2024-08-20T01:21:27.170 INFO:root:teuthology version: 1.2.0 2024-08-20T01:21:27.196 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-20T01:21:27.292 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/hyelloji-2024-08-19_19:57:23-fs-wip-hemanth-testing-2024-08-19-1357-distro-default-smithi/7861331 branch: wip-hemanth-testing-2024-08-19-1357 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/ffsb}} email: hyelloji@redhat.com first_in_suite: false job_id: '7861331' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: hyelloji-2024-08-19_19:57:23-fs-wip-hemanth-testing-2024-08-19-1357-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-hemanth-testing-2024-08-19-1357 ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: mds: mds_bal_replicate_threshold: 1 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 filestore flush min: 0 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd heartbeat grace: 60 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request - SLOW_OPS - slow request sha1: ef4275410d8483698016fe484b2a3c664080b4c1 subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.dir_split install: ceph: flavor: default sha1: ef4275410d8483698016fe484b2a3c664080b4c1 kclient: client.0: mount_subvol_num: 1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-hemanth-testing-2024-08-19-1357 sha1: ef4275410d8483698016fe484b2a3c664080b4c1 owner: scheduled_hyelloji@teuthology priority: 10 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7244 sha1: ef4275410d8483698016fe484b2a3c664080b4c1 sleep_before_teardown: 0 suite: fs suite_branch: wip-hemanth-testing-2024-08-19-1357 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_ef4275410d8483698016fe484b2a3c664080b4c1/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: ef4275410d8483698016fe484b2a3c664080b4c1 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi079.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP1OsPfqR9AppWfSH9vS2i1/bTxXYoE3nSA/nlcqRGKhHwB5/RLcTVGVx4bd77eNbQeTItJKvxu4zg9BuCjkIqA= smithi081.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFdVqId98QnILcnwHILPsQfR8RXUE6aZT901iXir+YwdUrPwLbrYnHtejL3VPYqwNBTjI3a7UpTk+ItdWjw+2MQ= smithi175.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDBU5BNCui9px3x5jFMA3j880OJ6a07Yuzr+m5iP/imj/qCdkNUrgGdUjPFbShDe+JuyJKVLx/HxsR+tGaNEmc8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/ffsb.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 67db276914d29505c9707d04f3a3b8fb9d8aee4b timestamp: 2024-08-19_19:57:23 tube: smithi user: hyelloji verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-20T01:21:27.293 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_ef4275410d8483698016fe484b2a3c664080b4c1/qa; will attempt to use it 2024-08-20T01:21:27.293 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_ef4275410d8483698016fe484b2a3c664080b4c1/qa/tasks 2024-08-20T01:21:27.294 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-20T01:21:27.295 INFO:teuthology.task.internal:Checking packages... 2024-08-20T01:21:27.317 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'ef4275410d8483698016fe484b2a3c664080b4c1' 2024-08-20T01:21:27.317 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-20T01:21:27.317 INFO:teuthology.packaging:ref: None 2024-08-20T01:21:27.317 INFO:teuthology.packaging:tag: None 2024-08-20T01:21:27.318 INFO:teuthology.packaging:branch: wip-hemanth-testing-2024-08-19-1357 2024-08-20T01:21:27.318 INFO:teuthology.packaging:sha1: ef4275410d8483698016fe484b2a3c664080b4c1 2024-08-20T01:21:27.318 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-hemanth-testing-2024-08-19-1357 2024-08-20T01:21:27.460 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-5872.gef427541 2024-08-20T01:21:27.462 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-20T01:21:27.468 INFO:teuthology.task.internal:no buildpackages task found 2024-08-20T01:21:27.468 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-20T01:21:27.476 INFO:teuthology.task.internal:Saving configuration 2024-08-20T01:21:27.496 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-20T01:21:27.504 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-20T01:21:27.527 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-08-19_19:57:23-fs-wip-hemanth-testing-2024-08-19-1357-distro-default-smithi/7861331', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-20 01:16:22.308051', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP1OsPfqR9AppWfSH9vS2i1/bTxXYoE3nSA/nlcqRGKhHwB5/RLcTVGVx4bd77eNbQeTItJKvxu4zg9BuCjkIqA='} 2024-08-20T01:21:27.551 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-08-19_19:57:23-fs-wip-hemanth-testing-2024-08-19-1357-distro-default-smithi/7861331', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-20 01:16:22.309722', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFdVqId98QnILcnwHILPsQfR8RXUE6aZT901iXir+YwdUrPwLbrYnHtejL3VPYqwNBTjI3a7UpTk+ItdWjw+2MQ='} 2024-08-20T01:21:27.574 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-08-19_19:57:23-fs-wip-hemanth-testing-2024-08-19-1357-distro-default-smithi/7861331', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-20 01:16:22.310859', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDBU5BNCui9px3x5jFMA3j880OJ6a07Yuzr+m5iP/imj/qCdkNUrgGdUjPFbShDe+JuyJKVLx/HxsR+tGaNEmc8='} 2024-08-20T01:21:27.574 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-20T01:21:27.581 INFO:teuthology.task.internal:roles: ubuntu@smithi079.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-08-20T01:21:27.582 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-08-20T01:21:27.582 INFO:teuthology.task.internal:roles: ubuntu@smithi175.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-08-20T01:21:27.582 INFO:teuthology.run_tasks:Running task console_log... 2024-08-20T01:21:27.678 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff3f9587be0>, signals=[15]) 2024-08-20T01:21:27.678 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-20T01:21:27.685 INFO:teuthology.task.internal:Opening connections... 2024-08-20T01:21:27.685 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi079.front.sepia.ceph.com 2024-08-20T01:21:27.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-20T01:21:27.768 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi081.front.sepia.ceph.com 2024-08-20T01:21:27.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-20T01:21:27.842 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi175.front.sepia.ceph.com 2024-08-20T01:21:27.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-20T01:21:27.916 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-20T01:21:27.923 DEBUG:teuthology.orchestra.run.smithi079:> uname -m 2024-08-20T01:21:27.941 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2024-08-20T01:21:27.942 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2024-08-20T01:21:27.999 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Stream" 2024-08-20T01:21:28.000 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="9" 2024-08-20T01:21:28.000 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos" 2024-08-20T01:21:28.000 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora" 2024-08-20T01:21:28.000 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="9" 2024-08-20T01:21:28.000 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el9" 2024-08-20T01:21:28.000 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-20T01:21:28.000 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2024-08-20T01:21:28.000 INFO:teuthology.orchestra.run.smithi079.stdout:LOGO="fedora-logo-icon" 2024-08-20T01:21:28.000 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-20T01:21:28.000 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/" 2024-08-20T01:21:28.000 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-20T01:21:28.001 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-20T01:21:28.001 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-20T01:21:28.001 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2024-08-20T01:21:28.026 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2024-08-20T01:21:28.045 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2024-08-20T01:21:28.045 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2024-08-20T01:21:28.103 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream" 2024-08-20T01:21:28.103 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="9" 2024-08-20T01:21:28.103 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos" 2024-08-20T01:21:28.103 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora" 2024-08-20T01:21:28.103 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="9" 2024-08-20T01:21:28.103 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el9" 2024-08-20T01:21:28.103 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-20T01:21:28.104 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2024-08-20T01:21:28.104 INFO:teuthology.orchestra.run.smithi081.stdout:LOGO="fedora-logo-icon" 2024-08-20T01:21:28.104 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-20T01:21:28.104 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/" 2024-08-20T01:21:28.104 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-20T01:21:28.104 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-20T01:21:28.104 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-20T01:21:28.105 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2024-08-20T01:21:28.135 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2024-08-20T01:21:28.153 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2024-08-20T01:21:28.154 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2024-08-20T01:21:28.212 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream" 2024-08-20T01:21:28.212 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="9" 2024-08-20T01:21:28.212 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos" 2024-08-20T01:21:28.212 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora" 2024-08-20T01:21:28.212 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="9" 2024-08-20T01:21:28.212 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el9" 2024-08-20T01:21:28.213 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-20T01:21:28.213 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2024-08-20T01:21:28.213 INFO:teuthology.orchestra.run.smithi175.stdout:LOGO="fedora-logo-icon" 2024-08-20T01:21:28.213 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-20T01:21:28.213 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/" 2024-08-20T01:21:28.213 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-20T01:21:28.213 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-20T01:21:28.213 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-20T01:21:28.214 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2024-08-20T01:21:28.235 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-20T01:21:28.247 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-20T01:21:28.253 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-20T01:21:28.254 DEBUG:teuthology.orchestra.run.smithi079:> test '!' -e /home/ubuntu/cephtest 2024-08-20T01:21:28.258 DEBUG:teuthology.orchestra.run.smithi081:> test '!' -e /home/ubuntu/cephtest 2024-08-20T01:21:28.260 DEBUG:teuthology.orchestra.run.smithi175:> test '!' -e /home/ubuntu/cephtest 2024-08-20T01:21:28.277 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-20T01:21:28.284 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-20T01:21:28.284 DEBUG:teuthology.orchestra.run.smithi079:> test -z $(ls -A /var/lib/ceph) 2024-08-20T01:21:28.314 DEBUG:teuthology.orchestra.run.smithi081:> test -z $(ls -A /var/lib/ceph) 2024-08-20T01:21:28.318 DEBUG:teuthology.orchestra.run.smithi175:> test -z $(ls -A /var/lib/ceph) 2024-08-20T01:21:28.489 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-20T01:21:28.566 INFO:teuthology.run_tasks:Running task kernel... 2024-08-20T01:21:28.582 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-08-20T01:21:28.582 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-08-20T01:21:28.582 DEBUG:teuthology.orchestra.run.smithi079:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-20T01:21:28.583 DEBUG:teuthology.orchestra.run.smithi081:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-20T01:21:28.583 DEBUG:teuthology.orchestra.run.smithi175:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-20T01:21:28.600 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-20T01:21:28.600 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-08-20T01:21:28.601 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-20T01:21:28.602 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-20T01:21:28.602 DEBUG:teuthology.orchestra.run.smithi175:> uname -r 2024-08-20T01:21:28.602 DEBUG:teuthology.orchestra.run.smithi079:> uname -r 2024-08-20T01:21:28.658 INFO:teuthology.orchestra.run.smithi081.stdout:5.14.0-496.el9.x86_64 2024-08-20T01:21:28.658 INFO:teuthology.task.kernel:Running kernel on smithi081: 5.14.0-496.el9.x86_64 2024-08-20T01:21:28.658 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum install -y kernel 2024-08-20T01:21:28.660 INFO:teuthology.orchestra.run.smithi079.stdout:5.14.0-496.el9.x86_64 2024-08-20T01:21:28.660 INFO:teuthology.task.kernel:Running kernel on smithi079: 5.14.0-496.el9.x86_64 2024-08-20T01:21:28.660 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum install -y kernel 2024-08-20T01:21:28.661 INFO:teuthology.orchestra.run.smithi175.stdout:5.14.0-496.el9.x86_64 2024-08-20T01:21:28.661 INFO:teuthology.task.kernel:Running kernel on smithi175: 5.14.0-496.el9.x86_64 2024-08-20T01:21:28.661 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum install -y kernel 2024-08-20T01:21:33.834 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - BaseOS 2.5 MB/s | 8.2 MB 00:03 2024-08-20T01:21:35.600 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - BaseOS 1.6 MB/s | 8.2 MB 00:05 2024-08-20T01:21:35.814 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - BaseOS 1.6 MB/s | 8.2 MB 00:05 2024-08-20T01:21:37.278 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - AppStream 8.6 MB/s | 20 MB 00:02 2024-08-20T01:21:39.581 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - AppStream 7.0 MB/s | 20 MB 00:02 2024-08-20T01:21:43.378 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - CRB 2.9 MB/s | 6.6 MB 00:02 2024-08-20T01:21:44.231 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - AppStream 2.8 MB/s | 20 MB 00:07 2024-08-20T01:21:44.978 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - Extras packages 69 kB/s | 18 kB 00:00 2024-08-20T01:21:46.016 INFO:teuthology.orchestra.run.smithi079.stdout:Extra Packages for Enterprise Linux 24 MB/s | 22 MB 00:00 2024-08-20T01:21:49.753 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - CRB 1.0 MB/s | 6.6 MB 00:06 2024-08-20T01:21:51.353 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - Extras packages 75 kB/s | 18 kB 00:00 2024-08-20T01:21:51.355 INFO:teuthology.orchestra.run.smithi079.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-08-20T01:21:52.166 INFO:teuthology.orchestra.run.smithi175.stdout:Extra Packages for Enterprise Linux 32 MB/s | 22 MB 00:00 2024-08-20T01:21:52.612 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - CRB 1.4 MB/s | 6.6 MB 00:04 2024-08-20T01:21:53.277 INFO:teuthology.orchestra.run.smithi079.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-08-20T01:21:53.278 INFO:teuthology.orchestra.run.smithi079.stdout:Package kernel-5.14.0-496.el9.x86_64 is already installed. 2024-08-20T01:21:53.354 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-08-20T01:21:53.355 INFO:teuthology.orchestra.run.smithi079.stdout:Nothing to do. 2024-08-20T01:21:53.355 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-08-20T01:21:53.465 DEBUG:teuthology.orchestra.run.smithi079:> echo no | sudo yum reinstall kernel || true 2024-08-20T01:21:54.014 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:00:03 ago on Tue 20 Aug 2024 01:21:51 AM UTC. 2024-08-20T01:21:54.147 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-08-20T01:21:54.154 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-08-20T01:21:54.154 INFO:teuthology.orchestra.run.smithi079.stdout: Package Architecture Version Repository Size 2024-08-20T01:21:54.154 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-08-20T01:21:54.154 INFO:teuthology.orchestra.run.smithi079.stdout:Reinstalling: 2024-08-20T01:21:54.154 INFO:teuthology.orchestra.run.smithi079.stdout: kernel x86_64 5.14.0-496.el9 baseos 1.8 M 2024-08-20T01:21:54.154 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:21:54.154 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-08-20T01:21:54.154 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-08-20T01:21:54.154 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:21:54.154 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 1.8 M 2024-08-20T01:21:54.155 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 0 2024-08-20T01:21:54.155 INFO:teuthology.orchestra.run.smithi079.stderr:Operation aborted. 2024-08-20T01:21:54.227 INFO:teuthology.orchestra.run.smithi079.stdout:Is this ok [y/N]: 2024-08-20T01:21:54.227 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum reinstall -y kernel || true 2024-08-20T01:21:54.313 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 18 kB 00:00 2024-08-20T01:21:54.773 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:00:03 ago on Tue 20 Aug 2024 01:21:51 AM UTC. 2024-08-20T01:21:54.896 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-08-20T01:21:54.897 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-08-20T01:21:54.897 INFO:teuthology.orchestra.run.smithi079.stdout: Package Architecture Version Repository Size 2024-08-20T01:21:54.897 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-08-20T01:21:54.897 INFO:teuthology.orchestra.run.smithi079.stdout:Reinstalling: 2024-08-20T01:21:54.897 INFO:teuthology.orchestra.run.smithi079.stdout: kernel x86_64 5.14.0-496.el9 baseos 1.8 M 2024-08-20T01:21:54.897 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:21:54.897 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-08-20T01:21:54.897 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-08-20T01:21:54.897 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:21:54.897 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 1.8 M 2024-08-20T01:21:54.897 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 0 2024-08-20T01:21:54.898 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-08-20T01:21:54.982 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] kernel-5.14.0-496.el9.x86_64.rpm: Status code: 404 for https://iad.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-496.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-20T01:21:55.000 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] kernel-5.14.0-496.el9.x86_64.rpm: Status code: 404 for http://iad.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-496.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-20T01:21:55.061 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] kernel-5.14.0-496.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-496.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:21:55.165 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] kernel-5.14.0-496.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-496.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:21:55.222 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] kernel-5.14.0-496.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-496.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:21:55.314 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] kernel-5.14.0-496.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-496.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:21:55.367 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 24 MB/s | 22 MB 00:00 2024-08-20T01:21:55.374 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] kernel-5.14.0-496.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-496.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T01:21:55.501 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] kernel-5.14.0-496.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-496.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T01:21:55.660 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] kernel-5.14.0-496.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-496.el9.x86_64.rpm (IP: 172.65.90.22) 2024-08-20T01:21:55.837 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] kernel-5.14.0-496.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-496.el9.x86_64.rpm (IP: 172.65.90.22) 2024-08-20T01:21:55.869 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] kernel-5.14.0-496.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-496.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T01:21:55.941 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] kernel-5.14.0-496.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-496.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T01:21:55.985 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] kernel-5.14.0-496.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-496.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:21:56.059 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] kernel-5.14.0-496.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-496.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:21:56.219 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] kernel-5.14.0-496.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-496.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:21:56.549 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] kernel-5.14.0-496.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-496.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:21:57.504 INFO:teuthology.orchestra.run.smithi175.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-08-20T01:21:58.239 INFO:teuthology.orchestra.run.smithi079.stdout:kernel-5.14.0-496.el9.x86_64.rpm 556 kB/s | 1.8 MB 00:03 2024-08-20T01:21:58.242 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-08-20T01:21:58.242 INFO:teuthology.orchestra.run.smithi079.stdout:Total 548 kB/s | 1.8 MB 00:03 2024-08-20T01:21:58.273 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-08-20T01:21:58.523 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-08-20T01:21:58.523 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-08-20T01:21:58.551 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-08-20T01:21:58.552 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-08-20T01:21:58.728 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-08-20T01:21:58.808 INFO:teuthology.orchestra.run.smithi079.stdout: Reinstalling : kernel-5.14.0-496.el9.x86_64 1/2 2024-08-20T01:21:58.808 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : kernel-5.14.0-496.el9.x86_64 2/2 2024-08-20T01:21:59.402 INFO:teuthology.orchestra.run.smithi175.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-08-20T01:21:59.402 INFO:teuthology.orchestra.run.smithi175.stdout:Package kernel-5.14.0-496.el9.x86_64 is already installed. 2024-08-20T01:21:59.487 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-08-20T01:21:59.488 INFO:teuthology.orchestra.run.smithi175.stdout:Nothing to do. 2024-08-20T01:21:59.489 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-08-20T01:21:59.534 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: kernel-5.14.0-496.el9.x86_64 2/2 2024-08-20T01:21:59.534 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : kernel-5.14.0-496.el9.x86_64 1/2 2024-08-20T01:21:59.603 DEBUG:teuthology.orchestra.run.smithi175:> echo no | sudo yum reinstall kernel || true 2024-08-20T01:22:00.153 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:00:03 ago on Tue 20 Aug 2024 01:21:57 AM UTC. 2024-08-20T01:22:00.265 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : kernel-5.14.0-496.el9.x86_64 2/2 2024-08-20T01:22:00.265 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:22:00.265 INFO:teuthology.orchestra.run.smithi079.stdout:Reinstalled: 2024-08-20T01:22:00.265 INFO:teuthology.orchestra.run.smithi079.stdout: kernel-5.14.0-496.el9.x86_64 2024-08-20T01:22:00.265 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:22:00.265 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-08-20T01:22:00.295 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-08-20T01:22:00.301 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-08-20T01:22:00.301 INFO:teuthology.orchestra.run.smithi175.stdout: Package Architecture Version Repository Size 2024-08-20T01:22:00.301 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-08-20T01:22:00.301 INFO:teuthology.orchestra.run.smithi175.stdout:Reinstalling: 2024-08-20T01:22:00.301 INFO:teuthology.orchestra.run.smithi175.stdout: kernel x86_64 5.14.0-496.el9 baseos 1.8 M 2024-08-20T01:22:00.301 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-08-20T01:22:00.301 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-08-20T01:22:00.302 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-08-20T01:22:00.302 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-08-20T01:22:00.302 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 1.8 M 2024-08-20T01:22:00.302 INFO:teuthology.orchestra.run.smithi175.stdout:Installed size: 0 2024-08-20T01:22:00.302 INFO:teuthology.orchestra.run.smithi175.stderr:Operation aborted. 2024-08-20T01:22:00.358 INFO:teuthology.orchestra.run.smithi175.stdout:Is this ok [y/N]: 2024-08-20T01:22:00.358 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum reinstall -y kernel || true 2024-08-20T01:22:00.460 DEBUG:teuthology.orchestra.run.smithi079:> rpm -q kernel | sort -rV | head -n 1 2024-08-20T01:22:00.518 INFO:teuthology.orchestra.run.smithi079.stdout:kernel-5.14.0-496.el9.x86_64 2024-08-20T01:22:00.519 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-496.el9.x86_64 2024-08-20T01:22:00.519 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-08-20T01:22:00.519 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-08-20T01:22:00.519 DEBUG:teuthology.orchestra.run.smithi079:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-20T01:22:00.553 INFO:teuthology.orchestra.run.smithi079.stdout:ttyS1 2024-08-20T01:22:00.576 DEBUG:teuthology.parallel:result is None 2024-08-20T01:22:00.681 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-08-20T01:22:00.908 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:00:03 ago on Tue 20 Aug 2024 01:21:57 AM UTC. 2024-08-20T01:22:01.031 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-08-20T01:22:01.032 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-08-20T01:22:01.032 INFO:teuthology.orchestra.run.smithi175.stdout: Package Architecture Version Repository Size 2024-08-20T01:22:01.032 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-08-20T01:22:01.032 INFO:teuthology.orchestra.run.smithi175.stdout:Reinstalling: 2024-08-20T01:22:01.032 INFO:teuthology.orchestra.run.smithi175.stdout: kernel x86_64 5.14.0-496.el9 baseos 1.8 M 2024-08-20T01:22:01.032 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-08-20T01:22:01.033 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-08-20T01:22:01.033 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-08-20T01:22:01.033 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-08-20T01:22:01.033 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 1.8 M 2024-08-20T01:22:01.033 INFO:teuthology.orchestra.run.smithi175.stdout:Installed size: 0 2024-08-20T01:22:01.033 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2024-08-20T01:22:01.113 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] kernel-5.14.0-496.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-496.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-20T01:22:01.171 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] kernel-5.14.0-496.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-496.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T01:22:01.297 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] kernel-5.14.0-496.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-496.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T01:22:01.458 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] kernel-5.14.0-496.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-496.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:22:01.787 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] kernel-5.14.0-496.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-496.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:22:01.843 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] kernel-5.14.0-496.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-496.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:22:01.938 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] kernel-5.14.0-496.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-496.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:22:01.969 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] kernel-5.14.0-496.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-496.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T01:22:02.043 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] kernel-5.14.0-496.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-496.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T01:22:02.587 INFO:teuthology.orchestra.run.smithi081.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-08-20T01:22:02.587 INFO:teuthology.orchestra.run.smithi081.stdout:Package kernel-5.14.0-496.el9.x86_64 is already installed. 2024-08-20T01:22:02.670 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-08-20T01:22:02.671 INFO:teuthology.orchestra.run.smithi081.stdout:Nothing to do. 2024-08-20T01:22:02.671 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-08-20T01:22:02.785 DEBUG:teuthology.orchestra.run.smithi081:> echo no | sudo yum reinstall kernel || true 2024-08-20T01:22:03.332 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:00:03 ago on Tue 20 Aug 2024 01:22:00 AM UTC. 2024-08-20T01:22:03.481 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-08-20T01:22:03.488 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-08-20T01:22:03.488 INFO:teuthology.orchestra.run.smithi081.stdout: Package Architecture Version Repository Size 2024-08-20T01:22:03.488 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-08-20T01:22:03.488 INFO:teuthology.orchestra.run.smithi081.stdout:Reinstalling: 2024-08-20T01:22:03.488 INFO:teuthology.orchestra.run.smithi081.stdout: kernel x86_64 5.14.0-496.el9 baseos 1.8 M 2024-08-20T01:22:03.488 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-08-20T01:22:03.489 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-08-20T01:22:03.489 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-08-20T01:22:03.489 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-08-20T01:22:03.489 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 1.8 M 2024-08-20T01:22:03.489 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 0 2024-08-20T01:22:03.489 INFO:teuthology.orchestra.run.smithi081.stderr:Operation aborted. 2024-08-20T01:22:03.553 INFO:teuthology.orchestra.run.smithi081.stdout:Is this ok [y/N]: 2024-08-20T01:22:03.554 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum reinstall -y kernel || true 2024-08-20T01:22:04.101 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:00:04 ago on Tue 20 Aug 2024 01:22:00 AM UTC. 2024-08-20T01:22:04.225 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-08-20T01:22:04.226 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-08-20T01:22:04.226 INFO:teuthology.orchestra.run.smithi081.stdout: Package Architecture Version Repository Size 2024-08-20T01:22:04.227 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-08-20T01:22:04.227 INFO:teuthology.orchestra.run.smithi081.stdout:Reinstalling: 2024-08-20T01:22:04.227 INFO:teuthology.orchestra.run.smithi081.stdout: kernel x86_64 5.14.0-496.el9 baseos 1.8 M 2024-08-20T01:22:04.227 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-08-20T01:22:04.227 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-08-20T01:22:04.227 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-08-20T01:22:04.227 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-08-20T01:22:04.227 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 1.8 M 2024-08-20T01:22:04.227 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 0 2024-08-20T01:22:04.227 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-08-20T01:22:04.656 INFO:teuthology.orchestra.run.smithi175.stdout:kernel-5.14.0-496.el9.x86_64.rpm 512 kB/s | 1.8 MB 00:03 2024-08-20T01:22:04.658 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2024-08-20T01:22:04.658 INFO:teuthology.orchestra.run.smithi175.stdout:Total 505 kB/s | 1.8 MB 00:03 2024-08-20T01:22:04.690 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2024-08-20T01:22:04.953 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2024-08-20T01:22:04.953 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2024-08-20T01:22:04.982 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2024-08-20T01:22:04.982 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2024-08-20T01:22:05.130 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2024-08-20T01:22:05.216 INFO:teuthology.orchestra.run.smithi175.stdout: Reinstalling : kernel-5.14.0-496.el9.x86_64 1/2 2024-08-20T01:22:05.216 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : kernel-5.14.0-496.el9.x86_64 2/2 2024-08-20T01:22:05.912 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: kernel-5.14.0-496.el9.x86_64 2/2 2024-08-20T01:22:05.913 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : kernel-5.14.0-496.el9.x86_64 1/2 2024-08-20T01:22:06.596 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : kernel-5.14.0-496.el9.x86_64 2/2 2024-08-20T01:22:06.596 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-08-20T01:22:06.596 INFO:teuthology.orchestra.run.smithi175.stdout:Reinstalled: 2024-08-20T01:22:06.596 INFO:teuthology.orchestra.run.smithi175.stdout: kernel-5.14.0-496.el9.x86_64 2024-08-20T01:22:06.596 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-08-20T01:22:06.596 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-08-20T01:22:06.807 DEBUG:teuthology.orchestra.run.smithi175:> rpm -q kernel | sort -rV | head -n 1 2024-08-20T01:22:06.865 INFO:teuthology.orchestra.run.smithi175.stdout:kernel-5.14.0-496.el9.x86_64 2024-08-20T01:22:06.866 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-496.el9.x86_64 2024-08-20T01:22:06.866 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-08-20T01:22:06.866 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-08-20T01:22:06.866 DEBUG:teuthology.orchestra.run.smithi175:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-20T01:22:06.907 INFO:teuthology.orchestra.run.smithi175.stdout:ttyS1 2024-08-20T01:22:06.928 DEBUG:teuthology.parallel:result is None 2024-08-20T01:22:07.083 INFO:teuthology.orchestra.run.smithi081.stdout:kernel-5.14.0-496.el9.x86_64.rpm 667 kB/s | 1.8 MB 00:02 2024-08-20T01:22:07.084 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-08-20T01:22:07.084 INFO:teuthology.orchestra.run.smithi081.stdout:Total 641 kB/s | 1.8 MB 00:02 2024-08-20T01:22:07.114 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-08-20T01:22:07.377 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-08-20T01:22:07.377 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-08-20T01:22:07.406 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-08-20T01:22:07.407 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-08-20T01:22:07.562 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-08-20T01:22:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: Reinstalling : kernel-5.14.0-496.el9.x86_64 1/2 2024-08-20T01:22:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : kernel-5.14.0-496.el9.x86_64 2/2 2024-08-20T01:22:08.352 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-5.14.0-496.el9.x86_64 2/2 2024-08-20T01:22:08.352 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-5.14.0-496.el9.x86_64 1/2 2024-08-20T01:22:09.013 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-5.14.0-496.el9.x86_64 2/2 2024-08-20T01:22:09.013 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-08-20T01:22:09.013 INFO:teuthology.orchestra.run.smithi081.stdout:Reinstalled: 2024-08-20T01:22:09.013 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-5.14.0-496.el9.x86_64 2024-08-20T01:22:09.013 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-08-20T01:22:09.013 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-08-20T01:22:09.197 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q kernel | sort -rV | head -n 1 2024-08-20T01:22:09.255 INFO:teuthology.orchestra.run.smithi081.stdout:kernel-5.14.0-496.el9.x86_64 2024-08-20T01:22:09.255 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-496.el9.x86_64 2024-08-20T01:22:09.255 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-08-20T01:22:09.255 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-08-20T01:22:09.256 DEBUG:teuthology.orchestra.run.smithi081:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-20T01:22:09.290 INFO:teuthology.orchestra.run.smithi081.stdout:ttyS1 2024-08-20T01:22:09.310 DEBUG:teuthology.parallel:result is None 2024-08-20T01:22:09.310 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-20T01:22:09.321 INFO:teuthology.task.internal:Creating test directory... 2024-08-20T01:22:09.321 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-20T01:22:09.325 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-20T01:22:09.352 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-20T01:22:09.371 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-20T01:22:09.975 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-20T01:22:10.789 INFO:teuthology.task.internal:Creating archive directory... 2024-08-20T01:22:10.789 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-20T01:22:10.792 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-20T01:22:10.795 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-20T01:22:10.868 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-20T01:22:10.875 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-20T01:22:10.875 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-20T01:22:10.877 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-20T01:22:10.880 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-20T01:22:10.911 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-20T01:22:10.923 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-20T01:22:10.924 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-20T01:22:10.934 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-20T01:22:10.936 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-20T01:22:10.946 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-20T01:22:10.948 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-20T01:22:10.956 INFO:teuthology.task.internal:Configuring sudo... 2024-08-20T01:22:10.956 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-20T01:22:10.959 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-20T01:22:10.961 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-20T01:22:10.992 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-20T01:22:11.003 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-20T01:22:11.003 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-20T01:22:11.027 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-20T01:22:11.030 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-20T01:22:11.050 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-20T01:22:11.127 DEBUG:teuthology.orchestra.run.smithi079:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-20T01:22:11.177 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-20T01:22:11.260 DEBUG:teuthology.orchestra.run.smithi079:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-20T01:22:11.300 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-08-20T01:22:11.300 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-20T01:22:11.366 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-20T01:22:11.409 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-20T01:22:11.465 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-20T01:22:11.541 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-20T01:22:11.591 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-08-20T01:22:11.591 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-20T01:22:11.658 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-20T01:22:11.703 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-20T01:22:11.758 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-20T01:22:11.842 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-20T01:22:11.885 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-08-20T01:22:11.885 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-20T01:22:11.950 DEBUG:teuthology.orchestra.run.smithi079:> sudo service rsyslog restart 2024-08-20T01:22:11.953 DEBUG:teuthology.orchestra.run.smithi081:> sudo service rsyslog restart 2024-08-20T01:22:11.955 DEBUG:teuthology.orchestra.run.smithi175:> sudo service rsyslog restart 2024-08-20T01:22:11.993 INFO:teuthology.orchestra.run.smithi079.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-20T01:22:12.012 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-20T01:22:12.025 INFO:teuthology.orchestra.run.smithi175.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-20T01:22:12.474 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-20T01:22:12.482 INFO:teuthology.task.internal:Starting timer... 2024-08-20T01:22:12.482 INFO:teuthology.run_tasks:Running task pcp... 2024-08-20T01:22:12.493 INFO:teuthology.run_tasks:Running task selinux... 2024-08-20T01:22:12.502 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-08-20T01:22:12.502 DEBUG:teuthology.orchestra.run.smithi079:> sudo service auditd rotate 2024-08-20T01:22:12.563 INFO:teuthology.orchestra.run.smithi079.stdout:Rotating logs: 2024-08-20T01:22:12.565 DEBUG:teuthology.orchestra.run.smithi081:> sudo service auditd rotate 2024-08-20T01:22:12.602 INFO:teuthology.orchestra.run.smithi081.stdout:Rotating logs: 2024-08-20T01:22:12.604 DEBUG:teuthology.orchestra.run.smithi175:> sudo service auditd rotate 2024-08-20T01:22:12.666 INFO:teuthology.orchestra.run.smithi175.stdout:Rotating logs: 2024-08-20T01:22:12.668 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-20T01:22:12.668 DEBUG:teuthology.orchestra.run.smithi079:> /usr/sbin/getenforce 2024-08-20T01:22:12.696 INFO:teuthology.orchestra.run.smithi079.stdout:Permissive 2024-08-20T01:22:12.696 DEBUG:teuthology.orchestra.run.smithi081:> /usr/sbin/getenforce 2024-08-20T01:22:12.716 INFO:teuthology.orchestra.run.smithi081.stdout:Permissive 2024-08-20T01:22:12.716 DEBUG:teuthology.orchestra.run.smithi175:> /usr/sbin/getenforce 2024-08-20T01:22:12.736 INFO:teuthology.orchestra.run.smithi175.stdout:Permissive 2024-08-20T01:22:12.736 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi079.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi081.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi175.front.sepia.ceph.com': 'permissive'} 2024-08-20T01:22:12.736 DEBUG:teuthology.orchestra.run.smithi079:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-20T01:22:12.764 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-20T01:22:12.764 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-20T01:22:12.789 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-20T01:22:12.789 DEBUG:teuthology.orchestra.run.smithi175:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-20T01:22:12.814 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-20T01:22:12.814 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-20T01:22:12.815 DEBUG:teuthology.orchestra.run.smithi079:> sudo /usr/sbin/setenforce permissive 2024-08-20T01:22:12.856 DEBUG:teuthology.orchestra.run.smithi081:> sudo /usr/sbin/setenforce permissive 2024-08-20T01:22:12.885 DEBUG:teuthology.orchestra.run.smithi175:> sudo /usr/sbin/setenforce permissive 2024-08-20T01:22:12.909 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-20T01:22:12.920 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-20T01:22:12.932 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-20T01:22:12.933 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi079.front.sepia.ceph.com,smithi081.front.sepia.ceph.com,smithi175.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-20T01:23:56.343 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi079.front.sepia.ceph.com'), Remote(name='ubuntu@smithi081.front.sepia.ceph.com'), Remote(name='ubuntu@smithi175.front.sepia.ceph.com')] 2024-08-20T01:23:56.344 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-08-20T01:23:56.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-20T01:23:56.424 DEBUG:teuthology.orchestra.run.smithi079:> true 2024-08-20T01:23:56.502 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-08-20T01:23:56.502 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-08-20T01:23:56.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-20T01:23:56.578 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-08-20T01:23:56.658 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-08-20T01:23:56.659 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-08-20T01:23:56.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-20T01:23:56.736 DEBUG:teuthology.orchestra.run.smithi175:> true 2024-08-20T01:23:56.819 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-08-20T01:23:56.820 INFO:teuthology.run_tasks:Running task clock... 2024-08-20T01:23:56.830 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-20T01:23:56.830 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-20T01:23:56.831 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-20T01:23:56.833 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-20T01:23:56.833 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-20T01:23:56.836 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-20T01:23:56.836 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-20T01:23:56.860 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-20T01:23:56.865 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-20T01:23:56.874 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-20T01:23:56.881 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-20T01:23:56.892 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-20T01:23:56.898 INFO:teuthology.orchestra.run.smithi079.stderr:sudo: ntpd: command not found 2024-08-20T01:23:56.905 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: ntpd: command not found 2024-08-20T01:23:56.907 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-20T01:23:56.909 INFO:teuthology.orchestra.run.smithi079.stdout:506 Cannot talk to daemon 2024-08-20T01:23:56.917 INFO:teuthology.orchestra.run.smithi081.stdout:506 Cannot talk to daemon 2024-08-20T01:23:56.924 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-20T01:23:56.931 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-20T01:23:56.933 INFO:teuthology.orchestra.run.smithi175.stderr:sudo: ntpd: command not found 2024-08-20T01:23:56.937 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-20T01:23:56.944 INFO:teuthology.orchestra.run.smithi175.stdout:506 Cannot talk to daemon 2024-08-20T01:23:56.945 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-20T01:23:56.959 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-20T01:23:56.973 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-20T01:23:56.994 INFO:teuthology.orchestra.run.smithi079.stderr:bash: line 1: ntpq: command not found 2024-08-20T01:23:56.997 INFO:teuthology.orchestra.run.smithi079.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-20T01:23:56.997 INFO:teuthology.orchestra.run.smithi079.stdout:=============================================================================== 2024-08-20T01:23:56.997 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T01:23:56.998 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T01:23:56.998 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T01:23:56.998 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T01:23:57.001 INFO:teuthology.orchestra.run.smithi081.stderr:bash: line 1: ntpq: command not found 2024-08-20T01:23:57.005 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-20T01:23:57.005 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2024-08-20T01:23:57.005 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T01:23:57.005 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T01:23:57.005 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T01:23:57.005 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T01:23:57.025 INFO:teuthology.orchestra.run.smithi175.stderr:bash: line 1: ntpq: command not found 2024-08-20T01:23:57.028 INFO:teuthology.orchestra.run.smithi175.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-20T01:23:57.028 INFO:teuthology.orchestra.run.smithi175.stdout:=============================================================================== 2024-08-20T01:23:57.028 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T01:23:57.028 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T01:23:57.028 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T01:23:57.029 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T01:23:57.029 INFO:teuthology.run_tasks:Running task install... 2024-08-20T01:23:57.038 DEBUG:teuthology.task.install:project ceph 2024-08-20T01:23:57.038 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ef4275410d8483698016fe484b2a3c664080b4c1'}} 2024-08-20T01:23:57.038 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ef4275410d8483698016fe484b2a3c664080b4c1'} 2024-08-20T01:23:57.038 INFO:teuthology.task.install:Using flavor: default 2024-08-20T01:23:57.043 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-20T01:23:57.043 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-08-20T01:23:57.044 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ef4275410d8483698016fe484b2a3c664080b4c1', 'tag': None, 'wait_for_package': False} 2024-08-20T01:23:57.044 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ef4275410d8483698016fe484b2a3c664080b4c1 2024-08-20T01:23:57.046 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ef4275410d8483698016fe484b2a3c664080b4c1', 'tag': None, 'wait_for_package': False} 2024-08-20T01:23:57.046 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ef4275410d8483698016fe484b2a3c664080b4c1 2024-08-20T01:23:57.047 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ef4275410d8483698016fe484b2a3c664080b4c1', 'tag': None, 'wait_for_package': False} 2024-08-20T01:23:57.048 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ef4275410d8483698016fe484b2a3c664080b4c1 2024-08-20T01:23:57.183 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/flavors/default/ 2024-08-20T01:23:57.184 INFO:teuthology.task.install.rpm:Package version is 19.0.0-5872.gef427541 2024-08-20T01:23:57.200 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/flavors/default/ 2024-08-20T01:23:57.200 INFO:teuthology.task.install.rpm:Package version is 19.0.0-5872.gef427541 2024-08-20T01:23:57.203 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/flavors/default/ 2024-08-20T01:23:57.203 INFO:teuthology.task.install.rpm:Package version is 19.0.0-5872.gef427541 2024-08-20T01:23:57.293 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-20T01:23:57.294 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-08-20T01:23:57.294 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-20T01:23:57.309 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-20T01:23:57.310 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-08-20T01:23:57.310 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-20T01:23:57.314 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-20T01:23:57.314 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-08-20T01:23:57.314 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-20T01:23:57.319 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-20T01:23:57.319 DEBUG:teuthology.orchestra.run.smithi079:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ef4275410d8483698016fe484b2a3c664080b4c1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-20T01:23:57.335 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-20T01:23:57.335 DEBUG:teuthology.orchestra.run.smithi175:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ef4275410d8483698016fe484b2a3c664080b4c1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-20T01:23:57.339 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-20T01:23:57.339 DEBUG:teuthology.orchestra.run.smithi081:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ef4275410d8483698016fe484b2a3c664080b4c1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-20T01:23:57.385 DEBUG:teuthology.orchestra.run.smithi079:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-20T01:23:57.401 DEBUG:teuthology.orchestra.run.smithi175:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-20T01:23:57.404 DEBUG:teuthology.orchestra.run.smithi081:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-20T01:23:57.459 DEBUG:teuthology.orchestra.run.smithi079:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-20T01:23:57.476 DEBUG:teuthology.orchestra.run.smithi175:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-20T01:23:57.479 DEBUG:teuthology.orchestra.run.smithi081:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-20T01:23:57.522 INFO:teuthology.orchestra.run.smithi079.stdout:check_obsoletes = 1 2024-08-20T01:23:57.524 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum clean all 2024-08-20T01:23:57.540 INFO:teuthology.orchestra.run.smithi175.stdout:check_obsoletes = 1 2024-08-20T01:23:57.542 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum clean all 2024-08-20T01:23:57.543 INFO:teuthology.orchestra.run.smithi081.stdout:check_obsoletes = 1 2024-08-20T01:23:57.545 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum clean all 2024-08-20T01:23:57.748 INFO:teuthology.orchestra.run.smithi079.stdout:45 files removed 2024-08-20T01:23:57.766 INFO:teuthology.orchestra.run.smithi175.stdout:45 files removed 2024-08-20T01:23:57.770 INFO:teuthology.orchestra.run.smithi081.stdout:45 files removed 2024-08-20T01:23:57.774 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-20T01:23:57.793 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-20T01:23:57.796 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-20T01:23:58.318 INFO:teuthology.orchestra.run.smithi079.stdout:ceph packages for x86_64 312 kB/s | 84 kB 00:00 2024-08-20T01:23:58.332 INFO:teuthology.orchestra.run.smithi175.stdout:ceph packages for x86_64 317 kB/s | 84 kB 00:00 2024-08-20T01:23:58.341 INFO:teuthology.orchestra.run.smithi081.stdout:ceph packages for x86_64 312 kB/s | 84 kB 00:00 2024-08-20T01:23:58.624 INFO:teuthology.orchestra.run.smithi175.stdout:ceph noarch packages 96 kB/s | 24 kB 00:00 2024-08-20T01:23:58.625 INFO:teuthology.orchestra.run.smithi081.stdout:ceph noarch packages 100 kB/s | 24 kB 00:00 2024-08-20T01:23:58.627 INFO:teuthology.orchestra.run.smithi079.stdout:ceph noarch packages 90 kB/s | 24 kB 00:00 2024-08-20T01:23:58.891 INFO:teuthology.orchestra.run.smithi175.stdout:ceph source packages 8.3 kB/s | 1.9 kB 00:00 2024-08-20T01:23:58.901 INFO:teuthology.orchestra.run.smithi081.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-08-20T01:23:58.902 INFO:teuthology.orchestra.run.smithi079.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-08-20T01:24:02.651 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - BaseOS 2.2 MB/s | 8.2 MB 00:03 2024-08-20T01:24:03.142 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - BaseOS 2.0 MB/s | 8.2 MB 00:04 2024-08-20T01:24:04.845 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - BaseOS 1.4 MB/s | 8.2 MB 00:05 2024-08-20T01:24:09.358 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - AppStream 4.0 MB/s | 20 MB 00:05 2024-08-20T01:24:11.711 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - AppStream 2.5 MB/s | 20 MB 00:07 2024-08-20T01:24:12.503 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - AppStream 3.1 MB/s | 20 MB 00:06 2024-08-20T01:24:15.833 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - CRB 2.5 MB/s | 6.6 MB 00:02 2024-08-20T01:24:17.597 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 18 kB 00:00 2024-08-20T01:24:18.435 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - CRB 3.0 MB/s | 6.6 MB 00:02 2024-08-20T01:24:18.642 INFO:teuthology.orchestra.run.smithi175.stdout:Extra Packages for Enterprise Linux 24 MB/s | 22 MB 00:00 2024-08-20T01:24:18.813 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - CRB 2.0 MB/s | 6.6 MB 00:03 2024-08-20T01:24:19.932 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - Extras packages 71 kB/s | 18 kB 00:00 2024-08-20T01:24:20.308 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - Extras packages 75 kB/s | 18 kB 00:00 2024-08-20T01:24:20.661 INFO:teuthology.orchestra.run.smithi079.stdout:Extra Packages for Enterprise Linux 37 MB/s | 22 MB 00:00 2024-08-20T01:24:21.355 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 24 MB/s | 22 MB 00:00 2024-08-20T01:24:23.973 INFO:teuthology.orchestra.run.smithi175.stdout:lab-extras 35 kB/s | 1.7 kB 00:00 2024-08-20T01:24:25.958 INFO:teuthology.orchestra.run.smithi079.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-08-20T01:24:26.124 INFO:teuthology.orchestra.run.smithi175.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-20T01:24:26.125 INFO:teuthology.orchestra.run.smithi175.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-20T01:24:26.137 INFO:teuthology.orchestra.run.smithi175.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-08-20T01:24:26.138 INFO:teuthology.orchestra.run.smithi175.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-20T01:24:26.139 INFO:teuthology.orchestra.run.smithi175.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-20T01:24:26.139 INFO:teuthology.orchestra.run.smithi175.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-20T01:24:26.141 INFO:teuthology.orchestra.run.smithi175.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-20T01:24:26.143 INFO:teuthology.orchestra.run.smithi175.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-20T01:24:26.144 INFO:teuthology.orchestra.run.smithi175.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-08-20T01:24:26.206 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-08-20T01:24:26.214 INFO:teuthology.orchestra.run.smithi175.stdout:======================================================================================= 2024-08-20T01:24:26.215 INFO:teuthology.orchestra.run.smithi175.stdout: Package Arch Version Repository Size 2024-08-20T01:24:26.215 INFO:teuthology.orchestra.run.smithi175.stdout:======================================================================================= 2024-08-20T01:24:26.215 INFO:teuthology.orchestra.run.smithi175.stdout:Installing: 2024-08-20T01:24:26.215 INFO:teuthology.orchestra.run.smithi175.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-20T01:24:26.215 INFO:teuthology.orchestra.run.smithi175.stdout: ceph x86_64 2:19.0.0-5872.gef427541.el9 ceph 6.6 k 2024-08-20T01:24:26.215 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base x86_64 2:19.0.0-5872.gef427541.el9 ceph 5.5 M 2024-08-20T01:24:26.215 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-fuse x86_64 2:19.0.0-5872.gef427541.el9 ceph 901 k 2024-08-20T01:24:26.215 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-5872.gef427541.el9 ceph 145 k 2024-08-20T01:24:26.215 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr x86_64 2:19.0.0-5872.gef427541.el9 ceph 1.5 M 2024-08-20T01:24:26.215 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-cephadm noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 150 k 2024-08-20T01:24:26.215 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 14 M 2024-08-20T01:24:26.215 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 7.4 M 2024-08-20T01:24:26.215 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-rook noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 49 k 2024-08-20T01:24:26.216 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-radosgw x86_64 2:19.0.0-5872.gef427541.el9 ceph 11 M 2024-08-20T01:24:26.216 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-test x86_64 2:19.0.0-5872.gef427541.el9 ceph 50 M 2024-08-20T01:24:26.216 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-volume noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 285 k 2024-08-20T01:24:26.216 INFO:teuthology.orchestra.run.smithi175.stdout: cephadm noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 772 k 2024-08-20T01:24:26.216 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-mirror x86_64 2:19.0.0-5872.gef427541.el9 ceph 225 k 2024-08-20T01:24:26.216 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-shell x86_64 2:19.0.0-5872.gef427541.el9 ceph 27 k 2024-08-20T01:24:26.216 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-top noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 18 k 2024-08-20T01:24:26.216 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-20T01:24:26.216 INFO:teuthology.orchestra.run.smithi175.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-20T01:24:26.216 INFO:teuthology.orchestra.run.smithi175.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-20T01:24:26.216 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs-devel x86_64 2:19.0.0-5872.gef427541.el9 ceph 32 k 2024-08-20T01:24:26.217 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs2 x86_64 2:19.0.0-5872.gef427541.el9 ceph 755 k 2024-08-20T01:24:26.217 INFO:teuthology.orchestra.run.smithi175.stdout: librados-devel x86_64 2:19.0.0-5872.gef427541.el9 ceph 126 k 2024-08-20T01:24:26.217 INFO:teuthology.orchestra.run.smithi175.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-20T01:24:26.217 INFO:teuthology.orchestra.run.smithi175.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-20T01:24:26.217 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-20T01:24:26.217 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-08-20T01:24:26.217 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-08-20T01:24:26.217 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-08-20T01:24:26.217 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cephfs x86_64 2:19.0.0-5872.gef427541.el9 ceph 188 k 2024-08-20T01:24:26.217 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados x86_64 2:19.0.0-5872.gef427541.el9 ceph 371 k 2024-08-20T01:24:26.217 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rbd x86_64 2:19.0.0-5872.gef427541.el9 ceph 355 k 2024-08-20T01:24:26.217 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rgw x86_64 2:19.0.0-5872.gef427541.el9 ceph 116 k 2024-08-20T01:24:26.218 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-fuse x86_64 2:19.0.0-5872.gef427541.el9 ceph 85 k 2024-08-20T01:24:26.218 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-mirror x86_64 2:19.0.0-5872.gef427541.el9 ceph 3.2 M 2024-08-20T01:24:26.218 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-nbd x86_64 2:19.0.0-5872.gef427541.el9 ceph 170 k 2024-08-20T01:24:26.218 INFO:teuthology.orchestra.run.smithi175.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-08-20T01:24:26.218 INFO:teuthology.orchestra.run.smithi175.stdout:Upgrading: 2024-08-20T01:24:26.218 INFO:teuthology.orchestra.run.smithi175.stdout: librados2 x86_64 2:19.0.0-5872.gef427541.el9 ceph 3.5 M 2024-08-20T01:24:26.218 INFO:teuthology.orchestra.run.smithi175.stdout: librbd1 x86_64 2:19.0.0-5872.gef427541.el9 ceph 3.2 M 2024-08-20T01:24:26.218 INFO:teuthology.orchestra.run.smithi175.stdout:Installing dependencies: 2024-08-20T01:24:26.218 INFO:teuthology.orchestra.run.smithi175.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-20T01:24:26.218 INFO:teuthology.orchestra.run.smithi175.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-20T01:24:26.219 INFO:teuthology.orchestra.run.smithi175.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-20T01:24:26.219 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-common x86_64 2:19.0.0-5872.gef427541.el9 ceph 22 M 2024-08-20T01:24:26.219 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-grafana-dashboards noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 34 k 2024-08-20T01:24:26.219 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mds x86_64 2:19.0.0-5872.gef427541.el9 ceph 2.4 M 2024-08-20T01:24:26.219 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 284 k 2024-08-20T01:24:26.219 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mon x86_64 2:19.0.0-5872.gef427541.el9 ceph 4.8 M 2024-08-20T01:24:26.219 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-osd x86_64 2:19.0.0-5872.gef427541.el9 ceph 17 M 2024-08-20T01:24:26.219 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-prometheus-alerts noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 16 k 2024-08-20T01:24:26.219 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-selinux x86_64 2:19.0.0-5872.gef427541.el9 ceph 25 k 2024-08-20T01:24:26.219 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-20T01:24:26.219 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-20T01:24:26.220 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-20T01:24:26.220 INFO:teuthology.orchestra.run.smithi175.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-20T01:24:26.220 INFO:teuthology.orchestra.run.smithi175.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-20T01:24:26.220 INFO:teuthology.orchestra.run.smithi175.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-20T01:24:26.220 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-20T01:24:26.220 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-20T01:24:26.220 INFO:teuthology.orchestra.run.smithi175.stdout: libcephsqlite x86_64 2:19.0.0-5872.gef427541.el9 ceph 163 k 2024-08-20T01:24:26.220 INFO:teuthology.orchestra.run.smithi175.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-08-20T01:24:26.220 INFO:teuthology.orchestra.run.smithi175.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-20T01:24:26.220 INFO:teuthology.orchestra.run.smithi175.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-20T01:24:26.221 INFO:teuthology.orchestra.run.smithi175.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-08-20T01:24:26.221 INFO:teuthology.orchestra.run.smithi175.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-20T01:24:26.221 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1 x86_64 2:19.0.0-5872.gef427541.el9 ceph 508 k 2024-08-20T01:24:26.221 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-20T01:24:26.221 INFO:teuthology.orchestra.run.smithi175.stdout: librgw2 x86_64 2:19.0.0-5872.gef427541.el9 ceph 5.5 M 2024-08-20T01:24:26.221 INFO:teuthology.orchestra.run.smithi175.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-20T01:24:26.221 INFO:teuthology.orchestra.run.smithi175.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-20T01:24:26.221 INFO:teuthology.orchestra.run.smithi175.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-20T01:24:26.221 INFO:teuthology.orchestra.run.smithi175.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-20T01:24:26.221 INFO:teuthology.orchestra.run.smithi175.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-20T01:24:26.221 INFO:teuthology.orchestra.run.smithi175.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-20T01:24:26.221 INFO:teuthology.orchestra.run.smithi175.stdout: openblas x86_64 0.3.26-1.el9 appstream 38 k 2024-08-20T01:24:26.222 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-openmp x86_64 0.3.26-1.el9 appstream 4.9 M 2024-08-20T01:24:26.222 INFO:teuthology.orchestra.run.smithi175.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-20T01:24:26.222 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-08-20T01:24:26.222 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-20T01:24:26.222 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-20T01:24:26.222 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-20T01:24:26.222 INFO:teuthology.orchestra.run.smithi175.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-20T01:24:26.222 INFO:teuthology.orchestra.run.smithi175.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-20T01:24:26.222 INFO:teuthology.orchestra.run.smithi175.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-20T01:24:26.222 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-20T01:24:26.222 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse x86_64 2:19.0.0-5872.gef427541.el9 ceph 45 k 2024-08-20T01:24:26.223 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common x86_64 2:19.0.0-5872.gef427541.el9 ceph 138 k 2024-08-20T01:24:26.223 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-20T01:24:26.223 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-20T01:24:26.223 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-20T01:24:26.223 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-20T01:24:26.223 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-20T01:24:26.223 INFO:teuthology.orchestra.run.smithi175.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-20T01:24:26.223 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-20T01:24:26.223 INFO:teuthology.orchestra.run.smithi175.stdout: python3-devel x86_64 3.9.19-7.el9 appstream 245 k 2024-08-20T01:24:26.223 INFO:teuthology.orchestra.run.smithi175.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-20T01:24:26.223 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-20T01:24:26.224 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-20T01:24:26.224 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-20T01:24:26.224 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-20T01:24:26.224 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-20T01:24:26.224 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-20T01:24:26.224 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-20T01:24:26.224 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-20T01:24:26.224 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-20T01:24:26.224 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-20T01:24:26.224 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-20T01:24:26.224 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-20T01:24:26.225 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-20T01:24:26.225 INFO:teuthology.orchestra.run.smithi175.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-20T01:24:26.225 INFO:teuthology.orchestra.run.smithi175.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-20T01:24:26.225 INFO:teuthology.orchestra.run.smithi175.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-20T01:24:26.225 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-20T01:24:26.225 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-20T01:24:26.225 INFO:teuthology.orchestra.run.smithi175.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-20T01:24:26.225 INFO:teuthology.orchestra.run.smithi175.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-20T01:24:26.225 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-20T01:24:26.226 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-20T01:24:26.226 INFO:teuthology.orchestra.run.smithi175.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-20T01:24:26.226 INFO:teuthology.orchestra.run.smithi175.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-20T01:24:26.226 INFO:teuthology.orchestra.run.smithi175.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-20T01:24:26.226 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-20T01:24:26.226 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-20T01:24:26.226 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-20T01:24:26.226 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-20T01:24:26.226 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-20T01:24:26.226 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-20T01:24:26.226 INFO:teuthology.orchestra.run.smithi175.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-20T01:24:26.226 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-20T01:24:26.227 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-20T01:24:26.227 INFO:teuthology.orchestra.run.smithi175.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-20T01:24:26.227 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-20T01:24:26.227 INFO:teuthology.orchestra.run.smithi175.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-20T01:24:26.227 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-20T01:24:26.227 INFO:teuthology.orchestra.run.smithi175.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-20T01:24:26.227 INFO:teuthology.orchestra.run.smithi175.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-20T01:24:26.227 INFO:teuthology.orchestra.run.smithi175.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-20T01:24:26.227 INFO:teuthology.orchestra.run.smithi175.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-20T01:24:26.228 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-20T01:24:26.228 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-20T01:24:26.228 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-20T01:24:26.228 INFO:teuthology.orchestra.run.smithi175.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-20T01:24:26.228 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-20T01:24:26.228 INFO:teuthology.orchestra.run.smithi175.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-20T01:24:26.228 INFO:teuthology.orchestra.run.smithi175.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-08-20T01:24:26.228 INFO:teuthology.orchestra.run.smithi175.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-20T01:24:26.228 INFO:teuthology.orchestra.run.smithi175.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-20T01:24:26.228 INFO:teuthology.orchestra.run.smithi175.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-20T01:24:26.228 INFO:teuthology.orchestra.run.smithi175.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-20T01:24:26.229 INFO:teuthology.orchestra.run.smithi175.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-20T01:24:26.229 INFO:teuthology.orchestra.run.smithi175.stdout:Installing weak dependencies: 2024-08-20T01:24:26.229 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-20T01:24:26.229 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-08-20T01:24:26.229 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-08-20T01:24:26.229 INFO:teuthology.orchestra.run.smithi175.stdout:======================================================================================= 2024-08-20T01:24:26.229 INFO:teuthology.orchestra.run.smithi175.stdout:Install 148 Packages 2024-08-20T01:24:26.229 INFO:teuthology.orchestra.run.smithi175.stdout:Upgrade 2 Packages 2024-08-20T01:24:26.230 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-08-20T01:24:26.230 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 232 M 2024-08-20T01:24:26.230 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2024-08-20T01:24:26.761 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-08-20T01:24:27.074 INFO:teuthology.orchestra.run.smithi175.stdout:(1/150): ceph-19.0.0-5872.gef427541.el9.x86_64. 55 kB/s | 6.6 kB 00:00 2024-08-20T01:24:27.291 INFO:teuthology.orchestra.run.smithi175.stdout:(2/150): ceph-fuse-19.0.0-5872.gef427541.el9.x8 4.1 MB/s | 901 kB 00:00 2024-08-20T01:24:27.357 INFO:teuthology.orchestra.run.smithi175.stdout:(3/150): ceph-immutable-object-cache-19.0.0-587 2.1 MB/s | 145 kB 00:00 2024-08-20T01:24:27.450 INFO:teuthology.orchestra.run.smithi175.stdout:(4/150): ceph-base-19.0.0-5872.gef427541.el9.x8 11 MB/s | 5.5 MB 00:00 2024-08-20T01:24:27.566 INFO:teuthology.orchestra.run.smithi175.stdout:(5/150): ceph-mds-19.0.0-5872.gef427541.el9.x86 11 MB/s | 2.4 MB 00:00 2024-08-20T01:24:27.600 INFO:teuthology.orchestra.run.smithi175.stdout:(6/150): ceph-mgr-19.0.0-5872.gef427541.el9.x86 10 MB/s | 1.5 MB 00:00 2024-08-20T01:24:27.984 INFO:teuthology.orchestra.run.smithi175.stdout:(7/150): ceph-mon-19.0.0-5872.gef427541.el9.x86 11 MB/s | 4.8 MB 00:00 2024-08-20T01:24:28.110 INFO:teuthology.orchestra.run.smithi079.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-20T01:24:28.110 INFO:teuthology.orchestra.run.smithi079.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-20T01:24:28.121 INFO:teuthology.orchestra.run.smithi079.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-08-20T01:24:28.122 INFO:teuthology.orchestra.run.smithi079.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-20T01:24:28.123 INFO:teuthology.orchestra.run.smithi079.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-20T01:24:28.124 INFO:teuthology.orchestra.run.smithi079.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-20T01:24:28.125 INFO:teuthology.orchestra.run.smithi079.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-20T01:24:28.128 INFO:teuthology.orchestra.run.smithi079.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-20T01:24:28.128 INFO:teuthology.orchestra.run.smithi079.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-08-20T01:24:28.188 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-08-20T01:24:28.196 INFO:teuthology.orchestra.run.smithi079.stdout:======================================================================================= 2024-08-20T01:24:28.196 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository Size 2024-08-20T01:24:28.197 INFO:teuthology.orchestra.run.smithi079.stdout:======================================================================================= 2024-08-20T01:24:28.197 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2024-08-20T01:24:28.197 INFO:teuthology.orchestra.run.smithi079.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-20T01:24:28.197 INFO:teuthology.orchestra.run.smithi079.stdout: ceph x86_64 2:19.0.0-5872.gef427541.el9 ceph 6.6 k 2024-08-20T01:24:28.197 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-base x86_64 2:19.0.0-5872.gef427541.el9 ceph 5.5 M 2024-08-20T01:24:28.197 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-fuse x86_64 2:19.0.0-5872.gef427541.el9 ceph 901 k 2024-08-20T01:24:28.197 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-5872.gef427541.el9 ceph 145 k 2024-08-20T01:24:28.197 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr x86_64 2:19.0.0-5872.gef427541.el9 ceph 1.5 M 2024-08-20T01:24:28.197 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-cephadm noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 150 k 2024-08-20T01:24:28.197 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-dashboard noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 14 M 2024-08-20T01:24:28.197 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 7.4 M 2024-08-20T01:24:28.197 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-rook noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 49 k 2024-08-20T01:24:28.197 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-radosgw x86_64 2:19.0.0-5872.gef427541.el9 ceph 11 M 2024-08-20T01:24:28.198 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-test x86_64 2:19.0.0-5872.gef427541.el9 ceph 50 M 2024-08-20T01:24:28.198 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-volume noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 285 k 2024-08-20T01:24:28.198 INFO:teuthology.orchestra.run.smithi079.stdout: cephadm noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 772 k 2024-08-20T01:24:28.198 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-mirror x86_64 2:19.0.0-5872.gef427541.el9 ceph 225 k 2024-08-20T01:24:28.198 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-shell x86_64 2:19.0.0-5872.gef427541.el9 ceph 27 k 2024-08-20T01:24:28.198 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-top noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 18 k 2024-08-20T01:24:28.198 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-20T01:24:28.198 INFO:teuthology.orchestra.run.smithi079.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-20T01:24:28.198 INFO:teuthology.orchestra.run.smithi079.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-20T01:24:28.198 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs-devel x86_64 2:19.0.0-5872.gef427541.el9 ceph 32 k 2024-08-20T01:24:28.198 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs2 x86_64 2:19.0.0-5872.gef427541.el9 ceph 755 k 2024-08-20T01:24:28.199 INFO:teuthology.orchestra.run.smithi079.stdout: librados-devel x86_64 2:19.0.0-5872.gef427541.el9 ceph 126 k 2024-08-20T01:24:28.199 INFO:teuthology.orchestra.run.smithi079.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-20T01:24:28.199 INFO:teuthology.orchestra.run.smithi079.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-20T01:24:28.199 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-20T01:24:28.199 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-08-20T01:24:28.199 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-08-20T01:24:28.199 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-08-20T01:24:28.199 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cephfs x86_64 2:19.0.0-5872.gef427541.el9 ceph 188 k 2024-08-20T01:24:28.199 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rados x86_64 2:19.0.0-5872.gef427541.el9 ceph 371 k 2024-08-20T01:24:28.199 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rbd x86_64 2:19.0.0-5872.gef427541.el9 ceph 355 k 2024-08-20T01:24:28.199 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rgw x86_64 2:19.0.0-5872.gef427541.el9 ceph 116 k 2024-08-20T01:24:28.199 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-fuse x86_64 2:19.0.0-5872.gef427541.el9 ceph 85 k 2024-08-20T01:24:28.200 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-mirror x86_64 2:19.0.0-5872.gef427541.el9 ceph 3.2 M 2024-08-20T01:24:28.200 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-nbd x86_64 2:19.0.0-5872.gef427541.el9 ceph 170 k 2024-08-20T01:24:28.200 INFO:teuthology.orchestra.run.smithi079.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-08-20T01:24:28.200 INFO:teuthology.orchestra.run.smithi079.stdout:Upgrading: 2024-08-20T01:24:28.200 INFO:teuthology.orchestra.run.smithi079.stdout: librados2 x86_64 2:19.0.0-5872.gef427541.el9 ceph 3.5 M 2024-08-20T01:24:28.200 INFO:teuthology.orchestra.run.smithi079.stdout: librbd1 x86_64 2:19.0.0-5872.gef427541.el9 ceph 3.2 M 2024-08-20T01:24:28.200 INFO:teuthology.orchestra.run.smithi079.stdout:Installing dependencies: 2024-08-20T01:24:28.200 INFO:teuthology.orchestra.run.smithi079.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-20T01:24:28.200 INFO:teuthology.orchestra.run.smithi079.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-20T01:24:28.200 INFO:teuthology.orchestra.run.smithi079.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-20T01:24:28.200 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-common x86_64 2:19.0.0-5872.gef427541.el9 ceph 22 M 2024-08-20T01:24:28.200 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-grafana-dashboards noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 34 k 2024-08-20T01:24:28.200 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mds x86_64 2:19.0.0-5872.gef427541.el9 ceph 2.4 M 2024-08-20T01:24:28.201 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-modules-core noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 284 k 2024-08-20T01:24:28.201 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mon x86_64 2:19.0.0-5872.gef427541.el9 ceph 4.8 M 2024-08-20T01:24:28.201 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-osd x86_64 2:19.0.0-5872.gef427541.el9 ceph 17 M 2024-08-20T01:24:28.201 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-prometheus-alerts noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 16 k 2024-08-20T01:24:28.201 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-selinux x86_64 2:19.0.0-5872.gef427541.el9 ceph 25 k 2024-08-20T01:24:28.201 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-20T01:24:28.201 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-20T01:24:28.201 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-20T01:24:28.201 INFO:teuthology.orchestra.run.smithi079.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-20T01:24:28.201 INFO:teuthology.orchestra.run.smithi079.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-20T01:24:28.201 INFO:teuthology.orchestra.run.smithi079.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-20T01:24:28.201 INFO:teuthology.orchestra.run.smithi079.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-20T01:24:28.202 INFO:teuthology.orchestra.run.smithi079.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-20T01:24:28.202 INFO:teuthology.orchestra.run.smithi079.stdout: libcephsqlite x86_64 2:19.0.0-5872.gef427541.el9 ceph 163 k 2024-08-20T01:24:28.202 INFO:teuthology.orchestra.run.smithi079.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-08-20T01:24:28.202 INFO:teuthology.orchestra.run.smithi079.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-20T01:24:28.202 INFO:teuthology.orchestra.run.smithi079.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-20T01:24:28.202 INFO:teuthology.orchestra.run.smithi079.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-08-20T01:24:28.202 INFO:teuthology.orchestra.run.smithi079.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-20T01:24:28.202 INFO:teuthology.orchestra.run.smithi079.stdout: libradosstriper1 x86_64 2:19.0.0-5872.gef427541.el9 ceph 508 k 2024-08-20T01:24:28.202 INFO:teuthology.orchestra.run.smithi079.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-20T01:24:28.202 INFO:teuthology.orchestra.run.smithi079.stdout: librgw2 x86_64 2:19.0.0-5872.gef427541.el9 ceph 5.5 M 2024-08-20T01:24:28.202 INFO:teuthology.orchestra.run.smithi079.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-20T01:24:28.203 INFO:teuthology.orchestra.run.smithi079.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-20T01:24:28.203 INFO:teuthology.orchestra.run.smithi079.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-20T01:24:28.203 INFO:teuthology.orchestra.run.smithi079.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-20T01:24:28.203 INFO:teuthology.orchestra.run.smithi079.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-20T01:24:28.203 INFO:teuthology.orchestra.run.smithi079.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-20T01:24:28.203 INFO:teuthology.orchestra.run.smithi079.stdout: openblas x86_64 0.3.26-1.el9 appstream 38 k 2024-08-20T01:24:28.203 INFO:teuthology.orchestra.run.smithi079.stdout: openblas-openmp x86_64 0.3.26-1.el9 appstream 4.9 M 2024-08-20T01:24:28.203 INFO:teuthology.orchestra.run.smithi079.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-20T01:24:28.203 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-08-20T01:24:28.203 INFO:teuthology.orchestra.run.smithi079.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-20T01:24:28.203 INFO:teuthology.orchestra.run.smithi079.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-20T01:24:28.203 INFO:teuthology.orchestra.run.smithi079.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-20T01:24:28.203 INFO:teuthology.orchestra.run.smithi079.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-20T01:24:28.204 INFO:teuthology.orchestra.run.smithi079.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-20T01:24:28.204 INFO:teuthology.orchestra.run.smithi079.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-20T01:24:28.204 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-20T01:24:28.204 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-argparse x86_64 2:19.0.0-5872.gef427541.el9 ceph 45 k 2024-08-20T01:24:28.204 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-common x86_64 2:19.0.0-5872.gef427541.el9 ceph 138 k 2024-08-20T01:24:28.204 INFO:teuthology.orchestra.run.smithi079.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-20T01:24:28.204 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-20T01:24:28.204 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-20T01:24:28.204 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-20T01:24:28.204 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-20T01:24:28.204 INFO:teuthology.orchestra.run.smithi079.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-20T01:24:28.204 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-20T01:24:28.204 INFO:teuthology.orchestra.run.smithi079.stdout: python3-devel x86_64 3.9.19-7.el9 appstream 245 k 2024-08-20T01:24:28.205 INFO:teuthology.orchestra.run.smithi079.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-20T01:24:28.205 INFO:teuthology.orchestra.run.smithi079.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-20T01:24:28.205 INFO:teuthology.orchestra.run.smithi079.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-20T01:24:28.205 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-20T01:24:28.205 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-20T01:24:28.205 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-20T01:24:28.205 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-20T01:24:28.205 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-20T01:24:28.205 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-20T01:24:28.205 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-20T01:24:28.205 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-20T01:24:28.205 INFO:teuthology.orchestra.run.smithi079.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-20T01:24:28.205 INFO:teuthology.orchestra.run.smithi079.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-20T01:24:28.206 INFO:teuthology.orchestra.run.smithi079.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-20T01:24:28.206 INFO:teuthology.orchestra.run.smithi079.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-20T01:24:28.206 INFO:teuthology.orchestra.run.smithi079.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-20T01:24:28.206 INFO:teuthology.orchestra.run.smithi079.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-20T01:24:28.206 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-20T01:24:28.206 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-20T01:24:28.206 INFO:teuthology.orchestra.run.smithi079.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-20T01:24:28.206 INFO:teuthology.orchestra.run.smithi079.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-20T01:24:28.206 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-20T01:24:28.206 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-20T01:24:28.206 INFO:teuthology.orchestra.run.smithi079.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-20T01:24:28.206 INFO:teuthology.orchestra.run.smithi079.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-20T01:24:28.207 INFO:teuthology.orchestra.run.smithi079.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-20T01:24:28.207 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-20T01:24:28.207 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-20T01:24:28.207 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-20T01:24:28.207 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-20T01:24:28.207 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-20T01:24:28.207 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-20T01:24:28.207 INFO:teuthology.orchestra.run.smithi079.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-20T01:24:28.207 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-20T01:24:28.207 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-20T01:24:28.207 INFO:teuthology.orchestra.run.smithi079.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-20T01:24:28.207 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-20T01:24:28.208 INFO:teuthology.orchestra.run.smithi079.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-20T01:24:28.208 INFO:teuthology.orchestra.run.smithi079.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-20T01:24:28.208 INFO:teuthology.orchestra.run.smithi079.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-20T01:24:28.208 INFO:teuthology.orchestra.run.smithi079.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-20T01:24:28.208 INFO:teuthology.orchestra.run.smithi079.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-20T01:24:28.208 INFO:teuthology.orchestra.run.smithi079.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-20T01:24:28.208 INFO:teuthology.orchestra.run.smithi079.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-20T01:24:28.208 INFO:teuthology.orchestra.run.smithi079.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-20T01:24:28.208 INFO:teuthology.orchestra.run.smithi079.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-20T01:24:28.208 INFO:teuthology.orchestra.run.smithi079.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-20T01:24:28.208 INFO:teuthology.orchestra.run.smithi079.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-20T01:24:28.208 INFO:teuthology.orchestra.run.smithi079.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-20T01:24:28.208 INFO:teuthology.orchestra.run.smithi079.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-08-20T01:24:28.209 INFO:teuthology.orchestra.run.smithi079.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-20T01:24:28.209 INFO:teuthology.orchestra.run.smithi079.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-20T01:24:28.209 INFO:teuthology.orchestra.run.smithi079.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-20T01:24:28.209 INFO:teuthology.orchestra.run.smithi079.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-20T01:24:28.209 INFO:teuthology.orchestra.run.smithi079.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-20T01:24:28.209 INFO:teuthology.orchestra.run.smithi079.stdout:Installing weak dependencies: 2024-08-20T01:24:28.209 INFO:teuthology.orchestra.run.smithi079.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-20T01:24:28.209 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:24:28.209 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-08-20T01:24:28.209 INFO:teuthology.orchestra.run.smithi079.stdout:======================================================================================= 2024-08-20T01:24:28.209 INFO:teuthology.orchestra.run.smithi079.stdout:Install 148 Packages 2024-08-20T01:24:28.209 INFO:teuthology.orchestra.run.smithi079.stdout:Upgrade 2 Packages 2024-08-20T01:24:28.210 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:24:28.210 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 232 M 2024-08-20T01:24:28.210 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-08-20T01:24:28.242 INFO:teuthology.orchestra.run.smithi175.stdout:(8/150): ceph-common-19.0.0-5872.gef427541.el9. 17 MB/s | 22 MB 00:01 2024-08-20T01:24:28.292 INFO:teuthology.orchestra.run.smithi175.stdout:(9/150): ceph-selinux-19.0.0-5872.gef427541.el9 507 kB/s | 25 kB 00:00 2024-08-20T01:24:28.643 INFO:teuthology.orchestra.run.smithi079.stdout:(1/150): ceph-19.0.0-5872.gef427541.el9.x86_64. 25 kB/s | 6.6 kB 00:00 2024-08-20T01:24:28.684 INFO:teuthology.orchestra.run.smithi175.stdout:(10/150): ceph-osd-19.0.0-5872.gef427541.el9.x8 16 MB/s | 17 MB 00:01 2024-08-20T01:24:28.818 INFO:teuthology.orchestra.run.smithi175.stdout:(11/150): ceph-radosgw-19.0.0-5872.gef427541.el 13 MB/s | 11 MB 00:00 2024-08-20T01:24:28.843 INFO:teuthology.orchestra.run.smithi175.stdout:(12/150): cephfs-mirror-19.0.0-5872.gef427541.e 1.4 MB/s | 225 kB 00:00 2024-08-20T01:24:28.885 INFO:teuthology.orchestra.run.smithi175.stdout:(13/150): cephfs-shell-19.0.0-5872.gef427541.el 406 kB/s | 27 kB 00:00 2024-08-20T01:24:28.910 INFO:teuthology.orchestra.run.smithi175.stdout:(14/150): libcephfs-devel-19.0.0-5872.gef427541 474 kB/s | 32 kB 00:00 2024-08-20T01:24:28.914 INFO:teuthology.orchestra.run.smithi081.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-20T01:24:28.915 INFO:teuthology.orchestra.run.smithi081.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-20T01:24:28.928 INFO:teuthology.orchestra.run.smithi081.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-08-20T01:24:28.929 INFO:teuthology.orchestra.run.smithi081.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-20T01:24:28.930 INFO:teuthology.orchestra.run.smithi081.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-20T01:24:28.931 INFO:teuthology.orchestra.run.smithi081.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-20T01:24:28.933 INFO:teuthology.orchestra.run.smithi081.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-20T01:24:28.936 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-20T01:24:28.937 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-08-20T01:24:28.969 INFO:teuthology.orchestra.run.smithi175.stdout:(15/150): libcephfs2-19.0.0-5872.gef427541.el9. 8.8 MB/s | 755 kB 00:00 2024-08-20T01:24:28.994 INFO:teuthology.orchestra.run.smithi175.stdout:(16/150): libcephsqlite-19.0.0-5872.gef427541.e 1.9 MB/s | 163 kB 00:00 2024-08-20T01:24:28.997 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-08-20T01:24:29.005 INFO:teuthology.orchestra.run.smithi081.stdout:======================================================================================= 2024-08-20T01:24:29.006 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2024-08-20T01:24:29.006 INFO:teuthology.orchestra.run.smithi081.stdout:======================================================================================= 2024-08-20T01:24:29.006 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-08-20T01:24:29.006 INFO:teuthology.orchestra.run.smithi081.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-20T01:24:29.006 INFO:teuthology.orchestra.run.smithi081.stdout: ceph x86_64 2:19.0.0-5872.gef427541.el9 ceph 6.6 k 2024-08-20T01:24:29.006 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base x86_64 2:19.0.0-5872.gef427541.el9 ceph 5.5 M 2024-08-20T01:24:29.006 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse x86_64 2:19.0.0-5872.gef427541.el9 ceph 901 k 2024-08-20T01:24:29.006 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-5872.gef427541.el9 ceph 145 k 2024-08-20T01:24:29.006 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr x86_64 2:19.0.0-5872.gef427541.el9 ceph 1.5 M 2024-08-20T01:24:29.006 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 150 k 2024-08-20T01:24:29.006 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 14 M 2024-08-20T01:24:29.007 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 7.4 M 2024-08-20T01:24:29.007 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 49 k 2024-08-20T01:24:29.007 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw x86_64 2:19.0.0-5872.gef427541.el9 ceph 11 M 2024-08-20T01:24:29.007 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test x86_64 2:19.0.0-5872.gef427541.el9 ceph 50 M 2024-08-20T01:24:29.007 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 285 k 2024-08-20T01:24:29.007 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 772 k 2024-08-20T01:24:29.007 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror x86_64 2:19.0.0-5872.gef427541.el9 ceph 225 k 2024-08-20T01:24:29.007 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-shell x86_64 2:19.0.0-5872.gef427541.el9 ceph 27 k 2024-08-20T01:24:29.007 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 18 k 2024-08-20T01:24:29.007 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-20T01:24:29.007 INFO:teuthology.orchestra.run.smithi081.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-20T01:24:29.007 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-20T01:24:29.008 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel x86_64 2:19.0.0-5872.gef427541.el9 ceph 32 k 2024-08-20T01:24:29.008 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2 x86_64 2:19.0.0-5872.gef427541.el9 ceph 755 k 2024-08-20T01:24:29.008 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel x86_64 2:19.0.0-5872.gef427541.el9 ceph 126 k 2024-08-20T01:24:29.008 INFO:teuthology.orchestra.run.smithi081.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-20T01:24:29.008 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-20T01:24:29.008 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-20T01:24:29.008 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-08-20T01:24:29.008 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-08-20T01:24:29.008 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-08-20T01:24:29.008 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs x86_64 2:19.0.0-5872.gef427541.el9 ceph 188 k 2024-08-20T01:24:29.008 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados x86_64 2:19.0.0-5872.gef427541.el9 ceph 371 k 2024-08-20T01:24:29.008 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd x86_64 2:19.0.0-5872.gef427541.el9 ceph 355 k 2024-08-20T01:24:29.009 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw x86_64 2:19.0.0-5872.gef427541.el9 ceph 116 k 2024-08-20T01:24:29.009 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse x86_64 2:19.0.0-5872.gef427541.el9 ceph 85 k 2024-08-20T01:24:29.009 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror x86_64 2:19.0.0-5872.gef427541.el9 ceph 3.2 M 2024-08-20T01:24:29.009 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd x86_64 2:19.0.0-5872.gef427541.el9 ceph 170 k 2024-08-20T01:24:29.009 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-08-20T01:24:29.009 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrading: 2024-08-20T01:24:29.009 INFO:teuthology.orchestra.run.smithi081.stdout: librados2 x86_64 2:19.0.0-5872.gef427541.el9 ceph 3.5 M 2024-08-20T01:24:29.009 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1 x86_64 2:19.0.0-5872.gef427541.el9 ceph 3.2 M 2024-08-20T01:24:29.009 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-08-20T01:24:29.009 INFO:teuthology.orchestra.run.smithi081.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-20T01:24:29.009 INFO:teuthology.orchestra.run.smithi081.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-20T01:24:29.009 INFO:teuthology.orchestra.run.smithi081.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-20T01:24:29.010 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common x86_64 2:19.0.0-5872.gef427541.el9 ceph 22 M 2024-08-20T01:24:29.010 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 34 k 2024-08-20T01:24:29.010 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds x86_64 2:19.0.0-5872.gef427541.el9 ceph 2.4 M 2024-08-20T01:24:29.010 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 284 k 2024-08-20T01:24:29.010 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon x86_64 2:19.0.0-5872.gef427541.el9 ceph 4.8 M 2024-08-20T01:24:29.010 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd x86_64 2:19.0.0-5872.gef427541.el9 ceph 17 M 2024-08-20T01:24:29.010 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 16 k 2024-08-20T01:24:29.010 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux x86_64 2:19.0.0-5872.gef427541.el9 ceph 25 k 2024-08-20T01:24:29.010 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-20T01:24:29.010 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-20T01:24:29.010 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-20T01:24:29.010 INFO:teuthology.orchestra.run.smithi081.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-20T01:24:29.011 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-20T01:24:29.011 INFO:teuthology.orchestra.run.smithi081.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-20T01:24:29.011 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-20T01:24:29.011 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-20T01:24:29.011 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite x86_64 2:19.0.0-5872.gef427541.el9 ceph 163 k 2024-08-20T01:24:29.011 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-08-20T01:24:29.011 INFO:teuthology.orchestra.run.smithi081.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-20T01:24:29.011 INFO:teuthology.orchestra.run.smithi081.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-20T01:24:29.011 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-08-20T01:24:29.011 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-20T01:24:29.011 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1 x86_64 2:19.0.0-5872.gef427541.el9 ceph 508 k 2024-08-20T01:24:29.011 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-20T01:24:29.012 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2 x86_64 2:19.0.0-5872.gef427541.el9 ceph 5.5 M 2024-08-20T01:24:29.012 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-20T01:24:29.012 INFO:teuthology.orchestra.run.smithi081.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-20T01:24:29.012 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-20T01:24:29.012 INFO:teuthology.orchestra.run.smithi081.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-20T01:24:29.012 INFO:teuthology.orchestra.run.smithi081.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-20T01:24:29.012 INFO:teuthology.orchestra.run.smithi081.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-20T01:24:29.012 INFO:teuthology.orchestra.run.smithi081.stdout: openblas x86_64 0.3.26-1.el9 appstream 38 k 2024-08-20T01:24:29.012 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-openmp x86_64 0.3.26-1.el9 appstream 4.9 M 2024-08-20T01:24:29.012 INFO:teuthology.orchestra.run.smithi081.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-20T01:24:29.012 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-08-20T01:24:29.012 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-20T01:24:29.013 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-20T01:24:29.013 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-20T01:24:29.013 INFO:teuthology.orchestra.run.smithi081.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-20T01:24:29.013 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-20T01:24:29.013 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-20T01:24:29.013 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-20T01:24:29.013 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse x86_64 2:19.0.0-5872.gef427541.el9 ceph 45 k 2024-08-20T01:24:29.013 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common x86_64 2:19.0.0-5872.gef427541.el9 ceph 138 k 2024-08-20T01:24:29.013 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-20T01:24:29.013 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-20T01:24:29.013 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-20T01:24:29.013 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-20T01:24:29.013 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-20T01:24:29.014 INFO:teuthology.orchestra.run.smithi081.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-20T01:24:29.014 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-20T01:24:29.014 INFO:teuthology.orchestra.run.smithi081.stdout: python3-devel x86_64 3.9.19-7.el9 appstream 245 k 2024-08-20T01:24:29.014 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-20T01:24:29.014 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-20T01:24:29.014 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-20T01:24:29.014 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-20T01:24:29.014 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-20T01:24:29.014 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-20T01:24:29.014 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-20T01:24:29.014 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-20T01:24:29.014 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-20T01:24:29.015 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-20T01:24:29.015 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-20T01:24:29.015 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-20T01:24:29.015 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-20T01:24:29.015 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-20T01:24:29.015 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-20T01:24:29.015 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-20T01:24:29.015 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-20T01:24:29.015 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-20T01:24:29.015 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-20T01:24:29.015 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-20T01:24:29.015 INFO:teuthology.orchestra.run.smithi081.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-20T01:24:29.016 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-20T01:24:29.016 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-20T01:24:29.016 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-20T01:24:29.016 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-20T01:24:29.016 INFO:teuthology.orchestra.run.smithi081.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-20T01:24:29.016 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-20T01:24:29.016 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-20T01:24:29.016 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-20T01:24:29.016 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-20T01:24:29.016 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-20T01:24:29.016 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-20T01:24:29.016 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-20T01:24:29.017 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-20T01:24:29.017 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-20T01:24:29.017 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-20T01:24:29.017 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-20T01:24:29.017 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-20T01:24:29.017 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-20T01:24:29.017 INFO:teuthology.orchestra.run.smithi081.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-20T01:24:29.017 INFO:teuthology.orchestra.run.smithi081.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-20T01:24:29.017 INFO:teuthology.orchestra.run.smithi081.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-20T01:24:29.017 INFO:teuthology.orchestra.run.smithi081.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-20T01:24:29.017 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-20T01:24:29.017 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-20T01:24:29.017 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-20T01:24:29.018 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-20T01:24:29.018 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-20T01:24:29.018 INFO:teuthology.orchestra.run.smithi081.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-20T01:24:29.018 INFO:teuthology.orchestra.run.smithi081.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-08-20T01:24:29.018 INFO:teuthology.orchestra.run.smithi081.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-20T01:24:29.018 INFO:teuthology.orchestra.run.smithi081.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-20T01:24:29.018 INFO:teuthology.orchestra.run.smithi081.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-20T01:24:29.018 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-20T01:24:29.018 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-20T01:24:29.018 INFO:teuthology.orchestra.run.smithi081.stdout:Installing weak dependencies: 2024-08-20T01:24:29.018 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-20T01:24:29.019 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-08-20T01:24:29.019 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-08-20T01:24:29.019 INFO:teuthology.orchestra.run.smithi081.stdout:======================================================================================= 2024-08-20T01:24:29.019 INFO:teuthology.orchestra.run.smithi081.stdout:Install 148 Packages 2024-08-20T01:24:29.019 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrade 2 Packages 2024-08-20T01:24:29.019 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-08-20T01:24:29.019 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 232 M 2024-08-20T01:24:29.020 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-08-20T01:24:29.044 INFO:teuthology.orchestra.run.smithi175.stdout:(17/150): librados-devel-19.0.0-5872.gef427541. 1.6 MB/s | 126 kB 00:00 2024-08-20T01:24:29.086 INFO:teuthology.orchestra.run.smithi175.stdout:(18/150): libradosstriper1-19.0.0-5872.gef42754 5.4 MB/s | 508 kB 00:00 2024-08-20T01:24:29.159 INFO:teuthology.orchestra.run.smithi079.stdout:(2/150): ceph-fuse-19.0.0-5872.gef427541.el9.x8 1.7 MB/s | 901 kB 00:00 2024-08-20T01:24:29.170 INFO:teuthology.orchestra.run.smithi175.stdout:(19/150): python3-ceph-argparse-19.0.0-5872.gef 541 kB/s | 45 kB 00:00 2024-08-20T01:24:29.270 INFO:teuthology.orchestra.run.smithi175.stdout:(20/150): python3-ceph-common-19.0.0-5872.gef42 1.4 MB/s | 138 kB 00:00 2024-08-20T01:24:29.318 INFO:teuthology.orchestra.run.smithi079.stdout:(3/150): ceph-immutable-object-cache-19.0.0-587 916 kB/s | 145 kB 00:00 2024-08-20T01:24:29.354 INFO:teuthology.orchestra.run.smithi175.stdout:(21/150): python3-cephfs-19.0.0-5872.gef427541. 2.2 MB/s | 188 kB 00:00 2024-08-20T01:24:29.463 INFO:teuthology.orchestra.run.smithi175.stdout:(22/150): python3-rados-19.0.0-5872.gef427541.e 3.4 MB/s | 371 kB 00:00 2024-08-20T01:24:29.538 INFO:teuthology.orchestra.run.smithi175.stdout:(23/150): librgw2-19.0.0-5872.gef427541.el9.x86 11 MB/s | 5.5 MB 00:00 2024-08-20T01:24:29.563 INFO:teuthology.orchestra.run.smithi175.stdout:(24/150): python3-rbd-19.0.0-5872.gef427541.el9 3.5 MB/s | 355 kB 00:00 2024-08-20T01:24:29.622 INFO:teuthology.orchestra.run.smithi175.stdout:(25/150): python3-rgw-19.0.0-5872.gef427541.el9 1.4 MB/s | 116 kB 00:00 2024-08-20T01:24:29.647 INFO:teuthology.orchestra.run.smithi175.stdout:(26/150): rbd-fuse-19.0.0-5872.gef427541.el9.x8 1.0 MB/s | 85 kB 00:00 2024-08-20T01:24:29.747 INFO:teuthology.orchestra.run.smithi175.stdout:(27/150): rbd-nbd-19.0.0-5872.gef427541.el9.x86 1.7 MB/s | 170 kB 00:00 2024-08-20T01:24:29.848 INFO:teuthology.orchestra.run.smithi175.stdout:(28/150): ceph-grafana-dashboards-19.0.0-5872.g 343 kB/s | 34 kB 00:00 2024-08-20T01:24:29.870 INFO:teuthology.orchestra.run.smithi081.stdout:(1/150): ceph-19.0.0-5872.gef427541.el9.x86_64. 21 kB/s | 6.6 kB 00:00 2024-08-20T01:24:29.956 INFO:teuthology.orchestra.run.smithi175.stdout:(29/150): rbd-mirror-19.0.0-5872.gef427541.el9. 9.5 MB/s | 3.2 MB 00:00 2024-08-20T01:24:29.981 INFO:teuthology.orchestra.run.smithi175.stdout:(30/150): ceph-mgr-cephadm-19.0.0-5872.gef42754 1.1 MB/s | 150 kB 00:00 2024-08-20T01:24:30.468 INFO:teuthology.orchestra.run.smithi079.stdout:(4/150): ceph-mds-19.0.0-5872.gef427541.el9.x86 2.1 MB/s | 2.4 MB 00:01 2024-08-20T01:24:31.229 INFO:teuthology.orchestra.run.smithi081.stdout:(2/150): ceph-fuse-19.0.0-5872.gef427541.el9.x8 663 kB/s | 901 kB 00:01 2024-08-20T01:24:31.260 INFO:teuthology.orchestra.run.smithi079.stdout:(5/150): ceph-base-19.0.0-5872.gef427541.el9.x8 1.9 MB/s | 5.5 MB 00:02 2024-08-20T01:24:31.402 INFO:teuthology.orchestra.run.smithi079.stdout:(6/150): ceph-mgr-19.0.0-5872.gef427541.el9.x86 1.6 MB/s | 1.5 MB 00:00 2024-08-20T01:24:31.404 INFO:teuthology.orchestra.run.smithi081.stdout:(3/150): ceph-immutable-object-cache-19.0.0-587 830 kB/s | 145 kB 00:00 2024-08-20T01:24:31.473 INFO:teuthology.orchestra.run.smithi175.stdout:(31/150): ceph-mgr-diskprediction-local-19.0.0- 5.0 MB/s | 7.4 MB 00:01 2024-08-20T01:24:31.632 INFO:teuthology.orchestra.run.smithi175.stdout:(32/150): ceph-mgr-dashboard-19.0.0-5872.gef427 8.4 MB/s | 14 MB 00:01 2024-08-20T01:24:31.657 INFO:teuthology.orchestra.run.smithi175.stdout:(33/150): ceph-mgr-modules-core-19.0.0-5872.gef 1.5 MB/s | 284 kB 00:00 2024-08-20T01:24:31.707 INFO:teuthology.orchestra.run.smithi175.stdout:(34/150): ceph-mgr-rook-19.0.0-5872.gef427541.e 659 kB/s | 49 kB 00:00 2024-08-20T01:24:31.732 INFO:teuthology.orchestra.run.smithi175.stdout:(35/150): ceph-prometheus-alerts-19.0.0-5872.ge 219 kB/s | 16 kB 00:00 2024-08-20T01:24:31.791 INFO:teuthology.orchestra.run.smithi175.stdout:(36/150): ceph-volume-19.0.0-5872.gef427541.el9 3.3 MB/s | 285 kB 00:00 2024-08-20T01:24:31.874 INFO:teuthology.orchestra.run.smithi175.stdout:(37/150): cephfs-top-19.0.0-5872.gef427541.el9. 220 kB/s | 18 kB 00:00 2024-08-20T01:24:31.900 INFO:teuthology.orchestra.run.smithi175.stdout:(38/150): cephadm-19.0.0-5872.gef427541.el9.noa 4.5 MB/s | 772 kB 00:00 2024-08-20T01:24:32.059 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:24:32.292 INFO:teuthology.orchestra.run.smithi175.stdout:(39/150): fuse-2.9.9-16.el9.x86_64.rpm 191 kB/s | 80 kB 00:00 2024-08-20T01:24:32.363 INFO:teuthology.orchestra.run.smithi081.stdout:(4/150): ceph-base-19.0.0-5872.gef427541.el9.x8 2.0 MB/s | 5.5 MB 00:02 2024-08-20T01:24:32.371 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:24:32.390 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:24:32.449 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T01:24:32.576 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T01:24:32.627 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://ord.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-20T01:24:32.699 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:24:32.715 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://ord.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-20T01:24:32.728 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T01:24:32.757 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T01:24:32.758 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:24:32.768 INFO:teuthology.orchestra.run.smithi079.stdout:(7/150): ceph-mon-19.0.0-5872.gef427541.el9.x86 3.2 MB/s | 4.8 MB 00:01 2024-08-20T01:24:32.813 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://ord.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-20T01:24:32.834 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:24:32.912 INFO:teuthology.orchestra.run.smithi081.stdout:(5/150): ceph-mgr-19.0.0-5872.gef427541.el9.x86 2.8 MB/s | 1.5 MB 00:00 2024-08-20T01:24:33.271 INFO:teuthology.orchestra.run.smithi081.stdout:(6/150): ceph-mds-19.0.0-5872.gef427541.el9.x86 1.3 MB/s | 2.4 MB 00:01 2024-08-20T01:24:33.276 INFO:teuthology.orchestra.run.smithi175.stdout:(40/150): ceph-test-19.0.0-5872.gef427541.el9.x 10 MB/s | 50 MB 00:04 2024-08-20T01:24:33.277 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 172.65.90.23) 2024-08-20T01:24:33.303 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://ord.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-20T01:24:33.325 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:24:33.346 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:24:33.400 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 172.65.90.23) 2024-08-20T01:24:33.583 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 172.65.90.21) 2024-08-20T01:24:33.617 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T01:24:33.700 INFO:teuthology.orchestra.run.smithi175.stdout:(41/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 598 kB/s | 253 kB 00:00 2024-08-20T01:24:33.701 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T01:24:33.757 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:24:33.853 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:24:33.914 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:24:34.018 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:24:34.075 INFO:teuthology.orchestra.run.smithi175.stdout:(42/150): python3-cryptography-36.0.1-4.el9.x86 3.3 MB/s | 1.2 MB 00:00 2024-08-20T01:24:34.092 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-20T01:24:34.184 INFO:teuthology.orchestra.run.smithi175.stdout:(43/150): python3-ply-3.11-14.el9.noarch.rpm 979 kB/s | 106 kB 00:00 2024-08-20T01:24:34.293 INFO:teuthology.orchestra.run.smithi175.stdout:(44/150): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-08-20T01:24:34.330 INFO:teuthology.orchestra.run.smithi081.stdout:(7/150): ceph-mon-19.0.0-5872.gef427541.el9.x86 3.4 MB/s | 4.8 MB 00:01 2024-08-20T01:24:34.393 INFO:teuthology.orchestra.run.smithi175.stdout:(45/150): python3-requests-2.25.1-8.el9.noarch. 1.2 MB/s | 125 kB 00:00 2024-08-20T01:24:34.533 INFO:teuthology.orchestra.run.smithi175.stdout:(46/150): python3-urllib3-1.26.5-6.el9.noarch.r 1.5 MB/s | 215 kB 00:00 2024-08-20T01:24:34.777 INFO:teuthology.orchestra.run.smithi175.stdout:(47/150): automake-1.16.2-8.el9.noarch.rpm 2.8 MB/s | 689 kB 00:00 2024-08-20T01:24:34.867 INFO:teuthology.orchestra.run.smithi175.stdout:(48/150): bison-3.7.4-5.el9.x86_64.rpm 10 MB/s | 943 kB 00:00 2024-08-20T01:24:34.909 INFO:teuthology.orchestra.run.smithi175.stdout:(49/150): libquadmath-11.5.0-2.el9.x86_64.rpm 73 kB/s | 191 kB 00:02 2024-08-20T01:24:34.934 INFO:teuthology.orchestra.run.smithi175.stdout:(50/150): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-08-20T01:24:34.993 INFO:teuthology.orchestra.run.smithi175.stdout:(51/150): flex-2.6.4-9.el9.x86_64.rpm 5.3 MB/s | 313 kB 00:00 2024-08-20T01:24:35.026 INFO:teuthology.orchestra.run.smithi175.stdout:(52/150): elfutils-libelf-devel-0.191-4.el9.x86 186 kB/s | 22 kB 00:00 2024-08-20T01:24:35.051 INFO:teuthology.orchestra.run.smithi175.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 560 kB/s | 33 kB 00:00 2024-08-20T01:24:35.102 INFO:teuthology.orchestra.run.smithi175.stdout:(54/150): flexiblas-openblas-openmp-3.0.4-8.el9 364 kB/s | 18 kB 00:00 2024-08-20T01:24:35.160 INFO:teuthology.orchestra.run.smithi175.stdout:(55/150): libaio-devel-0.3.111-13.el9.x86_64.rp 191 kB/s | 11 kB 00:00 2024-08-20T01:24:35.219 INFO:teuthology.orchestra.run.smithi175.stdout:(56/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-08-20T01:24:35.268 INFO:teuthology.orchestra.run.smithi079.stdout:(8/150): ceph-radosgw-19.0.0-5872.gef427541.el9 4.4 MB/s | 11 MB 00:02 2024-08-20T01:24:35.286 INFO:teuthology.orchestra.run.smithi175.stdout:(57/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 676 kB/s | 45 kB 00:00 2024-08-20T01:24:35.326 INFO:teuthology.orchestra.run.smithi079.stdout:(9/150): ceph-selinux-19.0.0-5872.gef427541.el9 433 kB/s | 25 kB 00:00 2024-08-20T01:24:35.336 INFO:teuthology.orchestra.run.smithi175.stdout:(58/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 9.7 MB/s | 3.0 MB 00:00 2024-08-20T01:24:35.361 INFO:teuthology.orchestra.run.smithi175.stdout:(59/150): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 662 kB 00:00 2024-08-20T01:24:35.403 INFO:teuthology.orchestra.run.smithi175.stdout:(60/150): libtool-2.4.6-46.el9.x86_64.rpm 8.5 MB/s | 581 kB 00:00 2024-08-20T01:24:35.428 INFO:teuthology.orchestra.run.smithi175.stdout:(61/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 381 kB/s | 25 kB 00:00 2024-08-20T01:24:35.454 INFO:teuthology.orchestra.run.smithi175.stdout:(62/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-08-20T01:24:35.487 INFO:teuthology.orchestra.run.smithi175.stdout:(63/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-08-20T01:24:35.512 INFO:teuthology.orchestra.run.smithi175.stdout:(64/150): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-08-20T01:24:35.517 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:24:35.543 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:24:35.549 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:24:35.591 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:24:35.651 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:24:35.665 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:24:35.673 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:24:35.676 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 172.65.90.21) 2024-08-20T01:24:35.695 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:24:35.709 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T01:24:35.761 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 172.65.90.23) 2024-08-20T01:24:35.781 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T01:24:35.838 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:24:35.861 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 172.65.90.23) 2024-08-20T01:24:35.921 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 172.65.90.21) 2024-08-20T01:24:35.930 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:24:35.987 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-20T01:24:35.992 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:24:36.036 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 172.65.90.21) 2024-08-20T01:24:36.069 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-20T01:24:36.077 INFO:teuthology.orchestra.run.smithi079.stdout:(10/150): ceph-common-19.0.0-5872.gef427541.el9 2.8 MB/s | 22 MB 00:07 2024-08-20T01:24:36.099 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-20T01:24:36.100 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:24:36.114 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T01:24:36.130 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T01:24:36.134 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-20T01:24:36.165 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-20T01:24:36.178 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-20T01:24:36.193 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T01:24:36.209 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T01:24:36.210 INFO:teuthology.orchestra.run.smithi079.stdout:(11/150): cephfs-mirror-19.0.0-5872.gef427541.e 1.6 MB/s | 225 kB 00:00 2024-08-20T01:24:36.220 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:24:36.226 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-20T01:24:36.256 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:24:36.260 INFO:teuthology.orchestra.run.smithi079.stdout:(12/150): cephfs-shell-19.0.0-5872.gef427541.el 540 kB/s | 27 kB 00:00 2024-08-20T01:24:36.321 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:24:36.328 INFO:teuthology.orchestra.run.smithi079.stdout:(13/150): libcephfs-devel-19.0.0-5872.gef427541 475 kB/s | 32 kB 00:00 2024-08-20T01:24:36.348 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:24:36.481 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:24:36.509 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:24:36.570 INFO:teuthology.orchestra.run.smithi079.stdout:(14/150): libcephfs2-19.0.0-5872.gef427541.el9. 3.0 MB/s | 755 kB 00:00 2024-08-20T01:24:36.645 INFO:teuthology.orchestra.run.smithi079.stdout:(15/150): libcephsqlite-19.0.0-5872.gef427541.e 2.1 MB/s | 163 kB 00:00 2024-08-20T01:24:36.813 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:24:36.822 INFO:teuthology.orchestra.run.smithi079.stdout:(16/150): ceph-osd-19.0.0-5872.gef427541.el9.x8 3.2 MB/s | 17 MB 00:05 2024-08-20T01:24:36.845 INFO:teuthology.orchestra.run.smithi079.stdout:(17/150): librados-devel-19.0.0-5872.gef427541. 632 kB/s | 126 kB 00:00 2024-08-20T01:24:36.846 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:24:36.905 INFO:teuthology.orchestra.run.smithi081.stdout:(8/150): ceph-radosgw-19.0.0-5872.gef427541.el9 4.3 MB/s | 11 MB 00:02 2024-08-20T01:24:36.954 INFO:teuthology.orchestra.run.smithi079.stdout:(18/150): libradosstriper1-19.0.0-5872.gef42754 3.7 MB/s | 508 kB 00:00 2024-08-20T01:24:37.021 INFO:teuthology.orchestra.run.smithi079.stdout:(19/150): python3-ceph-argparse-19.0.0-5872.gef 678 kB/s | 45 kB 00:00 2024-08-20T01:24:37.053 INFO:teuthology.orchestra.run.smithi081.stdout:(9/150): ceph-selinux-19.0.0-5872.gef427541.el9 170 kB/s | 25 kB 00:00 2024-08-20T01:24:37.088 INFO:teuthology.orchestra.run.smithi079.stdout:(20/150): python3-ceph-common-19.0.0-5872.gef42 2.0 MB/s | 138 kB 00:00 2024-08-20T01:24:37.163 INFO:teuthology.orchestra.run.smithi079.stdout:(21/150): python3-cephfs-19.0.0-5872.gef427541. 2.5 MB/s | 188 kB 00:00 2024-08-20T01:24:37.255 INFO:teuthology.orchestra.run.smithi081.stdout:(10/150): ceph-common-19.0.0-5872.gef427541.el9 2.8 MB/s | 22 MB 00:07 2024-08-20T01:24:37.298 INFO:teuthology.orchestra.run.smithi079.stdout:(22/150): python3-rados-19.0.0-5872.gef427541.e 2.7 MB/s | 371 kB 00:00 2024-08-20T01:24:37.389 INFO:teuthology.orchestra.run.smithi081.stdout:(11/150): cephfs-mirror-19.0.0-5872.gef427541.e 1.6 MB/s | 225 kB 00:00 2024-08-20T01:24:37.429 INFO:teuthology.orchestra.run.smithi175.stdout:(65/150): openblas-0.3.26-1.el9.x86_64.rpm 20 kB/s | 38 kB 00:01 2024-08-20T01:24:37.430 INFO:teuthology.orchestra.run.smithi079.stdout:(23/150): python3-rbd-19.0.0-5872.gef427541.el9 2.6 MB/s | 355 kB 00:00 2024-08-20T01:24:37.447 INFO:teuthology.orchestra.run.smithi081.stdout:(12/150): cephfs-shell-19.0.0-5872.gef427541.el 465 kB/s | 27 kB 00:00 2024-08-20T01:24:37.506 INFO:teuthology.orchestra.run.smithi079.stdout:(24/150): python3-rgw-19.0.0-5872.gef427541.el9 1.5 MB/s | 116 kB 00:00 2024-08-20T01:24:37.506 INFO:teuthology.orchestra.run.smithi081.stdout:(13/150): libcephfs-devel-19.0.0-5872.gef427541 544 kB/s | 32 kB 00:00 2024-08-20T01:24:37.598 INFO:teuthology.orchestra.run.smithi079.stdout:(25/150): rbd-fuse-19.0.0-5872.gef427541.el9.x8 930 kB/s | 85 kB 00:00 2024-08-20T01:24:37.680 INFO:teuthology.orchestra.run.smithi175.stdout:(66/150): libgfortran-11.5.0-2.el9.x86_64.rpm 139 kB/s | 801 kB 00:05 2024-08-20T01:24:37.756 INFO:teuthology.orchestra.run.smithi081.stdout:(14/150): libcephfs2-19.0.0-5872.gef427541.el9. 2.9 MB/s | 755 kB 00:00 2024-08-20T01:24:37.799 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:24:37.840 INFO:teuthology.orchestra.run.smithi081.stdout:(15/150): libcephsqlite-19.0.0-5872.gef427541.e 1.9 MB/s | 163 kB 00:00 2024-08-20T01:24:37.888 INFO:teuthology.orchestra.run.smithi175.stdout:(67/150): openssl-devel-3.2.2-2.el9.x86_64.rpm 9.7 MB/s | 4.4 MB 00:00 2024-08-20T01:24:37.889 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:24:37.919 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:24:37.924 INFO:teuthology.orchestra.run.smithi081.stdout:(16/150): librados-devel-19.0.0-5872.gef427541. 1.5 MB/s | 126 kB 00:00 2024-08-20T01:24:37.951 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:24:37.985 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:24:38.006 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:24:38.026 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:24:38.029 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:24:38.096 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 172.65.90.23) 2024-08-20T01:24:38.097 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 172.65.90.23) 2024-08-20T01:24:38.107 INFO:teuthology.orchestra.run.smithi081.stdout:(17/150): libradosstriper1-19.0.0-5872.gef42754 2.7 MB/s | 508 kB 00:00 2024-08-20T01:24:38.309 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 172.65.90.21) 2024-08-20T01:24:38.339 INFO:teuthology.orchestra.run.smithi079.stdout:(26/150): librgw2-19.0.0-5872.gef427541.el9.x86 3.7 MB/s | 5.5 MB 00:01 2024-08-20T01:24:38.341 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 172.65.90.21) 2024-08-20T01:24:38.373 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for http://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-20T01:24:38.414 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for http://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-20T01:24:38.431 INFO:teuthology.orchestra.run.smithi079.stdout:(27/150): rbd-nbd-19.0.0-5872.gef427541.el9.x86 1.8 MB/s | 170 kB 00:00 2024-08-20T01:24:38.483 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for https://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-20T01:24:38.515 INFO:teuthology.orchestra.run.smithi079.stdout:(28/150): ceph-grafana-dashboards-19.0.0-5872.g 413 kB/s | 34 kB 00:00 2024-08-20T01:24:38.516 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T01:24:38.540 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for https://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-20T01:24:38.556 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T01:24:38.596 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T01:24:38.599 INFO:teuthology.orchestra.run.smithi079.stdout:(29/150): rbd-mirror-19.0.0-5872.gef427541.el9. 3.2 MB/s | 3.2 MB 00:01 2024-08-20T01:24:38.624 INFO:teuthology.orchestra.run.smithi079.stdout:(30/150): ceph-mgr-cephadm-19.0.0-5872.gef42754 1.4 MB/s | 150 kB 00:00 2024-08-20T01:24:38.627 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T01:24:38.631 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-20T01:24:38.663 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-20T01:24:38.688 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:24:38.724 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:24:38.780 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:24:38.818 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:24:38.942 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:24:38.979 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:24:39.274 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:24:39.308 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:24:39.732 INFO:teuthology.orchestra.run.smithi081.stdout:(18/150): librgw2-19.0.0-5872.gef427541.el9.x86 3.4 MB/s | 5.5 MB 00:01 2024-08-20T01:24:39.900 INFO:teuthology.orchestra.run.smithi081.stdout:(19/150): ceph-osd-19.0.0-5872.gef427541.el9.x8 2.6 MB/s | 17 MB 00:06 2024-08-20T01:24:39.925 INFO:teuthology.orchestra.run.smithi081.stdout:(20/150): python3-ceph-argparse-19.0.0-5872.gef 235 kB/s | 45 kB 00:00 2024-08-20T01:24:39.992 INFO:teuthology.orchestra.run.smithi081.stdout:(21/150): python3-cephfs-19.0.0-5872.gef427541. 2.8 MB/s | 188 kB 00:00 2024-08-20T01:24:40.017 INFO:teuthology.orchestra.run.smithi081.stdout:(22/150): python3-ceph-common-19.0.0-5872.gef42 1.2 MB/s | 138 kB 00:00 2024-08-20T01:24:40.109 INFO:teuthology.orchestra.run.smithi081.stdout:(23/150): python3-rados-19.0.0-5872.gef427541.e 3.1 MB/s | 371 kB 00:00 2024-08-20T01:24:40.168 INFO:teuthology.orchestra.run.smithi081.stdout:(24/150): python3-rbd-19.0.0-5872.gef427541.el9 2.3 MB/s | 355 kB 00:00 2024-08-20T01:24:40.193 INFO:teuthology.orchestra.run.smithi081.stdout:(25/150): python3-rgw-19.0.0-5872.gef427541.el9 1.4 MB/s | 116 kB 00:00 2024-08-20T01:24:40.226 INFO:teuthology.orchestra.run.smithi081.stdout:(26/150): rbd-fuse-19.0.0-5872.gef427541.el9.x8 1.4 MB/s | 85 kB 00:00 2024-08-20T01:24:40.285 INFO:teuthology.orchestra.run.smithi081.stdout:(27/150): rbd-nbd-19.0.0-5872.gef427541.el9.x86 2.8 MB/s | 170 kB 00:00 2024-08-20T01:24:40.299 INFO:teuthology.orchestra.run.smithi079.stdout:(31/150): ceph-mgr-diskprediction-local-19.0.0- 4.4 MB/s | 7.4 MB 00:01 2024-08-20T01:24:40.335 INFO:teuthology.orchestra.run.smithi081.stdout:(28/150): ceph-grafana-dashboards-19.0.0-5872.g 689 kB/s | 34 kB 00:00 2024-08-20T01:24:40.403 INFO:teuthology.orchestra.run.smithi081.stdout:(29/150): ceph-mgr-cephadm-19.0.0-5872.gef42754 2.2 MB/s | 150 kB 00:00 2024-08-20T01:24:40.416 INFO:teuthology.orchestra.run.smithi079.stdout:(32/150): ceph-mgr-modules-core-19.0.0-5872.gef 2.4 MB/s | 284 kB 00:00 2024-08-20T01:24:40.483 INFO:teuthology.orchestra.run.smithi079.stdout:(33/150): ceph-mgr-rook-19.0.0-5872.gef427541.e 738 kB/s | 49 kB 00:00 2024-08-20T01:24:40.550 INFO:teuthology.orchestra.run.smithi079.stdout:(34/150): ceph-prometheus-alerts-19.0.0-5872.ge 247 kB/s | 16 kB 00:00 2024-08-20T01:24:40.667 INFO:teuthology.orchestra.run.smithi079.stdout:(35/150): ceph-volume-19.0.0-5872.gef427541.el9 2.4 MB/s | 285 kB 00:00 2024-08-20T01:24:40.811 INFO:teuthology.orchestra.run.smithi081.stdout:(30/150): rbd-mirror-19.0.0-5872.gef427541.el9. 5.1 MB/s | 3.2 MB 00:00 2024-08-20T01:24:40.867 INFO:teuthology.orchestra.run.smithi079.stdout:(36/150): cephadm-19.0.0-5872.gef427541.el9.noa 3.8 MB/s | 772 kB 00:00 2024-08-20T01:24:40.913 INFO:teuthology.orchestra.run.smithi175.stdout:(68/150): postgresql-contrib-13.16-1.el9.x86_64 301 kB/s | 910 kB 00:03 2024-08-20T01:24:40.925 INFO:teuthology.orchestra.run.smithi079.stdout:(37/150): cephfs-top-19.0.0-5872.gef427541.el9. 313 kB/s | 18 kB 00:00 2024-08-20T01:24:40.974 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] postgresql-private-libs-13.16-1.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-private-libs-13.16-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:24:41.076 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] postgresql-private-libs-13.16-1.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-private-libs-13.16-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:24:41.076 INFO:teuthology.orchestra.run.smithi079.stdout:(38/150): fuse-2.9.9-16.el9.x86_64.rpm 531 kB/s | 80 kB 00:00 2024-08-20T01:24:41.106 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:24:41.207 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:24:41.468 INFO:teuthology.orchestra.run.smithi079.stdout:(39/150): ceph-mgr-dashboard-19.0.0-5872.gef427 4.9 MB/s | 14 MB 00:02 2024-08-20T01:24:41.498 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:24:41.529 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:24:41.621 INFO:teuthology.orchestra.run.smithi175.stdout:(69/150): postgresql-13.16-1.el9.x86_64.rpm 412 kB/s | 1.6 MB 00:03 2024-08-20T01:24:41.652 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] postgresql-server-13.16-1.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-server-13.16-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:24:41.682 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] postgresql-server-13.16-1.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-server-13.16-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:24:41.770 INFO:teuthology.orchestra.run.smithi081.stdout:(31/150): ceph-mgr-diskprediction-local-19.0.0- 7.7 MB/s | 7.4 MB 00:00 2024-08-20T01:24:41.830 INFO:teuthology.orchestra.run.smithi175.stdout:(70/150): openblas-openmp-0.3.26-1.el9.x86_64.r 802 kB/s | 4.9 MB 00:06 2024-08-20T01:24:41.837 INFO:teuthology.orchestra.run.smithi081.stdout:(32/150): ceph-mgr-modules-core-19.0.0-5872.gef 4.2 MB/s | 284 kB 00:00 2024-08-20T01:24:41.855 INFO:teuthology.orchestra.run.smithi175.stdout:(71/150): postgresql-private-libs-13.16-1.el9.x 146 kB/s | 137 kB 00:00 2024-08-20T01:24:41.887 INFO:teuthology.orchestra.run.smithi081.stdout:(33/150): ceph-mgr-rook-19.0.0-5872.gef427541.e 990 kB/s | 49 kB 00:00 2024-08-20T01:24:41.937 INFO:teuthology.orchestra.run.smithi081.stdout:(34/150): ceph-prometheus-alerts-19.0.0-5872.ge 329 kB/s | 16 kB 00:00 2024-08-20T01:24:41.997 INFO:teuthology.orchestra.run.smithi175.stdout:(72/150): python3-attrs-20.3.0-7.el9.noarch.rpm 619 kB/s | 87 kB 00:00 2024-08-20T01:24:42.004 INFO:teuthology.orchestra.run.smithi081.stdout:(35/150): ceph-volume-19.0.0-5872.gef427541.el9 4.2 MB/s | 285 kB 00:00 2024-08-20T01:24:42.097 INFO:teuthology.orchestra.run.smithi175.stdout:(73/150): protobuf-3.14.0-13.el9.x86_64.rpm 3.8 MB/s | 1.0 MB 00:00 2024-08-20T01:24:42.113 INFO:teuthology.orchestra.run.smithi081.stdout:(36/150): cephadm-19.0.0-5872.gef427541.el9.noa 7.0 MB/s | 772 kB 00:00 2024-08-20T01:24:42.147 INFO:teuthology.orchestra.run.smithi175.stdout:(74/150): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-08-20T01:24:42.154 INFO:teuthology.orchestra.run.smithi081.stdout:(37/150): cephfs-top-19.0.0-5872.gef427541.el9. 439 kB/s | 18 kB 00:00 2024-08-20T01:24:42.179 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] python3-devel-3.9.19-7.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-devel-3.9.19-7.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:24:42.214 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] python3-devel-3.9.19-7.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-devel-3.9.19-7.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:24:42.235 INFO:teuthology.orchestra.run.smithi079.stdout:(40/150): libgfortran-11.5.0-2.el9.x86_64.rpm 692 kB/s | 801 kB 00:01 2024-08-20T01:24:42.288 INFO:teuthology.orchestra.run.smithi081.stdout:(38/150): fuse-2.9.9-16.el9.x86_64.rpm 599 kB/s | 80 kB 00:00 2024-08-20T01:24:42.302 INFO:teuthology.orchestra.run.smithi079.stdout:(41/150): libquadmath-11.5.0-2.el9.x86_64.rpm 229 kB/s | 191 kB 00:00 2024-08-20T01:24:42.306 INFO:teuthology.orchestra.run.smithi175.stdout:(75/150): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 6.0 MB 00:00 2024-08-20T01:24:42.309 INFO:teuthology.orchestra.run.smithi081.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:24:42.365 INFO:teuthology.orchestra.run.smithi175.stdout:(76/150): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-08-20T01:24:42.407 INFO:teuthology.orchestra.run.smithi175.stdout:(77/150): python3-jsonpatch-1.21-16.el9.noarch. 616 kB/s | 26 kB 00:00 2024-08-20T01:24:42.444 INFO:teuthology.orchestra.run.smithi079.stdout:(42/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-08-20T01:24:42.447 INFO:teuthology.orchestra.run.smithi081.stdout:(39/150): ceph-mgr-dashboard-19.0.0-5872.gef427 6.9 MB/s | 14 MB 00:02 2024-08-20T01:24:42.448 INFO:teuthology.orchestra.run.smithi175.stdout:(78/150): python3-jsonpointer-2.0-4.el9.noarch. 460 kB/s | 19 kB 00:00 2024-08-20T01:24:42.468 INFO:teuthology.orchestra.run.smithi081.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:24:42.502 INFO:teuthology.orchestra.run.smithi079.stdout:(43/150): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-08-20T01:24:42.516 INFO:teuthology.orchestra.run.smithi175.stdout:(79/150): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-08-20T01:24:42.526 INFO:teuthology.orchestra.run.smithi081.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:24:42.549 INFO:teuthology.orchestra.run.smithi081.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:24:42.552 INFO:teuthology.orchestra.run.smithi079.stdout:(44/150): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-08-20T01:24:42.566 INFO:teuthology.orchestra.run.smithi175.stdout:(80/150): python3-markupsafe-1.1.1-12.el9.x86_6 698 kB/s | 35 kB 00:00 2024-08-20T01:24:42.588 INFO:teuthology.orchestra.run.smithi081.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:24:42.611 INFO:teuthology.orchestra.run.smithi081.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:24:42.619 INFO:teuthology.orchestra.run.smithi079.stdout:(45/150): python3-requests-2.25.1-8.el9.noarch. 1.9 MB/s | 125 kB 00:00 2024-08-20T01:24:42.652 INFO:teuthology.orchestra.run.smithi079.stdout:(46/150): python3-cryptography-36.0.1-4.el9.x86 3.5 MB/s | 1.2 MB 00:00 2024-08-20T01:24:42.678 INFO:teuthology.orchestra.run.smithi079.stdout:(47/150): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-08-20T01:24:42.692 INFO:teuthology.orchestra.run.smithi081.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:24:42.714 INFO:teuthology.orchestra.run.smithi081.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:24:42.741 INFO:teuthology.orchestra.run.smithi175.stdout:(81/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 29 MB/s | 5.1 MB 00:00 2024-08-20T01:24:42.808 INFO:teuthology.orchestra.run.smithi175.stdout:(82/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-08-20T01:24:42.828 INFO:teuthology.orchestra.run.smithi079.stdout:(48/150): automake-1.16.2-8.el9.noarch.rpm 3.8 MB/s | 689 kB 00:00 2024-08-20T01:24:42.851 INFO:teuthology.orchestra.run.smithi081.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:24:42.866 INFO:teuthology.orchestra.run.smithi175.stdout:(83/150): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-08-20T01:24:42.870 INFO:teuthology.orchestra.run.smithi079.stdout:(49/150): bison-3.7.4-5.el9.x86_64.rpm 4.8 MB/s | 943 kB 00:00 2024-08-20T01:24:42.880 INFO:teuthology.orchestra.run.smithi081.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:24:42.895 INFO:teuthology.orchestra.run.smithi079.stdout:(50/150): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-08-20T01:24:42.912 INFO:teuthology.orchestra.run.smithi079.stdout:(51/150): elfutils-libelf-devel-0.191-4.el9.x86 519 kB/s | 22 kB 00:00 2024-08-20T01:24:42.925 INFO:teuthology.orchestra.run.smithi175.stdout:(84/150): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-08-20T01:24:42.984 INFO:teuthology.orchestra.run.smithi175.stdout:(85/150): python3-prettytable-0.7.2-27.el9.noar 725 kB/s | 42 kB 00:00 2024-08-20T01:24:43.051 INFO:teuthology.orchestra.run.smithi175.stdout:(86/150): python3-protobuf-3.14.0-13.el9.noarch 4.0 MB/s | 269 kB 00:00 2024-08-20T01:24:43.118 INFO:teuthology.orchestra.run.smithi175.stdout:(87/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-08-20T01:24:43.152 INFO:teuthology.orchestra.run.smithi175.stdout:(88/150): python3-devel-3.9.19-7.el9.x86_64.rpm 244 kB/s | 245 kB 00:01 2024-08-20T01:24:43.177 INFO:teuthology.orchestra.run.smithi175.stdout:(89/150): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-08-20T01:24:43.204 INFO:teuthology.orchestra.run.smithi081.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:24:43.219 INFO:teuthology.orchestra.run.smithi175.stdout:(90/150): python3-pytz-2021.1-5.el9.noarch.rpm 767 kB/s | 51 kB 00:00 2024-08-20T01:24:43.219 INFO:teuthology.orchestra.run.smithi081.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:24:43.241 INFO:teuthology.orchestra.run.smithi081.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-20T01:24:43.244 INFO:teuthology.orchestra.run.smithi175.stdout:(91/150): python3-requests-oauthlib-1.3.0-12.el 802 kB/s | 54 kB 00:00 2024-08-20T01:24:43.255 INFO:teuthology.orchestra.run.smithi081.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-20T01:24:43.294 INFO:teuthology.orchestra.run.smithi175.stdout:(92/150): python3-toml-0.10.2-6.el9.noarch.rpm 832 kB/s | 42 kB 00:00 2024-08-20T01:24:43.313 INFO:teuthology.orchestra.run.smithi081.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 172.65.90.22) 2024-08-20T01:24:43.335 INFO:teuthology.orchestra.run.smithi081.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 172.65.90.22) 2024-08-20T01:24:43.346 INFO:teuthology.orchestra.run.smithi079.stdout:(52/150): ceph-test-19.0.0-5872.gef427541.el9.x 6.3 MB/s | 50 MB 00:08 2024-08-20T01:24:43.354 INFO:teuthology.orchestra.run.smithi175.stdout:(93/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 759 kB/s | 44 kB 00:00 2024-08-20T01:24:43.380 INFO:teuthology.orchestra.run.smithi079.stdout:(53/150): flex-2.6.4-9.el9.x86_64.rpm 648 kB/s | 313 kB 00:00 2024-08-20T01:24:43.396 INFO:teuthology.orchestra.run.smithi079.stdout:(54/150): flexiblas-3.0.4-8.el9.x86_64.rpm 68 kB/s | 33 kB 00:00 2024-08-20T01:24:43.411 INFO:teuthology.orchestra.run.smithi081.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 172.65.90.20) 2024-08-20T01:24:43.411 INFO:teuthology.orchestra.run.smithi175.stdout:(94/150): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-08-20T01:24:43.430 INFO:teuthology.orchestra.run.smithi079.stdout:(55/150): libaio-devel-0.3.111-13.el9.x86_64.rp 334 kB/s | 11 kB 00:00 2024-08-20T01:24:43.451 INFO:teuthology.orchestra.run.smithi081.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 172.65.90.20) 2024-08-20T01:24:43.455 INFO:teuthology.orchestra.run.smithi079.stdout:(56/150): flexiblas-openblas-openmp-3.0.4-8.el9 241 kB/s | 18 kB 00:00 2024-08-20T01:24:43.481 INFO:teuthology.orchestra.run.smithi079.stdout:(57/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-08-20T01:24:43.487 INFO:teuthology.orchestra.run.smithi175.stdout:(95/150): qatlib-service-24.02.0-1.el9.x86_64.r 479 kB/s | 36 kB 00:00 2024-08-20T01:24:43.500 INFO:teuthology.orchestra.run.smithi081.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:24:43.539 INFO:teuthology.orchestra.run.smithi079.stdout:(58/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 16 MB/s | 3.0 MB 00:00 2024-08-20T01:24:43.564 INFO:teuthology.orchestra.run.smithi079.stdout:(59/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 416 kB/s | 45 kB 00:00 2024-08-20T01:24:43.598 INFO:teuthology.orchestra.run.smithi079.stdout:(60/150): libtool-2.4.6-46.el9.x86_64.rpm 9.7 MB/s | 581 kB 00:00 2024-08-20T01:24:43.623 INFO:teuthology.orchestra.run.smithi079.stdout:(61/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 436 kB/s | 25 kB 00:00 2024-08-20T01:24:43.649 INFO:teuthology.orchestra.run.smithi079.stdout:(62/150): librdkafka-1.6.1-102.el9.x86_64.rpm 3.9 MB/s | 662 kB 00:00 2024-08-20T01:24:43.674 INFO:teuthology.orchestra.run.smithi079.stdout:(63/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 628 kB/s | 47 kB 00:00 2024-08-20T01:24:43.695 INFO:teuthology.orchestra.run.smithi175.stdout:(96/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 228 kB/s | 47 kB 00:00 2024-08-20T01:24:43.699 INFO:teuthology.orchestra.run.smithi079.stdout:(64/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-08-20T01:24:43.699 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-20T01:24:43.733 INFO:teuthology.orchestra.run.smithi079.stdout:(65/150): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-08-20T01:24:43.733 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-20T01:24:43.754 INFO:teuthology.orchestra.run.smithi175.stdout:(97/150): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-08-20T01:24:43.813 INFO:teuthology.orchestra.run.smithi175.stdout:(98/150): uuid-1.6.2-55.el9.x86_64.rpm 994 kB/s | 58 kB 00:00 2024-08-20T01:24:43.842 INFO:teuthology.orchestra.run.smithi079.stdout:(66/150): openssl-devel-3.2.2-2.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-08-20T01:24:43.842 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 172.65.90.21) 2024-08-20T01:24:43.845 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 172.65.90.21) 2024-08-20T01:24:43.868 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-20T01:24:43.919 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 172.65.90.21) 2024-08-20T01:24:43.927 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 172.65.90.23) 2024-08-20T01:24:43.928 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 172.65.90.23) 2024-08-20T01:24:43.956 INFO:teuthology.orchestra.run.smithi081.stdout:(40/150): ceph-test-19.0.0-5872.gef427541.el9.x 7.3 MB/s | 50 MB 00:06 2024-08-20T01:24:43.966 INFO:teuthology.orchestra.run.smithi081.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:24:43.971 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:24:43.972 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:24:43.996 INFO:teuthology.orchestra.run.smithi175.stdout:(99/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 21 MB/s | 16 MB 00:00 2024-08-20T01:24:43.997 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] xfsprogs-devel-6.4.0-4.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/xfsprogs-devel-6.4.0-4.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:24:44.010 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 172.65.90.23) 2024-08-20T01:24:44.032 INFO:teuthology.orchestra.run.smithi081.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:24:44.033 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:24:44.045 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:24:44.054 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:24:44.054 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:24:44.069 INFO:teuthology.orchestra.run.smithi081.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T01:24:44.088 INFO:teuthology.orchestra.run.smithi175.stdout:(100/150): postgresql-server-13.16-1.el9.x86_64 2.3 MB/s | 5.8 MB 00:02 2024-08-20T01:24:44.089 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] xfsprogs-devel-6.4.0-4.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/xfsprogs-devel-6.4.0-4.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T01:24:44.113 INFO:teuthology.orchestra.run.smithi175.stdout:(101/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 548 kB/s | 64 kB 00:00 2024-08-20T01:24:44.147 INFO:teuthology.orchestra.run.smithi175.stdout:(102/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 774 kB/s | 45 kB 00:00 2024-08-20T01:24:44.147 INFO:teuthology.orchestra.run.smithi081.stdout:(41/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2024-08-20T01:24:44.210 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:24:44.220 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:24:44.224 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:24:44.230 INFO:teuthology.orchestra.run.smithi175.stdout:(103/150): lua-devel-5.4.4-4.el9.x86_64.rpm 191 kB/s | 22 kB 00:00 2024-08-20T01:24:44.256 INFO:teuthology.orchestra.run.smithi081.stdout:(42/150): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.2 MB 00:00 2024-08-20T01:24:44.281 INFO:teuthology.orchestra.run.smithi175.stdout:(104/150): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-08-20T01:24:44.306 INFO:teuthology.orchestra.run.smithi175.stdout:(105/150): gperftools-libs-2.9.1-2.el9.x86_64.r 12 MB/s | 309 kB 00:00 2024-08-20T01:24:44.306 INFO:teuthology.orchestra.run.smithi081.stdout:(43/150): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-08-20T01:24:44.331 INFO:teuthology.orchestra.run.smithi175.stdout:(106/150): grpc-data-1.46.7-10.el9.noarch.rpm 779 kB/s | 19 kB 00:00 2024-08-20T01:24:44.357 INFO:teuthology.orchestra.run.smithi081.stdout:(44/150): python3-pycparser-2.20-6.el9.noarch.r 3.1 MB/s | 135 kB 00:00 2024-08-20T01:24:44.373 INFO:teuthology.orchestra.run.smithi175.stdout:(107/150): protobuf-compiler-3.14.0-13.el9.x86_ 3.7 MB/s | 863 kB 00:00 2024-08-20T01:24:44.407 INFO:teuthology.orchestra.run.smithi081.stdout:(45/150): python3-requests-2.25.1-8.el9.noarch. 2.5 MB/s | 125 kB 00:00 2024-08-20T01:24:44.424 INFO:teuthology.orchestra.run.smithi175.stdout:(108/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 522 kB/s | 26 kB 00:00 2024-08-20T01:24:44.449 INFO:teuthology.orchestra.run.smithi175.stdout:(109/150): liboath-2.6.7-2.el9.x86_64.rpm 2.0 MB/s | 49 kB 00:00 2024-08-20T01:24:44.457 INFO:teuthology.orchestra.run.smithi081.stdout:(46/150): python3-urllib3-1.26.5-6.el9.noarch.r 4.3 MB/s | 215 kB 00:00 2024-08-20T01:24:44.474 INFO:teuthology.orchestra.run.smithi175.stdout:(110/150): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-08-20T01:24:44.507 INFO:teuthology.orchestra.run.smithi175.stdout:(111/150): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-08-20T01:24:44.542 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:24:44.558 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:24:44.560 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:24:44.582 INFO:teuthology.orchestra.run.smithi081.stdout:(47/150): automake-1.16.2-8.el9.noarch.rpm 5.4 MB/s | 689 kB 00:00 2024-08-20T01:24:44.583 INFO:teuthology.orchestra.run.smithi175.stdout:(112/150): libarrow-9.0.0-11.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-08-20T01:24:44.608 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-20T01:24:44.625 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for http://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-20T01:24:44.625 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-20T01:24:44.625 INFO:teuthology.orchestra.run.smithi175.stdout:(113/150): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-08-20T01:24:44.659 INFO:teuthology.orchestra.run.smithi175.stdout:(114/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.4 MB/s | 839 kB 00:00 2024-08-20T01:24:44.683 INFO:teuthology.orchestra.run.smithi175.stdout:(115/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 743 kB/s | 43 kB 00:00 2024-08-20T01:24:44.709 INFO:teuthology.orchestra.run.smithi175.stdout:(116/150): python3-cachetools-4.2.4-1.el9.noarc 643 kB/s | 32 kB 00:00 2024-08-20T01:24:44.716 INFO:teuthology.orchestra.run.smithi081.stdout:(48/150): bison-3.7.4-5.el9.x86_64.rpm 6.9 MB/s | 943 kB 00:00 2024-08-20T01:24:44.718 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-20T01:24:44.733 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-20T01:24:44.734 INFO:teuthology.orchestra.run.smithi175.stdout:(117/150): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-08-20T01:24:44.739 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for https://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-20T01:24:44.760 INFO:teuthology.orchestra.run.smithi175.stdout:(118/150): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-08-20T01:24:44.785 INFO:teuthology.orchestra.run.smithi175.stdout:(119/150): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-08-20T01:24:44.799 INFO:teuthology.orchestra.run.smithi081.stdout:(49/150): boost-program-options-1.75.0-8.el9.x8 1.3 MB/s | 107 kB 00:00 2024-08-20T01:24:44.810 INFO:teuthology.orchestra.run.smithi175.stdout:(120/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-08-20T01:24:44.835 INFO:teuthology.orchestra.run.smithi175.stdout:(121/150): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 94 kB/s | 96 kB 00:01 2024-08-20T01:24:44.861 INFO:teuthology.orchestra.run.smithi175.stdout:(122/150): python3-google-auth-2.33.0-1.el9.noa 2.8 MB/s | 220 kB 00:00 2024-08-20T01:24:44.866 INFO:teuthology.orchestra.run.smithi081.stdout:(50/150): elfutils-libelf-devel-0.191-4.el9.x86 326 kB/s | 22 kB 00:00 2024-08-20T01:24:44.886 INFO:teuthology.orchestra.run.smithi175.stdout:(123/150): python3-jaraco-8.2.1-3.el9.noarch.rp 624 kB/s | 11 kB 00:00 2024-08-20T01:24:44.903 INFO:teuthology.orchestra.run.smithi175.stdout:(124/150): python3-jaraco-classes-3.2.1-5.el9.n 1.2 MB/s | 18 kB 00:00 2024-08-20T01:24:44.920 INFO:teuthology.orchestra.run.smithi175.stdout:(125/150): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-08-20T01:24:44.925 INFO:teuthology.orchestra.run.smithi081.stdout:(51/150): libquadmath-11.5.0-2.el9.x86_64.rpm 77 kB/s | 191 kB 00:02 2024-08-20T01:24:44.945 INFO:teuthology.orchestra.run.smithi175.stdout:(126/150): python3-grpcio-tools-1.46.7-10.el9.x 1.3 MB/s | 144 kB 00:00 2024-08-20T01:24:44.962 INFO:teuthology.orchestra.run.smithi175.stdout:(127/150): python3-jaraco-functools-3.5.0-2.el9 467 kB/s | 19 kB 00:00 2024-08-20T01:24:44.984 INFO:teuthology.orchestra.run.smithi081.stdout:(52/150): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-08-20T01:24:45.009 INFO:teuthology.orchestra.run.smithi081.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 391 kB/s | 33 kB 00:00 2024-08-20T01:24:45.012 INFO:teuthology.orchestra.run.smithi175.stdout:(128/150): python3-grpcio-1.46.7-10.el9.x86_64. 10 MB/s | 2.0 MB 00:00 2024-08-20T01:24:45.037 INFO:teuthology.orchestra.run.smithi175.stdout:(129/150): python3-jaraco-text-3.2.0-6.el9.noar 262 kB/s | 20 kB 00:00 2024-08-20T01:24:45.062 INFO:teuthology.orchestra.run.smithi175.stdout:(130/150): python3-logutils-0.3.5-21.el9.noarch 926 kB/s | 46 kB 00:00 2024-08-20T01:24:45.088 INFO:teuthology.orchestra.run.smithi175.stdout:(131/150): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-08-20T01:24:45.093 INFO:teuthology.orchestra.run.smithi081.stdout:(54/150): flexiblas-openblas-openmp-3.0.4-8.el9 240 kB/s | 18 kB 00:00 2024-08-20T01:24:45.113 INFO:teuthology.orchestra.run.smithi175.stdout:(132/150): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-08-20T01:24:45.138 INFO:teuthology.orchestra.run.smithi175.stdout:(133/150): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-08-20T01:24:45.152 INFO:teuthology.orchestra.run.smithi081.stdout:(55/150): libaio-devel-0.3.111-13.el9.x86_64.rp 192 kB/s | 11 kB 00:00 2024-08-20T01:24:45.164 INFO:teuthology.orchestra.run.smithi175.stdout:(134/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-08-20T01:24:45.189 INFO:teuthology.orchestra.run.smithi175.stdout:(135/150): python3-pecan-1.4.2-3.el9.noarch.rpm 2.7 MB/s | 272 kB 00:00 2024-08-20T01:24:45.214 INFO:teuthology.orchestra.run.smithi175.stdout:(136/150): python3-pyperclip-1.8.2-2.el9.noarch 564 kB/s | 28 kB 00:00 2024-08-20T01:24:45.239 INFO:teuthology.orchestra.run.smithi175.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 615 kB/s | 31 kB 00:00 2024-08-20T01:24:45.260 INFO:teuthology.orchestra.run.smithi081.stdout:(56/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2024-08-20T01:24:45.273 INFO:teuthology.orchestra.run.smithi175.stdout:(138/150): python3-kubernetes-26.1.0-2.el9.noar 3.3 MB/s | 1.0 MB 00:00 2024-08-20T01:24:45.275 INFO:teuthology.orchestra.run.smithi079.stdout:(67/150): openblas-0.3.26-1.el9.x86_64.rpm 24 kB/s | 38 kB 00:01 2024-08-20T01:24:45.285 INFO:teuthology.orchestra.run.smithi081.stdout:(57/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-08-20T01:24:45.298 INFO:teuthology.orchestra.run.smithi175.stdout:(139/150): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-08-20T01:24:45.309 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-20T01:24:45.324 INFO:teuthology.orchestra.run.smithi175.stdout:(140/150): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-08-20T01:24:45.349 INFO:teuthology.orchestra.run.smithi175.stdout:(141/150): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-08-20T01:24:45.360 INFO:teuthology.orchestra.run.smithi081.stdout:(58/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 453 kB/s | 45 kB 00:00 2024-08-20T01:24:45.374 INFO:teuthology.orchestra.run.smithi175.stdout:(142/150): python3-typing-extensions-4.12.2-2.e 988 kB/s | 74 kB 00:00 2024-08-20T01:24:45.399 INFO:teuthology.orchestra.run.smithi175.stdout:(143/150): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-08-20T01:24:45.425 INFO:teuthology.orchestra.run.smithi175.stdout:(144/150): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-08-20T01:24:45.436 INFO:teuthology.orchestra.run.smithi081.stdout:(59/150): librdkafka-1.6.1-102.el9.x86_64.rpm 4.5 MB/s | 662 kB 00:00 2024-08-20T01:24:45.450 INFO:teuthology.orchestra.run.smithi175.stdout:(145/150): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-08-20T01:24:45.475 INFO:teuthology.orchestra.run.smithi175.stdout:(146/150): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-08-20T01:24:45.498 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 172.65.90.21) 2024-08-20T01:24:45.500 INFO:teuthology.orchestra.run.smithi175.stdout:(147/150): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-08-20T01:24:45.503 INFO:teuthology.orchestra.run.smithi081.stdout:(60/150): libtool-2.4.6-46.el9.x86_64.rpm 4.0 MB/s | 581 kB 00:00 2024-08-20T01:24:45.520 INFO:teuthology.orchestra.run.smithi081.stdout:(61/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 306 kB/s | 25 kB 00:00 2024-08-20T01:24:45.542 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:24:45.559 INFO:teuthology.orchestra.run.smithi175.stdout:(148/150): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-08-20T01:24:45.570 INFO:teuthology.orchestra.run.smithi081.stdout:(62/150): libgfortran-11.5.0-2.el9.x86_64.rpm 244 kB/s | 801 kB 00:03 2024-08-20T01:24:45.627 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 172.65.90.23) 2024-08-20T01:24:45.646 INFO:teuthology.orchestra.run.smithi081.stdout:(63/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 335 kB/s | 47 kB 00:00 2024-08-20T01:24:45.704 INFO:teuthology.orchestra.run.smithi081.stdout:(64/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.6 MB/s | 292 kB 00:00 2024-08-20T01:24:45.705 INFO:teuthology.orchestra.run.smithi081.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://iad.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-20T01:24:45.738 INFO:teuthology.orchestra.run.smithi081.stdout:(65/150): lua-5.4.4-4.el9.x86_64.rpm 1.1 MB/s | 188 kB 00:00 2024-08-20T01:24:45.754 INFO:teuthology.orchestra.run.smithi081.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://iad.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-20T01:24:45.771 INFO:teuthology.orchestra.run.smithi081.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://iad.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-20T01:24:45.787 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:24:45.790 INFO:teuthology.orchestra.run.smithi081.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://iad.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-20T01:24:45.861 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T01:24:45.892 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for http://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-20T01:24:45.951 INFO:teuthology.orchestra.run.smithi175.stdout:(149/150): librados2-19.0.0-5872.gef427541.el9. 7.3 MB/s | 3.5 MB 00:00 2024-08-20T01:24:46.009 INFO:teuthology.orchestra.run.smithi175.stdout:(150/150): librbd1-19.0.0-5872.gef427541.el9.x8 6.5 MB/s | 3.2 MB 00:00 2024-08-20T01:24:46.019 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2024-08-20T01:24:46.019 INFO:teuthology.orchestra.run.smithi175.stdout:Total 12 MB/s | 232 MB 00:19 2024-08-20T01:24:46.067 INFO:teuthology.orchestra.run.smithi079.stdout:(68/150): openblas-openmp-0.3.26-1.el9.x86_64.r 2.1 MB/s | 4.9 MB 00:02 2024-08-20T01:24:46.085 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] postgresql-private-libs-13.16-1.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-private-libs-13.16-1.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-20T01:24:46.105 INFO:teuthology.orchestra.run.smithi081.stdout:(66/150): openssl-devel-3.2.2-2.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-08-20T01:24:46.142 INFO:teuthology.orchestra.run.smithi081.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for https://iad.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-20T01:24:46.159 INFO:teuthology.orchestra.run.smithi079.stdout:(69/150): postgresql-13.16-1.el9.x86_64.rpm 701 kB/s | 1.6 MB 00:02 2024-08-20T01:24:46.159 INFO:teuthology.orchestra.run.smithi081.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for http://iad.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-20T01:24:46.176 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] postgresql-server-13.16-1.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-server-13.16-1.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-20T01:24:46.465 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:24:46.465 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] postgresql-private-libs-13.16-1.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-private-libs-13.16-1.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T01:24:46.466 INFO:teuthology.orchestra.run.smithi081.stdout:(67/150): openblas-0.3.26-1.el9.x86_64.rpm 53 kB/s | 38 kB 00:00 2024-08-20T01:24:46.466 INFO:teuthology.orchestra.run.smithi081.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for https://iad.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-20T01:24:46.466 INFO:teuthology.orchestra.run.smithi081.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for http://iad.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-20T01:24:46.930 INFO:teuthology.orchestra.run.smithi081.stdout:(68/150): openblas-openmp-0.3.26-1.el9.x86_64.r 4.0 MB/s | 4.9 MB 00:01 2024-08-20T01:24:46.965 INFO:teuthology.orchestra.run.smithi081.stdout:[MIRROR] postgresql-private-libs-13.16-1.el9.x86_64.rpm: Status code: 404 for https://iad.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-private-libs-13.16-1.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-20T01:24:47.117 INFO:teuthology.orchestra.run.smithi079.stdout:(70/150): postgresql-private-libs-13.16-1.el9.x 131 kB/s | 137 kB 00:01 2024-08-20T01:24:47.151 INFO:teuthology.orchestra.run.smithi079.stdout:(71/150): postgresql-contrib-13.16-1.el9.x86_64 485 kB/s | 910 kB 00:01 2024-08-20T01:24:47.151 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2024-08-20T01:24:47.163 INFO:teuthology.orchestra.run.smithi081.stdout:(69/150): postgresql-13.16-1.el9.x86_64.rpm 1.5 MB/s | 1.6 MB 00:01 2024-08-20T01:24:47.268 INFO:teuthology.orchestra.run.smithi079.stdout:(72/150): python3-attrs-20.3.0-7.el9.noarch.rpm 752 kB/s | 87 kB 00:00 2024-08-20T01:24:47.279 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2024-08-20T01:24:47.279 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2024-08-20T01:24:47.343 INFO:teuthology.orchestra.run.smithi079.stdout:(73/150): postgresql-server-13.16-1.el9.x86_64. 4.9 MB/s | 5.8 MB 00:01 2024-08-20T01:24:47.377 INFO:teuthology.orchestra.run.smithi079.stdout:(74/150): protobuf-3.14.0-13.el9.x86_64.rpm 3.9 MB/s | 1.0 MB 00:00 2024-08-20T01:24:47.394 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] python3-devel-3.9.19-7.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-devel-3.9.19-7.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-20T01:24:47.397 INFO:teuthology.orchestra.run.smithi081.stdout:(70/150): postgresql-contrib-13.16-1.el9.x86_64 887 kB/s | 910 kB 00:01 2024-08-20T01:24:47.460 INFO:teuthology.orchestra.run.smithi079.stdout:(75/150): python3-colorama-0.4.6-3.el9.noarch.r 525 kB/s | 61 kB 00:00 2024-08-20T01:24:47.502 INFO:teuthology.orchestra.run.smithi079.stdout:(76/150): python3-jinja2-2.11.3-6.el9.noarch.rp 5.9 MB/s | 248 kB 00:00 2024-08-20T01:24:47.586 INFO:teuthology.orchestra.run.smithi079.stdout:(77/150): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 6.0 MB 00:00 2024-08-20T01:24:47.603 INFO:teuthology.orchestra.run.smithi079.stdout:(78/150): python3-jsonpatch-1.21-16.el9.noarch. 255 kB/s | 26 kB 00:00 2024-08-20T01:24:47.619 INFO:teuthology.orchestra.run.smithi079.stdout:(79/150): python3-jsonpointer-2.0-4.el9.noarch. 577 kB/s | 19 kB 00:00 2024-08-20T01:24:47.646 INFO:teuthology.orchestra.run.smithi079.stdout:(80/150): python3-mako-1.1.4-6.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2024-08-20T01:24:47.656 INFO:teuthology.orchestra.run.smithi081.stdout:(71/150): postgresql-private-libs-13.16-1.el9.x 189 kB/s | 137 kB 00:00 2024-08-20T01:24:47.703 INFO:teuthology.orchestra.run.smithi079.stdout:(81/150): python3-markupsafe-1.1.1-12.el9.x86_6 415 kB/s | 35 kB 00:00 2024-08-20T01:24:47.754 INFO:teuthology.orchestra.run.smithi079.stdout:(82/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.9 MB/s | 250 kB 00:00 2024-08-20T01:24:47.796 INFO:teuthology.orchestra.run.smithi079.stdout:(83/150): python3-oauthlib-3.1.1-5.el9.noarch.r 5.2 MB/s | 222 kB 00:00 2024-08-20T01:24:47.887 INFO:teuthology.orchestra.run.smithi079.stdout:(84/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 21 MB/s | 5.1 MB 00:00 2024-08-20T01:24:47.904 INFO:teuthology.orchestra.run.smithi079.stdout:(85/150): python3-packaging-20.9-5.el9.noarch.r 716 kB/s | 77 kB 00:00 2024-08-20T01:24:47.921 INFO:teuthology.orchestra.run.smithi079.stdout:(86/150): python3-prettytable-0.7.2-27.el9.noar 1.2 MB/s | 42 kB 00:00 2024-08-20T01:24:47.946 INFO:teuthology.orchestra.run.smithi079.stdout:(87/150): python3-protobuf-3.14.0-13.el9.noarch 6.3 MB/s | 269 kB 00:00 2024-08-20T01:24:47.972 INFO:teuthology.orchestra.run.smithi079.stdout:(88/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-08-20T01:24:47.997 INFO:teuthology.orchestra.run.smithi079.stdout:(89/150): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-08-20T01:24:48.014 INFO:teuthology.orchestra.run.smithi079.stdout:(90/150): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-08-20T01:24:48.031 INFO:teuthology.orchestra.run.smithi079.stdout:(91/150): python3-requests-oauthlib-1.3.0-12.el 1.6 MB/s | 54 kB 00:00 2024-08-20T01:24:48.065 INFO:teuthology.orchestra.run.smithi079.stdout:(92/150): python3-toml-0.10.2-6.el9.noarch.rpm 1.2 MB/s | 42 kB 00:00 2024-08-20T01:24:48.098 INFO:teuthology.orchestra.run.smithi079.stdout:(93/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.3 MB/s | 44 kB 00:00 2024-08-20T01:24:48.140 INFO:teuthology.orchestra.run.smithi079.stdout:(94/150): qatlib-24.02.0-1.el9.x86_64.rpm 5.2 MB/s | 221 kB 00:00 2024-08-20T01:24:48.182 INFO:teuthology.orchestra.run.smithi079.stdout:(95/150): qatlib-service-24.02.0-1.el9.x86_64.r 860 kB/s | 36 kB 00:00 2024-08-20T01:24:48.306 INFO:teuthology.orchestra.run.smithi081.stdout:(72/150): postgresql-server-13.16-1.el9.x86_64. 5.1 MB/s | 5.8 MB 00:01 2024-08-20T01:24:48.331 INFO:teuthology.orchestra.run.smithi081.stdout:(73/150): python3-attrs-20.3.0-7.el9.noarch.rpm 129 kB/s | 87 kB 00:00 2024-08-20T01:24:48.349 INFO:teuthology.orchestra.run.smithi079.stdout:(96/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 49 MB/s | 16 MB 00:00 2024-08-20T01:24:48.365 INFO:teuthology.orchestra.run.smithi081.stdout:(74/150): protobuf-3.14.0-13.el9.x86_64.rpm 1.1 MB/s | 1.0 MB 00:00 2024-08-20T01:24:48.366 INFO:teuthology.orchestra.run.smithi079.stdout:(97/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 258 kB/s | 47 kB 00:00 2024-08-20T01:24:48.392 INFO:teuthology.orchestra.run.smithi079.stdout:(98/150): python3-devel-3.9.19-7.el9.x86_64.rpm 241 kB/s | 245 kB 00:01 2024-08-20T01:24:48.408 INFO:teuthology.orchestra.run.smithi079.stdout:(99/150): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-08-20T01:24:48.409 INFO:teuthology.orchestra.run.smithi079.stdout:[MIRROR] xfsprogs-devel-6.4.0-4.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/xfsprogs-devel-6.4.0-4.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-20T01:24:48.442 INFO:teuthology.orchestra.run.smithi079.stdout:(100/150): socat-1.7.4.1-6.el9.x86_64.rpm 3.2 MB/s | 304 kB 00:00 2024-08-20T01:24:48.462 INFO:teuthology.orchestra.run.smithi079.stdout:(101/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-08-20T01:24:48.476 INFO:teuthology.orchestra.run.smithi079.stdout:(102/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-08-20T01:24:48.965 INFO:teuthology.orchestra.run.smithi081.stdout:(75/150): python3-colorama-0.4.6-3.el9.noarch.r 97 kB/s | 61 kB 00:00 2024-08-20T01:24:48.984 INFO:teuthology.orchestra.run.smithi079.stdout:(103/150): lua-devel-5.4.4-4.el9.x86_64.rpm 42 kB/s | 22 kB 00:00 2024-08-20T01:24:49.051 INFO:teuthology.orchestra.run.smithi079.stdout:(104/150): abseil-cpp-20211102.0-3.el9.x86_64.r 8.1 MB/s | 548 kB 00:00 2024-08-20T01:24:49.078 INFO:teuthology.orchestra.run.smithi079.stdout:(105/150): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 140 kB/s | 96 kB 00:00 2024-08-20T01:24:49.095 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2024-08-20T01:24:49.096 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2024-08-20T01:24:49.110 INFO:teuthology.orchestra.run.smithi079.stdout:(106/150): gperftools-libs-2.9.1-2.el9.x86_64.r 5.2 MB/s | 309 kB 00:00 2024-08-20T01:24:49.135 INFO:teuthology.orchestra.run.smithi079.stdout:(107/150): grpc-data-1.46.7-10.el9.noarch.rpm 332 kB/s | 19 kB 00:00 2024-08-20T01:24:49.161 INFO:teuthology.orchestra.run.smithi079.stdout:(108/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-08-20T01:24:49.165 INFO:teuthology.orchestra.run.smithi081.stdout:(76/150): python3-devel-3.9.19-7.el9.x86_64.rpm 306 kB/s | 245 kB 00:00 2024-08-20T01:24:49.186 INFO:teuthology.orchestra.run.smithi079.stdout:(109/150): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-08-20T01:24:49.211 INFO:teuthology.orchestra.run.smithi079.stdout:(110/150): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-08-20T01:24:49.245 INFO:teuthology.orchestra.run.smithi079.stdout:(111/150): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-08-20T01:24:49.320 INFO:teuthology.orchestra.run.smithi079.stdout:(112/150): libarrow-9.0.0-11.el9.x86_64.rpm 21 MB/s | 4.4 MB 00:00 2024-08-20T01:24:49.362 INFO:teuthology.orchestra.run.smithi079.stdout:(113/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 839 kB 00:00 2024-08-20T01:24:49.387 INFO:teuthology.orchestra.run.smithi079.stdout:(114/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-08-20T01:24:49.413 INFO:teuthology.orchestra.run.smithi079.stdout:(115/150): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-08-20T01:24:49.446 INFO:teuthology.orchestra.run.smithi079.stdout:(116/150): protobuf-compiler-3.14.0-13.el9.x86_ 890 kB/s | 863 kB 00:00 2024-08-20T01:24:49.466 INFO:teuthology.orchestra.run.smithi081.stdout:(77/150): python3-babel-2.9.1-2.el9.noarch.rpm 5.1 MB/s | 6.0 MB 00:01 2024-08-20T01:24:49.472 INFO:teuthology.orchestra.run.smithi079.stdout:(117/150): python3-certifi-2023.05.07-4.el9.noa 241 kB/s | 14 kB 00:00 2024-08-20T01:24:49.514 INFO:teuthology.orchestra.run.smithi079.stdout:(118/150): python3-asyncssh-2.13.2-5.el9.noarch 2.8 MB/s | 548 kB 00:00 2024-08-20T01:24:49.539 INFO:teuthology.orchestra.run.smithi079.stdout:(119/150): python3-cheroot-8.6.0-4.el9.noarch.r 1.8 MB/s | 172 kB 00:00 2024-08-20T01:24:49.564 INFO:teuthology.orchestra.run.smithi079.stdout:(120/150): python3-google-auth-2.33.0-1.el9.noa 8.7 MB/s | 220 kB 00:00 2024-08-20T01:24:49.589 INFO:teuthology.orchestra.run.smithi079.stdout:(121/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.0 MB/s | 303 kB 00:00 2024-08-20T01:24:49.615 INFO:teuthology.orchestra.run.smithi079.stdout:(122/150): python3-cherrypy-18.6.1-2.el9.noarch 2.5 MB/s | 358 kB 00:00 2024-08-20T01:24:49.640 INFO:teuthology.orchestra.run.smithi079.stdout:(123/150): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-08-20T01:24:49.657 INFO:teuthology.orchestra.run.smithi079.stdout:(124/150): python3-jaraco-8.2.1-3.el9.noarch.rp 254 kB/s | 11 kB 00:00 2024-08-20T01:24:49.674 INFO:teuthology.orchestra.run.smithi079.stdout:(125/150): python3-jaraco-classes-3.2.1-5.el9.n 522 kB/s | 18 kB 00:00 2024-08-20T01:24:49.691 INFO:teuthology.orchestra.run.smithi079.stdout:(126/150): python3-jaraco-collections-3.0.0-8.e 691 kB/s | 23 kB 00:00 2024-08-20T01:24:49.708 INFO:teuthology.orchestra.run.smithi079.stdout:(127/150): python3-jaraco-functools-3.5.0-2.el9 581 kB/s | 19 kB 00:00 2024-08-20T01:24:49.724 INFO:teuthology.orchestra.run.smithi081.stdout:(78/150): python3-jsonpatch-1.21-16.el9.noarch. 46 kB/s | 26 kB 00:00 2024-08-20T01:24:49.725 INFO:teuthology.orchestra.run.smithi079.stdout:(128/150): python3-jaraco-text-3.2.0-6.el9.noar 590 kB/s | 20 kB 00:00 2024-08-20T01:24:49.742 INFO:teuthology.orchestra.run.smithi079.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-08-20T01:24:49.758 INFO:teuthology.orchestra.run.smithi081.stdout:(79/150): python3-jinja2-2.11.3-6.el9.noarch.rp 313 kB/s | 248 kB 00:00 2024-08-20T01:24:49.767 INFO:teuthology.orchestra.run.smithi079.stdout:(130/150): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-20T01:24:49.784 INFO:teuthology.orchestra.run.smithi079.stdout:(131/150): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-08-20T01:24:49.818 INFO:teuthology.orchestra.run.smithi079.stdout:(132/150): python3-kubernetes-26.1.0-2.el9.noar 9.3 MB/s | 1.0 MB 00:00 2024-08-20T01:24:49.835 INFO:teuthology.orchestra.run.smithi079.stdout:(133/150): python3-portend-3.1.0-2.el9.noarch.r 1.0 MB/s | 16 kB 00:00 2024-08-20T01:24:49.868 INFO:teuthology.orchestra.run.smithi079.stdout:(134/150): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-08-20T01:24:49.885 INFO:teuthology.orchestra.run.smithi079.stdout:(135/150): python3-pyperclip-1.8.2-2.el9.noarch 1.7 MB/s | 28 kB 00:00 2024-08-20T01:24:49.911 INFO:teuthology.orchestra.run.smithi079.stdout:(136/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-08-20T01:24:49.928 INFO:teuthology.orchestra.run.smithi079.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 734 kB/s | 31 kB 00:00 2024-08-20T01:24:49.950 INFO:teuthology.orchestra.run.smithi081.stdout:(80/150): python3-jsonpointer-2.0-4.el9.noarch. 40 kB/s | 19 kB 00:00 2024-08-20T01:24:49.953 INFO:teuthology.orchestra.run.smithi079.stdout:(138/150): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-20T01:24:49.978 INFO:teuthology.orchestra.run.smithi079.stdout:(139/150): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-08-20T01:24:50.003 INFO:teuthology.orchestra.run.smithi079.stdout:(140/150): python3-routes-2.5.1-5.el9.noarch.rp 2.0 MB/s | 188 kB 00:00 2024-08-20T01:24:50.029 INFO:teuthology.orchestra.run.smithi079.stdout:(141/150): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-08-20T01:24:50.071 INFO:teuthology.orchestra.run.smithi079.stdout:(142/150): python3-grpcio-1.46.7-10.el9.x86_64. 4.0 MB/s | 2.0 MB 00:00 2024-08-20T01:24:50.099 INFO:teuthology.orchestra.run.smithi079.stdout:(143/150): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-08-20T01:24:50.121 INFO:teuthology.orchestra.run.smithi079.stdout:(144/150): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-08-20T01:24:50.146 INFO:teuthology.orchestra.run.smithi079.stdout:(145/150): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-08-20T01:24:50.172 INFO:teuthology.orchestra.run.smithi079.stdout:(146/150): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-08-20T01:24:50.197 INFO:teuthology.orchestra.run.smithi079.stdout:(147/150): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-08-20T01:24:50.247 INFO:teuthology.orchestra.run.smithi079.stdout:(148/150): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-08-20T01:24:50.309 INFO:teuthology.orchestra.run.smithi081.stdout:(81/150): python3-markupsafe-1.1.1-12.el9.x86_6 63 kB/s | 35 kB 00:00 2024-08-20T01:24:50.459 INFO:teuthology.orchestra.run.smithi081.stdout:(82/150): python3-mako-1.1.4-6.el9.noarch.rpm 235 kB/s | 172 kB 00:00 2024-08-20T01:24:50.640 INFO:teuthology.orchestra.run.smithi079.stdout:(149/150): librados2-19.0.0-5872.gef427541.el9. 7.4 MB/s | 3.5 MB 00:00 2024-08-20T01:24:50.698 INFO:teuthology.orchestra.run.smithi079.stdout:(150/150): librbd1-19.0.0-5872.gef427541.el9.x8 6.6 MB/s | 3.2 MB 00:00 2024-08-20T01:24:50.707 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-08-20T01:24:50.707 INFO:teuthology.orchestra.run.smithi079.stdout:Total 10 MB/s | 232 MB 00:22 2024-08-20T01:24:51.209 INFO:teuthology.orchestra.run.smithi081.stdout:(83/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.1 MB/s | 5.1 MB 00:01 2024-08-20T01:24:51.234 INFO:teuthology.orchestra.run.smithi081.stdout:(84/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 271 kB/s | 250 kB 00:00 2024-08-20T01:24:51.368 INFO:teuthology.orchestra.run.smithi081.stdout:(85/150): python3-oauthlib-3.1.1-5.el9.noarch.r 244 kB/s | 222 kB 00:00 2024-08-20T01:24:51.810 INFO:teuthology.orchestra.run.smithi081.stdout:(86/150): python3-prettytable-0.7.2-27.el9.noar 73 kB/s | 42 kB 00:00 2024-08-20T01:24:51.817 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-08-20T01:24:51.852 INFO:teuthology.orchestra.run.smithi081.stdout:(87/150): python3-packaging-20.9-5.el9.noarch.r 120 kB/s | 77 kB 00:00 2024-08-20T01:24:51.945 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-08-20T01:24:51.945 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-08-20T01:24:52.277 INFO:teuthology.orchestra.run.smithi081.stdout:(88/150): python3-protobuf-3.14.0-13.el9.noarch 296 kB/s | 269 kB 00:00 2024-08-20T01:24:52.577 INFO:teuthology.orchestra.run.smithi081.stdout:(89/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 207 kB/s | 159 kB 00:00 2024-08-20T01:24:52.778 INFO:teuthology.orchestra.run.smithi081.stdout:(90/150): python3-pyasn1-modules-0.4.8-6.el9.no 301 kB/s | 279 kB 00:00 2024-08-20T01:24:52.878 INFO:teuthology.orchestra.run.smithi081.stdout:(91/150): python3-pytz-2021.1-5.el9.noarch.rpm 85 kB/s | 51 kB 00:00 2024-08-20T01:24:53.178 INFO:teuthology.orchestra.run.smithi081.stdout:(92/150): python3-requests-oauthlib-1.3.0-12.el 89 kB/s | 54 kB 00:00 2024-08-20T01:24:53.462 INFO:teuthology.orchestra.run.smithi081.stdout:(93/150): python3-toml-0.10.2-6.el9.noarch.rpm 71 kB/s | 42 kB 00:00 2024-08-20T01:24:53.745 INFO:teuthology.orchestra.run.smithi081.stdout:(94/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 78 kB/s | 44 kB 00:00 2024-08-20T01:24:53.759 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-08-20T01:24:53.760 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-08-20T01:24:54.304 INFO:teuthology.orchestra.run.smithi081.stdout:(95/150): qatlib-service-24.02.0-1.el9.x86_64.r 64 kB/s | 36 kB 00:00 2024-08-20T01:24:54.329 INFO:teuthology.orchestra.run.smithi081.stdout:(96/150): qatlib-24.02.0-1.el9.x86_64.rpm 255 kB/s | 221 kB 00:00 2024-08-20T01:24:54.896 INFO:teuthology.orchestra.run.smithi081.stdout:(97/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 80 kB/s | 47 kB 00:00 2024-08-20T01:24:55.028 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2024-08-20T01:24:55.103 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-20T01:24:55.128 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-20T01:24:55.171 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-20T01:24:55.271 INFO:teuthology.orchestra.run.smithi081.stdout:(98/150): socat-1.7.4.1-6.el9.x86_64.rpm 323 kB/s | 304 kB 00:00 2024-08-20T01:24:55.504 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-20T01:24:55.530 INFO:teuthology.orchestra.run.smithi081.stdout:(99/150): uuid-1.6.2-55.el9.x86_64.rpm 91 kB/s | 58 kB 00:00 2024-08-20T01:24:55.620 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : librados2-2:19.0.0-5872.gef427541.el9.x86_64 5/152 2024-08-20T01:24:55.743 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librados2-2:19.0.0-5872.gef427541.el9.x86_64 5/152 2024-08-20T01:24:55.771 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephfs2-2:19.0.0-5872.gef427541.el9.x86_64 6/152 2024-08-20T01:24:55.858 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libcephfs2-2:19.0.0-5872.gef427541.el9.x86_64 6/152 2024-08-20T01:24:55.896 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rados-2:19.0.0-5872.gef427541.el9.x86_64 7/152 2024-08-20T01:24:55.925 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-20T01:24:55.951 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-20T01:24:55.955 INFO:teuthology.orchestra.run.smithi081.stdout:(100/150): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 140 kB/s | 96 kB 00:00 2024-08-20T01:24:56.104 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 10/152 2024-08-20T01:24:56.165 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-13.16-1.el9.x86_64 11/152 2024-08-20T01:24:56.193 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephsqlite-2:19.0.0-5872.gef427541.el9.x86_64 12/152 2024-08-20T01:24:56.222 INFO:teuthology.orchestra.run.smithi081.stdout:(101/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 4.7 MB/s | 16 MB 00:03 2024-08-20T01:24:56.247 INFO:teuthology.orchestra.run.smithi081.stdout:(102/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 89 kB/s | 64 kB 00:00 2024-08-20T01:24:56.299 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libcephsqlite-2:19.0.0-5872.gef427541.el9.x86_64 12/152 2024-08-20T01:24:56.328 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libradosstriper1-2:19.0.0-5872.gef427541.el9.x86 13/152 2024-08-20T01:24:56.339 INFO:teuthology.orchestra.run.smithi081.stdout:(103/150): lua-devel-5.4.4-4.el9.x86_64.rpm 192 kB/s | 22 kB 00:00 2024-08-20T01:24:56.389 INFO:teuthology.orchestra.run.smithi081.stdout:(104/150): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-08-20T01:24:56.390 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libradosstriper1-2:19.0.0-5872.gef427541.el9.x86 13/152 2024-08-20T01:24:56.412 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-20T01:24:56.423 INFO:teuthology.orchestra.run.smithi081.stdout:(105/150): gperftools-libs-2.9.1-2.el9.x86_64.r 9.3 MB/s | 309 kB 00:00 2024-08-20T01:24:56.440 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-20T01:24:56.448 INFO:teuthology.orchestra.run.smithi081.stdout:(106/150): grpc-data-1.46.7-10.el9.noarch.rpm 778 kB/s | 19 kB 00:00 2024-08-20T01:24:56.557 INFO:teuthology.orchestra.run.smithi081.stdout:(107/150): libarrow-9.0.0-11.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-08-20T01:24:56.582 INFO:teuthology.orchestra.run.smithi081.stdout:(108/150): protobuf-compiler-3.14.0-13.el9.x86_ 2.5 MB/s | 863 kB 00:00 2024-08-20T01:24:56.616 INFO:teuthology.orchestra.run.smithi081.stdout:(109/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 441 kB/s | 26 kB 00:00 2024-08-20T01:24:56.650 INFO:teuthology.orchestra.run.smithi081.stdout:(110/150): libunwind-1.6.2-1.el9.x86_64.rpm 2.5 MB/s | 67 kB 00:00 2024-08-20T01:24:56.664 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-20T01:24:56.675 INFO:teuthology.orchestra.run.smithi081.stdout:(111/150): luarocks-3.9.2-5.el9.noarch.rpm 6.4 MB/s | 151 kB 00:00 2024-08-20T01:24:56.695 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-20T01:24:56.700 INFO:teuthology.orchestra.run.smithi081.stdout:(112/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 60 kB/s | 45 kB 00:00 2024-08-20T01:24:56.726 INFO:teuthology.orchestra.run.smithi081.stdout:(113/150): liboath-2.6.7-2.el9.x86_64.rpm 340 kB/s | 49 kB 00:00 2024-08-20T01:24:56.759 INFO:teuthology.orchestra.run.smithi081.stdout:(114/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-08-20T01:24:56.784 INFO:teuthology.orchestra.run.smithi081.stdout:(115/150): python3-cachetools-4.2.4-1.el9.noarc 1.4 MB/s | 32 kB 00:00 2024-08-20T01:24:56.806 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : re2-1:20211101-3.el9.x86_64 16/152 2024-08-20T01:24:56.818 INFO:teuthology.orchestra.run.smithi081.stdout:(116/150): python3-certifi-2023.05.07-4.el9.noa 422 kB/s | 14 kB 00:00 2024-08-20T01:24:56.834 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-20T01:24:56.852 INFO:teuthology.orchestra.run.smithi081.stdout:(117/150): python3-cheroot-8.6.0-4.el9.noarch.r 5.1 MB/s | 172 kB 00:00 2024-08-20T01:24:56.870 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/152 2024-08-20T01:24:56.885 INFO:teuthology.orchestra.run.smithi081.stdout:(118/150): python3-asyncssh-2.13.2-5.el9.noarch 2.9 MB/s | 548 kB 00:00 2024-08-20T01:24:56.911 INFO:teuthology.orchestra.run.smithi081.stdout:(119/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.5 MB/s | 839 kB 00:00 2024-08-20T01:24:56.943 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/152 2024-08-20T01:24:56.944 INFO:teuthology.orchestra.run.smithi081.stdout:(120/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-08-20T01:24:56.970 INFO:teuthology.orchestra.run.smithi081.stdout:(121/150): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2024-08-20T01:24:56.995 INFO:teuthology.orchestra.run.smithi081.stdout:(122/150): python3-google-auth-2.33.0-1.el9.noa 2.6 MB/s | 220 kB 00:00 2024-08-20T01:24:56.996 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/152 2024-08-20T01:24:57.020 INFO:teuthology.orchestra.run.smithi081.stdout:(123/150): python3-jaraco-8.2.1-3.el9.noarch.rp 427 kB/s | 11 kB 00:00 2024-08-20T01:24:57.037 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/152 2024-08-20T01:24:57.045 INFO:teuthology.orchestra.run.smithi081.stdout:(124/150): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-08-20T01:24:57.071 INFO:teuthology.orchestra.run.smithi081.stdout:(125/150): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-08-20T01:24:57.079 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-08-20T01:24:57.096 INFO:teuthology.orchestra.run.smithi081.stdout:(126/150): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-08-20T01:24:57.112 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-08-20T01:24:57.121 INFO:teuthology.orchestra.run.smithi081.stdout:(127/150): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-08-20T01:24:57.138 INFO:teuthology.orchestra.run.smithi081.stdout:(128/150): python3-jaraco-text-3.2.0-6.el9.noar 472 kB/s | 20 kB 00:00 2024-08-20T01:24:57.139 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-08-20T01:24:57.163 INFO:teuthology.orchestra.run.smithi081.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-20T01:24:57.189 INFO:teuthology.orchestra.run.smithi081.stdout:(130/150): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-20T01:24:57.202 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-08-20T01:24:57.214 INFO:teuthology.orchestra.run.smithi081.stdout:(131/150): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-20T01:24:57.248 INFO:teuthology.orchestra.run.smithi081.stdout:(132/150): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-08-20T01:24:57.254 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/152 2024-08-20T01:24:57.273 INFO:teuthology.orchestra.run.smithi081.stdout:(133/150): python3-portend-3.1.0-2.el9.noarch.r 658 kB/s | 16 kB 00:00 2024-08-20T01:24:57.284 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-08-20T01:24:57.307 INFO:teuthology.orchestra.run.smithi081.stdout:(134/150): python3-kubernetes-26.1.0-2.el9.noar 5.5 MB/s | 1.0 MB 00:00 2024-08-20T01:24:57.328 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/152 2024-08-20T01:24:57.332 INFO:teuthology.orchestra.run.smithi081.stdout:(135/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-08-20T01:24:57.349 INFO:teuthology.orchestra.run.smithi081.stdout:(136/150): python3-pyperclip-1.8.2-2.el9.noarch 680 kB/s | 28 kB 00:00 2024-08-20T01:24:57.366 INFO:teuthology.orchestra.run.smithi081.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 1.8 MB/s | 31 kB 00:00 2024-08-20T01:24:57.393 INFO:teuthology.orchestra.run.smithi081.stdout:(138/150): python3-rsa-4.9-2.el9.noarch.rpm 2.1 MB/s | 59 kB 00:00 2024-08-20T01:24:57.413 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/152 2024-08-20T01:24:57.435 INFO:teuthology.orchestra.run.smithi081.stdout:(139/150): python3-routes-2.5.1-5.el9.noarch.rp 2.1 MB/s | 188 kB 00:00 2024-08-20T01:24:57.446 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ceph-common-2:19.0.0-5872.gef427541.el9. 30/152 2024-08-20T01:24:57.461 INFO:teuthology.orchestra.run.smithi081.stdout:(140/150): python3-tempora-5.0.0-2.el9.noarch.r 534 kB/s | 36 kB 00:00 2024-08-20T01:24:57.492 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ceph-argparse-2:19.0.0-5872.gef427541.el 31/152 2024-08-20T01:24:57.519 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cephfs-2:19.0.0-5872.gef427541.el9.x86_6 32/152 2024-08-20T01:24:57.590 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-08-20T01:24:57.663 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/152 2024-08-20T01:24:57.728 INFO:teuthology.orchestra.run.smithi081.stdout:(141/150): python3-typing-extensions-4.12.2-2.e 254 kB/s | 74 kB 00:00 2024-08-20T01:24:57.742 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-08-20T01:24:57.770 INFO:teuthology.orchestra.run.smithi081.stdout:(142/150): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2024-08-20T01:24:57.795 INFO:teuthology.orchestra.run.smithi081.stdout:(143/150): python3-webob-1.8.7-6.el9.noarch.rpm 687 kB/s | 230 kB 00:00 2024-08-20T01:24:57.837 INFO:teuthology.orchestra.run.smithi081.stdout:(144/150): python3-grpcio-1.46.7-10.el9.x86_64. 2.3 MB/s | 2.0 MB 00:00 2024-08-20T01:24:57.862 INFO:teuthology.orchestra.run.smithi081.stdout:(145/150): python3-zc-lockfile-2.0-10.el9.noarc 298 kB/s | 20 kB 00:00 2024-08-20T01:24:57.876 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-08-20T01:24:57.888 INFO:teuthology.orchestra.run.smithi081.stdout:(146/150): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-08-20T01:24:57.921 INFO:teuthology.orchestra.run.smithi081.stdout:(147/150): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-08-20T01:24:57.928 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-08-20T01:24:57.963 INFO:teuthology.orchestra.run.smithi081.stdout:(148/150): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-08-20T01:24:58.230 INFO:teuthology.orchestra.run.smithi081.stdout:(149/150): librados2-19.0.0-5872.gef427541.el9. 10 MB/s | 3.5 MB 00:00 2024-08-20T01:24:58.438 INFO:teuthology.orchestra.run.smithi081.stdout:(150/150): librbd1-19.0.0-5872.gef427541.el9.x8 6.3 MB/s | 3.2 MB 00:00 2024-08-20T01:24:58.445 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-08-20T01:24:58.445 INFO:teuthology.orchestra.run.smithi081.stdout:Total 7.9 MB/s | 232 MB 00:29 2024-08-20T01:24:58.462 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-08-20T01:24:58.541 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-08-20T01:24:58.569 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/152 2024-08-20T01:24:58.612 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-08-20T01:24:58.650 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librados-devel-2:19.0.0-5872.gef427541.el9.x86_6 42/152 2024-08-20T01:24:58.683 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-08-20T01:24:58.777 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-08-20T01:24:58.840 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 45/152 2024-08-20T01:24:58.914 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-20T01:24:58.952 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/152 2024-08-20T01:24:58.988 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-20T01:24:59.035 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-20T01:24:59.070 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-20T01:24:59.114 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-20T01:24:59.156 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-20T01:24:59.293 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-20T01:24:59.341 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-20T01:24:59.382 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-20T01:24:59.487 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-20T01:24:59.505 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-08-20T01:24:59.524 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 57/152 2024-08-20T01:24:59.564 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-20T01:24:59.589 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-20T01:24:59.614 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-20T01:24:59.632 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-08-20T01:24:59.632 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-08-20T01:24:59.689 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-20T01:24:59.815 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-20T01:24:59.854 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-20T01:24:59.883 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-20T01:24:59.917 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-20T01:24:59.920 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-08-20T01:24:59.961 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-20T01:24:59.999 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-20T01:25:00.000 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-20T01:25:00.025 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-20T01:25:00.038 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-20T01:25:00.068 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-20T01:25:00.075 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-20T01:25:00.094 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-20T01:25:00.127 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-20T01:25:00.169 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-20T01:25:00.203 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-20T01:25:00.291 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-20T01:25:00.333 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-20T01:25:00.365 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-20T01:25:00.412 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-20T01:25:00.472 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-20T01:25:00.527 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-20T01:25:00.542 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : librados2-2:19.0.0-5872.gef427541.el9.x86_64 5/152 2024-08-20T01:25:00.665 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librados2-2:19.0.0-5872.gef427541.el9.x86_64 5/152 2024-08-20T01:25:00.693 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcephfs2-2:19.0.0-5872.gef427541.el9.x86_64 6/152 2024-08-20T01:25:00.789 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libcephfs2-2:19.0.0-5872.gef427541.el9.x86_64 6/152 2024-08-20T01:25:00.827 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rados-2:19.0.0-5872.gef427541.el9.x86_64 7/152 2024-08-20T01:25:00.864 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-20T01:25:00.890 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-20T01:25:01.042 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 10/152 2024-08-20T01:25:01.095 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : postgresql-13.16-1.el9.x86_64 11/152 2024-08-20T01:25:01.124 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcephsqlite-2:19.0.0-5872.gef427541.el9.x86_64 12/152 2024-08-20T01:25:01.228 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libcephsqlite-2:19.0.0-5872.gef427541.el9.x86_64 12/152 2024-08-20T01:25:01.258 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libradosstriper1-2:19.0.0-5872.gef427541.el9.x86 13/152 2024-08-20T01:25:01.278 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-20T01:25:01.313 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libradosstriper1-2:19.0.0-5872.gef427541.el9.x86 13/152 2024-08-20T01:25:01.332 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-20T01:25:01.342 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-20T01:25:01.363 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-20T01:25:01.365 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-20T01:25:01.430 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-08-20T01:25:01.430 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-08-20T01:25:01.468 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-20T01:25:01.521 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-devel-3.9.19-7.el9.x86_64 83/152 2024-08-20T01:25:01.566 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-20T01:25:01.657 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-20T01:25:01.671 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-20T01:25:01.692 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-20T01:25:01.710 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-20T01:25:01.799 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : re2-1:20211101-3.el9.x86_64 16/152 2024-08-20T01:25:01.823 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-20T01:25:01.858 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/152 2024-08-20T01:25:01.894 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openblas-0.3.26-1.el9.x86_64 87/152 2024-08-20T01:25:01.924 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openblas-openmp-0.3.26-1.el9.x86_64 88/152 2024-08-20T01:25:01.932 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/152 2024-08-20T01:25:01.993 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/152 2024-08-20T01:25:02.001 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-20T01:25:02.034 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/152 2024-08-20T01:25:02.077 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-08-20T01:25:02.109 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-08-20T01:25:02.137 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-08-20T01:25:02.207 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-08-20T01:25:02.260 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/152 2024-08-20T01:25:02.298 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-08-20T01:25:02.334 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/152 2024-08-20T01:25:02.411 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/152 2024-08-20T01:25:02.445 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-ceph-common-2:19.0.0-5872.gef427541.el9. 30/152 2024-08-20T01:25:02.490 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-ceph-argparse-2:19.0.0-5872.gef427541.el 31/152 2024-08-20T01:25:02.517 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cephfs-2:19.0.0-5872.gef427541.el9.x86_6 32/152 2024-08-20T01:25:02.591 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-08-20T01:25:02.632 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/152 2024-08-20T01:25:02.657 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-20T01:25:02.707 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-08-20T01:25:02.850 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-20T01:25:02.851 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-08-20T01:25:02.909 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-08-20T01:25:03.443 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-08-20T01:25:03.540 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-08-20T01:25:03.576 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/152 2024-08-20T01:25:03.627 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-08-20T01:25:03.666 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librados-devel-2:19.0.0-5872.gef427541.el9.x86_6 42/152 2024-08-20T01:25:03.698 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-08-20T01:25:03.792 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-08-20T01:25:03.856 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 45/152 2024-08-20T01:25:03.929 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-20T01:25:03.959 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/152 2024-08-20T01:25:03.995 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-20T01:25:04.050 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-20T01:25:04.086 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-20T01:25:04.093 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-20T01:25:04.129 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-20T01:25:04.171 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-20T01:25:04.171 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-20T01:25:04.198 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-20T01:25:04.232 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-08-20T01:25:04.312 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-20T01:25:04.348 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-20T01:25:04.390 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-20T01:25:04.494 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-20T01:25:04.532 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 57/152 2024-08-20T01:25:04.551 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-20T01:25:04.572 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-20T01:25:04.597 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-20T01:25:04.603 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : librbd1-2:19.0.0-5872.gef427541.el9.x86_64 97/152 2024-08-20T01:25:04.622 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-20T01:25:04.697 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-20T01:25:04.699 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librbd1-2:19.0.0-5872.gef427541.el9.x86_64 97/152 2024-08-20T01:25:04.725 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rbd-2:19.0.0-5872.gef427541.el9.x86_64 98/152 2024-08-20T01:25:04.761 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-20T01:25:04.825 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-20T01:25:04.863 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-20T01:25:04.891 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-20T01:25:04.925 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-20T01:25:04.969 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-20T01:25:05.007 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-20T01:25:05.047 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-20T01:25:05.206 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-20T01:25:05.251 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-20T01:25:05.281 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librgw2-2:19.0.0-5872.gef427541.el9.x86_64 101/152 2024-08-20T01:25:05.353 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librgw2-2:19.0.0-5872.gef427541.el9.x86_64 101/152 2024-08-20T01:25:05.374 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-20T01:25:05.383 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rgw-2:19.0.0-5872.gef427541.el9.x86_64 102/152 2024-08-20T01:25:05.411 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-20T01:25:05.474 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-20T01:25:05.512 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-20T01:25:05.602 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-20T01:25:05.651 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-20T01:25:05.682 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-20T01:25:05.794 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-20T01:25:05.858 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-20T01:25:06.587 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-20T01:25:06.639 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-20T01:25:06.672 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-20T01:25:06.773 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-20T01:25:06.836 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-devel-3.9.19-7.el9.x86_64 83/152 2024-08-20T01:25:06.881 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-20T01:25:06.968 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-20T01:25:07.000 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-20T01:25:07.182 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : openblas-0.3.26-1.el9.x86_64 87/152 2024-08-20T01:25:07.205 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : openblas-openmp-0.3.26-1.el9.x86_64 88/152 2024-08-20T01:25:07.291 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-20T01:25:07.384 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-08-20T01:25:07.457 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-20T01:25:07.483 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-20T01:25:07.525 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-20T01:25:07.691 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 103/152 2024-08-20T01:25:07.729 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 103/152 2024-08-20T01:25:07.861 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-20T01:25:07.956 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-20T01:25:07.992 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librados2-2:19.0.0-5872.gef427541.el9.x86_64 5/152 2024-08-20T01:25:08.072 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-20T01:25:08.113 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:19.0.0-5872.gef427541.el9.x86_64 5/152 2024-08-20T01:25:08.135 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs2-2:19.0.0-5872.gef427541.el9.x86_64 6/152 2024-08-20T01:25:08.213 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephfs2-2:19.0.0-5872.gef427541.el9.x86_64 6/152 2024-08-20T01:25:08.252 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rados-2:19.0.0-5872.gef427541.el9.x86_64 7/152 2024-08-20T01:25:08.281 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 103/152 2024-08-20T01:25:08.289 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-20T01:25:08.315 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-20T01:25:08.325 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-base-2:19.0.0-5872.gef427541.el9.x86_64 104/152 2024-08-20T01:25:08.409 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-base-2:19.0.0-5872.gef427541.el9.x86_64 104/152 2024-08-20T01:25:08.410 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-20T01:25:08.410 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-20T01:25:08.410 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-08-20T01:25:08.442 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-selinux-2:19.0.0-5872.gef427541.el9.x86_64 105/152 2024-08-20T01:25:08.472 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 10/152 2024-08-20T01:25:08.521 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-13.16-1.el9.x86_64 11/152 2024-08-20T01:25:08.549 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephsqlite-2:19.0.0-5872.gef427541.el9.x86_64 12/152 2024-08-20T01:25:08.645 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephsqlite-2:19.0.0-5872.gef427541.el9.x86_64 12/152 2024-08-20T01:25:08.674 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libradosstriper1-2:19.0.0-5872.gef427541.el9.x86 13/152 2024-08-20T01:25:08.737 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libradosstriper1-2:19.0.0-5872.gef427541.el9.x86 13/152 2024-08-20T01:25:08.759 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-20T01:25:08.785 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-20T01:25:09.079 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-20T01:25:09.117 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-20T01:25:09.226 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : re2-1:20211101-3.el9.x86_64 16/152 2024-08-20T01:25:09.257 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-20T01:25:09.292 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/152 2024-08-20T01:25:09.321 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-20T01:25:09.365 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/152 2024-08-20T01:25:09.402 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-20T01:25:09.418 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/152 2024-08-20T01:25:09.429 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-20T01:25:09.450 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/152 2024-08-20T01:25:09.463 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-08-20T01:25:09.493 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-08-20T01:25:09.526 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-08-20T01:25:09.554 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-08-20T01:25:09.624 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-08-20T01:25:09.677 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/152 2024-08-20T01:25:09.715 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-08-20T01:25:09.759 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/152 2024-08-20T01:25:09.780 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-20T01:25:09.834 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : librbd1-2:19.0.0-5872.gef427541.el9.x86_64 97/152 2024-08-20T01:25:09.836 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/152 2024-08-20T01:25:09.870 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-common-2:19.0.0-5872.gef427541.el9. 30/152 2024-08-20T01:25:09.915 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-argparse-2:19.0.0-5872.gef427541.el 31/152 2024-08-20T01:25:09.928 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librbd1-2:19.0.0-5872.gef427541.el9.x86_64 97/152 2024-08-20T01:25:09.942 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cephfs-2:19.0.0-5872.gef427541.el9.x86_6 32/152 2024-08-20T01:25:09.955 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rbd-2:19.0.0-5872.gef427541.el9.x86_64 98/152 2024-08-20T01:25:09.992 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-20T01:25:10.013 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-08-20T01:25:10.057 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/152 2024-08-20T01:25:10.132 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-08-20T01:25:10.266 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-08-20T01:25:10.336 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-08-20T01:25:10.480 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-20T01:25:10.512 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librgw2-2:19.0.0-5872.gef427541.el9.x86_64 101/152 2024-08-20T01:25:10.567 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librgw2-2:19.0.0-5872.gef427541.el9.x86_64 101/152 2024-08-20T01:25:10.597 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rgw-2:19.0.0-5872.gef427541.el9.x86_64 102/152 2024-08-20T01:25:10.866 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-08-20T01:25:10.948 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-08-20T01:25:10.985 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/152 2024-08-20T01:25:11.028 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-08-20T01:25:11.066 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librados-devel-2:19.0.0-5872.gef427541.el9.x86_6 42/152 2024-08-20T01:25:11.099 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-08-20T01:25:11.191 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-08-20T01:25:11.255 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 45/152 2024-08-20T01:25:11.336 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-20T01:25:11.368 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/152 2024-08-20T01:25:11.404 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-20T01:25:11.451 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-20T01:25:11.487 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-20T01:25:11.530 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-20T01:25:11.572 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-20T01:25:11.710 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-20T01:25:11.757 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-20T01:25:11.798 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-20T01:25:11.901 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-20T01:25:11.932 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 57/152 2024-08-20T01:25:11.972 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-20T01:25:12.015 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-20T01:25:12.039 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-20T01:25:12.114 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-20T01:25:12.257 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-20T01:25:12.296 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-20T01:25:12.324 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-20T01:25:12.359 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-20T01:25:12.403 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-20T01:25:12.440 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-20T01:25:12.472 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-20T01:25:12.502 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-20T01:25:12.536 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-20T01:25:12.570 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-20T01:25:12.611 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-20T01:25:12.646 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-20T01:25:12.734 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-20T01:25:12.785 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-20T01:25:12.819 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-20T01:25:12.922 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 103/152 2024-08-20T01:25:12.952 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 103/152 2024-08-20T01:25:13.065 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-20T01:25:13.142 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-20T01:25:13.501 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 103/152 2024-08-20T01:25:13.547 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-base-2:19.0.0-5872.gef427541.el9.x86_64 104/152 2024-08-20T01:25:13.635 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-base-2:19.0.0-5872.gef427541.el9.x86_64 104/152 2024-08-20T01:25:13.636 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-20T01:25:13.636 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-20T01:25:13.636 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:25:13.665 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-selinux-2:19.0.0-5872.gef427541.el9.x86_64 105/152 2024-08-20T01:25:13.876 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-20T01:25:13.922 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-20T01:25:13.956 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-20T01:25:14.057 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-20T01:25:14.120 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-devel-3.9.19-7.el9.x86_64 83/152 2024-08-20T01:25:14.165 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-20T01:25:14.253 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-20T01:25:14.284 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-20T01:25:14.469 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-0.3.26-1.el9.x86_64 87/152 2024-08-20T01:25:14.498 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-openmp-0.3.26-1.el9.x86_64 88/152 2024-08-20T01:25:14.575 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-20T01:25:15.219 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-20T01:25:15.339 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-20T01:25:16.575 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-20T01:25:16.661 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-20T01:25:16.689 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-20T01:25:16.722 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-08-20T01:25:17.041 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-20T01:25:17.225 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librbd1-2:19.0.0-5872.gef427541.el9.x86_64 97/152 2024-08-20T01:25:17.225 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:19.0.0-5872.gef427541.el9.x86_64 97/152 2024-08-20T01:25:17.225 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rbd-2:19.0.0-5872.gef427541.el9.x86_64 98/152 2024-08-20T01:25:17.242 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-20T01:25:17.736 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-20T01:25:17.763 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librgw2-2:19.0.0-5872.gef427541.el9.x86_64 101/152 2024-08-20T01:25:17.835 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librgw2-2:19.0.0-5872.gef427541.el9.x86_64 101/152 2024-08-20T01:25:17.856 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rgw-2:19.0.0-5872.gef427541.el9.x86_64 102/152 2024-08-20T01:25:19.883 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-selinux-2:19.0.0-5872.gef427541.el9.x86_64 105/152 2024-08-20T01:25:19.884 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /sys 2024-08-20T01:25:19.884 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /proc 2024-08-20T01:25:19.884 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /mnt 2024-08-20T01:25:19.884 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /var/tmp 2024-08-20T01:25:19.884 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /home 2024-08-20T01:25:19.884 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /root 2024-08-20T01:25:19.884 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /tmp 2024-08-20T01:25:19.884 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-08-20T01:25:20.055 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-volume-2:19.0.0-5872.gef427541.el9.noarch 106/152 2024-08-20T01:25:20.072 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-volume-2:19.0.0-5872.gef427541.el9.noarch 106/152 2024-08-20T01:25:20.072 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:25:20.072 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-20T01:25:20.072 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-08-20T01:25:20.196 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 103/152 2024-08-20T01:25:20.236 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 103/152 2024-08-20T01:25:20.790 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 103/152 2024-08-20T01:25:20.831 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-base-2:19.0.0-5872.gef427541.el9.x86_64 104/152 2024-08-20T01:25:20.930 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-base-2:19.0.0-5872.gef427541.el9.x86_64 104/152 2024-08-20T01:25:20.930 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-20T01:25:20.930 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-20T01:25:20.930 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-08-20T01:25:20.982 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-selinux-2:19.0.0-5872.gef427541.el9.x86_64 105/152 2024-08-20T01:25:21.558 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-osd-2:19.0.0-5872.gef427541.el9.x86_64 107/152 2024-08-20T01:25:21.585 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-osd-2:19.0.0-5872.gef427541.el9.x86_64 107/152 2024-08-20T01:25:21.586 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:25:21.586 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-20T01:25:21.586 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-20T01:25:21.586 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-20T01:25:21.586 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-08-20T01:25:21.817 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mds-2:19.0.0-5872.gef427541.el9.x86_64 108/152 2024-08-20T01:25:21.841 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mds-2:19.0.0-5872.gef427541.el9.x86_64 108/152 2024-08-20T01:25:21.841 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:25:21.841 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-20T01:25:21.841 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-20T01:25:21.841 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-20T01:25:21.841 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-08-20T01:25:22.285 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mon-2:19.0.0-5872.gef427541.el9.x86_64 109/152 2024-08-20T01:25:22.309 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mon-2:19.0.0-5872.gef427541.el9.x86_64 109/152 2024-08-20T01:25:22.309 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:25:22.309 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-20T01:25:22.309 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-20T01:25:22.309 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-20T01:25:22.309 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-08-20T01:25:22.415 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-20T01:25:22.472 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-20T01:25:22.527 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-20T01:25:22.712 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-20T01:25:22.760 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-20T01:25:22.838 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-20T01:25:22.926 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-20T01:25:23.058 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-20T01:25:23.111 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-20T01:25:23.143 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-20T01:25:23.171 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-20T01:25:23.635 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: cephadm-2:19.0.0-5872.gef427541.el9.noarch 121/152 2024-08-20T01:25:23.663 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephadm-2:19.0.0-5872.gef427541.el9.noarch 121/152 2024-08-20T01:25:23.695 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-5872.gef427541.e 122/152 2024-08-20T01:25:23.761 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-5872.gef427541. 123/152 2024-08-20T01:25:23.794 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-5872.gef427541.el9.noa 124/152 2024-08-20T01:25:25.524 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-selinux-2:19.0.0-5872.gef427541.el9.x86_64 105/152 2024-08-20T01:25:25.524 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /sys 2024-08-20T01:25:25.524 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /proc 2024-08-20T01:25:25.524 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /mnt 2024-08-20T01:25:25.524 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /var/tmp 2024-08-20T01:25:25.524 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /home 2024-08-20T01:25:25.524 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /root 2024-08-20T01:25:25.524 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /tmp 2024-08-20T01:25:25.525 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:25:25.709 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-volume-2:19.0.0-5872.gef427541.el9.noarch 106/152 2024-08-20T01:25:25.728 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-volume-2:19.0.0-5872.gef427541.el9.noarch 106/152 2024-08-20T01:25:25.728 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:25:25.728 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-20T01:25:25.728 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:25:26.958 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-5872.gef427541.el9.noa 124/152 2024-08-20T01:25:27.018 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-5872.gef427541.el9.n 125/152 2024-08-20T01:25:27.221 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-osd-2:19.0.0-5872.gef427541.el9.x86_64 107/152 2024-08-20T01:25:27.247 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-osd-2:19.0.0-5872.gef427541.el9.x86_64 107/152 2024-08-20T01:25:27.248 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:25:27.248 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-20T01:25:27.248 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-20T01:25:27.248 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-20T01:25:27.248 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:25:27.472 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mds-2:19.0.0-5872.gef427541.el9.x86_64 108/152 2024-08-20T01:25:27.495 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mds-2:19.0.0-5872.gef427541.el9.x86_64 108/152 2024-08-20T01:25:27.495 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:25:27.495 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-20T01:25:27.496 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-20T01:25:27.496 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-20T01:25:27.496 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:25:27.939 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mon-2:19.0.0-5872.gef427541.el9.x86_64 109/152 2024-08-20T01:25:27.963 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mon-2:19.0.0-5872.gef427541.el9.x86_64 109/152 2024-08-20T01:25:27.963 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:25:27.963 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-20T01:25:27.963 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-20T01:25:27.963 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-20T01:25:27.963 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:25:27.980 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-5872.gef427541.el9.n 125/152 2024-08-20T01:25:28.010 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-5872.gef4 126/152 2024-08-20T01:25:28.068 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-20T01:25:28.121 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-5872.gef4 126/152 2024-08-20T01:25:28.125 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-20T01:25:28.180 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-20T01:25:28.297 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-5872.gef427541.el 127/152 2024-08-20T01:25:28.329 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-2:19.0.0-5872.gef427541.el9.x86_64 128/152 2024-08-20T01:25:28.354 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-2:19.0.0-5872.gef427541.el9.x86_64 128/152 2024-08-20T01:25:28.354 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:25:28.354 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-20T01:25:28.354 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-20T01:25:28.354 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-20T01:25:28.354 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-08-20T01:25:28.363 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-20T01:25:28.405 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-rook-2:19.0.0-5872.gef427541.el9.noarch 129/152 2024-08-20T01:25:28.417 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-5872.gef427541.el9.noarch 129/152 2024-08-20T01:25:28.422 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-20T01:25:28.499 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-20T01:25:28.515 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-2:19.0.0-5872.gef427541.el9.x86_64 130/152 2024-08-20T01:25:28.561 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-fuse-2:19.0.0-5872.gef427541.el9.x86_64 131/152 2024-08-20T01:25:28.597 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-20T01:25:28.734 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-20T01:25:28.773 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-20T01:25:28.805 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-20T01:25:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-20T01:25:29.239 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: cephadm-2:19.0.0-5872.gef427541.el9.noarch 121/152 2024-08-20T01:25:29.266 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephadm-2:19.0.0-5872.gef427541.el9.noarch 121/152 2024-08-20T01:25:29.298 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-5872.gef427541.e 122/152 2024-08-20T01:25:29.363 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-5872.gef427541. 123/152 2024-08-20T01:25:29.398 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-5872.gef427541.el9.noa 124/152 2024-08-20T01:25:29.517 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-20T01:25:29.549 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-radosgw-2:19.0.0-5872.gef427541.el9.x86_64 133/152 2024-08-20T01:25:29.573 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-5872.gef427541.el9.x86_64 133/152 2024-08-20T01:25:29.574 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:25:29.574 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-20T01:25:29.574 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-20T01:25:29.574 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-20T01:25:29.574 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-08-20T01:25:29.616 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-5872.gef427 134/152 2024-08-20T01:25:29.640 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-5872.gef427 134/152 2024-08-20T01:25:29.640 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:25:29.640 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-20T01:25:29.640 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-08-20T01:25:29.692 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-mirror-2:19.0.0-5872.gef427541.el9.x86_64 135/152 2024-08-20T01:25:29.716 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-5872.gef427541.el9.x86_64 135/152 2024-08-20T01:25:29.716 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:25:29.716 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-20T01:25:29.716 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-20T01:25:29.716 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-20T01:25:29.716 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-08-20T01:25:30.090 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-mirror-2:19.0.0-5872.gef427541.el9.x86_64 136/152 2024-08-20T01:25:30.114 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: rbd-mirror-2:19.0.0-5872.gef427541.el9.x86_64 136/152 2024-08-20T01:25:30.114 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:25:30.115 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-20T01:25:30.115 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-20T01:25:30.115 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-20T01:25:30.115 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-08-20T01:25:32.393 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-selinux-2:19.0.0-5872.gef427541.el9.x86_64 105/152 2024-08-20T01:25:32.393 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /sys 2024-08-20T01:25:32.393 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /proc 2024-08-20T01:25:32.393 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /mnt 2024-08-20T01:25:32.393 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /var/tmp 2024-08-20T01:25:32.393 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /home 2024-08-20T01:25:32.394 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /root 2024-08-20T01:25:32.394 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /tmp 2024-08-20T01:25:32.394 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-08-20T01:25:32.538 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-5872.gef427541.el9.noa 124/152 2024-08-20T01:25:32.571 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-volume-2:19.0.0-5872.gef427541.el9.noarch 106/152 2024-08-20T01:25:32.587 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-volume-2:19.0.0-5872.gef427541.el9.noarch 106/152 2024-08-20T01:25:32.587 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:25:32.587 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-20T01:25:32.587 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-08-20T01:25:32.597 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-5872.gef427541.el9.n 125/152 2024-08-20T01:25:33.561 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-5872.gef427541.el9.n 125/152 2024-08-20T01:25:33.590 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-5872.gef4 126/152 2024-08-20T01:25:33.701 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-5872.gef4 126/152 2024-08-20T01:25:33.869 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-5872.gef427541.el 127/152 2024-08-20T01:25:33.901 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-2:19.0.0-5872.gef427541.el9.x86_64 128/152 2024-08-20T01:25:33.925 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-2:19.0.0-5872.gef427541.el9.x86_64 128/152 2024-08-20T01:25:33.925 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:25:33.925 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-20T01:25:33.926 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-20T01:25:33.926 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-20T01:25:33.926 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:25:33.977 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-rook-2:19.0.0-5872.gef427541.el9.noarch 129/152 2024-08-20T01:25:33.989 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-5872.gef427541.el9.noarch 129/152 2024-08-20T01:25:34.082 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-osd-2:19.0.0-5872.gef427541.el9.x86_64 107/152 2024-08-20T01:25:34.088 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-2:19.0.0-5872.gef427541.el9.x86_64 130/152 2024-08-20T01:25:34.108 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-osd-2:19.0.0-5872.gef427541.el9.x86_64 107/152 2024-08-20T01:25:34.108 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:25:34.109 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-20T01:25:34.109 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-20T01:25:34.109 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-20T01:25:34.109 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-08-20T01:25:34.133 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-fuse-2:19.0.0-5872.gef427541.el9.x86_64 131/152 2024-08-20T01:25:34.333 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mds-2:19.0.0-5872.gef427541.el9.x86_64 108/152 2024-08-20T01:25:34.356 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mds-2:19.0.0-5872.gef427541.el9.x86_64 108/152 2024-08-20T01:25:34.357 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:25:34.357 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-20T01:25:34.357 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-20T01:25:34.357 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-20T01:25:34.357 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-08-20T01:25:34.805 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-test-2:19.0.0-5872.gef427541.el9.x86_64 137/152 2024-08-20T01:25:34.809 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mon-2:19.0.0-5872.gef427541.el9.x86_64 109/152 2024-08-20T01:25:34.833 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mon-2:19.0.0-5872.gef427541.el9.x86_64 109/152 2024-08-20T01:25:34.834 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:25:34.834 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-20T01:25:34.834 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-20T01:25:34.834 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-20T01:25:34.834 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-08-20T01:25:34.846 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-fuse-2:19.0.0-5872.gef427541.el9.x86_64 138/152 2024-08-20T01:25:34.886 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-nbd-2:19.0.0-5872.gef427541.el9.x86_64 139/152 2024-08-20T01:25:34.919 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 140/152 2024-08-20T01:25:34.939 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-20T01:25:34.946 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-20T01:25:34.996 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-20T01:25:35.052 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-20T01:25:35.097 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-20T01:25:35.127 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-shell-2:19.0.0-5872.gef427541.el9.x86_64 142/152 2024-08-20T01:25:35.130 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-radosgw-2:19.0.0-5872.gef427541.el9.x86_64 133/152 2024-08-20T01:25:35.154 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-5872.gef427541.el9.x86_64 133/152 2024-08-20T01:25:35.154 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:25:35.154 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-20T01:25:35.154 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-20T01:25:35.154 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-20T01:25:35.155 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:25:35.167 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 143/152 2024-08-20T01:25:35.197 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-5872.gef427 134/152 2024-08-20T01:25:35.206 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephfs-devel-2:19.0.0-5872.gef427541.el9.x86_ 144/152 2024-08-20T01:25:35.221 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-5872.gef427 134/152 2024-08-20T01:25:35.221 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:25:35.221 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-20T01:25:35.221 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:25:35.245 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-20T01:25:35.273 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephfs-mirror-2:19.0.0-5872.gef427541.el9.x86_64 135/152 2024-08-20T01:25:35.297 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-5872.gef427541.el9.x86_64 135/152 2024-08-20T01:25:35.297 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:25:35.297 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-20T01:25:35.297 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-20T01:25:35.297 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-20T01:25:35.297 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:25:35.301 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-20T01:25:35.387 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-20T01:25:35.475 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-20T01:25:35.607 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : rbd-mirror-2:19.0.0-5872.gef427541.el9.x86_64 136/152 2024-08-20T01:25:35.615 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-20T01:25:35.631 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: rbd-mirror-2:19.0.0-5872.gef427541.el9.x86_64 136/152 2024-08-20T01:25:35.631 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:25:35.631 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-20T01:25:35.631 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-20T01:25:35.631 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-20T01:25:35.631 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:25:35.661 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-20T01:25:35.693 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-20T01:25:35.722 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-20T01:25:35.801 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-20T01:25:35.838 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-20T01:25:35.859 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-20T01:25:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephadm-2:19.0.0-5872.gef427541.el9.noarch 121/152 2024-08-20T01:25:36.221 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephadm-2:19.0.0-5872.gef427541.el9.noarch 121/152 2024-08-20T01:25:36.252 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-5872.gef427541.e 122/152 2024-08-20T01:25:36.317 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-5872.gef427541. 123/152 2024-08-20T01:25:36.352 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-5872.gef427541.el9.noa 124/152 2024-08-20T01:25:36.681 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-top-2:19.0.0-5872.gef427541.el9.noarch 146/152 2024-08-20T01:25:36.768 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 147/152 2024-08-20T01:25:36.809 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-20T01:25:36.890 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-20T01:25:36.931 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-20T01:25:36.931 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-20T01:25:37.006 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-20T01:25:37.006 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-20T01:25:39.512 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-5872.gef427541.el9.noa 124/152 2024-08-20T01:25:39.576 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-5872.gef427541.el9.n 125/152 2024-08-20T01:25:40.419 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-test-2:19.0.0-5872.gef427541.el9.x86_64 137/152 2024-08-20T01:25:40.461 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : rbd-fuse-2:19.0.0-5872.gef427541.el9.x86_64 138/152 2024-08-20T01:25:40.501 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : rbd-nbd-2:19.0.0-5872.gef427541.el9.x86_64 139/152 2024-08-20T01:25:40.534 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 140/152 2024-08-20T01:25:40.536 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-5872.gef427541.el9.n 125/152 2024-08-20T01:25:40.559 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-5872.gef4 126/152 2024-08-20T01:25:40.561 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-20T01:25:40.671 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-5872.gef4 126/152 2024-08-20T01:25:40.740 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephfs-shell-2:19.0.0-5872.gef427541.el9.x86_64 142/152 2024-08-20T01:25:40.792 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 143/152 2024-08-20T01:25:40.822 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcephfs-devel-2:19.0.0-5872.gef427541.el9.x86_ 144/152 2024-08-20T01:25:40.831 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-5872.gef427541.el 127/152 2024-08-20T01:25:40.862 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-2:19.0.0-5872.gef427541.el9.x86_64 128/152 2024-08-20T01:25:40.885 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-2:19.0.0-5872.gef427541.el9.x86_64 128/152 2024-08-20T01:25:40.885 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:25:40.885 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-20T01:25:40.885 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-20T01:25:40.886 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-20T01:25:40.886 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-08-20T01:25:40.929 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-rook-2:19.0.0-5872.gef427541.el9.noarch 129/152 2024-08-20T01:25:40.940 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-5872.gef427541.el9.noarch 129/152 2024-08-20T01:25:41.038 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-2:19.0.0-5872.gef427541.el9.x86_64 130/152 2024-08-20T01:25:41.093 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-fuse-2:19.0.0-5872.gef427541.el9.x86_64 131/152 2024-08-20T01:25:41.450 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-20T01:25:41.497 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-20T01:25:41.517 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-20T01:25:42.042 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-20T01:25:42.073 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-radosgw-2:19.0.0-5872.gef427541.el9.x86_64 133/152 2024-08-20T01:25:42.096 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-5872.gef427541.el9.x86_64 133/152 2024-08-20T01:25:42.096 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:25:42.096 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-20T01:25:42.096 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-20T01:25:42.097 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-20T01:25:42.097 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-08-20T01:25:42.140 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-5872.gef427 134/152 2024-08-20T01:25:42.163 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-5872.gef427 134/152 2024-08-20T01:25:42.163 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:25:42.163 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-20T01:25:42.163 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-08-20T01:25:42.216 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-mirror-2:19.0.0-5872.gef427541.el9.x86_64 135/152 2024-08-20T01:25:42.239 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-5872.gef427541.el9.x86_64 135/152 2024-08-20T01:25:42.239 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:25:42.239 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-20T01:25:42.239 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-20T01:25:42.240 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-20T01:25:42.240 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-08-20T01:25:42.348 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephfs-top-2:19.0.0-5872.gef427541.el9.noarch 146/152 2024-08-20T01:25:42.453 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 147/152 2024-08-20T01:25:42.494 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-20T01:25:42.550 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-mirror-2:19.0.0-5872.gef427541.el9.x86_64 136/152 2024-08-20T01:25:42.574 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: rbd-mirror-2:19.0.0-5872.gef427541.el9.x86_64 136/152 2024-08-20T01:25:42.574 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T01:25:42.574 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-20T01:25:42.574 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-20T01:25:42.574 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-20T01:25:42.574 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-08-20T01:25:42.575 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-20T01:25:42.608 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-20T01:25:42.608 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-20T01:25:42.692 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-20T01:25:42.692 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-20T01:25:43.570 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-20T01:25:43.570 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-2:19.0.0-5872.gef427541.el9.x86_64 1/152 2024-08-20T01:25:43.570 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-base-2:19.0.0-5872.gef427541.el9.x86_64 2/152 2024-08-20T01:25:43.570 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 3/152 2024-08-20T01:25:43.571 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-fuse-2:19.0.0-5872.gef427541.el9.x86_64 4/152 2024-08-20T01:25:43.571 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-5872.gef427 5/152 2024-08-20T01:25:43.571 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mds-2:19.0.0-5872.gef427541.el9.x86_64 6/152 2024-08-20T01:25:43.571 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-2:19.0.0-5872.gef427541.el9.x86_64 7/152 2024-08-20T01:25:43.571 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mon-2:19.0.0-5872.gef427541.el9.x86_64 8/152 2024-08-20T01:25:43.571 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-osd-2:19.0.0-5872.gef427541.el9.x86_64 9/152 2024-08-20T01:25:43.571 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-radosgw-2:19.0.0-5872.gef427541.el9.x86_64 10/152 2024-08-20T01:25:43.571 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-selinux-2:19.0.0-5872.gef427541.el9.x86_64 11/152 2024-08-20T01:25:43.571 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-test-2:19.0.0-5872.gef427541.el9.x86_64 12/152 2024-08-20T01:25:43.571 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-mirror-2:19.0.0-5872.gef427541.el9.x86_64 13/152 2024-08-20T01:25:43.571 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-shell-2:19.0.0-5872.gef427541.el9.x86_64 14/152 2024-08-20T01:25:43.571 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephfs-devel-2:19.0.0-5872.gef427541.el9.x86_ 15/152 2024-08-20T01:25:43.572 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephfs2-2:19.0.0-5872.gef427541.el9.x86_64 16/152 2024-08-20T01:25:43.572 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephsqlite-2:19.0.0-5872.gef427541.el9.x86_64 17/152 2024-08-20T01:25:43.572 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados-devel-2:19.0.0-5872.gef427541.el9.x86_6 18/152 2024-08-20T01:25:43.572 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libradosstriper1-2:19.0.0-5872.gef427541.el9.x86 19/152 2024-08-20T01:25:43.572 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librgw2-2:19.0.0-5872.gef427541.el9.x86_64 20/152 2024-08-20T01:25:43.572 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ceph-argparse-2:19.0.0-5872.gef427541.el 21/152 2024-08-20T01:25:43.572 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ceph-common-2:19.0.0-5872.gef427541.el9. 22/152 2024-08-20T01:25:43.572 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cephfs-2:19.0.0-5872.gef427541.el9.x86_6 23/152 2024-08-20T01:25:43.572 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rados-2:19.0.0-5872.gef427541.el9.x86_64 24/152 2024-08-20T01:25:43.572 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rbd-2:19.0.0-5872.gef427541.el9.x86_64 25/152 2024-08-20T01:25:43.584 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rgw-2:19.0.0-5872.gef427541.el9.x86_64 26/152 2024-08-20T01:25:43.584 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-fuse-2:19.0.0-5872.gef427541.el9.x86_64 27/152 2024-08-20T01:25:43.584 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-mirror-2:19.0.0-5872.gef427541.el9.x86_64 28/152 2024-08-20T01:25:43.584 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-nbd-2:19.0.0-5872.gef427541.el9.x86_64 29/152 2024-08-20T01:25:43.584 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-5872.gef427541. 30/152 2024-08-20T01:25:43.584 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-5872.gef427541.el9.noa 31/152 2024-08-20T01:25:43.584 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-5872.gef427541.el9.n 32/152 2024-08-20T01:25:43.584 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-5872.gef4 33/152 2024-08-20T01:25:43.584 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-5872.gef427541.el 34/152 2024-08-20T01:25:43.584 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-rook-2:19.0.0-5872.gef427541.el9.noarch 35/152 2024-08-20T01:25:43.584 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-5872.gef427541.e 36/152 2024-08-20T01:25:43.585 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-volume-2:19.0.0-5872.gef427541.el9.noarch 37/152 2024-08-20T01:25:43.585 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephadm-2:19.0.0-5872.gef427541.el9.noarch 38/152 2024-08-20T01:25:43.585 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-top-2:19.0.0-5872.gef427541.el9.noarch 39/152 2024-08-20T01:25:43.585 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-20T01:25:43.585 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/152 2024-08-20T01:25:43.585 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/152 2024-08-20T01:25:43.585 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-20T01:25:43.585 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-20T01:25:43.585 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-20T01:25:43.585 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-20T01:25:43.585 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-20T01:25:43.586 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-20T01:25:43.586 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-20T01:25:43.586 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-20T01:25:43.586 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-20T01:25:43.586 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-20T01:25:43.586 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-20T01:25:43.586 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-20T01:25:43.586 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-20T01:25:43.586 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-20T01:25:43.586 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-20T01:25:43.586 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-20T01:25:43.587 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-20T01:25:43.587 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-20T01:25:43.587 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-20T01:25:43.587 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-08-20T01:25:43.587 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-20T01:25:43.587 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-20T01:25:43.587 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-20T01:25:43.587 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openblas-0.3.26-1.el9.x86_64 66/152 2024-08-20T01:25:43.587 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openblas-openmp-0.3.26-1.el9.x86_64 67/152 2024-08-20T01:25:43.587 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 68/152 2024-08-20T01:25:43.587 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/152 2024-08-20T01:25:43.588 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/152 2024-08-20T01:25:43.588 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/152 2024-08-20T01:25:43.588 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/152 2024-08-20T01:25:43.588 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-20T01:25:43.588 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-20T01:25:43.588 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-20T01:25:43.588 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-20T01:25:43.588 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-devel-3.9.19-7.el9.x86_64 77/152 2024-08-20T01:25:43.588 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-20T01:25:43.588 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-20T01:25:43.588 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-20T01:25:43.588 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-20T01:25:43.589 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-20T01:25:43.589 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-20T01:25:43.589 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-20T01:25:43.589 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-20T01:25:43.589 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-20T01:25:43.589 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-20T01:25:43.589 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-20T01:25:43.589 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-20T01:25:43.589 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-20T01:25:43.589 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-20T01:25:43.589 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-20T01:25:43.589 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-20T01:25:43.590 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-20T01:25:43.590 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-20T01:25:43.590 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-20T01:25:43.590 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-20T01:25:43.590 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-20T01:25:43.590 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-20T01:25:43.590 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-20T01:25:43.590 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/152 2024-08-20T01:25:43.590 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-20T01:25:43.590 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-20T01:25:43.590 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-20T01:25:43.591 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-20T01:25:43.591 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-20T01:25:43.591 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-20T01:25:43.591 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-20T01:25:43.591 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-20T01:25:43.591 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-20T01:25:43.591 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-20T01:25:43.591 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-20T01:25:43.591 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-20T01:25:43.591 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-20T01:25:43.591 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-20T01:25:43.591 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-20T01:25:43.592 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-20T01:25:43.592 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-20T01:25:43.592 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-20T01:25:43.592 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-20T01:25:43.592 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-20T01:25:43.592 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 122/152 2024-08-20T01:25:43.592 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-20T01:25:43.592 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-20T01:25:43.592 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-20T01:25:43.592 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-20T01:25:43.592 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-20T01:25:43.593 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-20T01:25:43.593 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-20T01:25:43.593 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-20T01:25:43.593 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-20T01:25:43.593 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-20T01:25:43.593 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-20T01:25:43.593 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-20T01:25:43.593 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-20T01:25:43.593 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-20T01:25:43.593 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-20T01:25:43.593 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-20T01:25:43.593 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-20T01:25:43.594 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-20T01:25:43.594 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-20T01:25:43.594 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-20T01:25:43.594 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/152 2024-08-20T01:25:43.594 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-20T01:25:43.594 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-20T01:25:43.594 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-20T01:25:43.594 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/152 2024-08-20T01:25:43.594 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-20T01:25:43.594 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados2-2:19.0.0-5872.gef427541.el9.x86_64 149/152 2024-08-20T01:25:43.594 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-20T01:25:43.595 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librbd1-2:19.0.0-5872.gef427541.el9.x86_64 151/152 2024-08-20T01:25:45.714 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-20T01:25:45.714 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-08-20T01:25:45.714 INFO:teuthology.orchestra.run.smithi175.stdout:Upgraded: 2024-08-20T01:25:45.714 INFO:teuthology.orchestra.run.smithi175.stdout: librados2-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:45.714 INFO:teuthology.orchestra.run.smithi175.stdout: librbd1-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:45.715 INFO:teuthology.orchestra.run.smithi175.stdout:Installed: 2024-08-20T01:25:45.715 INFO:teuthology.orchestra.run.smithi175.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-20T01:25:45.715 INFO:teuthology.orchestra.run.smithi175.stdout: automake-1.16.2-8.el9.noarch 2024-08-20T01:25:45.715 INFO:teuthology.orchestra.run.smithi175.stdout: bison-3.7.4-5.el9.x86_64 2024-08-20T01:25:45.715 INFO:teuthology.orchestra.run.smithi175.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-20T01:25:45.715 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:45.715 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:45.715 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:45.715 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-fuse-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:45.715 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-grafana-dashboards-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:25:45.715 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-immutable-object-cache-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:45.715 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mds-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:45.715 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:45.716 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-cephadm-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:25:45.716 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:25:45.716 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-diskprediction-local-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:25:45.716 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:25:45.716 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-rook-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:25:45.716 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mon-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:45.716 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-osd-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:45.716 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-prometheus-alerts-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:25:45.716 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-radosgw-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:45.716 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-selinux-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:45.716 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-test-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:45.716 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-volume-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:25:45.716 INFO:teuthology.orchestra.run.smithi175.stdout: cephadm-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:25:45.717 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-mirror-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:45.717 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-shell-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:45.717 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-top-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:25:45.717 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-20T01:25:45.717 INFO:teuthology.orchestra.run.smithi175.stdout: flex-2.6.4-9.el9.x86_64 2024-08-20T01:25:45.717 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-20T01:25:45.717 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-20T01:25:45.717 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-20T01:25:45.717 INFO:teuthology.orchestra.run.smithi175.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-20T01:25:45.717 INFO:teuthology.orchestra.run.smithi175.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-20T01:25:45.717 INFO:teuthology.orchestra.run.smithi175.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-20T01:25:45.717 INFO:teuthology.orchestra.run.smithi175.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-20T01:25:45.717 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-20T01:25:45.718 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-20T01:25:45.718 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs-devel-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:45.718 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs2-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:45.718 INFO:teuthology.orchestra.run.smithi175.stdout: libcephsqlite-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:45.718 INFO:teuthology.orchestra.run.smithi175.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-08-20T01:25:45.718 INFO:teuthology.orchestra.run.smithi175.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-20T01:25:45.718 INFO:teuthology.orchestra.run.smithi175.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-20T01:25:45.718 INFO:teuthology.orchestra.run.smithi175.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-08-20T01:25:45.718 INFO:teuthology.orchestra.run.smithi175.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-20T01:25:45.718 INFO:teuthology.orchestra.run.smithi175.stdout: librados-devel-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:45.718 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:45.718 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-20T01:25:45.718 INFO:teuthology.orchestra.run.smithi175.stdout: librgw2-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:45.719 INFO:teuthology.orchestra.run.smithi175.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-20T01:25:45.719 INFO:teuthology.orchestra.run.smithi175.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-20T01:25:45.719 INFO:teuthology.orchestra.run.smithi175.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-20T01:25:45.719 INFO:teuthology.orchestra.run.smithi175.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-20T01:25:45.719 INFO:teuthology.orchestra.run.smithi175.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-20T01:25:45.719 INFO:teuthology.orchestra.run.smithi175.stdout: lua-5.4.4-4.el9.x86_64 2024-08-20T01:25:45.719 INFO:teuthology.orchestra.run.smithi175.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-20T01:25:45.719 INFO:teuthology.orchestra.run.smithi175.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-20T01:25:45.719 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-0.3.26-1.el9.x86_64 2024-08-20T01:25:45.719 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-openmp-0.3.26-1.el9.x86_64 2024-08-20T01:25:45.719 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-20T01:25:45.719 INFO:teuthology.orchestra.run.smithi175.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-20T01:25:45.720 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-13.16-1.el9.x86_64 2024-08-20T01:25:45.720 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-08-20T01:25:45.720 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-08-20T01:25:45.720 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-server-13.16-1.el9.x86_64 2024-08-20T01:25:45.720 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-20T01:25:45.720 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-20T01:25:45.720 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-20T01:25:45.720 INFO:teuthology.orchestra.run.smithi175.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-20T01:25:45.720 INFO:teuthology.orchestra.run.smithi175.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-20T01:25:45.720 INFO:teuthology.orchestra.run.smithi175.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-20T01:25:45.720 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-20T01:25:45.720 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:45.721 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:45.721 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cephfs-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:45.721 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-20T01:25:45.721 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-20T01:25:45.721 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-20T01:25:45.721 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-20T01:25:45.721 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-20T01:25:45.721 INFO:teuthology.orchestra.run.smithi175.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-20T01:25:45.721 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-20T01:25:45.721 INFO:teuthology.orchestra.run.smithi175.stdout: python3-devel-3.9.19-7.el9.x86_64 2024-08-20T01:25:45.721 INFO:teuthology.orchestra.run.smithi175.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-20T01:25:45.721 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-20T01:25:45.721 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-20T01:25:45.722 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-20T01:25:45.722 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-20T01:25:45.722 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-20T01:25:45.722 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-20T01:25:45.722 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-20T01:25:45.722 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-20T01:25:45.722 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-20T01:25:45.722 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-20T01:25:45.722 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-20T01:25:45.722 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-20T01:25:45.722 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-20T01:25:45.723 INFO:teuthology.orchestra.run.smithi175.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-20T01:25:45.723 INFO:teuthology.orchestra.run.smithi175.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-20T01:25:45.723 INFO:teuthology.orchestra.run.smithi175.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-20T01:25:45.723 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-20T01:25:45.723 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-20T01:25:45.723 INFO:teuthology.orchestra.run.smithi175.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-20T01:25:45.723 INFO:teuthology.orchestra.run.smithi175.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-20T01:25:45.723 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-20T01:25:45.723 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ply-3.11-14.el9.noarch 2024-08-20T01:25:45.723 INFO:teuthology.orchestra.run.smithi175.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-20T01:25:45.723 INFO:teuthology.orchestra.run.smithi175.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-20T01:25:45.723 INFO:teuthology.orchestra.run.smithi175.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-20T01:25:45.723 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-20T01:25:45.724 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-20T01:25:45.724 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-20T01:25:45.724 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-20T01:25:45.724 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-20T01:25:45.724 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-20T01:25:45.724 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:45.724 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rbd-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:45.724 INFO:teuthology.orchestra.run.smithi175.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-20T01:25:45.724 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-20T01:25:45.724 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-20T01:25:45.724 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rgw-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:45.725 INFO:teuthology.orchestra.run.smithi175.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-20T01:25:45.725 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-20T01:25:45.725 INFO:teuthology.orchestra.run.smithi175.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-20T01:25:45.725 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-20T01:25:45.725 INFO:teuthology.orchestra.run.smithi175.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-20T01:25:45.725 INFO:teuthology.orchestra.run.smithi175.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-20T01:25:45.725 INFO:teuthology.orchestra.run.smithi175.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-20T01:25:45.725 INFO:teuthology.orchestra.run.smithi175.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-20T01:25:45.725 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-20T01:25:45.725 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-20T01:25:45.725 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-20T01:25:45.725 INFO:teuthology.orchestra.run.smithi175.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-20T01:25:45.725 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-20T01:25:45.726 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-20T01:25:45.726 INFO:teuthology.orchestra.run.smithi175.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-20T01:25:45.726 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-fuse-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:45.726 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-mirror-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:45.726 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-nbd-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:45.726 INFO:teuthology.orchestra.run.smithi175.stdout: re2-1:20211101-3.el9.x86_64 2024-08-20T01:25:45.726 INFO:teuthology.orchestra.run.smithi175.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-20T01:25:45.726 INFO:teuthology.orchestra.run.smithi175.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-20T01:25:45.726 INFO:teuthology.orchestra.run.smithi175.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-20T01:25:45.726 INFO:teuthology.orchestra.run.smithi175.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-08-20T01:25:45.726 INFO:teuthology.orchestra.run.smithi175.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-20T01:25:45.727 INFO:teuthology.orchestra.run.smithi175.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-20T01:25:45.727 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-08-20T01:25:45.727 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-08-20T01:25:46.064 DEBUG:teuthology.parallel:result is None 2024-08-20T01:25:47.246 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-test-2:19.0.0-5872.gef427541.el9.x86_64 137/152 2024-08-20T01:25:47.287 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-fuse-2:19.0.0-5872.gef427541.el9.x86_64 138/152 2024-08-20T01:25:47.327 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-nbd-2:19.0.0-5872.gef427541.el9.x86_64 139/152 2024-08-20T01:25:47.360 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 140/152 2024-08-20T01:25:47.387 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-20T01:25:47.572 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-shell-2:19.0.0-5872.gef427541.el9.x86_64 142/152 2024-08-20T01:25:47.643 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 143/152 2024-08-20T01:25:47.923 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs-devel-2:19.0.0-5872.gef427541.el9.x86_ 144/152 2024-08-20T01:25:48.244 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-20T01:25:48.279 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-20T01:25:48.298 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-20T01:25:49.122 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-top-2:19.0.0-5872.gef427541.el9.noarch 146/152 2024-08-20T01:25:49.218 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 147/152 2024-08-20T01:25:49.258 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-20T01:25:49.339 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-20T01:25:49.372 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-20T01:25:49.372 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-20T01:25:49.439 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-20T01:25:49.439 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-20T01:25:49.780 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-20T01:25:49.780 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-2:19.0.0-5872.gef427541.el9.x86_64 1/152 2024-08-20T01:25:49.780 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-base-2:19.0.0-5872.gef427541.el9.x86_64 2/152 2024-08-20T01:25:49.780 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 3/152 2024-08-20T01:25:49.780 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-fuse-2:19.0.0-5872.gef427541.el9.x86_64 4/152 2024-08-20T01:25:49.780 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-5872.gef427 5/152 2024-08-20T01:25:49.781 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mds-2:19.0.0-5872.gef427541.el9.x86_64 6/152 2024-08-20T01:25:49.781 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-2:19.0.0-5872.gef427541.el9.x86_64 7/152 2024-08-20T01:25:49.781 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mon-2:19.0.0-5872.gef427541.el9.x86_64 8/152 2024-08-20T01:25:49.781 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-osd-2:19.0.0-5872.gef427541.el9.x86_64 9/152 2024-08-20T01:25:49.781 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-radosgw-2:19.0.0-5872.gef427541.el9.x86_64 10/152 2024-08-20T01:25:49.781 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-selinux-2:19.0.0-5872.gef427541.el9.x86_64 11/152 2024-08-20T01:25:49.781 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-test-2:19.0.0-5872.gef427541.el9.x86_64 12/152 2024-08-20T01:25:49.781 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephfs-mirror-2:19.0.0-5872.gef427541.el9.x86_64 13/152 2024-08-20T01:25:49.781 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephfs-shell-2:19.0.0-5872.gef427541.el9.x86_64 14/152 2024-08-20T01:25:49.781 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcephfs-devel-2:19.0.0-5872.gef427541.el9.x86_ 15/152 2024-08-20T01:25:49.781 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcephfs2-2:19.0.0-5872.gef427541.el9.x86_64 16/152 2024-08-20T01:25:49.781 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcephsqlite-2:19.0.0-5872.gef427541.el9.x86_64 17/152 2024-08-20T01:25:49.781 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librados-devel-2:19.0.0-5872.gef427541.el9.x86_6 18/152 2024-08-20T01:25:49.782 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libradosstriper1-2:19.0.0-5872.gef427541.el9.x86 19/152 2024-08-20T01:25:49.782 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librgw2-2:19.0.0-5872.gef427541.el9.x86_64 20/152 2024-08-20T01:25:49.782 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-ceph-argparse-2:19.0.0-5872.gef427541.el 21/152 2024-08-20T01:25:49.782 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-ceph-common-2:19.0.0-5872.gef427541.el9. 22/152 2024-08-20T01:25:49.782 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cephfs-2:19.0.0-5872.gef427541.el9.x86_6 23/152 2024-08-20T01:25:49.782 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rados-2:19.0.0-5872.gef427541.el9.x86_64 24/152 2024-08-20T01:25:49.782 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rbd-2:19.0.0-5872.gef427541.el9.x86_64 25/152 2024-08-20T01:25:49.782 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rgw-2:19.0.0-5872.gef427541.el9.x86_64 26/152 2024-08-20T01:25:49.782 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : rbd-fuse-2:19.0.0-5872.gef427541.el9.x86_64 27/152 2024-08-20T01:25:49.782 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : rbd-mirror-2:19.0.0-5872.gef427541.el9.x86_64 28/152 2024-08-20T01:25:49.793 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : rbd-nbd-2:19.0.0-5872.gef427541.el9.x86_64 29/152 2024-08-20T01:25:49.793 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-5872.gef427541. 30/152 2024-08-20T01:25:49.793 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-5872.gef427541.el9.noa 31/152 2024-08-20T01:25:49.793 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-5872.gef427541.el9.n 32/152 2024-08-20T01:25:49.793 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-5872.gef4 33/152 2024-08-20T01:25:49.793 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-5872.gef427541.el 34/152 2024-08-20T01:25:49.793 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-rook-2:19.0.0-5872.gef427541.el9.noarch 35/152 2024-08-20T01:25:49.794 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-5872.gef427541.e 36/152 2024-08-20T01:25:49.794 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-volume-2:19.0.0-5872.gef427541.el9.noarch 37/152 2024-08-20T01:25:49.794 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephadm-2:19.0.0-5872.gef427541.el9.noarch 38/152 2024-08-20T01:25:49.794 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephfs-top-2:19.0.0-5872.gef427541.el9.noarch 39/152 2024-08-20T01:25:49.794 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-20T01:25:49.794 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/152 2024-08-20T01:25:49.794 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/152 2024-08-20T01:25:49.794 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-20T01:25:49.794 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-20T01:25:49.794 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-20T01:25:49.794 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-20T01:25:49.794 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-20T01:25:49.795 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-20T01:25:49.795 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-20T01:25:49.795 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-20T01:25:49.795 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-20T01:25:49.795 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-20T01:25:49.795 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-20T01:25:49.795 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-20T01:25:49.795 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-20T01:25:49.795 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-20T01:25:49.795 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-20T01:25:49.795 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-20T01:25:49.795 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-20T01:25:49.795 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-20T01:25:49.796 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-20T01:25:49.796 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-08-20T01:25:49.796 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-20T01:25:49.796 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-20T01:25:49.796 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-20T01:25:49.796 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openblas-0.3.26-1.el9.x86_64 66/152 2024-08-20T01:25:49.796 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openblas-openmp-0.3.26-1.el9.x86_64 67/152 2024-08-20T01:25:49.796 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 68/152 2024-08-20T01:25:49.796 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/152 2024-08-20T01:25:49.796 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/152 2024-08-20T01:25:49.796 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/152 2024-08-20T01:25:49.796 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/152 2024-08-20T01:25:49.796 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-20T01:25:49.797 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-20T01:25:49.797 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-20T01:25:49.797 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-20T01:25:49.797 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-devel-3.9.19-7.el9.x86_64 77/152 2024-08-20T01:25:49.797 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-20T01:25:49.797 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-20T01:25:49.797 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-20T01:25:49.797 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-20T01:25:49.797 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-20T01:25:49.797 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-20T01:25:49.797 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-20T01:25:49.797 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-20T01:25:49.797 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-20T01:25:49.797 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-20T01:25:49.798 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-20T01:25:49.798 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-20T01:25:49.798 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-20T01:25:49.798 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-20T01:25:49.798 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-20T01:25:49.798 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-20T01:25:49.798 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-20T01:25:49.798 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-20T01:25:49.798 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-20T01:25:49.798 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-20T01:25:49.798 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-20T01:25:49.799 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-20T01:25:49.799 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-20T01:25:49.799 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/152 2024-08-20T01:25:49.799 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-20T01:25:49.799 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-20T01:25:49.799 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-20T01:25:49.799 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-20T01:25:49.799 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-20T01:25:49.799 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-20T01:25:49.799 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-20T01:25:49.799 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-20T01:25:49.799 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-20T01:25:49.799 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-20T01:25:49.800 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-20T01:25:49.800 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-20T01:25:49.800 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-20T01:25:49.800 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-20T01:25:49.800 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-20T01:25:49.800 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-20T01:25:49.800 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-20T01:25:49.800 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-20T01:25:49.800 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-20T01:25:49.800 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-20T01:25:49.800 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 122/152 2024-08-20T01:25:49.800 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-20T01:25:49.800 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-20T01:25:49.800 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-20T01:25:49.801 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-20T01:25:49.801 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-20T01:25:49.801 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-20T01:25:49.801 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-20T01:25:49.801 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-20T01:25:49.801 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-20T01:25:49.801 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-20T01:25:49.801 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-20T01:25:49.801 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-20T01:25:49.801 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-20T01:25:49.801 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-20T01:25:49.801 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-20T01:25:49.802 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-20T01:25:49.802 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-20T01:25:49.802 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-20T01:25:49.802 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-20T01:25:49.802 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-20T01:25:49.802 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/152 2024-08-20T01:25:49.802 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-20T01:25:49.802 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-20T01:25:49.802 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-20T01:25:49.802 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/152 2024-08-20T01:25:49.802 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-20T01:25:49.802 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librados2-2:19.0.0-5872.gef427541.el9.x86_64 149/152 2024-08-20T01:25:49.803 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-20T01:25:49.803 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librbd1-2:19.0.0-5872.gef427541.el9.x86_64 151/152 2024-08-20T01:25:52.000 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-20T01:25:52.001 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:25:52.001 INFO:teuthology.orchestra.run.smithi079.stdout:Upgraded: 2024-08-20T01:25:52.001 INFO:teuthology.orchestra.run.smithi079.stdout: librados2-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:52.001 INFO:teuthology.orchestra.run.smithi079.stdout: librbd1-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:52.001 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2024-08-20T01:25:52.001 INFO:teuthology.orchestra.run.smithi079.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-20T01:25:52.001 INFO:teuthology.orchestra.run.smithi079.stdout: automake-1.16.2-8.el9.noarch 2024-08-20T01:25:52.001 INFO:teuthology.orchestra.run.smithi079.stdout: bison-3.7.4-5.el9.x86_64 2024-08-20T01:25:52.001 INFO:teuthology.orchestra.run.smithi079.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-20T01:25:52.001 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:52.001 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-base-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:52.001 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:52.002 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-fuse-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:52.002 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-grafana-dashboards-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:25:52.002 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-immutable-object-cache-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:52.002 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mds-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:52.002 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:52.002 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-cephadm-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:25:52.002 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-dashboard-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:25:52.002 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-diskprediction-local-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:25:52.002 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-modules-core-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:25:52.002 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-rook-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:25:52.002 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mon-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:52.003 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-osd-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:52.003 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-prometheus-alerts-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:25:52.003 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-radosgw-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:52.003 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-selinux-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:52.003 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-test-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:52.003 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-volume-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:25:52.003 INFO:teuthology.orchestra.run.smithi079.stdout: cephadm-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:25:52.003 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-mirror-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:52.003 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-shell-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:52.003 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-top-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:25:52.003 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-20T01:25:52.003 INFO:teuthology.orchestra.run.smithi079.stdout: flex-2.6.4-9.el9.x86_64 2024-08-20T01:25:52.004 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-20T01:25:52.004 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-20T01:25:52.004 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-20T01:25:52.004 INFO:teuthology.orchestra.run.smithi079.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-20T01:25:52.004 INFO:teuthology.orchestra.run.smithi079.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-20T01:25:52.004 INFO:teuthology.orchestra.run.smithi079.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-20T01:25:52.004 INFO:teuthology.orchestra.run.smithi079.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-20T01:25:52.004 INFO:teuthology.orchestra.run.smithi079.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-20T01:25:52.004 INFO:teuthology.orchestra.run.smithi079.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-20T01:25:52.004 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs-devel-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:52.004 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs2-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:52.004 INFO:teuthology.orchestra.run.smithi079.stdout: libcephsqlite-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:52.004 INFO:teuthology.orchestra.run.smithi079.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-08-20T01:25:52.005 INFO:teuthology.orchestra.run.smithi079.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-20T01:25:52.005 INFO:teuthology.orchestra.run.smithi079.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-20T01:25:52.005 INFO:teuthology.orchestra.run.smithi079.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-08-20T01:25:52.005 INFO:teuthology.orchestra.run.smithi079.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-20T01:25:52.005 INFO:teuthology.orchestra.run.smithi079.stdout: librados-devel-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:52.005 INFO:teuthology.orchestra.run.smithi079.stdout: libradosstriper1-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:52.005 INFO:teuthology.orchestra.run.smithi079.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-20T01:25:52.005 INFO:teuthology.orchestra.run.smithi079.stdout: librgw2-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:52.005 INFO:teuthology.orchestra.run.smithi079.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-20T01:25:52.005 INFO:teuthology.orchestra.run.smithi079.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-20T01:25:52.005 INFO:teuthology.orchestra.run.smithi079.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-20T01:25:52.005 INFO:teuthology.orchestra.run.smithi079.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-20T01:25:52.006 INFO:teuthology.orchestra.run.smithi079.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-20T01:25:52.006 INFO:teuthology.orchestra.run.smithi079.stdout: lua-5.4.4-4.el9.x86_64 2024-08-20T01:25:52.006 INFO:teuthology.orchestra.run.smithi079.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-20T01:25:52.006 INFO:teuthology.orchestra.run.smithi079.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-20T01:25:52.006 INFO:teuthology.orchestra.run.smithi079.stdout: openblas-0.3.26-1.el9.x86_64 2024-08-20T01:25:52.006 INFO:teuthology.orchestra.run.smithi079.stdout: openblas-openmp-0.3.26-1.el9.x86_64 2024-08-20T01:25:52.006 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-20T01:25:52.006 INFO:teuthology.orchestra.run.smithi079.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-20T01:25:52.006 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-13.16-1.el9.x86_64 2024-08-20T01:25:52.006 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-08-20T01:25:52.006 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-08-20T01:25:52.007 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-server-13.16-1.el9.x86_64 2024-08-20T01:25:52.007 INFO:teuthology.orchestra.run.smithi079.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-20T01:25:52.007 INFO:teuthology.orchestra.run.smithi079.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-20T01:25:52.007 INFO:teuthology.orchestra.run.smithi079.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-20T01:25:52.007 INFO:teuthology.orchestra.run.smithi079.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-20T01:25:52.007 INFO:teuthology.orchestra.run.smithi079.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-20T01:25:52.007 INFO:teuthology.orchestra.run.smithi079.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-20T01:25:52.007 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-20T01:25:52.007 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-argparse-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:52.007 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:52.007 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cephfs-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:52.007 INFO:teuthology.orchestra.run.smithi079.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-20T01:25:52.008 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-20T01:25:52.008 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-20T01:25:52.008 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-20T01:25:52.008 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-20T01:25:52.008 INFO:teuthology.orchestra.run.smithi079.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-20T01:25:52.008 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-20T01:25:52.008 INFO:teuthology.orchestra.run.smithi079.stdout: python3-devel-3.9.19-7.el9.x86_64 2024-08-20T01:25:52.008 INFO:teuthology.orchestra.run.smithi079.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-20T01:25:52.008 INFO:teuthology.orchestra.run.smithi079.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-20T01:25:52.008 INFO:teuthology.orchestra.run.smithi079.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-20T01:25:52.008 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-20T01:25:52.009 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-20T01:25:52.009 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-20T01:25:52.009 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-20T01:25:52.009 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-20T01:25:52.009 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-20T01:25:52.009 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-20T01:25:52.009 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-20T01:25:52.009 INFO:teuthology.orchestra.run.smithi079.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-20T01:25:52.009 INFO:teuthology.orchestra.run.smithi079.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-20T01:25:52.009 INFO:teuthology.orchestra.run.smithi079.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-20T01:25:52.009 INFO:teuthology.orchestra.run.smithi079.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-20T01:25:52.009 INFO:teuthology.orchestra.run.smithi079.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-20T01:25:52.009 INFO:teuthology.orchestra.run.smithi079.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-20T01:25:52.010 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-20T01:25:52.010 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-20T01:25:52.010 INFO:teuthology.orchestra.run.smithi079.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-20T01:25:52.010 INFO:teuthology.orchestra.run.smithi079.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-20T01:25:52.010 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-20T01:25:52.010 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ply-3.11-14.el9.noarch 2024-08-20T01:25:52.010 INFO:teuthology.orchestra.run.smithi079.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-20T01:25:52.010 INFO:teuthology.orchestra.run.smithi079.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-20T01:25:52.010 INFO:teuthology.orchestra.run.smithi079.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-20T01:25:52.010 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-20T01:25:52.010 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-20T01:25:52.011 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-20T01:25:52.011 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-20T01:25:52.011 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-20T01:25:52.011 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-20T01:25:52.011 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rados-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:52.011 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rbd-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:52.011 INFO:teuthology.orchestra.run.smithi079.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-20T01:25:52.011 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-20T01:25:52.011 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-20T01:25:52.011 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rgw-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:52.011 INFO:teuthology.orchestra.run.smithi079.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-20T01:25:52.011 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-20T01:25:52.012 INFO:teuthology.orchestra.run.smithi079.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-20T01:25:52.012 INFO:teuthology.orchestra.run.smithi079.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-20T01:25:52.012 INFO:teuthology.orchestra.run.smithi079.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-20T01:25:52.012 INFO:teuthology.orchestra.run.smithi079.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-20T01:25:52.012 INFO:teuthology.orchestra.run.smithi079.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-20T01:25:52.012 INFO:teuthology.orchestra.run.smithi079.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-20T01:25:52.012 INFO:teuthology.orchestra.run.smithi079.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-20T01:25:52.012 INFO:teuthology.orchestra.run.smithi079.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-20T01:25:52.012 INFO:teuthology.orchestra.run.smithi079.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-20T01:25:52.012 INFO:teuthology.orchestra.run.smithi079.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-20T01:25:52.012 INFO:teuthology.orchestra.run.smithi079.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-20T01:25:52.012 INFO:teuthology.orchestra.run.smithi079.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-20T01:25:52.012 INFO:teuthology.orchestra.run.smithi079.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-20T01:25:52.013 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-fuse-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:52.013 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-mirror-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:52.013 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-nbd-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:52.013 INFO:teuthology.orchestra.run.smithi079.stdout: re2-1:20211101-3.el9.x86_64 2024-08-20T01:25:52.013 INFO:teuthology.orchestra.run.smithi079.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-20T01:25:52.013 INFO:teuthology.orchestra.run.smithi079.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-20T01:25:52.013 INFO:teuthology.orchestra.run.smithi079.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-20T01:25:52.013 INFO:teuthology.orchestra.run.smithi079.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-08-20T01:25:52.013 INFO:teuthology.orchestra.run.smithi079.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-20T01:25:52.013 INFO:teuthology.orchestra.run.smithi079.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-20T01:25:52.014 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:25:52.014 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-08-20T01:25:52.358 DEBUG:teuthology.parallel:result is None 2024-08-20T01:25:55.999 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-20T01:25:55.999 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-2:19.0.0-5872.gef427541.el9.x86_64 1/152 2024-08-20T01:25:55.999 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-base-2:19.0.0-5872.gef427541.el9.x86_64 2/152 2024-08-20T01:25:55.999 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 3/152 2024-08-20T01:25:55.999 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-fuse-2:19.0.0-5872.gef427541.el9.x86_64 4/152 2024-08-20T01:25:55.999 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-5872.gef427 5/152 2024-08-20T01:25:55.999 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mds-2:19.0.0-5872.gef427541.el9.x86_64 6/152 2024-08-20T01:25:55.999 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-2:19.0.0-5872.gef427541.el9.x86_64 7/152 2024-08-20T01:25:56.000 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mon-2:19.0.0-5872.gef427541.el9.x86_64 8/152 2024-08-20T01:25:56.000 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-osd-2:19.0.0-5872.gef427541.el9.x86_64 9/152 2024-08-20T01:25:56.000 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-radosgw-2:19.0.0-5872.gef427541.el9.x86_64 10/152 2024-08-20T01:25:56.000 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-selinux-2:19.0.0-5872.gef427541.el9.x86_64 11/152 2024-08-20T01:25:56.000 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-test-2:19.0.0-5872.gef427541.el9.x86_64 12/152 2024-08-20T01:25:56.000 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-mirror-2:19.0.0-5872.gef427541.el9.x86_64 13/152 2024-08-20T01:25:56.000 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-shell-2:19.0.0-5872.gef427541.el9.x86_64 14/152 2024-08-20T01:25:56.000 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs-devel-2:19.0.0-5872.gef427541.el9.x86_ 15/152 2024-08-20T01:25:56.000 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs2-2:19.0.0-5872.gef427541.el9.x86_64 16/152 2024-08-20T01:25:56.000 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephsqlite-2:19.0.0-5872.gef427541.el9.x86_64 17/152 2024-08-20T01:25:56.000 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados-devel-2:19.0.0-5872.gef427541.el9.x86_6 18/152 2024-08-20T01:25:56.000 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libradosstriper1-2:19.0.0-5872.gef427541.el9.x86 19/152 2024-08-20T01:25:56.001 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librgw2-2:19.0.0-5872.gef427541.el9.x86_64 20/152 2024-08-20T01:25:56.001 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-argparse-2:19.0.0-5872.gef427541.el 21/152 2024-08-20T01:25:56.001 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-common-2:19.0.0-5872.gef427541.el9. 22/152 2024-08-20T01:25:56.001 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cephfs-2:19.0.0-5872.gef427541.el9.x86_6 23/152 2024-08-20T01:25:56.001 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rados-2:19.0.0-5872.gef427541.el9.x86_64 24/152 2024-08-20T01:25:56.001 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rbd-2:19.0.0-5872.gef427541.el9.x86_64 25/152 2024-08-20T01:25:56.001 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rgw-2:19.0.0-5872.gef427541.el9.x86_64 26/152 2024-08-20T01:25:56.001 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-fuse-2:19.0.0-5872.gef427541.el9.x86_64 27/152 2024-08-20T01:25:56.001 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-mirror-2:19.0.0-5872.gef427541.el9.x86_64 28/152 2024-08-20T01:25:56.001 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-nbd-2:19.0.0-5872.gef427541.el9.x86_64 29/152 2024-08-20T01:25:56.001 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-5872.gef427541. 30/152 2024-08-20T01:25:56.012 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-5872.gef427541.el9.noa 31/152 2024-08-20T01:25:56.012 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-5872.gef427541.el9.n 32/152 2024-08-20T01:25:56.012 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-5872.gef4 33/152 2024-08-20T01:25:56.012 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-5872.gef427541.el 34/152 2024-08-20T01:25:56.012 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-rook-2:19.0.0-5872.gef427541.el9.noarch 35/152 2024-08-20T01:25:56.012 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-5872.gef427541.e 36/152 2024-08-20T01:25:56.013 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-volume-2:19.0.0-5872.gef427541.el9.noarch 37/152 2024-08-20T01:25:56.013 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephadm-2:19.0.0-5872.gef427541.el9.noarch 38/152 2024-08-20T01:25:56.013 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-top-2:19.0.0-5872.gef427541.el9.noarch 39/152 2024-08-20T01:25:56.013 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-20T01:25:56.013 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/152 2024-08-20T01:25:56.013 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/152 2024-08-20T01:25:56.013 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-20T01:25:56.013 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-20T01:25:56.013 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-20T01:25:56.013 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-20T01:25:56.013 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-20T01:25:56.013 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-20T01:25:56.014 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-20T01:25:56.014 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-20T01:25:56.014 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-20T01:25:56.014 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-20T01:25:56.014 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-20T01:25:56.014 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-20T01:25:56.014 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-20T01:25:56.014 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-20T01:25:56.014 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-20T01:25:56.014 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-20T01:25:56.014 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-20T01:25:56.015 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-20T01:25:56.015 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-20T01:25:56.015 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-08-20T01:25:56.015 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-20T01:25:56.015 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-20T01:25:56.015 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-20T01:25:56.015 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-0.3.26-1.el9.x86_64 66/152 2024-08-20T01:25:56.015 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-openmp-0.3.26-1.el9.x86_64 67/152 2024-08-20T01:25:56.015 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 68/152 2024-08-20T01:25:56.015 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/152 2024-08-20T01:25:56.015 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/152 2024-08-20T01:25:56.015 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/152 2024-08-20T01:25:56.016 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/152 2024-08-20T01:25:56.016 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-20T01:25:56.016 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-20T01:25:56.016 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-20T01:25:56.016 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-20T01:25:56.016 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-devel-3.9.19-7.el9.x86_64 77/152 2024-08-20T01:25:56.016 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-20T01:25:56.016 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-20T01:25:56.016 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-20T01:25:56.016 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-20T01:25:56.016 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-20T01:25:56.016 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-20T01:25:56.016 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-20T01:25:56.016 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-20T01:25:56.017 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-20T01:25:56.017 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-20T01:25:56.017 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-20T01:25:56.017 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-20T01:25:56.017 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-20T01:25:56.017 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-20T01:25:56.017 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-20T01:25:56.017 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-20T01:25:56.017 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-20T01:25:56.017 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-20T01:25:56.017 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-20T01:25:56.018 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-20T01:25:56.018 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-20T01:25:56.018 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-20T01:25:56.018 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-20T01:25:56.018 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/152 2024-08-20T01:25:56.018 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-20T01:25:56.018 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-20T01:25:56.018 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-20T01:25:56.018 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-20T01:25:56.018 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-20T01:25:56.018 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-20T01:25:56.018 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-20T01:25:56.019 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-20T01:25:56.019 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-20T01:25:56.019 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-20T01:25:56.019 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-20T01:25:56.019 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-20T01:25:56.019 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-20T01:25:56.019 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-20T01:25:56.019 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-20T01:25:56.019 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-20T01:25:56.019 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-20T01:25:56.019 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-20T01:25:56.019 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-20T01:25:56.020 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-20T01:25:56.020 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 122/152 2024-08-20T01:25:56.020 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-20T01:25:56.020 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-20T01:25:56.020 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-20T01:25:56.020 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-20T01:25:56.020 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-20T01:25:56.020 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-20T01:25:56.020 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-20T01:25:56.020 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-20T01:25:56.020 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-20T01:25:56.020 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-20T01:25:56.021 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-20T01:25:56.021 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-20T01:25:56.021 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-20T01:25:56.021 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-20T01:25:56.021 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-20T01:25:56.021 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-20T01:25:56.021 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-20T01:25:56.021 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-20T01:25:56.021 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-20T01:25:56.021 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-20T01:25:56.021 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/152 2024-08-20T01:25:56.021 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-20T01:25:56.022 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-20T01:25:56.022 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-20T01:25:56.022 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/152 2024-08-20T01:25:56.022 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-20T01:25:56.022 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:19.0.0-5872.gef427541.el9.x86_64 149/152 2024-08-20T01:25:56.022 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-20T01:25:56.022 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:19.0.0-5872.gef427541.el9.x86_64 151/152 2024-08-20T01:25:58.201 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-20T01:25:58.202 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-08-20T01:25:58.202 INFO:teuthology.orchestra.run.smithi081.stdout:Upgraded: 2024-08-20T01:25:58.202 INFO:teuthology.orchestra.run.smithi081.stdout: librados2-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:58.202 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:58.202 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-08-20T01:25:58.202 INFO:teuthology.orchestra.run.smithi081.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-20T01:25:58.202 INFO:teuthology.orchestra.run.smithi081.stdout: automake-1.16.2-8.el9.noarch 2024-08-20T01:25:58.202 INFO:teuthology.orchestra.run.smithi081.stdout: bison-3.7.4-5.el9.x86_64 2024-08-20T01:25:58.202 INFO:teuthology.orchestra.run.smithi081.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-20T01:25:58.202 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:58.202 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:58.203 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:58.203 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:58.203 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:25:58.203 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:58.203 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:58.203 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:58.203 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:25:58.203 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:25:58.203 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:25:58.203 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:25:58.203 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:25:58.204 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:58.204 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:58.204 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:25:58.204 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:58.204 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:58.204 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:58.204 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:25:58.204 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:25:58.204 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:58.204 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-shell-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:58.204 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T01:25:58.204 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-20T01:25:58.205 INFO:teuthology.orchestra.run.smithi081.stdout: flex-2.6.4-9.el9.x86_64 2024-08-20T01:25:58.205 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-20T01:25:58.205 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-20T01:25:58.205 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-20T01:25:58.205 INFO:teuthology.orchestra.run.smithi081.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-20T01:25:58.205 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-20T01:25:58.205 INFO:teuthology.orchestra.run.smithi081.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-20T01:25:58.205 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-20T01:25:58.205 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-20T01:25:58.205 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-20T01:25:58.205 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:58.206 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:58.206 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:58.206 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-08-20T01:25:58.206 INFO:teuthology.orchestra.run.smithi081.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-20T01:25:58.206 INFO:teuthology.orchestra.run.smithi081.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-20T01:25:58.206 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-08-20T01:25:58.206 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-20T01:25:58.206 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:58.206 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:58.206 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-20T01:25:58.206 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:58.206 INFO:teuthology.orchestra.run.smithi081.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-20T01:25:58.207 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-20T01:25:58.207 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-20T01:25:58.207 INFO:teuthology.orchestra.run.smithi081.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-20T01:25:58.207 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-20T01:25:58.207 INFO:teuthology.orchestra.run.smithi081.stdout: lua-5.4.4-4.el9.x86_64 2024-08-20T01:25:58.207 INFO:teuthology.orchestra.run.smithi081.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-20T01:25:58.207 INFO:teuthology.orchestra.run.smithi081.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-20T01:25:58.207 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-0.3.26-1.el9.x86_64 2024-08-20T01:25:58.207 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-openmp-0.3.26-1.el9.x86_64 2024-08-20T01:25:58.207 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-20T01:25:58.207 INFO:teuthology.orchestra.run.smithi081.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-20T01:25:58.207 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-13.16-1.el9.x86_64 2024-08-20T01:25:58.208 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-08-20T01:25:58.208 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-08-20T01:25:58.208 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-server-13.16-1.el9.x86_64 2024-08-20T01:25:58.208 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-20T01:25:58.208 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-20T01:25:58.208 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-20T01:25:58.208 INFO:teuthology.orchestra.run.smithi081.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-20T01:25:58.208 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-20T01:25:58.208 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-20T01:25:58.208 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-20T01:25:58.208 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:58.208 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:58.208 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:58.209 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-20T01:25:58.209 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-20T01:25:58.209 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-20T01:25:58.209 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-20T01:25:58.209 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-20T01:25:58.209 INFO:teuthology.orchestra.run.smithi081.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-20T01:25:58.209 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-20T01:25:58.209 INFO:teuthology.orchestra.run.smithi081.stdout: python3-devel-3.9.19-7.el9.x86_64 2024-08-20T01:25:58.209 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-20T01:25:58.209 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-20T01:25:58.209 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-20T01:25:58.209 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-20T01:25:58.210 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-20T01:25:58.210 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-20T01:25:58.210 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-20T01:25:58.210 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-20T01:25:58.210 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-20T01:25:58.210 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-20T01:25:58.210 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-20T01:25:58.210 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-20T01:25:58.210 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-20T01:25:58.210 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-20T01:25:58.210 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-20T01:25:58.210 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-20T01:25:58.211 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-20T01:25:58.211 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-20T01:25:58.211 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-20T01:25:58.211 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-20T01:25:58.211 INFO:teuthology.orchestra.run.smithi081.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-20T01:25:58.211 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-20T01:25:58.211 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ply-3.11-14.el9.noarch 2024-08-20T01:25:58.211 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-20T01:25:58.211 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-20T01:25:58.211 INFO:teuthology.orchestra.run.smithi081.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-20T01:25:58.211 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-20T01:25:58.211 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-20T01:25:58.212 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-20T01:25:58.212 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-20T01:25:58.212 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-20T01:25:58.212 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-20T01:25:58.212 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:58.212 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:58.212 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-20T01:25:58.212 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-20T01:25:58.212 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-20T01:25:58.212 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:58.212 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-20T01:25:58.212 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-20T01:25:58.212 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-20T01:25:58.213 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-20T01:25:58.213 INFO:teuthology.orchestra.run.smithi081.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-20T01:25:58.213 INFO:teuthology.orchestra.run.smithi081.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-20T01:25:58.213 INFO:teuthology.orchestra.run.smithi081.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-20T01:25:58.213 INFO:teuthology.orchestra.run.smithi081.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-20T01:25:58.213 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-20T01:25:58.213 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-20T01:25:58.213 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-20T01:25:58.213 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-20T01:25:58.213 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-20T01:25:58.213 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-20T01:25:58.213 INFO:teuthology.orchestra.run.smithi081.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-20T01:25:58.214 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:58.214 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:58.214 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T01:25:58.214 INFO:teuthology.orchestra.run.smithi081.stdout: re2-1:20211101-3.el9.x86_64 2024-08-20T01:25:58.214 INFO:teuthology.orchestra.run.smithi081.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-20T01:25:58.214 INFO:teuthology.orchestra.run.smithi081.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-20T01:25:58.214 INFO:teuthology.orchestra.run.smithi081.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-20T01:25:58.214 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-08-20T01:25:58.214 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-20T01:25:58.215 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-20T01:25:58.215 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-08-20T01:25:58.215 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-08-20T01:25:58.551 DEBUG:teuthology.parallel:result is None 2024-08-20T01:25:58.552 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ef4275410d8483698016fe484b2a3c664080b4c1 2024-08-20T01:25:58.698 DEBUG:teuthology.orchestra.run.smithi079:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-20T01:25:58.725 INFO:teuthology.orchestra.run.smithi079.stdout:19.0.0-5872.gef427541.el9 2024-08-20T01:25:58.726 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-5872.gef427541.el9 2024-08-20T01:25:58.726 INFO:teuthology.task.install:The correct ceph version 19.0.0-5872.gef427541 is installed. 2024-08-20T01:25:58.727 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ef4275410d8483698016fe484b2a3c664080b4c1 2024-08-20T01:25:58.869 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-20T01:25:58.891 INFO:teuthology.orchestra.run.smithi081.stdout:19.0.0-5872.gef427541.el9 2024-08-20T01:25:58.891 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-5872.gef427541.el9 2024-08-20T01:25:58.891 INFO:teuthology.task.install:The correct ceph version 19.0.0-5872.gef427541 is installed. 2024-08-20T01:25:58.893 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ef4275410d8483698016fe484b2a3c664080b4c1 2024-08-20T01:25:59.034 DEBUG:teuthology.orchestra.run.smithi175:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-20T01:25:59.060 INFO:teuthology.orchestra.run.smithi175.stdout:19.0.0-5872.gef427541.el9 2024-08-20T01:25:59.060 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-5872.gef427541.el9 2024-08-20T01:25:59.061 INFO:teuthology.task.install:The correct ceph version 19.0.0-5872.gef427541 is installed. 2024-08-20T01:25:59.062 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-20T01:25:59.062 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-08-20T01:25:59.062 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-20T01:25:59.095 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-08-20T01:25:59.095 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-20T01:25:59.122 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-08-20T01:25:59.122 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-20T01:25:59.153 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-20T01:25:59.153 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-08-20T01:25:59.153 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/daemon-helper 2024-08-20T01:25:59.182 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-20T01:25:59.250 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-08-20T01:25:59.250 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/daemon-helper 2024-08-20T01:25:59.277 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-20T01:25:59.342 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-08-20T01:25:59.343 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/daemon-helper 2024-08-20T01:25:59.373 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-20T01:25:59.441 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-20T01:25:59.441 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-08-20T01:25:59.441 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-20T01:25:59.470 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-20T01:25:59.536 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-08-20T01:25:59.536 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-20T01:25:59.561 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-20T01:25:59.628 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-08-20T01:25:59.628 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-20T01:25:59.653 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-20T01:25:59.719 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-20T01:25:59.719 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-08-20T01:25:59.719 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/stdin-killer 2024-08-20T01:25:59.744 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-20T01:25:59.809 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-08-20T01:25:59.810 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/stdin-killer 2024-08-20T01:25:59.834 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-20T01:25:59.898 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-08-20T01:25:59.898 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/stdin-killer 2024-08-20T01:25:59.923 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-20T01:25:59.989 INFO:teuthology.run_tasks:Running task cephadm... 2024-08-20T01:26:00.079 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'mds': {'mds_bal_replicate_threshold': 1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'filestore flush min': 0, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd heartbeat grace': 60, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request', 'SLOW_OPS', 'slow request'], 'sha1': 'ef4275410d8483698016fe484b2a3c664080b4c1', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-08-20T01:26:00.080 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 2024-08-20T01:26:00.080 INFO:tasks.cephadm:Cluster fsid is 28484e9a-5e93-11ef-bccf-c7b262605968 2024-08-20T01:26:00.080 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-08-20T01:26:00.080 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.79', 'mon.b': '172.21.15.81', 'mon.c': '172.21.15.175'} 2024-08-20T01:26:00.081 INFO:tasks.cephadm:First mon is mon.a on smithi079 2024-08-20T01:26:00.081 INFO:tasks.cephadm:First mgr is x 2024-08-20T01:26:00.081 INFO:tasks.cephadm:Normalizing hostnames... 2024-08-20T01:26:00.081 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname $(hostname -s) 2024-08-20T01:26:00.106 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname $(hostname -s) 2024-08-20T01:26:00.131 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname $(hostname -s) 2024-08-20T01:26:00.157 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-08-20T01:26:00.157 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ef4275410d8483698016fe484b2a3c664080b4c1 2024-08-20T01:26:00.292 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'ef4275410d8483698016fe484b2a3c664080b4c1', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82210/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-5872-gef427541', 'node_name': '172.21.2.6+braggi06', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-5872.gef427541'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-08-19 17:15:28.176472', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-hemanth-testing-2024-08-19-1357', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-08-20T01:26:00.425 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-hemanth-testing-2024-08-19-1357, sha1 ef4275410d8483698016fe484b2a3c664080b4c1 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=ef4275410d8483698016fe484b2a3c664080b4c1 2024-08-20T01:26:00.427 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/x86_64/flavors/default/cephadm 2024-08-20T01:26:00.427 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/x86_64/flavors/default/cephadm 2024-08-20T01:26:00.427 DEBUG:teuthology.orchestra.run.smithi079:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-20T01:26:00.798 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r--. 1 ubuntu ubuntu 792014 Aug 20 01:26 /home/ubuntu/cephtest/cephadm 2024-08-20T01:26:00.799 DEBUG:teuthology.orchestra.run.smithi081:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-20T01:26:01.192 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r--. 1 ubuntu ubuntu 792014 Aug 20 01:26 /home/ubuntu/cephtest/cephadm 2024-08-20T01:26:01.192 DEBUG:teuthology.orchestra.run.smithi175:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-20T01:26:01.600 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r--. 1 ubuntu ubuntu 792014 Aug 20 01:26 /home/ubuntu/cephtest/cephadm 2024-08-20T01:26:01.600 DEBUG:teuthology.orchestra.run.smithi079:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-20T01:26:01.621 DEBUG:teuthology.orchestra.run.smithi081:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-20T01:26:01.641 DEBUG:teuthology.orchestra.run.smithi175:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-20T01:26:01.675 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 on all hosts... 2024-08-20T01:26:01.675 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 pull 2024-08-20T01:26:01.678 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 pull 2024-08-20T01:26:01.683 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 pull 2024-08-20T01:26:03.323 INFO:teuthology.orchestra.run.smithi079.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1... 2024-08-20T01:26:03.351 INFO:teuthology.orchestra.run.smithi081.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1... 2024-08-20T01:26:03.414 INFO:teuthology.orchestra.run.smithi175.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1... 2024-08-20T01:26:34.267 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:26:34.267 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_version": "ceph version 19.0.0-5872-gef427541 (ef4275410d8483698016fe484b2a3c664080b4c1) squid (dev)", 2024-08-20T01:26:34.268 INFO:teuthology.orchestra.run.smithi079.stdout: "image_id": "9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a", 2024-08-20T01:26:34.268 INFO:teuthology.orchestra.run.smithi079.stdout: "repo_digests": [ 2024-08-20T01:26:34.268 INFO:teuthology.orchestra.run.smithi079.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8" 2024-08-20T01:26:34.268 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-08-20T01:26:34.268 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:26:52.182 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-08-20T01:26:52.183 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_version": "ceph version 19.0.0-5872-gef427541 (ef4275410d8483698016fe484b2a3c664080b4c1) squid (dev)", 2024-08-20T01:26:52.183 INFO:teuthology.orchestra.run.smithi175.stdout: "image_id": "9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a", 2024-08-20T01:26:52.183 INFO:teuthology.orchestra.run.smithi175.stdout: "repo_digests": [ 2024-08-20T01:26:52.183 INFO:teuthology.orchestra.run.smithi175.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8" 2024-08-20T01:26:52.183 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-08-20T01:26:52.183 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-08-20T01:26:58.076 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-08-20T01:26:58.077 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 19.0.0-5872-gef427541 (ef4275410d8483698016fe484b2a3c664080b4c1) squid (dev)", 2024-08-20T01:26:58.077 INFO:teuthology.orchestra.run.smithi081.stdout: "image_id": "9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a", 2024-08-20T01:26:58.077 INFO:teuthology.orchestra.run.smithi081.stdout: "repo_digests": [ 2024-08-20T01:26:58.077 INFO:teuthology.orchestra.run.smithi081.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8" 2024-08-20T01:26:58.077 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-08-20T01:26:58.077 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-08-20T01:26:58.103 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /etc/ceph 2024-08-20T01:26:58.136 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /etc/ceph 2024-08-20T01:26:58.164 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /etc/ceph 2024-08-20T01:26:58.197 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 777 /etc/ceph 2024-08-20T01:26:58.226 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 777 /etc/ceph 2024-08-20T01:26:58.250 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 777 /etc/ceph 2024-08-20T01:26:58.279 INFO:tasks.cephadm:Writing seed config... 2024-08-20T01:26:58.281 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-08-20T01:26:58.281 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-08-20T01:26:58.281 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-08-20T01:26:58.281 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-08-20T01:26:58.281 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-08-20T01:26:58.281 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-08-20T01:26:58.281 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-08-20T01:26:58.281 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-08-20T01:26:58.281 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-08-20T01:26:58.281 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-08-20T01:26:58.282 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-08-20T01:26:58.282 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-08-20T01:26:58.282 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-08-20T01:26:58.282 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-08-20T01:26:58.282 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-08-20T01:26:58.282 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-08-20T01:26:58.282 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-08-20T01:26:58.282 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-08-20T01:26:58.282 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-08-20T01:26:58.282 INFO:tasks.cephadm: override: [osd] filestore flush min = 0 2024-08-20T01:26:58.282 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-08-20T01:26:58.282 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-08-20T01:26:58.283 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-08-20T01:26:58.283 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-08-20T01:26:58.283 INFO:tasks.cephadm: override: [osd] osd heartbeat grace = 60 2024-08-20T01:26:58.283 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-08-20T01:26:58.283 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-08-20T01:26:58.283 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-08-20T01:26:58.284 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-08-20T01:26:58.284 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-08-20T01:26:58.302 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 28484e9a-5e93-11ef-bccf-c7b262605968 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 filestore flush min = 0 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd heartbeat grace = 60 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [mds] mds_bal_replicate_threshold = 1 2024-08-20T01:26:58.302 DEBUG:teuthology.orchestra.run.smithi079:mon.a> sudo journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mon.a.service 2024-08-20T01:26:58.345 DEBUG:teuthology.orchestra.run.smithi079:mgr.x> sudo journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mgr.x.service 2024-08-20T01:26:58.387 INFO:tasks.cephadm:Bootstrapping... 2024-08-20T01:26:58.387 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 -v bootstrap --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.79 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-08-20T01:26:58.593 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-08-20T01:26:58.593 INFO:teuthology.orchestra.run.smithi079.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', '-v', 'bootstrap', '--fsid', '28484e9a-5e93-11ef-bccf-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.79', '--skip-admin-label'] 2024-08-20T01:26:58.593 INFO:teuthology.orchestra.run.smithi079.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-08-20T01:26:58.593 INFO:teuthology.orchestra.run.smithi079.stdout:Verifying podman|docker is present... 2024-08-20T01:26:58.617 INFO:teuthology.orchestra.run.smithi079.stdout:/bin/podman: stdout 5.2.1 2024-08-20T01:26:58.618 INFO:teuthology.orchestra.run.smithi079.stdout:Verifying lvm2 is present... 2024-08-20T01:26:58.618 INFO:teuthology.orchestra.run.smithi079.stdout:Verifying time synchronization is in place... 2024-08-20T01:26:58.625 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-08-20T01:26:58.625 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-08-20T01:26:58.631 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-08-20T01:26:58.631 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout inactive 2024-08-20T01:26:58.637 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout enabled 2024-08-20T01:26:58.644 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout active 2024-08-20T01:26:58.644 INFO:teuthology.orchestra.run.smithi079.stdout:Unit chronyd.service is enabled and running 2024-08-20T01:26:58.644 INFO:teuthology.orchestra.run.smithi079.stdout:Repeating the final host check... 2024-08-20T01:26:58.678 INFO:teuthology.orchestra.run.smithi079.stdout:/bin/podman: stdout 5.2.1 2024-08-20T01:26:58.678 INFO:teuthology.orchestra.run.smithi079.stdout:podman (/bin/podman) version 5.2.1 is present 2024-08-20T01:26:58.678 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl is present 2024-08-20T01:26:58.678 INFO:teuthology.orchestra.run.smithi079.stdout:lvcreate is present 2024-08-20T01:26:58.684 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-08-20T01:26:58.685 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-08-20T01:26:58.690 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-08-20T01:26:58.691 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout inactive 2024-08-20T01:26:58.697 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout enabled 2024-08-20T01:26:58.704 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout active 2024-08-20T01:26:58.704 INFO:teuthology.orchestra.run.smithi079.stdout:Unit chronyd.service is enabled and running 2024-08-20T01:26:58.704 INFO:teuthology.orchestra.run.smithi079.stdout:Host looks OK 2024-08-20T01:26:58.704 INFO:teuthology.orchestra.run.smithi079.stdout:Cluster fsid: 28484e9a-5e93-11ef-bccf-c7b262605968 2024-08-20T01:26:58.704 INFO:teuthology.orchestra.run.smithi079.stdout:Acquiring lock 140015302901616 on /run/cephadm/28484e9a-5e93-11ef-bccf-c7b262605968.lock 2024-08-20T01:26:58.704 INFO:teuthology.orchestra.run.smithi079.stdout:Lock 140015302901616 acquired on /run/cephadm/28484e9a-5e93-11ef-bccf-c7b262605968.lock 2024-08-20T01:26:58.705 INFO:teuthology.orchestra.run.smithi079.stdout:Verifying IP 172.21.15.79 port 3300 ... 2024-08-20T01:26:58.705 INFO:teuthology.orchestra.run.smithi079.stdout:Verifying IP 172.21.15.79 port 6789 ... 2024-08-20T01:26:58.705 INFO:teuthology.orchestra.run.smithi079.stdout:Base mon IP(s) is [172.21.15.79:3300, 172.21.15.79:6789], mon addrv is [v2:172.21.15.79:3300,v1:172.21.15.79:6789] 2024-08-20T01:26:58.708 INFO:teuthology.orchestra.run.smithi079.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.79 metric 100 2024-08-20T01:26:58.708 INFO:teuthology.orchestra.run.smithi079.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.79 metric 100 2024-08-20T01:26:58.711 INFO:teuthology.orchestra.run.smithi079.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-08-20T01:26:58.711 INFO:teuthology.orchestra.run.smithi079.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-08-20T01:26:58.711 INFO:teuthology.orchestra.run.smithi079.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-08-20T01:26:58.713 INFO:teuthology.orchestra.run.smithi079.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-08-20T01:26:58.714 INFO:teuthology.orchestra.run.smithi079.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-08-20T01:26:58.714 INFO:teuthology.orchestra.run.smithi079.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-08-20T01:26:58.714 INFO:teuthology.orchestra.run.smithi079.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-08-20T01:26:58.714 INFO:teuthology.orchestra.run.smithi079.stdout:/sbin/ip: stdout inet6 fe80::f3b9:9ad0:b997:fd33/64 scope link noprefixroute 2024-08-20T01:26:58.714 INFO:teuthology.orchestra.run.smithi079.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-08-20T01:26:58.715 INFO:teuthology.orchestra.run.smithi079.stdout:Mon IP `172.21.15.79` is in CIDR network `172.21.0.0/20` 2024-08-20T01:26:58.715 INFO:teuthology.orchestra.run.smithi079.stdout:Mon IP `172.21.15.79` is in CIDR network `172.21.0.0/20` 2024-08-20T01:26:58.715 INFO:teuthology.orchestra.run.smithi079.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-08-20T01:26:58.715 INFO:teuthology.orchestra.run.smithi079.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-08-20T01:26:58.715 INFO:teuthology.orchestra.run.smithi079.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1... 2024-08-20T01:26:59.602 INFO:teuthology.orchestra.run.smithi079.stdout:/bin/podman: stdout 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a 2024-08-20T01:26:59.602 INFO:teuthology.orchestra.run.smithi079.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1... 2024-08-20T01:26:59.602 INFO:teuthology.orchestra.run.smithi079.stdout:/bin/podman: stderr Getting image source signatures 2024-08-20T01:26:59.602 INFO:teuthology.orchestra.run.smithi079.stdout:/bin/podman: stderr Copying blob sha256:0beb2e0cf0f87d34a70e3776822a6ff39fafdc5a4d91bc4481cb39d566d52b0d 2024-08-20T01:26:59.603 INFO:teuthology.orchestra.run.smithi079.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-08-20T01:26:59.603 INFO:teuthology.orchestra.run.smithi079.stdout:/bin/podman: stderr Copying config sha256:9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a 2024-08-20T01:26:59.603 INFO:teuthology.orchestra.run.smithi079.stdout:/bin/podman: stderr Writing manifest to image destination 2024-08-20T01:27:00.774 INFO:teuthology.orchestra.run.smithi079.stdout:ceph: stdout ceph version 19.0.0-5872-gef427541 (ef4275410d8483698016fe484b2a3c664080b4c1) squid (dev) 2024-08-20T01:27:00.774 INFO:teuthology.orchestra.run.smithi079.stdout:Ceph version: ceph version 19.0.0-5872-gef427541 (ef4275410d8483698016fe484b2a3c664080b4c1) squid (dev) 2024-08-20T01:27:00.774 INFO:teuthology.orchestra.run.smithi079.stdout:Extracting ceph user uid/gid from container image... 2024-08-20T01:27:01.623 INFO:teuthology.orchestra.run.smithi079.stdout:stat: stdout 167 167 2024-08-20T01:27:01.623 INFO:teuthology.orchestra.run.smithi079.stdout:Creating initial keys... 2024-08-20T01:27:02.662 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-authtool: stdout AQDl8MNmmv+COBAAFXECbAt8YUsEYjvKTxuQ4A== 2024-08-20T01:27:03.610 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-authtool: stdout AQDn8MNmhQ5cABAAnm6ULIpcDGGQ5DbRjOg4fw== 2024-08-20T01:27:04.534 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-authtool: stdout AQDn8MNmgC8tORAADdthOogyXUAyfXAayYAneA== 2024-08-20T01:27:04.534 INFO:teuthology.orchestra.run.smithi079.stdout:Creating initial monmap... 2024-08-20T01:27:05.383 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-08-20T01:27:05.383 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-08-20T01:27:05.383 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 28484e9a-5e93-11ef-bccf-c7b262605968 2024-08-20T01:27:05.383 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-08-20T01:27:05.383 INFO:teuthology.orchestra.run.smithi079.stdout:monmaptool for a [v2:172.21.15.79:3300,v1:172.21.15.79:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-08-20T01:27:05.383 INFO:teuthology.orchestra.run.smithi079.stdout:setting min_mon_release = quincy 2024-08-20T01:27:05.383 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/monmaptool: set fsid to 28484e9a-5e93-11ef-bccf-c7b262605968 2024-08-20T01:27:05.384 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-08-20T01:27:05.384 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:27:05.384 INFO:teuthology.orchestra.run.smithi079.stdout:Creating mon... 2024-08-20T01:27:06.331 INFO:teuthology.orchestra.run.smithi079.stdout:create mon.a on 2024-08-20T01:27:06.568 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-08-20T01:27:06.713 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-08-20T01:27:06.905 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-28484e9a-5e93-11ef-bccf-c7b262605968.target → /etc/systemd/system/ceph-28484e9a-5e93-11ef-bccf-c7b262605968.target. 2024-08-20T01:27:06.905 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-28484e9a-5e93-11ef-bccf-c7b262605968.target → /etc/systemd/system/ceph-28484e9a-5e93-11ef-bccf-c7b262605968.target. 2024-08-20T01:27:07.137 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mon.a 2024-08-20T01:27:07.137 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Failed to reset failed state of unit ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mon.a.service: Unit ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mon.a.service not loaded. 2024-08-20T01:27:07.293 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-28484e9a-5e93-11ef-bccf-c7b262605968.target.wants/ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mon.a.service → /etc/systemd/system/ceph-28484e9a-5e93-11ef-bccf-c7b262605968@.service. 2024-08-20T01:27:07.794 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:07 smithi079 podman[18273]: 2024-08-20 01:27:07.754031511 +0000 UTC m=+0.336240292 container start dfff7e4d7c0e3149eb68872c647eb07a816bc6a8761f3b9704432ecc98bc7174 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-08-20T01:27:07.839 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-20T01:27:07.839 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout disabled 2024-08-20T01:27:07.846 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-20T01:27:07.847 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout inactive 2024-08-20T01:27:07.847 INFO:teuthology.orchestra.run.smithi079.stdout:firewalld.service is not enabled 2024-08-20T01:27:07.847 INFO:teuthology.orchestra.run.smithi079.stdout:Not possible to enable service . firewalld.service is not available 2024-08-20T01:27:07.847 INFO:teuthology.orchestra.run.smithi079.stdout:Waiting for mon to start... 2024-08-20T01:27:07.847 INFO:teuthology.orchestra.run.smithi079.stdout:Waiting for mon... 2024-08-20T01:27:08.088 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:07 smithi079 ceph-mon[18292]: mkfs 28484e9a-5e93-11ef-bccf-c7b262605968 2024-08-20T01:27:08.088 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:07 smithi079 ceph-mon[18292]: mon.a is new leader, mons a in quorum (ranks 0) 2024-08-20T01:27:08.088 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:07 smithi079 bash[18273]: dfff7e4d7c0e3149eb68872c647eb07a816bc6a8761f3b9704432ecc98bc7174 2024-08-20T01:27:08.088 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:07 smithi079 systemd[1]: Started Ceph mon.a for 28484e9a-5e93-11ef-bccf-c7b262605968. 2024-08-20T01:27:08.896 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout cluster: 2024-08-20T01:27:08.896 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout id: 28484e9a-5e93-11ef-bccf-c7b262605968 2024-08-20T01:27:08.896 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-08-20T01:27:08.896 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-08-20T01:27:08.896 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout services: 2024-08-20T01:27:08.896 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.557505s) 2024-08-20T01:27:08.896 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-08-20T01:27:08.897 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-08-20T01:27:08.897 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-08-20T01:27:08.897 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout data: 2024-08-20T01:27:08.897 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-08-20T01:27:08.897 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-08-20T01:27:08.897 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-08-20T01:27:08.897 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout pgs: 2024-08-20T01:27:08.897 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-08-20T01:27:08.897 INFO:teuthology.orchestra.run.smithi079.stdout:mon is available 2024-08-20T01:27:08.897 INFO:teuthology.orchestra.run.smithi079.stdout:Assimilating anything we can from ceph.conf... 2024-08-20T01:27:09.016 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:08 smithi079 ceph-mon[18292]: mon.a is new leader, mons a in quorum (ranks 0) 2024-08-20T01:27:09.016 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:08 smithi079 ceph-mon[18292]: monmap epoch 1 2024-08-20T01:27:09.016 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:08 smithi079 ceph-mon[18292]: fsid 28484e9a-5e93-11ef-bccf-c7b262605968 2024-08-20T01:27:09.016 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:08 smithi079 ceph-mon[18292]: last_changed 2024-08-20T01:27:04.865800+0000 2024-08-20T01:27:09.016 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:08 smithi079 ceph-mon[18292]: created 2024-08-20T01:27:04.865800+0000 2024-08-20T01:27:09.017 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:08 smithi079 ceph-mon[18292]: min_mon_release 19 (squid) 2024-08-20T01:27:09.017 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:08 smithi079 ceph-mon[18292]: election_strategy: 1 2024-08-20T01:27:09.017 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:08 smithi079 ceph-mon[18292]: 0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2024-08-20T01:27:09.017 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:08 smithi079 ceph-mon[18292]: fsmap 2024-08-20T01:27:09.017 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:08 smithi079 ceph-mon[18292]: osdmap e1: 0 total, 0 up, 0 in 2024-08-20T01:27:09.017 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:08 smithi079 ceph-mon[18292]: mgrmap e1: no daemons active 2024-08-20T01:27:09.017 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:08 smithi079 ceph-mon[18292]: from='client.? 172.21.15.79:0/2855251894' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-08-20T01:27:10.006 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:09 smithi079 ceph-mon[18292]: from='client.? 172.21.15.79:0/3371849716' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-08-20T01:27:10.006 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:09 smithi079 ceph-mon[18292]: from='client.? 172.21.15.79:0/3371849716' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-08-20T01:27:10.010 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-08-20T01:27:10.010 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout [global] 2024-08-20T01:27:10.011 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout fsid = 28484e9a-5e93-11ef-bccf-c7b262605968 2024-08-20T01:27:10.011 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-08-20T01:27:10.011 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.79:3300,v1:172.21.15.79:6789] 2024-08-20T01:27:10.011 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-08-20T01:27:10.011 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-08-20T01:27:10.011 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-08-20T01:27:10.011 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-08-20T01:27:10.011 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-08-20T01:27:10.011 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout [mgr] 2024-08-20T01:27:10.011 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-08-20T01:27:10.011 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-08-20T01:27:10.012 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout [osd] 2024-08-20T01:27:10.012 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-08-20T01:27:10.012 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout filestore_flush_min = 0 2024-08-20T01:27:10.012 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-08-20T01:27:10.012 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-08-20T01:27:10.012 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-08-20T01:27:10.012 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-08-20T01:27:10.012 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-08-20T01:27:10.012 INFO:teuthology.orchestra.run.smithi079.stdout:Generating new minimal ceph.conf... 2024-08-20T01:27:11.065 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:10 smithi079 ceph-mon[18292]: from='client.? 172.21.15.79:0/595897136' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:27:11.067 INFO:teuthology.orchestra.run.smithi079.stdout:Restarting the monitor... 2024-08-20T01:27:11.335 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:11 smithi079 systemd[1]: Stopping Ceph mon.a for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:27:11.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:11 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mon-a[18288]: 2024-08-20T01:27:11.334+0000 7fd6a22c0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:27:11.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:11 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mon-a[18288]: 2024-08-20T01:27:11.334+0000 7fd6a22c0640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-08-20T01:27:11.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:11 smithi079 podman[18531]: 2024-08-20 01:27:11.488713101 +0000 UTC m=+0.260288990 container died dfff7e4d7c0e3149eb68872c647eb07a816bc6a8761f3b9704432ecc98bc7174 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mon-a, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T01:27:12.077 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:11 smithi079 podman[18531]: 2024-08-20 01:27:11.834981327 +0000 UTC m=+0.606557215 container cleanup dfff7e4d7c0e3149eb68872c647eb07a816bc6a8761f3b9704432ecc98bc7174 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mon-a, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0) 2024-08-20T01:27:12.078 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:11 smithi079 bash[18531]: ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mon-a 2024-08-20T01:27:12.403 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 podman[18542]: 2024-08-20 01:27:12.077936453 +0000 UTC m=+0.593498491 container remove dfff7e4d7c0e3149eb68872c647eb07a816bc6a8761f3b9704432ecc98bc7174 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mon-a, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-20T01:27:12.403 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 systemd[1]: ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mon.a.service: Deactivated successfully. 2024-08-20T01:27:12.403 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 systemd[1]: Stopped Ceph mon.a for 28484e9a-5e93-11ef-bccf-c7b262605968. 2024-08-20T01:27:12.404 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 systemd[1]: Starting Ceph mon.a for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:27:12.404 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 podman[18636]: 2024-08-20 01:27:12.306297045 +0000 UTC m=+0.015542386 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 2024-08-20T01:27:12.656 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 podman[18636]: 2024-08-20 01:27:12.403670385 +0000 UTC m=+0.112915719 container create 6399ab7138052474f9f49084a6d41ce1b989c63f6b85d7c3bf2c8309b882b5cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T01:27:12.656 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 podman[18636]: 2024-08-20 01:27:12.631434042 +0000 UTC m=+0.340679374 container init 6399ab7138052474f9f49084a6d41ce1b989c63f6b85d7c3bf2c8309b882b5cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mon-a, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, CEPH_POINT_RELEASE=) 2024-08-20T01:27:12.657 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 podman[18636]: 2024-08-20 01:27:12.634441456 +0000 UTC m=+0.343686787 container start 6399ab7138052474f9f49084a6d41ce1b989c63f6b85d7c3bf2c8309b882b5cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mon-a, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, ceph=True) 2024-08-20T01:27:12.657 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: set uid:gid to 167:167 (ceph:ceph) 2024-08-20T01:27:12.657 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: ceph version 19.0.0-5872-gef427541 (ef4275410d8483698016fe484b2a3c664080b4c1) squid (dev), process ceph-mon, pid 2 2024-08-20T01:27:12.657 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: pidfile_write: ignore empty --pid-file 2024-08-20T01:27:12.735 INFO:teuthology.orchestra.run.smithi079.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-08-20T01:27:12.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: load: jerasure load: lrc 2024-08-20T01:27:12.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: RocksDB version: 7.9.2 2024-08-20T01:27:12.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Git sha 0 2024-08-20T01:27:12.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Compile date 2024-08-19 15:50:59 2024-08-20T01:27:12.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: DB SUMMARY 2024-08-20T01:27:12.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: DB Session ID: QDWTN6ZCDJD0JXRR60YR 2024-08-20T01:27:12.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: CURRENT file: CURRENT 2024-08-20T01:27:12.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: IDENTITY file: IDENTITY 2024-08-20T01:27:12.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-08-20T01:27:12.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-08-20T01:27:12.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 95217 ; 2024-08-20T01:27:12.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.error_if_exists: 0 2024-08-20T01:27:12.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.create_if_missing: 0 2024-08-20T01:27:12.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.paranoid_checks: 1 2024-08-20T01:27:12.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-20T01:27:12.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-20T01:27:12.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-20T01:27:12.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.env: 0x55bbe8215be0 2024-08-20T01:27:12.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.fs: PosixFileSystem 2024-08-20T01:27:12.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.info_log: 0x55bbea9e5700 2024-08-20T01:27:12.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.max_file_opening_threads: 16 2024-08-20T01:27:12.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.statistics: (nil) 2024-08-20T01:27:12.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.use_fsync: 0 2024-08-20T01:27:12.938 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.max_log_file_size: 0 2024-08-20T01:27:12.938 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-20T01:27:12.938 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-20T01:27:12.938 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.keep_log_file_num: 1000 2024-08-20T01:27:12.938 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.recycle_log_file_num: 0 2024-08-20T01:27:12.938 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.allow_fallocate: 1 2024-08-20T01:27:12.938 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.allow_mmap_reads: 0 2024-08-20T01:27:12.938 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.allow_mmap_writes: 0 2024-08-20T01:27:12.938 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.use_direct_reads: 0 2024-08-20T01:27:12.938 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-20T01:27:12.938 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.create_missing_column_families: 0 2024-08-20T01:27:12.939 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.db_log_dir: 2024-08-20T01:27:12.939 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.wal_dir: 2024-08-20T01:27:12.939 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-20T01:27:12.939 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-20T01:27:12.939 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-20T01:27:12.939 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-20T01:27:12.940 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-20T01:27:12.940 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-20T01:27:12.940 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.advise_random_on_open: 1 2024-08-20T01:27:12.940 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.db_write_buffer_size: 0 2024-08-20T01:27:12.941 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.write_buffer_manager: 0x55bbea9e8e60 2024-08-20T01:27:12.941 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-20T01:27:12.941 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-20T01:27:12.941 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-20T01:27:12.941 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.rate_limiter: (nil) 2024-08-20T01:27:12.941 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-20T01:27:12.941 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.wal_recovery_mode: 2 2024-08-20T01:27:12.941 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.enable_thread_tracking: 0 2024-08-20T01:27:12.941 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.enable_pipelined_write: 0 2024-08-20T01:27:12.941 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.unordered_write: 0 2024-08-20T01:27:12.941 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-20T01:27:12.941 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-20T01:27:12.941 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-20T01:27:12.942 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-20T01:27:12.942 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.row_cache: None 2024-08-20T01:27:12.942 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.wal_filter: None 2024-08-20T01:27:12.942 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-20T01:27:12.942 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.allow_ingest_behind: 0 2024-08-20T01:27:12.942 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.two_write_queues: 0 2024-08-20T01:27:12.942 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.manual_wal_flush: 0 2024-08-20T01:27:12.942 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.wal_compression: 0 2024-08-20T01:27:12.942 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.atomic_flush: 0 2024-08-20T01:27:12.942 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-20T01:27:12.943 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-20T01:27:12.943 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-20T01:27:12.943 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.log_readahead_size: 0 2024-08-20T01:27:12.943 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-20T01:27:12.943 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.best_efforts_recovery: 0 2024-08-20T01:27:12.943 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-20T01:27:12.943 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-20T01:27:12.943 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.allow_data_in_errors: 0 2024-08-20T01:27:12.943 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.db_host_id: __hostname__ 2024-08-20T01:27:12.943 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-20T01:27:12.943 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.max_background_jobs: 2 2024-08-20T01:27:12.943 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.max_background_compactions: -1 2024-08-20T01:27:12.943 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.max_subcompactions: 1 2024-08-20T01:27:12.944 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-20T01:27:12.944 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-20T01:27:12.944 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-20T01:27:12.944 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.max_total_wal_size: 0 2024-08-20T01:27:12.944 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-20T01:27:12.944 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-20T01:27:12.944 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-20T01:27:12.944 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-20T01:27:12.944 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.max_open_files: -1 2024-08-20T01:27:12.944 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.bytes_per_sync: 0 2024-08-20T01:27:12.944 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-20T01:27:12.944 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-20T01:27:12.944 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.compaction_readahead_size: 0 2024-08-20T01:27:12.945 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.max_background_flushes: -1 2024-08-20T01:27:12.945 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Compression algorithms supported: 2024-08-20T01:27:12.945 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: kZSTD supported: 0 2024-08-20T01:27:12.945 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: kXpressCompression supported: 0 2024-08-20T01:27:12.945 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: kBZip2Compression supported: 0 2024-08-20T01:27:12.945 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-20T01:27:12.945 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: kLZ4Compression supported: 1 2024-08-20T01:27:12.945 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: kZlibCompression supported: 1 2024-08-20T01:27:12.945 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: kLZ4HCCompression supported: 1 2024-08-20T01:27:12.945 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: kSnappyCompression supported: 1 2024-08-20T01:27:12.945 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-20T01:27:12.945 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-20T01:27:12.945 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-08-20T01:27:12.946 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-20T01:27:12.946 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-20T01:27:12.946 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.merge_operator: 2024-08-20T01:27:12.946 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.compaction_filter: None 2024-08-20T01:27:12.946 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.compaction_filter_factory: None 2024-08-20T01:27:12.946 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.sst_partitioner_factory: None 2024-08-20T01:27:12.946 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-20T01:27:12.946 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-20T01:27:12.946 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55bbea9e5380) 2024-08-20T01:27:12.946 INFO:journalctl@ceph.mon.a.smithi079.stdout: cache_index_and_filter_blocks: 1 2024-08-20T01:27:12.946 INFO:journalctl@ceph.mon.a.smithi079.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-20T01:27:12.946 INFO:journalctl@ceph.mon.a.smithi079.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-20T01:27:12.947 INFO:journalctl@ceph.mon.a.smithi079.stdout: pin_top_level_index_and_filter: 1 2024-08-20T01:27:12.947 INFO:journalctl@ceph.mon.a.smithi079.stdout: index_type: 0 2024-08-20T01:27:12.947 INFO:journalctl@ceph.mon.a.smithi079.stdout: data_block_index_type: 0 2024-08-20T01:27:12.947 INFO:journalctl@ceph.mon.a.smithi079.stdout: index_shortening: 1 2024-08-20T01:27:12.947 INFO:journalctl@ceph.mon.a.smithi079.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-20T01:27:12.947 INFO:journalctl@ceph.mon.a.smithi079.stdout: checksum: 4 2024-08-20T01:27:12.947 INFO:journalctl@ceph.mon.a.smithi079.stdout: no_block_cache: 0 2024-08-20T01:27:12.947 INFO:journalctl@ceph.mon.a.smithi079.stdout: block_cache: 0x55bbea9d9610 2024-08-20T01:27:12.947 INFO:journalctl@ceph.mon.a.smithi079.stdout: block_cache_name: BinnedLRUCache 2024-08-20T01:27:12.947 INFO:journalctl@ceph.mon.a.smithi079.stdout: block_cache_options: 2024-08-20T01:27:12.947 INFO:journalctl@ceph.mon.a.smithi079.stdout: capacity : 536870912 2024-08-20T01:27:12.947 INFO:journalctl@ceph.mon.a.smithi079.stdout: num_shard_bits : 4 2024-08-20T01:27:12.947 INFO:journalctl@ceph.mon.a.smithi079.stdout: strict_capacity_limit : 0 2024-08-20T01:27:12.948 INFO:journalctl@ceph.mon.a.smithi079.stdout: high_pri_pool_ratio: 0.000 2024-08-20T01:27:12.948 INFO:journalctl@ceph.mon.a.smithi079.stdout: block_cache_compressed: (nil) 2024-08-20T01:27:12.948 INFO:journalctl@ceph.mon.a.smithi079.stdout: persistent_cache: (nil) 2024-08-20T01:27:12.948 INFO:journalctl@ceph.mon.a.smithi079.stdout: block_size: 4096 2024-08-20T01:27:12.948 INFO:journalctl@ceph.mon.a.smithi079.stdout: block_size_deviation: 10 2024-08-20T01:27:12.948 INFO:journalctl@ceph.mon.a.smithi079.stdout: block_restart_interval: 16 2024-08-20T01:27:12.948 INFO:journalctl@ceph.mon.a.smithi079.stdout: index_block_restart_interval: 1 2024-08-20T01:27:12.948 INFO:journalctl@ceph.mon.a.smithi079.stdout: metadata_block_size: 4096 2024-08-20T01:27:12.948 INFO:journalctl@ceph.mon.a.smithi079.stdout: partition_filters: 0 2024-08-20T01:27:12.948 INFO:journalctl@ceph.mon.a.smithi079.stdout: use_delta_encoding: 1 2024-08-20T01:27:12.948 INFO:journalctl@ceph.mon.a.smithi079.stdout: filter_policy: bloomfilter 2024-08-20T01:27:12.948 INFO:journalctl@ceph.mon.a.smithi079.stdout: whole_key_filtering: 1 2024-08-20T01:27:12.948 INFO:journalctl@ceph.mon.a.smithi079.stdout: verify_compression: 0 2024-08-20T01:27:12.949 INFO:journalctl@ceph.mon.a.smithi079.stdout: read_amp_bytes_per_bit: 0 2024-08-20T01:27:12.949 INFO:journalctl@ceph.mon.a.smithi079.stdout: format_version: 5 2024-08-20T01:27:12.949 INFO:journalctl@ceph.mon.a.smithi079.stdout: enable_index_compression: 1 2024-08-20T01:27:12.949 INFO:journalctl@ceph.mon.a.smithi079.stdout: block_align: 0 2024-08-20T01:27:12.949 INFO:journalctl@ceph.mon.a.smithi079.stdout: max_auto_readahead_size: 262144 2024-08-20T01:27:12.949 INFO:journalctl@ceph.mon.a.smithi079.stdout: prepopulate_block_cache: 0 2024-08-20T01:27:12.949 INFO:journalctl@ceph.mon.a.smithi079.stdout: initial_auto_readahead_size: 8192 2024-08-20T01:27:12.949 INFO:journalctl@ceph.mon.a.smithi079.stdout: num_file_reads_for_auto_readahead: 2 2024-08-20T01:27:12.949 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.write_buffer_size: 33554432 2024-08-20T01:27:12.949 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.max_write_buffer_number: 2 2024-08-20T01:27:12.949 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.compression: NoCompression 2024-08-20T01:27:12.949 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.bottommost_compression: Disabled 2024-08-20T01:27:12.950 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.prefix_extractor: nullptr 2024-08-20T01:27:12.950 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-20T01:27:12.950 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.num_levels: 7 2024-08-20T01:27:12.950 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-20T01:27:12.950 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-20T01:27:12.950 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-20T01:27:12.950 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-20T01:27:12.950 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-20T01:27:12.950 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-20T01:27:12.950 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-20T01:27:12.950 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-20T01:27:12.950 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-20T01:27:12.950 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-20T01:27:12.951 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-20T01:27:12.951 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-20T01:27:12.951 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-20T01:27:12.951 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.compression_opts.level: 32767 2024-08-20T01:27:12.951 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.compression_opts.strategy: 0 2024-08-20T01:27:12.951 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-20T01:27:12.951 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-20T01:27:12.951 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-20T01:27:12.951 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-20T01:27:12.951 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.compression_opts.enabled: false 2024-08-20T01:27:12.951 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-20T01:27:12.951 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-20T01:27:12.951 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-20T01:27:12.951 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-20T01:27:12.952 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.target_file_size_base: 67108864 2024-08-20T01:27:12.952 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-20T01:27:12.952 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-20T01:27:12.952 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-20T01:27:12.952 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-20T01:27:12.952 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-20T01:27:12.952 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-20T01:27:12.952 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-20T01:27:12.952 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-20T01:27:12.952 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-20T01:27:12.952 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-20T01:27:12.952 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-20T01:27:12.953 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-20T01:27:12.953 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-20T01:27:12.953 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-20T01:27:12.953 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.arena_block_size: 1048576 2024-08-20T01:27:12.953 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-20T01:27:12.953 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-20T01:27:12.953 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.disable_auto_compactions: 0 2024-08-20T01:27:12.953 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-20T01:27:12.953 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-20T01:27:12.953 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-20T01:27:12.953 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-20T01:27:12.953 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-20T01:27:12.953 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-20T01:27:12.953 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-20T01:27:12.954 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-20T01:27:12.954 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-20T01:27:12.954 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-20T01:27:12.954 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-20T01:27:12.954 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.inplace_update_support: 0 2024-08-20T01:27:12.954 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-20T01:27:12.954 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-20T01:27:12.954 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-20T01:27:12.954 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-20T01:27:12.954 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.bloom_locality: 0 2024-08-20T01:27:12.954 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.max_successive_merges: 0 2024-08-20T01:27:12.954 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-20T01:27:12.955 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.paranoid_file_checks: 0 2024-08-20T01:27:12.955 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.force_consistency_checks: 1 2024-08-20T01:27:12.955 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.report_bg_io_stats: 0 2024-08-20T01:27:12.955 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.ttl: 2592000 2024-08-20T01:27:12.955 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-20T01:27:12.955 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-20T01:27:12.955 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-20T01:27:12.955 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.enable_blob_files: false 2024-08-20T01:27:12.955 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.min_blob_size: 0 2024-08-20T01:27:12.955 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.blob_file_size: 268435456 2024-08-20T01:27:12.955 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-20T01:27:12.955 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-20T01:27:12.955 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-20T01:27:12.956 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-20T01:27:12.956 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-20T01:27:12.956 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.blob_file_starting_level: 0 2024-08-20T01:27:12.956 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-20T01:27:12.956 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-08-20T01:27:12.956 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-08-20T01:27:12.956 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 9f3060a7-959b-4343-aee2-568c0326ddd9 2024-08-20T01:27:12.956 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724117232661489, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-08-20T01:27:12.956 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-08-20T01:27:12.956 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724117232662363, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91374, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 284, "table_properties": {"data_size": 89415, "index_size": 279, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11704, "raw_average_key_size": 48, "raw_value_size": 82815, "raw_average_value_size": 340, "num_data_blocks": 12, "num_entries": 243, "num_filter_entries": 243, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1724117232, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "9f3060a7-959b-4343-aee2-568c0326ddd9", "db_session_id": "QDWTN6ZCDJD0JXRR60YR", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-08-20T01:27:12.956 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724117232662456, "job": 1, "event": "recovery_finished"} 2024-08-20T01:27:12.956 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-08-20T01:27:12.956 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-20T01:27:12.956 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55bbeaa08e00 2024-08-20T01:27:12.957 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: DB pointer 0x55bbeab06000 2024-08-20T01:27:12.957 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-20T01:27:12.957 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-20T01:27:12.957 INFO:journalctl@ceph.mon.a.smithi079.stdout: ** DB Stats ** 2024-08-20T01:27:12.957 INFO:journalctl@ceph.mon.a.smithi079.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-20T01:27:12.957 INFO:journalctl@ceph.mon.a.smithi079.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-20T01:27:12.957 INFO:journalctl@ceph.mon.a.smithi079.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-20T01:27:12.957 INFO:journalctl@ceph.mon.a.smithi079.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-20T01:27:12.957 INFO:journalctl@ceph.mon.a.smithi079.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-20T01:27:12.957 INFO:journalctl@ceph.mon.a.smithi079.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-20T01:27:12.957 INFO:journalctl@ceph.mon.a.smithi079.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-20T01:27:12.957 INFO:journalctl@ceph.mon.a.smithi079.stdout: 2024-08-20T01:27:12.957 INFO:journalctl@ceph.mon.a.smithi079.stdout: ** Compaction Stats [default] ** 2024-08-20T01:27:12.958 INFO:journalctl@ceph.mon.a.smithi079.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-20T01:27:12.958 INFO:journalctl@ceph.mon.a.smithi079.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-20T01:27:12.958 INFO:journalctl@ceph.mon.a.smithi079.stdout: L0 2/0 91.09 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 156.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-20T01:27:12.958 INFO:journalctl@ceph.mon.a.smithi079.stdout: Sum 2/0 91.09 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 156.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-20T01:27:12.958 INFO:journalctl@ceph.mon.a.smithi079.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 156.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-20T01:27:12.958 INFO:journalctl@ceph.mon.a.smithi079.stdout: 2024-08-20T01:27:12.958 INFO:journalctl@ceph.mon.a.smithi079.stdout: ** Compaction Stats [default] ** 2024-08-20T01:27:12.958 INFO:journalctl@ceph.mon.a.smithi079.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-20T01:27:12.958 INFO:journalctl@ceph.mon.a.smithi079.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-20T01:27:12.958 INFO:journalctl@ceph.mon.a.smithi079.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 156.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-20T01:27:12.958 INFO:journalctl@ceph.mon.a.smithi079.stdout: 2024-08-20T01:27:12.958 INFO:journalctl@ceph.mon.a.smithi079.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-20T01:27:12.959 INFO:journalctl@ceph.mon.a.smithi079.stdout: 2024-08-20T01:27:12.959 INFO:journalctl@ceph.mon.a.smithi079.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-20T01:27:12.959 INFO:journalctl@ceph.mon.a.smithi079.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-08-20T01:27:12.959 INFO:journalctl@ceph.mon.a.smithi079.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-20T01:27:12.959 INFO:journalctl@ceph.mon.a.smithi079.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-20T01:27:12.959 INFO:journalctl@ceph.mon.a.smithi079.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-20T01:27:12.959 INFO:journalctl@ceph.mon.a.smithi079.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-20T01:27:12.959 INFO:journalctl@ceph.mon.a.smithi079.stdout: Cumulative compaction: 0.00 GB write, 29.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-20T01:27:12.959 INFO:journalctl@ceph.mon.a.smithi079.stdout: Interval compaction: 0.00 GB write, 29.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-20T01:27:12.959 INFO:journalctl@ceph.mon.a.smithi079.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-20T01:27:12.959 INFO:journalctl@ceph.mon.a.smithi079.stdout: Block cache BinnedLRUCache@0x55bbea9d9610#2 capacity: 512.00 MB usage: 1.30 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-08-20T01:27:12.959 INFO:journalctl@ceph.mon.a.smithi079.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-08-20T01:27:12.959 INFO:journalctl@ceph.mon.a.smithi079.stdout: 2024-08-20T01:27:12.960 INFO:journalctl@ceph.mon.a.smithi079.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-20T01:27:12.960 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: starting mon.a rank 0 at public addrs [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] at bind addrs [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 28484e9a-5e93-11ef-bccf-c7b262605968 2024-08-20T01:27:12.960 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: mon.a@-1(???) e1 preinit fsid 28484e9a-5e93-11ef-bccf-c7b262605968 2024-08-20T01:27:12.960 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: mon.a@-1(???).mds e1 new map 2024-08-20T01:27:12.960 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: mon.a@-1(???).mds e1 print_map 2024-08-20T01:27:12.960 INFO:journalctl@ceph.mon.a.smithi079.stdout: e1 2024-08-20T01:27:12.960 INFO:journalctl@ceph.mon.a.smithi079.stdout: btime 2024-08-20T01:27:07:792478+0000 2024-08-20T01:27:12.960 INFO:journalctl@ceph.mon.a.smithi079.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-20T01:27:12.960 INFO:journalctl@ceph.mon.a.smithi079.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-20T01:27:12.960 INFO:journalctl@ceph.mon.a.smithi079.stdout: legacy client fscid: -1 2024-08-20T01:27:12.960 INFO:journalctl@ceph.mon.a.smithi079.stdout: 2024-08-20T01:27:12.960 INFO:journalctl@ceph.mon.a.smithi079.stdout: No filesystems configured 2024-08-20T01:27:12.960 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-20T01:27:12.961 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-20T01:27:12.961 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-20T01:27:12.961 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-20T01:27:12.961 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-08-20T01:27:12.961 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: mon.a is new leader, mons a in quorum (ranks 0) 2024-08-20T01:27:12.961 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: monmap epoch 1 2024-08-20T01:27:12.961 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: fsid 28484e9a-5e93-11ef-bccf-c7b262605968 2024-08-20T01:27:12.961 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: last_changed 2024-08-20T01:27:04.865800+0000 2024-08-20T01:27:12.961 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: created 2024-08-20T01:27:04.865800+0000 2024-08-20T01:27:12.961 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: min_mon_release 19 (squid) 2024-08-20T01:27:12.961 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: election_strategy: 1 2024-08-20T01:27:12.961 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: 0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2024-08-20T01:27:12.961 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: fsmap 2024-08-20T01:27:12.962 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: osdmap e1: 0 total, 0 up, 0 in 2024-08-20T01:27:12.962 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 ceph-mon[18656]: mgrmap e1: no daemons active 2024-08-20T01:27:12.962 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 bash[18636]: 6399ab7138052474f9f49084a6d41ce1b989c63f6b85d7c3bf2c8309b882b5cb 2024-08-20T01:27:12.962 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:12 smithi079 systemd[1]: Started Ceph mon.a for 28484e9a-5e93-11ef-bccf-c7b262605968. 2024-08-20T01:27:13.742 INFO:teuthology.orchestra.run.smithi079.stdout:Wrote config to /etc/ceph/ceph.conf 2024-08-20T01:27:13.764 INFO:teuthology.orchestra.run.smithi079.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-08-20T01:27:13.764 INFO:teuthology.orchestra.run.smithi079.stdout:Creating mgr... 2024-08-20T01:27:13.764 INFO:teuthology.orchestra.run.smithi079.stdout:Verifying port 0.0.0.0:9283 ... 2024-08-20T01:27:13.764 INFO:teuthology.orchestra.run.smithi079.stdout:Verifying port 0.0.0.0:8765 ... 2024-08-20T01:27:14.008 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mgr.x 2024-08-20T01:27:14.008 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Failed to reset failed state of unit ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mgr.x.service: Unit ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mgr.x.service not loaded. 2024-08-20T01:27:14.156 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-28484e9a-5e93-11ef-bccf-c7b262605968.target.wants/ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-28484e9a-5e93-11ef-bccf-c7b262605968@.service. 2024-08-20T01:27:14.383 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:14 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/3778811881' entity='client.admin' 2024-08-20T01:27:14.669 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:14 smithi079 podman[18869]: 2024-08-20 01:27:14.572196883 +0000 UTC m=+0.300748904 container start a969c0130e1ca40cb9d6fabbe95f2b94bf6e8ed3a7635eec7047cdd5ebcf7e57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-20T01:27:14.790 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-20T01:27:14.790 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout disabled 2024-08-20T01:27:14.790 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-20T01:27:14.790 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout inactive 2024-08-20T01:27:14.791 INFO:teuthology.orchestra.run.smithi079.stdout:firewalld.service is not enabled 2024-08-20T01:27:14.791 INFO:teuthology.orchestra.run.smithi079.stdout:Not possible to enable service . firewalld.service is not available 2024-08-20T01:27:14.791 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-20T01:27:14.791 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout disabled 2024-08-20T01:27:14.791 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-20T01:27:14.791 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout inactive 2024-08-20T01:27:14.791 INFO:teuthology.orchestra.run.smithi079.stdout:firewalld.service is not enabled 2024-08-20T01:27:14.791 INFO:teuthology.orchestra.run.smithi079.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-08-20T01:27:14.791 INFO:teuthology.orchestra.run.smithi079.stdout:Waiting for mgr to start... 2024-08-20T01:27:14.791 INFO:teuthology.orchestra.run.smithi079.stdout:Waiting for mgr... 2024-08-20T01:27:14.935 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:14 smithi079 bash[18869]: a969c0130e1ca40cb9d6fabbe95f2b94bf6e8ed3a7635eec7047cdd5ebcf7e57 2024-08-20T01:27:14.935 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:14 smithi079 systemd[1]: Started Ceph mgr.x for 28484e9a-5e93-11ef-bccf-c7b262605968. 2024-08-20T01:27:15.502 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:15 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2790361548' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-08-20T01:27:15.765 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-08-20T01:27:15.765 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout { 2024-08-20T01:27:15.765 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "fsid": "28484e9a-5e93-11ef-bccf-c7b262605968", 2024-08-20T01:27:15.765 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "health": { 2024-08-20T01:27:15.765 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-20T01:27:15.765 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-20T01:27:15.765 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-20T01:27:15.766 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-08-20T01:27:15.766 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-20T01:27:15.766 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-20T01:27:15.766 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 0 2024-08-20T01:27:15.766 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ], 2024-08-20T01:27:15.766 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-20T01:27:15.766 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "a" 2024-08-20T01:27:15.766 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ], 2024-08-20T01:27:15.766 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-08-20T01:27:15.766 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-20T01:27:15.766 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-20T01:27:15.766 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-20T01:27:15.767 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-20T01:27:15.767 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-08-20T01:27:15.767 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-20T01:27:15.767 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-20T01:27:15.767 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-20T01:27:15.767 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-20T01:27:15.767 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-20T01:27:15.770 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-20T01:27:15.770 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-20T01:27:15.771 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-20T01:27:15.771 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-08-20T01:27:15.771 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-20T01:27:15.771 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-20T01:27:15.771 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-20T01:27:15.771 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-20T01:27:15.771 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-20T01:27:15.771 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-20T01:27:15.771 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-20T01:27:15.771 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-20T01:27:15.771 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-20T01:27:15.772 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-08-20T01:27:15.772 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-20T01:27:15.772 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-20T01:27:15.772 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "btime": "2024-08-20T01:27:07:792478+0000", 2024-08-20T01:27:15.772 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-20T01:27:15.772 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-20T01:27:15.772 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-08-20T01:27:15.772 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-20T01:27:15.772 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "available": false, 2024-08-20T01:27:15.772 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-20T01:27:15.772 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-20T01:27:15.772 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-20T01:27:15.773 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-20T01:27:15.773 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "restful" 2024-08-20T01:27:15.773 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ], 2024-08-20T01:27:15.773 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-20T01:27:15.773 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-08-20T01:27:15.773 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-20T01:27:15.773 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-20T01:27:15.773 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "modified": "2024-08-20T01:27:07.793151+0000", 2024-08-20T01:27:15.773 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-20T01:27:15.773 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-08-20T01:27:15.773 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-20T01:27:15.773 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout } 2024-08-20T01:27:15.774 INFO:teuthology.orchestra.run.smithi079.stdout:mgr not available, waiting (1/15)... 2024-08-20T01:27:18.435 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:18 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/1364208080' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-08-20T01:27:18.763 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-08-20T01:27:18.763 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout { 2024-08-20T01:27:18.763 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "fsid": "28484e9a-5e93-11ef-bccf-c7b262605968", 2024-08-20T01:27:18.763 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "health": { 2024-08-20T01:27:18.763 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-20T01:27:18.763 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-20T01:27:18.763 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-20T01:27:18.764 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-08-20T01:27:18.764 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-20T01:27:18.764 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-20T01:27:18.764 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 0 2024-08-20T01:27:18.764 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ], 2024-08-20T01:27:18.764 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-20T01:27:18.764 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "a" 2024-08-20T01:27:18.764 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ], 2024-08-20T01:27:18.764 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-08-20T01:27:18.764 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-20T01:27:18.764 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-20T01:27:18.764 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-20T01:27:18.764 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-20T01:27:18.765 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-08-20T01:27:18.765 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-20T01:27:18.765 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-20T01:27:18.765 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-20T01:27:18.765 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-20T01:27:18.765 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-20T01:27:18.765 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-20T01:27:18.765 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-20T01:27:18.765 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-20T01:27:18.768 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-08-20T01:27:18.769 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-20T01:27:18.769 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-20T01:27:18.769 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-20T01:27:18.769 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-20T01:27:18.769 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-20T01:27:18.769 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-20T01:27:18.769 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-20T01:27:18.769 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-20T01:27:18.769 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-20T01:27:18.769 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-08-20T01:27:18.769 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-20T01:27:18.770 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-20T01:27:18.770 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "btime": "2024-08-20T01:27:07:792478+0000", 2024-08-20T01:27:18.770 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-20T01:27:18.770 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-20T01:27:18.770 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-08-20T01:27:18.770 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-20T01:27:18.770 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "available": false, 2024-08-20T01:27:18.770 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-20T01:27:18.770 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-20T01:27:18.770 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-20T01:27:18.770 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-20T01:27:18.771 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "restful" 2024-08-20T01:27:18.771 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ], 2024-08-20T01:27:18.771 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-20T01:27:18.771 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-08-20T01:27:18.771 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-20T01:27:18.771 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-20T01:27:18.771 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "modified": "2024-08-20T01:27:07.793151+0000", 2024-08-20T01:27:18.771 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-20T01:27:18.771 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-08-20T01:27:18.771 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-20T01:27:18.771 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout } 2024-08-20T01:27:18.771 INFO:teuthology.orchestra.run.smithi079.stdout:mgr not available, waiting (2/15)... 2024-08-20T01:27:19.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:19 smithi079 ceph-mon[18656]: Activating manager daemon x 2024-08-20T01:27:19.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:19 smithi079 ceph-mon[18656]: mgrmap e2: x(active, starting, since 0.00315851s) 2024-08-20T01:27:19.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:19 smithi079 ceph-mon[18656]: from='mgr.14100 172.21.15.79:0/3366117615' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-20T01:27:19.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:19 smithi079 ceph-mon[18656]: from='mgr.14100 172.21.15.79:0/3366117615' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-20T01:27:19.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:19 smithi079 ceph-mon[18656]: from='mgr.14100 172.21.15.79:0/3366117615' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-20T01:27:19.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:19 smithi079 ceph-mon[18656]: from='mgr.14100 172.21.15.79:0/3366117615' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T01:27:19.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:19 smithi079 ceph-mon[18656]: from='mgr.14100 172.21.15.79:0/3366117615' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-20T01:27:19.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:19 smithi079 ceph-mon[18656]: Manager daemon x is now available 2024-08-20T01:27:19.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:19 smithi079 ceph-mon[18656]: from='mgr.14100 172.21.15.79:0/3366117615' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-20T01:27:19.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:19 smithi079 ceph-mon[18656]: from='mgr.14100 172.21.15.79:0/3366117615' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-20T01:27:19.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:19 smithi079 ceph-mon[18656]: from='mgr.14100 172.21.15.79:0/3366117615' entity='mgr.x' 2024-08-20T01:27:19.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:19 smithi079 ceph-mon[18656]: from='mgr.14100 172.21.15.79:0/3366117615' entity='mgr.x' 2024-08-20T01:27:19.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:19 smithi079 ceph-mon[18656]: from='mgr.14100 172.21.15.79:0/3366117615' entity='mgr.x' 2024-08-20T01:27:21.849 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:21 smithi079 ceph-mon[18656]: mgrmap e3: x(active, since 1.00714s) 2024-08-20T01:27:21.849 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:21 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2935364389' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-08-20T01:27:22.141 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-08-20T01:27:22.141 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout { 2024-08-20T01:27:22.141 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "fsid": "28484e9a-5e93-11ef-bccf-c7b262605968", 2024-08-20T01:27:22.141 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "health": { 2024-08-20T01:27:22.141 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-20T01:27:22.141 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-20T01:27:22.141 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-20T01:27:22.141 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-08-20T01:27:22.141 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-20T01:27:22.141 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-20T01:27:22.142 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 0 2024-08-20T01:27:22.142 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ], 2024-08-20T01:27:22.142 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-20T01:27:22.142 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "a" 2024-08-20T01:27:22.142 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ], 2024-08-20T01:27:22.142 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-08-20T01:27:22.142 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-20T01:27:22.142 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-20T01:27:22.143 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-20T01:27:22.143 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-20T01:27:22.143 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-08-20T01:27:22.143 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-20T01:27:22.143 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-20T01:27:22.143 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-20T01:27:22.143 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-20T01:27:22.143 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-20T01:27:22.143 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-20T01:27:22.143 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-20T01:27:22.143 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-20T01:27:22.143 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-08-20T01:27:22.144 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-20T01:27:22.144 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-20T01:27:22.144 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-20T01:27:22.144 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-20T01:27:22.144 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-20T01:27:22.144 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-20T01:27:22.144 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-20T01:27:22.144 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-20T01:27:22.144 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-20T01:27:22.144 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-08-20T01:27:22.144 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-20T01:27:22.144 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-20T01:27:22.144 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "btime": "2024-08-20T01:27:07:792478+0000", 2024-08-20T01:27:22.145 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-20T01:27:22.145 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-20T01:27:22.145 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-08-20T01:27:22.145 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-20T01:27:22.145 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-20T01:27:22.145 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-20T01:27:22.145 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-20T01:27:22.145 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-20T01:27:22.145 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-20T01:27:22.145 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "restful" 2024-08-20T01:27:22.146 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ], 2024-08-20T01:27:22.146 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-20T01:27:22.146 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-08-20T01:27:22.146 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-20T01:27:22.146 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-20T01:27:22.146 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "modified": "2024-08-20T01:27:07.793151+0000", 2024-08-20T01:27:22.146 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-20T01:27:22.146 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-08-20T01:27:22.146 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-20T01:27:22.146 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout } 2024-08-20T01:27:22.146 INFO:teuthology.orchestra.run.smithi079.stdout:mgr is available 2024-08-20T01:27:22.739 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:22 smithi079 ceph-mon[18656]: mgrmap e4: x(active, since 2s) 2024-08-20T01:27:23.293 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-08-20T01:27:23.293 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout [global] 2024-08-20T01:27:23.293 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout fsid = 28484e9a-5e93-11ef-bccf-c7b262605968 2024-08-20T01:27:23.294 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-08-20T01:27:23.294 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.79:3300,v1:172.21.15.79:6789] 2024-08-20T01:27:23.294 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-08-20T01:27:23.294 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-08-20T01:27:23.294 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-08-20T01:27:23.294 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-08-20T01:27:23.294 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-08-20T01:27:23.294 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout [mgr] 2024-08-20T01:27:23.294 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-08-20T01:27:23.294 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-08-20T01:27:23.294 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout [osd] 2024-08-20T01:27:23.295 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-08-20T01:27:23.295 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout filestore_flush_min = 0 2024-08-20T01:27:23.295 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-08-20T01:27:23.295 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-08-20T01:27:23.295 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-08-20T01:27:23.295 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-08-20T01:27:23.295 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-08-20T01:27:23.295 INFO:teuthology.orchestra.run.smithi079.stdout:Enabling cephadm module... 2024-08-20T01:27:23.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:23 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/937825962' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-08-20T01:27:24.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:24 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/4288456234' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-08-20T01:27:24.935 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:24 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: ignoring --setuser ceph since I am not root 2024-08-20T01:27:24.935 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:24 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: ignoring --setgroup ceph since I am not root 2024-08-20T01:27:25.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:25 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/4288456234' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-08-20T01:27:25.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:25 smithi079 ceph-mon[18656]: mgrmap e5: x(active, since 5s) 2024-08-20T01:27:26.556 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout { 2024-08-20T01:27:26.556 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-08-20T01:27:26.556 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-20T01:27:26.556 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-08-20T01:27:26.556 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-08-20T01:27:26.556 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout } 2024-08-20T01:27:26.556 INFO:teuthology.orchestra.run.smithi079.stdout:Waiting for the mgr to restart... 2024-08-20T01:27:26.556 INFO:teuthology.orchestra.run.smithi079.stdout:Waiting for mgr epoch 5... 2024-08-20T01:27:26.677 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:26 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/3369001365' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-08-20T01:27:30.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:29 smithi079 ceph-mon[18656]: Active manager daemon x restarted 2024-08-20T01:27:30.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:29 smithi079 ceph-mon[18656]: Activating manager daemon x 2024-08-20T01:27:30.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:29 smithi079 ceph-mon[18656]: osdmap e2: 0 total, 0 up, 0 in 2024-08-20T01:27:30.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:29 smithi079 ceph-mon[18656]: mgrmap e6: x(active, starting, since 0.00357031s) 2024-08-20T01:27:30.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:29 smithi079 ceph-mon[18656]: from='mgr.14118 172.21.15.79:0/4202504586' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T01:27:30.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:29 smithi079 ceph-mon[18656]: from='mgr.14118 172.21.15.79:0/4202504586' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-20T01:27:30.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:29 smithi079 ceph-mon[18656]: from='mgr.14118 172.21.15.79:0/4202504586' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-20T01:27:30.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:29 smithi079 ceph-mon[18656]: from='mgr.14118 172.21.15.79:0/4202504586' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-20T01:27:30.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:29 smithi079 ceph-mon[18656]: from='mgr.14118 172.21.15.79:0/4202504586' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-20T01:27:30.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:29 smithi079 ceph-mon[18656]: Manager daemon x is now available 2024-08-20T01:27:31.255 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout { 2024-08-20T01:27:31.255 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-08-20T01:27:31.255 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "initialized": true 2024-08-20T01:27:31.255 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout } 2024-08-20T01:27:31.256 INFO:teuthology.orchestra.run.smithi079.stdout:mgr epoch 5 is available 2024-08-20T01:27:31.256 INFO:teuthology.orchestra.run.smithi079.stdout:Setting orchestrator backend to cephadm... 2024-08-20T01:27:31.873 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:31 smithi079 ceph-mon[18656]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-08-20T01:27:31.873 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:31 smithi079 ceph-mon[18656]: mgrmap e7: x(active, since 1.00525s) 2024-08-20T01:27:31.873 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:31 smithi079 ceph-mon[18656]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-08-20T01:27:31.873 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:31 smithi079 ceph-mon[18656]: from='mgr.14118 172.21.15.79:0/4202504586' entity='mgr.x' 2024-08-20T01:27:31.873 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:31 smithi079 ceph-mon[18656]: from='mgr.14118 172.21.15.79:0/4202504586' entity='mgr.x' 2024-08-20T01:27:31.873 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:31 smithi079 ceph-mon[18656]: from='mgr.14118 172.21.15.79:0/4202504586' entity='mgr.x' 2024-08-20T01:27:31.874 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:31 smithi079 ceph-mon[18656]: from='mgr.14118 172.21.15.79:0/4202504586' entity='mgr.x' 2024-08-20T01:27:31.874 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:31 smithi079 ceph-mon[18656]: from='mgr.14118 172.21.15.79:0/4202504586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:27:31.874 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:31 smithi079 ceph-mon[18656]: from='mgr.14118 172.21.15.79:0/4202504586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:27:31.874 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:31 smithi079 ceph-mon[18656]: from='mgr.14118 172.21.15.79:0/4202504586' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-20T01:27:31.874 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:31 smithi079 ceph-mon[18656]: from='mgr.14118 172.21.15.79:0/4202504586' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-20T01:27:32.176 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:32 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: 2024-08-20T01:27:32.104+0000 7fd46a3eb640 -1 log_channel(cephadm) log [ERR] : [20/Aug/2024:01:27:32] ENGINE Error in HTTPServer.serve 2024-08-20T01:27:32.176 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:32 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: Traceback (most recent call last): 2024-08-20T01:27:32.176 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:32 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-20T01:27:32.176 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:32 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: self._connections.run(self.expiration_interval) 2024-08-20T01:27:32.176 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:32 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-20T01:27:32.176 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:32 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: self._run(expiration_interval) 2024-08-20T01:27:32.176 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:32 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-20T01:27:32.177 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:32 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: new_conn = self._from_server_socket(self.server.socket) 2024-08-20T01:27:32.177 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:32 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-20T01:27:32.177 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:32 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-20T01:27:32.177 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:32 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-20T01:27:32.177 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:32 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: s = self.context.wrap_socket( 2024-08-20T01:27:32.177 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:32 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-20T01:27:32.177 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:32 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: return self.sslsocket_class._create( 2024-08-20T01:27:32.177 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:32 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-20T01:27:32.177 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:32 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: self.do_handshake() 2024-08-20T01:27:32.177 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:32 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-20T01:27:32.177 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:32 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: self._sslobj.do_handshake() 2024-08-20T01:27:32.178 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:32 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-20T01:27:32.178 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:32 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: 2024-08-20T01:27:32.787 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:32 smithi079 ceph-mon[18656]: Found migration_current of "None". Setting to last migration. 2024-08-20T01:27:32.788 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:32 smithi079 ceph-mon[18656]: from='mgr.14118 172.21.15.79:0/4202504586' entity='mgr.x' 2024-08-20T01:27:32.788 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:32 smithi079 ceph-mon[18656]: from='mgr.14118 172.21.15.79:0/4202504586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:27:32.788 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:32 smithi079 ceph-mon[18656]: mgrmap e8: x(active, since 2s) 2024-08-20T01:27:32.788 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:32 smithi079 ceph-mon[18656]: from='mgr.14118 172.21.15.79:0/4202504586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:27:33.580 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout value unchanged 2024-08-20T01:27:33.580 INFO:teuthology.orchestra.run.smithi079.stdout:Generating ssh key... 2024-08-20T01:27:33.833 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:33 smithi079 ceph-mon[18656]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:27:33.834 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:33 smithi079 ceph-mon[18656]: [20/Aug/2024:01:27:31] ENGINE Bus STARTING 2024-08-20T01:27:33.834 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:33 smithi079 ceph-mon[18656]: [20/Aug/2024:01:27:32] ENGINE Serving on https://172.21.15.79:7150 2024-08-20T01:27:33.834 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:33 smithi079 ceph-mon[18656]: [20/Aug/2024:01:27:32] ENGINE Error in HTTPServer.serve 2024-08-20T01:27:33.834 INFO:journalctl@ceph.mon.a.smithi079.stdout: Traceback (most recent call last): 2024-08-20T01:27:33.834 INFO:journalctl@ceph.mon.a.smithi079.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-20T01:27:33.834 INFO:journalctl@ceph.mon.a.smithi079.stdout: self._connections.run(self.expiration_interval) 2024-08-20T01:27:33.834 INFO:journalctl@ceph.mon.a.smithi079.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-20T01:27:33.834 INFO:journalctl@ceph.mon.a.smithi079.stdout: self._run(expiration_interval) 2024-08-20T01:27:33.834 INFO:journalctl@ceph.mon.a.smithi079.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-20T01:27:33.834 INFO:journalctl@ceph.mon.a.smithi079.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-20T01:27:33.834 INFO:journalctl@ceph.mon.a.smithi079.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-20T01:27:33.835 INFO:journalctl@ceph.mon.a.smithi079.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-20T01:27:33.835 INFO:journalctl@ceph.mon.a.smithi079.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-20T01:27:33.835 INFO:journalctl@ceph.mon.a.smithi079.stdout: s = self.context.wrap_socket( 2024-08-20T01:27:33.835 INFO:journalctl@ceph.mon.a.smithi079.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-20T01:27:33.835 INFO:journalctl@ceph.mon.a.smithi079.stdout: return self.sslsocket_class._create( 2024-08-20T01:27:33.835 INFO:journalctl@ceph.mon.a.smithi079.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-20T01:27:33.835 INFO:journalctl@ceph.mon.a.smithi079.stdout: self.do_handshake() 2024-08-20T01:27:33.835 INFO:journalctl@ceph.mon.a.smithi079.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-20T01:27:33.835 INFO:journalctl@ceph.mon.a.smithi079.stdout: self._sslobj.do_handshake() 2024-08-20T01:27:33.835 INFO:journalctl@ceph.mon.a.smithi079.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-20T01:27:33.835 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:33 smithi079 ceph-mon[18656]: [20/Aug/2024:01:27:32] ENGINE Serving on http://172.21.15.79:8765 2024-08-20T01:27:33.835 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:33 smithi079 ceph-mon[18656]: [20/Aug/2024:01:27:32] ENGINE Bus STARTED 2024-08-20T01:27:34.649 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:34 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: Generating public/private rsa key pair. 2024-08-20T01:27:34.649 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:34 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: Your identification has been saved in /tmp/tmpfnv_coaf/key 2024-08-20T01:27:34.649 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:34 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: Your public key has been saved in /tmp/tmpfnv_coaf/key.pub 2024-08-20T01:27:34.649 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:34 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: The key fingerprint is: 2024-08-20T01:27:34.649 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:34 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: SHA256:T4S5A2q/dc9ewu7wIG8FmWV5yTlGNcnfKVIOHqgu5cM ceph-28484e9a-5e93-11ef-bccf-c7b262605968 2024-08-20T01:27:34.649 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:34 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: The key's randomart image is: 2024-08-20T01:27:34.649 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:34 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: +---[RSA 3072]----+ 2024-08-20T01:27:34.649 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:34 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: | . +o=o| 2024-08-20T01:27:34.650 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:34 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: | + o+.Bo.| 2024-08-20T01:27:34.650 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:34 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: | . + o==o .+| 2024-08-20T01:27:34.650 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:34 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: | . + o+o o .o| 2024-08-20T01:27:34.650 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:34 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: | o = S ... . | 2024-08-20T01:27:34.650 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:34 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: | . o E + .. | 2024-08-20T01:27:34.650 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:34 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: | o + =.o . | 2024-08-20T01:27:34.650 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:34 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: | o +.B o | 2024-08-20T01:27:34.650 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:34 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: | . ..oB | 2024-08-20T01:27:34.650 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:34 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: +----[SHA256]-----+ 2024-08-20T01:27:34.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:34 smithi079 ceph-mon[18656]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:27:34.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:34 smithi079 ceph-mon[18656]: from='mgr.14118 172.21.15.79:0/4202504586' entity='mgr.x' 2024-08-20T01:27:34.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:34 smithi079 ceph-mon[18656]: from='mgr.14118 172.21.15.79:0/4202504586' entity='mgr.x' 2024-08-20T01:27:35.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:35 smithi079 ceph-mon[18656]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:27:35.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:35 smithi079 ceph-mon[18656]: Generating ssh key... 2024-08-20T01:27:36.059 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpajH0+PRlGSQigo4wUccMDBhVquTsum8+UJYdhGzJ3+QId7SEG36YlwuXqNtBI0y3CJAyLG+se9EJguMP5/EYHYNO7FUINKMhegy0YQw/MN8wKcX37SxUo0lUYROzsQg8TWt5qx3xH8Czyzxe/MuSGTxck9Rf7+jAEGWfPN1FCPcXV00jgRebfin997aoh4MhG6mNDrb6W45hhNmrcwyDbXKTEW5EGKP4KwGY0oLWHHdafXZclMbYJI/W2JdfwL+/YJ+JJufXygW7Y+QOzrjDOzabz7CNypolrUu0W2XSCvP9x9HnUoklPzjFUkYPwBUvSgzTpBD7MjxkrQGvmjHWESVRJp2u2+4B3HgjN3zf6JP9mJ3Yg6TY3ioZA3ZeB2/GzXgMDqc1gsto97vIpacp5Inx5UcdudaIjCOm7MCuWHGY/ANMqcq9lvK8m1Wv1Q+E0fREprwvUKO8zksBOJQzbvvBbSw7SqHtzqU2iLaK6Ha2V1+PAqj1yJsi1UklipE= ceph-28484e9a-5e93-11ef-bccf-c7b262605968 2024-08-20T01:27:36.059 INFO:teuthology.orchestra.run.smithi079.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-08-20T01:27:36.059 INFO:teuthology.orchestra.run.smithi079.stdout:Adding key to root@localhost authorized_keys... 2024-08-20T01:27:36.060 INFO:teuthology.orchestra.run.smithi079.stdout:Adding host smithi079... 2024-08-20T01:27:36.906 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:36 smithi079 ceph-mon[18656]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:27:37.673 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:37 smithi079 ceph-mon[18656]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi079", "addr": "172.21.15.79", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:27:38.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:38 smithi079 ceph-mon[18656]: Deploying cephadm binary to smithi079 2024-08-20T01:27:40.592 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout Added host 'smithi079' with addr '172.21.15.79' 2024-08-20T01:27:40.592 INFO:teuthology.orchestra.run.smithi079.stdout:Deploying unmanaged mon service... 2024-08-20T01:27:40.840 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:40 smithi079 ceph-mon[18656]: from='mgr.14118 172.21.15.79:0/4202504586' entity='mgr.x' 2024-08-20T01:27:40.840 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:40 smithi079 ceph-mon[18656]: Added host smithi079 2024-08-20T01:27:40.840 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:40 smithi079 ceph-mon[18656]: from='mgr.14118 172.21.15.79:0/4202504586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:27:41.893 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-08-20T01:27:41.893 INFO:teuthology.orchestra.run.smithi079.stdout:Deploying unmanaged mgr service... 2024-08-20T01:27:42.503 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:42 smithi079 ceph-mon[18656]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:27:42.504 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:42 smithi079 ceph-mon[18656]: Saving service mon spec with placement count:5 2024-08-20T01:27:42.504 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:42 smithi079 ceph-mon[18656]: from='mgr.14118 172.21.15.79:0/4202504586' entity='mgr.x' 2024-08-20T01:27:43.208 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-08-20T01:27:43.746 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:43 smithi079 ceph-mon[18656]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:27:43.746 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:43 smithi079 ceph-mon[18656]: Saving service mgr spec with placement count:2 2024-08-20T01:27:43.746 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:43 smithi079 ceph-mon[18656]: from='mgr.14118 172.21.15.79:0/4202504586' entity='mgr.x' 2024-08-20T01:27:44.922 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:44 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/689845254' entity='client.admin' 2024-08-20T01:27:44.923 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:44 smithi079 ceph-mon[18656]: from='mgr.14118 172.21.15.79:0/4202504586' entity='mgr.x' 2024-08-20T01:27:44.923 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:44 smithi079 ceph-mon[18656]: from='mgr.14118 172.21.15.79:0/4202504586' entity='mgr.x' 2024-08-20T01:27:46.558 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:46 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2805242335' entity='client.admin' 2024-08-20T01:27:46.558 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:46 smithi079 ceph-mon[18656]: from='mgr.14118 172.21.15.79:0/4202504586' entity='mgr.x' 2024-08-20T01:27:46.560 INFO:teuthology.orchestra.run.smithi079.stdout:Enabling the dashboard module... 2024-08-20T01:27:47.672 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:47 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2982024734' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-08-20T01:27:47.673 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:47 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: ignoring --setuser ceph since I am not root 2024-08-20T01:27:47.673 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:47 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: ignoring --setgroup ceph since I am not root 2024-08-20T01:27:48.644 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:48 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2982024734' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-08-20T01:27:48.644 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:48 smithi079 ceph-mon[18656]: mgrmap e9: x(active, since 17s) 2024-08-20T01:27:49.282 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout { 2024-08-20T01:27:49.283 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-08-20T01:27:49.283 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-20T01:27:49.283 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-08-20T01:27:49.283 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-08-20T01:27:49.283 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout } 2024-08-20T01:27:49.283 INFO:teuthology.orchestra.run.smithi079.stdout:Waiting for the mgr to restart... 2024-08-20T01:27:49.283 INFO:teuthology.orchestra.run.smithi079.stdout:Waiting for mgr epoch 9... 2024-08-20T01:27:49.553 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:49 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/4165672429' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-08-20T01:27:52.765 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:52 smithi079 ceph-mon[18656]: Active manager daemon x restarted 2024-08-20T01:27:52.765 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:52 smithi079 ceph-mon[18656]: Activating manager daemon x 2024-08-20T01:27:52.766 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:52 smithi079 ceph-mon[18656]: osdmap e3: 0 total, 0 up, 0 in 2024-08-20T01:27:52.766 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:52 smithi079 ceph-mon[18656]: mgrmap e10: x(active, starting, since 0.00382629s) 2024-08-20T01:27:52.766 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:52 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T01:27:52.766 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:52 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-20T01:27:52.766 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:52 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-20T01:27:52.766 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:52 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-20T01:27:52.766 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:52 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-20T01:27:52.766 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:52 smithi079 ceph-mon[18656]: Manager daemon x is now available 2024-08-20T01:27:53.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:53 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:27:53.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:53 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-20T01:27:53.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:53 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-20T01:27:53.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:53 smithi079 ceph-mon[18656]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-08-20T01:27:53.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:53 smithi079 ceph-mon[18656]: mgrmap e11: x(active, since 1.00675s) 2024-08-20T01:27:54.181 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:53 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: 2024-08-20T01:27:53.768+0000 7f27c914b640 -1 log_channel(cephadm) log [ERR] : [20/Aug/2024:01:27:53] ENGINE Error in HTTPServer.serve 2024-08-20T01:27:54.181 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:53 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: Traceback (most recent call last): 2024-08-20T01:27:54.182 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:53 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-20T01:27:54.182 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:53 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: self._connections.run(self.expiration_interval) 2024-08-20T01:27:54.182 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:53 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-20T01:27:54.182 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:53 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: self._run(expiration_interval) 2024-08-20T01:27:54.182 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:53 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-20T01:27:54.182 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:53 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: new_conn = self._from_server_socket(self.server.socket) 2024-08-20T01:27:54.182 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:53 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-20T01:27:54.182 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:53 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-20T01:27:54.182 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:53 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-20T01:27:54.182 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:53 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: s = self.context.wrap_socket( 2024-08-20T01:27:54.183 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:53 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-20T01:27:54.183 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:53 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: return self.sslsocket_class._create( 2024-08-20T01:27:54.183 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:53 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-20T01:27:54.183 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:53 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: self.do_handshake() 2024-08-20T01:27:54.183 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:53 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-20T01:27:54.183 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:53 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: self._sslobj.do_handshake() 2024-08-20T01:27:54.183 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:53 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-20T01:27:54.183 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:27:53 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: 2024-08-20T01:27:54.501 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout { 2024-08-20T01:27:54.501 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-08-20T01:27:54.501 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "initialized": true 2024-08-20T01:27:54.501 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout } 2024-08-20T01:27:54.501 INFO:teuthology.orchestra.run.smithi079.stdout:mgr epoch 9 is available 2024-08-20T01:27:54.501 INFO:teuthology.orchestra.run.smithi079.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-08-20T01:27:55.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:55 smithi079 ceph-mon[18656]: [20/Aug/2024:01:27:53] ENGINE Bus STARTING 2024-08-20T01:27:55.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:55 smithi079 ceph-mon[18656]: [20/Aug/2024:01:27:53] ENGINE Serving on https://172.21.15.79:7150 2024-08-20T01:27:55.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:55 smithi079 ceph-mon[18656]: [20/Aug/2024:01:27:53] ENGINE Error in HTTPServer.serve 2024-08-20T01:27:55.186 INFO:journalctl@ceph.mon.a.smithi079.stdout: Traceback (most recent call last): 2024-08-20T01:27:55.186 INFO:journalctl@ceph.mon.a.smithi079.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-20T01:27:55.186 INFO:journalctl@ceph.mon.a.smithi079.stdout: self._connections.run(self.expiration_interval) 2024-08-20T01:27:55.186 INFO:journalctl@ceph.mon.a.smithi079.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-20T01:27:55.186 INFO:journalctl@ceph.mon.a.smithi079.stdout: self._run(expiration_interval) 2024-08-20T01:27:55.186 INFO:journalctl@ceph.mon.a.smithi079.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-20T01:27:55.186 INFO:journalctl@ceph.mon.a.smithi079.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-20T01:27:55.186 INFO:journalctl@ceph.mon.a.smithi079.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-20T01:27:55.187 INFO:journalctl@ceph.mon.a.smithi079.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-20T01:27:55.187 INFO:journalctl@ceph.mon.a.smithi079.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-20T01:27:55.187 INFO:journalctl@ceph.mon.a.smithi079.stdout: s = self.context.wrap_socket( 2024-08-20T01:27:55.187 INFO:journalctl@ceph.mon.a.smithi079.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-20T01:27:55.187 INFO:journalctl@ceph.mon.a.smithi079.stdout: return self.sslsocket_class._create( 2024-08-20T01:27:55.187 INFO:journalctl@ceph.mon.a.smithi079.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-20T01:27:55.187 INFO:journalctl@ceph.mon.a.smithi079.stdout: self.do_handshake() 2024-08-20T01:27:55.187 INFO:journalctl@ceph.mon.a.smithi079.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-20T01:27:55.188 INFO:journalctl@ceph.mon.a.smithi079.stdout: self._sslobj.do_handshake() 2024-08-20T01:27:55.188 INFO:journalctl@ceph.mon.a.smithi079.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-20T01:27:55.188 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:55 smithi079 ceph-mon[18656]: [20/Aug/2024:01:27:53] ENGINE Serving on http://172.21.15.79:8765 2024-08-20T01:27:55.188 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:55 smithi079 ceph-mon[18656]: [20/Aug/2024:01:27:53] ENGINE Bus STARTED 2024-08-20T01:27:55.188 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:55 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:27:55.188 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:55 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:27:56.249 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:56 smithi079 ceph-mon[18656]: mgrmap e12: x(active, since 2s) 2024-08-20T01:27:56.249 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:56 smithi079 ceph-mon[18656]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:27:56.839 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+zCCAuOgAwIBAgIUJC4akNTNe3AAnevfgRVcnQJxg1wwDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDgyMDAxMjc1NVoXDTM0\nMDgyMTAxMjc1NVowFzEVMBMGA1UEAwwMMTcyLjIxLjE1Ljc5MIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEAs+P/N6EAC6a3jfrETZ2jSko/uxU6s24OlSRd\nDHqgGYXJ6I3tntd3yH1DnvCsM27P5dFwq34ibm1DOK4Ccmb9pgwlh1INGS8KjUpl\na+kI3x0cIgbyMXqFE3k7qrHigMd+Ux0ZtRP9AiLl9rbHkYdf9x/1+W9YMzCE8r44\n8PHKo2hla+NHCKeAOxRr79mGKjtzrXlmfX9CffLNmaX6vNdZq3BMpauXPkerAPuM\nFHTYeN17v7oR7KBCyshdNl2Fuwi/hn120WXxWGqveyM7bl6sCBd5YQIEEAC4LLxF\n+JZxv1YoAlkSbKpPYYbKaywfWw5HaKgbhh48uVT0xoxcBGFt0+1d9YvLfgi9+cGx\nAX6lHNF8zia7PvH6TQz4ngJChEtKHgeuFoh2YRL3zC32wzB/DEmRrNEKsnhDnLiP\nuyRTdR0VF/3m836Lt7n3B8L9Zcg57sIFVyGEgntYrOWgVNRC72NUvjMlVpE/f/Ed\nmBJJ0HRpKJwHtSvN7jrlodQ5gyNTEItwemNlFvNOg9UV2BOIgSPJgSw3L+fJWjM1\nRoE1ODT58eZO23EE7i3TGeNjAYGbe/hznxdgVMETRDU4zMHccaPDq4peqK801oTw\n6BMyNUSR2iqV1ycGb9muZescPaxqDA79+8Y87tqqWOZ0FFK0WHfuyIUi2J6w/0OW\nhULXyh8CAwEAAaM/MD0wLQYDVR0RBCYwJIIJc21pdGhpMDc5ghFkYXNoYm9hcmRf\nc2VydmVyc4cErBUPTzAMBgNVHRMBAf8EAjAAMA0GCSqGSIb3DQEBCwUAA4ICAQAh\nLqQ0GBvYWC8PkSYHlLsxlTOTDzllQoYAGO4ap8qc/Cy4iaF37mv8lBdut8kX1NZ0\nTtIYd/6u1mFfimzrToqjShJPZqd5xeU3bw05yIKyKpjPnFZSUnfW1e1DsijhdgCy\ntUXVvbt21DMROxLaiEMiqcrS+AAsoip6sjNUzNc04aDPbp6eT+IJA6a50nQaDttV\nnReO5ohnvrGM4RGIZIeXthQACc63cfZ5ScE1jD98YvUdaJD5o7Q4d0voRAdgoSu8\nCCUNNXBwDMNSbz5saoalPJv8/hqwSijsksY8enb/QHYo4fOWRcNFWpUiBiYDRCzC\nRB0B/NYCAcHEhDkNuGp/AqUHevWg2xIearbuvcX3wGvAg7hxritO9S47wpywvC7W\nQQ387XIwssxYOQ8m0gcKlds6/LpO4YBKh5UsuiHS7No75brfUNBLd4dN23yB/6rW\nEJT6upeQu3I7jioSerc0volYMXJFcg4g7lbbn06jdqpbLiS5FH7DkDwOkYNTmene\nKRHrS7py8Bkp56z9Ee8R7bCtlL1lWUtmoqGu1a/O6V3PCXMgqDQdB7aV2slk5itT\nAMdKWWMPrmOfX0YXTDaUW7Spq7k9cM+rQ0FWxa9cRQovzH75hYkMSiT5EmGWrosl\n3zwUrd0ttGUM0u0ltR69NxTjFh/tu2irv7WNyq+pig==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJJwIBAAKCAgEAs+P/N6EAC6a3jfrETZ2jSko/uxU6s24OlSRdDHqgGYXJ6I3t\nntd3yH1DnvCsM27P5dFwq34ibm1DOK4Ccmb9pgwlh1INGS8KjUpla+kI3x0cIgby\nMXqFE3k7qrHigMd+Ux0ZtRP9AiLl9rbHkYdf9x/1+W9YMzCE8r448PHKo2hla+NH\nCKeAOxRr79mGKjtzrXlmfX9CffLNmaX6vNdZq3BMpauXPkerAPuMFHTYeN17v7oR\n7KBCyshdNl2Fuwi/hn120WXxWGqveyM7bl6sCBd5YQIEEAC4LLxF+JZxv1YoAlkS\nbKpPYYbKaywfWw5HaKgbhh48uVT0xoxcBGFt0+1d9YvLfgi9+cGxAX6lHNF8zia7\nPvH6TQz4ngJChEtKHgeuFoh2YRL3zC32wzB/DEmRrNEKsnhDnLiPuyRTdR0VF/3m\n836Lt7n3B8L9Zcg57sIFVyGEgntYrOWgVNRC72NUvjMlVpE/f/EdmBJJ0HRpKJwH\ntSvN7jrlodQ5gyNTEItwemNlFvNOg9UV2BOIgSPJgSw3L+fJWjM1RoE1ODT58eZO\n23EE7i3TGeNjAYGbe/hznxdgVMETRDU4zMHccaPDq4peqK801oTw6BMyNUSR2iqV\n1ycGb9muZescPaxqDA79+8Y87tqqWOZ0FFK0WHfuyIUi2J6w/0OWhULXyh8CAwEA\nAQKCAgBVjsDZ8mcVI4v1qSkoSStasAmzrxsmL9gbsxnWT5RJz0oCo0461/wOjRVW\nSN198NxMT9qoletGXg00rf5X7wgAq5JF1A6KxcbdAF9QfZtMkonI3Ujfo4gbhPON\n8eDqovdADH0nlIQnOfXp63DrlFleLgNNSVnHrvHsifCHGFjqc0KZl5U3VoM0ljfn\n8atP9srD3ROT6Kz1Pj/vLfQdUMdDNLwfp4bdhjSc2Qb8y74RbjXnMFZKFsbtr3I1\n4zExja2aB541ZajuBn/DrzQbAEgN6Sw/qTfJbK4sCLe2zcb328BXrYmHyVDL79Hi\nOzAGnLn12s6McWEsPG3W6Pby1mvnLb+OBdG43urjbdQev+Q0NnI26GYsLSLrDUQd\n48jvxFB99ipvNLS2ROef31IqMWaAgEAqeYUtnsfSmSSlNBse9TI31cuJa/xES3rE\npfAMxDoztKOxdNbgKQhvSkXFzoc+FQsKDLQNYvWuDBc7PqNn2CUT0JmbnS/uK6jH\nZTwgqrmbhymMbSN+qcNlb68OJEZ/m5fdwR5v7X5tIkL2ogOFWT3sEgFESqCRYpKm\nQ0E+zigQ9jTWcquW27k2u3gW+orNn6s+VmodUxHJCHSdLyv+C4/YqTPoYQGQiSxI\nz6/TKGsZrcSMXBklsBV2XJVkKj6ZsND3WN3LFQR95o9oR/WWMQKCAQEA2NDJOG3P\nhb+vCM8YRBjpPtqFwI+QyxwBdCtrB3h/ZztvomMeY4pUb2Di1jtv3hvOquAvLkD+\noKICKASibVqa5QwP7N7WxPaX6OG5TATAFJ87PEi/zbEDRZ8NZhdQzCTmdHGAL4cf\n0kkid1DjxqkGIX5US2LHnMnbkfDtOcIx/fytAOrE7LPVAxIuikQ+xSze6/pD6lln\nxbtzfwcY5tU1QiKGdvKPxo4/Iwq6GWLUDGNg9t/khF6qbht64KFv26nPvE/UX2U0\nxlpdAjUUAziH5bmgWe69JU5UGRgi94IW7W/6CAX7xNl0eTXd4Ug+p9M6vssvqwKp\nymgY7XIhWQe53QKCAQEA1GbWLRhoSPp+n2SXircjZ3qrIYzV7MsTRTuOaGjpdyq8\nErt1xxjeON7NS7DuiP+iSfqMQfWM+oZXdM5TVUigAJqoCiu2wYTTzI6tc2at+mBO\npKOXAs9mC8Brt6u0+HzO5cdGsG+HwDweSWGtdpfiKWrjHhbwfg0x0tWima55+Vij\nGoVI/y1XcjsfzNfkNuE+fqSaRRnHDKooNIyWdXsacrEBOYmtpexHGumt6YKIwkAL\n6IugGXhIHk4vCPFKtduSsJDht1kFjLXoz8ZYEFwf/sDM6wtzpxBzk4o838mALxDr\nEuzQFdfTVYUuo4EDlNAZaG62SfYZjQQAWMJzhfW6KwKCAQA7ZadagCrT91laTnHV\nZgWwJGl0AWCnY/q5+pMNruMoQs4obIMMvf63rJE4I3xYGsIZaeVDBKc9FmUE1ZAx\n6Rp6GT3bpIit2Ohw8jWzL7H3dE/kCgIRtaax0gr3pveJlapUyCtX2erLzyFUEqLz\n76YwUs2BAYSx3VL7vkcfBaZwcGJs1+Qu/G0ktDxvwJZ5qftAJoWok+mr79iKOkWG\nJ265uX+g4n6k5J9DWFL3VW3GHwuXVmriIJUMKRcWpuNgCDtS2YPSxoUYufS1ABmF\ncF06gAn/2TmUGMtNPKGHsOnbDkwvGoSIvxH7ithIOWSA0YtMbZmXfdlKDA6YLiYY\nn9c5AoIBAD4+3OleS8GHV3BSxG5seT2sH1a3tUGtybnyWCuVA0ZfCbrboQp16Tn1\nYWibM2yGrgLMICp8UZJhqGOcy6Mko29J45EHeol/6an67i3xm27SpnltT6YNLbSn\n8WlkMqbXvLJuEfNG3BukAqQysekdXbQRlPmOc3AdYcqNvRcYoLpIFZSCFwBhQ01A\nsnMPmdvTasMmbeduRH0bqKitwrIvH3MZGGjKRk9nzPbAIK1cCcQTjOnbcVHFhC0N\ncI9IV0KwVG7WJq/asNupu86YK9qvhNjdm7AOLRh6o8RLMMfMf3pLlPh42gpss4xO\neXqFJo2H5spKF7XZH2fKEmfwpHZPqv0CggEAcMfllyhW8rGn8G5HAM/UQ7p5xlMr\nm/eh3Cbxr1cTmzymE/iLH5a5r5eEOl6+lh3YQFENdyyNn7eDqOGtqCjf+THjxgrv\nTEjssIaSC7pSBBz2l9EtDqZpf90lXdssJSv7HiNnM3I8jQXtM0oMOqAkt1p52DC1\npx/TeVbuYJ08i522Vfh5uFZCoNxcYrwCllMQZ8f+x8JwnBvYwC+BdOCmwveWkNXY\npiS1iLjsAcTIpUbtj17JzqKD5VRjA69/oCuDNazJ6Q6OP1u9cGgFs4X89RUYxLgf\n9ZGg3FwazoaAKGFb6x6Xf/QwwVUYpCiN8WTmFaadXz+17N5J+vvmUn24Mw==\n-----END RSA PRIVATE KEY-----\n"} 2024-08-20T01:27:58.003 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-08-20T01:27:58.614 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:58 smithi079 ceph-mon[18656]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:27:58.615 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:58 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:27:59.192 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-08-20T01:27:59.192 INFO:teuthology.orchestra.run.smithi079.stdout:Creating initial admin user... 2024-08-20T01:27:59.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:59 smithi079 ceph-mon[18656]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:27:59.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:27:59 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:00.548 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$aTrjsDlZ05eDilafouv7hePephun81J8g.EoT4oRfXdwxplVrEpUO", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1724117279, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-08-20T01:28:00.548 INFO:teuthology.orchestra.run.smithi079.stdout:Fetching dashboard port number... 2024-08-20T01:28:01.419 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:00 smithi079 ceph-mon[18656]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:28:01.419 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:00 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:01.680 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 8443 2024-08-20T01:28:01.689 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-20T01:28:01.689 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout disabled 2024-08-20T01:28:01.696 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-20T01:28:01.696 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout inactive 2024-08-20T01:28:01.697 INFO:teuthology.orchestra.run.smithi079.stdout:firewalld.service is not enabled 2024-08-20T01:28:01.697 INFO:teuthology.orchestra.run.smithi079.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-08-20T01:28:01.698 INFO:teuthology.orchestra.run.smithi079.stdout:Ceph Dashboard is now available at: 2024-08-20T01:28:01.698 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:28:01.698 INFO:teuthology.orchestra.run.smithi079.stdout: URL: https://smithi079:8443/ 2024-08-20T01:28:01.698 INFO:teuthology.orchestra.run.smithi079.stdout: User: admin 2024-08-20T01:28:01.698 INFO:teuthology.orchestra.run.smithi079.stdout: Password: 15jrzjik6g 2024-08-20T01:28:01.698 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:28:01.699 INFO:teuthology.orchestra.run.smithi079.stdout:Saving cluster configuration to /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/config directory 2024-08-20T01:28:02.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:01 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/1242600598' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-08-20T01:28:02.986 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-08-20T01:28:02.987 INFO:teuthology.orchestra.run.smithi079.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-08-20T01:28:02.987 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:28:02.987 INFO:teuthology.orchestra.run.smithi079.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-08-20T01:28:02.987 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:28:02.987 INFO:teuthology.orchestra.run.smithi079.stdout:Or, if you are only running a single cluster on this host: 2024-08-20T01:28:02.987 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:28:02.987 INFO:teuthology.orchestra.run.smithi079.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-08-20T01:28:02.987 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:28:02.987 INFO:teuthology.orchestra.run.smithi079.stdout:Please consider enabling telemetry to help improve Ceph: 2024-08-20T01:28:02.987 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:28:02.987 INFO:teuthology.orchestra.run.smithi079.stdout: ceph telemetry on 2024-08-20T01:28:02.988 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:28:02.988 INFO:teuthology.orchestra.run.smithi079.stdout:For more information see: 2024-08-20T01:28:02.988 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:28:02.988 INFO:teuthology.orchestra.run.smithi079.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-08-20T01:28:02.988 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:28:02.988 INFO:teuthology.orchestra.run.smithi079.stdout:Bootstrap complete. 2024-08-20T01:28:03.025 INFO:tasks.cephadm:Fetching config... 2024-08-20T01:28:03.026 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-08-20T01:28:03.026 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-08-20T01:28:03.042 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-08-20T01:28:03.043 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-08-20T01:28:03.043 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-08-20T01:28:03.102 INFO:tasks.cephadm:Fetching mon keyring... 2024-08-20T01:28:03.102 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-08-20T01:28:03.102 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/keyring of=/dev/stdout 2024-08-20T01:28:03.167 INFO:tasks.cephadm:Fetching pub ssh key... 2024-08-20T01:28:03.167 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-08-20T01:28:03.167 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-08-20T01:28:03.223 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-08-20T01:28:03.224 DEBUG:teuthology.orchestra.run.smithi079:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpajH0+PRlGSQigo4wUccMDBhVquTsum8+UJYdhGzJ3+QId7SEG36YlwuXqNtBI0y3CJAyLG+se9EJguMP5/EYHYNO7FUINKMhegy0YQw/MN8wKcX37SxUo0lUYROzsQg8TWt5qx3xH8Czyzxe/MuSGTxck9Rf7+jAEGWfPN1FCPcXV00jgRebfin997aoh4MhG6mNDrb6W45hhNmrcwyDbXKTEW5EGKP4KwGY0oLWHHdafXZclMbYJI/W2JdfwL+/YJ+JJufXygW7Y+QOzrjDOzabz7CNypolrUu0W2XSCvP9x9HnUoklPzjFUkYPwBUvSgzTpBD7MjxkrQGvmjHWESVRJp2u2+4B3HgjN3zf6JP9mJ3Yg6TY3ioZA3ZeB2/GzXgMDqc1gsto97vIpacp5Inx5UcdudaIjCOm7MCuWHGY/ANMqcq9lvK8m1Wv1Q+E0fREprwvUKO8zksBOJQzbvvBbSw7SqHtzqU2iLaK6Ha2V1+PAqj1yJsi1UklipE= ceph-28484e9a-5e93-11ef-bccf-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-20T01:28:03.298 INFO:teuthology.orchestra.run.smithi079.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpajH0+PRlGSQigo4wUccMDBhVquTsum8+UJYdhGzJ3+QId7SEG36YlwuXqNtBI0y3CJAyLG+se9EJguMP5/EYHYNO7FUINKMhegy0YQw/MN8wKcX37SxUo0lUYROzsQg8TWt5qx3xH8Czyzxe/MuSGTxck9Rf7+jAEGWfPN1FCPcXV00jgRebfin997aoh4MhG6mNDrb6W45hhNmrcwyDbXKTEW5EGKP4KwGY0oLWHHdafXZclMbYJI/W2JdfwL+/YJ+JJufXygW7Y+QOzrjDOzabz7CNypolrUu0W2XSCvP9x9HnUoklPzjFUkYPwBUvSgzTpBD7MjxkrQGvmjHWESVRJp2u2+4B3HgjN3zf6JP9mJ3Yg6TY3ioZA3ZeB2/GzXgMDqc1gsto97vIpacp5Inx5UcdudaIjCOm7MCuWHGY/ANMqcq9lvK8m1Wv1Q+E0fREprwvUKO8zksBOJQzbvvBbSw7SqHtzqU2iLaK6Ha2V1+PAqj1yJsi1UklipE= ceph-28484e9a-5e93-11ef-bccf-c7b262605968 2024-08-20T01:28:03.310 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpajH0+PRlGSQigo4wUccMDBhVquTsum8+UJYdhGzJ3+QId7SEG36YlwuXqNtBI0y3CJAyLG+se9EJguMP5/EYHYNO7FUINKMhegy0YQw/MN8wKcX37SxUo0lUYROzsQg8TWt5qx3xH8Czyzxe/MuSGTxck9Rf7+jAEGWfPN1FCPcXV00jgRebfin997aoh4MhG6mNDrb6W45hhNmrcwyDbXKTEW5EGKP4KwGY0oLWHHdafXZclMbYJI/W2JdfwL+/YJ+JJufXygW7Y+QOzrjDOzabz7CNypolrUu0W2XSCvP9x9HnUoklPzjFUkYPwBUvSgzTpBD7MjxkrQGvmjHWESVRJp2u2+4B3HgjN3zf6JP9mJ3Yg6TY3ioZA3ZeB2/GzXgMDqc1gsto97vIpacp5Inx5UcdudaIjCOm7MCuWHGY/ANMqcq9lvK8m1Wv1Q+E0fREprwvUKO8zksBOJQzbvvBbSw7SqHtzqU2iLaK6Ha2V1+PAqj1yJsi1UklipE= ceph-28484e9a-5e93-11ef-bccf-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-20T01:28:03.353 INFO:teuthology.orchestra.run.smithi081.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpajH0+PRlGSQigo4wUccMDBhVquTsum8+UJYdhGzJ3+QId7SEG36YlwuXqNtBI0y3CJAyLG+se9EJguMP5/EYHYNO7FUINKMhegy0YQw/MN8wKcX37SxUo0lUYROzsQg8TWt5qx3xH8Czyzxe/MuSGTxck9Rf7+jAEGWfPN1FCPcXV00jgRebfin997aoh4MhG6mNDrb6W45hhNmrcwyDbXKTEW5EGKP4KwGY0oLWHHdafXZclMbYJI/W2JdfwL+/YJ+JJufXygW7Y+QOzrjDOzabz7CNypolrUu0W2XSCvP9x9HnUoklPzjFUkYPwBUvSgzTpBD7MjxkrQGvmjHWESVRJp2u2+4B3HgjN3zf6JP9mJ3Yg6TY3ioZA3ZeB2/GzXgMDqc1gsto97vIpacp5Inx5UcdudaIjCOm7MCuWHGY/ANMqcq9lvK8m1Wv1Q+E0fREprwvUKO8zksBOJQzbvvBbSw7SqHtzqU2iLaK6Ha2V1+PAqj1yJsi1UklipE= ceph-28484e9a-5e93-11ef-bccf-c7b262605968 2024-08-20T01:28:03.366 DEBUG:teuthology.orchestra.run.smithi175:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpajH0+PRlGSQigo4wUccMDBhVquTsum8+UJYdhGzJ3+QId7SEG36YlwuXqNtBI0y3CJAyLG+se9EJguMP5/EYHYNO7FUINKMhegy0YQw/MN8wKcX37SxUo0lUYROzsQg8TWt5qx3xH8Czyzxe/MuSGTxck9Rf7+jAEGWfPN1FCPcXV00jgRebfin997aoh4MhG6mNDrb6W45hhNmrcwyDbXKTEW5EGKP4KwGY0oLWHHdafXZclMbYJI/W2JdfwL+/YJ+JJufXygW7Y+QOzrjDOzabz7CNypolrUu0W2XSCvP9x9HnUoklPzjFUkYPwBUvSgzTpBD7MjxkrQGvmjHWESVRJp2u2+4B3HgjN3zf6JP9mJ3Yg6TY3ioZA3ZeB2/GzXgMDqc1gsto97vIpacp5Inx5UcdudaIjCOm7MCuWHGY/ANMqcq9lvK8m1Wv1Q+E0fREprwvUKO8zksBOJQzbvvBbSw7SqHtzqU2iLaK6Ha2V1+PAqj1yJsi1UklipE= ceph-28484e9a-5e93-11ef-bccf-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-20T01:28:03.407 INFO:teuthology.orchestra.run.smithi175.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpajH0+PRlGSQigo4wUccMDBhVquTsum8+UJYdhGzJ3+QId7SEG36YlwuXqNtBI0y3CJAyLG+se9EJguMP5/EYHYNO7FUINKMhegy0YQw/MN8wKcX37SxUo0lUYROzsQg8TWt5qx3xH8Czyzxe/MuSGTxck9Rf7+jAEGWfPN1FCPcXV00jgRebfin997aoh4MhG6mNDrb6W45hhNmrcwyDbXKTEW5EGKP4KwGY0oLWHHdafXZclMbYJI/W2JdfwL+/YJ+JJufXygW7Y+QOzrjDOzabz7CNypolrUu0W2XSCvP9x9HnUoklPzjFUkYPwBUvSgzTpBD7MjxkrQGvmjHWESVRJp2u2+4B3HgjN3zf6JP9mJ3Yg6TY3ioZA3ZeB2/GzXgMDqc1gsto97vIpacp5Inx5UcdudaIjCOm7MCuWHGY/ANMqcq9lvK8m1Wv1Q+E0fREprwvUKO8zksBOJQzbvvBbSw7SqHtzqU2iLaK6Ha2V1+PAqj1yJsi1UklipE= ceph-28484e9a-5e93-11ef-bccf-c7b262605968 2024-08-20T01:28:03.420 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-08-20T01:28:03.588 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:03 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/525910402' entity='client.admin' 2024-08-20T01:28:03.679 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:05.382 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:05 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/3423966057' entity='client.admin' 2024-08-20T01:28:05.382 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:05 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:05.382 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:05 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:05.382 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:05 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi079", "name": "osd_memory_target"} : dispatch 2024-08-20T01:28:05.382 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:05 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:05.382 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:05 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:28:05.382 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:05 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:05.408 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-08-20T01:28:05.408 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-08-20T01:28:05.647 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:06.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:06 smithi079 ceph-mon[18656]: mgrmap e13: x(active, since 12s) 2024-08-20T01:28:06.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:06 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:06.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:06 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:28:06.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:06 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:06.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:06 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:28:07.181 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi081 2024-08-20T01:28:07.181 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-08-20T01:28:07.181 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/etc/ceph/ceph.conf 2024-08-20T01:28:07.201 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-08-20T01:28:07.201 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-20T01:28:07.260 INFO:tasks.cephadm:Adding host smithi081 to orchestrator... 2024-08-20T01:28:07.260 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph orch host add smithi081 2024-08-20T01:28:07.435 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:07 smithi079 ceph-mon[18656]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:28:07.435 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:07 smithi079 ceph-mon[18656]: Updating smithi079:/etc/ceph/ceph.conf 2024-08-20T01:28:07.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:07 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:07.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:07 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:07.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:07 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:07.497 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:08.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:08 smithi079 ceph-mon[18656]: Updating smithi079:/var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T01:28:08.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:08 smithi079 ceph-mon[18656]: Updating smithi079:/etc/ceph/ceph.client.admin.keyring 2024-08-20T01:28:08.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:08 smithi079 ceph-mon[18656]: Updating smithi079:/var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-20T01:28:09.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:09 smithi079 ceph-mon[18656]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi081", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:28:10.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:10 smithi079 ceph-mon[18656]: Deploying cephadm binary to smithi081 2024-08-20T01:28:11.290 INFO:teuthology.orchestra.run.smithi079.stdout:Added host 'smithi081' with addr '172.21.15.81' 2024-08-20T01:28:11.916 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph orch host ls --format=json 2024-08-20T01:28:12.154 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:12.551 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:12 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:12.552 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:12 smithi079 ceph-mon[18656]: Added host smithi081 2024-08-20T01:28:12.552 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:12 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:28:12.552 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:12 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:12.552 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:12 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:12.822 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:28:12.822 INFO:teuthology.orchestra.run.smithi079.stdout:[{"addr": "172.21.15.79", "hostname": "smithi079", "labels": [], "status": ""}, {"addr": "172.21.15.81", "hostname": "smithi081", "labels": [], "status": ""}] 2024-08-20T01:28:13.405 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:13 smithi079 ceph-mon[18656]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:13.405 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:13 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:13.433 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi175 2024-08-20T01:28:13.434 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-08-20T01:28:13.434 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/etc/ceph/ceph.conf 2024-08-20T01:28:13.453 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-08-20T01:28:13.453 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-20T01:28:13.513 INFO:tasks.cephadm:Adding host smithi175 to orchestrator... 2024-08-20T01:28:13.513 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph orch host add smithi175 2024-08-20T01:28:13.748 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:14.435 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:14 smithi079 ceph-mon[18656]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:28:15.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:15 smithi079 ceph-mon[18656]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi175", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:28:15.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:15 smithi079 ceph-mon[18656]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:16.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:16 smithi079 ceph-mon[18656]: Deploying cephadm binary to smithi175 2024-08-20T01:28:16.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:16 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:16.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:16 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:16.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:16 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:16.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:16 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:16.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:16 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi081", "name": "osd_memory_target"} : dispatch 2024-08-20T01:28:16.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:16 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:16.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:16 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:28:17.519 INFO:teuthology.orchestra.run.smithi079.stdout:Added host 'smithi175' with addr '172.21.15.175' 2024-08-20T01:28:17.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:17 smithi079 ceph-mon[18656]: Updating smithi081:/etc/ceph/ceph.conf 2024-08-20T01:28:17.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:17 smithi079 ceph-mon[18656]: Updating smithi081:/var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T01:28:17.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:17 smithi079 ceph-mon[18656]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2024-08-20T01:28:17.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:17 smithi079 ceph-mon[18656]: Updating smithi081:/var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-20T01:28:17.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:17 smithi079 ceph-mon[18656]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:17.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:17 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:17.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:17 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:17.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:17 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:18.133 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph orch host ls --format=json 2024-08-20T01:28:18.372 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:18.747 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:18 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:18.747 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:18 smithi079 ceph-mon[18656]: Added host smithi175 2024-08-20T01:28:18.747 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:18 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:28:18.747 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:18 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:18.748 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:18 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:18.748 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:18 smithi079 ceph-mon[18656]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:19.018 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:28:19.018 INFO:teuthology.orchestra.run.smithi079.stdout:[{"addr": "172.21.15.79", "hostname": "smithi079", "labels": [], "status": ""}, {"addr": "172.21.15.81", "hostname": "smithi081", "labels": [], "status": ""}, {"addr": "172.21.15.175", "hostname": "smithi175", "labels": [], "status": ""}] 2024-08-20T01:28:19.588 INFO:tasks.cephadm:Setting crush tunables to default 2024-08-20T01:28:19.588 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph osd crush tunables default 2024-08-20T01:28:19.825 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:20.179 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:19 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:20.179 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:19 smithi079 ceph-mon[18656]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:28:20.874 INFO:teuthology.orchestra.run.smithi079.stderr:adjusted tunables profile to default 2024-08-20T01:28:21.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:20 smithi079 ceph-mon[18656]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:21.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:20 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/3210822961' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-08-20T01:28:21.492 INFO:tasks.cephadm:Adding mon.a on smithi079 2024-08-20T01:28:21.492 INFO:tasks.cephadm:Adding mon.b on smithi081 2024-08-20T01:28:21.492 INFO:tasks.cephadm:Adding mon.c on smithi175 2024-08-20T01:28:21.492 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph orch apply mon '3;smithi079:172.21.15.79=a;smithi081:172.21.15.81=b;smithi175:172.21.15.175=c' 2024-08-20T01:28:21.736 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-20T01:28:21.786 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-20T01:28:22.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:21 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/3210822961' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-20T01:28:22.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:21 smithi079 ceph-mon[18656]: osdmap e4: 0 total, 0 up, 0 in 2024-08-20T01:28:22.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:21 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:22.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:21 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:22.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:21 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:22.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:21 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:22.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:21 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi175", "name": "osd_memory_target"} : dispatch 2024-08-20T01:28:22.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:21 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:22.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:21 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:28:22.481 INFO:teuthology.orchestra.run.smithi175.stdout:Scheduled mon update... 2024-08-20T01:28:23.125 DEBUG:teuthology.orchestra.run.smithi081:mon.b> sudo journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mon.b.service 2024-08-20T01:28:23.128 DEBUG:teuthology.orchestra.run.smithi175:mon.c> sudo journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mon.c.service 2024-08-20T01:28:23.130 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-20T01:28:23.131 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-20T01:28:23.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:22 smithi079 ceph-mon[18656]: Updating smithi175:/etc/ceph/ceph.conf 2024-08-20T01:28:23.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:22 smithi079 ceph-mon[18656]: Updating smithi175:/var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T01:28:23.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:22 smithi079 ceph-mon[18656]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2024-08-20T01:28:23.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:22 smithi079 ceph-mon[18656]: Updating smithi175:/var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-20T01:28:23.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:22 smithi079 ceph-mon[18656]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:23.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:22 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:23.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:22 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:23.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:22 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:23.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:22 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:23.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:22 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T01:28:23.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:22 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:24.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:23 smithi079 ceph-mon[18656]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi079:172.21.15.79=a;smithi081:172.21.15.81=b;smithi175:172.21.15.175=c", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:28:24.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:23 smithi079 ceph-mon[18656]: Saving service mon spec with placement smithi079:172.21.15.79=a;smithi081:172.21.15.81=b;smithi175:172.21.15.175=c;count:3 2024-08-20T01:28:24.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:23 smithi079 ceph-mon[18656]: Deploying daemon mon.c on smithi175 2024-08-20T01:28:24.719 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T01:28:25.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:24 smithi079 ceph-mon[18656]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:25.411 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-08-20T01:28:25.411 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":1,"fsid":"28484e9a-5e93-11ef-bccf-c7b262605968","modified":"2024-08-20T01:27:04.865800Z","created":"2024-08-20T01:27:04.865800Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:3300","nonce":0},{"type":"v1","addr":"172.21.15.79:6789","nonce":0}]},"addr":"172.21.15.79:6789/0","public_addr":"172.21.15.79:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-20T01:28:25.411 INFO:teuthology.orchestra.run.smithi175.stderr:dumped monmap epoch 1 2024-08-20T01:28:26.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:25 smithi079 ceph-mon[18656]: from='client.? 172.21.15.175:0/1316890067' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-20T01:28:26.743 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:26 smithi175 systemd[1]: Starting Ceph mon.c for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:28:27.072 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:26 smithi175 podman[22372]: 2024-08-20 01:28:26.733574761 +0000 UTC m=+0.029739304 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:28:27.072 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:26 smithi175 podman[22372]: 2024-08-20 01:28:26.845150782 +0000 UTC m=+0.141315352 container create e7b3dc17999d2be7e4d8fa7ea4b0689a7a10339721bf090fbcca7595710a3466 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-08-20T01:28:27.073 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 podman[22372]: 2024-08-20 01:28:27.072484637 +0000 UTC m=+0.368649168 container init e7b3dc17999d2be7e4d8fa7ea4b0689a7a10339721bf090fbcca7595710a3466 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mon-c, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-20T01:28:27.126 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-20T01:28:27.127 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-20T01:28:27.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:26 smithi079 ceph-mon[18656]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:27.375 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T01:28:27.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 podman[22372]: 2024-08-20 01:28:27.07589847 +0000 UTC m=+0.372062998 container start e7b3dc17999d2be7e4d8fa7ea4b0689a7a10339721bf090fbcca7595710a3466 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mon-c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_BRANCH=HEAD) 2024-08-20T01:28:27.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: set uid:gid to 167:167 (ceph:ceph) 2024-08-20T01:28:27.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: ceph version 19.0.0-5872-gef427541 (ef4275410d8483698016fe484b2a3c664080b4c1) squid (dev), process ceph-mon, pid 2 2024-08-20T01:28:27.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: pidfile_write: ignore empty --pid-file 2024-08-20T01:28:27.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: load: jerasure load: lrc 2024-08-20T01:28:27.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: RocksDB version: 7.9.2 2024-08-20T01:28:27.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Git sha 0 2024-08-20T01:28:27.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Compile date 2024-08-19 15:50:59 2024-08-20T01:28:27.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: DB SUMMARY 2024-08-20T01:28:27.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: DB Session ID: 7U0BE9XLNW6ALSMC9NXZ 2024-08-20T01:28:27.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: CURRENT file: CURRENT 2024-08-20T01:28:27.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: IDENTITY file: IDENTITY 2024-08-20T01:28:27.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-08-20T01:28:27.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-08-20T01:28:27.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-08-20T01:28:27.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.error_if_exists: 0 2024-08-20T01:28:27.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.create_if_missing: 0 2024-08-20T01:28:27.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.paranoid_checks: 1 2024-08-20T01:28:27.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-20T01:28:27.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-20T01:28:27.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-20T01:28:27.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.env: 0x55a72cc03be0 2024-08-20T01:28:27.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.fs: PosixFileSystem 2024-08-20T01:28:27.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.info_log: 0x55a72db55700 2024-08-20T01:28:27.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.max_file_opening_threads: 16 2024-08-20T01:28:27.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.statistics: (nil) 2024-08-20T01:28:27.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.use_fsync: 0 2024-08-20T01:28:27.391 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.max_log_file_size: 0 2024-08-20T01:28:27.391 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-20T01:28:27.391 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-20T01:28:27.391 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.keep_log_file_num: 1000 2024-08-20T01:28:27.391 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.recycle_log_file_num: 0 2024-08-20T01:28:27.391 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.allow_fallocate: 1 2024-08-20T01:28:27.392 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.allow_mmap_reads: 0 2024-08-20T01:28:27.392 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.allow_mmap_writes: 0 2024-08-20T01:28:27.392 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.use_direct_reads: 0 2024-08-20T01:28:27.392 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-20T01:28:27.392 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.create_missing_column_families: 0 2024-08-20T01:28:27.393 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.db_log_dir: 2024-08-20T01:28:27.393 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.wal_dir: 2024-08-20T01:28:27.393 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-20T01:28:27.393 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-20T01:28:27.393 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-20T01:28:27.393 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-20T01:28:27.393 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-20T01:28:27.393 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-20T01:28:27.393 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.advise_random_on_open: 1 2024-08-20T01:28:27.393 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.db_write_buffer_size: 0 2024-08-20T01:28:27.394 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.write_buffer_manager: 0x55a72db58e60 2024-08-20T01:28:27.394 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-20T01:28:27.394 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-20T01:28:27.394 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-20T01:28:27.394 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.rate_limiter: (nil) 2024-08-20T01:28:27.394 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-20T01:28:27.394 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.wal_recovery_mode: 2 2024-08-20T01:28:27.394 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.enable_thread_tracking: 0 2024-08-20T01:28:27.394 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.enable_pipelined_write: 0 2024-08-20T01:28:27.394 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.unordered_write: 0 2024-08-20T01:28:27.395 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-20T01:28:27.395 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-20T01:28:27.395 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-20T01:28:27.395 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-20T01:28:27.395 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.row_cache: None 2024-08-20T01:28:27.395 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.wal_filter: None 2024-08-20T01:28:27.395 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-20T01:28:27.395 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.allow_ingest_behind: 0 2024-08-20T01:28:27.395 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.two_write_queues: 0 2024-08-20T01:28:27.395 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.manual_wal_flush: 0 2024-08-20T01:28:27.395 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.wal_compression: 0 2024-08-20T01:28:27.395 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.atomic_flush: 0 2024-08-20T01:28:27.396 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-20T01:28:27.396 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-20T01:28:27.396 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-20T01:28:27.396 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.log_readahead_size: 0 2024-08-20T01:28:27.396 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-20T01:28:27.396 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.best_efforts_recovery: 0 2024-08-20T01:28:27.396 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-20T01:28:27.396 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-20T01:28:27.396 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.allow_data_in_errors: 0 2024-08-20T01:28:27.396 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.db_host_id: __hostname__ 2024-08-20T01:28:27.397 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-20T01:28:27.397 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.max_background_jobs: 2 2024-08-20T01:28:27.397 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.max_background_compactions: -1 2024-08-20T01:28:27.397 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.max_subcompactions: 1 2024-08-20T01:28:27.397 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-20T01:28:27.397 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-20T01:28:27.397 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-20T01:28:27.397 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.max_total_wal_size: 0 2024-08-20T01:28:27.397 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-20T01:28:27.397 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-20T01:28:27.398 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-20T01:28:27.398 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-20T01:28:27.398 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.max_open_files: -1 2024-08-20T01:28:27.398 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.bytes_per_sync: 0 2024-08-20T01:28:27.398 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-20T01:28:27.398 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-20T01:28:27.398 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.compaction_readahead_size: 0 2024-08-20T01:28:27.398 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.max_background_flushes: -1 2024-08-20T01:28:27.398 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Compression algorithms supported: 2024-08-20T01:28:27.398 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: kZSTD supported: 0 2024-08-20T01:28:27.398 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: kXpressCompression supported: 0 2024-08-20T01:28:27.398 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: kBZip2Compression supported: 0 2024-08-20T01:28:27.399 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-20T01:28:27.399 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: kLZ4Compression supported: 1 2024-08-20T01:28:27.399 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: kZlibCompression supported: 1 2024-08-20T01:28:27.399 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: kLZ4HCCompression supported: 1 2024-08-20T01:28:27.399 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: kSnappyCompression supported: 1 2024-08-20T01:28:27.399 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-20T01:28:27.399 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-20T01:28:27.399 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-08-20T01:28:27.399 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-20T01:28:27.399 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-20T01:28:27.399 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.merge_operator: 2024-08-20T01:28:27.399 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.compaction_filter: None 2024-08-20T01:28:27.400 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.compaction_filter_factory: None 2024-08-20T01:28:27.400 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.sst_partitioner_factory: None 2024-08-20T01:28:27.400 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-20T01:28:27.400 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-20T01:28:27.400 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a72db55380) 2024-08-20T01:28:27.400 INFO:journalctl@ceph.mon.c.smithi175.stdout: cache_index_and_filter_blocks: 1 2024-08-20T01:28:27.400 INFO:journalctl@ceph.mon.c.smithi175.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-20T01:28:27.400 INFO:journalctl@ceph.mon.c.smithi175.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-20T01:28:27.400 INFO:journalctl@ceph.mon.c.smithi175.stdout: pin_top_level_index_and_filter: 1 2024-08-20T01:28:27.400 INFO:journalctl@ceph.mon.c.smithi175.stdout: index_type: 0 2024-08-20T01:28:27.400 INFO:journalctl@ceph.mon.c.smithi175.stdout: data_block_index_type: 0 2024-08-20T01:28:27.400 INFO:journalctl@ceph.mon.c.smithi175.stdout: index_shortening: 1 2024-08-20T01:28:27.400 INFO:journalctl@ceph.mon.c.smithi175.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-20T01:28:27.400 INFO:journalctl@ceph.mon.c.smithi175.stdout: checksum: 4 2024-08-20T01:28:27.401 INFO:journalctl@ceph.mon.c.smithi175.stdout: no_block_cache: 0 2024-08-20T01:28:27.401 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_cache: 0x55a72db49610 2024-08-20T01:28:27.401 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_cache_name: BinnedLRUCache 2024-08-20T01:28:27.401 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_cache_options: 2024-08-20T01:28:27.401 INFO:journalctl@ceph.mon.c.smithi175.stdout: capacity : 536870912 2024-08-20T01:28:27.401 INFO:journalctl@ceph.mon.c.smithi175.stdout: num_shard_bits : 4 2024-08-20T01:28:27.401 INFO:journalctl@ceph.mon.c.smithi175.stdout: strict_capacity_limit : 0 2024-08-20T01:28:27.401 INFO:journalctl@ceph.mon.c.smithi175.stdout: high_pri_pool_ratio: 0.000 2024-08-20T01:28:27.401 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_cache_compressed: (nil) 2024-08-20T01:28:27.401 INFO:journalctl@ceph.mon.c.smithi175.stdout: persistent_cache: (nil) 2024-08-20T01:28:27.401 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_size: 4096 2024-08-20T01:28:27.401 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_size_deviation: 10 2024-08-20T01:28:27.402 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_restart_interval: 16 2024-08-20T01:28:27.402 INFO:journalctl@ceph.mon.c.smithi175.stdout: index_block_restart_interval: 1 2024-08-20T01:28:27.402 INFO:journalctl@ceph.mon.c.smithi175.stdout: metadata_block_size: 4096 2024-08-20T01:28:27.402 INFO:journalctl@ceph.mon.c.smithi175.stdout: partition_filters: 0 2024-08-20T01:28:27.402 INFO:journalctl@ceph.mon.c.smithi175.stdout: use_delta_encoding: 1 2024-08-20T01:28:27.402 INFO:journalctl@ceph.mon.c.smithi175.stdout: filter_policy: bloomfilter 2024-08-20T01:28:27.402 INFO:journalctl@ceph.mon.c.smithi175.stdout: whole_key_filtering: 1 2024-08-20T01:28:27.402 INFO:journalctl@ceph.mon.c.smithi175.stdout: verify_compression: 0 2024-08-20T01:28:27.402 INFO:journalctl@ceph.mon.c.smithi175.stdout: read_amp_bytes_per_bit: 0 2024-08-20T01:28:27.402 INFO:journalctl@ceph.mon.c.smithi175.stdout: format_version: 5 2024-08-20T01:28:27.402 INFO:journalctl@ceph.mon.c.smithi175.stdout: enable_index_compression: 1 2024-08-20T01:28:27.403 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_align: 0 2024-08-20T01:28:27.403 INFO:journalctl@ceph.mon.c.smithi175.stdout: max_auto_readahead_size: 262144 2024-08-20T01:28:27.403 INFO:journalctl@ceph.mon.c.smithi175.stdout: prepopulate_block_cache: 0 2024-08-20T01:28:27.403 INFO:journalctl@ceph.mon.c.smithi175.stdout: initial_auto_readahead_size: 8192 2024-08-20T01:28:27.403 INFO:journalctl@ceph.mon.c.smithi175.stdout: num_file_reads_for_auto_readahead: 2 2024-08-20T01:28:27.403 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.write_buffer_size: 33554432 2024-08-20T01:28:27.403 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.max_write_buffer_number: 2 2024-08-20T01:28:27.403 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.compression: NoCompression 2024-08-20T01:28:27.403 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.bottommost_compression: Disabled 2024-08-20T01:28:27.403 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.prefix_extractor: nullptr 2024-08-20T01:28:27.403 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-20T01:28:27.403 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.num_levels: 7 2024-08-20T01:28:27.403 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-20T01:28:27.404 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-20T01:28:27.404 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-20T01:28:27.404 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-20T01:28:27.404 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-20T01:28:27.404 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-20T01:28:27.404 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-20T01:28:27.404 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-20T01:28:27.404 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-20T01:28:27.404 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-20T01:28:27.405 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-20T01:28:27.405 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-20T01:28:27.405 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-20T01:28:27.405 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.compression_opts.level: 32767 2024-08-20T01:28:27.405 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.compression_opts.strategy: 0 2024-08-20T01:28:27.405 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-20T01:28:27.405 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-20T01:28:27.405 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-20T01:28:27.405 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-20T01:28:27.406 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.compression_opts.enabled: false 2024-08-20T01:28:27.406 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-20T01:28:27.406 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-20T01:28:27.406 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-20T01:28:27.406 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-20T01:28:27.406 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.target_file_size_base: 67108864 2024-08-20T01:28:27.406 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-20T01:28:27.406 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-20T01:28:27.406 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-20T01:28:27.407 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-20T01:28:27.407 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-20T01:28:27.407 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-20T01:28:27.407 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-20T01:28:27.407 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-20T01:28:27.407 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-20T01:28:27.407 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-20T01:28:27.407 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-20T01:28:27.407 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-20T01:28:27.407 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-20T01:28:27.407 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-20T01:28:27.407 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.arena_block_size: 1048576 2024-08-20T01:28:27.407 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-20T01:28:27.408 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-20T01:28:27.408 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.disable_auto_compactions: 0 2024-08-20T01:28:27.408 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-20T01:28:27.408 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-20T01:28:27.408 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-20T01:28:27.408 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-20T01:28:27.408 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-20T01:28:27.408 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-20T01:28:27.408 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-20T01:28:27.408 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-20T01:28:27.408 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-20T01:28:27.409 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-20T01:28:27.409 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-20T01:28:27.409 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.inplace_update_support: 0 2024-08-20T01:28:27.409 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-20T01:28:27.409 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-20T01:28:27.409 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-20T01:28:27.409 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-20T01:28:27.409 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.bloom_locality: 0 2024-08-20T01:28:27.409 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.max_successive_merges: 0 2024-08-20T01:28:27.409 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-20T01:28:27.409 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.paranoid_file_checks: 0 2024-08-20T01:28:27.410 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.force_consistency_checks: 1 2024-08-20T01:28:27.410 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.report_bg_io_stats: 0 2024-08-20T01:28:27.410 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.ttl: 2592000 2024-08-20T01:28:27.410 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-20T01:28:27.410 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-20T01:28:27.410 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-20T01:28:27.410 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.enable_blob_files: false 2024-08-20T01:28:27.410 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.min_blob_size: 0 2024-08-20T01:28:27.410 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.blob_file_size: 268435456 2024-08-20T01:28:27.410 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-20T01:28:27.410 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-20T01:28:27.410 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-20T01:28:27.410 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-20T01:28:27.411 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-20T01:28:27.411 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.blob_file_starting_level: 0 2024-08-20T01:28:27.412 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-20T01:28:27.412 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-08-20T01:28:27.412 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-08-20T01:28:27.412 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 50c6d38d-e9ea-44ef-a800-c1291b6d22be 2024-08-20T01:28:27.412 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724117307102606, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-08-20T01:28:27.412 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-08-20T01:28:27.412 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724117307103014, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1724117307, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "50c6d38d-e9ea-44ef-a800-c1291b6d22be", "db_session_id": "7U0BE9XLNW6ALSMC9NXZ", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-08-20T01:28:27.412 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724117307103105, "job": 1, "event": "recovery_finished"} 2024-08-20T01:28:27.412 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-08-20T01:28:27.412 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-20T01:28:27.412 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55a72db78e00 2024-08-20T01:28:27.412 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: DB pointer 0x55a72dc76000 2024-08-20T01:28:27.412 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-20T01:28:27.413 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-20T01:28:27.413 INFO:journalctl@ceph.mon.c.smithi175.stdout: ** DB Stats ** 2024-08-20T01:28:27.413 INFO:journalctl@ceph.mon.c.smithi175.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-20T01:28:27.413 INFO:journalctl@ceph.mon.c.smithi175.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-20T01:28:27.413 INFO:journalctl@ceph.mon.c.smithi175.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-20T01:28:27.413 INFO:journalctl@ceph.mon.c.smithi175.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-20T01:28:27.413 INFO:journalctl@ceph.mon.c.smithi175.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-20T01:28:27.413 INFO:journalctl@ceph.mon.c.smithi175.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-20T01:28:27.413 INFO:journalctl@ceph.mon.c.smithi175.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-20T01:28:27.413 INFO:journalctl@ceph.mon.c.smithi175.stdout: 2024-08-20T01:28:27.413 INFO:journalctl@ceph.mon.c.smithi175.stdout: ** Compaction Stats [default] ** 2024-08-20T01:28:27.413 INFO:journalctl@ceph.mon.c.smithi175.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-20T01:28:27.413 INFO:journalctl@ceph.mon.c.smithi175.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-20T01:28:27.414 INFO:journalctl@ceph.mon.c.smithi175.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-20T01:28:27.414 INFO:journalctl@ceph.mon.c.smithi175.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-20T01:28:27.414 INFO:journalctl@ceph.mon.c.smithi175.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-20T01:28:27.414 INFO:journalctl@ceph.mon.c.smithi175.stdout: 2024-08-20T01:28:27.414 INFO:journalctl@ceph.mon.c.smithi175.stdout: ** Compaction Stats [default] ** 2024-08-20T01:28:27.414 INFO:journalctl@ceph.mon.c.smithi175.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-20T01:28:27.414 INFO:journalctl@ceph.mon.c.smithi175.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-20T01:28:27.414 INFO:journalctl@ceph.mon.c.smithi175.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-20T01:28:27.414 INFO:journalctl@ceph.mon.c.smithi175.stdout: 2024-08-20T01:28:27.414 INFO:journalctl@ceph.mon.c.smithi175.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-20T01:28:27.414 INFO:journalctl@ceph.mon.c.smithi175.stdout: 2024-08-20T01:28:27.414 INFO:journalctl@ceph.mon.c.smithi175.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-20T01:28:27.415 INFO:journalctl@ceph.mon.c.smithi175.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-08-20T01:28:27.415 INFO:journalctl@ceph.mon.c.smithi175.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-20T01:28:27.415 INFO:journalctl@ceph.mon.c.smithi175.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-20T01:28:27.415 INFO:journalctl@ceph.mon.c.smithi175.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-20T01:28:27.415 INFO:journalctl@ceph.mon.c.smithi175.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-20T01:28:27.415 INFO:journalctl@ceph.mon.c.smithi175.stdout: Cumulative compaction: 0.00 GB write, 0.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-20T01:28:27.415 INFO:journalctl@ceph.mon.c.smithi175.stdout: Interval compaction: 0.00 GB write, 0.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-20T01:28:27.415 INFO:journalctl@ceph.mon.c.smithi175.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-20T01:28:27.415 INFO:journalctl@ceph.mon.c.smithi175.stdout: Block cache BinnedLRUCache@0x55a72db49610#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-08-20T01:28:27.415 INFO:journalctl@ceph.mon.c.smithi175.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-08-20T01:28:27.415 INFO:journalctl@ceph.mon.c.smithi175.stdout: 2024-08-20T01:28:27.415 INFO:journalctl@ceph.mon.c.smithi175.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-20T01:28:27.415 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-08-20T01:28:27.416 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: using public_addr v2:172.21.15.175:0/0 -> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] 2024-08-20T01:28:27.416 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: starting mon.c rank -1 at public addrs [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] at bind addrs [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 28484e9a-5e93-11ef-bccf-c7b262605968 2024-08-20T01:28:27.416 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: mon.c@-1(???) e0 preinit fsid 28484e9a-5e93-11ef-bccf-c7b262605968 2024-08-20T01:28:27.416 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: mon.c@-1(synchronizing).mds e1 new map 2024-08-20T01:28:27.416 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: mon.c@-1(synchronizing).mds e1 print_map 2024-08-20T01:28:27.416 INFO:journalctl@ceph.mon.c.smithi175.stdout: e1 2024-08-20T01:28:27.416 INFO:journalctl@ceph.mon.c.smithi175.stdout: btime 2024-08-20T01:27:07:792478+0000 2024-08-20T01:28:27.416 INFO:journalctl@ceph.mon.c.smithi175.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-20T01:28:27.416 INFO:journalctl@ceph.mon.c.smithi175.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-20T01:28:27.416 INFO:journalctl@ceph.mon.c.smithi175.stdout: legacy client fscid: -1 2024-08-20T01:28:27.416 INFO:journalctl@ceph.mon.c.smithi175.stdout: 2024-08-20T01:28:27.416 INFO:journalctl@ceph.mon.c.smithi175.stdout: No filesystems configured 2024-08-20T01:28:27.416 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-08-20T01:28:27.417 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-08-20T01:28:27.417 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-08-20T01:28:27.417 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-08-20T01:28:27.417 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-08-20T01:28:27.417 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-08-20T01:28:27.417 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-20T01:28:27.417 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-20T01:28:27.417 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-20T01:28:27.417 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-20T01:28:27.417 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi175", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:28:27.417 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:27.417 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: Deploying cephadm binary to smithi175 2024-08-20T01:28:27.418 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:27.418 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:27.418 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:27.418 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:27.418 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi081", "name": "osd_memory_target"} : dispatch 2024-08-20T01:28:27.418 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:27.418 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:28:27.418 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: Updating smithi081:/etc/ceph/ceph.conf 2024-08-20T01:28:27.418 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: Updating smithi081:/var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T01:28:27.418 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2024-08-20T01:28:27.418 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: Updating smithi081:/var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-20T01:28:27.419 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:27.419 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:27.419 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:27.419 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:27.419 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:27.419 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: Added host smithi175 2024-08-20T01:28:27.419 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:28:27.419 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:27.419 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:27.420 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:27.420 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:27.420 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:28:27.420 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:27.420 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/3210822961' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-08-20T01:28:27.420 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/3210822961' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-20T01:28:27.420 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: osdmap e4: 0 total, 0 up, 0 in 2024-08-20T01:28:27.420 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:27.421 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:27.421 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:27.421 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:27.421 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi175", "name": "osd_memory_target"} : dispatch 2024-08-20T01:28:27.421 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:27.421 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:28:27.421 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: Updating smithi175:/etc/ceph/ceph.conf 2024-08-20T01:28:27.421 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: Updating smithi175:/var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T01:28:27.421 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2024-08-20T01:28:27.421 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: Updating smithi175:/var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-20T01:28:27.421 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:27.422 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:27.422 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:27.422 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:27.422 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:27.422 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T01:28:27.422 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:27.422 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi079:172.21.15.79=a;smithi081:172.21.15.81=b;smithi175:172.21.15.175=c", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:28:27.422 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: Saving service mon spec with placement smithi079:172.21.15.79=a;smithi081:172.21.15.81=b;smithi175:172.21.15.175=c;count:3 2024-08-20T01:28:27.422 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: Deploying daemon mon.c on smithi175 2024-08-20T01:28:27.422 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:27.422 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: from='client.? 172.21.15.175:0/1316890067' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-20T01:28:27.422 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:27.423 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 ceph-mon[22392]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-08-20T01:28:27.423 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 bash[22372]: e7b3dc17999d2be7e4d8fa7ea4b0689a7a10339721bf090fbcca7595710a3466 2024-08-20T01:28:27.423 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:27 smithi175 systemd[1]: Started Ceph mon.c for 28484e9a-5e93-11ef-bccf-c7b262605968. 2024-08-20T01:28:32.436 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-08-20T01:28:32.437 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":2,"fsid":"28484e9a-5e93-11ef-bccf-c7b262605968","modified":"2024-08-20T01:28:27.128171Z","created":"2024-08-20T01:27:04.865800Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:3300","nonce":0},{"type":"v1","addr":"172.21.15.79:6789","nonce":0}]},"addr":"172.21.15.79:6789/0","public_addr":"172.21.15.79:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-08-20T01:28:32.437 INFO:teuthology.orchestra.run.smithi175.stderr:dumped monmap epoch 2 2024-08-20T01:28:32.447 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:32 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T01:28:32.448 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:32 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:28:32.448 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:32 smithi175 ceph-mon[22392]: mon.a calling monitor election 2024-08-20T01:28:32.448 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:32 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:28:32.448 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:32 smithi175 ceph-mon[22392]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:32.448 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:32 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:28:32.448 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:32 smithi175 ceph-mon[22392]: mon.c calling monitor election 2024-08-20T01:28:32.448 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:32 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:28:32.448 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:32 smithi175 ceph-mon[22392]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:32.448 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:32 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:28:32.448 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:32 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:28:32.448 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:32 smithi175 ceph-mon[22392]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-20T01:28:32.449 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:32 smithi175 ceph-mon[22392]: monmap epoch 2 2024-08-20T01:28:32.449 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:32 smithi175 ceph-mon[22392]: fsid 28484e9a-5e93-11ef-bccf-c7b262605968 2024-08-20T01:28:32.449 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:32 smithi175 ceph-mon[22392]: last_changed 2024-08-20T01:28:27.128171+0000 2024-08-20T01:28:32.449 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:32 smithi175 ceph-mon[22392]: created 2024-08-20T01:27:04.865800+0000 2024-08-20T01:28:32.449 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:32 smithi175 ceph-mon[22392]: min_mon_release 19 (squid) 2024-08-20T01:28:32.449 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:32 smithi175 ceph-mon[22392]: election_strategy: 1 2024-08-20T01:28:32.449 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:32 smithi175 ceph-mon[22392]: 0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2024-08-20T01:28:32.449 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:32 smithi175 ceph-mon[22392]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-08-20T01:28:32.449 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:32 smithi175 ceph-mon[22392]: fsmap 2024-08-20T01:28:32.449 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:32 smithi175 ceph-mon[22392]: osdmap e4: 0 total, 0 up, 0 in 2024-08-20T01:28:32.449 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:32 smithi175 ceph-mon[22392]: mgrmap e13: x(active, since 39s) 2024-08-20T01:28:32.449 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:32 smithi175 ceph-mon[22392]: overall HEALTH_OK 2024-08-20T01:28:32.449 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:32 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:32.450 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:32 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:32.450 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:32 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:32.450 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:32 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T01:28:32.450 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:32 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:32.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:32 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T01:28:32.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:32 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:28:32.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:32 smithi079 ceph-mon[18656]: mon.a calling monitor election 2024-08-20T01:28:32.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:32 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:28:32.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:32 smithi079 ceph-mon[18656]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:32.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:32 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:28:32.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:32 smithi079 ceph-mon[18656]: mon.c calling monitor election 2024-08-20T01:28:32.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:32 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:28:32.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:32 smithi079 ceph-mon[18656]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:32.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:32 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:28:32.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:32 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:28:32.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:32 smithi079 ceph-mon[18656]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-20T01:28:32.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:32 smithi079 ceph-mon[18656]: monmap epoch 2 2024-08-20T01:28:32.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:32 smithi079 ceph-mon[18656]: fsid 28484e9a-5e93-11ef-bccf-c7b262605968 2024-08-20T01:28:32.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:32 smithi079 ceph-mon[18656]: last_changed 2024-08-20T01:28:27.128171+0000 2024-08-20T01:28:32.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:32 smithi079 ceph-mon[18656]: created 2024-08-20T01:27:04.865800+0000 2024-08-20T01:28:32.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:32 smithi079 ceph-mon[18656]: min_mon_release 19 (squid) 2024-08-20T01:28:32.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:32 smithi079 ceph-mon[18656]: election_strategy: 1 2024-08-20T01:28:32.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:32 smithi079 ceph-mon[18656]: 0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2024-08-20T01:28:32.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:32 smithi079 ceph-mon[18656]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-08-20T01:28:32.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:32 smithi079 ceph-mon[18656]: fsmap 2024-08-20T01:28:32.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:32 smithi079 ceph-mon[18656]: osdmap e4: 0 total, 0 up, 0 in 2024-08-20T01:28:32.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:32 smithi079 ceph-mon[18656]: mgrmap e13: x(active, since 39s) 2024-08-20T01:28:32.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:32 smithi079 ceph-mon[18656]: overall HEALTH_OK 2024-08-20T01:28:32.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:32 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:32.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:32 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:32.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:32 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:32.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:32 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T01:28:32.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:32 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:33.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:33 smithi175 ceph-mon[22392]: Deploying daemon mon.b on smithi081 2024-08-20T01:28:33.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:33 smithi175 ceph-mon[22392]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:33.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:33 smithi175 ceph-mon[22392]: from='client.? 172.21.15.175:0/3771697247' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-20T01:28:33.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:33 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:28:33.587 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:33 smithi079 ceph-mon[18656]: Deploying daemon mon.b on smithi081 2024-08-20T01:28:33.587 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:33 smithi079 ceph-mon[18656]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:33.587 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:33 smithi079 ceph-mon[18656]: from='client.? 172.21.15.175:0/3771697247' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-20T01:28:33.587 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:33 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:28:34.048 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-20T01:28:34.048 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-20T01:28:34.294 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T01:28:34.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:34 smithi175 ceph-mon[22392]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:34.858 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:34 smithi079 ceph-mon[18656]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:34.939 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-08-20T01:28:34.939 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":2,"fsid":"28484e9a-5e93-11ef-bccf-c7b262605968","modified":"2024-08-20T01:28:27.128171Z","created":"2024-08-20T01:27:04.865800Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:3300","nonce":0},{"type":"v1","addr":"172.21.15.79:6789","nonce":0}]},"addr":"172.21.15.79:6789/0","public_addr":"172.21.15.79:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-08-20T01:28:34.940 INFO:teuthology.orchestra.run.smithi175.stderr:dumped monmap epoch 2 2024-08-20T01:28:35.750 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:35 smithi079 ceph-mon[18656]: from='client.? 172.21.15.175:0/3966210288' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-20T01:28:35.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:35 smithi175 ceph-mon[22392]: from='client.? 172.21.15.175:0/3966210288' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-20T01:28:35.947 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: mon.b@-1(synchronizing).mds e1 new map 2024-08-20T01:28:35.947 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: mon.b@-1(synchronizing).mds e1 print_map 2024-08-20T01:28:35.947 INFO:journalctl@ceph.mon.b.smithi081.stdout: e1 2024-08-20T01:28:35.947 INFO:journalctl@ceph.mon.b.smithi081.stdout: btime 2024-08-20T01:27:07:792478+0000 2024-08-20T01:28:35.947 INFO:journalctl@ceph.mon.b.smithi081.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-20T01:28:35.947 INFO:journalctl@ceph.mon.b.smithi081.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-20T01:28:35.947 INFO:journalctl@ceph.mon.b.smithi081.stdout: legacy client fscid: -1 2024-08-20T01:28:35.947 INFO:journalctl@ceph.mon.b.smithi081.stdout: 2024-08-20T01:28:35.947 INFO:journalctl@ceph.mon.b.smithi081.stdout: No filesystems configured 2024-08-20T01:28:35.947 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-08-20T01:28:35.947 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-08-20T01:28:35.947 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-08-20T01:28:35.948 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-08-20T01:28:35.948 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-08-20T01:28:35.948 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-08-20T01:28:36.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-20T01:28:36.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-20T01:28:36.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-20T01:28:36.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-20T01:28:36.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi175", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:28:36.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:36.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: Deploying cephadm binary to smithi175 2024-08-20T01:28:36.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:36.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:36.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:36.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:36.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi081", "name": "osd_memory_target"} : dispatch 2024-08-20T01:28:36.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:36.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:28:36.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: Updating smithi081:/etc/ceph/ceph.conf 2024-08-20T01:28:36.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: Updating smithi081:/var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T01:28:36.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2024-08-20T01:28:36.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: Updating smithi081:/var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-20T01:28:36.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:36.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:36.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:36.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:36.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:36.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: Added host smithi175 2024-08-20T01:28:36.280 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:28:36.280 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:36.280 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:36.280 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:36.280 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:36.280 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:28:36.280 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:36.280 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/3210822961' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-08-20T01:28:36.280 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/3210822961' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-20T01:28:36.280 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: osdmap e4: 0 total, 0 up, 0 in 2024-08-20T01:28:36.280 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:36.280 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:36.281 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:36.281 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:36.281 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi175", "name": "osd_memory_target"} : dispatch 2024-08-20T01:28:36.281 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:36.281 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:28:36.281 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: Updating smithi175:/etc/ceph/ceph.conf 2024-08-20T01:28:36.281 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: Updating smithi175:/var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T01:28:36.281 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2024-08-20T01:28:36.281 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: Updating smithi175:/var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-20T01:28:36.281 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:36.281 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:36.281 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:36.281 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:36.281 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:36.282 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T01:28:36.282 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:36.282 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi079:172.21.15.79=a;smithi081:172.21.15.81=b;smithi175:172.21.15.175=c", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:28:36.282 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: Saving service mon spec with placement smithi079:172.21.15.79=a;smithi081:172.21.15.81=b;smithi175:172.21.15.175=c;count:3 2024-08-20T01:28:36.282 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: Deploying daemon mon.c on smithi175 2024-08-20T01:28:36.282 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:36.282 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='client.? 172.21.15.175:0/1316890067' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-20T01:28:36.282 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:36.282 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T01:28:36.282 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:28:36.282 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: mon.a calling monitor election 2024-08-20T01:28:36.283 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:28:36.283 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:36.283 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:28:36.283 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: mon.c calling monitor election 2024-08-20T01:28:36.283 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:28:36.284 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:36.284 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:28:36.284 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:28:36.284 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-20T01:28:36.284 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: monmap epoch 2 2024-08-20T01:28:36.284 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: fsid 28484e9a-5e93-11ef-bccf-c7b262605968 2024-08-20T01:28:36.284 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: last_changed 2024-08-20T01:28:27.128171+0000 2024-08-20T01:28:36.284 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: created 2024-08-20T01:27:04.865800+0000 2024-08-20T01:28:36.284 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: min_mon_release 19 (squid) 2024-08-20T01:28:36.284 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: election_strategy: 1 2024-08-20T01:28:36.284 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: 0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2024-08-20T01:28:36.284 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-08-20T01:28:36.285 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: fsmap 2024-08-20T01:28:36.285 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: osdmap e4: 0 total, 0 up, 0 in 2024-08-20T01:28:36.285 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: mgrmap e13: x(active, since 39s) 2024-08-20T01:28:36.285 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: overall HEALTH_OK 2024-08-20T01:28:36.285 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:36.285 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:36.285 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:36.285 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T01:28:36.285 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:36.285 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: Deploying daemon mon.b on smithi081 2024-08-20T01:28:36.285 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:36.285 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='client.? 172.21.15.175:0/3771697247' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-20T01:28:36.285 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:28:36.285 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:36.286 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: from='client.? 172.21.15.175:0/3966210288' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-20T01:28:36.286 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 ceph-mon[22209]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-08-20T01:28:36.286 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 bash[22190]: c7fb4d2ef7eaf9f7ed64b06811b0a2a20b98e603369f31b1be512de1b3359231 2024-08-20T01:28:36.286 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:35 smithi081 systemd[1]: Started Ceph mon.b for 28484e9a-5e93-11ef-bccf-c7b262605968. 2024-08-20T01:28:36.512 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-20T01:28:36.512 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-20T01:28:36.756 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T01:28:41.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:41 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T01:28:41.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:41 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:28:41.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:41 smithi081 ceph-mon[22209]: mon.a calling monitor election 2024-08-20T01:28:41.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:41 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:28:41.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:41 smithi081 ceph-mon[22209]: mon.c calling monitor election 2024-08-20T01:28:41.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:41 smithi081 ceph-mon[22209]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:41.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:41 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:28:41.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:41 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:28:41.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:41 smithi081 ceph-mon[22209]: mon.b calling monitor election 2024-08-20T01:28:41.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:41 smithi081 ceph-mon[22209]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:41.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:41 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:28:41.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:41 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:28:41.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:41 smithi081 ceph-mon[22209]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:41.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:41 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:28:41.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:41 smithi081 ceph-mon[22209]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-20T01:28:41.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:41 smithi081 ceph-mon[22209]: monmap epoch 3 2024-08-20T01:28:41.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:41 smithi081 ceph-mon[22209]: fsid 28484e9a-5e93-11ef-bccf-c7b262605968 2024-08-20T01:28:41.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:41 smithi081 ceph-mon[22209]: last_changed 2024-08-20T01:28:35.952216+0000 2024-08-20T01:28:41.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:41 smithi081 ceph-mon[22209]: created 2024-08-20T01:27:04.865800+0000 2024-08-20T01:28:41.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:41 smithi081 ceph-mon[22209]: min_mon_release 19 (squid) 2024-08-20T01:28:41.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:41 smithi081 ceph-mon[22209]: election_strategy: 1 2024-08-20T01:28:41.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:41 smithi081 ceph-mon[22209]: 0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2024-08-20T01:28:41.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:41 smithi081 ceph-mon[22209]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-08-20T01:28:41.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:41 smithi081 ceph-mon[22209]: 2: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.b 2024-08-20T01:28:41.280 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:41 smithi081 ceph-mon[22209]: fsmap 2024-08-20T01:28:41.280 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:41 smithi081 ceph-mon[22209]: osdmap e4: 0 total, 0 up, 0 in 2024-08-20T01:28:41.280 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:41 smithi081 ceph-mon[22209]: mgrmap e13: x(active, since 48s) 2024-08-20T01:28:41.280 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:41 smithi081 ceph-mon[22209]: overall HEALTH_OK 2024-08-20T01:28:41.280 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:41 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:41.280 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:41 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:41.280 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:41 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:41.280 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:41 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:41.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:41 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T01:28:41.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:41 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:28:41.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:41 smithi175 ceph-mon[22392]: mon.a calling monitor election 2024-08-20T01:28:41.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:41 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:28:41.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:41 smithi175 ceph-mon[22392]: mon.c calling monitor election 2024-08-20T01:28:41.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:41 smithi175 ceph-mon[22392]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:41.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:41 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:28:41.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:41 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:28:41.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:41 smithi175 ceph-mon[22392]: mon.b calling monitor election 2024-08-20T01:28:41.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:41 smithi175 ceph-mon[22392]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:41.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:41 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:28:41.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:41 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:28:41.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:41 smithi175 ceph-mon[22392]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:41.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:41 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:28:41.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:41 smithi175 ceph-mon[22392]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-20T01:28:41.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:41 smithi175 ceph-mon[22392]: monmap epoch 3 2024-08-20T01:28:41.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:41 smithi175 ceph-mon[22392]: fsid 28484e9a-5e93-11ef-bccf-c7b262605968 2024-08-20T01:28:41.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:41 smithi175 ceph-mon[22392]: last_changed 2024-08-20T01:28:35.952216+0000 2024-08-20T01:28:41.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:41 smithi175 ceph-mon[22392]: created 2024-08-20T01:27:04.865800+0000 2024-08-20T01:28:41.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:41 smithi175 ceph-mon[22392]: min_mon_release 19 (squid) 2024-08-20T01:28:41.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:41 smithi175 ceph-mon[22392]: election_strategy: 1 2024-08-20T01:28:41.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:41 smithi175 ceph-mon[22392]: 0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2024-08-20T01:28:41.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:41 smithi175 ceph-mon[22392]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-08-20T01:28:41.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:41 smithi175 ceph-mon[22392]: 2: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.b 2024-08-20T01:28:41.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:41 smithi175 ceph-mon[22392]: fsmap 2024-08-20T01:28:41.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:41 smithi175 ceph-mon[22392]: osdmap e4: 0 total, 0 up, 0 in 2024-08-20T01:28:41.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:41 smithi175 ceph-mon[22392]: mgrmap e13: x(active, since 48s) 2024-08-20T01:28:41.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:41 smithi175 ceph-mon[22392]: overall HEALTH_OK 2024-08-20T01:28:41.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:41 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:41.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:41 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:41.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:41 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:41.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:41 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:41.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:41 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T01:28:41.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:41 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:28:41.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:41 smithi079 ceph-mon[18656]: mon.a calling monitor election 2024-08-20T01:28:41.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:41 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:28:41.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:41 smithi079 ceph-mon[18656]: mon.c calling monitor election 2024-08-20T01:28:41.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:41 smithi079 ceph-mon[18656]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:41.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:41 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:28:41.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:41 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:28:41.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:41 smithi079 ceph-mon[18656]: mon.b calling monitor election 2024-08-20T01:28:41.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:41 smithi079 ceph-mon[18656]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:41.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:41 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:28:41.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:41 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:28:41.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:41 smithi079 ceph-mon[18656]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:41.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:41 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:28:41.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:41 smithi079 ceph-mon[18656]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-20T01:28:41.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:41 smithi079 ceph-mon[18656]: monmap epoch 3 2024-08-20T01:28:41.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:41 smithi079 ceph-mon[18656]: fsid 28484e9a-5e93-11ef-bccf-c7b262605968 2024-08-20T01:28:41.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:41 smithi079 ceph-mon[18656]: last_changed 2024-08-20T01:28:35.952216+0000 2024-08-20T01:28:41.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:41 smithi079 ceph-mon[18656]: created 2024-08-20T01:27:04.865800+0000 2024-08-20T01:28:41.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:41 smithi079 ceph-mon[18656]: min_mon_release 19 (squid) 2024-08-20T01:28:41.438 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:41 smithi079 ceph-mon[18656]: election_strategy: 1 2024-08-20T01:28:41.438 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:41 smithi079 ceph-mon[18656]: 0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2024-08-20T01:28:41.438 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:41 smithi079 ceph-mon[18656]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-08-20T01:28:41.438 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:41 smithi079 ceph-mon[18656]: 2: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.b 2024-08-20T01:28:41.438 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:41 smithi079 ceph-mon[18656]: fsmap 2024-08-20T01:28:41.438 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:41 smithi079 ceph-mon[18656]: osdmap e4: 0 total, 0 up, 0 in 2024-08-20T01:28:41.438 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:41 smithi079 ceph-mon[18656]: mgrmap e13: x(active, since 48s) 2024-08-20T01:28:41.438 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:41 smithi079 ceph-mon[18656]: overall HEALTH_OK 2024-08-20T01:28:41.438 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:41 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:41.438 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:41 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:41.438 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:41 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:41.438 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:41 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:41.839 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-08-20T01:28:41.839 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":3,"fsid":"28484e9a-5e93-11ef-bccf-c7b262605968","modified":"2024-08-20T01:28:35.952216Z","created":"2024-08-20T01:27:04.865800Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:3300","nonce":0},{"type":"v1","addr":"172.21.15.79:6789","nonce":0}]},"addr":"172.21.15.79:6789/0","public_addr":"172.21.15.79:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-08-20T01:28:41.839 INFO:teuthology.orchestra.run.smithi175.stderr:dumped monmap epoch 3 2024-08-20T01:28:42.387 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:42 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:28:42.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:42 smithi175 ceph-mon[22392]: from='client.? 172.21.15.175:0/1968689374' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-20T01:28:42.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:42 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:28:42.435 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:42 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:28:42.435 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:42 smithi079 ceph-mon[18656]: from='client.? 172.21.15.175:0/1968689374' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-20T01:28:42.435 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:42 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:28:42.526 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:42 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:28:42.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:42 smithi081 ceph-mon[22209]: from='client.? 172.21.15.175:0/1968689374' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-20T01:28:42.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:42 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:28:42.758 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-08-20T01:28:42.758 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph config generate-minimal-conf 2024-08-20T01:28:43.010 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:43.367 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:43 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.367 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:43 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.367 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:43 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.367 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:43 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.367 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:43 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:43.367 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:43 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:28:43.367 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:43 smithi079 ceph-mon[18656]: Updating smithi079:/etc/ceph/ceph.conf 2024-08-20T01:28:43.367 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:43 smithi079 ceph-mon[18656]: Updating smithi081:/etc/ceph/ceph.conf 2024-08-20T01:28:43.367 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:43 smithi079 ceph-mon[18656]: Updating smithi175:/etc/ceph/ceph.conf 2024-08-20T01:28:43.368 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:43 smithi079 ceph-mon[18656]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:43.368 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:43 smithi079 ceph-mon[18656]: Updating smithi081:/var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T01:28:43.368 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:43 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.368 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:43 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.368 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:43 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.368 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:43 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.368 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:43 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.368 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:43 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.368 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:43 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.368 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:43 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.368 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:43 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.368 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:43 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.369 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:43 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.369 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:43 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.369 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:43 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T01:28:43.369 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:43 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-20T01:28:43.369 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:43 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:43.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:43 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:43 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:43 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:43 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:43 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:43.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:43 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:28:43.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:43 smithi175 ceph-mon[22392]: Updating smithi079:/etc/ceph/ceph.conf 2024-08-20T01:28:43.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:43 smithi175 ceph-mon[22392]: Updating smithi081:/etc/ceph/ceph.conf 2024-08-20T01:28:43.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:43 smithi175 ceph-mon[22392]: Updating smithi175:/etc/ceph/ceph.conf 2024-08-20T01:28:43.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:43 smithi175 ceph-mon[22392]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:43.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:43 smithi175 ceph-mon[22392]: Updating smithi081:/var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T01:28:43.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:43 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:43 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:43 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:43 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:43 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:43 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:43 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:43 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:43 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:43 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:43 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:43 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:43 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T01:28:43.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:43 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-20T01:28:43.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:43 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:43.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:43 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:43 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:43 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:43 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:43 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:43.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:43 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:28:43.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:43 smithi081 ceph-mon[22209]: Updating smithi079:/etc/ceph/ceph.conf 2024-08-20T01:28:43.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:43 smithi081 ceph-mon[22209]: Updating smithi081:/etc/ceph/ceph.conf 2024-08-20T01:28:43.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:43 smithi081 ceph-mon[22209]: Updating smithi175:/etc/ceph/ceph.conf 2024-08-20T01:28:43.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:43 smithi081 ceph-mon[22209]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:43.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:43 smithi081 ceph-mon[22209]: Updating smithi081:/var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T01:28:43.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:43 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:43 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:43 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:43 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:43 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:43 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:43 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:43 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:43 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:43 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:43 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:43 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:43.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:43 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T01:28:43.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:43 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-20T01:28:43.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:43 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:44.260 INFO:teuthology.orchestra.run.smithi079.stdout:# minimal ceph.conf for 28484e9a-5e93-11ef-bccf-c7b262605968 2024-08-20T01:28:44.260 INFO:teuthology.orchestra.run.smithi079.stdout:[global] 2024-08-20T01:28:44.260 INFO:teuthology.orchestra.run.smithi079.stdout: fsid = 28484e9a-5e93-11ef-bccf-c7b262605968 2024-08-20T01:28:44.260 INFO:teuthology.orchestra.run.smithi079.stdout: mon_host = [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] 2024-08-20T01:28:44.387 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:44 smithi175 ceph-mon[22392]: Updating smithi175:/var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T01:28:44.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:44 smithi175 ceph-mon[22392]: Updating smithi079:/var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T01:28:44.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:44 smithi175 ceph-mon[22392]: Reconfiguring mon.a (unknown last config time)... 2024-08-20T01:28:44.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:44 smithi175 ceph-mon[22392]: Reconfiguring daemon mon.a on smithi079 2024-08-20T01:28:44.435 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:44 smithi079 ceph-mon[18656]: Updating smithi175:/var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T01:28:44.435 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:44 smithi079 ceph-mon[18656]: Updating smithi079:/var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T01:28:44.435 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:44 smithi079 ceph-mon[18656]: Reconfiguring mon.a (unknown last config time)... 2024-08-20T01:28:44.435 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:44 smithi079 ceph-mon[18656]: Reconfiguring daemon mon.a on smithi079 2024-08-20T01:28:44.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:44 smithi081 ceph-mon[22209]: Updating smithi175:/var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T01:28:44.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:44 smithi081 ceph-mon[22209]: Updating smithi079:/var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T01:28:44.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:44 smithi081 ceph-mon[22209]: Reconfiguring mon.a (unknown last config time)... 2024-08-20T01:28:44.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:44 smithi081 ceph-mon[22209]: Reconfiguring daemon mon.a on smithi079 2024-08-20T01:28:45.168 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:45 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/1411577263' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:45.168 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:45 smithi079 ceph-mon[18656]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:45.168 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:45 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:45.168 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:45 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:45.168 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:45 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T01:28:45.168 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:45 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-20T01:28:45.168 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:45 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:45.193 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-08-20T01:28:45.193 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-08-20T01:28:45.193 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/ceph/ceph.conf 2024-08-20T01:28:45.220 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-08-20T01:28:45.220 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-20T01:28:45.253 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:45 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/1411577263' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:45.253 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:45 smithi081 ceph-mon[22209]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:45.253 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:45 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:45.253 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:45 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:45.253 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:45 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T01:28:45.253 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:45 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-20T01:28:45.253 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:45 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:45.285 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-08-20T01:28:45.285 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.conf 2024-08-20T01:28:45.313 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-08-20T01:28:45.314 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-20T01:28:45.380 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-08-20T01:28:45.380 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/ceph/ceph.conf 2024-08-20T01:28:45.410 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:45 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/1411577263' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:45.410 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:45 smithi175 ceph-mon[22392]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:45.411 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:45 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:45.411 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:45 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:45.411 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:45 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T01:28:45.411 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:45 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-20T01:28:45.411 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:45 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:45.413 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-08-20T01:28:45.413 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-20T01:28:45.483 INFO:tasks.cephadm:Adding mgr.x on smithi079 2024-08-20T01:28:45.483 INFO:tasks.cephadm:Adding mgr.y on smithi081 2024-08-20T01:28:45.483 INFO:tasks.cephadm:Adding mgr.z on smithi175 2024-08-20T01:28:45.483 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph orch apply mgr '3;smithi079=x;smithi081=y;smithi175=z' 2024-08-20T01:28:45.766 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T01:28:46.395 INFO:teuthology.orchestra.run.smithi175.stdout:Scheduled mgr update... 2024-08-20T01:28:46.425 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:46 smithi175 ceph-mon[22392]: Reconfiguring mon.b (monmap changed)... 2024-08-20T01:28:46.425 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:46 smithi175 ceph-mon[22392]: Reconfiguring daemon mon.b on smithi081 2024-08-20T01:28:46.425 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:46 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:46.425 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:46 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:46.425 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:46 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T01:28:46.425 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:46 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-20T01:28:46.425 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:46 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:46.435 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:46 smithi079 ceph-mon[18656]: Reconfiguring mon.b (monmap changed)... 2024-08-20T01:28:46.435 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:46 smithi079 ceph-mon[18656]: Reconfiguring daemon mon.b on smithi081 2024-08-20T01:28:46.435 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:46 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:46.435 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:46 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:46.435 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:46 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T01:28:46.435 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:46 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-20T01:28:46.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:46 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:46.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:46 smithi081 ceph-mon[22209]: Reconfiguring mon.b (monmap changed)... 2024-08-20T01:28:46.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:46 smithi081 ceph-mon[22209]: Reconfiguring daemon mon.b on smithi081 2024-08-20T01:28:46.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:46 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:46.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:46 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:46.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:46 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T01:28:46.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:46 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-20T01:28:46.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:46 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:47.405 DEBUG:teuthology.orchestra.run.smithi081:mgr.y> sudo journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mgr.y.service 2024-08-20T01:28:47.408 DEBUG:teuthology.orchestra.run.smithi175:mgr.z> sudo journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mgr.z.service 2024-08-20T01:28:47.411 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-08-20T01:28:47.411 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph config set client client_mount_timeout 600 2024-08-20T01:28:47.414 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-08-20T01:28:47.414 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph config set client debug_client 20 2024-08-20T01:28:47.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:47 smithi175 ceph-mon[22392]: Reconfiguring mon.c (monmap changed)... 2024-08-20T01:28:47.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:47 smithi175 ceph-mon[22392]: Reconfiguring daemon mon.c on smithi175 2024-08-20T01:28:47.432 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:47 smithi175 ceph-mon[22392]: from='client.14214 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi079=x;smithi081=y;smithi175=z", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:28:47.432 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:47 smithi175 ceph-mon[22392]: Saving service mgr spec with placement smithi079=x;smithi081=y;smithi175=z;count:3 2024-08-20T01:28:47.432 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:47 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:47.432 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:47 smithi175 ceph-mon[22392]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:47.456 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-08-20T01:28:47.456 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph config set client debug_ms 1 2024-08-20T01:28:47.500 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-08-20T01:28:47.500 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph config set client rados_mon_op_timeout 900 2024-08-20T01:28:47.545 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-08-20T01:28:47.545 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph config set client rados_osd_op_timeout 900 2024-08-20T01:28:47.588 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-08-20T01:28:47.588 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph config set mds debug_mds 20 2024-08-20T01:28:47.631 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-08-20T01:28:47.631 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph config set mds debug_mds_balancer 20 2024-08-20T01:28:47.660 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:47 smithi079 ceph-mon[18656]: Reconfiguring mon.c (monmap changed)... 2024-08-20T01:28:47.661 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:47 smithi079 ceph-mon[18656]: Reconfiguring daemon mon.c on smithi175 2024-08-20T01:28:47.661 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:47 smithi079 ceph-mon[18656]: from='client.14214 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi079=x;smithi081=y;smithi175=z", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:28:47.661 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:47 smithi079 ceph-mon[18656]: Saving service mgr spec with placement smithi079=x;smithi081=y;smithi175=z;count:3 2024-08-20T01:28:47.661 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:47 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:47.661 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:47 smithi079 ceph-mon[18656]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:47.662 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-08-20T01:28:47.662 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph config set mds debug_ms 2 2024-08-20T01:28:47.707 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-08-20T01:28:47.707 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-08-20T01:28:47.715 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:47.718 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-08-20T01:28:47.718 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph config set mds mds_bal_merge_size 5 2024-08-20T01:28:47.772 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-08-20T01:28:47.772 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph config set mds mds_bal_split_bits 3 2024-08-20T01:28:47.776 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:47 smithi081 ceph-mon[22209]: Reconfiguring mon.c (monmap changed)... 2024-08-20T01:28:47.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:47 smithi081 ceph-mon[22209]: Reconfiguring daemon mon.c on smithi175 2024-08-20T01:28:47.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:47 smithi081 ceph-mon[22209]: from='client.14214 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi079=x;smithi081=y;smithi175=z", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:28:47.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:47 smithi081 ceph-mon[22209]: Saving service mgr spec with placement smithi079=x;smithi081=y;smithi175=z;count:3 2024-08-20T01:28:47.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:47 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:47.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:47 smithi081 ceph-mon[22209]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:47.816 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-08-20T01:28:47.816 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph config set mds mds_bal_split_size 100 2024-08-20T01:28:47.859 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-08-20T01:28:47.859 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph config set mds mds_debug_frag True 2024-08-20T01:28:47.904 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-08-20T01:28:47.904 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph config set mds mds_debug_scatterstat True 2024-08-20T01:28:47.947 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-08-20T01:28:47.947 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph config set mds mds_op_complaint_time 180 2024-08-20T01:28:47.991 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-08-20T01:28:47.991 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph config set mds mds_verify_scatter True 2024-08-20T01:28:48.034 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-08-20T01:28:48.035 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph config set mds osd_op_complaint_time 180 2024-08-20T01:28:48.086 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-08-20T01:28:48.086 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph config set mds rados_mon_op_timeout 900 2024-08-20T01:28:48.132 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-08-20T01:28:48.133 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph config set mds rados_osd_op_timeout 900 2024-08-20T01:28:48.186 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-08-20T01:28:48.186 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph config set mon mon_op_complaint_time 120 2024-08-20T01:28:48.236 INFO:tasks.cephadm:setting config [mon] mon_warn_on_pool_no_app = False 2024-08-20T01:28:48.236 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph config set mon mon_warn_on_pool_no_app False 2024-08-20T01:28:48.292 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-08-20T01:28:48.292 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph config set osd osd_op_complaint_time 180 2024-08-20T01:28:48.345 DEBUG:tasks.cephadm:set 22 configs 2024-08-20T01:28:48.345 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '28484e9a-5e93-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi079') 2024-08-20T01:28:48.564 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:48.615 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:49.122 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:48 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:49.123 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:48 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:49.123 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:48 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:28:49.123 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:48 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:49.123 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:48 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:28:49.123 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:48 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:49.123 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:48 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-20T01:28:49.123 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:48 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-20T01:28:49.123 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:48 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-20T01:28:49.123 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:48 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:49.124 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:48 smithi175 ceph-mon[22392]: Deploying daemon mgr.z on smithi175 2024-08-20T01:28:49.124 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:48 smithi175 ceph-mon[22392]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:49.124 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:48 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2035474513' entity='client.admin' 2024-08-20T01:28:49.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:48 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:49.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:48 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:49.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:48 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:28:49.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:48 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:49.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:48 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:28:49.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:48 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:49.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:48 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-20T01:28:49.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:48 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-20T01:28:49.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:48 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-20T01:28:49.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:48 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:49.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:48 smithi079 ceph-mon[18656]: Deploying daemon mgr.z on smithi175 2024-08-20T01:28:49.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:48 smithi079 ceph-mon[18656]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:49.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:48 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2035474513' entity='client.admin' 2024-08-20T01:28:49.195 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:49.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:48 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:49.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:48 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:49.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:48 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:28:49.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:48 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:49.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:48 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:28:49.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:48 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:49.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:48 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-20T01:28:49.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:48 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-20T01:28:49.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:48 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-20T01:28:49.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:48 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:49.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:48 smithi081 ceph-mon[22209]: Deploying daemon mgr.z on smithi175 2024-08-20T01:28:49.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:48 smithi081 ceph-mon[22209]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:49.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:48 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2035474513' entity='client.admin' 2024-08-20T01:28:49.638 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Aug 20 01:28:49 smithi175 systemd[1]: Starting Ceph mgr.z for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:28:49.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.680+0000 7ff1ab94e640 1 -- 172.21.15.79:0/1966019320 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff19003ed60 msgr2=0x7ff190041220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:49.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.680+0000 7ff1ab94e640 1 --2- 172.21.15.79:0/1966019320 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff19003ed60 0x7ff190041220 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff194009a20 tx=0x7ff194005f10 comp rx=0 tx=0).stop 2024-08-20T01:28:49.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.680+0000 7ff1ab94e640 1 -- 172.21.15.79:0/1966019320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1a4101650 msgr2=0x7ff1a406bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:49.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.680+0000 7ff1ab94e640 1 --2- 172.21.15.79:0/1966019320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1a4101650 0x7ff1a406bad0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff1a000d950 tx=0x7ff1a000de10 comp rx=0 tx=0).stop 2024-08-20T01:28:49.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.680+0000 7ff1ab94e640 1 -- 172.21.15.79:0/1966019320 shutdown_connections 2024-08-20T01:28:49.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.680+0000 7ff1ab94e640 1 --2- 172.21.15.79:0/1966019320 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff19003ed60 0x7ff190041220 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:49.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.680+0000 7ff1ab94e640 1 --2- 172.21.15.79:0/1966019320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1a4103170 0x7ff1a419fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:49.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.680+0000 7ff1ab94e640 1 --2- 172.21.15.79:0/1966019320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1a41027b0 0x7ff1a419d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:49.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.680+0000 7ff1ab94e640 1 --2- 172.21.15.79:0/1966019320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1a4101650 0x7ff1a406bad0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:49.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.680+0000 7ff1ab94e640 1 -- 172.21.15.79:0/1966019320 >> 172.21.15.79:0/1966019320 conn(0x7ff1a40fcf00 msgr2=0x7ff1a4105d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:49.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.680+0000 7ff1ab94e640 1 -- 172.21.15.79:0/1966019320 shutdown_connections 2024-08-20T01:28:49.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.680+0000 7ff1ab94e640 1 -- 172.21.15.79:0/1966019320 wait complete. 2024-08-20T01:28:50.005 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Aug 20 01:28:49 smithi175 podman[23949]: 2024-08-20 01:28:49.652437197 +0000 UTC m=+0.015316841 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:28:50.005 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Aug 20 01:28:49 smithi175 podman[23949]: 2024-08-20 01:28:49.757950839 +0000 UTC m=+0.120830468 container create 2f5bfd5c2c46f8047e59ac80c96f1a4e6a812e313f30fa6b26bad1aa049ddd23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-z, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0) 2024-08-20T01:28:50.005 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Aug 20 01:28:49 smithi175 podman[23949]: 2024-08-20 01:28:49.977116663 +0000 UTC m=+0.339996290 container init 2f5bfd5c2c46f8047e59ac80c96f1a4e6a812e313f30fa6b26bad1aa049ddd23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-08-20T01:28:50.005 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Aug 20 01:28:49 smithi175 podman[23949]: 2024-08-20 01:28:49.980002962 +0000 UTC m=+0.342882590 container start 2f5bfd5c2c46f8047e59ac80c96f1a4e6a812e313f30fa6b26bad1aa049ddd23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-z, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.36.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-08-20T01:28:50.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.776+0000 7f1115ee9640 1 -- 172.21.15.79:0/524779517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1110102770 msgr2=0x7f1110102bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:50.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.776+0000 7f1115ee9640 1 --2- 172.21.15.79:0/524779517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1110102770 0x7f1110102bf0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f10f8009930 tx=0x7f10f802a420 comp rx=0 tx=0).stop 2024-08-20T01:28:50.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.777+0000 7f1115ee9640 1 -- 172.21.15.79:0/524779517 shutdown_connections 2024-08-20T01:28:50.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.777+0000 7f1115ee9640 1 --2- 172.21.15.79:0/524779517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1110103130 0x7f1110109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:50.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.777+0000 7f1115ee9640 1 --2- 172.21.15.79:0/524779517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1110102770 0x7f1110102bf0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:50.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.777+0000 7f1115ee9640 1 --2- 172.21.15.79:0/524779517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1110101610 0x7f1110101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:50.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.777+0000 7f1115ee9640 1 -- 172.21.15.79:0/524779517 >> 172.21.15.79:0/524779517 conn(0x7f11100fcee0 msgr2=0x7f11100ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:50.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.777+0000 7f1115ee9640 1 -- 172.21.15.79:0/524779517 shutdown_connections 2024-08-20T01:28:50.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.777+0000 7f1115ee9640 1 -- 172.21.15.79:0/524779517 wait complete. 2024-08-20T01:28:50.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.777+0000 7f1115ee9640 1 Processor -- start 2024-08-20T01:28:50.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.778+0000 7f1115ee9640 1 -- start start 2024-08-20T01:28:50.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.778+0000 7f1115ee9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1110101610 0x7f11101987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:50.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.778+0000 7f1115ee9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1110102770 0x7f1110198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:50.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.778+0000 7f1115ee9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1110103130 0x7f1110199a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:50.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.778+0000 7f1115ee9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f111010cdf0 con 0x7f1110102770 2024-08-20T01:28:50.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.778+0000 7f1115ee9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f111010cc70 con 0x7f1110103130 2024-08-20T01:28:50.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.778+0000 7f1115ee9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f111010cf70 con 0x7f1110101610 2024-08-20T01:28:50.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.778+0000 7f110effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1110102770 0x7f1110198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:50.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.778+0000 7f110effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1110102770 0x7f1110198e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36590/0 (socket says 172.21.15.79:36590) 2024-08-20T01:28:50.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.778+0000 7f110effd640 1 -- 172.21.15.79:0/957057033 learned_addr learned my addr 172.21.15.79:0/957057033 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:28:50.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.778+0000 7f110ffff640 1 --2- 172.21.15.79:0/957057033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1110103130 0x7f1110199a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:50.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.778+0000 7f110f7fe640 1 --2- 172.21.15.79:0/957057033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1110101610 0x7f11101987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:50.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.778+0000 7f110effd640 1 -- 172.21.15.79:0/957057033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1110101610 msgr2=0x7f11101987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:50.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.778+0000 7f110effd640 1 --2- 172.21.15.79:0/957057033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1110101610 0x7f11101987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:50.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.778+0000 7f110effd640 1 -- 172.21.15.79:0/957057033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1110103130 msgr2=0x7f1110199a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:50.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.778+0000 7f110effd640 1 --2- 172.21.15.79:0/957057033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1110103130 0x7f1110199a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:50.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.778+0000 7f110effd640 1 -- 172.21.15.79:0/957057033 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f111019a2f0 con 0x7f1110102770 2024-08-20T01:28:50.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.778+0000 7f110effd640 1 --2- 172.21.15.79:0/957057033 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1110102770 0x7f1110198e10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f10f8004fd0 tx=0x7f10f8004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:50.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.779+0000 7f110cff9640 1 -- 172.21.15.79:0/957057033 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f803f070 con 0x7f1110102770 2024-08-20T01:28:50.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.779+0000 7f110cff9640 1 -- 172.21.15.79:0/957057033 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(22 keys) ==== 976+0+0 (secure 0 0 0) 0x7f10f8031ce0 con 0x7f1110102770 2024-08-20T01:28:50.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.779+0000 7f1115ee9640 1 -- 172.21.15.79:0/957057033 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f111019a580 con 0x7f1110102770 2024-08-20T01:28:50.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.779+0000 7f110cff9640 1 -- 172.21.15.79:0/957057033 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f8035030 con 0x7f1110102770 2024-08-20T01:28:50.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.779+0000 7f1115ee9640 1 -- 172.21.15.79:0/957057033 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11101a0cc0 con 0x7f1110102770 2024-08-20T01:28:50.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.780+0000 7f110cff9640 1 -- 172.21.15.79:0/957057033 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 13) ==== 50747+0+0 (secure 0 0 0) 0x7f10f8042070 con 0x7f1110102770 2024-08-20T01:28:50.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.780+0000 7f1115ee9640 1 -- 172.21.15.79:0/957057033 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1110101a10 con 0x7f1110102770 2024-08-20T01:28:50.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.780+0000 7f110cff9640 1 --2- 172.21.15.79:0/957057033 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f10fc03ed60 0x7f10fc041220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:50.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.780+0000 7f110cff9640 1 -- 172.21.15.79:0/957057033 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f10f8073c60 con 0x7f1110102770 2024-08-20T01:28:50.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.780+0000 7f110f7fe640 1 --2- 172.21.15.79:0/957057033 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f10fc03ed60 0x7f10fc041220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:50.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.780+0000 7f110f7fe640 1 --2- 172.21.15.79:0/957057033 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f10fc03ed60 0x7f10fc041220 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1100005fd0 tx=0x7f1100009870 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:50.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.784+0000 7f110cff9640 1 -- 172.21.15.79:0/957057033 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f10f8037d90 con 0x7f1110102770 2024-08-20T01:28:50.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.963+0000 7f1115ee9640 1 -- 172.21.15.79:0/957057033 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f11101a0fb0 con 0x7f1110102770 2024-08-20T01:28:50.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.966+0000 7f110cff9640 1 -- 172.21.15.79:0/957057033 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v12)=0 v12) ==== 114+0+0 (secure 0 0 0) 0x7f10f80038a0 con 0x7f1110102770 2024-08-20T01:28:50.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.967+0000 7f110cff9640 1 -- 172.21.15.79:0/957057033 <== mon.0 v2:172.21.15.79:3300/0 8 ==== config(23 keys) ==== 1001+0+0 (secure 0 0 0) 0x7f10f8079080 con 0x7f1110102770 2024-08-20T01:28:50.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.968+0000 7f1115ee9640 1 -- 172.21.15.79:0/957057033 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f10fc03ed60 msgr2=0x7f10fc041220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:50.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.968+0000 7f1115ee9640 1 --2- 172.21.15.79:0/957057033 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f10fc03ed60 0x7f10fc041220 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1100005fd0 tx=0x7f1100009870 comp rx=0 tx=0).stop 2024-08-20T01:28:50.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.968+0000 7f1115ee9640 1 -- 172.21.15.79:0/957057033 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1110102770 msgr2=0x7f1110198e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:50.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.968+0000 7f1115ee9640 1 --2- 172.21.15.79:0/957057033 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1110102770 0x7f1110198e10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f10f8004fd0 tx=0x7f10f8004360 comp rx=0 tx=0).stop 2024-08-20T01:28:50.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.968+0000 7f1115ee9640 1 -- 172.21.15.79:0/957057033 shutdown_connections 2024-08-20T01:28:50.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.968+0000 7f1115ee9640 1 --2- 172.21.15.79:0/957057033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1110103130 0x7f1110199a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:50.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.968+0000 7f1115ee9640 1 --2- 172.21.15.79:0/957057033 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1110102770 0x7f1110198e10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:50.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.968+0000 7f1115ee9640 1 --2- 172.21.15.79:0/957057033 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f10fc03ed60 0x7f10fc041220 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:50.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.968+0000 7f1115ee9640 1 --2- 172.21.15.79:0/957057033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1110101610 0x7f11101987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:50.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.968+0000 7f1115ee9640 1 -- 172.21.15.79:0/957057033 >> 172.21.15.79:0/957057033 conn(0x7f11100fcee0 msgr2=0x7f111006a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:50.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.969+0000 7f1115ee9640 1 -- 172.21.15.79:0/957057033 shutdown_connections 2024-08-20T01:28:50.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:49.969+0000 7f1115ee9640 1 -- 172.21.15.79:0/957057033 wait complete. 2024-08-20T01:28:50.388 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Aug 20 01:28:50 smithi175 ceph-mgr[23968]: -- 172.21.15.175:0/266772460 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559120ab30e0 con 0x559120a91400 2024-08-20T01:28:50.388 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Aug 20 01:28:50 smithi175 bash[23949]: 2f5bfd5c2c46f8047e59ac80c96f1a4e6a812e313f30fa6b26bad1aa049ddd23 2024-08-20T01:28:50.388 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Aug 20 01:28:50 smithi175 systemd[1]: Started Ceph mgr.z for 28484e9a-5e93-11ef-bccf-c7b262605968. 2024-08-20T01:28:50.814 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:50 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/1966019320' entity='client.admin' 2024-08-20T01:28:50.814 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:50 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/957057033' entity='client.admin' 2024-08-20T01:28:50.814 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:50 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:50.814 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:50 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:50.815 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:50 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:50.815 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:50 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-20T01:28:50.815 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:50 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-20T01:28:50.815 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:50 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-20T01:28:50.815 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:50 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:50.815 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:50 smithi081 ceph-mon[22209]: Deploying daemon mgr.y on smithi081 2024-08-20T01:28:50.815 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:50 smithi081 ceph-mon[22209]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:50.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:50 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/1966019320' entity='client.admin' 2024-08-20T01:28:50.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:50 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/957057033' entity='client.admin' 2024-08-20T01:28:50.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:50 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:50.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:50 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:50.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:50 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:50.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:50 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-20T01:28:50.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:50 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-20T01:28:50.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:50 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-20T01:28:50.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:50 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:50.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:50 smithi079 ceph-mon[18656]: Deploying daemon mgr.y on smithi081 2024-08-20T01:28:50.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:50 smithi079 ceph-mon[18656]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:51.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:50 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/1966019320' entity='client.admin' 2024-08-20T01:28:51.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:50 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/957057033' entity='client.admin' 2024-08-20T01:28:51.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:50 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:51.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:50 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:51.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:50 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:51.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:50 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-20T01:28:51.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:50 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-20T01:28:51.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:50 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-20T01:28:51.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:50 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:51.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:50 smithi175 ceph-mon[22392]: Deploying daemon mgr.y on smithi081 2024-08-20T01:28:51.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:50 smithi175 ceph-mon[22392]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:51.523 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '28484e9a-5e93-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi079') 2024-08-20T01:28:51.524 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '28484e9a-5e93-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi079') 2024-08-20T01:28:51.524 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '28484e9a-5e93-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi079') 2024-08-20T01:28:51.598 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:51.598 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:52.157 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Aug 20 01:28:51 smithi081 systemd[1]: Starting Ceph mgr.y for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:28:52.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.208+0000 7effa8350640 1 -- 172.21.15.79:0/3146455946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effa0103160 msgr2=0x7effa0109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:52.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.208+0000 7effa8350640 1 --2- 172.21.15.79:0/3146455946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effa0103160 0x7effa0109cb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7eff98009cd0 tx=0x7eff9802a8d0 comp rx=0 tx=0).stop 2024-08-20T01:28:52.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.208+0000 7effa8350640 1 -- 172.21.15.79:0/3146455946 shutdown_connections 2024-08-20T01:28:52.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.208+0000 7effa8350640 1 --2- 172.21.15.79:0/3146455946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effa0103160 0x7effa0109cb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:52.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.208+0000 7effa8350640 1 --2- 172.21.15.79:0/3146455946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effa01025f0 0x7effa0102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:52.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.208+0000 7effa8350640 1 --2- 172.21.15.79:0/3146455946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effa0101cb0 0x7effa01020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:52.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.208+0000 7effa8350640 1 -- 172.21.15.79:0/3146455946 >> 172.21.15.79:0/3146455946 conn(0x7effa00fc690 msgr2=0x7effa00fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:52.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.208+0000 7effa8350640 1 -- 172.21.15.79:0/3146455946 shutdown_connections 2024-08-20T01:28:52.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.208+0000 7effa8350640 1 -- 172.21.15.79:0/3146455946 wait complete. 2024-08-20T01:28:52.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.209+0000 7effa8350640 1 Processor -- start 2024-08-20T01:28:52.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.209+0000 7effa8350640 1 -- start start 2024-08-20T01:28:52.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.209+0000 7effa8350640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effa0101cb0 0x7effa0198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:52.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.209+0000 7effa8350640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effa01025f0 0x7effa0198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:52.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.209+0000 7effa8350640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effa0103160 0x7effa0199ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:52.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.209+0000 7effa8350640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7effa010cef0 con 0x7effa0103160 2024-08-20T01:28:52.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.209+0000 7effa8350640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7effa010cd70 con 0x7effa0101cb0 2024-08-20T01:28:52.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.209+0000 7effa8350640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7effa010d070 con 0x7effa01025f0 2024-08-20T01:28:52.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.209+0000 7effa68ed640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effa0103160 0x7effa0199ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:52.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.209+0000 7effa68ed640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effa0103160 0x7effa0199ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57878/0 (socket says 172.21.15.79:57878) 2024-08-20T01:28:52.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.209+0000 7effa68ed640 1 -- 172.21.15.79:0/1203816669 learned_addr learned my addr 172.21.15.79:0/1203816669 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:28:52.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.209+0000 7effa58eb640 1 --2- 172.21.15.79:0/1203816669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effa01025f0 0x7effa0198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:52.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.209+0000 7effa60ec640 1 --2- 172.21.15.79:0/1203816669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effa0101cb0 0x7effa0198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:52.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.209+0000 7effa68ed640 1 -- 172.21.15.79:0/1203816669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effa01025f0 msgr2=0x7effa0198e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:52.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.209+0000 7effa68ed640 1 --2- 172.21.15.79:0/1203816669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effa01025f0 0x7effa0198e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:52.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.209+0000 7effa68ed640 1 -- 172.21.15.79:0/1203816669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effa0101cb0 msgr2=0x7effa0198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:52.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.209+0000 7effa68ed640 1 --2- 172.21.15.79:0/1203816669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effa0101cb0 0x7effa0198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:52.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.209+0000 7effa68ed640 1 -- 172.21.15.79:0/1203816669 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa019a370 con 0x7effa0103160 2024-08-20T01:28:52.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.209+0000 7effa58eb640 1 --2- 172.21.15.79:0/1203816669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effa01025f0 0x7effa0198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:28:52.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.210+0000 7effa68ed640 1 --2- 172.21.15.79:0/1203816669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effa0103160 0x7effa0199ad0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7eff980097b0 tx=0x7eff98031c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:52.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.210+0000 7eff937fe640 1 -- 172.21.15.79:0/1203816669 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff98003b70 con 0x7effa0103160 2024-08-20T01:28:52.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.210+0000 7eff937fe640 1 -- 172.21.15.79:0/1203816669 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(23 keys) ==== 1001+0+0 (secure 0 0 0) 0x7eff98003d10 con 0x7effa0103160 2024-08-20T01:28:52.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.210+0000 7effa8350640 1 -- 172.21.15.79:0/1203816669 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effa019a600 con 0x7effa0103160 2024-08-20T01:28:52.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.210+0000 7eff937fe640 1 -- 172.21.15.79:0/1203816669 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff980307d0 con 0x7effa0103160 2024-08-20T01:28:52.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.210+0000 7effa8350640 1 -- 172.21.15.79:0/1203816669 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effa01a0d40 con 0x7effa0103160 2024-08-20T01:28:52.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.211+0000 7eff937fe640 1 -- 172.21.15.79:0/1203816669 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 13) ==== 50747+0+0 (secure 0 0 0) 0x7eff98030a30 con 0x7effa0103160 2024-08-20T01:28:52.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.211+0000 7effa8350640 1 -- 172.21.15.79:0/1203816669 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effa01020b0 con 0x7effa0103160 2024-08-20T01:28:52.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.211+0000 7eff937fe640 1 --2- 172.21.15.79:0/1203816669 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7eff8c03ed60 0x7eff8c041220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:52.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.211+0000 7eff937fe640 1 -- 172.21.15.79:0/1203816669 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7eff98074420 con 0x7effa0103160 2024-08-20T01:28:52.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.211+0000 7effa60ec640 1 --2- 172.21.15.79:0/1203816669 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7eff8c03ed60 0x7eff8c041220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:52.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.211+0000 7effa60ec640 1 --2- 172.21.15.79:0/1203816669 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7eff8c03ed60 0x7eff8c041220 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7eff9c009b60 tx=0x7eff9c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:52.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.215+0000 7eff937fe640 1 -- 172.21.15.79:0/1203816669 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7eff98030d20 con 0x7effa0103160 2024-08-20T01:28:52.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.396+0000 7effa8350640 1 -- 172.21.15.79:0/1203816669 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7effa0109850 con 0x7effa0103160 2024-08-20T01:28:52.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.399+0000 7eff937fe640 1 -- 172.21.15.79:0/1203816669 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v13)=0 v13) ==== 127+0+0 (secure 0 0 0) 0x7eff9804edf0 con 0x7effa0103160 2024-08-20T01:28:52.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.401+0000 7effa8350640 1 -- 172.21.15.79:0/1203816669 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7eff8c03ed60 msgr2=0x7eff8c041220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:52.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.401+0000 7effa8350640 1 --2- 172.21.15.79:0/1203816669 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7eff8c03ed60 0x7eff8c041220 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7eff9c009b60 tx=0x7eff9c005f90 comp rx=0 tx=0).stop 2024-08-20T01:28:52.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.401+0000 7effa8350640 1 -- 172.21.15.79:0/1203816669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effa0103160 msgr2=0x7effa0199ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:52.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.401+0000 7effa8350640 1 --2- 172.21.15.79:0/1203816669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effa0103160 0x7effa0199ad0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7eff980097b0 tx=0x7eff98031c20 comp rx=0 tx=0).stop 2024-08-20T01:28:52.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.401+0000 7effa8350640 1 -- 172.21.15.79:0/1203816669 shutdown_connections 2024-08-20T01:28:52.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.401+0000 7effa8350640 1 --2- 172.21.15.79:0/1203816669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effa0103160 0x7effa0199ad0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:52.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.401+0000 7effa8350640 1 --2- 172.21.15.79:0/1203816669 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7eff8c03ed60 0x7eff8c041220 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:52.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.401+0000 7effa8350640 1 --2- 172.21.15.79:0/1203816669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effa01025f0 0x7effa0198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:52.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.401+0000 7effa8350640 1 --2- 172.21.15.79:0/1203816669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effa0101cb0 0x7effa0198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:52.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.401+0000 7effa8350640 1 -- 172.21.15.79:0/1203816669 >> 172.21.15.79:0/1203816669 conn(0x7effa00fc690 msgr2=0x7effa00fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:52.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.401+0000 7effa8350640 1 -- 172.21.15.79:0/1203816669 shutdown_connections 2024-08-20T01:28:52.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.402+0000 7effa8350640 1 -- 172.21.15.79:0/1203816669 wait complete. 2024-08-20T01:28:52.441 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Aug 20 01:28:52 smithi081 podman[23326]: 2024-08-20 01:28:52.15616612 +0000 UTC m=+0.097712760 container create 78334f5c956f78b7ecd406e89d3fd4c4e1f546a192e421d650d18137a9aa23a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-y, io.buildah.version=1.36.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-08-20T01:28:52.441 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Aug 20 01:28:52 smithi081 podman[23326]: 2024-08-20 01:28:52.074031756 +0000 UTC m=+0.015578369 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:28:52.442 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Aug 20 01:28:52 smithi081 podman[23326]: 2024-08-20 01:28:52.358431121 +0000 UTC m=+0.299977724 container init 78334f5c956f78b7ecd406e89d3fd4c4e1f546a192e421d650d18137a9aa23a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-y, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-08-20T01:28:52.442 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Aug 20 01:28:52 smithi081 podman[23326]: 2024-08-20 01:28:52.361218923 +0000 UTC m=+0.302765524 container start 78334f5c956f78b7ecd406e89d3fd4c4e1f546a192e421d650d18137a9aa23a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0) 2024-08-20T01:28:52.442 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Aug 20 01:28:52 smithi081 ceph-mgr[23345]: -- 172.21.15.81:0/930988615 <== mon.2 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ced545d0e0 con 0x55ced543a800 2024-08-20T01:28:52.777 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Aug 20 01:28:52 smithi081 bash[23326]: 78334f5c956f78b7ecd406e89d3fd4c4e1f546a192e421d650d18137a9aa23a0 2024-08-20T01:28:52.777 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Aug 20 01:28:52 smithi081 systemd[1]: Started Ceph mgr.y for 28484e9a-5e93-11ef-bccf-c7b262605968. 2024-08-20T01:28:52.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.814+0000 7fad9dfc3640 1 -- 172.21.15.79:0/25115056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad98103160 msgr2=0x7fad98109ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:52.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.814+0000 7fad9dfc3640 1 --2- 172.21.15.79:0/25115056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad98103160 0x7fad98109ae0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fad90009930 tx=0x7fad9002a420 comp rx=0 tx=0).stop 2024-08-20T01:28:52.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.814+0000 7fad9dfc3640 1 -- 172.21.15.79:0/25115056 shutdown_connections 2024-08-20T01:28:52.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.814+0000 7fad9dfc3640 1 --2- 172.21.15.79:0/25115056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad98103160 0x7fad98109ae0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:52.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.814+0000 7fad9dfc3640 1 --2- 172.21.15.79:0/25115056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad981027a0 0x7fad98102c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:52.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.814+0000 7fad9dfc3640 1 --2- 172.21.15.79:0/25115056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad98101640 0x7fad98101a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:52.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.814+0000 7fad9dfc3640 1 -- 172.21.15.79:0/25115056 >> 172.21.15.79:0/25115056 conn(0x7fad980fcf30 msgr2=0x7fad980ff350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:52.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.814+0000 7fad9dfc3640 1 -- 172.21.15.79:0/25115056 shutdown_connections 2024-08-20T01:28:52.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.814+0000 7fad9dfc3640 1 -- 172.21.15.79:0/25115056 wait complete. 2024-08-20T01:28:52.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.815+0000 7fad9dfc3640 1 Processor -- start 2024-08-20T01:28:52.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.815+0000 7fad9dfc3640 1 -- start start 2024-08-20T01:28:52.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.815+0000 7fad9dfc3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad98101640 0x7fad9806bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:52.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.815+0000 7fad9dfc3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad981027a0 0x7fad9819d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:52.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.815+0000 7fad9dfc3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad98103160 0x7fad9819fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:52.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.815+0000 7fad9dfc3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fad9810cf20 con 0x7fad98101640 2024-08-20T01:28:52.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.816+0000 7fad9dfc3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fad9810cda0 con 0x7fad981027a0 2024-08-20T01:28:52.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.816+0000 7fad9dfc3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fad9810d0a0 con 0x7fad98103160 2024-08-20T01:28:52.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.816+0000 7fad96ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad981027a0 0x7fad9819d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:52.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.816+0000 7fad977fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad98101640 0x7fad9806bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:52.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.816+0000 7fad96ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad981027a0 0x7fad9819d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:41010/0 (socket says 172.21.15.79:41010) 2024-08-20T01:28:52.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.816+0000 7fad96ffd640 1 -- 172.21.15.79:0/960342597 learned_addr learned my addr 172.21.15.79:0/960342597 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:28:52.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.816+0000 7fad977fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad98101640 0x7fad9806bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57892/0 (socket says 172.21.15.79:57892) 2024-08-20T01:28:52.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.816+0000 7fad97fff640 1 --2- 172.21.15.79:0/960342597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad98103160 0x7fad9819fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:52.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.816+0000 7fad96ffd640 1 -- 172.21.15.79:0/960342597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad98103160 msgr2=0x7fad9819fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:52.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.816+0000 7fad96ffd640 1 --2- 172.21.15.79:0/960342597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad98103160 0x7fad9819fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:52.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.816+0000 7fad96ffd640 1 -- 172.21.15.79:0/960342597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad98101640 msgr2=0x7fad9806bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:52.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.816+0000 7fad96ffd640 1 --2- 172.21.15.79:0/960342597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad98101640 0x7fad9806bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:52.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.816+0000 7fad96ffd640 1 -- 172.21.15.79:0/960342597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad981a0410 con 0x7fad981027a0 2024-08-20T01:28:52.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.816+0000 7fad96ffd640 1 --2- 172.21.15.79:0/960342597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad981027a0 0x7fad9819d510 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00e9f0 tx=0x7fad8c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:52.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.816+0000 7fad94ff9640 1 -- 172.21.15.79:0/960342597 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8c00cd80 con 0x7fad981027a0 2024-08-20T01:28:52.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.816+0000 7fad9dfc3640 1 -- 172.21.15.79:0/960342597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad981a0700 con 0x7fad981027a0 2024-08-20T01:28:52.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.816+0000 7fad94ff9640 1 -- 172.21.15.79:0/960342597 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(23 keys) ==== 1001+0+0 (secure 0 0 0) 0x7fad8c010880 con 0x7fad981027a0 2024-08-20T01:28:52.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.816+0000 7fad94ff9640 1 -- 172.21.15.79:0/960342597 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8c018660 con 0x7fad981027a0 2024-08-20T01:28:52.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.816+0000 7fad9dfc3640 1 -- 172.21.15.79:0/960342597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad981a0c90 con 0x7fad981027a0 2024-08-20T01:28:52.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.817+0000 7fad94ff9640 1 -- 172.21.15.79:0/960342597 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 50747+0+0 (secure 0 0 0) 0x7fad8c0188c0 con 0x7fad981027a0 2024-08-20T01:28:52.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.817+0000 7fad9dfc3640 1 -- 172.21.15.79:0/960342597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad98101a40 con 0x7fad981027a0 2024-08-20T01:28:52.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.818+0000 7fad94ff9640 1 --2- 172.21.15.79:0/960342597 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fad8003ed60 0x7fad80041220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:52.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.818+0000 7fad94ff9640 1 -- 172.21.15.79:0/960342597 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fad8c053810 con 0x7fad981027a0 2024-08-20T01:28:52.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.818+0000 7fad977fe640 1 --2- 172.21.15.79:0/960342597 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fad8003ed60 0x7fad80041220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:52.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.818+0000 7fad977fe640 1 --2- 172.21.15.79:0/960342597 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fad8003ed60 0x7fad80041220 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fad88005fd0 tx=0x7fad88009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:52.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:52.826+0000 7fad94ff9640 1 -- 172.21.15.79:0/960342597 <== mon.2 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fad8c020360 con 0x7fad981027a0 2024-08-20T01:28:52.830 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:52.832 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:52.838 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:52.841 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:52.854 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:53.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.060+0000 7fad9dfc3640 1 -- 172.21.15.79:0/960342597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fad98063a80 con 0x7fad981027a0 2024-08-20T01:28:53.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.065+0000 7fad94ff9640 1 -- 172.21.15.79:0/960342597 <== mon.2 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v14)=0 v14) ==== 106+0+0 (secure 0 0 0) 0x7fad8c013190 con 0x7fad981027a0 2024-08-20T01:28:53.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.068+0000 7fad9dfc3640 1 -- 172.21.15.79:0/960342597 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fad8003ed60 msgr2=0x7fad80041220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:53.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.068+0000 7fad9dfc3640 1 --2- 172.21.15.79:0/960342597 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fad8003ed60 0x7fad80041220 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fad88005fd0 tx=0x7fad88009680 comp rx=0 tx=0).stop 2024-08-20T01:28:53.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.068+0000 7fad9dfc3640 1 -- 172.21.15.79:0/960342597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad981027a0 msgr2=0x7fad9819d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:53.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.068+0000 7fad9dfc3640 1 --2- 172.21.15.79:0/960342597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad981027a0 0x7fad9819d510 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00e9f0 tx=0x7fad8c00eeb0 comp rx=0 tx=0).stop 2024-08-20T01:28:53.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.068+0000 7fad9dfc3640 1 -- 172.21.15.79:0/960342597 shutdown_connections 2024-08-20T01:28:53.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.068+0000 7fad9dfc3640 1 --2- 172.21.15.79:0/960342597 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fad8003ed60 0x7fad80041220 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:53.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.068+0000 7fad9dfc3640 1 --2- 172.21.15.79:0/960342597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad98103160 0x7fad9819fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:53.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.068+0000 7fad9dfc3640 1 --2- 172.21.15.79:0/960342597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad981027a0 0x7fad9819d510 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:53.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.068+0000 7fad9dfc3640 1 --2- 172.21.15.79:0/960342597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad98101640 0x7fad9806bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:53.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.068+0000 7fad9dfc3640 1 -- 172.21.15.79:0/960342597 >> 172.21.15.79:0/960342597 conn(0x7fad980fcf30 msgr2=0x7fad98105c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:53.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.068+0000 7fad9dfc3640 1 -- 172.21.15.79:0/960342597 shutdown_connections 2024-08-20T01:28:53.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.068+0000 7fad9dfc3640 1 -- 172.21.15.79:0/960342597 wait complete. 2024-08-20T01:28:53.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:53 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/1203816669' entity='client.admin' 2024-08-20T01:28:53.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:53 smithi081 ceph-mon[22209]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:53.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:53 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:53.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:53 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:53.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:53 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:53.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:53 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:53.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:53 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:28:53.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:53 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:53.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:53 smithi081 ceph-mon[22209]: from='client.? ' entity='client.admin' 2024-08-20T01:28:53.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:53 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/1203816669' entity='client.admin' 2024-08-20T01:28:53.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:53 smithi175 ceph-mon[22392]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:53.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:53 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:53.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:53 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:53.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:53 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:53.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:53 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:53.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:53 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:28:53.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:53 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:53.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:53 smithi175 ceph-mon[22392]: from='client.? ' entity='client.admin' 2024-08-20T01:28:53.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:53 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/1203816669' entity='client.admin' 2024-08-20T01:28:53.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:53 smithi079 ceph-mon[18656]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:53.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:53 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:53.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:53 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:53.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:53 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:53.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:53 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:53.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:53 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:28:53.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:53 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:53.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:53 smithi079 ceph-mon[18656]: from='client.? ' entity='client.admin' 2024-08-20T01:28:53.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.899+0000 7f0b3ce45640 1 -- 172.21.15.79:0/506890461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b38101640 msgr2=0x7f0b38101a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:53.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.899+0000 7f0b3ce45640 1 --2- 172.21.15.79:0/506890461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b38101640 0x7f0b38101a40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0b30009930 tx=0x7f0b3002a420 comp rx=0 tx=0).stop 2024-08-20T01:28:53.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.899+0000 7f0b3ce45640 1 -- 172.21.15.79:0/506890461 shutdown_connections 2024-08-20T01:28:53.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.899+0000 7f0b3ce45640 1 --2- 172.21.15.79:0/506890461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b38103160 0x7f0b38109ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:53.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.899+0000 7f0b3ce45640 1 --2- 172.21.15.79:0/506890461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b381027a0 0x7f0b38102c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:53.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.899+0000 7f0b3ce45640 1 --2- 172.21.15.79:0/506890461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b38101640 0x7f0b38101a40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:53.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.899+0000 7f0b3ce45640 1 -- 172.21.15.79:0/506890461 >> 172.21.15.79:0/506890461 conn(0x7f0b380fcf10 msgr2=0x7f0b380ff350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:53.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.899+0000 7f0b3ce45640 1 -- 172.21.15.79:0/506890461 shutdown_connections 2024-08-20T01:28:53.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.899+0000 7f0b3ce45640 1 -- 172.21.15.79:0/506890461 wait complete. 2024-08-20T01:28:53.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.900+0000 7f0b3ce45640 1 Processor -- start 2024-08-20T01:28:53.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.900+0000 7f0b3ce45640 1 -- start start 2024-08-20T01:28:53.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.900+0000 7f0b3ce45640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b38101640 0x7f0b38105400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:53.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.900+0000 7f0b3ce45640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b381027a0 0x7f0b38103c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:53.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.900+0000 7f0b3ce45640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b38103160 0x7f0b381041b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:53.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.900+0000 7f0b3ce45640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3810cf20 con 0x7f0b381027a0 2024-08-20T01:28:53.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.900+0000 7f0b3ce45640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3810cda0 con 0x7f0b38103160 2024-08-20T01:28:53.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.900+0000 7f0b3ce45640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3810d0a0 con 0x7f0b38101640 2024-08-20T01:28:53.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.900+0000 7f0b35d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b381027a0 0x7f0b38103c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:53.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.900+0000 7f0b3659c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b38101640 0x7f0b38105400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:53.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.900+0000 7f0b35d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b381027a0 0x7f0b38103c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57908/0 (socket says 172.21.15.79:57908) 2024-08-20T01:28:53.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.900+0000 7f0b35d9b640 1 -- 172.21.15.79:0/1971951028 learned_addr learned my addr 172.21.15.79:0/1971951028 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:28:53.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.900+0000 7f0b3659c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b38101640 0x7f0b38105400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:43828/0 (socket says 172.21.15.79:43828) 2024-08-20T01:28:53.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.900+0000 7f0b36d9d640 1 --2- 172.21.15.79:0/1971951028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b38103160 0x7f0b381041b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:53.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.900+0000 7f0b35d9b640 1 -- 172.21.15.79:0/1971951028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b38101640 msgr2=0x7f0b38105400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:53.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.900+0000 7f0b35d9b640 1 --2- 172.21.15.79:0/1971951028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b38101640 0x7f0b38105400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:53.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.900+0000 7f0b35d9b640 1 -- 172.21.15.79:0/1971951028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b38103160 msgr2=0x7f0b381041b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:53.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.900+0000 7f0b35d9b640 1 --2- 172.21.15.79:0/1971951028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b38103160 0x7f0b381041b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:53.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.900+0000 7f0b35d9b640 1 -- 172.21.15.79:0/1971951028 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b38104a70 con 0x7f0b381027a0 2024-08-20T01:28:53.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.901+0000 7f0b35d9b640 1 --2- 172.21.15.79:0/1971951028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b381027a0 0x7f0b38103c70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0b2000d950 tx=0x7f0b2000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:53.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.901+0000 7f0b2f7fe640 1 -- 172.21.15.79:0/1971951028 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b20017070 con 0x7f0b381027a0 2024-08-20T01:28:53.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.901+0000 7f0b2f7fe640 1 -- 172.21.15.79:0/1971951028 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(23 keys) ==== 1001+0+0 (secure 0 0 0) 0x7f0b20009c30 con 0x7f0b381027a0 2024-08-20T01:28:53.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.901+0000 7f0b2f7fe640 1 -- 172.21.15.79:0/1971951028 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b2000f3c0 con 0x7f0b381027a0 2024-08-20T01:28:53.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.901+0000 7f0b3ce45640 1 -- 172.21.15.79:0/1971951028 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b381a2960 con 0x7f0b381027a0 2024-08-20T01:28:53.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.901+0000 7f0b3ce45640 1 -- 172.21.15.79:0/1971951028 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b381a2e70 con 0x7f0b381027a0 2024-08-20T01:28:53.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.902+0000 7f0b2f7fe640 1 -- 172.21.15.79:0/1971951028 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 13) ==== 50747+0+0 (secure 0 0 0) 0x7f0b2000f560 con 0x7f0b381027a0 2024-08-20T01:28:53.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.902+0000 7f0b3ce45640 1 -- 172.21.15.79:0/1971951028 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b38101a40 con 0x7f0b381027a0 2024-08-20T01:28:53.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.902+0000 7f0b2f7fe640 1 --2- 172.21.15.79:0/1971951028 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0b2403ed60 0x7f0b24041220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:53.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.902+0000 7f0b2f7fe640 1 -- 172.21.15.79:0/1971951028 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f0b20053bb0 con 0x7f0b381027a0 2024-08-20T01:28:53.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.902+0000 7f0b3659c640 1 --2- 172.21.15.79:0/1971951028 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0b2403ed60 0x7f0b24041220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:53.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.902+0000 7f0b3659c640 1 --2- 172.21.15.79:0/1971951028 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0b2403ed60 0x7f0b24041220 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0b30004770 tx=0x7f0b30000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:53.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:53.910+0000 7f0b2f7fe640 1 -- 172.21.15.79:0/1971951028 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f0b2000f850 con 0x7f0b381027a0 2024-08-20T01:28:54.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.096+0000 7f0b3ce45640 1 -- 172.21.15.79:0/1971951028 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f0b381a31c0 con 0x7f0b381027a0 2024-08-20T01:28:54.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.102+0000 7f0b2f7fe640 1 -- 172.21.15.79:0/1971951028 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v15)=0 v15) ==== 117+0+0 (secure 0 0 0) 0x7f0b2000fc70 con 0x7f0b381027a0 2024-08-20T01:28:54.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.104+0000 7f0b3ce45640 1 -- 172.21.15.79:0/1971951028 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0b2403ed60 msgr2=0x7f0b24041220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:54.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.104+0000 7f0b3ce45640 1 --2- 172.21.15.79:0/1971951028 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0b2403ed60 0x7f0b24041220 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0b30004770 tx=0x7f0b30000bc0 comp rx=0 tx=0).stop 2024-08-20T01:28:54.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.104+0000 7f0b3ce45640 1 -- 172.21.15.79:0/1971951028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b381027a0 msgr2=0x7f0b38103c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:54.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.104+0000 7f0b3ce45640 1 --2- 172.21.15.79:0/1971951028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b381027a0 0x7f0b38103c70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0b2000d950 tx=0x7f0b2000de10 comp rx=0 tx=0).stop 2024-08-20T01:28:54.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.104+0000 7f0b3ce45640 1 -- 172.21.15.79:0/1971951028 shutdown_connections 2024-08-20T01:28:54.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.104+0000 7f0b3ce45640 1 --2- 172.21.15.79:0/1971951028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b38103160 0x7f0b381041b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:54.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.104+0000 7f0b3ce45640 1 --2- 172.21.15.79:0/1971951028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b381027a0 0x7f0b38103c70 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:54.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.104+0000 7f0b3ce45640 1 --2- 172.21.15.79:0/1971951028 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0b2403ed60 0x7f0b24041220 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:54.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.104+0000 7f0b3ce45640 1 --2- 172.21.15.79:0/1971951028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b38101640 0x7f0b38105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:54.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.104+0000 7f0b3ce45640 1 -- 172.21.15.79:0/1971951028 >> 172.21.15.79:0/1971951028 conn(0x7f0b380fcf10 msgr2=0x7f0b3806afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:54.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.104+0000 7f0b3ce45640 1 -- 172.21.15.79:0/1971951028 shutdown_connections 2024-08-20T01:28:54.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.104+0000 7f0b3ce45640 1 -- 172.21.15.79:0/1971951028 wait complete. 2024-08-20T01:28:54.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.519+0000 7f4fc9a3f640 1 -- 172.21.15.79:0/664314150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc4102740 msgr2=0x7f4fc4102b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:54.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.519+0000 7f4fc9a3f640 1 --2- 172.21.15.79:0/664314150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc4102740 0x7f4fc4102b40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4fb4009930 tx=0x7f4fb402a420 comp rx=0 tx=0).stop 2024-08-20T01:28:54.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.519+0000 7f4fc9a3f640 1 -- 172.21.15.79:0/664314150 shutdown_connections 2024-08-20T01:28:54.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.519+0000 7f4fc9a3f640 1 --2- 172.21.15.79:0/664314150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fc4104260 0x7f4fc410abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:54.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.519+0000 7f4fc9a3f640 1 --2- 172.21.15.79:0/664314150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fc41038a0 0x7f4fc4103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:54.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.519+0000 7f4fc9a3f640 1 --2- 172.21.15.79:0/664314150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc4102740 0x7f4fc4102b40 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:54.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.519+0000 7f4fc9a3f640 1 -- 172.21.15.79:0/664314150 >> 172.21.15.79:0/664314150 conn(0x7f4fc40fdff0 msgr2=0x7f4fc4100450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:54.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.519+0000 7f4fc9a3f640 1 -- 172.21.15.79:0/664314150 shutdown_connections 2024-08-20T01:28:54.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.519+0000 7f4fc9a3f640 1 -- 172.21.15.79:0/664314150 wait complete. 2024-08-20T01:28:54.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.519+0000 7f4fc9a3f640 1 Processor -- start 2024-08-20T01:28:54.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.520+0000 7f4fc9a3f640 1 -- start start 2024-08-20T01:28:54.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.520+0000 7f4fc9a3f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fc4102740 0x7f4fc4198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:54.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.520+0000 7f4fc9a3f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fc41038a0 0x7f4fc4198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:54.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.520+0000 7f4fc9a3f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc4104260 0x7f4fc4199af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:54.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.520+0000 7f4fc9a3f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc410dff0 con 0x7f4fc4104260 2024-08-20T01:28:54.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.520+0000 7f4fc9a3f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc410de70 con 0x7f4fc4102740 2024-08-20T01:28:54.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.520+0000 7f4fc9a3f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc410e170 con 0x7f4fc41038a0 2024-08-20T01:28:54.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.520+0000 7f4fc37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc4104260 0x7f4fc4199af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:54.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.520+0000 7f4fc37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc4104260 0x7f4fc4199af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57920/0 (socket says 172.21.15.79:57920) 2024-08-20T01:28:54.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.520+0000 7f4fc37fe640 1 -- 172.21.15.79:0/1751998128 learned_addr learned my addr 172.21.15.79:0/1751998128 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:28:54.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.520+0000 7f4fc2ffd640 1 --2- 172.21.15.79:0/1751998128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fc4102740 0x7f4fc4198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:54.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.520+0000 7f4fbbfff640 1 --2- 172.21.15.79:0/1751998128 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fc41038a0 0x7f4fc4198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:54.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.520+0000 7f4fc37fe640 1 -- 172.21.15.79:0/1751998128 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fc41038a0 msgr2=0x7f4fc4198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:54.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.520+0000 7f4fc37fe640 1 --2- 172.21.15.79:0/1751998128 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fc41038a0 0x7f4fc4198eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:54.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.520+0000 7f4fc37fe640 1 -- 172.21.15.79:0/1751998128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fc4102740 msgr2=0x7f4fc4198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:54.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.520+0000 7f4fc37fe640 1 --2- 172.21.15.79:0/1751998128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fc4102740 0x7f4fc4198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:54.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.520+0000 7f4fc37fe640 1 -- 172.21.15.79:0/1751998128 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc419a390 con 0x7f4fc4104260 2024-08-20T01:28:54.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.520+0000 7f4fc37fe640 1 --2- 172.21.15.79:0/1751998128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc4104260 0x7f4fc4199af0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc00eaa0 tx=0x7f4fbc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:54.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.520+0000 7f4fc8a3d640 1 -- 172.21.15.79:0/1751998128 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc00cdb0 con 0x7f4fc4104260 2024-08-20T01:28:54.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.521+0000 7f4fc8a3d640 1 -- 172.21.15.79:0/1751998128 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(23 keys) ==== 1001+0+0 (secure 0 0 0) 0x7f4fbc005020 con 0x7f4fc4104260 2024-08-20T01:28:54.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.521+0000 7f4fc9a3f640 1 -- 172.21.15.79:0/1751998128 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fc419a680 con 0x7f4fc4104260 2024-08-20T01:28:54.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.521+0000 7f4fc8a3d640 1 -- 172.21.15.79:0/1751998128 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc0116d0 con 0x7f4fc4104260 2024-08-20T01:28:54.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.521+0000 7f4fc9a3f640 1 -- 172.21.15.79:0/1751998128 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fc41a0d60 con 0x7f4fc4104260 2024-08-20T01:28:54.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.521+0000 7f4fc8a3d640 1 -- 172.21.15.79:0/1751998128 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 13) ==== 50747+0+0 (secure 0 0 0) 0x7f4fbc011870 con 0x7f4fc4104260 2024-08-20T01:28:54.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.521+0000 7f4fc9a3f640 1 -- 172.21.15.79:0/1751998128 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fc4102b40 con 0x7f4fc4104260 2024-08-20T01:28:54.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.522+0000 7f4fc8a3d640 1 --2- 172.21.15.79:0/1751998128 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4fb003ed60 0x7f4fb0041220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:54.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.522+0000 7f4fc8a3d640 1 -- 172.21.15.79:0/1751998128 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4fbc053550 con 0x7f4fc4104260 2024-08-20T01:28:54.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.522+0000 7f4fc2ffd640 1 --2- 172.21.15.79:0/1751998128 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4fb003ed60 0x7f4fb0041220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:54.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.522+0000 7f4fc2ffd640 1 --2- 172.21.15.79:0/1751998128 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4fb003ed60 0x7f4fb0041220 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4fb4009900 tx=0x7f4fb40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:54.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.526+0000 7f4fc8a3d640 1 -- 172.21.15.79:0/1751998128 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f4fbc016030 con 0x7f4fc4104260 2024-08-20T01:28:54.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.705+0000 7f4fc9a3f640 1 -- 172.21.15.79:0/1751998128 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f4fc4063a80 con 0x7f4fc4104260 2024-08-20T01:28:54.707 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:54 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:54.707 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:54 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:54.707 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:54 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:54.707 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:54 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:54.707 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:54 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:54.707 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:54 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:28:54.707 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:54 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:54.707 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:54 smithi079 ceph-mon[18656]: Reconfiguring mgr.x (unknown last config time)... 2024-08-20T01:28:54.707 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:54 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-20T01:28:54.707 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:54 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-20T01:28:54.708 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:54 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:54.708 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:54 smithi079 ceph-mon[18656]: Reconfiguring daemon mgr.x on smithi079 2024-08-20T01:28:54.708 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:54 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/1971951028' entity='client.admin' 2024-08-20T01:28:54.708 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:54 smithi079 ceph-mon[18656]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:54.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.710+0000 7f4fc8a3d640 1 -- 172.21.15.79:0/1751998128 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v16)=0 v16) ==== 123+0+0 (secure 0 0 0) 0x7f4fbc0054f0 con 0x7f4fc4104260 2024-08-20T01:28:54.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.711+0000 7f4fc8a3d640 1 -- 172.21.15.79:0/1751998128 <== mon.0 v2:172.21.15.79:3300/0 8 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f4fbc022910 con 0x7f4fc4104260 2024-08-20T01:28:54.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.712+0000 7f4fc9a3f640 1 -- 172.21.15.79:0/1751998128 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4fb003ed60 msgr2=0x7f4fb0041220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:54.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.712+0000 7f4fc9a3f640 1 --2- 172.21.15.79:0/1751998128 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4fb003ed60 0x7f4fb0041220 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4fb4009900 tx=0x7f4fb40058d0 comp rx=0 tx=0).stop 2024-08-20T01:28:54.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.712+0000 7f4fc9a3f640 1 -- 172.21.15.79:0/1751998128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc4104260 msgr2=0x7f4fc4199af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:54.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.712+0000 7f4fc9a3f640 1 --2- 172.21.15.79:0/1751998128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc4104260 0x7f4fc4199af0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc00eaa0 tx=0x7f4fbc00ef60 comp rx=0 tx=0).stop 2024-08-20T01:28:54.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.712+0000 7f4fc9a3f640 1 -- 172.21.15.79:0/1751998128 shutdown_connections 2024-08-20T01:28:54.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.712+0000 7f4fc9a3f640 1 --2- 172.21.15.79:0/1751998128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc4104260 0x7f4fc4199af0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:54.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.712+0000 7f4fc9a3f640 1 --2- 172.21.15.79:0/1751998128 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4fb003ed60 0x7f4fb0041220 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:54.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.712+0000 7f4fc9a3f640 1 --2- 172.21.15.79:0/1751998128 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fc41038a0 0x7f4fc4198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:54.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.712+0000 7f4fc9a3f640 1 --2- 172.21.15.79:0/1751998128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fc4102740 0x7f4fc4198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:54.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.712+0000 7f4fc9a3f640 1 -- 172.21.15.79:0/1751998128 >> 172.21.15.79:0/1751998128 conn(0x7f4fc40fdff0 msgr2=0x7f4fc4106e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:54.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.713+0000 7f4fc9a3f640 1 -- 172.21.15.79:0/1751998128 shutdown_connections 2024-08-20T01:28:54.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:54.713+0000 7f4fc9a3f640 1 -- 172.21.15.79:0/1751998128 wait complete. 2024-08-20T01:28:54.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:54 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:54.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:54 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:54.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:54 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:54.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:54 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:54.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:54 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:54.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:54 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:28:54.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:54 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:54.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:54 smithi081 ceph-mon[22209]: Reconfiguring mgr.x (unknown last config time)... 2024-08-20T01:28:54.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:54 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-20T01:28:54.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:54 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-20T01:28:54.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:54 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:54.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:54 smithi081 ceph-mon[22209]: Reconfiguring daemon mgr.x on smithi079 2024-08-20T01:28:54.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:54 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/1971951028' entity='client.admin' 2024-08-20T01:28:54.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:54 smithi081 ceph-mon[22209]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:54.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:54 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:54.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:54 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:54.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:54 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:54.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:54 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:54.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:54 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:54.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:54 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:28:54.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:54 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:28:54.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:54 smithi175 ceph-mon[22392]: Reconfiguring mgr.x (unknown last config time)... 2024-08-20T01:28:54.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:54 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-20T01:28:54.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:54 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-20T01:28:54.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:54 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:28:54.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:54 smithi175 ceph-mon[22392]: Reconfiguring daemon mgr.x on smithi079 2024-08-20T01:28:54.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:54 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/1971951028' entity='client.admin' 2024-08-20T01:28:54.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:54 smithi175 ceph-mon[22392]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:55.979 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:55 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/1751998128' entity='client.admin' 2024-08-20T01:28:55.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:55 smithi079 ceph-mon[18656]: Standby manager daemon z started 2024-08-20T01:28:55.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:55 smithi079 ceph-mon[18656]: from='mgr.? 172.21.15.175:0/123329305' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-08-20T01:28:55.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:55 smithi079 ceph-mon[18656]: from='mgr.? 172.21.15.175:0/123329305' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-20T01:28:55.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:55 smithi079 ceph-mon[18656]: from='mgr.? 172.21.15.175:0/123329305' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-08-20T01:28:55.980 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:55 smithi079 ceph-mon[18656]: from='mgr.? 172.21.15.175:0/123329305' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-20T01:28:55.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:55.978+0000 7f9308ae1640 1 -- 172.21.15.79:0/1803417764 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9304108420 msgr2=0x7f930410a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:55.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:55.978+0000 7f9308ae1640 1 --2- 172.21.15.79:0/1803417764 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9304108420 0x7f930410a8e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f92fc009900 tx=0x7f92fc02a410 comp rx=0 tx=0).stop 2024-08-20T01:28:55.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:55.978+0000 7f9308ae1640 1 -- 172.21.15.79:0/1803417764 shutdown_connections 2024-08-20T01:28:55.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:55.978+0000 7f9308ae1640 1 --2- 172.21.15.79:0/1803417764 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9304108420 0x7f930410a8e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:55.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:55.978+0000 7f9308ae1640 1 --2- 172.21.15.79:0/1803417764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9304105870 0x7f9304107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:55.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:55.978+0000 7f9308ae1640 1 --2- 172.21.15.79:0/1803417764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f930406b3a0 0x7f9304105330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:55.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:55.978+0000 7f9308ae1640 1 -- 172.21.15.79:0/1803417764 >> 172.21.15.79:0/1803417764 conn(0x7f93040fcee0 msgr2=0x7f93040ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:55.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:55.978+0000 7f9308ae1640 1 -- 172.21.15.79:0/1803417764 shutdown_connections 2024-08-20T01:28:55.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:55.979+0000 7f9308ae1640 1 -- 172.21.15.79:0/1803417764 wait complete. 2024-08-20T01:28:55.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:55.979+0000 7f9308ae1640 1 Processor -- start 2024-08-20T01:28:55.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:55.979+0000 7f9308ae1640 1 -- start start 2024-08-20T01:28:55.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:55.979+0000 7f9308ae1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f930406b3a0 0x7f93041988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:55.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:55.979+0000 7f9308ae1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9304105870 0x7f9304198f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:55.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:55.979+0000 7f9308ae1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9304108420 0x7f9304199b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:55.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:55.979+0000 7f9308ae1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f930410e0e0 con 0x7f930406b3a0 2024-08-20T01:28:55.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:55.979+0000 7f9308ae1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f930410df60 con 0x7f9304105870 2024-08-20T01:28:55.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:55.979+0000 7f9308ae1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f930410e260 con 0x7f9304108420 2024-08-20T01:28:55.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:55.980+0000 7f930259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f930406b3a0 0x7f93041988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:55.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:55.980+0000 7f930259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f930406b3a0 0x7f93041988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57938/0 (socket says 172.21.15.79:57938) 2024-08-20T01:28:55.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:55.980+0000 7f930259c640 1 -- 172.21.15.79:0/2235513049 learned_addr learned my addr 172.21.15.79:0/2235513049 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:28:55.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:55.980+0000 7f9302d9d640 1 --2- 172.21.15.79:0/2235513049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9304108420 0x7f9304199b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:55.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:55.980+0000 7f9301d9b640 1 --2- 172.21.15.79:0/2235513049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9304105870 0x7f9304198f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:55.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:55.980+0000 7f930259c640 1 -- 172.21.15.79:0/2235513049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9304108420 msgr2=0x7f9304199b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:55.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:55.980+0000 7f930259c640 1 --2- 172.21.15.79:0/2235513049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9304108420 0x7f9304199b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:55.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:55.980+0000 7f930259c640 1 -- 172.21.15.79:0/2235513049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9304105870 msgr2=0x7f9304198f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:55.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:55.980+0000 7f930259c640 1 --2- 172.21.15.79:0/2235513049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9304105870 0x7f9304198f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:55.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:55.980+0000 7f930259c640 1 -- 172.21.15.79:0/2235513049 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f930419a3e0 con 0x7f930406b3a0 2024-08-20T01:28:55.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:55.980+0000 7f9301d9b640 1 --2- 172.21.15.79:0/2235513049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9304105870 0x7f9304198f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:28:55.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:55.980+0000 7f930259c640 1 --2- 172.21.15.79:0/2235513049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f930406b3a0 0x7f93041988b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f92f400ea80 tx=0x7f92f400ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:55.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:55.980+0000 7f92f37fe640 1 -- 172.21.15.79:0/2235513049 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f400ce40 con 0x7f930406b3a0 2024-08-20T01:28:55.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:55.980+0000 7f9308ae1640 1 -- 172.21.15.79:0/2235513049 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f930419a6d0 con 0x7f930406b3a0 2024-08-20T01:28:55.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:55.980+0000 7f92f37fe640 1 -- 172.21.15.79:0/2235513049 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f92f4005020 con 0x7f930406b3a0 2024-08-20T01:28:55.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:55.980+0000 7f92f37fe640 1 -- 172.21.15.79:0/2235513049 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f40116d0 con 0x7f930406b3a0 2024-08-20T01:28:55.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:55.980+0000 7f9308ae1640 1 -- 172.21.15.79:0/2235513049 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93041a0db0 con 0x7f930406b3a0 2024-08-20T01:28:55.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:55.981+0000 7f9308ae1640 1 -- 172.21.15.79:0/2235513049 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9304105cd0 con 0x7f930406b3a0 2024-08-20T01:28:55.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:55.982+0000 7f92f37fe640 1 -- 172.21.15.79:0/2235513049 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 14) ==== 100875+0+0 (secure 0 0 0) 0x7f92f4004a40 con 0x7f930406b3a0 2024-08-20T01:28:55.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:55.982+0000 7f92f37fe640 1 --2- 172.21.15.79:0/2235513049 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f92ec079450 0x7f92ec07b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:55.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:55.983+0000 7f9301d9b640 1 --2- 172.21.15.79:0/2235513049 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f92ec079450 0x7f92ec07b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:55.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:55.983+0000 7f92f37fe640 1 -- 172.21.15.79:0/2235513049 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f92f409aa60 con 0x7f930406b3a0 2024-08-20T01:28:55.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:55.983+0000 7f9301d9b640 1 --2- 172.21.15.79:0/2235513049 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f92ec079450 0x7f92ec07b910 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f92f8009c20 tx=0x7f92f8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:55.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:55.987+0000 7f92f37fe640 1 -- 172.21.15.79:0/2235513049 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f92f4016030 con 0x7f930406b3a0 2024-08-20T01:28:55.999 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:56.002 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:56.003 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:56.003 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:56.003 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:56.003 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:56.004 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:56.026 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:55 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/1751998128' entity='client.admin' 2024-08-20T01:28:56.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:55 smithi081 ceph-mon[22209]: Standby manager daemon z started 2024-08-20T01:28:56.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:55 smithi081 ceph-mon[22209]: from='mgr.? 172.21.15.175:0/123329305' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-08-20T01:28:56.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:55 smithi081 ceph-mon[22209]: from='mgr.? 172.21.15.175:0/123329305' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-20T01:28:56.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:55 smithi081 ceph-mon[22209]: from='mgr.? 172.21.15.175:0/123329305' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-08-20T01:28:56.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:55 smithi081 ceph-mon[22209]: from='mgr.? 172.21.15.175:0/123329305' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-20T01:28:56.035 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:56.035 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:28:56.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:55 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/1751998128' entity='client.admin' 2024-08-20T01:28:56.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:55 smithi175 ceph-mon[22392]: Standby manager daemon z started 2024-08-20T01:28:56.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:55 smithi175 ceph-mon[22392]: from='mgr.? 172.21.15.175:0/123329305' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-08-20T01:28:56.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:55 smithi175 ceph-mon[22392]: from='mgr.? 172.21.15.175:0/123329305' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-20T01:28:56.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:55 smithi175 ceph-mon[22392]: from='mgr.? 172.21.15.175:0/123329305' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-08-20T01:28:56.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:55 smithi175 ceph-mon[22392]: from='mgr.? 172.21.15.175:0/123329305' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-20T01:28:56.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.202+0000 7f9308ae1640 1 -- 172.21.15.79:0/2235513049 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f9304063a80 con 0x7f930406b3a0 2024-08-20T01:28:56.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.207+0000 7f92f37fe640 1 -- 172.21.15.79:0/2235513049 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v17)=0 v17) ==== 108+0+0 (secure 0 0 0) 0x7f92f40051d0 con 0x7f930406b3a0 2024-08-20T01:28:56.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.210+0000 7f9308ae1640 1 -- 172.21.15.79:0/2235513049 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f92ec079450 msgr2=0x7f92ec07b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:56.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.210+0000 7f9308ae1640 1 --2- 172.21.15.79:0/2235513049 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f92ec079450 0x7f92ec07b910 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f92f8009c20 tx=0x7f92f8005f90 comp rx=0 tx=0).stop 2024-08-20T01:28:56.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.210+0000 7f9308ae1640 1 -- 172.21.15.79:0/2235513049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f930406b3a0 msgr2=0x7f93041988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:56.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.210+0000 7f9308ae1640 1 --2- 172.21.15.79:0/2235513049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f930406b3a0 0x7f93041988b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f92f400ea80 tx=0x7f92f400ef40 comp rx=0 tx=0).stop 2024-08-20T01:28:56.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.210+0000 7f9308ae1640 1 -- 172.21.15.79:0/2235513049 shutdown_connections 2024-08-20T01:28:56.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.210+0000 7f9308ae1640 1 --2- 172.21.15.79:0/2235513049 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f92ec079450 0x7f92ec07b910 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:56.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.210+0000 7f9308ae1640 1 --2- 172.21.15.79:0/2235513049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9304108420 0x7f9304199b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:56.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.210+0000 7f9308ae1640 1 --2- 172.21.15.79:0/2235513049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9304105870 0x7f9304198f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:56.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.210+0000 7f9308ae1640 1 --2- 172.21.15.79:0/2235513049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f930406b3a0 0x7f93041988b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:56.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.210+0000 7f9308ae1640 1 -- 172.21.15.79:0/2235513049 >> 172.21.15.79:0/2235513049 conn(0x7f93040fcee0 msgr2=0x7f9304103c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:56.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.210+0000 7f9308ae1640 1 -- 172.21.15.79:0/2235513049 shutdown_connections 2024-08-20T01:28:56.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.210+0000 7f9308ae1640 1 -- 172.21.15.79:0/2235513049 wait complete. 2024-08-20T01:28:56.929 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:56 smithi079 ceph-mon[18656]: mgrmap e14: x(active, since 63s), standbys: z 2024-08-20T01:28:56.929 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:56 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-08-20T01:28:56.929 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:56 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2235513049' entity='client.admin' 2024-08-20T01:28:56.929 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:56 smithi079 ceph-mon[18656]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:56.929 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:56 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/3938312037' entity='client.admin' 2024-08-20T01:28:57.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:56 smithi081 ceph-mon[22209]: mgrmap e14: x(active, since 63s), standbys: z 2024-08-20T01:28:57.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:56 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-08-20T01:28:57.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:56 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2235513049' entity='client.admin' 2024-08-20T01:28:57.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:56 smithi081 ceph-mon[22209]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:57.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:56 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/3938312037' entity='client.admin' 2024-08-20T01:28:57.137 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:56 smithi175 ceph-mon[22392]: mgrmap e14: x(active, since 63s), standbys: z 2024-08-20T01:28:57.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:56 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-08-20T01:28:57.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:56 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2235513049' entity='client.admin' 2024-08-20T01:28:57.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:56 smithi175 ceph-mon[22392]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:57.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:56 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/3938312037' entity='client.admin' 2024-08-20T01:28:57.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.678+0000 7f1b5ad40640 1 -- 172.21.15.79:0/4257955146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b54102770 msgr2=0x7f1b54102bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:57.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.678+0000 7f1b5ad40640 1 --2- 172.21.15.79:0/4257955146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b54102770 0x7f1b54102bf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009930 tx=0x7f1b4002a420 comp rx=0 tx=0).stop 2024-08-20T01:28:57.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.678+0000 7f1b5ad40640 1 -- 172.21.15.79:0/4257955146 shutdown_connections 2024-08-20T01:28:57.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.678+0000 7f1b5ad40640 1 --2- 172.21.15.79:0/4257955146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b54103130 0x7f1b54109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:57.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.678+0000 7f1b5ad40640 1 --2- 172.21.15.79:0/4257955146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b54102770 0x7f1b54102bf0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:57.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.678+0000 7f1b5ad40640 1 --2- 172.21.15.79:0/4257955146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b54101610 0x7f1b54101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:57.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.678+0000 7f1b5ad40640 1 -- 172.21.15.79:0/4257955146 >> 172.21.15.79:0/4257955146 conn(0x7f1b540fcee0 msgr2=0x7f1b540ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:57.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.678+0000 7f1b5ad40640 1 -- 172.21.15.79:0/4257955146 shutdown_connections 2024-08-20T01:28:57.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.678+0000 7f1b5ad40640 1 -- 172.21.15.79:0/4257955146 wait complete. 2024-08-20T01:28:57.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.678+0000 7f1b5ad40640 1 Processor -- start 2024-08-20T01:28:57.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.678+0000 7f1b5ad40640 1 -- start start 2024-08-20T01:28:57.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.679+0000 7f1b5ad40640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b54101610 0x7f1b54198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:57.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.679+0000 7f1b5ad40640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b54102770 0x7f1b54198fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:57.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.679+0000 7f1b5ad40640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b54103130 0x7f1b54199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:57.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.679+0000 7f1b5ad40640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1b5410e150 con 0x7f1b54102770 2024-08-20T01:28:57.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.679+0000 7f1b5ad40640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1b5410dfd0 con 0x7f1b54103130 2024-08-20T01:28:57.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.679+0000 7f1b5ad40640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1b5410e2d0 con 0x7f1b54101610 2024-08-20T01:28:57.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.679+0000 7f1b53fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b54102770 0x7f1b54198fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:57.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.679+0000 7f1b53fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b54102770 0x7f1b54198fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57972/0 (socket says 172.21.15.79:57972) 2024-08-20T01:28:57.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.679+0000 7f1b53fff640 1 -- 172.21.15.79:0/1446697898 learned_addr learned my addr 172.21.15.79:0/1446697898 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:28:57.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.679+0000 7f1b58adc640 1 --2- 172.21.15.79:0/1446697898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b54101610 0x7f1b54198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:57.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.679+0000 7f1b53fff640 1 -- 172.21.15.79:0/1446697898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b54101610 msgr2=0x7f1b54198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:57.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.679+0000 7f1b53fff640 1 --2- 172.21.15.79:0/1446697898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b54101610 0x7f1b54198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:57.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.679+0000 7f1b53fff640 1 -- 172.21.15.79:0/1446697898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b54103130 msgr2=0x7f1b54199c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:57.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.679+0000 7f1b53fff640 1 --2- 172.21.15.79:0/1446697898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b54103130 0x7f1b54199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:57.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.679+0000 7f1b53fff640 1 -- 172.21.15.79:0/1446697898 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b5419a4b0 con 0x7f1b54102770 2024-08-20T01:28:57.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.679+0000 7f1b53fff640 1 --2- 172.21.15.79:0/1446697898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b54102770 0x7f1b54198fd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009230 tx=0x7f1b400040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:57.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.679+0000 7f1b51ffb640 1 -- 172.21.15.79:0/1446697898 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4003f070 con 0x7f1b54102770 2024-08-20T01:28:57.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.679+0000 7f1b51ffb640 1 -- 172.21.15.79:0/1446697898 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f1b40004fd0 con 0x7f1b54102770 2024-08-20T01:28:57.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.679+0000 7f1b5ad40640 1 -- 172.21.15.79:0/1446697898 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b5419a740 con 0x7f1b54102770 2024-08-20T01:28:57.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.679+0000 7f1b51ffb640 1 -- 172.21.15.79:0/1446697898 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b40035030 con 0x7f1b54102770 2024-08-20T01:28:57.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.680+0000 7f1b5ad40640 1 -- 172.21.15.79:0/1446697898 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b541a0cb0 con 0x7f1b54102770 2024-08-20T01:28:57.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.680+0000 7f1b5ad40640 1 -- 172.21.15.79:0/1446697898 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b54101a10 con 0x7f1b54102770 2024-08-20T01:28:57.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.681+0000 7f1b51ffb640 1 -- 172.21.15.79:0/1446697898 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 14) ==== 100875+0+0 (secure 0 0 0) 0x7f1b40042070 con 0x7f1b54102770 2024-08-20T01:28:57.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.682+0000 7f1b51ffb640 1 --2- 172.21.15.79:0/1446697898 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1b44079450 0x7f1b4407b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:57.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.682+0000 7f1b58adc640 1 --2- 172.21.15.79:0/1446697898 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1b44079450 0x7f1b4407b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:57.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.682+0000 7f1b51ffb640 1 -- 172.21.15.79:0/1446697898 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f1b400bb0d0 con 0x7f1b54102770 2024-08-20T01:28:57.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.682+0000 7f1b58adc640 1 --2- 172.21.15.79:0/1446697898 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1b44079450 0x7f1b4407b910 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1b48009bd0 tx=0x7f1b48005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:57.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.686+0000 7f1b51ffb640 1 -- 172.21.15.79:0/1446697898 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f1b40004770 con 0x7f1b54102770 2024-08-20T01:28:57.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.865+0000 7f1b5ad40640 1 -- 172.21.15.79:0/1446697898 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f1b541a0f10 con 0x7f1b54102770 2024-08-20T01:28:57.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.868+0000 7f1b51ffb640 1 -- 172.21.15.79:0/1446697898 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v19)=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7f1b40083ec0 con 0x7f1b54102770 2024-08-20T01:28:57.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.870+0000 7f1b5ad40640 1 -- 172.21.15.79:0/1446697898 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1b44079450 msgr2=0x7f1b4407b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:57.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.870+0000 7f1b5ad40640 1 --2- 172.21.15.79:0/1446697898 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1b44079450 0x7f1b4407b910 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1b48009bd0 tx=0x7f1b48005f90 comp rx=0 tx=0).stop 2024-08-20T01:28:57.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.870+0000 7f1b5ad40640 1 -- 172.21.15.79:0/1446697898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b54102770 msgr2=0x7f1b54198fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:57.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.870+0000 7f1b5ad40640 1 --2- 172.21.15.79:0/1446697898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b54102770 0x7f1b54198fd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009230 tx=0x7f1b400040e0 comp rx=0 tx=0).stop 2024-08-20T01:28:57.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.870+0000 7f1b5ad40640 1 -- 172.21.15.79:0/1446697898 shutdown_connections 2024-08-20T01:28:57.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.870+0000 7f1b5ad40640 1 --2- 172.21.15.79:0/1446697898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b54103130 0x7f1b54199c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:57.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.870+0000 7f1b5ad40640 1 --2- 172.21.15.79:0/1446697898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b54102770 0x7f1b54198fd0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:57.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.870+0000 7f1b5ad40640 1 --2- 172.21.15.79:0/1446697898 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1b44079450 0x7f1b4407b910 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:57.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.870+0000 7f1b5ad40640 1 --2- 172.21.15.79:0/1446697898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b54101610 0x7f1b54198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:57.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.870+0000 7f1b5ad40640 1 -- 172.21.15.79:0/1446697898 >> 172.21.15.79:0/1446697898 conn(0x7f1b540fcee0 msgr2=0x7f1b54103ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:57.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.870+0000 7f1b5ad40640 1 -- 172.21.15.79:0/1446697898 shutdown_connections 2024-08-20T01:28:57.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.870+0000 7f1b5ad40640 1 -- 172.21.15.79:0/1446697898 wait complete. 2024-08-20T01:28:57.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.878+0000 7fe725b40640 1 -- 172.21.15.79:0/1025477352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7201038c0 msgr2=0x7fe720103d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:57.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.878+0000 7fe725b40640 1 --2- 172.21.15.79:0/1025477352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7201038c0 0x7fe720103d40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe714009930 tx=0x7fe71402a420 comp rx=0 tx=0).stop 2024-08-20T01:28:57.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.878+0000 7fe725b40640 1 -- 172.21.15.79:0/1025477352 shutdown_connections 2024-08-20T01:28:57.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.878+0000 7fe725b40640 1 --2- 172.21.15.79:0/1025477352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe720104280 0x7fe72010ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:57.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.878+0000 7fe725b40640 1 --2- 172.21.15.79:0/1025477352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7201038c0 0x7fe720103d40 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:57.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.878+0000 7fe725b40640 1 --2- 172.21.15.79:0/1025477352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe720102760 0x7fe720102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:57.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.878+0000 7fe725b40640 1 -- 172.21.15.79:0/1025477352 >> 172.21.15.79:0/1025477352 conn(0x7fe7200fe050 msgr2=0x7fe720100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:57.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.878+0000 7fe725b40640 1 -- 172.21.15.79:0/1025477352 shutdown_connections 2024-08-20T01:28:57.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.878+0000 7fe725b40640 1 -- 172.21.15.79:0/1025477352 wait complete. 2024-08-20T01:28:57.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.879+0000 7fe725b40640 1 Processor -- start 2024-08-20T01:28:57.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.879+0000 7fe725b40640 1 -- start start 2024-08-20T01:28:57.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.879+0000 7fe725b40640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe720102760 0x7fe720198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:57.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.879+0000 7fe725b40640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7201038c0 0x7fe720198f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:57.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.879+0000 7fe725b40640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe720104280 0x7fe720199bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:57.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.879+0000 7fe725b40640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe72010e130 con 0x7fe720104280 2024-08-20T01:28:57.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.879+0000 7fe725b40640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe72010dfb0 con 0x7fe7201038c0 2024-08-20T01:28:57.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.879+0000 7fe725b40640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe72010e2b0 con 0x7fe720102760 2024-08-20T01:28:57.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.879+0000 7fe71ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe720104280 0x7fe720199bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:57.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.879+0000 7fe71ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe720104280 0x7fe720199bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57996/0 (socket says 172.21.15.79:57996) 2024-08-20T01:28:57.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.879+0000 7fe71ffff640 1 -- 172.21.15.79:0/2493704414 learned_addr learned my addr 172.21.15.79:0/2493704414 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:28:57.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.880+0000 7fe71f7fe640 1 --2- 172.21.15.79:0/2493704414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe720102760 0x7fe720198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:57.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.880+0000 7fe71effd640 1 --2- 172.21.15.79:0/2493704414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7201038c0 0x7fe720198f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:57.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.880+0000 7fe71ffff640 1 -- 172.21.15.79:0/2493704414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe720102760 msgr2=0x7fe720198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:57.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.880+0000 7fe71ffff640 1 --2- 172.21.15.79:0/2493704414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe720102760 0x7fe720198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:57.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.880+0000 7fe71ffff640 1 -- 172.21.15.79:0/2493704414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7201038c0 msgr2=0x7fe720198f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:57.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.880+0000 7fe71ffff640 1 --2- 172.21.15.79:0/2493704414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7201038c0 0x7fe720198f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:57.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.880+0000 7fe71ffff640 1 -- 172.21.15.79:0/2493704414 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe72019a460 con 0x7fe720104280 2024-08-20T01:28:57.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.880+0000 7fe71ffff640 1 --2- 172.21.15.79:0/2493704414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe720104280 0x7fe720199bc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe71800eaa0 tx=0x7fe71800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:57.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.880+0000 7fe71cff9640 1 -- 172.21.15.79:0/2493704414 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71800cdb0 con 0x7fe720104280 2024-08-20T01:28:57.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.880+0000 7fe725b40640 1 -- 172.21.15.79:0/2493704414 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe72019a750 con 0x7fe720104280 2024-08-20T01:28:57.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.880+0000 7fe71cff9640 1 -- 172.21.15.79:0/2493704414 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fe718005020 con 0x7fe720104280 2024-08-20T01:28:57.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.880+0000 7fe71cff9640 1 -- 172.21.15.79:0/2493704414 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7180116d0 con 0x7fe720104280 2024-08-20T01:28:57.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.880+0000 7fe725b40640 1 -- 172.21.15.79:0/2493704414 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7201a0e30 con 0x7fe720104280 2024-08-20T01:28:57.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.881+0000 7fe725b40640 1 -- 172.21.15.79:0/2493704414 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe720102b60 con 0x7fe720104280 2024-08-20T01:28:57.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.882+0000 7fe71cff9640 1 -- 172.21.15.79:0/2493704414 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 14) ==== 100875+0+0 (secure 0 0 0) 0x7fe718011870 con 0x7fe720104280 2024-08-20T01:28:57.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.882+0000 7fe71cff9640 1 --2- 172.21.15.79:0/2493704414 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe708079450 0x7fe70807b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:57.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.883+0000 7fe71cff9640 1 -- 172.21.15.79:0/2493704414 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe71809aa50 con 0x7fe720104280 2024-08-20T01:28:57.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.883+0000 7fe71f7fe640 1 --2- 172.21.15.79:0/2493704414 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe708079450 0x7fe70807b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:57.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.883+0000 7fe71f7fe640 1 --2- 172.21.15.79:0/2493704414 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe708079450 0x7fe70807b910 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe71000bbe0 tx=0x7fe71000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:57.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:57.888+0000 7fe71cff9640 1 -- 172.21.15.79:0/2493704414 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fe718016030 con 0x7fe720104280 2024-08-20T01:28:58.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:58.069+0000 7fe725b40640 1 -- 172.21.15.79:0/2493704414 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7fe720063a80 con 0x7fe720104280 2024-08-20T01:28:58.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:58.074+0000 7fe71cff9640 1 -- 172.21.15.79:0/2493704414 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v20)=0 v20) ==== 119+0+0 (secure 0 0 0) 0x7fe718063840 con 0x7fe720104280 2024-08-20T01:28:58.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:58.076+0000 7fe725b40640 1 -- 172.21.15.79:0/2493704414 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe708079450 msgr2=0x7fe70807b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:58.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:58.076+0000 7fe725b40640 1 --2- 172.21.15.79:0/2493704414 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe708079450 0x7fe70807b910 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe71000bbe0 tx=0x7fe71000b390 comp rx=0 tx=0).stop 2024-08-20T01:28:58.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:58.076+0000 7fe725b40640 1 -- 172.21.15.79:0/2493704414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe720104280 msgr2=0x7fe720199bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:58.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:58.076+0000 7fe725b40640 1 --2- 172.21.15.79:0/2493704414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe720104280 0x7fe720199bc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe71800eaa0 tx=0x7fe71800ef60 comp rx=0 tx=0).stop 2024-08-20T01:28:58.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:58.076+0000 7fe725b40640 1 -- 172.21.15.79:0/2493704414 shutdown_connections 2024-08-20T01:28:58.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:58.076+0000 7fe725b40640 1 --2- 172.21.15.79:0/2493704414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe720104280 0x7fe720199bc0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:58.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:58.076+0000 7fe725b40640 1 --2- 172.21.15.79:0/2493704414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7201038c0 0x7fe720198f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:58.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:58.076+0000 7fe725b40640 1 --2- 172.21.15.79:0/2493704414 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe708079450 0x7fe70807b910 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:58.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:58.076+0000 7fe725b40640 1 --2- 172.21.15.79:0/2493704414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe720102760 0x7fe720198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:58.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:58.076+0000 7fe725b40640 1 -- 172.21.15.79:0/2493704414 >> 172.21.15.79:0/2493704414 conn(0x7fe7200fe050 msgr2=0x7fe720106df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:58.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:58.076+0000 7fe725b40640 1 -- 172.21.15.79:0/2493704414 shutdown_connections 2024-08-20T01:28:58.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:58.076+0000 7fe725b40640 1 -- 172.21.15.79:0/2493704414 wait complete. 2024-08-20T01:28:58.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:58 smithi081 ceph-mon[22209]: Standby manager daemon y started 2024-08-20T01:28:58.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:58 smithi081 ceph-mon[22209]: from='mgr.? 172.21.15.81:0/1281048829' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-08-20T01:28:58.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:58 smithi081 ceph-mon[22209]: from='mgr.? 172.21.15.81:0/1281048829' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-20T01:28:58.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:58 smithi081 ceph-mon[22209]: from='mgr.? 172.21.15.81:0/1281048829' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-08-20T01:28:58.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:58 smithi081 ceph-mon[22209]: from='mgr.? 172.21.15.81:0/1281048829' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-20T01:28:58.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:58 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/1446697898' entity='client.admin' 2024-08-20T01:28:58.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:58 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2493704414' entity='client.admin' 2024-08-20T01:28:58.608 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:58 smithi079 ceph-mon[18656]: Standby manager daemon y started 2024-08-20T01:28:58.608 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:58 smithi079 ceph-mon[18656]: from='mgr.? 172.21.15.81:0/1281048829' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-08-20T01:28:58.608 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:58 smithi079 ceph-mon[18656]: from='mgr.? 172.21.15.81:0/1281048829' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-20T01:28:58.608 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:58 smithi079 ceph-mon[18656]: from='mgr.? 172.21.15.81:0/1281048829' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-08-20T01:28:58.608 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:58 smithi079 ceph-mon[18656]: from='mgr.? 172.21.15.81:0/1281048829' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-20T01:28:58.608 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:58 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/1446697898' entity='client.admin' 2024-08-20T01:28:58.608 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:58 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2493704414' entity='client.admin' 2024-08-20T01:28:58.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:58 smithi175 ceph-mon[22392]: Standby manager daemon y started 2024-08-20T01:28:58.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:58 smithi175 ceph-mon[22392]: from='mgr.? 172.21.15.81:0/1281048829' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-08-20T01:28:58.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:58 smithi175 ceph-mon[22392]: from='mgr.? 172.21.15.81:0/1281048829' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-20T01:28:58.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:58 smithi175 ceph-mon[22392]: from='mgr.? 172.21.15.81:0/1281048829' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-08-20T01:28:58.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:58 smithi175 ceph-mon[22392]: from='mgr.? 172.21.15.81:0/1281048829' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-20T01:28:58.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:58 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/1446697898' entity='client.admin' 2024-08-20T01:28:58.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:58 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2493704414' entity='client.admin' 2024-08-20T01:28:59.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.126+0000 7f1ad9d26640 1 -- 172.21.15.79:0/2855287246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ad4104250 msgr2=0x7f1ad410abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:59.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.126+0000 7f1ad9d26640 1 --2- 172.21.15.79:0/2855287246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ad4104250 0x7f1ad410abd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1acc009cd0 tx=0x7f1acc02a8e0 comp rx=0 tx=0).stop 2024-08-20T01:28:59.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.126+0000 7f1ad9d26640 1 -- 172.21.15.79:0/2855287246 shutdown_connections 2024-08-20T01:28:59.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.126+0000 7f1ad9d26640 1 --2- 172.21.15.79:0/2855287246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ad4104250 0x7f1ad410abd0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:59.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.126+0000 7f1ad9d26640 1 --2- 172.21.15.79:0/2855287246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ad4103890 0x7f1ad4103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:59.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.126+0000 7f1ad9d26640 1 --2- 172.21.15.79:0/2855287246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ad4102730 0x7f1ad4102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:59.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.126+0000 7f1ad9d26640 1 -- 172.21.15.79:0/2855287246 >> 172.21.15.79:0/2855287246 conn(0x7f1ad40fe020 msgr2=0x7f1ad4100440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:59.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.126+0000 7f1ad9d26640 1 -- 172.21.15.79:0/2855287246 shutdown_connections 2024-08-20T01:28:59.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.126+0000 7f1ad9d26640 1 -- 172.21.15.79:0/2855287246 wait complete. 2024-08-20T01:28:59.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.126+0000 7f1ad9d26640 1 Processor -- start 2024-08-20T01:28:59.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.127+0000 7f1ad9d26640 1 -- start start 2024-08-20T01:28:59.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.127+0000 7f1ad9d26640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ad4102730 0x7f1ad4198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:59.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.127+0000 7f1ad9d26640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ad4103890 0x7f1ad4198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:59.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.127+0000 7f1ad9d26640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ad4104250 0x7f1ad4199ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:59.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.127+0000 7f1ad9d26640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad410e100 con 0x7f1ad4103890 2024-08-20T01:28:59.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.127+0000 7f1ad9d26640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad410df80 con 0x7f1ad4104250 2024-08-20T01:28:59.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.127+0000 7f1ad9d26640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad410e280 con 0x7f1ad4102730 2024-08-20T01:28:59.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.127+0000 7f1acbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ad4103890 0x7f1ad4198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:59.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.127+0000 7f1acbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ad4103890 0x7f1ad4198ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58002/0 (socket says 172.21.15.79:58002) 2024-08-20T01:28:59.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.127+0000 7f1acbfff640 1 -- 172.21.15.79:0/2542538706 learned_addr learned my addr 172.21.15.79:0/2542538706 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:28:59.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.127+0000 7f1ad3fff640 1 --2- 172.21.15.79:0/2542538706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ad4104250 0x7f1ad4199ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:59.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.127+0000 7f1ad37fe640 1 --2- 172.21.15.79:0/2542538706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ad4102730 0x7f1ad4198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:59.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.127+0000 7f1acbfff640 1 -- 172.21.15.79:0/2542538706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ad4102730 msgr2=0x7f1ad4198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:59.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.127+0000 7f1acbfff640 1 --2- 172.21.15.79:0/2542538706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ad4102730 0x7f1ad4198850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:59.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.127+0000 7f1acbfff640 1 -- 172.21.15.79:0/2542538706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ad4104250 msgr2=0x7f1ad4199ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:59.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.127+0000 7f1acbfff640 1 --2- 172.21.15.79:0/2542538706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ad4104250 0x7f1ad4199ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:59.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.127+0000 7f1acbfff640 1 -- 172.21.15.79:0/2542538706 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ad419a380 con 0x7f1ad4103890 2024-08-20T01:28:59.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.127+0000 7f1ad37fe640 1 --2- 172.21.15.79:0/2542538706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ad4102730 0x7f1ad4198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:28:59.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.127+0000 7f1acbfff640 1 --2- 172.21.15.79:0/2542538706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ad4103890 0x7f1ad4198ea0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1abc00c920 tx=0x7f1abc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:59.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.128+0000 7f1ad17fa640 1 -- 172.21.15.79:0/2542538706 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1abc007c70 con 0x7f1ad4103890 2024-08-20T01:28:59.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.128+0000 7f1ad9d26640 1 -- 172.21.15.79:0/2542538706 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ad419a670 con 0x7f1ad4103890 2024-08-20T01:28:59.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.128+0000 7f1ad17fa640 1 -- 172.21.15.79:0/2542538706 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f1abc007e10 con 0x7f1ad4103890 2024-08-20T01:28:59.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.128+0000 7f1ad17fa640 1 -- 172.21.15.79:0/2542538706 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1abc018660 con 0x7f1ad4103890 2024-08-20T01:28:59.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.128+0000 7f1ad9d26640 1 -- 172.21.15.79:0/2542538706 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ad41a0d50 con 0x7f1ad4103890 2024-08-20T01:28:59.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.129+0000 7f1ad9d26640 1 -- 172.21.15.79:0/2542538706 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ad4102b30 con 0x7f1ad4103890 2024-08-20T01:28:59.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.130+0000 7f1ad17fa640 1 -- 172.21.15.79:0/2542538706 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7f1abc00f450 con 0x7f1ad4103890 2024-08-20T01:28:59.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.131+0000 7f1ad17fa640 1 --2- 172.21.15.79:0/2542538706 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1ac00b3b40 0x7f1ac00b6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:59.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.131+0000 7f1ad37fe640 1 --2- 172.21.15.79:0/2542538706 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1ac00b3b40 0x7f1ac00b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:59.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.131+0000 7f1ad17fa640 1 -- 172.21.15.79:0/2542538706 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f1abc0e22f0 con 0x7f1ad4103890 2024-08-20T01:28:59.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.131+0000 7f1ad37fe640 1 --2- 172.21.15.79:0/2542538706 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1ac00b3b40 0x7f1ac00b6000 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1ac40058c0 tx=0x7f1ac4005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:59.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.134+0000 7f1ad17fa640 1 -- 172.21.15.79:0/2542538706 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f1abc014030 con 0x7f1ad4103890 2024-08-20T01:28:59.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.304+0000 7fc955c82640 1 -- 172.21.15.79:0/1925479757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc950102600 msgr2=0x7fc950102a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:59.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.304+0000 7fc955c82640 1 --2- 172.21.15.79:0/1925479757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc950102600 0x7fc950102a80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc944009930 tx=0x7fc94402a420 comp rx=0 tx=0).stop 2024-08-20T01:28:59.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.304+0000 7fc955c82640 1 -- 172.21.15.79:0/1925479757 shutdown_connections 2024-08-20T01:28:59.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.304+0000 7fc955c82640 1 --2- 172.21.15.79:0/1925479757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc950103170 0x7fc950109cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:59.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.304+0000 7fc955c82640 1 --2- 172.21.15.79:0/1925479757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc950102600 0x7fc950102a80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:59.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.304+0000 7fc955c82640 1 --2- 172.21.15.79:0/1925479757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc950101cc0 0x7fc9501020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:59.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.304+0000 7fc955c82640 1 -- 172.21.15.79:0/1925479757 >> 172.21.15.79:0/1925479757 conn(0x7fc9500fc6a0 msgr2=0x7fc9500feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:59.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.304+0000 7fc955c82640 1 -- 172.21.15.79:0/1925479757 shutdown_connections 2024-08-20T01:28:59.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.304+0000 7fc955c82640 1 -- 172.21.15.79:0/1925479757 wait complete. 2024-08-20T01:28:59.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.305+0000 7fc955c82640 1 Processor -- start 2024-08-20T01:28:59.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.305+0000 7fc955c82640 1 -- start start 2024-08-20T01:28:59.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.305+0000 7fc955c82640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc950101cc0 0x7fc950198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:59.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.305+0000 7fc955c82640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc950102600 0x7fc9501990a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:59.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.305+0000 7fc955c82640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc950103170 0x7fc950199ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:59.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.305+0000 7fc955c82640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc95010e1b0 con 0x7fc950101cc0 2024-08-20T01:28:59.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.305+0000 7fc955c82640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc95010e030 con 0x7fc950103170 2024-08-20T01:28:59.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.305+0000 7fc955c82640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc95010e330 con 0x7fc950102600 2024-08-20T01:28:59.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.305+0000 7fc94f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc950101cc0 0x7fc950198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:59.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.305+0000 7fc94f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc950101cc0 0x7fc950198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57960/0 (socket says 172.21.15.79:57960) 2024-08-20T01:28:59.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.305+0000 7fc94f7fe640 1 -- 172.21.15.79:0/3938312037 learned_addr learned my addr 172.21.15.79:0/3938312037 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:28:59.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.305+0000 7fc94ffff640 1 --2- 172.21.15.79:0/3938312037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc950103170 0x7fc950199ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:59.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.305+0000 7fc94effd640 1 --2- 172.21.15.79:0/3938312037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc950102600 0x7fc9501990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:59.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.306+0000 7fc94f7fe640 1 -- 172.21.15.79:0/3938312037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc950102600 msgr2=0x7fc9501990a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:59.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.306+0000 7fc94f7fe640 1 --2- 172.21.15.79:0/3938312037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc950102600 0x7fc9501990a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:59.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.306+0000 7fc94f7fe640 1 -- 172.21.15.79:0/3938312037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc950103170 msgr2=0x7fc950199ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:59.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.306+0000 7fc94f7fe640 1 --2- 172.21.15.79:0/3938312037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc950103170 0x7fc950199ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:59.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.306+0000 7fc94f7fe640 1 -- 172.21.15.79:0/3938312037 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc95019a580 con 0x7fc950101cc0 2024-08-20T01:28:59.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.306+0000 7fc94ffff640 1 --2- 172.21.15.79:0/3938312037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc950103170 0x7fc950199ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:28:59.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.306+0000 7fc94f7fe640 1 --2- 172.21.15.79:0/3938312037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc950101cc0 0x7fc950198a50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc94000b4a0 tx=0x7fc94000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:59.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.306+0000 7fc94cff9640 1 -- 172.21.15.79:0/3938312037 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc940014070 con 0x7fc950101cc0 2024-08-20T01:28:59.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.306+0000 7fc94cff9640 1 -- 172.21.15.79:0/3938312037 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fc940010a80 con 0x7fc950101cc0 2024-08-20T01:28:59.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.306+0000 7fc955c82640 1 -- 172.21.15.79:0/3938312037 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc95019a870 con 0x7fc950101cc0 2024-08-20T01:28:59.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.306+0000 7fc94cff9640 1 -- 172.21.15.79:0/3938312037 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc940017ac0 con 0x7fc950101cc0 2024-08-20T01:28:59.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.306+0000 7fc955c82640 1 -- 172.21.15.79:0/3938312037 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9501a0f50 con 0x7fc950101cc0 2024-08-20T01:28:59.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.307+0000 7fc955c82640 1 -- 172.21.15.79:0/3938312037 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9501020c0 con 0x7fc950101cc0 2024-08-20T01:28:59.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.307+0000 7fc94cff9640 1 -- 172.21.15.79:0/3938312037 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 14) ==== 100875+0+0 (secure 0 0 0) 0x7fc940017070 con 0x7fc950101cc0 2024-08-20T01:28:59.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.308+0000 7fc94cff9640 1 --2- 172.21.15.79:0/3938312037 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc938079450 0x7fc93807b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:28:59.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.308+0000 7fc94cff9640 1 -- 172.21.15.79:0/3938312037 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc940099eb0 con 0x7fc950101cc0 2024-08-20T01:28:59.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.308+0000 7fc94effd640 1 --2- 172.21.15.79:0/3938312037 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc938079450 0x7fc93807b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:28:59.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.309+0000 7fc94effd640 1 --2- 172.21.15.79:0/3938312037 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc938079450 0x7fc93807b910 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc944009900 tx=0x7fc944000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:28:59.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.312+0000 7fc94cff9640 1 -- 172.21.15.79:0/3938312037 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fc940062d00 con 0x7fc950101cc0 2024-08-20T01:28:59.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.493+0000 7fc955c82640 1 -- 172.21.15.79:0/3938312037 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7fc95002e5b0 con 0x7fc950101cc0 2024-08-20T01:28:59.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.498+0000 7fc94cff9640 1 -- 172.21.15.79:0/3938312037 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v18)=0 v18) ==== 121+0+0 (secure 0 0 0) 0x7fc940067250 con 0x7fc950101cc0 2024-08-20T01:28:59.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.500+0000 7fc955c82640 1 -- 172.21.15.79:0/3938312037 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc938079450 msgr2=0x7fc93807b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:59.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.500+0000 7fc955c82640 1 --2- 172.21.15.79:0/3938312037 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc938079450 0x7fc93807b910 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc944009900 tx=0x7fc944000bc0 comp rx=0 tx=0).stop 2024-08-20T01:28:59.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.500+0000 7fc955c82640 1 -- 172.21.15.79:0/3938312037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc950101cc0 msgr2=0x7fc950198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:59.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.500+0000 7fc955c82640 1 --2- 172.21.15.79:0/3938312037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc950101cc0 0x7fc950198a50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc94000b4a0 tx=0x7fc94000b960 comp rx=0 tx=0).stop 2024-08-20T01:28:59.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.500+0000 7fc955c82640 1 -- 172.21.15.79:0/3938312037 shutdown_connections 2024-08-20T01:28:59.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.500+0000 7fc955c82640 1 --2- 172.21.15.79:0/3938312037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc950103170 0x7fc950199ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:59.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.500+0000 7fc955c82640 1 --2- 172.21.15.79:0/3938312037 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc938079450 0x7fc93807b910 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:59.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.500+0000 7fc955c82640 1 --2- 172.21.15.79:0/3938312037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc950102600 0x7fc9501990a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:59.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.500+0000 7fc955c82640 1 --2- 172.21.15.79:0/3938312037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc950101cc0 0x7fc950198a50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:59.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.500+0000 7fc955c82640 1 -- 172.21.15.79:0/3938312037 >> 172.21.15.79:0/3938312037 conn(0x7fc9500fc6a0 msgr2=0x7fc950105e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:59.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.500+0000 7fc955c82640 1 -- 172.21.15.79:0/3938312037 shutdown_connections 2024-08-20T01:28:59.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:56.500+0000 7fc955c82640 1 -- 172.21.15.79:0/3938312037 wait complete. 2024-08-20T01:28:59.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.314+0000 7f1ad9d26640 1 -- 172.21.15.79:0/2542538706 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f1ad402e340 con 0x7f1ad4103890 2024-08-20T01:28:59.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.317+0000 7f1ad17fa640 1 -- 172.21.15.79:0/2542538706 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v21)=0 v21) ==== 116+0+0 (secure 0 0 0) 0x7f1abc0ab6a0 con 0x7f1ad4103890 2024-08-20T01:28:59.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.319+0000 7f1ad9d26640 1 -- 172.21.15.79:0/2542538706 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1ac00b3b40 msgr2=0x7f1ac00b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:59.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.319+0000 7f1ad9d26640 1 --2- 172.21.15.79:0/2542538706 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1ac00b3b40 0x7f1ac00b6000 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1ac40058c0 tx=0x7f1ac4005ec0 comp rx=0 tx=0).stop 2024-08-20T01:28:59.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.319+0000 7f1ad9d26640 1 -- 172.21.15.79:0/2542538706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ad4103890 msgr2=0x7f1ad4198ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:28:59.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.319+0000 7f1ad9d26640 1 --2- 172.21.15.79:0/2542538706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ad4103890 0x7f1ad4198ea0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1abc00c920 tx=0x7f1abc00cde0 comp rx=0 tx=0).stop 2024-08-20T01:28:59.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.319+0000 7f1ad9d26640 1 -- 172.21.15.79:0/2542538706 shutdown_connections 2024-08-20T01:28:59.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.319+0000 7f1ad9d26640 1 --2- 172.21.15.79:0/2542538706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ad4104250 0x7f1ad4199ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:59.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.319+0000 7f1ad9d26640 1 --2- 172.21.15.79:0/2542538706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ad4103890 0x7f1ad4198ea0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:59.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.319+0000 7f1ad9d26640 1 --2- 172.21.15.79:0/2542538706 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1ac00b3b40 0x7f1ac00b6000 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:59.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.319+0000 7f1ad9d26640 1 --2- 172.21.15.79:0/2542538706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ad4102730 0x7f1ad4198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:28:59.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.319+0000 7f1ad9d26640 1 -- 172.21.15.79:0/2542538706 >> 172.21.15.79:0/2542538706 conn(0x7f1ad40fe020 msgr2=0x7f1ad4106c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:28:59.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.320+0000 7f1ad9d26640 1 -- 172.21.15.79:0/2542538706 shutdown_connections 2024-08-20T01:28:59.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:28:59.320+0000 7f1ad9d26640 1 -- 172.21.15.79:0/2542538706 wait complete. 2024-08-20T01:28:59.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:59 smithi081 ceph-mon[22209]: mgrmap e15: x(active, since 65s), standbys: y, z 2024-08-20T01:28:59.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:59 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-08-20T01:28:59.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:28:59 smithi081 ceph-mon[22209]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:59.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:59 smithi175 ceph-mon[22392]: mgrmap e15: x(active, since 65s), standbys: y, z 2024-08-20T01:28:59.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:59 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-08-20T01:28:59.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:28:59 smithi175 ceph-mon[22392]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:28:59.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:59 smithi079 ceph-mon[18656]: mgrmap e15: x(active, since 65s), standbys: y, z 2024-08-20T01:28:59.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:59 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-08-20T01:28:59.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:28:59 smithi079 ceph-mon[18656]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:00.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:00 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2542538706' entity='client.admin' 2024-08-20T01:29:00.646 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:00 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2542538706' entity='client.admin' 2024-08-20T01:29:00.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:00 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2542538706' entity='client.admin' 2024-08-20T01:29:00.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:00.829+0000 7f939a1fc640 1 -- 172.21.15.79:0/1808392281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9394108450 msgr2=0x7f939410a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:00.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:00.829+0000 7f939a1fc640 1 --2- 172.21.15.79:0/1808392281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9394108450 0x7f939410a910 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f938c009ca0 tx=0x7f938c02a8c0 comp rx=0 tx=0).stop 2024-08-20T01:29:00.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:00.829+0000 7f939a1fc640 1 -- 172.21.15.79:0/1808392281 shutdown_connections 2024-08-20T01:29:00.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:00.829+0000 7f939a1fc640 1 --2- 172.21.15.79:0/1808392281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9394108450 0x7f939410a910 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:00.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:00.829+0000 7f939a1fc640 1 --2- 172.21.15.79:0/1808392281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93941058a0 0x7f9394107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:00.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:00.829+0000 7f939a1fc640 1 --2- 172.21.15.79:0/1808392281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f939406bde0 0x7f9394105310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:00.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:00.829+0000 7f939a1fc640 1 -- 172.21.15.79:0/1808392281 >> 172.21.15.79:0/1808392281 conn(0x7f93940fcf00 msgr2=0x7f93940ff340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:00.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:00.830+0000 7f939a1fc640 1 -- 172.21.15.79:0/1808392281 shutdown_connections 2024-08-20T01:29:00.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:00.830+0000 7f939a1fc640 1 -- 172.21.15.79:0/1808392281 wait complete. 2024-08-20T01:29:00.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:00.830+0000 7f939a1fc640 1 Processor -- start 2024-08-20T01:29:00.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:00.830+0000 7f939a1fc640 1 -- start start 2024-08-20T01:29:00.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:00.830+0000 7f939a1fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f939406bde0 0x7f9394198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:00.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:00.830+0000 7f939a1fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93941058a0 0x7f9394198f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:00.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:00.830+0000 7f939a1fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9394108450 0x7f9394199bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:00.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:00.830+0000 7f939a1fc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f939410e110 con 0x7f93941058a0 2024-08-20T01:29:00.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:00.830+0000 7f939a1fc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f939410df90 con 0x7f9394108450 2024-08-20T01:29:00.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:00.830+0000 7f939a1fc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f939410e290 con 0x7f939406bde0 2024-08-20T01:29:00.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:00.831+0000 7f9392ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93941058a0 0x7f9394198f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:00.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:00.831+0000 7f9392ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93941058a0 0x7f9394198f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37730/0 (socket says 172.21.15.79:37730) 2024-08-20T01:29:00.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:00.831+0000 7f9392ffd640 1 -- 172.21.15.79:0/4022666589 learned_addr learned my addr 172.21.15.79:0/4022666589 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:29:00.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:00.831+0000 7f93937fe640 1 --2- 172.21.15.79:0/4022666589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f939406bde0 0x7f9394198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:00.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:00.831+0000 7f9393fff640 1 --2- 172.21.15.79:0/4022666589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9394108450 0x7f9394199bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:00.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:00.831+0000 7f9392ffd640 1 -- 172.21.15.79:0/4022666589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f939406bde0 msgr2=0x7f9394198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:00.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:00.831+0000 7f9392ffd640 1 --2- 172.21.15.79:0/4022666589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f939406bde0 0x7f9394198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:00.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:00.831+0000 7f9392ffd640 1 -- 172.21.15.79:0/4022666589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9394108450 msgr2=0x7f9394199bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:00.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:00.831+0000 7f9392ffd640 1 --2- 172.21.15.79:0/4022666589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9394108450 0x7f9394199bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:00.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:00.831+0000 7f9392ffd640 1 -- 172.21.15.79:0/4022666589 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f939419a460 con 0x7f93941058a0 2024-08-20T01:29:00.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:00.831+0000 7f9393fff640 1 --2- 172.21.15.79:0/4022666589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9394108450 0x7f9394199bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:29:00.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:00.831+0000 7f9392ffd640 1 --2- 172.21.15.79:0/4022666589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93941058a0 0x7f9394198f80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f938800c970 tx=0x7f938800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:00.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:00.831+0000 7f9390ff9640 1 -- 172.21.15.79:0/4022666589 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9388007bb0 con 0x7f93941058a0 2024-08-20T01:29:00.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:00.831+0000 7f9390ff9640 1 -- 172.21.15.79:0/4022666589 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f9388007d50 con 0x7f93941058a0 2024-08-20T01:29:00.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:00.831+0000 7f939a1fc640 1 -- 172.21.15.79:0/4022666589 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f939419a750 con 0x7f93941058a0 2024-08-20T01:29:00.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:00.831+0000 7f9390ff9640 1 -- 172.21.15.79:0/4022666589 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9388004d50 con 0x7f93941058a0 2024-08-20T01:29:00.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:00.831+0000 7f939a1fc640 1 -- 172.21.15.79:0/4022666589 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93941a0e30 con 0x7f93941058a0 2024-08-20T01:29:00.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:00.832+0000 7f939a1fc640 1 -- 172.21.15.79:0/4022666589 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9394105d00 con 0x7f93941058a0 2024-08-20T01:29:00.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:00.833+0000 7f9390ff9640 1 -- 172.21.15.79:0/4022666589 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7f9388004ef0 con 0x7f93941058a0 2024-08-20T01:29:00.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:00.834+0000 7f9390ff9640 1 --2- 172.21.15.79:0/4022666589 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f937c0b3b40 0x7f937c0b6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:00.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:00.834+0000 7f93937fe640 1 --2- 172.21.15.79:0/4022666589 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f937c0b3b40 0x7f937c0b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:00.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:00.834+0000 7f9390ff9640 1 -- 172.21.15.79:0/4022666589 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f93880e1ec0 con 0x7f93941058a0 2024-08-20T01:29:00.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:00.835+0000 7f93937fe640 1 --2- 172.21.15.79:0/4022666589 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f937c0b3b40 0x7f937c0b6000 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9384005d00 tx=0x7f938400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:00.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:00.838+0000 7f9390ff9640 1 -- 172.21.15.79:0/4022666589 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f9388014030 con 0x7f93941058a0 2024-08-20T01:29:01.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.022+0000 7f939a1fc640 1 -- 172.21.15.79:0/4022666589 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f9394063a80 con 0x7f93941058a0 2024-08-20T01:29:01.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.025+0000 7f9390ff9640 1 -- 172.21.15.79:0/4022666589 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v22)=0 v22) ==== 125+0+0 (secure 0 0 0) 0x7f93880ab1e0 con 0x7f93941058a0 2024-08-20T01:29:01.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.027+0000 7f939a1fc640 1 -- 172.21.15.79:0/4022666589 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f937c0b3b40 msgr2=0x7f937c0b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:01.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.027+0000 7f939a1fc640 1 --2- 172.21.15.79:0/4022666589 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f937c0b3b40 0x7f937c0b6000 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9384005d00 tx=0x7f938400b410 comp rx=0 tx=0).stop 2024-08-20T01:29:01.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.027+0000 7f939a1fc640 1 -- 172.21.15.79:0/4022666589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93941058a0 msgr2=0x7f9394198f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:01.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.027+0000 7f939a1fc640 1 --2- 172.21.15.79:0/4022666589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93941058a0 0x7f9394198f80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f938800c970 tx=0x7f938800ce30 comp rx=0 tx=0).stop 2024-08-20T01:29:01.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.027+0000 7f939a1fc640 1 -- 172.21.15.79:0/4022666589 shutdown_connections 2024-08-20T01:29:01.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.027+0000 7f939a1fc640 1 --2- 172.21.15.79:0/4022666589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9394108450 0x7f9394199bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:01.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.027+0000 7f939a1fc640 1 --2- 172.21.15.79:0/4022666589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93941058a0 0x7f9394198f80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:01.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.027+0000 7f939a1fc640 1 --2- 172.21.15.79:0/4022666589 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f937c0b3b40 0x7f937c0b6000 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:01.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.027+0000 7f939a1fc640 1 --2- 172.21.15.79:0/4022666589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f939406bde0 0x7f9394198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:01.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.028+0000 7f939a1fc640 1 -- 172.21.15.79:0/4022666589 >> 172.21.15.79:0/4022666589 conn(0x7f93940fcf00 msgr2=0x7f9394103d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:01.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.028+0000 7f939a1fc640 1 -- 172.21.15.79:0/4022666589 shutdown_connections 2024-08-20T01:29:01.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.028+0000 7f939a1fc640 1 -- 172.21.15.79:0/4022666589 wait complete. 2024-08-20T01:29:01.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.300+0000 7f4ade098640 1 -- 172.21.15.79:0/4058397947 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ad8104250 msgr2=0x7f4ad810abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:01.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.300+0000 7f4ade098640 1 --2- 172.21.15.79:0/4058397947 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ad8104250 0x7f4ad810abd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0009930 tx=0x7f4ad002a420 comp rx=0 tx=0).stop 2024-08-20T01:29:01.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.300+0000 7f4ade098640 1 -- 172.21.15.79:0/4058397947 shutdown_connections 2024-08-20T01:29:01.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.300+0000 7f4ade098640 1 --2- 172.21.15.79:0/4058397947 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ad8104250 0x7f4ad810abd0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:01.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.300+0000 7f4ade098640 1 --2- 172.21.15.79:0/4058397947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ad8103890 0x7f4ad8103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:01.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.300+0000 7f4ade098640 1 --2- 172.21.15.79:0/4058397947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ad8102730 0x7f4ad8102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:01.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.300+0000 7f4ade098640 1 -- 172.21.15.79:0/4058397947 >> 172.21.15.79:0/4058397947 conn(0x7f4ad80fe020 msgr2=0x7f4ad8100440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:01.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.300+0000 7f4ade098640 1 -- 172.21.15.79:0/4058397947 shutdown_connections 2024-08-20T01:29:01.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.300+0000 7f4ade098640 1 -- 172.21.15.79:0/4058397947 wait complete. 2024-08-20T01:29:01.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.300+0000 7f4ade098640 1 Processor -- start 2024-08-20T01:29:01.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.300+0000 7f4ade098640 1 -- start start 2024-08-20T01:29:01.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.301+0000 7f4ade098640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ad8102730 0x7f4ad8198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:01.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.301+0000 7f4ade098640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ad8103890 0x7f4ad8198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:01.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.301+0000 7f4ade098640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ad8104250 0x7f4ad8199ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:01.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.301+0000 7f4ade098640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad810e150 con 0x7f4ad8102730 2024-08-20T01:29:01.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.301+0000 7f4ade098640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad810dfd0 con 0x7f4ad8104250 2024-08-20T01:29:01.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.301+0000 7f4ade098640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad810e2d0 con 0x7f4ad8103890 2024-08-20T01:29:01.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.301+0000 7f4ad77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ad8102730 0x7f4ad8198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:01.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.301+0000 7f4ad77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ad8102730 0x7f4ad8198850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37760/0 (socket says 172.21.15.79:37760) 2024-08-20T01:29:01.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.301+0000 7f4ad77fe640 1 -- 172.21.15.79:0/105997921 learned_addr learned my addr 172.21.15.79:0/105997921 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:29:01.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.301+0000 7f4ad7fff640 1 --2- 172.21.15.79:0/105997921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ad8104250 0x7f4ad8199ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:01.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.301+0000 7f4ad6ffd640 1 --2- 172.21.15.79:0/105997921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ad8103890 0x7f4ad8198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:01.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.301+0000 7f4ad77fe640 1 -- 172.21.15.79:0/105997921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ad8103890 msgr2=0x7f4ad8198ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:01.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.301+0000 7f4ad77fe640 1 --2- 172.21.15.79:0/105997921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ad8103890 0x7f4ad8198ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:01.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.301+0000 7f4ad77fe640 1 -- 172.21.15.79:0/105997921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ad8104250 msgr2=0x7f4ad8199ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:01.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.301+0000 7f4ad77fe640 1 --2- 172.21.15.79:0/105997921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ad8104250 0x7f4ad8199ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:01.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.301+0000 7f4ad77fe640 1 -- 172.21.15.79:0/105997921 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ad819a380 con 0x7f4ad8102730 2024-08-20T01:29:01.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.301+0000 7f4ad7fff640 1 --2- 172.21.15.79:0/105997921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ad8104250 0x7f4ad8199ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:29:01.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.301+0000 7f4ad77fe640 1 --2- 172.21.15.79:0/105997921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ad8102730 0x7f4ad8198850 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800cce0 tx=0x7f4ac800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:01.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.301+0000 7f4ad4ff9640 1 -- 172.21.15.79:0/105997921 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac800f650 con 0x7f4ad8102730 2024-08-20T01:29:01.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.301+0000 7f4ade098640 1 -- 172.21.15.79:0/105997921 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ad819a670 con 0x7f4ad8102730 2024-08-20T01:29:01.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.301+0000 7f4ad4ff9640 1 -- 172.21.15.79:0/105997921 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f4ac800fc60 con 0x7f4ad8102730 2024-08-20T01:29:01.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.301+0000 7f4ad4ff9640 1 -- 172.21.15.79:0/105997921 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8018a30 con 0x7f4ad8102730 2024-08-20T01:29:01.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.301+0000 7f4ade098640 1 -- 172.21.15.79:0/105997921 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ad81a0d50 con 0x7f4ad8102730 2024-08-20T01:29:01.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.302+0000 7f4ade098640 1 -- 172.21.15.79:0/105997921 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ad8102b30 con 0x7f4ad8102730 2024-08-20T01:29:01.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.304+0000 7f4ad4ff9640 1 -- 172.21.15.79:0/105997921 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7f4ac8018bd0 con 0x7f4ad8102730 2024-08-20T01:29:01.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.305+0000 7f4ad4ff9640 1 --2- 172.21.15.79:0/105997921 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4ac00b3b40 0x7f4ac00b6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:01.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.305+0000 7f4ad6ffd640 1 --2- 172.21.15.79:0/105997921 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4ac00b3b40 0x7f4ac00b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:01.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.305+0000 7f4ad4ff9640 1 -- 172.21.15.79:0/105997921 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4ac80e27b0 con 0x7f4ad8102730 2024-08-20T01:29:01.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.305+0000 7f4ad6ffd640 1 --2- 172.21.15.79:0/105997921 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4ac00b3b40 0x7f4ac00b6000 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4acc005fd0 tx=0x7f4acc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:01.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.307+0000 7f4ad4ff9640 1 -- 172.21.15.79:0/105997921 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f4ac8014030 con 0x7f4ad8102730 2024-08-20T01:29:01.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.489+0000 7f4ade098640 1 -- 172.21.15.79:0/105997921 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f4ad81a1100 con 0x7f4ad8102730 2024-08-20T01:29:01.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.492+0000 7f4ad4ff9640 1 -- 172.21.15.79:0/105997921 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v23)=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7f4ac80abb60 con 0x7f4ad8102730 2024-08-20T01:29:01.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.495+0000 7f4ade098640 1 -- 172.21.15.79:0/105997921 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4ac00b3b40 msgr2=0x7f4ac00b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:01.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.495+0000 7f4ade098640 1 --2- 172.21.15.79:0/105997921 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4ac00b3b40 0x7f4ac00b6000 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4acc005fd0 tx=0x7f4acc005850 comp rx=0 tx=0).stop 2024-08-20T01:29:01.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.495+0000 7f4ade098640 1 -- 172.21.15.79:0/105997921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ad8102730 msgr2=0x7f4ad8198850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:01.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.495+0000 7f4ade098640 1 --2- 172.21.15.79:0/105997921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ad8102730 0x7f4ad8198850 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800cce0 tx=0x7f4ac800a620 comp rx=0 tx=0).stop 2024-08-20T01:29:01.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.495+0000 7f4ade098640 1 -- 172.21.15.79:0/105997921 shutdown_connections 2024-08-20T01:29:01.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.495+0000 7f4ade098640 1 --2- 172.21.15.79:0/105997921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ad8104250 0x7f4ad8199ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:01.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.495+0000 7f4ade098640 1 --2- 172.21.15.79:0/105997921 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4ac00b3b40 0x7f4ac00b6000 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:01.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.495+0000 7f4ade098640 1 --2- 172.21.15.79:0/105997921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ad8103890 0x7f4ad8198ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:01.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.495+0000 7f4ade098640 1 --2- 172.21.15.79:0/105997921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ad8102730 0x7f4ad8198850 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:01.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.495+0000 7f4ade098640 1 -- 172.21.15.79:0/105997921 >> 172.21.15.79:0/105997921 conn(0x7f4ad80fe020 msgr2=0x7f4ad8104ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:01.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.495+0000 7f4ade098640 1 -- 172.21.15.79:0/105997921 shutdown_connections 2024-08-20T01:29:01.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:01.495+0000 7f4ade098640 1 -- 172.21.15.79:0/105997921 wait complete. 2024-08-20T01:29:01.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:01 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:01.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:01 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:01.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:01 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:29:01.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:01 smithi175 ceph-mon[22392]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:01.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:01 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/4022666589' entity='client.admin' 2024-08-20T01:29:01.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:01 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:01.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:01 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:01.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:01 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:29:01.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:01 smithi079 ceph-mon[18656]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:01.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:01 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/4022666589' entity='client.admin' 2024-08-20T01:29:01.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:01 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:01.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:01 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:01.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:01 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:29:01.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:01 smithi081 ceph-mon[22209]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:01.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:01 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/4022666589' entity='client.admin' 2024-08-20T01:29:02.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.295+0000 7fc13466e640 1 -- 172.21.15.79:0/3882505173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc12c1038a0 msgr2=0x7fc12c103d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:02.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.295+0000 7fc13466e640 1 --2- 172.21.15.79:0/3882505173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc12c1038a0 0x7fc12c103d20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc11c009930 tx=0x7fc11c02a420 comp rx=0 tx=0).stop 2024-08-20T01:29:02.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.295+0000 7fc13466e640 1 -- 172.21.15.79:0/3882505173 shutdown_connections 2024-08-20T01:29:02.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.295+0000 7fc13466e640 1 --2- 172.21.15.79:0/3882505173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc12c104260 0x7fc12c10abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:02.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.295+0000 7fc13466e640 1 --2- 172.21.15.79:0/3882505173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc12c1038a0 0x7fc12c103d20 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:02.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.295+0000 7fc13466e640 1 --2- 172.21.15.79:0/3882505173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc12c102740 0x7fc12c102b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:02.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.295+0000 7fc13466e640 1 -- 172.21.15.79:0/3882505173 >> 172.21.15.79:0/3882505173 conn(0x7fc12c0fe050 msgr2=0x7fc12c100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:02.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.295+0000 7fc13466e640 1 -- 172.21.15.79:0/3882505173 shutdown_connections 2024-08-20T01:29:02.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.295+0000 7fc13466e640 1 -- 172.21.15.79:0/3882505173 wait complete. 2024-08-20T01:29:02.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.295+0000 7fc13466e640 1 Processor -- start 2024-08-20T01:29:02.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.295+0000 7fc13466e640 1 -- start start 2024-08-20T01:29:02.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.296+0000 7fc13466e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc12c102740 0x7fc12c1988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:02.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.296+0000 7fc13466e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc12c1038a0 0x7fc12c198ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:02.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.296+0000 7fc13466e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc12c104260 0x7fc12c199b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:02.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.296+0000 7fc13466e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc12c10e110 con 0x7fc12c104260 2024-08-20T01:29:02.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.296+0000 7fc13466e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc12c10df90 con 0x7fc12c1038a0 2024-08-20T01:29:02.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.296+0000 7fc13466e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc12c10e290 con 0x7fc12c102740 2024-08-20T01:29:02.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.296+0000 7fc132c0b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc12c104260 0x7fc12c199b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:02.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.296+0000 7fc132c0b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc12c104260 0x7fc12c199b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37772/0 (socket says 172.21.15.79:37772) 2024-08-20T01:29:02.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.296+0000 7fc132c0b640 1 -- 172.21.15.79:0/265655854 learned_addr learned my addr 172.21.15.79:0/265655854 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:29:02.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.296+0000 7fc13240a640 1 --2- 172.21.15.79:0/265655854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc12c102740 0x7fc12c1988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:02.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.296+0000 7fc131c09640 1 --2- 172.21.15.79:0/265655854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc12c1038a0 0x7fc12c198ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:02.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.296+0000 7fc132c0b640 1 -- 172.21.15.79:0/265655854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc12c102740 msgr2=0x7fc12c1988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:02.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.296+0000 7fc132c0b640 1 --2- 172.21.15.79:0/265655854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc12c102740 0x7fc12c1988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:02.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.296+0000 7fc132c0b640 1 -- 172.21.15.79:0/265655854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc12c1038a0 msgr2=0x7fc12c198ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:02.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.296+0000 7fc132c0b640 1 --2- 172.21.15.79:0/265655854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc12c1038a0 0x7fc12c198ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:02.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.296+0000 7fc132c0b640 1 -- 172.21.15.79:0/265655854 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc12c19a3d0 con 0x7fc12c104260 2024-08-20T01:29:02.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.296+0000 7fc132c0b640 1 --2- 172.21.15.79:0/265655854 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc12c104260 0x7fc12c199b30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc12400eaa0 tx=0x7fc12400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:02.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.296+0000 7fc1237fe640 1 -- 172.21.15.79:0/265655854 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc124004d20 con 0x7fc12c104260 2024-08-20T01:29:02.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.296+0000 7fc1237fe640 1 -- 172.21.15.79:0/265655854 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fc124005020 con 0x7fc12c104260 2024-08-20T01:29:02.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.296+0000 7fc13466e640 1 -- 172.21.15.79:0/265655854 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc12c19a6c0 con 0x7fc12c104260 2024-08-20T01:29:02.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.296+0000 7fc1237fe640 1 -- 172.21.15.79:0/265655854 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1240116d0 con 0x7fc12c104260 2024-08-20T01:29:02.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.296+0000 7fc13466e640 1 -- 172.21.15.79:0/265655854 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc12c1a0da0 con 0x7fc12c104260 2024-08-20T01:29:02.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.297+0000 7fc13466e640 1 -- 172.21.15.79:0/265655854 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc12c102b40 con 0x7fc12c104260 2024-08-20T01:29:02.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.299+0000 7fc1237fe640 1 -- 172.21.15.79:0/265655854 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7fc12400caf0 con 0x7fc12c104260 2024-08-20T01:29:02.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.299+0000 7fc1237fe640 1 --2- 172.21.15.79:0/265655854 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc1180b3bc0 0x7fc1180b6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:02.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.299+0000 7fc13240a640 1 --2- 172.21.15.79:0/265655854 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc1180b3bc0 0x7fc1180b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:02.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.300+0000 7fc1237fe640 1 -- 172.21.15.79:0/265655854 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc1240e23f0 con 0x7fc12c104260 2024-08-20T01:29:02.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.300+0000 7fc13240a640 1 --2- 172.21.15.79:0/265655854 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc1180b3bc0 0x7fc1180b6080 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc12800abe0 tx=0x7fc12800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:02.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.302+0000 7fc1237fe640 1 -- 172.21.15.79:0/265655854 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fc124016030 con 0x7fc12c104260 2024-08-20T01:29:02.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.486+0000 7fc13466e640 1 -- 172.21.15.79:0/265655854 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7fc12c1a0f70 con 0x7fc12c104260 2024-08-20T01:29:02.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.489+0000 7fc1237fe640 1 -- 172.21.15.79:0/265655854 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v24)=0 v24) ==== 115+0+0 (secure 0 0 0) 0x7fc1240ab790 con 0x7fc12c104260 2024-08-20T01:29:02.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.492+0000 7fc13466e640 1 -- 172.21.15.79:0/265655854 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc1180b3bc0 msgr2=0x7fc1180b6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:02.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.492+0000 7fc13466e640 1 --2- 172.21.15.79:0/265655854 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc1180b3bc0 0x7fc1180b6080 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc12800abe0 tx=0x7fc12800a2d0 comp rx=0 tx=0).stop 2024-08-20T01:29:02.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.492+0000 7fc13466e640 1 -- 172.21.15.79:0/265655854 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc12c104260 msgr2=0x7fc12c199b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:02.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.492+0000 7fc13466e640 1 --2- 172.21.15.79:0/265655854 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc12c104260 0x7fc12c199b30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc12400eaa0 tx=0x7fc12400eea0 comp rx=0 tx=0).stop 2024-08-20T01:29:02.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.492+0000 7fc13466e640 1 -- 172.21.15.79:0/265655854 shutdown_connections 2024-08-20T01:29:02.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.492+0000 7fc13466e640 1 --2- 172.21.15.79:0/265655854 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc12c104260 0x7fc12c199b30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:02.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.492+0000 7fc13466e640 1 --2- 172.21.15.79:0/265655854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc12c1038a0 0x7fc12c198ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:02.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.492+0000 7fc13466e640 1 --2- 172.21.15.79:0/265655854 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc1180b3bc0 0x7fc1180b6080 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:02.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.492+0000 7fc13466e640 1 --2- 172.21.15.79:0/265655854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc12c102740 0x7fc12c1988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:02.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.492+0000 7fc13466e640 1 -- 172.21.15.79:0/265655854 >> 172.21.15.79:0/265655854 conn(0x7fc12c0fe050 msgr2=0x7fc12c104c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:02.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.492+0000 7fc13466e640 1 -- 172.21.15.79:0/265655854 shutdown_connections 2024-08-20T01:29:02.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:02.492+0000 7fc13466e640 1 -- 172.21.15.79:0/265655854 wait complete. 2024-08-20T01:29:02.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:02 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/105997921' entity='client.admin' 2024-08-20T01:29:02.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:02 smithi081 ceph-mon[22209]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:02.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:02 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/265655854' entity='client.admin' 2024-08-20T01:29:02.798 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:02 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/105997921' entity='client.admin' 2024-08-20T01:29:02.798 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:02 smithi079 ceph-mon[18656]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:02.798 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:02 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/265655854' entity='client.admin' 2024-08-20T01:29:02.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:02 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/105997921' entity='client.admin' 2024-08-20T01:29:02.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:02 smithi175 ceph-mon[22392]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:02.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:02 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/265655854' entity='client.admin' 2024-08-20T01:29:05.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:03.932+0000 7f90c271f640 1 -- 172.21.15.79:0/3787783637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90bc101640 msgr2=0x7f90bc101a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:05.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:03.932+0000 7f90c271f640 1 --2- 172.21.15.79:0/3787783637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90bc101640 0x7f90bc101a40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f90ac009930 tx=0x7f90ac02a420 comp rx=0 tx=0).stop 2024-08-20T01:29:05.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:03.932+0000 7f90c271f640 1 -- 172.21.15.79:0/3787783637 shutdown_connections 2024-08-20T01:29:05.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:03.932+0000 7f90c271f640 1 --2- 172.21.15.79:0/3787783637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90bc103160 0x7f90bc109ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:05.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:03.932+0000 7f90c271f640 1 --2- 172.21.15.79:0/3787783637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90bc1027a0 0x7f90bc102c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:05.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:03.932+0000 7f90c271f640 1 --2- 172.21.15.79:0/3787783637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90bc101640 0x7f90bc101a40 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:05.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:03.932+0000 7f90c271f640 1 -- 172.21.15.79:0/3787783637 >> 172.21.15.79:0/3787783637 conn(0x7f90bc0fcf30 msgr2=0x7f90bc0ff350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:05.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:03.932+0000 7f90c271f640 1 -- 172.21.15.79:0/3787783637 shutdown_connections 2024-08-20T01:29:05.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:03.932+0000 7f90c271f640 1 -- 172.21.15.79:0/3787783637 wait complete. 2024-08-20T01:29:05.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:03.932+0000 7f90c271f640 1 Processor -- start 2024-08-20T01:29:05.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:03.932+0000 7f90c271f640 1 -- start start 2024-08-20T01:29:05.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:03.933+0000 7f90c271f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90bc101640 0x7f90bc19ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:05.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:03.933+0000 7f90c271f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90bc1027a0 0x7f90bc19b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:05.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:03.933+0000 7f90c271f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90bc103160 0x7f90bc19be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:05.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:03.933+0000 7f90c271f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f90bc10d080 con 0x7f90bc1027a0 2024-08-20T01:29:05.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:03.933+0000 7f90c271f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f90bc10cf00 con 0x7f90bc101640 2024-08-20T01:29:05.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:03.933+0000 7f90c271f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f90bc10d200 con 0x7f90bc103160 2024-08-20T01:29:05.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:03.933+0000 7f90b3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90bc1027a0 0x7f90bc19b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:05.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:03.933+0000 7f90b3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90bc1027a0 0x7f90bc19b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37786/0 (socket says 172.21.15.79:37786) 2024-08-20T01:29:05.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:03.933+0000 7f90b3fff640 1 -- 172.21.15.79:0/2375932848 learned_addr learned my addr 172.21.15.79:0/2375932848 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:29:05.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:03.933+0000 7f90bbfff640 1 --2- 172.21.15.79:0/2375932848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90bc101640 0x7f90bc19ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:05.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:03.933+0000 7f90b3fff640 1 -- 172.21.15.79:0/2375932848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90bc103160 msgr2=0x7f90bc19be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:05.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:03.933+0000 7f90c0cbc640 1 --2- 172.21.15.79:0/2375932848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90bc103160 0x7f90bc19be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:05.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:03.933+0000 7f90b3fff640 1 --2- 172.21.15.79:0/2375932848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90bc103160 0x7f90bc19be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:05.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:03.933+0000 7f90b3fff640 1 -- 172.21.15.79:0/2375932848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90bc101640 msgr2=0x7f90bc19ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:05.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:03.933+0000 7f90b3fff640 1 --2- 172.21.15.79:0/2375932848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90bc101640 0x7f90bc19ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:05.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:03.933+0000 7f90b3fff640 1 -- 172.21.15.79:0/2375932848 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90bc19c6c0 con 0x7f90bc1027a0 2024-08-20T01:29:05.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:03.933+0000 7f90bbfff640 1 --2- 172.21.15.79:0/2375932848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90bc101640 0x7f90bc19ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:29:05.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:03.933+0000 7f90b3fff640 1 --2- 172.21.15.79:0/2375932848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90bc1027a0 0x7f90bc19b1e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f90a400d770 tx=0x7f90a400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:05.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:03.934+0000 7f90b9ffb640 1 -- 172.21.15.79:0/2375932848 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a4017070 con 0x7f90bc1027a0 2024-08-20T01:29:05.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:03.934+0000 7f90b9ffb640 1 -- 172.21.15.79:0/2375932848 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f90a4005490 con 0x7f90bc1027a0 2024-08-20T01:29:05.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:03.934+0000 7f90b9ffb640 1 -- 172.21.15.79:0/2375932848 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a4004b00 con 0x7f90bc1027a0 2024-08-20T01:29:05.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:03.934+0000 7f90c271f640 1 -- 172.21.15.79:0/2375932848 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90bc19c9b0 con 0x7f90bc1027a0 2024-08-20T01:29:05.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:03.934+0000 7f90c271f640 1 -- 172.21.15.79:0/2375932848 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90bc1a3090 con 0x7f90bc1027a0 2024-08-20T01:29:05.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:03.935+0000 7f90c271f640 1 -- 172.21.15.79:0/2375932848 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90bc101a40 con 0x7f90bc1027a0 2024-08-20T01:29:05.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:03.937+0000 7f90b9ffb640 1 -- 172.21.15.79:0/2375932848 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7f90a4004ca0 con 0x7f90bc1027a0 2024-08-20T01:29:05.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:03.937+0000 7f90b9ffb640 1 --2- 172.21.15.79:0/2375932848 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f90a80b3d30 0x7f90a80b61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:05.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:03.938+0000 7f90bbfff640 1 --2- 172.21.15.79:0/2375932848 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f90a80b3d30 0x7f90a80b61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:05.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:03.938+0000 7f90b9ffb640 1 -- 172.21.15.79:0/2375932848 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f90a40048a0 con 0x7f90bc1027a0 2024-08-20T01:29:05.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:03.938+0000 7f90bbfff640 1 --2- 172.21.15.79:0/2375932848 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f90a80b3d30 0x7f90a80b61f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f90ac009900 tx=0x7f90ac005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:05.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:03.940+0000 7f90b9ffb640 1 -- 172.21.15.79:0/2375932848 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f90a40aafa0 con 0x7f90bc1027a0 2024-08-20T01:29:05.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:04.118+0000 7f90c271f640 1 -- 172.21.15.79:0/2375932848 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f90bc1a3260 con 0x7f90bc1027a0 2024-08-20T01:29:05.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:04.122+0000 7f90b9ffb640 1 -- 172.21.15.79:0/2375932848 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v25)=0 v25) ==== 116+0+0 (secure 0 0 0) 0x7f90a40aa8a0 con 0x7f90bc1027a0 2024-08-20T01:29:05.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:04.125+0000 7f90c271f640 1 -- 172.21.15.79:0/2375932848 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f90a80b3d30 msgr2=0x7f90a80b61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:05.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:04.125+0000 7f90c271f640 1 --2- 172.21.15.79:0/2375932848 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f90a80b3d30 0x7f90a80b61f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f90ac009900 tx=0x7f90ac005fd0 comp rx=0 tx=0).stop 2024-08-20T01:29:05.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:04.125+0000 7f90c271f640 1 -- 172.21.15.79:0/2375932848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90bc1027a0 msgr2=0x7f90bc19b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:05.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:04.125+0000 7f90c271f640 1 --2- 172.21.15.79:0/2375932848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90bc1027a0 0x7f90bc19b1e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f90a400d770 tx=0x7f90a400dc30 comp rx=0 tx=0).stop 2024-08-20T01:29:05.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:04.125+0000 7f90c271f640 1 -- 172.21.15.79:0/2375932848 shutdown_connections 2024-08-20T01:29:05.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:04.125+0000 7f90c271f640 1 --2- 172.21.15.79:0/2375932848 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f90a80b3d30 0x7f90a80b61f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:05.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:04.125+0000 7f90c271f640 1 --2- 172.21.15.79:0/2375932848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90bc103160 0x7f90bc19be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:05.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:04.125+0000 7f90c271f640 1 --2- 172.21.15.79:0/2375932848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90bc1027a0 0x7f90bc19b1e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:05.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:04.125+0000 7f90c271f640 1 --2- 172.21.15.79:0/2375932848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90bc101640 0x7f90bc19ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:05.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:04.125+0000 7f90c271f640 1 -- 172.21.15.79:0/2375932848 >> 172.21.15.79:0/2375932848 conn(0x7f90bc0fcf30 msgr2=0x7f90bc0fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:05.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:04.125+0000 7f90c271f640 1 -- 172.21.15.79:0/2375932848 shutdown_connections 2024-08-20T01:29:05.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:04.125+0000 7f90c271f640 1 -- 172.21.15.79:0/2375932848 wait complete. 2024-08-20T01:29:05.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:05 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2375932848' entity='client.admin' 2024-08-20T01:29:05.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:05 smithi079 ceph-mon[18656]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:05.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:05 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2375932848' entity='client.admin' 2024-08-20T01:29:05.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:05 smithi175 ceph-mon[22392]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:05.480 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:05 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2375932848' entity='client.admin' 2024-08-20T01:29:05.480 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:05 smithi081 ceph-mon[22209]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:05.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.067+0000 7f9267842640 1 -- 172.21.15.79:0/874676084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9260101610 msgr2=0x7f9260101a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:05.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.067+0000 7f9267842640 1 --2- 172.21.15.79:0/874676084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9260101610 0x7f9260101a10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9250009930 tx=0x7f925002a420 comp rx=0 tx=0).stop 2024-08-20T01:29:05.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.067+0000 7f9267842640 1 -- 172.21.15.79:0/874676084 shutdown_connections 2024-08-20T01:29:05.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.067+0000 7f9267842640 1 --2- 172.21.15.79:0/874676084 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9260103130 0x7f9260109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:05.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.067+0000 7f9267842640 1 --2- 172.21.15.79:0/874676084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9260102770 0x7f9260102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:05.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.067+0000 7f9267842640 1 --2- 172.21.15.79:0/874676084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9260101610 0x7f9260101a10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:05.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.067+0000 7f9267842640 1 -- 172.21.15.79:0/874676084 >> 172.21.15.79:0/874676084 conn(0x7f92600fcee0 msgr2=0x7f92600ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:05.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.067+0000 7f9267842640 1 -- 172.21.15.79:0/874676084 shutdown_connections 2024-08-20T01:29:05.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.067+0000 7f9267842640 1 -- 172.21.15.79:0/874676084 wait complete. 2024-08-20T01:29:05.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.068+0000 7f9267842640 1 Processor -- start 2024-08-20T01:29:05.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.068+0000 7f9267842640 1 -- start start 2024-08-20T01:29:05.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.068+0000 7f9267842640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9260101610 0x7f9260198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:05.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.068+0000 7f9267842640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9260102770 0x7f9260198fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:05.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.068+0000 7f9267842640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9260103130 0x7f9260199c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:05.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.068+0000 7f9267842640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f926006b0b0 con 0x7f9260103130 2024-08-20T01:29:05.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.068+0000 7f9267842640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f926006af30 con 0x7f9260101610 2024-08-20T01:29:05.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.068+0000 7f9267842640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f926006b230 con 0x7f9260102770 2024-08-20T01:29:05.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.068+0000 7f9265ddf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9260103130 0x7f9260199c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:05.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.068+0000 7f9265ddf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9260103130 0x7f9260199c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37810/0 (socket says 172.21.15.79:37810) 2024-08-20T01:29:05.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.068+0000 7f9265ddf640 1 -- 172.21.15.79:0/3664833419 learned_addr learned my addr 172.21.15.79:0/3664833419 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:29:05.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.068+0000 7f92655de640 1 --2- 172.21.15.79:0/3664833419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9260101610 0x7f9260198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:05.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.068+0000 7f9264ddd640 1 --2- 172.21.15.79:0/3664833419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9260102770 0x7f9260198fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:05.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.068+0000 7f9265ddf640 1 -- 172.21.15.79:0/3664833419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9260102770 msgr2=0x7f9260198fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:05.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.068+0000 7f9265ddf640 1 --2- 172.21.15.79:0/3664833419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9260102770 0x7f9260198fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:05.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.068+0000 7f9265ddf640 1 -- 172.21.15.79:0/3664833419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9260101610 msgr2=0x7f9260198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:05.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.068+0000 7f9265ddf640 1 --2- 172.21.15.79:0/3664833419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9260101610 0x7f9260198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:05.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.068+0000 7f9265ddf640 1 -- 172.21.15.79:0/3664833419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f926019a4a0 con 0x7f9260103130 2024-08-20T01:29:05.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.068+0000 7f9264ddd640 1 --2- 172.21.15.79:0/3664833419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9260102770 0x7f9260198fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:29:05.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.068+0000 7f9265ddf640 1 --2- 172.21.15.79:0/3664833419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9260103130 0x7f9260199c00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f925800cad0 tx=0x7f925800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:05.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.069+0000 7f92567fc640 1 -- 172.21.15.79:0/3664833419 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925800ae20 con 0x7f9260103130 2024-08-20T01:29:05.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.069+0000 7f92567fc640 1 -- 172.21.15.79:0/3664833419 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f9258005020 con 0x7f9260103130 2024-08-20T01:29:05.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.069+0000 7f92567fc640 1 -- 172.21.15.79:0/3664833419 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925800f6b0 con 0x7f9260103130 2024-08-20T01:29:05.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.069+0000 7f9267842640 1 -- 172.21.15.79:0/3664833419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f926019a790 con 0x7f9260103130 2024-08-20T01:29:05.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.069+0000 7f9267842640 1 -- 172.21.15.79:0/3664833419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92601a0e70 con 0x7f9260103130 2024-08-20T01:29:05.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.070+0000 7f9267842640 1 -- 172.21.15.79:0/3664833419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9260101a10 con 0x7f9260103130 2024-08-20T01:29:05.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.071+0000 7f92567fc640 1 -- 172.21.15.79:0/3664833419 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7f9258004a40 con 0x7f9260103130 2024-08-20T01:29:05.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.072+0000 7f92567fc640 1 --2- 172.21.15.79:0/3664833419 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f924c0b3bc0 0x7f924c0b6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:05.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.072+0000 7f92655de640 1 --2- 172.21.15.79:0/3664833419 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f924c0b3bc0 0x7f924c0b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:05.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.072+0000 7f92567fc640 1 -- 172.21.15.79:0/3664833419 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f92580e2230 con 0x7f9260103130 2024-08-20T01:29:05.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.072+0000 7f92655de640 1 --2- 172.21.15.79:0/3664833419 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f924c0b3bc0 0x7f924c0b6080 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9250004770 tx=0x7f9250005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:05.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.078+0000 7f92567fc640 1 -- 172.21.15.79:0/3664833419 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f9258014030 con 0x7f9260103130 2024-08-20T01:29:05.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.264+0000 7f9267842640 1 -- 172.21.15.79:0/3664833419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f9260108a60 con 0x7f9260103130 2024-08-20T01:29:05.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.267+0000 7f92567fc640 1 -- 172.21.15.79:0/3664833419 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v26)=0 v26) ==== 122+0+0 (secure 0 0 0) 0x7f9260108a60 con 0x7f9260103130 2024-08-20T01:29:05.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.270+0000 7f9267842640 1 -- 172.21.15.79:0/3664833419 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f924c0b3bc0 msgr2=0x7f924c0b6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:05.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.270+0000 7f9267842640 1 --2- 172.21.15.79:0/3664833419 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f924c0b3bc0 0x7f924c0b6080 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9250004770 tx=0x7f9250005fd0 comp rx=0 tx=0).stop 2024-08-20T01:29:05.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.270+0000 7f9267842640 1 -- 172.21.15.79:0/3664833419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9260103130 msgr2=0x7f9260199c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:05.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.270+0000 7f9267842640 1 --2- 172.21.15.79:0/3664833419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9260103130 0x7f9260199c00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f925800cad0 tx=0x7f925800cf90 comp rx=0 tx=0).stop 2024-08-20T01:29:05.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.270+0000 7f9267842640 1 -- 172.21.15.79:0/3664833419 shutdown_connections 2024-08-20T01:29:05.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.270+0000 7f9267842640 1 --2- 172.21.15.79:0/3664833419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9260103130 0x7f9260199c00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:05.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.270+0000 7f9267842640 1 --2- 172.21.15.79:0/3664833419 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f924c0b3bc0 0x7f924c0b6080 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:05.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.270+0000 7f9267842640 1 --2- 172.21.15.79:0/3664833419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9260102770 0x7f9260198fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:05.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.270+0000 7f9267842640 1 --2- 172.21.15.79:0/3664833419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9260101610 0x7f9260198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:05.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.270+0000 7f9267842640 1 -- 172.21.15.79:0/3664833419 >> 172.21.15.79:0/3664833419 conn(0x7f92600fcee0 msgr2=0x7f9260105c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:05.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.270+0000 7f9267842640 1 -- 172.21.15.79:0/3664833419 shutdown_connections 2024-08-20T01:29:05.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:05.270+0000 7f9267842640 1 -- 172.21.15.79:0/3664833419 wait complete. 2024-08-20T01:29:06.383 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:06 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/3664833419' entity='client.admin' 2024-08-20T01:29:06.403 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:06.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:06 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/3664833419' entity='client.admin' 2024-08-20T01:29:06.567 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:06 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/3664833419' entity='client.admin' 2024-08-20T01:29:07.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.046+0000 7ff2a4531640 1 -- 172.21.15.79:0/4208896219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff29c1058c0 msgr2=0x7ff29c107d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:07.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.046+0000 7ff2a4531640 1 --2- 172.21.15.79:0/4208896219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff29c1058c0 0x7ff29c107d30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff28c009900 tx=0x7ff28c02a410 comp rx=0 tx=0).stop 2024-08-20T01:29:07.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.047+0000 7ff2a4531640 1 -- 172.21.15.79:0/4208896219 shutdown_connections 2024-08-20T01:29:07.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.047+0000 7ff2a4531640 1 --2- 172.21.15.79:0/4208896219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff29c108470 0x7ff29c10a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:07.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.047+0000 7ff2a4531640 1 --2- 172.21.15.79:0/4208896219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff29c1058c0 0x7ff29c107d30 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:07.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.047+0000 7ff2a4531640 1 --2- 172.21.15.79:0/4208896219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff29c06bdc0 0x7ff29c105330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:07.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.047+0000 7ff2a4531640 1 -- 172.21.15.79:0/4208896219 >> 172.21.15.79:0/4208896219 conn(0x7ff29c0fcf00 msgr2=0x7ff29c0ff360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:07.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.047+0000 7ff2a4531640 1 -- 172.21.15.79:0/4208896219 shutdown_connections 2024-08-20T01:29:07.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.047+0000 7ff2a4531640 1 -- 172.21.15.79:0/4208896219 wait complete. 2024-08-20T01:29:07.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.047+0000 7ff2a4531640 1 Processor -- start 2024-08-20T01:29:07.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.047+0000 7ff2a4531640 1 -- start start 2024-08-20T01:29:07.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.047+0000 7ff2a4531640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff29c06bdc0 0x7ff29c198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:07.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.047+0000 7ff2a4531640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff29c1058c0 0x7ff29c198fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:07.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.047+0000 7ff2a4531640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff29c108470 0x7ff29c199bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:07.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.047+0000 7ff2a4531640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff29c10e110 con 0x7ff29c06bdc0 2024-08-20T01:29:07.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.047+0000 7ff2a4531640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff29c10df90 con 0x7ff29c1058c0 2024-08-20T01:29:07.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.047+0000 7ff2a4531640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff29c10e290 con 0x7ff29c108470 2024-08-20T01:29:07.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.047+0000 7ff2a22cd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff29c06bdc0 0x7ff29c198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:07.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.047+0000 7ff2a22cd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff29c06bdc0 0x7ff29c198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37818/0 (socket says 172.21.15.79:37818) 2024-08-20T01:29:07.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.047+0000 7ff2a22cd640 1 -- 172.21.15.79:0/342836793 learned_addr learned my addr 172.21.15.79:0/342836793 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:29:07.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.048+0000 7ff2a2ace640 1 --2- 172.21.15.79:0/342836793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff29c108470 0x7ff29c199bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:07.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.048+0000 7ff2a1acc640 1 --2- 172.21.15.79:0/342836793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff29c1058c0 0x7ff29c198fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:07.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.048+0000 7ff2a22cd640 1 -- 172.21.15.79:0/342836793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff29c108470 msgr2=0x7ff29c199bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:07.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.048+0000 7ff2a22cd640 1 --2- 172.21.15.79:0/342836793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff29c108470 0x7ff29c199bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:07.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.048+0000 7ff2a22cd640 1 -- 172.21.15.79:0/342836793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff29c1058c0 msgr2=0x7ff29c198fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:07.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.048+0000 7ff2a22cd640 1 --2- 172.21.15.79:0/342836793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff29c1058c0 0x7ff29c198fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:07.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.048+0000 7ff2a22cd640 1 -- 172.21.15.79:0/342836793 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff29c19a490 con 0x7ff29c06bdc0 2024-08-20T01:29:07.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.048+0000 7ff2a2ace640 1 --2- 172.21.15.79:0/342836793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff29c108470 0x7ff29c199bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:29:07.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.048+0000 7ff2a22cd640 1 --2- 172.21.15.79:0/342836793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff29c06bdc0 0x7ff29c198960 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff29800cce0 tx=0x7ff29800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:07.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.048+0000 7ff2937fe640 1 -- 172.21.15.79:0/342836793 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29800f650 con 0x7ff29c06bdc0 2024-08-20T01:29:07.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.048+0000 7ff2a4531640 1 -- 172.21.15.79:0/342836793 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff29c19a780 con 0x7ff29c06bdc0 2024-08-20T01:29:07.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.048+0000 7ff2937fe640 1 -- 172.21.15.79:0/342836793 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7ff29800fc60 con 0x7ff29c06bdc0 2024-08-20T01:29:07.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.048+0000 7ff2937fe640 1 -- 172.21.15.79:0/342836793 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff298018a30 con 0x7ff29c06bdc0 2024-08-20T01:29:07.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.048+0000 7ff2a4531640 1 -- 172.21.15.79:0/342836793 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff29c1a0e60 con 0x7ff29c06bdc0 2024-08-20T01:29:07.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.049+0000 7ff2a4531640 1 -- 172.21.15.79:0/342836793 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff29c105d20 con 0x7ff29c06bdc0 2024-08-20T01:29:07.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.050+0000 7ff2937fe640 1 -- 172.21.15.79:0/342836793 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7ff298018bd0 con 0x7ff29c06bdc0 2024-08-20T01:29:07.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.051+0000 7ff2937fe640 1 --2- 172.21.15.79:0/342836793 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff2880b3b40 0x7ff2880b6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:07.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.051+0000 7ff2a1acc640 1 --2- 172.21.15.79:0/342836793 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff2880b3b40 0x7ff2880b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:07.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.052+0000 7ff2937fe640 1 -- 172.21.15.79:0/342836793 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff2980e27f0 con 0x7ff29c06bdc0 2024-08-20T01:29:07.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.052+0000 7ff2a1acc640 1 --2- 172.21.15.79:0/342836793 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff2880b3b40 0x7ff2880b6000 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff28c000c00 tx=0x7ff28c0041c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:07.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.054+0000 7ff2937fe640 1 -- 172.21.15.79:0/342836793 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7ff298014030 con 0x7ff29c06bdc0 2024-08-20T01:29:07.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.235+0000 7ff2a4531640 1 -- 172.21.15.79:0/342836793 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7ff29c0fe9f0 con 0x7ff29c06bdc0 2024-08-20T01:29:07.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.239+0000 7ff2937fe640 1 -- 172.21.15.79:0/342836793 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v27)=0 v27) ==== 120+0+0 (secure 0 0 0) 0x7ff2980abb00 con 0x7ff29c06bdc0 2024-08-20T01:29:07.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.241+0000 7ff2a4531640 1 -- 172.21.15.79:0/342836793 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff2880b3b40 msgr2=0x7ff2880b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:07.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.241+0000 7ff2a4531640 1 --2- 172.21.15.79:0/342836793 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff2880b3b40 0x7ff2880b6000 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff28c000c00 tx=0x7ff28c0041c0 comp rx=0 tx=0).stop 2024-08-20T01:29:07.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.241+0000 7ff2a4531640 1 -- 172.21.15.79:0/342836793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff29c06bdc0 msgr2=0x7ff29c198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:07.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.241+0000 7ff2a4531640 1 --2- 172.21.15.79:0/342836793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff29c06bdc0 0x7ff29c198960 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff29800cce0 tx=0x7ff29800a620 comp rx=0 tx=0).stop 2024-08-20T01:29:07.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.241+0000 7ff2a4531640 1 -- 172.21.15.79:0/342836793 shutdown_connections 2024-08-20T01:29:07.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.241+0000 7ff2a4531640 1 --2- 172.21.15.79:0/342836793 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff2880b3b40 0x7ff2880b6000 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:07.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.241+0000 7ff2a4531640 1 --2- 172.21.15.79:0/342836793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff29c108470 0x7ff29c199bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:07.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.241+0000 7ff2a4531640 1 --2- 172.21.15.79:0/342836793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff29c1058c0 0x7ff29c198fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:07.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.241+0000 7ff2a4531640 1 --2- 172.21.15.79:0/342836793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff29c06bdc0 0x7ff29c198960 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:07.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.241+0000 7ff2a4531640 1 -- 172.21.15.79:0/342836793 >> 172.21.15.79:0/342836793 conn(0x7ff29c0fcf00 msgr2=0x7ff29c103c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:07.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.241+0000 7ff2a4531640 1 -- 172.21.15.79:0/342836793 shutdown_connections 2024-08-20T01:29:07.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.241+0000 7ff2a4531640 1 -- 172.21.15.79:0/342836793 wait complete. 2024-08-20T01:29:07.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.249+0000 7f0ac4295640 1 -- 172.21.15.79:0/8267201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0abc102750 msgr2=0x7f0abc102b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:07.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.249+0000 7f0ac4295640 1 --2- 172.21.15.79:0/8267201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0abc102750 0x7f0abc102b50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8009930 tx=0x7f0ab802a420 comp rx=0 tx=0).stop 2024-08-20T01:29:07.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.249+0000 7f0ac4295640 1 -- 172.21.15.79:0/8267201 shutdown_connections 2024-08-20T01:29:07.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.249+0000 7f0ac4295640 1 --2- 172.21.15.79:0/8267201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0abc104270 0x7f0abc10abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:07.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.249+0000 7f0ac4295640 1 --2- 172.21.15.79:0/8267201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0abc1038b0 0x7f0abc103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:07.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.249+0000 7f0ac4295640 1 --2- 172.21.15.79:0/8267201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0abc102750 0x7f0abc102b50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:07.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.249+0000 7f0ac4295640 1 -- 172.21.15.79:0/8267201 >> 172.21.15.79:0/8267201 conn(0x7f0abc0fe080 msgr2=0x7f0abc1004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:07.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.249+0000 7f0ac4295640 1 -- 172.21.15.79:0/8267201 shutdown_connections 2024-08-20T01:29:07.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.249+0000 7f0ac4295640 1 -- 172.21.15.79:0/8267201 wait complete. 2024-08-20T01:29:07.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.250+0000 7f0ac4295640 1 Processor -- start 2024-08-20T01:29:07.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.250+0000 7f0ac4295640 1 -- start start 2024-08-20T01:29:07.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.250+0000 7f0ac4295640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0abc102750 0x7f0abc198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:07.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.250+0000 7f0ac4295640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0abc1038b0 0x7f0abc198fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:07.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.250+0000 7f0ac4295640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0abc104270 0x7f0abc199be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:07.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.250+0000 7f0ac4295640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0abc10e140 con 0x7f0abc102750 2024-08-20T01:29:07.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.250+0000 7f0ac4295640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0abc10dfc0 con 0x7f0abc1038b0 2024-08-20T01:29:07.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.250+0000 7f0ac4295640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0abc10e2c0 con 0x7f0abc104270 2024-08-20T01:29:07.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.250+0000 7f0ac2031640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0abc102750 0x7f0abc198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:07.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.250+0000 7f0ac2031640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0abc102750 0x7f0abc198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37830/0 (socket says 172.21.15.79:37830) 2024-08-20T01:29:07.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.250+0000 7f0ac2031640 1 -- 172.21.15.79:0/2737629767 learned_addr learned my addr 172.21.15.79:0/2737629767 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:29:07.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.250+0000 7f0ac1830640 1 --2- 172.21.15.79:0/2737629767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0abc1038b0 0x7f0abc198fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:07.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.250+0000 7f0ac2832640 1 --2- 172.21.15.79:0/2737629767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0abc104270 0x7f0abc199be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:07.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.250+0000 7f0ac2031640 1 -- 172.21.15.79:0/2737629767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0abc104270 msgr2=0x7f0abc199be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:07.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.250+0000 7f0ac2031640 1 --2- 172.21.15.79:0/2737629767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0abc104270 0x7f0abc199be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:07.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.250+0000 7f0ac2031640 1 -- 172.21.15.79:0/2737629767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0abc1038b0 msgr2=0x7f0abc198fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:07.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.250+0000 7f0ac2031640 1 --2- 172.21.15.79:0/2737629767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0abc1038b0 0x7f0abc198fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:07.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.250+0000 7f0ac2031640 1 -- 172.21.15.79:0/2737629767 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0abc19a480 con 0x7f0abc102750 2024-08-20T01:29:07.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.250+0000 7f0ac2031640 1 --2- 172.21.15.79:0/2737629767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0abc102750 0x7f0abc198950 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8009230 tx=0x7f0ab80040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:07.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.251+0000 7f0ab37fe640 1 -- 172.21.15.79:0/2737629767 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab803f070 con 0x7f0abc102750 2024-08-20T01:29:07.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.251+0000 7f0ac4295640 1 -- 172.21.15.79:0/2737629767 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0abc19a710 con 0x7f0abc102750 2024-08-20T01:29:07.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.251+0000 7f0ab37fe640 1 -- 172.21.15.79:0/2737629767 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f0ab8004fd0 con 0x7f0abc102750 2024-08-20T01:29:07.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.251+0000 7f0ab37fe640 1 -- 172.21.15.79:0/2737629767 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab8035030 con 0x7f0abc102750 2024-08-20T01:29:07.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.251+0000 7f0ac4295640 1 -- 172.21.15.79:0/2737629767 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0abc1a0e50 con 0x7f0abc102750 2024-08-20T01:29:07.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.252+0000 7f0ac4295640 1 -- 172.21.15.79:0/2737629767 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0abc10e900 con 0x7f0abc102750 2024-08-20T01:29:07.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.253+0000 7f0ab37fe640 1 -- 172.21.15.79:0/2737629767 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7f0ab8042070 con 0x7f0abc102750 2024-08-20T01:29:07.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.254+0000 7f0ab37fe640 1 --2- 172.21.15.79:0/2737629767 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0aa80b3b40 0x7f0aa80b6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:07.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.254+0000 7f0ac1830640 1 --2- 172.21.15.79:0/2737629767 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0aa80b3b40 0x7f0aa80b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:07.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.254+0000 7f0ab37fe640 1 -- 172.21.15.79:0/2737629767 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f0ab8102790 con 0x7f0abc102750 2024-08-20T01:29:07.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.254+0000 7f0ac1830640 1 --2- 172.21.15.79:0/2737629767 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0aa80b3b40 0x7f0aa80b6000 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0aac005fd0 tx=0x7f0aac00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:07.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.258+0000 7f0ab37fe640 1 -- 172.21.15.79:0/2737629767 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f0ab8004770 con 0x7f0abc102750 2024-08-20T01:29:07.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.445+0000 7f0ac4295640 1 -- 172.21.15.79:0/2737629767 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f0abc02e450 con 0x7f0abc102750 2024-08-20T01:29:07.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.451+0000 7f0ab37fe640 1 -- 172.21.15.79:0/2737629767 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v28)=0 v28) ==== 121+0+0 (secure 0 0 0) 0x7f0ab80cbab0 con 0x7f0abc102750 2024-08-20T01:29:07.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.453+0000 7f0ac4295640 1 -- 172.21.15.79:0/2737629767 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0aa80b3b40 msgr2=0x7f0aa80b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:07.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.453+0000 7f0ac4295640 1 --2- 172.21.15.79:0/2737629767 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0aa80b3b40 0x7f0aa80b6000 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0aac005fd0 tx=0x7f0aac00b390 comp rx=0 tx=0).stop 2024-08-20T01:29:07.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.453+0000 7f0ac4295640 1 -- 172.21.15.79:0/2737629767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0abc102750 msgr2=0x7f0abc198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:07.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.453+0000 7f0ac4295640 1 --2- 172.21.15.79:0/2737629767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0abc102750 0x7f0abc198950 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8009230 tx=0x7f0ab80040e0 comp rx=0 tx=0).stop 2024-08-20T01:29:07.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.453+0000 7f0ac4295640 1 -- 172.21.15.79:0/2737629767 shutdown_connections 2024-08-20T01:29:07.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.453+0000 7f0ac4295640 1 --2- 172.21.15.79:0/2737629767 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0aa80b3b40 0x7f0aa80b6000 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:07.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.453+0000 7f0ac4295640 1 --2- 172.21.15.79:0/2737629767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0abc104270 0x7f0abc199be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:07.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.453+0000 7f0ac4295640 1 --2- 172.21.15.79:0/2737629767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0abc1038b0 0x7f0abc198fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:07.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.453+0000 7f0ac4295640 1 --2- 172.21.15.79:0/2737629767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0abc102750 0x7f0abc198950 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:07.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.453+0000 7f0ac4295640 1 -- 172.21.15.79:0/2737629767 >> 172.21.15.79:0/2737629767 conn(0x7f0abc0fe080 msgr2=0x7f0abc106d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:07.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.453+0000 7f0ac4295640 1 -- 172.21.15.79:0/2737629767 shutdown_connections 2024-08-20T01:29:07.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.453+0000 7f0ac4295640 1 -- 172.21.15.79:0/2737629767 wait complete. 2024-08-20T01:29:07.498 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:07 smithi079 ceph-mon[18656]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:07.498 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:07 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:29:07.498 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:07 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:29:07.498 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:07 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:07.498 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:07 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/342836793' entity='client.admin' 2024-08-20T01:29:07.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:07 smithi175 ceph-mon[22392]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:07.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:07 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:29:07.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:07 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:29:07.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:07 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:07.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:07 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/342836793' entity='client.admin' 2024-08-20T01:29:07.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:07 smithi081 ceph-mon[22209]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:07.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:07 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:29:07.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:07 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:29:07.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:07 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:07.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:07 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/342836793' entity='client.admin' 2024-08-20T01:29:07.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.875+0000 7fe6639e5640 1 -- 172.21.15.79:0/472223153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe65c101610 msgr2=0x7fe65c101a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:07.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.875+0000 7fe6639e5640 1 --2- 172.21.15.79:0/472223153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe65c101610 0x7fe65c101a10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe654009930 tx=0x7fe65402a420 comp rx=0 tx=0).stop 2024-08-20T01:29:07.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.875+0000 7fe6639e5640 1 -- 172.21.15.79:0/472223153 shutdown_connections 2024-08-20T01:29:07.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.875+0000 7fe6639e5640 1 --2- 172.21.15.79:0/472223153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe65c103130 0x7fe65c109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:07.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.875+0000 7fe6639e5640 1 --2- 172.21.15.79:0/472223153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe65c102770 0x7fe65c102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:07.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.875+0000 7fe6639e5640 1 --2- 172.21.15.79:0/472223153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe65c101610 0x7fe65c101a10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:07.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.875+0000 7fe6639e5640 1 -- 172.21.15.79:0/472223153 >> 172.21.15.79:0/472223153 conn(0x7fe65c0fcee0 msgr2=0x7fe65c0ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:07.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.875+0000 7fe6639e5640 1 -- 172.21.15.79:0/472223153 shutdown_connections 2024-08-20T01:29:07.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.876+0000 7fe6639e5640 1 -- 172.21.15.79:0/472223153 wait complete. 2024-08-20T01:29:07.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.876+0000 7fe6639e5640 1 Processor -- start 2024-08-20T01:29:07.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.876+0000 7fe6639e5640 1 -- start start 2024-08-20T01:29:07.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.876+0000 7fe6639e5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe65c101610 0x7fe65c1989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:07.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.876+0000 7fe6639e5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe65c102770 0x7fe65c199040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:07.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.876+0000 7fe6639e5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe65c103130 0x7fe65c199c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:07.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.876+0000 7fe6639e5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe65c10cfe0 con 0x7fe65c102770 2024-08-20T01:29:07.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.876+0000 7fe6639e5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe65c10ce60 con 0x7fe65c101610 2024-08-20T01:29:07.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.876+0000 7fe6639e5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe65c10d160 con 0x7fe65c103130 2024-08-20T01:29:07.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.876+0000 7fe660f80640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe65c102770 0x7fe65c199040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:07.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.876+0000 7fe660f80640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe65c102770 0x7fe65c199040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37848/0 (socket says 172.21.15.79:37848) 2024-08-20T01:29:07.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.876+0000 7fe660f80640 1 -- 172.21.15.79:0/1870391637 learned_addr learned my addr 172.21.15.79:0/1870391637 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:29:07.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.877+0000 7fe661f82640 1 --2- 172.21.15.79:0/1870391637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe65c103130 0x7fe65c199c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:07.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.877+0000 7fe661781640 1 --2- 172.21.15.79:0/1870391637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe65c101610 0x7fe65c1989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:07.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.877+0000 7fe660f80640 1 -- 172.21.15.79:0/1870391637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe65c103130 msgr2=0x7fe65c199c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:07.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.877+0000 7fe660f80640 1 --2- 172.21.15.79:0/1870391637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe65c103130 0x7fe65c199c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:07.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.877+0000 7fe660f80640 1 -- 172.21.15.79:0/1870391637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe65c101610 msgr2=0x7fe65c1989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:07.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.877+0000 7fe660f80640 1 --2- 172.21.15.79:0/1870391637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe65c101610 0x7fe65c1989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:07.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.877+0000 7fe660f80640 1 -- 172.21.15.79:0/1870391637 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe65c19a520 con 0x7fe65c102770 2024-08-20T01:29:07.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.877+0000 7fe661781640 1 --2- 172.21.15.79:0/1870391637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe65c101610 0x7fe65c1989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:29:07.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.877+0000 7fe660f80640 1 --2- 172.21.15.79:0/1870391637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe65c102770 0x7fe65c199040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe65000d950 tx=0x7fe65000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:07.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.877+0000 7fe65a7fc640 1 -- 172.21.15.79:0/1870391637 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe650017070 con 0x7fe65c102770 2024-08-20T01:29:07.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.877+0000 7fe65a7fc640 1 -- 172.21.15.79:0/1870391637 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fe650009c30 con 0x7fe65c102770 2024-08-20T01:29:07.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.877+0000 7fe6639e5640 1 -- 172.21.15.79:0/1870391637 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe65c19a810 con 0x7fe65c102770 2024-08-20T01:29:07.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.877+0000 7fe65a7fc640 1 -- 172.21.15.79:0/1870391637 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65000f620 con 0x7fe65c102770 2024-08-20T01:29:07.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.877+0000 7fe6639e5640 1 -- 172.21.15.79:0/1870391637 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe65c1a0ef0 con 0x7fe65c102770 2024-08-20T01:29:07.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.878+0000 7fe6639e5640 1 -- 172.21.15.79:0/1870391637 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe65c101a10 con 0x7fe65c102770 2024-08-20T01:29:07.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.880+0000 7fe65a7fc640 1 -- 172.21.15.79:0/1870391637 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7fe650010460 con 0x7fe65c102770 2024-08-20T01:29:07.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.880+0000 7fe65a7fc640 1 --2- 172.21.15.79:0/1870391637 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe6440b3bc0 0x7fe6440b6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:07.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.880+0000 7fe661781640 1 --2- 172.21.15.79:0/1870391637 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe6440b3bc0 0x7fe6440b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:07.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.880+0000 7fe65a7fc640 1 -- 172.21.15.79:0/1870391637 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe6500e1a60 con 0x7fe65c102770 2024-08-20T01:29:07.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.881+0000 7fe661781640 1 --2- 172.21.15.79:0/1870391637 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe6440b3bc0 0x7fe6440b6080 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe654006010 tx=0x7fe654009610 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:07.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:07.883+0000 7fe65a7fc640 1 -- 172.21.15.79:0/1870391637 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fe6500aae00 con 0x7fe65c102770 2024-08-20T01:29:08.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.068+0000 7fe6639e5640 1 -- 172.21.15.79:0/1870391637 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fe65c1a10c0 con 0x7fe65c102770 2024-08-20T01:29:08.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.072+0000 7fe65a7fc640 1 -- 172.21.15.79:0/1870391637 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v29)=0 v29) ==== 120+0+0 (secure 0 0 0) 0x7fe6500a4e20 con 0x7fe65c102770 2024-08-20T01:29:08.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.075+0000 7fe6639e5640 1 -- 172.21.15.79:0/1870391637 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe6440b3bc0 msgr2=0x7fe6440b6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:08.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.075+0000 7fe6639e5640 1 --2- 172.21.15.79:0/1870391637 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe6440b3bc0 0x7fe6440b6080 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe654006010 tx=0x7fe654009610 comp rx=0 tx=0).stop 2024-08-20T01:29:08.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.075+0000 7fe6639e5640 1 -- 172.21.15.79:0/1870391637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe65c102770 msgr2=0x7fe65c199040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:08.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.075+0000 7fe6639e5640 1 --2- 172.21.15.79:0/1870391637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe65c102770 0x7fe65c199040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe65000d950 tx=0x7fe65000de10 comp rx=0 tx=0).stop 2024-08-20T01:29:08.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.075+0000 7fe6639e5640 1 -- 172.21.15.79:0/1870391637 shutdown_connections 2024-08-20T01:29:08.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.075+0000 7fe6639e5640 1 --2- 172.21.15.79:0/1870391637 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe6440b3bc0 0x7fe6440b6080 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:08.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.075+0000 7fe6639e5640 1 --2- 172.21.15.79:0/1870391637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe65c103130 0x7fe65c199c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:08.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.075+0000 7fe6639e5640 1 --2- 172.21.15.79:0/1870391637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe65c102770 0x7fe65c199040 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:08.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.075+0000 7fe6639e5640 1 --2- 172.21.15.79:0/1870391637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe65c101610 0x7fe65c1989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:08.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.075+0000 7fe6639e5640 1 -- 172.21.15.79:0/1870391637 >> 172.21.15.79:0/1870391637 conn(0x7fe65c0fcee0 msgr2=0x7fe65c06a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:08.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.075+0000 7fe6639e5640 1 -- 172.21.15.79:0/1870391637 shutdown_connections 2024-08-20T01:29:08.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.075+0000 7fe6639e5640 1 -- 172.21.15.79:0/1870391637 wait complete. 2024-08-20T01:29:08.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:08 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2737629767' entity='client.admin' 2024-08-20T01:29:08.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:08 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/1870391637' entity='client.admin' 2024-08-20T01:29:08.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:08 smithi079 ceph-mon[18656]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:08.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:08 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2737629767' entity='client.admin' 2024-08-20T01:29:08.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:08 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/1870391637' entity='client.admin' 2024-08-20T01:29:08.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:08 smithi081 ceph-mon[22209]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:08.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:08 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2737629767' entity='client.admin' 2024-08-20T01:29:08.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:08 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/1870391637' entity='client.admin' 2024-08-20T01:29:08.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:08 smithi175 ceph-mon[22392]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:09.916 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:10.039 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:09 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/1570572813' entity='client.admin' 2024-08-20T01:29:10.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:09 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/1570572813' entity='client.admin' 2024-08-20T01:29:10.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:09 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/1570572813' entity='client.admin' 2024-08-20T01:29:10.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.595+0000 7fe9a9b76640 1 -- 172.21.15.79:0/915166801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9a41025f0 msgr2=0x7fe9a4102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:10.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.595+0000 7fe9a9b76640 1 --2- 172.21.15.79:0/915166801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9a41025f0 0x7fe9a4102a70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe98c009930 tx=0x7fe98c02a420 comp rx=0 tx=0).stop 2024-08-20T01:29:10.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.595+0000 7fe9a9b76640 1 -- 172.21.15.79:0/915166801 shutdown_connections 2024-08-20T01:29:10.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.595+0000 7fe9a9b76640 1 --2- 172.21.15.79:0/915166801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9a4103160 0x7fe9a4109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:10.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.595+0000 7fe9a9b76640 1 --2- 172.21.15.79:0/915166801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9a41025f0 0x7fe9a4102a70 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:10.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.595+0000 7fe9a9b76640 1 --2- 172.21.15.79:0/915166801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9a4101cb0 0x7fe9a41020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:10.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.595+0000 7fe9a9b76640 1 -- 172.21.15.79:0/915166801 >> 172.21.15.79:0/915166801 conn(0x7fe9a40fc690 msgr2=0x7fe9a40fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:10.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.595+0000 7fe9a9b76640 1 -- 172.21.15.79:0/915166801 shutdown_connections 2024-08-20T01:29:10.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.595+0000 7fe9a9b76640 1 -- 172.21.15.79:0/915166801 wait complete. 2024-08-20T01:29:10.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.595+0000 7fe9a9b76640 1 Processor -- start 2024-08-20T01:29:10.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.595+0000 7fe9a9b76640 1 -- start start 2024-08-20T01:29:10.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.596+0000 7fe9a9b76640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9a4101cb0 0x7fe9a41012a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:10.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.596+0000 7fe9a9b76640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9a41025f0 0x7fe9a419d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:10.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.596+0000 7fe9a9b76640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9a4103160 0x7fe9a419fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:10.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.596+0000 7fe9a9b76640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a410d060 con 0x7fe9a4101cb0 2024-08-20T01:29:10.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.596+0000 7fe9a9b76640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a410cee0 con 0x7fe9a41025f0 2024-08-20T01:29:10.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.596+0000 7fe9a9b76640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a410d1e0 con 0x7fe9a4103160 2024-08-20T01:29:10.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.596+0000 7fe9a37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9a4101cb0 0x7fe9a41012a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:10.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.596+0000 7fe9a37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9a4101cb0 0x7fe9a41012a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37862/0 (socket says 172.21.15.79:37862) 2024-08-20T01:29:10.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.596+0000 7fe9a37fe640 1 -- 172.21.15.79:0/1570572813 learned_addr learned my addr 172.21.15.79:0/1570572813 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:29:10.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.596+0000 7fe99bfff640 1 --2- 172.21.15.79:0/1570572813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9a41025f0 0x7fe9a419d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:10.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.596+0000 7fe9a37fe640 1 -- 172.21.15.79:0/1570572813 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9a4103160 msgr2=0x7fe9a419fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:10.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.596+0000 7fe9a37fe640 1 --2- 172.21.15.79:0/1570572813 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9a4103160 0x7fe9a419fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:10.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.596+0000 7fe9a37fe640 1 -- 172.21.15.79:0/1570572813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9a41025f0 msgr2=0x7fe9a419d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:10.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.596+0000 7fe9a37fe640 1 --2- 172.21.15.79:0/1570572813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9a41025f0 0x7fe9a419d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:10.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.596+0000 7fe9a37fe640 1 -- 172.21.15.79:0/1570572813 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a41a0560 con 0x7fe9a4101cb0 2024-08-20T01:29:10.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.596+0000 7fe99bfff640 1 --2- 172.21.15.79:0/1570572813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9a41025f0 0x7fe9a419d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:29:10.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.596+0000 7fe9a37fe640 1 --2- 172.21.15.79:0/1570572813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9a4101cb0 0x7fe9a41012a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe99400d950 tx=0x7fe99400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:10.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.596+0000 7fe9a17fa640 1 -- 172.21.15.79:0/1570572813 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe994017070 con 0x7fe9a4101cb0 2024-08-20T01:29:10.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.596+0000 7fe9a17fa640 1 -- 172.21.15.79:0/1570572813 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fe994009c30 con 0x7fe9a4101cb0 2024-08-20T01:29:10.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.596+0000 7fe9a9b76640 1 -- 172.21.15.79:0/1570572813 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9a41a0850 con 0x7fe9a4101cb0 2024-08-20T01:29:10.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.596+0000 7fe9a17fa640 1 -- 172.21.15.79:0/1570572813 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe99400f620 con 0x7fe9a4101cb0 2024-08-20T01:29:10.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.596+0000 7fe9a9b76640 1 -- 172.21.15.79:0/1570572813 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9a41a0de0 con 0x7fe9a4101cb0 2024-08-20T01:29:10.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.597+0000 7fe9a9b76640 1 -- 172.21.15.79:0/1570572813 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9a41020b0 con 0x7fe9a4101cb0 2024-08-20T01:29:10.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.599+0000 7fe9a17fa640 1 -- 172.21.15.79:0/1570572813 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7fe994010460 con 0x7fe9a4101cb0 2024-08-20T01:29:10.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.599+0000 7fe9a17fa640 1 --2- 172.21.15.79:0/1570572813 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe9900b3bc0 0x7fe9900b6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:10.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.599+0000 7fe99bfff640 1 --2- 172.21.15.79:0/1570572813 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe9900b3bc0 0x7fe9900b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:10.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.599+0000 7fe9a17fa640 1 -- 172.21.15.79:0/1570572813 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe9940e1b20 con 0x7fe9a4101cb0 2024-08-20T01:29:10.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.600+0000 7fe99bfff640 1 --2- 172.21.15.79:0/1570572813 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe9900b3bc0 0x7fe9900b6080 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe98c009900 tx=0x7fe98c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:10.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.602+0000 7fe9a17fa640 1 -- 172.21.15.79:0/1570572813 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fe9940aaec0 con 0x7fe9a4101cb0 2024-08-20T01:29:10.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.779+0000 7fe9a9b76640 1 -- 172.21.15.79:0/1570572813 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fe9a4108d00 con 0x7fe9a4101cb0 2024-08-20T01:29:10.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.785+0000 7fe9a17fa640 1 -- 172.21.15.79:0/1570572813 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v30)=0 v30) ==== 123+0+0 (secure 0 0 0) 0x7fe994009de0 con 0x7fe9a4101cb0 2024-08-20T01:29:10.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.785+0000 7fe9a17fa640 1 -- 172.21.15.79:0/1570572813 <== mon.0 v2:172.21.15.79:3300/0 8 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe9940aa2d0 con 0x7fe9a4101cb0 2024-08-20T01:29:10.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.787+0000 7fe9a9b76640 1 -- 172.21.15.79:0/1570572813 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe9900b3bc0 msgr2=0x7fe9900b6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:10.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.787+0000 7fe9a9b76640 1 --2- 172.21.15.79:0/1570572813 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe9900b3bc0 0x7fe9900b6080 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe98c009900 tx=0x7fe98c000bc0 comp rx=0 tx=0).stop 2024-08-20T01:29:10.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.787+0000 7fe9a9b76640 1 -- 172.21.15.79:0/1570572813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9a4101cb0 msgr2=0x7fe9a41012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:10.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.787+0000 7fe9a9b76640 1 --2- 172.21.15.79:0/1570572813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9a4101cb0 0x7fe9a41012a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe99400d950 tx=0x7fe99400de10 comp rx=0 tx=0).stop 2024-08-20T01:29:10.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.787+0000 7fe9a9b76640 1 -- 172.21.15.79:0/1570572813 shutdown_connections 2024-08-20T01:29:10.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.787+0000 7fe9a9b76640 1 --2- 172.21.15.79:0/1570572813 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe9900b3bc0 0x7fe9900b6080 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:10.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.787+0000 7fe9a9b76640 1 --2- 172.21.15.79:0/1570572813 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9a4103160 0x7fe9a419fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:10.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.787+0000 7fe9a9b76640 1 --2- 172.21.15.79:0/1570572813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9a41025f0 0x7fe9a419d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:10.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.787+0000 7fe9a9b76640 1 --2- 172.21.15.79:0/1570572813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9a4101cb0 0x7fe9a41012a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:10.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.787+0000 7fe9a9b76640 1 -- 172.21.15.79:0/1570572813 >> 172.21.15.79:0/1570572813 conn(0x7fe9a40fc690 msgr2=0x7fe9a4105ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:10.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.787+0000 7fe9a9b76640 1 -- 172.21.15.79:0/1570572813 shutdown_connections 2024-08-20T01:29:10.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:08.787+0000 7fe9a9b76640 1 -- 172.21.15.79:0/1570572813 wait complete. 2024-08-20T01:29:11.087 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:10 smithi079 ceph-mon[18656]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:11.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:10 smithi175 ceph-mon[22392]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:11.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:10 smithi081 ceph-mon[22209]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:11.513 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '28484e9a-5e93-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi079') 2024-08-20T01:29:11.513 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '28484e9a-5e93-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi079') 2024-08-20T01:29:11.513 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '28484e9a-5e93-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi079') 2024-08-20T01:29:11.513 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '28484e9a-5e93-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi079') 2024-08-20T01:29:11.513 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '28484e9a-5e93-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi079') 2024-08-20T01:29:11.514 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '28484e9a-5e93-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi079') 2024-08-20T01:29:11.514 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '28484e9a-5e93-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi079') 2024-08-20T01:29:11.514 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '28484e9a-5e93-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi079') 2024-08-20T01:29:11.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:11.949+0000 7f13b30c0640 1 -- 172.21.15.79:0/2127239377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13ac103170 msgr2=0x7f13ac109af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:11.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:11.949+0000 7f13b30c0640 1 --2- 172.21.15.79:0/2127239377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13ac103170 0x7f13ac109af0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f13a4009cd0 tx=0x7f13a402a8e0 comp rx=0 tx=0).stop 2024-08-20T01:29:11.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:11.949+0000 7f13b30c0640 1 -- 172.21.15.79:0/2127239377 shutdown_connections 2024-08-20T01:29:11.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:11.949+0000 7f13b30c0640 1 --2- 172.21.15.79:0/2127239377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13ac103170 0x7f13ac109af0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:11.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:11.949+0000 7f13b30c0640 1 --2- 172.21.15.79:0/2127239377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13ac1027b0 0x7f13ac102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:11.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:11.949+0000 7f13b30c0640 1 --2- 172.21.15.79:0/2127239377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13ac101650 0x7f13ac101a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:11.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:11.949+0000 7f13b30c0640 1 -- 172.21.15.79:0/2127239377 >> 172.21.15.79:0/2127239377 conn(0x7f13ac0fcf00 msgr2=0x7f13ac0ff360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:11.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:11.949+0000 7f13b30c0640 1 -- 172.21.15.79:0/2127239377 shutdown_connections 2024-08-20T01:29:11.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:11.949+0000 7f13b30c0640 1 -- 172.21.15.79:0/2127239377 wait complete. 2024-08-20T01:29:11.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:11.950+0000 7f13b30c0640 1 Processor -- start 2024-08-20T01:29:11.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:11.950+0000 7f13b30c0640 1 -- start start 2024-08-20T01:29:11.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:11.950+0000 7f13b30c0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13ac101650 0x7f13ac198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:11.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:11.950+0000 7f13b30c0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13ac1027b0 0x7f13ac1990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:11.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:11.950+0000 7f13b30c0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13ac103170 0x7f13ac199cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:11.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:11.950+0000 7f13b30c0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f13ac10e2b0 con 0x7f13ac101650 2024-08-20T01:29:11.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:11.950+0000 7f13b30c0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f13ac10e130 con 0x7f13ac1027b0 2024-08-20T01:29:11.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:11.950+0000 7f13b30c0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f13ac10e430 con 0x7f13ac103170 2024-08-20T01:29:11.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:11.950+0000 7f13b0e5c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13ac101650 0x7f13ac198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:11.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:11.950+0000 7f13b0e5c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13ac101650 0x7f13ac198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55990/0 (socket says 172.21.15.79:55990) 2024-08-20T01:29:11.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:11.950+0000 7f13b0e5c640 1 -- 172.21.15.79:0/2862243761 learned_addr learned my addr 172.21.15.79:0/2862243761 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:29:11.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:11.950+0000 7f13abfff640 1 --2- 172.21.15.79:0/2862243761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13ac1027b0 0x7f13ac1990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:11.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:11.950+0000 7f13b165d640 1 --2- 172.21.15.79:0/2862243761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13ac103170 0x7f13ac199cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:11.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:11.950+0000 7f13b0e5c640 1 -- 172.21.15.79:0/2862243761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13ac103170 msgr2=0x7f13ac199cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:11.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:11.950+0000 7f13b0e5c640 1 --2- 172.21.15.79:0/2862243761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13ac103170 0x7f13ac199cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:11.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:11.950+0000 7f13b0e5c640 1 -- 172.21.15.79:0/2862243761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13ac1027b0 msgr2=0x7f13ac1990b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:11.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:11.950+0000 7f13b0e5c640 1 --2- 172.21.15.79:0/2862243761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13ac1027b0 0x7f13ac1990b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:11.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:11.950+0000 7f13b0e5c640 1 -- 172.21.15.79:0/2862243761 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13ac19a590 con 0x7f13ac101650 2024-08-20T01:29:11.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:11.950+0000 7f13b165d640 1 --2- 172.21.15.79:0/2862243761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13ac103170 0x7f13ac199cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:29:11.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:11.950+0000 7f13b0e5c640 1 --2- 172.21.15.79:0/2862243761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13ac101650 0x7f13ac198a60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f13a000d950 tx=0x7f13a000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:11.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:11.951+0000 7f13a9ffb640 1 -- 172.21.15.79:0/2862243761 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a0017070 con 0x7f13ac101650 2024-08-20T01:29:11.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:11.951+0000 7f13a9ffb640 1 -- 172.21.15.79:0/2862243761 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f13a0009c30 con 0x7f13ac101650 2024-08-20T01:29:11.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:11.951+0000 7f13b30c0640 1 -- 172.21.15.79:0/2862243761 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13ac19a880 con 0x7f13ac101650 2024-08-20T01:29:11.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:11.951+0000 7f13a9ffb640 1 -- 172.21.15.79:0/2862243761 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a000f620 con 0x7f13ac101650 2024-08-20T01:29:11.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:11.951+0000 7f13b30c0640 1 -- 172.21.15.79:0/2862243761 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13ac1a0f60 con 0x7f13ac101650 2024-08-20T01:29:11.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:11.952+0000 7f13b30c0640 1 -- 172.21.15.79:0/2862243761 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13ac1089f0 con 0x7f13ac101650 2024-08-20T01:29:11.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:11.953+0000 7f13a9ffb640 1 -- 172.21.15.79:0/2862243761 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7f13a0010460 con 0x7f13ac101650 2024-08-20T01:29:11.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:11.954+0000 7f13a9ffb640 1 --2- 172.21.15.79:0/2862243761 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f139c0b3bc0 0x7f139c0b6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:11.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:11.954+0000 7f13abfff640 1 --2- 172.21.15.79:0/2862243761 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f139c0b3bc0 0x7f139c0b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:11.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:11.954+0000 7f13a9ffb640 1 -- 172.21.15.79:0/2862243761 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f13a00e1aa0 con 0x7f13ac101650 2024-08-20T01:29:11.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:11.954+0000 7f13abfff640 1 --2- 172.21.15.79:0/2862243761 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f139c0b3bc0 0x7f139c0b6080 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f13980058c0 tx=0x7f139800a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:11.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:11.957+0000 7f13a9ffb640 1 -- 172.21.15.79:0/2862243761 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f13a00aae40 con 0x7f13ac101650 2024-08-20T01:29:12.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:12.132+0000 7f13b30c0640 1 -- 172.21.15.79:0/2862243761 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f13ac02e5d0 con 0x7f13ac101650 2024-08-20T01:29:12.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:12.135+0000 7f13a9ffb640 1 -- 172.21.15.79:0/2862243761 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v31)=0 v31) ==== 118+0+0 (secure 0 0 0) 0x7f13a0009de0 con 0x7f13ac101650 2024-08-20T01:29:12.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:12.137+0000 7f13b30c0640 1 -- 172.21.15.79:0/2862243761 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f139c0b3bc0 msgr2=0x7f139c0b6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:12.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:12.137+0000 7f13b30c0640 1 --2- 172.21.15.79:0/2862243761 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f139c0b3bc0 0x7f139c0b6080 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f13980058c0 tx=0x7f139800a250 comp rx=0 tx=0).stop 2024-08-20T01:29:12.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:12.137+0000 7f13b30c0640 1 -- 172.21.15.79:0/2862243761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13ac101650 msgr2=0x7f13ac198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:12.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:12.137+0000 7f13b30c0640 1 --2- 172.21.15.79:0/2862243761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13ac101650 0x7f13ac198a60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f13a000d950 tx=0x7f13a000de10 comp rx=0 tx=0).stop 2024-08-20T01:29:12.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:12.137+0000 7f13b30c0640 1 -- 172.21.15.79:0/2862243761 shutdown_connections 2024-08-20T01:29:12.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:12.138+0000 7f13b30c0640 1 --2- 172.21.15.79:0/2862243761 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f139c0b3bc0 0x7f139c0b6080 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:12.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:12.138+0000 7f13b30c0640 1 --2- 172.21.15.79:0/2862243761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13ac103170 0x7f13ac199cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:12.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:12.138+0000 7f13b30c0640 1 --2- 172.21.15.79:0/2862243761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13ac1027b0 0x7f13ac1990b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:12.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:12.138+0000 7f13b30c0640 1 --2- 172.21.15.79:0/2862243761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13ac101650 0x7f13ac198a60 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:12.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:12.138+0000 7f13b30c0640 1 -- 172.21.15.79:0/2862243761 >> 172.21.15.79:0/2862243761 conn(0x7f13ac0fcf00 msgr2=0x7f13ac105bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:12.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:12.138+0000 7f13b30c0640 1 -- 172.21.15.79:0/2862243761 shutdown_connections 2024-08-20T01:29:12.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:12.138+0000 7f13b30c0640 1 -- 172.21.15.79:0/2862243761 wait complete. 2024-08-20T01:29:12.747 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '28484e9a-5e93-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi079') 2024-08-20T01:29:12.747 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '28484e9a-5e93-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi079') 2024-08-20T01:29:12.748 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '28484e9a-5e93-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi079') 2024-08-20T01:29:12.748 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '28484e9a-5e93-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi079') 2024-08-20T01:29:12.748 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '28484e9a-5e93-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi079') 2024-08-20T01:29:12.748 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '28484e9a-5e93-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi079') 2024-08-20T01:29:12.748 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '28484e9a-5e93-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi079') 2024-08-20T01:29:12.748 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '28484e9a-5e93-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi079') 2024-08-20T01:29:12.748 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '28484e9a-5e93-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi079') 2024-08-20T01:29:12.749 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '28484e9a-5e93-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi079') 2024-08-20T01:29:12.749 INFO:tasks.cephadm:Deploying OSDs... 2024-08-20T01:29:12.749 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-08-20T01:29:12.749 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/scratch_devs of=/dev/stdout 2024-08-20T01:29:12.766 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-20T01:29:12.767 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_1 2024-08-20T01:29:12.823 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-20T01:29:12.823 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-20T01:29:12.823 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-08-20T01:29:12.823 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-20T01:29:12.823 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2024-08-20T01:29:12.823 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-08-20 01:28:03.904704579 +0000 2024-08-20T01:29:12.823 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-08-20 01:23:35.220741666 +0000 2024-08-20T01:29:12.823 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-08-20 01:23:35.220741666 +0000 2024-08-20T01:29:12.824 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2024-08-20 01:23:35.220741666 +0000 2024-08-20T01:29:12.824 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-20T01:29:12.888 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-08-20T01:29:12.889 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-08-20T01:29:12.889 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000231607 s, 2.2 MB/s 2024-08-20T01:29:12.890 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-20T01:29:12.947 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_2 2024-08-20T01:29:13.003 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-20T01:29:13.003 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-20T01:29:13.003 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-08-20T01:29:13.003 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-20T01:29:13.003 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2024-08-20T01:29:13.003 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-08-20 01:28:03.931703964 +0000 2024-08-20T01:29:13.004 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-08-20 01:23:35.555733969 +0000 2024-08-20T01:29:13.004 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-08-20 01:23:35.555733969 +0000 2024-08-20T01:29:13.004 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2024-08-20 01:23:35.555733969 +0000 2024-08-20T01:29:13.004 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-20T01:29:13.067 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-08-20T01:29:13.067 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-08-20T01:29:13.067 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000194606 s, 2.6 MB/s 2024-08-20T01:29:13.068 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-20T01:29:13.125 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_3 2024-08-20T01:29:13.181 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-20T01:29:13.181 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-20T01:29:13.181 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-08-20T01:29:13.181 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-20T01:29:13.181 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2024-08-20T01:29:13.181 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-08-20 01:28:03.958703350 +0000 2024-08-20T01:29:13.181 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-08-20 01:23:35.870726731 +0000 2024-08-20T01:29:13.181 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-08-20 01:23:35.870726731 +0000 2024-08-20T01:29:13.182 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2024-08-20 01:23:35.870726731 +0000 2024-08-20T01:29:13.182 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-20T01:29:13.243 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-08-20T01:29:13.244 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-08-20T01:29:13.244 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000196434 s, 2.6 MB/s 2024-08-20T01:29:13.245 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-20T01:29:13.302 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_4 2024-08-20T01:29:13.357 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-20T01:29:13.357 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-20T01:29:13.357 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-08-20T01:29:13.357 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-20T01:29:13.357 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2024-08-20T01:29:13.357 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-08-20 01:28:03.983702780 +0000 2024-08-20T01:29:13.357 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-08-20 01:23:36.201719126 +0000 2024-08-20T01:29:13.357 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-08-20 01:23:36.201719126 +0000 2024-08-20T01:29:13.357 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2024-08-20 01:23:36.201719126 +0000 2024-08-20T01:29:13.358 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-20T01:29:13.417 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:13 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2862243761' entity='client.admin' 2024-08-20T01:29:13.418 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:13 smithi079 ceph-mon[18656]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:13.420 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-08-20T01:29:13.420 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-08-20T01:29:13.420 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000197812 s, 2.6 MB/s 2024-08-20T01:29:13.421 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-20T01:29:13.478 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-08-20T01:29:13.478 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/scratch_devs of=/dev/stdout 2024-08-20T01:29:13.498 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-20T01:29:13.498 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_1 2024-08-20T01:29:13.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:13 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2862243761' entity='client.admin' 2024-08-20T01:29:13.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:13 smithi081 ceph-mon[22209]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:13.545 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-20T01:29:13.546 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-20T01:29:13.546 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-08-20T01:29:13.546 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-20T01:29:13.546 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-08-20T01:29:13.546 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-08-20 01:28:51.900496563 +0000 2024-08-20T01:29:13.546 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-08-20 01:23:35.309149324 +0000 2024-08-20T01:29:13.546 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-08-20 01:23:35.309149324 +0000 2024-08-20T01:29:13.547 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-08-20 01:23:35.309149324 +0000 2024-08-20T01:29:13.547 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-20T01:29:13.616 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-08-20T01:29:13.616 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-08-20T01:29:13.616 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000225798 s, 2.3 MB/s 2024-08-20T01:29:13.617 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-20T01:29:13.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:13 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2862243761' entity='client.admin' 2024-08-20T01:29:13.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:13 smithi175 ceph-mon[22392]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:13.676 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_2 2024-08-20T01:29:13.735 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-20T01:29:13.735 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-20T01:29:13.735 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-08-20T01:29:13.735 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-20T01:29:13.735 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-08-20T01:29:13.735 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-08-20 01:28:51.900496563 +0000 2024-08-20T01:29:13.736 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-08-20 01:23:35.631141858 +0000 2024-08-20T01:29:13.736 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-08-20 01:23:35.631141858 +0000 2024-08-20T01:29:13.736 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-08-20 01:23:35.631141858 +0000 2024-08-20T01:29:13.736 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-20T01:29:13.802 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-08-20T01:29:13.803 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-08-20T01:29:13.803 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000183896 s, 2.8 MB/s 2024-08-20T01:29:13.804 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-20T01:29:13.862 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_3 2024-08-20T01:29:13.919 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-20T01:29:13.919 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-20T01:29:13.919 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-08-20T01:29:13.919 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-20T01:29:13.920 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-08-20T01:29:13.920 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-08-20 01:28:51.900496563 +0000 2024-08-20T01:29:13.920 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-08-20 01:23:35.955134345 +0000 2024-08-20T01:29:13.920 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-08-20 01:23:35.955134345 +0000 2024-08-20T01:29:13.920 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-08-20 01:23:35.955134345 +0000 2024-08-20T01:29:13.920 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-20T01:29:13.985 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-08-20T01:29:13.985 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-08-20T01:29:13.985 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000222477 s, 2.3 MB/s 2024-08-20T01:29:13.986 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-20T01:29:14.044 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_4 2024-08-20T01:29:14.101 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-20T01:29:14.101 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-20T01:29:14.101 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-08-20T01:29:14.101 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-20T01:29:14.101 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-08-20T01:29:14.101 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-08-20 01:28:51.901496544 +0000 2024-08-20T01:29:14.101 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-08-20 01:23:36.283126740 +0000 2024-08-20T01:29:14.102 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-08-20 01:23:36.283126740 +0000 2024-08-20T01:29:14.102 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-08-20 01:23:36.283126740 +0000 2024-08-20T01:29:14.102 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-20T01:29:14.166 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-08-20T01:29:14.166 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-08-20T01:29:14.166 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000195899 s, 2.6 MB/s 2024-08-20T01:29:14.167 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-20T01:29:14.224 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-08-20T01:29:14.225 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/scratch_devs of=/dev/stdout 2024-08-20T01:29:14.244 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-20T01:29:14.245 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_1 2024-08-20T01:29:14.303 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-20T01:29:14.303 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-20T01:29:14.303 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-08-20T01:29:14.303 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-20T01:29:14.304 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-08-20T01:29:14.304 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-08-20 01:28:49.479463653 +0000 2024-08-20T01:29:14.304 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-08-20 01:23:35.789027717 +0000 2024-08-20T01:29:14.304 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-08-20 01:23:35.789027717 +0000 2024-08-20T01:29:14.304 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-08-20 01:23:35.789027717 +0000 2024-08-20T01:29:14.304 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-20T01:29:14.374 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-08-20T01:29:14.375 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-08-20T01:29:14.375 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000288314 s, 1.8 MB/s 2024-08-20T01:29:14.376 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-20T01:29:14.435 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_2 2024-08-20T01:29:14.494 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-20T01:29:14.494 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-20T01:29:14.494 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-08-20T01:29:14.494 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-20T01:29:14.494 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-08-20T01:29:14.494 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-08-20 01:28:49.479463653 +0000 2024-08-20T01:29:14.494 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-08-20 01:23:36.106021853 +0000 2024-08-20T01:29:14.495 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-08-20 01:23:36.106021853 +0000 2024-08-20T01:29:14.495 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-08-20 01:23:36.106021853 +0000 2024-08-20T01:29:14.495 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-20T01:29:14.561 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-08-20T01:29:14.561 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-08-20T01:29:14.561 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000180059 s, 2.8 MB/s 2024-08-20T01:29:14.563 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-20T01:29:14.621 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_3 2024-08-20T01:29:14.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:14 smithi175 ceph-mon[22392]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:14.654 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-20T01:29:14.654 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-20T01:29:14.654 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-08-20T01:29:14.654 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-20T01:29:14.654 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-08-20T01:29:14.655 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-08-20 01:28:49.480463637 +0000 2024-08-20T01:29:14.655 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-08-20 01:23:36.426015933 +0000 2024-08-20T01:29:14.655 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-08-20 01:23:36.426015933 +0000 2024-08-20T01:29:14.655 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-08-20 01:23:36.426015933 +0000 2024-08-20T01:29:14.655 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-20T01:29:14.722 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-08-20T01:29:14.722 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-08-20T01:29:14.722 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000234825 s, 2.2 MB/s 2024-08-20T01:29:14.723 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-20T01:29:14.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:14 smithi081 ceph-mon[22209]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:14.782 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_4 2024-08-20T01:29:14.839 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-20T01:29:14.839 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-20T01:29:14.839 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-08-20T01:29:14.839 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-20T01:29:14.839 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-08-20T01:29:14.840 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-08-20 01:28:49.480463637 +0000 2024-08-20T01:29:14.840 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-08-20 01:23:36.751009921 +0000 2024-08-20T01:29:14.840 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-08-20 01:23:36.751009921 +0000 2024-08-20T01:29:14.840 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-08-20 01:23:36.751009921 +0000 2024-08-20T01:29:14.840 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-20T01:29:14.868 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:14 smithi079 ceph-mon[18656]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:14.905 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-08-20T01:29:14.906 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-08-20T01:29:14.906 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.00017987 s, 2.8 MB/s 2024-08-20T01:29:14.907 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-20T01:29:14.965 INFO:tasks.cephadm:Deploying osd.0 on smithi079 with /dev/vg_nvme/lv_4... 2024-08-20T01:29:14.965 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-20T01:29:15.206 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:16.551 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:16 smithi079 ceph-mon[18656]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:16.735 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:16 smithi081 ceph-mon[22209]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:16.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:16 smithi175 ceph-mon[22392]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:17.669 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:29:17.696 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi079:vg_nvme/lv_4 2024-08-20T01:29:17.945 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:29:18.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:18.436+0000 7fdc2d733640 1 -- 172.21.15.79:0/1709242661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc28101640 msgr2=0x7fdc28101a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:18.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:18.436+0000 7fdc2d733640 1 --2- 172.21.15.79:0/1709242661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc28101640 0x7fdc28101a40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdc18009cd0 tx=0x7fdc1802a8e0 comp rx=0 tx=0).stop 2024-08-20T01:29:18.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:18.436+0000 7fdc2d733640 1 -- 172.21.15.79:0/1709242661 shutdown_connections 2024-08-20T01:29:18.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:18.436+0000 7fdc2d733640 1 --2- 172.21.15.79:0/1709242661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc28103160 0x7fdc28109ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:18.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:18.436+0000 7fdc2d733640 1 --2- 172.21.15.79:0/1709242661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc281027a0 0x7fdc28102c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:18.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:18.436+0000 7fdc2d733640 1 --2- 172.21.15.79:0/1709242661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc28101640 0x7fdc28101a40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:18.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:18.436+0000 7fdc2d733640 1 -- 172.21.15.79:0/1709242661 >> 172.21.15.79:0/1709242661 conn(0x7fdc280fcf30 msgr2=0x7fdc280ff350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:18.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:18.436+0000 7fdc2d733640 1 -- 172.21.15.79:0/1709242661 shutdown_connections 2024-08-20T01:29:18.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:18.437+0000 7fdc2d733640 1 -- 172.21.15.79:0/1709242661 wait complete. 2024-08-20T01:29:18.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:18.437+0000 7fdc2d733640 1 Processor -- start 2024-08-20T01:29:18.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:18.437+0000 7fdc2d733640 1 -- start start 2024-08-20T01:29:18.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:18.437+0000 7fdc2d733640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc28101640 0x7fdc2806bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:18.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:18.437+0000 7fdc2d733640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc281027a0 0x7fdc2819d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:18.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:18.437+0000 7fdc2d733640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc28103160 0x7fdc2819fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:18.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:18.437+0000 7fdc2d733640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2810d250 con 0x7fdc28101640 2024-08-20T01:29:18.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:18.437+0000 7fdc2d733640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2810d0d0 con 0x7fdc28103160 2024-08-20T01:29:18.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:18.437+0000 7fdc2d733640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2810d3d0 con 0x7fdc281027a0 2024-08-20T01:29:18.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:18.438+0000 7fdc26ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc28101640 0x7fdc2806bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:18.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:18.438+0000 7fdc26ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc28101640 0x7fdc2806bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56018/0 (socket says 172.21.15.79:56018) 2024-08-20T01:29:18.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:18.438+0000 7fdc26ffd640 1 -- 172.21.15.79:0/2186885113 learned_addr learned my addr 172.21.15.79:0/2186885113 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:29:18.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:18.438+0000 7fdc277fe640 1 --2- 172.21.15.79:0/2186885113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc28103160 0x7fdc2819fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:18.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:18.438+0000 7fdc267fc640 1 --2- 172.21.15.79:0/2186885113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc281027a0 0x7fdc2819d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:18.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:18.438+0000 7fdc26ffd640 1 -- 172.21.15.79:0/2186885113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc281027a0 msgr2=0x7fdc2819d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:18.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:18.438+0000 7fdc26ffd640 1 --2- 172.21.15.79:0/2186885113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc281027a0 0x7fdc2819d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:18.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:18.438+0000 7fdc26ffd640 1 -- 172.21.15.79:0/2186885113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc28103160 msgr2=0x7fdc2819fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:18.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:18.438+0000 7fdc26ffd640 1 --2- 172.21.15.79:0/2186885113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc28103160 0x7fdc2819fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:18.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:18.438+0000 7fdc26ffd640 1 -- 172.21.15.79:0/2186885113 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc281a0750 con 0x7fdc28101640 2024-08-20T01:29:18.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:18.438+0000 7fdc267fc640 1 --2- 172.21.15.79:0/2186885113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc281027a0 0x7fdc2819d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:29:18.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:18.438+0000 7fdc26ffd640 1 --2- 172.21.15.79:0/2186885113 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc28101640 0x7fdc2806bad0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdc1802ae00 tx=0x7fdc18003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:18.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:18.438+0000 7fdc0ffff640 1 -- 172.21.15.79:0/2186885113 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc18004450 con 0x7fdc28101640 2024-08-20T01:29:18.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:18.438+0000 7fdc2d733640 1 -- 172.21.15.79:0/2186885113 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc281a09e0 con 0x7fdc28101640 2024-08-20T01:29:18.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:18.438+0000 7fdc0ffff640 1 -- 172.21.15.79:0/2186885113 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdc180045f0 con 0x7fdc28101640 2024-08-20T01:29:18.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:18.438+0000 7fdc0ffff640 1 -- 172.21.15.79:0/2186885113 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc18046700 con 0x7fdc28101640 2024-08-20T01:29:18.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:18.438+0000 7fdc2d733640 1 -- 172.21.15.79:0/2186885113 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc281a0fa0 con 0x7fdc28101640 2024-08-20T01:29:18.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:18.439+0000 7fdc2d733640 1 -- 172.21.15.79:0/2186885113 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc28108a90 con 0x7fdc28101640 2024-08-20T01:29:18.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:18.440+0000 7fdc0ffff640 1 -- 172.21.15.79:0/2186885113 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7fdc180305a0 con 0x7fdc28101640 2024-08-20T01:29:18.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:18.441+0000 7fdc0ffff640 1 --2- 172.21.15.79:0/2186885113 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fdc100b3b40 0x7fdc100b6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:18.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:18.441+0000 7fdc267fc640 1 --2- 172.21.15.79:0/2186885113 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fdc100b3b40 0x7fdc100b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:18.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:18.441+0000 7fdc0ffff640 1 -- 172.21.15.79:0/2186885113 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fdc1802e030 con 0x7fdc28101640 2024-08-20T01:29:18.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:18.441+0000 7fdc267fc640 1 --2- 172.21.15.79:0/2186885113 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fdc100b3b40 0x7fdc100b6000 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c006fd0 tx=0x7fdc1c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:18.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:18.445+0000 7fdc0ffff640 1 -- 172.21.15.79:0/2186885113 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fdc1804b060 con 0x7fdc28101640 2024-08-20T01:29:18.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:18.629+0000 7fdc2d733640 1 -- 172.21.15.79:0/2186885113 --> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fdc280632c0 con 0x7fdc100b3b40 2024-08-20T01:29:18.629 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:18 smithi079 ceph-mon[18656]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:18.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:18 smithi081 ceph-mon[22209]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:18.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:18 smithi175 ceph-mon[22392]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:19.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:19 smithi079 ceph-mon[18656]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:29:19.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:19 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:29:19.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:19 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:29:19.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:19 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:29:19.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:19 smithi081 ceph-mon[22209]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:29:19.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:19 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:29:19.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:19 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:29:19.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:19 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:29:19.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:19 smithi175 ceph-mon[22392]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:29:19.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:19 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:29:19.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:19 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:29:19.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:19 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:29:20.613 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:20 smithi079 ceph-mon[18656]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:20.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:20 smithi081 ceph-mon[22209]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:20.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:20 smithi175 ceph-mon[22392]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:21.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:21 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2499669595' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ccdbeb3d-bb9d-4275-ad7e-49f2cc1222cc"} : dispatch 2024-08-20T01:29:21.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:21 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2499669595' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ccdbeb3d-bb9d-4275-ad7e-49f2cc1222cc"}]': finished 2024-08-20T01:29:21.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:21 smithi081 ceph-mon[22209]: osdmap e5: 1 total, 0 up, 1 in 2024-08-20T01:29:21.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:21 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T01:29:21.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:21 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2499669595' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ccdbeb3d-bb9d-4275-ad7e-49f2cc1222cc"} : dispatch 2024-08-20T01:29:21.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:21 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2499669595' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ccdbeb3d-bb9d-4275-ad7e-49f2cc1222cc"}]': finished 2024-08-20T01:29:21.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:21 smithi175 ceph-mon[22392]: osdmap e5: 1 total, 0 up, 1 in 2024-08-20T01:29:21.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:21 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T01:29:21.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:21 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2499669595' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ccdbeb3d-bb9d-4275-ad7e-49f2cc1222cc"} : dispatch 2024-08-20T01:29:21.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:21 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2499669595' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ccdbeb3d-bb9d-4275-ad7e-49f2cc1222cc"}]': finished 2024-08-20T01:29:21.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:21 smithi079 ceph-mon[18656]: osdmap e5: 1 total, 0 up, 1 in 2024-08-20T01:29:21.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:21 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T01:29:22.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:22 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/1447819538' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:29:22.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:22 smithi081 ceph-mon[22209]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:22.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:22 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/1447819538' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:29:22.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:22 smithi175 ceph-mon[22392]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:22.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:22 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/1447819538' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:29:22.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:22 smithi079 ceph-mon[18656]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:24.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:24 smithi081 ceph-mon[22209]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:24.887 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:24 smithi175 ceph-mon[22392]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:24.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:24 smithi079 ceph-mon[18656]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:26.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:26 smithi079 ceph-mon[18656]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:26.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:26 smithi081 ceph-mon[22209]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:26.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:26 smithi175 ceph-mon[22392]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:28.668 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:28 smithi079 ceph-mon[18656]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:28.776 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:28 smithi081 ceph-mon[22209]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:28.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:28 smithi175 ceph-mon[22392]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:29.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:29 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-08-20T01:29:29.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:29 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:29:30.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:29 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-08-20T01:29:30.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:29 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:29:30.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:29 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-08-20T01:29:30.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:29 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:29:30.926 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:30 smithi079 ceph-mon[18656]: Deploying daemon osd.0 on smithi079 2024-08-20T01:29:30.926 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:30 smithi079 ceph-mon[18656]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:31.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:30 smithi081 ceph-mon[22209]: Deploying daemon osd.0 on smithi079 2024-08-20T01:29:31.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:30 smithi081 ceph-mon[22209]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:31.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:30 smithi175 ceph-mon[22392]: Deploying daemon osd.0 on smithi079 2024-08-20T01:29:31.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:30 smithi175 ceph-mon[22392]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:32.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:32 smithi079 ceph-mon[18656]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:32.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:32 smithi081 ceph-mon[22209]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:32.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:32 smithi175 ceph-mon[22392]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:34.752 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:34 smithi079 ceph-mon[18656]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:34.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:34 smithi081 ceph-mon[22209]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:34.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:34 smithi175 ceph-mon[22392]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:35.759 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:35 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:29:35.759 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:35 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:35.759 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:35 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:35.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:29:35.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:35.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:35.789 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:35 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:29:35.789 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:35 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:35.789 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:35 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:36.743 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:36 smithi079 ceph-mon[18656]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:36.776 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:36 smithi081 ceph-mon[22209]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:36.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:36 smithi175 ceph-mon[22392]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:38.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:38 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:38.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:38 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:38.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:38 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:29:38.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:38 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:29:38.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:38 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:38.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:38 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:38.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:38 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:38.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:38 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:29:38.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:38 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:29:38.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:38 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:38.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:38 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:38.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:38 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:38.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:38 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:29:38.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:38 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:29:38.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:38 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:39.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:39.002+0000 7fdc0ffff640 1 -- 172.21.15.79:0/2186885113 <== mgr.14150 v2:172.21.15.79:6800/3038112779 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fdc280632c0 con 0x7fdc100b3b40 2024-08-20T01:29:39.003 INFO:teuthology.orchestra.run.smithi079.stdout:Created osd(s) 0 on host 'smithi079' 2024-08-20T01:29:39.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:39.004+0000 7fdc2d733640 1 -- 172.21.15.79:0/2186885113 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fdc100b3b40 msgr2=0x7fdc100b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:39.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:39.004+0000 7fdc2d733640 1 --2- 172.21.15.79:0/2186885113 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fdc100b3b40 0x7fdc100b6000 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c006fd0 tx=0x7fdc1c008040 comp rx=0 tx=0).stop 2024-08-20T01:29:39.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:39.004+0000 7fdc2d733640 1 -- 172.21.15.79:0/2186885113 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc28101640 msgr2=0x7fdc2806bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:39.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:39.004+0000 7fdc2d733640 1 --2- 172.21.15.79:0/2186885113 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc28101640 0x7fdc2806bad0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdc1802ae00 tx=0x7fdc18003ce0 comp rx=0 tx=0).stop 2024-08-20T01:29:39.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:39.004+0000 7fdc2d733640 1 -- 172.21.15.79:0/2186885113 shutdown_connections 2024-08-20T01:29:39.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:39.004+0000 7fdc2d733640 1 --2- 172.21.15.79:0/2186885113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc28103160 0x7fdc2819fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:39.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:39.004+0000 7fdc2d733640 1 --2- 172.21.15.79:0/2186885113 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fdc100b3b40 0x7fdc100b6000 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:39.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:39.004+0000 7fdc2d733640 1 --2- 172.21.15.79:0/2186885113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc281027a0 0x7fdc2819d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:39.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:39.004+0000 7fdc2d733640 1 --2- 172.21.15.79:0/2186885113 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc28101640 0x7fdc2806bad0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:39.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:39.004+0000 7fdc2d733640 1 -- 172.21.15.79:0/2186885113 >> 172.21.15.79:0/2186885113 conn(0x7fdc280fcf30 msgr2=0x7fdc28105c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:39.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:39.004+0000 7fdc2d733640 1 -- 172.21.15.79:0/2186885113 shutdown_connections 2024-08-20T01:29:39.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:29:39.004+0000 7fdc2d733640 1 -- 172.21.15.79:0/2186885113 wait complete. 2024-08-20T01:29:39.620 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:39 smithi079 ceph-mon[18656]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:39.620 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:39 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:29:39.620 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:39 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:39.620 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:39 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:39.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:39 smithi175 ceph-mon[22392]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:39.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:39 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:29:39.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:39 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:39.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:39 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:39.647 DEBUG:teuthology.orchestra.run.smithi079:osd.0> sudo journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@osd.0.service 2024-08-20T01:29:39.649 INFO:tasks.cephadm:Deploying osd.1 on smithi081 with /dev/vg_nvme/lv_4... 2024-08-20T01:29:39.649 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-20T01:29:39.676 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:39 smithi081 ceph-mon[22209]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:39.676 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:39 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:29:39.676 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:39 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:39.676 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:39 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:39.898 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.b/config 2024-08-20T01:29:40.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:40 smithi081 ceph-mon[22209]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:40.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:40 smithi175 ceph-mon[22392]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:40.901 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:40 smithi079 ceph-mon[18656]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:41.185 INFO:journalctl@ceph.osd.0.smithi079.stdout:Aug 20 01:29:41 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-0[32290]: 2024-08-20T01:29:41.047+0000 7f1777291640 -1 osd.0 0 log_to_monitors true 2024-08-20T01:29:41.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:41 smithi081 ceph-mon[22209]: from='osd.0 [v2:172.21.15.79:6802/1274927648,v1:172.21.15.79:6803/1274927648]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-08-20T01:29:41.862 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:41 smithi079 ceph-mon[18656]: from='osd.0 [v2:172.21.15.79:6802/1274927648,v1:172.21.15.79:6803/1274927648]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-08-20T01:29:41.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:41 smithi175 ceph-mon[22392]: from='osd.0 [v2:172.21.15.79:6802/1274927648,v1:172.21.15.79:6803/1274927648]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-08-20T01:29:42.075 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-08-20T01:29:42.103 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi081:vg_nvme/lv_4 2024-08-20T01:29:42.394 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.b/config 2024-08-20T01:29:42.524 INFO:journalctl@ceph.osd.0.smithi079.stdout:Aug 20 01:29:42 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-0[32290]: 2024-08-20T01:29:42.481+0000 7f1773214640 -1 osd.0 0 waiting for initial osdmap 2024-08-20T01:29:42.525 INFO:journalctl@ceph.osd.0.smithi079.stdout:Aug 20 01:29:42 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-0[32290]: 2024-08-20T01:29:42.484+0000 7f176f03b640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-20T01:29:42.525 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:42 smithi079 ceph-mon[18656]: from='osd.0 [v2:172.21.15.79:6802/1274927648,v1:172.21.15.79:6803/1274927648]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-20T01:29:42.525 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:42 smithi079 ceph-mon[18656]: osdmap e6: 1 total, 0 up, 1 in 2024-08-20T01:29:42.525 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:42 smithi079 ceph-mon[18656]: from='osd.0 [v2:172.21.15.79:6802/1274927648,v1:172.21.15.79:6803/1274927648]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-08-20T01:29:42.525 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:42 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T01:29:42.525 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:42 smithi079 ceph-mon[18656]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:42.637 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:42 smithi081 ceph-mon[22209]: from='osd.0 [v2:172.21.15.79:6802/1274927648,v1:172.21.15.79:6803/1274927648]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-20T01:29:42.637 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:42 smithi081 ceph-mon[22209]: osdmap e6: 1 total, 0 up, 1 in 2024-08-20T01:29:42.637 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:42 smithi081 ceph-mon[22209]: from='osd.0 [v2:172.21.15.79:6802/1274927648,v1:172.21.15.79:6803/1274927648]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-08-20T01:29:42.637 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:42 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T01:29:42.637 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:42 smithi081 ceph-mon[22209]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:42.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:29:42.843+0000 7f3583b4a640 1 -- 172.21.15.81:0/3725653007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f357c101610 msgr2=0x7f357c101a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:42.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:29:42.843+0000 7f3583b4a640 1 --2- 172.21.15.81:0/3725653007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f357c101610 0x7f357c101a10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3574009930 tx=0x7f357402a420 comp rx=0 tx=0).stop 2024-08-20T01:29:42.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:29:42.843+0000 7f3583b4a640 1 -- 172.21.15.81:0/3725653007 shutdown_connections 2024-08-20T01:29:42.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:29:42.843+0000 7f3583b4a640 1 --2- 172.21.15.81:0/3725653007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f357c103130 0x7f357c109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:42.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:29:42.843+0000 7f3583b4a640 1 --2- 172.21.15.81:0/3725653007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f357c102770 0x7f357c102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:42.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:29:42.843+0000 7f3583b4a640 1 --2- 172.21.15.81:0/3725653007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f357c101610 0x7f357c101a10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:42.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:29:42.843+0000 7f3583b4a640 1 -- 172.21.15.81:0/3725653007 >> 172.21.15.81:0/3725653007 conn(0x7f357c0fcee0 msgr2=0x7f357c0ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:29:42.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:29:42.843+0000 7f3583b4a640 1 -- 172.21.15.81:0/3725653007 shutdown_connections 2024-08-20T01:29:42.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:29:42.843+0000 7f3583b4a640 1 -- 172.21.15.81:0/3725653007 wait complete. 2024-08-20T01:29:42.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:29:42.844+0000 7f3583b4a640 1 Processor -- start 2024-08-20T01:29:42.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:29:42.844+0000 7f3583b4a640 1 -- start start 2024-08-20T01:29:42.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:29:42.844+0000 7f3583b4a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f357c101610 0x7f357c198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:42.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:29:42.844+0000 7f3583b4a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f357c102770 0x7f357c198fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:42.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:29:42.844+0000 7f3583b4a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f357c103130 0x7f357c199c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:42.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:29:42.844+0000 7f3583b4a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f357c10d120 con 0x7f357c102770 2024-08-20T01:29:42.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:29:42.844+0000 7f3583b4a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f357c10cfa0 con 0x7f357c103130 2024-08-20T01:29:42.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:29:42.844+0000 7f3583b4a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f357c10d2a0 con 0x7f357c101610 2024-08-20T01:29:42.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:29:42.844+0000 7f35820e7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f357c103130 0x7f357c199c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:42.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:29:42.844+0000 7f35820e7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f357c103130 0x7f357c199c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41242/0 (socket says 172.21.15.81:41242) 2024-08-20T01:29:42.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:29:42.844+0000 7f35820e7640 1 -- 172.21.15.81:0/1543413895 learned_addr learned my addr 172.21.15.81:0/1543413895 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-08-20T01:29:42.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:29:42.844+0000 7f35810e5640 1 --2- 172.21.15.81:0/1543413895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f357c102770 0x7f357c198fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:42.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:29:42.844+0000 7f35818e6640 1 --2- 172.21.15.81:0/1543413895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f357c101610 0x7f357c198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:42.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:29:42.845+0000 7f35820e7640 1 -- 172.21.15.81:0/1543413895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f357c101610 msgr2=0x7f357c198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:42.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:29:42.845+0000 7f35820e7640 1 --2- 172.21.15.81:0/1543413895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f357c101610 0x7f357c198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:42.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:29:42.845+0000 7f35820e7640 1 -- 172.21.15.81:0/1543413895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f357c102770 msgr2=0x7f357c198fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:29:42.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:29:42.845+0000 7f35820e7640 1 --2- 172.21.15.81:0/1543413895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f357c102770 0x7f357c198fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:29:42.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:29:42.845+0000 7f35820e7640 1 -- 172.21.15.81:0/1543413895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f357c19a4c0 con 0x7f357c103130 2024-08-20T01:29:42.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:29:42.845+0000 7f35820e7640 1 --2- 172.21.15.81:0/1543413895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f357c103130 0x7f357c199c20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f356c00eaa0 tx=0x7f356c00eea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:42.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:29:42.845+0000 7f357affd640 1 -- 172.21.15.81:0/1543413895 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f356c004d20 con 0x7f357c103130 2024-08-20T01:29:42.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:29:42.845+0000 7f3583b4a640 1 -- 172.21.15.81:0/1543413895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f357c19a7b0 con 0x7f357c103130 2024-08-20T01:29:42.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:29:42.845+0000 7f357affd640 1 -- 172.21.15.81:0/1543413895 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f356c005020 con 0x7f357c103130 2024-08-20T01:29:42.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:29:42.845+0000 7f357affd640 1 -- 172.21.15.81:0/1543413895 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f356c0116d0 con 0x7f357c103130 2024-08-20T01:29:42.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:29:42.845+0000 7f3583b4a640 1 -- 172.21.15.81:0/1543413895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f357c1a0e90 con 0x7f357c103130 2024-08-20T01:29:42.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:29:42.846+0000 7f3583b4a640 1 -- 172.21.15.81:0/1543413895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f357c1a1060 con 0x7f357c103130 2024-08-20T01:29:42.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:29:42.848+0000 7f357affd640 1 -- 172.21.15.81:0/1543413895 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7f356c0051d0 con 0x7f357c103130 2024-08-20T01:29:42.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:29:42.848+0000 7f357affd640 1 --2- 172.21.15.81:0/1543413895 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f35640b3bc0 0x7f35640b6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:29:42.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:29:42.848+0000 7f357affd640 1 -- 172.21.15.81:0/1543413895 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f356c0e2470 con 0x7f357c103130 2024-08-20T01:29:42.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:29:42.848+0000 7f35818e6640 1 --2- 172.21.15.81:0/1543413895 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f35640b3bc0 0x7f35640b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:29:42.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:29:42.849+0000 7f35818e6640 1 --2- 172.21.15.81:0/1543413895 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f35640b3bc0 0x7f35640b6080 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3574009900 tx=0x7f3574005720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:29:42.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:29:42.852+0000 7f357affd640 1 -- 172.21.15.81:0/1543413895 <== mon.2 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f356c016030 con 0x7f357c103130 2024-08-20T01:29:42.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:42 smithi175 ceph-mon[22392]: from='osd.0 [v2:172.21.15.79:6802/1274927648,v1:172.21.15.79:6803/1274927648]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-20T01:29:42.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:42 smithi175 ceph-mon[22392]: osdmap e6: 1 total, 0 up, 1 in 2024-08-20T01:29:42.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:42 smithi175 ceph-mon[22392]: from='osd.0 [v2:172.21.15.79:6802/1274927648,v1:172.21.15.79:6803/1274927648]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-08-20T01:29:42.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:42 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T01:29:42.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:42 smithi175 ceph-mon[22392]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:43.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:29:43.041+0000 7f3583b4a640 1 -- 172.21.15.81:0/1543413895 --> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f357c1a1230 con 0x7f35640b3bc0 2024-08-20T01:29:43.620 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:43 smithi081 ceph-mon[22209]: from='osd.0 [v2:172.21.15.79:6802/1274927648,v1:172.21.15.79:6803/1274927648]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-08-20T01:29:43.620 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:43 smithi081 ceph-mon[22209]: osdmap e7: 1 total, 0 up, 1 in 2024-08-20T01:29:43.620 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:43 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T01:29:43.621 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:43 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T01:29:43.621 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:43 smithi081 ceph-mon[22209]: Detected new or changed devices on smithi079 2024-08-20T01:29:43.621 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:43 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:43.621 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:43 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:43.621 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:43 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T01:29:43.621 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:43 smithi081 ceph-mon[22209]: Adjusting osd_memory_target on smithi079 to 17088M 2024-08-20T01:29:43.621 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:43 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:43.621 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:43 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:29:43.621 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:43 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:29:43.621 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:43 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:43.621 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:43 smithi081 ceph-mon[22209]: from='client.24233 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:29:43.621 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:43 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:29:43.622 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:43 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:29:43.622 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:43 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:29:43.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:43 smithi175 ceph-mon[22392]: from='osd.0 [v2:172.21.15.79:6802/1274927648,v1:172.21.15.79:6803/1274927648]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-08-20T01:29:43.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:43 smithi175 ceph-mon[22392]: osdmap e7: 1 total, 0 up, 1 in 2024-08-20T01:29:43.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:43 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T01:29:43.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:43 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T01:29:43.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:43 smithi175 ceph-mon[22392]: Detected new or changed devices on smithi079 2024-08-20T01:29:43.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:43 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:43.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:43 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:43.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:43 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T01:29:43.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:43 smithi175 ceph-mon[22392]: Adjusting osd_memory_target on smithi079 to 17088M 2024-08-20T01:29:43.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:43 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:43.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:43 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:29:43.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:43 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:29:43.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:43 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:43.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:43 smithi175 ceph-mon[22392]: from='client.24233 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:29:43.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:43 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:29:43.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:43 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:29:43.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:43 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:29:43.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:43 smithi079 ceph-mon[18656]: from='osd.0 [v2:172.21.15.79:6802/1274927648,v1:172.21.15.79:6803/1274927648]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-08-20T01:29:43.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:43 smithi079 ceph-mon[18656]: osdmap e7: 1 total, 0 up, 1 in 2024-08-20T01:29:43.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:43 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T01:29:43.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:43 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T01:29:43.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:43 smithi079 ceph-mon[18656]: Detected new or changed devices on smithi079 2024-08-20T01:29:43.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:43 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:43.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:43 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:43.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:43 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T01:29:43.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:43 smithi079 ceph-mon[18656]: Adjusting osd_memory_target on smithi079 to 17088M 2024-08-20T01:29:43.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:43 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:43.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:43 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:29:43.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:43 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:29:43.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:43 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:43.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:43 smithi079 ceph-mon[18656]: from='client.24233 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:29:43.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:43 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:29:43.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:43 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:29:43.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:43 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:29:44.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:44 smithi081 ceph-mon[22209]: purged_snaps scrub starts 2024-08-20T01:29:44.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:44 smithi081 ceph-mon[22209]: purged_snaps scrub ok 2024-08-20T01:29:44.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:44 smithi081 ceph-mon[22209]: osd.0 [v2:172.21.15.79:6802/1274927648,v1:172.21.15.79:6803/1274927648] boot 2024-08-20T01:29:44.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:44 smithi081 ceph-mon[22209]: osdmap e8: 1 total, 1 up, 1 in 2024-08-20T01:29:44.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:44 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T01:29:44.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:44 smithi081 ceph-mon[22209]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:44.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:44 smithi175 ceph-mon[22392]: purged_snaps scrub starts 2024-08-20T01:29:44.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:44 smithi175 ceph-mon[22392]: purged_snaps scrub ok 2024-08-20T01:29:44.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:44 smithi175 ceph-mon[22392]: osd.0 [v2:172.21.15.79:6802/1274927648,v1:172.21.15.79:6803/1274927648] boot 2024-08-20T01:29:44.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:44 smithi175 ceph-mon[22392]: osdmap e8: 1 total, 1 up, 1 in 2024-08-20T01:29:44.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:44 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T01:29:44.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:44 smithi175 ceph-mon[22392]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:44.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:44 smithi079 ceph-mon[18656]: purged_snaps scrub starts 2024-08-20T01:29:44.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:44 smithi079 ceph-mon[18656]: purged_snaps scrub ok 2024-08-20T01:29:44.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:44 smithi079 ceph-mon[18656]: osd.0 [v2:172.21.15.79:6802/1274927648,v1:172.21.15.79:6803/1274927648] boot 2024-08-20T01:29:44.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:44 smithi079 ceph-mon[18656]: osdmap e8: 1 total, 1 up, 1 in 2024-08-20T01:29:44.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:44 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T01:29:44.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:44 smithi079 ceph-mon[18656]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T01:29:45.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:45 smithi079 ceph-mon[18656]: osdmap e9: 1 total, 1 up, 1 in 2024-08-20T01:29:45.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:45 smithi079 ceph-mon[18656]: from='client.? 172.21.15.81:0/1895321792' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0906bc46-f89d-482d-9402-43d17e4246a4"} : dispatch 2024-08-20T01:29:45.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:45 smithi079 ceph-mon[18656]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0906bc46-f89d-482d-9402-43d17e4246a4"} : dispatch 2024-08-20T01:29:45.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:45 smithi079 ceph-mon[18656]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0906bc46-f89d-482d-9402-43d17e4246a4"}]': finished 2024-08-20T01:29:45.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:45 smithi079 ceph-mon[18656]: osdmap e10: 2 total, 1 up, 2 in 2024-08-20T01:29:45.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:45 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T01:29:45.745 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:45 smithi081 ceph-mon[22209]: osdmap e9: 1 total, 1 up, 1 in 2024-08-20T01:29:45.745 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:45 smithi081 ceph-mon[22209]: from='client.? 172.21.15.81:0/1895321792' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0906bc46-f89d-482d-9402-43d17e4246a4"} : dispatch 2024-08-20T01:29:45.745 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:45 smithi081 ceph-mon[22209]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0906bc46-f89d-482d-9402-43d17e4246a4"} : dispatch 2024-08-20T01:29:45.745 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:45 smithi081 ceph-mon[22209]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0906bc46-f89d-482d-9402-43d17e4246a4"}]': finished 2024-08-20T01:29:45.745 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:45 smithi081 ceph-mon[22209]: osdmap e10: 2 total, 1 up, 2 in 2024-08-20T01:29:45.746 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:45 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T01:29:45.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:45 smithi175 ceph-mon[22392]: osdmap e9: 1 total, 1 up, 1 in 2024-08-20T01:29:45.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:45 smithi175 ceph-mon[22392]: from='client.? 172.21.15.81:0/1895321792' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0906bc46-f89d-482d-9402-43d17e4246a4"} : dispatch 2024-08-20T01:29:45.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:45 smithi175 ceph-mon[22392]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0906bc46-f89d-482d-9402-43d17e4246a4"} : dispatch 2024-08-20T01:29:45.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:45 smithi175 ceph-mon[22392]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0906bc46-f89d-482d-9402-43d17e4246a4"}]': finished 2024-08-20T01:29:45.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:45 smithi175 ceph-mon[22392]: osdmap e10: 2 total, 1 up, 2 in 2024-08-20T01:29:45.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:45 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T01:29:46.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:46 smithi081 ceph-mon[22209]: from='client.? 172.21.15.81:0/3468432455' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:29:46.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:46 smithi081 ceph-mon[22209]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:29:46.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:46 smithi175 ceph-mon[22392]: from='client.? 172.21.15.81:0/3468432455' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:29:46.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:46 smithi175 ceph-mon[22392]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:29:46.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:46 smithi079 ceph-mon[18656]: from='client.? 172.21.15.81:0/3468432455' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:29:46.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:46 smithi079 ceph-mon[18656]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:29:48.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:48 smithi081 ceph-mon[22209]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:29:48.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:48 smithi175 ceph-mon[22392]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:29:48.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:48 smithi079 ceph-mon[18656]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:29:50.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:50 smithi081 ceph-mon[22209]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:29:50.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:50 smithi175 ceph-mon[22392]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:29:50.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:50 smithi079 ceph-mon[18656]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:29:52.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:52 smithi081 ceph-mon[22209]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:29:52.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:52 smithi175 ceph-mon[22392]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:29:52.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:52 smithi079 ceph-mon[18656]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:29:53.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:53 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-08-20T01:29:53.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:53 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:29:53.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:53 smithi081 ceph-mon[22209]: Deploying daemon osd.1 on smithi081 2024-08-20T01:29:53.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:53 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-08-20T01:29:53.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:53 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:29:53.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:53 smithi175 ceph-mon[22392]: Deploying daemon osd.1 on smithi081 2024-08-20T01:29:53.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:53 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-08-20T01:29:53.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:53 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:29:53.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:53 smithi079 ceph-mon[18656]: Deploying daemon osd.1 on smithi081 2024-08-20T01:29:55.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:55 smithi081 ceph-mon[22209]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:29:55.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:55 smithi175 ceph-mon[22392]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:29:55.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:55 smithi079 ceph-mon[18656]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:29:57.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:57 smithi081 ceph-mon[22209]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:29:57.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:57 smithi175 ceph-mon[22392]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:29:57.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:57 smithi079 ceph-mon[18656]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:29:58.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:58 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:29:58.803 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:58 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:58.803 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:29:58 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:58.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:58 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:29:58.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:58 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:58.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:29:58 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:58.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:58 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:29:58.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:58 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:29:58.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:29:58 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:00.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:00 smithi081 ceph-mon[22209]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:30:00.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:00 smithi081 ceph-mon[22209]: overall HEALTH_OK 2024-08-20T01:30:00.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:00 smithi175 ceph-mon[22392]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:30:00.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:00 smithi175 ceph-mon[22392]: overall HEALTH_OK 2024-08-20T01:30:00.435 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:00 smithi079 ceph-mon[18656]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:30:00.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:00 smithi079 ceph-mon[18656]: overall HEALTH_OK 2024-08-20T01:30:01.517 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:01 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:01.517 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:01 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:01.517 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:01 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:30:01.517 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:01 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:30:01.517 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:01 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:01.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:01 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:01.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:01 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:01.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:01 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:30:01.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:01 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:30:01.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:01 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:01.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:01 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:01.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:01 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:01.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:01 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:30:01.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:01 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:30:01.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:01 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:01.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:01.847+0000 7f357affd640 1 -- 172.21.15.81:0/1543413895 <== mgr.14150 v2:172.21.15.79:6800/3038112779 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f357c1a1230 con 0x7f35640b3bc0 2024-08-20T01:30:01.849 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 1 on host 'smithi081' 2024-08-20T01:30:01.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:01.849+0000 7f3583b4a640 1 -- 172.21.15.81:0/1543413895 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f35640b3bc0 msgr2=0x7f35640b6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:01.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:01.849+0000 7f3583b4a640 1 --2- 172.21.15.81:0/1543413895 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f35640b3bc0 0x7f35640b6080 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3574009900 tx=0x7f3574005720 comp rx=0 tx=0).stop 2024-08-20T01:30:01.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:01.849+0000 7f3583b4a640 1 -- 172.21.15.81:0/1543413895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f357c103130 msgr2=0x7f357c199c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:01.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:01.849+0000 7f3583b4a640 1 --2- 172.21.15.81:0/1543413895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f357c103130 0x7f357c199c20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f356c00eaa0 tx=0x7f356c00eea0 comp rx=0 tx=0).stop 2024-08-20T01:30:01.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:01.849+0000 7f3583b4a640 1 -- 172.21.15.81:0/1543413895 shutdown_connections 2024-08-20T01:30:01.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:01.849+0000 7f3583b4a640 1 --2- 172.21.15.81:0/1543413895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f357c103130 0x7f357c199c20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:01.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:01.849+0000 7f3583b4a640 1 --2- 172.21.15.81:0/1543413895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f357c102770 0x7f357c198fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:01.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:01.849+0000 7f3583b4a640 1 --2- 172.21.15.81:0/1543413895 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f35640b3bc0 0x7f35640b6080 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:01.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:01.849+0000 7f3583b4a640 1 --2- 172.21.15.81:0/1543413895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f357c101610 0x7f357c198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:01.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:01.849+0000 7f3583b4a640 1 -- 172.21.15.81:0/1543413895 >> 172.21.15.81:0/1543413895 conn(0x7f357c0fcee0 msgr2=0x7f357c0fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:01.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:01.849+0000 7f3583b4a640 1 -- 172.21.15.81:0/1543413895 shutdown_connections 2024-08-20T01:30:01.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:01.849+0000 7f3583b4a640 1 -- 172.21.15.81:0/1543413895 wait complete. 2024-08-20T01:30:02.463 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:02 smithi081 ceph-mon[22209]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:30:02.463 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:02 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:30:02.463 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:02 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:02.463 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:02 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:02.490 DEBUG:teuthology.orchestra.run.smithi081:osd.1> sudo journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@osd.1.service 2024-08-20T01:30:02.493 INFO:tasks.cephadm:Deploying osd.2 on smithi175 with /dev/vg_nvme/lv_4... 2024-08-20T01:30:02.493 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-20T01:30:02.535 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:02 smithi175 ceph-mon[22392]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:30:02.535 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:02 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:30:02.535 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:02 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:02.535 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:02 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:02.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:02 smithi079 ceph-mon[18656]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:30:02.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:02 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:30:02.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:02 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:02.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:02 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:02.745 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T01:30:04.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:04 smithi175 ceph-mon[22392]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:30:04.540 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:04 smithi081 ceph-mon[22209]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:30:04.540 INFO:journalctl@ceph.osd.1.smithi081.stdout:Aug 20 01:30:04 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-1[26622]: 2024-08-20T01:30:04.391+0000 7ffbddb9b640 -1 osd.1 0 log_to_monitors true 2024-08-20T01:30:04.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:04 smithi079 ceph-mon[18656]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:30:05.169 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-08-20T01:30:05.200 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi175:vg_nvme/lv_4 2024-08-20T01:30:05.469 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:05 smithi175 ceph-mon[22392]: from='osd.1 [v2:172.21.15.81:6800/1174012328,v1:172.21.15.81:6801/1174012328]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-20T01:30:05.469 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:05 smithi175 ceph-mon[22392]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-20T01:30:05.469 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:05 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:05.469 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:05 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:05.469 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:05 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T01:30:05.470 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:05 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:05.470 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:05 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:30:05.470 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:05 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:30:05.470 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:05 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:05.495 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T01:30:05.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:05 smithi081 ceph-mon[22209]: from='osd.1 [v2:172.21.15.81:6800/1174012328,v1:172.21.15.81:6801/1174012328]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-20T01:30:05.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:05 smithi081 ceph-mon[22209]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-20T01:30:05.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:05 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:05.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:05 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:05.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:05 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T01:30:05.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:05 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:05.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:05 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:30:05.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:05 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:30:05.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:05 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:05.673 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:05 smithi079 ceph-mon[18656]: from='osd.1 [v2:172.21.15.81:6800/1174012328,v1:172.21.15.81:6801/1174012328]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-20T01:30:05.673 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:05 smithi079 ceph-mon[18656]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-20T01:30:05.673 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:05 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:05.673 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:05 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:05.673 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:05 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T01:30:05.673 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:05 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:05.673 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:05 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:30:05.673 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:05 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:30:05.673 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:05 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:05.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:05.946+0000 7f903b63d640 1 -- 172.21.15.175:0/3911736087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9034101610 msgr2=0x7f9034101a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:05.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:05.946+0000 7f903b63d640 1 --2- 172.21.15.175:0/3911736087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9034101610 0x7f9034101a10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9030009960 tx=0x7f903002a460 comp rx=0 tx=0).stop 2024-08-20T01:30:05.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:05.946+0000 7f903b63d640 1 -- 172.21.15.175:0/3911736087 shutdown_connections 2024-08-20T01:30:05.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:05.946+0000 7f903b63d640 1 --2- 172.21.15.175:0/3911736087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9034103130 0x7f9034109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:05.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:05.946+0000 7f903b63d640 1 --2- 172.21.15.175:0/3911736087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9034102770 0x7f9034102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:05.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:05.946+0000 7f903b63d640 1 --2- 172.21.15.175:0/3911736087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9034101610 0x7f9034101a10 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:05.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:05.946+0000 7f903b63d640 1 -- 172.21.15.175:0/3911736087 >> 172.21.15.175:0/3911736087 conn(0x7f90340fcee0 msgr2=0x7f90340ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:05.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:05.946+0000 7f903b63d640 1 -- 172.21.15.175:0/3911736087 shutdown_connections 2024-08-20T01:30:05.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:05.946+0000 7f903b63d640 1 -- 172.21.15.175:0/3911736087 wait complete. 2024-08-20T01:30:05.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:05.947+0000 7f903b63d640 1 Processor -- start 2024-08-20T01:30:05.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:05.947+0000 7f903b63d640 1 -- start start 2024-08-20T01:30:05.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:05.947+0000 7f903b63d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9034101610 0x7f9034198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:05.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:05.947+0000 7f903b63d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9034102770 0x7f9034199090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:05.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:05.947+0000 7f903b63d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9034103130 0x7f9034199cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:05.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:05.947+0000 7f903b63d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f903410d120 con 0x7f9034103130 2024-08-20T01:30:05.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:05.947+0000 7f903b63d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f903410cfa0 con 0x7f9034102770 2024-08-20T01:30:05.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:05.947+0000 7f903b63d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f903410d2a0 con 0x7f9034101610 2024-08-20T01:30:05.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:05.947+0000 7f90393d9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9034101610 0x7f9034198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:05.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:05.947+0000 7f90393d9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9034101610 0x7f9034198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:58142/0 (socket says 172.21.15.175:58142) 2024-08-20T01:30:05.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:05.947+0000 7f90393d9640 1 -- 172.21.15.175:0/2727064515 learned_addr learned my addr 172.21.15.175:0/2727064515 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-08-20T01:30:05.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:05.947+0000 7f9038bd8640 1 --2- 172.21.15.175:0/2727064515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9034102770 0x7f9034199090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:05.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:05.947+0000 7f90393d9640 1 -- 172.21.15.175:0/2727064515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9034102770 msgr2=0x7f9034199090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:05.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:05.947+0000 7f90393d9640 1 --2- 172.21.15.175:0/2727064515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9034102770 0x7f9034199090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:05.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:05.947+0000 7f90393d9640 1 -- 172.21.15.175:0/2727064515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9034103130 msgr2=0x7f9034199cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:05.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:05.947+0000 7f90393d9640 1 --2- 172.21.15.175:0/2727064515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9034103130 0x7f9034199cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:05.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:05.947+0000 7f90393d9640 1 -- 172.21.15.175:0/2727064515 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f903419a570 con 0x7f9034101610 2024-08-20T01:30:05.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:05.947+0000 7f9038bd8640 1 --2- 172.21.15.175:0/2727064515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9034102770 0x7f9034199090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:30:05.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:05.948+0000 7f90393d9640 1 --2- 172.21.15.175:0/2727064515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9034101610 0x7f9034198a40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9030006010 tx=0x7f9030004380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:05.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:05.948+0000 7f902a7fc640 1 -- 172.21.15.175:0/2727064515 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903003f030 con 0x7f9034101610 2024-08-20T01:30:05.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:05.948+0000 7f902a7fc640 1 -- 172.21.15.175:0/2727064515 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9030003a80 con 0x7f9034101610 2024-08-20T01:30:05.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:05.948+0000 7f903b63d640 1 -- 172.21.15.175:0/2727064515 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f903419a800 con 0x7f9034101610 2024-08-20T01:30:05.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:05.948+0000 7f902a7fc640 1 -- 172.21.15.175:0/2727064515 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9030035070 con 0x7f9034101610 2024-08-20T01:30:05.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:05.948+0000 7f903b63d640 1 -- 172.21.15.175:0/2727064515 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90341a0f40 con 0x7f9034101610 2024-08-20T01:30:05.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:05.949+0000 7f903b63d640 1 -- 172.21.15.175:0/2727064515 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9034101a10 con 0x7f9034101610 2024-08-20T01:30:05.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:05.950+0000 7f902a7fc640 1 -- 172.21.15.175:0/2727064515 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7f9030042030 con 0x7f9034101610 2024-08-20T01:30:05.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:05.951+0000 7f902a7fc640 1 --2- 172.21.15.175:0/2727064515 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f90200b3bc0 0x7f90200b6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:05.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:05.951+0000 7f902a7fc640 1 -- 172.21.15.175:0/2727064515 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 1903+0+0 (secure 0 0 0) 0x7f9030102c70 con 0x7f9034101610 2024-08-20T01:30:05.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:05.951+0000 7f9038bd8640 1 --2- 172.21.15.175:0/2727064515 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f90200b3bc0 0x7f90200b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:05.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:05.951+0000 7f9038bd8640 1 --2- 172.21.15.175:0/2727064515 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f90200b3bc0 0x7f90200b6080 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f902400baa0 tx=0x7f9024005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:05.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:05.954+0000 7f902a7fc640 1 -- 172.21.15.175:0/2727064515 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f90300cbcb0 con 0x7f9034101610 2024-08-20T01:30:06.146 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:06.146+0000 7f903b63d640 1 -- 172.21.15.175:0/2727064515 --> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f90340ff0d0 con 0x7f90200b3bc0 2024-08-20T01:30:06.427 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:06 smithi175 ceph-mon[22392]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:30:06.427 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:06 smithi175 ceph-mon[22392]: Detected new or changed devices on smithi081 2024-08-20T01:30:06.427 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:06 smithi175 ceph-mon[22392]: Adjusting osd_memory_target on smithi081 to 17088M 2024-08-20T01:30:06.427 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:06 smithi175 ceph-mon[22392]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-20T01:30:06.427 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:06 smithi175 ceph-mon[22392]: osdmap e11: 2 total, 1 up, 2 in 2024-08-20T01:30:06.427 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:06 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T01:30:06.427 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:06 smithi175 ceph-mon[22392]: from='osd.1 [v2:172.21.15.81:6800/1174012328,v1:172.21.15.81:6801/1174012328]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-08-20T01:30:06.427 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:06 smithi175 ceph-mon[22392]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-08-20T01:30:06.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:06 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:30:06.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:06 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:30:06.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:06 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:30:06.524 INFO:journalctl@ceph.osd.1.smithi081.stdout:Aug 20 01:30:06 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-1[26622]: 2024-08-20T01:30:06.299+0000 7ffbd9b1e640 -1 osd.1 0 waiting for initial osdmap 2024-08-20T01:30:06.524 INFO:journalctl@ceph.osd.1.smithi081.stdout:Aug 20 01:30:06 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-1[26622]: 2024-08-20T01:30:06.303+0000 7ffbd5945640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-20T01:30:06.524 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:06 smithi081 ceph-mon[22209]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:30:06.524 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:06 smithi081 ceph-mon[22209]: Detected new or changed devices on smithi081 2024-08-20T01:30:06.524 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:06 smithi081 ceph-mon[22209]: Adjusting osd_memory_target on smithi081 to 17088M 2024-08-20T01:30:06.524 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:06 smithi081 ceph-mon[22209]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-20T01:30:06.525 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:06 smithi081 ceph-mon[22209]: osdmap e11: 2 total, 1 up, 2 in 2024-08-20T01:30:06.525 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:06 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T01:30:06.525 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:06 smithi081 ceph-mon[22209]: from='osd.1 [v2:172.21.15.81:6800/1174012328,v1:172.21.15.81:6801/1174012328]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-08-20T01:30:06.525 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:06 smithi081 ceph-mon[22209]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-08-20T01:30:06.525 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:06 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:30:06.525 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:06 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:30:06.525 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:06 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:30:06.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:06 smithi079 ceph-mon[18656]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:30:06.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:06 smithi079 ceph-mon[18656]: Detected new or changed devices on smithi081 2024-08-20T01:30:06.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:06 smithi079 ceph-mon[18656]: Adjusting osd_memory_target on smithi081 to 17088M 2024-08-20T01:30:06.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:06 smithi079 ceph-mon[18656]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-20T01:30:06.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:06 smithi079 ceph-mon[18656]: osdmap e11: 2 total, 1 up, 2 in 2024-08-20T01:30:06.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:06 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T01:30:06.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:06 smithi079 ceph-mon[18656]: from='osd.1 [v2:172.21.15.81:6800/1174012328,v1:172.21.15.81:6801/1174012328]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-08-20T01:30:06.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:06 smithi079 ceph-mon[18656]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-08-20T01:30:06.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:06 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:30:06.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:06 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:30:06.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:06 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:30:07.589 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:07 smithi175 ceph-mon[22392]: from='client.24253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:30:07.589 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:07 smithi175 ceph-mon[22392]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-08-20T01:30:07.589 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:07 smithi175 ceph-mon[22392]: osdmap e12: 2 total, 1 up, 2 in 2024-08-20T01:30:07.589 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:07 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T01:30:07.589 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:07 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T01:30:07.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:07 smithi079 ceph-mon[18656]: from='client.24253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:30:07.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:07 smithi079 ceph-mon[18656]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-08-20T01:30:07.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:07 smithi079 ceph-mon[18656]: osdmap e12: 2 total, 1 up, 2 in 2024-08-20T01:30:07.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:07 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T01:30:07.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:07 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T01:30:07.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:07 smithi081 ceph-mon[22209]: from='client.24253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:30:07.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:07 smithi081 ceph-mon[22209]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-08-20T01:30:07.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:07 smithi081 ceph-mon[22209]: osdmap e12: 2 total, 1 up, 2 in 2024-08-20T01:30:07.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:07 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T01:30:07.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:07 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T01:30:08.591 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:08 smithi175 ceph-mon[22392]: purged_snaps scrub starts 2024-08-20T01:30:08.591 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:08 smithi175 ceph-mon[22392]: purged_snaps scrub ok 2024-08-20T01:30:08.591 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:08 smithi175 ceph-mon[22392]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:30:08.591 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:08 smithi175 ceph-mon[22392]: osd.1 [v2:172.21.15.81:6800/1174012328,v1:172.21.15.81:6801/1174012328] boot 2024-08-20T01:30:08.591 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:08 smithi175 ceph-mon[22392]: osdmap e13: 2 total, 2 up, 2 in 2024-08-20T01:30:08.592 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:08 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T01:30:08.592 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:08 smithi175 ceph-mon[22392]: from='client.? 172.21.15.175:0/1832008168' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "11d8fb9d-cb2c-41c8-994c-603a1d8e01a1"} : dispatch 2024-08-20T01:30:08.592 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:08 smithi175 ceph-mon[22392]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "11d8fb9d-cb2c-41c8-994c-603a1d8e01a1"} : dispatch 2024-08-20T01:30:08.592 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:08 smithi175 ceph-mon[22392]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "11d8fb9d-cb2c-41c8-994c-603a1d8e01a1"}]': finished 2024-08-20T01:30:08.592 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:08 smithi175 ceph-mon[22392]: osdmap e14: 3 total, 2 up, 3 in 2024-08-20T01:30:08.592 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:08 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T01:30:08.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:08 smithi079 ceph-mon[18656]: purged_snaps scrub starts 2024-08-20T01:30:08.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:08 smithi079 ceph-mon[18656]: purged_snaps scrub ok 2024-08-20T01:30:08.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:08 smithi079 ceph-mon[18656]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:30:08.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:08 smithi079 ceph-mon[18656]: osd.1 [v2:172.21.15.81:6800/1174012328,v1:172.21.15.81:6801/1174012328] boot 2024-08-20T01:30:08.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:08 smithi079 ceph-mon[18656]: osdmap e13: 2 total, 2 up, 2 in 2024-08-20T01:30:08.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:08 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T01:30:08.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:08 smithi079 ceph-mon[18656]: from='client.? 172.21.15.175:0/1832008168' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "11d8fb9d-cb2c-41c8-994c-603a1d8e01a1"} : dispatch 2024-08-20T01:30:08.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:08 smithi079 ceph-mon[18656]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "11d8fb9d-cb2c-41c8-994c-603a1d8e01a1"} : dispatch 2024-08-20T01:30:08.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:08 smithi079 ceph-mon[18656]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "11d8fb9d-cb2c-41c8-994c-603a1d8e01a1"}]': finished 2024-08-20T01:30:08.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:08 smithi079 ceph-mon[18656]: osdmap e14: 3 total, 2 up, 3 in 2024-08-20T01:30:08.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:08 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T01:30:08.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:08 smithi081 ceph-mon[22209]: purged_snaps scrub starts 2024-08-20T01:30:08.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:08 smithi081 ceph-mon[22209]: purged_snaps scrub ok 2024-08-20T01:30:08.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:08 smithi081 ceph-mon[22209]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-20T01:30:08.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:08 smithi081 ceph-mon[22209]: osd.1 [v2:172.21.15.81:6800/1174012328,v1:172.21.15.81:6801/1174012328] boot 2024-08-20T01:30:08.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:08 smithi081 ceph-mon[22209]: osdmap e13: 2 total, 2 up, 2 in 2024-08-20T01:30:08.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:08 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T01:30:08.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:08 smithi081 ceph-mon[22209]: from='client.? 172.21.15.175:0/1832008168' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "11d8fb9d-cb2c-41c8-994c-603a1d8e01a1"} : dispatch 2024-08-20T01:30:08.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:08 smithi081 ceph-mon[22209]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "11d8fb9d-cb2c-41c8-994c-603a1d8e01a1"} : dispatch 2024-08-20T01:30:08.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:08 smithi081 ceph-mon[22209]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "11d8fb9d-cb2c-41c8-994c-603a1d8e01a1"}]': finished 2024-08-20T01:30:08.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:08 smithi081 ceph-mon[22209]: osdmap e14: 3 total, 2 up, 3 in 2024-08-20T01:30:08.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:08 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T01:30:09.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:09 smithi079 ceph-mon[18656]: from='client.? 172.21.15.175:0/3723706904' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:30:09.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:09 smithi081 ceph-mon[22209]: from='client.? 172.21.15.175:0/3723706904' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:30:09.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:09 smithi175 ceph-mon[22392]: from='client.? 172.21.15.175:0/3723706904' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:30:10.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:10 smithi079 ceph-mon[18656]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:30:10.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:10 smithi081 ceph-mon[22209]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:30:10.887 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:10 smithi175 ceph-mon[22392]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:30:12.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:12 smithi079 ceph-mon[18656]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:30:12.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:12 smithi081 ceph-mon[22209]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:30:12.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:12 smithi175 ceph-mon[22392]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:30:14.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:14 smithi175 ceph-mon[22392]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:30:14.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:14 smithi079 ceph-mon[18656]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:30:14.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:14 smithi081 ceph-mon[22209]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:30:16.636 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:16 smithi175 ceph-mon[22392]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:30:16.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:16 smithi079 ceph-mon[18656]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:30:16.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:16 smithi081 ceph-mon[22209]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:30:17.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:17 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-08-20T01:30:17.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:17 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:30:17.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:17 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-08-20T01:30:17.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:17 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:30:17.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:17 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-08-20T01:30:17.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:17 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:30:18.463 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:18 smithi175 ceph-mon[22392]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:30:18.463 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:18 smithi175 ceph-mon[22392]: Deploying daemon osd.2 on smithi175 2024-08-20T01:30:18.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:18 smithi079 ceph-mon[18656]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:30:18.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:18 smithi079 ceph-mon[18656]: Deploying daemon osd.2 on smithi175 2024-08-20T01:30:18.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:18 smithi081 ceph-mon[22209]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:30:18.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:18 smithi081 ceph-mon[22209]: Deploying daemon osd.2 on smithi175 2024-08-20T01:30:19.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:19 smithi175 ceph-mon[22392]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:30:19.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:19 smithi079 ceph-mon[18656]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:30:19.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:19 smithi081 ceph-mon[22209]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:30:21.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:21 smithi079 ceph-mon[18656]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:30:21.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:21 smithi081 ceph-mon[22209]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:30:21.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:21 smithi175 ceph-mon[22392]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:30:22.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:22 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:30:22.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:22 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:22.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:22 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:22.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:22 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:30:22.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:22 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:22.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:22 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:22.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:22 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:30:22.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:22 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:22.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:22 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:23.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:23 smithi175 ceph-mon[22392]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:30:23.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:23 smithi079 ceph-mon[18656]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:30:24.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:23 smithi081 ceph-mon[22209]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:30:25.271 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:24 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:25.272 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:24 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:25.272 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:24 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:30:25.272 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:24 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:30:25.272 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:24 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:25.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:24 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:25.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:24 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:25.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:24 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:30:25.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:24 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:30:25.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:24 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:25.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:25.309+0000 7f902a7fc640 1 -- 172.21.15.175:0/2727064515 <== mgr.14150 v2:172.21.15.79:6800/3038112779 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f90340ff0d0 con 0x7f90200b3bc0 2024-08-20T01:30:25.312 INFO:teuthology.orchestra.run.smithi175.stdout:Created osd(s) 2 on host 'smithi175' 2024-08-20T01:30:25.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:25.312+0000 7f903b63d640 1 -- 172.21.15.175:0/2727064515 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f90200b3bc0 msgr2=0x7f90200b6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:25.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:25.312+0000 7f903b63d640 1 --2- 172.21.15.175:0/2727064515 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f90200b3bc0 0x7f90200b6080 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f902400baa0 tx=0x7f9024005d90 comp rx=0 tx=0).stop 2024-08-20T01:30:25.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:25.312+0000 7f903b63d640 1 -- 172.21.15.175:0/2727064515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9034101610 msgr2=0x7f9034198a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:25.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:25.312+0000 7f903b63d640 1 --2- 172.21.15.175:0/2727064515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9034101610 0x7f9034198a40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9030006010 tx=0x7f9030004380 comp rx=0 tx=0).stop 2024-08-20T01:30:25.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:25.312+0000 7f903b63d640 1 -- 172.21.15.175:0/2727064515 shutdown_connections 2024-08-20T01:30:25.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:25.312+0000 7f903b63d640 1 --2- 172.21.15.175:0/2727064515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9034103130 0x7f9034199cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:25.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:25.312+0000 7f903b63d640 1 --2- 172.21.15.175:0/2727064515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9034102770 0x7f9034199090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:25.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:25.312+0000 7f903b63d640 1 --2- 172.21.15.175:0/2727064515 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f90200b3bc0 0x7f90200b6080 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:25.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:25.312+0000 7f903b63d640 1 --2- 172.21.15.175:0/2727064515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9034101610 0x7f9034198a40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:25.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:25.312+0000 7f903b63d640 1 -- 172.21.15.175:0/2727064515 >> 172.21.15.175:0/2727064515 conn(0x7f90340fcee0 msgr2=0x7f90340fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:25.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:25.312+0000 7f903b63d640 1 -- 172.21.15.175:0/2727064515 shutdown_connections 2024-08-20T01:30:25.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:30:25.312+0000 7f903b63d640 1 -- 172.21.15.175:0/2727064515 wait complete. 2024-08-20T01:30:25.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:24 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:25.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:24 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:25.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:24 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:30:25.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:24 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:30:25.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:24 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:25.877 DEBUG:teuthology.orchestra.run.smithi175:osd.2> sudo journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@osd.2.service 2024-08-20T01:30:25.880 INFO:tasks.cephadm:Deploying osd.3 on smithi079 with /dev/vg_nvme/lv_3... 2024-08-20T01:30:25.880 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-20T01:30:26.133 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:30:26.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:26 smithi175 ceph-mon[22392]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:30:26.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:26 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:30:26.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:26 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:26.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:26 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:26.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:26 smithi079 ceph-mon[18656]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:30:26.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:26 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:30:26.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:26 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:26.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:26 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:26.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:26 smithi081 ceph-mon[22209]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:30:26.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:26 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:30:26.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:26 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:26.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:26 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:28.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:28 smithi175 ceph-mon[22392]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:30:28.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:28 smithi175 ceph-mon[22392]: from='osd.2 [v2:172.21.15.175:6800/1132306232,v1:172.21.15.175:6801/1132306232]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-20T01:30:28.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:28 smithi175 ceph-mon[22392]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-20T01:30:28.139 INFO:journalctl@ceph.osd.2.smithi175.stdout:Aug 20 01:30:27 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-2[27341]: 2024-08-20T01:30:27.895+0000 7f5f76223640 -1 osd.2 0 log_to_monitors true 2024-08-20T01:30:28.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:28 smithi081 ceph-mon[22209]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:30:28.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:28 smithi081 ceph-mon[22209]: from='osd.2 [v2:172.21.15.175:6800/1132306232,v1:172.21.15.175:6801/1132306232]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-20T01:30:28.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:28 smithi081 ceph-mon[22209]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-20T01:30:28.350 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:28 smithi079 ceph-mon[18656]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:30:28.350 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:28 smithi079 ceph-mon[18656]: from='osd.2 [v2:172.21.15.175:6800/1132306232,v1:172.21.15.175:6801/1132306232]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-20T01:30:28.350 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:28 smithi079 ceph-mon[18656]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-20T01:30:28.711 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:30:28.737 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi079:vg_nvme/lv_3 2024-08-20T01:30:28.980 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:30:29.276 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:29 smithi079 ceph-mon[18656]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-20T01:30:29.276 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:29 smithi079 ceph-mon[18656]: osdmap e15: 3 total, 2 up, 3 in 2024-08-20T01:30:29.276 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:29 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T01:30:29.276 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:29 smithi079 ceph-mon[18656]: from='osd.2 [v2:172.21.15.175:6800/1132306232,v1:172.21.15.175:6801/1132306232]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-08-20T01:30:29.276 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:29 smithi079 ceph-mon[18656]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-08-20T01:30:29.276 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:29 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:29.276 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:29 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:29.276 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:29 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T01:30:29.276 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:29 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:29.277 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:29 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:30:29.277 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:29 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:30:29.277 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:29 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:29.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:29 smithi081 ceph-mon[22209]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-20T01:30:29.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:29 smithi081 ceph-mon[22209]: osdmap e15: 3 total, 2 up, 3 in 2024-08-20T01:30:29.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:29 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T01:30:29.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:29 smithi081 ceph-mon[22209]: from='osd.2 [v2:172.21.15.175:6800/1132306232,v1:172.21.15.175:6801/1132306232]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-08-20T01:30:29.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:29 smithi081 ceph-mon[22209]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-08-20T01:30:29.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:29 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:29.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:29 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:29.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:29 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T01:30:29.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:29 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:29.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:29 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:30:29.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:29 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:30:29.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:29 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:29.388 INFO:journalctl@ceph.osd.2.smithi175.stdout:Aug 20 01:30:29 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-2[27341]: 2024-08-20T01:30:29.020+0000 7f5f721a6640 -1 osd.2 0 waiting for initial osdmap 2024-08-20T01:30:29.388 INFO:journalctl@ceph.osd.2.smithi175.stdout:Aug 20 01:30:29 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-2[27341]: 2024-08-20T01:30:29.025+0000 7f5f6dfcd640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-20T01:30:29.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:29 smithi175 ceph-mon[22392]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-20T01:30:29.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:29 smithi175 ceph-mon[22392]: osdmap e15: 3 total, 2 up, 3 in 2024-08-20T01:30:29.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:29 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T01:30:29.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:29 smithi175 ceph-mon[22392]: from='osd.2 [v2:172.21.15.175:6800/1132306232,v1:172.21.15.175:6801/1132306232]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-08-20T01:30:29.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:29 smithi175 ceph-mon[22392]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-08-20T01:30:29.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:29 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:29.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:29 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:29.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:29 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T01:30:29.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:29 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:29.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:29 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:30:29.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:29 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:30:29.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:29 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:29.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:29.476+0000 7fe6b5ca2640 1 -- 172.21.15.79:0/416377152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6b0103130 msgr2=0x7fe6b0109ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:29.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:29.476+0000 7fe6b5ca2640 1 --2- 172.21.15.79:0/416377152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6b0103130 0x7fe6b0109ab0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8009930 tx=0x7fe6a802a420 comp rx=0 tx=0).stop 2024-08-20T01:30:29.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:29.476+0000 7fe6b5ca2640 1 -- 172.21.15.79:0/416377152 shutdown_connections 2024-08-20T01:30:29.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:29.476+0000 7fe6b5ca2640 1 --2- 172.21.15.79:0/416377152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6b0103130 0x7fe6b0109ab0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:29.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:29.476+0000 7fe6b5ca2640 1 --2- 172.21.15.79:0/416377152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6b0102770 0x7fe6b0102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:29.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:29.476+0000 7fe6b5ca2640 1 --2- 172.21.15.79:0/416377152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6b0101610 0x7fe6b0101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:29.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:29.476+0000 7fe6b5ca2640 1 -- 172.21.15.79:0/416377152 >> 172.21.15.79:0/416377152 conn(0x7fe6b00fcee0 msgr2=0x7fe6b00ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:29.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:29.476+0000 7fe6b5ca2640 1 -- 172.21.15.79:0/416377152 shutdown_connections 2024-08-20T01:30:29.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:29.476+0000 7fe6b5ca2640 1 -- 172.21.15.79:0/416377152 wait complete. 2024-08-20T01:30:29.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:29.476+0000 7fe6b5ca2640 1 Processor -- start 2024-08-20T01:30:29.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:29.477+0000 7fe6b5ca2640 1 -- start start 2024-08-20T01:30:29.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:29.477+0000 7fe6b5ca2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6b0101610 0x7fe6b006b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:29.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:29.477+0000 7fe6b5ca2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6b0102770 0x7fe6b019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:29.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:29.477+0000 7fe6b5ca2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6b0103130 0x7fe6b019fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:29.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:29.477+0000 7fe6b5ca2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b010d140 con 0x7fe6b0101610 2024-08-20T01:30:29.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:29.477+0000 7fe6b5ca2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b010cfc0 con 0x7fe6b0103130 2024-08-20T01:30:29.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:29.477+0000 7fe6b5ca2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b010d2c0 con 0x7fe6b0102770 2024-08-20T01:30:29.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:29.477+0000 7fe6af7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6b0101610 0x7fe6b006b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:29.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:29.477+0000 7fe6af7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6b0101610 0x7fe6b006b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60308/0 (socket says 172.21.15.79:60308) 2024-08-20T01:30:29.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:29.477+0000 7fe6af7fe640 1 -- 172.21.15.79:0/3345733127 learned_addr learned my addr 172.21.15.79:0/3345733127 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:30:29.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:29.477+0000 7fe6aeffd640 1 --2- 172.21.15.79:0/3345733127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6b0102770 0x7fe6b019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:29.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:29.477+0000 7fe6af7fe640 1 -- 172.21.15.79:0/3345733127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6b0102770 msgr2=0x7fe6b019d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:29.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:29.477+0000 7fe6af7fe640 1 --2- 172.21.15.79:0/3345733127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6b0102770 0x7fe6b019d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:29.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:29.477+0000 7fe6af7fe640 1 -- 172.21.15.79:0/3345733127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6b0103130 msgr2=0x7fe6b019fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:29.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:29.477+0000 7fe6af7fe640 1 --2- 172.21.15.79:0/3345733127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6b0103130 0x7fe6b019fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:29.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:29.477+0000 7fe6af7fe640 1 -- 172.21.15.79:0/3345733127 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6b01a0500 con 0x7fe6b0101610 2024-08-20T01:30:29.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:29.477+0000 7fe6af7fe640 1 --2- 172.21.15.79:0/3345733127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6b0101610 0x7fe6b006b110 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe6a000cce0 tx=0x7fe6a000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:29.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:29.477+0000 7fe6acff9640 1 -- 172.21.15.79:0/3345733127 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a0004b20 con 0x7fe6b0101610 2024-08-20T01:30:29.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:29.477+0000 7fe6acff9640 1 -- 172.21.15.79:0/3345733127 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6a0004cc0 con 0x7fe6b0101610 2024-08-20T01:30:29.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:29.477+0000 7fe6b5ca2640 1 -- 172.21.15.79:0/3345733127 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6b01a07f0 con 0x7fe6b0101610 2024-08-20T01:30:29.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:29.477+0000 7fe6acff9640 1 -- 172.21.15.79:0/3345733127 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a000f670 con 0x7fe6b0101610 2024-08-20T01:30:29.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:29.478+0000 7fe6b5ca2640 1 -- 172.21.15.79:0/3345733127 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6b01a0ce0 con 0x7fe6b0101610 2024-08-20T01:30:29.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:29.479+0000 7fe6b5ca2640 1 -- 172.21.15.79:0/3345733127 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6b0108910 con 0x7fe6b0101610 2024-08-20T01:30:29.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:29.480+0000 7fe6acff9640 1 -- 172.21.15.79:0/3345733127 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7fe6a0005540 con 0x7fe6b0101610 2024-08-20T01:30:29.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:29.481+0000 7fe6acff9640 1 --2- 172.21.15.79:0/3345733127 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe6980b3b40 0x7fe6980b6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:29.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:29.481+0000 7fe6aeffd640 1 --2- 172.21.15.79:0/3345733127 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe6980b3b40 0x7fe6980b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:29.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:29.481+0000 7fe6acff9640 1 -- 172.21.15.79:0/3345733127 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2571+0+0 (secure 0 0 0) 0x7fe6a00e29a0 con 0x7fe6b0101610 2024-08-20T01:30:29.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:29.481+0000 7fe6aeffd640 1 --2- 172.21.15.79:0/3345733127 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe6980b3b40 0x7fe6980b6000 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4005e10 tx=0x7fe6a4005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:29.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:29.483+0000 7fe6acff9640 1 -- 172.21.15.79:0/3345733127 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fe6a0014030 con 0x7fe6b0101610 2024-08-20T01:30:29.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:29.666+0000 7fe6b5ca2640 1 -- 172.21.15.79:0/3345733127 --> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fe6b00632c0 con 0x7fe6980b3b40 2024-08-20T01:30:30.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:30 smithi081 ceph-mon[22209]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:30:30.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:30 smithi081 ceph-mon[22209]: Detected new or changed devices on smithi175 2024-08-20T01:30:30.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:30 smithi081 ceph-mon[22209]: Adjusting osd_memory_target on smithi175 to 17088M 2024-08-20T01:30:30.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:30 smithi081 ceph-mon[22209]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-08-20T01:30:30.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:30 smithi081 ceph-mon[22209]: osdmap e16: 3 total, 2 up, 3 in 2024-08-20T01:30:30.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:30 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T01:30:30.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:30 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T01:30:30.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:30 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:30:30.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:30 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:30:30.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:30 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:30:30.321 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:30 smithi079 ceph-mon[18656]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:30:30.321 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:30 smithi079 ceph-mon[18656]: Detected new or changed devices on smithi175 2024-08-20T01:30:30.321 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:30 smithi079 ceph-mon[18656]: Adjusting osd_memory_target on smithi175 to 17088M 2024-08-20T01:30:30.321 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:30 smithi079 ceph-mon[18656]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-08-20T01:30:30.321 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:30 smithi079 ceph-mon[18656]: osdmap e16: 3 total, 2 up, 3 in 2024-08-20T01:30:30.321 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:30 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T01:30:30.322 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:30 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T01:30:30.322 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:30 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:30:30.322 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:30 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:30:30.322 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:30 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:30:30.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:30 smithi175 ceph-mon[22392]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-20T01:30:30.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:30 smithi175 ceph-mon[22392]: Detected new or changed devices on smithi175 2024-08-20T01:30:30.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:30 smithi175 ceph-mon[22392]: Adjusting osd_memory_target on smithi175 to 17088M 2024-08-20T01:30:30.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:30 smithi175 ceph-mon[22392]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-08-20T01:30:30.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:30 smithi175 ceph-mon[22392]: osdmap e16: 3 total, 2 up, 3 in 2024-08-20T01:30:30.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:30 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T01:30:30.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:30 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T01:30:30.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:30 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:30:30.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:30 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:30:30.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:30 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:30:31.083 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:31 smithi079 ceph-mon[18656]: purged_snaps scrub starts 2024-08-20T01:30:31.084 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:31 smithi079 ceph-mon[18656]: purged_snaps scrub ok 2024-08-20T01:30:31.084 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:31 smithi079 ceph-mon[18656]: from='client.14427 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:30:31.084 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:31 smithi079 ceph-mon[18656]: osd.2 [v2:172.21.15.175:6800/1132306232,v1:172.21.15.175:6801/1132306232] boot 2024-08-20T01:30:31.084 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:31 smithi079 ceph-mon[18656]: osdmap e17: 3 total, 3 up, 3 in 2024-08-20T01:30:31.084 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:31 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T01:30:31.084 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:31 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-08-20T01:30:31.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:31 smithi175 ceph-mon[22392]: purged_snaps scrub starts 2024-08-20T01:30:31.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:31 smithi175 ceph-mon[22392]: purged_snaps scrub ok 2024-08-20T01:30:31.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:31 smithi175 ceph-mon[22392]: from='client.14427 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:30:31.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:31 smithi175 ceph-mon[22392]: osd.2 [v2:172.21.15.175:6800/1132306232,v1:172.21.15.175:6801/1132306232] boot 2024-08-20T01:30:31.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:31 smithi175 ceph-mon[22392]: osdmap e17: 3 total, 3 up, 3 in 2024-08-20T01:30:31.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:31 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T01:30:31.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:31 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-08-20T01:30:31.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:31 smithi081 ceph-mon[22209]: purged_snaps scrub starts 2024-08-20T01:30:31.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:31 smithi081 ceph-mon[22209]: purged_snaps scrub ok 2024-08-20T01:30:31.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:31 smithi081 ceph-mon[22209]: from='client.14427 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:30:31.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:31 smithi081 ceph-mon[22209]: osd.2 [v2:172.21.15.175:6800/1132306232,v1:172.21.15.175:6801/1132306232] boot 2024-08-20T01:30:31.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:31 smithi081 ceph-mon[22209]: osdmap e17: 3 total, 3 up, 3 in 2024-08-20T01:30:31.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:31 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T01:30:31.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:31 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-08-20T01:30:32.299 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:32 smithi079 ceph-mon[18656]: pgmap v86: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:30:32.299 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:32 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-20T01:30:32.299 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:32 smithi079 ceph-mon[18656]: osdmap e18: 3 total, 3 up, 3 in 2024-08-20T01:30:32.299 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:32 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-08-20T01:30:32.299 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:32 smithi079 sudo[36734]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-20T01:30:32.299 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:32 smithi079 sudo[36734]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-20T01:30:32.299 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:32 smithi079 sudo[36734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-20T01:30:32.299 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:32 smithi079 sudo[36734]: pam_unix(sudo:session): session closed for user root 2024-08-20T01:30:32.299 INFO:journalctl@ceph.osd.0.smithi079.stdout:Aug 20 01:30:32 smithi079 sudo[36722]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-20T01:30:32.299 INFO:journalctl@ceph.osd.0.smithi079.stdout:Aug 20 01:30:32 smithi079 sudo[36722]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-20T01:30:32.300 INFO:journalctl@ceph.osd.0.smithi079.stdout:Aug 20 01:30:32 smithi079 sudo[36722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-20T01:30:32.300 INFO:journalctl@ceph.osd.0.smithi079.stdout:Aug 20 01:30:32 smithi079 sudo[36722]: pam_unix(sudo:session): session closed for user root 2024-08-20T01:30:32.300 INFO:journalctl@ceph.osd.0.smithi079.stdout:Aug 20 01:30:32 smithi079 sudo[36725]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-20T01:30:32.300 INFO:journalctl@ceph.osd.0.smithi079.stdout:Aug 20 01:30:32 smithi079 sudo[36725]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-20T01:30:32.300 INFO:journalctl@ceph.osd.0.smithi079.stdout:Aug 20 01:30:32 smithi079 sudo[36725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-20T01:30:32.300 INFO:journalctl@ceph.osd.0.smithi079.stdout:Aug 20 01:30:32 smithi079 sudo[36725]: pam_unix(sudo:session): session closed for user root 2024-08-20T01:30:32.323 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:32 smithi175 ceph-mon[22392]: pgmap v86: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:30:32.323 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:32 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-20T01:30:32.323 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:32 smithi175 ceph-mon[22392]: osdmap e18: 3 total, 3 up, 3 in 2024-08-20T01:30:32.324 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:32 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-08-20T01:30:32.324 INFO:journalctl@ceph.osd.2.smithi175.stdout:Aug 20 01:30:32 smithi175 sudo[31096]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-20T01:30:32.324 INFO:journalctl@ceph.osd.2.smithi175.stdout:Aug 20 01:30:32 smithi175 sudo[31096]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-20T01:30:32.324 INFO:journalctl@ceph.osd.2.smithi175.stdout:Aug 20 01:30:32 smithi175 sudo[31096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-20T01:30:32.324 INFO:journalctl@ceph.osd.2.smithi175.stdout:Aug 20 01:30:32 smithi175 sudo[31096]: pam_unix(sudo:session): session closed for user root 2024-08-20T01:30:32.324 INFO:journalctl@ceph.osd.2.smithi175.stdout:Aug 20 01:30:32 smithi175 sudo[31099]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-20T01:30:32.324 INFO:journalctl@ceph.osd.2.smithi175.stdout:Aug 20 01:30:32 smithi175 sudo[31099]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-20T01:30:32.324 INFO:journalctl@ceph.osd.2.smithi175.stdout:Aug 20 01:30:32 smithi175 sudo[31099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-20T01:30:32.324 INFO:journalctl@ceph.osd.2.smithi175.stdout:Aug 20 01:30:32 smithi175 sudo[31099]: pam_unix(sudo:session): session closed for user root 2024-08-20T01:30:32.363 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:32 smithi081 ceph-mon[22209]: pgmap v86: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:30:32.363 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:32 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-20T01:30:32.364 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:32 smithi081 ceph-mon[22209]: osdmap e18: 3 total, 3 up, 3 in 2024-08-20T01:30:32.364 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:32 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-08-20T01:30:32.364 INFO:journalctl@ceph.osd.1.smithi081.stdout:Aug 20 01:30:32 smithi081 sudo[30316]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-20T01:30:32.364 INFO:journalctl@ceph.osd.1.smithi081.stdout:Aug 20 01:30:32 smithi081 sudo[30316]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-20T01:30:32.364 INFO:journalctl@ceph.osd.1.smithi081.stdout:Aug 20 01:30:32 smithi081 sudo[30316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-20T01:30:32.364 INFO:journalctl@ceph.osd.1.smithi081.stdout:Aug 20 01:30:32 smithi081 sudo[30316]: pam_unix(sudo:session): session closed for user root 2024-08-20T01:30:32.364 INFO:journalctl@ceph.osd.1.smithi081.stdout:Aug 20 01:30:32 smithi081 sudo[30319]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-20T01:30:32.364 INFO:journalctl@ceph.osd.1.smithi081.stdout:Aug 20 01:30:32 smithi081 sudo[30319]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-20T01:30:32.364 INFO:journalctl@ceph.osd.1.smithi081.stdout:Aug 20 01:30:32 smithi081 sudo[30319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-20T01:30:32.364 INFO:journalctl@ceph.osd.1.smithi081.stdout:Aug 20 01:30:32 smithi081 sudo[30319]: pam_unix(sudo:session): session closed for user root 2024-08-20T01:30:32.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:32 smithi175 sudo[31102]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-20T01:30:32.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:32 smithi175 sudo[31102]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-20T01:30:32.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:32 smithi175 sudo[31102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-20T01:30:32.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:32 smithi175 sudo[31102]: pam_unix(sudo:session): session closed for user root 2024-08-20T01:30:32.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:32 smithi175 sudo[31105]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-20T01:30:32.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:32 smithi175 sudo[31105]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-20T01:30:32.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:32 smithi175 sudo[31105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-20T01:30:32.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:32 smithi175 sudo[31105]: pam_unix(sudo:session): session closed for user root 2024-08-20T01:30:32.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:32 smithi079 sudo[36737]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-20T01:30:32.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:32 smithi079 sudo[36737]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-20T01:30:32.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:32 smithi079 sudo[36737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-20T01:30:32.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:32 smithi079 sudo[36737]: pam_unix(sudo:session): session closed for user root 2024-08-20T01:30:32.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:32 smithi081 sudo[30322]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-20T01:30:32.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:32 smithi081 sudo[30322]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-20T01:30:32.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:32 smithi081 sudo[30322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-20T01:30:32.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:32 smithi081 sudo[30322]: pam_unix(sudo:session): session closed for user root 2024-08-20T01:30:32.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:32 smithi081 sudo[30325]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-20T01:30:32.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:32 smithi081 sudo[30325]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-20T01:30:32.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:32 smithi081 sudo[30325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-20T01:30:32.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:32 smithi081 sudo[30325]: pam_unix(sudo:session): session closed for user root 2024-08-20T01:30:33.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:33.370+0000 7fe6acff9640 1 -- 172.21.15.79:0/3345733127 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7fe6a00a72d0 con 0x7fe6b0101610 2024-08-20T01:30:33.372 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:33 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-20T01:30:33.372 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:33 smithi079 ceph-mon[18656]: osdmap e19: 3 total, 3 up, 3 in 2024-08-20T01:30:33.372 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:33 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2841711920' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "29e35242-957f-404b-b99e-d4dd0045c35d"} : dispatch 2024-08-20T01:30:33.372 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:33 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2841711920' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "29e35242-957f-404b-b99e-d4dd0045c35d"}]': finished 2024-08-20T01:30:33.372 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:33 smithi079 ceph-mon[18656]: osdmap e20: 4 total, 3 up, 4 in 2024-08-20T01:30:33.373 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:33 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T01:30:33.373 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:33 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:33.373 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:33 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:33.373 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:33 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:33.373 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:33 smithi079 ceph-mon[18656]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-20T01:30:33.373 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:33 smithi079 ceph-mon[18656]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-20T01:30:33.373 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:33 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T01:30:33.373 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:33 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:30:33.373 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:33 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:30:33.373 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:33 smithi079 ceph-mon[18656]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-20T01:30:33.373 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:33 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T01:30:33.373 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:33 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:30:33.374 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:33 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:30:33.374 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:33 smithi079 ceph-mon[18656]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-20T01:30:33.374 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:33 smithi079 ceph-mon[18656]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-20T01:30:33.374 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:33 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T01:30:33.374 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:33 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:30:33.374 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:33 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:30:33.374 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:33 smithi079 ceph-mon[18656]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-20T01:30:33.374 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:33 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/111191820' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:30:33.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:33 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-20T01:30:33.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:33 smithi175 ceph-mon[22392]: osdmap e19: 3 total, 3 up, 3 in 2024-08-20T01:30:33.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:33 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2841711920' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "29e35242-957f-404b-b99e-d4dd0045c35d"} : dispatch 2024-08-20T01:30:33.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:33 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2841711920' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "29e35242-957f-404b-b99e-d4dd0045c35d"}]': finished 2024-08-20T01:30:33.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:33 smithi175 ceph-mon[22392]: osdmap e20: 4 total, 3 up, 4 in 2024-08-20T01:30:33.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:33 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T01:30:33.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:33 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:33.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:33 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:33.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:33 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:33.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:33 smithi175 ceph-mon[22392]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-20T01:30:33.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:33 smithi175 ceph-mon[22392]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-20T01:30:33.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:33 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T01:30:33.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:33 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:30:33.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:33 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:30:33.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:33 smithi175 ceph-mon[22392]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-20T01:30:33.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:33 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T01:30:33.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:33 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:30:33.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:33 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:30:33.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:33 smithi175 ceph-mon[22392]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-20T01:30:33.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:33 smithi175 ceph-mon[22392]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-20T01:30:33.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:33 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T01:30:33.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:33 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:30:33.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:33 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:30:33.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:33 smithi175 ceph-mon[22392]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-20T01:30:33.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:33 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/111191820' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:30:33.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:33 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-20T01:30:33.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:33 smithi081 ceph-mon[22209]: osdmap e19: 3 total, 3 up, 3 in 2024-08-20T01:30:33.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:33 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2841711920' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "29e35242-957f-404b-b99e-d4dd0045c35d"} : dispatch 2024-08-20T01:30:33.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:33 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2841711920' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "29e35242-957f-404b-b99e-d4dd0045c35d"}]': finished 2024-08-20T01:30:33.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:33 smithi081 ceph-mon[22209]: osdmap e20: 4 total, 3 up, 4 in 2024-08-20T01:30:33.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:33 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T01:30:33.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:33 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:33.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:33 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:33.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:33 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:33.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:33 smithi081 ceph-mon[22209]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-20T01:30:33.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:33 smithi081 ceph-mon[22209]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-20T01:30:33.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:33 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T01:30:33.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:33 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:30:33.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:33 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:30:33.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:33 smithi081 ceph-mon[22209]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-20T01:30:33.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:33 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T01:30:33.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:33 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:30:33.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:33 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:30:33.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:33 smithi081 ceph-mon[22209]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-20T01:30:33.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:33 smithi081 ceph-mon[22209]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-20T01:30:33.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:33 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T01:30:33.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:33 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T01:30:33.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:33 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T01:30:33.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:33 smithi081 ceph-mon[22209]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-20T01:30:33.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:33 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/111191820' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:30:34.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:34 smithi175 ceph-mon[22392]: pgmap v90: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:30:34.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:34 smithi175 ceph-mon[22392]: mgrmap e16: x(active, since 2m), standbys: y, z 2024-08-20T01:30:34.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:34 smithi079 ceph-mon[18656]: pgmap v90: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:30:34.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:34 smithi079 ceph-mon[18656]: mgrmap e16: x(active, since 2m), standbys: y, z 2024-08-20T01:30:34.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:34 smithi081 ceph-mon[22209]: pgmap v90: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:30:34.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:34 smithi081 ceph-mon[22209]: mgrmap e16: x(active, since 2m), standbys: y, z 2024-08-20T01:30:36.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:36 smithi175 ceph-mon[22392]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:30:36.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:36 smithi079 ceph-mon[18656]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:30:36.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:36 smithi081 ceph-mon[22209]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:30:38.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:38 smithi175 ceph-mon[22392]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:30:38.644 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:38 smithi079 ceph-mon[18656]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:30:38.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:38 smithi081 ceph-mon[22209]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:30:40.546 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:40 smithi079 ceph-mon[18656]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:30:40.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:40 smithi175 ceph-mon[22392]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:30:40.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:40 smithi081 ceph-mon[22209]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:30:41.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:41 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-08-20T01:30:41.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:41 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:30:41.644 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:41 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-08-20T01:30:41.644 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:41 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:30:41.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:41 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-08-20T01:30:41.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:41 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:30:42.455 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:42 smithi079 ceph-mon[18656]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:30:42.455 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:42 smithi079 ceph-mon[18656]: Deploying daemon osd.3 on smithi079 2024-08-20T01:30:42.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:42 smithi175 ceph-mon[22392]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:30:42.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:42 smithi175 ceph-mon[22392]: Deploying daemon osd.3 on smithi079 2024-08-20T01:30:42.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:42 smithi081 ceph-mon[22209]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:30:42.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:42 smithi081 ceph-mon[22209]: Deploying daemon osd.3 on smithi079 2024-08-20T01:30:44.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:44 smithi175 ceph-mon[22392]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:30:44.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:44 smithi079 ceph-mon[18656]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:30:44.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:44 smithi081 ceph-mon[22209]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:30:46.532 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:46 smithi079 ceph-mon[18656]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:30:46.532 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:46 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:30:46.532 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:46 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:46.532 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:46 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:46.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:46 smithi081 ceph-mon[22209]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:30:46.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:46 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:30:46.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:46 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:46.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:46 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:46.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:46 smithi175 ceph-mon[22392]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:30:46.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:46 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:30:46.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:46 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:46.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:46 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:48.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:48 smithi175 ceph-mon[22392]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:30:48.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:48 smithi079 ceph-mon[18656]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:30:48.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:48 smithi081 ceph-mon[22209]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:30:49.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:49 smithi079 ceph-mon[18656]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:30:49.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:49 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:49.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:49 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:49.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:49 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:30:49.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:49 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:30:49.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:49 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:49.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:49.749+0000 7fe6acff9640 1 -- 172.21.15.79:0/3345733127 <== mgr.14150 v2:172.21.15.79:6800/3038112779 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe6b00632c0 con 0x7fe6980b3b40 2024-08-20T01:30:49.750 INFO:teuthology.orchestra.run.smithi079.stdout:Created osd(s) 3 on host 'smithi079' 2024-08-20T01:30:49.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:49.751+0000 7fe6b5ca2640 1 -- 172.21.15.79:0/3345733127 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe6980b3b40 msgr2=0x7fe6980b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:49.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:49.751+0000 7fe6b5ca2640 1 --2- 172.21.15.79:0/3345733127 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe6980b3b40 0x7fe6980b6000 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4005e10 tx=0x7fe6a4005da0 comp rx=0 tx=0).stop 2024-08-20T01:30:49.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:49.751+0000 7fe6b5ca2640 1 -- 172.21.15.79:0/3345733127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6b0101610 msgr2=0x7fe6b006b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:49.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:49.751+0000 7fe6b5ca2640 1 --2- 172.21.15.79:0/3345733127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6b0101610 0x7fe6b006b110 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe6a000cce0 tx=0x7fe6a000a620 comp rx=0 tx=0).stop 2024-08-20T01:30:49.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:49.751+0000 7fe6b5ca2640 1 -- 172.21.15.79:0/3345733127 shutdown_connections 2024-08-20T01:30:49.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:49.751+0000 7fe6b5ca2640 1 --2- 172.21.15.79:0/3345733127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6b0103130 0x7fe6b019fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:49.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:49.751+0000 7fe6b5ca2640 1 --2- 172.21.15.79:0/3345733127 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe6980b3b40 0x7fe6980b6000 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:49.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:49.751+0000 7fe6b5ca2640 1 --2- 172.21.15.79:0/3345733127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6b0102770 0x7fe6b019d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:49.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:49.751+0000 7fe6b5ca2640 1 --2- 172.21.15.79:0/3345733127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6b0101610 0x7fe6b006b110 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:49.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:49.751+0000 7fe6b5ca2640 1 -- 172.21.15.79:0/3345733127 >> 172.21.15.79:0/3345733127 conn(0x7fe6b00fcee0 msgr2=0x7fe6b0105ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:49.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:49.751+0000 7fe6b5ca2640 1 -- 172.21.15.79:0/3345733127 shutdown_connections 2024-08-20T01:30:49.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:30:49.751+0000 7fe6b5ca2640 1 -- 172.21.15.79:0/3345733127 wait complete. 2024-08-20T01:30:49.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:49 smithi081 ceph-mon[22209]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:30:49.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:49 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:49.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:49 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:49.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:49 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:30:49.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:49 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:30:49.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:49 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:49.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:49 smithi175 ceph-mon[22392]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:30:49.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:49 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:49.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:49 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:49.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:49 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:30:49.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:49 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:30:49.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:49 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:50.442 DEBUG:teuthology.orchestra.run.smithi079:osd.3> sudo journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@osd.3.service 2024-08-20T01:30:50.445 INFO:tasks.cephadm:Deploying osd.4 on smithi081 with /dev/vg_nvme/lv_3... 2024-08-20T01:30:50.445 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-20T01:30:50.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:50 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:30:50.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:50 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:50.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:50 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:50.698 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.b/config 2024-08-20T01:30:50.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:50 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:30:50.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:50 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:50.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:50 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:50.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:50 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:30:50.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:50 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:50.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:50 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:51.805 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:51 smithi079 ceph-mon[18656]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:30:51.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:51 smithi175 ceph-mon[22392]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:30:52.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:51 smithi081 ceph-mon[22209]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:30:52.185 INFO:journalctl@ceph.osd.3.smithi079.stdout:Aug 20 01:30:51 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-3[38748]: 2024-08-20T01:30:51.803+0000 7ff18749b640 -1 osd.3 0 log_to_monitors true 2024-08-20T01:30:53.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:52 smithi081 ceph-mon[22209]: from='osd.3 [v2:172.21.15.79:6810/1364181822,v1:172.21.15.79:6811/1364181822]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-08-20T01:30:53.120 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:52 smithi079 ceph-mon[18656]: from='osd.3 [v2:172.21.15.79:6810/1364181822,v1:172.21.15.79:6811/1364181822]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-08-20T01:30:53.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:52 smithi175 ceph-mon[22392]: from='osd.3 [v2:172.21.15.79:6810/1364181822,v1:172.21.15.79:6811/1364181822]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-08-20T01:30:53.347 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-08-20T01:30:53.379 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi081:vg_nvme/lv_3 2024-08-20T01:30:53.633 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.b/config 2024-08-20T01:30:54.005 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:53 smithi081 ceph-mon[22209]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:30:54.005 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:53 smithi081 ceph-mon[22209]: from='osd.3 [v2:172.21.15.79:6810/1364181822,v1:172.21.15.79:6811/1364181822]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-20T01:30:54.005 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:53 smithi081 ceph-mon[22209]: osdmap e21: 4 total, 3 up, 4 in 2024-08-20T01:30:54.005 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:53 smithi081 ceph-mon[22209]: from='osd.3 [v2:172.21.15.79:6810/1364181822,v1:172.21.15.79:6811/1364181822]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-08-20T01:30:54.005 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:53 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T01:30:54.006 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:53 smithi081 ceph-mon[22209]: Detected new or changed devices on smithi079 2024-08-20T01:30:54.006 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:53 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:54.006 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:53 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:54.006 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:53 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T01:30:54.006 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:53 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-20T01:30:54.006 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:53 smithi081 ceph-mon[22209]: Adjusting osd_memory_target on smithi079 to 8544M 2024-08-20T01:30:54.006 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:53 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:54.006 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:53 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:30:54.006 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:53 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:30:54.006 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:53 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:54.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:54.087+0000 7f53de9d4640 1 -- 172.21.15.81:0/2768557805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53d8108450 msgr2=0x7f53d810a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:54.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:54.087+0000 7f53de9d4640 1 --2- 172.21.15.81:0/2768557805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53d8108450 0x7f53d810a910 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f53d0009ca0 tx=0x7f53d002a8c0 comp rx=0 tx=0).stop 2024-08-20T01:30:54.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:54.087+0000 7f53de9d4640 1 -- 172.21.15.81:0/2768557805 shutdown_connections 2024-08-20T01:30:54.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:54.087+0000 7f53de9d4640 1 --2- 172.21.15.81:0/2768557805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53d8108450 0x7f53d810a910 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:54.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:54.087+0000 7f53de9d4640 1 --2- 172.21.15.81:0/2768557805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53d81058a0 0x7f53d8107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:54.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:54.087+0000 7f53de9d4640 1 --2- 172.21.15.81:0/2768557805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53d806bc00 0x7f53d8105310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:54.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:54.087+0000 7f53de9d4640 1 -- 172.21.15.81:0/2768557805 >> 172.21.15.81:0/2768557805 conn(0x7f53d80fcf00 msgr2=0x7f53d80ff340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:30:54.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:54.087+0000 7f53de9d4640 1 -- 172.21.15.81:0/2768557805 shutdown_connections 2024-08-20T01:30:54.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:54.087+0000 7f53de9d4640 1 -- 172.21.15.81:0/2768557805 wait complete. 2024-08-20T01:30:54.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:54.088+0000 7f53de9d4640 1 Processor -- start 2024-08-20T01:30:54.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:54.088+0000 7f53de9d4640 1 -- start start 2024-08-20T01:30:54.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:54.088+0000 7f53de9d4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53d806bc00 0x7f53d8102a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:54.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:54.088+0000 7f53de9d4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53d81058a0 0x7f53d81012b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:54.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:54.088+0000 7f53de9d4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53d8108450 0x7f53d81017f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:54.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:54.088+0000 7f53de9d4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f53d810e320 con 0x7f53d8108450 2024-08-20T01:30:54.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:54.088+0000 7f53de9d4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f53d810e1a0 con 0x7f53d806bc00 2024-08-20T01:30:54.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:54.088+0000 7f53de9d4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f53d810e4a0 con 0x7f53d81058a0 2024-08-20T01:30:54.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:54.088+0000 7f53d7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53d806bc00 0x7f53d8102a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:54.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:54.089+0000 7f53d7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53d806bc00 0x7f53d8102a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34354/0 (socket says 172.21.15.81:34354) 2024-08-20T01:30:54.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:54.089+0000 7f53d7fff640 1 -- 172.21.15.81:0/515777655 learned_addr learned my addr 172.21.15.81:0/515777655 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-08-20T01:30:54.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:54.089+0000 7f53dcf71640 1 --2- 172.21.15.81:0/515777655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53d8108450 0x7f53d81017f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:54.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:54.089+0000 7f53d77fe640 1 --2- 172.21.15.81:0/515777655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53d81058a0 0x7f53d81012b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:54.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:54.089+0000 7f53d7fff640 1 -- 172.21.15.81:0/515777655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53d81058a0 msgr2=0x7f53d81012b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:54.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:54.089+0000 7f53d7fff640 1 --2- 172.21.15.81:0/515777655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53d81058a0 0x7f53d81012b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:54.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:54.089+0000 7f53d7fff640 1 -- 172.21.15.81:0/515777655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53d8108450 msgr2=0x7f53d81017f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:30:54.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:54.089+0000 7f53d7fff640 1 --2- 172.21.15.81:0/515777655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53d8108450 0x7f53d81017f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:30:54.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:54.089+0000 7f53d7fff640 1 -- 172.21.15.81:0/515777655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d81020b0 con 0x7f53d806bc00 2024-08-20T01:30:54.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:54.089+0000 7f53dcf71640 1 --2- 172.21.15.81:0/515777655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53d8108450 0x7f53d81017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:30:54.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:54.089+0000 7f53d7fff640 1 --2- 172.21.15.81:0/515777655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53d806bc00 0x7f53d8102a40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f53c800b4a0 tx=0x7f53c800b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:54.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:54.089+0000 7f53d57fa640 1 -- 172.21.15.81:0/515777655 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c8014070 con 0x7f53d806bc00 2024-08-20T01:30:54.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:54.089+0000 7f53de9d4640 1 -- 172.21.15.81:0/515777655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53d81a2b40 con 0x7f53d806bc00 2024-08-20T01:30:54.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:54.089+0000 7f53d57fa640 1 -- 172.21.15.81:0/515777655 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f53c8010aa0 con 0x7f53d806bc00 2024-08-20T01:30:54.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:54.089+0000 7f53d57fa640 1 -- 172.21.15.81:0/515777655 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c8017b70 con 0x7f53d806bc00 2024-08-20T01:30:54.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:54.089+0000 7f53de9d4640 1 -- 172.21.15.81:0/515777655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53d81a30a0 con 0x7f53d806bc00 2024-08-20T01:30:54.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:54.091+0000 7f53de9d4640 1 -- 172.21.15.81:0/515777655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53d80fe9f0 con 0x7f53d806bc00 2024-08-20T01:30:54.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:54.092+0000 7f53d57fa640 1 -- 172.21.15.81:0/515777655 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f53c8017070 con 0x7f53d806bc00 2024-08-20T01:30:54.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:54.092+0000 7f53d57fa640 1 --2- 172.21.15.81:0/515777655 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f53c00b3c50 0x7f53c00b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:30:54.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:54.093+0000 7f53d57fa640 1 -- 172.21.15.81:0/515777655 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 3389+0+0 (secure 0 0 0) 0x7f53c80e1e70 con 0x7f53d806bc00 2024-08-20T01:30:54.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:54.093+0000 7f53d77fe640 1 --2- 172.21.15.81:0/515777655 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f53c00b3c50 0x7f53c00b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:30:54.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:54.093+0000 7f53d77fe640 1 --2- 172.21.15.81:0/515777655 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f53c00b3c50 0x7f53c00b6110 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f53d806c0b0 tx=0x7f53cc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:30:54.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:54.097+0000 7f53d57fa640 1 -- 172.21.15.81:0/515777655 <== mon.2 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f53c80aa1b0 con 0x7f53d806bc00 2024-08-20T01:30:54.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:53 smithi175 ceph-mon[22392]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:30:54.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:53 smithi175 ceph-mon[22392]: from='osd.3 [v2:172.21.15.79:6810/1364181822,v1:172.21.15.79:6811/1364181822]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-20T01:30:54.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:53 smithi175 ceph-mon[22392]: osdmap e21: 4 total, 3 up, 4 in 2024-08-20T01:30:54.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:53 smithi175 ceph-mon[22392]: from='osd.3 [v2:172.21.15.79:6810/1364181822,v1:172.21.15.79:6811/1364181822]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-08-20T01:30:54.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:53 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T01:30:54.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:53 smithi175 ceph-mon[22392]: Detected new or changed devices on smithi079 2024-08-20T01:30:54.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:53 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:54.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:53 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:54.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:53 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T01:30:54.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:53 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-20T01:30:54.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:53 smithi175 ceph-mon[22392]: Adjusting osd_memory_target on smithi079 to 8544M 2024-08-20T01:30:54.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:53 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:54.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:53 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:30:54.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:53 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:30:54.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:53 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:54.185 INFO:journalctl@ceph.osd.3.smithi079.stdout:Aug 20 01:30:53 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-3[38748]: 2024-08-20T01:30:53.762+0000 7ff18341e640 -1 osd.3 0 waiting for initial osdmap 2024-08-20T01:30:54.186 INFO:journalctl@ceph.osd.3.smithi079.stdout:Aug 20 01:30:53 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-3[38748]: 2024-08-20T01:30:53.770+0000 7ff17f245640 -1 osd.3 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-20T01:30:54.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:53 smithi079 ceph-mon[18656]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:30:54.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:53 smithi079 ceph-mon[18656]: from='osd.3 [v2:172.21.15.79:6810/1364181822,v1:172.21.15.79:6811/1364181822]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-20T01:30:54.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:53 smithi079 ceph-mon[18656]: osdmap e21: 4 total, 3 up, 4 in 2024-08-20T01:30:54.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:53 smithi079 ceph-mon[18656]: from='osd.3 [v2:172.21.15.79:6810/1364181822,v1:172.21.15.79:6811/1364181822]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-08-20T01:30:54.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:53 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T01:30:54.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:53 smithi079 ceph-mon[18656]: Detected new or changed devices on smithi079 2024-08-20T01:30:54.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:53 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:54.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:53 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:54.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:53 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T01:30:54.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:53 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-20T01:30:54.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:53 smithi079 ceph-mon[18656]: Adjusting osd_memory_target on smithi079 to 8544M 2024-08-20T01:30:54.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:53 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:54.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:53 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:30:54.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:53 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:30:54.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:53 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:30:54.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:30:54.285+0000 7f53de9d4640 1 -- 172.21.15.81:0/515777655 --> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f53d80632c0 con 0x7f53c00b3c50 2024-08-20T01:30:54.991 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:54 smithi081 ceph-mon[22209]: from='osd.3 [v2:172.21.15.79:6810/1364181822,v1:172.21.15.79:6811/1364181822]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-08-20T01:30:54.992 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:54 smithi081 ceph-mon[22209]: osdmap e22: 4 total, 3 up, 4 in 2024-08-20T01:30:54.992 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:54 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T01:30:54.992 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:54 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T01:30:54.992 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:54 smithi081 ceph-mon[22209]: from='client.24296 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:30:54.992 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:54 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:30:54.992 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:54 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:30:54.992 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:54 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:30:54.992 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:54 smithi081 ceph-mon[22209]: osd.3 [v2:172.21.15.79:6810/1364181822,v1:172.21.15.79:6811/1364181822] boot 2024-08-20T01:30:54.992 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:54 smithi081 ceph-mon[22209]: osdmap e23: 4 total, 4 up, 4 in 2024-08-20T01:30:54.992 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:54 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T01:30:55.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:54 smithi175 ceph-mon[22392]: from='osd.3 [v2:172.21.15.79:6810/1364181822,v1:172.21.15.79:6811/1364181822]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-08-20T01:30:55.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:54 smithi175 ceph-mon[22392]: osdmap e22: 4 total, 3 up, 4 in 2024-08-20T01:30:55.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:54 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T01:30:55.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:54 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T01:30:55.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:54 smithi175 ceph-mon[22392]: from='client.24296 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:30:55.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:54 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:30:55.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:54 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:30:55.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:54 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:30:55.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:54 smithi175 ceph-mon[22392]: osd.3 [v2:172.21.15.79:6810/1364181822,v1:172.21.15.79:6811/1364181822] boot 2024-08-20T01:30:55.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:54 smithi175 ceph-mon[22392]: osdmap e23: 4 total, 4 up, 4 in 2024-08-20T01:30:55.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:54 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T01:30:55.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:54 smithi079 ceph-mon[18656]: from='osd.3 [v2:172.21.15.79:6810/1364181822,v1:172.21.15.79:6811/1364181822]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-08-20T01:30:55.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:54 smithi079 ceph-mon[18656]: osdmap e22: 4 total, 3 up, 4 in 2024-08-20T01:30:55.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:54 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T01:30:55.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:54 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T01:30:55.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:54 smithi079 ceph-mon[18656]: from='client.24296 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:30:55.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:54 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:30:55.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:54 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:30:55.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:54 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:30:55.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:54 smithi079 ceph-mon[18656]: osd.3 [v2:172.21.15.79:6810/1364181822,v1:172.21.15.79:6811/1364181822] boot 2024-08-20T01:30:55.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:54 smithi079 ceph-mon[18656]: osdmap e23: 4 total, 4 up, 4 in 2024-08-20T01:30:55.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:54 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T01:30:55.838 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:55 smithi081 ceph-mon[22209]: purged_snaps scrub starts 2024-08-20T01:30:55.838 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:55 smithi081 ceph-mon[22209]: purged_snaps scrub ok 2024-08-20T01:30:55.838 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:55 smithi081 ceph-mon[22209]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:30:55.838 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:55 smithi081 ceph-mon[22209]: osdmap e24: 4 total, 4 up, 4 in 2024-08-20T01:30:56.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:55 smithi175 ceph-mon[22392]: purged_snaps scrub starts 2024-08-20T01:30:56.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:55 smithi175 ceph-mon[22392]: purged_snaps scrub ok 2024-08-20T01:30:56.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:55 smithi175 ceph-mon[22392]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:30:56.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:55 smithi175 ceph-mon[22392]: osdmap e24: 4 total, 4 up, 4 in 2024-08-20T01:30:56.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:55 smithi079 ceph-mon[18656]: purged_snaps scrub starts 2024-08-20T01:30:56.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:55 smithi079 ceph-mon[18656]: purged_snaps scrub ok 2024-08-20T01:30:56.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:55 smithi079 ceph-mon[18656]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-08-20T01:30:56.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:55 smithi079 ceph-mon[18656]: osdmap e24: 4 total, 4 up, 4 in 2024-08-20T01:30:57.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:56 smithi081 ceph-mon[22209]: from='client.? 172.21.15.81:0/3201446217' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9139c469-270f-4465-8adb-1e748529fa68"} : dispatch 2024-08-20T01:30:57.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:56 smithi081 ceph-mon[22209]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9139c469-270f-4465-8adb-1e748529fa68"} : dispatch 2024-08-20T01:30:57.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:56 smithi081 ceph-mon[22209]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9139c469-270f-4465-8adb-1e748529fa68"}]': finished 2024-08-20T01:30:57.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:56 smithi081 ceph-mon[22209]: osdmap e25: 5 total, 4 up, 5 in 2024-08-20T01:30:57.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:56 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T01:30:57.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:56 smithi175 ceph-mon[22392]: from='client.? 172.21.15.81:0/3201446217' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9139c469-270f-4465-8adb-1e748529fa68"} : dispatch 2024-08-20T01:30:57.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:56 smithi175 ceph-mon[22392]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9139c469-270f-4465-8adb-1e748529fa68"} : dispatch 2024-08-20T01:30:57.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:56 smithi175 ceph-mon[22392]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9139c469-270f-4465-8adb-1e748529fa68"}]': finished 2024-08-20T01:30:57.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:56 smithi175 ceph-mon[22392]: osdmap e25: 5 total, 4 up, 5 in 2024-08-20T01:30:57.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:56 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T01:30:57.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:56 smithi079 ceph-mon[18656]: from='client.? 172.21.15.81:0/3201446217' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9139c469-270f-4465-8adb-1e748529fa68"} : dispatch 2024-08-20T01:30:57.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:56 smithi079 ceph-mon[18656]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9139c469-270f-4465-8adb-1e748529fa68"} : dispatch 2024-08-20T01:30:57.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:56 smithi079 ceph-mon[18656]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9139c469-270f-4465-8adb-1e748529fa68"}]': finished 2024-08-20T01:30:57.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:56 smithi079 ceph-mon[18656]: osdmap e25: 5 total, 4 up, 5 in 2024-08-20T01:30:57.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:56 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T01:30:58.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:57 smithi175 ceph-mon[22392]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-08-20T01:30:58.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:57 smithi175 ceph-mon[22392]: from='client.? 172.21.15.81:0/1285595930' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:30:58.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:57 smithi079 ceph-mon[18656]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-08-20T01:30:58.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:57 smithi079 ceph-mon[18656]: from='client.? 172.21.15.81:0/1285595930' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:30:58.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:57 smithi081 ceph-mon[22209]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-08-20T01:30:58.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:57 smithi081 ceph-mon[22209]: from='client.? 172.21.15.81:0/1285595930' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:31:00.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:30:59 smithi175 ceph-mon[22392]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 124 KiB/s, 0 objects/s recovering 2024-08-20T01:31:00.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:30:59 smithi079 ceph-mon[18656]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 124 KiB/s, 0 objects/s recovering 2024-08-20T01:31:00.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:30:59 smithi081 ceph-mon[22209]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 124 KiB/s, 0 objects/s recovering 2024-08-20T01:31:02.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:01 smithi081 ceph-mon[22209]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-20T01:31:02.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:01 smithi175 ceph-mon[22392]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-20T01:31:02.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:01 smithi079 ceph-mon[18656]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-20T01:31:04.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:03 smithi081 ceph-mon[22209]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-08-20T01:31:04.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:03 smithi175 ceph-mon[22392]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-08-20T01:31:04.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:03 smithi079 ceph-mon[18656]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-08-20T01:31:05.982 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:05 smithi081 ceph-mon[22209]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-08-20T01:31:05.982 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:05 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-08-20T01:31:05.982 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:05 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:31:05.982 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:05 smithi081 ceph-mon[22209]: Deploying daemon osd.4 on smithi081 2024-08-20T01:31:06.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:05 smithi175 ceph-mon[22392]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-08-20T01:31:06.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:05 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-08-20T01:31:06.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:05 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:31:06.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:05 smithi175 ceph-mon[22392]: Deploying daemon osd.4 on smithi081 2024-08-20T01:31:06.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:05 smithi079 ceph-mon[18656]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-08-20T01:31:06.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:05 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-08-20T01:31:06.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:05 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:31:06.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:05 smithi079 ceph-mon[18656]: Deploying daemon osd.4 on smithi081 2024-08-20T01:31:07.845 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:07 smithi081 ceph-mon[22209]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-20T01:31:08.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:07 smithi175 ceph-mon[22392]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-20T01:31:08.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:07 smithi079 ceph-mon[18656]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-20T01:31:10.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:09 smithi081 ceph-mon[22209]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-20T01:31:10.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:09 smithi175 ceph-mon[22392]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-20T01:31:10.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:09 smithi079 ceph-mon[18656]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-20T01:31:11.115 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:10 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:31:11.115 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:10 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:11.115 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:10 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:11.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:10 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:31:11.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:10 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:11.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:10 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:11.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:10 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:31:11.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:10 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:11.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:10 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:12.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:11 smithi175 ceph-mon[22392]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-08-20T01:31:12.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:11 smithi079 ceph-mon[18656]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-08-20T01:31:12.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:11 smithi081 ceph-mon[22209]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-08-20T01:31:12.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:31:12.924+0000 7f53d57fa640 1 -- 172.21.15.81:0/515777655 <== mgr.14150 v2:172.21.15.79:6800/3038112779 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f53d80632c0 con 0x7f53c00b3c50 2024-08-20T01:31:12.926 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 4 on host 'smithi081' 2024-08-20T01:31:12.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:31:12.926+0000 7f53de9d4640 1 -- 172.21.15.81:0/515777655 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f53c00b3c50 msgr2=0x7f53c00b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:12.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:31:12.926+0000 7f53de9d4640 1 --2- 172.21.15.81:0/515777655 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f53c00b3c50 0x7f53c00b6110 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f53d806c0b0 tx=0x7f53cc00b390 comp rx=0 tx=0).stop 2024-08-20T01:31:12.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:31:12.926+0000 7f53de9d4640 1 -- 172.21.15.81:0/515777655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53d806bc00 msgr2=0x7f53d8102a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:12.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:31:12.926+0000 7f53de9d4640 1 --2- 172.21.15.81:0/515777655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53d806bc00 0x7f53d8102a40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f53c800b4a0 tx=0x7f53c800b960 comp rx=0 tx=0).stop 2024-08-20T01:31:12.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:31:12.926+0000 7f53de9d4640 1 -- 172.21.15.81:0/515777655 shutdown_connections 2024-08-20T01:31:12.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:31:12.926+0000 7f53de9d4640 1 --2- 172.21.15.81:0/515777655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53d8108450 0x7f53d81017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:12.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:31:12.926+0000 7f53de9d4640 1 --2- 172.21.15.81:0/515777655 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f53c00b3c50 0x7f53c00b6110 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:12.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:31:12.926+0000 7f53de9d4640 1 --2- 172.21.15.81:0/515777655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53d81058a0 0x7f53d81012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:12.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:31:12.926+0000 7f53de9d4640 1 --2- 172.21.15.81:0/515777655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53d806bc00 0x7f53d8102a40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:12.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:31:12.926+0000 7f53de9d4640 1 -- 172.21.15.81:0/515777655 >> 172.21.15.81:0/515777655 conn(0x7f53d80fcf00 msgr2=0x7f53d8103bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:12.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:31:12.927+0000 7f53de9d4640 1 -- 172.21.15.81:0/515777655 shutdown_connections 2024-08-20T01:31:12.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:31:12.927+0000 7f53de9d4640 1 -- 172.21.15.81:0/515777655 wait complete. 2024-08-20T01:31:13.564 DEBUG:teuthology.orchestra.run.smithi081:osd.4> sudo journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@osd.4.service 2024-08-20T01:31:13.567 INFO:tasks.cephadm:Deploying osd.5 on smithi175 with /dev/vg_nvme/lv_3... 2024-08-20T01:31:13.567 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-20T01:31:13.820 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T01:31:14.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:13 smithi079 ceph-mon[18656]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-08-20T01:31:14.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:13 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:14.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:13 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:14.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:13 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:14.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:13 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:14.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:13 smithi175 ceph-mon[22392]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-08-20T01:31:14.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:13 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:14.226 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:13 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:14.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:13 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:14.227 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:13 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:14.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:13 smithi081 ceph-mon[22209]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-08-20T01:31:14.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:13 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:14.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:13 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:14.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:13 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:14.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:13 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:16.109 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:15 smithi081 ceph-mon[22209]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-08-20T01:31:16.110 INFO:journalctl@ceph.osd.4.smithi081.stdout:Aug 20 01:31:15 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-4[33060]: 2024-08-20T01:31:15.920+0000 7ffbe5a3b640 -1 osd.4 0 log_to_monitors true 2024-08-20T01:31:16.174 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:15 smithi175 ceph-mon[22392]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-08-20T01:31:16.174 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-08-20T01:31:16.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:15 smithi079 ceph-mon[18656]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-08-20T01:31:16.199 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi175:vg_nvme/lv_3 2024-08-20T01:31:16.454 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T01:31:16.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:16.831+0000 7f143ac06640 1 -- 172.21.15.175:0/3361422127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14341038b0 msgr2=0x7f1434103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:16.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:16.831+0000 7f143ac06640 1 --2- 172.21.15.175:0/3361422127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14341038b0 0x7f1434103d30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1420009960 tx=0x7f142002a460 comp rx=0 tx=0).stop 2024-08-20T01:31:16.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:16.831+0000 7f143ac06640 1 -- 172.21.15.175:0/3361422127 shutdown_connections 2024-08-20T01:31:16.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:16.831+0000 7f143ac06640 1 --2- 172.21.15.175:0/3361422127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1434104270 0x7f143410abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:16.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:16.831+0000 7f143ac06640 1 --2- 172.21.15.175:0/3361422127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14341038b0 0x7f1434103d30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:16.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:16.831+0000 7f143ac06640 1 --2- 172.21.15.175:0/3361422127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1434102750 0x7f1434102b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:16.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:16.831+0000 7f143ac06640 1 -- 172.21.15.175:0/3361422127 >> 172.21.15.175:0/3361422127 conn(0x7f14340fe020 msgr2=0x7f1434100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:16.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:16.831+0000 7f143ac06640 1 -- 172.21.15.175:0/3361422127 shutdown_connections 2024-08-20T01:31:16.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:16.831+0000 7f143ac06640 1 -- 172.21.15.175:0/3361422127 wait complete. 2024-08-20T01:31:16.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:16.832+0000 7f143ac06640 1 Processor -- start 2024-08-20T01:31:16.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:16.832+0000 7f143ac06640 1 -- start start 2024-08-20T01:31:16.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:16.832+0000 7f143ac06640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1434102750 0x7f1434198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:16.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:16.832+0000 7f143ac06640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14341038b0 0x7f1434199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:16.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:16.832+0000 7f143ac06640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1434104270 0x7f1434199db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:16.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:16.832+0000 7f143ac06640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f143410e2e0 con 0x7f14341038b0 2024-08-20T01:31:16.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:16.832+0000 7f143ac06640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f143410e160 con 0x7f1434102750 2024-08-20T01:31:16.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:16.832+0000 7f143ac06640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f143410e460 con 0x7f1434104270 2024-08-20T01:31:16.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:16.832+0000 7f14391a3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1434104270 0x7f1434199db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:16.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:16.832+0000 7f14391a3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1434104270 0x7f1434199db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50872/0 (socket says 172.21.15.175:50872) 2024-08-20T01:31:16.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:16.832+0000 7f14391a3640 1 -- 172.21.15.175:0/2085784447 learned_addr learned my addr 172.21.15.175:0/2085784447 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-08-20T01:31:16.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:16.832+0000 7f1433fff640 1 --2- 172.21.15.175:0/2085784447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14341038b0 0x7f1434199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:16.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:16.833+0000 7f14389a2640 1 --2- 172.21.15.175:0/2085784447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1434102750 0x7f1434198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:16.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:16.833+0000 7f14391a3640 1 -- 172.21.15.175:0/2085784447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1434102750 msgr2=0x7f1434198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:16.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:16.833+0000 7f14391a3640 1 --2- 172.21.15.175:0/2085784447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1434102750 0x7f1434198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:16.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:16.833+0000 7f14391a3640 1 -- 172.21.15.175:0/2085784447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14341038b0 msgr2=0x7f1434199170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:16.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:16.833+0000 7f14391a3640 1 --2- 172.21.15.175:0/2085784447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14341038b0 0x7f1434199170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:16.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:16.833+0000 7f14391a3640 1 -- 172.21.15.175:0/2085784447 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f143419a650 con 0x7f1434104270 2024-08-20T01:31:16.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:16.833+0000 7f14391a3640 1 --2- 172.21.15.175:0/2085784447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1434104270 0x7f1434199db0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f142c00b970 tx=0x7f142c00be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:16.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:16.833+0000 7f1431ffb640 1 -- 172.21.15.175:0/2085784447 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f142c019070 con 0x7f1434104270 2024-08-20T01:31:16.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:16.833+0000 7f1431ffb640 1 -- 172.21.15.175:0/2085784447 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f142c014440 con 0x7f1434104270 2024-08-20T01:31:16.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:16.833+0000 7f143ac06640 1 -- 172.21.15.175:0/2085784447 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f143419a940 con 0x7f1434104270 2024-08-20T01:31:16.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:16.833+0000 7f1431ffb640 1 -- 172.21.15.175:0/2085784447 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f142c0075d0 con 0x7f1434104270 2024-08-20T01:31:16.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:16.833+0000 7f143ac06640 1 -- 172.21.15.175:0/2085784447 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14341a1020 con 0x7f1434104270 2024-08-20T01:31:16.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:16.835+0000 7f143ac06640 1 -- 172.21.15.175:0/2085784447 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1434109bc0 con 0x7f1434104270 2024-08-20T01:31:16.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:16.837+0000 7f1431ffb640 1 -- 172.21.15.175:0/2085784447 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f142c01c070 con 0x7f1434104270 2024-08-20T01:31:16.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:16.837+0000 7f1431ffb640 1 --2- 172.21.15.175:0/2085784447 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f14240b3c50 0x7f14240b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:16.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:16.838+0000 7f1431ffb640 1 -- 172.21.15.175:0/2085784447 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3784+0+0 (secure 0 0 0) 0x7f142c0e1f60 con 0x7f1434104270 2024-08-20T01:31:16.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:16.838+0000 7f14389a2640 1 --2- 172.21.15.175:0/2085784447 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f14240b3c50 0x7f14240b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:16.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:16.838+0000 7f14389a2640 1 --2- 172.21.15.175:0/2085784447 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f14240b3c50 0x7f14240b6110 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f14280058c0 tx=0x7f142800a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:16.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:16.845+0000 7f1431ffb640 1 -- 172.21.15.175:0/2085784447 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f142c0aa110 con 0x7f1434104270 2024-08-20T01:31:16.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:16 smithi079 ceph-mon[18656]: from='osd.4 [v2:172.21.15.81:6808/306873968,v1:172.21.15.81:6809/306873968]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-20T01:31:16.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:16 smithi079 ceph-mon[18656]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-20T01:31:16.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:16 smithi079 ceph-mon[18656]: Detected new or changed devices on smithi081 2024-08-20T01:31:16.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:16 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:16.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:16 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:16.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:16 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T01:31:16.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:16 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-20T01:31:16.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:16 smithi079 ceph-mon[18656]: Adjusting osd_memory_target on smithi081 to 8544M 2024-08-20T01:31:16.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:16 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:16.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:16 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:31:16.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:16 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:31:16.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:16 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:16.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:16 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:31:16.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:16 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:31:16.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:16 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:31:16.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:16 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:17.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:17.039+0000 7f143ac06640 1 -- 172.21.15.175:0/2085784447 --> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f14340632c0 con 0x7f14240b3c50 2024-08-20T01:31:17.041 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:16 smithi175 ceph-mon[22392]: from='osd.4 [v2:172.21.15.81:6808/306873968,v1:172.21.15.81:6809/306873968]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-20T01:31:17.041 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:16 smithi175 ceph-mon[22392]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-20T01:31:17.041 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:16 smithi175 ceph-mon[22392]: Detected new or changed devices on smithi081 2024-08-20T01:31:17.041 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:16 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:17.041 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:16 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:17.041 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:16 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T01:31:17.041 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:16 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-20T01:31:17.041 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:16 smithi175 ceph-mon[22392]: Adjusting osd_memory_target on smithi081 to 8544M 2024-08-20T01:31:17.042 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:16 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:17.042 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:16 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:31:17.042 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:16 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:31:17.042 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:16 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:17.042 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:16 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:31:17.042 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:16 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:31:17.042 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:16 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:31:17.042 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:16 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:17.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:16 smithi081 ceph-mon[22209]: from='osd.4 [v2:172.21.15.81:6808/306873968,v1:172.21.15.81:6809/306873968]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-20T01:31:17.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:16 smithi081 ceph-mon[22209]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-20T01:31:17.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:16 smithi081 ceph-mon[22209]: Detected new or changed devices on smithi081 2024-08-20T01:31:17.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:16 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:17.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:16 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:17.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:16 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T01:31:17.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:16 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-20T01:31:17.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:16 smithi081 ceph-mon[22209]: Adjusting osd_memory_target on smithi081 to 8544M 2024-08-20T01:31:17.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:16 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:17.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:16 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:31:17.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:16 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:31:17.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:16 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:17.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:16 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:31:17.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:16 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:31:17.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:16 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:31:17.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:16 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:18.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:17 smithi175 ceph-mon[22392]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-08-20T01:31:18.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:17 smithi175 ceph-mon[22392]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-20T01:31:18.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:17 smithi175 ceph-mon[22392]: osdmap e26: 5 total, 4 up, 5 in 2024-08-20T01:31:18.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:17 smithi175 ceph-mon[22392]: from='osd.4 [v2:172.21.15.81:6808/306873968,v1:172.21.15.81:6809/306873968]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-08-20T01:31:18.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:17 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T01:31:18.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:17 smithi175 ceph-mon[22392]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-08-20T01:31:18.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:17 smithi175 ceph-mon[22392]: from='client.24325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:31:18.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:17 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:31:18.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:17 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:31:18.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:17 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:31:18.277 INFO:journalctl@ceph.osd.4.smithi081.stdout:Aug 20 01:31:17 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-4[33060]: 2024-08-20T01:31:17.944+0000 7ffbe19be640 -1 osd.4 0 waiting for initial osdmap 2024-08-20T01:31:18.277 INFO:journalctl@ceph.osd.4.smithi081.stdout:Aug 20 01:31:17 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-4[33060]: 2024-08-20T01:31:17.951+0000 7ffbdd7e5640 -1 osd.4 27 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-20T01:31:18.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:17 smithi081 ceph-mon[22209]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-08-20T01:31:18.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:17 smithi081 ceph-mon[22209]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-20T01:31:18.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:17 smithi081 ceph-mon[22209]: osdmap e26: 5 total, 4 up, 5 in 2024-08-20T01:31:18.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:17 smithi081 ceph-mon[22209]: from='osd.4 [v2:172.21.15.81:6808/306873968,v1:172.21.15.81:6809/306873968]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-08-20T01:31:18.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:17 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T01:31:18.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:17 smithi081 ceph-mon[22209]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-08-20T01:31:18.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:17 smithi081 ceph-mon[22209]: from='client.24325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:31:18.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:17 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:31:18.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:17 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:31:18.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:17 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:31:18.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:17 smithi079 ceph-mon[18656]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-08-20T01:31:18.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:17 smithi079 ceph-mon[18656]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-20T01:31:18.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:17 smithi079 ceph-mon[18656]: osdmap e26: 5 total, 4 up, 5 in 2024-08-20T01:31:18.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:17 smithi079 ceph-mon[18656]: from='osd.4 [v2:172.21.15.81:6808/306873968,v1:172.21.15.81:6809/306873968]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-08-20T01:31:18.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:17 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T01:31:18.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:17 smithi079 ceph-mon[18656]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-08-20T01:31:18.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:17 smithi079 ceph-mon[18656]: from='client.24325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:31:18.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:17 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:31:18.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:17 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:31:18.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:17 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:31:19.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:18 smithi081 ceph-mon[22209]: purged_snaps scrub starts 2024-08-20T01:31:19.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:18 smithi081 ceph-mon[22209]: purged_snaps scrub ok 2024-08-20T01:31:19.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:18 smithi081 ceph-mon[22209]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-08-20T01:31:19.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:18 smithi081 ceph-mon[22209]: osdmap e27: 5 total, 4 up, 5 in 2024-08-20T01:31:19.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:18 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T01:31:19.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:18 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T01:31:19.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:18 smithi175 ceph-mon[22392]: purged_snaps scrub starts 2024-08-20T01:31:19.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:18 smithi175 ceph-mon[22392]: purged_snaps scrub ok 2024-08-20T01:31:19.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:18 smithi175 ceph-mon[22392]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-08-20T01:31:19.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:18 smithi175 ceph-mon[22392]: osdmap e27: 5 total, 4 up, 5 in 2024-08-20T01:31:19.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:18 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T01:31:19.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:18 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T01:31:19.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:18 smithi079 ceph-mon[18656]: purged_snaps scrub starts 2024-08-20T01:31:19.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:18 smithi079 ceph-mon[18656]: purged_snaps scrub ok 2024-08-20T01:31:19.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:18 smithi079 ceph-mon[18656]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-08-20T01:31:19.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:18 smithi079 ceph-mon[18656]: osdmap e27: 5 total, 4 up, 5 in 2024-08-20T01:31:19.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:18 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T01:31:19.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:18 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T01:31:20.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:19 smithi175 ceph-mon[22392]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-08-20T01:31:20.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:19 smithi175 ceph-mon[22392]: osd.4 [v2:172.21.15.81:6808/306873968,v1:172.21.15.81:6809/306873968] boot 2024-08-20T01:31:20.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:19 smithi175 ceph-mon[22392]: osdmap e28: 5 total, 5 up, 5 in 2024-08-20T01:31:20.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:19 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T01:31:20.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:19 smithi175 ceph-mon[22392]: from='client.? 172.21.15.175:0/2419814310' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6394e462-4510-45d6-bc99-8660085cb206"} : dispatch 2024-08-20T01:31:20.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:19 smithi175 ceph-mon[22392]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6394e462-4510-45d6-bc99-8660085cb206"} : dispatch 2024-08-20T01:31:20.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:19 smithi175 ceph-mon[22392]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6394e462-4510-45d6-bc99-8660085cb206"}]': finished 2024-08-20T01:31:20.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:19 smithi175 ceph-mon[22392]: osdmap e29: 6 total, 5 up, 6 in 2024-08-20T01:31:20.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:19 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:31:20.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:19 smithi175 ceph-mon[22392]: from='client.? 172.21.15.175:0/3344875535' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:31:20.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:19 smithi081 ceph-mon[22209]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-08-20T01:31:20.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:19 smithi081 ceph-mon[22209]: osd.4 [v2:172.21.15.81:6808/306873968,v1:172.21.15.81:6809/306873968] boot 2024-08-20T01:31:20.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:19 smithi081 ceph-mon[22209]: osdmap e28: 5 total, 5 up, 5 in 2024-08-20T01:31:20.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:19 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T01:31:20.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:19 smithi081 ceph-mon[22209]: from='client.? 172.21.15.175:0/2419814310' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6394e462-4510-45d6-bc99-8660085cb206"} : dispatch 2024-08-20T01:31:20.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:19 smithi081 ceph-mon[22209]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6394e462-4510-45d6-bc99-8660085cb206"} : dispatch 2024-08-20T01:31:20.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:19 smithi081 ceph-mon[22209]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6394e462-4510-45d6-bc99-8660085cb206"}]': finished 2024-08-20T01:31:20.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:19 smithi081 ceph-mon[22209]: osdmap e29: 6 total, 5 up, 6 in 2024-08-20T01:31:20.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:19 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:31:20.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:19 smithi081 ceph-mon[22209]: from='client.? 172.21.15.175:0/3344875535' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:31:20.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:19 smithi079 ceph-mon[18656]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-08-20T01:31:20.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:19 smithi079 ceph-mon[18656]: osd.4 [v2:172.21.15.81:6808/306873968,v1:172.21.15.81:6809/306873968] boot 2024-08-20T01:31:20.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:19 smithi079 ceph-mon[18656]: osdmap e28: 5 total, 5 up, 5 in 2024-08-20T01:31:20.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:19 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T01:31:20.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:19 smithi079 ceph-mon[18656]: from='client.? 172.21.15.175:0/2419814310' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6394e462-4510-45d6-bc99-8660085cb206"} : dispatch 2024-08-20T01:31:20.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:19 smithi079 ceph-mon[18656]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6394e462-4510-45d6-bc99-8660085cb206"} : dispatch 2024-08-20T01:31:20.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:19 smithi079 ceph-mon[18656]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6394e462-4510-45d6-bc99-8660085cb206"}]': finished 2024-08-20T01:31:20.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:19 smithi079 ceph-mon[18656]: osdmap e29: 6 total, 5 up, 6 in 2024-08-20T01:31:20.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:19 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:31:20.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:19 smithi079 ceph-mon[18656]: from='client.? 172.21.15.175:0/3344875535' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:31:21.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:21 smithi175 ceph-mon[22392]: osdmap e30: 6 total, 5 up, 6 in 2024-08-20T01:31:21.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:21 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:31:21.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:21 smithi079 ceph-mon[18656]: osdmap e30: 6 total, 5 up, 6 in 2024-08-20T01:31:21.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:21 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:31:21.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:21 smithi081 ceph-mon[22209]: osdmap e30: 6 total, 5 up, 6 in 2024-08-20T01:31:21.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:21 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:31:22.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:22 smithi175 ceph-mon[22392]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:31:22.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:22 smithi079 ceph-mon[18656]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:31:22.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:22 smithi081 ceph-mon[22209]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:31:24.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:24 smithi175 ceph-mon[22392]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:31:24.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:24 smithi079 ceph-mon[18656]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:31:24.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:24 smithi081 ceph-mon[22209]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:31:26.625 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:26 smithi175 ceph-mon[22392]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:31:26.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:26 smithi079 ceph-mon[18656]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:31:26.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:26 smithi081 ceph-mon[22209]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:31:28.542 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:28 smithi175 ceph-mon[22392]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:31:28.542 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:28 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-08-20T01:31:28.542 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:28 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:31:28.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:28 smithi079 ceph-mon[18656]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:31:28.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:28 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-08-20T01:31:28.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:28 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:31:28.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:28 smithi081 ceph-mon[22209]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:31:28.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:28 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-08-20T01:31:28.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:28 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:31:29.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:29 smithi175 ceph-mon[22392]: Deploying daemon osd.5 on smithi175 2024-08-20T01:31:29.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:29 smithi079 ceph-mon[18656]: Deploying daemon osd.5 on smithi175 2024-08-20T01:31:29.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:29 smithi081 ceph-mon[22209]: Deploying daemon osd.5 on smithi175 2024-08-20T01:31:30.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:30 smithi175 ceph-mon[22392]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:31:30.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:30 smithi079 ceph-mon[18656]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:31:30.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:30 smithi081 ceph-mon[22209]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:31:32.471 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:32 smithi175 ceph-mon[22392]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:31:32.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:32 smithi079 ceph-mon[18656]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:31:32.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:32 smithi081 ceph-mon[22209]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:31:33.630 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:33 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:31:33.630 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:33 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:33.630 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:33 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:33.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:33 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:31:33.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:33 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:33.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:33 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:33.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:33 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:31:33.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:33 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:33.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:33 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:34.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:34 smithi175 ceph-mon[22392]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:31:34.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:34 smithi079 ceph-mon[18656]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:31:34.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:34 smithi081 ceph-mon[22209]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:31:36.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:36 smithi175 ceph-mon[22392]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:31:36.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:36 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:36.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:36 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:36.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:36 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:31:36.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:36 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:31:36.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:36 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:36.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:36.438+0000 7f1431ffb640 1 -- 172.21.15.175:0/2085784447 <== mgr.14150 v2:172.21.15.79:6800/3038112779 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f14340632c0 con 0x7f14240b3c50 2024-08-20T01:31:36.441 INFO:teuthology.orchestra.run.smithi175.stdout:Created osd(s) 5 on host 'smithi175' 2024-08-20T01:31:36.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:36.442+0000 7f143ac06640 1 -- 172.21.15.175:0/2085784447 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f14240b3c50 msgr2=0x7f14240b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:36.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:36.442+0000 7f143ac06640 1 --2- 172.21.15.175:0/2085784447 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f14240b3c50 0x7f14240b6110 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f14280058c0 tx=0x7f142800a4c0 comp rx=0 tx=0).stop 2024-08-20T01:31:36.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:36.442+0000 7f143ac06640 1 -- 172.21.15.175:0/2085784447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1434104270 msgr2=0x7f1434199db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:36.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:36.442+0000 7f143ac06640 1 --2- 172.21.15.175:0/2085784447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1434104270 0x7f1434199db0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f142c00b970 tx=0x7f142c00be30 comp rx=0 tx=0).stop 2024-08-20T01:31:36.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:36.442+0000 7f143ac06640 1 -- 172.21.15.175:0/2085784447 shutdown_connections 2024-08-20T01:31:36.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:36.442+0000 7f143ac06640 1 --2- 172.21.15.175:0/2085784447 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f14240b3c50 0x7f14240b6110 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:36.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:36.442+0000 7f143ac06640 1 --2- 172.21.15.175:0/2085784447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1434104270 0x7f1434199db0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:36.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:36.442+0000 7f143ac06640 1 --2- 172.21.15.175:0/2085784447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14341038b0 0x7f1434199170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:36.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:36.442+0000 7f143ac06640 1 --2- 172.21.15.175:0/2085784447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1434102750 0x7f1434198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:36.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:36.442+0000 7f143ac06640 1 -- 172.21.15.175:0/2085784447 >> 172.21.15.175:0/2085784447 conn(0x7f14340fe020 msgr2=0x7f1434106d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:36.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:36.442+0000 7f143ac06640 1 -- 172.21.15.175:0/2085784447 shutdown_connections 2024-08-20T01:31:36.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:31:36.442+0000 7f143ac06640 1 -- 172.21.15.175:0/2085784447 wait complete. 2024-08-20T01:31:36.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:36 smithi079 ceph-mon[18656]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:31:36.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:36 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:36.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:36 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:36.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:36 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:31:36.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:36 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:31:36.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:36 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:36.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:36 smithi081 ceph-mon[22209]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:31:36.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:36 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:36.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:36 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:36.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:36 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:31:36.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:36 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:31:36.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:36 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:36.984 DEBUG:teuthology.orchestra.run.smithi175:osd.5> sudo journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@osd.5.service 2024-08-20T01:31:36.986 INFO:tasks.cephadm:Deploying osd.6 on smithi079 with /dev/vg_nvme/lv_2... 2024-08-20T01:31:36.986 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-20T01:31:37.240 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:31:37.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:37 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:31:37.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:37 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:37.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:37 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:37.675 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:37 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:31:37.676 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:37 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:37.676 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:37 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:37.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:37 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:31:37.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:37 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:37.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:37 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:38.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:38 smithi175 ceph-mon[22392]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:31:38.605 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:38 smithi079 ceph-mon[18656]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:31:38.765 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:38 smithi081 ceph-mon[22209]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:31:38.985 INFO:journalctl@ceph.osd.5.smithi175.stdout:Aug 20 01:31:38 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-5[33904]: 2024-08-20T01:31:38.878+0000 7f93cd5a1640 -1 osd.5 0 log_to_monitors true 2024-08-20T01:31:39.517 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:39 smithi079 ceph-mon[18656]: from='osd.5 [v2:172.21.15.175:6808/3908133424,v1:172.21.15.175:6809/3908133424]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-20T01:31:39.517 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:39 smithi079 ceph-mon[18656]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-20T01:31:39.578 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:39 smithi175 ceph-mon[22392]: from='osd.5 [v2:172.21.15.175:6808/3908133424,v1:172.21.15.175:6809/3908133424]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-20T01:31:39.578 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:39 smithi175 ceph-mon[22392]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-20T01:31:39.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:39 smithi081 ceph-mon[22209]: from='osd.5 [v2:172.21.15.175:6808/3908133424,v1:172.21.15.175:6809/3908133424]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-20T01:31:39.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:39 smithi081 ceph-mon[22209]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-20T01:31:39.891 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:31:39.917 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi079:vg_nvme/lv_2 2024-08-20T01:31:40.168 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:31:40.583 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:40 smithi079 ceph-mon[18656]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:31:40.583 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:40 smithi079 ceph-mon[18656]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-20T01:31:40.583 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:40 smithi079 ceph-mon[18656]: osdmap e31: 6 total, 5 up, 6 in 2024-08-20T01:31:40.583 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:40 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:31:40.583 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:40 smithi079 ceph-mon[18656]: from='osd.5 [v2:172.21.15.175:6808/3908133424,v1:172.21.15.175:6809/3908133424]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-08-20T01:31:40.584 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:40 smithi079 ceph-mon[18656]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-08-20T01:31:40.584 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:40 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:40.584 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:40 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:40.584 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:40 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T01:31:40.584 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:40 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-20T01:31:40.584 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:40 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:40.584 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:40 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:31:40.584 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:40 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:31:40.584 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:40 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:40.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:40 smithi175 ceph-mon[22392]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:31:40.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:40 smithi175 ceph-mon[22392]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-20T01:31:40.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:40 smithi175 ceph-mon[22392]: osdmap e31: 6 total, 5 up, 6 in 2024-08-20T01:31:40.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:40 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:31:40.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:40 smithi175 ceph-mon[22392]: from='osd.5 [v2:172.21.15.175:6808/3908133424,v1:172.21.15.175:6809/3908133424]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-08-20T01:31:40.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:40 smithi175 ceph-mon[22392]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-08-20T01:31:40.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:40 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:40.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:40 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:40.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:40 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T01:31:40.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:40 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-20T01:31:40.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:40 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:40.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:40 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:31:40.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:40 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:31:40.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:40 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:40.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:31:40.664+0000 7f78e7119640 1 -- 172.21.15.79:0/2436551702 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78e0104260 msgr2=0x7f78e010abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:40.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:31:40.664+0000 7f78e7119640 1 --2- 172.21.15.79:0/2436551702 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78e0104260 0x7f78e010abe0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f78d8009cd0 tx=0x7f78d802a8e0 comp rx=0 tx=0).stop 2024-08-20T01:31:40.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:31:40.664+0000 7f78e7119640 1 -- 172.21.15.79:0/2436551702 shutdown_connections 2024-08-20T01:31:40.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:31:40.664+0000 7f78e7119640 1 --2- 172.21.15.79:0/2436551702 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78e0104260 0x7f78e010abe0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:40.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:31:40.664+0000 7f78e7119640 1 --2- 172.21.15.79:0/2436551702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78e01038a0 0x7f78e0103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:40.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:31:40.664+0000 7f78e7119640 1 --2- 172.21.15.79:0/2436551702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78e0102740 0x7f78e0102b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:40.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:31:40.664+0000 7f78e7119640 1 -- 172.21.15.79:0/2436551702 >> 172.21.15.79:0/2436551702 conn(0x7f78e00fdff0 msgr2=0x7f78e0100450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:31:40.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:31:40.664+0000 7f78e7119640 1 -- 172.21.15.79:0/2436551702 shutdown_connections 2024-08-20T01:31:40.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:31:40.664+0000 7f78e7119640 1 -- 172.21.15.79:0/2436551702 wait complete. 2024-08-20T01:31:40.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:31:40.664+0000 7f78e7119640 1 Processor -- start 2024-08-20T01:31:40.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:31:40.665+0000 7f78e7119640 1 -- start start 2024-08-20T01:31:40.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:31:40.665+0000 7f78e7119640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78e0102740 0x7f78e019ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:40.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:31:40.665+0000 7f78e7119640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78e01038a0 0x7f78e019b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:40.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:31:40.665+0000 7f78e7119640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78e0104260 0x7f78e019bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:40.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:31:40.665+0000 7f78e7119640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f78e010e2d0 con 0x7f78e01038a0 2024-08-20T01:31:40.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:31:40.665+0000 7f78e7119640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f78e010e150 con 0x7f78e0104260 2024-08-20T01:31:40.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:31:40.665+0000 7f78e7119640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f78e010e450 con 0x7f78e0102740 2024-08-20T01:31:40.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:31:40.665+0000 7f78dffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78e01038a0 0x7f78e019b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:40.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:31:40.665+0000 7f78dffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78e01038a0 0x7f78e019b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55454/0 (socket says 172.21.15.79:55454) 2024-08-20T01:31:40.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:31:40.665+0000 7f78dffff640 1 -- 172.21.15.79:0/549953553 learned_addr learned my addr 172.21.15.79:0/549953553 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:31:40.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:31:40.665+0000 7f78e4eb5640 1 --2- 172.21.15.79:0/549953553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78e0102740 0x7f78e019ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:40.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:31:40.665+0000 7f78e56b6640 1 --2- 172.21.15.79:0/549953553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78e0104260 0x7f78e019bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:40.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:31:40.665+0000 7f78dffff640 1 -- 172.21.15.79:0/549953553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78e0102740 msgr2=0x7f78e019ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:40.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:31:40.665+0000 7f78dffff640 1 --2- 172.21.15.79:0/549953553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78e0102740 0x7f78e019ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:40.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:31:40.665+0000 7f78dffff640 1 -- 172.21.15.79:0/549953553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78e0104260 msgr2=0x7f78e019bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:31:40.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:31:40.665+0000 7f78dffff640 1 --2- 172.21.15.79:0/549953553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78e0104260 0x7f78e019bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:31:40.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:31:40.665+0000 7f78dffff640 1 -- 172.21.15.79:0/549953553 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78e019c790 con 0x7f78e01038a0 2024-08-20T01:31:40.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:31:40.665+0000 7f78dffff640 1 --2- 172.21.15.79:0/549953553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78e01038a0 0x7f78e019b2b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f78cc00d950 tx=0x7f78cc00dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:40.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:31:40.665+0000 7f78ddffb640 1 -- 172.21.15.79:0/549953553 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc017070 con 0x7f78e01038a0 2024-08-20T01:31:40.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:31:40.665+0000 7f78ddffb640 1 -- 172.21.15.79:0/549953553 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f78cc00de80 con 0x7f78e01038a0 2024-08-20T01:31:40.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:31:40.665+0000 7f78e7119640 1 -- 172.21.15.79:0/549953553 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78e019ca80 con 0x7f78e01038a0 2024-08-20T01:31:40.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:31:40.665+0000 7f78ddffb640 1 -- 172.21.15.79:0/549953553 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc00f620 con 0x7f78e01038a0 2024-08-20T01:31:40.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:31:40.666+0000 7f78e7119640 1 -- 172.21.15.79:0/549953553 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78e01a3160 con 0x7f78e01038a0 2024-08-20T01:31:40.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:31:40.667+0000 7f78e7119640 1 -- 172.21.15.79:0/549953553 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78e0102b40 con 0x7f78e01038a0 2024-08-20T01:31:40.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:31:40.668+0000 7f78ddffb640 1 -- 172.21.15.79:0/549953553 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f78cc009c30 con 0x7f78e01038a0 2024-08-20T01:31:40.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:31:40.669+0000 7f78ddffb640 1 --2- 172.21.15.79:0/549953553 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f78d00b3bd0 0x7f78d00b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:31:40.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:31:40.669+0000 7f78e4eb5640 1 --2- 172.21.15.79:0/549953553 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f78d00b3bd0 0x7f78d00b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:31:40.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:31:40.669+0000 7f78ddffb640 1 -- 172.21.15.79:0/549953553 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4253+0+0 (secure 0 0 0) 0x7f78cc0e2880 con 0x7f78e01038a0 2024-08-20T01:31:40.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:31:40.670+0000 7f78e4eb5640 1 --2- 172.21.15.79:0/549953553 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f78d00b3bd0 0x7f78d00b6090 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f78d4009990 tx=0x7f78d4009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:31:40.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:31:40.673+0000 7f78ddffb640 1 -- 172.21.15.79:0/549953553 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f78cc0aaeb0 con 0x7f78e01038a0 2024-08-20T01:31:40.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:40 smithi081 ceph-mon[22209]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:31:40.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:40 smithi081 ceph-mon[22209]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-20T01:31:40.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:40 smithi081 ceph-mon[22209]: osdmap e31: 6 total, 5 up, 6 in 2024-08-20T01:31:40.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:40 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:31:40.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:40 smithi081 ceph-mon[22209]: from='osd.5 [v2:172.21.15.175:6808/3908133424,v1:172.21.15.175:6809/3908133424]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-08-20T01:31:40.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:40 smithi081 ceph-mon[22209]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-08-20T01:31:40.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:40 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:40.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:40 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:40.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:40 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T01:31:40.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:40 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-20T01:31:40.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:40 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:40.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:40 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:31:40.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:40 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:31:40.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:40 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:40.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:31:40.854+0000 7f78e7119640 1 -- 172.21.15.79:0/549953553 --> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f78e00767d0 con 0x7f78d00b3bd0 2024-08-20T01:31:41.519 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:41 smithi079 ceph-mon[18656]: Detected new or changed devices on smithi175 2024-08-20T01:31:41.519 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:41 smithi079 ceph-mon[18656]: Adjusting osd_memory_target on smithi175 to 8544M 2024-08-20T01:31:41.519 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:41 smithi079 ceph-mon[18656]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-08-20T01:31:41.519 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:41 smithi079 ceph-mon[18656]: osdmap e32: 6 total, 5 up, 6 in 2024-08-20T01:31:41.519 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:41 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:31:41.519 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:41 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:31:41.519 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:41 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:31:41.519 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:41 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:31:41.519 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:41 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:31:41.520 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:41 smithi079 ceph-mon[18656]: from='osd.5 ' entity='osd.5' 2024-08-20T01:31:41.638 INFO:journalctl@ceph.osd.5.smithi175.stdout:Aug 20 01:31:41 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-5[33904]: 2024-08-20T01:31:41.261+0000 7f93c9524640 -1 osd.5 0 waiting for initial osdmap 2024-08-20T01:31:41.638 INFO:journalctl@ceph.osd.5.smithi175.stdout:Aug 20 01:31:41 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-5[33904]: 2024-08-20T01:31:41.465+0000 7f93c1343640 -1 osd.5 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-20T01:31:41.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:41 smithi175 ceph-mon[22392]: Detected new or changed devices on smithi175 2024-08-20T01:31:41.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:41 smithi175 ceph-mon[22392]: Adjusting osd_memory_target on smithi175 to 8544M 2024-08-20T01:31:41.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:41 smithi175 ceph-mon[22392]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-08-20T01:31:41.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:41 smithi175 ceph-mon[22392]: osdmap e32: 6 total, 5 up, 6 in 2024-08-20T01:31:41.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:41 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:31:41.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:41 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:31:41.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:41 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:31:41.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:41 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:31:41.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:41 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:31:41.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:41 smithi175 ceph-mon[22392]: from='osd.5 ' entity='osd.5' 2024-08-20T01:31:41.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:41 smithi081 ceph-mon[22209]: Detected new or changed devices on smithi175 2024-08-20T01:31:41.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:41 smithi081 ceph-mon[22209]: Adjusting osd_memory_target on smithi175 to 8544M 2024-08-20T01:31:41.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:41 smithi081 ceph-mon[22209]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-08-20T01:31:41.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:41 smithi081 ceph-mon[22209]: osdmap e32: 6 total, 5 up, 6 in 2024-08-20T01:31:41.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:41 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:31:41.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:41 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:31:41.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:41 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:31:41.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:41 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:31:41.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:41 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:31:41.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:41 smithi081 ceph-mon[22209]: from='osd.5 ' entity='osd.5' 2024-08-20T01:31:42.574 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:42 smithi079 ceph-mon[18656]: purged_snaps scrub starts 2024-08-20T01:31:42.575 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:42 smithi079 ceph-mon[18656]: purged_snaps scrub ok 2024-08-20T01:31:42.575 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:42 smithi079 ceph-mon[18656]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:31:42.575 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:42 smithi079 ceph-mon[18656]: from='client.14499 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:31:42.575 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:42 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:31:42.575 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:42 smithi079 ceph-mon[18656]: osdmap e33: 6 total, 5 up, 6 in 2024-08-20T01:31:42.575 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:42 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:31:42.575 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:42 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:31:42.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:42 smithi175 ceph-mon[22392]: purged_snaps scrub starts 2024-08-20T01:31:42.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:42 smithi175 ceph-mon[22392]: purged_snaps scrub ok 2024-08-20T01:31:42.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:42 smithi175 ceph-mon[22392]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:31:42.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:42 smithi175 ceph-mon[22392]: from='client.14499 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:31:42.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:42 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:31:42.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:42 smithi175 ceph-mon[22392]: osdmap e33: 6 total, 5 up, 6 in 2024-08-20T01:31:42.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:42 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:31:42.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:42 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:31:42.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:42 smithi081 ceph-mon[22209]: purged_snaps scrub starts 2024-08-20T01:31:42.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:42 smithi081 ceph-mon[22209]: purged_snaps scrub ok 2024-08-20T01:31:42.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:42 smithi081 ceph-mon[22209]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:31:42.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:42 smithi081 ceph-mon[22209]: from='client.14499 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:31:42.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:42 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:31:42.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:42 smithi081 ceph-mon[22209]: osdmap e33: 6 total, 5 up, 6 in 2024-08-20T01:31:42.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:42 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:31:42.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:42 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:31:43.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:43 smithi175 ceph-mon[22392]: osd.5 [v2:172.21.15.175:6808/3908133424,v1:172.21.15.175:6809/3908133424] boot 2024-08-20T01:31:43.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:43 smithi175 ceph-mon[22392]: osdmap e34: 6 total, 6 up, 6 in 2024-08-20T01:31:43.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:43 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:31:43.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:43 smithi175 ceph-mon[22392]: osdmap e35: 6 total, 6 up, 6 in 2024-08-20T01:31:43.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:43 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/461588150' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e8e51380-e2be-4c4c-82d8-d86306d9fc1f"} : dispatch 2024-08-20T01:31:43.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:43 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/461588150' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e8e51380-e2be-4c4c-82d8-d86306d9fc1f"}]': finished 2024-08-20T01:31:43.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:43 smithi175 ceph-mon[22392]: osdmap e36: 7 total, 6 up, 7 in 2024-08-20T01:31:43.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:43 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T01:31:43.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:43 smithi079 ceph-mon[18656]: osd.5 [v2:172.21.15.175:6808/3908133424,v1:172.21.15.175:6809/3908133424] boot 2024-08-20T01:31:43.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:43 smithi079 ceph-mon[18656]: osdmap e34: 6 total, 6 up, 6 in 2024-08-20T01:31:43.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:43 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:31:43.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:43 smithi079 ceph-mon[18656]: osdmap e35: 6 total, 6 up, 6 in 2024-08-20T01:31:43.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:43 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/461588150' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e8e51380-e2be-4c4c-82d8-d86306d9fc1f"} : dispatch 2024-08-20T01:31:43.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:43 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/461588150' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e8e51380-e2be-4c4c-82d8-d86306d9fc1f"}]': finished 2024-08-20T01:31:43.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:43 smithi079 ceph-mon[18656]: osdmap e36: 7 total, 6 up, 7 in 2024-08-20T01:31:43.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:43 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T01:31:43.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:43 smithi081 ceph-mon[22209]: osd.5 [v2:172.21.15.175:6808/3908133424,v1:172.21.15.175:6809/3908133424] boot 2024-08-20T01:31:43.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:43 smithi081 ceph-mon[22209]: osdmap e34: 6 total, 6 up, 6 in 2024-08-20T01:31:43.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:43 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T01:31:43.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:43 smithi081 ceph-mon[22209]: osdmap e35: 6 total, 6 up, 6 in 2024-08-20T01:31:43.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:43 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/461588150' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e8e51380-e2be-4c4c-82d8-d86306d9fc1f"} : dispatch 2024-08-20T01:31:43.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:43 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/461588150' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e8e51380-e2be-4c4c-82d8-d86306d9fc1f"}]': finished 2024-08-20T01:31:43.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:43 smithi081 ceph-mon[22209]: osdmap e36: 7 total, 6 up, 7 in 2024-08-20T01:31:43.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:43 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T01:31:44.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:44 smithi079 ceph-mon[18656]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:31:44.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:44 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2612232224' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:31:44.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:44 smithi081 ceph-mon[22209]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:31:44.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:44 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2612232224' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:31:44.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:44 smithi175 ceph-mon[22392]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-08-20T01:31:44.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:44 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2612232224' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:31:45.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:45 smithi175 ceph-mon[22392]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-20T01:31:45.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:45 smithi079 ceph-mon[18656]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-20T01:31:46.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:45 smithi081 ceph-mon[22209]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-20T01:31:47.841 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:47 smithi079 ceph-mon[18656]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-08-20T01:31:47.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:47 smithi175 ceph-mon[22392]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-08-20T01:31:48.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:47 smithi081 ceph-mon[22209]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-08-20T01:31:49.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:49 smithi175 ceph-mon[22392]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-08-20T01:31:49.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:49 smithi079 ceph-mon[18656]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-08-20T01:31:50.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:49 smithi081 ceph-mon[22209]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-08-20T01:31:51.594 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:51 smithi079 ceph-mon[18656]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-20T01:31:51.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:51 smithi175 ceph-mon[22392]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-20T01:31:52.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:51 smithi081 ceph-mon[22209]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-20T01:31:52.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:52 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-08-20T01:31:52.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:52 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:31:52.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:52 smithi079 ceph-mon[18656]: Deploying daemon osd.6 on smithi079 2024-08-20T01:31:52.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:52 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-08-20T01:31:52.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:52 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:31:52.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:52 smithi175 ceph-mon[22392]: Deploying daemon osd.6 on smithi079 2024-08-20T01:31:53.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:52 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-08-20T01:31:53.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:52 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:31:53.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:52 smithi081 ceph-mon[22209]: Deploying daemon osd.6 on smithi079 2024-08-20T01:31:53.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:53 smithi175 ceph-mon[22392]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-08-20T01:31:53.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:53 smithi079 ceph-mon[18656]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-08-20T01:31:54.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:53 smithi081 ceph-mon[22209]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-08-20T01:31:55.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:55 smithi079 ceph-mon[18656]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-08-20T01:31:55.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:55 smithi175 ceph-mon[22392]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-08-20T01:31:56.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:55 smithi081 ceph-mon[22209]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-08-20T01:31:57.665 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:57 smithi079 ceph-mon[18656]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-08-20T01:31:57.666 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:57 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:31:57.666 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:57 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:57.666 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:57 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:57.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:57 smithi175 ceph-mon[22392]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-08-20T01:31:57.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:57 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:31:57.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:57 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:57.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:57 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:58.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:57 smithi081 ceph-mon[22209]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-08-20T01:31:58.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:57 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:31:58.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:57 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:58.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:57 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:31:59.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:31:59 smithi079 ceph-mon[18656]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-08-20T01:31:59.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:31:59 smithi175 ceph-mon[22392]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-08-20T01:32:00.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:31:59 smithi081 ceph-mon[22209]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-08-20T01:32:00.693 INFO:teuthology.orchestra.run.smithi079.stdout:Created osd(s) 6 on host 'smithi079' 2024-08-20T01:32:00.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:00.691+0000 7f78ddffb640 1 -- 172.21.15.79:0/549953553 <== mgr.14150 v2:172.21.15.79:6800/3038112779 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f78e00767d0 con 0x7f78d00b3bd0 2024-08-20T01:32:00.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:00.694+0000 7f78e7119640 1 -- 172.21.15.79:0/549953553 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f78d00b3bd0 msgr2=0x7f78d00b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:00.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:00.694+0000 7f78e7119640 1 --2- 172.21.15.79:0/549953553 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f78d00b3bd0 0x7f78d00b6090 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f78d4009990 tx=0x7f78d4009110 comp rx=0 tx=0).stop 2024-08-20T01:32:00.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:00.694+0000 7f78e7119640 1 -- 172.21.15.79:0/549953553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78e01038a0 msgr2=0x7f78e019b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:00.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:00.694+0000 7f78e7119640 1 --2- 172.21.15.79:0/549953553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78e01038a0 0x7f78e019b2b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f78cc00d950 tx=0x7f78cc00dd50 comp rx=0 tx=0).stop 2024-08-20T01:32:00.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:00.694+0000 7f78e7119640 1 -- 172.21.15.79:0/549953553 shutdown_connections 2024-08-20T01:32:00.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:00.694+0000 7f78e7119640 1 --2- 172.21.15.79:0/549953553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78e0104260 0x7f78e019bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:00.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:00.694+0000 7f78e7119640 1 --2- 172.21.15.79:0/549953553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78e01038a0 0x7f78e019b2b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:00.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:00.694+0000 7f78e7119640 1 --2- 172.21.15.79:0/549953553 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f78d00b3bd0 0x7f78d00b6090 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:00.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:00.694+0000 7f78e7119640 1 --2- 172.21.15.79:0/549953553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78e0102740 0x7f78e019ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:00.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:00.694+0000 7f78e7119640 1 -- 172.21.15.79:0/549953553 >> 172.21.15.79:0/549953553 conn(0x7f78e00fdff0 msgr2=0x7f78e00750b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:00.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:00.694+0000 7f78e7119640 1 -- 172.21.15.79:0/549953553 shutdown_connections 2024-08-20T01:32:00.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:00.694+0000 7f78e7119640 1 -- 172.21.15.79:0/549953553 wait complete. 2024-08-20T01:32:00.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:00 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:00.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:00 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:00.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:00 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:32:00.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:00 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:32:00.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:00 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:00.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:00 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:00.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:00 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:00.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:00 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:32:00.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:00 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:32:00.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:00 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:01.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:00 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:01.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:00 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:01.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:00 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:32:01.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:00 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:32:01.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:00 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:01.433 DEBUG:teuthology.orchestra.run.smithi079:osd.6> sudo journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@osd.6.service 2024-08-20T01:32:01.435 INFO:tasks.cephadm:Deploying osd.7 on smithi081 with /dev/vg_nvme/lv_2... 2024-08-20T01:32:01.435 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-20T01:32:01.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:01 smithi079 ceph-mon[18656]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-08-20T01:32:01.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:01 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:32:01.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:01 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:01.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:01 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:01.690 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.b/config 2024-08-20T01:32:01.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:01 smithi081 ceph-mon[22209]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-08-20T01:32:01.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:01 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:32:01.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:01 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:01.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:01 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:01.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:01 smithi175 ceph-mon[22392]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-08-20T01:32:01.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:01 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:32:01.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:01 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:01.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:01 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:03.186 INFO:journalctl@ceph.osd.6.smithi079.stdout:Aug 20 01:32:02 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-6[45200]: 2024-08-20T01:32:02.986+0000 7fa05e382640 -1 osd.6 0 log_to_monitors true 2024-08-20T01:32:03.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:03 smithi175 ceph-mon[22392]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-08-20T01:32:03.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:03 smithi175 ceph-mon[22392]: from='osd.6 [v2:172.21.15.79:6818/3379368280,v1:172.21.15.79:6819/3379368280]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-08-20T01:32:03.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:03 smithi079 ceph-mon[18656]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-08-20T01:32:03.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:03 smithi079 ceph-mon[18656]: from='osd.6 [v2:172.21.15.79:6818/3379368280,v1:172.21.15.79:6819/3379368280]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-08-20T01:32:04.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:03 smithi081 ceph-mon[22209]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-08-20T01:32:04.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:03 smithi081 ceph-mon[22209]: from='osd.6 [v2:172.21.15.79:6818/3379368280,v1:172.21.15.79:6819/3379368280]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-08-20T01:32:04.250 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-08-20T01:32:04.276 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi081:vg_nvme/lv_2 2024-08-20T01:32:04.530 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.b/config 2024-08-20T01:32:04.827 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:04 smithi081 ceph-mon[22209]: from='osd.6 [v2:172.21.15.79:6818/3379368280,v1:172.21.15.79:6819/3379368280]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-20T01:32:04.828 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:04 smithi081 ceph-mon[22209]: osdmap e37: 7 total, 6 up, 7 in 2024-08-20T01:32:04.828 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:04 smithi081 ceph-mon[22209]: from='osd.6 [v2:172.21.15.79:6818/3379368280,v1:172.21.15.79:6819/3379368280]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-08-20T01:32:04.828 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:04 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T01:32:04.828 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:04 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:04.828 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:04 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:04.828 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:04 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T01:32:04.828 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:04 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-20T01:32:04.828 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:04 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-20T01:32:04.828 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:04 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:04.828 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:04 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:32:04.829 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:04 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:32:04.829 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:04 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:04.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:04 smithi175 ceph-mon[22392]: from='osd.6 [v2:172.21.15.79:6818/3379368280,v1:172.21.15.79:6819/3379368280]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-20T01:32:04.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:04 smithi175 ceph-mon[22392]: osdmap e37: 7 total, 6 up, 7 in 2024-08-20T01:32:04.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:04 smithi175 ceph-mon[22392]: from='osd.6 [v2:172.21.15.79:6818/3379368280,v1:172.21.15.79:6819/3379368280]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-08-20T01:32:04.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:04 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T01:32:04.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:04 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:04.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:04 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:04.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:04 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T01:32:04.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:04 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-20T01:32:04.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:04 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-20T01:32:04.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:04 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:04.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:04 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:32:04.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:04 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:32:04.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:04 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:04.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:04 smithi079 ceph-mon[18656]: from='osd.6 [v2:172.21.15.79:6818/3379368280,v1:172.21.15.79:6819/3379368280]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-20T01:32:04.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:04 smithi079 ceph-mon[18656]: osdmap e37: 7 total, 6 up, 7 in 2024-08-20T01:32:04.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:04 smithi079 ceph-mon[18656]: from='osd.6 [v2:172.21.15.79:6818/3379368280,v1:172.21.15.79:6819/3379368280]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-08-20T01:32:04.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:04 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T01:32:04.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:04 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:04.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:04 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:04.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:04 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T01:32:04.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:04 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-20T01:32:04.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:04 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-20T01:32:04.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:04 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:04.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:04 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:32:04.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:04 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:32:04.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:04 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:05.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.018+0000 7fcb76ab3640 1 -- 172.21.15.81:0/2498684174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb70102750 msgr2=0x7fcb70102b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:05.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.018+0000 7fcb76ab3640 1 --2- 172.21.15.81:0/2498684174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb70102750 0x7fcb70102b50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcb64009930 tx=0x7fcb6402a420 comp rx=0 tx=0).stop 2024-08-20T01:32:05.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.018+0000 7fcb76ab3640 1 -- 172.21.15.81:0/2498684174 shutdown_connections 2024-08-20T01:32:05.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.018+0000 7fcb76ab3640 1 --2- 172.21.15.81:0/2498684174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb70104270 0x7fcb7010abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:05.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.018+0000 7fcb76ab3640 1 --2- 172.21.15.81:0/2498684174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb701038b0 0x7fcb70103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:05.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.018+0000 7fcb76ab3640 1 --2- 172.21.15.81:0/2498684174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb70102750 0x7fcb70102b50 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:05.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.018+0000 7fcb76ab3640 1 -- 172.21.15.81:0/2498684174 >> 172.21.15.81:0/2498684174 conn(0x7fcb700fe020 msgr2=0x7fcb70100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:05.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.018+0000 7fcb76ab3640 1 -- 172.21.15.81:0/2498684174 shutdown_connections 2024-08-20T01:32:05.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.018+0000 7fcb76ab3640 1 -- 172.21.15.81:0/2498684174 wait complete. 2024-08-20T01:32:05.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.019+0000 7fcb76ab3640 1 Processor -- start 2024-08-20T01:32:05.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.019+0000 7fcb76ab3640 1 -- start start 2024-08-20T01:32:05.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.019+0000 7fcb76ab3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb70102750 0x7fcb70198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:05.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.019+0000 7fcb76ab3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb701038b0 0x7fcb70199060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:05.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.019+0000 7fcb76ab3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb70104270 0x7fcb70199ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:05.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.019+0000 7fcb76ab3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7010e260 con 0x7fcb701038b0 2024-08-20T01:32:05.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.019+0000 7fcb76ab3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7010e0e0 con 0x7fcb70102750 2024-08-20T01:32:05.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.019+0000 7fcb76ab3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7010e3e0 con 0x7fcb70104270 2024-08-20T01:32:05.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.019+0000 7fcb7484f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb70102750 0x7fcb70198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:05.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.019+0000 7fcb6ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb701038b0 0x7fcb70199060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:05.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.019+0000 7fcb7484f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb70102750 0x7fcb70198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42402/0 (socket says 172.21.15.81:42402) 2024-08-20T01:32:05.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.019+0000 7fcb6ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb701038b0 0x7fcb70199060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.81:36932/0 (socket says 172.21.15.81:36932) 2024-08-20T01:32:05.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.019+0000 7fcb7484f640 1 -- 172.21.15.81:0/3823435636 learned_addr learned my addr 172.21.15.81:0/3823435636 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-08-20T01:32:05.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.019+0000 7fcb75050640 1 --2- 172.21.15.81:0/3823435636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb70104270 0x7fcb70199ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:05.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.019+0000 7fcb6ffff640 1 -- 172.21.15.81:0/3823435636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb70104270 msgr2=0x7fcb70199ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:05.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.019+0000 7fcb6ffff640 1 --2- 172.21.15.81:0/3823435636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb70104270 0x7fcb70199ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:05.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.019+0000 7fcb6ffff640 1 -- 172.21.15.81:0/3823435636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb70102750 msgr2=0x7fcb70198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:05.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.019+0000 7fcb6ffff640 1 --2- 172.21.15.81:0/3823435636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb70102750 0x7fcb70198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:05.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.019+0000 7fcb6ffff640 1 -- 172.21.15.81:0/3823435636 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb7019a540 con 0x7fcb701038b0 2024-08-20T01:32:05.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.019+0000 7fcb7484f640 1 --2- 172.21.15.81:0/3823435636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb70102750 0x7fcb70198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:32:05.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.019+0000 7fcb75050640 1 --2- 172.21.15.81:0/3823435636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb70104270 0x7fcb70199ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:32:05.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.020+0000 7fcb6ffff640 1 --2- 172.21.15.81:0/3823435636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb701038b0 0x7fcb70199060 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c00c970 tx=0x7fcb5c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:05.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.020+0000 7fcb6dffb640 1 -- 172.21.15.81:0/3823435636 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c007bb0 con 0x7fcb701038b0 2024-08-20T01:32:05.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.020+0000 7fcb76ab3640 1 -- 172.21.15.81:0/3823435636 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb7019a830 con 0x7fcb701038b0 2024-08-20T01:32:05.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.020+0000 7fcb6dffb640 1 -- 172.21.15.81:0/3823435636 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcb5c007d50 con 0x7fcb701038b0 2024-08-20T01:32:05.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.020+0000 7fcb6dffb640 1 -- 172.21.15.81:0/3823435636 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c0186f0 con 0x7fcb701038b0 2024-08-20T01:32:05.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.020+0000 7fcb76ab3640 1 -- 172.21.15.81:0/3823435636 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb701a0f10 con 0x7fcb701038b0 2024-08-20T01:32:05.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.021+0000 7fcb76ab3640 1 -- 172.21.15.81:0/3823435636 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb70109ad0 con 0x7fcb701038b0 2024-08-20T01:32:05.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.022+0000 7fcb6dffb640 1 -- 172.21.15.81:0/3823435636 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7fcb5c00f450 con 0x7fcb701038b0 2024-08-20T01:32:05.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.023+0000 7fcb6dffb640 1 --2- 172.21.15.81:0/3823435636 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fcb600b3bd0 0x7fcb600b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:05.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.023+0000 7fcb7484f640 1 --2- 172.21.15.81:0/3823435636 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fcb600b3bd0 0x7fcb600b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:05.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.023+0000 7fcb6dffb640 1 -- 172.21.15.81:0/3823435636 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4685+0+0 (secure 0 0 0) 0x7fcb5c0e2ee0 con 0x7fcb701038b0 2024-08-20T01:32:05.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.024+0000 7fcb7484f640 1 --2- 172.21.15.81:0/3823435636 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fcb600b3bd0 0x7fcb600b6090 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcb64031960 tx=0x7fcb64031ac0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:05.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.031+0000 7fcb6dffb640 1 -- 172.21.15.81:0/3823435636 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fcb5c014030 con 0x7fcb701038b0 2024-08-20T01:32:05.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:05.229+0000 7fcb76ab3640 1 -- 172.21.15.81:0/3823435636 --> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fcb700632c0 con 0x7fcb600b3bd0 2024-08-20T01:32:05.767 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:05 smithi081 ceph-mon[22209]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-08-20T01:32:05.768 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:05 smithi081 ceph-mon[22209]: Detected new or changed devices on smithi079 2024-08-20T01:32:05.768 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:05 smithi081 ceph-mon[22209]: Adjusting osd_memory_target on smithi079 to 5696M 2024-08-20T01:32:05.768 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:05 smithi081 ceph-mon[22209]: from='osd.6 [v2:172.21.15.79:6818/3379368280,v1:172.21.15.79:6819/3379368280]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-08-20T01:32:05.768 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:05 smithi081 ceph-mon[22209]: osdmap e38: 7 total, 6 up, 7 in 2024-08-20T01:32:05.768 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:05 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T01:32:05.768 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:05 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T01:32:05.768 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:05 smithi081 ceph-mon[22209]: from='client.14526 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:32:05.768 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:05 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:32:05.768 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:05 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:32:05.769 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:05 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:32:05.769 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:05 smithi081 ceph-mon[22209]: from='osd.6 [v2:172.21.15.79:6818/3379368280,v1:172.21.15.79:6819/3379368280]' entity='osd.6' 2024-08-20T01:32:05.769 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:05 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T01:32:05.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:05 smithi175 ceph-mon[22392]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-08-20T01:32:05.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:05 smithi175 ceph-mon[22392]: Detected new or changed devices on smithi079 2024-08-20T01:32:05.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:05 smithi175 ceph-mon[22392]: Adjusting osd_memory_target on smithi079 to 5696M 2024-08-20T01:32:05.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:05 smithi175 ceph-mon[22392]: from='osd.6 [v2:172.21.15.79:6818/3379368280,v1:172.21.15.79:6819/3379368280]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-08-20T01:32:05.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:05 smithi175 ceph-mon[22392]: osdmap e38: 7 total, 6 up, 7 in 2024-08-20T01:32:05.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:05 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T01:32:05.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:05 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T01:32:05.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:05 smithi175 ceph-mon[22392]: from='client.14526 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:32:05.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:05 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:32:05.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:05 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:32:05.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:05 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:32:05.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:05 smithi175 ceph-mon[22392]: from='osd.6 [v2:172.21.15.79:6818/3379368280,v1:172.21.15.79:6819/3379368280]' entity='osd.6' 2024-08-20T01:32:05.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:05 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T01:32:05.936 INFO:journalctl@ceph.osd.6.smithi079.stdout:Aug 20 01:32:05 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-6[45200]: 2024-08-20T01:32:05.525+0000 7fa05a305640 -1 osd.6 0 waiting for initial osdmap 2024-08-20T01:32:05.936 INFO:journalctl@ceph.osd.6.smithi079.stdout:Aug 20 01:32:05 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-6[45200]: 2024-08-20T01:32:05.744+0000 7fa052124640 -1 osd.6 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-20T01:32:05.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:05 smithi079 ceph-mon[18656]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-08-20T01:32:05.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:05 smithi079 ceph-mon[18656]: Detected new or changed devices on smithi079 2024-08-20T01:32:05.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:05 smithi079 ceph-mon[18656]: Adjusting osd_memory_target on smithi079 to 5696M 2024-08-20T01:32:05.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:05 smithi079 ceph-mon[18656]: from='osd.6 [v2:172.21.15.79:6818/3379368280,v1:172.21.15.79:6819/3379368280]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-08-20T01:32:05.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:05 smithi079 ceph-mon[18656]: osdmap e38: 7 total, 6 up, 7 in 2024-08-20T01:32:05.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:05 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T01:32:05.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:05 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T01:32:05.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:05 smithi079 ceph-mon[18656]: from='client.14526 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:32:05.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:05 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:32:05.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:05 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:32:05.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:05 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:32:05.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:05 smithi079 ceph-mon[18656]: from='osd.6 [v2:172.21.15.79:6818/3379368280,v1:172.21.15.79:6819/3379368280]' entity='osd.6' 2024-08-20T01:32:05.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:05 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T01:32:06.867 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:06 smithi081 ceph-mon[22209]: purged_snaps scrub starts 2024-08-20T01:32:06.867 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:06 smithi081 ceph-mon[22209]: purged_snaps scrub ok 2024-08-20T01:32:06.868 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:06 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T01:32:06.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:06 smithi079 ceph-mon[18656]: purged_snaps scrub starts 2024-08-20T01:32:06.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:06 smithi079 ceph-mon[18656]: purged_snaps scrub ok 2024-08-20T01:32:06.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:06 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T01:32:07.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:06 smithi175 ceph-mon[22392]: purged_snaps scrub starts 2024-08-20T01:32:07.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:06 smithi175 ceph-mon[22392]: purged_snaps scrub ok 2024-08-20T01:32:07.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:06 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T01:32:07.893 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:07 smithi081 ceph-mon[22209]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-08-20T01:32:07.893 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:07 smithi081 ceph-mon[22209]: osd.6 [v2:172.21.15.79:6818/3379368280,v1:172.21.15.79:6819/3379368280] boot 2024-08-20T01:32:07.893 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:07 smithi081 ceph-mon[22209]: osdmap e39: 7 total, 7 up, 7 in 2024-08-20T01:32:07.894 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:07 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T01:32:07.894 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:07 smithi081 ceph-mon[22209]: from='client.? 172.21.15.81:0/63470955' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "875f7876-a2ca-4254-a8cc-27eebb11cf23"} : dispatch 2024-08-20T01:32:07.894 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:07 smithi081 ceph-mon[22209]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "875f7876-a2ca-4254-a8cc-27eebb11cf23"} : dispatch 2024-08-20T01:32:07.894 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:07 smithi081 ceph-mon[22209]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "875f7876-a2ca-4254-a8cc-27eebb11cf23"}]': finished 2024-08-20T01:32:07.894 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:07 smithi081 ceph-mon[22209]: osdmap e40: 8 total, 7 up, 8 in 2024-08-20T01:32:07.894 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:07 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T01:32:07.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:07 smithi079 ceph-mon[18656]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-08-20T01:32:07.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:07 smithi079 ceph-mon[18656]: osd.6 [v2:172.21.15.79:6818/3379368280,v1:172.21.15.79:6819/3379368280] boot 2024-08-20T01:32:07.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:07 smithi079 ceph-mon[18656]: osdmap e39: 7 total, 7 up, 7 in 2024-08-20T01:32:07.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:07 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T01:32:07.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:07 smithi079 ceph-mon[18656]: from='client.? 172.21.15.81:0/63470955' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "875f7876-a2ca-4254-a8cc-27eebb11cf23"} : dispatch 2024-08-20T01:32:07.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:07 smithi079 ceph-mon[18656]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "875f7876-a2ca-4254-a8cc-27eebb11cf23"} : dispatch 2024-08-20T01:32:07.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:07 smithi079 ceph-mon[18656]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "875f7876-a2ca-4254-a8cc-27eebb11cf23"}]': finished 2024-08-20T01:32:07.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:07 smithi079 ceph-mon[18656]: osdmap e40: 8 total, 7 up, 8 in 2024-08-20T01:32:07.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:07 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T01:32:08.040 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:07 smithi175 ceph-mon[22392]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-08-20T01:32:08.040 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:07 smithi175 ceph-mon[22392]: osd.6 [v2:172.21.15.79:6818/3379368280,v1:172.21.15.79:6819/3379368280] boot 2024-08-20T01:32:08.040 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:07 smithi175 ceph-mon[22392]: osdmap e39: 7 total, 7 up, 7 in 2024-08-20T01:32:08.040 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:07 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T01:32:08.040 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:07 smithi175 ceph-mon[22392]: from='client.? 172.21.15.81:0/63470955' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "875f7876-a2ca-4254-a8cc-27eebb11cf23"} : dispatch 2024-08-20T01:32:08.040 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:07 smithi175 ceph-mon[22392]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "875f7876-a2ca-4254-a8cc-27eebb11cf23"} : dispatch 2024-08-20T01:32:08.040 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:07 smithi175 ceph-mon[22392]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "875f7876-a2ca-4254-a8cc-27eebb11cf23"}]': finished 2024-08-20T01:32:08.040 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:07 smithi175 ceph-mon[22392]: osdmap e40: 8 total, 7 up, 8 in 2024-08-20T01:32:08.040 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:07 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T01:32:09.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:08 smithi081 ceph-mon[22209]: from='client.? 172.21.15.81:0/2971925968' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:32:09.055 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:08 smithi175 ceph-mon[22392]: from='client.? 172.21.15.81:0/2971925968' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:32:09.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:08 smithi079 ceph-mon[18656]: from='client.? 172.21.15.81:0/2971925968' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:32:10.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:09 smithi081 ceph-mon[22209]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:32:10.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:09 smithi175 ceph-mon[22392]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:32:10.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:09 smithi079 ceph-mon[18656]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:32:12.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:11 smithi081 ceph-mon[22209]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:32:12.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:11 smithi175 ceph-mon[22392]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:32:12.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:11 smithi079 ceph-mon[18656]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:32:14.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:13 smithi081 ceph-mon[22209]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:32:14.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:13 smithi175 ceph-mon[22392]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:32:14.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:13 smithi079 ceph-mon[18656]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:32:15.971 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:15 smithi081 ceph-mon[22209]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:32:16.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:15 smithi175 ceph-mon[22392]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:32:16.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:15 smithi079 ceph-mon[18656]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:32:16.981 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:16 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-08-20T01:32:16.982 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:16 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:32:16.982 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:16 smithi081 ceph-mon[22209]: Deploying daemon osd.7 on smithi081 2024-08-20T01:32:17.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:16 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-08-20T01:32:17.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:16 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:32:17.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:16 smithi175 ceph-mon[22392]: Deploying daemon osd.7 on smithi081 2024-08-20T01:32:17.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:16 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-08-20T01:32:17.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:16 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:32:17.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:16 smithi079 ceph-mon[18656]: Deploying daemon osd.7 on smithi081 2024-08-20T01:32:17.853 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:17 smithi081 ceph-mon[22209]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:32:17.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:17 smithi079 ceph-mon[18656]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:32:18.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:17 smithi175 ceph-mon[22392]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:32:20.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:19 smithi081 ceph-mon[22209]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:32:20.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:19 smithi175 ceph-mon[22392]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:32:20.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:19 smithi079 ceph-mon[18656]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:32:21.951 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:21 smithi081 ceph-mon[22209]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:32:21.952 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:21 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:32:21.952 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:21 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:21.952 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:21 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:22.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:21 smithi175 ceph-mon[22392]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:32:22.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:21 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:32:22.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:21 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:22.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:21 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:22.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:21 smithi079 ceph-mon[18656]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:32:22.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:21 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:32:22.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:21 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:22.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:21 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:23.736 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:23 smithi081 ceph-mon[22209]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:32:24.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:24.068+0000 7fcb6dffb640 1 -- 172.21.15.81:0/3823435636 <== mgr.14150 v2:172.21.15.79:6800/3038112779 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fcb700632c0 con 0x7fcb600b3bd0 2024-08-20T01:32:24.070 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 7 on host 'smithi081' 2024-08-20T01:32:24.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:24.071+0000 7fcb76ab3640 1 -- 172.21.15.81:0/3823435636 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fcb600b3bd0 msgr2=0x7fcb600b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:24.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:24.071+0000 7fcb76ab3640 1 --2- 172.21.15.81:0/3823435636 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fcb600b3bd0 0x7fcb600b6090 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcb64031960 tx=0x7fcb64031ac0 comp rx=0 tx=0).stop 2024-08-20T01:32:24.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:24.071+0000 7fcb76ab3640 1 -- 172.21.15.81:0/3823435636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb701038b0 msgr2=0x7fcb70199060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:24.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:24.071+0000 7fcb76ab3640 1 --2- 172.21.15.81:0/3823435636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb701038b0 0x7fcb70199060 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c00c970 tx=0x7fcb5c00ce30 comp rx=0 tx=0).stop 2024-08-20T01:32:24.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:24.071+0000 7fcb76ab3640 1 -- 172.21.15.81:0/3823435636 shutdown_connections 2024-08-20T01:32:24.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:24.071+0000 7fcb76ab3640 1 --2- 172.21.15.81:0/3823435636 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fcb600b3bd0 0x7fcb600b6090 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:24.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:24.071+0000 7fcb76ab3640 1 --2- 172.21.15.81:0/3823435636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb70104270 0x7fcb70199ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:24.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:24.071+0000 7fcb76ab3640 1 --2- 172.21.15.81:0/3823435636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb701038b0 0x7fcb70199060 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:24.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:24.071+0000 7fcb76ab3640 1 --2- 172.21.15.81:0/3823435636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb70102750 0x7fcb70198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:24.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:24.071+0000 7fcb76ab3640 1 -- 172.21.15.81:0/3823435636 >> 172.21.15.81:0/3823435636 conn(0x7fcb700fe020 msgr2=0x7fcb70106ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:24.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:24.071+0000 7fcb76ab3640 1 -- 172.21.15.81:0/3823435636 shutdown_connections 2024-08-20T01:32:24.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:32:24.071+0000 7fcb76ab3640 1 -- 172.21.15.81:0/3823435636 wait complete. 2024-08-20T01:32:24.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:23 smithi175 ceph-mon[22392]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:32:24.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:23 smithi079 ceph-mon[18656]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:32:24.644 DEBUG:teuthology.orchestra.run.smithi081:osd.7> sudo journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@osd.7.service 2024-08-20T01:32:24.647 INFO:tasks.cephadm:Deploying osd.8 on smithi175 with /dev/vg_nvme/lv_2... 2024-08-20T01:32:24.647 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-20T01:32:24.904 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T01:32:25.334 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:25 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:25.334 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:25 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:25.334 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:25 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:25.335 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:25 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:25.375 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:25 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:25.375 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:25 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:25.375 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:25 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:25.375 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:25 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:25.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:25 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:25.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:25 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:25.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:25 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:25.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:25 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:26.296 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:26 smithi175 ceph-mon[22392]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:32:26.348 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:26 smithi081 ceph-mon[22209]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:32:26.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:26 smithi079 ceph-mon[18656]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:32:27.375 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-08-20T01:32:27.401 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi175:vg_nvme/lv_2 2024-08-20T01:32:27.487 INFO:journalctl@ceph.osd.7.smithi081.stdout:Aug 20 01:32:27 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-7[39958]: 2024-08-20T01:32:27.259+0000 7fccf38a8640 -1 osd.7 0 log_to_monitors true 2024-08-20T01:32:27.651 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T01:32:28.071 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:28.068+0000 7fc926510640 1 -- 172.21.15.175:0/1850657732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc920103130 msgr2=0x7fc920109ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:28.071 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:28.068+0000 7fc926510640 1 --2- 172.21.15.175:0/1850657732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc920103130 0x7fc920109ab0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc918009d00 tx=0x7fc91802a910 comp rx=0 tx=0).stop 2024-08-20T01:32:28.071 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:28.068+0000 7fc926510640 1 -- 172.21.15.175:0/1850657732 shutdown_connections 2024-08-20T01:32:28.071 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:28.068+0000 7fc926510640 1 --2- 172.21.15.175:0/1850657732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc920103130 0x7fc920109ab0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:28.071 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:28.068+0000 7fc926510640 1 --2- 172.21.15.175:0/1850657732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc920102770 0x7fc920102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:28.071 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:28.068+0000 7fc926510640 1 --2- 172.21.15.175:0/1850657732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc920101610 0x7fc920101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:28.071 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:28.068+0000 7fc926510640 1 -- 172.21.15.175:0/1850657732 >> 172.21.15.175:0/1850657732 conn(0x7fc9200fcee0 msgr2=0x7fc9200ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:28.071 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:28.069+0000 7fc926510640 1 -- 172.21.15.175:0/1850657732 shutdown_connections 2024-08-20T01:32:28.071 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:28.069+0000 7fc926510640 1 -- 172.21.15.175:0/1850657732 wait complete. 2024-08-20T01:32:28.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:28.069+0000 7fc926510640 1 Processor -- start 2024-08-20T01:32:28.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:28.069+0000 7fc926510640 1 -- start start 2024-08-20T01:32:28.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:28.070+0000 7fc926510640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc920101610 0x7fc92006b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:28.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:28.070+0000 7fc926510640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc920102770 0x7fc92019d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:28.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:28.070+0000 7fc926510640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc920103130 0x7fc92019fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:28.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:28.070+0000 7fc926510640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc92010d120 con 0x7fc920101610 2024-08-20T01:32:28.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:28.070+0000 7fc926510640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc92010cfa0 con 0x7fc920102770 2024-08-20T01:32:28.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:28.070+0000 7fc926510640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc92010d2a0 con 0x7fc920103130 2024-08-20T01:32:28.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:28.070+0000 7fc924aad640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc920103130 0x7fc92019fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:28.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:28.070+0000 7fc91ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc920101610 0x7fc92006b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:28.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:28.070+0000 7fc924aad640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc920103130 0x7fc92019fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59564/0 (socket says 172.21.15.175:59564) 2024-08-20T01:32:28.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:28.070+0000 7fc924aad640 1 -- 172.21.15.175:0/1178820154 learned_addr learned my addr 172.21.15.175:0/1178820154 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-08-20T01:32:28.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:28.070+0000 7fc91f7fe640 1 --2- 172.21.15.175:0/1178820154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc920102770 0x7fc92019d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:28.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:28.070+0000 7fc924aad640 1 -- 172.21.15.175:0/1178820154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc920102770 msgr2=0x7fc92019d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:28.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:28.070+0000 7fc924aad640 1 --2- 172.21.15.175:0/1178820154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc920102770 0x7fc92019d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:28.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:28.070+0000 7fc924aad640 1 -- 172.21.15.175:0/1178820154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc920101610 msgr2=0x7fc92006b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:28.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:28.070+0000 7fc924aad640 1 --2- 172.21.15.175:0/1178820154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc920101610 0x7fc92006b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:28.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:28.070+0000 7fc924aad640 1 -- 172.21.15.175:0/1178820154 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9201a0570 con 0x7fc920103130 2024-08-20T01:32:28.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:28.070+0000 7fc91ffff640 1 --2- 172.21.15.175:0/1178820154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc920101610 0x7fc92006b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:32:28.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:28.070+0000 7fc924aad640 1 --2- 172.21.15.175:0/1178820154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc920103130 0x7fc92019fcb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc918031810 tx=0x7fc918030800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:28.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:28.071+0000 7fc91d7fa640 1 -- 172.21.15.175:0/1178820154 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc918030e30 con 0x7fc920103130 2024-08-20T01:32:28.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:28.071+0000 7fc926510640 1 -- 172.21.15.175:0/1178820154 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9201a0800 con 0x7fc920103130 2024-08-20T01:32:28.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:28.071+0000 7fc91d7fa640 1 -- 172.21.15.175:0/1178820154 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc91803b890 con 0x7fc920103130 2024-08-20T01:32:28.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:28.071+0000 7fc91d7fa640 1 -- 172.21.15.175:0/1178820154 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91803a6f0 con 0x7fc920103130 2024-08-20T01:32:28.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:28.071+0000 7fc926510640 1 -- 172.21.15.175:0/1178820154 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9201a0d90 con 0x7fc920103130 2024-08-20T01:32:28.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:28.072+0000 7fc926510640 1 -- 172.21.15.175:0/1178820154 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc920108990 con 0x7fc920103130 2024-08-20T01:32:28.076 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:28.074+0000 7fc91d7fa640 1 -- 172.21.15.175:0/1178820154 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7fc91803b400 con 0x7fc920103130 2024-08-20T01:32:28.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:28.075+0000 7fc91d7fa640 1 --2- 172.21.15.175:0/1178820154 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc90c0b3bd0 0x7fc90c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:28.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:28.075+0000 7fc91d7fa640 1 -- 172.21.15.175:0/1178820154 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5080+0+0 (secure 0 0 0) 0x7fc918104540 con 0x7fc920103130 2024-08-20T01:32:28.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:28.075+0000 7fc91ffff640 1 --2- 172.21.15.175:0/1178820154 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc90c0b3bd0 0x7fc90c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:28.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:28.075+0000 7fc91ffff640 1 --2- 172.21.15.175:0/1178820154 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc90c0b3bd0 0x7fc90c0b6090 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc90800bfd0 tx=0x7fc90800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:28.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:28.078+0000 7fc91d7fa640 1 -- 172.21.15.175:0/1178820154 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fc9180cc8c0 con 0x7fc920103130 2024-08-20T01:32:28.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:28.268+0000 7fc926510640 1 -- 172.21.15.175:0/1178820154 --> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fc9200632c0 con 0x7fc90c0b3bd0 2024-08-20T01:32:28.271 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:28 smithi175 ceph-mon[22392]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:32:28.271 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:28 smithi175 ceph-mon[22392]: from='osd.7 [v2:172.21.15.81:6816/747356685,v1:172.21.15.81:6817/747356685]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-20T01:32:28.271 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:28 smithi175 ceph-mon[22392]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-20T01:32:28.271 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:28 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:28.271 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:28 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:28.271 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:28 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T01:32:28.271 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:28 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-20T01:32:28.272 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:28 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-20T01:32:28.272 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:28 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:28.272 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:28 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:32:28.272 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:28 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:32:28.272 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:28 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:28.272 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:28 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:32:28.272 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:28 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:32:28.272 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:28 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:32:28.272 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:28 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:28.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:28 smithi079 ceph-mon[18656]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:32:28.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:28 smithi079 ceph-mon[18656]: from='osd.7 [v2:172.21.15.81:6816/747356685,v1:172.21.15.81:6817/747356685]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-20T01:32:28.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:28 smithi079 ceph-mon[18656]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-20T01:32:28.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:28 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:28.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:28 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:28.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:28 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T01:32:28.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:28 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-20T01:32:28.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:28 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-20T01:32:28.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:28 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:28.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:28 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:32:28.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:28 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:32:28.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:28 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:28.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:28 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:32:28.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:28 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:32:28.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:28 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:32:28.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:28 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:28.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:28 smithi081 ceph-mon[22209]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:32:28.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:28 smithi081 ceph-mon[22209]: from='osd.7 [v2:172.21.15.81:6816/747356685,v1:172.21.15.81:6817/747356685]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-20T01:32:28.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:28 smithi081 ceph-mon[22209]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-20T01:32:28.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:28 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:28.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:28 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:28.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:28 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T01:32:28.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:28 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-20T01:32:28.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:28 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-20T01:32:28.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:28 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:28.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:28 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:32:28.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:28 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:32:28.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:28 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:28.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:28 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:32:28.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:28 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:32:28.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:28 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:32:28.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:28 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:29.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:29 smithi175 ceph-mon[22392]: Detected new or changed devices on smithi081 2024-08-20T01:32:29.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:29 smithi175 ceph-mon[22392]: Adjusting osd_memory_target on smithi081 to 5696M 2024-08-20T01:32:29.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:29 smithi175 ceph-mon[22392]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-20T01:32:29.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:29 smithi175 ceph-mon[22392]: osdmap e41: 8 total, 7 up, 8 in 2024-08-20T01:32:29.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:29 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T01:32:29.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:29 smithi175 ceph-mon[22392]: from='osd.7 [v2:172.21.15.81:6816/747356685,v1:172.21.15.81:6817/747356685]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-08-20T01:32:29.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:29 smithi175 ceph-mon[22392]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-08-20T01:32:29.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:29 smithi175 ceph-mon[22392]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:32:29.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:29 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:32:29.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:29 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:32:29.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:29 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:32:29.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:29 smithi079 ceph-mon[18656]: Detected new or changed devices on smithi081 2024-08-20T01:32:29.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:29 smithi079 ceph-mon[18656]: Adjusting osd_memory_target on smithi081 to 5696M 2024-08-20T01:32:29.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:29 smithi079 ceph-mon[18656]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-20T01:32:29.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:29 smithi079 ceph-mon[18656]: osdmap e41: 8 total, 7 up, 8 in 2024-08-20T01:32:29.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:29 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T01:32:29.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:29 smithi079 ceph-mon[18656]: from='osd.7 [v2:172.21.15.81:6816/747356685,v1:172.21.15.81:6817/747356685]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-08-20T01:32:29.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:29 smithi079 ceph-mon[18656]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-08-20T01:32:29.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:29 smithi079 ceph-mon[18656]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:32:29.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:29 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:32:29.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:29 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:32:29.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:29 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:32:29.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:29 smithi081 ceph-mon[22209]: Detected new or changed devices on smithi081 2024-08-20T01:32:29.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:29 smithi081 ceph-mon[22209]: Adjusting osd_memory_target on smithi081 to 5696M 2024-08-20T01:32:29.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:29 smithi081 ceph-mon[22209]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-20T01:32:29.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:29 smithi081 ceph-mon[22209]: osdmap e41: 8 total, 7 up, 8 in 2024-08-20T01:32:29.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:29 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T01:32:29.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:29 smithi081 ceph-mon[22209]: from='osd.7 [v2:172.21.15.81:6816/747356685,v1:172.21.15.81:6817/747356685]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-08-20T01:32:29.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:29 smithi081 ceph-mon[22209]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-08-20T01:32:29.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:29 smithi081 ceph-mon[22209]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:32:29.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:29 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:32:29.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:29 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:32:29.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:29 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:32:30.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:30 smithi175 ceph-mon[22392]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:32:30.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:30 smithi175 ceph-mon[22392]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-08-20T01:32:30.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:30 smithi175 ceph-mon[22392]: osdmap e42: 8 total, 7 up, 8 in 2024-08-20T01:32:30.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:30 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T01:32:30.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:30 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T01:32:30.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:30 smithi175 ceph-mon[22392]: from='osd.7 ' entity='osd.7' 2024-08-20T01:32:30.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:30 smithi175 ceph-mon[22392]: osdmap e43: 8 total, 7 up, 8 in 2024-08-20T01:32:30.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:30 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T01:32:30.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:30 smithi079 ceph-mon[18656]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:32:30.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:30 smithi079 ceph-mon[18656]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-08-20T01:32:30.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:30 smithi079 ceph-mon[18656]: osdmap e42: 8 total, 7 up, 8 in 2024-08-20T01:32:30.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:30 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T01:32:30.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:30 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T01:32:30.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:30 smithi079 ceph-mon[18656]: from='osd.7 ' entity='osd.7' 2024-08-20T01:32:30.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:30 smithi079 ceph-mon[18656]: osdmap e43: 8 total, 7 up, 8 in 2024-08-20T01:32:30.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:30 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T01:32:30.527 INFO:journalctl@ceph.osd.7.smithi081.stdout:Aug 20 01:32:30 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-7[39958]: 2024-08-20T01:32:30.053+0000 7fccef82b640 -1 osd.7 0 waiting for initial osdmap 2024-08-20T01:32:30.527 INFO:journalctl@ceph.osd.7.smithi081.stdout:Aug 20 01:32:30 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-7[39958]: 2024-08-20T01:32:30.261+0000 7fcce764a640 -1 osd.7 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-20T01:32:30.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:30 smithi081 ceph-mon[22209]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:32:30.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:30 smithi081 ceph-mon[22209]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-08-20T01:32:30.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:30 smithi081 ceph-mon[22209]: osdmap e42: 8 total, 7 up, 8 in 2024-08-20T01:32:30.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:30 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T01:32:30.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:30 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T01:32:30.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:30 smithi081 ceph-mon[22209]: from='osd.7 ' entity='osd.7' 2024-08-20T01:32:30.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:30 smithi081 ceph-mon[22209]: osdmap e43: 8 total, 7 up, 8 in 2024-08-20T01:32:30.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:30 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T01:32:31.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:31 smithi175 ceph-mon[22392]: purged_snaps scrub starts 2024-08-20T01:32:31.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:31 smithi175 ceph-mon[22392]: purged_snaps scrub ok 2024-08-20T01:32:31.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:31 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T01:32:31.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:31 smithi175 ceph-mon[22392]: from='client.? 172.21.15.175:0/982747783' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d714a33b-8df5-411d-bc99-b33b4b27cc66"} : dispatch 2024-08-20T01:32:31.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:31 smithi175 ceph-mon[22392]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d714a33b-8df5-411d-bc99-b33b4b27cc66"} : dispatch 2024-08-20T01:32:31.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:31 smithi175 ceph-mon[22392]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d714a33b-8df5-411d-bc99-b33b4b27cc66"}]': finished 2024-08-20T01:32:31.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:31 smithi175 ceph-mon[22392]: osd.7 [v2:172.21.15.81:6816/747356685,v1:172.21.15.81:6817/747356685] boot 2024-08-20T01:32:31.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:31 smithi175 ceph-mon[22392]: osdmap e44: 9 total, 8 up, 9 in 2024-08-20T01:32:31.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:31 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T01:32:31.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:31 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T01:32:31.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:31 smithi079 ceph-mon[18656]: purged_snaps scrub starts 2024-08-20T01:32:31.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:31 smithi079 ceph-mon[18656]: purged_snaps scrub ok 2024-08-20T01:32:31.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:31 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T01:32:31.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:31 smithi079 ceph-mon[18656]: from='client.? 172.21.15.175:0/982747783' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d714a33b-8df5-411d-bc99-b33b4b27cc66"} : dispatch 2024-08-20T01:32:31.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:31 smithi079 ceph-mon[18656]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d714a33b-8df5-411d-bc99-b33b4b27cc66"} : dispatch 2024-08-20T01:32:31.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:31 smithi079 ceph-mon[18656]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d714a33b-8df5-411d-bc99-b33b4b27cc66"}]': finished 2024-08-20T01:32:31.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:31 smithi079 ceph-mon[18656]: osd.7 [v2:172.21.15.81:6816/747356685,v1:172.21.15.81:6817/747356685] boot 2024-08-20T01:32:31.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:31 smithi079 ceph-mon[18656]: osdmap e44: 9 total, 8 up, 9 in 2024-08-20T01:32:31.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:31 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T01:32:31.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:31 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T01:32:31.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:31 smithi081 ceph-mon[22209]: purged_snaps scrub starts 2024-08-20T01:32:31.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:31 smithi081 ceph-mon[22209]: purged_snaps scrub ok 2024-08-20T01:32:31.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:31 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T01:32:31.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:31 smithi081 ceph-mon[22209]: from='client.? 172.21.15.175:0/982747783' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d714a33b-8df5-411d-bc99-b33b4b27cc66"} : dispatch 2024-08-20T01:32:31.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:31 smithi081 ceph-mon[22209]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d714a33b-8df5-411d-bc99-b33b4b27cc66"} : dispatch 2024-08-20T01:32:31.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:31 smithi081 ceph-mon[22209]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d714a33b-8df5-411d-bc99-b33b4b27cc66"}]': finished 2024-08-20T01:32:31.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:31 smithi081 ceph-mon[22209]: osd.7 [v2:172.21.15.81:6816/747356685,v1:172.21.15.81:6817/747356685] boot 2024-08-20T01:32:31.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:31 smithi081 ceph-mon[22209]: osdmap e44: 9 total, 8 up, 9 in 2024-08-20T01:32:31.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:31 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T01:32:31.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:31 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T01:32:32.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:32 smithi175 ceph-mon[22392]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:32:32.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:32 smithi175 ceph-mon[22392]: from='client.? 172.21.15.175:0/1404359602' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:32:32.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:32 smithi175 ceph-mon[22392]: osdmap e45: 9 total, 8 up, 9 in 2024-08-20T01:32:32.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:32 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T01:32:32.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:32 smithi079 ceph-mon[18656]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:32:32.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:32 smithi079 ceph-mon[18656]: from='client.? 172.21.15.175:0/1404359602' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:32:32.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:32 smithi079 ceph-mon[18656]: osdmap e45: 9 total, 8 up, 9 in 2024-08-20T01:32:32.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:32 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T01:32:32.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:32 smithi081 ceph-mon[22209]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-08-20T01:32:32.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:32 smithi081 ceph-mon[22209]: from='client.? 172.21.15.175:0/1404359602' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:32:32.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:32 smithi081 ceph-mon[22209]: osdmap e45: 9 total, 8 up, 9 in 2024-08-20T01:32:32.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:32 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T01:32:33.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:33 smithi175 ceph-mon[22392]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-08-20T01:32:33.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:33 smithi175 ceph-mon[22392]: osdmap e46: 9 total, 8 up, 9 in 2024-08-20T01:32:33.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:33 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T01:32:33.935 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:33 smithi079 ceph-mon[18656]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-08-20T01:32:33.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:33 smithi079 ceph-mon[18656]: osdmap e46: 9 total, 8 up, 9 in 2024-08-20T01:32:33.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:33 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T01:32:34.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:33 smithi081 ceph-mon[22209]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-08-20T01:32:34.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:33 smithi081 ceph-mon[22209]: osdmap e46: 9 total, 8 up, 9 in 2024-08-20T01:32:34.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:33 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T01:32:35.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:35 smithi175 ceph-mon[22392]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-08-20T01:32:35.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:35 smithi079 ceph-mon[18656]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-08-20T01:32:36.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:35 smithi081 ceph-mon[22209]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-08-20T01:32:37.849 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:37 smithi175 ceph-mon[22392]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-20T01:32:37.967 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:37 smithi079 ceph-mon[18656]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-20T01:32:37.968 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:37 smithi081 ceph-mon[22209]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-20T01:32:39.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:39 smithi175 ceph-mon[22392]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-08-20T01:32:39.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:39 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-08-20T01:32:39.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:39 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:32:39.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:39 smithi175 ceph-mon[22392]: Deploying daemon osd.8 on smithi175 2024-08-20T01:32:39.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:39 smithi079 ceph-mon[18656]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-08-20T01:32:39.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:39 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-08-20T01:32:39.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:39 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:32:39.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:39 smithi079 ceph-mon[18656]: Deploying daemon osd.8 on smithi175 2024-08-20T01:32:40.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:39 smithi081 ceph-mon[22209]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-08-20T01:32:40.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:39 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-08-20T01:32:40.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:39 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:32:40.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:39 smithi081 ceph-mon[22209]: Deploying daemon osd.8 on smithi175 2024-08-20T01:32:41.856 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:41 smithi175 ceph-mon[22392]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-08-20T01:32:41.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:41 smithi079 ceph-mon[18656]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-08-20T01:32:42.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:41 smithi081 ceph-mon[22209]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-08-20T01:32:43.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:43 smithi175 ceph-mon[22392]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-20T01:32:43.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:43 smithi079 ceph-mon[18656]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-20T01:32:44.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:43 smithi081 ceph-mon[22209]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-20T01:32:44.865 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:44 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:32:44.865 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:44 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:44.865 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:44 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:44.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:44 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:32:44.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:44 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:44.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:44 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:45.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:44 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:32:45.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:44 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:45.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:44 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:46.525 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:46 smithi175 ceph-mon[22392]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-08-20T01:32:46.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:46 smithi081 ceph-mon[22209]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-08-20T01:32:46.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:46 smithi079 ceph-mon[18656]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-08-20T01:32:47.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:47.728+0000 7fc91d7fa640 1 -- 172.21.15.175:0/1178820154 <== mgr.14150 v2:172.21.15.79:6800/3038112779 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc9200632c0 con 0x7fc90c0b3bd0 2024-08-20T01:32:47.729 INFO:teuthology.orchestra.run.smithi175.stdout:Created osd(s) 8 on host 'smithi175' 2024-08-20T01:32:47.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:47.730+0000 7fc926510640 1 -- 172.21.15.175:0/1178820154 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc90c0b3bd0 msgr2=0x7fc90c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:47.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:47.730+0000 7fc926510640 1 --2- 172.21.15.175:0/1178820154 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc90c0b3bd0 0x7fc90c0b6090 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc90800bfd0 tx=0x7fc90800b390 comp rx=0 tx=0).stop 2024-08-20T01:32:47.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:47.730+0000 7fc926510640 1 -- 172.21.15.175:0/1178820154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc920103130 msgr2=0x7fc92019fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:47.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:47.730+0000 7fc926510640 1 --2- 172.21.15.175:0/1178820154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc920103130 0x7fc92019fcb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc918031810 tx=0x7fc918030800 comp rx=0 tx=0).stop 2024-08-20T01:32:47.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:47.730+0000 7fc926510640 1 -- 172.21.15.175:0/1178820154 shutdown_connections 2024-08-20T01:32:47.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:47.730+0000 7fc926510640 1 --2- 172.21.15.175:0/1178820154 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc90c0b3bd0 0x7fc90c0b6090 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:47.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:47.730+0000 7fc926510640 1 --2- 172.21.15.175:0/1178820154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc920103130 0x7fc92019fcb0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:47.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:47.730+0000 7fc926510640 1 --2- 172.21.15.175:0/1178820154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc920102770 0x7fc92019d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:47.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:47.730+0000 7fc926510640 1 --2- 172.21.15.175:0/1178820154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc920101610 0x7fc92006b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:47.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:47.730+0000 7fc926510640 1 -- 172.21.15.175:0/1178820154 >> 172.21.15.175:0/1178820154 conn(0x7fc9200fcee0 msgr2=0x7fc920105b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:47.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:47.730+0000 7fc926510640 1 -- 172.21.15.175:0/1178820154 shutdown_connections 2024-08-20T01:32:47.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:32:47.730+0000 7fc926510640 1 -- 172.21.15.175:0/1178820154 wait complete. 2024-08-20T01:32:48.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:47 smithi081 ceph-mon[22209]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-20T01:32:48.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:47 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:48.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:47 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:48.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:47 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:32:48.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:47 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:32:48.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:47 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:48.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:47 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:32:48.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:47 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:48.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:47 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:48.040 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:47 smithi175 ceph-mon[22392]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-20T01:32:48.040 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:47 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:48.040 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:47 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:48.041 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:47 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:32:48.041 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:47 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:32:48.041 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:47 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:48.041 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:47 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:32:48.041 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:47 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:48.041 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:47 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:48.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:47 smithi079 ceph-mon[18656]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-20T01:32:48.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:47 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:48.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:47 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:48.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:47 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:32:48.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:47 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:32:48.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:47 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:48.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:47 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:32:48.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:47 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:48.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:47 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:48.343 DEBUG:teuthology.orchestra.run.smithi175:osd.8> sudo journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@osd.8.service 2024-08-20T01:32:48.346 INFO:tasks.cephadm:Deploying osd.9 on smithi079 with /dev/vg_nvme/lv_1... 2024-08-20T01:32:48.346 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-20T01:32:48.602 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:32:49.975 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:49 smithi175 ceph-mon[22392]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-08-20T01:32:50.007 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:49 smithi079 ceph-mon[18656]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-08-20T01:32:50.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:49 smithi081 ceph-mon[22209]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-08-20T01:32:50.638 INFO:journalctl@ceph.osd.8.smithi175.stdout:Aug 20 01:32:50 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-8[40676]: 2024-08-20T01:32:50.257+0000 7feef64f3640 -1 osd.8 0 log_to_monitors true 2024-08-20T01:32:50.918 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:50 smithi079 ceph-mon[18656]: from='osd.8 [v2:172.21.15.175:6816/1537762925,v1:172.21.15.175:6817/1537762925]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-20T01:32:50.918 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:50 smithi079 ceph-mon[18656]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-20T01:32:50.996 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:50 smithi175 ceph-mon[22392]: from='osd.8 [v2:172.21.15.175:6816/1537762925,v1:172.21.15.175:6817/1537762925]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-20T01:32:50.996 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:50 smithi175 ceph-mon[22392]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-20T01:32:51.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:50 smithi081 ceph-mon[22209]: from='osd.8 [v2:172.21.15.175:6816/1537762925,v1:172.21.15.175:6817/1537762925]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-20T01:32:51.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:50 smithi081 ceph-mon[22209]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-20T01:32:51.319 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:32:51.346 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi079:vg_nvme/lv_1 2024-08-20T01:32:51.593 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:32:51.966 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:51 smithi079 ceph-mon[18656]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-08-20T01:32:51.966 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:51 smithi079 ceph-mon[18656]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-20T01:32:51.966 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:51 smithi079 ceph-mon[18656]: osdmap e47: 9 total, 8 up, 9 in 2024-08-20T01:32:51.967 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:51 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T01:32:51.967 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:51 smithi079 ceph-mon[18656]: from='osd.8 [v2:172.21.15.175:6816/1537762925,v1:172.21.15.175:6817/1537762925]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-08-20T01:32:51.967 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:51 smithi079 ceph-mon[18656]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-08-20T01:32:51.967 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:51 smithi079 ceph-mon[18656]: Detected new or changed devices on smithi175 2024-08-20T01:32:51.967 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:51 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:51.967 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:51 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:51.967 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:51 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T01:32:51.967 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:51 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-20T01:32:51.967 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:51 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-20T01:32:51.967 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:51 smithi079 ceph-mon[18656]: Adjusting osd_memory_target on smithi175 to 5696M 2024-08-20T01:32:51.967 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:51 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:51.967 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:51 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:32:51.968 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:51 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:32:51.968 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:51 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:52.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:51 smithi081 ceph-mon[22209]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-08-20T01:32:52.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:51 smithi081 ceph-mon[22209]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-20T01:32:52.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:51 smithi081 ceph-mon[22209]: osdmap e47: 9 total, 8 up, 9 in 2024-08-20T01:32:52.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:51 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T01:32:52.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:51 smithi081 ceph-mon[22209]: from='osd.8 [v2:172.21.15.175:6816/1537762925,v1:172.21.15.175:6817/1537762925]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-08-20T01:32:52.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:51 smithi081 ceph-mon[22209]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-08-20T01:32:52.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:51 smithi081 ceph-mon[22209]: Detected new or changed devices on smithi175 2024-08-20T01:32:52.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:51 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:52.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:51 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:52.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:51 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T01:32:52.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:51 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-20T01:32:52.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:51 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-20T01:32:52.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:51 smithi081 ceph-mon[22209]: Adjusting osd_memory_target on smithi175 to 5696M 2024-08-20T01:32:52.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:51 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:52.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:51 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:32:52.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:51 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:32:52.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:51 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:52.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:52.043+0000 7f447ac1c640 1 -- 172.21.15.79:0/3864486199 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4474103890 msgr2=0x7f4474103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:52.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:52.043+0000 7f447ac1c640 1 --2- 172.21.15.79:0/3864486199 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4474103890 0x7f4474103d10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4460009930 tx=0x7f446002a420 comp rx=0 tx=0).stop 2024-08-20T01:32:52.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:52.043+0000 7f447ac1c640 1 -- 172.21.15.79:0/3864486199 shutdown_connections 2024-08-20T01:32:52.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:52.043+0000 7f447ac1c640 1 --2- 172.21.15.79:0/3864486199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4474104250 0x7f447410abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:52.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:52.043+0000 7f447ac1c640 1 --2- 172.21.15.79:0/3864486199 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4474103890 0x7f4474103d10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:52.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:52.043+0000 7f447ac1c640 1 --2- 172.21.15.79:0/3864486199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4474102730 0x7f4474102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:52.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:52.043+0000 7f447ac1c640 1 -- 172.21.15.79:0/3864486199 >> 172.21.15.79:0/3864486199 conn(0x7f44740fe020 msgr2=0x7f4474100440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:32:52.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:52.043+0000 7f447ac1c640 1 -- 172.21.15.79:0/3864486199 shutdown_connections 2024-08-20T01:32:52.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:52.043+0000 7f447ac1c640 1 -- 172.21.15.79:0/3864486199 wait complete. 2024-08-20T01:32:52.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:52.044+0000 7f447ac1c640 1 Processor -- start 2024-08-20T01:32:52.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:52.044+0000 7f447ac1c640 1 -- start start 2024-08-20T01:32:52.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:52.044+0000 7f447ac1c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4474102730 0x7f4474198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:52.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:52.044+0000 7f447ac1c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4474103890 0x7f4474199080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:52.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:52.044+0000 7f447ac1c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4474104250 0x7f4474199cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:52.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:52.044+0000 7f447ac1c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f447410e260 con 0x7f4474103890 2024-08-20T01:32:52.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:52.044+0000 7f447ac1c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f447410e0e0 con 0x7f4474102730 2024-08-20T01:32:52.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:52.044+0000 7f447ac1c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f447410e3e0 con 0x7f4474104250 2024-08-20T01:32:52.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:52.044+0000 7f4473fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4474103890 0x7f4474199080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:52.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:52.044+0000 7f4473fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4474103890 0x7f4474199080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44986/0 (socket says 172.21.15.79:44986) 2024-08-20T01:32:52.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:52.044+0000 7f4473fff640 1 -- 172.21.15.79:0/2721239453 learned_addr learned my addr 172.21.15.79:0/2721239453 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:32:52.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:52.044+0000 7f44791b9640 1 --2- 172.21.15.79:0/2721239453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4474104250 0x7f4474199cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:52.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:52.044+0000 7f44789b8640 1 --2- 172.21.15.79:0/2721239453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4474102730 0x7f4474198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:52.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:52.044+0000 7f4473fff640 1 -- 172.21.15.79:0/2721239453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4474104250 msgr2=0x7f4474199cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:52.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:52.044+0000 7f4473fff640 1 --2- 172.21.15.79:0/2721239453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4474104250 0x7f4474199cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:52.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:52.044+0000 7f4473fff640 1 -- 172.21.15.79:0/2721239453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4474102730 msgr2=0x7f4474198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:32:52.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:52.044+0000 7f4473fff640 1 --2- 172.21.15.79:0/2721239453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4474102730 0x7f4474198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:32:52.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:52.044+0000 7f4473fff640 1 -- 172.21.15.79:0/2721239453 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f447419a560 con 0x7f4474103890 2024-08-20T01:32:52.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:52.044+0000 7f44789b8640 1 --2- 172.21.15.79:0/2721239453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4474102730 0x7f4474198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:32:52.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:52.045+0000 7f4473fff640 1 --2- 172.21.15.79:0/2721239453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4474103890 0x7f4474199080 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4460009a50 tx=0x7f4460004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:52.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:52.045+0000 7f4471ffb640 1 -- 172.21.15.79:0/2721239453 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446003f030 con 0x7f4474103890 2024-08-20T01:32:52.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:52.045+0000 7f4471ffb640 1 -- 172.21.15.79:0/2721239453 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4460003a80 con 0x7f4474103890 2024-08-20T01:32:52.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:52.045+0000 7f447ac1c640 1 -- 172.21.15.79:0/2721239453 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f447419a7f0 con 0x7f4474103890 2024-08-20T01:32:52.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:52.045+0000 7f4471ffb640 1 -- 172.21.15.79:0/2721239453 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4460035070 con 0x7f4474103890 2024-08-20T01:32:52.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:52.045+0000 7f447ac1c640 1 -- 172.21.15.79:0/2721239453 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44741a0d60 con 0x7f4474103890 2024-08-20T01:32:52.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:52.046+0000 7f447ac1c640 1 -- 172.21.15.79:0/2721239453 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44741a0fc0 con 0x7f4474103890 2024-08-20T01:32:52.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:52.047+0000 7f4471ffb640 1 -- 172.21.15.79:0/2721239453 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f4460042030 con 0x7f4474103890 2024-08-20T01:32:52.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:52.048+0000 7f4471ffb640 1 --2- 172.21.15.79:0/2721239453 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f44640b3bd0 0x7f44640b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:32:52.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:52.048+0000 7f44789b8640 1 --2- 172.21.15.79:0/2721239453 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f44640b3bd0 0x7f44640b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:32:52.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:52.048+0000 7f4471ffb640 1 -- 172.21.15.79:0/2721239453 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5549+0+0 (secure 0 0 0) 0x7f4460103d40 con 0x7f4474103890 2024-08-20T01:32:52.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:52.049+0000 7f44789b8640 1 --2- 172.21.15.79:0/2721239453 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f44640b3bd0 0x7f44640b6090 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f44680058c0 tx=0x7f4468005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:32:52.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:52.051+0000 7f4471ffb640 1 -- 172.21.15.79:0/2721239453 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f44600cbe60 con 0x7f4474103890 2024-08-20T01:32:52.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:51 smithi175 ceph-mon[22392]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-08-20T01:32:52.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:51 smithi175 ceph-mon[22392]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-20T01:32:52.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:51 smithi175 ceph-mon[22392]: osdmap e47: 9 total, 8 up, 9 in 2024-08-20T01:32:52.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:51 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T01:32:52.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:51 smithi175 ceph-mon[22392]: from='osd.8 [v2:172.21.15.175:6816/1537762925,v1:172.21.15.175:6817/1537762925]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-08-20T01:32:52.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:51 smithi175 ceph-mon[22392]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-08-20T01:32:52.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:51 smithi175 ceph-mon[22392]: Detected new or changed devices on smithi175 2024-08-20T01:32:52.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:51 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:52.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:51 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:52.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:51 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T01:32:52.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:51 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-20T01:32:52.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:51 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-20T01:32:52.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:51 smithi175 ceph-mon[22392]: Adjusting osd_memory_target on smithi175 to 5696M 2024-08-20T01:32:52.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:51 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:52.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:51 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:32:52.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:51 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:32:52.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:51 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:32:52.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:32:52.235+0000 7f447ac1c640 1 -- 172.21.15.79:0/2721239453 --> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f4474105380 con 0x7f44640b3bd0 2024-08-20T01:32:52.923 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:52 smithi079 ceph-mon[18656]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-08-20T01:32:52.923 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:52 smithi079 ceph-mon[18656]: osdmap e48: 9 total, 8 up, 9 in 2024-08-20T01:32:52.923 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:52 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T01:32:52.923 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:52 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T01:32:52.923 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:52 smithi079 ceph-mon[18656]: from='client.14559 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:32:52.924 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:52 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:32:52.924 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:52 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:32:52.924 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:52 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:32:52.924 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:52 smithi079 ceph-mon[18656]: from='osd.8 ' entity='osd.8' 2024-08-20T01:32:52.924 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:52 smithi079 ceph-mon[18656]: osdmap e49: 9 total, 8 up, 9 in 2024-08-20T01:32:52.924 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:52 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T01:32:53.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:52 smithi081 ceph-mon[22209]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-08-20T01:32:53.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:52 smithi081 ceph-mon[22209]: osdmap e48: 9 total, 8 up, 9 in 2024-08-20T01:32:53.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:52 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T01:32:53.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:52 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T01:32:53.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:52 smithi081 ceph-mon[22209]: from='client.14559 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:32:53.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:52 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:32:53.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:52 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:32:53.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:52 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:32:53.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:52 smithi081 ceph-mon[22209]: from='osd.8 ' entity='osd.8' 2024-08-20T01:32:53.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:52 smithi081 ceph-mon[22209]: osdmap e49: 9 total, 8 up, 9 in 2024-08-20T01:32:53.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:52 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T01:32:53.138 INFO:journalctl@ceph.osd.8.smithi175.stdout:Aug 20 01:32:52 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-8[40676]: 2024-08-20T01:32:52.654+0000 7feef2476640 -1 osd.8 0 waiting for initial osdmap 2024-08-20T01:32:53.138 INFO:journalctl@ceph.osd.8.smithi175.stdout:Aug 20 01:32:52 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-8[40676]: 2024-08-20T01:32:52.813+0000 7feeea295640 -1 osd.8 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-20T01:32:53.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:52 smithi175 ceph-mon[22392]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-08-20T01:32:53.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:52 smithi175 ceph-mon[22392]: osdmap e48: 9 total, 8 up, 9 in 2024-08-20T01:32:53.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:52 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T01:32:53.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:52 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T01:32:53.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:52 smithi175 ceph-mon[22392]: from='client.14559 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:32:53.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:52 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:32:53.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:52 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:32:53.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:52 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:32:53.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:52 smithi175 ceph-mon[22392]: from='osd.8 ' entity='osd.8' 2024-08-20T01:32:53.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:52 smithi175 ceph-mon[22392]: osdmap e49: 9 total, 8 up, 9 in 2024-08-20T01:32:53.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:52 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T01:32:54.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:53 smithi081 ceph-mon[22209]: purged_snaps scrub starts 2024-08-20T01:32:54.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:53 smithi081 ceph-mon[22209]: purged_snaps scrub ok 2024-08-20T01:32:54.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:53 smithi081 ceph-mon[22209]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-08-20T01:32:54.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:53 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T01:32:54.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:53 smithi081 ceph-mon[22209]: osd.8 [v2:172.21.15.175:6816/1537762925,v1:172.21.15.175:6817/1537762925] boot 2024-08-20T01:32:54.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:53 smithi081 ceph-mon[22209]: osdmap e50: 9 total, 9 up, 9 in 2024-08-20T01:32:54.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:53 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T01:32:54.054 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:53 smithi079 ceph-mon[18656]: purged_snaps scrub starts 2024-08-20T01:32:54.054 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:53 smithi079 ceph-mon[18656]: purged_snaps scrub ok 2024-08-20T01:32:54.054 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:53 smithi079 ceph-mon[18656]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-08-20T01:32:54.054 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:53 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T01:32:54.054 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:53 smithi079 ceph-mon[18656]: osd.8 [v2:172.21.15.175:6816/1537762925,v1:172.21.15.175:6817/1537762925] boot 2024-08-20T01:32:54.054 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:53 smithi079 ceph-mon[18656]: osdmap e50: 9 total, 9 up, 9 in 2024-08-20T01:32:54.054 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:53 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T01:32:54.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:53 smithi175 ceph-mon[22392]: purged_snaps scrub starts 2024-08-20T01:32:54.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:53 smithi175 ceph-mon[22392]: purged_snaps scrub ok 2024-08-20T01:32:54.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:53 smithi175 ceph-mon[22392]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-08-20T01:32:54.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:53 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T01:32:54.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:53 smithi175 ceph-mon[22392]: osd.8 [v2:172.21.15.175:6816/1537762925,v1:172.21.15.175:6817/1537762925] boot 2024-08-20T01:32:54.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:53 smithi175 ceph-mon[22392]: osdmap e50: 9 total, 9 up, 9 in 2024-08-20T01:32:54.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:53 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T01:32:56.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:55 smithi081 ceph-mon[22209]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-08-20T01:32:56.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:55 smithi081 ceph-mon[22209]: osdmap e51: 9 total, 9 up, 9 in 2024-08-20T01:32:56.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:55 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/3225519857' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "82db8305-1d72-4bef-99d6-5486e4de5b03"} : dispatch 2024-08-20T01:32:56.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:55 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/3225519857' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "82db8305-1d72-4bef-99d6-5486e4de5b03"}]': finished 2024-08-20T01:32:56.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:55 smithi081 ceph-mon[22209]: osdmap e52: 10 total, 9 up, 10 in 2024-08-20T01:32:56.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:55 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T01:32:56.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:55 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/3914710174' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:32:56.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:55 smithi175 ceph-mon[22392]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-08-20T01:32:56.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:55 smithi175 ceph-mon[22392]: osdmap e51: 9 total, 9 up, 9 in 2024-08-20T01:32:56.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:55 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/3225519857' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "82db8305-1d72-4bef-99d6-5486e4de5b03"} : dispatch 2024-08-20T01:32:56.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:55 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/3225519857' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "82db8305-1d72-4bef-99d6-5486e4de5b03"}]': finished 2024-08-20T01:32:56.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:55 smithi175 ceph-mon[22392]: osdmap e52: 10 total, 9 up, 10 in 2024-08-20T01:32:56.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:55 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T01:32:56.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:55 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/3914710174' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:32:56.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:55 smithi079 ceph-mon[18656]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-08-20T01:32:56.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:55 smithi079 ceph-mon[18656]: osdmap e51: 9 total, 9 up, 9 in 2024-08-20T01:32:56.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:55 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/3225519857' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "82db8305-1d72-4bef-99d6-5486e4de5b03"} : dispatch 2024-08-20T01:32:56.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:55 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/3225519857' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "82db8305-1d72-4bef-99d6-5486e4de5b03"}]': finished 2024-08-20T01:32:56.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:55 smithi079 ceph-mon[18656]: osdmap e52: 10 total, 9 up, 10 in 2024-08-20T01:32:56.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:55 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T01:32:56.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:55 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/3914710174' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:32:58.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:57 smithi081 ceph-mon[22209]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-20T01:32:58.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:57 smithi175 ceph-mon[22392]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-20T01:32:58.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:57 smithi079 ceph-mon[18656]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-20T01:33:00.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:32:59 smithi081 ceph-mon[22209]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-08-20T01:33:00.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:32:59 smithi175 ceph-mon[22392]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-08-20T01:33:00.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:32:59 smithi079 ceph-mon[18656]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-08-20T01:33:02.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:01 smithi081 ceph-mon[22209]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-08-20T01:33:02.043 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:01 smithi079 ceph-mon[18656]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-08-20T01:33:02.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:01 smithi175 ceph-mon[22392]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-08-20T01:33:03.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:03 smithi079 ceph-mon[18656]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-20T01:33:04.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:03 smithi081 ceph-mon[22209]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-20T01:33:04.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:03 smithi175 ceph-mon[22392]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-20T01:33:05.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:04 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-08-20T01:33:05.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:04 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:33:05.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:04 smithi081 ceph-mon[22209]: Deploying daemon osd.9 on smithi079 2024-08-20T01:33:05.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:04 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-08-20T01:33:05.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:04 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:33:05.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:04 smithi175 ceph-mon[22392]: Deploying daemon osd.9 on smithi079 2024-08-20T01:33:05.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:04 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-08-20T01:33:05.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:04 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:33:05.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:04 smithi079 ceph-mon[18656]: Deploying daemon osd.9 on smithi079 2024-08-20T01:33:05.863 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:05 smithi079 ceph-mon[18656]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-08-20T01:33:06.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:05 smithi081 ceph-mon[22209]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-08-20T01:33:06.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:05 smithi175 ceph-mon[22392]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-08-20T01:33:07.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:07 smithi079 ceph-mon[18656]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-08-20T01:33:08.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:07 smithi081 ceph-mon[22209]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-08-20T01:33:08.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:07 smithi175 ceph-mon[22392]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-08-20T01:33:10.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:09 smithi175 ceph-mon[22392]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-08-20T01:33:10.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:09 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:33:10.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:09 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:10.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:09 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:10.143 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:09 smithi079 ceph-mon[18656]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-08-20T01:33:10.143 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:09 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:33:10.143 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:09 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:10.143 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:09 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:10.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:09 smithi081 ceph-mon[22209]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-08-20T01:33:10.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:09 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:33:10.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:09 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:10.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:09 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:12.048 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:11 smithi079 ceph-mon[18656]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-08-20T01:33:12.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:11 smithi175 ceph-mon[22392]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-08-20T01:33:12.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:11 smithi081 ceph-mon[22209]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-08-20T01:33:13.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:33:13.234+0000 7f4471ffb640 1 -- 172.21.15.79:0/2721239453 <== mgr.14150 v2:172.21.15.79:6800/3038112779 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4474105380 con 0x7f44640b3bd0 2024-08-20T01:33:13.236 INFO:teuthology.orchestra.run.smithi079.stdout:Created osd(s) 9 on host 'smithi079' 2024-08-20T01:33:13.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:33:13.236+0000 7f447ac1c640 1 -- 172.21.15.79:0/2721239453 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f44640b3bd0 msgr2=0x7f44640b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:13.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:33:13.236+0000 7f447ac1c640 1 --2- 172.21.15.79:0/2721239453 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f44640b3bd0 0x7f44640b6090 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f44680058c0 tx=0x7f4468005d30 comp rx=0 tx=0).stop 2024-08-20T01:33:13.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:33:13.236+0000 7f447ac1c640 1 -- 172.21.15.79:0/2721239453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4474103890 msgr2=0x7f4474199080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:13.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:33:13.236+0000 7f447ac1c640 1 --2- 172.21.15.79:0/2721239453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4474103890 0x7f4474199080 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4460009a50 tx=0x7f4460004270 comp rx=0 tx=0).stop 2024-08-20T01:33:13.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:33:13.236+0000 7f447ac1c640 1 -- 172.21.15.79:0/2721239453 shutdown_connections 2024-08-20T01:33:13.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:33:13.236+0000 7f447ac1c640 1 --2- 172.21.15.79:0/2721239453 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f44640b3bd0 0x7f44640b6090 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:13.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:33:13.236+0000 7f447ac1c640 1 --2- 172.21.15.79:0/2721239453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4474104250 0x7f4474199cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:13.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:33:13.236+0000 7f447ac1c640 1 --2- 172.21.15.79:0/2721239453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4474103890 0x7f4474199080 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:13.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:33:13.236+0000 7f447ac1c640 1 --2- 172.21.15.79:0/2721239453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4474102730 0x7f4474198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:13.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:33:13.236+0000 7f447ac1c640 1 -- 172.21.15.79:0/2721239453 >> 172.21.15.79:0/2721239453 conn(0x7f44740fe020 msgr2=0x7f4474104c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:13.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:33:13.236+0000 7f447ac1c640 1 -- 172.21.15.79:0/2721239453 shutdown_connections 2024-08-20T01:33:13.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:33:13.237+0000 7f447ac1c640 1 -- 172.21.15.79:0/2721239453 wait complete. 2024-08-20T01:33:13.584 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:13 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:13.584 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:13 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:13.584 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:13 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:33:13.585 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:13 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:33:13.585 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:13 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:13.585 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:13 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:33:13.585 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:13 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:13.585 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:13 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:13.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:13 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:13.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:13 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:13.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:13 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:33:13.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:13 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:33:13.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:13 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:13.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:13 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:33:13.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:13 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:13.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:13 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:13.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:13 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:13.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:13 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:13.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:13 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:33:13.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:13 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:33:13.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:13 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:13.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:13 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:33:13.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:13 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:13.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:13 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:13.927 DEBUG:teuthology.orchestra.run.smithi079:osd.9> sudo journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@osd.9.service 2024-08-20T01:33:13.931 INFO:tasks.cephadm:Deploying osd.10 on smithi081 with /dev/vg_nvme/lv_1... 2024-08-20T01:33:13.931 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-20T01:33:14.187 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.b/config 2024-08-20T01:33:14.589 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:14 smithi081 ceph-mon[22209]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-08-20T01:33:14.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:14 smithi079 ceph-mon[18656]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-08-20T01:33:14.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:14 smithi175 ceph-mon[22392]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-08-20T01:33:15.068 INFO:journalctl@ceph.osd.9.smithi079.stdout:Aug 20 01:33:14 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-9[51886]: 2024-08-20T01:33:14.832+0000 7fcbb50a9640 -1 osd.9 0 log_to_monitors true 2024-08-20T01:33:15.547 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:15 smithi081 ceph-mon[22209]: from='osd.9 [v2:172.21.15.79:6826/2400574113,v1:172.21.15.79:6827/2400574113]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-08-20T01:33:15.629 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:15 smithi079 ceph-mon[18656]: from='osd.9 [v2:172.21.15.79:6826/2400574113,v1:172.21.15.79:6827/2400574113]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-08-20T01:33:15.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:15 smithi175 ceph-mon[22392]: from='osd.9 [v2:172.21.15.79:6826/2400574113,v1:172.21.15.79:6827/2400574113]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-08-20T01:33:16.528 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-08-20T01:33:16.553 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi081:vg_nvme/lv_1 2024-08-20T01:33:16.759 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:16 smithi079 ceph-mon[18656]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-08-20T01:33:16.759 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:16 smithi079 ceph-mon[18656]: from='osd.9 [v2:172.21.15.79:6826/2400574113,v1:172.21.15.79:6827/2400574113]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-20T01:33:16.759 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:16 smithi079 ceph-mon[18656]: osdmap e53: 10 total, 9 up, 10 in 2024-08-20T01:33:16.760 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:16 smithi079 ceph-mon[18656]: from='osd.9 [v2:172.21.15.79:6826/2400574113,v1:172.21.15.79:6827/2400574113]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-08-20T01:33:16.760 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:16 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T01:33:16.760 INFO:journalctl@ceph.osd.9.smithi079.stdout:Aug 20 01:33:16 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-9[51886]: 2024-08-20T01:33:16.452+0000 7fcbb102c640 -1 osd.9 0 waiting for initial osdmap 2024-08-20T01:33:16.760 INFO:journalctl@ceph.osd.9.smithi079.stdout:Aug 20 01:33:16 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-9[51886]: 2024-08-20T01:33:16.465+0000 7fcbace53640 -1 osd.9 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-20T01:33:16.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:16 smithi081 ceph-mon[22209]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-08-20T01:33:16.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:16 smithi081 ceph-mon[22209]: from='osd.9 [v2:172.21.15.79:6826/2400574113,v1:172.21.15.79:6827/2400574113]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-20T01:33:16.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:16 smithi081 ceph-mon[22209]: osdmap e53: 10 total, 9 up, 10 in 2024-08-20T01:33:16.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:16 smithi081 ceph-mon[22209]: from='osd.9 [v2:172.21.15.79:6826/2400574113,v1:172.21.15.79:6827/2400574113]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-08-20T01:33:16.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:16 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T01:33:16.800 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.b/config 2024-08-20T01:33:16.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:16 smithi175 ceph-mon[22392]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-08-20T01:33:16.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:16 smithi175 ceph-mon[22392]: from='osd.9 [v2:172.21.15.79:6826/2400574113,v1:172.21.15.79:6827/2400574113]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-20T01:33:16.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:16 smithi175 ceph-mon[22392]: osdmap e53: 10 total, 9 up, 10 in 2024-08-20T01:33:16.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:16 smithi175 ceph-mon[22392]: from='osd.9 [v2:172.21.15.79:6826/2400574113,v1:172.21.15.79:6827/2400574113]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-08-20T01:33:16.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:16 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T01:33:17.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:17.268+0000 7f5b26df9640 1 -- 172.21.15.81:0/2779730990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b20101610 msgr2=0x7f5b20101a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:17.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:17.268+0000 7f5b26df9640 1 --2- 172.21.15.81:0/2779730990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b20101610 0x7f5b20101a10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5b14009930 tx=0x7f5b1402a420 comp rx=0 tx=0).stop 2024-08-20T01:33:17.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:17.268+0000 7f5b26df9640 1 -- 172.21.15.81:0/2779730990 shutdown_connections 2024-08-20T01:33:17.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:17.268+0000 7f5b26df9640 1 --2- 172.21.15.81:0/2779730990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b20103130 0x7f5b20109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:17.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:17.268+0000 7f5b26df9640 1 --2- 172.21.15.81:0/2779730990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b20102770 0x7f5b20102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:17.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:17.268+0000 7f5b26df9640 1 --2- 172.21.15.81:0/2779730990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b20101610 0x7f5b20101a10 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:17.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:17.268+0000 7f5b26df9640 1 -- 172.21.15.81:0/2779730990 >> 172.21.15.81:0/2779730990 conn(0x7f5b200fcee0 msgr2=0x7f5b200ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:17.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:17.268+0000 7f5b26df9640 1 -- 172.21.15.81:0/2779730990 shutdown_connections 2024-08-20T01:33:17.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:17.268+0000 7f5b26df9640 1 -- 172.21.15.81:0/2779730990 wait complete. 2024-08-20T01:33:17.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:17.269+0000 7f5b26df9640 1 Processor -- start 2024-08-20T01:33:17.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:17.269+0000 7f5b26df9640 1 -- start start 2024-08-20T01:33:17.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:17.269+0000 7f5b26df9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b20101610 0x7f5b20105360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:17.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:17.269+0000 7f5b26df9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b20102770 0x7f5b20103c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:17.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:17.269+0000 7f5b26df9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b20103130 0x7f5b20104180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:17.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:17.269+0000 7f5b26df9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2010d120 con 0x7f5b20102770 2024-08-20T01:33:17.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:17.269+0000 7f5b26df9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2010cfa0 con 0x7f5b20101610 2024-08-20T01:33:17.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:17.269+0000 7f5b26df9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2010d2a0 con 0x7f5b20103130 2024-08-20T01:33:17.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:17.269+0000 7f5b24b95640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b20101610 0x7f5b20105360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:17.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:17.269+0000 7f5b24b95640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b20101610 0x7f5b20105360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55950/0 (socket says 172.21.15.81:55950) 2024-08-20T01:33:17.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:17.269+0000 7f5b24b95640 1 -- 172.21.15.81:0/2201667733 learned_addr learned my addr 172.21.15.81:0/2201667733 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-08-20T01:33:17.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:17.269+0000 7f5b1ffff640 1 --2- 172.21.15.81:0/2201667733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b20102770 0x7f5b20103c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:17.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:17.269+0000 7f5b25396640 1 --2- 172.21.15.81:0/2201667733 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b20103130 0x7f5b20104180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:17.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:17.269+0000 7f5b24b95640 1 -- 172.21.15.81:0/2201667733 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b20103130 msgr2=0x7f5b20104180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:17.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:17.269+0000 7f5b24b95640 1 --2- 172.21.15.81:0/2201667733 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b20103130 0x7f5b20104180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:17.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:17.269+0000 7f5b24b95640 1 -- 172.21.15.81:0/2201667733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b20102770 msgr2=0x7f5b20103c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:17.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:17.269+0000 7f5b24b95640 1 --2- 172.21.15.81:0/2201667733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b20102770 0x7f5b20103c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:17.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:17.269+0000 7f5b24b95640 1 -- 172.21.15.81:0/2201667733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b20104980 con 0x7f5b20101610 2024-08-20T01:33:17.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:17.269+0000 7f5b25396640 1 --2- 172.21.15.81:0/2201667733 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b20103130 0x7f5b20104180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:33:17.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:17.270+0000 7f5b24b95640 1 --2- 172.21.15.81:0/2201667733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b20101610 0x7f5b20105360 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5b14009a50 tx=0x7f5b14032f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:17.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:17.270+0000 7f5b1dffb640 1 -- 172.21.15.81:0/2201667733 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1403f030 con 0x7f5b20101610 2024-08-20T01:33:17.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:17.270+0000 7f5b1dffb640 1 -- 172.21.15.81:0/2201667733 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b140044b0 con 0x7f5b20101610 2024-08-20T01:33:17.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:17.270+0000 7f5b26df9640 1 -- 172.21.15.81:0/2201667733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b201a2a50 con 0x7f5b20101610 2024-08-20T01:33:17.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:17.270+0000 7f5b1dffb640 1 -- 172.21.15.81:0/2201667733 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b14035070 con 0x7f5b20101610 2024-08-20T01:33:17.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:17.270+0000 7f5b26df9640 1 -- 172.21.15.81:0/2201667733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b201a2f00 con 0x7f5b20101610 2024-08-20T01:33:17.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:17.271+0000 7f5b26df9640 1 -- 172.21.15.81:0/2201667733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b201a30d0 con 0x7f5b20101610 2024-08-20T01:33:17.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:17.272+0000 7f5b1dffb640 1 -- 172.21.15.81:0/2201667733 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f5b14042030 con 0x7f5b20101610 2024-08-20T01:33:17.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:17.273+0000 7f5b1dffb640 1 --2- 172.21.15.81:0/2201667733 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5b100b3bd0 0x7f5b100b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:17.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:17.273+0000 7f5b1dffb640 1 -- 172.21.15.81:0/2201667733 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5981+0+0 (secure 0 0 0) 0x7f5b141040d0 con 0x7f5b20101610 2024-08-20T01:33:17.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:17.273+0000 7f5b1ffff640 1 --2- 172.21.15.81:0/2201667733 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5b100b3bd0 0x7f5b100b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:17.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:17.274+0000 7f5b1ffff640 1 --2- 172.21.15.81:0/2201667733 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5b100b3bd0 0x7f5b100b6090 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c005e10 tx=0x7f5b0c005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:17.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:17.276+0000 7f5b1dffb640 1 -- 172.21.15.81:0/2201667733 <== mon.2 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f5b140cc040 con 0x7f5b20101610 2024-08-20T01:33:17.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:17.465+0000 7f5b26df9640 1 -- 172.21.15.81:0/2201667733 --> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f5b200ff0c0 con 0x7f5b100b3bd0 2024-08-20T01:33:17.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:17 smithi081 ceph-mon[22209]: from='osd.9 [v2:172.21.15.79:6826/2400574113,v1:172.21.15.79:6827/2400574113]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-08-20T01:33:17.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:17 smithi081 ceph-mon[22209]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-08-20T01:33:17.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:17 smithi081 ceph-mon[22209]: osdmap e54: 10 total, 9 up, 10 in 2024-08-20T01:33:17.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:17 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T01:33:17.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:17 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T01:33:17.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:17 smithi081 ceph-mon[22209]: Detected new or changed devices on smithi079 2024-08-20T01:33:17.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:17 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:17.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:17 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:17.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:17 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T01:33:17.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:17 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-20T01:33:17.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:17 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-20T01:33:17.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:17 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-20T01:33:17.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:17 smithi081 ceph-mon[22209]: Adjusting osd_memory_target on smithi079 to 4272M 2024-08-20T01:33:17.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:17 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:17.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:17 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:33:17.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:17 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:33:17.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:17 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:17.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:17 smithi175 ceph-mon[22392]: from='osd.9 [v2:172.21.15.79:6826/2400574113,v1:172.21.15.79:6827/2400574113]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-08-20T01:33:17.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:17 smithi175 ceph-mon[22392]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-08-20T01:33:17.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:17 smithi175 ceph-mon[22392]: osdmap e54: 10 total, 9 up, 10 in 2024-08-20T01:33:17.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:17 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T01:33:17.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:17 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T01:33:17.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:17 smithi175 ceph-mon[22392]: Detected new or changed devices on smithi079 2024-08-20T01:33:17.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:17 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:17.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:17 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:17.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:17 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T01:33:17.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:17 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-20T01:33:17.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:17 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-20T01:33:17.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:17 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-20T01:33:17.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:17 smithi175 ceph-mon[22392]: Adjusting osd_memory_target on smithi079 to 4272M 2024-08-20T01:33:17.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:17 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:17.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:17 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:33:17.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:17 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:33:17.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:17 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:17.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:17 smithi079 ceph-mon[18656]: from='osd.9 [v2:172.21.15.79:6826/2400574113,v1:172.21.15.79:6827/2400574113]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-08-20T01:33:17.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:17 smithi079 ceph-mon[18656]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-08-20T01:33:17.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:17 smithi079 ceph-mon[18656]: osdmap e54: 10 total, 9 up, 10 in 2024-08-20T01:33:17.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:17 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T01:33:17.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:17 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T01:33:17.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:17 smithi079 ceph-mon[18656]: Detected new or changed devices on smithi079 2024-08-20T01:33:17.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:17 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:17.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:17 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:17.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:17 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T01:33:17.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:17 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-20T01:33:17.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:17 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-20T01:33:17.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:17 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-20T01:33:17.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:17 smithi079 ceph-mon[18656]: Adjusting osd_memory_target on smithi079 to 4272M 2024-08-20T01:33:17.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:17 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:17.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:17 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:33:17.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:17 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:33:17.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:17 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:18.457 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:18 smithi081 ceph-mon[22209]: purged_snaps scrub starts 2024-08-20T01:33:18.457 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:18 smithi081 ceph-mon[22209]: purged_snaps scrub ok 2024-08-20T01:33:18.457 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:18 smithi081 ceph-mon[22209]: osd.9 [v2:172.21.15.79:6826/2400574113,v1:172.21.15.79:6827/2400574113] boot 2024-08-20T01:33:18.457 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:18 smithi081 ceph-mon[22209]: osdmap e55: 10 total, 10 up, 10 in 2024-08-20T01:33:18.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:18 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T01:33:18.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:18 smithi081 ceph-mon[22209]: from='client.24410 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:33:18.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:18 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:33:18.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:18 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:33:18.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:18 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:33:18.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:18 smithi175 ceph-mon[22392]: purged_snaps scrub starts 2024-08-20T01:33:18.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:18 smithi175 ceph-mon[22392]: purged_snaps scrub ok 2024-08-20T01:33:18.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:18 smithi175 ceph-mon[22392]: osd.9 [v2:172.21.15.79:6826/2400574113,v1:172.21.15.79:6827/2400574113] boot 2024-08-20T01:33:18.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:18 smithi175 ceph-mon[22392]: osdmap e55: 10 total, 10 up, 10 in 2024-08-20T01:33:18.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:18 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T01:33:18.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:18 smithi175 ceph-mon[22392]: from='client.24410 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:33:18.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:18 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:33:18.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:18 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:33:18.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:18 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:33:18.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:18 smithi079 ceph-mon[18656]: purged_snaps scrub starts 2024-08-20T01:33:18.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:18 smithi079 ceph-mon[18656]: purged_snaps scrub ok 2024-08-20T01:33:18.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:18 smithi079 ceph-mon[18656]: osd.9 [v2:172.21.15.79:6826/2400574113,v1:172.21.15.79:6827/2400574113] boot 2024-08-20T01:33:18.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:18 smithi079 ceph-mon[18656]: osdmap e55: 10 total, 10 up, 10 in 2024-08-20T01:33:18.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:18 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T01:33:18.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:18 smithi079 ceph-mon[18656]: from='client.24410 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:33:18.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:18 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:33:18.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:18 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:33:18.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:18 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:33:19.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:19 smithi081 ceph-mon[22209]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:33:19.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:19 smithi081 ceph-mon[22209]: osdmap e56: 10 total, 10 up, 10 in 2024-08-20T01:33:19.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:19 smithi175 ceph-mon[22392]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:33:19.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:19 smithi175 ceph-mon[22392]: osdmap e56: 10 total, 10 up, 10 in 2024-08-20T01:33:19.928 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:19 smithi079 ceph-mon[18656]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:33:19.928 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:19 smithi079 ceph-mon[18656]: osdmap e56: 10 total, 10 up, 10 in 2024-08-20T01:33:20.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:20 smithi081 ceph-mon[22209]: from='client.? 172.21.15.81:0/372680276' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "797e1e3f-12b5-4958-9e1f-f796cffaaf34"} : dispatch 2024-08-20T01:33:20.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:20 smithi081 ceph-mon[22209]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "797e1e3f-12b5-4958-9e1f-f796cffaaf34"} : dispatch 2024-08-20T01:33:20.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:20 smithi081 ceph-mon[22209]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "797e1e3f-12b5-4958-9e1f-f796cffaaf34"}]': finished 2024-08-20T01:33:20.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:20 smithi081 ceph-mon[22209]: osdmap e57: 11 total, 10 up, 11 in 2024-08-20T01:33:20.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:20 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T01:33:20.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:20 smithi081 ceph-mon[22209]: from='client.? 172.21.15.81:0/954453139' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:33:20.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:20 smithi175 ceph-mon[22392]: from='client.? 172.21.15.81:0/372680276' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "797e1e3f-12b5-4958-9e1f-f796cffaaf34"} : dispatch 2024-08-20T01:33:20.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:20 smithi175 ceph-mon[22392]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "797e1e3f-12b5-4958-9e1f-f796cffaaf34"} : dispatch 2024-08-20T01:33:20.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:20 smithi175 ceph-mon[22392]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "797e1e3f-12b5-4958-9e1f-f796cffaaf34"}]': finished 2024-08-20T01:33:20.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:20 smithi175 ceph-mon[22392]: osdmap e57: 11 total, 10 up, 11 in 2024-08-20T01:33:20.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:20 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T01:33:20.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:20 smithi175 ceph-mon[22392]: from='client.? 172.21.15.81:0/954453139' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:33:20.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:20 smithi079 ceph-mon[18656]: from='client.? 172.21.15.81:0/372680276' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "797e1e3f-12b5-4958-9e1f-f796cffaaf34"} : dispatch 2024-08-20T01:33:20.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:20 smithi079 ceph-mon[18656]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "797e1e3f-12b5-4958-9e1f-f796cffaaf34"} : dispatch 2024-08-20T01:33:20.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:20 smithi079 ceph-mon[18656]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "797e1e3f-12b5-4958-9e1f-f796cffaaf34"}]': finished 2024-08-20T01:33:20.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:20 smithi079 ceph-mon[18656]: osdmap e57: 11 total, 10 up, 11 in 2024-08-20T01:33:20.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:20 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T01:33:20.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:20 smithi079 ceph-mon[18656]: from='client.? 172.21.15.81:0/954453139' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:33:22.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:21 smithi175 ceph-mon[22392]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:33:22.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:21 smithi079 ceph-mon[18656]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:33:22.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:21 smithi081 ceph-mon[22209]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:33:24.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:23 smithi175 ceph-mon[22392]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:33:24.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:23 smithi079 ceph-mon[18656]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:33:24.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:23 smithi081 ceph-mon[22209]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:33:26.106 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:25 smithi081 ceph-mon[22209]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:33:26.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:25 smithi175 ceph-mon[22392]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:33:26.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:25 smithi079 ceph-mon[18656]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:33:28.132 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:27 smithi081 ceph-mon[22209]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:33:28.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:27 smithi175 ceph-mon[22392]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:33:28.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:27 smithi079 ceph-mon[18656]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:33:29.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:28 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-08-20T01:33:29.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:28 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:33:29.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:28 smithi175 ceph-mon[22392]: Deploying daemon osd.10 on smithi081 2024-08-20T01:33:29.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:28 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-08-20T01:33:29.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:28 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:33:29.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:28 smithi079 ceph-mon[18656]: Deploying daemon osd.10 on smithi081 2024-08-20T01:33:29.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:28 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-08-20T01:33:29.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:28 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:33:29.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:28 smithi081 ceph-mon[22209]: Deploying daemon osd.10 on smithi081 2024-08-20T01:33:30.064 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:29 smithi081 ceph-mon[22209]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:33:30.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:29 smithi175 ceph-mon[22392]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:33:30.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:29 smithi079 ceph-mon[18656]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:33:32.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:31 smithi081 ceph-mon[22209]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:33:32.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:31 smithi175 ceph-mon[22392]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:33:32.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:31 smithi079 ceph-mon[18656]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:33:34.119 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:33 smithi081 ceph-mon[22209]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:33:34.119 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:33 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:33:34.119 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:33 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:34.119 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:33 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:34.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:33 smithi175 ceph-mon[22392]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:33:34.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:33 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:33:34.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:33 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:34.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:33 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:34.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:33 smithi079 ceph-mon[18656]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:33:34.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:33 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:33:34.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:33 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:34.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:33 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:36.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:35 smithi175 ceph-mon[22392]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:33:36.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:35 smithi079 ceph-mon[18656]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:33:36.264 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:35 smithi081 ceph-mon[22209]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:33:36.927 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 10 on host 'smithi081' 2024-08-20T01:33:36.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:36.925+0000 7f5b1dffb640 1 -- 172.21.15.81:0/2201667733 <== mgr.14150 v2:172.21.15.79:6800/3038112779 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f5b200ff0c0 con 0x7f5b100b3bd0 2024-08-20T01:33:36.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:36.928+0000 7f5b26df9640 1 -- 172.21.15.81:0/2201667733 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5b100b3bd0 msgr2=0x7f5b100b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:36.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:36.928+0000 7f5b26df9640 1 --2- 172.21.15.81:0/2201667733 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5b100b3bd0 0x7f5b100b6090 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c005e10 tx=0x7f5b0c005da0 comp rx=0 tx=0).stop 2024-08-20T01:33:36.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:36.928+0000 7f5b26df9640 1 -- 172.21.15.81:0/2201667733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b20101610 msgr2=0x7f5b20105360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:36.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:36.928+0000 7f5b26df9640 1 --2- 172.21.15.81:0/2201667733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b20101610 0x7f5b20105360 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5b14009a50 tx=0x7f5b14032f90 comp rx=0 tx=0).stop 2024-08-20T01:33:36.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:36.928+0000 7f5b26df9640 1 -- 172.21.15.81:0/2201667733 shutdown_connections 2024-08-20T01:33:36.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:36.928+0000 7f5b26df9640 1 --2- 172.21.15.81:0/2201667733 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5b100b3bd0 0x7f5b100b6090 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:36.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:36.928+0000 7f5b26df9640 1 --2- 172.21.15.81:0/2201667733 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b20103130 0x7f5b20104180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:36.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:36.928+0000 7f5b26df9640 1 --2- 172.21.15.81:0/2201667733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b20102770 0x7f5b20103c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:36.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:36.928+0000 7f5b26df9640 1 --2- 172.21.15.81:0/2201667733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b20101610 0x7f5b20105360 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:36.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:36.928+0000 7f5b26df9640 1 -- 172.21.15.81:0/2201667733 >> 172.21.15.81:0/2201667733 conn(0x7f5b200fcee0 msgr2=0x7f5b200fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:36.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:36.928+0000 7f5b26df9640 1 -- 172.21.15.81:0/2201667733 shutdown_connections 2024-08-20T01:33:36.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-08-20T01:33:36.928+0000 7f5b26df9640 1 -- 172.21.15.81:0/2201667733 wait complete. 2024-08-20T01:33:37.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:37 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:37.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:37 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:37.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:37 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:33:37.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:37 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:33:37.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:37 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:37.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:37 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:33:37.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:37 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:37.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:37 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:37.587 DEBUG:teuthology.orchestra.run.smithi081:osd.10> sudo journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@osd.10.service 2024-08-20T01:33:37.590 INFO:tasks.cephadm:Deploying osd.11 on smithi175 with /dev/vg_nvme/lv_1... 2024-08-20T01:33:37.590 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-20T01:33:37.619 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:37 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:37.619 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:37 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:37.619 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:37 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:33:37.619 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:37 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:33:37.619 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:37 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:37.619 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:37 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:33:37.620 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:37 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:37.620 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:37 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:37.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:37 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:37.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:37 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:37.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:37 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:33:37.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:37 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:33:37.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:37 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:37.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:37 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:33:37.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:37 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:37.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:37 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:37.847 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T01:33:38.610 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:38 smithi081 ceph-mon[22209]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:33:38.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:38 smithi175 ceph-mon[22392]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:33:38.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:38 smithi079 ceph-mon[18656]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:33:39.156 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:33:39 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-10[46759]: 2024-08-20T01:33:39.075+0000 7f6918135640 -1 osd.10 0 log_to_monitors true 2024-08-20T01:33:39.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:39 smithi081 ceph-mon[22209]: from='osd.10 [v2:172.21.15.81:6824/4188407500,v1:172.21.15.81:6825/4188407500]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-20T01:33:39.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:39 smithi081 ceph-mon[22209]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-20T01:33:39.606 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:39 smithi175 ceph-mon[22392]: from='osd.10 [v2:172.21.15.81:6824/4188407500,v1:172.21.15.81:6825/4188407500]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-20T01:33:39.606 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:39 smithi175 ceph-mon[22392]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-20T01:33:39.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:39 smithi079 ceph-mon[18656]: from='osd.10 [v2:172.21.15.81:6824/4188407500,v1:172.21.15.81:6825/4188407500]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-20T01:33:39.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:39 smithi079 ceph-mon[18656]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-20T01:33:40.208 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-08-20T01:33:40.234 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi175:vg_nvme/lv_1 2024-08-20T01:33:40.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:40 smithi175 ceph-mon[22392]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:33:40.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:40 smithi175 ceph-mon[22392]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-20T01:33:40.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:40 smithi175 ceph-mon[22392]: osdmap e58: 11 total, 10 up, 11 in 2024-08-20T01:33:40.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:40 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T01:33:40.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:40 smithi175 ceph-mon[22392]: from='osd.10 [v2:172.21.15.81:6824/4188407500,v1:172.21.15.81:6825/4188407500]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-08-20T01:33:40.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:40 smithi175 ceph-mon[22392]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-08-20T01:33:40.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:40 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:40.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:40 smithi081 ceph-mon[22209]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:33:40.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:40 smithi081 ceph-mon[22209]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-20T01:33:40.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:40 smithi081 ceph-mon[22209]: osdmap e58: 11 total, 10 up, 11 in 2024-08-20T01:33:40.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:40 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T01:33:40.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:40 smithi081 ceph-mon[22209]: from='osd.10 [v2:172.21.15.81:6824/4188407500,v1:172.21.15.81:6825/4188407500]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-08-20T01:33:40.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:40 smithi081 ceph-mon[22209]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-08-20T01:33:40.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:40 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:40.532 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T01:33:40.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:40 smithi079 ceph-mon[18656]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:33:40.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:40 smithi079 ceph-mon[18656]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-20T01:33:40.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:40 smithi079 ceph-mon[18656]: osdmap e58: 11 total, 10 up, 11 in 2024-08-20T01:33:40.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:40 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T01:33:40.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:40 smithi079 ceph-mon[18656]: from='osd.10 [v2:172.21.15.81:6824/4188407500,v1:172.21.15.81:6825/4188407500]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-08-20T01:33:40.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:40 smithi079 ceph-mon[18656]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-08-20T01:33:40.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:40 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:41.012 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:33:41.008+0000 7f64ca80a640 1 -- 172.21.15.175:0/3861910034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64c4101610 msgr2=0x7f64c4101a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:41.012 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:33:41.008+0000 7f64ca80a640 1 --2- 172.21.15.175:0/3861910034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64c4101610 0x7f64c4101a10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f64b4009960 tx=0x7f64b402a460 comp rx=0 tx=0).stop 2024-08-20T01:33:41.012 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:33:41.008+0000 7f64ca80a640 1 -- 172.21.15.175:0/3861910034 shutdown_connections 2024-08-20T01:33:41.012 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:33:41.008+0000 7f64ca80a640 1 --2- 172.21.15.175:0/3861910034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64c4103130 0x7f64c4109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:41.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:33:41.008+0000 7f64ca80a640 1 --2- 172.21.15.175:0/3861910034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64c4102770 0x7f64c4102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:41.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:33:41.008+0000 7f64ca80a640 1 --2- 172.21.15.175:0/3861910034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64c4101610 0x7f64c4101a10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:41.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:33:41.008+0000 7f64ca80a640 1 -- 172.21.15.175:0/3861910034 >> 172.21.15.175:0/3861910034 conn(0x7f64c40fcee0 msgr2=0x7f64c40ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:33:41.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:33:41.008+0000 7f64ca80a640 1 -- 172.21.15.175:0/3861910034 shutdown_connections 2024-08-20T01:33:41.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:33:41.008+0000 7f64ca80a640 1 -- 172.21.15.175:0/3861910034 wait complete. 2024-08-20T01:33:41.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:33:41.009+0000 7f64ca80a640 1 Processor -- start 2024-08-20T01:33:41.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:33:41.009+0000 7f64ca80a640 1 -- start start 2024-08-20T01:33:41.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:33:41.009+0000 7f64ca80a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64c4101610 0x7f64c4198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:41.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:33:41.009+0000 7f64ca80a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64c4102770 0x7f64c41990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:41.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:33:41.009+0000 7f64ca80a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64c4103130 0x7f64c4199d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:41.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:33:41.009+0000 7f64ca80a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f64c410d170 con 0x7f64c4101610 2024-08-20T01:33:41.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:33:41.009+0000 7f64ca80a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f64c410cff0 con 0x7f64c4102770 2024-08-20T01:33:41.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:33:41.009+0000 7f64ca80a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f64c410d2f0 con 0x7f64c4103130 2024-08-20T01:33:41.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:33:41.009+0000 7f64c8da7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64c4103130 0x7f64c4199d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:41.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:33:41.009+0000 7f64c8da7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64c4103130 0x7f64c4199d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43076/0 (socket says 172.21.15.175:43076) 2024-08-20T01:33:41.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:33:41.009+0000 7f64c8da7640 1 -- 172.21.15.175:0/3138628659 learned_addr learned my addr 172.21.15.175:0/3138628659 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-08-20T01:33:41.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:33:41.009+0000 7f64bbfff640 1 --2- 172.21.15.175:0/3138628659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64c4102770 0x7f64c41990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:41.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:33:41.009+0000 7f64c3fff640 1 --2- 172.21.15.175:0/3138628659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64c4101610 0x7f64c4198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:41.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:33:41.009+0000 7f64c8da7640 1 -- 172.21.15.175:0/3138628659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64c4102770 msgr2=0x7f64c41990e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:41.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:33:41.009+0000 7f64c8da7640 1 --2- 172.21.15.175:0/3138628659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64c4102770 0x7f64c41990e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:41.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:33:41.009+0000 7f64c8da7640 1 -- 172.21.15.175:0/3138628659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64c4101610 msgr2=0x7f64c4198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:33:41.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:33:41.009+0000 7f64c8da7640 1 --2- 172.21.15.175:0/3138628659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64c4101610 0x7f64c4198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:33:41.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:33:41.009+0000 7f64c8da7640 1 -- 172.21.15.175:0/3138628659 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64c419a5c0 con 0x7f64c4103130 2024-08-20T01:33:41.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:33:41.010+0000 7f64c8da7640 1 --2- 172.21.15.175:0/3138628659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64c4103130 0x7f64c4199d20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f64bc00eaa0 tx=0x7f64bc00ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:41.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:33:41.010+0000 7f64c1ffb640 1 -- 172.21.15.175:0/3138628659 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64bc00cdb0 con 0x7f64c4103130 2024-08-20T01:33:41.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:33:41.010+0000 7f64ca80a640 1 -- 172.21.15.175:0/3138628659 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64c419a8b0 con 0x7f64c4103130 2024-08-20T01:33:41.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:33:41.010+0000 7f64c1ffb640 1 -- 172.21.15.175:0/3138628659 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f64bc005020 con 0x7f64c4103130 2024-08-20T01:33:41.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:33:41.010+0000 7f64c1ffb640 1 -- 172.21.15.175:0/3138628659 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64bc0116d0 con 0x7f64c4103130 2024-08-20T01:33:41.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:33:41.010+0000 7f64ca80a640 1 -- 172.21.15.175:0/3138628659 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64c41a0f90 con 0x7f64c4103130 2024-08-20T01:33:41.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:33:41.011+0000 7f64ca80a640 1 -- 172.21.15.175:0/3138628659 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64c41a1160 con 0x7f64c4103130 2024-08-20T01:33:41.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:33:41.012+0000 7f64c1ffb640 1 -- 172.21.15.175:0/3138628659 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f64bc0051d0 con 0x7f64c4103130 2024-08-20T01:33:41.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:33:41.013+0000 7f64c1ffb640 1 --2- 172.21.15.175:0/3138628659 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f64b00b3bd0 0x7f64b00b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:33:41.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:33:41.013+0000 7f64c3fff640 1 --2- 172.21.15.175:0/3138628659 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f64b00b3bd0 0x7f64b00b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:33:41.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:33:41.013+0000 7f64c1ffb640 1 -- 172.21.15.175:0/3138628659 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6414+0+0 (secure 0 0 0) 0x7f64bc0e3660 con 0x7f64c4103130 2024-08-20T01:33:41.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:33:41.014+0000 7f64c3fff640 1 --2- 172.21.15.175:0/3138628659 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f64b00b3bd0 0x7f64b00b6090 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f64b4005ab0 tx=0x7f64b4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:33:41.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:33:41.017+0000 7f64c1ffb640 1 -- 172.21.15.175:0/3138628659 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f64bc016030 con 0x7f64c4103130 2024-08-20T01:33:41.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:33:41.222+0000 7f64ca80a640 1 -- 172.21.15.175:0/3138628659 --> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f64c41a1330 con 0x7f64b00b3bd0 2024-08-20T01:33:41.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:41 smithi175 ceph-mon[22392]: Detected new or changed devices on smithi081 2024-08-20T01:33:41.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:41 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:41.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:41 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T01:33:41.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:41 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-20T01:33:41.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:41 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-20T01:33:41.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:41 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-20T01:33:41.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:41 smithi175 ceph-mon[22392]: Adjusting osd_memory_target on smithi081 to 4272M 2024-08-20T01:33:41.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:41 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:41.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:41 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:33:41.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:41 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:33:41.479 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:41 smithi175 ceph-mon[22392]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-08-20T01:33:41.480 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:41 smithi175 ceph-mon[22392]: osdmap e59: 11 total, 10 up, 11 in 2024-08-20T01:33:41.480 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:41 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T01:33:41.480 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:41 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:41.480 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:41 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T01:33:41.480 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:41 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:33:41.480 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:41 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:33:41.480 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:41 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:33:41.480 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:41 smithi175 ceph-mon[22392]: from='osd.10 ' entity='osd.10' 2024-08-20T01:33:41.527 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:33:41 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-10[46759]: 2024-08-20T01:33:41.242+0000 7f69140b8640 -1 osd.10 0 waiting for initial osdmap 2024-08-20T01:33:41.528 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:33:41 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-10[46759]: 2024-08-20T01:33:41.386+0000 7f690bed7640 -1 osd.10 60 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-20T01:33:41.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:41 smithi081 ceph-mon[22209]: Detected new or changed devices on smithi081 2024-08-20T01:33:41.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:41 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:41.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:41 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T01:33:41.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:41 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-20T01:33:41.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:41 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-20T01:33:41.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:41 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-20T01:33:41.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:41 smithi081 ceph-mon[22209]: Adjusting osd_memory_target on smithi081 to 4272M 2024-08-20T01:33:41.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:41 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:41.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:41 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:33:41.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:41 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:33:41.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:41 smithi081 ceph-mon[22209]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-08-20T01:33:41.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:41 smithi081 ceph-mon[22209]: osdmap e59: 11 total, 10 up, 11 in 2024-08-20T01:33:41.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:41 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T01:33:41.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:41 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:41.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:41 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T01:33:41.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:41 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:33:41.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:41 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:33:41.530 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:41 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:33:41.530 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:41 smithi081 ceph-mon[22209]: from='osd.10 ' entity='osd.10' 2024-08-20T01:33:41.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:41 smithi079 ceph-mon[18656]: Detected new or changed devices on smithi081 2024-08-20T01:33:41.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:41 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:41.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:41 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T01:33:41.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:41 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-20T01:33:41.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:41 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-20T01:33:41.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:41 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-20T01:33:41.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:41 smithi079 ceph-mon[18656]: Adjusting osd_memory_target on smithi081 to 4272M 2024-08-20T01:33:41.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:41 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:41.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:41 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:33:41.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:41 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:33:41.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:41 smithi079 ceph-mon[18656]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-08-20T01:33:41.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:41 smithi079 ceph-mon[18656]: osdmap e59: 11 total, 10 up, 11 in 2024-08-20T01:33:41.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:41 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T01:33:41.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:41 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:41.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:41 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T01:33:41.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:41 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T01:33:41.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:41 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T01:33:41.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:41 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:33:41.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:41 smithi079 ceph-mon[18656]: from='osd.10 ' entity='osd.10' 2024-08-20T01:33:42.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:42 smithi175 ceph-mon[22392]: purged_snaps scrub starts 2024-08-20T01:33:42.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:42 smithi175 ceph-mon[22392]: purged_snaps scrub ok 2024-08-20T01:33:42.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:42 smithi175 ceph-mon[22392]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:33:42.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:42 smithi175 ceph-mon[22392]: from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:33:42.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:42 smithi175 ceph-mon[22392]: osdmap e60: 11 total, 10 up, 11 in 2024-08-20T01:33:42.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:42 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T01:33:42.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:42 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T01:33:42.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:42 smithi079 ceph-mon[18656]: purged_snaps scrub starts 2024-08-20T01:33:42.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:42 smithi079 ceph-mon[18656]: purged_snaps scrub ok 2024-08-20T01:33:42.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:42 smithi079 ceph-mon[18656]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:33:42.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:42 smithi079 ceph-mon[18656]: from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:33:42.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:42 smithi079 ceph-mon[18656]: osdmap e60: 11 total, 10 up, 11 in 2024-08-20T01:33:42.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:42 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T01:33:42.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:42 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T01:33:42.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:42 smithi081 ceph-mon[22209]: purged_snaps scrub starts 2024-08-20T01:33:42.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:42 smithi081 ceph-mon[22209]: purged_snaps scrub ok 2024-08-20T01:33:42.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:42 smithi081 ceph-mon[22209]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:33:42.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:42 smithi081 ceph-mon[22209]: from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:33:42.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:42 smithi081 ceph-mon[22209]: osdmap e60: 11 total, 10 up, 11 in 2024-08-20T01:33:42.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:42 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T01:33:42.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:42 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T01:33:43.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:43 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T01:33:43.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:43 smithi175 ceph-mon[22392]: osd.10 [v2:172.21.15.81:6824/4188407500,v1:172.21.15.81:6825/4188407500] boot 2024-08-20T01:33:43.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:43 smithi175 ceph-mon[22392]: osdmap e61: 11 total, 11 up, 11 in 2024-08-20T01:33:43.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:43 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T01:33:43.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:43 smithi175 ceph-mon[22392]: osdmap e62: 11 total, 11 up, 11 in 2024-08-20T01:33:43.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:43 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T01:33:43.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:43 smithi079 ceph-mon[18656]: osd.10 [v2:172.21.15.81:6824/4188407500,v1:172.21.15.81:6825/4188407500] boot 2024-08-20T01:33:43.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:43 smithi079 ceph-mon[18656]: osdmap e61: 11 total, 11 up, 11 in 2024-08-20T01:33:43.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:43 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T01:33:43.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:43 smithi079 ceph-mon[18656]: osdmap e62: 11 total, 11 up, 11 in 2024-08-20T01:33:43.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:43 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T01:33:43.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:43 smithi081 ceph-mon[22209]: osd.10 [v2:172.21.15.81:6824/4188407500,v1:172.21.15.81:6825/4188407500] boot 2024-08-20T01:33:43.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:43 smithi081 ceph-mon[22209]: osdmap e61: 11 total, 11 up, 11 in 2024-08-20T01:33:43.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:43 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T01:33:43.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:43 smithi081 ceph-mon[22209]: osdmap e62: 11 total, 11 up, 11 in 2024-08-20T01:33:44.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:44 smithi175 ceph-mon[22392]: pgmap v226: 1 pgs: 1 peering; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:33:44.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:44 smithi175 ceph-mon[22392]: from='client.? 172.21.15.175:0/1856950995' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a4d218ae-5a41-4b34-9c4e-e795c4a6a16d"} : dispatch 2024-08-20T01:33:44.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:44 smithi175 ceph-mon[22392]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a4d218ae-5a41-4b34-9c4e-e795c4a6a16d"} : dispatch 2024-08-20T01:33:44.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:44 smithi175 ceph-mon[22392]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a4d218ae-5a41-4b34-9c4e-e795c4a6a16d"}]': finished 2024-08-20T01:33:44.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:44 smithi175 ceph-mon[22392]: osdmap e63: 12 total, 11 up, 12 in 2024-08-20T01:33:44.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:44 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T01:33:44.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:44 smithi175 ceph-mon[22392]: from='client.? 172.21.15.175:0/444136110' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:33:44.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:44 smithi079 ceph-mon[18656]: pgmap v226: 1 pgs: 1 peering; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:33:44.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:44 smithi079 ceph-mon[18656]: from='client.? 172.21.15.175:0/1856950995' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a4d218ae-5a41-4b34-9c4e-e795c4a6a16d"} : dispatch 2024-08-20T01:33:44.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:44 smithi079 ceph-mon[18656]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a4d218ae-5a41-4b34-9c4e-e795c4a6a16d"} : dispatch 2024-08-20T01:33:44.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:44 smithi079 ceph-mon[18656]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a4d218ae-5a41-4b34-9c4e-e795c4a6a16d"}]': finished 2024-08-20T01:33:44.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:44 smithi079 ceph-mon[18656]: osdmap e63: 12 total, 11 up, 12 in 2024-08-20T01:33:44.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:44 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T01:33:44.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:44 smithi079 ceph-mon[18656]: from='client.? 172.21.15.175:0/444136110' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:33:44.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:44 smithi081 ceph-mon[22209]: pgmap v226: 1 pgs: 1 peering; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-08-20T01:33:44.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:44 smithi081 ceph-mon[22209]: from='client.? 172.21.15.175:0/1856950995' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a4d218ae-5a41-4b34-9c4e-e795c4a6a16d"} : dispatch 2024-08-20T01:33:44.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:44 smithi081 ceph-mon[22209]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a4d218ae-5a41-4b34-9c4e-e795c4a6a16d"} : dispatch 2024-08-20T01:33:44.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:44 smithi081 ceph-mon[22209]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a4d218ae-5a41-4b34-9c4e-e795c4a6a16d"}]': finished 2024-08-20T01:33:44.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:44 smithi081 ceph-mon[22209]: osdmap e63: 12 total, 11 up, 12 in 2024-08-20T01:33:44.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:44 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T01:33:44.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:44 smithi081 ceph-mon[22209]: from='client.? 172.21.15.175:0/444136110' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T01:33:46.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:46 smithi175 ceph-mon[22392]: pgmap v229: 1 pgs: 1 peering; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-08-20T01:33:46.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:46 smithi079 ceph-mon[18656]: pgmap v229: 1 pgs: 1 peering; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-08-20T01:33:46.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:46 smithi081 ceph-mon[22209]: pgmap v229: 1 pgs: 1 peering; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-08-20T01:33:48.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:48 smithi175 ceph-mon[22392]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-08-20T01:33:48.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:48 smithi079 ceph-mon[18656]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-08-20T01:33:48.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:48 smithi081 ceph-mon[22209]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-08-20T01:33:50.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:50 smithi081 ceph-mon[22209]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-08-20T01:33:50.605 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:50 smithi175 ceph-mon[22392]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-08-20T01:33:50.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:50 smithi079 ceph-mon[18656]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-08-20T01:33:52.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:52 smithi175 ceph-mon[22392]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-20T01:33:52.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:52 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-08-20T01:33:52.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:52 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:33:52.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:52 smithi079 ceph-mon[18656]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-20T01:33:52.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:52 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-08-20T01:33:52.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:52 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:33:52.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:52 smithi081 ceph-mon[22209]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-20T01:33:52.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:52 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-08-20T01:33:52.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:52 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:33:53.636 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:53 smithi175 ceph-mon[22392]: Deploying daemon osd.11 on smithi175 2024-08-20T01:33:53.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:53 smithi079 ceph-mon[18656]: Deploying daemon osd.11 on smithi175 2024-08-20T01:33:53.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:53 smithi081 ceph-mon[22209]: Deploying daemon osd.11 on smithi175 2024-08-20T01:33:54.570 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:54 smithi175 ceph-mon[22392]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-08-20T01:33:54.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:54 smithi079 ceph-mon[18656]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-08-20T01:33:54.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:54 smithi081 ceph-mon[22209]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-08-20T01:33:56.635 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:56 smithi175 ceph-mon[22392]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-08-20T01:33:56.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:56 smithi079 ceph-mon[18656]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-08-20T01:33:56.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:56 smithi081 ceph-mon[22209]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-08-20T01:33:57.620 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:57 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:33:57.620 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:57 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:57.620 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:57 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:57.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:57 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:33:57.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:57 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:57.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:57 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:57.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:57 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:33:57.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:57 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:57.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:57 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:33:58.616 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:33:58 smithi175 ceph-mon[22392]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-20T01:33:58.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:33:58 smithi079 ceph-mon[18656]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-20T01:33:58.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:33:58 smithi081 ceph-mon[22209]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-20T01:34:00.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:00.227+0000 7f64c1ffb640 1 -- 172.21.15.175:0/3138628659 <== mgr.14150 v2:172.21.15.79:6800/3038112779 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f64c41a1330 con 0x7f64b00b3bd0 2024-08-20T01:34:00.229 INFO:teuthology.orchestra.run.smithi175.stdout:Created osd(s) 11 on host 'smithi175' 2024-08-20T01:34:00.231 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:00.230+0000 7f64ca80a640 1 -- 172.21.15.175:0/3138628659 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f64b00b3bd0 msgr2=0x7f64b00b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:00.231 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:00.230+0000 7f64ca80a640 1 --2- 172.21.15.175:0/3138628659 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f64b00b3bd0 0x7f64b00b6090 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f64b4005ab0 tx=0x7f64b4005a20 comp rx=0 tx=0).stop 2024-08-20T01:34:00.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:00.230+0000 7f64ca80a640 1 -- 172.21.15.175:0/3138628659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64c4103130 msgr2=0x7f64c4199d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:00.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:00.230+0000 7f64ca80a640 1 --2- 172.21.15.175:0/3138628659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64c4103130 0x7f64c4199d20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f64bc00eaa0 tx=0x7f64bc00ef60 comp rx=0 tx=0).stop 2024-08-20T01:34:00.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:00.230+0000 7f64ca80a640 1 -- 172.21.15.175:0/3138628659 shutdown_connections 2024-08-20T01:34:00.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:00.230+0000 7f64ca80a640 1 --2- 172.21.15.175:0/3138628659 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f64b00b3bd0 0x7f64b00b6090 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:00.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:00.230+0000 7f64ca80a640 1 --2- 172.21.15.175:0/3138628659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64c4103130 0x7f64c4199d20 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:00.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:00.230+0000 7f64ca80a640 1 --2- 172.21.15.175:0/3138628659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64c4102770 0x7f64c41990e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:00.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:00.230+0000 7f64ca80a640 1 --2- 172.21.15.175:0/3138628659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64c4101610 0x7f64c4198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:00.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:00.230+0000 7f64ca80a640 1 -- 172.21.15.175:0/3138628659 >> 172.21.15.175:0/3138628659 conn(0x7f64c40fcee0 msgr2=0x7f64c40fe9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:00.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:00.230+0000 7f64ca80a640 1 -- 172.21.15.175:0/3138628659 shutdown_connections 2024-08-20T01:34:00.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:00.230+0000 7f64ca80a640 1 -- 172.21.15.175:0/3138628659 wait complete. 2024-08-20T01:34:00.516 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:00 smithi175 ceph-mon[22392]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-08-20T01:34:00.569 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:00 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:00.569 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:00 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:00.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:00 smithi079 ceph-mon[18656]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-08-20T01:34:00.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:00 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:00.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:00 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:00.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:00 smithi081 ceph-mon[22209]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-08-20T01:34:00.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:00 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:00.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:00 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:00.797 DEBUG:teuthology.orchestra.run.smithi175:osd.11> sudo journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@osd.11.service 2024-08-20T01:34:00.800 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-08-20T01:34:00.800 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph osd stat -f json 2024-08-20T01:34:01.058 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:34:01.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.536+0000 7fbd84ab3640 1 -- 172.21.15.79:0/1718668043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd80102770 msgr2=0x7fbd80102bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:01.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.536+0000 7fbd84ab3640 1 --2- 172.21.15.79:0/1718668043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd80102770 0x7fbd80102bf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbd74009930 tx=0x7fbd7402a420 comp rx=0 tx=0).stop 2024-08-20T01:34:01.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.536+0000 7fbd84ab3640 1 -- 172.21.15.79:0/1718668043 shutdown_connections 2024-08-20T01:34:01.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.536+0000 7fbd84ab3640 1 --2- 172.21.15.79:0/1718668043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd80103130 0x7fbd80109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:01.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.536+0000 7fbd84ab3640 1 --2- 172.21.15.79:0/1718668043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd80102770 0x7fbd80102bf0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:01.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.536+0000 7fbd84ab3640 1 --2- 172.21.15.79:0/1718668043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd80101610 0x7fbd80101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:01.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.536+0000 7fbd84ab3640 1 -- 172.21.15.79:0/1718668043 >> 172.21.15.79:0/1718668043 conn(0x7fbd800fcee0 msgr2=0x7fbd800ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:01.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.536+0000 7fbd84ab3640 1 -- 172.21.15.79:0/1718668043 shutdown_connections 2024-08-20T01:34:01.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.536+0000 7fbd84ab3640 1 -- 172.21.15.79:0/1718668043 wait complete. 2024-08-20T01:34:01.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.537+0000 7fbd84ab3640 1 Processor -- start 2024-08-20T01:34:01.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.537+0000 7fbd84ab3640 1 -- start start 2024-08-20T01:34:01.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.537+0000 7fbd84ab3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd80101610 0x7fbd801054f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:01.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.537+0000 7fbd84ab3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd80102770 0x7fbd80103d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:01.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.537+0000 7fbd84ab3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd80103130 0x7fbd801042a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:01.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.537+0000 7fbd84ab3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8010d1a0 con 0x7fbd80102770 2024-08-20T01:34:01.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.537+0000 7fbd84ab3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8010d020 con 0x7fbd80101610 2024-08-20T01:34:01.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.537+0000 7fbd84ab3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8010d320 con 0x7fbd80103130 2024-08-20T01:34:01.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.537+0000 7fbd7dd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd80102770 0x7fbd80103d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:01.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.537+0000 7fbd7dd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd80102770 0x7fbd80103d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50062/0 (socket says 172.21.15.79:50062) 2024-08-20T01:34:01.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.537+0000 7fbd7dd9b640 1 -- 172.21.15.79:0/2073494591 learned_addr learned my addr 172.21.15.79:0/2073494591 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:34:01.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.537+0000 7fbd7ed9d640 1 --2- 172.21.15.79:0/2073494591 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd80103130 0x7fbd801042a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:01.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.537+0000 7fbd7e59c640 1 --2- 172.21.15.79:0/2073494591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd80101610 0x7fbd801054f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:01.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.537+0000 7fbd7dd9b640 1 -- 172.21.15.79:0/2073494591 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd80103130 msgr2=0x7fbd801042a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:01.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.537+0000 7fbd7dd9b640 1 --2- 172.21.15.79:0/2073494591 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd80103130 0x7fbd801042a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:01.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.537+0000 7fbd7dd9b640 1 -- 172.21.15.79:0/2073494591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd80101610 msgr2=0x7fbd801054f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:01.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.537+0000 7fbd7dd9b640 1 --2- 172.21.15.79:0/2073494591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd80101610 0x7fbd801054f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:01.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.537+0000 7fbd7dd9b640 1 -- 172.21.15.79:0/2073494591 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd80104b60 con 0x7fbd80102770 2024-08-20T01:34:01.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.537+0000 7fbd7dd9b640 1 --2- 172.21.15.79:0/2073494591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd80102770 0x7fbd80103d60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbd74009a50 tx=0x7fbd74004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:01.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.538+0000 7fbd6f7fe640 1 -- 172.21.15.79:0/2073494591 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7403f030 con 0x7fbd80102770 2024-08-20T01:34:01.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.538+0000 7fbd6f7fe640 1 -- 172.21.15.79:0/2073494591 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbd74003a80 con 0x7fbd80102770 2024-08-20T01:34:01.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.538+0000 7fbd84ab3640 1 -- 172.21.15.79:0/2073494591 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd801a2b00 con 0x7fbd80102770 2024-08-20T01:34:01.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.538+0000 7fbd6f7fe640 1 -- 172.21.15.79:0/2073494591 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd74035070 con 0x7fbd80102770 2024-08-20T01:34:01.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.538+0000 7fbd84ab3640 1 -- 172.21.15.79:0/2073494591 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd801a2fb0 con 0x7fbd80102770 2024-08-20T01:34:01.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.539+0000 7fbd84ab3640 1 -- 172.21.15.79:0/2073494591 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd801a32d0 con 0x7fbd80102770 2024-08-20T01:34:01.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.540+0000 7fbd6f7fe640 1 -- 172.21.15.79:0/2073494591 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7fbd74042030 con 0x7fbd80102770 2024-08-20T01:34:01.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.541+0000 7fbd6f7fe640 1 --2- 172.21.15.79:0/2073494591 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbd680b3bd0 0x7fbd680b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:01.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.541+0000 7fbd7e59c640 1 --2- 172.21.15.79:0/2073494591 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbd680b3bd0 0x7fbd680b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:01.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.541+0000 7fbd6f7fe640 1 -- 172.21.15.79:0/2073494591 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6809+0+0 (secure 0 0 0) 0x7fbd74104380 con 0x7fbd80102770 2024-08-20T01:34:01.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.541+0000 7fbd7e59c640 1 --2- 172.21.15.79:0/2073494591 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbd680b3bd0 0x7fbd680b6090 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbd70009f20 tx=0x7fbd700094f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:01.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.544+0000 7fbd6f7fe640 1 -- 172.21.15.79:0/2073494591 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fbd740cbfb0 con 0x7fbd80102770 2024-08-20T01:34:01.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.718+0000 7fbd84ab3640 1 -- 172.21.15.79:0/2073494591 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fbd801a35c0 con 0x7fbd80102770 2024-08-20T01:34:01.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.719+0000 7fbd6f7fe640 1 -- 172.21.15.79:0/2073494591 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v63) ==== 74+0+133 (secure 0 0 0) 0x7fbd740cb8b0 con 0x7fbd80102770 2024-08-20T01:34:01.721 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:34:01.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.721+0000 7fbd84ab3640 1 -- 172.21.15.79:0/2073494591 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbd680b3bd0 msgr2=0x7fbd680b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:01.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.721+0000 7fbd84ab3640 1 --2- 172.21.15.79:0/2073494591 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbd680b3bd0 0x7fbd680b6090 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbd70009f20 tx=0x7fbd700094f0 comp rx=0 tx=0).stop 2024-08-20T01:34:01.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.721+0000 7fbd84ab3640 1 -- 172.21.15.79:0/2073494591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd80102770 msgr2=0x7fbd80103d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:01.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.721+0000 7fbd84ab3640 1 --2- 172.21.15.79:0/2073494591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd80102770 0x7fbd80103d60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbd74009a50 tx=0x7fbd74004270 comp rx=0 tx=0).stop 2024-08-20T01:34:01.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.721+0000 7fbd84ab3640 1 -- 172.21.15.79:0/2073494591 shutdown_connections 2024-08-20T01:34:01.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.721+0000 7fbd84ab3640 1 --2- 172.21.15.79:0/2073494591 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbd680b3bd0 0x7fbd680b6090 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:01.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.721+0000 7fbd84ab3640 1 --2- 172.21.15.79:0/2073494591 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd80103130 0x7fbd801042a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:01.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.721+0000 7fbd84ab3640 1 --2- 172.21.15.79:0/2073494591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd80102770 0x7fbd80103d60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:01.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.721+0000 7fbd84ab3640 1 --2- 172.21.15.79:0/2073494591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd80101610 0x7fbd801054f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:01.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.721+0000 7fbd84ab3640 1 -- 172.21.15.79:0/2073494591 >> 172.21.15.79:0/2073494591 conn(0x7fbd800fcee0 msgr2=0x7fbd8006a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:01.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.721+0000 7fbd84ab3640 1 -- 172.21.15.79:0/2073494591 shutdown_connections 2024-08-20T01:34:01.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:01.721+0000 7fbd84ab3640 1 -- 172.21.15.79:0/2073494591 wait complete. 2024-08-20T01:34:02.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:01 smithi175 ceph-mon[22392]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-08-20T01:34:02.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:01 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:02.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:01 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:02.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:01 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2073494591' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-20T01:34:02.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:01 smithi079 ceph-mon[18656]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-08-20T01:34:02.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:01 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:02.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:01 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:02.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:01 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2073494591' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-20T01:34:02.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:01 smithi081 ceph-mon[22209]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-08-20T01:34:02.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:01 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:02.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:01 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:02.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:01 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2073494591' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-20T01:34:02.536 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":63,"num_osds":12,"num_up_osds":11,"osd_up_since":1724117622,"num_in_osds":12,"osd_in_since":1724117623,"num_remapped_pgs":0} 2024-08-20T01:34:03.537 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph osd stat -f json 2024-08-20T01:34:03.591 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:34:03 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:34:03.467+0000 7fb48a2e5640 -1 osd.11 0 log_to_monitors true 2024-08-20T01:34:03.806 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:34:03.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:03 smithi175 ceph-mon[22392]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-08-20T01:34:03.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:03 smithi175 ceph-mon[22392]: from='osd.11 [v2:172.21.15.175:6824/451069549,v1:172.21.15.175:6825/451069549]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-20T01:34:03.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:03 smithi175 ceph-mon[22392]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-20T01:34:03.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:03 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:03.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:03 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:03.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:03 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T01:34:03.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:03 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-20T01:34:03.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:03 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-20T01:34:03.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:03 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-20T01:34:03.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:03 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:03.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:03 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:03.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:03 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:34:03.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:03 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:03.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:03 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:34:03.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:03 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:03.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:03 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:34:03.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:03 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:04.083 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:03 smithi079 ceph-mon[18656]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-08-20T01:34:04.084 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:03 smithi079 ceph-mon[18656]: from='osd.11 [v2:172.21.15.175:6824/451069549,v1:172.21.15.175:6825/451069549]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-20T01:34:04.084 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:03 smithi079 ceph-mon[18656]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-20T01:34:04.084 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:03 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:04.084 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:03 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:04.084 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:03 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T01:34:04.084 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:03 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-20T01:34:04.084 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:03 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-20T01:34:04.084 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:03 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-20T01:34:04.084 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:03 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:04.084 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:03 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:04.084 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:03 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:34:04.085 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:03 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:04.085 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:03 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:34:04.085 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:03 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:04.085 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:03 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:34:04.085 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:03 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:04.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:03 smithi081 ceph-mon[22209]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-08-20T01:34:04.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:03 smithi081 ceph-mon[22209]: from='osd.11 [v2:172.21.15.175:6824/451069549,v1:172.21.15.175:6825/451069549]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-20T01:34:04.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:03 smithi081 ceph-mon[22209]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-20T01:34:04.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:03 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:04.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:03 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:04.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:03 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T01:34:04.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:03 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-20T01:34:04.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:03 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-20T01:34:04.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:03 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-20T01:34:04.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:03 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:04.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:03 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:04.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:03 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:34:04.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:03 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:04.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:03 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:34:04.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:03 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:04.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:03 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:34:04.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:03 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:04.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.293+0000 7fa926996640 1 -- 172.21.15.79:0/1964112442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa920102770 msgr2=0x7fa920102bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:04.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.293+0000 7fa926996640 1 --2- 172.21.15.79:0/1964112442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa920102770 0x7fa920102bf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa908009930 tx=0x7fa90802a420 comp rx=0 tx=0).stop 2024-08-20T01:34:04.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.293+0000 7fa926996640 1 -- 172.21.15.79:0/1964112442 shutdown_connections 2024-08-20T01:34:04.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.293+0000 7fa926996640 1 --2- 172.21.15.79:0/1964112442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa920103130 0x7fa920109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:04.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.293+0000 7fa926996640 1 --2- 172.21.15.79:0/1964112442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa920102770 0x7fa920102bf0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:04.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.293+0000 7fa926996640 1 --2- 172.21.15.79:0/1964112442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa920101610 0x7fa920101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:04.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.293+0000 7fa926996640 1 -- 172.21.15.79:0/1964112442 >> 172.21.15.79:0/1964112442 conn(0x7fa9200fcee0 msgr2=0x7fa9200ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:04.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.293+0000 7fa926996640 1 -- 172.21.15.79:0/1964112442 shutdown_connections 2024-08-20T01:34:04.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.293+0000 7fa926996640 1 -- 172.21.15.79:0/1964112442 wait complete. 2024-08-20T01:34:04.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.293+0000 7fa926996640 1 Processor -- start 2024-08-20T01:34:04.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.294+0000 7fa926996640 1 -- start start 2024-08-20T01:34:04.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.294+0000 7fa926996640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa920101610 0x7fa9201053d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:04.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.294+0000 7fa926996640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa920102770 0x7fa920103c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:04.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.294+0000 7fa926996640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa920103130 0x7fa920104180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:04.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.294+0000 7fa926996640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa92010d1a0 con 0x7fa920103130 2024-08-20T01:34:04.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.294+0000 7fa926996640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa92010d020 con 0x7fa920101610 2024-08-20T01:34:04.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.294+0000 7fa926996640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa92010d320 con 0x7fa920102770 2024-08-20T01:34:04.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.294+0000 7fa924f33640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa920103130 0x7fa920104180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:04.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.294+0000 7fa924f33640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa920103130 0x7fa920104180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50078/0 (socket says 172.21.15.79:50078) 2024-08-20T01:34:04.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.294+0000 7fa924f33640 1 -- 172.21.15.79:0/2787149337 learned_addr learned my addr 172.21.15.79:0/2787149337 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:34:04.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.294+0000 7fa91ffff640 1 --2- 172.21.15.79:0/2787149337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa920101610 0x7fa9201053d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:04.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.294+0000 7fa917fff640 1 --2- 172.21.15.79:0/2787149337 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa920102770 0x7fa920103c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:04.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.294+0000 7fa924f33640 1 -- 172.21.15.79:0/2787149337 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa920102770 msgr2=0x7fa920103c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:04.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.294+0000 7fa924f33640 1 --2- 172.21.15.79:0/2787149337 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa920102770 0x7fa920103c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:04.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.294+0000 7fa924f33640 1 -- 172.21.15.79:0/2787149337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa920101610 msgr2=0x7fa9201053d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:04.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.294+0000 7fa924f33640 1 --2- 172.21.15.79:0/2787149337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa920101610 0x7fa9201053d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:04.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.294+0000 7fa924f33640 1 -- 172.21.15.79:0/2787149337 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa920104a40 con 0x7fa920103130 2024-08-20T01:34:04.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.294+0000 7fa917fff640 1 --2- 172.21.15.79:0/2787149337 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa920102770 0x7fa920103c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:34:04.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.294+0000 7fa91ffff640 1 --2- 172.21.15.79:0/2787149337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa920101610 0x7fa9201053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:34:04.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.294+0000 7fa924f33640 1 --2- 172.21.15.79:0/2787149337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa920103130 0x7fa920104180 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa91800cce0 tx=0x7fa91800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:04.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.295+0000 7fa91dffb640 1 -- 172.21.15.79:0/2787149337 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa91800f450 con 0x7fa920103130 2024-08-20T01:34:04.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.295+0000 7fa91dffb640 1 -- 172.21.15.79:0/2787149337 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa91800fa80 con 0x7fa920103130 2024-08-20T01:34:04.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.295+0000 7fa91dffb640 1 -- 172.21.15.79:0/2787149337 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa918018ad0 con 0x7fa920103130 2024-08-20T01:34:04.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.295+0000 7fa926996640 1 -- 172.21.15.79:0/2787149337 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9201a2b30 con 0x7fa920103130 2024-08-20T01:34:04.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.295+0000 7fa926996640 1 -- 172.21.15.79:0/2787149337 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9201a2ff0 con 0x7fa920103130 2024-08-20T01:34:04.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.296+0000 7fa926996640 1 -- 172.21.15.79:0/2787149337 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9201a3280 con 0x7fa920103130 2024-08-20T01:34:04.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.297+0000 7fa91dffb640 1 -- 172.21.15.79:0/2787149337 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7fa91800f5f0 con 0x7fa920103130 2024-08-20T01:34:04.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.298+0000 7fa91dffb640 1 --2- 172.21.15.79:0/2787149337 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa90c0b3bd0 0x7fa90c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:04.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.298+0000 7fa91ffff640 1 --2- 172.21.15.79:0/2787149337 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa90c0b3bd0 0x7fa90c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:04.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.298+0000 7fa91dffb640 1 -- 172.21.15.79:0/2787149337 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6831+0+0 (secure 0 0 0) 0x7fa9180e3ea0 con 0x7fa920103130 2024-08-20T01:34:04.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.298+0000 7fa91ffff640 1 --2- 172.21.15.79:0/2787149337 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa90c0b3bd0 0x7fa90c0b6090 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa910009930 tx=0x7fa910008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:04.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.302+0000 7fa91dffb640 1 -- 172.21.15.79:0/2787149337 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fa918014030 con 0x7fa920103130 2024-08-20T01:34:04.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.477+0000 7fa926996640 1 -- 172.21.15.79:0/2787149337 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fa9201a3570 con 0x7fa920103130 2024-08-20T01:34:04.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.478+0000 7fa91dffb640 1 -- 172.21.15.79:0/2787149337 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v64) ==== 74+0+133 (secure 0 0 0) 0x7fa9180abac0 con 0x7fa920103130 2024-08-20T01:34:04.479 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:34:04.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.480+0000 7fa926996640 1 -- 172.21.15.79:0/2787149337 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa90c0b3bd0 msgr2=0x7fa90c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:04.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.480+0000 7fa926996640 1 --2- 172.21.15.79:0/2787149337 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa90c0b3bd0 0x7fa90c0b6090 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa910009930 tx=0x7fa910008040 comp rx=0 tx=0).stop 2024-08-20T01:34:04.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.480+0000 7fa926996640 1 -- 172.21.15.79:0/2787149337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa920103130 msgr2=0x7fa920104180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:04.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.480+0000 7fa926996640 1 --2- 172.21.15.79:0/2787149337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa920103130 0x7fa920104180 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa91800cce0 tx=0x7fa91800a620 comp rx=0 tx=0).stop 2024-08-20T01:34:04.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.480+0000 7fa926996640 1 -- 172.21.15.79:0/2787149337 shutdown_connections 2024-08-20T01:34:04.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.480+0000 7fa926996640 1 --2- 172.21.15.79:0/2787149337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa920103130 0x7fa920104180 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:04.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.480+0000 7fa926996640 1 --2- 172.21.15.79:0/2787149337 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa90c0b3bd0 0x7fa90c0b6090 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:04.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.480+0000 7fa926996640 1 --2- 172.21.15.79:0/2787149337 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa920102770 0x7fa920103c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:04.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.480+0000 7fa926996640 1 --2- 172.21.15.79:0/2787149337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa920101610 0x7fa9201053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:04.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.480+0000 7fa926996640 1 -- 172.21.15.79:0/2787149337 >> 172.21.15.79:0/2787149337 conn(0x7fa9200fcee0 msgr2=0x7fa9200fe980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:04.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.480+0000 7fa926996640 1 -- 172.21.15.79:0/2787149337 shutdown_connections 2024-08-20T01:34:04.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:04.480+0000 7fa926996640 1 -- 172.21.15.79:0/2787149337 wait complete. 2024-08-20T01:34:05.138 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:34:04 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:34:04.842+0000 7fb486268640 -1 osd.11 0 waiting for initial osdmap 2024-08-20T01:34:05.139 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:34:04 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:34:04.857+0000 7fb48208f640 -1 osd.11 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-20T01:34:05.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:04 smithi175 ceph-mon[22392]: Detected new or changed devices on smithi175 2024-08-20T01:34:05.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:04 smithi175 ceph-mon[22392]: Adjusting osd_memory_target on smithi175 to 4272M 2024-08-20T01:34:05.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:04 smithi175 ceph-mon[22392]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-20T01:34:05.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:04 smithi175 ceph-mon[22392]: from='osd.11 [v2:172.21.15.175:6824/451069549,v1:172.21.15.175:6825/451069549]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-08-20T01:34:05.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:04 smithi175 ceph-mon[22392]: osdmap e64: 12 total, 11 up, 12 in 2024-08-20T01:34:05.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:04 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T01:34:05.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:04 smithi175 ceph-mon[22392]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-08-20T01:34:05.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:04 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2787149337' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-20T01:34:05.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:04 smithi175 ceph-mon[22392]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-08-20T01:34:05.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:04 smithi175 ceph-mon[22392]: osdmap e65: 12 total, 11 up, 12 in 2024-08-20T01:34:05.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:04 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T01:34:05.188 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:04 smithi079 ceph-mon[18656]: Detected new or changed devices on smithi175 2024-08-20T01:34:05.188 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:04 smithi079 ceph-mon[18656]: Adjusting osd_memory_target on smithi175 to 4272M 2024-08-20T01:34:05.188 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:04 smithi079 ceph-mon[18656]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-20T01:34:05.188 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:04 smithi079 ceph-mon[18656]: from='osd.11 [v2:172.21.15.175:6824/451069549,v1:172.21.15.175:6825/451069549]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-08-20T01:34:05.188 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:04 smithi079 ceph-mon[18656]: osdmap e64: 12 total, 11 up, 12 in 2024-08-20T01:34:05.189 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:04 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T01:34:05.189 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:04 smithi079 ceph-mon[18656]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-08-20T01:34:05.189 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:04 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2787149337' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-20T01:34:05.189 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:04 smithi079 ceph-mon[18656]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-08-20T01:34:05.189 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:04 smithi079 ceph-mon[18656]: osdmap e65: 12 total, 11 up, 12 in 2024-08-20T01:34:05.189 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:04 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T01:34:05.257 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":64,"num_osds":12,"num_up_osds":11,"osd_up_since":1724117622,"num_in_osds":12,"osd_in_since":1724117623,"num_remapped_pgs":0} 2024-08-20T01:34:05.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:04 smithi081 ceph-mon[22209]: Detected new or changed devices on smithi175 2024-08-20T01:34:05.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:04 smithi081 ceph-mon[22209]: Adjusting osd_memory_target on smithi175 to 4272M 2024-08-20T01:34:05.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:04 smithi081 ceph-mon[22209]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-20T01:34:05.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:04 smithi081 ceph-mon[22209]: from='osd.11 [v2:172.21.15.175:6824/451069549,v1:172.21.15.175:6825/451069549]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-08-20T01:34:05.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:04 smithi081 ceph-mon[22209]: osdmap e64: 12 total, 11 up, 12 in 2024-08-20T01:34:05.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:04 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T01:34:05.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:04 smithi081 ceph-mon[22209]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]} : dispatch 2024-08-20T01:34:05.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:04 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2787149337' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-20T01:34:05.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:04 smithi081 ceph-mon[22209]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-08-20T01:34:05.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:04 smithi081 ceph-mon[22209]: osdmap e65: 12 total, 11 up, 12 in 2024-08-20T01:34:05.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:04 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T01:34:06.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:05 smithi175 ceph-mon[22392]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-08-20T01:34:06.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:05 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T01:34:06.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:05 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T01:34:06.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:05 smithi079 ceph-mon[18656]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-08-20T01:34:06.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:05 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T01:34:06.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:05 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T01:34:06.259 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph osd stat -f json 2024-08-20T01:34:06.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:05 smithi081 ceph-mon[22209]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-08-20T01:34:06.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:05 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T01:34:06.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:05 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T01:34:06.513 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:34:06.898 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:06 smithi079 ceph-mon[18656]: purged_snaps scrub starts 2024-08-20T01:34:06.898 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:06 smithi079 ceph-mon[18656]: purged_snaps scrub ok 2024-08-20T01:34:06.898 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:06 smithi079 ceph-mon[18656]: osd.11 [v2:172.21.15.175:6824/451069549,v1:172.21.15.175:6825/451069549] boot 2024-08-20T01:34:06.898 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:06 smithi079 ceph-mon[18656]: osdmap e66: 12 total, 12 up, 12 in 2024-08-20T01:34:06.898 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:06 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T01:34:06.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:06.974+0000 7f570a71a640 1 -- 172.21.15.79:0/3460165993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5704102770 msgr2=0x7f5704102bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:06.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:06.974+0000 7f570a71a640 1 --2- 172.21.15.79:0/3460165993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5704102770 0x7f5704102bf0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f56ec009930 tx=0x7f56ec02a420 comp rx=0 tx=0).stop 2024-08-20T01:34:06.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:06.974+0000 7f570a71a640 1 -- 172.21.15.79:0/3460165993 shutdown_connections 2024-08-20T01:34:06.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:06.974+0000 7f570a71a640 1 --2- 172.21.15.79:0/3460165993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5704103130 0x7f5704109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:06.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:06.974+0000 7f570a71a640 1 --2- 172.21.15.79:0/3460165993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5704102770 0x7f5704102bf0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:06.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:06.974+0000 7f570a71a640 1 --2- 172.21.15.79:0/3460165993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5704101610 0x7f5704101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:06.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:06.974+0000 7f570a71a640 1 -- 172.21.15.79:0/3460165993 >> 172.21.15.79:0/3460165993 conn(0x7f57040fcee0 msgr2=0x7f57040ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:06.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:06.974+0000 7f570a71a640 1 -- 172.21.15.79:0/3460165993 shutdown_connections 2024-08-20T01:34:06.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:06.974+0000 7f570a71a640 1 -- 172.21.15.79:0/3460165993 wait complete. 2024-08-20T01:34:06.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:06.975+0000 7f570a71a640 1 Processor -- start 2024-08-20T01:34:06.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:06.975+0000 7f570a71a640 1 -- start start 2024-08-20T01:34:06.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:06.975+0000 7f570a71a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5704101610 0x7f5704198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:06.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:06.975+0000 7f570a71a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5704102770 0x7f5704199050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:06.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:06.975+0000 7f570a71a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5704103130 0x7f5704199c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:06.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:06.975+0000 7f570a71a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f570410d140 con 0x7f5704102770 2024-08-20T01:34:06.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:06.975+0000 7f570a71a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f570410cfc0 con 0x7f5704103130 2024-08-20T01:34:06.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:06.975+0000 7f570a71a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f570410d2c0 con 0x7f5704101610 2024-08-20T01:34:06.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:06.975+0000 7f57037fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5704102770 0x7f5704199050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:06.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:06.975+0000 7f57037fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5704102770 0x7f5704199050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50092/0 (socket says 172.21.15.79:50092) 2024-08-20T01:34:06.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:06.975+0000 7f57037fe640 1 -- 172.21.15.79:0/881730109 learned_addr learned my addr 172.21.15.79:0/881730109 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:34:06.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:06.975+0000 7f5703fff640 1 --2- 172.21.15.79:0/881730109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5704101610 0x7f5704198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:06.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:06.976+0000 7f5708cb7640 1 --2- 172.21.15.79:0/881730109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5704103130 0x7f5704199c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:06.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:06.976+0000 7f57037fe640 1 -- 172.21.15.79:0/881730109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5704101610 msgr2=0x7f5704198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:06.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:06.976+0000 7f57037fe640 1 --2- 172.21.15.79:0/881730109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5704101610 0x7f5704198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:06.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:06.976+0000 7f57037fe640 1 -- 172.21.15.79:0/881730109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5704103130 msgr2=0x7f5704199c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:06.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:06.976+0000 7f57037fe640 1 --2- 172.21.15.79:0/881730109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5704103130 0x7f5704199c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:06.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:06.976+0000 7f57037fe640 1 -- 172.21.15.79:0/881730109 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f570419a530 con 0x7f5704102770 2024-08-20T01:34:06.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:06.976+0000 7f57037fe640 1 --2- 172.21.15.79:0/881730109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5704102770 0x7f5704199050 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f56ec009a50 tx=0x7f56ec004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:06.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:06.976+0000 7f57017fa640 1 -- 172.21.15.79:0/881730109 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ec03f030 con 0x7f5704102770 2024-08-20T01:34:06.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:06.976+0000 7f57017fa640 1 -- 172.21.15.79:0/881730109 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f56ec003a80 con 0x7f5704102770 2024-08-20T01:34:06.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:06.976+0000 7f57017fa640 1 -- 172.21.15.79:0/881730109 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ec035070 con 0x7f5704102770 2024-08-20T01:34:06.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:06.976+0000 7f570a71a640 1 -- 172.21.15.79:0/881730109 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f570419a7c0 con 0x7f5704102770 2024-08-20T01:34:06.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:06.976+0000 7f570a71a640 1 -- 172.21.15.79:0/881730109 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57041a0d30 con 0x7f5704102770 2024-08-20T01:34:06.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:06.977+0000 7f570a71a640 1 -- 172.21.15.79:0/881730109 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57041a0f90 con 0x7f5704102770 2024-08-20T01:34:06.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:06.978+0000 7f57017fa640 1 -- 172.21.15.79:0/881730109 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f56ec042030 con 0x7f5704102770 2024-08-20T01:34:06.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:06.979+0000 7f57017fa640 1 --2- 172.21.15.79:0/881730109 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f56f00b3bd0 0x7f56f00b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:06.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:06.979+0000 7f5703fff640 1 --2- 172.21.15.79:0/881730109 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f56f00b3bd0 0x7f56f00b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:06.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:06.979+0000 7f57017fa640 1 -- 172.21.15.79:0/881730109 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7f56ec103f60 con 0x7f5704102770 2024-08-20T01:34:06.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:06.980+0000 7f5703fff640 1 --2- 172.21.15.79:0/881730109 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f56f00b3bd0 0x7f56f00b6090 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f56f4005d00 tx=0x7f56f400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:06.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:06.983+0000 7f57017fa640 1 -- 172.21.15.79:0/881730109 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f56ec0cba50 con 0x7f5704102770 2024-08-20T01:34:07.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:06 smithi175 ceph-mon[22392]: purged_snaps scrub starts 2024-08-20T01:34:07.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:06 smithi175 ceph-mon[22392]: purged_snaps scrub ok 2024-08-20T01:34:07.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:06 smithi175 ceph-mon[22392]: osd.11 [v2:172.21.15.175:6824/451069549,v1:172.21.15.175:6825/451069549] boot 2024-08-20T01:34:07.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:06 smithi175 ceph-mon[22392]: osdmap e66: 12 total, 12 up, 12 in 2024-08-20T01:34:07.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:06 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T01:34:07.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:07.161+0000 7f570a71a640 1 -- 172.21.15.79:0/881730109 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f57041a1160 con 0x7f5704102770 2024-08-20T01:34:07.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:07.161+0000 7f57017fa640 1 -- 172.21.15.79:0/881730109 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v67) ==== 74+0+133 (secure 0 0 0) 0x7f56ec0cb350 con 0x7f5704102770 2024-08-20T01:34:07.163 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:34:07.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:07.164+0000 7f570a71a640 1 -- 172.21.15.79:0/881730109 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f56f00b3bd0 msgr2=0x7f56f00b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:07.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:07.164+0000 7f570a71a640 1 --2- 172.21.15.79:0/881730109 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f56f00b3bd0 0x7f56f00b6090 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f56f4005d00 tx=0x7f56f400b410 comp rx=0 tx=0).stop 2024-08-20T01:34:07.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:07.164+0000 7f570a71a640 1 -- 172.21.15.79:0/881730109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5704102770 msgr2=0x7f5704199050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:07.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:07.164+0000 7f570a71a640 1 --2- 172.21.15.79:0/881730109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5704102770 0x7f5704199050 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f56ec009a50 tx=0x7f56ec004270 comp rx=0 tx=0).stop 2024-08-20T01:34:07.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:07.164+0000 7f570a71a640 1 -- 172.21.15.79:0/881730109 shutdown_connections 2024-08-20T01:34:07.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:07.164+0000 7f570a71a640 1 --2- 172.21.15.79:0/881730109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5704103130 0x7f5704199c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:07.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:07.164+0000 7f570a71a640 1 --2- 172.21.15.79:0/881730109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5704102770 0x7f5704199050 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:07.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:07.164+0000 7f570a71a640 1 --2- 172.21.15.79:0/881730109 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f56f00b3bd0 0x7f56f00b6090 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:07.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:07.164+0000 7f570a71a640 1 --2- 172.21.15.79:0/881730109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5704101610 0x7f5704198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:07.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:07.164+0000 7f570a71a640 1 -- 172.21.15.79:0/881730109 >> 172.21.15.79:0/881730109 conn(0x7f57040fcee0 msgr2=0x7f5704103b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:07.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:07.164+0000 7f570a71a640 1 -- 172.21.15.79:0/881730109 shutdown_connections 2024-08-20T01:34:07.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:07.164+0000 7f570a71a640 1 -- 172.21.15.79:0/881730109 wait complete. 2024-08-20T01:34:07.179 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:06 smithi081 ceph-mon[22209]: purged_snaps scrub starts 2024-08-20T01:34:07.179 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:06 smithi081 ceph-mon[22209]: purged_snaps scrub ok 2024-08-20T01:34:07.179 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:06 smithi081 ceph-mon[22209]: osd.11 [v2:172.21.15.175:6824/451069549,v1:172.21.15.175:6825/451069549] boot 2024-08-20T01:34:07.179 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:06 smithi081 ceph-mon[22209]: osdmap e66: 12 total, 12 up, 12 in 2024-08-20T01:34:07.179 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:06 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T01:34:07.881 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":67,"num_osds":12,"num_up_osds":12,"osd_up_since":1724117645,"num_in_osds":12,"osd_in_since":1724117623,"num_remapped_pgs":0} 2024-08-20T01:34:07.882 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-20T01:34:08.136 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:34:08.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:07 smithi175 ceph-mon[22392]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-08-20T01:34:08.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:07 smithi175 ceph-mon[22392]: osdmap e67: 12 total, 12 up, 12 in 2024-08-20T01:34:08.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:07 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/881730109' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-20T01:34:08.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:07 smithi079 ceph-mon[18656]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-08-20T01:34:08.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:07 smithi079 ceph-mon[18656]: osdmap e67: 12 total, 12 up, 12 in 2024-08-20T01:34:08.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:07 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/881730109' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-20T01:34:08.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:07 smithi081 ceph-mon[22209]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-08-20T01:34:08.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:07 smithi081 ceph-mon[22209]: osdmap e67: 12 total, 12 up, 12 in 2024-08-20T01:34:08.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:07 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/881730109' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-20T01:34:08.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.593+0000 7f24be610640 1 -- 172.21.15.79:0/40608720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24b81019a0 msgr2=0x7f24b8101d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:08.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.593+0000 7f24be610640 1 --2- 172.21.15.79:0/40608720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24b81019a0 0x7f24b8101d80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f24a8009900 tx=0x7f24a802a410 comp rx=0 tx=0).stop 2024-08-20T01:34:08.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.593+0000 7f24be610640 1 -- 172.21.15.79:0/40608720 shutdown_connections 2024-08-20T01:34:08.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.593+0000 7f24be610640 1 --2- 172.21.15.79:0/40608720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24b8107d30 0x7f24b810e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:08.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.593+0000 7f24be610640 1 --2- 172.21.15.79:0/40608720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24b81073b0 0x7f24b81077f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:08.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.593+0000 7f24be610640 1 --2- 172.21.15.79:0/40608720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24b81019a0 0x7f24b8101d80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:08.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.593+0000 7f24be610640 1 -- 172.21.15.79:0/40608720 >> 172.21.15.79:0/40608720 conn(0x7f24b80fd3f0 msgr2=0x7f24b80ff810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:08.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.593+0000 7f24be610640 1 -- 172.21.15.79:0/40608720 shutdown_connections 2024-08-20T01:34:08.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.593+0000 7f24be610640 1 -- 172.21.15.79:0/40608720 wait complete. 2024-08-20T01:34:08.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.593+0000 7f24be610640 1 Processor -- start 2024-08-20T01:34:08.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.593+0000 7f24be610640 1 -- start start 2024-08-20T01:34:08.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.594+0000 7f24be610640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24b81019a0 0x7f24b8199cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:08.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.594+0000 7f24be610640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24b81073b0 0x7f24b819a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:08.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.594+0000 7f24be610640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24b8107d30 0x7f24b819a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:08.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.594+0000 7f24be610640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f24b81118a0 con 0x7f24b81073b0 2024-08-20T01:34:08.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.594+0000 7f24be610640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f24b8111720 con 0x7f24b8107d30 2024-08-20T01:34:08.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.594+0000 7f24be610640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f24b8111a20 con 0x7f24b81019a0 2024-08-20T01:34:08.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.594+0000 7f24b77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24b81073b0 0x7f24b819a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:08.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.594+0000 7f24b77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24b81073b0 0x7f24b819a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50122/0 (socket says 172.21.15.79:50122) 2024-08-20T01:34:08.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.594+0000 7f24b77fe640 1 -- 172.21.15.79:0/2585404038 learned_addr learned my addr 172.21.15.79:0/2585404038 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:34:08.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.594+0000 7f24b7fff640 1 --2- 172.21.15.79:0/2585404038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24b81019a0 0x7f24b8199cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:08.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.594+0000 7f24bcbad640 1 --2- 172.21.15.79:0/2585404038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24b8107d30 0x7f24b819a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:08.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.594+0000 7f24b77fe640 1 -- 172.21.15.79:0/2585404038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24b81019a0 msgr2=0x7f24b8199cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:08.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.594+0000 7f24b77fe640 1 --2- 172.21.15.79:0/2585404038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24b81019a0 0x7f24b8199cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:08.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.594+0000 7f24b77fe640 1 -- 172.21.15.79:0/2585404038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24b8107d30 msgr2=0x7f24b819a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:08.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.594+0000 7f24b77fe640 1 --2- 172.21.15.79:0/2585404038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24b8107d30 0x7f24b819a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:08.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.594+0000 7f24b77fe640 1 -- 172.21.15.79:0/2585404038 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24b81a50d0 con 0x7f24b81073b0 2024-08-20T01:34:08.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.594+0000 7f24b77fe640 1 --2- 172.21.15.79:0/2585404038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24b81073b0 0x7f24b819a230 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f24ac00c970 tx=0x7f24ac00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:08.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.595+0000 7f24b57fa640 1 -- 172.21.15.79:0/2585404038 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ac007bb0 con 0x7f24b81073b0 2024-08-20T01:34:08.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.595+0000 7f24be610640 1 -- 172.21.15.79:0/2585404038 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24b8197b40 con 0x7f24b81073b0 2024-08-20T01:34:08.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.595+0000 7f24b57fa640 1 -- 172.21.15.79:0/2585404038 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f24ac007d50 con 0x7f24b81073b0 2024-08-20T01:34:08.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.595+0000 7f24b57fa640 1 -- 172.21.15.79:0/2585404038 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ac004e40 con 0x7f24b81073b0 2024-08-20T01:34:08.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.595+0000 7f24be610640 1 -- 172.21.15.79:0/2585404038 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24b8198030 con 0x7f24b81073b0 2024-08-20T01:34:08.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.596+0000 7f24be610640 1 -- 172.21.15.79:0/2585404038 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24b8101d80 con 0x7f24b81073b0 2024-08-20T01:34:08.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.597+0000 7f24b57fa640 1 -- 172.21.15.79:0/2585404038 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f24ac005000 con 0x7f24b81073b0 2024-08-20T01:34:08.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.597+0000 7f24b57fa640 1 --2- 172.21.15.79:0/2585404038 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f24a00b3bd0 0x7f24a00b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:08.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.598+0000 7f24b7fff640 1 --2- 172.21.15.79:0/2585404038 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f24a00b3bd0 0x7f24a00b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:08.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.598+0000 7f24b57fa640 1 -- 172.21.15.79:0/2585404038 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7f24ac0e3960 con 0x7f24b81073b0 2024-08-20T01:34:08.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.598+0000 7f24b7fff640 1 --2- 172.21.15.79:0/2585404038 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f24a00b3bd0 0x7f24a00b6090 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f24a8000c00 tx=0x7f24a8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:08.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.601+0000 7f24b57fa640 1 -- 172.21.15.79:0/2585404038 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f24ac014030 con 0x7f24b81073b0 2024-08-20T01:34:08.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.778+0000 7f24be610640 1 -- 172.21.15.79:0/2585404038 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f24b802e340 con 0x7f24b81073b0 2024-08-20T01:34:08.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.779+0000 7f24b57fa640 1 -- 172.21.15.79:0/2585404038 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) ==== 74+0+18432 (secure 0 0 0) 0x7f24ac0ab450 con 0x7f24b81073b0 2024-08-20T01:34:08.781 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:34:08.781 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":67,"fsid":"28484e9a-5e93-11ef-bccf-c7b262605968","created":"2024-08-20T01:27:07.792689+0000","modified":"2024-08-20T01:34:06.847171+0000","last_up_change":"2024-08-20T01:34:05.838937+0000","last_in_change":"2024-08-20T01:33:43.645153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-20T01:30:30.693903+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ccdbeb3d-bb9d-4275-ad7e-49f2cc1222cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6803","nonce":1274927648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6805","nonce":1274927648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6809","nonce":1274927648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6807","nonce":1274927648}]},"public_addr":"172.21.15.79:6803/1274927648","cluster_addr":"172.21.15.79:6805/1274927648","heartbeat_back_addr":"172.21.15.79:6809/1274927648","heartbeat_front_addr":"172.21.15.79:6807/1274927648","state":["exists","up"]},{"osd":1,"uuid":"0906bc46-f89d-482d-9402-43d17e4246a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6801","nonce":1174012328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6803","nonce":1174012328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6807","nonce":1174012328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6805","nonce":1174012328}]},"public_addr":"172.21.15.81:6801/1174012328","cluster_addr":"172.21.15.81:6803/1174012328","heartbeat_back_addr":"172.21.15.81:6807/1174012328","heartbeat_front_addr":"172.21.15.81:6805/1174012328","state":["exists","up"]},{"osd":2,"uuid":"11d8fb9d-cb2c-41c8-994c-603a1d8e01a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6801","nonce":1132306232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6803","nonce":1132306232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6807","nonce":1132306232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6805","nonce":1132306232}]},"public_addr":"172.21.15.175:6801/1132306232","cluster_addr":"172.21.15.175:6803/1132306232","heartbeat_back_addr":"172.21.15.175:6807/1132306232","heartbeat_front_addr":"172.21.15.175:6805/1132306232","state":["exists","up"]},{"osd":3,"uuid":"29e35242-957f-404b-b99e-d4dd0045c35d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6811","nonce":1364181822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6813","nonce":1364181822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6817","nonce":1364181822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6815","nonce":1364181822}]},"public_addr":"172.21.15.79:6811/1364181822","cluster_addr":"172.21.15.79:6813/1364181822","heartbeat_back_addr":"172.21.15.79:6817/1364181822","heartbeat_front_addr":"172.21.15.79:6815/1364181822","state":["exists","up"]},{"osd":4,"uuid":"9139c469-270f-4465-8adb-1e748529fa68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6809","nonce":306873968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6811","nonce":306873968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6815","nonce":306873968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6813","nonce":306873968}]},"public_addr":"172.21.15.81:6809/306873968","cluster_addr":"172.21.15.81:6811/306873968","heartbeat_back_addr":"172.21.15.81:6815/306873968","heartbeat_front_addr":"172.21.15.81:6813/306873968","state":["exists","up"]},{"osd":5,"uuid":"6394e462-4510-45d6-bc99-8660085cb206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6809","nonce":3908133424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6811","nonce":3908133424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6815","nonce":3908133424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6813","nonce":3908133424}]},"public_addr":"172.21.15.175:6809/3908133424","cluster_addr":"172.21.15.175:6811/3908133424","heartbeat_back_addr":"172.21.15.175:6815/3908133424","heartbeat_front_addr":"172.21.15.175:6813/3908133424","state":["exists","up"]},{"osd":6,"uuid":"e8e51380-e2be-4c4c-82d8-d86306d9fc1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6819","nonce":3379368280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6821","nonce":3379368280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6825","nonce":3379368280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6823","nonce":3379368280}]},"public_addr":"172.21.15.79:6819/3379368280","cluster_addr":"172.21.15.79:6821/3379368280","heartbeat_back_addr":"172.21.15.79:6825/3379368280","heartbeat_front_addr":"172.21.15.79:6823/3379368280","state":["exists","up"]},{"osd":7,"uuid":"875f7876-a2ca-4254-a8cc-27eebb11cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6817","nonce":747356685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6819","nonce":747356685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6823","nonce":747356685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6821","nonce":747356685}]},"public_addr":"172.21.15.81:6817/747356685","cluster_addr":"172.21.15.81:6819/747356685","heartbeat_back_addr":"172.21.15.81:6823/747356685","heartbeat_front_addr":"172.21.15.81:6821/747356685","state":["exists","up"]},{"osd":8,"uuid":"d714a33b-8df5-411d-bc99-b33b4b27cc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6817","nonce":1537762925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6819","nonce":1537762925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6823","nonce":1537762925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6821","nonce":1537762925}]},"public_addr":"172.21.15.175:6817/1537762925","cluster_addr":"172.21.15.175:6819/1537762925","heartbeat_back_addr":"172.21.15.175:6823/1537762925","heartbeat_front_addr":"172.21.15.175:6821/1537762925","state":["exists","up"]},{"osd":9,"uuid":"82db8305-1d72-4bef-99d6-5486e4de5b03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6827","nonce":2400574113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6829","nonce":2400574113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6833","nonce":2400574113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6831","nonce":2400574113}]},"public_addr":"172.21.15.79:6827/2400574113","cluster_addr":"172.21.15.79:6829/2400574113","heartbeat_back_addr":"172.21.15.79:6833/2400574113","heartbeat_front_addr":"172.21.15.79:6831/2400574113","state":["exists","up"]},{"osd":10,"uuid":"797e1e3f-12b5-4958-9e1f-f796cffaaf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6825","nonce":4188407500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6827","nonce":4188407500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6831","nonce":4188407500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6829","nonce":4188407500}]},"public_addr":"172.21.15.81:6825/4188407500","cluster_addr":"172.21.15.81:6827/4188407500","heartbeat_back_addr":"172.21.15.81:6831/4188407500","heartbeat_front_addr":"172.21.15.81:6829/4188407500","state":["exists","up"]},{"osd":11,"uuid":"a4d218ae-5a41-4b34-9c4e-e795c4a6a16d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6825","nonce":451069549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6827","nonce":451069549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6831","nonce":451069549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6829","nonce":451069549}]},"public_addr":"172.21.15.175:6825/451069549","cluster_addr":"172.21.15.175:6827/451069549","heartbeat_back_addr":"172.21.15.175:6831/451069549","heartbeat_front_addr":"172.21.15.175:6829/451069549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:29:42.003425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:30:05.353547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:30:28.916727+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:30:52.845671+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:31:16.926826+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:31:39.840986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:32:04.013287+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:32:28.237482+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:32:51.270643+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:33:15.825156+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:33:40.037915+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:34:04.477377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:0/1750500064":"2024-08-21T01:27:52.389553+0000","172.21.15.79:0/103962305":"2024-08-21T01:27:52.389553+0000","172.21.15.79:6800/4045769179":"2024-08-21T01:27:29.643647+0000","172.21.15.79:0/525482354":"2024-08-21T01:27:52.389553+0000","172.21.15.79:6801/4045769179":"2024-08-21T01:27:29.643647+0000","172.21.15.79:0/1023212241":"2024-08-21T01:27:29.643647+0000","172.21.15.79:0/2368377219":"2024-08-21T01:27:29.643647+0000","172.21.15.79:6801/3302536522":"2024-08-21T01:27:52.389553+0000","172.21.15.79:6800/3302536522":"2024-08-21T01:27:52.389553+0000","172.21.15.79:0/3498829332":"2024-08-21T01:27:29.643647+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-20T01:34:08.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.781+0000 7f24be610640 1 -- 172.21.15.79:0/2585404038 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f24a00b3bd0 msgr2=0x7f24a00b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:08.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.781+0000 7f24be610640 1 --2- 172.21.15.79:0/2585404038 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f24a00b3bd0 0x7f24a00b6090 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f24a8000c00 tx=0x7f24a8005a20 comp rx=0 tx=0).stop 2024-08-20T01:34:08.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.781+0000 7f24be610640 1 -- 172.21.15.79:0/2585404038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24b81073b0 msgr2=0x7f24b819a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:08.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.781+0000 7f24be610640 1 --2- 172.21.15.79:0/2585404038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24b81073b0 0x7f24b819a230 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f24ac00c970 tx=0x7f24ac00ce30 comp rx=0 tx=0).stop 2024-08-20T01:34:08.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.781+0000 7f24be610640 1 -- 172.21.15.79:0/2585404038 shutdown_connections 2024-08-20T01:34:08.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.781+0000 7f24be610640 1 --2- 172.21.15.79:0/2585404038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24b8107d30 0x7f24b819a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:08.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.781+0000 7f24be610640 1 --2- 172.21.15.79:0/2585404038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24b81073b0 0x7f24b819a230 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:08.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.781+0000 7f24be610640 1 --2- 172.21.15.79:0/2585404038 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f24a00b3bd0 0x7f24a00b6090 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:08.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.781+0000 7f24be610640 1 --2- 172.21.15.79:0/2585404038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24b81019a0 0x7f24b8199cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:08.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.781+0000 7f24be610640 1 -- 172.21.15.79:0/2585404038 >> 172.21.15.79:0/2585404038 conn(0x7f24b80fd3f0 msgr2=0x7f24b80ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:08.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.781+0000 7f24be610640 1 -- 172.21.15.79:0/2585404038 shutdown_connections 2024-08-20T01:34:08.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:08.781+0000 7f24be610640 1 -- 172.21.15.79:0/2585404038 wait complete. 2024-08-20T01:34:09.102 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:08 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2585404038' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:34:09.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:08 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2585404038' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:34:09.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:08 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2585404038' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:34:09.540 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-20T01:30:30.693903+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-20T01:34:09.540 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-08-20T01:34:09.788 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:34:10.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:09 smithi175 ceph-mon[22392]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:10.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:09 smithi079 ceph-mon[18656]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:10.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:09 smithi081 ceph-mon[22209]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:10.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.284+0000 7f3c039a0640 1 -- 172.21.15.79:0/2580332503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bfc1017d0 msgr2=0x7f3bfc101bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:10.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.284+0000 7f3c039a0640 1 --2- 172.21.15.79:0/2580332503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bfc1017d0 0x7f3bfc101bb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8009900 tx=0x7f3bf802a410 comp rx=0 tx=0).stop 2024-08-20T01:34:10.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.284+0000 7f3c039a0640 1 -- 172.21.15.79:0/2580332503 shutdown_connections 2024-08-20T01:34:10.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.284+0000 7f3c039a0640 1 --2- 172.21.15.79:0/2580332503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bfc106c10 0x7f3bfc107060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:10.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.284+0000 7f3c039a0640 1 --2- 172.21.15.79:0/2580332503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bfc1020f0 0x7f3bfc1065c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:10.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.284+0000 7f3c039a0640 1 --2- 172.21.15.79:0/2580332503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bfc1017d0 0x7f3bfc101bb0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:10.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.284+0000 7f3c039a0640 1 -- 172.21.15.79:0/2580332503 >> 172.21.15.79:0/2580332503 conn(0x7f3bfc0fd440 msgr2=0x7f3bfc0ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:10.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.284+0000 7f3c039a0640 1 -- 172.21.15.79:0/2580332503 shutdown_connections 2024-08-20T01:34:10.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.284+0000 7f3c039a0640 1 -- 172.21.15.79:0/2580332503 wait complete. 2024-08-20T01:34:10.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.285+0000 7f3c039a0640 1 Processor -- start 2024-08-20T01:34:10.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.285+0000 7f3c039a0640 1 -- start start 2024-08-20T01:34:10.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.286+0000 7f3c039a0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bfc1017d0 0x7f3bfc19f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:10.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.286+0000 7f3c039a0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bfc1020f0 0x7f3bfc19fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:10.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.286+0000 7f3c039a0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bfc106c10 0x7f3bfc1a4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:10.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.286+0000 7f3c039a0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3bfc118f30 con 0x7f3bfc106c10 2024-08-20T01:34:10.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.286+0000 7f3c039a0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3bfc118db0 con 0x7f3bfc1017d0 2024-08-20T01:34:10.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.286+0000 7f3c039a0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3bfc1190b0 con 0x7f3bfc1020f0 2024-08-20T01:34:10.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.286+0000 7f3c01f3d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bfc106c10 0x7f3bfc1a4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:10.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.286+0000 7f3c01f3d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bfc106c10 0x7f3bfc1a4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48110/0 (socket says 172.21.15.79:48110) 2024-08-20T01:34:10.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.286+0000 7f3c01f3d640 1 -- 172.21.15.79:0/1693120984 learned_addr learned my addr 172.21.15.79:0/1693120984 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:34:10.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.286+0000 7f3c0173c640 1 --2- 172.21.15.79:0/1693120984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bfc1017d0 0x7f3bfc19f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:10.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.286+0000 7f3c00f3b640 1 --2- 172.21.15.79:0/1693120984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bfc1020f0 0x7f3bfc19fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:10.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.286+0000 7f3c01f3d640 1 -- 172.21.15.79:0/1693120984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bfc1020f0 msgr2=0x7f3bfc19fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:10.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.286+0000 7f3c01f3d640 1 --2- 172.21.15.79:0/1693120984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bfc1020f0 0x7f3bfc19fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:10.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.286+0000 7f3c01f3d640 1 -- 172.21.15.79:0/1693120984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bfc1017d0 msgr2=0x7f3bfc19f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:10.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.286+0000 7f3c01f3d640 1 --2- 172.21.15.79:0/1693120984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bfc1017d0 0x7f3bfc19f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:10.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.286+0000 7f3c01f3d640 1 -- 172.21.15.79:0/1693120984 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bfc1a5570 con 0x7f3bfc106c10 2024-08-20T01:34:10.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.286+0000 7f3c00f3b640 1 --2- 172.21.15.79:0/1693120984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bfc1020f0 0x7f3bfc19fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:34:10.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.286+0000 7f3c01f3d640 1 --2- 172.21.15.79:0/1693120984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bfc106c10 0x7f3bfc1a4da0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3bf400eaa0 tx=0x7f3bf400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:10.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.287+0000 7f3bf27fc640 1 -- 172.21.15.79:0/1693120984 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf400cdb0 con 0x7f3bfc106c10 2024-08-20T01:34:10.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.287+0000 7f3c039a0640 1 -- 172.21.15.79:0/1693120984 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bfc1a5860 con 0x7f3bfc106c10 2024-08-20T01:34:10.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.287+0000 7f3bf27fc640 1 -- 172.21.15.79:0/1693120984 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3bf4005020 con 0x7f3bfc106c10 2024-08-20T01:34:10.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.287+0000 7f3bf27fc640 1 -- 172.21.15.79:0/1693120984 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf40116d0 con 0x7f3bfc106c10 2024-08-20T01:34:10.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.287+0000 7f3c039a0640 1 -- 172.21.15.79:0/1693120984 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bfc1abf20 con 0x7f3bfc106c10 2024-08-20T01:34:10.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.288+0000 7f3c039a0640 1 -- 172.21.15.79:0/1693120984 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bfc1065c0 con 0x7f3bfc106c10 2024-08-20T01:34:10.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.289+0000 7f3bf27fc640 1 -- 172.21.15.79:0/1693120984 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f3bf40051d0 con 0x7f3bfc106c10 2024-08-20T01:34:10.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.290+0000 7f3bf27fc640 1 --2- 172.21.15.79:0/1693120984 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3be80b3bd0 0x7f3be80b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:10.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.290+0000 7f3c0173c640 1 --2- 172.21.15.79:0/1693120984 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3be80b3bd0 0x7f3be80b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:10.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.290+0000 7f3bf27fc640 1 -- 172.21.15.79:0/1693120984 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7f3bf40e3db0 con 0x7f3bfc106c10 2024-08-20T01:34:10.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.291+0000 7f3c0173c640 1 --2- 172.21.15.79:0/1693120984 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3be80b3bd0 0x7f3be80b6090 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3bf80057c0 tx=0x7f3bf80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:10.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.293+0000 7f3bf27fc640 1 -- 172.21.15.79:0/1693120984 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f3bf4016030 con 0x7f3bfc106c10 2024-08-20T01:34:10.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.468+0000 7f3c039a0640 1 -- 172.21.15.79:0/1693120984 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3bfc1ac2c0 con 0x7f3bfc106c10 2024-08-20T01:34:10.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.468+0000 7f3bf27fc640 1 -- 172.21.15.79:0/1693120984 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v67) ==== 93+0+10 (secure 0 0 0) 0x7f3bf40ab800 con 0x7f3bfc106c10 2024-08-20T01:34:10.471 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-08-20T01:34:10.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.470+0000 7f3c039a0640 1 -- 172.21.15.79:0/1693120984 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3be80b3bd0 msgr2=0x7f3be80b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:10.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.470+0000 7f3c039a0640 1 --2- 172.21.15.79:0/1693120984 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3be80b3bd0 0x7f3be80b6090 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3bf80057c0 tx=0x7f3bf80058d0 comp rx=0 tx=0).stop 2024-08-20T01:34:10.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.470+0000 7f3c039a0640 1 -- 172.21.15.79:0/1693120984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bfc106c10 msgr2=0x7f3bfc1a4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:10.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.470+0000 7f3c039a0640 1 --2- 172.21.15.79:0/1693120984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bfc106c10 0x7f3bfc1a4da0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3bf400eaa0 tx=0x7f3bf400ef60 comp rx=0 tx=0).stop 2024-08-20T01:34:10.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.470+0000 7f3c039a0640 1 -- 172.21.15.79:0/1693120984 shutdown_connections 2024-08-20T01:34:10.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.470+0000 7f3c039a0640 1 --2- 172.21.15.79:0/1693120984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bfc106c10 0x7f3bfc1a4da0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:10.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.470+0000 7f3c039a0640 1 --2- 172.21.15.79:0/1693120984 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3be80b3bd0 0x7f3be80b6090 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:10.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.470+0000 7f3c039a0640 1 --2- 172.21.15.79:0/1693120984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bfc1020f0 0x7f3bfc19fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:10.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.470+0000 7f3c039a0640 1 --2- 172.21.15.79:0/1693120984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bfc1017d0 0x7f3bfc19f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:10.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.471+0000 7f3c039a0640 1 -- 172.21.15.79:0/1693120984 >> 172.21.15.79:0/1693120984 conn(0x7f3bfc0fd440 msgr2=0x7f3bfc104540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:10.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.471+0000 7f3c039a0640 1 -- 172.21.15.79:0/1693120984 shutdown_connections 2024-08-20T01:34:10.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:10.471+0000 7f3c039a0640 1 -- 172.21.15.79:0/1693120984 wait complete. 2024-08-20T01:34:11.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:10 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/1693120984' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-20T01:34:11.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:10 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/1693120984' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-20T01:34:11.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:10 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/1693120984' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-20T01:34:11.279 INFO:tasks.cephadm:Adding mds.a on smithi079 2024-08-20T01:34:11.279 INFO:tasks.cephadm:Adding mds.d on smithi079 2024-08-20T01:34:11.279 INFO:tasks.cephadm:Adding mds.g on smithi079 2024-08-20T01:34:11.279 INFO:tasks.cephadm:Adding mds.j on smithi079 2024-08-20T01:34:11.279 INFO:tasks.cephadm:Adding mds.b on smithi081 2024-08-20T01:34:11.279 INFO:tasks.cephadm:Adding mds.e on smithi081 2024-08-20T01:34:11.279 INFO:tasks.cephadm:Adding mds.h on smithi081 2024-08-20T01:34:11.279 INFO:tasks.cephadm:Adding mds.k on smithi081 2024-08-20T01:34:11.279 INFO:tasks.cephadm:Adding mds.c on smithi175 2024-08-20T01:34:11.280 INFO:tasks.cephadm:Adding mds.f on smithi175 2024-08-20T01:34:11.280 INFO:tasks.cephadm:Adding mds.i on smithi175 2024-08-20T01:34:11.280 INFO:tasks.cephadm:Adding mds.l on smithi175 2024-08-20T01:34:11.280 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph orch apply mds all '12;smithi079=a;smithi079=d;smithi079=g;smithi079=j;smithi081=b;smithi081=e;smithi081=h;smithi081=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l' 2024-08-20T01:34:11.541 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T01:34:11.977 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:11 smithi175 ceph-mon[22392]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:11.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:11.975+0000 7f5c72fe1640 1 -- 172.21.15.175:0/394593312 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c6c108430 msgr2=0x7f5c6c10a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:11.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:11.975+0000 7f5c72fe1640 1 --2- 172.21.15.175:0/394593312 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c6c108430 0x7f5c6c10a8f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5c64009ca0 tx=0x7f5c6402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:34:11.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:11.975+0000 7f5c72fe1640 1 -- 172.21.15.175:0/394593312 shutdown_connections 2024-08-20T01:34:11.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:11.975+0000 7f5c72fe1640 1 --2- 172.21.15.175:0/394593312 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c6c108430 0x7f5c6c10a8f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:11.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:11.975+0000 7f5c72fe1640 1 --2- 172.21.15.175:0/394593312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c6c105880 0x7f5c6c107cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:11.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:11.975+0000 7f5c72fe1640 1 --2- 172.21.15.175:0/394593312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c6c06b3e0 0x7f5c6c1052f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:11.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:11.975+0000 7f5c72fe1640 1 -- 172.21.15.175:0/394593312 >> 172.21.15.175:0/394593312 conn(0x7f5c6c0fcee0 msgr2=0x7f5c6c0ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:11.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:11.976+0000 7f5c72fe1640 1 -- 172.21.15.175:0/394593312 shutdown_connections 2024-08-20T01:34:11.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:11.976+0000 7f5c72fe1640 1 -- 172.21.15.175:0/394593312 wait complete. 2024-08-20T01:34:11.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:11.976+0000 7f5c72fe1640 1 Processor -- start 2024-08-20T01:34:11.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:11.976+0000 7f5c72fe1640 1 -- start start 2024-08-20T01:34:11.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:11.977+0000 7f5c72fe1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c6c06b3e0 0x7f5c6c198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:11.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:11.977+0000 7f5c72fe1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c6c105880 0x7f5c6c1990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:11.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:11.977+0000 7f5c72fe1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c6c108430 0x7f5c6c199d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:11.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:11.977+0000 7f5c72fe1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5c6c10e380 con 0x7f5c6c06b3e0 2024-08-20T01:34:11.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:11.977+0000 7f5c72fe1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5c6c10e200 con 0x7f5c6c105880 2024-08-20T01:34:11.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:11.977+0000 7f5c72fe1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5c6c10e500 con 0x7f5c6c108430 2024-08-20T01:34:11.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:11.977+0000 7f5c7157e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c6c108430 0x7f5c6c199d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:11.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:11.977+0000 7f5c7157e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c6c108430 0x7f5c6c199d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46108/0 (socket says 172.21.15.175:46108) 2024-08-20T01:34:11.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:11.977+0000 7f5c7157e640 1 -- 172.21.15.175:0/1872044519 learned_addr learned my addr 172.21.15.175:0/1872044519 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-08-20T01:34:11.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:11.977+0000 7f5c70d7d640 1 --2- 172.21.15.175:0/1872044519 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c6c06b3e0 0x7f5c6c198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:11.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:11.977+0000 7f5c6bfff640 1 --2- 172.21.15.175:0/1872044519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c6c105880 0x7f5c6c1990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:11.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:11.977+0000 7f5c7157e640 1 -- 172.21.15.175:0/1872044519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c6c105880 msgr2=0x7f5c6c1990c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:11.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:11.977+0000 7f5c7157e640 1 --2- 172.21.15.175:0/1872044519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c6c105880 0x7f5c6c1990c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:11.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:11.977+0000 7f5c7157e640 1 -- 172.21.15.175:0/1872044519 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c6c06b3e0 msgr2=0x7f5c6c198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:11.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:11.977+0000 7f5c7157e640 1 --2- 172.21.15.175:0/1872044519 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c6c06b3e0 0x7f5c6c198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:11.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:11.977+0000 7f5c7157e640 1 -- 172.21.15.175:0/1872044519 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c6c19a5a0 con 0x7f5c6c108430 2024-08-20T01:34:11.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:11.977+0000 7f5c6bfff640 1 --2- 172.21.15.175:0/1872044519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c6c105880 0x7f5c6c1990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:34:11.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:11.977+0000 7f5c7157e640 1 --2- 172.21.15.175:0/1872044519 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c6c108430 0x7f5c6c199d00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5c64009dc0 tx=0x7f5c64003c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:11.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:11.978+0000 7f5c69ffb640 1 -- 172.21.15.175:0/1872044519 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c64004240 con 0x7f5c6c108430 2024-08-20T01:34:11.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:11.978+0000 7f5c69ffb640 1 -- 172.21.15.175:0/1872044519 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5c640305c0 con 0x7f5c6c108430 2024-08-20T01:34:11.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:11.978+0000 7f5c72fe1640 1 -- 172.21.15.175:0/1872044519 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c6c19a830 con 0x7f5c6c108430 2024-08-20T01:34:11.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:11.978+0000 7f5c69ffb640 1 -- 172.21.15.175:0/1872044519 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c6403c670 con 0x7f5c6c108430 2024-08-20T01:34:11.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:11.978+0000 7f5c72fe1640 1 -- 172.21.15.175:0/1872044519 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c6c1a0f70 con 0x7f5c6c108430 2024-08-20T01:34:11.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:11.979+0000 7f5c72fe1640 1 -- 172.21.15.175:0/1872044519 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c6c0fe9d0 con 0x7f5c6c108430 2024-08-20T01:34:11.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:11.981+0000 7f5c69ffb640 1 -- 172.21.15.175:0/1872044519 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f5c64030a70 con 0x7f5c6c108430 2024-08-20T01:34:11.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:11.981+0000 7f5c69ffb640 1 --2- 172.21.15.175:0/1872044519 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5c540b3bd0 0x7f5c540b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:11.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:11.981+0000 7f5c69ffb640 1 -- 172.21.15.175:0/1872044519 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7f5c64105250 con 0x7f5c6c108430 2024-08-20T01:34:11.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:11.982+0000 7f5c70d7d640 1 --2- 172.21.15.175:0/1872044519 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5c540b3bd0 0x7f5c540b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:11.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:11.982+0000 7f5c70d7d640 1 --2- 172.21.15.175:0/1872044519 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5c540b3bd0 0x7f5c540b6090 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c009890 tx=0x7f5c5c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:11.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:11.984+0000 7f5c69ffb640 1 -- 172.21.15.175:0/1872044519 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f5c640ccd40 con 0x7f5c6c108430 2024-08-20T01:34:12.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:12.168+0000 7f5c72fe1640 1 -- 172.21.15.175:0/1872044519 --> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi079=a;smithi079=d;smithi079=g;smithi079=j;smithi081=b;smithi081=e;smithi081=h;smithi081=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l", "target": ["mon-mgr", ""]}) -- 0x7f5c6c0633c0 con 0x7f5c540b3bd0 2024-08-20T01:34:12.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:12.176+0000 7f5c69ffb640 1 -- 172.21.15.175:0/1872044519 <== mgr.14150 v2:172.21.15.79:6800/3038112779 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f5c6c0633c0 con 0x7f5c540b3bd0 2024-08-20T01:34:12.177 INFO:teuthology.orchestra.run.smithi175.stdout:Scheduled mds.all update... 2024-08-20T01:34:12.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:12.178+0000 7f5c72fe1640 1 -- 172.21.15.175:0/1872044519 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5c540b3bd0 msgr2=0x7f5c540b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:12.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:12.178+0000 7f5c72fe1640 1 --2- 172.21.15.175:0/1872044519 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5c540b3bd0 0x7f5c540b6090 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c009890 tx=0x7f5c5c008040 comp rx=0 tx=0).stop 2024-08-20T01:34:12.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:12.178+0000 7f5c72fe1640 1 -- 172.21.15.175:0/1872044519 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c6c108430 msgr2=0x7f5c6c199d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:12.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:12.178+0000 7f5c72fe1640 1 --2- 172.21.15.175:0/1872044519 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c6c108430 0x7f5c6c199d00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5c64009dc0 tx=0x7f5c64003c90 comp rx=0 tx=0).stop 2024-08-20T01:34:12.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:12.178+0000 7f5c72fe1640 1 -- 172.21.15.175:0/1872044519 shutdown_connections 2024-08-20T01:34:12.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:12.178+0000 7f5c72fe1640 1 --2- 172.21.15.175:0/1872044519 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5c540b3bd0 0x7f5c540b6090 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:12.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:12.178+0000 7f5c72fe1640 1 --2- 172.21.15.175:0/1872044519 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c6c108430 0x7f5c6c199d00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:12.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:12.178+0000 7f5c72fe1640 1 --2- 172.21.15.175:0/1872044519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c6c105880 0x7f5c6c1990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:12.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:12.178+0000 7f5c72fe1640 1 --2- 172.21.15.175:0/1872044519 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c6c06b3e0 0x7f5c6c198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:12.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:12.178+0000 7f5c72fe1640 1 -- 172.21.15.175:0/1872044519 >> 172.21.15.175:0/1872044519 conn(0x7f5c6c0fcee0 msgr2=0x7f5c6c103b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:12.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:12.178+0000 7f5c72fe1640 1 -- 172.21.15.175:0/1872044519 shutdown_connections 2024-08-20T01:34:12.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-08-20T01:34:12.178+0000 7f5c72fe1640 1 -- 172.21.15.175:0/1872044519 wait complete. 2024-08-20T01:34:12.185 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:11 smithi079 ceph-mon[18656]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:12.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:11 smithi081 ceph-mon[22209]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:12.852 DEBUG:teuthology.orchestra.run.smithi079:mds.a> sudo journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mds.a.service 2024-08-20T01:34:12.856 DEBUG:teuthology.orchestra.run.smithi079:mds.d> sudo journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mds.d.service 2024-08-20T01:34:12.899 DEBUG:teuthology.orchestra.run.smithi079:mds.g> sudo journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mds.g.service 2024-08-20T01:34:12.941 DEBUG:teuthology.orchestra.run.smithi079:mds.j> sudo journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mds.j.service 2024-08-20T01:34:12.984 DEBUG:teuthology.orchestra.run.smithi081:mds.b> sudo journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mds.b.service 2024-08-20T01:34:12.987 DEBUG:teuthology.orchestra.run.smithi081:mds.e> sudo journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mds.e.service 2024-08-20T01:34:13.029 DEBUG:teuthology.orchestra.run.smithi081:mds.h> sudo journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mds.h.service 2024-08-20T01:34:13.072 DEBUG:teuthology.orchestra.run.smithi081:mds.k> sudo journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mds.k.service 2024-08-20T01:34:13.115 DEBUG:teuthology.orchestra.run.smithi175:mds.c> sudo journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mds.c.service 2024-08-20T01:34:13.118 DEBUG:teuthology.orchestra.run.smithi175:mds.f> sudo journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mds.f.service 2024-08-20T01:34:13.162 DEBUG:teuthology.orchestra.run.smithi175:mds.i> sudo journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mds.i.service 2024-08-20T01:34:13.205 DEBUG:teuthology.orchestra.run.smithi175:mds.l> sudo journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mds.l.service 2024-08-20T01:34:13.248 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-08-20T01:34:13.249 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:34:13.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:13 smithi081 ceph-mon[22209]: from='client.24487 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi079=a;smithi079=d;smithi079=g;smithi079=j;smithi081=b;smithi081=e;smithi081=h;smithi081=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:34:13.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:13 smithi081 ceph-mon[22209]: Saving service mds.all spec with placement smithi079=a;smithi079=d;smithi079=g;smithi079=j;smithi081=b;smithi081=e;smithi081=h;smithi081=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l;count:12 2024-08-20T01:34:13.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:13 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:13.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:13 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:34:13.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:13 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:13.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:13 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:34:13.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:13 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:13.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:13 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:34:13.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:13 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:34:13.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:13 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:13.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:13 smithi175 ceph-mon[22392]: from='client.24487 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi079=a;smithi079=d;smithi079=g;smithi079=j;smithi081=b;smithi081=e;smithi081=h;smithi081=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:34:13.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:13 smithi175 ceph-mon[22392]: Saving service mds.all spec with placement smithi079=a;smithi079=d;smithi079=g;smithi079=j;smithi081=b;smithi081=e;smithi081=h;smithi081=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l;count:12 2024-08-20T01:34:13.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:13 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:13.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:13 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:34:13.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:13 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:13.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:13 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:34:13.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:13 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:13.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:13 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:34:13.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:13 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:34:13.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:13 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:13.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:13 smithi079 ceph-mon[18656]: from='client.24487 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi079=a;smithi079=d;smithi079=g;smithi079=j;smithi081=b;smithi081=e;smithi081=h;smithi081=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:34:13.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:13 smithi079 ceph-mon[18656]: Saving service mds.all spec with placement smithi079=a;smithi079=d;smithi079=g;smithi079=j;smithi081=b;smithi081=e;smithi081=h;smithi081=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l;count:12 2024-08-20T01:34:13.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:13 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:13.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:13 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:34:13.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:13 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:13.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:13 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:34:13.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:13 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:13.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:13 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:34:13.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:13 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:34:13.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:13 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:13.487 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:34:13.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:13.933+0000 7f60d1f67640 1 -- 172.21.15.79:0/2785173215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60cc101990 msgr2=0x7f60cc101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:13.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:13.933+0000 7f60d1f67640 1 --2- 172.21.15.79:0/2785173215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60cc101990 0x7f60cc101d70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f60bc009900 tx=0x7f60bc02a410 comp rx=0 tx=0).stop 2024-08-20T01:34:13.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:13.933+0000 7f60d1f67640 1 -- 172.21.15.79:0/2785173215 shutdown_connections 2024-08-20T01:34:13.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:13.933+0000 7f60d1f67640 1 --2- 172.21.15.79:0/2785173215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60cc107d20 0x7f60cc10e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:13.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:13.933+0000 7f60d1f67640 1 --2- 172.21.15.79:0/2785173215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60cc1073a0 0x7f60cc1077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:13.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:13.933+0000 7f60d1f67640 1 --2- 172.21.15.79:0/2785173215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60cc101990 0x7f60cc101d70 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:13.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:13.933+0000 7f60d1f67640 1 -- 172.21.15.79:0/2785173215 >> 172.21.15.79:0/2785173215 conn(0x7f60cc0fd400 msgr2=0x7f60cc0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:13.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:13.933+0000 7f60d1f67640 1 -- 172.21.15.79:0/2785173215 shutdown_connections 2024-08-20T01:34:13.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:13.933+0000 7f60d1f67640 1 -- 172.21.15.79:0/2785173215 wait complete. 2024-08-20T01:34:13.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:13.933+0000 7f60d1f67640 1 Processor -- start 2024-08-20T01:34:13.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:13.933+0000 7f60d1f67640 1 -- start start 2024-08-20T01:34:13.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:13.933+0000 7f60d1f67640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60cc101990 0x7f60cc199e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:13.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:13.933+0000 7f60d1f67640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60cc1073a0 0x7f60cc19a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:13.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:13.933+0000 7f60d1f67640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60cc107d20 0x7f60cc19a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:13.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:13.933+0000 7f60d1f67640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f60cc111920 con 0x7f60cc1073a0 2024-08-20T01:34:13.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:13.933+0000 7f60d1f67640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f60cc1117a0 con 0x7f60cc101990 2024-08-20T01:34:13.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:13.933+0000 7f60d1f67640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f60cc111aa0 con 0x7f60cc107d20 2024-08-20T01:34:13.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:13.934+0000 7f60c3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60cc1073a0 0x7f60cc19a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:13.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:13.934+0000 7f60c3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60cc1073a0 0x7f60cc19a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48126/0 (socket says 172.21.15.79:48126) 2024-08-20T01:34:13.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:13.934+0000 7f60c3fff640 1 -- 172.21.15.79:0/1027379956 learned_addr learned my addr 172.21.15.79:0/1027379956 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:34:13.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:13.934+0000 7f60cb7fe640 1 --2- 172.21.15.79:0/1027379956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60cc101990 0x7f60cc199e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:13.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:13.934+0000 7f60cbfff640 1 --2- 172.21.15.79:0/1027379956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60cc107d20 0x7f60cc19a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:13.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:13.934+0000 7f60c3fff640 1 -- 172.21.15.79:0/1027379956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60cc107d20 msgr2=0x7f60cc19a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:13.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:13.934+0000 7f60c3fff640 1 --2- 172.21.15.79:0/1027379956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60cc107d20 0x7f60cc19a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:13.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:13.934+0000 7f60c3fff640 1 -- 172.21.15.79:0/1027379956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60cc101990 msgr2=0x7f60cc199e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:13.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:13.934+0000 7f60c3fff640 1 --2- 172.21.15.79:0/1027379956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60cc101990 0x7f60cc199e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:13.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:13.934+0000 7f60c3fff640 1 -- 172.21.15.79:0/1027379956 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60cc1a51f0 con 0x7f60cc1073a0 2024-08-20T01:34:13.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:13.934+0000 7f60c3fff640 1 --2- 172.21.15.79:0/1027379956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60cc1073a0 0x7f60cc19a350 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f60b400b4a0 tx=0x7f60b400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:13.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:13.934+0000 7f60c97fa640 1 -- 172.21.15.79:0/1027379956 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b4014070 con 0x7f60cc1073a0 2024-08-20T01:34:13.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:13.934+0000 7f60c97fa640 1 -- 172.21.15.79:0/1027379956 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f60b4010aa0 con 0x7f60cc1073a0 2024-08-20T01:34:13.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:13.934+0000 7f60d1f67640 1 -- 172.21.15.79:0/1027379956 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60cc1a54e0 con 0x7f60cc1073a0 2024-08-20T01:34:13.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:13.934+0000 7f60c97fa640 1 -- 172.21.15.79:0/1027379956 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b4017b70 con 0x7f60cc1073a0 2024-08-20T01:34:13.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:13.934+0000 7f60d1f67640 1 -- 172.21.15.79:0/1027379956 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60cc1a5aa0 con 0x7f60cc1073a0 2024-08-20T01:34:13.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:13.935+0000 7f60d1f67640 1 -- 172.21.15.79:0/1027379956 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60cc101df0 con 0x7f60cc1073a0 2024-08-20T01:34:13.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:13.936+0000 7f60c97fa640 1 -- 172.21.15.79:0/1027379956 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f60b4017070 con 0x7f60cc1073a0 2024-08-20T01:34:13.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:13.937+0000 7f60c97fa640 1 --2- 172.21.15.79:0/1027379956 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f60b80b3bd0 0x7f60b80b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:13.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:13.938+0000 7f60cb7fe640 1 --2- 172.21.15.79:0/1027379956 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f60b80b3bd0 0x7f60b80b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:13.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:13.938+0000 7f60c97fa640 1 -- 172.21.15.79:0/1027379956 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7f60b40e2f30 con 0x7f60cc1073a0 2024-08-20T01:34:13.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:13.938+0000 7f60cb7fe640 1 --2- 172.21.15.79:0/1027379956 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f60b80b3bd0 0x7f60b80b6090 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f60bc006010 tx=0x7f60bc005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:13.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:13.941+0000 7f60c97fa640 1 -- 172.21.15.79:0/1027379956 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f60b40aa980 con 0x7f60cc1073a0 2024-08-20T01:34:14.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:14.149+0000 7f60d1f67640 1 -- 172.21.15.79:0/1027379956 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60cc06abc0 con 0x7f60cc1073a0 2024-08-20T01:34:14.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:14.149+0000 7f60c97fa640 1 -- 172.21.15.79:0/1027379956 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f60b40aa280 con 0x7f60cc1073a0 2024-08-20T01:34:14.151 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:34:14.151 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":1,"btime":"2024-08-20T01:27:07:792478+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-08-20T01:34:14.151 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 1 2024-08-20T01:34:14.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:14.151+0000 7f60d1f67640 1 -- 172.21.15.79:0/1027379956 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f60b80b3bd0 msgr2=0x7f60b80b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:14.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:14.151+0000 7f60d1f67640 1 --2- 172.21.15.79:0/1027379956 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f60b80b3bd0 0x7f60b80b6090 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f60bc006010 tx=0x7f60bc005e80 comp rx=0 tx=0).stop 2024-08-20T01:34:14.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:14.151+0000 7f60d1f67640 1 -- 172.21.15.79:0/1027379956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60cc1073a0 msgr2=0x7f60cc19a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:14.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:14.151+0000 7f60d1f67640 1 --2- 172.21.15.79:0/1027379956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60cc1073a0 0x7f60cc19a350 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f60b400b4a0 tx=0x7f60b400b960 comp rx=0 tx=0).stop 2024-08-20T01:34:14.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:14.151+0000 7f60d1f67640 1 -- 172.21.15.79:0/1027379956 shutdown_connections 2024-08-20T01:34:14.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:14.151+0000 7f60d1f67640 1 --2- 172.21.15.79:0/1027379956 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f60b80b3bd0 0x7f60b80b6090 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:14.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:14.151+0000 7f60d1f67640 1 --2- 172.21.15.79:0/1027379956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60cc107d20 0x7f60cc19a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:14.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:14.151+0000 7f60d1f67640 1 --2- 172.21.15.79:0/1027379956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60cc1073a0 0x7f60cc19a350 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:14.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:14.151+0000 7f60d1f67640 1 --2- 172.21.15.79:0/1027379956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60cc101990 0x7f60cc199e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:14.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:14.151+0000 7f60d1f67640 1 -- 172.21.15.79:0/1027379956 >> 172.21.15.79:0/1027379956 conn(0x7f60cc0fd400 msgr2=0x7f60cc0ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:14.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:14.151+0000 7f60d1f67640 1 -- 172.21.15.79:0/1027379956 shutdown_connections 2024-08-20T01:34:14.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:14.151+0000 7f60d1f67640 1 -- 172.21.15.79:0/1027379956 wait complete. 2024-08-20T01:34:14.358 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:14 smithi175 ceph-mon[22392]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:14.359 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:14 smithi175 ceph-mon[22392]: Deploying daemon mds.l on smithi175 2024-08-20T01:34:14.359 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:14 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/1027379956' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:34:14.359 INFO:journalctl@ceph.mds.l.smithi175.stdout:Aug 20 01:34:14 smithi175 systemd[1]: Starting Ceph mds.l for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:34:14.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:14 smithi079 ceph-mon[18656]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:14.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:14 smithi079 ceph-mon[18656]: Deploying daemon mds.l on smithi175 2024-08-20T01:34:14.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:14 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/1027379956' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:34:14.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:14 smithi081 ceph-mon[22209]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:14.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:14 smithi081 ceph-mon[22209]: Deploying daemon mds.l on smithi175 2024-08-20T01:34:14.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:14 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/1027379956' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:34:14.638 INFO:journalctl@ceph.mds.l.smithi175.stdout:Aug 20 01:34:14 smithi175 podman[51664]: 2024-08-20 01:34:14.555664338 +0000 UTC m=+0.100770618 container create fd8ed55dd4270e8150ce830b3a0c11469ee81443c104d5961afe7f6505b3c680 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-l, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-08-20T01:34:14.638 INFO:journalctl@ceph.mds.l.smithi175.stdout:Aug 20 01:34:14 smithi175 podman[51664]: 2024-08-20 01:34:14.470539654 +0000 UTC m=+0.015645947 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:34:15.138 INFO:journalctl@ceph.mds.l.smithi175.stdout:Aug 20 01:34:14 smithi175 podman[51664]: 2024-08-20 01:34:14.741718722 +0000 UTC m=+0.286825001 container init fd8ed55dd4270e8150ce830b3a0c11469ee81443c104d5961afe7f6505b3c680 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-l, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.36.0, ceph=True, GIT_CLEAN=True) 2024-08-20T01:34:15.139 INFO:journalctl@ceph.mds.l.smithi175.stdout:Aug 20 01:34:14 smithi175 podman[51664]: 2024-08-20 01:34:14.744451076 +0000 UTC m=+0.289557361 container start fd8ed55dd4270e8150ce830b3a0c11469ee81443c104d5961afe7f6505b3c680 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-l, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-08-20T01:34:15.139 INFO:journalctl@ceph.mds.l.smithi175.stdout:Aug 20 01:34:14 smithi175 ceph-mds[51683]: -- 172.21.15.175:0/3896847501 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a8aa959860 con 0x55a8aa936800 2024-08-20T01:34:15.139 INFO:journalctl@ceph.mds.l.smithi175.stdout:Aug 20 01:34:14 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-l[51679]: starting mds.l at 2024-08-20T01:34:15.139 INFO:journalctl@ceph.mds.l.smithi175.stdout:Aug 20 01:34:14 smithi175 bash[51664]: fd8ed55dd4270e8150ce830b3a0c11469ee81443c104d5961afe7f6505b3c680 2024-08-20T01:34:15.139 INFO:journalctl@ceph.mds.l.smithi175.stdout:Aug 20 01:34:14 smithi175 systemd[1]: Started Ceph mds.l for 28484e9a-5e93-11ef-bccf-c7b262605968. 2024-08-20T01:34:16.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:15 smithi081 ceph-mon[22209]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:16.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:15 smithi081 ceph-mon[22209]: mds.? [v2:172.21.15.175:6832/1107229215,v1:172.21.15.175:6833/1107229215] up:boot 2024-08-20T01:34:16.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:15 smithi081 ceph-mon[22209]: fsmap 1 up:standby 2024-08-20T01:34:16.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:15 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-20T01:34:16.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:15 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:16.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:15 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:16.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:15 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:16.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:15 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:34:16.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:15 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:34:16.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:15 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:16.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:15 smithi081 ceph-mon[22209]: Deploying daemon mds.k on smithi081 2024-08-20T01:34:16.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:15 smithi175 ceph-mon[22392]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:16.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:15 smithi175 ceph-mon[22392]: mds.? [v2:172.21.15.175:6832/1107229215,v1:172.21.15.175:6833/1107229215] up:boot 2024-08-20T01:34:16.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:15 smithi175 ceph-mon[22392]: fsmap 1 up:standby 2024-08-20T01:34:16.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:15 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-20T01:34:16.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:15 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:16.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:15 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:16.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:15 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:16.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:15 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:34:16.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:15 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:34:16.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:15 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:16.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:15 smithi175 ceph-mon[22392]: Deploying daemon mds.k on smithi081 2024-08-20T01:34:16.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:15 smithi079 ceph-mon[18656]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:16.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:15 smithi079 ceph-mon[18656]: mds.? [v2:172.21.15.175:6832/1107229215,v1:172.21.15.175:6833/1107229215] up:boot 2024-08-20T01:34:16.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:15 smithi079 ceph-mon[18656]: fsmap 1 up:standby 2024-08-20T01:34:16.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:15 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-20T01:34:16.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:15 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:16.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:15 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:16.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:15 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:16.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:15 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:34:16.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:15 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:34:16.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:15 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:16.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:15 smithi079 ceph-mon[18656]: Deploying daemon mds.k on smithi081 2024-08-20T01:34:16.854 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:34:16.982 INFO:journalctl@ceph.mds.k.smithi081.stdout:Aug 20 01:34:16 smithi081 systemd[1]: Starting Ceph mds.k for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:34:17.107 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:34:17.256 INFO:journalctl@ceph.mds.k.smithi081.stdout:Aug 20 01:34:16 smithi081 podman[51039]: 2024-08-20 01:34:16.88396189 +0000 UTC m=+0.015954330 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:34:17.256 INFO:journalctl@ceph.mds.k.smithi081.stdout:Aug 20 01:34:17 smithi081 podman[51039]: 2024-08-20 01:34:17.002539713 +0000 UTC m=+0.134532143 container create ef9bfcfd23454b3f76f018ecabed6a982a95ec765371da22fef6ac6125e986e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-k, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0) 2024-08-20T01:34:17.256 INFO:journalctl@ceph.mds.k.smithi081.stdout:Aug 20 01:34:17 smithi081 podman[51039]: 2024-08-20 01:34:17.255221048 +0000 UTC m=+0.387213481 container init ef9bfcfd23454b3f76f018ecabed6a982a95ec765371da22fef6ac6125e986e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-k, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-20T01:34:17.528 INFO:journalctl@ceph.mds.k.smithi081.stdout:Aug 20 01:34:17 smithi081 podman[51039]: 2024-08-20 01:34:17.258303101 +0000 UTC m=+0.390295531 container start ef9bfcfd23454b3f76f018ecabed6a982a95ec765371da22fef6ac6125e986e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-k, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.vendor=CentOS) 2024-08-20T01:34:17.528 INFO:journalctl@ceph.mds.k.smithi081.stdout:Aug 20 01:34:17 smithi081 ceph-mds[51058]: -- 172.21.15.81:0/1194738481 <== mon.2 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5605d55ef860 con 0x5605d55cd000 2024-08-20T01:34:17.528 INFO:journalctl@ceph.mds.k.smithi081.stdout:Aug 20 01:34:17 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-k[51054]: starting mds.k at 2024-08-20T01:34:17.528 INFO:journalctl@ceph.mds.k.smithi081.stdout:Aug 20 01:34:17 smithi081 bash[51039]: ef9bfcfd23454b3f76f018ecabed6a982a95ec765371da22fef6ac6125e986e5 2024-08-20T01:34:17.528 INFO:journalctl@ceph.mds.k.smithi081.stdout:Aug 20 01:34:17 smithi081 systemd[1]: Started Ceph mds.k for 28484e9a-5e93-11ef-bccf-c7b262605968. 2024-08-20T01:34:17.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.579+0000 7f2d47f17640 1 -- 172.21.15.79:0/4044834766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d401073a0 msgr2=0x7f2d401077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:17.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.579+0000 7f2d47f17640 1 --2- 172.21.15.79:0/4044834766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d401073a0 0x7f2d401077e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2d30009900 tx=0x7f2d3002a410 comp rx=0 tx=0).stop 2024-08-20T01:34:17.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.579+0000 7f2d47f17640 1 -- 172.21.15.79:0/4044834766 shutdown_connections 2024-08-20T01:34:17.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.579+0000 7f2d47f17640 1 --2- 172.21.15.79:0/4044834766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d40107d20 0x7f2d4010e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:17.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.579+0000 7f2d47f17640 1 --2- 172.21.15.79:0/4044834766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d401073a0 0x7f2d401077e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:17.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.579+0000 7f2d47f17640 1 --2- 172.21.15.79:0/4044834766 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d40101990 0x7f2d40101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:17.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.579+0000 7f2d47f17640 1 -- 172.21.15.79:0/4044834766 >> 172.21.15.79:0/4044834766 conn(0x7f2d400fd400 msgr2=0x7f2d400ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:17.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.579+0000 7f2d47f17640 1 -- 172.21.15.79:0/4044834766 shutdown_connections 2024-08-20T01:34:17.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.579+0000 7f2d47f17640 1 -- 172.21.15.79:0/4044834766 wait complete. 2024-08-20T01:34:17.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.580+0000 7f2d47f17640 1 Processor -- start 2024-08-20T01:34:17.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.580+0000 7f2d47f17640 1 -- start start 2024-08-20T01:34:17.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.580+0000 7f2d47f17640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d40101990 0x7f2d400fd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:17.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.580+0000 7f2d47f17640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d401073a0 0x7f2d400fde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:17.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.580+0000 7f2d47f17640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d40107d20 0x7f2d400fe380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:17.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.580+0000 7f2d47f17640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2d401118e0 con 0x7f2d401073a0 2024-08-20T01:34:17.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.580+0000 7f2d47f17640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2d40111760 con 0x7f2d40107d20 2024-08-20T01:34:17.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.580+0000 7f2d47f17640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2d40111a60 con 0x7f2d40101990 2024-08-20T01:34:17.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.580+0000 7f2d454b2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d401073a0 0x7f2d400fde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:17.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.580+0000 7f2d454b2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d401073a0 0x7f2d400fde40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48140/0 (socket says 172.21.15.79:48140) 2024-08-20T01:34:17.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.580+0000 7f2d454b2640 1 -- 172.21.15.79:0/2311437481 learned_addr learned my addr 172.21.15.79:0/2311437481 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:34:17.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.580+0000 7f2d464b4640 1 --2- 172.21.15.79:0/2311437481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d40107d20 0x7f2d400fe380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:17.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.581+0000 7f2d45cb3640 1 --2- 172.21.15.79:0/2311437481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d40101990 0x7f2d400fd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:17.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.581+0000 7f2d454b2640 1 -- 172.21.15.79:0/2311437481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d40101990 msgr2=0x7f2d400fd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:17.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.581+0000 7f2d454b2640 1 --2- 172.21.15.79:0/2311437481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d40101990 0x7f2d400fd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:17.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.581+0000 7f2d454b2640 1 -- 172.21.15.79:0/2311437481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d40107d20 msgr2=0x7f2d400fe380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:17.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.581+0000 7f2d454b2640 1 --2- 172.21.15.79:0/2311437481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d40107d20 0x7f2d400fe380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:17.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.581+0000 7f2d454b2640 1 -- 172.21.15.79:0/2311437481 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d401a73a0 con 0x7f2d401073a0 2024-08-20T01:34:17.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.581+0000 7f2d45cb3640 1 --2- 172.21.15.79:0/2311437481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d40101990 0x7f2d400fd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:34:17.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.581+0000 7f2d464b4640 1 --2- 172.21.15.79:0/2311437481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d40107d20 0x7f2d400fe380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:34:17.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.581+0000 7f2d454b2640 1 --2- 172.21.15.79:0/2311437481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d401073a0 0x7f2d400fde40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2d3002a930 tx=0x7f2d30003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:17.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.581+0000 7f2d36ffd640 1 -- 172.21.15.79:0/2311437481 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d3003f070 con 0x7f2d401073a0 2024-08-20T01:34:17.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.581+0000 7f2d36ffd640 1 -- 172.21.15.79:0/2311437481 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2d30003e40 con 0x7f2d401073a0 2024-08-20T01:34:17.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.581+0000 7f2d47f17640 1 -- 172.21.15.79:0/2311437481 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d401a7630 con 0x7f2d401073a0 2024-08-20T01:34:17.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.581+0000 7f2d36ffd640 1 -- 172.21.15.79:0/2311437481 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d30035030 con 0x7f2d401073a0 2024-08-20T01:34:17.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.581+0000 7f2d47f17640 1 -- 172.21.15.79:0/2311437481 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d401a7b10 con 0x7f2d401073a0 2024-08-20T01:34:17.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.582+0000 7f2d47f17640 1 -- 172.21.15.79:0/2311437481 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d40101d70 con 0x7f2d401073a0 2024-08-20T01:34:17.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.584+0000 7f2d36ffd640 1 -- 172.21.15.79:0/2311437481 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f2d30042070 con 0x7f2d401073a0 2024-08-20T01:34:17.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.584+0000 7f2d36ffd640 1 --2- 172.21.15.79:0/2311437481 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2d2c0b3bd0 0x7f2d2c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:17.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.585+0000 7f2d45cb3640 1 --2- 172.21.15.79:0/2311437481 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2d2c0b3bd0 0x7f2d2c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:17.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.585+0000 7f2d36ffd640 1 -- 172.21.15.79:0/2311437481 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7f2d30104400 con 0x7f2d401073a0 2024-08-20T01:34:17.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.585+0000 7f2d45cb3640 1 --2- 172.21.15.79:0/2311437481 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2d2c0b3bd0 0x7f2d2c0b6090 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c006fd0 tx=0x7f2d3c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:17.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.591+0000 7f2d36ffd640 1 -- 172.21.15.79:0/2311437481 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f2d300cbef0 con 0x7f2d401073a0 2024-08-20T01:34:17.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.820+0000 7f2d47f17640 1 -- 172.21.15.79:0/2311437481 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2d401a7e60 con 0x7f2d401073a0 2024-08-20T01:34:17.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.821+0000 7f2d36ffd640 1 -- 172.21.15.79:0/2311437481 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2263 (secure 0 0 0) 0x7f2d300cb7f0 con 0x7f2d401073a0 2024-08-20T01:34:17.823 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:34:17.823 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":3,"btime":"2024-08-20T01:34:17:776325+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24473,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/1257507005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1257507005},{"type":"v1","addr":"172.21.15.81:6833","nonce":1257507005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1107229215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1107229215},{"type":"v1","addr":"172.21.15.175:6833","nonce":1107229215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-08-20T01:34:17.823 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 3 2024-08-20T01:34:17.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.823+0000 7f2d47f17640 1 -- 172.21.15.79:0/2311437481 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2d2c0b3bd0 msgr2=0x7f2d2c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:17.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.823+0000 7f2d47f17640 1 --2- 172.21.15.79:0/2311437481 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2d2c0b3bd0 0x7f2d2c0b6090 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c006fd0 tx=0x7f2d3c008040 comp rx=0 tx=0).stop 2024-08-20T01:34:17.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.823+0000 7f2d47f17640 1 -- 172.21.15.79:0/2311437481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d401073a0 msgr2=0x7f2d400fde40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:17.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.823+0000 7f2d47f17640 1 --2- 172.21.15.79:0/2311437481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d401073a0 0x7f2d400fde40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2d3002a930 tx=0x7f2d30003c20 comp rx=0 tx=0).stop 2024-08-20T01:34:17.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.823+0000 7f2d47f17640 1 -- 172.21.15.79:0/2311437481 shutdown_connections 2024-08-20T01:34:17.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.823+0000 7f2d47f17640 1 --2- 172.21.15.79:0/2311437481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d40107d20 0x7f2d400fe380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:17.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.823+0000 7f2d47f17640 1 --2- 172.21.15.79:0/2311437481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d401073a0 0x7f2d400fde40 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:17.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.823+0000 7f2d47f17640 1 --2- 172.21.15.79:0/2311437481 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2d2c0b3bd0 0x7f2d2c0b6090 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:17.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.823+0000 7f2d47f17640 1 --2- 172.21.15.79:0/2311437481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d40101990 0x7f2d400fd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:17.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.823+0000 7f2d47f17640 1 -- 172.21.15.79:0/2311437481 >> 172.21.15.79:0/2311437481 conn(0x7f2d400fd400 msgr2=0x7f2d40100310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:17.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.823+0000 7f2d47f17640 1 -- 172.21.15.79:0/2311437481 shutdown_connections 2024-08-20T01:34:17.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:17.823+0000 7f2d47f17640 1 -- 172.21.15.79:0/2311437481 wait complete. 2024-08-20T01:34:18.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:18 smithi079 ceph-mon[18656]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:18.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:18 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:18.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:18 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:18.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:18 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:18.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:18 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:34:18.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:18 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:34:18.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:18 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:18.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:18 smithi079 ceph-mon[18656]: Deploying daemon mds.j on smithi079 2024-08-20T01:34:18.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:18 smithi079 ceph-mon[18656]: mds.? [v2:172.21.15.81:6832/1257507005,v1:172.21.15.81:6833/1257507005] up:boot 2024-08-20T01:34:18.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:18 smithi079 ceph-mon[18656]: fsmap 2 up:standby 2024-08-20T01:34:18.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:18 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-20T01:34:18.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:18 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2311437481' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:34:18.693 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:18 smithi081 ceph-mon[22209]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:18.693 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:18 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:18.693 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:18 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:18.693 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:18 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:18.693 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:18 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:34:18.693 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:18 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:34:18.693 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:18 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:18.693 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:18 smithi081 ceph-mon[22209]: Deploying daemon mds.j on smithi079 2024-08-20T01:34:18.693 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:18 smithi081 ceph-mon[22209]: mds.? [v2:172.21.15.81:6832/1257507005,v1:172.21.15.81:6833/1257507005] up:boot 2024-08-20T01:34:18.693 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:18 smithi081 ceph-mon[22209]: fsmap 2 up:standby 2024-08-20T01:34:18.693 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:18 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-20T01:34:18.694 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:18 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2311437481' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:34:18.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:18 smithi175 ceph-mon[22392]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:18.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:18 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:18.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:18 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:18.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:18 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:18.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:18 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:34:18.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:18 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:34:18.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:18 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:18.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:18 smithi175 ceph-mon[22392]: Deploying daemon mds.j on smithi079 2024-08-20T01:34:18.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:18 smithi175 ceph-mon[22392]: mds.? [v2:172.21.15.81:6832/1257507005,v1:172.21.15.81:6833/1257507005] up:boot 2024-08-20T01:34:18.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:18 smithi175 ceph-mon[22392]: fsmap 2 up:standby 2024-08-20T01:34:18.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:18 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-20T01:34:18.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:18 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2311437481' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:34:19.686 INFO:journalctl@ceph.mds.j.smithi079.stdout:Aug 20 01:34:19 smithi079 systemd[1]: Starting Ceph mds.j for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:34:20.132 INFO:journalctl@ceph.mds.j.smithi079.stdout:Aug 20 01:34:20 smithi079 podman[57154]: 2024-08-20 01:34:20.002372013 +0000 UTC m=+0.109063726 container create d45e53552b35f55490845b64659b76d8a60a47c83c540720447468d44a6c0044 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-j, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-20T01:34:20.133 INFO:journalctl@ceph.mds.j.smithi079.stdout:Aug 20 01:34:20 smithi079 podman[57154]: 2024-08-20 01:34:19.909000458 +0000 UTC m=+0.015692179 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:34:20.414 INFO:journalctl@ceph.mds.j.smithi079.stdout:Aug 20 01:34:20 smithi079 podman[57154]: 2024-08-20 01:34:20.238206321 +0000 UTC m=+0.344898033 container init d45e53552b35f55490845b64659b76d8a60a47c83c540720447468d44a6c0044 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-j, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-08-20T01:34:20.414 INFO:journalctl@ceph.mds.j.smithi079.stdout:Aug 20 01:34:20 smithi079 podman[57154]: 2024-08-20 01:34:20.241087331 +0000 UTC m=+0.347779045 container start d45e53552b35f55490845b64659b76d8a60a47c83c540720447468d44a6c0044 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-j, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T01:34:20.414 INFO:journalctl@ceph.mds.j.smithi079.stdout:Aug 20 01:34:20 smithi079 ceph-mds[57173]: -- 172.21.15.79:0/944919208 <== mon.0 v2:172.21.15.79:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557023a6b860 con 0x557023a49400 2024-08-20T01:34:20.414 INFO:journalctl@ceph.mds.j.smithi079.stdout:Aug 20 01:34:20 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-j[57169]: starting mds.j at 2024-08-20T01:34:20.414 INFO:journalctl@ceph.mds.j.smithi079.stdout:Aug 20 01:34:20 smithi079 bash[57154]: d45e53552b35f55490845b64659b76d8a60a47c83c540720447468d44a6c0044 2024-08-20T01:34:20.414 INFO:journalctl@ceph.mds.j.smithi079.stdout:Aug 20 01:34:20 smithi079 systemd[1]: Started Ceph mds.j for 28484e9a-5e93-11ef-bccf-c7b262605968. 2024-08-20T01:34:20.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:20 smithi079 ceph-mon[18656]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:20.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:20 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:20.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:20 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:20.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:20 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:20.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:20 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:34:20.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:20 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:34:20.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:20 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:20.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:20 smithi081 ceph-mon[22209]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:20.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:20 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:20.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:20 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:20.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:20 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:20.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:20 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:34:20.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:20 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:34:20.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:20 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:20.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:20 smithi175 ceph-mon[22392]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:20.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:20 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:20.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:20 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:20.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:20 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:20.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:20 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:34:20.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:20 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:34:20.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:20 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:21.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:21 smithi079 ceph-mon[18656]: Deploying daemon mds.d on smithi079 2024-08-20T01:34:21.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:21 smithi079 ceph-mon[18656]: mds.? [v2:172.21.15.79:6834/735082912,v1:172.21.15.79:6835/735082912] up:boot 2024-08-20T01:34:21.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:21 smithi079 ceph-mon[18656]: fsmap 3 up:standby 2024-08-20T01:34:21.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:21 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-08-20T01:34:21.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:21 smithi081 ceph-mon[22209]: Deploying daemon mds.d on smithi079 2024-08-20T01:34:21.793 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:21 smithi081 ceph-mon[22209]: mds.? [v2:172.21.15.79:6834/735082912,v1:172.21.15.79:6835/735082912] up:boot 2024-08-20T01:34:21.793 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:21 smithi081 ceph-mon[22209]: fsmap 3 up:standby 2024-08-20T01:34:21.793 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:21 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-08-20T01:34:21.805 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:34:21.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:21 smithi175 ceph-mon[22392]: Deploying daemon mds.d on smithi079 2024-08-20T01:34:21.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:21 smithi175 ceph-mon[22392]: mds.? [v2:172.21.15.79:6834/735082912,v1:172.21.15.79:6835/735082912] up:boot 2024-08-20T01:34:21.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:21 smithi175 ceph-mon[22392]: fsmap 3 up:standby 2024-08-20T01:34:21.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:21 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-08-20T01:34:22.090 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:34:22.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.589+0000 7f166c6e1640 1 -- 172.21.15.79:0/3129299857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f166410ce40 msgr2=0x7f166410f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:22.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.589+0000 7f166c6e1640 1 --2- 172.21.15.79:0/3129299857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f166410ce40 0x7f166410f2a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f165c009ca0 tx=0x7f165c02a8c0 comp rx=0 tx=0).stop 2024-08-20T01:34:22.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.589+0000 7f166c6e1640 1 -- 172.21.15.79:0/3129299857 shutdown_connections 2024-08-20T01:34:22.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.589+0000 7f166c6e1640 1 --2- 172.21.15.79:0/3129299857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f166410ce40 0x7f166410f2a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:22.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.589+0000 7f166c6e1640 1 --2- 172.21.15.79:0/3129299857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1664104300 0x7f166410c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:22.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.589+0000 7f166c6e1640 1 --2- 172.21.15.79:0/3129299857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16641039e0 0x7f1664103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:22.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.589+0000 7f166c6e1640 1 -- 172.21.15.79:0/3129299857 >> 172.21.15.79:0/3129299857 conn(0x7f16640fd440 msgr2=0x7f16640ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:22.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.589+0000 7f166c6e1640 1 -- 172.21.15.79:0/3129299857 shutdown_connections 2024-08-20T01:34:22.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.589+0000 7f166c6e1640 1 -- 172.21.15.79:0/3129299857 wait complete. 2024-08-20T01:34:22.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.589+0000 7f166c6e1640 1 Processor -- start 2024-08-20T01:34:22.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.589+0000 7f166c6e1640 1 -- start start 2024-08-20T01:34:22.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.590+0000 7f166c6e1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16641039e0 0x7f1664198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:22.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.590+0000 7f166c6e1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1664104300 0x7f1664199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:22.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.590+0000 7f166c6e1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f166410ce40 0x7f166419e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:22.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.590+0000 7f166c6e1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f16641129b0 con 0x7f1664104300 2024-08-20T01:34:22.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.590+0000 7f166c6e1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1664112830 con 0x7f166410ce40 2024-08-20T01:34:22.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.590+0000 7f166c6e1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1664112b30 con 0x7f16641039e0 2024-08-20T01:34:22.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.590+0000 7f1669c7c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1664104300 0x7f1664199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:22.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.590+0000 7f1669c7c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1664104300 0x7f1664199360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35426/0 (socket says 172.21.15.79:35426) 2024-08-20T01:34:22.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.590+0000 7f1669c7c640 1 -- 172.21.15.79:0/3063472268 learned_addr learned my addr 172.21.15.79:0/3063472268 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:34:22.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.590+0000 7f1669c7c640 1 -- 172.21.15.79:0/3063472268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16641039e0 msgr2=0x7f1664198e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:22.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.590+0000 7f1669c7c640 1 --2- 172.21.15.79:0/3063472268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16641039e0 0x7f1664198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:22.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.590+0000 7f1669c7c640 1 -- 172.21.15.79:0/3063472268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f166410ce40 msgr2=0x7f166419e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:22.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.590+0000 7f1669c7c640 1 --2- 172.21.15.79:0/3063472268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f166410ce40 0x7f166419e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:22.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.590+0000 7f1669c7c640 1 -- 172.21.15.79:0/3063472268 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f166419eed0 con 0x7f1664104300 2024-08-20T01:34:22.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.590+0000 7f1669c7c640 1 --2- 172.21.15.79:0/3063472268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1664104300 0x7f1664199360 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f165400c970 tx=0x7f165400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:22.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.590+0000 7f165b7fe640 1 -- 172.21.15.79:0/3063472268 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1654004220 con 0x7f1664104300 2024-08-20T01:34:22.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.590+0000 7f166c6e1640 1 -- 172.21.15.79:0/3063472268 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f166419f1c0 con 0x7f1664104300 2024-08-20T01:34:22.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.590+0000 7f165b7fe640 1 -- 172.21.15.79:0/3063472268 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1654007e40 con 0x7f1664104300 2024-08-20T01:34:22.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.590+0000 7f165b7fe640 1 -- 172.21.15.79:0/3063472268 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16540047a0 con 0x7f1664104300 2024-08-20T01:34:22.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.590+0000 7f166c6e1640 1 -- 172.21.15.79:0/3063472268 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16641a5880 con 0x7f1664104300 2024-08-20T01:34:22.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.591+0000 7f166c6e1640 1 -- 172.21.15.79:0/3063472268 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1664103dc0 con 0x7f1664104300 2024-08-20T01:34:22.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.593+0000 7f165b7fe640 1 -- 172.21.15.79:0/3063472268 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f16540079b0 con 0x7f1664104300 2024-08-20T01:34:22.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.593+0000 7f165b7fe640 1 --2- 172.21.15.79:0/3063472268 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f16500b3bd0 0x7f16500b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:22.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.594+0000 7f166a47d640 1 --2- 172.21.15.79:0/3063472268 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f16500b3bd0 0x7f16500b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:22.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.594+0000 7f165b7fe640 1 -- 172.21.15.79:0/3063472268 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7f16540e3490 con 0x7f1664104300 2024-08-20T01:34:22.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.594+0000 7f166a47d640 1 --2- 172.21.15.79:0/3063472268 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f16500b3bd0 0x7f16500b6090 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f166000a990 tx=0x7f1660005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:22.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.598+0000 7f165b7fe640 1 -- 172.21.15.79:0/3063472268 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f1654014030 con 0x7f1664104300 2024-08-20T01:34:22.645 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:22 smithi175 ceph-mon[22392]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:22.690 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:22 smithi079 ceph-mon[18656]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:22.807 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:22 smithi081 ceph-mon[22209]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:22.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.818+0000 7f166c6e1640 1 -- 172.21.15.79:0/3063472268 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f16641a5b10 con 0x7f1664104300 2024-08-20T01:34:22.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.819+0000 7f165b7fe640 1 -- 172.21.15.79:0/3063472268 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3085 (secure 0 0 0) 0x7f16540aaf80 con 0x7f1664104300 2024-08-20T01:34:22.825 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:34:22.825 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":4,"btime":"2024-08-20T01:34:20:406344+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14670,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/735082912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":735082912},{"type":"v1","addr":"172.21.15.79:6835","nonce":735082912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24473,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/1257507005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1257507005},{"type":"v1","addr":"172.21.15.81:6833","nonce":1257507005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1107229215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1107229215},{"type":"v1","addr":"172.21.15.175:6833","nonce":1107229215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-08-20T01:34:22.826 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 4 2024-08-20T01:34:22.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.821+0000 7f166c6e1640 1 -- 172.21.15.79:0/3063472268 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f16500b3bd0 msgr2=0x7f16500b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:22.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.821+0000 7f166c6e1640 1 --2- 172.21.15.79:0/3063472268 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f16500b3bd0 0x7f16500b6090 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f166000a990 tx=0x7f1660005c70 comp rx=0 tx=0).stop 2024-08-20T01:34:22.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.821+0000 7f166c6e1640 1 -- 172.21.15.79:0/3063472268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1664104300 msgr2=0x7f1664199360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:22.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.821+0000 7f166c6e1640 1 --2- 172.21.15.79:0/3063472268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1664104300 0x7f1664199360 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f165400c970 tx=0x7f165400ce30 comp rx=0 tx=0).stop 2024-08-20T01:34:22.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.821+0000 7f166c6e1640 1 -- 172.21.15.79:0/3063472268 shutdown_connections 2024-08-20T01:34:22.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.821+0000 7f166c6e1640 1 --2- 172.21.15.79:0/3063472268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f166410ce40 0x7f166419e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:22.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.821+0000 7f166c6e1640 1 --2- 172.21.15.79:0/3063472268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1664104300 0x7f1664199360 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:22.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.821+0000 7f166c6e1640 1 --2- 172.21.15.79:0/3063472268 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f16500b3bd0 0x7f16500b6090 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:22.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.821+0000 7f166c6e1640 1 --2- 172.21.15.79:0/3063472268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16641039e0 0x7f1664198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:22.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.821+0000 7f166c6e1640 1 -- 172.21.15.79:0/3063472268 >> 172.21.15.79:0/3063472268 conn(0x7f16640fd440 msgr2=0x7f166410f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:22.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.821+0000 7f166c6e1640 1 -- 172.21.15.79:0/3063472268 shutdown_connections 2024-08-20T01:34:22.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:22.821+0000 7f166c6e1640 1 -- 172.21.15.79:0/3063472268 wait complete. 2024-08-20T01:34:23.649 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:23 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/3063472268' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:34:23.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:23 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/3063472268' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:34:23.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:23 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/3063472268' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:34:23.936 INFO:journalctl@ceph.mds.d.smithi079.stdout:Aug 20 01:34:23 smithi079 systemd[1]: Started Ceph mds.d for 28484e9a-5e93-11ef-bccf-c7b262605968. 2024-08-20T01:34:24.617 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:24 smithi081 ceph-mon[22209]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:24.617 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:24 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:24.617 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:24 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:24.618 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:24 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:24.618 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:24 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:34:24.618 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:24 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:34:24.618 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:24 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:24.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:24 smithi175 ceph-mon[22392]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:24.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:24 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:24.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:24 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:24.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:24 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:24.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:24 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:34:24.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:24 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:34:24.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:24 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:24.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:24 smithi079 ceph-mon[18656]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:24.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:24 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:24.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:24 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:24.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:24 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:24.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:24 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:34:24.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:24 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:34:24.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:24 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:25.678 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:34:25.679 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:25 smithi081 ceph-mon[22209]: Deploying daemon mds.e on smithi081 2024-08-20T01:34:25.679 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:25 smithi081 ceph-mon[22209]: mds.? [v2:172.21.15.79:6836/2150339873,v1:172.21.15.79:6837/2150339873] up:boot 2024-08-20T01:34:25.679 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:25 smithi081 ceph-mon[22209]: fsmap 4 up:standby 2024-08-20T01:34:25.679 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:25 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-08-20T01:34:25.707 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:25 smithi079 ceph-mon[18656]: Deploying daemon mds.e on smithi081 2024-08-20T01:34:25.708 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:25 smithi079 ceph-mon[18656]: mds.? [v2:172.21.15.79:6836/2150339873,v1:172.21.15.79:6837/2150339873] up:boot 2024-08-20T01:34:25.708 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:25 smithi079 ceph-mon[18656]: fsmap 4 up:standby 2024-08-20T01:34:25.708 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:25 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-08-20T01:34:25.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:25 smithi175 ceph-mon[22392]: Deploying daemon mds.e on smithi081 2024-08-20T01:34:25.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:25 smithi175 ceph-mon[22392]: mds.? [v2:172.21.15.79:6836/2150339873,v1:172.21.15.79:6837/2150339873] up:boot 2024-08-20T01:34:25.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:25 smithi175 ceph-mon[22392]: fsmap 4 up:standby 2024-08-20T01:34:25.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:25 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-08-20T01:34:25.936 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:34:26.027 INFO:journalctl@ceph.mds.e.smithi081.stdout:Aug 20 01:34:25 smithi081 systemd[1]: Starting Ceph mds.e for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:34:26.360 INFO:journalctl@ceph.mds.e.smithi081.stdout:Aug 20 01:34:26 smithi081 podman[51354]: 2024-08-20 01:34:25.975663343 +0000 UTC m=+0.015680833 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:34:26.360 INFO:journalctl@ceph.mds.e.smithi081.stdout:Aug 20 01:34:26 smithi081 podman[51354]: 2024-08-20 01:34:26.089477942 +0000 UTC m=+0.129495422 container create 2bed42758d3d21a337cd2cddfb7f0849808656111f686394960dd3e65e587fe1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-e, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-20T01:34:26.360 INFO:journalctl@ceph.mds.e.smithi081.stdout:Aug 20 01:34:26 smithi081 podman[51354]: 2024-08-20 01:34:26.267029682 +0000 UTC m=+0.307047165 container init 2bed42758d3d21a337cd2cddfb7f0849808656111f686394960dd3e65e587fe1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-e, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-08-20T01:34:26.360 INFO:journalctl@ceph.mds.e.smithi081.stdout:Aug 20 01:34:26 smithi081 podman[51354]: 2024-08-20 01:34:26.269662841 +0000 UTC m=+0.309680317 container start 2bed42758d3d21a337cd2cddfb7f0849808656111f686394960dd3e65e587fe1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-e, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0) 2024-08-20T01:34:26.360 INFO:journalctl@ceph.mds.e.smithi081.stdout:Aug 20 01:34:26 smithi081 ceph-mds[51373]: -- 172.21.15.81:0/477224389 <== mon.2 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557af52b3860 con 0x557af5291400 2024-08-20T01:34:26.360 INFO:journalctl@ceph.mds.e.smithi081.stdout:Aug 20 01:34:26 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-e[51369]: starting mds.e at 2024-08-20T01:34:26.360 INFO:journalctl@ceph.mds.e.smithi081.stdout:Aug 20 01:34:26 smithi081 bash[51354]: 2bed42758d3d21a337cd2cddfb7f0849808656111f686394960dd3e65e587fe1 2024-08-20T01:34:26.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.417+0000 7f10b6244640 1 -- 172.21.15.79:0/1374331770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10b01073a0 msgr2=0x7f10b01077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:26.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.417+0000 7f10b6244640 1 --2- 172.21.15.79:0/1374331770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10b01073a0 0x7f10b01077e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f10a4009900 tx=0x7f10a402a410 comp rx=0 tx=0).stop 2024-08-20T01:34:26.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.418+0000 7f10b6244640 1 -- 172.21.15.79:0/1374331770 shutdown_connections 2024-08-20T01:34:26.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.418+0000 7f10b6244640 1 --2- 172.21.15.79:0/1374331770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10b0107d20 0x7f10b010e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:26.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.418+0000 7f10b6244640 1 --2- 172.21.15.79:0/1374331770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10b01073a0 0x7f10b01077e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:26.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.418+0000 7f10b6244640 1 --2- 172.21.15.79:0/1374331770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10b0101990 0x7f10b0101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:26.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.418+0000 7f10b6244640 1 -- 172.21.15.79:0/1374331770 >> 172.21.15.79:0/1374331770 conn(0x7f10b00fd3e0 msgr2=0x7f10b00ff800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:26.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.418+0000 7f10b6244640 1 -- 172.21.15.79:0/1374331770 shutdown_connections 2024-08-20T01:34:26.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.418+0000 7f10b6244640 1 -- 172.21.15.79:0/1374331770 wait complete. 2024-08-20T01:34:26.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.418+0000 7f10b6244640 1 Processor -- start 2024-08-20T01:34:26.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.419+0000 7f10b6244640 1 -- start start 2024-08-20T01:34:26.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.419+0000 7f10b6244640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10b0101990 0x7f10b0199ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:26.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.419+0000 7f10b6244640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10b01073a0 0x7f10b019a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:26.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.419+0000 7f10b6244640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10b0107d20 0x7f10b019a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:26.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.419+0000 7f10b6244640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f10b0111890 con 0x7f10b0101990 2024-08-20T01:34:26.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.419+0000 7f10b6244640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f10b0111710 con 0x7f10b01073a0 2024-08-20T01:34:26.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.419+0000 7f10b6244640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f10b0111a10 con 0x7f10b0107d20 2024-08-20T01:34:26.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.419+0000 7f10af7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10b0101990 0x7f10b0199ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:26.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.419+0000 7f10af7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10b0101990 0x7f10b0199ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35468/0 (socket says 172.21.15.79:35468) 2024-08-20T01:34:26.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.419+0000 7f10af7fe640 1 -- 172.21.15.79:0/3450800781 learned_addr learned my addr 172.21.15.79:0/3450800781 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:34:26.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.419+0000 7f10aeffd640 1 --2- 172.21.15.79:0/3450800781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10b01073a0 0x7f10b019a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:26.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.419+0000 7f10affff640 1 --2- 172.21.15.79:0/3450800781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10b0107d20 0x7f10b019a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:26.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.419+0000 7f10af7fe640 1 -- 172.21.15.79:0/3450800781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10b0107d20 msgr2=0x7f10b019a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:26.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.419+0000 7f10af7fe640 1 --2- 172.21.15.79:0/3450800781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10b0107d20 0x7f10b019a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:26.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.419+0000 7f10af7fe640 1 -- 172.21.15.79:0/3450800781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10b01073a0 msgr2=0x7f10b019a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:26.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.419+0000 7f10af7fe640 1 --2- 172.21.15.79:0/3450800781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10b01073a0 0x7f10b019a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:26.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.419+0000 7f10af7fe640 1 -- 172.21.15.79:0/3450800781 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b01a50c0 con 0x7f10b0101990 2024-08-20T01:34:26.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.419+0000 7f10af7fe640 1 --2- 172.21.15.79:0/3450800781 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10b0101990 0x7f10b0199ce0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f10a000e9f0 tx=0x7f10a000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:26.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.420+0000 7f10acff9640 1 -- 172.21.15.79:0/3450800781 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a000cd80 con 0x7f10b0101990 2024-08-20T01:34:26.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.420+0000 7f10acff9640 1 -- 172.21.15.79:0/3450800781 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f10a00108c0 con 0x7f10b0101990 2024-08-20T01:34:26.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.420+0000 7f10acff9640 1 -- 172.21.15.79:0/3450800781 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a00187c0 con 0x7f10b0101990 2024-08-20T01:34:26.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.420+0000 7f10b6244640 1 -- 172.21.15.79:0/3450800781 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10b01a53b0 con 0x7f10b0101990 2024-08-20T01:34:26.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.420+0000 7f10b6244640 1 -- 172.21.15.79:0/3450800781 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10b01a5870 con 0x7f10b0101990 2024-08-20T01:34:26.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.421+0000 7f10b6244640 1 -- 172.21.15.79:0/3450800781 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10b0101d70 con 0x7f10b0101990 2024-08-20T01:34:26.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.423+0000 7f10acff9640 1 -- 172.21.15.79:0/3450800781 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f10a0010430 con 0x7f10b0101990 2024-08-20T01:34:26.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.423+0000 7f10acff9640 1 --2- 172.21.15.79:0/3450800781 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f10980b3bd0 0x7f10980b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:26.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.424+0000 7f10aeffd640 1 --2- 172.21.15.79:0/3450800781 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f10980b3bd0 0x7f10980b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:26.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.424+0000 7f10acff9640 1 -- 172.21.15.79:0/3450800781 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7f10a00e3c20 con 0x7f10b0101990 2024-08-20T01:34:26.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.424+0000 7f10aeffd640 1 --2- 172.21.15.79:0/3450800781 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f10980b3bd0 0x7f10980b6090 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f10a40057c0 tx=0x7f10a40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:26.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.428+0000 7f10acff9640 1 -- 172.21.15.79:0/3450800781 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f10a00ab670 con 0x7f10b0101990 2024-08-20T01:34:26.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.643+0000 7f10b6244640 1 -- 172.21.15.79:0/3450800781 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f10b002e340 con 0x7f10b0101990 2024-08-20T01:34:26.646 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:26 smithi079 ceph-mon[18656]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:26.646 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:26 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:26.646 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:26 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:26.646 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:26 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:26.646 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:26 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:34:26.646 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:26 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:34:26.646 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:26 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:26.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.644+0000 7f10acff9640 1 -- 172.21.15.79:0/3450800781 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4735 (secure 0 0 0) 0x7f10a00aaf70 con 0x7f10b0101990 2024-08-20T01:34:26.647 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:34:26.647 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":6,"btime":"2024-08-20T01:34:26:443125+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14670,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/735082912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":735082912},{"type":"v1","addr":"172.21.15.79:6835","nonce":735082912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2150339873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2150339873},{"type":"v1","addr":"172.21.15.79:6837","nonce":2150339873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24473,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/1257507005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1257507005},{"type":"v1","addr":"172.21.15.81:6833","nonce":1257507005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24494,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1499936216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1499936216},{"type":"v1","addr":"172.21.15.81:6835","nonce":1499936216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24496,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1107229215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1107229215},{"type":"v1","addr":"172.21.15.175:6833","nonce":1107229215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-08-20T01:34:26.648 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 6 2024-08-20T01:34:26.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.646+0000 7f10b6244640 1 -- 172.21.15.79:0/3450800781 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f10980b3bd0 msgr2=0x7f10980b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:26.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.646+0000 7f10b6244640 1 --2- 172.21.15.79:0/3450800781 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f10980b3bd0 0x7f10980b6090 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f10a40057c0 tx=0x7f10a40058d0 comp rx=0 tx=0).stop 2024-08-20T01:34:26.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.646+0000 7f10b6244640 1 -- 172.21.15.79:0/3450800781 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10b0101990 msgr2=0x7f10b0199ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:26.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.646+0000 7f10b6244640 1 --2- 172.21.15.79:0/3450800781 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10b0101990 0x7f10b0199ce0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f10a000e9f0 tx=0x7f10a000eeb0 comp rx=0 tx=0).stop 2024-08-20T01:34:26.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.646+0000 7f10b6244640 1 -- 172.21.15.79:0/3450800781 shutdown_connections 2024-08-20T01:34:26.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.646+0000 7f10b6244640 1 --2- 172.21.15.79:0/3450800781 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f10980b3bd0 0x7f10980b6090 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:26.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.646+0000 7f10b6244640 1 --2- 172.21.15.79:0/3450800781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10b0107d20 0x7f10b019a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:26.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.646+0000 7f10b6244640 1 --2- 172.21.15.79:0/3450800781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10b01073a0 0x7f10b019a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:26.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.646+0000 7f10b6244640 1 --2- 172.21.15.79:0/3450800781 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10b0101990 0x7f10b0199ce0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:26.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.646+0000 7f10b6244640 1 -- 172.21.15.79:0/3450800781 >> 172.21.15.79:0/3450800781 conn(0x7f10b00fd3e0 msgr2=0x7f10b00ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:26.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.646+0000 7f10b6244640 1 -- 172.21.15.79:0/3450800781 shutdown_connections 2024-08-20T01:34:26.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:26.646+0000 7f10b6244640 1 -- 172.21.15.79:0/3450800781 wait complete. 2024-08-20T01:34:26.777 INFO:journalctl@ceph.mds.e.smithi081.stdout:Aug 20 01:34:26 smithi081 systemd[1]: Started Ceph mds.e for 28484e9a-5e93-11ef-bccf-c7b262605968. 2024-08-20T01:34:26.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:26 smithi081 ceph-mon[22209]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:26.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:26 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:26.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:26 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:26.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:26 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:26.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:26 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:34:26.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:26 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:34:26.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:26 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:26.845 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:26 smithi175 ceph-mon[22392]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:26.845 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:26 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:26.845 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:26 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:26.845 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:26 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:26.845 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:26 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:34:26.845 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:26 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:34:26.846 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:26 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:27.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:27 smithi079 ceph-mon[18656]: Deploying daemon mds.f on smithi175 2024-08-20T01:34:27.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:27 smithi079 ceph-mon[18656]: mds.? [v2:172.21.15.81:6834/1499936216,v1:172.21.15.81:6835/1499936216] up:boot 2024-08-20T01:34:27.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:27 smithi079 ceph-mon[18656]: fsmap 5 up:standby 2024-08-20T01:34:27.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:27 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-20T01:34:27.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:27 smithi079 ceph-mon[18656]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:27.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:27 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/3450800781' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:34:27.765 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:27 smithi175 ceph-mon[22392]: Deploying daemon mds.f on smithi175 2024-08-20T01:34:27.766 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:27 smithi175 ceph-mon[22392]: mds.? [v2:172.21.15.81:6834/1499936216,v1:172.21.15.81:6835/1499936216] up:boot 2024-08-20T01:34:27.766 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:27 smithi175 ceph-mon[22392]: fsmap 5 up:standby 2024-08-20T01:34:27.766 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:27 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-20T01:34:27.766 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:27 smithi175 ceph-mon[22392]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:27.766 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:27 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/3450800781' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:34:27.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:27 smithi081 ceph-mon[22209]: Deploying daemon mds.f on smithi175 2024-08-20T01:34:27.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:27 smithi081 ceph-mon[22209]: mds.? [v2:172.21.15.81:6834/1499936216,v1:172.21.15.81:6835/1499936216] up:boot 2024-08-20T01:34:27.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:27 smithi081 ceph-mon[22209]: fsmap 5 up:standby 2024-08-20T01:34:27.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:27 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-20T01:34:27.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:27 smithi081 ceph-mon[22209]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:27.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:27 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/3450800781' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:34:28.388 INFO:journalctl@ceph.mds.f.smithi175.stdout:Aug 20 01:34:28 smithi175 systemd[1]: Starting Ceph mds.f for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:34:28.762 INFO:journalctl@ceph.mds.f.smithi175.stdout:Aug 20 01:34:28 smithi175 podman[51968]: 2024-08-20 01:34:28.348797925 +0000 UTC m=+0.015812774 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:34:28.762 INFO:journalctl@ceph.mds.f.smithi175.stdout:Aug 20 01:34:28 smithi175 podman[51968]: 2024-08-20 01:34:28.458296801 +0000 UTC m=+0.125311680 container create 03c0cd0b89f4b043a006d8570e51b764c2e6f9bbd0c0c435b0ce3e5b7b93e176 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-f, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-08-20T01:34:28.762 INFO:journalctl@ceph.mds.f.smithi175.stdout:Aug 20 01:34:28 smithi175 podman[51968]: 2024-08-20 01:34:28.668988131 +0000 UTC m=+0.336002971 container init 03c0cd0b89f4b043a006d8570e51b764c2e6f9bbd0c0c435b0ce3e5b7b93e176 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-f, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-08-20T01:34:28.762 INFO:journalctl@ceph.mds.f.smithi175.stdout:Aug 20 01:34:28 smithi175 podman[51968]: 2024-08-20 01:34:28.671711538 +0000 UTC m=+0.338726378 container start 03c0cd0b89f4b043a006d8570e51b764c2e6f9bbd0c0c435b0ce3e5b7b93e176 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-f, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True) 2024-08-20T01:34:28.762 INFO:journalctl@ceph.mds.f.smithi175.stdout:Aug 20 01:34:28 smithi175 ceph-mds[51988]: -- 172.21.15.175:0/2994289875 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559b607a5860 con 0x559b60783400 2024-08-20T01:34:28.762 INFO:journalctl@ceph.mds.f.smithi175.stdout:Aug 20 01:34:28 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-f[51984]: starting mds.f at 2024-08-20T01:34:28.762 INFO:journalctl@ceph.mds.f.smithi175.stdout:Aug 20 01:34:28 smithi175 bash[51968]: 03c0cd0b89f4b043a006d8570e51b764c2e6f9bbd0c0c435b0ce3e5b7b93e176 2024-08-20T01:34:29.138 INFO:journalctl@ceph.mds.f.smithi175.stdout:Aug 20 01:34:28 smithi175 systemd[1]: Started Ceph mds.f for 28484e9a-5e93-11ef-bccf-c7b262605968. 2024-08-20T01:34:29.429 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:34:29.689 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:34:30.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:29 smithi081 ceph-mon[22209]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:30.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:29 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:30.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:29 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:30.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:29 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:30.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:29 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:34:30.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:29 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:34:30.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:29 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:30.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:29 smithi081 ceph-mon[22209]: Deploying daemon mds.c on smithi175 2024-08-20T01:34:30.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:29 smithi081 ceph-mon[22209]: mds.? [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] up:boot 2024-08-20T01:34:30.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:29 smithi081 ceph-mon[22209]: fsmap 6 up:standby 2024-08-20T01:34:30.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:29 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-20T01:34:30.094 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:29 smithi079 ceph-mon[18656]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:30.095 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:29 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:30.095 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:29 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:30.095 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:29 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:30.095 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:29 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:34:30.095 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:29 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:34:30.095 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:29 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:30.095 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:29 smithi079 ceph-mon[18656]: Deploying daemon mds.c on smithi175 2024-08-20T01:34:30.095 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:29 smithi079 ceph-mon[18656]: mds.? [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] up:boot 2024-08-20T01:34:30.095 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:29 smithi079 ceph-mon[18656]: fsmap 6 up:standby 2024-08-20T01:34:30.095 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:29 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-20T01:34:30.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:29 smithi175 ceph-mon[22392]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:30.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:29 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:30.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:29 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:30.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:29 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:30.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:29 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:34:30.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:29 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:34:30.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:29 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:30.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:29 smithi175 ceph-mon[22392]: Deploying daemon mds.c on smithi175 2024-08-20T01:34:30.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:29 smithi175 ceph-mon[22392]: mds.? [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] up:boot 2024-08-20T01:34:30.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:29 smithi175 ceph-mon[22392]: fsmap 6 up:standby 2024-08-20T01:34:30.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:29 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-20T01:34:30.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.172+0000 7ff3dcf95640 1 -- 172.21.15.79:0/55799650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3d81019d0 msgr2=0x7ff3d8101db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:30.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.172+0000 7ff3dcf95640 1 --2- 172.21.15.79:0/55799650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3d81019d0 0x7ff3d8101db0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff3c8009900 tx=0x7ff3c802a3f0 comp rx=0 tx=0).stop 2024-08-20T01:34:30.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.172+0000 7ff3dcf95640 1 -- 172.21.15.79:0/55799650 shutdown_connections 2024-08-20T01:34:30.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.172+0000 7ff3dcf95640 1 --2- 172.21.15.79:0/55799650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3d8107d60 0x7ff3d810e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:30.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.172+0000 7ff3dcf95640 1 --2- 172.21.15.79:0/55799650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3d81073e0 0x7ff3d8107820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:30.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.172+0000 7ff3dcf95640 1 --2- 172.21.15.79:0/55799650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3d81019d0 0x7ff3d8101db0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:30.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.172+0000 7ff3dcf95640 1 -- 172.21.15.79:0/55799650 >> 172.21.15.79:0/55799650 conn(0x7ff3d80fd440 msgr2=0x7ff3d80ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:30.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.172+0000 7ff3dcf95640 1 -- 172.21.15.79:0/55799650 shutdown_connections 2024-08-20T01:34:30.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.172+0000 7ff3dcf95640 1 -- 172.21.15.79:0/55799650 wait complete. 2024-08-20T01:34:30.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.173+0000 7ff3dcf95640 1 Processor -- start 2024-08-20T01:34:30.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.173+0000 7ff3dcf95640 1 -- start start 2024-08-20T01:34:30.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.173+0000 7ff3dcf95640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3d81019d0 0x7ff3d8199c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:30.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.173+0000 7ff3dcf95640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3d81073e0 0x7ff3d819a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:30.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.173+0000 7ff3dcf95640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3d8107d60 0x7ff3d81a4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:30.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.173+0000 7ff3dcf95640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d8111890 con 0x7ff3d8107d60 2024-08-20T01:34:30.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.173+0000 7ff3dcf95640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d8111710 con 0x7ff3d81019d0 2024-08-20T01:34:30.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.173+0000 7ff3dcf95640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d8111a10 con 0x7ff3d81073e0 2024-08-20T01:34:30.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.173+0000 7ff3d6d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3d8107d60 0x7ff3d81a4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:30.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.173+0000 7ff3d6d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3d8107d60 0x7ff3d81a4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35482/0 (socket says 172.21.15.79:35482) 2024-08-20T01:34:30.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.173+0000 7ff3d6d9d640 1 -- 172.21.15.79:0/2014652292 learned_addr learned my addr 172.21.15.79:0/2014652292 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:34:30.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.173+0000 7ff3d5d9b640 1 --2- 172.21.15.79:0/2014652292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3d81073e0 0x7ff3d819a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:30.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.174+0000 7ff3d659c640 1 --2- 172.21.15.79:0/2014652292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3d81019d0 0x7ff3d8199c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:30.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.174+0000 7ff3d6d9d640 1 -- 172.21.15.79:0/2014652292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3d81073e0 msgr2=0x7ff3d819a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:30.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.174+0000 7ff3d6d9d640 1 --2- 172.21.15.79:0/2014652292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3d81073e0 0x7ff3d819a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:30.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.174+0000 7ff3d6d9d640 1 -- 172.21.15.79:0/2014652292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3d81019d0 msgr2=0x7ff3d8199c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:30.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.174+0000 7ff3d6d9d640 1 --2- 172.21.15.79:0/2014652292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3d81019d0 0x7ff3d8199c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:30.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.174+0000 7ff3d6d9d640 1 -- 172.21.15.79:0/2014652292 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3d81a5240 con 0x7ff3d8107d60 2024-08-20T01:34:30.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.174+0000 7ff3d6d9d640 1 --2- 172.21.15.79:0/2014652292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3d8107d60 0x7ff3d81a4d00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff3d000cad0 tx=0x7ff3d000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:30.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.174+0000 7ff3c77fe640 1 -- 172.21.15.79:0/2014652292 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d000ad60 con 0x7ff3d8107d60 2024-08-20T01:34:30.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.174+0000 7ff3c77fe640 1 -- 172.21.15.79:0/2014652292 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff3d0005020 con 0x7ff3d8107d60 2024-08-20T01:34:30.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.174+0000 7ff3c77fe640 1 -- 172.21.15.79:0/2014652292 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d000f6b0 con 0x7ff3d8107d60 2024-08-20T01:34:30.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.174+0000 7ff3dcf95640 1 -- 172.21.15.79:0/2014652292 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3d81a5410 con 0x7ff3d8107d60 2024-08-20T01:34:30.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.174+0000 7ff3dcf95640 1 -- 172.21.15.79:0/2014652292 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3d81a58f0 con 0x7ff3d8107d60 2024-08-20T01:34:30.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.175+0000 7ff3dcf95640 1 -- 172.21.15.79:0/2014652292 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3d8101db0 con 0x7ff3d8107d60 2024-08-20T01:34:30.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.176+0000 7ff3c77fe640 1 -- 172.21.15.79:0/2014652292 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7ff3d00051d0 con 0x7ff3d8107d60 2024-08-20T01:34:30.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.177+0000 7ff3c77fe640 1 --2- 172.21.15.79:0/2014652292 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff3c00b3c50 0x7ff3c00b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:30.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.177+0000 7ff3d659c640 1 --2- 172.21.15.79:0/2014652292 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff3c00b3c50 0x7ff3c00b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:30.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.177+0000 7ff3c77fe640 1 -- 172.21.15.79:0/2014652292 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7ff3d00e3a80 con 0x7ff3d8107d60 2024-08-20T01:34:30.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.177+0000 7ff3d659c640 1 --2- 172.21.15.79:0/2014652292 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff3c00b3c50 0x7ff3c00b6110 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff3c8006010 tx=0x7ff3c8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:30.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.180+0000 7ff3c77fe640 1 -- 172.21.15.79:0/2014652292 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7ff3d0014030 con 0x7ff3d8107d60 2024-08-20T01:34:30.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.390+0000 7ff3dcf95640 1 -- 172.21.15.79:0/2014652292 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3d806b600 con 0x7ff3d8107d60 2024-08-20T01:34:30.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.391+0000 7ff3c77fe640 1 -- 172.21.15.79:0/2014652292 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5563 (secure 0 0 0) 0x7ff3d00ab5f0 con 0x7ff3d8107d60 2024-08-20T01:34:30.393 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:34:30.393 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":7,"btime":"2024-08-20T01:34:29:515617+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14670,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/735082912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":735082912},{"type":"v1","addr":"172.21.15.79:6835","nonce":735082912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2150339873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2150339873},{"type":"v1","addr":"172.21.15.79:6837","nonce":2150339873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24473,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/1257507005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1257507005},{"type":"v1","addr":"172.21.15.81:6833","nonce":1257507005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24494,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1499936216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1499936216},{"type":"v1","addr":"172.21.15.81:6835","nonce":1499936216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24496,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1107229215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1107229215},{"type":"v1","addr":"172.21.15.175:6833","nonce":1107229215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2552601173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2552601173},{"type":"v1","addr":"172.21.15.175:6835","nonce":2552601173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-08-20T01:34:30.393 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 7 2024-08-20T01:34:30.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.393+0000 7ff3dcf95640 1 -- 172.21.15.79:0/2014652292 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff3c00b3c50 msgr2=0x7ff3c00b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:30.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.393+0000 7ff3dcf95640 1 --2- 172.21.15.79:0/2014652292 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff3c00b3c50 0x7ff3c00b6110 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff3c8006010 tx=0x7ff3c8000bc0 comp rx=0 tx=0).stop 2024-08-20T01:34:30.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.393+0000 7ff3dcf95640 1 -- 172.21.15.79:0/2014652292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3d8107d60 msgr2=0x7ff3d81a4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:30.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.393+0000 7ff3dcf95640 1 --2- 172.21.15.79:0/2014652292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3d8107d60 0x7ff3d81a4d00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff3d000cad0 tx=0x7ff3d000ced0 comp rx=0 tx=0).stop 2024-08-20T01:34:30.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.393+0000 7ff3dcf95640 1 -- 172.21.15.79:0/2014652292 shutdown_connections 2024-08-20T01:34:30.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.393+0000 7ff3dcf95640 1 --2- 172.21.15.79:0/2014652292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3d8107d60 0x7ff3d81a4d00 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:30.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.393+0000 7ff3dcf95640 1 --2- 172.21.15.79:0/2014652292 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff3c00b3c50 0x7ff3c00b6110 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:30.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.393+0000 7ff3dcf95640 1 --2- 172.21.15.79:0/2014652292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3d81073e0 0x7ff3d819a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:30.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.393+0000 7ff3dcf95640 1 --2- 172.21.15.79:0/2014652292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3d81019d0 0x7ff3d8199c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:30.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.393+0000 7ff3dcf95640 1 -- 172.21.15.79:0/2014652292 >> 172.21.15.79:0/2014652292 conn(0x7ff3d80fd440 msgr2=0x7ff3d80ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:30.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.393+0000 7ff3dcf95640 1 -- 172.21.15.79:0/2014652292 shutdown_connections 2024-08-20T01:34:30.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:30.394+0000 7ff3dcf95640 1 -- 172.21.15.79:0/2014652292 wait complete. 2024-08-20T01:34:30.817 INFO:journalctl@ceph.mds.c.smithi175.stdout:Aug 20 01:34:30 smithi175 systemd[1]: Starting Ceph mds.c for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:34:31.083 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:30 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2014652292' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:34:31.083 INFO:journalctl@ceph.mds.c.smithi175.stdout:Aug 20 01:34:30 smithi175 podman[52272]: 2024-08-20 01:34:30.752986851 +0000 UTC m=+0.015473142 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:34:31.083 INFO:journalctl@ceph.mds.c.smithi175.stdout:Aug 20 01:34:30 smithi175 podman[52272]: 2024-08-20 01:34:30.861587452 +0000 UTC m=+0.124073775 container create 0c8a3553794ec926269aac307784216658410c0217c3c30b1f40d8a8962d2f79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-20T01:34:31.083 INFO:journalctl@ceph.mds.c.smithi175.stdout:Aug 20 01:34:31 smithi175 podman[52272]: 2024-08-20 01:34:31.055607413 +0000 UTC m=+0.318093695 container init 0c8a3553794ec926269aac307784216658410c0217c3c30b1f40d8a8962d2f79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-08-20T01:34:31.083 INFO:journalctl@ceph.mds.c.smithi175.stdout:Aug 20 01:34:31 smithi175 podman[52272]: 2024-08-20 01:34:31.058600985 +0000 UTC m=+0.321087272 container start 0c8a3553794ec926269aac307784216658410c0217c3c30b1f40d8a8962d2f79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-c, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-20T01:34:31.166 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:30 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2014652292' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:34:31.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:30 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2014652292' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:34:31.388 INFO:journalctl@ceph.mds.c.smithi175.stdout:Aug 20 01:34:31 smithi175 ceph-mds[52291]: -- 172.21.15.175:0/1962508346 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5567c2f19860 con 0x5567c2ef7400 2024-08-20T01:34:31.388 INFO:journalctl@ceph.mds.c.smithi175.stdout:Aug 20 01:34:31 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-c[52287]: starting mds.c at 2024-08-20T01:34:31.388 INFO:journalctl@ceph.mds.c.smithi175.stdout:Aug 20 01:34:31 smithi175 bash[52272]: 0c8a3553794ec926269aac307784216658410c0217c3c30b1f40d8a8962d2f79 2024-08-20T01:34:31.388 INFO:journalctl@ceph.mds.c.smithi175.stdout:Aug 20 01:34:31 smithi175 systemd[1]: Started Ceph mds.c for 28484e9a-5e93-11ef-bccf-c7b262605968. 2024-08-20T01:34:32.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:32 smithi081 ceph-mon[22209]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:32.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:32 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:32.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:32 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:32.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:32 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:32.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:32 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:34:32.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:32 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:34:32.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:32 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:32.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:32 smithi081 ceph-mon[22209]: Deploying daemon mds.h on smithi081 2024-08-20T01:34:32.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:32 smithi081 ceph-mon[22209]: mds.? [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] up:boot 2024-08-20T01:34:32.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:32 smithi081 ceph-mon[22209]: fsmap 7 up:standby 2024-08-20T01:34:32.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:32 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-20T01:34:32.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:32 smithi175 ceph-mon[22392]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:32.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:32 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:32.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:32 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:32.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:32 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:32.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:32 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:34:32.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:32 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:34:32.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:32 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:32.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:32 smithi175 ceph-mon[22392]: Deploying daemon mds.h on smithi081 2024-08-20T01:34:32.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:32 smithi175 ceph-mon[22392]: mds.? [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] up:boot 2024-08-20T01:34:32.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:32 smithi175 ceph-mon[22392]: fsmap 7 up:standby 2024-08-20T01:34:32.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:32 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-20T01:34:32.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:32 smithi079 ceph-mon[18656]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:32.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:32 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:32.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:32 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:32.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:32 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:32.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:32 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:34:32.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:32 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:34:32.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:32 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:32.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:32 smithi079 ceph-mon[18656]: Deploying daemon mds.h on smithi081 2024-08-20T01:34:32.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:32 smithi079 ceph-mon[18656]: mds.? [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] up:boot 2024-08-20T01:34:32.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:32 smithi079 ceph-mon[18656]: fsmap 7 up:standby 2024-08-20T01:34:32.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:32 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-20T01:34:33.194 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:34:33.265 INFO:journalctl@ceph.mds.h.smithi081.stdout:Aug 20 01:34:33 smithi081 systemd[1]: Starting Ceph mds.h for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:34:33.450 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:34:33.521 INFO:journalctl@ceph.mds.h.smithi081.stdout:Aug 20 01:34:33 smithi081 podman[51654]: 2024-08-20 01:34:33.16602455 +0000 UTC m=+0.016205509 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:34:33.521 INFO:journalctl@ceph.mds.h.smithi081.stdout:Aug 20 01:34:33 smithi081 podman[51654]: 2024-08-20 01:34:33.30146186 +0000 UTC m=+0.151642807 container create 5aca4c06d84130d555b777738b3b1b934a6f58fae5ee24acf2fbdf9ef2ed0148 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-h, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-08-20T01:34:33.778 INFO:journalctl@ceph.mds.h.smithi081.stdout:Aug 20 01:34:33 smithi081 podman[51654]: 2024-08-20 01:34:33.521038226 +0000 UTC m=+0.371219171 container init 5aca4c06d84130d555b777738b3b1b934a6f58fae5ee24acf2fbdf9ef2ed0148 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-h, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T01:34:33.778 INFO:journalctl@ceph.mds.h.smithi081.stdout:Aug 20 01:34:33 smithi081 podman[51654]: 2024-08-20 01:34:33.52393772 +0000 UTC m=+0.374118669 container start 5aca4c06d84130d555b777738b3b1b934a6f58fae5ee24acf2fbdf9ef2ed0148 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-h, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-08-20T01:34:33.778 INFO:journalctl@ceph.mds.h.smithi081.stdout:Aug 20 01:34:33 smithi081 ceph-mds[51674]: -- 172.21.15.81:0/2331291952 <== mon.2 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a932a5d860 con 0x55a932a3a800 2024-08-20T01:34:33.778 INFO:journalctl@ceph.mds.h.smithi081.stdout:Aug 20 01:34:33 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-h[51670]: starting mds.h at 2024-08-20T01:34:33.778 INFO:journalctl@ceph.mds.h.smithi081.stdout:Aug 20 01:34:33 smithi081 bash[51654]: 5aca4c06d84130d555b777738b3b1b934a6f58fae5ee24acf2fbdf9ef2ed0148 2024-08-20T01:34:33.778 INFO:journalctl@ceph.mds.h.smithi081.stdout:Aug 20 01:34:33 smithi081 systemd[1]: Started Ceph mds.h for 28484e9a-5e93-11ef-bccf-c7b262605968. 2024-08-20T01:34:33.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:33.940+0000 7fd404ba1640 1 -- 172.21.15.79:0/4036861800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd40010ce00 msgr2=0x7fd40010f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:33.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:33.940+0000 7fd404ba1640 1 --2- 172.21.15.79:0/4036861800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd40010ce00 0x7fd40010f260 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8009ca0 tx=0x7fd3f802a8c0 comp rx=0 tx=0).stop 2024-08-20T01:34:33.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:33.941+0000 7fd404ba1640 1 -- 172.21.15.79:0/4036861800 shutdown_connections 2024-08-20T01:34:33.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:33.941+0000 7fd404ba1640 1 --2- 172.21.15.79:0/4036861800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd40010ce00 0x7fd40010f260 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:33.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:33.941+0000 7fd404ba1640 1 --2- 172.21.15.79:0/4036861800 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4001042c0 0x7fd40010c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:33.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:33.941+0000 7fd404ba1640 1 --2- 172.21.15.79:0/4036861800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4001039a0 0x7fd400103d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:33.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:33.941+0000 7fd404ba1640 1 -- 172.21.15.79:0/4036861800 >> 172.21.15.79:0/4036861800 conn(0x7fd4000fd400 msgr2=0x7fd4000ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:33.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:33.941+0000 7fd404ba1640 1 -- 172.21.15.79:0/4036861800 shutdown_connections 2024-08-20T01:34:33.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:33.941+0000 7fd404ba1640 1 -- 172.21.15.79:0/4036861800 wait complete. 2024-08-20T01:34:33.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:33.941+0000 7fd404ba1640 1 Processor -- start 2024-08-20T01:34:33.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:33.941+0000 7fd404ba1640 1 -- start start 2024-08-20T01:34:33.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:33.942+0000 7fd404ba1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4001039a0 0x7fd400198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:33.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:33.942+0000 7fd404ba1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4001042c0 0x7fd4001993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:33.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:33.942+0000 7fd404ba1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd40010ce00 0x7fd40019e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:33.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:33.942+0000 7fd404ba1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd400112970 con 0x7fd4001039a0 2024-08-20T01:34:33.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:33.942+0000 7fd404ba1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd4001127f0 con 0x7fd40010ce00 2024-08-20T01:34:33.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:33.942+0000 7fd404ba1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd400112af0 con 0x7fd4001042c0 2024-08-20T01:34:33.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:33.942+0000 7fd3fe59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4001039a0 0x7fd400198e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:33.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:33.942+0000 7fd3fe59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4001039a0 0x7fd400198e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59662/0 (socket says 172.21.15.79:59662) 2024-08-20T01:34:33.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:33.942+0000 7fd3fe59c640 1 -- 172.21.15.79:0/2053287791 learned_addr learned my addr 172.21.15.79:0/2053287791 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:34:33.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:33.942+0000 7fd3fdd9b640 1 --2- 172.21.15.79:0/2053287791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4001042c0 0x7fd4001993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:33.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:33.942+0000 7fd3fed9d640 1 --2- 172.21.15.79:0/2053287791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd40010ce00 0x7fd40019e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:33.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:33.942+0000 7fd3fdd9b640 1 -- 172.21.15.79:0/2053287791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd40010ce00 msgr2=0x7fd40019e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:33.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:33.942+0000 7fd3fdd9b640 1 --2- 172.21.15.79:0/2053287791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd40010ce00 0x7fd40019e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:33.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:33.942+0000 7fd3fdd9b640 1 -- 172.21.15.79:0/2053287791 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4001039a0 msgr2=0x7fd400198e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:33.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:33.942+0000 7fd3fdd9b640 1 --2- 172.21.15.79:0/2053287791 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4001039a0 0x7fd400198e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:33.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:33.942+0000 7fd3fdd9b640 1 -- 172.21.15.79:0/2053287791 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd40019ef30 con 0x7fd4001042c0 2024-08-20T01:34:33.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:33.942+0000 7fd3fe59c640 1 --2- 172.21.15.79:0/2053287791 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4001039a0 0x7fd400198e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:34:33.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:33.942+0000 7fd3fed9d640 1 --2- 172.21.15.79:0/2053287791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd40010ce00 0x7fd40019e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:34:33.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:33.942+0000 7fd3fdd9b640 1 --2- 172.21.15.79:0/2053287791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4001042c0 0x7fd4001993c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0009fc0 tx=0x7fd3f000ec20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:33.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:33.943+0000 7fd3ef7fe640 1 -- 172.21.15.79:0/2053287791 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f000ccc0 con 0x7fd4001042c0 2024-08-20T01:34:33.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:33.943+0000 7fd3ef7fe640 1 -- 172.21.15.79:0/2053287791 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd3f000ee70 con 0x7fd4001042c0 2024-08-20T01:34:33.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:33.943+0000 7fd404ba1640 1 -- 172.21.15.79:0/2053287791 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd40019f220 con 0x7fd4001042c0 2024-08-20T01:34:33.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:33.943+0000 7fd3ef7fe640 1 -- 172.21.15.79:0/2053287791 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f00035f0 con 0x7fd4001042c0 2024-08-20T01:34:33.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:33.943+0000 7fd404ba1640 1 -- 172.21.15.79:0/2053287791 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd400101530 con 0x7fd4001042c0 2024-08-20T01:34:33.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:33.944+0000 7fd404ba1640 1 -- 172.21.15.79:0/2053287791 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd400103d80 con 0x7fd4001042c0 2024-08-20T01:34:33.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:33.945+0000 7fd3ef7fe640 1 -- 172.21.15.79:0/2053287791 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7fd3f0005030 con 0x7fd4001042c0 2024-08-20T01:34:33.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:33.946+0000 7fd3ef7fe640 1 --2- 172.21.15.79:0/2053287791 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd3e80b3c50 0x7fd3e80b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:33.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:33.946+0000 7fd3fe59c640 1 --2- 172.21.15.79:0/2053287791 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd3e80b3c50 0x7fd3e80b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:33.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:33.946+0000 7fd3ef7fe640 1 -- 172.21.15.79:0/2053287791 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7fd3f00e7c70 con 0x7fd4001042c0 2024-08-20T01:34:33.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:33.946+0000 7fd3fe59c640 1 --2- 172.21.15.79:0/2053287791 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd3e80b3c50 0x7fd3e80b6110 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4011550 tx=0x7fd3f4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:33.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:33.951+0000 7fd3ef7fe640 1 -- 172.21.15.79:0/2053287791 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fd3f00af6c0 con 0x7fd4001042c0 2024-08-20T01:34:34.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:34.169+0000 7fd404ba1640 1 -- 172.21.15.79:0/2053287791 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd400199fb0 con 0x7fd4001042c0 2024-08-20T01:34:34.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:34.170+0000 7fd3ef7fe640 1 -- 172.21.15.79:0/2053287791 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6391 (secure 0 0 0) 0x7fd3f00aefc0 con 0x7fd4001042c0 2024-08-20T01:34:34.172 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:34:34.172 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":8,"btime":"2024-08-20T01:34:31:815811+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14670,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/735082912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":735082912},{"type":"v1","addr":"172.21.15.79:6835","nonce":735082912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2150339873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2150339873},{"type":"v1","addr":"172.21.15.79:6837","nonce":2150339873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24473,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/1257507005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1257507005},{"type":"v1","addr":"172.21.15.81:6833","nonce":1257507005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24494,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1499936216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1499936216},{"type":"v1","addr":"172.21.15.81:6835","nonce":1499936216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24496,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1107229215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1107229215},{"type":"v1","addr":"172.21.15.175:6833","nonce":1107229215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2552601173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2552601173},{"type":"v1","addr":"172.21.15.175:6835","nonce":2552601173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24523,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1767284089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1767284089},{"type":"v1","addr":"172.21.15.175:6837","nonce":1767284089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-08-20T01:34:34.172 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 8 2024-08-20T01:34:34.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:34.172+0000 7fd404ba1640 1 -- 172.21.15.79:0/2053287791 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd3e80b3c50 msgr2=0x7fd3e80b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:34.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:34.172+0000 7fd404ba1640 1 --2- 172.21.15.79:0/2053287791 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd3e80b3c50 0x7fd3e80b6110 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4011550 tx=0x7fd3f4005f90 comp rx=0 tx=0).stop 2024-08-20T01:34:34.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:34.172+0000 7fd404ba1640 1 -- 172.21.15.79:0/2053287791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4001042c0 msgr2=0x7fd4001993c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:34.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:34.172+0000 7fd404ba1640 1 --2- 172.21.15.79:0/2053287791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4001042c0 0x7fd4001993c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0009fc0 tx=0x7fd3f000ec20 comp rx=0 tx=0).stop 2024-08-20T01:34:34.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:34.172+0000 7fd404ba1640 1 -- 172.21.15.79:0/2053287791 shutdown_connections 2024-08-20T01:34:34.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:34.172+0000 7fd404ba1640 1 --2- 172.21.15.79:0/2053287791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd40010ce00 0x7fd40019e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:34.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:34.172+0000 7fd404ba1640 1 --2- 172.21.15.79:0/2053287791 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd3e80b3c50 0x7fd3e80b6110 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:34.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:34.172+0000 7fd404ba1640 1 --2- 172.21.15.79:0/2053287791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4001042c0 0x7fd4001993c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:34.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:34.172+0000 7fd404ba1640 1 --2- 172.21.15.79:0/2053287791 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4001039a0 0x7fd400198e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:34.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:34.172+0000 7fd404ba1640 1 -- 172.21.15.79:0/2053287791 >> 172.21.15.79:0/2053287791 conn(0x7fd4000fd400 msgr2=0x7fd4000fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:34.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:34.172+0000 7fd404ba1640 1 -- 172.21.15.79:0/2053287791 shutdown_connections 2024-08-20T01:34:34.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:34.172+0000 7fd404ba1640 1 -- 172.21.15.79:0/2053287791 wait complete. 2024-08-20T01:34:34.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:34 smithi175 ceph-mon[22392]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:34.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:34 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:34.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:34 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:34.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:34 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:34.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:34 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:34:34.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:34 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:34:34.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:34 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:34.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:34 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2053287791' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:34:34.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:34 smithi079 ceph-mon[18656]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:34.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:34 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:34.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:34 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:34.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:34 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:34.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:34 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:34:34.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:34 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:34:34.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:34 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:34.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:34 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2053287791' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:34:34.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:34 smithi081 ceph-mon[22209]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:34.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:34 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:34.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:34 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:34.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:34 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:34.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:34 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:34:34.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:34 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:34:34.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:34 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:34.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:34 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2053287791' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:34:35.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:35 smithi081 ceph-mon[22209]: Deploying daemon mds.i on smithi175 2024-08-20T01:34:35.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:35 smithi081 ceph-mon[22209]: mds.? [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] up:boot 2024-08-20T01:34:35.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:35 smithi081 ceph-mon[22209]: fsmap 8 up:standby 2024-08-20T01:34:35.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:35 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-20T01:34:35.624 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:35 smithi175 ceph-mon[22392]: Deploying daemon mds.i on smithi175 2024-08-20T01:34:35.624 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:35 smithi175 ceph-mon[22392]: mds.? [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] up:boot 2024-08-20T01:34:35.624 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:35 smithi175 ceph-mon[22392]: fsmap 8 up:standby 2024-08-20T01:34:35.624 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:35 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-20T01:34:35.624 INFO:journalctl@ceph.mds.i.smithi175.stdout:Aug 20 01:34:35 smithi175 systemd[1]: Starting Ceph mds.i for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:34:35.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:35 smithi079 ceph-mon[18656]: Deploying daemon mds.i on smithi175 2024-08-20T01:34:35.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:35 smithi079 ceph-mon[18656]: mds.? [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] up:boot 2024-08-20T01:34:35.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:35 smithi079 ceph-mon[18656]: fsmap 8 up:standby 2024-08-20T01:34:35.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:35 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-20T01:34:35.879 INFO:journalctl@ceph.mds.i.smithi175.stdout:Aug 20 01:34:35 smithi175 podman[52575]: 2024-08-20 01:34:35.622792161 +0000 UTC m=+0.108287177 container create 62a2ffb0d5a18d1d55df3b17cc50935f8a1eaf8e0e3b820ce2c1fa4fd446dc6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-i, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-08-20T01:34:35.879 INFO:journalctl@ceph.mds.i.smithi175.stdout:Aug 20 01:34:35 smithi175 podman[52575]: 2024-08-20 01:34:35.530404469 +0000 UTC m=+0.015899454 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:34:35.879 INFO:journalctl@ceph.mds.i.smithi175.stdout:Aug 20 01:34:35 smithi175 podman[52575]: 2024-08-20 01:34:35.852245174 +0000 UTC m=+0.337740154 container init 62a2ffb0d5a18d1d55df3b17cc50935f8a1eaf8e0e3b820ce2c1fa4fd446dc6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-08-20T01:34:35.879 INFO:journalctl@ceph.mds.i.smithi175.stdout:Aug 20 01:34:35 smithi175 podman[52575]: 2024-08-20 01:34:35.855298755 +0000 UTC m=+0.340793734 container start 62a2ffb0d5a18d1d55df3b17cc50935f8a1eaf8e0e3b820ce2c1fa4fd446dc6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-i, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-20T01:34:35.880 INFO:journalctl@ceph.mds.i.smithi175.stdout:Aug 20 01:34:35 smithi175 ceph-mds[52594]: -- 172.21.15.175:0/3699969156 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5580b4ee9860 con 0x5580b4ec6800 2024-08-20T01:34:36.138 INFO:journalctl@ceph.mds.i.smithi175.stdout:Aug 20 01:34:35 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-i[52590]: starting mds.i at 2024-08-20T01:34:36.139 INFO:journalctl@ceph.mds.i.smithi175.stdout:Aug 20 01:34:35 smithi175 bash[52575]: 62a2ffb0d5a18d1d55df3b17cc50935f8a1eaf8e0e3b820ce2c1fa4fd446dc6e 2024-08-20T01:34:36.139 INFO:journalctl@ceph.mds.i.smithi175.stdout:Aug 20 01:34:35 smithi175 systemd[1]: Started Ceph mds.i for 28484e9a-5e93-11ef-bccf-c7b262605968. 2024-08-20T01:34:36.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:36 smithi081 ceph-mon[22209]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:36.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:36 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:36.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:36 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:36.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:36 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:36.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:36 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:34:36.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:36 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:34:36.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:36 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:36.582 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:36 smithi079 ceph-mon[18656]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:36.582 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:36 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:36.582 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:36 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:36.582 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:36 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:36.582 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:36 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:34:36.582 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:36 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:34:36.582 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:36 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:36.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:36 smithi175 ceph-mon[22392]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:36.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:36 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:36.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:36 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:36.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:36 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:36.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:36 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:34:36.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:36 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:34:36.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:36 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:36.918 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:34:37.439 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:37 smithi079 ceph-mon[18656]: Deploying daemon mds.g on smithi079 2024-08-20T01:34:37.439 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:37 smithi079 ceph-mon[18656]: mds.? [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] up:boot 2024-08-20T01:34:37.439 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:37 smithi079 ceph-mon[18656]: fsmap 9 up:standby 2024-08-20T01:34:37.439 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:37 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-20T01:34:37.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:37 smithi081 ceph-mon[22209]: Deploying daemon mds.g on smithi079 2024-08-20T01:34:37.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:37 smithi081 ceph-mon[22209]: mds.? [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] up:boot 2024-08-20T01:34:37.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:37 smithi081 ceph-mon[22209]: fsmap 9 up:standby 2024-08-20T01:34:37.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:37 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-20T01:34:37.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:37 smithi175 ceph-mon[22392]: Deploying daemon mds.g on smithi079 2024-08-20T01:34:37.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:37 smithi175 ceph-mon[22392]: mds.? [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] up:boot 2024-08-20T01:34:37.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:37 smithi175 ceph-mon[22392]: fsmap 9 up:standby 2024-08-20T01:34:37.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:37 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-20T01:34:37.709 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:34:38.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.252+0000 7f75a9d94640 1 -- 172.21.15.79:0/646947389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75a41073a0 msgr2=0x7f75a41077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:38.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.252+0000 7f75a9d94640 1 --2- 172.21.15.79:0/646947389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75a41073a0 0x7f75a41077e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f758c009900 tx=0x7f758c02a410 comp rx=0 tx=0).stop 2024-08-20T01:34:38.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.252+0000 7f75a9d94640 1 -- 172.21.15.79:0/646947389 shutdown_connections 2024-08-20T01:34:38.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.252+0000 7f75a9d94640 1 --2- 172.21.15.79:0/646947389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75a4107d20 0x7f75a410e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:38.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.252+0000 7f75a9d94640 1 --2- 172.21.15.79:0/646947389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75a41073a0 0x7f75a41077e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:38.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.252+0000 7f75a9d94640 1 --2- 172.21.15.79:0/646947389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75a4101990 0x7f75a4101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:38.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.252+0000 7f75a9d94640 1 -- 172.21.15.79:0/646947389 >> 172.21.15.79:0/646947389 conn(0x7f75a40fd400 msgr2=0x7f75a40ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:38.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.252+0000 7f75a9d94640 1 -- 172.21.15.79:0/646947389 shutdown_connections 2024-08-20T01:34:38.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.252+0000 7f75a9d94640 1 -- 172.21.15.79:0/646947389 wait complete. 2024-08-20T01:34:38.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.253+0000 7f75a9d94640 1 Processor -- start 2024-08-20T01:34:38.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.253+0000 7f75a9d94640 1 -- start start 2024-08-20T01:34:38.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.253+0000 7f75a9d94640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75a4101990 0x7f75a4198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:38.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.253+0000 7f75a9d94640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75a41073a0 0x7f75a4199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:38.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.253+0000 7f75a9d94640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75a4107d20 0x7f75a419e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:38.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.253+0000 7f75a9d94640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f75a41118e0 con 0x7f75a41073a0 2024-08-20T01:34:38.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.253+0000 7f75a9d94640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f75a4111760 con 0x7f75a4107d20 2024-08-20T01:34:38.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.253+0000 7f75a9d94640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f75a4111a60 con 0x7f75a4101990 2024-08-20T01:34:38.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.253+0000 7f759bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75a41073a0 0x7f75a4199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:38.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.253+0000 7f759bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75a41073a0 0x7f75a4199400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59682/0 (socket says 172.21.15.79:59682) 2024-08-20T01:34:38.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.253+0000 7f759bfff640 1 -- 172.21.15.79:0/1043057089 learned_addr learned my addr 172.21.15.79:0/1043057089 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:34:38.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.253+0000 7f75a3fff640 1 --2- 172.21.15.79:0/1043057089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75a4107d20 0x7f75a419e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:38.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.253+0000 7f75a37fe640 1 --2- 172.21.15.79:0/1043057089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75a4101990 0x7f75a4198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:38.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.253+0000 7f759bfff640 1 -- 172.21.15.79:0/1043057089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75a4101990 msgr2=0x7f75a4198ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:38.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.253+0000 7f759bfff640 1 --2- 172.21.15.79:0/1043057089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75a4101990 0x7f75a4198ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:38.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.253+0000 7f759bfff640 1 -- 172.21.15.79:0/1043057089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75a4107d20 msgr2=0x7f75a419e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:38.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.253+0000 7f759bfff640 1 --2- 172.21.15.79:0/1043057089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75a4107d20 0x7f75a419e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:38.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.253+0000 7f759bfff640 1 -- 172.21.15.79:0/1043057089 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75a419ef70 con 0x7f75a41073a0 2024-08-20T01:34:38.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.253+0000 7f759bfff640 1 --2- 172.21.15.79:0/1043057089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75a41073a0 0x7f75a4199400 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f758c02a930 tx=0x7f758c003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:38.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.254+0000 7f75a17fa640 1 -- 172.21.15.79:0/1043057089 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758c03f070 con 0x7f75a41073a0 2024-08-20T01:34:38.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.254+0000 7f75a9d94640 1 -- 172.21.15.79:0/1043057089 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75a419f200 con 0x7f75a41073a0 2024-08-20T01:34:38.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.254+0000 7f75a17fa640 1 -- 172.21.15.79:0/1043057089 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f758c03baf0 con 0x7f75a41073a0 2024-08-20T01:34:38.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.254+0000 7f75a17fa640 1 -- 172.21.15.79:0/1043057089 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758c035030 con 0x7f75a41073a0 2024-08-20T01:34:38.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.254+0000 7f75a9d94640 1 -- 172.21.15.79:0/1043057089 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75a41a5920 con 0x7f75a41073a0 2024-08-20T01:34:38.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.255+0000 7f75a9d94640 1 -- 172.21.15.79:0/1043057089 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75a4101d70 con 0x7f75a41073a0 2024-08-20T01:34:38.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.256+0000 7f75a17fa640 1 -- 172.21.15.79:0/1043057089 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f758c042070 con 0x7f75a41073a0 2024-08-20T01:34:38.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.257+0000 7f75a17fa640 1 --2- 172.21.15.79:0/1043057089 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f75900b3bd0 0x7f75900b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:38.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.257+0000 7f75a37fe640 1 --2- 172.21.15.79:0/1043057089 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f75900b3bd0 0x7f75900b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:38.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.257+0000 7f75a17fa640 1 -- 172.21.15.79:0/1043057089 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7f758c104290 con 0x7f75a41073a0 2024-08-20T01:34:38.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.257+0000 7f75a37fe640 1 --2- 172.21.15.79:0/1043057089 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f75900b3bd0 0x7f75900b6090 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7594005fd0 tx=0x7f7594005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:38.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.260+0000 7f75a17fa640 1 -- 172.21.15.79:0/1043057089 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f758c0cbd80 con 0x7f75a41073a0 2024-08-20T01:34:38.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:38 smithi079 ceph-mon[18656]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:38.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.484+0000 7f75a9d94640 1 -- 172.21.15.79:0/1043057089 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f75a4199ff0 con 0x7f75a41073a0 2024-08-20T01:34:38.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.484+0000 7f75a17fa640 1 -- 172.21.15.79:0/1043057089 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8046 (secure 0 0 0) 0x7f758c0cb680 con 0x7f75a41073a0 2024-08-20T01:34:38.486 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:34:38.486 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":10,"btime":"2024-08-20T01:34:36:222482+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14670,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/735082912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":735082912},{"type":"v1","addr":"172.21.15.79:6835","nonce":735082912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2150339873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2150339873},{"type":"v1","addr":"172.21.15.79:6837","nonce":2150339873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24473,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/1257507005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1257507005},{"type":"v1","addr":"172.21.15.81:6833","nonce":1257507005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24494,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1499936216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1499936216},{"type":"v1","addr":"172.21.15.81:6835","nonce":1499936216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24496,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1107229215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1107229215},{"type":"v1","addr":"172.21.15.175:6833","nonce":1107229215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24512,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2073598870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2073598870},{"type":"v1","addr":"172.21.15.81:6837","nonce":2073598870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2552601173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2552601173},{"type":"v1","addr":"172.21.15.175:6835","nonce":2552601173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24523,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1767284089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1767284089},{"type":"v1","addr":"172.21.15.175:6837","nonce":1767284089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24538,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6839/1331748742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1331748742},{"type":"v1","addr":"172.21.15.175:6839","nonce":1331748742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-08-20T01:34:38.487 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 10 2024-08-20T01:34:38.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.486+0000 7f75a9d94640 1 -- 172.21.15.79:0/1043057089 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f75900b3bd0 msgr2=0x7f75900b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:38.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.486+0000 7f75a9d94640 1 --2- 172.21.15.79:0/1043057089 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f75900b3bd0 0x7f75900b6090 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7594005fd0 tx=0x7f7594005850 comp rx=0 tx=0).stop 2024-08-20T01:34:38.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.486+0000 7f75a9d94640 1 -- 172.21.15.79:0/1043057089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75a41073a0 msgr2=0x7f75a4199400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:38.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.486+0000 7f75a9d94640 1 --2- 172.21.15.79:0/1043057089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75a41073a0 0x7f75a4199400 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f758c02a930 tx=0x7f758c003b90 comp rx=0 tx=0).stop 2024-08-20T01:34:38.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.486+0000 7f75a9d94640 1 -- 172.21.15.79:0/1043057089 shutdown_connections 2024-08-20T01:34:38.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.486+0000 7f75a9d94640 1 --2- 172.21.15.79:0/1043057089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75a4107d20 0x7f75a419e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:38.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.486+0000 7f75a9d94640 1 --2- 172.21.15.79:0/1043057089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75a41073a0 0x7f75a4199400 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:38.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.486+0000 7f75a9d94640 1 --2- 172.21.15.79:0/1043057089 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f75900b3bd0 0x7f75900b6090 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:38.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.486+0000 7f75a9d94640 1 --2- 172.21.15.79:0/1043057089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75a4101990 0x7f75a4198ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:38.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.487+0000 7f75a9d94640 1 -- 172.21.15.79:0/1043057089 >> 172.21.15.79:0/1043057089 conn(0x7f75a40fd400 msgr2=0x7f75a406a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:38.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.487+0000 7f75a9d94640 1 -- 172.21.15.79:0/1043057089 shutdown_connections 2024-08-20T01:34:38.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:38.487+0000 7f75a9d94640 1 -- 172.21.15.79:0/1043057089 wait complete. 2024-08-20T01:34:38.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:38 smithi081 ceph-mon[22209]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:38.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:38 smithi175 ceph-mon[22392]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:39.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:39 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/1043057089' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:34:39.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:39 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:39.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:39 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:39.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:39 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:39.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:39 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:34:39.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:39 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:34:39.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:39 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:39.535 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:39 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/1043057089' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:34:39.535 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:39 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:39.535 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:39 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:39.535 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:39 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:39.535 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:39 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:34:39.535 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:39 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:34:39.535 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:39 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:39.540 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:39 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/1043057089' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:34:39.540 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:39 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:39.540 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:39 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:39.540 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:39 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:39.540 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:39 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:34:39.540 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:39 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:34:39.540 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:39 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:40.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:40 smithi079 ceph-mon[18656]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:40.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:40 smithi079 ceph-mon[18656]: Deploying daemon mds.a on smithi079 2024-08-20T01:34:40.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:40 smithi079 ceph-mon[18656]: mds.? [v2:172.21.15.79:6838/1071242274,v1:172.21.15.79:6839/1071242274] up:boot 2024-08-20T01:34:40.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:40 smithi079 ceph-mon[18656]: fsmap 10 up:standby 2024-08-20T01:34:40.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:40 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-20T01:34:40.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:40 smithi081 ceph-mon[22209]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:40.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:40 smithi081 ceph-mon[22209]: Deploying daemon mds.a on smithi079 2024-08-20T01:34:40.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:40 smithi081 ceph-mon[22209]: mds.? [v2:172.21.15.79:6838/1071242274,v1:172.21.15.79:6839/1071242274] up:boot 2024-08-20T01:34:40.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:40 smithi081 ceph-mon[22209]: fsmap 10 up:standby 2024-08-20T01:34:40.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:40 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-20T01:34:40.553 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:40 smithi175 ceph-mon[22392]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:40.553 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:40 smithi175 ceph-mon[22392]: Deploying daemon mds.a on smithi079 2024-08-20T01:34:40.554 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:40 smithi175 ceph-mon[22392]: mds.? [v2:172.21.15.79:6838/1071242274,v1:172.21.15.79:6839/1071242274] up:boot 2024-08-20T01:34:40.554 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:40 smithi175 ceph-mon[22392]: fsmap 10 up:standby 2024-08-20T01:34:40.554 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:40 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-20T01:34:41.671 INFO:journalctl@ceph.mds.a.smithi079.stdout:Aug 20 01:34:41 smithi079 systemd[1]: Starting Ceph mds.a for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:34:41.672 INFO:journalctl@ceph.mds.a.smithi079.stdout:Aug 20 01:34:41 smithi079 podman[58639]: 2024-08-20 01:34:41.57299996 +0000 UTC m=+0.015658859 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:34:41.690 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:34:41.936 INFO:journalctl@ceph.mds.a.smithi079.stdout:Aug 20 01:34:41 smithi079 podman[58639]: 2024-08-20 01:34:41.711302521 +0000 UTC m=+0.153961422 container create 833c34652cfc382bd8141a5927acb067f915feeac1667341c7978ea9de1c2e7b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-a, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-08-20T01:34:42.142 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:34:42.249 INFO:journalctl@ceph.mds.a.smithi079.stdout:Aug 20 01:34:41 smithi079 podman[58639]: 2024-08-20 01:34:41.963927295 +0000 UTC m=+0.406586193 container init 833c34652cfc382bd8141a5927acb067f915feeac1667341c7978ea9de1c2e7b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-a, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-20T01:34:42.249 INFO:journalctl@ceph.mds.a.smithi079.stdout:Aug 20 01:34:41 smithi079 podman[58639]: 2024-08-20 01:34:41.967163664 +0000 UTC m=+0.409822562 container start 833c34652cfc382bd8141a5927acb067f915feeac1667341c7978ea9de1c2e7b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-a, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-08-20T01:34:42.249 INFO:journalctl@ceph.mds.a.smithi079.stdout:Aug 20 01:34:41 smithi079 ceph-mds[58688]: -- 172.21.15.79:0/3685803905 <== mon.0 v2:172.21.15.79:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55611ade9860 con 0x55611adc7000 2024-08-20T01:34:42.249 INFO:journalctl@ceph.mds.a.smithi079.stdout:Aug 20 01:34:41 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-a[58672]: starting mds.a at 2024-08-20T01:34:42.249 INFO:journalctl@ceph.mds.a.smithi079.stdout:Aug 20 01:34:42 smithi079 bash[58639]: 833c34652cfc382bd8141a5927acb067f915feeac1667341c7978ea9de1c2e7b 2024-08-20T01:34:42.249 INFO:journalctl@ceph.mds.a.smithi079.stdout:Aug 20 01:34:42 smithi079 systemd[1]: Started Ceph mds.a for 28484e9a-5e93-11ef-bccf-c7b262605968. 2024-08-20T01:34:42.523 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:42 smithi081 ceph-mon[22209]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:42.523 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:42 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:42.523 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:42 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:42.523 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:42 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:42.523 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:42 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:34:42.523 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:42 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:34:42.523 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:42 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:42.567 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:42 smithi079 ceph-mon[18656]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:42.567 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:42 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:42.567 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:42 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:42.568 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:42 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:42.568 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:42 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:34:42.568 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:42 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:34:42.568 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:42 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:42.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:42 smithi175 ceph-mon[22392]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:42.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:42 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:42.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:42 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:42.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:42 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:42.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:42 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T01:34:42.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:42 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T01:34:42.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:42 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:42.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.646+0000 7fb3536ba640 1 -- 172.21.15.79:0/196940539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb34c10ce00 msgr2=0x7fb34c10f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:42.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.646+0000 7fb3536ba640 1 --2- 172.21.15.79:0/196940539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb34c10ce00 0x7fb34c10f260 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb344009900 tx=0x7fb34402a410 comp rx=0 tx=0).stop 2024-08-20T01:34:42.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.646+0000 7fb3536ba640 1 -- 172.21.15.79:0/196940539 shutdown_connections 2024-08-20T01:34:42.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.646+0000 7fb3536ba640 1 --2- 172.21.15.79:0/196940539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb34c10ce00 0x7fb34c10f260 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:42.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.646+0000 7fb3536ba640 1 --2- 172.21.15.79:0/196940539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb34c1042c0 0x7fb34c10c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:42.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.646+0000 7fb3536ba640 1 --2- 172.21.15.79:0/196940539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34c1039a0 0x7fb34c103d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:42.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.646+0000 7fb3536ba640 1 -- 172.21.15.79:0/196940539 >> 172.21.15.79:0/196940539 conn(0x7fb34c0fd400 msgr2=0x7fb34c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:42.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.646+0000 7fb3536ba640 1 -- 172.21.15.79:0/196940539 shutdown_connections 2024-08-20T01:34:42.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.646+0000 7fb3536ba640 1 -- 172.21.15.79:0/196940539 wait complete. 2024-08-20T01:34:42.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.647+0000 7fb3536ba640 1 Processor -- start 2024-08-20T01:34:42.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.647+0000 7fb3536ba640 1 -- start start 2024-08-20T01:34:42.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.647+0000 7fb3536ba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34c1039a0 0x7fb34c198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:42.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.647+0000 7fb3536ba640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb34c1042c0 0x7fb34c1993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:42.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.647+0000 7fb3536ba640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb34c10ce00 0x7fb34c19e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:42.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.647+0000 7fb3536ba640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb34c112920 con 0x7fb34c10ce00 2024-08-20T01:34:42.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.647+0000 7fb3536ba640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb34c1127a0 con 0x7fb34c1039a0 2024-08-20T01:34:42.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.647+0000 7fb3536ba640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb34c112aa0 con 0x7fb34c1042c0 2024-08-20T01:34:42.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.647+0000 7fb351c57640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb34c10ce00 0x7fb34c19e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:42.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.647+0000 7fb351c57640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb34c10ce00 0x7fb34c19e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49502/0 (socket says 172.21.15.79:49502) 2024-08-20T01:34:42.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.647+0000 7fb351c57640 1 -- 172.21.15.79:0/1339837836 learned_addr learned my addr 172.21.15.79:0/1339837836 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:34:42.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.647+0000 7fb351456640 1 --2- 172.21.15.79:0/1339837836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34c1039a0 0x7fb34c198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:42.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.647+0000 7fb350c55640 1 --2- 172.21.15.79:0/1339837836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb34c1042c0 0x7fb34c1993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:42.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.647+0000 7fb351c57640 1 -- 172.21.15.79:0/1339837836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb34c1042c0 msgr2=0x7fb34c1993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:42.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.647+0000 7fb351c57640 1 --2- 172.21.15.79:0/1339837836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb34c1042c0 0x7fb34c1993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:42.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.647+0000 7fb351c57640 1 -- 172.21.15.79:0/1339837836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34c1039a0 msgr2=0x7fb34c198e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:42.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.647+0000 7fb351c57640 1 --2- 172.21.15.79:0/1339837836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34c1039a0 0x7fb34c198e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:42.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.647+0000 7fb351c57640 1 -- 172.21.15.79:0/1339837836 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb34c19ef40 con 0x7fb34c10ce00 2024-08-20T01:34:42.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.647+0000 7fb351456640 1 --2- 172.21.15.79:0/1339837836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34c1039a0 0x7fb34c198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:34:42.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.648+0000 7fb351c57640 1 --2- 172.21.15.79:0/1339837836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb34c10ce00 0x7fb34c19e770 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb344005ab0 tx=0x7fb344005e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:42.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.648+0000 7fb34a7fc640 1 -- 172.21.15.79:0/1339837836 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb34403f030 con 0x7fb34c10ce00 2024-08-20T01:34:42.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.648+0000 7fb34a7fc640 1 -- 172.21.15.79:0/1339837836 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb3440043d0 con 0x7fb34c10ce00 2024-08-20T01:34:42.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.648+0000 7fb3536ba640 1 -- 172.21.15.79:0/1339837836 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb34c19f1d0 con 0x7fb34c10ce00 2024-08-20T01:34:42.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.648+0000 7fb34a7fc640 1 -- 172.21.15.79:0/1339837836 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb344035070 con 0x7fb34c10ce00 2024-08-20T01:34:42.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.648+0000 7fb3536ba640 1 -- 172.21.15.79:0/1339837836 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb34c1a58f0 con 0x7fb34c10ce00 2024-08-20T01:34:42.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.649+0000 7fb3536ba640 1 -- 172.21.15.79:0/1339837836 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb34c103d80 con 0x7fb34c10ce00 2024-08-20T01:34:42.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.650+0000 7fb34a7fc640 1 -- 172.21.15.79:0/1339837836 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7fb344042030 con 0x7fb34c10ce00 2024-08-20T01:34:42.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.651+0000 7fb34a7fc640 1 --2- 172.21.15.79:0/1339837836 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb3340b3c50 0x7fb3340b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:42.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.651+0000 7fb351456640 1 --2- 172.21.15.79:0/1339837836 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb3340b3c50 0x7fb3340b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:42.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.651+0000 7fb34a7fc640 1 -- 172.21.15.79:0/1339837836 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7fb344103db0 con 0x7fb34c10ce00 2024-08-20T01:34:42.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.651+0000 7fb351456640 1 --2- 172.21.15.79:0/1339837836 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb3340b3c50 0x7fb3340b6110 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb33c005fd0 tx=0x7fb33c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:42.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.654+0000 7fb34a7fc640 1 -- 172.21.15.79:0/1339837836 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fb3440cb250 con 0x7fb34c10ce00 2024-08-20T01:34:42.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.870+0000 7fb3536ba640 1 -- 172.21.15.79:0/1339837836 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb34c107e20 con 0x7fb34c10ce00 2024-08-20T01:34:42.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.870+0000 7fb34a7fc640 1 -- 172.21.15.79:0/1339837836 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9698 (secure 0 0 0) 0x7fb3440cf7a0 con 0x7fb34c10ce00 2024-08-20T01:34:42.872 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:34:42.872 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":12,"btime":"2024-08-20T01:34:42:243116+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14670,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/735082912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":735082912},{"type":"v1","addr":"172.21.15.79:6835","nonce":735082912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2150339873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2150339873},{"type":"v1","addr":"172.21.15.79:6837","nonce":2150339873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14724,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/1071242274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1071242274},{"type":"v1","addr":"172.21.15.79:6839","nonce":1071242274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14730,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/2448977611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":2448977611},{"type":"v1","addr":"172.21.15.79:6841","nonce":2448977611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24473,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/1257507005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1257507005},{"type":"v1","addr":"172.21.15.81:6833","nonce":1257507005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24494,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1499936216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1499936216},{"type":"v1","addr":"172.21.15.81:6835","nonce":1499936216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24496,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1107229215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1107229215},{"type":"v1","addr":"172.21.15.175:6833","nonce":1107229215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24512,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2073598870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2073598870},{"type":"v1","addr":"172.21.15.81:6837","nonce":2073598870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2552601173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2552601173},{"type":"v1","addr":"172.21.15.175:6835","nonce":2552601173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24523,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1767284089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1767284089},{"type":"v1","addr":"172.21.15.175:6837","nonce":1767284089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24538,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6839/1331748742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1331748742},{"type":"v1","addr":"172.21.15.175:6839","nonce":1331748742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-08-20T01:34:42.873 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 12 2024-08-20T01:34:42.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.873+0000 7fb3536ba640 1 -- 172.21.15.79:0/1339837836 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb3340b3c50 msgr2=0x7fb3340b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:42.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.873+0000 7fb3536ba640 1 --2- 172.21.15.79:0/1339837836 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb3340b3c50 0x7fb3340b6110 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb33c005fd0 tx=0x7fb33c009500 comp rx=0 tx=0).stop 2024-08-20T01:34:42.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.873+0000 7fb3536ba640 1 -- 172.21.15.79:0/1339837836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb34c10ce00 msgr2=0x7fb34c19e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:42.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.873+0000 7fb3536ba640 1 --2- 172.21.15.79:0/1339837836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb34c10ce00 0x7fb34c19e770 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb344005ab0 tx=0x7fb344005e10 comp rx=0 tx=0).stop 2024-08-20T01:34:42.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.873+0000 7fb3536ba640 1 -- 172.21.15.79:0/1339837836 shutdown_connections 2024-08-20T01:34:42.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.873+0000 7fb3536ba640 1 --2- 172.21.15.79:0/1339837836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb34c10ce00 0x7fb34c19e770 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:42.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.873+0000 7fb3536ba640 1 --2- 172.21.15.79:0/1339837836 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb3340b3c50 0x7fb3340b6110 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:42.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.873+0000 7fb3536ba640 1 --2- 172.21.15.79:0/1339837836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb34c1042c0 0x7fb34c1993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:42.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.873+0000 7fb3536ba640 1 --2- 172.21.15.79:0/1339837836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34c1039a0 0x7fb34c198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:42.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.873+0000 7fb3536ba640 1 -- 172.21.15.79:0/1339837836 >> 172.21.15.79:0/1339837836 conn(0x7fb34c0fd400 msgr2=0x7fb34c0fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:42.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.873+0000 7fb3536ba640 1 -- 172.21.15.79:0/1339837836 shutdown_connections 2024-08-20T01:34:42.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:42.873+0000 7fb3536ba640 1 -- 172.21.15.79:0/1339837836 wait complete. 2024-08-20T01:34:43.526 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:43 smithi081 ceph-mon[22209]: Deploying daemon mds.b on smithi081 2024-08-20T01:34:43.526 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:43 smithi081 ceph-mon[22209]: mds.? [v2:172.21.15.79:6840/2448977611,v1:172.21.15.79:6841/2448977611] up:boot 2024-08-20T01:34:43.526 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:43 smithi081 ceph-mon[22209]: fsmap 11 up:standby 2024-08-20T01:34:43.526 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:43 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-20T01:34:43.526 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:43 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/1339837836' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:34:43.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:43 smithi175 ceph-mon[22392]: Deploying daemon mds.b on smithi081 2024-08-20T01:34:43.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:43 smithi175 ceph-mon[22392]: mds.? [v2:172.21.15.79:6840/2448977611,v1:172.21.15.79:6841/2448977611] up:boot 2024-08-20T01:34:43.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:43 smithi175 ceph-mon[22392]: fsmap 11 up:standby 2024-08-20T01:34:43.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:43 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-20T01:34:43.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:43 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/1339837836' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:34:43.656 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:43 smithi079 ceph-mon[18656]: Deploying daemon mds.b on smithi081 2024-08-20T01:34:43.656 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:43 smithi079 ceph-mon[18656]: mds.? [v2:172.21.15.79:6840/2448977611,v1:172.21.15.79:6841/2448977611] up:boot 2024-08-20T01:34:43.656 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:43 smithi079 ceph-mon[18656]: fsmap 11 up:standby 2024-08-20T01:34:43.656 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:43 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-20T01:34:43.657 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:43 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/1339837836' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:34:44.256 INFO:journalctl@ceph.mds.b.smithi081.stdout:Aug 20 01:34:44 smithi081 systemd[1]: Starting Ceph mds.b for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:34:44.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:44 smithi081 ceph-mon[22209]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:44.528 INFO:journalctl@ceph.mds.b.smithi081.stdout:Aug 20 01:34:44 smithi081 podman[51970]: 2024-08-20 01:34:44.22376725 +0000 UTC m=+0.015815684 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:34:44.528 INFO:journalctl@ceph.mds.b.smithi081.stdout:Aug 20 01:34:44 smithi081 podman[51970]: 2024-08-20 01:34:44.355911293 +0000 UTC m=+0.147959756 container create a428163ca8fbb70e5e998377c21750e78a6738c87cb22bd89ce6509190c4f4d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-20T01:34:44.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:44 smithi175 ceph-mon[22392]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:44.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:44 smithi079 ceph-mon[18656]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:45.028 INFO:journalctl@ceph.mds.b.smithi081.stdout:Aug 20 01:34:44 smithi081 podman[51970]: 2024-08-20 01:34:44.566780136 +0000 UTC m=+0.358828557 container init a428163ca8fbb70e5e998377c21750e78a6738c87cb22bd89ce6509190c4f4d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-20T01:34:45.028 INFO:journalctl@ceph.mds.b.smithi081.stdout:Aug 20 01:34:44 smithi081 podman[51970]: 2024-08-20 01:34:44.569515463 +0000 UTC m=+0.361563894 container start a428163ca8fbb70e5e998377c21750e78a6738c87cb22bd89ce6509190c4f4d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-20T01:34:45.028 INFO:journalctl@ceph.mds.b.smithi081.stdout:Aug 20 01:34:44 smithi081 ceph-mds[51989]: -- 172.21.15.81:0/3099569408 <== mon.2 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561cfedef860 con 0x561cfedcd400 2024-08-20T01:34:45.028 INFO:journalctl@ceph.mds.b.smithi081.stdout:Aug 20 01:34:44 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-b[51985]: starting mds.b at 2024-08-20T01:34:45.028 INFO:journalctl@ceph.mds.b.smithi081.stdout:Aug 20 01:34:44 smithi081 bash[51970]: a428163ca8fbb70e5e998377c21750e78a6738c87cb22bd89ce6509190c4f4d3 2024-08-20T01:34:45.028 INFO:journalctl@ceph.mds.b.smithi081.stdout:Aug 20 01:34:44 smithi081 systemd[1]: Started Ceph mds.b for 28484e9a-5e93-11ef-bccf-c7b262605968. 2024-08-20T01:34:45.688 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:34:45.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:45 smithi079 ceph-mon[18656]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:45.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:45 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:45.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:45 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:45.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:45 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:45.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:45 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:45.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:45 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:45.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:45 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:34:45.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:45 smithi079 ceph-mon[18656]: mds.? [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] up:boot 2024-08-20T01:34:45.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:45 smithi079 ceph-mon[18656]: fsmap 12 up:standby 2024-08-20T01:34:45.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:45 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-20T01:34:45.946 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:34:46.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:45 smithi081 ceph-mon[22209]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:46.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:45 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:46.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:45 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:46.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:45 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:46.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:45 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:46.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:45 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:46.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:45 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:34:46.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:45 smithi081 ceph-mon[22209]: mds.? [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] up:boot 2024-08-20T01:34:46.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:45 smithi081 ceph-mon[22209]: fsmap 12 up:standby 2024-08-20T01:34:46.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:45 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-20T01:34:46.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:45 smithi175 ceph-mon[22392]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:46.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:45 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:46.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:45 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:46.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:45 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:46.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:45 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:46.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:45 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:46.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:45 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:34:46.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:45 smithi175 ceph-mon[22392]: mds.? [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] up:boot 2024-08-20T01:34:46.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:45 smithi175 ceph-mon[22392]: fsmap 12 up:standby 2024-08-20T01:34:46.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:45 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-20T01:34:46.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.442+0000 7f24584ad640 1 -- 172.21.15.79:0/199380039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f245010ce40 msgr2=0x7f245010f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:46.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.442+0000 7f24584ad640 1 --2- 172.21.15.79:0/199380039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f245010ce40 0x7f245010f2a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2448009900 tx=0x7f244802a410 comp rx=0 tx=0).stop 2024-08-20T01:34:46.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.442+0000 7f24584ad640 1 -- 172.21.15.79:0/199380039 shutdown_connections 2024-08-20T01:34:46.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.442+0000 7f24584ad640 1 --2- 172.21.15.79:0/199380039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f245010ce40 0x7f245010f2a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:46.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.442+0000 7f24584ad640 1 --2- 172.21.15.79:0/199380039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2450104300 0x7f245010c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:46.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.442+0000 7f24584ad640 1 --2- 172.21.15.79:0/199380039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24501039e0 0x7f2450103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:46.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.442+0000 7f24584ad640 1 -- 172.21.15.79:0/199380039 >> 172.21.15.79:0/199380039 conn(0x7f24500fd440 msgr2=0x7f24500ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:46.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.442+0000 7f24584ad640 1 -- 172.21.15.79:0/199380039 shutdown_connections 2024-08-20T01:34:46.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.442+0000 7f24584ad640 1 -- 172.21.15.79:0/199380039 wait complete. 2024-08-20T01:34:46.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.443+0000 7f24584ad640 1 Processor -- start 2024-08-20T01:34:46.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.443+0000 7f24584ad640 1 -- start start 2024-08-20T01:34:46.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.443+0000 7f24584ad640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24501039e0 0x7f2450101690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:46.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.443+0000 7f24584ad640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2450104300 0x7f2450101bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:46.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.443+0000 7f24584ad640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f245010ce40 0x7f2450102110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:46.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.443+0000 7f24584ad640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2450112960 con 0x7f2450104300 2024-08-20T01:34:46.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.443+0000 7f24584ad640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f24501127e0 con 0x7f245010ce40 2024-08-20T01:34:46.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.443+0000 7f24584ad640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2450112ae0 con 0x7f24501039e0 2024-08-20T01:34:46.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.443+0000 7f2455a48640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2450104300 0x7f2450101bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:46.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.443+0000 7f2455a48640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2450104300 0x7f2450101bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49524/0 (socket says 172.21.15.79:49524) 2024-08-20T01:34:46.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.443+0000 7f2455a48640 1 -- 172.21.15.79:0/1090118715 learned_addr learned my addr 172.21.15.79:0/1090118715 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:34:46.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.443+0000 7f2455a48640 1 -- 172.21.15.79:0/1090118715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24501039e0 msgr2=0x7f2450101690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:46.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.443+0000 7f2455a48640 1 --2- 172.21.15.79:0/1090118715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24501039e0 0x7f2450101690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:46.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.443+0000 7f2455a48640 1 -- 172.21.15.79:0/1090118715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f245010ce40 msgr2=0x7f2450102110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:46.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.443+0000 7f2455a48640 1 --2- 172.21.15.79:0/1090118715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f245010ce40 0x7f2450102110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:46.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.443+0000 7f2455a48640 1 -- 172.21.15.79:0/1090118715 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24501a7210 con 0x7f2450104300 2024-08-20T01:34:46.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.443+0000 7f2455a48640 1 --2- 172.21.15.79:0/1090118715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2450104300 0x7f2450101bd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f244400d750 tx=0x7f244400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:46.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.443+0000 7f244f7fe640 1 -- 172.21.15.79:0/1090118715 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2444017070 con 0x7f2450104300 2024-08-20T01:34:46.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.443+0000 7f24584ad640 1 -- 172.21.15.79:0/1090118715 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24501a7500 con 0x7f2450104300 2024-08-20T01:34:46.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.443+0000 7f244f7fe640 1 -- 172.21.15.79:0/1090118715 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2444004020 con 0x7f2450104300 2024-08-20T01:34:46.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.443+0000 7f244f7fe640 1 -- 172.21.15.79:0/1090118715 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2444003ba0 con 0x7f2450104300 2024-08-20T01:34:46.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.444+0000 7f24584ad640 1 -- 172.21.15.79:0/1090118715 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24501a7a90 con 0x7f2450104300 2024-08-20T01:34:46.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.445+0000 7f24584ad640 1 -- 172.21.15.79:0/1090118715 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2450103dc0 con 0x7f2450104300 2024-08-20T01:34:46.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.446+0000 7f244f7fe640 1 -- 172.21.15.79:0/1090118715 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f2444009a30 con 0x7f2450104300 2024-08-20T01:34:46.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.447+0000 7f244f7fe640 1 --2- 172.21.15.79:0/1090118715 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f24380b3bd0 0x7f24380b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:46.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.447+0000 7f2456249640 1 --2- 172.21.15.79:0/1090118715 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f24380b3bd0 0x7f24380b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:46.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.447+0000 7f244f7fe640 1 -- 172.21.15.79:0/1090118715 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7f24440e3530 con 0x7f2450104300 2024-08-20T01:34:46.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.447+0000 7f2456249640 1 --2- 172.21.15.79:0/1090118715 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f24380b3bd0 0x7f24380b6090 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2440005fd0 tx=0x7f24400071c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:46.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.450+0000 7f244f7fe640 1 -- 172.21.15.79:0/1090118715 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f24440ab020 con 0x7f2450104300 2024-08-20T01:34:46.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.687+0000 7f24584ad640 1 -- 172.21.15.79:0/1090118715 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2450102990 con 0x7f2450104300 2024-08-20T01:34:46.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.688+0000 7f244f7fe640 1 -- 172.21.15.79:0/1090118715 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10524 (secure 0 0 0) 0x7f24440cbe20 con 0x7f2450104300 2024-08-20T01:34:46.690 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:34:46.690 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":13,"btime":"2024-08-20T01:34:45:255408+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14670,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/735082912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":735082912},{"type":"v1","addr":"172.21.15.79:6835","nonce":735082912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2150339873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2150339873},{"type":"v1","addr":"172.21.15.79:6837","nonce":2150339873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14724,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/1071242274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1071242274},{"type":"v1","addr":"172.21.15.79:6839","nonce":1071242274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14730,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6841/2448977611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":2448977611},{"type":"v1","addr":"172.21.15.79:6841","nonce":2448977611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24473,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/1257507005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1257507005},{"type":"v1","addr":"172.21.15.81:6833","nonce":1257507005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24494,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1499936216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1499936216},{"type":"v1","addr":"172.21.15.81:6835","nonce":1499936216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24496,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1107229215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1107229215},{"type":"v1","addr":"172.21.15.175:6833","nonce":1107229215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24512,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2073598870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2073598870},{"type":"v1","addr":"172.21.15.81:6837","nonce":2073598870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2552601173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2552601173},{"type":"v1","addr":"172.21.15.175:6835","nonce":2552601173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24523,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1767284089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1767284089},{"type":"v1","addr":"172.21.15.175:6837","nonce":1767284089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24538,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6839/1331748742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1331748742},{"type":"v1","addr":"172.21.15.175:6839","nonce":1331748742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24539,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/4098410583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":4098410583},{"type":"v1","addr":"172.21.15.81:6839","nonce":4098410583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-08-20T01:34:46.691 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 13 2024-08-20T01:34:46.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.690+0000 7f24584ad640 1 -- 172.21.15.79:0/1090118715 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f24380b3bd0 msgr2=0x7f24380b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:46.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.690+0000 7f24584ad640 1 --2- 172.21.15.79:0/1090118715 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f24380b3bd0 0x7f24380b6090 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2440005fd0 tx=0x7f24400071c0 comp rx=0 tx=0).stop 2024-08-20T01:34:46.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.690+0000 7f24584ad640 1 -- 172.21.15.79:0/1090118715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2450104300 msgr2=0x7f2450101bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:46.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.690+0000 7f24584ad640 1 --2- 172.21.15.79:0/1090118715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2450104300 0x7f2450101bd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f244400d750 tx=0x7f244400dc10 comp rx=0 tx=0).stop 2024-08-20T01:34:46.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.690+0000 7f24584ad640 1 -- 172.21.15.79:0/1090118715 shutdown_connections 2024-08-20T01:34:46.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.690+0000 7f24584ad640 1 --2- 172.21.15.79:0/1090118715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f245010ce40 0x7f2450102110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:46.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.690+0000 7f24584ad640 1 --2- 172.21.15.79:0/1090118715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2450104300 0x7f2450101bd0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:46.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.690+0000 7f24584ad640 1 --2- 172.21.15.79:0/1090118715 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f24380b3bd0 0x7f24380b6090 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:46.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.690+0000 7f24584ad640 1 --2- 172.21.15.79:0/1090118715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24501039e0 0x7f2450101690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:46.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.691+0000 7f24584ad640 1 -- 172.21.15.79:0/1090118715 >> 172.21.15.79:0/1090118715 conn(0x7f24500fd440 msgr2=0x7f24500fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:46.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.691+0000 7f24584ad640 1 -- 172.21.15.79:0/1090118715 shutdown_connections 2024-08-20T01:34:46.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:46.691+0000 7f24584ad640 1 -- 172.21.15.79:0/1090118715 wait complete. 2024-08-20T01:34:47.363 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:47 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:47.363 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:47 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:47.364 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:47 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:47.364 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:47 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:47.364 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:47 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/1090118715' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:34:47.364 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:47 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:47.364 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:47 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:47.364 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:47 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:47.364 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:47 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:34:47.364 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:47 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:47.364 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:47 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:34:47.389 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-08-20T01:34:47.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:47 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:47.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:47 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:47.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:47 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:47.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:47 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:47.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:47 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/1090118715' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:34:47.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:47 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:47.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:47 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:47.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:47 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:47.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:47 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:34:47.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:47 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:47.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:47 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:34:47.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:47 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:47.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:47 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:47.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:47 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:47.534 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:47 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:47.534 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:47 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/1090118715' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:34:47.534 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:47 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:47.534 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:47 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:47.534 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:47 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:47.534 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:47 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:34:47.534 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:47 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:47.534 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:47 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:34:48.286 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:34:48.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:48 smithi081 ceph-mon[22209]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:48.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:48 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:48.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:48 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:48.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:48 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:48.545 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:48 smithi079 ceph-mon[18656]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:48.546 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:48 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:48.546 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:48 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:48.546 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:48 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:48.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:48 smithi175 ceph-mon[22392]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:48.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:48 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:48.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:48 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:48.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:48 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:48.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.765+0000 7ff89d5cf640 1 -- 172.21.15.79:0/3628410714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff89810ce50 msgr2=0x7ff89810f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:48.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.765+0000 7ff89d5cf640 1 --2- 172.21.15.79:0/3628410714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff89810ce50 0x7ff89810f280 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff890009ca0 tx=0x7ff89002a8c0 comp rx=0 tx=0).stop 2024-08-20T01:34:48.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.765+0000 7ff89d5cf640 1 -- 172.21.15.79:0/3628410714 shutdown_connections 2024-08-20T01:34:48.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.765+0000 7ff89d5cf640 1 --2- 172.21.15.79:0/3628410714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff89810ce50 0x7ff89810f280 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:48.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.765+0000 7ff89d5cf640 1 --2- 172.21.15.79:0/3628410714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8981042a0 0x7ff89810c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:48.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.765+0000 7ff89d5cf640 1 --2- 172.21.15.79:0/3628410714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8981038a0 0x7ff898103c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:48.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.765+0000 7ff89d5cf640 1 -- 172.21.15.79:0/3628410714 >> 172.21.15.79:0/3628410714 conn(0x7ff8980fd410 msgr2=0x7ff8980ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:48.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.765+0000 7ff89d5cf640 1 -- 172.21.15.79:0/3628410714 shutdown_connections 2024-08-20T01:34:48.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.765+0000 7ff89d5cf640 1 -- 172.21.15.79:0/3628410714 wait complete. 2024-08-20T01:34:48.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.766+0000 7ff89d5cf640 1 Processor -- start 2024-08-20T01:34:48.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.766+0000 7ff89d5cf640 1 -- start start 2024-08-20T01:34:48.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.766+0000 7ff89d5cf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8981038a0 0x7ff898199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:48.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.766+0000 7ff89d5cf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8981042a0 0x7ff8981996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:48.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.766+0000 7ff89d5cf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff89810ce50 0x7ff89819ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:48.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.766+0000 7ff89d5cf640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff898112990 con 0x7ff8981038a0 2024-08-20T01:34:48.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.766+0000 7ff89d5cf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff898112810 con 0x7ff89810ce50 2024-08-20T01:34:48.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.766+0000 7ff89d5cf640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff898112b10 con 0x7ff8981042a0 2024-08-20T01:34:48.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.766+0000 7ff896ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8981038a0 0x7ff898199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:48.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.766+0000 7ff896ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8981038a0 0x7ff898199160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49544/0 (socket says 172.21.15.79:49544) 2024-08-20T01:34:48.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.766+0000 7ff896ffd640 1 -- 172.21.15.79:0/3308449165 learned_addr learned my addr 172.21.15.79:0/3308449165 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:34:48.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.766+0000 7ff8977fe640 1 --2- 172.21.15.79:0/3308449165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff89810ce50 0x7ff89819ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:48.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.766+0000 7ff896ffd640 1 -- 172.21.15.79:0/3308449165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8981042a0 msgr2=0x7ff8981996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:48.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.766+0000 7ff88ffff640 1 --2- 172.21.15.79:0/3308449165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8981042a0 0x7ff8981996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:48.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.766+0000 7ff896ffd640 1 --2- 172.21.15.79:0/3308449165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8981042a0 0x7ff8981996a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:48.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.766+0000 7ff896ffd640 1 -- 172.21.15.79:0/3308449165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff89810ce50 msgr2=0x7ff89819ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:48.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.766+0000 7ff896ffd640 1 --2- 172.21.15.79:0/3308449165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff89810ce50 0x7ff89819ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:48.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.766+0000 7ff896ffd640 1 -- 172.21.15.79:0/3308449165 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff89819f210 con 0x7ff8981038a0 2024-08-20T01:34:48.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.766+0000 7ff8977fe640 1 --2- 172.21.15.79:0/3308449165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff89810ce50 0x7ff89819ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:34:48.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.767+0000 7ff896ffd640 1 --2- 172.21.15.79:0/3308449165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8981038a0 0x7ff898199160 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff88800d950 tx=0x7ff88800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:48.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.767+0000 7ff894ff9640 1 -- 172.21.15.79:0/3308449165 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff888017070 con 0x7ff8981038a0 2024-08-20T01:34:48.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.767+0000 7ff89d5cf640 1 -- 172.21.15.79:0/3308449165 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff89819f500 con 0x7ff8981038a0 2024-08-20T01:34:48.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.767+0000 7ff894ff9640 1 -- 172.21.15.79:0/3308449165 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff888009c30 con 0x7ff8981038a0 2024-08-20T01:34:48.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.767+0000 7ff894ff9640 1 -- 172.21.15.79:0/3308449165 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff88800f620 con 0x7ff8981038a0 2024-08-20T01:34:48.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.767+0000 7ff89d5cf640 1 -- 172.21.15.79:0/3308449165 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8981a5d90 con 0x7ff8981038a0 2024-08-20T01:34:48.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.768+0000 7ff89d5cf640 1 -- 172.21.15.79:0/3308449165 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff898103c80 con 0x7ff8981038a0 2024-08-20T01:34:48.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.769+0000 7ff894ff9640 1 -- 172.21.15.79:0/3308449165 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7ff888010460 con 0x7ff8981038a0 2024-08-20T01:34:48.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.770+0000 7ff894ff9640 1 --2- 172.21.15.79:0/3308449165 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff8840b3bd0 0x7ff8840b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:48.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.770+0000 7ff88ffff640 1 --2- 172.21.15.79:0/3308449165 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff8840b3bd0 0x7ff8840b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:48.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.770+0000 7ff894ff9640 1 -- 172.21.15.79:0/3308449165 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7ff8880e3420 con 0x7ff8981038a0 2024-08-20T01:34:48.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.770+0000 7ff88ffff640 1 --2- 172.21.15.79:0/3308449165 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff8840b3bd0 0x7ff8840b6090 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff89810f480 tx=0x7ff880005c60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:48.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.774+0000 7ff894ff9640 1 -- 172.21.15.79:0/3308449165 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7ff8880aaf10 con 0x7ff8981038a0 2024-08-20T01:34:48.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.963+0000 7ff89d5cf640 1 -- 172.21.15.79:0/3308449165 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff898107ec0 con 0x7ff8981038a0 2024-08-20T01:34:48.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.963+0000 7ff894ff9640 1 -- 172.21.15.79:0/3308449165 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v67) ==== 84+0+65 (secure 0 0 0) 0x7ff888009de0 con 0x7ff8981038a0 2024-08-20T01:34:48.965 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:34:48.965 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2024-08-20T01:34:48.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:34:48.965 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2024-08-20T01:34:48.965 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": ".mgr" 2024-08-20T01:34:48.965 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:34:48.966 INFO:teuthology.orchestra.run.smithi079.stdout:] 2024-08-20T01:34:48.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.965+0000 7ff89d5cf640 1 -- 172.21.15.79:0/3308449165 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff8840b3bd0 msgr2=0x7ff8840b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:48.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.965+0000 7ff89d5cf640 1 --2- 172.21.15.79:0/3308449165 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff8840b3bd0 0x7ff8840b6090 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff89810f480 tx=0x7ff880005c60 comp rx=0 tx=0).stop 2024-08-20T01:34:48.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.965+0000 7ff89d5cf640 1 -- 172.21.15.79:0/3308449165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8981038a0 msgr2=0x7ff898199160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:48.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.965+0000 7ff89d5cf640 1 --2- 172.21.15.79:0/3308449165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8981038a0 0x7ff898199160 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff88800d950 tx=0x7ff88800de10 comp rx=0 tx=0).stop 2024-08-20T01:34:48.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.966+0000 7ff89d5cf640 1 -- 172.21.15.79:0/3308449165 shutdown_connections 2024-08-20T01:34:48.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.966+0000 7ff89d5cf640 1 --2- 172.21.15.79:0/3308449165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff89810ce50 0x7ff89819ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:48.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.966+0000 7ff89d5cf640 1 --2- 172.21.15.79:0/3308449165 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff8840b3bd0 0x7ff8840b6090 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:48.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.966+0000 7ff89d5cf640 1 --2- 172.21.15.79:0/3308449165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8981042a0 0x7ff8981996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:48.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.966+0000 7ff89d5cf640 1 --2- 172.21.15.79:0/3308449165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8981038a0 0x7ff898199160 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:48.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.966+0000 7ff89d5cf640 1 -- 172.21.15.79:0/3308449165 >> 172.21.15.79:0/3308449165 conn(0x7ff8980fd410 msgr2=0x7ff8980fe350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:48.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.966+0000 7ff89d5cf640 1 -- 172.21.15.79:0/3308449165 shutdown_connections 2024-08-20T01:34:48.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:48.966+0000 7ff89d5cf640 1 -- 172.21.15.79:0/3308449165 wait complete. 2024-08-20T01:34:49.311 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:49 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:49.312 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:49 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:49.312 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:49 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/3308449165' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-08-20T01:34:49.312 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:49 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:49.312 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:49 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:49.312 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:49 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:49.312 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:49 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:34:49.312 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:49 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:49.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:49 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:49.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:49 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:49.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:49 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/3308449165' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-08-20T01:34:49.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:49 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:49.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:49 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:49.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:49 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:49.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:49 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:34:49.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:49 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:49.661 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-20T01:34:49.661 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-20T01:34:49.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:49 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:49.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:49 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:49.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:49 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/3308449165' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-08-20T01:34:49.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:49 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:49.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:49 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:49.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:49 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:34:49.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:49 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:34:49.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:49 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:34:49.904 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:34:50.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:50.397+0000 7f4b0ee28640 1 -- 172.21.15.79:0/1912240833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b08102ab0 msgr2=0x7f4b08102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:50.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:50.397+0000 7f4b0ee28640 1 --2- 172.21.15.79:0/1912240833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b08102ab0 0x7f4b08102e90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4afc009900 tx=0x7f4afc02a410 comp rx=0 tx=0).stop 2024-08-20T01:34:50.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:50.397+0000 7f4b0ee28640 1 -- 172.21.15.79:0/1912240833 shutdown_connections 2024-08-20T01:34:50.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:50.397+0000 7f4b0ee28640 1 --2- 172.21.15.79:0/1912240833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b08108e40 0x7f4b0810f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:50.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:50.397+0000 7f4b0ee28640 1 --2- 172.21.15.79:0/1912240833 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b081084c0 0x7f4b08108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:50.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:50.397+0000 7f4b0ee28640 1 --2- 172.21.15.79:0/1912240833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b08102ab0 0x7f4b08102e90 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:50.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:50.397+0000 7f4b0ee28640 1 -- 172.21.15.79:0/1912240833 >> 172.21.15.79:0/1912240833 conn(0x7f4b080fe500 msgr2=0x7f4b08100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:50.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:50.397+0000 7f4b0ee28640 1 -- 172.21.15.79:0/1912240833 shutdown_connections 2024-08-20T01:34:50.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:50.397+0000 7f4b0ee28640 1 -- 172.21.15.79:0/1912240833 wait complete. 2024-08-20T01:34:50.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:50.398+0000 7f4b0ee28640 1 Processor -- start 2024-08-20T01:34:50.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:50.398+0000 7f4b0ee28640 1 -- start start 2024-08-20T01:34:50.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:50.398+0000 7f4b0ee28640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b08102ab0 0x7f4b08199020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:50.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:50.398+0000 7f4b0ee28640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b081084c0 0x7f4b08199560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:50.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:50.398+0000 7f4b0ee28640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b08108e40 0x7f4b0819e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:50.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:50.398+0000 7f4b0ee28640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4b081129f0 con 0x7f4b081084c0 2024-08-20T01:34:50.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:50.398+0000 7f4b0ee28640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4b08112870 con 0x7f4b08108e40 2024-08-20T01:34:50.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:50.398+0000 7f4b0ee28640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4b08112b70 con 0x7f4b08102ab0 2024-08-20T01:34:50.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:50.398+0000 7f4b07fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b081084c0 0x7f4b08199560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:50.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:50.398+0000 7f4b07fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b081084c0 0x7f4b08199560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52728/0 (socket says 172.21.15.79:52728) 2024-08-20T01:34:50.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:50.398+0000 7f4b07fff640 1 -- 172.21.15.79:0/857670391 learned_addr learned my addr 172.21.15.79:0/857670391 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:34:50.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:50.398+0000 7f4b0cbc4640 1 --2- 172.21.15.79:0/857670391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b08102ab0 0x7f4b08199020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:50.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:50.398+0000 7f4b0d3c5640 1 --2- 172.21.15.79:0/857670391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b08108e40 0x7f4b0819e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:50.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:50.398+0000 7f4b07fff640 1 -- 172.21.15.79:0/857670391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b08102ab0 msgr2=0x7f4b08199020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:50.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:50.398+0000 7f4b07fff640 1 --2- 172.21.15.79:0/857670391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b08102ab0 0x7f4b08199020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:50.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:50.398+0000 7f4b07fff640 1 -- 172.21.15.79:0/857670391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b08108e40 msgr2=0x7f4b0819e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:50.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:50.398+0000 7f4b07fff640 1 --2- 172.21.15.79:0/857670391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b08108e40 0x7f4b0819e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:50.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:50.398+0000 7f4b07fff640 1 -- 172.21.15.79:0/857670391 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b0819f0d0 con 0x7f4b081084c0 2024-08-20T01:34:50.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:50.398+0000 7f4b07fff640 1 --2- 172.21.15.79:0/857670391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b081084c0 0x7f4b08199560 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4af400b4a0 tx=0x7f4af400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:50.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:50.399+0000 7f4b05ffb640 1 -- 172.21.15.79:0/857670391 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af4014070 con 0x7f4b081084c0 2024-08-20T01:34:50.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:50.399+0000 7f4b0ee28640 1 -- 172.21.15.79:0/857670391 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b0819f3c0 con 0x7f4b081084c0 2024-08-20T01:34:50.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:50.399+0000 7f4b05ffb640 1 -- 172.21.15.79:0/857670391 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4af4010aa0 con 0x7f4b081084c0 2024-08-20T01:34:50.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:50.399+0000 7f4b05ffb640 1 -- 172.21.15.79:0/857670391 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af4017b70 con 0x7f4b081084c0 2024-08-20T01:34:50.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:50.399+0000 7f4b0ee28640 1 -- 172.21.15.79:0/857670391 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b081a5b00 con 0x7f4b081084c0 2024-08-20T01:34:50.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:50.400+0000 7f4b0ee28640 1 -- 172.21.15.79:0/857670391 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b08102f10 con 0x7f4b081084c0 2024-08-20T01:34:50.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:50.401+0000 7f4b05ffb640 1 -- 172.21.15.79:0/857670391 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f4af4017070 con 0x7f4b081084c0 2024-08-20T01:34:50.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:50.402+0000 7f4b05ffb640 1 --2- 172.21.15.79:0/857670391 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4af80b3bd0 0x7f4af80b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:50.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:50.402+0000 7f4b0cbc4640 1 --2- 172.21.15.79:0/857670391 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4af80b3bd0 0x7f4af80b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:50.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:50.402+0000 7f4b05ffb640 1 -- 172.21.15.79:0/857670391 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7f4af40e2bc0 con 0x7f4b081084c0 2024-08-20T01:34:50.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:50.402+0000 7f4b0cbc4640 1 --2- 172.21.15.79:0/857670391 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4af80b3bd0 0x7f4af80b6090 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4afc000c00 tx=0x7f4afc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:50.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:50.405+0000 7f4b05ffb640 1 -- 172.21.15.79:0/857670391 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f4af40aa6b0 con 0x7f4b081084c0 2024-08-20T01:34:50.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:50.581+0000 7f4b0ee28640 1 -- 172.21.15.79:0/857670391 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f4b0802e340 con 0x7f4b081084c0 2024-08-20T01:34:50.583 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:50 smithi079 ceph-mon[18656]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:50.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:50 smithi175 ceph-mon[22392]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:50.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:50 smithi081 ceph-mon[22209]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:51.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:51.326+0000 7f4b05ffb640 1 -- 172.21.15.79:0/857670391 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v68) ==== 138+0+0 (secure 0 0 0) 0x7f4af40a9fb0 con 0x7f4b081084c0 2024-08-20T01:34:51.328 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2024-08-20T01:34:51.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:51.329+0000 7f4b0ee28640 1 -- 172.21.15.79:0/857670391 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4af80b3bd0 msgr2=0x7f4af80b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:51.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:51.329+0000 7f4b0ee28640 1 --2- 172.21.15.79:0/857670391 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4af80b3bd0 0x7f4af80b6090 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4afc000c00 tx=0x7f4afc005a20 comp rx=0 tx=0).stop 2024-08-20T01:34:51.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:51.329+0000 7f4b0ee28640 1 -- 172.21.15.79:0/857670391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b081084c0 msgr2=0x7f4b08199560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:51.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:51.329+0000 7f4b0ee28640 1 --2- 172.21.15.79:0/857670391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b081084c0 0x7f4b08199560 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4af400b4a0 tx=0x7f4af400b960 comp rx=0 tx=0).stop 2024-08-20T01:34:51.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:51.330+0000 7f4b0ee28640 1 -- 172.21.15.79:0/857670391 shutdown_connections 2024-08-20T01:34:51.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:51.330+0000 7f4b0ee28640 1 --2- 172.21.15.79:0/857670391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b08108e40 0x7f4b0819e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:51.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:51.330+0000 7f4b0ee28640 1 --2- 172.21.15.79:0/857670391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b081084c0 0x7f4b08199560 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:51.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:51.330+0000 7f4b0ee28640 1 --2- 172.21.15.79:0/857670391 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4af80b3bd0 0x7f4af80b6090 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:51.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:51.330+0000 7f4b0ee28640 1 --2- 172.21.15.79:0/857670391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b08102ab0 0x7f4b08199020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:51.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:51.330+0000 7f4b0ee28640 1 -- 172.21.15.79:0/857670391 >> 172.21.15.79:0/857670391 conn(0x7f4b080fe500 msgr2=0x7f4b081008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:51.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:51.330+0000 7f4b0ee28640 1 -- 172.21.15.79:0/857670391 shutdown_connections 2024-08-20T01:34:51.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:51.330+0000 7f4b0ee28640 1 -- 172.21.15.79:0/857670391 wait complete. 2024-08-20T01:34:51.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:51 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/857670391' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-08-20T01:34:51.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:51 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/857670391' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-08-20T01:34:51.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:51 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/857670391' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-08-20T01:34:52.077 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-20T01:34:52.329 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:34:52.338 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:52 smithi079 ceph-mon[18656]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:52.601 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:52 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/857670391' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-20T01:34:52.601 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:52 smithi079 ceph-mon[18656]: osdmap e68: 12 total, 12 up, 12 in 2024-08-20T01:34:52.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:52 smithi175 ceph-mon[22392]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:52.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:52 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/857670391' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-20T01:34:52.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:52 smithi175 ceph-mon[22392]: osdmap e68: 12 total, 12 up, 12 in 2024-08-20T01:34:52.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:52 smithi081 ceph-mon[22209]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:52.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:52 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/857670391' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-20T01:34:52.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:52 smithi081 ceph-mon[22209]: osdmap e68: 12 total, 12 up, 12 in 2024-08-20T01:34:52.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.792+0000 7f43e7dbe640 1 -- 172.21.15.79:0/1077278323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43e0101990 msgr2=0x7f43e0101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:52.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.792+0000 7f43e7dbe640 1 --2- 172.21.15.79:0/1077278323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43e0101990 0x7f43e0101d70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f43dc009900 tx=0x7f43dc02a410 comp rx=0 tx=0).stop 2024-08-20T01:34:52.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.792+0000 7f43e7dbe640 1 -- 172.21.15.79:0/1077278323 shutdown_connections 2024-08-20T01:34:52.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.792+0000 7f43e7dbe640 1 --2- 172.21.15.79:0/1077278323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43e0107d20 0x7f43e010e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:52.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.792+0000 7f43e7dbe640 1 --2- 172.21.15.79:0/1077278323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43e01073a0 0x7f43e01077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:52.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.792+0000 7f43e7dbe640 1 --2- 172.21.15.79:0/1077278323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43e0101990 0x7f43e0101d70 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:52.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.792+0000 7f43e7dbe640 1 -- 172.21.15.79:0/1077278323 >> 172.21.15.79:0/1077278323 conn(0x7f43e00fd400 msgr2=0x7f43e00ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:52.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.792+0000 7f43e7dbe640 1 -- 172.21.15.79:0/1077278323 shutdown_connections 2024-08-20T01:34:52.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.792+0000 7f43e7dbe640 1 -- 172.21.15.79:0/1077278323 wait complete. 2024-08-20T01:34:52.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.792+0000 7f43e7dbe640 1 Processor -- start 2024-08-20T01:34:52.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.792+0000 7f43e7dbe640 1 -- start start 2024-08-20T01:34:52.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.793+0000 7f43e7dbe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43e0101990 0x7f43e019b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:52.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.793+0000 7f43e7dbe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43e01073a0 0x7f43e019b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:52.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.793+0000 7f43e7dbe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43e0107d20 0x7f43e01a0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:52.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.793+0000 7f43e7dbe640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f43e0111890 con 0x7f43e01073a0 2024-08-20T01:34:52.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.793+0000 7f43e7dbe640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f43e0111710 con 0x7f43e0101990 2024-08-20T01:34:52.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.793+0000 7f43e7dbe640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f43e0111a10 con 0x7f43e0107d20 2024-08-20T01:34:52.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.793+0000 7f43e5359640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43e01073a0 0x7f43e019b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:52.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.793+0000 7f43e5359640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43e01073a0 0x7f43e019b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52754/0 (socket says 172.21.15.79:52754) 2024-08-20T01:34:52.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.793+0000 7f43e5359640 1 -- 172.21.15.79:0/1215719414 learned_addr learned my addr 172.21.15.79:0/1215719414 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:34:52.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.793+0000 7f43e5b5a640 1 --2- 172.21.15.79:0/1215719414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43e0101990 0x7f43e019b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:52.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.793+0000 7f43e5359640 1 -- 172.21.15.79:0/1215719414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43e0107d20 msgr2=0x7f43e01a0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:52.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.793+0000 7f43e635b640 1 --2- 172.21.15.79:0/1215719414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43e0107d20 0x7f43e01a0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:52.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.793+0000 7f43e5359640 1 --2- 172.21.15.79:0/1215719414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43e0107d20 0x7f43e01a0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:52.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.793+0000 7f43e5359640 1 -- 172.21.15.79:0/1215719414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43e0101990 msgr2=0x7f43e019b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:52.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.793+0000 7f43e5359640 1 --2- 172.21.15.79:0/1215719414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43e0101990 0x7f43e019b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:52.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.793+0000 7f43e5359640 1 -- 172.21.15.79:0/1215719414 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e01a11f0 con 0x7f43e01073a0 2024-08-20T01:34:52.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.793+0000 7f43e5b5a640 1 --2- 172.21.15.79:0/1215719414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43e0101990 0x7f43e019b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:34:52.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.793+0000 7f43e635b640 1 --2- 172.21.15.79:0/1215719414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43e0107d20 0x7f43e01a0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:34:52.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.793+0000 7f43e5359640 1 --2- 172.21.15.79:0/1215719414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43e01073a0 0x7f43e019b680 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f43d000d950 tx=0x7f43d000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:52.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.793+0000 7f43d6ffd640 1 -- 172.21.15.79:0/1215719414 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d0017030 con 0x7f43e01073a0 2024-08-20T01:34:52.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.793+0000 7f43e7dbe640 1 -- 172.21.15.79:0/1215719414 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43e01a14e0 con 0x7f43e01073a0 2024-08-20T01:34:52.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.793+0000 7f43d6ffd640 1 -- 172.21.15.79:0/1215719414 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f43d0004020 con 0x7f43e01073a0 2024-08-20T01:34:52.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.793+0000 7f43d6ffd640 1 -- 172.21.15.79:0/1215719414 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d00055d0 con 0x7f43e01073a0 2024-08-20T01:34:52.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.793+0000 7f43e7dbe640 1 -- 172.21.15.79:0/1215719414 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43e01a7d70 con 0x7f43e01073a0 2024-08-20T01:34:52.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.794+0000 7f43e7dbe640 1 -- 172.21.15.79:0/1215719414 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43e0101d70 con 0x7f43e01073a0 2024-08-20T01:34:52.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.796+0000 7f43d6ffd640 1 -- 172.21.15.79:0/1215719414 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f43d0009a30 con 0x7f43e01073a0 2024-08-20T01:34:52.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.797+0000 7f43d6ffd640 1 --2- 172.21.15.79:0/1215719414 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f43cc0b3bd0 0x7f43cc0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:52.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.797+0000 7f43e5b5a640 1 --2- 172.21.15.79:0/1215719414 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f43cc0b3bd0 0x7f43cc0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:52.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.797+0000 7f43d6ffd640 1 -- 172.21.15.79:0/1215719414 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7497+0+0 (secure 0 0 0) 0x7f43d00e3aa0 con 0x7f43e01073a0 2024-08-20T01:34:52.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.797+0000 7f43e5b5a640 1 --2- 172.21.15.79:0/1215719414 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f43cc0b3bd0 0x7f43cc0b6090 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f43dc000c00 tx=0x7f43dc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:52.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.800+0000 7f43d6ffd640 1 -- 172.21.15.79:0/1215719414 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f43d00ab420 con 0x7f43e01073a0 2024-08-20T01:34:52.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:52.975+0000 7f43e7dbe640 1 -- 172.21.15.79:0/1215719414 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f43e01a7f70 con 0x7f43e01073a0 2024-08-20T01:34:53.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:53.344+0000 7f43d6ffd640 1 -- 172.21.15.79:0/1215719414 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v70) ==== 170+0+0 (secure 0 0 0) 0x7f43d00aad20 con 0x7f43e01073a0 2024-08-20T01:34:53.346 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2024-08-20T01:34:53.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:53.346+0000 7f43e7dbe640 1 -- 172.21.15.79:0/1215719414 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f43cc0b3bd0 msgr2=0x7f43cc0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:53.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:53.347+0000 7f43e7dbe640 1 --2- 172.21.15.79:0/1215719414 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f43cc0b3bd0 0x7f43cc0b6090 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f43dc000c00 tx=0x7f43dc005a20 comp rx=0 tx=0).stop 2024-08-20T01:34:53.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:53.347+0000 7f43e7dbe640 1 -- 172.21.15.79:0/1215719414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43e01073a0 msgr2=0x7f43e019b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:53.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:53.347+0000 7f43e7dbe640 1 --2- 172.21.15.79:0/1215719414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43e01073a0 0x7f43e019b680 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f43d000d950 tx=0x7f43d000de10 comp rx=0 tx=0).stop 2024-08-20T01:34:53.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:53.347+0000 7f43e7dbe640 1 -- 172.21.15.79:0/1215719414 shutdown_connections 2024-08-20T01:34:53.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:53.347+0000 7f43e7dbe640 1 --2- 172.21.15.79:0/1215719414 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f43cc0b3bd0 0x7f43cc0b6090 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:53.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:53.347+0000 7f43e7dbe640 1 --2- 172.21.15.79:0/1215719414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43e0107d20 0x7f43e01a0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:53.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:53.347+0000 7f43e7dbe640 1 --2- 172.21.15.79:0/1215719414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43e01073a0 0x7f43e019b680 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:53.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:53.347+0000 7f43e7dbe640 1 --2- 172.21.15.79:0/1215719414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43e0101990 0x7f43e019b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:53.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:53.347+0000 7f43e7dbe640 1 -- 172.21.15.79:0/1215719414 >> 172.21.15.79:0/1215719414 conn(0x7f43e00fd400 msgr2=0x7f43e006afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:53.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:53.348+0000 7f43e7dbe640 1 -- 172.21.15.79:0/1215719414 shutdown_connections 2024-08-20T01:34:53.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:53.348+0000 7f43e7dbe640 1 -- 172.21.15.79:0/1215719414 wait complete. 2024-08-20T01:34:53.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:53 smithi175 ceph-mon[22392]: osdmap e69: 12 total, 12 up, 12 in 2024-08-20T01:34:53.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:53 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/1215719414' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-08-20T01:34:53.669 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:53 smithi079 ceph-mon[18656]: osdmap e69: 12 total, 12 up, 12 in 2024-08-20T01:34:53.669 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:53 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/1215719414' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-08-20T01:34:53.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:53 smithi081 ceph-mon[22209]: osdmap e69: 12 total, 12 up, 12 in 2024-08-20T01:34:53.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:53 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/1215719414' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-08-20T01:34:54.185 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-20T01:34:54.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:54 smithi079 ceph-mon[18656]: pgmap v269: 33 pgs: 1 creating+activating, 29 unknown, 3 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:54.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:54 smithi079 ceph-mon[18656]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-20T01:34:54.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:54 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/1215719414' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-20T01:34:54.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:54 smithi079 ceph-mon[18656]: osdmap e70: 12 total, 12 up, 12 in 2024-08-20T01:34:54.444 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:34:54.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:54 smithi175 ceph-mon[22392]: pgmap v269: 33 pgs: 1 creating+activating, 29 unknown, 3 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:54.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:54 smithi175 ceph-mon[22392]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-20T01:34:54.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:54 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/1215719414' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-20T01:34:54.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:54 smithi175 ceph-mon[22392]: osdmap e70: 12 total, 12 up, 12 in 2024-08-20T01:34:54.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:54 smithi081 ceph-mon[22209]: pgmap v269: 33 pgs: 1 creating+activating, 29 unknown, 3 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:54.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:54 smithi081 ceph-mon[22209]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-20T01:34:54.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:54 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/1215719414' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-20T01:34:54.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:54 smithi081 ceph-mon[22209]: osdmap e70: 12 total, 12 up, 12 in 2024-08-20T01:34:54.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:54.913+0000 7f09ffd5b640 1 -- 172.21.15.79:0/3626758907 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09f810ce00 msgr2=0x7f09f810f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:54.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:54.913+0000 7f09ffd5b640 1 --2- 172.21.15.79:0/3626758907 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09f810ce00 0x7f09f810f260 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f09f0009ca0 tx=0x7f09f002a8c0 comp rx=0 tx=0).stop 2024-08-20T01:34:54.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:54.913+0000 7f09ffd5b640 1 -- 172.21.15.79:0/3626758907 shutdown_connections 2024-08-20T01:34:54.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:54.913+0000 7f09ffd5b640 1 --2- 172.21.15.79:0/3626758907 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09f810ce00 0x7f09f810f260 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:54.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:54.913+0000 7f09ffd5b640 1 --2- 172.21.15.79:0/3626758907 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09f81042c0 0x7f09f810c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:54.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:54.913+0000 7f09ffd5b640 1 --2- 172.21.15.79:0/3626758907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09f81039a0 0x7f09f8103d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:54.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:54.913+0000 7f09ffd5b640 1 -- 172.21.15.79:0/3626758907 >> 172.21.15.79:0/3626758907 conn(0x7f09f80fd400 msgr2=0x7f09f80ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:54.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:54.913+0000 7f09ffd5b640 1 -- 172.21.15.79:0/3626758907 shutdown_connections 2024-08-20T01:34:54.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:54.913+0000 7f09ffd5b640 1 -- 172.21.15.79:0/3626758907 wait complete. 2024-08-20T01:34:54.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:54.913+0000 7f09ffd5b640 1 Processor -- start 2024-08-20T01:34:54.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:54.913+0000 7f09ffd5b640 1 -- start start 2024-08-20T01:34:54.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:54.914+0000 7f09ffd5b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09f81039a0 0x7f09f8101650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:54.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:54.914+0000 7f09ffd5b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09f81042c0 0x7f09f8101b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:54.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:54.914+0000 7f09ffd5b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09f810ce00 0x7f09f81020d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:54.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:54.914+0000 7f09ffd5b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f09f81129d0 con 0x7f09f81039a0 2024-08-20T01:34:54.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:54.914+0000 7f09ffd5b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f09f8112850 con 0x7f09f810ce00 2024-08-20T01:34:54.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:54.914+0000 7f09ffd5b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f09f8112b50 con 0x7f09f81042c0 2024-08-20T01:34:54.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:54.914+0000 7f09fdaf7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09f81039a0 0x7f09f8101650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:54.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:54.914+0000 7f09fdaf7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09f81039a0 0x7f09f8101650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52764/0 (socket says 172.21.15.79:52764) 2024-08-20T01:34:54.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:54.914+0000 7f09fdaf7640 1 -- 172.21.15.79:0/2535374144 learned_addr learned my addr 172.21.15.79:0/2535374144 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:34:54.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:54.914+0000 7f09fe2f8640 1 --2- 172.21.15.79:0/2535374144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09f810ce00 0x7f09f81020d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:54.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:54.914+0000 7f09fd2f6640 1 --2- 172.21.15.79:0/2535374144 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09f81042c0 0x7f09f8101b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:54.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:54.914+0000 7f09fdaf7640 1 -- 172.21.15.79:0/2535374144 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09f81042c0 msgr2=0x7f09f8101b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:54.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:54.914+0000 7f09fdaf7640 1 --2- 172.21.15.79:0/2535374144 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09f81042c0 0x7f09f8101b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:54.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:54.914+0000 7f09fdaf7640 1 -- 172.21.15.79:0/2535374144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09f810ce00 msgr2=0x7f09f81020d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:54.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:54.914+0000 7f09fdaf7640 1 --2- 172.21.15.79:0/2535374144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09f810ce00 0x7f09f81020d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:54.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:54.914+0000 7f09fdaf7640 1 -- 172.21.15.79:0/2535374144 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09f81a7260 con 0x7f09f81039a0 2024-08-20T01:34:54.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:54.914+0000 7f09fdaf7640 1 --2- 172.21.15.79:0/2535374144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09f81039a0 0x7f09f8101650 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f09f400c920 tx=0x7f09f400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:54.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:54.914+0000 7f09eeffd640 1 -- 172.21.15.79:0/2535374144 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f4007c70 con 0x7f09f81039a0 2024-08-20T01:34:54.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:54.914+0000 7f09eeffd640 1 -- 172.21.15.79:0/2535374144 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f09f4007e10 con 0x7f09f81039a0 2024-08-20T01:34:54.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:54.914+0000 7f09eeffd640 1 -- 172.21.15.79:0/2535374144 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f4018710 con 0x7f09f81039a0 2024-08-20T01:34:54.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:54.915+0000 7f09ffd5b640 1 -- 172.21.15.79:0/2535374144 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09f81a7550 con 0x7f09f81039a0 2024-08-20T01:34:54.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:54.915+0000 7f09ffd5b640 1 -- 172.21.15.79:0/2535374144 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09f81a7ae0 con 0x7f09f81039a0 2024-08-20T01:34:54.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:54.915+0000 7f09ffd5b640 1 -- 172.21.15.79:0/2535374144 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09f8103d80 con 0x7f09f81039a0 2024-08-20T01:34:54.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:54.917+0000 7f09eeffd640 1 -- 172.21.15.79:0/2535374144 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f09f400f450 con 0x7f09f81039a0 2024-08-20T01:34:54.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:54.917+0000 7f09eeffd640 1 --2- 172.21.15.79:0/2535374144 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f09e40b3c50 0x7f09e40b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:54.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:54.918+0000 7f09fd2f6640 1 --2- 172.21.15.79:0/2535374144 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f09e40b3c50 0x7f09e40b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:54.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:54.918+0000 7f09eeffd640 1 -- 172.21.15.79:0/2535374144 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7879+0+0 (secure 0 0 0) 0x7f09f40e3e70 con 0x7f09f81039a0 2024-08-20T01:34:54.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:54.918+0000 7f09fd2f6640 1 --2- 172.21.15.79:0/2535374144 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f09e40b3c50 0x7f09e40b6110 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f09f8103140 tx=0x7f09e8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:54.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:54.920+0000 7f09eeffd640 1 -- 172.21.15.79:0/2535374144 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f09f4014030 con 0x7f09f81039a0 2024-08-20T01:34:55.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:55.132+0000 7f09ffd5b640 1 -- 172.21.15.79:0/2535374144 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f09f8102950 con 0x7f09f81039a0 2024-08-20T01:34:55.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:55.358+0000 7f09eeffd640 1 -- 172.21.15.79:0/2535374144 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f09f40ab760 con 0x7f09f81039a0 2024-08-20T01:34:55.360 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 2 and data pool 3 2024-08-20T01:34:55.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:55.361+0000 7f09ffd5b640 1 -- 172.21.15.79:0/2535374144 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f09e40b3c50 msgr2=0x7f09e40b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:55.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:55.361+0000 7f09ffd5b640 1 --2- 172.21.15.79:0/2535374144 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f09e40b3c50 0x7f09e40b6110 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f09f8103140 tx=0x7f09e8008040 comp rx=0 tx=0).stop 2024-08-20T01:34:55.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:55.361+0000 7f09ffd5b640 1 -- 172.21.15.79:0/2535374144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09f81039a0 msgr2=0x7f09f8101650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:55.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:55.361+0000 7f09ffd5b640 1 --2- 172.21.15.79:0/2535374144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09f81039a0 0x7f09f8101650 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f09f400c920 tx=0x7f09f400cde0 comp rx=0 tx=0).stop 2024-08-20T01:34:55.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:55.361+0000 7f09ffd5b640 1 -- 172.21.15.79:0/2535374144 shutdown_connections 2024-08-20T01:34:55.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:55.361+0000 7f09ffd5b640 1 --2- 172.21.15.79:0/2535374144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09f810ce00 0x7f09f81020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:55.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:55.361+0000 7f09ffd5b640 1 --2- 172.21.15.79:0/2535374144 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f09e40b3c50 0x7f09e40b6110 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:55.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:55.361+0000 7f09ffd5b640 1 --2- 172.21.15.79:0/2535374144 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09f81042c0 0x7f09f8101b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:55.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:55.361+0000 7f09ffd5b640 1 --2- 172.21.15.79:0/2535374144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09f81039a0 0x7f09f8101650 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:55.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:55.361+0000 7f09ffd5b640 1 -- 172.21.15.79:0/2535374144 >> 172.21.15.79:0/2535374144 conn(0x7f09f80fd400 msgr2=0x7f09f810f070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:55.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:55.361+0000 7f09ffd5b640 1 -- 172.21.15.79:0/2535374144 shutdown_connections 2024-08-20T01:34:55.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:55.361+0000 7f09ffd5b640 1 -- 172.21.15.79:0/2535374144 wait complete. 2024-08-20T01:34:55.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:55 smithi079 ceph-mon[18656]: osdmap e71: 12 total, 12 up, 12 in 2024-08-20T01:34:55.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:55 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2535374144' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-08-20T01:34:55.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:55 smithi079 ceph-mon[18656]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-08-20T01:34:55.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:55 smithi175 ceph-mon[22392]: osdmap e71: 12 total, 12 up, 12 in 2024-08-20T01:34:55.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:55 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2535374144' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-08-20T01:34:55.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:55 smithi175 ceph-mon[22392]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-08-20T01:34:55.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:55 smithi081 ceph-mon[22209]: osdmap e71: 12 total, 12 up, 12 in 2024-08-20T01:34:55.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:55 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2535374144' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-08-20T01:34:55.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:55 smithi081 ceph-mon[22209]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-08-20T01:34:55.966 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-20T01:34:56.209 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:34:56.634 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:56 smithi079 ceph-mon[18656]: pgmap v272: 97 pgs: 9 creating+peering, 1 creating+activating, 66 unknown, 21 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:56.634 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:56 smithi079 ceph-mon[18656]: osdmap e72: 12 total, 12 up, 12 in 2024-08-20T01:34:56.634 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:56 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2535374144' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-20T01:34:56.634 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:56 smithi079 ceph-mon[18656]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-08-20T01:34:56.635 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:56 smithi079 ceph-mon[18656]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-08-20T01:34:56.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:56 smithi175 ceph-mon[22392]: pgmap v272: 97 pgs: 9 creating+peering, 1 creating+activating, 66 unknown, 21 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:56.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:56 smithi175 ceph-mon[22392]: osdmap e72: 12 total, 12 up, 12 in 2024-08-20T01:34:56.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:56 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2535374144' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-20T01:34:56.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:56 smithi175 ceph-mon[22392]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-08-20T01:34:56.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:56 smithi175 ceph-mon[22392]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-08-20T01:34:56.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.711+0000 7f28047b7640 1 -- 172.21.15.79:0/3044356153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27fc107d60 msgr2=0x7f27fc10e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:56.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.711+0000 7f28047b7640 1 --2- 172.21.15.79:0/3044356153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27fc107d60 0x7f27fc10e560 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f27f4009ca0 tx=0x7f27f402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:34:56.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.711+0000 7f28047b7640 1 -- 172.21.15.79:0/3044356153 shutdown_connections 2024-08-20T01:34:56.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.711+0000 7f28047b7640 1 --2- 172.21.15.79:0/3044356153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27fc107d60 0x7f27fc10e560 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:56.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.711+0000 7f28047b7640 1 --2- 172.21.15.79:0/3044356153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27fc1073e0 0x7f27fc107820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:56.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.711+0000 7f28047b7640 1 --2- 172.21.15.79:0/3044356153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27fc1019d0 0x7f27fc101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:56.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.711+0000 7f28047b7640 1 -- 172.21.15.79:0/3044356153 >> 172.21.15.79:0/3044356153 conn(0x7f27fc0fd440 msgr2=0x7f27fc0ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:56.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.712+0000 7f28047b7640 1 -- 172.21.15.79:0/3044356153 shutdown_connections 2024-08-20T01:34:56.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.712+0000 7f28047b7640 1 -- 172.21.15.79:0/3044356153 wait complete. 2024-08-20T01:34:56.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.712+0000 7f28047b7640 1 Processor -- start 2024-08-20T01:34:56.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.712+0000 7f28047b7640 1 -- start start 2024-08-20T01:34:56.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.713+0000 7f28047b7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27fc1019d0 0x7f27fc199d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:56.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.713+0000 7f28047b7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27fc1073e0 0x7f27fc19a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:56.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.713+0000 7f28047b7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27fc107d60 0x7f27fc19a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:56.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.713+0000 7f28047b7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f27fc111960 con 0x7f27fc1073e0 2024-08-20T01:34:56.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.713+0000 7f28047b7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f27fc1117e0 con 0x7f27fc1019d0 2024-08-20T01:34:56.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.713+0000 7f28047b7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f27fc111ae0 con 0x7f27fc107d60 2024-08-20T01:34:56.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.713+0000 7f2801d52640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27fc1073e0 0x7f27fc19a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:56.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.713+0000 7f2801d52640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27fc1073e0 0x7f27fc19a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52794/0 (socket says 172.21.15.79:52794) 2024-08-20T01:34:56.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.713+0000 7f2801d52640 1 -- 172.21.15.79:0/2905086303 learned_addr learned my addr 172.21.15.79:0/2905086303 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:34:56.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.713+0000 7f2801d52640 1 -- 172.21.15.79:0/2905086303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27fc107d60 msgr2=0x7f27fc19a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:56.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.713+0000 7f2801d52640 1 --2- 172.21.15.79:0/2905086303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27fc107d60 0x7f27fc19a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:56.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.713+0000 7f2801d52640 1 -- 172.21.15.79:0/2905086303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27fc1019d0 msgr2=0x7f27fc199d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:56.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.713+0000 7f2801d52640 1 --2- 172.21.15.79:0/2905086303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27fc1019d0 0x7f27fc199d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:56.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.713+0000 7f2801d52640 1 -- 172.21.15.79:0/2905086303 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27fc1a5110 con 0x7f27fc1073e0 2024-08-20T01:34:56.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.713+0000 7f2801d52640 1 --2- 172.21.15.79:0/2905086303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27fc1073e0 0x7f27fc19a250 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f27ec00b4a0 tx=0x7f27ec00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:56.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.713+0000 7f27f37fe640 1 -- 172.21.15.79:0/2905086303 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27ec014070 con 0x7f27fc1073e0 2024-08-20T01:34:56.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.713+0000 7f27f37fe640 1 -- 172.21.15.79:0/2905086303 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f27ec010aa0 con 0x7f27fc1073e0 2024-08-20T01:34:56.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.713+0000 7f27f37fe640 1 -- 172.21.15.79:0/2905086303 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27ec017b70 con 0x7f27fc1073e0 2024-08-20T01:34:56.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.713+0000 7f28047b7640 1 -- 172.21.15.79:0/2905086303 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27fc1a5400 con 0x7f27fc1073e0 2024-08-20T01:34:56.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.713+0000 7f28047b7640 1 -- 172.21.15.79:0/2905086303 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27fc1a5a10 con 0x7f27fc1073e0 2024-08-20T01:34:56.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.714+0000 7f28047b7640 1 -- 172.21.15.79:0/2905086303 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27fc101db0 con 0x7f27fc1073e0 2024-08-20T01:34:56.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.716+0000 7f27f37fe640 1 -- 172.21.15.79:0/2905086303 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f27ec017070 con 0x7f27fc1073e0 2024-08-20T01:34:56.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.717+0000 7f27f37fe640 1 --2- 172.21.15.79:0/2905086303 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f27e80b3c50 0x7f27e80b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:56.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.717+0000 7f2802553640 1 --2- 172.21.15.79:0/2905086303 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f27e80b3c50 0x7f27e80b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:56.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.718+0000 7f27f37fe640 1 -- 172.21.15.79:0/2905086303 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7f27ec0e3230 con 0x7f27fc1073e0 2024-08-20T01:34:56.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.718+0000 7f2802553640 1 --2- 172.21.15.79:0/2905086303 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f27e80b3c50 0x7f27e80b6110 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f27f8009710 tx=0x7f27f8006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:56.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.720+0000 7f27f37fe640 1 -- 172.21.15.79:0/2905086303 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f27ec0aa9d0 con 0x7f27fc1073e0 2024-08-20T01:34:56.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:56 smithi081 ceph-mon[22209]: pgmap v272: 97 pgs: 9 creating+peering, 1 creating+activating, 66 unknown, 21 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:56.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:56 smithi081 ceph-mon[22209]: osdmap e72: 12 total, 12 up, 12 in 2024-08-20T01:34:56.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:56 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2535374144' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-20T01:34:56.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:56 smithi081 ceph-mon[22209]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-08-20T01:34:56.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:56 smithi081 ceph-mon[22209]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-08-20T01:34:56.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.894+0000 7f28047b7640 1 -- 172.21.15.79:0/2905086303 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f27fc06b5c0 con 0x7f27fc1073e0 2024-08-20T01:34:56.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.896+0000 7f27f37fe640 1 -- 172.21.15.79:0/2905086303 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+22243 (secure 0 0 0) 0x7f27fc06b5c0 con 0x7f27fc1073e0 2024-08-20T01:34:56.897 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:34:56.898 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":72,"fsid":"28484e9a-5e93-11ef-bccf-c7b262605968","created":"2024-08-20T01:27:07.792689+0000","modified":"2024-08-20T01:34:55.133612+0000","last_up_change":"2024-08-20T01:34:05.838937+0000","last_in_change":"2024-08-20T01:33:43.645153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-20T01:30:30.693903+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-20T01:34:50.585939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-20T01:34:52.980599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ccdbeb3d-bb9d-4275-ad7e-49f2cc1222cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6803","nonce":1274927648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6805","nonce":1274927648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6809","nonce":1274927648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6807","nonce":1274927648}]},"public_addr":"172.21.15.79:6803/1274927648","cluster_addr":"172.21.15.79:6805/1274927648","heartbeat_back_addr":"172.21.15.79:6809/1274927648","heartbeat_front_addr":"172.21.15.79:6807/1274927648","state":["exists","up"]},{"osd":1,"uuid":"0906bc46-f89d-482d-9402-43d17e4246a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6801","nonce":1174012328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6803","nonce":1174012328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6807","nonce":1174012328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6805","nonce":1174012328}]},"public_addr":"172.21.15.81:6801/1174012328","cluster_addr":"172.21.15.81:6803/1174012328","heartbeat_back_addr":"172.21.15.81:6807/1174012328","heartbeat_front_addr":"172.21.15.81:6805/1174012328","state":["exists","up"]},{"osd":2,"uuid":"11d8fb9d-cb2c-41c8-994c-603a1d8e01a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6801","nonce":1132306232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6803","nonce":1132306232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6807","nonce":1132306232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6805","nonce":1132306232}]},"public_addr":"172.21.15.175:6801/1132306232","cluster_addr":"172.21.15.175:6803/1132306232","heartbeat_back_addr":"172.21.15.175:6807/1132306232","heartbeat_front_addr":"172.21.15.175:6805/1132306232","state":["exists","up"]},{"osd":3,"uuid":"29e35242-957f-404b-b99e-d4dd0045c35d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6811","nonce":1364181822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6813","nonce":1364181822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6817","nonce":1364181822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6815","nonce":1364181822}]},"public_addr":"172.21.15.79:6811/1364181822","cluster_addr":"172.21.15.79:6813/1364181822","heartbeat_back_addr":"172.21.15.79:6817/1364181822","heartbeat_front_addr":"172.21.15.79:6815/1364181822","state":["exists","up"]},{"osd":4,"uuid":"9139c469-270f-4465-8adb-1e748529fa68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6809","nonce":306873968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6811","nonce":306873968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6815","nonce":306873968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6813","nonce":306873968}]},"public_addr":"172.21.15.81:6809/306873968","cluster_addr":"172.21.15.81:6811/306873968","heartbeat_back_addr":"172.21.15.81:6815/306873968","heartbeat_front_addr":"172.21.15.81:6813/306873968","state":["exists","up"]},{"osd":5,"uuid":"6394e462-4510-45d6-bc99-8660085cb206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6809","nonce":3908133424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6811","nonce":3908133424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6815","nonce":3908133424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6813","nonce":3908133424}]},"public_addr":"172.21.15.175:6809/3908133424","cluster_addr":"172.21.15.175:6811/3908133424","heartbeat_back_addr":"172.21.15.175:6815/3908133424","heartbeat_front_addr":"172.21.15.175:6813/3908133424","state":["exists","up"]},{"osd":6,"uuid":"e8e51380-e2be-4c4c-82d8-d86306d9fc1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6819","nonce":3379368280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6821","nonce":3379368280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6825","nonce":3379368280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6823","nonce":3379368280}]},"public_addr":"172.21.15.79:6819/3379368280","cluster_addr":"172.21.15.79:6821/3379368280","heartbeat_back_addr":"172.21.15.79:6825/3379368280","heartbeat_front_addr":"172.21.15.79:6823/3379368280","state":["exists","up"]},{"osd":7,"uuid":"875f7876-a2ca-4254-a8cc-27eebb11cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6817","nonce":747356685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6819","nonce":747356685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6823","nonce":747356685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6821","nonce":747356685}]},"public_addr":"172.21.15.81:6817/747356685","cluster_addr":"172.21.15.81:6819/747356685","heartbeat_back_addr":"172.21.15.81:6823/747356685","heartbeat_front_addr":"172.21.15.81:6821/747356685","state":["exists","up"]},{"osd":8,"uuid":"d714a33b-8df5-411d-bc99-b33b4b27cc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6817","nonce":1537762925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6819","nonce":1537762925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6823","nonce":1537762925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6821","nonce":1537762925}]},"public_addr":"172.21.15.175:6817/1537762925","cluster_addr":"172.21.15.175:6819/1537762925","heartbeat_back_addr":"172.21.15.175:6823/1537762925","heartbeat_front_addr":"172.21.15.175:6821/1537762925","state":["exists","up"]},{"osd":9,"uuid":"82db8305-1d72-4bef-99d6-5486e4de5b03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6827","nonce":2400574113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6829","nonce":2400574113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6833","nonce":2400574113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6831","nonce":2400574113}]},"public_addr":"172.21.15.79:6827/2400574113","cluster_addr":"172.21.15.79:6829/2400574113","heartbeat_back_addr":"172.21.15.79:6833/2400574113","heartbeat_front_addr":"172.21.15.79:6831/2400574113","state":["exists","up"]},{"osd":10,"uuid":"797e1e3f-12b5-4958-9e1f-f796cffaaf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6825","nonce":4188407500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6827","nonce":4188407500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6831","nonce":4188407500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6829","nonce":4188407500}]},"public_addr":"172.21.15.81:6825/4188407500","cluster_addr":"172.21.15.81:6827/4188407500","heartbeat_back_addr":"172.21.15.81:6831/4188407500","heartbeat_front_addr":"172.21.15.81:6829/4188407500","state":["exists","up"]},{"osd":11,"uuid":"a4d218ae-5a41-4b34-9c4e-e795c4a6a16d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6825","nonce":451069549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6827","nonce":451069549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6831","nonce":451069549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6829","nonce":451069549}]},"public_addr":"172.21.15.175:6825/451069549","cluster_addr":"172.21.15.175:6827/451069549","heartbeat_back_addr":"172.21.15.175:6831/451069549","heartbeat_front_addr":"172.21.15.175:6829/451069549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:29:42.003425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:30:05.353547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:30:28.916727+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:30:52.845671+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:31:16.926826+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:31:39.840986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:32:04.013287+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:32:28.237482+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:32:51.270643+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:33:15.825156+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:33:40.037915+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:34:04.477377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:0/1750500064":"2024-08-21T01:27:52.389553+0000","172.21.15.79:0/103962305":"2024-08-21T01:27:52.389553+0000","172.21.15.79:6800/4045769179":"2024-08-21T01:27:29.643647+0000","172.21.15.79:0/525482354":"2024-08-21T01:27:52.389553+0000","172.21.15.79:6801/4045769179":"2024-08-21T01:27:29.643647+0000","172.21.15.79:0/1023212241":"2024-08-21T01:27:29.643647+0000","172.21.15.79:0/2368377219":"2024-08-21T01:27:29.643647+0000","172.21.15.79:6801/3302536522":"2024-08-21T01:27:52.389553+0000","172.21.15.79:6800/3302536522":"2024-08-21T01:27:52.389553+0000","172.21.15.79:0/3498829332":"2024-08-21T01:27:29.643647+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-20T01:34:56.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.898+0000 7f28047b7640 1 -- 172.21.15.79:0/2905086303 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f27e80b3c50 msgr2=0x7f27e80b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:56.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.898+0000 7f28047b7640 1 --2- 172.21.15.79:0/2905086303 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f27e80b3c50 0x7f27e80b6110 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f27f8009710 tx=0x7f27f8006c90 comp rx=0 tx=0).stop 2024-08-20T01:34:56.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.898+0000 7f28047b7640 1 -- 172.21.15.79:0/2905086303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27fc1073e0 msgr2=0x7f27fc19a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:56.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.898+0000 7f28047b7640 1 --2- 172.21.15.79:0/2905086303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27fc1073e0 0x7f27fc19a250 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f27ec00b4a0 tx=0x7f27ec00b960 comp rx=0 tx=0).stop 2024-08-20T01:34:56.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.898+0000 7f28047b7640 1 -- 172.21.15.79:0/2905086303 shutdown_connections 2024-08-20T01:34:56.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.898+0000 7f28047b7640 1 --2- 172.21.15.79:0/2905086303 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f27e80b3c50 0x7f27e80b6110 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:56.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.898+0000 7f28047b7640 1 --2- 172.21.15.79:0/2905086303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27fc107d60 0x7f27fc19a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:56.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.898+0000 7f28047b7640 1 --2- 172.21.15.79:0/2905086303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27fc1073e0 0x7f27fc19a250 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:56.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.898+0000 7f28047b7640 1 --2- 172.21.15.79:0/2905086303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27fc1019d0 0x7f27fc199d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:56.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.898+0000 7f28047b7640 1 -- 172.21.15.79:0/2905086303 >> 172.21.15.79:0/2905086303 conn(0x7f27fc0fd440 msgr2=0x7f27fc0ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:56.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.898+0000 7f28047b7640 1 -- 172.21.15.79:0/2905086303 shutdown_connections 2024-08-20T01:34:56.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:56.898+0000 7f28047b7640 1 -- 172.21.15.79:0/2905086303 wait complete. 2024-08-20T01:34:57.597 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:57 smithi079 ceph-mon[18656]: mds.? [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] up:active 2024-08-20T01:34:57.597 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:57 smithi079 ceph-mon[18656]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-20T01:34:57.597 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:57 smithi079 ceph-mon[18656]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-20T01:34:57.597 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:57 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2905086303' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:34:57.627 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-20T01:34:57.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:57 smithi175 ceph-mon[22392]: mds.? [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] up:active 2024-08-20T01:34:57.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:57 smithi175 ceph-mon[22392]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-20T01:34:57.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:57 smithi175 ceph-mon[22392]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-20T01:34:57.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:57 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2905086303' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:34:57.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:57 smithi081 ceph-mon[22209]: mds.? [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] up:active 2024-08-20T01:34:57.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:57 smithi081 ceph-mon[22209]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-20T01:34:57.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:57 smithi081 ceph-mon[22209]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-20T01:34:57.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:57 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2905086303' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:34:57.871 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:34:58.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.328+0000 7f6794d41640 1 -- 172.21.15.79:0/891691302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67901073a0 msgr2=0x7f67901077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:58.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.328+0000 7f6794d41640 1 --2- 172.21.15.79:0/891691302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67901073a0 0x7f67901077e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6784009900 tx=0x7f678402a410 comp rx=0 tx=0).stop 2024-08-20T01:34:58.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.328+0000 7f6794d41640 1 -- 172.21.15.79:0/891691302 shutdown_connections 2024-08-20T01:34:58.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.328+0000 7f6794d41640 1 --2- 172.21.15.79:0/891691302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6790107d20 0x7f679010e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:58.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.328+0000 7f6794d41640 1 --2- 172.21.15.79:0/891691302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67901073a0 0x7f67901077e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:58.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.328+0000 7f6794d41640 1 --2- 172.21.15.79:0/891691302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6790101990 0x7f6790101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:58.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.328+0000 7f6794d41640 1 -- 172.21.15.79:0/891691302 >> 172.21.15.79:0/891691302 conn(0x7f67900fd400 msgr2=0x7f67900ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:58.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.328+0000 7f6794d41640 1 -- 172.21.15.79:0/891691302 shutdown_connections 2024-08-20T01:34:58.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.328+0000 7f6794d41640 1 -- 172.21.15.79:0/891691302 wait complete. 2024-08-20T01:34:58.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.329+0000 7f6794d41640 1 Processor -- start 2024-08-20T01:34:58.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.329+0000 7f6794d41640 1 -- start start 2024-08-20T01:34:58.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.329+0000 7f6794d41640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6790101990 0x7f67900fd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:58.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.329+0000 7f6794d41640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67901073a0 0x7f67900fde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:58.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.329+0000 7f6794d41640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6790107d20 0x7f67900fe380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:58.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.329+0000 7f6794d41640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f67901118e0 con 0x7f6790107d20 2024-08-20T01:34:58.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.329+0000 7f6794d41640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6790111760 con 0x7f67901073a0 2024-08-20T01:34:58.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.329+0000 7f6794d41640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6790111a60 con 0x7f6790101990 2024-08-20T01:34:58.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.329+0000 7f678ed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6790107d20 0x7f67900fe380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:58.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.329+0000 7f678ed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6790107d20 0x7f67900fe380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52818/0 (socket says 172.21.15.79:52818) 2024-08-20T01:34:58.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.329+0000 7f678ed9d640 1 -- 172.21.15.79:0/2078214773 learned_addr learned my addr 172.21.15.79:0/2078214773 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:34:58.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.329+0000 7f678ed9d640 1 -- 172.21.15.79:0/2078214773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6790101990 msgr2=0x7f67900fd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:58.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.329+0000 7f678e59c640 1 --2- 172.21.15.79:0/2078214773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6790101990 0x7f67900fd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:58.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.329+0000 7f678ed9d640 1 --2- 172.21.15.79:0/2078214773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6790101990 0x7f67900fd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:58.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.329+0000 7f678ed9d640 1 -- 172.21.15.79:0/2078214773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67901073a0 msgr2=0x7f67900fde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:58.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.329+0000 7f678ed9d640 1 --2- 172.21.15.79:0/2078214773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67901073a0 0x7f67900fde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:58.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.329+0000 7f678ed9d640 1 -- 172.21.15.79:0/2078214773 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67901a7390 con 0x7f6790107d20 2024-08-20T01:34:58.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.329+0000 7f678e59c640 1 --2- 172.21.15.79:0/2078214773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6790101990 0x7f67900fd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:34:58.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.330+0000 7f678ed9d640 1 --2- 172.21.15.79:0/2078214773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6790107d20 0x7f67900fe380 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f678800eb10 tx=0x7f678800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:58.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.330+0000 7f677f7fe640 1 -- 172.21.15.79:0/2078214773 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6788004b20 con 0x7f6790107d20 2024-08-20T01:34:58.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.330+0000 7f677f7fe640 1 -- 172.21.15.79:0/2078214773 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6788004cc0 con 0x7f6790107d20 2024-08-20T01:34:58.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.330+0000 7f677f7fe640 1 -- 172.21.15.79:0/2078214773 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6788010690 con 0x7f6790107d20 2024-08-20T01:34:58.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.330+0000 7f6794d41640 1 -- 172.21.15.79:0/2078214773 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67901a7680 con 0x7f6790107d20 2024-08-20T01:34:58.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.330+0000 7f6794d41640 1 -- 172.21.15.79:0/2078214773 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67901a7c40 con 0x7f6790107d20 2024-08-20T01:34:58.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.331+0000 7f6794d41640 1 -- 172.21.15.79:0/2078214773 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6790101d70 con 0x7f6790107d20 2024-08-20T01:34:58.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.332+0000 7f677f7fe640 1 -- 172.21.15.79:0/2078214773 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f6788005000 con 0x7f6790107d20 2024-08-20T01:34:58.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.333+0000 7f677f7fe640 1 --2- 172.21.15.79:0/2078214773 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f67780b3c50 0x7f67780b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:58.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.333+0000 7f678e59c640 1 --2- 172.21.15.79:0/2078214773 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f67780b3c50 0x7f67780b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:58.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.333+0000 7f677f7fe640 1 -- 172.21.15.79:0/2078214773 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7f67880e4330 con 0x7f6790107d20 2024-08-20T01:34:58.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.333+0000 7f678e59c640 1 --2- 172.21.15.79:0/2078214773 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f67780b3c50 0x7f67780b6110 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6780006fd0 tx=0x7f6780008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:58.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.336+0000 7f677f7fe640 1 -- 172.21.15.79:0/2078214773 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f6788055e20 con 0x7f6790107d20 2024-08-20T01:34:58.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.513+0000 7f6794d41640 1 -- 172.21.15.79:0/2078214773 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f67901a80a0 con 0x7f6790107d20 2024-08-20T01:34:58.515 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:58 smithi079 ceph-mon[18656]: pgmap v274: 97 pgs: 9 creating+peering, 1 creating+activating, 25 unknown, 62 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:58.515 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:58 smithi079 ceph-mon[18656]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-20T01:34:58.515 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:58 smithi079 ceph-mon[18656]: Cluster is now healthy 2024-08-20T01:34:58.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.514+0000 7f677f7fe640 1 -- 172.21.15.79:0/2078214773 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+22243 (secure 0 0 0) 0x7f67880abad0 con 0x7f6790107d20 2024-08-20T01:34:58.516 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:34:58.516 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":72,"fsid":"28484e9a-5e93-11ef-bccf-c7b262605968","created":"2024-08-20T01:27:07.792689+0000","modified":"2024-08-20T01:34:55.133612+0000","last_up_change":"2024-08-20T01:34:05.838937+0000","last_in_change":"2024-08-20T01:33:43.645153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-20T01:30:30.693903+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-20T01:34:50.585939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-20T01:34:52.980599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ccdbeb3d-bb9d-4275-ad7e-49f2cc1222cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6803","nonce":1274927648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6805","nonce":1274927648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6809","nonce":1274927648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6807","nonce":1274927648}]},"public_addr":"172.21.15.79:6803/1274927648","cluster_addr":"172.21.15.79:6805/1274927648","heartbeat_back_addr":"172.21.15.79:6809/1274927648","heartbeat_front_addr":"172.21.15.79:6807/1274927648","state":["exists","up"]},{"osd":1,"uuid":"0906bc46-f89d-482d-9402-43d17e4246a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6801","nonce":1174012328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6803","nonce":1174012328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6807","nonce":1174012328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6805","nonce":1174012328}]},"public_addr":"172.21.15.81:6801/1174012328","cluster_addr":"172.21.15.81:6803/1174012328","heartbeat_back_addr":"172.21.15.81:6807/1174012328","heartbeat_front_addr":"172.21.15.81:6805/1174012328","state":["exists","up"]},{"osd":2,"uuid":"11d8fb9d-cb2c-41c8-994c-603a1d8e01a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6801","nonce":1132306232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6803","nonce":1132306232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6807","nonce":1132306232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6805","nonce":1132306232}]},"public_addr":"172.21.15.175:6801/1132306232","cluster_addr":"172.21.15.175:6803/1132306232","heartbeat_back_addr":"172.21.15.175:6807/1132306232","heartbeat_front_addr":"172.21.15.175:6805/1132306232","state":["exists","up"]},{"osd":3,"uuid":"29e35242-957f-404b-b99e-d4dd0045c35d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6811","nonce":1364181822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6813","nonce":1364181822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6817","nonce":1364181822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6815","nonce":1364181822}]},"public_addr":"172.21.15.79:6811/1364181822","cluster_addr":"172.21.15.79:6813/1364181822","heartbeat_back_addr":"172.21.15.79:6817/1364181822","heartbeat_front_addr":"172.21.15.79:6815/1364181822","state":["exists","up"]},{"osd":4,"uuid":"9139c469-270f-4465-8adb-1e748529fa68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6809","nonce":306873968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6811","nonce":306873968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6815","nonce":306873968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6813","nonce":306873968}]},"public_addr":"172.21.15.81:6809/306873968","cluster_addr":"172.21.15.81:6811/306873968","heartbeat_back_addr":"172.21.15.81:6815/306873968","heartbeat_front_addr":"172.21.15.81:6813/306873968","state":["exists","up"]},{"osd":5,"uuid":"6394e462-4510-45d6-bc99-8660085cb206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6809","nonce":3908133424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6811","nonce":3908133424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6815","nonce":3908133424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6813","nonce":3908133424}]},"public_addr":"172.21.15.175:6809/3908133424","cluster_addr":"172.21.15.175:6811/3908133424","heartbeat_back_addr":"172.21.15.175:6815/3908133424","heartbeat_front_addr":"172.21.15.175:6813/3908133424","state":["exists","up"]},{"osd":6,"uuid":"e8e51380-e2be-4c4c-82d8-d86306d9fc1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6819","nonce":3379368280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6821","nonce":3379368280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6825","nonce":3379368280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6823","nonce":3379368280}]},"public_addr":"172.21.15.79:6819/3379368280","cluster_addr":"172.21.15.79:6821/3379368280","heartbeat_back_addr":"172.21.15.79:6825/3379368280","heartbeat_front_addr":"172.21.15.79:6823/3379368280","state":["exists","up"]},{"osd":7,"uuid":"875f7876-a2ca-4254-a8cc-27eebb11cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6817","nonce":747356685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6819","nonce":747356685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6823","nonce":747356685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6821","nonce":747356685}]},"public_addr":"172.21.15.81:6817/747356685","cluster_addr":"172.21.15.81:6819/747356685","heartbeat_back_addr":"172.21.15.81:6823/747356685","heartbeat_front_addr":"172.21.15.81:6821/747356685","state":["exists","up"]},{"osd":8,"uuid":"d714a33b-8df5-411d-bc99-b33b4b27cc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6817","nonce":1537762925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6819","nonce":1537762925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6823","nonce":1537762925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6821","nonce":1537762925}]},"public_addr":"172.21.15.175:6817/1537762925","cluster_addr":"172.21.15.175:6819/1537762925","heartbeat_back_addr":"172.21.15.175:6823/1537762925","heartbeat_front_addr":"172.21.15.175:6821/1537762925","state":["exists","up"]},{"osd":9,"uuid":"82db8305-1d72-4bef-99d6-5486e4de5b03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6827","nonce":2400574113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6829","nonce":2400574113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6833","nonce":2400574113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6831","nonce":2400574113}]},"public_addr":"172.21.15.79:6827/2400574113","cluster_addr":"172.21.15.79:6829/2400574113","heartbeat_back_addr":"172.21.15.79:6833/2400574113","heartbeat_front_addr":"172.21.15.79:6831/2400574113","state":["exists","up"]},{"osd":10,"uuid":"797e1e3f-12b5-4958-9e1f-f796cffaaf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6825","nonce":4188407500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6827","nonce":4188407500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6831","nonce":4188407500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6829","nonce":4188407500}]},"public_addr":"172.21.15.81:6825/4188407500","cluster_addr":"172.21.15.81:6827/4188407500","heartbeat_back_addr":"172.21.15.81:6831/4188407500","heartbeat_front_addr":"172.21.15.81:6829/4188407500","state":["exists","up"]},{"osd":11,"uuid":"a4d218ae-5a41-4b34-9c4e-e795c4a6a16d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6825","nonce":451069549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6827","nonce":451069549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6831","nonce":451069549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6829","nonce":451069549}]},"public_addr":"172.21.15.175:6825/451069549","cluster_addr":"172.21.15.175:6827/451069549","heartbeat_back_addr":"172.21.15.175:6831/451069549","heartbeat_front_addr":"172.21.15.175:6829/451069549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:29:42.003425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:30:05.353547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:30:28.916727+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:30:52.845671+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:31:16.926826+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:31:39.840986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:32:04.013287+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:32:28.237482+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:32:51.270643+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:33:15.825156+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:33:40.037915+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:34:04.477377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:0/1750500064":"2024-08-21T01:27:52.389553+0000","172.21.15.79:0/103962305":"2024-08-21T01:27:52.389553+0000","172.21.15.79:6800/4045769179":"2024-08-21T01:27:29.643647+0000","172.21.15.79:0/525482354":"2024-08-21T01:27:52.389553+0000","172.21.15.79:6801/4045769179":"2024-08-21T01:27:29.643647+0000","172.21.15.79:0/1023212241":"2024-08-21T01:27:29.643647+0000","172.21.15.79:0/2368377219":"2024-08-21T01:27:29.643647+0000","172.21.15.79:6801/3302536522":"2024-08-21T01:27:52.389553+0000","172.21.15.79:6800/3302536522":"2024-08-21T01:27:52.389553+0000","172.21.15.79:0/3498829332":"2024-08-21T01:27:29.643647+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-20T01:34:58.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.517+0000 7f6794d41640 1 -- 172.21.15.79:0/2078214773 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f67780b3c50 msgr2=0x7f67780b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:58.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.517+0000 7f6794d41640 1 --2- 172.21.15.79:0/2078214773 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f67780b3c50 0x7f67780b6110 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6780006fd0 tx=0x7f6780008040 comp rx=0 tx=0).stop 2024-08-20T01:34:58.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.517+0000 7f6794d41640 1 -- 172.21.15.79:0/2078214773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6790107d20 msgr2=0x7f67900fe380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:58.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.517+0000 7f6794d41640 1 --2- 172.21.15.79:0/2078214773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6790107d20 0x7f67900fe380 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f678800eb10 tx=0x7f678800c2d0 comp rx=0 tx=0).stop 2024-08-20T01:34:58.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.517+0000 7f6794d41640 1 -- 172.21.15.79:0/2078214773 shutdown_connections 2024-08-20T01:34:58.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.517+0000 7f6794d41640 1 --2- 172.21.15.79:0/2078214773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6790107d20 0x7f67900fe380 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:58.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.517+0000 7f6794d41640 1 --2- 172.21.15.79:0/2078214773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67901073a0 0x7f67900fde40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:58.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.517+0000 7f6794d41640 1 --2- 172.21.15.79:0/2078214773 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f67780b3c50 0x7f67780b6110 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:58.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.517+0000 7f6794d41640 1 --2- 172.21.15.79:0/2078214773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6790101990 0x7f67900fd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:58.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.517+0000 7f6794d41640 1 -- 172.21.15.79:0/2078214773 >> 172.21.15.79:0/2078214773 conn(0x7f67900fd400 msgr2=0x7f679006aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:58.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.517+0000 7f6794d41640 1 -- 172.21.15.79:0/2078214773 shutdown_connections 2024-08-20T01:34:58.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:58.517+0000 7f6794d41640 1 -- 172.21.15.79:0/2078214773 wait complete. 2024-08-20T01:34:58.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:58 smithi175 ceph-mon[22392]: pgmap v274: 97 pgs: 9 creating+peering, 1 creating+activating, 25 unknown, 62 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:58.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:58 smithi175 ceph-mon[22392]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-20T01:34:58.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:58 smithi175 ceph-mon[22392]: Cluster is now healthy 2024-08-20T01:34:58.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:58 smithi081 ceph-mon[22209]: pgmap v274: 97 pgs: 9 creating+peering, 1 creating+activating, 25 unknown, 62 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:34:58.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:58 smithi081 ceph-mon[22209]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-20T01:34:58.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:58 smithi081 ceph-mon[22209]: Cluster is now healthy 2024-08-20T01:34:59.242 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-08-20T01:34:59.488 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:34:59.632 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:34:59 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2078214773' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:34:59.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:34:59 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2078214773' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:34:59.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:34:59 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2078214773' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:34:59.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:59.957+0000 7f81dbdf7640 1 -- 172.21.15.79:0/3400812800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81d41019d0 msgr2=0x7f81d4101db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:59.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:59.957+0000 7f81dbdf7640 1 --2- 172.21.15.79:0/3400812800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81d41019d0 0x7f81d4101db0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f81d0009900 tx=0x7f81d002a410 comp rx=0 tx=0).stop 2024-08-20T01:34:59.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:59.957+0000 7f81dbdf7640 1 -- 172.21.15.79:0/3400812800 shutdown_connections 2024-08-20T01:34:59.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:59.957+0000 7f81dbdf7640 1 --2- 172.21.15.79:0/3400812800 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81d4107d60 0x7f81d410e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:59.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:59.957+0000 7f81dbdf7640 1 --2- 172.21.15.79:0/3400812800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81d41073e0 0x7f81d4107820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:59.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:59.957+0000 7f81dbdf7640 1 --2- 172.21.15.79:0/3400812800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81d41019d0 0x7f81d4101db0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:59.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:59.957+0000 7f81dbdf7640 1 -- 172.21.15.79:0/3400812800 >> 172.21.15.79:0/3400812800 conn(0x7f81d40fd440 msgr2=0x7f81d40ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:34:59.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:59.957+0000 7f81dbdf7640 1 -- 172.21.15.79:0/3400812800 shutdown_connections 2024-08-20T01:34:59.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:59.957+0000 7f81dbdf7640 1 -- 172.21.15.79:0/3400812800 wait complete. 2024-08-20T01:34:59.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:59.958+0000 7f81dbdf7640 1 Processor -- start 2024-08-20T01:34:59.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:59.958+0000 7f81dbdf7640 1 -- start start 2024-08-20T01:34:59.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:59.958+0000 7f81dbdf7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81d41019d0 0x7f81d4199c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:59.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:59.958+0000 7f81dbdf7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81d41073e0 0x7f81d419a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:59.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:59.958+0000 7f81dbdf7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81d4107d60 0x7f81d419a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:59.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:59.958+0000 7f81dbdf7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f81d4111890 con 0x7f81d41019d0 2024-08-20T01:34:59.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:59.958+0000 7f81dbdf7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f81d4111710 con 0x7f81d4107d60 2024-08-20T01:34:59.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:59.958+0000 7f81dbdf7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f81d4111a10 con 0x7f81d41073e0 2024-08-20T01:34:59.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:59.958+0000 7f81d9b93640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81d41019d0 0x7f81d4199c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:59.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:59.958+0000 7f81d9b93640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81d41019d0 0x7f81d4199c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52830/0 (socket says 172.21.15.79:52830) 2024-08-20T01:34:59.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:59.958+0000 7f81d9b93640 1 -- 172.21.15.79:0/2008672814 learned_addr learned my addr 172.21.15.79:0/2008672814 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:34:59.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:59.958+0000 7f81da394640 1 --2- 172.21.15.79:0/2008672814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81d4107d60 0x7f81d419a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:59.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:59.958+0000 7f81d9b93640 1 -- 172.21.15.79:0/2008672814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81d41073e0 msgr2=0x7f81d419a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:59.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:59.958+0000 7f81d9b93640 1 --2- 172.21.15.79:0/2008672814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81d41073e0 0x7f81d419a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:59.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:59.958+0000 7f81d9b93640 1 -- 172.21.15.79:0/2008672814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81d4107d60 msgr2=0x7f81d419a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:34:59.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:59.958+0000 7f81d9b93640 1 --2- 172.21.15.79:0/2008672814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81d4107d60 0x7f81d419a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:34:59.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:59.958+0000 7f81d9b93640 1 -- 172.21.15.79:0/2008672814 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81d41a5040 con 0x7f81d41019d0 2024-08-20T01:34:59.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:59.958+0000 7f81da394640 1 --2- 172.21.15.79:0/2008672814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81d4107d60 0x7f81d419a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:34:59.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:59.958+0000 7f81d9b93640 1 --2- 172.21.15.79:0/2008672814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81d41019d0 0x7f81d4199c60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f81d0009230 tx=0x7f81d0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:59.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:59.959+0000 7f81caffd640 1 -- 172.21.15.79:0/2008672814 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d003f030 con 0x7f81d41019d0 2024-08-20T01:34:59.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:59.959+0000 7f81caffd640 1 -- 172.21.15.79:0/2008672814 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f81d0003a80 con 0x7f81d41019d0 2024-08-20T01:34:59.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:59.959+0000 7f81caffd640 1 -- 172.21.15.79:0/2008672814 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d0035070 con 0x7f81d41019d0 2024-08-20T01:34:59.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:59.959+0000 7f81dbdf7640 1 -- 172.21.15.79:0/2008672814 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81d41a52d0 con 0x7f81d41019d0 2024-08-20T01:34:59.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:59.959+0000 7f81dbdf7640 1 -- 172.21.15.79:0/2008672814 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81d41a5800 con 0x7f81d41019d0 2024-08-20T01:34:59.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:59.960+0000 7f81dbdf7640 1 -- 172.21.15.79:0/2008672814 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81d4101db0 con 0x7f81d41019d0 2024-08-20T01:34:59.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:59.961+0000 7f81caffd640 1 -- 172.21.15.79:0/2008672814 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f81d0042030 con 0x7f81d41019d0 2024-08-20T01:34:59.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:59.962+0000 7f81caffd640 1 --2- 172.21.15.79:0/2008672814 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f81c00b3c50 0x7f81c00b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:34:59.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:59.962+0000 7f81d9392640 1 --2- 172.21.15.79:0/2008672814 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f81c00b3c50 0x7f81c00b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:34:59.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:59.962+0000 7f81caffd640 1 -- 172.21.15.79:0/2008672814 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7f81d0104260 con 0x7f81d41019d0 2024-08-20T01:34:59.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:59.962+0000 7f81d9392640 1 --2- 172.21.15.79:0/2008672814 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f81c00b3c50 0x7f81c00b6110 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f81d406bd90 tx=0x7f81c4005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:34:59.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:34:59.966+0000 7f81caffd640 1 -- 172.21.15.79:0/2008672814 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f81d00cba00 con 0x7f81d41019d0 2024-08-20T01:35:00.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:00.177+0000 7f81dbdf7640 1 -- 172.21.15.79:0/2008672814 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f81d402e370 con 0x7f81d41019d0 2024-08-20T01:35:00.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:00.386+0000 7f81caffd640 1 -- 172.21.15.79:0/2008672814 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f81d00cb300 con 0x7f81d41019d0 2024-08-20T01:35:00.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:00.388+0000 7f81dbdf7640 1 -- 172.21.15.79:0/2008672814 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f81c00b3c50 msgr2=0x7f81c00b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:00.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:00.388+0000 7f81dbdf7640 1 --2- 172.21.15.79:0/2008672814 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f81c00b3c50 0x7f81c00b6110 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f81d406bd90 tx=0x7f81c4005c70 comp rx=0 tx=0).stop 2024-08-20T01:35:00.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:00.388+0000 7f81dbdf7640 1 -- 172.21.15.79:0/2008672814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81d41019d0 msgr2=0x7f81d4199c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:00.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:00.388+0000 7f81dbdf7640 1 --2- 172.21.15.79:0/2008672814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81d41019d0 0x7f81d4199c60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f81d0009230 tx=0x7f81d0004270 comp rx=0 tx=0).stop 2024-08-20T01:35:00.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:00.388+0000 7f81dbdf7640 1 -- 172.21.15.79:0/2008672814 shutdown_connections 2024-08-20T01:35:00.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:00.388+0000 7f81dbdf7640 1 --2- 172.21.15.79:0/2008672814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81d4107d60 0x7f81d419a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:00.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:00.388+0000 7f81dbdf7640 1 --2- 172.21.15.79:0/2008672814 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f81c00b3c50 0x7f81c00b6110 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:00.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:00.388+0000 7f81dbdf7640 1 --2- 172.21.15.79:0/2008672814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81d41073e0 0x7f81d419a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:00.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:00.388+0000 7f81dbdf7640 1 --2- 172.21.15.79:0/2008672814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81d41019d0 0x7f81d4199c60 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:00.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:00.388+0000 7f81dbdf7640 1 -- 172.21.15.79:0/2008672814 >> 172.21.15.79:0/2008672814 conn(0x7f81d40fd440 msgr2=0x7f81d40ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:00.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:00.388+0000 7f81dbdf7640 1 -- 172.21.15.79:0/2008672814 shutdown_connections 2024-08-20T01:35:00.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:00.388+0000 7f81dbdf7640 1 -- 172.21.15.79:0/2008672814 wait complete. 2024-08-20T01:35:00.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:00 smithi081 ceph-mon[22209]: pgmap v275: 97 pgs: 4 creating+peering, 93 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 3 op/s 2024-08-20T01:35:00.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:00 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2008672814' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-08-20T01:35:00.528 INFO:journalctl@ceph.mds.b.smithi081.stdout:Aug 20 01:35:00 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-b[51985]: 2024-08-20T01:35:00.267+0000 7f249eb45640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-20T01:35:00.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:00 smithi175 ceph-mon[22392]: pgmap v275: 97 pgs: 4 creating+peering, 93 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 3 op/s 2024-08-20T01:35:00.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:00 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2008672814' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-08-20T01:35:00.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:00 smithi079 ceph-mon[18656]: pgmap v275: 97 pgs: 4 creating+peering, 93 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 3 op/s 2024-08-20T01:35:00.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:00 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2008672814' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-08-20T01:35:01.049 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-08-20T01:35:01.050 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-08-20T01:35:01.299 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:01.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:01 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2008672814' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-20T01:35:01.727 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:01 smithi079 ceph-mon[18656]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-20T01:35:01.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:01 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2008672814' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-20T01:35:01.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:01 smithi081 ceph-mon[22209]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-20T01:35:01.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:01.767+0000 7f7a2807f640 1 -- 172.21.15.79:0/2168231527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a2010ce40 msgr2=0x7f7a2010f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:01.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:01.767+0000 7f7a2807f640 1 --2- 172.21.15.79:0/2168231527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a2010ce40 0x7f7a2010f2a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7a18009ca0 tx=0x7f7a1802a8c0 comp rx=0 tx=0).stop 2024-08-20T01:35:01.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:01.767+0000 7f7a2807f640 1 -- 172.21.15.79:0/2168231527 shutdown_connections 2024-08-20T01:35:01.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:01.767+0000 7f7a2807f640 1 --2- 172.21.15.79:0/2168231527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a2010ce40 0x7f7a2010f2a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:01.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:01.767+0000 7f7a2807f640 1 --2- 172.21.15.79:0/2168231527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a20104300 0x7f7a2010c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:01.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:01.767+0000 7f7a2807f640 1 --2- 172.21.15.79:0/2168231527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a201039e0 0x7f7a20103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:01.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:01.767+0000 7f7a2807f640 1 -- 172.21.15.79:0/2168231527 >> 172.21.15.79:0/2168231527 conn(0x7f7a200fd440 msgr2=0x7f7a200ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:01.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:01.767+0000 7f7a2807f640 1 -- 172.21.15.79:0/2168231527 shutdown_connections 2024-08-20T01:35:01.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:01.767+0000 7f7a2807f640 1 -- 172.21.15.79:0/2168231527 wait complete. 2024-08-20T01:35:01.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:01.767+0000 7f7a2807f640 1 Processor -- start 2024-08-20T01:35:01.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:01.767+0000 7f7a2807f640 1 -- start start 2024-08-20T01:35:01.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:01.767+0000 7f7a2807f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a201039e0 0x7f7a20198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:01.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:01.767+0000 7f7a2807f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a20104300 0x7f7a20199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:01.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:01.767+0000 7f7a2807f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a2010ce40 0x7f7a2019e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:01.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:01.767+0000 7f7a2807f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7a201129b0 con 0x7f7a2010ce40 2024-08-20T01:35:01.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:01.767+0000 7f7a2807f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7a20112830 con 0x7f7a20104300 2024-08-20T01:35:01.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:01.767+0000 7f7a2807f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7a20112b30 con 0x7f7a201039e0 2024-08-20T01:35:01.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:01.768+0000 7f7a2661c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a2010ce40 0x7f7a2019e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:01.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:01.768+0000 7f7a2661c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a2010ce40 0x7f7a2019e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47892/0 (socket says 172.21.15.79:47892) 2024-08-20T01:35:01.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:01.768+0000 7f7a2661c640 1 -- 172.21.15.79:0/2968008862 learned_addr learned my addr 172.21.15.79:0/2968008862 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:35:01.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:01.768+0000 7f7a2561a640 1 --2- 172.21.15.79:0/2968008862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a20104300 0x7f7a20199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:01.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:01.768+0000 7f7a25e1b640 1 --2- 172.21.15.79:0/2968008862 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a201039e0 0x7f7a20198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:01.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:01.768+0000 7f7a2661c640 1 -- 172.21.15.79:0/2968008862 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a201039e0 msgr2=0x7f7a20198de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:01.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:01.768+0000 7f7a2661c640 1 --2- 172.21.15.79:0/2968008862 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a201039e0 0x7f7a20198de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:01.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:01.768+0000 7f7a2661c640 1 -- 172.21.15.79:0/2968008862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a20104300 msgr2=0x7f7a20199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:01.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:01.768+0000 7f7a2661c640 1 --2- 172.21.15.79:0/2968008862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a20104300 0x7f7a20199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:01.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:01.768+0000 7f7a2661c640 1 -- 172.21.15.79:0/2968008862 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a2019ee90 con 0x7f7a2010ce40 2024-08-20T01:35:01.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:01.768+0000 7f7a2561a640 1 --2- 172.21.15.79:0/2968008862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a20104300 0x7f7a20199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:35:01.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:01.768+0000 7f7a2661c640 1 --2- 172.21.15.79:0/2968008862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a2010ce40 0x7f7a2019e6c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7a18031040 tx=0x7f7a18032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:01.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:01.768+0000 7f7a12ffd640 1 -- 172.21.15.79:0/2968008862 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a18004040 con 0x7f7a2010ce40 2024-08-20T01:35:01.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:01.768+0000 7f7a12ffd640 1 -- 172.21.15.79:0/2968008862 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7a18004670 con 0x7f7a2010ce40 2024-08-20T01:35:01.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:01.768+0000 7f7a2807f640 1 -- 172.21.15.79:0/2968008862 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a2019f120 con 0x7f7a2010ce40 2024-08-20T01:35:01.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:01.768+0000 7f7a12ffd640 1 -- 172.21.15.79:0/2968008862 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a18030bb0 con 0x7f7a2010ce40 2024-08-20T01:35:01.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:01.768+0000 7f7a2807f640 1 -- 172.21.15.79:0/2968008862 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a201a5840 con 0x7f7a2010ce40 2024-08-20T01:35:01.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:01.769+0000 7f7a2807f640 1 -- 172.21.15.79:0/2968008862 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a20103dc0 con 0x7f7a2010ce40 2024-08-20T01:35:01.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:01.770+0000 7f7a12ffd640 1 -- 172.21.15.79:0/2968008862 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f7a180041e0 con 0x7f7a2010ce40 2024-08-20T01:35:01.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:01.771+0000 7f7a12ffd640 1 --2- 172.21.15.79:0/2968008862 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f7a0c0b3c50 0x7f7a0c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:01.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:01.771+0000 7f7a25e1b640 1 --2- 172.21.15.79:0/2968008862 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f7a0c0b3c50 0x7f7a0c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:01.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:01.771+0000 7f7a12ffd640 1 -- 172.21.15.79:0/2968008862 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7f7a18104f00 con 0x7f7a2010ce40 2024-08-20T01:35:01.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:01.772+0000 7f7a25e1b640 1 --2- 172.21.15.79:0/2968008862 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f7a0c0b3c50 0x7f7a0c0b6110 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c005fd0 tx=0x7f7a1c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:01.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:01.775+0000 7f7a12ffd640 1 -- 172.21.15.79:0/2968008862 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f7a180cc6a0 con 0x7f7a2010ce40 2024-08-20T01:35:01.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:01 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2008672814' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-20T01:35:01.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:01 smithi175 ceph-mon[22392]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-20T01:35:01.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:01.986+0000 7f7a2807f640 1 -- 172.21.15.79:0/2968008862 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f7a2002e340 con 0x7f7a2010ce40 2024-08-20T01:35:02.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:02.393+0000 7f7a12ffd640 1 -- 172.21.15.79:0/2968008862 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f7a180cbfa0 con 0x7f7a2010ce40 2024-08-20T01:35:02.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:02.395+0000 7f7a2807f640 1 -- 172.21.15.79:0/2968008862 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f7a0c0b3c50 msgr2=0x7f7a0c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:02.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:02.395+0000 7f7a2807f640 1 --2- 172.21.15.79:0/2968008862 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f7a0c0b3c50 0x7f7a0c0b6110 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c005fd0 tx=0x7f7a1c005850 comp rx=0 tx=0).stop 2024-08-20T01:35:02.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:02.395+0000 7f7a2807f640 1 -- 172.21.15.79:0/2968008862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a2010ce40 msgr2=0x7f7a2019e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:02.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:02.395+0000 7f7a2807f640 1 --2- 172.21.15.79:0/2968008862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a2010ce40 0x7f7a2019e6c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7a18031040 tx=0x7f7a18032bc0 comp rx=0 tx=0).stop 2024-08-20T01:35:02.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:02.396+0000 7f7a2807f640 1 -- 172.21.15.79:0/2968008862 shutdown_connections 2024-08-20T01:35:02.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:02.396+0000 7f7a2807f640 1 --2- 172.21.15.79:0/2968008862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a2010ce40 0x7f7a2019e6c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:02.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:02.396+0000 7f7a2807f640 1 --2- 172.21.15.79:0/2968008862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a20104300 0x7f7a20199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:02.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:02.396+0000 7f7a2807f640 1 --2- 172.21.15.79:0/2968008862 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f7a0c0b3c50 0x7f7a0c0b6110 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:02.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:02.396+0000 7f7a2807f640 1 --2- 172.21.15.79:0/2968008862 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a201039e0 0x7f7a20198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:02.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:02.396+0000 7f7a2807f640 1 -- 172.21.15.79:0/2968008862 >> 172.21.15.79:0/2968008862 conn(0x7f7a200fd440 msgr2=0x7f7a200fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:02.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:02.396+0000 7f7a2807f640 1 -- 172.21.15.79:0/2968008862 shutdown_connections 2024-08-20T01:35:02.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:02.396+0000 7f7a2807f640 1 -- 172.21.15.79:0/2968008862 wait complete. 2024-08-20T01:35:02.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:02 smithi079 ceph-mon[18656]: pgmap v276: 97 pgs: 97 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-08-20T01:35:02.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:02 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2968008862' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-08-20T01:35:02.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:02 smithi081 ceph-mon[22209]: pgmap v276: 97 pgs: 97 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-08-20T01:35:02.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:02 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2968008862' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-08-20T01:35:02.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:02 smithi175 ceph-mon[22392]: pgmap v276: 97 pgs: 97 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-08-20T01:35:02.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:02 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2968008862' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-08-20T01:35:03.024 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-08-20T01:35:03.284 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:03.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:03 smithi079 ceph-mon[18656]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-20T01:35:03.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:03 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2968008862' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-08-20T01:35:03.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:03 smithi079 ceph-mon[18656]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-20T01:35:03.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:03 smithi079 ceph-mon[18656]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-20T01:35:03.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:03 smithi079 ceph-mon[18656]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-08-20T01:35:03.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:03 smithi079 ceph-mon[18656]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-08-20T01:35:03.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:03 smithi081 ceph-mon[22209]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-20T01:35:03.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:03 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2968008862' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-08-20T01:35:03.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:03 smithi081 ceph-mon[22209]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-20T01:35:03.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:03 smithi081 ceph-mon[22209]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-20T01:35:03.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:03 smithi081 ceph-mon[22209]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-08-20T01:35:03.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:03 smithi081 ceph-mon[22209]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-08-20T01:35:03.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:03.800+0000 7f4fcf532640 1 -- 172.21.15.79:0/3844548078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc8107d60 msgr2=0x7f4fc810e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:03.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:03.800+0000 7f4fcf532640 1 --2- 172.21.15.79:0/3844548078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc8107d60 0x7f4fc810e560 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0009ca0 tx=0x7f4fc002a8c0 comp rx=0 tx=0).stop 2024-08-20T01:35:03.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:03.801+0000 7f4fcf532640 1 -- 172.21.15.79:0/3844548078 shutdown_connections 2024-08-20T01:35:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:03.801+0000 7f4fcf532640 1 --2- 172.21.15.79:0/3844548078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc8107d60 0x7f4fc810e560 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:03.801+0000 7f4fcf532640 1 --2- 172.21.15.79:0/3844548078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fc81073e0 0x7f4fc8107820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:03.801+0000 7f4fcf532640 1 --2- 172.21.15.79:0/3844548078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fc81019d0 0x7f4fc8101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:03.801+0000 7f4fcf532640 1 -- 172.21.15.79:0/3844548078 >> 172.21.15.79:0/3844548078 conn(0x7f4fc80fd440 msgr2=0x7f4fc80ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:03.801+0000 7f4fcf532640 1 -- 172.21.15.79:0/3844548078 shutdown_connections 2024-08-20T01:35:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:03.801+0000 7f4fcf532640 1 -- 172.21.15.79:0/3844548078 wait complete. 2024-08-20T01:35:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:03.801+0000 7f4fcf532640 1 Processor -- start 2024-08-20T01:35:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:03.801+0000 7f4fcf532640 1 -- start start 2024-08-20T01:35:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:03.801+0000 7f4fcf532640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fc81019d0 0x7f4fc80fd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:03.801+0000 7f4fcf532640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fc81073e0 0x7f4fc80fde80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:03.801+0000 7f4fcf532640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc8107d60 0x7f4fc80fe3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:03.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:03.801+0000 7f4fcf532640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc8111920 con 0x7f4fc8107d60 2024-08-20T01:35:03.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:03.801+0000 7f4fcf532640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc81117a0 con 0x7f4fc81073e0 2024-08-20T01:35:03.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:03.801+0000 7f4fcf532640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc8111aa0 con 0x7f4fc81019d0 2024-08-20T01:35:03.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:03.802+0000 7f4fcdacf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc8107d60 0x7f4fc80fe3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:03.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:03.802+0000 7f4fcdacf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc8107d60 0x7f4fc80fe3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47908/0 (socket says 172.21.15.79:47908) 2024-08-20T01:35:03.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:03.802+0000 7f4fcdacf640 1 -- 172.21.15.79:0/2371298412 learned_addr learned my addr 172.21.15.79:0/2371298412 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:35:03.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:03.802+0000 7f4fcd2ce640 1 --2- 172.21.15.79:0/2371298412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fc81019d0 0x7f4fc80fd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:03.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:03.802+0000 7f4fccacd640 1 --2- 172.21.15.79:0/2371298412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fc81073e0 0x7f4fc80fde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:03.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:03.802+0000 7f4fcdacf640 1 -- 172.21.15.79:0/2371298412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fc81019d0 msgr2=0x7f4fc80fd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:03.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:03.802+0000 7f4fcdacf640 1 --2- 172.21.15.79:0/2371298412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fc81019d0 0x7f4fc80fd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:03.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:03.802+0000 7f4fcdacf640 1 -- 172.21.15.79:0/2371298412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fc81073e0 msgr2=0x7f4fc80fde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:03.802+0000 7f4fcdacf640 1 --2- 172.21.15.79:0/2371298412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fc81073e0 0x7f4fc80fde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:03.802+0000 7f4fcdacf640 1 -- 172.21.15.79:0/2371298412 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc81a72c0 con 0x7f4fc8107d60 2024-08-20T01:35:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:03.802+0000 7f4fccacd640 1 --2- 172.21.15.79:0/2371298412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fc81073e0 0x7f4fc80fde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:35:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:03.802+0000 7f4fcdacf640 1 --2- 172.21.15.79:0/2371298412 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc8107d60 0x7f4fc80fe3c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0005cc0 tx=0x7f4fc0032c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:03.802+0000 7f4fbe7fc640 1 -- 172.21.15.79:0/2371298412 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0004040 con 0x7f4fc8107d60 2024-08-20T01:35:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:03.802+0000 7f4fbe7fc640 1 -- 172.21.15.79:0/2371298412 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4fc0004670 con 0x7f4fc8107d60 2024-08-20T01:35:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:03.802+0000 7f4fcf532640 1 -- 172.21.15.79:0/2371298412 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fc81a7550 con 0x7f4fc8107d60 2024-08-20T01:35:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:03.802+0000 7f4fbe7fc640 1 -- 172.21.15.79:0/2371298412 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0030cc0 con 0x7f4fc8107d60 2024-08-20T01:35:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:03.802+0000 7f4fcf532640 1 -- 172.21.15.79:0/2371298412 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fc81a7a90 con 0x7f4fc8107d60 2024-08-20T01:35:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:03.803+0000 7f4fcf532640 1 -- 172.21.15.79:0/2371298412 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fc8101db0 con 0x7f4fc8107d60 2024-08-20T01:35:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:03.804+0000 7f4fbe7fc640 1 -- 172.21.15.79:0/2371298412 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f4fc00041e0 con 0x7f4fc8107d60 2024-08-20T01:35:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:03.805+0000 7f4fbe7fc640 1 --2- 172.21.15.79:0/2371298412 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4fb40b3bd0 0x7f4fb40b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:03.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:03.805+0000 7f4fcd2ce640 1 --2- 172.21.15.79:0/2371298412 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4fb40b3bd0 0x7f4fb40b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:03.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:03.805+0000 7f4fbe7fc640 1 -- 172.21.15.79:0/2371298412 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7f4fc0105270 con 0x7f4fc8107d60 2024-08-20T01:35:03.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:03.806+0000 7f4fcd2ce640 1 --2- 172.21.15.79:0/2371298412 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4fb40b3bd0 0x7f4fb40b6090 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4fc4005e10 tx=0x7f4fc4005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:03.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:03.809+0000 7f4fbe7fc640 1 -- 172.21.15.79:0/2371298412 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f4fc00cca10 con 0x7f4fc8107d60 2024-08-20T01:35:03.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:03 smithi175 ceph-mon[22392]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-20T01:35:03.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:03 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2968008862' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-08-20T01:35:03.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:03 smithi175 ceph-mon[22392]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-20T01:35:03.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:03 smithi175 ceph-mon[22392]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-20T01:35:03.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:03 smithi175 ceph-mon[22392]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-08-20T01:35:03.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:03 smithi175 ceph-mon[22392]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-08-20T01:35:04.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:04.023+0000 7f4fcf532640 1 -- 172.21.15.79:0/2371298412 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f4fc81a7e00 con 0x7f4fc8107d60 2024-08-20T01:35:04.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:04.414+0000 7f4fbe7fc640 1 -- 172.21.15.79:0/2371298412 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f4fc00cc310 con 0x7f4fc8107d60 2024-08-20T01:35:04.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:04.418+0000 7f4fcf532640 1 -- 172.21.15.79:0/2371298412 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4fb40b3bd0 msgr2=0x7f4fb40b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:04.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:04.418+0000 7f4fcf532640 1 --2- 172.21.15.79:0/2371298412 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4fb40b3bd0 0x7f4fb40b6090 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4fc4005e10 tx=0x7f4fc4005da0 comp rx=0 tx=0).stop 2024-08-20T01:35:04.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:04.418+0000 7f4fcf532640 1 -- 172.21.15.79:0/2371298412 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc8107d60 msgr2=0x7f4fc80fe3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:04.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:04.418+0000 7f4fcf532640 1 --2- 172.21.15.79:0/2371298412 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc8107d60 0x7f4fc80fe3c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0005cc0 tx=0x7f4fc0032c40 comp rx=0 tx=0).stop 2024-08-20T01:35:04.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:04.418+0000 7f4fcf532640 1 -- 172.21.15.79:0/2371298412 shutdown_connections 2024-08-20T01:35:04.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:04.418+0000 7f4fcf532640 1 --2- 172.21.15.79:0/2371298412 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc8107d60 0x7f4fc80fe3c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:04.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:04.418+0000 7f4fcf532640 1 --2- 172.21.15.79:0/2371298412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fc81073e0 0x7f4fc80fde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:04.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:04.418+0000 7f4fcf532640 1 --2- 172.21.15.79:0/2371298412 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4fb40b3bd0 0x7f4fb40b6090 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:04.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:04.418+0000 7f4fcf532640 1 --2- 172.21.15.79:0/2371298412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fc81019d0 0x7f4fc80fd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:04.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:04.418+0000 7f4fcf532640 1 -- 172.21.15.79:0/2371298412 >> 172.21.15.79:0/2371298412 conn(0x7f4fc80fd440 msgr2=0x7f4fc806b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:04.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:04.418+0000 7f4fcf532640 1 -- 172.21.15.79:0/2371298412 shutdown_connections 2024-08-20T01:35:04.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:04.418+0000 7f4fcf532640 1 -- 172.21.15.79:0/2371298412 wait complete. 2024-08-20T01:35:04.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:04 smithi079 ceph-mon[18656]: pgmap v277: 97 pgs: 97 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-08-20T01:35:04.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:04 smithi079 ceph-mon[18656]: mds.? [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] up:active 2024-08-20T01:35:04.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:04 smithi079 ceph-mon[18656]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-20T01:35:04.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:04 smithi079 ceph-mon[18656]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-08-20T01:35:04.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:04 smithi079 ceph-mon[18656]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-08-20T01:35:04.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:04 smithi079 ceph-mon[18656]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-08-20T01:35:04.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:04 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2371298412' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-08-20T01:35:04.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:04 smithi081 ceph-mon[22209]: pgmap v277: 97 pgs: 97 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-08-20T01:35:04.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:04 smithi081 ceph-mon[22209]: mds.? [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] up:active 2024-08-20T01:35:04.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:04 smithi081 ceph-mon[22209]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-20T01:35:04.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:04 smithi081 ceph-mon[22209]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-08-20T01:35:04.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:04 smithi081 ceph-mon[22209]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-08-20T01:35:04.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:04 smithi081 ceph-mon[22209]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-08-20T01:35:04.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:04 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2371298412' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-08-20T01:35:04.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:04 smithi175 ceph-mon[22392]: pgmap v277: 97 pgs: 97 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-08-20T01:35:04.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:04 smithi175 ceph-mon[22392]: mds.? [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] up:active 2024-08-20T01:35:04.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:04 smithi175 ceph-mon[22392]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-20T01:35:04.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:04 smithi175 ceph-mon[22392]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-08-20T01:35:04.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:04 smithi175 ceph-mon[22392]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-08-20T01:35:04.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:04 smithi175 ceph-mon[22392]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-08-20T01:35:04.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:04 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2371298412' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-08-20T01:35:05.153 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-08-20T01:35:05.404 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:05.528 INFO:journalctl@ceph.mds.b.smithi081.stdout:Aug 20 01:35:05 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-b[51985]: 2024-08-20T01:35:05.268+0000 7f249eb45640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-08-20T01:35:05.528 INFO:journalctl@ceph.mds.b.smithi081.stdout:Aug 20 01:35:05 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-b[51985]: 2024-08-20T01:35:05.268+0000 7f249eb45640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-08-20T01:35:05.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:05 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2371298412' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-20T01:35:05.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:05 smithi081 ceph-mon[22209]: mds.? [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] up:active 2024-08-20T01:35:05.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:05 smithi081 ceph-mon[22209]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-08-20T01:35:05.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:05 smithi081 ceph-mon[22209]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-08-20T01:35:05.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:05 smithi081 ceph-mon[22209]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2024-08-20T01:35:05.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:05 smithi081 ceph-mon[22209]: daemon mds.f is now active in filesystem cephfs as rank 3 2024-08-20T01:35:05.669 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:05 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2371298412' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-20T01:35:05.669 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:05 smithi079 ceph-mon[18656]: mds.? [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] up:active 2024-08-20T01:35:05.669 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:05 smithi079 ceph-mon[18656]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-08-20T01:35:05.669 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:05 smithi079 ceph-mon[18656]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-08-20T01:35:05.669 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:05 smithi079 ceph-mon[18656]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2024-08-20T01:35:05.669 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:05 smithi079 ceph-mon[18656]: daemon mds.f is now active in filesystem cephfs as rank 3 2024-08-20T01:35:05.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:05 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2371298412' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-20T01:35:05.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:05 smithi175 ceph-mon[22392]: mds.? [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] up:active 2024-08-20T01:35:05.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:05 smithi175 ceph-mon[22392]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-08-20T01:35:05.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:05 smithi175 ceph-mon[22392]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-08-20T01:35:05.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:05 smithi175 ceph-mon[22392]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2024-08-20T01:35:05.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:05 smithi175 ceph-mon[22392]: daemon mds.f is now active in filesystem cephfs as rank 3 2024-08-20T01:35:05.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:05.886+0000 7f3692a08640 1 -- 172.21.15.79:0/29763726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f368c108e60 msgr2=0x7f368c10f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:05.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:05.886+0000 7f3692a08640 1 --2- 172.21.15.79:0/29763726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f368c108e60 0x7f368c10f660 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3684009ca0 tx=0x7f368402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:35:05.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:05.886+0000 7f3692a08640 1 -- 172.21.15.79:0/29763726 shutdown_connections 2024-08-20T01:35:05.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:05.886+0000 7f3692a08640 1 --2- 172.21.15.79:0/29763726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f368c108e60 0x7f368c10f660 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:05.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:05.886+0000 7f3692a08640 1 --2- 172.21.15.79:0/29763726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f368c1084e0 0x7f368c108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:05.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:05.886+0000 7f3692a08640 1 --2- 172.21.15.79:0/29763726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f368c102ad0 0x7f368c102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:05.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:05.886+0000 7f3692a08640 1 -- 172.21.15.79:0/29763726 >> 172.21.15.79:0/29763726 conn(0x7f368c0fe540 msgr2=0x7f368c100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:05.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:05.886+0000 7f3692a08640 1 -- 172.21.15.79:0/29763726 shutdown_connections 2024-08-20T01:35:05.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:05.886+0000 7f3692a08640 1 -- 172.21.15.79:0/29763726 wait complete. 2024-08-20T01:35:05.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:05.887+0000 7f3692a08640 1 Processor -- start 2024-08-20T01:35:05.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:05.887+0000 7f3692a08640 1 -- start start 2024-08-20T01:35:05.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:05.887+0000 7f3692a08640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f368c102ad0 0x7f368c198f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:05.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:05.887+0000 7f3692a08640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f368c1084e0 0x7f368c1994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:05.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:05.887+0000 7f3692a08640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f368c108e60 0x7f368c19e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:05.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:05.887+0000 7f3692a08640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f368c112a60 con 0x7f368c1084e0 2024-08-20T01:35:05.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:05.887+0000 7f3692a08640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f368c1128e0 con 0x7f368c102ad0 2024-08-20T01:35:05.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:05.887+0000 7f3692a08640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f368c112be0 con 0x7f368c108e60 2024-08-20T01:35:05.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:05.887+0000 7f368b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f368c1084e0 0x7f368c1994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:05.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:05.887+0000 7f368b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f368c1084e0 0x7f368c1994b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47922/0 (socket says 172.21.15.79:47922) 2024-08-20T01:35:05.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:05.887+0000 7f368b7fe640 1 -- 172.21.15.79:0/322420338 learned_addr learned my addr 172.21.15.79:0/322420338 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:35:05.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:05.888+0000 7f368b7fe640 1 -- 172.21.15.79:0/322420338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f368c108e60 msgr2=0x7f368c19e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:05.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:05.888+0000 7f368b7fe640 1 --2- 172.21.15.79:0/322420338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f368c108e60 0x7f368c19e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:05.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:05.888+0000 7f368b7fe640 1 -- 172.21.15.79:0/322420338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f368c102ad0 msgr2=0x7f368c198f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:05.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:05.888+0000 7f368bfff640 1 --2- 172.21.15.79:0/322420338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f368c102ad0 0x7f368c198f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:05.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:05.888+0000 7f368b7fe640 1 --2- 172.21.15.79:0/322420338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f368c102ad0 0x7f368c198f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:05.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:05.888+0000 7f368b7fe640 1 -- 172.21.15.79:0/322420338 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f368c19f020 con 0x7f368c1084e0 2024-08-20T01:35:05.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:05.888+0000 7f368b7fe640 1 --2- 172.21.15.79:0/322420338 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f368c1084e0 0x7f368c1994b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f368000b4a0 tx=0x7f368000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:05.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:05.888+0000 7f36897fa640 1 -- 172.21.15.79:0/322420338 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3680014070 con 0x7f368c1084e0 2024-08-20T01:35:05.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:05.888+0000 7f36897fa640 1 -- 172.21.15.79:0/322420338 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3680010aa0 con 0x7f368c1084e0 2024-08-20T01:35:05.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:05.888+0000 7f3692a08640 1 -- 172.21.15.79:0/322420338 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f368c19f310 con 0x7f368c1084e0 2024-08-20T01:35:05.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:05.888+0000 7f36897fa640 1 -- 172.21.15.79:0/322420338 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3680017b70 con 0x7f368c1084e0 2024-08-20T01:35:05.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:05.888+0000 7f3692a08640 1 -- 172.21.15.79:0/322420338 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f368c1a5a50 con 0x7f368c1084e0 2024-08-20T01:35:05.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:05.889+0000 7f3692a08640 1 -- 172.21.15.79:0/322420338 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f368c102eb0 con 0x7f368c1084e0 2024-08-20T01:35:05.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:05.890+0000 7f36897fa640 1 -- 172.21.15.79:0/322420338 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f3680017070 con 0x7f368c1084e0 2024-08-20T01:35:05.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:05.891+0000 7f36897fa640 1 --2- 172.21.15.79:0/322420338 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f36740b3bd0 0x7f36740b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:05.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:05.891+0000 7f368bfff640 1 --2- 172.21.15.79:0/322420338 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f36740b3bd0 0x7f36740b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:05.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:05.891+0000 7f36897fa640 1 -- 172.21.15.79:0/322420338 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7f36800e3330 con 0x7f368c1084e0 2024-08-20T01:35:05.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:05.891+0000 7f368bfff640 1 --2- 172.21.15.79:0/322420338 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f36740b3bd0 0x7f36740b6090 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f367c00a810 tx=0x7f367c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:05.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:05.894+0000 7f36897fa640 1 -- 172.21.15.79:0/322420338 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f36800aaa30 con 0x7f368c1084e0 2024-08-20T01:35:06.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:06.104+0000 7f3692a08640 1 -- 172.21.15.79:0/322420338 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f368c02e340 con 0x7f368c1084e0 2024-08-20T01:35:06.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:06.434+0000 7f36897fa640 1 -- 172.21.15.79:0/322420338 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v26) ==== 115+0+0 (secure 0 0 0) 0x7f36800aa330 con 0x7f368c1084e0 2024-08-20T01:35:06.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:06.436+0000 7f3692a08640 1 -- 172.21.15.79:0/322420338 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f36740b3bd0 msgr2=0x7f36740b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:06.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:06.436+0000 7f3692a08640 1 --2- 172.21.15.79:0/322420338 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f36740b3bd0 0x7f36740b6090 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f367c00a810 tx=0x7f367c008040 comp rx=0 tx=0).stop 2024-08-20T01:35:06.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:06.436+0000 7f3692a08640 1 -- 172.21.15.79:0/322420338 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f368c1084e0 msgr2=0x7f368c1994b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:06.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:06.436+0000 7f3692a08640 1 --2- 172.21.15.79:0/322420338 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f368c1084e0 0x7f368c1994b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f368000b4a0 tx=0x7f368000b960 comp rx=0 tx=0).stop 2024-08-20T01:35:06.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:06.436+0000 7f3692a08640 1 -- 172.21.15.79:0/322420338 shutdown_connections 2024-08-20T01:35:06.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:06.436+0000 7f3692a08640 1 --2- 172.21.15.79:0/322420338 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f36740b3bd0 0x7f36740b6090 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:06.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:06.436+0000 7f3692a08640 1 --2- 172.21.15.79:0/322420338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f368c108e60 0x7f368c19e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:06.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:06.436+0000 7f3692a08640 1 --2- 172.21.15.79:0/322420338 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f368c1084e0 0x7f368c1994b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:06.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:06.436+0000 7f3692a08640 1 --2- 172.21.15.79:0/322420338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f368c102ad0 0x7f368c198f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:06.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:06.436+0000 7f3692a08640 1 -- 172.21.15.79:0/322420338 >> 172.21.15.79:0/322420338 conn(0x7f368c0fe540 msgr2=0x7f368c100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:06.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:06.436+0000 7f3692a08640 1 -- 172.21.15.79:0/322420338 shutdown_connections 2024-08-20T01:35:06.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:06.436+0000 7f3692a08640 1 -- 172.21.15.79:0/322420338 wait complete. 2024-08-20T01:35:06.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:06 smithi079 ceph-mon[18656]: pgmap v278: 97 pgs: 97 active+clean; 580 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 7 op/s 2024-08-20T01:35:06.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:06 smithi079 ceph-mon[18656]: mds.? [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] up:active 2024-08-20T01:35:06.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:06 smithi079 ceph-mon[18656]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-08-20T01:35:06.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:06 smithi079 ceph-mon[18656]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-20T01:35:06.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:06 smithi079 ceph-mon[18656]: Cluster is now healthy 2024-08-20T01:35:06.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:06 smithi079 ceph-mon[18656]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:active} 8 up:standby 2024-08-20T01:35:06.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:06 smithi079 ceph-mon[18656]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-08-20T01:35:06.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:06 smithi079 ceph-mon[18656]: daemon mds.h is now active in filesystem cephfs as rank 4 2024-08-20T01:35:06.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:06 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/322420338' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-08-20T01:35:06.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:06 smithi081 ceph-mon[22209]: pgmap v278: 97 pgs: 97 active+clean; 580 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 7 op/s 2024-08-20T01:35:06.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:06 smithi081 ceph-mon[22209]: mds.? [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] up:active 2024-08-20T01:35:06.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:06 smithi081 ceph-mon[22209]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-08-20T01:35:06.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:06 smithi081 ceph-mon[22209]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-20T01:35:06.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:06 smithi081 ceph-mon[22209]: Cluster is now healthy 2024-08-20T01:35:06.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:06 smithi081 ceph-mon[22209]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:active} 8 up:standby 2024-08-20T01:35:06.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:06 smithi081 ceph-mon[22209]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-08-20T01:35:06.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:06 smithi081 ceph-mon[22209]: daemon mds.h is now active in filesystem cephfs as rank 4 2024-08-20T01:35:06.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:06 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/322420338' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-08-20T01:35:06.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:06 smithi175 ceph-mon[22392]: pgmap v278: 97 pgs: 97 active+clean; 580 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 7 op/s 2024-08-20T01:35:06.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:06 smithi175 ceph-mon[22392]: mds.? [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] up:active 2024-08-20T01:35:06.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:06 smithi175 ceph-mon[22392]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-08-20T01:35:06.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:06 smithi175 ceph-mon[22392]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-20T01:35:06.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:06 smithi175 ceph-mon[22392]: Cluster is now healthy 2024-08-20T01:35:06.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:06 smithi175 ceph-mon[22392]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:active} 8 up:standby 2024-08-20T01:35:06.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:06 smithi175 ceph-mon[22392]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-08-20T01:35:06.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:06 smithi175 ceph-mon[22392]: daemon mds.h is now active in filesystem cephfs as rank 4 2024-08-20T01:35:06.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:06 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/322420338' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-08-20T01:35:07.045 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-08-20T01:35:07.045 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-08-20T01:35:07.289 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:07.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:07 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/322420338' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-20T01:35:07.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:07 smithi079 ceph-mon[18656]: mds.? [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] up:active 2024-08-20T01:35:07.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:07 smithi079 ceph-mon[18656]: fsmap cephfs:5 7 up:standby 5 up:active 2024-08-20T01:35:07.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:07 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:35:07.702 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:07 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/322420338' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-20T01:35:07.703 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:07 smithi081 ceph-mon[22209]: mds.? [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] up:active 2024-08-20T01:35:07.703 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:07 smithi081 ceph-mon[22209]: fsmap cephfs:5 7 up:standby 5 up:active 2024-08-20T01:35:07.703 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:07 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:35:07.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:07.810+0000 7fdb56fff640 1 -- 172.21.15.79:0/541691615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb50104250 msgr2=0x7fdb5010c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:07.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:07.810+0000 7fdb56fff640 1 --2- 172.21.15.79:0/541691615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb50104250 0x7fdb5010c830 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdb44009900 tx=0x7fdb4402a410 comp rx=0 tx=0).stop 2024-08-20T01:35:07.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:07.810+0000 7fdb56fff640 1 -- 172.21.15.79:0/541691615 shutdown_connections 2024-08-20T01:35:07.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:07.810+0000 7fdb56fff640 1 --2- 172.21.15.79:0/541691615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb5010ce00 0x7fdb5010f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:07.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:07.810+0000 7fdb56fff640 1 --2- 172.21.15.79:0/541691615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb50104250 0x7fdb5010c830 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:07.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:07.810+0000 7fdb56fff640 1 --2- 172.21.15.79:0/541691615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb50103850 0x7fdb50103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:07.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:07.810+0000 7fdb56fff640 1 -- 172.21.15.79:0/541691615 >> 172.21.15.79:0/541691615 conn(0x7fdb500fd440 msgr2=0x7fdb500ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:07.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:07.810+0000 7fdb56fff640 1 -- 172.21.15.79:0/541691615 shutdown_connections 2024-08-20T01:35:07.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:07.810+0000 7fdb56fff640 1 -- 172.21.15.79:0/541691615 wait complete. 2024-08-20T01:35:07.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:07.811+0000 7fdb56fff640 1 Processor -- start 2024-08-20T01:35:07.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:07.811+0000 7fdb56fff640 1 -- start start 2024-08-20T01:35:07.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:07.811+0000 7fdb56fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb50103850 0x7fdb50198ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:07.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:07.811+0000 7fdb56fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb50104250 0x7fdb50199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:07.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:07.811+0000 7fdb56fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb5010ce00 0x7fdb5019e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:07.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:07.811+0000 7fdb56fff640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdb50112980 con 0x7fdb50104250 2024-08-20T01:35:07.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:07.811+0000 7fdb56fff640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdb50112800 con 0x7fdb5010ce00 2024-08-20T01:35:07.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:07.811+0000 7fdb56fff640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdb50112b00 con 0x7fdb50103850 2024-08-20T01:35:07.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:07.811+0000 7fdb4ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb50104250 0x7fdb50199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:07.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:07.811+0000 7fdb4ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb50104250 0x7fdb50199430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47934/0 (socket says 172.21.15.79:47934) 2024-08-20T01:35:07.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:07.811+0000 7fdb4ffff640 1 -- 172.21.15.79:0/986884081 learned_addr learned my addr 172.21.15.79:0/986884081 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:35:07.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:07.811+0000 7fdb5559c640 1 --2- 172.21.15.79:0/986884081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb5010ce00 0x7fdb5019e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:07.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:07.812+0000 7fdb54d9b640 1 --2- 172.21.15.79:0/986884081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb50103850 0x7fdb50198ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:07.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:07.812+0000 7fdb4ffff640 1 -- 172.21.15.79:0/986884081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb50103850 msgr2=0x7fdb50198ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:07.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:07.812+0000 7fdb4ffff640 1 --2- 172.21.15.79:0/986884081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb50103850 0x7fdb50198ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:07.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:07.812+0000 7fdb4ffff640 1 -- 172.21.15.79:0/986884081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb5010ce00 msgr2=0x7fdb5019e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:07.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:07.812+0000 7fdb4ffff640 1 --2- 172.21.15.79:0/986884081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb5010ce00 0x7fdb5019e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:07.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:07.812+0000 7fdb4ffff640 1 -- 172.21.15.79:0/986884081 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb5019efa0 con 0x7fdb50104250 2024-08-20T01:35:07.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:07.812+0000 7fdb4ffff640 1 --2- 172.21.15.79:0/986884081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb50104250 0x7fdb50199430 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fdb44009230 tx=0x7fdb44004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:07.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:07.812+0000 7fdb4dffb640 1 -- 172.21.15.79:0/986884081 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4403f030 con 0x7fdb50104250 2024-08-20T01:35:07.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:07.812+0000 7fdb4dffb640 1 -- 172.21.15.79:0/986884081 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdb44003a80 con 0x7fdb50104250 2024-08-20T01:35:07.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:07.812+0000 7fdb56fff640 1 -- 172.21.15.79:0/986884081 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb5019f230 con 0x7fdb50104250 2024-08-20T01:35:07.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:07.812+0000 7fdb4dffb640 1 -- 172.21.15.79:0/986884081 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb44035070 con 0x7fdb50104250 2024-08-20T01:35:07.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:07.813+0000 7fdb56fff640 1 -- 172.21.15.79:0/986884081 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb501a5950 con 0x7fdb50104250 2024-08-20T01:35:07.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:07.814+0000 7fdb56fff640 1 -- 172.21.15.79:0/986884081 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb50103c30 con 0x7fdb50104250 2024-08-20T01:35:07.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:07.816+0000 7fdb4dffb640 1 -- 172.21.15.79:0/986884081 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7fdb44042030 con 0x7fdb50104250 2024-08-20T01:35:07.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:07.816+0000 7fdb4dffb640 1 --2- 172.21.15.79:0/986884081 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fdb380b3c50 0x7fdb380b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:07.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:07.817+0000 7fdb54d9b640 1 --2- 172.21.15.79:0/986884081 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fdb380b3c50 0x7fdb380b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:07.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:07.817+0000 7fdb4dffb640 1 -- 172.21.15.79:0/986884081 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7fdb44104660 con 0x7fdb50104250 2024-08-20T01:35:07.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:07.817+0000 7fdb54d9b640 1 --2- 172.21.15.79:0/986884081 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fdb380b3c50 0x7fdb380b6110 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdb40009890 tx=0x7fdb40008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:07.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:07.819+0000 7fdb4dffb640 1 -- 172.21.15.79:0/986884081 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fdb440cbe00 con 0x7fdb50104250 2024-08-20T01:35:07.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:07 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/322420338' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-20T01:35:07.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:07 smithi175 ceph-mon[22392]: mds.? [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] up:active 2024-08-20T01:35:07.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:07 smithi175 ceph-mon[22392]: fsmap cephfs:5 7 up:standby 5 up:active 2024-08-20T01:35:07.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:07 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:35:08.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:08.017+0000 7fdb56fff640 1 -- 172.21.15.79:0/986884081 --> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fdb500632c0 con 0x7fdb380b3c50 2024-08-20T01:35:08.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:08.036+0000 7fdb4dffb640 1 -- 172.21.15.79:0/986884081 <== mgr.14150 v2:172.21.15.79:6800/3038112779 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fdb500632c0 con 0x7fdb380b3c50 2024-08-20T01:35:08.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:08.038+0000 7fdb56fff640 1 -- 172.21.15.79:0/986884081 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fdb380b3c50 msgr2=0x7fdb380b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:08.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:08.038+0000 7fdb56fff640 1 --2- 172.21.15.79:0/986884081 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fdb380b3c50 0x7fdb380b6110 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdb40009890 tx=0x7fdb40008040 comp rx=0 tx=0).stop 2024-08-20T01:35:08.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:08.038+0000 7fdb56fff640 1 -- 172.21.15.79:0/986884081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb50104250 msgr2=0x7fdb50199430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:08.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:08.038+0000 7fdb56fff640 1 --2- 172.21.15.79:0/986884081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb50104250 0x7fdb50199430 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fdb44009230 tx=0x7fdb44004270 comp rx=0 tx=0).stop 2024-08-20T01:35:08.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:08.038+0000 7fdb56fff640 1 -- 172.21.15.79:0/986884081 shutdown_connections 2024-08-20T01:35:08.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:08.038+0000 7fdb56fff640 1 --2- 172.21.15.79:0/986884081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb5010ce00 0x7fdb5019e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:08.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:08.038+0000 7fdb56fff640 1 --2- 172.21.15.79:0/986884081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb50104250 0x7fdb50199430 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:08.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:08.038+0000 7fdb56fff640 1 --2- 172.21.15.79:0/986884081 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fdb380b3c50 0x7fdb380b6110 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:08.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:08.038+0000 7fdb56fff640 1 --2- 172.21.15.79:0/986884081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb50103850 0x7fdb50198ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:08.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:08.038+0000 7fdb56fff640 1 -- 172.21.15.79:0/986884081 >> 172.21.15.79:0/986884081 conn(0x7fdb500fd440 msgr2=0x7fdb500fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:08.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:08.038+0000 7fdb56fff640 1 -- 172.21.15.79:0/986884081 shutdown_connections 2024-08-20T01:35:08.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:08.038+0000 7fdb56fff640 1 -- 172.21.15.79:0/986884081 wait complete. 2024-08-20T01:35:08.363 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:35:08 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: 2024-08-20T01:35:08.021+0000 7f27c99cc640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-20T01:35:08.363 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:35:08 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: 2024-08-20T01:35:08.022+0000 7f27c99cc640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-20T01:35:08.363 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:35:08 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: 2024-08-20T01:35:08.022+0000 7f27c99cc640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-20T01:35:08.363 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:35:08 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: 2024-08-20T01:35:08.022+0000 7f27c99cc640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-20T01:35:08.363 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:35:08 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: 2024-08-20T01:35:08.022+0000 7f27c99cc640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-20T01:35:08.659 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:08 smithi079 ceph-mon[18656]: pgmap v279: 97 pgs: 97 active+clean; 583 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s wr, 11 op/s 2024-08-20T01:35:08.687 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-08-20T01:35:08.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:08 smithi081 ceph-mon[22209]: pgmap v279: 97 pgs: 97 active+clean; 583 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s wr, 11 op/s 2024-08-20T01:35:08.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:08 smithi175 ceph-mon[22392]: pgmap v279: 97 pgs: 97 active+clean; 583 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s wr, 11 op/s 2024-08-20T01:35:08.931 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:09.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.439+0000 7f84c568b640 1 -- 172.21.15.79:0/2142030377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84c01084c0 msgr2=0x7f84c0108900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:09.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.439+0000 7f84c568b640 1 --2- 172.21.15.79:0/2142030377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84c01084c0 0x7f84c0108900 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f84b4009900 tx=0x7f84b402a410 comp rx=0 tx=0).stop 2024-08-20T01:35:09.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.439+0000 7f84c568b640 1 -- 172.21.15.79:0/2142030377 shutdown_connections 2024-08-20T01:35:09.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.439+0000 7f84c568b640 1 --2- 172.21.15.79:0/2142030377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84c0108e40 0x7f84c010f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:09.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.439+0000 7f84c568b640 1 --2- 172.21.15.79:0/2142030377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84c01084c0 0x7f84c0108900 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:09.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.439+0000 7f84c568b640 1 --2- 172.21.15.79:0/2142030377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84c0102ab0 0x7f84c0102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:09.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.439+0000 7f84c568b640 1 -- 172.21.15.79:0/2142030377 >> 172.21.15.79:0/2142030377 conn(0x7f84c00fe500 msgr2=0x7f84c0100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:09.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.439+0000 7f84c568b640 1 -- 172.21.15.79:0/2142030377 shutdown_connections 2024-08-20T01:35:09.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.439+0000 7f84c568b640 1 -- 172.21.15.79:0/2142030377 wait complete. 2024-08-20T01:35:09.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.440+0000 7f84c568b640 1 Processor -- start 2024-08-20T01:35:09.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.440+0000 7f84c568b640 1 -- start start 2024-08-20T01:35:09.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.440+0000 7f84c568b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84c0102ab0 0x7f84c0198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:09.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.440+0000 7f84c568b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84c01084c0 0x7f84c0199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:09.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.440+0000 7f84c568b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84c0108e40 0x7f84c019e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:09.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.440+0000 7f84c568b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f84c0112970 con 0x7f84c01084c0 2024-08-20T01:35:09.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.440+0000 7f84c568b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f84c01127f0 con 0x7f84c0102ab0 2024-08-20T01:35:09.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.440+0000 7f84c568b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f84c0112af0 con 0x7f84c0108e40 2024-08-20T01:35:09.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.440+0000 7f84be7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84c01084c0 0x7f84c0199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:09.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.440+0000 7f84be7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84c01084c0 0x7f84c0199420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47982/0 (socket says 172.21.15.79:47982) 2024-08-20T01:35:09.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.440+0000 7f84be7fc640 1 -- 172.21.15.79:0/1306916182 learned_addr learned my addr 172.21.15.79:0/1306916182 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:35:09.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.440+0000 7f84beffd640 1 --2- 172.21.15.79:0/1306916182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84c0102ab0 0x7f84c0198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:09.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.441+0000 7f84bf7fe640 1 --2- 172.21.15.79:0/1306916182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84c0108e40 0x7f84c019e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:09.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.441+0000 7f84be7fc640 1 -- 172.21.15.79:0/1306916182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84c0108e40 msgr2=0x7f84c019e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:09.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.441+0000 7f84be7fc640 1 --2- 172.21.15.79:0/1306916182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84c0108e40 0x7f84c019e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:09.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.441+0000 7f84be7fc640 1 -- 172.21.15.79:0/1306916182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84c0102ab0 msgr2=0x7f84c0198ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:09.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.441+0000 7f84be7fc640 1 --2- 172.21.15.79:0/1306916182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84c0102ab0 0x7f84c0198ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:09.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.441+0000 7f84be7fc640 1 -- 172.21.15.79:0/1306916182 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c019ef90 con 0x7f84c01084c0 2024-08-20T01:35:09.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.441+0000 7f84beffd640 1 --2- 172.21.15.79:0/1306916182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84c0102ab0 0x7f84c0198ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:35:09.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.441+0000 7f84be7fc640 1 --2- 172.21.15.79:0/1306916182 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84c01084c0 0x7f84c0199420 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f84b4009230 tx=0x7f84b4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:09.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.441+0000 7f84a7fff640 1 -- 172.21.15.79:0/1306916182 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b403f030 con 0x7f84c01084c0 2024-08-20T01:35:09.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.441+0000 7f84a7fff640 1 -- 172.21.15.79:0/1306916182 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f84b4003a80 con 0x7f84c01084c0 2024-08-20T01:35:09.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.441+0000 7f84c568b640 1 -- 172.21.15.79:0/1306916182 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84c019f220 con 0x7f84c01084c0 2024-08-20T01:35:09.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.441+0000 7f84a7fff640 1 -- 172.21.15.79:0/1306916182 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b4035070 con 0x7f84c01084c0 2024-08-20T01:35:09.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.441+0000 7f84c568b640 1 -- 172.21.15.79:0/1306916182 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84c01a5940 con 0x7f84c01084c0 2024-08-20T01:35:09.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.442+0000 7f84c568b640 1 -- 172.21.15.79:0/1306916182 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84c0102e90 con 0x7f84c01084c0 2024-08-20T01:35:09.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.444+0000 7f84a7fff640 1 -- 172.21.15.79:0/1306916182 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f84b4042030 con 0x7f84c01084c0 2024-08-20T01:35:09.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.444+0000 7f84a7fff640 1 --2- 172.21.15.79:0/1306916182 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f84a80b3bd0 0x7f84a80b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:09.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.444+0000 7f84beffd640 1 --2- 172.21.15.79:0/1306916182 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f84a80b3bd0 0x7f84a80b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:09.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.444+0000 7f84a7fff640 1 -- 172.21.15.79:0/1306916182 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7f84b4104450 con 0x7f84c01084c0 2024-08-20T01:35:09.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.445+0000 7f84beffd640 1 --2- 172.21.15.79:0/1306916182 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f84a80b3bd0 0x7f84a80b6090 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f84b0005fd0 tx=0x7f84b0009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:09.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.448+0000 7f84a7fff640 1 -- 172.21.15.79:0/1306916182 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f84b40cb5a0 con 0x7f84c01084c0 2024-08-20T01:35:09.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.460+0000 7f84a7fff640 1 -- 172.21.15.79:0/1306916182 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f84b40c7830 con 0x7f84c01084c0 2024-08-20T01:35:09.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.652+0000 7f84c568b640 1 -- 172.21.15.79:0/1306916182 --> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f84c010ac80 con 0x7f84a80b3bd0 2024-08-20T01:35:09.653 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:09 smithi079 ceph-mon[18656]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:35:09.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.677+0000 7f84a7fff640 1 -- 172.21.15.79:0/1306916182 <== mgr.14150 v2:172.21.15.79:6800/3038112779 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f84c010ac80 con 0x7f84a80b3bd0 2024-08-20T01:35:09.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.679+0000 7f84c568b640 1 -- 172.21.15.79:0/1306916182 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f84a80b3bd0 msgr2=0x7f84a80b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:09.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.679+0000 7f84c568b640 1 --2- 172.21.15.79:0/1306916182 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f84a80b3bd0 0x7f84a80b6090 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f84b0005fd0 tx=0x7f84b0009500 comp rx=0 tx=0).stop 2024-08-20T01:35:09.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.679+0000 7f84c568b640 1 -- 172.21.15.79:0/1306916182 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84c01084c0 msgr2=0x7f84c0199420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:09.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.679+0000 7f84c568b640 1 --2- 172.21.15.79:0/1306916182 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84c01084c0 0x7f84c0199420 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f84b4009230 tx=0x7f84b4004270 comp rx=0 tx=0).stop 2024-08-20T01:35:09.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.679+0000 7f84c568b640 1 -- 172.21.15.79:0/1306916182 shutdown_connections 2024-08-20T01:35:09.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.679+0000 7f84c568b640 1 --2- 172.21.15.79:0/1306916182 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f84a80b3bd0 0x7f84a80b6090 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:09.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.679+0000 7f84c568b640 1 --2- 172.21.15.79:0/1306916182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84c0108e40 0x7f84c019e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:09.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.679+0000 7f84c568b640 1 --2- 172.21.15.79:0/1306916182 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84c01084c0 0x7f84c0199420 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:09.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.679+0000 7f84c568b640 1 --2- 172.21.15.79:0/1306916182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84c0102ab0 0x7f84c0198ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:09.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.679+0000 7f84c568b640 1 -- 172.21.15.79:0/1306916182 >> 172.21.15.79:0/1306916182 conn(0x7f84c00fe500 msgr2=0x7f84c01008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:09.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.680+0000 7f84c568b640 1 -- 172.21.15.79:0/1306916182 shutdown_connections 2024-08-20T01:35:09.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:09.680+0000 7f84c568b640 1 -- 172.21.15.79:0/1306916182 wait complete. 2024-08-20T01:35:09.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:09 smithi081 ceph-mon[22209]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:35:09.790 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:09 smithi175 ceph-mon[22392]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:35:10.370 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-08-20T01:35:10.528 INFO:journalctl@ceph.mds.b.smithi081.stdout:Aug 20 01:35:10 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-b[51985]: 2024-08-20T01:35:10.268+0000 7f249eb45640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-08-20T01:35:10.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:10 smithi081 ceph-mon[22209]: pgmap v280: 97 pgs: 97 active+clean; 590 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 5.6 KiB/s wr, 16 op/s 2024-08-20T01:35:10.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:10 smithi081 ceph-mon[22209]: mgrmap e17: x(active, since 7m), standbys: y, z 2024-08-20T01:35:10.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:10 smithi081 ceph-mon[22209]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:35:10.619 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:10.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:10 smithi079 ceph-mon[18656]: pgmap v280: 97 pgs: 97 active+clean; 590 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 5.6 KiB/s wr, 16 op/s 2024-08-20T01:35:10.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:10 smithi079 ceph-mon[18656]: mgrmap e17: x(active, since 7m), standbys: y, z 2024-08-20T01:35:10.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:10 smithi079 ceph-mon[18656]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:35:10.801 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:10 smithi175 ceph-mon[22392]: pgmap v280: 97 pgs: 97 active+clean; 590 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 5.6 KiB/s wr, 16 op/s 2024-08-20T01:35:10.802 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:10 smithi175 ceph-mon[22392]: mgrmap e17: x(active, since 7m), standbys: y, z 2024-08-20T01:35:10.802 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:10 smithi175 ceph-mon[22392]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:35:11.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.163+0000 7fb904110640 1 -- 172.21.15.79:0/3882857206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8fc1084c0 msgr2=0x7fb8fc108900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:11.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.163+0000 7fb904110640 1 --2- 172.21.15.79:0/3882857206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8fc1084c0 0x7fb8fc108900 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb8f8009900 tx=0x7fb8f802a410 comp rx=0 tx=0).stop 2024-08-20T01:35:11.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.163+0000 7fb904110640 1 -- 172.21.15.79:0/3882857206 shutdown_connections 2024-08-20T01:35:11.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.163+0000 7fb904110640 1 --2- 172.21.15.79:0/3882857206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8fc108e40 0x7fb8fc10f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:11.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.163+0000 7fb904110640 1 --2- 172.21.15.79:0/3882857206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8fc1084c0 0x7fb8fc108900 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:11.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.163+0000 7fb904110640 1 --2- 172.21.15.79:0/3882857206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8fc102ab0 0x7fb8fc102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:11.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.163+0000 7fb904110640 1 -- 172.21.15.79:0/3882857206 >> 172.21.15.79:0/3882857206 conn(0x7fb8fc0fe500 msgr2=0x7fb8fc100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:11.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.163+0000 7fb904110640 1 -- 172.21.15.79:0/3882857206 shutdown_connections 2024-08-20T01:35:11.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.163+0000 7fb904110640 1 -- 172.21.15.79:0/3882857206 wait complete. 2024-08-20T01:35:11.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.163+0000 7fb904110640 1 Processor -- start 2024-08-20T01:35:11.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.163+0000 7fb904110640 1 -- start start 2024-08-20T01:35:11.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.164+0000 7fb904110640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8fc102ab0 0x7fb8fc198f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:11.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.164+0000 7fb904110640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8fc1084c0 0x7fb8fc199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:11.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.164+0000 7fb904110640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8fc108e40 0x7fb8fc19e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:11.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.164+0000 7fb904110640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb8fc112970 con 0x7fb8fc102ab0 2024-08-20T01:35:11.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.164+0000 7fb904110640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb8fc1127f0 con 0x7fb8fc108e40 2024-08-20T01:35:11.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.164+0000 7fb904110640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb8fc112af0 con 0x7fb8fc1084c0 2024-08-20T01:35:11.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.164+0000 7fb901eac640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8fc102ab0 0x7fb8fc198f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:11.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.164+0000 7fb901eac640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8fc102ab0 0x7fb8fc198f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50122/0 (socket says 172.21.15.79:50122) 2024-08-20T01:35:11.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.164+0000 7fb901eac640 1 -- 172.21.15.79:0/283669560 learned_addr learned my addr 172.21.15.79:0/283669560 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:35:11.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.164+0000 7fb9016ab640 1 --2- 172.21.15.79:0/283669560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8fc1084c0 0x7fb8fc199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:11.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.164+0000 7fb9026ad640 1 --2- 172.21.15.79:0/283669560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8fc108e40 0x7fb8fc19e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:11.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.164+0000 7fb901eac640 1 -- 172.21.15.79:0/283669560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8fc1084c0 msgr2=0x7fb8fc199460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:11.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.164+0000 7fb901eac640 1 --2- 172.21.15.79:0/283669560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8fc1084c0 0x7fb8fc199460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:11.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.164+0000 7fb901eac640 1 -- 172.21.15.79:0/283669560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8fc108e40 msgr2=0x7fb8fc19e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:11.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.164+0000 7fb901eac640 1 --2- 172.21.15.79:0/283669560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8fc108e40 0x7fb8fc19e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:11.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.164+0000 7fb901eac640 1 -- 172.21.15.79:0/283669560 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8fc19efd0 con 0x7fb8fc102ab0 2024-08-20T01:35:11.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.164+0000 7fb901eac640 1 --2- 172.21.15.79:0/283669560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8fc102ab0 0x7fb8fc198f20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec00d950 tx=0x7fb8ec00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:11.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.164+0000 7fb8f2ffd640 1 -- 172.21.15.79:0/283669560 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec017070 con 0x7fb8fc102ab0 2024-08-20T01:35:11.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.164+0000 7fb904110640 1 -- 172.21.15.79:0/283669560 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8fc19f2c0 con 0x7fb8fc102ab0 2024-08-20T01:35:11.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.164+0000 7fb8f2ffd640 1 -- 172.21.15.79:0/283669560 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb8ec009c30 con 0x7fb8fc102ab0 2024-08-20T01:35:11.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.164+0000 7fb8f2ffd640 1 -- 172.21.15.79:0/283669560 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec00f620 con 0x7fb8fc102ab0 2024-08-20T01:35:11.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.164+0000 7fb904110640 1 -- 172.21.15.79:0/283669560 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8fc1a5b50 con 0x7fb8fc102ab0 2024-08-20T01:35:11.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.165+0000 7fb904110640 1 -- 172.21.15.79:0/283669560 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8fc103d60 con 0x7fb8fc102ab0 2024-08-20T01:35:11.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.167+0000 7fb8f2ffd640 1 -- 172.21.15.79:0/283669560 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fb8ec010460 con 0x7fb8fc102ab0 2024-08-20T01:35:11.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.168+0000 7fb8f2ffd640 1 --2- 172.21.15.79:0/283669560 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb8e80b3c60 0x7fb8e80b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:11.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.168+0000 7fb9016ab640 1 --2- 172.21.15.79:0/283669560 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb8e80b3c60 0x7fb8e80b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:11.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.168+0000 7fb8f2ffd640 1 -- 172.21.15.79:0/283669560 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7fb8ec0e38d0 con 0x7fb8fc102ab0 2024-08-20T01:35:11.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.169+0000 7fb9016ab640 1 --2- 172.21.15.79:0/283669560 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb8e80b3c60 0x7fb8e80b6120 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb8f80057c0 tx=0x7fb8f80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:11.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.171+0000 7fb8f2ffd640 1 -- 172.21.15.79:0/283669560 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fb8ec0aaef0 con 0x7fb8fc102ab0 2024-08-20T01:35:11.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.373+0000 7fb904110640 1 -- 172.21.15.79:0/283669560 --> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fb8fc0632c0 con 0x7fb8e80b3c60 2024-08-20T01:35:11.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.377+0000 7fb8f2ffd640 1 -- 172.21.15.79:0/283669560 <== mgr.14150 v2:172.21.15.79:6800/3038112779 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fb8fc0632c0 con 0x7fb8e80b3c60 2024-08-20T01:35:11.379 INFO:teuthology.orchestra.run.smithi079.stdout:/volumes/qa/sv_0/0a392478-c073-43eb-95a9-03dd7d2f4c34 2024-08-20T01:35:11.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.379+0000 7fb904110640 1 -- 172.21.15.79:0/283669560 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb8e80b3c60 msgr2=0x7fb8e80b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:11.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.379+0000 7fb904110640 1 --2- 172.21.15.79:0/283669560 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb8e80b3c60 0x7fb8e80b6120 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb8f80057c0 tx=0x7fb8f80058d0 comp rx=0 tx=0).stop 2024-08-20T01:35:11.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.380+0000 7fb904110640 1 -- 172.21.15.79:0/283669560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8fc102ab0 msgr2=0x7fb8fc198f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:11.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.380+0000 7fb904110640 1 --2- 172.21.15.79:0/283669560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8fc102ab0 0x7fb8fc198f20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec00d950 tx=0x7fb8ec00de10 comp rx=0 tx=0).stop 2024-08-20T01:35:11.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.380+0000 7fb904110640 1 -- 172.21.15.79:0/283669560 shutdown_connections 2024-08-20T01:35:11.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.380+0000 7fb904110640 1 --2- 172.21.15.79:0/283669560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8fc108e40 0x7fb8fc19e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:11.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.380+0000 7fb904110640 1 --2- 172.21.15.79:0/283669560 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb8e80b3c60 0x7fb8e80b6120 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:11.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.380+0000 7fb904110640 1 --2- 172.21.15.79:0/283669560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8fc1084c0 0x7fb8fc199460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:11.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.380+0000 7fb904110640 1 --2- 172.21.15.79:0/283669560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8fc102ab0 0x7fb8fc198f20 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:11.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.380+0000 7fb904110640 1 -- 172.21.15.79:0/283669560 >> 172.21.15.79:0/283669560 conn(0x7fb8fc0fe500 msgr2=0x7fb8fc1008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:11.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.380+0000 7fb904110640 1 -- 172.21.15.79:0/283669560 shutdown_connections 2024-08-20T01:35:11.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:11.380+0000 7fb904110640 1 -- 172.21.15.79:0/283669560 wait complete. 2024-08-20T01:35:11.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:11 smithi079 ceph-mon[18656]: pgmap v281: 97 pgs: 97 active+clean; 591 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5.3 KiB/s wr, 20 op/s 2024-08-20T01:35:11.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:11 smithi079 ceph-mon[18656]: from='client.14829 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:35:11.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:11 smithi081 ceph-mon[22209]: pgmap v281: 97 pgs: 97 active+clean; 591 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5.3 KiB/s wr, 20 op/s 2024-08-20T01:35:11.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:11 smithi081 ceph-mon[22209]: from='client.14829 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:35:11.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:11 smithi175 ceph-mon[22392]: pgmap v281: 97 pgs: 97 active+clean; 591 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5.3 KiB/s wr, 20 op/s 2024-08-20T01:35:11.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:11 smithi175 ceph-mon[22392]: from='client.14829 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:35:12.058 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-08-20T01:35:12.306 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:12.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:12.800+0000 7f065dbfe640 1 -- 172.21.15.79:0/877053552 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0658107d40 msgr2=0x7f065810e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:12.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:12.800+0000 7f065dbfe640 1 --2- 172.21.15.79:0/877053552 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0658107d40 0x7f065810e540 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0650009ca0 tx=0x7f065002a8c0 comp rx=0 tx=0).stop 2024-08-20T01:35:12.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:12.800+0000 7f065dbfe640 1 -- 172.21.15.79:0/877053552 shutdown_connections 2024-08-20T01:35:12.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:12.800+0000 7f065dbfe640 1 --2- 172.21.15.79:0/877053552 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0658107d40 0x7f065810e540 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:12.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:12.800+0000 7f065dbfe640 1 --2- 172.21.15.79:0/877053552 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06581073c0 0x7f0658107800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:12.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:12.800+0000 7f065dbfe640 1 --2- 172.21.15.79:0/877053552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06581019b0 0x7f0658101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:12.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:12.800+0000 7f065dbfe640 1 -- 172.21.15.79:0/877053552 >> 172.21.15.79:0/877053552 conn(0x7f06580fd420 msgr2=0x7f06580ff840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:12.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:12.800+0000 7f065dbfe640 1 -- 172.21.15.79:0/877053552 shutdown_connections 2024-08-20T01:35:12.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:12.800+0000 7f065dbfe640 1 -- 172.21.15.79:0/877053552 wait complete. 2024-08-20T01:35:12.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:12.801+0000 7f065dbfe640 1 Processor -- start 2024-08-20T01:35:12.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:12.801+0000 7f065dbfe640 1 -- start start 2024-08-20T01:35:12.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:12.801+0000 7f065dbfe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06581019b0 0x7f06580fd920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:12.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:12.801+0000 7f065dbfe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06581073c0 0x7f06580fde60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:12.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:12.801+0000 7f065dbfe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0658107d40 0x7f06580fe3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:12.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:12.801+0000 7f065dbfe640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0658111900 con 0x7f06581073c0 2024-08-20T01:35:12.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:12.801+0000 7f065dbfe640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0658111780 con 0x7f06581019b0 2024-08-20T01:35:12.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:12.801+0000 7f065dbfe640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0658111a80 con 0x7f0658107d40 2024-08-20T01:35:12.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:12.801+0000 7f064ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06581073c0 0x7f06580fde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:12.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:12.801+0000 7f064ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06581073c0 0x7f06580fde60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50150/0 (socket says 172.21.15.79:50150) 2024-08-20T01:35:12.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:12.801+0000 7f064ffff640 1 -- 172.21.15.79:0/2116673723 learned_addr learned my addr 172.21.15.79:0/2116673723 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:35:12.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:12.802+0000 7f0657fff640 1 --2- 172.21.15.79:0/2116673723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0658107d40 0x7f06580fe3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:12.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:12.802+0000 7f06577fe640 1 --2- 172.21.15.79:0/2116673723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06581019b0 0x7f06580fd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:12.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:12.802+0000 7f064ffff640 1 -- 172.21.15.79:0/2116673723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0658107d40 msgr2=0x7f06580fe3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:12.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:12.802+0000 7f064ffff640 1 --2- 172.21.15.79:0/2116673723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0658107d40 0x7f06580fe3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:12.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:12.802+0000 7f064ffff640 1 -- 172.21.15.79:0/2116673723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06581019b0 msgr2=0x7f06580fd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:12.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:12.802+0000 7f064ffff640 1 --2- 172.21.15.79:0/2116673723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06581019b0 0x7f06580fd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:12.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:12.802+0000 7f064ffff640 1 -- 172.21.15.79:0/2116673723 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06581a7280 con 0x7f06581073c0 2024-08-20T01:35:12.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:12.802+0000 7f06577fe640 1 --2- 172.21.15.79:0/2116673723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06581019b0 0x7f06580fd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:35:12.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:12.802+0000 7f064ffff640 1 --2- 172.21.15.79:0/2116673723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06581073c0 0x7f06580fde60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f064000d950 tx=0x7f064000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:12.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:12.802+0000 7f06557fa640 1 -- 172.21.15.79:0/2116673723 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0640017030 con 0x7f06581073c0 2024-08-20T01:35:12.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:12.802+0000 7f06557fa640 1 -- 172.21.15.79:0/2116673723 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0640004020 con 0x7f06581073c0 2024-08-20T01:35:12.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:12.802+0000 7f06557fa640 1 -- 172.21.15.79:0/2116673723 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06400055d0 con 0x7f06581073c0 2024-08-20T01:35:12.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:12.803+0000 7f065dbfe640 1 -- 172.21.15.79:0/2116673723 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06581a7570 con 0x7f06581073c0 2024-08-20T01:35:12.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:12.803+0000 7f065dbfe640 1 -- 172.21.15.79:0/2116673723 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06581a7a30 con 0x7f06581073c0 2024-08-20T01:35:12.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:12.803+0000 7f065dbfe640 1 -- 172.21.15.79:0/2116673723 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0658101d90 con 0x7f06581073c0 2024-08-20T01:35:12.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:12.805+0000 7f06557fa640 1 -- 172.21.15.79:0/2116673723 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f0640009a30 con 0x7f06581073c0 2024-08-20T01:35:12.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:12.805+0000 7f06557fa640 1 --2- 172.21.15.79:0/2116673723 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f06440b3ce0 0x7f06440b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:12.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:12.806+0000 7f06577fe640 1 --2- 172.21.15.79:0/2116673723 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f06440b3ce0 0x7f06440b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:12.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:12.806+0000 7f06557fa640 1 -- 172.21.15.79:0/2116673723 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7f06400e3340 con 0x7f06581073c0 2024-08-20T01:35:12.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:12.806+0000 7f06577fe640 1 --2- 172.21.15.79:0/2116673723 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f06440b3ce0 0x7f06440b61a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f06480058c0 tx=0x7f0648005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:12.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:12.809+0000 7f06557fa640 1 -- 172.21.15.79:0/2116673723 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f0640020070 con 0x7f06581073c0 2024-08-20T01:35:13.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:13.008+0000 7f065dbfe640 1 -- 172.21.15.79:0/2116673723 --> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f0658104980 con 0x7f06440b3ce0 2024-08-20T01:35:13.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:13.034+0000 7f06557fa640 1 -- 172.21.15.79:0/2116673723 <== mgr.14150 v2:172.21.15.79:6800/3038112779 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0658104980 con 0x7f06440b3ce0 2024-08-20T01:35:13.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:13.036+0000 7f065dbfe640 1 -- 172.21.15.79:0/2116673723 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f06440b3ce0 msgr2=0x7f06440b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:13.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:13.036+0000 7f065dbfe640 1 --2- 172.21.15.79:0/2116673723 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f06440b3ce0 0x7f06440b61a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f06480058c0 tx=0x7f0648005ec0 comp rx=0 tx=0).stop 2024-08-20T01:35:13.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:13.036+0000 7f065dbfe640 1 -- 172.21.15.79:0/2116673723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06581073c0 msgr2=0x7f06580fde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:13.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:13.036+0000 7f065dbfe640 1 --2- 172.21.15.79:0/2116673723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06581073c0 0x7f06580fde60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f064000d950 tx=0x7f064000de10 comp rx=0 tx=0).stop 2024-08-20T01:35:13.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:13.036+0000 7f065dbfe640 1 -- 172.21.15.79:0/2116673723 shutdown_connections 2024-08-20T01:35:13.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:13.036+0000 7f065dbfe640 1 --2- 172.21.15.79:0/2116673723 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f06440b3ce0 0x7f06440b61a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:13.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:13.036+0000 7f065dbfe640 1 --2- 172.21.15.79:0/2116673723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0658107d40 0x7f06580fe3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:13.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:13.036+0000 7f065dbfe640 1 --2- 172.21.15.79:0/2116673723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06581073c0 0x7f06580fde60 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:13.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:13.036+0000 7f065dbfe640 1 --2- 172.21.15.79:0/2116673723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06581019b0 0x7f06580fd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:13.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:13.036+0000 7f065dbfe640 1 -- 172.21.15.79:0/2116673723 >> 172.21.15.79:0/2116673723 conn(0x7f06580fd420 msgr2=0x7f065806b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:13.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:13.036+0000 7f065dbfe640 1 -- 172.21.15.79:0/2116673723 shutdown_connections 2024-08-20T01:35:13.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:13.036+0000 7f065dbfe640 1 -- 172.21.15.79:0/2116673723 wait complete. 2024-08-20T01:35:13.673 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-08-20T01:35:13.918 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:13.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:13 smithi079 ceph-mon[18656]: pgmap v282: 97 pgs: 97 active+clean; 591 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 4.8 KiB/s wr, 19 op/s 2024-08-20T01:35:13.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:13 smithi079 ceph-mon[18656]: from='client.14835 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:35:14.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:13 smithi081 ceph-mon[22209]: pgmap v282: 97 pgs: 97 active+clean; 591 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 4.8 KiB/s wr, 19 op/s 2024-08-20T01:35:14.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:13 smithi081 ceph-mon[22209]: from='client.14835 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:35:14.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:13 smithi175 ceph-mon[22392]: pgmap v282: 97 pgs: 97 active+clean; 591 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 4.8 KiB/s wr, 19 op/s 2024-08-20T01:35:14.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:13 smithi175 ceph-mon[22392]: from='client.14835 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:35:14.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.399+0000 7f9fa4086640 1 -- 172.21.15.79:0/2608991049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f9c108e60 msgr2=0x7f9f9c10f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:14.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.399+0000 7f9fa4086640 1 --2- 172.21.15.79:0/2608991049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f9c108e60 0x7f9f9c10f660 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9f94009ca0 tx=0x7f9f9402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:35:14.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.399+0000 7f9fa4086640 1 -- 172.21.15.79:0/2608991049 shutdown_connections 2024-08-20T01:35:14.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.399+0000 7f9fa4086640 1 --2- 172.21.15.79:0/2608991049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f9c108e60 0x7f9f9c10f660 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:14.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.399+0000 7f9fa4086640 1 --2- 172.21.15.79:0/2608991049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f9c1084e0 0x7f9f9c108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:14.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.399+0000 7f9fa4086640 1 --2- 172.21.15.79:0/2608991049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f9c102ad0 0x7f9f9c102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:14.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.399+0000 7f9fa4086640 1 -- 172.21.15.79:0/2608991049 >> 172.21.15.79:0/2608991049 conn(0x7f9f9c0fe540 msgr2=0x7f9f9c100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:14.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.399+0000 7f9fa4086640 1 -- 172.21.15.79:0/2608991049 shutdown_connections 2024-08-20T01:35:14.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.399+0000 7f9fa4086640 1 -- 172.21.15.79:0/2608991049 wait complete. 2024-08-20T01:35:14.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.400+0000 7f9fa4086640 1 Processor -- start 2024-08-20T01:35:14.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.400+0000 7f9fa4086640 1 -- start start 2024-08-20T01:35:14.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.400+0000 7f9fa4086640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f9c102ad0 0x7f9f9c198f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:14.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.400+0000 7f9fa4086640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f9c1084e0 0x7f9f9c199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:14.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.400+0000 7f9fa4086640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f9c108e60 0x7f9f9c19e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:14.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.400+0000 7f9fa4086640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9f9c112a20 con 0x7f9f9c102ad0 2024-08-20T01:35:14.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.400+0000 7f9fa4086640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9f9c1128a0 con 0x7f9f9c108e60 2024-08-20T01:35:14.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.400+0000 7f9fa4086640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9f9c112ba0 con 0x7f9f9c1084e0 2024-08-20T01:35:14.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.400+0000 7f9fa1e22640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f9c102ad0 0x7f9f9c198f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:14.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.400+0000 7f9fa1e22640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f9c102ad0 0x7f9f9c198f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50160/0 (socket says 172.21.15.79:50160) 2024-08-20T01:35:14.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.400+0000 7f9fa1e22640 1 -- 172.21.15.79:0/1347652302 learned_addr learned my addr 172.21.15.79:0/1347652302 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:35:14.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.400+0000 7f9fa2623640 1 --2- 172.21.15.79:0/1347652302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f9c108e60 0x7f9f9c19e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:14.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.400+0000 7f9fa1621640 1 --2- 172.21.15.79:0/1347652302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f9c1084e0 0x7f9f9c199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:14.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.400+0000 7f9fa1e22640 1 -- 172.21.15.79:0/1347652302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f9c1084e0 msgr2=0x7f9f9c199470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:14.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.400+0000 7f9fa1e22640 1 --2- 172.21.15.79:0/1347652302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f9c1084e0 0x7f9f9c199470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:14.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.400+0000 7f9fa1e22640 1 -- 172.21.15.79:0/1347652302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f9c108e60 msgr2=0x7f9f9c19e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:14.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.400+0000 7f9fa1e22640 1 --2- 172.21.15.79:0/1347652302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f9c108e60 0x7f9f9c19e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:14.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.400+0000 7f9fa1e22640 1 -- 172.21.15.79:0/1347652302 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f9c19efe0 con 0x7f9f9c102ad0 2024-08-20T01:35:14.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.401+0000 7f9fa1e22640 1 --2- 172.21.15.79:0/1347652302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f9c102ad0 0x7f9f9c198f30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9f9800b4a0 tx=0x7f9f9800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:14.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.401+0000 7f9f92ffd640 1 -- 172.21.15.79:0/1347652302 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f98014070 con 0x7f9f9c102ad0 2024-08-20T01:35:14.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.401+0000 7f9fa4086640 1 -- 172.21.15.79:0/1347652302 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f9c19f2d0 con 0x7f9f9c102ad0 2024-08-20T01:35:14.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.401+0000 7f9f92ffd640 1 -- 172.21.15.79:0/1347652302 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9f98010aa0 con 0x7f9f9c102ad0 2024-08-20T01:35:14.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.401+0000 7f9f92ffd640 1 -- 172.21.15.79:0/1347652302 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f98017b70 con 0x7f9f9c102ad0 2024-08-20T01:35:14.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.401+0000 7f9fa4086640 1 -- 172.21.15.79:0/1347652302 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f9c1a5b60 con 0x7f9f9c102ad0 2024-08-20T01:35:14.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.402+0000 7f9fa4086640 1 -- 172.21.15.79:0/1347652302 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f9c102eb0 con 0x7f9f9c102ad0 2024-08-20T01:35:14.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.403+0000 7f9f92ffd640 1 -- 172.21.15.79:0/1347652302 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f9f98017070 con 0x7f9f9c102ad0 2024-08-20T01:35:14.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.404+0000 7f9f92ffd640 1 --2- 172.21.15.79:0/1347652302 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9f880b3c60 0x7f9f880b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:14.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.404+0000 7f9fa1621640 1 --2- 172.21.15.79:0/1347652302 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9f880b3c60 0x7f9f880b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:14.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.404+0000 7f9f92ffd640 1 -- 172.21.15.79:0/1347652302 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7f9f980e3280 con 0x7f9f9c102ad0 2024-08-20T01:35:14.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.404+0000 7f9fa1621640 1 --2- 172.21.15.79:0/1347652302 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9f880b3c60 0x7f9f880b6120 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c005fd0 tx=0x7f9f8c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:14.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.408+0000 7f9f92ffd640 1 -- 172.21.15.79:0/1347652302 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f9f980aa930 con 0x7f9f9c102ad0 2024-08-20T01:35:14.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.610+0000 7f9fa4086640 1 -- 172.21.15.79:0/1347652302 --> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f9f9c10ac70 con 0x7f9f880b3c60 2024-08-20T01:35:14.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.615+0000 7f9f92ffd640 1 -- 172.21.15.79:0/1347652302 <== mgr.14150 v2:172.21.15.79:6800/3038112779 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f9f9c10ac70 con 0x7f9f880b3c60 2024-08-20T01:35:14.618 INFO:teuthology.orchestra.run.smithi079.stdout:/volumes/qa/sv_1/518a18ce-69ab-4472-8140-d4faaa8f37fd 2024-08-20T01:35:14.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.618+0000 7f9fa4086640 1 -- 172.21.15.79:0/1347652302 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9f880b3c60 msgr2=0x7f9f880b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:14.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.618+0000 7f9fa4086640 1 --2- 172.21.15.79:0/1347652302 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9f880b3c60 0x7f9f880b6120 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c005fd0 tx=0x7f9f8c005850 comp rx=0 tx=0).stop 2024-08-20T01:35:14.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.618+0000 7f9fa4086640 1 -- 172.21.15.79:0/1347652302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f9c102ad0 msgr2=0x7f9f9c198f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:14.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.618+0000 7f9fa4086640 1 --2- 172.21.15.79:0/1347652302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f9c102ad0 0x7f9f9c198f30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9f9800b4a0 tx=0x7f9f9800b960 comp rx=0 tx=0).stop 2024-08-20T01:35:14.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.618+0000 7f9fa4086640 1 -- 172.21.15.79:0/1347652302 shutdown_connections 2024-08-20T01:35:14.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.618+0000 7f9fa4086640 1 --2- 172.21.15.79:0/1347652302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f9c108e60 0x7f9f9c19e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:14.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.618+0000 7f9fa4086640 1 --2- 172.21.15.79:0/1347652302 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9f880b3c60 0x7f9f880b6120 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:14.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.618+0000 7f9fa4086640 1 --2- 172.21.15.79:0/1347652302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f9c1084e0 0x7f9f9c199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:14.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.618+0000 7f9fa4086640 1 --2- 172.21.15.79:0/1347652302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f9c102ad0 0x7f9f9c198f30 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:14.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.618+0000 7f9fa4086640 1 -- 172.21.15.79:0/1347652302 >> 172.21.15.79:0/1347652302 conn(0x7f9f9c0fe540 msgr2=0x7f9f9c100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:14.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.618+0000 7f9fa4086640 1 -- 172.21.15.79:0/1347652302 shutdown_connections 2024-08-20T01:35:14.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:14.618+0000 7f9fa4086640 1 -- 172.21.15.79:0/1347652302 wait complete. 2024-08-20T01:35:15.342 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:35:15.587 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:15.991 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:15 smithi079 ceph-mon[18656]: pgmap v283: 97 pgs: 97 active+clean; 623 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 7.7 KiB/s wr, 22 op/s 2024-08-20T01:35:15.992 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:15 smithi079 ceph-mon[18656]: from='client.14841 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:35:16.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:15 smithi081 ceph-mon[22209]: pgmap v283: 97 pgs: 97 active+clean; 623 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 7.7 KiB/s wr, 22 op/s 2024-08-20T01:35:16.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:15 smithi081 ceph-mon[22209]: from='client.14841 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:35:16.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.069+0000 7fc77eac6640 1 -- 172.21.15.79:0/4111744833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc778102a90 msgr2=0x7fc778102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:16.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.069+0000 7fc77eac6640 1 --2- 172.21.15.79:0/4111744833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc778102a90 0x7fc778102e70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc770009900 tx=0x7fc77002a410 comp rx=0 tx=0).stop 2024-08-20T01:35:16.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.070+0000 7fc77eac6640 1 -- 172.21.15.79:0/4111744833 shutdown_connections 2024-08-20T01:35:16.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.070+0000 7fc77eac6640 1 --2- 172.21.15.79:0/4111744833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc778108e20 0x7fc77810f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:16.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.070+0000 7fc77eac6640 1 --2- 172.21.15.79:0/4111744833 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7781084a0 0x7fc7781088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:16.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.070+0000 7fc77eac6640 1 --2- 172.21.15.79:0/4111744833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc778102a90 0x7fc778102e70 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:16.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.070+0000 7fc77eac6640 1 -- 172.21.15.79:0/4111744833 >> 172.21.15.79:0/4111744833 conn(0x7fc7780fe540 msgr2=0x7fc778100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:16.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.070+0000 7fc77eac6640 1 -- 172.21.15.79:0/4111744833 shutdown_connections 2024-08-20T01:35:16.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.070+0000 7fc77eac6640 1 -- 172.21.15.79:0/4111744833 wait complete. 2024-08-20T01:35:16.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.070+0000 7fc77eac6640 1 Processor -- start 2024-08-20T01:35:16.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.070+0000 7fc77eac6640 1 -- start start 2024-08-20T01:35:16.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.070+0000 7fc77eac6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc778102a90 0x7fc7780751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:16.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.070+0000 7fc77eac6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7781084a0 0x7fc778075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:16.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.070+0000 7fc77eac6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc778108e20 0x7fc778075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:16.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.070+0000 7fc77eac6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc778112990 con 0x7fc778108e20 2024-08-20T01:35:16.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.070+0000 7fc77eac6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc778112810 con 0x7fc7781084a0 2024-08-20T01:35:16.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.070+0000 7fc77eac6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc778112b10 con 0x7fc778102a90 2024-08-20T01:35:16.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.071+0000 7fc77d063640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc778108e20 0x7fc778075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:16.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.071+0000 7fc77d063640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc778108e20 0x7fc778075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50184/0 (socket says 172.21.15.79:50184) 2024-08-20T01:35:16.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.071+0000 7fc77d063640 1 -- 172.21.15.79:0/23771683 learned_addr learned my addr 172.21.15.79:0/23771683 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:35:16.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.071+0000 7fc77c862640 1 --2- 172.21.15.79:0/23771683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc778102a90 0x7fc7780751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:16.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.071+0000 7fc777fff640 1 --2- 172.21.15.79:0/23771683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7781084a0 0x7fc778075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:16.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.071+0000 7fc77d063640 1 -- 172.21.15.79:0/23771683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc778102a90 msgr2=0x7fc7780751d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:16.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.071+0000 7fc77d063640 1 --2- 172.21.15.79:0/23771683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc778102a90 0x7fc7780751d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:16.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.071+0000 7fc77d063640 1 -- 172.21.15.79:0/23771683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7781084a0 msgr2=0x7fc778075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:16.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.071+0000 7fc77d063640 1 --2- 172.21.15.79:0/23771683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7781084a0 0x7fc778075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:16.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.071+0000 7fc77d063640 1 -- 172.21.15.79:0/23771683 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7781a7340 con 0x7fc778108e20 2024-08-20T01:35:16.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.071+0000 7fc777fff640 1 --2- 172.21.15.79:0/23771683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7781084a0 0x7fc778075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:35:16.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.071+0000 7fc77c862640 1 --2- 172.21.15.79:0/23771683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc778102a90 0x7fc7780751d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:35:16.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.071+0000 7fc77d063640 1 --2- 172.21.15.79:0/23771683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc778108e20 0x7fc778075c50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc76800cad0 tx=0x7fc76800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:16.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.071+0000 7fc775ffb640 1 -- 172.21.15.79:0/23771683 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76800ae20 con 0x7fc778108e20 2024-08-20T01:35:16.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.071+0000 7fc775ffb640 1 -- 172.21.15.79:0/23771683 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc768005020 con 0x7fc778108e20 2024-08-20T01:35:16.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.071+0000 7fc77eac6640 1 -- 172.21.15.79:0/23771683 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7781a7630 con 0x7fc778108e20 2024-08-20T01:35:16.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.071+0000 7fc775ffb640 1 -- 172.21.15.79:0/23771683 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76800f6b0 con 0x7fc778108e20 2024-08-20T01:35:16.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.071+0000 7fc77eac6640 1 -- 172.21.15.79:0/23771683 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7781a7bf0 con 0x7fc778108e20 2024-08-20T01:35:16.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.072+0000 7fc77eac6640 1 -- 172.21.15.79:0/23771683 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc778102e70 con 0x7fc778108e20 2024-08-20T01:35:16.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.074+0000 7fc775ffb640 1 -- 172.21.15.79:0/23771683 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fc7680051d0 con 0x7fc778108e20 2024-08-20T01:35:16.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.075+0000 7fc775ffb640 1 --2- 172.21.15.79:0/23771683 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc7640b3ce0 0x7fc7640b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:16.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.075+0000 7fc775ffb640 1 -- 172.21.15.79:0/23771683 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7fc7680e40d0 con 0x7fc778108e20 2024-08-20T01:35:16.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.075+0000 7fc77c862640 1 --2- 172.21.15.79:0/23771683 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc7640b3ce0 0x7fc7640b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:16.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.075+0000 7fc77c862640 1 --2- 172.21.15.79:0/23771683 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc7640b3ce0 0x7fc7640b61a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc770000c00 tx=0x7fc770005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:16.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.078+0000 7fc775ffb640 1 -- 172.21.15.79:0/23771683 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fc768014030 con 0x7fc778108e20 2024-08-20T01:35:16.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:15 smithi175 ceph-mon[22392]: pgmap v283: 97 pgs: 97 active+clean; 623 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 7.7 KiB/s wr, 22 op/s 2024-08-20T01:35:16.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:15 smithi175 ceph-mon[22392]: from='client.14841 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:35:16.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.289+0000 7fc77eac6640 1 -- 172.21.15.79:0/23771683 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc77802e340 con 0x7fc778108e20 2024-08-20T01:35:16.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.289+0000 7fc775ffb640 1 -- 172.21.15.79:0/23771683 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11973 (secure 0 0 0) 0x7fc7680ab670 con 0x7fc778108e20 2024-08-20T01:35:16.294 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:35:16.295 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":27,"btime":"2024-08-20T01:35:06:437353+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14670,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/735082912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":735082912},{"type":"v1","addr":"172.21.15.79:6835","nonce":735082912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2150339873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2150339873},{"type":"v1","addr":"172.21.15.79:6837","nonce":2150339873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:34:55.133562+0000","modified":"2024-08-20T01:35:06.437339+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24539,"mds_1":24538,"mds_2":24523,"mds_3":24514,"mds_4":24512},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14724":{"gid":14724,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/1071242274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1071242274},{"type":"v1","addr":"172.21.15.79:6839","nonce":1071242274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14730":{"gid":14730,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6841/2448977611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":2448977611},{"type":"v1","addr":"172.21.15.79:6841","nonce":2448977611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/1257507005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1257507005},{"type":"v1","addr":"172.21.15.81:6833","nonce":1257507005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1499936216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1499936216},{"type":"v1","addr":"172.21.15.81:6835","nonce":1499936216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/1107229215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1107229215},{"type":"v1","addr":"172.21.15.175:6833","nonce":1107229215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6837/2073598870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2073598870},{"type":"v1","addr":"172.21.15.81:6837","nonce":2073598870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/2552601173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2552601173},{"type":"v1","addr":"172.21.15.175:6835","nonce":2552601173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6837/1767284089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1767284089},{"type":"v1","addr":"172.21.15.175:6837","nonce":1767284089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/1331748742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1331748742},{"type":"v1","addr":"172.21.15.175:6839","nonce":1331748742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/4098410583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":4098410583},{"type":"v1","addr":"172.21.15.81:6839","nonce":4098410583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24539,"qdb_cluster":[24539,24523,24514,24538,24512]},"id":1}]} 2024-08-20T01:35:16.295 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 27 2024-08-20T01:35:16.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.292+0000 7fc77eac6640 1 -- 172.21.15.79:0/23771683 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc7640b3ce0 msgr2=0x7fc7640b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:16.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.292+0000 7fc77eac6640 1 --2- 172.21.15.79:0/23771683 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc7640b3ce0 0x7fc7640b61a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc770000c00 tx=0x7fc770005a20 comp rx=0 tx=0).stop 2024-08-20T01:35:16.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.292+0000 7fc77eac6640 1 -- 172.21.15.79:0/23771683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc778108e20 msgr2=0x7fc778075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:16.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.292+0000 7fc77eac6640 1 --2- 172.21.15.79:0/23771683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc778108e20 0x7fc778075c50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc76800cad0 tx=0x7fc76800cf90 comp rx=0 tx=0).stop 2024-08-20T01:35:16.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.292+0000 7fc77eac6640 1 -- 172.21.15.79:0/23771683 shutdown_connections 2024-08-20T01:35:16.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.292+0000 7fc77eac6640 1 --2- 172.21.15.79:0/23771683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc778108e20 0x7fc778075c50 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:16.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.292+0000 7fc77eac6640 1 --2- 172.21.15.79:0/23771683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7781084a0 0x7fc778075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:16.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.292+0000 7fc77eac6640 1 --2- 172.21.15.79:0/23771683 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc7640b3ce0 0x7fc7640b61a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:16.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.292+0000 7fc77eac6640 1 --2- 172.21.15.79:0/23771683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc778102a90 0x7fc7780751d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:16.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.292+0000 7fc77eac6640 1 -- 172.21.15.79:0/23771683 >> 172.21.15.79:0/23771683 conn(0x7fc7780fe540 msgr2=0x7fc778100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:16.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.292+0000 7fc77eac6640 1 -- 172.21.15.79:0/23771683 shutdown_connections 2024-08-20T01:35:16.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:16.292+0000 7fc77eac6640 1 -- 172.21.15.79:0/23771683 wait complete. 2024-08-20T01:35:16.916 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-20T01:35:17.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:16 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/23771683' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:35:17.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:16 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/23771683' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:35:17.162 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:17.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:16 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/23771683' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:35:17.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.644+0000 7fcdef64c640 1 -- 172.21.15.79:0/1016991188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcde81039b0 msgr2=0x7fcde8103d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:17.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.644+0000 7fcdef64c640 1 --2- 172.21.15.79:0/1016991188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcde81039b0 0x7fcde8103d90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fcde4009900 tx=0x7fcde402a410 comp rx=0 tx=0).stop 2024-08-20T01:35:17.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.644+0000 7fcdef64c640 1 -- 172.21.15.79:0/1016991188 shutdown_connections 2024-08-20T01:35:17.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.644+0000 7fcdef64c640 1 --2- 172.21.15.79:0/1016991188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcde810ce10 0x7fcde810f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:17.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.644+0000 7fcdef64c640 1 --2- 172.21.15.79:0/1016991188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcde81042d0 0x7fcde810c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:17.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.645+0000 7fcdef64c640 1 --2- 172.21.15.79:0/1016991188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcde81039b0 0x7fcde8103d90 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:17.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.645+0000 7fcdef64c640 1 -- 172.21.15.79:0/1016991188 >> 172.21.15.79:0/1016991188 conn(0x7fcde80fd430 msgr2=0x7fcde80ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:17.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.645+0000 7fcdef64c640 1 -- 172.21.15.79:0/1016991188 shutdown_connections 2024-08-20T01:35:17.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.645+0000 7fcdef64c640 1 -- 172.21.15.79:0/1016991188 wait complete. 2024-08-20T01:35:17.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.645+0000 7fcdef64c640 1 Processor -- start 2024-08-20T01:35:17.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.645+0000 7fcdef64c640 1 -- start start 2024-08-20T01:35:17.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.645+0000 7fcdef64c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcde81039b0 0x7fcde8101660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:17.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.645+0000 7fcdef64c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcde81042d0 0x7fcde8101ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:17.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.645+0000 7fcdef64c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcde810ce10 0x7fcde81020e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:17.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.645+0000 7fcdef64c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcde8112990 con 0x7fcde810ce10 2024-08-20T01:35:17.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.645+0000 7fcdef64c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcde8112810 con 0x7fcde81042d0 2024-08-20T01:35:17.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.645+0000 7fcdef64c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcde8112b10 con 0x7fcde81039b0 2024-08-20T01:35:17.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.646+0000 7fcdedbe9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcde810ce10 0x7fcde81020e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:17.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.646+0000 7fcdedbe9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcde810ce10 0x7fcde81020e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50198/0 (socket says 172.21.15.79:50198) 2024-08-20T01:35:17.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.646+0000 7fcdedbe9640 1 -- 172.21.15.79:0/3794687284 learned_addr learned my addr 172.21.15.79:0/3794687284 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:35:17.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.646+0000 7fcdecbe7640 1 --2- 172.21.15.79:0/3794687284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcde81042d0 0x7fcde8101ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:17.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.646+0000 7fcded3e8640 1 --2- 172.21.15.79:0/3794687284 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcde81039b0 0x7fcde8101660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:17.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.646+0000 7fcdedbe9640 1 -- 172.21.15.79:0/3794687284 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcde81039b0 msgr2=0x7fcde8101660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:17.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.646+0000 7fcdedbe9640 1 --2- 172.21.15.79:0/3794687284 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcde81039b0 0x7fcde8101660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:17.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.646+0000 7fcdedbe9640 1 -- 172.21.15.79:0/3794687284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcde81042d0 msgr2=0x7fcde8101ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:17.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.646+0000 7fcdedbe9640 1 --2- 172.21.15.79:0/3794687284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcde81042d0 0x7fcde8101ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:17.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.646+0000 7fcdedbe9640 1 -- 172.21.15.79:0/3794687284 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcde81a73a0 con 0x7fcde810ce10 2024-08-20T01:35:17.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.646+0000 7fcded3e8640 1 --2- 172.21.15.79:0/3794687284 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcde81039b0 0x7fcde8101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:35:17.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.646+0000 7fcdedbe9640 1 --2- 172.21.15.79:0/3794687284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcde810ce10 0x7fcde81020e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcde000cad0 tx=0x7fcde000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:17.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.646+0000 7fcdde7fc640 1 -- 172.21.15.79:0/3794687284 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde000ae20 con 0x7fcde810ce10 2024-08-20T01:35:17.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.646+0000 7fcdde7fc640 1 -- 172.21.15.79:0/3794687284 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcde0005020 con 0x7fcde810ce10 2024-08-20T01:35:17.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.646+0000 7fcdef64c640 1 -- 172.21.15.79:0/3794687284 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcde81a7690 con 0x7fcde810ce10 2024-08-20T01:35:17.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.646+0000 7fcdde7fc640 1 -- 172.21.15.79:0/3794687284 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde000f6b0 con 0x7fcde810ce10 2024-08-20T01:35:17.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.646+0000 7fcdef64c640 1 -- 172.21.15.79:0/3794687284 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcde81a7c00 con 0x7fcde810ce10 2024-08-20T01:35:17.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.647+0000 7fcdef64c640 1 -- 172.21.15.79:0/3794687284 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcde8103d90 con 0x7fcde810ce10 2024-08-20T01:35:17.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.649+0000 7fcdde7fc640 1 -- 172.21.15.79:0/3794687284 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fcde00051d0 con 0x7fcde810ce10 2024-08-20T01:35:17.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.649+0000 7fcdde7fc640 1 --2- 172.21.15.79:0/3794687284 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fcdd40b3c60 0x7fcdd40b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:17.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.649+0000 7fcded3e8640 1 --2- 172.21.15.79:0/3794687284 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fcdd40b3c60 0x7fcdd40b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:17.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.649+0000 7fcdde7fc640 1 -- 172.21.15.79:0/3794687284 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7fcde00e4010 con 0x7fcde810ce10 2024-08-20T01:35:17.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.650+0000 7fcded3e8640 1 --2- 172.21.15.79:0/3794687284 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fcdd40b3c60 0x7fcdd40b6120 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcde4000c00 tx=0x7fcde4032d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:17.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.652+0000 7fcdde7fc640 1 -- 172.21.15.79:0/3794687284 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fcde0014030 con 0x7fcde810ce10 2024-08-20T01:35:17.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.831+0000 7fcdef64c640 1 -- 172.21.15.79:0/3794687284 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcde8102960 con 0x7fcde810ce10 2024-08-20T01:35:17.833 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:17 smithi079 ceph-mon[18656]: pgmap v284: 97 pgs: 97 active+clean; 623 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 6.7 KiB/s wr, 21 op/s 2024-08-20T01:35:17.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.833+0000 7fcdde7fc640 1 -- 172.21.15.79:0/3794687284 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+22243 (secure 0 0 0) 0x7fcde00ab6b0 con 0x7fcde810ce10 2024-08-20T01:35:17.835 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:35:17.835 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":72,"fsid":"28484e9a-5e93-11ef-bccf-c7b262605968","created":"2024-08-20T01:27:07.792689+0000","modified":"2024-08-20T01:34:55.133612+0000","last_up_change":"2024-08-20T01:34:05.838937+0000","last_in_change":"2024-08-20T01:33:43.645153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-20T01:30:30.693903+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-20T01:34:50.585939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-20T01:34:52.980599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ccdbeb3d-bb9d-4275-ad7e-49f2cc1222cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6803","nonce":1274927648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6805","nonce":1274927648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6809","nonce":1274927648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6807","nonce":1274927648}]},"public_addr":"172.21.15.79:6803/1274927648","cluster_addr":"172.21.15.79:6805/1274927648","heartbeat_back_addr":"172.21.15.79:6809/1274927648","heartbeat_front_addr":"172.21.15.79:6807/1274927648","state":["exists","up"]},{"osd":1,"uuid":"0906bc46-f89d-482d-9402-43d17e4246a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6801","nonce":1174012328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6803","nonce":1174012328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6807","nonce":1174012328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6805","nonce":1174012328}]},"public_addr":"172.21.15.81:6801/1174012328","cluster_addr":"172.21.15.81:6803/1174012328","heartbeat_back_addr":"172.21.15.81:6807/1174012328","heartbeat_front_addr":"172.21.15.81:6805/1174012328","state":["exists","up"]},{"osd":2,"uuid":"11d8fb9d-cb2c-41c8-994c-603a1d8e01a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6801","nonce":1132306232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6803","nonce":1132306232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6807","nonce":1132306232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6805","nonce":1132306232}]},"public_addr":"172.21.15.175:6801/1132306232","cluster_addr":"172.21.15.175:6803/1132306232","heartbeat_back_addr":"172.21.15.175:6807/1132306232","heartbeat_front_addr":"172.21.15.175:6805/1132306232","state":["exists","up"]},{"osd":3,"uuid":"29e35242-957f-404b-b99e-d4dd0045c35d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6811","nonce":1364181822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6813","nonce":1364181822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6817","nonce":1364181822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6815","nonce":1364181822}]},"public_addr":"172.21.15.79:6811/1364181822","cluster_addr":"172.21.15.79:6813/1364181822","heartbeat_back_addr":"172.21.15.79:6817/1364181822","heartbeat_front_addr":"172.21.15.79:6815/1364181822","state":["exists","up"]},{"osd":4,"uuid":"9139c469-270f-4465-8adb-1e748529fa68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6809","nonce":306873968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6811","nonce":306873968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6815","nonce":306873968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6813","nonce":306873968}]},"public_addr":"172.21.15.81:6809/306873968","cluster_addr":"172.21.15.81:6811/306873968","heartbeat_back_addr":"172.21.15.81:6815/306873968","heartbeat_front_addr":"172.21.15.81:6813/306873968","state":["exists","up"]},{"osd":5,"uuid":"6394e462-4510-45d6-bc99-8660085cb206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6809","nonce":3908133424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6811","nonce":3908133424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6815","nonce":3908133424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6813","nonce":3908133424}]},"public_addr":"172.21.15.175:6809/3908133424","cluster_addr":"172.21.15.175:6811/3908133424","heartbeat_back_addr":"172.21.15.175:6815/3908133424","heartbeat_front_addr":"172.21.15.175:6813/3908133424","state":["exists","up"]},{"osd":6,"uuid":"e8e51380-e2be-4c4c-82d8-d86306d9fc1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6819","nonce":3379368280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6821","nonce":3379368280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6825","nonce":3379368280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6823","nonce":3379368280}]},"public_addr":"172.21.15.79:6819/3379368280","cluster_addr":"172.21.15.79:6821/3379368280","heartbeat_back_addr":"172.21.15.79:6825/3379368280","heartbeat_front_addr":"172.21.15.79:6823/3379368280","state":["exists","up"]},{"osd":7,"uuid":"875f7876-a2ca-4254-a8cc-27eebb11cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6817","nonce":747356685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6819","nonce":747356685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6823","nonce":747356685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6821","nonce":747356685}]},"public_addr":"172.21.15.81:6817/747356685","cluster_addr":"172.21.15.81:6819/747356685","heartbeat_back_addr":"172.21.15.81:6823/747356685","heartbeat_front_addr":"172.21.15.81:6821/747356685","state":["exists","up"]},{"osd":8,"uuid":"d714a33b-8df5-411d-bc99-b33b4b27cc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6817","nonce":1537762925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6819","nonce":1537762925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6823","nonce":1537762925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6821","nonce":1537762925}]},"public_addr":"172.21.15.175:6817/1537762925","cluster_addr":"172.21.15.175:6819/1537762925","heartbeat_back_addr":"172.21.15.175:6823/1537762925","heartbeat_front_addr":"172.21.15.175:6821/1537762925","state":["exists","up"]},{"osd":9,"uuid":"82db8305-1d72-4bef-99d6-5486e4de5b03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6827","nonce":2400574113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6829","nonce":2400574113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6833","nonce":2400574113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6831","nonce":2400574113}]},"public_addr":"172.21.15.79:6827/2400574113","cluster_addr":"172.21.15.79:6829/2400574113","heartbeat_back_addr":"172.21.15.79:6833/2400574113","heartbeat_front_addr":"172.21.15.79:6831/2400574113","state":["exists","up"]},{"osd":10,"uuid":"797e1e3f-12b5-4958-9e1f-f796cffaaf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6825","nonce":4188407500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6827","nonce":4188407500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6831","nonce":4188407500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6829","nonce":4188407500}]},"public_addr":"172.21.15.81:6825/4188407500","cluster_addr":"172.21.15.81:6827/4188407500","heartbeat_back_addr":"172.21.15.81:6831/4188407500","heartbeat_front_addr":"172.21.15.81:6829/4188407500","state":["exists","up"]},{"osd":11,"uuid":"a4d218ae-5a41-4b34-9c4e-e795c4a6a16d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6825","nonce":451069549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6827","nonce":451069549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6831","nonce":451069549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6829","nonce":451069549}]},"public_addr":"172.21.15.175:6825/451069549","cluster_addr":"172.21.15.175:6827/451069549","heartbeat_back_addr":"172.21.15.175:6831/451069549","heartbeat_front_addr":"172.21.15.175:6829/451069549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:29:42.003425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:30:05.353547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:30:28.916727+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:30:52.845671+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:31:16.926826+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:31:39.840986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:32:04.013287+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:32:28.237482+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:32:51.270643+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:33:15.825156+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:33:40.037915+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:34:04.477377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:0/1750500064":"2024-08-21T01:27:52.389553+0000","172.21.15.79:0/103962305":"2024-08-21T01:27:52.389553+0000","172.21.15.79:6800/4045769179":"2024-08-21T01:27:29.643647+0000","172.21.15.79:0/525482354":"2024-08-21T01:27:52.389553+0000","172.21.15.79:6801/4045769179":"2024-08-21T01:27:29.643647+0000","172.21.15.79:0/1023212241":"2024-08-21T01:27:29.643647+0000","172.21.15.79:0/2368377219":"2024-08-21T01:27:29.643647+0000","172.21.15.79:6801/3302536522":"2024-08-21T01:27:52.389553+0000","172.21.15.79:6800/3302536522":"2024-08-21T01:27:52.389553+0000","172.21.15.79:0/3498829332":"2024-08-21T01:27:29.643647+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-20T01:35:17.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.836+0000 7fcdef64c640 1 -- 172.21.15.79:0/3794687284 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fcdd40b3c60 msgr2=0x7fcdd40b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:17.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.836+0000 7fcdef64c640 1 --2- 172.21.15.79:0/3794687284 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fcdd40b3c60 0x7fcdd40b6120 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcde4000c00 tx=0x7fcde4032d20 comp rx=0 tx=0).stop 2024-08-20T01:35:17.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.836+0000 7fcdef64c640 1 -- 172.21.15.79:0/3794687284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcde810ce10 msgr2=0x7fcde81020e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:17.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.836+0000 7fcdef64c640 1 --2- 172.21.15.79:0/3794687284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcde810ce10 0x7fcde81020e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcde000cad0 tx=0x7fcde000cf90 comp rx=0 tx=0).stop 2024-08-20T01:35:17.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.836+0000 7fcdef64c640 1 -- 172.21.15.79:0/3794687284 shutdown_connections 2024-08-20T01:35:17.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.836+0000 7fcdef64c640 1 --2- 172.21.15.79:0/3794687284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcde810ce10 0x7fcde81020e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:17.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.836+0000 7fcdef64c640 1 --2- 172.21.15.79:0/3794687284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcde81042d0 0x7fcde8101ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:17.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.836+0000 7fcdef64c640 1 --2- 172.21.15.79:0/3794687284 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fcdd40b3c60 0x7fcdd40b6120 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:17.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.836+0000 7fcdef64c640 1 --2- 172.21.15.79:0/3794687284 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcde81039b0 0x7fcde8101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:17.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.836+0000 7fcdef64c640 1 -- 172.21.15.79:0/3794687284 >> 172.21.15.79:0/3794687284 conn(0x7fcde80fd430 msgr2=0x7fcde80fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:17.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.836+0000 7fcdef64c640 1 -- 172.21.15.79:0/3794687284 shutdown_connections 2024-08-20T01:35:17.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:17.836+0000 7fcdef64c640 1 -- 172.21.15.79:0/3794687284 wait complete. 2024-08-20T01:35:18.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:17 smithi081 ceph-mon[22209]: pgmap v284: 97 pgs: 97 active+clean; 623 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 6.7 KiB/s wr, 21 op/s 2024-08-20T01:35:18.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:17 smithi175 ceph-mon[22392]: pgmap v284: 97 pgs: 97 active+clean; 623 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 6.7 KiB/s wr, 21 op/s 2024-08-20T01:35:18.552 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-20T01:35:18.552 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph pg dump --format=json 2024-08-20T01:35:18.794 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:19.031 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:18 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/3794687284' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:35:19.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:18 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/3794687284' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:35:19.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.255+0000 7f336d4e8640 1 -- 172.21.15.79:0/1431087598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f336810ce30 msgr2=0x7f336810f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:19.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.255+0000 7f336d4e8640 1 --2- 172.21.15.79:0/1431087598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f336810ce30 0x7f336810f290 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3360009ca0 tx=0x7f336002a8c0 comp rx=0 tx=0).stop 2024-08-20T01:35:19.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.255+0000 7f336d4e8640 1 -- 172.21.15.79:0/1431087598 shutdown_connections 2024-08-20T01:35:19.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.255+0000 7f336d4e8640 1 --2- 172.21.15.79:0/1431087598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f336810ce30 0x7f336810f290 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:19.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.255+0000 7f336d4e8640 1 --2- 172.21.15.79:0/1431087598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33681042f0 0x7f336810c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:19.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.255+0000 7f336d4e8640 1 --2- 172.21.15.79:0/1431087598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33681039d0 0x7f3368103db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:19.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.255+0000 7f336d4e8640 1 -- 172.21.15.79:0/1431087598 >> 172.21.15.79:0/1431087598 conn(0x7f33680fd430 msgr2=0x7f33680ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:19.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.255+0000 7f336d4e8640 1 -- 172.21.15.79:0/1431087598 shutdown_connections 2024-08-20T01:35:19.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.255+0000 7f336d4e8640 1 -- 172.21.15.79:0/1431087598 wait complete. 2024-08-20T01:35:19.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.256+0000 7f336d4e8640 1 Processor -- start 2024-08-20T01:35:19.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.256+0000 7f336d4e8640 1 -- start start 2024-08-20T01:35:19.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.256+0000 7f336d4e8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33681039d0 0x7f3368198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:19.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.256+0000 7f336d4e8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33681042f0 0x7f33681993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:19.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.256+0000 7f336d4e8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f336810ce30 0x7f336819e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:19.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.256+0000 7f336d4e8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f33681129a0 con 0x7f33681039d0 2024-08-20T01:35:19.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.256+0000 7f336d4e8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3368112820 con 0x7f336810ce30 2024-08-20T01:35:19.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.256+0000 7f336d4e8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3368112b20 con 0x7f33681042f0 2024-08-20T01:35:19.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.256+0000 7f3366ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33681039d0 0x7f3368198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:19.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.257+0000 7f3366ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33681039d0 0x7f3368198eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50210/0 (socket says 172.21.15.79:50210) 2024-08-20T01:35:19.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.257+0000 7f3366ffd640 1 -- 172.21.15.79:0/2763529996 learned_addr learned my addr 172.21.15.79:0/2763529996 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:35:19.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.257+0000 7f33667fc640 1 --2- 172.21.15.79:0/2763529996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33681042f0 0x7f33681993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:19.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.257+0000 7f3366ffd640 1 -- 172.21.15.79:0/2763529996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33681042f0 msgr2=0x7f33681993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:19.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.257+0000 7f33677fe640 1 --2- 172.21.15.79:0/2763529996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f336810ce30 0x7f336819e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:19.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.257+0000 7f3366ffd640 1 --2- 172.21.15.79:0/2763529996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33681042f0 0x7f33681993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:19.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.257+0000 7f3366ffd640 1 -- 172.21.15.79:0/2763529996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f336810ce30 msgr2=0x7f336819e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:19.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.257+0000 7f3366ffd640 1 --2- 172.21.15.79:0/2763529996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f336810ce30 0x7f336819e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:19.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.257+0000 7f3366ffd640 1 -- 172.21.15.79:0/2763529996 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f336819ef60 con 0x7f33681039d0 2024-08-20T01:35:19.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.257+0000 7f3366ffd640 1 --2- 172.21.15.79:0/2763529996 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33681039d0 0x7f3368198eb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f335800c890 tx=0x7f335800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:19.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.257+0000 7f334ffff640 1 -- 172.21.15.79:0/2763529996 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3358004220 con 0x7f33681039d0 2024-08-20T01:35:19.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.257+0000 7f334ffff640 1 -- 172.21.15.79:0/2763529996 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3358007e40 con 0x7f33681039d0 2024-08-20T01:35:19.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.257+0000 7f336d4e8640 1 -- 172.21.15.79:0/2763529996 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f336819f250 con 0x7f33681039d0 2024-08-20T01:35:19.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.257+0000 7f334ffff640 1 -- 172.21.15.79:0/2763529996 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3358004a00 con 0x7f33681039d0 2024-08-20T01:35:19.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.257+0000 7f336d4e8640 1 -- 172.21.15.79:0/2763529996 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33681a5910 con 0x7f33681039d0 2024-08-20T01:35:19.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.258+0000 7f336d4e8640 1 -- 172.21.15.79:0/2763529996 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3368103db0 con 0x7f33681039d0 2024-08-20T01:35:19.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.259+0000 7f334ffff640 1 -- 172.21.15.79:0/2763529996 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f33580079b0 con 0x7f33681039d0 2024-08-20T01:35:19.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.260+0000 7f334ffff640 1 --2- 172.21.15.79:0/2763529996 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f33500b3c60 0x7f33500b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:19.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.260+0000 7f33667fc640 1 --2- 172.21.15.79:0/2763529996 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f33500b3c60 0x7f33500b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:19.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.260+0000 7f334ffff640 1 -- 172.21.15.79:0/2763529996 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7f33580e39d0 con 0x7f33681039d0 2024-08-20T01:35:19.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.261+0000 7f33667fc640 1 --2- 172.21.15.79:0/2763529996 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f33500b3c60 0x7f33500b6120 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f335c0058c0 tx=0x7f335c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:19.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.264+0000 7f334ffff640 1 -- 172.21.15.79:0/2763529996 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f3358014030 con 0x7f33681039d0 2024-08-20T01:35:19.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:18 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/3794687284' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:35:19.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.435+0000 7f336d4e8640 1 -- 172.21.15.79:0/2763529996 --> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f33680ff750 con 0x7f33500b3c60 2024-08-20T01:35:19.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.440+0000 7f334ffff640 1 -- 172.21.15.79:0/2763529996 <== mgr.14150 v2:172.21.15.79:6800/3038112779 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258733 (secure 0 0 0) 0x7f33680ff750 con 0x7f33500b3c60 2024-08-20T01:35:19.445 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:35:19.447 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-08-20T01:35:19.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.443+0000 7f336d4e8640 1 -- 172.21.15.79:0/2763529996 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f33500b3c60 msgr2=0x7f33500b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:19.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.443+0000 7f336d4e8640 1 --2- 172.21.15.79:0/2763529996 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f33500b3c60 0x7f33500b6120 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f335c0058c0 tx=0x7f335c005850 comp rx=0 tx=0).stop 2024-08-20T01:35:19.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.443+0000 7f336d4e8640 1 -- 172.21.15.79:0/2763529996 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33681039d0 msgr2=0x7f3368198eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:19.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.444+0000 7f336d4e8640 1 --2- 172.21.15.79:0/2763529996 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33681039d0 0x7f3368198eb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f335800c890 tx=0x7f335800cd50 comp rx=0 tx=0).stop 2024-08-20T01:35:19.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.444+0000 7f336d4e8640 1 -- 172.21.15.79:0/2763529996 shutdown_connections 2024-08-20T01:35:19.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.444+0000 7f336d4e8640 1 --2- 172.21.15.79:0/2763529996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f336810ce30 0x7f336819e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:19.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.444+0000 7f336d4e8640 1 --2- 172.21.15.79:0/2763529996 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f33500b3c60 0x7f33500b6120 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:19.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.444+0000 7f336d4e8640 1 --2- 172.21.15.79:0/2763529996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33681042f0 0x7f33681993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:19.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.444+0000 7f336d4e8640 1 --2- 172.21.15.79:0/2763529996 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33681039d0 0x7f3368198eb0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:19.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.444+0000 7f336d4e8640 1 -- 172.21.15.79:0/2763529996 >> 172.21.15.79:0/2763529996 conn(0x7f33680fd430 msgr2=0x7f33680fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:19.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.444+0000 7f336d4e8640 1 -- 172.21.15.79:0/2763529996 shutdown_connections 2024-08-20T01:35:19.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:19.444+0000 7f336d4e8640 1 -- 172.21.15.79:0/2763529996 wait complete. 2024-08-20T01:35:20.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:19 smithi175 ceph-mon[22392]: pgmap v285: 97 pgs: 97 active+clean; 629 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.3 KiB/s wr, 21 op/s 2024-08-20T01:35:20.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:19 smithi175 ceph-mon[22392]: from='client.14859 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:35:20.140 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:19 smithi079 ceph-mon[18656]: pgmap v285: 97 pgs: 97 active+clean; 629 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.3 KiB/s wr, 21 op/s 2024-08-20T01:35:20.140 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:19 smithi079 ceph-mon[18656]: from='client.14859 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:35:20.168 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":285,"stamp":"2024-08-20T01:35:18.474332+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":643824,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":224,"num_read_kb":202,"num_write":355,"num_write_kb":2267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":292,"ondisk_log_size":292,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360640,"kb_used_data":11392,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124581184,"statfs":{"total":1151940427776,"available":1151571132416,"internally_reserved":0,"allocated":11665408,"data_stored":6434375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":357414203},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":47092,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":148,"num_read_kb":138,"num_write":108,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003128"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.373958+0000","last_change":"2024-08-20T01:34:54.368243+0000","last_active":"2024-08-20T01:34:55.373958+0000","last_peered":"2024-08-20T01:34:55.373958+0000","last_clean":"2024-08-20T01:34:55.373958+0000","last_became_active":"2024-08-20T01:34:54.367712+0000","last_became_peered":"2024-08-20T01:34:54.367712+0000","last_unstale":"2024-08-20T01:34:55.373958+0000","last_undegraded":"2024-08-20T01:34:55.373958+0000","last_fullsized":"2024-08-20T01:34:55.373958+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:48:31.179090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.370361+0000","last_change":"2024-08-20T01:34:54.371126+0000","last_active":"2024-08-20T01:34:55.370361+0000","last_peered":"2024-08-20T01:34:55.370361+0000","last_clean":"2024-08-20T01:34:55.370361+0000","last_became_active":"2024-08-20T01:34:54.370821+0000","last_became_peered":"2024-08-20T01:34:54.370821+0000","last_unstale":"2024-08-20T01:34:55.370361+0000","last_undegraded":"2024-08-20T01:34:55.370361+0000","last_fullsized":"2024-08-20T01:34:55.370361+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:37:41.175264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.369773+0000","last_change":"2024-08-20T01:34:54.373051+0000","last_active":"2024-08-20T01:34:55.369773+0000","last_peered":"2024-08-20T01:34:55.369773+0000","last_clean":"2024-08-20T01:34:55.369773+0000","last_became_active":"2024-08-20T01:34:54.372783+0000","last_became_peered":"2024-08-20T01:34:54.372783+0000","last_unstale":"2024-08-20T01:34:55.369773+0000","last_undegraded":"2024-08-20T01:34:55.369773+0000","last_fullsized":"2024-08-20T01:34:55.369773+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:12:49.630968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.356695+0000","last_change":"2024-08-20T01:34:54.372395+0000","last_active":"2024-08-20T01:34:55.356695+0000","last_peered":"2024-08-20T01:34:55.356695+0000","last_clean":"2024-08-20T01:34:55.356695+0000","last_became_active":"2024-08-20T01:34:54.371804+0000","last_became_peered":"2024-08-20T01:34:54.371804+0000","last_unstale":"2024-08-20T01:34:55.356695+0000","last_undegraded":"2024-08-20T01:34:55.356695+0000","last_fullsized":"2024-08-20T01:34:55.356695+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:01:14.395727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.368815+0000","last_change":"2024-08-20T01:34:54.379200+0000","last_active":"2024-08-20T01:34:55.368815+0000","last_peered":"2024-08-20T01:34:55.368815+0000","last_clean":"2024-08-20T01:34:55.368815+0000","last_became_active":"2024-08-20T01:34:54.378828+0000","last_became_peered":"2024-08-20T01:34:54.378828+0000","last_unstale":"2024-08-20T01:34:55.368815+0000","last_undegraded":"2024-08-20T01:34:55.368815+0000","last_fullsized":"2024-08-20T01:34:55.368815+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:27:09.672074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.368643+0000","last_change":"2024-08-20T01:34:54.377871+0000","last_active":"2024-08-20T01:34:55.368643+0000","last_peered":"2024-08-20T01:34:55.368643+0000","last_clean":"2024-08-20T01:34:55.368643+0000","last_became_active":"2024-08-20T01:34:54.376617+0000","last_became_peered":"2024-08-20T01:34:54.376617+0000","last_unstale":"2024-08-20T01:34:55.368643+0000","last_undegraded":"2024-08-20T01:34:55.368643+0000","last_fullsized":"2024-08-20T01:34:55.368643+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:17:09.740135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.369182+0000","last_change":"2024-08-20T01:34:54.373761+0000","last_active":"2024-08-20T01:34:55.369182+0000","last_peered":"2024-08-20T01:34:55.369182+0000","last_clean":"2024-08-20T01:34:55.369182+0000","last_became_active":"2024-08-20T01:34:54.372944+0000","last_became_peered":"2024-08-20T01:34:54.372944+0000","last_unstale":"2024-08-20T01:34:55.369182+0000","last_undegraded":"2024-08-20T01:34:55.369182+0000","last_fullsized":"2024-08-20T01:34:55.369182+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:21:44.477970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.371403+0000","last_change":"2024-08-20T01:34:54.375226+0000","last_active":"2024-08-20T01:34:55.371403+0000","last_peered":"2024-08-20T01:34:55.371403+0000","last_clean":"2024-08-20T01:34:55.371403+0000","last_became_active":"2024-08-20T01:34:54.374877+0000","last_became_peered":"2024-08-20T01:34:54.374877+0000","last_unstale":"2024-08-20T01:34:55.371403+0000","last_undegraded":"2024-08-20T01:34:55.371403+0000","last_fullsized":"2024-08-20T01:34:55.371403+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:19:11.121719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.372587+0000","last_change":"2024-08-20T01:34:54.378350+0000","last_active":"2024-08-20T01:34:55.372587+0000","last_peered":"2024-08-20T01:34:55.372587+0000","last_clean":"2024-08-20T01:34:55.372587+0000","last_became_active":"2024-08-20T01:34:54.376524+0000","last_became_peered":"2024-08-20T01:34:54.376524+0000","last_unstale":"2024-08-20T01:34:55.372587+0000","last_undegraded":"2024-08-20T01:34:55.372587+0000","last_fullsized":"2024-08-20T01:34:55.372587+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:50:03.179130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.369665+0000","last_change":"2024-08-20T01:34:54.376098+0000","last_active":"2024-08-20T01:34:55.369665+0000","last_peered":"2024-08-20T01:34:55.369665+0000","last_clean":"2024-08-20T01:34:55.369665+0000","last_became_active":"2024-08-20T01:34:54.375671+0000","last_became_peered":"2024-08-20T01:34:54.375671+0000","last_unstale":"2024-08-20T01:34:55.369665+0000","last_undegraded":"2024-08-20T01:34:55.369665+0000","last_fullsized":"2024-08-20T01:34:55.369665+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:43:14.876302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.370072+0000","last_change":"2024-08-20T01:34:54.374431+0000","last_active":"2024-08-20T01:34:55.370072+0000","last_peered":"2024-08-20T01:34:55.370072+0000","last_clean":"2024-08-20T01:34:55.370072+0000","last_became_active":"2024-08-20T01:34:54.374082+0000","last_became_peered":"2024-08-20T01:34:54.374082+0000","last_unstale":"2024-08-20T01:34:55.370072+0000","last_undegraded":"2024-08-20T01:34:55.370072+0000","last_fullsized":"2024-08-20T01:34:55.370072+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:11:10.046245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.356746+0000","last_change":"2024-08-20T01:34:54.372124+0000","last_active":"2024-08-20T01:34:55.356746+0000","last_peered":"2024-08-20T01:34:55.356746+0000","last_clean":"2024-08-20T01:34:55.356746+0000","last_became_active":"2024-08-20T01:34:54.371382+0000","last_became_peered":"2024-08-20T01:34:54.371382+0000","last_unstale":"2024-08-20T01:34:55.356746+0000","last_undegraded":"2024-08-20T01:34:55.356746+0000","last_fullsized":"2024-08-20T01:34:55.356746+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:29:38.715445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.355768+0000","last_change":"2024-08-20T01:34:54.372760+0000","last_active":"2024-08-20T01:34:55.355768+0000","last_peered":"2024-08-20T01:34:55.355768+0000","last_clean":"2024-08-20T01:34:55.355768+0000","last_became_active":"2024-08-20T01:34:54.372386+0000","last_became_peered":"2024-08-20T01:34:54.372386+0000","last_unstale":"2024-08-20T01:34:55.355768+0000","last_undegraded":"2024-08-20T01:34:55.355768+0000","last_fullsized":"2024-08-20T01:34:55.355768+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:30:32.873604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.369378+0000","last_change":"2024-08-20T01:34:54.371164+0000","last_active":"2024-08-20T01:34:55.369378+0000","last_peered":"2024-08-20T01:34:55.369378+0000","last_clean":"2024-08-20T01:34:55.369378+0000","last_became_active":"2024-08-20T01:34:54.370856+0000","last_became_peered":"2024-08-20T01:34:54.370856+0000","last_unstale":"2024-08-20T01:34:55.369378+0000","last_undegraded":"2024-08-20T01:34:55.369378+0000","last_fullsized":"2024-08-20T01:34:55.369378+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:14:26.803902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.369156+0000","last_change":"2024-08-20T01:34:54.369595+0000","last_active":"2024-08-20T01:34:55.369156+0000","last_peered":"2024-08-20T01:34:55.369156+0000","last_clean":"2024-08-20T01:34:55.369156+0000","last_became_active":"2024-08-20T01:34:54.369285+0000","last_became_peered":"2024-08-20T01:34:54.369285+0000","last_unstale":"2024-08-20T01:34:55.369156+0000","last_undegraded":"2024-08-20T01:34:55.369156+0000","last_fullsized":"2024-08-20T01:34:55.369156+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:53:16.965300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.371620+0000","last_change":"2024-08-20T01:34:54.366903+0000","last_active":"2024-08-20T01:34:55.371620+0000","last_peered":"2024-08-20T01:34:55.371620+0000","last_clean":"2024-08-20T01:34:55.371620+0000","last_became_active":"2024-08-20T01:34:54.366533+0000","last_became_peered":"2024-08-20T01:34:54.366533+0000","last_unstale":"2024-08-20T01:34:55.371620+0000","last_undegraded":"2024-08-20T01:34:55.371620+0000","last_fullsized":"2024-08-20T01:34:55.371620+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:11:23.025718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.374122+0000","last_change":"2024-08-20T01:34:54.368616+0000","last_active":"2024-08-20T01:34:55.374122+0000","last_peered":"2024-08-20T01:34:55.374122+0000","last_clean":"2024-08-20T01:34:55.374122+0000","last_became_active":"2024-08-20T01:34:54.368267+0000","last_became_peered":"2024-08-20T01:34:54.368267+0000","last_unstale":"2024-08-20T01:34:55.374122+0000","last_undegraded":"2024-08-20T01:34:55.374122+0000","last_fullsized":"2024-08-20T01:34:55.374122+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:53:09.035458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.368478+0000","last_change":"2024-08-20T01:34:54.369182+0000","last_active":"2024-08-20T01:34:55.368478+0000","last_peered":"2024-08-20T01:34:55.368478+0000","last_clean":"2024-08-20T01:34:55.368478+0000","last_became_active":"2024-08-20T01:34:54.368862+0000","last_became_peered":"2024-08-20T01:34:54.368862+0000","last_unstale":"2024-08-20T01:34:55.368478+0000","last_undegraded":"2024-08-20T01:34:55.368478+0000","last_fullsized":"2024-08-20T01:34:55.368478+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:31:16.013266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.372572+0000","last_change":"2024-08-20T01:34:54.368132+0000","last_active":"2024-08-20T01:34:55.372572+0000","last_peered":"2024-08-20T01:34:55.372572+0000","last_clean":"2024-08-20T01:34:55.372572+0000","last_became_active":"2024-08-20T01:34:54.366295+0000","last_became_peered":"2024-08-20T01:34:54.366295+0000","last_unstale":"2024-08-20T01:34:55.372572+0000","last_undegraded":"2024-08-20T01:34:55.372572+0000","last_fullsized":"2024-08-20T01:34:55.372572+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:52:23.928602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.371598+0000","last_change":"2024-08-20T01:34:54.372783+0000","last_active":"2024-08-20T01:34:55.371598+0000","last_peered":"2024-08-20T01:34:55.371598+0000","last_clean":"2024-08-20T01:34:55.371598+0000","last_became_active":"2024-08-20T01:34:54.371871+0000","last_became_peered":"2024-08-20T01:34:54.371871+0000","last_unstale":"2024-08-20T01:34:55.371598+0000","last_undegraded":"2024-08-20T01:34:55.371598+0000","last_fullsized":"2024-08-20T01:34:55.371598+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:03:16.118087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.355802+0000","last_change":"2024-08-20T01:34:54.366206+0000","last_active":"2024-08-20T01:34:55.355802+0000","last_peered":"2024-08-20T01:34:55.355802+0000","last_clean":"2024-08-20T01:34:55.355802+0000","last_became_active":"2024-08-20T01:34:54.365893+0000","last_became_peered":"2024-08-20T01:34:54.365893+0000","last_unstale":"2024-08-20T01:34:55.355802+0000","last_undegraded":"2024-08-20T01:34:55.355802+0000","last_fullsized":"2024-08-20T01:34:55.355802+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:39:22.610570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.372106+0000","last_change":"2024-08-20T01:34:54.368091+0000","last_active":"2024-08-20T01:34:55.372106+0000","last_peered":"2024-08-20T01:34:55.372106+0000","last_clean":"2024-08-20T01:34:55.372106+0000","last_became_active":"2024-08-20T01:34:54.367626+0000","last_became_peered":"2024-08-20T01:34:54.367626+0000","last_unstale":"2024-08-20T01:34:55.372106+0000","last_undegraded":"2024-08-20T01:34:55.372106+0000","last_fullsized":"2024-08-20T01:34:55.372106+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:52:34.157094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.371145+0000","last_change":"2024-08-20T01:34:54.370976+0000","last_active":"2024-08-20T01:34:55.371145+0000","last_peered":"2024-08-20T01:34:55.371145+0000","last_clean":"2024-08-20T01:34:55.371145+0000","last_became_active":"2024-08-20T01:34:54.368349+0000","last_became_peered":"2024-08-20T01:34:54.368349+0000","last_unstale":"2024-08-20T01:34:55.371145+0000","last_undegraded":"2024-08-20T01:34:55.371145+0000","last_fullsized":"2024-08-20T01:34:55.371145+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:53:48.846072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.357301+0000","last_change":"2024-08-20T01:34:54.379148+0000","last_active":"2024-08-20T01:34:55.357301+0000","last_peered":"2024-08-20T01:34:55.357301+0000","last_clean":"2024-08-20T01:34:55.357301+0000","last_became_active":"2024-08-20T01:34:54.378800+0000","last_became_peered":"2024-08-20T01:34:54.378800+0000","last_unstale":"2024-08-20T01:34:55.357301+0000","last_undegraded":"2024-08-20T01:34:55.357301+0000","last_fullsized":"2024-08-20T01:34:55.357301+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:42:47.382372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.371644+0000","last_change":"2024-08-20T01:34:54.376972+0000","last_active":"2024-08-20T01:34:55.371644+0000","last_peered":"2024-08-20T01:34:55.371644+0000","last_clean":"2024-08-20T01:34:55.371644+0000","last_became_active":"2024-08-20T01:34:54.376701+0000","last_became_peered":"2024-08-20T01:34:54.376701+0000","last_unstale":"2024-08-20T01:34:55.371644+0000","last_undegraded":"2024-08-20T01:34:55.371644+0000","last_fullsized":"2024-08-20T01:34:55.371644+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:19:12.897732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.373684+0000","last_change":"2024-08-20T01:34:54.372699+0000","last_active":"2024-08-20T01:34:55.373684+0000","last_peered":"2024-08-20T01:34:55.373684+0000","last_clean":"2024-08-20T01:34:55.373684+0000","last_became_active":"2024-08-20T01:34:54.371170+0000","last_became_peered":"2024-08-20T01:34:54.371170+0000","last_unstale":"2024-08-20T01:34:55.373684+0000","last_undegraded":"2024-08-20T01:34:55.373684+0000","last_fullsized":"2024-08-20T01:34:55.373684+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:18:00.373087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.371965+0000","last_change":"2024-08-20T01:34:54.373726+0000","last_active":"2024-08-20T01:34:55.371965+0000","last_peered":"2024-08-20T01:34:55.371965+0000","last_clean":"2024-08-20T01:34:55.371965+0000","last_became_active":"2024-08-20T01:34:54.373418+0000","last_became_peered":"2024-08-20T01:34:54.373418+0000","last_unstale":"2024-08-20T01:34:55.371965+0000","last_undegraded":"2024-08-20T01:34:55.371965+0000","last_fullsized":"2024-08-20T01:34:55.371965+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:55:28.791396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.355674+0000","last_change":"2024-08-20T01:34:54.371779+0000","last_active":"2024-08-20T01:34:55.355674+0000","last_peered":"2024-08-20T01:34:55.355674+0000","last_clean":"2024-08-20T01:34:55.355674+0000","last_became_active":"2024-08-20T01:34:54.370449+0000","last_became_peered":"2024-08-20T01:34:54.370449+0000","last_unstale":"2024-08-20T01:34:55.355674+0000","last_undegraded":"2024-08-20T01:34:55.355674+0000","last_fullsized":"2024-08-20T01:34:55.355674+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:03:22.153120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.370177+0000","last_change":"2024-08-20T01:34:54.369973+0000","last_active":"2024-08-20T01:34:55.370177+0000","last_peered":"2024-08-20T01:34:55.370177+0000","last_clean":"2024-08-20T01:34:55.370177+0000","last_became_active":"2024-08-20T01:34:54.369048+0000","last_became_peered":"2024-08-20T01:34:54.369048+0000","last_unstale":"2024-08-20T01:34:55.370177+0000","last_undegraded":"2024-08-20T01:34:55.370177+0000","last_fullsized":"2024-08-20T01:34:55.370177+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:52:02.127937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.372380+0000","last_change":"2024-08-20T01:34:54.369948+0000","last_active":"2024-08-20T01:34:55.372380+0000","last_peered":"2024-08-20T01:34:55.372380+0000","last_clean":"2024-08-20T01:34:55.372380+0000","last_became_active":"2024-08-20T01:34:54.367453+0000","last_became_peered":"2024-08-20T01:34:54.367453+0000","last_unstale":"2024-08-20T01:34:55.372380+0000","last_undegraded":"2024-08-20T01:34:55.372380+0000","last_fullsized":"2024-08-20T01:34:55.372380+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:09:38.800219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.372906+0000","last_change":"2024-08-20T01:34:54.373622+0000","last_active":"2024-08-20T01:34:55.372906+0000","last_peered":"2024-08-20T01:34:55.372906+0000","last_clean":"2024-08-20T01:34:55.372906+0000","last_became_active":"2024-08-20T01:34:54.373261+0000","last_became_peered":"2024-08-20T01:34:54.373261+0000","last_unstale":"2024-08-20T01:34:55.372906+0000","last_undegraded":"2024-08-20T01:34:55.372906+0000","last_fullsized":"2024-08-20T01:34:55.372906+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:21:03.471668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.372138+0000","last_change":"2024-08-20T01:34:54.374728+0000","last_active":"2024-08-20T01:34:55.372138+0000","last_peered":"2024-08-20T01:34:55.372138+0000","last_clean":"2024-08-20T01:34:55.372138+0000","last_became_active":"2024-08-20T01:34:54.374183+0000","last_became_peered":"2024-08-20T01:34:54.374183+0000","last_unstale":"2024-08-20T01:34:55.372138+0000","last_undegraded":"2024-08-20T01:34:55.372138+0000","last_fullsized":"2024-08-20T01:34:55.372138+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:39:40.203942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.368932+0000","last_change":"2024-08-20T01:34:54.372863+0000","last_active":"2024-08-20T01:34:55.368932+0000","last_peered":"2024-08-20T01:34:55.368932+0000","last_clean":"2024-08-20T01:34:55.368932+0000","last_became_active":"2024-08-20T01:34:54.372409+0000","last_became_peered":"2024-08-20T01:34:54.372409+0000","last_unstale":"2024-08-20T01:34:55.368932+0000","last_undegraded":"2024-08-20T01:34:55.368932+0000","last_fullsized":"2024-08-20T01:34:55.368932+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:22:51.676677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"72'5","reported_seq":38,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:16.464982+0000","last_change":"2024-08-20T01:34:52.343440+0000","last_active":"2024-08-20T01:35:16.464982+0000","last_peered":"2024-08-20T01:35:16.464982+0000","last_clean":"2024-08-20T01:35:16.464982+0000","last_became_active":"2024-08-20T01:34:52.343110+0000","last_became_peered":"2024-08-20T01:34:52.343110+0000","last_unstale":"2024-08-20T01:35:16.464982+0000","last_undegraded":"2024-08-20T01:35:16.464982+0000","last_fullsized":"2024-08-20T01:35:16.464982+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:46:51.406198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.357411+0000","last_change":"2024-08-20T01:34:54.379522+0000","last_active":"2024-08-20T01:34:55.357411+0000","last_peered":"2024-08-20T01:34:55.357411+0000","last_clean":"2024-08-20T01:34:55.357411+0000","last_became_active":"2024-08-20T01:34:54.378826+0000","last_became_peered":"2024-08-20T01:34:54.378826+0000","last_unstale":"2024-08-20T01:34:55.357411+0000","last_undegraded":"2024-08-20T01:34:55.357411+0000","last_fullsized":"2024-08-20T01:34:55.357411+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:49:59.985231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"72'7","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:04.435449+0000","last_change":"2024-08-20T01:34:52.344483+0000","last_active":"2024-08-20T01:35:04.435449+0000","last_peered":"2024-08-20T01:35:04.435449+0000","last_clean":"2024-08-20T01:35:04.435449+0000","last_became_active":"2024-08-20T01:34:52.343940+0000","last_became_peered":"2024-08-20T01:34:52.343940+0000","last_unstale":"2024-08-20T01:35:04.435449+0000","last_undegraded":"2024-08-20T01:35:04.435449+0000","last_fullsized":"2024-08-20T01:35:04.435449+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:19:53.480527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"72'3","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:03.422879+0000","last_change":"2024-08-20T01:34:52.340732+0000","last_active":"2024-08-20T01:35:03.422879+0000","last_peered":"2024-08-20T01:35:03.422879+0000","last_clean":"2024-08-20T01:35:03.422879+0000","last_became_active":"2024-08-20T01:34:52.340367+0000","last_became_peered":"2024-08-20T01:34:52.340367+0000","last_unstale":"2024-08-20T01:35:03.422879+0000","last_undegraded":"2024-08-20T01:35:03.422879+0000","last_fullsized":"2024-08-20T01:35:03.422879+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:33:17.751642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.371220+0000","last_change":"2024-08-20T01:34:54.370725+0000","last_active":"2024-08-20T01:34:55.371220+0000","last_peered":"2024-08-20T01:34:55.371220+0000","last_clean":"2024-08-20T01:34:55.371220+0000","last_became_active":"2024-08-20T01:34:54.370423+0000","last_became_peered":"2024-08-20T01:34:54.370423+0000","last_unstale":"2024-08-20T01:34:55.371220+0000","last_undegraded":"2024-08-20T01:34:55.371220+0000","last_fullsized":"2024-08-20T01:34:55.371220+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:03:30.081748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"72'3","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:05.442784+0000","last_change":"2024-08-20T01:34:52.348605+0000","last_active":"2024-08-20T01:35:05.442784+0000","last_peered":"2024-08-20T01:35:05.442784+0000","last_clean":"2024-08-20T01:35:05.442784+0000","last_became_active":"2024-08-20T01:34:52.348278+0000","last_became_peered":"2024-08-20T01:34:52.348278+0000","last_unstale":"2024-08-20T01:35:05.442784+0000","last_undegraded":"2024-08-20T01:35:05.442784+0000","last_fullsized":"2024-08-20T01:35:05.442784+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:19:40.243243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.368041+0000","last_change":"2024-08-20T01:34:54.365604+0000","last_active":"2024-08-20T01:34:55.368041+0000","last_peered":"2024-08-20T01:34:55.368041+0000","last_clean":"2024-08-20T01:34:55.368041+0000","last_became_active":"2024-08-20T01:34:54.365284+0000","last_became_peered":"2024-08-20T01:34:54.365284+0000","last_unstale":"2024-08-20T01:34:55.368041+0000","last_undegraded":"2024-08-20T01:34:55.368041+0000","last_fullsized":"2024-08-20T01:34:55.368041+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:41:57.017680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"72'4","reported_seq":47,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:17.465677+0000","last_change":"2024-08-20T01:34:52.344679+0000","last_active":"2024-08-20T01:35:17.465677+0000","last_peered":"2024-08-20T01:35:17.465677+0000","last_clean":"2024-08-20T01:35:17.465677+0000","last_became_active":"2024-08-20T01:34:52.344058+0000","last_became_peered":"2024-08-20T01:34:52.344058+0000","last_unstale":"2024-08-20T01:35:17.465677+0000","last_undegraded":"2024-08-20T01:35:17.465677+0000","last_fullsized":"2024-08-20T01:35:17.465677+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:27:40.079949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.372223+0000","last_change":"2024-08-20T01:34:54.369724+0000","last_active":"2024-08-20T01:34:55.372223+0000","last_peered":"2024-08-20T01:34:55.372223+0000","last_clean":"2024-08-20T01:34:55.372223+0000","last_became_active":"2024-08-20T01:34:54.369403+0000","last_became_peered":"2024-08-20T01:34:54.369403+0000","last_unstale":"2024-08-20T01:34:55.372223+0000","last_undegraded":"2024-08-20T01:34:55.372223+0000","last_fullsized":"2024-08-20T01:34:55.372223+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:31:22.382794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"72'4","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:05.444753+0000","last_change":"2024-08-20T01:34:52.346651+0000","last_active":"2024-08-20T01:35:05.444753+0000","last_peered":"2024-08-20T01:35:05.444753+0000","last_clean":"2024-08-20T01:35:05.444753+0000","last_became_active":"2024-08-20T01:34:52.346316+0000","last_became_peered":"2024-08-20T01:34:52.346316+0000","last_unstale":"2024-08-20T01:35:05.444753+0000","last_undegraded":"2024-08-20T01:35:05.444753+0000","last_fullsized":"2024-08-20T01:35:05.444753+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:48:34.382413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.370154+0000","last_change":"2024-08-20T01:34:54.375587+0000","last_active":"2024-08-20T01:34:55.370154+0000","last_peered":"2024-08-20T01:34:55.370154+0000","last_clean":"2024-08-20T01:34:55.370154+0000","last_became_active":"2024-08-20T01:34:54.374138+0000","last_became_peered":"2024-08-20T01:34:54.374138+0000","last_unstale":"2024-08-20T01:34:55.370154+0000","last_undegraded":"2024-08-20T01:34:55.370154+0000","last_fullsized":"2024-08-20T01:34:55.370154+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:02:46.817849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"72'5","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:04.433853+0000","last_change":"2024-08-20T01:34:52.559659+0000","last_active":"2024-08-20T01:35:04.433853+0000","last_peered":"2024-08-20T01:35:04.433853+0000","last_clean":"2024-08-20T01:35:04.433853+0000","last_became_active":"2024-08-20T01:34:52.559243+0000","last_became_peered":"2024-08-20T01:34:52.559243+0000","last_unstale":"2024-08-20T01:35:04.433853+0000","last_undegraded":"2024-08-20T01:35:04.433853+0000","last_fullsized":"2024-08-20T01:35:04.433853+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:49:02.314230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.372729+0000","last_change":"2024-08-20T01:34:54.372965+0000","last_active":"2024-08-20T01:34:55.372729+0000","last_peered":"2024-08-20T01:34:55.372729+0000","last_clean":"2024-08-20T01:34:55.372729+0000","last_became_active":"2024-08-20T01:34:54.372286+0000","last_became_peered":"2024-08-20T01:34:54.372286+0000","last_unstale":"2024-08-20T01:34:55.372729+0000","last_undegraded":"2024-08-20T01:34:55.372729+0000","last_fullsized":"2024-08-20T01:34:55.372729+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:32:45.178137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"72'24","reported_seq":73,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:17.469506+0000","last_change":"2024-08-20T01:34:52.348907+0000","last_active":"2024-08-20T01:35:17.469506+0000","last_peered":"2024-08-20T01:35:17.469506+0000","last_clean":"2024-08-20T01:35:17.469506+0000","last_became_active":"2024-08-20T01:34:52.347853+0000","last_became_peered":"2024-08-20T01:34:52.347853+0000","last_unstale":"2024-08-20T01:35:17.469506+0000","last_undegraded":"2024-08-20T01:35:17.469506+0000","last_fullsized":"2024-08-20T01:35:17.469506+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:19:31.142154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46800,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":30,"num_read_kb":60,"num_write":26,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.368849+0000","last_change":"2024-08-20T01:34:54.376493+0000","last_active":"2024-08-20T01:34:55.368849+0000","last_peered":"2024-08-20T01:34:55.368849+0000","last_clean":"2024-08-20T01:34:55.368849+0000","last_became_active":"2024-08-20T01:34:54.376160+0000","last_became_peered":"2024-08-20T01:34:54.376160+0000","last_unstale":"2024-08-20T01:34:55.368849+0000","last_undegraded":"2024-08-20T01:34:55.368849+0000","last_fullsized":"2024-08-20T01:34:55.368849+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:59:03.431731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"72'9","reported_seq":30,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:06.445779+0000","last_change":"2024-08-20T01:34:52.347516+0000","last_active":"2024-08-20T01:35:06.445779+0000","last_peered":"2024-08-20T01:35:06.445779+0000","last_clean":"2024-08-20T01:35:06.445779+0000","last_became_active":"2024-08-20T01:34:52.347134+0000","last_became_peered":"2024-08-20T01:34:52.347134+0000","last_unstale":"2024-08-20T01:35:06.445779+0000","last_undegraded":"2024-08-20T01:35:06.445779+0000","last_fullsized":"2024-08-20T01:35:06.445779+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:26:16.057472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.355520+0000","last_change":"2024-08-20T01:34:54.368083+0000","last_active":"2024-08-20T01:34:55.355520+0000","last_peered":"2024-08-20T01:34:55.355520+0000","last_clean":"2024-08-20T01:34:55.355520+0000","last_became_active":"2024-08-20T01:34:54.367815+0000","last_became_peered":"2024-08-20T01:34:54.367815+0000","last_unstale":"2024-08-20T01:34:55.355520+0000","last_undegraded":"2024-08-20T01:34:55.355520+0000","last_fullsized":"2024-08-20T01:34:55.355520+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:02:13.515114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"72'5","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:05.443230+0000","last_change":"2024-08-20T01:34:52.345104+0000","last_active":"2024-08-20T01:35:05.443230+0000","last_peered":"2024-08-20T01:35:05.443230+0000","last_clean":"2024-08-20T01:35:05.443230+0000","last_became_active":"2024-08-20T01:34:52.344776+0000","last_became_peered":"2024-08-20T01:34:52.344776+0000","last_unstale":"2024-08-20T01:35:05.443230+0000","last_undegraded":"2024-08-20T01:35:05.443230+0000","last_fullsized":"2024-08-20T01:35:05.443230+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:05:30.230328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.369267+0000","last_change":"2024-08-20T01:34:54.369341+0000","last_active":"2024-08-20T01:34:55.369267+0000","last_peered":"2024-08-20T01:34:55.369267+0000","last_clean":"2024-08-20T01:34:55.369267+0000","last_became_active":"2024-08-20T01:34:54.369040+0000","last_became_peered":"2024-08-20T01:34:54.369040+0000","last_unstale":"2024-08-20T01:34:55.369267+0000","last_undegraded":"2024-08-20T01:34:55.369267+0000","last_fullsized":"2024-08-20T01:34:55.369267+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:20:07.403778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"72'5","reported_seq":35,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:13.459850+0000","last_change":"2024-08-20T01:34:52.346787+0000","last_active":"2024-08-20T01:35:13.459850+0000","last_peered":"2024-08-20T01:35:13.459850+0000","last_clean":"2024-08-20T01:35:13.459850+0000","last_became_active":"2024-08-20T01:34:52.345713+0000","last_became_peered":"2024-08-20T01:34:52.345713+0000","last_unstale":"2024-08-20T01:35:13.459850+0000","last_undegraded":"2024-08-20T01:35:13.459850+0000","last_fullsized":"2024-08-20T01:35:13.459850+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:33:06.861899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.369087+0000","last_change":"2024-08-20T01:34:54.374153+0000","last_active":"2024-08-20T01:34:55.369087+0000","last_peered":"2024-08-20T01:34:55.369087+0000","last_clean":"2024-08-20T01:34:55.369087+0000","last_became_active":"2024-08-20T01:34:54.372804+0000","last_became_peered":"2024-08-20T01:34:54.372804+0000","last_unstale":"2024-08-20T01:34:55.369087+0000","last_undegraded":"2024-08-20T01:34:55.369087+0000","last_fullsized":"2024-08-20T01:34:55.369087+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:54:27.470643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"72'17","reported_seq":37,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:05.443203+0000","last_change":"2024-08-20T01:34:52.559701+0000","last_active":"2024-08-20T01:35:05.443203+0000","last_peered":"2024-08-20T01:35:05.443203+0000","last_clean":"2024-08-20T01:35:05.443203+0000","last_became_active":"2024-08-20T01:34:52.559378+0000","last_became_peered":"2024-08-20T01:34:52.559378+0000","last_unstale":"2024-08-20T01:35:05.443203+0000","last_undegraded":"2024-08-20T01:35:05.443203+0000","last_fullsized":"2024-08-20T01:35:05.443203+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:39:55.636492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.357500+0000","last_change":"2024-08-20T01:34:54.380037+0000","last_active":"2024-08-20T01:34:55.357500+0000","last_peered":"2024-08-20T01:34:55.357500+0000","last_clean":"2024-08-20T01:34:55.357500+0000","last_became_active":"2024-08-20T01:34:54.379715+0000","last_became_peered":"2024-08-20T01:34:54.379715+0000","last_unstale":"2024-08-20T01:34:55.357500+0000","last_undegraded":"2024-08-20T01:34:55.357500+0000","last_fullsized":"2024-08-20T01:34:55.357500+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:51:11.811646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"72'2","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:04.419708+0000","last_change":"2024-08-20T01:34:52.347574+0000","last_active":"2024-08-20T01:35:04.419708+0000","last_peered":"2024-08-20T01:35:04.419708+0000","last_clean":"2024-08-20T01:35:04.419708+0000","last_became_active":"2024-08-20T01:34:52.347250+0000","last_became_peered":"2024-08-20T01:34:52.347250+0000","last_unstale":"2024-08-20T01:35:04.419708+0000","last_undegraded":"2024-08-20T01:35:04.419708+0000","last_fullsized":"2024-08-20T01:35:04.419708+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:03:00.007548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.371970+0000","last_change":"2024-08-20T01:34:54.376383+0000","last_active":"2024-08-20T01:34:55.371970+0000","last_peered":"2024-08-20T01:34:55.371970+0000","last_clean":"2024-08-20T01:34:55.371970+0000","last_became_active":"2024-08-20T01:34:54.376044+0000","last_became_peered":"2024-08-20T01:34:54.376044+0000","last_unstale":"2024-08-20T01:34:55.371970+0000","last_undegraded":"2024-08-20T01:34:55.371970+0000","last_fullsized":"2024-08-20T01:34:55.371970+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:31:15.814776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"72'5","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:05.444257+0000","last_change":"2024-08-20T01:34:52.343441+0000","last_active":"2024-08-20T01:35:05.444257+0000","last_peered":"2024-08-20T01:35:05.444257+0000","last_clean":"2024-08-20T01:35:05.444257+0000","last_became_active":"2024-08-20T01:34:52.343120+0000","last_became_peered":"2024-08-20T01:34:52.343120+0000","last_unstale":"2024-08-20T01:35:05.444257+0000","last_undegraded":"2024-08-20T01:35:05.444257+0000","last_fullsized":"2024-08-20T01:35:05.444257+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:44:11.309626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.371039+0000","last_change":"2024-08-20T01:34:54.368986+0000","last_active":"2024-08-20T01:34:55.371039+0000","last_peered":"2024-08-20T01:34:55.371039+0000","last_clean":"2024-08-20T01:34:55.371039+0000","last_became_active":"2024-08-20T01:34:54.368611+0000","last_became_peered":"2024-08-20T01:34:54.368611+0000","last_unstale":"2024-08-20T01:34:55.371039+0000","last_undegraded":"2024-08-20T01:34:55.371039+0000","last_fullsized":"2024-08-20T01:34:55.371039+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:37:32.433584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"72'3","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:05.442623+0000","last_change":"2024-08-20T01:34:52.345863+0000","last_active":"2024-08-20T01:35:05.442623+0000","last_peered":"2024-08-20T01:35:05.442623+0000","last_clean":"2024-08-20T01:35:05.442623+0000","last_became_active":"2024-08-20T01:34:52.345555+0000","last_became_peered":"2024-08-20T01:34:52.345555+0000","last_unstale":"2024-08-20T01:35:05.442623+0000","last_undegraded":"2024-08-20T01:35:05.442623+0000","last_fullsized":"2024-08-20T01:35:05.442623+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:46:21.606019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"72'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:56.113469+0000","last_change":"2024-08-20T01:34:54.379699+0000","last_active":"2024-08-20T01:34:56.113469+0000","last_peered":"2024-08-20T01:34:56.113469+0000","last_clean":"2024-08-20T01:34:56.113469+0000","last_became_active":"2024-08-20T01:34:54.379197+0000","last_became_peered":"2024-08-20T01:34:54.379197+0000","last_unstale":"2024-08-20T01:34:56.113469+0000","last_undegraded":"2024-08-20T01:34:56.113469+0000","last_fullsized":"2024-08-20T01:34:56.113469+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:31:15.249200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"72'5","reported_seq":35,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:13.463752+0000","last_change":"2024-08-20T01:34:52.559520+0000","last_active":"2024-08-20T01:35:13.463752+0000","last_peered":"2024-08-20T01:35:13.463752+0000","last_clean":"2024-08-20T01:35:13.463752+0000","last_became_active":"2024-08-20T01:34:52.559180+0000","last_became_peered":"2024-08-20T01:34:52.559180+0000","last_unstale":"2024-08-20T01:35:13.463752+0000","last_undegraded":"2024-08-20T01:35:13.463752+0000","last_fullsized":"2024-08-20T01:35:13.463752+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:48:35.667441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.370245+0000","last_change":"2024-08-20T01:34:54.372709+0000","last_active":"2024-08-20T01:34:55.370245+0000","last_peered":"2024-08-20T01:34:55.370245+0000","last_clean":"2024-08-20T01:34:55.370245+0000","last_became_active":"2024-08-20T01:34:54.372277+0000","last_became_peered":"2024-08-20T01:34:54.372277+0000","last_unstale":"2024-08-20T01:34:55.370245+0000","last_undegraded":"2024-08-20T01:34:55.370245+0000","last_fullsized":"2024-08-20T01:34:55.370245+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:26:11.837805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":91,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.369340+0000","last_change":"2024-08-20T01:33:44.019475+0000","last_active":"2024-08-20T01:34:55.369340+0000","last_peered":"2024-08-20T01:34:55.369340+0000","last_clean":"2024-08-20T01:34:55.369340+0000","last_became_active":"2024-08-20T01:33:44.013614+0000","last_became_peered":"2024-08-20T01:33:44.013614+0000","last_unstale":"2024-08-20T01:34:55.369340+0000","last_undegraded":"2024-08-20T01:34:55.369340+0000","last_fullsized":"2024-08-20T01:34:55.369340+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:30:31.021505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:30:31.021505+0000","last_clean_scrub_stamp":"2024-08-20T01:30:31.021505+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:41:49.124707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"72'6","reported_seq":28,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:06.446376+0000","last_change":"2024-08-20T01:34:52.346409+0000","last_active":"2024-08-20T01:35:06.446376+0000","last_peered":"2024-08-20T01:35:06.446376+0000","last_clean":"2024-08-20T01:35:06.446376+0000","last_became_active":"2024-08-20T01:34:52.345821+0000","last_became_peered":"2024-08-20T01:34:52.345821+0000","last_unstale":"2024-08-20T01:35:06.446376+0000","last_undegraded":"2024-08-20T01:35:06.446376+0000","last_fullsized":"2024-08-20T01:35:06.446376+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:17:11.282558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.371414+0000","last_change":"2024-08-20T01:34:54.374804+0000","last_active":"2024-08-20T01:34:55.371414+0000","last_peered":"2024-08-20T01:34:55.371414+0000","last_clean":"2024-08-20T01:34:55.371414+0000","last_became_active":"2024-08-20T01:34:54.374252+0000","last_became_peered":"2024-08-20T01:34:54.374252+0000","last_unstale":"2024-08-20T01:34:55.371414+0000","last_undegraded":"2024-08-20T01:34:55.371414+0000","last_fullsized":"2024-08-20T01:34:55.371414+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:32:51.703703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"72'4","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:03.424877+0000","last_change":"2024-08-20T01:34:52.341399+0000","last_active":"2024-08-20T01:35:03.424877+0000","last_peered":"2024-08-20T01:35:03.424877+0000","last_clean":"2024-08-20T01:35:03.424877+0000","last_became_active":"2024-08-20T01:34:52.341034+0000","last_became_peered":"2024-08-20T01:34:52.341034+0000","last_unstale":"2024-08-20T01:35:03.424877+0000","last_undegraded":"2024-08-20T01:35:03.424877+0000","last_fullsized":"2024-08-20T01:35:03.424877+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:10:44.804836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.355403+0000","last_change":"2024-08-20T01:34:54.366567+0000","last_active":"2024-08-20T01:34:55.355403+0000","last_peered":"2024-08-20T01:34:55.355403+0000","last_clean":"2024-08-20T01:34:55.355403+0000","last_became_active":"2024-08-20T01:34:54.366298+0000","last_became_peered":"2024-08-20T01:34:54.366298+0000","last_unstale":"2024-08-20T01:34:55.355403+0000","last_undegraded":"2024-08-20T01:34:55.355403+0000","last_fullsized":"2024-08-20T01:34:55.355403+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:14:26.805902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"72'5","reported_seq":37,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:16.463026+0000","last_change":"2024-08-20T01:34:52.559166+0000","last_active":"2024-08-20T01:35:16.463026+0000","last_peered":"2024-08-20T01:35:16.463026+0000","last_clean":"2024-08-20T01:35:16.463026+0000","last_became_active":"2024-08-20T01:34:52.558652+0000","last_became_peered":"2024-08-20T01:34:52.558652+0000","last_unstale":"2024-08-20T01:35:16.463026+0000","last_undegraded":"2024-08-20T01:35:16.463026+0000","last_fullsized":"2024-08-20T01:35:16.463026+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:45:13.374924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.357411+0000","last_change":"2024-08-20T01:34:54.371193+0000","last_active":"2024-08-20T01:34:55.357411+0000","last_peered":"2024-08-20T01:34:55.357411+0000","last_clean":"2024-08-20T01:34:55.357411+0000","last_became_active":"2024-08-20T01:34:54.370869+0000","last_became_peered":"2024-08-20T01:34:54.370869+0000","last_unstale":"2024-08-20T01:34:55.357411+0000","last_undegraded":"2024-08-20T01:34:55.357411+0000","last_fullsized":"2024-08-20T01:34:55.357411+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:23:36.683049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"72'5","reported_seq":35,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:14.460402+0000","last_change":"2024-08-20T01:34:52.348815+0000","last_active":"2024-08-20T01:35:14.460402+0000","last_peered":"2024-08-20T01:35:14.460402+0000","last_clean":"2024-08-20T01:35:14.460402+0000","last_became_active":"2024-08-20T01:34:52.348437+0000","last_became_peered":"2024-08-20T01:34:52.348437+0000","last_unstale":"2024-08-20T01:35:14.460402+0000","last_undegraded":"2024-08-20T01:35:14.460402+0000","last_fullsized":"2024-08-20T01:35:14.460402+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:55:15.090721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.368839+0000","last_change":"2024-08-20T01:34:54.376049+0000","last_active":"2024-08-20T01:34:55.368839+0000","last_peered":"2024-08-20T01:34:55.368839+0000","last_clean":"2024-08-20T01:34:55.368839+0000","last_became_active":"2024-08-20T01:34:54.375680+0000","last_became_peered":"2024-08-20T01:34:54.375680+0000","last_unstale":"2024-08-20T01:34:55.368839+0000","last_undegraded":"2024-08-20T01:34:55.368839+0000","last_fullsized":"2024-08-20T01:34:55.368839+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:42:12.499850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"72'1","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.368355+0000","last_change":"2024-08-20T01:34:52.559823+0000","last_active":"2024-08-20T01:34:55.368355+0000","last_peered":"2024-08-20T01:34:55.368355+0000","last_clean":"2024-08-20T01:34:55.368355+0000","last_became_active":"2024-08-20T01:34:52.559293+0000","last_became_peered":"2024-08-20T01:34:52.559293+0000","last_unstale":"2024-08-20T01:34:55.368355+0000","last_undegraded":"2024-08-20T01:34:55.368355+0000","last_fullsized":"2024-08-20T01:34:55.368355+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:48:45.431937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"72'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:58.327468+0000","last_change":"2024-08-20T01:34:54.369686+0000","last_active":"2024-08-20T01:34:58.327468+0000","last_peered":"2024-08-20T01:34:58.327468+0000","last_clean":"2024-08-20T01:34:58.327468+0000","last_became_active":"2024-08-20T01:34:54.369343+0000","last_became_peered":"2024-08-20T01:34:54.369343+0000","last_unstale":"2024-08-20T01:34:58.327468+0000","last_undegraded":"2024-08-20T01:34:58.327468+0000","last_fullsized":"2024-08-20T01:34:58.327468+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:00:39.775809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"72'4","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:05.444293+0000","last_change":"2024-08-20T01:34:52.559098+0000","last_active":"2024-08-20T01:35:05.444293+0000","last_peered":"2024-08-20T01:35:05.444293+0000","last_clean":"2024-08-20T01:35:05.444293+0000","last_became_active":"2024-08-20T01:34:52.558684+0000","last_became_peered":"2024-08-20T01:34:52.558684+0000","last_unstale":"2024-08-20T01:35:05.444293+0000","last_undegraded":"2024-08-20T01:35:05.444293+0000","last_fullsized":"2024-08-20T01:35:05.444293+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:11:56.252973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.355689+0000","last_change":"2024-08-20T01:34:54.376275+0000","last_active":"2024-08-20T01:34:55.355689+0000","last_peered":"2024-08-20T01:34:55.355689+0000","last_clean":"2024-08-20T01:34:55.355689+0000","last_became_active":"2024-08-20T01:34:54.375797+0000","last_became_peered":"2024-08-20T01:34:54.375797+0000","last_unstale":"2024-08-20T01:34:55.355689+0000","last_undegraded":"2024-08-20T01:34:55.355689+0000","last_fullsized":"2024-08-20T01:34:55.355689+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:01:37.172855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"72'12","reported_seq":31,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:15.369567+0000","last_change":"2024-08-20T01:34:52.342207+0000","last_active":"2024-08-20T01:35:15.369567+0000","last_peered":"2024-08-20T01:35:15.369567+0000","last_clean":"2024-08-20T01:35:15.369567+0000","last_became_active":"2024-08-20T01:34:52.341878+0000","last_became_peered":"2024-08-20T01:34:52.341878+0000","last_unstale":"2024-08-20T01:35:15.369567+0000","last_undegraded":"2024-08-20T01:35:15.369567+0000","last_fullsized":"2024-08-20T01:35:15.369567+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:29:36.374725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.371792+0000","last_change":"2024-08-20T01:34:54.371162+0000","last_active":"2024-08-20T01:34:55.371792+0000","last_peered":"2024-08-20T01:34:55.371792+0000","last_clean":"2024-08-20T01:34:55.371792+0000","last_became_active":"2024-08-20T01:34:54.368442+0000","last_became_peered":"2024-08-20T01:34:54.368442+0000","last_unstale":"2024-08-20T01:34:55.371792+0000","last_undegraded":"2024-08-20T01:34:55.371792+0000","last_fullsized":"2024-08-20T01:34:55.371792+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:23:42.119533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"72'7","reported_seq":27,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:05.444042+0000","last_change":"2024-08-20T01:34:52.345551+0000","last_active":"2024-08-20T01:35:05.444042+0000","last_peered":"2024-08-20T01:35:05.444042+0000","last_clean":"2024-08-20T01:35:05.444042+0000","last_became_active":"2024-08-20T01:34:52.344212+0000","last_became_peered":"2024-08-20T01:34:52.344212+0000","last_unstale":"2024-08-20T01:35:05.444042+0000","last_undegraded":"2024-08-20T01:35:05.444042+0000","last_fullsized":"2024-08-20T01:35:05.444042+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:52:58.826394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.370514+0000","last_change":"2024-08-20T01:34:54.369468+0000","last_active":"2024-08-20T01:34:55.370514+0000","last_peered":"2024-08-20T01:34:55.370514+0000","last_clean":"2024-08-20T01:34:55.370514+0000","last_became_active":"2024-08-20T01:34:54.369152+0000","last_became_peered":"2024-08-20T01:34:54.369152+0000","last_unstale":"2024-08-20T01:34:55.370514+0000","last_undegraded":"2024-08-20T01:34:55.370514+0000","last_fullsized":"2024-08-20T01:34:55.370514+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:53:28.809714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"72'2","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:02.409086+0000","last_change":"2024-08-20T01:34:52.560529+0000","last_active":"2024-08-20T01:35:02.409086+0000","last_peered":"2024-08-20T01:35:02.409086+0000","last_clean":"2024-08-20T01:35:02.409086+0000","last_became_active":"2024-08-20T01:34:52.560141+0000","last_became_peered":"2024-08-20T01:34:52.560141+0000","last_unstale":"2024-08-20T01:35:02.409086+0000","last_undegraded":"2024-08-20T01:35:02.409086+0000","last_fullsized":"2024-08-20T01:35:02.409086+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:02:13.367700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.368580+0000","last_change":"2024-08-20T01:34:54.377963+0000","last_active":"2024-08-20T01:34:55.368580+0000","last_peered":"2024-08-20T01:34:55.368580+0000","last_clean":"2024-08-20T01:34:55.368580+0000","last_became_active":"2024-08-20T01:34:54.377645+0000","last_became_peered":"2024-08-20T01:34:54.377645+0000","last_unstale":"2024-08-20T01:34:55.368580+0000","last_undegraded":"2024-08-20T01:34:55.368580+0000","last_fullsized":"2024-08-20T01:34:55.368580+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:36:11.888293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"72'7","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:05.442261+0000","last_change":"2024-08-20T01:34:52.342262+0000","last_active":"2024-08-20T01:35:05.442261+0000","last_peered":"2024-08-20T01:35:05.442261+0000","last_clean":"2024-08-20T01:35:05.442261+0000","last_became_active":"2024-08-20T01:34:52.341919+0000","last_became_peered":"2024-08-20T01:34:52.341919+0000","last_unstale":"2024-08-20T01:35:05.442261+0000","last_undegraded":"2024-08-20T01:35:05.442261+0000","last_fullsized":"2024-08-20T01:35:05.442261+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:29:38.542146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.373298+0000","last_change":"2024-08-20T01:34:54.375741+0000","last_active":"2024-08-20T01:34:55.373298+0000","last_peered":"2024-08-20T01:34:55.373298+0000","last_clean":"2024-08-20T01:34:55.373298+0000","last_became_active":"2024-08-20T01:34:54.375409+0000","last_became_peered":"2024-08-20T01:34:54.375409+0000","last_unstale":"2024-08-20T01:34:55.373298+0000","last_undegraded":"2024-08-20T01:34:55.373298+0000","last_fullsized":"2024-08-20T01:34:55.373298+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:29:46.278762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"72'3","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:04.433907+0000","last_change":"2024-08-20T01:34:52.346296+0000","last_active":"2024-08-20T01:35:04.433907+0000","last_peered":"2024-08-20T01:35:04.433907+0000","last_clean":"2024-08-20T01:35:04.433907+0000","last_became_active":"2024-08-20T01:34:52.345535+0000","last_became_peered":"2024-08-20T01:34:52.345535+0000","last_unstale":"2024-08-20T01:35:04.433907+0000","last_undegraded":"2024-08-20T01:35:04.433907+0000","last_fullsized":"2024-08-20T01:35:04.433907+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:32:23.126530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.371499+0000","last_change":"2024-08-20T01:34:54.365720+0000","last_active":"2024-08-20T01:34:55.371499+0000","last_peered":"2024-08-20T01:34:55.371499+0000","last_clean":"2024-08-20T01:34:55.371499+0000","last_became_active":"2024-08-20T01:34:54.365406+0000","last_became_peered":"2024-08-20T01:34:54.365406+0000","last_unstale":"2024-08-20T01:34:55.371499+0000","last_undegraded":"2024-08-20T01:34:55.371499+0000","last_fullsized":"2024-08-20T01:34:55.371499+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:31:09.988882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"72'4","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:02.410363+0000","last_change":"2024-08-20T01:34:52.344263+0000","last_active":"2024-08-20T01:35:02.410363+0000","last_peered":"2024-08-20T01:35:02.410363+0000","last_clean":"2024-08-20T01:35:02.410363+0000","last_became_active":"2024-08-20T01:34:52.343706+0000","last_became_peered":"2024-08-20T01:34:52.343706+0000","last_unstale":"2024-08-20T01:35:02.410363+0000","last_undegraded":"2024-08-20T01:35:02.410363+0000","last_fullsized":"2024-08-20T01:35:02.410363+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:25:30.305116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.369628+0000","last_change":"2024-08-20T01:34:54.374564+0000","last_active":"2024-08-20T01:34:55.369628+0000","last_peered":"2024-08-20T01:34:55.369628+0000","last_clean":"2024-08-20T01:34:55.369628+0000","last_became_active":"2024-08-20T01:34:54.374136+0000","last_became_peered":"2024-08-20T01:34:54.374136+0000","last_unstale":"2024-08-20T01:34:55.369628+0000","last_undegraded":"2024-08-20T01:34:55.369628+0000","last_fullsized":"2024-08-20T01:34:55.369628+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:33:12.972430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.357877+0000","last_change":"2024-08-20T01:34:54.380373+0000","last_active":"2024-08-20T01:34:55.357877+0000","last_peered":"2024-08-20T01:34:55.357877+0000","last_clean":"2024-08-20T01:34:55.357877+0000","last_became_active":"2024-08-20T01:34:54.380033+0000","last_became_peered":"2024-08-20T01:34:54.380033+0000","last_unstale":"2024-08-20T01:34:55.357877+0000","last_undegraded":"2024-08-20T01:34:55.357877+0000","last_fullsized":"2024-08-20T01:34:55.357877+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:23:28.612871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"72'5","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:05.444627+0000","last_change":"2024-08-20T01:34:52.346174+0000","last_active":"2024-08-20T01:35:05.444627+0000","last_peered":"2024-08-20T01:35:05.444627+0000","last_clean":"2024-08-20T01:35:05.444627+0000","last_became_active":"2024-08-20T01:34:52.345677+0000","last_became_peered":"2024-08-20T01:34:52.345677+0000","last_unstale":"2024-08-20T01:35:05.444627+0000","last_undegraded":"2024-08-20T01:35:05.444627+0000","last_fullsized":"2024-08-20T01:35:05.444627+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:23:38.692225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.372541+0000","last_change":"2024-08-20T01:34:54.373515+0000","last_active":"2024-08-20T01:34:55.372541+0000","last_peered":"2024-08-20T01:34:55.372541+0000","last_clean":"2024-08-20T01:34:55.372541+0000","last_became_active":"2024-08-20T01:34:54.372954+0000","last_became_peered":"2024-08-20T01:34:54.372954+0000","last_unstale":"2024-08-20T01:34:55.372541+0000","last_undegraded":"2024-08-20T01:34:55.372541+0000","last_fullsized":"2024-08-20T01:34:55.372541+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:27:24.384924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"72'12","reported_seq":32,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:06.439392+0000","last_change":"2024-08-20T01:34:52.344089+0000","last_active":"2024-08-20T01:35:06.439392+0000","last_peered":"2024-08-20T01:35:06.439392+0000","last_clean":"2024-08-20T01:35:06.439392+0000","last_became_active":"2024-08-20T01:34:52.343354+0000","last_became_peered":"2024-08-20T01:34:52.343354+0000","last_unstale":"2024-08-20T01:35:06.439392+0000","last_undegraded":"2024-08-20T01:35:06.439392+0000","last_fullsized":"2024-08-20T01:35:06.439392+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:50:35.527307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.369966+0000","last_change":"2024-08-20T01:34:54.371931+0000","last_active":"2024-08-20T01:34:55.369966+0000","last_peered":"2024-08-20T01:34:55.369966+0000","last_clean":"2024-08-20T01:34:55.369966+0000","last_became_active":"2024-08-20T01:34:54.371385+0000","last_became_peered":"2024-08-20T01:34:54.371385+0000","last_unstale":"2024-08-20T01:34:55.369966+0000","last_undegraded":"2024-08-20T01:34:55.369966+0000","last_fullsized":"2024-08-20T01:34:55.369966+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:11:35.807145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"72'2","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.375060+0000","last_change":"2024-08-20T01:34:52.559127+0000","last_active":"2024-08-20T01:34:55.375060+0000","last_peered":"2024-08-20T01:34:55.375060+0000","last_clean":"2024-08-20T01:34:55.375060+0000","last_became_active":"2024-08-20T01:34:52.558834+0000","last_became_peered":"2024-08-20T01:34:52.558834+0000","last_unstale":"2024-08-20T01:34:55.375060+0000","last_undegraded":"2024-08-20T01:34:55.375060+0000","last_fullsized":"2024-08-20T01:34:55.375060+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:57:35.879486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.371546+0000","last_change":"2024-08-20T01:34:54.378164+0000","last_active":"2024-08-20T01:34:55.371546+0000","last_peered":"2024-08-20T01:34:55.371546+0000","last_clean":"2024-08-20T01:34:55.371546+0000","last_became_active":"2024-08-20T01:34:54.377863+0000","last_became_peered":"2024-08-20T01:34:54.377863+0000","last_unstale":"2024-08-20T01:34:55.371546+0000","last_undegraded":"2024-08-20T01:34:55.371546+0000","last_fullsized":"2024-08-20T01:34:55.371546+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:23:21.832692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"72'13","reported_seq":45,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:16.462431+0000","last_change":"2024-08-20T01:34:52.341730+0000","last_active":"2024-08-20T01:35:16.462431+0000","last_peered":"2024-08-20T01:35:16.462431+0000","last_clean":"2024-08-20T01:35:16.462431+0000","last_became_active":"2024-08-20T01:34:52.341407+0000","last_became_peered":"2024-08-20T01:34:52.341407+0000","last_unstale":"2024-08-20T01:35:16.462431+0000","last_undegraded":"2024-08-20T01:35:16.462431+0000","last_fullsized":"2024-08-20T01:35:16.462431+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:53:09.225154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":53222,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":148,"num_read_kb":138,"num_write":230,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":528384,"data_stored":159666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":198,"ondisk_log_size":198,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":66,"seq":283467841553,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717356,"statfs":{"total":95995035648,"available":95966572544,"internally_reserved":0,"allocated":790528,"data_stored":376912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":61,"seq":261993005079,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36788,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708364,"statfs":{"total":95995035648,"available":95957364736,"internally_reserved":0,"allocated":1478656,"data_stored":1014741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":55,"seq":236223201306,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717332,"statfs":{"total":95995035648,"available":95966547968,"internally_reserved":0,"allocated":815104,"data_stored":376842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":50,"seq":214748364831,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31976,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713176,"statfs":{"total":95995035648,"available":95962292224,"internally_reserved":0,"allocated":811008,"data_stored":377220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561060,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32560,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712592,"statfs":{"total":95995035648,"available":95961694208,"internally_reserved":0,"allocated":1409024,"data_stored":969347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":39,"seq":167503724586,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31964,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713188,"statfs":{"total":95995035648,"available":95962304512,"internally_reserved":0,"allocated":798720,"data_stored":376559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888111,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32572,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712580,"statfs":{"total":95995035648,"available":95961681920,"internally_reserved":0,"allocated":1421312,"data_stored":969025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084338,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27804,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717348,"statfs":{"total":95995035648,"available":95966564352,"internally_reserved":0,"allocated":798720,"data_stored":376420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247862,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717332,"statfs":{"total":95995035648,"available":95966547968,"internally_reserved":0,"allocated":815104,"data_stored":376384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444091,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":860160,"data_stored":418755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":847872,"data_stored":424272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738437,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":819200,"data_stored":377898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":48552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":48772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":48536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-20T01:35:20.173 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph pg dump --format=json 2024-08-20T01:35:20.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:19 smithi081 ceph-mon[22209]: pgmap v285: 97 pgs: 97 active+clean; 629 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.3 KiB/s wr, 21 op/s 2024-08-20T01:35:20.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:19 smithi081 ceph-mon[22209]: from='client.14859 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:35:20.415 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:20.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:20.879+0000 7f070d32a640 1 -- 172.21.15.79:0/815222359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07081019b0 msgr2=0x7f0708101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:20.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:20.879+0000 7f070d32a640 1 --2- 172.21.15.79:0/815222359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07081019b0 0x7f0708101d90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f06f8009900 tx=0x7f06f802a410 comp rx=0 tx=0).stop 2024-08-20T01:35:20.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:20.879+0000 7f070d32a640 1 -- 172.21.15.79:0/815222359 shutdown_connections 2024-08-20T01:35:20.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:20.879+0000 7f070d32a640 1 --2- 172.21.15.79:0/815222359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0708107d40 0x7f070810e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:20.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:20.879+0000 7f070d32a640 1 --2- 172.21.15.79:0/815222359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07081073c0 0x7f0708107800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:20.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:20.879+0000 7f070d32a640 1 --2- 172.21.15.79:0/815222359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07081019b0 0x7f0708101d90 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:20.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:20.879+0000 7f070d32a640 1 -- 172.21.15.79:0/815222359 >> 172.21.15.79:0/815222359 conn(0x7f07080fd420 msgr2=0x7f07080ff840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:20.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:20.880+0000 7f070d32a640 1 -- 172.21.15.79:0/815222359 shutdown_connections 2024-08-20T01:35:20.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:20.880+0000 7f070d32a640 1 -- 172.21.15.79:0/815222359 wait complete. 2024-08-20T01:35:20.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:20.880+0000 7f070d32a640 1 Processor -- start 2024-08-20T01:35:20.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:20.880+0000 7f070d32a640 1 -- start start 2024-08-20T01:35:20.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:20.880+0000 7f070d32a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07081019b0 0x7f0708197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:20.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:20.880+0000 7f070d32a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07081073c0 0x7f0708198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:20.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:20.880+0000 7f070d32a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0708107d40 0x7f070819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:20.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:20.881+0000 7f070d32a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f07081118b0 con 0x7f07081019b0 2024-08-20T01:35:20.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:20.881+0000 7f070d32a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0708111730 con 0x7f0708107d40 2024-08-20T01:35:20.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:20.881+0000 7f070d32a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0708111a30 con 0x7f07081073c0 2024-08-20T01:35:20.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:20.881+0000 7f0706ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07081019b0 0x7f0708197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:20.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:20.881+0000 7f0706ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07081019b0 0x7f0708197dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50994/0 (socket says 172.21.15.79:50994) 2024-08-20T01:35:20.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:20.881+0000 7f0706ffd640 1 -- 172.21.15.79:0/880298346 learned_addr learned my addr 172.21.15.79:0/880298346 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:35:20.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:20.881+0000 7f06fe7fc640 1 --2- 172.21.15.79:0/880298346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07081073c0 0x7f0708198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:20.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:20.881+0000 7f07077fe640 1 --2- 172.21.15.79:0/880298346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0708107d40 0x7f070819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:20.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:20.881+0000 7f0706ffd640 1 -- 172.21.15.79:0/880298346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07081073c0 msgr2=0x7f0708198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:20.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:20.881+0000 7f0706ffd640 1 --2- 172.21.15.79:0/880298346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07081073c0 0x7f0708198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:20.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:20.881+0000 7f0706ffd640 1 -- 172.21.15.79:0/880298346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0708107d40 msgr2=0x7f070819d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:20.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:20.881+0000 7f0706ffd640 1 --2- 172.21.15.79:0/880298346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0708107d40 0x7f070819d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:20.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:20.881+0000 7f0706ffd640 1 -- 172.21.15.79:0/880298346 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f070819de70 con 0x7f07081019b0 2024-08-20T01:35:20.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:20.881+0000 7f06fe7fc640 1 --2- 172.21.15.79:0/880298346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07081073c0 0x7f0708198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:35:20.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:20.881+0000 7f0706ffd640 1 --2- 172.21.15.79:0/880298346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07081019b0 0x7f0708197dc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f06f8009a20 tx=0x7f06f8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:20.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:20.881+0000 7f0704ff9640 1 -- 172.21.15.79:0/880298346 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f803f030 con 0x7f07081019b0 2024-08-20T01:35:20.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:20.881+0000 7f0704ff9640 1 -- 172.21.15.79:0/880298346 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f06f80035f0 con 0x7f07081019b0 2024-08-20T01:35:20.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:20.881+0000 7f0704ff9640 1 -- 172.21.15.79:0/880298346 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8035070 con 0x7f07081019b0 2024-08-20T01:35:20.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:20.881+0000 7f070d32a640 1 -- 172.21.15.79:0/880298346 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f070819e100 con 0x7f07081019b0 2024-08-20T01:35:20.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:20.881+0000 7f070d32a640 1 -- 172.21.15.79:0/880298346 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07081a4820 con 0x7f07081019b0 2024-08-20T01:35:20.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:20.883+0000 7f070d32a640 1 -- 172.21.15.79:0/880298346 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0708101d90 con 0x7f07081019b0 2024-08-20T01:35:20.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:20.884+0000 7f0704ff9640 1 -- 172.21.15.79:0/880298346 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f06f8003aa0 con 0x7f07081019b0 2024-08-20T01:35:20.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:20.884+0000 7f0704ff9640 1 --2- 172.21.15.79:0/880298346 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f06f40b3ce0 0x7f06f40b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:20.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:20.885+0000 7f06fe7fc640 1 --2- 172.21.15.79:0/880298346 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f06f40b3ce0 0x7f06f40b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:20.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:20.885+0000 7f0704ff9640 1 -- 172.21.15.79:0/880298346 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7f06f8104b80 con 0x7f07081019b0 2024-08-20T01:35:20.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:20.885+0000 7f06fe7fc640 1 --2- 172.21.15.79:0/880298346 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f06f40b3ce0 0x7f06f40b61a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0708100cf0 tx=0x7f06f0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:20.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:20.888+0000 7f0704ff9640 1 -- 172.21.15.79:0/880298346 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f06f80cc220 con 0x7f07081019b0 2024-08-20T01:35:21.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:21.061+0000 7f070d32a640 1 -- 172.21.15.79:0/880298346 --> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f07080632c0 con 0x7f06f40b3ce0 2024-08-20T01:35:21.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:21.065+0000 7f0704ff9640 1 -- 172.21.15.79:0/880298346 <== mgr.14150 v2:172.21.15.79:6800/3038112779 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258731 (secure 0 0 0) 0x7f07080632c0 con 0x7f06f40b3ce0 2024-08-20T01:35:21.069 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:35:21.070 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-08-20T01:35:21.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:21.068+0000 7f070d32a640 1 -- 172.21.15.79:0/880298346 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f06f40b3ce0 msgr2=0x7f06f40b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:21.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:21.068+0000 7f070d32a640 1 --2- 172.21.15.79:0/880298346 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f06f40b3ce0 0x7f06f40b61a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0708100cf0 tx=0x7f06f0008040 comp rx=0 tx=0).stop 2024-08-20T01:35:21.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:21.068+0000 7f070d32a640 1 -- 172.21.15.79:0/880298346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07081019b0 msgr2=0x7f0708197dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:21.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:21.068+0000 7f070d32a640 1 --2- 172.21.15.79:0/880298346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07081019b0 0x7f0708197dc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f06f8009a20 tx=0x7f06f8004270 comp rx=0 tx=0).stop 2024-08-20T01:35:21.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:21.068+0000 7f070d32a640 1 -- 172.21.15.79:0/880298346 shutdown_connections 2024-08-20T01:35:21.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:21.068+0000 7f070d32a640 1 --2- 172.21.15.79:0/880298346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0708107d40 0x7f070819d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:21.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:21.068+0000 7f070d32a640 1 --2- 172.21.15.79:0/880298346 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f06f40b3ce0 0x7f06f40b61a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:21.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:21.068+0000 7f070d32a640 1 --2- 172.21.15.79:0/880298346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07081073c0 0x7f0708198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:21.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:21.068+0000 7f070d32a640 1 --2- 172.21.15.79:0/880298346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07081019b0 0x7f0708197dc0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:21.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:21.068+0000 7f070d32a640 1 -- 172.21.15.79:0/880298346 >> 172.21.15.79:0/880298346 conn(0x7f07080fd420 msgr2=0x7f07080ff810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:21.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:21.068+0000 7f070d32a640 1 -- 172.21.15.79:0/880298346 shutdown_connections 2024-08-20T01:35:21.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:21.068+0000 7f070d32a640 1 -- 172.21.15.79:0/880298346 wait complete. 2024-08-20T01:35:21.777 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":286,"stamp":"2024-08-20T01:35:20.474850+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":643824,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":234,"num_read_kb":202,"num_write":355,"num_write_kb":2267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":292,"ondisk_log_size":292,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360648,"kb_used_data":11400,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124581176,"statfs":{"total":1151940427776,"available":1151571124224,"internally_reserved":0,"allocated":11673600,"data_stored":6440112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":357414203},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":39528,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":133,"num_read_kb":117,"num_write":55,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003077"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.373958+0000","last_change":"2024-08-20T01:34:54.368243+0000","last_active":"2024-08-20T01:34:55.373958+0000","last_peered":"2024-08-20T01:34:55.373958+0000","last_clean":"2024-08-20T01:34:55.373958+0000","last_became_active":"2024-08-20T01:34:54.367712+0000","last_became_peered":"2024-08-20T01:34:54.367712+0000","last_unstale":"2024-08-20T01:34:55.373958+0000","last_undegraded":"2024-08-20T01:34:55.373958+0000","last_fullsized":"2024-08-20T01:34:55.373958+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:48:31.179090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.370361+0000","last_change":"2024-08-20T01:34:54.371126+0000","last_active":"2024-08-20T01:34:55.370361+0000","last_peered":"2024-08-20T01:34:55.370361+0000","last_clean":"2024-08-20T01:34:55.370361+0000","last_became_active":"2024-08-20T01:34:54.370821+0000","last_became_peered":"2024-08-20T01:34:54.370821+0000","last_unstale":"2024-08-20T01:34:55.370361+0000","last_undegraded":"2024-08-20T01:34:55.370361+0000","last_fullsized":"2024-08-20T01:34:55.370361+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:37:41.175264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.369773+0000","last_change":"2024-08-20T01:34:54.373051+0000","last_active":"2024-08-20T01:34:55.369773+0000","last_peered":"2024-08-20T01:34:55.369773+0000","last_clean":"2024-08-20T01:34:55.369773+0000","last_became_active":"2024-08-20T01:34:54.372783+0000","last_became_peered":"2024-08-20T01:34:54.372783+0000","last_unstale":"2024-08-20T01:34:55.369773+0000","last_undegraded":"2024-08-20T01:34:55.369773+0000","last_fullsized":"2024-08-20T01:34:55.369773+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:12:49.630968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.356695+0000","last_change":"2024-08-20T01:34:54.372395+0000","last_active":"2024-08-20T01:34:55.356695+0000","last_peered":"2024-08-20T01:34:55.356695+0000","last_clean":"2024-08-20T01:34:55.356695+0000","last_became_active":"2024-08-20T01:34:54.371804+0000","last_became_peered":"2024-08-20T01:34:54.371804+0000","last_unstale":"2024-08-20T01:34:55.356695+0000","last_undegraded":"2024-08-20T01:34:55.356695+0000","last_fullsized":"2024-08-20T01:34:55.356695+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:01:14.395727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.368815+0000","last_change":"2024-08-20T01:34:54.379200+0000","last_active":"2024-08-20T01:34:55.368815+0000","last_peered":"2024-08-20T01:34:55.368815+0000","last_clean":"2024-08-20T01:34:55.368815+0000","last_became_active":"2024-08-20T01:34:54.378828+0000","last_became_peered":"2024-08-20T01:34:54.378828+0000","last_unstale":"2024-08-20T01:34:55.368815+0000","last_undegraded":"2024-08-20T01:34:55.368815+0000","last_fullsized":"2024-08-20T01:34:55.368815+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:27:09.672074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.368643+0000","last_change":"2024-08-20T01:34:54.377871+0000","last_active":"2024-08-20T01:34:55.368643+0000","last_peered":"2024-08-20T01:34:55.368643+0000","last_clean":"2024-08-20T01:34:55.368643+0000","last_became_active":"2024-08-20T01:34:54.376617+0000","last_became_peered":"2024-08-20T01:34:54.376617+0000","last_unstale":"2024-08-20T01:34:55.368643+0000","last_undegraded":"2024-08-20T01:34:55.368643+0000","last_fullsized":"2024-08-20T01:34:55.368643+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:17:09.740135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.369182+0000","last_change":"2024-08-20T01:34:54.373761+0000","last_active":"2024-08-20T01:34:55.369182+0000","last_peered":"2024-08-20T01:34:55.369182+0000","last_clean":"2024-08-20T01:34:55.369182+0000","last_became_active":"2024-08-20T01:34:54.372944+0000","last_became_peered":"2024-08-20T01:34:54.372944+0000","last_unstale":"2024-08-20T01:34:55.369182+0000","last_undegraded":"2024-08-20T01:34:55.369182+0000","last_fullsized":"2024-08-20T01:34:55.369182+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:21:44.477970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.371403+0000","last_change":"2024-08-20T01:34:54.375226+0000","last_active":"2024-08-20T01:34:55.371403+0000","last_peered":"2024-08-20T01:34:55.371403+0000","last_clean":"2024-08-20T01:34:55.371403+0000","last_became_active":"2024-08-20T01:34:54.374877+0000","last_became_peered":"2024-08-20T01:34:54.374877+0000","last_unstale":"2024-08-20T01:34:55.371403+0000","last_undegraded":"2024-08-20T01:34:55.371403+0000","last_fullsized":"2024-08-20T01:34:55.371403+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:19:11.121719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.372587+0000","last_change":"2024-08-20T01:34:54.378350+0000","last_active":"2024-08-20T01:34:55.372587+0000","last_peered":"2024-08-20T01:34:55.372587+0000","last_clean":"2024-08-20T01:34:55.372587+0000","last_became_active":"2024-08-20T01:34:54.376524+0000","last_became_peered":"2024-08-20T01:34:54.376524+0000","last_unstale":"2024-08-20T01:34:55.372587+0000","last_undegraded":"2024-08-20T01:34:55.372587+0000","last_fullsized":"2024-08-20T01:34:55.372587+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:50:03.179130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.369665+0000","last_change":"2024-08-20T01:34:54.376098+0000","last_active":"2024-08-20T01:34:55.369665+0000","last_peered":"2024-08-20T01:34:55.369665+0000","last_clean":"2024-08-20T01:34:55.369665+0000","last_became_active":"2024-08-20T01:34:54.375671+0000","last_became_peered":"2024-08-20T01:34:54.375671+0000","last_unstale":"2024-08-20T01:34:55.369665+0000","last_undegraded":"2024-08-20T01:34:55.369665+0000","last_fullsized":"2024-08-20T01:34:55.369665+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:43:14.876302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.370072+0000","last_change":"2024-08-20T01:34:54.374431+0000","last_active":"2024-08-20T01:34:55.370072+0000","last_peered":"2024-08-20T01:34:55.370072+0000","last_clean":"2024-08-20T01:34:55.370072+0000","last_became_active":"2024-08-20T01:34:54.374082+0000","last_became_peered":"2024-08-20T01:34:54.374082+0000","last_unstale":"2024-08-20T01:34:55.370072+0000","last_undegraded":"2024-08-20T01:34:55.370072+0000","last_fullsized":"2024-08-20T01:34:55.370072+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:11:10.046245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.356746+0000","last_change":"2024-08-20T01:34:54.372124+0000","last_active":"2024-08-20T01:34:55.356746+0000","last_peered":"2024-08-20T01:34:55.356746+0000","last_clean":"2024-08-20T01:34:55.356746+0000","last_became_active":"2024-08-20T01:34:54.371382+0000","last_became_peered":"2024-08-20T01:34:54.371382+0000","last_unstale":"2024-08-20T01:34:55.356746+0000","last_undegraded":"2024-08-20T01:34:55.356746+0000","last_fullsized":"2024-08-20T01:34:55.356746+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:29:38.715445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.355768+0000","last_change":"2024-08-20T01:34:54.372760+0000","last_active":"2024-08-20T01:34:55.355768+0000","last_peered":"2024-08-20T01:34:55.355768+0000","last_clean":"2024-08-20T01:34:55.355768+0000","last_became_active":"2024-08-20T01:34:54.372386+0000","last_became_peered":"2024-08-20T01:34:54.372386+0000","last_unstale":"2024-08-20T01:34:55.355768+0000","last_undegraded":"2024-08-20T01:34:55.355768+0000","last_fullsized":"2024-08-20T01:34:55.355768+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:30:32.873604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.369378+0000","last_change":"2024-08-20T01:34:54.371164+0000","last_active":"2024-08-20T01:34:55.369378+0000","last_peered":"2024-08-20T01:34:55.369378+0000","last_clean":"2024-08-20T01:34:55.369378+0000","last_became_active":"2024-08-20T01:34:54.370856+0000","last_became_peered":"2024-08-20T01:34:54.370856+0000","last_unstale":"2024-08-20T01:34:55.369378+0000","last_undegraded":"2024-08-20T01:34:55.369378+0000","last_fullsized":"2024-08-20T01:34:55.369378+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:14:26.803902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.369156+0000","last_change":"2024-08-20T01:34:54.369595+0000","last_active":"2024-08-20T01:34:55.369156+0000","last_peered":"2024-08-20T01:34:55.369156+0000","last_clean":"2024-08-20T01:34:55.369156+0000","last_became_active":"2024-08-20T01:34:54.369285+0000","last_became_peered":"2024-08-20T01:34:54.369285+0000","last_unstale":"2024-08-20T01:34:55.369156+0000","last_undegraded":"2024-08-20T01:34:55.369156+0000","last_fullsized":"2024-08-20T01:34:55.369156+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:53:16.965300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.371620+0000","last_change":"2024-08-20T01:34:54.366903+0000","last_active":"2024-08-20T01:34:55.371620+0000","last_peered":"2024-08-20T01:34:55.371620+0000","last_clean":"2024-08-20T01:34:55.371620+0000","last_became_active":"2024-08-20T01:34:54.366533+0000","last_became_peered":"2024-08-20T01:34:54.366533+0000","last_unstale":"2024-08-20T01:34:55.371620+0000","last_undegraded":"2024-08-20T01:34:55.371620+0000","last_fullsized":"2024-08-20T01:34:55.371620+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:11:23.025718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.374122+0000","last_change":"2024-08-20T01:34:54.368616+0000","last_active":"2024-08-20T01:34:55.374122+0000","last_peered":"2024-08-20T01:34:55.374122+0000","last_clean":"2024-08-20T01:34:55.374122+0000","last_became_active":"2024-08-20T01:34:54.368267+0000","last_became_peered":"2024-08-20T01:34:54.368267+0000","last_unstale":"2024-08-20T01:34:55.374122+0000","last_undegraded":"2024-08-20T01:34:55.374122+0000","last_fullsized":"2024-08-20T01:34:55.374122+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:53:09.035458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.368478+0000","last_change":"2024-08-20T01:34:54.369182+0000","last_active":"2024-08-20T01:34:55.368478+0000","last_peered":"2024-08-20T01:34:55.368478+0000","last_clean":"2024-08-20T01:34:55.368478+0000","last_became_active":"2024-08-20T01:34:54.368862+0000","last_became_peered":"2024-08-20T01:34:54.368862+0000","last_unstale":"2024-08-20T01:34:55.368478+0000","last_undegraded":"2024-08-20T01:34:55.368478+0000","last_fullsized":"2024-08-20T01:34:55.368478+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:31:16.013266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.372572+0000","last_change":"2024-08-20T01:34:54.368132+0000","last_active":"2024-08-20T01:34:55.372572+0000","last_peered":"2024-08-20T01:34:55.372572+0000","last_clean":"2024-08-20T01:34:55.372572+0000","last_became_active":"2024-08-20T01:34:54.366295+0000","last_became_peered":"2024-08-20T01:34:54.366295+0000","last_unstale":"2024-08-20T01:34:55.372572+0000","last_undegraded":"2024-08-20T01:34:55.372572+0000","last_fullsized":"2024-08-20T01:34:55.372572+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:52:23.928602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.371598+0000","last_change":"2024-08-20T01:34:54.372783+0000","last_active":"2024-08-20T01:34:55.371598+0000","last_peered":"2024-08-20T01:34:55.371598+0000","last_clean":"2024-08-20T01:34:55.371598+0000","last_became_active":"2024-08-20T01:34:54.371871+0000","last_became_peered":"2024-08-20T01:34:54.371871+0000","last_unstale":"2024-08-20T01:34:55.371598+0000","last_undegraded":"2024-08-20T01:34:55.371598+0000","last_fullsized":"2024-08-20T01:34:55.371598+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:03:16.118087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.355802+0000","last_change":"2024-08-20T01:34:54.366206+0000","last_active":"2024-08-20T01:34:55.355802+0000","last_peered":"2024-08-20T01:34:55.355802+0000","last_clean":"2024-08-20T01:34:55.355802+0000","last_became_active":"2024-08-20T01:34:54.365893+0000","last_became_peered":"2024-08-20T01:34:54.365893+0000","last_unstale":"2024-08-20T01:34:55.355802+0000","last_undegraded":"2024-08-20T01:34:55.355802+0000","last_fullsized":"2024-08-20T01:34:55.355802+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:39:22.610570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.372106+0000","last_change":"2024-08-20T01:34:54.368091+0000","last_active":"2024-08-20T01:34:55.372106+0000","last_peered":"2024-08-20T01:34:55.372106+0000","last_clean":"2024-08-20T01:34:55.372106+0000","last_became_active":"2024-08-20T01:34:54.367626+0000","last_became_peered":"2024-08-20T01:34:54.367626+0000","last_unstale":"2024-08-20T01:34:55.372106+0000","last_undegraded":"2024-08-20T01:34:55.372106+0000","last_fullsized":"2024-08-20T01:34:55.372106+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:52:34.157094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.371145+0000","last_change":"2024-08-20T01:34:54.370976+0000","last_active":"2024-08-20T01:34:55.371145+0000","last_peered":"2024-08-20T01:34:55.371145+0000","last_clean":"2024-08-20T01:34:55.371145+0000","last_became_active":"2024-08-20T01:34:54.368349+0000","last_became_peered":"2024-08-20T01:34:54.368349+0000","last_unstale":"2024-08-20T01:34:55.371145+0000","last_undegraded":"2024-08-20T01:34:55.371145+0000","last_fullsized":"2024-08-20T01:34:55.371145+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:53:48.846072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.357301+0000","last_change":"2024-08-20T01:34:54.379148+0000","last_active":"2024-08-20T01:34:55.357301+0000","last_peered":"2024-08-20T01:34:55.357301+0000","last_clean":"2024-08-20T01:34:55.357301+0000","last_became_active":"2024-08-20T01:34:54.378800+0000","last_became_peered":"2024-08-20T01:34:54.378800+0000","last_unstale":"2024-08-20T01:34:55.357301+0000","last_undegraded":"2024-08-20T01:34:55.357301+0000","last_fullsized":"2024-08-20T01:34:55.357301+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:42:47.382372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.371644+0000","last_change":"2024-08-20T01:34:54.376972+0000","last_active":"2024-08-20T01:34:55.371644+0000","last_peered":"2024-08-20T01:34:55.371644+0000","last_clean":"2024-08-20T01:34:55.371644+0000","last_became_active":"2024-08-20T01:34:54.376701+0000","last_became_peered":"2024-08-20T01:34:54.376701+0000","last_unstale":"2024-08-20T01:34:55.371644+0000","last_undegraded":"2024-08-20T01:34:55.371644+0000","last_fullsized":"2024-08-20T01:34:55.371644+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:19:12.897732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.373684+0000","last_change":"2024-08-20T01:34:54.372699+0000","last_active":"2024-08-20T01:34:55.373684+0000","last_peered":"2024-08-20T01:34:55.373684+0000","last_clean":"2024-08-20T01:34:55.373684+0000","last_became_active":"2024-08-20T01:34:54.371170+0000","last_became_peered":"2024-08-20T01:34:54.371170+0000","last_unstale":"2024-08-20T01:34:55.373684+0000","last_undegraded":"2024-08-20T01:34:55.373684+0000","last_fullsized":"2024-08-20T01:34:55.373684+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:18:00.373087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.371965+0000","last_change":"2024-08-20T01:34:54.373726+0000","last_active":"2024-08-20T01:34:55.371965+0000","last_peered":"2024-08-20T01:34:55.371965+0000","last_clean":"2024-08-20T01:34:55.371965+0000","last_became_active":"2024-08-20T01:34:54.373418+0000","last_became_peered":"2024-08-20T01:34:54.373418+0000","last_unstale":"2024-08-20T01:34:55.371965+0000","last_undegraded":"2024-08-20T01:34:55.371965+0000","last_fullsized":"2024-08-20T01:34:55.371965+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:55:28.791396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.355674+0000","last_change":"2024-08-20T01:34:54.371779+0000","last_active":"2024-08-20T01:34:55.355674+0000","last_peered":"2024-08-20T01:34:55.355674+0000","last_clean":"2024-08-20T01:34:55.355674+0000","last_became_active":"2024-08-20T01:34:54.370449+0000","last_became_peered":"2024-08-20T01:34:54.370449+0000","last_unstale":"2024-08-20T01:34:55.355674+0000","last_undegraded":"2024-08-20T01:34:55.355674+0000","last_fullsized":"2024-08-20T01:34:55.355674+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:03:22.153120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.370177+0000","last_change":"2024-08-20T01:34:54.369973+0000","last_active":"2024-08-20T01:34:55.370177+0000","last_peered":"2024-08-20T01:34:55.370177+0000","last_clean":"2024-08-20T01:34:55.370177+0000","last_became_active":"2024-08-20T01:34:54.369048+0000","last_became_peered":"2024-08-20T01:34:54.369048+0000","last_unstale":"2024-08-20T01:34:55.370177+0000","last_undegraded":"2024-08-20T01:34:55.370177+0000","last_fullsized":"2024-08-20T01:34:55.370177+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:52:02.127937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.372380+0000","last_change":"2024-08-20T01:34:54.369948+0000","last_active":"2024-08-20T01:34:55.372380+0000","last_peered":"2024-08-20T01:34:55.372380+0000","last_clean":"2024-08-20T01:34:55.372380+0000","last_became_active":"2024-08-20T01:34:54.367453+0000","last_became_peered":"2024-08-20T01:34:54.367453+0000","last_unstale":"2024-08-20T01:34:55.372380+0000","last_undegraded":"2024-08-20T01:34:55.372380+0000","last_fullsized":"2024-08-20T01:34:55.372380+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:09:38.800219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.372906+0000","last_change":"2024-08-20T01:34:54.373622+0000","last_active":"2024-08-20T01:34:55.372906+0000","last_peered":"2024-08-20T01:34:55.372906+0000","last_clean":"2024-08-20T01:34:55.372906+0000","last_became_active":"2024-08-20T01:34:54.373261+0000","last_became_peered":"2024-08-20T01:34:54.373261+0000","last_unstale":"2024-08-20T01:34:55.372906+0000","last_undegraded":"2024-08-20T01:34:55.372906+0000","last_fullsized":"2024-08-20T01:34:55.372906+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:21:03.471668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.372138+0000","last_change":"2024-08-20T01:34:54.374728+0000","last_active":"2024-08-20T01:34:55.372138+0000","last_peered":"2024-08-20T01:34:55.372138+0000","last_clean":"2024-08-20T01:34:55.372138+0000","last_became_active":"2024-08-20T01:34:54.374183+0000","last_became_peered":"2024-08-20T01:34:54.374183+0000","last_unstale":"2024-08-20T01:34:55.372138+0000","last_undegraded":"2024-08-20T01:34:55.372138+0000","last_fullsized":"2024-08-20T01:34:55.372138+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:39:40.203942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.368932+0000","last_change":"2024-08-20T01:34:54.372863+0000","last_active":"2024-08-20T01:34:55.368932+0000","last_peered":"2024-08-20T01:34:55.368932+0000","last_clean":"2024-08-20T01:34:55.368932+0000","last_became_active":"2024-08-20T01:34:54.372409+0000","last_became_peered":"2024-08-20T01:34:54.372409+0000","last_unstale":"2024-08-20T01:34:55.368932+0000","last_undegraded":"2024-08-20T01:34:55.368932+0000","last_fullsized":"2024-08-20T01:34:55.368932+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:22:51.676677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"72'5","reported_seq":38,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:16.464982+0000","last_change":"2024-08-20T01:34:52.343440+0000","last_active":"2024-08-20T01:35:16.464982+0000","last_peered":"2024-08-20T01:35:16.464982+0000","last_clean":"2024-08-20T01:35:16.464982+0000","last_became_active":"2024-08-20T01:34:52.343110+0000","last_became_peered":"2024-08-20T01:34:52.343110+0000","last_unstale":"2024-08-20T01:35:16.464982+0000","last_undegraded":"2024-08-20T01:35:16.464982+0000","last_fullsized":"2024-08-20T01:35:16.464982+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:46:51.406198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.357411+0000","last_change":"2024-08-20T01:34:54.379522+0000","last_active":"2024-08-20T01:34:55.357411+0000","last_peered":"2024-08-20T01:34:55.357411+0000","last_clean":"2024-08-20T01:34:55.357411+0000","last_became_active":"2024-08-20T01:34:54.378826+0000","last_became_peered":"2024-08-20T01:34:54.378826+0000","last_unstale":"2024-08-20T01:34:55.357411+0000","last_undegraded":"2024-08-20T01:34:55.357411+0000","last_fullsized":"2024-08-20T01:34:55.357411+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:49:59.985231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"72'7","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:04.435449+0000","last_change":"2024-08-20T01:34:52.344483+0000","last_active":"2024-08-20T01:35:04.435449+0000","last_peered":"2024-08-20T01:35:04.435449+0000","last_clean":"2024-08-20T01:35:04.435449+0000","last_became_active":"2024-08-20T01:34:52.343940+0000","last_became_peered":"2024-08-20T01:34:52.343940+0000","last_unstale":"2024-08-20T01:35:04.435449+0000","last_undegraded":"2024-08-20T01:35:04.435449+0000","last_fullsized":"2024-08-20T01:35:04.435449+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:19:53.480527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"72'3","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:03.422879+0000","last_change":"2024-08-20T01:34:52.340732+0000","last_active":"2024-08-20T01:35:03.422879+0000","last_peered":"2024-08-20T01:35:03.422879+0000","last_clean":"2024-08-20T01:35:03.422879+0000","last_became_active":"2024-08-20T01:34:52.340367+0000","last_became_peered":"2024-08-20T01:34:52.340367+0000","last_unstale":"2024-08-20T01:35:03.422879+0000","last_undegraded":"2024-08-20T01:35:03.422879+0000","last_fullsized":"2024-08-20T01:35:03.422879+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:33:17.751642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.371220+0000","last_change":"2024-08-20T01:34:54.370725+0000","last_active":"2024-08-20T01:34:55.371220+0000","last_peered":"2024-08-20T01:34:55.371220+0000","last_clean":"2024-08-20T01:34:55.371220+0000","last_became_active":"2024-08-20T01:34:54.370423+0000","last_became_peered":"2024-08-20T01:34:54.370423+0000","last_unstale":"2024-08-20T01:34:55.371220+0000","last_undegraded":"2024-08-20T01:34:55.371220+0000","last_fullsized":"2024-08-20T01:34:55.371220+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:03:30.081748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"72'3","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:05.442784+0000","last_change":"2024-08-20T01:34:52.348605+0000","last_active":"2024-08-20T01:35:05.442784+0000","last_peered":"2024-08-20T01:35:05.442784+0000","last_clean":"2024-08-20T01:35:05.442784+0000","last_became_active":"2024-08-20T01:34:52.348278+0000","last_became_peered":"2024-08-20T01:34:52.348278+0000","last_unstale":"2024-08-20T01:35:05.442784+0000","last_undegraded":"2024-08-20T01:35:05.442784+0000","last_fullsized":"2024-08-20T01:35:05.442784+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:19:40.243243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.368041+0000","last_change":"2024-08-20T01:34:54.365604+0000","last_active":"2024-08-20T01:34:55.368041+0000","last_peered":"2024-08-20T01:34:55.368041+0000","last_clean":"2024-08-20T01:34:55.368041+0000","last_became_active":"2024-08-20T01:34:54.365284+0000","last_became_peered":"2024-08-20T01:34:54.365284+0000","last_unstale":"2024-08-20T01:34:55.368041+0000","last_undegraded":"2024-08-20T01:34:55.368041+0000","last_fullsized":"2024-08-20T01:34:55.368041+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:41:57.017680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"72'4","reported_seq":47,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:17.465677+0000","last_change":"2024-08-20T01:34:52.344679+0000","last_active":"2024-08-20T01:35:17.465677+0000","last_peered":"2024-08-20T01:35:17.465677+0000","last_clean":"2024-08-20T01:35:17.465677+0000","last_became_active":"2024-08-20T01:34:52.344058+0000","last_became_peered":"2024-08-20T01:34:52.344058+0000","last_unstale":"2024-08-20T01:35:17.465677+0000","last_undegraded":"2024-08-20T01:35:17.465677+0000","last_fullsized":"2024-08-20T01:35:17.465677+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:27:40.079949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.372223+0000","last_change":"2024-08-20T01:34:54.369724+0000","last_active":"2024-08-20T01:34:55.372223+0000","last_peered":"2024-08-20T01:34:55.372223+0000","last_clean":"2024-08-20T01:34:55.372223+0000","last_became_active":"2024-08-20T01:34:54.369403+0000","last_became_peered":"2024-08-20T01:34:54.369403+0000","last_unstale":"2024-08-20T01:34:55.372223+0000","last_undegraded":"2024-08-20T01:34:55.372223+0000","last_fullsized":"2024-08-20T01:34:55.372223+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:31:22.382794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"72'4","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:05.444753+0000","last_change":"2024-08-20T01:34:52.346651+0000","last_active":"2024-08-20T01:35:05.444753+0000","last_peered":"2024-08-20T01:35:05.444753+0000","last_clean":"2024-08-20T01:35:05.444753+0000","last_became_active":"2024-08-20T01:34:52.346316+0000","last_became_peered":"2024-08-20T01:34:52.346316+0000","last_unstale":"2024-08-20T01:35:05.444753+0000","last_undegraded":"2024-08-20T01:35:05.444753+0000","last_fullsized":"2024-08-20T01:35:05.444753+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:48:34.382413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.370154+0000","last_change":"2024-08-20T01:34:54.375587+0000","last_active":"2024-08-20T01:34:55.370154+0000","last_peered":"2024-08-20T01:34:55.370154+0000","last_clean":"2024-08-20T01:34:55.370154+0000","last_became_active":"2024-08-20T01:34:54.374138+0000","last_became_peered":"2024-08-20T01:34:54.374138+0000","last_unstale":"2024-08-20T01:34:55.370154+0000","last_undegraded":"2024-08-20T01:34:55.370154+0000","last_fullsized":"2024-08-20T01:34:55.370154+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:02:46.817849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"72'5","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:04.433853+0000","last_change":"2024-08-20T01:34:52.559659+0000","last_active":"2024-08-20T01:35:04.433853+0000","last_peered":"2024-08-20T01:35:04.433853+0000","last_clean":"2024-08-20T01:35:04.433853+0000","last_became_active":"2024-08-20T01:34:52.559243+0000","last_became_peered":"2024-08-20T01:34:52.559243+0000","last_unstale":"2024-08-20T01:35:04.433853+0000","last_undegraded":"2024-08-20T01:35:04.433853+0000","last_fullsized":"2024-08-20T01:35:04.433853+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:49:02.314230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.372729+0000","last_change":"2024-08-20T01:34:54.372965+0000","last_active":"2024-08-20T01:34:55.372729+0000","last_peered":"2024-08-20T01:34:55.372729+0000","last_clean":"2024-08-20T01:34:55.372729+0000","last_became_active":"2024-08-20T01:34:54.372286+0000","last_became_peered":"2024-08-20T01:34:54.372286+0000","last_unstale":"2024-08-20T01:34:55.372729+0000","last_undegraded":"2024-08-20T01:34:55.372729+0000","last_fullsized":"2024-08-20T01:34:55.372729+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:32:45.178137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"72'24","reported_seq":73,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:17.469506+0000","last_change":"2024-08-20T01:34:52.348907+0000","last_active":"2024-08-20T01:35:17.469506+0000","last_peered":"2024-08-20T01:35:17.469506+0000","last_clean":"2024-08-20T01:35:17.469506+0000","last_became_active":"2024-08-20T01:34:52.347853+0000","last_became_peered":"2024-08-20T01:34:52.347853+0000","last_unstale":"2024-08-20T01:35:17.469506+0000","last_undegraded":"2024-08-20T01:35:17.469506+0000","last_fullsized":"2024-08-20T01:35:17.469506+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:19:31.142154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46800,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":30,"num_read_kb":60,"num_write":26,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.368849+0000","last_change":"2024-08-20T01:34:54.376493+0000","last_active":"2024-08-20T01:34:55.368849+0000","last_peered":"2024-08-20T01:34:55.368849+0000","last_clean":"2024-08-20T01:34:55.368849+0000","last_became_active":"2024-08-20T01:34:54.376160+0000","last_became_peered":"2024-08-20T01:34:54.376160+0000","last_unstale":"2024-08-20T01:34:55.368849+0000","last_undegraded":"2024-08-20T01:34:55.368849+0000","last_fullsized":"2024-08-20T01:34:55.368849+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:59:03.431731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"72'9","reported_seq":30,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:06.445779+0000","last_change":"2024-08-20T01:34:52.347516+0000","last_active":"2024-08-20T01:35:06.445779+0000","last_peered":"2024-08-20T01:35:06.445779+0000","last_clean":"2024-08-20T01:35:06.445779+0000","last_became_active":"2024-08-20T01:34:52.347134+0000","last_became_peered":"2024-08-20T01:34:52.347134+0000","last_unstale":"2024-08-20T01:35:06.445779+0000","last_undegraded":"2024-08-20T01:35:06.445779+0000","last_fullsized":"2024-08-20T01:35:06.445779+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:26:16.057472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.355520+0000","last_change":"2024-08-20T01:34:54.368083+0000","last_active":"2024-08-20T01:34:55.355520+0000","last_peered":"2024-08-20T01:34:55.355520+0000","last_clean":"2024-08-20T01:34:55.355520+0000","last_became_active":"2024-08-20T01:34:54.367815+0000","last_became_peered":"2024-08-20T01:34:54.367815+0000","last_unstale":"2024-08-20T01:34:55.355520+0000","last_undegraded":"2024-08-20T01:34:55.355520+0000","last_fullsized":"2024-08-20T01:34:55.355520+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:02:13.515114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"72'5","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:05.443230+0000","last_change":"2024-08-20T01:34:52.345104+0000","last_active":"2024-08-20T01:35:05.443230+0000","last_peered":"2024-08-20T01:35:05.443230+0000","last_clean":"2024-08-20T01:35:05.443230+0000","last_became_active":"2024-08-20T01:34:52.344776+0000","last_became_peered":"2024-08-20T01:34:52.344776+0000","last_unstale":"2024-08-20T01:35:05.443230+0000","last_undegraded":"2024-08-20T01:35:05.443230+0000","last_fullsized":"2024-08-20T01:35:05.443230+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:05:30.230328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.369267+0000","last_change":"2024-08-20T01:34:54.369341+0000","last_active":"2024-08-20T01:34:55.369267+0000","last_peered":"2024-08-20T01:34:55.369267+0000","last_clean":"2024-08-20T01:34:55.369267+0000","last_became_active":"2024-08-20T01:34:54.369040+0000","last_became_peered":"2024-08-20T01:34:54.369040+0000","last_unstale":"2024-08-20T01:34:55.369267+0000","last_undegraded":"2024-08-20T01:34:55.369267+0000","last_fullsized":"2024-08-20T01:34:55.369267+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:20:07.403778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"72'5","reported_seq":40,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:18.465637+0000","last_change":"2024-08-20T01:34:52.346787+0000","last_active":"2024-08-20T01:35:18.465637+0000","last_peered":"2024-08-20T01:35:18.465637+0000","last_clean":"2024-08-20T01:35:18.465637+0000","last_became_active":"2024-08-20T01:34:52.345713+0000","last_became_peered":"2024-08-20T01:34:52.345713+0000","last_unstale":"2024-08-20T01:35:18.465637+0000","last_undegraded":"2024-08-20T01:35:18.465637+0000","last_fullsized":"2024-08-20T01:35:18.465637+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:33:06.861899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.369087+0000","last_change":"2024-08-20T01:34:54.374153+0000","last_active":"2024-08-20T01:34:55.369087+0000","last_peered":"2024-08-20T01:34:55.369087+0000","last_clean":"2024-08-20T01:34:55.369087+0000","last_became_active":"2024-08-20T01:34:54.372804+0000","last_became_peered":"2024-08-20T01:34:54.372804+0000","last_unstale":"2024-08-20T01:34:55.369087+0000","last_undegraded":"2024-08-20T01:34:55.369087+0000","last_fullsized":"2024-08-20T01:34:55.369087+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:54:27.470643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"72'17","reported_seq":37,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:05.443203+0000","last_change":"2024-08-20T01:34:52.559701+0000","last_active":"2024-08-20T01:35:05.443203+0000","last_peered":"2024-08-20T01:35:05.443203+0000","last_clean":"2024-08-20T01:35:05.443203+0000","last_became_active":"2024-08-20T01:34:52.559378+0000","last_became_peered":"2024-08-20T01:34:52.559378+0000","last_unstale":"2024-08-20T01:35:05.443203+0000","last_undegraded":"2024-08-20T01:35:05.443203+0000","last_fullsized":"2024-08-20T01:35:05.443203+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:39:55.636492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.357500+0000","last_change":"2024-08-20T01:34:54.380037+0000","last_active":"2024-08-20T01:34:55.357500+0000","last_peered":"2024-08-20T01:34:55.357500+0000","last_clean":"2024-08-20T01:34:55.357500+0000","last_became_active":"2024-08-20T01:34:54.379715+0000","last_became_peered":"2024-08-20T01:34:54.379715+0000","last_unstale":"2024-08-20T01:34:55.357500+0000","last_undegraded":"2024-08-20T01:34:55.357500+0000","last_fullsized":"2024-08-20T01:34:55.357500+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:51:11.811646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"72'2","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:04.419708+0000","last_change":"2024-08-20T01:34:52.347574+0000","last_active":"2024-08-20T01:35:04.419708+0000","last_peered":"2024-08-20T01:35:04.419708+0000","last_clean":"2024-08-20T01:35:04.419708+0000","last_became_active":"2024-08-20T01:34:52.347250+0000","last_became_peered":"2024-08-20T01:34:52.347250+0000","last_unstale":"2024-08-20T01:35:04.419708+0000","last_undegraded":"2024-08-20T01:35:04.419708+0000","last_fullsized":"2024-08-20T01:35:04.419708+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:03:00.007548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.371970+0000","last_change":"2024-08-20T01:34:54.376383+0000","last_active":"2024-08-20T01:34:55.371970+0000","last_peered":"2024-08-20T01:34:55.371970+0000","last_clean":"2024-08-20T01:34:55.371970+0000","last_became_active":"2024-08-20T01:34:54.376044+0000","last_became_peered":"2024-08-20T01:34:54.376044+0000","last_unstale":"2024-08-20T01:34:55.371970+0000","last_undegraded":"2024-08-20T01:34:55.371970+0000","last_fullsized":"2024-08-20T01:34:55.371970+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:31:15.814776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"72'5","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:05.444257+0000","last_change":"2024-08-20T01:34:52.343441+0000","last_active":"2024-08-20T01:35:05.444257+0000","last_peered":"2024-08-20T01:35:05.444257+0000","last_clean":"2024-08-20T01:35:05.444257+0000","last_became_active":"2024-08-20T01:34:52.343120+0000","last_became_peered":"2024-08-20T01:34:52.343120+0000","last_unstale":"2024-08-20T01:35:05.444257+0000","last_undegraded":"2024-08-20T01:35:05.444257+0000","last_fullsized":"2024-08-20T01:35:05.444257+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:44:11.309626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.371039+0000","last_change":"2024-08-20T01:34:54.368986+0000","last_active":"2024-08-20T01:34:55.371039+0000","last_peered":"2024-08-20T01:34:55.371039+0000","last_clean":"2024-08-20T01:34:55.371039+0000","last_became_active":"2024-08-20T01:34:54.368611+0000","last_became_peered":"2024-08-20T01:34:54.368611+0000","last_unstale":"2024-08-20T01:34:55.371039+0000","last_undegraded":"2024-08-20T01:34:55.371039+0000","last_fullsized":"2024-08-20T01:34:55.371039+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:37:32.433584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"72'3","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:05.442623+0000","last_change":"2024-08-20T01:34:52.345863+0000","last_active":"2024-08-20T01:35:05.442623+0000","last_peered":"2024-08-20T01:35:05.442623+0000","last_clean":"2024-08-20T01:35:05.442623+0000","last_became_active":"2024-08-20T01:34:52.345555+0000","last_became_peered":"2024-08-20T01:34:52.345555+0000","last_unstale":"2024-08-20T01:35:05.442623+0000","last_undegraded":"2024-08-20T01:35:05.442623+0000","last_fullsized":"2024-08-20T01:35:05.442623+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:46:21.606019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"72'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:56.113469+0000","last_change":"2024-08-20T01:34:54.379699+0000","last_active":"2024-08-20T01:34:56.113469+0000","last_peered":"2024-08-20T01:34:56.113469+0000","last_clean":"2024-08-20T01:34:56.113469+0000","last_became_active":"2024-08-20T01:34:54.379197+0000","last_became_peered":"2024-08-20T01:34:54.379197+0000","last_unstale":"2024-08-20T01:34:56.113469+0000","last_undegraded":"2024-08-20T01:34:56.113469+0000","last_fullsized":"2024-08-20T01:34:56.113469+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:31:15.249200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"72'5","reported_seq":40,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:18.471206+0000","last_change":"2024-08-20T01:34:52.559520+0000","last_active":"2024-08-20T01:35:18.471206+0000","last_peered":"2024-08-20T01:35:18.471206+0000","last_clean":"2024-08-20T01:35:18.471206+0000","last_became_active":"2024-08-20T01:34:52.559180+0000","last_became_peered":"2024-08-20T01:34:52.559180+0000","last_unstale":"2024-08-20T01:35:18.471206+0000","last_undegraded":"2024-08-20T01:35:18.471206+0000","last_fullsized":"2024-08-20T01:35:18.471206+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:48:35.667441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.370245+0000","last_change":"2024-08-20T01:34:54.372709+0000","last_active":"2024-08-20T01:34:55.370245+0000","last_peered":"2024-08-20T01:34:55.370245+0000","last_clean":"2024-08-20T01:34:55.370245+0000","last_became_active":"2024-08-20T01:34:54.372277+0000","last_became_peered":"2024-08-20T01:34:54.372277+0000","last_unstale":"2024-08-20T01:34:55.370245+0000","last_undegraded":"2024-08-20T01:34:55.370245+0000","last_fullsized":"2024-08-20T01:34:55.370245+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:26:11.837805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":91,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.369340+0000","last_change":"2024-08-20T01:33:44.019475+0000","last_active":"2024-08-20T01:34:55.369340+0000","last_peered":"2024-08-20T01:34:55.369340+0000","last_clean":"2024-08-20T01:34:55.369340+0000","last_became_active":"2024-08-20T01:33:44.013614+0000","last_became_peered":"2024-08-20T01:33:44.013614+0000","last_unstale":"2024-08-20T01:34:55.369340+0000","last_undegraded":"2024-08-20T01:34:55.369340+0000","last_fullsized":"2024-08-20T01:34:55.369340+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:30:31.021505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:30:31.021505+0000","last_clean_scrub_stamp":"2024-08-20T01:30:31.021505+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:41:49.124707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"72'6","reported_seq":28,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:06.446376+0000","last_change":"2024-08-20T01:34:52.346409+0000","last_active":"2024-08-20T01:35:06.446376+0000","last_peered":"2024-08-20T01:35:06.446376+0000","last_clean":"2024-08-20T01:35:06.446376+0000","last_became_active":"2024-08-20T01:34:52.345821+0000","last_became_peered":"2024-08-20T01:34:52.345821+0000","last_unstale":"2024-08-20T01:35:06.446376+0000","last_undegraded":"2024-08-20T01:35:06.446376+0000","last_fullsized":"2024-08-20T01:35:06.446376+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:17:11.282558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.371414+0000","last_change":"2024-08-20T01:34:54.374804+0000","last_active":"2024-08-20T01:34:55.371414+0000","last_peered":"2024-08-20T01:34:55.371414+0000","last_clean":"2024-08-20T01:34:55.371414+0000","last_became_active":"2024-08-20T01:34:54.374252+0000","last_became_peered":"2024-08-20T01:34:54.374252+0000","last_unstale":"2024-08-20T01:34:55.371414+0000","last_undegraded":"2024-08-20T01:34:55.371414+0000","last_fullsized":"2024-08-20T01:34:55.371414+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:32:51.703703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"72'4","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:03.424877+0000","last_change":"2024-08-20T01:34:52.341399+0000","last_active":"2024-08-20T01:35:03.424877+0000","last_peered":"2024-08-20T01:35:03.424877+0000","last_clean":"2024-08-20T01:35:03.424877+0000","last_became_active":"2024-08-20T01:34:52.341034+0000","last_became_peered":"2024-08-20T01:34:52.341034+0000","last_unstale":"2024-08-20T01:35:03.424877+0000","last_undegraded":"2024-08-20T01:35:03.424877+0000","last_fullsized":"2024-08-20T01:35:03.424877+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:10:44.804836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.355403+0000","last_change":"2024-08-20T01:34:54.366567+0000","last_active":"2024-08-20T01:34:55.355403+0000","last_peered":"2024-08-20T01:34:55.355403+0000","last_clean":"2024-08-20T01:34:55.355403+0000","last_became_active":"2024-08-20T01:34:54.366298+0000","last_became_peered":"2024-08-20T01:34:54.366298+0000","last_unstale":"2024-08-20T01:34:55.355403+0000","last_undegraded":"2024-08-20T01:34:55.355403+0000","last_fullsized":"2024-08-20T01:34:55.355403+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:14:26.805902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"72'5","reported_seq":37,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:16.463026+0000","last_change":"2024-08-20T01:34:52.559166+0000","last_active":"2024-08-20T01:35:16.463026+0000","last_peered":"2024-08-20T01:35:16.463026+0000","last_clean":"2024-08-20T01:35:16.463026+0000","last_became_active":"2024-08-20T01:34:52.558652+0000","last_became_peered":"2024-08-20T01:34:52.558652+0000","last_unstale":"2024-08-20T01:35:16.463026+0000","last_undegraded":"2024-08-20T01:35:16.463026+0000","last_fullsized":"2024-08-20T01:35:16.463026+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:45:13.374924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.357411+0000","last_change":"2024-08-20T01:34:54.371193+0000","last_active":"2024-08-20T01:34:55.357411+0000","last_peered":"2024-08-20T01:34:55.357411+0000","last_clean":"2024-08-20T01:34:55.357411+0000","last_became_active":"2024-08-20T01:34:54.370869+0000","last_became_peered":"2024-08-20T01:34:54.370869+0000","last_unstale":"2024-08-20T01:34:55.357411+0000","last_undegraded":"2024-08-20T01:34:55.357411+0000","last_fullsized":"2024-08-20T01:34:55.357411+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:23:36.683049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"72'5","reported_seq":35,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:14.460402+0000","last_change":"2024-08-20T01:34:52.348815+0000","last_active":"2024-08-20T01:35:14.460402+0000","last_peered":"2024-08-20T01:35:14.460402+0000","last_clean":"2024-08-20T01:35:14.460402+0000","last_became_active":"2024-08-20T01:34:52.348437+0000","last_became_peered":"2024-08-20T01:34:52.348437+0000","last_unstale":"2024-08-20T01:35:14.460402+0000","last_undegraded":"2024-08-20T01:35:14.460402+0000","last_fullsized":"2024-08-20T01:35:14.460402+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:55:15.090721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.368839+0000","last_change":"2024-08-20T01:34:54.376049+0000","last_active":"2024-08-20T01:34:55.368839+0000","last_peered":"2024-08-20T01:34:55.368839+0000","last_clean":"2024-08-20T01:34:55.368839+0000","last_became_active":"2024-08-20T01:34:54.375680+0000","last_became_peered":"2024-08-20T01:34:54.375680+0000","last_unstale":"2024-08-20T01:34:55.368839+0000","last_undegraded":"2024-08-20T01:34:55.368839+0000","last_fullsized":"2024-08-20T01:34:55.368839+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:42:12.499850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"72'1","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.368355+0000","last_change":"2024-08-20T01:34:52.559823+0000","last_active":"2024-08-20T01:34:55.368355+0000","last_peered":"2024-08-20T01:34:55.368355+0000","last_clean":"2024-08-20T01:34:55.368355+0000","last_became_active":"2024-08-20T01:34:52.559293+0000","last_became_peered":"2024-08-20T01:34:52.559293+0000","last_unstale":"2024-08-20T01:34:55.368355+0000","last_undegraded":"2024-08-20T01:34:55.368355+0000","last_fullsized":"2024-08-20T01:34:55.368355+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:48:45.431937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"72'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:58.327468+0000","last_change":"2024-08-20T01:34:54.369686+0000","last_active":"2024-08-20T01:34:58.327468+0000","last_peered":"2024-08-20T01:34:58.327468+0000","last_clean":"2024-08-20T01:34:58.327468+0000","last_became_active":"2024-08-20T01:34:54.369343+0000","last_became_peered":"2024-08-20T01:34:54.369343+0000","last_unstale":"2024-08-20T01:34:58.327468+0000","last_undegraded":"2024-08-20T01:34:58.327468+0000","last_fullsized":"2024-08-20T01:34:58.327468+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:00:39.775809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"72'4","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:05.444293+0000","last_change":"2024-08-20T01:34:52.559098+0000","last_active":"2024-08-20T01:35:05.444293+0000","last_peered":"2024-08-20T01:35:05.444293+0000","last_clean":"2024-08-20T01:35:05.444293+0000","last_became_active":"2024-08-20T01:34:52.558684+0000","last_became_peered":"2024-08-20T01:34:52.558684+0000","last_unstale":"2024-08-20T01:35:05.444293+0000","last_undegraded":"2024-08-20T01:35:05.444293+0000","last_fullsized":"2024-08-20T01:35:05.444293+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:11:56.252973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.355689+0000","last_change":"2024-08-20T01:34:54.376275+0000","last_active":"2024-08-20T01:34:55.355689+0000","last_peered":"2024-08-20T01:34:55.355689+0000","last_clean":"2024-08-20T01:34:55.355689+0000","last_became_active":"2024-08-20T01:34:54.375797+0000","last_became_peered":"2024-08-20T01:34:54.375797+0000","last_unstale":"2024-08-20T01:34:55.355689+0000","last_undegraded":"2024-08-20T01:34:55.355689+0000","last_fullsized":"2024-08-20T01:34:55.355689+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:01:37.172855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"72'12","reported_seq":31,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:15.369567+0000","last_change":"2024-08-20T01:34:52.342207+0000","last_active":"2024-08-20T01:35:15.369567+0000","last_peered":"2024-08-20T01:35:15.369567+0000","last_clean":"2024-08-20T01:35:15.369567+0000","last_became_active":"2024-08-20T01:34:52.341878+0000","last_became_peered":"2024-08-20T01:34:52.341878+0000","last_unstale":"2024-08-20T01:35:15.369567+0000","last_undegraded":"2024-08-20T01:35:15.369567+0000","last_fullsized":"2024-08-20T01:35:15.369567+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:29:36.374725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.371792+0000","last_change":"2024-08-20T01:34:54.371162+0000","last_active":"2024-08-20T01:34:55.371792+0000","last_peered":"2024-08-20T01:34:55.371792+0000","last_clean":"2024-08-20T01:34:55.371792+0000","last_became_active":"2024-08-20T01:34:54.368442+0000","last_became_peered":"2024-08-20T01:34:54.368442+0000","last_unstale":"2024-08-20T01:34:55.371792+0000","last_undegraded":"2024-08-20T01:34:55.371792+0000","last_fullsized":"2024-08-20T01:34:55.371792+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:23:42.119533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"72'7","reported_seq":27,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:05.444042+0000","last_change":"2024-08-20T01:34:52.345551+0000","last_active":"2024-08-20T01:35:05.444042+0000","last_peered":"2024-08-20T01:35:05.444042+0000","last_clean":"2024-08-20T01:35:05.444042+0000","last_became_active":"2024-08-20T01:34:52.344212+0000","last_became_peered":"2024-08-20T01:34:52.344212+0000","last_unstale":"2024-08-20T01:35:05.444042+0000","last_undegraded":"2024-08-20T01:35:05.444042+0000","last_fullsized":"2024-08-20T01:35:05.444042+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:52:58.826394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.370514+0000","last_change":"2024-08-20T01:34:54.369468+0000","last_active":"2024-08-20T01:34:55.370514+0000","last_peered":"2024-08-20T01:34:55.370514+0000","last_clean":"2024-08-20T01:34:55.370514+0000","last_became_active":"2024-08-20T01:34:54.369152+0000","last_became_peered":"2024-08-20T01:34:54.369152+0000","last_unstale":"2024-08-20T01:34:55.370514+0000","last_undegraded":"2024-08-20T01:34:55.370514+0000","last_fullsized":"2024-08-20T01:34:55.370514+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:53:28.809714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"72'2","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:02.409086+0000","last_change":"2024-08-20T01:34:52.560529+0000","last_active":"2024-08-20T01:35:02.409086+0000","last_peered":"2024-08-20T01:35:02.409086+0000","last_clean":"2024-08-20T01:35:02.409086+0000","last_became_active":"2024-08-20T01:34:52.560141+0000","last_became_peered":"2024-08-20T01:34:52.560141+0000","last_unstale":"2024-08-20T01:35:02.409086+0000","last_undegraded":"2024-08-20T01:35:02.409086+0000","last_fullsized":"2024-08-20T01:35:02.409086+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:02:13.367700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.368580+0000","last_change":"2024-08-20T01:34:54.377963+0000","last_active":"2024-08-20T01:34:55.368580+0000","last_peered":"2024-08-20T01:34:55.368580+0000","last_clean":"2024-08-20T01:34:55.368580+0000","last_became_active":"2024-08-20T01:34:54.377645+0000","last_became_peered":"2024-08-20T01:34:54.377645+0000","last_unstale":"2024-08-20T01:34:55.368580+0000","last_undegraded":"2024-08-20T01:34:55.368580+0000","last_fullsized":"2024-08-20T01:34:55.368580+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:36:11.888293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"72'7","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:05.442261+0000","last_change":"2024-08-20T01:34:52.342262+0000","last_active":"2024-08-20T01:35:05.442261+0000","last_peered":"2024-08-20T01:35:05.442261+0000","last_clean":"2024-08-20T01:35:05.442261+0000","last_became_active":"2024-08-20T01:34:52.341919+0000","last_became_peered":"2024-08-20T01:34:52.341919+0000","last_unstale":"2024-08-20T01:35:05.442261+0000","last_undegraded":"2024-08-20T01:35:05.442261+0000","last_fullsized":"2024-08-20T01:35:05.442261+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:29:38.542146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.373298+0000","last_change":"2024-08-20T01:34:54.375741+0000","last_active":"2024-08-20T01:34:55.373298+0000","last_peered":"2024-08-20T01:34:55.373298+0000","last_clean":"2024-08-20T01:34:55.373298+0000","last_became_active":"2024-08-20T01:34:54.375409+0000","last_became_peered":"2024-08-20T01:34:54.375409+0000","last_unstale":"2024-08-20T01:34:55.373298+0000","last_undegraded":"2024-08-20T01:34:55.373298+0000","last_fullsized":"2024-08-20T01:34:55.373298+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:29:46.278762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"72'3","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:04.433907+0000","last_change":"2024-08-20T01:34:52.346296+0000","last_active":"2024-08-20T01:35:04.433907+0000","last_peered":"2024-08-20T01:35:04.433907+0000","last_clean":"2024-08-20T01:35:04.433907+0000","last_became_active":"2024-08-20T01:34:52.345535+0000","last_became_peered":"2024-08-20T01:34:52.345535+0000","last_unstale":"2024-08-20T01:35:04.433907+0000","last_undegraded":"2024-08-20T01:35:04.433907+0000","last_fullsized":"2024-08-20T01:35:04.433907+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:32:23.126530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.371499+0000","last_change":"2024-08-20T01:34:54.365720+0000","last_active":"2024-08-20T01:34:55.371499+0000","last_peered":"2024-08-20T01:34:55.371499+0000","last_clean":"2024-08-20T01:34:55.371499+0000","last_became_active":"2024-08-20T01:34:54.365406+0000","last_became_peered":"2024-08-20T01:34:54.365406+0000","last_unstale":"2024-08-20T01:34:55.371499+0000","last_undegraded":"2024-08-20T01:34:55.371499+0000","last_fullsized":"2024-08-20T01:34:55.371499+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:31:09.988882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"72'4","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:02.410363+0000","last_change":"2024-08-20T01:34:52.344263+0000","last_active":"2024-08-20T01:35:02.410363+0000","last_peered":"2024-08-20T01:35:02.410363+0000","last_clean":"2024-08-20T01:35:02.410363+0000","last_became_active":"2024-08-20T01:34:52.343706+0000","last_became_peered":"2024-08-20T01:34:52.343706+0000","last_unstale":"2024-08-20T01:35:02.410363+0000","last_undegraded":"2024-08-20T01:35:02.410363+0000","last_fullsized":"2024-08-20T01:35:02.410363+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:25:30.305116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.369628+0000","last_change":"2024-08-20T01:34:54.374564+0000","last_active":"2024-08-20T01:34:55.369628+0000","last_peered":"2024-08-20T01:34:55.369628+0000","last_clean":"2024-08-20T01:34:55.369628+0000","last_became_active":"2024-08-20T01:34:54.374136+0000","last_became_peered":"2024-08-20T01:34:54.374136+0000","last_unstale":"2024-08-20T01:34:55.369628+0000","last_undegraded":"2024-08-20T01:34:55.369628+0000","last_fullsized":"2024-08-20T01:34:55.369628+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:33:12.972430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.357877+0000","last_change":"2024-08-20T01:34:54.380373+0000","last_active":"2024-08-20T01:34:55.357877+0000","last_peered":"2024-08-20T01:34:55.357877+0000","last_clean":"2024-08-20T01:34:55.357877+0000","last_became_active":"2024-08-20T01:34:54.380033+0000","last_became_peered":"2024-08-20T01:34:54.380033+0000","last_unstale":"2024-08-20T01:34:55.357877+0000","last_undegraded":"2024-08-20T01:34:55.357877+0000","last_fullsized":"2024-08-20T01:34:55.357877+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:23:28.612871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"72'5","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:05.444627+0000","last_change":"2024-08-20T01:34:52.346174+0000","last_active":"2024-08-20T01:35:05.444627+0000","last_peered":"2024-08-20T01:35:05.444627+0000","last_clean":"2024-08-20T01:35:05.444627+0000","last_became_active":"2024-08-20T01:34:52.345677+0000","last_became_peered":"2024-08-20T01:34:52.345677+0000","last_unstale":"2024-08-20T01:35:05.444627+0000","last_undegraded":"2024-08-20T01:35:05.444627+0000","last_fullsized":"2024-08-20T01:35:05.444627+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:23:38.692225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.372541+0000","last_change":"2024-08-20T01:34:54.373515+0000","last_active":"2024-08-20T01:34:55.372541+0000","last_peered":"2024-08-20T01:34:55.372541+0000","last_clean":"2024-08-20T01:34:55.372541+0000","last_became_active":"2024-08-20T01:34:54.372954+0000","last_became_peered":"2024-08-20T01:34:54.372954+0000","last_unstale":"2024-08-20T01:34:55.372541+0000","last_undegraded":"2024-08-20T01:34:55.372541+0000","last_fullsized":"2024-08-20T01:34:55.372541+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:27:24.384924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"72'12","reported_seq":32,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:06.439392+0000","last_change":"2024-08-20T01:34:52.344089+0000","last_active":"2024-08-20T01:35:06.439392+0000","last_peered":"2024-08-20T01:35:06.439392+0000","last_clean":"2024-08-20T01:35:06.439392+0000","last_became_active":"2024-08-20T01:34:52.343354+0000","last_became_peered":"2024-08-20T01:34:52.343354+0000","last_unstale":"2024-08-20T01:35:06.439392+0000","last_undegraded":"2024-08-20T01:35:06.439392+0000","last_fullsized":"2024-08-20T01:35:06.439392+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:50:35.527307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.369966+0000","last_change":"2024-08-20T01:34:54.371931+0000","last_active":"2024-08-20T01:34:55.369966+0000","last_peered":"2024-08-20T01:34:55.369966+0000","last_clean":"2024-08-20T01:34:55.369966+0000","last_became_active":"2024-08-20T01:34:54.371385+0000","last_became_peered":"2024-08-20T01:34:54.371385+0000","last_unstale":"2024-08-20T01:34:55.369966+0000","last_undegraded":"2024-08-20T01:34:55.369966+0000","last_fullsized":"2024-08-20T01:34:55.369966+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:11:35.807145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"72'2","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.375060+0000","last_change":"2024-08-20T01:34:52.559127+0000","last_active":"2024-08-20T01:34:55.375060+0000","last_peered":"2024-08-20T01:34:55.375060+0000","last_clean":"2024-08-20T01:34:55.375060+0000","last_became_active":"2024-08-20T01:34:52.558834+0000","last_became_peered":"2024-08-20T01:34:52.558834+0000","last_unstale":"2024-08-20T01:34:55.375060+0000","last_undegraded":"2024-08-20T01:34:55.375060+0000","last_fullsized":"2024-08-20T01:34:55.375060+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:57:35.879486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:34:55.371546+0000","last_change":"2024-08-20T01:34:54.378164+0000","last_active":"2024-08-20T01:34:55.371546+0000","last_peered":"2024-08-20T01:34:55.371546+0000","last_clean":"2024-08-20T01:34:55.371546+0000","last_became_active":"2024-08-20T01:34:54.377863+0000","last_became_peered":"2024-08-20T01:34:54.377863+0000","last_unstale":"2024-08-20T01:34:55.371546+0000","last_undegraded":"2024-08-20T01:34:55.371546+0000","last_fullsized":"2024-08-20T01:34:55.371546+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:23:21.832692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"72'13","reported_seq":45,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-20T01:35:16.462431+0000","last_change":"2024-08-20T01:34:52.341730+0000","last_active":"2024-08-20T01:35:16.462431+0000","last_peered":"2024-08-20T01:35:16.462431+0000","last_clean":"2024-08-20T01:35:16.462431+0000","last_became_active":"2024-08-20T01:34:52.341407+0000","last_became_peered":"2024-08-20T01:34:52.341407+0000","last_unstale":"2024-08-20T01:35:16.462431+0000","last_undegraded":"2024-08-20T01:35:16.462431+0000","last_fullsized":"2024-08-20T01:35:16.462431+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:53:09.225154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":53222,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":158,"num_read_kb":138,"num_write":230,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":536576,"data_stored":167818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":198,"ondisk_log_size":198,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":66,"seq":283467841553,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717356,"statfs":{"total":95995035648,"available":95966572544,"internally_reserved":0,"allocated":790528,"data_stored":376912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":61,"seq":261993005079,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36788,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708364,"statfs":{"total":95995035648,"available":95957364736,"internally_reserved":0,"allocated":1478656,"data_stored":1014741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":55,"seq":236223201306,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717332,"statfs":{"total":95995035648,"available":95966547968,"internally_reserved":0,"allocated":815104,"data_stored":376842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":50,"seq":214748364832,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31976,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713176,"statfs":{"total":95995035648,"available":95962292224,"internally_reserved":0,"allocated":811008,"data_stored":377220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561060,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32560,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712592,"statfs":{"total":95995035648,"available":95961694208,"internally_reserved":0,"allocated":1409024,"data_stored":969347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":39,"seq":167503724586,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31964,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713188,"statfs":{"total":95995035648,"available":95962304512,"internally_reserved":0,"allocated":798720,"data_stored":376559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888111,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32572,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712580,"statfs":{"total":95995035648,"available":95961681920,"internally_reserved":0,"allocated":1421312,"data_stored":969025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084339,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27804,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717348,"statfs":{"total":95995035648,"available":95966564352,"internally_reserved":0,"allocated":798720,"data_stored":376420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247863,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717332,"statfs":{"total":95995035648,"available":95966547968,"internally_reserved":0,"allocated":815104,"data_stored":376384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444092,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":868352,"data_stored":424492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":847872,"data_stored":424272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738438,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":819200,"data_stored":377898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":48552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":56924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":48536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-20T01:35:21.781 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-20T01:35:21.782 INFO:tasks.cephadm:Setting up client nodes... 2024-08-20T01:35:21.782 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-08-20T01:35:22.029 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:22.045 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:21 smithi175 ceph-mon[22392]: pgmap v286: 97 pgs: 97 active+clean; 629 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.2 KiB/s wr, 15 op/s 2024-08-20T01:35:22.045 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:21 smithi175 ceph-mon[22392]: from='client.14865 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:35:22.149 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:21 smithi079 ceph-mon[18656]: pgmap v286: 97 pgs: 97 active+clean; 629 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.2 KiB/s wr, 15 op/s 2024-08-20T01:35:22.149 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:21 smithi079 ceph-mon[18656]: from='client.14865 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:35:22.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:21 smithi081 ceph-mon[22209]: pgmap v286: 97 pgs: 97 active+clean; 629 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.2 KiB/s wr, 15 op/s 2024-08-20T01:35:22.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:21 smithi081 ceph-mon[22209]: from='client.14865 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:35:22.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.558+0000 7fe04c8db640 1 -- 172.21.15.79:0/3887970860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe04806bdc0 msgr2=0x7fe048105320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:22.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.558+0000 7fe04c8db640 1 --2- 172.21.15.79:0/3887970860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe04806bdc0 0x7fe048105320 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe038009900 tx=0x7fe03802a410 comp rx=0 tx=0).stop 2024-08-20T01:35:22.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.558+0000 7fe04c8db640 1 -- 172.21.15.79:0/3887970860 shutdown_connections 2024-08-20T01:35:22.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.558+0000 7fe04c8db640 1 --2- 172.21.15.79:0/3887970860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe048108460 0x7fe04810a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:22.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.558+0000 7fe04c8db640 1 --2- 172.21.15.79:0/3887970860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0481058b0 0x7fe048107d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:22.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.558+0000 7fe04c8db640 1 --2- 172.21.15.79:0/3887970860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe04806bdc0 0x7fe048105320 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:22.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.558+0000 7fe04c8db640 1 -- 172.21.15.79:0/3887970860 >> 172.21.15.79:0/3887970860 conn(0x7fe0480fcf30 msgr2=0x7fe0480ff350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:22.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.558+0000 7fe04c8db640 1 -- 172.21.15.79:0/3887970860 shutdown_connections 2024-08-20T01:35:22.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.558+0000 7fe04c8db640 1 -- 172.21.15.79:0/3887970860 wait complete. 2024-08-20T01:35:22.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.558+0000 7fe04c8db640 1 Processor -- start 2024-08-20T01:35:22.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.559+0000 7fe04c8db640 1 -- start start 2024-08-20T01:35:22.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.559+0000 7fe04c8db640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe04806bdc0 0x7fe048102a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:22.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.559+0000 7fe04c8db640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0481058b0 0x7fe0481012c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:22.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.559+0000 7fe04c8db640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe048108460 0x7fe048101800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:22.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.559+0000 7fe04c8db640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe04810e360 con 0x7fe04806bdc0 2024-08-20T01:35:22.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.559+0000 7fe04c8db640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe04810e1e0 con 0x7fe048108460 2024-08-20T01:35:22.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.559+0000 7fe04c8db640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe04810e4e0 con 0x7fe0481058b0 2024-08-20T01:35:22.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.559+0000 7fe04659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe04806bdc0 0x7fe048102a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:22.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.559+0000 7fe04659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe04806bdc0 0x7fe048102a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51004/0 (socket says 172.21.15.79:51004) 2024-08-20T01:35:22.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.559+0000 7fe04659c640 1 -- 172.21.15.79:0/193588762 learned_addr learned my addr 172.21.15.79:0/193588762 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:35:22.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.559+0000 7fe046d9d640 1 --2- 172.21.15.79:0/193588762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe048108460 0x7fe048101800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:22.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.559+0000 7fe03dd9b640 1 --2- 172.21.15.79:0/193588762 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0481058b0 0x7fe0481012c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:22.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.559+0000 7fe04659c640 1 -- 172.21.15.79:0/193588762 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0481058b0 msgr2=0x7fe0481012c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:22.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.559+0000 7fe04659c640 1 --2- 172.21.15.79:0/193588762 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0481058b0 0x7fe0481012c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:22.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.559+0000 7fe04659c640 1 -- 172.21.15.79:0/193588762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe048108460 msgr2=0x7fe048101800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:22.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.559+0000 7fe04659c640 1 --2- 172.21.15.79:0/193588762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe048108460 0x7fe048101800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:22.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.559+0000 7fe04659c640 1 -- 172.21.15.79:0/193588762 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0481020c0 con 0x7fe04806bdc0 2024-08-20T01:35:22.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.559+0000 7fe046d9d640 1 --2- 172.21.15.79:0/193588762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe048108460 0x7fe048101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:35:22.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.559+0000 7fe04659c640 1 --2- 172.21.15.79:0/193588762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe04806bdc0 0x7fe048102a50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe038009230 tx=0x7fe0380042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:22.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.560+0000 7fe03ffff640 1 -- 172.21.15.79:0/193588762 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe03803f030 con 0x7fe04806bdc0 2024-08-20T01:35:22.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.560+0000 7fe03ffff640 1 -- 172.21.15.79:0/193588762 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe038003c90 con 0x7fe04806bdc0 2024-08-20T01:35:22.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.560+0000 7fe04c8db640 1 -- 172.21.15.79:0/193588762 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0481a2cb0 con 0x7fe04806bdc0 2024-08-20T01:35:22.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.560+0000 7fe03ffff640 1 -- 172.21.15.79:0/193588762 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe038035070 con 0x7fe04806bdc0 2024-08-20T01:35:22.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.560+0000 7fe04c8db640 1 -- 172.21.15.79:0/193588762 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0481a3160 con 0x7fe04806bdc0 2024-08-20T01:35:22.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.561+0000 7fe04c8db640 1 -- 172.21.15.79:0/193588762 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0480fea20 con 0x7fe04806bdc0 2024-08-20T01:35:22.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.562+0000 7fe03ffff640 1 -- 172.21.15.79:0/193588762 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fe038042030 con 0x7fe04806bdc0 2024-08-20T01:35:22.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.563+0000 7fe03ffff640 1 --2- 172.21.15.79:0/193588762 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe0340b3c60 0x7fe0340b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:22.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.563+0000 7fe03dd9b640 1 --2- 172.21.15.79:0/193588762 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe0340b3c60 0x7fe0340b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:22.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.563+0000 7fe03ffff640 1 -- 172.21.15.79:0/193588762 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7fe038104400 con 0x7fe04806bdc0 2024-08-20T01:35:22.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.563+0000 7fe03dd9b640 1 --2- 172.21.15.79:0/193588762 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe0340b3c60 0x7fe0340b6120 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe04806c270 tx=0x7fe030008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:22.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.567+0000 7fe03ffff640 1 -- 172.21.15.79:0/193588762 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fe0380cbaa0 con 0x7fe04806bdc0 2024-08-20T01:35:22.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.811+0000 7fe04c8db640 1 -- 172.21.15.79:0/193588762 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fe04802e340 con 0x7fe04806bdc0 2024-08-20T01:35:22.816 INFO:teuthology.orchestra.run.smithi079.stdout:[client.0] 2024-08-20T01:35:22.816 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDa8sNm1M54MBAA0EgEg8oqlTVu0YxUieGRCg== 2024-08-20T01:35:22.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.813+0000 7fe03ffff640 1 -- 172.21.15.79:0/193588762 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7fe0380cb3a0 con 0x7fe04806bdc0 2024-08-20T01:35:22.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.816+0000 7fe04c8db640 1 -- 172.21.15.79:0/193588762 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe0340b3c60 msgr2=0x7fe0340b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:22.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.816+0000 7fe04c8db640 1 --2- 172.21.15.79:0/193588762 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe0340b3c60 0x7fe0340b6120 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe04806c270 tx=0x7fe030008040 comp rx=0 tx=0).stop 2024-08-20T01:35:22.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.816+0000 7fe04c8db640 1 -- 172.21.15.79:0/193588762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe04806bdc0 msgr2=0x7fe048102a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:22.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.816+0000 7fe04c8db640 1 --2- 172.21.15.79:0/193588762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe04806bdc0 0x7fe048102a50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe038009230 tx=0x7fe0380042f0 comp rx=0 tx=0).stop 2024-08-20T01:35:22.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.816+0000 7fe04c8db640 1 -- 172.21.15.79:0/193588762 shutdown_connections 2024-08-20T01:35:22.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.816+0000 7fe04c8db640 1 --2- 172.21.15.79:0/193588762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe048108460 0x7fe048101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:22.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.816+0000 7fe04c8db640 1 --2- 172.21.15.79:0/193588762 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe0340b3c60 0x7fe0340b6120 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:22.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.816+0000 7fe04c8db640 1 --2- 172.21.15.79:0/193588762 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0481058b0 0x7fe0481012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:22.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.816+0000 7fe04c8db640 1 --2- 172.21.15.79:0/193588762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe04806bdc0 0x7fe048102a50 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:22.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.816+0000 7fe04c8db640 1 -- 172.21.15.79:0/193588762 >> 172.21.15.79:0/193588762 conn(0x7fe0480fcf30 msgr2=0x7fe048103cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:22.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.816+0000 7fe04c8db640 1 -- 172.21.15.79:0/193588762 shutdown_connections 2024-08-20T01:35:22.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:22.816+0000 7fe04c8db640 1 -- 172.21.15.79:0/193588762 wait complete. 2024-08-20T01:35:23.472 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-08-20T01:35:23.472 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-08-20T01:35:23.472 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-20T01:35:23.510 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph config log 1 --format=json 2024-08-20T01:35:23.791 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:24.047 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:23 smithi079 ceph-mon[18656]: pgmap v287: 97 pgs: 97 active+clean; 629 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 3.9 KiB/s wr, 11 op/s 2024-08-20T01:35:24.048 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:23 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/193588762' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-08-20T01:35:24.048 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:23 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/193588762' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-20T01:35:24.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:23 smithi175 ceph-mon[22392]: pgmap v287: 97 pgs: 97 active+clean; 629 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 3.9 KiB/s wr, 11 op/s 2024-08-20T01:35:24.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:23 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/193588762' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-08-20T01:35:24.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:23 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/193588762' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-20T01:35:24.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.223+0000 7fd7b2acc640 1 -- 172.21.15.79:0/3402961830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7ac1042d0 msgr2=0x7fd7ac10c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:24.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.223+0000 7fd7b2acc640 1 --2- 172.21.15.79:0/3402961830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7ac1042d0 0x7fd7ac10c7c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd794009900 tx=0x7fd79402a410 comp rx=0 tx=0).stop 2024-08-20T01:35:24.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.223+0000 7fd7b2acc640 1 -- 172.21.15.79:0/3402961830 shutdown_connections 2024-08-20T01:35:24.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.224+0000 7fd7b2acc640 1 --2- 172.21.15.79:0/3402961830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7ac10ce10 0x7fd7ac10f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:24.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.224+0000 7fd7b2acc640 1 --2- 172.21.15.79:0/3402961830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7ac1042d0 0x7fd7ac10c7c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:24.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.224+0000 7fd7b2acc640 1 --2- 172.21.15.79:0/3402961830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7ac1039b0 0x7fd7ac103d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:24.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.224+0000 7fd7b2acc640 1 -- 172.21.15.79:0/3402961830 >> 172.21.15.79:0/3402961830 conn(0x7fd7ac0fd430 msgr2=0x7fd7ac0ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:24.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.224+0000 7fd7b2acc640 1 -- 172.21.15.79:0/3402961830 shutdown_connections 2024-08-20T01:35:24.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.224+0000 7fd7b2acc640 1 -- 172.21.15.79:0/3402961830 wait complete. 2024-08-20T01:35:24.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.224+0000 7fd7b2acc640 1 Processor -- start 2024-08-20T01:35:24.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.224+0000 7fd7b2acc640 1 -- start start 2024-08-20T01:35:24.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.224+0000 7fd7b2acc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7ac1039b0 0x7fd7ac199050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:24.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.224+0000 7fd7b2acc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7ac1042d0 0x7fd7ac199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:24.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.224+0000 7fd7b2acc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7ac10ce10 0x7fd7ac19e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:24.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.224+0000 7fd7b2acc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ac112a40 con 0x7fd7ac1042d0 2024-08-20T01:35:24.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.224+0000 7fd7b2acc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ac1128c0 con 0x7fd7ac1039b0 2024-08-20T01:35:24.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.224+0000 7fd7b2acc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ac112bc0 con 0x7fd7ac10ce10 2024-08-20T01:35:24.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.225+0000 7fd7abfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7ac1042d0 0x7fd7ac199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:24.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.225+0000 7fd7abfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7ac1042d0 0x7fd7ac199590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51018/0 (socket says 172.21.15.79:51018) 2024-08-20T01:35:24.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.225+0000 7fd7abfff640 1 -- 172.21.15.79:0/965160661 learned_addr learned my addr 172.21.15.79:0/965160661 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:35:24.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.225+0000 7fd7b0868640 1 --2- 172.21.15.79:0/965160661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7ac1039b0 0x7fd7ac199050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:24.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.225+0000 7fd7abfff640 1 -- 172.21.15.79:0/965160661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7ac10ce10 msgr2=0x7fd7ac19e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:24.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.225+0000 7fd7abfff640 1 --2- 172.21.15.79:0/965160661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7ac10ce10 0x7fd7ac19e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:24.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.225+0000 7fd7abfff640 1 -- 172.21.15.79:0/965160661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7ac1039b0 msgr2=0x7fd7ac199050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:24.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.225+0000 7fd7abfff640 1 --2- 172.21.15.79:0/965160661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7ac1039b0 0x7fd7ac199050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:24.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.225+0000 7fd7abfff640 1 -- 172.21.15.79:0/965160661 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7ac19f100 con 0x7fd7ac1042d0 2024-08-20T01:35:24.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.225+0000 7fd7b0868640 1 --2- 172.21.15.79:0/965160661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7ac1039b0 0x7fd7ac199050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:35:24.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.225+0000 7fd7abfff640 1 --2- 172.21.15.79:0/965160661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7ac1042d0 0x7fd7ac199590 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd79402a930 tx=0x7fd794003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:24.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.225+0000 7fd7a9ffb640 1 -- 172.21.15.79:0/965160661 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79403f070 con 0x7fd7ac1042d0 2024-08-20T01:35:24.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.225+0000 7fd7b2acc640 1 -- 172.21.15.79:0/965160661 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7ac19f390 con 0x7fd7ac1042d0 2024-08-20T01:35:24.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.225+0000 7fd7a9ffb640 1 -- 172.21.15.79:0/965160661 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd79403bd00 con 0x7fd7ac1042d0 2024-08-20T01:35:24.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.225+0000 7fd7a9ffb640 1 -- 172.21.15.79:0/965160661 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd794035030 con 0x7fd7ac1042d0 2024-08-20T01:35:24.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.225+0000 7fd7b2acc640 1 -- 172.21.15.79:0/965160661 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7ac1a5ab0 con 0x7fd7ac1042d0 2024-08-20T01:35:24.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.227+0000 7fd7b2acc640 1 -- 172.21.15.79:0/965160661 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7ac103e10 con 0x7fd7ac1042d0 2024-08-20T01:35:24.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.228+0000 7fd7a9ffb640 1 -- 172.21.15.79:0/965160661 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fd794042070 con 0x7fd7ac1042d0 2024-08-20T01:35:24.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.228+0000 7fd7a9ffb640 1 --2- 172.21.15.79:0/965160661 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd7980b3c60 0x7fd7980b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:24.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.229+0000 7fd7b0868640 1 --2- 172.21.15.79:0/965160661 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd7980b3c60 0x7fd7980b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:24.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.229+0000 7fd7a9ffb640 1 -- 172.21.15.79:0/965160661 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7fd794104b00 con 0x7fd7ac1042d0 2024-08-20T01:35:24.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.229+0000 7fd7b0868640 1 --2- 172.21.15.79:0/965160661 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd7980b3c60 0x7fd7980b6120 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd79c009930 tx=0x7fd79c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:24.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.231+0000 7fd7a9ffb640 1 -- 172.21.15.79:0/965160661 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fd7940cc1a0 con 0x7fd7ac1042d0 2024-08-20T01:35:24.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:23 smithi081 ceph-mon[22209]: pgmap v287: 97 pgs: 97 active+clean; 629 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 3.9 KiB/s wr, 11 op/s 2024-08-20T01:35:24.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:23 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/193588762' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-08-20T01:35:24.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:23 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/193588762' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-20T01:35:24.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.407+0000 7fd7b2acc640 1 -- 172.21.15.79:0/965160661 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fd7ac107ee0 con 0x7fd7ac1042d0 2024-08-20T01:35:24.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.407+0000 7fd7a9ffb640 1 -- 172.21.15.79:0/965160661 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v49) ==== 86+0+133 (secure 0 0 0) 0x7fd7940cbaa0 con 0x7fd7ac1042d0 2024-08-20T01:35:24.410 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:35:24.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.410+0000 7fd7b2acc640 1 -- 172.21.15.79:0/965160661 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd7980b3c60 msgr2=0x7fd7980b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:24.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.410+0000 7fd7b2acc640 1 --2- 172.21.15.79:0/965160661 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd7980b3c60 0x7fd7980b6120 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd79c009930 tx=0x7fd79c008040 comp rx=0 tx=0).stop 2024-08-20T01:35:24.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.410+0000 7fd7b2acc640 1 -- 172.21.15.79:0/965160661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7ac1042d0 msgr2=0x7fd7ac199590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:24.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.410+0000 7fd7b2acc640 1 --2- 172.21.15.79:0/965160661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7ac1042d0 0x7fd7ac199590 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd79402a930 tx=0x7fd794003cd0 comp rx=0 tx=0).stop 2024-08-20T01:35:24.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.410+0000 7fd7b2acc640 1 -- 172.21.15.79:0/965160661 shutdown_connections 2024-08-20T01:35:24.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.410+0000 7fd7b2acc640 1 --2- 172.21.15.79:0/965160661 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd7980b3c60 0x7fd7980b6120 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:24.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.410+0000 7fd7b2acc640 1 --2- 172.21.15.79:0/965160661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7ac10ce10 0x7fd7ac19e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:24.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.410+0000 7fd7b2acc640 1 --2- 172.21.15.79:0/965160661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7ac1042d0 0x7fd7ac199590 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:24.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.410+0000 7fd7b2acc640 1 --2- 172.21.15.79:0/965160661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7ac1039b0 0x7fd7ac199050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:24.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.410+0000 7fd7b2acc640 1 -- 172.21.15.79:0/965160661 >> 172.21.15.79:0/965160661 conn(0x7fd7ac0fd430 msgr2=0x7fd7ac0fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:24.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.410+0000 7fd7b2acc640 1 -- 172.21.15.79:0/965160661 shutdown_connections 2024-08-20T01:35:24.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:24.410+0000 7fd7b2acc640 1 -- 172.21.15.79:0/965160661 wait complete. 2024-08-20T01:35:25.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:24 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/965160661' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-08-20T01:35:25.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:24 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/965160661' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-08-20T01:35:25.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:24 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/965160661' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-08-20T01:35:25.285 INFO:teuthology.orchestra.run.smithi079.stdout:[{"version":49,"timestamp":"2024-08-20T01:34:44.721764+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-08-20T01:35:25.285 INFO:tasks.ceph_manager:config epoch is 49 2024-08-20T01:35:25.286 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-20T01:35:25.286 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-08-20T01:35:25.286 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph mgr dump --format=json 2024-08-20T01:35:25.536 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:25.928 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:25 smithi079 ceph-mon[18656]: pgmap v288: 97 pgs: 97 active+clean; 637 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.6 KiB/s wr, 13 op/s 2024-08-20T01:35:26.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.007+0000 7f630137f640 1 -- 172.21.15.79:0/374508687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62fc104270 msgr2=0x7f62fc10c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:26.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.007+0000 7f630137f640 1 --2- 172.21.15.79:0/374508687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62fc104270 0x7f62fc10c850 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f62e4009900 tx=0x7f62e402a410 comp rx=0 tx=0).stop 2024-08-20T01:35:26.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.007+0000 7f630137f640 1 -- 172.21.15.79:0/374508687 shutdown_connections 2024-08-20T01:35:26.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.007+0000 7f630137f640 1 --2- 172.21.15.79:0/374508687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62fc10ce20 0x7f62fc10f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:26.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.007+0000 7f630137f640 1 --2- 172.21.15.79:0/374508687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62fc104270 0x7f62fc10c850 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:26.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.007+0000 7f630137f640 1 --2- 172.21.15.79:0/374508687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62fc103870 0x7f62fc103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:26.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.007+0000 7f630137f640 1 -- 172.21.15.79:0/374508687 >> 172.21.15.79:0/374508687 conn(0x7f62fc0fd440 msgr2=0x7f62fc0ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:26.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.007+0000 7f630137f640 1 -- 172.21.15.79:0/374508687 shutdown_connections 2024-08-20T01:35:26.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.007+0000 7f630137f640 1 -- 172.21.15.79:0/374508687 wait complete. 2024-08-20T01:35:26.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.007+0000 7f630137f640 1 Processor -- start 2024-08-20T01:35:26.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.007+0000 7f630137f640 1 -- start start 2024-08-20T01:35:26.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.008+0000 7f630137f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62fc103870 0x7f62fc1016f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:26.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.008+0000 7f630137f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62fc104270 0x7f62fc101c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:26.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.008+0000 7f630137f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62fc10ce20 0x7f62fc102170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:26.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.008+0000 7f630137f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f62fc112990 con 0x7f62fc104270 2024-08-20T01:35:26.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.008+0000 7f630137f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f62fc112810 con 0x7f62fc103870 2024-08-20T01:35:26.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.008+0000 7f630137f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f62fc112b10 con 0x7f62fc10ce20 2024-08-20T01:35:26.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.008+0000 7f62f3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62fc104270 0x7f62fc101c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:26.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.008+0000 7f62f3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62fc104270 0x7f62fc101c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51032/0 (socket says 172.21.15.79:51032) 2024-08-20T01:35:26.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.008+0000 7f62f3fff640 1 -- 172.21.15.79:0/1131722477 learned_addr learned my addr 172.21.15.79:0/1131722477 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:35:26.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.008+0000 7f62faffd640 1 --2- 172.21.15.79:0/1131722477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62fc103870 0x7f62fc1016f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:26.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.008+0000 7f62f3fff640 1 -- 172.21.15.79:0/1131722477 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62fc10ce20 msgr2=0x7f62fc102170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:26.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.008+0000 7f62f3fff640 1 --2- 172.21.15.79:0/1131722477 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62fc10ce20 0x7f62fc102170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:26.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.008+0000 7f62f3fff640 1 -- 172.21.15.79:0/1131722477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62fc103870 msgr2=0x7f62fc1016f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:26.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.008+0000 7f62f3fff640 1 --2- 172.21.15.79:0/1131722477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62fc103870 0x7f62fc1016f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:26.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.008+0000 7f62f3fff640 1 -- 172.21.15.79:0/1131722477 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62fc1a7260 con 0x7f62fc104270 2024-08-20T01:35:26.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.008+0000 7f62faffd640 1 --2- 172.21.15.79:0/1131722477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62fc103870 0x7f62fc1016f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:35:26.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.008+0000 7f62f3fff640 1 --2- 172.21.15.79:0/1131722477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62fc104270 0x7f62fc101c30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f62e4009a20 tx=0x7f62e4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:26.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.008+0000 7f62f8ff9640 1 -- 172.21.15.79:0/1131722477 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e403f030 con 0x7f62fc104270 2024-08-20T01:35:26.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.008+0000 7f62f8ff9640 1 -- 172.21.15.79:0/1131722477 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f62e40035f0 con 0x7f62fc104270 2024-08-20T01:35:26.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.008+0000 7f630137f640 1 -- 172.21.15.79:0/1131722477 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62fc1a74f0 con 0x7f62fc104270 2024-08-20T01:35:26.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.008+0000 7f62f8ff9640 1 -- 172.21.15.79:0/1131722477 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e4035070 con 0x7f62fc104270 2024-08-20T01:35:26.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.008+0000 7f630137f640 1 -- 172.21.15.79:0/1131722477 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62fc1a7aa0 con 0x7f62fc104270 2024-08-20T01:35:26.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.010+0000 7f630137f640 1 -- 172.21.15.79:0/1131722477 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62fc103c50 con 0x7f62fc104270 2024-08-20T01:35:26.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.011+0000 7f62f8ff9640 1 -- 172.21.15.79:0/1131722477 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f62e4003aa0 con 0x7f62fc104270 2024-08-20T01:35:26.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.012+0000 7f62f8ff9640 1 --2- 172.21.15.79:0/1131722477 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f62e80b3ce0 0x7f62e80b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:26.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.012+0000 7f62faffd640 1 --2- 172.21.15.79:0/1131722477 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f62e80b3ce0 0x7f62e80b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:26.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.012+0000 7f62f8ff9640 1 -- 172.21.15.79:0/1131722477 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7f62e4104b70 con 0x7f62fc104270 2024-08-20T01:35:26.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.013+0000 7f62faffd640 1 --2- 172.21.15.79:0/1131722477 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f62e80b3ce0 0x7f62e80b61a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f62ec00baa0 tx=0x7f62ec005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:26.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.015+0000 7f62f8ff9640 1 -- 172.21.15.79:0/1131722477 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f62e40cc210 con 0x7f62fc104270 2024-08-20T01:35:26.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:25 smithi175 ceph-mon[22392]: pgmap v288: 97 pgs: 97 active+clean; 637 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.6 KiB/s wr, 13 op/s 2024-08-20T01:35:26.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.238+0000 7f630137f640 1 -- 172.21.15.79:0/1131722477 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f62fc1a7ed0 con 0x7f62fc104270 2024-08-20T01:35:26.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.243+0000 7f62f8ff9640 1 -- 172.21.15.79:0/1131722477 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+291019 (secure 0 0 0) 0x7f62e40cbb10 con 0x7f62fc104270 2024-08-20T01:35:26.245 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:35:26.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.246+0000 7f630137f640 1 -- 172.21.15.79:0/1131722477 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f62e80b3ce0 msgr2=0x7f62e80b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:26.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.246+0000 7f630137f640 1 --2- 172.21.15.79:0/1131722477 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f62e80b3ce0 0x7f62e80b61a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f62ec00baa0 tx=0x7f62ec005d90 comp rx=0 tx=0).stop 2024-08-20T01:35:26.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.246+0000 7f630137f640 1 -- 172.21.15.79:0/1131722477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62fc104270 msgr2=0x7f62fc101c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:26.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.246+0000 7f630137f640 1 --2- 172.21.15.79:0/1131722477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62fc104270 0x7f62fc101c30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f62e4009a20 tx=0x7f62e4004270 comp rx=0 tx=0).stop 2024-08-20T01:35:26.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.246+0000 7f630137f640 1 -- 172.21.15.79:0/1131722477 shutdown_connections 2024-08-20T01:35:26.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.246+0000 7f630137f640 1 --2- 172.21.15.79:0/1131722477 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f62e80b3ce0 0x7f62e80b61a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:26.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.246+0000 7f630137f640 1 --2- 172.21.15.79:0/1131722477 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62fc10ce20 0x7f62fc102170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:26.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.246+0000 7f630137f640 1 --2- 172.21.15.79:0/1131722477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62fc104270 0x7f62fc101c30 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:26.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.246+0000 7f630137f640 1 --2- 172.21.15.79:0/1131722477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62fc103870 0x7f62fc1016f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:26.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.246+0000 7f630137f640 1 -- 172.21.15.79:0/1131722477 >> 172.21.15.79:0/1131722477 conn(0x7f62fc0fd440 msgr2=0x7f62fc0fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:26.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.246+0000 7f630137f640 1 -- 172.21.15.79:0/1131722477 shutdown_connections 2024-08-20T01:35:26.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:26.246+0000 7f630137f640 1 -- 172.21.15.79:0/1131722477 wait complete. 2024-08-20T01:35:26.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:25 smithi081 ceph-mon[22209]: pgmap v288: 97 pgs: 97 active+clean; 637 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.6 KiB/s wr, 13 op/s 2024-08-20T01:35:26.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:26 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/1131722477' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-08-20T01:35:27.064 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3038112779},{"type":"v1","addr":"172.21.15.79:6801","nonce":3038112779}]},"active_addr":"172.21.15.79:6801/3038112779","active_change":"2024-08-20T01:27:52.389685+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24119,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24121,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.79:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":2175610949}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":212469750}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":2518410933}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":2569963596}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":3484481528}]}]} 2024-08-20T01:35:27.073 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-08-20T01:35:27.073 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-08-20T01:35:27.074 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-20T01:35:27.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:26 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/1131722477' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-08-20T01:35:27.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:26 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/1131722477' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-08-20T01:35:27.327 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:27.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.801+0000 7f1c5260c640 1 -- 172.21.15.79:0/970104226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c4c107d20 msgr2=0x7f1c4c10e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:27.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.801+0000 7f1c5260c640 1 --2- 172.21.15.79:0/970104226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c4c107d20 0x7f1c4c10e520 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1c44009ca0 tx=0x7f1c4402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:35:27.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.801+0000 7f1c5260c640 1 -- 172.21.15.79:0/970104226 shutdown_connections 2024-08-20T01:35:27.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.801+0000 7f1c5260c640 1 --2- 172.21.15.79:0/970104226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c4c107d20 0x7f1c4c10e520 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:27.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.801+0000 7f1c5260c640 1 --2- 172.21.15.79:0/970104226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c4c1073a0 0x7f1c4c1077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:27.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.801+0000 7f1c5260c640 1 --2- 172.21.15.79:0/970104226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c4c101990 0x7f1c4c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:27.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.801+0000 7f1c5260c640 1 -- 172.21.15.79:0/970104226 >> 172.21.15.79:0/970104226 conn(0x7f1c4c0fd400 msgr2=0x7f1c4c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:27.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.801+0000 7f1c5260c640 1 -- 172.21.15.79:0/970104226 shutdown_connections 2024-08-20T01:35:27.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.801+0000 7f1c5260c640 1 -- 172.21.15.79:0/970104226 wait complete. 2024-08-20T01:35:27.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.802+0000 7f1c5260c640 1 Processor -- start 2024-08-20T01:35:27.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.802+0000 7f1c5260c640 1 -- start start 2024-08-20T01:35:27.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.802+0000 7f1c5260c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c4c101990 0x7f1c4c199c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:27.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.802+0000 7f1c5260c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c4c1073a0 0x7f1c4c19a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:27.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.802+0000 7f1c5260c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c4c107d20 0x7f1c4c19a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:27.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.802+0000 7f1c5260c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4c1118e0 con 0x7f1c4c101990 2024-08-20T01:35:27.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.802+0000 7f1c5260c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4c111760 con 0x7f1c4c1073a0 2024-08-20T01:35:27.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.802+0000 7f1c5260c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4c111a60 con 0x7f1c4c107d20 2024-08-20T01:35:27.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.802+0000 7f1c4bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c4c101990 0x7f1c4c199c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:27.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.802+0000 7f1c4bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c4c101990 0x7f1c4c199c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51052/0 (socket says 172.21.15.79:51052) 2024-08-20T01:35:27.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.802+0000 7f1c4bfff640 1 -- 172.21.15.79:0/3159950727 learned_addr learned my addr 172.21.15.79:0/3159950727 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:35:27.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.802+0000 7f1c4b7fe640 1 --2- 172.21.15.79:0/3159950727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c4c1073a0 0x7f1c4c19a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:27.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.802+0000 7f1c4bfff640 1 -- 172.21.15.79:0/3159950727 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c4c107d20 msgr2=0x7f1c4c19a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:27.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.802+0000 7f1c4bfff640 1 --2- 172.21.15.79:0/3159950727 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c4c107d20 0x7f1c4c19a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:27.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.802+0000 7f1c4bfff640 1 -- 172.21.15.79:0/3159950727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c4c1073a0 msgr2=0x7f1c4c19a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:27.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.802+0000 7f1c4bfff640 1 --2- 172.21.15.79:0/3159950727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c4c1073a0 0x7f1c4c19a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:27.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.802+0000 7f1c4bfff640 1 -- 172.21.15.79:0/3159950727 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c4c1a5070 con 0x7f1c4c101990 2024-08-20T01:35:27.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.802+0000 7f1c4bfff640 1 --2- 172.21.15.79:0/3159950727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c4c101990 0x7f1c4c199c90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c00b4a0 tx=0x7f1c3c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:27.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.803+0000 7f1c497fa640 1 -- 172.21.15.79:0/3159950727 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c014070 con 0x7f1c4c101990 2024-08-20T01:35:27.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.803+0000 7f1c5260c640 1 -- 172.21.15.79:0/3159950727 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c4c1a5360 con 0x7f1c4c101990 2024-08-20T01:35:27.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.803+0000 7f1c497fa640 1 -- 172.21.15.79:0/3159950727 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1c3c010aa0 con 0x7f1c4c101990 2024-08-20T01:35:27.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.803+0000 7f1c497fa640 1 -- 172.21.15.79:0/3159950727 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c017b70 con 0x7f1c4c101990 2024-08-20T01:35:27.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.803+0000 7f1c5260c640 1 -- 172.21.15.79:0/3159950727 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c4c1a58f0 con 0x7f1c4c101990 2024-08-20T01:35:27.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.804+0000 7f1c5260c640 1 -- 172.21.15.79:0/3159950727 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c4c101d70 con 0x7f1c4c101990 2024-08-20T01:35:27.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.805+0000 7f1c497fa640 1 -- 172.21.15.79:0/3159950727 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f1c3c017070 con 0x7f1c4c101990 2024-08-20T01:35:27.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.806+0000 7f1c497fa640 1 --2- 172.21.15.79:0/3159950727 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1c340b3c60 0x7f1c340b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:27.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.806+0000 7f1c4b7fe640 1 --2- 172.21.15.79:0/3159950727 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1c340b3c60 0x7f1c340b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:27.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.806+0000 7f1c497fa640 1 -- 172.21.15.79:0/3159950727 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7f1c3c0e3330 con 0x7f1c4c101990 2024-08-20T01:35:27.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.806+0000 7f1c4b7fe640 1 --2- 172.21.15.79:0/3159950727 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1c340b3c60 0x7f1c340b6120 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1c40005e10 tx=0x7f1c40005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:27.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.813+0000 7f1c497fa640 1 -- 172.21.15.79:0/3159950727 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f1c3c0aa9e0 con 0x7f1c4c101990 2024-08-20T01:35:27.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.988+0000 7f1c5260c640 1 -- 172.21.15.79:0/3159950727 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1c4c02e340 con 0x7f1c4c101990 2024-08-20T01:35:27.990 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:27 smithi079 ceph-mon[18656]: pgmap v289: 97 pgs: 97 active+clean; 637 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-08-20T01:35:27.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.989+0000 7f1c497fa640 1 -- 172.21.15.79:0/3159950727 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+22243 (secure 0 0 0) 0x7f1c3c0c4e20 con 0x7f1c4c101990 2024-08-20T01:35:27.991 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:35:27.991 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":72,"fsid":"28484e9a-5e93-11ef-bccf-c7b262605968","created":"2024-08-20T01:27:07.792689+0000","modified":"2024-08-20T01:34:55.133612+0000","last_up_change":"2024-08-20T01:34:05.838937+0000","last_in_change":"2024-08-20T01:33:43.645153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-20T01:30:30.693903+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-20T01:34:50.585939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-20T01:34:52.980599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ccdbeb3d-bb9d-4275-ad7e-49f2cc1222cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6803","nonce":1274927648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6805","nonce":1274927648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6809","nonce":1274927648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6807","nonce":1274927648}]},"public_addr":"172.21.15.79:6803/1274927648","cluster_addr":"172.21.15.79:6805/1274927648","heartbeat_back_addr":"172.21.15.79:6809/1274927648","heartbeat_front_addr":"172.21.15.79:6807/1274927648","state":["exists","up"]},{"osd":1,"uuid":"0906bc46-f89d-482d-9402-43d17e4246a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6801","nonce":1174012328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6803","nonce":1174012328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6807","nonce":1174012328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6805","nonce":1174012328}]},"public_addr":"172.21.15.81:6801/1174012328","cluster_addr":"172.21.15.81:6803/1174012328","heartbeat_back_addr":"172.21.15.81:6807/1174012328","heartbeat_front_addr":"172.21.15.81:6805/1174012328","state":["exists","up"]},{"osd":2,"uuid":"11d8fb9d-cb2c-41c8-994c-603a1d8e01a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6801","nonce":1132306232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6803","nonce":1132306232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6807","nonce":1132306232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6805","nonce":1132306232}]},"public_addr":"172.21.15.175:6801/1132306232","cluster_addr":"172.21.15.175:6803/1132306232","heartbeat_back_addr":"172.21.15.175:6807/1132306232","heartbeat_front_addr":"172.21.15.175:6805/1132306232","state":["exists","up"]},{"osd":3,"uuid":"29e35242-957f-404b-b99e-d4dd0045c35d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6811","nonce":1364181822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6813","nonce":1364181822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6817","nonce":1364181822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6815","nonce":1364181822}]},"public_addr":"172.21.15.79:6811/1364181822","cluster_addr":"172.21.15.79:6813/1364181822","heartbeat_back_addr":"172.21.15.79:6817/1364181822","heartbeat_front_addr":"172.21.15.79:6815/1364181822","state":["exists","up"]},{"osd":4,"uuid":"9139c469-270f-4465-8adb-1e748529fa68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6809","nonce":306873968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6811","nonce":306873968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6815","nonce":306873968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6813","nonce":306873968}]},"public_addr":"172.21.15.81:6809/306873968","cluster_addr":"172.21.15.81:6811/306873968","heartbeat_back_addr":"172.21.15.81:6815/306873968","heartbeat_front_addr":"172.21.15.81:6813/306873968","state":["exists","up"]},{"osd":5,"uuid":"6394e462-4510-45d6-bc99-8660085cb206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6809","nonce":3908133424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6811","nonce":3908133424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6815","nonce":3908133424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6813","nonce":3908133424}]},"public_addr":"172.21.15.175:6809/3908133424","cluster_addr":"172.21.15.175:6811/3908133424","heartbeat_back_addr":"172.21.15.175:6815/3908133424","heartbeat_front_addr":"172.21.15.175:6813/3908133424","state":["exists","up"]},{"osd":6,"uuid":"e8e51380-e2be-4c4c-82d8-d86306d9fc1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6819","nonce":3379368280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6821","nonce":3379368280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6825","nonce":3379368280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6823","nonce":3379368280}]},"public_addr":"172.21.15.79:6819/3379368280","cluster_addr":"172.21.15.79:6821/3379368280","heartbeat_back_addr":"172.21.15.79:6825/3379368280","heartbeat_front_addr":"172.21.15.79:6823/3379368280","state":["exists","up"]},{"osd":7,"uuid":"875f7876-a2ca-4254-a8cc-27eebb11cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6817","nonce":747356685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6819","nonce":747356685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6823","nonce":747356685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6821","nonce":747356685}]},"public_addr":"172.21.15.81:6817/747356685","cluster_addr":"172.21.15.81:6819/747356685","heartbeat_back_addr":"172.21.15.81:6823/747356685","heartbeat_front_addr":"172.21.15.81:6821/747356685","state":["exists","up"]},{"osd":8,"uuid":"d714a33b-8df5-411d-bc99-b33b4b27cc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6817","nonce":1537762925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6819","nonce":1537762925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6823","nonce":1537762925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6821","nonce":1537762925}]},"public_addr":"172.21.15.175:6817/1537762925","cluster_addr":"172.21.15.175:6819/1537762925","heartbeat_back_addr":"172.21.15.175:6823/1537762925","heartbeat_front_addr":"172.21.15.175:6821/1537762925","state":["exists","up"]},{"osd":9,"uuid":"82db8305-1d72-4bef-99d6-5486e4de5b03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6827","nonce":2400574113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6829","nonce":2400574113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6833","nonce":2400574113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6831","nonce":2400574113}]},"public_addr":"172.21.15.79:6827/2400574113","cluster_addr":"172.21.15.79:6829/2400574113","heartbeat_back_addr":"172.21.15.79:6833/2400574113","heartbeat_front_addr":"172.21.15.79:6831/2400574113","state":["exists","up"]},{"osd":10,"uuid":"797e1e3f-12b5-4958-9e1f-f796cffaaf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6825","nonce":4188407500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6827","nonce":4188407500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6831","nonce":4188407500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6829","nonce":4188407500}]},"public_addr":"172.21.15.81:6825/4188407500","cluster_addr":"172.21.15.81:6827/4188407500","heartbeat_back_addr":"172.21.15.81:6831/4188407500","heartbeat_front_addr":"172.21.15.81:6829/4188407500","state":["exists","up"]},{"osd":11,"uuid":"a4d218ae-5a41-4b34-9c4e-e795c4a6a16d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6825","nonce":451069549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6827","nonce":451069549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6831","nonce":451069549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6829","nonce":451069549}]},"public_addr":"172.21.15.175:6825/451069549","cluster_addr":"172.21.15.175:6827/451069549","heartbeat_back_addr":"172.21.15.175:6831/451069549","heartbeat_front_addr":"172.21.15.175:6829/451069549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:29:42.003425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:30:05.353547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:30:28.916727+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:30:52.845671+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:31:16.926826+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:31:39.840986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:32:04.013287+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:32:28.237482+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:32:51.270643+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:33:15.825156+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:33:40.037915+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:34:04.477377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:0/1750500064":"2024-08-21T01:27:52.389553+0000","172.21.15.79:0/103962305":"2024-08-21T01:27:52.389553+0000","172.21.15.79:6800/4045769179":"2024-08-21T01:27:29.643647+0000","172.21.15.79:0/525482354":"2024-08-21T01:27:52.389553+0000","172.21.15.79:6801/4045769179":"2024-08-21T01:27:29.643647+0000","172.21.15.79:0/1023212241":"2024-08-21T01:27:29.643647+0000","172.21.15.79:0/2368377219":"2024-08-21T01:27:29.643647+0000","172.21.15.79:6801/3302536522":"2024-08-21T01:27:52.389553+0000","172.21.15.79:6800/3302536522":"2024-08-21T01:27:52.389553+0000","172.21.15.79:0/3498829332":"2024-08-21T01:27:29.643647+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-20T01:35:27.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.991+0000 7f1c5260c640 1 -- 172.21.15.79:0/3159950727 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1c340b3c60 msgr2=0x7f1c340b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:27.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.991+0000 7f1c5260c640 1 --2- 172.21.15.79:0/3159950727 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1c340b3c60 0x7f1c340b6120 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1c40005e10 tx=0x7f1c40005da0 comp rx=0 tx=0).stop 2024-08-20T01:35:27.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.991+0000 7f1c5260c640 1 -- 172.21.15.79:0/3159950727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c4c101990 msgr2=0x7f1c4c199c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:27.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.991+0000 7f1c5260c640 1 --2- 172.21.15.79:0/3159950727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c4c101990 0x7f1c4c199c90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c00b4a0 tx=0x7f1c3c00b960 comp rx=0 tx=0).stop 2024-08-20T01:35:27.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.992+0000 7f1c5260c640 1 -- 172.21.15.79:0/3159950727 shutdown_connections 2024-08-20T01:35:27.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.992+0000 7f1c5260c640 1 --2- 172.21.15.79:0/3159950727 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1c340b3c60 0x7f1c340b6120 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:27.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.992+0000 7f1c5260c640 1 --2- 172.21.15.79:0/3159950727 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c4c107d20 0x7f1c4c19a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:27.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.992+0000 7f1c5260c640 1 --2- 172.21.15.79:0/3159950727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c4c1073a0 0x7f1c4c19a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:27.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.992+0000 7f1c5260c640 1 --2- 172.21.15.79:0/3159950727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c4c101990 0x7f1c4c199c90 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:27.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.992+0000 7f1c5260c640 1 -- 172.21.15.79:0/3159950727 >> 172.21.15.79:0/3159950727 conn(0x7f1c4c0fd400 msgr2=0x7f1c4c104a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:27.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.992+0000 7f1c5260c640 1 -- 172.21.15.79:0/3159950727 shutdown_connections 2024-08-20T01:35:27.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:27.992+0000 7f1c5260c640 1 -- 172.21.15.79:0/3159950727 wait complete. 2024-08-20T01:35:28.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:27 smithi175 ceph-mon[22392]: pgmap v289: 97 pgs: 97 active+clean; 637 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-08-20T01:35:28.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:27 smithi081 ceph-mon[22209]: pgmap v289: 97 pgs: 97 active+clean; 637 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-08-20T01:35:28.712 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-08-20T01:35:28.713 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-20T01:35:28.958 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:29.078 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:28 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/3159950727' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:35:29.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:28 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/3159950727' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:35:29.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:28 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/3159950727' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:35:29.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.535+0000 7f02e0cfe640 1 -- 172.21.15.79:0/1909405912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02dc10ce30 msgr2=0x7f02dc10f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:29.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.535+0000 7f02e0cfe640 1 --2- 172.21.15.79:0/1909405912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02dc10ce30 0x7f02dc10f290 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f02d4009ca0 tx=0x7f02d402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:35:29.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.535+0000 7f02e0cfe640 1 -- 172.21.15.79:0/1909405912 shutdown_connections 2024-08-20T01:35:29.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.535+0000 7f02e0cfe640 1 --2- 172.21.15.79:0/1909405912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02dc10ce30 0x7f02dc10f290 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:29.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.535+0000 7f02e0cfe640 1 --2- 172.21.15.79:0/1909405912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02dc1042f0 0x7f02dc10c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:29.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.535+0000 7f02e0cfe640 1 --2- 172.21.15.79:0/1909405912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02dc1039d0 0x7f02dc103db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:29.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.535+0000 7f02e0cfe640 1 -- 172.21.15.79:0/1909405912 >> 172.21.15.79:0/1909405912 conn(0x7f02dc0fd410 msgr2=0x7f02dc0ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:29.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.535+0000 7f02e0cfe640 1 -- 172.21.15.79:0/1909405912 shutdown_connections 2024-08-20T01:35:29.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.535+0000 7f02e0cfe640 1 -- 172.21.15.79:0/1909405912 wait complete. 2024-08-20T01:35:29.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.536+0000 7f02e0cfe640 1 Processor -- start 2024-08-20T01:35:29.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.536+0000 7f02e0cfe640 1 -- start start 2024-08-20T01:35:29.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.537+0000 7f02e0cfe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02dc1039d0 0x7f02dc199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:29.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.537+0000 7f02e0cfe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02dc1042f0 0x7f02dc199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:29.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.537+0000 7f02e0cfe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02dc10ce30 0x7f02dc19e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:29.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.537+0000 7f02e0cfe640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f02dc1129a0 con 0x7f02dc1042f0 2024-08-20T01:35:29.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.537+0000 7f02e0cfe640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f02dc112820 con 0x7f02dc1039d0 2024-08-20T01:35:29.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.537+0000 7f02e0cfe640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f02dc112b20 con 0x7f02dc10ce30 2024-08-20T01:35:29.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.537+0000 7f02d3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02dc1042f0 0x7f02dc199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:29.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.537+0000 7f02d3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02dc1042f0 0x7f02dc199650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51058/0 (socket says 172.21.15.79:51058) 2024-08-20T01:35:29.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.537+0000 7f02d3fff640 1 -- 172.21.15.79:0/3874552980 learned_addr learned my addr 172.21.15.79:0/3874552980 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:35:29.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.537+0000 7f02da59c640 1 --2- 172.21.15.79:0/3874552980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02dc1039d0 0x7f02dc199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:29.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.537+0000 7f02dad9d640 1 --2- 172.21.15.79:0/3874552980 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02dc10ce30 0x7f02dc19e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:29.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.537+0000 7f02d3fff640 1 -- 172.21.15.79:0/3874552980 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02dc10ce30 msgr2=0x7f02dc19e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:29.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.537+0000 7f02d3fff640 1 --2- 172.21.15.79:0/3874552980 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02dc10ce30 0x7f02dc19e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:29.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.537+0000 7f02d3fff640 1 -- 172.21.15.79:0/3874552980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02dc1039d0 msgr2=0x7f02dc199110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:29.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.537+0000 7f02d3fff640 1 --2- 172.21.15.79:0/3874552980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02dc1039d0 0x7f02dc199110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:29.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.537+0000 7f02d3fff640 1 -- 172.21.15.79:0/3874552980 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02dc19f1c0 con 0x7f02dc1042f0 2024-08-20T01:35:29.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.537+0000 7f02d3fff640 1 --2- 172.21.15.79:0/3874552980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02dc1042f0 0x7f02dc199650 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f02c400d750 tx=0x7f02c400db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:29.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.537+0000 7f02d37fe640 1 -- 172.21.15.79:0/3874552980 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c4017070 con 0x7f02dc1042f0 2024-08-20T01:35:29.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.537+0000 7f02d37fe640 1 -- 172.21.15.79:0/3874552980 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f02c4009cb0 con 0x7f02dc1042f0 2024-08-20T01:35:29.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.537+0000 7f02e0cfe640 1 -- 172.21.15.79:0/3874552980 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02dc19f4b0 con 0x7f02dc1042f0 2024-08-20T01:35:29.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.537+0000 7f02d37fe640 1 -- 172.21.15.79:0/3874552980 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c4003af0 con 0x7f02dc1042f0 2024-08-20T01:35:29.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.538+0000 7f02e0cfe640 1 -- 172.21.15.79:0/3874552980 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02dc1a5d40 con 0x7f02dc1042f0 2024-08-20T01:35:29.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.538+0000 7f02e0cfe640 1 -- 172.21.15.79:0/3874552980 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02dc103db0 con 0x7f02dc1042f0 2024-08-20T01:35:29.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.540+0000 7f02d37fe640 1 -- 172.21.15.79:0/3874552980 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f02c4003c90 con 0x7f02dc1042f0 2024-08-20T01:35:29.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.540+0000 7f02d37fe640 1 --2- 172.21.15.79:0/3874552980 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f02c80b3ce0 0x7f02c80b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:29.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.541+0000 7f02da59c640 1 --2- 172.21.15.79:0/3874552980 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f02c80b3ce0 0x7f02c80b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:29.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.541+0000 7f02d37fe640 1 -- 172.21.15.79:0/3874552980 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7f02c40e37d0 con 0x7f02dc1042f0 2024-08-20T01:35:29.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.541+0000 7f02da59c640 1 --2- 172.21.15.79:0/3874552980 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f02c80b3ce0 0x7f02c80b61a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f02cc00abe0 tx=0x7f02cc00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:29.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.543+0000 7f02d37fe640 1 -- 172.21.15.79:0/3874552980 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f02c40aaef0 con 0x7f02dc1042f0 2024-08-20T01:35:29.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.720+0000 7f02e0cfe640 1 -- 172.21.15.79:0/3874552980 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f02dc19a240 con 0x7f02dc1042f0 2024-08-20T01:35:29.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.721+0000 7f02d37fe640 1 -- 172.21.15.79:0/3874552980 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+22243 (secure 0 0 0) 0x7f02c40b31c0 con 0x7f02dc1042f0 2024-08-20T01:35:29.723 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:35:29.724 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":72,"fsid":"28484e9a-5e93-11ef-bccf-c7b262605968","created":"2024-08-20T01:27:07.792689+0000","modified":"2024-08-20T01:34:55.133612+0000","last_up_change":"2024-08-20T01:34:05.838937+0000","last_in_change":"2024-08-20T01:33:43.645153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-20T01:30:30.693903+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-20T01:34:50.585939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-20T01:34:52.980599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ccdbeb3d-bb9d-4275-ad7e-49f2cc1222cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6803","nonce":1274927648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6805","nonce":1274927648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6809","nonce":1274927648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6807","nonce":1274927648}]},"public_addr":"172.21.15.79:6803/1274927648","cluster_addr":"172.21.15.79:6805/1274927648","heartbeat_back_addr":"172.21.15.79:6809/1274927648","heartbeat_front_addr":"172.21.15.79:6807/1274927648","state":["exists","up"]},{"osd":1,"uuid":"0906bc46-f89d-482d-9402-43d17e4246a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6801","nonce":1174012328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6803","nonce":1174012328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6807","nonce":1174012328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6805","nonce":1174012328}]},"public_addr":"172.21.15.81:6801/1174012328","cluster_addr":"172.21.15.81:6803/1174012328","heartbeat_back_addr":"172.21.15.81:6807/1174012328","heartbeat_front_addr":"172.21.15.81:6805/1174012328","state":["exists","up"]},{"osd":2,"uuid":"11d8fb9d-cb2c-41c8-994c-603a1d8e01a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6801","nonce":1132306232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6803","nonce":1132306232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6807","nonce":1132306232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6805","nonce":1132306232}]},"public_addr":"172.21.15.175:6801/1132306232","cluster_addr":"172.21.15.175:6803/1132306232","heartbeat_back_addr":"172.21.15.175:6807/1132306232","heartbeat_front_addr":"172.21.15.175:6805/1132306232","state":["exists","up"]},{"osd":3,"uuid":"29e35242-957f-404b-b99e-d4dd0045c35d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6811","nonce":1364181822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6813","nonce":1364181822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6817","nonce":1364181822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6815","nonce":1364181822}]},"public_addr":"172.21.15.79:6811/1364181822","cluster_addr":"172.21.15.79:6813/1364181822","heartbeat_back_addr":"172.21.15.79:6817/1364181822","heartbeat_front_addr":"172.21.15.79:6815/1364181822","state":["exists","up"]},{"osd":4,"uuid":"9139c469-270f-4465-8adb-1e748529fa68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6809","nonce":306873968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6811","nonce":306873968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6815","nonce":306873968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6813","nonce":306873968}]},"public_addr":"172.21.15.81:6809/306873968","cluster_addr":"172.21.15.81:6811/306873968","heartbeat_back_addr":"172.21.15.81:6815/306873968","heartbeat_front_addr":"172.21.15.81:6813/306873968","state":["exists","up"]},{"osd":5,"uuid":"6394e462-4510-45d6-bc99-8660085cb206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6809","nonce":3908133424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6811","nonce":3908133424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6815","nonce":3908133424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6813","nonce":3908133424}]},"public_addr":"172.21.15.175:6809/3908133424","cluster_addr":"172.21.15.175:6811/3908133424","heartbeat_back_addr":"172.21.15.175:6815/3908133424","heartbeat_front_addr":"172.21.15.175:6813/3908133424","state":["exists","up"]},{"osd":6,"uuid":"e8e51380-e2be-4c4c-82d8-d86306d9fc1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6819","nonce":3379368280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6821","nonce":3379368280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6825","nonce":3379368280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6823","nonce":3379368280}]},"public_addr":"172.21.15.79:6819/3379368280","cluster_addr":"172.21.15.79:6821/3379368280","heartbeat_back_addr":"172.21.15.79:6825/3379368280","heartbeat_front_addr":"172.21.15.79:6823/3379368280","state":["exists","up"]},{"osd":7,"uuid":"875f7876-a2ca-4254-a8cc-27eebb11cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6817","nonce":747356685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6819","nonce":747356685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6823","nonce":747356685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6821","nonce":747356685}]},"public_addr":"172.21.15.81:6817/747356685","cluster_addr":"172.21.15.81:6819/747356685","heartbeat_back_addr":"172.21.15.81:6823/747356685","heartbeat_front_addr":"172.21.15.81:6821/747356685","state":["exists","up"]},{"osd":8,"uuid":"d714a33b-8df5-411d-bc99-b33b4b27cc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6817","nonce":1537762925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6819","nonce":1537762925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6823","nonce":1537762925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6821","nonce":1537762925}]},"public_addr":"172.21.15.175:6817/1537762925","cluster_addr":"172.21.15.175:6819/1537762925","heartbeat_back_addr":"172.21.15.175:6823/1537762925","heartbeat_front_addr":"172.21.15.175:6821/1537762925","state":["exists","up"]},{"osd":9,"uuid":"82db8305-1d72-4bef-99d6-5486e4de5b03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6827","nonce":2400574113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6829","nonce":2400574113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6833","nonce":2400574113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6831","nonce":2400574113}]},"public_addr":"172.21.15.79:6827/2400574113","cluster_addr":"172.21.15.79:6829/2400574113","heartbeat_back_addr":"172.21.15.79:6833/2400574113","heartbeat_front_addr":"172.21.15.79:6831/2400574113","state":["exists","up"]},{"osd":10,"uuid":"797e1e3f-12b5-4958-9e1f-f796cffaaf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6825","nonce":4188407500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6827","nonce":4188407500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6831","nonce":4188407500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6829","nonce":4188407500}]},"public_addr":"172.21.15.81:6825/4188407500","cluster_addr":"172.21.15.81:6827/4188407500","heartbeat_back_addr":"172.21.15.81:6831/4188407500","heartbeat_front_addr":"172.21.15.81:6829/4188407500","state":["exists","up"]},{"osd":11,"uuid":"a4d218ae-5a41-4b34-9c4e-e795c4a6a16d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6825","nonce":451069549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6827","nonce":451069549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6831","nonce":451069549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6829","nonce":451069549}]},"public_addr":"172.21.15.175:6825/451069549","cluster_addr":"172.21.15.175:6827/451069549","heartbeat_back_addr":"172.21.15.175:6831/451069549","heartbeat_front_addr":"172.21.15.175:6829/451069549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:29:42.003425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:30:05.353547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:30:28.916727+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:30:52.845671+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:31:16.926826+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:31:39.840986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:32:04.013287+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:32:28.237482+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:32:51.270643+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:33:15.825156+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:33:40.037915+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:34:04.477377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:0/1750500064":"2024-08-21T01:27:52.389553+0000","172.21.15.79:0/103962305":"2024-08-21T01:27:52.389553+0000","172.21.15.79:6800/4045769179":"2024-08-21T01:27:29.643647+0000","172.21.15.79:0/525482354":"2024-08-21T01:27:52.389553+0000","172.21.15.79:6801/4045769179":"2024-08-21T01:27:29.643647+0000","172.21.15.79:0/1023212241":"2024-08-21T01:27:29.643647+0000","172.21.15.79:0/2368377219":"2024-08-21T01:27:29.643647+0000","172.21.15.79:6801/3302536522":"2024-08-21T01:27:52.389553+0000","172.21.15.79:6800/3302536522":"2024-08-21T01:27:52.389553+0000","172.21.15.79:0/3498829332":"2024-08-21T01:27:29.643647+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-20T01:35:29.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.724+0000 7f02e0cfe640 1 -- 172.21.15.79:0/3874552980 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f02c80b3ce0 msgr2=0x7f02c80b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:29.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.724+0000 7f02e0cfe640 1 --2- 172.21.15.79:0/3874552980 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f02c80b3ce0 0x7f02c80b61a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f02cc00abe0 tx=0x7f02cc00a2d0 comp rx=0 tx=0).stop 2024-08-20T01:35:29.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.724+0000 7f02e0cfe640 1 -- 172.21.15.79:0/3874552980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02dc1042f0 msgr2=0x7f02dc199650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:29.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.724+0000 7f02e0cfe640 1 --2- 172.21.15.79:0/3874552980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02dc1042f0 0x7f02dc199650 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f02c400d750 tx=0x7f02c400db50 comp rx=0 tx=0).stop 2024-08-20T01:35:29.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.724+0000 7f02e0cfe640 1 -- 172.21.15.79:0/3874552980 shutdown_connections 2024-08-20T01:35:29.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.724+0000 7f02e0cfe640 1 --2- 172.21.15.79:0/3874552980 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f02c80b3ce0 0x7f02c80b61a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:29.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.724+0000 7f02e0cfe640 1 --2- 172.21.15.79:0/3874552980 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02dc10ce30 0x7f02dc19e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:29.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.724+0000 7f02e0cfe640 1 --2- 172.21.15.79:0/3874552980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02dc1042f0 0x7f02dc199650 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:29.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.724+0000 7f02e0cfe640 1 --2- 172.21.15.79:0/3874552980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02dc1039d0 0x7f02dc199110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:29.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.724+0000 7f02e0cfe640 1 -- 172.21.15.79:0/3874552980 >> 172.21.15.79:0/3874552980 conn(0x7f02dc0fd410 msgr2=0x7f02dc0fe010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:29.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.724+0000 7f02e0cfe640 1 -- 172.21.15.79:0/3874552980 shutdown_connections 2024-08-20T01:35:29.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:29.724+0000 7f02e0cfe640 1 -- 172.21.15.79:0/3874552980 wait complete. 2024-08-20T01:35:30.094 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:29 smithi079 ceph-mon[18656]: pgmap v290: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-08-20T01:35:30.094 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:29 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/3874552980' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:35:30.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:29 smithi175 ceph-mon[22392]: pgmap v290: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-08-20T01:35:30.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:29 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/3874552980' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:35:30.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:29 smithi081 ceph-mon[22209]: pgmap v290: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-08-20T01:35:30.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:29 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/3874552980' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:35:30.507 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-08-20T01:35:30.507 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-08-20T01:35:30.508 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-08-20T01:35:30.508 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-08-20T01:35:30.509 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-08-20T01:35:30.509 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-08-20T01:35:30.509 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-08-20T01:35:30.510 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-08-20T01:35:30.510 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-08-20T01:35:30.511 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-08-20T01:35:30.511 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-08-20T01:35:30.512 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-08-20T01:35:31.156 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:31.165 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:31.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.730+0000 7f9a52464640 1 -- 172.21.15.79:0/2646000194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a4c1019c0 msgr2=0x7f9a4c101da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:31.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.730+0000 7f9a52464640 1 --2- 172.21.15.79:0/2646000194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a4c1019c0 0x7f9a4c101da0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c009900 tx=0x7f9a3c02a410 comp rx=0 tx=0).stop 2024-08-20T01:35:31.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.730+0000 7f9a52464640 1 -- 172.21.15.79:0/2646000194 shutdown_connections 2024-08-20T01:35:31.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.730+0000 7f9a52464640 1 --2- 172.21.15.79:0/2646000194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a4c107d50 0x7f9a4c10e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:31.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.730+0000 7f9a52464640 1 --2- 172.21.15.79:0/2646000194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a4c1073d0 0x7f9a4c107810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:31.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.730+0000 7f9a52464640 1 --2- 172.21.15.79:0/2646000194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a4c1019c0 0x7f9a4c101da0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:31.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.730+0000 7f9a52464640 1 -- 172.21.15.79:0/2646000194 >> 172.21.15.79:0/2646000194 conn(0x7f9a4c0fd430 msgr2=0x7f9a4c0ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:31.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.730+0000 7f9a52464640 1 -- 172.21.15.79:0/2646000194 shutdown_connections 2024-08-20T01:35:31.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.730+0000 7f9a52464640 1 -- 172.21.15.79:0/2646000194 wait complete. 2024-08-20T01:35:31.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.731+0000 7f9a52464640 1 Processor -- start 2024-08-20T01:35:31.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.731+0000 7f9a52464640 1 -- start start 2024-08-20T01:35:31.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.731+0000 7f9a52464640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a4c1019c0 0x7f9a4c19b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:31.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.731+0000 7f9a52464640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a4c1073d0 0x7f9a4c19b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:31.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.731+0000 7f9a52464640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a4c107d50 0x7f9a4c1a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:31.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.731+0000 7f9a52464640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9a4c1118c0 con 0x7f9a4c1073d0 2024-08-20T01:35:31.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.731+0000 7f9a52464640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9a4c111740 con 0x7f9a4c1019c0 2024-08-20T01:35:31.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.731+0000 7f9a52464640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9a4c111a40 con 0x7f9a4c107d50 2024-08-20T01:35:31.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.731+0000 7f9a4b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a4c1073d0 0x7f9a4c19b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:31.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.731+0000 7f9a4b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a4c1073d0 0x7f9a4c19b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36462/0 (socket says 172.21.15.79:36462) 2024-08-20T01:35:31.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.731+0000 7f9a4b7fe640 1 -- 172.21.15.79:0/3921848820 learned_addr learned my addr 172.21.15.79:0/3921848820 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:35:31.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.731+0000 7f9a50a01640 1 --2- 172.21.15.79:0/3921848820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a4c107d50 0x7f9a4c1a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:31.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.731+0000 7f9a4b7fe640 1 -- 172.21.15.79:0/3921848820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a4c107d50 msgr2=0x7f9a4c1a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:31.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.731+0000 7f9a4b7fe640 1 --2- 172.21.15.79:0/3921848820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a4c107d50 0x7f9a4c1a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:31.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.731+0000 7f9a4bfff640 1 --2- 172.21.15.79:0/3921848820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a4c1019c0 0x7f9a4c19b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:31.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.731+0000 7f9a4b7fe640 1 -- 172.21.15.79:0/3921848820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a4c1019c0 msgr2=0x7f9a4c19b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:31.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.732+0000 7f9a4b7fe640 1 --2- 172.21.15.79:0/3921848820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a4c1019c0 0x7f9a4c19b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:31.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.732+0000 7f9a4b7fe640 1 -- 172.21.15.79:0/3921848820 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a4c1a1170 con 0x7f9a4c1073d0 2024-08-20T01:35:31.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.732+0000 7f9a4b7fe640 1 --2- 172.21.15.79:0/3921848820 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a4c1073d0 0x7f9a4c19b600 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9a4000c970 tx=0x7f9a4000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:31.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.732+0000 7f9a497fa640 1 -- 172.21.15.79:0/3921848820 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a40007bb0 con 0x7f9a4c1073d0 2024-08-20T01:35:31.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.732+0000 7f9a497fa640 1 -- 172.21.15.79:0/3921848820 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9a40007d50 con 0x7f9a4c1073d0 2024-08-20T01:35:31.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.732+0000 7f9a52464640 1 -- 172.21.15.79:0/3921848820 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a4c1a1460 con 0x7f9a4c1073d0 2024-08-20T01:35:31.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.732+0000 7f9a497fa640 1 -- 172.21.15.79:0/3921848820 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a40004e40 con 0x7f9a4c1073d0 2024-08-20T01:35:31.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.732+0000 7f9a52464640 1 -- 172.21.15.79:0/3921848820 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a4c1a7b20 con 0x7f9a4c1073d0 2024-08-20T01:35:31.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.733+0000 7f9a52464640 1 -- 172.21.15.79:0/3921848820 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9a4c10db90 con 0x7f9a4c1073d0 2024-08-20T01:35:31.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.735+0000 7f9a497fa640 1 -- 172.21.15.79:0/3921848820 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f9a40005000 con 0x7f9a4c1073d0 2024-08-20T01:35:31.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.735+0000 7f9a497fa640 1 --2- 172.21.15.79:0/3921848820 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9a340b3ce0 0x7f9a340b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:31.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.736+0000 7f9a4bfff640 1 --2- 172.21.15.79:0/3921848820 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9a340b3ce0 0x7f9a340b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:31.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.736+0000 7f9a497fa640 1 -- 172.21.15.79:0/3921848820 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7f9a400e3ed0 con 0x7f9a4c1073d0 2024-08-20T01:35:31.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.736+0000 7f9a497fa640 1 --2- 172.21.15.79:0/3921848820 >> [v2:172.21.15.81:6808/306873968,v1:172.21.15.81:6809/306873968] conn(0x7f9a340bd530 0x7f9a340bf950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:31.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.736+0000 7f9a497fa640 1 -- 172.21.15.79:0/3921848820 --> [v2:172.21.15.81:6808/306873968,v1:172.21.15.81:6809/306873968] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9a40016ec0 con 0x7f9a340bd530 2024-08-20T01:35:31.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.736+0000 7f9a497fa640 1 -- 172.21.15.79:0/3921848820 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7f9a400e42c0 con 0x7f9a4c1073d0 2024-08-20T01:35:31.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.736+0000 7f9a50a01640 1 --2- 172.21.15.79:0/3921848820 >> [v2:172.21.15.81:6808/306873968,v1:172.21.15.81:6809/306873968] conn(0x7f9a340bd530 0x7f9a340bf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:31.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.736+0000 7f9a4bfff640 1 --2- 172.21.15.79:0/3921848820 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9a340b3ce0 0x7f9a340b61a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c006010 tx=0x7f9a3c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:31.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.736+0000 7f9a50a01640 1 --2- 172.21.15.79:0/3921848820 >> [v2:172.21.15.81:6808/306873968,v1:172.21.15.81:6809/306873968] conn(0x7f9a340bd530 0x7f9a340bf950 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:31.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.737+0000 7f9a497fa640 1 -- 172.21.15.79:0/3921848820 <== osd.4 v2:172.21.15.81:6808/306873968 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9a40016ec0 con 0x7f9a340bd530 2024-08-20T01:35:31.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.756+0000 7f9a52464640 1 -- 172.21.15.79:0/3921848820 --> [v2:172.21.15.81:6808/306873968,v1:172.21.15.81:6809/306873968] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9a4c102c70 con 0x7f9a340bd530 2024-08-20T01:35:31.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.756+0000 7f9a497fa640 1 -- 172.21.15.79:0/3921848820 <== osd.4 v2:172.21.15.81:6808/306873968 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9a4c102c70 con 0x7f9a340bd530 2024-08-20T01:35:31.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.757+0000 7f9a52464640 1 -- 172.21.15.79:0/3921848820 >> [v2:172.21.15.81:6808/306873968,v1:172.21.15.81:6809/306873968] conn(0x7f9a340bd530 msgr2=0x7f9a340bf950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:31.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.757+0000 7f9a52464640 1 --2- 172.21.15.79:0/3921848820 >> [v2:172.21.15.81:6808/306873968,v1:172.21.15.81:6809/306873968] conn(0x7f9a340bd530 0x7f9a340bf950 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:31.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.757+0000 7f9a52464640 1 -- 172.21.15.79:0/3921848820 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9a340b3ce0 msgr2=0x7f9a340b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:31.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.757+0000 7f9a52464640 1 --2- 172.21.15.79:0/3921848820 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9a340b3ce0 0x7f9a340b61a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c006010 tx=0x7f9a3c000bc0 comp rx=0 tx=0).stop 2024-08-20T01:35:31.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.757+0000 7f9a52464640 1 -- 172.21.15.79:0/3921848820 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a4c1073d0 msgr2=0x7f9a4c19b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:31.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.757+0000 7f9a52464640 1 --2- 172.21.15.79:0/3921848820 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a4c1073d0 0x7f9a4c19b600 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9a4000c970 tx=0x7f9a4000ce30 comp rx=0 tx=0).stop 2024-08-20T01:35:31.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.757+0000 7f9a50a01640 1 -- 172.21.15.79:0/3921848820 reap_dead start 2024-08-20T01:35:31.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.757+0000 7f9a52464640 1 -- 172.21.15.79:0/3921848820 shutdown_connections 2024-08-20T01:35:31.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.757+0000 7f9a52464640 1 -- 172.21.15.79:0/3921848820 >> 172.21.15.79:0/3921848820 conn(0x7f9a4c0fd430 msgr2=0x7f9a4c06b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:31.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.757+0000 7f9a52464640 1 -- 172.21.15.79:0/3921848820 shutdown_connections 2024-08-20T01:35:31.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:31.757+0000 7f9a52464640 1 -- 172.21.15.79:0/3921848820 wait complete. 2024-08-20T01:35:31.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:31 smithi079 ceph-mon[18656]: pgmap v291: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-08-20T01:35:32.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:31 smithi175 ceph-mon[22392]: pgmap v291: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-08-20T01:35:32.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:31 smithi081 ceph-mon[22209]: pgmap v291: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-08-20T01:35:32.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.387+0000 7f6bde540640 1 -- 172.21.15.79:0/1376068361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bd8107d20 msgr2=0x7f6bd810e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:32.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.387+0000 7f6bde540640 1 --2- 172.21.15.79:0/1376068361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bd8107d20 0x7f6bd810e520 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0009ca0 tx=0x7f6bd002a8c0 comp rx=0 tx=0).stop 2024-08-20T01:35:32.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.387+0000 7f6bde540640 1 -- 172.21.15.79:0/1376068361 shutdown_connections 2024-08-20T01:35:32.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.387+0000 7f6bde540640 1 --2- 172.21.15.79:0/1376068361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bd8107d20 0x7f6bd810e520 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:32.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.387+0000 7f6bde540640 1 --2- 172.21.15.79:0/1376068361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bd81073a0 0x7f6bd81077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:32.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.387+0000 7f6bde540640 1 --2- 172.21.15.79:0/1376068361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bd8101990 0x7f6bd8101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:32.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.387+0000 7f6bde540640 1 -- 172.21.15.79:0/1376068361 >> 172.21.15.79:0/1376068361 conn(0x7f6bd80fd400 msgr2=0x7f6bd80ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:32.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.387+0000 7f6bde540640 1 -- 172.21.15.79:0/1376068361 shutdown_connections 2024-08-20T01:35:32.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.387+0000 7f6bde540640 1 -- 172.21.15.79:0/1376068361 wait complete. 2024-08-20T01:35:32.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.387+0000 7f6bde540640 1 Processor -- start 2024-08-20T01:35:32.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.388+0000 7f6bde540640 1 -- start start 2024-08-20T01:35:32.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.388+0000 7f6bde540640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bd8101990 0x7f6bd80fd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:32.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.388+0000 7f6bde540640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bd81073a0 0x7f6bd80fde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:32.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.388+0000 7f6bde540640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bd8107d20 0x7f6bd80fe380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:32.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.388+0000 7f6bde540640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd8111920 con 0x7f6bd8107d20 2024-08-20T01:35:32.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.388+0000 7f6bde540640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd81117a0 con 0x7f6bd81073a0 2024-08-20T01:35:32.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.388+0000 7f6bde540640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd8111aa0 con 0x7f6bd8101990 2024-08-20T01:35:32.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.388+0000 7f6bdcadd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bd8107d20 0x7f6bd80fe380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:32.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.388+0000 7f6bdcadd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bd8107d20 0x7f6bd80fe380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36476/0 (socket says 172.21.15.79:36476) 2024-08-20T01:35:32.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.388+0000 7f6bdcadd640 1 -- 172.21.15.79:0/3120137213 learned_addr learned my addr 172.21.15.79:0/3120137213 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:35:32.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.388+0000 7f6bd7fff640 1 --2- 172.21.15.79:0/3120137213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bd8101990 0x7f6bd80fd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:32.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.388+0000 7f6bd77fe640 1 --2- 172.21.15.79:0/3120137213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bd81073a0 0x7f6bd80fde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:32.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.388+0000 7f6bdcadd640 1 -- 172.21.15.79:0/3120137213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bd8101990 msgr2=0x7f6bd80fd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:32.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.388+0000 7f6bdcadd640 1 --2- 172.21.15.79:0/3120137213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bd8101990 0x7f6bd80fd900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:32.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.388+0000 7f6bdcadd640 1 -- 172.21.15.79:0/3120137213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bd81073a0 msgr2=0x7f6bd80fde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:32.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.388+0000 7f6bdcadd640 1 --2- 172.21.15.79:0/3120137213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bd81073a0 0x7f6bd80fde40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:32.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.388+0000 7f6bdcadd640 1 -- 172.21.15.79:0/3120137213 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bd81a7390 con 0x7f6bd8107d20 2024-08-20T01:35:32.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.388+0000 7f6bdcadd640 1 --2- 172.21.15.79:0/3120137213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bd8107d20 0x7f6bd80fe380 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0005cc0 tx=0x7f6bd0032c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:32.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.389+0000 7f6bd57fa640 1 -- 172.21.15.79:0/3120137213 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd0004040 con 0x7f6bd8107d20 2024-08-20T01:35:32.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.389+0000 7f6bde540640 1 -- 172.21.15.79:0/3120137213 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bd81a7620 con 0x7f6bd8107d20 2024-08-20T01:35:32.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.389+0000 7f6bd57fa640 1 -- 172.21.15.79:0/3120137213 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6bd0004670 con 0x7f6bd8107d20 2024-08-20T01:35:32.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.389+0000 7f6bd57fa640 1 -- 172.21.15.79:0/3120137213 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd0030cc0 con 0x7f6bd8107d20 2024-08-20T01:35:32.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.389+0000 7f6bde540640 1 -- 172.21.15.79:0/3120137213 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bd81a7be0 con 0x7f6bd8107d20 2024-08-20T01:35:32.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.389+0000 7f6bde540640 1 -- 172.21.15.79:0/3120137213 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6bd8100320 con 0x7f6bd8107d20 2024-08-20T01:35:32.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.391+0000 7f6bd57fa640 1 -- 172.21.15.79:0/3120137213 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f6bd00041e0 con 0x7f6bd8107d20 2024-08-20T01:35:32.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.392+0000 7f6bd57fa640 1 --2- 172.21.15.79:0/3120137213 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6bc00b3c60 0x7f6bc00b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:32.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.392+0000 7f6bd7fff640 1 --2- 172.21.15.79:0/3120137213 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6bc00b3c60 0x7f6bc00b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:32.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.392+0000 7f6bd57fa640 1 -- 172.21.15.79:0/3120137213 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7f6bd01054e0 con 0x7f6bd8107d20 2024-08-20T01:35:32.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.392+0000 7f6bd57fa640 1 --2- 172.21.15.79:0/3120137213 >> [v2:172.21.15.79:6810/1364181822,v1:172.21.15.79:6811/1364181822] conn(0x7f6bc00bd4a0 0x7f6bc00bf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:32.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.392+0000 7f6bd57fa640 1 -- 172.21.15.79:0/3120137213 --> [v2:172.21.15.79:6810/1364181822,v1:172.21.15.79:6811/1364181822] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6bd0046e70 con 0x7f6bc00bd4a0 2024-08-20T01:35:32.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.392+0000 7f6bd57fa640 1 -- 172.21.15.79:0/3120137213 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7f6bd01059c0 con 0x7f6bd8107d20 2024-08-20T01:35:32.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.392+0000 7f6bd77fe640 1 --2- 172.21.15.79:0/3120137213 >> [v2:172.21.15.79:6810/1364181822,v1:172.21.15.79:6811/1364181822] conn(0x7f6bc00bd4a0 0x7f6bc00bf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:32.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.392+0000 7f6bd7fff640 1 --2- 172.21.15.79:0/3120137213 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6bc00b3c60 0x7f6bc00b6120 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6bc800a810 tx=0x7f6bc8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:32.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.392+0000 7f6bd77fe640 1 --2- 172.21.15.79:0/3120137213 >> [v2:172.21.15.79:6810/1364181822,v1:172.21.15.79:6811/1364181822] conn(0x7f6bc00bd4a0 0x7f6bc00bf8c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:32.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.393+0000 7f6bd57fa640 1 -- 172.21.15.79:0/3120137213 <== osd.3 v2:172.21.15.79:6810/1364181822 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6bd0046e70 con 0x7f6bc00bd4a0 2024-08-20T01:35:32.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.406+0000 7f6bde540640 1 -- 172.21.15.79:0/3120137213 --> [v2:172.21.15.79:6810/1364181822,v1:172.21.15.79:6811/1364181822] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6bd8102c40 con 0x7f6bc00bd4a0 2024-08-20T01:35:32.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.407+0000 7f6bd57fa640 1 -- 172.21.15.79:0/3120137213 <== osd.3 v2:172.21.15.79:6810/1364181822 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6bd8102c40 con 0x7f6bc00bd4a0 2024-08-20T01:35:32.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.407+0000 7f6bde540640 1 -- 172.21.15.79:0/3120137213 >> [v2:172.21.15.79:6810/1364181822,v1:172.21.15.79:6811/1364181822] conn(0x7f6bc00bd4a0 msgr2=0x7f6bc00bf8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:32.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.407+0000 7f6bde540640 1 --2- 172.21.15.79:0/3120137213 >> [v2:172.21.15.79:6810/1364181822,v1:172.21.15.79:6811/1364181822] conn(0x7f6bc00bd4a0 0x7f6bc00bf8c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:32.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.407+0000 7f6bde540640 1 -- 172.21.15.79:0/3120137213 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6bc00b3c60 msgr2=0x7f6bc00b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:32.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.407+0000 7f6bde540640 1 --2- 172.21.15.79:0/3120137213 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6bc00b3c60 0x7f6bc00b6120 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6bc800a810 tx=0x7f6bc8008040 comp rx=0 tx=0).stop 2024-08-20T01:35:32.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.407+0000 7f6bde540640 1 -- 172.21.15.79:0/3120137213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bd8107d20 msgr2=0x7f6bd80fe380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:32.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.407+0000 7f6bde540640 1 --2- 172.21.15.79:0/3120137213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bd8107d20 0x7f6bd80fe380 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0005cc0 tx=0x7f6bd0032c40 comp rx=0 tx=0).stop 2024-08-20T01:35:32.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.407+0000 7f6bdcadd640 1 -- 172.21.15.79:0/3120137213 reap_dead start 2024-08-20T01:35:32.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.407+0000 7f6bde540640 1 -- 172.21.15.79:0/3120137213 shutdown_connections 2024-08-20T01:35:32.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.407+0000 7f6bde540640 1 -- 172.21.15.79:0/3120137213 >> 172.21.15.79:0/3120137213 conn(0x7f6bd80fd400 msgr2=0x7f6bd81044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:32.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.407+0000 7f6bde540640 1 -- 172.21.15.79:0/3120137213 shutdown_connections 2024-08-20T01:35:32.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:32.407+0000 7f6bde540640 1 -- 172.21.15.79:0/3120137213 wait complete. 2024-08-20T01:35:33.226 INFO:teuthology.orchestra.run.smithi079.stdout:120259084342 2024-08-20T01:35:33.226 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-08-20T01:35:33.279 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:33.281 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:33.288 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:33.288 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:33.289 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:33.291 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:33.291 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:33.702 INFO:teuthology.orchestra.run.smithi079.stdout:98784247866 2024-08-20T01:35:33.703 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-08-20T01:35:33.717 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:33.724 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:33.773 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:33.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:33 smithi079 ceph-mon[18656]: pgmap v292: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-08-20T01:35:34.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:33 smithi175 ceph-mon[22392]: pgmap v292: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-08-20T01:35:34.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:33 smithi081 ceph-mon[22209]: pgmap v292: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-08-20T01:35:34.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.491+0000 7f68e3d0f640 1 -- 172.21.15.79:0/3325165535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68dc10ce00 msgr2=0x7f68dc10f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:34.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.491+0000 7f68e3d0f640 1 --2- 172.21.15.79:0/3325165535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68dc10ce00 0x7f68dc10f250 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f68d4009ca0 tx=0x7f68d402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:35:34.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.491+0000 7f68e3d0f640 1 -- 172.21.15.79:0/3325165535 shutdown_connections 2024-08-20T01:35:34.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.491+0000 7f68e3d0f640 1 --2- 172.21.15.79:0/3325165535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68dc10ce00 0x7f68dc10f250 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:34.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.491+0000 7f68e3d0f640 1 --2- 172.21.15.79:0/3325165535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68dc104250 0x7f68dc10c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:34.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.491+0000 7f68e3d0f640 1 --2- 172.21.15.79:0/3325165535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68dc103850 0x7f68dc103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:34.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.491+0000 7f68e3d0f640 1 -- 172.21.15.79:0/3325165535 >> 172.21.15.79:0/3325165535 conn(0x7f68dc0fd400 msgr2=0x7f68dc0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:34.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.491+0000 7f68e3d0f640 1 -- 172.21.15.79:0/3325165535 shutdown_connections 2024-08-20T01:35:34.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.491+0000 7f68e3d0f640 1 -- 172.21.15.79:0/3325165535 wait complete. 2024-08-20T01:35:34.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.491+0000 7f68e3d0f640 1 Processor -- start 2024-08-20T01:35:34.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.491+0000 7f68e3d0f640 1 -- start start 2024-08-20T01:35:34.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.492+0000 7f68e3d0f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68dc103850 0x7f68dc198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:34.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.492+0000 7f68e3d0f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68dc104250 0x7f68dc1993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:34.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.492+0000 7f68e3d0f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68dc10ce00 0x7f68dc19e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:34.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.492+0000 7f68e3d0f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f68dc112960 con 0x7f68dc103850 2024-08-20T01:35:34.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.492+0000 7f68e3d0f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f68dc1127e0 con 0x7f68dc10ce00 2024-08-20T01:35:34.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.492+0000 7f68e3d0f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f68dc112ae0 con 0x7f68dc104250 2024-08-20T01:35:34.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.492+0000 7f68e1aab640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68dc103850 0x7f68dc198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:34.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.492+0000 7f68e1aab640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68dc103850 0x7f68dc198e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36482/0 (socket says 172.21.15.79:36482) 2024-08-20T01:35:34.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.492+0000 7f68e1aab640 1 -- 172.21.15.79:0/4056679798 learned_addr learned my addr 172.21.15.79:0/4056679798 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:35:34.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.492+0000 7f68e12aa640 1 --2- 172.21.15.79:0/4056679798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68dc104250 0x7f68dc1993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:34.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.492+0000 7f68e22ac640 1 --2- 172.21.15.79:0/4056679798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68dc10ce00 0x7f68dc19e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:34.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.492+0000 7f68e1aab640 1 -- 172.21.15.79:0/4056679798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68dc104250 msgr2=0x7f68dc1993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:34.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.492+0000 7f68e1aab640 1 --2- 172.21.15.79:0/4056679798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68dc104250 0x7f68dc1993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:34.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.492+0000 7f68e1aab640 1 -- 172.21.15.79:0/4056679798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68dc10ce00 msgr2=0x7f68dc19e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:34.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.492+0000 7f68e1aab640 1 --2- 172.21.15.79:0/4056679798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68dc10ce00 0x7f68dc19e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:34.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.492+0000 7f68e1aab640 1 -- 172.21.15.79:0/4056679798 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68dc19ef20 con 0x7f68dc103850 2024-08-20T01:35:34.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.492+0000 7f68e1aab640 1 --2- 172.21.15.79:0/4056679798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68dc103850 0x7f68dc198e70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f68d000d770 tx=0x7f68d000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:34.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.492+0000 7f68ceffd640 1 -- 172.21.15.79:0/4056679798 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d0017070 con 0x7f68dc103850 2024-08-20T01:35:34.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.492+0000 7f68e3d0f640 1 -- 172.21.15.79:0/4056679798 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68dc19f210 con 0x7f68dc103850 2024-08-20T01:35:34.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.492+0000 7f68ceffd640 1 -- 172.21.15.79:0/4056679798 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f68d00054b0 con 0x7f68dc103850 2024-08-20T01:35:34.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.493+0000 7f68ceffd640 1 -- 172.21.15.79:0/4056679798 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d0004c60 con 0x7f68dc103850 2024-08-20T01:35:34.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.493+0000 7f68e3d0f640 1 -- 172.21.15.79:0/4056679798 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68dc1a58d0 con 0x7f68dc103850 2024-08-20T01:35:34.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.493+0000 7f68e3d0f640 1 -- 172.21.15.79:0/4056679798 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f68dc0ffa30 con 0x7f68dc103850 2024-08-20T01:35:34.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.495+0000 7f68ceffd640 1 -- 172.21.15.79:0/4056679798 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f68d0004e00 con 0x7f68dc103850 2024-08-20T01:35:34.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.495+0000 7f68ceffd640 1 --2- 172.21.15.79:0/4056679798 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f68c80b3c60 0x7f68c80b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:34.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.496+0000 7f68e12aa640 1 --2- 172.21.15.79:0/4056679798 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f68c80b3c60 0x7f68c80b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:34.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.496+0000 7f68ceffd640 1 -- 172.21.15.79:0/4056679798 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7f68d00e39d0 con 0x7f68dc103850 2024-08-20T01:35:34.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.496+0000 7f68ceffd640 1 --2- 172.21.15.79:0/4056679798 >> [v2:172.21.15.81:6800/1174012328,v1:172.21.15.81:6801/1174012328] conn(0x7f68c80bd4b0 0x7f68c80bf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:34.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.496+0000 7f68ceffd640 1 -- 172.21.15.79:0/4056679798 --> [v2:172.21.15.81:6800/1174012328,v1:172.21.15.81:6801/1174012328] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f68d0001d30 con 0x7f68c80bd4b0 2024-08-20T01:35:34.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.496+0000 7f68ceffd640 1 -- 172.21.15.79:0/4056679798 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7f68d00e3eb0 con 0x7f68dc103850 2024-08-20T01:35:34.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.496+0000 7f68e12aa640 1 --2- 172.21.15.79:0/4056679798 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f68c80b3c60 0x7f68c80b6120 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f68dc10f4a0 tx=0x7f68d800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:34.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.496+0000 7f68e22ac640 1 --2- 172.21.15.79:0/4056679798 >> [v2:172.21.15.81:6800/1174012328,v1:172.21.15.81:6801/1174012328] conn(0x7f68c80bd4b0 0x7f68c80bf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:34.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.497+0000 7f68e22ac640 1 --2- 172.21.15.79:0/4056679798 >> [v2:172.21.15.81:6800/1174012328,v1:172.21.15.81:6801/1174012328] conn(0x7f68c80bd4b0 0x7f68c80bf8d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:34.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.497+0000 7f68ceffd640 1 -- 172.21.15.79:0/4056679798 <== osd.1 v2:172.21.15.81:6800/1174012328 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f68d0001d30 con 0x7f68c80bd4b0 2024-08-20T01:35:34.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.511+0000 7f68e3d0f640 1 -- 172.21.15.79:0/4056679798 --> [v2:172.21.15.81:6800/1174012328,v1:172.21.15.81:6801/1174012328] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f68dc06ae30 con 0x7f68c80bd4b0 2024-08-20T01:35:34.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.511+0000 7f68ceffd640 1 -- 172.21.15.79:0/4056679798 <== osd.1 v2:172.21.15.81:6800/1174012328 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f68dc06ae30 con 0x7f68c80bd4b0 2024-08-20T01:35:34.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.512+0000 7f68e3d0f640 1 -- 172.21.15.79:0/4056679798 >> [v2:172.21.15.81:6800/1174012328,v1:172.21.15.81:6801/1174012328] conn(0x7f68c80bd4b0 msgr2=0x7f68c80bf8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:34.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.512+0000 7f68e3d0f640 1 --2- 172.21.15.79:0/4056679798 >> [v2:172.21.15.81:6800/1174012328,v1:172.21.15.81:6801/1174012328] conn(0x7f68c80bd4b0 0x7f68c80bf8d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:34.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.512+0000 7f68e3d0f640 1 -- 172.21.15.79:0/4056679798 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f68c80b3c60 msgr2=0x7f68c80b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:34.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.512+0000 7f68e3d0f640 1 --2- 172.21.15.79:0/4056679798 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f68c80b3c60 0x7f68c80b6120 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f68dc10f4a0 tx=0x7f68d800b390 comp rx=0 tx=0).stop 2024-08-20T01:35:34.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.512+0000 7f68e3d0f640 1 -- 172.21.15.79:0/4056679798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68dc103850 msgr2=0x7f68dc198e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:34.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.512+0000 7f68e3d0f640 1 --2- 172.21.15.79:0/4056679798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68dc103850 0x7f68dc198e70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f68d000d770 tx=0x7f68d000dc30 comp rx=0 tx=0).stop 2024-08-20T01:35:34.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.512+0000 7f68e22ac640 1 -- 172.21.15.79:0/4056679798 reap_dead start 2024-08-20T01:35:34.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.512+0000 7f68e3d0f640 1 -- 172.21.15.79:0/4056679798 shutdown_connections 2024-08-20T01:35:34.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.512+0000 7f68e3d0f640 1 -- 172.21.15.79:0/4056679798 >> 172.21.15.79:0/4056679798 conn(0x7f68dc0fd400 msgr2=0x7f68dc0fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:34.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.512+0000 7f68e3d0f640 1 -- 172.21.15.79:0/4056679798 shutdown_connections 2024-08-20T01:35:34.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.512+0000 7f68e3d0f640 1 -- 172.21.15.79:0/4056679798 wait complete. 2024-08-20T01:35:34.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.709+0000 7ff202c8d640 1 -- 172.21.15.79:0/953266886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1fc1073c0 msgr2=0x7ff1fc107800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:34.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.709+0000 7ff202c8d640 1 --2- 172.21.15.79:0/953266886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1fc1073c0 0x7ff1fc107800 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8009900 tx=0x7ff1e802a410 comp rx=0 tx=0).stop 2024-08-20T01:35:34.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.709+0000 7ff202c8d640 1 -- 172.21.15.79:0/953266886 shutdown_connections 2024-08-20T01:35:34.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.709+0000 7ff202c8d640 1 --2- 172.21.15.79:0/953266886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1fc107d40 0x7ff1fc10e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:34.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.709+0000 7ff202c8d640 1 --2- 172.21.15.79:0/953266886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1fc1073c0 0x7ff1fc107800 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:34.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.709+0000 7ff202c8d640 1 --2- 172.21.15.79:0/953266886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1fc1019b0 0x7ff1fc101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:34.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.709+0000 7ff202c8d640 1 -- 172.21.15.79:0/953266886 >> 172.21.15.79:0/953266886 conn(0x7ff1fc0fd460 msgr2=0x7ff1fc0ff880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:34.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.709+0000 7ff202c8d640 1 -- 172.21.15.79:0/953266886 shutdown_connections 2024-08-20T01:35:34.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.709+0000 7ff202c8d640 1 -- 172.21.15.79:0/953266886 wait complete. 2024-08-20T01:35:34.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.710+0000 7ff202c8d640 1 Processor -- start 2024-08-20T01:35:34.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.710+0000 7ff202c8d640 1 -- start start 2024-08-20T01:35:34.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.710+0000 7ff202c8d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1fc1019b0 0x7ff1fc198f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:34.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.710+0000 7ff202c8d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1fc1073c0 0x7ff1fc199490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:34.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.710+0000 7ff202c8d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1fc107d40 0x7ff1fc19e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:34.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.710+0000 7ff202c8d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff1fc1118b0 con 0x7ff1fc1019b0 2024-08-20T01:35:34.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.710+0000 7ff202c8d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff1fc111730 con 0x7ff1fc1073c0 2024-08-20T01:35:34.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.710+0000 7ff202c8d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff1fc111a30 con 0x7ff1fc107d40 2024-08-20T01:35:34.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.710+0000 7ff200a29640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1fc1019b0 0x7ff1fc198f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:34.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.710+0000 7ff200a29640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1fc1019b0 0x7ff1fc198f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36502/0 (socket says 172.21.15.79:36502) 2024-08-20T01:35:34.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.710+0000 7ff200a29640 1 -- 172.21.15.79:0/2051730575 learned_addr learned my addr 172.21.15.79:0/2051730575 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:35:34.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.710+0000 7ff1fbfff640 1 --2- 172.21.15.79:0/2051730575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1fc1073c0 0x7ff1fc199490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:34.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.711+0000 7ff20122a640 1 --2- 172.21.15.79:0/2051730575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1fc107d40 0x7ff1fc19e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:34.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.711+0000 7ff200a29640 1 -- 172.21.15.79:0/2051730575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1fc107d40 msgr2=0x7ff1fc19e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:34.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.711+0000 7ff200a29640 1 --2- 172.21.15.79:0/2051730575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1fc107d40 0x7ff1fc19e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:34.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.711+0000 7ff200a29640 1 -- 172.21.15.79:0/2051730575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1fc1073c0 msgr2=0x7ff1fc199490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:34.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.711+0000 7ff200a29640 1 --2- 172.21.15.79:0/2051730575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1fc1073c0 0x7ff1fc199490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:34.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.711+0000 7ff200a29640 1 -- 172.21.15.79:0/2051730575 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1fc19f000 con 0x7ff1fc1019b0 2024-08-20T01:35:34.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.711+0000 7ff20122a640 1 --2- 172.21.15.79:0/2051730575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1fc107d40 0x7ff1fc19e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:35:34.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.711+0000 7ff200a29640 1 --2- 172.21.15.79:0/2051730575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1fc1019b0 0x7ff1fc198f50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff1f000d950 tx=0x7ff1f000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:34.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.711+0000 7ff1f9ffb640 1 -- 172.21.15.79:0/2051730575 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f0017070 con 0x7ff1fc1019b0 2024-08-20T01:35:34.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.711+0000 7ff202c8d640 1 -- 172.21.15.79:0/2051730575 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1fc19f2f0 con 0x7ff1fc1019b0 2024-08-20T01:35:34.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.711+0000 7ff1f9ffb640 1 -- 172.21.15.79:0/2051730575 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff1f0009c30 con 0x7ff1fc1019b0 2024-08-20T01:35:34.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.711+0000 7ff1f9ffb640 1 -- 172.21.15.79:0/2051730575 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f000f620 con 0x7ff1fc1019b0 2024-08-20T01:35:34.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.711+0000 7ff202c8d640 1 -- 172.21.15.79:0/2051730575 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1fc1a5b80 con 0x7ff1fc1019b0 2024-08-20T01:35:34.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.712+0000 7ff202c8d640 1 -- 172.21.15.79:0/2051730575 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff1fc100380 con 0x7ff1fc1019b0 2024-08-20T01:35:34.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.714+0000 7ff1f9ffb640 1 -- 172.21.15.79:0/2051730575 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7ff1f0010460 con 0x7ff1fc1019b0 2024-08-20T01:35:34.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.714+0000 7ff1f9ffb640 1 --2- 172.21.15.79:0/2051730575 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff1ec0b3c60 0x7ff1ec0b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:34.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.715+0000 7ff1fbfff640 1 --2- 172.21.15.79:0/2051730575 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff1ec0b3c60 0x7ff1ec0b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:34.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.715+0000 7ff1f9ffb640 1 -- 172.21.15.79:0/2051730575 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7ff1f00e3c70 con 0x7ff1fc1019b0 2024-08-20T01:35:34.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.715+0000 7ff1f9ffb640 1 --2- 172.21.15.79:0/2051730575 >> [v2:172.21.15.175:6800/1132306232,v1:172.21.15.175:6801/1132306232] conn(0x7ff1ec0bd4b0 0x7ff1ec0bf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:34.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.715+0000 7ff1f9ffb640 1 -- 172.21.15.79:0/2051730575 --> [v2:172.21.15.175:6800/1132306232,v1:172.21.15.175:6801/1132306232] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff1f0015e80 con 0x7ff1ec0bd4b0 2024-08-20T01:35:34.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.715+0000 7ff1f9ffb640 1 -- 172.21.15.79:0/2051730575 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7ff1f00e4150 con 0x7ff1fc1019b0 2024-08-20T01:35:34.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.715+0000 7ff1fbfff640 1 --2- 172.21.15.79:0/2051730575 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff1ec0b3c60 0x7ff1ec0b6120 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff1e80057c0 tx=0x7ff1e80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:34.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.715+0000 7ff20122a640 1 --2- 172.21.15.79:0/2051730575 >> [v2:172.21.15.175:6800/1132306232,v1:172.21.15.175:6801/1132306232] conn(0x7ff1ec0bd4b0 0x7ff1ec0bf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:34.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.716+0000 7ff20122a640 1 --2- 172.21.15.79:0/2051730575 >> [v2:172.21.15.175:6800/1132306232,v1:172.21.15.175:6801/1132306232] conn(0x7ff1ec0bd4b0 0x7ff1ec0bf8d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:34.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.716+0000 7ff1f9ffb640 1 -- 172.21.15.79:0/2051730575 <== osd.2 v2:172.21.15.175:6800/1132306232 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff1f0015e80 con 0x7ff1ec0bd4b0 2024-08-20T01:35:34.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.730+0000 7ff202c8d640 1 -- 172.21.15.79:0/2051730575 --> [v2:172.21.15.175:6800/1132306232,v1:172.21.15.175:6801/1132306232] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff1fc102c60 con 0x7ff1ec0bd4b0 2024-08-20T01:35:34.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.731+0000 7ff1f9ffb640 1 -- 172.21.15.79:0/2051730575 <== osd.2 v2:172.21.15.175:6800/1132306232 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff1fc102c60 con 0x7ff1ec0bd4b0 2024-08-20T01:35:34.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.731+0000 7ff202c8d640 1 -- 172.21.15.79:0/2051730575 >> [v2:172.21.15.175:6800/1132306232,v1:172.21.15.175:6801/1132306232] conn(0x7ff1ec0bd4b0 msgr2=0x7ff1ec0bf8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:34.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.731+0000 7ff202c8d640 1 --2- 172.21.15.79:0/2051730575 >> [v2:172.21.15.175:6800/1132306232,v1:172.21.15.175:6801/1132306232] conn(0x7ff1ec0bd4b0 0x7ff1ec0bf8d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:34.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.731+0000 7ff202c8d640 1 -- 172.21.15.79:0/2051730575 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff1ec0b3c60 msgr2=0x7ff1ec0b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:34.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.731+0000 7ff202c8d640 1 --2- 172.21.15.79:0/2051730575 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff1ec0b3c60 0x7ff1ec0b6120 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff1e80057c0 tx=0x7ff1e80058d0 comp rx=0 tx=0).stop 2024-08-20T01:35:34.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.731+0000 7ff202c8d640 1 -- 172.21.15.79:0/2051730575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1fc1019b0 msgr2=0x7ff1fc198f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:34.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.731+0000 7ff202c8d640 1 --2- 172.21.15.79:0/2051730575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1fc1019b0 0x7ff1fc198f50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff1f000d950 tx=0x7ff1f000de10 comp rx=0 tx=0).stop 2024-08-20T01:35:34.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.731+0000 7ff20122a640 1 -- 172.21.15.79:0/2051730575 reap_dead start 2024-08-20T01:35:34.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.731+0000 7ff202c8d640 1 -- 172.21.15.79:0/2051730575 shutdown_connections 2024-08-20T01:35:34.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.731+0000 7ff202c8d640 1 -- 172.21.15.79:0/2051730575 >> 172.21.15.79:0/2051730575 conn(0x7ff1fc0fd460 msgr2=0x7ff1fc06b330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:34.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.731+0000 7ff202c8d640 1 -- 172.21.15.79:0/2051730575 shutdown_connections 2024-08-20T01:35:34.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:34.731+0000 7ff202c8d640 1 -- 172.21.15.79:0/2051730575 wait complete. 2024-08-20T01:35:36.014 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:35 smithi079 ceph-mon[18656]: pgmap v293: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-08-20T01:35:36.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:35 smithi175 ceph-mon[22392]: pgmap v293: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-08-20T01:35:36.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:35 smithi081 ceph-mon[22209]: pgmap v293: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-08-20T01:35:36.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.535+0000 7f435de6c640 1 -- 172.21.15.79:0/2396882785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4358101990 msgr2=0x7f4358101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:36.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.535+0000 7f435de6c640 1 --2- 172.21.15.79:0/2396882785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4358101990 0x7f4358101d70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4348009900 tx=0x7f434802a410 comp rx=0 tx=0).stop 2024-08-20T01:35:36.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.535+0000 7f435de6c640 1 -- 172.21.15.79:0/2396882785 shutdown_connections 2024-08-20T01:35:36.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.535+0000 7f435de6c640 1 --2- 172.21.15.79:0/2396882785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4358107d20 0x7f435810e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:36.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.535+0000 7f435de6c640 1 --2- 172.21.15.79:0/2396882785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43581073a0 0x7f43581077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:36.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.535+0000 7f435de6c640 1 --2- 172.21.15.79:0/2396882785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4358101990 0x7f4358101d70 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:36.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.535+0000 7f435de6c640 1 -- 172.21.15.79:0/2396882785 >> 172.21.15.79:0/2396882785 conn(0x7f43580fd400 msgr2=0x7f43580ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:36.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.535+0000 7f435de6c640 1 -- 172.21.15.79:0/2396882785 shutdown_connections 2024-08-20T01:35:36.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.535+0000 7f435de6c640 1 -- 172.21.15.79:0/2396882785 wait complete. 2024-08-20T01:35:36.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.535+0000 7f435de6c640 1 Processor -- start 2024-08-20T01:35:36.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.535+0000 7f435de6c640 1 -- start start 2024-08-20T01:35:36.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.536+0000 7f435de6c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4358101990 0x7f4358198f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:36.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.536+0000 7f435de6c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43581073a0 0x7f4358199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:36.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.536+0000 7f435de6c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4358107d20 0x7f435819e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:36.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.536+0000 7f435de6c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f43581129b0 con 0x7f4358107d20 2024-08-20T01:35:36.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.536+0000 7f435de6c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4358112830 con 0x7f43581073a0 2024-08-20T01:35:36.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.536+0000 7f435de6c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4358112b30 con 0x7f4358101990 2024-08-20T01:35:36.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.536+0000 7f4357fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4358107d20 0x7f435819e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:36.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.536+0000 7f4357fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4358107d20 0x7f435819e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36538/0 (socket says 172.21.15.79:36538) 2024-08-20T01:35:36.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.536+0000 7f4357fff640 1 -- 172.21.15.79:0/3199797081 learned_addr learned my addr 172.21.15.79:0/3199797081 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:35:36.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.536+0000 7f43577fe640 1 --2- 172.21.15.79:0/3199797081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4358101990 0x7f4358198f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:36.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.536+0000 7f4356ffd640 1 --2- 172.21.15.79:0/3199797081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43581073a0 0x7f4358199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:36.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.536+0000 7f4357fff640 1 -- 172.21.15.79:0/3199797081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4358101990 msgr2=0x7f4358198f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:36.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.536+0000 7f4357fff640 1 --2- 172.21.15.79:0/3199797081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4358101990 0x7f4358198f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:36.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.536+0000 7f4357fff640 1 -- 172.21.15.79:0/3199797081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43581073a0 msgr2=0x7f4358199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:36.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.536+0000 7f4357fff640 1 --2- 172.21.15.79:0/3199797081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43581073a0 0x7f4358199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:36.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.536+0000 7f4357fff640 1 -- 172.21.15.79:0/3199797081 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f435819efb0 con 0x7f4358107d20 2024-08-20T01:35:36.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.536+0000 7f4357fff640 1 --2- 172.21.15.79:0/3199797081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4358107d20 0x7f435819e7e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f435000eb10 tx=0x7f435000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:36.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.536+0000 7f4354ff9640 1 -- 172.21.15.79:0/3199797081 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4350004b20 con 0x7f4358107d20 2024-08-20T01:35:36.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.536+0000 7f435de6c640 1 -- 172.21.15.79:0/3199797081 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f435819f2a0 con 0x7f4358107d20 2024-08-20T01:35:36.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.536+0000 7f4354ff9640 1 -- 172.21.15.79:0/3199797081 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4350004cc0 con 0x7f4358107d20 2024-08-20T01:35:36.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.536+0000 7f4354ff9640 1 -- 172.21.15.79:0/3199797081 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4350010690 con 0x7f4358107d20 2024-08-20T01:35:36.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.536+0000 7f435de6c640 1 -- 172.21.15.79:0/3199797081 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43581a5960 con 0x7f4358107d20 2024-08-20T01:35:36.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.537+0000 7f435de6c640 1 -- 172.21.15.79:0/3199797081 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4358063610 con 0x7f4358107d20 2024-08-20T01:35:36.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.539+0000 7f4354ff9640 1 -- 172.21.15.79:0/3199797081 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f4350005000 con 0x7f4358107d20 2024-08-20T01:35:36.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.539+0000 7f4354ff9640 1 --2- 172.21.15.79:0/3199797081 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f43440b3c60 0x7f43440b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:36.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.539+0000 7f43577fe640 1 --2- 172.21.15.79:0/3199797081 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f43440b3c60 0x7f43440b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:36.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.540+0000 7f4354ff9640 1 -- 172.21.15.79:0/3199797081 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7f43500e4650 con 0x7f4358107d20 2024-08-20T01:35:36.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.540+0000 7f4354ff9640 1 --2- 172.21.15.79:0/3199797081 >> [v2:172.21.15.175:6808/3908133424,v1:172.21.15.175:6809/3908133424] conn(0x7f43440bd4b0 0x7f43440bf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:36.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.540+0000 7f4354ff9640 1 -- 172.21.15.79:0/3199797081 --> [v2:172.21.15.175:6808/3908133424,v1:172.21.15.175:6809/3908133424] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f43440bff80 con 0x7f43440bd4b0 2024-08-20T01:35:36.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.540+0000 7f4354ff9640 1 -- 172.21.15.79:0/3199797081 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7f43500e4b30 con 0x7f4358107d20 2024-08-20T01:35:36.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.540+0000 7f43577fe640 1 --2- 172.21.15.79:0/3199797081 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f43440b3c60 0x7f43440b6120 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f43480057c0 tx=0x7f43480058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:36.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.540+0000 7f4356ffd640 1 --2- 172.21.15.79:0/3199797081 >> [v2:172.21.15.175:6808/3908133424,v1:172.21.15.175:6809/3908133424] conn(0x7f43440bd4b0 0x7f43440bf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:36.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.540+0000 7f4356ffd640 1 --2- 172.21.15.79:0/3199797081 >> [v2:172.21.15.175:6808/3908133424,v1:172.21.15.175:6809/3908133424] conn(0x7f43440bd4b0 0x7f43440bf8d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:36.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.541+0000 7f4354ff9640 1 -- 172.21.15.79:0/3199797081 <== osd.5 v2:172.21.15.175:6808/3908133424 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f43440bff80 con 0x7f43440bd4b0 2024-08-20T01:35:36.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.555+0000 7f435de6c640 1 -- 172.21.15.79:0/3199797081 --> [v2:172.21.15.175:6808/3908133424,v1:172.21.15.175:6809/3908133424] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4358063a90 con 0x7f43440bd4b0 2024-08-20T01:35:36.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.555+0000 7f4354ff9640 1 -- 172.21.15.79:0/3199797081 <== osd.5 v2:172.21.15.175:6808/3908133424 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4358063a90 con 0x7f43440bd4b0 2024-08-20T01:35:36.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.556+0000 7f435de6c640 1 -- 172.21.15.79:0/3199797081 >> [v2:172.21.15.175:6808/3908133424,v1:172.21.15.175:6809/3908133424] conn(0x7f43440bd4b0 msgr2=0x7f43440bf8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:36.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.556+0000 7f435de6c640 1 --2- 172.21.15.79:0/3199797081 >> [v2:172.21.15.175:6808/3908133424,v1:172.21.15.175:6809/3908133424] conn(0x7f43440bd4b0 0x7f43440bf8d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:36.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.556+0000 7f435de6c640 1 -- 172.21.15.79:0/3199797081 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f43440b3c60 msgr2=0x7f43440b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:36.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.556+0000 7f435de6c640 1 --2- 172.21.15.79:0/3199797081 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f43440b3c60 0x7f43440b6120 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f43480057c0 tx=0x7f43480058d0 comp rx=0 tx=0).stop 2024-08-20T01:35:36.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.556+0000 7f435de6c640 1 -- 172.21.15.79:0/3199797081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4358107d20 msgr2=0x7f435819e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:36.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.556+0000 7f435de6c640 1 --2- 172.21.15.79:0/3199797081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4358107d20 0x7f435819e7e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f435000eb10 tx=0x7f435000c2d0 comp rx=0 tx=0).stop 2024-08-20T01:35:36.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.556+0000 7f4357fff640 1 -- 172.21.15.79:0/3199797081 reap_dead start 2024-08-20T01:35:36.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.556+0000 7f435de6c640 1 -- 172.21.15.79:0/3199797081 shutdown_connections 2024-08-20T01:35:36.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.556+0000 7f435de6c640 1 -- 172.21.15.79:0/3199797081 >> 172.21.15.79:0/3199797081 conn(0x7f43580fd400 msgr2=0x7f43580ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:36.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.556+0000 7f435de6c640 1 -- 172.21.15.79:0/3199797081 shutdown_connections 2024-08-20T01:35:36.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.556+0000 7f435de6c640 1 -- 172.21.15.79:0/3199797081 wait complete. 2024-08-20T01:35:37.533 INFO:teuthology.orchestra.run.smithi079.stdout:73014444095 2024-08-20T01:35:37.534 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-08-20T01:35:37.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.703+0000 7fd02f1a0640 1 -- 172.21.15.79:0/2077104324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd028107200 msgr2=0x7fd028107640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:37.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.703+0000 7fd02f1a0640 1 --2- 172.21.15.79:0/2077104324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd028107200 0x7fd028107640 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd024009900 tx=0x7fd02402a410 comp rx=0 tx=0).stop 2024-08-20T01:35:37.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.703+0000 7fd02f1a0640 1 -- 172.21.15.79:0/2077104324 shutdown_connections 2024-08-20T01:35:37.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.703+0000 7fd02f1a0640 1 --2- 172.21.15.79:0/2077104324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd028107b80 0x7fd02810e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:37.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.703+0000 7fd02f1a0640 1 --2- 172.21.15.79:0/2077104324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd028107200 0x7fd028107640 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:37.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.703+0000 7fd02f1a0640 1 --2- 172.21.15.79:0/2077104324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0281017f0 0x7fd028101bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:37.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.703+0000 7fd02f1a0640 1 -- 172.21.15.79:0/2077104324 >> 172.21.15.79:0/2077104324 conn(0x7fd0280fd2a0 msgr2=0x7fd0280ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:37.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.703+0000 7fd02f1a0640 1 -- 172.21.15.79:0/2077104324 shutdown_connections 2024-08-20T01:35:37.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.703+0000 7fd02f1a0640 1 -- 172.21.15.79:0/2077104324 wait complete. 2024-08-20T01:35:37.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.704+0000 7fd02f1a0640 1 Processor -- start 2024-08-20T01:35:37.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.704+0000 7fd02f1a0640 1 -- start start 2024-08-20T01:35:37.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.704+0000 7fd02f1a0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0281017f0 0x7fd028197b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:37.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.704+0000 7fd02f1a0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd028107200 0x7fd028198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:37.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.704+0000 7fd02f1a0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd028107b80 0x7fd02819d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:37.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.705+0000 7fd02f1a0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd0281116f0 con 0x7fd028107b80 2024-08-20T01:35:37.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.705+0000 7fd02f1a0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd028111570 con 0x7fd0281017f0 2024-08-20T01:35:37.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.705+0000 7fd02f1a0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd028111870 con 0x7fd028107200 2024-08-20T01:35:37.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.705+0000 7fd02e99f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd028107b80 0x7fd02819d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:37.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.705+0000 7fd02e99f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd028107b80 0x7fd02819d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36546/0 (socket says 172.21.15.79:36546) 2024-08-20T01:35:37.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.705+0000 7fd02e99f640 1 -- 172.21.15.79:0/1507320330 learned_addr learned my addr 172.21.15.79:0/1507320330 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:35:37.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.705+0000 7fd02d99d640 1 --2- 172.21.15.79:0/1507320330 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd028107200 0x7fd028198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:37.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.705+0000 7fd02e19e640 1 --2- 172.21.15.79:0/1507320330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0281017f0 0x7fd028197b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:37.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.705+0000 7fd02e99f640 1 -- 172.21.15.79:0/1507320330 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd028107200 msgr2=0x7fd028198060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:37.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.705+0000 7fd02e99f640 1 --2- 172.21.15.79:0/1507320330 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd028107200 0x7fd028198060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:37.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.705+0000 7fd02e99f640 1 -- 172.21.15.79:0/1507320330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0281017f0 msgr2=0x7fd028197b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:37.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.705+0000 7fd02e99f640 1 --2- 172.21.15.79:0/1507320330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0281017f0 0x7fd028197b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:37.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.705+0000 7fd02e99f640 1 -- 172.21.15.79:0/1507320330 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd02819dbd0 con 0x7fd028107b80 2024-08-20T01:35:37.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.705+0000 7fd02d99d640 1 --2- 172.21.15.79:0/1507320330 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd028107200 0x7fd028198060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:35:37.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.705+0000 7fd02e19e640 1 --2- 172.21.15.79:0/1507320330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0281017f0 0x7fd028197b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:35:37.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.705+0000 7fd02e99f640 1 --2- 172.21.15.79:0/1507320330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd028107b80 0x7fd02819d400 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd02000b970 tx=0x7fd02000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:37.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.705+0000 7fd01f7fe640 1 -- 172.21.15.79:0/1507320330 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd020019070 con 0x7fd028107b80 2024-08-20T01:35:37.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.705+0000 7fd01f7fe640 1 -- 172.21.15.79:0/1507320330 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd020014440 con 0x7fd028107b80 2024-08-20T01:35:37.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.705+0000 7fd02f1a0640 1 -- 172.21.15.79:0/1507320330 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd02819dec0 con 0x7fd028107b80 2024-08-20T01:35:37.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.705+0000 7fd01f7fe640 1 -- 172.21.15.79:0/1507320330 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0200075d0 con 0x7fd028107b80 2024-08-20T01:35:37.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.705+0000 7fd02f1a0640 1 -- 172.21.15.79:0/1507320330 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd02806afd0 con 0x7fd028107b80 2024-08-20T01:35:37.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.706+0000 7fd02f1a0640 1 -- 172.21.15.79:0/1507320330 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd02806b630 con 0x7fd028107b80 2024-08-20T01:35:37.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.708+0000 7fd01f7fe640 1 -- 172.21.15.79:0/1507320330 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fd02001c070 con 0x7fd028107b80 2024-08-20T01:35:37.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.709+0000 7fd01f7fe640 1 --2- 172.21.15.79:0/1507320330 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd0140b5f20 0x7fd0140b83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:37.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.709+0000 7fd02e19e640 1 --2- 172.21.15.79:0/1507320330 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd0140b5f20 0x7fd0140b83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:37.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.709+0000 7fd01f7fe640 1 -- 172.21.15.79:0/1507320330 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7fd0200e3a70 con 0x7fd028107b80 2024-08-20T01:35:37.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.709+0000 7fd01f7fe640 1 --2- 172.21.15.79:0/1507320330 >> [v2:172.21.15.175:6816/1537762925,v1:172.21.15.175:6817/1537762925] conn(0x7fd0140bf770 0x7fd0140c1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:37.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.709+0000 7fd01f7fe640 1 -- 172.21.15.79:0/1507320330 --> [v2:172.21.15.175:6816/1537762925,v1:172.21.15.175:6817/1537762925] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd020020e50 con 0x7fd0140bf770 2024-08-20T01:35:37.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.709+0000 7fd01f7fe640 1 -- 172.21.15.79:0/1507320330 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7fd0200e3e20 con 0x7fd028107b80 2024-08-20T01:35:37.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.709+0000 7fd02e19e640 1 --2- 172.21.15.79:0/1507320330 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd0140b5f20 0x7fd0140b83e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd01800abe0 tx=0x7fd01800a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:37.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.709+0000 7fd02d99d640 1 --2- 172.21.15.79:0/1507320330 >> [v2:172.21.15.175:6816/1537762925,v1:172.21.15.175:6817/1537762925] conn(0x7fd0140bf770 0x7fd0140c1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:37.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.710+0000 7fd02d99d640 1 --2- 172.21.15.79:0/1507320330 >> [v2:172.21.15.175:6816/1537762925,v1:172.21.15.175:6817/1537762925] conn(0x7fd0140bf770 0x7fd0140c1b90 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:37.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.710+0000 7fd01f7fe640 1 -- 172.21.15.79:0/1507320330 <== osd.8 v2:172.21.15.175:6816/1537762925 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd020020e50 con 0x7fd0140bf770 2024-08-20T01:35:37.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.724+0000 7fd02f1a0640 1 -- 172.21.15.79:0/1507320330 --> [v2:172.21.15.175:6816/1537762925,v1:172.21.15.175:6817/1537762925] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd02806ba60 con 0x7fd0140bf770 2024-08-20T01:35:37.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.725+0000 7fd01f7fe640 1 -- 172.21.15.79:0/1507320330 <== osd.8 v2:172.21.15.175:6816/1537762925 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd02806ba60 con 0x7fd0140bf770 2024-08-20T01:35:37.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.725+0000 7fd02f1a0640 1 -- 172.21.15.79:0/1507320330 >> [v2:172.21.15.175:6816/1537762925,v1:172.21.15.175:6817/1537762925] conn(0x7fd0140bf770 msgr2=0x7fd0140c1b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:37.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.725+0000 7fd02f1a0640 1 --2- 172.21.15.79:0/1507320330 >> [v2:172.21.15.175:6816/1537762925,v1:172.21.15.175:6817/1537762925] conn(0x7fd0140bf770 0x7fd0140c1b90 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:37.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.725+0000 7fd02f1a0640 1 -- 172.21.15.79:0/1507320330 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd0140b5f20 msgr2=0x7fd0140b83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:37.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.725+0000 7fd02f1a0640 1 --2- 172.21.15.79:0/1507320330 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd0140b5f20 0x7fd0140b83e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd01800abe0 tx=0x7fd01800a5c0 comp rx=0 tx=0).stop 2024-08-20T01:35:37.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.725+0000 7fd02f1a0640 1 -- 172.21.15.79:0/1507320330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd028107b80 msgr2=0x7fd02819d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:37.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.725+0000 7fd02f1a0640 1 --2- 172.21.15.79:0/1507320330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd028107b80 0x7fd02819d400 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd02000b970 tx=0x7fd02000be30 comp rx=0 tx=0).stop 2024-08-20T01:35:37.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.725+0000 7fd02e99f640 1 -- 172.21.15.79:0/1507320330 reap_dead start 2024-08-20T01:35:37.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.725+0000 7fd02f1a0640 1 -- 172.21.15.79:0/1507320330 shutdown_connections 2024-08-20T01:35:37.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.725+0000 7fd02f1a0640 1 -- 172.21.15.79:0/1507320330 >> 172.21.15.79:0/1507320330 conn(0x7fd0280fd2a0 msgr2=0x7fd0280ff690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:37.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.725+0000 7fd02f1a0640 1 -- 172.21.15.79:0/1507320330 shutdown_connections 2024-08-20T01:35:37.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.725+0000 7fd02f1a0640 1 -- 172.21.15.79:0/1507320330 wait complete. 2024-08-20T01:35:37.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.910+0000 7f644ca5a640 1 -- 172.21.15.79:0/2422502704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6448102ab0 msgr2=0x7f6448102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:37.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.910+0000 7f644ca5a640 1 --2- 172.21.15.79:0/2422502704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6448102ab0 0x7f6448102e90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6438009900 tx=0x7f643802a410 comp rx=0 tx=0).stop 2024-08-20T01:35:37.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.910+0000 7f644ca5a640 1 -- 172.21.15.79:0/2422502704 shutdown_connections 2024-08-20T01:35:37.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.910+0000 7f644ca5a640 1 --2- 172.21.15.79:0/2422502704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6448108e40 0x7f644810f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:37.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.910+0000 7f644ca5a640 1 --2- 172.21.15.79:0/2422502704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64481084c0 0x7f6448108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:37.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.910+0000 7f644ca5a640 1 --2- 172.21.15.79:0/2422502704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6448102ab0 0x7f6448102e90 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:37.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.910+0000 7f644ca5a640 1 -- 172.21.15.79:0/2422502704 >> 172.21.15.79:0/2422502704 conn(0x7f64480fe500 msgr2=0x7f6448100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:37.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.910+0000 7f644ca5a640 1 -- 172.21.15.79:0/2422502704 shutdown_connections 2024-08-20T01:35:37.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.910+0000 7f644ca5a640 1 -- 172.21.15.79:0/2422502704 wait complete. 2024-08-20T01:35:37.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.911+0000 7f644ca5a640 1 Processor -- start 2024-08-20T01:35:37.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.911+0000 7f644ca5a640 1 -- start start 2024-08-20T01:35:37.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.911+0000 7f644ca5a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6448102ab0 0x7f64480751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:37.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.911+0000 7f644ca5a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64481084c0 0x7f6448075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:37.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.911+0000 7f644ca5a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6448108e40 0x7f6448075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:37.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.911+0000 7f644ca5a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f64481129f0 con 0x7f64481084c0 2024-08-20T01:35:37.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.911+0000 7f644ca5a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6448112870 con 0x7f6448108e40 2024-08-20T01:35:37.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.911+0000 7f644ca5a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6448112b70 con 0x7f6448102ab0 2024-08-20T01:35:37.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.911+0000 7f643ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64481084c0 0x7f6448075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:37.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.911+0000 7f643ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64481084c0 0x7f6448075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36568/0 (socket says 172.21.15.79:36568) 2024-08-20T01:35:37.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.911+0000 7f643ffff640 1 -- 172.21.15.79:0/2667349368 learned_addr learned my addr 172.21.15.79:0/2667349368 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:35:37.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.911+0000 7f643ffff640 1 -- 172.21.15.79:0/2667349368 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6448102ab0 msgr2=0x7f64480751d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:37.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.911+0000 7f644659c640 1 --2- 172.21.15.79:0/2667349368 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6448102ab0 0x7f64480751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:37.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.911+0000 7f643ffff640 1 --2- 172.21.15.79:0/2667349368 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6448102ab0 0x7f64480751d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:37.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.911+0000 7f643ffff640 1 -- 172.21.15.79:0/2667349368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6448108e40 msgr2=0x7f6448075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:37.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.911+0000 7f643ffff640 1 --2- 172.21.15.79:0/2667349368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6448108e40 0x7f6448075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:37.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.911+0000 7f643ffff640 1 -- 172.21.15.79:0/2667349368 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64481a7440 con 0x7f64481084c0 2024-08-20T01:35:37.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.911+0000 7f644659c640 1 --2- 172.21.15.79:0/2667349368 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6448102ab0 0x7f64480751d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:35:37.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.912+0000 7f643ffff640 1 --2- 172.21.15.79:0/2667349368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64481084c0 0x7f6448075710 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f643000b4a0 tx=0x7f643000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:37.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.912+0000 7f643f7fe640 1 -- 172.21.15.79:0/2667349368 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6430014070 con 0x7f64481084c0 2024-08-20T01:35:37.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.912+0000 7f643f7fe640 1 -- 172.21.15.79:0/2667349368 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6430010aa0 con 0x7f64481084c0 2024-08-20T01:35:37.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.912+0000 7f644ca5a640 1 -- 172.21.15.79:0/2667349368 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64481a7730 con 0x7f64481084c0 2024-08-20T01:35:37.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.912+0000 7f643f7fe640 1 -- 172.21.15.79:0/2667349368 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6430017b70 con 0x7f64481084c0 2024-08-20T01:35:37.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.912+0000 7f644ca5a640 1 -- 172.21.15.79:0/2667349368 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64481a7ca0 con 0x7f64481084c0 2024-08-20T01:35:37.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.913+0000 7f644ca5a640 1 -- 172.21.15.79:0/2667349368 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6448063610 con 0x7f64481084c0 2024-08-20T01:35:37.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.914+0000 7f643f7fe640 1 -- 172.21.15.79:0/2667349368 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f6430017070 con 0x7f64481084c0 2024-08-20T01:35:37.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.915+0000 7f643f7fe640 1 --2- 172.21.15.79:0/2667349368 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f64340b3c60 0x7f64340b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:37.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.915+0000 7f644659c640 1 --2- 172.21.15.79:0/2667349368 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f64340b3c60 0x7f64340b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:37.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.915+0000 7f643f7fe640 1 -- 172.21.15.79:0/2667349368 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7f64300e3360 con 0x7f64481084c0 2024-08-20T01:35:37.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.915+0000 7f643f7fe640 1 --2- 172.21.15.79:0/2667349368 >> [v2:172.21.15.81:6824/4188407500,v1:172.21.15.81:6825/4188407500] conn(0x7f64340bd4b0 0x7f64340bf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:37.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.915+0000 7f643f7fe640 1 -- 172.21.15.79:0/2667349368 --> [v2:172.21.15.81:6824/4188407500,v1:172.21.15.81:6825/4188407500] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f64340bff80 con 0x7f64340bd4b0 2024-08-20T01:35:37.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.915+0000 7f643f7fe640 1 -- 172.21.15.79:0/2667349368 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7f64300e3840 con 0x7f64481084c0 2024-08-20T01:35:37.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.915+0000 7f644659c640 1 --2- 172.21.15.79:0/2667349368 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f64340b3c60 0x7f64340b6120 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6438000c00 tx=0x7f6438032d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:37.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.916+0000 7f6446d9d640 1 --2- 172.21.15.79:0/2667349368 >> [v2:172.21.15.81:6824/4188407500,v1:172.21.15.81:6825/4188407500] conn(0x7f64340bd4b0 0x7f64340bf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:37.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.916+0000 7f6446d9d640 1 --2- 172.21.15.79:0/2667349368 >> [v2:172.21.15.81:6824/4188407500,v1:172.21.15.81:6825/4188407500] conn(0x7f64340bd4b0 0x7f64340bf8d0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:37.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.917+0000 7f643f7fe640 1 -- 172.21.15.79:0/2667349368 <== osd.10 v2:172.21.15.81:6824/4188407500 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f64340bff80 con 0x7f64340bd4b0 2024-08-20T01:35:37.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.930+0000 7f644ca5a640 1 -- 172.21.15.79:0/2667349368 --> [v2:172.21.15.81:6824/4188407500,v1:172.21.15.81:6825/4188407500] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6448063a90 con 0x7f64340bd4b0 2024-08-20T01:35:37.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.931+0000 7f643f7fe640 1 -- 172.21.15.79:0/2667349368 <== osd.10 v2:172.21.15.81:6824/4188407500 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6448063a90 con 0x7f64340bd4b0 2024-08-20T01:35:37.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.931+0000 7f644ca5a640 1 -- 172.21.15.79:0/2667349368 >> [v2:172.21.15.81:6824/4188407500,v1:172.21.15.81:6825/4188407500] conn(0x7f64340bd4b0 msgr2=0x7f64340bf8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:37.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.931+0000 7f644ca5a640 1 --2- 172.21.15.79:0/2667349368 >> [v2:172.21.15.81:6824/4188407500,v1:172.21.15.81:6825/4188407500] conn(0x7f64340bd4b0 0x7f64340bf8d0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:37.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.931+0000 7f644ca5a640 1 -- 172.21.15.79:0/2667349368 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f64340b3c60 msgr2=0x7f64340b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:37.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.931+0000 7f644ca5a640 1 --2- 172.21.15.79:0/2667349368 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f64340b3c60 0x7f64340b6120 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6438000c00 tx=0x7f6438032d20 comp rx=0 tx=0).stop 2024-08-20T01:35:37.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.931+0000 7f644ca5a640 1 -- 172.21.15.79:0/2667349368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64481084c0 msgr2=0x7f6448075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:37.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.931+0000 7f644ca5a640 1 --2- 172.21.15.79:0/2667349368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64481084c0 0x7f6448075710 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f643000b4a0 tx=0x7f643000b960 comp rx=0 tx=0).stop 2024-08-20T01:35:37.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.931+0000 7f6446d9d640 1 -- 172.21.15.79:0/2667349368 reap_dead start 2024-08-20T01:35:37.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.931+0000 7f644ca5a640 1 -- 172.21.15.79:0/2667349368 shutdown_connections 2024-08-20T01:35:37.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.931+0000 7f644ca5a640 1 -- 172.21.15.79:0/2667349368 >> 172.21.15.79:0/2667349368 conn(0x7f64480fe500 msgr2=0x7f64481008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:37.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.931+0000 7f644ca5a640 1 -- 172.21.15.79:0/2667349368 shutdown_connections 2024-08-20T01:35:37.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:37.931+0000 7f644ca5a640 1 -- 172.21.15.79:0/2667349368 wait complete. 2024-08-20T01:35:38.080 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:37 smithi081 ceph-mon[22209]: pgmap v294: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-08-20T01:35:38.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:37 smithi175 ceph-mon[22392]: pgmap v294: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-08-20T01:35:38.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:37 smithi079 ceph-mon[18656]: pgmap v294: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-08-20T01:35:38.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.323+0000 7f53d0554640 1 -- 172.21.15.79:0/914598279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53c8107d60 msgr2=0x7f53c810e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:38.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.323+0000 7f53d0554640 1 --2- 172.21.15.79:0/914598279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53c8107d60 0x7f53c810e560 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f53c0009ca0 tx=0x7f53c002a8c0 comp rx=0 tx=0).stop 2024-08-20T01:35:38.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.323+0000 7f53d0554640 1 -- 172.21.15.79:0/914598279 shutdown_connections 2024-08-20T01:35:38.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.323+0000 7f53d0554640 1 --2- 172.21.15.79:0/914598279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53c8107d60 0x7f53c810e560 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:38.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.323+0000 7f53d0554640 1 --2- 172.21.15.79:0/914598279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53c81073e0 0x7f53c8107820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:38.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.323+0000 7f53d0554640 1 --2- 172.21.15.79:0/914598279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53c81019d0 0x7f53c8101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:38.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.323+0000 7f53d0554640 1 -- 172.21.15.79:0/914598279 >> 172.21.15.79:0/914598279 conn(0x7f53c80fd440 msgr2=0x7f53c80ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:38.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.323+0000 7f53d0554640 1 -- 172.21.15.79:0/914598279 shutdown_connections 2024-08-20T01:35:38.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.323+0000 7f53d0554640 1 -- 172.21.15.79:0/914598279 wait complete. 2024-08-20T01:35:38.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.323+0000 7f53d0554640 1 Processor -- start 2024-08-20T01:35:38.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.324+0000 7f53d0554640 1 -- start start 2024-08-20T01:35:38.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.324+0000 7f53d0554640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53c81019d0 0x7f53c8197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:38.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.324+0000 7f53d0554640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53c81073e0 0x7f53c81982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:38.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.324+0000 7f53d0554640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53c8107d60 0x7f53c819d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:38.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.324+0000 7f53d0554640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f53c8111920 con 0x7f53c81073e0 2024-08-20T01:35:38.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.324+0000 7f53d0554640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f53c81117a0 con 0x7f53c8107d60 2024-08-20T01:35:38.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.324+0000 7f53d0554640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f53c8111aa0 con 0x7f53c81019d0 2024-08-20T01:35:38.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.324+0000 7f53cdaef640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53c81073e0 0x7f53c81982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:38.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.324+0000 7f53cdaef640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53c81073e0 0x7f53c81982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36516/0 (socket says 172.21.15.79:36516) 2024-08-20T01:35:38.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.324+0000 7f53cdaef640 1 -- 172.21.15.79:0/2961852206 learned_addr learned my addr 172.21.15.79:0/2961852206 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:35:38.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.324+0000 7f53ce2f0640 1 --2- 172.21.15.79:0/2961852206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53c81019d0 0x7f53c8197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:38.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.324+0000 7f53ceaf1640 1 --2- 172.21.15.79:0/2961852206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53c8107d60 0x7f53c819d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:38.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.324+0000 7f53cdaef640 1 -- 172.21.15.79:0/2961852206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53c81019d0 msgr2=0x7f53c8197db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:38.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.324+0000 7f53cdaef640 1 --2- 172.21.15.79:0/2961852206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53c81019d0 0x7f53c8197db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:38.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.324+0000 7f53cdaef640 1 -- 172.21.15.79:0/2961852206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53c8107d60 msgr2=0x7f53c819d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:38.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.324+0000 7f53cdaef640 1 --2- 172.21.15.79:0/2961852206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53c8107d60 0x7f53c819d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:38.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.324+0000 7f53cdaef640 1 -- 172.21.15.79:0/2961852206 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c819de60 con 0x7f53c81073e0 2024-08-20T01:35:38.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.324+0000 7f53ce2f0640 1 --2- 172.21.15.79:0/2961852206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53c81019d0 0x7f53c8197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:35:38.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.324+0000 7f53ceaf1640 1 --2- 172.21.15.79:0/2961852206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53c8107d60 0x7f53c819d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:35:38.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.324+0000 7f53cdaef640 1 --2- 172.21.15.79:0/2961852206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53c81073e0 0x7f53c81982f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f53bc00d950 tx=0x7f53bc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:38.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.325+0000 7f53bb7fe640 1 -- 172.21.15.79:0/2961852206 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc017070 con 0x7f53c81073e0 2024-08-20T01:35:38.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.325+0000 7f53d0554640 1 -- 172.21.15.79:0/2961852206 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53c819e150 con 0x7f53c81073e0 2024-08-20T01:35:38.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.325+0000 7f53bb7fe640 1 -- 172.21.15.79:0/2961852206 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f53bc009c30 con 0x7f53c81073e0 2024-08-20T01:35:38.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.325+0000 7f53bb7fe640 1 -- 172.21.15.79:0/2961852206 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc00f620 con 0x7f53c81073e0 2024-08-20T01:35:38.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.325+0000 7f53d0554640 1 -- 172.21.15.79:0/2961852206 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53c81a4810 con 0x7f53c81073e0 2024-08-20T01:35:38.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.326+0000 7f53d0554640 1 -- 172.21.15.79:0/2961852206 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f53c8063610 con 0x7f53c81073e0 2024-08-20T01:35:38.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.327+0000 7f53bb7fe640 1 -- 172.21.15.79:0/2961852206 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f53bc010460 con 0x7f53c81073e0 2024-08-20T01:35:38.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.328+0000 7f53bb7fe640 1 --2- 172.21.15.79:0/2961852206 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f53b40b3c60 0x7f53b40b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:38.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.328+0000 7f53ce2f0640 1 --2- 172.21.15.79:0/2961852206 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f53b40b3c60 0x7f53b40b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:38.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.328+0000 7f53bb7fe640 1 -- 172.21.15.79:0/2961852206 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7f53bc0e3d00 con 0x7f53c81073e0 2024-08-20T01:35:38.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.328+0000 7f53bb7fe640 1 --2- 172.21.15.79:0/2961852206 >> [v2:172.21.15.79:6802/1274927648,v1:172.21.15.79:6803/1274927648] conn(0x7f53b40bd4b0 0x7f53b40bf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:38.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.328+0000 7f53bb7fe640 1 -- 172.21.15.79:0/2961852206 --> [v2:172.21.15.79:6802/1274927648,v1:172.21.15.79:6803/1274927648] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f53bc016ec0 con 0x7f53b40bd4b0 2024-08-20T01:35:38.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.328+0000 7f53bb7fe640 1 -- 172.21.15.79:0/2961852206 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7f53bc0e41e0 con 0x7f53c81073e0 2024-08-20T01:35:38.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.328+0000 7f53ceaf1640 1 --2- 172.21.15.79:0/2961852206 >> [v2:172.21.15.79:6802/1274927648,v1:172.21.15.79:6803/1274927648] conn(0x7f53b40bd4b0 0x7f53b40bf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:38.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.328+0000 7f53ce2f0640 1 --2- 172.21.15.79:0/2961852206 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f53b40b3c60 0x7f53b40b6120 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f53c4009930 tx=0x7f53c4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:38.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.329+0000 7f53ceaf1640 1 --2- 172.21.15.79:0/2961852206 >> [v2:172.21.15.79:6802/1274927648,v1:172.21.15.79:6803/1274927648] conn(0x7f53b40bd4b0 0x7f53b40bf8d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:38.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.330+0000 7f53bb7fe640 1 -- 172.21.15.79:0/2961852206 <== osd.0 v2:172.21.15.79:6802/1274927648 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f53bc016ec0 con 0x7f53b40bd4b0 2024-08-20T01:35:38.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.343+0000 7f53d0554640 1 -- 172.21.15.79:0/2961852206 --> [v2:172.21.15.79:6802/1274927648,v1:172.21.15.79:6803/1274927648] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f53c8063a10 con 0x7f53b40bd4b0 2024-08-20T01:35:38.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.344+0000 7f53bb7fe640 1 -- 172.21.15.79:0/2961852206 <== osd.0 v2:172.21.15.79:6802/1274927648 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f53c8063a10 con 0x7f53b40bd4b0 2024-08-20T01:35:38.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.344+0000 7f53d0554640 1 -- 172.21.15.79:0/2961852206 >> [v2:172.21.15.79:6802/1274927648,v1:172.21.15.79:6803/1274927648] conn(0x7f53b40bd4b0 msgr2=0x7f53b40bf8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:38.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.344+0000 7f53d0554640 1 --2- 172.21.15.79:0/2961852206 >> [v2:172.21.15.79:6802/1274927648,v1:172.21.15.79:6803/1274927648] conn(0x7f53b40bd4b0 0x7f53b40bf8d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:38.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.344+0000 7f53d0554640 1 -- 172.21.15.79:0/2961852206 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f53b40b3c60 msgr2=0x7f53b40b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:38.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.344+0000 7f53d0554640 1 --2- 172.21.15.79:0/2961852206 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f53b40b3c60 0x7f53b40b6120 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f53c4009930 tx=0x7f53c4008040 comp rx=0 tx=0).stop 2024-08-20T01:35:38.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.344+0000 7f53d0554640 1 -- 172.21.15.79:0/2961852206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53c81073e0 msgr2=0x7f53c81982f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:38.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.344+0000 7f53d0554640 1 --2- 172.21.15.79:0/2961852206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53c81073e0 0x7f53c81982f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f53bc00d950 tx=0x7f53bc00de10 comp rx=0 tx=0).stop 2024-08-20T01:35:38.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.344+0000 7f53ceaf1640 1 -- 172.21.15.79:0/2961852206 reap_dead start 2024-08-20T01:35:38.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.344+0000 7f53d0554640 1 -- 172.21.15.79:0/2961852206 shutdown_connections 2024-08-20T01:35:38.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.344+0000 7f53d0554640 1 -- 172.21.15.79:0/2961852206 >> 172.21.15.79:0/2961852206 conn(0x7f53c80fd440 msgr2=0x7f53c80ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:38.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.344+0000 7f53d0554640 1 -- 172.21.15.79:0/2961852206 shutdown_connections 2024-08-20T01:35:38.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:36.344+0000 7f53d0554640 1 -- 172.21.15.79:0/2961852206 wait complete. 2024-08-20T01:35:38.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.828+0000 7fae20bb6640 1 -- 172.21.15.79:0/3382684474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae1c101f00 msgr2=0x7fae1c10c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:38.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.828+0000 7fae20bb6640 1 --2- 172.21.15.79:0/3382684474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae1c101f00 0x7fae1c10c6b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fae10009900 tx=0x7fae1002a410 comp rx=0 tx=0).stop 2024-08-20T01:35:38.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.828+0000 7fae20bb6640 1 -- 172.21.15.79:0/3382684474 shutdown_connections 2024-08-20T01:35:38.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.828+0000 7fae20bb6640 1 --2- 172.21.15.79:0/3382684474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae1c10cdc0 0x7fae1c10f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:38.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.828+0000 7fae20bb6640 1 --2- 172.21.15.79:0/3382684474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae1c101f00 0x7fae1c10c6b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:38.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.828+0000 7fae20bb6640 1 --2- 172.21.15.79:0/3382684474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae1c101500 0x7fae1c1018e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:38.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.828+0000 7fae20bb6640 1 -- 172.21.15.79:0/3382684474 >> 172.21.15.79:0/3382684474 conn(0x7fae1c076bd0 msgr2=0x7fae1c076fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:38.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.828+0000 7fae20bb6640 1 -- 172.21.15.79:0/3382684474 shutdown_connections 2024-08-20T01:35:38.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.828+0000 7fae20bb6640 1 -- 172.21.15.79:0/3382684474 wait complete. 2024-08-20T01:35:38.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.829+0000 7fae20bb6640 1 Processor -- start 2024-08-20T01:35:38.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.829+0000 7fae20bb6640 1 -- start start 2024-08-20T01:35:38.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.829+0000 7fae20bb6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae1c101500 0x7fae1c198ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:38.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.829+0000 7fae20bb6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae1c101f00 0x7fae1c199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:38.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.829+0000 7fae20bb6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae1c10cdc0 0x7fae1c19e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:38.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.829+0000 7fae20bb6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fae1c112920 con 0x7fae1c10cdc0 2024-08-20T01:35:38.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.829+0000 7fae20bb6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fae1c1127a0 con 0x7fae1c101f00 2024-08-20T01:35:38.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.829+0000 7fae20bb6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fae1c112aa0 con 0x7fae1c101500 2024-08-20T01:35:38.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.829+0000 7fae1ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae1c10cdc0 0x7fae1c19e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:38.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.829+0000 7fae1ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae1c10cdc0 0x7fae1c19e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36592/0 (socket says 172.21.15.79:36592) 2024-08-20T01:35:38.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.829+0000 7fae1ad9d640 1 -- 172.21.15.79:0/3899967577 learned_addr learned my addr 172.21.15.79:0/3899967577 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:35:38.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.829+0000 7fae19d9b640 1 --2- 172.21.15.79:0/3899967577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae1c101f00 0x7fae1c199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:38.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.829+0000 7fae1a59c640 1 --2- 172.21.15.79:0/3899967577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae1c101500 0x7fae1c198ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:38.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.829+0000 7fae1ad9d640 1 -- 172.21.15.79:0/3899967577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae1c101500 msgr2=0x7fae1c198ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:38.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.829+0000 7fae1ad9d640 1 --2- 172.21.15.79:0/3899967577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae1c101500 0x7fae1c198ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:38.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.829+0000 7fae1ad9d640 1 -- 172.21.15.79:0/3899967577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae1c101f00 msgr2=0x7fae1c199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:38.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.829+0000 7fae1ad9d640 1 --2- 172.21.15.79:0/3899967577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae1c101f00 0x7fae1c199430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:38.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.829+0000 7fae1ad9d640 1 -- 172.21.15.79:0/3899967577 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae1c19efa0 con 0x7fae1c10cdc0 2024-08-20T01:35:38.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.829+0000 7fae1ad9d640 1 --2- 172.21.15.79:0/3899967577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae1c10cdc0 0x7fae1c19e7d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fae14009fd0 tx=0x7fae1400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:38.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.829+0000 7fae0b7fe640 1 -- 172.21.15.79:0/3899967577 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae14017070 con 0x7fae1c10cdc0 2024-08-20T01:35:38.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.830+0000 7fae0b7fe640 1 -- 172.21.15.79:0/3899967577 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fae14003e00 con 0x7fae1c10cdc0 2024-08-20T01:35:38.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.830+0000 7fae20bb6640 1 -- 172.21.15.79:0/3899967577 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae1c19f290 con 0x7fae1c10cdc0 2024-08-20T01:35:38.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.830+0000 7fae0b7fe640 1 -- 172.21.15.79:0/3899967577 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae14010460 con 0x7fae1c10cdc0 2024-08-20T01:35:38.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.830+0000 7fae20bb6640 1 -- 172.21.15.79:0/3899967577 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae1c1a5950 con 0x7fae1c10cdc0 2024-08-20T01:35:38.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.831+0000 7fae20bb6640 1 -- 172.21.15.79:0/3899967577 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fae1c063610 con 0x7fae1c10cdc0 2024-08-20T01:35:38.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.832+0000 7fae0b7fe640 1 -- 172.21.15.79:0/3899967577 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fae14003970 con 0x7fae1c10cdc0 2024-08-20T01:35:38.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.833+0000 7fae0b7fe640 1 --2- 172.21.15.79:0/3899967577 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fae040b3c60 0x7fae040b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:38.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.833+0000 7fae1a59c640 1 --2- 172.21.15.79:0/3899967577 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fae040b3c60 0x7fae040b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:38.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.833+0000 7fae0b7fe640 1 -- 172.21.15.79:0/3899967577 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7fae140e3cc0 con 0x7fae1c10cdc0 2024-08-20T01:35:38.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.833+0000 7fae0b7fe640 1 --2- 172.21.15.79:0/3899967577 >> [v2:172.21.15.79:6818/3379368280,v1:172.21.15.79:6819/3379368280] conn(0x7fae040bd4b0 0x7fae040bf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:38.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.833+0000 7fae0b7fe640 1 -- 172.21.15.79:0/3899967577 --> [v2:172.21.15.79:6818/3379368280,v1:172.21.15.79:6819/3379368280] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fae040bff80 con 0x7fae040bd4b0 2024-08-20T01:35:38.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.833+0000 7fae0b7fe640 1 -- 172.21.15.79:0/3899967577 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7fae140e41a0 con 0x7fae1c10cdc0 2024-08-20T01:35:38.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.833+0000 7fae19d9b640 1 --2- 172.21.15.79:0/3899967577 >> [v2:172.21.15.79:6818/3379368280,v1:172.21.15.79:6819/3379368280] conn(0x7fae040bd4b0 0x7fae040bf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:38.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.833+0000 7fae1a59c640 1 --2- 172.21.15.79:0/3899967577 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fae040b3c60 0x7fae040b6120 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fae0c009bd0 tx=0x7fae0c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:38.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.833+0000 7fae19d9b640 1 --2- 172.21.15.79:0/3899967577 >> [v2:172.21.15.79:6818/3379368280,v1:172.21.15.79:6819/3379368280] conn(0x7fae040bd4b0 0x7fae040bf8d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:38.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.834+0000 7fae0b7fe640 1 -- 172.21.15.79:0/3899967577 <== osd.6 v2:172.21.15.79:6818/3379368280 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fae040bff80 con 0x7fae040bd4b0 2024-08-20T01:35:38.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.847+0000 7fae20bb6640 1 -- 172.21.15.79:0/3899967577 --> [v2:172.21.15.79:6818/3379368280,v1:172.21.15.79:6819/3379368280] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fae1c063a90 con 0x7fae040bd4b0 2024-08-20T01:35:38.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.848+0000 7fae0b7fe640 1 -- 172.21.15.79:0/3899967577 <== osd.6 v2:172.21.15.79:6818/3379368280 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fae1c063a90 con 0x7fae040bd4b0 2024-08-20T01:35:38.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.848+0000 7fae20bb6640 1 -- 172.21.15.79:0/3899967577 >> [v2:172.21.15.79:6818/3379368280,v1:172.21.15.79:6819/3379368280] conn(0x7fae040bd4b0 msgr2=0x7fae040bf8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:38.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.848+0000 7fae20bb6640 1 --2- 172.21.15.79:0/3899967577 >> [v2:172.21.15.79:6818/3379368280,v1:172.21.15.79:6819/3379368280] conn(0x7fae040bd4b0 0x7fae040bf8d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:38.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.848+0000 7fae20bb6640 1 -- 172.21.15.79:0/3899967577 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fae040b3c60 msgr2=0x7fae040b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:38.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.848+0000 7fae20bb6640 1 --2- 172.21.15.79:0/3899967577 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fae040b3c60 0x7fae040b6120 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fae0c009bd0 tx=0x7fae0c005f90 comp rx=0 tx=0).stop 2024-08-20T01:35:38.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.848+0000 7fae20bb6640 1 -- 172.21.15.79:0/3899967577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae1c10cdc0 msgr2=0x7fae1c19e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:38.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.848+0000 7fae20bb6640 1 --2- 172.21.15.79:0/3899967577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae1c10cdc0 0x7fae1c19e7d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fae14009fd0 tx=0x7fae1400b260 comp rx=0 tx=0).stop 2024-08-20T01:35:38.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.848+0000 7fae1ad9d640 1 -- 172.21.15.79:0/3899967577 reap_dead start 2024-08-20T01:35:38.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.848+0000 7fae20bb6640 1 -- 172.21.15.79:0/3899967577 shutdown_connections 2024-08-20T01:35:38.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.848+0000 7fae20bb6640 1 -- 172.21.15.79:0/3899967577 >> 172.21.15.79:0/3899967577 conn(0x7fae1c076bd0 msgr2=0x7fae1c0ff870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:38.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.848+0000 7fae20bb6640 1 -- 172.21.15.79:0/3899967577 shutdown_connections 2024-08-20T01:35:38.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:38.848+0000 7fae20bb6640 1 -- 172.21.15.79:0/3899967577 wait complete. 2024-08-20T01:35:39.612 INFO:teuthology.orchestra.run.smithi079.stdout:167503724591 2024-08-20T01:35:39.613 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-08-20T01:35:39.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.895+0000 7f5180c8e640 1 -- 172.21.15.79:0/2134747068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f517c1084a0 msgr2=0x7f517c1088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:39.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.895+0000 7f5180c8e640 1 --2- 172.21.15.79:0/2134747068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f517c1084a0 0x7f517c1088e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5164009900 tx=0x7f516402a410 comp rx=0 tx=0).stop 2024-08-20T01:35:39.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.895+0000 7f5180c8e640 1 -- 172.21.15.79:0/2134747068 shutdown_connections 2024-08-20T01:35:39.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.895+0000 7f5180c8e640 1 --2- 172.21.15.79:0/2134747068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f517c108e20 0x7f517c10f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:39.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.895+0000 7f5180c8e640 1 --2- 172.21.15.79:0/2134747068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f517c1084a0 0x7f517c1088e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:39.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.895+0000 7f5180c8e640 1 --2- 172.21.15.79:0/2134747068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f517c102a90 0x7f517c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:39.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.895+0000 7f5180c8e640 1 -- 172.21.15.79:0/2134747068 >> 172.21.15.79:0/2134747068 conn(0x7f517c0fe540 msgr2=0x7f517c100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:39.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.895+0000 7f5180c8e640 1 -- 172.21.15.79:0/2134747068 shutdown_connections 2024-08-20T01:35:39.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.895+0000 7f5180c8e640 1 -- 172.21.15.79:0/2134747068 wait complete. 2024-08-20T01:35:39.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.895+0000 7f5180c8e640 1 Processor -- start 2024-08-20T01:35:39.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.895+0000 7f5180c8e640 1 -- start start 2024-08-20T01:35:39.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.896+0000 7f5180c8e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f517c102a90 0x7f517c0751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:39.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.896+0000 7f5180c8e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f517c1084a0 0x7f517c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:39.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.896+0000 7f5180c8e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f517c108e20 0x7f517c075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:39.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.896+0000 7f5180c8e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f517c112990 con 0x7f517c108e20 2024-08-20T01:35:39.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.896+0000 7f5180c8e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f517c112810 con 0x7f517c1084a0 2024-08-20T01:35:39.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.896+0000 7f5180c8e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f517c112b10 con 0x7f517c102a90 2024-08-20T01:35:39.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.896+0000 7f517ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f517c108e20 0x7f517c075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:39.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.896+0000 7f517ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f517c108e20 0x7f517c075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36620/0 (socket says 172.21.15.79:36620) 2024-08-20T01:35:39.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.896+0000 7f517ad9d640 1 -- 172.21.15.79:0/3885622479 learned_addr learned my addr 172.21.15.79:0/3885622479 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:35:39.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.896+0000 7f5179d9b640 1 --2- 172.21.15.79:0/3885622479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f517c1084a0 0x7f517c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:39.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.896+0000 7f517a59c640 1 --2- 172.21.15.79:0/3885622479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f517c102a90 0x7f517c0751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:39.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.896+0000 7f517ad9d640 1 -- 172.21.15.79:0/3885622479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f517c102a90 msgr2=0x7f517c0751d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:39.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.896+0000 7f517ad9d640 1 --2- 172.21.15.79:0/3885622479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f517c102a90 0x7f517c0751d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:39.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.896+0000 7f517ad9d640 1 -- 172.21.15.79:0/3885622479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f517c1084a0 msgr2=0x7f517c075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:39.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.896+0000 7f517ad9d640 1 --2- 172.21.15.79:0/3885622479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f517c1084a0 0x7f517c075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:39.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.896+0000 7f517ad9d640 1 -- 172.21.15.79:0/3885622479 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f517c1a7240 con 0x7f517c108e20 2024-08-20T01:35:39.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.896+0000 7f517ad9d640 1 --2- 172.21.15.79:0/3885622479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f517c108e20 0x7f517c075c50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f516c00c970 tx=0x7f516c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:39.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.896+0000 7f51737fe640 1 -- 172.21.15.79:0/3885622479 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f516c007bb0 con 0x7f517c108e20 2024-08-20T01:35:39.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.896+0000 7f5180c8e640 1 -- 172.21.15.79:0/3885622479 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f517c1a7530 con 0x7f517c108e20 2024-08-20T01:35:39.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.896+0000 7f51737fe640 1 -- 172.21.15.79:0/3885622479 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f516c007d50 con 0x7f517c108e20 2024-08-20T01:35:39.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.896+0000 7f51737fe640 1 -- 172.21.15.79:0/3885622479 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f516c018660 con 0x7f517c108e20 2024-08-20T01:35:39.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.897+0000 7f5180c8e640 1 -- 172.21.15.79:0/3885622479 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f517c1a79f0 con 0x7f517c108e20 2024-08-20T01:35:39.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.897+0000 7f5180c8e640 1 -- 172.21.15.79:0/3885622479 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f517c063610 con 0x7f517c108e20 2024-08-20T01:35:39.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.899+0000 7f51737fe640 1 -- 172.21.15.79:0/3885622479 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f516c00f970 con 0x7f517c108e20 2024-08-20T01:35:39.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.899+0000 7f51737fe640 1 --2- 172.21.15.79:0/3885622479 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f51680b3c60 0x7f51680b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:39.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.900+0000 7f517a59c640 1 --2- 172.21.15.79:0/3885622479 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f51680b3c60 0x7f51680b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:39.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.900+0000 7f51737fe640 1 -- 172.21.15.79:0/3885622479 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7f516c0e4130 con 0x7f517c108e20 2024-08-20T01:35:39.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.900+0000 7f51737fe640 1 --2- 172.21.15.79:0/3885622479 >> [v2:172.21.15.81:6816/747356685,v1:172.21.15.81:6817/747356685] conn(0x7f51680bd4b0 0x7f51680bf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:39.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.900+0000 7f51737fe640 1 -- 172.21.15.79:0/3885622479 --> [v2:172.21.15.81:6816/747356685,v1:172.21.15.81:6817/747356685] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f516c00eec0 con 0x7f51680bd4b0 2024-08-20T01:35:39.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.900+0000 7f51737fe640 1 -- 172.21.15.79:0/3885622479 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7f516c0e44e0 con 0x7f517c108e20 2024-08-20T01:35:39.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.900+0000 7f517a59c640 1 --2- 172.21.15.79:0/3885622479 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f51680b3c60 0x7f51680b6120 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5174005c40 tx=0x7f517400a390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:39.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.900+0000 7f5179d9b640 1 --2- 172.21.15.79:0/3885622479 >> [v2:172.21.15.81:6816/747356685,v1:172.21.15.81:6817/747356685] conn(0x7f51680bd4b0 0x7f51680bf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:39.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.901+0000 7f5179d9b640 1 --2- 172.21.15.79:0/3885622479 >> [v2:172.21.15.81:6816/747356685,v1:172.21.15.81:6817/747356685] conn(0x7f51680bd4b0 0x7f51680bf8d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:39.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.901+0000 7f51737fe640 1 -- 172.21.15.79:0/3885622479 <== osd.7 v2:172.21.15.81:6816/747356685 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f516c00eec0 con 0x7f51680bd4b0 2024-08-20T01:35:39.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.915+0000 7f5180c8e640 1 -- 172.21.15.79:0/3885622479 --> [v2:172.21.15.81:6816/747356685,v1:172.21.15.81:6817/747356685] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f517c063a90 con 0x7f51680bd4b0 2024-08-20T01:35:39.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.916+0000 7f51737fe640 1 -- 172.21.15.79:0/3885622479 <== osd.7 v2:172.21.15.81:6816/747356685 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f517c063a90 con 0x7f51680bd4b0 2024-08-20T01:35:39.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.916+0000 7f5180c8e640 1 -- 172.21.15.79:0/3885622479 >> [v2:172.21.15.81:6816/747356685,v1:172.21.15.81:6817/747356685] conn(0x7f51680bd4b0 msgr2=0x7f51680bf8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:39.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.916+0000 7f5180c8e640 1 --2- 172.21.15.79:0/3885622479 >> [v2:172.21.15.81:6816/747356685,v1:172.21.15.81:6817/747356685] conn(0x7f51680bd4b0 0x7f51680bf8d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:39.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.916+0000 7f5180c8e640 1 -- 172.21.15.79:0/3885622479 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f51680b3c60 msgr2=0x7f51680b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:39.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.916+0000 7f5180c8e640 1 --2- 172.21.15.79:0/3885622479 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f51680b3c60 0x7f51680b6120 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5174005c40 tx=0x7f517400a390 comp rx=0 tx=0).stop 2024-08-20T01:35:39.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.916+0000 7f5180c8e640 1 -- 172.21.15.79:0/3885622479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f517c108e20 msgr2=0x7f517c075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:39.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.916+0000 7f5180c8e640 1 --2- 172.21.15.79:0/3885622479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f517c108e20 0x7f517c075c50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f516c00c970 tx=0x7f516c00ce30 comp rx=0 tx=0).stop 2024-08-20T01:35:39.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.916+0000 7f517ad9d640 1 -- 172.21.15.79:0/3885622479 reap_dead start 2024-08-20T01:35:39.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.917+0000 7f5180c8e640 1 -- 172.21.15.79:0/3885622479 shutdown_connections 2024-08-20T01:35:39.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.917+0000 7f5180c8e640 1 -- 172.21.15.79:0/3885622479 >> 172.21.15.79:0/3885622479 conn(0x7f517c0fe540 msgr2=0x7f517c100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:39.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.917+0000 7f5180c8e640 1 -- 172.21.15.79:0/3885622479 shutdown_connections 2024-08-20T01:35:39.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:39.917+0000 7f5180c8e640 1 -- 172.21.15.79:0/3885622479 wait complete. 2024-08-20T01:35:40.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:39 smithi175 ceph-mon[22392]: pgmap v295: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-08-20T01:35:40.167 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:39 smithi079 ceph-mon[18656]: pgmap v295: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-08-20T01:35:40.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:39 smithi081 ceph-mon[22209]: pgmap v295: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-08-20T01:35:41.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.142+0000 7f37901bc640 1 -- 172.21.15.79:0/3650637024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3788106c10 msgr2=0x7f3788107060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:41.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.142+0000 7f37901bc640 1 --2- 172.21.15.79:0/3650637024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3788106c10 0x7f3788107060 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3780009ca0 tx=0x7f378002a8c0 comp rx=0 tx=0).stop 2024-08-20T01:35:41.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.142+0000 7f37901bc640 1 -- 172.21.15.79:0/3650637024 shutdown_connections 2024-08-20T01:35:41.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.142+0000 7f37901bc640 1 --2- 172.21.15.79:0/3650637024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3788106c10 0x7f3788107060 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:41.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.142+0000 7f37901bc640 1 --2- 172.21.15.79:0/3650637024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37881020f0 0x7f37881065c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:41.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.142+0000 7f37901bc640 1 --2- 172.21.15.79:0/3650637024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37881017d0 0x7f3788101bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:41.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.142+0000 7f37901bc640 1 -- 172.21.15.79:0/3650637024 >> 172.21.15.79:0/3650637024 conn(0x7f37880fd440 msgr2=0x7f37880ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:41.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.142+0000 7f37901bc640 1 -- 172.21.15.79:0/3650637024 shutdown_connections 2024-08-20T01:35:41.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.142+0000 7f37901bc640 1 -- 172.21.15.79:0/3650637024 wait complete. 2024-08-20T01:35:41.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.142+0000 7f37901bc640 1 Processor -- start 2024-08-20T01:35:41.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.143+0000 7f37901bc640 1 -- start start 2024-08-20T01:35:41.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.143+0000 7f37901bc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37881017d0 0x7f378819f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:41.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.143+0000 7f37901bc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37881020f0 0x7f378819fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:41.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.143+0000 7f37901bc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3788106c10 0x7f37881a4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:41.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.143+0000 7f37901bc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3788119030 con 0x7f37881017d0 2024-08-20T01:35:41.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.143+0000 7f37901bc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3788118eb0 con 0x7f37881020f0 2024-08-20T01:35:41.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.143+0000 7f37901bc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f37881191b0 con 0x7f3788106c10 2024-08-20T01:35:41.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.143+0000 7f378df58640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37881017d0 0x7f378819f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:41.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.143+0000 7f378df58640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37881017d0 0x7f378819f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42508/0 (socket says 172.21.15.79:42508) 2024-08-20T01:35:41.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.143+0000 7f378df58640 1 -- 172.21.15.79:0/3108267831 learned_addr learned my addr 172.21.15.79:0/3108267831 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:35:41.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.143+0000 7f378e759640 1 --2- 172.21.15.79:0/3108267831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3788106c10 0x7f37881a4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:41.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.143+0000 7f378d757640 1 --2- 172.21.15.79:0/3108267831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37881020f0 0x7f378819fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:41.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.143+0000 7f378df58640 1 -- 172.21.15.79:0/3108267831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3788106c10 msgr2=0x7f37881a4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:41.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.143+0000 7f378df58640 1 --2- 172.21.15.79:0/3108267831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3788106c10 0x7f37881a4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:41.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.143+0000 7f378df58640 1 -- 172.21.15.79:0/3108267831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37881020f0 msgr2=0x7f378819fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:41.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.143+0000 7f378df58640 1 --2- 172.21.15.79:0/3108267831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37881020f0 0x7f378819fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:41.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.143+0000 7f378df58640 1 -- 172.21.15.79:0/3108267831 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37881a55d0 con 0x7f37881017d0 2024-08-20T01:35:41.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.143+0000 7f378df58640 1 --2- 172.21.15.79:0/3108267831 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37881017d0 0x7f378819f520 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f378400d770 tx=0x7f378400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:41.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.144+0000 7f377effd640 1 -- 172.21.15.79:0/3108267831 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3784017070 con 0x7f37881017d0 2024-08-20T01:35:41.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.144+0000 7f377effd640 1 -- 172.21.15.79:0/3108267831 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f37840054b0 con 0x7f37881017d0 2024-08-20T01:35:41.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.144+0000 7f37901bc640 1 -- 172.21.15.79:0/3108267831 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37881a58c0 con 0x7f37881017d0 2024-08-20T01:35:41.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.144+0000 7f377effd640 1 -- 172.21.15.79:0/3108267831 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3784004c60 con 0x7f37881017d0 2024-08-20T01:35:41.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.144+0000 7f37901bc640 1 -- 172.21.15.79:0/3108267831 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37881abf80 con 0x7f37881017d0 2024-08-20T01:35:41.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.144+0000 7f37901bc640 1 -- 172.21.15.79:0/3108267831 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3788105fb0 con 0x7f37881017d0 2024-08-20T01:35:41.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.147+0000 7f377effd640 1 -- 172.21.15.79:0/3108267831 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f3784004e00 con 0x7f37881017d0 2024-08-20T01:35:41.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.148+0000 7f377effd640 1 --2- 172.21.15.79:0/3108267831 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f37740b3ce0 0x7f37740b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:41.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.148+0000 7f378d757640 1 --2- 172.21.15.79:0/3108267831 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f37740b3ce0 0x7f37740b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:41.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.148+0000 7f377effd640 1 -- 172.21.15.79:0/3108267831 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7f37840e39e0 con 0x7f37881017d0 2024-08-20T01:35:41.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.148+0000 7f377effd640 1 --2- 172.21.15.79:0/3108267831 >> [v2:172.21.15.175:6824/451069549,v1:172.21.15.175:6825/451069549] conn(0x7f37740bd530 0x7f37740bf950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:41.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.148+0000 7f377effd640 1 -- 172.21.15.79:0/3108267831 --> [v2:172.21.15.175:6824/451069549,v1:172.21.15.175:6825/451069549] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3784009d20 con 0x7f37740bd530 2024-08-20T01:35:41.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.148+0000 7f377effd640 1 -- 172.21.15.79:0/3108267831 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7f37840e3e40 con 0x7f37881017d0 2024-08-20T01:35:41.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.148+0000 7f378d757640 1 --2- 172.21.15.79:0/3108267831 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f37740b3ce0 0x7f37740b61a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f37881007f0 tx=0x7f3778009060 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:41.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.148+0000 7f378e759640 1 --2- 172.21.15.79:0/3108267831 >> [v2:172.21.15.175:6824/451069549,v1:172.21.15.175:6825/451069549] conn(0x7f37740bd530 0x7f37740bf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:41.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.149+0000 7f378e759640 1 --2- 172.21.15.79:0/3108267831 >> [v2:172.21.15.175:6824/451069549,v1:172.21.15.175:6825/451069549] conn(0x7f37740bd530 0x7f37740bf950 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:41.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.149+0000 7f377effd640 1 -- 172.21.15.79:0/3108267831 <== osd.11 v2:172.21.15.175:6824/451069549 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3784009d20 con 0x7f37740bd530 2024-08-20T01:35:41.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.163+0000 7f37901bc640 1 -- 172.21.15.79:0/3108267831 --> [v2:172.21.15.175:6824/451069549,v1:172.21.15.175:6825/451069549] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f378806b890 con 0x7f37740bd530 2024-08-20T01:35:41.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.163+0000 7f377effd640 1 -- 172.21.15.79:0/3108267831 <== osd.11 v2:172.21.15.175:6824/451069549 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f378806b890 con 0x7f37740bd530 2024-08-20T01:35:41.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.163+0000 7f37901bc640 1 -- 172.21.15.79:0/3108267831 >> [v2:172.21.15.175:6824/451069549,v1:172.21.15.175:6825/451069549] conn(0x7f37740bd530 msgr2=0x7f37740bf950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:41.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.163+0000 7f37901bc640 1 --2- 172.21.15.79:0/3108267831 >> [v2:172.21.15.175:6824/451069549,v1:172.21.15.175:6825/451069549] conn(0x7f37740bd530 0x7f37740bf950 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:41.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.164+0000 7f37901bc640 1 -- 172.21.15.79:0/3108267831 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f37740b3ce0 msgr2=0x7f37740b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:41.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.164+0000 7f37901bc640 1 --2- 172.21.15.79:0/3108267831 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f37740b3ce0 0x7f37740b61a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f37881007f0 tx=0x7f3778009060 comp rx=0 tx=0).stop 2024-08-20T01:35:41.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.164+0000 7f37901bc640 1 -- 172.21.15.79:0/3108267831 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37881017d0 msgr2=0x7f378819f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:41.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.164+0000 7f37901bc640 1 --2- 172.21.15.79:0/3108267831 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37881017d0 0x7f378819f520 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f378400d770 tx=0x7f378400dc30 comp rx=0 tx=0).stop 2024-08-20T01:35:41.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.164+0000 7f378e759640 1 -- 172.21.15.79:0/3108267831 reap_dead start 2024-08-20T01:35:41.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.164+0000 7f37901bc640 1 -- 172.21.15.79:0/3108267831 shutdown_connections 2024-08-20T01:35:41.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.164+0000 7f37901bc640 1 -- 172.21.15.79:0/3108267831 >> 172.21.15.79:0/3108267831 conn(0x7f37880fd440 msgr2=0x7f3788104540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:41.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.164+0000 7f37901bc640 1 -- 172.21.15.79:0/3108267831 shutdown_connections 2024-08-20T01:35:41.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:41.164+0000 7f37901bc640 1 -- 172.21.15.79:0/3108267831 wait complete. 2024-08-20T01:35:41.906 INFO:teuthology.orchestra.run.smithi079.stdout:34359738442 2024-08-20T01:35:41.906 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-08-20T01:35:42.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:41 smithi175 ceph-mon[22392]: pgmap v296: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-20T01:35:42.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:41 smithi079 ceph-mon[18656]: pgmap v296: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-20T01:35:42.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:41 smithi081 ceph-mon[22209]: pgmap v296: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-20T01:35:42.406 INFO:teuthology.orchestra.run.smithi079.stdout:261993005083 2024-08-20T01:35:42.407 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-08-20T01:35:42.544 INFO:teuthology.orchestra.run.smithi079.stdout:146028888115 2024-08-20T01:35:42.544 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-08-20T01:35:42.932 INFO:teuthology.orchestra.run.smithi079.stdout:55834574917 2024-08-20T01:35:42.932 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-08-20T01:35:43.622 INFO:teuthology.orchestra.run.smithi079.stdout:283467841558 2024-08-20T01:35:43.623 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-08-20T01:35:43.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.834+0000 7fa02e201640 1 -- 172.21.15.79:0/3702895109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa028075210 msgr2=0x7fa0280755f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:43.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.834+0000 7fa02e201640 1 --2- 172.21.15.79:0/3702895109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa028075210 0x7fa0280755f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa018009900 tx=0x7fa01802a410 comp rx=0 tx=0).stop 2024-08-20T01:35:43.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.834+0000 7fa02e201640 1 -- 172.21.15.79:0/3702895109 shutdown_connections 2024-08-20T01:35:43.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.834+0000 7fa02e201640 1 --2- 172.21.15.79:0/3702895109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa02810f0e0 0x7fa0281114d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:43.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.834+0000 7fa02e201640 1 --2- 172.21.15.79:0/3702895109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa028075b30 0x7fa02810eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:43.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.834+0000 7fa02e201640 1 --2- 172.21.15.79:0/3702895109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa028075210 0x7fa0280755f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:43.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.834+0000 7fa02e201640 1 -- 172.21.15.79:0/3702895109 >> 172.21.15.79:0/3702895109 conn(0x7fa0280fe540 msgr2=0x7fa028100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:43.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.834+0000 7fa02e201640 1 -- 172.21.15.79:0/3702895109 shutdown_connections 2024-08-20T01:35:43.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.834+0000 7fa02e201640 1 -- 172.21.15.79:0/3702895109 wait complete. 2024-08-20T01:35:43.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.835+0000 7fa02e201640 1 Processor -- start 2024-08-20T01:35:43.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.835+0000 7fa02e201640 1 -- start start 2024-08-20T01:35:43.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.836+0000 7fa02e201640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa028075210 0x7fa02819b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:43.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.836+0000 7fa02e201640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa028075b30 0x7fa02819b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:43.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.836+0000 7fa02e201640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa02810f0e0 0x7fa0281a09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:43.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.836+0000 7fa02e201640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa028114b80 con 0x7fa02810f0e0 2024-08-20T01:35:43.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.836+0000 7fa02e201640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa028114a00 con 0x7fa028075210 2024-08-20T01:35:43.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.836+0000 7fa02e201640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa028114d00 con 0x7fa028075b30 2024-08-20T01:35:43.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.836+0000 7fa027fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa02810f0e0 0x7fa0281a09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:43.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.836+0000 7fa027fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa02810f0e0 0x7fa0281a09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42528/0 (socket says 172.21.15.79:42528) 2024-08-20T01:35:43.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.836+0000 7fa027fff640 1 -- 172.21.15.79:0/2696716294 learned_addr learned my addr 172.21.15.79:0/2696716294 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:35:43.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.836+0000 7fa0277fe640 1 --2- 172.21.15.79:0/2696716294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa028075210 0x7fa02819b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:43.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.836+0000 7fa026ffd640 1 --2- 172.21.15.79:0/2696716294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa028075b30 0x7fa02819b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:43.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.836+0000 7fa027fff640 1 -- 172.21.15.79:0/2696716294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa028075b30 msgr2=0x7fa02819b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:43.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.836+0000 7fa027fff640 1 --2- 172.21.15.79:0/2696716294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa028075b30 0x7fa02819b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:43.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.836+0000 7fa027fff640 1 -- 172.21.15.79:0/2696716294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa028075210 msgr2=0x7fa02819b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:43.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.836+0000 7fa027fff640 1 --2- 172.21.15.79:0/2696716294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa028075210 0x7fa02819b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:43.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.836+0000 7fa027fff640 1 -- 172.21.15.79:0/2696716294 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0281a11a0 con 0x7fa02810f0e0 2024-08-20T01:35:43.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.836+0000 7fa027fff640 1 --2- 172.21.15.79:0/2696716294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa02810f0e0 0x7fa0281a09d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa02000eb40 tx=0x7fa02000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:43.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.836+0000 7fa024ff9640 1 -- 172.21.15.79:0/2696716294 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa020004b20 con 0x7fa02810f0e0 2024-08-20T01:35:43.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.836+0000 7fa02e201640 1 -- 172.21.15.79:0/2696716294 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0281a1490 con 0x7fa02810f0e0 2024-08-20T01:35:43.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.836+0000 7fa024ff9640 1 -- 172.21.15.79:0/2696716294 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa020004cc0 con 0x7fa02810f0e0 2024-08-20T01:35:43.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.836+0000 7fa024ff9640 1 -- 172.21.15.79:0/2696716294 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa020010690 con 0x7fa02810f0e0 2024-08-20T01:35:43.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.836+0000 7fa02e201640 1 -- 172.21.15.79:0/2696716294 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0281a7b50 con 0x7fa02810f0e0 2024-08-20T01:35:43.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.837+0000 7fa02e201640 1 -- 172.21.15.79:0/2696716294 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa0280635d0 con 0x7fa02810f0e0 2024-08-20T01:35:43.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.839+0000 7fa024ff9640 1 -- 172.21.15.79:0/2696716294 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fa020005540 con 0x7fa02810f0e0 2024-08-20T01:35:43.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.839+0000 7fa024ff9640 1 --2- 172.21.15.79:0/2696716294 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa0100b3c60 0x7fa0100b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:43.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.840+0000 7fa0277fe640 1 --2- 172.21.15.79:0/2696716294 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa0100b3c60 0x7fa0100b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:43.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.840+0000 7fa024ff9640 1 -- 172.21.15.79:0/2696716294 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7fa0200e4430 con 0x7fa02810f0e0 2024-08-20T01:35:43.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.840+0000 7fa024ff9640 1 --2- 172.21.15.79:0/2696716294 >> [v2:172.21.15.79:6826/2400574113,v1:172.21.15.79:6827/2400574113] conn(0x7fa0100bd4b0 0x7fa0100bf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:43.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.840+0000 7fa024ff9640 1 -- 172.21.15.79:0/2696716294 --> [v2:172.21.15.79:6826/2400574113,v1:172.21.15.79:6827/2400574113] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa0100bff80 con 0x7fa0100bd4b0 2024-08-20T01:35:43.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.840+0000 7fa024ff9640 1 -- 172.21.15.79:0/2696716294 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7fa0200e4910 con 0x7fa02810f0e0 2024-08-20T01:35:43.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.840+0000 7fa0277fe640 1 --2- 172.21.15.79:0/2696716294 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa0100b3c60 0x7fa0100b6120 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa018006010 tx=0x7fa018005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:43.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.840+0000 7fa026ffd640 1 --2- 172.21.15.79:0/2696716294 >> [v2:172.21.15.79:6826/2400574113,v1:172.21.15.79:6827/2400574113] conn(0x7fa0100bd4b0 0x7fa0100bf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:43.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.840+0000 7fa026ffd640 1 --2- 172.21.15.79:0/2696716294 >> [v2:172.21.15.79:6826/2400574113,v1:172.21.15.79:6827/2400574113] conn(0x7fa0100bd4b0 0x7fa0100bf8d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:43.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.841+0000 7fa024ff9640 1 -- 172.21.15.79:0/2696716294 <== osd.9 v2:172.21.15.79:6826/2400574113 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa0100bff80 con 0x7fa0100bd4b0 2024-08-20T01:35:43.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.854+0000 7fa02e201640 1 -- 172.21.15.79:0/2696716294 --> [v2:172.21.15.79:6826/2400574113,v1:172.21.15.79:6827/2400574113] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa028063a50 con 0x7fa0100bd4b0 2024-08-20T01:35:43.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.855+0000 7fa024ff9640 1 -- 172.21.15.79:0/2696716294 <== osd.9 v2:172.21.15.79:6826/2400574113 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa028063a50 con 0x7fa0100bd4b0 2024-08-20T01:35:43.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.855+0000 7fa02e201640 1 -- 172.21.15.79:0/2696716294 >> [v2:172.21.15.79:6826/2400574113,v1:172.21.15.79:6827/2400574113] conn(0x7fa0100bd4b0 msgr2=0x7fa0100bf8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:43.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.855+0000 7fa02e201640 1 --2- 172.21.15.79:0/2696716294 >> [v2:172.21.15.79:6826/2400574113,v1:172.21.15.79:6827/2400574113] conn(0x7fa0100bd4b0 0x7fa0100bf8d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:43.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.855+0000 7fa02e201640 1 -- 172.21.15.79:0/2696716294 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa0100b3c60 msgr2=0x7fa0100b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:43.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.855+0000 7fa02e201640 1 --2- 172.21.15.79:0/2696716294 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa0100b3c60 0x7fa0100b6120 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa018006010 tx=0x7fa018005e80 comp rx=0 tx=0).stop 2024-08-20T01:35:43.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.855+0000 7fa02e201640 1 -- 172.21.15.79:0/2696716294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa02810f0e0 msgr2=0x7fa0281a09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:43.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.855+0000 7fa02e201640 1 --2- 172.21.15.79:0/2696716294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa02810f0e0 0x7fa0281a09d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa02000eb40 tx=0x7fa02000c2d0 comp rx=0 tx=0).stop 2024-08-20T01:35:43.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.855+0000 7fa027fff640 1 -- 172.21.15.79:0/2696716294 reap_dead start 2024-08-20T01:35:43.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.855+0000 7fa02e201640 1 -- 172.21.15.79:0/2696716294 shutdown_connections 2024-08-20T01:35:43.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.855+0000 7fa02e201640 1 -- 172.21.15.79:0/2696716294 >> 172.21.15.79:0/2696716294 conn(0x7fa0280fe540 msgr2=0x7fa0280ff1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:43.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.855+0000 7fa02e201640 1 -- 172.21.15.79:0/2696716294 shutdown_connections 2024-08-20T01:35:43.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:43.855+0000 7fa02e201640 1 -- 172.21.15.79:0/2696716294 wait complete. 2024-08-20T01:35:44.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:43 smithi175 ceph-mon[22392]: pgmap v297: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-20T01:35:44.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:43 smithi079 ceph-mon[18656]: pgmap v297: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-20T01:35:44.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:43 smithi081 ceph-mon[22209]: pgmap v297: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-20T01:35:44.408 INFO:teuthology.orchestra.run.smithi079.stdout:214748364836 2024-08-20T01:35:44.408 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-08-20T01:35:45.052 INFO:teuthology.orchestra.run.smithi079.stdout:236223201312 2024-08-20T01:35:45.053 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-08-20T01:35:45.099 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:45.100 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:45.133 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:45.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:45.852+0000 7f4e8992c640 1 -- 172.21.15.79:0/3436883051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e84103890 msgr2=0x7f4e84103c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:45.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:45.852+0000 7f4e8992c640 1 --2- 172.21.15.79:0/3436883051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e84103890 0x7f4e84103c70 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c009900 tx=0x7f4e7c02a410 comp rx=0 tx=0).stop 2024-08-20T01:35:45.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:45.852+0000 7f4e8992c640 1 -- 172.21.15.79:0/3436883051 shutdown_connections 2024-08-20T01:35:45.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:45.852+0000 7f4e8992c640 1 --2- 172.21.15.79:0/3436883051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e8410ce40 0x7f4e8410f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:45.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:45.852+0000 7f4e8992c640 1 --2- 172.21.15.79:0/3436883051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e84104290 0x7f4e8410c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:45.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:45.852+0000 7f4e8992c640 1 --2- 172.21.15.79:0/3436883051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e84103890 0x7f4e84103c70 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:45.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:45.852+0000 7f4e8992c640 1 -- 172.21.15.79:0/3436883051 >> 172.21.15.79:0/3436883051 conn(0x7f4e840fd400 msgr2=0x7f4e840ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:45.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:45.852+0000 7f4e8992c640 1 -- 172.21.15.79:0/3436883051 shutdown_connections 2024-08-20T01:35:45.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:45.852+0000 7f4e8992c640 1 -- 172.21.15.79:0/3436883051 wait complete. 2024-08-20T01:35:45.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:45.853+0000 7f4e8992c640 1 Processor -- start 2024-08-20T01:35:45.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:45.853+0000 7f4e8992c640 1 -- start start 2024-08-20T01:35:45.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:45.853+0000 7f4e8992c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e84103890 0x7f4e84198f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:45.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:45.853+0000 7f4e8992c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e84104290 0x7f4e84199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:45.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:45.853+0000 7f4e8992c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e8410ce40 0x7f4e8419e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:45.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:45.853+0000 7f4e8992c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4e84112970 con 0x7f4e8410ce40 2024-08-20T01:35:45.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:45.853+0000 7f4e8992c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4e841127f0 con 0x7f4e84104290 2024-08-20T01:35:45.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:45.853+0000 7f4e8992c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4e84112af0 con 0x7f4e84103890 2024-08-20T01:35:45.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:45.853+0000 7f4e837fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e8410ce40 0x7f4e8419e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:45.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:45.853+0000 7f4e837fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e8410ce40 0x7f4e8419e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42546/0 (socket says 172.21.15.79:42546) 2024-08-20T01:35:45.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:45.853+0000 7f4e837fe640 1 -- 172.21.15.79:0/1162756296 learned_addr learned my addr 172.21.15.79:0/1162756296 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:35:45.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:45.853+0000 7f4e82ffd640 1 --2- 172.21.15.79:0/1162756296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e84103890 0x7f4e84198f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:45.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:45.854+0000 7f4e827fc640 1 --2- 172.21.15.79:0/1162756296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e84104290 0x7f4e84199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:45.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:45.854+0000 7f4e837fe640 1 -- 172.21.15.79:0/1162756296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e84103890 msgr2=0x7f4e84198f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:45.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:45.854+0000 7f4e837fe640 1 --2- 172.21.15.79:0/1162756296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e84103890 0x7f4e84198f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:45.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:45.854+0000 7f4e837fe640 1 -- 172.21.15.79:0/1162756296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e84104290 msgr2=0x7f4e84199480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:45.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:45.854+0000 7f4e837fe640 1 --2- 172.21.15.79:0/1162756296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e84104290 0x7f4e84199480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:45.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:45.854+0000 7f4e837fe640 1 -- 172.21.15.79:0/1162756296 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e8419eff0 con 0x7f4e8410ce40 2024-08-20T01:35:45.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:45.854+0000 7f4e837fe640 1 --2- 172.21.15.79:0/1162756296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e8410ce40 0x7f4e8419e820 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4e7400e9d0 tx=0x7f4e7400edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:45.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:45.854+0000 7f4e8892a640 1 -- 172.21.15.79:0/1162756296 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e74004d20 con 0x7f4e8410ce40 2024-08-20T01:35:45.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:45.854+0000 7f4e8992c640 1 -- 172.21.15.79:0/1162756296 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e8419f2e0 con 0x7f4e8410ce40 2024-08-20T01:35:45.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:45.854+0000 7f4e8892a640 1 -- 172.21.15.79:0/1162756296 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4e74005020 con 0x7f4e8410ce40 2024-08-20T01:35:45.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:45.854+0000 7f4e8892a640 1 -- 172.21.15.79:0/1162756296 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e740116d0 con 0x7f4e8410ce40 2024-08-20T01:35:45.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:45.854+0000 7f4e8992c640 1 -- 172.21.15.79:0/1162756296 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e841a5a20 con 0x7f4e8410ce40 2024-08-20T01:35:45.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:45.855+0000 7f4e8992c640 1 -- 172.21.15.79:0/1162756296 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e84103c70 con 0x7f4e8410ce40 2024-08-20T01:35:45.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:45.857+0000 7f4e8892a640 1 -- 172.21.15.79:0/1162756296 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f4e7400cb20 con 0x7f4e8410ce40 2024-08-20T01:35:45.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:45.858+0000 7f4e8892a640 1 --2- 172.21.15.79:0/1162756296 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4e6c0b3c60 0x7f4e6c0b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:45.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:45.858+0000 7f4e82ffd640 1 --2- 172.21.15.79:0/1162756296 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4e6c0b3c60 0x7f4e6c0b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:45.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:45.858+0000 7f4e8892a640 1 -- 172.21.15.79:0/1162756296 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7f4e740e4040 con 0x7f4e8410ce40 2024-08-20T01:35:45.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:45.859+0000 7f4e82ffd640 1 --2- 172.21.15.79:0/1162756296 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4e6c0b3c60 0x7f4e6c0b6120 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c0057c0 tx=0x7f4e7c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:45.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:45.861+0000 7f4e8892a640 1 -- 172.21.15.79:0/1162756296 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f4e74016030 con 0x7f4e8410ce40 2024-08-20T01:35:45.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:45 smithi079 ceph-mon[18656]: pgmap v298: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-20T01:35:45.997 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:46.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.046+0000 7f4e8992c640 1 -- 172.21.15.79:0/1162756296 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f4e8402e340 con 0x7f4e8410ce40 2024-08-20T01:35:46.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.046+0000 7f4e8892a640 1 -- 172.21.15.79:0/1162756296 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4e740ab6e0 con 0x7f4e8410ce40 2024-08-20T01:35:46.048 INFO:teuthology.orchestra.run.smithi079.stdout:98784247868 2024-08-20T01:35:46.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.048+0000 7f4e8992c640 1 -- 172.21.15.79:0/1162756296 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4e6c0b3c60 msgr2=0x7f4e6c0b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:46.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.048+0000 7f4e8992c640 1 --2- 172.21.15.79:0/1162756296 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4e6c0b3c60 0x7f4e6c0b6120 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c0057c0 tx=0x7f4e7c0058d0 comp rx=0 tx=0).stop 2024-08-20T01:35:46.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.048+0000 7f4e8992c640 1 -- 172.21.15.79:0/1162756296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e8410ce40 msgr2=0x7f4e8419e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:46.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.048+0000 7f4e8992c640 1 --2- 172.21.15.79:0/1162756296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e8410ce40 0x7f4e8419e820 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4e7400e9d0 tx=0x7f4e7400edd0 comp rx=0 tx=0).stop 2024-08-20T01:35:46.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.048+0000 7f4e8992c640 1 -- 172.21.15.79:0/1162756296 shutdown_connections 2024-08-20T01:35:46.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.048+0000 7f4e8992c640 1 --2- 172.21.15.79:0/1162756296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e8410ce40 0x7f4e8419e820 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:46.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.048+0000 7f4e8992c640 1 --2- 172.21.15.79:0/1162756296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e84104290 0x7f4e84199480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:46.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.048+0000 7f4e8992c640 1 --2- 172.21.15.79:0/1162756296 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4e6c0b3c60 0x7f4e6c0b6120 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:46.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.048+0000 7f4e8992c640 1 --2- 172.21.15.79:0/1162756296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e84103890 0x7f4e84198f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:46.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.048+0000 7f4e8992c640 1 -- 172.21.15.79:0/1162756296 >> 172.21.15.79:0/1162756296 conn(0x7f4e840fd400 msgr2=0x7f4e840fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:46.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.049+0000 7f4e8992c640 1 -- 172.21.15.79:0/1162756296 shutdown_connections 2024-08-20T01:35:46.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.049+0000 7f4e8992c640 1 -- 172.21.15.79:0/1162756296 wait complete. 2024-08-20T01:35:46.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.075+0000 7fb21d45f640 1 -- 172.21.15.79:0/1938579685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb218102ad0 msgr2=0x7fb218102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:46.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.075+0000 7fb21d45f640 1 --2- 172.21.15.79:0/1938579685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb218102ad0 0x7fb218102eb0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb208009900 tx=0x7fb20802a410 comp rx=0 tx=0).stop 2024-08-20T01:35:46.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.075+0000 7fb21d45f640 1 -- 172.21.15.79:0/1938579685 shutdown_connections 2024-08-20T01:35:46.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.075+0000 7fb21d45f640 1 --2- 172.21.15.79:0/1938579685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb218108e60 0x7fb21810f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:46.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.075+0000 7fb21d45f640 1 --2- 172.21.15.79:0/1938579685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2181084e0 0x7fb218108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:46.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.075+0000 7fb21d45f640 1 --2- 172.21.15.79:0/1938579685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb218102ad0 0x7fb218102eb0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:46.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.075+0000 7fb21d45f640 1 -- 172.21.15.79:0/1938579685 >> 172.21.15.79:0/1938579685 conn(0x7fb2180fe540 msgr2=0x7fb218100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:46.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.075+0000 7fb21d45f640 1 -- 172.21.15.79:0/1938579685 shutdown_connections 2024-08-20T01:35:46.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.075+0000 7fb21d45f640 1 -- 172.21.15.79:0/1938579685 wait complete. 2024-08-20T01:35:46.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.075+0000 7fb21d45f640 1 Processor -- start 2024-08-20T01:35:46.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.076+0000 7fb21d45f640 1 -- start start 2024-08-20T01:35:46.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.076+0000 7fb21d45f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb218102ad0 0x7fb218198f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:46.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.076+0000 7fb21d45f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2181084e0 0x7fb218199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:46.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.076+0000 7fb21d45f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb218108e60 0x7fb21819e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:46.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.076+0000 7fb21d45f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb2181129d0 con 0x7fb218108e60 2024-08-20T01:35:46.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.076+0000 7fb21d45f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb218112850 con 0x7fb2181084e0 2024-08-20T01:35:46.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.076+0000 7fb21d45f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb218112b50 con 0x7fb218102ad0 2024-08-20T01:35:46.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.076+0000 7fb2177fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb218108e60 0x7fb21819e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:46.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.076+0000 7fb2177fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb218108e60 0x7fb21819e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42554/0 (socket says 172.21.15.79:42554) 2024-08-20T01:35:46.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.076+0000 7fb2177fe640 1 -- 172.21.15.79:0/3912848144 learned_addr learned my addr 172.21.15.79:0/3912848144 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:35:46.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.076+0000 7fb2167fc640 1 --2- 172.21.15.79:0/3912848144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2181084e0 0x7fb218199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:46.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.076+0000 7fb216ffd640 1 --2- 172.21.15.79:0/3912848144 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb218102ad0 0x7fb218198f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:46.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.076+0000 7fb2177fe640 1 -- 172.21.15.79:0/3912848144 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb218102ad0 msgr2=0x7fb218198f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:46.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.076+0000 7fb2177fe640 1 --2- 172.21.15.79:0/3912848144 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb218102ad0 0x7fb218198f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:46.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.076+0000 7fb2177fe640 1 -- 172.21.15.79:0/3912848144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2181084e0 msgr2=0x7fb218199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:46.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.076+0000 7fb2177fe640 1 --2- 172.21.15.79:0/3912848144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2181084e0 0x7fb218199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:46.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.076+0000 7fb2177fe640 1 -- 172.21.15.79:0/3912848144 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb21819efb0 con 0x7fb218108e60 2024-08-20T01:35:46.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.076+0000 7fb2177fe640 1 --2- 172.21.15.79:0/3912848144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb218108e60 0x7fb21819e7e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb210009fd0 tx=0x7fb21000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:46.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.077+0000 7fb216ffd640 1 --2- 172.21.15.79:0/3912848144 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb218102ad0 0x7fb218198f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:35:46.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.077+0000 7fb1fffff640 1 -- 172.21.15.79:0/3912848144 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb210017070 con 0x7fb218108e60 2024-08-20T01:35:46.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.077+0000 7fb1fffff640 1 -- 172.21.15.79:0/3912848144 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb210003e00 con 0x7fb218108e60 2024-08-20T01:35:46.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.077+0000 7fb21d45f640 1 -- 172.21.15.79:0/3912848144 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb21819f2a0 con 0x7fb218108e60 2024-08-20T01:35:46.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.077+0000 7fb1fffff640 1 -- 172.21.15.79:0/3912848144 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb210010460 con 0x7fb218108e60 2024-08-20T01:35:46.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.077+0000 7fb21d45f640 1 -- 172.21.15.79:0/3912848144 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2181a5960 con 0x7fb218108e60 2024-08-20T01:35:46.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.078+0000 7fb21d45f640 1 -- 172.21.15.79:0/3912848144 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb218102eb0 con 0x7fb218108e60 2024-08-20T01:35:46.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.079+0000 7fb1fffff640 1 -- 172.21.15.79:0/3912848144 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fb210003fb0 con 0x7fb218108e60 2024-08-20T01:35:46.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.080+0000 7fb1fffff640 1 --2- 172.21.15.79:0/3912848144 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb2000b3ce0 0x7fb2000b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:46.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.080+0000 7fb1fffff640 1 -- 172.21.15.79:0/3912848144 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7fb2100e38d0 con 0x7fb218108e60 2024-08-20T01:35:46.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.080+0000 7fb216ffd640 1 --2- 172.21.15.79:0/3912848144 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb2000b3ce0 0x7fb2000b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:46.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.081+0000 7fb216ffd640 1 --2- 172.21.15.79:0/3912848144 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb2000b3ce0 0x7fb2000b61a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb208000c00 tx=0x7fb208032c40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:46.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.083+0000 7fb1fffff640 1 -- 172.21.15.79:0/3912848144 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fb2100aaff0 con 0x7fb218108e60 2024-08-20T01:35:46.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:45 smithi175 ceph-mon[22392]: pgmap v298: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-20T01:35:46.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.269+0000 7fb21d45f640 1 -- 172.21.15.79:0/3912848144 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fb21802e340 con 0x7fb218108e60 2024-08-20T01:35:46.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.269+0000 7fb1fffff640 1 -- 172.21.15.79:0/3912848144 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb2100aa8f0 con 0x7fb218108e60 2024-08-20T01:35:46.271 INFO:teuthology.orchestra.run.smithi079.stdout:167503724592 2024-08-20T01:35:46.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.271+0000 7fb21d45f640 1 -- 172.21.15.79:0/3912848144 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb2000b3ce0 msgr2=0x7fb2000b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:46.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.271+0000 7fb21d45f640 1 --2- 172.21.15.79:0/3912848144 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb2000b3ce0 0x7fb2000b61a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb208000c00 tx=0x7fb208032c40 comp rx=0 tx=0).stop 2024-08-20T01:35:46.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.271+0000 7fb21d45f640 1 -- 172.21.15.79:0/3912848144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb218108e60 msgr2=0x7fb21819e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:46.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.271+0000 7fb21d45f640 1 --2- 172.21.15.79:0/3912848144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb218108e60 0x7fb21819e7e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb210009fd0 tx=0x7fb21000b260 comp rx=0 tx=0).stop 2024-08-20T01:35:46.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.271+0000 7fb21d45f640 1 -- 172.21.15.79:0/3912848144 shutdown_connections 2024-08-20T01:35:46.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.271+0000 7fb21d45f640 1 --2- 172.21.15.79:0/3912848144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb218108e60 0x7fb21819e7e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:46.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.271+0000 7fb21d45f640 1 --2- 172.21.15.79:0/3912848144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2181084e0 0x7fb218199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:46.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.271+0000 7fb21d45f640 1 --2- 172.21.15.79:0/3912848144 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb2000b3ce0 0x7fb2000b61a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:46.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.271+0000 7fb21d45f640 1 --2- 172.21.15.79:0/3912848144 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb218102ad0 0x7fb218198f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:46.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.271+0000 7fb21d45f640 1 -- 172.21.15.79:0/3912848144 >> 172.21.15.79:0/3912848144 conn(0x7fb2180fe540 msgr2=0x7fb2180fff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:46.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.271+0000 7fb21d45f640 1 -- 172.21.15.79:0/3912848144 shutdown_connections 2024-08-20T01:35:46.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:46.271+0000 7fb21d45f640 1 -- 172.21.15.79:0/3912848144 wait complete. 2024-08-20T01:35:46.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:45 smithi081 ceph-mon[22209]: pgmap v298: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-20T01:35:46.868 INFO:teuthology.orchestra.run.smithi079.stdout:188978561065 2024-08-20T01:35:46.869 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-08-20T01:35:46.890 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:46 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/1162756296' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-08-20T01:35:46.891 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:46 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/3912848144' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-08-20T01:35:47.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:46 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/1162756296' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-08-20T01:35:47.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:46 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/3912848144' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-08-20T01:35:47.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:46 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/1162756296' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-08-20T01:35:47.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:46 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/3912848144' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-08-20T01:35:47.744 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247866 got 98784247868 for osd.3 2024-08-20T01:35:47.745 DEBUG:teuthology.parallel:result is None 2024-08-20T01:35:47.746 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:47.921 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:47 smithi079 ceph-mon[18656]: pgmap v299: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-08-20T01:35:47.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:47.918+0000 7f4a7a085640 1 -- 172.21.15.79:0/4287288519 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a741073a0 msgr2=0x7f4a741077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:47.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:47.918+0000 7f4a7a085640 1 --2- 172.21.15.79:0/4287288519 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a741073a0 0x7f4a741077e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c009900 tx=0x7f4a5c02a410 comp rx=0 tx=0).stop 2024-08-20T01:35:47.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:47.919+0000 7f4a7a085640 1 -- 172.21.15.79:0/4287288519 shutdown_connections 2024-08-20T01:35:47.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:47.919+0000 7f4a7a085640 1 --2- 172.21.15.79:0/4287288519 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a74107d20 0x7f4a7410e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:47.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:47.919+0000 7f4a7a085640 1 --2- 172.21.15.79:0/4287288519 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a741073a0 0x7f4a741077e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:47.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:47.919+0000 7f4a7a085640 1 --2- 172.21.15.79:0/4287288519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a74101990 0x7f4a74101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:47.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:47.919+0000 7f4a7a085640 1 -- 172.21.15.79:0/4287288519 >> 172.21.15.79:0/4287288519 conn(0x7f4a740fd400 msgr2=0x7f4a740ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:47.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:47.919+0000 7f4a7a085640 1 -- 172.21.15.79:0/4287288519 shutdown_connections 2024-08-20T01:35:47.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:47.919+0000 7f4a7a085640 1 -- 172.21.15.79:0/4287288519 wait complete. 2024-08-20T01:35:47.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:47.919+0000 7f4a7a085640 1 Processor -- start 2024-08-20T01:35:47.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:47.919+0000 7f4a7a085640 1 -- start start 2024-08-20T01:35:47.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:47.920+0000 7f4a7a085640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a74101990 0x7f4a741990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:47.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:47.920+0000 7f4a7a085640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a741073a0 0x7f4a741995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:47.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:47.920+0000 7f4a7a085640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a74107d20 0x7f4a7419e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:47.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:47.920+0000 7f4a7a085640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4a741118d0 con 0x7f4a74101990 2024-08-20T01:35:47.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:47.920+0000 7f4a7a085640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4a74111750 con 0x7f4a741073a0 2024-08-20T01:35:47.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:47.920+0000 7f4a7a085640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4a74111a50 con 0x7f4a74107d20 2024-08-20T01:35:47.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:47.920+0000 7f4a737fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a74101990 0x7f4a741990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:47.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:47.920+0000 7f4a737fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a74101990 0x7f4a741990b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42576/0 (socket says 172.21.15.79:42576) 2024-08-20T01:35:47.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:47.920+0000 7f4a737fe640 1 -- 172.21.15.79:0/3596601262 learned_addr learned my addr 172.21.15.79:0/3596601262 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:35:47.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:47.920+0000 7f4a6bfff640 1 --2- 172.21.15.79:0/3596601262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a741073a0 0x7f4a741995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:47.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:47.920+0000 7f4a737fe640 1 -- 172.21.15.79:0/3596601262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a74107d20 msgr2=0x7f4a7419e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:47.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:47.920+0000 7f4a737fe640 1 --2- 172.21.15.79:0/3596601262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a74107d20 0x7f4a7419e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:47.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:47.920+0000 7f4a737fe640 1 -- 172.21.15.79:0/3596601262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a741073a0 msgr2=0x7f4a741995f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:47.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:47.920+0000 7f4a737fe640 1 --2- 172.21.15.79:0/3596601262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a741073a0 0x7f4a741995f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:47.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:47.920+0000 7f4a737fe640 1 -- 172.21.15.79:0/3596601262 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a7419f160 con 0x7f4a74101990 2024-08-20T01:35:47.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:47.920+0000 7f4a6bfff640 1 --2- 172.21.15.79:0/3596601262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a741073a0 0x7f4a741995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:35:47.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:47.920+0000 7f4a737fe640 1 --2- 172.21.15.79:0/3596601262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a74101990 0x7f4a741990b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4a6400b4a0 tx=0x7f4a6400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:47.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:47.920+0000 7f4a717fa640 1 -- 172.21.15.79:0/3596601262 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a64014070 con 0x7f4a74101990 2024-08-20T01:35:47.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:47.920+0000 7f4a7a085640 1 -- 172.21.15.79:0/3596601262 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a7419f450 con 0x7f4a74101990 2024-08-20T01:35:47.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:47.920+0000 7f4a717fa640 1 -- 172.21.15.79:0/3596601262 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4a64010aa0 con 0x7f4a74101990 2024-08-20T01:35:47.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:47.920+0000 7f4a717fa640 1 -- 172.21.15.79:0/3596601262 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a64017b70 con 0x7f4a74101990 2024-08-20T01:35:47.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:47.921+0000 7f4a7a085640 1 -- 172.21.15.79:0/3596601262 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a740fd9b0 con 0x7f4a74101990 2024-08-20T01:35:47.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:47.921+0000 7f4a7a085640 1 -- 172.21.15.79:0/3596601262 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a74102c40 con 0x7f4a74101990 2024-08-20T01:35:47.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:47.923+0000 7f4a717fa640 1 -- 172.21.15.79:0/3596601262 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f4a64017070 con 0x7f4a74101990 2024-08-20T01:35:47.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:47.923+0000 7f4a717fa640 1 --2- 172.21.15.79:0/3596601262 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4a600b3c60 0x7f4a600b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:47.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:47.923+0000 7f4a6bfff640 1 --2- 172.21.15.79:0/3596601262 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4a600b3c60 0x7f4a600b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:47.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:47.924+0000 7f4a717fa640 1 -- 172.21.15.79:0/3596601262 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7f4a640e32d0 con 0x7f4a74101990 2024-08-20T01:35:47.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:47.924+0000 7f4a6bfff640 1 --2- 172.21.15.79:0/3596601262 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4a600b3c60 0x7f4a600b6120 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c000c00 tx=0x7f4a5c032d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:47.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:47.926+0000 7f4a717fa640 1 -- 172.21.15.79:0/3596601262 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f4a640aaa80 con 0x7f4a74101990 2024-08-20T01:35:48.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.107+0000 7f4a7a085640 1 -- 172.21.15.79:0/3596601262 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f4a740fdc70 con 0x7f4a74101990 2024-08-20T01:35:48.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.108+0000 7f4a717fa640 1 -- 172.21.15.79:0/3596601262 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4a640aa380 con 0x7f4a74101990 2024-08-20T01:35:48.110 INFO:teuthology.orchestra.run.smithi079.stdout:73014444098 2024-08-20T01:35:48.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.110+0000 7f4a7a085640 1 -- 172.21.15.79:0/3596601262 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4a600b3c60 msgr2=0x7f4a600b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:48.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.110+0000 7f4a7a085640 1 --2- 172.21.15.79:0/3596601262 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4a600b3c60 0x7f4a600b6120 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c000c00 tx=0x7f4a5c032d20 comp rx=0 tx=0).stop 2024-08-20T01:35:48.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.110+0000 7f4a7a085640 1 -- 172.21.15.79:0/3596601262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a74101990 msgr2=0x7f4a741990b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:48.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.110+0000 7f4a7a085640 1 --2- 172.21.15.79:0/3596601262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a74101990 0x7f4a741990b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4a6400b4a0 tx=0x7f4a6400b960 comp rx=0 tx=0).stop 2024-08-20T01:35:48.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.110+0000 7f4a7a085640 1 -- 172.21.15.79:0/3596601262 shutdown_connections 2024-08-20T01:35:48.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.110+0000 7f4a7a085640 1 --2- 172.21.15.79:0/3596601262 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4a600b3c60 0x7f4a600b6120 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:48.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.110+0000 7f4a7a085640 1 --2- 172.21.15.79:0/3596601262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a74107d20 0x7f4a7419e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:48.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.110+0000 7f4a7a085640 1 --2- 172.21.15.79:0/3596601262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a741073a0 0x7f4a741995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:48.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.110+0000 7f4a7a085640 1 --2- 172.21.15.79:0/3596601262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a74101990 0x7f4a741990b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:48.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.110+0000 7f4a7a085640 1 -- 172.21.15.79:0/3596601262 >> 172.21.15.79:0/3596601262 conn(0x7f4a740fd400 msgr2=0x7f4a74104980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:48.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.110+0000 7f4a7a085640 1 -- 172.21.15.79:0/3596601262 shutdown_connections 2024-08-20T01:35:48.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.110+0000 7f4a7a085640 1 -- 172.21.15.79:0/3596601262 wait complete. 2024-08-20T01:35:48.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:47 smithi175 ceph-mon[22392]: pgmap v299: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-08-20T01:35:48.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:47 smithi081 ceph-mon[22209]: pgmap v299: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-08-20T01:35:48.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.561+0000 7f1d83f11640 1 -- 172.21.15.79:0/22857688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d7c107d20 msgr2=0x7f1d7c10e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:48.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.561+0000 7f1d83f11640 1 --2- 172.21.15.79:0/22857688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d7c107d20 0x7f1d7c10e520 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1d74009ca0 tx=0x7f1d7402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:35:48.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.561+0000 7f1d83f11640 1 -- 172.21.15.79:0/22857688 shutdown_connections 2024-08-20T01:35:48.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.561+0000 7f1d83f11640 1 --2- 172.21.15.79:0/22857688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d7c107d20 0x7f1d7c10e520 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:48.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.561+0000 7f1d83f11640 1 --2- 172.21.15.79:0/22857688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d7c1073a0 0x7f1d7c1077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:48.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.561+0000 7f1d83f11640 1 --2- 172.21.15.79:0/22857688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d7c101990 0x7f1d7c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:48.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.561+0000 7f1d83f11640 1 -- 172.21.15.79:0/22857688 >> 172.21.15.79:0/22857688 conn(0x7f1d7c0fd400 msgr2=0x7f1d7c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:48.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.561+0000 7f1d83f11640 1 -- 172.21.15.79:0/22857688 shutdown_connections 2024-08-20T01:35:48.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.561+0000 7f1d83f11640 1 -- 172.21.15.79:0/22857688 wait complete. 2024-08-20T01:35:48.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.562+0000 7f1d83f11640 1 Processor -- start 2024-08-20T01:35:48.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.562+0000 7f1d83f11640 1 -- start start 2024-08-20T01:35:48.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.562+0000 7f1d83f11640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d7c101990 0x7f1d7c199cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:48.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.562+0000 7f1d83f11640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d7c1073a0 0x7f1d7c19a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:48.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.562+0000 7f1d814ac640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d7c1073a0 0x7f1d7c19a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:48.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.562+0000 7f1d814ac640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d7c1073a0 0x7f1d7c19a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42612/0 (socket says 172.21.15.79:42612) 2024-08-20T01:35:48.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.562+0000 7f1d81cad640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d7c101990 0x7f1d7c199cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:48.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.562+0000 7f1d81cad640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d7c101990 0x7f1d7c199cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:43470/0 (socket says 172.21.15.79:43470) 2024-08-20T01:35:48.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.562+0000 7f1d83f11640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d7c107d20 0x7f1d7c19a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:48.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.562+0000 7f1d814ac640 1 -- 172.21.15.79:0/2517369705 learned_addr learned my addr 172.21.15.79:0/2517369705 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:35:48.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.562+0000 7f1d83f11640 1 -- 172.21.15.79:0/2517369705 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7c1118e0 con 0x7f1d7c1073a0 2024-08-20T01:35:48.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.562+0000 7f1d83f11640 1 -- 172.21.15.79:0/2517369705 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7c111760 con 0x7f1d7c107d20 2024-08-20T01:35:48.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.562+0000 7f1d83f11640 1 -- 172.21.15.79:0/2517369705 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7c111a60 con 0x7f1d7c101990 2024-08-20T01:35:48.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.563+0000 7f1d824ae640 1 --2- 172.21.15.79:0/2517369705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d7c107d20 0x7f1d7c19a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:48.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.563+0000 7f1d814ac640 1 -- 172.21.15.79:0/2517369705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d7c101990 msgr2=0x7f1d7c199cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:48.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.563+0000 7f1d814ac640 1 --2- 172.21.15.79:0/2517369705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d7c101990 0x7f1d7c199cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:48.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.563+0000 7f1d814ac640 1 -- 172.21.15.79:0/2517369705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d7c107d20 msgr2=0x7f1d7c19a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:48.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.563+0000 7f1d814ac640 1 --2- 172.21.15.79:0/2517369705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d7c107d20 0x7f1d7c19a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:48.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.563+0000 7f1d814ac640 1 -- 172.21.15.79:0/2517369705 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d7c1a50d0 con 0x7f1d7c1073a0 2024-08-20T01:35:48.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.563+0000 7f1d814ac640 1 --2- 172.21.15.79:0/2517369705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d7c1073a0 0x7f1d7c19a230 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c00d950 tx=0x7f1d6c00dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:48.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.563+0000 7f1d72ffd640 1 -- 172.21.15.79:0/2517369705 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c017070 con 0x7f1d7c1073a0 2024-08-20T01:35:48.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.563+0000 7f1d72ffd640 1 -- 172.21.15.79:0/2517369705 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d6c00de80 con 0x7f1d7c1073a0 2024-08-20T01:35:48.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.563+0000 7f1d83f11640 1 -- 172.21.15.79:0/2517369705 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d7c1a53c0 con 0x7f1d7c1073a0 2024-08-20T01:35:48.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.563+0000 7f1d72ffd640 1 -- 172.21.15.79:0/2517369705 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c00f620 con 0x7f1d7c1073a0 2024-08-20T01:35:48.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.563+0000 7f1d83f11640 1 -- 172.21.15.79:0/2517369705 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d7c1a5900 con 0x7f1d7c1073a0 2024-08-20T01:35:48.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.564+0000 7f1d83f11640 1 -- 172.21.15.79:0/2517369705 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d7c101d70 con 0x7f1d7c1073a0 2024-08-20T01:35:48.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.567+0000 7f1d72ffd640 1 -- 172.21.15.79:0/2517369705 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f1d6c009c30 con 0x7f1d7c1073a0 2024-08-20T01:35:48.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.568+0000 7f1d72ffd640 1 --2- 172.21.15.79:0/2517369705 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1d680b3c60 0x7f1d680b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:48.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.568+0000 7f1d81cad640 1 --2- 172.21.15.79:0/2517369705 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1d680b3c60 0x7f1d680b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:48.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.568+0000 7f1d72ffd640 1 -- 172.21.15.79:0/2517369705 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7f1d6c0e3750 con 0x7f1d7c1073a0 2024-08-20T01:35:48.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.568+0000 7f1d81cad640 1 --2- 172.21.15.79:0/2517369705 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1d680b3c60 0x7f1d680b6120 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1d78009990 tx=0x7f1d78009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:48.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.570+0000 7f1d72ffd640 1 -- 172.21.15.79:0/2517369705 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f1d6c0aadf0 con 0x7f1d7c1073a0 2024-08-20T01:35:48.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.756+0000 7f1d83f11640 1 -- 172.21.15.79:0/2517369705 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f1d7c02e340 con 0x7f1d7c1073a0 2024-08-20T01:35:48.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.756+0000 7f1d72ffd640 1 -- 172.21.15.79:0/2517369705 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f1d6c0aa6f0 con 0x7f1d7c1073a0 2024-08-20T01:35:48.758 INFO:teuthology.orchestra.run.smithi079.stdout:261993005085 2024-08-20T01:35:48.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.758+0000 7f1d83f11640 1 -- 172.21.15.79:0/2517369705 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1d680b3c60 msgr2=0x7f1d680b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:48.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.758+0000 7f1d83f11640 1 --2- 172.21.15.79:0/2517369705 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1d680b3c60 0x7f1d680b6120 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1d78009990 tx=0x7f1d78009110 comp rx=0 tx=0).stop 2024-08-20T01:35:48.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.758+0000 7f1d83f11640 1 -- 172.21.15.79:0/2517369705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d7c1073a0 msgr2=0x7f1d7c19a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:48.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.758+0000 7f1d83f11640 1 --2- 172.21.15.79:0/2517369705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d7c1073a0 0x7f1d7c19a230 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c00d950 tx=0x7f1d6c00dd50 comp rx=0 tx=0).stop 2024-08-20T01:35:48.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.758+0000 7f1d83f11640 1 -- 172.21.15.79:0/2517369705 shutdown_connections 2024-08-20T01:35:48.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.758+0000 7f1d83f11640 1 --2- 172.21.15.79:0/2517369705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d7c107d20 0x7f1d7c19a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:48.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.758+0000 7f1d83f11640 1 --2- 172.21.15.79:0/2517369705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d7c1073a0 0x7f1d7c19a230 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:48.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.758+0000 7f1d83f11640 1 --2- 172.21.15.79:0/2517369705 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1d680b3c60 0x7f1d680b6120 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:48.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.758+0000 7f1d83f11640 1 --2- 172.21.15.79:0/2517369705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d7c101990 0x7f1d7c199cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:48.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.758+0000 7f1d83f11640 1 -- 172.21.15.79:0/2517369705 >> 172.21.15.79:0/2517369705 conn(0x7f1d7c0fd400 msgr2=0x7f1d7c0ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:48.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.758+0000 7f1d83f11640 1 -- 172.21.15.79:0/2517369705 shutdown_connections 2024-08-20T01:35:48.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.758+0000 7f1d83f11640 1 -- 172.21.15.79:0/2517369705 wait complete. 2024-08-20T01:35:48.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.461+0000 7fc362938640 1 -- 172.21.15.79:0/3970296001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc35c102aa0 msgr2=0x7fc35c102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:48.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.461+0000 7fc362938640 1 --2- 172.21.15.79:0/3970296001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc35c102aa0 0x7fc35c102e80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc34c009900 tx=0x7fc34c02a410 comp rx=0 tx=0).stop 2024-08-20T01:35:48.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.461+0000 7fc362938640 1 -- 172.21.15.79:0/3970296001 shutdown_connections 2024-08-20T01:35:48.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.461+0000 7fc362938640 1 --2- 172.21.15.79:0/3970296001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc35c108e30 0x7fc35c10f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:48.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.461+0000 7fc362938640 1 --2- 172.21.15.79:0/3970296001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc35c1084b0 0x7fc35c1088f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:48.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.461+0000 7fc362938640 1 --2- 172.21.15.79:0/3970296001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc35c102aa0 0x7fc35c102e80 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:48.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.461+0000 7fc362938640 1 -- 172.21.15.79:0/3970296001 >> 172.21.15.79:0/3970296001 conn(0x7fc35c0fe550 msgr2=0x7fc35c100970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:48.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.461+0000 7fc362938640 1 -- 172.21.15.79:0/3970296001 shutdown_connections 2024-08-20T01:35:48.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.461+0000 7fc362938640 1 -- 172.21.15.79:0/3970296001 wait complete. 2024-08-20T01:35:48.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.461+0000 7fc362938640 1 Processor -- start 2024-08-20T01:35:48.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.462+0000 7fc362938640 1 -- start start 2024-08-20T01:35:48.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.462+0000 7fc362938640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc35c102aa0 0x7fc35c198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:48.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.462+0000 7fc362938640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc35c1084b0 0x7fc35c1993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:48.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.462+0000 7fc362938640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc35c108e30 0x7fc35c19e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:48.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.462+0000 7fc362938640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc35c1129a0 con 0x7fc35c1084b0 2024-08-20T01:35:48.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.462+0000 7fc362938640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc35c112820 con 0x7fc35c102aa0 2024-08-20T01:35:48.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.462+0000 7fc362938640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc35c112b20 con 0x7fc35c108e30 2024-08-20T01:35:48.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.462+0000 7fc35b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc35c1084b0 0x7fc35c1993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:48.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.462+0000 7fc35b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc35c1084b0 0x7fc35c1993f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42592/0 (socket says 172.21.15.79:42592) 2024-08-20T01:35:48.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.462+0000 7fc35b7fe640 1 -- 172.21.15.79:0/2353252466 learned_addr learned my addr 172.21.15.79:0/2353252466 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:35:48.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.462+0000 7fc35bfff640 1 --2- 172.21.15.79:0/2353252466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc35c102aa0 0x7fc35c198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:48.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.462+0000 7fc360ed5640 1 --2- 172.21.15.79:0/2353252466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc35c108e30 0x7fc35c19e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:48.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.462+0000 7fc35b7fe640 1 -- 172.21.15.79:0/2353252466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc35c108e30 msgr2=0x7fc35c19e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:48.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.462+0000 7fc35b7fe640 1 --2- 172.21.15.79:0/2353252466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc35c108e30 0x7fc35c19e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:48.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.462+0000 7fc35b7fe640 1 -- 172.21.15.79:0/2353252466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc35c102aa0 msgr2=0x7fc35c198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:48.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.462+0000 7fc35b7fe640 1 --2- 172.21.15.79:0/2353252466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc35c102aa0 0x7fc35c198eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:48.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.462+0000 7fc35b7fe640 1 -- 172.21.15.79:0/2353252466 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc35c19ef60 con 0x7fc35c1084b0 2024-08-20T01:35:48.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.462+0000 7fc35bfff640 1 --2- 172.21.15.79:0/2353252466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc35c102aa0 0x7fc35c198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:35:48.821 INFO:teuthology.orchestra.run.smithi079.stdout:120259084345 2024-08-20T01:35:48.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.463+0000 7fc35b7fe640 1 --2- 172.21.15.79:0/2353252466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc35c1084b0 0x7fc35c1993f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc35000c890 tx=0x7fc35000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:48.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.463+0000 7fc3597fa640 1 -- 172.21.15.79:0/2353252466 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc350004220 con 0x7fc35c1084b0 2024-08-20T01:35:48.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.463+0000 7fc362938640 1 -- 172.21.15.79:0/2353252466 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc35c19f250 con 0x7fc35c1084b0 2024-08-20T01:35:48.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.463+0000 7fc3597fa640 1 -- 172.21.15.79:0/2353252466 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc350007e40 con 0x7fc35c1084b0 2024-08-20T01:35:48.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.463+0000 7fc3597fa640 1 -- 172.21.15.79:0/2353252466 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc350004a00 con 0x7fc35c1084b0 2024-08-20T01:35:48.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.463+0000 7fc362938640 1 -- 172.21.15.79:0/2353252466 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc35c1a5ae0 con 0x7fc35c1084b0 2024-08-20T01:35:48.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.464+0000 7fc362938640 1 -- 172.21.15.79:0/2353252466 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc35c102e80 con 0x7fc35c1084b0 2024-08-20T01:35:48.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.465+0000 7fc3597fa640 1 -- 172.21.15.79:0/2353252466 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fc3500079b0 con 0x7fc35c1084b0 2024-08-20T01:35:48.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.466+0000 7fc3597fa640 1 --2- 172.21.15.79:0/2353252466 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc3440b3c60 0x7fc3440b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:48.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.466+0000 7fc35bfff640 1 --2- 172.21.15.79:0/2353252466 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc3440b3c60 0x7fc3440b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:48.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.466+0000 7fc3597fa640 1 -- 172.21.15.79:0/2353252466 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7fc3500e3db0 con 0x7fc35c1084b0 2024-08-20T01:35:48.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.467+0000 7fc35bfff640 1 --2- 172.21.15.79:0/2353252466 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc3440b3c60 0x7fc3440b6120 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc34c000c00 tx=0x7fc34c032c40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:48.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.469+0000 7fc3597fa640 1 -- 172.21.15.79:0/2353252466 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fc350014030 con 0x7fc35c1084b0 2024-08-20T01:35:48.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.654+0000 7fc362938640 1 -- 172.21.15.79:0/2353252466 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fc35c199fe0 con 0x7fc35c1084b0 2024-08-20T01:35:48.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.655+0000 7fc3597fa640 1 -- 172.21.15.79:0/2353252466 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc3500ab450 con 0x7fc35c1084b0 2024-08-20T01:35:48.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.657+0000 7fc362938640 1 -- 172.21.15.79:0/2353252466 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc3440b3c60 msgr2=0x7fc3440b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:48.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.657+0000 7fc362938640 1 --2- 172.21.15.79:0/2353252466 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc3440b3c60 0x7fc3440b6120 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc34c000c00 tx=0x7fc34c032c40 comp rx=0 tx=0).stop 2024-08-20T01:35:48.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.657+0000 7fc362938640 1 -- 172.21.15.79:0/2353252466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc35c1084b0 msgr2=0x7fc35c1993f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:48.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.657+0000 7fc362938640 1 --2- 172.21.15.79:0/2353252466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc35c1084b0 0x7fc35c1993f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc35000c890 tx=0x7fc35000cd50 comp rx=0 tx=0).stop 2024-08-20T01:35:48.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.657+0000 7fc362938640 1 -- 172.21.15.79:0/2353252466 shutdown_connections 2024-08-20T01:35:48.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.657+0000 7fc362938640 1 --2- 172.21.15.79:0/2353252466 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc3440b3c60 0x7fc3440b6120 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:48.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.657+0000 7fc362938640 1 --2- 172.21.15.79:0/2353252466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc35c108e30 0x7fc35c19e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:48.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.657+0000 7fc362938640 1 --2- 172.21.15.79:0/2353252466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc35c1084b0 0x7fc35c1993f0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:48.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.657+0000 7fc362938640 1 --2- 172.21.15.79:0/2353252466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc35c102aa0 0x7fc35c198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:48.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.657+0000 7fc362938640 1 -- 172.21.15.79:0/2353252466 >> 172.21.15.79:0/2353252466 conn(0x7fc35c0fe550 msgr2=0x7fc35c0fff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:48.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.657+0000 7fc362938640 1 -- 172.21.15.79:0/2353252466 shutdown_connections 2024-08-20T01:35:48.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:48.657+0000 7fc362938640 1 -- 172.21.15.79:0/2353252466 wait complete. 2024-08-20T01:35:49.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:48 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/3596601262' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-08-20T01:35:49.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:48 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2353252466' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-08-20T01:35:49.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:48 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2517369705' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-08-20T01:35:49.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:48 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/3596601262' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-08-20T01:35:49.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:48 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2353252466' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-08-20T01:35:49.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:48 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2517369705' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-08-20T01:35:49.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:48 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/3596601262' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-08-20T01:35:49.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:48 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2353252466' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-08-20T01:35:49.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:48 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2517369705' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-08-20T01:35:49.823 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444095 got 73014444098 for osd.2 2024-08-20T01:35:49.823 DEBUG:teuthology.parallel:result is None 2024-08-20T01:35:50.118 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:49 smithi081 ceph-mon[22209]: pgmap v300: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-08-20T01:35:50.118 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:49 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:35:50.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:49 smithi175 ceph-mon[22392]: pgmap v300: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-08-20T01:35:50.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:49 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:35:50.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:49 smithi079 ceph-mon[18656]: pgmap v300: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-08-20T01:35:50.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:49 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:35:50.789 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724591 got 167503724592 for osd.6 2024-08-20T01:35:50.789 DEBUG:teuthology.parallel:result is None 2024-08-20T01:35:51.191 INFO:tasks.cephadm.ceph_manager.ceph:need seq 261993005083 got 261993005085 for osd.10 2024-08-20T01:35:51.191 DEBUG:teuthology.parallel:result is None 2024-08-20T01:35:51.600 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:51.601 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:51.601 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:51.606 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:51.609 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:51.610 INFO:tasks.cephadm.ceph_manager.ceph:need seq 120259084342 got 120259084345 for osd.4 2024-08-20T01:35:51.611 DEBUG:teuthology.parallel:result is None 2024-08-20T01:35:51.880 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:51 smithi079 ceph-mon[18656]: pgmap v301: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-20T01:35:51.880 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:51 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:35:51.880 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:51 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:35:51.880 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:51 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:35:51.880 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:51 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:35:51.881 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:52.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:51 smithi081 ceph-mon[22209]: pgmap v301: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-20T01:35:52.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:51 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:35:52.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:51 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:35:52.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:51 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:35:52.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:51 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:35:52.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:51 smithi175 ceph-mon[22392]: pgmap v301: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-20T01:35:52.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:51 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:35:52.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:51 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:35:52.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:51 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:35:52.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:51 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:35:52.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.564+0000 7f89bd2ca640 1 -- 172.21.15.79:0/3736332245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89b8107d60 msgr2=0x7f89b810e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:52.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.564+0000 7f89bd2ca640 1 --2- 172.21.15.79:0/3736332245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89b8107d60 0x7f89b810e560 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f89b0009ca0 tx=0x7f89b002a8c0 comp rx=0 tx=0).stop 2024-08-20T01:35:52.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.564+0000 7f89bd2ca640 1 -- 172.21.15.79:0/3736332245 shutdown_connections 2024-08-20T01:35:52.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.564+0000 7f89bd2ca640 1 --2- 172.21.15.79:0/3736332245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89b8107d60 0x7f89b810e560 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:52.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.564+0000 7f89bd2ca640 1 --2- 172.21.15.79:0/3736332245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89b81073e0 0x7f89b8107820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:52.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.564+0000 7f89bd2ca640 1 --2- 172.21.15.79:0/3736332245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89b81019d0 0x7f89b8101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:52.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.564+0000 7f89bd2ca640 1 -- 172.21.15.79:0/3736332245 >> 172.21.15.79:0/3736332245 conn(0x7f89b80fd440 msgr2=0x7f89b80ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:52.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.564+0000 7f89bd2ca640 1 -- 172.21.15.79:0/3736332245 shutdown_connections 2024-08-20T01:35:52.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.564+0000 7f89bd2ca640 1 -- 172.21.15.79:0/3736332245 wait complete. 2024-08-20T01:35:52.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.565+0000 7f89bd2ca640 1 Processor -- start 2024-08-20T01:35:52.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.565+0000 7f89bd2ca640 1 -- start start 2024-08-20T01:35:52.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.565+0000 7f89bd2ca640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89b81019d0 0x7f89b8198fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:52.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.565+0000 7f89bd2ca640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89b81073e0 0x7f89b81994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:52.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.565+0000 7f89bd2ca640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89b8107d60 0x7f89b819e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:52.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.565+0000 7f89bd2ca640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f89b8111960 con 0x7f89b81019d0 2024-08-20T01:35:52.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.565+0000 7f89bd2ca640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f89b81117e0 con 0x7f89b8107d60 2024-08-20T01:35:52.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.565+0000 7f89bd2ca640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f89b8111ae0 con 0x7f89b81073e0 2024-08-20T01:35:52.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.565+0000 7f89b6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89b81019d0 0x7f89b8198fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:52.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.566+0000 7f89b6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89b81019d0 0x7f89b8198fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52070/0 (socket says 172.21.15.79:52070) 2024-08-20T01:35:52.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.566+0000 7f89b6ffd640 1 -- 172.21.15.79:0/3840764930 learned_addr learned my addr 172.21.15.79:0/3840764930 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:35:52.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.566+0000 7f89ae7fc640 1 --2- 172.21.15.79:0/3840764930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89b81073e0 0x7f89b81994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:52.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.566+0000 7f89b77fe640 1 --2- 172.21.15.79:0/3840764930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89b8107d60 0x7f89b819e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:52.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.566+0000 7f89b6ffd640 1 -- 172.21.15.79:0/3840764930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89b81073e0 msgr2=0x7f89b81994f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:52.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.566+0000 7f89b6ffd640 1 --2- 172.21.15.79:0/3840764930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89b81073e0 0x7f89b81994f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:52.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.566+0000 7f89b6ffd640 1 -- 172.21.15.79:0/3840764930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89b8107d60 msgr2=0x7f89b819e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:52.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.566+0000 7f89b6ffd640 1 --2- 172.21.15.79:0/3840764930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89b8107d60 0x7f89b819e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:52.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.566+0000 7f89b6ffd640 1 -- 172.21.15.79:0/3840764930 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89b819f060 con 0x7f89b81019d0 2024-08-20T01:35:52.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.566+0000 7f89b77fe640 1 --2- 172.21.15.79:0/3840764930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89b8107d60 0x7f89b819e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:35:52.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.566+0000 7f89b6ffd640 1 --2- 172.21.15.79:0/3840764930 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89b81019d0 0x7f89b8198fb0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f89a800b4a0 tx=0x7f89a800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:52.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.566+0000 7f89b4ff9640 1 -- 172.21.15.79:0/3840764930 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a8015020 con 0x7f89b81019d0 2024-08-20T01:35:52.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.566+0000 7f89b4ff9640 1 -- 172.21.15.79:0/3840764930 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f89a8011cc0 con 0x7f89b81019d0 2024-08-20T01:35:52.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.566+0000 7f89b4ff9640 1 -- 172.21.15.79:0/3840764930 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a8010d00 con 0x7f89b81019d0 2024-08-20T01:35:52.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.566+0000 7f89bd2ca640 1 -- 172.21.15.79:0/3840764930 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89b819f350 con 0x7f89b81019d0 2024-08-20T01:35:52.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.566+0000 7f89bd2ca640 1 -- 172.21.15.79:0/3840764930 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89b81a5a90 con 0x7f89b81019d0 2024-08-20T01:35:52.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.567+0000 7f89bd2ca640 1 -- 172.21.15.79:0/3840764930 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89b8101db0 con 0x7f89b81019d0 2024-08-20T01:35:52.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.569+0000 7f89b4ff9640 1 -- 172.21.15.79:0/3840764930 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f89a8018020 con 0x7f89b81019d0 2024-08-20T01:35:52.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.570+0000 7f89b4ff9640 1 --2- 172.21.15.79:0/3840764930 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f89a40b3c60 0x7f89a40b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:52.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.570+0000 7f89ae7fc640 1 --2- 172.21.15.79:0/3840764930 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f89a40b3c60 0x7f89a40b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:52.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.570+0000 7f89b4ff9640 1 -- 172.21.15.79:0/3840764930 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7979+0+0 (secure 0 0 0) 0x7f89a80e3940 con 0x7f89b81019d0 2024-08-20T01:35:52.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.571+0000 7f89ae7fc640 1 --2- 172.21.15.79:0/3840764930 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f89a40b3c60 0x7f89a40b6120 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f89b8103cc0 tx=0x7f89a0009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:52.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.573+0000 7f89b4ff9640 1 -- 172.21.15.79:0/3840764930 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f89a801f020 con 0x7f89b81019d0 2024-08-20T01:35:52.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.754+0000 7f89bd2ca640 1 -- 172.21.15.79:0/3840764930 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f89b81a5eb0 con 0x7f89b81019d0 2024-08-20T01:35:52.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.754+0000 7f89b4ff9640 1 -- 172.21.15.79:0/3840764930 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f89a80ab0f0 con 0x7f89b81019d0 2024-08-20T01:35:52.755 INFO:teuthology.orchestra.run.smithi079.stdout:55834574920 2024-08-20T01:35:52.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.757+0000 7f89bd2ca640 1 -- 172.21.15.79:0/3840764930 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f89a40b3c60 msgr2=0x7f89a40b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:52.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.757+0000 7f89bd2ca640 1 --2- 172.21.15.79:0/3840764930 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f89a40b3c60 0x7f89a40b6120 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f89b8103cc0 tx=0x7f89a0009110 comp rx=0 tx=0).stop 2024-08-20T01:35:52.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.757+0000 7f89bd2ca640 1 -- 172.21.15.79:0/3840764930 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89b81019d0 msgr2=0x7f89b8198fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:52.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.757+0000 7f89bd2ca640 1 --2- 172.21.15.79:0/3840764930 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89b81019d0 0x7f89b8198fb0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f89a800b4a0 tx=0x7f89a800b8a0 comp rx=0 tx=0).stop 2024-08-20T01:35:52.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.757+0000 7f89bd2ca640 1 -- 172.21.15.79:0/3840764930 shutdown_connections 2024-08-20T01:35:52.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.757+0000 7f89bd2ca640 1 --2- 172.21.15.79:0/3840764930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89b8107d60 0x7f89b819e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:52.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.757+0000 7f89bd2ca640 1 --2- 172.21.15.79:0/3840764930 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f89a40b3c60 0x7f89a40b6120 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:52.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.757+0000 7f89bd2ca640 1 --2- 172.21.15.79:0/3840764930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89b81073e0 0x7f89b81994f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:52.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.757+0000 7f89bd2ca640 1 --2- 172.21.15.79:0/3840764930 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89b81019d0 0x7f89b8198fb0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:52.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.757+0000 7f89bd2ca640 1 -- 172.21.15.79:0/3840764930 >> 172.21.15.79:0/3840764930 conn(0x7f89b80fd440 msgr2=0x7f89b81003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:52.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.757+0000 7f89bd2ca640 1 -- 172.21.15.79:0/3840764930 shutdown_connections 2024-08-20T01:35:52.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.757+0000 7f89bd2ca640 1 -- 172.21.15.79:0/3840764930 wait complete. 2024-08-20T01:35:52.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.832+0000 7fd4bca6f640 1 -- 172.21.15.79:0/712802142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4b8101990 msgr2=0x7fd4b8101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:52.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.832+0000 7fd4bca6f640 1 --2- 172.21.15.79:0/712802142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4b8101990 0x7fd4b8101d70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8009900 tx=0x7fd4a802a410 comp rx=0 tx=0).stop 2024-08-20T01:35:52.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.832+0000 7fd4bca6f640 1 -- 172.21.15.79:0/712802142 shutdown_connections 2024-08-20T01:35:52.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.832+0000 7fd4bca6f640 1 --2- 172.21.15.79:0/712802142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4b8107d20 0x7fd4b810e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:52.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.832+0000 7fd4bca6f640 1 --2- 172.21.15.79:0/712802142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4b81073a0 0x7fd4b81077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:52.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.832+0000 7fd4bca6f640 1 --2- 172.21.15.79:0/712802142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4b8101990 0x7fd4b8101d70 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:52.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.832+0000 7fd4bca6f640 1 -- 172.21.15.79:0/712802142 >> 172.21.15.79:0/712802142 conn(0x7fd4b80fd400 msgr2=0x7fd4b80ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:52.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.832+0000 7fd4bca6f640 1 -- 172.21.15.79:0/712802142 shutdown_connections 2024-08-20T01:35:52.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.832+0000 7fd4bca6f640 1 -- 172.21.15.79:0/712802142 wait complete. 2024-08-20T01:35:52.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.833+0000 7fd4bca6f640 1 Processor -- start 2024-08-20T01:35:52.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.833+0000 7fd4bca6f640 1 -- start start 2024-08-20T01:35:52.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.833+0000 7fd4bca6f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4b8101990 0x7fd4b8197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:52.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.833+0000 7fd4bca6f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4b81073a0 0x7fd4b8198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:52.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.833+0000 7fd4bca6f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4b8107d20 0x7fd4b819d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:52.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.833+0000 7fd4bca6f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b81118d0 con 0x7fd4b81073a0 2024-08-20T01:35:52.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.833+0000 7fd4bca6f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b8111750 con 0x7fd4b8101990 2024-08-20T01:35:52.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.833+0000 7fd4bca6f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b8111a50 con 0x7fd4b8107d20 2024-08-20T01:35:52.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.833+0000 7fd4b5d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4b81073a0 0x7fd4b8198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:52.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.833+0000 7fd4b5d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4b81073a0 0x7fd4b8198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52084/0 (socket says 172.21.15.79:52084) 2024-08-20T01:35:52.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.833+0000 7fd4b5d9b640 1 -- 172.21.15.79:0/3508103297 learned_addr learned my addr 172.21.15.79:0/3508103297 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:35:52.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.834+0000 7fd4b6d9d640 1 --2- 172.21.15.79:0/3508103297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4b8107d20 0x7fd4b819d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:52.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.834+0000 7fd4b659c640 1 --2- 172.21.15.79:0/3508103297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4b8101990 0x7fd4b8197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:52.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.834+0000 7fd4b5d9b640 1 -- 172.21.15.79:0/3508103297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4b8107d20 msgr2=0x7fd4b819d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:52.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.834+0000 7fd4b5d9b640 1 --2- 172.21.15.79:0/3508103297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4b8107d20 0x7fd4b819d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:52.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.834+0000 7fd4b5d9b640 1 -- 172.21.15.79:0/3508103297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4b8101990 msgr2=0x7fd4b8197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:52.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.834+0000 7fd4b5d9b640 1 --2- 172.21.15.79:0/3508103297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4b8101990 0x7fd4b8197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:52.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.834+0000 7fd4b5d9b640 1 -- 172.21.15.79:0/3508103297 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4b819dfd0 con 0x7fd4b81073a0 2024-08-20T01:35:52.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.834+0000 7fd4b659c640 1 --2- 172.21.15.79:0/3508103297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4b8101990 0x7fd4b8197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:35:52.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.834+0000 7fd4b5d9b640 1 --2- 172.21.15.79:0/3508103297 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4b81073a0 0x7fd4b8198460 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac00b4a0 tx=0x7fd4ac00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:52.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.834+0000 7fd4a77fe640 1 -- 172.21.15.79:0/3508103297 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac014070 con 0x7fd4b81073a0 2024-08-20T01:35:52.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.834+0000 7fd4a77fe640 1 -- 172.21.15.79:0/3508103297 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4ac010aa0 con 0x7fd4b81073a0 2024-08-20T01:35:52.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.834+0000 7fd4bca6f640 1 -- 172.21.15.79:0/3508103297 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4b819e2c0 con 0x7fd4b81073a0 2024-08-20T01:35:52.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.834+0000 7fd4a77fe640 1 -- 172.21.15.79:0/3508103297 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac017b70 con 0x7fd4b81073a0 2024-08-20T01:35:52.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.834+0000 7fd4bca6f640 1 -- 172.21.15.79:0/3508103297 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4b81a4b50 con 0x7fd4b81073a0 2024-08-20T01:35:52.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.835+0000 7fd4bca6f640 1 -- 172.21.15.79:0/3508103297 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4b8101df0 con 0x7fd4b81073a0 2024-08-20T01:35:52.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.837+0000 7fd4a77fe640 1 -- 172.21.15.79:0/3508103297 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fd4ac017070 con 0x7fd4b81073a0 2024-08-20T01:35:52.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.837+0000 7fd4a77fe640 1 --2- 172.21.15.79:0/3508103297 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd4a00b3ce0 0x7fd4a00b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:52.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.837+0000 7fd4b659c640 1 --2- 172.21.15.79:0/3508103297 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd4a00b3ce0 0x7fd4a00b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:52.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.837+0000 7fd4a77fe640 1 -- 172.21.15.79:0/3508103297 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7fd4ac0e3340 con 0x7fd4b81073a0 2024-08-20T01:35:52.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.838+0000 7fd4b659c640 1 --2- 172.21.15.79:0/3508103297 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd4a00b3ce0 0x7fd4a00b61a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8000c00 tx=0x7fd4a8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:52.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:52.840+0000 7fd4a77fe640 1 -- 172.21.15.79:0/3508103297 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fd4ac0aa950 con 0x7fd4b81073a0 2024-08-20T01:35:53.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.017+0000 7fd4bca6f640 1 -- 172.21.15.79:0/3508103297 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fd4b8199050 con 0x7fd4b81073a0 2024-08-20T01:35:53.019 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:52 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]} : dispatch 2024-08-20T01:35:53.019 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:52 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]} : dispatch 2024-08-20T01:35:53.019 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:52 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 7]} : dispatch 2024-08-20T01:35:53.019 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:52 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]} : dispatch 2024-08-20T01:35:53.019 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:52 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]} : dispatch 2024-08-20T01:35:53.019 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:52 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]} : dispatch 2024-08-20T01:35:53.020 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:52 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]} : dispatch 2024-08-20T01:35:53.020 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:52 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]} : dispatch 2024-08-20T01:35:53.020 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:52 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/3840764930' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-08-20T01:35:53.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.018+0000 7fd4a77fe640 1 -- 172.21.15.79:0/3508103297 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fd4b8199050 con 0x7fd4b81073a0 2024-08-20T01:35:53.020 INFO:teuthology.orchestra.run.smithi079.stdout:283467841561 2024-08-20T01:35:53.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.020+0000 7fd4bca6f640 1 -- 172.21.15.79:0/3508103297 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd4a00b3ce0 msgr2=0x7fd4a00b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:53.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.020+0000 7fd4bca6f640 1 --2- 172.21.15.79:0/3508103297 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd4a00b3ce0 0x7fd4a00b61a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8000c00 tx=0x7fd4a8005a20 comp rx=0 tx=0).stop 2024-08-20T01:35:53.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.020+0000 7fd4bca6f640 1 -- 172.21.15.79:0/3508103297 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4b81073a0 msgr2=0x7fd4b8198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:53.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.020+0000 7fd4bca6f640 1 --2- 172.21.15.79:0/3508103297 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4b81073a0 0x7fd4b8198460 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac00b4a0 tx=0x7fd4ac00b960 comp rx=0 tx=0).stop 2024-08-20T01:35:53.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.020+0000 7fd4bca6f640 1 -- 172.21.15.79:0/3508103297 shutdown_connections 2024-08-20T01:35:53.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.020+0000 7fd4bca6f640 1 --2- 172.21.15.79:0/3508103297 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd4a00b3ce0 0x7fd4a00b61a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:53.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.020+0000 7fd4bca6f640 1 --2- 172.21.15.79:0/3508103297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4b8107d20 0x7fd4b819d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:53.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.020+0000 7fd4bca6f640 1 --2- 172.21.15.79:0/3508103297 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4b81073a0 0x7fd4b8198460 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:53.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.020+0000 7fd4bca6f640 1 --2- 172.21.15.79:0/3508103297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4b8101990 0x7fd4b8197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:53.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.020+0000 7fd4bca6f640 1 -- 172.21.15.79:0/3508103297 >> 172.21.15.79:0/3508103297 conn(0x7fd4b80fd400 msgr2=0x7fd4b80ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:53.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.020+0000 7fd4bca6f640 1 -- 172.21.15.79:0/3508103297 shutdown_connections 2024-08-20T01:35:53.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.020+0000 7fd4bca6f640 1 -- 172.21.15.79:0/3508103297 wait complete. 2024-08-20T01:35:53.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:52 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]} : dispatch 2024-08-20T01:35:53.027 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:52 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]} : dispatch 2024-08-20T01:35:53.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:52 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 7]} : dispatch 2024-08-20T01:35:53.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:52 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]} : dispatch 2024-08-20T01:35:53.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:52 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]} : dispatch 2024-08-20T01:35:53.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:52 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]} : dispatch 2024-08-20T01:35:53.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:52 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]} : dispatch 2024-08-20T01:35:53.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:52 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]} : dispatch 2024-08-20T01:35:53.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:52 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/3840764930' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-08-20T01:35:53.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:52 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]} : dispatch 2024-08-20T01:35:53.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:52 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]} : dispatch 2024-08-20T01:35:53.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:52 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 7]} : dispatch 2024-08-20T01:35:53.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:52 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]} : dispatch 2024-08-20T01:35:53.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:52 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]} : dispatch 2024-08-20T01:35:53.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:52 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]} : dispatch 2024-08-20T01:35:53.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:52 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]} : dispatch 2024-08-20T01:35:53.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:52 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]} : dispatch 2024-08-20T01:35:53.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:52 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/3840764930' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-08-20T01:35:53.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.638+0000 7f847604f640 1 -- 172.21.15.79:0/3535010100 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8470103860 msgr2=0x7f8470103c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:53.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.638+0000 7f847604f640 1 --2- 172.21.15.79:0/3535010100 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8470103860 0x7f8470103c40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8460009900 tx=0x7f846002a410 comp rx=0 tx=0).stop 2024-08-20T01:35:53.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.638+0000 7f847604f640 1 -- 172.21.15.79:0/3535010100 shutdown_connections 2024-08-20T01:35:53.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.638+0000 7f847604f640 1 --2- 172.21.15.79:0/3535010100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f847010ce10 0x7f847010f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:53.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.638+0000 7f847604f640 1 --2- 172.21.15.79:0/3535010100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8470104260 0x7f847010c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:53.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.638+0000 7f847604f640 1 --2- 172.21.15.79:0/3535010100 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8470103860 0x7f8470103c40 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:53.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.638+0000 7f847604f640 1 -- 172.21.15.79:0/3535010100 >> 172.21.15.79:0/3535010100 conn(0x7f84700fd410 msgr2=0x7f84700ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:53.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.638+0000 7f847604f640 1 -- 172.21.15.79:0/3535010100 shutdown_connections 2024-08-20T01:35:53.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.638+0000 7f847604f640 1 -- 172.21.15.79:0/3535010100 wait complete. 2024-08-20T01:35:53.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.639+0000 7f847604f640 1 Processor -- start 2024-08-20T01:35:53.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.639+0000 7f847604f640 1 -- start start 2024-08-20T01:35:53.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.639+0000 7f847604f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8470103860 0x7f8470199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:53.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.639+0000 7f847604f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8470104260 0x7f84701998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:53.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.639+0000 7f847604f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f847010ce10 0x7f847019ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:53.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.639+0000 7f847604f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8470112a00 con 0x7f8470104260 2024-08-20T01:35:53.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.639+0000 7f847604f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8470112880 con 0x7f8470103860 2024-08-20T01:35:53.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.639+0000 7f847604f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8470112b80 con 0x7f847010ce10 2024-08-20T01:35:53.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.639+0000 7f8467fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8470104260 0x7f84701998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:53.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.639+0000 7f8467fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8470104260 0x7f84701998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52096/0 (socket says 172.21.15.79:52096) 2024-08-20T01:35:53.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.639+0000 7f8467fff640 1 -- 172.21.15.79:0/84964540 learned_addr learned my addr 172.21.15.79:0/84964540 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:35:53.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.639+0000 7f846f7fe640 1 --2- 172.21.15.79:0/84964540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8470103860 0x7f8470199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:53.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.639+0000 7f846ffff640 1 --2- 172.21.15.79:0/84964540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f847010ce10 0x7f847019ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:53.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.639+0000 7f8467fff640 1 -- 172.21.15.79:0/84964540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f847010ce10 msgr2=0x7f847019ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:53.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.639+0000 7f8467fff640 1 --2- 172.21.15.79:0/84964540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f847010ce10 0x7f847019ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:53.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.639+0000 7f8467fff640 1 -- 172.21.15.79:0/84964540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8470103860 msgr2=0x7f8470199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:53.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.639+0000 7f8467fff640 1 --2- 172.21.15.79:0/84964540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8470103860 0x7f8470199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:53.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.639+0000 7f8467fff640 1 -- 172.21.15.79:0/84964540 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f847019f420 con 0x7f8470104260 2024-08-20T01:35:53.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.639+0000 7f846ffff640 1 --2- 172.21.15.79:0/84964540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f847010ce10 0x7f847019ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:35:53.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.639+0000 7f846f7fe640 1 --2- 172.21.15.79:0/84964540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8470103860 0x7f8470199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:35:53.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.640+0000 7f8467fff640 1 --2- 172.21.15.79:0/84964540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8470104260 0x7f84701998b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f845800b4a0 tx=0x7f845800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:53.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.640+0000 7f846d7fa640 1 -- 172.21.15.79:0/84964540 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8458014070 con 0x7f8470104260 2024-08-20T01:35:53.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.640+0000 7f846d7fa640 1 -- 172.21.15.79:0/84964540 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8458010aa0 con 0x7f8470104260 2024-08-20T01:35:53.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.640+0000 7f847604f640 1 -- 172.21.15.79:0/84964540 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f847019f710 con 0x7f8470104260 2024-08-20T01:35:53.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.640+0000 7f846d7fa640 1 -- 172.21.15.79:0/84964540 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8458017b70 con 0x7f8470104260 2024-08-20T01:35:53.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.640+0000 7f847604f640 1 -- 172.21.15.79:0/84964540 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84701a5fa0 con 0x7f8470104260 2024-08-20T01:35:53.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.641+0000 7f847604f640 1 -- 172.21.15.79:0/84964540 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8470103cc0 con 0x7f8470104260 2024-08-20T01:35:53.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.642+0000 7f846d7fa640 1 -- 172.21.15.79:0/84964540 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f8458017070 con 0x7f8470104260 2024-08-20T01:35:53.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.643+0000 7f846d7fa640 1 --2- 172.21.15.79:0/84964540 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f845c0b3ce0 0x7f845c0b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:53.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.643+0000 7f846f7fe640 1 --2- 172.21.15.79:0/84964540 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f845c0b3ce0 0x7f845c0b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:53.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.643+0000 7f846d7fa640 1 -- 172.21.15.79:0/84964540 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8211+0+0 (secure 0 0 0) 0x7f84580e33a0 con 0x7f8470104260 2024-08-20T01:35:53.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.643+0000 7f846f7fe640 1 --2- 172.21.15.79:0/84964540 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f845c0b3ce0 0x7f845c0b61a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8460000c00 tx=0x7f8460005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:53.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.647+0000 7f846d7fa640 1 -- 172.21.15.79:0/84964540 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f84580aa9b0 con 0x7f8470104260 2024-08-20T01:35:53.658 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:35:53.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.840+0000 7f847604f640 1 -- 172.21.15.79:0/84964540 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f847006ae90 con 0x7f8470104260 2024-08-20T01:35:53.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.840+0000 7f846d7fa640 1 -- 172.21.15.79:0/84964540 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f84580aa2b0 con 0x7f8470104260 2024-08-20T01:35:53.842 INFO:teuthology.orchestra.run.smithi079.stdout:34359738445 2024-08-20T01:35:53.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.842+0000 7f847604f640 1 -- 172.21.15.79:0/84964540 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f845c0b3ce0 msgr2=0x7f845c0b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:53.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.842+0000 7f847604f640 1 --2- 172.21.15.79:0/84964540 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f845c0b3ce0 0x7f845c0b61a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8460000c00 tx=0x7f8460005a20 comp rx=0 tx=0).stop 2024-08-20T01:35:53.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.842+0000 7f847604f640 1 -- 172.21.15.79:0/84964540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8470104260 msgr2=0x7f84701998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:53.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.842+0000 7f847604f640 1 --2- 172.21.15.79:0/84964540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8470104260 0x7f84701998b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f845800b4a0 tx=0x7f845800b960 comp rx=0 tx=0).stop 2024-08-20T01:35:53.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.842+0000 7f847604f640 1 -- 172.21.15.79:0/84964540 shutdown_connections 2024-08-20T01:35:53.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.842+0000 7f847604f640 1 --2- 172.21.15.79:0/84964540 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f845c0b3ce0 0x7f845c0b61a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:53.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.842+0000 7f847604f640 1 --2- 172.21.15.79:0/84964540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f847010ce10 0x7f847019ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:53.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.842+0000 7f847604f640 1 --2- 172.21.15.79:0/84964540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8470104260 0x7f84701998b0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:53.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.842+0000 7f847604f640 1 --2- 172.21.15.79:0/84964540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8470103860 0x7f8470199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:53.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.842+0000 7f847604f640 1 -- 172.21.15.79:0/84964540 >> 172.21.15.79:0/84964540 conn(0x7f84700fd410 msgr2=0x7f84700fe490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:53.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.842+0000 7f847604f640 1 -- 172.21.15.79:0/84964540 shutdown_connections 2024-08-20T01:35:53.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:53.843+0000 7f847604f640 1 -- 172.21.15.79:0/84964540 wait complete. 2024-08-20T01:35:54.011 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:53 smithi079 ceph-mon[18656]: pgmap v302: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-08-20T01:35:54.011 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:53 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-08-20T01:35:54.011 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:53 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-08-20T01:35:54.011 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:53 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 7]}]': finished 2024-08-20T01:35:54.011 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:53 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-08-20T01:35:54.011 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:53 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]}]': finished 2024-08-20T01:35:54.011 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:53 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]': finished 2024-08-20T01:35:54.012 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:53 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-08-20T01:35:54.012 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:53 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-08-20T01:35:54.012 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:53 smithi079 ceph-mon[18656]: osdmap e73: 12 total, 12 up, 12 in 2024-08-20T01:35:54.012 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:53 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/3508103297' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-08-20T01:35:54.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:53 smithi175 ceph-mon[22392]: pgmap v302: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-08-20T01:35:54.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:53 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-08-20T01:35:54.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:53 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-08-20T01:35:54.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:53 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 7]}]': finished 2024-08-20T01:35:54.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:53 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-08-20T01:35:54.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:53 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]}]': finished 2024-08-20T01:35:54.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:53 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]': finished 2024-08-20T01:35:54.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:53 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-08-20T01:35:54.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:53 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-08-20T01:35:54.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:53 smithi175 ceph-mon[22392]: osdmap e73: 12 total, 12 up, 12 in 2024-08-20T01:35:54.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:53 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/3508103297' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-08-20T01:35:54.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:53 smithi081 ceph-mon[22209]: pgmap v302: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-08-20T01:35:54.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:53 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-08-20T01:35:54.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:53 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-08-20T01:35:54.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:53 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 7]}]': finished 2024-08-20T01:35:54.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:53 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-08-20T01:35:54.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:53 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]}]': finished 2024-08-20T01:35:54.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:53 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]': finished 2024-08-20T01:35:54.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:53 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-08-20T01:35:54.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:53 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-08-20T01:35:54.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:53 smithi081 ceph-mon[22209]: osdmap e73: 12 total, 12 up, 12 in 2024-08-20T01:35:54.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:53 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/3508103297' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-08-20T01:35:54.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.547+0000 7fad3bf3f640 1 -- 172.21.15.79:0/4284342233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad341042c0 msgr2=0x7fad3410c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:54.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.547+0000 7fad3bf3f640 1 --2- 172.21.15.79:0/4284342233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad341042c0 0x7fad3410c7b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fad24009900 tx=0x7fad2402a410 comp rx=0 tx=0).stop 2024-08-20T01:35:54.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.547+0000 7fad3bf3f640 1 -- 172.21.15.79:0/4284342233 shutdown_connections 2024-08-20T01:35:54.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.547+0000 7fad3bf3f640 1 --2- 172.21.15.79:0/4284342233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad3410ce00 0x7fad3410f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:54.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.547+0000 7fad3bf3f640 1 --2- 172.21.15.79:0/4284342233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad341042c0 0x7fad3410c7b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:54.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.547+0000 7fad3bf3f640 1 --2- 172.21.15.79:0/4284342233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad341039a0 0x7fad34103d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:54.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.547+0000 7fad3bf3f640 1 -- 172.21.15.79:0/4284342233 >> 172.21.15.79:0/4284342233 conn(0x7fad340fd400 msgr2=0x7fad340ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:54.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.547+0000 7fad3bf3f640 1 -- 172.21.15.79:0/4284342233 shutdown_connections 2024-08-20T01:35:54.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.547+0000 7fad3bf3f640 1 -- 172.21.15.79:0/4284342233 wait complete. 2024-08-20T01:35:54.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.548+0000 7fad3bf3f640 1 Processor -- start 2024-08-20T01:35:54.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.548+0000 7fad3bf3f640 1 -- start start 2024-08-20T01:35:54.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.548+0000 7fad3bf3f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad341039a0 0x7fad34199010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:54.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.548+0000 7fad3bf3f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad341042c0 0x7fad34199550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:54.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.548+0000 7fad3bf3f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad3410ce00 0x7fad3419e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:54.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.548+0000 7fad3bf3f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fad341129e0 con 0x7fad341039a0 2024-08-20T01:35:54.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.548+0000 7fad3bf3f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fad34112860 con 0x7fad3410ce00 2024-08-20T01:35:54.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.548+0000 7fad3bf3f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fad34112b60 con 0x7fad341042c0 2024-08-20T01:35:54.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.548+0000 7fad39cdb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad341039a0 0x7fad34199010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:54.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.548+0000 7fad39cdb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad341039a0 0x7fad34199010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52128/0 (socket says 172.21.15.79:52128) 2024-08-20T01:35:54.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.548+0000 7fad39cdb640 1 -- 172.21.15.79:0/151431668 learned_addr learned my addr 172.21.15.79:0/151431668 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:35:54.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.548+0000 7fad394da640 1 --2- 172.21.15.79:0/151431668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad341042c0 0x7fad34199550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:54.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.549+0000 7fad3a4dc640 1 --2- 172.21.15.79:0/151431668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad3410ce00 0x7fad3419e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:54.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.549+0000 7fad39cdb640 1 -- 172.21.15.79:0/151431668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad341042c0 msgr2=0x7fad34199550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:54.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.549+0000 7fad39cdb640 1 --2- 172.21.15.79:0/151431668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad341042c0 0x7fad34199550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:54.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.549+0000 7fad39cdb640 1 -- 172.21.15.79:0/151431668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad3410ce00 msgr2=0x7fad3419e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:54.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.549+0000 7fad39cdb640 1 --2- 172.21.15.79:0/151431668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad3410ce00 0x7fad3419e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:54.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.549+0000 7fad39cdb640 1 -- 172.21.15.79:0/151431668 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad3419f0c0 con 0x7fad341039a0 2024-08-20T01:35:54.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.549+0000 7fad39cdb640 1 --2- 172.21.15.79:0/151431668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad341039a0 0x7fad34199010 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fad3000b4a0 tx=0x7fad3000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:54.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.549+0000 7fad2affd640 1 -- 172.21.15.79:0/151431668 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad30014070 con 0x7fad341039a0 2024-08-20T01:35:54.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.549+0000 7fad3bf3f640 1 -- 172.21.15.79:0/151431668 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad3419f3b0 con 0x7fad341039a0 2024-08-20T01:35:54.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.549+0000 7fad2affd640 1 -- 172.21.15.79:0/151431668 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fad30010aa0 con 0x7fad341039a0 2024-08-20T01:35:54.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.549+0000 7fad2affd640 1 -- 172.21.15.79:0/151431668 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad30017b70 con 0x7fad341039a0 2024-08-20T01:35:54.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.549+0000 7fad3bf3f640 1 -- 172.21.15.79:0/151431668 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad341a5af0 con 0x7fad341039a0 2024-08-20T01:35:54.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.550+0000 7fad3bf3f640 1 -- 172.21.15.79:0/151431668 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad34103e00 con 0x7fad341039a0 2024-08-20T01:35:54.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.552+0000 7fad2affd640 1 -- 172.21.15.79:0/151431668 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fad30017070 con 0x7fad341039a0 2024-08-20T01:35:54.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.553+0000 7fad2affd640 1 --2- 172.21.15.79:0/151431668 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fad200b3c60 0x7fad200b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:54.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.553+0000 7fad394da640 1 --2- 172.21.15.79:0/151431668 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fad200b3c60 0x7fad200b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:54.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.553+0000 7fad2affd640 1 -- 172.21.15.79:0/151431668 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fad300e3330 con 0x7fad341039a0 2024-08-20T01:35:54.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.554+0000 7fad394da640 1 --2- 172.21.15.79:0/151431668 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fad200b3c60 0x7fad200b6120 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fad24005ec0 tx=0x7fad240058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:54.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.555+0000 7fad2affd640 1 -- 172.21.15.79:0/151431668 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fad300aa940 con 0x7fad341039a0 2024-08-20T01:35:54.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.744+0000 7fad3bf3f640 1 -- 172.21.15.79:0/151431668 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fad3419a140 con 0x7fad341039a0 2024-08-20T01:35:54.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.744+0000 7fad2affd640 1 -- 172.21.15.79:0/151431668 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fad3419a140 con 0x7fad341039a0 2024-08-20T01:35:54.746 INFO:teuthology.orchestra.run.smithi079.stdout:214748364839 2024-08-20T01:35:54.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.746+0000 7fad3bf3f640 1 -- 172.21.15.79:0/151431668 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fad200b3c60 msgr2=0x7fad200b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:54.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.746+0000 7fad3bf3f640 1 --2- 172.21.15.79:0/151431668 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fad200b3c60 0x7fad200b6120 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fad24005ec0 tx=0x7fad240058d0 comp rx=0 tx=0).stop 2024-08-20T01:35:54.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.746+0000 7fad3bf3f640 1 -- 172.21.15.79:0/151431668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad341039a0 msgr2=0x7fad34199010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:54.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.746+0000 7fad3bf3f640 1 --2- 172.21.15.79:0/151431668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad341039a0 0x7fad34199010 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fad3000b4a0 tx=0x7fad3000b960 comp rx=0 tx=0).stop 2024-08-20T01:35:54.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.746+0000 7fad3bf3f640 1 -- 172.21.15.79:0/151431668 shutdown_connections 2024-08-20T01:35:54.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.746+0000 7fad3bf3f640 1 --2- 172.21.15.79:0/151431668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad3410ce00 0x7fad3419e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:54.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.746+0000 7fad3bf3f640 1 --2- 172.21.15.79:0/151431668 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fad200b3c60 0x7fad200b6120 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:54.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.746+0000 7fad3bf3f640 1 --2- 172.21.15.79:0/151431668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad341042c0 0x7fad34199550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:54.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.746+0000 7fad3bf3f640 1 --2- 172.21.15.79:0/151431668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad341039a0 0x7fad34199010 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:54.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.746+0000 7fad3bf3f640 1 -- 172.21.15.79:0/151431668 >> 172.21.15.79:0/151431668 conn(0x7fad340fd400 msgr2=0x7fad340fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:54.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.746+0000 7fad3bf3f640 1 -- 172.21.15.79:0/151431668 shutdown_connections 2024-08-20T01:35:54.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.746+0000 7fad3bf3f640 1 -- 172.21.15.79:0/151431668 wait complete. 2024-08-20T01:35:54.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.453+0000 7f5bf20f6640 1 -- 172.21.15.79:0/692536825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bec075b10 msgr2=0x7f5bec10eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:54.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.453+0000 7f5bf20f6640 1 --2- 172.21.15.79:0/692536825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bec075b10 0x7f5bec10eb80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4009900 tx=0x7f5bd402a410 comp rx=0 tx=0).stop 2024-08-20T01:35:54.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.453+0000 7f5bf20f6640 1 -- 172.21.15.79:0/692536825 shutdown_connections 2024-08-20T01:35:54.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.453+0000 7f5bf20f6640 1 --2- 172.21.15.79:0/692536825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bec10f0c0 0x7f5bec1114b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:54.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.453+0000 7f5bf20f6640 1 --2- 172.21.15.79:0/692536825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bec075b10 0x7f5bec10eb80 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:54.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.453+0000 7f5bf20f6640 1 --2- 172.21.15.79:0/692536825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bec0751f0 0x7f5bec0755d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:54.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.453+0000 7f5bf20f6640 1 -- 172.21.15.79:0/692536825 >> 172.21.15.79:0/692536825 conn(0x7f5bec0fe500 msgr2=0x7f5bec100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:54.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.453+0000 7f5bf20f6640 1 -- 172.21.15.79:0/692536825 shutdown_connections 2024-08-20T01:35:54.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.453+0000 7f5bf20f6640 1 -- 172.21.15.79:0/692536825 wait complete. 2024-08-20T01:35:54.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.453+0000 7f5bf20f6640 1 Processor -- start 2024-08-20T01:35:54.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.454+0000 7f5bf20f6640 1 -- start start 2024-08-20T01:35:54.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.454+0000 7f5bf20f6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bec0751f0 0x7f5bec19b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:54.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.454+0000 7f5bf20f6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bec075b10 0x7f5bec19b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:54.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.454+0000 7f5bf20f6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bec10f0c0 0x7f5bec1a0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:54.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.454+0000 7f5bf20f6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5bec114b50 con 0x7f5bec10f0c0 2024-08-20T01:35:54.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.454+0000 7f5bf20f6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5bec1149d0 con 0x7f5bec075b10 2024-08-20T01:35:54.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.454+0000 7f5bf20f6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5bec114cd0 con 0x7f5bec0751f0 2024-08-20T01:35:54.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.454+0000 7f5bebfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bec10f0c0 0x7f5bec1a0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:54.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.454+0000 7f5bebfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bec10f0c0 0x7f5bec1a0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52114/0 (socket says 172.21.15.79:52114) 2024-08-20T01:35:54.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.454+0000 7f5bebfff640 1 -- 172.21.15.79:0/3441779711 learned_addr learned my addr 172.21.15.79:0/3441779711 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:35:54.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.454+0000 7f5bebfff640 1 -- 172.21.15.79:0/3441779711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bec0751f0 msgr2=0x7f5bec19b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:54.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.454+0000 7f5beb7fe640 1 --2- 172.21.15.79:0/3441779711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bec0751f0 0x7f5bec19b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:54.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.454+0000 7f5bebfff640 1 --2- 172.21.15.79:0/3441779711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bec0751f0 0x7f5bec19b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:54.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.454+0000 7f5bebfff640 1 -- 172.21.15.79:0/3441779711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bec075b10 msgr2=0x7f5bec19b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:54.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.454+0000 7f5beaffd640 1 --2- 172.21.15.79:0/3441779711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bec075b10 0x7f5bec19b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:54.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.454+0000 7f5bebfff640 1 --2- 172.21.15.79:0/3441779711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bec075b10 0x7f5bec19b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:54.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.454+0000 7f5bebfff640 1 -- 172.21.15.79:0/3441779711 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bec1a1150 con 0x7f5bec10f0c0 2024-08-20T01:35:54.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.455+0000 7f5bebfff640 1 --2- 172.21.15.79:0/3441779711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bec10f0c0 0x7f5bec1a0980 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5be400c970 tx=0x7f5be400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:54.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.455+0000 7f5be8ff9640 1 -- 172.21.15.79:0/3441779711 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be4007bb0 con 0x7f5bec10f0c0 2024-08-20T01:35:54.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.455+0000 7f5be8ff9640 1 -- 172.21.15.79:0/3441779711 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5be4007d50 con 0x7f5bec10f0c0 2024-08-20T01:35:54.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.455+0000 7f5bf20f6640 1 -- 172.21.15.79:0/3441779711 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bec1a1440 con 0x7f5bec10f0c0 2024-08-20T01:35:54.890 INFO:teuthology.orchestra.run.smithi079.stdout:146028888118 2024-08-20T01:35:54.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.455+0000 7f5be8ff9640 1 -- 172.21.15.79:0/3441779711 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be4004db0 con 0x7f5bec10f0c0 2024-08-20T01:35:54.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.455+0000 7f5bf20f6640 1 -- 172.21.15.79:0/3441779711 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bec1a7b00 con 0x7f5bec10f0c0 2024-08-20T01:35:54.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.456+0000 7f5bf20f6640 1 -- 172.21.15.79:0/3441779711 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bec0755d0 con 0x7f5bec10f0c0 2024-08-20T01:35:54.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.457+0000 7f5be8ff9640 1 -- 172.21.15.79:0/3441779711 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f5be4005020 con 0x7f5bec10f0c0 2024-08-20T01:35:54.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.458+0000 7f5be8ff9640 1 --2- 172.21.15.79:0/3441779711 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5bd80b3c60 0x7f5bd80b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:54.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.458+0000 7f5beb7fe640 1 --2- 172.21.15.79:0/3441779711 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5bd80b3c60 0x7f5bd80b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:54.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.458+0000 7f5be8ff9640 1 -- 172.21.15.79:0/3441779711 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f5be40e38c0 con 0x7f5bec10f0c0 2024-08-20T01:35:54.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.458+0000 7f5beb7fe640 1 --2- 172.21.15.79:0/3441779711 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5bd80b3c60 0x7f5bd80b6120 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc005c40 tx=0x7f5bdc005bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:54.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.462+0000 7f5be8ff9640 1 -- 172.21.15.79:0/3441779711 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f5be4014030 con 0x7f5bec10f0c0 2024-08-20T01:35:54.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.653+0000 7f5bf20f6640 1 -- 172.21.15.79:0/3441779711 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f5bec1a7ea0 con 0x7f5bec10f0c0 2024-08-20T01:35:54.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.653+0000 7f5be8ff9640 1 -- 172.21.15.79:0/3441779711 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f5be40aadc0 con 0x7f5bec10f0c0 2024-08-20T01:35:54.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.655+0000 7f5bf20f6640 1 -- 172.21.15.79:0/3441779711 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5bd80b3c60 msgr2=0x7f5bd80b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:54.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.655+0000 7f5bf20f6640 1 --2- 172.21.15.79:0/3441779711 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5bd80b3c60 0x7f5bd80b6120 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc005c40 tx=0x7f5bdc005bd0 comp rx=0 tx=0).stop 2024-08-20T01:35:54.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.655+0000 7f5bf20f6640 1 -- 172.21.15.79:0/3441779711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bec10f0c0 msgr2=0x7f5bec1a0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:54.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.655+0000 7f5bf20f6640 1 --2- 172.21.15.79:0/3441779711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bec10f0c0 0x7f5bec1a0980 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5be400c970 tx=0x7f5be400ce30 comp rx=0 tx=0).stop 2024-08-20T01:35:54.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.655+0000 7f5bf20f6640 1 -- 172.21.15.79:0/3441779711 shutdown_connections 2024-08-20T01:35:54.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.655+0000 7f5bf20f6640 1 --2- 172.21.15.79:0/3441779711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bec10f0c0 0x7f5bec1a0980 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:54.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.655+0000 7f5bf20f6640 1 --2- 172.21.15.79:0/3441779711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bec075b10 0x7f5bec19b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:54.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.656+0000 7f5bf20f6640 1 --2- 172.21.15.79:0/3441779711 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5bd80b3c60 0x7f5bd80b6120 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:54.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.656+0000 7f5bf20f6640 1 --2- 172.21.15.79:0/3441779711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bec0751f0 0x7f5bec19b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:54.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.656+0000 7f5bf20f6640 1 -- 172.21.15.79:0/3441779711 >> 172.21.15.79:0/3441779711 conn(0x7f5bec0fe500 msgr2=0x7f5bec0ff100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:54.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.656+0000 7f5bf20f6640 1 -- 172.21.15.79:0/3441779711 shutdown_connections 2024-08-20T01:35:54.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:54.656+0000 7f5bf20f6640 1 -- 172.21.15.79:0/3441779711 wait complete. 2024-08-20T01:35:54.893 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:54 smithi079 ceph-mon[18656]: osdmap e74: 12 total, 12 up, 12 in 2024-08-20T01:35:54.893 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:54 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/84964540' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-08-20T01:35:54.893 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:54 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/3441779711' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-08-20T01:35:54.893 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:54 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/151431668' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-08-20T01:35:55.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:54 smithi175 ceph-mon[22392]: osdmap e74: 12 total, 12 up, 12 in 2024-08-20T01:35:55.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:54 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/84964540' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-08-20T01:35:55.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:54 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/3441779711' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-08-20T01:35:55.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:54 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/151431668' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-08-20T01:35:55.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:54 smithi081 ceph-mon[22209]: osdmap e74: 12 total, 12 up, 12 in 2024-08-20T01:35:55.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:54 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/84964540' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-08-20T01:35:55.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:54 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/3441779711' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-08-20T01:35:55.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:54 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/151431668' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-08-20T01:35:55.571 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738442 got 34359738445 for osd.0 2024-08-20T01:35:55.571 DEBUG:teuthology.parallel:result is None 2024-08-20T01:35:55.894 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:55 smithi079 ceph-mon[18656]: pgmap v305: 97 pgs: 1 peering, 96 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 op/s 2024-08-20T01:35:55.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:55.974+0000 7f74346f8640 1 -- 172.21.15.79:0/1874527324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f742c1073a0 msgr2=0x7f742c1077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:55.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:55.974+0000 7f74346f8640 1 --2- 172.21.15.79:0/1874527324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f742c1073a0 0x7f742c1077e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f741c009900 tx=0x7f741c02a410 comp rx=0 tx=0).stop 2024-08-20T01:35:55.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:55.974+0000 7f74346f8640 1 -- 172.21.15.79:0/1874527324 shutdown_connections 2024-08-20T01:35:55.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:55.974+0000 7f74346f8640 1 --2- 172.21.15.79:0/1874527324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f742c107d20 0x7f742c10e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:55.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:55.974+0000 7f74346f8640 1 --2- 172.21.15.79:0/1874527324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f742c1073a0 0x7f742c1077e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:55.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:55.974+0000 7f74346f8640 1 --2- 172.21.15.79:0/1874527324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f742c101990 0x7f742c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:55.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:55.974+0000 7f74346f8640 1 -- 172.21.15.79:0/1874527324 >> 172.21.15.79:0/1874527324 conn(0x7f742c0fd400 msgr2=0x7f742c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:55.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:55.974+0000 7f74346f8640 1 -- 172.21.15.79:0/1874527324 shutdown_connections 2024-08-20T01:35:55.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:55.974+0000 7f74346f8640 1 -- 172.21.15.79:0/1874527324 wait complete. 2024-08-20T01:35:55.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:55.974+0000 7f74346f8640 1 Processor -- start 2024-08-20T01:35:55.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:55.974+0000 7f74346f8640 1 -- start start 2024-08-20T01:35:55.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:55.975+0000 7f74346f8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f742c101990 0x7f742c198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:55.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:55.975+0000 7f74346f8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f742c1073a0 0x7f742c1993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:55.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:55.975+0000 7f74346f8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f742c107d20 0x7f742c19e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:55.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:55.975+0000 7f74346f8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f742c112980 con 0x7f742c1073a0 2024-08-20T01:35:55.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:55.975+0000 7f74346f8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f742c112800 con 0x7f742c107d20 2024-08-20T01:35:55.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:55.975+0000 7f74346f8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f742c112b00 con 0x7f742c101990 2024-08-20T01:35:55.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:55.975+0000 7f7431c93640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f742c1073a0 0x7f742c1993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:55.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:55.975+0000 7f7431c93640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f742c1073a0 0x7f742c1993f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52148/0 (socket says 172.21.15.79:52148) 2024-08-20T01:35:55.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:55.975+0000 7f7431c93640 1 -- 172.21.15.79:0/2320960622 learned_addr learned my addr 172.21.15.79:0/2320960622 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:35:55.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:55.975+0000 7f7432c95640 1 --2- 172.21.15.79:0/2320960622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f742c107d20 0x7f742c19e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:55.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:55.975+0000 7f7432494640 1 --2- 172.21.15.79:0/2320960622 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f742c101990 0x7f742c198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:55.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:55.975+0000 7f7431c93640 1 -- 172.21.15.79:0/2320960622 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f742c101990 msgr2=0x7f742c198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:55.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:55.975+0000 7f7431c93640 1 --2- 172.21.15.79:0/2320960622 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f742c101990 0x7f742c198eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:55.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:55.975+0000 7f7431c93640 1 -- 172.21.15.79:0/2320960622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f742c107d20 msgr2=0x7f742c19e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:55.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:55.975+0000 7f7431c93640 1 --2- 172.21.15.79:0/2320960622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f742c107d20 0x7f742c19e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:55.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:55.975+0000 7f7431c93640 1 -- 172.21.15.79:0/2320960622 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f742c19ef60 con 0x7f742c1073a0 2024-08-20T01:35:55.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:55.975+0000 7f7432c95640 1 --2- 172.21.15.79:0/2320960622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f742c107d20 0x7f742c19e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:35:55.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:55.975+0000 7f7431c93640 1 --2- 172.21.15.79:0/2320960622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f742c1073a0 0x7f742c1993f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f741c009230 tx=0x7f741c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:55.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:55.975+0000 7f74237fe640 1 -- 172.21.15.79:0/2320960622 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741c03f030 con 0x7f742c1073a0 2024-08-20T01:35:55.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:55.975+0000 7f74237fe640 1 -- 172.21.15.79:0/2320960622 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f741c003a80 con 0x7f742c1073a0 2024-08-20T01:35:55.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:55.975+0000 7f74346f8640 1 -- 172.21.15.79:0/2320960622 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f742c19f1f0 con 0x7f742c1073a0 2024-08-20T01:35:55.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:55.975+0000 7f74237fe640 1 -- 172.21.15.79:0/2320960622 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741c035070 con 0x7f742c1073a0 2024-08-20T01:35:55.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:55.976+0000 7f74346f8640 1 -- 172.21.15.79:0/2320960622 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f742c1a5910 con 0x7f742c1073a0 2024-08-20T01:35:55.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:55.976+0000 7f74346f8640 1 -- 172.21.15.79:0/2320960622 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f742c101d70 con 0x7f742c1073a0 2024-08-20T01:35:55.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:55.978+0000 7f74237fe640 1 -- 172.21.15.79:0/2320960622 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f741c042030 con 0x7f742c1073a0 2024-08-20T01:35:55.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:55.979+0000 7f74237fe640 1 --2- 172.21.15.79:0/2320960622 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f74180b3ce0 0x7f74180b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:55.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:55.979+0000 7f7432494640 1 --2- 172.21.15.79:0/2320960622 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f74180b3ce0 0x7f74180b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:55.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:55.979+0000 7f74237fe640 1 -- 172.21.15.79:0/2320960622 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f741c104890 con 0x7f742c1073a0 2024-08-20T01:35:55.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:55.979+0000 7f7432494640 1 --2- 172.21.15.79:0/2320960622 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f74180b3ce0 0x7f74180b61a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7428009b60 tx=0x7f7428005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:55.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:55.981+0000 7f74237fe640 1 -- 172.21.15.79:0/2320960622 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f741c0cbd90 con 0x7f742c1073a0 2024-08-20T01:35:56.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:55 smithi175 ceph-mon[22392]: pgmap v305: 97 pgs: 1 peering, 96 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 op/s 2024-08-20T01:35:56.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.158+0000 7f74346f8640 1 -- 172.21.15.79:0/2320960622 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f742c199fe0 con 0x7f742c1073a0 2024-08-20T01:35:56.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.158+0000 7f74237fe640 1 -- 172.21.15.79:0/2320960622 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f742c199fe0 con 0x7f742c1073a0 2024-08-20T01:35:56.160 INFO:teuthology.orchestra.run.smithi079.stdout:236223201314 2024-08-20T01:35:56.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.160+0000 7f74346f8640 1 -- 172.21.15.79:0/2320960622 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f74180b3ce0 msgr2=0x7f74180b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:56.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.160+0000 7f74346f8640 1 --2- 172.21.15.79:0/2320960622 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f74180b3ce0 0x7f74180b61a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7428009b60 tx=0x7f7428005f90 comp rx=0 tx=0).stop 2024-08-20T01:35:56.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.160+0000 7f74346f8640 1 -- 172.21.15.79:0/2320960622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f742c1073a0 msgr2=0x7f742c1993f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:56.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.160+0000 7f74346f8640 1 --2- 172.21.15.79:0/2320960622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f742c1073a0 0x7f742c1993f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f741c009230 tx=0x7f741c004270 comp rx=0 tx=0).stop 2024-08-20T01:35:56.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.160+0000 7f74346f8640 1 -- 172.21.15.79:0/2320960622 shutdown_connections 2024-08-20T01:35:56.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.160+0000 7f74346f8640 1 --2- 172.21.15.79:0/2320960622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f742c107d20 0x7f742c19e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:56.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.160+0000 7f74346f8640 1 --2- 172.21.15.79:0/2320960622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f742c1073a0 0x7f742c1993f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:56.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.160+0000 7f74346f8640 1 --2- 172.21.15.79:0/2320960622 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f74180b3ce0 0x7f74180b61a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:56.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.160+0000 7f74346f8640 1 --2- 172.21.15.79:0/2320960622 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f742c101990 0x7f742c198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:56.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.160+0000 7f74346f8640 1 -- 172.21.15.79:0/2320960622 >> 172.21.15.79:0/2320960622 conn(0x7f742c0fd400 msgr2=0x7f742c0ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:56.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.160+0000 7f74346f8640 1 -- 172.21.15.79:0/2320960622 shutdown_connections 2024-08-20T01:35:56.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.160+0000 7f74346f8640 1 -- 172.21.15.79:0/2320960622 wait complete. 2024-08-20T01:35:56.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:55 smithi081 ceph-mon[22209]: pgmap v305: 97 pgs: 1 peering, 96 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 op/s 2024-08-20T01:35:56.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.426+0000 7efc2b76b640 1 -- 172.21.15.79:0/3703022804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc241073c0 msgr2=0x7efc24107800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:56.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.426+0000 7efc2b76b640 1 --2- 172.21.15.79:0/3703022804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc241073c0 0x7efc24107800 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7efc14009900 tx=0x7efc1402a410 comp rx=0 tx=0).stop 2024-08-20T01:35:56.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.426+0000 7efc2b76b640 1 -- 172.21.15.79:0/3703022804 shutdown_connections 2024-08-20T01:35:56.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.426+0000 7efc2b76b640 1 --2- 172.21.15.79:0/3703022804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc24107d40 0x7efc2410e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:56.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.426+0000 7efc2b76b640 1 --2- 172.21.15.79:0/3703022804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc241073c0 0x7efc24107800 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:56.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.426+0000 7efc2b76b640 1 --2- 172.21.15.79:0/3703022804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc241019b0 0x7efc24101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:56.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.426+0000 7efc2b76b640 1 -- 172.21.15.79:0/3703022804 >> 172.21.15.79:0/3703022804 conn(0x7efc240fd400 msgr2=0x7efc240ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:56.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.426+0000 7efc2b76b640 1 -- 172.21.15.79:0/3703022804 shutdown_connections 2024-08-20T01:35:56.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.426+0000 7efc2b76b640 1 -- 172.21.15.79:0/3703022804 wait complete. 2024-08-20T01:35:56.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.427+0000 7efc2b76b640 1 Processor -- start 2024-08-20T01:35:56.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.427+0000 7efc2b76b640 1 -- start start 2024-08-20T01:35:56.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.427+0000 7efc2b76b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc241019b0 0x7efc240fd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:56.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.427+0000 7efc2b76b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc241073c0 0x7efc240fde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:56.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.427+0000 7efc2b76b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc24107d40 0x7efc240fe380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:56.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.427+0000 7efc2b76b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efc241118b0 con 0x7efc241073c0 2024-08-20T01:35:56.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.427+0000 7efc2b76b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efc24111730 con 0x7efc24107d40 2024-08-20T01:35:56.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.427+0000 7efc2b76b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efc24111a30 con 0x7efc241019b0 2024-08-20T01:35:56.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.427+0000 7efc28d06640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc241073c0 0x7efc240fde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:56.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.427+0000 7efc28d06640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc241073c0 0x7efc240fde40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52160/0 (socket says 172.21.15.79:52160) 2024-08-20T01:35:56.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.427+0000 7efc28d06640 1 -- 172.21.15.79:0/1241021234 learned_addr learned my addr 172.21.15.79:0/1241021234 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:35:56.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.427+0000 7efc29507640 1 --2- 172.21.15.79:0/1241021234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc241019b0 0x7efc240fd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:56.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.427+0000 7efc29d08640 1 --2- 172.21.15.79:0/1241021234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc24107d40 0x7efc240fe380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:56.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.428+0000 7efc28d06640 1 -- 172.21.15.79:0/1241021234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc241019b0 msgr2=0x7efc240fd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:56.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.428+0000 7efc28d06640 1 --2- 172.21.15.79:0/1241021234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc241019b0 0x7efc240fd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:56.677 INFO:teuthology.orchestra.run.smithi079.stdout:188978561068 2024-08-20T01:35:56.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.428+0000 7efc28d06640 1 -- 172.21.15.79:0/1241021234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc24107d40 msgr2=0x7efc240fe380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:56.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.428+0000 7efc28d06640 1 --2- 172.21.15.79:0/1241021234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc24107d40 0x7efc240fe380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:56.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.428+0000 7efc28d06640 1 -- 172.21.15.79:0/1241021234 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc241a75d0 con 0x7efc241073c0 2024-08-20T01:35:56.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.428+0000 7efc28d06640 1 --2- 172.21.15.79:0/1241021234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc241073c0 0x7efc240fde40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7efc14009230 tx=0x7efc14004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:56.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.428+0000 7efc1a7fc640 1 -- 172.21.15.79:0/1241021234 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc1403f030 con 0x7efc241073c0 2024-08-20T01:35:56.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.428+0000 7efc2b76b640 1 -- 172.21.15.79:0/1241021234 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc241a7860 con 0x7efc241073c0 2024-08-20T01:35:56.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.428+0000 7efc1a7fc640 1 -- 172.21.15.79:0/1241021234 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efc14003a80 con 0x7efc241073c0 2024-08-20T01:35:56.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.428+0000 7efc1a7fc640 1 -- 172.21.15.79:0/1241021234 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc14035070 con 0x7efc241073c0 2024-08-20T01:35:56.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.428+0000 7efc2b76b640 1 -- 172.21.15.79:0/1241021234 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc241a7d40 con 0x7efc241073c0 2024-08-20T01:35:56.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.429+0000 7efc2b76b640 1 -- 172.21.15.79:0/1241021234 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc24101d90 con 0x7efc241073c0 2024-08-20T01:35:56.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.431+0000 7efc1a7fc640 1 -- 172.21.15.79:0/1241021234 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7efc14042030 con 0x7efc241073c0 2024-08-20T01:35:56.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.432+0000 7efc1a7fc640 1 --2- 172.21.15.79:0/1241021234 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7efc100b3c60 0x7efc100b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:35:56.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.432+0000 7efc29507640 1 --2- 172.21.15.79:0/1241021234 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7efc100b3c60 0x7efc100b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:35:56.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.432+0000 7efc1a7fc640 1 -- 172.21.15.79:0/1241021234 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7efc141048e0 con 0x7efc241073c0 2024-08-20T01:35:56.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.432+0000 7efc29507640 1 --2- 172.21.15.79:0/1241021234 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7efc100b3c60 0x7efc100b6120 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7efc20005d00 tx=0x7efc2000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:35:56.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.435+0000 7efc1a7fc640 1 -- 172.21.15.79:0/1241021234 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7efc140cbde0 con 0x7efc241073c0 2024-08-20T01:35:56.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.615+0000 7efc2b76b640 1 -- 172.21.15.79:0/1241021234 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7efc2406aeb0 con 0x7efc241073c0 2024-08-20T01:35:56.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.615+0000 7efc1a7fc640 1 -- 172.21.15.79:0/1241021234 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7efc140cb6e0 con 0x7efc241073c0 2024-08-20T01:35:56.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.617+0000 7efc2b76b640 1 -- 172.21.15.79:0/1241021234 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7efc100b3c60 msgr2=0x7efc100b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:56.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.617+0000 7efc2b76b640 1 --2- 172.21.15.79:0/1241021234 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7efc100b3c60 0x7efc100b6120 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7efc20005d00 tx=0x7efc2000b410 comp rx=0 tx=0).stop 2024-08-20T01:35:56.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.617+0000 7efc2b76b640 1 -- 172.21.15.79:0/1241021234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc241073c0 msgr2=0x7efc240fde40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:35:56.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.617+0000 7efc2b76b640 1 --2- 172.21.15.79:0/1241021234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc241073c0 0x7efc240fde40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7efc14009230 tx=0x7efc14004270 comp rx=0 tx=0).stop 2024-08-20T01:35:56.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.617+0000 7efc2b76b640 1 -- 172.21.15.79:0/1241021234 shutdown_connections 2024-08-20T01:35:56.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.617+0000 7efc2b76b640 1 --2- 172.21.15.79:0/1241021234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc24107d40 0x7efc240fe380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:56.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.617+0000 7efc2b76b640 1 --2- 172.21.15.79:0/1241021234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc241073c0 0x7efc240fde40 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:56.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.617+0000 7efc2b76b640 1 --2- 172.21.15.79:0/1241021234 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7efc100b3c60 0x7efc100b6120 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:56.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.617+0000 7efc2b76b640 1 --2- 172.21.15.79:0/1241021234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc241019b0 0x7efc240fd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:35:56.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.617+0000 7efc2b76b640 1 -- 172.21.15.79:0/1241021234 >> 172.21.15.79:0/1241021234 conn(0x7efc240fd400 msgr2=0x7efc2406ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:35:56.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.618+0000 7efc2b76b640 1 -- 172.21.15.79:0/1241021234 shutdown_connections 2024-08-20T01:35:56.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:35:56.618+0000 7efc2b76b640 1 -- 172.21.15.79:0/1241021234 wait complete. 2024-08-20T01:35:57.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:56 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2320960622' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-08-20T01:35:57.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:56 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/1241021234' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-08-20T01:35:57.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:56 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2320960622' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-08-20T01:35:57.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:56 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/1241021234' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-08-20T01:35:57.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:56 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2320960622' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-08-20T01:35:57.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:56 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/1241021234' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-08-20T01:35:57.344 INFO:tasks.cephadm.ceph_manager.ceph:need seq 283467841558 got 283467841561 for osd.11 2024-08-20T01:35:57.344 DEBUG:teuthology.parallel:result is None 2024-08-20T01:35:57.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:57 smithi079 ceph-mon[18656]: pgmap v306: 97 pgs: 1 peering, 96 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 8 op/s 2024-08-20T01:35:57.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:57 smithi079 ceph-mon[18656]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-08-20T01:35:57.988 INFO:tasks.cephadm.ceph_manager.ceph:need seq 236223201312 got 236223201314 for osd.9 2024-08-20T01:35:57.988 DEBUG:teuthology.parallel:result is None 2024-08-20T01:35:58.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:57 smithi175 ceph-mon[22392]: pgmap v306: 97 pgs: 1 peering, 96 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 8 op/s 2024-08-20T01:35:58.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:57 smithi175 ceph-mon[22392]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-08-20T01:35:58.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:57 smithi081 ceph-mon[22209]: pgmap v306: 97 pgs: 1 peering, 96 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 8 op/s 2024-08-20T01:35:58.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:57 smithi081 ceph-mon[22209]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-08-20T01:35:58.385 INFO:tasks.cephadm.ceph_manager.ceph:need seq 188978561065 got 188978561068 for osd.7 2024-08-20T01:35:58.385 DEBUG:teuthology.parallel:result is None 2024-08-20T01:35:58.879 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574917 got 55834574920 for osd.1 2024-08-20T01:35:58.879 DEBUG:teuthology.parallel:result is None 2024-08-20T01:35:59.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:58 smithi175 ceph-mon[22392]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-08-20T01:35:59.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:58 smithi175 ceph-mon[22392]: Cluster is now healthy 2024-08-20T01:35:59.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:58 smithi079 ceph-mon[18656]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-08-20T01:35:59.214 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:58 smithi079 ceph-mon[18656]: Cluster is now healthy 2024-08-20T01:35:59.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:58 smithi081 ceph-mon[22209]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-08-20T01:35:59.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:58 smithi081 ceph-mon[22209]: Cluster is now healthy 2024-08-20T01:35:59.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:35:59 smithi079 ceph-mon[18656]: pgmap v307: 97 pgs: 97 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s; 13 B/s, 0 objects/s recovering 2024-08-20T01:35:59.990 INFO:tasks.cephadm.ceph_manager.ceph:need seq 214748364836 got 214748364839 for osd.8 2024-08-20T01:35:59.990 DEBUG:teuthology.parallel:result is None 2024-08-20T01:36:00.138 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:35:59 smithi175 ceph-mon[22392]: pgmap v307: 97 pgs: 97 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s; 13 B/s, 0 objects/s recovering 2024-08-20T01:36:00.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:35:59 smithi081 ceph-mon[22209]: pgmap v307: 97 pgs: 97 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s; 13 B/s, 0 objects/s recovering 2024-08-20T01:36:00.394 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888115 got 146028888118 for osd.5 2024-08-20T01:36:00.394 DEBUG:teuthology.parallel:result is None 2024-08-20T01:36:00.394 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-20T01:36:00.394 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph pg dump --format=json 2024-08-20T01:36:00.669 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:36:01.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.116+0000 7f4af220d640 1 -- 172.21.15.79:0/4105317322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aec104290 msgr2=0x7f4aec10c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:01.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.116+0000 7f4af220d640 1 --2- 172.21.15.79:0/4105317322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aec104290 0x7f4aec10c870 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0009900 tx=0x7f4ae002a410 comp rx=0 tx=0).stop 2024-08-20T01:36:01.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.116+0000 7f4af220d640 1 -- 172.21.15.79:0/4105317322 shutdown_connections 2024-08-20T01:36:01.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.116+0000 7f4af220d640 1 --2- 172.21.15.79:0/4105317322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4aec10ce40 0x7f4aec10f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:01.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.116+0000 7f4af220d640 1 --2- 172.21.15.79:0/4105317322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aec104290 0x7f4aec10c870 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:01.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.116+0000 7f4af220d640 1 --2- 172.21.15.79:0/4105317322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4aec103890 0x7f4aec103c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:01.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.116+0000 7f4af220d640 1 -- 172.21.15.79:0/4105317322 >> 172.21.15.79:0/4105317322 conn(0x7f4aec0fd400 msgr2=0x7f4aec0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:01.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.116+0000 7f4af220d640 1 -- 172.21.15.79:0/4105317322 shutdown_connections 2024-08-20T01:36:01.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.116+0000 7f4af220d640 1 -- 172.21.15.79:0/4105317322 wait complete. 2024-08-20T01:36:01.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.117+0000 7f4af220d640 1 Processor -- start 2024-08-20T01:36:01.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.117+0000 7f4af220d640 1 -- start start 2024-08-20T01:36:01.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.117+0000 7f4af220d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4aec103890 0x7f4aec198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:01.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.117+0000 7f4af220d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4aec104290 0x7f4aec199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:01.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.117+0000 7f4af220d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aec10ce40 0x7f4aec19e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:01.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.117+0000 7f4af220d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec112910 con 0x7f4aec10ce40 2024-08-20T01:36:01.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.117+0000 7f4af220d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec112790 con 0x7f4aec104290 2024-08-20T01:36:01.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.117+0000 7f4af220d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec112a90 con 0x7f4aec103890 2024-08-20T01:36:01.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.117+0000 7f4aebfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aec10ce40 0x7f4aec19e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:01.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.118+0000 7f4aebfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aec10ce40 0x7f4aec19e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47986/0 (socket says 172.21.15.79:47986) 2024-08-20T01:36:01.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.118+0000 7f4aebfff640 1 -- 172.21.15.79:0/172071125 learned_addr learned my addr 172.21.15.79:0/172071125 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:01.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.118+0000 7f4aeaffd640 1 --2- 172.21.15.79:0/172071125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4aec104290 0x7f4aec199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:01.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.118+0000 7f4aeb7fe640 1 --2- 172.21.15.79:0/172071125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4aec103890 0x7f4aec198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:01.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.118+0000 7f4aebfff640 1 -- 172.21.15.79:0/172071125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4aec103890 msgr2=0x7f4aec198ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:01.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.118+0000 7f4aebfff640 1 --2- 172.21.15.79:0/172071125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4aec103890 0x7f4aec198ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:01.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.118+0000 7f4aebfff640 1 -- 172.21.15.79:0/172071125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4aec104290 msgr2=0x7f4aec199400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:01.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.118+0000 7f4aebfff640 1 --2- 172.21.15.79:0/172071125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4aec104290 0x7f4aec199400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:01.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.118+0000 7f4aebfff640 1 -- 172.21.15.79:0/172071125 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aec19ef70 con 0x7f4aec10ce40 2024-08-20T01:36:01.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.118+0000 7f4aebfff640 1 --2- 172.21.15.79:0/172071125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aec10ce40 0x7f4aec19e7a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4ae400cab0 tx=0x7f4ae400cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:01.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.118+0000 7f4ae8ff9640 1 -- 172.21.15.79:0/172071125 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae400ae20 con 0x7f4aec10ce40 2024-08-20T01:36:01.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.118+0000 7f4ae8ff9640 1 -- 172.21.15.79:0/172071125 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4ae400f8e0 con 0x7f4aec10ce40 2024-08-20T01:36:01.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.118+0000 7f4ae8ff9640 1 -- 172.21.15.79:0/172071125 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4018990 con 0x7f4aec10ce40 2024-08-20T01:36:01.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.118+0000 7f4af220d640 1 -- 172.21.15.79:0/172071125 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4aec19f260 con 0x7f4aec10ce40 2024-08-20T01:36:01.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.118+0000 7f4af220d640 1 -- 172.21.15.79:0/172071125 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4aec1a5920 con 0x7f4aec10ce40 2024-08-20T01:36:01.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.120+0000 7f4af220d640 1 -- 172.21.15.79:0/172071125 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4aec103c70 con 0x7f4aec10ce40 2024-08-20T01:36:01.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.122+0000 7f4ae8ff9640 1 -- 172.21.15.79:0/172071125 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f4ae400f450 con 0x7f4aec10ce40 2024-08-20T01:36:01.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.123+0000 7f4ae8ff9640 1 --2- 172.21.15.79:0/172071125 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4ad40b3c60 0x7f4ad40b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:01.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.123+0000 7f4aeb7fe640 1 --2- 172.21.15.79:0/172071125 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4ad40b3c60 0x7f4ad40b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:01.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.123+0000 7f4ae8ff9640 1 -- 172.21.15.79:0/172071125 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f4ae40e40f0 con 0x7f4aec10ce40 2024-08-20T01:36:01.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.123+0000 7f4aeb7fe640 1 --2- 172.21.15.79:0/172071125 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4ad40b3c60 0x7f4ad40b6120 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4adc0058c0 tx=0x7f4adc00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:01.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.127+0000 7f4ae8ff9640 1 -- 172.21.15.79:0/172071125 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f4ae4014030 con 0x7f4aec10ce40 2024-08-20T01:36:01.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.307+0000 7f4af220d640 1 -- 172.21.15.79:0/172071125 --> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4aec0632c0 con 0x7f4ad40b3c60 2024-08-20T01:36:01.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.312+0000 7f4ae8ff9640 1 -- 172.21.15.79:0/172071125 <== mgr.14150 v2:172.21.15.79:6800/3038112779 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258762 (secure 0 0 0) 0x7f4aec0632c0 con 0x7f4ad40b3c60 2024-08-20T01:36:01.316 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:36:01.317 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-08-20T01:36:01.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.316+0000 7f4af220d640 1 -- 172.21.15.79:0/172071125 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4ad40b3c60 msgr2=0x7f4ad40b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:01.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.316+0000 7f4af220d640 1 --2- 172.21.15.79:0/172071125 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4ad40b3c60 0x7f4ad40b6120 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4adc0058c0 tx=0x7f4adc00a2d0 comp rx=0 tx=0).stop 2024-08-20T01:36:01.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.316+0000 7f4af220d640 1 -- 172.21.15.79:0/172071125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aec10ce40 msgr2=0x7f4aec19e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:01.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.316+0000 7f4af220d640 1 --2- 172.21.15.79:0/172071125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aec10ce40 0x7f4aec19e7a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4ae400cab0 tx=0x7f4ae400cf70 comp rx=0 tx=0).stop 2024-08-20T01:36:01.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.316+0000 7f4af220d640 1 -- 172.21.15.79:0/172071125 shutdown_connections 2024-08-20T01:36:01.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.316+0000 7f4af220d640 1 --2- 172.21.15.79:0/172071125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aec10ce40 0x7f4aec19e7a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:01.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.316+0000 7f4af220d640 1 --2- 172.21.15.79:0/172071125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4aec104290 0x7f4aec199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:01.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.316+0000 7f4af220d640 1 --2- 172.21.15.79:0/172071125 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4ad40b3c60 0x7f4ad40b6120 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:01.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.316+0000 7f4af220d640 1 --2- 172.21.15.79:0/172071125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4aec103890 0x7f4aec198ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:01.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.316+0000 7f4af220d640 1 -- 172.21.15.79:0/172071125 >> 172.21.15.79:0/172071125 conn(0x7f4aec0fd400 msgr2=0x7f4aec0fe140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:01.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.316+0000 7f4af220d640 1 -- 172.21.15.79:0/172071125 shutdown_connections 2024-08-20T01:36:01.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:01.316+0000 7f4af220d640 1 -- 172.21.15.79:0/172071125 wait complete. 2024-08-20T01:36:02.067 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:01 smithi079 ceph-mon[18656]: pgmap v308: 97 pgs: 97 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 11 op/s; 13 B/s, 0 objects/s recovering 2024-08-20T01:36:02.067 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:01 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:36:02.067 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:01 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:36:02.068 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:01 smithi079 ceph-mon[18656]: from='client.15045 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:36:02.068 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:01 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:36:02.068 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:01 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:36:02.068 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:01 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:36:02.095 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":308,"stamp":"2024-08-20T01:36:00.484159+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656786,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":635,"num_read_kb":414,"num_write":365,"num_write_kb":2284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2951952,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":300,"ondisk_log_size":300,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":289,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":361056,"kb_used_data":11724,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124580768,"statfs":{"total":1151940427776,"available":1151570706432,"internally_reserved":0,"allocated":12005376,"data_stored":6684030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":357414203},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":44,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001628"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779232+0000","last_change":"2024-08-20T01:34:54.368243+0000","last_active":"2024-08-20T01:35:53.779232+0000","last_peered":"2024-08-20T01:35:53.779232+0000","last_clean":"2024-08-20T01:35:53.779232+0000","last_became_active":"2024-08-20T01:34:54.367712+0000","last_became_peered":"2024-08-20T01:34:54.367712+0000","last_unstale":"2024-08-20T01:35:53.779232+0000","last_undegraded":"2024-08-20T01:35:53.779232+0000","last_fullsized":"2024-08-20T01:35:53.779232+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:48:31.179090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779847+0000","last_change":"2024-08-20T01:34:54.371126+0000","last_active":"2024-08-20T01:35:53.779847+0000","last_peered":"2024-08-20T01:35:53.779847+0000","last_clean":"2024-08-20T01:35:53.779847+0000","last_became_active":"2024-08-20T01:34:54.370821+0000","last_became_peered":"2024-08-20T01:34:54.370821+0000","last_unstale":"2024-08-20T01:35:53.779847+0000","last_undegraded":"2024-08-20T01:35:53.779847+0000","last_fullsized":"2024-08-20T01:35:53.779847+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:37:41.175264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.780285+0000","last_change":"2024-08-20T01:34:54.373051+0000","last_active":"2024-08-20T01:35:53.780285+0000","last_peered":"2024-08-20T01:35:53.780285+0000","last_clean":"2024-08-20T01:35:53.780285+0000","last_became_active":"2024-08-20T01:34:54.372783+0000","last_became_peered":"2024-08-20T01:34:54.372783+0000","last_unstale":"2024-08-20T01:35:53.780285+0000","last_undegraded":"2024-08-20T01:35:53.780285+0000","last_fullsized":"2024-08-20T01:35:53.780285+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:12:49.630968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.797782+0000","last_change":"2024-08-20T01:34:54.372395+0000","last_active":"2024-08-20T01:35:53.797782+0000","last_peered":"2024-08-20T01:35:53.797782+0000","last_clean":"2024-08-20T01:35:53.797782+0000","last_became_active":"2024-08-20T01:34:54.371804+0000","last_became_peered":"2024-08-20T01:34:54.371804+0000","last_unstale":"2024-08-20T01:35:53.797782+0000","last_undegraded":"2024-08-20T01:35:53.797782+0000","last_fullsized":"2024-08-20T01:35:53.797782+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:01:14.395727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.782215+0000","last_change":"2024-08-20T01:34:54.379200+0000","last_active":"2024-08-20T01:35:53.782215+0000","last_peered":"2024-08-20T01:35:53.782215+0000","last_clean":"2024-08-20T01:35:53.782215+0000","last_became_active":"2024-08-20T01:34:54.378828+0000","last_became_peered":"2024-08-20T01:34:54.378828+0000","last_unstale":"2024-08-20T01:35:53.782215+0000","last_undegraded":"2024-08-20T01:35:53.782215+0000","last_fullsized":"2024-08-20T01:35:53.782215+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:27:09.672074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796880+0000","last_change":"2024-08-20T01:34:54.377871+0000","last_active":"2024-08-20T01:35:53.796880+0000","last_peered":"2024-08-20T01:35:53.796880+0000","last_clean":"2024-08-20T01:35:53.796880+0000","last_became_active":"2024-08-20T01:34:54.376617+0000","last_became_peered":"2024-08-20T01:34:54.376617+0000","last_unstale":"2024-08-20T01:35:53.796880+0000","last_undegraded":"2024-08-20T01:35:53.796880+0000","last_fullsized":"2024-08-20T01:35:53.796880+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:17:09.740135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779347+0000","last_change":"2024-08-20T01:34:54.373761+0000","last_active":"2024-08-20T01:35:53.779347+0000","last_peered":"2024-08-20T01:35:53.779347+0000","last_clean":"2024-08-20T01:35:53.779347+0000","last_became_active":"2024-08-20T01:34:54.372944+0000","last_became_peered":"2024-08-20T01:34:54.372944+0000","last_unstale":"2024-08-20T01:35:53.779347+0000","last_undegraded":"2024-08-20T01:35:53.779347+0000","last_fullsized":"2024-08-20T01:35:53.779347+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:21:44.477970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.799746+0000","last_change":"2024-08-20T01:35:53.799340+0000","last_active":"2024-08-20T01:35:53.799746+0000","last_peered":"2024-08-20T01:35:53.799746+0000","last_clean":"2024-08-20T01:35:53.799746+0000","last_became_active":"2024-08-20T01:35:53.799002+0000","last_became_peered":"2024-08-20T01:35:53.799002+0000","last_unstale":"2024-08-20T01:35:53.799746+0000","last_undegraded":"2024-08-20T01:35:53.799746+0000","last_fullsized":"2024-08-20T01:35:53.799746+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:42:42.446756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.797086+0000","last_change":"2024-08-20T01:34:54.378350+0000","last_active":"2024-08-20T01:35:53.797086+0000","last_peered":"2024-08-20T01:35:53.797086+0000","last_clean":"2024-08-20T01:35:53.797086+0000","last_became_active":"2024-08-20T01:34:54.376524+0000","last_became_peered":"2024-08-20T01:34:54.376524+0000","last_unstale":"2024-08-20T01:35:53.797086+0000","last_undegraded":"2024-08-20T01:35:53.797086+0000","last_fullsized":"2024-08-20T01:35:53.797086+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:50:03.179130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.797975+0000","last_change":"2024-08-20T01:34:54.376098+0000","last_active":"2024-08-20T01:35:53.797975+0000","last_peered":"2024-08-20T01:35:53.797975+0000","last_clean":"2024-08-20T01:35:53.797975+0000","last_became_active":"2024-08-20T01:34:54.375671+0000","last_became_peered":"2024-08-20T01:34:54.375671+0000","last_unstale":"2024-08-20T01:35:53.797975+0000","last_undegraded":"2024-08-20T01:35:53.797975+0000","last_fullsized":"2024-08-20T01:35:53.797975+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:43:14.876302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779830+0000","last_change":"2024-08-20T01:34:54.374431+0000","last_active":"2024-08-20T01:35:53.779830+0000","last_peered":"2024-08-20T01:35:53.779830+0000","last_clean":"2024-08-20T01:35:53.779830+0000","last_became_active":"2024-08-20T01:34:54.374082+0000","last_became_peered":"2024-08-20T01:34:54.374082+0000","last_unstale":"2024-08-20T01:35:53.779830+0000","last_undegraded":"2024-08-20T01:35:53.779830+0000","last_fullsized":"2024-08-20T01:35:53.779830+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:11:10.046245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.797894+0000","last_change":"2024-08-20T01:34:54.372124+0000","last_active":"2024-08-20T01:35:53.797894+0000","last_peered":"2024-08-20T01:35:53.797894+0000","last_clean":"2024-08-20T01:35:53.797894+0000","last_became_active":"2024-08-20T01:34:54.371382+0000","last_became_peered":"2024-08-20T01:34:54.371382+0000","last_unstale":"2024-08-20T01:35:53.797894+0000","last_undegraded":"2024-08-20T01:35:53.797894+0000","last_fullsized":"2024-08-20T01:35:53.797894+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:29:38.715445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.778157+0000","last_change":"2024-08-20T01:34:54.372760+0000","last_active":"2024-08-20T01:35:53.778157+0000","last_peered":"2024-08-20T01:35:53.778157+0000","last_clean":"2024-08-20T01:35:53.778157+0000","last_became_active":"2024-08-20T01:34:54.372386+0000","last_became_peered":"2024-08-20T01:34:54.372386+0000","last_unstale":"2024-08-20T01:35:53.778157+0000","last_undegraded":"2024-08-20T01:35:53.778157+0000","last_fullsized":"2024-08-20T01:35:53.778157+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:30:32.873604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.780156+0000","last_change":"2024-08-20T01:34:54.371164+0000","last_active":"2024-08-20T01:35:53.780156+0000","last_peered":"2024-08-20T01:35:53.780156+0000","last_clean":"2024-08-20T01:35:53.780156+0000","last_became_active":"2024-08-20T01:34:54.370856+0000","last_became_peered":"2024-08-20T01:34:54.370856+0000","last_unstale":"2024-08-20T01:35:53.780156+0000","last_undegraded":"2024-08-20T01:35:53.780156+0000","last_fullsized":"2024-08-20T01:35:53.780156+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:14:26.803902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779978+0000","last_change":"2024-08-20T01:34:54.369595+0000","last_active":"2024-08-20T01:35:53.779978+0000","last_peered":"2024-08-20T01:35:53.779978+0000","last_clean":"2024-08-20T01:35:53.779978+0000","last_became_active":"2024-08-20T01:34:54.369285+0000","last_became_peered":"2024-08-20T01:34:54.369285+0000","last_unstale":"2024-08-20T01:35:53.779978+0000","last_undegraded":"2024-08-20T01:35:53.779978+0000","last_fullsized":"2024-08-20T01:35:53.779978+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:53:16.965300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796178+0000","last_change":"2024-08-20T01:34:54.366903+0000","last_active":"2024-08-20T01:35:53.796178+0000","last_peered":"2024-08-20T01:35:53.796178+0000","last_clean":"2024-08-20T01:35:53.796178+0000","last_became_active":"2024-08-20T01:34:54.366533+0000","last_became_peered":"2024-08-20T01:34:54.366533+0000","last_unstale":"2024-08-20T01:35:53.796178+0000","last_undegraded":"2024-08-20T01:35:53.796178+0000","last_fullsized":"2024-08-20T01:35:53.796178+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:11:23.025718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779337+0000","last_change":"2024-08-20T01:34:54.368616+0000","last_active":"2024-08-20T01:35:53.779337+0000","last_peered":"2024-08-20T01:35:53.779337+0000","last_clean":"2024-08-20T01:35:53.779337+0000","last_became_active":"2024-08-20T01:34:54.368267+0000","last_became_peered":"2024-08-20T01:34:54.368267+0000","last_unstale":"2024-08-20T01:35:53.779337+0000","last_undegraded":"2024-08-20T01:35:53.779337+0000","last_fullsized":"2024-08-20T01:35:53.779337+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:53:09.035458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.781911+0000","last_change":"2024-08-20T01:34:54.369182+0000","last_active":"2024-08-20T01:35:53.781911+0000","last_peered":"2024-08-20T01:35:53.781911+0000","last_clean":"2024-08-20T01:35:53.781911+0000","last_became_active":"2024-08-20T01:34:54.368862+0000","last_became_peered":"2024-08-20T01:34:54.368862+0000","last_unstale":"2024-08-20T01:35:53.781911+0000","last_undegraded":"2024-08-20T01:35:53.781911+0000","last_fullsized":"2024-08-20T01:35:53.781911+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:31:16.013266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796980+0000","last_change":"2024-08-20T01:34:54.368132+0000","last_active":"2024-08-20T01:35:53.796980+0000","last_peered":"2024-08-20T01:35:53.796980+0000","last_clean":"2024-08-20T01:35:53.796980+0000","last_became_active":"2024-08-20T01:34:54.366295+0000","last_became_peered":"2024-08-20T01:34:54.366295+0000","last_unstale":"2024-08-20T01:35:53.796980+0000","last_undegraded":"2024-08-20T01:35:53.796980+0000","last_fullsized":"2024-08-20T01:35:53.796980+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:52:23.928602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.785820+0000","last_change":"2024-08-20T01:35:53.785719+0000","last_active":"2024-08-20T01:35:53.785820+0000","last_peered":"2024-08-20T01:35:53.785820+0000","last_clean":"2024-08-20T01:35:53.785820+0000","last_became_active":"2024-08-20T01:35:53.785072+0000","last_became_peered":"2024-08-20T01:35:53.785072+0000","last_unstale":"2024-08-20T01:35:53.785820+0000","last_undegraded":"2024-08-20T01:35:53.785820+0000","last_fullsized":"2024-08-20T01:35:53.785820+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:52:22.034855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.778249+0000","last_change":"2024-08-20T01:34:54.366206+0000","last_active":"2024-08-20T01:35:53.778249+0000","last_peered":"2024-08-20T01:35:53.778249+0000","last_clean":"2024-08-20T01:35:53.778249+0000","last_became_active":"2024-08-20T01:34:54.365893+0000","last_became_peered":"2024-08-20T01:34:54.365893+0000","last_unstale":"2024-08-20T01:35:53.778249+0000","last_undegraded":"2024-08-20T01:35:53.778249+0000","last_fullsized":"2024-08-20T01:35:53.778249+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:39:22.610570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796415+0000","last_change":"2024-08-20T01:34:54.368091+0000","last_active":"2024-08-20T01:35:53.796415+0000","last_peered":"2024-08-20T01:35:53.796415+0000","last_clean":"2024-08-20T01:35:53.796415+0000","last_became_active":"2024-08-20T01:34:54.367626+0000","last_became_peered":"2024-08-20T01:34:54.367626+0000","last_unstale":"2024-08-20T01:35:53.796415+0000","last_undegraded":"2024-08-20T01:35:53.796415+0000","last_fullsized":"2024-08-20T01:35:53.796415+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:52:34.157094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796075+0000","last_change":"2024-08-20T01:34:54.370976+0000","last_active":"2024-08-20T01:35:53.796075+0000","last_peered":"2024-08-20T01:35:53.796075+0000","last_clean":"2024-08-20T01:35:53.796075+0000","last_became_active":"2024-08-20T01:34:54.368349+0000","last_became_peered":"2024-08-20T01:34:54.368349+0000","last_unstale":"2024-08-20T01:35:53.796075+0000","last_undegraded":"2024-08-20T01:35:53.796075+0000","last_fullsized":"2024-08-20T01:35:53.796075+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:53:48.846072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.782947+0000","last_change":"2024-08-20T01:34:54.379148+0000","last_active":"2024-08-20T01:35:53.782947+0000","last_peered":"2024-08-20T01:35:53.782947+0000","last_clean":"2024-08-20T01:35:53.782947+0000","last_became_active":"2024-08-20T01:34:54.378800+0000","last_became_peered":"2024-08-20T01:34:54.378800+0000","last_unstale":"2024-08-20T01:35:53.782947+0000","last_undegraded":"2024-08-20T01:35:53.782947+0000","last_fullsized":"2024-08-20T01:35:53.782947+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:42:47.382372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796240+0000","last_change":"2024-08-20T01:34:54.376972+0000","last_active":"2024-08-20T01:35:53.796240+0000","last_peered":"2024-08-20T01:35:53.796240+0000","last_clean":"2024-08-20T01:35:53.796240+0000","last_became_active":"2024-08-20T01:34:54.376701+0000","last_became_peered":"2024-08-20T01:34:54.376701+0000","last_unstale":"2024-08-20T01:35:53.796240+0000","last_undegraded":"2024-08-20T01:35:53.796240+0000","last_fullsized":"2024-08-20T01:35:53.796240+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:19:12.897732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.797084+0000","last_change":"2024-08-20T01:34:54.372699+0000","last_active":"2024-08-20T01:35:53.797084+0000","last_peered":"2024-08-20T01:35:53.797084+0000","last_clean":"2024-08-20T01:35:53.797084+0000","last_became_active":"2024-08-20T01:34:54.371170+0000","last_became_peered":"2024-08-20T01:34:54.371170+0000","last_unstale":"2024-08-20T01:35:53.797084+0000","last_undegraded":"2024-08-20T01:35:53.797084+0000","last_fullsized":"2024-08-20T01:35:53.797084+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:18:00.373087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779319+0000","last_change":"2024-08-20T01:34:54.373726+0000","last_active":"2024-08-20T01:35:53.779319+0000","last_peered":"2024-08-20T01:35:53.779319+0000","last_clean":"2024-08-20T01:35:53.779319+0000","last_became_active":"2024-08-20T01:34:54.373418+0000","last_became_peered":"2024-08-20T01:34:54.373418+0000","last_unstale":"2024-08-20T01:35:53.779319+0000","last_undegraded":"2024-08-20T01:35:53.779319+0000","last_fullsized":"2024-08-20T01:35:53.779319+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:55:28.791396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.778212+0000","last_change":"2024-08-20T01:34:54.371779+0000","last_active":"2024-08-20T01:35:53.778212+0000","last_peered":"2024-08-20T01:35:53.778212+0000","last_clean":"2024-08-20T01:35:53.778212+0000","last_became_active":"2024-08-20T01:34:54.370449+0000","last_became_peered":"2024-08-20T01:34:54.370449+0000","last_unstale":"2024-08-20T01:35:53.778212+0000","last_undegraded":"2024-08-20T01:35:53.778212+0000","last_fullsized":"2024-08-20T01:35:53.778212+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:03:22.153120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.785815+0000","last_change":"2024-08-20T01:35:53.785757+0000","last_active":"2024-08-20T01:35:53.785815+0000","last_peered":"2024-08-20T01:35:53.785815+0000","last_clean":"2024-08-20T01:35:53.785815+0000","last_became_active":"2024-08-20T01:35:53.784991+0000","last_became_peered":"2024-08-20T01:35:53.784991+0000","last_unstale":"2024-08-20T01:35:53.785815+0000","last_undegraded":"2024-08-20T01:35:53.785815+0000","last_fullsized":"2024-08-20T01:35:53.785815+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:46:28.442935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796584+0000","last_change":"2024-08-20T01:34:54.369948+0000","last_active":"2024-08-20T01:35:53.796584+0000","last_peered":"2024-08-20T01:35:53.796584+0000","last_clean":"2024-08-20T01:35:53.796584+0000","last_became_active":"2024-08-20T01:34:54.367453+0000","last_became_peered":"2024-08-20T01:34:54.367453+0000","last_unstale":"2024-08-20T01:35:53.796584+0000","last_undegraded":"2024-08-20T01:35:53.796584+0000","last_fullsized":"2024-08-20T01:35:53.796584+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:09:38.800219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796610+0000","last_change":"2024-08-20T01:34:54.373622+0000","last_active":"2024-08-20T01:35:53.796610+0000","last_peered":"2024-08-20T01:35:53.796610+0000","last_clean":"2024-08-20T01:35:53.796610+0000","last_became_active":"2024-08-20T01:34:54.373261+0000","last_became_peered":"2024-08-20T01:34:54.373261+0000","last_unstale":"2024-08-20T01:35:53.796610+0000","last_undegraded":"2024-08-20T01:35:53.796610+0000","last_fullsized":"2024-08-20T01:35:53.796610+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:21:03.471668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.778893+0000","last_change":"2024-08-20T01:34:54.374728+0000","last_active":"2024-08-20T01:35:53.778893+0000","last_peered":"2024-08-20T01:35:53.778893+0000","last_clean":"2024-08-20T01:35:53.778893+0000","last_became_active":"2024-08-20T01:34:54.374183+0000","last_became_peered":"2024-08-20T01:34:54.374183+0000","last_unstale":"2024-08-20T01:35:53.778893+0000","last_undegraded":"2024-08-20T01:35:53.778893+0000","last_fullsized":"2024-08-20T01:35:53.778893+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:39:40.203942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.782560+0000","last_change":"2024-08-20T01:34:54.372863+0000","last_active":"2024-08-20T01:35:53.782560+0000","last_peered":"2024-08-20T01:35:53.782560+0000","last_clean":"2024-08-20T01:35:53.782560+0000","last_became_active":"2024-08-20T01:34:54.372409+0000","last_became_peered":"2024-08-20T01:34:54.372409+0000","last_unstale":"2024-08-20T01:35:53.782560+0000","last_undegraded":"2024-08-20T01:35:53.782560+0000","last_fullsized":"2024-08-20T01:35:53.782560+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:22:51.676677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"72'5","reported_seq":82,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:56.519358+0000","last_change":"2024-08-20T01:34:52.343440+0000","last_active":"2024-08-20T01:35:56.519358+0000","last_peered":"2024-08-20T01:35:56.519358+0000","last_clean":"2024-08-20T01:35:56.519358+0000","last_became_active":"2024-08-20T01:34:52.343110+0000","last_became_peered":"2024-08-20T01:34:52.343110+0000","last_unstale":"2024-08-20T01:35:56.519358+0000","last_undegraded":"2024-08-20T01:35:56.519358+0000","last_fullsized":"2024-08-20T01:35:56.519358+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:46:51.406198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.783034+0000","last_change":"2024-08-20T01:34:54.379522+0000","last_active":"2024-08-20T01:35:53.783034+0000","last_peered":"2024-08-20T01:35:53.783034+0000","last_clean":"2024-08-20T01:35:53.783034+0000","last_became_active":"2024-08-20T01:34:54.378826+0000","last_became_peered":"2024-08-20T01:34:54.378826+0000","last_unstale":"2024-08-20T01:35:53.783034+0000","last_undegraded":"2024-08-20T01:35:53.783034+0000","last_fullsized":"2024-08-20T01:35:53.783034+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:49:59.985231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"72'7","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796989+0000","last_change":"2024-08-20T01:34:52.344483+0000","last_active":"2024-08-20T01:35:53.796989+0000","last_peered":"2024-08-20T01:35:53.796989+0000","last_clean":"2024-08-20T01:35:53.796989+0000","last_became_active":"2024-08-20T01:34:52.343940+0000","last_became_peered":"2024-08-20T01:34:52.343940+0000","last_unstale":"2024-08-20T01:35:53.796989+0000","last_undegraded":"2024-08-20T01:35:53.796989+0000","last_fullsized":"2024-08-20T01:35:53.796989+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:19:53.480527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"72'3","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.777959+0000","last_change":"2024-08-20T01:34:52.340732+0000","last_active":"2024-08-20T01:35:53.777959+0000","last_peered":"2024-08-20T01:35:53.777959+0000","last_clean":"2024-08-20T01:35:53.777959+0000","last_became_active":"2024-08-20T01:34:52.340367+0000","last_became_peered":"2024-08-20T01:34:52.340367+0000","last_unstale":"2024-08-20T01:35:53.777959+0000","last_undegraded":"2024-08-20T01:35:53.777959+0000","last_fullsized":"2024-08-20T01:35:53.777959+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:33:17.751642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796078+0000","last_change":"2024-08-20T01:34:54.370725+0000","last_active":"2024-08-20T01:35:53.796078+0000","last_peered":"2024-08-20T01:35:53.796078+0000","last_clean":"2024-08-20T01:35:53.796078+0000","last_became_active":"2024-08-20T01:34:54.370423+0000","last_became_peered":"2024-08-20T01:34:54.370423+0000","last_unstale":"2024-08-20T01:35:53.796078+0000","last_undegraded":"2024-08-20T01:35:53.796078+0000","last_fullsized":"2024-08-20T01:35:53.796078+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:03:30.081748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"72'3","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.783141+0000","last_change":"2024-08-20T01:34:52.348605+0000","last_active":"2024-08-20T01:35:53.783141+0000","last_peered":"2024-08-20T01:35:53.783141+0000","last_clean":"2024-08-20T01:35:53.783141+0000","last_became_active":"2024-08-20T01:34:52.348278+0000","last_became_peered":"2024-08-20T01:34:52.348278+0000","last_unstale":"2024-08-20T01:35:53.783141+0000","last_undegraded":"2024-08-20T01:35:53.783141+0000","last_fullsized":"2024-08-20T01:35:53.783141+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:19:40.243243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.781186+0000","last_change":"2024-08-20T01:34:54.365604+0000","last_active":"2024-08-20T01:35:53.781186+0000","last_peered":"2024-08-20T01:35:53.781186+0000","last_clean":"2024-08-20T01:35:53.781186+0000","last_became_active":"2024-08-20T01:34:54.365284+0000","last_became_peered":"2024-08-20T01:34:54.365284+0000","last_unstale":"2024-08-20T01:35:53.781186+0000","last_undegraded":"2024-08-20T01:35:53.781186+0000","last_fullsized":"2024-08-20T01:35:53.781186+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:41:57.017680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"72'4","reported_seq":131,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:57.519989+0000","last_change":"2024-08-20T01:34:52.344679+0000","last_active":"2024-08-20T01:35:57.519989+0000","last_peered":"2024-08-20T01:35:57.519989+0000","last_clean":"2024-08-20T01:35:57.519989+0000","last_became_active":"2024-08-20T01:34:52.344058+0000","last_became_peered":"2024-08-20T01:34:52.344058+0000","last_unstale":"2024-08-20T01:35:57.519989+0000","last_undegraded":"2024-08-20T01:35:57.519989+0000","last_fullsized":"2024-08-20T01:35:57.519989+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:27:40.079949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796657+0000","last_change":"2024-08-20T01:34:54.369724+0000","last_active":"2024-08-20T01:35:53.796657+0000","last_peered":"2024-08-20T01:35:53.796657+0000","last_clean":"2024-08-20T01:35:53.796657+0000","last_became_active":"2024-08-20T01:34:54.369403+0000","last_became_peered":"2024-08-20T01:34:54.369403+0000","last_unstale":"2024-08-20T01:35:53.796657+0000","last_undegraded":"2024-08-20T01:35:53.796657+0000","last_fullsized":"2024-08-20T01:35:53.796657+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:31:22.382794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"72'4","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779736+0000","last_change":"2024-08-20T01:34:52.346651+0000","last_active":"2024-08-20T01:35:53.779736+0000","last_peered":"2024-08-20T01:35:53.779736+0000","last_clean":"2024-08-20T01:35:53.779736+0000","last_became_active":"2024-08-20T01:34:52.346316+0000","last_became_peered":"2024-08-20T01:34:52.346316+0000","last_unstale":"2024-08-20T01:35:53.779736+0000","last_undegraded":"2024-08-20T01:35:53.779736+0000","last_fullsized":"2024-08-20T01:35:53.779736+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:48:34.382413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.780585+0000","last_change":"2024-08-20T01:34:54.375587+0000","last_active":"2024-08-20T01:35:53.780585+0000","last_peered":"2024-08-20T01:35:53.780585+0000","last_clean":"2024-08-20T01:35:53.780585+0000","last_became_active":"2024-08-20T01:34:54.374138+0000","last_became_peered":"2024-08-20T01:34:54.374138+0000","last_unstale":"2024-08-20T01:35:53.780585+0000","last_undegraded":"2024-08-20T01:35:53.780585+0000","last_fullsized":"2024-08-20T01:35:53.780585+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:02:46.817849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"72'5","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.784242+0000","last_change":"2024-08-20T01:34:52.559659+0000","last_active":"2024-08-20T01:35:53.784242+0000","last_peered":"2024-08-20T01:35:53.784242+0000","last_clean":"2024-08-20T01:35:53.784242+0000","last_became_active":"2024-08-20T01:34:52.559243+0000","last_became_peered":"2024-08-20T01:34:52.559243+0000","last_unstale":"2024-08-20T01:35:53.784242+0000","last_undegraded":"2024-08-20T01:35:53.784242+0000","last_fullsized":"2024-08-20T01:35:53.784242+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:49:02.314230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796588+0000","last_change":"2024-08-20T01:34:54.372965+0000","last_active":"2024-08-20T01:35:53.796588+0000","last_peered":"2024-08-20T01:35:53.796588+0000","last_clean":"2024-08-20T01:35:53.796588+0000","last_became_active":"2024-08-20T01:34:54.372286+0000","last_became_peered":"2024-08-20T01:34:54.372286+0000","last_unstale":"2024-08-20T01:35:53.796588+0000","last_undegraded":"2024-08-20T01:35:53.796588+0000","last_fullsized":"2024-08-20T01:35:53.796588+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:32:45.178137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"72'30","reported_seq":166,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:57.535462+0000","last_change":"2024-08-20T01:34:52.348907+0000","last_active":"2024-08-20T01:35:57.535462+0000","last_peered":"2024-08-20T01:35:57.535462+0000","last_clean":"2024-08-20T01:35:57.535462+0000","last_became_active":"2024-08-20T01:34:52.347853+0000","last_became_peered":"2024-08-20T01:34:52.347853+0000","last_unstale":"2024-08-20T01:35:57.535462+0000","last_undegraded":"2024-08-20T01:35:57.535462+0000","last_fullsized":"2024-08-20T01:35:57.535462+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:19:31.142154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59762,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":113,"num_read_kb":114,"num_write":32,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.784562+0000","last_change":"2024-08-20T01:34:54.376493+0000","last_active":"2024-08-20T01:35:53.784562+0000","last_peered":"2024-08-20T01:35:53.784562+0000","last_clean":"2024-08-20T01:35:53.784562+0000","last_became_active":"2024-08-20T01:34:54.376160+0000","last_became_peered":"2024-08-20T01:34:54.376160+0000","last_unstale":"2024-08-20T01:35:53.784562+0000","last_undegraded":"2024-08-20T01:35:53.784562+0000","last_fullsized":"2024-08-20T01:35:53.784562+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:59:03.431731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"72'9","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796753+0000","last_change":"2024-08-20T01:34:52.347516+0000","last_active":"2024-08-20T01:35:53.796753+0000","last_peered":"2024-08-20T01:35:53.796753+0000","last_clean":"2024-08-20T01:35:53.796753+0000","last_became_active":"2024-08-20T01:34:52.347134+0000","last_became_peered":"2024-08-20T01:34:52.347134+0000","last_unstale":"2024-08-20T01:35:53.796753+0000","last_undegraded":"2024-08-20T01:35:53.796753+0000","last_fullsized":"2024-08-20T01:35:53.796753+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:26:16.057472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.778058+0000","last_change":"2024-08-20T01:34:54.368083+0000","last_active":"2024-08-20T01:35:53.778058+0000","last_peered":"2024-08-20T01:35:53.778058+0000","last_clean":"2024-08-20T01:35:53.778058+0000","last_became_active":"2024-08-20T01:34:54.367815+0000","last_became_peered":"2024-08-20T01:34:54.367815+0000","last_unstale":"2024-08-20T01:35:53.778058+0000","last_undegraded":"2024-08-20T01:35:53.778058+0000","last_fullsized":"2024-08-20T01:35:53.778058+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:02:13.515114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"72'5","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.783037+0000","last_change":"2024-08-20T01:34:52.345104+0000","last_active":"2024-08-20T01:35:53.783037+0000","last_peered":"2024-08-20T01:35:53.783037+0000","last_clean":"2024-08-20T01:35:53.783037+0000","last_became_active":"2024-08-20T01:34:52.344776+0000","last_became_peered":"2024-08-20T01:34:52.344776+0000","last_unstale":"2024-08-20T01:35:53.783037+0000","last_undegraded":"2024-08-20T01:35:53.783037+0000","last_fullsized":"2024-08-20T01:35:53.783037+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:05:30.230328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779602+0000","last_change":"2024-08-20T01:34:54.369341+0000","last_active":"2024-08-20T01:35:53.779602+0000","last_peered":"2024-08-20T01:35:53.779602+0000","last_clean":"2024-08-20T01:35:53.779602+0000","last_became_active":"2024-08-20T01:34:54.369040+0000","last_became_peered":"2024-08-20T01:34:54.369040+0000","last_unstale":"2024-08-20T01:35:53.779602+0000","last_undegraded":"2024-08-20T01:35:53.779602+0000","last_fullsized":"2024-08-20T01:35:53.779602+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:20:07.403778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"72'5","reported_seq":84,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:58.516859+0000","last_change":"2024-08-20T01:34:52.346787+0000","last_active":"2024-08-20T01:35:58.516859+0000","last_peered":"2024-08-20T01:35:58.516859+0000","last_clean":"2024-08-20T01:35:58.516859+0000","last_became_active":"2024-08-20T01:34:52.345713+0000","last_became_peered":"2024-08-20T01:34:52.345713+0000","last_unstale":"2024-08-20T01:35:58.516859+0000","last_undegraded":"2024-08-20T01:35:58.516859+0000","last_fullsized":"2024-08-20T01:35:58.516859+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:33:06.861899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779302+0000","last_change":"2024-08-20T01:34:54.374153+0000","last_active":"2024-08-20T01:35:53.779302+0000","last_peered":"2024-08-20T01:35:53.779302+0000","last_clean":"2024-08-20T01:35:53.779302+0000","last_became_active":"2024-08-20T01:34:54.372804+0000","last_became_peered":"2024-08-20T01:34:54.372804+0000","last_unstale":"2024-08-20T01:35:53.779302+0000","last_undegraded":"2024-08-20T01:35:53.779302+0000","last_fullsized":"2024-08-20T01:35:53.779302+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:54:27.470643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"72'17","reported_seq":41,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.782185+0000","last_change":"2024-08-20T01:34:52.559701+0000","last_active":"2024-08-20T01:35:53.782185+0000","last_peered":"2024-08-20T01:35:53.782185+0000","last_clean":"2024-08-20T01:35:53.782185+0000","last_became_active":"2024-08-20T01:34:52.559378+0000","last_became_peered":"2024-08-20T01:34:52.559378+0000","last_unstale":"2024-08-20T01:35:53.782185+0000","last_undegraded":"2024-08-20T01:35:53.782185+0000","last_fullsized":"2024-08-20T01:35:53.782185+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:39:55.636492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.798844+0000","last_change":"2024-08-20T01:35:53.798283+0000","last_active":"2024-08-20T01:35:53.798844+0000","last_peered":"2024-08-20T01:35:53.798844+0000","last_clean":"2024-08-20T01:35:53.798844+0000","last_became_active":"2024-08-20T01:35:53.797903+0000","last_became_peered":"2024-08-20T01:35:53.797903+0000","last_unstale":"2024-08-20T01:35:53.798844+0000","last_undegraded":"2024-08-20T01:35:53.798844+0000","last_fullsized":"2024-08-20T01:35:53.798844+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:22:27.676567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"72'2","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.784675+0000","last_change":"2024-08-20T01:34:52.347574+0000","last_active":"2024-08-20T01:35:53.784675+0000","last_peered":"2024-08-20T01:35:53.784675+0000","last_clean":"2024-08-20T01:35:53.784675+0000","last_became_active":"2024-08-20T01:34:52.347250+0000","last_became_peered":"2024-08-20T01:34:52.347250+0000","last_unstale":"2024-08-20T01:35:53.784675+0000","last_undegraded":"2024-08-20T01:35:53.784675+0000","last_fullsized":"2024-08-20T01:35:53.784675+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:03:00.007548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779162+0000","last_change":"2024-08-20T01:34:54.376383+0000","last_active":"2024-08-20T01:35:53.779162+0000","last_peered":"2024-08-20T01:35:53.779162+0000","last_clean":"2024-08-20T01:35:53.779162+0000","last_became_active":"2024-08-20T01:34:54.376044+0000","last_became_peered":"2024-08-20T01:34:54.376044+0000","last_unstale":"2024-08-20T01:35:53.779162+0000","last_undegraded":"2024-08-20T01:35:53.779162+0000","last_fullsized":"2024-08-20T01:35:53.779162+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:31:15.814776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"72'5","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.778440+0000","last_change":"2024-08-20T01:34:52.343441+0000","last_active":"2024-08-20T01:35:53.778440+0000","last_peered":"2024-08-20T01:35:53.778440+0000","last_clean":"2024-08-20T01:35:53.778440+0000","last_became_active":"2024-08-20T01:34:52.343120+0000","last_became_peered":"2024-08-20T01:34:52.343120+0000","last_unstale":"2024-08-20T01:35:53.778440+0000","last_undegraded":"2024-08-20T01:35:53.778440+0000","last_fullsized":"2024-08-20T01:35:53.778440+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:44:11.309626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779847+0000","last_change":"2024-08-20T01:34:54.368986+0000","last_active":"2024-08-20T01:35:53.779847+0000","last_peered":"2024-08-20T01:35:53.779847+0000","last_clean":"2024-08-20T01:35:53.779847+0000","last_became_active":"2024-08-20T01:34:54.368611+0000","last_became_peered":"2024-08-20T01:34:54.368611+0000","last_unstale":"2024-08-20T01:35:53.779847+0000","last_undegraded":"2024-08-20T01:35:53.779847+0000","last_fullsized":"2024-08-20T01:35:53.779847+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:37:32.433584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"72'3","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.783920+0000","last_change":"2024-08-20T01:34:52.345863+0000","last_active":"2024-08-20T01:35:53.783920+0000","last_peered":"2024-08-20T01:35:53.783920+0000","last_clean":"2024-08-20T01:35:53.783920+0000","last_became_active":"2024-08-20T01:34:52.345555+0000","last_became_peered":"2024-08-20T01:34:52.345555+0000","last_unstale":"2024-08-20T01:35:53.783920+0000","last_undegraded":"2024-08-20T01:35:53.783920+0000","last_fullsized":"2024-08-20T01:35:53.783920+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:46:21.606019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"72'1","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779663+0000","last_change":"2024-08-20T01:34:54.379699+0000","last_active":"2024-08-20T01:35:53.779663+0000","last_peered":"2024-08-20T01:35:53.779663+0000","last_clean":"2024-08-20T01:35:53.779663+0000","last_became_active":"2024-08-20T01:34:54.379197+0000","last_became_peered":"2024-08-20T01:34:54.379197+0000","last_unstale":"2024-08-20T01:35:53.779663+0000","last_undegraded":"2024-08-20T01:35:53.779663+0000","last_fullsized":"2024-08-20T01:35:53.779663+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:31:15.249200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"72'5","reported_seq":84,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:58.525221+0000","last_change":"2024-08-20T01:34:52.559520+0000","last_active":"2024-08-20T01:35:58.525221+0000","last_peered":"2024-08-20T01:35:58.525221+0000","last_clean":"2024-08-20T01:35:58.525221+0000","last_became_active":"2024-08-20T01:34:52.559180+0000","last_became_peered":"2024-08-20T01:34:52.559180+0000","last_unstale":"2024-08-20T01:35:58.525221+0000","last_undegraded":"2024-08-20T01:35:58.525221+0000","last_fullsized":"2024-08-20T01:35:58.525221+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:48:35.667441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779834+0000","last_change":"2024-08-20T01:34:54.372709+0000","last_active":"2024-08-20T01:35:53.779834+0000","last_peered":"2024-08-20T01:35:53.779834+0000","last_clean":"2024-08-20T01:35:53.779834+0000","last_became_active":"2024-08-20T01:34:54.372277+0000","last_became_peered":"2024-08-20T01:34:54.372277+0000","last_unstale":"2024-08-20T01:35:53.779834+0000","last_undegraded":"2024-08-20T01:35:53.779834+0000","last_fullsized":"2024-08-20T01:35:53.779834+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:26:11.837805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":95,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779483+0000","last_change":"2024-08-20T01:33:44.019475+0000","last_active":"2024-08-20T01:35:53.779483+0000","last_peered":"2024-08-20T01:35:53.779483+0000","last_clean":"2024-08-20T01:35:53.779483+0000","last_became_active":"2024-08-20T01:33:44.013614+0000","last_became_peered":"2024-08-20T01:33:44.013614+0000","last_unstale":"2024-08-20T01:35:53.779483+0000","last_undegraded":"2024-08-20T01:35:53.779483+0000","last_fullsized":"2024-08-20T01:35:53.779483+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:30:31.021505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:30:31.021505+0000","last_clean_scrub_stamp":"2024-08-20T01:30:31.021505+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:41:49.124707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"72'6","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.797689+0000","last_change":"2024-08-20T01:34:52.346409+0000","last_active":"2024-08-20T01:35:53.797689+0000","last_peered":"2024-08-20T01:35:53.797689+0000","last_clean":"2024-08-20T01:35:53.797689+0000","last_became_active":"2024-08-20T01:34:52.345821+0000","last_became_peered":"2024-08-20T01:34:52.345821+0000","last_unstale":"2024-08-20T01:35:53.797689+0000","last_undegraded":"2024-08-20T01:35:53.797689+0000","last_fullsized":"2024-08-20T01:35:53.797689+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:17:11.282558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796328+0000","last_change":"2024-08-20T01:34:54.374804+0000","last_active":"2024-08-20T01:35:53.796328+0000","last_peered":"2024-08-20T01:35:53.796328+0000","last_clean":"2024-08-20T01:35:53.796328+0000","last_became_active":"2024-08-20T01:34:54.374252+0000","last_became_peered":"2024-08-20T01:34:54.374252+0000","last_unstale":"2024-08-20T01:35:53.796328+0000","last_undegraded":"2024-08-20T01:35:53.796328+0000","last_fullsized":"2024-08-20T01:35:53.796328+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:32:51.703703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"72'4","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779475+0000","last_change":"2024-08-20T01:34:52.341399+0000","last_active":"2024-08-20T01:35:53.779475+0000","last_peered":"2024-08-20T01:35:53.779475+0000","last_clean":"2024-08-20T01:35:53.779475+0000","last_became_active":"2024-08-20T01:34:52.341034+0000","last_became_peered":"2024-08-20T01:34:52.341034+0000","last_unstale":"2024-08-20T01:35:53.779475+0000","last_undegraded":"2024-08-20T01:35:53.779475+0000","last_fullsized":"2024-08-20T01:35:53.779475+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:10:44.804836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.777948+0000","last_change":"2024-08-20T01:34:54.366567+0000","last_active":"2024-08-20T01:35:53.777948+0000","last_peered":"2024-08-20T01:35:53.777948+0000","last_clean":"2024-08-20T01:35:53.777948+0000","last_became_active":"2024-08-20T01:34:54.366298+0000","last_became_peered":"2024-08-20T01:34:54.366298+0000","last_unstale":"2024-08-20T01:35:53.777948+0000","last_undegraded":"2024-08-20T01:35:53.777948+0000","last_fullsized":"2024-08-20T01:35:53.777948+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:14:26.805902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"72'5","reported_seq":81,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:56.513729+0000","last_change":"2024-08-20T01:34:52.559166+0000","last_active":"2024-08-20T01:35:56.513729+0000","last_peered":"2024-08-20T01:35:56.513729+0000","last_clean":"2024-08-20T01:35:56.513729+0000","last_became_active":"2024-08-20T01:34:52.558652+0000","last_became_peered":"2024-08-20T01:34:52.558652+0000","last_unstale":"2024-08-20T01:35:56.513729+0000","last_undegraded":"2024-08-20T01:35:56.513729+0000","last_fullsized":"2024-08-20T01:35:56.513729+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:45:13.374924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.783076+0000","last_change":"2024-08-20T01:34:54.371193+0000","last_active":"2024-08-20T01:35:53.783076+0000","last_peered":"2024-08-20T01:35:53.783076+0000","last_clean":"2024-08-20T01:35:53.783076+0000","last_became_active":"2024-08-20T01:34:54.370869+0000","last_became_peered":"2024-08-20T01:34:54.370869+0000","last_unstale":"2024-08-20T01:35:53.783076+0000","last_undegraded":"2024-08-20T01:35:53.783076+0000","last_fullsized":"2024-08-20T01:35:53.783076+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:23:36.683049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"72'5","reported_seq":79,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:54.511272+0000","last_change":"2024-08-20T01:34:52.348815+0000","last_active":"2024-08-20T01:35:54.511272+0000","last_peered":"2024-08-20T01:35:54.511272+0000","last_clean":"2024-08-20T01:35:54.511272+0000","last_became_active":"2024-08-20T01:34:52.348437+0000","last_became_peered":"2024-08-20T01:34:52.348437+0000","last_unstale":"2024-08-20T01:35:54.511272+0000","last_undegraded":"2024-08-20T01:35:54.511272+0000","last_fullsized":"2024-08-20T01:35:54.511272+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:55:15.090721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.797255+0000","last_change":"2024-08-20T01:34:54.376049+0000","last_active":"2024-08-20T01:35:53.797255+0000","last_peered":"2024-08-20T01:35:53.797255+0000","last_clean":"2024-08-20T01:35:53.797255+0000","last_became_active":"2024-08-20T01:34:54.375680+0000","last_became_peered":"2024-08-20T01:34:54.375680+0000","last_unstale":"2024-08-20T01:35:53.797255+0000","last_undegraded":"2024-08-20T01:35:53.797255+0000","last_fullsized":"2024-08-20T01:35:53.797255+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:42:12.499850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"72'1","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.785333+0000","last_change":"2024-08-20T01:35:53.785259+0000","last_active":"2024-08-20T01:35:53.785333+0000","last_peered":"2024-08-20T01:35:53.785333+0000","last_clean":"2024-08-20T01:35:53.785333+0000","last_became_active":"2024-08-20T01:35:53.784842+0000","last_became_peered":"2024-08-20T01:35:53.784842+0000","last_unstale":"2024-08-20T01:35:53.785333+0000","last_undegraded":"2024-08-20T01:35:53.785333+0000","last_fullsized":"2024-08-20T01:35:53.785333+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:55:09.411882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"72'1","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.797518+0000","last_change":"2024-08-20T01:34:54.369686+0000","last_active":"2024-08-20T01:35:53.797518+0000","last_peered":"2024-08-20T01:35:53.797518+0000","last_clean":"2024-08-20T01:35:53.797518+0000","last_became_active":"2024-08-20T01:34:54.369343+0000","last_became_peered":"2024-08-20T01:34:54.369343+0000","last_unstale":"2024-08-20T01:35:53.797518+0000","last_undegraded":"2024-08-20T01:35:53.797518+0000","last_fullsized":"2024-08-20T01:35:53.797518+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:00:39.775809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"72'4","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.791703+0000","last_change":"2024-08-20T01:35:53.791290+0000","last_active":"2024-08-20T01:35:53.791703+0000","last_peered":"2024-08-20T01:35:53.791703+0000","last_clean":"2024-08-20T01:35:53.791703+0000","last_became_active":"2024-08-20T01:35:53.783283+0000","last_became_peered":"2024-08-20T01:35:53.783283+0000","last_unstale":"2024-08-20T01:35:53.791703+0000","last_undegraded":"2024-08-20T01:35:53.791703+0000","last_fullsized":"2024-08-20T01:35:53.791703+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:54:40.774394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.778296+0000","last_change":"2024-08-20T01:34:54.376275+0000","last_active":"2024-08-20T01:35:53.778296+0000","last_peered":"2024-08-20T01:35:53.778296+0000","last_clean":"2024-08-20T01:35:53.778296+0000","last_became_active":"2024-08-20T01:34:54.375797+0000","last_became_peered":"2024-08-20T01:34:54.375797+0000","last_unstale":"2024-08-20T01:35:53.778296+0000","last_undegraded":"2024-08-20T01:35:53.778296+0000","last_fullsized":"2024-08-20T01:35:53.778296+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:01:37.172855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"72'14","reported_seq":37,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.781922+0000","last_change":"2024-08-20T01:34:52.342207+0000","last_active":"2024-08-20T01:35:53.781922+0000","last_peered":"2024-08-20T01:35:53.781922+0000","last_clean":"2024-08-20T01:35:53.781922+0000","last_became_active":"2024-08-20T01:34:52.341878+0000","last_became_peered":"2024-08-20T01:34:52.341878+0000","last_unstale":"2024-08-20T01:35:53.781922+0000","last_undegraded":"2024-08-20T01:35:53.781922+0000","last_fullsized":"2024-08-20T01:35:53.781922+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:29:36.374725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796394+0000","last_change":"2024-08-20T01:34:54.371162+0000","last_active":"2024-08-20T01:35:53.796394+0000","last_peered":"2024-08-20T01:35:53.796394+0000","last_clean":"2024-08-20T01:35:53.796394+0000","last_became_active":"2024-08-20T01:34:54.368442+0000","last_became_peered":"2024-08-20T01:34:54.368442+0000","last_unstale":"2024-08-20T01:35:53.796394+0000","last_undegraded":"2024-08-20T01:35:53.796394+0000","last_fullsized":"2024-08-20T01:35:53.796394+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:23:42.119533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"72'7","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.797237+0000","last_change":"2024-08-20T01:34:52.345551+0000","last_active":"2024-08-20T01:35:53.797237+0000","last_peered":"2024-08-20T01:35:53.797237+0000","last_clean":"2024-08-20T01:35:53.797237+0000","last_became_active":"2024-08-20T01:34:52.344212+0000","last_became_peered":"2024-08-20T01:34:52.344212+0000","last_unstale":"2024-08-20T01:35:53.797237+0000","last_undegraded":"2024-08-20T01:35:53.797237+0000","last_fullsized":"2024-08-20T01:35:53.797237+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:52:58.826394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.799263+0000","last_change":"2024-08-20T01:35:53.799194+0000","last_active":"2024-08-20T01:35:53.799263+0000","last_peered":"2024-08-20T01:35:53.799263+0000","last_clean":"2024-08-20T01:35:53.799263+0000","last_became_active":"2024-08-20T01:35:53.798865+0000","last_became_peered":"2024-08-20T01:35:53.798865+0000","last_unstale":"2024-08-20T01:35:53.799263+0000","last_undegraded":"2024-08-20T01:35:53.799263+0000","last_fullsized":"2024-08-20T01:35:53.799263+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:24:58.697929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"72'2","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796311+0000","last_change":"2024-08-20T01:34:52.560529+0000","last_active":"2024-08-20T01:35:53.796311+0000","last_peered":"2024-08-20T01:35:53.796311+0000","last_clean":"2024-08-20T01:35:53.796311+0000","last_became_active":"2024-08-20T01:34:52.560141+0000","last_became_peered":"2024-08-20T01:34:52.560141+0000","last_unstale":"2024-08-20T01:35:53.796311+0000","last_undegraded":"2024-08-20T01:35:53.796311+0000","last_fullsized":"2024-08-20T01:35:53.796311+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:02:13.367700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.782373+0000","last_change":"2024-08-20T01:34:54.377963+0000","last_active":"2024-08-20T01:35:53.782373+0000","last_peered":"2024-08-20T01:35:53.782373+0000","last_clean":"2024-08-20T01:35:53.782373+0000","last_became_active":"2024-08-20T01:34:54.377645+0000","last_became_peered":"2024-08-20T01:34:54.377645+0000","last_unstale":"2024-08-20T01:35:53.782373+0000","last_undegraded":"2024-08-20T01:35:53.782373+0000","last_fullsized":"2024-08-20T01:35:53.782373+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:36:11.888293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"72'7","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796210+0000","last_change":"2024-08-20T01:34:52.342262+0000","last_active":"2024-08-20T01:35:53.796210+0000","last_peered":"2024-08-20T01:35:53.796210+0000","last_clean":"2024-08-20T01:35:53.796210+0000","last_became_active":"2024-08-20T01:34:52.341919+0000","last_became_peered":"2024-08-20T01:34:52.341919+0000","last_unstale":"2024-08-20T01:35:53.796210+0000","last_undegraded":"2024-08-20T01:35:53.796210+0000","last_fullsized":"2024-08-20T01:35:53.796210+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:29:38.542146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.778966+0000","last_change":"2024-08-20T01:34:54.375741+0000","last_active":"2024-08-20T01:35:53.778966+0000","last_peered":"2024-08-20T01:35:53.778966+0000","last_clean":"2024-08-20T01:35:53.778966+0000","last_became_active":"2024-08-20T01:34:54.375409+0000","last_became_peered":"2024-08-20T01:34:54.375409+0000","last_unstale":"2024-08-20T01:35:53.778966+0000","last_undegraded":"2024-08-20T01:35:53.778966+0000","last_fullsized":"2024-08-20T01:35:53.778966+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:29:46.278762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"72'3","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796628+0000","last_change":"2024-08-20T01:34:52.346296+0000","last_active":"2024-08-20T01:35:53.796628+0000","last_peered":"2024-08-20T01:35:53.796628+0000","last_clean":"2024-08-20T01:35:53.796628+0000","last_became_active":"2024-08-20T01:34:52.345535+0000","last_became_peered":"2024-08-20T01:34:52.345535+0000","last_unstale":"2024-08-20T01:35:53.796628+0000","last_undegraded":"2024-08-20T01:35:53.796628+0000","last_fullsized":"2024-08-20T01:35:53.796628+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:32:23.126530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796546+0000","last_change":"2024-08-20T01:34:54.365720+0000","last_active":"2024-08-20T01:35:53.796546+0000","last_peered":"2024-08-20T01:35:53.796546+0000","last_clean":"2024-08-20T01:35:53.796546+0000","last_became_active":"2024-08-20T01:34:54.365406+0000","last_became_peered":"2024-08-20T01:34:54.365406+0000","last_unstale":"2024-08-20T01:35:53.796546+0000","last_undegraded":"2024-08-20T01:35:53.796546+0000","last_fullsized":"2024-08-20T01:35:53.796546+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:31:09.988882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"72'4","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.782477+0000","last_change":"2024-08-20T01:34:52.344263+0000","last_active":"2024-08-20T01:35:53.782477+0000","last_peered":"2024-08-20T01:35:53.782477+0000","last_clean":"2024-08-20T01:35:53.782477+0000","last_became_active":"2024-08-20T01:34:52.343706+0000","last_became_peered":"2024-08-20T01:34:52.343706+0000","last_unstale":"2024-08-20T01:35:53.782477+0000","last_undegraded":"2024-08-20T01:35:53.782477+0000","last_fullsized":"2024-08-20T01:35:53.782477+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:25:30.305116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779525+0000","last_change":"2024-08-20T01:34:54.374564+0000","last_active":"2024-08-20T01:35:53.779525+0000","last_peered":"2024-08-20T01:35:53.779525+0000","last_clean":"2024-08-20T01:35:53.779525+0000","last_became_active":"2024-08-20T01:34:54.374136+0000","last_became_peered":"2024-08-20T01:34:54.374136+0000","last_unstale":"2024-08-20T01:35:53.779525+0000","last_undegraded":"2024-08-20T01:35:53.779525+0000","last_fullsized":"2024-08-20T01:35:53.779525+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:33:12.972430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.798451+0000","last_change":"2024-08-20T01:35:53.798392+0000","last_active":"2024-08-20T01:35:53.798451+0000","last_peered":"2024-08-20T01:35:53.798451+0000","last_clean":"2024-08-20T01:35:53.798451+0000","last_became_active":"2024-08-20T01:35:53.798035+0000","last_became_peered":"2024-08-20T01:35:53.798035+0000","last_unstale":"2024-08-20T01:35:53.798451+0000","last_undegraded":"2024-08-20T01:35:53.798451+0000","last_fullsized":"2024-08-20T01:35:53.798451+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:52:47.630577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"72'5","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.783108+0000","last_change":"2024-08-20T01:34:52.346174+0000","last_active":"2024-08-20T01:35:53.783108+0000","last_peered":"2024-08-20T01:35:53.783108+0000","last_clean":"2024-08-20T01:35:53.783108+0000","last_became_active":"2024-08-20T01:34:52.345677+0000","last_became_peered":"2024-08-20T01:34:52.345677+0000","last_unstale":"2024-08-20T01:35:53.783108+0000","last_undegraded":"2024-08-20T01:35:53.783108+0000","last_fullsized":"2024-08-20T01:35:53.783108+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:23:38.692225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796480+0000","last_change":"2024-08-20T01:34:54.373515+0000","last_active":"2024-08-20T01:35:53.796480+0000","last_peered":"2024-08-20T01:35:53.796480+0000","last_clean":"2024-08-20T01:35:53.796480+0000","last_became_active":"2024-08-20T01:34:54.372954+0000","last_became_peered":"2024-08-20T01:34:54.372954+0000","last_unstale":"2024-08-20T01:35:53.796480+0000","last_undegraded":"2024-08-20T01:35:53.796480+0000","last_fullsized":"2024-08-20T01:35:53.796480+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:27:24.384924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"72'12","reported_seq":36,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.784666+0000","last_change":"2024-08-20T01:34:52.344089+0000","last_active":"2024-08-20T01:35:53.784666+0000","last_peered":"2024-08-20T01:35:53.784666+0000","last_clean":"2024-08-20T01:35:53.784666+0000","last_became_active":"2024-08-20T01:34:52.343354+0000","last_became_peered":"2024-08-20T01:34:52.343354+0000","last_unstale":"2024-08-20T01:35:53.784666+0000","last_undegraded":"2024-08-20T01:35:53.784666+0000","last_fullsized":"2024-08-20T01:35:53.784666+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:50:35.527307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.780489+0000","last_change":"2024-08-20T01:34:54.371931+0000","last_active":"2024-08-20T01:35:53.780489+0000","last_peered":"2024-08-20T01:35:53.780489+0000","last_clean":"2024-08-20T01:35:53.780489+0000","last_became_active":"2024-08-20T01:34:54.371385+0000","last_became_peered":"2024-08-20T01:34:54.371385+0000","last_unstale":"2024-08-20T01:35:53.780489+0000","last_undegraded":"2024-08-20T01:35:53.780489+0000","last_fullsized":"2024-08-20T01:35:53.780489+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:11:35.807145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"72'2","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796613+0000","last_change":"2024-08-20T01:34:52.559127+0000","last_active":"2024-08-20T01:35:53.796613+0000","last_peered":"2024-08-20T01:35:53.796613+0000","last_clean":"2024-08-20T01:35:53.796613+0000","last_became_active":"2024-08-20T01:34:52.558834+0000","last_became_peered":"2024-08-20T01:34:52.558834+0000","last_unstale":"2024-08-20T01:35:53.796613+0000","last_undegraded":"2024-08-20T01:35:53.796613+0000","last_fullsized":"2024-08-20T01:35:53.796613+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:57:35.879486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796415+0000","last_change":"2024-08-20T01:34:54.378164+0000","last_active":"2024-08-20T01:35:53.796415+0000","last_peered":"2024-08-20T01:35:53.796415+0000","last_clean":"2024-08-20T01:35:53.796415+0000","last_became_active":"2024-08-20T01:34:54.377863+0000","last_became_peered":"2024-08-20T01:34:54.377863+0000","last_unstale":"2024-08-20T01:35:53.796415+0000","last_undegraded":"2024-08-20T01:35:53.796415+0000","last_fullsized":"2024-08-20T01:35:53.796415+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:23:21.832692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"72'13","reported_seq":88,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:55.512120+0000","last_change":"2024-08-20T01:34:52.341730+0000","last_active":"2024-08-20T01:35:55.512120+0000","last_peered":"2024-08-20T01:35:55.512120+0000","last_clean":"2024-08-20T01:35:55.512120+0000","last_became_active":"2024-08-20T01:34:52.341407+0000","last_became_peered":"2024-08-20T01:34:52.341407+0000","last_unstale":"2024-08-20T01:35:55.512120+0000","last_undegraded":"2024-08-20T01:35:55.512120+0000","last_fullsized":"2024-08-20T01:35:55.512120+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:53:09.225154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66184,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":559,"num_read_kb":350,"num_write":240,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":198552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":66,"seq":283467841562,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":823296,"data_stored":394110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":61,"seq":261993005088,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36828,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708324,"statfs":{"total":95995035648,"available":95957323776,"internally_reserved":0,"allocated":1515520,"data_stored":1044789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":55,"seq":236223201315,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":839680,"data_stored":393928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":50,"seq":214748364841,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32000,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713152,"statfs":{"total":95995035648,"available":95962267648,"internally_reserved":0,"allocated":827392,"data_stored":394194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561069,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32592,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712560,"statfs":{"total":95995035648,"available":95961661440,"internally_reserved":0,"allocated":1433600,"data_stored":986433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":39,"seq":167503724595,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31992,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713160,"statfs":{"total":95995035648,"available":95962275840,"internally_reserved":0,"allocated":823296,"data_stored":393645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888120,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32600,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712552,"statfs":{"total":95995035648,"available":95961653248,"internally_reserved":0,"allocated":1445888,"data_stored":986111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084348,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":823296,"data_stored":393506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247872,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":839680,"data_stored":393470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444101,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":905216,"data_stored":454540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":884736,"data_stored":454320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":843776,"data_stored":394984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":61514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":61498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-20T01:36:02.100 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph pg dump --format=json 2024-08-20T01:36:02.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:01 smithi081 ceph-mon[22209]: pgmap v308: 97 pgs: 97 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 11 op/s; 13 B/s, 0 objects/s recovering 2024-08-20T01:36:02.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:01 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:36:02.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:01 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:36:02.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:01 smithi081 ceph-mon[22209]: from='client.15045 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:36:02.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:01 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:36:02.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:01 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:36:02.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:01 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:36:02.345 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:36:02.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:01 smithi175 ceph-mon[22392]: pgmap v308: 97 pgs: 97 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 11 op/s; 13 B/s, 0 objects/s recovering 2024-08-20T01:36:02.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:01 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:36:02.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:01 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:36:02.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:01 smithi175 ceph-mon[22392]: from='client.15045 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:36:02.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:01 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:36:02.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:01 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:36:02.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:01 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:36:02.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:02.858+0000 7fa4c54ec640 1 -- 172.21.15.79:0/2715871103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4c01039d0 msgr2=0x7fa4c0103db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:02.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:02.858+0000 7fa4c54ec640 1 --2- 172.21.15.79:0/2715871103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4c01039d0 0x7fa4c0103db0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0009900 tx=0x7fa4b002a410 comp rx=0 tx=0).stop 2024-08-20T01:36:02.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:02.858+0000 7fa4c54ec640 1 -- 172.21.15.79:0/2715871103 shutdown_connections 2024-08-20T01:36:02.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:02.858+0000 7fa4c54ec640 1 --2- 172.21.15.79:0/2715871103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4c010ce30 0x7fa4c010f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:02.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:02.858+0000 7fa4c54ec640 1 --2- 172.21.15.79:0/2715871103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4c01042f0 0x7fa4c010c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:02.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:02.858+0000 7fa4c54ec640 1 --2- 172.21.15.79:0/2715871103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4c01039d0 0x7fa4c0103db0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:02.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:02.858+0000 7fa4c54ec640 1 -- 172.21.15.79:0/2715871103 >> 172.21.15.79:0/2715871103 conn(0x7fa4c00fd410 msgr2=0x7fa4c00ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:02.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:02.858+0000 7fa4c54ec640 1 -- 172.21.15.79:0/2715871103 shutdown_connections 2024-08-20T01:36:02.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:02.858+0000 7fa4c54ec640 1 -- 172.21.15.79:0/2715871103 wait complete. 2024-08-20T01:36:02.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:02.858+0000 7fa4c54ec640 1 Processor -- start 2024-08-20T01:36:02.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:02.858+0000 7fa4c54ec640 1 -- start start 2024-08-20T01:36:02.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:02.859+0000 7fa4c54ec640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4c01039d0 0x7fa4c0101680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:02.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:02.859+0000 7fa4c54ec640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4c01042f0 0x7fa4c0101bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:02.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:02.859+0000 7fa4c54ec640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4c010ce30 0x7fa4c0102100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:02.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:02.859+0000 7fa4c54ec640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c01129b0 con 0x7fa4c01042f0 2024-08-20T01:36:02.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:02.859+0000 7fa4c54ec640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c0112830 con 0x7fa4c01039d0 2024-08-20T01:36:02.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:02.859+0000 7fa4c54ec640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c0112b30 con 0x7fa4c010ce30 2024-08-20T01:36:02.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:02.859+0000 7fa4b7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4c01042f0 0x7fa4c0101bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:02.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:02.859+0000 7fa4b7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4c01042f0 0x7fa4c0101bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48010/0 (socket says 172.21.15.79:48010) 2024-08-20T01:36:02.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:02.859+0000 7fa4b7fff640 1 -- 172.21.15.79:0/1048864171 learned_addr learned my addr 172.21.15.79:0/1048864171 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:02.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:02.859+0000 7fa4beffd640 1 --2- 172.21.15.79:0/1048864171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4c01039d0 0x7fa4c0101680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:02.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:02.859+0000 7fa4bf7fe640 1 --2- 172.21.15.79:0/1048864171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4c010ce30 0x7fa4c0102100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:02.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:02.859+0000 7fa4b7fff640 1 -- 172.21.15.79:0/1048864171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4c010ce30 msgr2=0x7fa4c0102100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:02.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:02.859+0000 7fa4b7fff640 1 --2- 172.21.15.79:0/1048864171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4c010ce30 0x7fa4c0102100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:02.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:02.859+0000 7fa4b7fff640 1 -- 172.21.15.79:0/1048864171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4c01039d0 msgr2=0x7fa4c0101680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:02.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:02.859+0000 7fa4b7fff640 1 --2- 172.21.15.79:0/1048864171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4c01039d0 0x7fa4c0101680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:02.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:02.859+0000 7fa4b7fff640 1 -- 172.21.15.79:0/1048864171 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4c01a7680 con 0x7fa4c01042f0 2024-08-20T01:36:02.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:02.859+0000 7fa4b7fff640 1 --2- 172.21.15.79:0/1048864171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4c01042f0 0x7fa4c0101bc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa4a800b3c0 tx=0x7fa4a800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:02.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:02.859+0000 7fa4bcff9640 1 -- 172.21.15.79:0/1048864171 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a8011830 con 0x7fa4c01042f0 2024-08-20T01:36:02.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:02.859+0000 7fa4bcff9640 1 -- 172.21.15.79:0/1048864171 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa4a8016070 con 0x7fa4c01042f0 2024-08-20T01:36:02.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:02.859+0000 7fa4c54ec640 1 -- 172.21.15.79:0/1048864171 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4c01a7970 con 0x7fa4c01042f0 2024-08-20T01:36:02.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:02.859+0000 7fa4bcff9640 1 -- 172.21.15.79:0/1048864171 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a8010d20 con 0x7fa4c01042f0 2024-08-20T01:36:02.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:02.859+0000 7fa4c54ec640 1 -- 172.21.15.79:0/1048864171 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4c01a7f30 con 0x7fa4c01042f0 2024-08-20T01:36:02.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:02.860+0000 7fa4c54ec640 1 -- 172.21.15.79:0/1048864171 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4c0103db0 con 0x7fa4c01042f0 2024-08-20T01:36:02.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:02.862+0000 7fa4bcff9640 1 -- 172.21.15.79:0/1048864171 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fa4a80119d0 con 0x7fa4c01042f0 2024-08-20T01:36:02.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:02.862+0000 7fa4bcff9640 1 --2- 172.21.15.79:0/1048864171 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa4ac0b3c60 0x7fa4ac0b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:02.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:02.862+0000 7fa4beffd640 1 --2- 172.21.15.79:0/1048864171 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa4ac0b3c60 0x7fa4ac0b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:02.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:02.863+0000 7fa4bcff9640 1 -- 172.21.15.79:0/1048864171 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fa4a80e38f0 con 0x7fa4c01042f0 2024-08-20T01:36:02.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:02.863+0000 7fa4beffd640 1 --2- 172.21.15.79:0/1048864171 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa4ac0b3c60 0x7fa4ac0b6120 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa4b00057c0 tx=0x7fa4b00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:02.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:02.865+0000 7fa4bcff9640 1 -- 172.21.15.79:0/1048864171 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fa4a80aaf00 con 0x7fa4c01042f0 2024-08-20T01:36:03.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:03.040+0000 7fa4c54ec640 1 -- 172.21.15.79:0/1048864171 --> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa4c006ae90 con 0x7fa4ac0b3c60 2024-08-20T01:36:03.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:03.044+0000 7fa4bcff9640 1 -- 172.21.15.79:0/1048864171 <== mgr.14150 v2:172.21.15.79:6800/3038112779 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258762 (secure 0 0 0) 0x7fa4c006ae90 con 0x7fa4ac0b3c60 2024-08-20T01:36:03.049 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:36:03.062 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-08-20T01:36:03.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:03.047+0000 7fa4c54ec640 1 -- 172.21.15.79:0/1048864171 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa4ac0b3c60 msgr2=0x7fa4ac0b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:03.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:03.047+0000 7fa4c54ec640 1 --2- 172.21.15.79:0/1048864171 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa4ac0b3c60 0x7fa4ac0b6120 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa4b00057c0 tx=0x7fa4b00058d0 comp rx=0 tx=0).stop 2024-08-20T01:36:03.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:03.047+0000 7fa4c54ec640 1 -- 172.21.15.79:0/1048864171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4c01042f0 msgr2=0x7fa4c0101bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:03.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:03.047+0000 7fa4c54ec640 1 --2- 172.21.15.79:0/1048864171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4c01042f0 0x7fa4c0101bc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa4a800b3c0 tx=0x7fa4a800b880 comp rx=0 tx=0).stop 2024-08-20T01:36:03.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:03.047+0000 7fa4c54ec640 1 -- 172.21.15.79:0/1048864171 shutdown_connections 2024-08-20T01:36:03.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:03.047+0000 7fa4c54ec640 1 --2- 172.21.15.79:0/1048864171 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa4ac0b3c60 0x7fa4ac0b6120 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:03.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:03.047+0000 7fa4c54ec640 1 --2- 172.21.15.79:0/1048864171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4c010ce30 0x7fa4c0102100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:03.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:03.047+0000 7fa4c54ec640 1 --2- 172.21.15.79:0/1048864171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4c01042f0 0x7fa4c0101bc0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:03.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:03.047+0000 7fa4c54ec640 1 --2- 172.21.15.79:0/1048864171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4c01039d0 0x7fa4c0101680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:03.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:03.047+0000 7fa4c54ec640 1 -- 172.21.15.79:0/1048864171 >> 172.21.15.79:0/1048864171 conn(0x7fa4c00fd410 msgr2=0x7fa4c00fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:03.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:03.047+0000 7fa4c54ec640 1 -- 172.21.15.79:0/1048864171 shutdown_connections 2024-08-20T01:36:03.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:03.047+0000 7fa4c54ec640 1 -- 172.21.15.79:0/1048864171 wait complete. 2024-08-20T01:36:03.741 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":309,"stamp":"2024-08-20T01:36:02.484647+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656786,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":645,"num_read_kb":419,"num_write":365,"num_write_kb":2284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2951952,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":300,"ondisk_log_size":300,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":361056,"kb_used_data":11724,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124580768,"statfs":{"total":1151940427776,"available":1151570706432,"internally_reserved":0,"allocated":12005376,"data_stored":6684030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":357414203},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":44,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.707201"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779232+0000","last_change":"2024-08-20T01:34:54.368243+0000","last_active":"2024-08-20T01:35:53.779232+0000","last_peered":"2024-08-20T01:35:53.779232+0000","last_clean":"2024-08-20T01:35:53.779232+0000","last_became_active":"2024-08-20T01:34:54.367712+0000","last_became_peered":"2024-08-20T01:34:54.367712+0000","last_unstale":"2024-08-20T01:35:53.779232+0000","last_undegraded":"2024-08-20T01:35:53.779232+0000","last_fullsized":"2024-08-20T01:35:53.779232+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:48:31.179090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779847+0000","last_change":"2024-08-20T01:34:54.371126+0000","last_active":"2024-08-20T01:35:53.779847+0000","last_peered":"2024-08-20T01:35:53.779847+0000","last_clean":"2024-08-20T01:35:53.779847+0000","last_became_active":"2024-08-20T01:34:54.370821+0000","last_became_peered":"2024-08-20T01:34:54.370821+0000","last_unstale":"2024-08-20T01:35:53.779847+0000","last_undegraded":"2024-08-20T01:35:53.779847+0000","last_fullsized":"2024-08-20T01:35:53.779847+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:37:41.175264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.780285+0000","last_change":"2024-08-20T01:34:54.373051+0000","last_active":"2024-08-20T01:35:53.780285+0000","last_peered":"2024-08-20T01:35:53.780285+0000","last_clean":"2024-08-20T01:35:53.780285+0000","last_became_active":"2024-08-20T01:34:54.372783+0000","last_became_peered":"2024-08-20T01:34:54.372783+0000","last_unstale":"2024-08-20T01:35:53.780285+0000","last_undegraded":"2024-08-20T01:35:53.780285+0000","last_fullsized":"2024-08-20T01:35:53.780285+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:12:49.630968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.797782+0000","last_change":"2024-08-20T01:34:54.372395+0000","last_active":"2024-08-20T01:35:53.797782+0000","last_peered":"2024-08-20T01:35:53.797782+0000","last_clean":"2024-08-20T01:35:53.797782+0000","last_became_active":"2024-08-20T01:34:54.371804+0000","last_became_peered":"2024-08-20T01:34:54.371804+0000","last_unstale":"2024-08-20T01:35:53.797782+0000","last_undegraded":"2024-08-20T01:35:53.797782+0000","last_fullsized":"2024-08-20T01:35:53.797782+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:01:14.395727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.782215+0000","last_change":"2024-08-20T01:34:54.379200+0000","last_active":"2024-08-20T01:35:53.782215+0000","last_peered":"2024-08-20T01:35:53.782215+0000","last_clean":"2024-08-20T01:35:53.782215+0000","last_became_active":"2024-08-20T01:34:54.378828+0000","last_became_peered":"2024-08-20T01:34:54.378828+0000","last_unstale":"2024-08-20T01:35:53.782215+0000","last_undegraded":"2024-08-20T01:35:53.782215+0000","last_fullsized":"2024-08-20T01:35:53.782215+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:27:09.672074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796880+0000","last_change":"2024-08-20T01:34:54.377871+0000","last_active":"2024-08-20T01:35:53.796880+0000","last_peered":"2024-08-20T01:35:53.796880+0000","last_clean":"2024-08-20T01:35:53.796880+0000","last_became_active":"2024-08-20T01:34:54.376617+0000","last_became_peered":"2024-08-20T01:34:54.376617+0000","last_unstale":"2024-08-20T01:35:53.796880+0000","last_undegraded":"2024-08-20T01:35:53.796880+0000","last_fullsized":"2024-08-20T01:35:53.796880+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:17:09.740135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779347+0000","last_change":"2024-08-20T01:34:54.373761+0000","last_active":"2024-08-20T01:35:53.779347+0000","last_peered":"2024-08-20T01:35:53.779347+0000","last_clean":"2024-08-20T01:35:53.779347+0000","last_became_active":"2024-08-20T01:34:54.372944+0000","last_became_peered":"2024-08-20T01:34:54.372944+0000","last_unstale":"2024-08-20T01:35:53.779347+0000","last_undegraded":"2024-08-20T01:35:53.779347+0000","last_fullsized":"2024-08-20T01:35:53.779347+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:21:44.477970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.799746+0000","last_change":"2024-08-20T01:35:53.799340+0000","last_active":"2024-08-20T01:35:53.799746+0000","last_peered":"2024-08-20T01:35:53.799746+0000","last_clean":"2024-08-20T01:35:53.799746+0000","last_became_active":"2024-08-20T01:35:53.799002+0000","last_became_peered":"2024-08-20T01:35:53.799002+0000","last_unstale":"2024-08-20T01:35:53.799746+0000","last_undegraded":"2024-08-20T01:35:53.799746+0000","last_fullsized":"2024-08-20T01:35:53.799746+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:42:42.446756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.797086+0000","last_change":"2024-08-20T01:34:54.378350+0000","last_active":"2024-08-20T01:35:53.797086+0000","last_peered":"2024-08-20T01:35:53.797086+0000","last_clean":"2024-08-20T01:35:53.797086+0000","last_became_active":"2024-08-20T01:34:54.376524+0000","last_became_peered":"2024-08-20T01:34:54.376524+0000","last_unstale":"2024-08-20T01:35:53.797086+0000","last_undegraded":"2024-08-20T01:35:53.797086+0000","last_fullsized":"2024-08-20T01:35:53.797086+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:50:03.179130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.797975+0000","last_change":"2024-08-20T01:34:54.376098+0000","last_active":"2024-08-20T01:35:53.797975+0000","last_peered":"2024-08-20T01:35:53.797975+0000","last_clean":"2024-08-20T01:35:53.797975+0000","last_became_active":"2024-08-20T01:34:54.375671+0000","last_became_peered":"2024-08-20T01:34:54.375671+0000","last_unstale":"2024-08-20T01:35:53.797975+0000","last_undegraded":"2024-08-20T01:35:53.797975+0000","last_fullsized":"2024-08-20T01:35:53.797975+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:43:14.876302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779830+0000","last_change":"2024-08-20T01:34:54.374431+0000","last_active":"2024-08-20T01:35:53.779830+0000","last_peered":"2024-08-20T01:35:53.779830+0000","last_clean":"2024-08-20T01:35:53.779830+0000","last_became_active":"2024-08-20T01:34:54.374082+0000","last_became_peered":"2024-08-20T01:34:54.374082+0000","last_unstale":"2024-08-20T01:35:53.779830+0000","last_undegraded":"2024-08-20T01:35:53.779830+0000","last_fullsized":"2024-08-20T01:35:53.779830+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:11:10.046245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.797894+0000","last_change":"2024-08-20T01:34:54.372124+0000","last_active":"2024-08-20T01:35:53.797894+0000","last_peered":"2024-08-20T01:35:53.797894+0000","last_clean":"2024-08-20T01:35:53.797894+0000","last_became_active":"2024-08-20T01:34:54.371382+0000","last_became_peered":"2024-08-20T01:34:54.371382+0000","last_unstale":"2024-08-20T01:35:53.797894+0000","last_undegraded":"2024-08-20T01:35:53.797894+0000","last_fullsized":"2024-08-20T01:35:53.797894+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:29:38.715445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.778157+0000","last_change":"2024-08-20T01:34:54.372760+0000","last_active":"2024-08-20T01:35:53.778157+0000","last_peered":"2024-08-20T01:35:53.778157+0000","last_clean":"2024-08-20T01:35:53.778157+0000","last_became_active":"2024-08-20T01:34:54.372386+0000","last_became_peered":"2024-08-20T01:34:54.372386+0000","last_unstale":"2024-08-20T01:35:53.778157+0000","last_undegraded":"2024-08-20T01:35:53.778157+0000","last_fullsized":"2024-08-20T01:35:53.778157+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:30:32.873604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.780156+0000","last_change":"2024-08-20T01:34:54.371164+0000","last_active":"2024-08-20T01:35:53.780156+0000","last_peered":"2024-08-20T01:35:53.780156+0000","last_clean":"2024-08-20T01:35:53.780156+0000","last_became_active":"2024-08-20T01:34:54.370856+0000","last_became_peered":"2024-08-20T01:34:54.370856+0000","last_unstale":"2024-08-20T01:35:53.780156+0000","last_undegraded":"2024-08-20T01:35:53.780156+0000","last_fullsized":"2024-08-20T01:35:53.780156+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:14:26.803902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779978+0000","last_change":"2024-08-20T01:34:54.369595+0000","last_active":"2024-08-20T01:35:53.779978+0000","last_peered":"2024-08-20T01:35:53.779978+0000","last_clean":"2024-08-20T01:35:53.779978+0000","last_became_active":"2024-08-20T01:34:54.369285+0000","last_became_peered":"2024-08-20T01:34:54.369285+0000","last_unstale":"2024-08-20T01:35:53.779978+0000","last_undegraded":"2024-08-20T01:35:53.779978+0000","last_fullsized":"2024-08-20T01:35:53.779978+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:53:16.965300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796178+0000","last_change":"2024-08-20T01:34:54.366903+0000","last_active":"2024-08-20T01:35:53.796178+0000","last_peered":"2024-08-20T01:35:53.796178+0000","last_clean":"2024-08-20T01:35:53.796178+0000","last_became_active":"2024-08-20T01:34:54.366533+0000","last_became_peered":"2024-08-20T01:34:54.366533+0000","last_unstale":"2024-08-20T01:35:53.796178+0000","last_undegraded":"2024-08-20T01:35:53.796178+0000","last_fullsized":"2024-08-20T01:35:53.796178+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:11:23.025718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779337+0000","last_change":"2024-08-20T01:34:54.368616+0000","last_active":"2024-08-20T01:35:53.779337+0000","last_peered":"2024-08-20T01:35:53.779337+0000","last_clean":"2024-08-20T01:35:53.779337+0000","last_became_active":"2024-08-20T01:34:54.368267+0000","last_became_peered":"2024-08-20T01:34:54.368267+0000","last_unstale":"2024-08-20T01:35:53.779337+0000","last_undegraded":"2024-08-20T01:35:53.779337+0000","last_fullsized":"2024-08-20T01:35:53.779337+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:53:09.035458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.781911+0000","last_change":"2024-08-20T01:34:54.369182+0000","last_active":"2024-08-20T01:35:53.781911+0000","last_peered":"2024-08-20T01:35:53.781911+0000","last_clean":"2024-08-20T01:35:53.781911+0000","last_became_active":"2024-08-20T01:34:54.368862+0000","last_became_peered":"2024-08-20T01:34:54.368862+0000","last_unstale":"2024-08-20T01:35:53.781911+0000","last_undegraded":"2024-08-20T01:35:53.781911+0000","last_fullsized":"2024-08-20T01:35:53.781911+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:31:16.013266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796980+0000","last_change":"2024-08-20T01:34:54.368132+0000","last_active":"2024-08-20T01:35:53.796980+0000","last_peered":"2024-08-20T01:35:53.796980+0000","last_clean":"2024-08-20T01:35:53.796980+0000","last_became_active":"2024-08-20T01:34:54.366295+0000","last_became_peered":"2024-08-20T01:34:54.366295+0000","last_unstale":"2024-08-20T01:35:53.796980+0000","last_undegraded":"2024-08-20T01:35:53.796980+0000","last_fullsized":"2024-08-20T01:35:53.796980+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:52:23.928602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.785820+0000","last_change":"2024-08-20T01:35:53.785719+0000","last_active":"2024-08-20T01:35:53.785820+0000","last_peered":"2024-08-20T01:35:53.785820+0000","last_clean":"2024-08-20T01:35:53.785820+0000","last_became_active":"2024-08-20T01:35:53.785072+0000","last_became_peered":"2024-08-20T01:35:53.785072+0000","last_unstale":"2024-08-20T01:35:53.785820+0000","last_undegraded":"2024-08-20T01:35:53.785820+0000","last_fullsized":"2024-08-20T01:35:53.785820+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:52:22.034855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.778249+0000","last_change":"2024-08-20T01:34:54.366206+0000","last_active":"2024-08-20T01:35:53.778249+0000","last_peered":"2024-08-20T01:35:53.778249+0000","last_clean":"2024-08-20T01:35:53.778249+0000","last_became_active":"2024-08-20T01:34:54.365893+0000","last_became_peered":"2024-08-20T01:34:54.365893+0000","last_unstale":"2024-08-20T01:35:53.778249+0000","last_undegraded":"2024-08-20T01:35:53.778249+0000","last_fullsized":"2024-08-20T01:35:53.778249+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:39:22.610570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796415+0000","last_change":"2024-08-20T01:34:54.368091+0000","last_active":"2024-08-20T01:35:53.796415+0000","last_peered":"2024-08-20T01:35:53.796415+0000","last_clean":"2024-08-20T01:35:53.796415+0000","last_became_active":"2024-08-20T01:34:54.367626+0000","last_became_peered":"2024-08-20T01:34:54.367626+0000","last_unstale":"2024-08-20T01:35:53.796415+0000","last_undegraded":"2024-08-20T01:35:53.796415+0000","last_fullsized":"2024-08-20T01:35:53.796415+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:52:34.157094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796075+0000","last_change":"2024-08-20T01:34:54.370976+0000","last_active":"2024-08-20T01:35:53.796075+0000","last_peered":"2024-08-20T01:35:53.796075+0000","last_clean":"2024-08-20T01:35:53.796075+0000","last_became_active":"2024-08-20T01:34:54.368349+0000","last_became_peered":"2024-08-20T01:34:54.368349+0000","last_unstale":"2024-08-20T01:35:53.796075+0000","last_undegraded":"2024-08-20T01:35:53.796075+0000","last_fullsized":"2024-08-20T01:35:53.796075+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:53:48.846072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.782947+0000","last_change":"2024-08-20T01:34:54.379148+0000","last_active":"2024-08-20T01:35:53.782947+0000","last_peered":"2024-08-20T01:35:53.782947+0000","last_clean":"2024-08-20T01:35:53.782947+0000","last_became_active":"2024-08-20T01:34:54.378800+0000","last_became_peered":"2024-08-20T01:34:54.378800+0000","last_unstale":"2024-08-20T01:35:53.782947+0000","last_undegraded":"2024-08-20T01:35:53.782947+0000","last_fullsized":"2024-08-20T01:35:53.782947+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:42:47.382372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796240+0000","last_change":"2024-08-20T01:34:54.376972+0000","last_active":"2024-08-20T01:35:53.796240+0000","last_peered":"2024-08-20T01:35:53.796240+0000","last_clean":"2024-08-20T01:35:53.796240+0000","last_became_active":"2024-08-20T01:34:54.376701+0000","last_became_peered":"2024-08-20T01:34:54.376701+0000","last_unstale":"2024-08-20T01:35:53.796240+0000","last_undegraded":"2024-08-20T01:35:53.796240+0000","last_fullsized":"2024-08-20T01:35:53.796240+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:19:12.897732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.797084+0000","last_change":"2024-08-20T01:34:54.372699+0000","last_active":"2024-08-20T01:35:53.797084+0000","last_peered":"2024-08-20T01:35:53.797084+0000","last_clean":"2024-08-20T01:35:53.797084+0000","last_became_active":"2024-08-20T01:34:54.371170+0000","last_became_peered":"2024-08-20T01:34:54.371170+0000","last_unstale":"2024-08-20T01:35:53.797084+0000","last_undegraded":"2024-08-20T01:35:53.797084+0000","last_fullsized":"2024-08-20T01:35:53.797084+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:18:00.373087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779319+0000","last_change":"2024-08-20T01:34:54.373726+0000","last_active":"2024-08-20T01:35:53.779319+0000","last_peered":"2024-08-20T01:35:53.779319+0000","last_clean":"2024-08-20T01:35:53.779319+0000","last_became_active":"2024-08-20T01:34:54.373418+0000","last_became_peered":"2024-08-20T01:34:54.373418+0000","last_unstale":"2024-08-20T01:35:53.779319+0000","last_undegraded":"2024-08-20T01:35:53.779319+0000","last_fullsized":"2024-08-20T01:35:53.779319+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:55:28.791396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.778212+0000","last_change":"2024-08-20T01:34:54.371779+0000","last_active":"2024-08-20T01:35:53.778212+0000","last_peered":"2024-08-20T01:35:53.778212+0000","last_clean":"2024-08-20T01:35:53.778212+0000","last_became_active":"2024-08-20T01:34:54.370449+0000","last_became_peered":"2024-08-20T01:34:54.370449+0000","last_unstale":"2024-08-20T01:35:53.778212+0000","last_undegraded":"2024-08-20T01:35:53.778212+0000","last_fullsized":"2024-08-20T01:35:53.778212+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:03:22.153120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.785815+0000","last_change":"2024-08-20T01:35:53.785757+0000","last_active":"2024-08-20T01:35:53.785815+0000","last_peered":"2024-08-20T01:35:53.785815+0000","last_clean":"2024-08-20T01:35:53.785815+0000","last_became_active":"2024-08-20T01:35:53.784991+0000","last_became_peered":"2024-08-20T01:35:53.784991+0000","last_unstale":"2024-08-20T01:35:53.785815+0000","last_undegraded":"2024-08-20T01:35:53.785815+0000","last_fullsized":"2024-08-20T01:35:53.785815+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:46:28.442935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796584+0000","last_change":"2024-08-20T01:34:54.369948+0000","last_active":"2024-08-20T01:35:53.796584+0000","last_peered":"2024-08-20T01:35:53.796584+0000","last_clean":"2024-08-20T01:35:53.796584+0000","last_became_active":"2024-08-20T01:34:54.367453+0000","last_became_peered":"2024-08-20T01:34:54.367453+0000","last_unstale":"2024-08-20T01:35:53.796584+0000","last_undegraded":"2024-08-20T01:35:53.796584+0000","last_fullsized":"2024-08-20T01:35:53.796584+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:09:38.800219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796610+0000","last_change":"2024-08-20T01:34:54.373622+0000","last_active":"2024-08-20T01:35:53.796610+0000","last_peered":"2024-08-20T01:35:53.796610+0000","last_clean":"2024-08-20T01:35:53.796610+0000","last_became_active":"2024-08-20T01:34:54.373261+0000","last_became_peered":"2024-08-20T01:34:54.373261+0000","last_unstale":"2024-08-20T01:35:53.796610+0000","last_undegraded":"2024-08-20T01:35:53.796610+0000","last_fullsized":"2024-08-20T01:35:53.796610+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:21:03.471668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.778893+0000","last_change":"2024-08-20T01:34:54.374728+0000","last_active":"2024-08-20T01:35:53.778893+0000","last_peered":"2024-08-20T01:35:53.778893+0000","last_clean":"2024-08-20T01:35:53.778893+0000","last_became_active":"2024-08-20T01:34:54.374183+0000","last_became_peered":"2024-08-20T01:34:54.374183+0000","last_unstale":"2024-08-20T01:35:53.778893+0000","last_undegraded":"2024-08-20T01:35:53.778893+0000","last_fullsized":"2024-08-20T01:35:53.778893+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:39:40.203942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.782560+0000","last_change":"2024-08-20T01:34:54.372863+0000","last_active":"2024-08-20T01:35:53.782560+0000","last_peered":"2024-08-20T01:35:53.782560+0000","last_clean":"2024-08-20T01:35:53.782560+0000","last_became_active":"2024-08-20T01:34:54.372409+0000","last_became_peered":"2024-08-20T01:34:54.372409+0000","last_unstale":"2024-08-20T01:35:53.782560+0000","last_undegraded":"2024-08-20T01:35:53.782560+0000","last_fullsized":"2024-08-20T01:35:53.782560+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:22:51.676677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"72'5","reported_seq":82,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:56.519358+0000","last_change":"2024-08-20T01:34:52.343440+0000","last_active":"2024-08-20T01:35:56.519358+0000","last_peered":"2024-08-20T01:35:56.519358+0000","last_clean":"2024-08-20T01:35:56.519358+0000","last_became_active":"2024-08-20T01:34:52.343110+0000","last_became_peered":"2024-08-20T01:34:52.343110+0000","last_unstale":"2024-08-20T01:35:56.519358+0000","last_undegraded":"2024-08-20T01:35:56.519358+0000","last_fullsized":"2024-08-20T01:35:56.519358+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:46:51.406198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.783034+0000","last_change":"2024-08-20T01:34:54.379522+0000","last_active":"2024-08-20T01:35:53.783034+0000","last_peered":"2024-08-20T01:35:53.783034+0000","last_clean":"2024-08-20T01:35:53.783034+0000","last_became_active":"2024-08-20T01:34:54.378826+0000","last_became_peered":"2024-08-20T01:34:54.378826+0000","last_unstale":"2024-08-20T01:35:53.783034+0000","last_undegraded":"2024-08-20T01:35:53.783034+0000","last_fullsized":"2024-08-20T01:35:53.783034+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:49:59.985231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"72'7","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796989+0000","last_change":"2024-08-20T01:34:52.344483+0000","last_active":"2024-08-20T01:35:53.796989+0000","last_peered":"2024-08-20T01:35:53.796989+0000","last_clean":"2024-08-20T01:35:53.796989+0000","last_became_active":"2024-08-20T01:34:52.343940+0000","last_became_peered":"2024-08-20T01:34:52.343940+0000","last_unstale":"2024-08-20T01:35:53.796989+0000","last_undegraded":"2024-08-20T01:35:53.796989+0000","last_fullsized":"2024-08-20T01:35:53.796989+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:19:53.480527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"72'3","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.777959+0000","last_change":"2024-08-20T01:34:52.340732+0000","last_active":"2024-08-20T01:35:53.777959+0000","last_peered":"2024-08-20T01:35:53.777959+0000","last_clean":"2024-08-20T01:35:53.777959+0000","last_became_active":"2024-08-20T01:34:52.340367+0000","last_became_peered":"2024-08-20T01:34:52.340367+0000","last_unstale":"2024-08-20T01:35:53.777959+0000","last_undegraded":"2024-08-20T01:35:53.777959+0000","last_fullsized":"2024-08-20T01:35:53.777959+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:33:17.751642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796078+0000","last_change":"2024-08-20T01:34:54.370725+0000","last_active":"2024-08-20T01:35:53.796078+0000","last_peered":"2024-08-20T01:35:53.796078+0000","last_clean":"2024-08-20T01:35:53.796078+0000","last_became_active":"2024-08-20T01:34:54.370423+0000","last_became_peered":"2024-08-20T01:34:54.370423+0000","last_unstale":"2024-08-20T01:35:53.796078+0000","last_undegraded":"2024-08-20T01:35:53.796078+0000","last_fullsized":"2024-08-20T01:35:53.796078+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:03:30.081748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"72'3","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.783141+0000","last_change":"2024-08-20T01:34:52.348605+0000","last_active":"2024-08-20T01:35:53.783141+0000","last_peered":"2024-08-20T01:35:53.783141+0000","last_clean":"2024-08-20T01:35:53.783141+0000","last_became_active":"2024-08-20T01:34:52.348278+0000","last_became_peered":"2024-08-20T01:34:52.348278+0000","last_unstale":"2024-08-20T01:35:53.783141+0000","last_undegraded":"2024-08-20T01:35:53.783141+0000","last_fullsized":"2024-08-20T01:35:53.783141+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:19:40.243243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.781186+0000","last_change":"2024-08-20T01:34:54.365604+0000","last_active":"2024-08-20T01:35:53.781186+0000","last_peered":"2024-08-20T01:35:53.781186+0000","last_clean":"2024-08-20T01:35:53.781186+0000","last_became_active":"2024-08-20T01:34:54.365284+0000","last_became_peered":"2024-08-20T01:34:54.365284+0000","last_unstale":"2024-08-20T01:35:53.781186+0000","last_undegraded":"2024-08-20T01:35:53.781186+0000","last_fullsized":"2024-08-20T01:35:53.781186+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:41:57.017680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"72'4","reported_seq":131,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:57.519989+0000","last_change":"2024-08-20T01:34:52.344679+0000","last_active":"2024-08-20T01:35:57.519989+0000","last_peered":"2024-08-20T01:35:57.519989+0000","last_clean":"2024-08-20T01:35:57.519989+0000","last_became_active":"2024-08-20T01:34:52.344058+0000","last_became_peered":"2024-08-20T01:34:52.344058+0000","last_unstale":"2024-08-20T01:35:57.519989+0000","last_undegraded":"2024-08-20T01:35:57.519989+0000","last_fullsized":"2024-08-20T01:35:57.519989+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:27:40.079949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796657+0000","last_change":"2024-08-20T01:34:54.369724+0000","last_active":"2024-08-20T01:35:53.796657+0000","last_peered":"2024-08-20T01:35:53.796657+0000","last_clean":"2024-08-20T01:35:53.796657+0000","last_became_active":"2024-08-20T01:34:54.369403+0000","last_became_peered":"2024-08-20T01:34:54.369403+0000","last_unstale":"2024-08-20T01:35:53.796657+0000","last_undegraded":"2024-08-20T01:35:53.796657+0000","last_fullsized":"2024-08-20T01:35:53.796657+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:31:22.382794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"72'4","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779736+0000","last_change":"2024-08-20T01:34:52.346651+0000","last_active":"2024-08-20T01:35:53.779736+0000","last_peered":"2024-08-20T01:35:53.779736+0000","last_clean":"2024-08-20T01:35:53.779736+0000","last_became_active":"2024-08-20T01:34:52.346316+0000","last_became_peered":"2024-08-20T01:34:52.346316+0000","last_unstale":"2024-08-20T01:35:53.779736+0000","last_undegraded":"2024-08-20T01:35:53.779736+0000","last_fullsized":"2024-08-20T01:35:53.779736+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:48:34.382413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.780585+0000","last_change":"2024-08-20T01:34:54.375587+0000","last_active":"2024-08-20T01:35:53.780585+0000","last_peered":"2024-08-20T01:35:53.780585+0000","last_clean":"2024-08-20T01:35:53.780585+0000","last_became_active":"2024-08-20T01:34:54.374138+0000","last_became_peered":"2024-08-20T01:34:54.374138+0000","last_unstale":"2024-08-20T01:35:53.780585+0000","last_undegraded":"2024-08-20T01:35:53.780585+0000","last_fullsized":"2024-08-20T01:35:53.780585+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:02:46.817849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"72'5","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.784242+0000","last_change":"2024-08-20T01:34:52.559659+0000","last_active":"2024-08-20T01:35:53.784242+0000","last_peered":"2024-08-20T01:35:53.784242+0000","last_clean":"2024-08-20T01:35:53.784242+0000","last_became_active":"2024-08-20T01:34:52.559243+0000","last_became_peered":"2024-08-20T01:34:52.559243+0000","last_unstale":"2024-08-20T01:35:53.784242+0000","last_undegraded":"2024-08-20T01:35:53.784242+0000","last_fullsized":"2024-08-20T01:35:53.784242+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:49:02.314230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796588+0000","last_change":"2024-08-20T01:34:54.372965+0000","last_active":"2024-08-20T01:35:53.796588+0000","last_peered":"2024-08-20T01:35:53.796588+0000","last_clean":"2024-08-20T01:35:53.796588+0000","last_became_active":"2024-08-20T01:34:54.372286+0000","last_became_peered":"2024-08-20T01:34:54.372286+0000","last_unstale":"2024-08-20T01:35:53.796588+0000","last_undegraded":"2024-08-20T01:35:53.796588+0000","last_fullsized":"2024-08-20T01:35:53.796588+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:32:45.178137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"72'30","reported_seq":166,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:57.535462+0000","last_change":"2024-08-20T01:34:52.348907+0000","last_active":"2024-08-20T01:35:57.535462+0000","last_peered":"2024-08-20T01:35:57.535462+0000","last_clean":"2024-08-20T01:35:57.535462+0000","last_became_active":"2024-08-20T01:34:52.347853+0000","last_became_peered":"2024-08-20T01:34:52.347853+0000","last_unstale":"2024-08-20T01:35:57.535462+0000","last_undegraded":"2024-08-20T01:35:57.535462+0000","last_fullsized":"2024-08-20T01:35:57.535462+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:19:31.142154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59762,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":113,"num_read_kb":114,"num_write":32,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.784562+0000","last_change":"2024-08-20T01:34:54.376493+0000","last_active":"2024-08-20T01:35:53.784562+0000","last_peered":"2024-08-20T01:35:53.784562+0000","last_clean":"2024-08-20T01:35:53.784562+0000","last_became_active":"2024-08-20T01:34:54.376160+0000","last_became_peered":"2024-08-20T01:34:54.376160+0000","last_unstale":"2024-08-20T01:35:53.784562+0000","last_undegraded":"2024-08-20T01:35:53.784562+0000","last_fullsized":"2024-08-20T01:35:53.784562+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:59:03.431731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"72'9","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796753+0000","last_change":"2024-08-20T01:34:52.347516+0000","last_active":"2024-08-20T01:35:53.796753+0000","last_peered":"2024-08-20T01:35:53.796753+0000","last_clean":"2024-08-20T01:35:53.796753+0000","last_became_active":"2024-08-20T01:34:52.347134+0000","last_became_peered":"2024-08-20T01:34:52.347134+0000","last_unstale":"2024-08-20T01:35:53.796753+0000","last_undegraded":"2024-08-20T01:35:53.796753+0000","last_fullsized":"2024-08-20T01:35:53.796753+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:26:16.057472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.778058+0000","last_change":"2024-08-20T01:34:54.368083+0000","last_active":"2024-08-20T01:35:53.778058+0000","last_peered":"2024-08-20T01:35:53.778058+0000","last_clean":"2024-08-20T01:35:53.778058+0000","last_became_active":"2024-08-20T01:34:54.367815+0000","last_became_peered":"2024-08-20T01:34:54.367815+0000","last_unstale":"2024-08-20T01:35:53.778058+0000","last_undegraded":"2024-08-20T01:35:53.778058+0000","last_fullsized":"2024-08-20T01:35:53.778058+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:02:13.515114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"72'5","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.783037+0000","last_change":"2024-08-20T01:34:52.345104+0000","last_active":"2024-08-20T01:35:53.783037+0000","last_peered":"2024-08-20T01:35:53.783037+0000","last_clean":"2024-08-20T01:35:53.783037+0000","last_became_active":"2024-08-20T01:34:52.344776+0000","last_became_peered":"2024-08-20T01:34:52.344776+0000","last_unstale":"2024-08-20T01:35:53.783037+0000","last_undegraded":"2024-08-20T01:35:53.783037+0000","last_fullsized":"2024-08-20T01:35:53.783037+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:05:30.230328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779602+0000","last_change":"2024-08-20T01:34:54.369341+0000","last_active":"2024-08-20T01:35:53.779602+0000","last_peered":"2024-08-20T01:35:53.779602+0000","last_clean":"2024-08-20T01:35:53.779602+0000","last_became_active":"2024-08-20T01:34:54.369040+0000","last_became_peered":"2024-08-20T01:34:54.369040+0000","last_unstale":"2024-08-20T01:35:53.779602+0000","last_undegraded":"2024-08-20T01:35:53.779602+0000","last_fullsized":"2024-08-20T01:35:53.779602+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:20:07.403778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"72'5","reported_seq":84,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:58.516859+0000","last_change":"2024-08-20T01:34:52.346787+0000","last_active":"2024-08-20T01:35:58.516859+0000","last_peered":"2024-08-20T01:35:58.516859+0000","last_clean":"2024-08-20T01:35:58.516859+0000","last_became_active":"2024-08-20T01:34:52.345713+0000","last_became_peered":"2024-08-20T01:34:52.345713+0000","last_unstale":"2024-08-20T01:35:58.516859+0000","last_undegraded":"2024-08-20T01:35:58.516859+0000","last_fullsized":"2024-08-20T01:35:58.516859+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:33:06.861899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779302+0000","last_change":"2024-08-20T01:34:54.374153+0000","last_active":"2024-08-20T01:35:53.779302+0000","last_peered":"2024-08-20T01:35:53.779302+0000","last_clean":"2024-08-20T01:35:53.779302+0000","last_became_active":"2024-08-20T01:34:54.372804+0000","last_became_peered":"2024-08-20T01:34:54.372804+0000","last_unstale":"2024-08-20T01:35:53.779302+0000","last_undegraded":"2024-08-20T01:35:53.779302+0000","last_fullsized":"2024-08-20T01:35:53.779302+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:54:27.470643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"72'17","reported_seq":41,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.782185+0000","last_change":"2024-08-20T01:34:52.559701+0000","last_active":"2024-08-20T01:35:53.782185+0000","last_peered":"2024-08-20T01:35:53.782185+0000","last_clean":"2024-08-20T01:35:53.782185+0000","last_became_active":"2024-08-20T01:34:52.559378+0000","last_became_peered":"2024-08-20T01:34:52.559378+0000","last_unstale":"2024-08-20T01:35:53.782185+0000","last_undegraded":"2024-08-20T01:35:53.782185+0000","last_fullsized":"2024-08-20T01:35:53.782185+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:39:55.636492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.798844+0000","last_change":"2024-08-20T01:35:53.798283+0000","last_active":"2024-08-20T01:35:53.798844+0000","last_peered":"2024-08-20T01:35:53.798844+0000","last_clean":"2024-08-20T01:35:53.798844+0000","last_became_active":"2024-08-20T01:35:53.797903+0000","last_became_peered":"2024-08-20T01:35:53.797903+0000","last_unstale":"2024-08-20T01:35:53.798844+0000","last_undegraded":"2024-08-20T01:35:53.798844+0000","last_fullsized":"2024-08-20T01:35:53.798844+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:22:27.676567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"72'2","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.784675+0000","last_change":"2024-08-20T01:34:52.347574+0000","last_active":"2024-08-20T01:35:53.784675+0000","last_peered":"2024-08-20T01:35:53.784675+0000","last_clean":"2024-08-20T01:35:53.784675+0000","last_became_active":"2024-08-20T01:34:52.347250+0000","last_became_peered":"2024-08-20T01:34:52.347250+0000","last_unstale":"2024-08-20T01:35:53.784675+0000","last_undegraded":"2024-08-20T01:35:53.784675+0000","last_fullsized":"2024-08-20T01:35:53.784675+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:03:00.007548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779162+0000","last_change":"2024-08-20T01:34:54.376383+0000","last_active":"2024-08-20T01:35:53.779162+0000","last_peered":"2024-08-20T01:35:53.779162+0000","last_clean":"2024-08-20T01:35:53.779162+0000","last_became_active":"2024-08-20T01:34:54.376044+0000","last_became_peered":"2024-08-20T01:34:54.376044+0000","last_unstale":"2024-08-20T01:35:53.779162+0000","last_undegraded":"2024-08-20T01:35:53.779162+0000","last_fullsized":"2024-08-20T01:35:53.779162+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:31:15.814776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"72'5","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.778440+0000","last_change":"2024-08-20T01:34:52.343441+0000","last_active":"2024-08-20T01:35:53.778440+0000","last_peered":"2024-08-20T01:35:53.778440+0000","last_clean":"2024-08-20T01:35:53.778440+0000","last_became_active":"2024-08-20T01:34:52.343120+0000","last_became_peered":"2024-08-20T01:34:52.343120+0000","last_unstale":"2024-08-20T01:35:53.778440+0000","last_undegraded":"2024-08-20T01:35:53.778440+0000","last_fullsized":"2024-08-20T01:35:53.778440+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:44:11.309626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779847+0000","last_change":"2024-08-20T01:34:54.368986+0000","last_active":"2024-08-20T01:35:53.779847+0000","last_peered":"2024-08-20T01:35:53.779847+0000","last_clean":"2024-08-20T01:35:53.779847+0000","last_became_active":"2024-08-20T01:34:54.368611+0000","last_became_peered":"2024-08-20T01:34:54.368611+0000","last_unstale":"2024-08-20T01:35:53.779847+0000","last_undegraded":"2024-08-20T01:35:53.779847+0000","last_fullsized":"2024-08-20T01:35:53.779847+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:37:32.433584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"72'3","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.783920+0000","last_change":"2024-08-20T01:34:52.345863+0000","last_active":"2024-08-20T01:35:53.783920+0000","last_peered":"2024-08-20T01:35:53.783920+0000","last_clean":"2024-08-20T01:35:53.783920+0000","last_became_active":"2024-08-20T01:34:52.345555+0000","last_became_peered":"2024-08-20T01:34:52.345555+0000","last_unstale":"2024-08-20T01:35:53.783920+0000","last_undegraded":"2024-08-20T01:35:53.783920+0000","last_fullsized":"2024-08-20T01:35:53.783920+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:46:21.606019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"72'1","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779663+0000","last_change":"2024-08-20T01:34:54.379699+0000","last_active":"2024-08-20T01:35:53.779663+0000","last_peered":"2024-08-20T01:35:53.779663+0000","last_clean":"2024-08-20T01:35:53.779663+0000","last_became_active":"2024-08-20T01:34:54.379197+0000","last_became_peered":"2024-08-20T01:34:54.379197+0000","last_unstale":"2024-08-20T01:35:53.779663+0000","last_undegraded":"2024-08-20T01:35:53.779663+0000","last_fullsized":"2024-08-20T01:35:53.779663+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:31:15.249200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"72'5","reported_seq":84,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:58.525221+0000","last_change":"2024-08-20T01:34:52.559520+0000","last_active":"2024-08-20T01:35:58.525221+0000","last_peered":"2024-08-20T01:35:58.525221+0000","last_clean":"2024-08-20T01:35:58.525221+0000","last_became_active":"2024-08-20T01:34:52.559180+0000","last_became_peered":"2024-08-20T01:34:52.559180+0000","last_unstale":"2024-08-20T01:35:58.525221+0000","last_undegraded":"2024-08-20T01:35:58.525221+0000","last_fullsized":"2024-08-20T01:35:58.525221+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:48:35.667441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779834+0000","last_change":"2024-08-20T01:34:54.372709+0000","last_active":"2024-08-20T01:35:53.779834+0000","last_peered":"2024-08-20T01:35:53.779834+0000","last_clean":"2024-08-20T01:35:53.779834+0000","last_became_active":"2024-08-20T01:34:54.372277+0000","last_became_peered":"2024-08-20T01:34:54.372277+0000","last_unstale":"2024-08-20T01:35:53.779834+0000","last_undegraded":"2024-08-20T01:35:53.779834+0000","last_fullsized":"2024-08-20T01:35:53.779834+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:26:11.837805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":95,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779483+0000","last_change":"2024-08-20T01:33:44.019475+0000","last_active":"2024-08-20T01:35:53.779483+0000","last_peered":"2024-08-20T01:35:53.779483+0000","last_clean":"2024-08-20T01:35:53.779483+0000","last_became_active":"2024-08-20T01:33:44.013614+0000","last_became_peered":"2024-08-20T01:33:44.013614+0000","last_unstale":"2024-08-20T01:35:53.779483+0000","last_undegraded":"2024-08-20T01:35:53.779483+0000","last_fullsized":"2024-08-20T01:35:53.779483+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:30:31.021505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:30:31.021505+0000","last_clean_scrub_stamp":"2024-08-20T01:30:31.021505+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:41:49.124707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"72'6","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.797689+0000","last_change":"2024-08-20T01:34:52.346409+0000","last_active":"2024-08-20T01:35:53.797689+0000","last_peered":"2024-08-20T01:35:53.797689+0000","last_clean":"2024-08-20T01:35:53.797689+0000","last_became_active":"2024-08-20T01:34:52.345821+0000","last_became_peered":"2024-08-20T01:34:52.345821+0000","last_unstale":"2024-08-20T01:35:53.797689+0000","last_undegraded":"2024-08-20T01:35:53.797689+0000","last_fullsized":"2024-08-20T01:35:53.797689+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:17:11.282558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796328+0000","last_change":"2024-08-20T01:34:54.374804+0000","last_active":"2024-08-20T01:35:53.796328+0000","last_peered":"2024-08-20T01:35:53.796328+0000","last_clean":"2024-08-20T01:35:53.796328+0000","last_became_active":"2024-08-20T01:34:54.374252+0000","last_became_peered":"2024-08-20T01:34:54.374252+0000","last_unstale":"2024-08-20T01:35:53.796328+0000","last_undegraded":"2024-08-20T01:35:53.796328+0000","last_fullsized":"2024-08-20T01:35:53.796328+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:32:51.703703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"72'4","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779475+0000","last_change":"2024-08-20T01:34:52.341399+0000","last_active":"2024-08-20T01:35:53.779475+0000","last_peered":"2024-08-20T01:35:53.779475+0000","last_clean":"2024-08-20T01:35:53.779475+0000","last_became_active":"2024-08-20T01:34:52.341034+0000","last_became_peered":"2024-08-20T01:34:52.341034+0000","last_unstale":"2024-08-20T01:35:53.779475+0000","last_undegraded":"2024-08-20T01:35:53.779475+0000","last_fullsized":"2024-08-20T01:35:53.779475+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:10:44.804836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.777948+0000","last_change":"2024-08-20T01:34:54.366567+0000","last_active":"2024-08-20T01:35:53.777948+0000","last_peered":"2024-08-20T01:35:53.777948+0000","last_clean":"2024-08-20T01:35:53.777948+0000","last_became_active":"2024-08-20T01:34:54.366298+0000","last_became_peered":"2024-08-20T01:34:54.366298+0000","last_unstale":"2024-08-20T01:35:53.777948+0000","last_undegraded":"2024-08-20T01:35:53.777948+0000","last_fullsized":"2024-08-20T01:35:53.777948+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:14:26.805902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"72'5","reported_seq":81,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:56.513729+0000","last_change":"2024-08-20T01:34:52.559166+0000","last_active":"2024-08-20T01:35:56.513729+0000","last_peered":"2024-08-20T01:35:56.513729+0000","last_clean":"2024-08-20T01:35:56.513729+0000","last_became_active":"2024-08-20T01:34:52.558652+0000","last_became_peered":"2024-08-20T01:34:52.558652+0000","last_unstale":"2024-08-20T01:35:56.513729+0000","last_undegraded":"2024-08-20T01:35:56.513729+0000","last_fullsized":"2024-08-20T01:35:56.513729+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:45:13.374924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.783076+0000","last_change":"2024-08-20T01:34:54.371193+0000","last_active":"2024-08-20T01:35:53.783076+0000","last_peered":"2024-08-20T01:35:53.783076+0000","last_clean":"2024-08-20T01:35:53.783076+0000","last_became_active":"2024-08-20T01:34:54.370869+0000","last_became_peered":"2024-08-20T01:34:54.370869+0000","last_unstale":"2024-08-20T01:35:53.783076+0000","last_undegraded":"2024-08-20T01:35:53.783076+0000","last_fullsized":"2024-08-20T01:35:53.783076+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:23:36.683049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"72'5","reported_seq":84,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:59.518088+0000","last_change":"2024-08-20T01:34:52.348815+0000","last_active":"2024-08-20T01:35:59.518088+0000","last_peered":"2024-08-20T01:35:59.518088+0000","last_clean":"2024-08-20T01:35:59.518088+0000","last_became_active":"2024-08-20T01:34:52.348437+0000","last_became_peered":"2024-08-20T01:34:52.348437+0000","last_unstale":"2024-08-20T01:35:59.518088+0000","last_undegraded":"2024-08-20T01:35:59.518088+0000","last_fullsized":"2024-08-20T01:35:59.518088+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:55:15.090721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.797255+0000","last_change":"2024-08-20T01:34:54.376049+0000","last_active":"2024-08-20T01:35:53.797255+0000","last_peered":"2024-08-20T01:35:53.797255+0000","last_clean":"2024-08-20T01:35:53.797255+0000","last_became_active":"2024-08-20T01:34:54.375680+0000","last_became_peered":"2024-08-20T01:34:54.375680+0000","last_unstale":"2024-08-20T01:35:53.797255+0000","last_undegraded":"2024-08-20T01:35:53.797255+0000","last_fullsized":"2024-08-20T01:35:53.797255+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:42:12.499850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"72'1","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.785333+0000","last_change":"2024-08-20T01:35:53.785259+0000","last_active":"2024-08-20T01:35:53.785333+0000","last_peered":"2024-08-20T01:35:53.785333+0000","last_clean":"2024-08-20T01:35:53.785333+0000","last_became_active":"2024-08-20T01:35:53.784842+0000","last_became_peered":"2024-08-20T01:35:53.784842+0000","last_unstale":"2024-08-20T01:35:53.785333+0000","last_undegraded":"2024-08-20T01:35:53.785333+0000","last_fullsized":"2024-08-20T01:35:53.785333+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:55:09.411882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"72'1","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.797518+0000","last_change":"2024-08-20T01:34:54.369686+0000","last_active":"2024-08-20T01:35:53.797518+0000","last_peered":"2024-08-20T01:35:53.797518+0000","last_clean":"2024-08-20T01:35:53.797518+0000","last_became_active":"2024-08-20T01:34:54.369343+0000","last_became_peered":"2024-08-20T01:34:54.369343+0000","last_unstale":"2024-08-20T01:35:53.797518+0000","last_undegraded":"2024-08-20T01:35:53.797518+0000","last_fullsized":"2024-08-20T01:35:53.797518+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:00:39.775809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"72'4","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.791703+0000","last_change":"2024-08-20T01:35:53.791290+0000","last_active":"2024-08-20T01:35:53.791703+0000","last_peered":"2024-08-20T01:35:53.791703+0000","last_clean":"2024-08-20T01:35:53.791703+0000","last_became_active":"2024-08-20T01:35:53.783283+0000","last_became_peered":"2024-08-20T01:35:53.783283+0000","last_unstale":"2024-08-20T01:35:53.791703+0000","last_undegraded":"2024-08-20T01:35:53.791703+0000","last_fullsized":"2024-08-20T01:35:53.791703+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:54:40.774394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.778296+0000","last_change":"2024-08-20T01:34:54.376275+0000","last_active":"2024-08-20T01:35:53.778296+0000","last_peered":"2024-08-20T01:35:53.778296+0000","last_clean":"2024-08-20T01:35:53.778296+0000","last_became_active":"2024-08-20T01:34:54.375797+0000","last_became_peered":"2024-08-20T01:34:54.375797+0000","last_unstale":"2024-08-20T01:35:53.778296+0000","last_undegraded":"2024-08-20T01:35:53.778296+0000","last_fullsized":"2024-08-20T01:35:53.778296+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:01:37.172855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"72'14","reported_seq":37,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.781922+0000","last_change":"2024-08-20T01:34:52.342207+0000","last_active":"2024-08-20T01:35:53.781922+0000","last_peered":"2024-08-20T01:35:53.781922+0000","last_clean":"2024-08-20T01:35:53.781922+0000","last_became_active":"2024-08-20T01:34:52.341878+0000","last_became_peered":"2024-08-20T01:34:52.341878+0000","last_unstale":"2024-08-20T01:35:53.781922+0000","last_undegraded":"2024-08-20T01:35:53.781922+0000","last_fullsized":"2024-08-20T01:35:53.781922+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:29:36.374725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796394+0000","last_change":"2024-08-20T01:34:54.371162+0000","last_active":"2024-08-20T01:35:53.796394+0000","last_peered":"2024-08-20T01:35:53.796394+0000","last_clean":"2024-08-20T01:35:53.796394+0000","last_became_active":"2024-08-20T01:34:54.368442+0000","last_became_peered":"2024-08-20T01:34:54.368442+0000","last_unstale":"2024-08-20T01:35:53.796394+0000","last_undegraded":"2024-08-20T01:35:53.796394+0000","last_fullsized":"2024-08-20T01:35:53.796394+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:23:42.119533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"72'7","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.797237+0000","last_change":"2024-08-20T01:34:52.345551+0000","last_active":"2024-08-20T01:35:53.797237+0000","last_peered":"2024-08-20T01:35:53.797237+0000","last_clean":"2024-08-20T01:35:53.797237+0000","last_became_active":"2024-08-20T01:34:52.344212+0000","last_became_peered":"2024-08-20T01:34:52.344212+0000","last_unstale":"2024-08-20T01:35:53.797237+0000","last_undegraded":"2024-08-20T01:35:53.797237+0000","last_fullsized":"2024-08-20T01:35:53.797237+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:52:58.826394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.799263+0000","last_change":"2024-08-20T01:35:53.799194+0000","last_active":"2024-08-20T01:35:53.799263+0000","last_peered":"2024-08-20T01:35:53.799263+0000","last_clean":"2024-08-20T01:35:53.799263+0000","last_became_active":"2024-08-20T01:35:53.798865+0000","last_became_peered":"2024-08-20T01:35:53.798865+0000","last_unstale":"2024-08-20T01:35:53.799263+0000","last_undegraded":"2024-08-20T01:35:53.799263+0000","last_fullsized":"2024-08-20T01:35:53.799263+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:24:58.697929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"72'2","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796311+0000","last_change":"2024-08-20T01:34:52.560529+0000","last_active":"2024-08-20T01:35:53.796311+0000","last_peered":"2024-08-20T01:35:53.796311+0000","last_clean":"2024-08-20T01:35:53.796311+0000","last_became_active":"2024-08-20T01:34:52.560141+0000","last_became_peered":"2024-08-20T01:34:52.560141+0000","last_unstale":"2024-08-20T01:35:53.796311+0000","last_undegraded":"2024-08-20T01:35:53.796311+0000","last_fullsized":"2024-08-20T01:35:53.796311+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:02:13.367700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.782373+0000","last_change":"2024-08-20T01:34:54.377963+0000","last_active":"2024-08-20T01:35:53.782373+0000","last_peered":"2024-08-20T01:35:53.782373+0000","last_clean":"2024-08-20T01:35:53.782373+0000","last_became_active":"2024-08-20T01:34:54.377645+0000","last_became_peered":"2024-08-20T01:34:54.377645+0000","last_unstale":"2024-08-20T01:35:53.782373+0000","last_undegraded":"2024-08-20T01:35:53.782373+0000","last_fullsized":"2024-08-20T01:35:53.782373+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:36:11.888293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"72'7","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796210+0000","last_change":"2024-08-20T01:34:52.342262+0000","last_active":"2024-08-20T01:35:53.796210+0000","last_peered":"2024-08-20T01:35:53.796210+0000","last_clean":"2024-08-20T01:35:53.796210+0000","last_became_active":"2024-08-20T01:34:52.341919+0000","last_became_peered":"2024-08-20T01:34:52.341919+0000","last_unstale":"2024-08-20T01:35:53.796210+0000","last_undegraded":"2024-08-20T01:35:53.796210+0000","last_fullsized":"2024-08-20T01:35:53.796210+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:29:38.542146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.778966+0000","last_change":"2024-08-20T01:34:54.375741+0000","last_active":"2024-08-20T01:35:53.778966+0000","last_peered":"2024-08-20T01:35:53.778966+0000","last_clean":"2024-08-20T01:35:53.778966+0000","last_became_active":"2024-08-20T01:34:54.375409+0000","last_became_peered":"2024-08-20T01:34:54.375409+0000","last_unstale":"2024-08-20T01:35:53.778966+0000","last_undegraded":"2024-08-20T01:35:53.778966+0000","last_fullsized":"2024-08-20T01:35:53.778966+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:29:46.278762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"72'3","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796628+0000","last_change":"2024-08-20T01:34:52.346296+0000","last_active":"2024-08-20T01:35:53.796628+0000","last_peered":"2024-08-20T01:35:53.796628+0000","last_clean":"2024-08-20T01:35:53.796628+0000","last_became_active":"2024-08-20T01:34:52.345535+0000","last_became_peered":"2024-08-20T01:34:52.345535+0000","last_unstale":"2024-08-20T01:35:53.796628+0000","last_undegraded":"2024-08-20T01:35:53.796628+0000","last_fullsized":"2024-08-20T01:35:53.796628+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:32:23.126530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796546+0000","last_change":"2024-08-20T01:34:54.365720+0000","last_active":"2024-08-20T01:35:53.796546+0000","last_peered":"2024-08-20T01:35:53.796546+0000","last_clean":"2024-08-20T01:35:53.796546+0000","last_became_active":"2024-08-20T01:34:54.365406+0000","last_became_peered":"2024-08-20T01:34:54.365406+0000","last_unstale":"2024-08-20T01:35:53.796546+0000","last_undegraded":"2024-08-20T01:35:53.796546+0000","last_fullsized":"2024-08-20T01:35:53.796546+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:31:09.988882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"72'4","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.782477+0000","last_change":"2024-08-20T01:34:52.344263+0000","last_active":"2024-08-20T01:35:53.782477+0000","last_peered":"2024-08-20T01:35:53.782477+0000","last_clean":"2024-08-20T01:35:53.782477+0000","last_became_active":"2024-08-20T01:34:52.343706+0000","last_became_peered":"2024-08-20T01:34:52.343706+0000","last_unstale":"2024-08-20T01:35:53.782477+0000","last_undegraded":"2024-08-20T01:35:53.782477+0000","last_fullsized":"2024-08-20T01:35:53.782477+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:25:30.305116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779525+0000","last_change":"2024-08-20T01:34:54.374564+0000","last_active":"2024-08-20T01:35:53.779525+0000","last_peered":"2024-08-20T01:35:53.779525+0000","last_clean":"2024-08-20T01:35:53.779525+0000","last_became_active":"2024-08-20T01:34:54.374136+0000","last_became_peered":"2024-08-20T01:34:54.374136+0000","last_unstale":"2024-08-20T01:35:53.779525+0000","last_undegraded":"2024-08-20T01:35:53.779525+0000","last_fullsized":"2024-08-20T01:35:53.779525+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:33:12.972430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.798451+0000","last_change":"2024-08-20T01:35:53.798392+0000","last_active":"2024-08-20T01:35:53.798451+0000","last_peered":"2024-08-20T01:35:53.798451+0000","last_clean":"2024-08-20T01:35:53.798451+0000","last_became_active":"2024-08-20T01:35:53.798035+0000","last_became_peered":"2024-08-20T01:35:53.798035+0000","last_unstale":"2024-08-20T01:35:53.798451+0000","last_undegraded":"2024-08-20T01:35:53.798451+0000","last_fullsized":"2024-08-20T01:35:53.798451+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:52:47.630577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"72'5","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.783108+0000","last_change":"2024-08-20T01:34:52.346174+0000","last_active":"2024-08-20T01:35:53.783108+0000","last_peered":"2024-08-20T01:35:53.783108+0000","last_clean":"2024-08-20T01:35:53.783108+0000","last_became_active":"2024-08-20T01:34:52.345677+0000","last_became_peered":"2024-08-20T01:34:52.345677+0000","last_unstale":"2024-08-20T01:35:53.783108+0000","last_undegraded":"2024-08-20T01:35:53.783108+0000","last_fullsized":"2024-08-20T01:35:53.783108+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:23:38.692225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796480+0000","last_change":"2024-08-20T01:34:54.373515+0000","last_active":"2024-08-20T01:35:53.796480+0000","last_peered":"2024-08-20T01:35:53.796480+0000","last_clean":"2024-08-20T01:35:53.796480+0000","last_became_active":"2024-08-20T01:34:54.372954+0000","last_became_peered":"2024-08-20T01:34:54.372954+0000","last_unstale":"2024-08-20T01:35:53.796480+0000","last_undegraded":"2024-08-20T01:35:53.796480+0000","last_fullsized":"2024-08-20T01:35:53.796480+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:27:24.384924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"72'12","reported_seq":36,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.784666+0000","last_change":"2024-08-20T01:34:52.344089+0000","last_active":"2024-08-20T01:35:53.784666+0000","last_peered":"2024-08-20T01:35:53.784666+0000","last_clean":"2024-08-20T01:35:53.784666+0000","last_became_active":"2024-08-20T01:34:52.343354+0000","last_became_peered":"2024-08-20T01:34:52.343354+0000","last_unstale":"2024-08-20T01:35:53.784666+0000","last_undegraded":"2024-08-20T01:35:53.784666+0000","last_fullsized":"2024-08-20T01:35:53.784666+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:50:35.527307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.780489+0000","last_change":"2024-08-20T01:34:54.371931+0000","last_active":"2024-08-20T01:35:53.780489+0000","last_peered":"2024-08-20T01:35:53.780489+0000","last_clean":"2024-08-20T01:35:53.780489+0000","last_became_active":"2024-08-20T01:34:54.371385+0000","last_became_peered":"2024-08-20T01:34:54.371385+0000","last_unstale":"2024-08-20T01:35:53.780489+0000","last_undegraded":"2024-08-20T01:35:53.780489+0000","last_fullsized":"2024-08-20T01:35:53.780489+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:11:35.807145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"72'2","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796613+0000","last_change":"2024-08-20T01:34:52.559127+0000","last_active":"2024-08-20T01:35:53.796613+0000","last_peered":"2024-08-20T01:35:53.796613+0000","last_clean":"2024-08-20T01:35:53.796613+0000","last_became_active":"2024-08-20T01:34:52.558834+0000","last_became_peered":"2024-08-20T01:34:52.558834+0000","last_unstale":"2024-08-20T01:35:53.796613+0000","last_undegraded":"2024-08-20T01:35:53.796613+0000","last_fullsized":"2024-08-20T01:35:53.796613+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:57:35.879486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796415+0000","last_change":"2024-08-20T01:34:54.378164+0000","last_active":"2024-08-20T01:35:53.796415+0000","last_peered":"2024-08-20T01:35:53.796415+0000","last_clean":"2024-08-20T01:35:53.796415+0000","last_became_active":"2024-08-20T01:34:54.377863+0000","last_became_peered":"2024-08-20T01:34:54.377863+0000","last_unstale":"2024-08-20T01:35:53.796415+0000","last_undegraded":"2024-08-20T01:35:53.796415+0000","last_fullsized":"2024-08-20T01:35:53.796415+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:23:21.832692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"72'13","reported_seq":93,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:00.518762+0000","last_change":"2024-08-20T01:34:52.341730+0000","last_active":"2024-08-20T01:36:00.518762+0000","last_peered":"2024-08-20T01:36:00.518762+0000","last_clean":"2024-08-20T01:36:00.518762+0000","last_became_active":"2024-08-20T01:34:52.341407+0000","last_became_peered":"2024-08-20T01:34:52.341407+0000","last_unstale":"2024-08-20T01:36:00.518762+0000","last_undegraded":"2024-08-20T01:36:00.518762+0000","last_fullsized":"2024-08-20T01:36:00.518762+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:53:09.225154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66184,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":569,"num_read_kb":355,"num_write":240,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":198552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":66,"seq":283467841563,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":823296,"data_stored":394110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":61,"seq":261993005088,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36828,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708324,"statfs":{"total":95995035648,"available":95957323776,"internally_reserved":0,"allocated":1515520,"data_stored":1044789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":55,"seq":236223201316,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":839680,"data_stored":393928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":50,"seq":214748364841,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32000,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713152,"statfs":{"total":95995035648,"available":95962267648,"internally_reserved":0,"allocated":827392,"data_stored":394194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561070,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32592,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712560,"statfs":{"total":95995035648,"available":95961661440,"internally_reserved":0,"allocated":1433600,"data_stored":986433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":39,"seq":167503724595,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31992,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713160,"statfs":{"total":95995035648,"available":95962275840,"internally_reserved":0,"allocated":823296,"data_stored":393645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888120,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32600,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712552,"statfs":{"total":95995035648,"available":95961653248,"internally_reserved":0,"allocated":1445888,"data_stored":986111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084348,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":823296,"data_stored":393506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247872,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":839680,"data_stored":393470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444101,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":905216,"data_stored":454540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":884736,"data_stored":454320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":843776,"data_stored":394984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":61514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":61498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-20T01:36:03.745 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-20T01:36:03.746 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-20T01:36:03.746 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-08-20T01:36:03.746 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph health --format=json 2024-08-20T01:36:03.994 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:36:04.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:03 smithi079 ceph-mon[18656]: pgmap v309: 97 pgs: 97 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s; 11 B/s, 0 objects/s recovering 2024-08-20T01:36:04.237 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:03 smithi079 ceph-mon[18656]: from='client.15051 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:36:04.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:03 smithi081 ceph-mon[22209]: pgmap v309: 97 pgs: 97 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s; 11 B/s, 0 objects/s recovering 2024-08-20T01:36:04.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:03 smithi081 ceph-mon[22209]: from='client.15051 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:36:04.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:03 smithi175 ceph-mon[22392]: pgmap v309: 97 pgs: 97 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s; 11 B/s, 0 objects/s recovering 2024-08-20T01:36:04.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:03 smithi175 ceph-mon[22392]: from='client.15051 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:36:04.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.456+0000 7f54b2cee640 1 -- 172.21.15.79:0/3392479167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54ac1019d0 msgr2=0x7f54ac101db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:04.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.456+0000 7f54b2cee640 1 --2- 172.21.15.79:0/3392479167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54ac1019d0 0x7f54ac101db0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f54a4009900 tx=0x7f54a402a410 comp rx=0 tx=0).stop 2024-08-20T01:36:04.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.456+0000 7f54b2cee640 1 -- 172.21.15.79:0/3392479167 shutdown_connections 2024-08-20T01:36:04.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.456+0000 7f54b2cee640 1 --2- 172.21.15.79:0/3392479167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54ac107d60 0x7f54ac10e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:04.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.456+0000 7f54b2cee640 1 --2- 172.21.15.79:0/3392479167 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54ac1073e0 0x7f54ac107820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:04.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.456+0000 7f54b2cee640 1 --2- 172.21.15.79:0/3392479167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54ac1019d0 0x7f54ac101db0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:04.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.456+0000 7f54b2cee640 1 -- 172.21.15.79:0/3392479167 >> 172.21.15.79:0/3392479167 conn(0x7f54ac0fd440 msgr2=0x7f54ac0ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:04.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.456+0000 7f54b2cee640 1 -- 172.21.15.79:0/3392479167 shutdown_connections 2024-08-20T01:36:04.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.456+0000 7f54b2cee640 1 -- 172.21.15.79:0/3392479167 wait complete. 2024-08-20T01:36:04.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.456+0000 7f54b2cee640 1 Processor -- start 2024-08-20T01:36:04.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.457+0000 7f54b2cee640 1 -- start start 2024-08-20T01:36:04.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.457+0000 7f54b2cee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54ac1019d0 0x7f54ac19b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:04.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.457+0000 7f54b2cee640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54ac1073e0 0x7f54ac19b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:04.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.457+0000 7f54b2cee640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54ac107d60 0x7f54ac1a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:04.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.457+0000 7f54b2cee640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac1118d0 con 0x7f54ac1019d0 2024-08-20T01:36:04.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.457+0000 7f54b2cee640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac111750 con 0x7f54ac107d60 2024-08-20T01:36:04.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.457+0000 7f54b2cee640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac111a50 con 0x7f54ac1073e0 2024-08-20T01:36:04.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.457+0000 7f54b0a8a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54ac1019d0 0x7f54ac19b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:04.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.457+0000 7f54b0a8a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54ac1019d0 0x7f54ac19b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48022/0 (socket says 172.21.15.79:48022) 2024-08-20T01:36:04.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.457+0000 7f54b0a8a640 1 -- 172.21.15.79:0/1046556832 learned_addr learned my addr 172.21.15.79:0/1046556832 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:04.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.457+0000 7f54abfff640 1 --2- 172.21.15.79:0/1046556832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54ac1073e0 0x7f54ac19b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:04.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.457+0000 7f54b128b640 1 --2- 172.21.15.79:0/1046556832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54ac107d60 0x7f54ac1a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:04.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.457+0000 7f54b0a8a640 1 -- 172.21.15.79:0/1046556832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54ac1073e0 msgr2=0x7f54ac19b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:04.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.457+0000 7f54b0a8a640 1 --2- 172.21.15.79:0/1046556832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54ac1073e0 0x7f54ac19b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:04.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.457+0000 7f54b0a8a640 1 -- 172.21.15.79:0/1046556832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54ac107d60 msgr2=0x7f54ac1a0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:04.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.457+0000 7f54b0a8a640 1 --2- 172.21.15.79:0/1046556832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54ac107d60 0x7f54ac1a0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:04.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.457+0000 7f54b0a8a640 1 -- 172.21.15.79:0/1046556832 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54ac1a1220 con 0x7f54ac1019d0 2024-08-20T01:36:04.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.457+0000 7f54b0a8a640 1 --2- 172.21.15.79:0/1046556832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54ac1019d0 0x7f54ac19b170 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f54a4009230 tx=0x7f54a4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:04.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.458+0000 7f54a9ffb640 1 -- 172.21.15.79:0/1046556832 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a403f030 con 0x7f54ac1019d0 2024-08-20T01:36:04.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.458+0000 7f54a9ffb640 1 -- 172.21.15.79:0/1046556832 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f54a4003a80 con 0x7f54ac1019d0 2024-08-20T01:36:04.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.458+0000 7f54b2cee640 1 -- 172.21.15.79:0/1046556832 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54ac1a14b0 con 0x7f54ac1019d0 2024-08-20T01:36:04.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.458+0000 7f54a9ffb640 1 -- 172.21.15.79:0/1046556832 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a4035070 con 0x7f54ac1019d0 2024-08-20T01:36:04.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.458+0000 7f54b2cee640 1 -- 172.21.15.79:0/1046556832 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54ac1a7bd0 con 0x7f54ac1019d0 2024-08-20T01:36:04.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.459+0000 7f54b2cee640 1 -- 172.21.15.79:0/1046556832 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54ac101db0 con 0x7f54ac1019d0 2024-08-20T01:36:04.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.460+0000 7f54a9ffb640 1 -- 172.21.15.79:0/1046556832 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f54a4042030 con 0x7f54ac1019d0 2024-08-20T01:36:04.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.461+0000 7f54a9ffb640 1 --2- 172.21.15.79:0/1046556832 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f54980b3c60 0x7f54980b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:04.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.461+0000 7f54abfff640 1 --2- 172.21.15.79:0/1046556832 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f54980b3c60 0x7f54980b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:04.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.461+0000 7f54a9ffb640 1 -- 172.21.15.79:0/1046556832 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f54a4104830 con 0x7f54ac1019d0 2024-08-20T01:36:04.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.461+0000 7f54abfff640 1 --2- 172.21.15.79:0/1046556832 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f54980b3c60 0x7f54980b6120 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f54ac1009e0 tx=0x7f549c009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:04.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.464+0000 7f54a9ffb640 1 -- 172.21.15.79:0/1046556832 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f54a40cb6e0 con 0x7f54ac1019d0 2024-08-20T01:36:04.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.677+0000 7f54b2cee640 1 -- 172.21.15.79:0/1046556832 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f54ac1a7e30 con 0x7f54ac1019d0 2024-08-20T01:36:04.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.678+0000 7f54a9ffb640 1 -- 172.21.15.79:0/1046556832 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f54a40cfc30 con 0x7f54ac1019d0 2024-08-20T01:36:04.679 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:36:04.679 INFO:teuthology.orchestra.run.smithi079.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-20T01:36:04.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.680+0000 7f54b2cee640 1 -- 172.21.15.79:0/1046556832 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f54980b3c60 msgr2=0x7f54980b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:04.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.680+0000 7f54b2cee640 1 --2- 172.21.15.79:0/1046556832 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f54980b3c60 0x7f54980b6120 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f54ac1009e0 tx=0x7f549c009680 comp rx=0 tx=0).stop 2024-08-20T01:36:04.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.680+0000 7f54b2cee640 1 -- 172.21.15.79:0/1046556832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54ac1019d0 msgr2=0x7f54ac19b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:04.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.680+0000 7f54b2cee640 1 --2- 172.21.15.79:0/1046556832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54ac1019d0 0x7f54ac19b170 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f54a4009230 tx=0x7f54a4004270 comp rx=0 tx=0).stop 2024-08-20T01:36:04.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.680+0000 7f54b2cee640 1 -- 172.21.15.79:0/1046556832 shutdown_connections 2024-08-20T01:36:04.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.680+0000 7f54b2cee640 1 --2- 172.21.15.79:0/1046556832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54ac107d60 0x7f54ac1a0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:04.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.680+0000 7f54b2cee640 1 --2- 172.21.15.79:0/1046556832 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f54980b3c60 0x7f54980b6120 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:04.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.680+0000 7f54b2cee640 1 --2- 172.21.15.79:0/1046556832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54ac1073e0 0x7f54ac19b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:04.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.680+0000 7f54b2cee640 1 --2- 172.21.15.79:0/1046556832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54ac1019d0 0x7f54ac19b170 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:04.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.680+0000 7f54b2cee640 1 -- 172.21.15.79:0/1046556832 >> 172.21.15.79:0/1046556832 conn(0x7f54ac0fd440 msgr2=0x7f54ac06b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:04.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.680+0000 7f54b2cee640 1 -- 172.21.15.79:0/1046556832 shutdown_connections 2024-08-20T01:36:04.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:04.680+0000 7f54b2cee640 1 -- 172.21.15.79:0/1046556832 wait complete. 2024-08-20T01:36:05.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:04 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/1046556832' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-08-20T01:36:05.334 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:04 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/1046556832' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-08-20T01:36:05.365 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-08-20T01:36:05.366 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:36:05.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:04 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/1046556832' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-08-20T01:36:05.622 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:36:06.170 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:05 smithi079 ceph-mon[18656]: pgmap v310: 97 pgs: 97 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 10 B/s, 0 objects/s recovering 2024-08-20T01:36:06.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.168+0000 7f4ee1c14640 1 -- 172.21.15.79:0/2906732712 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4edc107d20 msgr2=0x7f4edc10e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:06.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.168+0000 7f4ee1c14640 1 --2- 172.21.15.79:0/2906732712 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4edc107d20 0x7f4edc10e520 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4ed4009ca0 tx=0x7f4ed402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.168+0000 7f4ee1c14640 1 -- 172.21.15.79:0/2906732712 shutdown_connections 2024-08-20T01:36:06.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.168+0000 7f4ee1c14640 1 --2- 172.21.15.79:0/2906732712 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4edc107d20 0x7f4edc10e520 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.168+0000 7f4ee1c14640 1 --2- 172.21.15.79:0/2906732712 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4edc1073a0 0x7f4edc1077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.168+0000 7f4ee1c14640 1 --2- 172.21.15.79:0/2906732712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4edc101990 0x7f4edc101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.168+0000 7f4ee1c14640 1 -- 172.21.15.79:0/2906732712 >> 172.21.15.79:0/2906732712 conn(0x7f4edc0fd400 msgr2=0x7f4edc0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:06.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.168+0000 7f4ee1c14640 1 -- 172.21.15.79:0/2906732712 shutdown_connections 2024-08-20T01:36:06.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.168+0000 7f4ee1c14640 1 -- 172.21.15.79:0/2906732712 wait complete. 2024-08-20T01:36:06.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.169+0000 7f4ee1c14640 1 Processor -- start 2024-08-20T01:36:06.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.169+0000 7f4ee1c14640 1 -- start start 2024-08-20T01:36:06.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.169+0000 7f4ee1c14640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4edc101990 0x7f4edc19b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:06.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.169+0000 7f4ee1c14640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4edc1073a0 0x7f4edc19b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:06.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.169+0000 7f4ee1c14640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4edc107d20 0x7f4edc1a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:06.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.169+0000 7f4ee1c14640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4edc111920 con 0x7f4edc107d20 2024-08-20T01:36:06.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.169+0000 7f4ee1c14640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4edc1117a0 con 0x7f4edc101990 2024-08-20T01:36:06.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.169+0000 7f4ee1c14640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4edc111aa0 con 0x7f4edc1073a0 2024-08-20T01:36:06.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.169+0000 7f4edbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4edc107d20 0x7f4edc1a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:06.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.169+0000 7f4edbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4edc107d20 0x7f4edc1a0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48034/0 (socket says 172.21.15.79:48034) 2024-08-20T01:36:06.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.169+0000 7f4edbfff640 1 -- 172.21.15.79:0/1829593358 learned_addr learned my addr 172.21.15.79:0/1829593358 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:06.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.169+0000 7f4edaffd640 1 --2- 172.21.15.79:0/1829593358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4edc1073a0 0x7f4edc19b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:06.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.170+0000 7f4edb7fe640 1 --2- 172.21.15.79:0/1829593358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4edc101990 0x7f4edc19b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:06.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.170+0000 7f4edbfff640 1 -- 172.21.15.79:0/1829593358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4edc1073a0 msgr2=0x7f4edc19b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:06.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.170+0000 7f4edbfff640 1 --2- 172.21.15.79:0/1829593358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4edc1073a0 0x7f4edc19b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.170+0000 7f4edbfff640 1 -- 172.21.15.79:0/1829593358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4edc101990 msgr2=0x7f4edc19b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:06.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.170+0000 7f4edbfff640 1 --2- 172.21.15.79:0/1829593358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4edc101990 0x7f4edc19b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.170+0000 7f4edbfff640 1 -- 172.21.15.79:0/1829593358 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4edc1a12a0 con 0x7f4edc107d20 2024-08-20T01:36:06.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.170+0000 7f4edbfff640 1 --2- 172.21.15.79:0/1829593358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4edc107d20 0x7f4edc1a0ad0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4ed4005cc0 tx=0x7f4ed4032c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:06.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.170+0000 7f4ed8ff9640 1 -- 172.21.15.79:0/1829593358 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed4004040 con 0x7f4edc107d20 2024-08-20T01:36:06.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.170+0000 7f4ee1c14640 1 -- 172.21.15.79:0/1829593358 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4edc1a1530 con 0x7f4edc107d20 2024-08-20T01:36:06.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.170+0000 7f4ed8ff9640 1 -- 172.21.15.79:0/1829593358 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4ed4004670 con 0x7f4edc107d20 2024-08-20T01:36:06.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.170+0000 7f4ed8ff9640 1 -- 172.21.15.79:0/1829593358 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed4030cc0 con 0x7f4edc107d20 2024-08-20T01:36:06.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.170+0000 7f4ee1c14640 1 -- 172.21.15.79:0/1829593358 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4edc1a7c50 con 0x7f4edc107d20 2024-08-20T01:36:06.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.171+0000 7f4ee1c14640 1 -- 172.21.15.79:0/1829593358 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4edc101d70 con 0x7f4edc107d20 2024-08-20T01:36:06.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.173+0000 7f4ed8ff9640 1 -- 172.21.15.79:0/1829593358 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f4ed40041e0 con 0x7f4edc107d20 2024-08-20T01:36:06.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.174+0000 7f4ed8ff9640 1 --2- 172.21.15.79:0/1829593358 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4ec40b3c60 0x7f4ec40b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:06.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.174+0000 7f4edb7fe640 1 --2- 172.21.15.79:0/1829593358 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4ec40b3c60 0x7f4ec40b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:06.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.174+0000 7f4ed8ff9640 1 -- 172.21.15.79:0/1829593358 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f4ed4105500 con 0x7f4edc107d20 2024-08-20T01:36:06.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.174+0000 7f4edb7fe640 1 --2- 172.21.15.79:0/1829593358 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4ec40b3c60 0x7f4ec40b6120 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc009890 tx=0x7f4ecc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:06.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.176+0000 7f4ed8ff9640 1 -- 172.21.15.79:0/1829593358 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f4ed40ccb10 con 0x7f4edc107d20 2024-08-20T01:36:06.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:05 smithi081 ceph-mon[22209]: pgmap v310: 97 pgs: 97 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 10 B/s, 0 objects/s recovering 2024-08-20T01:36:06.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:05 smithi175 ceph-mon[22392]: pgmap v310: 97 pgs: 97 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 10 B/s, 0 objects/s recovering 2024-08-20T01:36:06.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.397+0000 7f4ee1c14640 1 -- 172.21.15.79:0/1829593358 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4edc19c320 con 0x7f4edc107d20 2024-08-20T01:36:06.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.397+0000 7f4ed8ff9640 1 -- 172.21.15.79:0/1829593358 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11973 (secure 0 0 0) 0x7f4edc19c320 con 0x7f4edc107d20 2024-08-20T01:36:06.399 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:36:06.399 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":27,"btime":"2024-08-20T01:35:06:437353+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14670,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/735082912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":735082912},{"type":"v1","addr":"172.21.15.79:6835","nonce":735082912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2150339873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2150339873},{"type":"v1","addr":"172.21.15.79:6837","nonce":2150339873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:34:55.133562+0000","modified":"2024-08-20T01:35:06.437339+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24539,"mds_1":24538,"mds_2":24523,"mds_3":24514,"mds_4":24512},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14724":{"gid":14724,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/1071242274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1071242274},{"type":"v1","addr":"172.21.15.79:6839","nonce":1071242274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14730":{"gid":14730,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6841/2448977611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":2448977611},{"type":"v1","addr":"172.21.15.79:6841","nonce":2448977611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/1257507005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1257507005},{"type":"v1","addr":"172.21.15.81:6833","nonce":1257507005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1499936216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1499936216},{"type":"v1","addr":"172.21.15.81:6835","nonce":1499936216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/1107229215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1107229215},{"type":"v1","addr":"172.21.15.175:6833","nonce":1107229215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6837/2073598870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2073598870},{"type":"v1","addr":"172.21.15.81:6837","nonce":2073598870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/2552601173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2552601173},{"type":"v1","addr":"172.21.15.175:6835","nonce":2552601173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6837/1767284089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1767284089},{"type":"v1","addr":"172.21.15.175:6837","nonce":1767284089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/1331748742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1331748742},{"type":"v1","addr":"172.21.15.175:6839","nonce":1331748742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/4098410583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":4098410583},{"type":"v1","addr":"172.21.15.81:6839","nonce":4098410583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24539,"qdb_cluster":[24539,24523,24514,24538,24512]},"id":1}]} 2024-08-20T01:36:06.400 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 27 2024-08-20T01:36:06.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.399+0000 7f4ee1c14640 1 -- 172.21.15.79:0/1829593358 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4ec40b3c60 msgr2=0x7f4ec40b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:06.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.399+0000 7f4ee1c14640 1 --2- 172.21.15.79:0/1829593358 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4ec40b3c60 0x7f4ec40b6120 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc009890 tx=0x7f4ecc008040 comp rx=0 tx=0).stop 2024-08-20T01:36:06.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.399+0000 7f4ee1c14640 1 -- 172.21.15.79:0/1829593358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4edc107d20 msgr2=0x7f4edc1a0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:06.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.399+0000 7f4ee1c14640 1 --2- 172.21.15.79:0/1829593358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4edc107d20 0x7f4edc1a0ad0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4ed4005cc0 tx=0x7f4ed4032c40 comp rx=0 tx=0).stop 2024-08-20T01:36:06.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.399+0000 7f4ee1c14640 1 -- 172.21.15.79:0/1829593358 shutdown_connections 2024-08-20T01:36:06.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.399+0000 7f4ee1c14640 1 --2- 172.21.15.79:0/1829593358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4edc107d20 0x7f4edc1a0ad0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.399+0000 7f4ee1c14640 1 --2- 172.21.15.79:0/1829593358 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4ec40b3c60 0x7f4ec40b6120 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.399+0000 7f4ee1c14640 1 --2- 172.21.15.79:0/1829593358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4edc1073a0 0x7f4edc19b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.399+0000 7f4ee1c14640 1 --2- 172.21.15.79:0/1829593358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4edc101990 0x7f4edc19b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:06.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.399+0000 7f4ee1c14640 1 -- 172.21.15.79:0/1829593358 >> 172.21.15.79:0/1829593358 conn(0x7f4edc0fd400 msgr2=0x7f4edc06afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:06.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.400+0000 7f4ee1c14640 1 -- 172.21.15.79:0/1829593358 shutdown_connections 2024-08-20T01:36:06.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:06.400+0000 7f4ee1c14640 1 -- 172.21.15.79:0/1829593358 wait complete. 2024-08-20T01:36:07.177 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:06 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/1829593358' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:36:07.205 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:36:07.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:06 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/1829593358' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:36:07.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:06 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/1829593358' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:36:07.453 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:36:07.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:07.908+0000 7fd1bac82640 1 -- 172.21.15.79:0/117706895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1b41073b0 msgr2=0x7fd1b41077f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:07.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:07.908+0000 7fd1bac82640 1 --2- 172.21.15.79:0/117706895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1b41073b0 0x7fd1b41077f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd1a0009900 tx=0x7fd1a002a410 comp rx=0 tx=0).stop 2024-08-20T01:36:07.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:07.908+0000 7fd1bac82640 1 -- 172.21.15.79:0/117706895 shutdown_connections 2024-08-20T01:36:07.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:07.908+0000 7fd1bac82640 1 --2- 172.21.15.79:0/117706895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b4107d30 0x7fd1b410e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:07.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:07.908+0000 7fd1bac82640 1 --2- 172.21.15.79:0/117706895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1b41073b0 0x7fd1b41077f0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:07.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:07.908+0000 7fd1bac82640 1 --2- 172.21.15.79:0/117706895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1b41019a0 0x7fd1b4101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:07.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:07.908+0000 7fd1bac82640 1 -- 172.21.15.79:0/117706895 >> 172.21.15.79:0/117706895 conn(0x7fd1b40fd430 msgr2=0x7fd1b40ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:07.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:07.908+0000 7fd1bac82640 1 -- 172.21.15.79:0/117706895 shutdown_connections 2024-08-20T01:36:07.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:07.908+0000 7fd1bac82640 1 -- 172.21.15.79:0/117706895 wait complete. 2024-08-20T01:36:07.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:07.909+0000 7fd1bac82640 1 Processor -- start 2024-08-20T01:36:07.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:07.909+0000 7fd1bac82640 1 -- start start 2024-08-20T01:36:07.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:07.909+0000 7fd1bac82640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b41019a0 0x7fd1b4198f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:07.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:07.909+0000 7fd1bac82640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1b41073b0 0x7fd1b4199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:07.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:07.909+0000 7fd1bac82640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1b4107d30 0x7fd1b419e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:07.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:07.909+0000 7fd1bac82640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd1b41129c0 con 0x7fd1b41073b0 2024-08-20T01:36:07.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:07.909+0000 7fd1bac82640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd1b4112840 con 0x7fd1b41019a0 2024-08-20T01:36:07.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:07.909+0000 7fd1bac82640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd1b4112b40 con 0x7fd1b4107d30 2024-08-20T01:36:07.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:07.909+0000 7fd1b3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1b41073b0 0x7fd1b4199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:07.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:07.909+0000 7fd1b3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1b41073b0 0x7fd1b4199470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48062/0 (socket says 172.21.15.79:48062) 2024-08-20T01:36:07.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:07.909+0000 7fd1b3fff640 1 -- 172.21.15.79:0/1117988678 learned_addr learned my addr 172.21.15.79:0/1117988678 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:07.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:07.909+0000 7fd1b8a1e640 1 --2- 172.21.15.79:0/1117988678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b41019a0 0x7fd1b4198f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:07.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:07.909+0000 7fd1b921f640 1 --2- 172.21.15.79:0/1117988678 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1b4107d30 0x7fd1b419e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:07.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:07.910+0000 7fd1b3fff640 1 -- 172.21.15.79:0/1117988678 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1b4107d30 msgr2=0x7fd1b419e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:07.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:07.910+0000 7fd1b3fff640 1 --2- 172.21.15.79:0/1117988678 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1b4107d30 0x7fd1b419e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:07.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:07.910+0000 7fd1b3fff640 1 -- 172.21.15.79:0/1117988678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b41019a0 msgr2=0x7fd1b4198f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:07.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:07.910+0000 7fd1b3fff640 1 --2- 172.21.15.79:0/1117988678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b41019a0 0x7fd1b4198f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:07.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:07.910+0000 7fd1b3fff640 1 -- 172.21.15.79:0/1117988678 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1b419efe0 con 0x7fd1b41073b0 2024-08-20T01:36:07.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:07.910+0000 7fd1b8a1e640 1 --2- 172.21.15.79:0/1117988678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b41019a0 0x7fd1b4198f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:36:07.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:07.910+0000 7fd1b921f640 1 --2- 172.21.15.79:0/1117988678 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1b4107d30 0x7fd1b419e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:36:07.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:07.910+0000 7fd1b3fff640 1 --2- 172.21.15.79:0/1117988678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1b41073b0 0x7fd1b4199470 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd1a0009230 tx=0x7fd1a0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:07.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:07.910+0000 7fd1b1ffb640 1 -- 172.21.15.79:0/1117988678 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a003f030 con 0x7fd1b41073b0 2024-08-20T01:36:07.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:07.910+0000 7fd1b1ffb640 1 -- 172.21.15.79:0/1117988678 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd1a0003a80 con 0x7fd1b41073b0 2024-08-20T01:36:07.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:07.910+0000 7fd1bac82640 1 -- 172.21.15.79:0/1117988678 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1b419f270 con 0x7fd1b41073b0 2024-08-20T01:36:07.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:07.910+0000 7fd1b1ffb640 1 -- 172.21.15.79:0/1117988678 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a0035070 con 0x7fd1b41073b0 2024-08-20T01:36:07.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:07.910+0000 7fd1bac82640 1 -- 172.21.15.79:0/1117988678 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1b41a5990 con 0x7fd1b41073b0 2024-08-20T01:36:07.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:07.911+0000 7fd1bac82640 1 -- 172.21.15.79:0/1117988678 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1b4101d80 con 0x7fd1b41073b0 2024-08-20T01:36:07.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:07.912+0000 7fd1b1ffb640 1 -- 172.21.15.79:0/1117988678 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fd1a0042030 con 0x7fd1b41073b0 2024-08-20T01:36:07.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:07.913+0000 7fd1b1ffb640 1 --2- 172.21.15.79:0/1117988678 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd1a40b3c60 0x7fd1a40b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:07.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:07.913+0000 7fd1b8a1e640 1 --2- 172.21.15.79:0/1117988678 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd1a40b3c60 0x7fd1a40b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:07.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:07.914+0000 7fd1b1ffb640 1 -- 172.21.15.79:0/1117988678 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fd1a01049b0 con 0x7fd1b41073b0 2024-08-20T01:36:07.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:07.914+0000 7fd1b8a1e640 1 --2- 172.21.15.79:0/1117988678 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd1a40b3c60 0x7fd1a40b6120 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd1a80058c0 tx=0x7fd1a8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:07.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:07.916+0000 7fd1b1ffb640 1 -- 172.21.15.79:0/1117988678 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fd1a00cbeb0 con 0x7fd1b41073b0 2024-08-20T01:36:08.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:08.127+0000 7fd1bac82640 1 -- 172.21.15.79:0/1117988678 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd1b419a060 con 0x7fd1b41073b0 2024-08-20T01:36:08.129 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:07 smithi079 ceph-mon[18656]: pgmap v311: 97 pgs: 97 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s; 9 B/s, 0 objects/s recovering 2024-08-20T01:36:08.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:08.127+0000 7fd1b1ffb640 1 -- 172.21.15.79:0/1117988678 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11973 (secure 0 0 0) 0x7fd1a00d4180 con 0x7fd1b41073b0 2024-08-20T01:36:08.130 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:36:08.130 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":27,"btime":"2024-08-20T01:35:06:437353+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14670,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/735082912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":735082912},{"type":"v1","addr":"172.21.15.79:6835","nonce":735082912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2150339873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2150339873},{"type":"v1","addr":"172.21.15.79:6837","nonce":2150339873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:34:55.133562+0000","modified":"2024-08-20T01:35:06.437339+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24539,"mds_1":24538,"mds_2":24523,"mds_3":24514,"mds_4":24512},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14724":{"gid":14724,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/1071242274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1071242274},{"type":"v1","addr":"172.21.15.79:6839","nonce":1071242274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14730":{"gid":14730,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6841/2448977611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":2448977611},{"type":"v1","addr":"172.21.15.79:6841","nonce":2448977611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/1257507005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1257507005},{"type":"v1","addr":"172.21.15.81:6833","nonce":1257507005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1499936216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1499936216},{"type":"v1","addr":"172.21.15.81:6835","nonce":1499936216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/1107229215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1107229215},{"type":"v1","addr":"172.21.15.175:6833","nonce":1107229215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6837/2073598870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2073598870},{"type":"v1","addr":"172.21.15.81:6837","nonce":2073598870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/2552601173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2552601173},{"type":"v1","addr":"172.21.15.175:6835","nonce":2552601173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6837/1767284089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1767284089},{"type":"v1","addr":"172.21.15.175:6837","nonce":1767284089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/1331748742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1331748742},{"type":"v1","addr":"172.21.15.175:6839","nonce":1331748742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/4098410583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":4098410583},{"type":"v1","addr":"172.21.15.81:6839","nonce":4098410583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24539,"qdb_cluster":[24539,24523,24514,24538,24512]},"id":1}]} 2024-08-20T01:36:08.130 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 27 2024-08-20T01:36:08.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:08.130+0000 7fd1bac82640 1 -- 172.21.15.79:0/1117988678 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd1a40b3c60 msgr2=0x7fd1a40b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:08.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:08.130+0000 7fd1bac82640 1 --2- 172.21.15.79:0/1117988678 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd1a40b3c60 0x7fd1a40b6120 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd1a80058c0 tx=0x7fd1a8005850 comp rx=0 tx=0).stop 2024-08-20T01:36:08.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:08.130+0000 7fd1bac82640 1 -- 172.21.15.79:0/1117988678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1b41073b0 msgr2=0x7fd1b4199470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:08.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:08.130+0000 7fd1bac82640 1 --2- 172.21.15.79:0/1117988678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1b41073b0 0x7fd1b4199470 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd1a0009230 tx=0x7fd1a0004270 comp rx=0 tx=0).stop 2024-08-20T01:36:08.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:08.130+0000 7fd1bac82640 1 -- 172.21.15.79:0/1117988678 shutdown_connections 2024-08-20T01:36:08.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:08.130+0000 7fd1bac82640 1 --2- 172.21.15.79:0/1117988678 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd1a40b3c60 0x7fd1a40b6120 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:08.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:08.130+0000 7fd1bac82640 1 --2- 172.21.15.79:0/1117988678 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1b4107d30 0x7fd1b419e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:08.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:08.130+0000 7fd1bac82640 1 --2- 172.21.15.79:0/1117988678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1b41073b0 0x7fd1b4199470 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:08.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:08.130+0000 7fd1bac82640 1 --2- 172.21.15.79:0/1117988678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b41019a0 0x7fd1b4198f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:08.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:08.130+0000 7fd1bac82640 1 -- 172.21.15.79:0/1117988678 >> 172.21.15.79:0/1117988678 conn(0x7fd1b40fd430 msgr2=0x7fd1b40ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:08.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:08.130+0000 7fd1bac82640 1 -- 172.21.15.79:0/1117988678 shutdown_connections 2024-08-20T01:36:08.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:08.130+0000 7fd1bac82640 1 -- 172.21.15.79:0/1117988678 wait complete. 2024-08-20T01:36:08.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:08 smithi081 ceph-mon[22209]: pgmap v311: 97 pgs: 97 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s; 9 B/s, 0 objects/s recovering 2024-08-20T01:36:08.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:08 smithi175 ceph-mon[22392]: pgmap v311: 97 pgs: 97 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s; 9 B/s, 0 objects/s recovering 2024-08-20T01:36:08.796 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-20T01:36:09.042 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:36:09.163 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:09 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/1117988678' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:36:09.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:09 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/1117988678' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:36:09.290 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:09 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/1117988678' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:36:09.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.576+0000 7fd2c4a4d640 1 -- 172.21.15.79:0/2921035964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2c0102ab0 msgr2=0x7fd2c0102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:09.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.576+0000 7fd2c4a4d640 1 --2- 172.21.15.79:0/2921035964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2c0102ab0 0x7fd2c0102e90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd2b0009900 tx=0x7fd2b002a410 comp rx=0 tx=0).stop 2024-08-20T01:36:09.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.577+0000 7fd2c4a4d640 1 -- 172.21.15.79:0/2921035964 shutdown_connections 2024-08-20T01:36:09.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.577+0000 7fd2c4a4d640 1 --2- 172.21.15.79:0/2921035964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2c0108e40 0x7fd2c010f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:09.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.577+0000 7fd2c4a4d640 1 --2- 172.21.15.79:0/2921035964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2c01084c0 0x7fd2c0108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:09.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.577+0000 7fd2c4a4d640 1 --2- 172.21.15.79:0/2921035964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2c0102ab0 0x7fd2c0102e90 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:09.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.577+0000 7fd2c4a4d640 1 -- 172.21.15.79:0/2921035964 >> 172.21.15.79:0/2921035964 conn(0x7fd2c00fe580 msgr2=0x7fd2c01009a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:09.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.577+0000 7fd2c4a4d640 1 -- 172.21.15.79:0/2921035964 shutdown_connections 2024-08-20T01:36:09.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.577+0000 7fd2c4a4d640 1 -- 172.21.15.79:0/2921035964 wait complete. 2024-08-20T01:36:09.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.577+0000 7fd2c4a4d640 1 Processor -- start 2024-08-20T01:36:09.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.577+0000 7fd2c4a4d640 1 -- start start 2024-08-20T01:36:09.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.578+0000 7fd2c4a4d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2c0102ab0 0x7fd2c0198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:09.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.578+0000 7fd2c4a4d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2c01084c0 0x7fd2c0199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:09.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.578+0000 7fd2c4a4d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2c0108e40 0x7fd2c019e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:09.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.578+0000 7fd2c4a4d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c01129b0 con 0x7fd2c01084c0 2024-08-20T01:36:09.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.578+0000 7fd2c4a4d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c0112830 con 0x7fd2c0108e40 2024-08-20T01:36:09.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.578+0000 7fd2c4a4d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c0112b30 con 0x7fd2c0102ab0 2024-08-20T01:36:09.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.578+0000 7fd2b7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2c01084c0 0x7fd2c0199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:09.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.578+0000 7fd2b7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2c01084c0 0x7fd2c0199400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48074/0 (socket says 172.21.15.79:48074) 2024-08-20T01:36:09.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.578+0000 7fd2b7fff640 1 -- 172.21.15.79:0/3123909062 learned_addr learned my addr 172.21.15.79:0/3123909062 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:09.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.578+0000 7fd2bed9d640 1 --2- 172.21.15.79:0/3123909062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2c0108e40 0x7fd2c019e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:09.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.578+0000 7fd2be59c640 1 --2- 172.21.15.79:0/3123909062 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2c0102ab0 0x7fd2c0198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:09.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.578+0000 7fd2b7fff640 1 -- 172.21.15.79:0/3123909062 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2c0102ab0 msgr2=0x7fd2c0198ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:09.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.578+0000 7fd2b7fff640 1 --2- 172.21.15.79:0/3123909062 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2c0102ab0 0x7fd2c0198ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:09.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.578+0000 7fd2b7fff640 1 -- 172.21.15.79:0/3123909062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2c0108e40 msgr2=0x7fd2c019e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:09.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.578+0000 7fd2b7fff640 1 --2- 172.21.15.79:0/3123909062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2c0108e40 0x7fd2c019e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:09.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.578+0000 7fd2b7fff640 1 -- 172.21.15.79:0/3123909062 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2c019ef70 con 0x7fd2c01084c0 2024-08-20T01:36:09.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.578+0000 7fd2be59c640 1 --2- 172.21.15.79:0/3123909062 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2c0102ab0 0x7fd2c0198ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:36:09.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.578+0000 7fd2bed9d640 1 --2- 172.21.15.79:0/3123909062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2c0108e40 0x7fd2c019e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:36:09.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.578+0000 7fd2b7fff640 1 --2- 172.21.15.79:0/3123909062 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2c01084c0 0x7fd2c0199400 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd2a800d950 tx=0x7fd2a800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:09.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.578+0000 7fd2b77fe640 1 -- 172.21.15.79:0/3123909062 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a8017070 con 0x7fd2c01084c0 2024-08-20T01:36:09.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.578+0000 7fd2c4a4d640 1 -- 172.21.15.79:0/3123909062 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2c019f260 con 0x7fd2c01084c0 2024-08-20T01:36:09.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.578+0000 7fd2b77fe640 1 -- 172.21.15.79:0/3123909062 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd2a8009c30 con 0x7fd2c01084c0 2024-08-20T01:36:09.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.578+0000 7fd2b77fe640 1 -- 172.21.15.79:0/3123909062 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a800f620 con 0x7fd2c01084c0 2024-08-20T01:36:09.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.578+0000 7fd2c4a4d640 1 -- 172.21.15.79:0/3123909062 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2c01a5920 con 0x7fd2c01084c0 2024-08-20T01:36:09.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.579+0000 7fd2c4a4d640 1 -- 172.21.15.79:0/3123909062 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2c0102e90 con 0x7fd2c01084c0 2024-08-20T01:36:09.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.581+0000 7fd2b77fe640 1 -- 172.21.15.79:0/3123909062 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fd2a8010460 con 0x7fd2c01084c0 2024-08-20T01:36:09.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.581+0000 7fd2b77fe640 1 --2- 172.21.15.79:0/3123909062 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd2ac0b3c60 0x7fd2ac0b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:09.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.581+0000 7fd2be59c640 1 --2- 172.21.15.79:0/3123909062 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd2ac0b3c60 0x7fd2ac0b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:09.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.581+0000 7fd2b77fe640 1 -- 172.21.15.79:0/3123909062 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fd2a80e3aa0 con 0x7fd2c01084c0 2024-08-20T01:36:09.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.582+0000 7fd2be59c640 1 --2- 172.21.15.79:0/3123909062 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd2ac0b3c60 0x7fd2ac0b6120 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd2b0000c00 tx=0x7fd2b0032c40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:09.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.584+0000 7fd2b77fe640 1 -- 172.21.15.79:0/3123909062 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fd2a80aafa0 con 0x7fd2c01084c0 2024-08-20T01:36:09.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.761+0000 7fd2c4a4d640 1 -- 172.21.15.79:0/3123909062 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd2c0199ff0 con 0x7fd2c01084c0 2024-08-20T01:36:09.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.762+0000 7fd2b77fe640 1 -- 172.21.15.79:0/3123909062 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22676 (secure 0 0 0) 0x7fd2c0199ff0 con 0x7fd2c01084c0 2024-08-20T01:36:09.765 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:36:09.765 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":74,"fsid":"28484e9a-5e93-11ef-bccf-c7b262605968","created":"2024-08-20T01:27:07.792689+0000","modified":"2024-08-20T01:35:53.774800+0000","last_up_change":"2024-08-20T01:34:05.838937+0000","last_in_change":"2024-08-20T01:33:43.645153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-20T01:30:30.693903+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-20T01:34:50.585939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-20T01:34:52.980599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ccdbeb3d-bb9d-4275-ad7e-49f2cc1222cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6803","nonce":1274927648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6805","nonce":1274927648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6809","nonce":1274927648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6807","nonce":1274927648}]},"public_addr":"172.21.15.79:6803/1274927648","cluster_addr":"172.21.15.79:6805/1274927648","heartbeat_back_addr":"172.21.15.79:6809/1274927648","heartbeat_front_addr":"172.21.15.79:6807/1274927648","state":["exists","up"]},{"osd":1,"uuid":"0906bc46-f89d-482d-9402-43d17e4246a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6801","nonce":1174012328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6803","nonce":1174012328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6807","nonce":1174012328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6805","nonce":1174012328}]},"public_addr":"172.21.15.81:6801/1174012328","cluster_addr":"172.21.15.81:6803/1174012328","heartbeat_back_addr":"172.21.15.81:6807/1174012328","heartbeat_front_addr":"172.21.15.81:6805/1174012328","state":["exists","up"]},{"osd":2,"uuid":"11d8fb9d-cb2c-41c8-994c-603a1d8e01a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6801","nonce":1132306232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6803","nonce":1132306232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6807","nonce":1132306232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6805","nonce":1132306232}]},"public_addr":"172.21.15.175:6801/1132306232","cluster_addr":"172.21.15.175:6803/1132306232","heartbeat_back_addr":"172.21.15.175:6807/1132306232","heartbeat_front_addr":"172.21.15.175:6805/1132306232","state":["exists","up"]},{"osd":3,"uuid":"29e35242-957f-404b-b99e-d4dd0045c35d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6811","nonce":1364181822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6813","nonce":1364181822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6817","nonce":1364181822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6815","nonce":1364181822}]},"public_addr":"172.21.15.79:6811/1364181822","cluster_addr":"172.21.15.79:6813/1364181822","heartbeat_back_addr":"172.21.15.79:6817/1364181822","heartbeat_front_addr":"172.21.15.79:6815/1364181822","state":["exists","up"]},{"osd":4,"uuid":"9139c469-270f-4465-8adb-1e748529fa68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6809","nonce":306873968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6811","nonce":306873968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6815","nonce":306873968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6813","nonce":306873968}]},"public_addr":"172.21.15.81:6809/306873968","cluster_addr":"172.21.15.81:6811/306873968","heartbeat_back_addr":"172.21.15.81:6815/306873968","heartbeat_front_addr":"172.21.15.81:6813/306873968","state":["exists","up"]},{"osd":5,"uuid":"6394e462-4510-45d6-bc99-8660085cb206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6809","nonce":3908133424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6811","nonce":3908133424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6815","nonce":3908133424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6813","nonce":3908133424}]},"public_addr":"172.21.15.175:6809/3908133424","cluster_addr":"172.21.15.175:6811/3908133424","heartbeat_back_addr":"172.21.15.175:6815/3908133424","heartbeat_front_addr":"172.21.15.175:6813/3908133424","state":["exists","up"]},{"osd":6,"uuid":"e8e51380-e2be-4c4c-82d8-d86306d9fc1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6819","nonce":3379368280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6821","nonce":3379368280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6825","nonce":3379368280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6823","nonce":3379368280}]},"public_addr":"172.21.15.79:6819/3379368280","cluster_addr":"172.21.15.79:6821/3379368280","heartbeat_back_addr":"172.21.15.79:6825/3379368280","heartbeat_front_addr":"172.21.15.79:6823/3379368280","state":["exists","up"]},{"osd":7,"uuid":"875f7876-a2ca-4254-a8cc-27eebb11cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6817","nonce":747356685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6819","nonce":747356685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6823","nonce":747356685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6821","nonce":747356685}]},"public_addr":"172.21.15.81:6817/747356685","cluster_addr":"172.21.15.81:6819/747356685","heartbeat_back_addr":"172.21.15.81:6823/747356685","heartbeat_front_addr":"172.21.15.81:6821/747356685","state":["exists","up"]},{"osd":8,"uuid":"d714a33b-8df5-411d-bc99-b33b4b27cc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6817","nonce":1537762925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6819","nonce":1537762925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6823","nonce":1537762925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6821","nonce":1537762925}]},"public_addr":"172.21.15.175:6817/1537762925","cluster_addr":"172.21.15.175:6819/1537762925","heartbeat_back_addr":"172.21.15.175:6823/1537762925","heartbeat_front_addr":"172.21.15.175:6821/1537762925","state":["exists","up"]},{"osd":9,"uuid":"82db8305-1d72-4bef-99d6-5486e4de5b03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6827","nonce":2400574113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6829","nonce":2400574113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6833","nonce":2400574113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6831","nonce":2400574113}]},"public_addr":"172.21.15.79:6827/2400574113","cluster_addr":"172.21.15.79:6829/2400574113","heartbeat_back_addr":"172.21.15.79:6833/2400574113","heartbeat_front_addr":"172.21.15.79:6831/2400574113","state":["exists","up"]},{"osd":10,"uuid":"797e1e3f-12b5-4958-9e1f-f796cffaaf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6825","nonce":4188407500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6827","nonce":4188407500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6831","nonce":4188407500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6829","nonce":4188407500}]},"public_addr":"172.21.15.81:6825/4188407500","cluster_addr":"172.21.15.81:6827/4188407500","heartbeat_back_addr":"172.21.15.81:6831/4188407500","heartbeat_front_addr":"172.21.15.81:6829/4188407500","state":["exists","up"]},{"osd":11,"uuid":"a4d218ae-5a41-4b34-9c4e-e795c4a6a16d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6825","nonce":451069549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6827","nonce":451069549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6831","nonce":451069549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6829","nonce":451069549}]},"public_addr":"172.21.15.175:6825/451069549","cluster_addr":"172.21.15.175:6827/451069549","heartbeat_back_addr":"172.21.15.175:6831/451069549","heartbeat_front_addr":"172.21.15.175:6829/451069549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:29:42.003425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:30:05.353547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:30:28.916727+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:30:52.845671+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:31:16.926826+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:31:39.840986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:32:04.013287+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:32:28.237482+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:32:51.270643+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:33:15.825156+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:33:40.037915+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:34:04.477377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":3,"to":7}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:0/1750500064":"2024-08-21T01:27:52.389553+0000","172.21.15.79:0/103962305":"2024-08-21T01:27:52.389553+0000","172.21.15.79:6800/4045769179":"2024-08-21T01:27:29.643647+0000","172.21.15.79:0/525482354":"2024-08-21T01:27:52.389553+0000","172.21.15.79:6801/4045769179":"2024-08-21T01:27:29.643647+0000","172.21.15.79:0/1023212241":"2024-08-21T01:27:29.643647+0000","172.21.15.79:0/2368377219":"2024-08-21T01:27:29.643647+0000","172.21.15.79:6801/3302536522":"2024-08-21T01:27:52.389553+0000","172.21.15.79:6800/3302536522":"2024-08-21T01:27:52.389553+0000","172.21.15.79:0/3498829332":"2024-08-21T01:27:29.643647+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-20T01:36:09.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.765+0000 7fd2c4a4d640 1 -- 172.21.15.79:0/3123909062 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd2ac0b3c60 msgr2=0x7fd2ac0b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:09.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.765+0000 7fd2c4a4d640 1 --2- 172.21.15.79:0/3123909062 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd2ac0b3c60 0x7fd2ac0b6120 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd2b0000c00 tx=0x7fd2b0032c40 comp rx=0 tx=0).stop 2024-08-20T01:36:09.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.765+0000 7fd2c4a4d640 1 -- 172.21.15.79:0/3123909062 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2c01084c0 msgr2=0x7fd2c0199400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:09.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.765+0000 7fd2c4a4d640 1 --2- 172.21.15.79:0/3123909062 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2c01084c0 0x7fd2c0199400 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd2a800d950 tx=0x7fd2a800de10 comp rx=0 tx=0).stop 2024-08-20T01:36:09.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.765+0000 7fd2c4a4d640 1 -- 172.21.15.79:0/3123909062 shutdown_connections 2024-08-20T01:36:09.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.765+0000 7fd2c4a4d640 1 --2- 172.21.15.79:0/3123909062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2c0108e40 0x7fd2c019e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:09.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.765+0000 7fd2c4a4d640 1 --2- 172.21.15.79:0/3123909062 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2c01084c0 0x7fd2c0199400 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:09.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.765+0000 7fd2c4a4d640 1 --2- 172.21.15.79:0/3123909062 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd2ac0b3c60 0x7fd2ac0b6120 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:09.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.765+0000 7fd2c4a4d640 1 --2- 172.21.15.79:0/3123909062 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2c0102ab0 0x7fd2c0198ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:09.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.765+0000 7fd2c4a4d640 1 -- 172.21.15.79:0/3123909062 >> 172.21.15.79:0/3123909062 conn(0x7fd2c00fe580 msgr2=0x7fd2c00fffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:09.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.765+0000 7fd2c4a4d640 1 -- 172.21.15.79:0/3123909062 shutdown_connections 2024-08-20T01:36:09.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:09.765+0000 7fd2c4a4d640 1 -- 172.21.15.79:0/3123909062 wait complete. 2024-08-20T01:36:10.118 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:10 smithi079 ceph-mon[18656]: pgmap v312: 97 pgs: 97 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s; 9 B/s, 0 objects/s recovering 2024-08-20T01:36:10.119 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:10 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/3123909062' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:36:10.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:10 smithi081 ceph-mon[22209]: pgmap v312: 97 pgs: 97 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s; 9 B/s, 0 objects/s recovering 2024-08-20T01:36:10.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:10 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/3123909062' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:36:10.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:10 smithi175 ceph-mon[22392]: pgmap v312: 97 pgs: 97 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s; 9 B/s, 0 objects/s recovering 2024-08-20T01:36:10.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:10 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/3123909062' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:36:10.421 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:36:10.668 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:36:11.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.125+0000 7f29624e2640 1 -- 172.21.15.79:0/3157188902 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f295c103850 msgr2=0x7f295c103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:11.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.125+0000 7f29624e2640 1 --2- 172.21.15.79:0/3157188902 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f295c103850 0x7f295c103c30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f294c009900 tx=0x7f294c02a410 comp rx=0 tx=0).stop 2024-08-20T01:36:11.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.125+0000 7f29624e2640 1 -- 172.21.15.79:0/3157188902 shutdown_connections 2024-08-20T01:36:11.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.125+0000 7f29624e2640 1 --2- 172.21.15.79:0/3157188902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f295c10ce00 0x7f295c10f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:11.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.125+0000 7f29624e2640 1 --2- 172.21.15.79:0/3157188902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f295c104250 0x7f295c10c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:11.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.125+0000 7f29624e2640 1 --2- 172.21.15.79:0/3157188902 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f295c103850 0x7f295c103c30 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:11.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.125+0000 7f29624e2640 1 -- 172.21.15.79:0/3157188902 >> 172.21.15.79:0/3157188902 conn(0x7f295c0fd400 msgr2=0x7f295c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:11.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.125+0000 7f29624e2640 1 -- 172.21.15.79:0/3157188902 shutdown_connections 2024-08-20T01:36:11.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.125+0000 7f29624e2640 1 -- 172.21.15.79:0/3157188902 wait complete. 2024-08-20T01:36:11.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.125+0000 7f29624e2640 1 Processor -- start 2024-08-20T01:36:11.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.125+0000 7f29624e2640 1 -- start start 2024-08-20T01:36:11.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.125+0000 7f29624e2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f295c103850 0x7f295c198fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:11.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.125+0000 7f29624e2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f295c104250 0x7f295c199500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:11.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.125+0000 7f29624e2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f295c10ce00 0x7f295c19e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:11.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.126+0000 7f29624e2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f295c112950 con 0x7f295c10ce00 2024-08-20T01:36:11.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.126+0000 7f29624e2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f295c1127d0 con 0x7f295c103850 2024-08-20T01:36:11.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.126+0000 7f29624e2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f295c112ad0 con 0x7f295c104250 2024-08-20T01:36:11.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.126+0000 7f2960a7f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f295c10ce00 0x7f295c19e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:11.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.126+0000 7f2960a7f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f295c10ce00 0x7f295c19e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48980/0 (socket says 172.21.15.79:48980) 2024-08-20T01:36:11.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.126+0000 7f2960a7f640 1 -- 172.21.15.79:0/2656557389 learned_addr learned my addr 172.21.15.79:0/2656557389 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:11.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.126+0000 7f295bfff640 1 --2- 172.21.15.79:0/2656557389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f295c103850 0x7f295c198fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:11.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.126+0000 7f2960a7f640 1 -- 172.21.15.79:0/2656557389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f295c104250 msgr2=0x7f295c199500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:11.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.126+0000 7f2960a7f640 1 --2- 172.21.15.79:0/2656557389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f295c104250 0x7f295c199500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:11.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.126+0000 7f2960a7f640 1 -- 172.21.15.79:0/2656557389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f295c103850 msgr2=0x7f295c198fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:11.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.126+0000 7f2960a7f640 1 --2- 172.21.15.79:0/2656557389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f295c103850 0x7f295c198fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:11.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.126+0000 7f2960a7f640 1 -- 172.21.15.79:0/2656557389 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f295c19f070 con 0x7f295c10ce00 2024-08-20T01:36:11.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.126+0000 7f2960a7f640 1 --2- 172.21.15.79:0/2656557389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f295c10ce00 0x7f295c19e8a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f295400b970 tx=0x7f295400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:11.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.126+0000 7f2959ffb640 1 -- 172.21.15.79:0/2656557389 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2954019070 con 0x7f295c10ce00 2024-08-20T01:36:11.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.126+0000 7f29624e2640 1 -- 172.21.15.79:0/2656557389 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f295c19f360 con 0x7f295c10ce00 2024-08-20T01:36:11.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.126+0000 7f2959ffb640 1 -- 172.21.15.79:0/2656557389 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2954014440 con 0x7f295c10ce00 2024-08-20T01:36:11.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.126+0000 7f2959ffb640 1 -- 172.21.15.79:0/2656557389 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29540075d0 con 0x7f295c10ce00 2024-08-20T01:36:11.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.126+0000 7f29624e2640 1 -- 172.21.15.79:0/2656557389 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f295c1a5bf0 con 0x7f295c10ce00 2024-08-20T01:36:11.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.127+0000 7f29624e2640 1 -- 172.21.15.79:0/2656557389 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f295c103c30 con 0x7f295c10ce00 2024-08-20T01:36:11.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.129+0000 7f2959ffb640 1 -- 172.21.15.79:0/2656557389 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f295401c070 con 0x7f295c10ce00 2024-08-20T01:36:11.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.129+0000 7f2959ffb640 1 --2- 172.21.15.79:0/2656557389 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f29480b3c60 0x7f29480b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:11.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.129+0000 7f295bfff640 1 --2- 172.21.15.79:0/2656557389 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f29480b3c60 0x7f29480b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:11.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.129+0000 7f2959ffb640 1 -- 172.21.15.79:0/2656557389 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f29540e3760 con 0x7f295c10ce00 2024-08-20T01:36:11.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.130+0000 7f295bfff640 1 --2- 172.21.15.79:0/2656557389 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f29480b3c60 0x7f29480b6120 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f294c000c00 tx=0x7f294c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:11.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.132+0000 7f2959ffb640 1 -- 172.21.15.79:0/2656557389 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f29540aad70 con 0x7f295c10ce00 2024-08-20T01:36:11.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.342+0000 7f29624e2640 1 -- 172.21.15.79:0/2656557389 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f295c107ef0 con 0x7f295c10ce00 2024-08-20T01:36:11.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.343+0000 7f2959ffb640 1 -- 172.21.15.79:0/2656557389 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11973 (secure 0 0 0) 0x7f29540b3040 con 0x7f295c10ce00 2024-08-20T01:36:11.345 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:36:11.345 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":27,"btime":"2024-08-20T01:35:06:437353+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14670,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/735082912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":735082912},{"type":"v1","addr":"172.21.15.79:6835","nonce":735082912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2150339873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2150339873},{"type":"v1","addr":"172.21.15.79:6837","nonce":2150339873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:34:55.133562+0000","modified":"2024-08-20T01:35:06.437339+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24539,"mds_1":24538,"mds_2":24523,"mds_3":24514,"mds_4":24512},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14724":{"gid":14724,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/1071242274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1071242274},{"type":"v1","addr":"172.21.15.79:6839","nonce":1071242274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14730":{"gid":14730,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6841/2448977611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":2448977611},{"type":"v1","addr":"172.21.15.79:6841","nonce":2448977611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/1257507005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1257507005},{"type":"v1","addr":"172.21.15.81:6833","nonce":1257507005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1499936216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1499936216},{"type":"v1","addr":"172.21.15.81:6835","nonce":1499936216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/1107229215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1107229215},{"type":"v1","addr":"172.21.15.175:6833","nonce":1107229215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6837/2073598870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2073598870},{"type":"v1","addr":"172.21.15.81:6837","nonce":2073598870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/2552601173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2552601173},{"type":"v1","addr":"172.21.15.175:6835","nonce":2552601173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6837/1767284089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1767284089},{"type":"v1","addr":"172.21.15.175:6837","nonce":1767284089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/1331748742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1331748742},{"type":"v1","addr":"172.21.15.175:6839","nonce":1331748742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/4098410583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":4098410583},{"type":"v1","addr":"172.21.15.81:6839","nonce":4098410583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24539,"qdb_cluster":[24539,24523,24514,24538,24512]},"id":1}]} 2024-08-20T01:36:11.345 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 27 2024-08-20T01:36:11.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.345+0000 7f29624e2640 1 -- 172.21.15.79:0/2656557389 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f29480b3c60 msgr2=0x7f29480b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:11.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.345+0000 7f29624e2640 1 --2- 172.21.15.79:0/2656557389 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f29480b3c60 0x7f29480b6120 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f294c000c00 tx=0x7f294c005a20 comp rx=0 tx=0).stop 2024-08-20T01:36:11.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.345+0000 7f29624e2640 1 -- 172.21.15.79:0/2656557389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f295c10ce00 msgr2=0x7f295c19e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:11.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.345+0000 7f29624e2640 1 --2- 172.21.15.79:0/2656557389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f295c10ce00 0x7f295c19e8a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f295400b970 tx=0x7f295400be30 comp rx=0 tx=0).stop 2024-08-20T01:36:11.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.345+0000 7f29624e2640 1 -- 172.21.15.79:0/2656557389 shutdown_connections 2024-08-20T01:36:11.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.345+0000 7f29624e2640 1 --2- 172.21.15.79:0/2656557389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f295c10ce00 0x7f295c19e8a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:11.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.345+0000 7f29624e2640 1 --2- 172.21.15.79:0/2656557389 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f29480b3c60 0x7f29480b6120 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:11.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.345+0000 7f29624e2640 1 --2- 172.21.15.79:0/2656557389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f295c104250 0x7f295c199500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:11.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.345+0000 7f29624e2640 1 --2- 172.21.15.79:0/2656557389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f295c103850 0x7f295c198fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:11.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.345+0000 7f29624e2640 1 -- 172.21.15.79:0/2656557389 >> 172.21.15.79:0/2656557389 conn(0x7f295c0fd400 msgr2=0x7f295c0fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:11.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.345+0000 7f29624e2640 1 -- 172.21.15.79:0/2656557389 shutdown_connections 2024-08-20T01:36:11.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:11.345+0000 7f29624e2640 1 -- 172.21.15.79:0/2656557389 wait complete. 2024-08-20T01:36:12.005 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-08-20T01:34:55.133562+0000', 'modified': '2024-08-20T01:35:06.437339+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24539, 'mds_1': 24538, 'mds_2': 24523, 'mds_3': 24514, 'mds_4': 24512}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14724': {'gid': 14724, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.79:6839/1071242274', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6838', 'nonce': 1071242274}, {'type': 'v1', 'addr': '172.21.15.79:6839', 'nonce': 1071242274}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14730': {'gid': 14730, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.79:6841/2448977611', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6840', 'nonce': 2448977611}, {'type': 'v1', 'addr': '172.21.15.79:6841', 'nonce': 2448977611}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24473': {'gid': 24473, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.81:6833/1257507005', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6832', 'nonce': 1257507005}, {'type': 'v1', 'addr': '172.21.15.81:6833', 'nonce': 1257507005}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24494': {'gid': 24494, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.81:6835/1499936216', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6834', 'nonce': 1499936216}, {'type': 'v1', 'addr': '172.21.15.81:6835', 'nonce': 1499936216}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24496': {'gid': 24496, 'name': 'l', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.175:6833/1107229215', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6832', 'nonce': 1107229215}, {'type': 'v1', 'addr': '172.21.15.175:6833', 'nonce': 1107229215}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24512': {'gid': 24512, 'name': 'h', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.81:6837/2073598870', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6836', 'nonce': 2073598870}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 2073598870}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24514': {'gid': 24514, 'name': 'f', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.175:6835/2552601173', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6834', 'nonce': 2552601173}, {'type': 'v1', 'addr': '172.21.15.175:6835', 'nonce': 2552601173}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24523': {'gid': 24523, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.175:6837/1767284089', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6836', 'nonce': 1767284089}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 1767284089}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24538': {'gid': 24538, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.175:6839/1331748742', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6838', 'nonce': 1331748742}, {'type': 'v1', 'addr': '172.21.15.175:6839', 'nonce': 1331748742}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24539': {'gid': 24539, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.81:6839/4098410583', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6838', 'nonce': 4098410583}, {'type': 'v1', 'addr': '172.21.15.81:6839', 'nonce': 4098410583}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24539, 'qdb_cluster': [24539, 24523, 24514, 24538, 24512]} 2024-08-20T01:36:12.005 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-08-20T01:36:12.006 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.h status 2024-08-20T01:36:12.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:12 smithi079 ceph-mon[18656]: pgmap v313: 97 pgs: 97 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-20T01:36:12.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:12 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2656557389' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:36:12.249 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:36:12.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:12 smithi081 ceph-mon[22209]: pgmap v313: 97 pgs: 97 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-20T01:36:12.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:12 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2656557389' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:36:12.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:12 smithi175 ceph-mon[22392]: pgmap v313: 97 pgs: 97 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-20T01:36:12.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:12 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2656557389' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:36:12.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.764+0000 7f3a38a02640 1 -- 172.21.15.79:0/1976075817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a34107b80 msgr2=0x7f3a3410e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:12.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.764+0000 7f3a38a02640 1 --2- 172.21.15.79:0/1976075817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a34107b80 0x7f3a3410e380 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c009ca0 tx=0x7f3a2c02a8c0 comp rx=0 tx=0).stop 2024-08-20T01:36:12.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.764+0000 7f3a38a02640 1 -- 172.21.15.79:0/1976075817 shutdown_connections 2024-08-20T01:36:12.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.764+0000 7f3a38a02640 1 --2- 172.21.15.79:0/1976075817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a34107b80 0x7f3a3410e380 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:12.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.764+0000 7f3a38a02640 1 --2- 172.21.15.79:0/1976075817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a34107200 0x7f3a34107640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:12.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.764+0000 7f3a38a02640 1 --2- 172.21.15.79:0/1976075817 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a341017f0 0x7f3a34101bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:12.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.764+0000 7f3a38a02640 1 -- 172.21.15.79:0/1976075817 >> 172.21.15.79:0/1976075817 conn(0x7f3a340fd2a0 msgr2=0x7f3a340ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:12.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.764+0000 7f3a38a02640 1 -- 172.21.15.79:0/1976075817 shutdown_connections 2024-08-20T01:36:12.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.764+0000 7f3a38a02640 1 -- 172.21.15.79:0/1976075817 wait complete. 2024-08-20T01:36:12.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.765+0000 7f3a38a02640 1 Processor -- start 2024-08-20T01:36:12.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.765+0000 7f3a38a02640 1 -- start start 2024-08-20T01:36:12.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.765+0000 7f3a38a02640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a341017f0 0x7f3a34198ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:12.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.765+0000 7f3a38a02640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a34107200 0x7f3a34199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:12.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.765+0000 7f3a38a02640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a34107b80 0x7f3a3419e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:12.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.765+0000 7f3a38a02640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3a34111780 con 0x7f3a34107200 2024-08-20T01:36:12.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.765+0000 7f3a38a02640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3a34111600 con 0x7f3a34107b80 2024-08-20T01:36:12.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.765+0000 7f3a38a02640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3a34111900 con 0x7f3a341017f0 2024-08-20T01:36:12.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.765+0000 7f3a2bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a34107200 0x7f3a34199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:12.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.765+0000 7f3a2bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a34107200 0x7f3a34199220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48996/0 (socket says 172.21.15.79:48996) 2024-08-20T01:36:12.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.765+0000 7f3a2bfff640 1 -- 172.21.15.79:0/2259192937 learned_addr learned my addr 172.21.15.79:0/2259192937 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:12.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.766+0000 7f3a3359e640 1 --2- 172.21.15.79:0/2259192937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a34107b80 0x7f3a3419e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:12.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.766+0000 7f3a32d9d640 1 --2- 172.21.15.79:0/2259192937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a341017f0 0x7f3a34198ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:12.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.766+0000 7f3a2bfff640 1 -- 172.21.15.79:0/2259192937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a341017f0 msgr2=0x7f3a34198ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:12.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.766+0000 7f3a2bfff640 1 --2- 172.21.15.79:0/2259192937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a341017f0 0x7f3a34198ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:12.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.766+0000 7f3a2bfff640 1 -- 172.21.15.79:0/2259192937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a34107b80 msgr2=0x7f3a3419e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:12.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.766+0000 7f3a2bfff640 1 --2- 172.21.15.79:0/2259192937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a34107b80 0x7f3a3419e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:12.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.766+0000 7f3a2bfff640 1 -- 172.21.15.79:0/2259192937 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a3419ed90 con 0x7f3a34107200 2024-08-20T01:36:12.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.766+0000 7f3a2bfff640 1 --2- 172.21.15.79:0/2259192937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a34107200 0x7f3a34199220 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c00b4a0 tx=0x7f3a1c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:12.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.766+0000 7f3a30d99640 1 -- 172.21.15.79:0/2259192937 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c014070 con 0x7f3a34107200 2024-08-20T01:36:12.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.766+0000 7f3a30d99640 1 -- 172.21.15.79:0/2259192937 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3a1c010aa0 con 0x7f3a34107200 2024-08-20T01:36:12.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.766+0000 7f3a38a02640 1 -- 172.21.15.79:0/2259192937 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a3419f080 con 0x7f3a34107200 2024-08-20T01:36:12.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.766+0000 7f3a30d99640 1 -- 172.21.15.79:0/2259192937 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c017b70 con 0x7f3a34107200 2024-08-20T01:36:12.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.766+0000 7f3a38a02640 1 -- 172.21.15.79:0/2259192937 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a341a57c0 con 0x7f3a34107200 2024-08-20T01:36:12.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.768+0000 7f3a30d99640 1 -- 172.21.15.79:0/2259192937 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f3a1c017070 con 0x7f3a34107200 2024-08-20T01:36:12.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.769+0000 7f3a3b5fc740 1 Processor -- start 2024-08-20T01:36:12.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.769+0000 7f3a3b5fc740 1 -- start start 2024-08-20T01:36:12.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.769+0000 7f3a3b5fc740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e3a6abdc0 0x555e3a6ac1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:12.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.769+0000 7f3a3b5fc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e3a6ac6e0 0x555e3a6b8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:12.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.769+0000 7f3a3b5fc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e3a6b8670 0x555e3a6baa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:12.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.769+0000 7f3a3b5fc740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555e3a6226a0 con 0x555e3a6abdc0 2024-08-20T01:36:12.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.769+0000 7f3a3b5fc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555e3a611ba0 con 0x555e3a6ac6e0 2024-08-20T01:36:12.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.769+0000 7f3a3b5fc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555e3a615be0 con 0x555e3a6b8670 2024-08-20T01:36:12.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.769+0000 7f3a3359e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e3a6abdc0 0x555e3a6ac1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:12.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.769+0000 7f3a3359e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e3a6abdc0 0x555e3a6ac1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49004/0 (socket says 172.21.15.79:49004) 2024-08-20T01:36:12.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.769+0000 7f3a3359e640 1 -- 172.21.15.79:0/4005096523 learned_addr learned my addr 172.21.15.79:0/4005096523 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:12.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.769+0000 7f3a30d99640 1 --2- 172.21.15.79:0/2259192937 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3a200b3d10 0x7f3a200b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:12.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.769+0000 7f3a2bfff640 1 --2- 172.21.15.79:0/4005096523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e3a6b8670 0x555e3a6baa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:12.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.769+0000 7f3a3359e640 1 --2- 172.21.15.79:0/2259192937 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3a200b3d10 0x7f3a200b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:12.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.770+0000 7f3a3359e640 1 -- 172.21.15.79:0/4005096523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e3a6b8670 msgr2=0x555e3a6baa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:12.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.770+0000 7f3a3359e640 1 --2- 172.21.15.79:0/4005096523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e3a6b8670 0x555e3a6baa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:12.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.770+0000 7f3a3359e640 1 -- 172.21.15.79:0/4005096523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e3a6ac6e0 msgr2=0x555e3a6b8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:12.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.770+0000 7f3a3359e640 1 --2- 172.21.15.79:0/4005096523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e3a6ac6e0 0x555e3a6b8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:12.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.770+0000 7f3a3359e640 1 -- 172.21.15.79:0/4005096523 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e3a371540 con 0x555e3a6abdc0 2024-08-20T01:36:12.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.770+0000 7f3a2bfff640 1 --2- 172.21.15.79:0/4005096523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e3a6b8670 0x555e3a6baa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:36:12.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.770+0000 7f3a30d99640 1 -- 172.21.15.79:0/2259192937 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f3a1c0e3460 con 0x7f3a34107200 2024-08-20T01:36:12.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.770+0000 7f3a3359e640 1 --2- 172.21.15.79:0/4005096523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e3a6abdc0 0x555e3a6ac1a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c031920 tx=0x7f3a2c031b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce9fef6591bf8846 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:12.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.770+0000 7f3a297fa640 1 -- 172.21.15.79:0/4005096523 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c004b40 con 0x555e3a6abdc0 2024-08-20T01:36:12.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.770+0000 7f3a297fa640 1 -- 172.21.15.79:0/4005096523 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3a2c04e070 con 0x555e3a6abdc0 2024-08-20T01:36:12.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.770+0000 7f3a297fa640 1 -- 172.21.15.79:0/4005096523 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c030c00 con 0x555e3a6abdc0 2024-08-20T01:36:12.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.770+0000 7f3a3359e640 1 --2- 172.21.15.79:0/2259192937 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3a200b3d10 0x7f3a200b61d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c04d000 tx=0x7f3a2c04b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:12.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.771+0000 7f3a3b5fc740 1 -- 172.21.15.79:0/4005096523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e3a6abdc0 msgr2=0x555e3a6ac1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:12.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.771+0000 7f3a3b5fc740 1 --2- 172.21.15.79:0/4005096523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e3a6abdc0 0x555e3a6ac1a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c031920 tx=0x7f3a2c031b30 comp rx=0 tx=0).stop 2024-08-20T01:36:12.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.771+0000 7f3a3b5fc740 1 -- 172.21.15.79:0/4005096523 shutdown_connections 2024-08-20T01:36:12.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.771+0000 7f3a3b5fc740 1 --2- 172.21.15.79:0/4005096523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e3a6b8670 0x555e3a6baa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:12.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.771+0000 7f3a3b5fc740 1 --2- 172.21.15.79:0/4005096523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e3a6ac6e0 0x555e3a6b8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:12.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.771+0000 7f3a3b5fc740 1 --2- 172.21.15.79:0/4005096523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e3a6abdc0 0x555e3a6ac1a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:12.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.771+0000 7f3a3b5fc740 1 -- 172.21.15.79:0/4005096523 >> 172.21.15.79:0/4005096523 conn(0x555e3a6a9bf0 msgr2=0x555e3a6aad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:12.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.771+0000 7f3a3b5fc740 1 -- 172.21.15.79:0/4005096523 shutdown_connections 2024-08-20T01:36:12.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.771+0000 7f3a3b5fc740 1 -- 172.21.15.79:0/4005096523 wait complete. 2024-08-20T01:36:12.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.771+0000 7f3a3b5fc740 1 -- start start 2024-08-20T01:36:12.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.771+0000 7f3a3b5fc740 1 Processor -- start 2024-08-20T01:36:12.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.772+0000 7f3a3b5fc740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e3a6abdc0 0x555e3a6b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:12.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.772+0000 7f3a3b5fc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e3a6ac6e0 0x555e3a6b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:12.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.772+0000 7f3a3b5fc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e3a6b8670 0x555e3a6b6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:12.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.772+0000 7f3a3b5fc740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555e3a4745f0 con 0x555e3a6abdc0 2024-08-20T01:36:12.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.772+0000 7f3a3b5fc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555e3a5986c0 con 0x555e3a6b8670 2024-08-20T01:36:12.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.772+0000 7f3a3b5fc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555e3a6bb320 con 0x555e3a6ac6e0 2024-08-20T01:36:12.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.772+0000 7f3a3b5fc740 10 client.0 _ll_register_callbacks cb 0x555e3a5d51e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:12.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.772+0000 7f3a32d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e3a6abdc0 0x555e3a6b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:12.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.772+0000 7f3a32d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e3a6abdc0 0x555e3a6b56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49008/0 (socket says 172.21.15.79:49008) 2024-08-20T01:36:12.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.772+0000 7f3a32d9d640 1 -- 172.21.15.79:0/3519252683 learned_addr learned my addr 172.21.15.79:0/3519252683 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:12.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.772+0000 7f3a3359e640 1 --2- 172.21.15.79:0/3519252683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e3a6b8670 0x555e3a6b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:12.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.772+0000 7f3a32d9d640 1 -- 172.21.15.79:0/3519252683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e3a6ac6e0 msgr2=0x555e3a6b5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:12.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.772+0000 7f3a32d9d640 1 --2- 172.21.15.79:0/3519252683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e3a6ac6e0 0x555e3a6b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:12.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.772+0000 7f3a32d9d640 1 -- 172.21.15.79:0/3519252683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e3a6b8670 msgr2=0x555e3a6b6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:12.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.772+0000 7f3a32d9d640 1 --2- 172.21.15.79:0/3519252683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e3a6b8670 0x555e3a6b6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:12.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.772+0000 7f3a32d9d640 1 -- 172.21.15.79:0/3519252683 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e3a6c4780 con 0x555e3a6abdc0 2024-08-20T01:36:12.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.772+0000 7f3a3359e640 1 --2- 172.21.15.79:0/3519252683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e3a6b8670 0x555e3a6b6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:36:12.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.772+0000 7f3a32d9d640 1 --2- 172.21.15.79:0/3519252683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e3a6abdc0 0x555e3a6b56a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3a2400d160 tx=0x7f3a2400d620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4863c690fb74e9c4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:12.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.772+0000 7f3a1a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:36:12.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.772+0000 7f3a1a7fc640 1 -- 172.21.15.79:0/3519252683 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a2400de50 con 0x555e3a6abdc0 2024-08-20T01:36:12.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.772+0000 7f3a1a7fc640 1 -- 172.21.15.79:0/3519252683 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f3a240125f0 con 0x555e3a6abdc0 2024-08-20T01:36:12.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.772+0000 7f3a3b5fc740 1 -- 172.21.15.79:0/3519252683 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a2c04e070 con 0x555e3a6abdc0 2024-08-20T01:36:12.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.772+0000 7f3a1a7fc640 1 -- 172.21.15.79:0/3519252683 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3a24012810 con 0x555e3a6abdc0 2024-08-20T01:36:12.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.772+0000 7f3a3b5fc740 10 client.15093 fetch_fsmap learned FSMap version 27 2024-08-20T01:36:12.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.772+0000 7f3a3b5fc740 1 -- 172.21.15.79:0/3519252683 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555e3a6c7170 con 0x555e3a6abdc0 2024-08-20T01:36:12.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.773+0000 7f3a1a7fc640 1 -- 172.21.15.79:0/3519252683 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3a2c04e070 con 0x555e3a6abdc0 2024-08-20T01:36:12.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.773+0000 7f3a1a7fc640 1 -- 172.21.15.79:0/3519252683 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f3a24013bd0 con 0x555e3a6abdc0 2024-08-20T01:36:12.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.773+0000 7f3a3b5fc740 10 client.15093 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:36:12.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.773+0000 7f3a3b5fc740 10 client.15093 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-20T01:36:12.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.773+0000 7f3a3b5fc740 20 client.15093 populate_metadata read hostname 'smithi079' 2024-08-20T01:36:12.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.773+0000 7f3a3b5fc740 1 --2- 172.21.15.79:0/3519252683 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x555e3a6c9840 0x555e3a6cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:12.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.773+0000 7f3a3b5fc740 4 client.15093 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:36:12.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.773+0000 7f3a3b5fc740 1 -- 172.21.15.79:0/3519252683 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555e3a6245f0 con 0x555e3a6c9840 2024-08-20T01:36:12.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.773+0000 7f3a2bfff640 1 --2- 172.21.15.79:0/3519252683 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x555e3a6c9840 0x555e3a6cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:12.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.774+0000 7f3a2bfff640 1 --2- 172.21.15.79:0/3519252683 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x555e3a6c9840 0x555e3a6cacb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8ccc51ea40fcc79b server_cookie=1bf2e68ce0312a14 in_seq=0 out_seq=0 2024-08-20T01:36:12.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.774+0000 7f3a1a7fc640 10 client.15093 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:36:12.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.774+0000 7f3a1a7fc640 1 -- 172.21.15.79:0/3519252683 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555e3a6245f0 con 0x555e3a6c9840 2024-08-20T01:36:12.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.774+0000 7f3a1a7fc640 10 client.15093 handle_command_reply: tid=0 2024-08-20T01:36:12.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.774+0000 7f3a3b5fc740 1 client.15093 shutdown 2024-08-20T01:36:12.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.774+0000 7f3a3b5fc740 1 -- 172.21.15.79:0/3519252683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e3a6abdc0 msgr2=0x555e3a6b56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:12.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.774+0000 7f3a3b5fc740 1 --2- 172.21.15.79:0/3519252683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e3a6abdc0 0x555e3a6b56a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3a2400d160 tx=0x7f3a2400d620 comp rx=0 tx=0).stop 2024-08-20T01:36:12.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.774+0000 7f3a3b5fc740 1 -- 172.21.15.79:0/3519252683 shutdown_connections 2024-08-20T01:36:12.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.775+0000 7f3a3b5fc740 1 --2- 172.21.15.79:0/3519252683 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x555e3a6c9840 0x555e3a6cacb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:12.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.775+0000 7f3a1a7fc640 0 client.15093 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:36:12.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.775+0000 7f3a3b5fc740 1 --2- 172.21.15.79:0/3519252683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e3a6b8670 0x555e3a6b6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:12.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.775+0000 7f3a3b5fc740 1 --2- 172.21.15.79:0/3519252683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e3a6ac6e0 0x555e3a6b5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:12.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.775+0000 7f3a3b5fc740 1 --2- 172.21.15.79:0/3519252683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e3a6abdc0 0x555e3a6b56a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:12.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.775+0000 7f3a3b5fc740 1 -- 172.21.15.79:0/3519252683 >> 172.21.15.79:0/3519252683 conn(0x555e3a6a9bf0 msgr2=0x555e3a6af790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:12.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.775+0000 7f3a3b5fc740 1 -- 172.21.15.79:0/3519252683 shutdown_connections 2024-08-20T01:36:12.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.775+0000 7f3a3b5fc740 1 -- 172.21.15.79:0/3519252683 wait complete. 2024-08-20T01:36:12.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.775+0000 7f3a3b5fc740 20 client.15093 trim_cache size 0 max 16384 2024-08-20T01:36:12.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.792+0000 7f3a3b5fc740 1 Processor -- start 2024-08-20T01:36:12.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.792+0000 7f3a3b5fc740 1 -- start start 2024-08-20T01:36:12.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.793+0000 7f3a3b5fc740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e3a6abdc0 0x555e3a6c8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:12.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.793+0000 7f3a3b5fc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e3a6ac6e0 0x555e3a6afe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:12.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.793+0000 7f3a3b5fc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e3a6b8670 0x555e3a6c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:12.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.793+0000 7f3a3b5fc740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555e3a6c8ff0 con 0x555e3a6abdc0 2024-08-20T01:36:12.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.793+0000 7f3a3b5fc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555e3a6c96c0 con 0x555e3a6b8670 2024-08-20T01:36:12.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.793+0000 7f3a3b5fc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555e3a6c9d90 con 0x555e3a6ac6e0 2024-08-20T01:36:12.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.793+0000 7f3a32d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e3a6abdc0 0x555e3a6c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:12.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.793+0000 7f3a32d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e3a6abdc0 0x555e3a6c8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49022/0 (socket says 172.21.15.79:49022) 2024-08-20T01:36:12.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.793+0000 7f3a32d9d640 1 -- 172.21.15.79:0/2340478651 learned_addr learned my addr 172.21.15.79:0/2340478651 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:12.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.793+0000 7f3a2bfff640 1 --2- 172.21.15.79:0/2340478651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e3a6ac6e0 0x555e3a6afe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:12.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.793+0000 7f3a32d9d640 1 -- 172.21.15.79:0/2340478651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e3a6ac6e0 msgr2=0x555e3a6afe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:12.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.793+0000 7f3a32d9d640 1 --2- 172.21.15.79:0/2340478651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e3a6ac6e0 0x555e3a6afe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:12.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.793+0000 7f3a32d9d640 1 -- 172.21.15.79:0/2340478651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e3a6b8670 msgr2=0x555e3a6c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:12.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.793+0000 7f3a3359e640 1 --2- 172.21.15.79:0/2340478651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e3a6b8670 0x555e3a6c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:12.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.793+0000 7f3a32d9d640 1 --2- 172.21.15.79:0/2340478651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e3a6b8670 0x555e3a6c3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:12.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.793+0000 7f3a32d9d640 1 -- 172.21.15.79:0/2340478651 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e3a6aa670 con 0x555e3a6abdc0 2024-08-20T01:36:12.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.793+0000 7f3a2bfff640 1 --2- 172.21.15.79:0/2340478651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e3a6ac6e0 0x555e3a6afe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:36:12.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.793+0000 7f3a3359e640 1 --2- 172.21.15.79:0/2340478651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e3a6b8670 0x555e3a6c3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:36:12.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.793+0000 7f3a32d9d640 1 --2- 172.21.15.79:0/2340478651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e3a6abdc0 0x555e3a6c8630 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f3a24004810 tx=0x7f3a2400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99dc26c82180461 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:12.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.794+0000 7f3a28ff9640 1 -- 172.21.15.79:0/2340478651 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a2402e070 con 0x555e3a6abdc0 2024-08-20T01:36:12.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.794+0000 7f3a28ff9640 1 -- 172.21.15.79:0/2340478651 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3a24018070 con 0x555e3a6abdc0 2024-08-20T01:36:12.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.794+0000 7f3a28ff9640 1 -- 172.21.15.79:0/2340478651 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a24012c10 con 0x555e3a6abdc0 2024-08-20T01:36:12.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.794+0000 7f3a3b5fc740 1 -- 172.21.15.79:0/2340478651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e3a6abdc0 msgr2=0x555e3a6c8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:12.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.794+0000 7f3a3b5fc740 1 --2- 172.21.15.79:0/2340478651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e3a6abdc0 0x555e3a6c8630 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f3a24004810 tx=0x7f3a2400b260 comp rx=0 tx=0).stop 2024-08-20T01:36:12.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.794+0000 7f3a3b5fc740 1 -- 172.21.15.79:0/2340478651 shutdown_connections 2024-08-20T01:36:12.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.794+0000 7f3a3b5fc740 1 --2- 172.21.15.79:0/2340478651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e3a6b8670 0x555e3a6c3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:12.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.794+0000 7f3a3b5fc740 1 --2- 172.21.15.79:0/2340478651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e3a6ac6e0 0x555e3a6afe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:12.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.794+0000 7f3a3b5fc740 1 --2- 172.21.15.79:0/2340478651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e3a6abdc0 0x555e3a6c8630 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:12.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.794+0000 7f3a3b5fc740 1 -- 172.21.15.79:0/2340478651 >> 172.21.15.79:0/2340478651 conn(0x555e3a6a9bf0 msgr2=0x555e3a6c35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:12.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.794+0000 7f3a3b5fc740 1 -- 172.21.15.79:0/2340478651 shutdown_connections 2024-08-20T01:36:12.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.794+0000 7f3a3b5fc740 1 -- 172.21.15.79:0/2340478651 wait complete. 2024-08-20T01:36:12.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.795+0000 7f3a3b5fc740 1 -- start start 2024-08-20T01:36:12.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.795+0000 7f3a3b5fc740 1 Processor -- start 2024-08-20T01:36:12.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.795+0000 7f3a3b5fc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e3a6abdc0 0x555e3a6d2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:12.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.795+0000 7f3a3b5fc740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e3a6ac6e0 0x555e3a6d3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:12.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.795+0000 7f3a3b5fc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e3a6b8670 0x555e3a730340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:12.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.795+0000 7f3a3b5fc740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555e3a6cab30 con 0x555e3a6ac6e0 2024-08-20T01:36:12.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.795+0000 7f3a3b5fc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555e3a6ca460 con 0x555e3a6b8670 2024-08-20T01:36:12.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.795+0000 7f3a3b5fc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555e3a6cb200 con 0x555e3a6abdc0 2024-08-20T01:36:12.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.795+0000 7f3a3b5fc740 10 client.0 _ll_register_callbacks cb 0x7f3a2400b180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:12.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.795+0000 7f3a2bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e3a6ac6e0 0x555e3a6d3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:12.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.795+0000 7f3a2bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e3a6ac6e0 0x555e3a6d3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49038/0 (socket says 172.21.15.79:49038) 2024-08-20T01:36:12.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.795+0000 7f3a2bfff640 1 -- 172.21.15.79:0/107151016 learned_addr learned my addr 172.21.15.79:0/107151016 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:12.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.795+0000 7f3a3359e640 1 --2- 172.21.15.79:0/107151016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e3a6b8670 0x555e3a730340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:12.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.795+0000 7f3a32d9d640 1 --2- 172.21.15.79:0/107151016 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e3a6abdc0 0x555e3a6d2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:12.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.795+0000 7f3a2bfff640 1 -- 172.21.15.79:0/107151016 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e3a6abdc0 msgr2=0x555e3a6d2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:12.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.795+0000 7f3a2bfff640 1 --2- 172.21.15.79:0/107151016 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e3a6abdc0 0x555e3a6d2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:12.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.795+0000 7f3a2bfff640 1 -- 172.21.15.79:0/107151016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e3a6b8670 msgr2=0x555e3a730340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:12.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.795+0000 7f3a2bfff640 1 --2- 172.21.15.79:0/107151016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e3a6b8670 0x555e3a730340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:12.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.795+0000 7f3a2bfff640 1 -- 172.21.15.79:0/107151016 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e3a730a80 con 0x555e3a6ac6e0 2024-08-20T01:36:12.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.796+0000 7f3a2bfff640 1 --2- 172.21.15.79:0/107151016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e3a6ac6e0 0x555e3a6d3160 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c0aa2a0 tx=0x7f3a1c073780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53a35ab6c4a53a4a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:12.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.796+0000 7f3a1a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:36:12.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.796+0000 7f3a1a7fc640 1 -- 172.21.15.79:0/107151016 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c01e040 con 0x555e3a6ac6e0 2024-08-20T01:36:12.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.796+0000 7f3a1a7fc640 1 -- 172.21.15.79:0/107151016 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f3a1c0a65a0 con 0x555e3a6ac6e0 2024-08-20T01:36:12.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.796+0000 7f3a3b5fc740 1 -- 172.21.15.79:0/107151016 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a24018070 con 0x555e3a6ac6e0 2024-08-20T01:36:12.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.796+0000 7f3a1a7fc640 1 -- 172.21.15.79:0/107151016 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3a1c0aaa10 con 0x555e3a6ac6e0 2024-08-20T01:36:12.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.796+0000 7f3a3b5fc740 10 client.15099 fetch_fsmap learned FSMap version 27 2024-08-20T01:36:12.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.796+0000 7f3a3b5fc740 1 -- 172.21.15.79:0/107151016 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555e3a737ed0 con 0x555e3a6ac6e0 2024-08-20T01:36:12.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.796+0000 7f3a1a7fc640 1 -- 172.21.15.79:0/107151016 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3a24018070 con 0x555e3a6ac6e0 2024-08-20T01:36:12.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.796+0000 7f3a1a7fc640 1 -- 172.21.15.79:0/107151016 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f3a1c0e1010 con 0x555e3a6ac6e0 2024-08-20T01:36:12.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.796+0000 7f3a3b5fc740 10 client.15099 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:36:12.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.796+0000 7f3a3b5fc740 10 client.15099 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-20T01:36:12.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.796+0000 7f3a3b5fc740 20 client.15099 populate_metadata read hostname 'smithi079' 2024-08-20T01:36:12.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.796+0000 7f3a3b5fc740 1 --2- 172.21.15.79:0/107151016 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x555e3a6c9840 0x555e3a73b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:12.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.796+0000 7f3a3b5fc740 4 client.15099 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-20T01:36:12.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.796+0000 7f3a3b5fc740 1 -- 172.21.15.79:0/107151016 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "status"}) -- 0x555e3a620090 con 0x555e3a6c9840 2024-08-20T01:36:12.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.797+0000 7f3a32d9d640 1 --2- 172.21.15.79:0/107151016 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x555e3a6c9840 0x555e3a73b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:12.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.797+0000 7f3a1a7fc640 10 client.15099 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:36:12.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.797+0000 7f3a32d9d640 1 --2- 172.21.15.79:0/107151016 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x555e3a6c9840 0x555e3a73b7e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=888a28baaac98d02 server_cookie=d81147d84cc5fc34 in_seq=0 out_seq=0 2024-08-20T01:36:12.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.797+0000 7f3a1a7fc640 1 -- 172.21.15.79:0/107151016 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x555e3a620090 con 0x555e3a6c9840 2024-08-20T01:36:12.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.797+0000 7f3a1a7fc640 10 client.15099 handle_command_reply: tid=0 2024-08-20T01:36:12.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.797+0000 7f3a3b5fc740 1 client.15099 shutdown 2024-08-20T01:36:12.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.797+0000 7f3a3b5fc740 1 -- 172.21.15.79:0/107151016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e3a6ac6e0 msgr2=0x555e3a6d3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:12.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.797+0000 7f3a3b5fc740 1 --2- 172.21.15.79:0/107151016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e3a6ac6e0 0x555e3a6d3160 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c0aa2a0 tx=0x7f3a1c073780 comp rx=0 tx=0).stop 2024-08-20T01:36:12.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.797+0000 7f3a3b5fc740 1 -- 172.21.15.79:0/107151016 shutdown_connections 2024-08-20T01:36:12.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.797+0000 7f3a3b5fc740 1 --2- 172.21.15.79:0/107151016 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x555e3a6c9840 0x555e3a73b7e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:12.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.797+0000 7f3a3b5fc740 1 --2- 172.21.15.79:0/107151016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e3a6b8670 0x555e3a730340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:12.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.797+0000 7f3a3b5fc740 1 --2- 172.21.15.79:0/107151016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e3a6ac6e0 0x555e3a6d3160 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:12.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.797+0000 7f3a3b5fc740 1 --2- 172.21.15.79:0/107151016 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e3a6abdc0 0x555e3a6d2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:12.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.797+0000 7f3a1a7fc640 0 client.15099 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:36:12.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.797+0000 7f3a3b5fc740 1 -- 172.21.15.79:0/107151016 >> 172.21.15.79:0/107151016 conn(0x555e3a6a9bf0 msgr2=0x555e3a6a84a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:12.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.797+0000 7f3a3b5fc740 1 -- 172.21.15.79:0/107151016 shutdown_connections 2024-08-20T01:36:12.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.797+0000 7f3a3b5fc740 1 -- 172.21.15.79:0/107151016 wait complete. 2024-08-20T01:36:12.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.798+0000 7f3a3b5fc740 20 client.15099 trim_cache size 0 max 16384 2024-08-20T01:36:12.817 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:36:12.817 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "28484e9a-5e93-11ef-bccf-c7b262605968", 2024-08-20T01:36:12.817 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 4, 2024-08-20T01:36:12.817 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 24512, 2024-08-20T01:36:12.817 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-08-20T01:36:12.817 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-08-20T01:36:12.817 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-08-20T01:36:12.817 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 67.363342094999993, 2024-08-20T01:36:12.817 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 27, 2024-08-20T01:36:12.818 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 74, 2024-08-20T01:36:12.818 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 72, 2024-08-20T01:36:12.818 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 99.248247387999996 2024-08-20T01:36:12.818 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:36:12.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.798+0000 7f3a38a02640 1 -- 172.21.15.79:0/2259192937 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3a200b3d10 msgr2=0x7f3a200b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:12.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.798+0000 7f3a38a02640 1 --2- 172.21.15.79:0/2259192937 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3a200b3d10 0x7f3a200b61d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c04d000 tx=0x7f3a2c04b000 comp rx=0 tx=0).stop 2024-08-20T01:36:12.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.798+0000 7f3a38a02640 1 -- 172.21.15.79:0/2259192937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a34107200 msgr2=0x7f3a34199220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:12.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.798+0000 7f3a38a02640 1 --2- 172.21.15.79:0/2259192937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a34107200 0x7f3a34199220 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c00b4a0 tx=0x7f3a1c00b960 comp rx=0 tx=0).stop 2024-08-20T01:36:12.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.798+0000 7f3a38a02640 1 -- 172.21.15.79:0/2259192937 shutdown_connections 2024-08-20T01:36:12.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.798+0000 7f3a38a02640 1 --2- 172.21.15.79:0/2259192937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a34107b80 0x7f3a3419e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:12.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.798+0000 7f3a38a02640 1 --2- 172.21.15.79:0/2259192937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a34107200 0x7f3a34199220 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:12.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.798+0000 7f3a38a02640 1 --2- 172.21.15.79:0/2259192937 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3a200b3d10 0x7f3a200b61d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:12.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.798+0000 7f3a38a02640 1 --2- 172.21.15.79:0/2259192937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a341017f0 0x7f3a34198ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:12.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.798+0000 7f3a38a02640 1 -- 172.21.15.79:0/2259192937 >> 172.21.15.79:0/2259192937 conn(0x7f3a340fd2a0 msgr2=0x7f3a3406b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:12.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.798+0000 7f3a38a02640 1 -- 172.21.15.79:0/2259192937 shutdown_connections 2024-08-20T01:36:12.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:12.798+0000 7f3a38a02640 1 -- 172.21.15.79:0/2259192937 wait complete. 2024-08-20T01:36:13.464 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.f status 2024-08-20T01:36:13.707 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:36:14.133 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:14 smithi079 ceph-mon[18656]: pgmap v314: 97 pgs: 97 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T01:36:14.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.135+0000 7f416bff1640 1 -- 172.21.15.79:0/3686137638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4164101500 msgr2=0x7f41641018e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:14.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.135+0000 7f416bff1640 1 --2- 172.21.15.79:0/3686137638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4164101500 0x7f41641018e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4158009930 tx=0x7f415802a420 comp rx=0 tx=0).stop 2024-08-20T01:36:14.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.135+0000 7f416bff1640 1 -- 172.21.15.79:0/3686137638 shutdown_connections 2024-08-20T01:36:14.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.135+0000 7f416bff1640 1 --2- 172.21.15.79:0/3686137638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4164108f80 0x7f416410f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:14.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.135+0000 7f416bff1640 1 --2- 172.21.15.79:0/3686137638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4164108600 0x7f4164108a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:14.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.135+0000 7f416bff1640 1 --2- 172.21.15.79:0/3686137638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4164101500 0x7f41641018e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:14.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.135+0000 7f416bff1640 1 -- 172.21.15.79:0/3686137638 >> 172.21.15.79:0/3686137638 conn(0x7f4164076cc0 msgr2=0x7f41640770d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:14.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.135+0000 7f416bff1640 1 -- 172.21.15.79:0/3686137638 shutdown_connections 2024-08-20T01:36:14.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.135+0000 7f416bff1640 1 -- 172.21.15.79:0/3686137638 wait complete. 2024-08-20T01:36:14.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.136+0000 7f416bff1640 1 Processor -- start 2024-08-20T01:36:14.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.136+0000 7f416bff1640 1 -- start start 2024-08-20T01:36:14.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.136+0000 7f416bff1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4164101500 0x7f4164198fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:14.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.136+0000 7f416bff1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4164108600 0x7f4164199510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:14.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.136+0000 7f416bff1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4164108f80 0x7f416419e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:14.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.136+0000 7f416bff1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f41641129a0 con 0x7f4164108600 2024-08-20T01:36:14.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.136+0000 7f416bff1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4164112820 con 0x7f4164108f80 2024-08-20T01:36:14.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.136+0000 7f416bff1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4164112b20 con 0x7f4164101500 2024-08-20T01:36:14.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.136+0000 7f416958c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4164108600 0x7f4164199510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:14.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.136+0000 7f416958c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4164108600 0x7f4164199510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49060/0 (socket says 172.21.15.79:49060) 2024-08-20T01:36:14.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.136+0000 7f416958c640 1 -- 172.21.15.79:0/1557079912 learned_addr learned my addr 172.21.15.79:0/1557079912 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:14.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.136+0000 7f4169d8d640 1 --2- 172.21.15.79:0/1557079912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4164101500 0x7f4164198fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:14.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.137+0000 7f416a58e640 1 --2- 172.21.15.79:0/1557079912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4164108f80 0x7f416419e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:14.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.137+0000 7f416958c640 1 -- 172.21.15.79:0/1557079912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4164101500 msgr2=0x7f4164198fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:14.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.137+0000 7f416958c640 1 --2- 172.21.15.79:0/1557079912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4164101500 0x7f4164198fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:14.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.137+0000 7f416958c640 1 -- 172.21.15.79:0/1557079912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4164108f80 msgr2=0x7f416419e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:14.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.137+0000 7f416958c640 1 --2- 172.21.15.79:0/1557079912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4164108f80 0x7f416419e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:14.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.137+0000 7f416958c640 1 -- 172.21.15.79:0/1557079912 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f416419f080 con 0x7f4164108600 2024-08-20T01:36:14.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.137+0000 7f4169d8d640 1 --2- 172.21.15.79:0/1557079912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4164101500 0x7f4164198fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:36:14.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.137+0000 7f416958c640 1 --2- 172.21.15.79:0/1557079912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4164108600 0x7f4164199510 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f416000d950 tx=0x7f416000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:14.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.137+0000 7f4156ffd640 1 -- 172.21.15.79:0/1557079912 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4160017070 con 0x7f4164108600 2024-08-20T01:36:14.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.137+0000 7f4156ffd640 1 -- 172.21.15.79:0/1557079912 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4160009c30 con 0x7f4164108600 2024-08-20T01:36:14.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.137+0000 7f416bff1640 1 -- 172.21.15.79:0/1557079912 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f416419f370 con 0x7f4164108600 2024-08-20T01:36:14.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.137+0000 7f4156ffd640 1 -- 172.21.15.79:0/1557079912 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416000f620 con 0x7f4164108600 2024-08-20T01:36:14.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.137+0000 7f416bff1640 1 -- 172.21.15.79:0/1557079912 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41641a5c00 con 0x7f4164108600 2024-08-20T01:36:14.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.139+0000 7f4156ffd640 1 -- 172.21.15.79:0/1557079912 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f4160010460 con 0x7f4164108600 2024-08-20T01:36:14.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.139+0000 7f416e3ea740 1 Processor -- start 2024-08-20T01:36:14.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.140+0000 7f416e3ea740 1 -- start start 2024-08-20T01:36:14.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.140+0000 7f416e3ea740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e12d28bf0 0x558e12d28fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:14.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.140+0000 7f416e3ea740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e12d29510 0x558e12d34f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:14.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.140+0000 7f416e3ea740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e12d354a0 0x558e12d37890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:14.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.140+0000 7f416e3ea740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558e12c9f6a0 con 0x558e12d354a0 2024-08-20T01:36:14.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.140+0000 7f416e3ea740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558e12c8eba0 con 0x558e12d29510 2024-08-20T01:36:14.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.140+0000 7f416e3ea740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558e12c92be0 con 0x558e12d28bf0 2024-08-20T01:36:14.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.140+0000 7f416958c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e12d354a0 0x558e12d37890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:14.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.140+0000 7f416958c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e12d354a0 0x558e12d37890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49074/0 (socket says 172.21.15.79:49074) 2024-08-20T01:36:14.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.140+0000 7f416958c640 1 -- 172.21.15.79:0/3379659364 learned_addr learned my addr 172.21.15.79:0/3379659364 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:14.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.140+0000 7f416a58e640 1 --2- 172.21.15.79:0/3379659364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e12d28bf0 0x558e12d28fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:14.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.140+0000 7f4169d8d640 1 --2- 172.21.15.79:0/3379659364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e12d29510 0x558e12d34f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:14.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.140+0000 7f416958c640 1 -- 172.21.15.79:0/3379659364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e12d28bf0 msgr2=0x558e12d28fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:14.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.140+0000 7f416958c640 1 --2- 172.21.15.79:0/3379659364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e12d28bf0 0x558e12d28fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:14.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.140+0000 7f416958c640 1 -- 172.21.15.79:0/3379659364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e12d29510 msgr2=0x558e12d34f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:14.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.140+0000 7f416958c640 1 --2- 172.21.15.79:0/3379659364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e12d29510 0x558e12d34f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:14.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.140+0000 7f416958c640 1 -- 172.21.15.79:0/3379659364 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e129ee540 con 0x558e12d354a0 2024-08-20T01:36:14.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.141+0000 7f4169d8d640 1 --2- 172.21.15.79:0/3379659364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e12d29510 0x558e12d34f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:36:14.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.141+0000 7f4156ffd640 1 --2- 172.21.15.79:0/1557079912 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f41500b3ce0 0x7f41500b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:14.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.141+0000 7f416958c640 1 --2- 172.21.15.79:0/3379659364 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e12d354a0 0x558e12d37890 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f41600e9c20 tx=0x7f41600eb670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7ac23442dd108e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:14.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.141+0000 7f416a58e640 1 --2- 172.21.15.79:0/1557079912 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f41500b3ce0 0x7f41500b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:14.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.141+0000 7f4156ffd640 1 -- 172.21.15.79:0/1557079912 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f41600e3a20 con 0x7f4164108600 2024-08-20T01:36:14.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.141+0000 7f414ffff640 1 -- 172.21.15.79:0/3379659364 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41600a6680 con 0x558e12d354a0 2024-08-20T01:36:14.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.141+0000 7f414ffff640 1 -- 172.21.15.79:0/3379659364 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f41600aa2d0 con 0x558e12d354a0 2024-08-20T01:36:14.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.141+0000 7f414ffff640 1 -- 172.21.15.79:0/3379659364 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41600a9f30 con 0x558e12d354a0 2024-08-20T01:36:14.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.142+0000 7f416e3ea740 1 -- 172.21.15.79:0/3379659364 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e12d354a0 msgr2=0x558e12d37890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:14.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.142+0000 7f416e3ea740 1 --2- 172.21.15.79:0/3379659364 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e12d354a0 0x558e12d37890 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f41600e9c20 tx=0x7f41600eb670 comp rx=0 tx=0).stop 2024-08-20T01:36:14.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.142+0000 7f416a58e640 1 --2- 172.21.15.79:0/1557079912 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f41500b3ce0 0x7f41500b61a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f415c005fd0 tx=0x7f415c0096e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:14.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.142+0000 7f416e3ea740 1 -- 172.21.15.79:0/3379659364 shutdown_connections 2024-08-20T01:36:14.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.142+0000 7f416e3ea740 1 --2- 172.21.15.79:0/3379659364 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e12d354a0 0x558e12d37890 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:14.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.142+0000 7f416e3ea740 1 --2- 172.21.15.79:0/3379659364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e12d29510 0x558e12d34f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:14.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.142+0000 7f416e3ea740 1 --2- 172.21.15.79:0/3379659364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e12d28bf0 0x558e12d28fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:14.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.142+0000 7f416e3ea740 1 -- 172.21.15.79:0/3379659364 >> 172.21.15.79:0/3379659364 conn(0x558e12d26a20 msgr2=0x558e12d27bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:14.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.142+0000 7f416e3ea740 1 -- 172.21.15.79:0/3379659364 shutdown_connections 2024-08-20T01:36:14.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.142+0000 7f416e3ea740 1 -- 172.21.15.79:0/3379659364 wait complete. 2024-08-20T01:36:14.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.142+0000 7f416e3ea740 1 -- start start 2024-08-20T01:36:14.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.142+0000 7f416e3ea740 1 Processor -- start 2024-08-20T01:36:14.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.143+0000 7f416e3ea740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e12d28bf0 0x558e12d32420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:14.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.143+0000 7f416e3ea740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e12d29510 0x558e12d32960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:14.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.143+0000 7f416e3ea740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e12d354a0 0x558e12d32ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:14.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.143+0000 7f416e3ea740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558e12af15f0 con 0x558e12d28bf0 2024-08-20T01:36:14.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.143+0000 7f416e3ea740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558e12c156c0 con 0x558e12d29510 2024-08-20T01:36:14.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.143+0000 7f416e3ea740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558e12d38150 con 0x558e12d354a0 2024-08-20T01:36:14.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.143+0000 7f416e3ea740 10 client.0 _ll_register_callbacks cb 0x558e12c521e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:14.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.143+0000 7f4169d8d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e12d28bf0 0x558e12d32420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:14.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.143+0000 7f4169d8d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e12d28bf0 0x558e12d32420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49086/0 (socket says 172.21.15.79:49086) 2024-08-20T01:36:14.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.143+0000 7f4169d8d640 1 -- 172.21.15.79:0/3435627034 learned_addr learned my addr 172.21.15.79:0/3435627034 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:14.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.143+0000 7f416958c640 1 --2- 172.21.15.79:0/3435627034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e12d29510 0x558e12d32960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:14.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.143+0000 7f416a58e640 1 --2- 172.21.15.79:0/3435627034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e12d354a0 0x558e12d32ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:14.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.143+0000 7f4169d8d640 1 -- 172.21.15.79:0/3435627034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e12d354a0 msgr2=0x558e12d32ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:14.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.143+0000 7f4169d8d640 1 --2- 172.21.15.79:0/3435627034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e12d354a0 0x558e12d32ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:14.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.143+0000 7f4169d8d640 1 -- 172.21.15.79:0/3435627034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e12d29510 msgr2=0x558e12d32960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:14.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.143+0000 7f4169d8d640 1 --2- 172.21.15.79:0/3435627034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e12d29510 0x558e12d32960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:14.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.143+0000 7f4169d8d640 1 -- 172.21.15.79:0/3435627034 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e12d41500 con 0x558e12d28bf0 2024-08-20T01:36:14.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.143+0000 7f416958c640 1 --2- 172.21.15.79:0/3435627034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e12d29510 0x558e12d32960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:36:14.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.143+0000 7f4169d8d640 1 --2- 172.21.15.79:0/3435627034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e12d28bf0 0x558e12d32420 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f4158009930 tx=0x7f4158031690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d20959517f6bedfe server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:14.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.143+0000 7f414d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:36:14.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.144+0000 7f414d7fa640 1 -- 172.21.15.79:0/3435627034 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4158035070 con 0x558e12d28bf0 2024-08-20T01:36:14.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.144+0000 7f414d7fa640 1 -- 172.21.15.79:0/3435627034 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f4158004240 con 0x558e12d28bf0 2024-08-20T01:36:14.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.144+0000 7f416e3ea740 1 -- 172.21.15.79:0/3435627034 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41600aa2d0 con 0x558e12d28bf0 2024-08-20T01:36:14.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.144+0000 7f414d7fa640 1 -- 172.21.15.79:0/3435627034 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4158004440 con 0x558e12d28bf0 2024-08-20T01:36:14.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.144+0000 7f416e3ea740 10 client.15111 fetch_fsmap learned FSMap version 27 2024-08-20T01:36:14.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.144+0000 7f416e3ea740 1 -- 172.21.15.79:0/3435627034 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558e12d43e90 con 0x558e12d28bf0 2024-08-20T01:36:14.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.144+0000 7f414d7fa640 1 -- 172.21.15.79:0/3435627034 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f41600aa2d0 con 0x558e12d28bf0 2024-08-20T01:36:14.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.144+0000 7f414d7fa640 1 -- 172.21.15.79:0/3435627034 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f4158004a30 con 0x558e12d28bf0 2024-08-20T01:36:14.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.144+0000 7f416e3ea740 10 client.15111 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:36:14.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.144+0000 7f416e3ea740 10 client.15111 resolve_mds: resolved name 'f' to daemon mds.f 2024-08-20T01:36:14.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.144+0000 7f416e3ea740 20 client.15111 populate_metadata read hostname 'smithi079' 2024-08-20T01:36:14.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.144+0000 7f416e3ea740 1 --2- 172.21.15.79:0/3435627034 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x558e12d464c0 0x558e12d47930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:14.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.144+0000 7f416e3ea740 4 client.15111 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:36:14.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.144+0000 7f416e3ea740 1 -- 172.21.15.79:0/3435627034 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e12ca15f0 con 0x558e12d464c0 2024-08-20T01:36:14.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.145+0000 7f416958c640 1 --2- 172.21.15.79:0/3435627034 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x558e12d464c0 0x558e12d47930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:14.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.145+0000 7f414d7fa640 10 client.15111 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:36:14.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.145+0000 7f416958c640 1 --2- 172.21.15.79:0/3435627034 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x558e12d464c0 0x558e12d47930 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c3ac90c9ddfd14f server_cookie=26dd956f9f85ebe5 in_seq=0 out_seq=0 2024-08-20T01:36:14.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.146+0000 7f414d7fa640 1 -- 172.21.15.79:0/3435627034 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558e12ca15f0 con 0x558e12d464c0 2024-08-20T01:36:14.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.146+0000 7f414d7fa640 10 client.15111 handle_command_reply: tid=0 2024-08-20T01:36:14.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.146+0000 7f416e3ea740 1 client.15111 shutdown 2024-08-20T01:36:14.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.146+0000 7f416e3ea740 1 -- 172.21.15.79:0/3435627034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e12d28bf0 msgr2=0x558e12d32420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:14.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.146+0000 7f416e3ea740 1 --2- 172.21.15.79:0/3435627034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e12d28bf0 0x558e12d32420 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f4158009930 tx=0x7f4158031690 comp rx=0 tx=0).stop 2024-08-20T01:36:14.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.146+0000 7f416e3ea740 1 -- 172.21.15.79:0/3435627034 shutdown_connections 2024-08-20T01:36:14.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.146+0000 7f416e3ea740 1 --2- 172.21.15.79:0/3435627034 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x558e12d464c0 0x558e12d47930 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:14.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.146+0000 7f416e3ea740 1 --2- 172.21.15.79:0/3435627034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e12d354a0 0x558e12d32ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:14.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.146+0000 7f416e3ea740 1 --2- 172.21.15.79:0/3435627034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e12d29510 0x558e12d32960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:14.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.146+0000 7f414d7fa640 0 client.15111 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:36:14.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.146+0000 7f416e3ea740 1 --2- 172.21.15.79:0/3435627034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e12d28bf0 0x558e12d32420 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:14.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.146+0000 7f416e3ea740 1 -- 172.21.15.79:0/3435627034 >> 172.21.15.79:0/3435627034 conn(0x558e12d26a20 msgr2=0x558e12d2c590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:14.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.146+0000 7f416e3ea740 1 -- 172.21.15.79:0/3435627034 shutdown_connections 2024-08-20T01:36:14.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.146+0000 7f416e3ea740 1 -- 172.21.15.79:0/3435627034 wait complete. 2024-08-20T01:36:14.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.147+0000 7f416e3ea740 20 client.15111 trim_cache size 0 max 16384 2024-08-20T01:36:14.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.164+0000 7f416e3ea740 1 Processor -- start 2024-08-20T01:36:14.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.164+0000 7f416e3ea740 1 -- start start 2024-08-20T01:36:14.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.164+0000 7f416e3ea740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e12d28bf0 0x558e12d2cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:14.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.164+0000 7f416e3ea740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e12d29510 0x558e12d32920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:14.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.164+0000 7f416e3ea740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e12d354a0 0x558e12d32e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:14.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.164+0000 7f416e3ea740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558e12d45c70 con 0x558e12d28bf0 2024-08-20T01:36:14.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.164+0000 7f416e3ea740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558e12d46340 con 0x558e12d29510 2024-08-20T01:36:14.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.164+0000 7f416e3ea740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558e12d46a10 con 0x558e12d354a0 2024-08-20T01:36:14.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.164+0000 7f4169d8d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e12d28bf0 0x558e12d2cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:14.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.164+0000 7f4169d8d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e12d28bf0 0x558e12d2cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49094/0 (socket says 172.21.15.79:49094) 2024-08-20T01:36:14.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.164+0000 7f4169d8d640 1 -- 172.21.15.79:0/1408486933 learned_addr learned my addr 172.21.15.79:0/1408486933 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:14.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.165+0000 7f416a58e640 1 --2- 172.21.15.79:0/1408486933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e12d354a0 0x558e12d32e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:14.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.165+0000 7f4169d8d640 1 -- 172.21.15.79:0/1408486933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e12d354a0 msgr2=0x558e12d32e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:14.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.165+0000 7f4169d8d640 1 --2- 172.21.15.79:0/1408486933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e12d354a0 0x558e12d32e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:14.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.165+0000 7f4169d8d640 1 -- 172.21.15.79:0/1408486933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e12d29510 msgr2=0x558e12d32920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:14.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.165+0000 7f4169d8d640 1 --2- 172.21.15.79:0/1408486933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e12d29510 0x558e12d32920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:14.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.165+0000 7f4169d8d640 1 -- 172.21.15.79:0/1408486933 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e12d26810 con 0x558e12d28bf0 2024-08-20T01:36:14.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.165+0000 7f4169d8d640 1 --2- 172.21.15.79:0/1408486933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e12d28bf0 0x558e12d2cc60 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4158009850 tx=0x7f41580058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8965bf8b486fd7a8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:14.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.165+0000 7f414f7fe640 1 -- 172.21.15.79:0/1408486933 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4158035070 con 0x558e12d28bf0 2024-08-20T01:36:14.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.165+0000 7f414f7fe640 1 -- 172.21.15.79:0/1408486933 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4158003840 con 0x558e12d28bf0 2024-08-20T01:36:14.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.165+0000 7f414f7fe640 1 -- 172.21.15.79:0/1408486933 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4158004fc0 con 0x558e12d28bf0 2024-08-20T01:36:14.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.166+0000 7f416e3ea740 1 -- 172.21.15.79:0/1408486933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e12d28bf0 msgr2=0x558e12d2cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:14.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.166+0000 7f416e3ea740 1 --2- 172.21.15.79:0/1408486933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e12d28bf0 0x558e12d2cc60 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4158009850 tx=0x7f41580058b0 comp rx=0 tx=0).stop 2024-08-20T01:36:14.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.166+0000 7f416e3ea740 1 -- 172.21.15.79:0/1408486933 shutdown_connections 2024-08-20T01:36:14.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.166+0000 7f416e3ea740 1 --2- 172.21.15.79:0/1408486933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e12d354a0 0x558e12d32e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:14.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.166+0000 7f416e3ea740 1 --2- 172.21.15.79:0/1408486933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e12d29510 0x558e12d32920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:14.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.166+0000 7f416e3ea740 1 --2- 172.21.15.79:0/1408486933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e12d28bf0 0x558e12d2cc60 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:14.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.166+0000 7f416e3ea740 1 -- 172.21.15.79:0/1408486933 >> 172.21.15.79:0/1408486933 conn(0x558e12d26a20 msgr2=0x558e12d2d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:14.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.166+0000 7f416e3ea740 1 -- 172.21.15.79:0/1408486933 shutdown_connections 2024-08-20T01:36:14.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.166+0000 7f416e3ea740 1 -- 172.21.15.79:0/1408486933 wait complete. 2024-08-20T01:36:14.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.166+0000 7f416e3ea740 1 -- start start 2024-08-20T01:36:14.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.166+0000 7f416e3ea740 1 Processor -- start 2024-08-20T01:36:14.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.166+0000 7f416e3ea740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e12d28bf0 0x558e12d49320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:14.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.166+0000 7f416e3ea740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e12d29510 0x558e12d498a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:14.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.166+0000 7f416e3ea740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e12d354a0 0x558e12d4e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:14.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.166+0000 7f416e3ea740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558e12d477b0 con 0x558e12d354a0 2024-08-20T01:36:14.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.166+0000 7f416e3ea740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558e12d470e0 con 0x558e12d29510 2024-08-20T01:36:14.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.166+0000 7f416e3ea740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558e12d47e80 con 0x558e12d28bf0 2024-08-20T01:36:14.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.166+0000 7f416e3ea740 10 client.0 _ll_register_callbacks cb 0x7f4158009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:14.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.167+0000 7f416a58e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e12d354a0 0x558e12d4e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:14.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.167+0000 7f416a58e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e12d354a0 0x558e12d4e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49100/0 (socket says 172.21.15.79:49100) 2024-08-20T01:36:14.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.167+0000 7f416a58e640 1 -- 172.21.15.79:0/2650081850 learned_addr learned my addr 172.21.15.79:0/2650081850 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:14.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.167+0000 7f4169d8d640 1 --2- 172.21.15.79:0/2650081850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e12d28bf0 0x558e12d49320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:14.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.167+0000 7f416958c640 1 --2- 172.21.15.79:0/2650081850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e12d29510 0x558e12d498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:14.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.167+0000 7f416a58e640 1 -- 172.21.15.79:0/2650081850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e12d28bf0 msgr2=0x558e12d49320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:14.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.167+0000 7f416a58e640 1 --2- 172.21.15.79:0/2650081850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e12d28bf0 0x558e12d49320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:14.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.167+0000 7f416a58e640 1 -- 172.21.15.79:0/2650081850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e12d29510 msgr2=0x558e12d498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:14.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.167+0000 7f416a58e640 1 --2- 172.21.15.79:0/2650081850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e12d29510 0x558e12d498a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:14.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.167+0000 7f416a58e640 1 -- 172.21.15.79:0/2650081850 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e12d4ef10 con 0x558e12d354a0 2024-08-20T01:36:14.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.167+0000 7f416a58e640 1 --2- 172.21.15.79:0/2650081850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e12d354a0 0x558e12d4e800 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f415c01e8c0 tx=0x7f415c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6928f023d8b948df server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:14.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.167+0000 7f414d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:36:14.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.167+0000 7f414d7fa640 1 -- 172.21.15.79:0/2650081850 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415c01cb40 con 0x558e12d354a0 2024-08-20T01:36:14.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.167+0000 7f414d7fa640 1 -- 172.21.15.79:0/2650081850 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f415c01cce0 con 0x558e12d354a0 2024-08-20T01:36:14.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.167+0000 7f416e3ea740 1 -- 172.21.15.79:0/2650081850 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4158003840 con 0x558e12d354a0 2024-08-20T01:36:14.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.167+0000 7f414d7fa640 1 -- 172.21.15.79:0/2650081850 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f415c0273f0 con 0x558e12d354a0 2024-08-20T01:36:14.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.167+0000 7f416e3ea740 10 client.15117 fetch_fsmap learned FSMap version 27 2024-08-20T01:36:14.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.167+0000 7f416e3ea740 1 -- 172.21.15.79:0/2650081850 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558e12d50370 con 0x558e12d354a0 2024-08-20T01:36:14.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.168+0000 7f414d7fa640 1 -- 172.21.15.79:0/2650081850 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4158003840 con 0x558e12d354a0 2024-08-20T01:36:14.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.168+0000 7f414d7fa640 1 -- 172.21.15.79:0/2650081850 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f415c026070 con 0x558e12d354a0 2024-08-20T01:36:14.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.168+0000 7f416e3ea740 10 client.15117 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:36:14.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.168+0000 7f416e3ea740 10 client.15117 resolve_mds: resolved name 'f' to daemon mds.f 2024-08-20T01:36:14.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.168+0000 7f416e3ea740 20 client.15117 populate_metadata read hostname 'smithi079' 2024-08-20T01:36:14.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.168+0000 7f416e3ea740 1 --2- 172.21.15.79:0/2650081850 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x558e12db51a0 0x558e12db3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:14.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.168+0000 7f416e3ea740 4 client.15117 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-20T01:36:14.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.168+0000 7f416e3ea740 1 -- 172.21.15.79:0/2650081850 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "status"}) -- 0x558e12c9d090 con 0x558e12db51a0 2024-08-20T01:36:14.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.168+0000 7f4169d8d640 1 --2- 172.21.15.79:0/2650081850 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x558e12db51a0 0x558e12db3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:14.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.168+0000 7f4169d8d640 1 --2- 172.21.15.79:0/2650081850 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x558e12db51a0 0x558e12db3eb0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6e099dd53a8d57af server_cookie=3304b7b729607787 in_seq=0 out_seq=0 2024-08-20T01:36:14.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.168+0000 7f414d7fa640 10 client.15117 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:36:14.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.169+0000 7f414d7fa640 1 -- 172.21.15.79:0/2650081850 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x558e12c9d090 con 0x558e12db51a0 2024-08-20T01:36:14.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.169+0000 7f414d7fa640 10 client.15117 handle_command_reply: tid=0 2024-08-20T01:36:14.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.169+0000 7f416e3ea740 1 client.15117 shutdown 2024-08-20T01:36:14.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.169+0000 7f416e3ea740 1 -- 172.21.15.79:0/2650081850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e12d354a0 msgr2=0x558e12d4e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:14.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.169+0000 7f416e3ea740 1 --2- 172.21.15.79:0/2650081850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e12d354a0 0x558e12d4e800 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f415c01e8c0 tx=0x7f415c004a40 comp rx=0 tx=0).stop 2024-08-20T01:36:14.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.169+0000 7f416e3ea740 1 -- 172.21.15.79:0/2650081850 shutdown_connections 2024-08-20T01:36:14.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.169+0000 7f416e3ea740 1 --2- 172.21.15.79:0/2650081850 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x558e12db51a0 0x558e12db3eb0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:14.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.169+0000 7f416e3ea740 1 --2- 172.21.15.79:0/2650081850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e12d354a0 0x558e12d4e800 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:14.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.169+0000 7f414d7fa640 0 client.15117 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:36:14.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.169+0000 7f416e3ea740 1 --2- 172.21.15.79:0/2650081850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e12d29510 0x558e12d498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:14.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.169+0000 7f416e3ea740 1 --2- 172.21.15.79:0/2650081850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e12d28bf0 0x558e12d49320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:14.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.169+0000 7f416e3ea740 1 -- 172.21.15.79:0/2650081850 >> 172.21.15.79:0/2650081850 conn(0x558e12d26a20 msgr2=0x558e12d30c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:14.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.169+0000 7f416e3ea740 1 -- 172.21.15.79:0/2650081850 shutdown_connections 2024-08-20T01:36:14.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.169+0000 7f416e3ea740 1 -- 172.21.15.79:0/2650081850 wait complete. 2024-08-20T01:36:14.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.169+0000 7f416e3ea740 20 client.15117 trim_cache size 0 max 16384 2024-08-20T01:36:14.181 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:36:14.181 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "28484e9a-5e93-11ef-bccf-c7b262605968", 2024-08-20T01:36:14.181 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 3, 2024-08-20T01:36:14.181 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 24514, 2024-08-20T01:36:14.181 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-08-20T01:36:14.181 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-08-20T01:36:14.181 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-08-20T01:36:14.181 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 69.744892910999994, 2024-08-20T01:36:14.181 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 27, 2024-08-20T01:36:14.181 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 74, 2024-08-20T01:36:14.181 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 72, 2024-08-20T01:36:14.182 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 105.472765279 2024-08-20T01:36:14.182 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:36:14.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.170+0000 7f416bff1640 1 -- 172.21.15.79:0/1557079912 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f41500b3ce0 msgr2=0x7f41500b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:14.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.170+0000 7f416bff1640 1 --2- 172.21.15.79:0/1557079912 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f41500b3ce0 0x7f41500b61a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f415c005fd0 tx=0x7f415c0096e0 comp rx=0 tx=0).stop 2024-08-20T01:36:14.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.170+0000 7f416bff1640 1 -- 172.21.15.79:0/1557079912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4164108600 msgr2=0x7f4164199510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:14.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.170+0000 7f416bff1640 1 --2- 172.21.15.79:0/1557079912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4164108600 0x7f4164199510 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f416000d950 tx=0x7f416000de10 comp rx=0 tx=0).stop 2024-08-20T01:36:14.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.170+0000 7f416bff1640 1 -- 172.21.15.79:0/1557079912 shutdown_connections 2024-08-20T01:36:14.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.170+0000 7f416bff1640 1 --2- 172.21.15.79:0/1557079912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4164108f80 0x7f416419e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:14.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.170+0000 7f416bff1640 1 --2- 172.21.15.79:0/1557079912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4164108600 0x7f4164199510 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:14.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.170+0000 7f416bff1640 1 --2- 172.21.15.79:0/1557079912 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f41500b3ce0 0x7f41500b61a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:14.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.170+0000 7f416bff1640 1 --2- 172.21.15.79:0/1557079912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4164101500 0x7f4164198fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:14.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.170+0000 7f416bff1640 1 -- 172.21.15.79:0/1557079912 >> 172.21.15.79:0/1557079912 conn(0x7f4164076cc0 msgr2=0x7f41641000a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:14.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.170+0000 7f416bff1640 1 -- 172.21.15.79:0/1557079912 shutdown_connections 2024-08-20T01:36:14.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:14.170+0000 7f416bff1640 1 -- 172.21.15.79:0/1557079912 wait complete. 2024-08-20T01:36:14.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:14 smithi081 ceph-mon[22209]: pgmap v314: 97 pgs: 97 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T01:36:14.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:14 smithi175 ceph-mon[22392]: pgmap v314: 97 pgs: 97 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T01:36:14.937 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.c status 2024-08-20T01:36:15.182 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:36:15.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.659+0000 7f9fde943640 1 -- 172.21.15.79:0/3958635810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fd8101ed0 msgr2=0x7f9fd810ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:15.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.659+0000 7f9fde943640 1 --2- 172.21.15.79:0/3958635810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fd8101ed0 0x7f9fd810ec20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc009900 tx=0x7f9fcc02a480 comp rx=0 tx=0).stop 2024-08-20T01:36:15.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.659+0000 7f9fde943640 1 -- 172.21.15.79:0/3958635810 shutdown_connections 2024-08-20T01:36:15.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.659+0000 7f9fde943640 1 --2- 172.21.15.79:0/3958635810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd810f160 0x7f9fd8111550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:15.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.659+0000 7f9fde943640 1 --2- 172.21.15.79:0/3958635810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fd8101ed0 0x7f9fd810ec20 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:15.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.659+0000 7f9fde943640 1 --2- 172.21.15.79:0/3958635810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9fd81015b0 0x7f9fd8101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:15.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.659+0000 7f9fde943640 1 -- 172.21.15.79:0/3958635810 >> 172.21.15.79:0/3958635810 conn(0x7f9fd80fd400 msgr2=0x7f9fd80ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:15.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.659+0000 7f9fde943640 1 -- 172.21.15.79:0/3958635810 shutdown_connections 2024-08-20T01:36:15.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.659+0000 7f9fde943640 1 -- 172.21.15.79:0/3958635810 wait complete. 2024-08-20T01:36:15.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.660+0000 7f9fde943640 1 Processor -- start 2024-08-20T01:36:15.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.660+0000 7f9fde943640 1 -- start start 2024-08-20T01:36:15.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.660+0000 7f9fde943640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd81015b0 0x7f9fd819b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:15.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.660+0000 7f9fde943640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9fd8101ed0 0x7f9fd819b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:15.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.660+0000 7f9fde943640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fd810f160 0x7f9fd81a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:15.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.660+0000 7f9fde943640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd8114be0 con 0x7f9fd810f160 2024-08-20T01:36:15.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.660+0000 7f9fde943640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd8114a60 con 0x7f9fd81015b0 2024-08-20T01:36:15.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.660+0000 7f9fde943640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd8114d60 con 0x7f9fd8101ed0 2024-08-20T01:36:15.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.660+0000 7f9fdcee0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fd810f160 0x7f9fd81a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:15.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.661+0000 7f9fdcee0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fd810f160 0x7f9fd81a0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49116/0 (socket says 172.21.15.79:49116) 2024-08-20T01:36:15.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.661+0000 7f9fdcee0640 1 -- 172.21.15.79:0/1241591699 learned_addr learned my addr 172.21.15.79:0/1241591699 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:15.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.661+0000 7f9fd77fe640 1 --2- 172.21.15.79:0/1241591699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9fd8101ed0 0x7f9fd819b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:15.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.661+0000 7f9fd7fff640 1 --2- 172.21.15.79:0/1241591699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd81015b0 0x7f9fd819b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:15.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.661+0000 7f9fdcee0640 1 -- 172.21.15.79:0/1241591699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9fd8101ed0 msgr2=0x7f9fd819b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:15.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.661+0000 7f9fdcee0640 1 --2- 172.21.15.79:0/1241591699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9fd8101ed0 0x7f9fd819b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:15.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.661+0000 7f9fdcee0640 1 -- 172.21.15.79:0/1241591699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd81015b0 msgr2=0x7f9fd819b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:15.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.661+0000 7f9fdcee0640 1 --2- 172.21.15.79:0/1241591699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd81015b0 0x7f9fd819b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:15.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.661+0000 7f9fdcee0640 1 -- 172.21.15.79:0/1241591699 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fd81a12e0 con 0x7f9fd810f160 2024-08-20T01:36:15.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.661+0000 7f9fd7fff640 1 --2- 172.21.15.79:0/1241591699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd81015b0 0x7f9fd819b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:36:15.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.661+0000 7f9fdcee0640 1 --2- 172.21.15.79:0/1241591699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fd810f160 0x7f9fd81a0b10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9fd000b970 tx=0x7f9fd000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:15.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.661+0000 7f9fd57fa640 1 -- 172.21.15.79:0/1241591699 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0019070 con 0x7f9fd810f160 2024-08-20T01:36:15.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.661+0000 7f9fd57fa640 1 -- 172.21.15.79:0/1241591699 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9fd0014440 con 0x7f9fd810f160 2024-08-20T01:36:15.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.661+0000 7f9fde943640 1 -- 172.21.15.79:0/1241591699 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fd81a15d0 con 0x7f9fd810f160 2024-08-20T01:36:15.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.661+0000 7f9fd57fa640 1 -- 172.21.15.79:0/1241591699 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd00075d0 con 0x7f9fd810f160 2024-08-20T01:36:15.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.661+0000 7f9fde943640 1 -- 172.21.15.79:0/1241591699 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fd81a7d10 con 0x7f9fd810f160 2024-08-20T01:36:15.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.664+0000 7f9fe0d3c740 1 Processor -- start 2024-08-20T01:36:15.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.664+0000 7f9fd57fa640 1 -- 172.21.15.79:0/1241591699 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f9fd001c070 con 0x7f9fd810f160 2024-08-20T01:36:15.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.664+0000 7f9fe0d3c740 1 -- start start 2024-08-20T01:36:15.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.664+0000 7f9fe0d3c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620580babf0 0x5620580bafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:15.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.664+0000 7f9fe0d3c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620580bb510 0x5620580c6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:15.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.664+0000 7f9fe0d3c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620580c74a0 0x5620580c9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:15.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.664+0000 7f9fe0d3c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5620580316a0 con 0x5620580bb510 2024-08-20T01:36:15.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.664+0000 7f9fe0d3c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562058020ba0 con 0x5620580c74a0 2024-08-20T01:36:15.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.664+0000 7f9fe0d3c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562058024be0 con 0x5620580babf0 2024-08-20T01:36:15.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.664+0000 7f9fd7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620580bb510 0x5620580c6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:15.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.664+0000 7f9fd7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620580bb510 0x5620580c6f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49128/0 (socket says 172.21.15.79:49128) 2024-08-20T01:36:15.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.664+0000 7f9fd7fff640 1 -- 172.21.15.79:0/24985134 learned_addr learned my addr 172.21.15.79:0/24985134 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:15.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.664+0000 7f9fd77fe640 1 --2- 172.21.15.79:0/24985134 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620580babf0 0x5620580bafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:15.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.664+0000 7f9fd77fe640 1 --2- 172.21.15.79:0/24985134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620580c74a0 0x5620580c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:15.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.665+0000 7f9fd7fff640 1 -- 172.21.15.79:0/24985134 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620580babf0 msgr2=0x5620580bafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:15.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.665+0000 7f9fd7fff640 1 --2- 172.21.15.79:0/24985134 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620580babf0 0x5620580bafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:15.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.665+0000 7f9fd7fff640 1 -- 172.21.15.79:0/24985134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620580c74a0 msgr2=0x5620580c9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:15.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.665+0000 7f9fd7fff640 1 --2- 172.21.15.79:0/24985134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620580c74a0 0x5620580c9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:15.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.665+0000 7f9fd7fff640 1 -- 172.21.15.79:0/24985134 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562057d80540 con 0x5620580bb510 2024-08-20T01:36:15.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.665+0000 7f9fd57fa640 1 --2- 172.21.15.79:0/1241591699 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9fc00b3ce0 0x7f9fc00b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:15.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.665+0000 7f9fd77fe640 1 --2- 172.21.15.79:0/1241591699 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9fc00b3ce0 0x7f9fc00b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:15.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.665+0000 7f9fd7fff640 1 --2- 172.21.15.79:0/24985134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620580bb510 0x5620580c6f60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9fc800aa40 tx=0x7f9fc800af00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbd0935205b16023 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:15.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.665+0000 7f9fd57fa640 1 -- 172.21.15.79:0/1241591699 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9fd00e3220 con 0x7f9fd810f160 2024-08-20T01:36:15.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.665+0000 7f9fbe7fc640 1 -- 172.21.15.79:0/24985134 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc8015070 con 0x5620580bb510 2024-08-20T01:36:15.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.665+0000 7f9fbe7fc640 1 -- 172.21.15.79:0/24985134 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9fc800cc40 con 0x5620580bb510 2024-08-20T01:36:15.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.665+0000 7f9fbe7fc640 1 -- 172.21.15.79:0/24985134 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc80185c0 con 0x5620580bb510 2024-08-20T01:36:15.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.666+0000 7f9fe0d3c740 1 -- 172.21.15.79:0/24985134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620580bb510 msgr2=0x5620580c6f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:15.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.666+0000 7f9fd77fe640 1 --2- 172.21.15.79:0/1241591699 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9fc00b3ce0 0x7f9fc00b61a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc000c00 tx=0x7f9fcc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:15.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.666+0000 7f9fe0d3c740 1 --2- 172.21.15.79:0/24985134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620580bb510 0x5620580c6f60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9fc800aa40 tx=0x7f9fc800af00 comp rx=0 tx=0).stop 2024-08-20T01:36:15.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.666+0000 7f9fe0d3c740 1 -- 172.21.15.79:0/24985134 shutdown_connections 2024-08-20T01:36:15.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.666+0000 7f9fe0d3c740 1 --2- 172.21.15.79:0/24985134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620580c74a0 0x5620580c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:15.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.666+0000 7f9fe0d3c740 1 --2- 172.21.15.79:0/24985134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620580bb510 0x5620580c6f60 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:15.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.666+0000 7f9fe0d3c740 1 --2- 172.21.15.79:0/24985134 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620580babf0 0x5620580bafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:15.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.666+0000 7f9fe0d3c740 1 -- 172.21.15.79:0/24985134 >> 172.21.15.79:0/24985134 conn(0x5620580b8a20 msgr2=0x5620580b9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:15.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.666+0000 7f9fe0d3c740 1 -- 172.21.15.79:0/24985134 shutdown_connections 2024-08-20T01:36:15.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.666+0000 7f9fe0d3c740 1 -- 172.21.15.79:0/24985134 wait complete. 2024-08-20T01:36:15.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.666+0000 7f9fe0d3c740 1 -- start start 2024-08-20T01:36:15.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.667+0000 7f9fe0d3c740 1 Processor -- start 2024-08-20T01:36:15.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.667+0000 7f9fe0d3c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620580babf0 0x5620580c4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:15.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.667+0000 7f9fe0d3c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620580bb510 0x5620580c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:15.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.667+0000 7f9fe0d3c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620580c74a0 0x5620580c4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:15.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.667+0000 7f9fe0d3c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562057e835f0 con 0x5620580c74a0 2024-08-20T01:36:15.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.667+0000 7f9fe0d3c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562057fa76c0 con 0x5620580babf0 2024-08-20T01:36:15.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.667+0000 7f9fe0d3c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5620580ca150 con 0x5620580bb510 2024-08-20T01:36:15.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.667+0000 7f9fe0d3c740 10 client.0 _ll_register_callbacks cb 0x562057fe41e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:15.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.667+0000 7f9fdcee0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620580c74a0 0x5620580c4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:15.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.667+0000 7f9fdcee0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620580c74a0 0x5620580c4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49130/0 (socket says 172.21.15.79:49130) 2024-08-20T01:36:15.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.667+0000 7f9fdcee0640 1 -- 172.21.15.79:0/866052005 learned_addr learned my addr 172.21.15.79:0/866052005 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:15.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.667+0000 7f9fd7fff640 1 --2- 172.21.15.79:0/866052005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620580babf0 0x5620580c4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:15.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.667+0000 7f9fdcee0640 1 -- 172.21.15.79:0/866052005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620580bb510 msgr2=0x5620580c49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:15.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.667+0000 7f9fdcee0640 1 --2- 172.21.15.79:0/866052005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620580bb510 0x5620580c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:15.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.667+0000 7f9fdcee0640 1 -- 172.21.15.79:0/866052005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620580babf0 msgr2=0x5620580c4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:15.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.667+0000 7f9fdcee0640 1 --2- 172.21.15.79:0/866052005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620580babf0 0x5620580c4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:15.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.667+0000 7f9fdcee0640 1 -- 172.21.15.79:0/866052005 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620580d3530 con 0x5620580c74a0 2024-08-20T01:36:15.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.667+0000 7f9fdcee0640 1 --2- 172.21.15.79:0/866052005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620580c74a0 0x5620580c4ef0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9fd00a61b0 tx=0x7f9fd00aa960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a869edb3e3448bf9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:15.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.667+0000 7f9fb77fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:36:15.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.667+0000 7f9fb77fe640 1 -- 172.21.15.79:0/866052005 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd00b31e0 con 0x5620580c74a0 2024-08-20T01:36:15.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.667+0000 7f9fb77fe640 1 -- 172.21.15.79:0/866052005 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9fd00b2d50 con 0x5620580c74a0 2024-08-20T01:36:15.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.667+0000 7f9fe0d3c740 1 -- 172.21.15.79:0/866052005 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fc800cc40 con 0x5620580c74a0 2024-08-20T01:36:15.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.668+0000 7f9fb77fe640 1 -- 172.21.15.79:0/866052005 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9fd00b2f70 con 0x5620580c74a0 2024-08-20T01:36:15.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.668+0000 7f9fe0d3c740 10 client.15129 fetch_fsmap learned FSMap version 27 2024-08-20T01:36:15.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.668+0000 7f9fe0d3c740 1 -- 172.21.15.79:0/866052005 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5620580d5f40 con 0x5620580c74a0 2024-08-20T01:36:15.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.668+0000 7f9fb77fe640 1 -- 172.21.15.79:0/866052005 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9fc800cc40 con 0x5620580c74a0 2024-08-20T01:36:15.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.668+0000 7f9fb77fe640 1 -- 172.21.15.79:0/866052005 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f9fd00a5ca0 con 0x5620580c74a0 2024-08-20T01:36:15.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.668+0000 7f9fe0d3c740 10 client.15129 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:36:15.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.668+0000 7f9fe0d3c740 10 client.15129 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-20T01:36:15.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.668+0000 7f9fe0d3c740 20 client.15129 populate_metadata read hostname 'smithi079' 2024-08-20T01:36:15.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.668+0000 7f9fe0d3c740 1 --2- 172.21.15.79:0/866052005 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x5620580d85f0 0x5620580d9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:15.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.668+0000 7f9fe0d3c740 4 client.15129 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:36:15.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.668+0000 7f9fe0d3c740 1 -- 172.21.15.79:0/866052005 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5620580335f0 con 0x5620580d85f0 2024-08-20T01:36:15.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.668+0000 7f9fd7fff640 1 --2- 172.21.15.79:0/866052005 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x5620580d85f0 0x5620580d9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:15.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.669+0000 7f9fb77fe640 10 client.15129 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:36:15.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.669+0000 7f9fd7fff640 1 --2- 172.21.15.79:0/866052005 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x5620580d85f0 0x5620580d9a60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d59bbbc0701b32be server_cookie=6862161cddacad0d in_seq=0 out_seq=0 2024-08-20T01:36:15.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.670+0000 7f9fb77fe640 1 -- 172.21.15.79:0/866052005 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5620580335f0 con 0x5620580d85f0 2024-08-20T01:36:15.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.670+0000 7f9fb77fe640 10 client.15129 handle_command_reply: tid=0 2024-08-20T01:36:15.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.670+0000 7f9fe0d3c740 1 client.15129 shutdown 2024-08-20T01:36:15.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.670+0000 7f9fe0d3c740 1 -- 172.21.15.79:0/866052005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620580c74a0 msgr2=0x5620580c4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:15.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.670+0000 7f9fe0d3c740 1 --2- 172.21.15.79:0/866052005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620580c74a0 0x5620580c4ef0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9fd00a61b0 tx=0x7f9fd00aa960 comp rx=0 tx=0).stop 2024-08-20T01:36:15.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.670+0000 7f9fe0d3c740 1 -- 172.21.15.79:0/866052005 shutdown_connections 2024-08-20T01:36:15.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.670+0000 7f9fe0d3c740 1 --2- 172.21.15.79:0/866052005 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x5620580d85f0 0x5620580d9a60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:15.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.670+0000 7f9fe0d3c740 1 --2- 172.21.15.79:0/866052005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620580c74a0 0x5620580c4ef0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:15.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.670+0000 7f9fe0d3c740 1 --2- 172.21.15.79:0/866052005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620580bb510 0x5620580c49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:15.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.670+0000 7f9fe0d3c740 1 --2- 172.21.15.79:0/866052005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620580babf0 0x5620580c4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:15.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.670+0000 7f9fe0d3c740 1 -- 172.21.15.79:0/866052005 >> 172.21.15.79:0/866052005 conn(0x5620580b8a20 msgr2=0x5620580be5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:15.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.670+0000 7f9fb77fe640 0 client.15129 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:36:15.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.670+0000 7f9fe0d3c740 1 -- 172.21.15.79:0/866052005 shutdown_connections 2024-08-20T01:36:15.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.670+0000 7f9fe0d3c740 1 -- 172.21.15.79:0/866052005 wait complete. 2024-08-20T01:36:15.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.670+0000 7f9fe0d3c740 20 client.15129 trim_cache size 0 max 16384 2024-08-20T01:36:15.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.687+0000 7f9fe0d3c740 1 Processor -- start 2024-08-20T01:36:15.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.688+0000 7f9fe0d3c740 1 -- start start 2024-08-20T01:36:15.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.688+0000 7f9fe0d3c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620580babf0 0x5620580d8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:15.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.688+0000 7f9fe0d3c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620580bb510 0x5620580bedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:15.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.688+0000 7f9fe0d3c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620580c74a0 0x5620580c3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:15.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.688+0000 7f9fe0d3c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5620580d7da0 con 0x5620580c74a0 2024-08-20T01:36:15.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.688+0000 7f9fe0d3c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5620580d8470 con 0x5620580bb510 2024-08-20T01:36:15.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.688+0000 7f9fe0d3c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5620580d8b40 con 0x5620580babf0 2024-08-20T01:36:15.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.688+0000 7f9fdcee0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620580c74a0 0x5620580c3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:15.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.688+0000 7f9fdcee0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620580c74a0 0x5620580c3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49132/0 (socket says 172.21.15.79:49132) 2024-08-20T01:36:15.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.688+0000 7f9fdcee0640 1 -- 172.21.15.79:0/2348457396 learned_addr learned my addr 172.21.15.79:0/2348457396 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:15.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.688+0000 7f9fdcee0640 1 -- 172.21.15.79:0/2348457396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620580babf0 msgr2=0x5620580d8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:15.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.688+0000 7f9fdcee0640 1 --2- 172.21.15.79:0/2348457396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620580babf0 0x5620580d8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:15.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.688+0000 7f9fd77fe640 1 --2- 172.21.15.79:0/2348457396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620580bb510 0x5620580bedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:15.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.688+0000 7f9fdcee0640 1 -- 172.21.15.79:0/2348457396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620580bb510 msgr2=0x5620580bedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:15.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.688+0000 7f9fdcee0640 1 --2- 172.21.15.79:0/2348457396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620580bb510 0x5620580bedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:15.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.688+0000 7f9fdcee0640 1 -- 172.21.15.79:0/2348457396 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620580d96c0 con 0x5620580c74a0 2024-08-20T01:36:15.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.688+0000 7f9fd77fe640 1 --2- 172.21.15.79:0/2348457396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620580bb510 0x5620580bedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:36:15.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.688+0000 7f9fdcee0640 1 --2- 172.21.15.79:0/2348457396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620580c74a0 0x5620580c3d00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9fd00aa870 tx=0x7f9fd00b3110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a61daedf352d893 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:15.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.688+0000 7f9fbdffb640 1 -- 172.21.15.79:0/2348457396 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd00b31e0 con 0x5620580c74a0 2024-08-20T01:36:15.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.688+0000 7f9fbdffb640 1 -- 172.21.15.79:0/2348457396 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9fd00c8070 con 0x5620580c74a0 2024-08-20T01:36:15.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.688+0000 7f9fbdffb640 1 -- 172.21.15.79:0/2348457396 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd00a95f0 con 0x5620580c74a0 2024-08-20T01:36:15.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.689+0000 7f9fe0d3c740 1 -- 172.21.15.79:0/2348457396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620580c74a0 msgr2=0x5620580c3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:15.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.689+0000 7f9fe0d3c740 1 --2- 172.21.15.79:0/2348457396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620580c74a0 0x5620580c3d00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9fd00aa870 tx=0x7f9fd00b3110 comp rx=0 tx=0).stop 2024-08-20T01:36:15.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.689+0000 7f9fe0d3c740 1 -- 172.21.15.79:0/2348457396 shutdown_connections 2024-08-20T01:36:15.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.689+0000 7f9fe0d3c740 1 --2- 172.21.15.79:0/2348457396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620580c74a0 0x5620580c3d00 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:15.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.689+0000 7f9fe0d3c740 1 --2- 172.21.15.79:0/2348457396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620580bb510 0x5620580bedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:15.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.689+0000 7f9fe0d3c740 1 --2- 172.21.15.79:0/2348457396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620580babf0 0x5620580d8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:15.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.689+0000 7f9fe0d3c740 1 -- 172.21.15.79:0/2348457396 >> 172.21.15.79:0/2348457396 conn(0x5620580b8a20 msgr2=0x5620580bf700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:15.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.689+0000 7f9fe0d3c740 1 -- 172.21.15.79:0/2348457396 shutdown_connections 2024-08-20T01:36:15.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.689+0000 7f9fe0d3c740 1 -- 172.21.15.79:0/2348457396 wait complete. 2024-08-20T01:36:15.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.689+0000 7f9fe0d3c740 1 -- start start 2024-08-20T01:36:15.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.690+0000 7f9fe0d3c740 1 Processor -- start 2024-08-20T01:36:15.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.690+0000 7f9fe0d3c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620580babf0 0x5620580e25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:15.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.690+0000 7f9fe0d3c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620580bb510 0x5620580dac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:15.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.690+0000 7f9fe0d3c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620580c74a0 0x5620580db3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:15.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.690+0000 7f9fe0d3c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5620580d98e0 con 0x5620580bb510 2024-08-20T01:36:15.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.690+0000 7f9fe0d3c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5620580d9210 con 0x5620580c74a0 2024-08-20T01:36:15.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.690+0000 7f9fe0d3c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5620580d9fb0 con 0x5620580babf0 2024-08-20T01:36:15.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.690+0000 7f9fe0d3c740 10 client.0 _ll_register_callbacks cb 0x7f9fd00a9f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:15.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.690+0000 7f9fd77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620580bb510 0x5620580dac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:15.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.690+0000 7f9fd77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620580bb510 0x5620580dac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49138/0 (socket says 172.21.15.79:49138) 2024-08-20T01:36:15.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.690+0000 7f9fd77fe640 1 -- 172.21.15.79:0/1739108531 learned_addr learned my addr 172.21.15.79:0/1739108531 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:15.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.690+0000 7f9fdcee0640 1 --2- 172.21.15.79:0/1739108531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620580c74a0 0x5620580db3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:15.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.690+0000 7f9fd77fe640 1 -- 172.21.15.79:0/1739108531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620580babf0 msgr2=0x5620580e25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:15.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.690+0000 7f9fd77fe640 1 --2- 172.21.15.79:0/1739108531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620580babf0 0x5620580e25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:15.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.690+0000 7f9fd77fe640 1 -- 172.21.15.79:0/1739108531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620580c74a0 msgr2=0x5620580db3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:15.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.690+0000 7f9fd77fe640 1 --2- 172.21.15.79:0/1739108531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620580c74a0 0x5620580db3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:15.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.690+0000 7f9fd77fe640 1 -- 172.21.15.79:0/1739108531 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562058140cf0 con 0x5620580bb510 2024-08-20T01:36:15.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.690+0000 7f9fd77fe640 1 --2- 172.21.15.79:0/1739108531 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620580bb510 0x5620580dac60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc02a9a0 tx=0x7f9fcc032b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe8b4a10db6b3d2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:15.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.690+0000 7f9fb77fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:36:15.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.691+0000 7f9fb77fe640 1 -- 172.21.15.79:0/1739108531 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc050070 con 0x5620580bb510 2024-08-20T01:36:15.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.691+0000 7f9fb77fe640 1 -- 172.21.15.79:0/1739108531 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9fcc0046c0 con 0x5620580bb510 2024-08-20T01:36:15.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.691+0000 7f9fe0d3c740 1 -- 172.21.15.79:0/1739108531 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fd00c8070 con 0x5620580bb510 2024-08-20T01:36:15.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.691+0000 7f9fb77fe640 1 -- 172.21.15.79:0/1739108531 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9fcc05c050 con 0x5620580bb510 2024-08-20T01:36:15.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.691+0000 7f9fe0d3c740 10 client.15135 fetch_fsmap learned FSMap version 27 2024-08-20T01:36:15.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.691+0000 7f9fe0d3c740 1 -- 172.21.15.79:0/1739108531 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562058141ef0 con 0x5620580bb510 2024-08-20T01:36:15.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.691+0000 7f9fb77fe640 1 -- 172.21.15.79:0/1739108531 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9fd00c8070 con 0x5620580bb510 2024-08-20T01:36:15.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.691+0000 7f9fb77fe640 1 -- 172.21.15.79:0/1739108531 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f9fcc04b040 con 0x5620580bb510 2024-08-20T01:36:15.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.691+0000 7f9fe0d3c740 10 client.15135 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:36:15.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.691+0000 7f9fe0d3c740 10 client.15135 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-20T01:36:15.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.691+0000 7f9fe0d3c740 20 client.15135 populate_metadata read hostname 'smithi079' 2024-08-20T01:36:15.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.691+0000 7f9fe0d3c740 1 --2- 172.21.15.79:0/1739108531 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x562058146b70 0x562058145880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:15.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.691+0000 7f9fe0d3c740 4 client.15135 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-20T01:36:15.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.691+0000 7f9fe0d3c740 1 -- 172.21.15.79:0/1739108531 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "status"}) -- 0x56205802f090 con 0x562058146b70 2024-08-20T01:36:15.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.691+0000 7f9fd7fff640 1 --2- 172.21.15.79:0/1739108531 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x562058146b70 0x562058145880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:15.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.692+0000 7f9fd7fff640 1 --2- 172.21.15.79:0/1739108531 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x562058146b70 0x562058145880 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1ec0ae57fce9cea2 server_cookie=4f2b0baee96d4564 in_seq=0 out_seq=0 2024-08-20T01:36:15.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.692+0000 7f9fb77fe640 10 client.15135 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:36:15.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.692+0000 7f9fb77fe640 1 -- 172.21.15.79:0/1739108531 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x56205802f090 con 0x562058146b70 2024-08-20T01:36:15.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.692+0000 7f9fb77fe640 10 client.15135 handle_command_reply: tid=0 2024-08-20T01:36:15.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.692+0000 7f9fe0d3c740 1 client.15135 shutdown 2024-08-20T01:36:15.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.692+0000 7f9fe0d3c740 1 -- 172.21.15.79:0/1739108531 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620580bb510 msgr2=0x5620580dac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:15.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.692+0000 7f9fe0d3c740 1 --2- 172.21.15.79:0/1739108531 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620580bb510 0x5620580dac60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc02a9a0 tx=0x7f9fcc032b80 comp rx=0 tx=0).stop 2024-08-20T01:36:15.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.692+0000 7f9fe0d3c740 1 -- 172.21.15.79:0/1739108531 shutdown_connections 2024-08-20T01:36:15.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.692+0000 7f9fe0d3c740 1 --2- 172.21.15.79:0/1739108531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620580c74a0 0x5620580db3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:15.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.692+0000 7f9fe0d3c740 1 --2- 172.21.15.79:0/1739108531 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x562058146b70 0x562058145880 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:15.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.692+0000 7f9fe0d3c740 1 --2- 172.21.15.79:0/1739108531 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620580bb510 0x5620580dac60 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:15.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.692+0000 7f9fe0d3c740 1 --2- 172.21.15.79:0/1739108531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620580babf0 0x5620580e25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:15.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.692+0000 7f9fe0d3c740 1 -- 172.21.15.79:0/1739108531 >> 172.21.15.79:0/1739108531 conn(0x5620580b8a20 msgr2=0x5620580c5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:15.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.692+0000 7f9fb77fe640 0 client.15135 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:36:15.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.692+0000 7f9fe0d3c740 1 -- 172.21.15.79:0/1739108531 shutdown_connections 2024-08-20T01:36:15.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.692+0000 7f9fe0d3c740 1 -- 172.21.15.79:0/1739108531 wait complete. 2024-08-20T01:36:15.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.692+0000 7f9fe0d3c740 20 client.15135 trim_cache size 0 max 16384 2024-08-20T01:36:15.701 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:36:15.701 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "28484e9a-5e93-11ef-bccf-c7b262605968", 2024-08-20T01:36:15.701 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 2, 2024-08-20T01:36:15.701 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 24523, 2024-08-20T01:36:15.701 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-08-20T01:36:15.702 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-08-20T01:36:15.702 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-08-20T01:36:15.702 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 72.278117494, 2024-08-20T01:36:15.702 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 27, 2024-08-20T01:36:15.702 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 74, 2024-08-20T01:36:15.702 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 72, 2024-08-20T01:36:15.702 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 104.609119968 2024-08-20T01:36:15.702 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:36:15.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.693+0000 7f9fde943640 1 -- 172.21.15.79:0/1241591699 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9fc00b3ce0 msgr2=0x7f9fc00b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:15.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.693+0000 7f9fde943640 1 --2- 172.21.15.79:0/1241591699 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9fc00b3ce0 0x7f9fc00b61a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc000c00 tx=0x7f9fcc009260 comp rx=0 tx=0).stop 2024-08-20T01:36:15.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.693+0000 7f9fde943640 1 -- 172.21.15.79:0/1241591699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fd810f160 msgr2=0x7f9fd81a0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:15.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.693+0000 7f9fde943640 1 --2- 172.21.15.79:0/1241591699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fd810f160 0x7f9fd81a0b10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9fd000b970 tx=0x7f9fd000be30 comp rx=0 tx=0).stop 2024-08-20T01:36:15.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.693+0000 7f9fde943640 1 -- 172.21.15.79:0/1241591699 shutdown_connections 2024-08-20T01:36:15.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.693+0000 7f9fde943640 1 --2- 172.21.15.79:0/1241591699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fd810f160 0x7f9fd81a0b10 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:15.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.693+0000 7f9fde943640 1 --2- 172.21.15.79:0/1241591699 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9fc00b3ce0 0x7f9fc00b61a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:15.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.693+0000 7f9fde943640 1 --2- 172.21.15.79:0/1241591699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9fd8101ed0 0x7f9fd819b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:15.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.693+0000 7f9fde943640 1 --2- 172.21.15.79:0/1241591699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd81015b0 0x7f9fd819b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:15.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.693+0000 7f9fde943640 1 -- 172.21.15.79:0/1241591699 >> 172.21.15.79:0/1241591699 conn(0x7f9fd80fd400 msgr2=0x7f9fd80ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:15.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.693+0000 7f9fde943640 1 -- 172.21.15.79:0/1241591699 shutdown_connections 2024-08-20T01:36:15.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:15.693+0000 7f9fde943640 1 -- 172.21.15.79:0/1241591699 wait complete. 2024-08-20T01:36:16.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:16 smithi081 ceph-mon[22209]: pgmap v315: 97 pgs: 97 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-20T01:36:16.333 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:16 smithi079 ceph-mon[18656]: pgmap v315: 97 pgs: 97 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-20T01:36:16.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:16 smithi175 ceph-mon[22392]: pgmap v315: 97 pgs: 97 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-20T01:36:16.457 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.i status 2024-08-20T01:36:16.701 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:36:17.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.135+0000 7f9ec56e7640 1 -- 172.21.15.79:0/4067062711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ec01084e0 msgr2=0x7f9ec0108920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:17.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.135+0000 7f9ec56e7640 1 --2- 172.21.15.79:0/4067062711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ec01084e0 0x7f9ec0108920 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4009900 tx=0x7f9eb402a410 comp rx=0 tx=0).stop 2024-08-20T01:36:17.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.135+0000 7f9ec56e7640 1 -- 172.21.15.79:0/4067062711 shutdown_connections 2024-08-20T01:36:17.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.135+0000 7f9ec56e7640 1 --2- 172.21.15.79:0/4067062711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ec0108e60 0x7f9ec010f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:17.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.135+0000 7f9ec56e7640 1 --2- 172.21.15.79:0/4067062711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ec01084e0 0x7f9ec0108920 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:17.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.135+0000 7f9ec56e7640 1 --2- 172.21.15.79:0/4067062711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ec0102ad0 0x7f9ec0102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:17.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.135+0000 7f9ec56e7640 1 -- 172.21.15.79:0/4067062711 >> 172.21.15.79:0/4067062711 conn(0x7f9ec00fe540 msgr2=0x7f9ec0100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:17.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.135+0000 7f9ec56e7640 1 -- 172.21.15.79:0/4067062711 shutdown_connections 2024-08-20T01:36:17.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.135+0000 7f9ec56e7640 1 -- 172.21.15.79:0/4067062711 wait complete. 2024-08-20T01:36:17.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.135+0000 7f9ec56e7640 1 Processor -- start 2024-08-20T01:36:17.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.136+0000 7f9ec56e7640 1 -- start start 2024-08-20T01:36:17.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.136+0000 7f9ec56e7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ec0102ad0 0x7f9ec0198f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:17.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.136+0000 7f9ec56e7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ec01084e0 0x7f9ec0199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:17.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.136+0000 7f9ec56e7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ec0108e60 0x7f9ec019e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:17.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.136+0000 7f9ec56e7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec01129d0 con 0x7f9ec01084e0 2024-08-20T01:36:17.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.136+0000 7f9ec56e7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec0112850 con 0x7f9ec0108e60 2024-08-20T01:36:17.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.136+0000 7f9ec56e7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec0112b50 con 0x7f9ec0102ad0 2024-08-20T01:36:17.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.136+0000 7f9ebe7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ec01084e0 0x7f9ec0199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:17.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.136+0000 7f9ebe7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ec01084e0 0x7f9ec0199460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49146/0 (socket says 172.21.15.79:49146) 2024-08-20T01:36:17.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.136+0000 7f9ebe7fc640 1 -- 172.21.15.79:0/92073695 learned_addr learned my addr 172.21.15.79:0/92073695 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:17.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.136+0000 7f9ebf7fe640 1 --2- 172.21.15.79:0/92073695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ec0108e60 0x7f9ec019e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:17.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.136+0000 7f9ebeffd640 1 --2- 172.21.15.79:0/92073695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ec0102ad0 0x7f9ec0198f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:17.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.136+0000 7f9ebe7fc640 1 -- 172.21.15.79:0/92073695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ec0102ad0 msgr2=0x7f9ec0198f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:17.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.136+0000 7f9ebe7fc640 1 --2- 172.21.15.79:0/92073695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ec0102ad0 0x7f9ec0198f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:17.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.136+0000 7f9ebe7fc640 1 -- 172.21.15.79:0/92073695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ec0108e60 msgr2=0x7f9ec019e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:17.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.136+0000 7f9ebe7fc640 1 --2- 172.21.15.79:0/92073695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ec0108e60 0x7f9ec019e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:17.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.136+0000 7f9ebe7fc640 1 -- 172.21.15.79:0/92073695 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ec019efd0 con 0x7f9ec01084e0 2024-08-20T01:36:17.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.136+0000 7f9ebf7fe640 1 --2- 172.21.15.79:0/92073695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ec0108e60 0x7f9ec019e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:36:17.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.136+0000 7f9ebeffd640 1 --2- 172.21.15.79:0/92073695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ec0102ad0 0x7f9ec0198f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:36:17.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.136+0000 7f9ebe7fc640 1 --2- 172.21.15.79:0/92073695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ec01084e0 0x7f9ec0199460 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4009a20 tx=0x7f9eb4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:17.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.136+0000 7f9ea7fff640 1 -- 172.21.15.79:0/92073695 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb403f030 con 0x7f9ec01084e0 2024-08-20T01:36:17.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.136+0000 7f9ec56e7640 1 -- 172.21.15.79:0/92073695 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ec019f260 con 0x7f9ec01084e0 2024-08-20T01:36:17.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.136+0000 7f9ea7fff640 1 -- 172.21.15.79:0/92073695 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9eb40035f0 con 0x7f9ec01084e0 2024-08-20T01:36:17.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.136+0000 7f9ea7fff640 1 -- 172.21.15.79:0/92073695 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb4035070 con 0x7f9ec01084e0 2024-08-20T01:36:17.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.137+0000 7f9ec56e7640 1 -- 172.21.15.79:0/92073695 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ec01a5980 con 0x7f9ec01084e0 2024-08-20T01:36:17.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.139+0000 7f9ec7ae0740 1 Processor -- start 2024-08-20T01:36:17.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.139+0000 7f9ec7ae0740 1 -- start start 2024-08-20T01:36:17.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.140+0000 7f9ec7ae0740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55adc82f1bf0 0x55adc82f1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:17.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.140+0000 7f9ec7ae0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55adc82f2510 0x55adc8302370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:17.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.140+0000 7f9ec7ae0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55adc83028b0 0x55adc8304ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:17.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.140+0000 7f9ec7ae0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55adc82686a0 con 0x55adc82f2510 2024-08-20T01:36:17.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.140+0000 7f9ec7ae0740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55adc8257ba0 con 0x55adc82f1bf0 2024-08-20T01:36:17.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.140+0000 7f9ec7ae0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55adc825bbe0 con 0x55adc83028b0 2024-08-20T01:36:17.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.140+0000 7f9ebeffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55adc82f2510 0x55adc8302370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:17.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.140+0000 7f9ebeffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55adc82f2510 0x55adc8302370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49154/0 (socket says 172.21.15.79:49154) 2024-08-20T01:36:17.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.140+0000 7f9ebeffd640 1 -- 172.21.15.79:0/260485587 learned_addr learned my addr 172.21.15.79:0/260485587 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:17.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.140+0000 7f9ea7fff640 1 -- 172.21.15.79:0/92073695 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f9eb4003aa0 con 0x7f9ec01084e0 2024-08-20T01:36:17.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.140+0000 7f9ebf7fe640 1 --2- 172.21.15.79:0/260485587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55adc82f1bf0 0x55adc82f1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:17.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.140+0000 7f9ebeffd640 1 -- 172.21.15.79:0/260485587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55adc83028b0 msgr2=0x55adc8304ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:17.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.140+0000 7f9ebeffd640 1 --2- 172.21.15.79:0/260485587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55adc83028b0 0x55adc8304ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:17.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.140+0000 7f9ebeffd640 1 -- 172.21.15.79:0/260485587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55adc82f1bf0 msgr2=0x55adc82f1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:17.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.140+0000 7f9ebeffd640 1 --2- 172.21.15.79:0/260485587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55adc82f1bf0 0x55adc82f1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:17.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.140+0000 7f9ebeffd640 1 -- 172.21.15.79:0/260485587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adc7fb7540 con 0x55adc82f2510 2024-08-20T01:36:17.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.140+0000 7f9ebf7fe640 1 --2- 172.21.15.79:0/260485587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55adc82f1bf0 0x55adc82f1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:36:17.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.140+0000 7f9ebeffd640 1 --2- 172.21.15.79:0/260485587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55adc82f2510 0x55adc8302370 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9eb000bc20 tx=0x7f9eb000d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abcd15b11b649594 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:17.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.141+0000 7f9ea57fa640 1 -- 172.21.15.79:0/260485587 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb0017620 con 0x55adc82f2510 2024-08-20T01:36:17.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.141+0000 7f9ea57fa640 1 -- 172.21.15.79:0/260485587 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9eb0017c50 con 0x55adc82f2510 2024-08-20T01:36:17.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.141+0000 7f9ea57fa640 1 -- 172.21.15.79:0/260485587 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb000fb90 con 0x55adc82f2510 2024-08-20T01:36:17.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.141+0000 7f9ea7fff640 1 --2- 172.21.15.79:0/92073695 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9ea80b3ce0 0x7f9ea80b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:17.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.141+0000 7f9ebf7fe640 1 --2- 172.21.15.79:0/92073695 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9ea80b3ce0 0x7f9ea80b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:17.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.141+0000 7f9ea7fff640 1 -- 172.21.15.79:0/92073695 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9eb4104740 con 0x7f9ec01084e0 2024-08-20T01:36:17.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.141+0000 7f9ec7ae0740 1 -- 172.21.15.79:0/260485587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55adc82f2510 msgr2=0x55adc8302370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:17.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.141+0000 7f9ebf7fe640 1 --2- 172.21.15.79:0/92073695 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9ea80b3ce0 0x7f9ea80b61a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800e390 tx=0x7f9eb80075e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:17.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.141+0000 7f9ec7ae0740 1 --2- 172.21.15.79:0/260485587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55adc82f2510 0x55adc8302370 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9eb000bc20 tx=0x7f9eb000d710 comp rx=0 tx=0).stop 2024-08-20T01:36:17.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.141+0000 7f9ec7ae0740 1 -- 172.21.15.79:0/260485587 shutdown_connections 2024-08-20T01:36:17.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.141+0000 7f9ec7ae0740 1 --2- 172.21.15.79:0/260485587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55adc83028b0 0x55adc8304ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:17.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.141+0000 7f9ec7ae0740 1 --2- 172.21.15.79:0/260485587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55adc82f2510 0x55adc8302370 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:17.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.141+0000 7f9ec7ae0740 1 --2- 172.21.15.79:0/260485587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55adc82f1bf0 0x55adc82f1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:17.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.141+0000 7f9ec7ae0740 1 -- 172.21.15.79:0/260485587 >> 172.21.15.79:0/260485587 conn(0x55adc82efa20 msgr2=0x55adc82f0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:17.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.141+0000 7f9ec7ae0740 1 -- 172.21.15.79:0/260485587 shutdown_connections 2024-08-20T01:36:17.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.141+0000 7f9ec7ae0740 1 -- 172.21.15.79:0/260485587 wait complete. 2024-08-20T01:36:17.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.142+0000 7f9ec7ae0740 1 -- start start 2024-08-20T01:36:17.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.142+0000 7f9ec7ae0740 1 Processor -- start 2024-08-20T01:36:17.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.142+0000 7f9ec7ae0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55adc82f1bf0 0x55adc82ff7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:17.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.142+0000 7f9ec7ae0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55adc82f2510 0x55adc82ffd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:17.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.142+0000 7f9ec7ae0740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55adc83028b0 0x55adc8300260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:17.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.142+0000 7f9ec7ae0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55adc80ba5f0 con 0x55adc82f2510 2024-08-20T01:36:17.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.142+0000 7f9ec7ae0740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55adc81de6c0 con 0x55adc83028b0 2024-08-20T01:36:17.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.142+0000 7f9ec7ae0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55adc8305560 con 0x55adc82f1bf0 2024-08-20T01:36:17.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.142+0000 7f9ec7ae0740 10 client.0 _ll_register_callbacks cb 0x55adc821b1e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:17.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.142+0000 7f9ebe7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55adc82f2510 0x55adc82ffd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:17.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.142+0000 7f9ebe7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55adc82f2510 0x55adc82ffd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49170/0 (socket says 172.21.15.79:49170) 2024-08-20T01:36:17.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.142+0000 7f9ebe7fc640 1 -- 172.21.15.79:0/722078795 learned_addr learned my addr 172.21.15.79:0/722078795 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:17.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.142+0000 7f9ebeffd640 1 --2- 172.21.15.79:0/722078795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55adc82f1bf0 0x55adc82ff7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:17.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.142+0000 7f9ebf7fe640 1 --2- 172.21.15.79:0/722078795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55adc83028b0 0x55adc8300260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:17.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.143+0000 7f9ebe7fc640 1 -- 172.21.15.79:0/722078795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55adc82f1bf0 msgr2=0x55adc82ff7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:17.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.143+0000 7f9ebe7fc640 1 --2- 172.21.15.79:0/722078795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55adc82f1bf0 0x55adc82ff7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:17.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.143+0000 7f9ebe7fc640 1 -- 172.21.15.79:0/722078795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55adc83028b0 msgr2=0x55adc8300260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:17.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.143+0000 7f9ebe7fc640 1 --2- 172.21.15.79:0/722078795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55adc83028b0 0x55adc8300260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:17.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.143+0000 7f9ebe7fc640 1 -- 172.21.15.79:0/722078795 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55adc830e8f0 con 0x55adc82f2510 2024-08-20T01:36:17.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.143+0000 7f9ebe7fc640 1 --2- 172.21.15.79:0/722078795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55adc82f2510 0x55adc82ffd20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4005ec0 tx=0x7f9eb4102580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5dce5849b4fed89 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:17.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.143+0000 7f9ea2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:36:17.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.143+0000 7f9ea2ff5640 1 -- 172.21.15.79:0/722078795 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb4049070 con 0x55adc82f2510 2024-08-20T01:36:17.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.143+0000 7f9ea2ff5640 1 -- 172.21.15.79:0/722078795 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9eb40c77d0 con 0x55adc82f2510 2024-08-20T01:36:17.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.143+0000 7f9ec7ae0740 1 -- 172.21.15.79:0/722078795 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9eb0017c50 con 0x55adc82f2510 2024-08-20T01:36:17.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.143+0000 7f9ea2ff5640 1 -- 172.21.15.79:0/722078795 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9eb40ee0d0 con 0x55adc82f2510 2024-08-20T01:36:17.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.143+0000 7f9ec7ae0740 10 client.15147 fetch_fsmap learned FSMap version 27 2024-08-20T01:36:17.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.143+0000 7f9ec7ae0740 1 -- 172.21.15.79:0/722078795 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55adc8311280 con 0x55adc82f2510 2024-08-20T01:36:17.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.143+0000 7f9ea2ff5640 1 -- 172.21.15.79:0/722078795 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9eb0017c50 con 0x55adc82f2510 2024-08-20T01:36:17.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.143+0000 7f9ea2ff5640 1 -- 172.21.15.79:0/722078795 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f9eb40cb7a0 con 0x55adc82f2510 2024-08-20T01:36:17.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.143+0000 7f9ec7ae0740 10 client.15147 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:36:17.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.143+0000 7f9ec7ae0740 10 client.15147 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-20T01:36:17.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.143+0000 7f9ec7ae0740 20 client.15147 populate_metadata read hostname 'smithi079' 2024-08-20T01:36:17.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.143+0000 7f9ec7ae0740 1 --2- 172.21.15.79:0/722078795 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55adc8313870 0x55adc8314ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:17.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.143+0000 7f9ec7ae0740 4 client.15147 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:36:17.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.143+0000 7f9ec7ae0740 1 -- 172.21.15.79:0/722078795 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55adc826a5f0 con 0x55adc8313870 2024-08-20T01:36:17.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.144+0000 7f9ebeffd640 1 --2- 172.21.15.79:0/722078795 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55adc8313870 0x55adc8314ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:17.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.144+0000 7f9ebeffd640 1 --2- 172.21.15.79:0/722078795 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55adc8313870 0x55adc8314ce0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=69b2c9758ac71121 server_cookie=11b55bf3ec7ac459 in_seq=0 out_seq=0 2024-08-20T01:36:17.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.144+0000 7f9ea2ff5640 10 client.15147 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:36:17.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.145+0000 7f9ea2ff5640 1 -- 172.21.15.79:0/722078795 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55adc826a5f0 con 0x55adc8313870 2024-08-20T01:36:17.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.145+0000 7f9ea2ff5640 10 client.15147 handle_command_reply: tid=0 2024-08-20T01:36:17.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.145+0000 7f9ec7ae0740 1 client.15147 shutdown 2024-08-20T01:36:17.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.145+0000 7f9ec7ae0740 1 -- 172.21.15.79:0/722078795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55adc82f2510 msgr2=0x55adc82ffd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:17.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.145+0000 7f9ec7ae0740 1 --2- 172.21.15.79:0/722078795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55adc82f2510 0x55adc82ffd20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4005ec0 tx=0x7f9eb4102580 comp rx=0 tx=0).stop 2024-08-20T01:36:17.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.145+0000 7f9ec7ae0740 1 -- 172.21.15.79:0/722078795 shutdown_connections 2024-08-20T01:36:17.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.145+0000 7f9ec7ae0740 1 --2- 172.21.15.79:0/722078795 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55adc8313870 0x55adc8314ce0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:17.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.145+0000 7f9ea2ff5640 0 client.15147 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:36:17.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.145+0000 7f9ec7ae0740 1 --2- 172.21.15.79:0/722078795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55adc83028b0 0x55adc8300260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:17.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.145+0000 7f9ec7ae0740 1 --2- 172.21.15.79:0/722078795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55adc82f2510 0x55adc82ffd20 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:17.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.145+0000 7f9ec7ae0740 1 --2- 172.21.15.79:0/722078795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55adc82f1bf0 0x55adc82ff7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:17.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.145+0000 7f9ec7ae0740 1 -- 172.21.15.79:0/722078795 >> 172.21.15.79:0/722078795 conn(0x55adc82efa20 msgr2=0x55adc82f5550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:17.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.145+0000 7f9ec7ae0740 1 -- 172.21.15.79:0/722078795 shutdown_connections 2024-08-20T01:36:17.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.145+0000 7f9ec7ae0740 1 -- 172.21.15.79:0/722078795 wait complete. 2024-08-20T01:36:17.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.145+0000 7f9ec7ae0740 20 client.15147 trim_cache size 0 max 16384 2024-08-20T01:36:17.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.163+0000 7f9ec7ae0740 1 Processor -- start 2024-08-20T01:36:17.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.163+0000 7f9ec7ae0740 1 -- start start 2024-08-20T01:36:17.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.163+0000 7f9ec7ae0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55adc82f1bf0 0x55adc82fd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:17.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.163+0000 7f9ec7ae0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55adc82f2510 0x55adc8303940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:17.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.163+0000 7f9ec7ae0740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55adc83028b0 0x55adc8303e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:17.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.163+0000 7f9ec7ae0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55adc8313020 con 0x55adc82f1bf0 2024-08-20T01:36:17.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.163+0000 7f9ec7ae0740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55adc83136f0 con 0x55adc83028b0 2024-08-20T01:36:17.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.163+0000 7f9ec7ae0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55adc8313dc0 con 0x55adc82f2510 2024-08-20T01:36:17.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.163+0000 7f9ebeffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55adc82f1bf0 0x55adc82fd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:17.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.163+0000 7f9ebeffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55adc82f1bf0 0x55adc82fd340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49182/0 (socket says 172.21.15.79:49182) 2024-08-20T01:36:17.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.163+0000 7f9ebeffd640 1 -- 172.21.15.79:0/4273756884 learned_addr learned my addr 172.21.15.79:0/4273756884 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:17.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.163+0000 7f9ebe7fc640 1 --2- 172.21.15.79:0/4273756884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55adc82f2510 0x55adc8303940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:17.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.163+0000 7f9ebeffd640 1 -- 172.21.15.79:0/4273756884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55adc82f2510 msgr2=0x55adc8303940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:17.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.163+0000 7f9ebeffd640 1 --2- 172.21.15.79:0/4273756884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55adc82f2510 0x55adc8303940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:17.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.163+0000 7f9ebeffd640 1 -- 172.21.15.79:0/4273756884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55adc83028b0 msgr2=0x55adc8303e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:17.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.163+0000 7f9ebeffd640 1 --2- 172.21.15.79:0/4273756884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55adc83028b0 0x55adc8303e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:17.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.163+0000 7f9ebeffd640 1 -- 172.21.15.79:0/4273756884 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adc82ef850 con 0x55adc82f1bf0 2024-08-20T01:36:17.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.164+0000 7f9ebeffd640 1 --2- 172.21.15.79:0/4273756884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55adc82f1bf0 0x55adc82fd340 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9eb000bb40 tx=0x7f9eb000bfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8925e8440afea51 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:17.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.164+0000 7f9ea4ff9640 1 -- 172.21.15.79:0/4273756884 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb000b790 con 0x55adc82f1bf0 2024-08-20T01:36:17.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.164+0000 7f9ea4ff9640 1 -- 172.21.15.79:0/4273756884 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9eb002e070 con 0x55adc82f1bf0 2024-08-20T01:36:17.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.164+0000 7f9ea4ff9640 1 -- 172.21.15.79:0/4273756884 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb0004bc0 con 0x55adc82f1bf0 2024-08-20T01:36:17.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.164+0000 7f9ec7ae0740 1 -- 172.21.15.79:0/4273756884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55adc82f1bf0 msgr2=0x55adc82fd340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:17.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.164+0000 7f9ec7ae0740 1 --2- 172.21.15.79:0/4273756884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55adc82f1bf0 0x55adc82fd340 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9eb000bb40 tx=0x7f9eb000bfc0 comp rx=0 tx=0).stop 2024-08-20T01:36:17.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.164+0000 7f9ec7ae0740 1 -- 172.21.15.79:0/4273756884 shutdown_connections 2024-08-20T01:36:17.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.164+0000 7f9ec7ae0740 1 --2- 172.21.15.79:0/4273756884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55adc83028b0 0x55adc8303e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:17.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.164+0000 7f9ec7ae0740 1 --2- 172.21.15.79:0/4273756884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55adc82f2510 0x55adc8303940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:17.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.164+0000 7f9ec7ae0740 1 --2- 172.21.15.79:0/4273756884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55adc82f1bf0 0x55adc82fd340 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:17.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.164+0000 7f9ec7ae0740 1 -- 172.21.15.79:0/4273756884 >> 172.21.15.79:0/4273756884 conn(0x55adc82efa20 msgr2=0x55adc83125d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:17.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.164+0000 7f9ec7ae0740 1 -- 172.21.15.79:0/4273756884 shutdown_connections 2024-08-20T01:36:17.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.164+0000 7f9ec7ae0740 1 -- 172.21.15.79:0/4273756884 wait complete. 2024-08-20T01:36:17.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.165+0000 7f9ec7ae0740 1 -- start start 2024-08-20T01:36:17.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.165+0000 7f9ec7ae0740 1 Processor -- start 2024-08-20T01:36:17.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.165+0000 7f9ec7ae0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55adc82f1bf0 0x55adc82fecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:17.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.165+0000 7f9ec7ae0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55adc82f2510 0x55adc82ff210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:17.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.165+0000 7f9ec7ae0740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55adc83028b0 0x55adc82ff750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:17.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.165+0000 7f9ec7ae0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55adc8314b60 con 0x55adc82f1bf0 2024-08-20T01:36:17.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.165+0000 7f9ec7ae0740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55adc8314490 con 0x55adc83028b0 2024-08-20T01:36:17.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.165+0000 7f9ec7ae0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55adc8315230 con 0x55adc82f2510 2024-08-20T01:36:17.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.165+0000 7f9ec7ae0740 10 client.0 _ll_register_callbacks cb 0x7f9eb4009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:17.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.165+0000 7f9ebeffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55adc82f1bf0 0x55adc82fecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:17.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.165+0000 7f9ebeffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55adc82f1bf0 0x55adc82fecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49188/0 (socket says 172.21.15.79:49188) 2024-08-20T01:36:17.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.165+0000 7f9ebeffd640 1 -- 172.21.15.79:0/2637917576 learned_addr learned my addr 172.21.15.79:0/2637917576 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:17.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.165+0000 7f9ebeffd640 1 -- 172.21.15.79:0/2637917576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55adc82f2510 msgr2=0x55adc82ff210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:17.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.165+0000 7f9ebeffd640 1 --2- 172.21.15.79:0/2637917576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55adc82f2510 0x55adc82ff210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:17.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.165+0000 7f9ebeffd640 1 -- 172.21.15.79:0/2637917576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55adc83028b0 msgr2=0x55adc82ff750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:17.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.165+0000 7f9ebeffd640 1 --2- 172.21.15.79:0/2637917576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55adc83028b0 0x55adc82ff750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:17.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.165+0000 7f9ebeffd640 1 -- 172.21.15.79:0/2637917576 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55adc830efc0 con 0x55adc82f1bf0 2024-08-20T01:36:17.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.166+0000 7f9ebeffd640 1 --2- 172.21.15.79:0/2637917576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55adc82f1bf0 0x55adc82fecd0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0019040 tx=0x7f9eb0005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6476fea4eeb5b9fe server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:17.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.166+0000 7f9ea2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:36:17.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.166+0000 7f9ea2ff5640 1 -- 172.21.15.79:0/2637917576 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb0038070 con 0x55adc82f1bf0 2024-08-20T01:36:17.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.166+0000 7f9ea2ff5640 1 -- 172.21.15.79:0/2637917576 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9eb0017620 con 0x55adc82f1bf0 2024-08-20T01:36:17.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.166+0000 7f9ec7ae0740 1 -- 172.21.15.79:0/2637917576 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9eb002e070 con 0x55adc82f1bf0 2024-08-20T01:36:17.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.166+0000 7f9ea2ff5640 1 -- 172.21.15.79:0/2637917576 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9eb000b810 con 0x55adc82f1bf0 2024-08-20T01:36:17.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.166+0000 7f9ec7ae0740 10 client.15153 fetch_fsmap learned FSMap version 27 2024-08-20T01:36:17.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.166+0000 7f9ec7ae0740 1 -- 172.21.15.79:0/2637917576 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55adc837d280 con 0x55adc82f1bf0 2024-08-20T01:36:17.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.166+0000 7f9ea2ff5640 1 -- 172.21.15.79:0/2637917576 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9eb002e070 con 0x55adc82f1bf0 2024-08-20T01:36:17.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.166+0000 7f9ea2ff5640 1 -- 172.21.15.79:0/2637917576 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f9eb00289c0 con 0x55adc82f1bf0 2024-08-20T01:36:17.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.166+0000 7f9ec7ae0740 10 client.15153 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:36:17.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.166+0000 7f9ec7ae0740 10 client.15153 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-20T01:36:17.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.166+0000 7f9ec7ae0740 20 client.15153 populate_metadata read hostname 'smithi079' 2024-08-20T01:36:17.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.166+0000 7f9ec7ae0740 1 --2- 172.21.15.79:0/2637917576 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55adc83819a0 0x55adc83806b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:17.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.166+0000 7f9ec7ae0740 4 client.15153 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-20T01:36:17.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.166+0000 7f9ec7ae0740 1 -- 172.21.15.79:0/2637917576 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "status"}) -- 0x55adc8266090 con 0x55adc83819a0 2024-08-20T01:36:17.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.167+0000 7f9ebe7fc640 1 --2- 172.21.15.79:0/2637917576 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55adc83819a0 0x55adc83806b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:17.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.167+0000 7f9ebe7fc640 1 --2- 172.21.15.79:0/2637917576 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55adc83819a0 0x55adc83806b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=20746a4074061b16 server_cookie=d5ac26645b6bf237 in_seq=0 out_seq=0 2024-08-20T01:36:17.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.167+0000 7f9ea2ff5640 10 client.15153 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:36:17.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.167+0000 7f9ea2ff5640 1 -- 172.21.15.79:0/2637917576 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55adc8266090 con 0x55adc83819a0 2024-08-20T01:36:17.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.167+0000 7f9ea2ff5640 10 client.15153 handle_command_reply: tid=0 2024-08-20T01:36:17.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.167+0000 7f9ec7ae0740 1 client.15153 shutdown 2024-08-20T01:36:17.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.167+0000 7f9ec7ae0740 1 -- 172.21.15.79:0/2637917576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55adc82f1bf0 msgr2=0x55adc82fecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:17.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.167+0000 7f9ec7ae0740 1 --2- 172.21.15.79:0/2637917576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55adc82f1bf0 0x55adc82fecd0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0019040 tx=0x7f9eb0005d20 comp rx=0 tx=0).stop 2024-08-20T01:36:17.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.167+0000 7f9ec7ae0740 1 -- 172.21.15.79:0/2637917576 shutdown_connections 2024-08-20T01:36:17.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.167+0000 7f9ec7ae0740 1 --2- 172.21.15.79:0/2637917576 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55adc83819a0 0x55adc83806b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:17.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.167+0000 7f9ec7ae0740 1 --2- 172.21.15.79:0/2637917576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55adc83028b0 0x55adc82ff750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:17.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.167+0000 7f9ec7ae0740 1 --2- 172.21.15.79:0/2637917576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55adc82f2510 0x55adc82ff210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:17.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.167+0000 7f9ec7ae0740 1 --2- 172.21.15.79:0/2637917576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55adc82f1bf0 0x55adc82fecd0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:17.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.167+0000 7f9ec7ae0740 1 -- 172.21.15.79:0/2637917576 >> 172.21.15.79:0/2637917576 conn(0x55adc82efa20 msgr2=0x55adc83125d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:17.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.167+0000 7f9ea2ff5640 0 client.15153 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:36:17.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.168+0000 7f9ec7ae0740 1 -- 172.21.15.79:0/2637917576 shutdown_connections 2024-08-20T01:36:17.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.168+0000 7f9ec7ae0740 1 -- 172.21.15.79:0/2637917576 wait complete. 2024-08-20T01:36:17.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.168+0000 7f9ec7ae0740 20 client.15153 trim_cache size 0 max 16384 2024-08-20T01:36:17.176 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:36:17.177 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "28484e9a-5e93-11ef-bccf-c7b262605968", 2024-08-20T01:36:17.177 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 1, 2024-08-20T01:36:17.177 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 24538, 2024-08-20T01:36:17.177 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-08-20T01:36:17.177 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-08-20T01:36:17.177 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-08-20T01:36:17.177 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 74.767682722000004, 2024-08-20T01:36:17.177 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 27, 2024-08-20T01:36:17.177 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 74, 2024-08-20T01:36:17.177 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 72, 2024-08-20T01:36:17.177 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 101.28743752299999 2024-08-20T01:36:17.177 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:36:17.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.168+0000 7f9ec56e7640 1 -- 172.21.15.79:0/92073695 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9ea80b3ce0 msgr2=0x7f9ea80b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:17.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.168+0000 7f9ec56e7640 1 --2- 172.21.15.79:0/92073695 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9ea80b3ce0 0x7f9ea80b61a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800e390 tx=0x7f9eb80075e0 comp rx=0 tx=0).stop 2024-08-20T01:36:17.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.168+0000 7f9ec56e7640 1 -- 172.21.15.79:0/92073695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ec01084e0 msgr2=0x7f9ec0199460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:17.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.168+0000 7f9ec56e7640 1 --2- 172.21.15.79:0/92073695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ec01084e0 0x7f9ec0199460 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4009a20 tx=0x7f9eb4004270 comp rx=0 tx=0).stop 2024-08-20T01:36:17.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.168+0000 7f9ec56e7640 1 -- 172.21.15.79:0/92073695 shutdown_connections 2024-08-20T01:36:17.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.168+0000 7f9ec56e7640 1 --2- 172.21.15.79:0/92073695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ec0108e60 0x7f9ec019e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:17.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.168+0000 7f9ec56e7640 1 --2- 172.21.15.79:0/92073695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ec01084e0 0x7f9ec0199460 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:17.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.168+0000 7f9ec56e7640 1 --2- 172.21.15.79:0/92073695 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9ea80b3ce0 0x7f9ea80b61a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:17.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.168+0000 7f9ec56e7640 1 --2- 172.21.15.79:0/92073695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ec0102ad0 0x7f9ec0198f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:17.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.168+0000 7f9ec56e7640 1 -- 172.21.15.79:0/92073695 >> 172.21.15.79:0/92073695 conn(0x7f9ec00fe540 msgr2=0x7f9ec0100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:17.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.168+0000 7f9ec56e7640 1 -- 172.21.15.79:0/92073695 shutdown_connections 2024-08-20T01:36:17.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:17.168+0000 7f9ec56e7640 1 -- 172.21.15.79:0/92073695 wait complete. 2024-08-20T01:36:17.940 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.b status 2024-08-20T01:36:18.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:18 smithi079 ceph-mon[18656]: pgmap v316: 97 pgs: 97 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-20T01:36:18.191 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:36:18.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:18 smithi081 ceph-mon[22209]: pgmap v316: 97 pgs: 97 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-20T01:36:18.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:18 smithi175 ceph-mon[22392]: pgmap v316: 97 pgs: 97 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-20T01:36:18.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.685+0000 7fedba6a0640 1 -- 172.21.15.79:0/787560569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedb410cf60 msgr2=0x7fedb410f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:18.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.685+0000 7fedba6a0640 1 --2- 172.21.15.79:0/787560569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedb410cf60 0x7fedb410f350 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fedac009ca0 tx=0x7fedac02a8c0 comp rx=0 tx=0).stop 2024-08-20T01:36:18.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.685+0000 7fedba6a0640 1 -- 172.21.15.79:0/787560569 shutdown_connections 2024-08-20T01:36:18.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.685+0000 7fedba6a0640 1 --2- 172.21.15.79:0/787560569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedb410cf60 0x7fedb410f350 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:18.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.685+0000 7fedba6a0640 1 --2- 172.21.15.79:0/787560569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedb410a630 0x7fedb410ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:18.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.685+0000 7fedba6a0640 1 --2- 172.21.15.79:0/787560569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fedb4101520 0x7fedb4101900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:18.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.685+0000 7fedba6a0640 1 -- 172.21.15.79:0/787560569 >> 172.21.15.79:0/787560569 conn(0x7fedb4076c80 msgr2=0x7fedb4077090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:18.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.685+0000 7fedba6a0640 1 -- 172.21.15.79:0/787560569 shutdown_connections 2024-08-20T01:36:18.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.685+0000 7fedba6a0640 1 -- 172.21.15.79:0/787560569 wait complete. 2024-08-20T01:36:18.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.686+0000 7fedba6a0640 1 Processor -- start 2024-08-20T01:36:18.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.686+0000 7fedba6a0640 1 -- start start 2024-08-20T01:36:18.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.686+0000 7fedba6a0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fedb4101520 0x7fedb41024f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:18.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.686+0000 7fedba6a0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedb410a630 0x7fedb4102a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:18.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.686+0000 7fedba6a0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedb410cf60 0x7fedb4102f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:18.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.686+0000 7fedba6a0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fedb41129e0 con 0x7fedb410a630 2024-08-20T01:36:18.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.686+0000 7fedba6a0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fedb4112860 con 0x7fedb410cf60 2024-08-20T01:36:18.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.686+0000 7fedba6a0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fedb4112b60 con 0x7fedb4101520 2024-08-20T01:36:18.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.686+0000 7fedb37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedb410a630 0x7fedb4102a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:18.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.686+0000 7fedb37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedb410a630 0x7fedb4102a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49212/0 (socket says 172.21.15.79:49212) 2024-08-20T01:36:18.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.686+0000 7fedb37fe640 1 -- 172.21.15.79:0/1523257596 learned_addr learned my addr 172.21.15.79:0/1523257596 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:18.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.686+0000 7fedb3fff640 1 --2- 172.21.15.79:0/1523257596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fedb4101520 0x7fedb41024f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:18.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.687+0000 7fedb8c3d640 1 --2- 172.21.15.79:0/1523257596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedb410cf60 0x7fedb4102f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:18.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.687+0000 7fedb37fe640 1 -- 172.21.15.79:0/1523257596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fedb4101520 msgr2=0x7fedb41024f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:18.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.687+0000 7fedb37fe640 1 --2- 172.21.15.79:0/1523257596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fedb4101520 0x7fedb41024f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:18.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.687+0000 7fedb37fe640 1 -- 172.21.15.79:0/1523257596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedb410cf60 msgr2=0x7fedb4102f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:18.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.687+0000 7fedb37fe640 1 --2- 172.21.15.79:0/1523257596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedb410cf60 0x7fedb4102f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:18.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.687+0000 7fedb37fe640 1 -- 172.21.15.79:0/1523257596 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedb41a7350 con 0x7fedb410a630 2024-08-20T01:36:18.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.687+0000 7fedb8c3d640 1 --2- 172.21.15.79:0/1523257596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedb410cf60 0x7fedb4102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:36:18.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.687+0000 7fedb37fe640 1 --2- 172.21.15.79:0/1523257596 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedb410a630 0x7fedb4102a30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7feda800b4a0 tx=0x7feda800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:18.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.687+0000 7fedb17fa640 1 -- 172.21.15.79:0/1523257596 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda8014070 con 0x7fedb410a630 2024-08-20T01:36:18.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.687+0000 7fedb17fa640 1 -- 172.21.15.79:0/1523257596 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feda8010aa0 con 0x7fedb410a630 2024-08-20T01:36:18.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.687+0000 7fedba6a0640 1 -- 172.21.15.79:0/1523257596 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedb41a7640 con 0x7fedb410a630 2024-08-20T01:36:18.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.687+0000 7fedb17fa640 1 -- 172.21.15.79:0/1523257596 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda8017b70 con 0x7fedb410a630 2024-08-20T01:36:18.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.687+0000 7fedba6a0640 1 -- 172.21.15.79:0/1523257596 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedb41a7b80 con 0x7fedb410a630 2024-08-20T01:36:18.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.689+0000 7fedb17fa640 1 -- 172.21.15.79:0/1523257596 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7feda8017070 con 0x7fedb410a630 2024-08-20T01:36:18.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.689+0000 7fedbca99740 1 Processor -- start 2024-08-20T01:36:18.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.690+0000 7fedbca99740 1 -- start start 2024-08-20T01:36:18.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.690+0000 7fedbca99740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56165be52bf0 0x56165be52fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:18.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.690+0000 7fedbca99740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56165be53510 0x56165be5ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:18.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.690+0000 7fedbca99740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56165be5f4a0 0x56165be61890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:18.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.690+0000 7fedbca99740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56165bdc96a0 con 0x56165be53510 2024-08-20T01:36:18.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.690+0000 7fedbca99740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56165bdb8ba0 con 0x56165be5f4a0 2024-08-20T01:36:18.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.690+0000 7fedbca99740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56165bdbcbe0 con 0x56165be52bf0 2024-08-20T01:36:18.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.690+0000 7fedb3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56165be53510 0x56165be5ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:18.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.690+0000 7fedb3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56165be53510 0x56165be5ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49218/0 (socket says 172.21.15.79:49218) 2024-08-20T01:36:18.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.690+0000 7fedb3fff640 1 -- 172.21.15.79:0/2499209455 learned_addr learned my addr 172.21.15.79:0/2499209455 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:18.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.690+0000 7fedb8c3d640 1 --2- 172.21.15.79:0/2499209455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56165be52bf0 0x56165be52fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:18.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.690+0000 7fedb3fff640 1 -- 172.21.15.79:0/2499209455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56165be52bf0 msgr2=0x56165be52fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:18.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.690+0000 7fedb3fff640 1 --2- 172.21.15.79:0/2499209455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56165be52bf0 0x56165be52fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:18.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.690+0000 7fedb37fe640 1 --2- 172.21.15.79:0/2499209455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56165be5f4a0 0x56165be61890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:18.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.690+0000 7fedb3fff640 1 -- 172.21.15.79:0/2499209455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56165be5f4a0 msgr2=0x56165be61890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:18.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.690+0000 7fedb17fa640 1 --2- 172.21.15.79:0/1523257596 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fed9c0b3c60 0x7fed9c0b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:18.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.690+0000 7fedb3fff640 1 --2- 172.21.15.79:0/2499209455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56165be5f4a0 0x56165be61890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:18.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.690+0000 7fedb3fff640 1 -- 172.21.15.79:0/2499209455 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56165bb18540 con 0x56165be53510 2024-08-20T01:36:18.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.690+0000 7fedb8c3d640 1 --2- 172.21.15.79:0/1523257596 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fed9c0b3c60 0x7fed9c0b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:18.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.690+0000 7fedb3fff640 1 --2- 172.21.15.79:0/2499209455 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56165be53510 0x56165be5ef60 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7feda400b790 tx=0x7feda400bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2968487a55770a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:18.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.690+0000 7fedb17fa640 1 -- 172.21.15.79:0/1523257596 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7feda80e3350 con 0x7fedb410a630 2024-08-20T01:36:18.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.691+0000 7fed9a7fc640 1 -- 172.21.15.79:0/2499209455 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda4003dd0 con 0x56165be53510 2024-08-20T01:36:18.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.691+0000 7fed9a7fc640 1 -- 172.21.15.79:0/2499209455 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feda4015070 con 0x56165be53510 2024-08-20T01:36:18.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.691+0000 7fed9a7fc640 1 -- 172.21.15.79:0/2499209455 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda4004cc0 con 0x56165be53510 2024-08-20T01:36:18.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.691+0000 7fedbca99740 1 -- 172.21.15.79:0/2499209455 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56165be53510 msgr2=0x56165be5ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:18.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.691+0000 7fedb8c3d640 1 --2- 172.21.15.79:0/1523257596 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fed9c0b3c60 0x7fed9c0b6120 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fedac004af0 tx=0x7fedac005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:18.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.691+0000 7fedbca99740 1 --2- 172.21.15.79:0/2499209455 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56165be53510 0x56165be5ef60 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7feda400b790 tx=0x7feda400bc50 comp rx=0 tx=0).stop 2024-08-20T01:36:18.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.692+0000 7fedbca99740 1 -- 172.21.15.79:0/2499209455 shutdown_connections 2024-08-20T01:36:18.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.692+0000 7fedbca99740 1 --2- 172.21.15.79:0/2499209455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56165be5f4a0 0x56165be61890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:18.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.692+0000 7fedbca99740 1 --2- 172.21.15.79:0/2499209455 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56165be53510 0x56165be5ef60 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:18.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.692+0000 7fedbca99740 1 --2- 172.21.15.79:0/2499209455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56165be52bf0 0x56165be52fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:18.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.692+0000 7fedbca99740 1 -- 172.21.15.79:0/2499209455 >> 172.21.15.79:0/2499209455 conn(0x56165be50a20 msgr2=0x56165be51bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:18.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.692+0000 7fedbca99740 1 -- 172.21.15.79:0/2499209455 shutdown_connections 2024-08-20T01:36:18.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.692+0000 7fedbca99740 1 -- 172.21.15.79:0/2499209455 wait complete. 2024-08-20T01:36:18.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.692+0000 7fedbca99740 1 -- start start 2024-08-20T01:36:18.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.692+0000 7fedbca99740 1 Processor -- start 2024-08-20T01:36:18.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.693+0000 7fedbca99740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56165be52bf0 0x56165be5c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:18.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.693+0000 7fedbca99740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56165be53510 0x56165be5c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:18.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.693+0000 7fedbca99740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56165be5f4a0 0x56165be5ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:18.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.693+0000 7fedbca99740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56165bc1b5f0 con 0x56165be5f4a0 2024-08-20T01:36:18.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.693+0000 7fedbca99740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56165bd3f6c0 con 0x56165be53510 2024-08-20T01:36:18.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.693+0000 7fedbca99740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56165be62150 con 0x56165be52bf0 2024-08-20T01:36:18.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.693+0000 7fedbca99740 10 client.0 _ll_register_callbacks cb 0x56165bd7c1e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:18.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.693+0000 7fedb8c3d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56165be5f4a0 0x56165be5ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:18.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.693+0000 7fedb8c3d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56165be5f4a0 0x56165be5ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49220/0 (socket says 172.21.15.79:49220) 2024-08-20T01:36:18.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.693+0000 7fedb8c3d640 1 -- 172.21.15.79:0/357534238 learned_addr learned my addr 172.21.15.79:0/357534238 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:18.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.693+0000 7fedb37fe640 1 --2- 172.21.15.79:0/357534238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56165be53510 0x56165be5c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:18.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.693+0000 7fedb3fff640 1 --2- 172.21.15.79:0/357534238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56165be52bf0 0x56165be5c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:18.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.693+0000 7fedb8c3d640 1 -- 172.21.15.79:0/357534238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56165be52bf0 msgr2=0x56165be5c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:18.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.693+0000 7fedb8c3d640 1 --2- 172.21.15.79:0/357534238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56165be52bf0 0x56165be5c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:18.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.693+0000 7fedb8c3d640 1 -- 172.21.15.79:0/357534238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56165be53510 msgr2=0x56165be5c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:18.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.693+0000 7fedb8c3d640 1 --2- 172.21.15.79:0/357534238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56165be53510 0x56165be5c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:18.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.693+0000 7fedb8c3d640 1 -- 172.21.15.79:0/357534238 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56165be6b500 con 0x56165be5f4a0 2024-08-20T01:36:18.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.693+0000 7fedb8c3d640 1 --2- 172.21.15.79:0/357534238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56165be5f4a0 0x56165be5ceb0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fedac032c10 tx=0x7fedac0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cce73db98f887cd server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:18.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.693+0000 7fed937fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:36:18.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.693+0000 7fed937fe640 1 -- 172.21.15.79:0/357534238 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedac0305c0 con 0x56165be5f4a0 2024-08-20T01:36:18.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.693+0000 7fed937fe640 1 -- 172.21.15.79:0/357534238 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fedac030760 con 0x56165be5f4a0 2024-08-20T01:36:18.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.693+0000 7fedbca99740 1 -- 172.21.15.79:0/357534238 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feda4015070 con 0x56165be5f4a0 2024-08-20T01:36:18.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.693+0000 7fed937fe640 1 -- 172.21.15.79:0/357534238 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fedac030960 con 0x56165be5f4a0 2024-08-20T01:36:18.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.693+0000 7fedbca99740 10 client.15165 fetch_fsmap learned FSMap version 27 2024-08-20T01:36:18.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.694+0000 7fedbca99740 1 -- 172.21.15.79:0/357534238 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56165be6deb0 con 0x56165be5f4a0 2024-08-20T01:36:18.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.694+0000 7fed937fe640 1 -- 172.21.15.79:0/357534238 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feda4015070 con 0x56165be5f4a0 2024-08-20T01:36:18.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.694+0000 7fed937fe640 1 -- 172.21.15.79:0/357534238 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fedac043040 con 0x56165be5f4a0 2024-08-20T01:36:18.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.694+0000 7fedbca99740 10 client.15165 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:36:18.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.694+0000 7fedbca99740 10 client.15165 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-20T01:36:18.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.694+0000 7fedbca99740 20 client.15165 populate_metadata read hostname 'smithi079' 2024-08-20T01:36:18.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.694+0000 7fedbca99740 1 --2- 172.21.15.79:0/357534238 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56165be70590 0x56165be71a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:18.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.694+0000 7fedbca99740 4 client.15165 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:36:18.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.694+0000 7fedbca99740 1 -- 172.21.15.79:0/357534238 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56165bdcb5f0 con 0x56165be70590 2024-08-20T01:36:18.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.694+0000 7fedb3fff640 1 --2- 172.21.15.79:0/357534238 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56165be70590 0x56165be71a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:18.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.695+0000 7fedb3fff640 1 --2- 172.21.15.79:0/357534238 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56165be70590 0x56165be71a00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f581f4da780658a server_cookie=99e030b733be64ed in_seq=0 out_seq=0 2024-08-20T01:36:18.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.695+0000 7fed937fe640 10 client.15165 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:36:18.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.695+0000 7fed937fe640 1 -- 172.21.15.79:0/357534238 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56165bdcb5f0 con 0x56165be70590 2024-08-20T01:36:18.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.695+0000 7fed937fe640 10 client.15165 handle_command_reply: tid=0 2024-08-20T01:36:18.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.695+0000 7fedbca99740 1 client.15165 shutdown 2024-08-20T01:36:18.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.696+0000 7fedbca99740 1 -- 172.21.15.79:0/357534238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56165be5f4a0 msgr2=0x56165be5ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:18.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.696+0000 7fedbca99740 1 --2- 172.21.15.79:0/357534238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56165be5f4a0 0x56165be5ceb0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fedac032c10 tx=0x7fedac0095c0 comp rx=0 tx=0).stop 2024-08-20T01:36:18.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.696+0000 7fedbca99740 1 -- 172.21.15.79:0/357534238 shutdown_connections 2024-08-20T01:36:18.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.696+0000 7fedbca99740 1 --2- 172.21.15.79:0/357534238 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56165be70590 0x56165be71a00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:18.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.696+0000 7fedbca99740 1 --2- 172.21.15.79:0/357534238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56165be5f4a0 0x56165be5ceb0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:18.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.696+0000 7fedbca99740 1 --2- 172.21.15.79:0/357534238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56165be53510 0x56165be5c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:18.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.696+0000 7fedbca99740 1 --2- 172.21.15.79:0/357534238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56165be52bf0 0x56165be5c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:18.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.696+0000 7fedbca99740 1 -- 172.21.15.79:0/357534238 >> 172.21.15.79:0/357534238 conn(0x56165be50a20 msgr2=0x56165be565c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:18.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.696+0000 7fed937fe640 0 client.15165 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:36:18.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.696+0000 7fedbca99740 1 -- 172.21.15.79:0/357534238 shutdown_connections 2024-08-20T01:36:18.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.696+0000 7fedbca99740 1 -- 172.21.15.79:0/357534238 wait complete. 2024-08-20T01:36:18.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.696+0000 7fedbca99740 20 client.15165 trim_cache size 0 max 16384 2024-08-20T01:36:18.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.713+0000 7fedbca99740 1 Processor -- start 2024-08-20T01:36:18.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.713+0000 7fedbca99740 1 -- start start 2024-08-20T01:36:18.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.713+0000 7fedbca99740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56165be52bf0 0x56165be70c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:18.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.713+0000 7fedbca99740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56165be53510 0x56165be56db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:18.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.713+0000 7fedbca99740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56165be5f4a0 0x56165be6f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:18.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.713+0000 7fedbca99740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56165be6fd40 con 0x56165be52bf0 2024-08-20T01:36:18.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.713+0000 7fedbca99740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56165be70410 con 0x56165be5f4a0 2024-08-20T01:36:18.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.713+0000 7fedbca99740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56165be70ae0 con 0x56165be53510 2024-08-20T01:36:18.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.713+0000 7fedb3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56165be52bf0 0x56165be70c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:18.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.713+0000 7fedb3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56165be52bf0 0x56165be70c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49224/0 (socket says 172.21.15.79:49224) 2024-08-20T01:36:18.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.713+0000 7fedb3fff640 1 -- 172.21.15.79:0/690886480 learned_addr learned my addr 172.21.15.79:0/690886480 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:18.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.714+0000 7fedb3fff640 1 -- 172.21.15.79:0/690886480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56165be53510 msgr2=0x56165be56db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:18.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.714+0000 7fedb3fff640 1 --2- 172.21.15.79:0/690886480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56165be53510 0x56165be56db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:18.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.714+0000 7fedb3fff640 1 -- 172.21.15.79:0/690886480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56165be5f4a0 msgr2=0x56165be6f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:18.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.714+0000 7fedb3fff640 1 --2- 172.21.15.79:0/690886480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56165be5f4a0 0x56165be6f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:18.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.714+0000 7fedb3fff640 1 -- 172.21.15.79:0/690886480 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56165be514a0 con 0x56165be52bf0 2024-08-20T01:36:18.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.714+0000 7fedb3fff640 1 --2- 172.21.15.79:0/690886480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56165be52bf0 0x56165be70c60 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7feda40039c0 tx=0x7feda400bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9050adfe005da4ff server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:18.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.714+0000 7fed99ffb640 1 -- 172.21.15.79:0/690886480 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda402a020 con 0x56165be52bf0 2024-08-20T01:36:18.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.714+0000 7fed99ffb640 1 -- 172.21.15.79:0/690886480 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feda4015030 con 0x56165be52bf0 2024-08-20T01:36:18.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.714+0000 7fed99ffb640 1 -- 172.21.15.79:0/690886480 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda40116a0 con 0x56165be52bf0 2024-08-20T01:36:18.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.715+0000 7fedbca99740 1 -- 172.21.15.79:0/690886480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56165be52bf0 msgr2=0x56165be70c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:18.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.715+0000 7fedbca99740 1 --2- 172.21.15.79:0/690886480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56165be52bf0 0x56165be70c60 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7feda40039c0 tx=0x7feda400bc50 comp rx=0 tx=0).stop 2024-08-20T01:36:18.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.715+0000 7fedbca99740 1 -- 172.21.15.79:0/690886480 shutdown_connections 2024-08-20T01:36:18.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.715+0000 7fedbca99740 1 --2- 172.21.15.79:0/690886480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56165be5f4a0 0x56165be6f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:18.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.715+0000 7fedbca99740 1 --2- 172.21.15.79:0/690886480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56165be53510 0x56165be56db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:18.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.715+0000 7fedbca99740 1 --2- 172.21.15.79:0/690886480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56165be52bf0 0x56165be70c60 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:18.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.715+0000 7fedbca99740 1 -- 172.21.15.79:0/690886480 >> 172.21.15.79:0/690886480 conn(0x56165be50a20 msgr2=0x56165be5ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:18.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.715+0000 7fedbca99740 1 -- 172.21.15.79:0/690886480 shutdown_connections 2024-08-20T01:36:18.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.715+0000 7fedbca99740 1 -- 172.21.15.79:0/690886480 wait complete. 2024-08-20T01:36:18.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.715+0000 7fedbca99740 1 -- start start 2024-08-20T01:36:18.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.715+0000 7fedbca99740 1 Processor -- start 2024-08-20T01:36:18.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.716+0000 7fedbca99740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56165be52bf0 0x56165be74c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:18.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.716+0000 7fedbca99740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56165be53510 0x56165be75150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:18.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.716+0000 7fedbca99740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56165be5f4a0 0x56165be75690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:18.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.716+0000 7fedbca99740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56165be71880 con 0x56165be52bf0 2024-08-20T01:36:18.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.716+0000 7fedbca99740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56165be711b0 con 0x56165be5f4a0 2024-08-20T01:36:18.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.716+0000 7fedbca99740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56165be71f50 con 0x56165be53510 2024-08-20T01:36:18.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.716+0000 7fedbca99740 10 client.0 _ll_register_callbacks cb 0x7fedac009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:18.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.716+0000 7fedb3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56165be52bf0 0x56165be74c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:18.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.716+0000 7fedb3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56165be52bf0 0x56165be74c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49238/0 (socket says 172.21.15.79:49238) 2024-08-20T01:36:18.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.716+0000 7fedb3fff640 1 -- 172.21.15.79:0/3741169647 learned_addr learned my addr 172.21.15.79:0/3741169647 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:18.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.716+0000 7fedb8c3d640 1 --2- 172.21.15.79:0/3741169647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56165be5f4a0 0x56165be75690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:18.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.716+0000 7fedb37fe640 1 --2- 172.21.15.79:0/3741169647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56165be53510 0x56165be75150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:18.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.716+0000 7fedb3fff640 1 -- 172.21.15.79:0/3741169647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56165be53510 msgr2=0x56165be75150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:18.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.716+0000 7fedb3fff640 1 --2- 172.21.15.79:0/3741169647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56165be53510 0x56165be75150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:18.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.716+0000 7fedb3fff640 1 -- 172.21.15.79:0/3741169647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56165be5f4a0 msgr2=0x56165be75690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:18.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.716+0000 7fedb3fff640 1 --2- 172.21.15.79:0/3741169647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56165be5f4a0 0x56165be75690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:18.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.716+0000 7fedb3fff640 1 -- 172.21.15.79:0/3741169647 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56165bed8d10 con 0x56165be52bf0 2024-08-20T01:36:18.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.716+0000 7fedb8c3d640 1 --2- 172.21.15.79:0/3741169647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56165be5f4a0 0x56165be75690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:36:18.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.716+0000 7fedb3fff640 1 --2- 172.21.15.79:0/3741169647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56165be52bf0 0x56165be74c10 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7feda400b6b0 tx=0x7feda4003b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d564a6d2309f916 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:18.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.716+0000 7fed937fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:36:18.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.716+0000 7fed937fe640 1 -- 172.21.15.79:0/3741169647 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda4033070 con 0x56165be52bf0 2024-08-20T01:36:18.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.717+0000 7fed937fe640 1 -- 172.21.15.79:0/3741169647 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7feda4026660 con 0x56165be52bf0 2024-08-20T01:36:18.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.717+0000 7fedbca99740 1 -- 172.21.15.79:0/3741169647 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feda4015030 con 0x56165be52bf0 2024-08-20T01:36:18.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.717+0000 7fed937fe640 1 -- 172.21.15.79:0/3741169647 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7feda402a030 con 0x56165be52bf0 2024-08-20T01:36:18.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.717+0000 7fedbca99740 10 client.15171 fetch_fsmap learned FSMap version 27 2024-08-20T01:36:18.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.717+0000 7fedbca99740 1 -- 172.21.15.79:0/3741169647 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56165beda010 con 0x56165be52bf0 2024-08-20T01:36:18.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.717+0000 7fed937fe640 1 -- 172.21.15.79:0/3741169647 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feda4015030 con 0x56165be52bf0 2024-08-20T01:36:18.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.717+0000 7fed937fe640 1 -- 172.21.15.79:0/3741169647 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7feda4005020 con 0x56165be52bf0 2024-08-20T01:36:18.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.717+0000 7fedbca99740 10 client.15171 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:36:18.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.717+0000 7fedbca99740 10 client.15171 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-20T01:36:18.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.717+0000 7fedbca99740 20 client.15171 populate_metadata read hostname 'smithi079' 2024-08-20T01:36:18.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.717+0000 7fedbca99740 1 --2- 172.21.15.79:0/3741169647 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56165bede590 0x56165bedd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:18.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.717+0000 7fedbca99740 4 client.15171 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-20T01:36:18.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.717+0000 7fedbca99740 1 -- 172.21.15.79:0/3741169647 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "status"}) -- 0x56165bdc7090 con 0x56165bede590 2024-08-20T01:36:18.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.718+0000 7fedb37fe640 1 --2- 172.21.15.79:0/3741169647 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56165bede590 0x56165bedd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:18.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.718+0000 7fed937fe640 10 client.15171 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:36:18.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.718+0000 7fedb37fe640 1 --2- 172.21.15.79:0/3741169647 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56165bede590 0x56165bedd2a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8fce2f8814223fc server_cookie=f9b8e5584cd2675f in_seq=0 out_seq=0 2024-08-20T01:36:18.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.718+0000 7fed937fe640 1 -- 172.21.15.79:0/3741169647 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x56165bdc7090 con 0x56165bede590 2024-08-20T01:36:18.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.718+0000 7fed937fe640 10 client.15171 handle_command_reply: tid=0 2024-08-20T01:36:18.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.718+0000 7fedbca99740 1 client.15171 shutdown 2024-08-20T01:36:18.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.719+0000 7fedbca99740 1 -- 172.21.15.79:0/3741169647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56165be52bf0 msgr2=0x56165be74c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:18.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.719+0000 7fedbca99740 1 --2- 172.21.15.79:0/3741169647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56165be52bf0 0x56165be74c10 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7feda400b6b0 tx=0x7feda4003b60 comp rx=0 tx=0).stop 2024-08-20T01:36:18.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.719+0000 7fedbca99740 1 -- 172.21.15.79:0/3741169647 shutdown_connections 2024-08-20T01:36:18.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.719+0000 7fedbca99740 1 --2- 172.21.15.79:0/3741169647 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56165bede590 0x56165bedd2a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:18.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.719+0000 7fedbca99740 1 --2- 172.21.15.79:0/3741169647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56165be5f4a0 0x56165be75690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:18.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.719+0000 7fedbca99740 1 --2- 172.21.15.79:0/3741169647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56165be53510 0x56165be75150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:18.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.719+0000 7fedbca99740 1 --2- 172.21.15.79:0/3741169647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56165be52bf0 0x56165be74c10 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:18.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.719+0000 7fedbca99740 1 -- 172.21.15.79:0/3741169647 >> 172.21.15.79:0/3741169647 conn(0x56165be50a20 msgr2=0x56165be6f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:18.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.719+0000 7fed937fe640 0 client.15171 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:36:18.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.719+0000 7fedbca99740 1 -- 172.21.15.79:0/3741169647 shutdown_connections 2024-08-20T01:36:18.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.719+0000 7fedbca99740 1 -- 172.21.15.79:0/3741169647 wait complete. 2024-08-20T01:36:18.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.719+0000 7fedbca99740 20 client.15171 trim_cache size 0 max 16384 2024-08-20T01:36:18.731 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:36:18.731 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "28484e9a-5e93-11ef-bccf-c7b262605968", 2024-08-20T01:36:18.732 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2024-08-20T01:36:18.732 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 24539, 2024-08-20T01:36:18.732 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-08-20T01:36:18.732 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-08-20T01:36:18.732 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-08-20T01:36:18.732 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 83.358391763, 2024-08-20T01:36:18.732 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 27, 2024-08-20T01:36:18.732 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 74, 2024-08-20T01:36:18.732 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 72, 2024-08-20T01:36:18.732 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 94.124214219999999 2024-08-20T01:36:18.732 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:36:18.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.719+0000 7fedba6a0640 1 -- 172.21.15.79:0/1523257596 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fed9c0b3c60 msgr2=0x7fed9c0b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:18.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.719+0000 7fedba6a0640 1 --2- 172.21.15.79:0/1523257596 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fed9c0b3c60 0x7fed9c0b6120 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fedac004af0 tx=0x7fedac005d80 comp rx=0 tx=0).stop 2024-08-20T01:36:18.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.719+0000 7fedba6a0640 1 -- 172.21.15.79:0/1523257596 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedb410a630 msgr2=0x7fedb4102a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:18.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.719+0000 7fedba6a0640 1 --2- 172.21.15.79:0/1523257596 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedb410a630 0x7fedb4102a30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7feda800b4a0 tx=0x7feda800b960 comp rx=0 tx=0).stop 2024-08-20T01:36:18.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.720+0000 7fedba6a0640 1 -- 172.21.15.79:0/1523257596 shutdown_connections 2024-08-20T01:36:18.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.720+0000 7fedba6a0640 1 --2- 172.21.15.79:0/1523257596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedb410cf60 0x7fedb4102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:18.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.720+0000 7fedba6a0640 1 --2- 172.21.15.79:0/1523257596 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedb410a630 0x7fedb4102a30 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:18.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.720+0000 7fedba6a0640 1 --2- 172.21.15.79:0/1523257596 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fed9c0b3c60 0x7fed9c0b6120 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:18.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.720+0000 7fedba6a0640 1 --2- 172.21.15.79:0/1523257596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fedb4101520 0x7fedb41024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:18.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.720+0000 7fedba6a0640 1 -- 172.21.15.79:0/1523257596 >> 172.21.15.79:0/1523257596 conn(0x7fedb4076c80 msgr2=0x7fedb41002b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:18.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.720+0000 7fedba6a0640 1 -- 172.21.15.79:0/1523257596 shutdown_connections 2024-08-20T01:36:18.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:18.720+0000 7fedba6a0640 1 -- 172.21.15.79:0/1523257596 wait complete. 2024-08-20T01:36:19.389 INFO:tasks.cephadm:Setup complete, yielding 2024-08-20T01:36:19.390 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-20T01:36:19.398 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi079.front.sepia.ceph.com 2024-08-20T01:36:19.399 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- bash -c 'ceph orch status' 2024-08-20T01:36:19.645 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:36:20.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.094+0000 7fa57f9d9640 1 -- 172.21.15.79:0/2776746773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5781058d0 msgr2=0x7fa578107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:20.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.094+0000 7fa57f9d9640 1 --2- 172.21.15.79:0/2776746773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5781058d0 0x7fa578107ce0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa568009900 tx=0x7fa56802a410 comp rx=0 tx=0).stop 2024-08-20T01:36:20.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.094+0000 7fa57f9d9640 1 -- 172.21.15.79:0/2776746773 shutdown_connections 2024-08-20T01:36:20.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.094+0000 7fa57f9d9640 1 --2- 172.21.15.79:0/2776746773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa578108420 0x7fa57810a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:20.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.094+0000 7fa57f9d9640 1 --2- 172.21.15.79:0/2776746773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5781058d0 0x7fa578107ce0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:20.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.094+0000 7fa57f9d9640 1 --2- 172.21.15.79:0/2776746773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa57806b340 0x7fa578105390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:20.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.094+0000 7fa57f9d9640 1 -- 172.21.15.79:0/2776746773 >> 172.21.15.79:0/2776746773 conn(0x7fa5780fcee0 msgr2=0x7fa5780ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:20.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.094+0000 7fa57f9d9640 1 -- 172.21.15.79:0/2776746773 shutdown_connections 2024-08-20T01:36:20.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.094+0000 7fa57f9d9640 1 -- 172.21.15.79:0/2776746773 wait complete. 2024-08-20T01:36:20.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.095+0000 7fa57f9d9640 1 Processor -- start 2024-08-20T01:36:20.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.095+0000 7fa57f9d9640 1 -- start start 2024-08-20T01:36:20.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.095+0000 7fa57f9d9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa57806b340 0x7fa57819ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:20.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.095+0000 7fa57f9d9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5781058d0 0x7fa57819b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:20.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.095+0000 7fa57f9d9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa578108420 0x7fa57819bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:20.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.095+0000 7fa57f9d9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa57810e300 con 0x7fa57806b340 2024-08-20T01:36:20.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.095+0000 7fa57f9d9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa57810e180 con 0x7fa578108420 2024-08-20T01:36:20.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.095+0000 7fa57f9d9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa57810e480 con 0x7fa5781058d0 2024-08-20T01:36:20.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.095+0000 7fa57d775640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa57806b340 0x7fa57819ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:20.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.095+0000 7fa57d775640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa57806b340 0x7fa57819ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49262/0 (socket says 172.21.15.79:49262) 2024-08-20T01:36:20.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.095+0000 7fa57d775640 1 -- 172.21.15.79:0/3865186729 learned_addr learned my addr 172.21.15.79:0/3865186729 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:20.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.095+0000 7fa57d775640 1 -- 172.21.15.79:0/3865186729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5781058d0 msgr2=0x7fa57819b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:20.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.095+0000 7fa57d775640 1 --2- 172.21.15.79:0/3865186729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5781058d0 0x7fa57819b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:20.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.095+0000 7fa57d775640 1 -- 172.21.15.79:0/3865186729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa578108420 msgr2=0x7fa57819bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:20.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.095+0000 7fa57d775640 1 --2- 172.21.15.79:0/3865186729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa578108420 0x7fa57819bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:20.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.095+0000 7fa57d775640 1 -- 172.21.15.79:0/3865186729 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa57819c860 con 0x7fa57806b340 2024-08-20T01:36:20.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.095+0000 7fa57d775640 1 --2- 172.21.15.79:0/3865186729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa57806b340 0x7fa57819ad30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa57400b4a0 tx=0x7fa57400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:20.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.095+0000 7fa56e7fc640 1 -- 172.21.15.79:0/3865186729 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa574014070 con 0x7fa57806b340 2024-08-20T01:36:20.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.095+0000 7fa56e7fc640 1 -- 172.21.15.79:0/3865186729 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa574010aa0 con 0x7fa57806b340 2024-08-20T01:36:20.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.095+0000 7fa56e7fc640 1 -- 172.21.15.79:0/3865186729 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa574017b70 con 0x7fa57806b340 2024-08-20T01:36:20.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.095+0000 7fa57f9d9640 1 -- 172.21.15.79:0/3865186729 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa57819cb50 con 0x7fa57806b340 2024-08-20T01:36:20.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.096+0000 7fa57f9d9640 1 -- 172.21.15.79:0/3865186729 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5781a3230 con 0x7fa57806b340 2024-08-20T01:36:20.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.096+0000 7fa57f9d9640 1 -- 172.21.15.79:0/3865186729 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5781a3460 con 0x7fa57806b340 2024-08-20T01:36:20.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.099+0000 7fa56e7fc640 1 -- 172.21.15.79:0/3865186729 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fa574017070 con 0x7fa57806b340 2024-08-20T01:36:20.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.099+0000 7fa56e7fc640 1 --2- 172.21.15.79:0/3865186729 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa5640b3c60 0x7fa5640b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:20.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.099+0000 7fa57cf74640 1 --2- 172.21.15.79:0/3865186729 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa5640b3c60 0x7fa5640b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:20.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.099+0000 7fa56e7fc640 1 -- 172.21.15.79:0/3865186729 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fa5740e3450 con 0x7fa57806b340 2024-08-20T01:36:20.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.100+0000 7fa57cf74640 1 --2- 172.21.15.79:0/3865186729 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa5640b3c60 0x7fa5640b6120 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa56802a930 tx=0x7fa568000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:20.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.102+0000 7fa56e7fc640 1 -- 172.21.15.79:0/3865186729 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fa5740aaa60 con 0x7fa57806b340 2024-08-20T01:36:20.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:20 smithi081 ceph-mon[22209]: pgmap v317: 97 pgs: 97 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-08-20T01:36:20.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.291+0000 7fa57f9d9640 1 -- 172.21.15.79:0/3865186729 --> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fa5781a3630 con 0x7fa5640b3c60 2024-08-20T01:36:20.294 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:20 smithi079 ceph-mon[18656]: pgmap v317: 97 pgs: 97 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-08-20T01:36:20.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.293+0000 7fa56e7fc640 1 -- 172.21.15.79:0/3865186729 <== mgr.14150 v2:172.21.15.79:6800/3038112779 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fa5781a3630 con 0x7fa5640b3c60 2024-08-20T01:36:20.294 INFO:teuthology.orchestra.run.smithi079.stdout:Backend: cephadm 2024-08-20T01:36:20.294 INFO:teuthology.orchestra.run.smithi079.stdout:Available: Yes 2024-08-20T01:36:20.295 INFO:teuthology.orchestra.run.smithi079.stdout:Paused: No 2024-08-20T01:36:20.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.295+0000 7fa57f9d9640 1 -- 172.21.15.79:0/3865186729 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa5640b3c60 msgr2=0x7fa5640b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:20.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.295+0000 7fa57f9d9640 1 --2- 172.21.15.79:0/3865186729 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa5640b3c60 0x7fa5640b6120 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa56802a930 tx=0x7fa568000bc0 comp rx=0 tx=0).stop 2024-08-20T01:36:20.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.295+0000 7fa57f9d9640 1 -- 172.21.15.79:0/3865186729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa57806b340 msgr2=0x7fa57819ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:20.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.295+0000 7fa57f9d9640 1 --2- 172.21.15.79:0/3865186729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa57806b340 0x7fa57819ad30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa57400b4a0 tx=0x7fa57400b960 comp rx=0 tx=0).stop 2024-08-20T01:36:20.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.295+0000 7fa57f9d9640 1 -- 172.21.15.79:0/3865186729 shutdown_connections 2024-08-20T01:36:20.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.295+0000 7fa57f9d9640 1 --2- 172.21.15.79:0/3865186729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa578108420 0x7fa57819bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:20.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.295+0000 7fa57f9d9640 1 --2- 172.21.15.79:0/3865186729 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa5640b3c60 0x7fa5640b6120 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:20.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.295+0000 7fa57f9d9640 1 --2- 172.21.15.79:0/3865186729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5781058d0 0x7fa57819b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:20.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.295+0000 7fa57f9d9640 1 --2- 172.21.15.79:0/3865186729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa57806b340 0x7fa57819ad30 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:20.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.295+0000 7fa57f9d9640 1 -- 172.21.15.79:0/3865186729 >> 172.21.15.79:0/3865186729 conn(0x7fa5780fcee0 msgr2=0x7fa5780ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:20.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.295+0000 7fa57f9d9640 1 -- 172.21.15.79:0/3865186729 shutdown_connections 2024-08-20T01:36:20.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:20.295+0000 7fa57f9d9640 1 -- 172.21.15.79:0/3865186729 wait complete. 2024-08-20T01:36:20.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:20 smithi175 ceph-mon[22392]: pgmap v317: 97 pgs: 97 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-08-20T01:36:21.021 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- bash -c 'ceph orch ps' 2024-08-20T01:36:21.262 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:36:21.382 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:21 smithi079 ceph-mon[18656]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:36:21.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:21 smithi175 ceph-mon[22392]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:36:21.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:21 smithi081 ceph-mon[22209]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:36:21.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.742+0000 7f4a7a7f3640 1 -- 172.21.15.79:0/2338190587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a74100dc0 msgr2=0x7f4a741011c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:21.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.742+0000 7f4a7a7f3640 1 --2- 172.21.15.79:0/2338190587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a74100dc0 0x7f4a741011c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4a64009930 tx=0x7f4a6402a420 comp rx=0 tx=0).stop 2024-08-20T01:36:21.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.742+0000 7f4a7a7f3640 1 -- 172.21.15.79:0/2338190587 shutdown_connections 2024-08-20T01:36:21.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.742+0000 7f4a7a7f3640 1 --2- 172.21.15.79:0/2338190587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a741028e0 0x7f4a74109260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:21.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.742+0000 7f4a7a7f3640 1 --2- 172.21.15.79:0/2338190587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a74101f20 0x7f4a741023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:21.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.742+0000 7f4a7a7f3640 1 --2- 172.21.15.79:0/2338190587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a74100dc0 0x7f4a741011c0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:21.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.742+0000 7f4a7a7f3640 1 -- 172.21.15.79:0/2338190587 >> 172.21.15.79:0/2338190587 conn(0x7f4a740fc690 msgr2=0x7f4a740fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:21.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.742+0000 7f4a7a7f3640 1 -- 172.21.15.79:0/2338190587 shutdown_connections 2024-08-20T01:36:21.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.742+0000 7f4a7a7f3640 1 -- 172.21.15.79:0/2338190587 wait complete. 2024-08-20T01:36:21.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.742+0000 7f4a7a7f3640 1 Processor -- start 2024-08-20T01:36:21.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.742+0000 7f4a7a7f3640 1 -- start start 2024-08-20T01:36:21.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.743+0000 7f4a7a7f3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a74100dc0 0x7f4a74197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:21.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.743+0000 7f4a7a7f3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a74101f20 0x7f4a741980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:21.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.743+0000 7f4a7a7f3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a741028e0 0x7f4a74198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:21.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.743+0000 7f4a7a7f3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7410c9d0 con 0x7f4a74100dc0 2024-08-20T01:36:21.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.743+0000 7f4a7a7f3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7410c850 con 0x7f4a741028e0 2024-08-20T01:36:21.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.743+0000 7f4a7a7f3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7410cb50 con 0x7f4a74101f20 2024-08-20T01:36:21.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.743+0000 7f4a73fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a74100dc0 0x7f4a74197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:21.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.743+0000 7f4a73fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a74100dc0 0x7f4a74197a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35806/0 (socket says 172.21.15.79:35806) 2024-08-20T01:36:21.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.743+0000 7f4a73fff640 1 -- 172.21.15.79:0/3289666488 learned_addr learned my addr 172.21.15.79:0/3289666488 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:21.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.743+0000 7f4a78d90640 1 --2- 172.21.15.79:0/3289666488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a741028e0 0x7f4a74198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:21.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.743+0000 7f4a73fff640 1 -- 172.21.15.79:0/3289666488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a74101f20 msgr2=0x7f4a741980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:21.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.743+0000 7f4a73fff640 1 --2- 172.21.15.79:0/3289666488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a74101f20 0x7f4a741980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:21.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.743+0000 7f4a73fff640 1 -- 172.21.15.79:0/3289666488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a741028e0 msgr2=0x7f4a74198cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:21.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.743+0000 7f4a73fff640 1 --2- 172.21.15.79:0/3289666488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a741028e0 0x7f4a74198cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:21.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.743+0000 7f4a73fff640 1 -- 172.21.15.79:0/3289666488 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a74199590 con 0x7f4a74100dc0 2024-08-20T01:36:21.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.743+0000 7f4a78d90640 1 --2- 172.21.15.79:0/3289666488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a741028e0 0x7f4a74198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:36:21.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.743+0000 7f4a73fff640 1 --2- 172.21.15.79:0/3289666488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a74100dc0 0x7f4a74197a60 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4a64009a50 tx=0x7f4a64032f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:21.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.743+0000 7f4a717fa640 1 -- 172.21.15.79:0/3289666488 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6403f030 con 0x7f4a74100dc0 2024-08-20T01:36:21.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.744+0000 7f4a717fa640 1 -- 172.21.15.79:0/3289666488 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4a640044b0 con 0x7f4a74100dc0 2024-08-20T01:36:21.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.744+0000 7f4a7a7f3640 1 -- 172.21.15.79:0/3289666488 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a74199820 con 0x7f4a74100dc0 2024-08-20T01:36:21.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.744+0000 7f4a717fa640 1 -- 172.21.15.79:0/3289666488 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a64035070 con 0x7f4a74100dc0 2024-08-20T01:36:21.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.744+0000 7f4a7a7f3640 1 -- 172.21.15.79:0/3289666488 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a7419fe10 con 0x7f4a74100dc0 2024-08-20T01:36:21.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.745+0000 7f4a7a7f3640 1 -- 172.21.15.79:0/3289666488 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a74107960 con 0x7f4a74100dc0 2024-08-20T01:36:21.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.746+0000 7f4a717fa640 1 -- 172.21.15.79:0/3289666488 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f4a64042030 con 0x7f4a74100dc0 2024-08-20T01:36:21.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.746+0000 7f4a717fa640 1 --2- 172.21.15.79:0/3289666488 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4a5c0b3c60 0x7f4a5c0b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:21.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.747+0000 7f4a737fe640 1 --2- 172.21.15.79:0/3289666488 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4a5c0b3c60 0x7f4a5c0b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:21.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.747+0000 7f4a717fa640 1 -- 172.21.15.79:0/3289666488 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f4a64104c10 con 0x7f4a74100dc0 2024-08-20T01:36:21.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.747+0000 7f4a737fe640 1 --2- 172.21.15.79:0/3289666488 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4a5c0b3c60 0x7f4a5c0b6120 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4a68009710 tx=0x7f4a68006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:21.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.749+0000 7f4a717fa640 1 -- 172.21.15.79:0/3289666488 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f4a640cc110 con 0x7f4a74100dc0 2024-08-20T01:36:21.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.931+0000 7f4a7a7f3640 1 -- 172.21.15.79:0/3289666488 --> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f4a740632c0 con 0x7f4a5c0b3c60 2024-08-20T01:36:21.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.943+0000 7f4a717fa640 1 -- 172.21.15.79:0/3289666488 <== mgr.14150 v2:172.21.15.79:6800/3038112779 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4185 (secure 0 0 0) 0x7f4a740632c0 con 0x7f4a5c0b3c60 2024-08-20T01:36:21.945 INFO:teuthology.orchestra.run.smithi079.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-20T01:36:21.945 INFO:teuthology.orchestra.run.smithi079.stdout:mds.a smithi079 running (100s) 20s ago 99s 19.3M - 19.0.0-5872-gef427541 9f5c88d94bb6 833c34652cfc 2024-08-20T01:36:21.945 INFO:teuthology.orchestra.run.smithi079.stdout:mds.b smithi081 running (97s) 31s ago 97s 29.2M - 19.0.0-5872-gef427541 9f5c88d94bb6 a428163ca8fb 2024-08-20T01:36:21.946 INFO:teuthology.orchestra.run.smithi079.stdout:mds.c smithi175 running (111s) 31s ago 110s 17.2M - 19.0.0-5872-gef427541 9f5c88d94bb6 0c8a3553794e 2024-08-20T01:36:21.946 INFO:teuthology.orchestra.run.smithi079.stdout:mds.d smithi079 running (119s) 20s ago 118s 13.8M - 19.0.0-5872-gef427541 9f5c88d94bb6 c62e0325de33 2024-08-20T01:36:21.946 INFO:teuthology.orchestra.run.smithi079.stdout:mds.e smithi081 running (115s) 31s ago 115s 18.7M - 19.0.0-5872-gef427541 9f5c88d94bb6 2bed42758d3d 2024-08-20T01:36:21.946 INFO:teuthology.orchestra.run.smithi079.stdout:mds.f smithi175 running (113s) 31s ago 113s 18.4M - 19.0.0-5872-gef427541 9f5c88d94bb6 03c0cd0b89f4 2024-08-20T01:36:21.946 INFO:teuthology.orchestra.run.smithi079.stdout:mds.g smithi079 running (103s) 20s ago 103s 19.4M - 19.0.0-5872-gef427541 9f5c88d94bb6 d8192a226ede 2024-08-20T01:36:21.946 INFO:teuthology.orchestra.run.smithi079.stdout:mds.h smithi081 running (108s) 31s ago 108s 18.0M - 19.0.0-5872-gef427541 9f5c88d94bb6 5aca4c06d841 2024-08-20T01:36:21.946 INFO:teuthology.orchestra.run.smithi079.stdout:mds.i smithi175 running (106s) 31s ago 105s 17.7M - 19.0.0-5872-gef427541 9f5c88d94bb6 62a2ffb0d5a1 2024-08-20T01:36:21.946 INFO:teuthology.orchestra.run.smithi079.stdout:mds.j smithi079 running (2m) 20s ago 2m 16.1M - 19.0.0-5872-gef427541 9f5c88d94bb6 d45e53552b35 2024-08-20T01:36:21.946 INFO:teuthology.orchestra.run.smithi079.stdout:mds.k smithi081 running (2m) 31s ago 2m 19.4M - 19.0.0-5872-gef427541 9f5c88d94bb6 ef9bfcfd2345 2024-08-20T01:36:21.946 INFO:teuthology.orchestra.run.smithi079.stdout:mds.l smithi175 running (2m) 31s ago 2m 18.4M - 19.0.0-5872-gef427541 9f5c88d94bb6 fd8ed55dd427 2024-08-20T01:36:21.946 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.x smithi079 *:9283,8765 running (9m) 20s ago 9m 522M - 19.0.0-5872-gef427541 9f5c88d94bb6 a969c0130e1c 2024-08-20T01:36:21.947 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.y smithi081 *:8443,8765 running (7m) 31s ago 7m 455M - 19.0.0-5872-gef427541 9f5c88d94bb6 78334f5c956f 2024-08-20T01:36:21.947 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.z smithi175 *:8443,8765 running (7m) 31s ago 7m 457M - 19.0.0-5872-gef427541 9f5c88d94bb6 2f5bfd5c2c46 2024-08-20T01:36:21.947 INFO:teuthology.orchestra.run.smithi079.stdout:mon.a smithi079 running (9m) 20s ago 9m 51.9M 2048M 19.0.0-5872-gef427541 9f5c88d94bb6 6399ab713805 2024-08-20T01:36:21.947 INFO:teuthology.orchestra.run.smithi079.stdout:mon.b smithi081 running (7m) 31s ago 7m 40.2M 2048M 19.0.0-5872-gef427541 9f5c88d94bb6 c7fb4d2ef7ea 2024-08-20T01:36:21.947 INFO:teuthology.orchestra.run.smithi079.stdout:mon.c smithi175 running (7m) 31s ago 7m 40.5M 2048M 19.0.0-5872-gef427541 9f5c88d94bb6 e7b3dc17999d 2024-08-20T01:36:21.947 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0 smithi079 running (6m) 20s ago 6m 48.2M 4272M 19.0.0-5872-gef427541 9f5c88d94bb6 4dd33d561847 2024-08-20T01:36:21.947 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1 smithi081 running (6m) 31s ago 6m 48.5M 4272M 19.0.0-5872-gef427541 9f5c88d94bb6 5ce4f6fa7d88 2024-08-20T01:36:21.947 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2 smithi175 running (6m) 31s ago 6m 50.0M 4272M 19.0.0-5872-gef427541 9f5c88d94bb6 f5cc59dbc828 2024-08-20T01:36:21.947 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3 smithi079 running (5m) 20s ago 5m 46.0M 4272M 19.0.0-5872-gef427541 9f5c88d94bb6 eb4f8a817d18 2024-08-20T01:36:21.947 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4 smithi081 running (5m) 31s ago 5m 44.7M 4272M 19.0.0-5872-gef427541 9f5c88d94bb6 3ded9d5a8ac6 2024-08-20T01:36:21.948 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5 smithi175 running (4m) 31s ago 4m 56.6M 4272M 19.0.0-5872-gef427541 9f5c88d94bb6 28b9fb249ff0 2024-08-20T01:36:21.948 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6 smithi079 running (4m) 20s ago 4m 53.8M 4272M 19.0.0-5872-gef427541 9f5c88d94bb6 206905df4702 2024-08-20T01:36:21.948 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7 smithi081 running (4m) 31s ago 4m 53.8M 4272M 19.0.0-5872-gef427541 9f5c88d94bb6 f947a91ce5d6 2024-08-20T01:36:21.948 INFO:teuthology.orchestra.run.smithi079.stdout:osd.8 smithi175 running (3m) 31s ago 3m 52.8M 4272M 19.0.0-5872-gef427541 9f5c88d94bb6 394121331a5b 2024-08-20T01:36:21.948 INFO:teuthology.orchestra.run.smithi079.stdout:osd.9 smithi079 running (3m) 20s ago 3m 44.0M 4272M 19.0.0-5872-gef427541 9f5c88d94bb6 528ae44eb302 2024-08-20T01:36:21.948 INFO:teuthology.orchestra.run.smithi079.stdout:osd.10 smithi081 running (2m) 31s ago 2m 56.8M 4272M 19.0.0-5872-gef427541 9f5c88d94bb6 50e418ec5603 2024-08-20T01:36:21.948 INFO:teuthology.orchestra.run.smithi079.stdout:osd.11 smithi175 running (2m) 31s ago 2m 42.3M 4272M 19.0.0-5872-gef427541 9f5c88d94bb6 a32f31d156b8 2024-08-20T01:36:21.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.946+0000 7f4a7a7f3640 1 -- 172.21.15.79:0/3289666488 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4a5c0b3c60 msgr2=0x7f4a5c0b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:21.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.946+0000 7f4a7a7f3640 1 --2- 172.21.15.79:0/3289666488 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4a5c0b3c60 0x7f4a5c0b6120 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4a68009710 tx=0x7f4a68006c90 comp rx=0 tx=0).stop 2024-08-20T01:36:21.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.946+0000 7f4a7a7f3640 1 -- 172.21.15.79:0/3289666488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a74100dc0 msgr2=0x7f4a74197a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:21.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.946+0000 7f4a7a7f3640 1 --2- 172.21.15.79:0/3289666488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a74100dc0 0x7f4a74197a60 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4a64009a50 tx=0x7f4a64032f90 comp rx=0 tx=0).stop 2024-08-20T01:36:21.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.946+0000 7f4a7a7f3640 1 -- 172.21.15.79:0/3289666488 shutdown_connections 2024-08-20T01:36:21.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.946+0000 7f4a7a7f3640 1 --2- 172.21.15.79:0/3289666488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a741028e0 0x7f4a74198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:21.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.946+0000 7f4a7a7f3640 1 --2- 172.21.15.79:0/3289666488 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4a5c0b3c60 0x7f4a5c0b6120 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:21.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.946+0000 7f4a7a7f3640 1 --2- 172.21.15.79:0/3289666488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a74101f20 0x7f4a741980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:21.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.946+0000 7f4a7a7f3640 1 --2- 172.21.15.79:0/3289666488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a74100dc0 0x7f4a74197a60 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:21.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.946+0000 7f4a7a7f3640 1 -- 172.21.15.79:0/3289666488 >> 172.21.15.79:0/3289666488 conn(0x7f4a740fc690 msgr2=0x7f4a740fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:21.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.946+0000 7f4a7a7f3640 1 -- 172.21.15.79:0/3289666488 shutdown_connections 2024-08-20T01:36:21.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:21.946+0000 7f4a7a7f3640 1 -- 172.21.15.79:0/3289666488 wait complete. 2024-08-20T01:36:22.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:22 smithi079 ceph-mon[18656]: pgmap v318: 97 pgs: 97 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-20T01:36:22.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:22 smithi081 ceph-mon[22209]: pgmap v318: 97 pgs: 97 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-20T01:36:22.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:22 smithi175 ceph-mon[22392]: pgmap v318: 97 pgs: 97 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-20T01:36:22.597 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- bash -c 'ceph orch ls' 2024-08-20T01:36:22.864 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:36:23.280 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:23 smithi079 ceph-mon[18656]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:36:23.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:23 smithi175 ceph-mon[22392]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:36:23.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.358+0000 7f3d2a65d640 1 -- 172.21.15.79:0/1945212940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d24102750 msgr2=0x7f3d24102b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:23.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.358+0000 7f3d2a65d640 1 --2- 172.21.15.79:0/1945212940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d24102750 0x7f3d24102b50 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3d14009930 tx=0x7f3d1402a440 comp rx=0 tx=0).stop 2024-08-20T01:36:23.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.358+0000 7f3d2a65d640 1 -- 172.21.15.79:0/1945212940 shutdown_connections 2024-08-20T01:36:23.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.358+0000 7f3d2a65d640 1 --2- 172.21.15.79:0/1945212940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d24104270 0x7f3d2410abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:23.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.358+0000 7f3d2a65d640 1 --2- 172.21.15.79:0/1945212940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d241038b0 0x7f3d24103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:23.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.358+0000 7f3d2a65d640 1 --2- 172.21.15.79:0/1945212940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d24102750 0x7f3d24102b50 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:23.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.358+0000 7f3d2a65d640 1 -- 172.21.15.79:0/1945212940 >> 172.21.15.79:0/1945212940 conn(0x7f3d240fe040 msgr2=0x7f3d24100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:23.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.358+0000 7f3d2a65d640 1 -- 172.21.15.79:0/1945212940 shutdown_connections 2024-08-20T01:36:23.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.358+0000 7f3d2a65d640 1 -- 172.21.15.79:0/1945212940 wait complete. 2024-08-20T01:36:23.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.359+0000 7f3d2a65d640 1 Processor -- start 2024-08-20T01:36:23.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.359+0000 7f3d2a65d640 1 -- start start 2024-08-20T01:36:23.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.359+0000 7f3d2a65d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d24102750 0x7f3d24076a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:23.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.359+0000 7f3d2a65d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d241038b0 0x7f3d24075270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:23.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.359+0000 7f3d2a65d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d24104270 0x7f3d240757b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:23.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.359+0000 7f3d2a65d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3d2410e3d0 con 0x7f3d24102750 2024-08-20T01:36:23.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.359+0000 7f3d2a65d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3d2410e250 con 0x7f3d24104270 2024-08-20T01:36:23.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.359+0000 7f3d2a65d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3d2410e550 con 0x7f3d241038b0 2024-08-20T01:36:23.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.359+0000 7f3d23fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d24102750 0x7f3d24076a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:23.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.359+0000 7f3d23fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d24102750 0x7f3d24076a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35822/0 (socket says 172.21.15.79:35822) 2024-08-20T01:36:23.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.359+0000 7f3d23fff640 1 -- 172.21.15.79:0/3769772681 learned_addr learned my addr 172.21.15.79:0/3769772681 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:23.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.359+0000 7f3d28bfa640 1 --2- 172.21.15.79:0/3769772681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d24104270 0x7f3d240757b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:23.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.359+0000 7f3d237fe640 1 --2- 172.21.15.79:0/3769772681 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d241038b0 0x7f3d24075270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:23.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.359+0000 7f3d23fff640 1 -- 172.21.15.79:0/3769772681 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d241038b0 msgr2=0x7f3d24075270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:23.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.359+0000 7f3d23fff640 1 --2- 172.21.15.79:0/3769772681 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d241038b0 0x7f3d24075270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:23.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.359+0000 7f3d23fff640 1 -- 172.21.15.79:0/3769772681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d24104270 msgr2=0x7f3d240757b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:23.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.359+0000 7f3d23fff640 1 --2- 172.21.15.79:0/3769772681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d24104270 0x7f3d240757b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:23.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.359+0000 7f3d23fff640 1 -- 172.21.15.79:0/3769772681 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d24076070 con 0x7f3d24102750 2024-08-20T01:36:23.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.359+0000 7f3d28bfa640 1 --2- 172.21.15.79:0/3769772681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d24104270 0x7f3d240757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:36:23.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.359+0000 7f3d237fe640 1 --2- 172.21.15.79:0/3769772681 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d241038b0 0x7f3d24075270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:36:23.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.360+0000 7f3d23fff640 1 --2- 172.21.15.79:0/3769772681 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d24102750 0x7f3d24076a00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3d14009900 tx=0x7f3d14003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:23.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.360+0000 7f3d217fa640 1 -- 172.21.15.79:0/3769772681 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d1403f070 con 0x7f3d24102750 2024-08-20T01:36:23.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.360+0000 7f3d217fa640 1 -- 172.21.15.79:0/3769772681 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3d14031d10 con 0x7f3d24102750 2024-08-20T01:36:23.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.360+0000 7f3d217fa640 1 -- 172.21.15.79:0/3769772681 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d14035030 con 0x7f3d24102750 2024-08-20T01:36:23.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.360+0000 7f3d2a65d640 1 -- 172.21.15.79:0/3769772681 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d241a2c40 con 0x7f3d24102750 2024-08-20T01:36:23.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.360+0000 7f3d2a65d640 1 -- 172.21.15.79:0/3769772681 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d241a3140 con 0x7f3d24102750 2024-08-20T01:36:23.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.361+0000 7f3d2a65d640 1 -- 172.21.15.79:0/3769772681 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d24109b20 con 0x7f3d24102750 2024-08-20T01:36:23.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.362+0000 7f3d217fa640 1 -- 172.21.15.79:0/3769772681 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f3d14042070 con 0x7f3d24102750 2024-08-20T01:36:23.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.363+0000 7f3d217fa640 1 --2- 172.21.15.79:0/3769772681 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3d0c0b3ce0 0x7f3d0c0b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:23.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.363+0000 7f3d237fe640 1 --2- 172.21.15.79:0/3769772681 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3d0c0b3ce0 0x7f3d0c0b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:23.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.363+0000 7f3d217fa640 1 -- 172.21.15.79:0/3769772681 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f3d141047b0 con 0x7f3d24102750 2024-08-20T01:36:23.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.363+0000 7f3d237fe640 1 --2- 172.21.15.79:0/3769772681 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3d0c0b3ce0 0x7f3d0c0b61a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3d1800a8b0 tx=0x7f3d18008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:23.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.367+0000 7f3d217fa640 1 -- 172.21.15.79:0/3769772681 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f3d140cbcb0 con 0x7f3d24102750 2024-08-20T01:36:23.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:23 smithi081 ceph-mon[22209]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:36:23.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.553+0000 7f3d2a65d640 1 -- 172.21.15.79:0/3769772681 --> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f3d240632c0 con 0x7f3d0c0b3ce0 2024-08-20T01:36:23.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.559+0000 7f3d217fa640 1 -- 172.21.15.79:0/3769772681 <== mgr.14150 v2:172.21.15.79:6800/3038112779 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f3d240632c0 con 0x7f3d0c0b3ce0 2024-08-20T01:36:23.561 INFO:teuthology.orchestra.run.smithi079.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-08-20T01:36:23.561 INFO:teuthology.orchestra.run.smithi079.stdout:mds.all 12/12 32s ago 2m smithi079=a;smithi079=d;smithi079=g;smithi079=j;smithi081=b;smithi081=e;smithi081=h;smithi081=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l;count:12 2024-08-20T01:36:23.561 INFO:teuthology.orchestra.run.smithi079.stdout:mgr 3/3 32s ago 7m smithi079=x;smithi081=y;smithi175=z;count:3 2024-08-20T01:36:23.561 INFO:teuthology.orchestra.run.smithi079.stdout:mon 3/3 32s ago 8m smithi079:172.21.15.79=a;smithi081:172.21.15.81=b;smithi175:172.21.15.175=c;count:3 2024-08-20T01:36:23.562 INFO:teuthology.orchestra.run.smithi079.stdout:osd 12 32s ago - 2024-08-20T01:36:23.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.561+0000 7f3d2a65d640 1 -- 172.21.15.79:0/3769772681 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3d0c0b3ce0 msgr2=0x7f3d0c0b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:23.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.561+0000 7f3d2a65d640 1 --2- 172.21.15.79:0/3769772681 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3d0c0b3ce0 0x7f3d0c0b61a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3d1800a8b0 tx=0x7f3d18008040 comp rx=0 tx=0).stop 2024-08-20T01:36:23.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.561+0000 7f3d2a65d640 1 -- 172.21.15.79:0/3769772681 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d24102750 msgr2=0x7f3d24076a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:23.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.561+0000 7f3d2a65d640 1 --2- 172.21.15.79:0/3769772681 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d24102750 0x7f3d24076a00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3d14009900 tx=0x7f3d14003d50 comp rx=0 tx=0).stop 2024-08-20T01:36:23.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.562+0000 7f3d2a65d640 1 -- 172.21.15.79:0/3769772681 shutdown_connections 2024-08-20T01:36:23.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.562+0000 7f3d2a65d640 1 --2- 172.21.15.79:0/3769772681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d24104270 0x7f3d240757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:23.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.562+0000 7f3d2a65d640 1 --2- 172.21.15.79:0/3769772681 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3d0c0b3ce0 0x7f3d0c0b61a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:23.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.562+0000 7f3d2a65d640 1 --2- 172.21.15.79:0/3769772681 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d241038b0 0x7f3d24075270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:23.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.562+0000 7f3d2a65d640 1 --2- 172.21.15.79:0/3769772681 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d24102750 0x7f3d24076a00 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:23.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.562+0000 7f3d2a65d640 1 -- 172.21.15.79:0/3769772681 >> 172.21.15.79:0/3769772681 conn(0x7f3d240fe040 msgr2=0x7f3d24106cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:23.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.562+0000 7f3d2a65d640 1 -- 172.21.15.79:0/3769772681 shutdown_connections 2024-08-20T01:36:23.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:23.562+0000 7f3d2a65d640 1 -- 172.21.15.79:0/3769772681 wait complete. 2024-08-20T01:36:24.261 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:24 smithi079 ceph-mon[18656]: pgmap v319: 97 pgs: 97 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T01:36:24.294 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- bash -c 'ceph orch host ls' 2024-08-20T01:36:24.391 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:24 smithi175 ceph-mon[22392]: pgmap v319: 97 pgs: 97 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T01:36:24.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:24 smithi081 ceph-mon[22209]: pgmap v319: 97 pgs: 97 active+clean; 641 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T01:36:24.542 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:36:25.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.000+0000 7fab4c8ca640 1 -- 172.21.15.79:0/1208603974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab48103150 msgr2=0x7fab48109ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:25.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.000+0000 7fab4c8ca640 1 --2- 172.21.15.79:0/1208603974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab48103150 0x7fab48109ad0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fab40009cd0 tx=0x7fab4002a8e0 comp rx=0 tx=0).stop 2024-08-20T01:36:25.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.001+0000 7fab4c8ca640 1 -- 172.21.15.79:0/1208603974 shutdown_connections 2024-08-20T01:36:25.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.001+0000 7fab4c8ca640 1 --2- 172.21.15.79:0/1208603974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab48103150 0x7fab48109ad0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:25.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.001+0000 7fab4c8ca640 1 --2- 172.21.15.79:0/1208603974 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab48102790 0x7fab48102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:25.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.001+0000 7fab4c8ca640 1 --2- 172.21.15.79:0/1208603974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab48101630 0x7fab48101a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:25.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.001+0000 7fab4c8ca640 1 -- 172.21.15.79:0/1208603974 >> 172.21.15.79:0/1208603974 conn(0x7fab480fcf00 msgr2=0x7fab480ff340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:25.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.001+0000 7fab4c8ca640 1 -- 172.21.15.79:0/1208603974 shutdown_connections 2024-08-20T01:36:25.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.001+0000 7fab4c8ca640 1 -- 172.21.15.79:0/1208603974 wait complete. 2024-08-20T01:36:25.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.001+0000 7fab4c8ca640 1 Processor -- start 2024-08-20T01:36:25.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.001+0000 7fab4c8ca640 1 -- start start 2024-08-20T01:36:25.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.001+0000 7fab4c8ca640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab48101630 0x7fab4806bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:25.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.001+0000 7fab4c8ca640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab48102790 0x7fab4819d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:25.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.001+0000 7fab4c8ca640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab48103150 0x7fab4819fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:25.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.001+0000 7fab4c8ca640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fab4810d1c0 con 0x7fab48103150 2024-08-20T01:36:25.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.001+0000 7fab4c8ca640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fab4810d040 con 0x7fab48102790 2024-08-20T01:36:25.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.001+0000 7fab4c8ca640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fab4810d340 con 0x7fab48101630 2024-08-20T01:36:25.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.002+0000 7fab46d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab48103150 0x7fab4819fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:25.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.002+0000 7fab46d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab48103150 0x7fab4819fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35840/0 (socket says 172.21.15.79:35840) 2024-08-20T01:36:25.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.002+0000 7fab46d9d640 1 -- 172.21.15.79:0/1199249491 learned_addr learned my addr 172.21.15.79:0/1199249491 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:25.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.002+0000 7fab4659c640 1 --2- 172.21.15.79:0/1199249491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab48101630 0x7fab4806bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:25.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.002+0000 7fab45d9b640 1 --2- 172.21.15.79:0/1199249491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab48102790 0x7fab4819d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:25.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.002+0000 7fab46d9d640 1 -- 172.21.15.79:0/1199249491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab48101630 msgr2=0x7fab4806bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:25.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.002+0000 7fab46d9d640 1 --2- 172.21.15.79:0/1199249491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab48101630 0x7fab4806bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:25.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.002+0000 7fab46d9d640 1 -- 172.21.15.79:0/1199249491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab48102790 msgr2=0x7fab4819d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:25.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.002+0000 7fab46d9d640 1 --2- 172.21.15.79:0/1199249491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab48102790 0x7fab4819d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:25.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.002+0000 7fab46d9d640 1 -- 172.21.15.79:0/1199249491 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab481a0660 con 0x7fab48103150 2024-08-20T01:36:25.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.002+0000 7fab45d9b640 1 --2- 172.21.15.79:0/1199249491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab48102790 0x7fab4819d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:36:25.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.002+0000 7fab46d9d640 1 --2- 172.21.15.79:0/1199249491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab48103150 0x7fab4819fda0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fab400097b0 tx=0x7fab40003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:25.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.002+0000 7fab377fe640 1 -- 172.21.15.79:0/1199249491 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab40004450 con 0x7fab48103150 2024-08-20T01:36:25.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.002+0000 7fab4c8ca640 1 -- 172.21.15.79:0/1199249491 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab481a08f0 con 0x7fab48103150 2024-08-20T01:36:25.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.002+0000 7fab377fe640 1 -- 172.21.15.79:0/1199249491 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fab400045f0 con 0x7fab48103150 2024-08-20T01:36:25.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.002+0000 7fab377fe640 1 -- 172.21.15.79:0/1199249491 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab40046800 con 0x7fab48103150 2024-08-20T01:36:25.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.002+0000 7fab4c8ca640 1 -- 172.21.15.79:0/1199249491 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab481a0e30 con 0x7fab48103150 2024-08-20T01:36:25.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.003+0000 7fab4c8ca640 1 -- 172.21.15.79:0/1199249491 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab481a1060 con 0x7fab48103150 2024-08-20T01:36:25.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.004+0000 7fab377fe640 1 -- 172.21.15.79:0/1199249491 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fab40030ac0 con 0x7fab48103150 2024-08-20T01:36:25.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.005+0000 7fab377fe640 1 --2- 172.21.15.79:0/1199249491 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fab300b3c60 0x7fab300b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:25.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.006+0000 7fab4659c640 1 --2- 172.21.15.79:0/1199249491 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fab300b3c60 0x7fab300b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:25.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.006+0000 7fab377fe640 1 -- 172.21.15.79:0/1199249491 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fab4002e030 con 0x7fab48103150 2024-08-20T01:36:25.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.006+0000 7fab4659c640 1 --2- 172.21.15.79:0/1199249491 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fab300b3c60 0x7fab300b6120 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fab3c009890 tx=0x7fab3c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:25.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.010+0000 7fab377fe640 1 -- 172.21.15.79:0/1199249491 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fab4004b060 con 0x7fab48103150 2024-08-20T01:36:25.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.048+0000 7fab377fe640 1 -- 172.21.15.79:0/1199249491 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fab400c89f0 con 0x7fab48103150 2024-08-20T01:36:25.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:25 smithi079 ceph-mon[18656]: from='client.15189 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:36:25.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.194+0000 7fab4c8ca640 1 -- 172.21.15.79:0/1199249491 --> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fab481a1230 con 0x7fab300b3c60 2024-08-20T01:36:25.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.196+0000 7fab377fe640 1 -- 172.21.15.79:0/1199249491 <== mgr.14150 v2:172.21.15.79:6800/3038112779 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fab481a1230 con 0x7fab300b3c60 2024-08-20T01:36:25.197 INFO:teuthology.orchestra.run.smithi079.stdout:HOST ADDR LABELS STATUS 2024-08-20T01:36:25.197 INFO:teuthology.orchestra.run.smithi079.stdout:smithi079 172.21.15.79 2024-08-20T01:36:25.197 INFO:teuthology.orchestra.run.smithi079.stdout:smithi081 172.21.15.81 2024-08-20T01:36:25.197 INFO:teuthology.orchestra.run.smithi079.stdout:smithi175 172.21.15.175 2024-08-20T01:36:25.198 INFO:teuthology.orchestra.run.smithi079.stdout:3 hosts in cluster 2024-08-20T01:36:25.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.198+0000 7fab4c8ca640 1 -- 172.21.15.79:0/1199249491 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fab300b3c60 msgr2=0x7fab300b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:25.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.198+0000 7fab4c8ca640 1 --2- 172.21.15.79:0/1199249491 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fab300b3c60 0x7fab300b6120 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fab3c009890 tx=0x7fab3c008040 comp rx=0 tx=0).stop 2024-08-20T01:36:25.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.198+0000 7fab4c8ca640 1 -- 172.21.15.79:0/1199249491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab48103150 msgr2=0x7fab4819fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:25.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.198+0000 7fab4c8ca640 1 --2- 172.21.15.79:0/1199249491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab48103150 0x7fab4819fda0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fab400097b0 tx=0x7fab40003ce0 comp rx=0 tx=0).stop 2024-08-20T01:36:25.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.198+0000 7fab4c8ca640 1 -- 172.21.15.79:0/1199249491 shutdown_connections 2024-08-20T01:36:25.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.198+0000 7fab4c8ca640 1 --2- 172.21.15.79:0/1199249491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab48103150 0x7fab4819fda0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:25.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.198+0000 7fab4c8ca640 1 --2- 172.21.15.79:0/1199249491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab48102790 0x7fab4819d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:25.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.198+0000 7fab4c8ca640 1 --2- 172.21.15.79:0/1199249491 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fab300b3c60 0x7fab300b6120 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:25.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.198+0000 7fab4c8ca640 1 --2- 172.21.15.79:0/1199249491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab48101630 0x7fab4806bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:25.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.198+0000 7fab4c8ca640 1 -- 172.21.15.79:0/1199249491 >> 172.21.15.79:0/1199249491 conn(0x7fab480fcf00 msgr2=0x7fab48103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:25.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.198+0000 7fab4c8ca640 1 -- 172.21.15.79:0/1199249491 shutdown_connections 2024-08-20T01:36:25.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:25.198+0000 7fab4c8ca640 1 -- 172.21.15.79:0/1199249491 wait complete. 2024-08-20T01:36:25.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:25 smithi175 ceph-mon[22392]: from='client.15189 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:36:25.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:25 smithi081 ceph-mon[22209]: from='client.15189 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:36:25.913 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- bash -c 'ceph orch device ls' 2024-08-20T01:36:26.160 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:36:26.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:26 smithi079 ceph-mon[18656]: pgmap v320: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-20T01:36:26.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:26 smithi079 ceph-mon[18656]: mgrmap e18: x(active, since 8m), standbys: y, z 2024-08-20T01:36:26.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:26 smithi079 ceph-mon[18656]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:36:26.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:26 smithi175 ceph-mon[22392]: pgmap v320: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-20T01:36:26.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:26 smithi175 ceph-mon[22392]: mgrmap e18: x(active, since 8m), standbys: y, z 2024-08-20T01:36:26.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:26 smithi175 ceph-mon[22392]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:36:26.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:26 smithi081 ceph-mon[22209]: pgmap v320: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-20T01:36:26.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:26 smithi081 ceph-mon[22209]: mgrmap e18: x(active, since 8m), standbys: y, z 2024-08-20T01:36:26.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:26 smithi081 ceph-mon[22209]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:36:26.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.685+0000 7f535fb3e640 1 -- 172.21.15.79:0/2206815661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5358102740 msgr2=0x7f5358102b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:26.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.685+0000 7f535fb3e640 1 --2- 172.21.15.79:0/2206815661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5358102740 0x7f5358102b40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5354009930 tx=0x7f535402a420 comp rx=0 tx=0).stop 2024-08-20T01:36:26.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.685+0000 7f535fb3e640 1 -- 172.21.15.79:0/2206815661 shutdown_connections 2024-08-20T01:36:26.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.685+0000 7f535fb3e640 1 --2- 172.21.15.79:0/2206815661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5358104260 0x7f535810abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:26.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.685+0000 7f535fb3e640 1 --2- 172.21.15.79:0/2206815661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53581038a0 0x7f5358103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:26.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.685+0000 7f535fb3e640 1 --2- 172.21.15.79:0/2206815661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5358102740 0x7f5358102b40 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:26.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.685+0000 7f535fb3e640 1 -- 172.21.15.79:0/2206815661 >> 172.21.15.79:0/2206815661 conn(0x7f53580fdff0 msgr2=0x7f5358100450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:26.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.685+0000 7f535fb3e640 1 -- 172.21.15.79:0/2206815661 shutdown_connections 2024-08-20T01:36:26.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.685+0000 7f535fb3e640 1 -- 172.21.15.79:0/2206815661 wait complete. 2024-08-20T01:36:26.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.686+0000 7f535fb3e640 1 Processor -- start 2024-08-20T01:36:26.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.686+0000 7f535fb3e640 1 -- start start 2024-08-20T01:36:26.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.686+0000 7f535fb3e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5358102740 0x7f5358198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:26.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.686+0000 7f535fb3e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53581038a0 0x7f53581991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:26.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.686+0000 7f535fb3e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5358104260 0x7f5358199e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:26.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.686+0000 7f535fb3e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f535810e350 con 0x7f53581038a0 2024-08-20T01:36:26.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.686+0000 7f535fb3e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f535810e1d0 con 0x7f5358102740 2024-08-20T01:36:26.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.686+0000 7f535fb3e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f535810e4d0 con 0x7f5358104260 2024-08-20T01:36:26.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.686+0000 7f535d0d9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53581038a0 0x7f53581991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:26.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.686+0000 7f535d0d9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53581038a0 0x7f53581991d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35866/0 (socket says 172.21.15.79:35866) 2024-08-20T01:36:26.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.686+0000 7f535d0d9640 1 -- 172.21.15.79:0/2669948550 learned_addr learned my addr 172.21.15.79:0/2669948550 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:26.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.686+0000 7f535d8da640 1 --2- 172.21.15.79:0/2669948550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5358102740 0x7f5358198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:26.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.686+0000 7f535e0db640 1 --2- 172.21.15.79:0/2669948550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5358104260 0x7f5358199e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:26.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.687+0000 7f535d0d9640 1 -- 172.21.15.79:0/2669948550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5358104260 msgr2=0x7f5358199e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.687+0000 7f535d0d9640 1 --2- 172.21.15.79:0/2669948550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5358104260 0x7f5358199e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.687+0000 7f535d0d9640 1 -- 172.21.15.79:0/2669948550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5358102740 msgr2=0x7f5358198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.687+0000 7f535d0d9640 1 --2- 172.21.15.79:0/2669948550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5358102740 0x7f5358198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.687+0000 7f535d0d9640 1 -- 172.21.15.79:0/2669948550 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f535819a6b0 con 0x7f53581038a0 2024-08-20T01:36:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.687+0000 7f535e0db640 1 --2- 172.21.15.79:0/2669948550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5358104260 0x7f5358199e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:36:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.687+0000 7f535d0d9640 1 --2- 172.21.15.79:0/2669948550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53581038a0 0x7f53581991d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f534800b4a0 tx=0x7f534800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.687+0000 7f534effd640 1 -- 172.21.15.79:0/2669948550 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5348014070 con 0x7f53581038a0 2024-08-20T01:36:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.687+0000 7f534effd640 1 -- 172.21.15.79:0/2669948550 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5348010aa0 con 0x7f53581038a0 2024-08-20T01:36:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.687+0000 7f535fb3e640 1 -- 172.21.15.79:0/2669948550 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f535819a9a0 con 0x7f53581038a0 2024-08-20T01:36:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.687+0000 7f534effd640 1 -- 172.21.15.79:0/2669948550 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5348017b70 con 0x7f53581038a0 2024-08-20T01:36:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.687+0000 7f535fb3e640 1 -- 172.21.15.79:0/2669948550 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53581a1080 con 0x7f53581038a0 2024-08-20T01:36:26.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.688+0000 7f535fb3e640 1 -- 172.21.15.79:0/2669948550 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5358109b90 con 0x7f53581038a0 2024-08-20T01:36:26.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.690+0000 7f534effd640 1 -- 172.21.15.79:0/2669948550 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5348017070 con 0x7f53581038a0 2024-08-20T01:36:26.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.691+0000 7f534effd640 1 --2- 172.21.15.79:0/2669948550 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f53440b3c50 0x7f53440b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:26.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.691+0000 7f535d8da640 1 --2- 172.21.15.79:0/2669948550 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f53440b3c50 0x7f53440b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:26.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.691+0000 7f534effd640 1 -- 172.21.15.79:0/2669948550 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f53480e2f70 con 0x7f53581038a0 2024-08-20T01:36:26.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.692+0000 7f535d8da640 1 --2- 172.21.15.79:0/2669948550 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f53440b3c50 0x7f53440b6110 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5354009900 tx=0x7f5354005720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:26.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.694+0000 7f534effd640 1 -- 172.21.15.79:0/2669948550 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f53480aa5d0 con 0x7f53581038a0 2024-08-20T01:36:26.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.876+0000 7f535fb3e640 1 -- 172.21.15.79:0/2669948550 --> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f53580632c0 con 0x7f53440b3c50 2024-08-20T01:36:26.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.878+0000 7f534effd640 1 -- 172.21.15.79:0/2669948550 <== mgr.14150 v2:172.21.15.79:6800/3038112779 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f53580632c0 con 0x7f53440b3c50 2024-08-20T01:36:26.879 INFO:teuthology.orchestra.run.smithi079.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-08-20T01:36:26.880 INFO:teuthology.orchestra.run.smithi079.stdout:smithi079 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204013G400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-08-20T01:36:26.880 INFO:teuthology.orchestra.run.smithi079.stdout:smithi081 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400N7400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-08-20T01:36:26.880 INFO:teuthology.orchestra.run.smithi079.stdout:smithi175 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300M0400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-08-20T01:36:26.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.880+0000 7f535fb3e640 1 -- 172.21.15.79:0/2669948550 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f53440b3c50 msgr2=0x7f53440b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:26.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.880+0000 7f535fb3e640 1 --2- 172.21.15.79:0/2669948550 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f53440b3c50 0x7f53440b6110 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5354009900 tx=0x7f5354005720 comp rx=0 tx=0).stop 2024-08-20T01:36:26.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.880+0000 7f535fb3e640 1 -- 172.21.15.79:0/2669948550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53581038a0 msgr2=0x7f53581991d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:26.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.880+0000 7f535fb3e640 1 --2- 172.21.15.79:0/2669948550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53581038a0 0x7f53581991d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f534800b4a0 tx=0x7f534800b960 comp rx=0 tx=0).stop 2024-08-20T01:36:26.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.880+0000 7f535fb3e640 1 -- 172.21.15.79:0/2669948550 shutdown_connections 2024-08-20T01:36:26.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.880+0000 7f535fb3e640 1 --2- 172.21.15.79:0/2669948550 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f53440b3c50 0x7f53440b6110 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:26.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.880+0000 7f535fb3e640 1 --2- 172.21.15.79:0/2669948550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5358104260 0x7f5358199e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:26.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.880+0000 7f535fb3e640 1 --2- 172.21.15.79:0/2669948550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53581038a0 0x7f53581991d0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:26.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.880+0000 7f535fb3e640 1 --2- 172.21.15.79:0/2669948550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5358102740 0x7f5358198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:26.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.880+0000 7f535fb3e640 1 -- 172.21.15.79:0/2669948550 >> 172.21.15.79:0/2669948550 conn(0x7f53580fdff0 msgr2=0x7f5358106d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:26.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.880+0000 7f535fb3e640 1 -- 172.21.15.79:0/2669948550 shutdown_connections 2024-08-20T01:36:26.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:26.880+0000 7f535fb3e640 1 -- 172.21.15.79:0/2669948550 wait complete. 2024-08-20T01:36:27.486 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-20T01:36:27.498 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi079.front.sepia.ceph.com 2024-08-20T01:36:27.498 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- bash -c 'ceph fs dump' 2024-08-20T01:36:27.741 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:36:28.153 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:28 smithi079 ceph-mon[18656]: pgmap v321: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-20T01:36:28.153 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:28 smithi079 ceph-mon[18656]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:36:28.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.230+0000 7f2e41df6640 1 -- 172.21.15.79:0/3898002774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e3c1058c0 msgr2=0x7f2e3c107d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:28.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.230+0000 7f2e41df6640 1 --2- 172.21.15.79:0/3898002774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e3c1058c0 0x7f2e3c107d30 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2e30009900 tx=0x7f2e3002a410 comp rx=0 tx=0).stop 2024-08-20T01:36:28.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.230+0000 7f2e41df6640 1 -- 172.21.15.79:0/3898002774 shutdown_connections 2024-08-20T01:36:28.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.230+0000 7f2e41df6640 1 --2- 172.21.15.79:0/3898002774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e3c108470 0x7f2e3c10a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:28.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.230+0000 7f2e41df6640 1 --2- 172.21.15.79:0/3898002774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e3c1058c0 0x7f2e3c107d30 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:28.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.230+0000 7f2e41df6640 1 --2- 172.21.15.79:0/3898002774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e3c06bdc0 0x7f2e3c105330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:28.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.230+0000 7f2e41df6640 1 -- 172.21.15.79:0/3898002774 >> 172.21.15.79:0/3898002774 conn(0x7f2e3c0fcf00 msgr2=0x7f2e3c0ff360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:28.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.230+0000 7f2e41df6640 1 -- 172.21.15.79:0/3898002774 shutdown_connections 2024-08-20T01:36:28.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.231+0000 7f2e41df6640 1 -- 172.21.15.79:0/3898002774 wait complete. 2024-08-20T01:36:28.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.231+0000 7f2e41df6640 1 Processor -- start 2024-08-20T01:36:28.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.231+0000 7f2e41df6640 1 -- start start 2024-08-20T01:36:28.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.231+0000 7f2e41df6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e3c06bdc0 0x7f2e3c198bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:28.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.231+0000 7f2e41df6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e3c1058c0 0x7f2e3c199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:28.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.231+0000 7f2e41df6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e3c108470 0x7f2e3c199e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:28.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.231+0000 7f2e41df6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3c10e350 con 0x7f2e3c06bdc0 2024-08-20T01:36:28.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.231+0000 7f2e41df6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3c10e1d0 con 0x7f2e3c1058c0 2024-08-20T01:36:28.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.231+0000 7f2e41df6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3c10e4d0 con 0x7f2e3c108470 2024-08-20T01:36:28.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.231+0000 7f2e3b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e3c06bdc0 0x7f2e3c198bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:28.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.232+0000 7f2e3b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e3c06bdc0 0x7f2e3c198bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35882/0 (socket says 172.21.15.79:35882) 2024-08-20T01:36:28.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.232+0000 7f2e3b7fe640 1 -- 172.21.15.79:0/3551389799 learned_addr learned my addr 172.21.15.79:0/3551389799 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:28.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.232+0000 7f2e3affd640 1 --2- 172.21.15.79:0/3551389799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e3c1058c0 0x7f2e3c199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:28.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.232+0000 7f2e3bfff640 1 --2- 172.21.15.79:0/3551389799 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e3c108470 0x7f2e3c199e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:28.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.232+0000 7f2e3b7fe640 1 -- 172.21.15.79:0/3551389799 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e3c108470 msgr2=0x7f2e3c199e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:28.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.232+0000 7f2e3b7fe640 1 --2- 172.21.15.79:0/3551389799 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e3c108470 0x7f2e3c199e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:28.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.232+0000 7f2e3b7fe640 1 -- 172.21.15.79:0/3551389799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e3c1058c0 msgr2=0x7f2e3c199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:28.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.232+0000 7f2e3b7fe640 1 --2- 172.21.15.79:0/3551389799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e3c1058c0 0x7f2e3c199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:28.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.232+0000 7f2e3b7fe640 1 -- 172.21.15.79:0/3551389799 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e3c19a720 con 0x7f2e3c06bdc0 2024-08-20T01:36:28.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.232+0000 7f2e3affd640 1 --2- 172.21.15.79:0/3551389799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e3c1058c0 0x7f2e3c199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:36:28.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.232+0000 7f2e3b7fe640 1 --2- 172.21.15.79:0/3551389799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e3c06bdc0 0x7f2e3c198bf0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c00b4a0 tx=0x7f2e2c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:28.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.232+0000 7f2e38ff9640 1 -- 172.21.15.79:0/3551389799 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c014070 con 0x7f2e3c06bdc0 2024-08-20T01:36:28.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.232+0000 7f2e41df6640 1 -- 172.21.15.79:0/3551389799 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e3c19aa10 con 0x7f2e3c06bdc0 2024-08-20T01:36:28.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.232+0000 7f2e38ff9640 1 -- 172.21.15.79:0/3551389799 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e2c010aa0 con 0x7f2e3c06bdc0 2024-08-20T01:36:28.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.232+0000 7f2e38ff9640 1 -- 172.21.15.79:0/3551389799 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c017b70 con 0x7f2e3c06bdc0 2024-08-20T01:36:28.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.232+0000 7f2e41df6640 1 -- 172.21.15.79:0/3551389799 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e3c1a10f0 con 0x7f2e3c06bdc0 2024-08-20T01:36:28.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.233+0000 7f2e41df6640 1 -- 172.21.15.79:0/3551389799 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e3c0fe9f0 con 0x7f2e3c06bdc0 2024-08-20T01:36:28.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.235+0000 7f2e38ff9640 1 -- 172.21.15.79:0/3551389799 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2e2c017070 con 0x7f2e3c06bdc0 2024-08-20T01:36:28.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.236+0000 7f2e38ff9640 1 --2- 172.21.15.79:0/3551389799 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2e240b3bd0 0x7f2e240b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:28.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.236+0000 7f2e3affd640 1 --2- 172.21.15.79:0/3551389799 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2e240b3bd0 0x7f2e240b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:28.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.236+0000 7f2e38ff9640 1 -- 172.21.15.79:0/3551389799 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f2e2c0e3360 con 0x7f2e3c06bdc0 2024-08-20T01:36:28.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.236+0000 7f2e3affd640 1 --2- 172.21.15.79:0/3551389799 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2e240b3bd0 0x7f2e240b6090 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2e30006010 tx=0x7f2e30031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:28.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.239+0000 7f2e38ff9640 1 -- 172.21.15.79:0/3551389799 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f2e2c0aa9c0 con 0x7f2e3c06bdc0 2024-08-20T01:36:28.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:28 smithi175 ceph-mon[22392]: pgmap v321: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-20T01:36:28.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:28 smithi175 ceph-mon[22392]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:36:28.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.453+0000 7f2e41df6640 1 -- 172.21.15.79:0/3551389799 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f2e3c02e340 con 0x7f2e3c06bdc0 2024-08-20T01:36:28.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.453+0000 7f2e38ff9640 1 -- 172.21.15.79:0/3551389799 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) ==== 76+0+3128 (secure 0 0 0) 0x7f2e2c0aa2c0 con 0x7f2e3c06bdc0 2024-08-20T01:36:28.455 INFO:teuthology.orchestra.run.smithi079.stdout:e27 2024-08-20T01:36:28.455 INFO:teuthology.orchestra.run.smithi079.stdout:btime 2024-08-20T01:35:06:437353+0000 2024-08-20T01:36:28.455 INFO:teuthology.orchestra.run.smithi079.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-20T01:36:28.455 INFO:teuthology.orchestra.run.smithi079.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-20T01:36:28.455 INFO:teuthology.orchestra.run.smithi079.stdout:legacy client fscid: 1 2024-08-20T01:36:28.455 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:36:28.456 INFO:teuthology.orchestra.run.smithi079.stdout:Filesystem 'cephfs' (1) 2024-08-20T01:36:28.456 INFO:teuthology.orchestra.run.smithi079.stdout:fs_name cephfs 2024-08-20T01:36:28.456 INFO:teuthology.orchestra.run.smithi079.stdout:epoch 27 2024-08-20T01:36:28.456 INFO:teuthology.orchestra.run.smithi079.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-20T01:36:28.456 INFO:teuthology.orchestra.run.smithi079.stdout:created 2024-08-20T01:34:55.133562+0000 2024-08-20T01:36:28.456 INFO:teuthology.orchestra.run.smithi079.stdout:modified 2024-08-20T01:35:06.437339+0000 2024-08-20T01:36:28.456 INFO:teuthology.orchestra.run.smithi079.stdout:tableserver 0 2024-08-20T01:36:28.456 INFO:teuthology.orchestra.run.smithi079.stdout:root 0 2024-08-20T01:36:28.456 INFO:teuthology.orchestra.run.smithi079.stdout:session_timeout 300 2024-08-20T01:36:28.456 INFO:teuthology.orchestra.run.smithi079.stdout:session_autoclose 300 2024-08-20T01:36:28.456 INFO:teuthology.orchestra.run.smithi079.stdout:max_file_size 1099511627776 2024-08-20T01:36:28.456 INFO:teuthology.orchestra.run.smithi079.stdout:max_xattr_size 65536 2024-08-20T01:36:28.456 INFO:teuthology.orchestra.run.smithi079.stdout:required_client_features {} 2024-08-20T01:36:28.457 INFO:teuthology.orchestra.run.smithi079.stdout:last_failure 0 2024-08-20T01:36:28.457 INFO:teuthology.orchestra.run.smithi079.stdout:last_failure_osd_epoch 0 2024-08-20T01:36:28.457 INFO:teuthology.orchestra.run.smithi079.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-20T01:36:28.457 INFO:teuthology.orchestra.run.smithi079.stdout:max_mds 5 2024-08-20T01:36:28.457 INFO:teuthology.orchestra.run.smithi079.stdout:in 0,1,2,3,4 2024-08-20T01:36:28.457 INFO:teuthology.orchestra.run.smithi079.stdout:up {0=24539,1=24538,2=24523,3=24514,4=24512} 2024-08-20T01:36:28.457 INFO:teuthology.orchestra.run.smithi079.stdout:failed 2024-08-20T01:36:28.457 INFO:teuthology.orchestra.run.smithi079.stdout:damaged 2024-08-20T01:36:28.457 INFO:teuthology.orchestra.run.smithi079.stdout:stopped 2024-08-20T01:36:28.457 INFO:teuthology.orchestra.run.smithi079.stdout:data_pools [3] 2024-08-20T01:36:28.457 INFO:teuthology.orchestra.run.smithi079.stdout:metadata_pool 2 2024-08-20T01:36:28.457 INFO:teuthology.orchestra.run.smithi079.stdout:inline_data disabled 2024-08-20T01:36:28.458 INFO:teuthology.orchestra.run.smithi079.stdout:balancer 2024-08-20T01:36:28.458 INFO:teuthology.orchestra.run.smithi079.stdout:bal_rank_mask -1 2024-08-20T01:36:28.458 INFO:teuthology.orchestra.run.smithi079.stdout:standby_count_wanted 0 2024-08-20T01:36:28.458 INFO:teuthology.orchestra.run.smithi079.stdout:qdb_cluster leader: 24539 members: 24539,24523,24514,24538,24512 2024-08-20T01:36:28.458 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.b{0:24539} state up:active seq 4 addr [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] compat {c=[1],r=[1],i=[1fff]}] 2024-08-20T01:36:28.458 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.l{0:24496} state up:standby-replay seq 1 addr [v2:172.21.15.175:6832/1107229215,v1:172.21.15.175:6833/1107229215] compat {c=[1],r=[1],i=[1fff]}] 2024-08-20T01:36:28.458 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.i{1:24538} state up:active seq 8 addr [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] compat {c=[1],r=[1],i=[1fff]}] 2024-08-20T01:36:28.458 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.e{1:24494} state up:standby-replay seq 1 addr [v2:172.21.15.81:6834/1499936216,v1:172.21.15.81:6835/1499936216] compat {c=[1],r=[1],i=[1fff]}] 2024-08-20T01:36:28.458 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.c{2:24523} state up:active seq 10 addr [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] compat {c=[1],r=[1],i=[1fff]}] 2024-08-20T01:36:28.458 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.k{2:24473} state up:standby-replay seq 1 addr [v2:172.21.15.81:6832/1257507005,v1:172.21.15.81:6833/1257507005] compat {c=[1],r=[1],i=[1fff]}] 2024-08-20T01:36:28.458 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.f{3:24514} state up:active seq 10 addr [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] compat {c=[1],r=[1],i=[1fff]}] 2024-08-20T01:36:28.458 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.a{3:14730} state up:standby-replay seq 1 addr [v2:172.21.15.79:6840/2448977611,v1:172.21.15.79:6841/2448977611] compat {c=[1],r=[1],i=[1fff]}] 2024-08-20T01:36:28.459 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.h{4:24512} state up:active seq 9 addr [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] compat {c=[1],r=[1],i=[1fff]}] 2024-08-20T01:36:28.459 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.g{4:14724} state up:standby-replay seq 1 addr [v2:172.21.15.79:6838/1071242274,v1:172.21.15.79:6839/1071242274] compat {c=[1],r=[1],i=[1fff]}] 2024-08-20T01:36:28.459 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:36:28.459 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:36:28.459 INFO:teuthology.orchestra.run.smithi079.stdout:Standby daemons: 2024-08-20T01:36:28.459 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:36:28.459 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.j{-1:14670} state up:standby seq 1 addr [v2:172.21.15.79:6834/735082912,v1:172.21.15.79:6835/735082912] compat {c=[1],r=[1],i=[1fff]}] 2024-08-20T01:36:28.459 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.d{-1:14682} state up:standby seq 1 addr [v2:172.21.15.79:6836/2150339873,v1:172.21.15.79:6837/2150339873] compat {c=[1],r=[1],i=[1fff]}] 2024-08-20T01:36:28.460 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 27 2024-08-20T01:36:28.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.455+0000 7f2e41df6640 1 -- 172.21.15.79:0/3551389799 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2e240b3bd0 msgr2=0x7f2e240b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:28.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.455+0000 7f2e41df6640 1 --2- 172.21.15.79:0/3551389799 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2e240b3bd0 0x7f2e240b6090 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2e30006010 tx=0x7f2e30031400 comp rx=0 tx=0).stop 2024-08-20T01:36:28.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.455+0000 7f2e41df6640 1 -- 172.21.15.79:0/3551389799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e3c06bdc0 msgr2=0x7f2e3c198bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:28.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.455+0000 7f2e41df6640 1 --2- 172.21.15.79:0/3551389799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e3c06bdc0 0x7f2e3c198bf0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c00b4a0 tx=0x7f2e2c00b960 comp rx=0 tx=0).stop 2024-08-20T01:36:28.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.455+0000 7f2e41df6640 1 -- 172.21.15.79:0/3551389799 shutdown_connections 2024-08-20T01:36:28.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.455+0000 7f2e41df6640 1 --2- 172.21.15.79:0/3551389799 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2e240b3bd0 0x7f2e240b6090 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:28.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.455+0000 7f2e41df6640 1 --2- 172.21.15.79:0/3551389799 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e3c108470 0x7f2e3c199e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:28.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.455+0000 7f2e41df6640 1 --2- 172.21.15.79:0/3551389799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e3c1058c0 0x7f2e3c199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:28.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.455+0000 7f2e41df6640 1 --2- 172.21.15.79:0/3551389799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e3c06bdc0 0x7f2e3c198bf0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:28.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.455+0000 7f2e41df6640 1 -- 172.21.15.79:0/3551389799 >> 172.21.15.79:0/3551389799 conn(0x7f2e3c0fcf00 msgr2=0x7f2e3c103d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:28.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.455+0000 7f2e41df6640 1 -- 172.21.15.79:0/3551389799 shutdown_connections 2024-08-20T01:36:28.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:28.455+0000 7f2e41df6640 1 -- 172.21.15.79:0/3551389799 wait complete. 2024-08-20T01:36:28.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:28 smithi081 ceph-mon[22209]: pgmap v321: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-20T01:36:28.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:28 smithi081 ceph-mon[22209]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T01:36:29.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:29 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/3551389799' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-20T01:36:29.226 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- bash -c 'ceph osd dump' 2024-08-20T01:36:29.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:29 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/3551389799' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-20T01:36:29.469 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:36:29.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:29 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/3551389799' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-20T01:36:29.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:29.922+0000 7fe57b725640 1 -- 172.21.15.79:0/3525210202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe574101650 msgr2=0x7fe574101a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:29.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:29.922+0000 7fe57b725640 1 --2- 172.21.15.79:0/3525210202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe574101650 0x7fe574101a50 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe568009930 tx=0x7fe56802a420 comp rx=0 tx=0).stop 2024-08-20T01:36:29.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:29.922+0000 7fe57b725640 1 -- 172.21.15.79:0/3525210202 shutdown_connections 2024-08-20T01:36:29.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:29.922+0000 7fe57b725640 1 --2- 172.21.15.79:0/3525210202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe574103170 0x7fe574109af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:29.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:29.922+0000 7fe57b725640 1 --2- 172.21.15.79:0/3525210202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5741027b0 0x7fe574102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:29.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:29.922+0000 7fe57b725640 1 --2- 172.21.15.79:0/3525210202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe574101650 0x7fe574101a50 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:29.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:29.922+0000 7fe57b725640 1 -- 172.21.15.79:0/3525210202 >> 172.21.15.79:0/3525210202 conn(0x7fe5740fcf00 msgr2=0x7fe5740ff360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:29.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:29.922+0000 7fe57b725640 1 -- 172.21.15.79:0/3525210202 shutdown_connections 2024-08-20T01:36:29.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:29.922+0000 7fe57b725640 1 -- 172.21.15.79:0/3525210202 wait complete. 2024-08-20T01:36:29.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:29.922+0000 7fe57b725640 1 Processor -- start 2024-08-20T01:36:29.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:29.922+0000 7fe57b725640 1 -- start start 2024-08-20T01:36:29.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:29.923+0000 7fe57b725640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe574101650 0x7fe574197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:29.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:29.923+0000 7fe57b725640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5741027b0 0x7fe574198150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:29.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:29.923+0000 7fe57b725640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe574103170 0x7fe574198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:29.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:29.923+0000 7fe57b725640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe57410d260 con 0x7fe574103170 2024-08-20T01:36:29.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:29.923+0000 7fe57b725640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe57410d0e0 con 0x7fe5741027b0 2024-08-20T01:36:29.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:29.923+0000 7fe57b725640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe57410d3e0 con 0x7fe574101650 2024-08-20T01:36:29.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:29.923+0000 7fe579cc2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe574103170 0x7fe574198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:29.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:29.923+0000 7fe579cc2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe574103170 0x7fe574198d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35894/0 (socket says 172.21.15.79:35894) 2024-08-20T01:36:29.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:29.923+0000 7fe579cc2640 1 -- 172.21.15.79:0/3049779613 learned_addr learned my addr 172.21.15.79:0/3049779613 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:29.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:29.923+0000 7fe5794c1640 1 --2- 172.21.15.79:0/3049779613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe574101650 0x7fe574197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:29.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:29.923+0000 7fe578cc0640 1 --2- 172.21.15.79:0/3049779613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5741027b0 0x7fe574198150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:29.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:29.923+0000 7fe579cc2640 1 -- 172.21.15.79:0/3049779613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe574101650 msgr2=0x7fe574197b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:29.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:29.923+0000 7fe579cc2640 1 --2- 172.21.15.79:0/3049779613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe574101650 0x7fe574197b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:29.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:29.923+0000 7fe579cc2640 1 -- 172.21.15.79:0/3049779613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5741027b0 msgr2=0x7fe574198150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:29.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:29.923+0000 7fe579cc2640 1 --2- 172.21.15.79:0/3049779613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5741027b0 0x7fe574198150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:29.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:29.923+0000 7fe579cc2640 1 -- 172.21.15.79:0/3049779613 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe574199630 con 0x7fe574103170 2024-08-20T01:36:29.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:29.923+0000 7fe578cc0640 1 --2- 172.21.15.79:0/3049779613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5741027b0 0x7fe574198150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:36:29.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:29.923+0000 7fe579cc2640 1 --2- 172.21.15.79:0/3049779613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe574103170 0x7fe574198d90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe56c00db90 tx=0x7fe56c00dc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:29.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:29.923+0000 7fe5667fc640 1 -- 172.21.15.79:0/3049779613 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe56c00e980 con 0x7fe574103170 2024-08-20T01:36:29.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:29.923+0000 7fe5667fc640 1 -- 172.21.15.79:0/3049779613 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe56c009580 con 0x7fe574103170 2024-08-20T01:36:29.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:29.923+0000 7fe57b725640 1 -- 172.21.15.79:0/3049779613 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5741998c0 con 0x7fe574103170 2024-08-20T01:36:29.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:29.923+0000 7fe5667fc640 1 -- 172.21.15.79:0/3049779613 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe56c016650 con 0x7fe574103170 2024-08-20T01:36:29.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:29.924+0000 7fe57b725640 1 -- 172.21.15.79:0/3049779613 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe57406b3e0 con 0x7fe574103170 2024-08-20T01:36:29.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:29.925+0000 7fe57b725640 1 -- 172.21.15.79:0/3049779613 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe574101ad0 con 0x7fe574103170 2024-08-20T01:36:29.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:29.927+0000 7fe5667fc640 1 -- 172.21.15.79:0/3049779613 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fe56c00eb20 con 0x7fe574103170 2024-08-20T01:36:29.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:29.927+0000 7fe5667fc640 1 --2- 172.21.15.79:0/3049779613 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe5600b3c50 0x7fe5600b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:29.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:29.927+0000 7fe5794c1640 1 --2- 172.21.15.79:0/3049779613 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe5600b3c50 0x7fe5600b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:29.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:29.928+0000 7fe5667fc640 1 -- 172.21.15.79:0/3049779613 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fe56c0e5490 con 0x7fe574103170 2024-08-20T01:36:29.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:29.928+0000 7fe5794c1640 1 --2- 172.21.15.79:0/3049779613 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe5600b3c50 0x7fe5600b6110 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe568009900 tx=0x7fe568005720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:29.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:29.930+0000 7fe5667fc640 1 -- 172.21.15.79:0/3049779613 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fe56c0acaf0 con 0x7fe574103170 2024-08-20T01:36:30.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:30.108+0000 7fe57b725640 1 -- 172.21.15.79:0/3049779613 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fe57406c030 con 0x7fe574103170 2024-08-20T01:36:30.110 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:30 smithi079 ceph-mon[18656]: pgmap v322: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-20T01:36:30.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:30.109+0000 7fe5667fc640 1 -- 172.21.15.79:0/3049779613 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v74) ==== 56+0+5267 (secure 0 0 0) 0x7fe56c0ac3f0 con 0x7fe574103170 2024-08-20T01:36:30.111 INFO:teuthology.orchestra.run.smithi079.stdout:epoch 74 2024-08-20T01:36:30.111 INFO:teuthology.orchestra.run.smithi079.stdout:fsid 28484e9a-5e93-11ef-bccf-c7b262605968 2024-08-20T01:36:30.111 INFO:teuthology.orchestra.run.smithi079.stdout:created 2024-08-20T01:27:07.792689+0000 2024-08-20T01:36:30.111 INFO:teuthology.orchestra.run.smithi079.stdout:modified 2024-08-20T01:35:53.774800+0000 2024-08-20T01:36:30.111 INFO:teuthology.orchestra.run.smithi079.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-08-20T01:36:30.111 INFO:teuthology.orchestra.run.smithi079.stdout:crush_version 26 2024-08-20T01:36:30.111 INFO:teuthology.orchestra.run.smithi079.stdout:full_ratio 0.95 2024-08-20T01:36:30.111 INFO:teuthology.orchestra.run.smithi079.stdout:backfillfull_ratio 0.9 2024-08-20T01:36:30.111 INFO:teuthology.orchestra.run.smithi079.stdout:nearfull_ratio 0.85 2024-08-20T01:36:30.111 INFO:teuthology.orchestra.run.smithi079.stdout:require_min_compat_client luminous 2024-08-20T01:36:30.111 INFO:teuthology.orchestra.run.smithi079.stdout:min_compat_client luminous 2024-08-20T01:36:30.112 INFO:teuthology.orchestra.run.smithi079.stdout:require_osd_release squid 2024-08-20T01:36:30.112 INFO:teuthology.orchestra.run.smithi079.stdout:stretch_mode_enabled false 2024-08-20T01:36:30.112 INFO:teuthology.orchestra.run.smithi079.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 20 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-08-20T01:36:30.112 INFO:teuthology.orchestra.run.smithi079.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 72 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-08-20T01:36:30.112 INFO:teuthology.orchestra.run.smithi079.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 72 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-08-20T01:36:30.112 INFO:teuthology.orchestra.run.smithi079.stdout:max_osd 12 2024-08-20T01:36:30.112 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0 up in weight 1 up_from 8 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6802/1274927648,v1:172.21.15.79:6803/1274927648] [v2:172.21.15.79:6804/1274927648,v1:172.21.15.79:6805/1274927648] exists,up ccdbeb3d-bb9d-4275-ad7e-49f2cc1222cc 2024-08-20T01:36:30.112 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1 up in weight 1 up_from 13 up_thru 70 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6800/1174012328,v1:172.21.15.81:6801/1174012328] [v2:172.21.15.81:6802/1174012328,v1:172.21.15.81:6803/1174012328] exists,up 0906bc46-f89d-482d-9402-43d17e4246a4 2024-08-20T01:36:30.112 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2 up in weight 1 up_from 17 up_thru 70 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6800/1132306232,v1:172.21.15.175:6801/1132306232] [v2:172.21.15.175:6802/1132306232,v1:172.21.15.175:6803/1132306232] exists,up 11d8fb9d-cb2c-41c8-994c-603a1d8e01a1 2024-08-20T01:36:30.112 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3 up in weight 1 up_from 23 up_thru 70 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6810/1364181822,v1:172.21.15.79:6811/1364181822] [v2:172.21.15.79:6812/1364181822,v1:172.21.15.79:6813/1364181822] exists,up 29e35242-957f-404b-b99e-d4dd0045c35d 2024-08-20T01:36:30.112 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4 up in weight 1 up_from 28 up_thru 70 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6808/306873968,v1:172.21.15.81:6809/306873968] [v2:172.21.15.81:6810/306873968,v1:172.21.15.81:6811/306873968] exists,up 9139c469-270f-4465-8adb-1e748529fa68 2024-08-20T01:36:30.112 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5 up in weight 1 up_from 34 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6808/3908133424,v1:172.21.15.175:6809/3908133424] [v2:172.21.15.175:6810/3908133424,v1:172.21.15.175:6811/3908133424] exists,up 6394e462-4510-45d6-bc99-8660085cb206 2024-08-20T01:36:30.113 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6 up in weight 1 up_from 39 up_thru 70 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6818/3379368280,v1:172.21.15.79:6819/3379368280] [v2:172.21.15.79:6820/3379368280,v1:172.21.15.79:6821/3379368280] exists,up e8e51380-e2be-4c4c-82d8-d86306d9fc1f 2024-08-20T01:36:30.113 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7 up in weight 1 up_from 44 up_thru 70 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6816/747356685,v1:172.21.15.81:6817/747356685] [v2:172.21.15.81:6818/747356685,v1:172.21.15.81:6819/747356685] exists,up 875f7876-a2ca-4254-a8cc-27eebb11cf23 2024-08-20T01:36:30.113 INFO:teuthology.orchestra.run.smithi079.stdout:osd.8 up in weight 1 up_from 50 up_thru 70 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6816/1537762925,v1:172.21.15.175:6817/1537762925] [v2:172.21.15.175:6818/1537762925,v1:172.21.15.175:6819/1537762925] exists,up d714a33b-8df5-411d-bc99-b33b4b27cc66 2024-08-20T01:36:30.113 INFO:teuthology.orchestra.run.smithi079.stdout:osd.9 up in weight 1 up_from 55 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6826/2400574113,v1:172.21.15.79:6827/2400574113] [v2:172.21.15.79:6828/2400574113,v1:172.21.15.79:6829/2400574113] exists,up 82db8305-1d72-4bef-99d6-5486e4de5b03 2024-08-20T01:36:30.113 INFO:teuthology.orchestra.run.smithi079.stdout:osd.10 up in weight 1 up_from 61 up_thru 70 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6824/4188407500,v1:172.21.15.81:6825/4188407500] [v2:172.21.15.81:6826/4188407500,v1:172.21.15.81:6827/4188407500] exists,up 797e1e3f-12b5-4958-9e1f-f796cffaaf34 2024-08-20T01:36:30.113 INFO:teuthology.orchestra.run.smithi079.stdout:osd.11 up in weight 1 up_from 66 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6824/451069549,v1:172.21.15.175:6825/451069549] [v2:172.21.15.175:6826/451069549,v1:172.21.15.175:6827/451069549] exists,up a4d218ae-5a41-4b34-9c4e-e795c4a6a16d 2024-08-20T01:36:30.113 INFO:teuthology.orchestra.run.smithi079.stdout:pg_upmap_items 2.4 [2,11] 2024-08-20T01:36:30.113 INFO:teuthology.orchestra.run.smithi079.stdout:pg_upmap_items 2.5 [8,11] 2024-08-20T01:36:30.113 INFO:teuthology.orchestra.run.smithi079.stdout:pg_upmap_items 3.6 [3,7] 2024-08-20T01:36:30.113 INFO:teuthology.orchestra.run.smithi079.stdout:pg_upmap_items 3.11 [5,9] 2024-08-20T01:36:30.113 INFO:teuthology.orchestra.run.smithi079.stdout:pg_upmap_items 3.1d [4,6] 2024-08-20T01:36:30.113 INFO:teuthology.orchestra.run.smithi079.stdout:pg_upmap_items 3.23 [4,8] 2024-08-20T01:36:30.114 INFO:teuthology.orchestra.run.smithi079.stdout:pg_upmap_items 3.2c [4,9] 2024-08-20T01:36:30.114 INFO:teuthology.orchestra.run.smithi079.stdout:pg_upmap_items 3.38 [3,9] 2024-08-20T01:36:30.114 INFO:teuthology.orchestra.run.smithi079.stdout:blocklist 172.21.15.79:0/1750500064 expires 2024-08-21T01:27:52.389553+0000 2024-08-20T01:36:30.114 INFO:teuthology.orchestra.run.smithi079.stdout:blocklist 172.21.15.79:0/103962305 expires 2024-08-21T01:27:52.389553+0000 2024-08-20T01:36:30.114 INFO:teuthology.orchestra.run.smithi079.stdout:blocklist 172.21.15.79:6800/4045769179 expires 2024-08-21T01:27:29.643647+0000 2024-08-20T01:36:30.114 INFO:teuthology.orchestra.run.smithi079.stdout:blocklist 172.21.15.79:0/525482354 expires 2024-08-21T01:27:52.389553+0000 2024-08-20T01:36:30.114 INFO:teuthology.orchestra.run.smithi079.stdout:blocklist 172.21.15.79:6801/4045769179 expires 2024-08-21T01:27:29.643647+0000 2024-08-20T01:36:30.114 INFO:teuthology.orchestra.run.smithi079.stdout:blocklist 172.21.15.79:0/1023212241 expires 2024-08-21T01:27:29.643647+0000 2024-08-20T01:36:30.114 INFO:teuthology.orchestra.run.smithi079.stdout:blocklist 172.21.15.79:0/2368377219 expires 2024-08-21T01:27:29.643647+0000 2024-08-20T01:36:30.114 INFO:teuthology.orchestra.run.smithi079.stdout:blocklist 172.21.15.79:6801/3302536522 expires 2024-08-21T01:27:52.389553+0000 2024-08-20T01:36:30.115 INFO:teuthology.orchestra.run.smithi079.stdout:blocklist 172.21.15.79:6800/3302536522 expires 2024-08-21T01:27:52.389553+0000 2024-08-20T01:36:30.115 INFO:teuthology.orchestra.run.smithi079.stdout:blocklist 172.21.15.79:0/3498829332 expires 2024-08-21T01:27:29.643647+0000 2024-08-20T01:36:30.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:30.111+0000 7fe57b725640 1 -- 172.21.15.79:0/3049779613 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe5600b3c50 msgr2=0x7fe5600b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:30.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:30.111+0000 7fe57b725640 1 --2- 172.21.15.79:0/3049779613 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe5600b3c50 0x7fe5600b6110 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe568009900 tx=0x7fe568005720 comp rx=0 tx=0).stop 2024-08-20T01:36:30.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:30.111+0000 7fe57b725640 1 -- 172.21.15.79:0/3049779613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe574103170 msgr2=0x7fe574198d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:30.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:30.111+0000 7fe57b725640 1 --2- 172.21.15.79:0/3049779613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe574103170 0x7fe574198d90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe56c00db90 tx=0x7fe56c00dc80 comp rx=0 tx=0).stop 2024-08-20T01:36:30.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:30.111+0000 7fe57b725640 1 -- 172.21.15.79:0/3049779613 shutdown_connections 2024-08-20T01:36:30.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:30.111+0000 7fe57b725640 1 --2- 172.21.15.79:0/3049779613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe574103170 0x7fe574198d90 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:30.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:30.111+0000 7fe57b725640 1 --2- 172.21.15.79:0/3049779613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5741027b0 0x7fe574198150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:30.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:30.111+0000 7fe57b725640 1 --2- 172.21.15.79:0/3049779613 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe5600b3c50 0x7fe5600b6110 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:30.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:30.111+0000 7fe57b725640 1 --2- 172.21.15.79:0/3049779613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe574101650 0x7fe574197b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:30.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:30.111+0000 7fe57b725640 1 -- 172.21.15.79:0/3049779613 >> 172.21.15.79:0/3049779613 conn(0x7fe5740fcf00 msgr2=0x7fe574105c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:30.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:30.111+0000 7fe57b725640 1 -- 172.21.15.79:0/3049779613 shutdown_connections 2024-08-20T01:36:30.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:30.111+0000 7fe57b725640 1 -- 172.21.15.79:0/3049779613 wait complete. 2024-08-20T01:36:30.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:30 smithi175 ceph-mon[22392]: pgmap v322: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-20T01:36:30.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:30 smithi081 ceph-mon[22209]: pgmap v322: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-20T01:36:30.776 INFO:teuthology.run_tasks:Running task fs.ready... 2024-08-20T01:36:30.809 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:36:31.052 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:36:31.321 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:31 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/3049779613' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-08-20T01:36:31.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:31 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/3049779613' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-08-20T01:36:31.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.512+0000 7f53d57de640 1 -- 172.21.15.79:0/3683902714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53d010ce40 msgr2=0x7f53d010f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:31.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.512+0000 7f53d57de640 1 --2- 172.21.15.79:0/3683902714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53d010ce40 0x7f53d010f270 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f53c8009ca0 tx=0x7f53c802a8c0 comp rx=0 tx=0).stop 2024-08-20T01:36:31.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.512+0000 7f53d57de640 1 -- 172.21.15.79:0/3683902714 shutdown_connections 2024-08-20T01:36:31.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.512+0000 7f53d57de640 1 --2- 172.21.15.79:0/3683902714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53d010ce40 0x7f53d010f270 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:31.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.512+0000 7f53d57de640 1 --2- 172.21.15.79:0/3683902714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53d0104290 0x7f53d010c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:31.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.512+0000 7f53d57de640 1 --2- 172.21.15.79:0/3683902714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53d0103890 0x7f53d0103c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:31.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.512+0000 7f53d57de640 1 -- 172.21.15.79:0/3683902714 >> 172.21.15.79:0/3683902714 conn(0x7f53d00fd420 msgr2=0x7f53d00ff840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:31.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.512+0000 7f53d57de640 1 -- 172.21.15.79:0/3683902714 shutdown_connections 2024-08-20T01:36:31.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.512+0000 7f53d57de640 1 -- 172.21.15.79:0/3683902714 wait complete. 2024-08-20T01:36:31.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.513+0000 7f53d57de640 1 Processor -- start 2024-08-20T01:36:31.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.513+0000 7f53d57de640 1 -- start start 2024-08-20T01:36:31.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.513+0000 7f53d57de640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53d0103890 0x7f53d0198f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:31.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.513+0000 7f53d57de640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53d0104290 0x7f53d0199490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:31.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.513+0000 7f53d57de640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53d010ce40 0x7f53d019e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:31.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.513+0000 7f53d57de640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f53d0112a40 con 0x7f53d010ce40 2024-08-20T01:36:31.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.513+0000 7f53d57de640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f53d01128c0 con 0x7f53d0104290 2024-08-20T01:36:31.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.513+0000 7f53d57de640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f53d0112bc0 con 0x7f53d0103890 2024-08-20T01:36:31.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.513+0000 7f53cf7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53d010ce40 0x7f53d019e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:31.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.513+0000 7f53cf7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53d010ce40 0x7f53d019e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46324/0 (socket says 172.21.15.79:46324) 2024-08-20T01:36:31.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.513+0000 7f53cf7fe640 1 -- 172.21.15.79:0/1794155585 learned_addr learned my addr 172.21.15.79:0/1794155585 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:31.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.514+0000 7f53c7fff640 1 --2- 172.21.15.79:0/1794155585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53d0104290 0x7f53d0199490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:31.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.514+0000 7f53cf7fe640 1 -- 172.21.15.79:0/1794155585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53d0103890 msgr2=0x7f53d0198f50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-20T01:36:31.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.514+0000 7f53cf7fe640 1 --2- 172.21.15.79:0/1794155585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53d0103890 0x7f53d0198f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:31.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.514+0000 7f53cf7fe640 1 -- 172.21.15.79:0/1794155585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53d0104290 msgr2=0x7f53d0199490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:31.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.514+0000 7f53cf7fe640 1 --2- 172.21.15.79:0/1794155585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53d0104290 0x7f53d0199490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:31.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.514+0000 7f53cf7fe640 1 -- 172.21.15.79:0/1794155585 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d019f000 con 0x7f53d010ce40 2024-08-20T01:36:31.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.514+0000 7f53cf7fe640 1 --2- 172.21.15.79:0/1794155585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53d010ce40 0x7f53d019e830 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f53c8005cc0 tx=0x7f53c8032c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:31.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.514+0000 7f53ccff9640 1 -- 172.21.15.79:0/1794155585 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c8004040 con 0x7f53d010ce40 2024-08-20T01:36:31.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.514+0000 7f53d57de640 1 -- 172.21.15.79:0/1794155585 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53d019f290 con 0x7f53d010ce40 2024-08-20T01:36:31.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.514+0000 7f53ccff9640 1 -- 172.21.15.79:0/1794155585 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f53c8004670 con 0x7f53d010ce40 2024-08-20T01:36:31.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.514+0000 7f53ccff9640 1 -- 172.21.15.79:0/1794155585 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c8030cc0 con 0x7f53d010ce40 2024-08-20T01:36:31.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.514+0000 7f53d57de640 1 -- 172.21.15.79:0/1794155585 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53d01a5a30 con 0x7f53d010ce40 2024-08-20T01:36:31.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.515+0000 7f53d57de640 1 -- 172.21.15.79:0/1794155585 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53d0103c70 con 0x7f53d010ce40 2024-08-20T01:36:31.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.516+0000 7f53ccff9640 1 -- 172.21.15.79:0/1794155585 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f53c80041e0 con 0x7f53d010ce40 2024-08-20T01:36:31.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.517+0000 7f53ccff9640 1 --2- 172.21.15.79:0/1794155585 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f53bc0b3bd0 0x7f53bc0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:31.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.517+0000 7f53ceffd640 1 --2- 172.21.15.79:0/1794155585 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f53bc0b3bd0 0x7f53bc0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:31.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.517+0000 7f53ccff9640 1 -- 172.21.15.79:0/1794155585 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f53c81055a0 con 0x7f53d010ce40 2024-08-20T01:36:31.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.518+0000 7f53ceffd640 1 --2- 172.21.15.79:0/1794155585 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f53bc0b3bd0 0x7f53bc0b6090 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f53c00096b0 tx=0x7f53c0006c20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:31.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.520+0000 7f53ccff9640 1 -- 172.21.15.79:0/1794155585 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f53c80ccba0 con 0x7f53d010ce40 2024-08-20T01:36:31.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:31 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/3049779613' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-08-20T01:36:31.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.730+0000 7f53d57de640 1 -- 172.21.15.79:0/1794155585 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f53d0107ee0 con 0x7f53d010ce40 2024-08-20T01:36:31.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.731+0000 7f53ccff9640 1 -- 172.21.15.79:0/1794155585 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11973 (secure 0 0 0) 0x7f53c80d3e20 con 0x7f53d010ce40 2024-08-20T01:36:31.733 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:36:31.733 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":27,"btime":"2024-08-20T01:35:06:437353+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14670,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/735082912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":735082912},{"type":"v1","addr":"172.21.15.79:6835","nonce":735082912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2150339873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2150339873},{"type":"v1","addr":"172.21.15.79:6837","nonce":2150339873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:34:55.133562+0000","modified":"2024-08-20T01:35:06.437339+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24539,"mds_1":24538,"mds_2":24523,"mds_3":24514,"mds_4":24512},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14724":{"gid":14724,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/1071242274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1071242274},{"type":"v1","addr":"172.21.15.79:6839","nonce":1071242274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14730":{"gid":14730,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6841/2448977611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":2448977611},{"type":"v1","addr":"172.21.15.79:6841","nonce":2448977611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/1257507005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1257507005},{"type":"v1","addr":"172.21.15.81:6833","nonce":1257507005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1499936216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1499936216},{"type":"v1","addr":"172.21.15.81:6835","nonce":1499936216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/1107229215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1107229215},{"type":"v1","addr":"172.21.15.175:6833","nonce":1107229215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6837/2073598870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2073598870},{"type":"v1","addr":"172.21.15.81:6837","nonce":2073598870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/2552601173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2552601173},{"type":"v1","addr":"172.21.15.175:6835","nonce":2552601173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6837/1767284089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1767284089},{"type":"v1","addr":"172.21.15.175:6837","nonce":1767284089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/1331748742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1331748742},{"type":"v1","addr":"172.21.15.175:6839","nonce":1331748742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/4098410583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":4098410583},{"type":"v1","addr":"172.21.15.81:6839","nonce":4098410583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24539,"qdb_cluster":[24539,24523,24514,24538,24512]},"id":1}]} 2024-08-20T01:36:31.733 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 27 2024-08-20T01:36:31.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.733+0000 7f53d57de640 1 -- 172.21.15.79:0/1794155585 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f53bc0b3bd0 msgr2=0x7f53bc0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:31.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.733+0000 7f53d57de640 1 --2- 172.21.15.79:0/1794155585 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f53bc0b3bd0 0x7f53bc0b6090 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f53c00096b0 tx=0x7f53c0006c20 comp rx=0 tx=0).stop 2024-08-20T01:36:31.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.733+0000 7f53d57de640 1 -- 172.21.15.79:0/1794155585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53d010ce40 msgr2=0x7f53d019e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:31.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.733+0000 7f53d57de640 1 --2- 172.21.15.79:0/1794155585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53d010ce40 0x7f53d019e830 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f53c8005cc0 tx=0x7f53c8032c40 comp rx=0 tx=0).stop 2024-08-20T01:36:31.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.733+0000 7f53d57de640 1 -- 172.21.15.79:0/1794155585 shutdown_connections 2024-08-20T01:36:31.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.733+0000 7f53d57de640 1 --2- 172.21.15.79:0/1794155585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53d010ce40 0x7f53d019e830 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:31.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.733+0000 7f53d57de640 1 --2- 172.21.15.79:0/1794155585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53d0104290 0x7f53d0199490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:31.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.733+0000 7f53d57de640 1 --2- 172.21.15.79:0/1794155585 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f53bc0b3bd0 0x7f53bc0b6090 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:31.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.733+0000 7f53d57de640 1 --2- 172.21.15.79:0/1794155585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53d0103890 0x7f53d0198f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:31.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.733+0000 7f53d57de640 1 -- 172.21.15.79:0/1794155585 >> 172.21.15.79:0/1794155585 conn(0x7f53d00fd420 msgr2=0x7f53d00fe0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:31.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.733+0000 7f53d57de640 1 -- 172.21.15.79:0/1794155585 shutdown_connections 2024-08-20T01:36:31.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:31.734+0000 7f53d57de640 1 -- 172.21.15.79:0/1794155585 wait complete. 2024-08-20T01:36:32.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:32 smithi175 ceph-mon[22392]: pgmap v323: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-20T01:36:32.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:32 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/1794155585' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:36:32.389 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:32 smithi079 ceph-mon[18656]: pgmap v323: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-20T01:36:32.389 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:32 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/1794155585' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:36:32.418 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:36:32.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:32 smithi081 ceph-mon[22209]: pgmap v323: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-20T01:36:32.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:32 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/1794155585' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:36:32.664 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:36:33.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.120+0000 7f4837f00640 1 -- 172.21.15.79:0/3801654316 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4830101990 msgr2=0x7f4830101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:33.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.120+0000 7f4837f00640 1 --2- 172.21.15.79:0/3801654316 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4830101990 0x7f4830101d70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f482c009900 tx=0x7f482c02a410 comp rx=0 tx=0).stop 2024-08-20T01:36:33.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.120+0000 7f4837f00640 1 -- 172.21.15.79:0/3801654316 shutdown_connections 2024-08-20T01:36:33.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.120+0000 7f4837f00640 1 --2- 172.21.15.79:0/3801654316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4830107d20 0x7f483010e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:33.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.120+0000 7f4837f00640 1 --2- 172.21.15.79:0/3801654316 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48301073a0 0x7f48301077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:33.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.120+0000 7f4837f00640 1 --2- 172.21.15.79:0/3801654316 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4830101990 0x7f4830101d70 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:33.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.120+0000 7f4837f00640 1 -- 172.21.15.79:0/3801654316 >> 172.21.15.79:0/3801654316 conn(0x7f48300fd400 msgr2=0x7f48300ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:33.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.120+0000 7f4837f00640 1 -- 172.21.15.79:0/3801654316 shutdown_connections 2024-08-20T01:36:33.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.120+0000 7f4837f00640 1 -- 172.21.15.79:0/3801654316 wait complete. 2024-08-20T01:36:33.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.121+0000 7f4837f00640 1 Processor -- start 2024-08-20T01:36:33.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.121+0000 7f4837f00640 1 -- start start 2024-08-20T01:36:33.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.121+0000 7f4837f00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4830101990 0x7f4830198f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:33.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.121+0000 7f4837f00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48301073a0 0x7f48301994c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:33.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.121+0000 7f4837f00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4830107d20 0x7f483019e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:33.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.121+0000 7f4837f00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4830111890 con 0x7f4830101990 2024-08-20T01:36:33.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.121+0000 7f4837f00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4830111710 con 0x7f48301073a0 2024-08-20T01:36:33.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.121+0000 7f4837f00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4830111a10 con 0x7f4830107d20 2024-08-20T01:36:33.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.121+0000 7f4835c9c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4830101990 0x7f4830198f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:33.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.121+0000 7f4835c9c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4830101990 0x7f4830198f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46350/0 (socket says 172.21.15.79:46350) 2024-08-20T01:36:33.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.121+0000 7f4835c9c640 1 -- 172.21.15.79:0/2251642406 learned_addr learned my addr 172.21.15.79:0/2251642406 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:33.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.121+0000 7f483549b640 1 --2- 172.21.15.79:0/2251642406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48301073a0 0x7f48301994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:33.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.121+0000 7f4835c9c640 1 -- 172.21.15.79:0/2251642406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4830107d20 msgr2=0x7f483019e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:33.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.121+0000 7f4835c9c640 1 --2- 172.21.15.79:0/2251642406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4830107d20 0x7f483019e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:33.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.121+0000 7f4835c9c640 1 -- 172.21.15.79:0/2251642406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48301073a0 msgr2=0x7f48301994c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:33.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.121+0000 7f4835c9c640 1 --2- 172.21.15.79:0/2251642406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48301073a0 0x7f48301994c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:33.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.121+0000 7f4835c9c640 1 -- 172.21.15.79:0/2251642406 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f483019f030 con 0x7f4830101990 2024-08-20T01:36:33.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.121+0000 7f483549b640 1 --2- 172.21.15.79:0/2251642406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48301073a0 0x7f48301994c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:36:33.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.121+0000 7f4835c9c640 1 --2- 172.21.15.79:0/2251642406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4830101990 0x7f4830198f80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f482c009a20 tx=0x7f482c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:33.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.121+0000 7f4826ffd640 1 -- 172.21.15.79:0/2251642406 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f482c03f030 con 0x7f4830101990 2024-08-20T01:36:33.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.121+0000 7f4826ffd640 1 -- 172.21.15.79:0/2251642406 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f482c0035f0 con 0x7f4830101990 2024-08-20T01:36:33.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.121+0000 7f4837f00640 1 -- 172.21.15.79:0/2251642406 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f483019f2c0 con 0x7f4830101990 2024-08-20T01:36:33.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.121+0000 7f4826ffd640 1 -- 172.21.15.79:0/2251642406 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f482c035070 con 0x7f4830101990 2024-08-20T01:36:33.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.122+0000 7f4837f00640 1 -- 172.21.15.79:0/2251642406 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48301a59e0 con 0x7f4830101990 2024-08-20T01:36:33.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.122+0000 7f4837f00640 1 -- 172.21.15.79:0/2251642406 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4830101d70 con 0x7f4830101990 2024-08-20T01:36:33.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.124+0000 7f4826ffd640 1 -- 172.21.15.79:0/2251642406 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f482c003aa0 con 0x7f4830101990 2024-08-20T01:36:33.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.125+0000 7f4826ffd640 1 --2- 172.21.15.79:0/2251642406 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f481c0b3bd0 0x7f481c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:33.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.125+0000 7f483549b640 1 --2- 172.21.15.79:0/2251642406 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f481c0b3bd0 0x7f481c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:33.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.125+0000 7f4826ffd640 1 -- 172.21.15.79:0/2251642406 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f482c104c00 con 0x7f4830101990 2024-08-20T01:36:33.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.126+0000 7f483549b640 1 --2- 172.21.15.79:0/2251642406 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f481c0b3bd0 0x7f481c0b6090 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4820006fd0 tx=0x7f4820008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:33.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.128+0000 7f4826ffd640 1 -- 172.21.15.79:0/2251642406 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f482c0cc260 con 0x7f4830101990 2024-08-20T01:36:33.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.340+0000 7f4837f00640 1 -- 172.21.15.79:0/2251642406 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f483002e340 con 0x7f4830101990 2024-08-20T01:36:33.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.341+0000 7f4826ffd640 1 -- 172.21.15.79:0/2251642406 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11973 (secure 0 0 0) 0x7f482c0cbb60 con 0x7f4830101990 2024-08-20T01:36:33.342 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:36:33.342 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":27,"btime":"2024-08-20T01:35:06:437353+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14670,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/735082912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":735082912},{"type":"v1","addr":"172.21.15.79:6835","nonce":735082912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2150339873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2150339873},{"type":"v1","addr":"172.21.15.79:6837","nonce":2150339873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:34:55.133562+0000","modified":"2024-08-20T01:35:06.437339+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24539,"mds_1":24538,"mds_2":24523,"mds_3":24514,"mds_4":24512},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14724":{"gid":14724,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/1071242274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1071242274},{"type":"v1","addr":"172.21.15.79:6839","nonce":1071242274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14730":{"gid":14730,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6841/2448977611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":2448977611},{"type":"v1","addr":"172.21.15.79:6841","nonce":2448977611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/1257507005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1257507005},{"type":"v1","addr":"172.21.15.81:6833","nonce":1257507005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1499936216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1499936216},{"type":"v1","addr":"172.21.15.81:6835","nonce":1499936216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/1107229215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1107229215},{"type":"v1","addr":"172.21.15.175:6833","nonce":1107229215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6837/2073598870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2073598870},{"type":"v1","addr":"172.21.15.81:6837","nonce":2073598870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/2552601173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2552601173},{"type":"v1","addr":"172.21.15.175:6835","nonce":2552601173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6837/1767284089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1767284089},{"type":"v1","addr":"172.21.15.175:6837","nonce":1767284089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/1331748742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1331748742},{"type":"v1","addr":"172.21.15.175:6839","nonce":1331748742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/4098410583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":4098410583},{"type":"v1","addr":"172.21.15.81:6839","nonce":4098410583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24539,"qdb_cluster":[24539,24523,24514,24538,24512]},"id":1}]} 2024-08-20T01:36:33.343 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 27 2024-08-20T01:36:33.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.343+0000 7f4837f00640 1 -- 172.21.15.79:0/2251642406 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f481c0b3bd0 msgr2=0x7f481c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:33.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.343+0000 7f4837f00640 1 --2- 172.21.15.79:0/2251642406 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f481c0b3bd0 0x7f481c0b6090 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4820006fd0 tx=0x7f4820008040 comp rx=0 tx=0).stop 2024-08-20T01:36:33.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.343+0000 7f4837f00640 1 -- 172.21.15.79:0/2251642406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4830101990 msgr2=0x7f4830198f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:33.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.343+0000 7f4837f00640 1 --2- 172.21.15.79:0/2251642406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4830101990 0x7f4830198f80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f482c009a20 tx=0x7f482c004270 comp rx=0 tx=0).stop 2024-08-20T01:36:33.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.343+0000 7f4837f00640 1 -- 172.21.15.79:0/2251642406 shutdown_connections 2024-08-20T01:36:33.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.343+0000 7f4837f00640 1 --2- 172.21.15.79:0/2251642406 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f481c0b3bd0 0x7f481c0b6090 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:33.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.343+0000 7f4837f00640 1 --2- 172.21.15.79:0/2251642406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4830107d20 0x7f483019e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:33.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.343+0000 7f4837f00640 1 --2- 172.21.15.79:0/2251642406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48301073a0 0x7f48301994c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:33.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.343+0000 7f4837f00640 1 --2- 172.21.15.79:0/2251642406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4830101990 0x7f4830198f80 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:33.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.343+0000 7f4837f00640 1 -- 172.21.15.79:0/2251642406 >> 172.21.15.79:0/2251642406 conn(0x7f48300fd400 msgr2=0x7f483006ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:33.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.343+0000 7f4837f00640 1 -- 172.21.15.79:0/2251642406 shutdown_connections 2024-08-20T01:36:33.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:33.343+0000 7f4837f00640 1 -- 172.21.15.79:0/2251642406 wait complete. 2024-08-20T01:36:34.008 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-20T01:36:34.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:34 smithi079 ceph-mon[18656]: pgmap v324: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-20T01:36:34.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:34 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2251642406' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:36:34.251 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:36:34.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:34 smithi175 ceph-mon[22392]: pgmap v324: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-20T01:36:34.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:34 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2251642406' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:36:34.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:34 smithi081 ceph-mon[22209]: pgmap v324: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-20T01:36:34.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:34 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2251642406' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:36:34.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.719+0000 7f0cf3a86640 1 -- 172.21.15.79:0/1952358315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cec108500 msgr2=0x7f0cec108940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:34.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.719+0000 7f0cf3a86640 1 --2- 172.21.15.79:0/1952358315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cec108500 0x7f0cec108940 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0009900 tx=0x7f0ce002a410 comp rx=0 tx=0).stop 2024-08-20T01:36:34.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.719+0000 7f0cf3a86640 1 -- 172.21.15.79:0/1952358315 shutdown_connections 2024-08-20T01:36:34.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.719+0000 7f0cf3a86640 1 --2- 172.21.15.79:0/1952358315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0cec108e80 0x7f0cec10f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:34.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.719+0000 7f0cf3a86640 1 --2- 172.21.15.79:0/1952358315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cec108500 0x7f0cec108940 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:34.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.719+0000 7f0cf3a86640 1 --2- 172.21.15.79:0/1952358315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cec102af0 0x7f0cec102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:34.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.719+0000 7f0cf3a86640 1 -- 172.21.15.79:0/1952358315 >> 172.21.15.79:0/1952358315 conn(0x7f0cec0fe580 msgr2=0x7f0cec1009a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:34.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.719+0000 7f0cf3a86640 1 -- 172.21.15.79:0/1952358315 shutdown_connections 2024-08-20T01:36:34.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.719+0000 7f0cf3a86640 1 -- 172.21.15.79:0/1952358315 wait complete. 2024-08-20T01:36:34.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.720+0000 7f0cf3a86640 1 Processor -- start 2024-08-20T01:36:34.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.720+0000 7f0cf3a86640 1 -- start start 2024-08-20T01:36:34.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.720+0000 7f0cf3a86640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cec102af0 0x7f0cec198fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:34.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.720+0000 7f0cf3a86640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cec108500 0x7f0cec199510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:34.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.720+0000 7f0cf3a86640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0cec108e80 0x7f0cec19e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:34.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.720+0000 7f0cf3a86640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0cec112a00 con 0x7f0cec102af0 2024-08-20T01:36:34.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.720+0000 7f0cf3a86640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0cec112880 con 0x7f0cec108500 2024-08-20T01:36:34.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.720+0000 7f0cf3a86640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0cec112b80 con 0x7f0cec108e80 2024-08-20T01:36:34.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.720+0000 7f0cf1822640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cec102af0 0x7f0cec198fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:34.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.720+0000 7f0cf1822640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cec102af0 0x7f0cec198fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46374/0 (socket says 172.21.15.79:46374) 2024-08-20T01:36:34.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.720+0000 7f0cf1822640 1 -- 172.21.15.79:0/2559493416 learned_addr learned my addr 172.21.15.79:0/2559493416 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:34.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.721+0000 7f0cf2023640 1 --2- 172.21.15.79:0/2559493416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0cec108e80 0x7f0cec19e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:34.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.721+0000 7f0cf1822640 1 -- 172.21.15.79:0/2559493416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0cec108e80 msgr2=0x7f0cec19e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:34.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.721+0000 7f0cf1822640 1 --2- 172.21.15.79:0/2559493416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0cec108e80 0x7f0cec19e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:34.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.721+0000 7f0cf1822640 1 -- 172.21.15.79:0/2559493416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cec108500 msgr2=0x7f0cec199510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:34.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.721+0000 7f0cf1822640 1 --2- 172.21.15.79:0/2559493416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cec108500 0x7f0cec199510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:34.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.721+0000 7f0cf1822640 1 -- 172.21.15.79:0/2559493416 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cec19f080 con 0x7f0cec102af0 2024-08-20T01:36:34.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.721+0000 7f0cf1822640 1 --2- 172.21.15.79:0/2559493416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cec102af0 0x7f0cec198fd0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc00cce0 tx=0x7f0cdc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:34.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.721+0000 7f0ceaffd640 1 -- 172.21.15.79:0/2559493416 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc004b20 con 0x7f0cec102af0 2024-08-20T01:36:34.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.721+0000 7f0ceaffd640 1 -- 172.21.15.79:0/2559493416 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0cdc004cc0 con 0x7f0cec102af0 2024-08-20T01:36:34.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.721+0000 7f0cf3a86640 1 -- 172.21.15.79:0/2559493416 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cec19f370 con 0x7f0cec102af0 2024-08-20T01:36:34.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.721+0000 7f0ceaffd640 1 -- 172.21.15.79:0/2559493416 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc00f6b0 con 0x7f0cec102af0 2024-08-20T01:36:34.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.721+0000 7f0cf3a86640 1 -- 172.21.15.79:0/2559493416 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cec1a5a30 con 0x7f0cec102af0 2024-08-20T01:36:34.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.722+0000 7f0cf3a86640 1 -- 172.21.15.79:0/2559493416 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cec102ed0 con 0x7f0cec102af0 2024-08-20T01:36:34.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.724+0000 7f0ceaffd640 1 -- 172.21.15.79:0/2559493416 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f0cdc00f850 con 0x7f0cec102af0 2024-08-20T01:36:34.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.725+0000 7f0ceaffd640 1 --2- 172.21.15.79:0/2559493416 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0cd40b3bd0 0x7f0cd40b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:34.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.725+0000 7f0cf1021640 1 --2- 172.21.15.79:0/2559493416 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0cd40b3bd0 0x7f0cd40b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:34.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.725+0000 7f0ceaffd640 1 -- 172.21.15.79:0/2559493416 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f0cdc0e40e0 con 0x7f0cec102af0 2024-08-20T01:36:34.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.725+0000 7f0cf1021640 1 --2- 172.21.15.79:0/2559493416 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0cd40b3bd0 0x7f0cd40b6090 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0009230 tx=0x7f0ce0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:34.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.728+0000 7f0ceaffd640 1 -- 172.21.15.79:0/2559493416 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f0cdc014030 con 0x7f0cec102af0 2024-08-20T01:36:34.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.906+0000 7f0cf3a86640 1 -- 172.21.15.79:0/2559493416 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0cec02e340 con 0x7f0cec102af0 2024-08-20T01:36:34.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.907+0000 7f0ceaffd640 1 -- 172.21.15.79:0/2559493416 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22676 (secure 0 0 0) 0x7f0cdc0ab740 con 0x7f0cec102af0 2024-08-20T01:36:34.908 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:36:34.909 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":74,"fsid":"28484e9a-5e93-11ef-bccf-c7b262605968","created":"2024-08-20T01:27:07.792689+0000","modified":"2024-08-20T01:35:53.774800+0000","last_up_change":"2024-08-20T01:34:05.838937+0000","last_in_change":"2024-08-20T01:33:43.645153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-20T01:30:30.693903+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-20T01:34:50.585939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-20T01:34:52.980599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ccdbeb3d-bb9d-4275-ad7e-49f2cc1222cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6803","nonce":1274927648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6805","nonce":1274927648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6809","nonce":1274927648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6807","nonce":1274927648}]},"public_addr":"172.21.15.79:6803/1274927648","cluster_addr":"172.21.15.79:6805/1274927648","heartbeat_back_addr":"172.21.15.79:6809/1274927648","heartbeat_front_addr":"172.21.15.79:6807/1274927648","state":["exists","up"]},{"osd":1,"uuid":"0906bc46-f89d-482d-9402-43d17e4246a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6801","nonce":1174012328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6803","nonce":1174012328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6807","nonce":1174012328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6805","nonce":1174012328}]},"public_addr":"172.21.15.81:6801/1174012328","cluster_addr":"172.21.15.81:6803/1174012328","heartbeat_back_addr":"172.21.15.81:6807/1174012328","heartbeat_front_addr":"172.21.15.81:6805/1174012328","state":["exists","up"]},{"osd":2,"uuid":"11d8fb9d-cb2c-41c8-994c-603a1d8e01a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6801","nonce":1132306232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6803","nonce":1132306232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6807","nonce":1132306232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6805","nonce":1132306232}]},"public_addr":"172.21.15.175:6801/1132306232","cluster_addr":"172.21.15.175:6803/1132306232","heartbeat_back_addr":"172.21.15.175:6807/1132306232","heartbeat_front_addr":"172.21.15.175:6805/1132306232","state":["exists","up"]},{"osd":3,"uuid":"29e35242-957f-404b-b99e-d4dd0045c35d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6811","nonce":1364181822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6813","nonce":1364181822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6817","nonce":1364181822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6815","nonce":1364181822}]},"public_addr":"172.21.15.79:6811/1364181822","cluster_addr":"172.21.15.79:6813/1364181822","heartbeat_back_addr":"172.21.15.79:6817/1364181822","heartbeat_front_addr":"172.21.15.79:6815/1364181822","state":["exists","up"]},{"osd":4,"uuid":"9139c469-270f-4465-8adb-1e748529fa68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6809","nonce":306873968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6811","nonce":306873968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6815","nonce":306873968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6813","nonce":306873968}]},"public_addr":"172.21.15.81:6809/306873968","cluster_addr":"172.21.15.81:6811/306873968","heartbeat_back_addr":"172.21.15.81:6815/306873968","heartbeat_front_addr":"172.21.15.81:6813/306873968","state":["exists","up"]},{"osd":5,"uuid":"6394e462-4510-45d6-bc99-8660085cb206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6809","nonce":3908133424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6811","nonce":3908133424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6815","nonce":3908133424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6813","nonce":3908133424}]},"public_addr":"172.21.15.175:6809/3908133424","cluster_addr":"172.21.15.175:6811/3908133424","heartbeat_back_addr":"172.21.15.175:6815/3908133424","heartbeat_front_addr":"172.21.15.175:6813/3908133424","state":["exists","up"]},{"osd":6,"uuid":"e8e51380-e2be-4c4c-82d8-d86306d9fc1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6819","nonce":3379368280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6821","nonce":3379368280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6825","nonce":3379368280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6823","nonce":3379368280}]},"public_addr":"172.21.15.79:6819/3379368280","cluster_addr":"172.21.15.79:6821/3379368280","heartbeat_back_addr":"172.21.15.79:6825/3379368280","heartbeat_front_addr":"172.21.15.79:6823/3379368280","state":["exists","up"]},{"osd":7,"uuid":"875f7876-a2ca-4254-a8cc-27eebb11cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6817","nonce":747356685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6819","nonce":747356685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6823","nonce":747356685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6821","nonce":747356685}]},"public_addr":"172.21.15.81:6817/747356685","cluster_addr":"172.21.15.81:6819/747356685","heartbeat_back_addr":"172.21.15.81:6823/747356685","heartbeat_front_addr":"172.21.15.81:6821/747356685","state":["exists","up"]},{"osd":8,"uuid":"d714a33b-8df5-411d-bc99-b33b4b27cc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6817","nonce":1537762925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6819","nonce":1537762925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6823","nonce":1537762925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6821","nonce":1537762925}]},"public_addr":"172.21.15.175:6817/1537762925","cluster_addr":"172.21.15.175:6819/1537762925","heartbeat_back_addr":"172.21.15.175:6823/1537762925","heartbeat_front_addr":"172.21.15.175:6821/1537762925","state":["exists","up"]},{"osd":9,"uuid":"82db8305-1d72-4bef-99d6-5486e4de5b03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6827","nonce":2400574113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6829","nonce":2400574113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6833","nonce":2400574113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6831","nonce":2400574113}]},"public_addr":"172.21.15.79:6827/2400574113","cluster_addr":"172.21.15.79:6829/2400574113","heartbeat_back_addr":"172.21.15.79:6833/2400574113","heartbeat_front_addr":"172.21.15.79:6831/2400574113","state":["exists","up"]},{"osd":10,"uuid":"797e1e3f-12b5-4958-9e1f-f796cffaaf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6825","nonce":4188407500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6827","nonce":4188407500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6831","nonce":4188407500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6829","nonce":4188407500}]},"public_addr":"172.21.15.81:6825/4188407500","cluster_addr":"172.21.15.81:6827/4188407500","heartbeat_back_addr":"172.21.15.81:6831/4188407500","heartbeat_front_addr":"172.21.15.81:6829/4188407500","state":["exists","up"]},{"osd":11,"uuid":"a4d218ae-5a41-4b34-9c4e-e795c4a6a16d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6825","nonce":451069549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6827","nonce":451069549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6831","nonce":451069549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6829","nonce":451069549}]},"public_addr":"172.21.15.175:6825/451069549","cluster_addr":"172.21.15.175:6827/451069549","heartbeat_back_addr":"172.21.15.175:6831/451069549","heartbeat_front_addr":"172.21.15.175:6829/451069549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:29:42.003425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:30:05.353547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:30:28.916727+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:30:52.845671+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:31:16.926826+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:31:39.840986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:32:04.013287+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:32:28.237482+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:32:51.270643+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:33:15.825156+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:33:40.037915+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:34:04.477377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":3,"to":7}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:0/1750500064":"2024-08-21T01:27:52.389553+0000","172.21.15.79:0/103962305":"2024-08-21T01:27:52.389553+0000","172.21.15.79:6800/4045769179":"2024-08-21T01:27:29.643647+0000","172.21.15.79:0/525482354":"2024-08-21T01:27:52.389553+0000","172.21.15.79:6801/4045769179":"2024-08-21T01:27:29.643647+0000","172.21.15.79:0/1023212241":"2024-08-21T01:27:29.643647+0000","172.21.15.79:0/2368377219":"2024-08-21T01:27:29.643647+0000","172.21.15.79:6801/3302536522":"2024-08-21T01:27:52.389553+0000","172.21.15.79:6800/3302536522":"2024-08-21T01:27:52.389553+0000","172.21.15.79:0/3498829332":"2024-08-21T01:27:29.643647+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-20T01:36:34.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.910+0000 7f0cf3a86640 1 -- 172.21.15.79:0/2559493416 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0cd40b3bd0 msgr2=0x7f0cd40b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:34.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.910+0000 7f0cf3a86640 1 --2- 172.21.15.79:0/2559493416 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0cd40b3bd0 0x7f0cd40b6090 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0009230 tx=0x7f0ce0000bc0 comp rx=0 tx=0).stop 2024-08-20T01:36:34.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.910+0000 7f0cf3a86640 1 -- 172.21.15.79:0/2559493416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cec102af0 msgr2=0x7f0cec198fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:34.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.910+0000 7f0cf3a86640 1 --2- 172.21.15.79:0/2559493416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cec102af0 0x7f0cec198fd0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc00cce0 tx=0x7f0cdc00a620 comp rx=0 tx=0).stop 2024-08-20T01:36:34.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.910+0000 7f0cf3a86640 1 -- 172.21.15.79:0/2559493416 shutdown_connections 2024-08-20T01:36:34.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.910+0000 7f0cf3a86640 1 --2- 172.21.15.79:0/2559493416 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0cd40b3bd0 0x7f0cd40b6090 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:34.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.910+0000 7f0cf3a86640 1 --2- 172.21.15.79:0/2559493416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0cec108e80 0x7f0cec19e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:34.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.910+0000 7f0cf3a86640 1 --2- 172.21.15.79:0/2559493416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cec108500 0x7f0cec199510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:34.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.910+0000 7f0cf3a86640 1 --2- 172.21.15.79:0/2559493416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cec102af0 0x7f0cec198fd0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:34.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.910+0000 7f0cf3a86640 1 -- 172.21.15.79:0/2559493416 >> 172.21.15.79:0/2559493416 conn(0x7f0cec0fe580 msgr2=0x7f0cec100970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:34.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.910+0000 7f0cf3a86640 1 -- 172.21.15.79:0/2559493416 shutdown_connections 2024-08-20T01:36:34.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:34.910+0000 7f0cf3a86640 1 -- 172.21.15.79:0/2559493416 wait complete. 2024-08-20T01:36:35.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:35 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2559493416' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:36:35.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:35 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2559493416' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:36:35.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:35 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2559493416' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:36:35.591 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-08-20T01:34:55.133562+0000', 'modified': '2024-08-20T01:35:06.437339+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24539, 'mds_1': 24538, 'mds_2': 24523, 'mds_3': 24514, 'mds_4': 24512}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14724': {'gid': 14724, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.79:6839/1071242274', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6838', 'nonce': 1071242274}, {'type': 'v1', 'addr': '172.21.15.79:6839', 'nonce': 1071242274}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14730': {'gid': 14730, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.79:6841/2448977611', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6840', 'nonce': 2448977611}, {'type': 'v1', 'addr': '172.21.15.79:6841', 'nonce': 2448977611}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24473': {'gid': 24473, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.81:6833/1257507005', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6832', 'nonce': 1257507005}, {'type': 'v1', 'addr': '172.21.15.81:6833', 'nonce': 1257507005}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24494': {'gid': 24494, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.81:6835/1499936216', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6834', 'nonce': 1499936216}, {'type': 'v1', 'addr': '172.21.15.81:6835', 'nonce': 1499936216}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24496': {'gid': 24496, 'name': 'l', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.175:6833/1107229215', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6832', 'nonce': 1107229215}, {'type': 'v1', 'addr': '172.21.15.175:6833', 'nonce': 1107229215}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24512': {'gid': 24512, 'name': 'h', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.81:6837/2073598870', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6836', 'nonce': 2073598870}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 2073598870}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24514': {'gid': 24514, 'name': 'f', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.175:6835/2552601173', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6834', 'nonce': 2552601173}, {'type': 'v1', 'addr': '172.21.15.175:6835', 'nonce': 2552601173}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24523': {'gid': 24523, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.175:6837/1767284089', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6836', 'nonce': 1767284089}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 1767284089}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24538': {'gid': 24538, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.175:6839/1331748742', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6838', 'nonce': 1331748742}, {'type': 'v1', 'addr': '172.21.15.175:6839', 'nonce': 1331748742}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24539': {'gid': 24539, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.81:6839/4098410583', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6838', 'nonce': 4098410583}, {'type': 'v1', 'addr': '172.21.15.81:6839', 'nonce': 4098410583}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24539, 'qdb_cluster': [24539, 24523, 24514, 24538, 24512]} 2024-08-20T01:36:35.591 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-08-20T01:36:35.591 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.h status 2024-08-20T01:36:35.846 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:36:36.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:36 smithi079 ceph-mon[18656]: pgmap v325: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-20T01:36:36.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.313+0000 7fbe80817640 1 -- 172.21.15.79:0/1375919068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe7c101990 msgr2=0x7fbe7c101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:36.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.313+0000 7fbe80817640 1 --2- 172.21.15.79:0/1375919068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe7c101990 0x7fbe7c101d70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c009900 tx=0x7fbe6c02a410 comp rx=0 tx=0).stop 2024-08-20T01:36:36.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.313+0000 7fbe80817640 1 -- 172.21.15.79:0/1375919068 shutdown_connections 2024-08-20T01:36:36.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.313+0000 7fbe80817640 1 --2- 172.21.15.79:0/1375919068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe7c107d20 0x7fbe7c10e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:36.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.313+0000 7fbe80817640 1 --2- 172.21.15.79:0/1375919068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe7c1073a0 0x7fbe7c1077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:36.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.313+0000 7fbe80817640 1 --2- 172.21.15.79:0/1375919068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe7c101990 0x7fbe7c101d70 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:36.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.313+0000 7fbe80817640 1 -- 172.21.15.79:0/1375919068 >> 172.21.15.79:0/1375919068 conn(0x7fbe7c0fd400 msgr2=0x7fbe7c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:36.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.313+0000 7fbe80817640 1 -- 172.21.15.79:0/1375919068 shutdown_connections 2024-08-20T01:36:36.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.313+0000 7fbe80817640 1 -- 172.21.15.79:0/1375919068 wait complete. 2024-08-20T01:36:36.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.314+0000 7fbe80817640 1 Processor -- start 2024-08-20T01:36:36.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.314+0000 7fbe80817640 1 -- start start 2024-08-20T01:36:36.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.315+0000 7fbe80817640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe7c101990 0x7fbe7c197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:36.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.315+0000 7fbe80817640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe7c1073a0 0x7fbe7c198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:36.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.315+0000 7fbe80817640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe7c107d20 0x7fbe7c19d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:36.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.315+0000 7fbe80817640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbe7c111890 con 0x7fbe7c101990 2024-08-20T01:36:36.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.315+0000 7fbe80817640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbe7c111710 con 0x7fbe7c1073a0 2024-08-20T01:36:36.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.315+0000 7fbe80817640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbe7c111a10 con 0x7fbe7c107d20 2024-08-20T01:36:36.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.315+0000 7fbe7a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe7c101990 0x7fbe7c197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:36.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.315+0000 7fbe7a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe7c101990 0x7fbe7c197e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46398/0 (socket says 172.21.15.79:46398) 2024-08-20T01:36:36.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.315+0000 7fbe7a59c640 1 -- 172.21.15.79:0/240422223 learned_addr learned my addr 172.21.15.79:0/240422223 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:36.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.315+0000 7fbe79d9b640 1 --2- 172.21.15.79:0/240422223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe7c1073a0 0x7fbe7c198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:36.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.315+0000 7fbe7ad9d640 1 --2- 172.21.15.79:0/240422223 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe7c107d20 0x7fbe7c19d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:36.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.315+0000 7fbe7a59c640 1 -- 172.21.15.79:0/240422223 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe7c107d20 msgr2=0x7fbe7c19d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:36.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.315+0000 7fbe7a59c640 1 --2- 172.21.15.79:0/240422223 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe7c107d20 0x7fbe7c19d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:36.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.315+0000 7fbe7a59c640 1 -- 172.21.15.79:0/240422223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe7c1073a0 msgr2=0x7fbe7c198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:36.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.315+0000 7fbe7a59c640 1 --2- 172.21.15.79:0/240422223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe7c1073a0 0x7fbe7c198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:36.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.315+0000 7fbe7a59c640 1 -- 172.21.15.79:0/240422223 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe7c19deb0 con 0x7fbe7c101990 2024-08-20T01:36:36.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.315+0000 7fbe7a59c640 1 --2- 172.21.15.79:0/240422223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe7c101990 0x7fbe7c197e00 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c009230 tx=0x7fbe6c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:36.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.315+0000 7fbe6b7fe640 1 -- 172.21.15.79:0/240422223 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c03f030 con 0x7fbe7c101990 2024-08-20T01:36:36.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.315+0000 7fbe80817640 1 -- 172.21.15.79:0/240422223 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe7c19e140 con 0x7fbe7c101990 2024-08-20T01:36:36.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.316+0000 7fbe6b7fe640 1 -- 172.21.15.79:0/240422223 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbe6c003a80 con 0x7fbe7c101990 2024-08-20T01:36:36.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.316+0000 7fbe6b7fe640 1 -- 172.21.15.79:0/240422223 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c035070 con 0x7fbe7c101990 2024-08-20T01:36:36.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.316+0000 7fbe80817640 1 -- 172.21.15.79:0/240422223 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe7c1a4860 con 0x7fbe7c101990 2024-08-20T01:36:36.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.318+0000 7fbe6b7fe640 1 -- 172.21.15.79:0/240422223 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fbe6c042030 con 0x7fbe7c101990 2024-08-20T01:36:36.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.318+0000 7fbe82c10740 1 Processor -- start 2024-08-20T01:36:36.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.318+0000 7fbe82c10740 1 -- start start 2024-08-20T01:36:36.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.318+0000 7fbe82c10740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4cd34bbf0 0x55c4cd34bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:36.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.319+0000 7fbe82c10740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4cd34c510 0x55c4cd35a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:36.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.319+0000 7fbe82c10740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c4cd35a6b0 0x55c4cd35caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:36.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.319+0000 7fbe82c10740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c4cd2c26a0 con 0x55c4cd34bbf0 2024-08-20T01:36:36.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.319+0000 7fbe82c10740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c4cd2b1ba0 con 0x55c4cd35a6b0 2024-08-20T01:36:36.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.319+0000 7fbe82c10740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c4cd2b5be0 con 0x55c4cd34c510 2024-08-20T01:36:36.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.319+0000 7fbe7ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4cd34bbf0 0x55c4cd34bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:36.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.319+0000 7fbe7ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4cd34bbf0 0x55c4cd34bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46404/0 (socket says 172.21.15.79:46404) 2024-08-20T01:36:36.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.319+0000 7fbe7ad9d640 1 -- 172.21.15.79:0/2158565142 learned_addr learned my addr 172.21.15.79:0/2158565142 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:36.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.319+0000 7fbe7a59c640 1 --2- 172.21.15.79:0/2158565142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4cd34c510 0x55c4cd35a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:36.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.319+0000 7fbe79d9b640 1 --2- 172.21.15.79:0/2158565142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c4cd35a6b0 0x55c4cd35caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:36.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.319+0000 7fbe7ad9d640 1 -- 172.21.15.79:0/2158565142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4cd34c510 msgr2=0x55c4cd35a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:36.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.319+0000 7fbe7ad9d640 1 --2- 172.21.15.79:0/2158565142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4cd34c510 0x55c4cd35a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:36.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.319+0000 7fbe7ad9d640 1 -- 172.21.15.79:0/2158565142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c4cd35a6b0 msgr2=0x55c4cd35caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:36.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.319+0000 7fbe7ad9d640 1 --2- 172.21.15.79:0/2158565142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c4cd35a6b0 0x55c4cd35caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:36.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.319+0000 7fbe7ad9d640 1 -- 172.21.15.79:0/2158565142 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4cd011540 con 0x55c4cd34bbf0 2024-08-20T01:36:36.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.319+0000 7fbe7ad9d640 1 --2- 172.21.15.79:0/2158565142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4cd34bbf0 0x55c4cd34bfd0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbe74009f20 tx=0x7fbe7400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e53400865d5075f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:36.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.319+0000 7fbe6b7fe640 1 --2- 172.21.15.79:0/240422223 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbe640b3bd0 0x7fbe640b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:36.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.319+0000 7fbe7a59c640 1 --2- 172.21.15.79:0/240422223 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbe640b3bd0 0x7fbe640b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:36.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.319+0000 7fbe68ff9640 1 -- 172.21.15.79:0/2158565142 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7401a070 con 0x55c4cd34bbf0 2024-08-20T01:36:36.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.319+0000 7fbe68ff9640 1 -- 172.21.15.79:0/2158565142 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbe740158a0 con 0x55c4cd34bbf0 2024-08-20T01:36:36.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.320+0000 7fbe68ff9640 1 -- 172.21.15.79:0/2158565142 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7400a760 con 0x55c4cd34bbf0 2024-08-20T01:36:36.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.320+0000 7fbe6b7fe640 1 -- 172.21.15.79:0/240422223 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fbe6c104180 con 0x7fbe7c101990 2024-08-20T01:36:36.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.320+0000 7fbe82c10740 1 -- 172.21.15.79:0/2158565142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4cd34bbf0 msgr2=0x55c4cd34bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:36.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.320+0000 7fbe82c10740 1 --2- 172.21.15.79:0/2158565142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4cd34bbf0 0x55c4cd34bfd0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbe74009f20 tx=0x7fbe7400c8b0 comp rx=0 tx=0).stop 2024-08-20T01:36:36.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.320+0000 7fbe7a59c640 1 --2- 172.21.15.79:0/240422223 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbe640b3bd0 0x7fbe640b6090 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c102000 tx=0x7fbe6c107e70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:36.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.320+0000 7fbe82c10740 1 -- 172.21.15.79:0/2158565142 shutdown_connections 2024-08-20T01:36:36.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.320+0000 7fbe82c10740 1 --2- 172.21.15.79:0/2158565142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c4cd35a6b0 0x55c4cd35caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:36.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.320+0000 7fbe82c10740 1 --2- 172.21.15.79:0/2158565142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4cd34c510 0x55c4cd35a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:36.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.320+0000 7fbe82c10740 1 --2- 172.21.15.79:0/2158565142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4cd34bbf0 0x55c4cd34bfd0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:36.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.320+0000 7fbe82c10740 1 -- 172.21.15.79:0/2158565142 >> 172.21.15.79:0/2158565142 conn(0x55c4cd349a20 msgr2=0x55c4cd34abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:36.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.320+0000 7fbe82c10740 1 -- 172.21.15.79:0/2158565142 shutdown_connections 2024-08-20T01:36:36.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.320+0000 7fbe82c10740 1 -- 172.21.15.79:0/2158565142 wait complete. 2024-08-20T01:36:36.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.321+0000 7fbe82c10740 1 -- start start 2024-08-20T01:36:36.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.321+0000 7fbe82c10740 1 Processor -- start 2024-08-20T01:36:36.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.321+0000 7fbe82c10740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4cd34bbf0 0x55c4cd357620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:36.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.321+0000 7fbe82c10740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4cd34c510 0x55c4cd357b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:36.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.321+0000 7fbe82c10740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c4cd35a6b0 0x55c4cd3580a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:36.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.321+0000 7fbe82c10740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c4cd1145f0 con 0x55c4cd34c510 2024-08-20T01:36:36.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.321+0000 7fbe82c10740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c4cd2386c0 con 0x55c4cd35a6b0 2024-08-20T01:36:36.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.321+0000 7fbe82c10740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c4cd35d360 con 0x55c4cd34bbf0 2024-08-20T01:36:36.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.321+0000 7fbe82c10740 10 client.0 _ll_register_callbacks cb 0x55c4cd2751e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:36.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.321+0000 7fbe79d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4cd34c510 0x55c4cd357b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:36.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.321+0000 7fbe79d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4cd34c510 0x55c4cd357b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46408/0 (socket says 172.21.15.79:46408) 2024-08-20T01:36:36.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.321+0000 7fbe79d9b640 1 -- 172.21.15.79:0/2241595896 learned_addr learned my addr 172.21.15.79:0/2241595896 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:36.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.321+0000 7fbe7ad9d640 1 --2- 172.21.15.79:0/2241595896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4cd34bbf0 0x55c4cd357620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:36.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.321+0000 7fbe7ad9d640 1 --2- 172.21.15.79:0/2241595896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c4cd35a6b0 0x55c4cd3580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:36.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.321+0000 7fbe79d9b640 1 -- 172.21.15.79:0/2241595896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4cd34bbf0 msgr2=0x55c4cd357620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:36.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.321+0000 7fbe79d9b640 1 --2- 172.21.15.79:0/2241595896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4cd34bbf0 0x55c4cd357620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:36.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.321+0000 7fbe79d9b640 1 -- 172.21.15.79:0/2241595896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c4cd35a6b0 msgr2=0x55c4cd3580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:36.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.321+0000 7fbe79d9b640 1 --2- 172.21.15.79:0/2241595896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c4cd35a6b0 0x55c4cd3580a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:36.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.321+0000 7fbe79d9b640 1 -- 172.21.15.79:0/2241595896 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4cd366710 con 0x55c4cd34c510 2024-08-20T01:36:36.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.322+0000 7fbe79d9b640 1 --2- 172.21.15.79:0/2241595896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4cd34c510 0x55c4cd357b60 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fbe7000ba20 tx=0x7fbe7000bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7bcfabbf0f20bb7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:36.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.322+0000 7fbe61ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:36:36.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.322+0000 7fbe61ffb640 1 -- 172.21.15.79:0/2241595896 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7001b640 con 0x55c4cd34c510 2024-08-20T01:36:36.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.322+0000 7fbe82c10740 1 -- 172.21.15.79:0/2241595896 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe740158a0 con 0x55c4cd34c510 2024-08-20T01:36:36.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.322+0000 7fbe61ffb640 1 -- 172.21.15.79:0/2241595896 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fbe7001b7e0 con 0x55c4cd34c510 2024-08-20T01:36:36.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.322+0000 7fbe61ffb640 1 -- 172.21.15.79:0/2241595896 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbe7001b9e0 con 0x55c4cd34c510 2024-08-20T01:36:36.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.322+0000 7fbe82c10740 10 client.15243 fetch_fsmap learned FSMap version 27 2024-08-20T01:36:36.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.322+0000 7fbe82c10740 1 -- 172.21.15.79:0/2241595896 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c4cd369120 con 0x55c4cd34c510 2024-08-20T01:36:36.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.322+0000 7fbe61ffb640 1 -- 172.21.15.79:0/2241595896 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbe740158a0 con 0x55c4cd34c510 2024-08-20T01:36:36.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.322+0000 7fbe61ffb640 1 -- 172.21.15.79:0/2241595896 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fbe70019020 con 0x55c4cd34c510 2024-08-20T01:36:36.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.322+0000 7fbe82c10740 10 client.15243 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:36:36.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.322+0000 7fbe82c10740 10 client.15243 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-20T01:36:36.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.322+0000 7fbe82c10740 20 client.15243 populate_metadata read hostname 'smithi079' 2024-08-20T01:36:36.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.322+0000 7fbe82c10740 1 --2- 172.21.15.79:0/2241595896 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55c4cd36b780 0x55c4cd36cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:36.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.322+0000 7fbe82c10740 4 client.15243 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:36:36.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.323+0000 7fbe82c10740 1 -- 172.21.15.79:0/2241595896 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c4cd2c45f0 con 0x55c4cd36b780 2024-08-20T01:36:36.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.323+0000 7fbe7ad9d640 1 --2- 172.21.15.79:0/2241595896 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55c4cd36b780 0x55c4cd36cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:36.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.323+0000 7fbe61ffb640 10 client.15243 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:36:36.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.323+0000 7fbe7ad9d640 1 --2- 172.21.15.79:0/2241595896 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55c4cd36b780 0x55c4cd36cbf0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5a5a9681f9356adb server_cookie=95883f1e71b13f3e in_seq=0 out_seq=0 2024-08-20T01:36:36.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.324+0000 7fbe61ffb640 1 -- 172.21.15.79:0/2241595896 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c4cd2c45f0 con 0x55c4cd36b780 2024-08-20T01:36:36.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.324+0000 7fbe61ffb640 10 client.15243 handle_command_reply: tid=0 2024-08-20T01:36:36.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.324+0000 7fbe82c10740 1 client.15243 shutdown 2024-08-20T01:36:36.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.324+0000 7fbe82c10740 1 -- 172.21.15.79:0/2241595896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4cd34c510 msgr2=0x55c4cd357b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:36.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.324+0000 7fbe82c10740 1 --2- 172.21.15.79:0/2241595896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4cd34c510 0x55c4cd357b60 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fbe7000ba20 tx=0x7fbe7000bee0 comp rx=0 tx=0).stop 2024-08-20T01:36:36.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.324+0000 7fbe82c10740 1 -- 172.21.15.79:0/2241595896 shutdown_connections 2024-08-20T01:36:36.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.324+0000 7fbe82c10740 1 --2- 172.21.15.79:0/2241595896 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55c4cd36b780 0x55c4cd36cbf0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:36.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.324+0000 7fbe61ffb640 0 client.15243 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:36:36.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.324+0000 7fbe82c10740 1 --2- 172.21.15.79:0/2241595896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c4cd35a6b0 0x55c4cd3580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:36.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.324+0000 7fbe82c10740 1 --2- 172.21.15.79:0/2241595896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4cd34c510 0x55c4cd357b60 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:36.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.324+0000 7fbe82c10740 1 --2- 172.21.15.79:0/2241595896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4cd34bbf0 0x55c4cd357620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:36.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.324+0000 7fbe82c10740 1 -- 172.21.15.79:0/2241595896 >> 172.21.15.79:0/2241595896 conn(0x55c4cd349a20 msgr2=0x55c4cd34f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:36.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.324+0000 7fbe82c10740 1 -- 172.21.15.79:0/2241595896 shutdown_connections 2024-08-20T01:36:36.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.324+0000 7fbe82c10740 1 -- 172.21.15.79:0/2241595896 wait complete. 2024-08-20T01:36:36.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.324+0000 7fbe82c10740 20 client.15243 trim_cache size 0 max 16384 2024-08-20T01:36:36.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.342+0000 7fbe82c10740 1 Processor -- start 2024-08-20T01:36:36.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.342+0000 7fbe82c10740 1 -- start start 2024-08-20T01:36:36.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.342+0000 7fbe82c10740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c4cd34bbf0 0x55c4cd355140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:36.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.342+0000 7fbe82c10740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4cd34c510 0x55c4cd3492d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:36.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.342+0000 7fbe82c10740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4cd35a6b0 0x55c4cd357b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:36.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.342+0000 7fbe82c10740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c4cd36af30 con 0x55c4cd35a6b0 2024-08-20T01:36:36.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.342+0000 7fbe82c10740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c4cd36b600 con 0x55c4cd34bbf0 2024-08-20T01:36:36.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.342+0000 7fbe82c10740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c4cd36bcd0 con 0x55c4cd34c510 2024-08-20T01:36:36.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.342+0000 7fbe7ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4cd35a6b0 0x55c4cd357b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:36.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.342+0000 7fbe7ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4cd35a6b0 0x55c4cd357b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46416/0 (socket says 172.21.15.79:46416) 2024-08-20T01:36:36.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.342+0000 7fbe7ad9d640 1 -- 172.21.15.79:0/2016287298 learned_addr learned my addr 172.21.15.79:0/2016287298 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:36.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.343+0000 7fbe7ad9d640 1 --2- 172.21.15.79:0/2016287298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c4cd34bbf0 0x55c4cd355140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:36.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.343+0000 7fbe79d9b640 1 --2- 172.21.15.79:0/2016287298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4cd34c510 0x55c4cd3492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:36.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.343+0000 7fbe7ad9d640 1 -- 172.21.15.79:0/2016287298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4cd34c510 msgr2=0x55c4cd3492d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:36.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.343+0000 7fbe7ad9d640 1 --2- 172.21.15.79:0/2016287298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4cd34c510 0x55c4cd3492d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:36.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.343+0000 7fbe7ad9d640 1 -- 172.21.15.79:0/2016287298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c4cd34bbf0 msgr2=0x55c4cd355140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:36.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.343+0000 7fbe7ad9d640 1 --2- 172.21.15.79:0/2016287298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c4cd34bbf0 0x55c4cd355140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:36.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.343+0000 7fbe7ad9d640 1 -- 172.21.15.79:0/2016287298 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4cd355b40 con 0x55c4cd35a6b0 2024-08-20T01:36:36.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.343+0000 7fbe79d9b640 1 --2- 172.21.15.79:0/2016287298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4cd34c510 0x55c4cd3492d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:36:36.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.343+0000 7fbe7ad9d640 1 --2- 172.21.15.79:0/2016287298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4cd35a6b0 0x55c4cd357b40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbe7400dfd0 tx=0x7fbe7400c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e968537bdae3928 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:36.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.343+0000 7fbe63fff640 1 -- 172.21.15.79:0/2016287298 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7401a040 con 0x55c4cd35a6b0 2024-08-20T01:36:36.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.343+0000 7fbe63fff640 1 -- 172.21.15.79:0/2016287298 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbe74024400 con 0x55c4cd35a6b0 2024-08-20T01:36:36.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.343+0000 7fbe63fff640 1 -- 172.21.15.79:0/2016287298 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7402b420 con 0x55c4cd35a6b0 2024-08-20T01:36:36.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.344+0000 7fbe82c10740 1 -- 172.21.15.79:0/2016287298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4cd35a6b0 msgr2=0x55c4cd357b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:36.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.344+0000 7fbe82c10740 1 --2- 172.21.15.79:0/2016287298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4cd35a6b0 0x55c4cd357b40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbe7400dfd0 tx=0x7fbe7400c380 comp rx=0 tx=0).stop 2024-08-20T01:36:36.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.344+0000 7fbe82c10740 1 -- 172.21.15.79:0/2016287298 shutdown_connections 2024-08-20T01:36:36.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.344+0000 7fbe82c10740 1 --2- 172.21.15.79:0/2016287298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4cd35a6b0 0x55c4cd357b40 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:36.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.344+0000 7fbe82c10740 1 --2- 172.21.15.79:0/2016287298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4cd34c510 0x55c4cd3492d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:36.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.344+0000 7fbe82c10740 1 --2- 172.21.15.79:0/2016287298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c4cd34bbf0 0x55c4cd355140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:36.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.344+0000 7fbe82c10740 1 -- 172.21.15.79:0/2016287298 >> 172.21.15.79:0/2016287298 conn(0x55c4cd349a20 msgr2=0x55c4cd34aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:36.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.344+0000 7fbe82c10740 1 -- 172.21.15.79:0/2016287298 shutdown_connections 2024-08-20T01:36:36.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.344+0000 7fbe82c10740 1 -- 172.21.15.79:0/2016287298 wait complete. 2024-08-20T01:36:36.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.344+0000 7fbe82c10740 1 -- start start 2024-08-20T01:36:36.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.344+0000 7fbe82c10740 1 Processor -- start 2024-08-20T01:36:36.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.345+0000 7fbe82c10740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4cd34bbf0 0x55c4cd34dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:36.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.345+0000 7fbe82c10740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c4cd34c510 0x55c4cd34e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:36.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.345+0000 7fbe82c10740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4cd35a6b0 0x55c4cd356c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:36.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.345+0000 7fbe82c10740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c4cd36ca70 con 0x55c4cd34bbf0 2024-08-20T01:36:36.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.345+0000 7fbe82c10740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c4cd36c3a0 con 0x55c4cd34c510 2024-08-20T01:36:36.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.345+0000 7fbe82c10740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c4cd36d140 con 0x55c4cd35a6b0 2024-08-20T01:36:36.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.345+0000 7fbe82c10740 10 client.0 _ll_register_callbacks cb 0x7fbe70004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:36.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.345+0000 7fbe7ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4cd34bbf0 0x55c4cd34dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:36.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.345+0000 7fbe7ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4cd34bbf0 0x55c4cd34dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46430/0 (socket says 172.21.15.79:46430) 2024-08-20T01:36:36.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.345+0000 7fbe7ad9d640 1 -- 172.21.15.79:0/2001094698 learned_addr learned my addr 172.21.15.79:0/2001094698 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:36.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.345+0000 7fbe79d9b640 1 --2- 172.21.15.79:0/2001094698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c4cd34c510 0x55c4cd34e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:36.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.345+0000 7fbe7ad9d640 1 -- 172.21.15.79:0/2001094698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4cd35a6b0 msgr2=0x55c4cd356c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:36.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.345+0000 7fbe7ad9d640 1 --2- 172.21.15.79:0/2001094698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4cd35a6b0 0x55c4cd356c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:36.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.345+0000 7fbe7ad9d640 1 -- 172.21.15.79:0/2001094698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c4cd34c510 msgr2=0x55c4cd34e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:36.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.345+0000 7fbe7ad9d640 1 --2- 172.21.15.79:0/2001094698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c4cd34c510 0x55c4cd34e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:36.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.345+0000 7fbe7ad9d640 1 -- 172.21.15.79:0/2001094698 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4cd3572c0 con 0x55c4cd34bbf0 2024-08-20T01:36:36.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.345+0000 7fbe79d9b640 1 --2- 172.21.15.79:0/2001094698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c4cd34c510 0x55c4cd34e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:36:36.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.345+0000 7fbe7ad9d640 1 --2- 172.21.15.79:0/2001094698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4cd34bbf0 0x55c4cd34dc50 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fbe7400cdb0 tx=0x7fbe74009c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2add9309464acade server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:36.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.345+0000 7fbe61ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:36:36.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.345+0000 7fbe61ffb640 1 -- 172.21.15.79:0/2001094698 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7401a070 con 0x55c4cd34bbf0 2024-08-20T01:36:36.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.345+0000 7fbe82c10740 1 -- 172.21.15.79:0/2001094698 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe74024400 con 0x55c4cd34bbf0 2024-08-20T01:36:36.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.345+0000 7fbe61ffb640 1 -- 172.21.15.79:0/2001094698 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fbe74012040 con 0x55c4cd34bbf0 2024-08-20T01:36:36.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.346+0000 7fbe61ffb640 1 -- 172.21.15.79:0/2001094698 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbe74015790 con 0x55c4cd34bbf0 2024-08-20T01:36:36.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.346+0000 7fbe82c10740 10 client.15249 fetch_fsmap learned FSMap version 27 2024-08-20T01:36:36.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.346+0000 7fbe82c10740 1 -- 172.21.15.79:0/2001094698 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c4cd3755b0 con 0x55c4cd34bbf0 2024-08-20T01:36:36.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.346+0000 7fbe61ffb640 1 -- 172.21.15.79:0/2001094698 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbe74024400 con 0x55c4cd34bbf0 2024-08-20T01:36:36.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.346+0000 7fbe61ffb640 1 -- 172.21.15.79:0/2001094698 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fbe7402b420 con 0x55c4cd34bbf0 2024-08-20T01:36:36.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.346+0000 7fbe82c10740 10 client.15249 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:36:36.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.346+0000 7fbe82c10740 10 client.15249 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-20T01:36:36.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.346+0000 7fbe82c10740 20 client.15249 populate_metadata read hostname 'smithi079' 2024-08-20T01:36:36.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.346+0000 7fbe82c10740 1 --2- 172.21.15.79:0/2001094698 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55c4cd36b780 0x55c4cd3d8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:36.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.346+0000 7fbe82c10740 4 client.15249 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-20T01:36:36.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.346+0000 7fbe82c10740 1 -- 172.21.15.79:0/2001094698 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "status"}) -- 0x55c4cd35b210 con 0x55c4cd36b780 2024-08-20T01:36:36.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.346+0000 7fbe79d9b640 1 --2- 172.21.15.79:0/2001094698 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55c4cd36b780 0x55c4cd3d8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:36.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.347+0000 7fbe61ffb640 10 client.15249 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:36:36.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.347+0000 7fbe79d9b640 1 --2- 172.21.15.79:0/2001094698 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55c4cd36b780 0x55c4cd3d8810 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=be8d938c07705cc4 server_cookie=9d331dde1911ea9c in_seq=0 out_seq=0 2024-08-20T01:36:36.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.347+0000 7fbe61ffb640 1 -- 172.21.15.79:0/2001094698 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55c4cd35b210 con 0x55c4cd36b780 2024-08-20T01:36:36.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.347+0000 7fbe61ffb640 10 client.15249 handle_command_reply: tid=0 2024-08-20T01:36:36.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.347+0000 7fbe82c10740 1 client.15249 shutdown 2024-08-20T01:36:36.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.347+0000 7fbe82c10740 1 -- 172.21.15.79:0/2001094698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4cd34bbf0 msgr2=0x55c4cd34dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:36.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.347+0000 7fbe82c10740 1 --2- 172.21.15.79:0/2001094698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4cd34bbf0 0x55c4cd34dc50 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fbe7400cdb0 tx=0x7fbe74009c40 comp rx=0 tx=0).stop 2024-08-20T01:36:36.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.347+0000 7fbe82c10740 1 -- 172.21.15.79:0/2001094698 shutdown_connections 2024-08-20T01:36:36.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.347+0000 7fbe82c10740 1 --2- 172.21.15.79:0/2001094698 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55c4cd36b780 0x55c4cd3d8810 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:36.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.347+0000 7fbe82c10740 1 --2- 172.21.15.79:0/2001094698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4cd35a6b0 0x55c4cd356c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:36.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.347+0000 7fbe82c10740 1 --2- 172.21.15.79:0/2001094698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c4cd34c510 0x55c4cd34e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:36.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.347+0000 7fbe82c10740 1 --2- 172.21.15.79:0/2001094698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4cd34bbf0 0x55c4cd34dc50 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:36.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.347+0000 7fbe82c10740 1 -- 172.21.15.79:0/2001094698 >> 172.21.15.79:0/2001094698 conn(0x55c4cd349a20 msgr2=0x55c4cd34aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:36.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.347+0000 7fbe61ffb640 0 client.15249 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:36:36.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.347+0000 7fbe82c10740 1 -- 172.21.15.79:0/2001094698 shutdown_connections 2024-08-20T01:36:36.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.347+0000 7fbe82c10740 1 -- 172.21.15.79:0/2001094698 wait complete. 2024-08-20T01:36:36.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.348+0000 7fbe82c10740 20 client.15249 trim_cache size 0 max 16384 2024-08-20T01:36:36.374 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:36:36.375 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "28484e9a-5e93-11ef-bccf-c7b262605968", 2024-08-20T01:36:36.375 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 4, 2024-08-20T01:36:36.375 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 24512, 2024-08-20T01:36:36.375 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-08-20T01:36:36.375 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-08-20T01:36:36.375 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-08-20T01:36:36.375 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 90.912307233999996, 2024-08-20T01:36:36.375 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 27, 2024-08-20T01:36:36.375 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 74, 2024-08-20T01:36:36.375 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 72, 2024-08-20T01:36:36.375 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 122.797213758 2024-08-20T01:36:36.376 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:36:36.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.348+0000 7fbe80817640 1 -- 172.21.15.79:0/240422223 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbe640b3bd0 msgr2=0x7fbe640b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:36.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.348+0000 7fbe80817640 1 --2- 172.21.15.79:0/240422223 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbe640b3bd0 0x7fbe640b6090 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c102000 tx=0x7fbe6c107e70 comp rx=0 tx=0).stop 2024-08-20T01:36:36.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.348+0000 7fbe80817640 1 -- 172.21.15.79:0/240422223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe7c101990 msgr2=0x7fbe7c197e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:36.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.348+0000 7fbe80817640 1 --2- 172.21.15.79:0/240422223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe7c101990 0x7fbe7c197e00 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c009230 tx=0x7fbe6c004270 comp rx=0 tx=0).stop 2024-08-20T01:36:36.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.348+0000 7fbe80817640 1 -- 172.21.15.79:0/240422223 shutdown_connections 2024-08-20T01:36:36.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.348+0000 7fbe80817640 1 --2- 172.21.15.79:0/240422223 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbe640b3bd0 0x7fbe640b6090 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:36.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.348+0000 7fbe80817640 1 --2- 172.21.15.79:0/240422223 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe7c107d20 0x7fbe7c19d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:36.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.348+0000 7fbe80817640 1 --2- 172.21.15.79:0/240422223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe7c1073a0 0x7fbe7c198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:36.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.348+0000 7fbe80817640 1 --2- 172.21.15.79:0/240422223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe7c101990 0x7fbe7c197e00 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:36.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.348+0000 7fbe80817640 1 -- 172.21.15.79:0/240422223 >> 172.21.15.79:0/240422223 conn(0x7fbe7c0fd400 msgr2=0x7fbe7c0fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:36.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.348+0000 7fbe80817640 1 -- 172.21.15.79:0/240422223 shutdown_connections 2024-08-20T01:36:36.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:36.348+0000 7fbe80817640 1 -- 172.21.15.79:0/240422223 wait complete. 2024-08-20T01:36:36.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:36 smithi175 ceph-mon[22392]: pgmap v325: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-20T01:36:36.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:36 smithi081 ceph-mon[22209]: pgmap v325: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-20T01:36:37.057 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.f status 2024-08-20T01:36:37.304 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:36:37.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.768+0000 7f7c2cf86640 1 -- 172.21.15.79:0/1114835617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c28101990 msgr2=0x7f7c28101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:37.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.768+0000 7f7c2cf86640 1 --2- 172.21.15.79:0/1114835617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c28101990 0x7f7c28101d70 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f7c18009900 tx=0x7f7c1802a410 comp rx=0 tx=0).stop 2024-08-20T01:36:37.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.768+0000 7f7c2cf86640 1 -- 172.21.15.79:0/1114835617 shutdown_connections 2024-08-20T01:36:37.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.768+0000 7f7c2cf86640 1 --2- 172.21.15.79:0/1114835617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c28107d20 0x7f7c2810e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:37.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.768+0000 7f7c2cf86640 1 --2- 172.21.15.79:0/1114835617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c281073a0 0x7f7c281077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:37.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.768+0000 7f7c2cf86640 1 --2- 172.21.15.79:0/1114835617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c28101990 0x7f7c28101d70 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:37.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.768+0000 7f7c2cf86640 1 -- 172.21.15.79:0/1114835617 >> 172.21.15.79:0/1114835617 conn(0x7f7c280fd400 msgr2=0x7f7c280ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:37.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.768+0000 7f7c2cf86640 1 -- 172.21.15.79:0/1114835617 shutdown_connections 2024-08-20T01:36:37.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.768+0000 7f7c2cf86640 1 -- 172.21.15.79:0/1114835617 wait complete. 2024-08-20T01:36:37.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.769+0000 7f7c2cf86640 1 Processor -- start 2024-08-20T01:36:37.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.769+0000 7f7c2cf86640 1 -- start start 2024-08-20T01:36:37.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.769+0000 7f7c2cf86640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c28101990 0x7f7c28199e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:37.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.769+0000 7f7c2cf86640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c281073a0 0x7f7c2819a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:37.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.769+0000 7f7c2cf86640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c28107d20 0x7f7c2819a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:37.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.769+0000 7f7c2cf86640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7c281118d0 con 0x7f7c28107d20 2024-08-20T01:36:37.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.769+0000 7f7c2cf86640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7c28111750 con 0x7f7c281073a0 2024-08-20T01:36:37.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.769+0000 7f7c2cf86640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7c28111a50 con 0x7f7c28101990 2024-08-20T01:36:37.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.770+0000 7f7c26d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c28107d20 0x7f7c2819a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:37.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.770+0000 7f7c26d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c28107d20 0x7f7c2819a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46452/0 (socket says 172.21.15.79:46452) 2024-08-20T01:36:37.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.770+0000 7f7c26d9d640 1 -- 172.21.15.79:0/94815130 learned_addr learned my addr 172.21.15.79:0/94815130 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:37.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.770+0000 7f7c2659c640 1 --2- 172.21.15.79:0/94815130 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c28101990 0x7f7c28199e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:37.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.770+0000 7f7c1dd9b640 1 --2- 172.21.15.79:0/94815130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c281073a0 0x7f7c2819a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:37.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.770+0000 7f7c26d9d640 1 -- 172.21.15.79:0/94815130 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c28101990 msgr2=0x7f7c28199e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:37.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.770+0000 7f7c26d9d640 1 --2- 172.21.15.79:0/94815130 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c28101990 0x7f7c28199e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:37.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.770+0000 7f7c26d9d640 1 -- 172.21.15.79:0/94815130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c281073a0 msgr2=0x7f7c2819a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:37.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.770+0000 7f7c26d9d640 1 --2- 172.21.15.79:0/94815130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c281073a0 0x7f7c2819a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:37.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.770+0000 7f7c26d9d640 1 -- 172.21.15.79:0/94815130 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c281a5220 con 0x7f7c28107d20 2024-08-20T01:36:37.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.770+0000 7f7c26d9d640 1 --2- 172.21.15.79:0/94815130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c28107d20 0x7f7c2819a8e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7c2000b970 tx=0x7f7c2000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:37.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.770+0000 7f7c1ffff640 1 -- 172.21.15.79:0/94815130 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c20019070 con 0x7f7c28107d20 2024-08-20T01:36:37.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.770+0000 7f7c1ffff640 1 -- 172.21.15.79:0/94815130 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7c20014440 con 0x7f7c28107d20 2024-08-20T01:36:37.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.770+0000 7f7c2cf86640 1 -- 172.21.15.79:0/94815130 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c281a5510 con 0x7f7c28107d20 2024-08-20T01:36:37.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.770+0000 7f7c1ffff640 1 -- 172.21.15.79:0/94815130 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c200075d0 con 0x7f7c28107d20 2024-08-20T01:36:37.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.770+0000 7f7c2cf86640 1 -- 172.21.15.79:0/94815130 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c281a5a80 con 0x7f7c28107d20 2024-08-20T01:36:37.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.773+0000 7f7c1ffff640 1 -- 172.21.15.79:0/94815130 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f7c2001c070 con 0x7f7c28107d20 2024-08-20T01:36:37.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.773+0000 7f7c2f37f740 1 Processor -- start 2024-08-20T01:36:37.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.773+0000 7f7c2f37f740 1 -- start start 2024-08-20T01:36:37.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.773+0000 7f7c2f37f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5652a612ebf0 0x5652a612efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:37.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.773+0000 7f7c2f37f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5652a612f510 0x5652a613af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:37.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.773+0000 7f7c2f37f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5652a613b4a0 0x5652a613d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:37.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.773+0000 7f7c2f37f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5652a60a56a0 con 0x5652a612ebf0 2024-08-20T01:36:37.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.773+0000 7f7c2f37f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5652a6094ba0 con 0x5652a613b4a0 2024-08-20T01:36:37.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.773+0000 7f7c2f37f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5652a6098be0 con 0x5652a612f510 2024-08-20T01:36:37.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.773+0000 7f7c1dd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5652a612ebf0 0x5652a612efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:37.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.773+0000 7f7c1dd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5652a612ebf0 0x5652a612efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46466/0 (socket says 172.21.15.79:46466) 2024-08-20T01:36:37.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.773+0000 7f7c1dd9b640 1 -- 172.21.15.79:0/1704861910 learned_addr learned my addr 172.21.15.79:0/1704861910 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:37.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.774+0000 7f7c2659c640 1 --2- 172.21.15.79:0/1704861910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5652a612f510 0x5652a613af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:37.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.774+0000 7f7c1dd9b640 1 -- 172.21.15.79:0/1704861910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5652a612f510 msgr2=0x5652a613af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:37.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.774+0000 7f7c1dd9b640 1 --2- 172.21.15.79:0/1704861910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5652a612f510 0x5652a613af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:37.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.774+0000 7f7c1ffff640 1 --2- 172.21.15.79:0/94815130 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f7c140b3bd0 0x7f7c140b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:37.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.774+0000 7f7c1dd9b640 1 -- 172.21.15.79:0/1704861910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5652a613b4a0 msgr2=0x5652a613d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:37.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.774+0000 7f7c1dd9b640 1 --2- 172.21.15.79:0/1704861910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5652a613b4a0 0x5652a613d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:37.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.774+0000 7f7c1dd9b640 1 -- 172.21.15.79:0/1704861910 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652a5df4540 con 0x5652a612ebf0 2024-08-20T01:36:37.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.774+0000 7f7c2659c640 1 --2- 172.21.15.79:0/1704861910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5652a612f510 0x5652a613af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:36:37.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.774+0000 7f7c26d9d640 1 --2- 172.21.15.79:0/94815130 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f7c140b3bd0 0x7f7c140b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:37.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.774+0000 7f7c1dd9b640 1 --2- 172.21.15.79:0/1704861910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5652a612ebf0 0x5652a612efd0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7c10009b10 tx=0x7f7c100101f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66e217ad6f7a526e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:37.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.774+0000 7f7c1cd99640 1 -- 172.21.15.79:0/1704861910 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c10018020 con 0x5652a612ebf0 2024-08-20T01:36:37.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.774+0000 7f7c1ffff640 1 -- 172.21.15.79:0/94815130 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f7c200e30c0 con 0x7f7c28107d20 2024-08-20T01:36:37.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.774+0000 7f7c1cd99640 1 -- 172.21.15.79:0/1704861910 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7c10010e00 con 0x5652a612ebf0 2024-08-20T01:36:37.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.774+0000 7f7c1cd99640 1 -- 172.21.15.79:0/1704861910 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c100135e0 con 0x5652a612ebf0 2024-08-20T01:36:37.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.775+0000 7f7c2f37f740 1 -- 172.21.15.79:0/1704861910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5652a612ebf0 msgr2=0x5652a612efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:37.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.775+0000 7f7c26d9d640 1 --2- 172.21.15.79:0/94815130 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f7c140b3bd0 0x7f7c140b6090 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7c200a6150 tx=0x7f7c200a6820 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:37.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.775+0000 7f7c2f37f740 1 --2- 172.21.15.79:0/1704861910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5652a612ebf0 0x5652a612efd0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7c10009b10 tx=0x7f7c100101f0 comp rx=0 tx=0).stop 2024-08-20T01:36:37.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.775+0000 7f7c2f37f740 1 -- 172.21.15.79:0/1704861910 shutdown_connections 2024-08-20T01:36:37.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.775+0000 7f7c2f37f740 1 --2- 172.21.15.79:0/1704861910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5652a613b4a0 0x5652a613d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:37.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.775+0000 7f7c2f37f740 1 --2- 172.21.15.79:0/1704861910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5652a612f510 0x5652a613af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:37.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.775+0000 7f7c2f37f740 1 --2- 172.21.15.79:0/1704861910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5652a612ebf0 0x5652a612efd0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:37.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.775+0000 7f7c2f37f740 1 -- 172.21.15.79:0/1704861910 >> 172.21.15.79:0/1704861910 conn(0x5652a612ca20 msgr2=0x5652a612dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:37.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.775+0000 7f7c2f37f740 1 -- 172.21.15.79:0/1704861910 shutdown_connections 2024-08-20T01:36:37.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.775+0000 7f7c2f37f740 1 -- 172.21.15.79:0/1704861910 wait complete. 2024-08-20T01:36:37.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.775+0000 7f7c2f37f740 1 -- start start 2024-08-20T01:36:37.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.775+0000 7f7c2f37f740 1 Processor -- start 2024-08-20T01:36:37.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.776+0000 7f7c2f37f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5652a612ebf0 0x5652a6138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:37.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.776+0000 7f7c2f37f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5652a612f510 0x5652a6138950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:37.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.776+0000 7f7c2f37f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5652a613b4a0 0x5652a6138e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:37.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.776+0000 7f7c2f37f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5652a5ef75f0 con 0x5652a612f510 2024-08-20T01:36:37.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.776+0000 7f7c2f37f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5652a601b6c0 con 0x5652a612ebf0 2024-08-20T01:36:37.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.776+0000 7f7c2f37f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5652a613e150 con 0x5652a613b4a0 2024-08-20T01:36:37.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.776+0000 7f7c2f37f740 10 client.0 _ll_register_callbacks cb 0x5652a60581e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:37.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.776+0000 7f7c2659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5652a612f510 0x5652a6138950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:37.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.776+0000 7f7c2659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5652a612f510 0x5652a6138950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46472/0 (socket says 172.21.15.79:46472) 2024-08-20T01:36:37.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.776+0000 7f7c2659c640 1 -- 172.21.15.79:0/1076303676 learned_addr learned my addr 172.21.15.79:0/1076303676 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:37.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.776+0000 7f7c1dd9b640 1 --2- 172.21.15.79:0/1076303676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5652a612ebf0 0x5652a6138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:37.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.776+0000 7f7c1dd9b640 1 --2- 172.21.15.79:0/1076303676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5652a613b4a0 0x5652a6138e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:37.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.776+0000 7f7c2659c640 1 -- 172.21.15.79:0/1076303676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5652a613b4a0 msgr2=0x5652a6138e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:37.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.776+0000 7f7c2659c640 1 --2- 172.21.15.79:0/1076303676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5652a613b4a0 0x5652a6138e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:37.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.776+0000 7f7c2659c640 1 -- 172.21.15.79:0/1076303676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5652a612ebf0 msgr2=0x5652a6138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:37.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.776+0000 7f7c2659c640 1 --2- 172.21.15.79:0/1076303676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5652a612ebf0 0x5652a6138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:37.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.776+0000 7f7c2659c640 1 -- 172.21.15.79:0/1076303676 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652a61474d0 con 0x5652a612f510 2024-08-20T01:36:37.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.776+0000 7f7c2659c640 1 --2- 172.21.15.79:0/1076303676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5652a612f510 0x5652a6138950 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7c18006010 tx=0x7f7c18031480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cae1cbce30964b4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:37.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.776+0000 7f7c0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:36:37.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.776+0000 7f7c0dffb640 1 -- 172.21.15.79:0/1076303676 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c18035070 con 0x5652a612f510 2024-08-20T01:36:37.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.777+0000 7f7c0dffb640 1 -- 172.21.15.79:0/1076303676 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f7c18004240 con 0x5652a612f510 2024-08-20T01:36:37.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.777+0000 7f7c2f37f740 1 -- 172.21.15.79:0/1076303676 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c10010e00 con 0x5652a612f510 2024-08-20T01:36:37.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.777+0000 7f7c0dffb640 1 -- 172.21.15.79:0/1076303676 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7c18046080 con 0x5652a612f510 2024-08-20T01:36:37.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.777+0000 7f7c2f37f740 10 client.15261 fetch_fsmap learned FSMap version 27 2024-08-20T01:36:37.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.777+0000 7f7c2f37f740 1 -- 172.21.15.79:0/1076303676 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5652a6149e80 con 0x5652a612f510 2024-08-20T01:36:37.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.777+0000 7f7c0dffb640 1 -- 172.21.15.79:0/1076303676 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7c10010e00 con 0x5652a612f510 2024-08-20T01:36:37.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.777+0000 7f7c0dffb640 1 -- 172.21.15.79:0/1076303676 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f7c18043030 con 0x5652a612f510 2024-08-20T01:36:37.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.777+0000 7f7c2f37f740 10 client.15261 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:36:37.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.777+0000 7f7c2f37f740 10 client.15261 resolve_mds: resolved name 'f' to daemon mds.f 2024-08-20T01:36:37.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.777+0000 7f7c2f37f740 20 client.15261 populate_metadata read hostname 'smithi079' 2024-08-20T01:36:37.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.777+0000 7f7c2f37f740 1 --2- 172.21.15.79:0/1076303676 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5652a614c460 0x5652a614d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:37.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.777+0000 7f7c2f37f740 4 client.15261 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:36:37.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.777+0000 7f7c2f37f740 1 -- 172.21.15.79:0/1076303676 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5652a60a75f0 con 0x5652a614c460 2024-08-20T01:36:37.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.777+0000 7f7c1dd9b640 1 --2- 172.21.15.79:0/1076303676 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5652a614c460 0x5652a614d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:37.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.778+0000 7f7c1dd9b640 1 --2- 172.21.15.79:0/1076303676 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5652a614c460 0x5652a614d8d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8d75591cf087f607 server_cookie=2d2025fb7ebb5ec9 in_seq=0 out_seq=0 2024-08-20T01:36:37.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.778+0000 7f7c0dffb640 10 client.15261 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:36:37.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.778+0000 7f7c0dffb640 1 -- 172.21.15.79:0/1076303676 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5652a60a75f0 con 0x5652a614c460 2024-08-20T01:36:37.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.778+0000 7f7c0dffb640 10 client.15261 handle_command_reply: tid=0 2024-08-20T01:36:37.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.778+0000 7f7c2f37f740 1 client.15261 shutdown 2024-08-20T01:36:37.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.779+0000 7f7c2f37f740 1 -- 172.21.15.79:0/1076303676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5652a612f510 msgr2=0x5652a6138950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:37.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.779+0000 7f7c2f37f740 1 --2- 172.21.15.79:0/1076303676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5652a612f510 0x5652a6138950 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7c18006010 tx=0x7f7c18031480 comp rx=0 tx=0).stop 2024-08-20T01:36:37.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.779+0000 7f7c2f37f740 1 -- 172.21.15.79:0/1076303676 shutdown_connections 2024-08-20T01:36:37.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.779+0000 7f7c2f37f740 1 --2- 172.21.15.79:0/1076303676 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5652a614c460 0x5652a614d8d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:37.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.779+0000 7f7c2f37f740 1 --2- 172.21.15.79:0/1076303676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5652a613b4a0 0x5652a6138e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:37.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.779+0000 7f7c2f37f740 1 --2- 172.21.15.79:0/1076303676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5652a612f510 0x5652a6138950 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:37.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.779+0000 7f7c2f37f740 1 --2- 172.21.15.79:0/1076303676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5652a612ebf0 0x5652a6138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:37.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.779+0000 7f7c2f37f740 1 -- 172.21.15.79:0/1076303676 >> 172.21.15.79:0/1076303676 conn(0x5652a612ca20 msgr2=0x5652a6132590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:37.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.779+0000 7f7c0dffb640 0 client.15261 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:36:37.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.779+0000 7f7c2f37f740 1 -- 172.21.15.79:0/1076303676 shutdown_connections 2024-08-20T01:36:37.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.779+0000 7f7c2f37f740 1 -- 172.21.15.79:0/1076303676 wait complete. 2024-08-20T01:36:37.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.779+0000 7f7c2f37f740 20 client.15261 trim_cache size 0 max 16384 2024-08-20T01:36:37.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.796+0000 7f7c2f37f740 1 Processor -- start 2024-08-20T01:36:37.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.796+0000 7f7c2f37f740 1 -- start start 2024-08-20T01:36:37.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.797+0000 7f7c2f37f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5652a612ebf0 0x5652a614c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:37.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.797+0000 7f7c2f37f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5652a612f510 0x5652a6132c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:37.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.797+0000 7f7c2f37f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5652a613b4a0 0x5652a6138ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:37.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.797+0000 7f7c2f37f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5652a614bc10 con 0x5652a613b4a0 2024-08-20T01:36:37.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.797+0000 7f7c2f37f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5652a614c2e0 con 0x5652a612f510 2024-08-20T01:36:37.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.797+0000 7f7c2f37f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5652a614c9b0 con 0x5652a612ebf0 2024-08-20T01:36:37.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.797+0000 7f7c1dd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5652a613b4a0 0x5652a6138ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:37.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.797+0000 7f7c1dd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5652a613b4a0 0x5652a6138ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46482/0 (socket says 172.21.15.79:46482) 2024-08-20T01:36:37.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.797+0000 7f7c1dd9b640 1 -- 172.21.15.79:0/2851053905 learned_addr learned my addr 172.21.15.79:0/2851053905 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:37.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.797+0000 7f7c1dd9b640 1 --2- 172.21.15.79:0/2851053905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5652a612ebf0 0x5652a614c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:37.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.797+0000 7f7c1dd9b640 1 -- 172.21.15.79:0/2851053905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5652a612ebf0 msgr2=0x5652a614c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:37.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.797+0000 7f7c1dd9b640 1 --2- 172.21.15.79:0/2851053905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5652a612ebf0 0x5652a614c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:37.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.797+0000 7f7c1dd9b640 1 -- 172.21.15.79:0/2851053905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5652a612f510 msgr2=0x5652a6132c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:37.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.797+0000 7f7c1dd9b640 1 --2- 172.21.15.79:0/2851053905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5652a612f510 0x5652a6132c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:37.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.797+0000 7f7c1dd9b640 1 -- 172.21.15.79:0/2851053905 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652a6136910 con 0x5652a613b4a0 2024-08-20T01:36:37.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.797+0000 7f7c1dd9b640 1 --2- 172.21.15.79:0/2851053905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5652a613b4a0 0x5652a6138ca0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7c10017040 tx=0x7f7c10008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f12041a934f1045 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:37.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.797+0000 7f7c0ffff640 1 -- 172.21.15.79:0/2851053905 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c10018040 con 0x5652a613b4a0 2024-08-20T01:36:37.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.797+0000 7f7c0ffff640 1 -- 172.21.15.79:0/2851053905 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7c10010c80 con 0x5652a613b4a0 2024-08-20T01:36:37.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.797+0000 7f7c0ffff640 1 -- 172.21.15.79:0/2851053905 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1002c350 con 0x5652a613b4a0 2024-08-20T01:36:37.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.798+0000 7f7c2f37f740 1 -- 172.21.15.79:0/2851053905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5652a613b4a0 msgr2=0x5652a6138ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:37.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.798+0000 7f7c2f37f740 1 --2- 172.21.15.79:0/2851053905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5652a613b4a0 0x5652a6138ca0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7c10017040 tx=0x7f7c10008040 comp rx=0 tx=0).stop 2024-08-20T01:36:37.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.798+0000 7f7c2f37f740 1 -- 172.21.15.79:0/2851053905 shutdown_connections 2024-08-20T01:36:37.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.798+0000 7f7c2f37f740 1 --2- 172.21.15.79:0/2851053905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5652a613b4a0 0x5652a6138ca0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:37.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.798+0000 7f7c2f37f740 1 --2- 172.21.15.79:0/2851053905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5652a612f510 0x5652a6132c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:37.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.798+0000 7f7c2f37f740 1 --2- 172.21.15.79:0/2851053905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5652a612ebf0 0x5652a614c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:37.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.798+0000 7f7c2f37f740 1 -- 172.21.15.79:0/2851053905 >> 172.21.15.79:0/2851053905 conn(0x5652a612ca20 msgr2=0x5652a6133640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:37.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.798+0000 7f7c2f37f740 1 -- 172.21.15.79:0/2851053905 shutdown_connections 2024-08-20T01:36:37.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.798+0000 7f7c2f37f740 1 -- 172.21.15.79:0/2851053905 wait complete. 2024-08-20T01:36:37.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.798+0000 7f7c2f37f740 1 -- start start 2024-08-20T01:36:37.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.799+0000 7f7c2f37f740 1 Processor -- start 2024-08-20T01:36:37.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.799+0000 7f7c2f37f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5652a612ebf0 0x5652a6150b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:37.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.799+0000 7f7c2f37f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5652a612f510 0x5652a61510a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:37.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.799+0000 7f7c2f37f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5652a613b4a0 0x5652a61515e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:37.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.799+0000 7f7c2f37f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5652a614d750 con 0x5652a613b4a0 2024-08-20T01:36:37.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.799+0000 7f7c2f37f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5652a614d080 con 0x5652a612ebf0 2024-08-20T01:36:37.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.799+0000 7f7c2f37f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5652a614de20 con 0x5652a612f510 2024-08-20T01:36:37.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.799+0000 7f7c2f37f740 10 client.0 _ll_register_callbacks cb 0x7f7c18009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:37.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.799+0000 7f7c1dd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5652a613b4a0 0x5652a61515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:37.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.799+0000 7f7c1dd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5652a613b4a0 0x5652a61515e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46486/0 (socket says 172.21.15.79:46486) 2024-08-20T01:36:37.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.799+0000 7f7c1dd9b640 1 -- 172.21.15.79:0/4186091425 learned_addr learned my addr 172.21.15.79:0/4186091425 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:37.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.799+0000 7f7c1dd9b640 1 --2- 172.21.15.79:0/4186091425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5652a612ebf0 0x5652a6150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:37.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.799+0000 7f7c2659c640 1 --2- 172.21.15.79:0/4186091425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5652a612f510 0x5652a61510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:37.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.799+0000 7f7c1dd9b640 1 -- 172.21.15.79:0/4186091425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5652a612f510 msgr2=0x5652a61510a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:37.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.799+0000 7f7c1dd9b640 1 --2- 172.21.15.79:0/4186091425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5652a612f510 0x5652a61510a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:37.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.799+0000 7f7c1dd9b640 1 -- 172.21.15.79:0/4186091425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5652a612ebf0 msgr2=0x5652a6150b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:37.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.799+0000 7f7c1dd9b640 1 --2- 172.21.15.79:0/4186091425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5652a612ebf0 0x5652a6150b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:37.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.799+0000 7f7c1dd9b640 1 -- 172.21.15.79:0/4186091425 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652a61b4d60 con 0x5652a613b4a0 2024-08-20T01:36:37.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.799+0000 7f7c1dd9b640 1 --2- 172.21.15.79:0/4186091425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5652a613b4a0 0x5652a61515e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7c10014fc0 tx=0x7f7c100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d80f297236a169f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:37.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.799+0000 7f7c0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:36:37.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.800+0000 7f7c0dffb640 1 -- 172.21.15.79:0/4186091425 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c10018040 con 0x5652a613b4a0 2024-08-20T01:36:37.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.800+0000 7f7c0dffb640 1 -- 172.21.15.79:0/4186091425 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f7c10014710 con 0x5652a613b4a0 2024-08-20T01:36:37.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.800+0000 7f7c2f37f740 1 -- 172.21.15.79:0/4186091425 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c10010c80 con 0x5652a613b4a0 2024-08-20T01:36:37.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.800+0000 7f7c0dffb640 1 -- 172.21.15.79:0/4186091425 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7c10014950 con 0x5652a613b4a0 2024-08-20T01:36:37.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.800+0000 7f7c2f37f740 10 client.15267 fetch_fsmap learned FSMap version 27 2024-08-20T01:36:37.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.800+0000 7f7c2f37f740 1 -- 172.21.15.79:0/4186091425 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5652a61b6040 con 0x5652a613b4a0 2024-08-20T01:36:37.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.800+0000 7f7c0dffb640 1 -- 172.21.15.79:0/4186091425 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7c10010c80 con 0x5652a613b4a0 2024-08-20T01:36:37.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.800+0000 7f7c0dffb640 1 -- 172.21.15.79:0/4186091425 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f7c10013500 con 0x5652a613b4a0 2024-08-20T01:36:37.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.800+0000 7f7c2f37f740 10 client.15267 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:36:37.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.800+0000 7f7c2f37f740 10 client.15267 resolve_mds: resolved name 'f' to daemon mds.f 2024-08-20T01:36:37.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.800+0000 7f7c2f37f740 20 client.15267 populate_metadata read hostname 'smithi079' 2024-08-20T01:36:37.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.800+0000 7f7c2f37f740 1 --2- 172.21.15.79:0/4186091425 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5652a61ba480 0x5652a61b9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:37.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.800+0000 7f7c2f37f740 4 client.15267 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-20T01:36:37.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.800+0000 7f7c2f37f740 1 -- 172.21.15.79:0/4186091425 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "status"}) -- 0x5652a60a3090 con 0x5652a61ba480 2024-08-20T01:36:37.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.800+0000 7f7c2659c640 1 --2- 172.21.15.79:0/4186091425 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5652a61ba480 0x5652a61b9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:37.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.801+0000 7f7c2659c640 1 --2- 172.21.15.79:0/4186091425 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5652a61ba480 0x5652a61b9190 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7c07ebd3e7f96ec0 server_cookie=535e36694f15131c in_seq=0 out_seq=0 2024-08-20T01:36:37.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.801+0000 7f7c0dffb640 10 client.15267 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:36:37.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.801+0000 7f7c0dffb640 1 -- 172.21.15.79:0/4186091425 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5652a60a3090 con 0x5652a61ba480 2024-08-20T01:36:37.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.801+0000 7f7c0dffb640 10 client.15267 handle_command_reply: tid=0 2024-08-20T01:36:37.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.801+0000 7f7c2f37f740 1 client.15267 shutdown 2024-08-20T01:36:37.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.801+0000 7f7c2f37f740 1 -- 172.21.15.79:0/4186091425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5652a613b4a0 msgr2=0x5652a61515e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:37.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.801+0000 7f7c2f37f740 1 --2- 172.21.15.79:0/4186091425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5652a613b4a0 0x5652a61515e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7c10014fc0 tx=0x7f7c100046c0 comp rx=0 tx=0).stop 2024-08-20T01:36:37.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.801+0000 7f7c2f37f740 1 -- 172.21.15.79:0/4186091425 shutdown_connections 2024-08-20T01:36:37.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.801+0000 7f7c2f37f740 1 --2- 172.21.15.79:0/4186091425 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5652a61ba480 0x5652a61b9190 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:37.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.801+0000 7f7c2f37f740 1 --2- 172.21.15.79:0/4186091425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5652a613b4a0 0x5652a61515e0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:37.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.801+0000 7f7c2f37f740 1 --2- 172.21.15.79:0/4186091425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5652a612f510 0x5652a61510a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:37.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.801+0000 7f7c0dffb640 0 client.15267 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:36:37.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.801+0000 7f7c2f37f740 1 --2- 172.21.15.79:0/4186091425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5652a612ebf0 0x5652a6150b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:37.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.801+0000 7f7c2f37f740 1 -- 172.21.15.79:0/4186091425 >> 172.21.15.79:0/4186091425 conn(0x5652a612ca20 msgr2=0x5652a61463e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:37.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.801+0000 7f7c2f37f740 1 -- 172.21.15.79:0/4186091425 shutdown_connections 2024-08-20T01:36:37.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.801+0000 7f7c2f37f740 1 -- 172.21.15.79:0/4186091425 wait complete. 2024-08-20T01:36:37.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.801+0000 7f7c2f37f740 20 client.15267 trim_cache size 0 max 16384 2024-08-20T01:36:37.812 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:36:37.812 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "28484e9a-5e93-11ef-bccf-c7b262605968", 2024-08-20T01:36:37.812 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 3, 2024-08-20T01:36:37.812 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 24514, 2024-08-20T01:36:37.812 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-08-20T01:36:37.812 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-08-20T01:36:37.812 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-08-20T01:36:37.812 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 93.377267107999998, 2024-08-20T01:36:37.813 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 27, 2024-08-20T01:36:37.813 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 74, 2024-08-20T01:36:37.813 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 72, 2024-08-20T01:36:37.813 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 129.10513895099999 2024-08-20T01:36:37.813 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:36:37.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.802+0000 7f7c2cf86640 1 -- 172.21.15.79:0/94815130 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f7c140b3bd0 msgr2=0x7f7c140b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:37.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.802+0000 7f7c2cf86640 1 --2- 172.21.15.79:0/94815130 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f7c140b3bd0 0x7f7c140b6090 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7c200a6150 tx=0x7f7c200a6820 comp rx=0 tx=0).stop 2024-08-20T01:36:37.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.802+0000 7f7c2cf86640 1 -- 172.21.15.79:0/94815130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c28107d20 msgr2=0x7f7c2819a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:37.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.802+0000 7f7c2cf86640 1 --2- 172.21.15.79:0/94815130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c28107d20 0x7f7c2819a8e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7c2000b970 tx=0x7f7c2000bd70 comp rx=0 tx=0).stop 2024-08-20T01:36:37.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.802+0000 7f7c2cf86640 1 -- 172.21.15.79:0/94815130 shutdown_connections 2024-08-20T01:36:37.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.802+0000 7f7c2cf86640 1 --2- 172.21.15.79:0/94815130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c28107d20 0x7f7c2819a8e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:37.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.802+0000 7f7c2cf86640 1 --2- 172.21.15.79:0/94815130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c281073a0 0x7f7c2819a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:37.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.802+0000 7f7c2cf86640 1 --2- 172.21.15.79:0/94815130 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f7c140b3bd0 0x7f7c140b6090 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:37.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.802+0000 7f7c2cf86640 1 --2- 172.21.15.79:0/94815130 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c28101990 0x7f7c28199e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:37.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.802+0000 7f7c2cf86640 1 -- 172.21.15.79:0/94815130 >> 172.21.15.79:0/94815130 conn(0x7f7c280fd400 msgr2=0x7f7c280ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:37.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.802+0000 7f7c2cf86640 1 -- 172.21.15.79:0/94815130 shutdown_connections 2024-08-20T01:36:37.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:37.802+0000 7f7c2cf86640 1 -- 172.21.15.79:0/94815130 wait complete. 2024-08-20T01:36:38.330 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:38 smithi081 ceph-mon[22209]: pgmap v326: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-20T01:36:38.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:38 smithi175 ceph-mon[22392]: pgmap v326: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-20T01:36:38.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:38 smithi079 ceph-mon[18656]: pgmap v326: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-20T01:36:38.574 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.c status 2024-08-20T01:36:38.885 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:36:39.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.327+0000 7f0175d84640 1 -- 172.21.15.79:0/1557281718 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01701042e0 msgr2=0x7f017010c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:39.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.327+0000 7f0175d84640 1 --2- 172.21.15.79:0/1557281718 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01701042e0 0x7f017010c7d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0158009900 tx=0x7f015802a410 comp rx=0 tx=0).stop 2024-08-20T01:36:39.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.327+0000 7f0175d84640 1 -- 172.21.15.79:0/1557281718 shutdown_connections 2024-08-20T01:36:39.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.327+0000 7f0175d84640 1 --2- 172.21.15.79:0/1557281718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f017010ce20 0x7f017010f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.327+0000 7f0175d84640 1 --2- 172.21.15.79:0/1557281718 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01701042e0 0x7f017010c7d0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.327+0000 7f0175d84640 1 --2- 172.21.15.79:0/1557281718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01701039c0 0x7f0170103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.327+0000 7f0175d84640 1 -- 172.21.15.79:0/1557281718 >> 172.21.15.79:0/1557281718 conn(0x7f01700fd420 msgr2=0x7f01700ff840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:39.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.327+0000 7f0175d84640 1 -- 172.21.15.79:0/1557281718 shutdown_connections 2024-08-20T01:36:39.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.327+0000 7f0175d84640 1 -- 172.21.15.79:0/1557281718 wait complete. 2024-08-20T01:36:39.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.327+0000 7f0175d84640 1 Processor -- start 2024-08-20T01:36:39.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.328+0000 7f0175d84640 1 -- start start 2024-08-20T01:36:39.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.328+0000 7f0175d84640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01701039c0 0x7f0170199040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:39.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.328+0000 7f0175d84640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01701042e0 0x7f0170199580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:39.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.328+0000 7f0175d84640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f017010ce20 0x7f017019e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:39.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.328+0000 7f0175d84640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0170112a50 con 0x7f01701042e0 2024-08-20T01:36:39.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.328+0000 7f0175d84640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f01701128d0 con 0x7f01701039c0 2024-08-20T01:36:39.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.328+0000 7f0175d84640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0170112bd0 con 0x7f017010ce20 2024-08-20T01:36:39.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.328+0000 7f0167fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01701042e0 0x7f0170199580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:39.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.328+0000 7f0167fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01701042e0 0x7f0170199580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46496/0 (socket says 172.21.15.79:46496) 2024-08-20T01:36:39.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.328+0000 7f0167fff640 1 -- 172.21.15.79:0/3697476472 learned_addr learned my addr 172.21.15.79:0/3697476472 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:39.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.328+0000 7f016ffff640 1 --2- 172.21.15.79:0/3697476472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f017010ce20 0x7f017019e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:39.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.328+0000 7f016f7fe640 1 --2- 172.21.15.79:0/3697476472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01701039c0 0x7f0170199040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:39.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.328+0000 7f0167fff640 1 -- 172.21.15.79:0/3697476472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f017010ce20 msgr2=0x7f017019e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:39.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.328+0000 7f0167fff640 1 --2- 172.21.15.79:0/3697476472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f017010ce20 0x7f017019e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.328+0000 7f0167fff640 1 -- 172.21.15.79:0/3697476472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01701039c0 msgr2=0x7f0170199040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:39.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.328+0000 7f0167fff640 1 --2- 172.21.15.79:0/3697476472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01701039c0 0x7f0170199040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.328+0000 7f0167fff640 1 -- 172.21.15.79:0/3697476472 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f017019f0f0 con 0x7f01701042e0 2024-08-20T01:36:39.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.328+0000 7f016ffff640 1 --2- 172.21.15.79:0/3697476472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f017010ce20 0x7f017019e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:36:39.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.328+0000 7f016f7fe640 1 --2- 172.21.15.79:0/3697476472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01701039c0 0x7f0170199040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:36:39.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.328+0000 7f0167fff640 1 --2- 172.21.15.79:0/3697476472 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01701042e0 0x7f0170199580 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f015802a930 tx=0x7f0158003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:39.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.328+0000 7f016d7fa640 1 -- 172.21.15.79:0/3697476472 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f015803f070 con 0x7f01701042e0 2024-08-20T01:36:39.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.329+0000 7f0175d84640 1 -- 172.21.15.79:0/3697476472 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f017019f380 con 0x7f01701042e0 2024-08-20T01:36:39.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.329+0000 7f016d7fa640 1 -- 172.21.15.79:0/3697476472 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f015803bd00 con 0x7f01701042e0 2024-08-20T01:36:39.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.329+0000 7f016d7fa640 1 -- 172.21.15.79:0/3697476472 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0158035030 con 0x7f01701042e0 2024-08-20T01:36:39.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.329+0000 7f0175d84640 1 -- 172.21.15.79:0/3697476472 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01701a5aa0 con 0x7f01701042e0 2024-08-20T01:36:39.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.331+0000 7f016d7fa640 1 -- 172.21.15.79:0/3697476472 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f0158042070 con 0x7f01701042e0 2024-08-20T01:36:39.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.331+0000 7f017817d740 1 Processor -- start 2024-08-20T01:36:39.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.331+0000 7f017817d740 1 -- start start 2024-08-20T01:36:39.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.331+0000 7f017817d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638d49c6bf0 0x5638d49c6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:39.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.331+0000 7f017817d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638d49c7510 0x5638d49d2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:39.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.331+0000 7f017817d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d49d34a0 0x5638d49d5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:39.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.331+0000 7f017817d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5638d493d6a0 con 0x5638d49d34a0 2024-08-20T01:36:39.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.331+0000 7f017817d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5638d492cba0 con 0x5638d49c6bf0 2024-08-20T01:36:39.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.331+0000 7f017817d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5638d4930be0 con 0x5638d49c7510 2024-08-20T01:36:39.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.332+0000 7f0167fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d49d34a0 0x5638d49d5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:39.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.332+0000 7f0167fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d49d34a0 0x5638d49d5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46500/0 (socket says 172.21.15.79:46500) 2024-08-20T01:36:39.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.332+0000 7f0167fff640 1 -- 172.21.15.79:0/2497221082 learned_addr learned my addr 172.21.15.79:0/2497221082 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:39.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.332+0000 7f016ffff640 1 --2- 172.21.15.79:0/2497221082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638d49c6bf0 0x5638d49c6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:39.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.332+0000 7f016f7fe640 1 --2- 172.21.15.79:0/2497221082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638d49c7510 0x5638d49d2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:39.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.332+0000 7f0167fff640 1 -- 172.21.15.79:0/2497221082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638d49c7510 msgr2=0x5638d49d2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:39.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.332+0000 7f0167fff640 1 --2- 172.21.15.79:0/2497221082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638d49c7510 0x5638d49d2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.332+0000 7f0167fff640 1 -- 172.21.15.79:0/2497221082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638d49c6bf0 msgr2=0x5638d49c6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:39.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.332+0000 7f0167fff640 1 --2- 172.21.15.79:0/2497221082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638d49c6bf0 0x5638d49c6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.332+0000 7f0167fff640 1 -- 172.21.15.79:0/2497221082 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638d468c540 con 0x5638d49d34a0 2024-08-20T01:36:39.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.332+0000 7f016d7fa640 1 --2- 172.21.15.79:0/3697476472 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f015c0b3bd0 0x7f015c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:39.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.332+0000 7f0167fff640 1 --2- 172.21.15.79:0/2497221082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d49d34a0 0x5638d49d5890 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f015810a7a0 tx=0x7f015810a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe63467f55c9766e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:39.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.332+0000 7f016ffff640 1 --2- 172.21.15.79:0/3697476472 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f015c0b3bd0 0x7f015c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:39.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.332+0000 7f0165ffb640 1 -- 172.21.15.79:0/2497221082 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01580c7360 con 0x5638d49d34a0 2024-08-20T01:36:39.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.332+0000 7f016d7fa640 1 -- 172.21.15.79:0/3697476472 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f0158104540 con 0x7f01701042e0 2024-08-20T01:36:39.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.332+0000 7f0165ffb640 1 -- 172.21.15.79:0/2497221082 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f01580cafb0 con 0x5638d49d34a0 2024-08-20T01:36:39.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.332+0000 7f0165ffb640 1 -- 172.21.15.79:0/2497221082 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01580cac10 con 0x5638d49d34a0 2024-08-20T01:36:39.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.333+0000 7f016ffff640 1 --2- 172.21.15.79:0/3697476472 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f015c0b3bd0 0x7f015c0b6090 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f016800f4c0 tx=0x7f0168007740 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:39.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.333+0000 7f017817d740 1 -- 172.21.15.79:0/2497221082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d49d34a0 msgr2=0x5638d49d5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:39.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.333+0000 7f017817d740 1 --2- 172.21.15.79:0/2497221082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d49d34a0 0x5638d49d5890 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f015810a7a0 tx=0x7f015810a890 comp rx=0 tx=0).stop 2024-08-20T01:36:39.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.333+0000 7f017817d740 1 -- 172.21.15.79:0/2497221082 shutdown_connections 2024-08-20T01:36:39.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.333+0000 7f017817d740 1 --2- 172.21.15.79:0/2497221082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d49d34a0 0x5638d49d5890 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.333+0000 7f017817d740 1 --2- 172.21.15.79:0/2497221082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638d49c7510 0x5638d49d2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.333+0000 7f017817d740 1 --2- 172.21.15.79:0/2497221082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638d49c6bf0 0x5638d49c6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.333+0000 7f017817d740 1 -- 172.21.15.79:0/2497221082 >> 172.21.15.79:0/2497221082 conn(0x5638d49c4a20 msgr2=0x5638d49c5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:39.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.333+0000 7f017817d740 1 -- 172.21.15.79:0/2497221082 shutdown_connections 2024-08-20T01:36:39.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.333+0000 7f017817d740 1 -- 172.21.15.79:0/2497221082 wait complete. 2024-08-20T01:36:39.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.333+0000 7f017817d740 1 -- start start 2024-08-20T01:36:39.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.334+0000 7f017817d740 1 Processor -- start 2024-08-20T01:36:39.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.334+0000 7f017817d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638d49c6bf0 0x5638d49d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:39.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.334+0000 7f017817d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d49c7510 0x5638d49d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:39.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.334+0000 7f017817d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638d49d34a0 0x5638d49d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:39.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.334+0000 7f017817d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5638d478f5f0 con 0x5638d49c7510 2024-08-20T01:36:39.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.334+0000 7f017817d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5638d48b36c0 con 0x5638d49c6bf0 2024-08-20T01:36:39.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.334+0000 7f017817d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5638d49d5f10 con 0x5638d49d34a0 2024-08-20T01:36:39.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.334+0000 7f017817d740 10 client.0 _ll_register_callbacks cb 0x5638d48f01e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:39.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.334+0000 7f0167fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d49c7510 0x5638d49d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:39.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.334+0000 7f0167fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d49c7510 0x5638d49d09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46516/0 (socket says 172.21.15.79:46516) 2024-08-20T01:36:39.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.334+0000 7f0167fff640 1 -- 172.21.15.79:0/4177244276 learned_addr learned my addr 172.21.15.79:0/4177244276 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:39.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.334+0000 7f016f7fe640 1 --2- 172.21.15.79:0/4177244276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638d49c6bf0 0x5638d49d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:39.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.334+0000 7f016ffff640 1 --2- 172.21.15.79:0/4177244276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638d49d34a0 0x5638d49d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:39.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.334+0000 7f0167fff640 1 -- 172.21.15.79:0/4177244276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638d49d34a0 msgr2=0x5638d49d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:39.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.334+0000 7f0167fff640 1 --2- 172.21.15.79:0/4177244276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638d49d34a0 0x5638d49d0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.334+0000 7f0167fff640 1 -- 172.21.15.79:0/4177244276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638d49c6bf0 msgr2=0x5638d49d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:39.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.334+0000 7f0167fff640 1 --2- 172.21.15.79:0/4177244276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638d49c6bf0 0x5638d49d04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.334+0000 7f0167fff640 1 -- 172.21.15.79:0/4177244276 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638d49df280 con 0x5638d49c7510 2024-08-20T01:36:39.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.334+0000 7f016f7fe640 1 --2- 172.21.15.79:0/4177244276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638d49c6bf0 0x5638d49d04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:36:39.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.334+0000 7f016ffff640 1 --2- 172.21.15.79:0/4177244276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638d49d34a0 0x5638d49d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:36:39.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.334+0000 7f0167fff640 1 --2- 172.21.15.79:0/4177244276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d49c7510 0x5638d49d09f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f01580ee040 tx=0x7f01580ee0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=326db0ca352d2f6a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:39.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.334+0000 7f014effd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:36:39.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.335+0000 7f014effd640 1 -- 172.21.15.79:0/4177244276 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0158049030 con 0x5638d49c7510 2024-08-20T01:36:39.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.335+0000 7f014effd640 1 -- 172.21.15.79:0/4177244276 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f0158107b30 con 0x5638d49c7510 2024-08-20T01:36:39.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.335+0000 7f017817d740 1 -- 172.21.15.79:0/4177244276 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01580cafb0 con 0x5638d49c7510 2024-08-20T01:36:39.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.335+0000 7f014effd640 1 -- 172.21.15.79:0/4177244276 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f01580cadf0 con 0x5638d49c7510 2024-08-20T01:36:39.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.335+0000 7f017817d740 10 client.15279 fetch_fsmap learned FSMap version 27 2024-08-20T01:36:39.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.335+0000 7f017817d740 1 -- 172.21.15.79:0/4177244276 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5638d49e1c30 con 0x5638d49c7510 2024-08-20T01:36:39.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.335+0000 7f014effd640 1 -- 172.21.15.79:0/4177244276 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f01580cafb0 con 0x5638d49c7510 2024-08-20T01:36:39.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.335+0000 7f014effd640 1 -- 172.21.15.79:0/4177244276 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f01580c7730 con 0x5638d49c7510 2024-08-20T01:36:39.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.335+0000 7f017817d740 10 client.15279 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:36:39.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.335+0000 7f017817d740 10 client.15279 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-20T01:36:39.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.335+0000 7f017817d740 20 client.15279 populate_metadata read hostname 'smithi079' 2024-08-20T01:36:39.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.335+0000 7f017817d740 1 --2- 172.21.15.79:0/4177244276 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x5638d49e4030 0x5638d49e54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:39.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.335+0000 7f017817d740 4 client.15279 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:36:39.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.335+0000 7f017817d740 1 -- 172.21.15.79:0/4177244276 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5638d493f5f0 con 0x5638d49e4030 2024-08-20T01:36:39.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.335+0000 7f016f7fe640 1 --2- 172.21.15.79:0/4177244276 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x5638d49e4030 0x5638d49e54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:39.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.336+0000 7f014effd640 10 client.15279 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:36:39.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.336+0000 7f016f7fe640 1 --2- 172.21.15.79:0/4177244276 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x5638d49e4030 0x5638d49e54a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=82deb5f0cb7cfacd server_cookie=feb0b8390d5e8482 in_seq=0 out_seq=0 2024-08-20T01:36:39.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.337+0000 7f014effd640 1 -- 172.21.15.79:0/4177244276 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5638d493f5f0 con 0x5638d49e4030 2024-08-20T01:36:39.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.337+0000 7f014effd640 10 client.15279 handle_command_reply: tid=0 2024-08-20T01:36:39.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.337+0000 7f017817d740 1 client.15279 shutdown 2024-08-20T01:36:39.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.337+0000 7f017817d740 1 -- 172.21.15.79:0/4177244276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d49c7510 msgr2=0x5638d49d09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:39.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.337+0000 7f017817d740 1 --2- 172.21.15.79:0/4177244276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d49c7510 0x5638d49d09f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f01580ee040 tx=0x7f01580ee0d0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.337+0000 7f017817d740 1 -- 172.21.15.79:0/4177244276 shutdown_connections 2024-08-20T01:36:39.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.337+0000 7f017817d740 1 --2- 172.21.15.79:0/4177244276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638d49d34a0 0x5638d49d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.337+0000 7f017817d740 1 --2- 172.21.15.79:0/4177244276 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x5638d49e4030 0x5638d49e54a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.337+0000 7f017817d740 1 --2- 172.21.15.79:0/4177244276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d49c7510 0x5638d49d09f0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.337+0000 7f017817d740 1 --2- 172.21.15.79:0/4177244276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638d49c6bf0 0x5638d49d04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.337+0000 7f014effd640 0 client.15279 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:36:39.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.337+0000 7f017817d740 1 -- 172.21.15.79:0/4177244276 >> 172.21.15.79:0/4177244276 conn(0x5638d49c4a20 msgr2=0x5638d49ca5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:39.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.337+0000 7f017817d740 1 -- 172.21.15.79:0/4177244276 shutdown_connections 2024-08-20T01:36:39.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.337+0000 7f017817d740 1 -- 172.21.15.79:0/4177244276 wait complete. 2024-08-20T01:36:39.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.337+0000 7f017817d740 20 client.15279 trim_cache size 0 max 16384 2024-08-20T01:36:39.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.355+0000 7f017817d740 1 Processor -- start 2024-08-20T01:36:39.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.355+0000 7f017817d740 1 -- start start 2024-08-20T01:36:39.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.355+0000 7f017817d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638d49c6bf0 0x5638d49cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:39.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.355+0000 7f017817d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d49c7510 0x5638d49e2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:39.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.355+0000 7f017817d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638d49d34a0 0x5638d49de870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:39.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.355+0000 7f017817d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5638d49e37e0 con 0x5638d49c7510 2024-08-20T01:36:39.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.355+0000 7f017817d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5638d49e3eb0 con 0x5638d49c6bf0 2024-08-20T01:36:39.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.355+0000 7f017817d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5638d49e4580 con 0x5638d49d34a0 2024-08-20T01:36:39.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.355+0000 7f0167fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d49c7510 0x5638d49e2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:39.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.355+0000 7f0167fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d49c7510 0x5638d49e2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46532/0 (socket says 172.21.15.79:46532) 2024-08-20T01:36:39.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.355+0000 7f0167fff640 1 -- 172.21.15.79:0/3838674991 learned_addr learned my addr 172.21.15.79:0/3838674991 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:39.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.355+0000 7f0167fff640 1 -- 172.21.15.79:0/3838674991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638d49d34a0 msgr2=0x5638d49de870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:39.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.355+0000 7f0167fff640 1 --2- 172.21.15.79:0/3838674991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638d49d34a0 0x5638d49de870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.355+0000 7f0167fff640 1 -- 172.21.15.79:0/3838674991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638d49c6bf0 msgr2=0x5638d49cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:39.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.355+0000 7f0167fff640 1 --2- 172.21.15.79:0/3838674991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638d49c6bf0 0x5638d49cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.355+0000 7f0167fff640 1 -- 172.21.15.79:0/3838674991 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638d49c65d0 con 0x5638d49c7510 2024-08-20T01:36:39.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.355+0000 7f0167fff640 1 --2- 172.21.15.79:0/3838674991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d49c7510 0x5638d49e2f80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0158005ec0 tx=0x7f015810a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b20bae94f1b979e4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:39.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.355+0000 7f01657fa640 1 -- 172.21.15.79:0/3838674991 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0158049030 con 0x5638d49c7510 2024-08-20T01:36:39.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.356+0000 7f01657fa640 1 -- 172.21.15.79:0/3838674991 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f015810a190 con 0x5638d49c7510 2024-08-20T01:36:39.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.356+0000 7f01657fa640 1 -- 172.21.15.79:0/3838674991 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01580cb270 con 0x5638d49c7510 2024-08-20T01:36:39.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.356+0000 7f017817d740 1 -- 172.21.15.79:0/3838674991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d49c7510 msgr2=0x5638d49e2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:39.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.356+0000 7f017817d740 1 --2- 172.21.15.79:0/3838674991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d49c7510 0x5638d49e2f80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0158005ec0 tx=0x7f015810a890 comp rx=0 tx=0).stop 2024-08-20T01:36:39.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.356+0000 7f017817d740 1 -- 172.21.15.79:0/3838674991 shutdown_connections 2024-08-20T01:36:39.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.356+0000 7f017817d740 1 --2- 172.21.15.79:0/3838674991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638d49d34a0 0x5638d49de870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.356+0000 7f017817d740 1 --2- 172.21.15.79:0/3838674991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d49c7510 0x5638d49e2f80 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.356+0000 7f017817d740 1 --2- 172.21.15.79:0/3838674991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638d49c6bf0 0x5638d49cadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.356+0000 7f017817d740 1 -- 172.21.15.79:0/3838674991 >> 172.21.15.79:0/3838674991 conn(0x5638d49c4a20 msgr2=0x5638d49de160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:39.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.356+0000 7f017817d740 1 -- 172.21.15.79:0/3838674991 shutdown_connections 2024-08-20T01:36:39.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.356+0000 7f017817d740 1 -- 172.21.15.79:0/3838674991 wait complete. 2024-08-20T01:36:39.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.356+0000 7f017817d740 1 -- start start 2024-08-20T01:36:39.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.357+0000 7f017817d740 1 Processor -- start 2024-08-20T01:36:39.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.357+0000 7f017817d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d49c6bf0 0x5638d49eb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:39.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.357+0000 7f017817d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638d49c7510 0x5638d49ebb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:39.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.357+0000 7f017817d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638d49d34a0 0x5638d49e8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:39.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.357+0000 7f017817d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5638d49e5320 con 0x5638d49c6bf0 2024-08-20T01:36:39.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.357+0000 7f017817d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5638d49e4c50 con 0x5638d49d34a0 2024-08-20T01:36:39.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.357+0000 7f017817d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5638d49e59f0 con 0x5638d49c7510 2024-08-20T01:36:39.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.357+0000 7f017817d740 10 client.0 _ll_register_callbacks cb 0x7f01680075e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:39.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.357+0000 7f016f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d49c6bf0 0x5638d49eb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:39.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.357+0000 7f016f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d49c6bf0 0x5638d49eb5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46542/0 (socket says 172.21.15.79:46542) 2024-08-20T01:36:39.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.357+0000 7f016f7fe640 1 -- 172.21.15.79:0/2383181377 learned_addr learned my addr 172.21.15.79:0/2383181377 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:39.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.357+0000 7f016f7fe640 1 -- 172.21.15.79:0/2383181377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638d49c7510 msgr2=0x5638d49ebb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:39.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.357+0000 7f016f7fe640 1 --2- 172.21.15.79:0/2383181377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638d49c7510 0x5638d49ebb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.357+0000 7f016f7fe640 1 -- 172.21.15.79:0/2383181377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638d49d34a0 msgr2=0x5638d49e8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:39.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.357+0000 7f016f7fe640 1 --2- 172.21.15.79:0/2383181377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638d49d34a0 0x5638d49e8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.357+0000 7f016f7fe640 1 -- 172.21.15.79:0/2383181377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638d49e89e0 con 0x5638d49c6bf0 2024-08-20T01:36:39.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.357+0000 7f016f7fe640 1 --2- 172.21.15.79:0/2383181377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d49c6bf0 0x5638d49eb5e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0160000c00 tx=0x7f016000aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=754fa88a2c47581d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:39.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.357+0000 7f014effd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:36:39.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.357+0000 7f014effd640 1 -- 172.21.15.79:0/2383181377 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0160016a70 con 0x5638d49c6bf0 2024-08-20T01:36:39.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.358+0000 7f017817d740 1 -- 172.21.15.79:0/2383181377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f015810a190 con 0x5638d49c6bf0 2024-08-20T01:36:39.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.358+0000 7f014effd640 1 -- 172.21.15.79:0/2383181377 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f0160016c10 con 0x5638d49c6bf0 2024-08-20T01:36:39.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.358+0000 7f014effd640 1 -- 172.21.15.79:0/2383181377 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0160016e10 con 0x5638d49c6bf0 2024-08-20T01:36:39.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.358+0000 7f017817d740 10 client.15285 fetch_fsmap learned FSMap version 27 2024-08-20T01:36:39.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.358+0000 7f017817d740 1 -- 172.21.15.79:0/2383181377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5638d49ecf60 con 0x5638d49c6bf0 2024-08-20T01:36:39.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.358+0000 7f014effd640 1 -- 172.21.15.79:0/2383181377 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f015810a190 con 0x5638d49c6bf0 2024-08-20T01:36:39.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.358+0000 7f014effd640 1 -- 172.21.15.79:0/2383181377 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f016001d590 con 0x5638d49c6bf0 2024-08-20T01:36:39.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.358+0000 7f017817d740 10 client.15285 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:36:39.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.358+0000 7f017817d740 10 client.15285 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-20T01:36:39.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.358+0000 7f017817d740 20 client.15285 populate_metadata read hostname 'smithi079' 2024-08-20T01:36:39.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.358+0000 7f017817d740 1 --2- 172.21.15.79:0/2383181377 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x5638d4a52ee0 0x5638d4a51bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:39.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.358+0000 7f017817d740 4 client.15285 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-20T01:36:39.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.358+0000 7f017817d740 1 -- 172.21.15.79:0/2383181377 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "status"}) -- 0x5638d493b090 con 0x5638d4a52ee0 2024-08-20T01:36:39.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.359+0000 7f0167fff640 1 --2- 172.21.15.79:0/2383181377 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x5638d4a52ee0 0x5638d4a51bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:39.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.359+0000 7f0167fff640 1 --2- 172.21.15.79:0/2383181377 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x5638d4a52ee0 0x5638d4a51bf0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bb1d0bc0736bb444 server_cookie=b5118426cdb2ef32 in_seq=0 out_seq=0 2024-08-20T01:36:39.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.359+0000 7f014effd640 10 client.15285 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:36:39.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.359+0000 7f014effd640 1 -- 172.21.15.79:0/2383181377 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5638d493b090 con 0x5638d4a52ee0 2024-08-20T01:36:39.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.359+0000 7f014effd640 10 client.15285 handle_command_reply: tid=0 2024-08-20T01:36:39.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.359+0000 7f017817d740 1 client.15285 shutdown 2024-08-20T01:36:39.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.359+0000 7f017817d740 1 -- 172.21.15.79:0/2383181377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d49c6bf0 msgr2=0x5638d49eb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:39.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.359+0000 7f017817d740 1 --2- 172.21.15.79:0/2383181377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d49c6bf0 0x5638d49eb5e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0160000c00 tx=0x7f016000aca0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.359+0000 7f017817d740 1 -- 172.21.15.79:0/2383181377 shutdown_connections 2024-08-20T01:36:39.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.359+0000 7f017817d740 1 --2- 172.21.15.79:0/2383181377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638d49d34a0 0x5638d49e8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.359+0000 7f017817d740 1 --2- 172.21.15.79:0/2383181377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638d49c7510 0x5638d49ebb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.359+0000 7f017817d740 1 --2- 172.21.15.79:0/2383181377 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x5638d4a52ee0 0x5638d4a51bf0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.359+0000 7f017817d740 1 --2- 172.21.15.79:0/2383181377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5638d49c6bf0 0x5638d49eb5e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.359+0000 7f017817d740 1 -- 172.21.15.79:0/2383181377 >> 172.21.15.79:0/2383181377 conn(0x5638d49c4a20 msgr2=0x5638d49de980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:39.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.359+0000 7f014effd640 0 client.15285 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:36:39.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.359+0000 7f017817d740 1 -- 172.21.15.79:0/2383181377 shutdown_connections 2024-08-20T01:36:39.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.359+0000 7f017817d740 1 -- 172.21.15.79:0/2383181377 wait complete. 2024-08-20T01:36:39.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.360+0000 7f017817d740 20 client.15285 trim_cache size 0 max 16384 2024-08-20T01:36:39.384 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:36:39.384 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "28484e9a-5e93-11ef-bccf-c7b262605968", 2024-08-20T01:36:39.384 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 2, 2024-08-20T01:36:39.384 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 24523, 2024-08-20T01:36:39.384 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-08-20T01:36:39.384 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-08-20T01:36:39.384 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-08-20T01:36:39.384 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 95.945119849999998, 2024-08-20T01:36:39.384 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 27, 2024-08-20T01:36:39.384 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 74, 2024-08-20T01:36:39.384 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 72, 2024-08-20T01:36:39.384 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 128.276122448 2024-08-20T01:36:39.385 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:36:39.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.360+0000 7f0175d84640 1 -- 172.21.15.79:0/3697476472 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f015c0b3bd0 msgr2=0x7f015c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:39.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.360+0000 7f0175d84640 1 --2- 172.21.15.79:0/3697476472 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f015c0b3bd0 0x7f015c0b6090 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f016800f4c0 tx=0x7f0168007740 comp rx=0 tx=0).stop 2024-08-20T01:36:39.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.360+0000 7f0175d84640 1 -- 172.21.15.79:0/3697476472 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01701042e0 msgr2=0x7f0170199580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:39.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.360+0000 7f0175d84640 1 --2- 172.21.15.79:0/3697476472 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01701042e0 0x7f0170199580 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f015802a930 tx=0x7f0158003cd0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.360+0000 7f0175d84640 1 -- 172.21.15.79:0/3697476472 shutdown_connections 2024-08-20T01:36:39.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.360+0000 7f0175d84640 1 --2- 172.21.15.79:0/3697476472 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f015c0b3bd0 0x7f015c0b6090 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.360+0000 7f0175d84640 1 --2- 172.21.15.79:0/3697476472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f017010ce20 0x7f017019e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.360+0000 7f0175d84640 1 --2- 172.21.15.79:0/3697476472 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01701042e0 0x7f0170199580 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.360+0000 7f0175d84640 1 --2- 172.21.15.79:0/3697476472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01701039c0 0x7f0170199040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:39.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.360+0000 7f0175d84640 1 -- 172.21.15.79:0/3697476472 >> 172.21.15.79:0/3697476472 conn(0x7f01700fd420 msgr2=0x7f01700fe0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:39.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.360+0000 7f0175d84640 1 -- 172.21.15.79:0/3697476472 shutdown_connections 2024-08-20T01:36:39.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:39.360+0000 7f0175d84640 1 -- 172.21.15.79:0/3697476472 wait complete. 2024-08-20T01:36:40.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:40 smithi079 ceph-mon[18656]: pgmap v327: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 0 B/s wr, 11 op/s 2024-08-20T01:36:40.227 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.i status 2024-08-20T01:36:40.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:40 smithi175 ceph-mon[22392]: pgmap v327: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 0 B/s wr, 11 op/s 2024-08-20T01:36:40.475 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:36:40.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:40 smithi081 ceph-mon[22209]: pgmap v327: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 0 B/s wr, 11 op/s 2024-08-20T01:36:40.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.934+0000 7f7f1715a640 1 -- 172.21.15.79:0/2701025501 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f101019b0 msgr2=0x7f7f10101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:40.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.934+0000 7f7f1715a640 1 --2- 172.21.15.79:0/2701025501 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f101019b0 0x7f7f10101d90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f7f04009900 tx=0x7f7f0402a410 comp rx=0 tx=0).stop 2024-08-20T01:36:40.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.934+0000 7f7f1715a640 1 -- 172.21.15.79:0/2701025501 shutdown_connections 2024-08-20T01:36:40.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.934+0000 7f7f1715a640 1 --2- 172.21.15.79:0/2701025501 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f10107d40 0x7f7f1010e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:40.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.934+0000 7f7f1715a640 1 --2- 172.21.15.79:0/2701025501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f101073c0 0x7f7f10107800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:40.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.934+0000 7f7f1715a640 1 --2- 172.21.15.79:0/2701025501 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f101019b0 0x7f7f10101d90 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:40.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.934+0000 7f7f1715a640 1 -- 172.21.15.79:0/2701025501 >> 172.21.15.79:0/2701025501 conn(0x7f7f100fd400 msgr2=0x7f7f100ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:40.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.934+0000 7f7f1715a640 1 -- 172.21.15.79:0/2701025501 shutdown_connections 2024-08-20T01:36:40.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.934+0000 7f7f1715a640 1 -- 172.21.15.79:0/2701025501 wait complete. 2024-08-20T01:36:40.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.935+0000 7f7f1715a640 1 Processor -- start 2024-08-20T01:36:40.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.935+0000 7f7f1715a640 1 -- start start 2024-08-20T01:36:40.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.935+0000 7f7f1715a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f101019b0 0x7f7f10197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:40.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.935+0000 7f7f1715a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f101073c0 0x7f7f10198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:40.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.935+0000 7f7f1715a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f10107d40 0x7f7f1019d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:40.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.935+0000 7f7f1715a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7f10111870 con 0x7f7f101019b0 2024-08-20T01:36:40.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.935+0000 7f7f1715a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7f101116f0 con 0x7f7f101073c0 2024-08-20T01:36:40.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.935+0000 7f7f1715a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7f101119f0 con 0x7f7f10107d40 2024-08-20T01:36:40.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.935+0000 7f7f14ef6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f101019b0 0x7f7f10197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:40.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.935+0000 7f7f14ef6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f101019b0 0x7f7f10197fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38396/0 (socket says 172.21.15.79:38396) 2024-08-20T01:36:40.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.935+0000 7f7f14ef6640 1 -- 172.21.15.79:0/1826264958 learned_addr learned my addr 172.21.15.79:0/1826264958 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:40.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.935+0000 7f7f0ffff640 1 --2- 172.21.15.79:0/1826264958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f101073c0 0x7f7f10198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:40.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.935+0000 7f7f14ef6640 1 -- 172.21.15.79:0/1826264958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f10107d40 msgr2=0x7f7f1019d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:40.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.935+0000 7f7f14ef6640 1 --2- 172.21.15.79:0/1826264958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f10107d40 0x7f7f1019d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:40.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.935+0000 7f7f14ef6640 1 -- 172.21.15.79:0/1826264958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f101073c0 msgr2=0x7f7f10198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:40.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.935+0000 7f7f14ef6640 1 --2- 172.21.15.79:0/1826264958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f101073c0 0x7f7f10198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:40.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.935+0000 7f7f14ef6640 1 -- 172.21.15.79:0/1826264958 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f1019e090 con 0x7f7f101019b0 2024-08-20T01:36:40.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.935+0000 7f7f0ffff640 1 --2- 172.21.15.79:0/1826264958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f101073c0 0x7f7f10198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:36:40.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.936+0000 7f7f14ef6640 1 --2- 172.21.15.79:0/1826264958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f101019b0 0x7f7f10197fe0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7f04009a20 tx=0x7f7f04004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:40.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.936+0000 7f7f0dffb640 1 -- 172.21.15.79:0/1826264958 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0403f030 con 0x7f7f101019b0 2024-08-20T01:36:40.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.936+0000 7f7f0dffb640 1 -- 172.21.15.79:0/1826264958 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7f040035f0 con 0x7f7f101019b0 2024-08-20T01:36:40.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.936+0000 7f7f1715a640 1 -- 172.21.15.79:0/1826264958 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f1019e320 con 0x7f7f101019b0 2024-08-20T01:36:40.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.936+0000 7f7f0dffb640 1 -- 172.21.15.79:0/1826264958 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f04035070 con 0x7f7f101019b0 2024-08-20T01:36:40.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.936+0000 7f7f1715a640 1 -- 172.21.15.79:0/1826264958 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f101a4a40 con 0x7f7f101019b0 2024-08-20T01:36:40.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.938+0000 7f7f19553740 1 Processor -- start 2024-08-20T01:36:40.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.939+0000 7f7f19553740 1 -- start start 2024-08-20T01:36:40.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.939+0000 7f7f0dffb640 1 -- 172.21.15.79:0/1826264958 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f7f04003aa0 con 0x7f7f101019b0 2024-08-20T01:36:40.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.939+0000 7f7f19553740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9ce5bbbf0 0x55d9ce5bbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:40.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.939+0000 7f7f19553740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9ce5bc510 0x55d9ce5ca170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:40.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.939+0000 7f7f19553740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9ce5ca6b0 0x55d9ce5ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:40.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.939+0000 7f7f19553740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d9ce5326a0 con 0x55d9ce5bbbf0 2024-08-20T01:36:40.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.939+0000 7f7f19553740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d9ce521ba0 con 0x55d9ce5bc510 2024-08-20T01:36:40.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.939+0000 7f7f19553740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d9ce525be0 con 0x55d9ce5ca6b0 2024-08-20T01:36:40.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.939+0000 7f7f156f7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9ce5bbbf0 0x55d9ce5bbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:40.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.939+0000 7f7f156f7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9ce5bbbf0 0x55d9ce5bbfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38402/0 (socket says 172.21.15.79:38402) 2024-08-20T01:36:40.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.939+0000 7f7f156f7640 1 -- 172.21.15.79:0/4261898650 learned_addr learned my addr 172.21.15.79:0/4261898650 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:40.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.939+0000 7f7f14ef6640 1 --2- 172.21.15.79:0/4261898650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9ce5bc510 0x55d9ce5ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:40.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.939+0000 7f7f0ffff640 1 --2- 172.21.15.79:0/4261898650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9ce5ca6b0 0x55d9ce5ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:40.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.939+0000 7f7f156f7640 1 -- 172.21.15.79:0/4261898650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9ce5ca6b0 msgr2=0x55d9ce5ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:40.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.939+0000 7f7f156f7640 1 --2- 172.21.15.79:0/4261898650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9ce5ca6b0 0x55d9ce5ccaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:40.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.939+0000 7f7f156f7640 1 -- 172.21.15.79:0/4261898650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9ce5bc510 msgr2=0x55d9ce5ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:40.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.939+0000 7f7f156f7640 1 --2- 172.21.15.79:0/4261898650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9ce5bc510 0x55d9ce5ca170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:40.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.939+0000 7f7f156f7640 1 -- 172.21.15.79:0/4261898650 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9ce281540 con 0x55d9ce5bbbf0 2024-08-20T01:36:40.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.939+0000 7f7f156f7640 1 --2- 172.21.15.79:0/4261898650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9ce5bbbf0 0x55d9ce5bbfd0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7f08007d20 tx=0x7f7f0800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da50241e9da9be63 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:40.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.940+0000 7f7efaffd640 1 -- 172.21.15.79:0/4261898650 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f08014070 con 0x55d9ce5bbbf0 2024-08-20T01:36:40.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.940+0000 7f7efaffd640 1 -- 172.21.15.79:0/4261898650 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7f0800fae0 con 0x55d9ce5bbbf0 2024-08-20T01:36:40.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.940+0000 7f7efaffd640 1 -- 172.21.15.79:0/4261898650 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0800ea80 con 0x55d9ce5bbbf0 2024-08-20T01:36:40.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.940+0000 7f7f0dffb640 1 --2- 172.21.15.79:0/1826264958 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f7f000b3c50 0x7f7f000b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:40.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.940+0000 7f7f14ef6640 1 --2- 172.21.15.79:0/1826264958 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f7f000b3c50 0x7f7f000b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:40.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.940+0000 7f7f0dffb640 1 -- 172.21.15.79:0/1826264958 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f7f041045b0 con 0x7f7f101019b0 2024-08-20T01:36:40.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.940+0000 7f7f19553740 1 -- 172.21.15.79:0/4261898650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9ce5bbbf0 msgr2=0x55d9ce5bbfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:40.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.940+0000 7f7f14ef6640 1 --2- 172.21.15.79:0/1826264958 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f7f000b3c50 0x7f7f000b6110 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7f040cb4a0 tx=0x7f7f0410a630 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:40.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.940+0000 7f7f19553740 1 --2- 172.21.15.79:0/4261898650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9ce5bbbf0 0x55d9ce5bbfd0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7f08007d20 tx=0x7f7f0800c6a0 comp rx=0 tx=0).stop 2024-08-20T01:36:40.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.940+0000 7f7f19553740 1 -- 172.21.15.79:0/4261898650 shutdown_connections 2024-08-20T01:36:40.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.940+0000 7f7f19553740 1 --2- 172.21.15.79:0/4261898650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9ce5ca6b0 0x55d9ce5ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:40.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.940+0000 7f7f19553740 1 --2- 172.21.15.79:0/4261898650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9ce5bc510 0x55d9ce5ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:40.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.940+0000 7f7f19553740 1 --2- 172.21.15.79:0/4261898650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9ce5bbbf0 0x55d9ce5bbfd0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:40.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.940+0000 7f7f19553740 1 -- 172.21.15.79:0/4261898650 >> 172.21.15.79:0/4261898650 conn(0x55d9ce5b9a20 msgr2=0x55d9ce5babc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:40.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.940+0000 7f7f19553740 1 -- 172.21.15.79:0/4261898650 shutdown_connections 2024-08-20T01:36:40.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.941+0000 7f7f19553740 1 -- 172.21.15.79:0/4261898650 wait complete. 2024-08-20T01:36:40.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.941+0000 7f7f19553740 1 -- start start 2024-08-20T01:36:40.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.941+0000 7f7f19553740 1 Processor -- start 2024-08-20T01:36:40.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.941+0000 7f7f19553740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9ce5bbbf0 0x55d9ce5c7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:40.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.941+0000 7f7f19553740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9ce5bc510 0x55d9ce5c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:40.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.941+0000 7f7f19553740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9ce5ca6b0 0x55d9ce5c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:40.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.941+0000 7f7f19553740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d9ce3845f0 con 0x55d9ce5bbbf0 2024-08-20T01:36:40.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.941+0000 7f7f19553740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d9ce4a86c0 con 0x55d9ce5ca6b0 2024-08-20T01:36:40.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.941+0000 7f7f19553740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d9ce5cd360 con 0x55d9ce5bc510 2024-08-20T01:36:40.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.941+0000 7f7f19553740 10 client.0 _ll_register_callbacks cb 0x55d9ce4e51e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:40.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.941+0000 7f7f156f7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9ce5bbbf0 0x55d9ce5c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:40.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.942+0000 7f7f156f7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9ce5bbbf0 0x55d9ce5c7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38410/0 (socket says 172.21.15.79:38410) 2024-08-20T01:36:40.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.942+0000 7f7f156f7640 1 -- 172.21.15.79:0/658396786 learned_addr learned my addr 172.21.15.79:0/658396786 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:40.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.942+0000 7f7f0ffff640 1 --2- 172.21.15.79:0/658396786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9ce5bc510 0x55d9ce5c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:40.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.942+0000 7f7f156f7640 1 -- 172.21.15.79:0/658396786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9ce5bc510 msgr2=0x55d9ce5c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:40.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.942+0000 7f7f156f7640 1 --2- 172.21.15.79:0/658396786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9ce5bc510 0x55d9ce5c7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:40.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.942+0000 7f7f156f7640 1 -- 172.21.15.79:0/658396786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9ce5ca6b0 msgr2=0x55d9ce5c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:40.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.942+0000 7f7f156f7640 1 --2- 172.21.15.79:0/658396786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9ce5ca6b0 0x55d9ce5c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:40.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.942+0000 7f7f156f7640 1 -- 172.21.15.79:0/658396786 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9ce5d6740 con 0x55d9ce5bbbf0 2024-08-20T01:36:40.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.942+0000 7f7f156f7640 1 --2- 172.21.15.79:0/658396786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9ce5bbbf0 0x55d9ce5c7640 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7f0800e600 tx=0x7f7f08007a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46081ced6526f1f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:40.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.942+0000 7f7eeffff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:36:40.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.942+0000 7f7eeffff640 1 -- 172.21.15.79:0/658396786 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f08014050 con 0x55d9ce5bbbf0 2024-08-20T01:36:40.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.942+0000 7f7eeffff640 1 -- 172.21.15.79:0/658396786 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f7f08003d80 con 0x55d9ce5bbbf0 2024-08-20T01:36:40.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.942+0000 7f7f19553740 1 -- 172.21.15.79:0/658396786 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f0800fae0 con 0x55d9ce5bbbf0 2024-08-20T01:36:40.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.942+0000 7f7eeffff640 1 -- 172.21.15.79:0/658396786 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7f0800f450 con 0x55d9ce5bbbf0 2024-08-20T01:36:40.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.942+0000 7f7f19553740 10 client.15297 fetch_fsmap learned FSMap version 27 2024-08-20T01:36:40.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.942+0000 7f7f19553740 1 -- 172.21.15.79:0/658396786 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d9ce5d90f0 con 0x55d9ce5bbbf0 2024-08-20T01:36:40.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.943+0000 7f7eeffff640 1 -- 172.21.15.79:0/658396786 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7f0800fae0 con 0x55d9ce5bbbf0 2024-08-20T01:36:40.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.943+0000 7f7eeffff640 1 -- 172.21.15.79:0/658396786 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f7f08004040 con 0x55d9ce5bbbf0 2024-08-20T01:36:40.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.943+0000 7f7f19553740 10 client.15297 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:36:40.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.943+0000 7f7f19553740 10 client.15297 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-20T01:36:40.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.943+0000 7f7f19553740 20 client.15297 populate_metadata read hostname 'smithi079' 2024-08-20T01:36:40.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.943+0000 7f7f19553740 1 --2- 172.21.15.79:0/658396786 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55d9ce5db430 0x55d9ce5dc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:40.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.943+0000 7f7f19553740 4 client.15297 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:36:40.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.943+0000 7f7f19553740 1 -- 172.21.15.79:0/658396786 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d9ce5345f0 con 0x55d9ce5db430 2024-08-20T01:36:40.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.943+0000 7f7f0ffff640 1 --2- 172.21.15.79:0/658396786 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55d9ce5db430 0x55d9ce5dc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:40.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.943+0000 7f7f0ffff640 1 --2- 172.21.15.79:0/658396786 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55d9ce5db430 0x55d9ce5dc8a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=144856c7e151c445 server_cookie=62e8deb4c1486b60 in_seq=0 out_seq=0 2024-08-20T01:36:40.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.943+0000 7f7eeffff640 10 client.15297 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:36:40.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.944+0000 7f7eeffff640 1 -- 172.21.15.79:0/658396786 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d9ce5345f0 con 0x55d9ce5db430 2024-08-20T01:36:40.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.944+0000 7f7eeffff640 10 client.15297 handle_command_reply: tid=0 2024-08-20T01:36:40.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.944+0000 7f7f19553740 1 client.15297 shutdown 2024-08-20T01:36:40.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.944+0000 7f7f19553740 1 -- 172.21.15.79:0/658396786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9ce5bbbf0 msgr2=0x55d9ce5c7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:40.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.944+0000 7f7f19553740 1 --2- 172.21.15.79:0/658396786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9ce5bbbf0 0x55d9ce5c7640 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7f0800e600 tx=0x7f7f08007a30 comp rx=0 tx=0).stop 2024-08-20T01:36:40.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.944+0000 7f7f19553740 1 -- 172.21.15.79:0/658396786 shutdown_connections 2024-08-20T01:36:40.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.944+0000 7f7f19553740 1 --2- 172.21.15.79:0/658396786 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55d9ce5db430 0x55d9ce5dc8a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:40.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.944+0000 7f7eeffff640 0 client.15297 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:36:40.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.944+0000 7f7f19553740 1 --2- 172.21.15.79:0/658396786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9ce5ca6b0 0x55d9ce5c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:40.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.944+0000 7f7f19553740 1 --2- 172.21.15.79:0/658396786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9ce5bc510 0x55d9ce5c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:40.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.944+0000 7f7f19553740 1 --2- 172.21.15.79:0/658396786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9ce5bbbf0 0x55d9ce5c7640 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:40.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.944+0000 7f7f19553740 1 -- 172.21.15.79:0/658396786 >> 172.21.15.79:0/658396786 conn(0x55d9ce5b9a20 msgr2=0x55d9ce5bf520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:40.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.945+0000 7f7f19553740 1 -- 172.21.15.79:0/658396786 shutdown_connections 2024-08-20T01:36:40.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.945+0000 7f7f19553740 1 -- 172.21.15.79:0/658396786 wait complete. 2024-08-20T01:36:40.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.945+0000 7f7f19553740 20 client.15297 trim_cache size 0 max 16384 2024-08-20T01:36:40.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.962+0000 7f7f19553740 1 Processor -- start 2024-08-20T01:36:40.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.962+0000 7f7f19553740 1 -- start start 2024-08-20T01:36:40.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.962+0000 7f7f19553740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9ce5bbbf0 0x55d9ce5c5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:40.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.962+0000 7f7f19553740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9ce5bc510 0x55d9ce5b92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:40.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.962+0000 7f7f19553740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9ce5ca6b0 0x55d9ce5bae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:40.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.962+0000 7f7f19553740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d9ce5dabe0 con 0x55d9ce5bbbf0 2024-08-20T01:36:40.990 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:36:40.990 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "28484e9a-5e93-11ef-bccf-c7b262605968", 2024-08-20T01:36:40.990 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 1, 2024-08-20T01:36:40.990 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 24538, 2024-08-20T01:36:40.990 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-08-20T01:36:40.990 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-08-20T01:36:40.990 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-08-20T01:36:40.990 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 98.567164446999996, 2024-08-20T01:36:40.990 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 27, 2024-08-20T01:36:40.990 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 74, 2024-08-20T01:36:40.991 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 72, 2024-08-20T01:36:40.991 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 125.086918658 2024-08-20T01:36:40.991 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:36:40.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.962+0000 7f7f19553740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d9ce5db2b0 con 0x55d9ce5bc510 2024-08-20T01:36:40.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.963+0000 7f7f19553740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d9ce5db980 con 0x55d9ce5ca6b0 2024-08-20T01:36:40.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.963+0000 7f7f156f7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9ce5bbbf0 0x55d9ce5c5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:40.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.963+0000 7f7f156f7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9ce5bbbf0 0x55d9ce5c5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38418/0 (socket says 172.21.15.79:38418) 2024-08-20T01:36:40.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.963+0000 7f7f156f7640 1 -- 172.21.15.79:0/180544132 learned_addr learned my addr 172.21.15.79:0/180544132 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:40.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.963+0000 7f7f156f7640 1 -- 172.21.15.79:0/180544132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9ce5ca6b0 msgr2=0x55d9ce5bae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:40.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.963+0000 7f7f0ffff640 1 --2- 172.21.15.79:0/180544132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9ce5bc510 0x55d9ce5b92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:40.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.963+0000 7f7f156f7640 1 --2- 172.21.15.79:0/180544132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9ce5ca6b0 0x55d9ce5bae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:40.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.963+0000 7f7f156f7640 1 -- 172.21.15.79:0/180544132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9ce5bc510 msgr2=0x55d9ce5b92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:40.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.963+0000 7f7f156f7640 1 --2- 172.21.15.79:0/180544132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9ce5bc510 0x55d9ce5b92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:40.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.963+0000 7f7f156f7640 1 -- 172.21.15.79:0/180544132 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9ce5b9810 con 0x55d9ce5bbbf0 2024-08-20T01:36:40.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.963+0000 7f7f156f7640 1 --2- 172.21.15.79:0/180544132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9ce5bbbf0 0x55d9ce5c5140 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f7f08004a80 tx=0x7f7f08007260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fe9a71f0a103277 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:40.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.963+0000 7f7efa7fc640 1 -- 172.21.15.79:0/180544132 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f08014040 con 0x55d9ce5bbbf0 2024-08-20T01:36:40.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.963+0000 7f7efa7fc640 1 -- 172.21.15.79:0/180544132 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7f08033070 con 0x55d9ce5bbbf0 2024-08-20T01:36:40.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.963+0000 7f7efa7fc640 1 -- 172.21.15.79:0/180544132 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f08004260 con 0x55d9ce5bbbf0 2024-08-20T01:36:40.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.964+0000 7f7f19553740 1 -- 172.21.15.79:0/180544132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9ce5bbbf0 msgr2=0x55d9ce5c5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:40.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.964+0000 7f7f19553740 1 --2- 172.21.15.79:0/180544132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9ce5bbbf0 0x55d9ce5c5140 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f7f08004a80 tx=0x7f7f08007260 comp rx=0 tx=0).stop 2024-08-20T01:36:40.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.964+0000 7f7f19553740 1 -- 172.21.15.79:0/180544132 shutdown_connections 2024-08-20T01:36:40.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.964+0000 7f7f19553740 1 --2- 172.21.15.79:0/180544132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9ce5ca6b0 0x55d9ce5bae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:40.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.964+0000 7f7f19553740 1 --2- 172.21.15.79:0/180544132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9ce5bc510 0x55d9ce5b92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:40.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.964+0000 7f7f19553740 1 --2- 172.21.15.79:0/180544132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9ce5bbbf0 0x55d9ce5c5140 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:40.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.964+0000 7f7f19553740 1 -- 172.21.15.79:0/180544132 >> 172.21.15.79:0/180544132 conn(0x55d9ce5b9a20 msgr2=0x55d9ce5ba700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:40.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.964+0000 7f7f19553740 1 -- 172.21.15.79:0/180544132 shutdown_connections 2024-08-20T01:36:40.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.964+0000 7f7f19553740 1 -- 172.21.15.79:0/180544132 wait complete. 2024-08-20T01:36:40.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.964+0000 7f7f19553740 1 -- start start 2024-08-20T01:36:40.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.964+0000 7f7f19553740 1 Processor -- start 2024-08-20T01:36:40.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.965+0000 7f7f19553740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9ce5bbbf0 0x55d9ce5e4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:40.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.965+0000 7f7f19553740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9ce5bc510 0x55d9ce5e5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:40.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.965+0000 7f7f19553740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9ce5ca6b0 0x55d9ce5bdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:40.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.965+0000 7f7f19553740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d9ce5dc720 con 0x55d9ce5bc510 2024-08-20T01:36:40.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.965+0000 7f7f19553740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d9ce5dc050 con 0x55d9ce5ca6b0 2024-08-20T01:36:40.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.965+0000 7f7f19553740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d9ce5dcdf0 con 0x55d9ce5bbbf0 2024-08-20T01:36:40.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.965+0000 7f7f19553740 10 client.0 _ll_register_callbacks cb 0x7f7f0410a500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:40.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.965+0000 7f7f0ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9ce5bc510 0x55d9ce5e5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:40.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.965+0000 7f7f0ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9ce5bc510 0x55d9ce5e5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38420/0 (socket says 172.21.15.79:38420) 2024-08-20T01:36:40.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.965+0000 7f7f0ffff640 1 -- 172.21.15.79:0/1378067925 learned_addr learned my addr 172.21.15.79:0/1378067925 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:40.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.965+0000 7f7f0ffff640 1 -- 172.21.15.79:0/1378067925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9ce5bbbf0 msgr2=0x55d9ce5e4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:40.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.965+0000 7f7f0ffff640 1 --2- 172.21.15.79:0/1378067925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9ce5bbbf0 0x55d9ce5e4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:40.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.965+0000 7f7f0ffff640 1 -- 172.21.15.79:0/1378067925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9ce5ca6b0 msgr2=0x55d9ce5bdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:40.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.965+0000 7f7f0ffff640 1 --2- 172.21.15.79:0/1378067925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9ce5ca6b0 0x55d9ce5bdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:40.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.965+0000 7f7f0ffff640 1 -- 172.21.15.79:0/1378067925 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9ce5be060 con 0x55d9ce5bc510 2024-08-20T01:36:40.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.965+0000 7f7f0ffff640 1 --2- 172.21.15.79:0/1378067925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9ce5bc510 0x55d9ce5e5030 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x55d9ce5bbba0 tx=0x7f7efc0108c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed8e72a78fdca0ba server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:40.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.965+0000 7f7eeffff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:36:40.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.965+0000 7f7eeffff640 1 -- 172.21.15.79:0/1378067925 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc019790 con 0x55d9ce5bc510 2024-08-20T01:36:40.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.965+0000 7f7eeffff640 1 -- 172.21.15.79:0/1378067925 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f7efc019930 con 0x55d9ce5bc510 2024-08-20T01:36:40.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.965+0000 7f7f19553740 1 -- 172.21.15.79:0/1378067925 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f08033070 con 0x55d9ce5bc510 2024-08-20T01:36:40.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.965+0000 7f7eeffff640 1 -- 172.21.15.79:0/1378067925 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7efc019b30 con 0x55d9ce5bc510 2024-08-20T01:36:40.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.965+0000 7f7f19553740 10 client.15303 fetch_fsmap learned FSMap version 27 2024-08-20T01:36:40.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.965+0000 7f7f19553740 1 -- 172.21.15.79:0/1378067925 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d9ce5c7470 con 0x55d9ce5bc510 2024-08-20T01:36:40.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.966+0000 7f7eeffff640 1 -- 172.21.15.79:0/1378067925 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7f08033070 con 0x55d9ce5bc510 2024-08-20T01:36:40.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.966+0000 7f7eeffff640 1 -- 172.21.15.79:0/1378067925 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f7efc00f420 con 0x55d9ce5bc510 2024-08-20T01:36:40.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.966+0000 7f7f19553740 10 client.15303 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:36:40.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.966+0000 7f7f19553740 10 client.15303 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-20T01:36:40.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.966+0000 7f7f19553740 20 client.15303 populate_metadata read hostname 'smithi079' 2024-08-20T01:36:40.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.966+0000 7f7f19553740 1 --2- 172.21.15.79:0/1378067925 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55d9ce5db430 0x55d9ce648dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:40.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.966+0000 7f7f19553740 4 client.15303 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-20T01:36:40.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.966+0000 7f7f19553740 1 -- 172.21.15.79:0/1378067925 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "status"}) -- 0x55d9ce530090 con 0x55d9ce5db430 2024-08-20T01:36:40.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.966+0000 7f7f156f7640 1 --2- 172.21.15.79:0/1378067925 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55d9ce5db430 0x55d9ce648dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:40.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.966+0000 7f7f156f7640 1 --2- 172.21.15.79:0/1378067925 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55d9ce5db430 0x55d9ce648dc0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=81def43c216f9e1a server_cookie=2c9552a6cc75c8a8 in_seq=0 out_seq=0 2024-08-20T01:36:40.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.966+0000 7f7eeffff640 10 client.15303 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:36:40.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.967+0000 7f7eeffff640 1 -- 172.21.15.79:0/1378067925 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55d9ce530090 con 0x55d9ce5db430 2024-08-20T01:36:40.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.967+0000 7f7eeffff640 10 client.15303 handle_command_reply: tid=0 2024-08-20T01:36:40.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.967+0000 7f7f19553740 1 client.15303 shutdown 2024-08-20T01:36:40.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.967+0000 7f7f19553740 1 -- 172.21.15.79:0/1378067925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9ce5bc510 msgr2=0x55d9ce5e5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:40.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.967+0000 7f7f19553740 1 --2- 172.21.15.79:0/1378067925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9ce5bc510 0x55d9ce5e5030 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x55d9ce5bbba0 tx=0x7f7efc0108c0 comp rx=0 tx=0).stop 2024-08-20T01:36:40.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.967+0000 7f7f19553740 1 -- 172.21.15.79:0/1378067925 shutdown_connections 2024-08-20T01:36:40.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.967+0000 7f7f19553740 1 --2- 172.21.15.79:0/1378067925 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55d9ce5db430 0x55d9ce648dc0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:40.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.967+0000 7f7f19553740 1 --2- 172.21.15.79:0/1378067925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9ce5ca6b0 0x55d9ce5bdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:40.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.967+0000 7f7f19553740 1 --2- 172.21.15.79:0/1378067925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9ce5bc510 0x55d9ce5e5030 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:40.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.967+0000 7f7eeffff640 0 client.15303 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:36:40.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.967+0000 7f7f19553740 1 --2- 172.21.15.79:0/1378067925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9ce5bbbf0 0x55d9ce5e4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:40.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.967+0000 7f7f19553740 1 -- 172.21.15.79:0/1378067925 >> 172.21.15.79:0/1378067925 conn(0x55d9ce5b9a20 msgr2=0x55d9ce5baf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:40.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.967+0000 7f7f19553740 1 -- 172.21.15.79:0/1378067925 shutdown_connections 2024-08-20T01:36:40.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.967+0000 7f7f19553740 1 -- 172.21.15.79:0/1378067925 wait complete. 2024-08-20T01:36:40.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.967+0000 7f7f19553740 20 client.15303 trim_cache size 0 max 16384 2024-08-20T01:36:40.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.968+0000 7f7f1715a640 1 -- 172.21.15.79:0/1826264958 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f7f000b3c50 msgr2=0x7f7f000b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:40.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.968+0000 7f7f1715a640 1 --2- 172.21.15.79:0/1826264958 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f7f000b3c50 0x7f7f000b6110 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7f040cb4a0 tx=0x7f7f0410a630 comp rx=0 tx=0).stop 2024-08-20T01:36:40.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.968+0000 7f7f1715a640 1 -- 172.21.15.79:0/1826264958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f101019b0 msgr2=0x7f7f10197fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:40.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.968+0000 7f7f1715a640 1 --2- 172.21.15.79:0/1826264958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f101019b0 0x7f7f10197fe0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7f04009a20 tx=0x7f7f04004270 comp rx=0 tx=0).stop 2024-08-20T01:36:40.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.968+0000 7f7f1715a640 1 -- 172.21.15.79:0/1826264958 shutdown_connections 2024-08-20T01:36:40.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.968+0000 7f7f1715a640 1 --2- 172.21.15.79:0/1826264958 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f7f000b3c50 0x7f7f000b6110 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:40.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.968+0000 7f7f1715a640 1 --2- 172.21.15.79:0/1826264958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f10107d40 0x7f7f1019d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:40.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.968+0000 7f7f1715a640 1 --2- 172.21.15.79:0/1826264958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f101073c0 0x7f7f10198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:40.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.968+0000 7f7f1715a640 1 --2- 172.21.15.79:0/1826264958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f101019b0 0x7f7f10197fe0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:40.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.968+0000 7f7f1715a640 1 -- 172.21.15.79:0/1826264958 >> 172.21.15.79:0/1826264958 conn(0x7f7f100fd400 msgr2=0x7f7f100ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:40.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.968+0000 7f7f1715a640 1 -- 172.21.15.79:0/1826264958 shutdown_connections 2024-08-20T01:36:40.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:40.968+0000 7f7f1715a640 1 -- 172.21.15.79:0/1826264958 wait complete. 2024-08-20T01:36:41.673 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.b status 2024-08-20T01:36:41.919 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:36:42.314 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:42 smithi079 ceph-mon[18656]: pgmap v328: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-20T01:36:42.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:42 smithi175 ceph-mon[22392]: pgmap v328: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-20T01:36:42.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.392+0000 7efd1dadc640 1 -- 172.21.15.79:0/573777299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd181042c0 msgr2=0x7efd1810c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:42.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.392+0000 7efd1dadc640 1 --2- 172.21.15.79:0/573777299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd181042c0 0x7efd1810c7b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7efd00009900 tx=0x7efd0002a410 comp rx=0 tx=0).stop 2024-08-20T01:36:42.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.392+0000 7efd1dadc640 1 -- 172.21.15.79:0/573777299 shutdown_connections 2024-08-20T01:36:42.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.392+0000 7efd1dadc640 1 --2- 172.21.15.79:0/573777299 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd1810ce00 0x7efd1810f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:42.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.392+0000 7efd1dadc640 1 --2- 172.21.15.79:0/573777299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd181042c0 0x7efd1810c7b0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:42.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.392+0000 7efd1dadc640 1 --2- 172.21.15.79:0/573777299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd181039a0 0x7efd18103d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:42.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.392+0000 7efd1dadc640 1 -- 172.21.15.79:0/573777299 >> 172.21.15.79:0/573777299 conn(0x7efd180fd400 msgr2=0x7efd180ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:42.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.392+0000 7efd1dadc640 1 -- 172.21.15.79:0/573777299 shutdown_connections 2024-08-20T01:36:42.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.392+0000 7efd1dadc640 1 -- 172.21.15.79:0/573777299 wait complete. 2024-08-20T01:36:42.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.393+0000 7efd1dadc640 1 Processor -- start 2024-08-20T01:36:42.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.393+0000 7efd1dadc640 1 -- start start 2024-08-20T01:36:42.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.393+0000 7efd1dadc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd181039a0 0x7efd18101650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:42.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.393+0000 7efd1dadc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd181042c0 0x7efd18101b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:42.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.393+0000 7efd1dadc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd1810ce00 0x7efd181020d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:42.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.393+0000 7efd1dadc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efd18112970 con 0x7efd1810ce00 2024-08-20T01:36:42.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.393+0000 7efd1dadc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efd181127f0 con 0x7efd181042c0 2024-08-20T01:36:42.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.393+0000 7efd1dadc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efd18112af0 con 0x7efd181039a0 2024-08-20T01:36:42.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.393+0000 7efd17fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd1810ce00 0x7efd181020d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:42.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.393+0000 7efd17fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd1810ce00 0x7efd181020d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38428/0 (socket says 172.21.15.79:38428) 2024-08-20T01:36:42.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.393+0000 7efd17fff640 1 -- 172.21.15.79:0/2751877419 learned_addr learned my addr 172.21.15.79:0/2751877419 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:42.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.393+0000 7efd177fe640 1 --2- 172.21.15.79:0/2751877419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd181039a0 0x7efd18101650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:42.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.394+0000 7efd0effd640 1 --2- 172.21.15.79:0/2751877419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd181042c0 0x7efd18101b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:42.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.394+0000 7efd17fff640 1 -- 172.21.15.79:0/2751877419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd181039a0 msgr2=0x7efd18101650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:42.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.394+0000 7efd17fff640 1 --2- 172.21.15.79:0/2751877419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd181039a0 0x7efd18101650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:42.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.394+0000 7efd17fff640 1 -- 172.21.15.79:0/2751877419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd181042c0 msgr2=0x7efd18101b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:42.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.394+0000 7efd17fff640 1 --2- 172.21.15.79:0/2751877419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd181042c0 0x7efd18101b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:42.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.394+0000 7efd17fff640 1 -- 172.21.15.79:0/2751877419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd181a7280 con 0x7efd1810ce00 2024-08-20T01:36:42.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.394+0000 7efd0effd640 1 --2- 172.21.15.79:0/2751877419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd181042c0 0x7efd18101b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:36:42.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.394+0000 7efd17fff640 1 --2- 172.21.15.79:0/2751877419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd1810ce00 0x7efd181020d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7efd1000eaa0 tx=0x7efd1000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:42.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.394+0000 7efd157fa640 1 -- 172.21.15.79:0/2751877419 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1000cdb0 con 0x7efd1810ce00 2024-08-20T01:36:42.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.394+0000 7efd157fa640 1 -- 172.21.15.79:0/2751877419 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd10005020 con 0x7efd1810ce00 2024-08-20T01:36:42.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.394+0000 7efd1dadc640 1 -- 172.21.15.79:0/2751877419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd181a7570 con 0x7efd1810ce00 2024-08-20T01:36:42.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.394+0000 7efd157fa640 1 -- 172.21.15.79:0/2751877419 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd100116d0 con 0x7efd1810ce00 2024-08-20T01:36:42.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.394+0000 7efd1dadc640 1 -- 172.21.15.79:0/2751877419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd181a7ab0 con 0x7efd1810ce00 2024-08-20T01:36:42.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.396+0000 7efd1fed5740 1 Processor -- start 2024-08-20T01:36:42.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.396+0000 7efd157fa640 1 -- 172.21.15.79:0/2751877419 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7efd100051d0 con 0x7efd1810ce00 2024-08-20T01:36:42.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.396+0000 7efd1fed5740 1 -- start start 2024-08-20T01:36:42.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.397+0000 7efd1fed5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c337d71bf0 0x55c337d71fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:42.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.397+0000 7efd1fed5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c337d72510 0x55c337d7df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:42.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.397+0000 7efd1fed5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c337d7e4a0 0x55c337d80890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:42.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.397+0000 7efd1fed5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c337ce86a0 con 0x55c337d7e4a0 2024-08-20T01:36:42.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.397+0000 7efd1fed5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c337cd7ba0 con 0x55c337d71bf0 2024-08-20T01:36:42.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.397+0000 7efd1fed5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c337cdbbe0 con 0x55c337d72510 2024-08-20T01:36:42.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.397+0000 7efd0effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c337d7e4a0 0x55c337d80890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:42.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.397+0000 7efd0effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c337d7e4a0 0x55c337d80890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38438/0 (socket says 172.21.15.79:38438) 2024-08-20T01:36:42.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.397+0000 7efd0effd640 1 -- 172.21.15.79:0/956535925 learned_addr learned my addr 172.21.15.79:0/956535925 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:42.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.397+0000 7efd0effd640 1 --2- 172.21.15.79:0/956535925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c337d71bf0 0x55c337d71fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:42.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.397+0000 7efd177fe640 1 --2- 172.21.15.79:0/956535925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c337d72510 0x55c337d7df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:42.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.397+0000 7efd0effd640 1 -- 172.21.15.79:0/956535925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c337d72510 msgr2=0x55c337d7df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:42.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.397+0000 7efd0effd640 1 --2- 172.21.15.79:0/956535925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c337d72510 0x55c337d7df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:42.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.397+0000 7efd0effd640 1 -- 172.21.15.79:0/956535925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c337d71bf0 msgr2=0x55c337d71fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:42.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.397+0000 7efd0effd640 1 --2- 172.21.15.79:0/956535925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c337d71bf0 0x55c337d71fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:42.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.397+0000 7efd0effd640 1 -- 172.21.15.79:0/956535925 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c337a37540 con 0x55c337d7e4a0 2024-08-20T01:36:42.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.397+0000 7efd157fa640 1 --2- 172.21.15.79:0/2751877419 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7efd040b3bd0 0x7efd040b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:42.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.397+0000 7efd0effd640 1 --2- 172.21.15.79:0/956535925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c337d7e4a0 0x55c337d80890 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7efd00005c20 tx=0x7efd00000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=880927af01f65cab server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:42.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.397+0000 7efd177fe640 1 --2- 172.21.15.79:0/2751877419 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7efd040b3bd0 0x7efd040b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:42.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.397+0000 7efd157fa640 1 -- 172.21.15.79:0/2751877419 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7efd100e3e50 con 0x7efd1810ce00 2024-08-20T01:36:42.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.398+0000 7efd0dffb640 1 -- 172.21.15.79:0/956535925 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd00045070 con 0x55c337d7e4a0 2024-08-20T01:36:42.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.398+0000 7efd0dffb640 1 -- 172.21.15.79:0/956535925 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd000053c0 con 0x55c337d7e4a0 2024-08-20T01:36:42.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.398+0000 7efd0dffb640 1 -- 172.21.15.79:0/956535925 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd00035070 con 0x55c337d7e4a0 2024-08-20T01:36:42.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.398+0000 7efd1fed5740 1 -- 172.21.15.79:0/956535925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c337d7e4a0 msgr2=0x55c337d80890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:42.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.398+0000 7efd1fed5740 1 --2- 172.21.15.79:0/956535925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c337d7e4a0 0x55c337d80890 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7efd00005c20 tx=0x7efd00000bc0 comp rx=0 tx=0).stop 2024-08-20T01:36:42.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.398+0000 7efd177fe640 1 --2- 172.21.15.79:0/2751877419 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7efd040b3bd0 0x7efd040b6090 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7efd080058c0 tx=0x7efd08005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:42.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.398+0000 7efd1fed5740 1 -- 172.21.15.79:0/956535925 shutdown_connections 2024-08-20T01:36:42.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.398+0000 7efd1fed5740 1 --2- 172.21.15.79:0/956535925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c337d7e4a0 0x55c337d80890 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:42.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.398+0000 7efd1fed5740 1 --2- 172.21.15.79:0/956535925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c337d72510 0x55c337d7df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:42.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.398+0000 7efd1fed5740 1 --2- 172.21.15.79:0/956535925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c337d71bf0 0x55c337d71fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:42.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.398+0000 7efd1fed5740 1 -- 172.21.15.79:0/956535925 >> 172.21.15.79:0/956535925 conn(0x55c337d6fa20 msgr2=0x55c337d70bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:42.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.398+0000 7efd1fed5740 1 -- 172.21.15.79:0/956535925 shutdown_connections 2024-08-20T01:36:42.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.398+0000 7efd1fed5740 1 -- 172.21.15.79:0/956535925 wait complete. 2024-08-20T01:36:42.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.399+0000 7efd1fed5740 1 -- start start 2024-08-20T01:36:42.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.399+0000 7efd1fed5740 1 Processor -- start 2024-08-20T01:36:42.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.399+0000 7efd1fed5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c337d71bf0 0x55c337d7b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:42.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.399+0000 7efd1fed5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c337d72510 0x55c337d7ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:42.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.399+0000 7efd1fed5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c337d7e4a0 0x55c337d7bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:42.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.399+0000 7efd1fed5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c337b3a5f0 con 0x55c337d71bf0 2024-08-20T01:36:42.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.399+0000 7efd1fed5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c337c5e6c0 con 0x55c337d72510 2024-08-20T01:36:42.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.399+0000 7efd1fed5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c337d810f0 con 0x55c337d7e4a0 2024-08-20T01:36:42.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.399+0000 7efd1fed5740 10 client.0 _ll_register_callbacks cb 0x55c337c9b1e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:42.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.399+0000 7efd177fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c337d71bf0 0x55c337d7b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:42.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.399+0000 7efd177fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c337d71bf0 0x55c337d7b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38454/0 (socket says 172.21.15.79:38454) 2024-08-20T01:36:42.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.399+0000 7efd177fe640 1 -- 172.21.15.79:0/2769262839 learned_addr learned my addr 172.21.15.79:0/2769262839 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:42.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.399+0000 7efd17fff640 1 --2- 172.21.15.79:0/2769262839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c337d7e4a0 0x55c337d7bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:42.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.399+0000 7efd0effd640 1 --2- 172.21.15.79:0/2769262839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c337d72510 0x55c337d7ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:42.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.400+0000 7efd177fe640 1 -- 172.21.15.79:0/2769262839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c337d7e4a0 msgr2=0x55c337d7bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:42.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.400+0000 7efd177fe640 1 --2- 172.21.15.79:0/2769262839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c337d7e4a0 0x55c337d7bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:42.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.400+0000 7efd177fe640 1 -- 172.21.15.79:0/2769262839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c337d72510 msgr2=0x55c337d7ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:42.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.400+0000 7efd177fe640 1 --2- 172.21.15.79:0/2769262839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c337d72510 0x55c337d7ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:42.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.400+0000 7efd177fe640 1 -- 172.21.15.79:0/2769262839 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c337d8a5b0 con 0x55c337d71bf0 2024-08-20T01:36:42.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.400+0000 7efd0effd640 1 --2- 172.21.15.79:0/2769262839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c337d72510 0x55c337d7ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:36:42.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.400+0000 7efd177fe640 1 --2- 172.21.15.79:0/2769262839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c337d71bf0 0x55c337d7b500 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7efd08011e10 tx=0x7efd080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7047bcc32a7f5f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:42.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.400+0000 7efcf6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:36:42.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.400+0000 7efcf6ffd640 1 -- 172.21.15.79:0/2769262839 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd08004030 con 0x55c337d71bf0 2024-08-20T01:36:42.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.400+0000 7efcf6ffd640 1 -- 172.21.15.79:0/2769262839 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7efd080041d0 con 0x55c337d71bf0 2024-08-20T01:36:42.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.400+0000 7efd1fed5740 1 -- 172.21.15.79:0/2769262839 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd000053c0 con 0x55c337d71bf0 2024-08-20T01:36:42.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.400+0000 7efcf6ffd640 1 -- 172.21.15.79:0/2769262839 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7efd080043d0 con 0x55c337d71bf0 2024-08-20T01:36:42.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.400+0000 7efd1fed5740 10 client.15315 fetch_fsmap learned FSMap version 27 2024-08-20T01:36:42.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.400+0000 7efd1fed5740 1 -- 172.21.15.79:0/2769262839 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c337d8cfa0 con 0x55c337d71bf0 2024-08-20T01:36:42.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.400+0000 7efcf6ffd640 1 -- 172.21.15.79:0/2769262839 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd000053c0 con 0x55c337d71bf0 2024-08-20T01:36:42.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.400+0000 7efcf6ffd640 1 -- 172.21.15.79:0/2769262839 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7efd0801e440 con 0x55c337d71bf0 2024-08-20T01:36:42.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.400+0000 7efd1fed5740 10 client.15315 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:36:42.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.400+0000 7efd1fed5740 10 client.15315 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-20T01:36:42.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.400+0000 7efd1fed5740 20 client.15315 populate_metadata read hostname 'smithi079' 2024-08-20T01:36:42.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.400+0000 7efd1fed5740 1 --2- 172.21.15.79:0/2769262839 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55c337d8f630 0x55c337d90aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:42.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.400+0000 7efd1fed5740 4 client.15315 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:36:42.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.400+0000 7efd1fed5740 1 -- 172.21.15.79:0/2769262839 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c337cea5f0 con 0x55c337d8f630 2024-08-20T01:36:42.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.401+0000 7efd0effd640 1 --2- 172.21.15.79:0/2769262839 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55c337d8f630 0x55c337d90aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:42.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.401+0000 7efcf6ffd640 10 client.15315 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:36:42.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.401+0000 7efd0effd640 1 --2- 172.21.15.79:0/2769262839 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55c337d8f630 0x55c337d90aa0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2dd226ddc8a346d3 server_cookie=9fbcef1f5afcad00 in_seq=0 out_seq=0 2024-08-20T01:36:42.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.402+0000 7efcf6ffd640 1 -- 172.21.15.79:0/2769262839 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c337cea5f0 con 0x55c337d8f630 2024-08-20T01:36:42.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.402+0000 7efcf6ffd640 10 client.15315 handle_command_reply: tid=0 2024-08-20T01:36:42.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.402+0000 7efd1fed5740 1 client.15315 shutdown 2024-08-20T01:36:42.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.402+0000 7efd1fed5740 1 -- 172.21.15.79:0/2769262839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c337d71bf0 msgr2=0x55c337d7b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:42.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.402+0000 7efd1fed5740 1 --2- 172.21.15.79:0/2769262839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c337d71bf0 0x55c337d7b500 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7efd08011e10 tx=0x7efd080046c0 comp rx=0 tx=0).stop 2024-08-20T01:36:42.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.402+0000 7efd1fed5740 1 -- 172.21.15.79:0/2769262839 shutdown_connections 2024-08-20T01:36:42.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.402+0000 7efd1fed5740 1 --2- 172.21.15.79:0/2769262839 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55c337d8f630 0x55c337d90aa0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:42.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.402+0000 7efd1fed5740 1 --2- 172.21.15.79:0/2769262839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c337d7e4a0 0x55c337d7bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:42.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.402+0000 7efd1fed5740 1 --2- 172.21.15.79:0/2769262839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c337d72510 0x55c337d7ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:42.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.402+0000 7efcf6ffd640 0 client.15315 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:36:42.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.402+0000 7efd1fed5740 1 --2- 172.21.15.79:0/2769262839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c337d71bf0 0x55c337d7b500 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:42.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.402+0000 7efd1fed5740 1 -- 172.21.15.79:0/2769262839 >> 172.21.15.79:0/2769262839 conn(0x55c337d6fa20 msgr2=0x55c337d755c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:42.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.402+0000 7efd1fed5740 1 -- 172.21.15.79:0/2769262839 shutdown_connections 2024-08-20T01:36:42.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.402+0000 7efd1fed5740 1 -- 172.21.15.79:0/2769262839 wait complete. 2024-08-20T01:36:42.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.402+0000 7efd1fed5740 20 client.15315 trim_cache size 0 max 16384 2024-08-20T01:36:42.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.420+0000 7efd1fed5740 1 Processor -- start 2024-08-20T01:36:42.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.420+0000 7efd1fed5740 1 -- start start 2024-08-20T01:36:42.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.420+0000 7efd1fed5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c337d71bf0 0x55c337d75c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:42.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.420+0000 7efd1fed5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c337d72510 0x55c337d767e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:42.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.420+0000 7efd1fed5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c337d7e4a0 0x55c337d76d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:42.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.420+0000 7efd1fed5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c337d8ede0 con 0x55c337d71bf0 2024-08-20T01:36:42.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.420+0000 7efd1fed5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c337d8f4b0 con 0x55c337d7e4a0 2024-08-20T01:36:42.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.420+0000 7efd1fed5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c337d8fb80 con 0x55c337d72510 2024-08-20T01:36:42.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.420+0000 7efd177fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c337d71bf0 0x55c337d75c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:42.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.420+0000 7efd177fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c337d71bf0 0x55c337d75c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38462/0 (socket says 172.21.15.79:38462) 2024-08-20T01:36:42.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.420+0000 7efd177fe640 1 -- 172.21.15.79:0/1163444661 learned_addr learned my addr 172.21.15.79:0/1163444661 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:42.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.421+0000 7efd177fe640 1 -- 172.21.15.79:0/1163444661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c337d72510 msgr2=0x55c337d767e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:42.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.421+0000 7efd177fe640 1 --2- 172.21.15.79:0/1163444661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c337d72510 0x55c337d767e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:42.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.421+0000 7efd177fe640 1 -- 172.21.15.79:0/1163444661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c337d7e4a0 msgr2=0x55c337d76d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:42.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.421+0000 7efd177fe640 1 --2- 172.21.15.79:0/1163444661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c337d7e4a0 0x55c337d76d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:42.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.421+0000 7efd177fe640 1 -- 172.21.15.79:0/1163444661 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c337d79a00 con 0x55c337d71bf0 2024-08-20T01:36:42.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.421+0000 7efd177fe640 1 --2- 172.21.15.79:0/1163444661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c337d71bf0 0x55c337d75c60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7efd08011010 tx=0x7efd0800ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c951ce510e53068 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:42.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.421+0000 7efd0d7fa640 1 -- 172.21.15.79:0/1163444661 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0803f070 con 0x55c337d71bf0 2024-08-20T01:36:42.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.421+0000 7efd0d7fa640 1 -- 172.21.15.79:0/1163444661 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd08010c80 con 0x55c337d71bf0 2024-08-20T01:36:42.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.421+0000 7efd0d7fa640 1 -- 172.21.15.79:0/1163444661 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0801e680 con 0x55c337d71bf0 2024-08-20T01:36:42.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.422+0000 7efd1fed5740 1 -- 172.21.15.79:0/1163444661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c337d71bf0 msgr2=0x55c337d75c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:42.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.422+0000 7efd1fed5740 1 --2- 172.21.15.79:0/1163444661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c337d71bf0 0x55c337d75c60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7efd08011010 tx=0x7efd0800ec60 comp rx=0 tx=0).stop 2024-08-20T01:36:42.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.422+0000 7efd1fed5740 1 -- 172.21.15.79:0/1163444661 shutdown_connections 2024-08-20T01:36:42.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.422+0000 7efd1fed5740 1 --2- 172.21.15.79:0/1163444661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c337d7e4a0 0x55c337d76d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:42.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.422+0000 7efd1fed5740 1 --2- 172.21.15.79:0/1163444661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c337d72510 0x55c337d767e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:42.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.422+0000 7efd1fed5740 1 --2- 172.21.15.79:0/1163444661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c337d71bf0 0x55c337d75c60 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:42.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.422+0000 7efd1fed5740 1 -- 172.21.15.79:0/1163444661 >> 172.21.15.79:0/1163444661 conn(0x55c337d6fa20 msgr2=0x55c337d70b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:42.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.422+0000 7efd1fed5740 1 -- 172.21.15.79:0/1163444661 shutdown_connections 2024-08-20T01:36:42.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.422+0000 7efd1fed5740 1 -- 172.21.15.79:0/1163444661 wait complete. 2024-08-20T01:36:42.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.422+0000 7efd1fed5740 1 -- start start 2024-08-20T01:36:42.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.422+0000 7efd1fed5740 1 Processor -- start 2024-08-20T01:36:42.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.423+0000 7efd1fed5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c337d71bf0 0x55c337d92030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:42.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.423+0000 7efd1fed5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c337d72510 0x55c337d925b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:42.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.423+0000 7efd1fed5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c337d7e4a0 0x55c337d97650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:42.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.423+0000 7efd1fed5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c337d90920 con 0x55c337d72510 2024-08-20T01:36:42.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.423+0000 7efd1fed5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c337d90250 con 0x55c337d7e4a0 2024-08-20T01:36:42.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.423+0000 7efd1fed5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c337d90ff0 con 0x55c337d71bf0 2024-08-20T01:36:42.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.423+0000 7efd1fed5740 10 client.0 _ll_register_callbacks cb 0x7efd0800c960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:42.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.423+0000 7efd0effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c337d72510 0x55c337d925b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:42.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.423+0000 7efd0effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c337d72510 0x55c337d925b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38476/0 (socket says 172.21.15.79:38476) 2024-08-20T01:36:42.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.423+0000 7efd0effd640 1 -- 172.21.15.79:0/1426316223 learned_addr learned my addr 172.21.15.79:0/1426316223 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:42.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.423+0000 7efd17fff640 1 --2- 172.21.15.79:0/1426316223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c337d7e4a0 0x55c337d97650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:42.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.423+0000 7efd0effd640 1 -- 172.21.15.79:0/1426316223 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c337d71bf0 msgr2=0x55c337d92030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:42.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.423+0000 7efd0effd640 1 --2- 172.21.15.79:0/1426316223 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c337d71bf0 0x55c337d92030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:42.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.423+0000 7efd0effd640 1 -- 172.21.15.79:0/1426316223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c337d7e4a0 msgr2=0x55c337d97650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:42.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.423+0000 7efd0effd640 1 --2- 172.21.15.79:0/1426316223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c337d7e4a0 0x55c337d97650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:42.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.423+0000 7efd0effd640 1 -- 172.21.15.79:0/1426316223 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c337d97d60 con 0x55c337d72510 2024-08-20T01:36:42.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.423+0000 7efd0effd640 1 --2- 172.21.15.79:0/1426316223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c337d72510 0x55c337d925b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x55c337d71ba0 tx=0x7efd00004f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a87437bc2a40dd6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:42.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.423+0000 7efcf6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:36:42.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.423+0000 7efcf6ffd640 1 -- 172.21.15.79:0/1426316223 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd00035070 con 0x55c337d72510 2024-08-20T01:36:42.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.423+0000 7efcf6ffd640 1 -- 172.21.15.79:0/1426316223 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7efd000042b0 con 0x55c337d72510 2024-08-20T01:36:42.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.423+0000 7efd1fed5740 1 -- 172.21.15.79:0/1426316223 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd08010c80 con 0x55c337d72510 2024-08-20T01:36:42.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.423+0000 7efcf6ffd640 1 -- 172.21.15.79:0/1426316223 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7efd00045040 con 0x55c337d72510 2024-08-20T01:36:42.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.423+0000 7efd1fed5740 10 client.15321 fetch_fsmap learned FSMap version 27 2024-08-20T01:36:42.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.423+0000 7efd1fed5740 1 -- 172.21.15.79:0/1426316223 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c337d991c0 con 0x55c337d72510 2024-08-20T01:36:42.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.424+0000 7efcf6ffd640 1 -- 172.21.15.79:0/1426316223 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd08010c80 con 0x55c337d72510 2024-08-20T01:36:42.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.424+0000 7efcf6ffd640 1 -- 172.21.15.79:0/1426316223 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7efd0003a050 con 0x55c337d72510 2024-08-20T01:36:42.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.424+0000 7efd1fed5740 10 client.15321 fetch_fsmap finished waiting for FSMap version 27 2024-08-20T01:36:42.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.424+0000 7efd1fed5740 10 client.15321 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-20T01:36:42.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.424+0000 7efd1fed5740 20 client.15321 populate_metadata read hostname 'smithi079' 2024-08-20T01:36:42.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.424+0000 7efd1fed5740 1 --2- 172.21.15.79:0/1426316223 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55c337d8f630 0x55c337dfc740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:42.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.424+0000 7efd1fed5740 4 client.15321 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-20T01:36:42.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.424+0000 7efd1fed5740 1 -- 172.21.15.79:0/1426316223 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "status"}) -- 0x55c337ce6090 con 0x55c337d8f630 2024-08-20T01:36:42.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.424+0000 7efd177fe640 1 --2- 172.21.15.79:0/1426316223 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55c337d8f630 0x55c337dfc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:42.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.424+0000 7efcf6ffd640 10 client.15321 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:36:42.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.424+0000 7efd177fe640 1 --2- 172.21.15.79:0/1426316223 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55c337d8f630 0x55c337dfc740 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9423a1950e25108 server_cookie=a28a23d3ac46498d in_seq=0 out_seq=0 2024-08-20T01:36:42.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.425+0000 7efcf6ffd640 1 -- 172.21.15.79:0/1426316223 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55c337ce6090 con 0x55c337d8f630 2024-08-20T01:36:42.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.425+0000 7efcf6ffd640 10 client.15321 handle_command_reply: tid=0 2024-08-20T01:36:42.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.425+0000 7efd1fed5740 1 client.15321 shutdown 2024-08-20T01:36:42.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.425+0000 7efd1fed5740 1 -- 172.21.15.79:0/1426316223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c337d72510 msgr2=0x55c337d925b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:42.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.425+0000 7efd1fed5740 1 --2- 172.21.15.79:0/1426316223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c337d72510 0x55c337d925b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x55c337d71ba0 tx=0x7efd00004f20 comp rx=0 tx=0).stop 2024-08-20T01:36:42.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.425+0000 7efd1fed5740 1 -- 172.21.15.79:0/1426316223 shutdown_connections 2024-08-20T01:36:42.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.425+0000 7efd1fed5740 1 --2- 172.21.15.79:0/1426316223 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55c337d8f630 0x55c337dfc740 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:42.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.425+0000 7efd1fed5740 1 --2- 172.21.15.79:0/1426316223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c337d7e4a0 0x55c337d97650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:42.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.425+0000 7efcf6ffd640 0 client.15321 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:36:42.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.425+0000 7efd1fed5740 1 --2- 172.21.15.79:0/1426316223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c337d72510 0x55c337d925b0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:42.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.425+0000 7efd1fed5740 1 --2- 172.21.15.79:0/1426316223 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c337d71bf0 0x55c337d92030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:42.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.425+0000 7efd1fed5740 1 -- 172.21.15.79:0/1426316223 >> 172.21.15.79:0/1426316223 conn(0x55c337d6fa20 msgr2=0x55c337d767e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:42.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.425+0000 7efd1fed5740 1 -- 172.21.15.79:0/1426316223 shutdown_connections 2024-08-20T01:36:42.451 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:36:42.451 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "28484e9a-5e93-11ef-bccf-c7b262605968", 2024-08-20T01:36:42.451 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2024-08-20T01:36:42.451 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 24539, 2024-08-20T01:36:42.451 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2024-08-20T01:36:42.451 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2024-08-20T01:36:42.451 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2024-08-20T01:36:42.452 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 107.06469140999999, 2024-08-20T01:36:42.452 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 27, 2024-08-20T01:36:42.452 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 74, 2024-08-20T01:36:42.452 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 72, 2024-08-20T01:36:42.452 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 117.83051639 2024-08-20T01:36:42.452 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:36:42.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.425+0000 7efd1fed5740 1 -- 172.21.15.79:0/1426316223 wait complete. 2024-08-20T01:36:42.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.425+0000 7efd1fed5740 20 client.15321 trim_cache size 0 max 16384 2024-08-20T01:36:42.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.425+0000 7efd1dadc640 1 -- 172.21.15.79:0/2751877419 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7efd040b3bd0 msgr2=0x7efd040b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:42.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.425+0000 7efd1dadc640 1 --2- 172.21.15.79:0/2751877419 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7efd040b3bd0 0x7efd040b6090 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7efd080058c0 tx=0x7efd08005850 comp rx=0 tx=0).stop 2024-08-20T01:36:42.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.426+0000 7efd1dadc640 1 -- 172.21.15.79:0/2751877419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd1810ce00 msgr2=0x7efd181020d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:42.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.426+0000 7efd1dadc640 1 --2- 172.21.15.79:0/2751877419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd1810ce00 0x7efd181020d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7efd1000eaa0 tx=0x7efd1000ef60 comp rx=0 tx=0).stop 2024-08-20T01:36:42.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.426+0000 7efd1dadc640 1 -- 172.21.15.79:0/2751877419 shutdown_connections 2024-08-20T01:36:42.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.426+0000 7efd1dadc640 1 --2- 172.21.15.79:0/2751877419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd1810ce00 0x7efd181020d0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:42.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.426+0000 7efd1dadc640 1 --2- 172.21.15.79:0/2751877419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd181042c0 0x7efd18101b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:42.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.426+0000 7efd1dadc640 1 --2- 172.21.15.79:0/2751877419 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7efd040b3bd0 0x7efd040b6090 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:42.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.426+0000 7efd1dadc640 1 --2- 172.21.15.79:0/2751877419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd181039a0 0x7efd18101650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:42.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.426+0000 7efd1dadc640 1 -- 172.21.15.79:0/2751877419 >> 172.21.15.79:0/2751877419 conn(0x7efd180fd400 msgr2=0x7efd180fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:42.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.426+0000 7efd1dadc640 1 -- 172.21.15.79:0/2751877419 shutdown_connections 2024-08-20T01:36:42.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:42.426+0000 7efd1dadc640 1 -- 172.21.15.79:0/2751877419 wait complete. 2024-08-20T01:36:42.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:42 smithi081 ceph-mon[22209]: pgmap v328: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-20T01:36:43.177 INFO:teuthology.run_tasks:Running task sequential... 2024-08-20T01:36:43.208 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-08-20T01:36:43.209 INFO:teuthology.task.sequential:In sequential, running task print... 2024-08-20T01:36:43.242 INFO:teuthology.task.print:Enabling mgr modules 2024-08-20T01:36:43.242 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-08-20T01:36:43.276 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-08-20T01:36:43.277 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-08-20T01:36:43.277 INFO:tasks.ceph_fuse:client.0 config is {'mount_subvol_num': 0} 2024-08-20T01:36:43.277 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-20T01:36:43.277 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-20T01:36:43.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T01:36:43.278 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-08-20T01:36:43.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T01:36:43.297 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link delete ceph-brx 2024-08-20T01:36:43.366 INFO:teuthology.orchestra.run.smithi079.stderr:Cannot find device "ceph-brx" 2024-08-20T01:36:43.368 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-20T01:36:43.368 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-08-20T01:36:43.368 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-08-20T01:36:43.369 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs ls 2024-08-20T01:36:43.658 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:36:44.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.125+0000 7fd2e1f54640 1 -- 172.21.15.79:0/1691253734 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2dc101990 msgr2=0x7fd2dc101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:44.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.125+0000 7fd2e1f54640 1 --2- 172.21.15.79:0/1691253734 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2dc101990 0x7fd2dc101d70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc009ca0 tx=0x7fd2cc02a8c0 comp rx=0 tx=0).stop 2024-08-20T01:36:44.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.125+0000 7fd2e1f54640 1 -- 172.21.15.79:0/1691253734 shutdown_connections 2024-08-20T01:36:44.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.125+0000 7fd2e1f54640 1 --2- 172.21.15.79:0/1691253734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2dc107d20 0x7fd2dc10e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:44.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.125+0000 7fd2e1f54640 1 --2- 172.21.15.79:0/1691253734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2dc1073a0 0x7fd2dc1077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:44.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.125+0000 7fd2e1f54640 1 --2- 172.21.15.79:0/1691253734 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2dc101990 0x7fd2dc101d70 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:44.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.125+0000 7fd2e1f54640 1 -- 172.21.15.79:0/1691253734 >> 172.21.15.79:0/1691253734 conn(0x7fd2dc0fd400 msgr2=0x7fd2dc0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:44.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.125+0000 7fd2e1f54640 1 -- 172.21.15.79:0/1691253734 shutdown_connections 2024-08-20T01:36:44.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.125+0000 7fd2e1f54640 1 -- 172.21.15.79:0/1691253734 wait complete. 2024-08-20T01:36:44.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.126+0000 7fd2e1f54640 1 Processor -- start 2024-08-20T01:36:44.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.126+0000 7fd2e1f54640 1 -- start start 2024-08-20T01:36:44.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.126+0000 7fd2e1f54640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2dc101990 0x7fd2dc197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:44.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.126+0000 7fd2e1f54640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2dc1073a0 0x7fd2dc198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:44.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.126+0000 7fd2e1f54640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2dc107d20 0x7fd2dc19d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:44.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.126+0000 7fd2e1f54640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd2dc1118e0 con 0x7fd2dc101990 2024-08-20T01:36:44.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.126+0000 7fd2e1f54640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd2dc111760 con 0x7fd2dc1073a0 2024-08-20T01:36:44.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.126+0000 7fd2e1f54640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd2dc111a60 con 0x7fd2dc107d20 2024-08-20T01:36:44.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.126+0000 7fd2db7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2dc101990 0x7fd2dc197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:44.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.126+0000 7fd2db7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2dc101990 0x7fd2dc197d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38494/0 (socket says 172.21.15.79:38494) 2024-08-20T01:36:44.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.126+0000 7fd2db7fe640 1 -- 172.21.15.79:0/2847148985 learned_addr learned my addr 172.21.15.79:0/2847148985 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:44.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.126+0000 7fd2daffd640 1 --2- 172.21.15.79:0/2847148985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2dc1073a0 0x7fd2dc198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:44.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.126+0000 7fd2dbfff640 1 --2- 172.21.15.79:0/2847148985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2dc107d20 0x7fd2dc19d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:44.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.127+0000 7fd2db7fe640 1 -- 172.21.15.79:0/2847148985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2dc107d20 msgr2=0x7fd2dc19d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:44.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.127+0000 7fd2db7fe640 1 --2- 172.21.15.79:0/2847148985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2dc107d20 0x7fd2dc19d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:44.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.127+0000 7fd2db7fe640 1 -- 172.21.15.79:0/2847148985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2dc1073a0 msgr2=0x7fd2dc198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:44.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.127+0000 7fd2db7fe640 1 --2- 172.21.15.79:0/2847148985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2dc1073a0 0x7fd2dc198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:44.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.127+0000 7fd2db7fe640 1 -- 172.21.15.79:0/2847148985 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2dc19de00 con 0x7fd2dc101990 2024-08-20T01:36:44.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.127+0000 7fd2daffd640 1 --2- 172.21.15.79:0/2847148985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2dc1073a0 0x7fd2dc198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:36:44.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.127+0000 7fd2db7fe640 1 --2- 172.21.15.79:0/2847148985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2dc101990 0x7fd2dc197d50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc006010 tx=0x7fd2cc032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:44.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.127+0000 7fd2d8ff9640 1 -- 172.21.15.79:0/2847148985 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc004040 con 0x7fd2dc101990 2024-08-20T01:36:44.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.127+0000 7fd2e1f54640 1 -- 172.21.15.79:0/2847148985 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2dc19e090 con 0x7fd2dc101990 2024-08-20T01:36:44.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.127+0000 7fd2d8ff9640 1 -- 172.21.15.79:0/2847148985 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd2cc004670 con 0x7fd2dc101990 2024-08-20T01:36:44.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.127+0000 7fd2d8ff9640 1 -- 172.21.15.79:0/2847148985 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc030da0 con 0x7fd2dc101990 2024-08-20T01:36:44.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.127+0000 7fd2e1f54640 1 -- 172.21.15.79:0/2847148985 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2dc1a47b0 con 0x7fd2dc101990 2024-08-20T01:36:44.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.128+0000 7fd2e1f54640 1 -- 172.21.15.79:0/2847148985 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2dc101d70 con 0x7fd2dc101990 2024-08-20T01:36:44.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.130+0000 7fd2d8ff9640 1 -- 172.21.15.79:0/2847148985 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fd2cc0305c0 con 0x7fd2dc101990 2024-08-20T01:36:44.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.131+0000 7fd2d8ff9640 1 --2- 172.21.15.79:0/2847148985 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd2c80b3bd0 0x7fd2c80b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:44.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.131+0000 7fd2daffd640 1 --2- 172.21.15.79:0/2847148985 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd2c80b3bd0 0x7fd2c80b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:44.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.131+0000 7fd2d8ff9640 1 -- 172.21.15.79:0/2847148985 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fd2cc105530 con 0x7fd2dc101990 2024-08-20T01:36:44.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.131+0000 7fd2daffd640 1 --2- 172.21.15.79:0/2847148985 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd2c80b3bd0 0x7fd2c80b6090 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc100d40 tx=0x7fd2c400a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:44.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.134+0000 7fd2d8ff9640 1 -- 172.21.15.79:0/2847148985 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fd2cc004820 con 0x7fd2dc101990 2024-08-20T01:36:44.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.344+0000 7fd2e1f54640 1 -- 172.21.15.79:0/2847148985 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd2dc198e80 con 0x7fd2dc101990 2024-08-20T01:36:44.347 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:44 smithi079 ceph-mon[18656]: pgmap v329: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T01:36:44.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.344+0000 7fd2d8ff9640 1 -- 172.21.15.79:0/2847148985 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7fd2cc0ccb90 con 0x7fd2dc101990 2024-08-20T01:36:44.347 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-20T01:36:44.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.348+0000 7fd2e1f54640 1 -- 172.21.15.79:0/2847148985 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd2c80b3bd0 msgr2=0x7fd2c80b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:44.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.348+0000 7fd2e1f54640 1 --2- 172.21.15.79:0/2847148985 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd2c80b3bd0 0x7fd2c80b6090 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc100d40 tx=0x7fd2c400a5c0 comp rx=0 tx=0).stop 2024-08-20T01:36:44.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.348+0000 7fd2e1f54640 1 -- 172.21.15.79:0/2847148985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2dc101990 msgr2=0x7fd2dc197d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:44.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.348+0000 7fd2e1f54640 1 --2- 172.21.15.79:0/2847148985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2dc101990 0x7fd2dc197d50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc006010 tx=0x7fd2cc032bc0 comp rx=0 tx=0).stop 2024-08-20T01:36:44.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.348+0000 7fd2e1f54640 1 -- 172.21.15.79:0/2847148985 shutdown_connections 2024-08-20T01:36:44.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.348+0000 7fd2e1f54640 1 --2- 172.21.15.79:0/2847148985 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd2c80b3bd0 0x7fd2c80b6090 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:44.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.348+0000 7fd2e1f54640 1 --2- 172.21.15.79:0/2847148985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2dc107d20 0x7fd2dc19d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:44.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.348+0000 7fd2e1f54640 1 --2- 172.21.15.79:0/2847148985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2dc1073a0 0x7fd2dc198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:44.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.348+0000 7fd2e1f54640 1 --2- 172.21.15.79:0/2847148985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2dc101990 0x7fd2dc197d50 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:44.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.348+0000 7fd2e1f54640 1 -- 172.21.15.79:0/2847148985 >> 172.21.15.79:0/2847148985 conn(0x7fd2dc0fd400 msgr2=0x7fd2dc0ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:44.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.348+0000 7fd2e1f54640 1 -- 172.21.15.79:0/2847148985 shutdown_connections 2024-08-20T01:36:44.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:44.348+0000 7fd2e1f54640 1 -- 172.21.15.79:0/2847148985 wait complete. 2024-08-20T01:36:44.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:44 smithi175 ceph-mon[22392]: pgmap v329: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T01:36:44.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:44 smithi081 ceph-mon[22209]: pgmap v329: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T01:36:45.006 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-20T01:36:45.006 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-20T01:36:45.006 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2024-08-20T01:36:45.006 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-20T01:36:45.006 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-20T01:36:45.006 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-20T01:36:45.006 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-20T01:36:45.006 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-20T01:36:45.006 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-20T01:36:45.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T01:36:45.011 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2024-08-20T01:36:45.029 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-20T01:36:45.029 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-20T01:36:45.029 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-08-20T01:36:45.030 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-08-20T01:36:45.030 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-08-20T01:36:45.030 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-08-20T01:36:45.030 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-20T01:36:45.030 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2024-08-20T01:36:45.030 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2024-08-20T01:36:45.030 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-20T01:36:45.030 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2024-08-20T01:36:45.030 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2024-08-20T01:36:45.030 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-20T01:36:45.030 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2024-08-20T01:36:45.030 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-20T01:36:45.031 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2024-08-20T01:36:45.031 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-20T01:36:45.031 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42247sec preferred_lft 42247sec 2024-08-20T01:36:45.031 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::f3b9:9ad0:b997:fd33/64 scope link noprefixroute 2024-08-20T01:36:45.031 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-08-20T01:36:45.031 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-20T01:36:45.031 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-20T01:36:45.032 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-08-20T01:36:45.032 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link add name ceph-brx type bridge 2024-08-20T01:36:45.032 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip addr flush dev ceph-brx 2024-08-20T01:36:45.032 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set ceph-brx up 2024-08-20T01:36:45.032 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-20T01:36:45.032 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-08-20T01:36:45.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-20T01:36:45.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-20T01:36:45.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T01:36:45.225 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-20T01:36:45.234 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:45 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2847148985' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-20T01:36:45.250 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-08-20T01:36:45.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T01:36:45.252 DEBUG:teuthology.orchestra.run.smithi079:> route 2024-08-20T01:36:45.323 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2024-08-20T01:36:45.323 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-20T01:36:45.323 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-20T01:36:45.323 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-20T01:36:45.323 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-20T01:36:45.324 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-20T01:36:45.324 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-08-20T01:36:45.324 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-20T01:36:45.324 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-20T01:36:45.324 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-20T01:36:45.324 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-08-20T01:36:45.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:45 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2847148985' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-20T01:36:45.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-20T01:36:45.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:45 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2847148985' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-20T01:36:45.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-20T01:36:45.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T01:36:45.607 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-08-20T01:36:45.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T01:36:45.624 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list-id 2024-08-20T01:36:45.679 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-20T01:36:45.679 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-08-20T01:36:45.680 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-20T01:36:45.680 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-20T01:36:45.680 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-08-20T01:36:45.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-20T01:36:45.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-20T01:36:45.796 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-20T01:36:45.797 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-20T01:36:45.797 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-08-20T01:36:45.797 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-20T01:36:45.797 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-20T01:36:45.797 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-20T01:36:45.797 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-20T01:36:45.797 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-20T01:36:45.797 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-08-20T01:36:45.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-20T01:36:45.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-20T01:36:45.929 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-20T01:36:45.929 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-08-20T01:36:45.929 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2024-08-20T01:36:45.930 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set dev brx.0 master ceph-brx 2024-08-20T01:36:45.930 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-08-20T01:36:45.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-20T01:36:46.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-20T01:36:46.006 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mount_subvol_num': 0} 2024-08-20T01:36:46.006 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-20T01:36:46.006 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-20T01:36:46.021 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-20T01:36:46.021 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-20T01:36:46.021 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-20T01:36:46.076 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2024-08-20T01:36:46.142 DEBUG:teuthology.orchestra.run.smithi079:> cat /proc/self/mounts | awk '{print $2}' 2024-08-20T01:36:46.198 INFO:teuthology.orchestra.run.smithi079.stdout:/proc 2024-08-20T01:36:46.198 INFO:teuthology.orchestra.run.smithi079.stdout:/sys 2024-08-20T01:36:46.198 INFO:teuthology.orchestra.run.smithi079.stdout:/dev 2024-08-20T01:36:46.198 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/security 2024-08-20T01:36:46.198 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/shm 2024-08-20T01:36:46.198 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/pts 2024-08-20T01:36:46.198 INFO:teuthology.orchestra.run.smithi079.stdout:/run 2024-08-20T01:36:46.198 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/cgroup 2024-08-20T01:36:46.198 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/pstore 2024-08-20T01:36:46.198 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/bpf 2024-08-20T01:36:46.199 INFO:teuthology.orchestra.run.smithi079.stdout:/ 2024-08-20T01:36:46.199 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/selinux 2024-08-20T01:36:46.199 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-08-20T01:36:46.199 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/hugepages 2024-08-20T01:36:46.199 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/mqueue 2024-08-20T01:36:46.199 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/debug 2024-08-20T01:36:46.199 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/tracing 2024-08-20T01:36:46.199 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysusers.service 2024-08-20T01:36:46.199 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/config 2024-08-20T01:36:46.199 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/fuse/connections 2024-08-20T01:36:46.200 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysctl.service 2024-08-20T01:36:46.200 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-20T01:36:46.200 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-20T01:36:46.200 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/nfs/rpc_pipefs 2024-08-20T01:36:46.200 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/1000 2024-08-20T01:36:46.200 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph 2024-08-20T01:36:46.200 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay 2024-08-20T01:36:46.200 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/4cf1d04ccc663cf57790608c673bae0606805138cf164d161cc78cae237f8d9b/merged 2024-08-20T01:36:46.200 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/d071992a9d1aa3d0018bf617d190cb58303a8f2db668389fe0d7b62781834bdd/merged 2024-08-20T01:36:46.200 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/0 2024-08-20T01:36:46.200 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-08-20T01:36:46.201 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/e532250c85bcff6c039000bc07b49182cc5faaae6b81153cc6fd5c90d756cb60/merged 2024-08-20T01:36:46.201 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/1e894f964c9900ac2c48b72991e9314821c2700418808ed6f83a660b0437f1c1/merged 2024-08-20T01:36:46.201 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/0c91e57b8f3e2d98ec94c033d81739bd076411bf15c28712248d6e965abbe859/merged 2024-08-20T01:36:46.201 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/f6694d7e5f52ea9d80ac6866e572ec7187ffac8cb26be9ec2eab033c3d0a15f4/merged 2024-08-20T01:36:46.201 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/b2462e94d999ece520d9261b446ed1811bb7857dac7b593384a796dd078016a3/merged 2024-08-20T01:36:46.201 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/3b8fdf7f1a9f93ecede4395ba83f8172d62acf2dab7955ab7900ed31946b1805/merged 2024-08-20T01:36:46.201 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/927cc9a694dcf3dc839a81de781ec196b9c097a1ce0afd17e19997ae1610b181/merged 2024-08-20T01:36:46.201 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/22adda25d7bf33af5fa45c2e12d2d9e642bf562793ec817a982e605aa43d20d8/merged 2024-08-20T01:36:46.201 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns 2024-08-20T01:36:46.201 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-20T01:36:46.201 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-20T01:36:46.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T01:36:46.202 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2024-08-20T01:36:46.255 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-20T01:36:46.255 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/volumes/qa/sv_0/0a392478-c073-43eb-95a9-03dd7d2f4c34 --client_fs=cephfs) 2024-08-20T01:36:46.298 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2024-08-20T01:36:46.322 DEBUG:teuthology.orchestra.run.smithi079:> cat /proc/self/mounts | awk '{print $2}' 2024-08-20T01:36:46.338 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:46 smithi079 ceph-mon[18656]: pgmap v330: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-20T01:36:46.353 INFO:teuthology.orchestra.run.smithi079.stdout:/proc 2024-08-20T01:36:46.353 INFO:teuthology.orchestra.run.smithi079.stdout:/sys 2024-08-20T01:36:46.353 INFO:teuthology.orchestra.run.smithi079.stdout:/dev 2024-08-20T01:36:46.353 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/security 2024-08-20T01:36:46.353 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/shm 2024-08-20T01:36:46.353 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/pts 2024-08-20T01:36:46.354 INFO:teuthology.orchestra.run.smithi079.stdout:/run 2024-08-20T01:36:46.354 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/cgroup 2024-08-20T01:36:46.354 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/pstore 2024-08-20T01:36:46.354 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/bpf 2024-08-20T01:36:46.354 INFO:teuthology.orchestra.run.smithi079.stdout:/ 2024-08-20T01:36:46.354 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/selinux 2024-08-20T01:36:46.354 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-08-20T01:36:46.354 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/hugepages 2024-08-20T01:36:46.354 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/mqueue 2024-08-20T01:36:46.354 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/debug 2024-08-20T01:36:46.354 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/tracing 2024-08-20T01:36:46.354 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysusers.service 2024-08-20T01:36:46.355 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/config 2024-08-20T01:36:46.355 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/fuse/connections 2024-08-20T01:36:46.355 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysctl.service 2024-08-20T01:36:46.355 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-20T01:36:46.355 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-20T01:36:46.355 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/nfs/rpc_pipefs 2024-08-20T01:36:46.356 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/1000 2024-08-20T01:36:46.356 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph 2024-08-20T01:36:46.356 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay 2024-08-20T01:36:46.356 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/4cf1d04ccc663cf57790608c673bae0606805138cf164d161cc78cae237f8d9b/merged 2024-08-20T01:36:46.356 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/d071992a9d1aa3d0018bf617d190cb58303a8f2db668389fe0d7b62781834bdd/merged 2024-08-20T01:36:46.356 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/0 2024-08-20T01:36:46.356 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-08-20T01:36:46.356 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/e532250c85bcff6c039000bc07b49182cc5faaae6b81153cc6fd5c90d756cb60/merged 2024-08-20T01:36:46.356 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/1e894f964c9900ac2c48b72991e9314821c2700418808ed6f83a660b0437f1c1/merged 2024-08-20T01:36:46.356 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/0c91e57b8f3e2d98ec94c033d81739bd076411bf15c28712248d6e965abbe859/merged 2024-08-20T01:36:46.356 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/f6694d7e5f52ea9d80ac6866e572ec7187ffac8cb26be9ec2eab033c3d0a15f4/merged 2024-08-20T01:36:46.356 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/b2462e94d999ece520d9261b446ed1811bb7857dac7b593384a796dd078016a3/merged 2024-08-20T01:36:46.357 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/3b8fdf7f1a9f93ecede4395ba83f8172d62acf2dab7955ab7900ed31946b1805/merged 2024-08-20T01:36:46.357 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/927cc9a694dcf3dc839a81de781ec196b9c097a1ce0afd17e19997ae1610b181/merged 2024-08-20T01:36:46.357 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/22adda25d7bf33af5fa45c2e12d2d9e642bf562793ec817a982e605aa43d20d8/merged 2024-08-20T01:36:46.357 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns 2024-08-20T01:36:46.357 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-20T01:36:46.357 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-20T01:36:46.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T01:36:46.357 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2024-08-20T01:36:46.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:46 smithi175 ceph-mon[22392]: pgmap v330: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-20T01:36:46.403 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:2024-08-20T01:36:46.401+0000 7ff1d2e0c480 -1 init, newargv = 0x56257b0c6160 newargc=15 2024-08-20T01:36:46.403 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[69504]: starting ceph client 2024-08-20T01:36:46.425 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[69504]: starting fuse 2024-08-20T01:36:46.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:46 smithi081 ceph-mon[22209]: pgmap v330: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-20T01:36:47.511 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2024-08-20T01:36:47.543 DEBUG:teuthology.orchestra.run.smithi079:> cat /proc/self/mounts | awk '{print $2}' 2024-08-20T01:36:47.603 INFO:teuthology.orchestra.run.smithi079.stdout:/proc 2024-08-20T01:36:47.604 INFO:teuthology.orchestra.run.smithi079.stdout:/sys 2024-08-20T01:36:47.604 INFO:teuthology.orchestra.run.smithi079.stdout:/dev 2024-08-20T01:36:47.604 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/security 2024-08-20T01:36:47.604 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/shm 2024-08-20T01:36:47.604 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/pts 2024-08-20T01:36:47.604 INFO:teuthology.orchestra.run.smithi079.stdout:/run 2024-08-20T01:36:47.604 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/cgroup 2024-08-20T01:36:47.604 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/pstore 2024-08-20T01:36:47.604 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/bpf 2024-08-20T01:36:47.604 INFO:teuthology.orchestra.run.smithi079.stdout:/ 2024-08-20T01:36:47.605 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/selinux 2024-08-20T01:36:47.605 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-08-20T01:36:47.605 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/hugepages 2024-08-20T01:36:47.605 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/mqueue 2024-08-20T01:36:47.605 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/debug 2024-08-20T01:36:47.605 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/tracing 2024-08-20T01:36:47.605 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysusers.service 2024-08-20T01:36:47.605 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/kernel/config 2024-08-20T01:36:47.605 INFO:teuthology.orchestra.run.smithi079.stdout:/sys/fs/fuse/connections 2024-08-20T01:36:47.605 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-sysctl.service 2024-08-20T01:36:47.605 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-20T01:36:47.605 INFO:teuthology.orchestra.run.smithi079.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-20T01:36:47.606 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/nfs/rpc_pipefs 2024-08-20T01:36:47.606 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/1000 2024-08-20T01:36:47.606 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/ceph 2024-08-20T01:36:47.606 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay 2024-08-20T01:36:47.606 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/4cf1d04ccc663cf57790608c673bae0606805138cf164d161cc78cae237f8d9b/merged 2024-08-20T01:36:47.606 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/d071992a9d1aa3d0018bf617d190cb58303a8f2db668389fe0d7b62781834bdd/merged 2024-08-20T01:36:47.606 INFO:teuthology.orchestra.run.smithi079.stdout:/run/user/0 2024-08-20T01:36:47.606 INFO:teuthology.orchestra.run.smithi079.stdout:/proc/sys/fs/binfmt_misc 2024-08-20T01:36:47.606 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/e532250c85bcff6c039000bc07b49182cc5faaae6b81153cc6fd5c90d756cb60/merged 2024-08-20T01:36:47.606 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/1e894f964c9900ac2c48b72991e9314821c2700418808ed6f83a660b0437f1c1/merged 2024-08-20T01:36:47.606 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/0c91e57b8f3e2d98ec94c033d81739bd076411bf15c28712248d6e965abbe859/merged 2024-08-20T01:36:47.606 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/f6694d7e5f52ea9d80ac6866e572ec7187ffac8cb26be9ec2eab033c3d0a15f4/merged 2024-08-20T01:36:47.607 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/b2462e94d999ece520d9261b446ed1811bb7857dac7b593384a796dd078016a3/merged 2024-08-20T01:36:47.607 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/3b8fdf7f1a9f93ecede4395ba83f8172d62acf2dab7955ab7900ed31946b1805/merged 2024-08-20T01:36:47.607 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/927cc9a694dcf3dc839a81de781ec196b9c097a1ce0afd17e19997ae1610b181/merged 2024-08-20T01:36:47.607 INFO:teuthology.orchestra.run.smithi079.stdout:/var/lib/containers/storage/overlay/22adda25d7bf33af5fa45c2e12d2d9e642bf562793ec817a982e605aa43d20d8/merged 2024-08-20T01:36:47.607 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns 2024-08-20T01:36:47.607 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-20T01:36:47.607 INFO:teuthology.orchestra.run.smithi079.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-20T01:36:47.607 INFO:teuthology.orchestra.run.smithi079.stdout:/home/ubuntu/cephtest/mnt.0 2024-08-20T01:36:47.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T01:36:47.607 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2024-08-20T01:36:47.662 INFO:teuthology.orchestra.run.smithi079.stdout:121 2024-08-20T01:36:47.662 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [121] 2024-08-20T01:36:47.662 DEBUG:teuthology.orchestra.run.smithi079:> sudo stdin-killer -- python3 -c ' 2024-08-20T01:36:47.662 DEBUG:teuthology.orchestra.run.smithi079:> import glob 2024-08-20T01:36:47.662 DEBUG:teuthology.orchestra.run.smithi079:> import re 2024-08-20T01:36:47.662 DEBUG:teuthology.orchestra.run.smithi079:> import os 2024-08-20T01:36:47.662 DEBUG:teuthology.orchestra.run.smithi079:> import subprocess 2024-08-20T01:36:47.662 DEBUG:teuthology.orchestra.run.smithi079:> 2024-08-20T01:36:47.663 DEBUG:teuthology.orchestra.run.smithi079:> def _find_admin_socket(client_name): 2024-08-20T01:36:47.663 DEBUG:teuthology.orchestra.run.smithi079:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-08-20T01:36:47.663 DEBUG:teuthology.orchestra.run.smithi079:> files = glob.glob(asok_path) 2024-08-20T01:36:47.663 DEBUG:teuthology.orchestra.run.smithi079:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-08-20T01:36:47.663 DEBUG:teuthology.orchestra.run.smithi079:> 2024-08-20T01:36:47.663 DEBUG:teuthology.orchestra.run.smithi079:> # Given a non-glob path, it better be there 2024-08-20T01:36:47.663 DEBUG:teuthology.orchestra.run.smithi079:> if "*" not in asok_path: 2024-08-20T01:36:47.663 DEBUG:teuthology.orchestra.run.smithi079:> assert(len(files) == 1) 2024-08-20T01:36:47.663 DEBUG:teuthology.orchestra.run.smithi079:> return files[0] 2024-08-20T01:36:47.664 DEBUG:teuthology.orchestra.run.smithi079:> 2024-08-20T01:36:47.664 DEBUG:teuthology.orchestra.run.smithi079:> for f in files: 2024-08-20T01:36:47.664 DEBUG:teuthology.orchestra.run.smithi079:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-20T01:36:47.664 DEBUG:teuthology.orchestra.run.smithi079:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-20T01:36:47.664 DEBUG:teuthology.orchestra.run.smithi079:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-20T01:36:47.664 DEBUG:teuthology.orchestra.run.smithi079:> contents = proc_f.read() 2024-08-20T01:36:47.664 DEBUG:teuthology.orchestra.run.smithi079:> if mountpoint in contents: 2024-08-20T01:36:47.664 DEBUG:teuthology.orchestra.run.smithi079:> return f 2024-08-20T01:36:47.664 DEBUG:teuthology.orchestra.run.smithi079:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-20T01:36:47.664 DEBUG:teuthology.orchestra.run.smithi079:> 2024-08-20T01:36:47.664 DEBUG:teuthology.orchestra.run.smithi079:> print(_find_admin_socket("client.0")) 2024-08-20T01:36:47.664 DEBUG:teuthology.orchestra.run.smithi079:> ' 2024-08-20T01:36:47.787 INFO:teuthology.orchestra.run.smithi079.stdout:/var/run/ceph/ceph-client.0.69504.asok 2024-08-20T01:36:47.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-20T01:36:47.800 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.69504.asok 2024-08-20T01:36:47.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T01:36:47.800 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.69504.asok status 2024-08-20T01:36:47.934 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:36:47.934 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": { 2024-08-20T01:36:47.934 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_sha1": "ef4275410d8483698016fe484b2a3c664080b4c1", 2024-08-20T01:36:47.934 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_version": "ceph version 19.0.0-5872-gef427541 (ef4275410d8483698016fe484b2a3c664080b4c1) squid (dev)", 2024-08-20T01:36:47.934 INFO:teuthology.orchestra.run.smithi079.stdout: "entity_id": "0", 2024-08-20T01:36:47.934 INFO:teuthology.orchestra.run.smithi079.stdout: "hostname": "smithi079", 2024-08-20T01:36:47.934 INFO:teuthology.orchestra.run.smithi079.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-08-20T01:36:47.934 INFO:teuthology.orchestra.run.smithi079.stdout: "pid": "69504", 2024-08-20T01:36:47.934 INFO:teuthology.orchestra.run.smithi079.stdout: "root": "/volumes/qa/sv_0/0a392478-c073-43eb-95a9-03dd7d2f4c34" 2024-08-20T01:36:47.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:36:47.935 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_count": 0, 2024-08-20T01:36:47.935 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_pinned_count": 0, 2024-08-20T01:36:47.935 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 15333, 2024-08-20T01:36:47.935 INFO:teuthology.orchestra.run.smithi079.stdout: "inst": { 2024-08-20T01:36:47.935 INFO:teuthology.orchestra.run.smithi079.stdout: "name": { 2024-08-20T01:36:47.935 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "client", 2024-08-20T01:36:47.935 INFO:teuthology.orchestra.run.smithi079.stdout: "num": 15333 2024-08-20T01:36:47.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:36:47.935 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2024-08-20T01:36:47.935 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-08-20T01:36:47.935 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2024-08-20T01:36:47.936 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1672231020 2024-08-20T01:36:47.936 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:36:47.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:36:47.936 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2024-08-20T01:36:47.936 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-08-20T01:36:47.936 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2024-08-20T01:36:47.936 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1672231020 2024-08-20T01:36:47.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:36:47.936 INFO:teuthology.orchestra.run.smithi079.stdout: "inst_str": "client.15333 192.168.0.1:0/1672231020", 2024-08-20T01:36:47.936 INFO:teuthology.orchestra.run.smithi079.stdout: "addr_str": "192.168.0.1:0/1672231020", 2024-08-20T01:36:47.936 INFO:teuthology.orchestra.run.smithi079.stdout: "inode_count": 5, 2024-08-20T01:36:47.936 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_epoch": 27, 2024-08-20T01:36:47.936 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch": 74, 2024-08-20T01:36:47.937 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch_barrier": 0, 2024-08-20T01:36:47.937 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklisted": false, 2024-08-20T01:36:47.937 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs" 2024-08-20T01:36:47.937 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:36:47.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T01:36:47.942 DEBUG:teuthology.orchestra.run.smithi079:> stat --file-system '--printf=%T 2024-08-20T01:36:47.942 DEBUG:teuthology.orchestra.run.smithi079:> ' -- /home/ubuntu/cephtest/mnt.0 2024-08-20T01:36:47.958 INFO:teuthology.orchestra.run.smithi079.stdout:fuseblk 2024-08-20T01:36:47.958 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-08-20T01:36:47.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T01:36:47.958 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-20T01:36:48.025 INFO:teuthology.run_tasks:Running task exec... 2024-08-20T01:36:48.055 INFO:teuthology.task.exec:Executing custom commands... 2024-08-20T01:36:48.055 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi079.front.sepia.ceph.com 2024-08-20T01:36:48.055 DEBUG:teuthology.orchestra.run.smithi079:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-08-20T01:36:48.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:48.165+0000 7fb187870640 1 -- 172.21.15.79:0/3391438579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb180101560 msgr2=0x7fb180101960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:48.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:48.165+0000 7fb187870640 1 --2- 172.21.15.79:0/3391438579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb180101560 0x7fb180101960 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb170009cd0 tx=0x7fb17002a8e0 comp rx=0 tx=0).stop 2024-08-20T01:36:48.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:48.165+0000 7fb187870640 1 -- 172.21.15.79:0/3391438579 shutdown_connections 2024-08-20T01:36:48.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:48.165+0000 7fb187870640 1 --2- 172.21.15.79:0/3391438579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb180103070 0x7fb1801099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:48.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:48.165+0000 7fb187870640 1 --2- 172.21.15.79:0/3391438579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1801026b0 0x7fb180102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:48.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:48.165+0000 7fb187870640 1 --2- 172.21.15.79:0/3391438579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb180101560 0x7fb180101960 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:48.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:48.165+0000 7fb187870640 1 -- 172.21.15.79:0/3391438579 >> 172.21.15.79:0/3391438579 conn(0x7fb1800fce40 msgr2=0x7fb1800ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:48.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:48.165+0000 7fb187870640 1 -- 172.21.15.79:0/3391438579 shutdown_connections 2024-08-20T01:36:48.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:48.165+0000 7fb187870640 1 -- 172.21.15.79:0/3391438579 wait complete. 2024-08-20T01:36:48.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:48.165+0000 7fb187870640 1 Processor -- start 2024-08-20T01:36:48.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:48.165+0000 7fb187870640 1 -- start start 2024-08-20T01:36:48.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:48.165+0000 7fb187870640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb180101560 0x7fb18006ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:48.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:48.165+0000 7fb187870640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1801026b0 0x7fb18019d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:48.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:48.166+0000 7fb187870640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb180103070 0x7fb18019fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:48.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:48.166+0000 7fb187870640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb18010d060 con 0x7fb180103070 2024-08-20T01:36:48.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:48.166+0000 7fb187870640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb18010cee0 con 0x7fb180101560 2024-08-20T01:36:48.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:48.166+0000 7fb187870640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb18010d1e0 con 0x7fb1801026b0 2024-08-20T01:36:48.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:48.166+0000 7fb185e0d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb180103070 0x7fb18019fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:48.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:48.166+0000 7fb185e0d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb180103070 0x7fb18019fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38514/0 (socket says 172.21.15.79:38514) 2024-08-20T01:36:48.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:48.166+0000 7fb185e0d640 1 -- 172.21.15.79:0/2778205487 learned_addr learned my addr 172.21.15.79:0/2778205487 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:48.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:48.166+0000 7fb18560c640 1 --2- 172.21.15.79:0/2778205487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb180101560 0x7fb18006ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:48.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:48.166+0000 7fb184e0b640 1 --2- 172.21.15.79:0/2778205487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1801026b0 0x7fb18019d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:48.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:48.166+0000 7fb185e0d640 1 -- 172.21.15.79:0/2778205487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1801026b0 msgr2=0x7fb18019d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:48.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:48.166+0000 7fb185e0d640 1 --2- 172.21.15.79:0/2778205487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1801026b0 0x7fb18019d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:48.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:48.166+0000 7fb185e0d640 1 -- 172.21.15.79:0/2778205487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb180101560 msgr2=0x7fb18006ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:48.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:48.166+0000 7fb185e0d640 1 --2- 172.21.15.79:0/2778205487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb180101560 0x7fb18006ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:48.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:48.166+0000 7fb185e0d640 1 -- 172.21.15.79:0/2778205487 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1801a05b0 con 0x7fb180103070 2024-08-20T01:36:48.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:48.166+0000 7fb185e0d640 1 --2- 172.21.15.79:0/2778205487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb180103070 0x7fb18019fcf0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb17800d950 tx=0x7fb17800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:48.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:48.166+0000 7fb17e7fc640 1 -- 172.21.15.79:0/2778205487 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb178017030 con 0x7fb180103070 2024-08-20T01:36:48.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:48.166+0000 7fb17e7fc640 1 -- 172.21.15.79:0/2778205487 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb178004020 con 0x7fb180103070 2024-08-20T01:36:48.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:48.166+0000 7fb17e7fc640 1 -- 172.21.15.79:0/2778205487 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb178003ab0 con 0x7fb180103070 2024-08-20T01:36:48.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:48.166+0000 7fb187870640 1 -- 172.21.15.79:0/2778205487 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1801a08a0 con 0x7fb180103070 2024-08-20T01:36:48.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:48.166+0000 7fb187870640 1 -- 172.21.15.79:0/2778205487 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1801a0df0 con 0x7fb180103070 2024-08-20T01:36:48.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:48.167+0000 7fb187870640 1 -- 172.21.15.79:0/2778205487 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb180108970 con 0x7fb180103070 2024-08-20T01:36:48.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:48.169+0000 7fb17e7fc640 1 -- 172.21.15.79:0/2778205487 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb17801a070 con 0x7fb180103070 2024-08-20T01:36:48.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:48.170+0000 7fb17e7fc640 1 --2- 172.21.15.79:0/2778205487 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb1680b3c50 0x7fb1680b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:48.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:48.170+0000 7fb18560c640 1 --2- 172.21.15.79:0/2778205487 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb1680b3c50 0x7fb1680b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:48.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:48.170+0000 7fb17e7fc640 1 -- 172.21.15.79:0/2778205487 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fb1780e3600 con 0x7fb180103070 2024-08-20T01:36:48.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:48.171+0000 7fb18560c640 1 --2- 172.21.15.79:0/2778205487 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb1680b3c50 0x7fb1680b6110 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb170006010 tx=0x7fb170009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:48.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:48.173+0000 7fb17e7fc640 1 -- 172.21.15.79:0/2778205487 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fb178021070 con 0x7fb180103070 2024-08-20T01:36:48.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:48.382+0000 7fb187870640 1 -- 172.21.15.79:0/2778205487 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7fb18002e340 con 0x7fb180103070 2024-08-20T01:36:48.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:48 smithi175 ceph-mon[22392]: pgmap v331: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-20T01:36:48.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:48 smithi079 ceph-mon[18656]: pgmap v331: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-20T01:36:48.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:48 smithi081 ceph-mon[22209]: pgmap v331: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-20T01:36:49.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.094+0000 7fb17e7fc640 1 -- 172.21.15.79:0/2778205487 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v28) ==== 117+0+0 (secure 0 0 0) 0x7fb1780aace0 con 0x7fb180103070 2024-08-20T01:36:49.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.097+0000 7fb187870640 1 -- 172.21.15.79:0/2778205487 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb1680b3c50 msgr2=0x7fb1680b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:49.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.097+0000 7fb187870640 1 --2- 172.21.15.79:0/2778205487 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb1680b3c50 0x7fb1680b6110 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb170006010 tx=0x7fb170009360 comp rx=0 tx=0).stop 2024-08-20T01:36:49.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.097+0000 7fb187870640 1 -- 172.21.15.79:0/2778205487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb180103070 msgr2=0x7fb18019fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:49.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.097+0000 7fb187870640 1 --2- 172.21.15.79:0/2778205487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb180103070 0x7fb18019fcf0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb17800d950 tx=0x7fb17800de10 comp rx=0 tx=0).stop 2024-08-20T01:36:49.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.097+0000 7fb187870640 1 -- 172.21.15.79:0/2778205487 shutdown_connections 2024-08-20T01:36:49.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.097+0000 7fb187870640 1 --2- 172.21.15.79:0/2778205487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb180103070 0x7fb18019fcf0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.097+0000 7fb187870640 1 --2- 172.21.15.79:0/2778205487 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb1680b3c50 0x7fb1680b6110 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.097+0000 7fb187870640 1 --2- 172.21.15.79:0/2778205487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1801026b0 0x7fb18019d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.097+0000 7fb187870640 1 --2- 172.21.15.79:0/2778205487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb180101560 0x7fb18006ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.097+0000 7fb187870640 1 -- 172.21.15.79:0/2778205487 >> 172.21.15.79:0/2778205487 conn(0x7fb1800fce40 msgr2=0x7fb180105b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:49.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.097+0000 7fb187870640 1 -- 172.21.15.79:0/2778205487 shutdown_connections 2024-08-20T01:36:49.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.097+0000 7fb187870640 1 -- 172.21.15.79:0/2778205487 wait complete. 2024-08-20T01:36:49.110 INFO:teuthology.run_tasks:Running task check-counter... 2024-08-20T01:36:49.140 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-08-20T01:36:49.156 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-20T01:36:49.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.254+0000 7f082b0a8640 1 -- 172.21.15.79:0/2505500682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08241015b0 msgr2=0x7f08241019b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:49.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.254+0000 7f082b0a8640 1 --2- 172.21.15.79:0/2505500682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08241015b0 0x7f08241019b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f0814009930 tx=0x7f081402a420 comp rx=0 tx=0).stop 2024-08-20T01:36:49.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.254+0000 7f082b0a8640 1 -- 172.21.15.79:0/2505500682 shutdown_connections 2024-08-20T01:36:49.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.254+0000 7f082b0a8640 1 --2- 172.21.15.79:0/2505500682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08241030c0 0x7f0824109a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.254+0000 7f082b0a8640 1 --2- 172.21.15.79:0/2505500682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0824102700 0x7f0824102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.254+0000 7f082b0a8640 1 --2- 172.21.15.79:0/2505500682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08241015b0 0x7f08241019b0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.254+0000 7f082b0a8640 1 -- 172.21.15.79:0/2505500682 >> 172.21.15.79:0/2505500682 conn(0x7f08240fce50 msgr2=0x7f08240ff290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:49.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.254+0000 7f082b0a8640 1 -- 172.21.15.79:0/2505500682 shutdown_connections 2024-08-20T01:36:49.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.254+0000 7f082b0a8640 1 -- 172.21.15.79:0/2505500682 wait complete. 2024-08-20T01:36:49.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.254+0000 7f082b0a8640 1 Processor -- start 2024-08-20T01:36:49.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.254+0000 7f082b0a8640 1 -- start start 2024-08-20T01:36:49.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.254+0000 7f082b0a8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08241015b0 0x7f08241989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:49.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.254+0000 7f082b0a8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0824102700 0x7f0824199030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:49.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.254+0000 7f082b0a8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08241030c0 0x7f0824199c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:49.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.254+0000 7f082b0a8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f082410d180 con 0x7f0824102700 2024-08-20T01:36:49.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.254+0000 7f082b0a8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f082410d000 con 0x7f08241015b0 2024-08-20T01:36:49.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.254+0000 7f082b0a8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f082410d300 con 0x7f08241030c0 2024-08-20T01:36:49.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.254+0000 7f0823fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0824102700 0x7f0824199030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:49.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.255+0000 7f0823fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0824102700 0x7f0824199030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38534/0 (socket says 172.21.15.79:38534) 2024-08-20T01:36:49.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.255+0000 7f0823fff640 1 -- 172.21.15.79:0/3326137687 learned_addr learned my addr 172.21.15.79:0/3326137687 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:49.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.255+0000 7f0828e44640 1 --2- 172.21.15.79:0/3326137687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08241015b0 0x7f08241989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:49.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.255+0000 7f0829645640 1 --2- 172.21.15.79:0/3326137687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08241030c0 0x7f0824199c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:49.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.255+0000 7f0823fff640 1 -- 172.21.15.79:0/3326137687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08241030c0 msgr2=0x7f0824199c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:49.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.255+0000 7f0823fff640 1 --2- 172.21.15.79:0/3326137687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08241030c0 0x7f0824199c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.255+0000 7f0823fff640 1 -- 172.21.15.79:0/3326137687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08241015b0 msgr2=0x7f08241989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:49.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.255+0000 7f0823fff640 1 --2- 172.21.15.79:0/3326137687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08241015b0 0x7f08241989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.255+0000 7f0823fff640 1 -- 172.21.15.79:0/3326137687 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f082419a520 con 0x7f0824102700 2024-08-20T01:36:49.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.255+0000 7f0823fff640 1 --2- 172.21.15.79:0/3326137687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0824102700 0x7f0824199030 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f080c00c920 tx=0x7f080c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:49.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.255+0000 7f0821ffb640 1 -- 172.21.15.79:0/3326137687 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080c007c70 con 0x7f0824102700 2024-08-20T01:36:49.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.255+0000 7f0821ffb640 1 -- 172.21.15.79:0/3326137687 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f080c007e10 con 0x7f0824102700 2024-08-20T01:36:49.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.255+0000 7f082b0a8640 1 -- 172.21.15.79:0/3326137687 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f082419a810 con 0x7f0824102700 2024-08-20T01:36:49.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.255+0000 7f0821ffb640 1 -- 172.21.15.79:0/3326137687 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080c018710 con 0x7f0824102700 2024-08-20T01:36:49.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.255+0000 7f082b0a8640 1 -- 172.21.15.79:0/3326137687 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08241a0ee0 con 0x7f0824102700 2024-08-20T01:36:49.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.256+0000 7f082b0a8640 1 -- 172.21.15.79:0/3326137687 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08241a1170 con 0x7f0824102700 2024-08-20T01:36:49.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.257+0000 7f0821ffb640 1 -- 172.21.15.79:0/3326137687 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f080c00f450 con 0x7f0824102700 2024-08-20T01:36:49.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.258+0000 7f0821ffb640 1 --2- 172.21.15.79:0/3326137687 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f08100b3c50 0x7f08100b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:49.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.258+0000 7f0828e44640 1 --2- 172.21.15.79:0/3326137687 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f08100b3c50 0x7f08100b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:49.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.258+0000 7f0821ffb640 1 -- 172.21.15.79:0/3326137687 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f080c0e4090 con 0x7f0824102700 2024-08-20T01:36:49.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.259+0000 7f0828e44640 1 --2- 172.21.15.79:0/3326137687 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f08100b3c50 0x7f08100b6110 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f08140057c0 tx=0x7f0814000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:49.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.261+0000 7f0821ffb640 1 -- 172.21.15.79:0/3326137687 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f080c014030 con 0x7f0824102700 2024-08-20T01:36:49.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:49 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2778205487' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-08-20T01:36:49.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:49 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2778205487' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-08-20T01:36:49.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.437+0000 7f082b0a8640 1 -- 172.21.15.79:0/3326137687 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f08241a1340 con 0x7f0824102700 2024-08-20T01:36:49.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.438+0000 7f0821ffb640 1 -- 172.21.15.79:0/3326137687 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22676 (secure 0 0 0) 0x7f080c0ab800 con 0x7f0824102700 2024-08-20T01:36:49.440 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:36:49.440 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":74,"fsid":"28484e9a-5e93-11ef-bccf-c7b262605968","created":"2024-08-20T01:27:07.792689+0000","modified":"2024-08-20T01:35:53.774800+0000","last_up_change":"2024-08-20T01:34:05.838937+0000","last_in_change":"2024-08-20T01:33:43.645153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-20T01:30:30.693903+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-20T01:34:50.585939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-20T01:34:52.980599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ccdbeb3d-bb9d-4275-ad7e-49f2cc1222cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6803","nonce":1274927648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6805","nonce":1274927648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6809","nonce":1274927648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6807","nonce":1274927648}]},"public_addr":"172.21.15.79:6803/1274927648","cluster_addr":"172.21.15.79:6805/1274927648","heartbeat_back_addr":"172.21.15.79:6809/1274927648","heartbeat_front_addr":"172.21.15.79:6807/1274927648","state":["exists","up"]},{"osd":1,"uuid":"0906bc46-f89d-482d-9402-43d17e4246a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6801","nonce":1174012328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6803","nonce":1174012328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6807","nonce":1174012328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6805","nonce":1174012328}]},"public_addr":"172.21.15.81:6801/1174012328","cluster_addr":"172.21.15.81:6803/1174012328","heartbeat_back_addr":"172.21.15.81:6807/1174012328","heartbeat_front_addr":"172.21.15.81:6805/1174012328","state":["exists","up"]},{"osd":2,"uuid":"11d8fb9d-cb2c-41c8-994c-603a1d8e01a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6801","nonce":1132306232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6803","nonce":1132306232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6807","nonce":1132306232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6805","nonce":1132306232}]},"public_addr":"172.21.15.175:6801/1132306232","cluster_addr":"172.21.15.175:6803/1132306232","heartbeat_back_addr":"172.21.15.175:6807/1132306232","heartbeat_front_addr":"172.21.15.175:6805/1132306232","state":["exists","up"]},{"osd":3,"uuid":"29e35242-957f-404b-b99e-d4dd0045c35d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6811","nonce":1364181822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6813","nonce":1364181822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6817","nonce":1364181822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6815","nonce":1364181822}]},"public_addr":"172.21.15.79:6811/1364181822","cluster_addr":"172.21.15.79:6813/1364181822","heartbeat_back_addr":"172.21.15.79:6817/1364181822","heartbeat_front_addr":"172.21.15.79:6815/1364181822","state":["exists","up"]},{"osd":4,"uuid":"9139c469-270f-4465-8adb-1e748529fa68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6809","nonce":306873968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6811","nonce":306873968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6815","nonce":306873968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6813","nonce":306873968}]},"public_addr":"172.21.15.81:6809/306873968","cluster_addr":"172.21.15.81:6811/306873968","heartbeat_back_addr":"172.21.15.81:6815/306873968","heartbeat_front_addr":"172.21.15.81:6813/306873968","state":["exists","up"]},{"osd":5,"uuid":"6394e462-4510-45d6-bc99-8660085cb206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6809","nonce":3908133424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6811","nonce":3908133424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6815","nonce":3908133424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6813","nonce":3908133424}]},"public_addr":"172.21.15.175:6809/3908133424","cluster_addr":"172.21.15.175:6811/3908133424","heartbeat_back_addr":"172.21.15.175:6815/3908133424","heartbeat_front_addr":"172.21.15.175:6813/3908133424","state":["exists","up"]},{"osd":6,"uuid":"e8e51380-e2be-4c4c-82d8-d86306d9fc1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6819","nonce":3379368280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6821","nonce":3379368280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6825","nonce":3379368280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6823","nonce":3379368280}]},"public_addr":"172.21.15.79:6819/3379368280","cluster_addr":"172.21.15.79:6821/3379368280","heartbeat_back_addr":"172.21.15.79:6825/3379368280","heartbeat_front_addr":"172.21.15.79:6823/3379368280","state":["exists","up"]},{"osd":7,"uuid":"875f7876-a2ca-4254-a8cc-27eebb11cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6817","nonce":747356685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6819","nonce":747356685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6823","nonce":747356685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6821","nonce":747356685}]},"public_addr":"172.21.15.81:6817/747356685","cluster_addr":"172.21.15.81:6819/747356685","heartbeat_back_addr":"172.21.15.81:6823/747356685","heartbeat_front_addr":"172.21.15.81:6821/747356685","state":["exists","up"]},{"osd":8,"uuid":"d714a33b-8df5-411d-bc99-b33b4b27cc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6817","nonce":1537762925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6819","nonce":1537762925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6823","nonce":1537762925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6821","nonce":1537762925}]},"public_addr":"172.21.15.175:6817/1537762925","cluster_addr":"172.21.15.175:6819/1537762925","heartbeat_back_addr":"172.21.15.175:6823/1537762925","heartbeat_front_addr":"172.21.15.175:6821/1537762925","state":["exists","up"]},{"osd":9,"uuid":"82db8305-1d72-4bef-99d6-5486e4de5b03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6827","nonce":2400574113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6829","nonce":2400574113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6833","nonce":2400574113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6831","nonce":2400574113}]},"public_addr":"172.21.15.79:6827/2400574113","cluster_addr":"172.21.15.79:6829/2400574113","heartbeat_back_addr":"172.21.15.79:6833/2400574113","heartbeat_front_addr":"172.21.15.79:6831/2400574113","state":["exists","up"]},{"osd":10,"uuid":"797e1e3f-12b5-4958-9e1f-f796cffaaf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6825","nonce":4188407500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6827","nonce":4188407500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6831","nonce":4188407500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6829","nonce":4188407500}]},"public_addr":"172.21.15.81:6825/4188407500","cluster_addr":"172.21.15.81:6827/4188407500","heartbeat_back_addr":"172.21.15.81:6831/4188407500","heartbeat_front_addr":"172.21.15.81:6829/4188407500","state":["exists","up"]},{"osd":11,"uuid":"a4d218ae-5a41-4b34-9c4e-e795c4a6a16d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6825","nonce":451069549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6827","nonce":451069549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6831","nonce":451069549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6829","nonce":451069549}]},"public_addr":"172.21.15.175:6825/451069549","cluster_addr":"172.21.15.175:6827/451069549","heartbeat_back_addr":"172.21.15.175:6831/451069549","heartbeat_front_addr":"172.21.15.175:6829/451069549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:29:42.003425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:30:05.353547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:30:28.916727+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:30:52.845671+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:31:16.926826+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:31:39.840986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:32:04.013287+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:32:28.237482+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:32:51.270643+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:33:15.825156+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:33:40.037915+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:34:04.477377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":3,"to":7}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:0/1750500064":"2024-08-21T01:27:52.389553+0000","172.21.15.79:0/103962305":"2024-08-21T01:27:52.389553+0000","172.21.15.79:6800/4045769179":"2024-08-21T01:27:29.643647+0000","172.21.15.79:0/525482354":"2024-08-21T01:27:52.389553+0000","172.21.15.79:6801/4045769179":"2024-08-21T01:27:29.643647+0000","172.21.15.79:0/1023212241":"2024-08-21T01:27:29.643647+0000","172.21.15.79:0/2368377219":"2024-08-21T01:27:29.643647+0000","172.21.15.79:6801/3302536522":"2024-08-21T01:27:52.389553+0000","172.21.15.79:6800/3302536522":"2024-08-21T01:27:52.389553+0000","172.21.15.79:0/3498829332":"2024-08-21T01:27:29.643647+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-20T01:36:49.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.441+0000 7f082b0a8640 1 -- 172.21.15.79:0/3326137687 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f08100b3c50 msgr2=0x7f08100b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:49.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.441+0000 7f082b0a8640 1 --2- 172.21.15.79:0/3326137687 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f08100b3c50 0x7f08100b6110 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f08140057c0 tx=0x7f0814000bc0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.441+0000 7f082b0a8640 1 -- 172.21.15.79:0/3326137687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0824102700 msgr2=0x7f0824199030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:49.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.441+0000 7f082b0a8640 1 --2- 172.21.15.79:0/3326137687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0824102700 0x7f0824199030 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f080c00c920 tx=0x7f080c00cde0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.441+0000 7f082b0a8640 1 -- 172.21.15.79:0/3326137687 shutdown_connections 2024-08-20T01:36:49.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.441+0000 7f082b0a8640 1 --2- 172.21.15.79:0/3326137687 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f08100b3c50 0x7f08100b6110 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.441+0000 7f082b0a8640 1 --2- 172.21.15.79:0/3326137687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08241030c0 0x7f0824199c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.441+0000 7f082b0a8640 1 --2- 172.21.15.79:0/3326137687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0824102700 0x7f0824199030 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.441+0000 7f082b0a8640 1 --2- 172.21.15.79:0/3326137687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08241015b0 0x7f08241989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.441+0000 7f082b0a8640 1 -- 172.21.15.79:0/3326137687 >> 172.21.15.79:0/3326137687 conn(0x7f08240fce50 msgr2=0x7f08240fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:49.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.441+0000 7f082b0a8640 1 -- 172.21.15.79:0/3326137687 shutdown_connections 2024-08-20T01:36:49.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.441+0000 7f082b0a8640 1 -- 172.21.15.79:0/3326137687 wait complete. 2024-08-20T01:36:49.454 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-20T01:30:30.693903+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-20T01:34:50.585939+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-20T01:34:52.980599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-20T01:36:49.454 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-20T01:36:49.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:49 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2778205487' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-08-20T01:36:49.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.555+0000 7f241c20e640 1 -- 172.21.15.79:0/436352064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2414101580 msgr2=0x7f2414101980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:49.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.555+0000 7f241c20e640 1 --2- 172.21.15.79:0/436352064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2414101580 0x7f2414101980 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2408009930 tx=0x7f240802a420 comp rx=0 tx=0).stop 2024-08-20T01:36:49.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.555+0000 7f241c20e640 1 -- 172.21.15.79:0/436352064 shutdown_connections 2024-08-20T01:36:49.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.555+0000 7f241c20e640 1 --2- 172.21.15.79:0/436352064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2414103090 0x7f2414109a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.555+0000 7f241c20e640 1 --2- 172.21.15.79:0/436352064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24141026d0 0x7f2414102b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.555+0000 7f241c20e640 1 --2- 172.21.15.79:0/436352064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2414101580 0x7f2414101980 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.555+0000 7f241c20e640 1 -- 172.21.15.79:0/436352064 >> 172.21.15.79:0/436352064 conn(0x7f24140fce40 msgr2=0x7f24140ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:49.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.555+0000 7f241c20e640 1 -- 172.21.15.79:0/436352064 shutdown_connections 2024-08-20T01:36:49.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.555+0000 7f241c20e640 1 -- 172.21.15.79:0/436352064 wait complete. 2024-08-20T01:36:49.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.556+0000 7f241c20e640 1 Processor -- start 2024-08-20T01:36:49.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.556+0000 7f241c20e640 1 -- start start 2024-08-20T01:36:49.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.556+0000 7f241c20e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2414101580 0x7f2414197900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:49.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.556+0000 7f241c20e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24141026d0 0x7f2414197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:49.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.556+0000 7f241c20e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2414103090 0x7f2414198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:49.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.556+0000 7f241c20e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f241410d0b0 con 0x7f2414101580 2024-08-20T01:36:49.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.556+0000 7f241c20e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f241410cf30 con 0x7f2414103090 2024-08-20T01:36:49.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.556+0000 7f241c20e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f241410d230 con 0x7f24141026d0 2024-08-20T01:36:49.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.556+0000 7f2419faa640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2414101580 0x7f2414197900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:49.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.556+0000 7f2419faa640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2414101580 0x7f2414197900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38562/0 (socket says 172.21.15.79:38562) 2024-08-20T01:36:49.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.556+0000 7f2419faa640 1 -- 172.21.15.79:0/1560478148 learned_addr learned my addr 172.21.15.79:0/1560478148 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:49.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.556+0000 7f241a7ab640 1 --2- 172.21.15.79:0/1560478148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2414103090 0x7f2414198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:49.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.556+0000 7f24197a9640 1 --2- 172.21.15.79:0/1560478148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24141026d0 0x7f2414197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:49.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.556+0000 7f2419faa640 1 -- 172.21.15.79:0/1560478148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24141026d0 msgr2=0x7f2414197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:49.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.556+0000 7f2419faa640 1 --2- 172.21.15.79:0/1560478148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24141026d0 0x7f2414197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.556+0000 7f2419faa640 1 -- 172.21.15.79:0/1560478148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2414103090 msgr2=0x7f2414198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:49.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.556+0000 7f2419faa640 1 --2- 172.21.15.79:0/1560478148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2414103090 0x7f2414198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.556+0000 7f2419faa640 1 -- 172.21.15.79:0/1560478148 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2414199440 con 0x7f2414101580 2024-08-20T01:36:49.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.557+0000 7f2419faa640 1 --2- 172.21.15.79:0/1560478148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2414101580 0x7f2414197900 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2408005ab0 tx=0x7f24080042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:49.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.557+0000 7f2406ffd640 1 -- 172.21.15.79:0/1560478148 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f240803f030 con 0x7f2414101580 2024-08-20T01:36:49.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.557+0000 7f2406ffd640 1 -- 172.21.15.79:0/1560478148 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2408003c90 con 0x7f2414101580 2024-08-20T01:36:49.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.557+0000 7f2406ffd640 1 -- 172.21.15.79:0/1560478148 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2408035070 con 0x7f2414101580 2024-08-20T01:36:49.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.557+0000 7f241c20e640 1 -- 172.21.15.79:0/1560478148 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24141996d0 con 0x7f2414101580 2024-08-20T01:36:49.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.557+0000 7f241c20e640 1 -- 172.21.15.79:0/1560478148 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f241419fe00 con 0x7f2414101580 2024-08-20T01:36:49.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.558+0000 7f241c20e640 1 -- 172.21.15.79:0/1560478148 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2414101980 con 0x7f2414101580 2024-08-20T01:36:49.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.560+0000 7f2406ffd640 1 -- 172.21.15.79:0/1560478148 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2408042030 con 0x7f2414101580 2024-08-20T01:36:49.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.561+0000 7f2406ffd640 1 --2- 172.21.15.79:0/1560478148 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f24000b3bd0 0x7f24000b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:49.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.561+0000 7f24197a9640 1 --2- 172.21.15.79:0/1560478148 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f24000b3bd0 0x7f24000b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:49.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.561+0000 7f2406ffd640 1 -- 172.21.15.79:0/1560478148 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f24081046f0 con 0x7f2414101580 2024-08-20T01:36:49.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.561+0000 7f24197a9640 1 --2- 172.21.15.79:0/1560478148 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f24000b3bd0 0x7f24000b6090 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2410005fd0 tx=0x7f2410005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:49.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.564+0000 7f2406ffd640 1 -- 172.21.15.79:0/1560478148 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f24080cbcf0 con 0x7f2414101580 2024-08-20T01:36:49.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.738+0000 7f241c20e640 1 -- 172.21.15.79:0/1560478148 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2414063a80 con 0x7f2414101580 2024-08-20T01:36:49.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.738+0000 7f2406ffd640 1 -- 172.21.15.79:0/1560478148 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) ==== 93+0+10 (secure 0 0 0) 0x7f24080cb5f0 con 0x7f2414101580 2024-08-20T01:36:49.740 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-08-20T01:36:49.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.740+0000 7f241c20e640 1 -- 172.21.15.79:0/1560478148 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f24000b3bd0 msgr2=0x7f24000b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:49.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.740+0000 7f241c20e640 1 --2- 172.21.15.79:0/1560478148 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f24000b3bd0 0x7f24000b6090 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2410005fd0 tx=0x7f2410005850 comp rx=0 tx=0).stop 2024-08-20T01:36:49.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.740+0000 7f241c20e640 1 -- 172.21.15.79:0/1560478148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2414101580 msgr2=0x7f2414197900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:49.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.740+0000 7f241c20e640 1 --2- 172.21.15.79:0/1560478148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2414101580 0x7f2414197900 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2408005ab0 tx=0x7f24080042f0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.741+0000 7f241c20e640 1 -- 172.21.15.79:0/1560478148 shutdown_connections 2024-08-20T01:36:49.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.741+0000 7f241c20e640 1 --2- 172.21.15.79:0/1560478148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2414103090 0x7f2414198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.741+0000 7f241c20e640 1 --2- 172.21.15.79:0/1560478148 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f24000b3bd0 0x7f24000b6090 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.741+0000 7f241c20e640 1 --2- 172.21.15.79:0/1560478148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24141026d0 0x7f2414197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.741+0000 7f241c20e640 1 --2- 172.21.15.79:0/1560478148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2414101580 0x7f2414197900 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.741+0000 7f241c20e640 1 -- 172.21.15.79:0/1560478148 >> 172.21.15.79:0/1560478148 conn(0x7f24140fce40 msgr2=0x7f2414105b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:49.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.741+0000 7f241c20e640 1 -- 172.21.15.79:0/1560478148 shutdown_connections 2024-08-20T01:36:49.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.741+0000 7f241c20e640 1 -- 172.21.15.79:0/1560478148 wait complete. 2024-08-20T01:36:49.753 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-20T01:36:49.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.854+0000 7fda70ba1640 1 -- 172.21.15.79:0/4250630327 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda6c1015a0 msgr2=0x7fda6c1019a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:49.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.854+0000 7fda70ba1640 1 --2- 172.21.15.79:0/4250630327 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda6c1015a0 0x7fda6c1019a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fda5c009930 tx=0x7fda5c02a420 comp rx=0 tx=0).stop 2024-08-20T01:36:49.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.854+0000 7fda70ba1640 1 -- 172.21.15.79:0/4250630327 shutdown_connections 2024-08-20T01:36:49.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.854+0000 7fda70ba1640 1 --2- 172.21.15.79:0/4250630327 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda6c1030b0 0x7fda6c109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.854+0000 7fda70ba1640 1 --2- 172.21.15.79:0/4250630327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda6c1026f0 0x7fda6c102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.854+0000 7fda70ba1640 1 --2- 172.21.15.79:0/4250630327 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda6c1015a0 0x7fda6c1019a0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.854+0000 7fda70ba1640 1 -- 172.21.15.79:0/4250630327 >> 172.21.15.79:0/4250630327 conn(0x7fda6c0fce40 msgr2=0x7fda6c0ff280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:49.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.854+0000 7fda70ba1640 1 -- 172.21.15.79:0/4250630327 shutdown_connections 2024-08-20T01:36:49.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.854+0000 7fda70ba1640 1 -- 172.21.15.79:0/4250630327 wait complete. 2024-08-20T01:36:49.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.855+0000 7fda70ba1640 1 Processor -- start 2024-08-20T01:36:49.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.855+0000 7fda70ba1640 1 -- start start 2024-08-20T01:36:49.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.855+0000 7fda70ba1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda6c1015a0 0x7fda6c06b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:49.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.855+0000 7fda70ba1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda6c1026f0 0x7fda6c19fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:49.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.855+0000 7fda70ba1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda6c1030b0 0x7fda6c1a2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:49.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.855+0000 7fda70ba1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fda6c10d0d0 con 0x7fda6c1026f0 2024-08-20T01:36:49.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.855+0000 7fda70ba1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fda6c10cf50 con 0x7fda6c1030b0 2024-08-20T01:36:49.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.855+0000 7fda70ba1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fda6c10d250 con 0x7fda6c1015a0 2024-08-20T01:36:49.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.855+0000 7fda63fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda6c1026f0 0x7fda6c19fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:49.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.855+0000 7fda63fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda6c1026f0 0x7fda6c19fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38574/0 (socket says 172.21.15.79:38574) 2024-08-20T01:36:49.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.855+0000 7fda63fff640 1 -- 172.21.15.79:0/2258937395 learned_addr learned my addr 172.21.15.79:0/2258937395 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:49.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.855+0000 7fda6a59c640 1 --2- 172.21.15.79:0/2258937395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda6c1015a0 0x7fda6c06b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:49.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.855+0000 7fda6ad9d640 1 --2- 172.21.15.79:0/2258937395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda6c1030b0 0x7fda6c1a2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:49.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.856+0000 7fda63fff640 1 -- 172.21.15.79:0/2258937395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda6c1015a0 msgr2=0x7fda6c06b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:49.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.856+0000 7fda63fff640 1 --2- 172.21.15.79:0/2258937395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda6c1015a0 0x7fda6c06b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.856+0000 7fda63fff640 1 -- 172.21.15.79:0/2258937395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda6c1030b0 msgr2=0x7fda6c1a2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:49.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.856+0000 7fda63fff640 1 --2- 172.21.15.79:0/2258937395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda6c1030b0 0x7fda6c1a2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:49.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.856+0000 7fda63fff640 1 -- 172.21.15.79:0/2258937395 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda6c1a27f0 con 0x7fda6c1026f0 2024-08-20T01:36:49.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.856+0000 7fda6ad9d640 1 --2- 172.21.15.79:0/2258937395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda6c1030b0 0x7fda6c1a2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:36:49.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.856+0000 7fda63fff640 1 --2- 172.21.15.79:0/2258937395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda6c1026f0 0x7fda6c19fb20 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fda5400d950 tx=0x7fda5400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:49.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.856+0000 7fda637fe640 1 -- 172.21.15.79:0/2258937395 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda54017070 con 0x7fda6c1026f0 2024-08-20T01:36:49.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.856+0000 7fda637fe640 1 -- 172.21.15.79:0/2258937395 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fda54009c30 con 0x7fda6c1026f0 2024-08-20T01:36:49.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.856+0000 7fda70ba1640 1 -- 172.21.15.79:0/2258937395 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda6c1a2ae0 con 0x7fda6c1026f0 2024-08-20T01:36:49.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.856+0000 7fda637fe640 1 -- 172.21.15.79:0/2258937395 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda5400f620 con 0x7fda6c1026f0 2024-08-20T01:36:49.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.856+0000 7fda70ba1640 1 -- 172.21.15.79:0/2258937395 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda6c1a3030 con 0x7fda6c1026f0 2024-08-20T01:36:49.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.857+0000 7fda70ba1640 1 -- 172.21.15.79:0/2258937395 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda6c108990 con 0x7fda6c1026f0 2024-08-20T01:36:49.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.858+0000 7fda637fe640 1 -- 172.21.15.79:0/2258937395 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fda54005030 con 0x7fda6c1026f0 2024-08-20T01:36:49.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.859+0000 7fda637fe640 1 --2- 172.21.15.79:0/2258937395 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fda580b3bd0 0x7fda580b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:49.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.859+0000 7fda6a59c640 1 --2- 172.21.15.79:0/2258937395 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fda580b3bd0 0x7fda580b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:49.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.859+0000 7fda637fe640 1 -- 172.21.15.79:0/2258937395 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fda540e37b0 con 0x7fda6c1026f0 2024-08-20T01:36:49.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.859+0000 7fda6a59c640 1 --2- 172.21.15.79:0/2258937395 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fda580b3bd0 0x7fda580b6090 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fda5c0057c0 tx=0x7fda5c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:49.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:49.862+0000 7fda637fe640 1 -- 172.21.15.79:0/2258937395 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fda540aae10 con 0x7fda6c1026f0 2024-08-20T01:36:50.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.037+0000 7fda70ba1640 1 -- 172.21.15.79:0/2258937395 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fda6c02e590 con 0x7fda6c1026f0 2024-08-20T01:36:50.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.037+0000 7fda637fe640 1 -- 172.21.15.79:0/2258937395 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v74) ==== 104+0+11 (secure 0 0 0) 0x7fda54009de0 con 0x7fda6c1026f0 2024-08-20T01:36:50.039 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2024-08-20T01:36:50.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.039+0000 7fda70ba1640 1 -- 172.21.15.79:0/2258937395 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fda580b3bd0 msgr2=0x7fda580b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:50.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.039+0000 7fda70ba1640 1 --2- 172.21.15.79:0/2258937395 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fda580b3bd0 0x7fda580b6090 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fda5c0057c0 tx=0x7fda5c031400 comp rx=0 tx=0).stop 2024-08-20T01:36:50.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.039+0000 7fda70ba1640 1 -- 172.21.15.79:0/2258937395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda6c1026f0 msgr2=0x7fda6c19fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:50.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.039+0000 7fda70ba1640 1 --2- 172.21.15.79:0/2258937395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda6c1026f0 0x7fda6c19fb20 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fda5400d950 tx=0x7fda5400de10 comp rx=0 tx=0).stop 2024-08-20T01:36:50.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.039+0000 7fda70ba1640 1 -- 172.21.15.79:0/2258937395 shutdown_connections 2024-08-20T01:36:50.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.039+0000 7fda70ba1640 1 --2- 172.21.15.79:0/2258937395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda6c1030b0 0x7fda6c1a2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:50.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.039+0000 7fda70ba1640 1 --2- 172.21.15.79:0/2258937395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda6c1026f0 0x7fda6c19fb20 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:50.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.039+0000 7fda70ba1640 1 --2- 172.21.15.79:0/2258937395 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fda580b3bd0 0x7fda580b6090 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:50.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.039+0000 7fda70ba1640 1 --2- 172.21.15.79:0/2258937395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda6c1015a0 0x7fda6c06b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:50.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.039+0000 7fda70ba1640 1 -- 172.21.15.79:0/2258937395 >> 172.21.15.79:0/2258937395 conn(0x7fda6c0fce40 msgr2=0x7fda6c105b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:50.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.039+0000 7fda70ba1640 1 -- 172.21.15.79:0/2258937395 shutdown_connections 2024-08-20T01:36:50.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.039+0000 7fda70ba1640 1 -- 172.21.15.79:0/2258937395 wait complete. 2024-08-20T01:36:50.052 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-20T01:36:50.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.153+0000 7fd818e67640 1 -- 172.21.15.79:0/1646090694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd814102680 msgr2=0x7fd814102a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:50.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.153+0000 7fd818e67640 1 --2- 172.21.15.79:0/1646090694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd814102680 0x7fd814102a80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fd804009cd0 tx=0x7fd80402a8e0 comp rx=0 tx=0).stop 2024-08-20T01:36:50.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.153+0000 7fd818e67640 1 -- 172.21.15.79:0/1646090694 shutdown_connections 2024-08-20T01:36:50.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.153+0000 7fd818e67640 1 --2- 172.21.15.79:0/1646090694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd814104190 0x7fd81410ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:50.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.153+0000 7fd818e67640 1 --2- 172.21.15.79:0/1646090694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8141037d0 0x7fd814103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:50.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.153+0000 7fd818e67640 1 --2- 172.21.15.79:0/1646090694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd814102680 0x7fd814102a80 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:50.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.153+0000 7fd818e67640 1 -- 172.21.15.79:0/1646090694 >> 172.21.15.79:0/1646090694 conn(0x7fd8140fdf40 msgr2=0x7fd814100360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:50.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.153+0000 7fd818e67640 1 -- 172.21.15.79:0/1646090694 shutdown_connections 2024-08-20T01:36:50.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.153+0000 7fd818e67640 1 -- 172.21.15.79:0/1646090694 wait complete. 2024-08-20T01:36:50.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.154+0000 7fd818e67640 1 Processor -- start 2024-08-20T01:36:50.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.154+0000 7fd818e67640 1 -- start start 2024-08-20T01:36:50.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.154+0000 7fd818e67640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd814102680 0x7fd8140769a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:50.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.154+0000 7fd818e67640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8141037d0 0x7fd814075270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:50.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.154+0000 7fd818e67640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd814104190 0x7fd8140757b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:50.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.154+0000 7fd818e67640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd81410e220 con 0x7fd814104190 2024-08-20T01:36:50.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.154+0000 7fd818e67640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd81410e0a0 con 0x7fd8141037d0 2024-08-20T01:36:50.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.154+0000 7fd818e67640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd81410e3a0 con 0x7fd814102680 2024-08-20T01:36:50.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.154+0000 7fd812d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd814104190 0x7fd8140757b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:50.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.154+0000 7fd812d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd814104190 0x7fd8140757b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38604/0 (socket says 172.21.15.79:38604) 2024-08-20T01:36:50.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.154+0000 7fd812d9d640 1 -- 172.21.15.79:0/1864093154 learned_addr learned my addr 172.21.15.79:0/1864093154 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:50.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.155+0000 7fd811d9b640 1 --2- 172.21.15.79:0/1864093154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8141037d0 0x7fd814075270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:50.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.155+0000 7fd81259c640 1 --2- 172.21.15.79:0/1864093154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd814102680 0x7fd8140769a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:50.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.155+0000 7fd812d9d640 1 -- 172.21.15.79:0/1864093154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd814102680 msgr2=0x7fd8140769a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:50.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.155+0000 7fd812d9d640 1 --2- 172.21.15.79:0/1864093154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd814102680 0x7fd8140769a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:50.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.155+0000 7fd812d9d640 1 -- 172.21.15.79:0/1864093154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8141037d0 msgr2=0x7fd814075270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:50.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.155+0000 7fd812d9d640 1 --2- 172.21.15.79:0/1864093154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8141037d0 0x7fd814075270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:50.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.155+0000 7fd812d9d640 1 -- 172.21.15.79:0/1864093154 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd814075fb0 con 0x7fd814104190 2024-08-20T01:36:50.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.155+0000 7fd811d9b640 1 --2- 172.21.15.79:0/1864093154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8141037d0 0x7fd814075270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:36:50.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.155+0000 7fd812d9d640 1 --2- 172.21.15.79:0/1864093154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd814104190 0x7fd8140757b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd80c009fd0 tx=0x7fd80c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:50.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.155+0000 7fd80b7fe640 1 -- 172.21.15.79:0/1864093154 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80c011830 con 0x7fd814104190 2024-08-20T01:36:50.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.155+0000 7fd80b7fe640 1 -- 172.21.15.79:0/1864093154 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd80c016070 con 0x7fd814104190 2024-08-20T01:36:50.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.155+0000 7fd818e67640 1 -- 172.21.15.79:0/1864093154 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8141a2b10 con 0x7fd814104190 2024-08-20T01:36:50.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.155+0000 7fd80b7fe640 1 -- 172.21.15.79:0/1864093154 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80c010d20 con 0x7fd814104190 2024-08-20T01:36:50.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.155+0000 7fd818e67640 1 -- 172.21.15.79:0/1864093154 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8141a3060 con 0x7fd814104190 2024-08-20T01:36:50.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.156+0000 7fd818e67640 1 -- 172.21.15.79:0/1864093154 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd814109a70 con 0x7fd814104190 2024-08-20T01:36:50.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.157+0000 7fd80b7fe640 1 -- 172.21.15.79:0/1864093154 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fd80c0119d0 con 0x7fd814104190 2024-08-20T01:36:50.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.158+0000 7fd80b7fe640 1 --2- 172.21.15.79:0/1864093154 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd8000b3bd0 0x7fd8000b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:50.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.158+0000 7fd81259c640 1 --2- 172.21.15.79:0/1864093154 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd8000b3bd0 0x7fd8000b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:50.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.158+0000 7fd80b7fe640 1 -- 172.21.15.79:0/1864093154 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fd80c0e3990 con 0x7fd814104190 2024-08-20T01:36:50.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.158+0000 7fd81259c640 1 --2- 172.21.15.79:0/1864093154 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd8000b3bd0 0x7fd8000b6090 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd8040317f0 tx=0x7fd804005f80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:50.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.161+0000 7fd80b7fe640 1 -- 172.21.15.79:0/1864093154 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fd80c0aaff0 con 0x7fd814104190 2024-08-20T01:36:50.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.340+0000 7fd818e67640 1 -- 172.21.15.79:0/1864093154 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd81402e590 con 0x7fd814104190 2024-08-20T01:36:50.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.340+0000 7fd80b7fe640 1 -- 172.21.15.79:0/1864093154 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v74) ==== 100+0+11 (secure 0 0 0) 0x7fd80c0aa8f0 con 0x7fd814104190 2024-08-20T01:36:50.342 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2024-08-20T01:36:50.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.342+0000 7fd818e67640 1 -- 172.21.15.79:0/1864093154 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd8000b3bd0 msgr2=0x7fd8000b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:50.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.342+0000 7fd818e67640 1 --2- 172.21.15.79:0/1864093154 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd8000b3bd0 0x7fd8000b6090 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd8040317f0 tx=0x7fd804005f80 comp rx=0 tx=0).stop 2024-08-20T01:36:50.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.342+0000 7fd818e67640 1 -- 172.21.15.79:0/1864093154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd814104190 msgr2=0x7fd8140757b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:50.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.342+0000 7fd818e67640 1 --2- 172.21.15.79:0/1864093154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd814104190 0x7fd8140757b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd80c009fd0 tx=0x7fd80c00b8e0 comp rx=0 tx=0).stop 2024-08-20T01:36:50.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.342+0000 7fd818e67640 1 -- 172.21.15.79:0/1864093154 shutdown_connections 2024-08-20T01:36:50.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.342+0000 7fd818e67640 1 --2- 172.21.15.79:0/1864093154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd814104190 0x7fd8140757b0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:50.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.342+0000 7fd818e67640 1 --2- 172.21.15.79:0/1864093154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8141037d0 0x7fd814075270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:50.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.342+0000 7fd818e67640 1 --2- 172.21.15.79:0/1864093154 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd8000b3bd0 0x7fd8000b6090 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:50.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.342+0000 7fd818e67640 1 --2- 172.21.15.79:0/1864093154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd814102680 0x7fd8140769a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:50.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.342+0000 7fd818e67640 1 -- 172.21.15.79:0/1864093154 >> 172.21.15.79:0/1864093154 conn(0x7fd8140fdf40 msgr2=0x7fd814106c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:50.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.342+0000 7fd818e67640 1 -- 172.21.15.79:0/1864093154 shutdown_connections 2024-08-20T01:36:50.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:50.342+0000 7fd818e67640 1 -- 172.21.15.79:0/1864093154 wait complete. 2024-08-20T01:36:50.354 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:50 smithi079 ceph-mon[18656]: pgmap v332: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 682 B/s wr, 12 op/s 2024-08-20T01:36:50.355 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:50 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2778205487' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-08-20T01:36:50.355 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:50 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:36:50.355 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:50 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/3326137687' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:36:50.355 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:50 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/1560478148' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-20T01:36:50.355 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:50 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2258937395' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-20T01:36:50.356 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-08-20T01:36:50.356 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:36:50.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:50 smithi175 ceph-mon[22392]: pgmap v332: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 682 B/s wr, 12 op/s 2024-08-20T01:36:50.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:50 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2778205487' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-08-20T01:36:50.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:50 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:36:50.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:50 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/3326137687' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:36:50.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:50 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/1560478148' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-20T01:36:50.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:50 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2258937395' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-20T01:36:50.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:50 smithi081 ceph-mon[22209]: pgmap v332: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 682 B/s wr, 12 op/s 2024-08-20T01:36:50.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:50 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2778205487' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-08-20T01:36:50.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:50 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:36:50.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:50 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/3326137687' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:36:50.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:50 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/1560478148' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-20T01:36:50.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:50 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2258937395' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-20T01:36:50.601 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:36:51.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.061+0000 7f2a5d4c9640 1 -- 172.21.15.79:0/1404876440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a58102ab0 msgr2=0x7f2a58102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:51.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.061+0000 7f2a5d4c9640 1 --2- 172.21.15.79:0/1404876440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a58102ab0 0x7f2a58102e90 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f2a48009900 tx=0x7f2a4802a410 comp rx=0 tx=0).stop 2024-08-20T01:36:51.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.061+0000 7f2a5d4c9640 1 -- 172.21.15.79:0/1404876440 shutdown_connections 2024-08-20T01:36:51.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.061+0000 7f2a5d4c9640 1 --2- 172.21.15.79:0/1404876440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a58108e40 0x7f2a5810f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:51.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.061+0000 7f2a5d4c9640 1 --2- 172.21.15.79:0/1404876440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a581084c0 0x7f2a58108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:51.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.061+0000 7f2a5d4c9640 1 --2- 172.21.15.79:0/1404876440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a58102ab0 0x7f2a58102e90 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:51.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.061+0000 7f2a5d4c9640 1 -- 172.21.15.79:0/1404876440 >> 172.21.15.79:0/1404876440 conn(0x7f2a580fe500 msgr2=0x7f2a58100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:51.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.061+0000 7f2a5d4c9640 1 -- 172.21.15.79:0/1404876440 shutdown_connections 2024-08-20T01:36:51.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.061+0000 7f2a5d4c9640 1 -- 172.21.15.79:0/1404876440 wait complete. 2024-08-20T01:36:51.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.061+0000 7f2a5d4c9640 1 Processor -- start 2024-08-20T01:36:51.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.062+0000 7f2a5d4c9640 1 -- start start 2024-08-20T01:36:51.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.062+0000 7f2a5d4c9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a58102ab0 0x7f2a58198f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:51.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.062+0000 7f2a5d4c9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a581084c0 0x7f2a581994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:51.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.062+0000 7f2a5d4c9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a58108e40 0x7f2a5819e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:51.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.062+0000 7f2a5d4c9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2a581129b0 con 0x7f2a58102ab0 2024-08-20T01:36:51.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.062+0000 7f2a5d4c9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2a58112830 con 0x7f2a58108e40 2024-08-20T01:36:51.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.062+0000 7f2a5d4c9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2a58112b30 con 0x7f2a581084c0 2024-08-20T01:36:51.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.062+0000 7f2a56ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a58102ab0 0x7f2a58198f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:51.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.062+0000 7f2a56ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a58102ab0 0x7f2a58198f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46428/0 (socket says 172.21.15.79:46428) 2024-08-20T01:36:51.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.062+0000 7f2a56ffd640 1 -- 172.21.15.79:0/2866473951 learned_addr learned my addr 172.21.15.79:0/2866473951 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:51.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.062+0000 7f2a56ffd640 1 -- 172.21.15.79:0/2866473951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a581084c0 msgr2=0x7f2a581994a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-20T01:36:51.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.062+0000 7f2a56ffd640 1 --2- 172.21.15.79:0/2866473951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a581084c0 0x7f2a581994a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:51.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.062+0000 7f2a56ffd640 1 -- 172.21.15.79:0/2866473951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a58108e40 msgr2=0x7f2a5819e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:51.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.062+0000 7f2a56ffd640 1 --2- 172.21.15.79:0/2866473951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a58108e40 0x7f2a5819e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:51.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.062+0000 7f2a56ffd640 1 -- 172.21.15.79:0/2866473951 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a5819f010 con 0x7f2a58102ab0 2024-08-20T01:36:51.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.062+0000 7f2a56ffd640 1 --2- 172.21.15.79:0/2866473951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a58102ab0 0x7f2a58198f60 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2a48009230 tx=0x7f2a48004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:51.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.063+0000 7f2a3ffff640 1 -- 172.21.15.79:0/2866473951 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4803f030 con 0x7f2a58102ab0 2024-08-20T01:36:51.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.063+0000 7f2a5d4c9640 1 -- 172.21.15.79:0/2866473951 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a5819f2a0 con 0x7f2a58102ab0 2024-08-20T01:36:51.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.063+0000 7f2a3ffff640 1 -- 172.21.15.79:0/2866473951 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2a48003a80 con 0x7f2a58102ab0 2024-08-20T01:36:51.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.063+0000 7f2a3ffff640 1 -- 172.21.15.79:0/2866473951 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a48035070 con 0x7f2a58102ab0 2024-08-20T01:36:51.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.063+0000 7f2a5d4c9640 1 -- 172.21.15.79:0/2866473951 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a581a59c0 con 0x7f2a58102ab0 2024-08-20T01:36:51.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.064+0000 7f2a5d4c9640 1 -- 172.21.15.79:0/2866473951 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a58102e90 con 0x7f2a58102ab0 2024-08-20T01:36:51.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.065+0000 7f2a3ffff640 1 -- 172.21.15.79:0/2866473951 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2a48042030 con 0x7f2a58102ab0 2024-08-20T01:36:51.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.066+0000 7f2a3ffff640 1 --2- 172.21.15.79:0/2866473951 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2a400b3bd0 0x7f2a400b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:51.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.066+0000 7f2a567fc640 1 --2- 172.21.15.79:0/2866473951 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2a400b3bd0 0x7f2a400b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:51.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.066+0000 7f2a3ffff640 1 -- 172.21.15.79:0/2866473951 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f2a48104420 con 0x7f2a58102ab0 2024-08-20T01:36:51.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.066+0000 7f2a567fc640 1 --2- 172.21.15.79:0/2866473951 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2a400b3bd0 0x7f2a400b6090 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2a58108020 tx=0x7f2a4c006c20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:51.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.070+0000 7f2a3ffff640 1 -- 172.21.15.79:0/2866473951 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f2a480cba80 con 0x7f2a58102ab0 2024-08-20T01:36:51.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.282+0000 7f2a5d4c9640 1 -- 172.21.15.79:0/2866473951 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a5802e340 con 0x7f2a58102ab0 2024-08-20T01:36:51.284 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:51 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/1864093154' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-20T01:36:51.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.282+0000 7f2a3ffff640 1 -- 172.21.15.79:0/2866473951 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7f2a480cb380 con 0x7f2a58102ab0 2024-08-20T01:36:51.285 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:36:51.285 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":28,"btime":"2024-08-20T01:36:49:088329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14670,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/735082912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":735082912},{"type":"v1","addr":"172.21.15.79:6835","nonce":735082912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2150339873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2150339873},{"type":"v1","addr":"172.21.15.79:6837","nonce":2150339873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:34:55.133562+0000","modified":"2024-08-20T01:36:48.384274+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24539,"mds_1":24538,"mds_2":24523,"mds_3":24514,"mds_4":24512},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14724":{"gid":14724,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/1071242274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1071242274},{"type":"v1","addr":"172.21.15.79:6839","nonce":1071242274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14730":{"gid":14730,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6841/2448977611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":2448977611},{"type":"v1","addr":"172.21.15.79:6841","nonce":2448977611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/1257507005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1257507005},{"type":"v1","addr":"172.21.15.81:6833","nonce":1257507005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1499936216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1499936216},{"type":"v1","addr":"172.21.15.81:6835","nonce":1499936216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/1107229215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1107229215},{"type":"v1","addr":"172.21.15.175:6833","nonce":1107229215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6837/2073598870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2073598870},{"type":"v1","addr":"172.21.15.81:6837","nonce":2073598870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/2552601173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2552601173},{"type":"v1","addr":"172.21.15.175:6835","nonce":2552601173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6837/1767284089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1767284089},{"type":"v1","addr":"172.21.15.175:6837","nonce":1767284089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/1331748742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1331748742},{"type":"v1","addr":"172.21.15.175:6839","nonce":1331748742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/4098410583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":4098410583},{"type":"v1","addr":"172.21.15.81:6839","nonce":4098410583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24539,"qdb_cluster":[24512,24538,24514,24523,24539]},"id":1}]} 2024-08-20T01:36:51.285 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 28 2024-08-20T01:36:51.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.284+0000 7f2a5d4c9640 1 -- 172.21.15.79:0/2866473951 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2a400b3bd0 msgr2=0x7f2a400b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:51.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.284+0000 7f2a5d4c9640 1 --2- 172.21.15.79:0/2866473951 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2a400b3bd0 0x7f2a400b6090 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2a58108020 tx=0x7f2a4c006c20 comp rx=0 tx=0).stop 2024-08-20T01:36:51.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.284+0000 7f2a5d4c9640 1 -- 172.21.15.79:0/2866473951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a58102ab0 msgr2=0x7f2a58198f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:51.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.284+0000 7f2a5d4c9640 1 --2- 172.21.15.79:0/2866473951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a58102ab0 0x7f2a58198f60 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2a48009230 tx=0x7f2a48004270 comp rx=0 tx=0).stop 2024-08-20T01:36:51.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.284+0000 7f2a5d4c9640 1 -- 172.21.15.79:0/2866473951 shutdown_connections 2024-08-20T01:36:51.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.284+0000 7f2a5d4c9640 1 --2- 172.21.15.79:0/2866473951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a58108e40 0x7f2a5819e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:51.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.284+0000 7f2a5d4c9640 1 --2- 172.21.15.79:0/2866473951 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2a400b3bd0 0x7f2a400b6090 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:51.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.284+0000 7f2a5d4c9640 1 --2- 172.21.15.79:0/2866473951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a581084c0 0x7f2a581994a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:51.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.284+0000 7f2a5d4c9640 1 --2- 172.21.15.79:0/2866473951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a58102ab0 0x7f2a58198f60 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:51.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.284+0000 7f2a5d4c9640 1 -- 172.21.15.79:0/2866473951 >> 172.21.15.79:0/2866473951 conn(0x7f2a580fe500 msgr2=0x7f2a581008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:51.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.285+0000 7f2a5d4c9640 1 -- 172.21.15.79:0/2866473951 shutdown_connections 2024-08-20T01:36:51.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:51.285+0000 7f2a5d4c9640 1 -- 172.21.15.79:0/2866473951 wait complete. 2024-08-20T01:36:51.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:51 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/1864093154' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-20T01:36:51.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:51 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/1864093154' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-20T01:36:52.049 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-08-20T01:36:52.050 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-08-20T01:36:52.050 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-20T01:36:52.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.151+0000 7f3b91e6e640 1 -- 172.21.15.79:0/3299623154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b8c100d20 msgr2=0x7f3b8c101120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:52.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.151+0000 7f3b91e6e640 1 --2- 172.21.15.79:0/3299623154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b8c100d20 0x7f3b8c101120 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c00ade0 tx=0x7f3b7c02b7e0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.151+0000 7f3b91e6e640 1 -- 172.21.15.79:0/3299623154 shutdown_connections 2024-08-20T01:36:52.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.151+0000 7f3b91e6e640 1 --2- 172.21.15.79:0/3299623154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b8c102830 0x7f3b8c1091b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.151+0000 7f3b91e6e640 1 --2- 172.21.15.79:0/3299623154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b8c101e70 0x7f3b8c1022f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.151+0000 7f3b91e6e640 1 --2- 172.21.15.79:0/3299623154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b8c100d20 0x7f3b8c101120 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.151+0000 7f3b91e6e640 1 -- 172.21.15.79:0/3299623154 >> 172.21.15.79:0/3299623154 conn(0x7f3b8c0fc5c0 msgr2=0x7f3b8c0fea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:52.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.151+0000 7f3b91e6e640 1 -- 172.21.15.79:0/3299623154 shutdown_connections 2024-08-20T01:36:52.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.151+0000 7f3b91e6e640 1 -- 172.21.15.79:0/3299623154 wait complete. 2024-08-20T01:36:52.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.152+0000 7f3b91e6e640 1 Processor -- start 2024-08-20T01:36:52.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.152+0000 7f3b91e6e640 1 -- start start 2024-08-20T01:36:52.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.152+0000 7f3b91e6e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b8c100d20 0x7f3b8c104cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:52.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.152+0000 7f3b91e6e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b8c101e70 0x7f3b8c103530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:52.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.152+0000 7f3b91e6e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b8c102830 0x7f3b8c103a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:52.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.152+0000 7f3b91e6e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c10c090 con 0x7f3b8c101e70 2024-08-20T01:36:52.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.152+0000 7f3b91e6e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c10bf10 con 0x7f3b8c102830 2024-08-20T01:36:52.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.152+0000 7f3b91e6e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c10c210 con 0x7f3b8c100d20 2024-08-20T01:36:52.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.152+0000 7f3b8affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b8c101e70 0x7f3b8c103530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:52.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.152+0000 7f3b8affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b8c101e70 0x7f3b8c103530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46442/0 (socket says 172.21.15.79:46442) 2024-08-20T01:36:52.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.152+0000 7f3b8affd640 1 -- 172.21.15.79:0/2959104593 learned_addr learned my addr 172.21.15.79:0/2959104593 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:52.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.153+0000 7f3b8bfff640 1 --2- 172.21.15.79:0/2959104593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b8c102830 0x7f3b8c103a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:52.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.153+0000 7f3b8b7fe640 1 --2- 172.21.15.79:0/2959104593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b8c100d20 0x7f3b8c104cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:52.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.153+0000 7f3b8affd640 1 -- 172.21.15.79:0/2959104593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b8c100d20 msgr2=0x7f3b8c104cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:52.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.153+0000 7f3b8affd640 1 --2- 172.21.15.79:0/2959104593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b8c100d20 0x7f3b8c104cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.153+0000 7f3b8affd640 1 -- 172.21.15.79:0/2959104593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b8c102830 msgr2=0x7f3b8c103a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:52.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.153+0000 7f3b8affd640 1 --2- 172.21.15.79:0/2959104593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b8c102830 0x7f3b8c103a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.153+0000 7f3b8affd640 1 -- 172.21.15.79:0/2959104593 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b8c1042e0 con 0x7f3b8c101e70 2024-08-20T01:36:52.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.153+0000 7f3b8affd640 1 --2- 172.21.15.79:0/2959104593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b8c101e70 0x7f3b8c103530 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f3b8000b4a0 tx=0x7f3b8000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:52.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.153+0000 7f3b88ff9640 1 -- 172.21.15.79:0/2959104593 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b80014070 con 0x7f3b8c101e70 2024-08-20T01:36:52.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.153+0000 7f3b88ff9640 1 -- 172.21.15.79:0/2959104593 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b80010aa0 con 0x7f3b8c101e70 2024-08-20T01:36:52.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.153+0000 7f3b91e6e640 1 -- 172.21.15.79:0/2959104593 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b8c1a2c70 con 0x7f3b8c101e70 2024-08-20T01:36:52.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.153+0000 7f3b88ff9640 1 -- 172.21.15.79:0/2959104593 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b80017b70 con 0x7f3b8c101e70 2024-08-20T01:36:52.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.153+0000 7f3b91e6e640 1 -- 172.21.15.79:0/2959104593 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b8c1a3190 con 0x7f3b8c101e70 2024-08-20T01:36:52.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.154+0000 7f3b91e6e640 1 -- 172.21.15.79:0/2959104593 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b8c1a3420 con 0x7f3b8c101e70 2024-08-20T01:36:52.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.155+0000 7f3b88ff9640 1 -- 172.21.15.79:0/2959104593 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3b80017070 con 0x7f3b8c101e70 2024-08-20T01:36:52.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.156+0000 7f3b88ff9640 1 --2- 172.21.15.79:0/2959104593 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3b740b3bd0 0x7f3b740b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:52.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.156+0000 7f3b8b7fe640 1 --2- 172.21.15.79:0/2959104593 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3b740b3bd0 0x7f3b740b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:52.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.156+0000 7f3b88ff9640 1 -- 172.21.15.79:0/2959104593 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f3b800e32b0 con 0x7f3b8c101e70 2024-08-20T01:36:52.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.157+0000 7f3b8b7fe640 1 --2- 172.21.15.79:0/2959104593 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3b740b3bd0 0x7f3b740b6090 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c032ab0 tx=0x7f3b7c00a500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:52.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.160+0000 7f3b88ff9640 1 -- 172.21.15.79:0/2959104593 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f3b800aa910 con 0x7f3b8c101e70 2024-08-20T01:36:52.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.333+0000 7f3b91e6e640 1 -- 172.21.15.79:0/2959104593 --> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3b8c108cb0 con 0x7f3b740b3bd0 2024-08-20T01:36:52.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.337+0000 7f3b88ff9640 1 -- 172.21.15.79:0/2959104593 <== mgr.14150 v2:172.21.15.79:6800/3038112779 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258868 (secure 0 0 0) 0x7f3b8c108cb0 con 0x7f3b740b3bd0 2024-08-20T01:36:52.343 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:36:52.344 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-08-20T01:36:52.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.340+0000 7f3b91e6e640 1 -- 172.21.15.79:0/2959104593 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3b740b3bd0 msgr2=0x7f3b740b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:52.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.340+0000 7f3b91e6e640 1 --2- 172.21.15.79:0/2959104593 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3b740b3bd0 0x7f3b740b6090 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c032ab0 tx=0x7f3b7c00a500 comp rx=0 tx=0).stop 2024-08-20T01:36:52.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.340+0000 7f3b91e6e640 1 -- 172.21.15.79:0/2959104593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b8c101e70 msgr2=0x7f3b8c103530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:52.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.340+0000 7f3b91e6e640 1 --2- 172.21.15.79:0/2959104593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b8c101e70 0x7f3b8c103530 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f3b8000b4a0 tx=0x7f3b8000b960 comp rx=0 tx=0).stop 2024-08-20T01:36:52.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.340+0000 7f3b91e6e640 1 -- 172.21.15.79:0/2959104593 shutdown_connections 2024-08-20T01:36:52.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.340+0000 7f3b91e6e640 1 --2- 172.21.15.79:0/2959104593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b8c102830 0x7f3b8c103a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.340+0000 7f3b91e6e640 1 --2- 172.21.15.79:0/2959104593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b8c101e70 0x7f3b8c103530 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.340+0000 7f3b91e6e640 1 --2- 172.21.15.79:0/2959104593 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3b740b3bd0 0x7f3b740b6090 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.340+0000 7f3b91e6e640 1 --2- 172.21.15.79:0/2959104593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b8c100d20 0x7f3b8c104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.340+0000 7f3b91e6e640 1 -- 172.21.15.79:0/2959104593 >> 172.21.15.79:0/2959104593 conn(0x7f3b8c0fc5c0 msgr2=0x7f3b8c107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:52.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.341+0000 7f3b91e6e640 1 -- 172.21.15.79:0/2959104593 shutdown_connections 2024-08-20T01:36:52.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.341+0000 7f3b91e6e640 1 -- 172.21.15.79:0/2959104593 wait complete. 2024-08-20T01:36:52.355 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:52 smithi079 ceph-mon[18656]: pgmap v333: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1023 B/s wr, 10 op/s 2024-08-20T01:36:52.355 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:52 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2866473951' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:36:52.356 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":333,"stamp":"2024-08-20T01:36:50.496562+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659007,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1140,"num_read_kb":669,"num_write":385,"num_write_kb":2299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2951952,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":816,"ondisk_log_size":816,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365132,"kb_used_data":11724,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576692,"statfs":{"total":1151940427776,"available":1151566532608,"internally_reserved":0,"allocated":12005376,"data_stored":6690200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":361674043},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1972,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":54,"num_write":15,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002901"},"pg_stats":[{"pgid":"3.3f","version":"74'8","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.723367+0000","last_change":"2024-08-20T01:34:54.368243+0000","last_active":"2024-08-20T01:36:22.723367+0000","last_peered":"2024-08-20T01:36:22.723367+0000","last_clean":"2024-08-20T01:36:22.723367+0000","last_became_active":"2024-08-20T01:34:54.367712+0000","last_became_peered":"2024-08-20T01:34:54.367712+0000","last_unstale":"2024-08-20T01:36:22.723367+0000","last_undegraded":"2024-08-20T01:36:22.723367+0000","last_fullsized":"2024-08-20T01:36:22.723367+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:48:31.179090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"74'4","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.709603+0000","last_change":"2024-08-20T01:34:54.371126+0000","last_active":"2024-08-20T01:36:22.709603+0000","last_peered":"2024-08-20T01:36:22.709603+0000","last_clean":"2024-08-20T01:36:22.709603+0000","last_became_active":"2024-08-20T01:34:54.370821+0000","last_became_peered":"2024-08-20T01:34:54.370821+0000","last_unstale":"2024-08-20T01:36:22.709603+0000","last_undegraded":"2024-08-20T01:36:22.709603+0000","last_fullsized":"2024-08-20T01:36:22.709603+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:37:41.175264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"74'7","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.719479+0000","last_change":"2024-08-20T01:34:54.373051+0000","last_active":"2024-08-20T01:36:22.719479+0000","last_peered":"2024-08-20T01:36:22.719479+0000","last_clean":"2024-08-20T01:36:22.719479+0000","last_became_active":"2024-08-20T01:34:54.372783+0000","last_became_peered":"2024-08-20T01:34:54.372783+0000","last_unstale":"2024-08-20T01:36:22.719479+0000","last_undegraded":"2024-08-20T01:36:22.719479+0000","last_fullsized":"2024-08-20T01:36:22.719479+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:12:49.630968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"74'8","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.706204+0000","last_change":"2024-08-20T01:34:54.372395+0000","last_active":"2024-08-20T01:36:22.706204+0000","last_peered":"2024-08-20T01:36:22.706204+0000","last_clean":"2024-08-20T01:36:22.706204+0000","last_became_active":"2024-08-20T01:34:54.371804+0000","last_became_peered":"2024-08-20T01:34:54.371804+0000","last_unstale":"2024-08-20T01:36:22.706204+0000","last_undegraded":"2024-08-20T01:36:22.706204+0000","last_fullsized":"2024-08-20T01:36:22.706204+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:01:14.395727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"74'4","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.707351+0000","last_change":"2024-08-20T01:34:54.379200+0000","last_active":"2024-08-20T01:36:22.707351+0000","last_peered":"2024-08-20T01:36:22.707351+0000","last_clean":"2024-08-20T01:36:22.707351+0000","last_became_active":"2024-08-20T01:34:54.378828+0000","last_became_peered":"2024-08-20T01:34:54.378828+0000","last_unstale":"2024-08-20T01:36:22.707351+0000","last_undegraded":"2024-08-20T01:36:22.707351+0000","last_fullsized":"2024-08-20T01:36:22.707351+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:27:09.672074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"74'6","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.713927+0000","last_change":"2024-08-20T01:34:54.377871+0000","last_active":"2024-08-20T01:36:22.713927+0000","last_peered":"2024-08-20T01:36:22.713927+0000","last_clean":"2024-08-20T01:36:22.713927+0000","last_became_active":"2024-08-20T01:34:54.376617+0000","last_became_peered":"2024-08-20T01:34:54.376617+0000","last_unstale":"2024-08-20T01:36:22.713927+0000","last_undegraded":"2024-08-20T01:36:22.713927+0000","last_fullsized":"2024-08-20T01:36:22.713927+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:17:09.740135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"74'5","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.715604+0000","last_change":"2024-08-20T01:34:54.373761+0000","last_active":"2024-08-20T01:36:22.715604+0000","last_peered":"2024-08-20T01:36:22.715604+0000","last_clean":"2024-08-20T01:36:22.715604+0000","last_became_active":"2024-08-20T01:34:54.372944+0000","last_became_peered":"2024-08-20T01:34:54.372944+0000","last_unstale":"2024-08-20T01:36:22.715604+0000","last_undegraded":"2024-08-20T01:36:22.715604+0000","last_fullsized":"2024-08-20T01:36:22.715604+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:21:44.477970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"74'9","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.710177+0000","last_change":"2024-08-20T01:35:53.799340+0000","last_active":"2024-08-20T01:36:22.710177+0000","last_peered":"2024-08-20T01:36:22.710177+0000","last_clean":"2024-08-20T01:36:22.710177+0000","last_became_active":"2024-08-20T01:35:53.799002+0000","last_became_peered":"2024-08-20T01:35:53.799002+0000","last_unstale":"2024-08-20T01:36:22.710177+0000","last_undegraded":"2024-08-20T01:36:22.710177+0000","last_fullsized":"2024-08-20T01:36:22.710177+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:42:42.446756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"74'11","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.721041+0000","last_change":"2024-08-20T01:34:54.378350+0000","last_active":"2024-08-20T01:36:22.721041+0000","last_peered":"2024-08-20T01:36:22.721041+0000","last_clean":"2024-08-20T01:36:22.721041+0000","last_became_active":"2024-08-20T01:34:54.376524+0000","last_became_peered":"2024-08-20T01:34:54.376524+0000","last_unstale":"2024-08-20T01:36:22.721041+0000","last_undegraded":"2024-08-20T01:36:22.721041+0000","last_fullsized":"2024-08-20T01:36:22.721041+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:50:03.179130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"74'16","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.716257+0000","last_change":"2024-08-20T01:34:54.376098+0000","last_active":"2024-08-20T01:36:22.716257+0000","last_peered":"2024-08-20T01:36:22.716257+0000","last_clean":"2024-08-20T01:36:22.716257+0000","last_became_active":"2024-08-20T01:34:54.375671+0000","last_became_peered":"2024-08-20T01:34:54.375671+0000","last_unstale":"2024-08-20T01:36:22.716257+0000","last_undegraded":"2024-08-20T01:36:22.716257+0000","last_fullsized":"2024-08-20T01:36:22.716257+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:43:14.876302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"74'6","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.723368+0000","last_change":"2024-08-20T01:34:54.374431+0000","last_active":"2024-08-20T01:36:22.723368+0000","last_peered":"2024-08-20T01:36:22.723368+0000","last_clean":"2024-08-20T01:36:22.723368+0000","last_became_active":"2024-08-20T01:34:54.374082+0000","last_became_peered":"2024-08-20T01:34:54.374082+0000","last_unstale":"2024-08-20T01:36:22.723368+0000","last_undegraded":"2024-08-20T01:36:22.723368+0000","last_fullsized":"2024-08-20T01:36:22.723368+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:11:10.046245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"74'7","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.705064+0000","last_change":"2024-08-20T01:34:54.372124+0000","last_active":"2024-08-20T01:36:22.705064+0000","last_peered":"2024-08-20T01:36:22.705064+0000","last_clean":"2024-08-20T01:36:22.705064+0000","last_became_active":"2024-08-20T01:34:54.371382+0000","last_became_peered":"2024-08-20T01:34:54.371382+0000","last_unstale":"2024-08-20T01:36:22.705064+0000","last_undegraded":"2024-08-20T01:36:22.705064+0000","last_fullsized":"2024-08-20T01:36:22.705064+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:29:38.715445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"74'10","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.691522+0000","last_change":"2024-08-20T01:34:54.372760+0000","last_active":"2024-08-20T01:36:22.691522+0000","last_peered":"2024-08-20T01:36:22.691522+0000","last_clean":"2024-08-20T01:36:22.691522+0000","last_became_active":"2024-08-20T01:34:54.372386+0000","last_became_peered":"2024-08-20T01:34:54.372386+0000","last_unstale":"2024-08-20T01:36:22.691522+0000","last_undegraded":"2024-08-20T01:36:22.691522+0000","last_fullsized":"2024-08-20T01:36:22.691522+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:30:32.873604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"74'7","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.710969+0000","last_change":"2024-08-20T01:34:54.371164+0000","last_active":"2024-08-20T01:36:22.710969+0000","last_peered":"2024-08-20T01:36:22.710969+0000","last_clean":"2024-08-20T01:36:22.710969+0000","last_became_active":"2024-08-20T01:34:54.370856+0000","last_became_peered":"2024-08-20T01:34:54.370856+0000","last_unstale":"2024-08-20T01:36:22.710969+0000","last_undegraded":"2024-08-20T01:36:22.710969+0000","last_fullsized":"2024-08-20T01:36:22.710969+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:14:26.803902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"74'7","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.712712+0000","last_change":"2024-08-20T01:34:54.369595+0000","last_active":"2024-08-20T01:36:22.712712+0000","last_peered":"2024-08-20T01:36:22.712712+0000","last_clean":"2024-08-20T01:36:22.712712+0000","last_became_active":"2024-08-20T01:34:54.369285+0000","last_became_peered":"2024-08-20T01:34:54.369285+0000","last_unstale":"2024-08-20T01:36:22.712712+0000","last_undegraded":"2024-08-20T01:36:22.712712+0000","last_fullsized":"2024-08-20T01:36:22.712712+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:53:16.965300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"74'9","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.721473+0000","last_change":"2024-08-20T01:34:54.366903+0000","last_active":"2024-08-20T01:36:22.721473+0000","last_peered":"2024-08-20T01:36:22.721473+0000","last_clean":"2024-08-20T01:36:22.721473+0000","last_became_active":"2024-08-20T01:34:54.366533+0000","last_became_peered":"2024-08-20T01:34:54.366533+0000","last_unstale":"2024-08-20T01:36:22.721473+0000","last_undegraded":"2024-08-20T01:36:22.721473+0000","last_fullsized":"2024-08-20T01:36:22.721473+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:11:23.025718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"74'8","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.723477+0000","last_change":"2024-08-20T01:34:54.368616+0000","last_active":"2024-08-20T01:36:22.723477+0000","last_peered":"2024-08-20T01:36:22.723477+0000","last_clean":"2024-08-20T01:36:22.723477+0000","last_became_active":"2024-08-20T01:34:54.368267+0000","last_became_peered":"2024-08-20T01:34:54.368267+0000","last_unstale":"2024-08-20T01:36:22.723477+0000","last_undegraded":"2024-08-20T01:36:22.723477+0000","last_fullsized":"2024-08-20T01:36:22.723477+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:53:09.035458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"74'10","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.711163+0000","last_change":"2024-08-20T01:34:54.369182+0000","last_active":"2024-08-20T01:36:22.711163+0000","last_peered":"2024-08-20T01:36:22.711163+0000","last_clean":"2024-08-20T01:36:22.711163+0000","last_became_active":"2024-08-20T01:34:54.368862+0000","last_became_peered":"2024-08-20T01:34:54.368862+0000","last_unstale":"2024-08-20T01:36:22.711163+0000","last_undegraded":"2024-08-20T01:36:22.711163+0000","last_fullsized":"2024-08-20T01:36:22.711163+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:31:16.013266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"74'7","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.707703+0000","last_change":"2024-08-20T01:34:54.368132+0000","last_active":"2024-08-20T01:36:22.707703+0000","last_peered":"2024-08-20T01:36:22.707703+0000","last_clean":"2024-08-20T01:36:22.707703+0000","last_became_active":"2024-08-20T01:34:54.366295+0000","last_became_peered":"2024-08-20T01:34:54.366295+0000","last_unstale":"2024-08-20T01:36:22.707703+0000","last_undegraded":"2024-08-20T01:36:22.707703+0000","last_fullsized":"2024-08-20T01:36:22.707703+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:52:23.928602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"74'8","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.709841+0000","last_change":"2024-08-20T01:35:53.785719+0000","last_active":"2024-08-20T01:36:22.709841+0000","last_peered":"2024-08-20T01:36:22.709841+0000","last_clean":"2024-08-20T01:36:22.709841+0000","last_became_active":"2024-08-20T01:35:53.785072+0000","last_became_peered":"2024-08-20T01:35:53.785072+0000","last_unstale":"2024-08-20T01:36:22.709841+0000","last_undegraded":"2024-08-20T01:36:22.709841+0000","last_fullsized":"2024-08-20T01:36:22.709841+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:52:22.034855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"74'11","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.698034+0000","last_change":"2024-08-20T01:34:54.366206+0000","last_active":"2024-08-20T01:36:22.698034+0000","last_peered":"2024-08-20T01:36:22.698034+0000","last_clean":"2024-08-20T01:36:22.698034+0000","last_became_active":"2024-08-20T01:34:54.365893+0000","last_became_peered":"2024-08-20T01:34:54.365893+0000","last_unstale":"2024-08-20T01:36:22.698034+0000","last_undegraded":"2024-08-20T01:36:22.698034+0000","last_fullsized":"2024-08-20T01:36:22.698034+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:39:22.610570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"74'10","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.722253+0000","last_change":"2024-08-20T01:34:54.368091+0000","last_active":"2024-08-20T01:36:22.722253+0000","last_peered":"2024-08-20T01:36:22.722253+0000","last_clean":"2024-08-20T01:36:22.722253+0000","last_became_active":"2024-08-20T01:34:54.367626+0000","last_became_peered":"2024-08-20T01:34:54.367626+0000","last_unstale":"2024-08-20T01:36:22.722253+0000","last_undegraded":"2024-08-20T01:36:22.722253+0000","last_fullsized":"2024-08-20T01:36:22.722253+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:52:34.157094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"74'8","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.709450+0000","last_change":"2024-08-20T01:34:54.370976+0000","last_active":"2024-08-20T01:36:22.709450+0000","last_peered":"2024-08-20T01:36:22.709450+0000","last_clean":"2024-08-20T01:36:22.709450+0000","last_became_active":"2024-08-20T01:34:54.368349+0000","last_became_peered":"2024-08-20T01:34:54.368349+0000","last_unstale":"2024-08-20T01:36:22.709450+0000","last_undegraded":"2024-08-20T01:36:22.709450+0000","last_fullsized":"2024-08-20T01:36:22.709450+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:53:48.846072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"74'6","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.709768+0000","last_change":"2024-08-20T01:34:54.379148+0000","last_active":"2024-08-20T01:36:22.709768+0000","last_peered":"2024-08-20T01:36:22.709768+0000","last_clean":"2024-08-20T01:36:22.709768+0000","last_became_active":"2024-08-20T01:34:54.378800+0000","last_became_peered":"2024-08-20T01:34:54.378800+0000","last_unstale":"2024-08-20T01:36:22.709768+0000","last_undegraded":"2024-08-20T01:36:22.709768+0000","last_fullsized":"2024-08-20T01:36:22.709768+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:42:47.382372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"74'2","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.705849+0000","last_change":"2024-08-20T01:34:54.376972+0000","last_active":"2024-08-20T01:36:22.705849+0000","last_peered":"2024-08-20T01:36:22.705849+0000","last_clean":"2024-08-20T01:36:22.705849+0000","last_became_active":"2024-08-20T01:34:54.376701+0000","last_became_peered":"2024-08-20T01:34:54.376701+0000","last_unstale":"2024-08-20T01:36:22.705849+0000","last_undegraded":"2024-08-20T01:36:22.705849+0000","last_fullsized":"2024-08-20T01:36:22.705849+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:19:12.897732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"74'15","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.712436+0000","last_change":"2024-08-20T01:34:54.372699+0000","last_active":"2024-08-20T01:36:22.712436+0000","last_peered":"2024-08-20T01:36:22.712436+0000","last_clean":"2024-08-20T01:36:22.712436+0000","last_became_active":"2024-08-20T01:34:54.371170+0000","last_became_peered":"2024-08-20T01:34:54.371170+0000","last_unstale":"2024-08-20T01:36:22.712436+0000","last_undegraded":"2024-08-20T01:36:22.712436+0000","last_fullsized":"2024-08-20T01:36:22.712436+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:18:00.373087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"74'6","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.708851+0000","last_change":"2024-08-20T01:34:54.373726+0000","last_active":"2024-08-20T01:36:22.708851+0000","last_peered":"2024-08-20T01:36:22.708851+0000","last_clean":"2024-08-20T01:36:22.708851+0000","last_became_active":"2024-08-20T01:34:54.373418+0000","last_became_peered":"2024-08-20T01:34:54.373418+0000","last_unstale":"2024-08-20T01:36:22.708851+0000","last_undegraded":"2024-08-20T01:36:22.708851+0000","last_fullsized":"2024-08-20T01:36:22.708851+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:55:28.791396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"74'4","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.690715+0000","last_change":"2024-08-20T01:34:54.371779+0000","last_active":"2024-08-20T01:36:22.690715+0000","last_peered":"2024-08-20T01:36:22.690715+0000","last_clean":"2024-08-20T01:36:22.690715+0000","last_became_active":"2024-08-20T01:34:54.370449+0000","last_became_peered":"2024-08-20T01:34:54.370449+0000","last_unstale":"2024-08-20T01:36:22.690715+0000","last_undegraded":"2024-08-20T01:36:22.690715+0000","last_fullsized":"2024-08-20T01:36:22.690715+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:03:22.153120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"74'7","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.710052+0000","last_change":"2024-08-20T01:35:53.785757+0000","last_active":"2024-08-20T01:36:22.710052+0000","last_peered":"2024-08-20T01:36:22.710052+0000","last_clean":"2024-08-20T01:36:22.710052+0000","last_became_active":"2024-08-20T01:35:53.784991+0000","last_became_peered":"2024-08-20T01:35:53.784991+0000","last_unstale":"2024-08-20T01:36:22.710052+0000","last_undegraded":"2024-08-20T01:36:22.710052+0000","last_fullsized":"2024-08-20T01:36:22.710052+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:46:28.442935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"74'8","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.711359+0000","last_change":"2024-08-20T01:34:54.369948+0000","last_active":"2024-08-20T01:36:22.711359+0000","last_peered":"2024-08-20T01:36:22.711359+0000","last_clean":"2024-08-20T01:36:22.711359+0000","last_became_active":"2024-08-20T01:34:54.367453+0000","last_became_peered":"2024-08-20T01:34:54.367453+0000","last_unstale":"2024-08-20T01:36:22.711359+0000","last_undegraded":"2024-08-20T01:36:22.711359+0000","last_fullsized":"2024-08-20T01:36:22.711359+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:09:38.800219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"74'12","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.712332+0000","last_change":"2024-08-20T01:34:54.373622+0000","last_active":"2024-08-20T01:36:22.712332+0000","last_peered":"2024-08-20T01:36:22.712332+0000","last_clean":"2024-08-20T01:36:22.712332+0000","last_became_active":"2024-08-20T01:34:54.373261+0000","last_became_peered":"2024-08-20T01:34:54.373261+0000","last_unstale":"2024-08-20T01:36:22.712332+0000","last_undegraded":"2024-08-20T01:36:22.712332+0000","last_fullsized":"2024-08-20T01:36:22.712332+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:21:03.471668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"74'9","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.710320+0000","last_change":"2024-08-20T01:34:54.374728+0000","last_active":"2024-08-20T01:36:22.710320+0000","last_peered":"2024-08-20T01:36:22.710320+0000","last_clean":"2024-08-20T01:36:22.710320+0000","last_became_active":"2024-08-20T01:34:54.374183+0000","last_became_peered":"2024-08-20T01:34:54.374183+0000","last_unstale":"2024-08-20T01:36:22.710320+0000","last_undegraded":"2024-08-20T01:36:22.710320+0000","last_fullsized":"2024-08-20T01:36:22.710320+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:39:40.203942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"74'7","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.707022+0000","last_change":"2024-08-20T01:34:54.372863+0000","last_active":"2024-08-20T01:36:22.707022+0000","last_peered":"2024-08-20T01:36:22.707022+0000","last_clean":"2024-08-20T01:36:22.707022+0000","last_became_active":"2024-08-20T01:34:54.372409+0000","last_became_peered":"2024-08-20T01:34:54.372409+0000","last_unstale":"2024-08-20T01:36:22.707022+0000","last_undegraded":"2024-08-20T01:36:22.707022+0000","last_fullsized":"2024-08-20T01:36:22.707022+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:22:51.676677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"74'6","reported_seq":134,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:46.593176+0000","last_change":"2024-08-20T01:34:52.343440+0000","last_active":"2024-08-20T01:36:46.593176+0000","last_peered":"2024-08-20T01:36:46.593176+0000","last_clean":"2024-08-20T01:36:46.593176+0000","last_became_active":"2024-08-20T01:34:52.343110+0000","last_became_peered":"2024-08-20T01:34:52.343110+0000","last_unstale":"2024-08-20T01:36:46.593176+0000","last_undegraded":"2024-08-20T01:36:46.593176+0000","last_fullsized":"2024-08-20T01:36:46.593176+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:46:51.406198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1115,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"74'8","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.713479+0000","last_change":"2024-08-20T01:34:54.379522+0000","last_active":"2024-08-20T01:36:22.713479+0000","last_peered":"2024-08-20T01:36:22.713479+0000","last_clean":"2024-08-20T01:36:22.713479+0000","last_became_active":"2024-08-20T01:34:54.378826+0000","last_became_peered":"2024-08-20T01:34:54.378826+0000","last_unstale":"2024-08-20T01:36:22.713479+0000","last_undegraded":"2024-08-20T01:36:22.713479+0000","last_fullsized":"2024-08-20T01:36:22.713479+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:49:59.985231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"72'7","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796989+0000","last_change":"2024-08-20T01:34:52.344483+0000","last_active":"2024-08-20T01:35:53.796989+0000","last_peered":"2024-08-20T01:35:53.796989+0000","last_clean":"2024-08-20T01:35:53.796989+0000","last_became_active":"2024-08-20T01:34:52.343940+0000","last_became_peered":"2024-08-20T01:34:52.343940+0000","last_unstale":"2024-08-20T01:35:53.796989+0000","last_undegraded":"2024-08-20T01:35:53.796989+0000","last_fullsized":"2024-08-20T01:35:53.796989+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:19:53.480527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"72'3","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.777959+0000","last_change":"2024-08-20T01:34:52.340732+0000","last_active":"2024-08-20T01:35:53.777959+0000","last_peered":"2024-08-20T01:35:53.777959+0000","last_clean":"2024-08-20T01:35:53.777959+0000","last_became_active":"2024-08-20T01:34:52.340367+0000","last_became_peered":"2024-08-20T01:34:52.340367+0000","last_unstale":"2024-08-20T01:35:53.777959+0000","last_undegraded":"2024-08-20T01:35:53.777959+0000","last_fullsized":"2024-08-20T01:35:53.777959+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:33:17.751642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"74'8","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.709157+0000","last_change":"2024-08-20T01:34:54.370725+0000","last_active":"2024-08-20T01:36:22.709157+0000","last_peered":"2024-08-20T01:36:22.709157+0000","last_clean":"2024-08-20T01:36:22.709157+0000","last_became_active":"2024-08-20T01:34:54.370423+0000","last_became_peered":"2024-08-20T01:34:54.370423+0000","last_unstale":"2024-08-20T01:36:22.709157+0000","last_undegraded":"2024-08-20T01:36:22.709157+0000","last_fullsized":"2024-08-20T01:36:22.709157+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:03:30.081748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"72'3","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.783141+0000","last_change":"2024-08-20T01:34:52.348605+0000","last_active":"2024-08-20T01:35:53.783141+0000","last_peered":"2024-08-20T01:35:53.783141+0000","last_clean":"2024-08-20T01:35:53.783141+0000","last_became_active":"2024-08-20T01:34:52.348278+0000","last_became_peered":"2024-08-20T01:34:52.348278+0000","last_unstale":"2024-08-20T01:35:53.783141+0000","last_undegraded":"2024-08-20T01:35:53.783141+0000","last_fullsized":"2024-08-20T01:35:53.783141+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:19:40.243243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"74'11","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.708919+0000","last_change":"2024-08-20T01:34:54.365604+0000","last_active":"2024-08-20T01:36:22.708919+0000","last_peered":"2024-08-20T01:36:22.708919+0000","last_clean":"2024-08-20T01:36:22.708919+0000","last_became_active":"2024-08-20T01:34:54.365284+0000","last_became_peered":"2024-08-20T01:34:54.365284+0000","last_unstale":"2024-08-20T01:36:22.708919+0000","last_undegraded":"2024-08-20T01:36:22.708919+0000","last_fullsized":"2024-08-20T01:36:22.708919+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:41:57.017680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'6","reported_seq":233,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:47.593893+0000","last_change":"2024-08-20T01:34:52.344679+0000","last_active":"2024-08-20T01:36:47.593893+0000","last_peered":"2024-08-20T01:36:47.593893+0000","last_clean":"2024-08-20T01:36:47.593893+0000","last_became_active":"2024-08-20T01:34:52.344058+0000","last_became_peered":"2024-08-20T01:34:52.344058+0000","last_unstale":"2024-08-20T01:36:47.593893+0000","last_undegraded":"2024-08-20T01:36:47.593893+0000","last_fullsized":"2024-08-20T01:36:47.593893+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:27:40.079949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":204,"num_read_kb":204,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"74'10","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.720099+0000","last_change":"2024-08-20T01:34:54.369724+0000","last_active":"2024-08-20T01:36:22.720099+0000","last_peered":"2024-08-20T01:36:22.720099+0000","last_clean":"2024-08-20T01:36:22.720099+0000","last_became_active":"2024-08-20T01:34:54.369403+0000","last_became_peered":"2024-08-20T01:34:54.369403+0000","last_unstale":"2024-08-20T01:36:22.720099+0000","last_undegraded":"2024-08-20T01:36:22.720099+0000","last_fullsized":"2024-08-20T01:36:22.720099+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:31:22.382794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"72'4","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779736+0000","last_change":"2024-08-20T01:34:52.346651+0000","last_active":"2024-08-20T01:35:53.779736+0000","last_peered":"2024-08-20T01:35:53.779736+0000","last_clean":"2024-08-20T01:35:53.779736+0000","last_became_active":"2024-08-20T01:34:52.346316+0000","last_became_peered":"2024-08-20T01:34:52.346316+0000","last_unstale":"2024-08-20T01:35:53.779736+0000","last_undegraded":"2024-08-20T01:35:53.779736+0000","last_fullsized":"2024-08-20T01:35:53.779736+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:48:34.382413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"74'9","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.712452+0000","last_change":"2024-08-20T01:34:54.375587+0000","last_active":"2024-08-20T01:36:22.712452+0000","last_peered":"2024-08-20T01:36:22.712452+0000","last_clean":"2024-08-20T01:36:22.712452+0000","last_became_active":"2024-08-20T01:34:54.374138+0000","last_became_peered":"2024-08-20T01:34:54.374138+0000","last_unstale":"2024-08-20T01:36:22.712452+0000","last_undegraded":"2024-08-20T01:36:22.712452+0000","last_fullsized":"2024-08-20T01:36:22.712452+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:02:46.817849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"72'5","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.784242+0000","last_change":"2024-08-20T01:34:52.559659+0000","last_active":"2024-08-20T01:35:53.784242+0000","last_peered":"2024-08-20T01:35:53.784242+0000","last_clean":"2024-08-20T01:35:53.784242+0000","last_became_active":"2024-08-20T01:34:52.559243+0000","last_became_peered":"2024-08-20T01:34:52.559243+0000","last_unstale":"2024-08-20T01:35:53.784242+0000","last_undegraded":"2024-08-20T01:35:53.784242+0000","last_fullsized":"2024-08-20T01:35:53.784242+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:49:02.314230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"74'11","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.722877+0000","last_change":"2024-08-20T01:34:54.372965+0000","last_active":"2024-08-20T01:36:22.722877+0000","last_peered":"2024-08-20T01:36:22.722877+0000","last_clean":"2024-08-20T01:36:22.722877+0000","last_became_active":"2024-08-20T01:34:54.372286+0000","last_became_peered":"2024-08-20T01:34:54.372286+0000","last_unstale":"2024-08-20T01:36:22.722877+0000","last_undegraded":"2024-08-20T01:36:22.722877+0000","last_fullsized":"2024-08-20T01:36:22.722877+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:32:45.178137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"74'35","reported_seq":273,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:47.615183+0000","last_change":"2024-08-20T01:34:52.348907+0000","last_active":"2024-08-20T01:36:47.615183+0000","last_peered":"2024-08-20T01:36:47.615183+0000","last_clean":"2024-08-20T01:36:47.615183+0000","last_became_active":"2024-08-20T01:34:52.347853+0000","last_became_peered":"2024-08-20T01:34:52.347853+0000","last_unstale":"2024-08-20T01:36:47.615183+0000","last_undegraded":"2024-08-20T01:36:47.615183+0000","last_fullsized":"2024-08-20T01:36:47.615183+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:19:31.142154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60504,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":215,"num_read_kb":166,"num_write":37,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"74'6","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.708224+0000","last_change":"2024-08-20T01:34:54.376493+0000","last_active":"2024-08-20T01:36:22.708224+0000","last_peered":"2024-08-20T01:36:22.708224+0000","last_clean":"2024-08-20T01:36:22.708224+0000","last_became_active":"2024-08-20T01:34:54.376160+0000","last_became_peered":"2024-08-20T01:34:54.376160+0000","last_unstale":"2024-08-20T01:36:22.708224+0000","last_undegraded":"2024-08-20T01:36:22.708224+0000","last_fullsized":"2024-08-20T01:36:22.708224+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:59:03.431731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"72'9","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796753+0000","last_change":"2024-08-20T01:34:52.347516+0000","last_active":"2024-08-20T01:35:53.796753+0000","last_peered":"2024-08-20T01:35:53.796753+0000","last_clean":"2024-08-20T01:35:53.796753+0000","last_became_active":"2024-08-20T01:34:52.347134+0000","last_became_peered":"2024-08-20T01:34:52.347134+0000","last_unstale":"2024-08-20T01:35:53.796753+0000","last_undegraded":"2024-08-20T01:35:53.796753+0000","last_fullsized":"2024-08-20T01:35:53.796753+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:26:16.057472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"74'9","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.704726+0000","last_change":"2024-08-20T01:34:54.368083+0000","last_active":"2024-08-20T01:36:22.704726+0000","last_peered":"2024-08-20T01:36:22.704726+0000","last_clean":"2024-08-20T01:36:22.704726+0000","last_became_active":"2024-08-20T01:34:54.367815+0000","last_became_peered":"2024-08-20T01:34:54.367815+0000","last_unstale":"2024-08-20T01:36:22.704726+0000","last_undegraded":"2024-08-20T01:36:22.704726+0000","last_fullsized":"2024-08-20T01:36:22.704726+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:02:13.515114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"72'5","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.783037+0000","last_change":"2024-08-20T01:34:52.345104+0000","last_active":"2024-08-20T01:35:53.783037+0000","last_peered":"2024-08-20T01:35:53.783037+0000","last_clean":"2024-08-20T01:35:53.783037+0000","last_became_active":"2024-08-20T01:34:52.344776+0000","last_became_peered":"2024-08-20T01:34:52.344776+0000","last_unstale":"2024-08-20T01:35:53.783037+0000","last_undegraded":"2024-08-20T01:35:53.783037+0000","last_fullsized":"2024-08-20T01:35:53.783037+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:05:30.230328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"74'15","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.714654+0000","last_change":"2024-08-20T01:34:54.369341+0000","last_active":"2024-08-20T01:36:22.714654+0000","last_peered":"2024-08-20T01:36:22.714654+0000","last_clean":"2024-08-20T01:36:22.714654+0000","last_became_active":"2024-08-20T01:34:54.369040+0000","last_became_peered":"2024-08-20T01:34:54.369040+0000","last_unstale":"2024-08-20T01:36:22.714654+0000","last_undegraded":"2024-08-20T01:36:22.714654+0000","last_fullsized":"2024-08-20T01:36:22.714654+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:20:07.403778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"74'6","reported_seq":136,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:48.579109+0000","last_change":"2024-08-20T01:34:52.346787+0000","last_active":"2024-08-20T01:36:48.579109+0000","last_peered":"2024-08-20T01:36:48.579109+0000","last_clean":"2024-08-20T01:36:48.579109+0000","last_became_active":"2024-08-20T01:34:52.345713+0000","last_became_peered":"2024-08-20T01:34:52.345713+0000","last_unstale":"2024-08-20T01:36:48.579109+0000","last_undegraded":"2024-08-20T01:36:48.579109+0000","last_fullsized":"2024-08-20T01:36:48.579109+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:33:06.861899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"74'6","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.715128+0000","last_change":"2024-08-20T01:34:54.374153+0000","last_active":"2024-08-20T01:36:22.715128+0000","last_peered":"2024-08-20T01:36:22.715128+0000","last_clean":"2024-08-20T01:36:22.715128+0000","last_became_active":"2024-08-20T01:34:54.372804+0000","last_became_peered":"2024-08-20T01:34:54.372804+0000","last_unstale":"2024-08-20T01:36:22.715128+0000","last_undegraded":"2024-08-20T01:36:22.715128+0000","last_fullsized":"2024-08-20T01:36:22.715128+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:54:27.470643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"72'17","reported_seq":41,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.782185+0000","last_change":"2024-08-20T01:34:52.559701+0000","last_active":"2024-08-20T01:35:53.782185+0000","last_peered":"2024-08-20T01:35:53.782185+0000","last_clean":"2024-08-20T01:35:53.782185+0000","last_became_active":"2024-08-20T01:34:52.559378+0000","last_became_peered":"2024-08-20T01:34:52.559378+0000","last_unstale":"2024-08-20T01:35:53.782185+0000","last_undegraded":"2024-08-20T01:35:53.782185+0000","last_fullsized":"2024-08-20T01:35:53.782185+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:39:55.636492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"74'6","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.710710+0000","last_change":"2024-08-20T01:35:53.798283+0000","last_active":"2024-08-20T01:36:22.710710+0000","last_peered":"2024-08-20T01:36:22.710710+0000","last_clean":"2024-08-20T01:36:22.710710+0000","last_became_active":"2024-08-20T01:35:53.797903+0000","last_became_peered":"2024-08-20T01:35:53.797903+0000","last_unstale":"2024-08-20T01:36:22.710710+0000","last_undegraded":"2024-08-20T01:36:22.710710+0000","last_fullsized":"2024-08-20T01:36:22.710710+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:22:27.676567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"74'3","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.784736+0000","last_change":"2024-08-20T01:34:52.347574+0000","last_active":"2024-08-20T01:35:53.784736+0000","last_peered":"2024-08-20T01:35:53.784736+0000","last_clean":"2024-08-20T01:35:53.784736+0000","last_became_active":"2024-08-20T01:34:52.347250+0000","last_became_peered":"2024-08-20T01:34:52.347250+0000","last_unstale":"2024-08-20T01:35:53.784736+0000","last_undegraded":"2024-08-20T01:35:53.784736+0000","last_fullsized":"2024-08-20T01:35:53.784736+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:03:00.007548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"74'5","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.707391+0000","last_change":"2024-08-20T01:34:54.376383+0000","last_active":"2024-08-20T01:36:22.707391+0000","last_peered":"2024-08-20T01:36:22.707391+0000","last_clean":"2024-08-20T01:36:22.707391+0000","last_became_active":"2024-08-20T01:34:54.376044+0000","last_became_peered":"2024-08-20T01:34:54.376044+0000","last_unstale":"2024-08-20T01:36:22.707391+0000","last_undegraded":"2024-08-20T01:36:22.707391+0000","last_fullsized":"2024-08-20T01:36:22.707391+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:31:15.814776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"72'5","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.778440+0000","last_change":"2024-08-20T01:34:52.343441+0000","last_active":"2024-08-20T01:35:53.778440+0000","last_peered":"2024-08-20T01:35:53.778440+0000","last_clean":"2024-08-20T01:35:53.778440+0000","last_became_active":"2024-08-20T01:34:52.343120+0000","last_became_peered":"2024-08-20T01:34:52.343120+0000","last_unstale":"2024-08-20T01:35:53.778440+0000","last_undegraded":"2024-08-20T01:35:53.778440+0000","last_fullsized":"2024-08-20T01:35:53.778440+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:44:11.309626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"74'9","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.712867+0000","last_change":"2024-08-20T01:34:54.368986+0000","last_active":"2024-08-20T01:36:22.712867+0000","last_peered":"2024-08-20T01:36:22.712867+0000","last_clean":"2024-08-20T01:36:22.712867+0000","last_became_active":"2024-08-20T01:34:54.368611+0000","last_became_peered":"2024-08-20T01:34:54.368611+0000","last_unstale":"2024-08-20T01:36:22.712867+0000","last_undegraded":"2024-08-20T01:36:22.712867+0000","last_fullsized":"2024-08-20T01:36:22.712867+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:37:32.433584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"72'3","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.783920+0000","last_change":"2024-08-20T01:34:52.345863+0000","last_active":"2024-08-20T01:35:53.783920+0000","last_peered":"2024-08-20T01:35:53.783920+0000","last_clean":"2024-08-20T01:35:53.783920+0000","last_became_active":"2024-08-20T01:34:52.345555+0000","last_became_peered":"2024-08-20T01:34:52.345555+0000","last_unstale":"2024-08-20T01:35:53.783920+0000","last_undegraded":"2024-08-20T01:35:53.783920+0000","last_fullsized":"2024-08-20T01:35:53.783920+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:46:21.606019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"74'7","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.715436+0000","last_change":"2024-08-20T01:34:54.379699+0000","last_active":"2024-08-20T01:36:22.715436+0000","last_peered":"2024-08-20T01:36:22.715436+0000","last_clean":"2024-08-20T01:36:22.715436+0000","last_became_active":"2024-08-20T01:34:54.379197+0000","last_became_peered":"2024-08-20T01:34:54.379197+0000","last_unstale":"2024-08-20T01:36:22.715436+0000","last_undegraded":"2024-08-20T01:36:22.715436+0000","last_fullsized":"2024-08-20T01:36:22.715436+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:31:15.249200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'6","reported_seq":136,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:48.613522+0000","last_change":"2024-08-20T01:34:52.559520+0000","last_active":"2024-08-20T01:36:48.613522+0000","last_peered":"2024-08-20T01:36:48.613522+0000","last_clean":"2024-08-20T01:36:48.613522+0000","last_became_active":"2024-08-20T01:34:52.559180+0000","last_became_peered":"2024-08-20T01:34:52.559180+0000","last_unstale":"2024-08-20T01:36:48.613522+0000","last_undegraded":"2024-08-20T01:36:48.613522+0000","last_fullsized":"2024-08-20T01:36:48.613522+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:48:35.667441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1663,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"74'7","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.723481+0000","last_change":"2024-08-20T01:34:54.372709+0000","last_active":"2024-08-20T01:36:22.723481+0000","last_peered":"2024-08-20T01:36:22.723481+0000","last_clean":"2024-08-20T01:36:22.723481+0000","last_became_active":"2024-08-20T01:34:54.372277+0000","last_became_peered":"2024-08-20T01:34:54.372277+0000","last_unstale":"2024-08-20T01:36:22.723481+0000","last_undegraded":"2024-08-20T01:36:22.723481+0000","last_fullsized":"2024-08-20T01:36:22.723481+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:26:11.837805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":96,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779536+0000","last_change":"2024-08-20T01:33:44.019475+0000","last_active":"2024-08-20T01:35:53.779536+0000","last_peered":"2024-08-20T01:35:53.779536+0000","last_clean":"2024-08-20T01:35:53.779536+0000","last_became_active":"2024-08-20T01:33:44.013614+0000","last_became_peered":"2024-08-20T01:33:44.013614+0000","last_unstale":"2024-08-20T01:35:53.779536+0000","last_undegraded":"2024-08-20T01:35:53.779536+0000","last_fullsized":"2024-08-20T01:35:53.779536+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:30:31.021505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:30:31.021505+0000","last_clean_scrub_stamp":"2024-08-20T01:30:31.021505+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:41:49.124707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"72'6","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.797689+0000","last_change":"2024-08-20T01:34:52.346409+0000","last_active":"2024-08-20T01:35:53.797689+0000","last_peered":"2024-08-20T01:35:53.797689+0000","last_clean":"2024-08-20T01:35:53.797689+0000","last_became_active":"2024-08-20T01:34:52.345821+0000","last_became_peered":"2024-08-20T01:34:52.345821+0000","last_unstale":"2024-08-20T01:35:53.797689+0000","last_undegraded":"2024-08-20T01:35:53.797689+0000","last_fullsized":"2024-08-20T01:35:53.797689+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:17:11.282558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"74'8","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.714769+0000","last_change":"2024-08-20T01:34:54.374804+0000","last_active":"2024-08-20T01:36:22.714769+0000","last_peered":"2024-08-20T01:36:22.714769+0000","last_clean":"2024-08-20T01:36:22.714769+0000","last_became_active":"2024-08-20T01:34:54.374252+0000","last_became_peered":"2024-08-20T01:34:54.374252+0000","last_unstale":"2024-08-20T01:36:22.714769+0000","last_undegraded":"2024-08-20T01:36:22.714769+0000","last_fullsized":"2024-08-20T01:36:22.714769+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:32:51.703703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"72'4","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779475+0000","last_change":"2024-08-20T01:34:52.341399+0000","last_active":"2024-08-20T01:35:53.779475+0000","last_peered":"2024-08-20T01:35:53.779475+0000","last_clean":"2024-08-20T01:35:53.779475+0000","last_became_active":"2024-08-20T01:34:52.341034+0000","last_became_peered":"2024-08-20T01:34:52.341034+0000","last_unstale":"2024-08-20T01:35:53.779475+0000","last_undegraded":"2024-08-20T01:35:53.779475+0000","last_fullsized":"2024-08-20T01:35:53.779475+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:10:44.804836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"74'5","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.695649+0000","last_change":"2024-08-20T01:34:54.366567+0000","last_active":"2024-08-20T01:36:22.695649+0000","last_peered":"2024-08-20T01:36:22.695649+0000","last_clean":"2024-08-20T01:36:22.695649+0000","last_became_active":"2024-08-20T01:34:54.366298+0000","last_became_peered":"2024-08-20T01:34:54.366298+0000","last_unstale":"2024-08-20T01:36:22.695649+0000","last_undegraded":"2024-08-20T01:36:22.695649+0000","last_fullsized":"2024-08-20T01:36:22.695649+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:14:26.805902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"74'6","reported_seq":132,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:46.574831+0000","last_change":"2024-08-20T01:34:52.559166+0000","last_active":"2024-08-20T01:36:46.574831+0000","last_peered":"2024-08-20T01:36:46.574831+0000","last_clean":"2024-08-20T01:36:46.574831+0000","last_became_active":"2024-08-20T01:34:52.558652+0000","last_became_peered":"2024-08-20T01:34:52.558652+0000","last_unstale":"2024-08-20T01:36:46.574831+0000","last_undegraded":"2024-08-20T01:36:46.574831+0000","last_fullsized":"2024-08-20T01:36:46.574831+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:45:13.374924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"74'8","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.713738+0000","last_change":"2024-08-20T01:34:54.371193+0000","last_active":"2024-08-20T01:36:22.713738+0000","last_peered":"2024-08-20T01:36:22.713738+0000","last_clean":"2024-08-20T01:36:22.713738+0000","last_became_active":"2024-08-20T01:34:54.370869+0000","last_became_peered":"2024-08-20T01:34:54.370869+0000","last_unstale":"2024-08-20T01:36:22.713738+0000","last_undegraded":"2024-08-20T01:36:22.713738+0000","last_fullsized":"2024-08-20T01:36:22.713738+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:23:36.683049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"72'5","reported_seq":129,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:44.572729+0000","last_change":"2024-08-20T01:34:52.348815+0000","last_active":"2024-08-20T01:36:44.572729+0000","last_peered":"2024-08-20T01:36:44.572729+0000","last_clean":"2024-08-20T01:36:44.572729+0000","last_became_active":"2024-08-20T01:34:52.348437+0000","last_became_peered":"2024-08-20T01:34:52.348437+0000","last_unstale":"2024-08-20T01:36:44.572729+0000","last_undegraded":"2024-08-20T01:36:44.572729+0000","last_fullsized":"2024-08-20T01:36:44.572729+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:55:15.090721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"74'7","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.713229+0000","last_change":"2024-08-20T01:34:54.376049+0000","last_active":"2024-08-20T01:36:22.713229+0000","last_peered":"2024-08-20T01:36:22.713229+0000","last_clean":"2024-08-20T01:36:22.713229+0000","last_became_active":"2024-08-20T01:34:54.375680+0000","last_became_peered":"2024-08-20T01:34:54.375680+0000","last_unstale":"2024-08-20T01:36:22.713229+0000","last_undegraded":"2024-08-20T01:36:22.713229+0000","last_fullsized":"2024-08-20T01:36:22.713229+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:42:12.499850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"72'1","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.785333+0000","last_change":"2024-08-20T01:35:53.785259+0000","last_active":"2024-08-20T01:35:53.785333+0000","last_peered":"2024-08-20T01:35:53.785333+0000","last_clean":"2024-08-20T01:35:53.785333+0000","last_became_active":"2024-08-20T01:35:53.784842+0000","last_became_peered":"2024-08-20T01:35:53.784842+0000","last_unstale":"2024-08-20T01:35:53.785333+0000","last_undegraded":"2024-08-20T01:35:53.785333+0000","last_fullsized":"2024-08-20T01:35:53.785333+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:55:09.411882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"74'5","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.709555+0000","last_change":"2024-08-20T01:34:54.369686+0000","last_active":"2024-08-20T01:36:22.709555+0000","last_peered":"2024-08-20T01:36:22.709555+0000","last_clean":"2024-08-20T01:36:22.709555+0000","last_became_active":"2024-08-20T01:34:54.369343+0000","last_became_peered":"2024-08-20T01:34:54.369343+0000","last_unstale":"2024-08-20T01:36:22.709555+0000","last_undegraded":"2024-08-20T01:36:22.709555+0000","last_fullsized":"2024-08-20T01:36:22.709555+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:00:39.775809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"72'4","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.791703+0000","last_change":"2024-08-20T01:35:53.791290+0000","last_active":"2024-08-20T01:35:53.791703+0000","last_peered":"2024-08-20T01:35:53.791703+0000","last_clean":"2024-08-20T01:35:53.791703+0000","last_became_active":"2024-08-20T01:35:53.783283+0000","last_became_peered":"2024-08-20T01:35:53.783283+0000","last_unstale":"2024-08-20T01:35:53.791703+0000","last_undegraded":"2024-08-20T01:35:53.791703+0000","last_fullsized":"2024-08-20T01:35:53.791703+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:54:40.774394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"74'9","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.696093+0000","last_change":"2024-08-20T01:34:54.376275+0000","last_active":"2024-08-20T01:36:22.696093+0000","last_peered":"2024-08-20T01:36:22.696093+0000","last_clean":"2024-08-20T01:36:22.696093+0000","last_became_active":"2024-08-20T01:34:54.375797+0000","last_became_peered":"2024-08-20T01:34:54.375797+0000","last_unstale":"2024-08-20T01:36:22.696093+0000","last_undegraded":"2024-08-20T01:36:22.696093+0000","last_fullsized":"2024-08-20T01:36:22.696093+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:01:37.172855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"74'16","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:23.379623+0000","last_change":"2024-08-20T01:34:52.342207+0000","last_active":"2024-08-20T01:36:23.379623+0000","last_peered":"2024-08-20T01:36:23.379623+0000","last_clean":"2024-08-20T01:36:23.379623+0000","last_became_active":"2024-08-20T01:34:52.341878+0000","last_became_peered":"2024-08-20T01:34:52.341878+0000","last_unstale":"2024-08-20T01:36:23.379623+0000","last_undegraded":"2024-08-20T01:36:23.379623+0000","last_fullsized":"2024-08-20T01:36:23.379623+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:29:36.374725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"74'5","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.712779+0000","last_change":"2024-08-20T01:34:54.371162+0000","last_active":"2024-08-20T01:36:22.712779+0000","last_peered":"2024-08-20T01:36:22.712779+0000","last_clean":"2024-08-20T01:36:22.712779+0000","last_became_active":"2024-08-20T01:34:54.368442+0000","last_became_peered":"2024-08-20T01:34:54.368442+0000","last_unstale":"2024-08-20T01:36:22.712779+0000","last_undegraded":"2024-08-20T01:36:22.712779+0000","last_fullsized":"2024-08-20T01:36:22.712779+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:23:42.119533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"72'7","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.797237+0000","last_change":"2024-08-20T01:34:52.345551+0000","last_active":"2024-08-20T01:35:53.797237+0000","last_peered":"2024-08-20T01:35:53.797237+0000","last_clean":"2024-08-20T01:35:53.797237+0000","last_became_active":"2024-08-20T01:34:52.344212+0000","last_became_peered":"2024-08-20T01:34:52.344212+0000","last_unstale":"2024-08-20T01:35:53.797237+0000","last_undegraded":"2024-08-20T01:35:53.797237+0000","last_fullsized":"2024-08-20T01:35:53.797237+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:52:58.826394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"74'7","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.716462+0000","last_change":"2024-08-20T01:35:53.799194+0000","last_active":"2024-08-20T01:36:22.716462+0000","last_peered":"2024-08-20T01:36:22.716462+0000","last_clean":"2024-08-20T01:36:22.716462+0000","last_became_active":"2024-08-20T01:35:53.798865+0000","last_became_peered":"2024-08-20T01:35:53.798865+0000","last_unstale":"2024-08-20T01:36:22.716462+0000","last_undegraded":"2024-08-20T01:36:22.716462+0000","last_fullsized":"2024-08-20T01:36:22.716462+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:24:58.697929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"72'2","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796311+0000","last_change":"2024-08-20T01:34:52.560529+0000","last_active":"2024-08-20T01:35:53.796311+0000","last_peered":"2024-08-20T01:35:53.796311+0000","last_clean":"2024-08-20T01:35:53.796311+0000","last_became_active":"2024-08-20T01:34:52.560141+0000","last_became_peered":"2024-08-20T01:34:52.560141+0000","last_unstale":"2024-08-20T01:35:53.796311+0000","last_undegraded":"2024-08-20T01:35:53.796311+0000","last_fullsized":"2024-08-20T01:35:53.796311+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:02:13.367700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"74'2","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.674299+0000","last_change":"2024-08-20T01:34:54.377963+0000","last_active":"2024-08-20T01:36:22.674299+0000","last_peered":"2024-08-20T01:36:22.674299+0000","last_clean":"2024-08-20T01:36:22.674299+0000","last_became_active":"2024-08-20T01:34:54.377645+0000","last_became_peered":"2024-08-20T01:34:54.377645+0000","last_unstale":"2024-08-20T01:36:22.674299+0000","last_undegraded":"2024-08-20T01:36:22.674299+0000","last_fullsized":"2024-08-20T01:36:22.674299+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:36:11.888293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"72'7","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796210+0000","last_change":"2024-08-20T01:34:52.342262+0000","last_active":"2024-08-20T01:35:53.796210+0000","last_peered":"2024-08-20T01:35:53.796210+0000","last_clean":"2024-08-20T01:35:53.796210+0000","last_became_active":"2024-08-20T01:34:52.341919+0000","last_became_peered":"2024-08-20T01:34:52.341919+0000","last_unstale":"2024-08-20T01:35:53.796210+0000","last_undegraded":"2024-08-20T01:35:53.796210+0000","last_fullsized":"2024-08-20T01:35:53.796210+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:29:38.542146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"74'9","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.708016+0000","last_change":"2024-08-20T01:34:54.375741+0000","last_active":"2024-08-20T01:36:22.708016+0000","last_peered":"2024-08-20T01:36:22.708016+0000","last_clean":"2024-08-20T01:36:22.708016+0000","last_became_active":"2024-08-20T01:34:54.375409+0000","last_became_peered":"2024-08-20T01:34:54.375409+0000","last_unstale":"2024-08-20T01:36:22.708016+0000","last_undegraded":"2024-08-20T01:36:22.708016+0000","last_fullsized":"2024-08-20T01:36:22.708016+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:29:46.278762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'4","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796682+0000","last_change":"2024-08-20T01:34:52.346296+0000","last_active":"2024-08-20T01:35:53.796682+0000","last_peered":"2024-08-20T01:35:53.796682+0000","last_clean":"2024-08-20T01:35:53.796682+0000","last_became_active":"2024-08-20T01:34:52.345535+0000","last_became_peered":"2024-08-20T01:34:52.345535+0000","last_unstale":"2024-08-20T01:35:53.796682+0000","last_undegraded":"2024-08-20T01:35:53.796682+0000","last_fullsized":"2024-08-20T01:35:53.796682+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:32:23.126530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"74'8","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.710087+0000","last_change":"2024-08-20T01:34:54.365720+0000","last_active":"2024-08-20T01:36:22.710087+0000","last_peered":"2024-08-20T01:36:22.710087+0000","last_clean":"2024-08-20T01:36:22.710087+0000","last_became_active":"2024-08-20T01:34:54.365406+0000","last_became_peered":"2024-08-20T01:34:54.365406+0000","last_unstale":"2024-08-20T01:36:22.710087+0000","last_undegraded":"2024-08-20T01:36:22.710087+0000","last_fullsized":"2024-08-20T01:36:22.710087+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:31:09.988882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"72'4","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.782477+0000","last_change":"2024-08-20T01:34:52.344263+0000","last_active":"2024-08-20T01:35:53.782477+0000","last_peered":"2024-08-20T01:35:53.782477+0000","last_clean":"2024-08-20T01:35:53.782477+0000","last_became_active":"2024-08-20T01:34:52.343706+0000","last_became_peered":"2024-08-20T01:34:52.343706+0000","last_unstale":"2024-08-20T01:35:53.782477+0000","last_undegraded":"2024-08-20T01:35:53.782477+0000","last_fullsized":"2024-08-20T01:35:53.782477+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:25:30.305116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"74'5","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.723549+0000","last_change":"2024-08-20T01:34:54.374564+0000","last_active":"2024-08-20T01:36:22.723549+0000","last_peered":"2024-08-20T01:36:22.723549+0000","last_clean":"2024-08-20T01:36:22.723549+0000","last_became_active":"2024-08-20T01:34:54.374136+0000","last_became_peered":"2024-08-20T01:34:54.374136+0000","last_unstale":"2024-08-20T01:36:22.723549+0000","last_undegraded":"2024-08-20T01:36:22.723549+0000","last_fullsized":"2024-08-20T01:36:22.723549+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:33:12.972430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"74'15","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.707188+0000","last_change":"2024-08-20T01:35:53.798392+0000","last_active":"2024-08-20T01:36:22.707188+0000","last_peered":"2024-08-20T01:36:22.707188+0000","last_clean":"2024-08-20T01:36:22.707188+0000","last_became_active":"2024-08-20T01:35:53.798035+0000","last_became_peered":"2024-08-20T01:35:53.798035+0000","last_unstale":"2024-08-20T01:36:22.707188+0000","last_undegraded":"2024-08-20T01:36:22.707188+0000","last_fullsized":"2024-08-20T01:36:22.707188+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:52:47.630577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"72'5","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.783108+0000","last_change":"2024-08-20T01:34:52.346174+0000","last_active":"2024-08-20T01:35:53.783108+0000","last_peered":"2024-08-20T01:35:53.783108+0000","last_clean":"2024-08-20T01:35:53.783108+0000","last_became_active":"2024-08-20T01:34:52.345677+0000","last_became_peered":"2024-08-20T01:34:52.345677+0000","last_unstale":"2024-08-20T01:35:53.783108+0000","last_undegraded":"2024-08-20T01:35:53.783108+0000","last_fullsized":"2024-08-20T01:35:53.783108+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:23:38.692225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"74'9","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.719866+0000","last_change":"2024-08-20T01:34:54.373515+0000","last_active":"2024-08-20T01:36:22.719866+0000","last_peered":"2024-08-20T01:36:22.719866+0000","last_clean":"2024-08-20T01:36:22.719866+0000","last_became_active":"2024-08-20T01:34:54.372954+0000","last_became_peered":"2024-08-20T01:34:54.372954+0000","last_unstale":"2024-08-20T01:36:22.719866+0000","last_undegraded":"2024-08-20T01:36:22.719866+0000","last_fullsized":"2024-08-20T01:36:22.719866+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:27:24.384924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"72'12","reported_seq":36,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.784666+0000","last_change":"2024-08-20T01:34:52.344089+0000","last_active":"2024-08-20T01:35:53.784666+0000","last_peered":"2024-08-20T01:35:53.784666+0000","last_clean":"2024-08-20T01:35:53.784666+0000","last_became_active":"2024-08-20T01:34:52.343354+0000","last_became_peered":"2024-08-20T01:34:52.343354+0000","last_unstale":"2024-08-20T01:35:53.784666+0000","last_undegraded":"2024-08-20T01:35:53.784666+0000","last_fullsized":"2024-08-20T01:35:53.784666+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:50:35.527307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"74'6","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.719529+0000","last_change":"2024-08-20T01:34:54.371931+0000","last_active":"2024-08-20T01:36:22.719529+0000","last_peered":"2024-08-20T01:36:22.719529+0000","last_clean":"2024-08-20T01:36:22.719529+0000","last_became_active":"2024-08-20T01:34:54.371385+0000","last_became_peered":"2024-08-20T01:34:54.371385+0000","last_unstale":"2024-08-20T01:36:22.719529+0000","last_undegraded":"2024-08-20T01:36:22.719529+0000","last_fullsized":"2024-08-20T01:36:22.719529+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:11:35.807145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"72'2","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796613+0000","last_change":"2024-08-20T01:34:52.559127+0000","last_active":"2024-08-20T01:35:53.796613+0000","last_peered":"2024-08-20T01:35:53.796613+0000","last_clean":"2024-08-20T01:35:53.796613+0000","last_became_active":"2024-08-20T01:34:52.558834+0000","last_became_peered":"2024-08-20T01:34:52.558834+0000","last_unstale":"2024-08-20T01:35:53.796613+0000","last_undegraded":"2024-08-20T01:35:53.796613+0000","last_fullsized":"2024-08-20T01:35:53.796613+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:57:35.879486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"74'5","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.706734+0000","last_change":"2024-08-20T01:34:54.378164+0000","last_active":"2024-08-20T01:36:22.706734+0000","last_peered":"2024-08-20T01:36:22.706734+0000","last_clean":"2024-08-20T01:36:22.706734+0000","last_became_active":"2024-08-20T01:34:54.377863+0000","last_became_peered":"2024-08-20T01:34:54.377863+0000","last_unstale":"2024-08-20T01:36:22.706734+0000","last_undegraded":"2024-08-20T01:36:22.706734+0000","last_fullsized":"2024-08-20T01:36:22.706734+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:23:21.832692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'14","reported_seq":139,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:46.422490+0000","last_change":"2024-08-20T01:34:52.341730+0000","last_active":"2024-08-20T01:36:46.422490+0000","last_peered":"2024-08-20T01:36:46.422490+0000","last_clean":"2024-08-20T01:36:46.422490+0000","last_became_active":"2024-08-20T01:34:52.341407+0000","last_became_peered":"2024-08-20T01:34:52.341407+0000","last_unstale":"2024-08-20T01:36:46.422490+0000","last_undegraded":"2024-08-20T01:36:46.422490+0000","last_fullsized":"2024-08-20T01:36:46.422490+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:53:09.225154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68405,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1064,"num_read_kb":605,"num_write":260,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":569344,"data_stored":209529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":66,"seq":283467841572,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":823296,"data_stored":394110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":61,"seq":261993005098,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36824,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708328,"statfs":{"total":95995035648,"available":95957327872,"internally_reserved":0,"allocated":1515520,"data_stored":1046024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":55,"seq":236223201325,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":839680,"data_stored":393928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":50,"seq":214748364851,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36152,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709000,"statfs":{"total":95995035648,"available":95958016000,"internally_reserved":0,"allocated":827392,"data_stored":394194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561079,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32584,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712568,"statfs":{"total":95995035648,"available":95961669632,"internally_reserved":0,"allocated":1433600,"data_stored":986433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":39,"seq":167503724605,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31988,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713164,"statfs":{"total":95995035648,"available":95962279936,"internally_reserved":0,"allocated":823296,"data_stored":394138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888130,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32596,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712556,"statfs":{"total":95995035648,"available":95961657344,"internally_reserved":0,"allocated":1445888,"data_stored":986604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084358,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":823296,"data_stored":393999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247882,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":839680,"data_stored":393470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444111,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":456268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":455555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":843776,"data_stored":395477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-20T01:36:52.361 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-20T01:36:52.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:52 smithi175 ceph-mon[22392]: pgmap v333: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1023 B/s wr, 10 op/s 2024-08-20T01:36:52.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:52 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2866473951' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:36:52.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.494+0000 7fdce6efd640 1 -- 172.21.15.79:0/338914249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdce01026e0 msgr2=0x7fdce0102b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:52.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.494+0000 7fdce6efd640 1 --2- 172.21.15.79:0/338914249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdce01026e0 0x7fdce0102b60 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0009930 tx=0x7fdcd002a420 comp rx=0 tx=0).stop 2024-08-20T01:36:52.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.494+0000 7fdce6efd640 1 -- 172.21.15.79:0/338914249 shutdown_connections 2024-08-20T01:36:52.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.494+0000 7fdce6efd640 1 --2- 172.21.15.79:0/338914249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdce01030a0 0x7fdce0109a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.494+0000 7fdce6efd640 1 --2- 172.21.15.79:0/338914249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdce01026e0 0x7fdce0102b60 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.494+0000 7fdce6efd640 1 --2- 172.21.15.79:0/338914249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdce0101590 0x7fdce0101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.494+0000 7fdce6efd640 1 -- 172.21.15.79:0/338914249 >> 172.21.15.79:0/338914249 conn(0x7fdce00fce50 msgr2=0x7fdce00ff270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:52.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.494+0000 7fdce6efd640 1 -- 172.21.15.79:0/338914249 shutdown_connections 2024-08-20T01:36:52.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.494+0000 7fdce6efd640 1 -- 172.21.15.79:0/338914249 wait complete. 2024-08-20T01:36:52.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.495+0000 7fdce6efd640 1 Processor -- start 2024-08-20T01:36:52.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.495+0000 7fdce6efd640 1 -- start start 2024-08-20T01:36:52.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.495+0000 7fdce6efd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdce0101590 0x7fdce01978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:52.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.495+0000 7fdce6efd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdce01026e0 0x7fdce0197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:52.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.495+0000 7fdce6efd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdce01030a0 0x7fdce0198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:52.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.495+0000 7fdce6efd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdce010d0b0 con 0x7fdce01030a0 2024-08-20T01:36:52.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.495+0000 7fdce6efd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdce010cf30 con 0x7fdce0101590 2024-08-20T01:36:52.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.495+0000 7fdce6efd640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdce010d230 con 0x7fdce01026e0 2024-08-20T01:36:52.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.495+0000 7fdce549a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdce01030a0 0x7fdce0198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:52.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.495+0000 7fdce549a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdce01030a0 0x7fdce0198b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46464/0 (socket says 172.21.15.79:46464) 2024-08-20T01:36:52.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.495+0000 7fdce549a640 1 -- 172.21.15.79:0/1050685429 learned_addr learned my addr 172.21.15.79:0/1050685429 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:52.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.495+0000 7fdcd7fff640 1 --2- 172.21.15.79:0/1050685429 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdce01026e0 0x7fdce0197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:52.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.495+0000 7fdce4c99640 1 --2- 172.21.15.79:0/1050685429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdce0101590 0x7fdce01978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:52.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.495+0000 7fdce549a640 1 -- 172.21.15.79:0/1050685429 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdce01026e0 msgr2=0x7fdce0197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:52.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.495+0000 7fdce549a640 1 --2- 172.21.15.79:0/1050685429 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdce01026e0 0x7fdce0197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.495+0000 7fdce549a640 1 -- 172.21.15.79:0/1050685429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdce0101590 msgr2=0x7fdce01978d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:52.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.495+0000 7fdce549a640 1 --2- 172.21.15.79:0/1050685429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdce0101590 0x7fdce01978d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.495+0000 7fdce549a640 1 -- 172.21.15.79:0/1050685429 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdce0199410 con 0x7fdce01030a0 2024-08-20T01:36:52.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.495+0000 7fdcd7fff640 1 --2- 172.21.15.79:0/1050685429 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdce01026e0 0x7fdce0197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:36:52.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.495+0000 7fdce549a640 1 --2- 172.21.15.79:0/1050685429 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdce01030a0 0x7fdce0198b50 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fdcd800cad0 tx=0x7fdcd800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:52.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.496+0000 7fdcd5ffb640 1 -- 172.21.15.79:0/1050685429 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd800ae20 con 0x7fdce01030a0 2024-08-20T01:36:52.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.496+0000 7fdce6efd640 1 -- 172.21.15.79:0/1050685429 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdce0199700 con 0x7fdce01030a0 2024-08-20T01:36:52.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.496+0000 7fdcd5ffb640 1 -- 172.21.15.79:0/1050685429 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdcd8005020 con 0x7fdce01030a0 2024-08-20T01:36:52.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.496+0000 7fdcd5ffb640 1 -- 172.21.15.79:0/1050685429 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd800f6b0 con 0x7fdce01030a0 2024-08-20T01:36:52.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.496+0000 7fdce6efd640 1 -- 172.21.15.79:0/1050685429 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdce019fdd0 con 0x7fdce01030a0 2024-08-20T01:36:52.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.497+0000 7fdce6efd640 1 -- 172.21.15.79:0/1050685429 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdce0108950 con 0x7fdce01030a0 2024-08-20T01:36:52.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.498+0000 7fdcd5ffb640 1 -- 172.21.15.79:0/1050685429 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fdcd80051d0 con 0x7fdce01030a0 2024-08-20T01:36:52.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.499+0000 7fdcd5ffb640 1 --2- 172.21.15.79:0/1050685429 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fdcc80b3c50 0x7fdcc80b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:52.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.499+0000 7fdce4c99640 1 --2- 172.21.15.79:0/1050685429 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fdcc80b3c50 0x7fdcc80b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:52.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.499+0000 7fdcd5ffb640 1 -- 172.21.15.79:0/1050685429 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fdcd80e3fa0 con 0x7fdce01030a0 2024-08-20T01:36:52.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.499+0000 7fdce4c99640 1 --2- 172.21.15.79:0/1050685429 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fdcc80b3c50 0x7fdcc80b6110 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc0058c0 tx=0x7fdcdc005c60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:52.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.503+0000 7fdcd5ffb640 1 -- 172.21.15.79:0/1050685429 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fdcd8014030 con 0x7fdce01030a0 2024-08-20T01:36:52.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:52 smithi081 ceph-mon[22209]: pgmap v333: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1023 B/s wr, 10 op/s 2024-08-20T01:36:52.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:52 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2866473951' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:36:52.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.677+0000 7fdce6efd640 1 -- 172.21.15.79:0/1050685429 --> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdce00632c0 con 0x7fdcc80b3c50 2024-08-20T01:36:52.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.681+0000 7fdcd5ffb640 1 -- 172.21.15.79:0/1050685429 <== mgr.14150 v2:172.21.15.79:6800/3038112779 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258869 (secure 0 0 0) 0x7fdce00632c0 con 0x7fdcc80b3c50 2024-08-20T01:36:52.686 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:36:52.687 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-08-20T01:36:52.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.684+0000 7fdce6efd640 1 -- 172.21.15.79:0/1050685429 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fdcc80b3c50 msgr2=0x7fdcc80b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:52.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.684+0000 7fdce6efd640 1 --2- 172.21.15.79:0/1050685429 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fdcc80b3c50 0x7fdcc80b6110 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc0058c0 tx=0x7fdcdc005c60 comp rx=0 tx=0).stop 2024-08-20T01:36:52.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.684+0000 7fdce6efd640 1 -- 172.21.15.79:0/1050685429 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdce01030a0 msgr2=0x7fdce0198b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:52.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.684+0000 7fdce6efd640 1 --2- 172.21.15.79:0/1050685429 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdce01030a0 0x7fdce0198b50 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fdcd800cad0 tx=0x7fdcd800cf90 comp rx=0 tx=0).stop 2024-08-20T01:36:52.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.684+0000 7fdce6efd640 1 -- 172.21.15.79:0/1050685429 shutdown_connections 2024-08-20T01:36:52.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.684+0000 7fdce6efd640 1 --2- 172.21.15.79:0/1050685429 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdce01030a0 0x7fdce0198b50 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.684+0000 7fdce6efd640 1 --2- 172.21.15.79:0/1050685429 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fdcc80b3c50 0x7fdcc80b6110 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.684+0000 7fdce6efd640 1 --2- 172.21.15.79:0/1050685429 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdce01026e0 0x7fdce0197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.684+0000 7fdce6efd640 1 --2- 172.21.15.79:0/1050685429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdce0101590 0x7fdce01978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.684+0000 7fdce6efd640 1 -- 172.21.15.79:0/1050685429 >> 172.21.15.79:0/1050685429 conn(0x7fdce00fce50 msgr2=0x7fdce0105b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:52.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.685+0000 7fdce6efd640 1 -- 172.21.15.79:0/1050685429 shutdown_connections 2024-08-20T01:36:52.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.685+0000 7fdce6efd640 1 -- 172.21.15.79:0/1050685429 wait complete. 2024-08-20T01:36:52.698 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":334,"stamp":"2024-08-20T01:36:52.496959+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659500,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1151,"num_read_kb":675,"num_write":386,"num_write_kb":2300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2951952,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":817,"ondisk_log_size":817,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365132,"kb_used_data":11724,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576692,"statfs":{"total":1151940427776,"available":1151566532608,"internally_reserved":0,"allocated":12005376,"data_stored":6692172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":361674043},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2465,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":60,"num_write":16,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002868"},"pg_stats":[{"pgid":"3.3f","version":"74'8","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.723367+0000","last_change":"2024-08-20T01:34:54.368243+0000","last_active":"2024-08-20T01:36:22.723367+0000","last_peered":"2024-08-20T01:36:22.723367+0000","last_clean":"2024-08-20T01:36:22.723367+0000","last_became_active":"2024-08-20T01:34:54.367712+0000","last_became_peered":"2024-08-20T01:34:54.367712+0000","last_unstale":"2024-08-20T01:36:22.723367+0000","last_undegraded":"2024-08-20T01:36:22.723367+0000","last_fullsized":"2024-08-20T01:36:22.723367+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:48:31.179090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"74'4","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.709603+0000","last_change":"2024-08-20T01:34:54.371126+0000","last_active":"2024-08-20T01:36:22.709603+0000","last_peered":"2024-08-20T01:36:22.709603+0000","last_clean":"2024-08-20T01:36:22.709603+0000","last_became_active":"2024-08-20T01:34:54.370821+0000","last_became_peered":"2024-08-20T01:34:54.370821+0000","last_unstale":"2024-08-20T01:36:22.709603+0000","last_undegraded":"2024-08-20T01:36:22.709603+0000","last_fullsized":"2024-08-20T01:36:22.709603+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:37:41.175264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"74'7","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.719479+0000","last_change":"2024-08-20T01:34:54.373051+0000","last_active":"2024-08-20T01:36:22.719479+0000","last_peered":"2024-08-20T01:36:22.719479+0000","last_clean":"2024-08-20T01:36:22.719479+0000","last_became_active":"2024-08-20T01:34:54.372783+0000","last_became_peered":"2024-08-20T01:34:54.372783+0000","last_unstale":"2024-08-20T01:36:22.719479+0000","last_undegraded":"2024-08-20T01:36:22.719479+0000","last_fullsized":"2024-08-20T01:36:22.719479+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:12:49.630968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"74'8","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.706204+0000","last_change":"2024-08-20T01:34:54.372395+0000","last_active":"2024-08-20T01:36:22.706204+0000","last_peered":"2024-08-20T01:36:22.706204+0000","last_clean":"2024-08-20T01:36:22.706204+0000","last_became_active":"2024-08-20T01:34:54.371804+0000","last_became_peered":"2024-08-20T01:34:54.371804+0000","last_unstale":"2024-08-20T01:36:22.706204+0000","last_undegraded":"2024-08-20T01:36:22.706204+0000","last_fullsized":"2024-08-20T01:36:22.706204+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:01:14.395727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"74'4","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.707351+0000","last_change":"2024-08-20T01:34:54.379200+0000","last_active":"2024-08-20T01:36:22.707351+0000","last_peered":"2024-08-20T01:36:22.707351+0000","last_clean":"2024-08-20T01:36:22.707351+0000","last_became_active":"2024-08-20T01:34:54.378828+0000","last_became_peered":"2024-08-20T01:34:54.378828+0000","last_unstale":"2024-08-20T01:36:22.707351+0000","last_undegraded":"2024-08-20T01:36:22.707351+0000","last_fullsized":"2024-08-20T01:36:22.707351+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:27:09.672074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"74'6","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.713927+0000","last_change":"2024-08-20T01:34:54.377871+0000","last_active":"2024-08-20T01:36:22.713927+0000","last_peered":"2024-08-20T01:36:22.713927+0000","last_clean":"2024-08-20T01:36:22.713927+0000","last_became_active":"2024-08-20T01:34:54.376617+0000","last_became_peered":"2024-08-20T01:34:54.376617+0000","last_unstale":"2024-08-20T01:36:22.713927+0000","last_undegraded":"2024-08-20T01:36:22.713927+0000","last_fullsized":"2024-08-20T01:36:22.713927+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:17:09.740135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"74'5","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.715604+0000","last_change":"2024-08-20T01:34:54.373761+0000","last_active":"2024-08-20T01:36:22.715604+0000","last_peered":"2024-08-20T01:36:22.715604+0000","last_clean":"2024-08-20T01:36:22.715604+0000","last_became_active":"2024-08-20T01:34:54.372944+0000","last_became_peered":"2024-08-20T01:34:54.372944+0000","last_unstale":"2024-08-20T01:36:22.715604+0000","last_undegraded":"2024-08-20T01:36:22.715604+0000","last_fullsized":"2024-08-20T01:36:22.715604+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:21:44.477970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"74'9","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.710177+0000","last_change":"2024-08-20T01:35:53.799340+0000","last_active":"2024-08-20T01:36:22.710177+0000","last_peered":"2024-08-20T01:36:22.710177+0000","last_clean":"2024-08-20T01:36:22.710177+0000","last_became_active":"2024-08-20T01:35:53.799002+0000","last_became_peered":"2024-08-20T01:35:53.799002+0000","last_unstale":"2024-08-20T01:36:22.710177+0000","last_undegraded":"2024-08-20T01:36:22.710177+0000","last_fullsized":"2024-08-20T01:36:22.710177+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:42:42.446756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"74'11","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.721041+0000","last_change":"2024-08-20T01:34:54.378350+0000","last_active":"2024-08-20T01:36:22.721041+0000","last_peered":"2024-08-20T01:36:22.721041+0000","last_clean":"2024-08-20T01:36:22.721041+0000","last_became_active":"2024-08-20T01:34:54.376524+0000","last_became_peered":"2024-08-20T01:34:54.376524+0000","last_unstale":"2024-08-20T01:36:22.721041+0000","last_undegraded":"2024-08-20T01:36:22.721041+0000","last_fullsized":"2024-08-20T01:36:22.721041+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:50:03.179130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"74'16","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.716257+0000","last_change":"2024-08-20T01:34:54.376098+0000","last_active":"2024-08-20T01:36:22.716257+0000","last_peered":"2024-08-20T01:36:22.716257+0000","last_clean":"2024-08-20T01:36:22.716257+0000","last_became_active":"2024-08-20T01:34:54.375671+0000","last_became_peered":"2024-08-20T01:34:54.375671+0000","last_unstale":"2024-08-20T01:36:22.716257+0000","last_undegraded":"2024-08-20T01:36:22.716257+0000","last_fullsized":"2024-08-20T01:36:22.716257+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:43:14.876302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"74'6","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.723368+0000","last_change":"2024-08-20T01:34:54.374431+0000","last_active":"2024-08-20T01:36:22.723368+0000","last_peered":"2024-08-20T01:36:22.723368+0000","last_clean":"2024-08-20T01:36:22.723368+0000","last_became_active":"2024-08-20T01:34:54.374082+0000","last_became_peered":"2024-08-20T01:34:54.374082+0000","last_unstale":"2024-08-20T01:36:22.723368+0000","last_undegraded":"2024-08-20T01:36:22.723368+0000","last_fullsized":"2024-08-20T01:36:22.723368+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:11:10.046245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"74'7","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.705064+0000","last_change":"2024-08-20T01:34:54.372124+0000","last_active":"2024-08-20T01:36:22.705064+0000","last_peered":"2024-08-20T01:36:22.705064+0000","last_clean":"2024-08-20T01:36:22.705064+0000","last_became_active":"2024-08-20T01:34:54.371382+0000","last_became_peered":"2024-08-20T01:34:54.371382+0000","last_unstale":"2024-08-20T01:36:22.705064+0000","last_undegraded":"2024-08-20T01:36:22.705064+0000","last_fullsized":"2024-08-20T01:36:22.705064+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:29:38.715445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"74'10","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.691522+0000","last_change":"2024-08-20T01:34:54.372760+0000","last_active":"2024-08-20T01:36:22.691522+0000","last_peered":"2024-08-20T01:36:22.691522+0000","last_clean":"2024-08-20T01:36:22.691522+0000","last_became_active":"2024-08-20T01:34:54.372386+0000","last_became_peered":"2024-08-20T01:34:54.372386+0000","last_unstale":"2024-08-20T01:36:22.691522+0000","last_undegraded":"2024-08-20T01:36:22.691522+0000","last_fullsized":"2024-08-20T01:36:22.691522+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:30:32.873604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"74'7","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.710969+0000","last_change":"2024-08-20T01:34:54.371164+0000","last_active":"2024-08-20T01:36:22.710969+0000","last_peered":"2024-08-20T01:36:22.710969+0000","last_clean":"2024-08-20T01:36:22.710969+0000","last_became_active":"2024-08-20T01:34:54.370856+0000","last_became_peered":"2024-08-20T01:34:54.370856+0000","last_unstale":"2024-08-20T01:36:22.710969+0000","last_undegraded":"2024-08-20T01:36:22.710969+0000","last_fullsized":"2024-08-20T01:36:22.710969+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:14:26.803902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"74'7","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.712712+0000","last_change":"2024-08-20T01:34:54.369595+0000","last_active":"2024-08-20T01:36:22.712712+0000","last_peered":"2024-08-20T01:36:22.712712+0000","last_clean":"2024-08-20T01:36:22.712712+0000","last_became_active":"2024-08-20T01:34:54.369285+0000","last_became_peered":"2024-08-20T01:34:54.369285+0000","last_unstale":"2024-08-20T01:36:22.712712+0000","last_undegraded":"2024-08-20T01:36:22.712712+0000","last_fullsized":"2024-08-20T01:36:22.712712+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:53:16.965300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"74'9","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.721473+0000","last_change":"2024-08-20T01:34:54.366903+0000","last_active":"2024-08-20T01:36:22.721473+0000","last_peered":"2024-08-20T01:36:22.721473+0000","last_clean":"2024-08-20T01:36:22.721473+0000","last_became_active":"2024-08-20T01:34:54.366533+0000","last_became_peered":"2024-08-20T01:34:54.366533+0000","last_unstale":"2024-08-20T01:36:22.721473+0000","last_undegraded":"2024-08-20T01:36:22.721473+0000","last_fullsized":"2024-08-20T01:36:22.721473+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:11:23.025718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"74'8","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.723477+0000","last_change":"2024-08-20T01:34:54.368616+0000","last_active":"2024-08-20T01:36:22.723477+0000","last_peered":"2024-08-20T01:36:22.723477+0000","last_clean":"2024-08-20T01:36:22.723477+0000","last_became_active":"2024-08-20T01:34:54.368267+0000","last_became_peered":"2024-08-20T01:34:54.368267+0000","last_unstale":"2024-08-20T01:36:22.723477+0000","last_undegraded":"2024-08-20T01:36:22.723477+0000","last_fullsized":"2024-08-20T01:36:22.723477+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:53:09.035458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"74'10","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.711163+0000","last_change":"2024-08-20T01:34:54.369182+0000","last_active":"2024-08-20T01:36:22.711163+0000","last_peered":"2024-08-20T01:36:22.711163+0000","last_clean":"2024-08-20T01:36:22.711163+0000","last_became_active":"2024-08-20T01:34:54.368862+0000","last_became_peered":"2024-08-20T01:34:54.368862+0000","last_unstale":"2024-08-20T01:36:22.711163+0000","last_undegraded":"2024-08-20T01:36:22.711163+0000","last_fullsized":"2024-08-20T01:36:22.711163+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:31:16.013266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"74'7","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.707703+0000","last_change":"2024-08-20T01:34:54.368132+0000","last_active":"2024-08-20T01:36:22.707703+0000","last_peered":"2024-08-20T01:36:22.707703+0000","last_clean":"2024-08-20T01:36:22.707703+0000","last_became_active":"2024-08-20T01:34:54.366295+0000","last_became_peered":"2024-08-20T01:34:54.366295+0000","last_unstale":"2024-08-20T01:36:22.707703+0000","last_undegraded":"2024-08-20T01:36:22.707703+0000","last_fullsized":"2024-08-20T01:36:22.707703+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:52:23.928602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"74'8","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.709841+0000","last_change":"2024-08-20T01:35:53.785719+0000","last_active":"2024-08-20T01:36:22.709841+0000","last_peered":"2024-08-20T01:36:22.709841+0000","last_clean":"2024-08-20T01:36:22.709841+0000","last_became_active":"2024-08-20T01:35:53.785072+0000","last_became_peered":"2024-08-20T01:35:53.785072+0000","last_unstale":"2024-08-20T01:36:22.709841+0000","last_undegraded":"2024-08-20T01:36:22.709841+0000","last_fullsized":"2024-08-20T01:36:22.709841+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:52:22.034855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"74'11","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.698034+0000","last_change":"2024-08-20T01:34:54.366206+0000","last_active":"2024-08-20T01:36:22.698034+0000","last_peered":"2024-08-20T01:36:22.698034+0000","last_clean":"2024-08-20T01:36:22.698034+0000","last_became_active":"2024-08-20T01:34:54.365893+0000","last_became_peered":"2024-08-20T01:34:54.365893+0000","last_unstale":"2024-08-20T01:36:22.698034+0000","last_undegraded":"2024-08-20T01:36:22.698034+0000","last_fullsized":"2024-08-20T01:36:22.698034+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:39:22.610570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"74'10","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.722253+0000","last_change":"2024-08-20T01:34:54.368091+0000","last_active":"2024-08-20T01:36:22.722253+0000","last_peered":"2024-08-20T01:36:22.722253+0000","last_clean":"2024-08-20T01:36:22.722253+0000","last_became_active":"2024-08-20T01:34:54.367626+0000","last_became_peered":"2024-08-20T01:34:54.367626+0000","last_unstale":"2024-08-20T01:36:22.722253+0000","last_undegraded":"2024-08-20T01:36:22.722253+0000","last_fullsized":"2024-08-20T01:36:22.722253+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:52:34.157094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"74'8","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.709450+0000","last_change":"2024-08-20T01:34:54.370976+0000","last_active":"2024-08-20T01:36:22.709450+0000","last_peered":"2024-08-20T01:36:22.709450+0000","last_clean":"2024-08-20T01:36:22.709450+0000","last_became_active":"2024-08-20T01:34:54.368349+0000","last_became_peered":"2024-08-20T01:34:54.368349+0000","last_unstale":"2024-08-20T01:36:22.709450+0000","last_undegraded":"2024-08-20T01:36:22.709450+0000","last_fullsized":"2024-08-20T01:36:22.709450+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:53:48.846072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"74'6","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.709768+0000","last_change":"2024-08-20T01:34:54.379148+0000","last_active":"2024-08-20T01:36:22.709768+0000","last_peered":"2024-08-20T01:36:22.709768+0000","last_clean":"2024-08-20T01:36:22.709768+0000","last_became_active":"2024-08-20T01:34:54.378800+0000","last_became_peered":"2024-08-20T01:34:54.378800+0000","last_unstale":"2024-08-20T01:36:22.709768+0000","last_undegraded":"2024-08-20T01:36:22.709768+0000","last_fullsized":"2024-08-20T01:36:22.709768+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:42:47.382372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"74'2","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.705849+0000","last_change":"2024-08-20T01:34:54.376972+0000","last_active":"2024-08-20T01:36:22.705849+0000","last_peered":"2024-08-20T01:36:22.705849+0000","last_clean":"2024-08-20T01:36:22.705849+0000","last_became_active":"2024-08-20T01:34:54.376701+0000","last_became_peered":"2024-08-20T01:34:54.376701+0000","last_unstale":"2024-08-20T01:36:22.705849+0000","last_undegraded":"2024-08-20T01:36:22.705849+0000","last_fullsized":"2024-08-20T01:36:22.705849+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:19:12.897732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"74'15","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.712436+0000","last_change":"2024-08-20T01:34:54.372699+0000","last_active":"2024-08-20T01:36:22.712436+0000","last_peered":"2024-08-20T01:36:22.712436+0000","last_clean":"2024-08-20T01:36:22.712436+0000","last_became_active":"2024-08-20T01:34:54.371170+0000","last_became_peered":"2024-08-20T01:34:54.371170+0000","last_unstale":"2024-08-20T01:36:22.712436+0000","last_undegraded":"2024-08-20T01:36:22.712436+0000","last_fullsized":"2024-08-20T01:36:22.712436+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:18:00.373087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"74'6","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.708851+0000","last_change":"2024-08-20T01:34:54.373726+0000","last_active":"2024-08-20T01:36:22.708851+0000","last_peered":"2024-08-20T01:36:22.708851+0000","last_clean":"2024-08-20T01:36:22.708851+0000","last_became_active":"2024-08-20T01:34:54.373418+0000","last_became_peered":"2024-08-20T01:34:54.373418+0000","last_unstale":"2024-08-20T01:36:22.708851+0000","last_undegraded":"2024-08-20T01:36:22.708851+0000","last_fullsized":"2024-08-20T01:36:22.708851+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:55:28.791396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"74'4","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.690715+0000","last_change":"2024-08-20T01:34:54.371779+0000","last_active":"2024-08-20T01:36:22.690715+0000","last_peered":"2024-08-20T01:36:22.690715+0000","last_clean":"2024-08-20T01:36:22.690715+0000","last_became_active":"2024-08-20T01:34:54.370449+0000","last_became_peered":"2024-08-20T01:34:54.370449+0000","last_unstale":"2024-08-20T01:36:22.690715+0000","last_undegraded":"2024-08-20T01:36:22.690715+0000","last_fullsized":"2024-08-20T01:36:22.690715+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:03:22.153120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"74'7","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.710052+0000","last_change":"2024-08-20T01:35:53.785757+0000","last_active":"2024-08-20T01:36:22.710052+0000","last_peered":"2024-08-20T01:36:22.710052+0000","last_clean":"2024-08-20T01:36:22.710052+0000","last_became_active":"2024-08-20T01:35:53.784991+0000","last_became_peered":"2024-08-20T01:35:53.784991+0000","last_unstale":"2024-08-20T01:36:22.710052+0000","last_undegraded":"2024-08-20T01:36:22.710052+0000","last_fullsized":"2024-08-20T01:36:22.710052+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:46:28.442935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"74'8","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.711359+0000","last_change":"2024-08-20T01:34:54.369948+0000","last_active":"2024-08-20T01:36:22.711359+0000","last_peered":"2024-08-20T01:36:22.711359+0000","last_clean":"2024-08-20T01:36:22.711359+0000","last_became_active":"2024-08-20T01:34:54.367453+0000","last_became_peered":"2024-08-20T01:34:54.367453+0000","last_unstale":"2024-08-20T01:36:22.711359+0000","last_undegraded":"2024-08-20T01:36:22.711359+0000","last_fullsized":"2024-08-20T01:36:22.711359+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:09:38.800219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"74'12","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.712332+0000","last_change":"2024-08-20T01:34:54.373622+0000","last_active":"2024-08-20T01:36:22.712332+0000","last_peered":"2024-08-20T01:36:22.712332+0000","last_clean":"2024-08-20T01:36:22.712332+0000","last_became_active":"2024-08-20T01:34:54.373261+0000","last_became_peered":"2024-08-20T01:34:54.373261+0000","last_unstale":"2024-08-20T01:36:22.712332+0000","last_undegraded":"2024-08-20T01:36:22.712332+0000","last_fullsized":"2024-08-20T01:36:22.712332+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:21:03.471668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"74'9","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.710320+0000","last_change":"2024-08-20T01:34:54.374728+0000","last_active":"2024-08-20T01:36:22.710320+0000","last_peered":"2024-08-20T01:36:22.710320+0000","last_clean":"2024-08-20T01:36:22.710320+0000","last_became_active":"2024-08-20T01:34:54.374183+0000","last_became_peered":"2024-08-20T01:34:54.374183+0000","last_unstale":"2024-08-20T01:36:22.710320+0000","last_undegraded":"2024-08-20T01:36:22.710320+0000","last_fullsized":"2024-08-20T01:36:22.710320+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:39:40.203942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"74'7","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.707022+0000","last_change":"2024-08-20T01:34:54.372863+0000","last_active":"2024-08-20T01:36:22.707022+0000","last_peered":"2024-08-20T01:36:22.707022+0000","last_clean":"2024-08-20T01:36:22.707022+0000","last_became_active":"2024-08-20T01:34:54.372409+0000","last_became_peered":"2024-08-20T01:34:54.372409+0000","last_unstale":"2024-08-20T01:36:22.707022+0000","last_undegraded":"2024-08-20T01:36:22.707022+0000","last_fullsized":"2024-08-20T01:36:22.707022+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:22:51.676677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"74'6","reported_seq":134,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:46.593176+0000","last_change":"2024-08-20T01:34:52.343440+0000","last_active":"2024-08-20T01:36:46.593176+0000","last_peered":"2024-08-20T01:36:46.593176+0000","last_clean":"2024-08-20T01:36:46.593176+0000","last_became_active":"2024-08-20T01:34:52.343110+0000","last_became_peered":"2024-08-20T01:34:52.343110+0000","last_unstale":"2024-08-20T01:36:46.593176+0000","last_undegraded":"2024-08-20T01:36:46.593176+0000","last_fullsized":"2024-08-20T01:36:46.593176+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:46:51.406198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1115,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"74'8","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.713479+0000","last_change":"2024-08-20T01:34:54.379522+0000","last_active":"2024-08-20T01:36:22.713479+0000","last_peered":"2024-08-20T01:36:22.713479+0000","last_clean":"2024-08-20T01:36:22.713479+0000","last_became_active":"2024-08-20T01:34:54.378826+0000","last_became_peered":"2024-08-20T01:34:54.378826+0000","last_unstale":"2024-08-20T01:36:22.713479+0000","last_undegraded":"2024-08-20T01:36:22.713479+0000","last_fullsized":"2024-08-20T01:36:22.713479+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:49:59.985231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"72'7","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796989+0000","last_change":"2024-08-20T01:34:52.344483+0000","last_active":"2024-08-20T01:35:53.796989+0000","last_peered":"2024-08-20T01:35:53.796989+0000","last_clean":"2024-08-20T01:35:53.796989+0000","last_became_active":"2024-08-20T01:34:52.343940+0000","last_became_peered":"2024-08-20T01:34:52.343940+0000","last_unstale":"2024-08-20T01:35:53.796989+0000","last_undegraded":"2024-08-20T01:35:53.796989+0000","last_fullsized":"2024-08-20T01:35:53.796989+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:19:53.480527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"72'3","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.777959+0000","last_change":"2024-08-20T01:34:52.340732+0000","last_active":"2024-08-20T01:35:53.777959+0000","last_peered":"2024-08-20T01:35:53.777959+0000","last_clean":"2024-08-20T01:35:53.777959+0000","last_became_active":"2024-08-20T01:34:52.340367+0000","last_became_peered":"2024-08-20T01:34:52.340367+0000","last_unstale":"2024-08-20T01:35:53.777959+0000","last_undegraded":"2024-08-20T01:35:53.777959+0000","last_fullsized":"2024-08-20T01:35:53.777959+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:33:17.751642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"74'8","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.709157+0000","last_change":"2024-08-20T01:34:54.370725+0000","last_active":"2024-08-20T01:36:22.709157+0000","last_peered":"2024-08-20T01:36:22.709157+0000","last_clean":"2024-08-20T01:36:22.709157+0000","last_became_active":"2024-08-20T01:34:54.370423+0000","last_became_peered":"2024-08-20T01:34:54.370423+0000","last_unstale":"2024-08-20T01:36:22.709157+0000","last_undegraded":"2024-08-20T01:36:22.709157+0000","last_fullsized":"2024-08-20T01:36:22.709157+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:03:30.081748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"72'3","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.783141+0000","last_change":"2024-08-20T01:34:52.348605+0000","last_active":"2024-08-20T01:35:53.783141+0000","last_peered":"2024-08-20T01:35:53.783141+0000","last_clean":"2024-08-20T01:35:53.783141+0000","last_became_active":"2024-08-20T01:34:52.348278+0000","last_became_peered":"2024-08-20T01:34:52.348278+0000","last_unstale":"2024-08-20T01:35:53.783141+0000","last_undegraded":"2024-08-20T01:35:53.783141+0000","last_fullsized":"2024-08-20T01:35:53.783141+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:19:40.243243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"74'11","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.708919+0000","last_change":"2024-08-20T01:34:54.365604+0000","last_active":"2024-08-20T01:36:22.708919+0000","last_peered":"2024-08-20T01:36:22.708919+0000","last_clean":"2024-08-20T01:36:22.708919+0000","last_became_active":"2024-08-20T01:34:54.365284+0000","last_became_peered":"2024-08-20T01:34:54.365284+0000","last_unstale":"2024-08-20T01:36:22.708919+0000","last_undegraded":"2024-08-20T01:36:22.708919+0000","last_fullsized":"2024-08-20T01:36:22.708919+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:41:57.017680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'6","reported_seq":233,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:47.593893+0000","last_change":"2024-08-20T01:34:52.344679+0000","last_active":"2024-08-20T01:36:47.593893+0000","last_peered":"2024-08-20T01:36:47.593893+0000","last_clean":"2024-08-20T01:36:47.593893+0000","last_became_active":"2024-08-20T01:34:52.344058+0000","last_became_peered":"2024-08-20T01:34:52.344058+0000","last_unstale":"2024-08-20T01:36:47.593893+0000","last_undegraded":"2024-08-20T01:36:47.593893+0000","last_fullsized":"2024-08-20T01:36:47.593893+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:27:40.079949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":204,"num_read_kb":204,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"74'10","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.720099+0000","last_change":"2024-08-20T01:34:54.369724+0000","last_active":"2024-08-20T01:36:22.720099+0000","last_peered":"2024-08-20T01:36:22.720099+0000","last_clean":"2024-08-20T01:36:22.720099+0000","last_became_active":"2024-08-20T01:34:54.369403+0000","last_became_peered":"2024-08-20T01:34:54.369403+0000","last_unstale":"2024-08-20T01:36:22.720099+0000","last_undegraded":"2024-08-20T01:36:22.720099+0000","last_fullsized":"2024-08-20T01:36:22.720099+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:31:22.382794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"72'4","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779736+0000","last_change":"2024-08-20T01:34:52.346651+0000","last_active":"2024-08-20T01:35:53.779736+0000","last_peered":"2024-08-20T01:35:53.779736+0000","last_clean":"2024-08-20T01:35:53.779736+0000","last_became_active":"2024-08-20T01:34:52.346316+0000","last_became_peered":"2024-08-20T01:34:52.346316+0000","last_unstale":"2024-08-20T01:35:53.779736+0000","last_undegraded":"2024-08-20T01:35:53.779736+0000","last_fullsized":"2024-08-20T01:35:53.779736+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:48:34.382413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"74'9","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.712452+0000","last_change":"2024-08-20T01:34:54.375587+0000","last_active":"2024-08-20T01:36:22.712452+0000","last_peered":"2024-08-20T01:36:22.712452+0000","last_clean":"2024-08-20T01:36:22.712452+0000","last_became_active":"2024-08-20T01:34:54.374138+0000","last_became_peered":"2024-08-20T01:34:54.374138+0000","last_unstale":"2024-08-20T01:36:22.712452+0000","last_undegraded":"2024-08-20T01:36:22.712452+0000","last_fullsized":"2024-08-20T01:36:22.712452+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:02:46.817849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"72'5","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.784242+0000","last_change":"2024-08-20T01:34:52.559659+0000","last_active":"2024-08-20T01:35:53.784242+0000","last_peered":"2024-08-20T01:35:53.784242+0000","last_clean":"2024-08-20T01:35:53.784242+0000","last_became_active":"2024-08-20T01:34:52.559243+0000","last_became_peered":"2024-08-20T01:34:52.559243+0000","last_unstale":"2024-08-20T01:35:53.784242+0000","last_undegraded":"2024-08-20T01:35:53.784242+0000","last_fullsized":"2024-08-20T01:35:53.784242+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:49:02.314230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"74'11","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.722877+0000","last_change":"2024-08-20T01:34:54.372965+0000","last_active":"2024-08-20T01:36:22.722877+0000","last_peered":"2024-08-20T01:36:22.722877+0000","last_clean":"2024-08-20T01:36:22.722877+0000","last_became_active":"2024-08-20T01:34:54.372286+0000","last_became_peered":"2024-08-20T01:34:54.372286+0000","last_unstale":"2024-08-20T01:36:22.722877+0000","last_undegraded":"2024-08-20T01:36:22.722877+0000","last_fullsized":"2024-08-20T01:36:22.722877+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:32:45.178137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"74'35","reported_seq":273,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:47.615183+0000","last_change":"2024-08-20T01:34:52.348907+0000","last_active":"2024-08-20T01:36:47.615183+0000","last_peered":"2024-08-20T01:36:47.615183+0000","last_clean":"2024-08-20T01:36:47.615183+0000","last_became_active":"2024-08-20T01:34:52.347853+0000","last_became_peered":"2024-08-20T01:34:52.347853+0000","last_unstale":"2024-08-20T01:36:47.615183+0000","last_undegraded":"2024-08-20T01:36:47.615183+0000","last_fullsized":"2024-08-20T01:36:47.615183+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:19:31.142154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60504,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":215,"num_read_kb":166,"num_write":37,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"74'6","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.708224+0000","last_change":"2024-08-20T01:34:54.376493+0000","last_active":"2024-08-20T01:36:22.708224+0000","last_peered":"2024-08-20T01:36:22.708224+0000","last_clean":"2024-08-20T01:36:22.708224+0000","last_became_active":"2024-08-20T01:34:54.376160+0000","last_became_peered":"2024-08-20T01:34:54.376160+0000","last_unstale":"2024-08-20T01:36:22.708224+0000","last_undegraded":"2024-08-20T01:36:22.708224+0000","last_fullsized":"2024-08-20T01:36:22.708224+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:59:03.431731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"72'9","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796753+0000","last_change":"2024-08-20T01:34:52.347516+0000","last_active":"2024-08-20T01:35:53.796753+0000","last_peered":"2024-08-20T01:35:53.796753+0000","last_clean":"2024-08-20T01:35:53.796753+0000","last_became_active":"2024-08-20T01:34:52.347134+0000","last_became_peered":"2024-08-20T01:34:52.347134+0000","last_unstale":"2024-08-20T01:35:53.796753+0000","last_undegraded":"2024-08-20T01:35:53.796753+0000","last_fullsized":"2024-08-20T01:35:53.796753+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:26:16.057472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"74'9","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.704726+0000","last_change":"2024-08-20T01:34:54.368083+0000","last_active":"2024-08-20T01:36:22.704726+0000","last_peered":"2024-08-20T01:36:22.704726+0000","last_clean":"2024-08-20T01:36:22.704726+0000","last_became_active":"2024-08-20T01:34:54.367815+0000","last_became_peered":"2024-08-20T01:34:54.367815+0000","last_unstale":"2024-08-20T01:36:22.704726+0000","last_undegraded":"2024-08-20T01:36:22.704726+0000","last_fullsized":"2024-08-20T01:36:22.704726+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:02:13.515114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"72'5","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.783037+0000","last_change":"2024-08-20T01:34:52.345104+0000","last_active":"2024-08-20T01:35:53.783037+0000","last_peered":"2024-08-20T01:35:53.783037+0000","last_clean":"2024-08-20T01:35:53.783037+0000","last_became_active":"2024-08-20T01:34:52.344776+0000","last_became_peered":"2024-08-20T01:34:52.344776+0000","last_unstale":"2024-08-20T01:35:53.783037+0000","last_undegraded":"2024-08-20T01:35:53.783037+0000","last_fullsized":"2024-08-20T01:35:53.783037+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:05:30.230328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"74'15","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.714654+0000","last_change":"2024-08-20T01:34:54.369341+0000","last_active":"2024-08-20T01:36:22.714654+0000","last_peered":"2024-08-20T01:36:22.714654+0000","last_clean":"2024-08-20T01:36:22.714654+0000","last_became_active":"2024-08-20T01:34:54.369040+0000","last_became_peered":"2024-08-20T01:34:54.369040+0000","last_unstale":"2024-08-20T01:36:22.714654+0000","last_undegraded":"2024-08-20T01:36:22.714654+0000","last_fullsized":"2024-08-20T01:36:22.714654+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:20:07.403778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"74'6","reported_seq":136,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:48.579109+0000","last_change":"2024-08-20T01:34:52.346787+0000","last_active":"2024-08-20T01:36:48.579109+0000","last_peered":"2024-08-20T01:36:48.579109+0000","last_clean":"2024-08-20T01:36:48.579109+0000","last_became_active":"2024-08-20T01:34:52.345713+0000","last_became_peered":"2024-08-20T01:34:52.345713+0000","last_unstale":"2024-08-20T01:36:48.579109+0000","last_undegraded":"2024-08-20T01:36:48.579109+0000","last_fullsized":"2024-08-20T01:36:48.579109+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:33:06.861899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"74'6","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.715128+0000","last_change":"2024-08-20T01:34:54.374153+0000","last_active":"2024-08-20T01:36:22.715128+0000","last_peered":"2024-08-20T01:36:22.715128+0000","last_clean":"2024-08-20T01:36:22.715128+0000","last_became_active":"2024-08-20T01:34:54.372804+0000","last_became_peered":"2024-08-20T01:34:54.372804+0000","last_unstale":"2024-08-20T01:36:22.715128+0000","last_undegraded":"2024-08-20T01:36:22.715128+0000","last_fullsized":"2024-08-20T01:36:22.715128+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:54:27.470643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"72'17","reported_seq":41,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.782185+0000","last_change":"2024-08-20T01:34:52.559701+0000","last_active":"2024-08-20T01:35:53.782185+0000","last_peered":"2024-08-20T01:35:53.782185+0000","last_clean":"2024-08-20T01:35:53.782185+0000","last_became_active":"2024-08-20T01:34:52.559378+0000","last_became_peered":"2024-08-20T01:34:52.559378+0000","last_unstale":"2024-08-20T01:35:53.782185+0000","last_undegraded":"2024-08-20T01:35:53.782185+0000","last_fullsized":"2024-08-20T01:35:53.782185+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:39:55.636492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"74'6","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.710710+0000","last_change":"2024-08-20T01:35:53.798283+0000","last_active":"2024-08-20T01:36:22.710710+0000","last_peered":"2024-08-20T01:36:22.710710+0000","last_clean":"2024-08-20T01:36:22.710710+0000","last_became_active":"2024-08-20T01:35:53.797903+0000","last_became_peered":"2024-08-20T01:35:53.797903+0000","last_unstale":"2024-08-20T01:36:22.710710+0000","last_undegraded":"2024-08-20T01:36:22.710710+0000","last_fullsized":"2024-08-20T01:36:22.710710+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:22:27.676567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"74'3","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.784736+0000","last_change":"2024-08-20T01:34:52.347574+0000","last_active":"2024-08-20T01:35:53.784736+0000","last_peered":"2024-08-20T01:35:53.784736+0000","last_clean":"2024-08-20T01:35:53.784736+0000","last_became_active":"2024-08-20T01:34:52.347250+0000","last_became_peered":"2024-08-20T01:34:52.347250+0000","last_unstale":"2024-08-20T01:35:53.784736+0000","last_undegraded":"2024-08-20T01:35:53.784736+0000","last_fullsized":"2024-08-20T01:35:53.784736+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:03:00.007548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"74'5","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.707391+0000","last_change":"2024-08-20T01:34:54.376383+0000","last_active":"2024-08-20T01:36:22.707391+0000","last_peered":"2024-08-20T01:36:22.707391+0000","last_clean":"2024-08-20T01:36:22.707391+0000","last_became_active":"2024-08-20T01:34:54.376044+0000","last_became_peered":"2024-08-20T01:34:54.376044+0000","last_unstale":"2024-08-20T01:36:22.707391+0000","last_undegraded":"2024-08-20T01:36:22.707391+0000","last_fullsized":"2024-08-20T01:36:22.707391+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:31:15.814776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"72'5","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.778440+0000","last_change":"2024-08-20T01:34:52.343441+0000","last_active":"2024-08-20T01:35:53.778440+0000","last_peered":"2024-08-20T01:35:53.778440+0000","last_clean":"2024-08-20T01:35:53.778440+0000","last_became_active":"2024-08-20T01:34:52.343120+0000","last_became_peered":"2024-08-20T01:34:52.343120+0000","last_unstale":"2024-08-20T01:35:53.778440+0000","last_undegraded":"2024-08-20T01:35:53.778440+0000","last_fullsized":"2024-08-20T01:35:53.778440+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:44:11.309626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"74'9","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.712867+0000","last_change":"2024-08-20T01:34:54.368986+0000","last_active":"2024-08-20T01:36:22.712867+0000","last_peered":"2024-08-20T01:36:22.712867+0000","last_clean":"2024-08-20T01:36:22.712867+0000","last_became_active":"2024-08-20T01:34:54.368611+0000","last_became_peered":"2024-08-20T01:34:54.368611+0000","last_unstale":"2024-08-20T01:36:22.712867+0000","last_undegraded":"2024-08-20T01:36:22.712867+0000","last_fullsized":"2024-08-20T01:36:22.712867+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:37:32.433584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"72'3","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.783920+0000","last_change":"2024-08-20T01:34:52.345863+0000","last_active":"2024-08-20T01:35:53.783920+0000","last_peered":"2024-08-20T01:35:53.783920+0000","last_clean":"2024-08-20T01:35:53.783920+0000","last_became_active":"2024-08-20T01:34:52.345555+0000","last_became_peered":"2024-08-20T01:34:52.345555+0000","last_unstale":"2024-08-20T01:35:53.783920+0000","last_undegraded":"2024-08-20T01:35:53.783920+0000","last_fullsized":"2024-08-20T01:35:53.783920+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:46:21.606019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"74'7","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.715436+0000","last_change":"2024-08-20T01:34:54.379699+0000","last_active":"2024-08-20T01:36:22.715436+0000","last_peered":"2024-08-20T01:36:22.715436+0000","last_clean":"2024-08-20T01:36:22.715436+0000","last_became_active":"2024-08-20T01:34:54.379197+0000","last_became_peered":"2024-08-20T01:34:54.379197+0000","last_unstale":"2024-08-20T01:36:22.715436+0000","last_undegraded":"2024-08-20T01:36:22.715436+0000","last_fullsized":"2024-08-20T01:36:22.715436+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:31:15.249200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'6","reported_seq":136,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:48.613522+0000","last_change":"2024-08-20T01:34:52.559520+0000","last_active":"2024-08-20T01:36:48.613522+0000","last_peered":"2024-08-20T01:36:48.613522+0000","last_clean":"2024-08-20T01:36:48.613522+0000","last_became_active":"2024-08-20T01:34:52.559180+0000","last_became_peered":"2024-08-20T01:34:52.559180+0000","last_unstale":"2024-08-20T01:36:48.613522+0000","last_undegraded":"2024-08-20T01:36:48.613522+0000","last_fullsized":"2024-08-20T01:36:48.613522+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:48:35.667441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1663,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"74'7","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.723481+0000","last_change":"2024-08-20T01:34:54.372709+0000","last_active":"2024-08-20T01:36:22.723481+0000","last_peered":"2024-08-20T01:36:22.723481+0000","last_clean":"2024-08-20T01:36:22.723481+0000","last_became_active":"2024-08-20T01:34:54.372277+0000","last_became_peered":"2024-08-20T01:34:54.372277+0000","last_unstale":"2024-08-20T01:36:22.723481+0000","last_undegraded":"2024-08-20T01:36:22.723481+0000","last_fullsized":"2024-08-20T01:36:22.723481+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:26:11.837805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":96,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779536+0000","last_change":"2024-08-20T01:33:44.019475+0000","last_active":"2024-08-20T01:35:53.779536+0000","last_peered":"2024-08-20T01:35:53.779536+0000","last_clean":"2024-08-20T01:35:53.779536+0000","last_became_active":"2024-08-20T01:33:44.013614+0000","last_became_peered":"2024-08-20T01:33:44.013614+0000","last_unstale":"2024-08-20T01:35:53.779536+0000","last_undegraded":"2024-08-20T01:35:53.779536+0000","last_fullsized":"2024-08-20T01:35:53.779536+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:30:31.021505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:30:31.021505+0000","last_clean_scrub_stamp":"2024-08-20T01:30:31.021505+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:41:49.124707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"72'6","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.797689+0000","last_change":"2024-08-20T01:34:52.346409+0000","last_active":"2024-08-20T01:35:53.797689+0000","last_peered":"2024-08-20T01:35:53.797689+0000","last_clean":"2024-08-20T01:35:53.797689+0000","last_became_active":"2024-08-20T01:34:52.345821+0000","last_became_peered":"2024-08-20T01:34:52.345821+0000","last_unstale":"2024-08-20T01:35:53.797689+0000","last_undegraded":"2024-08-20T01:35:53.797689+0000","last_fullsized":"2024-08-20T01:35:53.797689+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:17:11.282558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"74'8","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.714769+0000","last_change":"2024-08-20T01:34:54.374804+0000","last_active":"2024-08-20T01:36:22.714769+0000","last_peered":"2024-08-20T01:36:22.714769+0000","last_clean":"2024-08-20T01:36:22.714769+0000","last_became_active":"2024-08-20T01:34:54.374252+0000","last_became_peered":"2024-08-20T01:34:54.374252+0000","last_unstale":"2024-08-20T01:36:22.714769+0000","last_undegraded":"2024-08-20T01:36:22.714769+0000","last_fullsized":"2024-08-20T01:36:22.714769+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:32:51.703703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"72'4","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779475+0000","last_change":"2024-08-20T01:34:52.341399+0000","last_active":"2024-08-20T01:35:53.779475+0000","last_peered":"2024-08-20T01:35:53.779475+0000","last_clean":"2024-08-20T01:35:53.779475+0000","last_became_active":"2024-08-20T01:34:52.341034+0000","last_became_peered":"2024-08-20T01:34:52.341034+0000","last_unstale":"2024-08-20T01:35:53.779475+0000","last_undegraded":"2024-08-20T01:35:53.779475+0000","last_fullsized":"2024-08-20T01:35:53.779475+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:10:44.804836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"74'5","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.695649+0000","last_change":"2024-08-20T01:34:54.366567+0000","last_active":"2024-08-20T01:36:22.695649+0000","last_peered":"2024-08-20T01:36:22.695649+0000","last_clean":"2024-08-20T01:36:22.695649+0000","last_became_active":"2024-08-20T01:34:54.366298+0000","last_became_peered":"2024-08-20T01:34:54.366298+0000","last_unstale":"2024-08-20T01:36:22.695649+0000","last_undegraded":"2024-08-20T01:36:22.695649+0000","last_fullsized":"2024-08-20T01:36:22.695649+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:14:26.805902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"74'6","reported_seq":132,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:46.574831+0000","last_change":"2024-08-20T01:34:52.559166+0000","last_active":"2024-08-20T01:36:46.574831+0000","last_peered":"2024-08-20T01:36:46.574831+0000","last_clean":"2024-08-20T01:36:46.574831+0000","last_became_active":"2024-08-20T01:34:52.558652+0000","last_became_peered":"2024-08-20T01:34:52.558652+0000","last_unstale":"2024-08-20T01:36:46.574831+0000","last_undegraded":"2024-08-20T01:36:46.574831+0000","last_fullsized":"2024-08-20T01:36:46.574831+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:45:13.374924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"74'8","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.713738+0000","last_change":"2024-08-20T01:34:54.371193+0000","last_active":"2024-08-20T01:36:22.713738+0000","last_peered":"2024-08-20T01:36:22.713738+0000","last_clean":"2024-08-20T01:36:22.713738+0000","last_became_active":"2024-08-20T01:34:54.370869+0000","last_became_peered":"2024-08-20T01:34:54.370869+0000","last_unstale":"2024-08-20T01:36:22.713738+0000","last_undegraded":"2024-08-20T01:36:22.713738+0000","last_fullsized":"2024-08-20T01:36:22.713738+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:23:36.683049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'6","reported_seq":136,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:49.579864+0000","last_change":"2024-08-20T01:34:52.348815+0000","last_active":"2024-08-20T01:36:49.579864+0000","last_peered":"2024-08-20T01:36:49.579864+0000","last_clean":"2024-08-20T01:36:49.579864+0000","last_became_active":"2024-08-20T01:34:52.348437+0000","last_became_peered":"2024-08-20T01:34:52.348437+0000","last_unstale":"2024-08-20T01:36:49.579864+0000","last_undegraded":"2024-08-20T01:36:49.579864+0000","last_fullsized":"2024-08-20T01:36:49.579864+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:55:15.090721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"74'7","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.713229+0000","last_change":"2024-08-20T01:34:54.376049+0000","last_active":"2024-08-20T01:36:22.713229+0000","last_peered":"2024-08-20T01:36:22.713229+0000","last_clean":"2024-08-20T01:36:22.713229+0000","last_became_active":"2024-08-20T01:34:54.375680+0000","last_became_peered":"2024-08-20T01:34:54.375680+0000","last_unstale":"2024-08-20T01:36:22.713229+0000","last_undegraded":"2024-08-20T01:36:22.713229+0000","last_fullsized":"2024-08-20T01:36:22.713229+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:42:12.499850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"72'1","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.785333+0000","last_change":"2024-08-20T01:35:53.785259+0000","last_active":"2024-08-20T01:35:53.785333+0000","last_peered":"2024-08-20T01:35:53.785333+0000","last_clean":"2024-08-20T01:35:53.785333+0000","last_became_active":"2024-08-20T01:35:53.784842+0000","last_became_peered":"2024-08-20T01:35:53.784842+0000","last_unstale":"2024-08-20T01:35:53.785333+0000","last_undegraded":"2024-08-20T01:35:53.785333+0000","last_fullsized":"2024-08-20T01:35:53.785333+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:55:09.411882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"74'5","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.709555+0000","last_change":"2024-08-20T01:34:54.369686+0000","last_active":"2024-08-20T01:36:22.709555+0000","last_peered":"2024-08-20T01:36:22.709555+0000","last_clean":"2024-08-20T01:36:22.709555+0000","last_became_active":"2024-08-20T01:34:54.369343+0000","last_became_peered":"2024-08-20T01:34:54.369343+0000","last_unstale":"2024-08-20T01:36:22.709555+0000","last_undegraded":"2024-08-20T01:36:22.709555+0000","last_fullsized":"2024-08-20T01:36:22.709555+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:00:39.775809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"72'4","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.791703+0000","last_change":"2024-08-20T01:35:53.791290+0000","last_active":"2024-08-20T01:35:53.791703+0000","last_peered":"2024-08-20T01:35:53.791703+0000","last_clean":"2024-08-20T01:35:53.791703+0000","last_became_active":"2024-08-20T01:35:53.783283+0000","last_became_peered":"2024-08-20T01:35:53.783283+0000","last_unstale":"2024-08-20T01:35:53.791703+0000","last_undegraded":"2024-08-20T01:35:53.791703+0000","last_fullsized":"2024-08-20T01:35:53.791703+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:54:40.774394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"74'9","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.696093+0000","last_change":"2024-08-20T01:34:54.376275+0000","last_active":"2024-08-20T01:36:22.696093+0000","last_peered":"2024-08-20T01:36:22.696093+0000","last_clean":"2024-08-20T01:36:22.696093+0000","last_became_active":"2024-08-20T01:34:54.375797+0000","last_became_peered":"2024-08-20T01:34:54.375797+0000","last_unstale":"2024-08-20T01:36:22.696093+0000","last_undegraded":"2024-08-20T01:36:22.696093+0000","last_fullsized":"2024-08-20T01:36:22.696093+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:01:37.172855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"74'16","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:23.379623+0000","last_change":"2024-08-20T01:34:52.342207+0000","last_active":"2024-08-20T01:36:23.379623+0000","last_peered":"2024-08-20T01:36:23.379623+0000","last_clean":"2024-08-20T01:36:23.379623+0000","last_became_active":"2024-08-20T01:34:52.341878+0000","last_became_peered":"2024-08-20T01:34:52.341878+0000","last_unstale":"2024-08-20T01:36:23.379623+0000","last_undegraded":"2024-08-20T01:36:23.379623+0000","last_fullsized":"2024-08-20T01:36:23.379623+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:29:36.374725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"74'5","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.712779+0000","last_change":"2024-08-20T01:34:54.371162+0000","last_active":"2024-08-20T01:36:22.712779+0000","last_peered":"2024-08-20T01:36:22.712779+0000","last_clean":"2024-08-20T01:36:22.712779+0000","last_became_active":"2024-08-20T01:34:54.368442+0000","last_became_peered":"2024-08-20T01:34:54.368442+0000","last_unstale":"2024-08-20T01:36:22.712779+0000","last_undegraded":"2024-08-20T01:36:22.712779+0000","last_fullsized":"2024-08-20T01:36:22.712779+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:23:42.119533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"72'7","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.797237+0000","last_change":"2024-08-20T01:34:52.345551+0000","last_active":"2024-08-20T01:35:53.797237+0000","last_peered":"2024-08-20T01:35:53.797237+0000","last_clean":"2024-08-20T01:35:53.797237+0000","last_became_active":"2024-08-20T01:34:52.344212+0000","last_became_peered":"2024-08-20T01:34:52.344212+0000","last_unstale":"2024-08-20T01:35:53.797237+0000","last_undegraded":"2024-08-20T01:35:53.797237+0000","last_fullsized":"2024-08-20T01:35:53.797237+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:52:58.826394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"74'7","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.716462+0000","last_change":"2024-08-20T01:35:53.799194+0000","last_active":"2024-08-20T01:36:22.716462+0000","last_peered":"2024-08-20T01:36:22.716462+0000","last_clean":"2024-08-20T01:36:22.716462+0000","last_became_active":"2024-08-20T01:35:53.798865+0000","last_became_peered":"2024-08-20T01:35:53.798865+0000","last_unstale":"2024-08-20T01:36:22.716462+0000","last_undegraded":"2024-08-20T01:36:22.716462+0000","last_fullsized":"2024-08-20T01:36:22.716462+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:24:58.697929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"72'2","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796311+0000","last_change":"2024-08-20T01:34:52.560529+0000","last_active":"2024-08-20T01:35:53.796311+0000","last_peered":"2024-08-20T01:35:53.796311+0000","last_clean":"2024-08-20T01:35:53.796311+0000","last_became_active":"2024-08-20T01:34:52.560141+0000","last_became_peered":"2024-08-20T01:34:52.560141+0000","last_unstale":"2024-08-20T01:35:53.796311+0000","last_undegraded":"2024-08-20T01:35:53.796311+0000","last_fullsized":"2024-08-20T01:35:53.796311+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:02:13.367700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"74'2","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.674299+0000","last_change":"2024-08-20T01:34:54.377963+0000","last_active":"2024-08-20T01:36:22.674299+0000","last_peered":"2024-08-20T01:36:22.674299+0000","last_clean":"2024-08-20T01:36:22.674299+0000","last_became_active":"2024-08-20T01:34:54.377645+0000","last_became_peered":"2024-08-20T01:34:54.377645+0000","last_unstale":"2024-08-20T01:36:22.674299+0000","last_undegraded":"2024-08-20T01:36:22.674299+0000","last_fullsized":"2024-08-20T01:36:22.674299+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:36:11.888293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"72'7","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796210+0000","last_change":"2024-08-20T01:34:52.342262+0000","last_active":"2024-08-20T01:35:53.796210+0000","last_peered":"2024-08-20T01:35:53.796210+0000","last_clean":"2024-08-20T01:35:53.796210+0000","last_became_active":"2024-08-20T01:34:52.341919+0000","last_became_peered":"2024-08-20T01:34:52.341919+0000","last_unstale":"2024-08-20T01:35:53.796210+0000","last_undegraded":"2024-08-20T01:35:53.796210+0000","last_fullsized":"2024-08-20T01:35:53.796210+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:29:38.542146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"74'9","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.708016+0000","last_change":"2024-08-20T01:34:54.375741+0000","last_active":"2024-08-20T01:36:22.708016+0000","last_peered":"2024-08-20T01:36:22.708016+0000","last_clean":"2024-08-20T01:36:22.708016+0000","last_became_active":"2024-08-20T01:34:54.375409+0000","last_became_peered":"2024-08-20T01:34:54.375409+0000","last_unstale":"2024-08-20T01:36:22.708016+0000","last_undegraded":"2024-08-20T01:36:22.708016+0000","last_fullsized":"2024-08-20T01:36:22.708016+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:29:46.278762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'4","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796682+0000","last_change":"2024-08-20T01:34:52.346296+0000","last_active":"2024-08-20T01:35:53.796682+0000","last_peered":"2024-08-20T01:35:53.796682+0000","last_clean":"2024-08-20T01:35:53.796682+0000","last_became_active":"2024-08-20T01:34:52.345535+0000","last_became_peered":"2024-08-20T01:34:52.345535+0000","last_unstale":"2024-08-20T01:35:53.796682+0000","last_undegraded":"2024-08-20T01:35:53.796682+0000","last_fullsized":"2024-08-20T01:35:53.796682+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:32:23.126530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"74'8","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.710087+0000","last_change":"2024-08-20T01:34:54.365720+0000","last_active":"2024-08-20T01:36:22.710087+0000","last_peered":"2024-08-20T01:36:22.710087+0000","last_clean":"2024-08-20T01:36:22.710087+0000","last_became_active":"2024-08-20T01:34:54.365406+0000","last_became_peered":"2024-08-20T01:34:54.365406+0000","last_unstale":"2024-08-20T01:36:22.710087+0000","last_undegraded":"2024-08-20T01:36:22.710087+0000","last_fullsized":"2024-08-20T01:36:22.710087+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:31:09.988882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"72'4","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.782477+0000","last_change":"2024-08-20T01:34:52.344263+0000","last_active":"2024-08-20T01:35:53.782477+0000","last_peered":"2024-08-20T01:35:53.782477+0000","last_clean":"2024-08-20T01:35:53.782477+0000","last_became_active":"2024-08-20T01:34:52.343706+0000","last_became_peered":"2024-08-20T01:34:52.343706+0000","last_unstale":"2024-08-20T01:35:53.782477+0000","last_undegraded":"2024-08-20T01:35:53.782477+0000","last_fullsized":"2024-08-20T01:35:53.782477+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:25:30.305116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"74'5","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.723549+0000","last_change":"2024-08-20T01:34:54.374564+0000","last_active":"2024-08-20T01:36:22.723549+0000","last_peered":"2024-08-20T01:36:22.723549+0000","last_clean":"2024-08-20T01:36:22.723549+0000","last_became_active":"2024-08-20T01:34:54.374136+0000","last_became_peered":"2024-08-20T01:34:54.374136+0000","last_unstale":"2024-08-20T01:36:22.723549+0000","last_undegraded":"2024-08-20T01:36:22.723549+0000","last_fullsized":"2024-08-20T01:36:22.723549+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:33:12.972430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"74'15","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.707188+0000","last_change":"2024-08-20T01:35:53.798392+0000","last_active":"2024-08-20T01:36:22.707188+0000","last_peered":"2024-08-20T01:36:22.707188+0000","last_clean":"2024-08-20T01:36:22.707188+0000","last_became_active":"2024-08-20T01:35:53.798035+0000","last_became_peered":"2024-08-20T01:35:53.798035+0000","last_unstale":"2024-08-20T01:36:22.707188+0000","last_undegraded":"2024-08-20T01:36:22.707188+0000","last_fullsized":"2024-08-20T01:36:22.707188+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:52:47.630577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"72'5","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.783108+0000","last_change":"2024-08-20T01:34:52.346174+0000","last_active":"2024-08-20T01:35:53.783108+0000","last_peered":"2024-08-20T01:35:53.783108+0000","last_clean":"2024-08-20T01:35:53.783108+0000","last_became_active":"2024-08-20T01:34:52.345677+0000","last_became_peered":"2024-08-20T01:34:52.345677+0000","last_unstale":"2024-08-20T01:35:53.783108+0000","last_undegraded":"2024-08-20T01:35:53.783108+0000","last_fullsized":"2024-08-20T01:35:53.783108+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:23:38.692225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"74'9","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.719866+0000","last_change":"2024-08-20T01:34:54.373515+0000","last_active":"2024-08-20T01:36:22.719866+0000","last_peered":"2024-08-20T01:36:22.719866+0000","last_clean":"2024-08-20T01:36:22.719866+0000","last_became_active":"2024-08-20T01:34:54.372954+0000","last_became_peered":"2024-08-20T01:34:54.372954+0000","last_unstale":"2024-08-20T01:36:22.719866+0000","last_undegraded":"2024-08-20T01:36:22.719866+0000","last_fullsized":"2024-08-20T01:36:22.719866+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:27:24.384924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"72'12","reported_seq":36,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.784666+0000","last_change":"2024-08-20T01:34:52.344089+0000","last_active":"2024-08-20T01:35:53.784666+0000","last_peered":"2024-08-20T01:35:53.784666+0000","last_clean":"2024-08-20T01:35:53.784666+0000","last_became_active":"2024-08-20T01:34:52.343354+0000","last_became_peered":"2024-08-20T01:34:52.343354+0000","last_unstale":"2024-08-20T01:35:53.784666+0000","last_undegraded":"2024-08-20T01:35:53.784666+0000","last_fullsized":"2024-08-20T01:35:53.784666+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:50:35.527307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"74'6","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.719529+0000","last_change":"2024-08-20T01:34:54.371931+0000","last_active":"2024-08-20T01:36:22.719529+0000","last_peered":"2024-08-20T01:36:22.719529+0000","last_clean":"2024-08-20T01:36:22.719529+0000","last_became_active":"2024-08-20T01:34:54.371385+0000","last_became_peered":"2024-08-20T01:34:54.371385+0000","last_unstale":"2024-08-20T01:36:22.719529+0000","last_undegraded":"2024-08-20T01:36:22.719529+0000","last_fullsized":"2024-08-20T01:36:22.719529+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:11:35.807145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"72'2","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796613+0000","last_change":"2024-08-20T01:34:52.559127+0000","last_active":"2024-08-20T01:35:53.796613+0000","last_peered":"2024-08-20T01:35:53.796613+0000","last_clean":"2024-08-20T01:35:53.796613+0000","last_became_active":"2024-08-20T01:34:52.558834+0000","last_became_peered":"2024-08-20T01:34:52.558834+0000","last_unstale":"2024-08-20T01:35:53.796613+0000","last_undegraded":"2024-08-20T01:35:53.796613+0000","last_fullsized":"2024-08-20T01:35:53.796613+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:57:35.879486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"74'5","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.706734+0000","last_change":"2024-08-20T01:34:54.378164+0000","last_active":"2024-08-20T01:36:22.706734+0000","last_peered":"2024-08-20T01:36:22.706734+0000","last_clean":"2024-08-20T01:36:22.706734+0000","last_became_active":"2024-08-20T01:34:54.377863+0000","last_became_peered":"2024-08-20T01:34:54.377863+0000","last_unstale":"2024-08-20T01:36:22.706734+0000","last_undegraded":"2024-08-20T01:36:22.706734+0000","last_fullsized":"2024-08-20T01:36:22.706734+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:23:21.832692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'14","reported_seq":144,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:50.580608+0000","last_change":"2024-08-20T01:34:52.341730+0000","last_active":"2024-08-20T01:36:50.580608+0000","last_peered":"2024-08-20T01:36:50.580608+0000","last_clean":"2024-08-20T01:36:50.580608+0000","last_became_active":"2024-08-20T01:34:52.341407+0000","last_became_peered":"2024-08-20T01:34:52.341407+0000","last_unstale":"2024-08-20T01:36:50.580608+0000","last_undegraded":"2024-08-20T01:36:50.580608+0000","last_fullsized":"2024-08-20T01:36:50.580608+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:53:09.225154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":107,"num_read_kb":107,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68898,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1075,"num_read_kb":611,"num_write":261,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":569344,"data_stored":211008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":223,"ondisk_log_size":223,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":66,"seq":283467841573,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":823296,"data_stored":394603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":61,"seq":261993005098,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36824,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708328,"statfs":{"total":95995035648,"available":95957327872,"internally_reserved":0,"allocated":1515520,"data_stored":1046024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":55,"seq":236223201326,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":839680,"data_stored":393928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":50,"seq":214748364851,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36152,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709000,"statfs":{"total":95995035648,"available":95958016000,"internally_reserved":0,"allocated":827392,"data_stored":394194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561080,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32584,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712568,"statfs":{"total":95995035648,"available":95961669632,"internally_reserved":0,"allocated":1433600,"data_stored":987912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":39,"seq":167503724605,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31988,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713164,"statfs":{"total":95995035648,"available":95962279936,"internally_reserved":0,"allocated":823296,"data_stored":394138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888130,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32596,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712556,"statfs":{"total":95995035648,"available":95961657344,"internally_reserved":0,"allocated":1445888,"data_stored":986604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084358,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":823296,"data_stored":393999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247882,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":839680,"data_stored":393470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444111,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":456268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":455555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":843776,"data_stored":395477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-20T01:36:52.702 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-08-20T01:36:52.702 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-20T01:36:52.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.836+0000 7f434abd2640 1 -- 172.21.15.79:0/3626628335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4344103ba0 msgr2=0x7f4344103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:52.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.836+0000 7f434abd2640 1 --2- 172.21.15.79:0/3626628335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4344103ba0 0x7f4344103fa0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4334009900 tx=0x7f433402a410 comp rx=0 tx=0).stop 2024-08-20T01:36:52.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.836+0000 7f434abd2640 1 -- 172.21.15.79:0/3626628335 shutdown_connections 2024-08-20T01:36:52.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.836+0000 7f434abd2640 1 --2- 172.21.15.79:0/3626628335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4344102db0 0x7f434410ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.836+0000 7f434abd2640 1 --2- 172.21.15.79:0/3626628335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43441023f0 0x7f4344102870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.836+0000 7f434abd2640 1 --2- 172.21.15.79:0/3626628335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4344103ba0 0x7f4344103fa0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.836+0000 7f434abd2640 1 -- 172.21.15.79:0/3626628335 >> 172.21.15.79:0/3626628335 conn(0x7f43440fdf40 msgr2=0x7f4344100380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:52.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.836+0000 7f434abd2640 1 -- 172.21.15.79:0/3626628335 shutdown_connections 2024-08-20T01:36:52.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.836+0000 7f434abd2640 1 -- 172.21.15.79:0/3626628335 wait complete. 2024-08-20T01:36:52.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.837+0000 7f434abd2640 1 Processor -- start 2024-08-20T01:36:52.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.837+0000 7f434abd2640 1 -- start start 2024-08-20T01:36:52.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.837+0000 7f434abd2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43441023f0 0x7f4344198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:52.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.837+0000 7f434abd2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4344102db0 0x7f43441990a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:52.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.837+0000 7f434abd2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4344103ba0 0x7f4344199cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:52.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.837+0000 7f434abd2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f434410e2b0 con 0x7f43441023f0 2024-08-20T01:36:52.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.837+0000 7f434abd2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f434410e130 con 0x7f4344103ba0 2024-08-20T01:36:52.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.837+0000 7f434abd2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f434410e430 con 0x7f4344102db0 2024-08-20T01:36:52.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.837+0000 7f434896e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43441023f0 0x7f4344198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:52.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.837+0000 7f434896e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43441023f0 0x7f4344198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46478/0 (socket says 172.21.15.79:46478) 2024-08-20T01:36:52.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.837+0000 7f434896e640 1 -- 172.21.15.79:0/3350811638 learned_addr learned my addr 172.21.15.79:0/3350811638 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:52.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.837+0000 7f4343fff640 1 --2- 172.21.15.79:0/3350811638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4344102db0 0x7f43441990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:52.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.837+0000 7f434916f640 1 --2- 172.21.15.79:0/3350811638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4344103ba0 0x7f4344199cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:52.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.837+0000 7f434896e640 1 -- 172.21.15.79:0/3350811638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4344102db0 msgr2=0x7f43441990a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:52.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.837+0000 7f434896e640 1 --2- 172.21.15.79:0/3350811638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4344102db0 0x7f43441990a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.837+0000 7f434896e640 1 -- 172.21.15.79:0/3350811638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4344103ba0 msgr2=0x7f4344199cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:52.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.837+0000 7f434896e640 1 --2- 172.21.15.79:0/3350811638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4344103ba0 0x7f4344199cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:52.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.837+0000 7f434896e640 1 -- 172.21.15.79:0/3350811638 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f434419a590 con 0x7f43441023f0 2024-08-20T01:36:52.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.837+0000 7f4343fff640 1 --2- 172.21.15.79:0/3350811638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4344102db0 0x7f43441990a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:36:52.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.838+0000 7f434896e640 1 --2- 172.21.15.79:0/3350811638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43441023f0 0x7f4344198a50 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4334009230 tx=0x7f43340042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:52.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.838+0000 7f4341ffb640 1 -- 172.21.15.79:0/3350811638 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f433403f030 con 0x7f43441023f0 2024-08-20T01:36:52.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.838+0000 7f4341ffb640 1 -- 172.21.15.79:0/3350811638 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4334003c90 con 0x7f43441023f0 2024-08-20T01:36:52.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.838+0000 7f4341ffb640 1 -- 172.21.15.79:0/3350811638 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4334035070 con 0x7f43441023f0 2024-08-20T01:36:52.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.838+0000 7f434abd2640 1 -- 172.21.15.79:0/3350811638 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f434419a820 con 0x7f43441023f0 2024-08-20T01:36:52.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.838+0000 7f434abd2640 1 -- 172.21.15.79:0/3350811638 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43441a0f50 con 0x7f43441023f0 2024-08-20T01:36:52.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.839+0000 7f434abd2640 1 -- 172.21.15.79:0/3350811638 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4344102870 con 0x7f43441023f0 2024-08-20T01:36:52.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.840+0000 7f4341ffb640 1 -- 172.21.15.79:0/3350811638 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f4334042030 con 0x7f43441023f0 2024-08-20T01:36:52.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.841+0000 7f4341ffb640 1 --2- 172.21.15.79:0/3350811638 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f43300b3c50 0x7f43300b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:52.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.841+0000 7f4343fff640 1 --2- 172.21.15.79:0/3350811638 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f43300b3c50 0x7f43300b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:52.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.841+0000 7f4341ffb640 1 -- 172.21.15.79:0/3350811638 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f4334104800 con 0x7f43441023f0 2024-08-20T01:36:52.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.841+0000 7f4343fff640 1 --2- 172.21.15.79:0/3350811638 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f43300b3c50 0x7f43300b6110 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f432c0058c0 tx=0x7f432c005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:52.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:52.844+0000 7f4341ffb640 1 -- 172.21.15.79:0/3350811638 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f43340cbe60 con 0x7f43441023f0 2024-08-20T01:36:53.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.015+0000 7f434abd2640 1 -- 172.21.15.79:0/3350811638 --> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f434402e720 con 0x7f43300b3c50 2024-08-20T01:36:53.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.019+0000 7f4341ffb640 1 -- 172.21.15.79:0/3350811638 <== mgr.14150 v2:172.21.15.79:6800/3038112779 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258869 (secure 0 0 0) 0x7f434402e720 con 0x7f43300b3c50 2024-08-20T01:36:53.023 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:36:53.025 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-08-20T01:36:53.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.022+0000 7f434abd2640 1 -- 172.21.15.79:0/3350811638 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f43300b3c50 msgr2=0x7f43300b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:53.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.022+0000 7f434abd2640 1 --2- 172.21.15.79:0/3350811638 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f43300b3c50 0x7f43300b6110 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f432c0058c0 tx=0x7f432c005ec0 comp rx=0 tx=0).stop 2024-08-20T01:36:53.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.022+0000 7f434abd2640 1 -- 172.21.15.79:0/3350811638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43441023f0 msgr2=0x7f4344198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:53.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.022+0000 7f434abd2640 1 --2- 172.21.15.79:0/3350811638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43441023f0 0x7f4344198a50 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4334009230 tx=0x7f43340042f0 comp rx=0 tx=0).stop 2024-08-20T01:36:53.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.022+0000 7f434abd2640 1 -- 172.21.15.79:0/3350811638 shutdown_connections 2024-08-20T01:36:53.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.022+0000 7f434abd2640 1 --2- 172.21.15.79:0/3350811638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4344103ba0 0x7f4344199cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:53.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.022+0000 7f434abd2640 1 --2- 172.21.15.79:0/3350811638 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f43300b3c50 0x7f43300b6110 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:53.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.022+0000 7f434abd2640 1 --2- 172.21.15.79:0/3350811638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4344102db0 0x7f43441990a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:53.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.022+0000 7f434abd2640 1 --2- 172.21.15.79:0/3350811638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43441023f0 0x7f4344198a50 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:53.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.022+0000 7f434abd2640 1 -- 172.21.15.79:0/3350811638 >> 172.21.15.79:0/3350811638 conn(0x7f43440fdf40 msgr2=0x7f4344106be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:53.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.023+0000 7f434abd2640 1 -- 172.21.15.79:0/3350811638 shutdown_connections 2024-08-20T01:36:53.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.023+0000 7f434abd2640 1 -- 172.21.15.79:0/3350811638 wait complete. 2024-08-20T01:36:53.035 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":334,"stamp":"2024-08-20T01:36:52.496959+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659500,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1151,"num_read_kb":675,"num_write":386,"num_write_kb":2300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2951952,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":817,"ondisk_log_size":817,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365132,"kb_used_data":11724,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576692,"statfs":{"total":1151940427776,"available":1151566532608,"internally_reserved":0,"allocated":12005376,"data_stored":6692172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":361674043},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2465,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":60,"num_write":16,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002868"},"pg_stats":[{"pgid":"3.3f","version":"74'8","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.723367+0000","last_change":"2024-08-20T01:34:54.368243+0000","last_active":"2024-08-20T01:36:22.723367+0000","last_peered":"2024-08-20T01:36:22.723367+0000","last_clean":"2024-08-20T01:36:22.723367+0000","last_became_active":"2024-08-20T01:34:54.367712+0000","last_became_peered":"2024-08-20T01:34:54.367712+0000","last_unstale":"2024-08-20T01:36:22.723367+0000","last_undegraded":"2024-08-20T01:36:22.723367+0000","last_fullsized":"2024-08-20T01:36:22.723367+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:48:31.179090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"74'4","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.709603+0000","last_change":"2024-08-20T01:34:54.371126+0000","last_active":"2024-08-20T01:36:22.709603+0000","last_peered":"2024-08-20T01:36:22.709603+0000","last_clean":"2024-08-20T01:36:22.709603+0000","last_became_active":"2024-08-20T01:34:54.370821+0000","last_became_peered":"2024-08-20T01:34:54.370821+0000","last_unstale":"2024-08-20T01:36:22.709603+0000","last_undegraded":"2024-08-20T01:36:22.709603+0000","last_fullsized":"2024-08-20T01:36:22.709603+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:37:41.175264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"74'7","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.719479+0000","last_change":"2024-08-20T01:34:54.373051+0000","last_active":"2024-08-20T01:36:22.719479+0000","last_peered":"2024-08-20T01:36:22.719479+0000","last_clean":"2024-08-20T01:36:22.719479+0000","last_became_active":"2024-08-20T01:34:54.372783+0000","last_became_peered":"2024-08-20T01:34:54.372783+0000","last_unstale":"2024-08-20T01:36:22.719479+0000","last_undegraded":"2024-08-20T01:36:22.719479+0000","last_fullsized":"2024-08-20T01:36:22.719479+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:12:49.630968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"74'8","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.706204+0000","last_change":"2024-08-20T01:34:54.372395+0000","last_active":"2024-08-20T01:36:22.706204+0000","last_peered":"2024-08-20T01:36:22.706204+0000","last_clean":"2024-08-20T01:36:22.706204+0000","last_became_active":"2024-08-20T01:34:54.371804+0000","last_became_peered":"2024-08-20T01:34:54.371804+0000","last_unstale":"2024-08-20T01:36:22.706204+0000","last_undegraded":"2024-08-20T01:36:22.706204+0000","last_fullsized":"2024-08-20T01:36:22.706204+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:01:14.395727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"74'4","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.707351+0000","last_change":"2024-08-20T01:34:54.379200+0000","last_active":"2024-08-20T01:36:22.707351+0000","last_peered":"2024-08-20T01:36:22.707351+0000","last_clean":"2024-08-20T01:36:22.707351+0000","last_became_active":"2024-08-20T01:34:54.378828+0000","last_became_peered":"2024-08-20T01:34:54.378828+0000","last_unstale":"2024-08-20T01:36:22.707351+0000","last_undegraded":"2024-08-20T01:36:22.707351+0000","last_fullsized":"2024-08-20T01:36:22.707351+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:27:09.672074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"74'6","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.713927+0000","last_change":"2024-08-20T01:34:54.377871+0000","last_active":"2024-08-20T01:36:22.713927+0000","last_peered":"2024-08-20T01:36:22.713927+0000","last_clean":"2024-08-20T01:36:22.713927+0000","last_became_active":"2024-08-20T01:34:54.376617+0000","last_became_peered":"2024-08-20T01:34:54.376617+0000","last_unstale":"2024-08-20T01:36:22.713927+0000","last_undegraded":"2024-08-20T01:36:22.713927+0000","last_fullsized":"2024-08-20T01:36:22.713927+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:17:09.740135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"74'5","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.715604+0000","last_change":"2024-08-20T01:34:54.373761+0000","last_active":"2024-08-20T01:36:22.715604+0000","last_peered":"2024-08-20T01:36:22.715604+0000","last_clean":"2024-08-20T01:36:22.715604+0000","last_became_active":"2024-08-20T01:34:54.372944+0000","last_became_peered":"2024-08-20T01:34:54.372944+0000","last_unstale":"2024-08-20T01:36:22.715604+0000","last_undegraded":"2024-08-20T01:36:22.715604+0000","last_fullsized":"2024-08-20T01:36:22.715604+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:21:44.477970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"74'9","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.710177+0000","last_change":"2024-08-20T01:35:53.799340+0000","last_active":"2024-08-20T01:36:22.710177+0000","last_peered":"2024-08-20T01:36:22.710177+0000","last_clean":"2024-08-20T01:36:22.710177+0000","last_became_active":"2024-08-20T01:35:53.799002+0000","last_became_peered":"2024-08-20T01:35:53.799002+0000","last_unstale":"2024-08-20T01:36:22.710177+0000","last_undegraded":"2024-08-20T01:36:22.710177+0000","last_fullsized":"2024-08-20T01:36:22.710177+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:42:42.446756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"74'11","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.721041+0000","last_change":"2024-08-20T01:34:54.378350+0000","last_active":"2024-08-20T01:36:22.721041+0000","last_peered":"2024-08-20T01:36:22.721041+0000","last_clean":"2024-08-20T01:36:22.721041+0000","last_became_active":"2024-08-20T01:34:54.376524+0000","last_became_peered":"2024-08-20T01:34:54.376524+0000","last_unstale":"2024-08-20T01:36:22.721041+0000","last_undegraded":"2024-08-20T01:36:22.721041+0000","last_fullsized":"2024-08-20T01:36:22.721041+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:50:03.179130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"74'16","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.716257+0000","last_change":"2024-08-20T01:34:54.376098+0000","last_active":"2024-08-20T01:36:22.716257+0000","last_peered":"2024-08-20T01:36:22.716257+0000","last_clean":"2024-08-20T01:36:22.716257+0000","last_became_active":"2024-08-20T01:34:54.375671+0000","last_became_peered":"2024-08-20T01:34:54.375671+0000","last_unstale":"2024-08-20T01:36:22.716257+0000","last_undegraded":"2024-08-20T01:36:22.716257+0000","last_fullsized":"2024-08-20T01:36:22.716257+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:43:14.876302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"74'6","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.723368+0000","last_change":"2024-08-20T01:34:54.374431+0000","last_active":"2024-08-20T01:36:22.723368+0000","last_peered":"2024-08-20T01:36:22.723368+0000","last_clean":"2024-08-20T01:36:22.723368+0000","last_became_active":"2024-08-20T01:34:54.374082+0000","last_became_peered":"2024-08-20T01:34:54.374082+0000","last_unstale":"2024-08-20T01:36:22.723368+0000","last_undegraded":"2024-08-20T01:36:22.723368+0000","last_fullsized":"2024-08-20T01:36:22.723368+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:11:10.046245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"74'7","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.705064+0000","last_change":"2024-08-20T01:34:54.372124+0000","last_active":"2024-08-20T01:36:22.705064+0000","last_peered":"2024-08-20T01:36:22.705064+0000","last_clean":"2024-08-20T01:36:22.705064+0000","last_became_active":"2024-08-20T01:34:54.371382+0000","last_became_peered":"2024-08-20T01:34:54.371382+0000","last_unstale":"2024-08-20T01:36:22.705064+0000","last_undegraded":"2024-08-20T01:36:22.705064+0000","last_fullsized":"2024-08-20T01:36:22.705064+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:29:38.715445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"74'10","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.691522+0000","last_change":"2024-08-20T01:34:54.372760+0000","last_active":"2024-08-20T01:36:22.691522+0000","last_peered":"2024-08-20T01:36:22.691522+0000","last_clean":"2024-08-20T01:36:22.691522+0000","last_became_active":"2024-08-20T01:34:54.372386+0000","last_became_peered":"2024-08-20T01:34:54.372386+0000","last_unstale":"2024-08-20T01:36:22.691522+0000","last_undegraded":"2024-08-20T01:36:22.691522+0000","last_fullsized":"2024-08-20T01:36:22.691522+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:30:32.873604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"74'7","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.710969+0000","last_change":"2024-08-20T01:34:54.371164+0000","last_active":"2024-08-20T01:36:22.710969+0000","last_peered":"2024-08-20T01:36:22.710969+0000","last_clean":"2024-08-20T01:36:22.710969+0000","last_became_active":"2024-08-20T01:34:54.370856+0000","last_became_peered":"2024-08-20T01:34:54.370856+0000","last_unstale":"2024-08-20T01:36:22.710969+0000","last_undegraded":"2024-08-20T01:36:22.710969+0000","last_fullsized":"2024-08-20T01:36:22.710969+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:14:26.803902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"74'7","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.712712+0000","last_change":"2024-08-20T01:34:54.369595+0000","last_active":"2024-08-20T01:36:22.712712+0000","last_peered":"2024-08-20T01:36:22.712712+0000","last_clean":"2024-08-20T01:36:22.712712+0000","last_became_active":"2024-08-20T01:34:54.369285+0000","last_became_peered":"2024-08-20T01:34:54.369285+0000","last_unstale":"2024-08-20T01:36:22.712712+0000","last_undegraded":"2024-08-20T01:36:22.712712+0000","last_fullsized":"2024-08-20T01:36:22.712712+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:53:16.965300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"74'9","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.721473+0000","last_change":"2024-08-20T01:34:54.366903+0000","last_active":"2024-08-20T01:36:22.721473+0000","last_peered":"2024-08-20T01:36:22.721473+0000","last_clean":"2024-08-20T01:36:22.721473+0000","last_became_active":"2024-08-20T01:34:54.366533+0000","last_became_peered":"2024-08-20T01:34:54.366533+0000","last_unstale":"2024-08-20T01:36:22.721473+0000","last_undegraded":"2024-08-20T01:36:22.721473+0000","last_fullsized":"2024-08-20T01:36:22.721473+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:11:23.025718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"74'8","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.723477+0000","last_change":"2024-08-20T01:34:54.368616+0000","last_active":"2024-08-20T01:36:22.723477+0000","last_peered":"2024-08-20T01:36:22.723477+0000","last_clean":"2024-08-20T01:36:22.723477+0000","last_became_active":"2024-08-20T01:34:54.368267+0000","last_became_peered":"2024-08-20T01:34:54.368267+0000","last_unstale":"2024-08-20T01:36:22.723477+0000","last_undegraded":"2024-08-20T01:36:22.723477+0000","last_fullsized":"2024-08-20T01:36:22.723477+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:53:09.035458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"74'10","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.711163+0000","last_change":"2024-08-20T01:34:54.369182+0000","last_active":"2024-08-20T01:36:22.711163+0000","last_peered":"2024-08-20T01:36:22.711163+0000","last_clean":"2024-08-20T01:36:22.711163+0000","last_became_active":"2024-08-20T01:34:54.368862+0000","last_became_peered":"2024-08-20T01:34:54.368862+0000","last_unstale":"2024-08-20T01:36:22.711163+0000","last_undegraded":"2024-08-20T01:36:22.711163+0000","last_fullsized":"2024-08-20T01:36:22.711163+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:31:16.013266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"74'7","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.707703+0000","last_change":"2024-08-20T01:34:54.368132+0000","last_active":"2024-08-20T01:36:22.707703+0000","last_peered":"2024-08-20T01:36:22.707703+0000","last_clean":"2024-08-20T01:36:22.707703+0000","last_became_active":"2024-08-20T01:34:54.366295+0000","last_became_peered":"2024-08-20T01:34:54.366295+0000","last_unstale":"2024-08-20T01:36:22.707703+0000","last_undegraded":"2024-08-20T01:36:22.707703+0000","last_fullsized":"2024-08-20T01:36:22.707703+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:52:23.928602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"74'8","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.709841+0000","last_change":"2024-08-20T01:35:53.785719+0000","last_active":"2024-08-20T01:36:22.709841+0000","last_peered":"2024-08-20T01:36:22.709841+0000","last_clean":"2024-08-20T01:36:22.709841+0000","last_became_active":"2024-08-20T01:35:53.785072+0000","last_became_peered":"2024-08-20T01:35:53.785072+0000","last_unstale":"2024-08-20T01:36:22.709841+0000","last_undegraded":"2024-08-20T01:36:22.709841+0000","last_fullsized":"2024-08-20T01:36:22.709841+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:52:22.034855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"74'11","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.698034+0000","last_change":"2024-08-20T01:34:54.366206+0000","last_active":"2024-08-20T01:36:22.698034+0000","last_peered":"2024-08-20T01:36:22.698034+0000","last_clean":"2024-08-20T01:36:22.698034+0000","last_became_active":"2024-08-20T01:34:54.365893+0000","last_became_peered":"2024-08-20T01:34:54.365893+0000","last_unstale":"2024-08-20T01:36:22.698034+0000","last_undegraded":"2024-08-20T01:36:22.698034+0000","last_fullsized":"2024-08-20T01:36:22.698034+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:39:22.610570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"74'10","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.722253+0000","last_change":"2024-08-20T01:34:54.368091+0000","last_active":"2024-08-20T01:36:22.722253+0000","last_peered":"2024-08-20T01:36:22.722253+0000","last_clean":"2024-08-20T01:36:22.722253+0000","last_became_active":"2024-08-20T01:34:54.367626+0000","last_became_peered":"2024-08-20T01:34:54.367626+0000","last_unstale":"2024-08-20T01:36:22.722253+0000","last_undegraded":"2024-08-20T01:36:22.722253+0000","last_fullsized":"2024-08-20T01:36:22.722253+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:52:34.157094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"74'8","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.709450+0000","last_change":"2024-08-20T01:34:54.370976+0000","last_active":"2024-08-20T01:36:22.709450+0000","last_peered":"2024-08-20T01:36:22.709450+0000","last_clean":"2024-08-20T01:36:22.709450+0000","last_became_active":"2024-08-20T01:34:54.368349+0000","last_became_peered":"2024-08-20T01:34:54.368349+0000","last_unstale":"2024-08-20T01:36:22.709450+0000","last_undegraded":"2024-08-20T01:36:22.709450+0000","last_fullsized":"2024-08-20T01:36:22.709450+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:53:48.846072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"74'6","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.709768+0000","last_change":"2024-08-20T01:34:54.379148+0000","last_active":"2024-08-20T01:36:22.709768+0000","last_peered":"2024-08-20T01:36:22.709768+0000","last_clean":"2024-08-20T01:36:22.709768+0000","last_became_active":"2024-08-20T01:34:54.378800+0000","last_became_peered":"2024-08-20T01:34:54.378800+0000","last_unstale":"2024-08-20T01:36:22.709768+0000","last_undegraded":"2024-08-20T01:36:22.709768+0000","last_fullsized":"2024-08-20T01:36:22.709768+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:42:47.382372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"74'2","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.705849+0000","last_change":"2024-08-20T01:34:54.376972+0000","last_active":"2024-08-20T01:36:22.705849+0000","last_peered":"2024-08-20T01:36:22.705849+0000","last_clean":"2024-08-20T01:36:22.705849+0000","last_became_active":"2024-08-20T01:34:54.376701+0000","last_became_peered":"2024-08-20T01:34:54.376701+0000","last_unstale":"2024-08-20T01:36:22.705849+0000","last_undegraded":"2024-08-20T01:36:22.705849+0000","last_fullsized":"2024-08-20T01:36:22.705849+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:19:12.897732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"74'15","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.712436+0000","last_change":"2024-08-20T01:34:54.372699+0000","last_active":"2024-08-20T01:36:22.712436+0000","last_peered":"2024-08-20T01:36:22.712436+0000","last_clean":"2024-08-20T01:36:22.712436+0000","last_became_active":"2024-08-20T01:34:54.371170+0000","last_became_peered":"2024-08-20T01:34:54.371170+0000","last_unstale":"2024-08-20T01:36:22.712436+0000","last_undegraded":"2024-08-20T01:36:22.712436+0000","last_fullsized":"2024-08-20T01:36:22.712436+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:18:00.373087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"74'6","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.708851+0000","last_change":"2024-08-20T01:34:54.373726+0000","last_active":"2024-08-20T01:36:22.708851+0000","last_peered":"2024-08-20T01:36:22.708851+0000","last_clean":"2024-08-20T01:36:22.708851+0000","last_became_active":"2024-08-20T01:34:54.373418+0000","last_became_peered":"2024-08-20T01:34:54.373418+0000","last_unstale":"2024-08-20T01:36:22.708851+0000","last_undegraded":"2024-08-20T01:36:22.708851+0000","last_fullsized":"2024-08-20T01:36:22.708851+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:55:28.791396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"74'4","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.690715+0000","last_change":"2024-08-20T01:34:54.371779+0000","last_active":"2024-08-20T01:36:22.690715+0000","last_peered":"2024-08-20T01:36:22.690715+0000","last_clean":"2024-08-20T01:36:22.690715+0000","last_became_active":"2024-08-20T01:34:54.370449+0000","last_became_peered":"2024-08-20T01:34:54.370449+0000","last_unstale":"2024-08-20T01:36:22.690715+0000","last_undegraded":"2024-08-20T01:36:22.690715+0000","last_fullsized":"2024-08-20T01:36:22.690715+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:03:22.153120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"74'7","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.710052+0000","last_change":"2024-08-20T01:35:53.785757+0000","last_active":"2024-08-20T01:36:22.710052+0000","last_peered":"2024-08-20T01:36:22.710052+0000","last_clean":"2024-08-20T01:36:22.710052+0000","last_became_active":"2024-08-20T01:35:53.784991+0000","last_became_peered":"2024-08-20T01:35:53.784991+0000","last_unstale":"2024-08-20T01:36:22.710052+0000","last_undegraded":"2024-08-20T01:36:22.710052+0000","last_fullsized":"2024-08-20T01:36:22.710052+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:46:28.442935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"74'8","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.711359+0000","last_change":"2024-08-20T01:34:54.369948+0000","last_active":"2024-08-20T01:36:22.711359+0000","last_peered":"2024-08-20T01:36:22.711359+0000","last_clean":"2024-08-20T01:36:22.711359+0000","last_became_active":"2024-08-20T01:34:54.367453+0000","last_became_peered":"2024-08-20T01:34:54.367453+0000","last_unstale":"2024-08-20T01:36:22.711359+0000","last_undegraded":"2024-08-20T01:36:22.711359+0000","last_fullsized":"2024-08-20T01:36:22.711359+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:09:38.800219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"74'12","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.712332+0000","last_change":"2024-08-20T01:34:54.373622+0000","last_active":"2024-08-20T01:36:22.712332+0000","last_peered":"2024-08-20T01:36:22.712332+0000","last_clean":"2024-08-20T01:36:22.712332+0000","last_became_active":"2024-08-20T01:34:54.373261+0000","last_became_peered":"2024-08-20T01:34:54.373261+0000","last_unstale":"2024-08-20T01:36:22.712332+0000","last_undegraded":"2024-08-20T01:36:22.712332+0000","last_fullsized":"2024-08-20T01:36:22.712332+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:21:03.471668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"74'9","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.710320+0000","last_change":"2024-08-20T01:34:54.374728+0000","last_active":"2024-08-20T01:36:22.710320+0000","last_peered":"2024-08-20T01:36:22.710320+0000","last_clean":"2024-08-20T01:36:22.710320+0000","last_became_active":"2024-08-20T01:34:54.374183+0000","last_became_peered":"2024-08-20T01:34:54.374183+0000","last_unstale":"2024-08-20T01:36:22.710320+0000","last_undegraded":"2024-08-20T01:36:22.710320+0000","last_fullsized":"2024-08-20T01:36:22.710320+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:39:40.203942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"74'7","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.707022+0000","last_change":"2024-08-20T01:34:54.372863+0000","last_active":"2024-08-20T01:36:22.707022+0000","last_peered":"2024-08-20T01:36:22.707022+0000","last_clean":"2024-08-20T01:36:22.707022+0000","last_became_active":"2024-08-20T01:34:54.372409+0000","last_became_peered":"2024-08-20T01:34:54.372409+0000","last_unstale":"2024-08-20T01:36:22.707022+0000","last_undegraded":"2024-08-20T01:36:22.707022+0000","last_fullsized":"2024-08-20T01:36:22.707022+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:22:51.676677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"74'6","reported_seq":134,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:46.593176+0000","last_change":"2024-08-20T01:34:52.343440+0000","last_active":"2024-08-20T01:36:46.593176+0000","last_peered":"2024-08-20T01:36:46.593176+0000","last_clean":"2024-08-20T01:36:46.593176+0000","last_became_active":"2024-08-20T01:34:52.343110+0000","last_became_peered":"2024-08-20T01:34:52.343110+0000","last_unstale":"2024-08-20T01:36:46.593176+0000","last_undegraded":"2024-08-20T01:36:46.593176+0000","last_fullsized":"2024-08-20T01:36:46.593176+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:46:51.406198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1115,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"74'8","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.713479+0000","last_change":"2024-08-20T01:34:54.379522+0000","last_active":"2024-08-20T01:36:22.713479+0000","last_peered":"2024-08-20T01:36:22.713479+0000","last_clean":"2024-08-20T01:36:22.713479+0000","last_became_active":"2024-08-20T01:34:54.378826+0000","last_became_peered":"2024-08-20T01:34:54.378826+0000","last_unstale":"2024-08-20T01:36:22.713479+0000","last_undegraded":"2024-08-20T01:36:22.713479+0000","last_fullsized":"2024-08-20T01:36:22.713479+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:49:59.985231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"72'7","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796989+0000","last_change":"2024-08-20T01:34:52.344483+0000","last_active":"2024-08-20T01:35:53.796989+0000","last_peered":"2024-08-20T01:35:53.796989+0000","last_clean":"2024-08-20T01:35:53.796989+0000","last_became_active":"2024-08-20T01:34:52.343940+0000","last_became_peered":"2024-08-20T01:34:52.343940+0000","last_unstale":"2024-08-20T01:35:53.796989+0000","last_undegraded":"2024-08-20T01:35:53.796989+0000","last_fullsized":"2024-08-20T01:35:53.796989+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:19:53.480527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"72'3","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.777959+0000","last_change":"2024-08-20T01:34:52.340732+0000","last_active":"2024-08-20T01:35:53.777959+0000","last_peered":"2024-08-20T01:35:53.777959+0000","last_clean":"2024-08-20T01:35:53.777959+0000","last_became_active":"2024-08-20T01:34:52.340367+0000","last_became_peered":"2024-08-20T01:34:52.340367+0000","last_unstale":"2024-08-20T01:35:53.777959+0000","last_undegraded":"2024-08-20T01:35:53.777959+0000","last_fullsized":"2024-08-20T01:35:53.777959+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:33:17.751642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"74'8","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.709157+0000","last_change":"2024-08-20T01:34:54.370725+0000","last_active":"2024-08-20T01:36:22.709157+0000","last_peered":"2024-08-20T01:36:22.709157+0000","last_clean":"2024-08-20T01:36:22.709157+0000","last_became_active":"2024-08-20T01:34:54.370423+0000","last_became_peered":"2024-08-20T01:34:54.370423+0000","last_unstale":"2024-08-20T01:36:22.709157+0000","last_undegraded":"2024-08-20T01:36:22.709157+0000","last_fullsized":"2024-08-20T01:36:22.709157+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:03:30.081748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"72'3","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.783141+0000","last_change":"2024-08-20T01:34:52.348605+0000","last_active":"2024-08-20T01:35:53.783141+0000","last_peered":"2024-08-20T01:35:53.783141+0000","last_clean":"2024-08-20T01:35:53.783141+0000","last_became_active":"2024-08-20T01:34:52.348278+0000","last_became_peered":"2024-08-20T01:34:52.348278+0000","last_unstale":"2024-08-20T01:35:53.783141+0000","last_undegraded":"2024-08-20T01:35:53.783141+0000","last_fullsized":"2024-08-20T01:35:53.783141+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:19:40.243243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"74'11","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.708919+0000","last_change":"2024-08-20T01:34:54.365604+0000","last_active":"2024-08-20T01:36:22.708919+0000","last_peered":"2024-08-20T01:36:22.708919+0000","last_clean":"2024-08-20T01:36:22.708919+0000","last_became_active":"2024-08-20T01:34:54.365284+0000","last_became_peered":"2024-08-20T01:34:54.365284+0000","last_unstale":"2024-08-20T01:36:22.708919+0000","last_undegraded":"2024-08-20T01:36:22.708919+0000","last_fullsized":"2024-08-20T01:36:22.708919+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:41:57.017680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'6","reported_seq":233,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:47.593893+0000","last_change":"2024-08-20T01:34:52.344679+0000","last_active":"2024-08-20T01:36:47.593893+0000","last_peered":"2024-08-20T01:36:47.593893+0000","last_clean":"2024-08-20T01:36:47.593893+0000","last_became_active":"2024-08-20T01:34:52.344058+0000","last_became_peered":"2024-08-20T01:34:52.344058+0000","last_unstale":"2024-08-20T01:36:47.593893+0000","last_undegraded":"2024-08-20T01:36:47.593893+0000","last_fullsized":"2024-08-20T01:36:47.593893+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:27:40.079949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":204,"num_read_kb":204,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"74'10","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.720099+0000","last_change":"2024-08-20T01:34:54.369724+0000","last_active":"2024-08-20T01:36:22.720099+0000","last_peered":"2024-08-20T01:36:22.720099+0000","last_clean":"2024-08-20T01:36:22.720099+0000","last_became_active":"2024-08-20T01:34:54.369403+0000","last_became_peered":"2024-08-20T01:34:54.369403+0000","last_unstale":"2024-08-20T01:36:22.720099+0000","last_undegraded":"2024-08-20T01:36:22.720099+0000","last_fullsized":"2024-08-20T01:36:22.720099+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:31:22.382794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"72'4","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779736+0000","last_change":"2024-08-20T01:34:52.346651+0000","last_active":"2024-08-20T01:35:53.779736+0000","last_peered":"2024-08-20T01:35:53.779736+0000","last_clean":"2024-08-20T01:35:53.779736+0000","last_became_active":"2024-08-20T01:34:52.346316+0000","last_became_peered":"2024-08-20T01:34:52.346316+0000","last_unstale":"2024-08-20T01:35:53.779736+0000","last_undegraded":"2024-08-20T01:35:53.779736+0000","last_fullsized":"2024-08-20T01:35:53.779736+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:48:34.382413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"74'9","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.712452+0000","last_change":"2024-08-20T01:34:54.375587+0000","last_active":"2024-08-20T01:36:22.712452+0000","last_peered":"2024-08-20T01:36:22.712452+0000","last_clean":"2024-08-20T01:36:22.712452+0000","last_became_active":"2024-08-20T01:34:54.374138+0000","last_became_peered":"2024-08-20T01:34:54.374138+0000","last_unstale":"2024-08-20T01:36:22.712452+0000","last_undegraded":"2024-08-20T01:36:22.712452+0000","last_fullsized":"2024-08-20T01:36:22.712452+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:02:46.817849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"72'5","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.784242+0000","last_change":"2024-08-20T01:34:52.559659+0000","last_active":"2024-08-20T01:35:53.784242+0000","last_peered":"2024-08-20T01:35:53.784242+0000","last_clean":"2024-08-20T01:35:53.784242+0000","last_became_active":"2024-08-20T01:34:52.559243+0000","last_became_peered":"2024-08-20T01:34:52.559243+0000","last_unstale":"2024-08-20T01:35:53.784242+0000","last_undegraded":"2024-08-20T01:35:53.784242+0000","last_fullsized":"2024-08-20T01:35:53.784242+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:49:02.314230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"74'11","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.722877+0000","last_change":"2024-08-20T01:34:54.372965+0000","last_active":"2024-08-20T01:36:22.722877+0000","last_peered":"2024-08-20T01:36:22.722877+0000","last_clean":"2024-08-20T01:36:22.722877+0000","last_became_active":"2024-08-20T01:34:54.372286+0000","last_became_peered":"2024-08-20T01:34:54.372286+0000","last_unstale":"2024-08-20T01:36:22.722877+0000","last_undegraded":"2024-08-20T01:36:22.722877+0000","last_fullsized":"2024-08-20T01:36:22.722877+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:32:45.178137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"74'35","reported_seq":273,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:47.615183+0000","last_change":"2024-08-20T01:34:52.348907+0000","last_active":"2024-08-20T01:36:47.615183+0000","last_peered":"2024-08-20T01:36:47.615183+0000","last_clean":"2024-08-20T01:36:47.615183+0000","last_became_active":"2024-08-20T01:34:52.347853+0000","last_became_peered":"2024-08-20T01:34:52.347853+0000","last_unstale":"2024-08-20T01:36:47.615183+0000","last_undegraded":"2024-08-20T01:36:47.615183+0000","last_fullsized":"2024-08-20T01:36:47.615183+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:19:31.142154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60504,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":215,"num_read_kb":166,"num_write":37,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"74'6","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.708224+0000","last_change":"2024-08-20T01:34:54.376493+0000","last_active":"2024-08-20T01:36:22.708224+0000","last_peered":"2024-08-20T01:36:22.708224+0000","last_clean":"2024-08-20T01:36:22.708224+0000","last_became_active":"2024-08-20T01:34:54.376160+0000","last_became_peered":"2024-08-20T01:34:54.376160+0000","last_unstale":"2024-08-20T01:36:22.708224+0000","last_undegraded":"2024-08-20T01:36:22.708224+0000","last_fullsized":"2024-08-20T01:36:22.708224+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:59:03.431731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"72'9","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796753+0000","last_change":"2024-08-20T01:34:52.347516+0000","last_active":"2024-08-20T01:35:53.796753+0000","last_peered":"2024-08-20T01:35:53.796753+0000","last_clean":"2024-08-20T01:35:53.796753+0000","last_became_active":"2024-08-20T01:34:52.347134+0000","last_became_peered":"2024-08-20T01:34:52.347134+0000","last_unstale":"2024-08-20T01:35:53.796753+0000","last_undegraded":"2024-08-20T01:35:53.796753+0000","last_fullsized":"2024-08-20T01:35:53.796753+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:26:16.057472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"74'9","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.704726+0000","last_change":"2024-08-20T01:34:54.368083+0000","last_active":"2024-08-20T01:36:22.704726+0000","last_peered":"2024-08-20T01:36:22.704726+0000","last_clean":"2024-08-20T01:36:22.704726+0000","last_became_active":"2024-08-20T01:34:54.367815+0000","last_became_peered":"2024-08-20T01:34:54.367815+0000","last_unstale":"2024-08-20T01:36:22.704726+0000","last_undegraded":"2024-08-20T01:36:22.704726+0000","last_fullsized":"2024-08-20T01:36:22.704726+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:02:13.515114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"72'5","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.783037+0000","last_change":"2024-08-20T01:34:52.345104+0000","last_active":"2024-08-20T01:35:53.783037+0000","last_peered":"2024-08-20T01:35:53.783037+0000","last_clean":"2024-08-20T01:35:53.783037+0000","last_became_active":"2024-08-20T01:34:52.344776+0000","last_became_peered":"2024-08-20T01:34:52.344776+0000","last_unstale":"2024-08-20T01:35:53.783037+0000","last_undegraded":"2024-08-20T01:35:53.783037+0000","last_fullsized":"2024-08-20T01:35:53.783037+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:05:30.230328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"74'15","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.714654+0000","last_change":"2024-08-20T01:34:54.369341+0000","last_active":"2024-08-20T01:36:22.714654+0000","last_peered":"2024-08-20T01:36:22.714654+0000","last_clean":"2024-08-20T01:36:22.714654+0000","last_became_active":"2024-08-20T01:34:54.369040+0000","last_became_peered":"2024-08-20T01:34:54.369040+0000","last_unstale":"2024-08-20T01:36:22.714654+0000","last_undegraded":"2024-08-20T01:36:22.714654+0000","last_fullsized":"2024-08-20T01:36:22.714654+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:20:07.403778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"74'6","reported_seq":136,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:48.579109+0000","last_change":"2024-08-20T01:34:52.346787+0000","last_active":"2024-08-20T01:36:48.579109+0000","last_peered":"2024-08-20T01:36:48.579109+0000","last_clean":"2024-08-20T01:36:48.579109+0000","last_became_active":"2024-08-20T01:34:52.345713+0000","last_became_peered":"2024-08-20T01:34:52.345713+0000","last_unstale":"2024-08-20T01:36:48.579109+0000","last_undegraded":"2024-08-20T01:36:48.579109+0000","last_fullsized":"2024-08-20T01:36:48.579109+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:33:06.861899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"74'6","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.715128+0000","last_change":"2024-08-20T01:34:54.374153+0000","last_active":"2024-08-20T01:36:22.715128+0000","last_peered":"2024-08-20T01:36:22.715128+0000","last_clean":"2024-08-20T01:36:22.715128+0000","last_became_active":"2024-08-20T01:34:54.372804+0000","last_became_peered":"2024-08-20T01:34:54.372804+0000","last_unstale":"2024-08-20T01:36:22.715128+0000","last_undegraded":"2024-08-20T01:36:22.715128+0000","last_fullsized":"2024-08-20T01:36:22.715128+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:54:27.470643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"72'17","reported_seq":41,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.782185+0000","last_change":"2024-08-20T01:34:52.559701+0000","last_active":"2024-08-20T01:35:53.782185+0000","last_peered":"2024-08-20T01:35:53.782185+0000","last_clean":"2024-08-20T01:35:53.782185+0000","last_became_active":"2024-08-20T01:34:52.559378+0000","last_became_peered":"2024-08-20T01:34:52.559378+0000","last_unstale":"2024-08-20T01:35:53.782185+0000","last_undegraded":"2024-08-20T01:35:53.782185+0000","last_fullsized":"2024-08-20T01:35:53.782185+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:39:55.636492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"74'6","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.710710+0000","last_change":"2024-08-20T01:35:53.798283+0000","last_active":"2024-08-20T01:36:22.710710+0000","last_peered":"2024-08-20T01:36:22.710710+0000","last_clean":"2024-08-20T01:36:22.710710+0000","last_became_active":"2024-08-20T01:35:53.797903+0000","last_became_peered":"2024-08-20T01:35:53.797903+0000","last_unstale":"2024-08-20T01:36:22.710710+0000","last_undegraded":"2024-08-20T01:36:22.710710+0000","last_fullsized":"2024-08-20T01:36:22.710710+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:22:27.676567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"74'3","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.784736+0000","last_change":"2024-08-20T01:34:52.347574+0000","last_active":"2024-08-20T01:35:53.784736+0000","last_peered":"2024-08-20T01:35:53.784736+0000","last_clean":"2024-08-20T01:35:53.784736+0000","last_became_active":"2024-08-20T01:34:52.347250+0000","last_became_peered":"2024-08-20T01:34:52.347250+0000","last_unstale":"2024-08-20T01:35:53.784736+0000","last_undegraded":"2024-08-20T01:35:53.784736+0000","last_fullsized":"2024-08-20T01:35:53.784736+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:03:00.007548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"74'5","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.707391+0000","last_change":"2024-08-20T01:34:54.376383+0000","last_active":"2024-08-20T01:36:22.707391+0000","last_peered":"2024-08-20T01:36:22.707391+0000","last_clean":"2024-08-20T01:36:22.707391+0000","last_became_active":"2024-08-20T01:34:54.376044+0000","last_became_peered":"2024-08-20T01:34:54.376044+0000","last_unstale":"2024-08-20T01:36:22.707391+0000","last_undegraded":"2024-08-20T01:36:22.707391+0000","last_fullsized":"2024-08-20T01:36:22.707391+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:31:15.814776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"72'5","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.778440+0000","last_change":"2024-08-20T01:34:52.343441+0000","last_active":"2024-08-20T01:35:53.778440+0000","last_peered":"2024-08-20T01:35:53.778440+0000","last_clean":"2024-08-20T01:35:53.778440+0000","last_became_active":"2024-08-20T01:34:52.343120+0000","last_became_peered":"2024-08-20T01:34:52.343120+0000","last_unstale":"2024-08-20T01:35:53.778440+0000","last_undegraded":"2024-08-20T01:35:53.778440+0000","last_fullsized":"2024-08-20T01:35:53.778440+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:44:11.309626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"74'9","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.712867+0000","last_change":"2024-08-20T01:34:54.368986+0000","last_active":"2024-08-20T01:36:22.712867+0000","last_peered":"2024-08-20T01:36:22.712867+0000","last_clean":"2024-08-20T01:36:22.712867+0000","last_became_active":"2024-08-20T01:34:54.368611+0000","last_became_peered":"2024-08-20T01:34:54.368611+0000","last_unstale":"2024-08-20T01:36:22.712867+0000","last_undegraded":"2024-08-20T01:36:22.712867+0000","last_fullsized":"2024-08-20T01:36:22.712867+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:37:32.433584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"72'3","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.783920+0000","last_change":"2024-08-20T01:34:52.345863+0000","last_active":"2024-08-20T01:35:53.783920+0000","last_peered":"2024-08-20T01:35:53.783920+0000","last_clean":"2024-08-20T01:35:53.783920+0000","last_became_active":"2024-08-20T01:34:52.345555+0000","last_became_peered":"2024-08-20T01:34:52.345555+0000","last_unstale":"2024-08-20T01:35:53.783920+0000","last_undegraded":"2024-08-20T01:35:53.783920+0000","last_fullsized":"2024-08-20T01:35:53.783920+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:46:21.606019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"74'7","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.715436+0000","last_change":"2024-08-20T01:34:54.379699+0000","last_active":"2024-08-20T01:36:22.715436+0000","last_peered":"2024-08-20T01:36:22.715436+0000","last_clean":"2024-08-20T01:36:22.715436+0000","last_became_active":"2024-08-20T01:34:54.379197+0000","last_became_peered":"2024-08-20T01:34:54.379197+0000","last_unstale":"2024-08-20T01:36:22.715436+0000","last_undegraded":"2024-08-20T01:36:22.715436+0000","last_fullsized":"2024-08-20T01:36:22.715436+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:31:15.249200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'6","reported_seq":136,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:48.613522+0000","last_change":"2024-08-20T01:34:52.559520+0000","last_active":"2024-08-20T01:36:48.613522+0000","last_peered":"2024-08-20T01:36:48.613522+0000","last_clean":"2024-08-20T01:36:48.613522+0000","last_became_active":"2024-08-20T01:34:52.559180+0000","last_became_peered":"2024-08-20T01:34:52.559180+0000","last_unstale":"2024-08-20T01:36:48.613522+0000","last_undegraded":"2024-08-20T01:36:48.613522+0000","last_fullsized":"2024-08-20T01:36:48.613522+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:48:35.667441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1663,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"74'7","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.723481+0000","last_change":"2024-08-20T01:34:54.372709+0000","last_active":"2024-08-20T01:36:22.723481+0000","last_peered":"2024-08-20T01:36:22.723481+0000","last_clean":"2024-08-20T01:36:22.723481+0000","last_became_active":"2024-08-20T01:34:54.372277+0000","last_became_peered":"2024-08-20T01:34:54.372277+0000","last_unstale":"2024-08-20T01:36:22.723481+0000","last_undegraded":"2024-08-20T01:36:22.723481+0000","last_fullsized":"2024-08-20T01:36:22.723481+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:26:11.837805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":96,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779536+0000","last_change":"2024-08-20T01:33:44.019475+0000","last_active":"2024-08-20T01:35:53.779536+0000","last_peered":"2024-08-20T01:35:53.779536+0000","last_clean":"2024-08-20T01:35:53.779536+0000","last_became_active":"2024-08-20T01:33:44.013614+0000","last_became_peered":"2024-08-20T01:33:44.013614+0000","last_unstale":"2024-08-20T01:35:53.779536+0000","last_undegraded":"2024-08-20T01:35:53.779536+0000","last_fullsized":"2024-08-20T01:35:53.779536+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:30:31.021505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:30:31.021505+0000","last_clean_scrub_stamp":"2024-08-20T01:30:31.021505+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:41:49.124707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"72'6","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.797689+0000","last_change":"2024-08-20T01:34:52.346409+0000","last_active":"2024-08-20T01:35:53.797689+0000","last_peered":"2024-08-20T01:35:53.797689+0000","last_clean":"2024-08-20T01:35:53.797689+0000","last_became_active":"2024-08-20T01:34:52.345821+0000","last_became_peered":"2024-08-20T01:34:52.345821+0000","last_unstale":"2024-08-20T01:35:53.797689+0000","last_undegraded":"2024-08-20T01:35:53.797689+0000","last_fullsized":"2024-08-20T01:35:53.797689+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:17:11.282558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"74'8","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.714769+0000","last_change":"2024-08-20T01:34:54.374804+0000","last_active":"2024-08-20T01:36:22.714769+0000","last_peered":"2024-08-20T01:36:22.714769+0000","last_clean":"2024-08-20T01:36:22.714769+0000","last_became_active":"2024-08-20T01:34:54.374252+0000","last_became_peered":"2024-08-20T01:34:54.374252+0000","last_unstale":"2024-08-20T01:36:22.714769+0000","last_undegraded":"2024-08-20T01:36:22.714769+0000","last_fullsized":"2024-08-20T01:36:22.714769+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:32:51.703703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"72'4","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.779475+0000","last_change":"2024-08-20T01:34:52.341399+0000","last_active":"2024-08-20T01:35:53.779475+0000","last_peered":"2024-08-20T01:35:53.779475+0000","last_clean":"2024-08-20T01:35:53.779475+0000","last_became_active":"2024-08-20T01:34:52.341034+0000","last_became_peered":"2024-08-20T01:34:52.341034+0000","last_unstale":"2024-08-20T01:35:53.779475+0000","last_undegraded":"2024-08-20T01:35:53.779475+0000","last_fullsized":"2024-08-20T01:35:53.779475+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:10:44.804836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"74'5","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.695649+0000","last_change":"2024-08-20T01:34:54.366567+0000","last_active":"2024-08-20T01:36:22.695649+0000","last_peered":"2024-08-20T01:36:22.695649+0000","last_clean":"2024-08-20T01:36:22.695649+0000","last_became_active":"2024-08-20T01:34:54.366298+0000","last_became_peered":"2024-08-20T01:34:54.366298+0000","last_unstale":"2024-08-20T01:36:22.695649+0000","last_undegraded":"2024-08-20T01:36:22.695649+0000","last_fullsized":"2024-08-20T01:36:22.695649+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:14:26.805902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"74'6","reported_seq":132,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:46.574831+0000","last_change":"2024-08-20T01:34:52.559166+0000","last_active":"2024-08-20T01:36:46.574831+0000","last_peered":"2024-08-20T01:36:46.574831+0000","last_clean":"2024-08-20T01:36:46.574831+0000","last_became_active":"2024-08-20T01:34:52.558652+0000","last_became_peered":"2024-08-20T01:34:52.558652+0000","last_unstale":"2024-08-20T01:36:46.574831+0000","last_undegraded":"2024-08-20T01:36:46.574831+0000","last_fullsized":"2024-08-20T01:36:46.574831+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:45:13.374924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"74'8","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.713738+0000","last_change":"2024-08-20T01:34:54.371193+0000","last_active":"2024-08-20T01:36:22.713738+0000","last_peered":"2024-08-20T01:36:22.713738+0000","last_clean":"2024-08-20T01:36:22.713738+0000","last_became_active":"2024-08-20T01:34:54.370869+0000","last_became_peered":"2024-08-20T01:34:54.370869+0000","last_unstale":"2024-08-20T01:36:22.713738+0000","last_undegraded":"2024-08-20T01:36:22.713738+0000","last_fullsized":"2024-08-20T01:36:22.713738+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:23:36.683049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'6","reported_seq":136,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:49.579864+0000","last_change":"2024-08-20T01:34:52.348815+0000","last_active":"2024-08-20T01:36:49.579864+0000","last_peered":"2024-08-20T01:36:49.579864+0000","last_clean":"2024-08-20T01:36:49.579864+0000","last_became_active":"2024-08-20T01:34:52.348437+0000","last_became_peered":"2024-08-20T01:34:52.348437+0000","last_unstale":"2024-08-20T01:36:49.579864+0000","last_undegraded":"2024-08-20T01:36:49.579864+0000","last_fullsized":"2024-08-20T01:36:49.579864+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:55:15.090721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"74'7","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.713229+0000","last_change":"2024-08-20T01:34:54.376049+0000","last_active":"2024-08-20T01:36:22.713229+0000","last_peered":"2024-08-20T01:36:22.713229+0000","last_clean":"2024-08-20T01:36:22.713229+0000","last_became_active":"2024-08-20T01:34:54.375680+0000","last_became_peered":"2024-08-20T01:34:54.375680+0000","last_unstale":"2024-08-20T01:36:22.713229+0000","last_undegraded":"2024-08-20T01:36:22.713229+0000","last_fullsized":"2024-08-20T01:36:22.713229+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:42:12.499850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"72'1","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.785333+0000","last_change":"2024-08-20T01:35:53.785259+0000","last_active":"2024-08-20T01:35:53.785333+0000","last_peered":"2024-08-20T01:35:53.785333+0000","last_clean":"2024-08-20T01:35:53.785333+0000","last_became_active":"2024-08-20T01:35:53.784842+0000","last_became_peered":"2024-08-20T01:35:53.784842+0000","last_unstale":"2024-08-20T01:35:53.785333+0000","last_undegraded":"2024-08-20T01:35:53.785333+0000","last_fullsized":"2024-08-20T01:35:53.785333+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T01:55:09.411882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"74'5","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.709555+0000","last_change":"2024-08-20T01:34:54.369686+0000","last_active":"2024-08-20T01:36:22.709555+0000","last_peered":"2024-08-20T01:36:22.709555+0000","last_clean":"2024-08-20T01:36:22.709555+0000","last_became_active":"2024-08-20T01:34:54.369343+0000","last_became_peered":"2024-08-20T01:34:54.369343+0000","last_unstale":"2024-08-20T01:36:22.709555+0000","last_undegraded":"2024-08-20T01:36:22.709555+0000","last_fullsized":"2024-08-20T01:36:22.709555+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:00:39.775809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"72'4","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.791703+0000","last_change":"2024-08-20T01:35:53.791290+0000","last_active":"2024-08-20T01:35:53.791703+0000","last_peered":"2024-08-20T01:35:53.791703+0000","last_clean":"2024-08-20T01:35:53.791703+0000","last_became_active":"2024-08-20T01:35:53.783283+0000","last_became_peered":"2024-08-20T01:35:53.783283+0000","last_unstale":"2024-08-20T01:35:53.791703+0000","last_undegraded":"2024-08-20T01:35:53.791703+0000","last_fullsized":"2024-08-20T01:35:53.791703+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:54:40.774394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"74'9","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.696093+0000","last_change":"2024-08-20T01:34:54.376275+0000","last_active":"2024-08-20T01:36:22.696093+0000","last_peered":"2024-08-20T01:36:22.696093+0000","last_clean":"2024-08-20T01:36:22.696093+0000","last_became_active":"2024-08-20T01:34:54.375797+0000","last_became_peered":"2024-08-20T01:34:54.375797+0000","last_unstale":"2024-08-20T01:36:22.696093+0000","last_undegraded":"2024-08-20T01:36:22.696093+0000","last_fullsized":"2024-08-20T01:36:22.696093+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:01:37.172855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"74'16","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:23.379623+0000","last_change":"2024-08-20T01:34:52.342207+0000","last_active":"2024-08-20T01:36:23.379623+0000","last_peered":"2024-08-20T01:36:23.379623+0000","last_clean":"2024-08-20T01:36:23.379623+0000","last_became_active":"2024-08-20T01:34:52.341878+0000","last_became_peered":"2024-08-20T01:34:52.341878+0000","last_unstale":"2024-08-20T01:36:23.379623+0000","last_undegraded":"2024-08-20T01:36:23.379623+0000","last_fullsized":"2024-08-20T01:36:23.379623+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:29:36.374725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"74'5","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.712779+0000","last_change":"2024-08-20T01:34:54.371162+0000","last_active":"2024-08-20T01:36:22.712779+0000","last_peered":"2024-08-20T01:36:22.712779+0000","last_clean":"2024-08-20T01:36:22.712779+0000","last_became_active":"2024-08-20T01:34:54.368442+0000","last_became_peered":"2024-08-20T01:34:54.368442+0000","last_unstale":"2024-08-20T01:36:22.712779+0000","last_undegraded":"2024-08-20T01:36:22.712779+0000","last_fullsized":"2024-08-20T01:36:22.712779+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:23:42.119533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"72'7","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.797237+0000","last_change":"2024-08-20T01:34:52.345551+0000","last_active":"2024-08-20T01:35:53.797237+0000","last_peered":"2024-08-20T01:35:53.797237+0000","last_clean":"2024-08-20T01:35:53.797237+0000","last_became_active":"2024-08-20T01:34:52.344212+0000","last_became_peered":"2024-08-20T01:34:52.344212+0000","last_unstale":"2024-08-20T01:35:53.797237+0000","last_undegraded":"2024-08-20T01:35:53.797237+0000","last_fullsized":"2024-08-20T01:35:53.797237+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:52:58.826394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"74'7","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.716462+0000","last_change":"2024-08-20T01:35:53.799194+0000","last_active":"2024-08-20T01:36:22.716462+0000","last_peered":"2024-08-20T01:36:22.716462+0000","last_clean":"2024-08-20T01:36:22.716462+0000","last_became_active":"2024-08-20T01:35:53.798865+0000","last_became_peered":"2024-08-20T01:35:53.798865+0000","last_unstale":"2024-08-20T01:36:22.716462+0000","last_undegraded":"2024-08-20T01:36:22.716462+0000","last_fullsized":"2024-08-20T01:36:22.716462+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:24:58.697929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"72'2","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796311+0000","last_change":"2024-08-20T01:34:52.560529+0000","last_active":"2024-08-20T01:35:53.796311+0000","last_peered":"2024-08-20T01:35:53.796311+0000","last_clean":"2024-08-20T01:35:53.796311+0000","last_became_active":"2024-08-20T01:34:52.560141+0000","last_became_peered":"2024-08-20T01:34:52.560141+0000","last_unstale":"2024-08-20T01:35:53.796311+0000","last_undegraded":"2024-08-20T01:35:53.796311+0000","last_fullsized":"2024-08-20T01:35:53.796311+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T02:02:13.367700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"74'2","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.674299+0000","last_change":"2024-08-20T01:34:54.377963+0000","last_active":"2024-08-20T01:36:22.674299+0000","last_peered":"2024-08-20T01:36:22.674299+0000","last_clean":"2024-08-20T01:36:22.674299+0000","last_became_active":"2024-08-20T01:34:54.377645+0000","last_became_peered":"2024-08-20T01:34:54.377645+0000","last_unstale":"2024-08-20T01:36:22.674299+0000","last_undegraded":"2024-08-20T01:36:22.674299+0000","last_fullsized":"2024-08-20T01:36:22.674299+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T03:36:11.888293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"72'7","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796210+0000","last_change":"2024-08-20T01:34:52.342262+0000","last_active":"2024-08-20T01:35:53.796210+0000","last_peered":"2024-08-20T01:35:53.796210+0000","last_clean":"2024-08-20T01:35:53.796210+0000","last_became_active":"2024-08-20T01:34:52.341919+0000","last_became_peered":"2024-08-20T01:34:52.341919+0000","last_unstale":"2024-08-20T01:35:53.796210+0000","last_undegraded":"2024-08-20T01:35:53.796210+0000","last_fullsized":"2024-08-20T01:35:53.796210+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:29:38.542146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"74'9","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.708016+0000","last_change":"2024-08-20T01:34:54.375741+0000","last_active":"2024-08-20T01:36:22.708016+0000","last_peered":"2024-08-20T01:36:22.708016+0000","last_clean":"2024-08-20T01:36:22.708016+0000","last_became_active":"2024-08-20T01:34:54.375409+0000","last_became_peered":"2024-08-20T01:34:54.375409+0000","last_unstale":"2024-08-20T01:36:22.708016+0000","last_undegraded":"2024-08-20T01:36:22.708016+0000","last_fullsized":"2024-08-20T01:36:22.708016+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:29:46.278762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'4","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796682+0000","last_change":"2024-08-20T01:34:52.346296+0000","last_active":"2024-08-20T01:35:53.796682+0000","last_peered":"2024-08-20T01:35:53.796682+0000","last_clean":"2024-08-20T01:35:53.796682+0000","last_became_active":"2024-08-20T01:34:52.345535+0000","last_became_peered":"2024-08-20T01:34:52.345535+0000","last_unstale":"2024-08-20T01:35:53.796682+0000","last_undegraded":"2024-08-20T01:35:53.796682+0000","last_fullsized":"2024-08-20T01:35:53.796682+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:32:23.126530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"74'8","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.710087+0000","last_change":"2024-08-20T01:34:54.365720+0000","last_active":"2024-08-20T01:36:22.710087+0000","last_peered":"2024-08-20T01:36:22.710087+0000","last_clean":"2024-08-20T01:36:22.710087+0000","last_became_active":"2024-08-20T01:34:54.365406+0000","last_became_peered":"2024-08-20T01:34:54.365406+0000","last_unstale":"2024-08-20T01:36:22.710087+0000","last_undegraded":"2024-08-20T01:36:22.710087+0000","last_fullsized":"2024-08-20T01:36:22.710087+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:31:09.988882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"72'4","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.782477+0000","last_change":"2024-08-20T01:34:52.344263+0000","last_active":"2024-08-20T01:35:53.782477+0000","last_peered":"2024-08-20T01:35:53.782477+0000","last_clean":"2024-08-20T01:35:53.782477+0000","last_became_active":"2024-08-20T01:34:52.343706+0000","last_became_peered":"2024-08-20T01:34:52.343706+0000","last_unstale":"2024-08-20T01:35:53.782477+0000","last_undegraded":"2024-08-20T01:35:53.782477+0000","last_fullsized":"2024-08-20T01:35:53.782477+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:25:30.305116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"74'5","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.723549+0000","last_change":"2024-08-20T01:34:54.374564+0000","last_active":"2024-08-20T01:36:22.723549+0000","last_peered":"2024-08-20T01:36:22.723549+0000","last_clean":"2024-08-20T01:36:22.723549+0000","last_became_active":"2024-08-20T01:34:54.374136+0000","last_became_peered":"2024-08-20T01:34:54.374136+0000","last_unstale":"2024-08-20T01:36:22.723549+0000","last_undegraded":"2024-08-20T01:36:22.723549+0000","last_fullsized":"2024-08-20T01:36:22.723549+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:33:12.972430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"74'15","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.707188+0000","last_change":"2024-08-20T01:35:53.798392+0000","last_active":"2024-08-20T01:36:22.707188+0000","last_peered":"2024-08-20T01:36:22.707188+0000","last_clean":"2024-08-20T01:36:22.707188+0000","last_became_active":"2024-08-20T01:35:53.798035+0000","last_became_peered":"2024-08-20T01:35:53.798035+0000","last_unstale":"2024-08-20T01:36:22.707188+0000","last_undegraded":"2024-08-20T01:36:22.707188+0000","last_fullsized":"2024-08-20T01:36:22.707188+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T04:52:47.630577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"72'5","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.783108+0000","last_change":"2024-08-20T01:34:52.346174+0000","last_active":"2024-08-20T01:35:53.783108+0000","last_peered":"2024-08-20T01:35:53.783108+0000","last_clean":"2024-08-20T01:35:53.783108+0000","last_became_active":"2024-08-20T01:34:52.345677+0000","last_became_peered":"2024-08-20T01:34:52.345677+0000","last_unstale":"2024-08-20T01:35:53.783108+0000","last_undegraded":"2024-08-20T01:35:53.783108+0000","last_fullsized":"2024-08-20T01:35:53.783108+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:23:38.692225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"74'9","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.719866+0000","last_change":"2024-08-20T01:34:54.373515+0000","last_active":"2024-08-20T01:36:22.719866+0000","last_peered":"2024-08-20T01:36:22.719866+0000","last_clean":"2024-08-20T01:36:22.719866+0000","last_became_active":"2024-08-20T01:34:54.372954+0000","last_became_peered":"2024-08-20T01:34:54.372954+0000","last_unstale":"2024-08-20T01:36:22.719866+0000","last_undegraded":"2024-08-20T01:36:22.719866+0000","last_fullsized":"2024-08-20T01:36:22.719866+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:27:24.384924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"72'12","reported_seq":36,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.784666+0000","last_change":"2024-08-20T01:34:52.344089+0000","last_active":"2024-08-20T01:35:53.784666+0000","last_peered":"2024-08-20T01:35:53.784666+0000","last_clean":"2024-08-20T01:35:53.784666+0000","last_became_active":"2024-08-20T01:34:52.343354+0000","last_became_peered":"2024-08-20T01:34:52.343354+0000","last_unstale":"2024-08-20T01:35:53.784666+0000","last_undegraded":"2024-08-20T01:35:53.784666+0000","last_fullsized":"2024-08-20T01:35:53.784666+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:50:35.527307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"74'6","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.719529+0000","last_change":"2024-08-20T01:34:54.371931+0000","last_active":"2024-08-20T01:36:22.719529+0000","last_peered":"2024-08-20T01:36:22.719529+0000","last_clean":"2024-08-20T01:36:22.719529+0000","last_became_active":"2024-08-20T01:34:54.371385+0000","last_became_peered":"2024-08-20T01:34:54.371385+0000","last_unstale":"2024-08-20T01:36:22.719529+0000","last_undegraded":"2024-08-20T01:36:22.719529+0000","last_fullsized":"2024-08-20T01:36:22.719529+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:11:35.807145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"72'2","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:35:53.796613+0000","last_change":"2024-08-20T01:34:52.559127+0000","last_active":"2024-08-20T01:35:53.796613+0000","last_peered":"2024-08-20T01:35:53.796613+0000","last_clean":"2024-08-20T01:35:53.796613+0000","last_became_active":"2024-08-20T01:34:52.558834+0000","last_became_peered":"2024-08-20T01:34:52.558834+0000","last_unstale":"2024-08-20T01:35:53.796613+0000","last_undegraded":"2024-08-20T01:35:53.796613+0000","last_fullsized":"2024-08-20T01:35:53.796613+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:57:35.879486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"74'5","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:22.706734+0000","last_change":"2024-08-20T01:34:54.378164+0000","last_active":"2024-08-20T01:36:22.706734+0000","last_peered":"2024-08-20T01:36:22.706734+0000","last_clean":"2024-08-20T01:36:22.706734+0000","last_became_active":"2024-08-20T01:34:54.377863+0000","last_became_peered":"2024-08-20T01:34:54.377863+0000","last_unstale":"2024-08-20T01:36:22.706734+0000","last_undegraded":"2024-08-20T01:36:22.706734+0000","last_fullsized":"2024-08-20T01:36:22.706734+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:53.338028+0000","last_clean_scrub_stamp":"2024-08-20T01:34:53.338028+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:23:21.832692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'14","reported_seq":144,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-20T01:36:50.580608+0000","last_change":"2024-08-20T01:34:52.341730+0000","last_active":"2024-08-20T01:36:50.580608+0000","last_peered":"2024-08-20T01:36:50.580608+0000","last_clean":"2024-08-20T01:36:50.580608+0000","last_became_active":"2024-08-20T01:34:52.341407+0000","last_became_peered":"2024-08-20T01:34:52.341407+0000","last_unstale":"2024-08-20T01:36:50.580608+0000","last_undegraded":"2024-08-20T01:36:50.580608+0000","last_fullsized":"2024-08-20T01:36:50.580608+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T01:34:51.319253+0000","last_clean_scrub_stamp":"2024-08-20T01:34:51.319253+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:53:09.225154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":107,"num_read_kb":107,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68898,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1075,"num_read_kb":611,"num_write":261,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":569344,"data_stored":211008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":223,"ondisk_log_size":223,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":66,"seq":283467841573,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":823296,"data_stored":394603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":61,"seq":261993005098,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36824,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708328,"statfs":{"total":95995035648,"available":95957327872,"internally_reserved":0,"allocated":1515520,"data_stored":1046024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":55,"seq":236223201326,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":839680,"data_stored":393928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":50,"seq":214748364851,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36152,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709000,"statfs":{"total":95995035648,"available":95958016000,"internally_reserved":0,"allocated":827392,"data_stored":394194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561080,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32584,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712568,"statfs":{"total":95995035648,"available":95961669632,"internally_reserved":0,"allocated":1433600,"data_stored":987912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":39,"seq":167503724605,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31988,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713164,"statfs":{"total":95995035648,"available":95962279936,"internally_reserved":0,"allocated":823296,"data_stored":394138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888130,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32596,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712556,"statfs":{"total":95995035648,"available":95961657344,"internally_reserved":0,"allocated":1445888,"data_stored":986604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084358,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":823296,"data_stored":393999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247882,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":839680,"data_stored":393470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444111,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":456268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":455555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":843776,"data_stored":395477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-20T01:36:53.039 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:36:53.320 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:36:53.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:53 smithi175 ceph-mon[22392]: from='client.15375 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:36:53.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:53 smithi079 ceph-mon[18656]: from='client.15375 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:36:53.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:53 smithi081 ceph-mon[22209]: from='client.15375 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:36:53.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.810+0000 7f84dc2b4640 1 -- 172.21.15.79:0/939717331 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84d4101990 msgr2=0x7f84d4101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:53.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.810+0000 7f84dc2b4640 1 --2- 172.21.15.79:0/939717331 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84d4101990 0x7f84d4101d70 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f84c8009900 tx=0x7f84c802a410 comp rx=0 tx=0).stop 2024-08-20T01:36:53.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.810+0000 7f84dc2b4640 1 -- 172.21.15.79:0/939717331 shutdown_connections 2024-08-20T01:36:53.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.810+0000 7f84dc2b4640 1 --2- 172.21.15.79:0/939717331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84d4107d20 0x7f84d410e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:53.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.810+0000 7f84dc2b4640 1 --2- 172.21.15.79:0/939717331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84d41073a0 0x7f84d41077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:53.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.810+0000 7f84dc2b4640 1 --2- 172.21.15.79:0/939717331 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84d4101990 0x7f84d4101d70 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:53.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.810+0000 7f84dc2b4640 1 -- 172.21.15.79:0/939717331 >> 172.21.15.79:0/939717331 conn(0x7f84d40fd400 msgr2=0x7f84d40ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:53.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.810+0000 7f84dc2b4640 1 -- 172.21.15.79:0/939717331 shutdown_connections 2024-08-20T01:36:53.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.810+0000 7f84dc2b4640 1 -- 172.21.15.79:0/939717331 wait complete. 2024-08-20T01:36:53.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.811+0000 7f84dc2b4640 1 Processor -- start 2024-08-20T01:36:53.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.811+0000 7f84dc2b4640 1 -- start start 2024-08-20T01:36:53.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.811+0000 7f84dc2b4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84d4101990 0x7f84d4198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:53.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.811+0000 7f84dc2b4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84d41073a0 0x7f84d4199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:53.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.811+0000 7f84dc2b4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84d4107d20 0x7f84d419e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:53.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.811+0000 7f84dc2b4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f84d41129b0 con 0x7f84d4101990 2024-08-20T01:36:53.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.811+0000 7f84dc2b4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f84d4112830 con 0x7f84d4107d20 2024-08-20T01:36:53.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.811+0000 7f84dc2b4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f84d4112b30 con 0x7f84d41073a0 2024-08-20T01:36:53.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.811+0000 7f84da050640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84d4101990 0x7f84d4198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:53.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.811+0000 7f84da050640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84d4101990 0x7f84d4198e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46490/0 (socket says 172.21.15.79:46490) 2024-08-20T01:36:53.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.811+0000 7f84da050640 1 -- 172.21.15.79:0/4095050239 learned_addr learned my addr 172.21.15.79:0/4095050239 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:53.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.811+0000 7f84d984f640 1 --2- 172.21.15.79:0/4095050239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84d41073a0 0x7f84d4199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:53.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.811+0000 7f84da851640 1 --2- 172.21.15.79:0/4095050239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84d4107d20 0x7f84d419e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:53.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.811+0000 7f84da050640 1 -- 172.21.15.79:0/4095050239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84d41073a0 msgr2=0x7f84d4199380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:53.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.811+0000 7f84da050640 1 --2- 172.21.15.79:0/4095050239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84d41073a0 0x7f84d4199380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:53.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.811+0000 7f84da050640 1 -- 172.21.15.79:0/4095050239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84d4107d20 msgr2=0x7f84d419e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:53.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.811+0000 7f84da050640 1 --2- 172.21.15.79:0/4095050239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84d4107d20 0x7f84d419e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:53.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.811+0000 7f84da050640 1 -- 172.21.15.79:0/4095050239 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84d419eef0 con 0x7f84d4101990 2024-08-20T01:36:53.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.811+0000 7f84da851640 1 --2- 172.21.15.79:0/4095050239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84d4107d20 0x7f84d419e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:36:53.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.811+0000 7f84da050640 1 --2- 172.21.15.79:0/4095050239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84d4101990 0x7f84d4198e40 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f84c8009230 tx=0x7f84c8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:53.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.812+0000 7f84c77fe640 1 -- 172.21.15.79:0/4095050239 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c803f030 con 0x7f84d4101990 2024-08-20T01:36:53.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.812+0000 7f84c77fe640 1 -- 172.21.15.79:0/4095050239 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f84c8003a80 con 0x7f84d4101990 2024-08-20T01:36:53.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.812+0000 7f84dc2b4640 1 -- 172.21.15.79:0/4095050239 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84d419f180 con 0x7f84d4101990 2024-08-20T01:36:53.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.812+0000 7f84c77fe640 1 -- 172.21.15.79:0/4095050239 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c8035070 con 0x7f84d4101990 2024-08-20T01:36:53.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.812+0000 7f84dc2b4640 1 -- 172.21.15.79:0/4095050239 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84d41a58a0 con 0x7f84d4101990 2024-08-20T01:36:53.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.813+0000 7f84dc2b4640 1 -- 172.21.15.79:0/4095050239 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84d4101d70 con 0x7f84d4101990 2024-08-20T01:36:53.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.814+0000 7f84c77fe640 1 -- 172.21.15.79:0/4095050239 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f84c8042030 con 0x7f84d4101990 2024-08-20T01:36:53.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.815+0000 7f84c77fe640 1 --2- 172.21.15.79:0/4095050239 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f84c00b3c50 0x7f84c00b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:53.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.815+0000 7f84d984f640 1 --2- 172.21.15.79:0/4095050239 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f84c00b3c50 0x7f84c00b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:53.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.815+0000 7f84c77fe640 1 -- 172.21.15.79:0/4095050239 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f84c8104730 con 0x7f84d4101990 2024-08-20T01:36:53.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.815+0000 7f84d984f640 1 --2- 172.21.15.79:0/4095050239 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f84c00b3c50 0x7f84c00b6110 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f84d4100dd0 tx=0x7f84d000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:53.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:53.818+0000 7f84c77fe640 1 -- 172.21.15.79:0/4095050239 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f84c80cbd30 con 0x7f84d4101990 2024-08-20T01:36:54.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:54.024+0000 7f84dc2b4640 1 -- 172.21.15.79:0/4095050239 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f84d4199f70 con 0x7f84d4101990 2024-08-20T01:36:54.026 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:36:54.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:54.024+0000 7f84c77fe640 1 -- 172.21.15.79:0/4095050239 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7f84c80cb630 con 0x7f84d4101990 2024-08-20T01:36:54.027 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 28 2024-08-20T01:36:54.027 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":28,"btime":"2024-08-20T01:36:49:088329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14670,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/735082912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":735082912},{"type":"v1","addr":"172.21.15.79:6835","nonce":735082912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2150339873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2150339873},{"type":"v1","addr":"172.21.15.79:6837","nonce":2150339873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:34:55.133562+0000","modified":"2024-08-20T01:36:48.384274+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24539,"mds_1":24538,"mds_2":24523,"mds_3":24514,"mds_4":24512},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14724":{"gid":14724,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/1071242274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1071242274},{"type":"v1","addr":"172.21.15.79:6839","nonce":1071242274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14730":{"gid":14730,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6841/2448977611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":2448977611},{"type":"v1","addr":"172.21.15.79:6841","nonce":2448977611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/1257507005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1257507005},{"type":"v1","addr":"172.21.15.81:6833","nonce":1257507005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1499936216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1499936216},{"type":"v1","addr":"172.21.15.81:6835","nonce":1499936216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/1107229215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1107229215},{"type":"v1","addr":"172.21.15.175:6833","nonce":1107229215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6837/2073598870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2073598870},{"type":"v1","addr":"172.21.15.81:6837","nonce":2073598870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/2552601173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2552601173},{"type":"v1","addr":"172.21.15.175:6835","nonce":2552601173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6837/1767284089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1767284089},{"type":"v1","addr":"172.21.15.175:6837","nonce":1767284089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/1331748742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1331748742},{"type":"v1","addr":"172.21.15.175:6839","nonce":1331748742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/4098410583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":4098410583},{"type":"v1","addr":"172.21.15.81:6839","nonce":4098410583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24539,"qdb_cluster":[24512,24538,24514,24523,24539]},"id":1}]} 2024-08-20T01:36:54.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:54.027+0000 7f84dc2b4640 1 -- 172.21.15.79:0/4095050239 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f84c00b3c50 msgr2=0x7f84c00b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:54.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:54.027+0000 7f84dc2b4640 1 --2- 172.21.15.79:0/4095050239 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f84c00b3c50 0x7f84c00b6110 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f84d4100dd0 tx=0x7f84d000a2d0 comp rx=0 tx=0).stop 2024-08-20T01:36:54.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:54.027+0000 7f84dc2b4640 1 -- 172.21.15.79:0/4095050239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84d4101990 msgr2=0x7f84d4198e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:54.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:54.027+0000 7f84dc2b4640 1 --2- 172.21.15.79:0/4095050239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84d4101990 0x7f84d4198e40 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f84c8009230 tx=0x7f84c8004270 comp rx=0 tx=0).stop 2024-08-20T01:36:54.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:54.027+0000 7f84dc2b4640 1 -- 172.21.15.79:0/4095050239 shutdown_connections 2024-08-20T01:36:54.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:54.027+0000 7f84dc2b4640 1 --2- 172.21.15.79:0/4095050239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84d4107d20 0x7f84d419e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:54.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:54.027+0000 7f84dc2b4640 1 --2- 172.21.15.79:0/4095050239 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f84c00b3c50 0x7f84c00b6110 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:54.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:54.027+0000 7f84dc2b4640 1 --2- 172.21.15.79:0/4095050239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84d41073a0 0x7f84d4199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:54.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:54.027+0000 7f84dc2b4640 1 --2- 172.21.15.79:0/4095050239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84d4101990 0x7f84d4198e40 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:54.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:54.027+0000 7f84dc2b4640 1 -- 172.21.15.79:0/4095050239 >> 172.21.15.79:0/4095050239 conn(0x7f84d40fd400 msgr2=0x7f84d40ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:54.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:54.027+0000 7f84dc2b4640 1 -- 172.21.15.79:0/4095050239 shutdown_connections 2024-08-20T01:36:54.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:54.027+0000 7f84dc2b4640 1 -- 172.21.15.79:0/4095050239 wait complete. 2024-08-20T01:36:54.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:54 smithi175 ceph-mon[22392]: pgmap v334: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-08-20T01:36:54.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:54 smithi175 ceph-mon[22392]: from='client.15381 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:36:54.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:54 smithi175 ceph-mon[22392]: from='client.15387 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:36:54.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:54 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/4095050239' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:36:54.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:54 smithi079 ceph-mon[18656]: pgmap v334: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-08-20T01:36:54.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:54 smithi079 ceph-mon[18656]: from='client.15381 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:36:54.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:54 smithi079 ceph-mon[18656]: from='client.15387 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:36:54.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:54 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/4095050239' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:36:54.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:54 smithi081 ceph-mon[22209]: pgmap v334: 97 pgs: 97 active+clean; 644 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-08-20T01:36:54.582 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:54 smithi081 ceph-mon[22209]: from='client.15381 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:36:54.582 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:54 smithi081 ceph-mon[22209]: from='client.15387 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T01:36:54.582 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:54 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/4095050239' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:36:54.815 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-20T01:36:55.061 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:36:55.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.569+0000 7f1304c89640 1 -- 172.21.15.79:0/2528305312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1300107d20 msgr2=0x7f130010e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:55.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.569+0000 7f1304c89640 1 --2- 172.21.15.79:0/2528305312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1300107d20 0x7f130010e520 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f12f8009900 tx=0x7f12f802a3f0 comp rx=0 tx=0).stop 2024-08-20T01:36:55.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.570+0000 7f1304c89640 1 -- 172.21.15.79:0/2528305312 shutdown_connections 2024-08-20T01:36:55.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.570+0000 7f1304c89640 1 --2- 172.21.15.79:0/2528305312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1300107d20 0x7f130010e520 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:55.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.570+0000 7f1304c89640 1 --2- 172.21.15.79:0/2528305312 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13001073a0 0x7f13001077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:55.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.570+0000 7f1304c89640 1 --2- 172.21.15.79:0/2528305312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1300101990 0x7f1300101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:55.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.570+0000 7f1304c89640 1 -- 172.21.15.79:0/2528305312 >> 172.21.15.79:0/2528305312 conn(0x7f13000fd400 msgr2=0x7f13000ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:55.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.570+0000 7f1304c89640 1 -- 172.21.15.79:0/2528305312 shutdown_connections 2024-08-20T01:36:55.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.570+0000 7f1304c89640 1 -- 172.21.15.79:0/2528305312 wait complete. 2024-08-20T01:36:55.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.570+0000 7f1304c89640 1 Processor -- start 2024-08-20T01:36:55.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.570+0000 7f1304c89640 1 -- start start 2024-08-20T01:36:55.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.571+0000 7f1304c89640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1300101990 0x7f1300197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:55.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.571+0000 7f1304c89640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13001073a0 0x7f1300198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:55.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.571+0000 7f1304c89640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1300107d20 0x7f130019d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:55.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.571+0000 7f1304c89640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1300111890 con 0x7f13001073a0 2024-08-20T01:36:55.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.571+0000 7f1304c89640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1300111710 con 0x7f1300107d20 2024-08-20T01:36:55.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.571+0000 7f1304c89640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1300111a10 con 0x7f1300101990 2024-08-20T01:36:55.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.571+0000 7f12fdd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13001073a0 0x7f1300198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:55.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.571+0000 7f12fdd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13001073a0 0x7f1300198230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46504/0 (socket says 172.21.15.79:46504) 2024-08-20T01:36:55.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.571+0000 7f12fdd9b640 1 -- 172.21.15.79:0/2797525879 learned_addr learned my addr 172.21.15.79:0/2797525879 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:55.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.571+0000 7f12fe59c640 1 --2- 172.21.15.79:0/2797525879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1300101990 0x7f1300197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:55.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.571+0000 7f12fed9d640 1 --2- 172.21.15.79:0/2797525879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1300107d20 0x7f130019d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:55.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.571+0000 7f12fdd9b640 1 -- 172.21.15.79:0/2797525879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1300101990 msgr2=0x7f1300197cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:55.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.571+0000 7f12fdd9b640 1 --2- 172.21.15.79:0/2797525879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1300101990 0x7f1300197cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:55.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.571+0000 7f12fdd9b640 1 -- 172.21.15.79:0/2797525879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1300107d20 msgr2=0x7f130019d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:55.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.571+0000 7f12fdd9b640 1 --2- 172.21.15.79:0/2797525879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1300107d20 0x7f130019d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:55.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.571+0000 7f12fdd9b640 1 -- 172.21.15.79:0/2797525879 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f130019dda0 con 0x7f13001073a0 2024-08-20T01:36:55.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.571+0000 7f12fdd9b640 1 --2- 172.21.15.79:0/2797525879 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13001073a0 0x7f1300198230 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f12f400c920 tx=0x7f12f400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:55.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.571+0000 7f12ef7fe640 1 -- 172.21.15.79:0/2797525879 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f4007c70 con 0x7f13001073a0 2024-08-20T01:36:55.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.571+0000 7f12ef7fe640 1 -- 172.21.15.79:0/2797525879 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f12f4007e10 con 0x7f13001073a0 2024-08-20T01:36:55.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.571+0000 7f1304c89640 1 -- 172.21.15.79:0/2797525879 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f130019e090 con 0x7f13001073a0 2024-08-20T01:36:55.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.571+0000 7f12ef7fe640 1 -- 172.21.15.79:0/2797525879 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f4018710 con 0x7f13001073a0 2024-08-20T01:36:55.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.572+0000 7f1304c89640 1 -- 172.21.15.79:0/2797525879 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f130006a7b0 con 0x7f13001073a0 2024-08-20T01:36:55.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.572+0000 7f1304c89640 1 -- 172.21.15.79:0/2797525879 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1300101d70 con 0x7f13001073a0 2024-08-20T01:36:55.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.574+0000 7f12ef7fe640 1 -- 172.21.15.79:0/2797525879 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f12f400f450 con 0x7f13001073a0 2024-08-20T01:36:55.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.574+0000 7f12ef7fe640 1 --2- 172.21.15.79:0/2797525879 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f12e80b3bd0 0x7f12e80b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:55.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.575+0000 7f12fe59c640 1 --2- 172.21.15.79:0/2797525879 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f12e80b3bd0 0x7f12e80b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:55.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.575+0000 7f12ef7fe640 1 -- 172.21.15.79:0/2797525879 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f12f40e3f80 con 0x7f13001073a0 2024-08-20T01:36:55.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.575+0000 7f12fe59c640 1 --2- 172.21.15.79:0/2797525879 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f12e80b3bd0 0x7f12e80b6090 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f12f0005fd0 tx=0x7f12f0009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:55.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.577+0000 7f12ef7fe640 1 -- 172.21.15.79:0/2797525879 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f12f4014030 con 0x7f13001073a0 2024-08-20T01:36:55.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.754+0000 7f1304c89640 1 -- 172.21.15.79:0/2797525879 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f130006b360 con 0x7f13001073a0 2024-08-20T01:36:55.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.755+0000 7f12ef7fe640 1 -- 172.21.15.79:0/2797525879 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22676 (secure 0 0 0) 0x7f12f40ab670 con 0x7f13001073a0 2024-08-20T01:36:55.757 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:36:55.757 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":74,"fsid":"28484e9a-5e93-11ef-bccf-c7b262605968","created":"2024-08-20T01:27:07.792689+0000","modified":"2024-08-20T01:35:53.774800+0000","last_up_change":"2024-08-20T01:34:05.838937+0000","last_in_change":"2024-08-20T01:33:43.645153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-20T01:30:30.693903+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-20T01:34:50.585939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-20T01:34:52.980599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ccdbeb3d-bb9d-4275-ad7e-49f2cc1222cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6803","nonce":1274927648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6805","nonce":1274927648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6809","nonce":1274927648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6807","nonce":1274927648}]},"public_addr":"172.21.15.79:6803/1274927648","cluster_addr":"172.21.15.79:6805/1274927648","heartbeat_back_addr":"172.21.15.79:6809/1274927648","heartbeat_front_addr":"172.21.15.79:6807/1274927648","state":["exists","up"]},{"osd":1,"uuid":"0906bc46-f89d-482d-9402-43d17e4246a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6801","nonce":1174012328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6803","nonce":1174012328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6807","nonce":1174012328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6805","nonce":1174012328}]},"public_addr":"172.21.15.81:6801/1174012328","cluster_addr":"172.21.15.81:6803/1174012328","heartbeat_back_addr":"172.21.15.81:6807/1174012328","heartbeat_front_addr":"172.21.15.81:6805/1174012328","state":["exists","up"]},{"osd":2,"uuid":"11d8fb9d-cb2c-41c8-994c-603a1d8e01a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6801","nonce":1132306232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6803","nonce":1132306232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6807","nonce":1132306232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6805","nonce":1132306232}]},"public_addr":"172.21.15.175:6801/1132306232","cluster_addr":"172.21.15.175:6803/1132306232","heartbeat_back_addr":"172.21.15.175:6807/1132306232","heartbeat_front_addr":"172.21.15.175:6805/1132306232","state":["exists","up"]},{"osd":3,"uuid":"29e35242-957f-404b-b99e-d4dd0045c35d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6811","nonce":1364181822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6813","nonce":1364181822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6817","nonce":1364181822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6815","nonce":1364181822}]},"public_addr":"172.21.15.79:6811/1364181822","cluster_addr":"172.21.15.79:6813/1364181822","heartbeat_back_addr":"172.21.15.79:6817/1364181822","heartbeat_front_addr":"172.21.15.79:6815/1364181822","state":["exists","up"]},{"osd":4,"uuid":"9139c469-270f-4465-8adb-1e748529fa68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6809","nonce":306873968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6811","nonce":306873968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6815","nonce":306873968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6813","nonce":306873968}]},"public_addr":"172.21.15.81:6809/306873968","cluster_addr":"172.21.15.81:6811/306873968","heartbeat_back_addr":"172.21.15.81:6815/306873968","heartbeat_front_addr":"172.21.15.81:6813/306873968","state":["exists","up"]},{"osd":5,"uuid":"6394e462-4510-45d6-bc99-8660085cb206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6809","nonce":3908133424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6811","nonce":3908133424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6815","nonce":3908133424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6813","nonce":3908133424}]},"public_addr":"172.21.15.175:6809/3908133424","cluster_addr":"172.21.15.175:6811/3908133424","heartbeat_back_addr":"172.21.15.175:6815/3908133424","heartbeat_front_addr":"172.21.15.175:6813/3908133424","state":["exists","up"]},{"osd":6,"uuid":"e8e51380-e2be-4c4c-82d8-d86306d9fc1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6819","nonce":3379368280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6821","nonce":3379368280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6825","nonce":3379368280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6823","nonce":3379368280}]},"public_addr":"172.21.15.79:6819/3379368280","cluster_addr":"172.21.15.79:6821/3379368280","heartbeat_back_addr":"172.21.15.79:6825/3379368280","heartbeat_front_addr":"172.21.15.79:6823/3379368280","state":["exists","up"]},{"osd":7,"uuid":"875f7876-a2ca-4254-a8cc-27eebb11cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6817","nonce":747356685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6819","nonce":747356685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6823","nonce":747356685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6821","nonce":747356685}]},"public_addr":"172.21.15.81:6817/747356685","cluster_addr":"172.21.15.81:6819/747356685","heartbeat_back_addr":"172.21.15.81:6823/747356685","heartbeat_front_addr":"172.21.15.81:6821/747356685","state":["exists","up"]},{"osd":8,"uuid":"d714a33b-8df5-411d-bc99-b33b4b27cc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6817","nonce":1537762925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6819","nonce":1537762925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6823","nonce":1537762925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6821","nonce":1537762925}]},"public_addr":"172.21.15.175:6817/1537762925","cluster_addr":"172.21.15.175:6819/1537762925","heartbeat_back_addr":"172.21.15.175:6823/1537762925","heartbeat_front_addr":"172.21.15.175:6821/1537762925","state":["exists","up"]},{"osd":9,"uuid":"82db8305-1d72-4bef-99d6-5486e4de5b03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6827","nonce":2400574113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6829","nonce":2400574113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6833","nonce":2400574113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6831","nonce":2400574113}]},"public_addr":"172.21.15.79:6827/2400574113","cluster_addr":"172.21.15.79:6829/2400574113","heartbeat_back_addr":"172.21.15.79:6833/2400574113","heartbeat_front_addr":"172.21.15.79:6831/2400574113","state":["exists","up"]},{"osd":10,"uuid":"797e1e3f-12b5-4958-9e1f-f796cffaaf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6825","nonce":4188407500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6827","nonce":4188407500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6831","nonce":4188407500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6829","nonce":4188407500}]},"public_addr":"172.21.15.81:6825/4188407500","cluster_addr":"172.21.15.81:6827/4188407500","heartbeat_back_addr":"172.21.15.81:6831/4188407500","heartbeat_front_addr":"172.21.15.81:6829/4188407500","state":["exists","up"]},{"osd":11,"uuid":"a4d218ae-5a41-4b34-9c4e-e795c4a6a16d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6825","nonce":451069549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6827","nonce":451069549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6831","nonce":451069549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6829","nonce":451069549}]},"public_addr":"172.21.15.175:6825/451069549","cluster_addr":"172.21.15.175:6827/451069549","heartbeat_back_addr":"172.21.15.175:6831/451069549","heartbeat_front_addr":"172.21.15.175:6829/451069549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:29:42.003425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:30:05.353547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:30:28.916727+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:30:52.845671+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:31:16.926826+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:31:39.840986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:32:04.013287+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:32:28.237482+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:32:51.270643+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:33:15.825156+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:33:40.037915+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:34:04.477377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":3,"to":7}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:0/1750500064":"2024-08-21T01:27:52.389553+0000","172.21.15.79:0/103962305":"2024-08-21T01:27:52.389553+0000","172.21.15.79:6800/4045769179":"2024-08-21T01:27:29.643647+0000","172.21.15.79:0/525482354":"2024-08-21T01:27:52.389553+0000","172.21.15.79:6801/4045769179":"2024-08-21T01:27:29.643647+0000","172.21.15.79:0/1023212241":"2024-08-21T01:27:29.643647+0000","172.21.15.79:0/2368377219":"2024-08-21T01:27:29.643647+0000","172.21.15.79:6801/3302536522":"2024-08-21T01:27:52.389553+0000","172.21.15.79:6800/3302536522":"2024-08-21T01:27:52.389553+0000","172.21.15.79:0/3498829332":"2024-08-21T01:27:29.643647+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-20T01:36:55.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.757+0000 7f1304c89640 1 -- 172.21.15.79:0/2797525879 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f12e80b3bd0 msgr2=0x7f12e80b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:55.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.757+0000 7f1304c89640 1 --2- 172.21.15.79:0/2797525879 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f12e80b3bd0 0x7f12e80b6090 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f12f0005fd0 tx=0x7f12f0009680 comp rx=0 tx=0).stop 2024-08-20T01:36:55.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.757+0000 7f1304c89640 1 -- 172.21.15.79:0/2797525879 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13001073a0 msgr2=0x7f1300198230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:55.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.757+0000 7f1304c89640 1 --2- 172.21.15.79:0/2797525879 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13001073a0 0x7f1300198230 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f12f400c920 tx=0x7f12f400cde0 comp rx=0 tx=0).stop 2024-08-20T01:36:55.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.757+0000 7f1304c89640 1 -- 172.21.15.79:0/2797525879 shutdown_connections 2024-08-20T01:36:55.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.757+0000 7f1304c89640 1 --2- 172.21.15.79:0/2797525879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1300107d20 0x7f130019d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:55.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.757+0000 7f1304c89640 1 --2- 172.21.15.79:0/2797525879 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13001073a0 0x7f1300198230 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:55.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.757+0000 7f1304c89640 1 --2- 172.21.15.79:0/2797525879 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f12e80b3bd0 0x7f12e80b6090 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:55.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.757+0000 7f1304c89640 1 --2- 172.21.15.79:0/2797525879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1300101990 0x7f1300197cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:55.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.757+0000 7f1304c89640 1 -- 172.21.15.79:0/2797525879 >> 172.21.15.79:0/2797525879 conn(0x7f13000fd400 msgr2=0x7f13000ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:55.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.758+0000 7f1304c89640 1 -- 172.21.15.79:0/2797525879 shutdown_connections 2024-08-20T01:36:55.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:55.758+0000 7f1304c89640 1 -- 172.21.15.79:0/2797525879 wait complete. 2024-08-20T01:36:56.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:56 smithi175 ceph-mon[22392]: pgmap v335: 97 pgs: 97 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-08-20T01:36:56.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:56 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2797525879' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:36:56.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:56 smithi079 ceph-mon[18656]: pgmap v335: 97 pgs: 97 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-08-20T01:36:56.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:56 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2797525879' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:36:56.474 DEBUG:tasks.fwd_scrub:Yielding 2024-08-20T01:36:56.474 INFO:teuthology.run_tasks:Running task background_exec... 2024-08-20T01:36:57.247 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi079.front.sepia.ceph.com 2024-08-20T01:36:57.247 DEBUG:teuthology.orchestra.run.smithi079:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-08-20T01:36:57.248 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-08-20T01:36:57.248 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T01:36:57.248 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T01:36:57.249 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:56 smithi081 ceph-mon[22209]: pgmap v335: 97 pgs: 97 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-08-20T01:36:57.249 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:56 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2797525879' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:36:57.250 INFO:teuthology.run_tasks:Running task workunit... 2024-08-20T01:36:57.606 INFO:tasks.workunit:Pulling workunits from ref ef4275410d8483698016fe484b2a3c664080b4c1 2024-08-20T01:36:57.606 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-08-20T01:36:57.607 INFO:tasks.workunit:timeout=3h 2024-08-20T01:36:57.607 INFO:tasks.workunit:cleanup=True 2024-08-20T01:36:57.607 DEBUG:teuthology.orchestra.run.smithi079:> stat -- /home/ubuntu/cephtest/mnt.0 2024-08-20T01:36:57.608 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:36:57.666 INFO:teuthology.orchestra.run.smithi079.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-08-20T01:36:57.666 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-08-20T01:36:57.666 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 79h/121d Inode: 1 Links: 2 2024-08-20T01:36:57.666 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-20T01:36:57.666 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:fusefs_t:s0 2024-08-20T01:36:57.666 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-08-20 01:35:09.657375162 +0000 2024-08-20T01:36:57.666 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-08-20 01:35:09.657375162 +0000 2024-08-20T01:36:57.666 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-08-20 01:36:48.021669104 +0000 2024-08-20T01:36:57.666 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2024-08-20T01:36:57.667 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-08-20T01:36:57.667 DEBUG:teuthology.orchestra.run.smithi079:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-08-20T01:36:57.743 DEBUG:teuthology.orchestra.run.smithi079:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout ef4275410d8483698016fe484b2a3c664080b4c1 2024-08-20T01:36:57.799 INFO:tasks.workunit.client.0.smithi079.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-08-20T01:36:58.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.991+0000 7f273dae5640 1 -- 172.21.15.79:0/2998806282 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2738101990 msgr2=0x7f2738101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:58.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.991+0000 7f273dae5640 1 --2- 172.21.15.79:0/2998806282 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2738101990 0x7f2738101d70 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f272c009900 tx=0x7f272c02a410 comp rx=0 tx=0).stop 2024-08-20T01:36:58.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.991+0000 7f273dae5640 1 -- 172.21.15.79:0/2998806282 shutdown_connections 2024-08-20T01:36:58.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.991+0000 7f273dae5640 1 --2- 172.21.15.79:0/2998806282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2738107d20 0x7f273810e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.991+0000 7f273dae5640 1 --2- 172.21.15.79:0/2998806282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27381073a0 0x7f27381077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.991+0000 7f273dae5640 1 --2- 172.21.15.79:0/2998806282 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2738101990 0x7f2738101d70 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.991+0000 7f273dae5640 1 -- 172.21.15.79:0/2998806282 >> 172.21.15.79:0/2998806282 conn(0x7f27380fd400 msgr2=0x7f27380ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:58.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.991+0000 7f273dae5640 1 -- 172.21.15.79:0/2998806282 shutdown_connections 2024-08-20T01:36:58.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.991+0000 7f273dae5640 1 -- 172.21.15.79:0/2998806282 wait complete. 2024-08-20T01:36:58.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.991+0000 7f273dae5640 1 Processor -- start 2024-08-20T01:36:58.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.992+0000 7f273dae5640 1 -- start start 2024-08-20T01:36:58.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.992+0000 7f273dae5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2738101990 0x7f2738199010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:58.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.992+0000 7f273dae5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27381073a0 0x7f2738199550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:58.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.992+0000 7f273dae5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2738107d20 0x7f273819e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:58.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.992+0000 7f273dae5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f27381118d0 con 0x7f2738101990 2024-08-20T01:36:58.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.992+0000 7f273dae5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2738111750 con 0x7f27381073a0 2024-08-20T01:36:58.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.992+0000 7f273dae5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2738111a50 con 0x7f2738107d20 2024-08-20T01:36:58.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.992+0000 7f27377fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2738101990 0x7f2738199010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:58.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.992+0000 7f27377fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2738101990 0x7f2738199010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46520/0 (socket says 172.21.15.79:46520) 2024-08-20T01:36:58.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.992+0000 7f27377fe640 1 -- 172.21.15.79:0/1812123594 learned_addr learned my addr 172.21.15.79:0/1812123594 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:58.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.992+0000 7f2736ffd640 1 --2- 172.21.15.79:0/1812123594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27381073a0 0x7f2738199550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:58.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.992+0000 7f2737fff640 1 --2- 172.21.15.79:0/1812123594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2738107d20 0x7f273819e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:58.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.992+0000 7f27377fe640 1 -- 172.21.15.79:0/1812123594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2738107d20 msgr2=0x7f273819e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:58.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.992+0000 7f27377fe640 1 --2- 172.21.15.79:0/1812123594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2738107d20 0x7f273819e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.992+0000 7f27377fe640 1 -- 172.21.15.79:0/1812123594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27381073a0 msgr2=0x7f2738199550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:58.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.992+0000 7f27377fe640 1 --2- 172.21.15.79:0/1812123594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27381073a0 0x7f2738199550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.992+0000 7f27377fe640 1 -- 172.21.15.79:0/1812123594 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f273819f0c0 con 0x7f2738101990 2024-08-20T01:36:58.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.993+0000 7f27377fe640 1 --2- 172.21.15.79:0/1812123594 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2738101990 0x7f2738199010 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f272c009a20 tx=0x7f272c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:58.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.993+0000 7f2734ff9640 1 -- 172.21.15.79:0/1812123594 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f272c03f030 con 0x7f2738101990 2024-08-20T01:36:58.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.993+0000 7f273dae5640 1 -- 172.21.15.79:0/1812123594 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f273819f350 con 0x7f2738101990 2024-08-20T01:36:58.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.993+0000 7f2734ff9640 1 -- 172.21.15.79:0/1812123594 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f272c0035f0 con 0x7f2738101990 2024-08-20T01:36:58.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.993+0000 7f2734ff9640 1 -- 172.21.15.79:0/1812123594 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f272c035070 con 0x7f2738101990 2024-08-20T01:36:58.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.993+0000 7f273dae5640 1 -- 172.21.15.79:0/1812123594 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27381a5a70 con 0x7f2738101990 2024-08-20T01:36:58.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.995+0000 7f2734ff9640 1 -- 172.21.15.79:0/1812123594 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f272c003aa0 con 0x7f2738101990 2024-08-20T01:36:58.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.997+0000 7f2734ff9640 1 --2- 172.21.15.79:0/1812123594 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f27200b3bd0 0x7f27200b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:58.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.997+0000 7f273fede740 1 Processor -- start 2024-08-20T01:36:58.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.997+0000 7f273fede740 1 -- start start 2024-08-20T01:36:58.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.997+0000 7f2736ffd640 1 --2- 172.21.15.79:0/1812123594 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f27200b3bd0 0x7f27200b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:58.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.997+0000 7f2734ff9640 1 -- 172.21.15.79:0/1812123594 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f272c104560 con 0x7f2738101990 2024-08-20T01:36:58.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.997+0000 7f273fede740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e21f7e63b0 0x55e21f7e6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:58.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.997+0000 7f273fede740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e21f7e6cd0 0x55e21f7f2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:58.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.997+0000 7f273fede740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e21f7f2c60 0x55e21f7f5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:58.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.997+0000 7f273fede740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e21f75c940 con 0x55e21f7e63b0 2024-08-20T01:36:58.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.997+0000 7f273fede740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e21f74be40 con 0x55e21f7f2c60 2024-08-20T01:36:58.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.997+0000 7f273fede740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e21f74fe80 con 0x55e21f7e6cd0 2024-08-20T01:36:58.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.997+0000 7f27377fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e21f7e63b0 0x55e21f7e6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:58.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.998+0000 7f27377fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e21f7e63b0 0x55e21f7e6790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46534/0 (socket says 172.21.15.79:46534) 2024-08-20T01:36:58.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.998+0000 7f27377fe640 1 -- 172.21.15.79:0/2573914780 learned_addr learned my addr 172.21.15.79:0/2573914780 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:58.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.998+0000 7f2736ffd640 1 --2- 172.21.15.79:0/2573914780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e21f7e6cd0 0x55e21f7f2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:58.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.998+0000 7f2736ffd640 1 --2- 172.21.15.79:0/1812123594 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f27200b3bd0 0x7f27200b6090 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f27381002a0 tx=0x7f2728009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:58.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.998+0000 7f2737fff640 1 --2- 172.21.15.79:0/2573914780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e21f7f2c60 0x55e21f7f5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:58.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.998+0000 7f27377fe640 1 -- 172.21.15.79:0/2573914780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e21f7e6cd0 msgr2=0x55e21f7f2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:58.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.998+0000 7f27377fe640 1 --2- 172.21.15.79:0/2573914780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e21f7e6cd0 0x55e21f7f2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.998+0000 7f27377fe640 1 -- 172.21.15.79:0/2573914780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e21f7f2c60 msgr2=0x55e21f7f5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:58.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.998+0000 7f27377fe640 1 --2- 172.21.15.79:0/2573914780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e21f7f2c60 0x55e21f7f5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.998+0000 7f27377fe640 1 -- 172.21.15.79:0/2573914780 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e21f6e8520 con 0x55e21f7e63b0 2024-08-20T01:36:58.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.998+0000 7f2737fff640 1 --2- 172.21.15.79:0/2573914780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e21f7f2c60 0x55e21f7f5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:36:58.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.998+0000 7f27377fe640 1 --2- 172.21.15.79:0/2573914780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e21f7e63b0 0x55e21f7e6790 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f272c0cb1c0 tx=0x7f272c0cad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bd2a67976160277 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:58.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.998+0000 7f271dffb640 1 -- 172.21.15.79:0/2573914780 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f272c049070 con 0x55e21f7e63b0 2024-08-20T01:36:58.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.998+0000 7f271dffb640 1 -- 172.21.15.79:0/2573914780 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f272c0cfac0 con 0x55e21f7e63b0 2024-08-20T01:36:58.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.998+0000 7f271dffb640 1 -- 172.21.15.79:0/2573914780 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f272c0cb720 con 0x55e21f7e63b0 2024-08-20T01:36:58.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.999+0000 7f273fede740 1 -- 172.21.15.79:0/2573914780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e21f7e63b0 msgr2=0x55e21f7e6790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:58.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.999+0000 7f273fede740 1 --2- 172.21.15.79:0/2573914780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e21f7e63b0 0x55e21f7e6790 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f272c0cb1c0 tx=0x7f272c0cad60 comp rx=0 tx=0).stop 2024-08-20T01:36:58.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.999+0000 7f273fede740 1 -- 172.21.15.79:0/2573914780 shutdown_connections 2024-08-20T01:36:58.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.999+0000 7f273fede740 1 --2- 172.21.15.79:0/2573914780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e21f7f2c60 0x55e21f7f5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.999+0000 7f273fede740 1 --2- 172.21.15.79:0/2573914780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e21f7e6cd0 0x55e21f7f2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.999+0000 7f273fede740 1 --2- 172.21.15.79:0/2573914780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e21f7e63b0 0x55e21f7e6790 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.999+0000 7f273fede740 1 -- 172.21.15.79:0/2573914780 >> 172.21.15.79:0/2573914780 conn(0x55e21f7e41e0 msgr2=0x55e21f7e5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:58.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.999+0000 7f273fede740 1 -- 172.21.15.79:0/2573914780 shutdown_connections 2024-08-20T01:36:58.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.999+0000 7f273fede740 1 -- 172.21.15.79:0/2573914780 wait complete. 2024-08-20T01:36:58.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:57.999+0000 7f273fede740 1 -- start start 2024-08-20T01:36:58.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.000+0000 7f273fede740 1 Processor -- start 2024-08-20T01:36:58.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.000+0000 7f273fede740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e21f7e63b0 0x55e21f7efcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:58.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.000+0000 7f273fede740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e21f7e6cd0 0x55e21f7f0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:58.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.000+0000 7f273fede740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e21f7f2c60 0x55e21f7f0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:58.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.000+0000 7f273fede740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e21f5ae890 con 0x55e21f7e63b0 2024-08-20T01:36:58.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.000+0000 7f273fede740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e21f6d2700 con 0x55e21f7e6cd0 2024-08-20T01:36:58.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.000+0000 7f273fede740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e21f7f56d0 con 0x55e21f7f2c60 2024-08-20T01:36:58.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.000+0000 7f27377fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e21f7e63b0 0x55e21f7efcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:58.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.000+0000 7f273fede740 10 client.0 _ll_register_callbacks cb 0x55e21f7476f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:58.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.000+0000 7f27377fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e21f7e63b0 0x55e21f7efcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46548/0 (socket says 172.21.15.79:46548) 2024-08-20T01:36:58.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.000+0000 7f27377fe640 1 -- 172.21.15.79:0/2385480970 learned_addr learned my addr 172.21.15.79:0/2385480970 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:58.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.000+0000 7f2736ffd640 1 --2- 172.21.15.79:0/2385480970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e21f7e6cd0 0x55e21f7f0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:58.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.000+0000 7f27377fe640 1 -- 172.21.15.79:0/2385480970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e21f7f2c60 msgr2=0x55e21f7f0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:58.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.000+0000 7f27377fe640 1 --2- 172.21.15.79:0/2385480970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e21f7f2c60 0x55e21f7f0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.000+0000 7f27377fe640 1 -- 172.21.15.79:0/2385480970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e21f7e6cd0 msgr2=0x55e21f7f0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:58.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.000+0000 7f27377fe640 1 --2- 172.21.15.79:0/2385480970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e21f7e6cd0 0x55e21f7f0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.000+0000 7f27377fe640 1 -- 172.21.15.79:0/2385480970 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e21f4ab930 con 0x55e21f7e63b0 2024-08-20T01:36:58.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.001+0000 7f2736ffd640 1 --2- 172.21.15.79:0/2385480970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e21f7e6cd0 0x55e21f7f0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:36:58.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.001+0000 7f27377fe640 1 --2- 172.21.15.79:0/2385480970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e21f7e63b0 0x55e21f7efcf0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f272c0cb170 tx=0x7f272c0039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a92e039373243ddd server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:58.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.001+0000 7f2716ffd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:36:58.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.001+0000 7f2716ffd640 1 -- 172.21.15.79:0/2385480970 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f272c049070 con 0x55e21f7e63b0 2024-08-20T01:36:58.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.001+0000 7f2716ffd640 1 -- 172.21.15.79:0/2385480970 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f272c0cb930 con 0x55e21f7e63b0 2024-08-20T01:36:58.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.001+0000 7f273fede740 1 -- 172.21.15.79:0/2385480970 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f272c0cfac0 con 0x55e21f7e63b0 2024-08-20T01:36:58.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.001+0000 7f2716ffd640 1 -- 172.21.15.79:0/2385480970 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f272c0d4570 con 0x55e21f7e63b0 2024-08-20T01:36:58.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.001+0000 7f273fede740 10 client.15411 fetch_fsmap learned FSMap version 28 2024-08-20T01:36:58.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.001+0000 7f273fede740 1 -- 172.21.15.79:0/2385480970 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e21f801390 con 0x55e21f7e63b0 2024-08-20T01:36:58.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.001+0000 7f2716ffd640 1 -- 172.21.15.79:0/2385480970 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f272c0cfac0 con 0x55e21f7e63b0 2024-08-20T01:36:58.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.001+0000 7f2716ffd640 1 -- 172.21.15.79:0/2385480970 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f272c104070 con 0x55e21f7e63b0 2024-08-20T01:36:58.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.001+0000 7f273fede740 10 client.15411 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:36:58.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.001+0000 7f273fede740 10 client.15411 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:36:58.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.001+0000 7f273fede740 20 client.15411 populate_metadata read hostname 'smithi079' 2024-08-20T01:36:58.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.001+0000 7f273fede740 1 --2- 172.21.15.79:0/2385480970 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55e21f8026e0 0x55e21f804ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:58.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.001+0000 7f273fede740 4 client.15411 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:36:58.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.001+0000 7f273fede740 1 -- 172.21.15.79:0/2385480970 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e21f75e890 con 0x55e21f8026e0 2024-08-20T01:36:58.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.002+0000 7f2736ffd640 1 --2- 172.21.15.79:0/2385480970 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55e21f8026e0 0x55e21f804ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:58.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.002+0000 7f2736ffd640 1 --2- 172.21.15.79:0/2385480970 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55e21f8026e0 0x55e21f804ad0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a75050ca7691b2d9 server_cookie=bbd1e59bb32e00f1 in_seq=0 out_seq=0 2024-08-20T01:36:58.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.002+0000 7f2716ffd640 10 client.15411 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:36:58.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.003+0000 7f2716ffd640 1 -- 172.21.15.79:0/2385480970 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e21f75e890 con 0x55e21f8026e0 2024-08-20T01:36:58.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.003+0000 7f2716ffd640 10 client.15411 handle_command_reply: tid=0 2024-08-20T01:36:58.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.003+0000 7f273fede740 1 client.15411 shutdown 2024-08-20T01:36:58.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.003+0000 7f273fede740 1 -- 172.21.15.79:0/2385480970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e21f7e63b0 msgr2=0x55e21f7efcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:58.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.003+0000 7f273fede740 1 --2- 172.21.15.79:0/2385480970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e21f7e63b0 0x55e21f7efcf0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f272c0cb170 tx=0x7f272c0039b0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.003+0000 7f273fede740 1 -- 172.21.15.79:0/2385480970 shutdown_connections 2024-08-20T01:36:58.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.003+0000 7f273fede740 1 --2- 172.21.15.79:0/2385480970 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55e21f8026e0 0x55e21f804ad0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.003+0000 7f273fede740 1 --2- 172.21.15.79:0/2385480970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e21f7f2c60 0x55e21f7f0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.003+0000 7f273fede740 1 --2- 172.21.15.79:0/2385480970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e21f7e6cd0 0x55e21f7f0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.003+0000 7f2716ffd640 0 client.15411 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:36:58.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.003+0000 7f273fede740 1 --2- 172.21.15.79:0/2385480970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e21f7e63b0 0x55e21f7efcf0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.003+0000 7f273fede740 1 -- 172.21.15.79:0/2385480970 >> 172.21.15.79:0/2385480970 conn(0x55e21f7e41e0 msgr2=0x55e21f7e9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:58.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.003+0000 7f273fede740 1 -- 172.21.15.79:0/2385480970 shutdown_connections 2024-08-20T01:36:58.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.003+0000 7f273fede740 1 -- 172.21.15.79:0/2385480970 wait complete. 2024-08-20T01:36:58.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.003+0000 7f273fede740 20 client.15411 trim_cache size 0 max 16384 2024-08-20T01:36:58.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.020+0000 7f273fede740 1 Processor -- start 2024-08-20T01:36:58.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.020+0000 7f273fede740 1 -- start start 2024-08-20T01:36:58.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.021+0000 7f273fede740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e21f7e63b0 0x55e21f7e9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:58.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.021+0000 7f273fede740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e21f7e6cd0 0x55e21f80a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:58.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.021+0000 7f273fede740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e21f7f2c60 0x55e21f80a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:58.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.021+0000 7f273fede740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f27381ae160 con 0x55e21f7e63b0 2024-08-20T01:36:58.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.021+0000 7f273fede740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f27381afca0 con 0x55e21f7f2c60 2024-08-20T01:36:58.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.021+0000 7f273fede740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f27381ae830 con 0x55e21f7e6cd0 2024-08-20T01:36:58.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.021+0000 7f27377fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e21f7e63b0 0x55e21f7e9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:58.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.021+0000 7f27377fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e21f7e63b0 0x55e21f7e9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46556/0 (socket says 172.21.15.79:46556) 2024-08-20T01:36:58.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.021+0000 7f27377fe640 1 -- 172.21.15.79:0/3420706433 learned_addr learned my addr 172.21.15.79:0/3420706433 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:58.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.021+0000 7f27377fe640 1 -- 172.21.15.79:0/3420706433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e21f7e6cd0 msgr2=0x55e21f80a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:58.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.021+0000 7f27377fe640 1 --2- 172.21.15.79:0/3420706433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e21f7e6cd0 0x55e21f80a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.021+0000 7f27377fe640 1 -- 172.21.15.79:0/3420706433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e21f7f2c60 msgr2=0x55e21f80a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:58.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.021+0000 7f27377fe640 1 --2- 172.21.15.79:0/3420706433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e21f7f2c60 0x55e21f80a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.021+0000 7f27377fe640 1 -- 172.21.15.79:0/3420706433 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e21f7e6ac0 con 0x55e21f7e63b0 2024-08-20T01:36:58.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.021+0000 7f27377fe640 1 --2- 172.21.15.79:0/3420706433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e21f7e63b0 0x55e21f7e9c70 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f272c032fd0 tx=0x7f272c0cad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6799f17539105d55 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:58.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.021+0000 7f271d7fa640 1 -- 172.21.15.79:0/3420706433 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f272c049070 con 0x55e21f7e63b0 2024-08-20T01:36:58.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.021+0000 7f271d7fa640 1 -- 172.21.15.79:0/3420706433 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f272c0cfac0 con 0x55e21f7e63b0 2024-08-20T01:36:58.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.021+0000 7f271d7fa640 1 -- 172.21.15.79:0/3420706433 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f272c0d4340 con 0x55e21f7e63b0 2024-08-20T01:36:58.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.022+0000 7f273fede740 1 -- 172.21.15.79:0/3420706433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e21f7e63b0 msgr2=0x55e21f7e9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:58.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.022+0000 7f273fede740 1 --2- 172.21.15.79:0/3420706433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e21f7e63b0 0x55e21f7e9c70 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f272c032fd0 tx=0x7f272c0cad60 comp rx=0 tx=0).stop 2024-08-20T01:36:58.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.022+0000 7f273fede740 1 -- 172.21.15.79:0/3420706433 shutdown_connections 2024-08-20T01:36:58.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.022+0000 7f273fede740 1 --2- 172.21.15.79:0/3420706433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e21f7f2c60 0x55e21f80a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.022+0000 7f273fede740 1 --2- 172.21.15.79:0/3420706433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e21f7e6cd0 0x55e21f80a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.022+0000 7f273fede740 1 --2- 172.21.15.79:0/3420706433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e21f7e63b0 0x55e21f7e9c70 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.022+0000 7f273fede740 1 -- 172.21.15.79:0/3420706433 >> 172.21.15.79:0/3420706433 conn(0x55e21f7e41e0 msgr2=0x55e21f7e9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:58.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.022+0000 7f273fede740 1 -- 172.21.15.79:0/3420706433 shutdown_connections 2024-08-20T01:36:58.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.022+0000 7f273fede740 1 -- 172.21.15.79:0/3420706433 wait complete. 2024-08-20T01:36:58.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.023+0000 7f273fede740 1 -- start start 2024-08-20T01:36:58.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.023+0000 7f273fede740 1 Processor -- start 2024-08-20T01:36:58.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.023+0000 7f273fede740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e21f7e63b0 0x55e21f7fae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:58.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.023+0000 7f273fede740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e21f7e6cd0 0x55e21f7f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:58.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.023+0000 7f273fede740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e21f7f2c60 0x55e21f7f6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:58.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.023+0000 7f273fede740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f27381af5d0 con 0x55e21f7e63b0 2024-08-20T01:36:58.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.023+0000 7f273fede740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f27381aef00 con 0x55e21f7f2c60 2024-08-20T01:36:58.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.023+0000 7f273fede740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f27381ac140 con 0x55e21f7e6cd0 2024-08-20T01:36:58.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.023+0000 7f273fede740 10 client.0 _ll_register_callbacks cb 0x7f272c0cf070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:58.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.023+0000 7f27377fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e21f7e63b0 0x55e21f7fae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:58.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.023+0000 7f27377fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e21f7e63b0 0x55e21f7fae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46564/0 (socket says 172.21.15.79:46564) 2024-08-20T01:36:58.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.023+0000 7f27377fe640 1 -- 172.21.15.79:0/1949820466 learned_addr learned my addr 172.21.15.79:0/1949820466 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:58.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.023+0000 7f2736ffd640 1 --2- 172.21.15.79:0/1949820466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e21f7e6cd0 0x55e21f7f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:58.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.023+0000 7f27377fe640 1 -- 172.21.15.79:0/1949820466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e21f7e6cd0 msgr2=0x55e21f7f62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:58.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.023+0000 7f27377fe640 1 --2- 172.21.15.79:0/1949820466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e21f7e6cd0 0x55e21f7f62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.023+0000 7f27377fe640 1 -- 172.21.15.79:0/1949820466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e21f7f2c60 msgr2=0x55e21f7f6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:58.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.023+0000 7f27377fe640 1 --2- 172.21.15.79:0/1949820466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e21f7f2c60 0x55e21f7f6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.023+0000 7f27377fe640 1 -- 172.21.15.79:0/1949820466 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e21f7f6e00 con 0x55e21f7e63b0 2024-08-20T01:36:58.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.023+0000 7f2736ffd640 1 --2- 172.21.15.79:0/1949820466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e21f7e6cd0 0x55e21f7f62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:36:58.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.024+0000 7f27377fe640 1 --2- 172.21.15.79:0/1949820466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e21f7e63b0 0x55e21f7fae00 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f272c0cb400 tx=0x7f272c0039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5960a176c88ff3ad server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:58.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.024+0000 7f2716ffd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:36:58.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.024+0000 7f2716ffd640 1 -- 172.21.15.79:0/1949820466 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f272c049040 con 0x55e21f7e63b0 2024-08-20T01:36:58.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.024+0000 7f2716ffd640 1 -- 172.21.15.79:0/1949820466 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f272c0e0d70 con 0x55e21f7e63b0 2024-08-20T01:36:58.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.024+0000 7f273fede740 1 -- 172.21.15.79:0/1949820466 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f272c0cfac0 con 0x55e21f7e63b0 2024-08-20T01:36:58.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.024+0000 7f2716ffd640 1 -- 172.21.15.79:0/1949820466 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f272c0ca720 con 0x55e21f7e63b0 2024-08-20T01:36:58.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.024+0000 7f273fede740 10 client.15417 fetch_fsmap learned FSMap version 28 2024-08-20T01:36:58.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.024+0000 7f273fede740 1 -- 172.21.15.79:0/1949820466 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e21f7f6e00 con 0x55e21f7e63b0 2024-08-20T01:36:58.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.024+0000 7f2716ffd640 1 -- 172.21.15.79:0/1949820466 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f272c0ca8c0 con 0x55e21f7e63b0 2024-08-20T01:36:58.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.024+0000 7f2716ffd640 1 -- 172.21.15.79:0/1949820466 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f272c0d0e50 con 0x55e21f7e63b0 2024-08-20T01:36:58.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.024+0000 7f273fede740 10 client.15417 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:36:58.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.024+0000 7f273fede740 10 client.15417 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:36:58.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.024+0000 7f273fede740 20 client.15417 populate_metadata read hostname 'smithi079' 2024-08-20T01:36:58.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.024+0000 7f273fede740 1 --2- 172.21.15.79:0/1949820466 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55e21f86d490 0x55e21f86f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:58.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.024+0000 7f273fede740 4 client.15417 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T01:36:58.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.024+0000 7f273fede740 1 -- 172.21.15.79:0/1949820466 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f272c0cfac0 con 0x55e21f86d490 2024-08-20T01:36:58.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.025+0000 7f2736ffd640 1 --2- 172.21.15.79:0/1949820466 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55e21f86d490 0x55e21f86f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:58.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.025+0000 7f2716ffd640 10 client.15417 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:36:58.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.025+0000 7f2736ffd640 1 --2- 172.21.15.79:0/1949820466 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55e21f86d490 0x55e21f86f880 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb36cde2c935cbe8 server_cookie=ee7e148874f78fba in_seq=0 out_seq=0 2024-08-20T01:36:58.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.026+0000 7f2716ffd640 1 -- 172.21.15.79:0/1949820466 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f272c0cfac0 con 0x55e21f86d490 2024-08-20T01:36:58.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.026+0000 7f2716ffd640 10 client.15417 handle_command_reply: tid=0 2024-08-20T01:36:58.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.026+0000 7f273fede740 1 client.15417 shutdown 2024-08-20T01:36:58.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.026+0000 7f273fede740 1 -- 172.21.15.79:0/1949820466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e21f7e63b0 msgr2=0x55e21f7fae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:58.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.026+0000 7f273fede740 1 --2- 172.21.15.79:0/1949820466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e21f7e63b0 0x55e21f7fae00 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f272c0cb400 tx=0x7f272c0039b0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.026+0000 7f273fede740 1 -- 172.21.15.79:0/1949820466 shutdown_connections 2024-08-20T01:36:58.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.026+0000 7f273fede740 1 --2- 172.21.15.79:0/1949820466 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55e21f86d490 0x55e21f86f880 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.026+0000 7f273fede740 1 --2- 172.21.15.79:0/1949820466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e21f7f2c60 0x55e21f7f6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.026+0000 7f273fede740 1 --2- 172.21.15.79:0/1949820466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e21f7e6cd0 0x55e21f7f62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.026+0000 7f2716ffd640 0 client.15417 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:36:58.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.026+0000 7f273fede740 1 --2- 172.21.15.79:0/1949820466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e21f7e63b0 0x55e21f7fae00 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.026+0000 7f273fede740 1 -- 172.21.15.79:0/1949820466 >> 172.21.15.79:0/1949820466 conn(0x55e21f7e41e0 msgr2=0x55e21f7e9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:58.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.027+0000 7f273fede740 1 -- 172.21.15.79:0/1949820466 shutdown_connections 2024-08-20T01:36:58.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.027+0000 7f273fede740 1 -- 172.21.15.79:0/1949820466 wait complete. 2024-08-20T01:36:58.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.027+0000 7f273fede740 20 client.15417 trim_cache size 0 max 16384 2024-08-20T01:36:58.035 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:36:58.035 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-08-20T01:36:58.035 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "d87c951b-8f90-47f4-96a0-7f2f8469ff7a", 2024-08-20T01:36:58.035 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-08-20T01:36:58.035 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:36:58.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.027+0000 7f273dae5640 1 -- 172.21.15.79:0/1812123594 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f27200b3bd0 msgr2=0x7f27200b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:58.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.027+0000 7f273dae5640 1 --2- 172.21.15.79:0/1812123594 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f27200b3bd0 0x7f27200b6090 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f27381002a0 tx=0x7f2728009110 comp rx=0 tx=0).stop 2024-08-20T01:36:58.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.027+0000 7f273dae5640 1 -- 172.21.15.79:0/1812123594 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2738101990 msgr2=0x7f2738199010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:58.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.027+0000 7f273dae5640 1 --2- 172.21.15.79:0/1812123594 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2738101990 0x7f2738199010 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f272c009a20 tx=0x7f272c004270 comp rx=0 tx=0).stop 2024-08-20T01:36:58.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.027+0000 7f273dae5640 1 -- 172.21.15.79:0/1812123594 shutdown_connections 2024-08-20T01:36:58.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.027+0000 7f273dae5640 1 --2- 172.21.15.79:0/1812123594 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f27200b3bd0 0x7f27200b6090 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.027+0000 7f273dae5640 1 --2- 172.21.15.79:0/1812123594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2738107d20 0x7f273819e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.027+0000 7f273dae5640 1 --2- 172.21.15.79:0/1812123594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27381073a0 0x7f2738199550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.027+0000 7f273dae5640 1 --2- 172.21.15.79:0/1812123594 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2738101990 0x7f2738199010 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:58.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.027+0000 7f273dae5640 1 -- 172.21.15.79:0/1812123594 >> 172.21.15.79:0/1812123594 conn(0x7f27380fd400 msgr2=0x7f273806ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:58.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.027+0000 7f273dae5640 1 -- 172.21.15.79:0/1812123594 shutdown_connections 2024-08-20T01:36:58.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:58.027+0000 7f273dae5640 1 -- 172.21.15.79:0/1812123594 wait complete. 2024-08-20T01:36:58.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:58 smithi079 ceph-mon[18656]: pgmap v336: 97 pgs: 97 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-08-20T01:36:58.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:58 smithi175 ceph-mon[22392]: pgmap v336: 97 pgs: 97 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-08-20T01:36:58.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:58 smithi081 ceph-mon[22209]: pgmap v336: 97 pgs: 97 active+clean; 648 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-08-20T01:36:58.839 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:36:59.127 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:36:59.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:59 smithi079 ceph-mon[18656]: scrub queued for path: / 2024-08-20T01:36:59.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:59 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:59.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:59 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:36:59.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:36:59 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:59.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:59 smithi175 ceph-mon[22392]: scrub queued for path: / 2024-08-20T01:36:59.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:59 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:59.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:59 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:36:59.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:36:59 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:59.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:59 smithi081 ceph-mon[22209]: scrub queued for path: / 2024-08-20T01:36:59.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:59 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:59.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:59 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:36:59.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:36:59 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:36:59.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.653+0000 7eff87bdd640 1 -- 172.21.15.79:0/780285574 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff80107d40 msgr2=0x7eff8010e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:59.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.653+0000 7eff87bdd640 1 --2- 172.21.15.79:0/780285574 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff80107d40 0x7eff8010e540 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7eff78009ca0 tx=0x7eff7802a8c0 comp rx=0 tx=0).stop 2024-08-20T01:36:59.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.653+0000 7eff87bdd640 1 -- 172.21.15.79:0/780285574 shutdown_connections 2024-08-20T01:36:59.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.653+0000 7eff87bdd640 1 --2- 172.21.15.79:0/780285574 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff80107d40 0x7eff8010e540 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:59.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.653+0000 7eff87bdd640 1 --2- 172.21.15.79:0/780285574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff801073c0 0x7eff80107800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:59.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.653+0000 7eff87bdd640 1 --2- 172.21.15.79:0/780285574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff801019b0 0x7eff80101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:59.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.653+0000 7eff87bdd640 1 -- 172.21.15.79:0/780285574 >> 172.21.15.79:0/780285574 conn(0x7eff800fd420 msgr2=0x7eff800ff840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:59.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.654+0000 7eff87bdd640 1 -- 172.21.15.79:0/780285574 shutdown_connections 2024-08-20T01:36:59.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.654+0000 7eff87bdd640 1 -- 172.21.15.79:0/780285574 wait complete. 2024-08-20T01:36:59.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.654+0000 7eff87bdd640 1 Processor -- start 2024-08-20T01:36:59.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.654+0000 7eff87bdd640 1 -- start start 2024-08-20T01:36:59.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.654+0000 7eff87bdd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff801019b0 0x7eff800fd920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:59.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.654+0000 7eff87bdd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff801073c0 0x7eff800fde60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:59.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.654+0000 7eff87bdd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff80107d40 0x7eff800fe3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:59.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.654+0000 7eff87bdd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7eff80111900 con 0x7eff801019b0 2024-08-20T01:36:59.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.654+0000 7eff87bdd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7eff80111780 con 0x7eff801073c0 2024-08-20T01:36:59.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.654+0000 7eff87bdd640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7eff80111a80 con 0x7eff80107d40 2024-08-20T01:36:59.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.654+0000 7eff85979640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff801019b0 0x7eff800fd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:59.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.654+0000 7eff85979640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff801019b0 0x7eff800fd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46592/0 (socket says 172.21.15.79:46592) 2024-08-20T01:36:59.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.654+0000 7eff85979640 1 -- 172.21.15.79:0/1698232482 learned_addr learned my addr 172.21.15.79:0/1698232482 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:59.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.654+0000 7eff8617a640 1 --2- 172.21.15.79:0/1698232482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff80107d40 0x7eff800fe3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:59.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.655+0000 7eff85178640 1 --2- 172.21.15.79:0/1698232482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff801073c0 0x7eff800fde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:59.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.655+0000 7eff85979640 1 -- 172.21.15.79:0/1698232482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff80107d40 msgr2=0x7eff800fe3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:59.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.655+0000 7eff85979640 1 --2- 172.21.15.79:0/1698232482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff80107d40 0x7eff800fe3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:59.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.655+0000 7eff85979640 1 -- 172.21.15.79:0/1698232482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff801073c0 msgr2=0x7eff800fde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:59.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.655+0000 7eff85979640 1 --2- 172.21.15.79:0/1698232482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff801073c0 0x7eff800fde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:59.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.655+0000 7eff85979640 1 -- 172.21.15.79:0/1698232482 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff801a7250 con 0x7eff801019b0 2024-08-20T01:36:59.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.655+0000 7eff85178640 1 --2- 172.21.15.79:0/1698232482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff801073c0 0x7eff800fde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:36:59.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.655+0000 7eff8617a640 1 --2- 172.21.15.79:0/1698232482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff80107d40 0x7eff800fe3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:36:59.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.655+0000 7eff85979640 1 --2- 172.21.15.79:0/1698232482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff801019b0 0x7eff800fd920 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7eff7c00d950 tx=0x7eff7c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:59.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.655+0000 7eff76ffd640 1 -- 172.21.15.79:0/1698232482 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7c017070 con 0x7eff801019b0 2024-08-20T01:36:59.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.655+0000 7eff87bdd640 1 -- 172.21.15.79:0/1698232482 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff801a7540 con 0x7eff801019b0 2024-08-20T01:36:59.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.655+0000 7eff76ffd640 1 -- 172.21.15.79:0/1698232482 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff7c009c30 con 0x7eff801019b0 2024-08-20T01:36:59.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.655+0000 7eff76ffd640 1 -- 172.21.15.79:0/1698232482 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7c00f620 con 0x7eff801019b0 2024-08-20T01:36:59.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.655+0000 7eff87bdd640 1 -- 172.21.15.79:0/1698232482 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff801a7a80 con 0x7eff801019b0 2024-08-20T01:36:59.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.658+0000 7eff89fd6740 1 Processor -- start 2024-08-20T01:36:59.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.658+0000 7eff89fd6740 1 -- start start 2024-08-20T01:36:59.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.658+0000 7eff89fd6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f32b40830 0x561f32b40c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:59.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.658+0000 7eff89fd6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f32b41150 0x561f32b4cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:59.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.658+0000 7eff89fd6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f32b4d0e0 0x561f32b4f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:59.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.658+0000 7eff89fd6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561f32ab78e0 con 0x561f32b41150 2024-08-20T01:36:59.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.658+0000 7eff89fd6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561f32aa6de0 con 0x561f32b4d0e0 2024-08-20T01:36:59.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.658+0000 7eff89fd6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561f32aaae20 con 0x561f32b40830 2024-08-20T01:36:59.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.658+0000 7eff76ffd640 1 -- 172.21.15.79:0/1698232482 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7eff7c010460 con 0x7eff801019b0 2024-08-20T01:36:59.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.659+0000 7eff85979640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f32b41150 0x561f32b4cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:59.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.659+0000 7eff85979640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f32b41150 0x561f32b4cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46606/0 (socket says 172.21.15.79:46606) 2024-08-20T01:36:59.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.659+0000 7eff85979640 1 -- 172.21.15.79:0/1343245950 learned_addr learned my addr 172.21.15.79:0/1343245950 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:59.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.659+0000 7eff8617a640 1 --2- 172.21.15.79:0/1343245950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f32b40830 0x561f32b40c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:59.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.659+0000 7eff85178640 1 --2- 172.21.15.79:0/1343245950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f32b4d0e0 0x561f32b4f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:59.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.659+0000 7eff85979640 1 -- 172.21.15.79:0/1343245950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f32b40830 msgr2=0x561f32b40c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:59.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.659+0000 7eff85979640 1 --2- 172.21.15.79:0/1343245950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f32b40830 0x561f32b40c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:59.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.659+0000 7eff85979640 1 -- 172.21.15.79:0/1343245950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f32b4d0e0 msgr2=0x561f32b4f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:59.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.659+0000 7eff85979640 1 --2- 172.21.15.79:0/1343245950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f32b4d0e0 0x561f32b4f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:59.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.659+0000 7eff85979640 1 -- 172.21.15.79:0/1343245950 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f32806650 con 0x561f32b41150 2024-08-20T01:36:59.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.659+0000 7eff85178640 1 --2- 172.21.15.79:0/1343245950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f32b4d0e0 0x561f32b4f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:36:59.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.659+0000 7eff85979640 1 --2- 172.21.15.79:0/1343245950 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f32b41150 0x561f32b4cba0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7eff7c0e9c50 tx=0x7eff7c0eb670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa6a1ca92f5ad87f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:59.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.659+0000 7eff6bfff640 1 -- 172.21.15.79:0/1343245950 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7c0f2070 con 0x561f32b41150 2024-08-20T01:36:59.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.659+0000 7eff6bfff640 1 -- 172.21.15.79:0/1343245950 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff7c0eeab0 con 0x561f32b41150 2024-08-20T01:36:59.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.659+0000 7eff76ffd640 1 --2- 172.21.15.79:0/1698232482 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7eff6c0b3c50 0x7eff6c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:59.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.659+0000 7eff6bfff640 1 -- 172.21.15.79:0/1343245950 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7c0ed7c0 con 0x561f32b41150 2024-08-20T01:36:59.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.660+0000 7eff8617a640 1 --2- 172.21.15.79:0/1698232482 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7eff6c0b3c50 0x7eff6c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:59.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.660+0000 7eff76ffd640 1 -- 172.21.15.79:0/1698232482 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7eff7c0e3910 con 0x7eff801019b0 2024-08-20T01:36:59.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.660+0000 7eff89fd6740 1 -- 172.21.15.79:0/1343245950 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f32b41150 msgr2=0x561f32b4cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:59.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.660+0000 7eff8617a640 1 --2- 172.21.15.79:0/1698232482 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7eff6c0b3c50 0x7eff6c0b6110 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7eff78005e30 tx=0x7eff78005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:59.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.660+0000 7eff89fd6740 1 --2- 172.21.15.79:0/1343245950 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f32b41150 0x561f32b4cba0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7eff7c0e9c50 tx=0x7eff7c0eb670 comp rx=0 tx=0).stop 2024-08-20T01:36:59.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.660+0000 7eff89fd6740 1 -- 172.21.15.79:0/1343245950 shutdown_connections 2024-08-20T01:36:59.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.660+0000 7eff89fd6740 1 --2- 172.21.15.79:0/1343245950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f32b4d0e0 0x561f32b4f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:59.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.660+0000 7eff89fd6740 1 --2- 172.21.15.79:0/1343245950 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f32b41150 0x561f32b4cba0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:59.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.660+0000 7eff89fd6740 1 --2- 172.21.15.79:0/1343245950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f32b40830 0x561f32b40c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:59.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.660+0000 7eff89fd6740 1 -- 172.21.15.79:0/1343245950 >> 172.21.15.79:0/1343245950 conn(0x561f32b3e660 msgr2=0x561f32b3f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:59.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.660+0000 7eff89fd6740 1 -- 172.21.15.79:0/1343245950 shutdown_connections 2024-08-20T01:36:59.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.660+0000 7eff89fd6740 1 -- 172.21.15.79:0/1343245950 wait complete. 2024-08-20T01:36:59.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.661+0000 7eff89fd6740 1 -- start start 2024-08-20T01:36:59.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.661+0000 7eff89fd6740 1 Processor -- start 2024-08-20T01:36:59.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.661+0000 7eff89fd6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f32b40830 0x561f32b4a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:59.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.661+0000 7eff89fd6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f32b41150 0x561f32b4a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:59.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.661+0000 7eff89fd6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f32b4d0e0 0x561f32b4aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:59.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.661+0000 7eff89fd6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561f32909700 con 0x561f32b41150 2024-08-20T01:36:59.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.661+0000 7eff89fd6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561f32a2d7c0 con 0x561f32b4d0e0 2024-08-20T01:36:59.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.661+0000 7eff89fd6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561f32b4fd90 con 0x561f32b40830 2024-08-20T01:36:59.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.661+0000 7eff89fd6740 10 client.0 _ll_register_callbacks cb 0x561f32aa06b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:59.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.661+0000 7eff85178640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f32b41150 0x561f32b4a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:59.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.661+0000 7eff85178640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f32b41150 0x561f32b4a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46616/0 (socket says 172.21.15.79:46616) 2024-08-20T01:36:59.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.661+0000 7eff85178640 1 -- 172.21.15.79:0/699463026 learned_addr learned my addr 172.21.15.79:0/699463026 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:59.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.661+0000 7eff85979640 1 --2- 172.21.15.79:0/699463026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f32b40830 0x561f32b4a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:59.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.661+0000 7eff8617a640 1 --2- 172.21.15.79:0/699463026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f32b4d0e0 0x561f32b4aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:59.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.661+0000 7eff85178640 1 -- 172.21.15.79:0/699463026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f32b40830 msgr2=0x561f32b4a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:59.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.661+0000 7eff85178640 1 --2- 172.21.15.79:0/699463026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f32b40830 0x561f32b4a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:59.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.661+0000 7eff85178640 1 -- 172.21.15.79:0/699463026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f32b4d0e0 msgr2=0x561f32b4aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:59.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.661+0000 7eff85178640 1 --2- 172.21.15.79:0/699463026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f32b4d0e0 0x561f32b4aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:59.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.661+0000 7eff85178640 1 -- 172.21.15.79:0/699463026 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f32b59140 con 0x561f32b41150 2024-08-20T01:36:59.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.662+0000 7eff8617a640 1 --2- 172.21.15.79:0/699463026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f32b4d0e0 0x561f32b4aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:36:59.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.662+0000 7eff85178640 1 --2- 172.21.15.79:0/699463026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f32b41150 0x561f32b4a580 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7eff700106d0 tx=0x7eff70010b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec5c33a0011590d5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:59.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.662+0000 7eff697fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:36:59.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.662+0000 7eff697fa640 1 -- 172.21.15.79:0/699463026 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7000ead0 con 0x561f32b41150 2024-08-20T01:36:59.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.662+0000 7eff697fa640 1 -- 172.21.15.79:0/699463026 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7eff7000ec70 con 0x561f32b41150 2024-08-20T01:36:59.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.662+0000 7eff89fd6740 1 -- 172.21.15.79:0/699463026 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561f32a56100 con 0x561f32b41150 2024-08-20T01:36:59.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.662+0000 7eff697fa640 1 -- 172.21.15.79:0/699463026 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7eff7000ee70 con 0x561f32b41150 2024-08-20T01:36:59.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.662+0000 7eff89fd6740 10 client.15429 fetch_fsmap learned FSMap version 28 2024-08-20T01:36:59.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.662+0000 7eff89fd6740 1 -- 172.21.15.79:0/699463026 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561f32b5bb50 con 0x561f32b41150 2024-08-20T01:36:59.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.662+0000 7eff697fa640 1 -- 172.21.15.79:0/699463026 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x561f32a56100 con 0x561f32b41150 2024-08-20T01:36:59.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.662+0000 7eff697fa640 1 -- 172.21.15.79:0/699463026 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7eff7000f040 con 0x561f32b41150 2024-08-20T01:36:59.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.662+0000 7eff89fd6740 10 client.15429 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:36:59.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.662+0000 7eff89fd6740 10 client.15429 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:36:59.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.662+0000 7eff89fd6740 20 client.15429 populate_metadata read hostname 'smithi079' 2024-08-20T01:36:59.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.662+0000 7eff89fd6740 1 --2- 172.21.15.79:0/699463026 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x561f32b5d060 0x561f32b5f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:59.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.662+0000 7eff89fd6740 4 client.15429 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:36:59.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.662+0000 7eff89fd6740 1 -- 172.21.15.79:0/699463026 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561f32ab9830 con 0x561f32b5d060 2024-08-20T01:36:59.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.663+0000 7eff85979640 1 --2- 172.21.15.79:0/699463026 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x561f32b5d060 0x561f32b5f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:59.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.663+0000 7eff85979640 1 --2- 172.21.15.79:0/699463026 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x561f32b5d060 0x561f32b5f480 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d87cfb4a88d2045 server_cookie=4659e18c54682be in_seq=0 out_seq=0 2024-08-20T01:36:59.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.663+0000 7eff697fa640 10 client.15429 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:36:59.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.664+0000 7eff697fa640 1 -- 172.21.15.79:0/699463026 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561f32ab9830 con 0x561f32b5d060 2024-08-20T01:36:59.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.664+0000 7eff697fa640 10 client.15429 handle_command_reply: tid=0 2024-08-20T01:36:59.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.664+0000 7eff89fd6740 1 client.15429 shutdown 2024-08-20T01:36:59.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.664+0000 7eff89fd6740 1 -- 172.21.15.79:0/699463026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f32b41150 msgr2=0x561f32b4a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:59.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.664+0000 7eff89fd6740 1 --2- 172.21.15.79:0/699463026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f32b41150 0x561f32b4a580 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7eff700106d0 tx=0x7eff70010b90 comp rx=0 tx=0).stop 2024-08-20T01:36:59.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.664+0000 7eff89fd6740 1 -- 172.21.15.79:0/699463026 shutdown_connections 2024-08-20T01:36:59.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.664+0000 7eff89fd6740 1 --2- 172.21.15.79:0/699463026 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x561f32b5d060 0x561f32b5f480 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:59.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.664+0000 7eff89fd6740 1 --2- 172.21.15.79:0/699463026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f32b4d0e0 0x561f32b4aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:59.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.664+0000 7eff89fd6740 1 --2- 172.21.15.79:0/699463026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f32b41150 0x561f32b4a580 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:59.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.664+0000 7eff697fa640 0 client.15429 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:36:59.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.664+0000 7eff89fd6740 1 --2- 172.21.15.79:0/699463026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f32b40830 0x561f32b4a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:59.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.664+0000 7eff89fd6740 1 -- 172.21.15.79:0/699463026 >> 172.21.15.79:0/699463026 conn(0x561f32b3e660 msgr2=0x561f32b44200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:59.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.664+0000 7eff89fd6740 1 -- 172.21.15.79:0/699463026 shutdown_connections 2024-08-20T01:36:59.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.664+0000 7eff89fd6740 1 -- 172.21.15.79:0/699463026 wait complete. 2024-08-20T01:36:59.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.665+0000 7eff89fd6740 20 client.15429 trim_cache size 0 max 16384 2024-08-20T01:36:59.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.681+0000 7eff89fd6740 1 Processor -- start 2024-08-20T01:36:59.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.681+0000 7eff89fd6740 1 -- start start 2024-08-20T01:36:59.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.682+0000 7eff89fd6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f32b40830 0x561f32b449f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:59.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.682+0000 7eff89fd6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f32b41150 0x561f32b64d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:59.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.682+0000 7eff89fd6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f32b4d0e0 0x561f32b65290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:59.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.682+0000 7eff89fd6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7eff801b01e0 con 0x561f32b4d0e0 2024-08-20T01:36:59.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.682+0000 7eff89fd6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7eff801b1d20 con 0x561f32b41150 2024-08-20T01:36:59.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.682+0000 7eff89fd6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7eff801b08b0 con 0x561f32b40830 2024-08-20T01:36:59.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.682+0000 7eff8617a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f32b4d0e0 0x561f32b65290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:59.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.682+0000 7eff8617a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f32b4d0e0 0x561f32b65290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46618/0 (socket says 172.21.15.79:46618) 2024-08-20T01:36:59.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.682+0000 7eff8617a640 1 -- 172.21.15.79:0/3892495280 learned_addr learned my addr 172.21.15.79:0/3892495280 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:59.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.682+0000 7eff85178640 1 --2- 172.21.15.79:0/3892495280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f32b41150 0x561f32b64d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:59.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.682+0000 7eff85979640 1 --2- 172.21.15.79:0/3892495280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f32b40830 0x561f32b449f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:59.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.682+0000 7eff8617a640 1 -- 172.21.15.79:0/3892495280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f32b40830 msgr2=0x561f32b449f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:59.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.682+0000 7eff8617a640 1 --2- 172.21.15.79:0/3892495280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f32b40830 0x561f32b449f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:59.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.682+0000 7eff8617a640 1 -- 172.21.15.79:0/3892495280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f32b41150 msgr2=0x561f32b64d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:59.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.682+0000 7eff8617a640 1 --2- 172.21.15.79:0/3892495280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f32b41150 0x561f32b64d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:59.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.682+0000 7eff8617a640 1 -- 172.21.15.79:0/3892495280 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f32b3f0e0 con 0x561f32b4d0e0 2024-08-20T01:36:59.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.682+0000 7eff85979640 1 --2- 172.21.15.79:0/3892495280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f32b40830 0x561f32b449f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:36:59.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.682+0000 7eff8617a640 1 --2- 172.21.15.79:0/3892495280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f32b4d0e0 0x561f32b65290 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7eff78035000 tx=0x7eff78041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de8c27368c97efab server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:59.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.682+0000 7eff6b7fe640 1 -- 172.21.15.79:0/3892495280 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff78032b90 con 0x561f32b4d0e0 2024-08-20T01:36:59.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.682+0000 7eff6b7fe640 1 -- 172.21.15.79:0/3892495280 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff78036040 con 0x561f32b4d0e0 2024-08-20T01:36:59.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.683+0000 7eff6b7fe640 1 -- 172.21.15.79:0/3892495280 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff780305c0 con 0x561f32b4d0e0 2024-08-20T01:36:59.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.683+0000 7eff89fd6740 1 -- 172.21.15.79:0/3892495280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f32b4d0e0 msgr2=0x561f32b65290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:59.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.683+0000 7eff89fd6740 1 --2- 172.21.15.79:0/3892495280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f32b4d0e0 0x561f32b65290 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7eff78035000 tx=0x7eff78041000 comp rx=0 tx=0).stop 2024-08-20T01:36:59.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.683+0000 7eff89fd6740 1 -- 172.21.15.79:0/3892495280 shutdown_connections 2024-08-20T01:36:59.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.683+0000 7eff89fd6740 1 --2- 172.21.15.79:0/3892495280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f32b4d0e0 0x561f32b65290 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:59.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.683+0000 7eff89fd6740 1 --2- 172.21.15.79:0/3892495280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f32b41150 0x561f32b64d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:59.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.683+0000 7eff89fd6740 1 --2- 172.21.15.79:0/3892495280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f32b40830 0x561f32b449f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:59.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.683+0000 7eff89fd6740 1 -- 172.21.15.79:0/3892495280 >> 172.21.15.79:0/3892495280 conn(0x561f32b3e660 msgr2=0x561f32b4be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:59.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.683+0000 7eff89fd6740 1 -- 172.21.15.79:0/3892495280 shutdown_connections 2024-08-20T01:36:59.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.683+0000 7eff89fd6740 1 -- 172.21.15.79:0/3892495280 wait complete. 2024-08-20T01:36:59.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.683+0000 7eff89fd6740 1 -- start start 2024-08-20T01:36:59.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.684+0000 7eff89fd6740 1 Processor -- start 2024-08-20T01:36:59.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.684+0000 7eff89fd6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f32b40830 0x561f32b52a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:59.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.684+0000 7eff89fd6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f32b41150 0x561f32b52f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:59.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.684+0000 7eff89fd6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f32b4d0e0 0x561f32bbed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:59.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.684+0000 7eff89fd6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7eff801b1650 con 0x561f32b40830 2024-08-20T01:36:59.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.684+0000 7eff89fd6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7eff801b0f80 con 0x561f32b4d0e0 2024-08-20T01:36:59.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.684+0000 7eff89fd6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7eff801ae1c0 con 0x561f32b41150 2024-08-20T01:36:59.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.684+0000 7eff89fd6740 10 client.0 _ll_register_callbacks cb 0x7eff70009380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:36:59.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.684+0000 7eff85979640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f32b40830 0x561f32b52a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:59.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.684+0000 7eff85979640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f32b40830 0x561f32b52a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46620/0 (socket says 172.21.15.79:46620) 2024-08-20T01:36:59.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.684+0000 7eff85979640 1 -- 172.21.15.79:0/1355046851 learned_addr learned my addr 172.21.15.79:0/1355046851 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:36:59.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.684+0000 7eff8617a640 1 --2- 172.21.15.79:0/1355046851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f32b4d0e0 0x561f32bbed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:59.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.684+0000 7eff85178640 1 --2- 172.21.15.79:0/1355046851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f32b41150 0x561f32b52f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:59.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.684+0000 7eff85979640 1 -- 172.21.15.79:0/1355046851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f32b41150 msgr2=0x561f32b52f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:59.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.684+0000 7eff85979640 1 --2- 172.21.15.79:0/1355046851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f32b41150 0x561f32b52f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:59.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.684+0000 7eff85979640 1 -- 172.21.15.79:0/1355046851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f32b4d0e0 msgr2=0x561f32bbed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:36:59.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.684+0000 7eff85979640 1 --2- 172.21.15.79:0/1355046851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f32b4d0e0 0x561f32bbed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:59.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.684+0000 7eff85979640 1 -- 172.21.15.79:0/1355046851 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f32bbf460 con 0x561f32b40830 2024-08-20T01:36:59.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.684+0000 7eff85178640 1 --2- 172.21.15.79:0/1355046851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f32b41150 0x561f32b52f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:36:59.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.685+0000 7eff85979640 1 --2- 172.21.15.79:0/1355046851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f32b40830 0x561f32b52a00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7eff7c0a6890 tx=0x7eff7c0a6040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7341aff8ee0b0772 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:36:59.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.685+0000 7eff697fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:36:59.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.685+0000 7eff697fa640 1 -- 172.21.15.79:0/1355046851 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7c020070 con 0x561f32b40830 2024-08-20T01:36:59.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.685+0000 7eff697fa640 1 -- 172.21.15.79:0/1355046851 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7eff7c0a6aa0 con 0x561f32b40830 2024-08-20T01:36:59.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.685+0000 7eff89fd6740 1 -- 172.21.15.79:0/1355046851 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff78036040 con 0x561f32b40830 2024-08-20T01:36:59.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.685+0000 7eff697fa640 1 -- 172.21.15.79:0/1355046851 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7eff7c0f2070 con 0x561f32b40830 2024-08-20T01:36:59.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.685+0000 7eff89fd6740 10 client.15435 fetch_fsmap learned FSMap version 28 2024-08-20T01:36:59.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.685+0000 7eff89fd6740 1 -- 172.21.15.79:0/1355046851 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561f32bc7960 con 0x561f32b40830 2024-08-20T01:36:59.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.685+0000 7eff697fa640 1 -- 172.21.15.79:0/1355046851 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff78036040 con 0x561f32b40830 2024-08-20T01:36:59.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.685+0000 7eff697fa640 1 -- 172.21.15.79:0/1355046851 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7eff7c0aaa70 con 0x561f32b40830 2024-08-20T01:36:59.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.685+0000 7eff89fd6740 10 client.15435 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:36:59.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.685+0000 7eff89fd6740 10 client.15435 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:36:59.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.685+0000 7eff89fd6740 20 client.15435 populate_metadata read hostname 'smithi079' 2024-08-20T01:36:59.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.685+0000 7eff89fd6740 1 --2- 172.21.15.79:0/1355046851 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x561f32bc7ca0 0x561f32bca090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:36:59.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.685+0000 7eff89fd6740 4 client.15435 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:36:59.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.685+0000 7eff89fd6740 1 -- 172.21.15.79:0/1355046851 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561f32ab52d0 con 0x561f32bc7ca0 2024-08-20T01:36:59.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.686+0000 7eff85178640 1 --2- 172.21.15.79:0/1355046851 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x561f32bc7ca0 0x561f32bca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:36:59.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.686+0000 7eff697fa640 10 client.15435 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:36:59.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.686+0000 7eff85178640 1 --2- 172.21.15.79:0/1355046851 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x561f32bc7ca0 0x561f32bca090 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ac1cb03a6e87aba server_cookie=a78d54f6c1576bcf in_seq=0 out_seq=0 2024-08-20T01:36:59.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.686+0000 7eff697fa640 1 -- 172.21.15.79:0/1355046851 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x561f32ab52d0 con 0x561f32bc7ca0 2024-08-20T01:36:59.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.686+0000 7eff697fa640 10 client.15435 handle_command_reply: tid=0 2024-08-20T01:36:59.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.686+0000 7eff89fd6740 1 client.15435 shutdown 2024-08-20T01:36:59.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.686+0000 7eff89fd6740 1 -- 172.21.15.79:0/1355046851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f32b40830 msgr2=0x561f32b52a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:59.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.686+0000 7eff89fd6740 1 --2- 172.21.15.79:0/1355046851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f32b40830 0x561f32b52a00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7eff7c0a6890 tx=0x7eff7c0a6040 comp rx=0 tx=0).stop 2024-08-20T01:36:59.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.686+0000 7eff89fd6740 1 -- 172.21.15.79:0/1355046851 shutdown_connections 2024-08-20T01:36:59.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.686+0000 7eff89fd6740 1 --2- 172.21.15.79:0/1355046851 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x561f32bc7ca0 0x561f32bca090 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:59.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.686+0000 7eff89fd6740 1 --2- 172.21.15.79:0/1355046851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f32b4d0e0 0x561f32bbed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:59.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.686+0000 7eff89fd6740 1 --2- 172.21.15.79:0/1355046851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f32b41150 0x561f32b52f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:59.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.686+0000 7eff89fd6740 1 --2- 172.21.15.79:0/1355046851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561f32b40830 0x561f32b52a00 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:59.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.686+0000 7eff697fa640 0 client.15435 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:36:59.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.686+0000 7eff89fd6740 1 -- 172.21.15.79:0/1355046851 >> 172.21.15.79:0/1355046851 conn(0x561f32b3e660 msgr2=0x561f32b3cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:59.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.686+0000 7eff89fd6740 1 -- 172.21.15.79:0/1355046851 shutdown_connections 2024-08-20T01:36:59.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.687+0000 7eff89fd6740 1 -- 172.21.15.79:0/1355046851 wait complete. 2024-08-20T01:36:59.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.687+0000 7eff89fd6740 20 client.15435 trim_cache size 0 max 16384 2024-08-20T01:36:59.700 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:36:59.701 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-20T01:36:59.701 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": { 2024-08-20T01:36:59.701 INFO:teuthology.orchestra.run.smithi079.stdout: "d87c951b-8f90-47f4-96a0-7f2f8469ff7a": { 2024-08-20T01:36:59.701 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/", 2024-08-20T01:36:59.701 INFO:teuthology.orchestra.run.smithi079.stdout: "tag": "d87c951b-8f90-47f4-96a0-7f2f8469ff7a", 2024-08-20T01:36:59.701 INFO:teuthology.orchestra.run.smithi079.stdout: "options": "recursive,force" 2024-08-20T01:36:59.701 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:36:59.701 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:36:59.701 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:36:59.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.687+0000 7eff87bdd640 1 -- 172.21.15.79:0/1698232482 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7eff6c0b3c50 msgr2=0x7eff6c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:59.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.687+0000 7eff87bdd640 1 --2- 172.21.15.79:0/1698232482 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7eff6c0b3c50 0x7eff6c0b6110 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7eff78005e30 tx=0x7eff78005d80 comp rx=0 tx=0).stop 2024-08-20T01:36:59.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.687+0000 7eff87bdd640 1 -- 172.21.15.79:0/1698232482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff801019b0 msgr2=0x7eff800fd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:36:59.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.687+0000 7eff87bdd640 1 --2- 172.21.15.79:0/1698232482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff801019b0 0x7eff800fd920 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7eff7c00d950 tx=0x7eff7c00de10 comp rx=0 tx=0).stop 2024-08-20T01:36:59.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.687+0000 7eff87bdd640 1 -- 172.21.15.79:0/1698232482 shutdown_connections 2024-08-20T01:36:59.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.687+0000 7eff87bdd640 1 --2- 172.21.15.79:0/1698232482 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7eff6c0b3c50 0x7eff6c0b6110 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:59.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.687+0000 7eff87bdd640 1 --2- 172.21.15.79:0/1698232482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff80107d40 0x7eff800fe3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:59.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.687+0000 7eff87bdd640 1 --2- 172.21.15.79:0/1698232482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff801073c0 0x7eff800fde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:59.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.687+0000 7eff87bdd640 1 --2- 172.21.15.79:0/1698232482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff801019b0 0x7eff800fd920 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:36:59.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.687+0000 7eff87bdd640 1 -- 172.21.15.79:0/1698232482 >> 172.21.15.79:0/1698232482 conn(0x7eff800fd420 msgr2=0x7eff8006b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:36:59.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.687+0000 7eff87bdd640 1 -- 172.21.15.79:0/1698232482 shutdown_connections 2024-08-20T01:36:59.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:36:59.687+0000 7eff87bdd640 1 -- 172.21.15.79:0/1698232482 wait complete. 2024-08-20T01:37:00.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:00 smithi175 ceph-mon[22392]: pgmap v337: 97 pgs: 97 active+clean; 654 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.0 KiB/s wr, 13 op/s 2024-08-20T01:37:00.421 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:00 smithi079 ceph-mon[18656]: pgmap v337: 97 pgs: 97 active+clean; 654 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.0 KiB/s wr, 13 op/s 2024-08-20T01:37:00.448 INFO:tasks.cephfs.filesystem:scrub status for tag:d87c951b-8f90-47f4-96a0-7f2f8469ff7a - {'path': '/', 'tag': 'd87c951b-8f90-47f4-96a0-7f2f8469ff7a', 'options': 'recursive,force'} 2024-08-20T01:37:00.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:00 smithi081 ceph-mon[22209]: pgmap v337: 97 pgs: 97 active+clean; 654 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.0 KiB/s wr, 13 op/s 2024-08-20T01:37:02.336 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:02 smithi175 ceph-mon[22392]: pgmap v338: 97 pgs: 97 active+clean; 654 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-08-20T01:37:02.337 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:02 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:37:02.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:02 smithi079 ceph-mon[18656]: pgmap v338: 97 pgs: 97 active+clean; 654 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-08-20T01:37:02.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:02 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:37:02.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:02 smithi081 ceph-mon[22209]: pgmap v338: 97 pgs: 97 active+clean; 654 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-08-20T01:37:02.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:02 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:37:04.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:03 smithi079 ceph-mon[18656]: pgmap v339: 97 pgs: 97 active+clean; 654 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-08-20T01:37:04.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:03 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:37:04.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:03 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:37:04.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:03 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:37:04.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:03 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:37:04.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:03 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:37:04.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:03 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:37:04.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:03 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:37:04.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:03 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:37:04.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:03 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:37:04.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:03 smithi081 ceph-mon[22209]: pgmap v339: 97 pgs: 97 active+clean; 654 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-08-20T01:37:04.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:03 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:37:04.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:03 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:37:04.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:03 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:37:04.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:03 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:37:04.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:03 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:37:04.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:03 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:37:04.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:03 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:37:04.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:03 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:37:04.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:03 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:37:04.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:03 smithi175 ceph-mon[22392]: pgmap v339: 97 pgs: 97 active+clean; 654 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-08-20T01:37:04.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:03 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:37:04.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:03 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:37:04.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:03 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:37:04.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:03 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:37:04.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:03 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:37:04.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:03 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:37:04.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:03 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:37:04.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:03 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:37:04.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:03 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:37:06.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:05 smithi079 ceph-mon[18656]: pgmap v340: 97 pgs: 97 active+clean; 654 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1023 B/s wr, 11 op/s 2024-08-20T01:37:06.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:05 smithi081 ceph-mon[22209]: pgmap v340: 97 pgs: 97 active+clean; 654 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1023 B/s wr, 11 op/s 2024-08-20T01:37:06.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:05 smithi175 ceph-mon[22392]: pgmap v340: 97 pgs: 97 active+clean; 654 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1023 B/s wr, 11 op/s 2024-08-20T01:37:08.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:07 smithi079 ceph-mon[18656]: pgmap v341: 97 pgs: 97 active+clean; 654 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-08-20T01:37:08.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:07 smithi081 ceph-mon[22209]: pgmap v341: 97 pgs: 97 active+clean; 654 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-08-20T01:37:08.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:07 smithi175 ceph-mon[22392]: pgmap v341: 97 pgs: 97 active+clean; 654 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-08-20T01:37:10.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:09 smithi079 ceph-mon[18656]: pgmap v342: 97 pgs: 97 active+clean; 659 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-08-20T01:37:10.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:09 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:37:10.191 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:09 smithi175 ceph-mon[22392]: pgmap v342: 97 pgs: 97 active+clean; 659 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-08-20T01:37:10.191 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:09 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:37:10.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:09 smithi081 ceph-mon[22209]: pgmap v342: 97 pgs: 97 active+clean; 659 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-08-20T01:37:10.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:09 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:37:10.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.395+0000 7f98c240b640 1 -- 172.21.15.79:0/236296436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98bc101560 msgr2=0x7f98bc101960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:10.480 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.395+0000 7f98c240b640 1 --2- 172.21.15.79:0/236296436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98bc101560 0x7f98bc101960 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f98ac009930 tx=0x7f98ac02a420 comp rx=0 tx=0).stop 2024-08-20T01:37:10.480 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.395+0000 7f98c240b640 1 -- 172.21.15.79:0/236296436 shutdown_connections 2024-08-20T01:37:10.480 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.395+0000 7f98c240b640 1 --2- 172.21.15.79:0/236296436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98bc103070 0x7f98bc1099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:10.480 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.395+0000 7f98c240b640 1 --2- 172.21.15.79:0/236296436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98bc1026b0 0x7f98bc102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:10.480 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.395+0000 7f98c240b640 1 --2- 172.21.15.79:0/236296436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98bc101560 0x7f98bc101960 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:10.480 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.395+0000 7f98c240b640 1 -- 172.21.15.79:0/236296436 >> 172.21.15.79:0/236296436 conn(0x7f98bc0fce40 msgr2=0x7f98bc0ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:10.480 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.395+0000 7f98c240b640 1 -- 172.21.15.79:0/236296436 shutdown_connections 2024-08-20T01:37:10.480 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.395+0000 7f98c240b640 1 -- 172.21.15.79:0/236296436 wait complete. 2024-08-20T01:37:10.480 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.396+0000 7f98c240b640 1 Processor -- start 2024-08-20T01:37:10.480 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.396+0000 7f98c240b640 1 -- start start 2024-08-20T01:37:10.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.396+0000 7f98c240b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98bc101560 0x7f98bc06ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:10.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.396+0000 7f98c240b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98bc1026b0 0x7f98bc19d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:10.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.396+0000 7f98c240b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98bc103070 0x7f98bc19fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:10.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.396+0000 7f98c240b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f98bc10d090 con 0x7f98bc101560 2024-08-20T01:37:10.502 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.396+0000 7f98c240b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f98bc10cf10 con 0x7f98bc103070 2024-08-20T01:37:10.502 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.396+0000 7f98c240b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f98bc10d210 con 0x7f98bc1026b0 2024-08-20T01:37:10.502 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.396+0000 7f98bbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98bc101560 0x7f98bc06ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:10.502 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.396+0000 7f98bbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98bc101560 0x7f98bc06ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36948/0 (socket says 172.21.15.79:36948) 2024-08-20T01:37:10.502 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.396+0000 7f98bbfff640 1 -- 172.21.15.79:0/1901154851 learned_addr learned my addr 172.21.15.79:0/1901154851 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:10.503 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.396+0000 7f98bb7fe640 1 --2- 172.21.15.79:0/1901154851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98bc1026b0 0x7f98bc19d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:10.503 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.396+0000 7f98c09a8640 1 --2- 172.21.15.79:0/1901154851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98bc103070 0x7f98bc19fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:10.503 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.397+0000 7f98bbfff640 1 -- 172.21.15.79:0/1901154851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98bc1026b0 msgr2=0x7f98bc19d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:10.503 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.397+0000 7f98bbfff640 1 --2- 172.21.15.79:0/1901154851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98bc1026b0 0x7f98bc19d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:10.503 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.397+0000 7f98bbfff640 1 -- 172.21.15.79:0/1901154851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98bc103070 msgr2=0x7f98bc19fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:10.503 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.397+0000 7f98bbfff640 1 --2- 172.21.15.79:0/1901154851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98bc103070 0x7f98bc19fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:10.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.397+0000 7f98bbfff640 1 -- 172.21.15.79:0/1901154851 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98bc1a05c0 con 0x7f98bc101560 2024-08-20T01:37:10.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.397+0000 7f98bb7fe640 1 --2- 172.21.15.79:0/1901154851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98bc1026b0 0x7f98bc19d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:37:10.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.397+0000 7f98bbfff640 1 --2- 172.21.15.79:0/1901154851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98bc101560 0x7f98bc06ae80 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f98ac005ab0 tx=0x7f98ac0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:10.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.397+0000 7f98b97fa640 1 -- 172.21.15.79:0/1901154851 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98ac03f030 con 0x7f98bc101560 2024-08-20T01:37:10.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.397+0000 7f98b97fa640 1 -- 172.21.15.79:0/1901154851 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f98ac003c90 con 0x7f98bc101560 2024-08-20T01:37:10.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.397+0000 7f98c240b640 1 -- 172.21.15.79:0/1901154851 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98bc1a0850 con 0x7f98bc101560 2024-08-20T01:37:10.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.397+0000 7f98b97fa640 1 -- 172.21.15.79:0/1901154851 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98ac035070 con 0x7f98bc101560 2024-08-20T01:37:10.505 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.397+0000 7f98c240b640 1 -- 172.21.15.79:0/1901154851 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98bc1a0d40 con 0x7f98bc101560 2024-08-20T01:37:10.505 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.399+0000 7f98c51fc740 1 Processor -- start 2024-08-20T01:37:10.505 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.399+0000 7f98b97fa640 1 -- 172.21.15.79:0/1901154851 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f98ac042030 con 0x7f98bc101560 2024-08-20T01:37:10.505 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.399+0000 7f98c51fc740 1 -- start start 2024-08-20T01:37:10.505 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.400+0000 7f98c51fc740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646774fe630 0x564677500a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:10.505 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.400+0000 7f98c51fc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564677500f60 0x564677503350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:10.505 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.400+0000 7f98c51fc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646775039a0 0x564677505e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:10.506 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.400+0000 7f98c51fc740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564677471360 con 0x5646774fe630 2024-08-20T01:37:10.506 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.400+0000 7f98c51fc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564677460860 con 0x564677500f60 2024-08-20T01:37:10.506 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.400+0000 7f98c51fc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5646774648a0 con 0x5646775039a0 2024-08-20T01:37:10.506 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.400+0000 7f98c09a8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646774fe630 0x564677500a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:10.506 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.400+0000 7f98c09a8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646774fe630 0x564677500a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36950/0 (socket says 172.21.15.79:36950) 2024-08-20T01:37:10.506 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.400+0000 7f98c09a8640 1 -- 172.21.15.79:0/3660886488 learned_addr learned my addr 172.21.15.79:0/3660886488 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:10.507 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.400+0000 7f98bb7fe640 1 --2- 172.21.15.79:0/3660886488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646775039a0 0x564677505e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:10.507 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.400+0000 7f98bbfff640 1 --2- 172.21.15.79:0/3660886488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564677500f60 0x564677503350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:10.507 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.400+0000 7f98c09a8640 1 -- 172.21.15.79:0/3660886488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646775039a0 msgr2=0x564677505e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:10.507 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.400+0000 7f98c09a8640 1 --2- 172.21.15.79:0/3660886488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646775039a0 0x564677505e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:10.507 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.400+0000 7f98c09a8640 1 -- 172.21.15.79:0/3660886488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564677500f60 msgr2=0x564677503350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:10.507 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.400+0000 7f98c09a8640 1 --2- 172.21.15.79:0/3660886488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564677500f60 0x564677503350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:10.508 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.400+0000 7f98c09a8640 1 -- 172.21.15.79:0/3660886488 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564677407e40 con 0x5646774fe630 2024-08-20T01:37:10.508 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.400+0000 7f98bb7fe640 1 --2- 172.21.15.79:0/3660886488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646775039a0 0x564677505e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:37:10.508 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.400+0000 7f98bbfff640 1 --2- 172.21.15.79:0/3660886488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564677500f60 0x564677503350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:37:10.508 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.400+0000 7f98b97fa640 1 --2- 172.21.15.79:0/1901154851 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f98a40b3bd0 0x7f98a40b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:10.508 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.400+0000 7f98c09a8640 1 --2- 172.21.15.79:0/3660886488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646774fe630 0x564677500a20 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f98b4008dc0 tx=0x7f98b400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92bcf9af9e675d4a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:10.508 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.400+0000 7f98bbfff640 1 --2- 172.21.15.79:0/1901154851 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f98a40b3bd0 0x7f98a40b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:10.509 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.400+0000 7f98a27fc640 1 -- 172.21.15.79:0/3660886488 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b4014070 con 0x5646774fe630 2024-08-20T01:37:10.509 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.401+0000 7f98a27fc640 1 -- 172.21.15.79:0/3660886488 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f98b4004020 con 0x5646774fe630 2024-08-20T01:37:10.509 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.401+0000 7f98a27fc640 1 -- 172.21.15.79:0/3660886488 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b4010690 con 0x5646774fe630 2024-08-20T01:37:10.509 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.401+0000 7f98b97fa640 1 -- 172.21.15.79:0/1901154851 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f98ac104420 con 0x7f98bc101560 2024-08-20T01:37:10.509 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.401+0000 7f98c51fc740 1 -- 172.21.15.79:0/3660886488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646774fe630 msgr2=0x564677500a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:10.509 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.401+0000 7f98bbfff640 1 --2- 172.21.15.79:0/1901154851 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f98a40b3bd0 0x7f98a40b6090 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f98ac0856e0 tx=0x7f98ac02a420 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:10.510 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.401+0000 7f98c51fc740 1 --2- 172.21.15.79:0/3660886488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646774fe630 0x564677500a20 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f98b4008dc0 tx=0x7f98b400e720 comp rx=0 tx=0).stop 2024-08-20T01:37:10.510 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.401+0000 7f98c51fc740 1 -- 172.21.15.79:0/3660886488 shutdown_connections 2024-08-20T01:37:10.510 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.401+0000 7f98c51fc740 1 --2- 172.21.15.79:0/3660886488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646775039a0 0x564677505e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:10.510 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.401+0000 7f98c51fc740 1 --2- 172.21.15.79:0/3660886488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564677500f60 0x564677503350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:10.510 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.401+0000 7f98c51fc740 1 --2- 172.21.15.79:0/3660886488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646774fe630 0x564677500a20 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:10.511 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.401+0000 7f98c51fc740 1 -- 172.21.15.79:0/3660886488 >> 172.21.15.79:0/3660886488 conn(0x5646774f9730 msgr2=0x5646774fa510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:10.511 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.401+0000 7f98c51fc740 1 -- 172.21.15.79:0/3660886488 shutdown_connections 2024-08-20T01:37:10.511 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.401+0000 7f98c51fc740 1 -- 172.21.15.79:0/3660886488 wait complete. 2024-08-20T01:37:10.511 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.402+0000 7f98c51fc740 1 -- start start 2024-08-20T01:37:10.511 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.402+0000 7f98c51fc740 1 Processor -- start 2024-08-20T01:37:10.511 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.402+0000 7f98c51fc740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646774fe630 0x564677507eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:10.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.402+0000 7f98c51fc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564677500f60 0x564677508550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:10.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.402+0000 7f98c51fc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646775039a0 0x564677509120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:10.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.402+0000 7f98c51fc740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564677399ab0 con 0x5646774fe630 2024-08-20T01:37:10.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.402+0000 7f98c51fc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5646773e7780 con 0x5646775039a0 2024-08-20T01:37:10.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.402+0000 7f98c51fc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564677506980 con 0x564677500f60 2024-08-20T01:37:10.513 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.402+0000 7f98c51fc740 10 client.0 _ll_register_callbacks cb 0x56467716fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:10.513 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.402+0000 7f98c09a8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646774fe630 0x564677507eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:10.513 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.402+0000 7f98c09a8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646774fe630 0x564677507eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36966/0 (socket says 172.21.15.79:36966) 2024-08-20T01:37:10.513 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.402+0000 7f98c09a8640 1 -- 172.21.15.79:0/2787630356 learned_addr learned my addr 172.21.15.79:0/2787630356 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:10.513 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.402+0000 7f98bb7fe640 1 --2- 172.21.15.79:0/2787630356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564677500f60 0x564677508550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:10.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.403+0000 7f98c09a8640 1 -- 172.21.15.79:0/2787630356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564677500f60 msgr2=0x564677508550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:10.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.403+0000 7f98c09a8640 1 --2- 172.21.15.79:0/2787630356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564677500f60 0x564677508550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:10.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.403+0000 7f98c09a8640 1 -- 172.21.15.79:0/2787630356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646775039a0 msgr2=0x564677509120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:10.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.403+0000 7f98c09a8640 1 --2- 172.21.15.79:0/2787630356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646775039a0 0x564677509120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:10.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.403+0000 7f98c09a8640 1 -- 172.21.15.79:0/2787630356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646771c3790 con 0x5646774fe630 2024-08-20T01:37:10.515 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.403+0000 7f98c09a8640 1 --2- 172.21.15.79:0/2787630356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646774fe630 0x564677507eb0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f98b4005b40 tx=0x7f98b4010c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b919e05dbf71a71 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:10.515 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.403+0000 7f989b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:37:10.515 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.403+0000 7f989b7fe640 1 -- 172.21.15.79:0/2787630356 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b4014070 con 0x5646774fe630 2024-08-20T01:37:10.515 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.403+0000 7f989b7fe640 1 -- 172.21.15.79:0/2787630356 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f98b4018820 con 0x5646774fe630 2024-08-20T01:37:10.515 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.403+0000 7f98c51fc740 1 -- 172.21.15.79:0/2787630356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56467740fe00 con 0x5646774fe630 2024-08-20T01:37:10.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.403+0000 7f989b7fe640 1 -- 172.21.15.79:0/2787630356 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f98b4010e20 con 0x5646774fe630 2024-08-20T01:37:10.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.403+0000 7f98c51fc740 10 client.15447 fetch_fsmap learned FSMap version 28 2024-08-20T01:37:10.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.403+0000 7f98c51fc740 1 -- 172.21.15.79:0/2787630356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56467723c620 con 0x5646774fe630 2024-08-20T01:37:10.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.403+0000 7f989b7fe640 1 -- 172.21.15.79:0/2787630356 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56467740fe00 con 0x5646774fe630 2024-08-20T01:37:10.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.403+0000 7f989b7fe640 1 -- 172.21.15.79:0/2787630356 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f98b4025bc0 con 0x5646774fe630 2024-08-20T01:37:10.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.404+0000 7f98c51fc740 10 client.15447 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:37:10.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.404+0000 7f98c51fc740 10 client.15447 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:37:10.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.404+0000 7f98c51fc740 20 client.15447 populate_metadata read hostname 'smithi079' 2024-08-20T01:37:10.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.404+0000 7f98c51fc740 1 --2- 172.21.15.79:0/2787630356 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564677513410 0x564677515800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:10.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.404+0000 7f98c51fc740 4 client.15447 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:37:10.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.404+0000 7f98c51fc740 1 -- 172.21.15.79:0/2787630356 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5646774732b0 con 0x564677513410 2024-08-20T01:37:10.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.404+0000 7f98bb7fe640 1 --2- 172.21.15.79:0/2787630356 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564677513410 0x564677515800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:10.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.404+0000 7f989b7fe640 10 client.15447 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:37:10.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.404+0000 7f98bb7fe640 1 --2- 172.21.15.79:0/2787630356 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564677513410 0x564677515800 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea31d11830697b4c server_cookie=2991446359fd5d33 in_seq=0 out_seq=0 2024-08-20T01:37:10.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.405+0000 7f989b7fe640 1 -- 172.21.15.79:0/2787630356 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5646774732b0 con 0x564677513410 2024-08-20T01:37:10.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.405+0000 7f989b7fe640 10 client.15447 handle_command_reply: tid=0 2024-08-20T01:37:10.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.405+0000 7f98c51fc740 1 client.15447 shutdown 2024-08-20T01:37:10.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.405+0000 7f98c51fc740 1 -- 172.21.15.79:0/2787630356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646774fe630 msgr2=0x564677507eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:10.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.405+0000 7f98c51fc740 1 --2- 172.21.15.79:0/2787630356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646774fe630 0x564677507eb0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f98b4005b40 tx=0x7f98b4010c30 comp rx=0 tx=0).stop 2024-08-20T01:37:10.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.405+0000 7f98c51fc740 1 -- 172.21.15.79:0/2787630356 shutdown_connections 2024-08-20T01:37:10.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.405+0000 7f98c51fc740 1 --2- 172.21.15.79:0/2787630356 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564677513410 0x564677515800 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:10.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.405+0000 7f98c51fc740 1 --2- 172.21.15.79:0/2787630356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646775039a0 0x564677509120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:10.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.405+0000 7f98c51fc740 1 --2- 172.21.15.79:0/2787630356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564677500f60 0x564677508550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:10.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.405+0000 7f989b7fe640 0 client.15447 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:37:10.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.405+0000 7f98c51fc740 1 --2- 172.21.15.79:0/2787630356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646774fe630 0x564677507eb0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:10.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.405+0000 7f98c51fc740 1 -- 172.21.15.79:0/2787630356 >> 172.21.15.79:0/2787630356 conn(0x5646774f9730 msgr2=0x5646774f8850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:10.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.405+0000 7f98c51fc740 1 -- 172.21.15.79:0/2787630356 shutdown_connections 2024-08-20T01:37:10.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.405+0000 7f98c51fc740 1 -- 172.21.15.79:0/2787630356 wait complete. 2024-08-20T01:37:10.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.405+0000 7f98c51fc740 20 client.15447 trim_cache size 0 max 16384 2024-08-20T01:37:10.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.423+0000 7f98c51fc740 1 Processor -- start 2024-08-20T01:37:10.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.423+0000 7f98c51fc740 1 -- start start 2024-08-20T01:37:10.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.423+0000 7f98c51fc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646774fe630 0x564677507c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:10.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.423+0000 7f98c51fc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564677500f60 0x5646774f8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:10.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.423+0000 7f98c51fc740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646775039a0 0x5646774f8570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:10.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.423+0000 7f98c51fc740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f98bc1a9ae0 con 0x5646775039a0 2024-08-20T01:37:10.521 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.423+0000 7f98c51fc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f98bc1ab620 con 0x564677500f60 2024-08-20T01:37:10.521 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.423+0000 7f98c51fc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f98bc1aa1b0 con 0x5646774fe630 2024-08-20T01:37:10.521 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.424+0000 7f98c09a8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646775039a0 0x5646774f8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:10.521 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.424+0000 7f98c09a8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646775039a0 0x5646774f8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36982/0 (socket says 172.21.15.79:36982) 2024-08-20T01:37:10.521 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.424+0000 7f98c09a8640 1 -- 172.21.15.79:0/36073275 learned_addr learned my addr 172.21.15.79:0/36073275 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:10.521 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.424+0000 7f98c09a8640 1 --2- 172.21.15.79:0/36073275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646774fe630 0x564677507c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:10.522 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.424+0000 7f98bb7fe640 1 --2- 172.21.15.79:0/36073275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564677500f60 0x5646774f8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:10.522 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.424+0000 7f98c09a8640 1 -- 172.21.15.79:0/36073275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646774fe630 msgr2=0x564677507c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:10.522 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.424+0000 7f98c09a8640 1 --2- 172.21.15.79:0/36073275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646774fe630 0x564677507c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:10.522 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.424+0000 7f98c09a8640 1 -- 172.21.15.79:0/36073275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564677500f60 msgr2=0x5646774f8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:10.522 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.424+0000 7f98c09a8640 1 --2- 172.21.15.79:0/36073275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564677500f60 0x5646774f8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:10.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.424+0000 7f98c09a8640 1 -- 172.21.15.79:0/36073275 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646774fa9e0 con 0x5646775039a0 2024-08-20T01:37:10.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.424+0000 7f98bb7fe640 1 --2- 172.21.15.79:0/36073275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564677500f60 0x5646774f8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:37:10.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.424+0000 7f98c09a8640 1 --2- 172.21.15.79:0/36073275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646775039a0 0x5646774f8570 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f98b4005e10 tx=0x7f98b4025f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f39b2580cf6182 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:10.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.424+0000 7f98a1ffb640 1 -- 172.21.15.79:0/36073275 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b4014070 con 0x5646775039a0 2024-08-20T01:37:10.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.424+0000 7f98a1ffb640 1 -- 172.21.15.79:0/36073275 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f98b4020070 con 0x5646775039a0 2024-08-20T01:37:10.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.424+0000 7f98a1ffb640 1 -- 172.21.15.79:0/36073275 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b4003c60 con 0x5646775039a0 2024-08-20T01:37:10.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.425+0000 7f98c51fc740 1 -- 172.21.15.79:0/36073275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646775039a0 msgr2=0x5646774f8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:10.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.425+0000 7f98c51fc740 1 --2- 172.21.15.79:0/36073275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646775039a0 0x5646774f8570 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f98b4005e10 tx=0x7f98b4025f90 comp rx=0 tx=0).stop 2024-08-20T01:37:10.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.425+0000 7f98c51fc740 1 -- 172.21.15.79:0/36073275 shutdown_connections 2024-08-20T01:37:10.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.425+0000 7f98c51fc740 1 --2- 172.21.15.79:0/36073275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646775039a0 0x5646774f8570 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:10.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.425+0000 7f98c51fc740 1 --2- 172.21.15.79:0/36073275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564677500f60 0x5646774f8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:10.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.425+0000 7f98c51fc740 1 --2- 172.21.15.79:0/36073275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646774fe630 0x564677507c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:10.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.425+0000 7f98c51fc740 1 -- 172.21.15.79:0/36073275 >> 172.21.15.79:0/36073275 conn(0x5646774f9730 msgr2=0x564677505380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:10.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.425+0000 7f98c51fc740 1 -- 172.21.15.79:0/36073275 shutdown_connections 2024-08-20T01:37:10.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.425+0000 7f98c51fc740 1 -- 172.21.15.79:0/36073275 wait complete. 2024-08-20T01:37:10.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.425+0000 7f98c51fc740 1 -- start start 2024-08-20T01:37:10.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.426+0000 7f98c51fc740 1 Processor -- start 2024-08-20T01:37:10.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.426+0000 7f98c51fc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646774fe630 0x56467750f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:10.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.426+0000 7f98c51fc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564677500f60 0x56467750fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:10.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.426+0000 7f98c51fc740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646775039a0 0x56467750e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:10.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.426+0000 7f98c51fc740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f98bc1aaf50 con 0x5646775039a0 2024-08-20T01:37:10.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.426+0000 7f98c51fc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f98bc1aa880 con 0x564677500f60 2024-08-20T01:37:10.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.426+0000 7f98c51fc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f98bc1a7ac0 con 0x5646774fe630 2024-08-20T01:37:10.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.426+0000 7f98c51fc740 10 client.0 _ll_register_callbacks cb 0x7f98b4008c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:10.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.426+0000 7f98c09a8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646775039a0 0x56467750e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:10.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.426+0000 7f98c09a8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646775039a0 0x56467750e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36994/0 (socket says 172.21.15.79:36994) 2024-08-20T01:37:10.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.426+0000 7f98c09a8640 1 -- 172.21.15.79:0/1139303 learned_addr learned my addr 172.21.15.79:0/1139303 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:10.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.426+0000 7f98c09a8640 1 --2- 172.21.15.79:0/1139303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646774fe630 0x56467750f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:10.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.426+0000 7f98bb7fe640 1 --2- 172.21.15.79:0/1139303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564677500f60 0x56467750fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:10.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.426+0000 7f98c09a8640 1 -- 172.21.15.79:0/1139303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646774fe630 msgr2=0x56467750f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:10.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.426+0000 7f98c09a8640 1 --2- 172.21.15.79:0/1139303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646774fe630 0x56467750f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:10.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.426+0000 7f98c09a8640 1 -- 172.21.15.79:0/1139303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564677500f60 msgr2=0x56467750fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:10.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.426+0000 7f98c09a8640 1 --2- 172.21.15.79:0/1139303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564677500f60 0x56467750fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:10.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.426+0000 7f98c09a8640 1 -- 172.21.15.79:0/1139303 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564677500d90 con 0x5646775039a0 2024-08-20T01:37:10.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.426+0000 7f98bb7fe640 1 --2- 172.21.15.79:0/1139303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564677500f60 0x56467750fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:37:10.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.426+0000 7f98c09a8640 1 --2- 172.21.15.79:0/1139303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646775039a0 0x56467750e4d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f98b4010800 tx=0x7f98b400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1071cffdfe556bf1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:10.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.426+0000 7f989b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:37:10.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.427+0000 7f989b7fe640 1 -- 172.21.15.79:0/1139303 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b4014030 con 0x5646775039a0 2024-08-20T01:37:10.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.427+0000 7f989b7fe640 1 -- 172.21.15.79:0/1139303 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f98b40257c0 con 0x5646775039a0 2024-08-20T01:37:10.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.427+0000 7f98c51fc740 1 -- 172.21.15.79:0/1139303 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98b4020070 con 0x5646775039a0 2024-08-20T01:37:10.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.427+0000 7f989b7fe640 1 -- 172.21.15.79:0/1139303 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f98b40259c0 con 0x5646775039a0 2024-08-20T01:37:10.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.427+0000 7f98c51fc740 10 client.15453 fetch_fsmap learned FSMap version 28 2024-08-20T01:37:10.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.427+0000 7f98c51fc740 1 -- 172.21.15.79:0/1139303 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56467750d910 con 0x5646775039a0 2024-08-20T01:37:10.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.427+0000 7f989b7fe640 1 -- 172.21.15.79:0/1139303 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f98b4020070 con 0x5646775039a0 2024-08-20T01:37:10.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.427+0000 7f989b7fe640 1 -- 172.21.15.79:0/1139303 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f98b4041a20 con 0x5646775039a0 2024-08-20T01:37:10.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.427+0000 7f98c51fc740 10 client.15453 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:37:10.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.427+0000 7f98c51fc740 10 client.15453 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:37:10.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.427+0000 7f98c51fc740 20 client.15453 populate_metadata read hostname 'smithi079' 2024-08-20T01:37:10.527 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.427+0000 7f98c51fc740 1 --2- 172.21.15.79:0/1139303 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56467757e2d0 0x5646775806c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:10.527 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.427+0000 7f98c51fc740 4 client.15453 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:37:10.527 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.427+0000 7f98c51fc740 1 -- 172.21.15.79:0/1139303 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56467746ed50 con 0x56467757e2d0 2024-08-20T01:37:10.527 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.427+0000 7f98bb7fe640 1 --2- 172.21.15.79:0/1139303 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56467757e2d0 0x5646775806c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:10.527 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.428+0000 7f98bb7fe640 1 --2- 172.21.15.79:0/1139303 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56467757e2d0 0x5646775806c0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39c6005085660754 server_cookie=956984d02f7b87d in_seq=0 out_seq=0 2024-08-20T01:37:10.527 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.428+0000 7f989b7fe640 10 client.15453 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:37:10.527 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.439+0000 7f989b7fe640 1 -- 172.21.15.79:0/1139303 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56467746ed50 con 0x56467757e2d0 2024-08-20T01:37:10.528 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.439+0000 7f989b7fe640 10 client.15453 handle_command_reply: tid=0 2024-08-20T01:37:10.528 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.439+0000 7f98c51fc740 1 client.15453 shutdown 2024-08-20T01:37:10.528 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.439+0000 7f98c51fc740 1 -- 172.21.15.79:0/1139303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646775039a0 msgr2=0x56467750e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:10.528 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.439+0000 7f98c51fc740 1 --2- 172.21.15.79:0/1139303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646775039a0 0x56467750e4d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f98b4010800 tx=0x7f98b400e720 comp rx=0 tx=0).stop 2024-08-20T01:37:10.528 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.439+0000 7f98c51fc740 1 -- 172.21.15.79:0/1139303 shutdown_connections 2024-08-20T01:37:10.528 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.439+0000 7f98c51fc740 1 --2- 172.21.15.79:0/1139303 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56467757e2d0 0x5646775806c0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:10.528 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.439+0000 7f98c51fc740 1 --2- 172.21.15.79:0/1139303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646775039a0 0x56467750e4d0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:10.528 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.439+0000 7f98c51fc740 1 --2- 172.21.15.79:0/1139303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564677500f60 0x56467750fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:10.528 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.439+0000 7f98c51fc740 1 --2- 172.21.15.79:0/1139303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5646774fe630 0x56467750f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:10.528 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.439+0000 7f98c51fc740 1 -- 172.21.15.79:0/1139303 >> 172.21.15.79:0/1139303 conn(0x5646774f9730 msgr2=0x564677503d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:10.528 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.439+0000 7f989b7fe640 0 client.15453 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:37:10.529 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.439+0000 7f98c51fc740 1 -- 172.21.15.79:0/1139303 shutdown_connections 2024-08-20T01:37:10.529 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.439+0000 7f98c51fc740 1 -- 172.21.15.79:0/1139303 wait complete. 2024-08-20T01:37:10.529 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.440+0000 7f98c51fc740 20 client.15453 trim_cache size 0 max 16384 2024-08-20T01:37:10.529 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:37:10.529 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:37:10.529 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:37:10.529 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:37:10.530 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.440+0000 7f98c240b640 1 -- 172.21.15.79:0/1901154851 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f98a40b3bd0 msgr2=0x7f98a40b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:10.530 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.440+0000 7f98c240b640 1 --2- 172.21.15.79:0/1901154851 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f98a40b3bd0 0x7f98a40b6090 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f98ac0856e0 tx=0x7f98ac02a420 comp rx=0 tx=0).stop 2024-08-20T01:37:10.530 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.440+0000 7f98c240b640 1 -- 172.21.15.79:0/1901154851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98bc101560 msgr2=0x7f98bc06ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:10.531 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.440+0000 7f98c240b640 1 --2- 172.21.15.79:0/1901154851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98bc101560 0x7f98bc06ae80 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f98ac005ab0 tx=0x7f98ac0042f0 comp rx=0 tx=0).stop 2024-08-20T01:37:10.531 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.440+0000 7f98c240b640 1 -- 172.21.15.79:0/1901154851 shutdown_connections 2024-08-20T01:37:10.531 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.440+0000 7f98c240b640 1 --2- 172.21.15.79:0/1901154851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98bc103070 0x7f98bc19fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:10.531 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.440+0000 7f98c240b640 1 --2- 172.21.15.79:0/1901154851 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f98a40b3bd0 0x7f98a40b6090 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:10.531 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.440+0000 7f98c240b640 1 --2- 172.21.15.79:0/1901154851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98bc1026b0 0x7f98bc19d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:10.531 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.440+0000 7f98c240b640 1 --2- 172.21.15.79:0/1901154851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98bc101560 0x7f98bc06ae80 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:10.531 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.440+0000 7f98c240b640 1 -- 172.21.15.79:0/1901154851 >> 172.21.15.79:0/1901154851 conn(0x7f98bc0fce40 msgr2=0x7f98bc105b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:10.531 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.440+0000 7f98c240b640 1 -- 172.21.15.79:0/1901154851 shutdown_connections 2024-08-20T01:37:10.531 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:10.440+0000 7f98c240b640 1 -- 172.21.15.79:0/1901154851 wait complete. 2024-08-20T01:37:12.281 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:11 smithi081 ceph-mon[22209]: pgmap v343: 97 pgs: 97 active+clean; 659 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 9 op/s 2024-08-20T01:37:12.396 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:11 smithi175 ceph-mon[22392]: pgmap v343: 97 pgs: 97 active+clean; 659 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 9 op/s 2024-08-20T01:37:12.419 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:11 smithi079 ceph-mon[18656]: pgmap v343: 97 pgs: 97 active+clean; 659 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 9 op/s 2024-08-20T01:37:14.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:13 smithi081 ceph-mon[22209]: pgmap v344: 97 pgs: 97 active+clean; 659 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1023 B/s wr, 11 op/s 2024-08-20T01:37:14.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:13 smithi175 ceph-mon[22392]: pgmap v344: 97 pgs: 97 active+clean; 659 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1023 B/s wr, 11 op/s 2024-08-20T01:37:14.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:13 smithi079 ceph-mon[18656]: pgmap v344: 97 pgs: 97 active+clean; 659 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1023 B/s wr, 11 op/s 2024-08-20T01:37:16.280 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:15 smithi081 ceph-mon[22209]: pgmap v345: 97 pgs: 97 active+clean; 662 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.0 KiB/s wr, 14 op/s 2024-08-20T01:37:16.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:15 smithi175 ceph-mon[22392]: pgmap v345: 97 pgs: 97 active+clean; 662 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.0 KiB/s wr, 14 op/s 2024-08-20T01:37:16.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:15 smithi079 ceph-mon[18656]: pgmap v345: 97 pgs: 97 active+clean; 662 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.0 KiB/s wr, 14 op/s 2024-08-20T01:37:18.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:17 smithi081 ceph-mon[22209]: pgmap v346: 97 pgs: 97 active+clean; 662 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-08-20T01:37:18.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:17 smithi175 ceph-mon[22392]: pgmap v346: 97 pgs: 97 active+clean; 662 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-08-20T01:37:18.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:17 smithi079 ceph-mon[18656]: pgmap v346: 97 pgs: 97 active+clean; 662 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-08-20T01:37:20.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:19 smithi081 ceph-mon[22209]: pgmap v347: 97 pgs: 97 active+clean; 662 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.2 KiB/s wr, 16 op/s 2024-08-20T01:37:20.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:19 smithi175 ceph-mon[22392]: pgmap v347: 97 pgs: 97 active+clean; 662 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.2 KiB/s wr, 16 op/s 2024-08-20T01:37:20.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:19 smithi079 ceph-mon[18656]: pgmap v347: 97 pgs: 97 active+clean; 662 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.2 KiB/s wr, 16 op/s 2024-08-20T01:37:22.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:21 smithi081 ceph-mon[22209]: pgmap v348: 97 pgs: 97 active+clean; 662 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-08-20T01:37:22.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:21 smithi175 ceph-mon[22392]: pgmap v348: 97 pgs: 97 active+clean; 662 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-08-20T01:37:22.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:21 smithi079 ceph-mon[18656]: pgmap v348: 97 pgs: 97 active+clean; 662 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-08-20T01:37:23.572 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.570+0000 7fdd71d9e640 1 -- 172.21.15.79:0/1905891340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd6c102ea0 msgr2=0x7fdd6c109820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:23.572 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.570+0000 7fdd71d9e640 1 --2- 172.21.15.79:0/1905891340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd6c102ea0 0x7fdd6c109820 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fdd64009cd0 tx=0x7fdd6402a8e0 comp rx=0 tx=0).stop 2024-08-20T01:37:23.572 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.570+0000 7fdd71d9e640 1 -- 172.21.15.79:0/1905891340 shutdown_connections 2024-08-20T01:37:23.572 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.570+0000 7fdd71d9e640 1 --2- 172.21.15.79:0/1905891340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd6c102ea0 0x7fdd6c109820 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:23.573 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.570+0000 7fdd71d9e640 1 --2- 172.21.15.79:0/1905891340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd6c1024e0 0x7fdd6c102960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:23.573 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.570+0000 7fdd71d9e640 1 --2- 172.21.15.79:0/1905891340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd6c101390 0x7fdd6c101790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:23.573 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.570+0000 7fdd71d9e640 1 -- 172.21.15.79:0/1905891340 >> 172.21.15.79:0/1905891340 conn(0x7fdd6c0fcc30 msgr2=0x7fdd6c0ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:23.573 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.570+0000 7fdd71d9e640 1 -- 172.21.15.79:0/1905891340 shutdown_connections 2024-08-20T01:37:23.573 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.570+0000 7fdd71d9e640 1 -- 172.21.15.79:0/1905891340 wait complete. 2024-08-20T01:37:23.576 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.571+0000 7fdd71d9e640 1 Processor -- start 2024-08-20T01:37:23.576 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.571+0000 7fdd71d9e640 1 -- start start 2024-08-20T01:37:23.576 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.571+0000 7fdd71d9e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd6c101390 0x7fdd6c1987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:23.576 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.571+0000 7fdd71d9e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd6c1024e0 0x7fdd6c198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:23.576 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.571+0000 7fdd71d9e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd6c102ea0 0x7fdd6c199a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:23.576 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.571+0000 7fdd71d9e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdd6c10e040 con 0x7fdd6c1024e0 2024-08-20T01:37:23.576 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.571+0000 7fdd71d9e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdd6c10dec0 con 0x7fdd6c102ea0 2024-08-20T01:37:23.576 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.571+0000 7fdd71d9e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdd6c10e1c0 con 0x7fdd6c101390 2024-08-20T01:37:23.576 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.572+0000 7fdd6bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd6c1024e0 0x7fdd6c198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:23.576 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.572+0000 7fdd6bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd6c1024e0 0x7fdd6c198e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34598/0 (socket says 172.21.15.79:34598) 2024-08-20T01:37:23.577 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.572+0000 7fdd6bfff640 1 -- 172.21.15.79:0/3785171124 learned_addr learned my addr 172.21.15.79:0/3785171124 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:23.577 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.572+0000 7fdd7159d640 1 --2- 172.21.15.79:0/3785171124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd6c102ea0 0x7fdd6c199a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:23.577 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.572+0000 7fdd70d9c640 1 --2- 172.21.15.79:0/3785171124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd6c101390 0x7fdd6c1987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:23.577 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.572+0000 7fdd6bfff640 1 -- 172.21.15.79:0/3785171124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd6c101390 msgr2=0x7fdd6c1987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:23.577 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.572+0000 7fdd6bfff640 1 --2- 172.21.15.79:0/3785171124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd6c101390 0x7fdd6c1987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:23.577 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.572+0000 7fdd6bfff640 1 -- 172.21.15.79:0/3785171124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd6c102ea0 msgr2=0x7fdd6c199a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:23.577 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.572+0000 7fdd6bfff640 1 --2- 172.21.15.79:0/3785171124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd6c102ea0 0x7fdd6c199a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:23.577 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.572+0000 7fdd6bfff640 1 -- 172.21.15.79:0/3785171124 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd6c19a2c0 con 0x7fdd6c1024e0 2024-08-20T01:37:23.577 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.572+0000 7fdd6bfff640 1 --2- 172.21.15.79:0/3785171124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd6c1024e0 0x7fdd6c198e40 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800d950 tx=0x7fdd5800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:23.577 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.572+0000 7fdd69ffb640 1 -- 172.21.15.79:0/3785171124 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd58017030 con 0x7fdd6c1024e0 2024-08-20T01:37:23.577 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.573+0000 7fdd69ffb640 1 -- 172.21.15.79:0/3785171124 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdd58004020 con 0x7fdd6c1024e0 2024-08-20T01:37:23.577 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.573+0000 7fdd69ffb640 1 -- 172.21.15.79:0/3785171124 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd58017030 con 0x7fdd6c1024e0 2024-08-20T01:37:23.578 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.573+0000 7fdd71d9e640 1 -- 172.21.15.79:0/3785171124 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd6c19a5b0 con 0x7fdd6c1024e0 2024-08-20T01:37:23.578 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.573+0000 7fdd71d9e640 1 -- 172.21.15.79:0/3785171124 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd6c1a0c80 con 0x7fdd6c1024e0 2024-08-20T01:37:23.579 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.576+0000 7fdd75df3740 1 Processor -- start 2024-08-20T01:37:23.579 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.576+0000 7fdd75df3740 1 -- start start 2024-08-20T01:37:23.579 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.577+0000 7fdd75df3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557243c8a810 0x557243c8cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:23.579 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.577+0000 7fdd75df3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557243c8d140 0x557243c8f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:23.579 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.577+0000 7fdd75df3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557243c8fb80 0x557243c92040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:23.579 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.577+0000 7fdd75df3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557243bfd360 con 0x557243c8fb80 2024-08-20T01:37:23.579 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.577+0000 7fdd75df3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557243bec860 con 0x557243c8a810 2024-08-20T01:37:23.579 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.577+0000 7fdd75df3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557243bf08a0 con 0x557243c8d140 2024-08-20T01:37:23.579 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.577+0000 7fdd69ffb640 1 -- 172.21.15.79:0/3785171124 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fdd580041d0 con 0x7fdd6c1024e0 2024-08-20T01:37:23.580 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.577+0000 7fdd7159d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557243c8a810 0x557243c8cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:23.580 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.577+0000 7fdd7159d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557243c8a810 0x557243c8cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:53018/0 (socket says 172.21.15.79:53018) 2024-08-20T01:37:23.580 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.577+0000 7fdd7159d640 1 -- 172.21.15.79:0/1684202269 learned_addr learned my addr 172.21.15.79:0/1684202269 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:23.580 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.577+0000 7fdd70d9c640 1 --2- 172.21.15.79:0/1684202269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557243c8d140 0x557243c8f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:23.580 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.578+0000 7fdd69ffb640 1 --2- 172.21.15.79:0/3785171124 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fdd5c0b3dd0 0x7fdd5c0b6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:23.580 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.578+0000 7fdd7159d640 1 --2- 172.21.15.79:0/3785171124 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fdd5c0b3dd0 0x7fdd5c0b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:23.581 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.579+0000 7fdd7159d640 1 -- 172.21.15.79:0/1684202269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557243c8d140 msgr2=0x557243c8f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:23.581 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.579+0000 7fdd7159d640 1 --2- 172.21.15.79:0/1684202269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557243c8d140 0x557243c8f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:23.581 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.579+0000 7fdd7159d640 1 -- 172.21.15.79:0/1684202269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557243c8fb80 msgr2=0x557243c92040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:37:23.581 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.579+0000 7fdd7159d640 1 --2- 172.21.15.79:0/1684202269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557243c8fb80 0x557243c92040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:23.581 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.579+0000 7fdd7159d640 1 -- 172.21.15.79:0/1684202269 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557243b93e40 con 0x557243c8a810 2024-08-20T01:37:23.581 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.579+0000 7fdd69ffb640 1 -- 172.21.15.79:0/3785171124 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fdd580a5ed0 con 0x7fdd6c1024e0 2024-08-20T01:37:23.581 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.579+0000 7fdd7159d640 1 --2- 172.21.15.79:0/1684202269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557243c8a810 0x557243c8cc00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdd6402aed0 tx=0x7fdd640099e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a5a4bd492e96eac server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:23.581 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.579+0000 7fdd56ffd640 1 -- 172.21.15.79:0/1684202269 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd64004690 con 0x557243c8a810 2024-08-20T01:37:23.581 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.579+0000 7fdd56ffd640 1 -- 172.21.15.79:0/1684202269 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdd6404d070 con 0x557243c8a810 2024-08-20T01:37:23.582 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.579+0000 7fdd56ffd640 1 -- 172.21.15.79:0/1684202269 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd64030ec0 con 0x557243c8a810 2024-08-20T01:37:23.582 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.579+0000 7fdd7159d640 1 --2- 172.21.15.79:0/3785171124 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fdd5c0b3dd0 0x7fdd5c0b6290 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdd6404c000 tx=0x7fdd6404a000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:23.586 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.580+0000 7fdd75df3740 1 -- 172.21.15.79:0/1684202269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557243c8a810 msgr2=0x557243c8cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:23.586 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.580+0000 7fdd75df3740 1 --2- 172.21.15.79:0/1684202269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557243c8a810 0x557243c8cc00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdd6402aed0 tx=0x7fdd640099e0 comp rx=0 tx=0).stop 2024-08-20T01:37:23.586 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.580+0000 7fdd75df3740 1 -- 172.21.15.79:0/1684202269 shutdown_connections 2024-08-20T01:37:23.586 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.580+0000 7fdd75df3740 1 --2- 172.21.15.79:0/1684202269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557243c8fb80 0x557243c92040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:23.586 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.580+0000 7fdd75df3740 1 --2- 172.21.15.79:0/1684202269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557243c8d140 0x557243c8f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:23.587 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.580+0000 7fdd75df3740 1 --2- 172.21.15.79:0/1684202269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557243c8a810 0x557243c8cc00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:23.587 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.580+0000 7fdd75df3740 1 -- 172.21.15.79:0/1684202269 >> 172.21.15.79:0/1684202269 conn(0x557243c85960 msgr2=0x557243c866f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:23.587 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.580+0000 7fdd75df3740 1 -- 172.21.15.79:0/1684202269 shutdown_connections 2024-08-20T01:37:23.587 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.580+0000 7fdd75df3740 1 -- 172.21.15.79:0/1684202269 wait complete. 2024-08-20T01:37:23.587 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.581+0000 7fdd75df3740 1 -- start start 2024-08-20T01:37:23.587 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.581+0000 7fdd75df3740 1 Processor -- start 2024-08-20T01:37:23.587 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.581+0000 7fdd75df3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557243c8a810 0x557243c940d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:23.587 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.581+0000 7fdd75df3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557243c8d140 0x557243c94770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:23.587 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.581+0000 7fdd75df3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557243c8fb80 0x557243c952d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:23.587 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.581+0000 7fdd75df3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557243b25ab0 con 0x557243c8fb80 2024-08-20T01:37:23.587 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.581+0000 7fdd75df3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557243b73780 con 0x557243c8a810 2024-08-20T01:37:23.587 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.581+0000 7fdd75df3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557243c92b60 con 0x557243c8d140 2024-08-20T01:37:23.588 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.581+0000 7fdd75df3740 10 client.0 _ll_register_callbacks cb 0x5572438fba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:23.588 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.581+0000 7fdd7159d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557243c8fb80 0x557243c952d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:23.588 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.581+0000 7fdd7159d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557243c8fb80 0x557243c952d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34608/0 (socket says 172.21.15.79:34608) 2024-08-20T01:37:23.588 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.581+0000 7fdd7159d640 1 -- 172.21.15.79:0/1809330264 learned_addr learned my addr 172.21.15.79:0/1809330264 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:23.588 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.582+0000 7fdd70d9c640 1 --2- 172.21.15.79:0/1809330264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557243c8a810 0x557243c940d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:23.588 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.582+0000 7fdd6bfff640 1 --2- 172.21.15.79:0/1809330264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557243c8d140 0x557243c94770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:23.588 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.582+0000 7fdd7159d640 1 -- 172.21.15.79:0/1809330264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557243c8d140 msgr2=0x557243c94770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:23.588 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.582+0000 7fdd7159d640 1 --2- 172.21.15.79:0/1809330264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557243c8d140 0x557243c94770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:23.588 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.582+0000 7fdd7159d640 1 -- 172.21.15.79:0/1809330264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557243c8a810 msgr2=0x557243c940d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:23.589 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.582+0000 7fdd7159d640 1 --2- 172.21.15.79:0/1809330264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557243c8a810 0x557243c940d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:23.589 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.582+0000 7fdd7159d640 1 -- 172.21.15.79:0/1809330264 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55724394f790 con 0x557243c8fb80 2024-08-20T01:37:23.589 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.582+0000 7fdd6bfff640 1 --2- 172.21.15.79:0/1809330264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557243c8d140 0x557243c94770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:37:23.589 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.582+0000 7fdd70d9c640 1 --2- 172.21.15.79:0/1809330264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557243c8a810 0x557243c940d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:37:23.589 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.582+0000 7fdd7159d640 1 --2- 172.21.15.79:0/1809330264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557243c8fb80 0x557243c952d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fdd64031640 tx=0x7fdd64030ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f4a3e8b6990667 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:23.589 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.582+0000 7fdd4bfff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:37:23.589 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.582+0000 7fdd4bfff640 1 -- 172.21.15.79:0/1809330264 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd64059020 con 0x557243c8fb80 2024-08-20T01:37:23.589 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.582+0000 7fdd75df3740 1 -- 172.21.15.79:0/1809330264 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557243b9be00 con 0x557243c8fb80 2024-08-20T01:37:23.589 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.582+0000 7fdd4bfff640 1 -- 172.21.15.79:0/1809330264 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fdd64030870 con 0x557243c8fb80 2024-08-20T01:37:23.589 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.583+0000 7fdd4bfff640 1 -- 172.21.15.79:0/1809330264 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdd64004410 con 0x557243c8fb80 2024-08-20T01:37:23.589 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.583+0000 7fdd75df3740 10 client.15462 fetch_fsmap learned FSMap version 28 2024-08-20T01:37:23.590 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.583+0000 7fdd75df3740 1 -- 172.21.15.79:0/1809330264 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5572439c8620 con 0x557243c8fb80 2024-08-20T01:37:23.590 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.583+0000 7fdd4bfff640 1 -- 172.21.15.79:0/1809330264 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x557243b9be00 con 0x557243c8fb80 2024-08-20T01:37:23.590 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.583+0000 7fdd4bfff640 1 -- 172.21.15.79:0/1809330264 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fdd64030070 con 0x557243c8fb80 2024-08-20T01:37:23.590 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.584+0000 7fdd75df3740 10 client.15462 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:37:23.590 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.584+0000 7fdd75df3740 10 client.15462 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:37:23.590 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.584+0000 7fdd75df3740 20 client.15462 populate_metadata read hostname 'smithi079' 2024-08-20T01:37:23.590 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.584+0000 7fdd75df3740 1 --2- 172.21.15.79:0/1809330264 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557243c9f550 0x557243ca1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:23.590 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.584+0000 7fdd75df3740 4 client.15462 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:37:23.590 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.584+0000 7fdd75df3740 1 -- 172.21.15.79:0/1809330264 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557243bff2b0 con 0x557243c9f550 2024-08-20T01:37:23.590 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.584+0000 7fdd70d9c640 1 --2- 172.21.15.79:0/1809330264 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557243c9f550 0x557243ca1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:23.591 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.584+0000 7fdd70d9c640 1 --2- 172.21.15.79:0/1809330264 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557243c9f550 0x557243ca1940 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1dc19816aaca1bd3 server_cookie=4f300452f61910d1 in_seq=0 out_seq=0 2024-08-20T01:37:23.591 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.584+0000 7fdd4bfff640 10 client.15462 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:37:23.593 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.585+0000 7fdd4bfff640 1 -- 172.21.15.79:0/1809330264 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557243bff2b0 con 0x557243c9f550 2024-08-20T01:37:23.593 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.585+0000 7fdd4bfff640 10 client.15462 handle_command_reply: tid=0 2024-08-20T01:37:23.593 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.585+0000 7fdd75df3740 1 client.15462 shutdown 2024-08-20T01:37:23.593 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.585+0000 7fdd75df3740 1 -- 172.21.15.79:0/1809330264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557243c8fb80 msgr2=0x557243c952d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:23.593 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.585+0000 7fdd75df3740 1 --2- 172.21.15.79:0/1809330264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557243c8fb80 0x557243c952d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fdd64031640 tx=0x7fdd64030ff0 comp rx=0 tx=0).stop 2024-08-20T01:37:23.593 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.585+0000 7fdd75df3740 1 -- 172.21.15.79:0/1809330264 shutdown_connections 2024-08-20T01:37:23.593 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.585+0000 7fdd75df3740 1 --2- 172.21.15.79:0/1809330264 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557243c9f550 0x557243ca1940 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:23.593 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.585+0000 7fdd75df3740 1 --2- 172.21.15.79:0/1809330264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557243c8fb80 0x557243c952d0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:23.593 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.585+0000 7fdd4bfff640 0 client.15462 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:37:23.594 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.585+0000 7fdd75df3740 1 --2- 172.21.15.79:0/1809330264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557243c8d140 0x557243c94770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:23.594 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.585+0000 7fdd75df3740 1 --2- 172.21.15.79:0/1809330264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557243c8a810 0x557243c940d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:23.594 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.585+0000 7fdd75df3740 1 -- 172.21.15.79:0/1809330264 >> 172.21.15.79:0/1809330264 conn(0x557243c85960 msgr2=0x557243c84a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:23.594 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.586+0000 7fdd75df3740 1 -- 172.21.15.79:0/1809330264 shutdown_connections 2024-08-20T01:37:23.594 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.586+0000 7fdd75df3740 1 -- 172.21.15.79:0/1809330264 wait complete. 2024-08-20T01:37:23.594 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.586+0000 7fdd75df3740 20 client.15462 trim_cache size 0 max 16384 2024-08-20T01:37:23.616 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.613+0000 7fdd75df3740 1 Processor -- start 2024-08-20T01:37:23.616 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.614+0000 7fdd75df3740 1 -- start start 2024-08-20T01:37:23.616 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.614+0000 7fdd75df3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557243c8a810 0x557243c84930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:23.616 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.614+0000 7fdd75df3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557243c8d140 0x557243c9bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:23.617 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.614+0000 7fdd75df3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557243c8fb80 0x557243c9c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:23.617 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.614+0000 7fdd75df3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdd6c1a99a0 con 0x557243c8fb80 2024-08-20T01:37:23.617 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.614+0000 7fdd75df3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdd6c1ab4e0 con 0x557243c8a810 2024-08-20T01:37:23.617 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.614+0000 7fdd75df3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdd6c1aa070 con 0x557243c8d140 2024-08-20T01:37:23.617 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.614+0000 7fdd7159d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557243c8fb80 0x557243c9c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:23.617 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.614+0000 7fdd7159d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557243c8fb80 0x557243c9c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34622/0 (socket says 172.21.15.79:34622) 2024-08-20T01:37:23.617 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.614+0000 7fdd7159d640 1 -- 172.21.15.79:0/1664913988 learned_addr learned my addr 172.21.15.79:0/1664913988 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:23.617 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.614+0000 7fdd70d9c640 1 --2- 172.21.15.79:0/1664913988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557243c8a810 0x557243c84930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:23.617 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.614+0000 7fdd6bfff640 1 --2- 172.21.15.79:0/1664913988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557243c8d140 0x557243c9bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:23.617 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.614+0000 7fdd7159d640 1 -- 172.21.15.79:0/1664913988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557243c8d140 msgr2=0x557243c9bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:23.617 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.614+0000 7fdd7159d640 1 --2- 172.21.15.79:0/1664913988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557243c8d140 0x557243c9bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:23.617 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.614+0000 7fdd7159d640 1 -- 172.21.15.79:0/1664913988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557243c8a810 msgr2=0x557243c84930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:23.618 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.614+0000 7fdd7159d640 1 --2- 172.21.15.79:0/1664913988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557243c8a810 0x557243c84930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:23.618 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.614+0000 7fdd7159d640 1 -- 172.21.15.79:0/1664913988 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557243c8cf70 con 0x557243c8fb80 2024-08-20T01:37:23.618 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.615+0000 7fdd7159d640 1 --2- 172.21.15.79:0/1664913988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557243c8fb80 0x557243c9c110 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fdd64048f20 tx=0x7fdd640021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5650a6c538a8a4ba server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.615+0000 7fdd567fc640 1 -- 172.21.15.79:0/1664913988 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd64059040 con 0x557243c8fb80 2024-08-20T01:37:23.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.615+0000 7fdd567fc640 1 -- 172.21.15.79:0/1664913988 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdd6404d030 con 0x557243c8fb80 2024-08-20T01:37:23.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.615+0000 7fdd567fc640 1 -- 172.21.15.79:0/1664913988 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd640489f0 con 0x557243c8fb80 2024-08-20T01:37:23.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.616+0000 7fdd75df3740 1 -- 172.21.15.79:0/1664913988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557243c8fb80 msgr2=0x557243c9c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:23.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.616+0000 7fdd75df3740 1 --2- 172.21.15.79:0/1664913988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557243c8fb80 0x557243c9c110 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fdd64048f20 tx=0x7fdd640021d0 comp rx=0 tx=0).stop 2024-08-20T01:37:23.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.616+0000 7fdd75df3740 1 -- 172.21.15.79:0/1664913988 shutdown_connections 2024-08-20T01:37:23.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.616+0000 7fdd75df3740 1 --2- 172.21.15.79:0/1664913988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557243c8fb80 0x557243c9c110 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:23.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.616+0000 7fdd75df3740 1 --2- 172.21.15.79:0/1664913988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557243c8d140 0x557243c9bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:23.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.616+0000 7fdd75df3740 1 --2- 172.21.15.79:0/1664913988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557243c8a810 0x557243c84930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:23.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.616+0000 7fdd75df3740 1 -- 172.21.15.79:0/1664913988 >> 172.21.15.79:0/1664913988 conn(0x557243c85960 msgr2=0x557243c84220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:23.624 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.616+0000 7fdd75df3740 1 -- 172.21.15.79:0/1664913988 shutdown_connections 2024-08-20T01:37:23.624 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.616+0000 7fdd75df3740 1 -- 172.21.15.79:0/1664913988 wait complete. 2024-08-20T01:37:23.624 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.617+0000 7fdd75df3740 1 -- start start 2024-08-20T01:37:23.624 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.617+0000 7fdd75df3740 1 Processor -- start 2024-08-20T01:37:23.624 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.617+0000 7fdd75df3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557243c8a810 0x557243c993d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:23.624 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.617+0000 7fdd75df3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557243c8d140 0x557243c99a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:23.624 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.617+0000 7fdd75df3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557243c8fb80 0x557243c9a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:23.624 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.618+0000 7fdd75df3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdd6c1aae10 con 0x557243c8fb80 2024-08-20T01:37:23.624 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.618+0000 7fdd7159d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557243c8fb80 0x557243c9a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:23.625 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.618+0000 7fdd75df3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdd6c1aa740 con 0x557243c8a810 2024-08-20T01:37:23.625 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.618+0000 7fdd7159d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557243c8fb80 0x557243c9a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34626/0 (socket says 172.21.15.79:34626) 2024-08-20T01:37:23.625 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.618+0000 7fdd7159d640 1 -- 172.21.15.79:0/2138201918 learned_addr learned my addr 172.21.15.79:0/2138201918 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:23.625 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.618+0000 7fdd75df3740 1 -- 172.21.15.79:0/2138201918 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdd6c1a7980 con 0x557243c8d140 2024-08-20T01:37:23.625 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.618+0000 7fdd6bfff640 1 --2- 172.21.15.79:0/2138201918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557243c8d140 0x557243c99a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:23.625 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.618+0000 7fdd70d9c640 1 --2- 172.21.15.79:0/2138201918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557243c8a810 0x557243c993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:23.625 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.618+0000 7fdd75df3740 10 client.0 _ll_register_callbacks cb 0x7fdd6000b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:23.625 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.618+0000 7fdd6bfff640 1 -- 172.21.15.79:0/2138201918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557243c8a810 msgr2=0x557243c993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:23.625 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.618+0000 7fdd6bfff640 1 --2- 172.21.15.79:0/2138201918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557243c8a810 0x557243c993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:23.625 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.618+0000 7fdd6bfff640 1 -- 172.21.15.79:0/2138201918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557243c8fb80 msgr2=0x557243c9a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:23.625 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.618+0000 7fdd6bfff640 1 --2- 172.21.15.79:0/2138201918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557243c8fb80 0x557243c9a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:23.625 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.618+0000 7fdd6bfff640 1 -- 172.21.15.79:0/2138201918 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557243c9ae20 con 0x557243c8d140 2024-08-20T01:37:23.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.618+0000 7fdd7159d640 1 --2- 172.21.15.79:0/2138201918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557243c8fb80 0x557243c9a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:37:23.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.618+0000 7fdd75df3740 1 -- 172.21.15.79:0/2138201918 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd6404d030 con 0x557243c8d140 2024-08-20T01:37:23.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.618+0000 7fdd70d9c640 1 --2- 172.21.15.79:0/2138201918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557243c8a810 0x557243c993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:37:23.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.618+0000 7fdd6bfff640 1 --2- 172.21.15.79:0/2138201918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557243c8d140 0x557243c99a70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c19a8f0 tx=0x7fdd580a5e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=422656233d2a1991 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:23.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.618+0000 7fdd4bfff640 10 client.24907 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:37:23.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.619+0000 7fdd4bfff640 1 -- 172.21.15.79:0/2138201918 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd580c8070 con 0x557243c8d140 2024-08-20T01:37:23.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.619+0000 7fdd4bfff640 1 -- 172.21.15.79:0/2138201918 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fdd58083b70 con 0x557243c8d140 2024-08-20T01:37:23.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.619+0000 7fdd4bfff640 1 -- 172.21.15.79:0/2138201918 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdd58083d70 con 0x557243c8d140 2024-08-20T01:37:23.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.619+0000 7fdd75df3740 10 client.24907 fetch_fsmap learned FSMap version 28 2024-08-20T01:37:23.627 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.619+0000 7fdd75df3740 1 -- 172.21.15.79:0/2138201918 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({fsmap=28}) -- 0x557243c9c160 con 0x557243c8d140 2024-08-20T01:37:23.627 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.619+0000 7fdd4bfff640 1 -- 172.21.15.79:0/2138201918 <== mon.1 v2:172.21.15.175:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fdd580a8b40 con 0x557243c8d140 2024-08-20T01:37:23.627 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.619+0000 7fdd75df3740 10 client.24907 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:37:23.627 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.619+0000 7fdd75df3740 10 client.24907 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:37:23.627 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.619+0000 7fdd75df3740 20 client.24907 populate_metadata read hostname 'smithi079' 2024-08-20T01:37:23.627 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.619+0000 7fdd75df3740 1 --2- 172.21.15.79:0/2138201918 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557243c9f550 0x557243d0c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:23.627 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.620+0000 7fdd75df3740 4 client.24907 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:37:23.627 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.620+0000 7fdd75df3740 1 -- 172.21.15.79:0/2138201918 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557243bfad50 con 0x557243c9f550 2024-08-20T01:37:23.627 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.620+0000 7fdd70d9c640 1 --2- 172.21.15.79:0/2138201918 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557243c9f550 0x557243d0c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:23.627 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.620+0000 7fdd4bfff640 10 client.24907 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:37:23.628 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.620+0000 7fdd70d9c640 1 --2- 172.21.15.79:0/2138201918 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557243c9f550 0x557243d0c450 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa2e9ee4accceff5 server_cookie=d7356cdb8c293730 in_seq=0 out_seq=0 2024-08-20T01:37:23.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.627+0000 7fdd4bfff640 1 -- 172.21.15.79:0/2138201918 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557243bfad50 con 0x557243c9f550 2024-08-20T01:37:23.630 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.627+0000 7fdd4bfff640 10 client.24907 handle_command_reply: tid=0 2024-08-20T01:37:23.630 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.627+0000 7fdd75df3740 1 client.24907 shutdown 2024-08-20T01:37:23.630 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.627+0000 7fdd75df3740 1 -- 172.21.15.79:0/2138201918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557243c8d140 msgr2=0x557243c99a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:23.630 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.627+0000 7fdd75df3740 1 --2- 172.21.15.79:0/2138201918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557243c8d140 0x557243c99a70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c19a8f0 tx=0x7fdd580a5e40 comp rx=0 tx=0).stop 2024-08-20T01:37:23.630 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.627+0000 7fdd75df3740 1 -- 172.21.15.79:0/2138201918 shutdown_connections 2024-08-20T01:37:23.630 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.627+0000 7fdd75df3740 1 --2- 172.21.15.79:0/2138201918 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557243c9f550 0x557243d0c450 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:23.630 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.627+0000 7fdd75df3740 1 --2- 172.21.15.79:0/2138201918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557243c8fb80 0x557243c9a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:23.630 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.627+0000 7fdd75df3740 1 --2- 172.21.15.79:0/2138201918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557243c8d140 0x557243c99a70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:23.631 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.627+0000 7fdd75df3740 1 --2- 172.21.15.79:0/2138201918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557243c8a810 0x557243c993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:23.631 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.627+0000 7fdd75df3740 1 -- 172.21.15.79:0/2138201918 >> 172.21.15.79:0/2138201918 conn(0x557243c85960 msgr2=0x557243c84a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:23.631 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.627+0000 7fdd4bfff640 0 client.24907 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:37:23.631 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.627+0000 7fdd75df3740 1 -- 172.21.15.79:0/2138201918 shutdown_connections 2024-08-20T01:37:23.631 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.627+0000 7fdd75df3740 1 -- 172.21.15.79:0/2138201918 wait complete. 2024-08-20T01:37:23.631 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.627+0000 7fdd75df3740 20 client.24907 trim_cache size 0 max 16384 2024-08-20T01:37:23.631 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:37:23.631 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:37:23.631 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:37:23.632 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:37:23.632 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.628+0000 7fdd71d9e640 1 -- 172.21.15.79:0/3785171124 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fdd5c0b3dd0 msgr2=0x7fdd5c0b6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:23.632 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.628+0000 7fdd71d9e640 1 --2- 172.21.15.79:0/3785171124 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fdd5c0b3dd0 0x7fdd5c0b6290 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdd6404c000 tx=0x7fdd6404a000 comp rx=0 tx=0).stop 2024-08-20T01:37:23.632 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.628+0000 7fdd71d9e640 1 -- 172.21.15.79:0/3785171124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd6c1024e0 msgr2=0x7fdd6c198e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:23.633 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.628+0000 7fdd71d9e640 1 --2- 172.21.15.79:0/3785171124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd6c1024e0 0x7fdd6c198e40 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800d950 tx=0x7fdd5800de10 comp rx=0 tx=0).stop 2024-08-20T01:37:23.633 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.628+0000 7fdd71d9e640 1 -- 172.21.15.79:0/3785171124 shutdown_connections 2024-08-20T01:37:23.633 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.628+0000 7fdd71d9e640 1 --2- 172.21.15.79:0/3785171124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd6c102ea0 0x7fdd6c199a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:23.633 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.628+0000 7fdd71d9e640 1 --2- 172.21.15.79:0/3785171124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd6c1024e0 0x7fdd6c198e40 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:23.633 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.628+0000 7fdd71d9e640 1 --2- 172.21.15.79:0/3785171124 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fdd5c0b3dd0 0x7fdd5c0b6290 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:23.633 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.628+0000 7fdd71d9e640 1 --2- 172.21.15.79:0/3785171124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd6c101390 0x7fdd6c1987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:23.633 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.628+0000 7fdd71d9e640 1 -- 172.21.15.79:0/3785171124 >> 172.21.15.79:0/3785171124 conn(0x7fdd6c0fcc30 msgr2=0x7fdd6c105930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:23.633 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.628+0000 7fdd71d9e640 1 -- 172.21.15.79:0/3785171124 shutdown_connections 2024-08-20T01:37:23.633 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:23.629+0000 7fdd71d9e640 1 -- 172.21.15.79:0/3785171124 wait complete. 2024-08-20T01:37:24.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:23 smithi081 ceph-mon[22209]: pgmap v349: 97 pgs: 97 active+clean; 662 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-08-20T01:37:24.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:23 smithi175 ceph-mon[22392]: pgmap v349: 97 pgs: 97 active+clean; 662 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-08-20T01:37:24.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:23 smithi079 ceph-mon[18656]: pgmap v349: 97 pgs: 97 active+clean; 662 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-08-20T01:37:26.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:25 smithi081 ceph-mon[22209]: pgmap v350: 97 pgs: 97 active+clean; 662 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-08-20T01:37:26.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:25 smithi175 ceph-mon[22392]: pgmap v350: 97 pgs: 97 active+clean; 662 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-08-20T01:37:26.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:25 smithi079 ceph-mon[18656]: pgmap v350: 97 pgs: 97 active+clean; 662 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-08-20T01:37:28.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:27 smithi081 ceph-mon[22209]: pgmap v351: 97 pgs: 97 active+clean; 662 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-08-20T01:37:28.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:27 smithi175 ceph-mon[22392]: pgmap v351: 97 pgs: 97 active+clean; 662 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-08-20T01:37:28.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:27 smithi079 ceph-mon[18656]: pgmap v351: 97 pgs: 97 active+clean; 662 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-08-20T01:37:30.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:29 smithi081 ceph-mon[22209]: pgmap v352: 97 pgs: 97 active+clean; 662 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 426 B/s wr, 12 op/s 2024-08-20T01:37:30.393 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:29 smithi175 ceph-mon[22392]: pgmap v352: 97 pgs: 97 active+clean; 662 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 426 B/s wr, 12 op/s 2024-08-20T01:37:30.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:29 smithi079 ceph-mon[18656]: pgmap v352: 97 pgs: 97 active+clean; 662 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 426 B/s wr, 12 op/s 2024-08-20T01:37:30.450 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:37:30.812 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:37:31.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.367+0000 7fbcf24d4640 1 -- 172.21.15.79:0/2119300936 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcec107d20 msgr2=0x7fbcec10e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:31.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.367+0000 7fbcf24d4640 1 --2- 172.21.15.79:0/2119300936 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcec107d20 0x7fbcec10e520 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fbce4009ca0 tx=0x7fbce402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:37:31.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.367+0000 7fbcf24d4640 1 -- 172.21.15.79:0/2119300936 shutdown_connections 2024-08-20T01:37:31.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.367+0000 7fbcf24d4640 1 --2- 172.21.15.79:0/2119300936 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcec107d20 0x7fbcec10e520 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:31.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.367+0000 7fbcf24d4640 1 --2- 172.21.15.79:0/2119300936 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcec1073a0 0x7fbcec1077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:31.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.367+0000 7fbcf24d4640 1 --2- 172.21.15.79:0/2119300936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbcec101990 0x7fbcec101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:31.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.367+0000 7fbcf24d4640 1 -- 172.21.15.79:0/2119300936 >> 172.21.15.79:0/2119300936 conn(0x7fbcec0fd400 msgr2=0x7fbcec0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:31.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.367+0000 7fbcf24d4640 1 -- 172.21.15.79:0/2119300936 shutdown_connections 2024-08-20T01:37:31.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.367+0000 7fbcf24d4640 1 -- 172.21.15.79:0/2119300936 wait complete. 2024-08-20T01:37:31.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.368+0000 7fbcf24d4640 1 Processor -- start 2024-08-20T01:37:31.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.368+0000 7fbcf24d4640 1 -- start start 2024-08-20T01:37:31.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.369+0000 7fbcf24d4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbcec101990 0x7fbcec196b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:31.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.369+0000 7fbcf24d4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcec1073a0 0x7fbcec197080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:31.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.369+0000 7fbcf24d4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcec107d20 0x7fbcec19c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:31.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.369+0000 7fbcf0a71640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcec107d20 0x7fbcec19c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:31.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.369+0000 7fbcf0a71640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcec107d20 0x7fbcec19c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51436/0 (socket says 172.21.15.79:51436) 2024-08-20T01:37:31.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.369+0000 7fbceb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcec1073a0 0x7fbcec197080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:31.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.369+0000 7fbceb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcec1073a0 0x7fbcec197080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:55016/0 (socket says 172.21.15.79:55016) 2024-08-20T01:37:31.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.369+0000 7fbcebfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbcec101990 0x7fbcec196b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:31.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.369+0000 7fbcf0a71640 1 -- 172.21.15.79:0/3414653777 learned_addr learned my addr 172.21.15.79:0/3414653777 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:31.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.369+0000 7fbcf24d4640 1 -- 172.21.15.79:0/3414653777 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbcec1107d0 con 0x7fbcec107d20 2024-08-20T01:37:31.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.369+0000 7fbcf24d4640 1 -- 172.21.15.79:0/3414653777 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbcec110650 con 0x7fbcec1073a0 2024-08-20T01:37:31.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.369+0000 7fbcf24d4640 1 -- 172.21.15.79:0/3414653777 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbcec110950 con 0x7fbcec101990 2024-08-20T01:37:31.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.370+0000 7fbcf0a71640 1 -- 172.21.15.79:0/3414653777 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbcec101990 msgr2=0x7fbcec196b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:31.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.370+0000 7fbcf0a71640 1 --2- 172.21.15.79:0/3414653777 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbcec101990 0x7fbcec196b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:31.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.370+0000 7fbcf0a71640 1 -- 172.21.15.79:0/3414653777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcec1073a0 msgr2=0x7fbcec197080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:31.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.370+0000 7fbcf0a71640 1 --2- 172.21.15.79:0/3414653777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcec1073a0 0x7fbcec197080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:31.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.370+0000 7fbcf0a71640 1 -- 172.21.15.79:0/3414653777 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcec19cbf0 con 0x7fbcec107d20 2024-08-20T01:37:31.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.370+0000 7fbcf0a71640 1 --2- 172.21.15.79:0/3414653777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcec107d20 0x7fbcec19c420 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fbce4032ba0 tx=0x7fbce4032bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:31.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.370+0000 7fbce97fa640 1 -- 172.21.15.79:0/3414653777 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce4004040 con 0x7fbcec107d20 2024-08-20T01:37:31.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.370+0000 7fbce97fa640 1 -- 172.21.15.79:0/3414653777 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbce4004670 con 0x7fbcec107d20 2024-08-20T01:37:31.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.370+0000 7fbcf24d4640 1 -- 172.21.15.79:0/3414653777 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcec19ce80 con 0x7fbcec107d20 2024-08-20T01:37:31.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.371+0000 7fbcf24d4640 1 -- 172.21.15.79:0/3414653777 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcec1a35a0 con 0x7fbcec107d20 2024-08-20T01:37:31.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.372+0000 7fbce97fa640 1 -- 172.21.15.79:0/3414653777 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce4030d50 con 0x7fbcec107d20 2024-08-20T01:37:31.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.374+0000 7fbcf48cd740 1 Processor -- start 2024-08-20T01:37:31.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.375+0000 7fbce97fa640 1 -- 172.21.15.79:0/3414653777 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fbce404e440 con 0x7fbcec107d20 2024-08-20T01:37:31.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.375+0000 7fbcf48cd740 1 -- start start 2024-08-20T01:37:31.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.375+0000 7fbcf48cd740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633884b6830 0x5633884b6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:31.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.375+0000 7fbcf48cd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5633884b7150 0x5633884c6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:31.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.375+0000 7fbcf48cd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633884c74f0 0x5633884c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:31.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.375+0000 7fbcf48cd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56338842d8e0 con 0x5633884c74f0 2024-08-20T01:37:31.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.375+0000 7fbcf48cd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56338841cde0 con 0x5633884b7150 2024-08-20T01:37:31.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.375+0000 7fbcf48cd740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563388420e20 con 0x5633884b6830 2024-08-20T01:37:31.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.376+0000 7fbceb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633884c74f0 0x5633884c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:31.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.376+0000 7fbceb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633884c74f0 0x5633884c98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51442/0 (socket says 172.21.15.79:51442) 2024-08-20T01:37:31.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.376+0000 7fbceb7fe640 1 -- 172.21.15.79:0/3099353151 learned_addr learned my addr 172.21.15.79:0/3099353151 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.376+0000 7fbcebfff640 1 --2- 172.21.15.79:0/3099353151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5633884b7150 0x5633884c6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.376+0000 7fbce97fa640 1 --2- 172.21.15.79:0/3414653777 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbcd40b3c50 0x7fbcd40b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.376+0000 7fbce97fa640 1 -- 172.21.15.79:0/3414653777 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fbce4104e00 con 0x7fbcec107d20 2024-08-20T01:37:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.376+0000 7fbceb7fe640 1 -- 172.21.15.79:0/3099353151 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633884b6830 msgr2=0x5633884b6c10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:37:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.376+0000 7fbceb7fe640 1 --2- 172.21.15.79:0/3099353151 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633884b6830 0x5633884b6c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.376+0000 7fbceb7fe640 1 -- 172.21.15.79:0/3099353151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5633884b7150 msgr2=0x5633884c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.376+0000 7fbceb7fe640 1 --2- 172.21.15.79:0/3099353151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5633884b7150 0x5633884c6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.376+0000 7fbceb7fe640 1 -- 172.21.15.79:0/3099353151 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56338817c650 con 0x5633884c74f0 2024-08-20T01:37:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.377+0000 7fbceb7fe640 1 --2- 172.21.15.79:0/3099353151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633884c74f0 0x5633884c98e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fbce0009c30 tx=0x7fbce0011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48bb69396d062853 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.377+0000 7fbcf0a71640 1 --2- 172.21.15.79:0/3414653777 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbcd40b3c50 0x7fbcd40b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:31.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.378+0000 7fbcf0a71640 1 --2- 172.21.15.79:0/3414653777 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbcd40b3c50 0x7fbcd40b6110 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbce4031920 tx=0x7fbce4039000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:31.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.378+0000 7fbcd27fc640 1 -- 172.21.15.79:0/3099353151 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce001e070 con 0x5633884c74f0 2024-08-20T01:37:31.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.378+0000 7fbcd27fc640 1 -- 172.21.15.79:0/3099353151 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbce0004250 con 0x5633884c74f0 2024-08-20T01:37:31.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.378+0000 7fbcd27fc640 1 -- 172.21.15.79:0/3099353151 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce0019690 con 0x5633884c74f0 2024-08-20T01:37:31.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.379+0000 7fbcf48cd740 1 -- 172.21.15.79:0/3099353151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633884c74f0 msgr2=0x5633884c98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:31.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.379+0000 7fbcf48cd740 1 --2- 172.21.15.79:0/3099353151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633884c74f0 0x5633884c98e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fbce0009c30 tx=0x7fbce0011810 comp rx=0 tx=0).stop 2024-08-20T01:37:31.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.379+0000 7fbcf48cd740 1 -- 172.21.15.79:0/3099353151 shutdown_connections 2024-08-20T01:37:31.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.379+0000 7fbcf48cd740 1 --2- 172.21.15.79:0/3099353151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633884c74f0 0x5633884c98e0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:31.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.379+0000 7fbcf48cd740 1 --2- 172.21.15.79:0/3099353151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5633884b7150 0x5633884c6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:31.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.379+0000 7fbcf48cd740 1 --2- 172.21.15.79:0/3099353151 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633884b6830 0x5633884b6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:31.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.379+0000 7fbcf48cd740 1 -- 172.21.15.79:0/3099353151 >> 172.21.15.79:0/3099353151 conn(0x5633884b4660 msgr2=0x5633884b5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:31.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.379+0000 7fbcf48cd740 1 -- 172.21.15.79:0/3099353151 shutdown_connections 2024-08-20T01:37:31.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.379+0000 7fbcf48cd740 1 -- 172.21.15.79:0/3099353151 wait complete. 2024-08-20T01:37:31.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.380+0000 7fbcf48cd740 1 -- start start 2024-08-20T01:37:31.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.380+0000 7fbcf48cd740 1 Processor -- start 2024-08-20T01:37:31.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.381+0000 7fbcf48cd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5633884b6830 0x5633884c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:31.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.381+0000 7fbcf48cd740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633884b7150 0x5633884c4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:31.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.381+0000 7fbcf48cd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633884c74f0 0x5633884c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:31.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.381+0000 7fbceb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633884c74f0 0x5633884c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:31.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.381+0000 7fbceb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633884c74f0 0x5633884c4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51456/0 (socket says 172.21.15.79:51456) 2024-08-20T01:37:31.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.381+0000 7fbceb7fe640 1 -- 172.21.15.79:0/4226911852 learned_addr learned my addr 172.21.15.79:0/4226911852 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:31.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.381+0000 7fbcf48cd740 1 -- 172.21.15.79:0/4226911852 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56338827f700 con 0x5633884c74f0 2024-08-20T01:37:31.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.381+0000 7fbcf48cd740 1 -- 172.21.15.79:0/4226911852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5633883a37c0 con 0x5633884b6830 2024-08-20T01:37:31.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.381+0000 7fbcf48cd740 1 -- 172.21.15.79:0/4226911852 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5633884ca1a0 con 0x5633884b7150 2024-08-20T01:37:31.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.381+0000 7fbcebfff640 1 --2- 172.21.15.79:0/4226911852 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633884b7150 0x5633884c4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:31.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.381+0000 7fbceb7fe640 1 --2- 172.21.15.79:0/4226911852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5633884b6830 0x5633884c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:31.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.382+0000 7fbceb7fe640 1 -- 172.21.15.79:0/4226911852 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633884b7150 msgr2=0x5633884c4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:31.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.382+0000 7fbceb7fe640 1 --2- 172.21.15.79:0/4226911852 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633884b7150 0x5633884c4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:31.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.382+0000 7fbceb7fe640 1 -- 172.21.15.79:0/4226911852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5633884b6830 msgr2=0x5633884c44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:31.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.382+0000 7fbceb7fe640 1 --2- 172.21.15.79:0/4226911852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5633884b6830 0x5633884c44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:31.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.382+0000 7fbceb7fe640 1 -- 172.21.15.79:0/4226911852 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633884d3660 con 0x5633884c74f0 2024-08-20T01:37:31.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.382+0000 7fbcf48cd740 10 client.0 _ll_register_callbacks cb 0x5633884166b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:31.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.382+0000 7fbceb7fe640 1 --2- 172.21.15.79:0/4226911852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633884c74f0 0x5633884c4f70 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fbce0003b70 tx=0x7fbce0005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=434110693c35c4ef server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:31.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.382+0000 7fbcf48cd740 1 -- 172.21.15.79:0/4226911852 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5633883cc100 con 0x5633884c74f0 2024-08-20T01:37:31.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.382+0000 7fbccb7fe640 10 client.15480 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:37:31.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.383+0000 7fbccb7fe640 1 -- 172.21.15.79:0/4226911852 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce002d060 con 0x5633884c74f0 2024-08-20T01:37:31.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.383+0000 7fbccb7fe640 1 -- 172.21.15.79:0/4226911852 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fbce0019430 con 0x5633884c74f0 2024-08-20T01:37:31.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.383+0000 7fbccb7fe640 1 -- 172.21.15.79:0/4226911852 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbce001e040 con 0x5633884c74f0 2024-08-20T01:37:31.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.383+0000 7fbcf48cd740 10 client.15480 fetch_fsmap learned FSMap version 28 2024-08-20T01:37:31.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.383+0000 7fbcf48cd740 1 -- 172.21.15.79:0/4226911852 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5633884d5dd0 con 0x5633884c74f0 2024-08-20T01:37:31.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.383+0000 7fbccb7fe640 1 -- 172.21.15.79:0/4226911852 <== mon.0 v2:172.21.15.79:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbce0024070 con 0x5633884c74f0 2024-08-20T01:37:31.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.383+0000 7fbcf48cd740 10 client.15480 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:37:31.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.383+0000 7fbcf48cd740 10 client.15480 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:37:31.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.383+0000 7fbcf48cd740 20 client.15480 populate_metadata read hostname 'smithi079' 2024-08-20T01:37:31.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.383+0000 7fbcf48cd740 1 --2- 172.21.15.79:0/4226911852 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5633884d7120 0x5633884d9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:31.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.383+0000 7fbcf48cd740 4 client.15480 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:37:31.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.383+0000 7fbcf48cd740 1 -- 172.21.15.79:0/4226911852 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56338842f830 con 0x5633884d7120 2024-08-20T01:37:31.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.384+0000 7fbcebfff640 1 --2- 172.21.15.79:0/4226911852 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5633884d7120 0x5633884d9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:31.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.384+0000 7fbccb7fe640 10 client.15480 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:37:31.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.384+0000 7fbcebfff640 1 --2- 172.21.15.79:0/4226911852 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5633884d7120 0x5633884d9510 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50907cd939ab0b8 server_cookie=b88882eeb278f090 in_seq=0 out_seq=0 2024-08-20T01:37:31.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.385+0000 7fbccb7fe640 1 -- 172.21.15.79:0/4226911852 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56338842f830 con 0x5633884d7120 2024-08-20T01:37:31.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.385+0000 7fbccb7fe640 10 client.15480 handle_command_reply: tid=0 2024-08-20T01:37:31.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.385+0000 7fbcf48cd740 1 client.15480 shutdown 2024-08-20T01:37:31.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.385+0000 7fbcf48cd740 1 -- 172.21.15.79:0/4226911852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633884c74f0 msgr2=0x5633884c4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:31.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.385+0000 7fbcf48cd740 1 --2- 172.21.15.79:0/4226911852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633884c74f0 0x5633884c4f70 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fbce0003b70 tx=0x7fbce0005850 comp rx=0 tx=0).stop 2024-08-20T01:37:31.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.385+0000 7fbcf48cd740 1 -- 172.21.15.79:0/4226911852 shutdown_connections 2024-08-20T01:37:31.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.385+0000 7fbcf48cd740 1 --2- 172.21.15.79:0/4226911852 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5633884d7120 0x5633884d9510 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:31.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.386+0000 7fbccb7fe640 0 client.15480 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:37:31.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.386+0000 7fbcf48cd740 1 --2- 172.21.15.79:0/4226911852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633884c74f0 0x5633884c4f70 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:31.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.386+0000 7fbcf48cd740 1 --2- 172.21.15.79:0/4226911852 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633884b7150 0x5633884c4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:31.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.386+0000 7fbcf48cd740 1 --2- 172.21.15.79:0/4226911852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5633884b6830 0x5633884c44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:31.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.386+0000 7fbcf48cd740 1 -- 172.21.15.79:0/4226911852 >> 172.21.15.79:0/4226911852 conn(0x5633884b4660 msgr2=0x5633884ba190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:31.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.386+0000 7fbcf48cd740 1 -- 172.21.15.79:0/4226911852 shutdown_connections 2024-08-20T01:37:31.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.386+0000 7fbcf48cd740 1 -- 172.21.15.79:0/4226911852 wait complete. 2024-08-20T01:37:31.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.386+0000 7fbcf48cd740 20 client.15480 trim_cache size 0 max 16384 2024-08-20T01:37:31.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.420+0000 7fbcf48cd740 1 Processor -- start 2024-08-20T01:37:31.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.420+0000 7fbcf48cd740 1 -- start start 2024-08-20T01:37:31.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.420+0000 7fbcf48cd740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633884b6830 0x5633884c1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:31.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.421+0000 7fbcf48cd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5633884b7150 0x5633884b3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:31.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.421+0000 7fbcf48cd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633884c74f0 0x5633884c6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:31.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.421+0000 7fbcf48cd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd800e400 con 0x5633884c74f0 2024-08-20T01:37:31.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.421+0000 7fbcf48cd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd800ff40 con 0x5633884b7150 2024-08-20T01:37:31.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.421+0000 7fbcf48cd740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd800ead0 con 0x5633884b6830 2024-08-20T01:37:31.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.421+0000 7fbceb7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633884b6830 0x5633884c1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:31.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.421+0000 7fbcebfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5633884b7150 0x5633884b3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:31.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.421+0000 7fbcebfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5633884b7150 0x5633884b3f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:55056/0 (socket says 172.21.15.79:55056) 2024-08-20T01:37:31.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.421+0000 7fbceb7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633884b6830 0x5633884c1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:60166/0 (socket says 172.21.15.79:60166) 2024-08-20T01:37:31.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.421+0000 7fbcebfff640 1 -- 172.21.15.79:0/1188951396 learned_addr learned my addr 172.21.15.79:0/1188951396 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:31.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.421+0000 7fbceb7fe640 1 --2- 172.21.15.79:0/1188951396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633884c74f0 0x5633884c6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:31.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.421+0000 7fbcebfff640 1 -- 172.21.15.79:0/1188951396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633884b6830 msgr2=0x5633884c1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:31.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.421+0000 7fbcebfff640 1 --2- 172.21.15.79:0/1188951396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633884b6830 0x5633884c1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:31.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.421+0000 7fbcebfff640 1 -- 172.21.15.79:0/1188951396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633884c74f0 msgr2=0x5633884c6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:31.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.422+0000 7fbcebfff640 1 --2- 172.21.15.79:0/1188951396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633884c74f0 0x5633884c6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:31.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.422+0000 7fbcebfff640 1 -- 172.21.15.79:0/1188951396 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633884b6f80 con 0x5633884b7150 2024-08-20T01:37:31.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.422+0000 7fbceb7fe640 1 --2- 172.21.15.79:0/1188951396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633884c74f0 0x5633884c6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:37:31.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.422+0000 7fbcebfff640 1 --2- 172.21.15.79:0/1188951396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5633884b7150 0x5633884b3f10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc004700 tx=0x7fbcdc00b500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae8369efb134eded server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:31.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.422+0000 7fbcd1ffb640 1 -- 172.21.15.79:0/1188951396 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc00bd40 con 0x5633884b7150 2024-08-20T01:37:31.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.422+0000 7fbcd1ffb640 1 -- 172.21.15.79:0/1188951396 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbcdc0054b0 con 0x5633884b7150 2024-08-20T01:37:31.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.422+0000 7fbcd1ffb640 1 -- 172.21.15.79:0/1188951396 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc018660 con 0x5633884b7150 2024-08-20T01:37:31.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.423+0000 7fbcf48cd740 1 -- 172.21.15.79:0/1188951396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5633884b7150 msgr2=0x5633884b3f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:31.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.423+0000 7fbcf48cd740 1 --2- 172.21.15.79:0/1188951396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5633884b7150 0x5633884b3f10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc004700 tx=0x7fbcdc00b500 comp rx=0 tx=0).stop 2024-08-20T01:37:31.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.423+0000 7fbcf48cd740 1 -- 172.21.15.79:0/1188951396 shutdown_connections 2024-08-20T01:37:31.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.423+0000 7fbcf48cd740 1 --2- 172.21.15.79:0/1188951396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633884c74f0 0x5633884c6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:31.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.423+0000 7fbcf48cd740 1 --2- 172.21.15.79:0/1188951396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5633884b7150 0x5633884b3f10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:31.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.424+0000 7fbcf48cd740 1 --2- 172.21.15.79:0/1188951396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633884b6830 0x5633884c1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:31.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.424+0000 7fbcf48cd740 1 -- 172.21.15.79:0/1188951396 >> 172.21.15.79:0/1188951396 conn(0x5633884b4660 msgr2=0x5633884c5b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:31.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.424+0000 7fbcf48cd740 1 -- 172.21.15.79:0/1188951396 shutdown_connections 2024-08-20T01:37:31.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.424+0000 7fbcf48cd740 1 -- 172.21.15.79:0/1188951396 wait complete. 2024-08-20T01:37:31.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.424+0000 7fbcf48cd740 1 -- start start 2024-08-20T01:37:31.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.425+0000 7fbcf48cd740 1 Processor -- start 2024-08-20T01:37:31.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.425+0000 7fbcf48cd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633884b6830 0x5633884ded30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:31.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.425+0000 7fbcf48cd740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633884b7150 0x5633884df270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:31.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.426+0000 7fbcf48cd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5633884c74f0 0x5633884cf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:31.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.426+0000 7fbcf48cd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd800f870 con 0x5633884b6830 2024-08-20T01:37:31.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.426+0000 7fbcf48cd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd800f1a0 con 0x5633884c74f0 2024-08-20T01:37:31.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.426+0000 7fbcf48cd740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd800c3e0 con 0x5633884b7150 2024-08-20T01:37:31.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.426+0000 7fbcf48cd740 10 client.0 _ll_register_callbacks cb 0x7fbce001c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:31.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.426+0000 7fbceb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633884b6830 0x5633884ded30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:31.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.426+0000 7fbceb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633884b6830 0x5633884ded30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51478/0 (socket says 172.21.15.79:51478) 2024-08-20T01:37:31.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.426+0000 7fbceb7fe640 1 -- 172.21.15.79:0/2442985776 learned_addr learned my addr 172.21.15.79:0/2442985776 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:31.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.426+0000 7fbcebfff640 1 --2- 172.21.15.79:0/2442985776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633884b7150 0x5633884df270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:31.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.426+0000 7fbcebfff640 1 -- 172.21.15.79:0/2442985776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5633884c74f0 msgr2=0x5633884cf4c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:37:31.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.426+0000 7fbcebfff640 1 --2- 172.21.15.79:0/2442985776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5633884c74f0 0x5633884cf4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:31.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.426+0000 7fbcebfff640 1 -- 172.21.15.79:0/2442985776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633884b6830 msgr2=0x5633884ded30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:31.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.426+0000 7fbcebfff640 1 --2- 172.21.15.79:0/2442985776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633884b6830 0x5633884ded30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:31.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.426+0000 7fbcebfff640 1 -- 172.21.15.79:0/2442985776 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633884cfa80 con 0x5633884b7150 2024-08-20T01:37:31.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.427+0000 7fbcebfff640 1 --2- 172.21.15.79:0/2442985776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633884b7150 0x5633884df270 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x5633883c8e00 tx=0x7fbcdc004d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82cf38d6d9fe8339 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:31.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.427+0000 7fbccb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:37:31.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.427+0000 7fbccb7fe640 1 -- 172.21.15.79:0/2442985776 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc02c070 con 0x5633884b7150 2024-08-20T01:37:31.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.427+0000 7fbcf48cd740 1 -- 172.21.15.79:0/2442985776 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcdc0054b0 con 0x5633884b7150 2024-08-20T01:37:31.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.427+0000 7fbccb7fe640 1 -- 172.21.15.79:0/2442985776 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fbcdc005230 con 0x5633884b7150 2024-08-20T01:37:31.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.427+0000 7fbccb7fe640 1 -- 172.21.15.79:0/2442985776 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbcdc0047a0 con 0x5633884b7150 2024-08-20T01:37:31.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.428+0000 7fbcf48cd740 10 client.24922 fetch_fsmap learned FSMap version 28 2024-08-20T01:37:31.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.428+0000 7fbcf48cd740 1 -- 172.21.15.79:0/2442985776 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5633884b8700 con 0x5633884b7150 2024-08-20T01:37:31.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.428+0000 7fbccb7fe640 1 -- 172.21.15.79:0/2442985776 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbcdc0054b0 con 0x5633884b7150 2024-08-20T01:37:31.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.429+0000 7fbccb7fe640 1 -- 172.21.15.79:0/2442985776 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbcdc028ca0 con 0x5633884b7150 2024-08-20T01:37:31.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.429+0000 7fbcf48cd740 10 client.24922 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:37:31.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.429+0000 7fbcf48cd740 10 client.24922 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:37:31.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.429+0000 7fbcf48cd740 20 client.24922 populate_metadata read hostname 'smithi079' 2024-08-20T01:37:31.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.429+0000 7fbcf48cd740 1 --2- 172.21.15.79:0/2442985776 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5633884d7120 0x5633884bece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:31.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.429+0000 7fbcf48cd740 4 client.24922 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:37:31.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.429+0000 7fbcf48cd740 1 -- 172.21.15.79:0/2442985776 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56338842b2d0 con 0x5633884d7120 2024-08-20T01:37:31.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.429+0000 7fbceb7fe640 1 --2- 172.21.15.79:0/2442985776 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5633884d7120 0x5633884bece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:31.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.430+0000 7fbceb7fe640 1 --2- 172.21.15.79:0/2442985776 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5633884d7120 0x5633884bece0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=414b6e61794ad49c server_cookie=aad672889e9bb162 in_seq=0 out_seq=0 2024-08-20T01:37:31.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.430+0000 7fbccb7fe640 10 client.24922 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:37:31.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.430+0000 7fbccb7fe640 1 -- 172.21.15.79:0/2442985776 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56338842b2d0 con 0x5633884d7120 2024-08-20T01:37:31.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.430+0000 7fbccb7fe640 10 client.24922 handle_command_reply: tid=0 2024-08-20T01:37:31.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.430+0000 7fbcf48cd740 1 client.24922 shutdown 2024-08-20T01:37:31.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.430+0000 7fbcf48cd740 1 -- 172.21.15.79:0/2442985776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633884b7150 msgr2=0x5633884df270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:31.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.430+0000 7fbcf48cd740 1 --2- 172.21.15.79:0/2442985776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633884b7150 0x5633884df270 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x5633883c8e00 tx=0x7fbcdc004d10 comp rx=0 tx=0).stop 2024-08-20T01:37:31.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.431+0000 7fbcf48cd740 1 -- 172.21.15.79:0/2442985776 shutdown_connections 2024-08-20T01:37:31.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.431+0000 7fbcf48cd740 1 --2- 172.21.15.79:0/2442985776 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5633884d7120 0x5633884bece0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:31.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.431+0000 7fbcf48cd740 1 --2- 172.21.15.79:0/2442985776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5633884c74f0 0x5633884cf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:31.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.431+0000 7fbcf48cd740 1 --2- 172.21.15.79:0/2442985776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633884b7150 0x5633884df270 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:31.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.431+0000 7fbcf48cd740 1 --2- 172.21.15.79:0/2442985776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633884b6830 0x5633884ded30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:31.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.431+0000 7fbcf48cd740 1 -- 172.21.15.79:0/2442985776 >> 172.21.15.79:0/2442985776 conn(0x5633884b4660 msgr2=0x5633884ba190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:31.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.431+0000 7fbccb7fe640 0 client.24922 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:37:31.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.431+0000 7fbcf48cd740 1 -- 172.21.15.79:0/2442985776 shutdown_connections 2024-08-20T01:37:31.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.431+0000 7fbcf48cd740 1 -- 172.21.15.79:0/2442985776 wait complete. 2024-08-20T01:37:31.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.431+0000 7fbcf48cd740 20 client.24922 trim_cache size 0 max 16384 2024-08-20T01:37:31.437 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:37:31.437 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-08-20T01:37:31.437 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-08-20T01:37:31.437 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:37:31.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.432+0000 7fbcf24d4640 1 -- 172.21.15.79:0/3414653777 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbcd40b3c50 msgr2=0x7fbcd40b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:31.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.432+0000 7fbcf24d4640 1 --2- 172.21.15.79:0/3414653777 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbcd40b3c50 0x7fbcd40b6110 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbce4031920 tx=0x7fbce4039000 comp rx=0 tx=0).stop 2024-08-20T01:37:31.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.432+0000 7fbcf24d4640 1 -- 172.21.15.79:0/3414653777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcec107d20 msgr2=0x7fbcec19c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:31.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.432+0000 7fbcf24d4640 1 --2- 172.21.15.79:0/3414653777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcec107d20 0x7fbcec19c420 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fbce4032ba0 tx=0x7fbce4032bd0 comp rx=0 tx=0).stop 2024-08-20T01:37:31.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.432+0000 7fbcf24d4640 1 -- 172.21.15.79:0/3414653777 shutdown_connections 2024-08-20T01:37:31.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.432+0000 7fbcf24d4640 1 --2- 172.21.15.79:0/3414653777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcec107d20 0x7fbcec19c420 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:31.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.432+0000 7fbcf24d4640 1 --2- 172.21.15.79:0/3414653777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcec1073a0 0x7fbcec197080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:31.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.432+0000 7fbcf24d4640 1 --2- 172.21.15.79:0/3414653777 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbcd40b3c50 0x7fbcd40b6110 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:31.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.432+0000 7fbcf24d4640 1 --2- 172.21.15.79:0/3414653777 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbcec101990 0x7fbcec196b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:31.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.432+0000 7fbcf24d4640 1 -- 172.21.15.79:0/3414653777 >> 172.21.15.79:0/3414653777 conn(0x7fbcec0fd400 msgr2=0x7fbcec0fda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:31.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.433+0000 7fbcf24d4640 1 -- 172.21.15.79:0/3414653777 shutdown_connections 2024-08-20T01:37:31.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:31.433+0000 7fbcf24d4640 1 -- 172.21.15.79:0/3414653777 wait complete. 2024-08-20T01:37:32.266 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:31 smithi079 ceph-mon[18656]: pgmap v353: 97 pgs: 97 active+clean; 662 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-08-20T01:37:32.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:31 smithi081 ceph-mon[22209]: pgmap v353: 97 pgs: 97 active+clean; 662 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-08-20T01:37:32.309 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T01:37:32.310 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:37:32.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:31 smithi175 ceph-mon[22392]: pgmap v353: 97 pgs: 97 active+clean; 662 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-08-20T01:37:32.677 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:37:33.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.201+0000 7f6c3124a640 1 -- 172.21.15.79:0/570165812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c2c1073a0 msgr2=0x7f6c2c1077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:33.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.201+0000 7f6c3124a640 1 --2- 172.21.15.79:0/570165812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c2c1073a0 0x7f6c2c1077e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f6c20009900 tx=0x7f6c2002a410 comp rx=0 tx=0).stop 2024-08-20T01:37:33.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.201+0000 7f6c3124a640 1 -- 172.21.15.79:0/570165812 shutdown_connections 2024-08-20T01:37:33.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.201+0000 7f6c3124a640 1 --2- 172.21.15.79:0/570165812 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c2c107d20 0x7f6c2c10e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:33.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.201+0000 7f6c3124a640 1 --2- 172.21.15.79:0/570165812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c2c1073a0 0x7f6c2c1077e0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:33.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.201+0000 7f6c3124a640 1 --2- 172.21.15.79:0/570165812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c2c101990 0x7f6c2c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:33.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.201+0000 7f6c3124a640 1 -- 172.21.15.79:0/570165812 >> 172.21.15.79:0/570165812 conn(0x7f6c2c0fd400 msgr2=0x7f6c2c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:33.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.202+0000 7f6c3124a640 1 -- 172.21.15.79:0/570165812 shutdown_connections 2024-08-20T01:37:33.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.202+0000 7f6c3124a640 1 -- 172.21.15.79:0/570165812 wait complete. 2024-08-20T01:37:33.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.202+0000 7f6c3124a640 1 Processor -- start 2024-08-20T01:37:33.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.203+0000 7f6c3124a640 1 -- start start 2024-08-20T01:37:33.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.203+0000 7f6c3124a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c2c101990 0x7f6c2c19b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:33.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.203+0000 7f6c3124a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c2c1073a0 0x7f6c2c19b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:33.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.203+0000 7f6c2a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c2c1073a0 0x7f6c2c19b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:33.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.203+0000 7f6c2a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c2c1073a0 0x7f6c2c19b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51488/0 (socket says 172.21.15.79:51488) 2024-08-20T01:37:33.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.203+0000 7f6c3124a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c2c107d20 0x7f6c2c1a0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:33.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.203+0000 7f6c2a59c640 1 -- 172.21.15.79:0/3847464975 learned_addr learned my addr 172.21.15.79:0/3847464975 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:33.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.203+0000 7f6c2ad9d640 1 --2- 172.21.15.79:0/3847464975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c2c101990 0x7f6c2c19b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:33.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.203+0000 7f6c3124a640 1 -- 172.21.15.79:0/3847464975 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2c111890 con 0x7f6c2c1073a0 2024-08-20T01:37:33.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.203+0000 7f6c3124a640 1 -- 172.21.15.79:0/3847464975 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2c111710 con 0x7f6c2c101990 2024-08-20T01:37:33.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.203+0000 7f6c3124a640 1 -- 172.21.15.79:0/3847464975 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2c111a10 con 0x7f6c2c107d20 2024-08-20T01:37:33.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.203+0000 7f6c2b59e640 1 --2- 172.21.15.79:0/3847464975 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c2c107d20 0x7f6c2c1a0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:33.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.203+0000 7f6c2a59c640 1 -- 172.21.15.79:0/3847464975 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c2c107d20 msgr2=0x7f6c2c1a0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:33.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.204+0000 7f6c2a59c640 1 --2- 172.21.15.79:0/3847464975 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c2c107d20 0x7f6c2c1a0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:33.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.204+0000 7f6c2a59c640 1 -- 172.21.15.79:0/3847464975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c2c101990 msgr2=0x7f6c2c19b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:33.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.204+0000 7f6c2a59c640 1 --2- 172.21.15.79:0/3847464975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c2c101990 0x7f6c2c19b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:33.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.204+0000 7f6c2a59c640 1 -- 172.21.15.79:0/3847464975 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c2c1a1130 con 0x7f6c2c1073a0 2024-08-20T01:37:33.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.204+0000 7f6c2a59c640 1 --2- 172.21.15.79:0/3847464975 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c2c1073a0 0x7f6c2c19b5c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f6c20009230 tx=0x7f6c20004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:33.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.204+0000 7f6c13fff640 1 -- 172.21.15.79:0/3847464975 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2003f030 con 0x7f6c2c1073a0 2024-08-20T01:37:33.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.204+0000 7f6c3124a640 1 -- 172.21.15.79:0/3847464975 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c2c1a13c0 con 0x7f6c2c1073a0 2024-08-20T01:37:33.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.204+0000 7f6c13fff640 1 -- 172.21.15.79:0/3847464975 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6c20003a80 con 0x7f6c2c1073a0 2024-08-20T01:37:33.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.204+0000 7f6c13fff640 1 -- 172.21.15.79:0/3847464975 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c20035070 con 0x7f6c2c1073a0 2024-08-20T01:37:33.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.204+0000 7f6c3124a640 1 -- 172.21.15.79:0/3847464975 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c2c1a7ae0 con 0x7f6c2c1073a0 2024-08-20T01:37:33.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.205+0000 7f6c11ffb640 1 -- 172.21.15.79:0/3847464975 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c0c005290 con 0x7f6c2c1073a0 2024-08-20T01:37:33.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.208+0000 7f6c13fff640 1 -- 172.21.15.79:0/3847464975 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f6c20042030 con 0x7f6c2c1073a0 2024-08-20T01:37:33.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.209+0000 7f6c13fff640 1 --2- 172.21.15.79:0/3847464975 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6c140b3cd0 0x7f6c140b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:33.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.209+0000 7f6c13fff640 1 -- 172.21.15.79:0/3847464975 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f6c20104750 con 0x7f6c2c1073a0 2024-08-20T01:37:33.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.209+0000 7f6c2ad9d640 1 --2- 172.21.15.79:0/3847464975 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6c140b3cd0 0x7f6c140b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:33.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.210+0000 7f6c2ad9d640 1 --2- 172.21.15.79:0/3847464975 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6c140b3cd0 0x7f6c140b6190 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c00bbe0 tx=0x7f6c1c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:33.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.211+0000 7f6c13fff640 1 -- 172.21.15.79:0/3847464975 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f6c200cbd50 con 0x7f6c2c1073a0 2024-08-20T01:37:33.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.431+0000 7f6c11ffb640 1 -- 172.21.15.79:0/3847464975 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c0c005580 con 0x7f6c2c1073a0 2024-08-20T01:37:33.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.432+0000 7f6c13fff640 1 -- 172.21.15.79:0/3847464975 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7f6c200cb650 con 0x7f6c2c1073a0 2024-08-20T01:37:33.434 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:37:33.434 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":28,"btime":"2024-08-20T01:36:49:088329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14670,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/735082912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":735082912},{"type":"v1","addr":"172.21.15.79:6835","nonce":735082912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2150339873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2150339873},{"type":"v1","addr":"172.21.15.79:6837","nonce":2150339873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:34:55.133562+0000","modified":"2024-08-20T01:36:48.384274+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24539,"mds_1":24538,"mds_2":24523,"mds_3":24514,"mds_4":24512},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14724":{"gid":14724,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/1071242274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1071242274},{"type":"v1","addr":"172.21.15.79:6839","nonce":1071242274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14730":{"gid":14730,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6841/2448977611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":2448977611},{"type":"v1","addr":"172.21.15.79:6841","nonce":2448977611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/1257507005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1257507005},{"type":"v1","addr":"172.21.15.81:6833","nonce":1257507005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1499936216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1499936216},{"type":"v1","addr":"172.21.15.81:6835","nonce":1499936216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/1107229215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1107229215},{"type":"v1","addr":"172.21.15.175:6833","nonce":1107229215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6837/2073598870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2073598870},{"type":"v1","addr":"172.21.15.81:6837","nonce":2073598870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/2552601173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2552601173},{"type":"v1","addr":"172.21.15.175:6835","nonce":2552601173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6837/1767284089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1767284089},{"type":"v1","addr":"172.21.15.175:6837","nonce":1767284089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/1331748742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1331748742},{"type":"v1","addr":"172.21.15.175:6839","nonce":1331748742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/4098410583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":4098410583},{"type":"v1","addr":"172.21.15.81:6839","nonce":4098410583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24539,"qdb_cluster":[24512,24538,24514,24523,24539]},"id":1}]} 2024-08-20T01:37:33.435 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 28 2024-08-20T01:37:33.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.434+0000 7f6c11ffb640 1 -- 172.21.15.79:0/3847464975 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6c140b3cd0 msgr2=0x7f6c140b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:33.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.434+0000 7f6c11ffb640 1 --2- 172.21.15.79:0/3847464975 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6c140b3cd0 0x7f6c140b6190 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c00bbe0 tx=0x7f6c1c00b390 comp rx=0 tx=0).stop 2024-08-20T01:37:33.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.434+0000 7f6c11ffb640 1 -- 172.21.15.79:0/3847464975 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c2c1073a0 msgr2=0x7f6c2c19b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:33.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.434+0000 7f6c11ffb640 1 --2- 172.21.15.79:0/3847464975 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c2c1073a0 0x7f6c2c19b5c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f6c20009230 tx=0x7f6c20004270 comp rx=0 tx=0).stop 2024-08-20T01:37:33.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.435+0000 7f6c11ffb640 1 -- 172.21.15.79:0/3847464975 shutdown_connections 2024-08-20T01:37:33.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.435+0000 7f6c11ffb640 1 --2- 172.21.15.79:0/3847464975 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6c140b3cd0 0x7f6c140b6190 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:33.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.435+0000 7f6c11ffb640 1 --2- 172.21.15.79:0/3847464975 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c2c107d20 0x7f6c2c1a0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:33.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.435+0000 7f6c11ffb640 1 --2- 172.21.15.79:0/3847464975 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c2c1073a0 0x7f6c2c19b5c0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:33.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.435+0000 7f6c11ffb640 1 --2- 172.21.15.79:0/3847464975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c2c101990 0x7f6c2c19b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:33.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.435+0000 7f6c11ffb640 1 -- 172.21.15.79:0/3847464975 >> 172.21.15.79:0/3847464975 conn(0x7f6c2c0fd400 msgr2=0x7f6c2c06a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:33.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.435+0000 7f6c11ffb640 1 -- 172.21.15.79:0/3847464975 shutdown_connections 2024-08-20T01:37:33.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:33.435+0000 7f6c11ffb640 1 -- 172.21.15.79:0/3847464975 wait complete. 2024-08-20T01:37:34.071 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:33 smithi079 ceph-mon[18656]: pgmap v354: 97 pgs: 97 active+clean; 662 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-08-20T01:37:34.071 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:33 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/3847464975' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:37:34.102 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-20T01:37:34.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:33 smithi081 ceph-mon[22209]: pgmap v354: 97 pgs: 97 active+clean; 662 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-08-20T01:37:34.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:33 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/3847464975' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:37:34.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:33 smithi175 ceph-mon[22392]: pgmap v354: 97 pgs: 97 active+clean; 662 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-08-20T01:37:34.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:33 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/3847464975' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:37:34.402 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:37:34.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.923+0000 7efc12d06640 1 -- 172.21.15.79:0/2282807157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc0c107d20 msgr2=0x7efc0c10e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:34.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.923+0000 7efc12d06640 1 --2- 172.21.15.79:0/2282807157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc0c107d20 0x7efc0c10e520 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7efc04009ca0 tx=0x7efc0402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:37:34.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.923+0000 7efc12d06640 1 -- 172.21.15.79:0/2282807157 shutdown_connections 2024-08-20T01:37:34.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.923+0000 7efc12d06640 1 --2- 172.21.15.79:0/2282807157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc0c107d20 0x7efc0c10e520 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:34.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.923+0000 7efc12d06640 1 --2- 172.21.15.79:0/2282807157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc0c1073a0 0x7efc0c1077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:34.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.923+0000 7efc12d06640 1 --2- 172.21.15.79:0/2282807157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc0c101990 0x7efc0c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:34.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.923+0000 7efc12d06640 1 -- 172.21.15.79:0/2282807157 >> 172.21.15.79:0/2282807157 conn(0x7efc0c0fd400 msgr2=0x7efc0c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:34.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.923+0000 7efc12d06640 1 -- 172.21.15.79:0/2282807157 shutdown_connections 2024-08-20T01:37:34.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.923+0000 7efc12d06640 1 -- 172.21.15.79:0/2282807157 wait complete. 2024-08-20T01:37:34.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.924+0000 7efc12d06640 1 Processor -- start 2024-08-20T01:37:34.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.924+0000 7efc12d06640 1 -- start start 2024-08-20T01:37:34.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.924+0000 7efc12d06640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc0c101990 0x7efc0c196be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:34.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.924+0000 7efc12d06640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc0c1073a0 0x7efc0c197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:34.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.924+0000 7efc12d06640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc0c107d20 0x7efc0c19c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:34.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.924+0000 7efc12d06640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efc0c1107d0 con 0x7efc0c1073a0 2024-08-20T01:37:34.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.924+0000 7efc12d06640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efc0c110650 con 0x7efc0c101990 2024-08-20T01:37:34.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.924+0000 7efc12d06640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efc0c110950 con 0x7efc0c107d20 2024-08-20T01:37:34.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.925+0000 7efc0bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc0c1073a0 0x7efc0c197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:34.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.925+0000 7efc0bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc0c1073a0 0x7efc0c197120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51508/0 (socket says 172.21.15.79:51508) 2024-08-20T01:37:34.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.925+0000 7efc0bfff640 1 -- 172.21.15.79:0/230418210 learned_addr learned my addr 172.21.15.79:0/230418210 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:34.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.925+0000 7efc10aa2640 1 --2- 172.21.15.79:0/230418210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc0c101990 0x7efc0c196be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:34.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.925+0000 7efc112a3640 1 --2- 172.21.15.79:0/230418210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc0c107d20 0x7efc0c19c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:34.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.925+0000 7efc0bfff640 1 -- 172.21.15.79:0/230418210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc0c107d20 msgr2=0x7efc0c19c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:34.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.925+0000 7efc0bfff640 1 --2- 172.21.15.79:0/230418210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc0c107d20 0x7efc0c19c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:34.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.925+0000 7efc0bfff640 1 -- 172.21.15.79:0/230418210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc0c101990 msgr2=0x7efc0c196be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:34.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.925+0000 7efc0bfff640 1 --2- 172.21.15.79:0/230418210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc0c101990 0x7efc0c196be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:34.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.925+0000 7efc0bfff640 1 -- 172.21.15.79:0/230418210 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc0c19cc90 con 0x7efc0c1073a0 2024-08-20T01:37:34.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.925+0000 7efc0bfff640 1 --2- 172.21.15.79:0/230418210 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc0c1073a0 0x7efc0c197120 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7efbf800c920 tx=0x7efbf800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:34.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.926+0000 7efc09ffb640 1 -- 172.21.15.79:0/230418210 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf8007c70 con 0x7efc0c1073a0 2024-08-20T01:37:34.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.926+0000 7efc12d06640 1 -- 172.21.15.79:0/230418210 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc0c19cf80 con 0x7efc0c1073a0 2024-08-20T01:37:34.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.926+0000 7efc09ffb640 1 -- 172.21.15.79:0/230418210 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efbf8007e10 con 0x7efc0c1073a0 2024-08-20T01:37:34.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.926+0000 7efc09ffb640 1 -- 172.21.15.79:0/230418210 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf80186f0 con 0x7efc0c1073a0 2024-08-20T01:37:34.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.926+0000 7efc12d06640 1 -- 172.21.15.79:0/230418210 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc0c1a3810 con 0x7efc0c1073a0 2024-08-20T01:37:34.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.929+0000 7efc150ff740 1 Processor -- start 2024-08-20T01:37:34.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.929+0000 7efc150ff740 1 -- start start 2024-08-20T01:37:34.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.930+0000 7efc09ffb640 1 -- 172.21.15.79:0/230418210 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7efbf800f450 con 0x7efc0c1073a0 2024-08-20T01:37:34.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.930+0000 7efc150ff740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55757e121880 0x55757e121c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:34.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.930+0000 7efc150ff740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55757e1221a0 0x55757e12dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:34.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.930+0000 7efc150ff740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55757e12e130 0x55757e130520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:34.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.930+0000 7efc150ff740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55757e098930 con 0x55757e1221a0 2024-08-20T01:37:34.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.930+0000 7efc150ff740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55757e087e30 con 0x55757e121880 2024-08-20T01:37:34.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.930+0000 7efc150ff740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55757e08be70 con 0x55757e12e130 2024-08-20T01:37:34.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.930+0000 7efc10aa2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55757e1221a0 0x55757e12dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:34.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.930+0000 7efc10aa2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55757e1221a0 0x55757e12dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51518/0 (socket says 172.21.15.79:51518) 2024-08-20T01:37:34.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.930+0000 7efc10aa2640 1 -- 172.21.15.79:0/4153646962 learned_addr learned my addr 172.21.15.79:0/4153646962 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:34.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.930+0000 7efc112a3640 1 --2- 172.21.15.79:0/4153646962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55757e121880 0x55757e121c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:34.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.930+0000 7efc0bfff640 1 --2- 172.21.15.79:0/4153646962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55757e12e130 0x55757e130520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:34.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.930+0000 7efc10aa2640 1 -- 172.21.15.79:0/4153646962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55757e12e130 msgr2=0x55757e130520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:34.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.930+0000 7efc10aa2640 1 --2- 172.21.15.79:0/4153646962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55757e12e130 0x55757e130520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:34.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.930+0000 7efc10aa2640 1 -- 172.21.15.79:0/4153646962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55757e121880 msgr2=0x55757e121c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:34.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.930+0000 7efc10aa2640 1 --2- 172.21.15.79:0/4153646962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55757e121880 0x55757e121c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:34.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.930+0000 7efc10aa2640 1 -- 172.21.15.79:0/4153646962 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55757dde7650 con 0x55757e1221a0 2024-08-20T01:37:34.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.931+0000 7efc112a3640 1 --2- 172.21.15.79:0/4153646962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55757e121880 0x55757e121c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:37:34.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.931+0000 7efc10aa2640 1 --2- 172.21.15.79:0/4153646962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55757e1221a0 0x55757e12dbf0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7efc0000bd40 tx=0x7efc000107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51eb328508d80412 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:34.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.931+0000 7efc09ffb640 1 --2- 172.21.15.79:0/230418210 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7efbfc0b3bb0 0x7efbfc0b6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:34.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.931+0000 7efbf6ffd640 1 -- 172.21.15.79:0/4153646962 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc00004230 con 0x55757e1221a0 2024-08-20T01:37:34.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.931+0000 7efbf6ffd640 1 -- 172.21.15.79:0/4153646962 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efc0000be30 con 0x55757e1221a0 2024-08-20T01:37:34.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.931+0000 7efbf6ffd640 1 -- 172.21.15.79:0/4153646962 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc000116a0 con 0x55757e1221a0 2024-08-20T01:37:34.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.931+0000 7efc09ffb640 1 -- 172.21.15.79:0/230418210 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7efbf80e3d80 con 0x7efc0c1073a0 2024-08-20T01:37:34.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.931+0000 7efc112a3640 1 --2- 172.21.15.79:0/230418210 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7efbfc0b3bb0 0x7efbfc0b6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:34.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.932+0000 7efc150ff740 1 -- 172.21.15.79:0/4153646962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55757e1221a0 msgr2=0x55757e12dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:34.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.932+0000 7efc112a3640 1 --2- 172.21.15.79:0/230418210 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7efbfc0b3bb0 0x7efbfc0b6070 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7efc04006010 tx=0x7efc04005fa0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:34.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.932+0000 7efc150ff740 1 --2- 172.21.15.79:0/4153646962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55757e1221a0 0x55757e12dbf0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7efc0000bd40 tx=0x7efc000107a0 comp rx=0 tx=0).stop 2024-08-20T01:37:34.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.932+0000 7efc150ff740 1 -- 172.21.15.79:0/4153646962 shutdown_connections 2024-08-20T01:37:34.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.932+0000 7efc150ff740 1 --2- 172.21.15.79:0/4153646962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55757e12e130 0x55757e130520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:34.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.932+0000 7efc150ff740 1 --2- 172.21.15.79:0/4153646962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55757e1221a0 0x55757e12dbf0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:34.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.932+0000 7efc150ff740 1 --2- 172.21.15.79:0/4153646962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55757e121880 0x55757e121c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:34.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.932+0000 7efc150ff740 1 -- 172.21.15.79:0/4153646962 >> 172.21.15.79:0/4153646962 conn(0x55757e11f6b0 msgr2=0x55757e120850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:34.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.932+0000 7efc150ff740 1 -- 172.21.15.79:0/4153646962 shutdown_connections 2024-08-20T01:37:34.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.932+0000 7efc150ff740 1 -- 172.21.15.79:0/4153646962 wait complete. 2024-08-20T01:37:34.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.933+0000 7efc150ff740 1 -- start start 2024-08-20T01:37:34.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.933+0000 7efc150ff740 1 Processor -- start 2024-08-20T01:37:34.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.933+0000 7efc150ff740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55757e121880 0x55757e12b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:34.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.933+0000 7efc150ff740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55757e1221a0 0x55757e12b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:34.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.934+0000 7efc150ff740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55757e12e130 0x55757e12bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:34.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.934+0000 7efc150ff740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55757deea700 con 0x55757e12e130 2024-08-20T01:37:34.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.934+0000 7efc150ff740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55757e00e810 con 0x55757e121880 2024-08-20T01:37:34.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.934+0000 7efc150ff740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55757e130de0 con 0x55757e1221a0 2024-08-20T01:37:34.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.934+0000 7efc150ff740 10 client.0 _ll_register_callbacks cb 0x55757e081700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:34.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.934+0000 7efc0bfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55757e1221a0 0x55757e12b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:34.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.934+0000 7efc0bfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55757e1221a0 0x55757e12b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:60230/0 (socket says 172.21.15.79:60230) 2024-08-20T01:37:34.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.934+0000 7efc0bfff640 1 -- 172.21.15.79:0/2064995288 learned_addr learned my addr 172.21.15.79:0/2064995288 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:34.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.934+0000 7efc112a3640 1 --2- 172.21.15.79:0/2064995288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55757e12e130 0x55757e12bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:34.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.934+0000 7efc10aa2640 1 --2- 172.21.15.79:0/2064995288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55757e121880 0x55757e12b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:34.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.935+0000 7efc0bfff640 1 -- 172.21.15.79:0/2064995288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55757e121880 msgr2=0x55757e12b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:34.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.935+0000 7efc0bfff640 1 --2- 172.21.15.79:0/2064995288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55757e121880 0x55757e12b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:34.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.935+0000 7efc0bfff640 1 -- 172.21.15.79:0/2064995288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55757e12e130 msgr2=0x55757e12bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:34.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.935+0000 7efc0bfff640 1 --2- 172.21.15.79:0/2064995288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55757e12e130 0x55757e12bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:34.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.935+0000 7efc0bfff640 1 -- 172.21.15.79:0/2064995288 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55757e13a1c0 con 0x55757e1221a0 2024-08-20T01:37:34.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.935+0000 7efc10aa2640 1 --2- 172.21.15.79:0/2064995288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55757e121880 0x55757e12b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:37:34.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.935+0000 7efc0bfff640 1 --2- 172.21.15.79:0/2064995288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55757e1221a0 0x55757e12b5f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efbf8000c00 tx=0x7efbf80aa4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f6284073c0ac4fc server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:34.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.935+0000 7efbebfff640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:37:34.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.935+0000 7efbebfff640 1 -- 172.21.15.79:0/2064995288 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf80e5050 con 0x55757e1221a0 2024-08-20T01:37:34.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.935+0000 7efbebfff640 1 -- 172.21.15.79:0/2064995288 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7efbf80a6f10 con 0x55757e1221a0 2024-08-20T01:37:34.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.935+0000 7efc150ff740 1 -- 172.21.15.79:0/2064995288 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55757e037150 con 0x55757e1221a0 2024-08-20T01:37:34.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.935+0000 7efbebfff640 1 -- 172.21.15.79:0/2064995288 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efbf80aac80 con 0x55757e1221a0 2024-08-20T01:37:34.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.935+0000 7efc150ff740 10 client.24937 fetch_fsmap learned FSMap version 28 2024-08-20T01:37:34.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.935+0000 7efc150ff740 1 -- 172.21.15.79:0/2064995288 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55757e13cb50 con 0x55757e1221a0 2024-08-20T01:37:34.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.936+0000 7efbebfff640 1 -- 172.21.15.79:0/2064995288 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efbf80cd040 con 0x55757e1221a0 2024-08-20T01:37:34.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.936+0000 7efbebfff640 1 -- 172.21.15.79:0/2064995288 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7efbf80e8040 con 0x55757e1221a0 2024-08-20T01:37:34.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.936+0000 7efc150ff740 10 client.24937 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:37:34.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.936+0000 7efc150ff740 10 client.24937 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:37:34.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.936+0000 7efc150ff740 20 client.24937 populate_metadata read hostname 'smithi079' 2024-08-20T01:37:34.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.936+0000 7efc150ff740 1 --2- 172.21.15.79:0/2064995288 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55757e13e010 0x55757e140400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:34.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.936+0000 7efc150ff740 4 client.24937 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:37:34.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.936+0000 7efc150ff740 1 -- 172.21.15.79:0/2064995288 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55757e037150 con 0x55757e13e010 2024-08-20T01:37:34.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.936+0000 7efc10aa2640 1 --2- 172.21.15.79:0/2064995288 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55757e13e010 0x55757e140400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:34.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.937+0000 7efbebfff640 10 client.24937 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:37:34.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.937+0000 7efc10aa2640 1 --2- 172.21.15.79:0/2064995288 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55757e13e010 0x55757e140400 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b2b77b308d163207 server_cookie=25e8bd7a0e3cdd73 in_seq=0 out_seq=0 2024-08-20T01:37:34.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.937+0000 7efbebfff640 1 -- 172.21.15.79:0/2064995288 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55757e037150 con 0x55757e13e010 2024-08-20T01:37:34.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.937+0000 7efbebfff640 10 client.24937 handle_command_reply: tid=0 2024-08-20T01:37:34.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.937+0000 7efc150ff740 1 client.24937 shutdown 2024-08-20T01:37:34.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.938+0000 7efc150ff740 1 -- 172.21.15.79:0/2064995288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55757e1221a0 msgr2=0x55757e12b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:34.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.938+0000 7efc150ff740 1 --2- 172.21.15.79:0/2064995288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55757e1221a0 0x55757e12b5f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efbf8000c00 tx=0x7efbf80aa4b0 comp rx=0 tx=0).stop 2024-08-20T01:37:34.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.938+0000 7efc150ff740 1 -- 172.21.15.79:0/2064995288 shutdown_connections 2024-08-20T01:37:34.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.938+0000 7efc150ff740 1 --2- 172.21.15.79:0/2064995288 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55757e13e010 0x55757e140400 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:34.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.938+0000 7efbebfff640 0 client.24937 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:37:34.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.938+0000 7efc150ff740 1 --2- 172.21.15.79:0/2064995288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55757e12e130 0x55757e12bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:34.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.938+0000 7efc150ff740 1 --2- 172.21.15.79:0/2064995288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55757e1221a0 0x55757e12b5f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:34.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.938+0000 7efc150ff740 1 --2- 172.21.15.79:0/2064995288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55757e121880 0x55757e12b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:34.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.938+0000 7efc150ff740 1 -- 172.21.15.79:0/2064995288 >> 172.21.15.79:0/2064995288 conn(0x55757e11f6b0 msgr2=0x55757e125250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:34.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.938+0000 7efc150ff740 1 -- 172.21.15.79:0/2064995288 shutdown_connections 2024-08-20T01:37:34.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.938+0000 7efc150ff740 1 -- 172.21.15.79:0/2064995288 wait complete. 2024-08-20T01:37:34.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.938+0000 7efc150ff740 20 client.24937 trim_cache size 0 max 16384 2024-08-20T01:37:34.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.962+0000 7efc150ff740 1 Processor -- start 2024-08-20T01:37:34.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.962+0000 7efc150ff740 1 -- start start 2024-08-20T01:37:34.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.962+0000 7efc150ff740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55757e121880 0x55757e125a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:34.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.962+0000 7efc150ff740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55757e1221a0 0x55757e145c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:34.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.962+0000 7efc150ff740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55757e12e130 0x55757e1461c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:34.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.962+0000 7efc150ff740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efc0c1abce0 con 0x55757e12e130 2024-08-20T01:37:34.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.963+0000 7efc150ff740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efc0c1ad820 con 0x55757e121880 2024-08-20T01:37:34.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.963+0000 7efc150ff740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efc0c1ac3b0 con 0x55757e1221a0 2024-08-20T01:37:34.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.963+0000 7efc112a3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55757e12e130 0x55757e1461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:34.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.963+0000 7efc10aa2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55757e121880 0x55757e125a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:34.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.963+0000 7efc112a3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55757e12e130 0x55757e1461c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51540/0 (socket says 172.21.15.79:51540) 2024-08-20T01:37:34.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.963+0000 7efc112a3640 1 -- 172.21.15.79:0/2881903560 learned_addr learned my addr 172.21.15.79:0/2881903560 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:34.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.963+0000 7efc0bfff640 1 --2- 172.21.15.79:0/2881903560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55757e1221a0 0x55757e145c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:34.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.963+0000 7efc112a3640 1 -- 172.21.15.79:0/2881903560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55757e1221a0 msgr2=0x55757e145c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:34.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.963+0000 7efc112a3640 1 --2- 172.21.15.79:0/2881903560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55757e1221a0 0x55757e145c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:34.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.963+0000 7efc112a3640 1 -- 172.21.15.79:0/2881903560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55757e121880 msgr2=0x55757e125a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:34.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.963+0000 7efc112a3640 1 --2- 172.21.15.79:0/2881903560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55757e121880 0x55757e125a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:34.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.963+0000 7efc112a3640 1 -- 172.21.15.79:0/2881903560 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55757e140770 con 0x55757e12e130 2024-08-20T01:37:34.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.963+0000 7efc112a3640 1 --2- 172.21.15.79:0/2881903560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55757e12e130 0x55757e1461c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7efc04035000 tx=0x7efc04048000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f2068dbf53f5dd server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:34.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.965+0000 7efbf67fc640 1 -- 172.21.15.79:0/2881903560 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc04004540 con 0x55757e12e130 2024-08-20T01:37:34.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.965+0000 7efbf67fc640 1 -- 172.21.15.79:0/2881903560 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efc04036040 con 0x55757e12e130 2024-08-20T01:37:34.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.965+0000 7efbf67fc640 1 -- 172.21.15.79:0/2881903560 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc04030e90 con 0x55757e12e130 2024-08-20T01:37:34.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.966+0000 7efc150ff740 1 -- 172.21.15.79:0/2881903560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55757e12e130 msgr2=0x55757e1461c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:34.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.966+0000 7efc150ff740 1 --2- 172.21.15.79:0/2881903560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55757e12e130 0x55757e1461c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7efc04035000 tx=0x7efc04048000 comp rx=0 tx=0).stop 2024-08-20T01:37:34.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.966+0000 7efc150ff740 1 -- 172.21.15.79:0/2881903560 shutdown_connections 2024-08-20T01:37:34.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.966+0000 7efc150ff740 1 --2- 172.21.15.79:0/2881903560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55757e12e130 0x55757e1461c0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:34.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.966+0000 7efc150ff740 1 --2- 172.21.15.79:0/2881903560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55757e1221a0 0x55757e145c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:34.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.966+0000 7efc150ff740 1 --2- 172.21.15.79:0/2881903560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55757e121880 0x55757e125a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:34.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.966+0000 7efc150ff740 1 -- 172.21.15.79:0/2881903560 >> 172.21.15.79:0/2881903560 conn(0x55757e11f6b0 msgr2=0x55757e120bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:34.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.966+0000 7efc150ff740 1 -- 172.21.15.79:0/2881903560 shutdown_connections 2024-08-20T01:37:34.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.966+0000 7efc150ff740 1 -- 172.21.15.79:0/2881903560 wait complete. 2024-08-20T01:37:34.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.967+0000 7efc150ff740 1 -- start start 2024-08-20T01:37:34.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.967+0000 7efc150ff740 1 Processor -- start 2024-08-20T01:37:34.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.967+0000 7efc150ff740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55757e121880 0x55757e1363b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:34.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.968+0000 7efc150ff740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55757e1221a0 0x55757e136930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:34.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.968+0000 7efc10aa2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55757e121880 0x55757e1363b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:34.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.968+0000 7efc10aa2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55757e121880 0x55757e1363b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51548/0 (socket says 172.21.15.79:51548) 2024-08-20T01:37:34.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.968+0000 7efc10aa2640 1 -- 172.21.15.79:0/2075310986 learned_addr learned my addr 172.21.15.79:0/2075310986 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:34.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.968+0000 7efc150ff740 1 --2- 172.21.15.79:0/2075310986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55757e12e130 0x55757e131a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:34.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.968+0000 7efc150ff740 1 -- 172.21.15.79:0/2075310986 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efc0c1ad150 con 0x55757e121880 2024-08-20T01:37:34.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.968+0000 7efc150ff740 1 -- 172.21.15.79:0/2075310986 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efc0c1aca80 con 0x55757e1221a0 2024-08-20T01:37:34.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.968+0000 7efc150ff740 1 -- 172.21.15.79:0/2075310986 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efc0c1a9cc0 con 0x55757e12e130 2024-08-20T01:37:34.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.968+0000 7efc0bfff640 1 --2- 172.21.15.79:0/2075310986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55757e1221a0 0x55757e136930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:34.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.968+0000 7efc112a3640 1 --2- 172.21.15.79:0/2075310986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55757e12e130 0x55757e131a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:34.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.968+0000 7efc10aa2640 1 -- 172.21.15.79:0/2075310986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55757e12e130 msgr2=0x55757e131a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:34.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.968+0000 7efc10aa2640 1 --2- 172.21.15.79:0/2075310986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55757e12e130 0x55757e131a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:34.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.968+0000 7efc10aa2640 1 -- 172.21.15.79:0/2075310986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55757e1221a0 msgr2=0x55757e136930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:34.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.968+0000 7efc10aa2640 1 --2- 172.21.15.79:0/2075310986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55757e1221a0 0x55757e136930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:34.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.968+0000 7efc10aa2640 1 -- 172.21.15.79:0/2075310986 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55757e132260 con 0x55757e121880 2024-08-20T01:37:34.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.968+0000 7efc150ff740 10 client.0 _ll_register_callbacks cb 0x7efbf800cf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:34.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.968+0000 7efc150ff740 1 -- 172.21.15.79:0/2075310986 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc04036040 con 0x55757e121880 2024-08-20T01:37:34.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.969+0000 7efc10aa2640 1 --2- 172.21.15.79:0/2075310986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55757e121880 0x55757e1363b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x55757e124a00 tx=0x7efc00010fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44e0335423141f87 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:34.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.969+0000 7efbebfff640 10 client.15510 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:37:34.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.969+0000 7efbebfff640 1 -- 172.21.15.79:0/2075310986 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc00032060 con 0x55757e121880 2024-08-20T01:37:34.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.969+0000 7efbebfff640 1 -- 172.21.15.79:0/2075310986 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7efc00004260 con 0x55757e121880 2024-08-20T01:37:34.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.969+0000 7efbebfff640 1 -- 172.21.15.79:0/2075310986 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efc0000b690 con 0x55757e121880 2024-08-20T01:37:34.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.969+0000 7efc150ff740 10 client.15510 fetch_fsmap learned FSMap version 28 2024-08-20T01:37:34.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.969+0000 7efc150ff740 1 -- 172.21.15.79:0/2075310986 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55757e1b0eb0 con 0x55757e121880 2024-08-20T01:37:34.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.969+0000 7efbebfff640 1 -- 172.21.15.79:0/2075310986 <== mon.0 v2:172.21.15.79:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7efc0002c070 con 0x55757e121880 2024-08-20T01:37:34.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.970+0000 7efc150ff740 10 client.15510 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:37:34.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.970+0000 7efc150ff740 10 client.15510 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:37:34.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.970+0000 7efc150ff740 20 client.15510 populate_metadata read hostname 'smithi079' 2024-08-20T01:37:34.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.970+0000 7efc150ff740 1 --2- 172.21.15.79:0/2075310986 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55757e13e010 0x55757e1b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:34.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.970+0000 7efc150ff740 4 client.15510 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:37:34.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.970+0000 7efc150ff740 1 -- 172.21.15.79:0/2075310986 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55757e09a880 con 0x55757e13e010 2024-08-20T01:37:34.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.970+0000 7efc0bfff640 1 --2- 172.21.15.79:0/2075310986 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55757e13e010 0x55757e1b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:34.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.971+0000 7efc0bfff640 1 --2- 172.21.15.79:0/2075310986 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55757e13e010 0x55757e1b32f0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b26d581107aeec20 server_cookie=3129354dcc310846 in_seq=0 out_seq=0 2024-08-20T01:37:34.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.971+0000 7efbebfff640 10 client.15510 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:37:34.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.971+0000 7efbebfff640 1 -- 172.21.15.79:0/2075310986 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55757e09a880 con 0x55757e13e010 2024-08-20T01:37:34.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.971+0000 7efbebfff640 10 client.15510 handle_command_reply: tid=0 2024-08-20T01:37:34.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.971+0000 7efc150ff740 1 client.15510 shutdown 2024-08-20T01:37:34.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.971+0000 7efc150ff740 1 -- 172.21.15.79:0/2075310986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55757e121880 msgr2=0x55757e1363b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:34.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.971+0000 7efc150ff740 1 --2- 172.21.15.79:0/2075310986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55757e121880 0x55757e1363b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x55757e124a00 tx=0x7efc00010fd0 comp rx=0 tx=0).stop 2024-08-20T01:37:34.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.971+0000 7efc150ff740 1 -- 172.21.15.79:0/2075310986 shutdown_connections 2024-08-20T01:37:34.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.971+0000 7efc150ff740 1 --2- 172.21.15.79:0/2075310986 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55757e13e010 0x55757e1b32f0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:34.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.971+0000 7efc150ff740 1 --2- 172.21.15.79:0/2075310986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55757e12e130 0x55757e131a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:34.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.971+0000 7efc150ff740 1 --2- 172.21.15.79:0/2075310986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55757e1221a0 0x55757e136930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:34.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.971+0000 7efc150ff740 1 --2- 172.21.15.79:0/2075310986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55757e121880 0x55757e1363b0 secure :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0x55757e124a00 tx=0x7efc00010fd0 comp rx=0 tx=0).stop 2024-08-20T01:37:34.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.971+0000 7efc150ff740 1 -- 172.21.15.79:0/2075310986 >> 172.21.15.79:0/2075310986 conn(0x55757e11f6b0 msgr2=0x55757e11df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:34.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.971+0000 7efbebfff640 0 client.15510 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:37:34.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.972+0000 7efc150ff740 1 -- 172.21.15.79:0/2075310986 shutdown_connections 2024-08-20T01:37:34.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.972+0000 7efc150ff740 1 -- 172.21.15.79:0/2075310986 wait complete. 2024-08-20T01:37:34.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.972+0000 7efc150ff740 20 client.15510 trim_cache size 0 max 16384 2024-08-20T01:37:34.977 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:37:34.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.973+0000 7efc12d06640 1 -- 172.21.15.79:0/230418210 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7efbfc0b3bb0 msgr2=0x7efbfc0b6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:34.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.973+0000 7efc12d06640 1 --2- 172.21.15.79:0/230418210 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7efbfc0b3bb0 0x7efbfc0b6070 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7efc04006010 tx=0x7efc04005fa0 comp rx=0 tx=0).stop 2024-08-20T01:37:34.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.973+0000 7efc12d06640 1 -- 172.21.15.79:0/230418210 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc0c1073a0 msgr2=0x7efc0c197120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:34.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.973+0000 7efc12d06640 1 --2- 172.21.15.79:0/230418210 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc0c1073a0 0x7efc0c197120 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7efbf800c920 tx=0x7efbf800cde0 comp rx=0 tx=0).stop 2024-08-20T01:37:34.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.973+0000 7efc12d06640 1 -- 172.21.15.79:0/230418210 shutdown_connections 2024-08-20T01:37:34.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.973+0000 7efc12d06640 1 --2- 172.21.15.79:0/230418210 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7efbfc0b3bb0 0x7efbfc0b6070 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:34.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.973+0000 7efc12d06640 1 --2- 172.21.15.79:0/230418210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc0c107d20 0x7efc0c19c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:34.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.973+0000 7efc12d06640 1 --2- 172.21.15.79:0/230418210 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc0c1073a0 0x7efc0c197120 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:34.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.973+0000 7efc12d06640 1 --2- 172.21.15.79:0/230418210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc0c101990 0x7efc0c196be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:34.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.973+0000 7efc12d06640 1 -- 172.21.15.79:0/230418210 >> 172.21.15.79:0/230418210 conn(0x7efc0c0fd400 msgr2=0x7efc0c0ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:34.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.973+0000 7efc12d06640 1 -- 172.21.15.79:0/230418210 shutdown_connections 2024-08-20T01:37:34.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:34.974+0000 7efc12d06640 1 -- 172.21.15.79:0/230418210 wait complete. 2024-08-20T01:37:35.618 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-20T01:37:35.947 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:37:36.220 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:35 smithi079 ceph-mon[18656]: pgmap v355: 97 pgs: 97 active+clean; 662 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 426 B/s wr, 11 op/s 2024-08-20T01:37:36.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:35 smithi081 ceph-mon[22209]: pgmap v355: 97 pgs: 97 active+clean; 662 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 426 B/s wr, 11 op/s 2024-08-20T01:37:36.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:35 smithi175 ceph-mon[22392]: pgmap v355: 97 pgs: 97 active+clean; 662 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 426 B/s wr, 11 op/s 2024-08-20T01:37:36.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.464+0000 7f71392cf640 1 -- 172.21.15.79:0/136409075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7134101990 msgr2=0x7f7134101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:36.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.464+0000 7f71392cf640 1 --2- 172.21.15.79:0/136409075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7134101990 0x7f7134101d70 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f7124009900 tx=0x7f712402a410 comp rx=0 tx=0).stop 2024-08-20T01:37:36.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.465+0000 7f71392cf640 1 -- 172.21.15.79:0/136409075 shutdown_connections 2024-08-20T01:37:36.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.465+0000 7f71392cf640 1 --2- 172.21.15.79:0/136409075 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7134107d20 0x7f713410e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.465+0000 7f71392cf640 1 --2- 172.21.15.79:0/136409075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71341073a0 0x7f71341077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.465+0000 7f71392cf640 1 --2- 172.21.15.79:0/136409075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7134101990 0x7f7134101d70 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.465+0000 7f71392cf640 1 -- 172.21.15.79:0/136409075 >> 172.21.15.79:0/136409075 conn(0x7f71340fd400 msgr2=0x7f71340ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:36.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.465+0000 7f71392cf640 1 -- 172.21.15.79:0/136409075 shutdown_connections 2024-08-20T01:37:36.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.465+0000 7f71392cf640 1 -- 172.21.15.79:0/136409075 wait complete. 2024-08-20T01:37:36.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.465+0000 7f71392cf640 1 Processor -- start 2024-08-20T01:37:36.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.466+0000 7f71392cf640 1 -- start start 2024-08-20T01:37:36.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.466+0000 7f71392cf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7134101990 0x7f7134197aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.466+0000 7f71392cf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71341073a0 0x7f7134197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.466+0000 7f71392cf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7134107d20 0x7f7134198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.466+0000 7f71392cf640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7134111890 con 0x7f71341073a0 2024-08-20T01:37:36.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.466+0000 7f71392cf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7134111710 con 0x7f7134107d20 2024-08-20T01:37:36.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.466+0000 7f71392cf640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7134111a10 con 0x7f7134101990 2024-08-20T01:37:36.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.466+0000 7f71327fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71341073a0 0x7f7134197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.466+0000 7f71327fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71341073a0 0x7f7134197fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51564/0 (socket says 172.21.15.79:51564) 2024-08-20T01:37:36.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.466+0000 7f71327fc640 1 -- 172.21.15.79:0/2765260671 learned_addr learned my addr 172.21.15.79:0/2765260671 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:36.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.466+0000 7f7132ffd640 1 --2- 172.21.15.79:0/2765260671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7134101990 0x7f7134197aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.466+0000 7f71337fe640 1 --2- 172.21.15.79:0/2765260671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7134107d20 0x7f7134198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.467+0000 7f71327fc640 1 -- 172.21.15.79:0/2765260671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7134101990 msgr2=0x7f7134197aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:36.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.467+0000 7f71327fc640 1 --2- 172.21.15.79:0/2765260671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7134101990 0x7f7134197aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.467+0000 7f71327fc640 1 -- 172.21.15.79:0/2765260671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7134107d20 msgr2=0x7f7134198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:36.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.467+0000 7f71327fc640 1 --2- 172.21.15.79:0/2765260671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7134107d20 0x7f7134198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.467+0000 7f71327fc640 1 -- 172.21.15.79:0/2765260671 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f713419ce70 con 0x7f71341073a0 2024-08-20T01:37:36.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.467+0000 7f71327fc640 1 --2- 172.21.15.79:0/2765260671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71341073a0 0x7f7134197fe0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f712800d950 tx=0x7f712800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:36.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.467+0000 7f711bfff640 1 -- 172.21.15.79:0/2765260671 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7128017070 con 0x7f71341073a0 2024-08-20T01:37:36.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.467+0000 7f711bfff640 1 -- 172.21.15.79:0/2765260671 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7128009c30 con 0x7f71341073a0 2024-08-20T01:37:36.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.467+0000 7f711bfff640 1 -- 172.21.15.79:0/2765260671 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f712800f620 con 0x7f71341073a0 2024-08-20T01:37:36.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.467+0000 7f71392cf640 1 -- 172.21.15.79:0/2765260671 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f713419d160 con 0x7f71341073a0 2024-08-20T01:37:36.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.468+0000 7f71392cf640 1 -- 172.21.15.79:0/2765260671 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f713419d650 con 0x7f71341073a0 2024-08-20T01:37:36.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.471+0000 7f713b6c8740 1 Processor -- start 2024-08-20T01:37:36.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.471+0000 7f711bfff640 1 -- 172.21.15.79:0/2765260671 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f7128010460 con 0x7f71341073a0 2024-08-20T01:37:36.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.471+0000 7f713b6c8740 1 -- start start 2024-08-20T01:37:36.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.471+0000 7f713b6c8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b3b5b59880 0x55b3b5b59c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.471+0000 7f713b6c8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3b5b5a1a0 0x55b3b5b65bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.472+0000 7f713b6c8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b3b5b66130 0x55b3b5b68520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.472+0000 7f713b6c8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b3b5ad0930 con 0x55b3b5b59880 2024-08-20T01:37:36.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.472+0000 7f713b6c8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b3b5abfe30 con 0x55b3b5b5a1a0 2024-08-20T01:37:36.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.472+0000 7f713b6c8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b3b5ac3e70 con 0x55b3b5b66130 2024-08-20T01:37:36.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.472+0000 7f71337fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b3b5b59880 0x55b3b5b59c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.472+0000 7f7132ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3b5b5a1a0 0x55b3b5b65bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.472+0000 7f7132ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3b5b5a1a0 0x55b3b5b65bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:55160/0 (socket says 172.21.15.79:55160) 2024-08-20T01:37:36.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.472+0000 7f7132ffd640 1 -- 172.21.15.79:0/3656038295 learned_addr learned my addr 172.21.15.79:0/3656038295 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:36.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.472+0000 7f711bfff640 1 --2- 172.21.15.79:0/2765260671 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f711c0b3bd0 0x7f711c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.472+0000 7f71327fc640 1 --2- 172.21.15.79:0/3656038295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b3b5b66130 0x55b3b5b68520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.472+0000 7f7132ffd640 1 -- 172.21.15.79:0/3656038295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b3b5b66130 msgr2=0x55b3b5b68520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:36.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.472+0000 7f7132ffd640 1 --2- 172.21.15.79:0/3656038295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b3b5b66130 0x55b3b5b68520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.472+0000 7f7132ffd640 1 -- 172.21.15.79:0/3656038295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b3b5b59880 msgr2=0x55b3b5b59c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:36.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.472+0000 7f7132ffd640 1 --2- 172.21.15.79:0/3656038295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b3b5b59880 0x55b3b5b59c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.472+0000 7f7132ffd640 1 -- 172.21.15.79:0/3656038295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3b581f650 con 0x55b3b5b5a1a0 2024-08-20T01:37:36.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.472+0000 7f711bfff640 1 -- 172.21.15.79:0/2765260671 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f71280e3750 con 0x7f71341073a0 2024-08-20T01:37:36.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.473+0000 7f71337fe640 1 --2- 172.21.15.79:0/2765260671 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f711c0b3bd0 0x7f711c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.473+0000 7f7132ffd640 1 --2- 172.21.15.79:0/3656038295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3b5b5a1a0 0x55b3b5b65bf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7124000c00 tx=0x7f7124031dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17cc2c7e5bc9f221 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:36.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.473+0000 7f71197fa640 1 -- 172.21.15.79:0/3656038295 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7124035030 con 0x55b3b5b5a1a0 2024-08-20T01:37:36.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.473+0000 7f71197fa640 1 -- 172.21.15.79:0/3656038295 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7124040070 con 0x55b3b5b5a1a0 2024-08-20T01:37:36.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.473+0000 7f71197fa640 1 -- 172.21.15.79:0/3656038295 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7124003a60 con 0x55b3b5b5a1a0 2024-08-20T01:37:36.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.474+0000 7f713b6c8740 1 -- 172.21.15.79:0/3656038295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3b5b5a1a0 msgr2=0x55b3b5b65bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:36.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.474+0000 7f71337fe640 1 --2- 172.21.15.79:0/2765260671 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f711c0b3bd0 0x7f711c0b6090 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f712c013ba0 tx=0x7f712c00acd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:36.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.474+0000 7f713b6c8740 1 --2- 172.21.15.79:0/3656038295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3b5b5a1a0 0x55b3b5b65bf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7124000c00 tx=0x7f7124031dc0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.474+0000 7f713b6c8740 1 -- 172.21.15.79:0/3656038295 shutdown_connections 2024-08-20T01:37:36.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.474+0000 7f713b6c8740 1 --2- 172.21.15.79:0/3656038295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b3b5b66130 0x55b3b5b68520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.474+0000 7f713b6c8740 1 --2- 172.21.15.79:0/3656038295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3b5b5a1a0 0x55b3b5b65bf0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.474+0000 7f713b6c8740 1 --2- 172.21.15.79:0/3656038295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b3b5b59880 0x55b3b5b59c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.474+0000 7f713b6c8740 1 -- 172.21.15.79:0/3656038295 >> 172.21.15.79:0/3656038295 conn(0x55b3b5b576b0 msgr2=0x55b3b5b58850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:36.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.474+0000 7f713b6c8740 1 -- 172.21.15.79:0/3656038295 shutdown_connections 2024-08-20T01:37:36.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.474+0000 7f713b6c8740 1 -- 172.21.15.79:0/3656038295 wait complete. 2024-08-20T01:37:36.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.474+0000 7f713b6c8740 1 -- start start 2024-08-20T01:37:36.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.474+0000 7f713b6c8740 1 Processor -- start 2024-08-20T01:37:36.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.475+0000 7f713b6c8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b3b5b59880 0x55b3b5b630d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.475+0000 7f713b6c8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b3b5b5a1a0 0x55b3b5b63610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.475+0000 7f713b6c8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3b5b66130 0x55b3b5b63b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.475+0000 7f713b6c8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b3b5922700 con 0x55b3b5b59880 2024-08-20T01:37:36.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.475+0000 7f713b6c8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b3b5a46810 con 0x55b3b5b66130 2024-08-20T01:37:36.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.475+0000 7f713b6c8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b3b5b68d80 con 0x55b3b5b5a1a0 2024-08-20T01:37:36.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.475+0000 7f713b6c8740 10 client.0 _ll_register_callbacks cb 0x55b3b5ab9700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:36.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.475+0000 7f7132ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b3b5b59880 0x55b3b5b630d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.475+0000 7f7132ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b3b5b59880 0x55b3b5b630d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51580/0 (socket says 172.21.15.79:51580) 2024-08-20T01:37:36.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.475+0000 7f7132ffd640 1 -- 172.21.15.79:0/3257249740 learned_addr learned my addr 172.21.15.79:0/3257249740 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:36.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.475+0000 7f71337fe640 1 --2- 172.21.15.79:0/3257249740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3b5b66130 0x55b3b5b63b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.475+0000 7f7132ffd640 1 -- 172.21.15.79:0/3257249740 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b3b5b5a1a0 msgr2=0x55b3b5b63610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:36.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.475+0000 7f7132ffd640 1 --2- 172.21.15.79:0/3257249740 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b3b5b5a1a0 0x55b3b5b63610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.475+0000 7f7132ffd640 1 -- 172.21.15.79:0/3257249740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3b5b66130 msgr2=0x55b3b5b63b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:36.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.475+0000 7f7132ffd640 1 --2- 172.21.15.79:0/3257249740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3b5b66130 0x55b3b5b63b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.475+0000 7f7132ffd640 1 -- 172.21.15.79:0/3257249740 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3b5b72130 con 0x55b3b5b59880 2024-08-20T01:37:36.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.476+0000 7f7132ffd640 1 --2- 172.21.15.79:0/3257249740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b3b5b59880 0x55b3b5b630d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f7124006010 tx=0x7f71240316b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6996d92fb6bfcac8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:36.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.476+0000 7f7116ff5640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:37:36.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.476+0000 7f7116ff5640 1 -- 172.21.15.79:0/3257249740 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7124035040 con 0x55b3b5b59880 2024-08-20T01:37:36.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.476+0000 7f7116ff5640 1 -- 172.21.15.79:0/3257249740 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f712403c850 con 0x55b3b5b59880 2024-08-20T01:37:36.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.476+0000 7f713b6c8740 1 -- 172.21.15.79:0/3257249740 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b3b5a6f150 con 0x55b3b5b59880 2024-08-20T01:37:36.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.476+0000 7f7116ff5640 1 -- 172.21.15.79:0/3257249740 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f712403ca50 con 0x55b3b5b59880 2024-08-20T01:37:36.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.476+0000 7f713b6c8740 10 client.15522 fetch_fsmap learned FSMap version 28 2024-08-20T01:37:36.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.476+0000 7f713b6c8740 1 -- 172.21.15.79:0/3257249740 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b3b5b74ae0 con 0x55b3b5b59880 2024-08-20T01:37:36.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.477+0000 7f7116ff5640 1 -- 172.21.15.79:0/3257249740 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55b3b5a6f150 con 0x55b3b5b59880 2024-08-20T01:37:36.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.477+0000 7f7116ff5640 1 -- 172.21.15.79:0/3257249740 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f71240448c0 con 0x55b3b5b59880 2024-08-20T01:37:36.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.477+0000 7f713b6c8740 10 client.15522 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:37:36.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.477+0000 7f713b6c8740 10 client.15522 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:37:36.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.477+0000 7f713b6c8740 20 client.15522 populate_metadata read hostname 'smithi079' 2024-08-20T01:37:36.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.477+0000 7f713b6c8740 1 --2- 172.21.15.79:0/3257249740 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x55b3b5b75e30 0x55b3b5b78220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.477+0000 7f713b6c8740 4 client.15522 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:37:36.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.477+0000 7f713b6c8740 1 -- 172.21.15.79:0/3257249740 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b3b5ad2880 con 0x55b3b5b75e30 2024-08-20T01:37:36.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.478+0000 7f71327fc640 1 --2- 172.21.15.79:0/3257249740 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x55b3b5b75e30 0x55b3b5b78220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.478+0000 7f7116ff5640 10 client.15522 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:37:36.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.478+0000 7f71327fc640 1 --2- 172.21.15.79:0/3257249740 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x55b3b5b75e30 0x55b3b5b78220 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d5f7f3ca3b708401 server_cookie=76b821c98a85a2c4 in_seq=0 out_seq=0 2024-08-20T01:37:36.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.479+0000 7f7116ff5640 1 -- 172.21.15.79:0/3257249740 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b3b5ad2880 con 0x55b3b5b75e30 2024-08-20T01:37:36.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.479+0000 7f7116ff5640 10 client.15522 handle_command_reply: tid=0 2024-08-20T01:37:36.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.479+0000 7f713b6c8740 1 client.15522 shutdown 2024-08-20T01:37:36.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.479+0000 7f713b6c8740 1 -- 172.21.15.79:0/3257249740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b3b5b59880 msgr2=0x55b3b5b630d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:36.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.479+0000 7f713b6c8740 1 --2- 172.21.15.79:0/3257249740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b3b5b59880 0x55b3b5b630d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f7124006010 tx=0x7f71240316b0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.479+0000 7f713b6c8740 1 -- 172.21.15.79:0/3257249740 shutdown_connections 2024-08-20T01:37:36.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.479+0000 7f713b6c8740 1 --2- 172.21.15.79:0/3257249740 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x55b3b5b75e30 0x55b3b5b78220 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.479+0000 7f713b6c8740 1 --2- 172.21.15.79:0/3257249740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3b5b66130 0x55b3b5b63b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.479+0000 7f713b6c8740 1 --2- 172.21.15.79:0/3257249740 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b3b5b5a1a0 0x55b3b5b63610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.479+0000 7f713b6c8740 1 --2- 172.21.15.79:0/3257249740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b3b5b59880 0x55b3b5b630d0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.479+0000 7f713b6c8740 1 -- 172.21.15.79:0/3257249740 >> 172.21.15.79:0/3257249740 conn(0x55b3b5b576b0 msgr2=0x55b3b5b5d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:36.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.479+0000 7f7116ff5640 0 client.15522 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:37:36.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.479+0000 7f713b6c8740 1 -- 172.21.15.79:0/3257249740 shutdown_connections 2024-08-20T01:37:36.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.479+0000 7f713b6c8740 1 -- 172.21.15.79:0/3257249740 wait complete. 2024-08-20T01:37:36.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.479+0000 7f713b6c8740 20 client.15522 trim_cache size 0 max 16384 2024-08-20T01:37:36.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.492+0000 7f713b6c8740 1 Processor -- start 2024-08-20T01:37:36.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.492+0000 7f713b6c8740 1 -- start start 2024-08-20T01:37:36.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.493+0000 7f713b6c8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b3b5b5a1a0 0x55b3b5b63950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.493+0000 7f713b6c8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3b5b66130 0x55b3b5b64e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.493+0000 7f713b6c8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b3b5b52600 0x55b3b5b7d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.493+0000 7f713b6c8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f71341b44d0 con 0x55b3b5b52600 2024-08-20T01:37:36.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.493+0000 7f713b6c8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f71341b6010 con 0x55b3b5b66130 2024-08-20T01:37:36.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.493+0000 7f713b6c8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f71341b4ba0 con 0x55b3b5b5a1a0 2024-08-20T01:37:36.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.493+0000 7f71337fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b3b5b52600 0x55b3b5b7d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.493+0000 7f71337fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b3b5b52600 0x55b3b5b7d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51582/0 (socket says 172.21.15.79:51582) 2024-08-20T01:37:36.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.493+0000 7f71337fe640 1 -- 172.21.15.79:0/1743618866 learned_addr learned my addr 172.21.15.79:0/1743618866 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:36.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.493+0000 7f7132ffd640 1 --2- 172.21.15.79:0/1743618866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b3b5b5a1a0 0x55b3b5b63950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.493+0000 7f71327fc640 1 --2- 172.21.15.79:0/1743618866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3b5b66130 0x55b3b5b64e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.493+0000 7f7132ffd640 1 -- 172.21.15.79:0/1743618866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3b5b66130 msgr2=0x55b3b5b64e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:36.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.493+0000 7f7132ffd640 1 --2- 172.21.15.79:0/1743618866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3b5b66130 0x55b3b5b64e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.493+0000 7f7132ffd640 1 -- 172.21.15.79:0/1743618866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b3b5b52600 msgr2=0x55b3b5b7d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:36.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.493+0000 7f7132ffd640 1 --2- 172.21.15.79:0/1743618866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b3b5b52600 0x55b3b5b7d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.493+0000 7f7132ffd640 1 -- 172.21.15.79:0/1743618866 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3b5b58130 con 0x55b3b5b5a1a0 2024-08-20T01:37:36.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.493+0000 7f71337fe640 1 --2- 172.21.15.79:0/1743618866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b3b5b52600 0x55b3b5b7d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:37:36.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.494+0000 7f7132ffd640 1 --2- 172.21.15.79:0/1743618866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b3b5b5a1a0 0x55b3b5b63950 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7124045000 tx=0x7f7124044f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1918ea1e8101a3b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:36.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.494+0000 7f7118ff9640 1 -- 172.21.15.79:0/1743618866 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7124035030 con 0x55b3b5b5a1a0 2024-08-20T01:37:36.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.494+0000 7f7118ff9640 1 -- 172.21.15.79:0/1743618866 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f712404c070 con 0x55b3b5b5a1a0 2024-08-20T01:37:36.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.494+0000 7f7118ff9640 1 -- 172.21.15.79:0/1743618866 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71240443f0 con 0x55b3b5b5a1a0 2024-08-20T01:37:36.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.495+0000 7f713b6c8740 1 -- 172.21.15.79:0/1743618866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b3b5b5a1a0 msgr2=0x55b3b5b63950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:36.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.495+0000 7f713b6c8740 1 --2- 172.21.15.79:0/1743618866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b3b5b5a1a0 0x55b3b5b63950 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7124045000 tx=0x7f7124044f00 comp rx=0 tx=0).stop 2024-08-20T01:37:36.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.495+0000 7f713b6c8740 1 -- 172.21.15.79:0/1743618866 shutdown_connections 2024-08-20T01:37:36.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.495+0000 7f713b6c8740 1 --2- 172.21.15.79:0/1743618866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b3b5b52600 0x55b3b5b7d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.495+0000 7f713b6c8740 1 --2- 172.21.15.79:0/1743618866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3b5b66130 0x55b3b5b64e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.495+0000 7f713b6c8740 1 --2- 172.21.15.79:0/1743618866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b3b5b5a1a0 0x55b3b5b63950 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.495+0000 7f713b6c8740 1 -- 172.21.15.79:0/1743618866 >> 172.21.15.79:0/1743618866 conn(0x55b3b5b576b0 msgr2=0x55b3b5b64700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:36.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.495+0000 7f713b6c8740 1 -- 172.21.15.79:0/1743618866 shutdown_connections 2024-08-20T01:37:36.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.495+0000 7f713b6c8740 1 -- 172.21.15.79:0/1743618866 wait complete. 2024-08-20T01:37:36.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.495+0000 7f713b6c8740 1 -- start start 2024-08-20T01:37:36.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.496+0000 7f713b6c8740 1 Processor -- start 2024-08-20T01:37:36.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.496+0000 7f713b6c8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b3b5b52600 0x55b3b5b6e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.496+0000 7f713b6c8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b3b5b5a1a0 0x55b3b5b6e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.496+0000 7f713b6c8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3b5b66130 0x55b3b5b69ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.496+0000 7f713b6c8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f71341b5940 con 0x55b3b5b5a1a0 2024-08-20T01:37:36.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.496+0000 7f713b6c8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f71341b5270 con 0x55b3b5b66130 2024-08-20T01:37:36.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.496+0000 7f713b6c8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f71341b24b0 con 0x55b3b5b52600 2024-08-20T01:37:36.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.496+0000 7f713b6c8740 10 client.0 _ll_register_callbacks cb 0x7f712c00a8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:36.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.496+0000 7f7132ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b3b5b52600 0x55b3b5b6e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.496+0000 7f7132ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b3b5b52600 0x55b3b5b6e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:60282/0 (socket says 172.21.15.79:60282) 2024-08-20T01:37:36.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.496+0000 7f7132ffd640 1 -- 172.21.15.79:0/502884122 learned_addr learned my addr 172.21.15.79:0/502884122 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:36.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.496+0000 7f71327fc640 1 --2- 172.21.15.79:0/502884122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b3b5b5a1a0 0x55b3b5b6e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.496+0000 7f71337fe640 1 --2- 172.21.15.79:0/502884122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3b5b66130 0x55b3b5b69ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.497+0000 7f7132ffd640 1 -- 172.21.15.79:0/502884122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3b5b66130 msgr2=0x55b3b5b69ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:36.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.497+0000 7f7132ffd640 1 --2- 172.21.15.79:0/502884122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3b5b66130 0x55b3b5b69ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.497+0000 7f7132ffd640 1 -- 172.21.15.79:0/502884122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b3b5b5a1a0 msgr2=0x55b3b5b6e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:36.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.497+0000 7f7132ffd640 1 --2- 172.21.15.79:0/502884122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b3b5b5a1a0 0x55b3b5b6e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.497+0000 7f7132ffd640 1 -- 172.21.15.79:0/502884122 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3b5b6a310 con 0x55b3b5b52600 2024-08-20T01:37:36.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.497+0000 7f71327fc640 1 --2- 172.21.15.79:0/502884122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b3b5b5a1a0 0x55b3b5b6e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:37:36.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.497+0000 7f7132ffd640 1 --2- 172.21.15.79:0/502884122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b3b5b52600 0x55b3b5b6e3c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f712402a930 tx=0x7f712402ab90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f90e1977b51f964b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:36.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.497+0000 7f7116ff5640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:37:36.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.497+0000 7f7116ff5640 1 -- 172.21.15.79:0/502884122 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7124035040 con 0x55b3b5b52600 2024-08-20T01:37:36.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.497+0000 7f7116ff5640 1 -- 172.21.15.79:0/502884122 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f71240318b0 con 0x55b3b5b52600 2024-08-20T01:37:36.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.497+0000 7f713b6c8740 1 -- 172.21.15.79:0/502884122 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f712404c070 con 0x55b3b5b52600 2024-08-20T01:37:36.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.498+0000 7f7116ff5640 1 -- 172.21.15.79:0/502884122 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f712403c860 con 0x55b3b5b52600 2024-08-20T01:37:36.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.498+0000 7f713b6c8740 10 client.24952 fetch_fsmap learned FSMap version 28 2024-08-20T01:37:36.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.498+0000 7f713b6c8740 1 -- 172.21.15.79:0/502884122 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b3b5be0650 con 0x55b3b5b52600 2024-08-20T01:37:36.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.498+0000 7f7116ff5640 1 -- 172.21.15.79:0/502884122 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f712404c070 con 0x55b3b5b52600 2024-08-20T01:37:36.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.498+0000 7f7116ff5640 1 -- 172.21.15.79:0/502884122 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f71240507b0 con 0x55b3b5b52600 2024-08-20T01:37:36.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.498+0000 7f713b6c8740 10 client.24952 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:37:36.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.498+0000 7f713b6c8740 10 client.24952 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:37:36.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.498+0000 7f713b6c8740 20 client.24952 populate_metadata read hostname 'smithi079' 2024-08-20T01:37:36.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.498+0000 7f713b6c8740 1 --2- 172.21.15.79:0/502884122 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x55b3b5be0b00 0x55b3b5be2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.498+0000 7f713b6c8740 4 client.24952 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:37:36.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.498+0000 7f713b6c8740 1 -- 172.21.15.79:0/502884122 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b3b5ace320 con 0x55b3b5be0b00 2024-08-20T01:37:36.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.499+0000 7f71327fc640 1 --2- 172.21.15.79:0/502884122 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x55b3b5be0b00 0x55b3b5be2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.499+0000 7f7116ff5640 10 client.24952 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:37:36.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.499+0000 7f71327fc640 1 --2- 172.21.15.79:0/502884122 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x55b3b5be0b00 0x55b3b5be2f20 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9dfc3988bc5c2a33 server_cookie=1b522ad5f1ac4189 in_seq=0 out_seq=0 2024-08-20T01:37:36.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.499+0000 7f7116ff5640 1 -- 172.21.15.79:0/502884122 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b3b5ace320 con 0x55b3b5be0b00 2024-08-20T01:37:36.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.499+0000 7f7116ff5640 10 client.24952 handle_command_reply: tid=0 2024-08-20T01:37:36.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.499+0000 7f713b6c8740 1 client.24952 shutdown 2024-08-20T01:37:36.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.499+0000 7f713b6c8740 1 -- 172.21.15.79:0/502884122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b3b5b52600 msgr2=0x55b3b5b6e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:36.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.499+0000 7f713b6c8740 1 --2- 172.21.15.79:0/502884122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b3b5b52600 0x55b3b5b6e3c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f712402a930 tx=0x7f712402ab90 comp rx=0 tx=0).stop 2024-08-20T01:37:36.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.500+0000 7f713b6c8740 1 -- 172.21.15.79:0/502884122 shutdown_connections 2024-08-20T01:37:36.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.500+0000 7f713b6c8740 1 --2- 172.21.15.79:0/502884122 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x55b3b5be0b00 0x55b3b5be2f20 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.500+0000 7f713b6c8740 1 --2- 172.21.15.79:0/502884122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3b5b66130 0x55b3b5b69ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.500+0000 7f713b6c8740 1 --2- 172.21.15.79:0/502884122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b3b5b5a1a0 0x55b3b5b6e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.500+0000 7f713b6c8740 1 --2- 172.21.15.79:0/502884122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b3b5b52600 0x55b3b5b6e3c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.500+0000 7f713b6c8740 1 -- 172.21.15.79:0/502884122 >> 172.21.15.79:0/502884122 conn(0x55b3b5b576b0 msgr2=0x55b3b5b56770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:36.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.500+0000 7f7116ff5640 0 client.24952 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:37:36.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.500+0000 7f713b6c8740 1 -- 172.21.15.79:0/502884122 shutdown_connections 2024-08-20T01:37:36.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.500+0000 7f713b6c8740 1 -- 172.21.15.79:0/502884122 wait complete. 2024-08-20T01:37:36.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.500+0000 7f713b6c8740 20 client.24952 trim_cache size 0 max 16384 2024-08-20T01:37:36.508 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:37:36.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.500+0000 7f71392cf640 1 -- 172.21.15.79:0/2765260671 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f711c0b3bd0 msgr2=0x7f711c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:36.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.501+0000 7f71392cf640 1 --2- 172.21.15.79:0/2765260671 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f711c0b3bd0 0x7f711c0b6090 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f712c013ba0 tx=0x7f712c00acd0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.501+0000 7f71392cf640 1 -- 172.21.15.79:0/2765260671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71341073a0 msgr2=0x7f7134197fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:36.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.501+0000 7f71392cf640 1 --2- 172.21.15.79:0/2765260671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71341073a0 0x7f7134197fe0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f712800d950 tx=0x7f712800de10 comp rx=0 tx=0).stop 2024-08-20T01:37:36.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.501+0000 7f71392cf640 1 -- 172.21.15.79:0/2765260671 shutdown_connections 2024-08-20T01:37:36.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.501+0000 7f71392cf640 1 --2- 172.21.15.79:0/2765260671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7134107d20 0x7f7134198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.501+0000 7f71392cf640 1 --2- 172.21.15.79:0/2765260671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71341073a0 0x7f7134197fe0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.501+0000 7f71392cf640 1 --2- 172.21.15.79:0/2765260671 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f711c0b3bd0 0x7f711c0b6090 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.501+0000 7f71392cf640 1 --2- 172.21.15.79:0/2765260671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7134101990 0x7f7134197aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.501+0000 7f71392cf640 1 -- 172.21.15.79:0/2765260671 >> 172.21.15.79:0/2765260671 conn(0x7f71340fd400 msgr2=0x7f71340ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:36.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.501+0000 7f71392cf640 1 -- 172.21.15.79:0/2765260671 shutdown_connections 2024-08-20T01:37:36.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:36.501+0000 7f71392cf640 1 -- 172.21.15.79:0/2765260671 wait complete. 2024-08-20T01:37:36.755 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.752+0000 7f21c45f7640 1 -- 172.21.15.79:0/4149857342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21bc103070 msgr2=0x7f21bc1099f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:36.755 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.752+0000 7f21c45f7640 1 --2- 172.21.15.79:0/4149857342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21bc103070 0x7f21bc1099f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f21b4009cd0 tx=0x7f21b402a8e0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.755 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.753+0000 7f21c45f7640 1 -- 172.21.15.79:0/4149857342 shutdown_connections 2024-08-20T01:37:36.755 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.753+0000 7f21c45f7640 1 --2- 172.21.15.79:0/4149857342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21bc103070 0x7f21bc1099f0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.755 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.753+0000 7f21c45f7640 1 --2- 172.21.15.79:0/4149857342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21bc1026b0 0x7f21bc102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.755 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.753+0000 7f21c45f7640 1 --2- 172.21.15.79:0/4149857342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21bc101560 0x7f21bc101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.755 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.753+0000 7f21c45f7640 1 -- 172.21.15.79:0/4149857342 >> 172.21.15.79:0/4149857342 conn(0x7f21bc0fce40 msgr2=0x7f21bc0ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:36.755 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.753+0000 7f21c45f7640 1 -- 172.21.15.79:0/4149857342 shutdown_connections 2024-08-20T01:37:36.755 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.753+0000 7f21c45f7640 1 -- 172.21.15.79:0/4149857342 wait complete. 2024-08-20T01:37:36.757 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.753+0000 7f21c45f7640 1 Processor -- start 2024-08-20T01:37:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.754+0000 7f21c45f7640 1 -- start start 2024-08-20T01:37:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.754+0000 7f21c45f7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21bc101560 0x7f21bc197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.754+0000 7f21c45f7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21bc1026b0 0x7f21bc197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.754+0000 7f21c45f7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21bc103070 0x7f21bc198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.754+0000 7f21c45f7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f21bc10d080 con 0x7f21bc101560 2024-08-20T01:37:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.754+0000 7f21c45f7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f21bc10cf00 con 0x7f21bc103070 2024-08-20T01:37:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.754+0000 7f21c45f7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f21bc10d200 con 0x7f21bc1026b0 2024-08-20T01:37:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.754+0000 7f21c2393640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21bc101560 0x7f21bc197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.754+0000 7f21c2393640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21bc101560 0x7f21bc197860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51616/0 (socket says 172.21.15.79:51616) 2024-08-20T01:37:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.754+0000 7f21c2393640 1 -- 172.21.15.79:0/1976740704 learned_addr learned my addr 172.21.15.79:0/1976740704 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.754+0000 7f21c1b92640 1 --2- 172.21.15.79:0/1976740704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21bc1026b0 0x7f21bc197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.754+0000 7f21c2b94640 1 --2- 172.21.15.79:0/1976740704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21bc103070 0x7f21bc198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.754+0000 7f21c2393640 1 -- 172.21.15.79:0/1976740704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21bc1026b0 msgr2=0x7f21bc197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.754+0000 7f21c2393640 1 --2- 172.21.15.79:0/1976740704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21bc1026b0 0x7f21bc197eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.754+0000 7f21c2393640 1 -- 172.21.15.79:0/1976740704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21bc103070 msgr2=0x7f21bc198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.754+0000 7f21c2393640 1 --2- 172.21.15.79:0/1976740704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21bc103070 0x7f21bc198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.754+0000 7f21c2393640 1 -- 172.21.15.79:0/1976740704 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21bc1993a0 con 0x7f21bc101560 2024-08-20T01:37:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.755+0000 7f21c2393640 1 --2- 172.21.15.79:0/1976740704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21bc101560 0x7f21bc197860 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f21b800d950 tx=0x7f21b800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.755+0000 7f21b37fe640 1 -- 172.21.15.79:0/1976740704 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b8017030 con 0x7f21bc101560 2024-08-20T01:37:36.760 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.755+0000 7f21b37fe640 1 -- 172.21.15.79:0/1976740704 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f21b8004020 con 0x7f21bc101560 2024-08-20T01:37:36.760 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.755+0000 7f21b37fe640 1 -- 172.21.15.79:0/1976740704 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b80055d0 con 0x7f21bc101560 2024-08-20T01:37:36.760 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.755+0000 7f21c45f7640 1 -- 172.21.15.79:0/1976740704 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21bc199690 con 0x7f21bc101560 2024-08-20T01:37:36.760 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.755+0000 7f21c45f7640 1 -- 172.21.15.79:0/1976740704 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21bc06a710 con 0x7f21bc101560 2024-08-20T01:37:36.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.758+0000 7f21b37fe640 1 -- 172.21.15.79:0/1976740704 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f21b80047a0 con 0x7f21bc101560 2024-08-20T01:37:36.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.759+0000 7f21c73f1740 1 Processor -- start 2024-08-20T01:37:36.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.759+0000 7f21c73f1740 1 -- start start 2024-08-20T01:37:36.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.759+0000 7f21c73f1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad4840e8d0 0x55ad48410cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.759+0000 7f21c73f1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad48411200 0x55ad484135f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.759+0000 7f21c73f1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad48413c40 0x55ad48416100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.759+0000 7f21c73f1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ad48381360 con 0x55ad4840e8d0 2024-08-20T01:37:36.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.759+0000 7f21c73f1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ad48370860 con 0x55ad48411200 2024-08-20T01:37:36.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.759+0000 7f21c73f1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ad483748a0 con 0x55ad48413c40 2024-08-20T01:37:36.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.759+0000 7f21b37fe640 1 --2- 172.21.15.79:0/1976740704 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f21a80b3c50 0x7f21a80b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.759+0000 7f21c2b94640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad4840e8d0 0x55ad48410cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.759+0000 7f21c2b94640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad4840e8d0 0x55ad48410cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51626/0 (socket says 172.21.15.79:51626) 2024-08-20T01:37:36.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.760+0000 7f21c2b94640 1 -- 172.21.15.79:0/4031643087 learned_addr learned my addr 172.21.15.79:0/4031643087 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:36.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.760+0000 7f21c1b92640 1 --2- 172.21.15.79:0/4031643087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad48413c40 0x55ad48416100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.760+0000 7f21c2393640 1 --2- 172.21.15.79:0/4031643087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad48411200 0x55ad484135f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.760+0000 7f21c2b94640 1 --2- 172.21.15.79:0/1976740704 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f21a80b3c50 0x7f21a80b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.760+0000 7f21c1b92640 1 -- 172.21.15.79:0/4031643087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad48411200 msgr2=0x55ad484135f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:36.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.760+0000 7f21b37fe640 1 -- 172.21.15.79:0/1976740704 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f21b80e3620 con 0x7f21bc101560 2024-08-20T01:37:36.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.760+0000 7f21c1b92640 1 --2- 172.21.15.79:0/4031643087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad48411200 0x55ad484135f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.760+0000 7f21c1b92640 1 -- 172.21.15.79:0/4031643087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad4840e8d0 msgr2=0x55ad48410cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:36.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.760+0000 7f21c1b92640 1 --2- 172.21.15.79:0/4031643087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad4840e8d0 0x55ad48410cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.760+0000 7f21c1b92640 1 -- 172.21.15.79:0/4031643087 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad48317e40 con 0x55ad48413c40 2024-08-20T01:37:36.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.760+0000 7f21c2393640 1 --2- 172.21.15.79:0/4031643087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad48411200 0x55ad484135f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:37:36.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.760+0000 7f21c1b92640 1 --2- 172.21.15.79:0/4031643087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad48413c40 0x55ad48416100 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f21ac004530 tx=0x7f21ac00dc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9722239928183d71 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:36.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.760+0000 7f21c2b94640 1 --2- 172.21.15.79:0/1976740704 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f21a80b3c50 0x7f21a80b6110 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f21b4031650 tx=0x7f21b4031560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:36.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.760+0000 7f21b0bfe640 1 -- 172.21.15.79:0/4031643087 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ac01b070 con 0x55ad48413c40 2024-08-20T01:37:36.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.761+0000 7f21b0bfe640 1 -- 172.21.15.79:0/4031643087 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f21ac00d020 con 0x55ad48413c40 2024-08-20T01:37:36.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.761+0000 7f21b0bfe640 1 -- 172.21.15.79:0/4031643087 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ac017da0 con 0x55ad48413c40 2024-08-20T01:37:36.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.761+0000 7f21c73f1740 1 -- 172.21.15.79:0/4031643087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad48413c40 msgr2=0x55ad48416100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:36.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.761+0000 7f21c73f1740 1 --2- 172.21.15.79:0/4031643087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad48413c40 0x55ad48416100 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f21ac004530 tx=0x7f21ac00dc70 comp rx=0 tx=0).stop 2024-08-20T01:37:36.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.761+0000 7f21c73f1740 1 -- 172.21.15.79:0/4031643087 shutdown_connections 2024-08-20T01:37:36.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.761+0000 7f21c73f1740 1 --2- 172.21.15.79:0/4031643087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad48413c40 0x55ad48416100 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.761+0000 7f21c73f1740 1 --2- 172.21.15.79:0/4031643087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad48411200 0x55ad484135f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.761+0000 7f21c73f1740 1 --2- 172.21.15.79:0/4031643087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad4840e8d0 0x55ad48410cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.761+0000 7f21c73f1740 1 -- 172.21.15.79:0/4031643087 >> 172.21.15.79:0/4031643087 conn(0x55ad48409a20 msgr2=0x55ad4840a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:36.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.761+0000 7f21c73f1740 1 -- 172.21.15.79:0/4031643087 shutdown_connections 2024-08-20T01:37:36.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.761+0000 7f21c73f1740 1 -- 172.21.15.79:0/4031643087 wait complete. 2024-08-20T01:37:36.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.762+0000 7f21c73f1740 1 -- start start 2024-08-20T01:37:36.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.762+0000 7f21c73f1740 1 Processor -- start 2024-08-20T01:37:36.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.762+0000 7f21c73f1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad4840e8d0 0x55ad48418120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.762+0000 7f21c73f1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad48411200 0x55ad484187c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.762+0000 7f21c73f1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad48413c40 0x55ad48419390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.772 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.762+0000 7f21c73f1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ad482a9ab0 con 0x55ad48411200 2024-08-20T01:37:36.772 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.762+0000 7f21c73f1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ad482f7780 con 0x55ad48413c40 2024-08-20T01:37:36.772 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.762+0000 7f21c73f1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ad48416c20 con 0x55ad4840e8d0 2024-08-20T01:37:36.772 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.762+0000 7f21c73f1740 10 client.0 _ll_register_callbacks cb 0x55ad4807fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:36.772 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.762+0000 7f21c1b92640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad48411200 0x55ad484187c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.772 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.762+0000 7f21c1b92640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad48411200 0x55ad484187c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51632/0 (socket says 172.21.15.79:51632) 2024-08-20T01:37:36.772 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.762+0000 7f21c1b92640 1 -- 172.21.15.79:0/1370799427 learned_addr learned my addr 172.21.15.79:0/1370799427 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:36.772 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.762+0000 7f21c2393640 1 --2- 172.21.15.79:0/1370799427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad4840e8d0 0x55ad48418120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.772 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.763+0000 7f21c2b94640 1 --2- 172.21.15.79:0/1370799427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad48413c40 0x55ad48419390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.773 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.763+0000 7f21c1b92640 1 -- 172.21.15.79:0/1370799427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad4840e8d0 msgr2=0x55ad48418120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:36.773 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.763+0000 7f21c1b92640 1 --2- 172.21.15.79:0/1370799427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad4840e8d0 0x55ad48418120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.773 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.763+0000 7f21c1b92640 1 -- 172.21.15.79:0/1370799427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad48413c40 msgr2=0x55ad48419390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:36.773 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.763+0000 7f21c1b92640 1 --2- 172.21.15.79:0/1370799427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad48413c40 0x55ad48419390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.773 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.763+0000 7f21c1b92640 1 -- 172.21.15.79:0/1370799427 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad480d3790 con 0x55ad48411200 2024-08-20T01:37:36.773 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.763+0000 7f21c1b92640 1 --2- 172.21.15.79:0/1370799427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad48411200 0x55ad484187c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f21ac006010 tx=0x7f21ac003e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a72a398eedab88ff server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:36.773 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.763+0000 7f21a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:37:36.773 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.764+0000 7f21a5ffb640 1 -- 172.21.15.79:0/1370799427 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ac01b070 con 0x55ad48411200 2024-08-20T01:37:36.773 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.764+0000 7f21a5ffb640 1 -- 172.21.15.79:0/1370799427 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f21ac017cd0 con 0x55ad48411200 2024-08-20T01:37:36.773 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.764+0000 7f21c73f1740 1 -- 172.21.15.79:0/1370799427 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ad4831fe00 con 0x55ad48411200 2024-08-20T01:37:36.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.764+0000 7f21a5ffb640 1 -- 172.21.15.79:0/1370799427 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f21ac005050 con 0x55ad48411200 2024-08-20T01:37:36.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.764+0000 7f21c73f1740 10 client.15540 fetch_fsmap learned FSMap version 28 2024-08-20T01:37:36.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.764+0000 7f21c73f1740 1 -- 172.21.15.79:0/1370799427 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ad4814c620 con 0x55ad48411200 2024-08-20T01:37:36.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.765+0000 7f21a5ffb640 1 -- 172.21.15.79:0/1370799427 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55ad4831fe00 con 0x55ad48411200 2024-08-20T01:37:36.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.765+0000 7f21a5ffb640 1 -- 172.21.15.79:0/1370799427 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f21ac0046c0 con 0x55ad48411200 2024-08-20T01:37:36.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.765+0000 7f21c73f1740 10 client.15540 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:37:36.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.765+0000 7f21c73f1740 10 client.15540 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:37:36.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.765+0000 7f21c73f1740 20 client.15540 populate_metadata read hostname 'smithi079' 2024-08-20T01:37:36.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.765+0000 7f21c73f1740 1 --2- 172.21.15.79:0/1370799427 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55ad48423640 0x55ad48425a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.765+0000 7f21c73f1740 4 client.15540 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:37:36.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.765+0000 7f21c73f1740 1 -- 172.21.15.79:0/1370799427 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad483832b0 con 0x55ad48423640 2024-08-20T01:37:36.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.765+0000 7f21c2393640 1 --2- 172.21.15.79:0/1370799427 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55ad48423640 0x55ad48425a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.775 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.766+0000 7f21a5ffb640 10 client.15540 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:37:36.775 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.766+0000 7f21c2393640 1 --2- 172.21.15.79:0/1370799427 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55ad48423640 0x55ad48425a30 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=206e2a813f98f0da server_cookie=3842fa4b097177b0 in_seq=0 out_seq=0 2024-08-20T01:37:36.775 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.767+0000 7f21a5ffb640 1 -- 172.21.15.79:0/1370799427 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ad483832b0 con 0x55ad48423640 2024-08-20T01:37:36.775 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.767+0000 7f21a5ffb640 10 client.15540 handle_command_reply: tid=0 2024-08-20T01:37:36.775 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.767+0000 7f21c73f1740 1 client.15540 shutdown 2024-08-20T01:37:36.775 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.767+0000 7f21c73f1740 1 -- 172.21.15.79:0/1370799427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad48411200 msgr2=0x55ad484187c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:36.775 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.767+0000 7f21c73f1740 1 --2- 172.21.15.79:0/1370799427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad48411200 0x55ad484187c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f21ac006010 tx=0x7f21ac003e30 comp rx=0 tx=0).stop 2024-08-20T01:37:36.775 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.767+0000 7f21c73f1740 1 -- 172.21.15.79:0/1370799427 shutdown_connections 2024-08-20T01:37:36.776 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.767+0000 7f21c73f1740 1 --2- 172.21.15.79:0/1370799427 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55ad48423640 0x55ad48425a30 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.776 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.767+0000 7f21a5ffb640 0 client.15540 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:37:36.776 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.767+0000 7f21c73f1740 1 --2- 172.21.15.79:0/1370799427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad48413c40 0x55ad48419390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.776 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.767+0000 7f21c73f1740 1 --2- 172.21.15.79:0/1370799427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad48411200 0x55ad484187c0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.776 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.767+0000 7f21c73f1740 1 --2- 172.21.15.79:0/1370799427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad4840e8d0 0x55ad48418120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.776 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.767+0000 7f21c73f1740 1 -- 172.21.15.79:0/1370799427 >> 172.21.15.79:0/1370799427 conn(0x55ad48409a20 msgr2=0x55ad48408ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:36.776 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.767+0000 7f21c73f1740 1 -- 172.21.15.79:0/1370799427 shutdown_connections 2024-08-20T01:37:36.776 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.767+0000 7f21c73f1740 1 -- 172.21.15.79:0/1370799427 wait complete. 2024-08-20T01:37:36.776 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.767+0000 7f21c73f1740 20 client.15540 trim_cache size 0 max 16384 2024-08-20T01:37:36.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.785+0000 7f21c73f1740 1 Processor -- start 2024-08-20T01:37:36.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.785+0000 7f21c73f1740 1 -- start start 2024-08-20T01:37:36.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.786+0000 7f21c73f1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad4840e8d0 0x55ad48418830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.786+0000 7f21c73f1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad48413c40 0x55ad48414020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.786+0000 7f21c73f1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad48423640 0x55ad48414560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.786+0000 7f21c73f1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f21bc1a78e0 con 0x55ad48413c40 2024-08-20T01:37:36.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.786+0000 7f21c73f1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f21bc1a9420 con 0x55ad4840e8d0 2024-08-20T01:37:36.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.786+0000 7f21c73f1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f21bc1a7fb0 con 0x55ad48423640 2024-08-20T01:37:36.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.786+0000 7f21c1b92640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad48413c40 0x55ad48414020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.786+0000 7f21c1b92640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad48413c40 0x55ad48414020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51642/0 (socket says 172.21.15.79:51642) 2024-08-20T01:37:36.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.786+0000 7f21c1b92640 1 -- 172.21.15.79:0/2988101927 learned_addr learned my addr 172.21.15.79:0/2988101927 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:36.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.786+0000 7f21c2b94640 1 --2- 172.21.15.79:0/2988101927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad48423640 0x55ad48414560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.786+0000 7f21c2393640 1 --2- 172.21.15.79:0/2988101927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad4840e8d0 0x55ad48418830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.786+0000 7f21c1b92640 1 -- 172.21.15.79:0/2988101927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad48423640 msgr2=0x55ad48414560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:36.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.786+0000 7f21c1b92640 1 --2- 172.21.15.79:0/2988101927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad48423640 0x55ad48414560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.786+0000 7f21c1b92640 1 -- 172.21.15.79:0/2988101927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad4840e8d0 msgr2=0x55ad48418830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:36.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.786+0000 7f21c1b92640 1 --2- 172.21.15.79:0/2988101927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad4840e8d0 0x55ad48418830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.786+0000 7f21c1b92640 1 -- 172.21.15.79:0/2988101927 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad48419700 con 0x55ad48413c40 2024-08-20T01:37:36.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.786+0000 7f21c1b92640 1 --2- 172.21.15.79:0/2988101927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad48413c40 0x55ad48414020 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f21ac004c80 tx=0x7f21ac00dc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6be5c81e45d4e997 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:36.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.786+0000 7f21a7fff640 1 -- 172.21.15.79:0/2988101927 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ac01b040 con 0x55ad48413c40 2024-08-20T01:37:36.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.787+0000 7f21a7fff640 1 -- 172.21.15.79:0/2988101927 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f21ac02d070 con 0x55ad48413c40 2024-08-20T01:37:36.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.787+0000 7f21a7fff640 1 -- 172.21.15.79:0/2988101927 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ac004620 con 0x55ad48413c40 2024-08-20T01:37:36.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.787+0000 7f21c73f1740 1 -- 172.21.15.79:0/2988101927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad48413c40 msgr2=0x55ad48414020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:36.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.787+0000 7f21c73f1740 1 --2- 172.21.15.79:0/2988101927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad48413c40 0x55ad48414020 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f21ac004c80 tx=0x7f21ac00dc70 comp rx=0 tx=0).stop 2024-08-20T01:37:36.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.787+0000 7f21c73f1740 1 -- 172.21.15.79:0/2988101927 shutdown_connections 2024-08-20T01:37:36.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.787+0000 7f21c73f1740 1 --2- 172.21.15.79:0/2988101927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad48423640 0x55ad48414560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.787+0000 7f21c73f1740 1 --2- 172.21.15.79:0/2988101927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad48413c40 0x55ad48414020 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.787+0000 7f21c73f1740 1 --2- 172.21.15.79:0/2988101927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad4840e8d0 0x55ad48418830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.787+0000 7f21c73f1740 1 -- 172.21.15.79:0/2988101927 >> 172.21.15.79:0/2988101927 conn(0x55ad48409a20 msgr2=0x55ad48418120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:36.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.787+0000 7f21c73f1740 1 -- 172.21.15.79:0/2988101927 shutdown_connections 2024-08-20T01:37:36.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.787+0000 7f21c73f1740 1 -- 172.21.15.79:0/2988101927 wait complete. 2024-08-20T01:37:36.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.788+0000 7f21c73f1740 1 -- start start 2024-08-20T01:37:36.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.788+0000 7f21c73f1740 1 Processor -- start 2024-08-20T01:37:36.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.788+0000 7f21c73f1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad4840e8d0 0x55ad4841cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.788+0000 7f21c73f1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad48413c40 0x55ad4841d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.788+0000 7f21c73f1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad48423640 0x55ad4841df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.788+0000 7f21c73f1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f21bc1a8d50 con 0x55ad48413c40 2024-08-20T01:37:36.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.788+0000 7f21c73f1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f21bc1a8680 con 0x55ad48423640 2024-08-20T01:37:36.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.788+0000 7f21c73f1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f21bc1a58c0 con 0x55ad4840e8d0 2024-08-20T01:37:36.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.788+0000 7f21c73f1740 10 client.0 _ll_register_callbacks cb 0x7f21ac004430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:36.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.788+0000 7f21c1b92640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad48413c40 0x55ad4841d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.788+0000 7f21c1b92640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad48413c40 0x55ad4841d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51648/0 (socket says 172.21.15.79:51648) 2024-08-20T01:37:36.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.788+0000 7f21c1b92640 1 -- 172.21.15.79:0/3750325586 learned_addr learned my addr 172.21.15.79:0/3750325586 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:36.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.788+0000 7f21c2393640 1 --2- 172.21.15.79:0/3750325586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad4840e8d0 0x55ad4841cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.789+0000 7f21c2b94640 1 --2- 172.21.15.79:0/3750325586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad48423640 0x55ad4841df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.789+0000 7f21c1b92640 1 -- 172.21.15.79:0/3750325586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad4840e8d0 msgr2=0x55ad4841cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:36.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.789+0000 7f21c1b92640 1 --2- 172.21.15.79:0/3750325586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad4840e8d0 0x55ad4841cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.789+0000 7f21c1b92640 1 -- 172.21.15.79:0/3750325586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad48423640 msgr2=0x55ad4841df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:36.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.789+0000 7f21c1b92640 1 --2- 172.21.15.79:0/3750325586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad48423640 0x55ad4841df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.789+0000 7f21c1b92640 1 -- 172.21.15.79:0/3750325586 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad4841e7b0 con 0x55ad48413c40 2024-08-20T01:37:36.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.789+0000 7f21c2393640 1 --2- 172.21.15.79:0/3750325586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad4840e8d0 0x55ad4841cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:37:36.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.789+0000 7f21c1b92640 1 --2- 172.21.15.79:0/3750325586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad48413c40 0x55ad4841d400 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f21ac004bb0 tx=0x7f21ac003e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db57a8b2c2adce39 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:36.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.789+0000 7f21a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:37:36.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.789+0000 7f21a5ffb640 1 -- 172.21.15.79:0/3750325586 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ac01b040 con 0x55ad48413c40 2024-08-20T01:37:36.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.789+0000 7f21a5ffb640 1 -- 172.21.15.79:0/3750325586 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f21ac004d20 con 0x55ad48413c40 2024-08-20T01:37:36.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.789+0000 7f21c73f1740 1 -- 172.21.15.79:0/3750325586 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21ac02d070 con 0x55ad48413c40 2024-08-20T01:37:36.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.789+0000 7f21a5ffb640 1 -- 172.21.15.79:0/3750325586 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f21ac00d020 con 0x55ad48413c40 2024-08-20T01:37:36.798 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.790+0000 7f21c73f1740 10 client.15546 fetch_fsmap learned FSMap version 28 2024-08-20T01:37:36.798 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.790+0000 7f21c73f1740 1 -- 172.21.15.79:0/3750325586 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ad4841fb20 con 0x55ad48413c40 2024-08-20T01:37:36.798 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.790+0000 7f21a5ffb640 1 -- 172.21.15.79:0/3750325586 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f21ac02d070 con 0x55ad48413c40 2024-08-20T01:37:36.798 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.790+0000 7f21a5ffb640 1 -- 172.21.15.79:0/3750325586 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f21ac028ac0 con 0x55ad48413c40 2024-08-20T01:37:36.798 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.790+0000 7f21c73f1740 10 client.15546 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:37:36.798 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.790+0000 7f21c73f1740 10 client.15546 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:37:36.798 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.790+0000 7f21c73f1740 20 client.15546 populate_metadata read hostname 'smithi079' 2024-08-20T01:37:36.798 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.790+0000 7f21c73f1740 1 --2- 172.21.15.79:0/3750325586 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55ad4848e2c0 0x55ad484906b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:36.798 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.790+0000 7f21c73f1740 4 client.15546 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:37:36.798 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.790+0000 7f21c73f1740 1 -- 172.21.15.79:0/3750325586 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ad4837ed50 con 0x55ad4848e2c0 2024-08-20T01:37:36.799 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.790+0000 7f21c2393640 1 --2- 172.21.15.79:0/3750325586 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55ad4848e2c0 0x55ad484906b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:36.799 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.791+0000 7f21a5ffb640 10 client.15546 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:37:36.799 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.791+0000 7f21c2393640 1 --2- 172.21.15.79:0/3750325586 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55ad4848e2c0 0x55ad484906b0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=951acb26cfb612c3 server_cookie=c7c831da3164546e in_seq=0 out_seq=0 2024-08-20T01:37:36.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.794+0000 7f21a5ffb640 1 -- 172.21.15.79:0/3750325586 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ad4837ed50 con 0x55ad4848e2c0 2024-08-20T01:37:36.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.794+0000 7f21a5ffb640 10 client.15546 handle_command_reply: tid=0 2024-08-20T01:37:36.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.794+0000 7f21c73f1740 1 client.15546 shutdown 2024-08-20T01:37:36.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.794+0000 7f21c73f1740 1 -- 172.21.15.79:0/3750325586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad48413c40 msgr2=0x55ad4841d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:36.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.794+0000 7f21c73f1740 1 --2- 172.21.15.79:0/3750325586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad48413c40 0x55ad4841d400 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f21ac004bb0 tx=0x7f21ac003e90 comp rx=0 tx=0).stop 2024-08-20T01:37:36.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.795+0000 7f21c73f1740 1 -- 172.21.15.79:0/3750325586 shutdown_connections 2024-08-20T01:37:36.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.795+0000 7f21c73f1740 1 --2- 172.21.15.79:0/3750325586 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55ad4848e2c0 0x55ad484906b0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.795+0000 7f21c73f1740 1 --2- 172.21.15.79:0/3750325586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad48423640 0x55ad4841df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.795+0000 7f21c73f1740 1 --2- 172.21.15.79:0/3750325586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad48413c40 0x55ad4841d400 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.795+0000 7f21c73f1740 1 --2- 172.21.15.79:0/3750325586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad4840e8d0 0x55ad4841cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.795+0000 7f21c73f1740 1 -- 172.21.15.79:0/3750325586 >> 172.21.15.79:0/3750325586 conn(0x55ad48409a20 msgr2=0x55ad484082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:36.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.795+0000 7f21a5ffb640 0 client.15546 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:37:36.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.795+0000 7f21c73f1740 1 -- 172.21.15.79:0/3750325586 shutdown_connections 2024-08-20T01:37:36.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.795+0000 7f21c73f1740 1 -- 172.21.15.79:0/3750325586 wait complete. 2024-08-20T01:37:36.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.795+0000 7f21c73f1740 20 client.15546 trim_cache size 0 max 16384 2024-08-20T01:37:36.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:37:36.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:37:36.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:37:36.803 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:37:36.803 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.795+0000 7f21c45f7640 1 -- 172.21.15.79:0/1976740704 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f21a80b3c50 msgr2=0x7f21a80b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:36.803 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.795+0000 7f21c45f7640 1 --2- 172.21.15.79:0/1976740704 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f21a80b3c50 0x7f21a80b6110 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f21b4031650 tx=0x7f21b4031560 comp rx=0 tx=0).stop 2024-08-20T01:37:36.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.795+0000 7f21c45f7640 1 -- 172.21.15.79:0/1976740704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21bc101560 msgr2=0x7f21bc197860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:36.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.795+0000 7f21c45f7640 1 --2- 172.21.15.79:0/1976740704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21bc101560 0x7f21bc197860 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f21b800d950 tx=0x7f21b800de10 comp rx=0 tx=0).stop 2024-08-20T01:37:36.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.796+0000 7f21c45f7640 1 -- 172.21.15.79:0/1976740704 shutdown_connections 2024-08-20T01:37:36.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.796+0000 7f21c45f7640 1 --2- 172.21.15.79:0/1976740704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21bc103070 0x7f21bc198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.796+0000 7f21c45f7640 1 --2- 172.21.15.79:0/1976740704 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f21a80b3c50 0x7f21a80b6110 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.796+0000 7f21c45f7640 1 --2- 172.21.15.79:0/1976740704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21bc1026b0 0x7f21bc197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.796+0000 7f21c45f7640 1 --2- 172.21.15.79:0/1976740704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21bc101560 0x7f21bc197860 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:36.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.796+0000 7f21c45f7640 1 -- 172.21.15.79:0/1976740704 >> 172.21.15.79:0/1976740704 conn(0x7f21bc0fce40 msgr2=0x7f21bc105af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:36.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.796+0000 7f21c45f7640 1 -- 172.21.15.79:0/1976740704 shutdown_connections 2024-08-20T01:37:36.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:36.796+0000 7f21c45f7640 1 -- 172.21.15.79:0/1976740704 wait complete. 2024-08-20T01:37:37.190 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T01:37:37.462 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:37:37.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.926+0000 7fd749db4640 1 -- 172.21.15.79:0/2162776884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd744108e30 msgr2=0x7fd74410f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:37.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.926+0000 7fd749db4640 1 --2- 172.21.15.79:0/2162776884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd744108e30 0x7fd74410f630 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fd73c009ca0 tx=0x7fd73c02a8c0 comp rx=0 tx=0).stop 2024-08-20T01:37:37.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.926+0000 7fd749db4640 1 -- 172.21.15.79:0/2162776884 shutdown_connections 2024-08-20T01:37:37.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.926+0000 7fd749db4640 1 --2- 172.21.15.79:0/2162776884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd744108e30 0x7fd74410f630 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:37.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.926+0000 7fd749db4640 1 --2- 172.21.15.79:0/2162776884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7441084b0 0x7fd7441088f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:37.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.926+0000 7fd749db4640 1 --2- 172.21.15.79:0/2162776884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd744102aa0 0x7fd744102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:37.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.926+0000 7fd749db4640 1 -- 172.21.15.79:0/2162776884 >> 172.21.15.79:0/2162776884 conn(0x7fd7440fe550 msgr2=0x7fd744100970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:37.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.926+0000 7fd749db4640 1 -- 172.21.15.79:0/2162776884 shutdown_connections 2024-08-20T01:37:37.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.926+0000 7fd749db4640 1 -- 172.21.15.79:0/2162776884 wait complete. 2024-08-20T01:37:37.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.927+0000 7fd749db4640 1 Processor -- start 2024-08-20T01:37:37.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.927+0000 7fd749db4640 1 -- start start 2024-08-20T01:37:37.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.927+0000 7fd749db4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd744102aa0 0x7fd744198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:37.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.927+0000 7fd749db4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7441084b0 0x7fd744199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:37.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.927+0000 7fd749db4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd744108e30 0x7fd74419e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:37.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.927+0000 7fd749db4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd7441129f0 con 0x7fd7441084b0 2024-08-20T01:37:37.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.927+0000 7fd749db4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd744112870 con 0x7fd744108e30 2024-08-20T01:37:37.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.927+0000 7fd749db4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd744112b70 con 0x7fd744102aa0 2024-08-20T01:37:37.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.927+0000 7fd742ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7441084b0 0x7fd744199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:37.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.927+0000 7fd742ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7441084b0 0x7fd744199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51670/0 (socket says 172.21.15.79:51670) 2024-08-20T01:37:37.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.927+0000 7fd742ffd640 1 -- 172.21.15.79:0/8534188 learned_addr learned my addr 172.21.15.79:0/8534188 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:37.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.928+0000 7fd7437fe640 1 --2- 172.21.15.79:0/8534188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd744102aa0 0x7fd744198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:37.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.928+0000 7fd743fff640 1 --2- 172.21.15.79:0/8534188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd744108e30 0x7fd74419e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:37.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.928+0000 7fd742ffd640 1 -- 172.21.15.79:0/8534188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd744102aa0 msgr2=0x7fd744198e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:37.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.928+0000 7fd742ffd640 1 --2- 172.21.15.79:0/8534188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd744102aa0 0x7fd744198e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:37.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.928+0000 7fd742ffd640 1 -- 172.21.15.79:0/8534188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd744108e30 msgr2=0x7fd74419e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:37.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.928+0000 7fd742ffd640 1 --2- 172.21.15.79:0/8534188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd744108e30 0x7fd74419e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:37.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.928+0000 7fd742ffd640 1 -- 172.21.15.79:0/8534188 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd74419eec0 con 0x7fd7441084b0 2024-08-20T01:37:37.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.928+0000 7fd743fff640 1 --2- 172.21.15.79:0/8534188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd744108e30 0x7fd74419e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:37:37.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.928+0000 7fd742ffd640 1 --2- 172.21.15.79:0/8534188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7441084b0 0x7fd744199350 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd73800e9f0 tx=0x7fd73800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:37.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.928+0000 7fd740ff9640 1 -- 172.21.15.79:0/8534188 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73800cd80 con 0x7fd7441084b0 2024-08-20T01:37:37.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.928+0000 7fd740ff9640 1 -- 172.21.15.79:0/8534188 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd7380108c0 con 0x7fd7441084b0 2024-08-20T01:37:37.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.928+0000 7fd740ff9640 1 -- 172.21.15.79:0/8534188 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7380187c0 con 0x7fd7441084b0 2024-08-20T01:37:37.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.928+0000 7fd749db4640 1 -- 172.21.15.79:0/8534188 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd74419f1b0 con 0x7fd7441084b0 2024-08-20T01:37:37.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.929+0000 7fd749db4640 1 -- 172.21.15.79:0/8534188 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7440750b0 con 0x7fd7441084b0 2024-08-20T01:37:37.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.931+0000 7fd740ff9640 1 -- 172.21.15.79:0/8534188 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fd738010430 con 0x7fd7441084b0 2024-08-20T01:37:37.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.932+0000 7fd74c1ad740 1 Processor -- start 2024-08-20T01:37:37.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.932+0000 7fd74c1ad740 1 -- start start 2024-08-20T01:37:37.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.932+0000 7fd740ff9640 1 --2- 172.21.15.79:0/8534188 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd72c0b8060 0x7fd72c0ba520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:37.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.932+0000 7fd74c1ad740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56000449e880 0x56000449ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:37.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.932+0000 7fd74c1ad740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56000449f1a0 0x5600044aabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:37.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.932+0000 7fd74c1ad740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5600044ab130 0x5600044ad520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:37.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.932+0000 7fd74c1ad740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560004415930 con 0x56000449f1a0 2024-08-20T01:37:37.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.932+0000 7fd74c1ad740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560004404e30 con 0x5600044ab130 2024-08-20T01:37:37.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.932+0000 7fd74c1ad740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560004408e70 con 0x56000449e880 2024-08-20T01:37:37.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.932+0000 7fd740ff9640 1 -- 172.21.15.79:0/8534188 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fd7380e3fc0 con 0x7fd7441084b0 2024-08-20T01:37:37.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.933+0000 7fd743fff640 1 --2- 172.21.15.79:0/8534188 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd72c0b8060 0x7fd72c0ba520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:37.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.933+0000 7fd7437fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56000449e880 0x56000449ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:37.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.933+0000 7fd742ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56000449f1a0 0x5600044aabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:37.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.933+0000 7fd742ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56000449f1a0 0x5600044aabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51674/0 (socket says 172.21.15.79:51674) 2024-08-20T01:37:37.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.933+0000 7fd742ffd640 1 -- 172.21.15.79:0/799491324 learned_addr learned my addr 172.21.15.79:0/799491324 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:37.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.933+0000 7fd742ffd640 1 -- 172.21.15.79:0/799491324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56000449e880 msgr2=0x56000449ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:37.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.933+0000 7fd742ffd640 1 --2- 172.21.15.79:0/799491324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56000449e880 0x56000449ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:37.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.933+0000 7fd742ffd640 1 -- 172.21.15.79:0/799491324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5600044ab130 msgr2=0x5600044ad520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:37:37.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.933+0000 7fd742ffd640 1 --2- 172.21.15.79:0/799491324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5600044ab130 0x5600044ad520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:37.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.933+0000 7fd742ffd640 1 -- 172.21.15.79:0/799491324 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560004164650 con 0x56000449f1a0 2024-08-20T01:37:37.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.933+0000 7fd742ffd640 1 --2- 172.21.15.79:0/799491324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56000449f1a0 0x5600044aabf0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd7380aac20 tx=0x7fd7380aad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80a3575344e9067c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:37.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.934+0000 7fd743fff640 1 --2- 172.21.15.79:0/8534188 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd72c0b8060 0x7fd72c0ba520 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd73c009a60 tx=0x7fd73c005f80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:37.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.934+0000 7fd729ffb640 1 -- 172.21.15.79:0/799491324 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7380b3fd0 con 0x56000449f1a0 2024-08-20T01:37:37.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.934+0000 7fd729ffb640 1 -- 172.21.15.79:0/799491324 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd738010a70 con 0x56000449f1a0 2024-08-20T01:37:37.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.934+0000 7fd729ffb640 1 -- 172.21.15.79:0/799491324 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7380a6af0 con 0x56000449f1a0 2024-08-20T01:37:37.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.934+0000 7fd74c1ad740 1 -- 172.21.15.79:0/799491324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56000449f1a0 msgr2=0x5600044aabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:37.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.934+0000 7fd74c1ad740 1 --2- 172.21.15.79:0/799491324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56000449f1a0 0x5600044aabf0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd7380aac20 tx=0x7fd7380aad70 comp rx=0 tx=0).stop 2024-08-20T01:37:37.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.935+0000 7fd74c1ad740 1 -- 172.21.15.79:0/799491324 shutdown_connections 2024-08-20T01:37:37.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.935+0000 7fd74c1ad740 1 --2- 172.21.15.79:0/799491324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5600044ab130 0x5600044ad520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:37.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.935+0000 7fd74c1ad740 1 --2- 172.21.15.79:0/799491324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56000449f1a0 0x5600044aabf0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:37.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.935+0000 7fd74c1ad740 1 --2- 172.21.15.79:0/799491324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56000449e880 0x56000449ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:37.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.935+0000 7fd74c1ad740 1 -- 172.21.15.79:0/799491324 >> 172.21.15.79:0/799491324 conn(0x56000449c6b0 msgr2=0x56000449d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:37.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.935+0000 7fd74c1ad740 1 -- 172.21.15.79:0/799491324 shutdown_connections 2024-08-20T01:37:37.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.935+0000 7fd74c1ad740 1 -- 172.21.15.79:0/799491324 wait complete. 2024-08-20T01:37:37.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.935+0000 7fd74c1ad740 1 -- start start 2024-08-20T01:37:37.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.935+0000 7fd74c1ad740 1 Processor -- start 2024-08-20T01:37:37.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.936+0000 7fd74c1ad740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56000449e880 0x5600044a8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:37.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.936+0000 7fd74c1ad740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56000449f1a0 0x5600044a8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:37.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.936+0000 7fd74c1ad740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5600044ab130 0x5600044a8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:37.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.936+0000 7fd74c1ad740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560004267700 con 0x56000449e880 2024-08-20T01:37:37.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.936+0000 7fd74c1ad740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56000438b810 con 0x5600044ab130 2024-08-20T01:37:37.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.936+0000 7fd74c1ad740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5600044ade30 con 0x56000449f1a0 2024-08-20T01:37:37.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.936+0000 7fd74c1ad740 10 client.0 _ll_register_callbacks cb 0x5600043fe700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:37.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.936+0000 7fd7437fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56000449e880 0x5600044a8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:37.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.936+0000 7fd7437fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56000449e880 0x5600044a8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51688/0 (socket says 172.21.15.79:51688) 2024-08-20T01:37:37.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.936+0000 7fd7437fe640 1 -- 172.21.15.79:0/1773551095 learned_addr learned my addr 172.21.15.79:0/1773551095 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:37.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.936+0000 7fd743fff640 1 --2- 172.21.15.79:0/1773551095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5600044ab130 0x5600044a8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:37.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.936+0000 7fd742ffd640 1 --2- 172.21.15.79:0/1773551095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56000449f1a0 0x5600044a8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:37.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.936+0000 7fd7437fe640 1 -- 172.21.15.79:0/1773551095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56000449f1a0 msgr2=0x5600044a8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:37.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.936+0000 7fd7437fe640 1 --2- 172.21.15.79:0/1773551095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56000449f1a0 0x5600044a8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:37.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.936+0000 7fd7437fe640 1 -- 172.21.15.79:0/1773551095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5600044ab130 msgr2=0x5600044a8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:37.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.936+0000 7fd7437fe640 1 --2- 172.21.15.79:0/1773551095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5600044ab130 0x5600044a8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:37.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.936+0000 7fd7437fe640 1 -- 172.21.15.79:0/1773551095 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600044bfa40 con 0x56000449e880 2024-08-20T01:37:37.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.936+0000 7fd7437fe640 1 --2- 172.21.15.79:0/1773551095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56000449e880 0x5600044a8110 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fd734012700 tx=0x7fd734012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=455e11de305711ec server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:37.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.936+0000 7fd722ffd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:37:37.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.937+0000 7fd722ffd640 1 -- 172.21.15.79:0/1773551095 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73400f920 con 0x56000449e880 2024-08-20T01:37:37.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.937+0000 7fd722ffd640 1 -- 172.21.15.79:0/1773551095 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fd73400fac0 con 0x56000449e880 2024-08-20T01:37:37.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.937+0000 7fd74c1ad740 1 -- 172.21.15.79:0/1773551095 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5600043b4150 con 0x56000449e880 2024-08-20T01:37:37.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.937+0000 7fd722ffd640 1 -- 172.21.15.79:0/1773551095 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd73400fcc0 con 0x56000449e880 2024-08-20T01:37:37.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.937+0000 7fd74c1ad740 10 client.15558 fetch_fsmap learned FSMap version 28 2024-08-20T01:37:37.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.937+0000 7fd74c1ad740 1 -- 172.21.15.79:0/1773551095 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5600044c2450 con 0x56000449e880 2024-08-20T01:37:37.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.937+0000 7fd722ffd640 1 -- 172.21.15.79:0/1773551095 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5600043b4150 con 0x56000449e880 2024-08-20T01:37:37.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.937+0000 7fd722ffd640 1 -- 172.21.15.79:0/1773551095 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd73401c420 con 0x56000449e880 2024-08-20T01:37:37.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.937+0000 7fd74c1ad740 10 client.15558 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:37:37.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.937+0000 7fd74c1ad740 10 client.15558 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:37:37.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.937+0000 7fd74c1ad740 20 client.15558 populate_metadata read hostname 'smithi079' 2024-08-20T01:37:37.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.938+0000 7fd74c1ad740 1 --2- 172.21.15.79:0/1773551095 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x5600044c3920 0x5600044c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:37.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.938+0000 7fd74c1ad740 4 client.15558 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:37:37.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.938+0000 7fd74c1ad740 1 -- 172.21.15.79:0/1773551095 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560004417880 con 0x5600044c3920 2024-08-20T01:37:37.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.938+0000 7fd742ffd640 1 --2- 172.21.15.79:0/1773551095 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x5600044c3920 0x5600044c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:37.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.938+0000 7fd722ffd640 10 client.15558 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:37:37.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.938+0000 7fd742ffd640 1 --2- 172.21.15.79:0/1773551095 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x5600044c3920 0x5600044c5d30 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=492bbf0e096ab5b3 server_cookie=9cb64593124d036e in_seq=0 out_seq=0 2024-08-20T01:37:37.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.939+0000 7fd722ffd640 1 -- 172.21.15.79:0/1773551095 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560004417880 con 0x5600044c3920 2024-08-20T01:37:37.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.939+0000 7fd722ffd640 10 client.15558 handle_command_reply: tid=0 2024-08-20T01:37:37.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.939+0000 7fd74c1ad740 1 client.15558 shutdown 2024-08-20T01:37:37.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.939+0000 7fd74c1ad740 1 -- 172.21.15.79:0/1773551095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56000449e880 msgr2=0x5600044a8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:37.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.939+0000 7fd74c1ad740 1 --2- 172.21.15.79:0/1773551095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56000449e880 0x5600044a8110 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fd734012700 tx=0x7fd734012bc0 comp rx=0 tx=0).stop 2024-08-20T01:37:37.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.939+0000 7fd74c1ad740 1 -- 172.21.15.79:0/1773551095 shutdown_connections 2024-08-20T01:37:37.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.939+0000 7fd74c1ad740 1 --2- 172.21.15.79:0/1773551095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5600044ab130 0x5600044a8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:37.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.939+0000 7fd74c1ad740 1 --2- 172.21.15.79:0/1773551095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56000449f1a0 0x5600044a8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:37.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.939+0000 7fd74c1ad740 1 --2- 172.21.15.79:0/1773551095 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x5600044c3920 0x5600044c5d30 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:37.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.940+0000 7fd722ffd640 0 client.15558 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:37:37.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.940+0000 7fd74c1ad740 1 --2- 172.21.15.79:0/1773551095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56000449e880 0x5600044a8110 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:37.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.940+0000 7fd74c1ad740 1 -- 172.21.15.79:0/1773551095 >> 172.21.15.79:0/1773551095 conn(0x56000449c6b0 msgr2=0x5600044a2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:37.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.940+0000 7fd74c1ad740 1 -- 172.21.15.79:0/1773551095 shutdown_connections 2024-08-20T01:37:37.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.940+0000 7fd74c1ad740 1 -- 172.21.15.79:0/1773551095 wait complete. 2024-08-20T01:37:37.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.940+0000 7fd74c1ad740 20 client.15558 trim_cache size 0 max 16384 2024-08-20T01:37:37.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.953+0000 7fd74c1ad740 1 Processor -- start 2024-08-20T01:37:37.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.953+0000 7fd74c1ad740 1 -- start start 2024-08-20T01:37:37.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.953+0000 7fd74c1ad740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56000449e880 0x5600044a9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:37.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.953+0000 7fd74c1ad740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56000449f1a0 0x5600044a7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:37.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.953+0000 7fd74c1ad740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600044ab130 0x5600044cb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:37.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.953+0000 7fd74c1ad740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd7441abdc0 con 0x56000449e880 2024-08-20T01:37:37.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.953+0000 7fd74c1ad740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd7441ad900 con 0x56000449f1a0 2024-08-20T01:37:37.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.953+0000 7fd74c1ad740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd7441ac490 con 0x5600044ab130 2024-08-20T01:37:37.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.953+0000 7fd7437fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56000449e880 0x5600044a9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:37.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.953+0000 7fd7437fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56000449e880 0x5600044a9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51704/0 (socket says 172.21.15.79:51704) 2024-08-20T01:37:37.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.953+0000 7fd7437fe640 1 -- 172.21.15.79:0/2793809928 learned_addr learned my addr 172.21.15.79:0/2793809928 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:37.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.953+0000 7fd743fff640 1 --2- 172.21.15.79:0/2793809928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600044ab130 0x5600044cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:37.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.953+0000 7fd742ffd640 1 --2- 172.21.15.79:0/2793809928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56000449f1a0 0x5600044a7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:37.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.954+0000 7fd7437fe640 1 -- 172.21.15.79:0/2793809928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600044ab130 msgr2=0x5600044cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:37.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.954+0000 7fd7437fe640 1 --2- 172.21.15.79:0/2793809928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600044ab130 0x5600044cb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:37.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.954+0000 7fd7437fe640 1 -- 172.21.15.79:0/2793809928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56000449f1a0 msgr2=0x5600044a7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:37.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.954+0000 7fd7437fe640 1 --2- 172.21.15.79:0/2793809928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56000449f1a0 0x5600044a7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:37.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.954+0000 7fd7437fe640 1 -- 172.21.15.79:0/2793809928 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600044a6610 con 0x56000449e880 2024-08-20T01:37:37.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.954+0000 7fd742ffd640 1 --2- 172.21.15.79:0/2793809928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56000449f1a0 0x5600044a7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:37:37.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.954+0000 7fd7437fe640 1 --2- 172.21.15.79:0/2793809928 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56000449e880 0x5600044a9740 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd734009460 tx=0x7fd7340122e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72701e2073d7a51 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:37.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.954+0000 7fd7297fa640 1 -- 172.21.15.79:0/2793809928 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73402b030 con 0x56000449e880 2024-08-20T01:37:37.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.954+0000 7fd7297fa640 1 -- 172.21.15.79:0/2793809928 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd73401ce50 con 0x56000449e880 2024-08-20T01:37:37.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.954+0000 7fd7297fa640 1 -- 172.21.15.79:0/2793809928 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73401c420 con 0x56000449e880 2024-08-20T01:37:37.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.955+0000 7fd74c1ad740 1 -- 172.21.15.79:0/2793809928 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56000449e880 msgr2=0x5600044a9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:37.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.955+0000 7fd74c1ad740 1 --2- 172.21.15.79:0/2793809928 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56000449e880 0x5600044a9740 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd734009460 tx=0x7fd7340122e0 comp rx=0 tx=0).stop 2024-08-20T01:37:37.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.955+0000 7fd74c1ad740 1 -- 172.21.15.79:0/2793809928 shutdown_connections 2024-08-20T01:37:37.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.955+0000 7fd74c1ad740 1 --2- 172.21.15.79:0/2793809928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600044ab130 0x5600044cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:37.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.955+0000 7fd74c1ad740 1 --2- 172.21.15.79:0/2793809928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56000449f1a0 0x5600044a7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:37.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.955+0000 7fd74c1ad740 1 --2- 172.21.15.79:0/2793809928 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56000449e880 0x5600044a9740 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:37.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.955+0000 7fd74c1ad740 1 -- 172.21.15.79:0/2793809928 >> 172.21.15.79:0/2793809928 conn(0x56000449c6b0 msgr2=0x5600044a8900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:37.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.955+0000 7fd74c1ad740 1 -- 172.21.15.79:0/2793809928 shutdown_connections 2024-08-20T01:37:37.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.955+0000 7fd74c1ad740 1 -- 172.21.15.79:0/2793809928 wait complete. 2024-08-20T01:37:37.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.956+0000 7fd74c1ad740 1 -- start start 2024-08-20T01:37:37.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.956+0000 7fd74c1ad740 1 Processor -- start 2024-08-20T01:37:37.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.956+0000 7fd74c1ad740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56000449e880 0x5600044bbc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:37.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.956+0000 7fd74c1ad740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56000449f1a0 0x5600044bc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:37.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.956+0000 7fd74c1ad740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5600044ab130 0x5600044b73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:37.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.956+0000 7fd74c1ad740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd7441ad230 con 0x5600044ab130 2024-08-20T01:37:37.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.956+0000 7fd74c1ad740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd7441acb60 con 0x56000449f1a0 2024-08-20T01:37:37.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.956+0000 7fd74c1ad740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd7441a9da0 con 0x56000449e880 2024-08-20T01:37:37.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.956+0000 7fd74c1ad740 10 client.0 _ll_register_callbacks cb 0x7fd734009850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:37.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.956+0000 7fd7437fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56000449e880 0x5600044bbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:37.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.956+0000 7fd742ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56000449f1a0 0x5600044bc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:37.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.956+0000 7fd7437fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56000449e880 0x5600044bbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:60398/0 (socket says 172.21.15.79:60398) 2024-08-20T01:37:37.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.956+0000 7fd7437fe640 1 -- 172.21.15.79:0/3813289502 learned_addr learned my addr 172.21.15.79:0/3813289502 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:37.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.956+0000 7fd743fff640 1 --2- 172.21.15.79:0/3813289502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5600044ab130 0x5600044b73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:37.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.957+0000 7fd7437fe640 1 -- 172.21.15.79:0/3813289502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56000449f1a0 msgr2=0x5600044bc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:37.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.957+0000 7fd7437fe640 1 --2- 172.21.15.79:0/3813289502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56000449f1a0 0x5600044bc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:37.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.957+0000 7fd7437fe640 1 -- 172.21.15.79:0/3813289502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5600044ab130 msgr2=0x5600044b73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:37.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.957+0000 7fd7437fe640 1 --2- 172.21.15.79:0/3813289502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5600044ab130 0x5600044b73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:37.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.957+0000 7fd7437fe640 1 -- 172.21.15.79:0/3813289502 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600044b7c20 con 0x56000449e880 2024-08-20T01:37:37.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.957+0000 7fd743fff640 1 --2- 172.21.15.79:0/3813289502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5600044ab130 0x5600044b73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:37:37.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.957+0000 7fd7437fe640 1 --2- 172.21.15.79:0/3813289502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56000449e880 0x5600044bbc80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd73401c810 tx=0x7fd734005970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60f44468059ea9c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:37.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.957+0000 7fd722ffd640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:37:37.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.957+0000 7fd722ffd640 1 -- 172.21.15.79:0/3813289502 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd734033020 con 0x56000449e880 2024-08-20T01:37:37.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.957+0000 7fd74c1ad740 1 -- 172.21.15.79:0/3813289502 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd73401ce50 con 0x56000449e880 2024-08-20T01:37:37.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.957+0000 7fd722ffd640 1 -- 172.21.15.79:0/3813289502 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fd7340050b0 con 0x56000449e880 2024-08-20T01:37:37.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.957+0000 7fd722ffd640 1 -- 172.21.15.79:0/3813289502 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd73401cc90 con 0x56000449e880 2024-08-20T01:37:37.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.957+0000 7fd74c1ad740 10 client.24988 fetch_fsmap learned FSMap version 28 2024-08-20T01:37:37.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.957+0000 7fd74c1ad740 1 -- 172.21.15.79:0/3813289502 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56000452e2c0 con 0x56000449e880 2024-08-20T01:37:37.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.958+0000 7fd722ffd640 1 -- 172.21.15.79:0/3813289502 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd73401ce50 con 0x56000449e880 2024-08-20T01:37:37.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.958+0000 7fd722ffd640 1 -- 172.21.15.79:0/3813289502 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd734003cb0 con 0x56000449e880 2024-08-20T01:37:37.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.958+0000 7fd74c1ad740 10 client.24988 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:37:37.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.958+0000 7fd74c1ad740 10 client.24988 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:37:37.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.958+0000 7fd74c1ad740 20 client.24988 populate_metadata read hostname 'smithi079' 2024-08-20T01:37:37.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.958+0000 7fd74c1ad740 1 --2- 172.21.15.79:0/3813289502 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x56000452e920 0x560004530d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:37.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.958+0000 7fd74c1ad740 4 client.24988 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:37:37.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.958+0000 7fd74c1ad740 1 -- 172.21.15.79:0/3813289502 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560004413320 con 0x56000452e920 2024-08-20T01:37:37.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.958+0000 7fd742ffd640 1 --2- 172.21.15.79:0/3813289502 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x56000452e920 0x560004530d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:37.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.959+0000 7fd742ffd640 1 --2- 172.21.15.79:0/3813289502 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x56000452e920 0x560004530d10 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9c6b599b25e4e571 server_cookie=229d05665b276849 in_seq=0 out_seq=0 2024-08-20T01:37:37.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.959+0000 7fd722ffd640 10 client.24988 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:37:37.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.959+0000 7fd722ffd640 1 -- 172.21.15.79:0/3813289502 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560004413320 con 0x56000452e920 2024-08-20T01:37:37.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.959+0000 7fd722ffd640 10 client.24988 handle_command_reply: tid=0 2024-08-20T01:37:37.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.959+0000 7fd74c1ad740 1 client.24988 shutdown 2024-08-20T01:37:37.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.959+0000 7fd74c1ad740 1 -- 172.21.15.79:0/3813289502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56000449e880 msgr2=0x5600044bbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:37.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.959+0000 7fd74c1ad740 1 --2- 172.21.15.79:0/3813289502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56000449e880 0x5600044bbc80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd73401c810 tx=0x7fd734005970 comp rx=0 tx=0).stop 2024-08-20T01:37:37.968 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:37:37.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.959+0000 7fd74c1ad740 1 -- 172.21.15.79:0/3813289502 shutdown_connections 2024-08-20T01:37:37.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.959+0000 7fd74c1ad740 1 --2- 172.21.15.79:0/3813289502 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x56000452e920 0x560004530d10 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:37.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.959+0000 7fd74c1ad740 1 --2- 172.21.15.79:0/3813289502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5600044ab130 0x5600044b73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:37.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.959+0000 7fd74c1ad740 1 --2- 172.21.15.79:0/3813289502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56000449f1a0 0x5600044bc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:37.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.959+0000 7fd722ffd640 0 client.24988 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:37:37.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.959+0000 7fd74c1ad740 1 --2- 172.21.15.79:0/3813289502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56000449e880 0x5600044bbc80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:37.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.959+0000 7fd74c1ad740 1 -- 172.21.15.79:0/3813289502 >> 172.21.15.79:0/3813289502 conn(0x56000449c6b0 msgr2=0x5600044a80e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:37.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.960+0000 7fd74c1ad740 1 -- 172.21.15.79:0/3813289502 shutdown_connections 2024-08-20T01:37:37.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.960+0000 7fd74c1ad740 1 -- 172.21.15.79:0/3813289502 wait complete. 2024-08-20T01:37:37.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.960+0000 7fd74c1ad740 20 client.24988 trim_cache size 0 max 16384 2024-08-20T01:37:37.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.960+0000 7fd749db4640 1 -- 172.21.15.79:0/8534188 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd72c0b8060 msgr2=0x7fd72c0ba520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:37.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.960+0000 7fd749db4640 1 --2- 172.21.15.79:0/8534188 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd72c0b8060 0x7fd72c0ba520 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd73c009a60 tx=0x7fd73c005f80 comp rx=0 tx=0).stop 2024-08-20T01:37:37.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.960+0000 7fd749db4640 1 -- 172.21.15.79:0/8534188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7441084b0 msgr2=0x7fd744199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:37.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.960+0000 7fd749db4640 1 --2- 172.21.15.79:0/8534188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7441084b0 0x7fd744199350 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd73800e9f0 tx=0x7fd73800eeb0 comp rx=0 tx=0).stop 2024-08-20T01:37:37.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.960+0000 7fd749db4640 1 -- 172.21.15.79:0/8534188 shutdown_connections 2024-08-20T01:37:37.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.960+0000 7fd749db4640 1 --2- 172.21.15.79:0/8534188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd744108e30 0x7fd74419e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:37.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.960+0000 7fd749db4640 1 --2- 172.21.15.79:0/8534188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7441084b0 0x7fd744199350 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:37.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.960+0000 7fd749db4640 1 --2- 172.21.15.79:0/8534188 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd72c0b8060 0x7fd72c0ba520 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:37.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.960+0000 7fd749db4640 1 --2- 172.21.15.79:0/8534188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd744102aa0 0x7fd744198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:37.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.960+0000 7fd749db4640 1 -- 172.21.15.79:0/8534188 >> 172.21.15.79:0/8534188 conn(0x7fd7440fe550 msgr2=0x7fd744100940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:37.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.961+0000 7fd749db4640 1 -- 172.21.15.79:0/8534188 shutdown_connections 2024-08-20T01:37:37.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:37.961+0000 7fd749db4640 1 -- 172.21.15.79:0/8534188 wait complete. 2024-08-20T01:37:38.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:37 smithi079 ceph-mon[18656]: pgmap v356: 97 pgs: 97 active+clean; 662 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-08-20T01:37:38.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:37 smithi081 ceph-mon[22209]: pgmap v356: 97 pgs: 97 active+clean; 662 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-08-20T01:37:38.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:37 smithi175 ceph-mon[22392]: pgmap v356: 97 pgs: 97 active+clean; 662 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-08-20T01:37:38.644 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T01:37:39.024 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:37:39.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.488+0000 7f1b140a9640 1 -- 172.21.15.79:0/2189656164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b0c1084c0 msgr2=0x7f1b0c108900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:39.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.488+0000 7f1b140a9640 1 --2- 172.21.15.79:0/2189656164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b0c1084c0 0x7f1b0c108900 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1afc009900 tx=0x7f1afc02a410 comp rx=0 tx=0).stop 2024-08-20T01:37:39.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.488+0000 7f1b140a9640 1 -- 172.21.15.79:0/2189656164 shutdown_connections 2024-08-20T01:37:39.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.488+0000 7f1b140a9640 1 --2- 172.21.15.79:0/2189656164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b0c108e40 0x7f1b0c10f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.488+0000 7f1b140a9640 1 --2- 172.21.15.79:0/2189656164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b0c1084c0 0x7f1b0c108900 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.488+0000 7f1b140a9640 1 --2- 172.21.15.79:0/2189656164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b0c102ab0 0x7f1b0c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.488+0000 7f1b140a9640 1 -- 172.21.15.79:0/2189656164 >> 172.21.15.79:0/2189656164 conn(0x7f1b0c0fe580 msgr2=0x7f1b0c1009a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:39.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.488+0000 7f1b140a9640 1 -- 172.21.15.79:0/2189656164 shutdown_connections 2024-08-20T01:37:39.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.488+0000 7f1b140a9640 1 -- 172.21.15.79:0/2189656164 wait complete. 2024-08-20T01:37:39.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.489+0000 7f1b140a9640 1 Processor -- start 2024-08-20T01:37:39.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.489+0000 7f1b140a9640 1 -- start start 2024-08-20T01:37:39.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.489+0000 7f1b140a9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b0c102ab0 0x7f1b0c198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:39.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.489+0000 7f1b140a9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b0c1084c0 0x7f1b0c199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:39.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.489+0000 7f1b140a9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b0c108e40 0x7f1b0c19e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:39.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.489+0000 7f1b140a9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1b0c112a00 con 0x7f1b0c102ab0 2024-08-20T01:37:39.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.489+0000 7f1b140a9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1b0c112880 con 0x7f1b0c108e40 2024-08-20T01:37:39.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.489+0000 7f1b140a9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1b0c112b80 con 0x7f1b0c1084c0 2024-08-20T01:37:39.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.489+0000 7f1b11e45640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b0c102ab0 0x7f1b0c198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:39.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.489+0000 7f1b11e45640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b0c102ab0 0x7f1b0c198e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51728/0 (socket says 172.21.15.79:51728) 2024-08-20T01:37:39.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.489+0000 7f1b11e45640 1 -- 172.21.15.79:0/2161062757 learned_addr learned my addr 172.21.15.79:0/2161062757 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:39.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.489+0000 7f1b12646640 1 --2- 172.21.15.79:0/2161062757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b0c108e40 0x7f1b0c19e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:39.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.490+0000 7f1b11644640 1 --2- 172.21.15.79:0/2161062757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b0c1084c0 0x7f1b0c199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:39.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.490+0000 7f1b11e45640 1 -- 172.21.15.79:0/2161062757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b0c1084c0 msgr2=0x7f1b0c199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:39.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.490+0000 7f1b11e45640 1 --2- 172.21.15.79:0/2161062757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b0c1084c0 0x7f1b0c199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.490+0000 7f1b11e45640 1 -- 172.21.15.79:0/2161062757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b0c108e40 msgr2=0x7f1b0c19e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:39.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.490+0000 7f1b11e45640 1 --2- 172.21.15.79:0/2161062757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b0c108e40 0x7f1b0c19e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.490+0000 7f1b11e45640 1 -- 172.21.15.79:0/2161062757 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b0c19ef00 con 0x7f1b0c102ab0 2024-08-20T01:37:39.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.490+0000 7f1b11644640 1 --2- 172.21.15.79:0/2161062757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b0c1084c0 0x7f1b0c199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:37:39.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.490+0000 7f1b11e45640 1 --2- 172.21.15.79:0/2161062757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b0c102ab0 0x7f1b0c198e50 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f1b0800d950 tx=0x7f1b0800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:39.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.490+0000 7f1b02ffd640 1 -- 172.21.15.79:0/2161062757 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b08017070 con 0x7f1b0c102ab0 2024-08-20T01:37:39.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.490+0000 7f1b140a9640 1 -- 172.21.15.79:0/2161062757 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b0c19f1f0 con 0x7f1b0c102ab0 2024-08-20T01:37:39.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.490+0000 7f1b140a9640 1 -- 172.21.15.79:0/2161062757 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b0c1a5a80 con 0x7f1b0c102ab0 2024-08-20T01:37:39.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.490+0000 7f1b02ffd640 1 -- 172.21.15.79:0/2161062757 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b08009c30 con 0x7f1b0c102ab0 2024-08-20T01:37:39.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.490+0000 7f1b02ffd640 1 -- 172.21.15.79:0/2161062757 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0800f620 con 0x7f1b0c102ab0 2024-08-20T01:37:39.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.493+0000 7f1b164a2740 1 Processor -- start 2024-08-20T01:37:39.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.493+0000 7f1b164a2740 1 -- start start 2024-08-20T01:37:39.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.493+0000 7f1b164a2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561945fab730 0x561945fabb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:39.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.493+0000 7f1b164a2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561945fac050 0x561945fbbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:39.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.493+0000 7f1b164a2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561945fbc3f0 0x561945fbe7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:39.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.493+0000 7f1b164a2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561945f22930 con 0x561945fab730 2024-08-20T01:37:39.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.493+0000 7f1b164a2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561945f11e30 con 0x561945fac050 2024-08-20T01:37:39.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.493+0000 7f1b164a2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561945f15e70 con 0x561945fbc3f0 2024-08-20T01:37:39.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.493+0000 7f1b12646640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561945fab730 0x561945fabb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:39.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.493+0000 7f1b12646640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561945fab730 0x561945fabb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51742/0 (socket says 172.21.15.79:51742) 2024-08-20T01:37:39.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.493+0000 7f1b12646640 1 -- 172.21.15.79:0/1615845078 learned_addr learned my addr 172.21.15.79:0/1615845078 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:39.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.493+0000 7f1b02ffd640 1 -- 172.21.15.79:0/2161062757 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1b0800f7c0 con 0x7f1b0c102ab0 2024-08-20T01:37:39.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.494+0000 7f1b12646640 1 -- 172.21.15.79:0/1615845078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561945fbc3f0 msgr2=0x561945fbe7e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:37:39.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.494+0000 7f1b12646640 1 --2- 172.21.15.79:0/1615845078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561945fbc3f0 0x561945fbe7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.494+0000 7f1b12646640 1 -- 172.21.15.79:0/1615845078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561945fac050 msgr2=0x561945fbbeb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:37:39.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.494+0000 7f1b12646640 1 --2- 172.21.15.79:0/1615845078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561945fac050 0x561945fbbeb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.494+0000 7f1b12646640 1 -- 172.21.15.79:0/1615845078 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561945c71650 con 0x561945fab730 2024-08-20T01:37:39.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.494+0000 7f1b12646640 1 --2- 172.21.15.79:0/1615845078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561945fab730 0x561945fabb10 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f1b04007f70 tx=0x7f1b0400f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68bbe0df6a6312c8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:39.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.494+0000 7f1af7fff640 1 -- 172.21.15.79:0/1615845078 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b04010900 con 0x561945fab730 2024-08-20T01:37:39.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.494+0000 7f1af7fff640 1 -- 172.21.15.79:0/1615845078 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b04014070 con 0x561945fab730 2024-08-20T01:37:39.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.494+0000 7f1af7fff640 1 -- 172.21.15.79:0/1615845078 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b04017c60 con 0x561945fab730 2024-08-20T01:37:39.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.495+0000 7f1b02ffd640 1 --2- 172.21.15.79:0/2161062757 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1af80b3c50 0x7f1af80b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:39.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.495+0000 7f1b164a2740 1 -- 172.21.15.79:0/1615845078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561945fab730 msgr2=0x561945fabb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:39.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.495+0000 7f1b164a2740 1 --2- 172.21.15.79:0/1615845078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561945fab730 0x561945fabb10 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f1b04007f70 tx=0x7f1b0400f850 comp rx=0 tx=0).stop 2024-08-20T01:37:39.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.495+0000 7f1b11e45640 1 --2- 172.21.15.79:0/2161062757 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1af80b3c50 0x7f1af80b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:39.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.495+0000 7f1b164a2740 1 -- 172.21.15.79:0/1615845078 shutdown_connections 2024-08-20T01:37:39.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.495+0000 7f1b164a2740 1 --2- 172.21.15.79:0/1615845078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561945fbc3f0 0x561945fbe7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.495+0000 7f1b164a2740 1 --2- 172.21.15.79:0/1615845078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561945fac050 0x561945fbbeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.495+0000 7f1b164a2740 1 --2- 172.21.15.79:0/1615845078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561945fab730 0x561945fabb10 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.495+0000 7f1b164a2740 1 -- 172.21.15.79:0/1615845078 >> 172.21.15.79:0/1615845078 conn(0x561945fa9560 msgr2=0x561945faa700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:39.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.495+0000 7f1b164a2740 1 -- 172.21.15.79:0/1615845078 shutdown_connections 2024-08-20T01:37:39.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.495+0000 7f1b02ffd640 1 -- 172.21.15.79:0/2161062757 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f1b080e35a0 con 0x7f1b0c102ab0 2024-08-20T01:37:39.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.496+0000 7f1b164a2740 1 -- 172.21.15.79:0/1615845078 wait complete. 2024-08-20T01:37:39.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.496+0000 7f1b164a2740 1 -- start start 2024-08-20T01:37:39.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.496+0000 7f1b11e45640 1 --2- 172.21.15.79:0/2161062757 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1af80b3c50 0x7f1af80b6110 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1b080058c0 tx=0x7f1b080b3040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:39.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.496+0000 7f1b164a2740 1 Processor -- start 2024-08-20T01:37:39.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.497+0000 7f1b164a2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561945fab730 0x561945fbbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:39.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.497+0000 7f1b164a2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561945fac050 0x561945fb4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:39.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.497+0000 7f1b164a2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561945fbc3f0 0x561945fb5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:39.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.497+0000 7f1b11644640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561945fac050 0x561945fb4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:39.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.497+0000 7f1b164a2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561945d74700 con 0x561945fac050 2024-08-20T01:37:39.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.497+0000 7f1b164a2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561945e98810 con 0x561945fab730 2024-08-20T01:37:39.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.497+0000 7f1b164a2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561945fbf0a0 con 0x561945fbc3f0 2024-08-20T01:37:39.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.497+0000 7f1b11644640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561945fac050 0x561945fb4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51750/0 (socket says 172.21.15.79:51750) 2024-08-20T01:37:39.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.497+0000 7f1b11644640 1 -- 172.21.15.79:0/1789647956 learned_addr learned my addr 172.21.15.79:0/1789647956 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:39.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.497+0000 7f1b164a2740 10 client.0 _ll_register_callbacks cb 0x561945f0b700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:39.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.497+0000 7f1b12646640 1 --2- 172.21.15.79:0/1789647956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561945fab730 0x561945fbbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:39.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.497+0000 7f1b12646640 1 --2- 172.21.15.79:0/1789647956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561945fbc3f0 0x561945fb5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:39.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.497+0000 7f1b11644640 1 -- 172.21.15.79:0/1789647956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561945fbc3f0 msgr2=0x561945fb5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:39.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.497+0000 7f1b11644640 1 --2- 172.21.15.79:0/1789647956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561945fbc3f0 0x561945fb5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.497+0000 7f1b11644640 1 -- 172.21.15.79:0/1789647956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561945fab730 msgr2=0x561945fbbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:39.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.497+0000 7f1b11644640 1 --2- 172.21.15.79:0/1789647956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561945fab730 0x561945fbbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.497+0000 7f1b11644640 1 -- 172.21.15.79:0/1789647956 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561945fb5bc0 con 0x561945fac050 2024-08-20T01:37:39.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.497+0000 7f1b12646640 1 --2- 172.21.15.79:0/1789647956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561945fab730 0x561945fbbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:37:39.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.497+0000 7f1b11644640 1 --2- 172.21.15.79:0/1789647956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561945fac050 0x561945fb4f40 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f1afc02aa00 tx=0x7f1afc005250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47806056dc696c71 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:39.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.497+0000 7f1af57fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:37:39.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.497+0000 7f1af57fa640 1 -- 172.21.15.79:0/1789647956 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1afc035030 con 0x561945fac050 2024-08-20T01:37:39.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.498+0000 7f1af57fa640 1 -- 172.21.15.79:0/1789647956 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f1afc0048c0 con 0x561945fac050 2024-08-20T01:37:39.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.498+0000 7f1b164a2740 1 -- 172.21.15.79:0/1789647956 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561945ec1150 con 0x561945fac050 2024-08-20T01:37:39.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.498+0000 7f1af57fa640 1 -- 172.21.15.79:0/1789647956 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1afc005d50 con 0x561945fac050 2024-08-20T01:37:39.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.498+0000 7f1b164a2740 10 client.15573 fetch_fsmap learned FSMap version 28 2024-08-20T01:37:39.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.498+0000 7f1b164a2740 1 -- 172.21.15.79:0/1789647956 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561945fcf290 con 0x561945fac050 2024-08-20T01:37:39.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.498+0000 7f1af57fa640 1 -- 172.21.15.79:0/1789647956 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x561945ec1150 con 0x561945fac050 2024-08-20T01:37:39.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.498+0000 7f1af57fa640 1 -- 172.21.15.79:0/1789647956 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1afc03b430 con 0x561945fac050 2024-08-20T01:37:39.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.498+0000 7f1b164a2740 10 client.15573 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:37:39.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.498+0000 7f1b164a2740 10 client.15573 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:37:39.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.498+0000 7f1b164a2740 20 client.15573 populate_metadata read hostname 'smithi079' 2024-08-20T01:37:39.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.498+0000 7f1b164a2740 1 --2- 172.21.15.79:0/1789647956 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x561945fd06f0 0x561945fd2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:39.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.498+0000 7f1b164a2740 4 client.15573 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:37:39.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.499+0000 7f1b164a2740 1 -- 172.21.15.79:0/1789647956 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561945f24880 con 0x561945fd06f0 2024-08-20T01:37:39.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.499+0000 7f1b12646640 1 --2- 172.21.15.79:0/1789647956 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x561945fd06f0 0x561945fd2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:39.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.499+0000 7f1af57fa640 10 client.15573 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:37:39.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.499+0000 7f1b12646640 1 --2- 172.21.15.79:0/1789647956 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x561945fd06f0 0x561945fd2b60 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=530aaa42f636dc25 server_cookie=96512f6b7ebe1d4e in_seq=0 out_seq=0 2024-08-20T01:37:39.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.500+0000 7f1af57fa640 1 -- 172.21.15.79:0/1789647956 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561945f24880 con 0x561945fd06f0 2024-08-20T01:37:39.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.500+0000 7f1af57fa640 10 client.15573 handle_command_reply: tid=0 2024-08-20T01:37:39.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.500+0000 7f1b164a2740 1 client.15573 shutdown 2024-08-20T01:37:39.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.500+0000 7f1b164a2740 1 -- 172.21.15.79:0/1789647956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561945fac050 msgr2=0x561945fb4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:39.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.500+0000 7f1b164a2740 1 --2- 172.21.15.79:0/1789647956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561945fac050 0x561945fb4f40 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f1afc02aa00 tx=0x7f1afc005250 comp rx=0 tx=0).stop 2024-08-20T01:37:39.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.500+0000 7f1b164a2740 1 -- 172.21.15.79:0/1789647956 shutdown_connections 2024-08-20T01:37:39.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.500+0000 7f1b164a2740 1 --2- 172.21.15.79:0/1789647956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561945fbc3f0 0x561945fb5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.500+0000 7f1b164a2740 1 --2- 172.21.15.79:0/1789647956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561945fac050 0x561945fb4f40 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.500+0000 7f1b164a2740 1 --2- 172.21.15.79:0/1789647956 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x561945fd06f0 0x561945fd2b60 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.500+0000 7f1b164a2740 1 --2- 172.21.15.79:0/1789647956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561945fab730 0x561945fbbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.500+0000 7f1af57fa640 0 client.15573 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:37:39.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.500+0000 7f1b164a2740 1 -- 172.21.15.79:0/1789647956 >> 172.21.15.79:0/1789647956 conn(0x561945fa9560 msgr2=0x561945faf100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:39.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.500+0000 7f1b164a2740 1 -- 172.21.15.79:0/1789647956 shutdown_connections 2024-08-20T01:37:39.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.500+0000 7f1b164a2740 1 -- 172.21.15.79:0/1789647956 wait complete. 2024-08-20T01:37:39.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.500+0000 7f1b164a2740 20 client.15573 trim_cache size 0 max 16384 2024-08-20T01:37:39.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.513+0000 7f1b164a2740 1 Processor -- start 2024-08-20T01:37:39.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.513+0000 7f1b164a2740 1 -- start start 2024-08-20T01:37:39.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.514+0000 7f1b164a2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561945fab730 0x561945fb5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:39.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.514+0000 7f1b164a2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561945fac050 0x561945faa580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:39.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.514+0000 7f1b12646640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561945fab730 0x561945fb5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:39.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.514+0000 7f1b12646640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561945fab730 0x561945fb5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51760/0 (socket says 172.21.15.79:51760) 2024-08-20T01:37:39.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.514+0000 7f1b164a2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561945fbc3f0 0x561945faaac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:39.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.514+0000 7f1b164a2740 1 -- 172.21.15.79:0/4027456795 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1af000e3d0 con 0x561945fab730 2024-08-20T01:37:39.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.514+0000 7f1b12646640 1 -- 172.21.15.79:0/4027456795 learned_addr learned my addr 172.21.15.79:0/4027456795 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:39.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.514+0000 7f1b164a2740 1 -- 172.21.15.79:0/4027456795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1af000ff10 con 0x561945fac050 2024-08-20T01:37:39.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.514+0000 7f1b164a2740 1 -- 172.21.15.79:0/4027456795 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1af000eaa0 con 0x561945fbc3f0 2024-08-20T01:37:39.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.514+0000 7f1b11644640 1 --2- 172.21.15.79:0/4027456795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561945fac050 0x561945faa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:39.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.514+0000 7f1b12646640 1 -- 172.21.15.79:0/4027456795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561945fbc3f0 msgr2=0x561945faaac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:39.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.514+0000 7f1b12646640 1 --2- 172.21.15.79:0/4027456795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561945fbc3f0 0x561945faaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.514+0000 7f1b12646640 1 -- 172.21.15.79:0/4027456795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561945fac050 msgr2=0x561945faa580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:39.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.514+0000 7f1b12646640 1 --2- 172.21.15.79:0/4027456795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561945fac050 0x561945faa580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.514+0000 7f1b12646640 1 -- 172.21.15.79:0/4027456795 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561945fd31e0 con 0x561945fab730 2024-08-20T01:37:39.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.514+0000 7f1b12646640 1 --2- 172.21.15.79:0/4027456795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561945fab730 0x561945fb5620 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f1b04007330 tx=0x7f1b04017840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91208f929ce3d841 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:39.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.515+0000 7f1af77fe640 1 -- 172.21.15.79:0/4027456795 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b04003b70 con 0x561945fab730 2024-08-20T01:37:39.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.515+0000 7f1af77fe640 1 -- 172.21.15.79:0/4027456795 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b04014050 con 0x561945fab730 2024-08-20T01:37:39.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.515+0000 7f1af77fe640 1 -- 172.21.15.79:0/4027456795 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b04010af0 con 0x561945fab730 2024-08-20T01:37:39.543 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:37:39.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.515+0000 7f1b164a2740 1 -- 172.21.15.79:0/4027456795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561945fab730 msgr2=0x561945fb5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:39.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.515+0000 7f1b164a2740 1 --2- 172.21.15.79:0/4027456795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561945fab730 0x561945fb5620 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f1b04007330 tx=0x7f1b04017840 comp rx=0 tx=0).stop 2024-08-20T01:37:39.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.516+0000 7f1b164a2740 1 -- 172.21.15.79:0/4027456795 shutdown_connections 2024-08-20T01:37:39.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.516+0000 7f1b164a2740 1 --2- 172.21.15.79:0/4027456795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561945fbc3f0 0x561945faaac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.516+0000 7f1b164a2740 1 --2- 172.21.15.79:0/4027456795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561945fac050 0x561945faa580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.516+0000 7f1b164a2740 1 --2- 172.21.15.79:0/4027456795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561945fab730 0x561945fb5620 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.516+0000 7f1b164a2740 1 -- 172.21.15.79:0/4027456795 >> 172.21.15.79:0/4027456795 conn(0x561945fa9560 msgr2=0x561945fb4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:39.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.516+0000 7f1b164a2740 1 -- 172.21.15.79:0/4027456795 shutdown_connections 2024-08-20T01:37:39.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.516+0000 7f1b164a2740 1 -- 172.21.15.79:0/4027456795 wait complete. 2024-08-20T01:37:39.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.516+0000 7f1b164a2740 1 -- start start 2024-08-20T01:37:39.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.516+0000 7f1b164a2740 1 Processor -- start 2024-08-20T01:37:39.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.517+0000 7f1b164a2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561945fab730 0x561945fcd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:39.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.517+0000 7f1b164a2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561945fac050 0x561945fb1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:39.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.517+0000 7f1b164a2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561945fbc3f0 0x561945fb24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:39.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.517+0000 7f1b164a2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1af000f840 con 0x561945fac050 2024-08-20T01:37:39.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.517+0000 7f1b164a2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1af000f170 con 0x561945fbc3f0 2024-08-20T01:37:39.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.517+0000 7f1b164a2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1af000c3b0 con 0x561945fab730 2024-08-20T01:37:39.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.517+0000 7f1b11644640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561945fac050 0x561945fb1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:39.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.517+0000 7f1b164a2740 10 client.0 _ll_register_callbacks cb 0x7f1afc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:39.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.517+0000 7f1b11644640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561945fac050 0x561945fb1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51776/0 (socket says 172.21.15.79:51776) 2024-08-20T01:37:39.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.517+0000 7f1b11644640 1 -- 172.21.15.79:0/4178433932 learned_addr learned my addr 172.21.15.79:0/4178433932 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:39.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.517+0000 7f1b12646640 1 --2- 172.21.15.79:0/4178433932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561945fab730 0x561945fcd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:39.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.517+0000 7f1b12646640 1 --2- 172.21.15.79:0/4178433932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561945fbc3f0 0x561945fb24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:39.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.517+0000 7f1b11644640 1 -- 172.21.15.79:0/4178433932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561945fab730 msgr2=0x561945fcd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:39.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.517+0000 7f1b11644640 1 --2- 172.21.15.79:0/4178433932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561945fab730 0x561945fcd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.517+0000 7f1b11644640 1 -- 172.21.15.79:0/4178433932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561945fbc3f0 msgr2=0x561945fb24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:39.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.517+0000 7f1b11644640 1 --2- 172.21.15.79:0/4178433932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561945fbc3f0 0x561945fb24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.517+0000 7f1b11644640 1 -- 172.21.15.79:0/4178433932 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561945fb2ce0 con 0x561945fac050 2024-08-20T01:37:39.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.517+0000 7f1b12646640 1 --2- 172.21.15.79:0/4178433932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561945fbc3f0 0x561945fb24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:37:39.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.517+0000 7f1b11644640 1 --2- 172.21.15.79:0/4178433932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561945fac050 0x561945fb1f10 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f1afc005ab0 tx=0x7f1afc004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee118b6acb6dd444 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:39.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.517+0000 7f1af57fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:37:39.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.518+0000 7f1af57fa640 1 -- 172.21.15.79:0/4178433932 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1afc053070 con 0x561945fac050 2024-08-20T01:37:39.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.518+0000 7f1af57fa640 1 -- 172.21.15.79:0/4178433932 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f1afc0048c0 con 0x561945fac050 2024-08-20T01:37:39.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.518+0000 7f1b164a2740 1 -- 172.21.15.79:0/4178433932 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b04014050 con 0x561945fac050 2024-08-20T01:37:39.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.518+0000 7f1af57fa640 1 -- 172.21.15.79:0/4178433932 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1afc035040 con 0x561945fac050 2024-08-20T01:37:39.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.518+0000 7f1b164a2740 10 client.15579 fetch_fsmap learned FSMap version 28 2024-08-20T01:37:39.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.518+0000 7f1b164a2740 1 -- 172.21.15.79:0/4178433932 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56194603b510 con 0x561945fac050 2024-08-20T01:37:39.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.518+0000 7f1af57fa640 1 -- 172.21.15.79:0/4178433932 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b04014050 con 0x561945fac050 2024-08-20T01:37:39.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.518+0000 7f1af57fa640 1 -- 172.21.15.79:0/4178433932 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1afc003af0 con 0x561945fac050 2024-08-20T01:37:39.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.518+0000 7f1b164a2740 10 client.15579 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:37:39.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.518+0000 7f1b164a2740 10 client.15579 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:37:39.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.518+0000 7f1b164a2740 20 client.15579 populate_metadata read hostname 'smithi079' 2024-08-20T01:37:39.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.519+0000 7f1b164a2740 1 --2- 172.21.15.79:0/4178433932 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x56194603bc90 0x56194603e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:39.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.519+0000 7f1b164a2740 4 client.15579 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:37:39.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.519+0000 7f1b164a2740 1 -- 172.21.15.79:0/4178433932 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561945f20320 con 0x56194603bc90 2024-08-20T01:37:39.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.519+0000 7f1b12646640 1 --2- 172.21.15.79:0/4178433932 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x56194603bc90 0x56194603e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:39.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.519+0000 7f1b12646640 1 --2- 172.21.15.79:0/4178433932 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x56194603bc90 0x56194603e0b0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9a34cef6192e607a server_cookie=709d5fb5957946b9 in_seq=0 out_seq=0 2024-08-20T01:37:39.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.519+0000 7f1af57fa640 10 client.15579 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:37:39.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.520+0000 7f1af57fa640 1 -- 172.21.15.79:0/4178433932 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561945f20320 con 0x56194603bc90 2024-08-20T01:37:39.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.520+0000 7f1af57fa640 10 client.15579 handle_command_reply: tid=0 2024-08-20T01:37:39.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.520+0000 7f1b164a2740 1 client.15579 shutdown 2024-08-20T01:37:39.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.520+0000 7f1b164a2740 1 -- 172.21.15.79:0/4178433932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561945fac050 msgr2=0x561945fb1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:39.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.520+0000 7f1b164a2740 1 --2- 172.21.15.79:0/4178433932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561945fac050 0x561945fb1f10 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f1afc005ab0 tx=0x7f1afc004610 comp rx=0 tx=0).stop 2024-08-20T01:37:39.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.520+0000 7f1b164a2740 1 -- 172.21.15.79:0/4178433932 shutdown_connections 2024-08-20T01:37:39.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.520+0000 7f1b164a2740 1 --2- 172.21.15.79:0/4178433932 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x56194603bc90 0x56194603e0b0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.520+0000 7f1b164a2740 1 --2- 172.21.15.79:0/4178433932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561945fbc3f0 0x561945fb24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.520+0000 7f1af57fa640 0 client.15579 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:37:39.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.520+0000 7f1b164a2740 1 --2- 172.21.15.79:0/4178433932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561945fac050 0x561945fb1f10 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.520+0000 7f1b164a2740 1 --2- 172.21.15.79:0/4178433932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561945fab730 0x561945fcd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.520+0000 7f1b164a2740 1 -- 172.21.15.79:0/4178433932 >> 172.21.15.79:0/4178433932 conn(0x561945fa9560 msgr2=0x561945faa560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:39.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.520+0000 7f1b164a2740 1 -- 172.21.15.79:0/4178433932 shutdown_connections 2024-08-20T01:37:39.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.520+0000 7f1b164a2740 1 -- 172.21.15.79:0/4178433932 wait complete. 2024-08-20T01:37:39.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.520+0000 7f1b164a2740 20 client.15579 trim_cache size 0 max 16384 2024-08-20T01:37:39.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.521+0000 7f1b140a9640 1 -- 172.21.15.79:0/2161062757 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1af80b3c50 msgr2=0x7f1af80b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:39.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.521+0000 7f1b140a9640 1 --2- 172.21.15.79:0/2161062757 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1af80b3c50 0x7f1af80b6110 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1b080058c0 tx=0x7f1b080b3040 comp rx=0 tx=0).stop 2024-08-20T01:37:39.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.521+0000 7f1b140a9640 1 -- 172.21.15.79:0/2161062757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b0c102ab0 msgr2=0x7f1b0c198e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:39.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.521+0000 7f1b140a9640 1 --2- 172.21.15.79:0/2161062757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b0c102ab0 0x7f1b0c198e50 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f1b0800d950 tx=0x7f1b0800de10 comp rx=0 tx=0).stop 2024-08-20T01:37:39.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.521+0000 7f1b140a9640 1 -- 172.21.15.79:0/2161062757 shutdown_connections 2024-08-20T01:37:39.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.521+0000 7f1b140a9640 1 --2- 172.21.15.79:0/2161062757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b0c108e40 0x7f1b0c19e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.521+0000 7f1b140a9640 1 --2- 172.21.15.79:0/2161062757 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1af80b3c50 0x7f1af80b6110 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.521+0000 7f1b140a9640 1 --2- 172.21.15.79:0/2161062757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b0c1084c0 0x7f1b0c199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.522+0000 7f1b140a9640 1 --2- 172.21.15.79:0/2161062757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b0c102ab0 0x7f1b0c198e50 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:39.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.522+0000 7f1b140a9640 1 -- 172.21.15.79:0/2161062757 >> 172.21.15.79:0/2161062757 conn(0x7f1b0c0fe580 msgr2=0x7f1b0c100970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:39.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.522+0000 7f1b140a9640 1 -- 172.21.15.79:0/2161062757 shutdown_connections 2024-08-20T01:37:39.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:39.522+0000 7f1b140a9640 1 -- 172.21.15.79:0/2161062757 wait complete. 2024-08-20T01:37:40.170 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:39 smithi079 ceph-mon[18656]: pgmap v357: 97 pgs: 97 active+clean; 663 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 682 B/s wr, 12 op/s 2024-08-20T01:37:40.209 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T01:37:40.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:39 smithi081 ceph-mon[22209]: pgmap v357: 97 pgs: 97 active+clean; 663 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 682 B/s wr, 12 op/s 2024-08-20T01:37:40.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:39 smithi175 ceph-mon[22392]: pgmap v357: 97 pgs: 97 active+clean; 663 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 682 B/s wr, 12 op/s 2024-08-20T01:37:40.504 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:37:41.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.033+0000 7f554f6da640 1 -- 172.21.15.79:0/1822631977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5548101590 msgr2=0x7f5548101970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:41.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.033+0000 7f554f6da640 1 --2- 172.21.15.79:0/1822631977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5548101590 0x7f5548101970 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f5544009900 tx=0x7f554402a410 comp rx=0 tx=0).stop 2024-08-20T01:37:41.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.033+0000 7f554f6da640 1 -- 172.21.15.79:0/1822631977 shutdown_connections 2024-08-20T01:37:41.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.033+0000 7f554f6da640 1 --2- 172.21.15.79:0/1822631977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f554810cdf0 0x7f554810f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.033+0000 7f554f6da640 1 --2- 172.21.15.79:0/1822631977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5548101f40 0x7f554810c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.033+0000 7f554f6da640 1 --2- 172.21.15.79:0/1822631977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5548101590 0x7f5548101970 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.033+0000 7f554f6da640 1 -- 172.21.15.79:0/1822631977 >> 172.21.15.79:0/1822631977 conn(0x7f5548076bd0 msgr2=0x7f5548076fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:41.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.033+0000 7f554f6da640 1 -- 172.21.15.79:0/1822631977 shutdown_connections 2024-08-20T01:37:41.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.033+0000 7f554f6da640 1 -- 172.21.15.79:0/1822631977 wait complete. 2024-08-20T01:37:41.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.034+0000 7f554f6da640 1 Processor -- start 2024-08-20T01:37:41.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.034+0000 7f554f6da640 1 -- start start 2024-08-20T01:37:41.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.034+0000 7f554f6da640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5548101590 0x7f5548198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:41.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.035+0000 7f554f6da640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5548101f40 0x7f5548199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:41.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.035+0000 7f554f6da640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f554810cdf0 0x7f554819e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:41.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.035+0000 7f554f6da640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f55481129b0 con 0x7f554810cdf0 2024-08-20T01:37:41.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.035+0000 7f554f6da640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5548112830 con 0x7f5548101590 2024-08-20T01:37:41.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.035+0000 7f554f6da640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5548112b30 con 0x7f5548101f40 2024-08-20T01:37:41.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.035+0000 7f554dc77640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f554810cdf0 0x7f554819e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:41.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.035+0000 7f554dc77640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f554810cdf0 0x7f554819e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49808/0 (socket says 172.21.15.79:49808) 2024-08-20T01:37:41.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.035+0000 7f554dc77640 1 -- 172.21.15.79:0/3582007391 learned_addr learned my addr 172.21.15.79:0/3582007391 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:41.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.035+0000 7f554d476640 1 --2- 172.21.15.79:0/3582007391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5548101590 0x7f5548198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:41.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.035+0000 7f554cc75640 1 --2- 172.21.15.79:0/3582007391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5548101f40 0x7f5548199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:41.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.035+0000 7f554d476640 1 -- 172.21.15.79:0/3582007391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5548101f40 msgr2=0x7f5548199420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:41.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.035+0000 7f554d476640 1 --2- 172.21.15.79:0/3582007391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5548101f40 0x7f5548199420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.035+0000 7f554d476640 1 -- 172.21.15.79:0/3582007391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f554810cdf0 msgr2=0x7f554819e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:41.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.035+0000 7f554d476640 1 --2- 172.21.15.79:0/3582007391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f554810cdf0 0x7f554819e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.035+0000 7f554d476640 1 -- 172.21.15.79:0/3582007391 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f554819ef90 con 0x7f5548101590 2024-08-20T01:37:41.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.036+0000 7f554d476640 1 --2- 172.21.15.79:0/3582007391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5548101590 0x7f5548198ee0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5544005940 tx=0x7f55440042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:41.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.036+0000 7f553e7fc640 1 -- 172.21.15.79:0/3582007391 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554403f070 con 0x7f5548101590 2024-08-20T01:37:41.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.036+0000 7f554f6da640 1 -- 172.21.15.79:0/3582007391 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f554819f220 con 0x7f5548101590 2024-08-20T01:37:41.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.036+0000 7f554f6da640 1 -- 172.21.15.79:0/3582007391 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5548102440 con 0x7f5548101590 2024-08-20T01:37:41.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.036+0000 7f553e7fc640 1 -- 172.21.15.79:0/3582007391 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f554403b460 con 0x7f5548101590 2024-08-20T01:37:41.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.036+0000 7f553e7fc640 1 -- 172.21.15.79:0/3582007391 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5544035070 con 0x7f5548101590 2024-08-20T01:37:41.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.039+0000 7f553e7fc640 1 -- 172.21.15.79:0/3582007391 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f554403a620 con 0x7f5548101590 2024-08-20T01:37:41.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.039+0000 7f5551ad3740 1 Processor -- start 2024-08-20T01:37:41.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.040+0000 7f5551ad3740 1 -- start start 2024-08-20T01:37:41.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.040+0000 7f5551ad3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55626effb880 0x55626effbc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:41.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.040+0000 7f5551ad3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626effc1a0 0x55626f007bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:41.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.040+0000 7f5551ad3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55626f008130 0x55626f00a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:41.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.040+0000 7f5551ad3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55626ef72930 con 0x55626f008130 2024-08-20T01:37:41.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.040+0000 7f5551ad3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55626ef61e30 con 0x55626effc1a0 2024-08-20T01:37:41.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.040+0000 7f5551ad3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55626ef65e70 con 0x55626effb880 2024-08-20T01:37:41.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.040+0000 7f554cc75640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55626f008130 0x55626f00a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:41.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.040+0000 7f554cc75640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55626f008130 0x55626f00a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49810/0 (socket says 172.21.15.79:49810) 2024-08-20T01:37:41.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.040+0000 7f554cc75640 1 -- 172.21.15.79:0/1392687964 learned_addr learned my addr 172.21.15.79:0/1392687964 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:41.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.040+0000 7f554dc77640 1 --2- 172.21.15.79:0/1392687964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55626effb880 0x55626effbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:41.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.040+0000 7f554d476640 1 --2- 172.21.15.79:0/1392687964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626effc1a0 0x55626f007bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:41.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.041+0000 7f554cc75640 1 -- 172.21.15.79:0/1392687964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55626effb880 msgr2=0x55626effbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:41.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.041+0000 7f554cc75640 1 --2- 172.21.15.79:0/1392687964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55626effb880 0x55626effbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.041+0000 7f554cc75640 1 -- 172.21.15.79:0/1392687964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626effc1a0 msgr2=0x55626f007bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:41.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.041+0000 7f554cc75640 1 --2- 172.21.15.79:0/1392687964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626effc1a0 0x55626f007bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.041+0000 7f553e7fc640 1 --2- 172.21.15.79:0/3582007391 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f55340b3c50 0x7f55340b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:41.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.041+0000 7f554cc75640 1 -- 172.21.15.79:0/1392687964 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55626ecc1650 con 0x55626f008130 2024-08-20T01:37:41.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.041+0000 7f554dc77640 1 --2- 172.21.15.79:0/3582007391 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f55340b3c50 0x7f55340b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:41.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.041+0000 7f553e7fc640 1 -- 172.21.15.79:0/3582007391 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f5544103d10 con 0x7f5548101590 2024-08-20T01:37:41.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.041+0000 7f554cc75640 1 --2- 172.21.15.79:0/1392687964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55626f008130 0x55626f00a520 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f5538009a30 tx=0x7f5538009ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78b97ca550687c6b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:41.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.041+0000 7f55337fe640 1 -- 172.21.15.79:0/1392687964 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5538017070 con 0x55626f008130 2024-08-20T01:37:41.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.041+0000 7f55337fe640 1 -- 172.21.15.79:0/1392687964 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5538013470 con 0x55626f008130 2024-08-20T01:37:41.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.041+0000 7f55337fe640 1 -- 172.21.15.79:0/1392687964 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5538012630 con 0x55626f008130 2024-08-20T01:37:41.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.042+0000 7f5551ad3740 1 -- 172.21.15.79:0/1392687964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55626f008130 msgr2=0x55626f00a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:41.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.042+0000 7f554dc77640 1 --2- 172.21.15.79:0/3582007391 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f55340b3c50 0x7f55340b6110 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5540010480 tx=0x7f55400075e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:41.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.042+0000 7f5551ad3740 1 --2- 172.21.15.79:0/1392687964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55626f008130 0x55626f00a520 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f5538009a30 tx=0x7f5538009ef0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.042+0000 7f5551ad3740 1 -- 172.21.15.79:0/1392687964 shutdown_connections 2024-08-20T01:37:41.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.042+0000 7f5551ad3740 1 --2- 172.21.15.79:0/1392687964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55626f008130 0x55626f00a520 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.042+0000 7f5551ad3740 1 --2- 172.21.15.79:0/1392687964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626effc1a0 0x55626f007bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.042+0000 7f5551ad3740 1 --2- 172.21.15.79:0/1392687964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55626effb880 0x55626effbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.042+0000 7f5551ad3740 1 -- 172.21.15.79:0/1392687964 >> 172.21.15.79:0/1392687964 conn(0x55626eff96b0 msgr2=0x55626effa850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:41.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.042+0000 7f5551ad3740 1 -- 172.21.15.79:0/1392687964 shutdown_connections 2024-08-20T01:37:41.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.042+0000 7f5551ad3740 1 -- 172.21.15.79:0/1392687964 wait complete. 2024-08-20T01:37:41.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.043+0000 7f5551ad3740 1 -- start start 2024-08-20T01:37:41.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.043+0000 7f5551ad3740 1 Processor -- start 2024-08-20T01:37:41.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.043+0000 7f5551ad3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626effb880 0x55626f0050a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:41.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.043+0000 7f5551ad3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55626effc1a0 0x55626f0055e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:41.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.044+0000 7f5551ad3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55626f008130 0x55626f005b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:41.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.044+0000 7f5551ad3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55626edc4700 con 0x55626f008130 2024-08-20T01:37:41.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.044+0000 7f5551ad3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55626eee8810 con 0x55626effb880 2024-08-20T01:37:41.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.044+0000 7f5551ad3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55626f00ade0 con 0x55626effc1a0 2024-08-20T01:37:41.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.044+0000 7f5551ad3740 10 client.0 _ll_register_callbacks cb 0x55626ef5b700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:41.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.044+0000 7f554dc77640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55626f008130 0x55626f005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:41.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.044+0000 7f554d476640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626effb880 0x55626f0050a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:41.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.044+0000 7f554d476640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626effb880 0x55626f0050a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:37564/0 (socket says 172.21.15.79:37564) 2024-08-20T01:37:41.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.044+0000 7f554dc77640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55626f008130 0x55626f005b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49820/0 (socket says 172.21.15.79:49820) 2024-08-20T01:37:41.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.044+0000 7f554d476640 1 -- 172.21.15.79:0/2671800783 learned_addr learned my addr 172.21.15.79:0/2671800783 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:41.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.044+0000 7f554cc75640 1 --2- 172.21.15.79:0/2671800783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55626effc1a0 0x55626f0055e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:41.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.044+0000 7f554dc77640 1 -- 172.21.15.79:0/2671800783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55626effc1a0 msgr2=0x55626f0055e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:41.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.044+0000 7f554dc77640 1 --2- 172.21.15.79:0/2671800783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55626effc1a0 0x55626f0055e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.044+0000 7f554dc77640 1 -- 172.21.15.79:0/2671800783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626effb880 msgr2=0x55626f0050a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:41.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.044+0000 7f554dc77640 1 --2- 172.21.15.79:0/2671800783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626effb880 0x55626f0050a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.044+0000 7f554dc77640 1 -- 172.21.15.79:0/2671800783 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55626f0141f0 con 0x55626f008130 2024-08-20T01:37:41.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.044+0000 7f554dc77640 1 --2- 172.21.15.79:0/2671800783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55626f008130 0x55626f005b20 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f5540010dd0 tx=0x7f5540004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bea831bd2e30172 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:41.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.044+0000 7f5530ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:37:41.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.045+0000 7f5530ff9640 1 -- 172.21.15.79:0/2671800783 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554002b060 con 0x55626f008130 2024-08-20T01:37:41.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.045+0000 7f5551ad3740 1 -- 172.21.15.79:0/2671800783 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55626ef11150 con 0x55626f008130 2024-08-20T01:37:41.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.045+0000 7f5530ff9640 1 -- 172.21.15.79:0/2671800783 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f5540016030 con 0x55626f008130 2024-08-20T01:37:41.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.045+0000 7f5530ff9640 1 -- 172.21.15.79:0/2671800783 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5540026410 con 0x55626f008130 2024-08-20T01:37:41.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.045+0000 7f5551ad3740 10 client.15591 fetch_fsmap learned FSMap version 28 2024-08-20T01:37:41.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.045+0000 7f5551ad3740 1 -- 172.21.15.79:0/2671800783 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55626f016c80 con 0x55626f008130 2024-08-20T01:37:41.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.045+0000 7f5530ff9640 1 -- 172.21.15.79:0/2671800783 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5540026a40 con 0x55626f008130 2024-08-20T01:37:41.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.045+0000 7f5530ff9640 1 -- 172.21.15.79:0/2671800783 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f554001b6f0 con 0x55626f008130 2024-08-20T01:37:41.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.045+0000 7f5551ad3740 10 client.15591 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:37:41.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.045+0000 7f5551ad3740 10 client.15591 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:37:41.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.045+0000 7f5551ad3740 20 client.15591 populate_metadata read hostname 'smithi079' 2024-08-20T01:37:41.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.045+0000 7f5551ad3740 1 --2- 172.21.15.79:0/2671800783 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55626f018300 0x55626f01a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:41.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.045+0000 7f5551ad3740 4 client.15591 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:37:41.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.045+0000 7f5551ad3740 1 -- 172.21.15.79:0/2671800783 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55626ef11150 con 0x55626f018300 2024-08-20T01:37:41.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.046+0000 7f554d476640 1 --2- 172.21.15.79:0/2671800783 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55626f018300 0x55626f01a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:41.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.046+0000 7f554d476640 1 --2- 172.21.15.79:0/2671800783 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55626f018300 0x55626f01a740 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac1b597d3eb592dc server_cookie=f791ed66bcae24db in_seq=0 out_seq=0 2024-08-20T01:37:41.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.046+0000 7f5530ff9640 10 client.15591 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:37:41.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.047+0000 7f5530ff9640 1 -- 172.21.15.79:0/2671800783 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55626ef11150 con 0x55626f018300 2024-08-20T01:37:41.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.047+0000 7f5530ff9640 10 client.15591 handle_command_reply: tid=0 2024-08-20T01:37:41.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.047+0000 7f5551ad3740 1 client.15591 shutdown 2024-08-20T01:37:41.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.047+0000 7f5551ad3740 1 -- 172.21.15.79:0/2671800783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55626f008130 msgr2=0x55626f005b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:41.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.047+0000 7f5551ad3740 1 --2- 172.21.15.79:0/2671800783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55626f008130 0x55626f005b20 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f5540010dd0 tx=0x7f5540004ab0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.047+0000 7f5551ad3740 1 -- 172.21.15.79:0/2671800783 shutdown_connections 2024-08-20T01:37:41.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.047+0000 7f5551ad3740 1 --2- 172.21.15.79:0/2671800783 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55626f018300 0x55626f01a740 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.047+0000 7f5551ad3740 1 --2- 172.21.15.79:0/2671800783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55626f008130 0x55626f005b20 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.047+0000 7f5551ad3740 1 --2- 172.21.15.79:0/2671800783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55626effc1a0 0x55626f0055e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.047+0000 7f5551ad3740 1 --2- 172.21.15.79:0/2671800783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626effb880 0x55626f0050a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.047+0000 7f5551ad3740 1 -- 172.21.15.79:0/2671800783 >> 172.21.15.79:0/2671800783 conn(0x55626eff96b0 msgr2=0x55626efff250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:41.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.047+0000 7f5530ff9640 0 client.15591 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:37:41.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.047+0000 7f5551ad3740 1 -- 172.21.15.79:0/2671800783 shutdown_connections 2024-08-20T01:37:41.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.047+0000 7f5551ad3740 1 -- 172.21.15.79:0/2671800783 wait complete. 2024-08-20T01:37:41.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.047+0000 7f5551ad3740 20 client.15591 trim_cache size 0 max 16384 2024-08-20T01:37:41.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.060+0000 7f5551ad3740 1 Processor -- start 2024-08-20T01:37:41.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.060+0000 7f5551ad3740 1 -- start start 2024-08-20T01:37:41.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.061+0000 7f5551ad3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626effb880 0x55626efff8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:41.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.061+0000 7f5551ad3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55626effc1a0 0x55626f020010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:41.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.061+0000 7f5551ad3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55626f008130 0x55626f020550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:41.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.061+0000 7f5551ad3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f552c00e430 con 0x55626effc1a0 2024-08-20T01:37:41.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.061+0000 7f554cc75640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55626effc1a0 0x55626f020010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:41.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.061+0000 7f5551ad3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f552c00ff70 con 0x55626effb880 2024-08-20T01:37:41.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.061+0000 7f5551ad3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f552c00eb00 con 0x55626f008130 2024-08-20T01:37:41.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.061+0000 7f554cc75640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55626effc1a0 0x55626f020010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49832/0 (socket says 172.21.15.79:49832) 2024-08-20T01:37:41.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.061+0000 7f554cc75640 1 -- 172.21.15.79:0/4227206488 learned_addr learned my addr 172.21.15.79:0/4227206488 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:41.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.061+0000 7f554d476640 1 --2- 172.21.15.79:0/4227206488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626effb880 0x55626efff8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:41.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.061+0000 7f554dc77640 1 --2- 172.21.15.79:0/4227206488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55626f008130 0x55626f020550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:41.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.061+0000 7f554d476640 1 -- 172.21.15.79:0/4227206488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55626f008130 msgr2=0x55626f020550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:41.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.061+0000 7f554d476640 1 --2- 172.21.15.79:0/4227206488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55626f008130 0x55626f020550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.061+0000 7f554d476640 1 -- 172.21.15.79:0/4227206488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55626effc1a0 msgr2=0x55626f020010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:41.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.061+0000 7f554d476640 1 --2- 172.21.15.79:0/4227206488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55626effc1a0 0x55626f020010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.061+0000 7f554d476640 1 -- 172.21.15.79:0/4227206488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55626f0035a0 con 0x55626effb880 2024-08-20T01:37:41.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.061+0000 7f554cc75640 1 --2- 172.21.15.79:0/4227206488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55626effc1a0 0x55626f020010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:37:41.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.061+0000 7f554d476640 1 --2- 172.21.15.79:0/4227206488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626effb880 0x55626efff8f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5544033000 tx=0x7f55441077f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d483ad784fd838cf server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:41.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.062+0000 7f5532ffd640 1 -- 172.21.15.79:0/4227206488 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5544048040 con 0x55626effb880 2024-08-20T01:37:41.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.062+0000 7f5532ffd640 1 -- 172.21.15.79:0/4227206488 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f55440ca780 con 0x55626effb880 2024-08-20T01:37:41.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.062+0000 7f5532ffd640 1 -- 172.21.15.79:0/4227206488 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55440ed040 con 0x55626effb880 2024-08-20T01:37:41.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.062+0000 7f5551ad3740 1 -- 172.21.15.79:0/4227206488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626effb880 msgr2=0x55626efff8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:41.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.062+0000 7f5551ad3740 1 --2- 172.21.15.79:0/4227206488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626effb880 0x55626efff8f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5544033000 tx=0x7f55441077f0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.062+0000 7f5551ad3740 1 -- 172.21.15.79:0/4227206488 shutdown_connections 2024-08-20T01:37:41.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.062+0000 7f5551ad3740 1 --2- 172.21.15.79:0/4227206488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55626f008130 0x55626f020550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.062+0000 7f5551ad3740 1 --2- 172.21.15.79:0/4227206488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55626effc1a0 0x55626f020010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.062+0000 7f5551ad3740 1 --2- 172.21.15.79:0/4227206488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626effb880 0x55626efff8f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.062+0000 7f5551ad3740 1 -- 172.21.15.79:0/4227206488 >> 172.21.15.79:0/4227206488 conn(0x55626eff96b0 msgr2=0x55626f0002e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:41.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.062+0000 7f5551ad3740 1 -- 172.21.15.79:0/4227206488 shutdown_connections 2024-08-20T01:37:41.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.063+0000 7f5551ad3740 1 -- 172.21.15.79:0/4227206488 wait complete. 2024-08-20T01:37:41.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.063+0000 7f5551ad3740 1 -- start start 2024-08-20T01:37:41.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.063+0000 7f5551ad3740 1 Processor -- start 2024-08-20T01:37:41.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.063+0000 7f5551ad3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626effb880 0x55626f00b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:41.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.063+0000 7f5551ad3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55626effc1a0 0x55626f00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:41.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.063+0000 7f5551ad3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55626f008130 0x55626f080fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:41.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.063+0000 7f5551ad3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f552c00f8a0 con 0x55626effc1a0 2024-08-20T01:37:41.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.063+0000 7f5551ad3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f552c00f1d0 con 0x55626effb880 2024-08-20T01:37:41.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.063+0000 7f5551ad3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f552c00c410 con 0x55626f008130 2024-08-20T01:37:41.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.063+0000 7f5551ad3740 10 client.0 _ll_register_callbacks cb 0x7f5540007d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:41.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.063+0000 7f554cc75640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55626effc1a0 0x55626f00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:41.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.064+0000 7f554cc75640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55626effc1a0 0x55626f00ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49848/0 (socket says 172.21.15.79:49848) 2024-08-20T01:37:41.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.064+0000 7f554cc75640 1 -- 172.21.15.79:0/82713158 learned_addr learned my addr 172.21.15.79:0/82713158 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:41.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.064+0000 7f554d476640 1 --2- 172.21.15.79:0/82713158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626effb880 0x55626f00b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:41.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.064+0000 7f554dc77640 1 --2- 172.21.15.79:0/82713158 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55626f008130 0x55626f080fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:41.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.064+0000 7f554cc75640 1 -- 172.21.15.79:0/82713158 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55626f008130 msgr2=0x55626f080fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:41.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.064+0000 7f554cc75640 1 --2- 172.21.15.79:0/82713158 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55626f008130 0x55626f080fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.064+0000 7f554cc75640 1 -- 172.21.15.79:0/82713158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626effb880 msgr2=0x55626f00b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:41.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.064+0000 7f554cc75640 1 --2- 172.21.15.79:0/82713158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626effb880 0x55626f00b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.064+0000 7f554cc75640 1 -- 172.21.15.79:0/82713158 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55626f081510 con 0x55626effc1a0 2024-08-20T01:37:41.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.064+0000 7f554d476640 1 --2- 172.21.15.79:0/82713158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626effb880 0x55626f00b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:37:41.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.064+0000 7f554cc75640 1 --2- 172.21.15.79:0/82713158 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55626effc1a0 0x55626f00ba30 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f5538013e80 tx=0x7f55380047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bee294a11f906c2d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:41.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.064+0000 7f5530ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:37:41.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.064+0000 7f5530ff9640 1 -- 172.21.15.79:0/82713158 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5538029060 con 0x55626effc1a0 2024-08-20T01:37:41.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.064+0000 7f5530ff9640 1 -- 172.21.15.79:0/82713158 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f5538013880 con 0x55626effc1a0 2024-08-20T01:37:41.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.064+0000 7f5551ad3740 1 -- 172.21.15.79:0/82713158 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55440ca780 con 0x55626effc1a0 2024-08-20T01:37:41.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.065+0000 7f5530ff9640 1 -- 172.21.15.79:0/82713158 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5538017040 con 0x55626effc1a0 2024-08-20T01:37:41.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.065+0000 7f5551ad3740 10 client.15597 fetch_fsmap learned FSMap version 28 2024-08-20T01:37:41.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.065+0000 7f5551ad3740 1 -- 172.21.15.79:0/82713158 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55626f082770 con 0x55626effc1a0 2024-08-20T01:37:41.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.065+0000 7f5530ff9640 1 -- 172.21.15.79:0/82713158 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f55440ca780 con 0x55626effc1a0 2024-08-20T01:37:41.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.065+0000 7f5530ff9640 1 -- 172.21.15.79:0/82713158 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f553802f3d0 con 0x55626effc1a0 2024-08-20T01:37:41.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.065+0000 7f5551ad3740 10 client.15597 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:37:41.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.065+0000 7f5551ad3740 10 client.15597 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:37:41.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.065+0000 7f5551ad3740 20 client.15597 populate_metadata read hostname 'smithi079' 2024-08-20T01:37:41.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.065+0000 7f5551ad3740 1 --2- 172.21.15.79:0/82713158 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55626f082c10 0x55626f085030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:41.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.065+0000 7f5551ad3740 4 client.15597 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:37:41.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.065+0000 7f5551ad3740 1 -- 172.21.15.79:0/82713158 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55626ef74880 con 0x55626f082c10 2024-08-20T01:37:41.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.066+0000 7f554d476640 1 --2- 172.21.15.79:0/82713158 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55626f082c10 0x55626f085030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:41.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.066+0000 7f554d476640 1 --2- 172.21.15.79:0/82713158 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55626f082c10 0x55626f085030 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22159867673b6908 server_cookie=9d759fc0b4c4297 in_seq=0 out_seq=0 2024-08-20T01:37:41.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.066+0000 7f5530ff9640 10 client.15597 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:37:41.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.066+0000 7f5530ff9640 1 -- 172.21.15.79:0/82713158 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55626ef74880 con 0x55626f082c10 2024-08-20T01:37:41.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.066+0000 7f5530ff9640 10 client.15597 handle_command_reply: tid=0 2024-08-20T01:37:41.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.066+0000 7f5551ad3740 1 client.15597 shutdown 2024-08-20T01:37:41.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.066+0000 7f5551ad3740 1 -- 172.21.15.79:0/82713158 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55626effc1a0 msgr2=0x55626f00ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:41.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.066+0000 7f5551ad3740 1 --2- 172.21.15.79:0/82713158 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55626effc1a0 0x55626f00ba30 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f5538013e80 tx=0x7f55380047d0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.066+0000 7f5551ad3740 1 -- 172.21.15.79:0/82713158 shutdown_connections 2024-08-20T01:37:41.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.066+0000 7f5551ad3740 1 --2- 172.21.15.79:0/82713158 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55626f082c10 0x55626f085030 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.066+0000 7f5551ad3740 1 --2- 172.21.15.79:0/82713158 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55626f008130 0x55626f080fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.066+0000 7f5551ad3740 1 --2- 172.21.15.79:0/82713158 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55626effc1a0 0x55626f00ba30 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.066+0000 7f5551ad3740 1 --2- 172.21.15.79:0/82713158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626effb880 0x55626f00b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.066+0000 7f5551ad3740 1 -- 172.21.15.79:0/82713158 >> 172.21.15.79:0/82713158 conn(0x55626eff96b0 msgr2=0x55626f0066d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:41.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.066+0000 7f5530ff9640 0 client.15597 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:37:41.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.067+0000 7f5551ad3740 1 -- 172.21.15.79:0/82713158 shutdown_connections 2024-08-20T01:37:41.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.067+0000 7f5551ad3740 1 -- 172.21.15.79:0/82713158 wait complete. 2024-08-20T01:37:41.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.067+0000 7f5551ad3740 20 client.15597 trim_cache size 0 max 16384 2024-08-20T01:37:41.076 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:37:41.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.067+0000 7f554f6da640 1 -- 172.21.15.79:0/3582007391 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f55340b3c50 msgr2=0x7f55340b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:41.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.067+0000 7f554f6da640 1 --2- 172.21.15.79:0/3582007391 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f55340b3c50 0x7f55340b6110 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5540010480 tx=0x7f55400075e0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.067+0000 7f554f6da640 1 -- 172.21.15.79:0/3582007391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5548101590 msgr2=0x7f5548198ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:41.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.067+0000 7f554f6da640 1 --2- 172.21.15.79:0/3582007391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5548101590 0x7f5548198ee0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5544005940 tx=0x7f55440042f0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.068+0000 7f554f6da640 1 -- 172.21.15.79:0/3582007391 shutdown_connections 2024-08-20T01:37:41.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.068+0000 7f554f6da640 1 --2- 172.21.15.79:0/3582007391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f554810cdf0 0x7f554819e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.068+0000 7f554f6da640 1 --2- 172.21.15.79:0/3582007391 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f55340b3c50 0x7f55340b6110 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.068+0000 7f554f6da640 1 --2- 172.21.15.79:0/3582007391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5548101f40 0x7f5548199420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.068+0000 7f554f6da640 1 --2- 172.21.15.79:0/3582007391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5548101590 0x7f5548198ee0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:41.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.068+0000 7f554f6da640 1 -- 172.21.15.79:0/3582007391 >> 172.21.15.79:0/3582007391 conn(0x7f5548076bd0 msgr2=0x7f55480ff6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:41.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.068+0000 7f554f6da640 1 -- 172.21.15.79:0/3582007391 shutdown_connections 2024-08-20T01:37:41.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:41.068+0000 7f554f6da640 1 -- 172.21.15.79:0/3582007391 wait complete. 2024-08-20T01:37:42.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:41 smithi081 ceph-mon[22209]: pgmap v358: 97 pgs: 97 active+clean; 663 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-20T01:37:42.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:41 smithi175 ceph-mon[22392]: pgmap v358: 97 pgs: 97 active+clean; 663 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-20T01:37:42.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:41 smithi079 ceph-mon[18656]: pgmap v358: 97 pgs: 97 active+clean; 663 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-20T01:37:42.824 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T01:37:42.824 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T01:37:43.170 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:37:43.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.644+0000 7f48d6821640 1 -- 172.21.15.79:0/4060172857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48d0107d60 msgr2=0x7f48d010e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:43.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.644+0000 7f48d6821640 1 --2- 172.21.15.79:0/4060172857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48d0107d60 0x7f48d010e560 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f48c8009ca0 tx=0x7f48c802a8c0 comp rx=0 tx=0).stop 2024-08-20T01:37:43.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.644+0000 7f48d6821640 1 -- 172.21.15.79:0/4060172857 shutdown_connections 2024-08-20T01:37:43.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.644+0000 7f48d6821640 1 --2- 172.21.15.79:0/4060172857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48d0107d60 0x7f48d010e560 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:43.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.644+0000 7f48d6821640 1 --2- 172.21.15.79:0/4060172857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48d01073e0 0x7f48d0107820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:43.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.644+0000 7f48d6821640 1 --2- 172.21.15.79:0/4060172857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48d01019d0 0x7f48d0101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:43.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.644+0000 7f48d6821640 1 -- 172.21.15.79:0/4060172857 >> 172.21.15.79:0/4060172857 conn(0x7f48d00fd460 msgr2=0x7f48d00ff880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:43.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.644+0000 7f48d6821640 1 -- 172.21.15.79:0/4060172857 shutdown_connections 2024-08-20T01:37:43.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.644+0000 7f48d6821640 1 -- 172.21.15.79:0/4060172857 wait complete. 2024-08-20T01:37:43.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.644+0000 7f48d6821640 1 Processor -- start 2024-08-20T01:37:43.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.644+0000 7f48d6821640 1 -- start start 2024-08-20T01:37:43.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.645+0000 7f48d6821640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48d01019d0 0x7f48d0198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:43.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.645+0000 7f48d6821640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48d01073e0 0x7f48d01993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:43.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.645+0000 7f48d6821640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48d0107d60 0x7f48d019e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:43.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.645+0000 7f48d6821640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f48d0112a20 con 0x7f48d01073e0 2024-08-20T01:37:43.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.645+0000 7f48d6821640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f48d01128a0 con 0x7f48d01019d0 2024-08-20T01:37:43.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.645+0000 7f48d6821640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f48d0112ba0 con 0x7f48d0107d60 2024-08-20T01:37:43.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.645+0000 7f48cf7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48d01073e0 0x7f48d01993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:43.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.645+0000 7f48cf7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48d01073e0 0x7f48d01993b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49856/0 (socket says 172.21.15.79:49856) 2024-08-20T01:37:43.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.645+0000 7f48cf7fe640 1 -- 172.21.15.79:0/959782901 learned_addr learned my addr 172.21.15.79:0/959782901 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:43.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.645+0000 7f48d4dbe640 1 --2- 172.21.15.79:0/959782901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48d0107d60 0x7f48d019e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:43.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.645+0000 7f48cffff640 1 --2- 172.21.15.79:0/959782901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48d01019d0 0x7f48d0198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:43.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.645+0000 7f48cf7fe640 1 -- 172.21.15.79:0/959782901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48d0107d60 msgr2=0x7f48d019e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:43.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.645+0000 7f48cf7fe640 1 --2- 172.21.15.79:0/959782901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48d0107d60 0x7f48d019e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:43.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.645+0000 7f48cf7fe640 1 -- 172.21.15.79:0/959782901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48d01019d0 msgr2=0x7f48d0198e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:43.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.645+0000 7f48cf7fe640 1 --2- 172.21.15.79:0/959782901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48d01019d0 0x7f48d0198e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:43.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.645+0000 7f48cf7fe640 1 -- 172.21.15.79:0/959782901 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d019ef20 con 0x7f48d01073e0 2024-08-20T01:37:43.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.645+0000 7f48d4dbe640 1 --2- 172.21.15.79:0/959782901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48d0107d60 0x7f48d019e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:37:43.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.646+0000 7f48cf7fe640 1 --2- 172.21.15.79:0/959782901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48d01073e0 0x7f48d01993b0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f48c400d950 tx=0x7f48c400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:43.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.646+0000 7f48cd7fa640 1 -- 172.21.15.79:0/959782901 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c4017070 con 0x7f48d01073e0 2024-08-20T01:37:43.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.646+0000 7f48d6821640 1 -- 172.21.15.79:0/959782901 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48d019f210 con 0x7f48d01073e0 2024-08-20T01:37:43.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.646+0000 7f48cd7fa640 1 -- 172.21.15.79:0/959782901 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f48c4009c30 con 0x7f48d01073e0 2024-08-20T01:37:43.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.646+0000 7f48cd7fa640 1 -- 172.21.15.79:0/959782901 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c400f620 con 0x7f48d01073e0 2024-08-20T01:37:43.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.646+0000 7f48d6821640 1 -- 172.21.15.79:0/959782901 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48d01a5aa0 con 0x7f48d01073e0 2024-08-20T01:37:43.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.649+0000 7f48cd7fa640 1 -- 172.21.15.79:0/959782901 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f48c4010460 con 0x7f48d01073e0 2024-08-20T01:37:43.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.649+0000 7f48cd7fa640 1 --2- 172.21.15.79:0/959782901 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f48b80b3bd0 0x7f48b80b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:43.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.649+0000 7f48d8c1a740 1 Processor -- start 2024-08-20T01:37:43.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.649+0000 7f48d8c1a740 1 -- start start 2024-08-20T01:37:43.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.649+0000 7f48cffff640 1 --2- 172.21.15.79:0/959782901 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f48b80b3bd0 0x7f48b80b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:43.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.649+0000 7f48cd7fa640 1 -- 172.21.15.79:0/959782901 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f48c40e3240 con 0x7f48d01073e0 2024-08-20T01:37:43.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.650+0000 7f48d8c1a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603e92343b0 0x5603e9234790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:43.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.650+0000 7f48d8c1a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603e9234cd0 0x5603e9240720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:43.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.650+0000 7f48d8c1a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603e9240c60 0x5603e9243050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:43.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.650+0000 7f48d8c1a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5603e91aa940 con 0x5603e9240c60 2024-08-20T01:37:43.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.650+0000 7f48d8c1a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5603e9199e40 con 0x5603e92343b0 2024-08-20T01:37:43.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.650+0000 7f48d8c1a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5603e919de80 con 0x5603e9234cd0 2024-08-20T01:37:43.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.650+0000 7f48d4dbe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603e9240c60 0x5603e9243050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:43.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.650+0000 7f48d4dbe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603e9240c60 0x5603e9243050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49870/0 (socket says 172.21.15.79:49870) 2024-08-20T01:37:43.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.650+0000 7f48d4dbe640 1 -- 172.21.15.79:0/573201101 learned_addr learned my addr 172.21.15.79:0/573201101 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:43.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.650+0000 7f48cf7fe640 1 --2- 172.21.15.79:0/573201101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603e9234cd0 0x5603e9240720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:43.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.650+0000 7f48cffff640 1 --2- 172.21.15.79:0/573201101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603e92343b0 0x5603e9234790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:43.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.650+0000 7f48d4dbe640 1 -- 172.21.15.79:0/573201101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603e9234cd0 msgr2=0x5603e9240720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:43.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.650+0000 7f48d4dbe640 1 --2- 172.21.15.79:0/573201101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603e9234cd0 0x5603e9240720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:43.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.650+0000 7f48d4dbe640 1 -- 172.21.15.79:0/573201101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603e92343b0 msgr2=0x5603e9234790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:43.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.650+0000 7f48cffff640 1 --2- 172.21.15.79:0/959782901 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f48b80b3bd0 0x7f48b80b6090 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f48c00058c0 tx=0x7f48c000af00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:43.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.650+0000 7f48d4dbe640 1 --2- 172.21.15.79:0/573201101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603e92343b0 0x5603e9234790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:43.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.650+0000 7f48d4dbe640 1 -- 172.21.15.79:0/573201101 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603e9136520 con 0x5603e9240c60 2024-08-20T01:37:43.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.650+0000 7f48d4dbe640 1 --2- 172.21.15.79:0/573201101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603e9240c60 0x5603e9243050 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f48c8031630 tx=0x7f48c8031660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad8a1f1c57db52f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:43.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.651+0000 7f48b67fc640 1 -- 172.21.15.79:0/573201101 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c8031b80 con 0x5603e9240c60 2024-08-20T01:37:43.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.651+0000 7f48b67fc640 1 -- 172.21.15.79:0/573201101 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f48c8040070 con 0x5603e9240c60 2024-08-20T01:37:43.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.651+0000 7f48b67fc640 1 -- 172.21.15.79:0/573201101 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c8004500 con 0x5603e9240c60 2024-08-20T01:37:43.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.651+0000 7f48d8c1a740 1 -- 172.21.15.79:0/573201101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603e9240c60 msgr2=0x5603e9243050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:43.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.651+0000 7f48d8c1a740 1 --2- 172.21.15.79:0/573201101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603e9240c60 0x5603e9243050 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f48c8031630 tx=0x7f48c8031660 comp rx=0 tx=0).stop 2024-08-20T01:37:43.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.652+0000 7f48d8c1a740 1 -- 172.21.15.79:0/573201101 shutdown_connections 2024-08-20T01:37:43.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.652+0000 7f48d8c1a740 1 --2- 172.21.15.79:0/573201101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603e9240c60 0x5603e9243050 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:43.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.652+0000 7f48d8c1a740 1 --2- 172.21.15.79:0/573201101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603e9234cd0 0x5603e9240720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:43.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.652+0000 7f48d8c1a740 1 --2- 172.21.15.79:0/573201101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603e92343b0 0x5603e9234790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:43.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.652+0000 7f48d8c1a740 1 -- 172.21.15.79:0/573201101 >> 172.21.15.79:0/573201101 conn(0x5603e92321e0 msgr2=0x5603e9233380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:43.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.652+0000 7f48d8c1a740 1 -- 172.21.15.79:0/573201101 shutdown_connections 2024-08-20T01:37:43.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.652+0000 7f48d8c1a740 1 -- 172.21.15.79:0/573201101 wait complete. 2024-08-20T01:37:43.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.652+0000 7f48d8c1a740 1 -- start start 2024-08-20T01:37:43.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.652+0000 7f48d8c1a740 1 Processor -- start 2024-08-20T01:37:43.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.653+0000 7f48d8c1a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603e92343b0 0x5603e923dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:43.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.653+0000 7f48d8c1a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603e9234cd0 0x5603e923e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:43.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.653+0000 7f48d8c1a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603e9240c60 0x5603e923e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:43.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.653+0000 7f48d8c1a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5603e8ffc890 con 0x5603e9240c60 2024-08-20T01:37:43.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.653+0000 7f48d8c1a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5603e9120700 con 0x5603e9234cd0 2024-08-20T01:37:43.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.653+0000 7f48d8c1a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5603e9243950 con 0x5603e92343b0 2024-08-20T01:37:43.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.653+0000 7f48d4dbe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603e9240c60 0x5603e923e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:43.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.653+0000 7f48d8c1a740 10 client.0 _ll_register_callbacks cb 0x5603e91956f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:43.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.653+0000 7f48d4dbe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603e9240c60 0x5603e923e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49886/0 (socket says 172.21.15.79:49886) 2024-08-20T01:37:43.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.653+0000 7f48cffff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603e92343b0 0x5603e923dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:43.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.653+0000 7f48d4dbe640 1 -- 172.21.15.79:0/2346001630 learned_addr learned my addr 172.21.15.79:0/2346001630 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:43.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.653+0000 7f48cf7fe640 1 --2- 172.21.15.79:0/2346001630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603e9234cd0 0x5603e923e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:43.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.653+0000 7f48cffff640 1 -- 172.21.15.79:0/2346001630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603e9234cd0 msgr2=0x5603e923e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:43.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.653+0000 7f48cffff640 1 --2- 172.21.15.79:0/2346001630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603e9234cd0 0x5603e923e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:43.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.653+0000 7f48cffff640 1 -- 172.21.15.79:0/2346001630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603e9240c60 msgr2=0x5603e923e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:43.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.653+0000 7f48cffff640 1 --2- 172.21.15.79:0/2346001630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603e9240c60 0x5603e923e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:43.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.653+0000 7f48cffff640 1 -- 172.21.15.79:0/2346001630 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603e8ef9930 con 0x5603e92343b0 2024-08-20T01:37:43.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.653+0000 7f48cffff640 1 --2- 172.21.15.79:0/2346001630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603e92343b0 0x5603e923dca0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f48c000afd0 tx=0x7f48c0004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc60af43eda64aab server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:43.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.653+0000 7f48af7fe640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:37:43.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.654+0000 7f48af7fe640 1 -- 172.21.15.79:0/2346001630 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c00118b0 con 0x5603e92343b0 2024-08-20T01:37:43.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.654+0000 7f48d8c1a740 1 -- 172.21.15.79:0/2346001630 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48c8040070 con 0x5603e92343b0 2024-08-20T01:37:43.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.654+0000 7f48af7fe640 1 -- 172.21.15.79:0/2346001630 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f48c0011a50 con 0x5603e92343b0 2024-08-20T01:37:43.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.654+0000 7f48af7fe640 1 -- 172.21.15.79:0/2346001630 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f48c0011c50 con 0x5603e92343b0 2024-08-20T01:37:43.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.654+0000 7f48d8c1a740 10 client.25021 fetch_fsmap learned FSMap version 28 2024-08-20T01:37:43.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.654+0000 7f48d8c1a740 1 -- 172.21.15.79:0/2346001630 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5603e924f5f0 con 0x5603e92343b0 2024-08-20T01:37:43.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.654+0000 7f48af7fe640 1 -- 172.21.15.79:0/2346001630 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f48c8040070 con 0x5603e92343b0 2024-08-20T01:37:43.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.654+0000 7f48af7fe640 1 -- 172.21.15.79:0/2346001630 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f48c0004830 con 0x5603e92343b0 2024-08-20T01:37:43.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.654+0000 7f48d8c1a740 10 client.25021 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:37:43.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.654+0000 7f48d8c1a740 10 client.25021 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:37:43.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.654+0000 7f48d8c1a740 20 client.25021 populate_metadata read hostname 'smithi079' 2024-08-20T01:37:43.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.654+0000 7f48d8c1a740 1 --2- 172.21.15.79:0/2346001630 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5603e9250ba0 0x5603e9252fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:43.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.655+0000 7f48d8c1a740 4 client.25021 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:37:43.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.655+0000 7f48d8c1a740 1 -- 172.21.15.79:0/2346001630 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5603e91ac890 con 0x5603e9250ba0 2024-08-20T01:37:43.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.655+0000 7f48cf7fe640 1 --2- 172.21.15.79:0/2346001630 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5603e9250ba0 0x5603e9252fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:43.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.655+0000 7f48af7fe640 10 client.25021 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:37:43.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.656+0000 7f48cf7fe640 1 --2- 172.21.15.79:0/2346001630 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5603e9250ba0 0x5603e9252fc0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db407ccb6083a6b6 server_cookie=52f00fafd16cf48c in_seq=0 out_seq=0 2024-08-20T01:37:43.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.656+0000 7f48af7fe640 1 -- 172.21.15.79:0/2346001630 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5603e91ac890 con 0x5603e9250ba0 2024-08-20T01:37:43.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.656+0000 7f48af7fe640 10 client.25021 handle_command_reply: tid=0 2024-08-20T01:37:43.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.656+0000 7f48d8c1a740 1 client.25021 shutdown 2024-08-20T01:37:43.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.657+0000 7f48d8c1a740 1 -- 172.21.15.79:0/2346001630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603e92343b0 msgr2=0x5603e923dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:43.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.657+0000 7f48d8c1a740 1 --2- 172.21.15.79:0/2346001630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603e92343b0 0x5603e923dca0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f48c000afd0 tx=0x7f48c0004730 comp rx=0 tx=0).stop 2024-08-20T01:37:43.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.657+0000 7f48d8c1a740 1 -- 172.21.15.79:0/2346001630 shutdown_connections 2024-08-20T01:37:43.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.657+0000 7f48d8c1a740 1 --2- 172.21.15.79:0/2346001630 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5603e9250ba0 0x5603e9252fc0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:43.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.657+0000 7f48d8c1a740 1 --2- 172.21.15.79:0/2346001630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603e9240c60 0x5603e923e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:43.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.657+0000 7f48af7fe640 0 client.25021 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:37:43.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.657+0000 7f48d8c1a740 1 --2- 172.21.15.79:0/2346001630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603e9234cd0 0x5603e923e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:43.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.657+0000 7f48d8c1a740 1 --2- 172.21.15.79:0/2346001630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603e92343b0 0x5603e923dca0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:43.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.657+0000 7f48d8c1a740 1 -- 172.21.15.79:0/2346001630 >> 172.21.15.79:0/2346001630 conn(0x5603e92321e0 msgr2=0x5603e9237d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:43.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.658+0000 7f48d8c1a740 1 -- 172.21.15.79:0/2346001630 shutdown_connections 2024-08-20T01:37:43.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.658+0000 7f48d8c1a740 1 -- 172.21.15.79:0/2346001630 wait complete. 2024-08-20T01:37:43.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.658+0000 7f48d8c1a740 20 client.25021 trim_cache size 0 max 16384 2024-08-20T01:37:43.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.692+0000 7f48d8c1a740 1 Processor -- start 2024-08-20T01:37:43.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.692+0000 7f48d8c1a740 1 -- start start 2024-08-20T01:37:43.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.692+0000 7f48d8c1a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603e92343b0 0x5603e92311f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:43.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.692+0000 7f48d8c1a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603e9234cd0 0x5603e9258890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:43.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.692+0000 7f48d8c1a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603e9240c60 0x5603e9258dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:43.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.692+0000 7f48d8c1a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f48d01abe80 con 0x5603e9234cd0 2024-08-20T01:37:43.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.692+0000 7f48d8c1a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f48d01ad9c0 con 0x5603e92343b0 2024-08-20T01:37:43.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.692+0000 7f48d8c1a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f48d01ac550 con 0x5603e9240c60 2024-08-20T01:37:43.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.692+0000 7f48cf7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603e9234cd0 0x5603e9258890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:43.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.692+0000 7f48cf7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603e9234cd0 0x5603e9258890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49902/0 (socket says 172.21.15.79:49902) 2024-08-20T01:37:43.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.692+0000 7f48cf7fe640 1 -- 172.21.15.79:0/2661606625 learned_addr learned my addr 172.21.15.79:0/2661606625 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:43.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.693+0000 7f48cffff640 1 --2- 172.21.15.79:0/2661606625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603e92343b0 0x5603e92311f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:43.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.693+0000 7f48cf7fe640 1 -- 172.21.15.79:0/2661606625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603e9240c60 msgr2=0x5603e9258dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:43.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.693+0000 7f48cf7fe640 1 --2- 172.21.15.79:0/2661606625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603e9240c60 0x5603e9258dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:43.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.693+0000 7f48cf7fe640 1 -- 172.21.15.79:0/2661606625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603e92343b0 msgr2=0x5603e92311f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:43.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.693+0000 7f48cf7fe640 1 --2- 172.21.15.79:0/2661606625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603e92343b0 0x5603e92311f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:43.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.693+0000 7f48cf7fe640 1 -- 172.21.15.79:0/2661606625 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603e923cc00 con 0x5603e9234cd0 2024-08-20T01:37:43.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.693+0000 7f48cf7fe640 1 --2- 172.21.15.79:0/2661606625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603e9234cd0 0x5603e9258890 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f48c40a6220 tx=0x7f48c40a60e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94b951b452635fc6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:43.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.693+0000 7f48b5ffb640 1 -- 172.21.15.79:0/2661606625 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c4020040 con 0x5603e9234cd0 2024-08-20T01:37:43.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.693+0000 7f48b5ffb640 1 -- 172.21.15.79:0/2661606625 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f48c40e0e60 con 0x5603e9234cd0 2024-08-20T01:37:43.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.693+0000 7f48b5ffb640 1 -- 172.21.15.79:0/2661606625 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c40a5b10 con 0x5603e9234cd0 2024-08-20T01:37:43.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.694+0000 7f48d8c1a740 1 -- 172.21.15.79:0/2661606625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603e9234cd0 msgr2=0x5603e9258890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:43.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.694+0000 7f48d8c1a740 1 --2- 172.21.15.79:0/2661606625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603e9234cd0 0x5603e9258890 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f48c40a6220 tx=0x7f48c40a60e0 comp rx=0 tx=0).stop 2024-08-20T01:37:43.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.694+0000 7f48d8c1a740 1 -- 172.21.15.79:0/2661606625 shutdown_connections 2024-08-20T01:37:43.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.694+0000 7f48d8c1a740 1 --2- 172.21.15.79:0/2661606625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603e9240c60 0x5603e9258dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:43.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.694+0000 7f48d8c1a740 1 --2- 172.21.15.79:0/2661606625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603e9234cd0 0x5603e9258890 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:43.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.695+0000 7f48d8c1a740 1 --2- 172.21.15.79:0/2661606625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603e92343b0 0x5603e92311f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:43.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.695+0000 7f48d8c1a740 1 -- 172.21.15.79:0/2661606625 >> 172.21.15.79:0/2661606625 conn(0x5603e92321e0 msgr2=0x5603e9230ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:43.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.695+0000 7f48d8c1a740 1 -- 172.21.15.79:0/2661606625 shutdown_connections 2024-08-20T01:37:43.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.695+0000 7f48d8c1a740 1 -- 172.21.15.79:0/2661606625 wait complete. 2024-08-20T01:37:43.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.695+0000 7f48d8c1a740 1 -- start start 2024-08-20T01:37:43.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.695+0000 7f48d8c1a740 1 Processor -- start 2024-08-20T01:37:43.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.696+0000 7f48d8c1a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603e92343b0 0x5603e9244e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:43.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.696+0000 7f48d8c1a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603e9234cd0 0x5603e92453d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:43.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.696+0000 7f48d8c1a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603e9240c60 0x5603e92ba860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:43.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.696+0000 7f48d8c1a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f48d01ad2f0 con 0x5603e92343b0 2024-08-20T01:37:43.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.696+0000 7f48d8c1a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f48d01acc20 con 0x5603e9240c60 2024-08-20T01:37:43.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.696+0000 7f48d8c1a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f48d01a9e60 con 0x5603e9234cd0 2024-08-20T01:37:43.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.696+0000 7f48d8c1a740 10 client.0 _ll_register_callbacks cb 0x7f48c001a2d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:43.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.696+0000 7f48cf7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603e9234cd0 0x5603e92453d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:43.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.696+0000 7f48cf7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603e9234cd0 0x5603e92453d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:60202/0 (socket says 172.21.15.79:60202) 2024-08-20T01:37:43.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.696+0000 7f48cf7fe640 1 -- 172.21.15.79:0/799499828 learned_addr learned my addr 172.21.15.79:0/799499828 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:43.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.696+0000 7f48cffff640 1 --2- 172.21.15.79:0/799499828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603e92343b0 0x5603e9244e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:43.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.696+0000 7f48d4dbe640 1 --2- 172.21.15.79:0/799499828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603e9240c60 0x5603e92ba860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:43.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.696+0000 7f48cf7fe640 1 -- 172.21.15.79:0/799499828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603e9240c60 msgr2=0x5603e92ba860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:43.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.696+0000 7f48cf7fe640 1 --2- 172.21.15.79:0/799499828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603e9240c60 0x5603e92ba860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:43.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.696+0000 7f48cf7fe640 1 -- 172.21.15.79:0/799499828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603e92343b0 msgr2=0x5603e9244e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:43.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.696+0000 7f48cf7fe640 1 --2- 172.21.15.79:0/799499828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603e92343b0 0x5603e9244e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:43.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.696+0000 7f48cf7fe640 1 -- 172.21.15.79:0/799499828 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603e92bada0 con 0x5603e9234cd0 2024-08-20T01:37:43.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.696+0000 7f48cf7fe640 1 --2- 172.21.15.79:0/799499828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603e9234cd0 0x5603e92453d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f48c40aa130 tx=0x7f48c4005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b3f088141942e8a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:43.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.696+0000 7f48af7fe640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:37:43.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.697+0000 7f48af7fe640 1 -- 172.21.15.79:0/799499828 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c4089060 con 0x5603e9234cd0 2024-08-20T01:37:43.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.697+0000 7f48af7fe640 1 -- 172.21.15.79:0/799499828 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f48c40b1d30 con 0x5603e9234cd0 2024-08-20T01:37:43.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.697+0000 7f48d8c1a740 1 -- 172.21.15.79:0/799499828 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48c40e0e60 con 0x5603e9234cd0 2024-08-20T01:37:43.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.697+0000 7f48af7fe640 1 -- 172.21.15.79:0/799499828 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f48c4020030 con 0x5603e9234cd0 2024-08-20T01:37:43.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.697+0000 7f48d8c1a740 10 client.25024 fetch_fsmap learned FSMap version 28 2024-08-20T01:37:43.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.697+0000 7f48d8c1a740 1 -- 172.21.15.79:0/799499828 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5603e92bc040 con 0x5603e9234cd0 2024-08-20T01:37:43.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.697+0000 7f48af7fe640 1 -- 172.21.15.79:0/799499828 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f48c40e0e60 con 0x5603e9234cd0 2024-08-20T01:37:43.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.697+0000 7f48af7fe640 1 -- 172.21.15.79:0/799499828 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f48c40c4ce0 con 0x5603e9234cd0 2024-08-20T01:37:43.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.698+0000 7f48d8c1a740 10 client.25024 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:37:43.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.698+0000 7f48d8c1a740 10 client.25024 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:37:43.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.698+0000 7f48d8c1a740 20 client.25024 populate_metadata read hostname 'smithi079' 2024-08-20T01:37:43.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.698+0000 7f48d8c1a740 1 --2- 172.21.15.79:0/799499828 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5603e9250ba0 0x5603e92be7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:43.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.698+0000 7f48d8c1a740 4 client.25024 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T01:37:43.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.698+0000 7f48d8c1a740 1 -- 172.21.15.79:0/799499828 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5603e91a8330 con 0x5603e9250ba0 2024-08-20T01:37:43.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.698+0000 7f48cffff640 1 --2- 172.21.15.79:0/799499828 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5603e9250ba0 0x5603e92be7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:43.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.698+0000 7f48af7fe640 10 client.25024 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:37:43.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.698+0000 7f48cffff640 1 --2- 172.21.15.79:0/799499828 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5603e9250ba0 0x5603e92be7a0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4d266e52f7f6bd server_cookie=ef1f4dd223e2fdd in_seq=0 out_seq=0 2024-08-20T01:37:43.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.700+0000 7f48af7fe640 1 -- 172.21.15.79:0/799499828 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5603e91a8330 con 0x5603e9250ba0 2024-08-20T01:37:43.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.700+0000 7f48af7fe640 10 client.25024 handle_command_reply: tid=0 2024-08-20T01:37:43.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.700+0000 7f48d8c1a740 1 client.25024 shutdown 2024-08-20T01:37:43.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.700+0000 7f48d8c1a740 1 -- 172.21.15.79:0/799499828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603e9234cd0 msgr2=0x5603e92453d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:43.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.700+0000 7f48d8c1a740 1 --2- 172.21.15.79:0/799499828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603e9234cd0 0x5603e92453d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f48c40aa130 tx=0x7f48c4005880 comp rx=0 tx=0).stop 2024-08-20T01:37:43.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.700+0000 7f48d8c1a740 1 -- 172.21.15.79:0/799499828 shutdown_connections 2024-08-20T01:37:43.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.700+0000 7f48d8c1a740 1 --2- 172.21.15.79:0/799499828 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5603e9250ba0 0x5603e92be7a0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:43.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.700+0000 7f48d8c1a740 1 --2- 172.21.15.79:0/799499828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603e9240c60 0x5603e92ba860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:43.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.700+0000 7f48af7fe640 0 client.25024 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:37:43.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.700+0000 7f48d8c1a740 1 --2- 172.21.15.79:0/799499828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603e9234cd0 0x5603e92453d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:43.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.700+0000 7f48d8c1a740 1 --2- 172.21.15.79:0/799499828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603e92343b0 0x5603e9244e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:43.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.700+0000 7f48d8c1a740 1 -- 172.21.15.79:0/799499828 >> 172.21.15.79:0/799499828 conn(0x5603e92321e0 msgr2=0x5603e9231300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:43.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.700+0000 7f48d8c1a740 1 -- 172.21.15.79:0/799499828 shutdown_connections 2024-08-20T01:37:43.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.700+0000 7f48d8c1a740 1 -- 172.21.15.79:0/799499828 wait complete. 2024-08-20T01:37:43.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.700+0000 7f48d8c1a740 20 client.25024 trim_cache size 0 max 16384 2024-08-20T01:37:43.709 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:37:43.709 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-08-20T01:37:43.709 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "40d4e345-7107-4672-8b02-a31e65e069be", 2024-08-20T01:37:43.709 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-08-20T01:37:43.709 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:37:43.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.701+0000 7f48d6821640 1 -- 172.21.15.79:0/959782901 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f48b80b3bd0 msgr2=0x7f48b80b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:43.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.701+0000 7f48d6821640 1 --2- 172.21.15.79:0/959782901 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f48b80b3bd0 0x7f48b80b6090 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f48c00058c0 tx=0x7f48c000af00 comp rx=0 tx=0).stop 2024-08-20T01:37:43.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.701+0000 7f48d6821640 1 -- 172.21.15.79:0/959782901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48d01073e0 msgr2=0x7f48d01993b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:43.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.701+0000 7f48d6821640 1 --2- 172.21.15.79:0/959782901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48d01073e0 0x7f48d01993b0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f48c400d950 tx=0x7f48c400de10 comp rx=0 tx=0).stop 2024-08-20T01:37:43.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.702+0000 7f48d6821640 1 -- 172.21.15.79:0/959782901 shutdown_connections 2024-08-20T01:37:43.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.702+0000 7f48d6821640 1 --2- 172.21.15.79:0/959782901 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f48b80b3bd0 0x7f48b80b6090 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:43.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.702+0000 7f48d6821640 1 --2- 172.21.15.79:0/959782901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48d0107d60 0x7f48d019e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:43.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.702+0000 7f48d6821640 1 --2- 172.21.15.79:0/959782901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48d01073e0 0x7f48d01993b0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:43.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.702+0000 7f48d6821640 1 --2- 172.21.15.79:0/959782901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48d01019d0 0x7f48d0198e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:43.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.702+0000 7f48d6821640 1 -- 172.21.15.79:0/959782901 >> 172.21.15.79:0/959782901 conn(0x7f48d00fd460 msgr2=0x7f48d00ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:43.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.702+0000 7f48d6821640 1 -- 172.21.15.79:0/959782901 shutdown_connections 2024-08-20T01:37:43.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:43.702+0000 7f48d6821640 1 -- 172.21.15.79:0/959782901 wait complete. 2024-08-20T01:37:44.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:43 smithi081 ceph-mon[22209]: pgmap v359: 97 pgs: 97 active+clean; 663 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-20T01:37:44.282 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:43 smithi079 ceph-mon[18656]: pgmap v359: 97 pgs: 97 active+clean; 663 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-20T01:37:44.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:43 smithi175 ceph-mon[22392]: pgmap v359: 97 pgs: 97 active+clean; 663 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-20T01:37:44.401 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:37:44.660 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:37:45.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:44 smithi079 ceph-mon[18656]: scrub queued for path: / 2024-08-20T01:37:45.271 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:44 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:37:45.271 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:44 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:37:45.271 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:44 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:37:45.271 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:44 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:37:45.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:44 smithi081 ceph-mon[22209]: scrub queued for path: / 2024-08-20T01:37:45.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:44 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:37:45.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:44 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:37:45.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:44 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:37:45.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:44 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:37:45.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:44 smithi175 ceph-mon[22392]: scrub queued for path: / 2024-08-20T01:37:45.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:44 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:37:45.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:44 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:37:45.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:44 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:37:45.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:44 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:37:45.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.474+0000 7f5bd24a6640 1 -- 172.21.15.79:0/3458657164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bcc1042c0 msgr2=0x7f5bcc10c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:45.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.474+0000 7f5bd24a6640 1 --2- 172.21.15.79:0/3458657164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bcc1042c0 0x7f5bcc10c7b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0009900 tx=0x7f5bc002a410 comp rx=0 tx=0).stop 2024-08-20T01:37:45.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.474+0000 7f5bd24a6640 1 -- 172.21.15.79:0/3458657164 shutdown_connections 2024-08-20T01:37:45.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.474+0000 7f5bd24a6640 1 --2- 172.21.15.79:0/3458657164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bcc10ce00 0x7f5bcc10f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:45.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.474+0000 7f5bd24a6640 1 --2- 172.21.15.79:0/3458657164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bcc1042c0 0x7f5bcc10c7b0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:45.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.474+0000 7f5bd24a6640 1 --2- 172.21.15.79:0/3458657164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bcc1039a0 0x7f5bcc103d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:45.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.474+0000 7f5bd24a6640 1 -- 172.21.15.79:0/3458657164 >> 172.21.15.79:0/3458657164 conn(0x7f5bcc0fd400 msgr2=0x7f5bcc0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:45.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.474+0000 7f5bd24a6640 1 -- 172.21.15.79:0/3458657164 shutdown_connections 2024-08-20T01:37:45.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.474+0000 7f5bd24a6640 1 -- 172.21.15.79:0/3458657164 wait complete. 2024-08-20T01:37:45.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.475+0000 7f5bd24a6640 1 Processor -- start 2024-08-20T01:37:45.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.475+0000 7f5bd24a6640 1 -- start start 2024-08-20T01:37:45.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.475+0000 7f5bd24a6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bcc1039a0 0x7f5bcc101650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:45.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.475+0000 7f5bd24a6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bcc1042c0 0x7f5bcc101b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:45.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.475+0000 7f5bd24a6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bcc10ce00 0x7f5bcc1020d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:45.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.475+0000 7f5bd24a6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5bcc1129b0 con 0x7f5bcc1039a0 2024-08-20T01:37:45.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.475+0000 7f5bd24a6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5bcc112830 con 0x7f5bcc1042c0 2024-08-20T01:37:45.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.475+0000 7f5bd24a6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5bcc112b30 con 0x7f5bcc10ce00 2024-08-20T01:37:45.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.475+0000 7f5bcbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bcc1039a0 0x7f5bcc101650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:45.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.475+0000 7f5bcbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bcc1039a0 0x7f5bcc101650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49922/0 (socket says 172.21.15.79:49922) 2024-08-20T01:37:45.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.475+0000 7f5bcbfff640 1 -- 172.21.15.79:0/3267409416 learned_addr learned my addr 172.21.15.79:0/3267409416 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:45.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.475+0000 7f5bd0a43640 1 --2- 172.21.15.79:0/3267409416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bcc10ce00 0x7f5bcc1020d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:45.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.475+0000 7f5bcb7fe640 1 --2- 172.21.15.79:0/3267409416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bcc1042c0 0x7f5bcc101b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:45.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.476+0000 7f5bcbfff640 1 -- 172.21.15.79:0/3267409416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bcc10ce00 msgr2=0x7f5bcc1020d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:45.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.476+0000 7f5bcbfff640 1 --2- 172.21.15.79:0/3267409416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bcc10ce00 0x7f5bcc1020d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:45.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.476+0000 7f5bcbfff640 1 -- 172.21.15.79:0/3267409416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bcc1042c0 msgr2=0x7f5bcc101b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:45.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.476+0000 7f5bcbfff640 1 --2- 172.21.15.79:0/3267409416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bcc1042c0 0x7f5bcc101b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:45.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.476+0000 7f5bcbfff640 1 -- 172.21.15.79:0/3267409416 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bcc1a7320 con 0x7f5bcc1039a0 2024-08-20T01:37:45.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.476+0000 7f5bcb7fe640 1 --2- 172.21.15.79:0/3267409416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bcc1042c0 0x7f5bcc101b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:37:45.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.476+0000 7f5bcbfff640 1 --2- 172.21.15.79:0/3267409416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bcc1039a0 0x7f5bcc101650 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc00c920 tx=0x7f5bbc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:45.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.476+0000 7f5bc97fa640 1 -- 172.21.15.79:0/3267409416 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc007c70 con 0x7f5bcc1039a0 2024-08-20T01:37:45.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.476+0000 7f5bc97fa640 1 -- 172.21.15.79:0/3267409416 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5bbc007e10 con 0x7f5bcc1039a0 2024-08-20T01:37:45.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.476+0000 7f5bd24a6640 1 -- 172.21.15.79:0/3267409416 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bcc1a7610 con 0x7f5bcc1039a0 2024-08-20T01:37:45.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.476+0000 7f5bc97fa640 1 -- 172.21.15.79:0/3267409416 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc018710 con 0x7f5bcc1039a0 2024-08-20T01:37:45.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.476+0000 7f5bd24a6640 1 -- 172.21.15.79:0/3267409416 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bcc1a7b20 con 0x7f5bcc1039a0 2024-08-20T01:37:45.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.479+0000 7f5bd489f740 1 Processor -- start 2024-08-20T01:37:45.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.479+0000 7f5bd489f740 1 -- start start 2024-08-20T01:37:45.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.479+0000 7f5bc97fa640 1 -- 172.21.15.79:0/3267409416 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5bbc00f450 con 0x7f5bcc1039a0 2024-08-20T01:37:45.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.479+0000 7f5bd489f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d59d42c830 0x55d59d42cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:45.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.479+0000 7f5bd489f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d59d42d150 0x55d59d438ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:45.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.479+0000 7f5bd489f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d59d4390e0 0x55d59d43b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:45.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.479+0000 7f5bd489f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d59d3a38e0 con 0x55d59d42c830 2024-08-20T01:37:45.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.479+0000 7f5bd489f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d59d392de0 con 0x55d59d4390e0 2024-08-20T01:37:45.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.479+0000 7f5bd489f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d59d396e20 con 0x55d59d42d150 2024-08-20T01:37:45.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.479+0000 7f5bd0a43640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d59d42c830 0x55d59d42cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:45.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.479+0000 7f5bd0a43640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d59d42c830 0x55d59d42cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49926/0 (socket says 172.21.15.79:49926) 2024-08-20T01:37:45.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.479+0000 7f5bd0a43640 1 -- 172.21.15.79:0/348012095 learned_addr learned my addr 172.21.15.79:0/348012095 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:45.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.479+0000 7f5bcb7fe640 1 --2- 172.21.15.79:0/348012095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d59d4390e0 0x55d59d43b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:45.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.479+0000 7f5bcbfff640 1 --2- 172.21.15.79:0/348012095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d59d42d150 0x55d59d438ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:45.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.479+0000 7f5bd0a43640 1 -- 172.21.15.79:0/348012095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d59d42d150 msgr2=0x55d59d438ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:45.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.480+0000 7f5bd0a43640 1 --2- 172.21.15.79:0/348012095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d59d42d150 0x55d59d438ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:45.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.480+0000 7f5bd0a43640 1 -- 172.21.15.79:0/348012095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d59d4390e0 msgr2=0x55d59d43b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:45.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.480+0000 7f5bd0a43640 1 --2- 172.21.15.79:0/348012095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d59d4390e0 0x55d59d43b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:45.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.480+0000 7f5bd0a43640 1 -- 172.21.15.79:0/348012095 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d59d0f2650 con 0x55d59d42c830 2024-08-20T01:37:45.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.480+0000 7f5bd0a43640 1 --2- 172.21.15.79:0/348012095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d59d42c830 0x55d59d42cc10 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5bc400a430 tx=0x7f5bc4009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8998771c4b081ac6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:45.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.480+0000 7f5bc97fa640 1 --2- 172.21.15.79:0/3267409416 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5bb40b3bd0 0x7f5bb40b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:45.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.480+0000 7f5bb27fc640 1 -- 172.21.15.79:0/348012095 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc4013790 con 0x55d59d42c830 2024-08-20T01:37:45.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.480+0000 7f5bcbfff640 1 --2- 172.21.15.79:0/3267409416 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5bb40b3bd0 0x7f5bb40b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:45.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.480+0000 7f5bb27fc640 1 -- 172.21.15.79:0/348012095 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5bc4019070 con 0x55d59d42c830 2024-08-20T01:37:45.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.480+0000 7f5bc97fa640 1 -- 172.21.15.79:0/3267409416 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f5bbc0e3dd0 con 0x7f5bcc1039a0 2024-08-20T01:37:45.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.480+0000 7f5bb27fc640 1 -- 172.21.15.79:0/348012095 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc4014c20 con 0x55d59d42c830 2024-08-20T01:37:45.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.481+0000 7f5bd489f740 1 -- 172.21.15.79:0/348012095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d59d42c830 msgr2=0x55d59d42cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:45.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.481+0000 7f5bcbfff640 1 --2- 172.21.15.79:0/3267409416 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5bb40b3bd0 0x7f5bb40b6090 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0e1c50 tx=0x7f5bbc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:45.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.481+0000 7f5bd489f740 1 --2- 172.21.15.79:0/348012095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d59d42c830 0x55d59d42cc10 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5bc400a430 tx=0x7f5bc4009650 comp rx=0 tx=0).stop 2024-08-20T01:37:45.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.481+0000 7f5bd489f740 1 -- 172.21.15.79:0/348012095 shutdown_connections 2024-08-20T01:37:45.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.481+0000 7f5bd489f740 1 --2- 172.21.15.79:0/348012095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d59d4390e0 0x55d59d43b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:45.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.481+0000 7f5bd489f740 1 --2- 172.21.15.79:0/348012095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d59d42d150 0x55d59d438ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:45.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.481+0000 7f5bd489f740 1 --2- 172.21.15.79:0/348012095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d59d42c830 0x55d59d42cc10 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:45.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.481+0000 7f5bd489f740 1 -- 172.21.15.79:0/348012095 >> 172.21.15.79:0/348012095 conn(0x55d59d42a660 msgr2=0x55d59d42b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:45.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.481+0000 7f5bd489f740 1 -- 172.21.15.79:0/348012095 shutdown_connections 2024-08-20T01:37:45.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.481+0000 7f5bd489f740 1 -- 172.21.15.79:0/348012095 wait complete. 2024-08-20T01:37:45.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.482+0000 7f5bd489f740 1 -- start start 2024-08-20T01:37:45.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.482+0000 7f5bd489f740 1 Processor -- start 2024-08-20T01:37:45.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.482+0000 7f5bd489f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d59d42c830 0x55d59d436090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:45.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.482+0000 7f5bd489f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d59d42d150 0x55d59d4365d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:45.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.482+0000 7f5bd489f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d59d4390e0 0x55d59d436b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:45.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.482+0000 7f5bd489f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d59d1f5700 con 0x55d59d42d150 2024-08-20T01:37:45.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.482+0000 7f5bd489f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d59d3197c0 con 0x55d59d4390e0 2024-08-20T01:37:45.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.482+0000 7f5bd489f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d59d43bd90 con 0x55d59d42c830 2024-08-20T01:37:45.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.482+0000 7f5bd489f740 10 client.0 _ll_register_callbacks cb 0x55d59d38c6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:45.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.482+0000 7f5bd0a43640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d59d42c830 0x55d59d436090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:45.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.482+0000 7f5bd0a43640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d59d42c830 0x55d59d436090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:60250/0 (socket says 172.21.15.79:60250) 2024-08-20T01:37:45.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.482+0000 7f5bd0a43640 1 -- 172.21.15.79:0/745980693 learned_addr learned my addr 172.21.15.79:0/745980693 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:45.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.482+0000 7f5bcb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d59d42d150 0x55d59d4365d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:45.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.483+0000 7f5bd0a43640 1 --2- 172.21.15.79:0/745980693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d59d4390e0 0x55d59d436b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:45.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.483+0000 7f5bd0a43640 1 -- 172.21.15.79:0/745980693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d59d4390e0 msgr2=0x55d59d436b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:45.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.483+0000 7f5bd0a43640 1 --2- 172.21.15.79:0/745980693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d59d4390e0 0x55d59d436b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:45.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.483+0000 7f5bd0a43640 1 -- 172.21.15.79:0/745980693 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d59d42d150 msgr2=0x55d59d4365d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:45.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.483+0000 7f5bd0a43640 1 --2- 172.21.15.79:0/745980693 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d59d42d150 0x55d59d4365d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:45.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.483+0000 7f5bd0a43640 1 -- 172.21.15.79:0/745980693 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d59d445170 con 0x55d59d42c830 2024-08-20T01:37:45.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.483+0000 7f5bd0a43640 1 --2- 172.21.15.79:0/745980693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d59d42c830 0x55d59d436090 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4016040 tx=0x7f5bc4014800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f6b9bfbc5eec561 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:45.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.483+0000 7f5bab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:37:45.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.483+0000 7f5bab7fe640 1 -- 172.21.15.79:0/745980693 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc4013590 con 0x55d59d42c830 2024-08-20T01:37:45.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.483+0000 7f5bd489f740 1 -- 172.21.15.79:0/745980693 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d59d342100 con 0x55d59d42c830 2024-08-20T01:37:45.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.483+0000 7f5bab7fe640 1 -- 172.21.15.79:0/745980693 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f5bc4013730 con 0x55d59d42c830 2024-08-20T01:37:45.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.483+0000 7f5bab7fe640 1 -- 172.21.15.79:0/745980693 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5bc4013930 con 0x55d59d42c830 2024-08-20T01:37:45.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.483+0000 7f5bd489f740 10 client.25033 fetch_fsmap learned FSMap version 28 2024-08-20T01:37:45.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.483+0000 7f5bd489f740 1 -- 172.21.15.79:0/745980693 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d59d447b50 con 0x55d59d42c830 2024-08-20T01:37:45.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.484+0000 7f5bab7fe640 1 -- 172.21.15.79:0/745980693 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55d59d342100 con 0x55d59d42c830 2024-08-20T01:37:45.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.484+0000 7f5bab7fe640 1 -- 172.21.15.79:0/745980693 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5bc402b060 con 0x55d59d42c830 2024-08-20T01:37:45.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.484+0000 7f5bd489f740 10 client.25033 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:37:45.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.484+0000 7f5bd489f740 10 client.25033 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:37:45.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.484+0000 7f5bd489f740 20 client.25033 populate_metadata read hostname 'smithi079' 2024-08-20T01:37:45.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.484+0000 7f5bd489f740 1 --2- 172.21.15.79:0/745980693 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d59d448f00 0x55d59d44b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:45.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.484+0000 7f5bd489f740 4 client.25033 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:37:45.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.484+0000 7f5bd489f740 1 -- 172.21.15.79:0/745980693 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d59d3a5830 con 0x55d59d448f00 2024-08-20T01:37:45.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.484+0000 7f5bcb7fe640 1 --2- 172.21.15.79:0/745980693 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d59d448f00 0x55d59d44b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:45.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.485+0000 7f5bab7fe640 10 client.25033 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:37:45.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.485+0000 7f5bcb7fe640 1 --2- 172.21.15.79:0/745980693 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d59d448f00 0x55d59d44b2f0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=619fab6c6ce17d99 server_cookie=e13ecb7b3e4a7bbc in_seq=0 out_seq=0 2024-08-20T01:37:45.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.485+0000 7f5bab7fe640 1 -- 172.21.15.79:0/745980693 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d59d3a5830 con 0x55d59d448f00 2024-08-20T01:37:45.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.485+0000 7f5bab7fe640 10 client.25033 handle_command_reply: tid=0 2024-08-20T01:37:45.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.485+0000 7f5bd489f740 1 client.25033 shutdown 2024-08-20T01:37:45.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.485+0000 7f5bd489f740 1 -- 172.21.15.79:0/745980693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d59d42c830 msgr2=0x55d59d436090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:45.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.485+0000 7f5bd489f740 1 --2- 172.21.15.79:0/745980693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d59d42c830 0x55d59d436090 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4016040 tx=0x7f5bc4014800 comp rx=0 tx=0).stop 2024-08-20T01:37:45.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.485+0000 7f5bd489f740 1 -- 172.21.15.79:0/745980693 shutdown_connections 2024-08-20T01:37:45.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.485+0000 7f5bd489f740 1 --2- 172.21.15.79:0/745980693 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d59d448f00 0x55d59d44b2f0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:45.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.485+0000 7f5bab7fe640 0 client.25033 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:37:45.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.486+0000 7f5bd489f740 1 --2- 172.21.15.79:0/745980693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d59d4390e0 0x55d59d436b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:45.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.486+0000 7f5bd489f740 1 --2- 172.21.15.79:0/745980693 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d59d42d150 0x55d59d4365d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:45.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.486+0000 7f5bd489f740 1 --2- 172.21.15.79:0/745980693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d59d42c830 0x55d59d436090 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:45.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.486+0000 7f5bd489f740 1 -- 172.21.15.79:0/745980693 >> 172.21.15.79:0/745980693 conn(0x55d59d42a660 msgr2=0x55d59d430200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:45.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.486+0000 7f5bd489f740 1 -- 172.21.15.79:0/745980693 shutdown_connections 2024-08-20T01:37:45.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.486+0000 7f5bd489f740 1 -- 172.21.15.79:0/745980693 wait complete. 2024-08-20T01:37:45.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.486+0000 7f5bd489f740 20 client.25033 trim_cache size 0 max 16384 2024-08-20T01:37:45.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.516+0000 7f5bd489f740 1 Processor -- start 2024-08-20T01:37:45.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.516+0000 7f5bd489f740 1 -- start start 2024-08-20T01:37:45.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.516+0000 7f5bd489f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d59d42c830 0x55d59d450a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:45.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.516+0000 7f5bd489f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d59d42d150 0x55d59d450f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:45.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.516+0000 7f5bd489f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d59d4390e0 0x55d59d441010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:45.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.516+0000 7f5bd489f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5bcc1b01d0 con 0x55d59d4390e0 2024-08-20T01:37:45.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.516+0000 7f5bd489f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5bcc1b1d10 con 0x55d59d42c830 2024-08-20T01:37:45.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.516+0000 7f5bd489f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5bcc1b08a0 con 0x55d59d42d150 2024-08-20T01:37:45.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.516+0000 7f5bd0a43640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d59d4390e0 0x55d59d441010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:45.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.516+0000 7f5bd0a43640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d59d4390e0 0x55d59d441010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49936/0 (socket says 172.21.15.79:49936) 2024-08-20T01:37:45.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.516+0000 7f5bd0a43640 1 -- 172.21.15.79:0/3250612066 learned_addr learned my addr 172.21.15.79:0/3250612066 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:45.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.516+0000 7f5bcb7fe640 1 --2- 172.21.15.79:0/3250612066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d59d42d150 0x55d59d450f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:45.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.516+0000 7f5bd0a43640 1 --2- 172.21.15.79:0/3250612066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d59d42c830 0x55d59d450a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:45.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.516+0000 7f5bd0a43640 1 -- 172.21.15.79:0/3250612066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d59d42d150 msgr2=0x55d59d450f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:45.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.516+0000 7f5bd0a43640 1 --2- 172.21.15.79:0/3250612066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d59d42d150 0x55d59d450f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:45.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.516+0000 7f5bd0a43640 1 -- 172.21.15.79:0/3250612066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d59d42c830 msgr2=0x55d59d450a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:45.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.516+0000 7f5bd0a43640 1 --2- 172.21.15.79:0/3250612066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d59d42c830 0x55d59d450a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:45.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.516+0000 7f5bd0a43640 1 -- 172.21.15.79:0/3250612066 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d59d42b0e0 con 0x55d59d4390e0 2024-08-20T01:37:45.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.517+0000 7f5bd0a43640 1 --2- 172.21.15.79:0/3250612066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d59d4390e0 0x55d59d441010 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f5bc401d4d0 tx=0x7f5bc4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c545196a61fdf17a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:45.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.517+0000 7f5bb1ffb640 1 -- 172.21.15.79:0/3250612066 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc4009a30 con 0x55d59d4390e0 2024-08-20T01:37:45.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.517+0000 7f5bb1ffb640 1 -- 172.21.15.79:0/3250612066 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5bc4019050 con 0x55d59d4390e0 2024-08-20T01:37:45.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.517+0000 7f5bb1ffb640 1 -- 172.21.15.79:0/3250612066 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc402d480 con 0x55d59d4390e0 2024-08-20T01:37:45.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.518+0000 7f5bd489f740 1 -- 172.21.15.79:0/3250612066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d59d4390e0 msgr2=0x55d59d441010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:45.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.518+0000 7f5bd489f740 1 --2- 172.21.15.79:0/3250612066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d59d4390e0 0x55d59d441010 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f5bc401d4d0 tx=0x7f5bc4004a40 comp rx=0 tx=0).stop 2024-08-20T01:37:45.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.518+0000 7f5bd489f740 1 -- 172.21.15.79:0/3250612066 shutdown_connections 2024-08-20T01:37:45.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.518+0000 7f5bd489f740 1 --2- 172.21.15.79:0/3250612066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d59d4390e0 0x55d59d441010 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:45.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.518+0000 7f5bd489f740 1 --2- 172.21.15.79:0/3250612066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d59d42d150 0x55d59d450f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:45.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.518+0000 7f5bd489f740 1 --2- 172.21.15.79:0/3250612066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d59d42c830 0x55d59d450a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:45.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.518+0000 7f5bd489f740 1 -- 172.21.15.79:0/3250612066 >> 172.21.15.79:0/3250612066 conn(0x55d59d42a660 msgr2=0x55d59d437ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:45.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.518+0000 7f5bd489f740 1 -- 172.21.15.79:0/3250612066 shutdown_connections 2024-08-20T01:37:45.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.518+0000 7f5bd489f740 1 -- 172.21.15.79:0/3250612066 wait complete. 2024-08-20T01:37:45.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.518+0000 7f5bd489f740 1 -- start start 2024-08-20T01:37:45.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.518+0000 7f5bd489f740 1 Processor -- start 2024-08-20T01:37:45.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.519+0000 7f5bd489f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d59d42c830 0x55d59d43e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:45.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.519+0000 7f5bd489f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d59d42d150 0x55d59d43e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:45.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.519+0000 7f5bd489f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d59d4390e0 0x55d59d4b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:45.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.519+0000 7f5bd489f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5bcc1b1640 con 0x55d59d42d150 2024-08-20T01:37:45.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.519+0000 7f5bd489f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5bcc1b0f70 con 0x55d59d4390e0 2024-08-20T01:37:45.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.519+0000 7f5bd489f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5bcc1ae1b0 con 0x55d59d42c830 2024-08-20T01:37:45.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.519+0000 7f5bd489f740 10 client.0 _ll_register_callbacks cb 0x7f5bcc06b810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:45.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.519+0000 7f5bcb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d59d42d150 0x55d59d43e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:45.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.519+0000 7f5bcb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d59d42d150 0x55d59d43e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49946/0 (socket says 172.21.15.79:49946) 2024-08-20T01:37:45.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.519+0000 7f5bcb7fe640 1 -- 172.21.15.79:0/3089308399 learned_addr learned my addr 172.21.15.79:0/3089308399 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:45.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.519+0000 7f5bd0a43640 1 --2- 172.21.15.79:0/3089308399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d59d42c830 0x55d59d43e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:45.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.519+0000 7f5bd0a43640 1 --2- 172.21.15.79:0/3089308399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d59d4390e0 0x55d59d4b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:45.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.519+0000 7f5bcb7fe640 1 -- 172.21.15.79:0/3089308399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d59d42c830 msgr2=0x55d59d43e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:45.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.519+0000 7f5bcb7fe640 1 --2- 172.21.15.79:0/3089308399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d59d42c830 0x55d59d43e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:45.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.519+0000 7f5bcb7fe640 1 -- 172.21.15.79:0/3089308399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d59d4390e0 msgr2=0x55d59d4b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:45.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.519+0000 7f5bcb7fe640 1 --2- 172.21.15.79:0/3089308399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d59d4390e0 0x55d59d4b1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:45.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.519+0000 7f5bcb7fe640 1 -- 172.21.15.79:0/3089308399 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d59d4b1f40 con 0x55d59d42d150 2024-08-20T01:37:45.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.519+0000 7f5bd0a43640 1 --2- 172.21.15.79:0/3089308399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d59d42c830 0x55d59d43e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:37:45.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.519+0000 7f5bcb7fe640 1 --2- 172.21.15.79:0/3089308399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d59d42d150 0x55d59d43e7d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0006010 tx=0x7f5bc00037a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb12f29965b963b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:45.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.519+0000 7f5bab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:37:45.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.520+0000 7f5bab7fe640 1 -- 172.21.15.79:0/3089308399 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc0035040 con 0x55d59d42d150 2024-08-20T01:37:45.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.520+0000 7f5bab7fe640 1 -- 172.21.15.79:0/3089308399 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f5bc0003de0 con 0x55d59d42d150 2024-08-20T01:37:45.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.520+0000 7f5bd489f740 1 -- 172.21.15.79:0/3089308399 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5bc4019050 con 0x55d59d42d150 2024-08-20T01:37:45.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.520+0000 7f5bab7fe640 1 -- 172.21.15.79:0/3089308399 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5bc0003fe0 con 0x55d59d42d150 2024-08-20T01:37:45.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.520+0000 7f5bd489f740 10 client.15633 fetch_fsmap learned FSMap version 28 2024-08-20T01:37:45.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.520+0000 7f5bd489f740 1 -- 172.21.15.79:0/3089308399 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d59d4b3170 con 0x55d59d42d150 2024-08-20T01:37:45.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.520+0000 7f5bab7fe640 1 -- 172.21.15.79:0/3089308399 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5bc00467a0 con 0x55d59d42d150 2024-08-20T01:37:45.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.520+0000 7f5bab7fe640 1 -- 172.21.15.79:0/3089308399 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5bc003c7b0 con 0x55d59d42d150 2024-08-20T01:37:45.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.520+0000 7f5bd489f740 10 client.15633 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:37:45.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.520+0000 7f5bd489f740 10 client.15633 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:37:45.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.520+0000 7f5bd489f740 20 client.15633 populate_metadata read hostname 'smithi079' 2024-08-20T01:37:45.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.520+0000 7f5bd489f740 1 --2- 172.21.15.79:0/3089308399 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d59d448f00 0x55d59d4b5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:45.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.520+0000 7f5bd489f740 4 client.15633 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:37:45.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.520+0000 7f5bd489f740 1 -- 172.21.15.79:0/3089308399 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f5bc4019050 con 0x55d59d448f00 2024-08-20T01:37:45.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.521+0000 7f5bd0a43640 1 --2- 172.21.15.79:0/3089308399 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d59d448f00 0x55d59d4b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:45.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.521+0000 7f5bd0a43640 1 --2- 172.21.15.79:0/3089308399 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d59d448f00 0x55d59d4b5960 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c81109528cb5470e server_cookie=3202a67dcff75105 in_seq=0 out_seq=0 2024-08-20T01:37:45.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.521+0000 7f5bab7fe640 10 client.15633 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:37:45.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.521+0000 7f5bab7fe640 1 -- 172.21.15.79:0/3089308399 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f5bc4019050 con 0x55d59d448f00 2024-08-20T01:37:45.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.521+0000 7f5bab7fe640 10 client.15633 handle_command_reply: tid=0 2024-08-20T01:37:45.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.521+0000 7f5bd489f740 1 client.15633 shutdown 2024-08-20T01:37:45.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.521+0000 7f5bd489f740 1 -- 172.21.15.79:0/3089308399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d59d42d150 msgr2=0x55d59d43e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:45.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.521+0000 7f5bd489f740 1 --2- 172.21.15.79:0/3089308399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d59d42d150 0x55d59d43e7d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0006010 tx=0x7f5bc00037a0 comp rx=0 tx=0).stop 2024-08-20T01:37:45.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.521+0000 7f5bd489f740 1 -- 172.21.15.79:0/3089308399 shutdown_connections 2024-08-20T01:37:45.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.521+0000 7f5bd489f740 1 --2- 172.21.15.79:0/3089308399 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d59d448f00 0x55d59d4b5960 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:45.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.522+0000 7f5bd489f740 1 --2- 172.21.15.79:0/3089308399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d59d4390e0 0x55d59d4b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:45.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.522+0000 7f5bd489f740 1 --2- 172.21.15.79:0/3089308399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d59d42d150 0x55d59d43e7d0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:45.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.522+0000 7f5bab7fe640 0 client.15633 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:37:45.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.522+0000 7f5bd489f740 1 --2- 172.21.15.79:0/3089308399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d59d42c830 0x55d59d43e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:45.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.522+0000 7f5bd489f740 1 -- 172.21.15.79:0/3089308399 >> 172.21.15.79:0/3089308399 conn(0x55d59d42a660 msgr2=0x55d59d42f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:45.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.522+0000 7f5bd489f740 1 -- 172.21.15.79:0/3089308399 shutdown_connections 2024-08-20T01:37:45.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.522+0000 7f5bd489f740 1 -- 172.21.15.79:0/3089308399 wait complete. 2024-08-20T01:37:45.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.522+0000 7f5bd489f740 20 client.15633 trim_cache size 0 max 16384 2024-08-20T01:37:45.530 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:37:45.530 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-08-20T01:37:45.530 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-08-20T01:37:45.530 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:37:45.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.522+0000 7f5bd24a6640 1 -- 172.21.15.79:0/3267409416 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5bb40b3bd0 msgr2=0x7f5bb40b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:45.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.522+0000 7f5bd24a6640 1 --2- 172.21.15.79:0/3267409416 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5bb40b3bd0 0x7f5bb40b6090 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0e1c50 tx=0x7f5bbc000bc0 comp rx=0 tx=0).stop 2024-08-20T01:37:45.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.522+0000 7f5bd24a6640 1 -- 172.21.15.79:0/3267409416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bcc1039a0 msgr2=0x7f5bcc101650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:45.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.522+0000 7f5bd24a6640 1 --2- 172.21.15.79:0/3267409416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bcc1039a0 0x7f5bcc101650 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc00c920 tx=0x7f5bbc00cde0 comp rx=0 tx=0).stop 2024-08-20T01:37:45.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.522+0000 7f5bd24a6640 1 -- 172.21.15.79:0/3267409416 shutdown_connections 2024-08-20T01:37:45.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.522+0000 7f5bd24a6640 1 --2- 172.21.15.79:0/3267409416 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5bb40b3bd0 0x7f5bb40b6090 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:45.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.522+0000 7f5bd24a6640 1 --2- 172.21.15.79:0/3267409416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bcc10ce00 0x7f5bcc1020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:45.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.522+0000 7f5bd24a6640 1 --2- 172.21.15.79:0/3267409416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bcc1042c0 0x7f5bcc101b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:45.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.522+0000 7f5bd24a6640 1 --2- 172.21.15.79:0/3267409416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5bcc1039a0 0x7f5bcc101650 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:45.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.523+0000 7f5bd24a6640 1 -- 172.21.15.79:0/3267409416 >> 172.21.15.79:0/3267409416 conn(0x7f5bcc0fd400 msgr2=0x7f5bcc0fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:45.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.523+0000 7f5bd24a6640 1 -- 172.21.15.79:0/3267409416 shutdown_connections 2024-08-20T01:37:45.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:45.523+0000 7f5bd24a6640 1 -- 172.21.15.79:0/3267409416 wait complete. 2024-08-20T01:37:46.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:45 smithi081 ceph-mon[22209]: pgmap v360: 97 pgs: 97 active+clean; 663 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-20T01:37:46.368 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:45 smithi079 ceph-mon[18656]: pgmap v360: 97 pgs: 97 active+clean; 663 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-20T01:37:46.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:45 smithi175 ceph-mon[22392]: pgmap v360: 97 pgs: 97 active+clean; 663 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-20T01:37:46.397 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T01:37:46.397 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:37:46.649 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:37:46.906 INFO:tasks.workunit.client.0.smithi079.stderr:Updating files: 99% (12058/12088) Updating files: 100% (12088/12088) Updating files: 100% (12088/12088), done. 2024-08-20T01:37:47.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.181+0000 7ff43bf00640 1 -- 172.21.15.79:0/4170416601 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff43410ce00 msgr2=0x7ff43410f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:47.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.181+0000 7ff43bf00640 1 --2- 172.21.15.79:0/4170416601 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff43410ce00 0x7ff43410f260 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ff42c009ca0 tx=0x7ff42c02a8c0 comp rx=0 tx=0).stop 2024-08-20T01:37:47.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.181+0000 7ff43bf00640 1 -- 172.21.15.79:0/4170416601 shutdown_connections 2024-08-20T01:37:47.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.181+0000 7ff43bf00640 1 --2- 172.21.15.79:0/4170416601 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff43410ce00 0x7ff43410f260 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:47.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.181+0000 7ff43bf00640 1 --2- 172.21.15.79:0/4170416601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4341042c0 0x7ff43410c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:47.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.181+0000 7ff43bf00640 1 --2- 172.21.15.79:0/4170416601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4341039a0 0x7ff434103d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:47.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.181+0000 7ff43bf00640 1 -- 172.21.15.79:0/4170416601 >> 172.21.15.79:0/4170416601 conn(0x7ff4340fd400 msgr2=0x7ff4340ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:47.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.181+0000 7ff43bf00640 1 -- 172.21.15.79:0/4170416601 shutdown_connections 2024-08-20T01:37:47.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.181+0000 7ff43bf00640 1 -- 172.21.15.79:0/4170416601 wait complete. 2024-08-20T01:37:47.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.181+0000 7ff43bf00640 1 Processor -- start 2024-08-20T01:37:47.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.181+0000 7ff43bf00640 1 -- start start 2024-08-20T01:37:47.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.182+0000 7ff43bf00640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4341039a0 0x7ff434101650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:47.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.182+0000 7ff43bf00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4341042c0 0x7ff434101b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:47.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.182+0000 7ff43bf00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff43410ce00 0x7ff4341020d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:47.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.182+0000 7ff43bf00640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff434112970 con 0x7ff4341039a0 2024-08-20T01:37:47.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.182+0000 7ff43bf00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff4341127f0 con 0x7ff43410ce00 2024-08-20T01:37:47.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.182+0000 7ff43bf00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff434112af0 con 0x7ff4341042c0 2024-08-20T01:37:47.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.182+0000 7ff439c9c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4341039a0 0x7ff434101650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:47.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.182+0000 7ff439c9c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4341039a0 0x7ff434101650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49970/0 (socket says 172.21.15.79:49970) 2024-08-20T01:37:47.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.182+0000 7ff439c9c640 1 -- 172.21.15.79:0/155069346 learned_addr learned my addr 172.21.15.79:0/155069346 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:47.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.182+0000 7ff43949b640 1 --2- 172.21.15.79:0/155069346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4341042c0 0x7ff434101b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:47.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.182+0000 7ff43a49d640 1 --2- 172.21.15.79:0/155069346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff43410ce00 0x7ff4341020d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:47.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.182+0000 7ff439c9c640 1 -- 172.21.15.79:0/155069346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4341042c0 msgr2=0x7ff434101b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:47.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.182+0000 7ff439c9c640 1 --2- 172.21.15.79:0/155069346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4341042c0 0x7ff434101b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:47.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.182+0000 7ff439c9c640 1 -- 172.21.15.79:0/155069346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff43410ce00 msgr2=0x7ff4341020d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:47.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.182+0000 7ff439c9c640 1 --2- 172.21.15.79:0/155069346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff43410ce00 0x7ff4341020d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:47.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.182+0000 7ff439c9c640 1 -- 172.21.15.79:0/155069346 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4341a72c0 con 0x7ff4341039a0 2024-08-20T01:37:47.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.182+0000 7ff43949b640 1 --2- 172.21.15.79:0/155069346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4341042c0 0x7ff434101b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:37:47.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.182+0000 7ff43a49d640 1 --2- 172.21.15.79:0/155069346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff43410ce00 0x7ff4341020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:37:47.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.182+0000 7ff439c9c640 1 --2- 172.21.15.79:0/155069346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4341039a0 0x7ff434101650 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff42400c970 tx=0x7ff42400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:47.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.182+0000 7ff42affd640 1 -- 172.21.15.79:0/155069346 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff424007bb0 con 0x7ff4341039a0 2024-08-20T01:37:47.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.182+0000 7ff42affd640 1 -- 172.21.15.79:0/155069346 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff424007d50 con 0x7ff4341039a0 2024-08-20T01:37:47.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.182+0000 7ff43bf00640 1 -- 172.21.15.79:0/155069346 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4341a75b0 con 0x7ff4341039a0 2024-08-20T01:37:47.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.182+0000 7ff42affd640 1 -- 172.21.15.79:0/155069346 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff424004e40 con 0x7ff4341039a0 2024-08-20T01:37:47.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.182+0000 7ff43bf00640 1 -- 172.21.15.79:0/155069346 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4341a7aa0 con 0x7ff4341039a0 2024-08-20T01:37:47.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.183+0000 7ff43bf00640 1 -- 172.21.15.79:0/155069346 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff434103d80 con 0x7ff4341039a0 2024-08-20T01:37:47.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.185+0000 7ff42affd640 1 -- 172.21.15.79:0/155069346 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff424005000 con 0x7ff4341039a0 2024-08-20T01:37:47.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.186+0000 7ff42affd640 1 --2- 172.21.15.79:0/155069346 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff4200b3bd0 0x7ff4200b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:47.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.186+0000 7ff43949b640 1 --2- 172.21.15.79:0/155069346 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff4200b3bd0 0x7ff4200b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:47.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.186+0000 7ff42affd640 1 -- 172.21.15.79:0/155069346 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff4240e3df0 con 0x7ff4341039a0 2024-08-20T01:37:47.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.186+0000 7ff43949b640 1 --2- 172.21.15.79:0/155069346 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff4200b3bd0 0x7ff4200b6090 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff430005fd0 tx=0x7ff430005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:47.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.188+0000 7ff42affd640 1 -- 172.21.15.79:0/155069346 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7ff424014030 con 0x7ff4341039a0 2024-08-20T01:37:47.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.407+0000 7ff43bf00640 1 -- 172.21.15.79:0/155069346 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff43402e340 con 0x7ff4341039a0 2024-08-20T01:37:47.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.408+0000 7ff42affd640 1 -- 172.21.15.79:0/155069346 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7ff4240ab450 con 0x7ff4341039a0 2024-08-20T01:37:47.410 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:37:47.411 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":28,"btime":"2024-08-20T01:36:49:088329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14670,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/735082912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":735082912},{"type":"v1","addr":"172.21.15.79:6835","nonce":735082912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2150339873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2150339873},{"type":"v1","addr":"172.21.15.79:6837","nonce":2150339873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:34:55.133562+0000","modified":"2024-08-20T01:36:48.384274+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24539,"mds_1":24538,"mds_2":24523,"mds_3":24514,"mds_4":24512},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14724":{"gid":14724,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/1071242274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1071242274},{"type":"v1","addr":"172.21.15.79:6839","nonce":1071242274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14730":{"gid":14730,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6841/2448977611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":2448977611},{"type":"v1","addr":"172.21.15.79:6841","nonce":2448977611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/1257507005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1257507005},{"type":"v1","addr":"172.21.15.81:6833","nonce":1257507005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1499936216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1499936216},{"type":"v1","addr":"172.21.15.81:6835","nonce":1499936216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/1107229215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1107229215},{"type":"v1","addr":"172.21.15.175:6833","nonce":1107229215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6837/2073598870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2073598870},{"type":"v1","addr":"172.21.15.81:6837","nonce":2073598870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/2552601173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2552601173},{"type":"v1","addr":"172.21.15.175:6835","nonce":2552601173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6837/1767284089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1767284089},{"type":"v1","addr":"172.21.15.175:6837","nonce":1767284089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/1331748742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1331748742},{"type":"v1","addr":"172.21.15.175:6839","nonce":1331748742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/4098410583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":4098410583},{"type":"v1","addr":"172.21.15.81:6839","nonce":4098410583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24539,"qdb_cluster":[24512,24538,24514,24523,24539]},"id":1}]} 2024-08-20T01:37:47.411 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 28 2024-08-20T01:37:47.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.410+0000 7ff43bf00640 1 -- 172.21.15.79:0/155069346 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff4200b3bd0 msgr2=0x7ff4200b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:47.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.410+0000 7ff43bf00640 1 --2- 172.21.15.79:0/155069346 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff4200b3bd0 0x7ff4200b6090 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff430005fd0 tx=0x7ff430005850 comp rx=0 tx=0).stop 2024-08-20T01:37:47.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.410+0000 7ff43bf00640 1 -- 172.21.15.79:0/155069346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4341039a0 msgr2=0x7ff434101650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:47.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.410+0000 7ff43bf00640 1 --2- 172.21.15.79:0/155069346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4341039a0 0x7ff434101650 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff42400c970 tx=0x7ff42400ce30 comp rx=0 tx=0).stop 2024-08-20T01:37:47.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.410+0000 7ff43bf00640 1 -- 172.21.15.79:0/155069346 shutdown_connections 2024-08-20T01:37:47.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.411+0000 7ff43bf00640 1 --2- 172.21.15.79:0/155069346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff43410ce00 0x7ff4341020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:47.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.411+0000 7ff43bf00640 1 --2- 172.21.15.79:0/155069346 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff4200b3bd0 0x7ff4200b6090 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:47.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.411+0000 7ff43bf00640 1 --2- 172.21.15.79:0/155069346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4341042c0 0x7ff434101b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:47.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.411+0000 7ff43bf00640 1 --2- 172.21.15.79:0/155069346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4341039a0 0x7ff434101650 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:47.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.411+0000 7ff43bf00640 1 -- 172.21.15.79:0/155069346 >> 172.21.15.79:0/155069346 conn(0x7ff4340fd400 msgr2=0x7ff4340fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:47.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.411+0000 7ff43bf00640 1 -- 172.21.15.79:0/155069346 shutdown_connections 2024-08-20T01:37:47.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:47.411+0000 7ff43bf00640 1 -- 172.21.15.79:0/155069346 wait complete. 2024-08-20T01:37:47.987 INFO:tasks.workunit.client.0.smithi079.stderr:Note: switching to 'ef4275410d8483698016fe484b2a3c664080b4c1'. 2024-08-20T01:37:47.987 INFO:tasks.workunit.client.0.smithi079.stderr: 2024-08-20T01:37:47.987 INFO:tasks.workunit.client.0.smithi079.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-08-20T01:37:47.988 INFO:tasks.workunit.client.0.smithi079.stderr:changes and commit them, and you can discard any commits you make in this 2024-08-20T01:37:47.988 INFO:tasks.workunit.client.0.smithi079.stderr:state without impacting any branches by switching back to a branch. 2024-08-20T01:37:47.988 INFO:tasks.workunit.client.0.smithi079.stderr: 2024-08-20T01:37:47.988 INFO:tasks.workunit.client.0.smithi079.stderr:If you want to create a new branch to retain commits you create, you may 2024-08-20T01:37:47.988 INFO:tasks.workunit.client.0.smithi079.stderr:do so (now or later) by using -c with the switch command. Example: 2024-08-20T01:37:47.988 INFO:tasks.workunit.client.0.smithi079.stderr: 2024-08-20T01:37:47.988 INFO:tasks.workunit.client.0.smithi079.stderr: git switch -c 2024-08-20T01:37:47.988 INFO:tasks.workunit.client.0.smithi079.stderr: 2024-08-20T01:37:47.988 INFO:tasks.workunit.client.0.smithi079.stderr:Or undo this operation with: 2024-08-20T01:37:47.988 INFO:tasks.workunit.client.0.smithi079.stderr: 2024-08-20T01:37:47.988 INFO:tasks.workunit.client.0.smithi079.stderr: git switch - 2024-08-20T01:37:47.988 INFO:tasks.workunit.client.0.smithi079.stderr: 2024-08-20T01:37:47.989 INFO:tasks.workunit.client.0.smithi079.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-08-20T01:37:47.989 INFO:tasks.workunit.client.0.smithi079.stderr: 2024-08-20T01:37:47.989 INFO:tasks.workunit.client.0.smithi079.stderr:HEAD is now at ef4275410d8 Merge branch 'mds-conf-sorted' of https://github.com/batrick/ceph into wip-hemanth-testing-2024-08-19-1357 2024-08-20T01:37:47.992 DEBUG:teuthology.orchestra.run.smithi079:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-08-20T01:37:48.078 INFO:tasks.workunit.client.0.smithi079.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-08-20T01:37:48.081 INFO:tasks.workunit.client.0.smithi079.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-20T01:37:48.081 INFO:tasks.workunit.client.0.smithi079.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-08-20T01:37:48.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:47 smithi079 ceph-mon[18656]: pgmap v361: 97 pgs: 97 active+clean; 663 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-08-20T01:37:48.236 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:47 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/155069346' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:37:48.248 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-20T01:37:48.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:47 smithi081 ceph-mon[22209]: pgmap v361: 97 pgs: 97 active+clean; 663 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-08-20T01:37:48.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:47 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/155069346' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:37:48.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:47 smithi175 ceph-mon[22392]: pgmap v361: 97 pgs: 97 active+clean; 663 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-08-20T01:37:48.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:47 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/155069346' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:37:48.496 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:37:49.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.006+0000 7f1477b08640 1 -- 172.21.15.79:0/3879844788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f147010a630 msgr2=0x7f147010ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:49.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.006+0000 7f1477b08640 1 --2- 172.21.15.79:0/3879844788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f147010a630 0x7f147010ca20 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f1460009900 tx=0x7f146002a410 comp rx=0 tx=0).stop 2024-08-20T01:37:49.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.006+0000 7f1477b08640 1 -- 172.21.15.79:0/3879844788 shutdown_connections 2024-08-20T01:37:49.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.006+0000 7f1477b08640 1 --2- 172.21.15.79:0/3879844788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f147010cf60 0x7f147010f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.006+0000 7f1477b08640 1 --2- 172.21.15.79:0/3879844788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f147010a630 0x7f147010ca20 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.006+0000 7f1477b08640 1 --2- 172.21.15.79:0/3879844788 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1470101520 0x7f1470101900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.006+0000 7f1477b08640 1 -- 172.21.15.79:0/3879844788 >> 172.21.15.79:0/3879844788 conn(0x7f1470076c80 msgr2=0x7f1470077090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:49.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.006+0000 7f1477b08640 1 -- 172.21.15.79:0/3879844788 shutdown_connections 2024-08-20T01:37:49.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.006+0000 7f1477b08640 1 -- 172.21.15.79:0/3879844788 wait complete. 2024-08-20T01:37:49.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.007+0000 7f1477b08640 1 Processor -- start 2024-08-20T01:37:49.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.007+0000 7f1477b08640 1 -- start start 2024-08-20T01:37:49.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.007+0000 7f1477b08640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1470101520 0x7f1470199080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.007+0000 7f1477b08640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f147010a630 0x7f14701995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.007+0000 7f1477b08640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f147010cf60 0x7f147019e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.007+0000 7f1477b08640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f14701129f0 con 0x7f147010a630 2024-08-20T01:37:49.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.007+0000 7f1477b08640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1470112870 con 0x7f147010cf60 2024-08-20T01:37:49.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.007+0000 7f1477b08640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1470112b70 con 0x7f1470101520 2024-08-20T01:37:49.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.007+0000 7f14750a3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f147010a630 0x7f14701995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.007+0000 7f14750a3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f147010a630 0x7f14701995c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49978/0 (socket says 172.21.15.79:49978) 2024-08-20T01:37:49.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.007+0000 7f14750a3640 1 -- 172.21.15.79:0/3944163860 learned_addr learned my addr 172.21.15.79:0/3944163860 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:49.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.007+0000 7f14758a4640 1 --2- 172.21.15.79:0/3944163860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1470101520 0x7f1470199080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.007+0000 7f14750a3640 1 -- 172.21.15.79:0/3944163860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1470101520 msgr2=0x7f1470199080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:49.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.007+0000 7f14750a3640 1 --2- 172.21.15.79:0/3944163860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1470101520 0x7f1470199080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.007+0000 7f14750a3640 1 -- 172.21.15.79:0/3944163860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f147010cf60 msgr2=0x7f147019e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:49.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.007+0000 7f14750a3640 1 --2- 172.21.15.79:0/3944163860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f147010cf60 0x7f147019e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.007+0000 7f14750a3640 1 -- 172.21.15.79:0/3944163860 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f147019f130 con 0x7f147010a630 2024-08-20T01:37:49.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.008+0000 7f14750a3640 1 --2- 172.21.15.79:0/3944163860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f147010a630 0x7f14701995c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f1460009a20 tx=0x7f1460004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:49.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.008+0000 7f1466ffd640 1 -- 172.21.15.79:0/3944163860 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146003f030 con 0x7f147010a630 2024-08-20T01:37:49.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.008+0000 7f1466ffd640 1 -- 172.21.15.79:0/3944163860 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f14600035f0 con 0x7f147010a630 2024-08-20T01:37:49.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.008+0000 7f1466ffd640 1 -- 172.21.15.79:0/3944163860 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1460035070 con 0x7f147010a630 2024-08-20T01:37:49.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.008+0000 7f1477b08640 1 -- 172.21.15.79:0/3944163860 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f147019f3c0 con 0x7f147010a630 2024-08-20T01:37:49.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.008+0000 7f1477b08640 1 -- 172.21.15.79:0/3944163860 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14701a5ae0 con 0x7f147010a630 2024-08-20T01:37:49.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.011+0000 7f1479f01740 1 Processor -- start 2024-08-20T01:37:49.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.011+0000 7f1479f01740 1 -- start start 2024-08-20T01:37:49.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.011+0000 7f1479f01740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d53f64e880 0x55d53f64ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.011+0000 7f1479f01740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d53f64f1a0 0x55d53f65abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.011+0000 7f1479f01740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d53f65b130 0x55d53f65d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.011+0000 7f1479f01740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d53f5c5930 con 0x55d53f64e880 2024-08-20T01:37:49.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.011+0000 7f1479f01740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d53f5b4e30 con 0x55d53f65b130 2024-08-20T01:37:49.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.011+0000 7f1479f01740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d53f5b8e70 con 0x55d53f64f1a0 2024-08-20T01:37:49.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.011+0000 7f1466ffd640 1 -- 172.21.15.79:0/3944163860 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1460003aa0 con 0x7f147010a630 2024-08-20T01:37:49.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.012+0000 7f14760a5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d53f64e880 0x55d53f64ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.012+0000 7f14760a5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d53f64e880 0x55d53f64ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49990/0 (socket says 172.21.15.79:49990) 2024-08-20T01:37:49.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.012+0000 7f14760a5640 1 -- 172.21.15.79:0/1494275025 learned_addr learned my addr 172.21.15.79:0/1494275025 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:49.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.012+0000 7f14758a4640 1 --2- 172.21.15.79:0/1494275025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d53f64f1a0 0x55d53f65abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.012+0000 7f14750a3640 1 --2- 172.21.15.79:0/1494275025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d53f65b130 0x55d53f65d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.012+0000 7f14760a5640 1 -- 172.21.15.79:0/1494275025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d53f64f1a0 msgr2=0x55d53f65abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:49.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.012+0000 7f14760a5640 1 --2- 172.21.15.79:0/1494275025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d53f64f1a0 0x55d53f65abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.012+0000 7f14760a5640 1 -- 172.21.15.79:0/1494275025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d53f65b130 msgr2=0x55d53f65d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:49.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.012+0000 7f14760a5640 1 --2- 172.21.15.79:0/1494275025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d53f65b130 0x55d53f65d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.012+0000 7f14760a5640 1 -- 172.21.15.79:0/1494275025 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d53f314650 con 0x55d53f64e880 2024-08-20T01:37:49.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.012+0000 7f14750a3640 1 --2- 172.21.15.79:0/1494275025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d53f65b130 0x55d53f65d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:37:49.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.012+0000 7f14760a5640 1 --2- 172.21.15.79:0/1494275025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d53f64e880 0x55d53f64ec60 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f1468009d30 tx=0x7f146800b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd3fd082fc28b1e4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:49.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.012+0000 7f145bfff640 1 -- 172.21.15.79:0/1494275025 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146800bd40 con 0x55d53f64e880 2024-08-20T01:37:49.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.012+0000 7f145bfff640 1 -- 172.21.15.79:0/1494275025 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1468017070 con 0x55d53f64e880 2024-08-20T01:37:49.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.012+0000 7f1466ffd640 1 --2- 172.21.15.79:0/3944163860 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f145c0b3bd0 0x7f145c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.012+0000 7f145bfff640 1 -- 172.21.15.79:0/1494275025 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1468011590 con 0x55d53f64e880 2024-08-20T01:37:49.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.012+0000 7f14758a4640 1 --2- 172.21.15.79:0/3944163860 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f145c0b3bd0 0x7f145c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.013+0000 7f1466ffd640 1 -- 172.21.15.79:0/3944163860 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f14601047d0 con 0x7f147010a630 2024-08-20T01:37:49.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.013+0000 7f14758a4640 1 --2- 172.21.15.79:0/3944163860 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f145c0b3bd0 0x7f145c0b6090 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x55d53f651a00 tx=0x7f146c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:49.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.013+0000 7f1479f01740 1 -- 172.21.15.79:0/1494275025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d53f64e880 msgr2=0x55d53f64ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:49.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.013+0000 7f1479f01740 1 --2- 172.21.15.79:0/1494275025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d53f64e880 0x55d53f64ec60 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f1468009d30 tx=0x7f146800b420 comp rx=0 tx=0).stop 2024-08-20T01:37:49.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.013+0000 7f1479f01740 1 -- 172.21.15.79:0/1494275025 shutdown_connections 2024-08-20T01:37:49.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.013+0000 7f1479f01740 1 --2- 172.21.15.79:0/1494275025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d53f65b130 0x55d53f65d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.013+0000 7f1479f01740 1 --2- 172.21.15.79:0/1494275025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d53f64f1a0 0x55d53f65abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.013+0000 7f1479f01740 1 --2- 172.21.15.79:0/1494275025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d53f64e880 0x55d53f64ec60 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.013+0000 7f1479f01740 1 -- 172.21.15.79:0/1494275025 >> 172.21.15.79:0/1494275025 conn(0x55d53f64c6b0 msgr2=0x55d53f64d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:49.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.013+0000 7f1479f01740 1 -- 172.21.15.79:0/1494275025 shutdown_connections 2024-08-20T01:37:49.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.013+0000 7f1479f01740 1 -- 172.21.15.79:0/1494275025 wait complete. 2024-08-20T01:37:49.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.014+0000 7f1479f01740 1 -- start start 2024-08-20T01:37:49.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.014+0000 7f1479f01740 1 Processor -- start 2024-08-20T01:37:49.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.014+0000 7f1479f01740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d53f64e880 0x55d53f6580a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.014+0000 7f1479f01740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d53f64f1a0 0x55d53f6585e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.014+0000 7f1479f01740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d53f65b130 0x55d53f658b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.014+0000 7f1479f01740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d53f417700 con 0x55d53f65b130 2024-08-20T01:37:49.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.014+0000 7f1479f01740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d53f53b810 con 0x55d53f64f1a0 2024-08-20T01:37:49.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.014+0000 7f1479f01740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d53f65dde0 con 0x55d53f64e880 2024-08-20T01:37:49.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.014+0000 7f1479f01740 10 client.0 _ll_register_callbacks cb 0x55d53f5ae700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:49.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.014+0000 7f14760a5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d53f65b130 0x55d53f658b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.014+0000 7f14760a5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d53f65b130 0x55d53f658b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50002/0 (socket says 172.21.15.79:50002) 2024-08-20T01:37:49.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.014+0000 7f14760a5640 1 -- 172.21.15.79:0/433589161 learned_addr learned my addr 172.21.15.79:0/433589161 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:49.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.014+0000 7f14758a4640 1 --2- 172.21.15.79:0/433589161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d53f64e880 0x55d53f6580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.014+0000 7f14750a3640 1 --2- 172.21.15.79:0/433589161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d53f64f1a0 0x55d53f6585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.015+0000 7f14760a5640 1 -- 172.21.15.79:0/433589161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d53f64e880 msgr2=0x55d53f6580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:49.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.015+0000 7f14760a5640 1 --2- 172.21.15.79:0/433589161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d53f64e880 0x55d53f6580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.015+0000 7f14760a5640 1 -- 172.21.15.79:0/433589161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d53f64f1a0 msgr2=0x55d53f6585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:49.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.015+0000 7f14760a5640 1 --2- 172.21.15.79:0/433589161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d53f64f1a0 0x55d53f6585e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.015+0000 7f14760a5640 1 -- 172.21.15.79:0/433589161 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d53f667160 con 0x55d53f65b130 2024-08-20T01:37:49.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.015+0000 7f14750a3640 1 --2- 172.21.15.79:0/433589161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d53f64f1a0 0x55d53f6585e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:37:49.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.015+0000 7f14760a5640 1 --2- 172.21.15.79:0/433589161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d53f65b130 0x55d53f658b20 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f1468012c60 tx=0x7f1468012c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=618fadaa3967dd75 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:49.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.015+0000 7f14597fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:37:49.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.015+0000 7f14597fa640 1 -- 172.21.15.79:0/433589161 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146801b600 con 0x55d53f65b130 2024-08-20T01:37:49.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.015+0000 7f14597fa640 1 -- 172.21.15.79:0/433589161 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f146801b7a0 con 0x55d53f65b130 2024-08-20T01:37:49.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.015+0000 7f1479f01740 1 -- 172.21.15.79:0/433589161 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d53f564150 con 0x55d53f65b130 2024-08-20T01:37:49.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.015+0000 7f14597fa640 1 -- 172.21.15.79:0/433589161 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f146801b9a0 con 0x55d53f65b130 2024-08-20T01:37:49.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.015+0000 7f1479f01740 10 client.15651 fetch_fsmap learned FSMap version 28 2024-08-20T01:37:49.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.015+0000 7f1479f01740 1 -- 172.21.15.79:0/433589161 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d53f669b10 con 0x55d53f65b130 2024-08-20T01:37:49.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.015+0000 7f14597fa640 1 -- 172.21.15.79:0/433589161 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55d53f564150 con 0x55d53f65b130 2024-08-20T01:37:49.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.016+0000 7f14597fa640 1 -- 172.21.15.79:0/433589161 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1468011070 con 0x55d53f65b130 2024-08-20T01:37:49.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.016+0000 7f1479f01740 10 client.15651 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:37:49.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.016+0000 7f1479f01740 10 client.15651 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:37:49.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.016+0000 7f1479f01740 20 client.15651 populate_metadata read hostname 'smithi079' 2024-08-20T01:37:49.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.016+0000 7f1479f01740 1 --2- 172.21.15.79:0/433589161 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55d53f66af70 0x55d53f66d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.016+0000 7f1479f01740 4 client.15651 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:37:49.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.016+0000 7f1479f01740 1 -- 172.21.15.79:0/433589161 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d53f5c7880 con 0x55d53f66af70 2024-08-20T01:37:49.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.016+0000 7f14758a4640 1 --2- 172.21.15.79:0/433589161 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55d53f66af70 0x55d53f66d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.016+0000 7f14597fa640 10 client.15651 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:37:49.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.016+0000 7f14758a4640 1 --2- 172.21.15.79:0/433589161 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55d53f66af70 0x55d53f66d360 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8be46a47526baa35 server_cookie=bc5db739e7dc732c in_seq=0 out_seq=0 2024-08-20T01:37:49.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.017+0000 7f14597fa640 1 -- 172.21.15.79:0/433589161 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d53f5c7880 con 0x55d53f66af70 2024-08-20T01:37:49.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.017+0000 7f14597fa640 10 client.15651 handle_command_reply: tid=0 2024-08-20T01:37:49.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.017+0000 7f1479f01740 1 client.15651 shutdown 2024-08-20T01:37:49.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.017+0000 7f1479f01740 1 -- 172.21.15.79:0/433589161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d53f65b130 msgr2=0x55d53f658b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:49.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.017+0000 7f1479f01740 1 --2- 172.21.15.79:0/433589161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d53f65b130 0x55d53f658b20 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f1468012c60 tx=0x7f1468012c90 comp rx=0 tx=0).stop 2024-08-20T01:37:49.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.017+0000 7f1479f01740 1 -- 172.21.15.79:0/433589161 shutdown_connections 2024-08-20T01:37:49.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.017+0000 7f1479f01740 1 --2- 172.21.15.79:0/433589161 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55d53f66af70 0x55d53f66d360 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.017+0000 7f1479f01740 1 --2- 172.21.15.79:0/433589161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d53f65b130 0x55d53f658b20 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.017+0000 7f14597fa640 0 client.15651 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:37:49.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.017+0000 7f1479f01740 1 --2- 172.21.15.79:0/433589161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d53f64f1a0 0x55d53f6585e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.017+0000 7f1479f01740 1 --2- 172.21.15.79:0/433589161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d53f64e880 0x55d53f6580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.017+0000 7f1479f01740 1 -- 172.21.15.79:0/433589161 >> 172.21.15.79:0/433589161 conn(0x55d53f64c6b0 msgr2=0x55d53f652250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:49.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.017+0000 7f1479f01740 1 -- 172.21.15.79:0/433589161 shutdown_connections 2024-08-20T01:37:49.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.017+0000 7f1479f01740 1 -- 172.21.15.79:0/433589161 wait complete. 2024-08-20T01:37:49.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.018+0000 7f1479f01740 20 client.15651 trim_cache size 0 max 16384 2024-08-20T01:37:49.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.030+0000 7f1479f01740 1 Processor -- start 2024-08-20T01:37:49.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.030+0000 7f1479f01740 1 -- start start 2024-08-20T01:37:49.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.030+0000 7f1479f01740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d53f64e880 0x55d53f652a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.030+0000 7f1479f01740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d53f64f1a0 0x55d53f657800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.030+0000 7f1479f01740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d53f65b130 0x55d53f672990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.030+0000 7f1479f01740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f14701ae0a0 con 0x55d53f64e880 2024-08-20T01:37:49.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.030+0000 7f1479f01740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f14701afbe0 con 0x55d53f65b130 2024-08-20T01:37:49.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.030+0000 7f1479f01740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f14701ae770 con 0x55d53f64f1a0 2024-08-20T01:37:49.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.031+0000 7f14758a4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d53f64e880 0x55d53f652a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.031+0000 7f14758a4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d53f64e880 0x55d53f652a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50008/0 (socket says 172.21.15.79:50008) 2024-08-20T01:37:49.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.031+0000 7f14758a4640 1 -- 172.21.15.79:0/400438048 learned_addr learned my addr 172.21.15.79:0/400438048 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:49.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.031+0000 7f14760a5640 1 --2- 172.21.15.79:0/400438048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d53f65b130 0x55d53f672990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.031+0000 7f14750a3640 1 --2- 172.21.15.79:0/400438048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d53f64f1a0 0x55d53f657800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.031+0000 7f14758a4640 1 -- 172.21.15.79:0/400438048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d53f64f1a0 msgr2=0x55d53f657800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:49.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.031+0000 7f14758a4640 1 --2- 172.21.15.79:0/400438048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d53f64f1a0 0x55d53f657800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.031+0000 7f14758a4640 1 -- 172.21.15.79:0/400438048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d53f65b130 msgr2=0x55d53f672990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:49.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.031+0000 7f14758a4640 1 --2- 172.21.15.79:0/400438048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d53f65b130 0x55d53f672990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.031+0000 7f14758a4640 1 -- 172.21.15.79:0/400438048 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d53f64d130 con 0x55d53f64e880 2024-08-20T01:37:49.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.031+0000 7f14760a5640 1 --2- 172.21.15.79:0/400438048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d53f65b130 0x55d53f672990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:37:49.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.031+0000 7f14750a3640 1 --2- 172.21.15.79:0/400438048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d53f64f1a0 0x55d53f657800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:37:49.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.031+0000 7f14758a4640 1 --2- 172.21.15.79:0/400438048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d53f64e880 0x55d53f652a40 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f146c010c20 tx=0x7f146c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d5a5da43a0cac00 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:49.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.031+0000 7f145b7fe640 1 -- 172.21.15.79:0/400438048 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146c01c040 con 0x55d53f64e880 2024-08-20T01:37:49.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.031+0000 7f145b7fe640 1 -- 172.21.15.79:0/400438048 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f146c02f070 con 0x55d53f64e880 2024-08-20T01:37:49.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.031+0000 7f145b7fe640 1 -- 172.21.15.79:0/400438048 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146c023b50 con 0x55d53f64e880 2024-08-20T01:37:49.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.032+0000 7f1479f01740 1 -- 172.21.15.79:0/400438048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d53f64e880 msgr2=0x55d53f652a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:49.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.032+0000 7f1479f01740 1 --2- 172.21.15.79:0/400438048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d53f64e880 0x55d53f652a40 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f146c010c20 tx=0x7f146c013000 comp rx=0 tx=0).stop 2024-08-20T01:37:49.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.032+0000 7f1479f01740 1 -- 172.21.15.79:0/400438048 shutdown_connections 2024-08-20T01:37:49.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.032+0000 7f1479f01740 1 --2- 172.21.15.79:0/400438048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d53f65b130 0x55d53f672990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.032+0000 7f1479f01740 1 --2- 172.21.15.79:0/400438048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d53f64f1a0 0x55d53f657800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.032+0000 7f1479f01740 1 --2- 172.21.15.79:0/400438048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d53f64e880 0x55d53f652a40 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.032+0000 7f1479f01740 1 -- 172.21.15.79:0/400438048 >> 172.21.15.79:0/400438048 conn(0x55d53f64c6b0 msgr2=0x55d53f659ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:49.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.032+0000 7f1479f01740 1 -- 172.21.15.79:0/400438048 shutdown_connections 2024-08-20T01:37:49.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.032+0000 7f1479f01740 1 -- 172.21.15.79:0/400438048 wait complete. 2024-08-20T01:37:49.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.032+0000 7f1479f01740 1 -- start start 2024-08-20T01:37:49.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.032+0000 7f1479f01740 1 Processor -- start 2024-08-20T01:37:49.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.033+0000 7f1479f01740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d53f64e880 0x55d53f663900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.033+0000 7f1479f01740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d53f64f1a0 0x55d53f65e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.033+0000 7f1479f01740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d53f65b130 0x55d53f65e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.033+0000 7f1479f01740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f14701af510 con 0x55d53f64e880 2024-08-20T01:37:49.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.033+0000 7f1479f01740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f14701aee40 con 0x55d53f64f1a0 2024-08-20T01:37:49.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.033+0000 7f1479f01740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f14701ac080 con 0x55d53f65b130 2024-08-20T01:37:49.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.033+0000 7f1479f01740 10 client.0 _ll_register_callbacks cb 0x7f146c00b180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:49.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.033+0000 7f14758a4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d53f64e880 0x55d53f663900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.033+0000 7f14758a4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d53f64e880 0x55d53f663900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50016/0 (socket says 172.21.15.79:50016) 2024-08-20T01:37:49.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.033+0000 7f14758a4640 1 -- 172.21.15.79:0/3595441607 learned_addr learned my addr 172.21.15.79:0/3595441607 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:49.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.033+0000 7f14750a3640 1 --2- 172.21.15.79:0/3595441607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d53f64f1a0 0x55d53f65e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.033+0000 7f14760a5640 1 --2- 172.21.15.79:0/3595441607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d53f65b130 0x55d53f65e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.033+0000 7f14758a4640 1 -- 172.21.15.79:0/3595441607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d53f65b130 msgr2=0x55d53f65e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:49.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.033+0000 7f14758a4640 1 --2- 172.21.15.79:0/3595441607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d53f65b130 0x55d53f65e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.033+0000 7f14758a4640 1 -- 172.21.15.79:0/3595441607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d53f64f1a0 msgr2=0x55d53f65e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:49.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.033+0000 7f14758a4640 1 --2- 172.21.15.79:0/3595441607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d53f64f1a0 0x55d53f65e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.033+0000 7f14758a4640 1 -- 172.21.15.79:0/3595441607 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d53f6d3950 con 0x55d53f64e880 2024-08-20T01:37:49.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.033+0000 7f14760a5640 1 --2- 172.21.15.79:0/3595441607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d53f65b130 0x55d53f65e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:37:49.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.033+0000 7f14750a3640 1 --2- 172.21.15.79:0/3595441607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d53f64f1a0 0x55d53f65e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:37:49.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.033+0000 7f14758a4640 1 --2- 172.21.15.79:0/3595441607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d53f64e880 0x55d53f663900 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f146c004810 tx=0x7f146c0234b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef0e1b8a522f9ce2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:49.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.033+0000 7f14597fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:37:49.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.033+0000 7f14597fa640 1 -- 172.21.15.79:0/3595441607 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146c01c050 con 0x55d53f64e880 2024-08-20T01:37:49.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.033+0000 7f14597fa640 1 -- 172.21.15.79:0/3595441607 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f146c023cd0 con 0x55d53f64e880 2024-08-20T01:37:49.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.033+0000 7f1479f01740 1 -- 172.21.15.79:0/3595441607 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f146c02f070 con 0x55d53f64e880 2024-08-20T01:37:49.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.034+0000 7f14597fa640 1 -- 172.21.15.79:0/3595441607 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f146c0059c0 con 0x55d53f64e880 2024-08-20T01:37:49.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.034+0000 7f1479f01740 10 client.15657 fetch_fsmap learned FSMap version 28 2024-08-20T01:37:49.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.034+0000 7f1479f01740 1 -- 172.21.15.79:0/3595441607 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d53f6d4b10 con 0x55d53f64e880 2024-08-20T01:37:49.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.034+0000 7f14597fa640 1 -- 172.21.15.79:0/3595441607 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f146c02f070 con 0x55d53f64e880 2024-08-20T01:37:49.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.034+0000 7f14597fa640 1 -- 172.21.15.79:0/3595441607 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f146c006620 con 0x55d53f64e880 2024-08-20T01:37:49.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.034+0000 7f1479f01740 10 client.15657 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:37:49.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.034+0000 7f1479f01740 10 client.15657 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:37:49.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.034+0000 7f1479f01740 20 client.15657 populate_metadata read hostname 'smithi079' 2024-08-20T01:37:49.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.034+0000 7f1479f01740 1 --2- 172.21.15.79:0/3595441607 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55d53f6d5220 0x55d53f6d7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.111 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:37:49.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.034+0000 7f1479f01740 4 client.15657 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:37:49.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.034+0000 7f1479f01740 1 -- 172.21.15.79:0/3595441607 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d53f5c3320 con 0x55d53f6d5220 2024-08-20T01:37:49.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.034+0000 7f14750a3640 1 --2- 172.21.15.79:0/3595441607 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55d53f6d5220 0x55d53f6d7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.035+0000 7f14750a3640 1 --2- 172.21.15.79:0/3595441607 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55d53f6d5220 0x55d53f6d7640 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e6f7cf8192d4fefc server_cookie=c4fa2dc8f5c271a4 in_seq=0 out_seq=0 2024-08-20T01:37:49.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.035+0000 7f14597fa640 10 client.15657 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:37:49.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.035+0000 7f14597fa640 1 -- 172.21.15.79:0/3595441607 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d53f5c3320 con 0x55d53f6d5220 2024-08-20T01:37:49.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.035+0000 7f14597fa640 10 client.15657 handle_command_reply: tid=0 2024-08-20T01:37:49.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.035+0000 7f1479f01740 1 client.15657 shutdown 2024-08-20T01:37:49.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.035+0000 7f1479f01740 1 -- 172.21.15.79:0/3595441607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d53f64e880 msgr2=0x55d53f663900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:49.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.035+0000 7f1479f01740 1 --2- 172.21.15.79:0/3595441607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d53f64e880 0x55d53f663900 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f146c004810 tx=0x7f146c0234b0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.035+0000 7f1479f01740 1 -- 172.21.15.79:0/3595441607 shutdown_connections 2024-08-20T01:37:49.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.035+0000 7f1479f01740 1 --2- 172.21.15.79:0/3595441607 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55d53f6d5220 0x55d53f6d7640 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.035+0000 7f1479f01740 1 --2- 172.21.15.79:0/3595441607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d53f65b130 0x55d53f65e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.035+0000 7f1479f01740 1 --2- 172.21.15.79:0/3595441607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d53f64f1a0 0x55d53f65e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.035+0000 7f1479f01740 1 --2- 172.21.15.79:0/3595441607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d53f64e880 0x55d53f663900 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.035+0000 7f14597fa640 0 client.15657 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:37:49.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.035+0000 7f1479f01740 1 -- 172.21.15.79:0/3595441607 >> 172.21.15.79:0/3595441607 conn(0x55d53f64c6b0 msgr2=0x55d53f64af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:49.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.035+0000 7f1479f01740 1 -- 172.21.15.79:0/3595441607 shutdown_connections 2024-08-20T01:37:49.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.035+0000 7f1479f01740 1 -- 172.21.15.79:0/3595441607 wait complete. 2024-08-20T01:37:49.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.035+0000 7f1479f01740 20 client.15657 trim_cache size 0 max 16384 2024-08-20T01:37:49.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.036+0000 7f1477b08640 1 -- 172.21.15.79:0/3944163860 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f145c0b3bd0 msgr2=0x7f145c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:49.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.036+0000 7f1477b08640 1 --2- 172.21.15.79:0/3944163860 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f145c0b3bd0 0x7f145c0b6090 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x55d53f651a00 tx=0x7f146c008040 comp rx=0 tx=0).stop 2024-08-20T01:37:49.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.036+0000 7f1477b08640 1 -- 172.21.15.79:0/3944163860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f147010a630 msgr2=0x7f14701995c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:49.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.036+0000 7f1477b08640 1 --2- 172.21.15.79:0/3944163860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f147010a630 0x7f14701995c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f1460009a20 tx=0x7f1460004270 comp rx=0 tx=0).stop 2024-08-20T01:37:49.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.036+0000 7f1477b08640 1 -- 172.21.15.79:0/3944163860 shutdown_connections 2024-08-20T01:37:49.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.036+0000 7f1477b08640 1 --2- 172.21.15.79:0/3944163860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f147010cf60 0x7f147019e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.036+0000 7f1477b08640 1 --2- 172.21.15.79:0/3944163860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f147010a630 0x7f14701995c0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.036+0000 7f1477b08640 1 --2- 172.21.15.79:0/3944163860 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f145c0b3bd0 0x7f145c0b6090 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.036+0000 7f1477b08640 1 --2- 172.21.15.79:0/3944163860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1470101520 0x7f1470199080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.036+0000 7f1477b08640 1 -- 172.21.15.79:0/3944163860 >> 172.21.15.79:0/3944163860 conn(0x7f1470076c80 msgr2=0x7f14701002b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:49.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.036+0000 7f1477b08640 1 -- 172.21.15.79:0/3944163860 shutdown_connections 2024-08-20T01:37:49.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:49.036+0000 7f1477b08640 1 -- 172.21.15.79:0/3944163860 wait complete. 2024-08-20T01:37:49.580 INFO:tasks.workunit.client.0.smithi079.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-08-20T01:37:49.699 INFO:tasks.workunit.client.0.smithi079.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-08-20T01:37:49.741 INFO:tasks.workunit.client.0.smithi079.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-20T01:37:49.742 INFO:tasks.workunit.client.0.smithi079.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-20T01:37:49.742 INFO:tasks.workunit.client.0.smithi079.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-08-20T01:37:49.782 INFO:tasks.workunit.client.0.smithi079.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-20T01:37:49.786 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-08-20T01:37:49.786 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-08-20T01:37:49.808 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.0... 2024-08-20T01:37:49.809 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2024-08-20T01:37:49.809 DEBUG:teuthology.orchestra.run.smithi079:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ef4275410d8483698016fe484b2a3c664080b4c1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-08-20T01:37:49.880 INFO:tasks.workunit.client.0.smithi079.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-08-20T01:37:49.881 INFO:tasks.workunit.client.0.smithi079.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/suites 2024-08-20T01:37:49.881 INFO:tasks.workunit.client.0.smithi079.stderr:+ trap -- retry EXIT 2024-08-20T01:37:49.881 INFO:tasks.workunit.client.0.smithi079.stderr:+ rm -rf ffsb 2024-08-20T01:37:49.882 INFO:tasks.workunit.client.0.smithi079.stderr:+ timeout 1800 git clone https://git.ceph.com/ffsb.git --depth 1 2024-08-20T01:37:49.886 INFO:tasks.workunit.client.0.smithi079.stderr:Cloning into 'ffsb'... 2024-08-20T01:37:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.887+0000 7facf3d06640 1 -- 172.21.15.79:0/911854373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facec1030b0 msgr2=0x7facec109a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.887+0000 7facf3d06640 1 --2- 172.21.15.79:0/911854373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facec1030b0 0x7facec109a30 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7face4009cd0 tx=0x7face402a8e0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.887+0000 7facf3d06640 1 -- 172.21.15.79:0/911854373 shutdown_connections 2024-08-20T01:37:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.887+0000 7facf3d06640 1 --2- 172.21.15.79:0/911854373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facec1030b0 0x7facec109a30 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.887+0000 7facf3d06640 1 --2- 172.21.15.79:0/911854373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facec1026f0 0x7facec102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.887+0000 7facf3d06640 1 --2- 172.21.15.79:0/911854373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facec1015a0 0x7facec1019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.887+0000 7facf3d06640 1 -- 172.21.15.79:0/911854373 >> 172.21.15.79:0/911854373 conn(0x7facec0fce60 msgr2=0x7facec0ff280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.887+0000 7facf3d06640 1 -- 172.21.15.79:0/911854373 shutdown_connections 2024-08-20T01:37:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.887+0000 7facf3d06640 1 -- 172.21.15.79:0/911854373 wait complete. 2024-08-20T01:37:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.887+0000 7facf3d06640 1 Processor -- start 2024-08-20T01:37:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.887+0000 7facf3d06640 1 -- start start 2024-08-20T01:37:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.887+0000 7facf3d06640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facec1015a0 0x7facec1978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.888+0000 7facf3d06640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facec1026f0 0x7facec197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.888+0000 7facf3d06640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facec1030b0 0x7facec198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.888+0000 7facf3d06640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7facec10d0a0 con 0x7facec1026f0 2024-08-20T01:37:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.888+0000 7facf3d06640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7facec10cf20 con 0x7facec1030b0 2024-08-20T01:37:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.888+0000 7facf3d06640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7facec10d220 con 0x7facec1015a0 2024-08-20T01:37:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.888+0000 7facf12a1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facec1026f0 0x7facec197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.888+0000 7facf12a1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facec1026f0 0x7facec197f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50042/0 (socket says 172.21.15.79:50042) 2024-08-20T01:37:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.888+0000 7facf12a1640 1 -- 172.21.15.79:0/1705970387 learned_addr learned my addr 172.21.15.79:0/1705970387 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.888+0000 7facf22a3640 1 --2- 172.21.15.79:0/1705970387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facec1030b0 0x7facec198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.888+0000 7facf1aa2640 1 --2- 172.21.15.79:0/1705970387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facec1015a0 0x7facec1978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.888+0000 7facf12a1640 1 -- 172.21.15.79:0/1705970387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facec1015a0 msgr2=0x7facec1978b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.888+0000 7facf12a1640 1 --2- 172.21.15.79:0/1705970387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facec1015a0 0x7facec1978b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.888+0000 7facf12a1640 1 -- 172.21.15.79:0/1705970387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facec1030b0 msgr2=0x7facec198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.888+0000 7facf12a1640 1 --2- 172.21.15.79:0/1705970387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facec1030b0 0x7facec198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.888+0000 7facf12a1640 1 -- 172.21.15.79:0/1705970387 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facec1993f0 con 0x7facec1026f0 2024-08-20T01:37:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.888+0000 7facf12a1640 1 --2- 172.21.15.79:0/1705970387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facec1026f0 0x7facec197f00 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7facdc00c890 tx=0x7facdc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.888+0000 7face2ffd640 1 -- 172.21.15.79:0/1705970387 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facdc004220 con 0x7facec1026f0 2024-08-20T01:37:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.888+0000 7face2ffd640 1 -- 172.21.15.79:0/1705970387 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7facdc007e40 con 0x7facec1026f0 2024-08-20T01:37:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.888+0000 7face2ffd640 1 -- 172.21.15.79:0/1705970387 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facdc004a00 con 0x7facec1026f0 2024-08-20T01:37:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.888+0000 7facf3d06640 1 -- 172.21.15.79:0/1705970387 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facec1996e0 con 0x7facec1026f0 2024-08-20T01:37:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.888+0000 7facf3d06640 1 -- 172.21.15.79:0/1705970387 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facec19fdb0 con 0x7facec1026f0 2024-08-20T01:37:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.891+0000 7facf6bce740 1 Processor -- start 2024-08-20T01:37:49.895 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.891+0000 7facf6bce740 1 -- start start 2024-08-20T01:37:49.895 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.891+0000 7facf6bce740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e2ff91840 0x561e2ff93c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.895 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.891+0000 7face2ffd640 1 -- 172.21.15.79:0/1705970387 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7facdc0079b0 con 0x7facec1026f0 2024-08-20T01:37:49.895 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.891+0000 7facf6bce740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e2ff94170 0x561e2ff96560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.895 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.891+0000 7facf6bce740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e2ff96bb0 0x561e2ff99070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.895 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.891+0000 7facf6bce740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561e2ff02360 con 0x561e2ff91840 2024-08-20T01:37:49.895 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.891+0000 7facf6bce740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561e2fef1860 con 0x561e2ff96bb0 2024-08-20T01:37:49.895 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.891+0000 7facf6bce740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561e2fef58a0 con 0x561e2ff94170 2024-08-20T01:37:49.898 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.892+0000 7facf22a3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e2ff91840 0x561e2ff93c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.898 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.892+0000 7facf22a3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e2ff91840 0x561e2ff93c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50048/0 (socket says 172.21.15.79:50048) 2024-08-20T01:37:49.898 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.892+0000 7facf22a3640 1 -- 172.21.15.79:0/4164391317 learned_addr learned my addr 172.21.15.79:0/4164391317 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:49.898 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.892+0000 7facf12a1640 1 --2- 172.21.15.79:0/4164391317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e2ff96bb0 0x561e2ff99070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.898 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.892+0000 7facf1aa2640 1 --2- 172.21.15.79:0/4164391317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e2ff94170 0x561e2ff96560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.899 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.892+0000 7facf22a3640 1 -- 172.21.15.79:0/4164391317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e2ff94170 msgr2=0x561e2ff96560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:49.899 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.892+0000 7facf22a3640 1 --2- 172.21.15.79:0/4164391317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e2ff94170 0x561e2ff96560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.899 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.892+0000 7facf22a3640 1 -- 172.21.15.79:0/4164391317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e2ff96bb0 msgr2=0x561e2ff99070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:49.899 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.892+0000 7facf22a3640 1 --2- 172.21.15.79:0/4164391317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e2ff96bb0 0x561e2ff99070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.899 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.892+0000 7facf22a3640 1 -- 172.21.15.79:0/4164391317 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e2fe98e40 con 0x561e2ff91840 2024-08-20T01:37:49.899 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.892+0000 7facf22a3640 1 --2- 172.21.15.79:0/4164391317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e2ff91840 0x561e2ff93c30 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7face4009cd0 tx=0x7face4009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44fc72ac9fa8b8b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:49.899 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.892+0000 7facd7fff640 1 -- 172.21.15.79:0/4164391317 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face4048070 con 0x561e2ff91840 2024-08-20T01:37:49.899 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.892+0000 7facd7fff640 1 -- 172.21.15.79:0/4164391317 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7face4036070 con 0x561e2ff91840 2024-08-20T01:37:49.899 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.892+0000 7facd7fff640 1 -- 172.21.15.79:0/4164391317 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face4004510 con 0x561e2ff91840 2024-08-20T01:37:49.899 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.892+0000 7face2ffd640 1 --2- 172.21.15.79:0/1705970387 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7facd80b3bd0 0x7facd80b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.899 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.893+0000 7facf1aa2640 1 --2- 172.21.15.79:0/1705970387 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7facd80b3bd0 0x7facd80b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.900 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.893+0000 7face2ffd640 1 -- 172.21.15.79:0/1705970387 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7facdc0e3930 con 0x7facec1026f0 2024-08-20T01:37:49.900 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.893+0000 7facf6bce740 1 -- 172.21.15.79:0/4164391317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e2ff91840 msgr2=0x561e2ff93c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:49.900 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.893+0000 7facf1aa2640 1 --2- 172.21.15.79:0/1705970387 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7facd80b3bd0 0x7facd80b6090 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7face8009cf0 tx=0x7face8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:49.900 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.893+0000 7facf6bce740 1 --2- 172.21.15.79:0/4164391317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e2ff91840 0x561e2ff93c30 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7face4009cd0 tx=0x7face4009a20 comp rx=0 tx=0).stop 2024-08-20T01:37:49.900 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.893+0000 7facf6bce740 1 -- 172.21.15.79:0/4164391317 shutdown_connections 2024-08-20T01:37:49.900 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.893+0000 7facf6bce740 1 --2- 172.21.15.79:0/4164391317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e2ff96bb0 0x561e2ff99070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.900 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.893+0000 7facf6bce740 1 --2- 172.21.15.79:0/4164391317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e2ff94170 0x561e2ff96560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.900 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.893+0000 7facf6bce740 1 --2- 172.21.15.79:0/4164391317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e2ff91840 0x561e2ff93c30 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.900 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.893+0000 7facf6bce740 1 -- 172.21.15.79:0/4164391317 >> 172.21.15.79:0/4164391317 conn(0x561e2ff8c940 msgr2=0x561e2ff8d720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:49.900 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.893+0000 7facf6bce740 1 -- 172.21.15.79:0/4164391317 shutdown_connections 2024-08-20T01:37:49.900 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.893+0000 7facf6bce740 1 -- 172.21.15.79:0/4164391317 wait complete. 2024-08-20T01:37:49.900 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.894+0000 7facf6bce740 1 -- start start 2024-08-20T01:37:49.901 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.894+0000 7facf6bce740 1 Processor -- start 2024-08-20T01:37:49.901 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.894+0000 7facf6bce740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e2ff91840 0x561e2ff9b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.901 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.894+0000 7facf6bce740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e2ff94170 0x561e2ff9b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.901 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.894+0000 7facf6bce740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e2ff96bb0 0x561e2ff9c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.901 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.894+0000 7facf6bce740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561e2fe2aab0 con 0x561e2ff94170 2024-08-20T01:37:49.901 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.894+0000 7facf6bce740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561e2fe78780 con 0x561e2ff91840 2024-08-20T01:37:49.901 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.894+0000 7facf6bce740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561e2ff99b30 con 0x561e2ff96bb0 2024-08-20T01:37:49.901 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.894+0000 7facf6bce740 10 client.0 _ll_register_callbacks cb 0x561e2fc00a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:49.901 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.894+0000 7facf12a1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e2ff94170 0x561e2ff9b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.901 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.894+0000 7facf12a1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e2ff94170 0x561e2ff9b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50052/0 (socket says 172.21.15.79:50052) 2024-08-20T01:37:49.901 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.894+0000 7facf12a1640 1 -- 172.21.15.79:0/3208134247 learned_addr learned my addr 172.21.15.79:0/3208134247 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:49.904 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.894+0000 7facf1aa2640 1 --2- 172.21.15.79:0/3208134247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e2ff91840 0x561e2ff9b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.904 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.895+0000 7facf12a1640 1 -- 172.21.15.79:0/3208134247 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e2ff96bb0 msgr2=0x561e2ff9c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:49.904 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.895+0000 7facf12a1640 1 --2- 172.21.15.79:0/3208134247 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e2ff96bb0 0x561e2ff9c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.904 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.895+0000 7facf12a1640 1 -- 172.21.15.79:0/3208134247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e2ff91840 msgr2=0x561e2ff9b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:49.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.895+0000 7facf12a1640 1 --2- 172.21.15.79:0/3208134247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e2ff91840 0x561e2ff9b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.895+0000 7facf12a1640 1 -- 172.21.15.79:0/3208134247 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e2fc54790 con 0x561e2ff94170 2024-08-20T01:37:49.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.895+0000 7facf12a1640 1 --2- 172.21.15.79:0/3208134247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e2ff94170 0x561e2ff9b720 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7facdc0aa820 tx=0x7facdc0a6750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86d0912d329653d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:49.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.895+0000 7facd57fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:37:49.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.895+0000 7facd57fa640 1 -- 172.21.15.79:0/3208134247 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facdc01d030 con 0x561e2ff94170 2024-08-20T01:37:49.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.895+0000 7facd57fa640 1 -- 172.21.15.79:0/3208134247 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7facdc0043c0 con 0x561e2ff94170 2024-08-20T01:37:49.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.895+0000 7facf6bce740 1 -- 172.21.15.79:0/3208134247 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561e2fea0e00 con 0x561e2ff94170 2024-08-20T01:37:49.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.895+0000 7facd57fa640 1 -- 172.21.15.79:0/3208134247 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7facdc0aa000 con 0x561e2ff94170 2024-08-20T01:37:49.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.895+0000 7facf6bce740 10 client.15669 fetch_fsmap learned FSMap version 28 2024-08-20T01:37:49.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.895+0000 7facf6bce740 1 -- 172.21.15.79:0/3208134247 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561e2fccd620 con 0x561e2ff94170 2024-08-20T01:37:49.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.895+0000 7facd57fa640 1 -- 172.21.15.79:0/3208134247 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x561e2fea0e00 con 0x561e2ff94170 2024-08-20T01:37:49.906 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.896+0000 7facd57fa640 1 -- 172.21.15.79:0/3208134247 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7facdc0a6200 con 0x561e2ff94170 2024-08-20T01:37:49.906 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.896+0000 7facf6bce740 10 client.15669 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:37:49.906 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.896+0000 7facf6bce740 10 client.15669 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:37:49.906 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.896+0000 7facf6bce740 20 client.15669 populate_metadata read hostname 'smithi079' 2024-08-20T01:37:49.906 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.896+0000 7facf6bce740 1 --2- 172.21.15.79:0/3208134247 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x561e2ffa6930 0x561e2ffa8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.906 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.896+0000 7facf6bce740 4 client.15669 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:37:49.906 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.896+0000 7facf6bce740 1 -- 172.21.15.79:0/3208134247 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e2ff042b0 con 0x561e2ffa6930 2024-08-20T01:37:49.906 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.896+0000 7facf1aa2640 1 --2- 172.21.15.79:0/3208134247 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x561e2ffa6930 0x561e2ffa8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.906 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.896+0000 7facf1aa2640 1 --2- 172.21.15.79:0/3208134247 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x561e2ffa6930 0x561e2ffa8d20 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfea0aec3d40be5 server_cookie=76af35d577339233 in_seq=0 out_seq=0 2024-08-20T01:37:49.906 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.896+0000 7facd57fa640 10 client.15669 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:37:49.906 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.898+0000 7facd57fa640 1 -- 172.21.15.79:0/3208134247 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561e2ff042b0 con 0x561e2ffa6930 2024-08-20T01:37:49.906 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.898+0000 7facd57fa640 10 client.15669 handle_command_reply: tid=0 2024-08-20T01:37:49.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.898+0000 7facf6bce740 1 client.15669 shutdown 2024-08-20T01:37:49.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.898+0000 7facf6bce740 1 -- 172.21.15.79:0/3208134247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e2ff94170 msgr2=0x561e2ff9b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:49.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.898+0000 7facf6bce740 1 --2- 172.21.15.79:0/3208134247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e2ff94170 0x561e2ff9b720 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7facdc0aa820 tx=0x7facdc0a6750 comp rx=0 tx=0).stop 2024-08-20T01:37:49.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.898+0000 7facf6bce740 1 -- 172.21.15.79:0/3208134247 shutdown_connections 2024-08-20T01:37:49.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.898+0000 7facf6bce740 1 --2- 172.21.15.79:0/3208134247 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x561e2ffa6930 0x561e2ffa8d20 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.898+0000 7facf6bce740 1 --2- 172.21.15.79:0/3208134247 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e2ff96bb0 0x561e2ff9c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.898+0000 7facd57fa640 0 client.15669 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:37:49.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.898+0000 7facf6bce740 1 --2- 172.21.15.79:0/3208134247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e2ff94170 0x561e2ff9b720 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.898+0000 7facf6bce740 1 --2- 172.21.15.79:0/3208134247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e2ff91840 0x561e2ff9b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.898+0000 7facf6bce740 1 -- 172.21.15.79:0/3208134247 >> 172.21.15.79:0/3208134247 conn(0x561e2ff8c940 msgr2=0x561e2ff89850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:49.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.898+0000 7facf6bce740 1 -- 172.21.15.79:0/3208134247 shutdown_connections 2024-08-20T01:37:49.908 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.898+0000 7facf6bce740 1 -- 172.21.15.79:0/3208134247 wait complete. 2024-08-20T01:37:49.908 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.898+0000 7facf6bce740 20 client.15669 trim_cache size 0 max 16384 2024-08-20T01:37:49.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.915+0000 7facf6bce740 1 Processor -- start 2024-08-20T01:37:49.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.915+0000 7facf6bce740 1 -- start start 2024-08-20T01:37:49.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.915+0000 7facf6bce740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e2ff91840 0x561e2ff89030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.915+0000 7facf6bce740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e2ff94170 0x561e2ff89570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.915+0000 7facf6bce740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e2ff96bb0 0x561e2ff89ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.915+0000 7facf6bce740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7facec1a7910 con 0x561e2ff91840 2024-08-20T01:37:49.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.915+0000 7facf6bce740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7facec1a9450 con 0x561e2ff96bb0 2024-08-20T01:37:49.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.915+0000 7facf6bce740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7facec1a7fe0 con 0x561e2ff94170 2024-08-20T01:37:49.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.916+0000 7facf1aa2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e2ff91840 0x561e2ff89030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.916+0000 7facf22a3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e2ff96bb0 0x561e2ff89ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.916+0000 7facf12a1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e2ff94170 0x561e2ff89570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.916+0000 7facf1aa2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e2ff91840 0x561e2ff89030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50060/0 (socket says 172.21.15.79:50060) 2024-08-20T01:37:49.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.916+0000 7facf1aa2640 1 -- 172.21.15.79:0/2228436837 learned_addr learned my addr 172.21.15.79:0/2228436837 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:49.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.916+0000 7facf22a3640 1 -- 172.21.15.79:0/2228436837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e2ff94170 msgr2=0x561e2ff89570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:49.920 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.916+0000 7facf22a3640 1 --2- 172.21.15.79:0/2228436837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e2ff94170 0x561e2ff89570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.920 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.916+0000 7facf22a3640 1 -- 172.21.15.79:0/2228436837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e2ff91840 msgr2=0x561e2ff89030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:49.920 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.916+0000 7facf22a3640 1 --2- 172.21.15.79:0/2228436837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e2ff91840 0x561e2ff89030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.920 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.916+0000 7facf22a3640 1 -- 172.21.15.79:0/2228436837 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e2ff9c660 con 0x561e2ff96bb0 2024-08-20T01:37:49.920 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.916+0000 7facf1aa2640 1 --2- 172.21.15.79:0/2228436837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e2ff91840 0x561e2ff89030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:37:49.920 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.916+0000 7facf22a3640 1 --2- 172.21.15.79:0/2228436837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e2ff96bb0 0x561e2ff89ab0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7face402ae00 tx=0x7face4005fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4141c21d8395454 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:49.920 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.916+0000 7facd77fe640 1 -- 172.21.15.79:0/2228436837 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face4053070 con 0x561e2ff96bb0 2024-08-20T01:37:49.920 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.916+0000 7facd77fe640 1 -- 172.21.15.79:0/2228436837 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7face4036040 con 0x561e2ff96bb0 2024-08-20T01:37:49.920 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.916+0000 7facd77fe640 1 -- 172.21.15.79:0/2228436837 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face4048040 con 0x561e2ff96bb0 2024-08-20T01:37:49.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.917+0000 7facf6bce740 1 -- 172.21.15.79:0/2228436837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e2ff96bb0 msgr2=0x561e2ff89ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:49.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.917+0000 7facf6bce740 1 --2- 172.21.15.79:0/2228436837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e2ff96bb0 0x561e2ff89ab0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7face402ae00 tx=0x7face4005fa0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.917+0000 7facf6bce740 1 -- 172.21.15.79:0/2228436837 shutdown_connections 2024-08-20T01:37:49.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.917+0000 7facf6bce740 1 --2- 172.21.15.79:0/2228436837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e2ff96bb0 0x561e2ff89ab0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.917+0000 7facf6bce740 1 --2- 172.21.15.79:0/2228436837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e2ff94170 0x561e2ff89570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.917+0000 7facf6bce740 1 --2- 172.21.15.79:0/2228436837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e2ff91840 0x561e2ff89030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.917+0000 7facf6bce740 1 -- 172.21.15.79:0/2228436837 >> 172.21.15.79:0/2228436837 conn(0x561e2ff8c940 msgr2=0x561e2ff98600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:49.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.917+0000 7facf6bce740 1 -- 172.21.15.79:0/2228436837 shutdown_connections 2024-08-20T01:37:49.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.917+0000 7facf6bce740 1 -- 172.21.15.79:0/2228436837 wait complete. 2024-08-20T01:37:49.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.918+0000 7facf6bce740 1 -- start start 2024-08-20T01:37:49.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.918+0000 7facf6bce740 1 Processor -- start 2024-08-20T01:37:49.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.918+0000 7facf6bce740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e2ff91840 0x561e2ffa0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.918+0000 7facf6bce740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e2ff94170 0x561e2ffa06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.918+0000 7facf6bce740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e2ff96bb0 0x561e2ffa12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.918+0000 7facf6bce740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7facec1a8d80 con 0x561e2ff96bb0 2024-08-20T01:37:49.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.918+0000 7facf6bce740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7facec1a86b0 con 0x561e2ff94170 2024-08-20T01:37:49.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.918+0000 7facf6bce740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7facec1a58f0 con 0x561e2ff91840 2024-08-20T01:37:49.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.918+0000 7facf6bce740 10 client.0 _ll_register_callbacks cb 0x7facdc0e9240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:49.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.918+0000 7facf22a3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e2ff96bb0 0x561e2ffa12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.918+0000 7facf1aa2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e2ff91840 0x561e2ffa0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.918+0000 7facf12a1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e2ff94170 0x561e2ffa06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.918+0000 7facf1aa2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e2ff91840 0x561e2ffa0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:60408/0 (socket says 172.21.15.79:60408) 2024-08-20T01:37:49.926 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.918+0000 7facf22a3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e2ff96bb0 0x561e2ffa12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50064/0 (socket says 172.21.15.79:50064) 2024-08-20T01:37:49.926 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.918+0000 7facf1aa2640 1 -- 172.21.15.79:0/4178680587 learned_addr learned my addr 172.21.15.79:0/4178680587 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:49.926 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.919+0000 7facf22a3640 1 -- 172.21.15.79:0/4178680587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e2ff91840 msgr2=0x561e2ffa0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:49.926 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.919+0000 7facf22a3640 1 --2- 172.21.15.79:0/4178680587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e2ff91840 0x561e2ffa0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.926 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.919+0000 7facf22a3640 1 -- 172.21.15.79:0/4178680587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e2ff94170 msgr2=0x561e2ffa06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:49.926 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.919+0000 7facf22a3640 1 --2- 172.21.15.79:0/4178680587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e2ff94170 0x561e2ffa06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.926 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.919+0000 7facf22a3640 1 -- 172.21.15.79:0/4178680587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e2ffa1af0 con 0x561e2ff96bb0 2024-08-20T01:37:49.926 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.919+0000 7facf1aa2640 1 --2- 172.21.15.79:0/4178680587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e2ff91840 0x561e2ffa0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:37:49.926 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.919+0000 7facf22a3640 1 --2- 172.21.15.79:0/4178680587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e2ff96bb0 0x561e2ffa12c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x561e2ff89ff0 tx=0x7face4003da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf9149f81906195 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:49.926 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.919+0000 7facd57fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:37:49.926 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.919+0000 7facd57fa640 1 -- 172.21.15.79:0/4178680587 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face4053070 con 0x561e2ff96bb0 2024-08-20T01:37:49.926 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.919+0000 7facd57fa640 1 -- 172.21.15.79:0/4178680587 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7face40042b0 con 0x561e2ff96bb0 2024-08-20T01:37:49.927 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.919+0000 7facf6bce740 1 -- 172.21.15.79:0/4178680587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7face4036040 con 0x561e2ff96bb0 2024-08-20T01:37:49.927 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.919+0000 7facd57fa640 1 -- 172.21.15.79:0/4178680587 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7face4048070 con 0x561e2ff96bb0 2024-08-20T01:37:49.927 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.919+0000 7facf6bce740 10 client.15675 fetch_fsmap learned FSMap version 28 2024-08-20T01:37:49.927 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.919+0000 7facf6bce740 1 -- 172.21.15.79:0/4178680587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561e2ffa2e60 con 0x561e2ff96bb0 2024-08-20T01:37:49.927 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.919+0000 7facd57fa640 1 -- 172.21.15.79:0/4178680587 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7face4036040 con 0x561e2ff96bb0 2024-08-20T01:37:49.927 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.920+0000 7facd57fa640 1 -- 172.21.15.79:0/4178680587 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7face4042030 con 0x561e2ff96bb0 2024-08-20T01:37:49.927 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.920+0000 7facf6bce740 10 client.15675 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:37:49.927 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.920+0000 7facf6bce740 10 client.15675 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:37:49.927 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.920+0000 7facf6bce740 20 client.15675 populate_metadata read hostname 'smithi079' 2024-08-20T01:37:49.927 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.920+0000 7facf6bce740 1 --2- 172.21.15.79:0/4178680587 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x561e30011610 0x561e30013a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:49.927 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.920+0000 7facf6bce740 4 client.15675 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:37:49.927 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.920+0000 7facf6bce740 1 -- 172.21.15.79:0/4178680587 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561e2feffd50 con 0x561e30011610 2024-08-20T01:37:49.928 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.920+0000 7facf1aa2640 1 --2- 172.21.15.79:0/4178680587 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x561e30011610 0x561e30013a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:49.928 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.920+0000 7facd57fa640 10 client.15675 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:37:49.928 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.920+0000 7facf1aa2640 1 --2- 172.21.15.79:0/4178680587 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x561e30011610 0x561e30013a00 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e13ae7743f7afcb2 server_cookie=f209ed7d8b69a92f in_seq=0 out_seq=0 2024-08-20T01:37:49.991 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.989+0000 7facd57fa640 1 -- 172.21.15.79:0/4178680587 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561e2feffd50 con 0x561e30011610 2024-08-20T01:37:49.992 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.989+0000 7facd57fa640 10 client.15675 handle_command_reply: tid=0 2024-08-20T01:37:49.992 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.989+0000 7facf6bce740 1 client.15675 shutdown 2024-08-20T01:37:49.992 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.989+0000 7facf6bce740 1 -- 172.21.15.79:0/4178680587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e2ff96bb0 msgr2=0x561e2ffa12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:49.992 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.989+0000 7facf6bce740 1 --2- 172.21.15.79:0/4178680587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e2ff96bb0 0x561e2ffa12c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x561e2ff89ff0 tx=0x7face4003da0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.992 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.989+0000 7facf6bce740 1 -- 172.21.15.79:0/4178680587 shutdown_connections 2024-08-20T01:37:49.992 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.989+0000 7facf6bce740 1 --2- 172.21.15.79:0/4178680587 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x561e30011610 0x561e30013a00 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.992 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.989+0000 7facf6bce740 1 --2- 172.21.15.79:0/4178680587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e2ff96bb0 0x561e2ffa12c0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.992 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.989+0000 7facf6bce740 1 --2- 172.21.15.79:0/4178680587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e2ff94170 0x561e2ffa06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.992 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.989+0000 7facd57fa640 0 client.15675 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:37:49.992 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.989+0000 7facf6bce740 1 --2- 172.21.15.79:0/4178680587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e2ff91840 0x561e2ffa0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.992 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.989+0000 7facf6bce740 1 -- 172.21.15.79:0/4178680587 >> 172.21.15.79:0/4178680587 conn(0x561e2ff8c940 msgr2=0x561e2ff89030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:49.993 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.989+0000 7facf6bce740 1 -- 172.21.15.79:0/4178680587 shutdown_connections 2024-08-20T01:37:49.993 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.989+0000 7facf6bce740 1 -- 172.21.15.79:0/4178680587 wait complete. 2024-08-20T01:37:49.993 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.989+0000 7facf6bce740 20 client.15675 trim_cache size 0 max 16384 2024-08-20T01:37:49.993 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:37:49.993 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:37:49.993 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:37:49.993 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:37:49.994 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.990+0000 7facf3d06640 1 -- 172.21.15.79:0/1705970387 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7facd80b3bd0 msgr2=0x7facd80b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:49.994 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.990+0000 7facf3d06640 1 --2- 172.21.15.79:0/1705970387 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7facd80b3bd0 0x7facd80b6090 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7face8009cf0 tx=0x7face8005f90 comp rx=0 tx=0).stop 2024-08-20T01:37:49.994 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.990+0000 7facf3d06640 1 -- 172.21.15.79:0/1705970387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facec1026f0 msgr2=0x7facec197f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:49.994 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.990+0000 7facf3d06640 1 --2- 172.21.15.79:0/1705970387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facec1026f0 0x7facec197f00 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7facdc00c890 tx=0x7facdc00cd50 comp rx=0 tx=0).stop 2024-08-20T01:37:49.994 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.990+0000 7facf3d06640 1 -- 172.21.15.79:0/1705970387 shutdown_connections 2024-08-20T01:37:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.990+0000 7facf3d06640 1 --2- 172.21.15.79:0/1705970387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facec1030b0 0x7facec198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.990+0000 7facf3d06640 1 --2- 172.21.15.79:0/1705970387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facec1026f0 0x7facec197f00 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.990+0000 7facf3d06640 1 --2- 172.21.15.79:0/1705970387 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7facd80b3bd0 0x7facd80b6090 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.990+0000 7facf3d06640 1 --2- 172.21.15.79:0/1705970387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facec1015a0 0x7facec1978b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.990+0000 7facf3d06640 1 -- 172.21.15.79:0/1705970387 >> 172.21.15.79:0/1705970387 conn(0x7facec0fce60 msgr2=0x7facec103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.990+0000 7facf3d06640 1 -- 172.21.15.79:0/1705970387 shutdown_connections 2024-08-20T01:37:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:37:49.990+0000 7facf3d06640 1 -- 172.21.15.79:0/1705970387 wait complete. 2024-08-20T01:37:50.049 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-20T01:37:50.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:49 smithi081 ceph-mon[22209]: pgmap v362: 97 pgs: 97 active+clean; 663 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-08-20T01:37:50.353 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:37:50.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:49 smithi175 ceph-mon[22392]: pgmap v362: 97 pgs: 97 active+clean; 663 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-08-20T01:37:50.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:49 smithi079 ceph-mon[18656]: pgmap v362: 97 pgs: 97 active+clean; 663 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-08-20T01:37:50.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.860+0000 7ff628629640 1 -- 172.21.15.79:0/3459290079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff620107d40 msgr2=0x7ff62010e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:50.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.860+0000 7ff628629640 1 --2- 172.21.15.79:0/3459290079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff620107d40 0x7ff62010e540 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff618009ca0 tx=0x7ff61802a8c0 comp rx=0 tx=0).stop 2024-08-20T01:37:50.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.861+0000 7ff628629640 1 -- 172.21.15.79:0/3459290079 shutdown_connections 2024-08-20T01:37:50.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.861+0000 7ff628629640 1 --2- 172.21.15.79:0/3459290079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff620107d40 0x7ff62010e540 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:50.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.861+0000 7ff628629640 1 --2- 172.21.15.79:0/3459290079 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6201073c0 0x7ff620107800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:50.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.861+0000 7ff628629640 1 --2- 172.21.15.79:0/3459290079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6201019b0 0x7ff620101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:50.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.861+0000 7ff628629640 1 -- 172.21.15.79:0/3459290079 >> 172.21.15.79:0/3459290079 conn(0x7ff6200fd460 msgr2=0x7ff6200ff880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:50.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.861+0000 7ff628629640 1 -- 172.21.15.79:0/3459290079 shutdown_connections 2024-08-20T01:37:50.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.861+0000 7ff628629640 1 -- 172.21.15.79:0/3459290079 wait complete. 2024-08-20T01:37:50.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.861+0000 7ff628629640 1 Processor -- start 2024-08-20T01:37:50.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.861+0000 7ff628629640 1 -- start start 2024-08-20T01:37:50.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.861+0000 7ff628629640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6201019b0 0x7ff620198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:50.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.861+0000 7ff628629640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6201073c0 0x7ff6201993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:50.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.861+0000 7ff628629640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff620107d40 0x7ff62019e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:50.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.861+0000 7ff628629640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff6201118c0 con 0x7ff620107d40 2024-08-20T01:37:50.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.861+0000 7ff628629640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff620111740 con 0x7ff6201019b0 2024-08-20T01:37:50.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.861+0000 7ff628629640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff620111a40 con 0x7ff6201073c0 2024-08-20T01:37:50.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.862+0000 7ff626bc6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff620107d40 0x7ff62019e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:50.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.862+0000 7ff626bc6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff620107d40 0x7ff62019e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45214/0 (socket says 172.21.15.79:45214) 2024-08-20T01:37:50.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.862+0000 7ff626bc6640 1 -- 172.21.15.79:0/2475670105 learned_addr learned my addr 172.21.15.79:0/2475670105 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:50.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.862+0000 7ff6263c5640 1 --2- 172.21.15.79:0/2475670105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6201019b0 0x7ff620198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:50.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.862+0000 7ff625bc4640 1 --2- 172.21.15.79:0/2475670105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6201073c0 0x7ff6201993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:50.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.862+0000 7ff626bc6640 1 -- 172.21.15.79:0/2475670105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6201073c0 msgr2=0x7ff6201993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:50.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.862+0000 7ff626bc6640 1 --2- 172.21.15.79:0/2475670105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6201073c0 0x7ff6201993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:50.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.862+0000 7ff626bc6640 1 -- 172.21.15.79:0/2475670105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6201019b0 msgr2=0x7ff620198e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:50.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.862+0000 7ff626bc6640 1 --2- 172.21.15.79:0/2475670105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6201019b0 0x7ff620198e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:50.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.862+0000 7ff626bc6640 1 -- 172.21.15.79:0/2475670105 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff62019ef20 con 0x7ff620107d40 2024-08-20T01:37:50.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.862+0000 7ff625bc4640 1 --2- 172.21.15.79:0/2475670105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6201073c0 0x7ff6201993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:37:50.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.862+0000 7ff6263c5640 1 --2- 172.21.15.79:0/2475670105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6201019b0 0x7ff620198e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:37:50.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.862+0000 7ff626bc6640 1 --2- 172.21.15.79:0/2475670105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff620107d40 0x7ff62019e750 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff618005cc0 tx=0x7ff618003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:50.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.862+0000 7ff6177fe640 1 -- 172.21.15.79:0/2475670105 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff618032c10 con 0x7ff620107d40 2024-08-20T01:37:50.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.862+0000 7ff628629640 1 -- 172.21.15.79:0/2475670105 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff62019f1b0 con 0x7ff620107d40 2024-08-20T01:37:50.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.862+0000 7ff6177fe640 1 -- 172.21.15.79:0/2475670105 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff618032db0 con 0x7ff620107d40 2024-08-20T01:37:50.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.862+0000 7ff6177fe640 1 -- 172.21.15.79:0/2475670105 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff618030a60 con 0x7ff620107d40 2024-08-20T01:37:50.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.862+0000 7ff628629640 1 -- 172.21.15.79:0/2475670105 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6201a58d0 con 0x7ff620107d40 2024-08-20T01:37:50.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.865+0000 7ff6177fe640 1 -- 172.21.15.79:0/2475670105 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff618030c20 con 0x7ff620107d40 2024-08-20T01:37:50.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.865+0000 7ff62aa22740 1 Processor -- start 2024-08-20T01:37:50.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.865+0000 7ff62aa22740 1 -- start start 2024-08-20T01:37:50.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.865+0000 7ff62aa22740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a8683f880 0x560a8683fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:50.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.865+0000 7ff62aa22740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a868401a0 0x560a8684bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:50.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.865+0000 7ff62aa22740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a8684c130 0x560a8684e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:50.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.865+0000 7ff62aa22740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560a867b6930 con 0x560a8683f880 2024-08-20T01:37:50.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.865+0000 7ff62aa22740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560a867a5e30 con 0x560a868401a0 2024-08-20T01:37:50.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.865+0000 7ff62aa22740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560a867a9e70 con 0x560a8684c130 2024-08-20T01:37:50.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.866+0000 7ff625bc4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a8683f880 0x560a8683fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:50.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.866+0000 7ff6263c5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a868401a0 0x560a8684bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:50.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.866+0000 7ff625bc4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a8683f880 0x560a8683fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45220/0 (socket says 172.21.15.79:45220) 2024-08-20T01:37:50.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.866+0000 7ff625bc4640 1 -- 172.21.15.79:0/2799871655 learned_addr learned my addr 172.21.15.79:0/2799871655 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:50.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.866+0000 7ff6263c5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a868401a0 0x560a8684bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:46044/0 (socket says 172.21.15.79:46044) 2024-08-20T01:37:50.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.866+0000 7ff625bc4640 1 --2- 172.21.15.79:0/2799871655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a8684c130 0x560a8684e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:50.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.866+0000 7ff625bc4640 1 -- 172.21.15.79:0/2799871655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a8684c130 msgr2=0x560a8684e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:50.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.866+0000 7ff625bc4640 1 --2- 172.21.15.79:0/2799871655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a8684c130 0x560a8684e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:50.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.866+0000 7ff625bc4640 1 -- 172.21.15.79:0/2799871655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a868401a0 msgr2=0x560a8684bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:50.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.866+0000 7ff625bc4640 1 --2- 172.21.15.79:0/2799871655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a868401a0 0x560a8684bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:50.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.866+0000 7ff625bc4640 1 -- 172.21.15.79:0/2799871655 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a86505650 con 0x560a8683f880 2024-08-20T01:37:50.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.866+0000 7ff6263c5640 1 --2- 172.21.15.79:0/2799871655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a868401a0 0x560a8684bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:37:50.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.866+0000 7ff6177fe640 1 --2- 172.21.15.79:0/2475670105 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff60c0b3bd0 0x7ff60c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:50.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.866+0000 7ff625bc4640 1 --2- 172.21.15.79:0/2799871655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a8683f880 0x560a8683fc60 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff6100135c0 tx=0x7ff6100097d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f20ed4ac8f2189ca server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:50.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.866+0000 7ff6263c5640 1 --2- 172.21.15.79:0/2475670105 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff60c0b3bd0 0x7ff60c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:50.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.866+0000 7ff6177fe640 1 -- 172.21.15.79:0/2475670105 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff618104f90 con 0x7ff620107d40 2024-08-20T01:37:50.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.866+0000 7ff614ff9640 1 -- 172.21.15.79:0/2799871655 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff61000f520 con 0x560a8683f880 2024-08-20T01:37:50.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.866+0000 7ff614ff9640 1 -- 172.21.15.79:0/2799871655 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff61000fb50 con 0x560a8683f880 2024-08-20T01:37:50.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.866+0000 7ff614ff9640 1 -- 172.21.15.79:0/2799871655 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff610011910 con 0x560a8683f880 2024-08-20T01:37:50.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.867+0000 7ff62aa22740 1 -- 172.21.15.79:0/2799871655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a8683f880 msgr2=0x560a8683fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:50.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.867+0000 7ff6263c5640 1 --2- 172.21.15.79:0/2475670105 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff60c0b3bd0 0x7ff60c0b6090 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff61c009fd0 tx=0x7ff61c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:50.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.867+0000 7ff62aa22740 1 --2- 172.21.15.79:0/2799871655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a8683f880 0x560a8683fc60 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff6100135c0 tx=0x7ff6100097d0 comp rx=0 tx=0).stop 2024-08-20T01:37:50.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.867+0000 7ff62aa22740 1 -- 172.21.15.79:0/2799871655 shutdown_connections 2024-08-20T01:37:50.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.867+0000 7ff62aa22740 1 --2- 172.21.15.79:0/2799871655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a8684c130 0x560a8684e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:50.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.867+0000 7ff62aa22740 1 --2- 172.21.15.79:0/2799871655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a868401a0 0x560a8684bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:50.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.867+0000 7ff62aa22740 1 --2- 172.21.15.79:0/2799871655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a8683f880 0x560a8683fc60 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:50.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.867+0000 7ff62aa22740 1 -- 172.21.15.79:0/2799871655 >> 172.21.15.79:0/2799871655 conn(0x560a8683d6b0 msgr2=0x560a8683e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:50.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.867+0000 7ff62aa22740 1 -- 172.21.15.79:0/2799871655 shutdown_connections 2024-08-20T01:37:50.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.867+0000 7ff62aa22740 1 -- 172.21.15.79:0/2799871655 wait complete. 2024-08-20T01:37:50.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.868+0000 7ff62aa22740 1 -- start start 2024-08-20T01:37:50.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.868+0000 7ff62aa22740 1 Processor -- start 2024-08-20T01:37:50.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.868+0000 7ff62aa22740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a8683f880 0x560a86849160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:50.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.868+0000 7ff62aa22740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a868401a0 0x560a868496a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:50.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.868+0000 7ff62aa22740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a8684c130 0x560a86849be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:50.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.868+0000 7ff62aa22740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560a86608700 con 0x560a8683f880 2024-08-20T01:37:50.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.868+0000 7ff62aa22740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560a8672c810 con 0x560a8684c130 2024-08-20T01:37:50.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.868+0000 7ff62aa22740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560a8684ede0 con 0x560a868401a0 2024-08-20T01:37:50.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.868+0000 7ff62aa22740 10 client.0 _ll_register_callbacks cb 0x560a8679f700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:50.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.868+0000 7ff6263c5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a8683f880 0x560a86849160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:50.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.868+0000 7ff6263c5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a8683f880 0x560a86849160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45236/0 (socket says 172.21.15.79:45236) 2024-08-20T01:37:50.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.868+0000 7ff6263c5640 1 -- 172.21.15.79:0/1437434021 learned_addr learned my addr 172.21.15.79:0/1437434021 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:50.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.868+0000 7ff626bc6640 1 --2- 172.21.15.79:0/1437434021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a8684c130 0x560a86849be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:50.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.868+0000 7ff625bc4640 1 --2- 172.21.15.79:0/1437434021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a868401a0 0x560a868496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:50.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.869+0000 7ff6263c5640 1 -- 172.21.15.79:0/1437434021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a868401a0 msgr2=0x560a868496a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:50.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.869+0000 7ff6263c5640 1 --2- 172.21.15.79:0/1437434021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a868401a0 0x560a868496a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:50.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.869+0000 7ff6263c5640 1 -- 172.21.15.79:0/1437434021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a8684c130 msgr2=0x560a86849be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:50.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.869+0000 7ff6263c5640 1 --2- 172.21.15.79:0/1437434021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a8684c130 0x560a86849be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:50.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.869+0000 7ff6263c5640 1 -- 172.21.15.79:0/1437434021 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a868582a0 con 0x560a8683f880 2024-08-20T01:37:50.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.869+0000 7ff626bc6640 1 --2- 172.21.15.79:0/1437434021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a8684c130 0x560a86849be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:37:50.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.869+0000 7ff6263c5640 1 --2- 172.21.15.79:0/1437434021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a8683f880 0x560a86849160 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff61c012ed0 tx=0x7ff61c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8adff8a6c4ab13 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:50.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.869+0000 7ff609ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:37:50.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.869+0000 7ff609ffb640 1 -- 172.21.15.79:0/1437434021 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff61c00fe20 con 0x560a8683f880 2024-08-20T01:37:50.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.869+0000 7ff609ffb640 1 -- 172.21.15.79:0/1437434021 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff61c011b50 con 0x560a8683f880 2024-08-20T01:37:50.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.869+0000 7ff62aa22740 1 -- 172.21.15.79:0/1437434021 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560a86755150 con 0x560a8683f880 2024-08-20T01:37:50.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.869+0000 7ff609ffb640 1 -- 172.21.15.79:0/1437434021 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff61c011d50 con 0x560a8683f880 2024-08-20T01:37:50.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.869+0000 7ff62aa22740 10 client.15687 fetch_fsmap learned FSMap version 28 2024-08-20T01:37:50.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.869+0000 7ff62aa22740 1 -- 172.21.15.79:0/1437434021 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560a8685ac90 con 0x560a8683f880 2024-08-20T01:37:50.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.869+0000 7ff609ffb640 1 -- 172.21.15.79:0/1437434021 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x560a86755150 con 0x560a8683f880 2024-08-20T01:37:50.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.869+0000 7ff609ffb640 1 -- 172.21.15.79:0/1437434021 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff61c027070 con 0x560a8683f880 2024-08-20T01:37:50.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.869+0000 7ff62aa22740 10 client.15687 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:37:50.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.869+0000 7ff62aa22740 10 client.15687 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:37:50.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.870+0000 7ff62aa22740 20 client.15687 populate_metadata read hostname 'smithi079' 2024-08-20T01:37:50.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.870+0000 7ff62aa22740 1 --2- 172.21.15.79:0/1437434021 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x560a8685c190 0x560a8685e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:50.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.870+0000 7ff62aa22740 4 client.15687 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:37:50.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.870+0000 7ff62aa22740 1 -- 172.21.15.79:0/1437434021 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560a867b8880 con 0x560a8685c190 2024-08-20T01:37:50.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.870+0000 7ff625bc4640 1 --2- 172.21.15.79:0/1437434021 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x560a8685c190 0x560a8685e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:50.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.870+0000 7ff609ffb640 10 client.15687 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:37:50.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.870+0000 7ff625bc4640 1 --2- 172.21.15.79:0/1437434021 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x560a8685c190 0x560a8685e5f0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=25e1f403932efdab server_cookie=4168c24f03b7e187 in_seq=0 out_seq=0 2024-08-20T01:37:50.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.871+0000 7ff609ffb640 1 -- 172.21.15.79:0/1437434021 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560a867b8880 con 0x560a8685c190 2024-08-20T01:37:50.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.871+0000 7ff609ffb640 10 client.15687 handle_command_reply: tid=0 2024-08-20T01:37:50.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.871+0000 7ff62aa22740 1 client.15687 shutdown 2024-08-20T01:37:50.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.871+0000 7ff62aa22740 1 -- 172.21.15.79:0/1437434021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a8683f880 msgr2=0x560a86849160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:50.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.871+0000 7ff62aa22740 1 --2- 172.21.15.79:0/1437434021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a8683f880 0x560a86849160 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff61c012ed0 tx=0x7ff61c004730 comp rx=0 tx=0).stop 2024-08-20T01:37:50.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.871+0000 7ff62aa22740 1 -- 172.21.15.79:0/1437434021 shutdown_connections 2024-08-20T01:37:50.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.871+0000 7ff62aa22740 1 --2- 172.21.15.79:0/1437434021 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x560a8685c190 0x560a8685e5f0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:50.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.871+0000 7ff62aa22740 1 --2- 172.21.15.79:0/1437434021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a8684c130 0x560a86849be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:50.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.871+0000 7ff62aa22740 1 --2- 172.21.15.79:0/1437434021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a868401a0 0x560a868496a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:50.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.871+0000 7ff609ffb640 0 client.15687 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:37:50.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.871+0000 7ff62aa22740 1 --2- 172.21.15.79:0/1437434021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a8683f880 0x560a86849160 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:50.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.871+0000 7ff62aa22740 1 -- 172.21.15.79:0/1437434021 >> 172.21.15.79:0/1437434021 conn(0x560a8683d6b0 msgr2=0x560a86843250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:50.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.871+0000 7ff62aa22740 1 -- 172.21.15.79:0/1437434021 shutdown_connections 2024-08-20T01:37:50.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.871+0000 7ff62aa22740 1 -- 172.21.15.79:0/1437434021 wait complete. 2024-08-20T01:37:50.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.872+0000 7ff62aa22740 20 client.15687 trim_cache size 0 max 16384 2024-08-20T01:37:50.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.886+0000 7ff62aa22740 1 Processor -- start 2024-08-20T01:37:50.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.886+0000 7ff62aa22740 1 -- start start 2024-08-20T01:37:50.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.886+0000 7ff62aa22740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a8683f880 0x560a8684b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:50.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.886+0000 7ff62aa22740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a868401a0 0x560a86863ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:50.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.886+0000 7ff62aa22740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a8684c130 0x560a86864400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:50.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.886+0000 7ff62aa22740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff6201adf30 con 0x560a8683f880 2024-08-20T01:37:50.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.886+0000 7ff62aa22740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff6201afa70 con 0x560a8684c130 2024-08-20T01:37:50.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.886+0000 7ff62aa22740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff6201ae600 con 0x560a868401a0 2024-08-20T01:37:50.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.886+0000 7ff6263c5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a8683f880 0x560a8684b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:50.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.886+0000 7ff6263c5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a8683f880 0x560a8684b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45244/0 (socket says 172.21.15.79:45244) 2024-08-20T01:37:50.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.886+0000 7ff6263c5640 1 -- 172.21.15.79:0/2133165626 learned_addr learned my addr 172.21.15.79:0/2133165626 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:50.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.886+0000 7ff625bc4640 1 --2- 172.21.15.79:0/2133165626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a868401a0 0x560a86863ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:50.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.886+0000 7ff626bc6640 1 --2- 172.21.15.79:0/2133165626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a8684c130 0x560a86864400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:50.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.886+0000 7ff6263c5640 1 -- 172.21.15.79:0/2133165626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a868401a0 msgr2=0x560a86863ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:50.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.886+0000 7ff6263c5640 1 --2- 172.21.15.79:0/2133165626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a868401a0 0x560a86863ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:50.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.886+0000 7ff6263c5640 1 -- 172.21.15.79:0/2133165626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a8684c130 msgr2=0x560a86864400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:50.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.886+0000 7ff6263c5640 1 --2- 172.21.15.79:0/2133165626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a8684c130 0x560a86864400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:50.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.886+0000 7ff6263c5640 1 -- 172.21.15.79:0/2133165626 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a8683d4e0 con 0x560a8683f880 2024-08-20T01:37:50.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.887+0000 7ff6263c5640 1 --2- 172.21.15.79:0/2133165626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a8683f880 0x560a8684b260 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff61c0058c0 tx=0x7ff61c0046a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c6f356ce0a53ca server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:50.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.887+0000 7ff60bfff640 1 -- 172.21.15.79:0/2133165626 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff61c0123f0 con 0x560a8683f880 2024-08-20T01:37:50.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.887+0000 7ff60bfff640 1 -- 172.21.15.79:0/2133165626 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff61c02f030 con 0x560a8683f880 2024-08-20T01:37:50.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.887+0000 7ff60bfff640 1 -- 172.21.15.79:0/2133165626 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff61c029800 con 0x560a8683f880 2024-08-20T01:37:50.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.888+0000 7ff62aa22740 1 -- 172.21.15.79:0/2133165626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a8683f880 msgr2=0x560a8684b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:50.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.888+0000 7ff62aa22740 1 --2- 172.21.15.79:0/2133165626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a8683f880 0x560a8684b260 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff61c0058c0 tx=0x7ff61c0046a0 comp rx=0 tx=0).stop 2024-08-20T01:37:50.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.888+0000 7ff62aa22740 1 -- 172.21.15.79:0/2133165626 shutdown_connections 2024-08-20T01:37:50.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.888+0000 7ff62aa22740 1 --2- 172.21.15.79:0/2133165626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a8684c130 0x560a86864400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:50.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.888+0000 7ff62aa22740 1 --2- 172.21.15.79:0/2133165626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a868401a0 0x560a86863ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:50.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.888+0000 7ff62aa22740 1 --2- 172.21.15.79:0/2133165626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a8683f880 0x560a8684b260 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:50.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.888+0000 7ff62aa22740 1 -- 172.21.15.79:0/2133165626 >> 172.21.15.79:0/2133165626 conn(0x560a8683d6b0 msgr2=0x560a86857770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:50.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.888+0000 7ff62aa22740 1 -- 172.21.15.79:0/2133165626 shutdown_connections 2024-08-20T01:37:50.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.888+0000 7ff62aa22740 1 -- 172.21.15.79:0/2133165626 wait complete. 2024-08-20T01:37:50.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.888+0000 7ff62aa22740 1 -- start start 2024-08-20T01:37:50.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.888+0000 7ff62aa22740 1 Processor -- start 2024-08-20T01:37:50.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.888+0000 7ff62aa22740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a8683f880 0x560a86854500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:50.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.888+0000 7ff62aa22740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a868401a0 0x560a868519f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:50.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.888+0000 7ff62aa22740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a8684c130 0x560a86851f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:50.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.888+0000 7ff62aa22740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff6201af3a0 con 0x560a8684c130 2024-08-20T01:37:50.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.888+0000 7ff62aa22740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff6201aecd0 con 0x560a868401a0 2024-08-20T01:37:50.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.888+0000 7ff62aa22740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff6201abf10 con 0x560a8683f880 2024-08-20T01:37:50.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.889+0000 7ff62aa22740 10 client.0 _ll_register_callbacks cb 0x7ff61c009ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:50.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.889+0000 7ff6263c5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a8683f880 0x560a86854500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:50.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.889+0000 7ff626bc6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a8684c130 0x560a86851f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:50.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.889+0000 7ff6263c5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a8683f880 0x560a86854500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:35664/0 (socket says 172.21.15.79:35664) 2024-08-20T01:37:50.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.889+0000 7ff6263c5640 1 -- 172.21.15.79:0/3378091698 learned_addr learned my addr 172.21.15.79:0/3378091698 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:50.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.889+0000 7ff626bc6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a8684c130 0x560a86851f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45246/0 (socket says 172.21.15.79:45246) 2024-08-20T01:37:50.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.889+0000 7ff625bc4640 1 --2- 172.21.15.79:0/3378091698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a868401a0 0x560a868519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:50.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.889+0000 7ff6263c5640 1 -- 172.21.15.79:0/3378091698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a868401a0 msgr2=0x560a868519f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:50.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.889+0000 7ff6263c5640 1 --2- 172.21.15.79:0/3378091698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a868401a0 0x560a868519f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:50.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.889+0000 7ff6263c5640 1 -- 172.21.15.79:0/3378091698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a8684c130 msgr2=0x560a86851f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:50.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.889+0000 7ff6263c5640 1 --2- 172.21.15.79:0/3378091698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a8684c130 0x560a86851f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:50.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.889+0000 7ff6263c5640 1 -- 172.21.15.79:0/3378091698 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a8683e130 con 0x560a8683f880 2024-08-20T01:37:50.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.889+0000 7ff626bc6640 1 --2- 172.21.15.79:0/3378091698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a8684c130 0x560a86851f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:37:50.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.889+0000 7ff6263c5640 1 --2- 172.21.15.79:0/3378091698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a8683f880 0x560a86854500 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff61c0054a0 tx=0x7ff61c0054d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd84b102aef28375 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:50.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.889+0000 7ff609ffb640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:37:50.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.889+0000 7ff609ffb640 1 -- 172.21.15.79:0/3378091698 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff61c01f6b0 con 0x560a8683f880 2024-08-20T01:37:50.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.889+0000 7ff609ffb640 1 -- 172.21.15.79:0/3378091698 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff61c01f850 con 0x560a8683f880 2024-08-20T01:37:50.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.889+0000 7ff62aa22740 1 -- 172.21.15.79:0/3378091698 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff61c02f030 con 0x560a8683f880 2024-08-20T01:37:50.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.889+0000 7ff609ffb640 1 -- 172.21.15.79:0/3378091698 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff61c01fa50 con 0x560a8683f880 2024-08-20T01:37:50.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.889+0000 7ff62aa22740 10 client.25078 fetch_fsmap learned FSMap version 28 2024-08-20T01:37:50.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.889+0000 7ff62aa22740 1 -- 172.21.15.79:0/3378091698 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560a868caed0 con 0x560a8683f880 2024-08-20T01:37:50.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.890+0000 7ff609ffb640 1 -- 172.21.15.79:0/3378091698 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff61c02f030 con 0x560a8683f880 2024-08-20T01:37:50.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.890+0000 7ff609ffb640 1 -- 172.21.15.79:0/3378091698 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff61c027040 con 0x560a8683f880 2024-08-20T01:37:50.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.890+0000 7ff62aa22740 10 client.25078 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:37:50.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.890+0000 7ff62aa22740 10 client.25078 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:37:50.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.890+0000 7ff62aa22740 20 client.25078 populate_metadata read hostname 'smithi079' 2024-08-20T01:37:50.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.890+0000 7ff62aa22740 1 --2- 172.21.15.79:0/3378091698 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x560a868cb590 0x560a868cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:50.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.890+0000 7ff62aa22740 4 client.25078 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:37:50.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.890+0000 7ff62aa22740 1 -- 172.21.15.79:0/3378091698 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560a867b4320 con 0x560a868cb590 2024-08-20T01:37:50.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.890+0000 7ff625bc4640 1 --2- 172.21.15.79:0/3378091698 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x560a868cb590 0x560a868cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:50.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.890+0000 7ff625bc4640 1 --2- 172.21.15.79:0/3378091698 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x560a868cb590 0x560a868cd9b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=27df510fcd09092d server_cookie=4dae907d48671169 in_seq=0 out_seq=0 2024-08-20T01:37:50.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.890+0000 7ff609ffb640 10 client.25078 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:37:50.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.890+0000 7ff609ffb640 1 -- 172.21.15.79:0/3378091698 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560a867b4320 con 0x560a868cb590 2024-08-20T01:37:50.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.890+0000 7ff609ffb640 10 client.25078 handle_command_reply: tid=0 2024-08-20T01:37:50.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.891+0000 7ff62aa22740 1 client.25078 shutdown 2024-08-20T01:37:50.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.891+0000 7ff62aa22740 1 -- 172.21.15.79:0/3378091698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a8683f880 msgr2=0x560a86854500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:50.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.891+0000 7ff62aa22740 1 --2- 172.21.15.79:0/3378091698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a8683f880 0x560a86854500 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff61c0054a0 tx=0x7ff61c0054d0 comp rx=0 tx=0).stop 2024-08-20T01:37:50.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.891+0000 7ff62aa22740 1 -- 172.21.15.79:0/3378091698 shutdown_connections 2024-08-20T01:37:50.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.891+0000 7ff62aa22740 1 --2- 172.21.15.79:0/3378091698 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x560a868cb590 0x560a868cd9b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:50.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.891+0000 7ff62aa22740 1 --2- 172.21.15.79:0/3378091698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a8684c130 0x560a86851f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:50.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.891+0000 7ff62aa22740 1 --2- 172.21.15.79:0/3378091698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a868401a0 0x560a868519f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:50.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.891+0000 7ff609ffb640 0 client.25078 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:37:50.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.891+0000 7ff62aa22740 1 --2- 172.21.15.79:0/3378091698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a8683f880 0x560a86854500 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:50.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.891+0000 7ff62aa22740 1 -- 172.21.15.79:0/3378091698 >> 172.21.15.79:0/3378091698 conn(0x560a8683d6b0 msgr2=0x560a8683bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:50.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.891+0000 7ff62aa22740 1 -- 172.21.15.79:0/3378091698 shutdown_connections 2024-08-20T01:37:50.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.891+0000 7ff62aa22740 1 -- 172.21.15.79:0/3378091698 wait complete. 2024-08-20T01:37:50.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.891+0000 7ff62aa22740 20 client.25078 trim_cache size 0 max 16384 2024-08-20T01:37:50.907 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:37:50.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.891+0000 7ff628629640 1 -- 172.21.15.79:0/2475670105 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff60c0b3bd0 msgr2=0x7ff60c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:50.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.891+0000 7ff628629640 1 --2- 172.21.15.79:0/2475670105 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff60c0b3bd0 0x7ff60c0b6090 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff61c009fd0 tx=0x7ff61c005f90 comp rx=0 tx=0).stop 2024-08-20T01:37:50.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.891+0000 7ff628629640 1 -- 172.21.15.79:0/2475670105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff620107d40 msgr2=0x7ff62019e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:50.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.891+0000 7ff628629640 1 --2- 172.21.15.79:0/2475670105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff620107d40 0x7ff62019e750 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff618005cc0 tx=0x7ff618003f90 comp rx=0 tx=0).stop 2024-08-20T01:37:50.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.891+0000 7ff628629640 1 -- 172.21.15.79:0/2475670105 shutdown_connections 2024-08-20T01:37:50.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.891+0000 7ff628629640 1 --2- 172.21.15.79:0/2475670105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff620107d40 0x7ff62019e750 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:50.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.891+0000 7ff628629640 1 --2- 172.21.15.79:0/2475670105 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff60c0b3bd0 0x7ff60c0b6090 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:50.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.891+0000 7ff628629640 1 --2- 172.21.15.79:0/2475670105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6201073c0 0x7ff6201993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:50.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.891+0000 7ff628629640 1 --2- 172.21.15.79:0/2475670105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6201019b0 0x7ff620198e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:50.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.892+0000 7ff628629640 1 -- 172.21.15.79:0/2475670105 >> 172.21.15.79:0/2475670105 conn(0x7ff6200fd460 msgr2=0x7ff620105770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:50.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.892+0000 7ff628629640 1 -- 172.21.15.79:0/2475670105 shutdown_connections 2024-08-20T01:37:50.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:50.892+0000 7ff628629640 1 -- 172.21.15.79:0/2475670105 wait complete. 2024-08-20T01:37:51.549 INFO:tasks.workunit.client.0.smithi079.stderr:+ trap - EXIT 2024-08-20T01:37:51.549 INFO:tasks.workunit.client.0.smithi079.stderr:+ cd ffsb 2024-08-20T01:37:51.550 INFO:tasks.workunit.client.0.smithi079.stderr:+ ./configure 2024-08-20T01:37:51.708 INFO:tasks.workunit.client.0.smithi079.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-08-20T01:37:51.808 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T01:37:52.051 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:37:52.171 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:51 smithi079 ceph-mon[18656]: pgmap v363: 97 pgs: 97 active+clean; 663 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2024-08-20T01:37:52.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:51 smithi081 ceph-mon[22209]: pgmap v363: 97 pgs: 97 active+clean; 663 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2024-08-20T01:37:52.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:51 smithi175 ceph-mon[22392]: pgmap v363: 97 pgs: 97 active+clean; 663 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2024-08-20T01:37:52.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.484+0000 7f5ba1508640 1 -- 172.21.15.79:0/3368980883 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b9c1073a0 msgr2=0x7f5b9c1077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:52.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.484+0000 7f5ba1508640 1 --2- 172.21.15.79:0/3368980883 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b9c1073a0 0x7f5b9c1077e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f5b84009900 tx=0x7f5b8402a410 comp rx=0 tx=0).stop 2024-08-20T01:37:52.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.484+0000 7f5ba1508640 1 -- 172.21.15.79:0/3368980883 shutdown_connections 2024-08-20T01:37:52.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.484+0000 7f5ba1508640 1 --2- 172.21.15.79:0/3368980883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b9c107d20 0x7f5b9c10e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:52.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.484+0000 7f5ba1508640 1 --2- 172.21.15.79:0/3368980883 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b9c1073a0 0x7f5b9c1077e0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:52.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.484+0000 7f5ba1508640 1 --2- 172.21.15.79:0/3368980883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b9c101990 0x7f5b9c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:52.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.484+0000 7f5ba1508640 1 -- 172.21.15.79:0/3368980883 >> 172.21.15.79:0/3368980883 conn(0x7f5b9c0fd400 msgr2=0x7f5b9c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:52.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.484+0000 7f5ba1508640 1 -- 172.21.15.79:0/3368980883 shutdown_connections 2024-08-20T01:37:52.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.484+0000 7f5ba1508640 1 -- 172.21.15.79:0/3368980883 wait complete. 2024-08-20T01:37:52.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.485+0000 7f5ba1508640 1 Processor -- start 2024-08-20T01:37:52.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.485+0000 7f5ba1508640 1 -- start start 2024-08-20T01:37:52.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.485+0000 7f5ba1508640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b9c101990 0x7f5b9c19b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:52.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.485+0000 7f5ba1508640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b9c1073a0 0x7f5b9c19b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:52.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.485+0000 7f5ba1508640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b9c107d20 0x7f5b9c1a09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:52.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.485+0000 7f5ba1508640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9c111870 con 0x7f5b9c1073a0 2024-08-20T01:37:52.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.485+0000 7f5ba1508640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9c1116f0 con 0x7f5b9c101990 2024-08-20T01:37:52.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.485+0000 7f5ba1508640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9c1119f0 con 0x7f5b9c107d20 2024-08-20T01:37:52.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.485+0000 7f5b927fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b9c1073a0 0x7f5b9c19b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:52.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.485+0000 7f5b927fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b9c1073a0 0x7f5b9c19b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45266/0 (socket says 172.21.15.79:45266) 2024-08-20T01:37:52.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.485+0000 7f5b927fc640 1 -- 172.21.15.79:0/2125252973 learned_addr learned my addr 172.21.15.79:0/2125252973 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:52.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.485+0000 7f5b9b7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b9c107d20 0x7f5b9c1a09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:52.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.485+0000 7f5b9affd640 1 --2- 172.21.15.79:0/2125252973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b9c101990 0x7f5b9c19b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:52.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.486+0000 7f5b927fc640 1 -- 172.21.15.79:0/2125252973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b9c107d20 msgr2=0x7f5b9c1a09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:52.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.486+0000 7f5b927fc640 1 --2- 172.21.15.79:0/2125252973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b9c107d20 0x7f5b9c1a09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:52.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.486+0000 7f5b927fc640 1 -- 172.21.15.79:0/2125252973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b9c101990 msgr2=0x7f5b9c19b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:52.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.486+0000 7f5b927fc640 1 --2- 172.21.15.79:0/2125252973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b9c101990 0x7f5b9c19b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:52.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.486+0000 7f5b927fc640 1 -- 172.21.15.79:0/2125252973 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b9c1a1180 con 0x7f5b9c1073a0 2024-08-20T01:37:52.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.486+0000 7f5b927fc640 1 --2- 172.21.15.79:0/2125252973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b9c1073a0 0x7f5b9c19b610 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f5b8402a930 tx=0x7f5b84003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:52.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.486+0000 7f5b98ff9640 1 -- 172.21.15.79:0/2125252973 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8403f070 con 0x7f5b9c1073a0 2024-08-20T01:37:52.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.486+0000 7f5b98ff9640 1 -- 172.21.15.79:0/2125252973 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b84003e40 con 0x7f5b9c1073a0 2024-08-20T01:37:52.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.486+0000 7f5ba1508640 1 -- 172.21.15.79:0/2125252973 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b9c1a1410 con 0x7f5b9c1073a0 2024-08-20T01:37:52.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.486+0000 7f5b98ff9640 1 -- 172.21.15.79:0/2125252973 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b84035030 con 0x7f5b9c1073a0 2024-08-20T01:37:52.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.486+0000 7f5ba1508640 1 -- 172.21.15.79:0/2125252973 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b9c1a7b30 con 0x7f5b9c1073a0 2024-08-20T01:37:52.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.488+0000 7f5b98ff9640 1 -- 172.21.15.79:0/2125252973 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5b84042070 con 0x7f5b9c1073a0 2024-08-20T01:37:52.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.488+0000 7f5ba3901740 1 Processor -- start 2024-08-20T01:37:52.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.489+0000 7f5ba3901740 1 -- start start 2024-08-20T01:37:52.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.489+0000 7f5ba3901740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558893f48880 0x558893f48c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:52.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.489+0000 7f5ba3901740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558893f491a0 0x558893f54bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:52.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.489+0000 7f5ba3901740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558893f55130 0x558893f57520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:52.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.489+0000 7f5ba3901740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558893ebf930 con 0x558893f48880 2024-08-20T01:37:52.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.489+0000 7f5ba3901740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558893eaee30 con 0x558893f491a0 2024-08-20T01:37:52.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.489+0000 7f5ba3901740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558893eb2e70 con 0x558893f55130 2024-08-20T01:37:52.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.489+0000 7f5b9b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558893f48880 0x558893f48c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:52.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.489+0000 7f5b9b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558893f48880 0x558893f48c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45280/0 (socket says 172.21.15.79:45280) 2024-08-20T01:37:52.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.489+0000 7f5b9b7fe640 1 -- 172.21.15.79:0/435725919 learned_addr learned my addr 172.21.15.79:0/435725919 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:52.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.489+0000 7f5b927fc640 1 --2- 172.21.15.79:0/435725919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558893f55130 0x558893f57520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:52.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.489+0000 7f5b9affd640 1 --2- 172.21.15.79:0/435725919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558893f491a0 0x558893f54bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:52.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.489+0000 7f5b9b7fe640 1 -- 172.21.15.79:0/435725919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558893f55130 msgr2=0x558893f57520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:52.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.489+0000 7f5b9b7fe640 1 --2- 172.21.15.79:0/435725919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558893f55130 0x558893f57520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:52.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.489+0000 7f5b9b7fe640 1 -- 172.21.15.79:0/435725919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558893f491a0 msgr2=0x558893f54bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:52.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.489+0000 7f5b9b7fe640 1 --2- 172.21.15.79:0/435725919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558893f491a0 0x558893f54bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:52.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.489+0000 7f5b98ff9640 1 --2- 172.21.15.79:0/2125252973 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5b880b3bd0 0x7f5b880b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:52.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.489+0000 7f5b9b7fe640 1 -- 172.21.15.79:0/435725919 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558893c0e650 con 0x558893f48880 2024-08-20T01:37:52.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.490+0000 7f5b98ff9640 1 -- 172.21.15.79:0/2125252973 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f5b84104360 con 0x7f5b9c1073a0 2024-08-20T01:37:52.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.490+0000 7f5b9b7fe640 1 --2- 172.21.15.79:0/2125252973 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5b880b3bd0 0x7f5b880b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:52.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.490+0000 7f5b9b7fe640 1 --2- 172.21.15.79:0/435725919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558893f48880 0x558893f48c60 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f5b94009fa0 tx=0x7f5b94010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e816d4d9c5889392 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:52.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.490+0000 7f5b917fa640 1 -- 172.21.15.79:0/435725919 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b94022070 con 0x558893f48880 2024-08-20T01:37:52.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.490+0000 7f5b917fa640 1 -- 172.21.15.79:0/435725919 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b940113e0 con 0x558893f48880 2024-08-20T01:37:52.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.490+0000 7f5b917fa640 1 -- 172.21.15.79:0/435725919 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b94016070 con 0x558893f48880 2024-08-20T01:37:52.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.491+0000 7f5ba3901740 1 -- 172.21.15.79:0/435725919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558893f48880 msgr2=0x558893f48c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:52.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.491+0000 7f5ba3901740 1 --2- 172.21.15.79:0/435725919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558893f48880 0x558893f48c60 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f5b94009fa0 tx=0x7f5b94010800 comp rx=0 tx=0).stop 2024-08-20T01:37:52.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.491+0000 7f5b9b7fe640 1 --2- 172.21.15.79:0/2125252973 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5b880b3bd0 0x7f5b880b6090 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5b9401f000 tx=0x7f5b94022000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:52.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.491+0000 7f5ba3901740 1 -- 172.21.15.79:0/435725919 shutdown_connections 2024-08-20T01:37:52.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.491+0000 7f5ba3901740 1 --2- 172.21.15.79:0/435725919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558893f55130 0x558893f57520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:52.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.491+0000 7f5ba3901740 1 --2- 172.21.15.79:0/435725919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558893f491a0 0x558893f54bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:52.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.491+0000 7f5ba3901740 1 --2- 172.21.15.79:0/435725919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558893f48880 0x558893f48c60 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:52.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.491+0000 7f5ba3901740 1 -- 172.21.15.79:0/435725919 >> 172.21.15.79:0/435725919 conn(0x558893f466b0 msgr2=0x558893f47850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:52.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.491+0000 7f5ba3901740 1 -- 172.21.15.79:0/435725919 shutdown_connections 2024-08-20T01:37:52.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.491+0000 7f5ba3901740 1 -- 172.21.15.79:0/435725919 wait complete. 2024-08-20T01:37:52.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.491+0000 7f5ba3901740 1 -- start start 2024-08-20T01:37:52.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.491+0000 7f5ba3901740 1 Processor -- start 2024-08-20T01:37:52.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.492+0000 7f5ba3901740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558893f48880 0x558893f520f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:52.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.492+0000 7f5ba3901740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558893f491a0 0x558893f52630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:52.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.492+0000 7f5ba3901740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558893f55130 0x558893f52b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:52.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.492+0000 7f5ba3901740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558893d11700 con 0x558893f55130 2024-08-20T01:37:52.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.492+0000 7f5ba3901740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558893e35810 con 0x558893f48880 2024-08-20T01:37:52.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.492+0000 7f5ba3901740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558893f57de0 con 0x558893f491a0 2024-08-20T01:37:52.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.492+0000 7f5ba3901740 10 client.0 _ll_register_callbacks cb 0x558893ea8700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:52.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.492+0000 7f5b9b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558893f55130 0x558893f52b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:52.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.492+0000 7f5b9affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558893f48880 0x558893f520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:52.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.492+0000 7f5b9b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558893f55130 0x558893f52b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45284/0 (socket says 172.21.15.79:45284) 2024-08-20T01:37:52.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.492+0000 7f5b9b7fe640 1 -- 172.21.15.79:0/4039610065 learned_addr learned my addr 172.21.15.79:0/4039610065 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:52.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.492+0000 7f5b927fc640 1 --2- 172.21.15.79:0/4039610065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558893f491a0 0x558893f52630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:52.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.492+0000 7f5b9b7fe640 1 -- 172.21.15.79:0/4039610065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558893f491a0 msgr2=0x558893f52630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:52.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.492+0000 7f5b9b7fe640 1 --2- 172.21.15.79:0/4039610065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558893f491a0 0x558893f52630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:52.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.492+0000 7f5b9b7fe640 1 -- 172.21.15.79:0/4039610065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558893f48880 msgr2=0x558893f520f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:52.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.492+0000 7f5b9b7fe640 1 --2- 172.21.15.79:0/4039610065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558893f48880 0x558893f520f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:52.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.492+0000 7f5b9b7fe640 1 -- 172.21.15.79:0/4039610065 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558893f611c0 con 0x558893f55130 2024-08-20T01:37:52.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.492+0000 7f5b9affd640 1 --2- 172.21.15.79:0/4039610065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558893f48880 0x558893f520f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:37:52.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.492+0000 7f5b9b7fe640 1 --2- 172.21.15.79:0/4039610065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558893f55130 0x558893f52b70 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5b94011cf0 tx=0x7f5b94012a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9727a087f89c65e7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:52.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.492+0000 7f5b827fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:37:52.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.492+0000 7f5b827fc640 1 -- 172.21.15.79:0/4039610065 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b94034060 con 0x558893f55130 2024-08-20T01:37:52.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.492+0000 7f5b827fc640 1 -- 172.21.15.79:0/4039610065 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f5b940115f0 con 0x558893f55130 2024-08-20T01:37:52.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.492+0000 7f5ba3901740 1 -- 172.21.15.79:0/4039610065 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558893e5e150 con 0x558893f55130 2024-08-20T01:37:52.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.492+0000 7f5b827fc640 1 -- 172.21.15.79:0/4039610065 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5b94016050 con 0x558893f55130 2024-08-20T01:37:52.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.492+0000 7f5ba3901740 10 client.15705 fetch_fsmap learned FSMap version 28 2024-08-20T01:37:52.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.492+0000 7f5ba3901740 1 -- 172.21.15.79:0/4039610065 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558893f63b70 con 0x558893f55130 2024-08-20T01:37:52.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.493+0000 7f5b827fc640 1 -- 172.21.15.79:0/4039610065 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x558893e5e150 con 0x558893f55130 2024-08-20T01:37:52.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.493+0000 7f5b827fc640 1 -- 172.21.15.79:0/4039610065 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5b9402e030 con 0x558893f55130 2024-08-20T01:37:52.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.493+0000 7f5ba3901740 10 client.15705 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:37:52.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.493+0000 7f5ba3901740 10 client.15705 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:37:52.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.493+0000 7f5ba3901740 20 client.15705 populate_metadata read hostname 'smithi079' 2024-08-20T01:37:52.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.493+0000 7f5ba3901740 1 --2- 172.21.15.79:0/4039610065 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x558893f64fd0 0x558893f673c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:52.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.493+0000 7f5ba3901740 4 client.15705 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:37:52.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.493+0000 7f5ba3901740 1 -- 172.21.15.79:0/4039610065 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558893ec1880 con 0x558893f64fd0 2024-08-20T01:37:52.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.493+0000 7f5b9affd640 1 --2- 172.21.15.79:0/4039610065 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x558893f64fd0 0x558893f673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:52.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.493+0000 7f5b827fc640 10 client.15705 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:37:52.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.493+0000 7f5b9affd640 1 --2- 172.21.15.79:0/4039610065 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x558893f64fd0 0x558893f673c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=20f164508c1cd5dc server_cookie=ad8337924d60c705 in_seq=0 out_seq=0 2024-08-20T01:37:52.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.494+0000 7f5b827fc640 1 -- 172.21.15.79:0/4039610065 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558893ec1880 con 0x558893f64fd0 2024-08-20T01:37:52.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.494+0000 7f5b827fc640 10 client.15705 handle_command_reply: tid=0 2024-08-20T01:37:52.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.494+0000 7f5ba3901740 1 client.15705 shutdown 2024-08-20T01:37:52.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.494+0000 7f5ba3901740 1 -- 172.21.15.79:0/4039610065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558893f55130 msgr2=0x558893f52b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:52.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.494+0000 7f5ba3901740 1 --2- 172.21.15.79:0/4039610065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558893f55130 0x558893f52b70 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5b94011cf0 tx=0x7f5b94012a00 comp rx=0 tx=0).stop 2024-08-20T01:37:52.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.494+0000 7f5ba3901740 1 -- 172.21.15.79:0/4039610065 shutdown_connections 2024-08-20T01:37:52.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.494+0000 7f5ba3901740 1 --2- 172.21.15.79:0/4039610065 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x558893f64fd0 0x558893f673c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:52.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.494+0000 7f5ba3901740 1 --2- 172.21.15.79:0/4039610065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558893f55130 0x558893f52b70 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:52.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.494+0000 7f5ba3901740 1 --2- 172.21.15.79:0/4039610065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558893f491a0 0x558893f52630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:52.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.494+0000 7f5b827fc640 0 client.15705 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:37:52.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.494+0000 7f5ba3901740 1 --2- 172.21.15.79:0/4039610065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558893f48880 0x558893f520f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:52.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.494+0000 7f5ba3901740 1 -- 172.21.15.79:0/4039610065 >> 172.21.15.79:0/4039610065 conn(0x558893f466b0 msgr2=0x558893f4c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:52.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.494+0000 7f5ba3901740 1 -- 172.21.15.79:0/4039610065 shutdown_connections 2024-08-20T01:37:52.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.494+0000 7f5ba3901740 1 -- 172.21.15.79:0/4039610065 wait complete. 2024-08-20T01:37:52.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.494+0000 7f5ba3901740 20 client.15705 trim_cache size 0 max 16384 2024-08-20T01:37:52.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.507+0000 7f5ba3901740 1 Processor -- start 2024-08-20T01:37:52.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.507+0000 7f5ba3901740 1 -- start start 2024-08-20T01:37:52.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.507+0000 7f5ba3901740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558893f48880 0x558893f51850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:52.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.507+0000 7f5ba3901740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558893f491a0 0x558893f6cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:52.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.507+0000 7f5ba3901740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558893f55130 0x558893f6d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:52.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.507+0000 7f5ba3901740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9c1b01f0 con 0x558893f48880 2024-08-20T01:37:52.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.507+0000 7f5ba3901740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9c1b1d30 con 0x558893f55130 2024-08-20T01:37:52.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.507+0000 7f5ba3901740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9c1b08c0 con 0x558893f491a0 2024-08-20T01:37:52.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.508+0000 7f5b9affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558893f48880 0x558893f51850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:52.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.508+0000 7f5b9affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558893f48880 0x558893f51850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45290/0 (socket says 172.21.15.79:45290) 2024-08-20T01:37:52.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.508+0000 7f5b9affd640 1 -- 172.21.15.79:0/2947516413 learned_addr learned my addr 172.21.15.79:0/2947516413 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:52.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.508+0000 7f5b927fc640 1 --2- 172.21.15.79:0/2947516413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558893f491a0 0x558893f6cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:52.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.508+0000 7f5b9b7fe640 1 --2- 172.21.15.79:0/2947516413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558893f55130 0x558893f6d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:52.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.508+0000 7f5b9affd640 1 -- 172.21.15.79:0/2947516413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558893f491a0 msgr2=0x558893f6cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:52.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.508+0000 7f5b9affd640 1 --2- 172.21.15.79:0/2947516413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558893f491a0 0x558893f6cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:52.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.508+0000 7f5b9affd640 1 -- 172.21.15.79:0/2947516413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558893f55130 msgr2=0x558893f6d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:52.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.508+0000 7f5b9affd640 1 --2- 172.21.15.79:0/2947516413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558893f55130 0x558893f6d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:52.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.508+0000 7f5b9affd640 1 -- 172.21.15.79:0/2947516413 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558893f47130 con 0x558893f48880 2024-08-20T01:37:52.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.508+0000 7f5b9b7fe640 1 --2- 172.21.15.79:0/2947516413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558893f55130 0x558893f6d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:37:52.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.508+0000 7f5b927fc640 1 --2- 172.21.15.79:0/2947516413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558893f491a0 0x558893f6cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:37:52.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.508+0000 7f5b9affd640 1 --2- 172.21.15.79:0/2947516413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558893f48880 0x558893f51850 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x558893f67bc0 tx=0x7f5b8c00b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=604d0830c176da8b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:52.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.508+0000 7f5b90ff9640 1 -- 172.21.15.79:0/2947516413 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c022070 con 0x558893f48880 2024-08-20T01:37:52.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.508+0000 7f5b90ff9640 1 -- 172.21.15.79:0/2947516413 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b8c004220 con 0x558893f48880 2024-08-20T01:37:52.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.508+0000 7f5b90ff9640 1 -- 172.21.15.79:0/2947516413 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c01d660 con 0x558893f48880 2024-08-20T01:37:52.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.509+0000 7f5ba3901740 1 -- 172.21.15.79:0/2947516413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558893f48880 msgr2=0x558893f51850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:52.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.509+0000 7f5ba3901740 1 --2- 172.21.15.79:0/2947516413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558893f48880 0x558893f51850 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x558893f67bc0 tx=0x7f5b8c00b410 comp rx=0 tx=0).stop 2024-08-20T01:37:52.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.509+0000 7f5ba3901740 1 -- 172.21.15.79:0/2947516413 shutdown_connections 2024-08-20T01:37:52.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.509+0000 7f5ba3901740 1 --2- 172.21.15.79:0/2947516413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558893f55130 0x558893f6d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:52.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.509+0000 7f5ba3901740 1 --2- 172.21.15.79:0/2947516413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558893f491a0 0x558893f6cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:52.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.509+0000 7f5ba3901740 1 --2- 172.21.15.79:0/2947516413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558893f48880 0x558893f51850 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:52.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.509+0000 7f5ba3901740 1 -- 172.21.15.79:0/2947516413 >> 172.21.15.79:0/2947516413 conn(0x558893f466b0 msgr2=0x558893f53f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:52.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.509+0000 7f5ba3901740 1 -- 172.21.15.79:0/2947516413 shutdown_connections 2024-08-20T01:37:52.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.509+0000 7f5ba3901740 1 -- 172.21.15.79:0/2947516413 wait complete. 2024-08-20T01:37:52.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.510+0000 7f5ba3901740 1 -- start start 2024-08-20T01:37:52.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.510+0000 7f5ba3901740 1 Processor -- start 2024-08-20T01:37:52.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.510+0000 7f5ba3901740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558893f48880 0x558893f5d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:52.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.510+0000 7f5ba3901740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558893f491a0 0x558893f5b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:52.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.510+0000 7f5ba3901740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558893f55130 0x558893f5b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:52.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.510+0000 7f5ba3901740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9c1b1660 con 0x558893f491a0 2024-08-20T01:37:52.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.510+0000 7f5ba3901740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9c1b0f90 con 0x558893f48880 2024-08-20T01:37:52.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.510+0000 7f5ba3901740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9c1ae1d0 con 0x558893f55130 2024-08-20T01:37:52.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.510+0000 7f5ba3901740 10 client.0 _ll_register_callbacks cb 0x7f5b94020070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:52.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.510+0000 7f5b927fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558893f491a0 0x558893f5b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:52.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.510+0000 7f5b927fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558893f491a0 0x558893f5b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45294/0 (socket says 172.21.15.79:45294) 2024-08-20T01:37:52.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.510+0000 7f5b927fc640 1 -- 172.21.15.79:0/3502065598 learned_addr learned my addr 172.21.15.79:0/3502065598 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:52.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.510+0000 7f5b9b7fe640 1 --2- 172.21.15.79:0/3502065598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558893f55130 0x558893f5b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:52.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.510+0000 7f5b9affd640 1 --2- 172.21.15.79:0/3502065598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558893f48880 0x558893f5d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:52.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.510+0000 7f5b927fc640 1 -- 172.21.15.79:0/3502065598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558893f55130 msgr2=0x558893f5b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:52.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.510+0000 7f5b927fc640 1 --2- 172.21.15.79:0/3502065598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558893f55130 0x558893f5b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:52.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.510+0000 7f5b927fc640 1 -- 172.21.15.79:0/3502065598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558893f48880 msgr2=0x558893f5d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:52.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.510+0000 7f5b927fc640 1 --2- 172.21.15.79:0/3502065598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558893f48880 0x558893f5d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:52.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.511+0000 7f5b927fc640 1 -- 172.21.15.79:0/3502065598 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558893f5bcb0 con 0x558893f491a0 2024-08-20T01:37:52.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.511+0000 7f5b827fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:37:52.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.511+0000 7f5b927fc640 1 --2- 172.21.15.79:0/3502065598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558893f491a0 0x558893f5b080 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f5b840c73f0 tx=0x7f5b84009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a2f3a463c7b5594 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:52.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.511+0000 7f5b827fc640 1 -- 172.21.15.79:0/3502065598 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b84049050 con 0x558893f491a0 2024-08-20T01:37:52.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.511+0000 7f5b827fc640 1 -- 172.21.15.79:0/3502065598 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f5b840cb5d0 con 0x558893f491a0 2024-08-20T01:37:52.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.511+0000 7f5ba3901740 1 -- 172.21.15.79:0/3502065598 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b8c004220 con 0x558893f491a0 2024-08-20T01:37:52.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.511+0000 7f5b827fc640 1 -- 172.21.15.79:0/3502065598 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5b840cae80 con 0x558893f491a0 2024-08-20T01:37:52.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.511+0000 7f5ba3901740 10 client.15711 fetch_fsmap learned FSMap version 28 2024-08-20T01:37:52.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.511+0000 7f5ba3901740 1 -- 172.21.15.79:0/3502065598 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558893fceab0 con 0x558893f491a0 2024-08-20T01:37:52.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.511+0000 7f5b827fc640 1 -- 172.21.15.79:0/3502065598 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b8c004220 con 0x558893f491a0 2024-08-20T01:37:52.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.511+0000 7f5b827fc640 1 -- 172.21.15.79:0/3502065598 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5b840d3ee0 con 0x558893f491a0 2024-08-20T01:37:52.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.511+0000 7f5ba3901740 10 client.15711 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:37:52.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.511+0000 7f5ba3901740 10 client.15711 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:37:52.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.511+0000 7f5ba3901740 20 client.15711 populate_metadata read hostname 'smithi079' 2024-08-20T01:37:52.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.512+0000 7f5ba3901740 1 --2- 172.21.15.79:0/3502065598 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x558893fcf230 0x558893fd1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:52.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.512+0000 7f5ba3901740 4 client.15711 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:37:52.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.512+0000 7f5ba3901740 1 -- 172.21.15.79:0/3502065598 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558893f41880 con 0x558893fcf230 2024-08-20T01:37:52.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.512+0000 7f5b9affd640 1 --2- 172.21.15.79:0/3502065598 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x558893fcf230 0x558893fd1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:52.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.512+0000 7f5b827fc640 10 client.15711 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:37:52.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.512+0000 7f5b9affd640 1 --2- 172.21.15.79:0/3502065598 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x558893fcf230 0x558893fd1650 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c90bf2c83ab3e486 server_cookie=2d44222af32e9329 in_seq=0 out_seq=0 2024-08-20T01:37:52.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.512+0000 7f5b827fc640 1 -- 172.21.15.79:0/3502065598 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558893f41880 con 0x558893fcf230 2024-08-20T01:37:52.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.512+0000 7f5b827fc640 10 client.15711 handle_command_reply: tid=0 2024-08-20T01:37:52.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.512+0000 7f5ba3901740 1 client.15711 shutdown 2024-08-20T01:37:52.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.512+0000 7f5ba3901740 1 -- 172.21.15.79:0/3502065598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558893f491a0 msgr2=0x558893f5b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:52.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.512+0000 7f5ba3901740 1 --2- 172.21.15.79:0/3502065598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558893f491a0 0x558893f5b080 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f5b840c73f0 tx=0x7f5b84009260 comp rx=0 tx=0).stop 2024-08-20T01:37:52.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.512+0000 7f5ba3901740 1 -- 172.21.15.79:0/3502065598 shutdown_connections 2024-08-20T01:37:52.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.512+0000 7f5ba3901740 1 --2- 172.21.15.79:0/3502065598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558893f55130 0x558893f5b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:52.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.512+0000 7f5ba3901740 1 --2- 172.21.15.79:0/3502065598 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x558893fcf230 0x558893fd1650 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:52.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.512+0000 7f5ba3901740 1 --2- 172.21.15.79:0/3502065598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558893f491a0 0x558893f5b080 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:52.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.512+0000 7f5ba3901740 1 --2- 172.21.15.79:0/3502065598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558893f48880 0x558893f5d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:52.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.512+0000 7f5b827fc640 0 client.15711 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:37:52.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.512+0000 7f5ba3901740 1 -- 172.21.15.79:0/3502065598 >> 172.21.15.79:0/3502065598 conn(0x558893f466b0 msgr2=0x558893f4b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:52.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.513+0000 7f5ba3901740 1 -- 172.21.15.79:0/3502065598 shutdown_connections 2024-08-20T01:37:52.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.513+0000 7f5ba3901740 1 -- 172.21.15.79:0/3502065598 wait complete. 2024-08-20T01:37:52.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.513+0000 7f5ba3901740 20 client.15711 trim_cache size 0 max 16384 2024-08-20T01:37:52.536 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:37:52.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.513+0000 7f5ba1508640 1 -- 172.21.15.79:0/2125252973 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5b880b3bd0 msgr2=0x7f5b880b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:52.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.513+0000 7f5ba1508640 1 --2- 172.21.15.79:0/2125252973 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5b880b3bd0 0x7f5b880b6090 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5b9401f000 tx=0x7f5b94022000 comp rx=0 tx=0).stop 2024-08-20T01:37:52.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.513+0000 7f5ba1508640 1 -- 172.21.15.79:0/2125252973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b9c1073a0 msgr2=0x7f5b9c19b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:52.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.513+0000 7f5ba1508640 1 --2- 172.21.15.79:0/2125252973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b9c1073a0 0x7f5b9c19b610 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f5b8402a930 tx=0x7f5b84003c20 comp rx=0 tx=0).stop 2024-08-20T01:37:52.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.513+0000 7f5ba1508640 1 -- 172.21.15.79:0/2125252973 shutdown_connections 2024-08-20T01:37:52.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.513+0000 7f5ba1508640 1 --2- 172.21.15.79:0/2125252973 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5b880b3bd0 0x7f5b880b6090 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:52.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.513+0000 7f5ba1508640 1 --2- 172.21.15.79:0/2125252973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b9c107d20 0x7f5b9c1a09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:52.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.513+0000 7f5ba1508640 1 --2- 172.21.15.79:0/2125252973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b9c1073a0 0x7f5b9c19b610 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:52.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.513+0000 7f5ba1508640 1 --2- 172.21.15.79:0/2125252973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b9c101990 0x7f5b9c19b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:52.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.513+0000 7f5ba1508640 1 -- 172.21.15.79:0/2125252973 >> 172.21.15.79:0/2125252973 conn(0x7f5b9c0fd400 msgr2=0x7f5b9c06afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:52.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.513+0000 7f5ba1508640 1 -- 172.21.15.79:0/2125252973 shutdown_connections 2024-08-20T01:37:52.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:52.513+0000 7f5ba1508640 1 -- 172.21.15.79:0/2125252973 wait complete. 2024-08-20T01:37:52.717 INFO:tasks.workunit.client.0.smithi079.stdout:checking whether build environment is sane... yes 2024-08-20T01:37:52.731 INFO:tasks.workunit.client.0.smithi079.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-08-20T01:37:52.732 INFO:tasks.workunit.client.0.smithi079.stdout:checking for gawk... gawk 2024-08-20T01:37:52.753 INFO:tasks.workunit.client.0.smithi079.stdout:checking whether make sets $(MAKE)... yes 2024-08-20T01:37:52.794 INFO:tasks.workunit.client.0.smithi079.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-08-20T01:37:52.795 INFO:tasks.workunit.client.0.smithi079.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-08-20T01:37:52.813 INFO:tasks.workunit.client.0.smithi079.stdout:checking for style of include used by make... GNU 2024-08-20T01:37:52.818 INFO:tasks.workunit.client.0.smithi079.stdout:checking for gcc... gcc 2024-08-20T01:37:52.906 INFO:tasks.workunit.client.0.smithi079.stdout:checking for C compiler default output file name... a.out 2024-08-20T01:37:52.909 INFO:tasks.workunit.client.0.smithi079.stdout:checking whether the C compiler works... yes 2024-08-20T01:37:52.914 INFO:tasks.workunit.client.0.smithi079.stdout:checking whether we are cross compiling... no 2024-08-20T01:37:52.962 INFO:tasks.workunit.client.0.smithi079.stdout:checking for suffix of executables... 2024-08-20T01:37:53.004 INFO:tasks.workunit.client.0.smithi079.stdout:checking for suffix of object files... o 2024-08-20T01:37:53.045 INFO:tasks.workunit.client.0.smithi079.stdout:checking whether we are using the GNU C compiler... yes 2024-08-20T01:37:53.086 INFO:tasks.workunit.client.0.smithi079.stdout:checking whether gcc accepts -g... yes 2024-08-20T01:37:53.309 INFO:tasks.workunit.client.0.smithi079.stdout:checking for gcc option to accept ISO C89... none needed 2024-08-20T01:37:53.462 INFO:tasks.workunit.client.0.smithi079.stdout:checking dependency style of gcc... gcc3 2024-08-20T01:37:53.497 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T01:37:53.555 INFO:tasks.workunit.client.0.smithi079.stdout:checking how to run the C preprocessor... gcc -E 2024-08-20T01:37:53.611 INFO:tasks.workunit.client.0.smithi079.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-08-20T01:37:53.613 INFO:tasks.workunit.client.0.smithi079.stdout:checking for egrep... /usr/bin/grep -E 2024-08-20T01:37:53.626 INFO:tasks.workunit.client.0.smithi079.stdout:checking for AIX... no 2024-08-20T01:37:53.652 INFO:tasks.workunit.client.0.smithi079.stdout:checking for gcc... (cached) gcc 2024-08-20T01:37:53.665 INFO:tasks.workunit.client.0.smithi079.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-08-20T01:37:53.666 INFO:tasks.workunit.client.0.smithi079.stdout:checking whether gcc accepts -g... (cached) yes 2024-08-20T01:37:53.666 INFO:tasks.workunit.client.0.smithi079.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-08-20T01:37:53.667 INFO:tasks.workunit.client.0.smithi079.stdout:checking dependency style of gcc... (cached) gcc3 2024-08-20T01:37:53.742 INFO:tasks.workunit.client.0.smithi079.stdout:checking for main in -lm... yes 2024-08-20T01:37:53.766 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:37:53.826 INFO:tasks.workunit.client.0.smithi079.stdout:checking for main in -lpthread... yes 2024-08-20T01:37:54.082 INFO:tasks.workunit.client.0.smithi079.stdout:checking for ANSI C header files... yes 2024-08-20T01:37:54.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:53 smithi079 ceph-mon[18656]: pgmap v364: 97 pgs: 97 active+clean; 944 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 27 KiB/s wr, 16 op/s 2024-08-20T01:37:54.266 INFO:tasks.workunit.client.0.smithi079.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-08-20T01:37:54.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:53 smithi081 ceph-mon[22209]: pgmap v364: 97 pgs: 97 active+clean; 944 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 27 KiB/s wr, 16 op/s 2024-08-20T01:37:54.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.275+0000 7f29f4e89640 1 -- 172.21.15.79:0/1431446527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29f01073a0 msgr2=0x7f29f01077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:54.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.275+0000 7f29f4e89640 1 --2- 172.21.15.79:0/1431446527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29f01073a0 0x7f29f01077e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f29e4009900 tx=0x7f29e402a410 comp rx=0 tx=0).stop 2024-08-20T01:37:54.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.275+0000 7f29f4e89640 1 -- 172.21.15.79:0/1431446527 shutdown_connections 2024-08-20T01:37:54.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.275+0000 7f29f4e89640 1 --2- 172.21.15.79:0/1431446527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29f0107d20 0x7f29f010e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:54.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.275+0000 7f29f4e89640 1 --2- 172.21.15.79:0/1431446527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29f01073a0 0x7f29f01077e0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:54.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.275+0000 7f29f4e89640 1 --2- 172.21.15.79:0/1431446527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29f0101990 0x7f29f0101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:54.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.275+0000 7f29f4e89640 1 -- 172.21.15.79:0/1431446527 >> 172.21.15.79:0/1431446527 conn(0x7f29f00fd400 msgr2=0x7f29f00ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:54.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.275+0000 7f29f4e89640 1 -- 172.21.15.79:0/1431446527 shutdown_connections 2024-08-20T01:37:54.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.275+0000 7f29f4e89640 1 -- 172.21.15.79:0/1431446527 wait complete. 2024-08-20T01:37:54.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.276+0000 7f29f4e89640 1 Processor -- start 2024-08-20T01:37:54.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.276+0000 7f29f4e89640 1 -- start start 2024-08-20T01:37:54.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.277+0000 7f29f4e89640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29f0101990 0x7f29f0197d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:54.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.277+0000 7f29f4e89640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29f01073a0 0x7f29f01982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:54.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.277+0000 7f29f4e89640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29f0107d20 0x7f29f019d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:54.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.277+0000 7f29f4e89640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f29f0111850 con 0x7f29f01073a0 2024-08-20T01:37:54.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.277+0000 7f29f4e89640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f29f01116d0 con 0x7f29f0107d20 2024-08-20T01:37:54.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.277+0000 7f29f4e89640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f29f01119d0 con 0x7f29f0101990 2024-08-20T01:37:54.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.277+0000 7f29edd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29f01073a0 0x7f29f01982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:54.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.277+0000 7f29edd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29f01073a0 0x7f29f01982d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45316/0 (socket says 172.21.15.79:45316) 2024-08-20T01:37:54.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.277+0000 7f29eed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29f0107d20 0x7f29f019d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:54.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.277+0000 7f29edd9b640 1 -- 172.21.15.79:0/4186646234 learned_addr learned my addr 172.21.15.79:0/4186646234 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:54.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.277+0000 7f29ee59c640 1 --2- 172.21.15.79:0/4186646234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29f0101990 0x7f29f0197d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:54.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.277+0000 7f29eed9d640 1 -- 172.21.15.79:0/4186646234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29f0101990 msgr2=0x7f29f0197d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:54.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.277+0000 7f29eed9d640 1 --2- 172.21.15.79:0/4186646234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29f0101990 0x7f29f0197d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:54.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.277+0000 7f29eed9d640 1 -- 172.21.15.79:0/4186646234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29f01073a0 msgr2=0x7f29f01982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:54.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.277+0000 7f29eed9d640 1 --2- 172.21.15.79:0/4186646234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29f01073a0 0x7f29f01982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:54.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.277+0000 7f29eed9d640 1 -- 172.21.15.79:0/4186646234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f019de40 con 0x7f29f0107d20 2024-08-20T01:37:54.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.277+0000 7f29eed9d640 1 --2- 172.21.15.79:0/4186646234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29f0107d20 0x7f29f019d670 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f29e8009fd0 tx=0x7f29e800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:54.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.278+0000 7f29df7fe640 1 -- 172.21.15.79:0/4186646234 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e800ce20 con 0x7f29f0107d20 2024-08-20T01:37:54.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.278+0000 7f29df7fe640 1 -- 172.21.15.79:0/4186646234 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29e8005020 con 0x7f29f0107d20 2024-08-20T01:37:54.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.278+0000 7f29f4e89640 1 -- 172.21.15.79:0/4186646234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29f019e130 con 0x7f29f0107d20 2024-08-20T01:37:54.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.278+0000 7f29df7fe640 1 -- 172.21.15.79:0/4186646234 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e8010690 con 0x7f29f0107d20 2024-08-20T01:37:54.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.278+0000 7f29f4e89640 1 -- 172.21.15.79:0/4186646234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29f006a7b0 con 0x7f29f0107d20 2024-08-20T01:37:54.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.280+0000 7f29df7fe640 1 -- 172.21.15.79:0/4186646234 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f29e8004a40 con 0x7f29f0107d20 2024-08-20T01:37:54.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.280+0000 7f29f7282740 1 Processor -- start 2024-08-20T01:37:54.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.280+0000 7f29f7282740 1 -- start start 2024-08-20T01:37:54.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.281+0000 7f29f7282740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5572440ad880 0x5572440adc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:54.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.281+0000 7f29f7282740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572440ae1a0 0x5572440b9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:54.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.281+0000 7f29f7282740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572440ba130 0x5572440bc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:54.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.281+0000 7f29f7282740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557244024930 con 0x5572440ae1a0 2024-08-20T01:37:54.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.281+0000 7f29f7282740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557244013e30 con 0x5572440ba130 2024-08-20T01:37:54.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.281+0000 7f29f7282740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557244017e70 con 0x5572440ad880 2024-08-20T01:37:54.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.281+0000 7f29ee59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572440ae1a0 0x5572440b9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:54.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.281+0000 7f29df7fe640 1 --2- 172.21.15.79:0/4186646234 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f29d80b3c50 0x7f29d80b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:54.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.281+0000 7f29ee59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572440ae1a0 0x5572440b9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45328/0 (socket says 172.21.15.79:45328) 2024-08-20T01:37:54.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.281+0000 7f29ee59c640 1 -- 172.21.15.79:0/136258787 learned_addr learned my addr 172.21.15.79:0/136258787 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:54.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.281+0000 7f29edd9b640 1 --2- 172.21.15.79:0/136258787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572440ba130 0x5572440bc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:54.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.281+0000 7f29edd9b640 1 --2- 172.21.15.79:0/136258787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5572440ad880 0x5572440adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:54.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.281+0000 7f29eed9d640 1 --2- 172.21.15.79:0/4186646234 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f29d80b3c50 0x7f29d80b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:54.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.281+0000 7f29edd9b640 1 -- 172.21.15.79:0/136258787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5572440ad880 msgr2=0x5572440adc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:54.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.281+0000 7f29edd9b640 1 --2- 172.21.15.79:0/136258787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5572440ad880 0x5572440adc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:54.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.281+0000 7f29edd9b640 1 -- 172.21.15.79:0/136258787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572440ae1a0 msgr2=0x5572440b9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:54.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.281+0000 7f29edd9b640 1 --2- 172.21.15.79:0/136258787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572440ae1a0 0x5572440b9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:54.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.281+0000 7f29edd9b640 1 -- 172.21.15.79:0/136258787 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557243d73650 con 0x5572440ba130 2024-08-20T01:37:54.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.281+0000 7f29ee59c640 1 --2- 172.21.15.79:0/136258787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572440ae1a0 0x5572440b9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:37:54.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.281+0000 7f29df7fe640 1 -- 172.21.15.79:0/4186646234 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f29e80e4200 con 0x7f29f0107d20 2024-08-20T01:37:54.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.281+0000 7f29edd9b640 1 --2- 172.21.15.79:0/136258787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572440ba130 0x5572440bc520 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f29e40057c0 tx=0x7f29e403a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=966b27a7504692c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:54.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.282+0000 7f29dcff9640 1 -- 172.21.15.79:0/136258787 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e4035030 con 0x5572440ba130 2024-08-20T01:37:54.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.282+0000 7f29eed9d640 1 --2- 172.21.15.79:0/4186646234 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f29d80b3c50 0x7f29d80b6110 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f29e80a71e0 tx=0x7f29e80a5040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:54.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.282+0000 7f29dcff9640 1 -- 172.21.15.79:0/136258787 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29e4032d80 con 0x5572440ba130 2024-08-20T01:37:54.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.282+0000 7f29dcff9640 1 -- 172.21.15.79:0/136258787 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e4004320 con 0x5572440ba130 2024-08-20T01:37:54.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.283+0000 7f29f7282740 1 -- 172.21.15.79:0/136258787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572440ba130 msgr2=0x5572440bc520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:54.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.283+0000 7f29f7282740 1 --2- 172.21.15.79:0/136258787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572440ba130 0x5572440bc520 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f29e40057c0 tx=0x7f29e403a040 comp rx=0 tx=0).stop 2024-08-20T01:37:54.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.283+0000 7f29f7282740 1 -- 172.21.15.79:0/136258787 shutdown_connections 2024-08-20T01:37:54.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.283+0000 7f29f7282740 1 --2- 172.21.15.79:0/136258787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572440ba130 0x5572440bc520 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:54.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.283+0000 7f29f7282740 1 --2- 172.21.15.79:0/136258787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572440ae1a0 0x5572440b9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:54.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.283+0000 7f29f7282740 1 --2- 172.21.15.79:0/136258787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5572440ad880 0x5572440adc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:54.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.283+0000 7f29f7282740 1 -- 172.21.15.79:0/136258787 >> 172.21.15.79:0/136258787 conn(0x5572440ab6b0 msgr2=0x5572440ac850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:54.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.283+0000 7f29f7282740 1 -- 172.21.15.79:0/136258787 shutdown_connections 2024-08-20T01:37:54.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.283+0000 7f29f7282740 1 -- 172.21.15.79:0/136258787 wait complete. 2024-08-20T01:37:54.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.283+0000 7f29f7282740 1 -- start start 2024-08-20T01:37:54.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.283+0000 7f29f7282740 1 Processor -- start 2024-08-20T01:37:54.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.283+0000 7f29f7282740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572440ad880 0x5572440b7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:54.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.284+0000 7f29f7282740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5572440ae1a0 0x5572440b76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:54.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.284+0000 7f29f7282740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572440ba130 0x5572440b7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:54.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.284+0000 7f29f7282740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557243e76700 con 0x5572440ba130 2024-08-20T01:37:54.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.284+0000 7f29f7282740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557243f9a810 con 0x5572440ad880 2024-08-20T01:37:54.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.284+0000 7f29f7282740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5572440bcd80 con 0x5572440ae1a0 2024-08-20T01:37:54.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.284+0000 7f29f7282740 10 client.0 _ll_register_callbacks cb 0x55724400d700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:54.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.284+0000 7f29edd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572440ad880 0x5572440b7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:54.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.284+0000 7f29edd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572440ad880 0x5572440b7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:46166/0 (socket says 172.21.15.79:46166) 2024-08-20T01:37:54.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.284+0000 7f29edd9b640 1 -- 172.21.15.79:0/1927225027 learned_addr learned my addr 172.21.15.79:0/1927225027 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:54.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.284+0000 7f29edd9b640 1 --2- 172.21.15.79:0/1927225027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572440ba130 0x5572440b7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:54.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.284+0000 7f29ee59c640 1 --2- 172.21.15.79:0/1927225027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5572440ae1a0 0x5572440b76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:54.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.284+0000 7f29edd9b640 1 -- 172.21.15.79:0/1927225027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5572440ae1a0 msgr2=0x5572440b76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:54.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.284+0000 7f29edd9b640 1 --2- 172.21.15.79:0/1927225027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5572440ae1a0 0x5572440b76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:54.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.284+0000 7f29edd9b640 1 -- 172.21.15.79:0/1927225027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572440ba130 msgr2=0x5572440b7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:54.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.284+0000 7f29edd9b640 1 --2- 172.21.15.79:0/1927225027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572440ba130 0x5572440b7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:54.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.284+0000 7f29edd9b640 1 -- 172.21.15.79:0/1927225027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572440c61e0 con 0x5572440ad880 2024-08-20T01:37:54.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.284+0000 7f29ee59c640 1 --2- 172.21.15.79:0/1927225027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5572440ae1a0 0x5572440b76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:37:54.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.284+0000 7f29edd9b640 1 --2- 172.21.15.79:0/1927225027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572440ad880 0x5572440b7170 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f29e4032fd0 tx=0x7f29e402a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49d28c5d94b1bdd9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:54.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.284+0000 7f29d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:37:54.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.284+0000 7f29d5ffb640 1 -- 172.21.15.79:0/1927225027 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e4035070 con 0x5572440ad880 2024-08-20T01:37:54.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.285+0000 7f29f7282740 1 -- 172.21.15.79:0/1927225027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557243fc3150 con 0x5572440ad880 2024-08-20T01:37:54.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.285+0000 7f29d5ffb640 1 -- 172.21.15.79:0/1927225027 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f29e4004160 con 0x5572440ad880 2024-08-20T01:37:54.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.285+0000 7f29d5ffb640 1 -- 172.21.15.79:0/1927225027 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f29e4031400 con 0x5572440ad880 2024-08-20T01:37:54.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.285+0000 7f29f7282740 10 client.25112 fetch_fsmap learned FSMap version 28 2024-08-20T01:37:54.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.285+0000 7f29f7282740 1 -- 172.21.15.79:0/1927225027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5572440c8b90 con 0x5572440ad880 2024-08-20T01:37:54.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.285+0000 7f29d5ffb640 1 -- 172.21.15.79:0/1927225027 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x557243fc3150 con 0x5572440ad880 2024-08-20T01:37:54.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.285+0000 7f29d5ffb640 1 -- 172.21.15.79:0/1927225027 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f29e4044070 con 0x5572440ad880 2024-08-20T01:37:54.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.285+0000 7f29f7282740 10 client.25112 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:37:54.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.285+0000 7f29f7282740 10 client.25112 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:37:54.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.285+0000 7f29f7282740 20 client.25112 populate_metadata read hostname 'smithi079' 2024-08-20T01:37:54.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.285+0000 7f29f7282740 1 --2- 172.21.15.79:0/1927225027 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x5572440c9ee0 0x5572440cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:54.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.285+0000 7f29f7282740 4 client.25112 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:37:54.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.285+0000 7f29f7282740 1 -- 172.21.15.79:0/1927225027 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557244026880 con 0x5572440c9ee0 2024-08-20T01:37:54.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.285+0000 7f29ee59c640 1 --2- 172.21.15.79:0/1927225027 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x5572440c9ee0 0x5572440cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:54.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.286+0000 7f29ee59c640 1 --2- 172.21.15.79:0/1927225027 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x5572440c9ee0 0x5572440cc2f0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=41130e0f8fb89dd server_cookie=dd8e7bf574a1e937 in_seq=0 out_seq=0 2024-08-20T01:37:54.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.286+0000 7f29d5ffb640 10 client.25112 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:37:54.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.287+0000 7f29d5ffb640 1 -- 172.21.15.79:0/1927225027 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557244026880 con 0x5572440c9ee0 2024-08-20T01:37:54.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.287+0000 7f29d5ffb640 10 client.25112 handle_command_reply: tid=0 2024-08-20T01:37:54.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.287+0000 7f29f7282740 1 client.25112 shutdown 2024-08-20T01:37:54.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.287+0000 7f29f7282740 1 -- 172.21.15.79:0/1927225027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572440ad880 msgr2=0x5572440b7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:54.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.287+0000 7f29f7282740 1 --2- 172.21.15.79:0/1927225027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572440ad880 0x5572440b7170 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f29e4032fd0 tx=0x7f29e402a410 comp rx=0 tx=0).stop 2024-08-20T01:37:54.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.287+0000 7f29f7282740 1 -- 172.21.15.79:0/1927225027 shutdown_connections 2024-08-20T01:37:54.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.287+0000 7f29f7282740 1 --2- 172.21.15.79:0/1927225027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572440ba130 0x5572440b7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:54.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.287+0000 7f29f7282740 1 --2- 172.21.15.79:0/1927225027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5572440ae1a0 0x5572440b76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:54.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.287+0000 7f29f7282740 1 --2- 172.21.15.79:0/1927225027 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x5572440c9ee0 0x5572440cc2f0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:54.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.287+0000 7f29f7282740 1 --2- 172.21.15.79:0/1927225027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572440ad880 0x5572440b7170 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:54.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.287+0000 7f29d5ffb640 0 client.25112 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:37:54.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.287+0000 7f29f7282740 1 -- 172.21.15.79:0/1927225027 >> 172.21.15.79:0/1927225027 conn(0x5572440ab6b0 msgr2=0x5572440b1250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:54.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.287+0000 7f29f7282740 1 -- 172.21.15.79:0/1927225027 shutdown_connections 2024-08-20T01:37:54.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.287+0000 7f29f7282740 1 -- 172.21.15.79:0/1927225027 wait complete. 2024-08-20T01:37:54.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.287+0000 7f29f7282740 20 client.25112 trim_cache size 0 max 16384 2024-08-20T01:37:54.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.300+0000 7f29f7282740 1 Processor -- start 2024-08-20T01:37:54.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.300+0000 7f29f7282740 1 -- start start 2024-08-20T01:37:54.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.300+0000 7f29f7282740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572440ad880 0x5572440b9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:54.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.300+0000 7f29f7282740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572440ae1a0 0x5572440b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:54.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.300+0000 7f29f7282740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5572440ba130 0x5572440b6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:54.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.300+0000 7f29f7282740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f29f01abd50 con 0x5572440ae1a0 2024-08-20T01:37:54.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.300+0000 7f29f7282740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f29f01ad890 con 0x5572440ad880 2024-08-20T01:37:54.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.300+0000 7f29f7282740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f29f01ac420 con 0x5572440ba130 2024-08-20T01:37:54.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.300+0000 7f29ee59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572440ae1a0 0x5572440b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:54.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.301+0000 7f29ee59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572440ae1a0 0x5572440b1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45342/0 (socket says 172.21.15.79:45342) 2024-08-20T01:37:54.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.301+0000 7f29ee59c640 1 -- 172.21.15.79:0/1959822338 learned_addr learned my addr 172.21.15.79:0/1959822338 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:54.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.301+0000 7f29edd9b640 1 --2- 172.21.15.79:0/1959822338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5572440ba130 0x5572440b6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:54.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.301+0000 7f29edd9b640 1 --2- 172.21.15.79:0/1959822338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572440ad880 0x5572440b9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:54.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.301+0000 7f29ee59c640 1 -- 172.21.15.79:0/1959822338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5572440ba130 msgr2=0x5572440b6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:54.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.301+0000 7f29ee59c640 1 --2- 172.21.15.79:0/1959822338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5572440ba130 0x5572440b6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:54.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.301+0000 7f29ee59c640 1 -- 172.21.15.79:0/1959822338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572440ad880 msgr2=0x5572440b9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:54.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.301+0000 7f29ee59c640 1 --2- 172.21.15.79:0/1959822338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572440ad880 0x5572440b9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:54.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.301+0000 7f29ee59c640 1 -- 172.21.15.79:0/1959822338 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572440ac130 con 0x5572440ae1a0 2024-08-20T01:37:54.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.301+0000 7f29ee59c640 1 --2- 172.21.15.79:0/1959822338 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572440ae1a0 0x5572440b1a40 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f29e0005d00 tx=0x7f29e0005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a13b319a6580d716 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:54.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.301+0000 7f29d7fff640 1 -- 172.21.15.79:0/1959822338 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e00106f0 con 0x5572440ae1a0 2024-08-20T01:37:54.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.301+0000 7f29d7fff640 1 -- 172.21.15.79:0/1959822338 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29e0010d20 con 0x5572440ae1a0 2024-08-20T01:37:54.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.301+0000 7f29d7fff640 1 -- 172.21.15.79:0/1959822338 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e001ec20 con 0x5572440ae1a0 2024-08-20T01:37:54.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.302+0000 7f29f7282740 1 -- 172.21.15.79:0/1959822338 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572440ae1a0 msgr2=0x5572440b1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:54.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.302+0000 7f29f7282740 1 --2- 172.21.15.79:0/1959822338 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572440ae1a0 0x5572440b1a40 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f29e0005d00 tx=0x7f29e0005f90 comp rx=0 tx=0).stop 2024-08-20T01:37:54.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.302+0000 7f29f7282740 1 -- 172.21.15.79:0/1959822338 shutdown_connections 2024-08-20T01:37:54.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.302+0000 7f29f7282740 1 --2- 172.21.15.79:0/1959822338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5572440ba130 0x5572440b6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:54.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.302+0000 7f29f7282740 1 --2- 172.21.15.79:0/1959822338 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572440ae1a0 0x5572440b1a40 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:54.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.302+0000 7f29f7282740 1 --2- 172.21.15.79:0/1959822338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572440ad880 0x5572440b9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:54.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.302+0000 7f29f7282740 1 -- 172.21.15.79:0/1959822338 >> 172.21.15.79:0/1959822338 conn(0x5572440ab6b0 msgr2=0x5572440aa770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:54.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.302+0000 7f29f7282740 1 -- 172.21.15.79:0/1959822338 shutdown_connections 2024-08-20T01:37:54.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.302+0000 7f29f7282740 1 -- 172.21.15.79:0/1959822338 wait complete. 2024-08-20T01:37:54.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.302+0000 7f29f7282740 1 -- start start 2024-08-20T01:37:54.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.303+0000 7f29f7282740 1 Processor -- start 2024-08-20T01:37:54.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.303+0000 7f29f7282740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5572440ad880 0x5572440bd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:54.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.303+0000 7f29f7282740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572440ae1a0 0x5572440bd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:54.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.303+0000 7f29f7282740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572440ba130 0x557244132b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:54.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.303+0000 7f29f7282740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f29f01ad1c0 con 0x5572440ba130 2024-08-20T01:37:54.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.303+0000 7f29f7282740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f29f01acaf0 con 0x5572440ae1a0 2024-08-20T01:37:54.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.303+0000 7f29f7282740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f29f01a9d30 con 0x5572440ad880 2024-08-20T01:37:54.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.303+0000 7f29f7282740 10 client.0 _ll_register_callbacks cb 0x7f29e00097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:54.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.303+0000 7f29edd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572440ba130 0x557244132b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:54.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.303+0000 7f29edd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572440ba130 0x557244132b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45354/0 (socket says 172.21.15.79:45354) 2024-08-20T01:37:54.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.303+0000 7f29edd9b640 1 -- 172.21.15.79:0/3421929496 learned_addr learned my addr 172.21.15.79:0/3421929496 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:54.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.303+0000 7f29edd9b640 1 --2- 172.21.15.79:0/3421929496 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5572440ad880 0x5572440bd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:54.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.303+0000 7f29ee59c640 1 --2- 172.21.15.79:0/3421929496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572440ae1a0 0x5572440bd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:54.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.303+0000 7f29edd9b640 1 -- 172.21.15.79:0/3421929496 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5572440ad880 msgr2=0x5572440bd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:54.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.303+0000 7f29edd9b640 1 --2- 172.21.15.79:0/3421929496 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5572440ad880 0x5572440bd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:54.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.303+0000 7f29edd9b640 1 -- 172.21.15.79:0/3421929496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572440ae1a0 msgr2=0x5572440bd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:54.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.303+0000 7f29edd9b640 1 --2- 172.21.15.79:0/3421929496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572440ae1a0 0x5572440bd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:54.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.303+0000 7f29edd9b640 1 -- 172.21.15.79:0/3421929496 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572440bc910 con 0x5572440ba130 2024-08-20T01:37:54.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.303+0000 7f29edd9b640 1 --2- 172.21.15.79:0/3421929496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572440ba130 0x557244132b50 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f29e4009230 tx=0x7f29e4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d496ffaeb8aaf6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:54.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.303+0000 7f29d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:37:54.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.304+0000 7f29d5ffb640 1 -- 172.21.15.79:0/3421929496 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e4069060 con 0x5572440ba130 2024-08-20T01:37:54.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.304+0000 7f29d5ffb640 1 -- 172.21.15.79:0/3421929496 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f29e4003f30 con 0x5572440ba130 2024-08-20T01:37:54.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.304+0000 7f29f7282740 1 -- 172.21.15.79:0/3421929496 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29e0010d20 con 0x5572440ba130 2024-08-20T01:37:54.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.304+0000 7f29d5ffb640 1 -- 172.21.15.79:0/3421929496 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f29e4035040 con 0x5572440ba130 2024-08-20T01:37:54.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.304+0000 7f29f7282740 10 client.15729 fetch_fsmap learned FSMap version 28 2024-08-20T01:37:54.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.304+0000 7f29f7282740 1 -- 172.21.15.79:0/3421929496 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557244134030 con 0x5572440ba130 2024-08-20T01:37:54.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.304+0000 7f29d5ffb640 1 -- 172.21.15.79:0/3421929496 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29e0010d20 con 0x5572440ba130 2024-08-20T01:37:54.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.304+0000 7f29d5ffb640 1 -- 172.21.15.79:0/3421929496 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f29e4044040 con 0x5572440ba130 2024-08-20T01:37:54.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.304+0000 7f29f7282740 10 client.15729 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:37:54.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.304+0000 7f29f7282740 10 client.15729 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:37:54.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.304+0000 7f29f7282740 20 client.15729 populate_metadata read hostname 'smithi079' 2024-08-20T01:37:54.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.304+0000 7f29f7282740 1 --2- 172.21.15.79:0/3421929496 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x557244134720 0x557244136b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:54.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.304+0000 7f29f7282740 4 client.15729 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:37:54.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.304+0000 7f29f7282740 1 -- 172.21.15.79:0/3421929496 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557244022320 con 0x557244134720 2024-08-20T01:37:54.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.304+0000 7f29ee59c640 1 --2- 172.21.15.79:0/3421929496 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x557244134720 0x557244136b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:54.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.305+0000 7f29d5ffb640 10 client.15729 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:37:54.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.305+0000 7f29ee59c640 1 --2- 172.21.15.79:0/3421929496 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x557244134720 0x557244136b40 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=71440e949123f0da server_cookie=8daf37a99e4ec3 in_seq=0 out_seq=0 2024-08-20T01:37:54.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.305+0000 7f29d5ffb640 1 -- 172.21.15.79:0/3421929496 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557244022320 con 0x557244134720 2024-08-20T01:37:54.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.305+0000 7f29d5ffb640 10 client.15729 handle_command_reply: tid=0 2024-08-20T01:37:54.355 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:37:54.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.305+0000 7f29f7282740 1 client.15729 shutdown 2024-08-20T01:37:54.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.305+0000 7f29f7282740 1 -- 172.21.15.79:0/3421929496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572440ba130 msgr2=0x557244132b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:54.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.305+0000 7f29f7282740 1 --2- 172.21.15.79:0/3421929496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572440ba130 0x557244132b50 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f29e4009230 tx=0x7f29e4009260 comp rx=0 tx=0).stop 2024-08-20T01:37:54.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.305+0000 7f29f7282740 1 -- 172.21.15.79:0/3421929496 shutdown_connections 2024-08-20T01:37:54.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.305+0000 7f29f7282740 1 --2- 172.21.15.79:0/3421929496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5572440ba130 0x557244132b50 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:54.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.305+0000 7f29f7282740 1 --2- 172.21.15.79:0/3421929496 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x557244134720 0x557244136b40 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:54.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.305+0000 7f29d5ffb640 0 client.15729 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:37:54.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.305+0000 7f29f7282740 1 --2- 172.21.15.79:0/3421929496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572440ae1a0 0x5572440bd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:54.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.305+0000 7f29f7282740 1 --2- 172.21.15.79:0/3421929496 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5572440ad880 0x5572440bd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:54.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.305+0000 7f29f7282740 1 -- 172.21.15.79:0/3421929496 >> 172.21.15.79:0/3421929496 conn(0x5572440ab6b0 msgr2=0x5572440aa770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:54.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.305+0000 7f29f7282740 1 -- 172.21.15.79:0/3421929496 shutdown_connections 2024-08-20T01:37:54.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.305+0000 7f29f7282740 1 -- 172.21.15.79:0/3421929496 wait complete. 2024-08-20T01:37:54.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.305+0000 7f29f7282740 20 client.15729 trim_cache size 0 max 16384 2024-08-20T01:37:54.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.306+0000 7f29f4e89640 1 -- 172.21.15.79:0/4186646234 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f29d80b3c50 msgr2=0x7f29d80b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:54.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.306+0000 7f29f4e89640 1 --2- 172.21.15.79:0/4186646234 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f29d80b3c50 0x7f29d80b6110 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f29e80a71e0 tx=0x7f29e80a5040 comp rx=0 tx=0).stop 2024-08-20T01:37:54.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.306+0000 7f29f4e89640 1 -- 172.21.15.79:0/4186646234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29f0107d20 msgr2=0x7f29f019d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:54.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.306+0000 7f29f4e89640 1 --2- 172.21.15.79:0/4186646234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29f0107d20 0x7f29f019d670 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f29e8009fd0 tx=0x7f29e800ef10 comp rx=0 tx=0).stop 2024-08-20T01:37:54.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.306+0000 7f29f4e89640 1 -- 172.21.15.79:0/4186646234 shutdown_connections 2024-08-20T01:37:54.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.306+0000 7f29f4e89640 1 --2- 172.21.15.79:0/4186646234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29f0107d20 0x7f29f019d670 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:54.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.306+0000 7f29f4e89640 1 --2- 172.21.15.79:0/4186646234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29f01073a0 0x7f29f01982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:54.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.306+0000 7f29f4e89640 1 --2- 172.21.15.79:0/4186646234 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f29d80b3c50 0x7f29d80b6110 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:54.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.306+0000 7f29f4e89640 1 --2- 172.21.15.79:0/4186646234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29f0101990 0x7f29f0197d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:54.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.306+0000 7f29f4e89640 1 -- 172.21.15.79:0/4186646234 >> 172.21.15.79:0/4186646234 conn(0x7f29f00fd400 msgr2=0x7f29f00ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:54.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.306+0000 7f29f4e89640 1 -- 172.21.15.79:0/4186646234 shutdown_connections 2024-08-20T01:37:54.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:54.306+0000 7f29f4e89640 1 -- 172.21.15.79:0/4186646234 wait complete. 2024-08-20T01:37:54.360 INFO:tasks.workunit.client.0.smithi079.stdout:checking for sys/types.h... yes 2024-08-20T01:37:54.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:53 smithi175 ceph-mon[22392]: pgmap v364: 97 pgs: 97 active+clean; 944 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 27 KiB/s wr, 16 op/s 2024-08-20T01:37:54.398 INFO:tasks.workunit.client.0.smithi079.stdout:checking for sys/stat.h... yes 2024-08-20T01:37:54.465 INFO:tasks.workunit.client.0.smithi079.stdout:checking for stdlib.h... yes 2024-08-20T01:37:54.546 INFO:tasks.workunit.client.0.smithi079.stdout:checking for string.h... yes 2024-08-20T01:37:54.634 INFO:tasks.workunit.client.0.smithi079.stdout:checking for memory.h... yes 2024-08-20T01:37:54.695 INFO:tasks.workunit.client.0.smithi079.stdout:checking for strings.h... yes 2024-08-20T01:37:54.761 INFO:tasks.workunit.client.0.smithi079.stdout:checking for inttypes.h... yes 2024-08-20T01:37:54.841 INFO:tasks.workunit.client.0.smithi079.stdout:checking for stdint.h... yes 2024-08-20T01:37:54.914 INFO:tasks.workunit.client.0.smithi079.stdout:checking for unistd.h... yes 2024-08-20T01:37:55.019 INFO:tasks.workunit.client.0.smithi079.stdout:checking pthread.h usability... yes 2024-08-20T01:37:55.047 INFO:tasks.workunit.client.0.smithi079.stdout:checking pthread.h presence... yes 2024-08-20T01:37:55.047 INFO:tasks.workunit.client.0.smithi079.stdout:checking for pthread.h... yes 2024-08-20T01:37:55.118 INFO:tasks.workunit.client.0.smithi079.stdout:checking fcntl.h usability... yes 2024-08-20T01:37:55.124 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T01:37:55.146 INFO:tasks.workunit.client.0.smithi079.stdout:checking fcntl.h presence... yes 2024-08-20T01:37:55.146 INFO:tasks.workunit.client.0.smithi079.stdout:checking for fcntl.h... yes 2024-08-20T01:37:55.217 INFO:tasks.workunit.client.0.smithi079.stdout:checking limits.h usability... yes 2024-08-20T01:37:55.245 INFO:tasks.workunit.client.0.smithi079.stdout:checking limits.h presence... yes 2024-08-20T01:37:55.246 INFO:tasks.workunit.client.0.smithi079.stdout:checking for limits.h... yes 2024-08-20T01:37:55.268 INFO:tasks.workunit.client.0.smithi079.stdout:checking for stdint.h... (cached) yes 2024-08-20T01:37:55.334 INFO:tasks.workunit.client.0.smithi079.stdout:checking sys/time.h usability... yes 2024-08-20T01:37:55.367 INFO:tasks.workunit.client.0.smithi079.stdout:checking sys/time.h presence... yes 2024-08-20T01:37:55.368 INFO:tasks.workunit.client.0.smithi079.stdout:checking for sys/time.h... yes 2024-08-20T01:37:55.390 INFO:tasks.workunit.client.0.smithi079.stdout:checking for unistd.h... (cached) yes 2024-08-20T01:37:55.391 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:37:55.491 INFO:tasks.workunit.client.0.smithi079.stdout:checking sys/vfs.h usability... yes 2024-08-20T01:37:55.518 INFO:tasks.workunit.client.0.smithi079.stdout:checking sys/vfs.h presence... yes 2024-08-20T01:37:55.519 INFO:tasks.workunit.client.0.smithi079.stdout:checking for sys/vfs.h... yes 2024-08-20T01:37:55.593 INFO:tasks.workunit.client.0.smithi079.stdout:checking sys/limits.h usability... no 2024-08-20T01:37:55.623 INFO:tasks.workunit.client.0.smithi079.stdout:checking sys/limits.h presence... no 2024-08-20T01:37:55.623 INFO:tasks.workunit.client.0.smithi079.stdout:checking for sys/limits.h... no 2024-08-20T01:37:55.669 INFO:tasks.workunit.client.0.smithi079.stdout:checking for an ANSI C-conforming const... yes 2024-08-20T01:37:55.715 INFO:tasks.workunit.client.0.smithi079.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-08-20T01:37:55.717 INFO:tasks.workunit.client.0.smithi079.stdout:checking for function prototypes... yes 2024-08-20T01:37:55.790 INFO:tasks.workunit.client.0.smithi079.stdout:checking whether setvbuf arguments are reversed... no 2024-08-20T01:37:55.875 INFO:tasks.workunit.client.0.smithi079.stdout:checking for system... yes 2024-08-20T01:37:55.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.926+0000 7f9b97536640 1 -- 172.21.15.79:0/2837590051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b9010cde0 msgr2=0x7f9b9010f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:55.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.926+0000 7f9b97536640 1 --2- 172.21.15.79:0/2837590051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b9010cde0 0x7f9b9010f250 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f9b88009ca0 tx=0x7f9b8802a8c0 comp rx=0 tx=0).stop 2024-08-20T01:37:55.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.927+0000 7f9b97536640 1 -- 172.21.15.79:0/2837590051 shutdown_connections 2024-08-20T01:37:55.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.927+0000 7f9b97536640 1 --2- 172.21.15.79:0/2837590051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b9010cde0 0x7f9b9010f250 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:55.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.927+0000 7f9b97536640 1 --2- 172.21.15.79:0/2837590051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b90104230 0x7f9b9010c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:55.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.927+0000 7f9b97536640 1 --2- 172.21.15.79:0/2837590051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b90103830 0x7f9b90103c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:55.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.927+0000 7f9b97536640 1 -- 172.21.15.79:0/2837590051 >> 172.21.15.79:0/2837590051 conn(0x7f9b900fd400 msgr2=0x7f9b900ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:55.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.927+0000 7f9b97536640 1 -- 172.21.15.79:0/2837590051 shutdown_connections 2024-08-20T01:37:55.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.927+0000 7f9b97536640 1 -- 172.21.15.79:0/2837590051 wait complete. 2024-08-20T01:37:55.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.927+0000 7f9b97536640 1 Processor -- start 2024-08-20T01:37:55.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.927+0000 7f9b97536640 1 -- start start 2024-08-20T01:37:55.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.927+0000 7f9b97536640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b90103830 0x7f9b901016b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:55.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.927+0000 7f9b97536640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b90104230 0x7f9b90101bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:55.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.927+0000 7f9b97536640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b9010cde0 0x7f9b90102130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:55.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.928+0000 7f9b97536640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9b90112960 con 0x7f9b9010cde0 2024-08-20T01:37:55.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.928+0000 7f9b97536640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9b901127e0 con 0x7f9b90103830 2024-08-20T01:37:55.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.928+0000 7f9b97536640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9b90112ae0 con 0x7f9b90104230 2024-08-20T01:37:55.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.928+0000 7f9b95ad3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b9010cde0 0x7f9b90102130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:55.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.928+0000 7f9b952d2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b90103830 0x7f9b901016b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:55.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.928+0000 7f9b95ad3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b9010cde0 0x7f9b90102130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45374/0 (socket says 172.21.15.79:45374) 2024-08-20T01:37:55.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.928+0000 7f9b95ad3640 1 -- 172.21.15.79:0/3262213973 learned_addr learned my addr 172.21.15.79:0/3262213973 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:55.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.928+0000 7f9b94ad1640 1 --2- 172.21.15.79:0/3262213973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b90104230 0x7f9b90101bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:55.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.928+0000 7f9b952d2640 1 -- 172.21.15.79:0/3262213973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b90104230 msgr2=0x7f9b90101bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:55.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.928+0000 7f9b952d2640 1 --2- 172.21.15.79:0/3262213973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b90104230 0x7f9b90101bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:55.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.928+0000 7f9b952d2640 1 -- 172.21.15.79:0/3262213973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b9010cde0 msgr2=0x7f9b90102130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:55.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.928+0000 7f9b952d2640 1 --2- 172.21.15.79:0/3262213973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b9010cde0 0x7f9b90102130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:55.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.928+0000 7f9b952d2640 1 -- 172.21.15.79:0/3262213973 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b901a7270 con 0x7f9b90103830 2024-08-20T01:37:55.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.928+0000 7f9b94ad1640 1 --2- 172.21.15.79:0/3262213973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b90104230 0x7f9b90101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:37:55.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.928+0000 7f9b952d2640 1 --2- 172.21.15.79:0/3262213973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b90103830 0x7f9b901016b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9b8000e9f0 tx=0x7f9b8000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:55.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.928+0000 7f9b867fc640 1 -- 172.21.15.79:0/3262213973 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8000ccc0 con 0x7f9b90103830 2024-08-20T01:37:55.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.928+0000 7f9b867fc640 1 -- 172.21.15.79:0/3262213973 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9b800108c0 con 0x7f9b90103830 2024-08-20T01:37:55.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.928+0000 7f9b97536640 1 -- 172.21.15.79:0/3262213973 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b901a7560 con 0x7f9b90103830 2024-08-20T01:37:55.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.928+0000 7f9b867fc640 1 -- 172.21.15.79:0/3262213973 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b800187e0 con 0x7f9b90103830 2024-08-20T01:37:55.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.928+0000 7f9b97536640 1 -- 172.21.15.79:0/3262213973 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b901a7aa0 con 0x7f9b90103830 2024-08-20T01:37:55.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.931+0000 7f9b867fc640 1 -- 172.21.15.79:0/3262213973 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f9b80010430 con 0x7f9b90103830 2024-08-20T01:37:55.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.931+0000 7f9b9992f740 1 Processor -- start 2024-08-20T01:37:55.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.931+0000 7f9b9992f740 1 -- start start 2024-08-20T01:37:55.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.932+0000 7f9b9992f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582540ac880 0x5582540acc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:55.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.932+0000 7f9b9992f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582540ad1a0 0x5582540b8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:55.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.932+0000 7f9b9992f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582540b9130 0x5582540bb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:55.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.932+0000 7f9b9992f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558254023930 con 0x5582540b9130 2024-08-20T01:37:55.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.932+0000 7f9b9992f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558254012e30 con 0x5582540ac880 2024-08-20T01:37:55.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.932+0000 7f9b9992f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558254016e70 con 0x5582540ad1a0 2024-08-20T01:37:55.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.932+0000 7f9b94ad1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582540b9130 0x5582540bb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:55.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.932+0000 7f9b95ad3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582540ac880 0x5582540acc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:55.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.932+0000 7f9b94ad1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582540b9130 0x5582540bb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45390/0 (socket says 172.21.15.79:45390) 2024-08-20T01:37:55.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.932+0000 7f9b94ad1640 1 -- 172.21.15.79:0/1992192483 learned_addr learned my addr 172.21.15.79:0/1992192483 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:55.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.932+0000 7f9b952d2640 1 --2- 172.21.15.79:0/1992192483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582540ad1a0 0x5582540b8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:55.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.932+0000 7f9b95ad3640 1 -- 172.21.15.79:0/1992192483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582540ad1a0 msgr2=0x5582540b8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:55.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.932+0000 7f9b95ad3640 1 --2- 172.21.15.79:0/1992192483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582540ad1a0 0x5582540b8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:55.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.932+0000 7f9b95ad3640 1 -- 172.21.15.79:0/1992192483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582540b9130 msgr2=0x5582540bb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:55.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.932+0000 7f9b95ad3640 1 --2- 172.21.15.79:0/1992192483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582540b9130 0x5582540bb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:55.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.932+0000 7f9b95ad3640 1 -- 172.21.15.79:0/1992192483 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558253d72650 con 0x5582540ac880 2024-08-20T01:37:55.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.932+0000 7f9b952d2640 1 --2- 172.21.15.79:0/1992192483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582540ad1a0 0x5582540b8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:37:55.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.932+0000 7f9b867fc640 1 --2- 172.21.15.79:0/3262213973 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9b7c0b3bd0 0x7f9b7c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:55.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.933+0000 7f9b952d2640 1 --2- 172.21.15.79:0/3262213973 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9b7c0b3bd0 0x7f9b7c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:55.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.933+0000 7f9b95ad3640 1 --2- 172.21.15.79:0/1992192483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582540ac880 0x5582540acc60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9b90103770 tx=0x7f9b88005fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10c25c984dc5f5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:55.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.933+0000 7f9b7b7fe640 1 -- 172.21.15.79:0/1992192483 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b88031980 con 0x5582540ac880 2024-08-20T01:37:55.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.933+0000 7f9b867fc640 1 -- 172.21.15.79:0/3262213973 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9b800e3fa0 con 0x7f9b90103830 2024-08-20T01:37:55.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.933+0000 7f9b7b7fe640 1 -- 172.21.15.79:0/1992192483 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9b88036030 con 0x5582540ac880 2024-08-20T01:37:55.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.933+0000 7f9b7b7fe640 1 -- 172.21.15.79:0/1992192483 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b88004310 con 0x5582540ac880 2024-08-20T01:37:55.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.934+0000 7f9b9992f740 1 -- 172.21.15.79:0/1992192483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582540ac880 msgr2=0x5582540acc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:55.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.934+0000 7f9b952d2640 1 --2- 172.21.15.79:0/3262213973 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9b7c0b3bd0 0x7f9b7c0b6090 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9b800e1e20 tx=0x7f9b8001f000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:55.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.934+0000 7f9b9992f740 1 --2- 172.21.15.79:0/1992192483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582540ac880 0x5582540acc60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9b90103770 tx=0x7f9b88005fa0 comp rx=0 tx=0).stop 2024-08-20T01:37:55.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.934+0000 7f9b9992f740 1 -- 172.21.15.79:0/1992192483 shutdown_connections 2024-08-20T01:37:55.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.934+0000 7f9b9992f740 1 --2- 172.21.15.79:0/1992192483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582540b9130 0x5582540bb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:55.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.934+0000 7f9b9992f740 1 --2- 172.21.15.79:0/1992192483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582540ad1a0 0x5582540b8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:55.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.934+0000 7f9b9992f740 1 --2- 172.21.15.79:0/1992192483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582540ac880 0x5582540acc60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:55.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.934+0000 7f9b9992f740 1 -- 172.21.15.79:0/1992192483 >> 172.21.15.79:0/1992192483 conn(0x5582540aa6b0 msgr2=0x5582540ab850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:55.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.934+0000 7f9b9992f740 1 -- 172.21.15.79:0/1992192483 shutdown_connections 2024-08-20T01:37:55.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.934+0000 7f9b9992f740 1 -- 172.21.15.79:0/1992192483 wait complete. 2024-08-20T01:37:55.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.934+0000 7f9b9992f740 1 -- start start 2024-08-20T01:37:55.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.934+0000 7f9b9992f740 1 Processor -- start 2024-08-20T01:37:55.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.935+0000 7f9b9992f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582540ac880 0x5582540b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:55.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.935+0000 7f9b9992f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582540ad1a0 0x5582540b6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:55.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.935+0000 7f9b9992f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582540b9130 0x5582540b6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:55.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.935+0000 7f9b9992f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558253e75700 con 0x5582540b9130 2024-08-20T01:37:55.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.935+0000 7f9b9992f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558253f99810 con 0x5582540ac880 2024-08-20T01:37:55.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.935+0000 7f9b9992f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5582540bbc00 con 0x5582540ad1a0 2024-08-20T01:37:55.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.935+0000 7f9b9992f740 10 client.0 _ll_register_callbacks cb 0x55825400c700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:55.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.935+0000 7f9b95ad3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582540b9130 0x5582540b6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:55.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.935+0000 7f9b95ad3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582540b9130 0x5582540b6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45406/0 (socket says 172.21.15.79:45406) 2024-08-20T01:37:55.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.935+0000 7f9b95ad3640 1 -- 172.21.15.79:0/935626499 learned_addr learned my addr 172.21.15.79:0/935626499 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:55.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.935+0000 7f9b95ad3640 1 --2- 172.21.15.79:0/935626499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582540ac880 0x5582540b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:55.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.935+0000 7f9b94ad1640 1 --2- 172.21.15.79:0/935626499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582540ad1a0 0x5582540b6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:55.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.935+0000 7f9b95ad3640 1 -- 172.21.15.79:0/935626499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582540ad1a0 msgr2=0x5582540b6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:55.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.935+0000 7f9b95ad3640 1 --2- 172.21.15.79:0/935626499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582540ad1a0 0x5582540b6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:55.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.935+0000 7f9b95ad3640 1 -- 172.21.15.79:0/935626499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582540ac880 msgr2=0x5582540b60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:55.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.935+0000 7f9b95ad3640 1 --2- 172.21.15.79:0/935626499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582540ac880 0x5582540b60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:55.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.935+0000 7f9b95ad3640 1 -- 172.21.15.79:0/935626499 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582540c4fb0 con 0x5582540b9130 2024-08-20T01:37:55.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.935+0000 7f9b95ad3640 1 --2- 172.21.15.79:0/935626499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582540b9130 0x5582540b6b50 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f9b88006010 tx=0x7f9b88003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=146453c3bbddd93a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:55.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.935+0000 7f9b78ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:37:55.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.936+0000 7f9b78ff9640 1 -- 172.21.15.79:0/935626499 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b88058060 con 0x5582540b9130 2024-08-20T01:37:55.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.936+0000 7f9b9992f740 1 -- 172.21.15.79:0/935626499 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558253fc2150 con 0x5582540b9130 2024-08-20T01:37:55.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.936+0000 7f9b78ff9640 1 -- 172.21.15.79:0/935626499 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9b88031980 con 0x5582540b9130 2024-08-20T01:37:55.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.936+0000 7f9b78ff9640 1 -- 172.21.15.79:0/935626499 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9b8804a040 con 0x5582540b9130 2024-08-20T01:37:55.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.936+0000 7f9b9992f740 10 client.15741 fetch_fsmap learned FSMap version 28 2024-08-20T01:37:55.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.936+0000 7f9b9992f740 1 -- 172.21.15.79:0/935626499 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5582540c7940 con 0x5582540b9130 2024-08-20T01:37:55.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.936+0000 7f9b78ff9640 1 -- 172.21.15.79:0/935626499 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x558253fc2150 con 0x5582540b9130 2024-08-20T01:37:55.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.936+0000 7f9b78ff9640 1 -- 172.21.15.79:0/935626499 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9b88050070 con 0x5582540b9130 2024-08-20T01:37:55.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.936+0000 7f9b9992f740 10 client.15741 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:37:55.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.936+0000 7f9b9992f740 10 client.15741 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:37:55.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.936+0000 7f9b9992f740 20 client.15741 populate_metadata read hostname 'smithi079' 2024-08-20T01:37:55.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.936+0000 7f9b9992f740 1 --2- 172.21.15.79:0/935626499 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5582540c8c90 0x5582540cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:55.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.936+0000 7f9b9992f740 4 client.15741 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:37:55.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.936+0000 7f9b9992f740 1 -- 172.21.15.79:0/935626499 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558254025880 con 0x5582540c8c90 2024-08-20T01:37:55.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.936+0000 7f9b94ad1640 1 --2- 172.21.15.79:0/935626499 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5582540c8c90 0x5582540cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:55.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.937+0000 7f9b78ff9640 10 client.15741 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:37:55.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.937+0000 7f9b94ad1640 1 --2- 172.21.15.79:0/935626499 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5582540c8c90 0x5582540cb080 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf9d3f1ddac36a69 server_cookie=bb110a234b1fe5d6 in_seq=0 out_seq=0 2024-08-20T01:37:55.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.937+0000 7f9b78ff9640 1 -- 172.21.15.79:0/935626499 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558254025880 con 0x5582540c8c90 2024-08-20T01:37:55.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.937+0000 7f9b78ff9640 10 client.15741 handle_command_reply: tid=0 2024-08-20T01:37:55.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.938+0000 7f9b9992f740 1 client.15741 shutdown 2024-08-20T01:37:55.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.938+0000 7f9b9992f740 1 -- 172.21.15.79:0/935626499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582540b9130 msgr2=0x5582540b6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:55.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.938+0000 7f9b9992f740 1 --2- 172.21.15.79:0/935626499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582540b9130 0x5582540b6b50 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f9b88006010 tx=0x7f9b88003f90 comp rx=0 tx=0).stop 2024-08-20T01:37:55.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.938+0000 7f9b9992f740 1 -- 172.21.15.79:0/935626499 shutdown_connections 2024-08-20T01:37:55.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.938+0000 7f9b9992f740 1 --2- 172.21.15.79:0/935626499 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5582540c8c90 0x5582540cb080 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:55.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.938+0000 7f9b9992f740 1 --2- 172.21.15.79:0/935626499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582540b9130 0x5582540b6b50 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:55.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.938+0000 7f9b9992f740 1 --2- 172.21.15.79:0/935626499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582540ad1a0 0x5582540b6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:55.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.938+0000 7f9b9992f740 1 --2- 172.21.15.79:0/935626499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582540ac880 0x5582540b60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:55.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.938+0000 7f9b9992f740 1 -- 172.21.15.79:0/935626499 >> 172.21.15.79:0/935626499 conn(0x5582540aa6b0 msgr2=0x5582540b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:55.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.938+0000 7f9b78ff9640 0 client.15741 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:37:55.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.938+0000 7f9b9992f740 1 -- 172.21.15.79:0/935626499 shutdown_connections 2024-08-20T01:37:55.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.938+0000 7f9b9992f740 1 -- 172.21.15.79:0/935626499 wait complete. 2024-08-20T01:37:55.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.938+0000 7f9b9992f740 20 client.15741 trim_cache size 0 max 16384 2024-08-20T01:37:55.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.953+0000 7f9b9992f740 1 Processor -- start 2024-08-20T01:37:55.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.954+0000 7f9b9992f740 1 -- start start 2024-08-20T01:37:55.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.954+0000 7f9b9992f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582540ac880 0x5582540b5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:55.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.954+0000 7f9b9992f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582540ad1a0 0x5582540d06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:55.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.954+0000 7f9b9992f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582540b9130 0x5582540d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:55.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.954+0000 7f9b9992f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9b901b00f0 con 0x5582540ad1a0 2024-08-20T01:37:55.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.954+0000 7f9b9992f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9b901b1c30 con 0x5582540ac880 2024-08-20T01:37:55.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.954+0000 7f9b9992f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9b901b07c0 con 0x5582540b9130 2024-08-20T01:37:55.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.954+0000 7f9b94ad1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582540ad1a0 0x5582540d06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:55.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.954+0000 7f9b95ad3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582540ac880 0x5582540b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:55.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.954+0000 7f9b94ad1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582540ad1a0 0x5582540d06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45414/0 (socket says 172.21.15.79:45414) 2024-08-20T01:37:55.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.954+0000 7f9b94ad1640 1 -- 172.21.15.79:0/2427389143 learned_addr learned my addr 172.21.15.79:0/2427389143 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:55.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.954+0000 7f9b95ad3640 1 --2- 172.21.15.79:0/2427389143 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582540b9130 0x5582540d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:55.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.954+0000 7f9b95ad3640 1 -- 172.21.15.79:0/2427389143 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582540b9130 msgr2=0x5582540d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:55.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.954+0000 7f9b95ad3640 1 --2- 172.21.15.79:0/2427389143 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582540b9130 0x5582540d0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:55.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.954+0000 7f9b95ad3640 1 -- 172.21.15.79:0/2427389143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582540ad1a0 msgr2=0x5582540d06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:55.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.954+0000 7f9b95ad3640 1 --2- 172.21.15.79:0/2427389143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582540ad1a0 0x5582540d06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:55.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.954+0000 7f9b95ad3640 1 -- 172.21.15.79:0/2427389143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582540acfd0 con 0x5582540ac880 2024-08-20T01:37:55.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.954+0000 7f9b95ad3640 1 --2- 172.21.15.79:0/2427389143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582540ac880 0x5582540b5960 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9b88000f80 tx=0x7f9b88005fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=821b6ad02397a120 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:55.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.955+0000 7f9b7affd640 1 -- 172.21.15.79:0/2427389143 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b88058070 con 0x5582540ac880 2024-08-20T01:37:55.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.955+0000 7f9b7affd640 1 -- 172.21.15.79:0/2427389143 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9b88036030 con 0x5582540ac880 2024-08-20T01:37:55.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.955+0000 7f9b7affd640 1 -- 172.21.15.79:0/2427389143 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b88003de0 con 0x5582540ac880 2024-08-20T01:37:55.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.956+0000 7f9b9992f740 1 -- 172.21.15.79:0/2427389143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582540ac880 msgr2=0x5582540b5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:55.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.956+0000 7f9b9992f740 1 --2- 172.21.15.79:0/2427389143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582540ac880 0x5582540b5960 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9b88000f80 tx=0x7f9b88005fa0 comp rx=0 tx=0).stop 2024-08-20T01:37:55.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.956+0000 7f9b9992f740 1 -- 172.21.15.79:0/2427389143 shutdown_connections 2024-08-20T01:37:55.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.956+0000 7f9b9992f740 1 --2- 172.21.15.79:0/2427389143 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582540b9130 0x5582540d0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:55.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.956+0000 7f9b9992f740 1 --2- 172.21.15.79:0/2427389143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582540ad1a0 0x5582540d06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:55.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.956+0000 7f9b9992f740 1 --2- 172.21.15.79:0/2427389143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582540ac880 0x5582540b5960 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:55.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.956+0000 7f9b9992f740 1 -- 172.21.15.79:0/2427389143 >> 172.21.15.79:0/2427389143 conn(0x5582540aa6b0 msgr2=0x5582540b7f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:55.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.956+0000 7f9b9992f740 1 -- 172.21.15.79:0/2427389143 shutdown_connections 2024-08-20T01:37:55.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.956+0000 7f9b9992f740 1 -- 172.21.15.79:0/2427389143 wait complete. 2024-08-20T01:37:55.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.956+0000 7f9b9992f740 1 -- start start 2024-08-20T01:37:55.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.956+0000 7f9b9992f740 1 Processor -- start 2024-08-20T01:37:55.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.957+0000 7f9b9992f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582540ac880 0x5582540bc240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:55.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.957+0000 7f9b9992f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582540ad1a0 0x5582540bc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:55.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.957+0000 7f9b9992f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582540b9130 0x5582541316a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:55.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.957+0000 7f9b9992f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9b901b1560 con 0x5582540ad1a0 2024-08-20T01:37:55.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.957+0000 7f9b9992f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9b901b0e90 con 0x5582540ac880 2024-08-20T01:37:55.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.957+0000 7f9b9992f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9b901ae0d0 con 0x5582540b9130 2024-08-20T01:37:55.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.957+0000 7f9b9992f740 10 client.0 _ll_register_callbacks cb 0x7f9b8c00b4c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:55.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.957+0000 7f9b94ad1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582540ad1a0 0x5582540bc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:55.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.957+0000 7f9b94ad1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582540ad1a0 0x5582540bc780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45416/0 (socket says 172.21.15.79:45416) 2024-08-20T01:37:55.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.957+0000 7f9b94ad1640 1 -- 172.21.15.79:0/333205187 learned_addr learned my addr 172.21.15.79:0/333205187 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:55.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.957+0000 7f9b95ad3640 1 --2- 172.21.15.79:0/333205187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582540ac880 0x5582540bc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:55.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.957+0000 7f9b95ad3640 1 --2- 172.21.15.79:0/333205187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582540b9130 0x5582541316a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:55.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.957+0000 7f9b94ad1640 1 -- 172.21.15.79:0/333205187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582540b9130 msgr2=0x5582541316a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:55.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.957+0000 7f9b94ad1640 1 --2- 172.21.15.79:0/333205187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582540b9130 0x5582541316a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:55.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.957+0000 7f9b94ad1640 1 -- 172.21.15.79:0/333205187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582540ac880 msgr2=0x5582540bc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:55.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.957+0000 7f9b94ad1640 1 --2- 172.21.15.79:0/333205187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582540ac880 0x5582540bc240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:55.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.957+0000 7f9b94ad1640 1 -- 172.21.15.79:0/333205187 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558254131be0 con 0x5582540ad1a0 2024-08-20T01:37:55.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.957+0000 7f9b94ad1640 1 --2- 172.21.15.79:0/333205187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582540ad1a0 0x5582540bc780 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c0134b0 tx=0x7f9b8c013970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f07c43f51ad971d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:55.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.957+0000 7f9b78ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:37:55.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.958+0000 7f9b78ff9640 1 -- 172.21.15.79:0/333205187 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c005220 con 0x5582540ad1a0 2024-08-20T01:37:55.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.958+0000 7f9b78ff9640 1 -- 172.21.15.79:0/333205187 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9b8c0053c0 con 0x5582540ad1a0 2024-08-20T01:37:55.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.958+0000 7f9b9992f740 1 -- 172.21.15.79:0/333205187 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b88036030 con 0x5582540ad1a0 2024-08-20T01:37:55.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.958+0000 7f9b78ff9640 1 -- 172.21.15.79:0/333205187 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9b8c0055c0 con 0x5582540ad1a0 2024-08-20T01:37:55.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.958+0000 7f9b9992f740 10 client.15747 fetch_fsmap learned FSMap version 28 2024-08-20T01:37:55.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.958+0000 7f9b9992f740 1 -- 172.21.15.79:0/333205187 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558254132d50 con 0x5582540ad1a0 2024-08-20T01:37:55.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.958+0000 7f9b78ff9640 1 -- 172.21.15.79:0/333205187 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9b88036030 con 0x5582540ad1a0 2024-08-20T01:37:55.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.958+0000 7f9b78ff9640 1 -- 172.21.15.79:0/333205187 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9b8c01d760 con 0x5582540ad1a0 2024-08-20T01:37:55.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.958+0000 7f9b9992f740 10 client.15747 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:37:55.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.958+0000 7f9b9992f740 10 client.15747 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:37:55.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.958+0000 7f9b9992f740 20 client.15747 populate_metadata read hostname 'smithi079' 2024-08-20T01:37:55.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.958+0000 7f9b9992f740 1 --2- 172.21.15.79:0/333205187 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5582541334a0 0x5582541358c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:55.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.958+0000 7f9b9992f740 4 client.15747 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:37:55.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.958+0000 7f9b9992f740 1 -- 172.21.15.79:0/333205187 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558254021320 con 0x5582541334a0 2024-08-20T01:37:55.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.958+0000 7f9b95ad3640 1 --2- 172.21.15.79:0/333205187 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5582541334a0 0x5582541358c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:55.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.959+0000 7f9b78ff9640 10 client.15747 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:37:55.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.959+0000 7f9b95ad3640 1 --2- 172.21.15.79:0/333205187 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5582541334a0 0x5582541358c0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21ede5b70b51b200 server_cookie=23d9dc11d89739a1 in_seq=0 out_seq=0 2024-08-20T01:37:55.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.960+0000 7f9b78ff9640 1 -- 172.21.15.79:0/333205187 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558254021320 con 0x5582541334a0 2024-08-20T01:37:55.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.960+0000 7f9b78ff9640 10 client.15747 handle_command_reply: tid=0 2024-08-20T01:37:55.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.960+0000 7f9b9992f740 1 client.15747 shutdown 2024-08-20T01:37:55.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.960+0000 7f9b9992f740 1 -- 172.21.15.79:0/333205187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582540ad1a0 msgr2=0x5582540bc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:55.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.960+0000 7f9b9992f740 1 --2- 172.21.15.79:0/333205187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582540ad1a0 0x5582540bc780 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c0134b0 tx=0x7f9b8c013970 comp rx=0 tx=0).stop 2024-08-20T01:37:55.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.960+0000 7f9b9992f740 1 -- 172.21.15.79:0/333205187 shutdown_connections 2024-08-20T01:37:55.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.960+0000 7f9b9992f740 1 --2- 172.21.15.79:0/333205187 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5582541334a0 0x5582541358c0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:55.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.960+0000 7f9b9992f740 1 --2- 172.21.15.79:0/333205187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582540b9130 0x5582541316a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:55.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.960+0000 7f9b9992f740 1 --2- 172.21.15.79:0/333205187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582540ad1a0 0x5582540bc780 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:55.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.960+0000 7f9b9992f740 1 --2- 172.21.15.79:0/333205187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582540ac880 0x5582540bc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:55.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.960+0000 7f9b9992f740 1 -- 172.21.15.79:0/333205187 >> 172.21.15.79:0/333205187 conn(0x5582540aa6b0 msgr2=0x5582540b60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:55.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.960+0000 7f9b78ff9640 0 client.15747 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:37:55.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.960+0000 7f9b9992f740 1 -- 172.21.15.79:0/333205187 shutdown_connections 2024-08-20T01:37:55.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.960+0000 7f9b9992f740 1 -- 172.21.15.79:0/333205187 wait complete. 2024-08-20T01:37:55.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.960+0000 7f9b9992f740 20 client.15747 trim_cache size 0 max 16384 2024-08-20T01:37:55.979 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:37:55.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.961+0000 7f9b97536640 1 -- 172.21.15.79:0/3262213973 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9b7c0b3bd0 msgr2=0x7f9b7c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:55.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.961+0000 7f9b97536640 1 --2- 172.21.15.79:0/3262213973 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9b7c0b3bd0 0x7f9b7c0b6090 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9b800e1e20 tx=0x7f9b8001f000 comp rx=0 tx=0).stop 2024-08-20T01:37:55.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.961+0000 7f9b97536640 1 -- 172.21.15.79:0/3262213973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b90103830 msgr2=0x7f9b901016b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:55.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.961+0000 7f9b97536640 1 --2- 172.21.15.79:0/3262213973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b90103830 0x7f9b901016b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9b8000e9f0 tx=0x7f9b8000eeb0 comp rx=0 tx=0).stop 2024-08-20T01:37:55.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.961+0000 7f9b97536640 1 -- 172.21.15.79:0/3262213973 shutdown_connections 2024-08-20T01:37:55.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.961+0000 7f9b97536640 1 --2- 172.21.15.79:0/3262213973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b9010cde0 0x7f9b90102130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:55.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.961+0000 7f9b97536640 1 --2- 172.21.15.79:0/3262213973 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9b7c0b3bd0 0x7f9b7c0b6090 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:55.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.961+0000 7f9b97536640 1 --2- 172.21.15.79:0/3262213973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b90104230 0x7f9b90101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:55.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.961+0000 7f9b97536640 1 --2- 172.21.15.79:0/3262213973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b90103830 0x7f9b901016b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:55.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.961+0000 7f9b97536640 1 -- 172.21.15.79:0/3262213973 >> 172.21.15.79:0/3262213973 conn(0x7f9b900fd400 msgr2=0x7f9b900fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:55.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.961+0000 7f9b97536640 1 -- 172.21.15.79:0/3262213973 shutdown_connections 2024-08-20T01:37:55.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:55.961+0000 7f9b97536640 1 -- 172.21.15.79:0/3262213973 wait complete. 2024-08-20T01:37:55.981 INFO:tasks.workunit.client.0.smithi079.stdout:checking for gettimeofday... yes 2024-08-20T01:37:56.060 INFO:tasks.workunit.client.0.smithi079.stdout:checking for mkdir... yes 2024-08-20T01:37:56.146 INFO:tasks.workunit.client.0.smithi079.stdout:checking for strerror... yes 2024-08-20T01:37:56.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:55 smithi079 ceph-mon[18656]: pgmap v365: 97 pgs: 97 active+clean; 2.9 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 205 KiB/s wr, 42 op/s 2024-08-20T01:37:56.231 INFO:tasks.workunit.client.0.smithi079.stdout:checking for open64... yes 2024-08-20T01:37:56.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:55 smithi081 ceph-mon[22209]: pgmap v365: 97 pgs: 97 active+clean; 2.9 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 205 KiB/s wr, 42 op/s 2024-08-20T01:37:56.316 INFO:tasks.workunit.client.0.smithi079.stdout:checking for stat64... yes 2024-08-20T01:37:56.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:55 smithi175 ceph-mon[22392]: pgmap v365: 97 pgs: 97 active+clean; 2.9 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 205 KiB/s wr, 42 op/s 2024-08-20T01:37:56.401 INFO:tasks.workunit.client.0.smithi079.stdout:checking for fseeko64... yes 2024-08-20T01:37:56.492 INFO:tasks.workunit.client.0.smithi079.stdout:checking for lrand48_r... yes 2024-08-20T01:37:56.584 INFO:tasks.workunit.client.0.smithi079.stdout:checking for srand48_r... yes 2024-08-20T01:37:56.610 INFO:tasks.workunit.client.0.smithi079.stdout:configure: creating ./config.status 2024-08-20T01:37:56.747 INFO:tasks.workunit.client.0.smithi079.stdout:config.status: creating Makefile 2024-08-20T01:37:56.765 INFO:tasks.workunit.client.0.smithi079.stdout:config.status: creating config.h 2024-08-20T01:37:56.791 INFO:tasks.workunit.client.0.smithi079.stdout:config.status: executing depfiles commands 2024-08-20T01:37:56.864 INFO:tasks.workunit.client.0.smithi079.stdout:config.status: executing default commands 2024-08-20T01:37:56.931 INFO:tasks.workunit.client.0.smithi079.stderr:+ make 2024-08-20T01:37:56.959 INFO:tasks.workunit.client.0.smithi079.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run aclocal-1.10 2024-08-20T01:37:56.965 INFO:tasks.workunit.client.0.smithi079.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: aclocal-1.10: command not found 2024-08-20T01:37:56.966 INFO:tasks.workunit.client.0.smithi079.stderr:WARNING: `aclocal-1.10' is missing on your system. You should only need it if 2024-08-20T01:37:56.966 INFO:tasks.workunit.client.0.smithi079.stderr: you modified `acinclude.m4' or `configure.in'. You might want 2024-08-20T01:37:56.966 INFO:tasks.workunit.client.0.smithi079.stderr: to install the `Automake' and `Perl' packages. Grab them from 2024-08-20T01:37:56.966 INFO:tasks.workunit.client.0.smithi079.stderr: any GNU archive site. 2024-08-20T01:37:56.971 INFO:tasks.workunit.client.0.smithi079.stdout: cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run automake-1.10 --gnu 2024-08-20T01:37:56.976 INFO:tasks.workunit.client.0.smithi079.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: automake-1.10: command not found 2024-08-20T01:37:56.976 INFO:tasks.workunit.client.0.smithi079.stderr:WARNING: `automake-1.10' is missing on your system. You should only need it if 2024-08-20T01:37:56.977 INFO:tasks.workunit.client.0.smithi079.stderr: you modified `Makefile.am', `acinclude.m4' or `configure.in'. 2024-08-20T01:37:56.977 INFO:tasks.workunit.client.0.smithi079.stderr: You might want to install the `Automake' and `Perl' packages. 2024-08-20T01:37:56.977 INFO:tasks.workunit.client.0.smithi079.stderr: Grab them from any GNU archive site. 2024-08-20T01:37:57.166 INFO:tasks.workunit.client.0.smithi079.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoconf 2024-08-20T01:37:57.474 INFO:tasks.workunit.client.0.smithi079.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2024-08-20T01:37:57.474 INFO:tasks.workunit.client.0.smithi079.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2024-08-20T01:37:57.474 INFO:tasks.workunit.client.0.smithi079.stderr:If you have problems, you may need to regenerate the build system entirely. 2024-08-20T01:37:57.474 INFO:tasks.workunit.client.0.smithi079.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2024-08-20T01:37:57.611 INFO:tasks.workunit.client.0.smithi079.stdout:/bin/sh ./config.status --recheck 2024-08-20T01:37:57.670 INFO:tasks.workunit.client.0.smithi079.stdout:running CONFIG_SHELL=/bin/sh /bin/sh ./configure --no-create --no-recursion 2024-08-20T01:37:57.721 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T01:37:57.722 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T01:37:57.816 INFO:tasks.workunit.client.0.smithi079.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-08-20T01:37:57.975 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:37:58.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:57 smithi081 ceph-mon[22209]: pgmap v366: 97 pgs: 97 active+clean; 3.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 252 KiB/s wr, 64 op/s 2024-08-20T01:37:58.287 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:57 smithi079 ceph-mon[18656]: pgmap v366: 97 pgs: 97 active+clean; 3.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 252 KiB/s wr, 64 op/s 2024-08-20T01:37:58.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.369+0000 7ff20b7f3640 1 -- 172.21.15.79:0/1425317606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2041073a0 msgr2=0x7ff2041077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:58.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.369+0000 7ff20b7f3640 1 --2- 172.21.15.79:0/1425317606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2041073a0 0x7ff2041077e0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff200009900 tx=0x7ff20002a410 comp rx=0 tx=0).stop 2024-08-20T01:37:58.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.369+0000 7ff20b7f3640 1 -- 172.21.15.79:0/1425317606 shutdown_connections 2024-08-20T01:37:58.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.369+0000 7ff20b7f3640 1 --2- 172.21.15.79:0/1425317606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff204107d20 0x7ff20410e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:58.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.369+0000 7ff20b7f3640 1 --2- 172.21.15.79:0/1425317606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2041073a0 0x7ff2041077e0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:58.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.369+0000 7ff20b7f3640 1 --2- 172.21.15.79:0/1425317606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff204101990 0x7ff204101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:58.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.369+0000 7ff20b7f3640 1 -- 172.21.15.79:0/1425317606 >> 172.21.15.79:0/1425317606 conn(0x7ff2040fd400 msgr2=0x7ff2040ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:58.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.369+0000 7ff20b7f3640 1 -- 172.21.15.79:0/1425317606 shutdown_connections 2024-08-20T01:37:58.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.369+0000 7ff20b7f3640 1 -- 172.21.15.79:0/1425317606 wait complete. 2024-08-20T01:37:58.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.369+0000 7ff20b7f3640 1 Processor -- start 2024-08-20T01:37:58.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.369+0000 7ff20b7f3640 1 -- start start 2024-08-20T01:37:58.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.370+0000 7ff20b7f3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff204101990 0x7ff204198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:58.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.370+0000 7ff20b7f3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2041073a0 0x7ff204199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:58.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.370+0000 7ff20b7f3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff204107d20 0x7ff20419e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:58.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.370+0000 7ff20b7f3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff2041129b0 con 0x7ff2041073a0 2024-08-20T01:37:58.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.370+0000 7ff20b7f3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff204112830 con 0x7ff204107d20 2024-08-20T01:37:58.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.370+0000 7ff20b7f3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff204112b30 con 0x7ff204101990 2024-08-20T01:37:58.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.370+0000 7ff208d8e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2041073a0 0x7ff204199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:58.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.370+0000 7ff208d8e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2041073a0 0x7ff204199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45426/0 (socket says 172.21.15.79:45426) 2024-08-20T01:37:58.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.370+0000 7ff208d8e640 1 -- 172.21.15.79:0/3484606116 learned_addr learned my addr 172.21.15.79:0/3484606116 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:58.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.370+0000 7ff20958f640 1 --2- 172.21.15.79:0/3484606116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff204101990 0x7ff204198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:58.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.370+0000 7ff209d90640 1 --2- 172.21.15.79:0/3484606116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff204107d20 0x7ff20419e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:58.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.370+0000 7ff208d8e640 1 -- 172.21.15.79:0/3484606116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff204101990 msgr2=0x7ff204198e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:58.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.370+0000 7ff208d8e640 1 --2- 172.21.15.79:0/3484606116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff204101990 0x7ff204198e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:58.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.370+0000 7ff208d8e640 1 -- 172.21.15.79:0/3484606116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff204107d20 msgr2=0x7ff20419e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:58.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.370+0000 7ff208d8e640 1 --2- 172.21.15.79:0/3484606116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff204107d20 0x7ff20419e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:58.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.370+0000 7ff208d8e640 1 -- 172.21.15.79:0/3484606116 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff20419eeb0 con 0x7ff2041073a0 2024-08-20T01:37:58.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.370+0000 7ff208d8e640 1 --2- 172.21.15.79:0/3484606116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2041073a0 0x7ff204199340 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7ff200009230 tx=0x7ff200004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:58.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.371+0000 7ff1f67fc640 1 -- 172.21.15.79:0/3484606116 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff20003f030 con 0x7ff2041073a0 2024-08-20T01:37:58.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.371+0000 7ff1f67fc640 1 -- 172.21.15.79:0/3484606116 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff200003a80 con 0x7ff2041073a0 2024-08-20T01:37:58.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.371+0000 7ff20b7f3640 1 -- 172.21.15.79:0/3484606116 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff20419f140 con 0x7ff2041073a0 2024-08-20T01:37:58.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.371+0000 7ff1f67fc640 1 -- 172.21.15.79:0/3484606116 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff200035070 con 0x7ff2041073a0 2024-08-20T01:37:58.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.371+0000 7ff20b7f3640 1 -- 172.21.15.79:0/3484606116 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2041a5860 con 0x7ff2041073a0 2024-08-20T01:37:58.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.373+0000 7ff20dbec740 1 Processor -- start 2024-08-20T01:37:58.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.373+0000 7ff1f67fc640 1 -- 172.21.15.79:0/3484606116 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff200042030 con 0x7ff2041073a0 2024-08-20T01:37:58.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.373+0000 7ff20dbec740 1 -- start start 2024-08-20T01:37:58.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.373+0000 7ff20dbec740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56181be1a3b0 0x56181be1a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:58.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.373+0000 7ff20dbec740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56181be1acd0 0x56181be2ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:58.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.373+0000 7ff20dbec740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56181be2b070 0x56181be2d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:58.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.373+0000 7ff20dbec740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56181bd90940 con 0x56181be1a3b0 2024-08-20T01:37:58.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.373+0000 7ff20dbec740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56181bd7fe40 con 0x56181be1acd0 2024-08-20T01:37:58.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.373+0000 7ff20dbec740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56181bd83e80 con 0x56181be2b070 2024-08-20T01:37:58.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.374+0000 7ff209d90640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56181be1a3b0 0x56181be1a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:58.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.374+0000 7ff20958f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56181be1acd0 0x56181be2ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:58.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.374+0000 7ff209d90640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56181be1a3b0 0x56181be1a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45442/0 (socket says 172.21.15.79:45442) 2024-08-20T01:37:58.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.374+0000 7ff209d90640 1 -- 172.21.15.79:0/443034423 learned_addr learned my addr 172.21.15.79:0/443034423 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:58.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.374+0000 7ff208d8e640 1 --2- 172.21.15.79:0/443034423 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56181be2b070 0x56181be2d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:58.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.374+0000 7ff20958f640 1 -- 172.21.15.79:0/443034423 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56181be2b070 msgr2=0x56181be2d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:58.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.374+0000 7ff20958f640 1 --2- 172.21.15.79:0/443034423 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56181be2b070 0x56181be2d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:58.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.374+0000 7ff20958f640 1 -- 172.21.15.79:0/443034423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56181be1a3b0 msgr2=0x56181be1a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:58.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.374+0000 7ff20958f640 1 --2- 172.21.15.79:0/443034423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56181be1a3b0 0x56181be1a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:58.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.374+0000 7ff20958f640 1 -- 172.21.15.79:0/443034423 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56181bd1c520 con 0x56181be1acd0 2024-08-20T01:37:58.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.374+0000 7ff208d8e640 1 --2- 172.21.15.79:0/443034423 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56181be2b070 0x56181be2d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:37:58.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.374+0000 7ff209d90640 1 --2- 172.21.15.79:0/443034423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56181be1a3b0 0x56181be1a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:37:58.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.374+0000 7ff20958f640 1 --2- 172.21.15.79:0/443034423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56181be1acd0 0x56181be2ab30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff1f800abf0 tx=0x7ff1f800f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=847ccfbe2a649a5d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:58.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.374+0000 7ff1f67fc640 1 --2- 172.21.15.79:0/3484606116 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff1f00b3c50 0x7ff1f00b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:58.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.374+0000 7ff1ef7fe640 1 -- 172.21.15.79:0/443034423 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f8005220 con 0x56181be1acd0 2024-08-20T01:37:58.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.374+0000 7ff1ef7fe640 1 -- 172.21.15.79:0/443034423 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff1f80047a0 con 0x56181be1acd0 2024-08-20T01:37:58.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.374+0000 7ff1ef7fe640 1 -- 172.21.15.79:0/443034423 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f80186a0 con 0x56181be1acd0 2024-08-20T01:37:58.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.374+0000 7ff209d90640 1 --2- 172.21.15.79:0/3484606116 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff1f00b3c50 0x7ff1f00b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:58.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.375+0000 7ff1f67fc640 1 -- 172.21.15.79:0/3484606116 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff200103f90 con 0x7ff2041073a0 2024-08-20T01:37:58.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.375+0000 7ff20dbec740 1 -- 172.21.15.79:0/443034423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56181be1acd0 msgr2=0x56181be2ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:58.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.375+0000 7ff209d90640 1 --2- 172.21.15.79:0/3484606116 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff1f00b3c50 0x7ff1f00b6110 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc005f40 tx=0x7ff1fc009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:58.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.375+0000 7ff20dbec740 1 --2- 172.21.15.79:0/443034423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56181be1acd0 0x56181be2ab30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff1f800abf0 tx=0x7ff1f800f790 comp rx=0 tx=0).stop 2024-08-20T01:37:58.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.375+0000 7ff20dbec740 1 -- 172.21.15.79:0/443034423 shutdown_connections 2024-08-20T01:37:58.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.375+0000 7ff20dbec740 1 --2- 172.21.15.79:0/443034423 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56181be2b070 0x56181be2d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:58.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.375+0000 7ff20dbec740 1 --2- 172.21.15.79:0/443034423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56181be1acd0 0x56181be2ab30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:58.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.375+0000 7ff20dbec740 1 --2- 172.21.15.79:0/443034423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56181be1a3b0 0x56181be1a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:58.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.375+0000 7ff20dbec740 1 -- 172.21.15.79:0/443034423 >> 172.21.15.79:0/443034423 conn(0x56181be181e0 msgr2=0x56181be19380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:58.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.375+0000 7ff20dbec740 1 -- 172.21.15.79:0/443034423 shutdown_connections 2024-08-20T01:37:58.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.375+0000 7ff20dbec740 1 -- 172.21.15.79:0/443034423 wait complete. 2024-08-20T01:37:58.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.375+0000 7ff20dbec740 1 -- start start 2024-08-20T01:37:58.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.376+0000 7ff20dbec740 1 Processor -- start 2024-08-20T01:37:58.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.376+0000 7ff20dbec740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56181be1a3b0 0x56181be27fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:58.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.376+0000 7ff20dbec740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56181be1acd0 0x56181be284e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:58.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.376+0000 7ff20dbec740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56181be2b070 0x56181be28a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:58.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.376+0000 7ff20dbec740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56181bbe2890 con 0x56181be2b070 2024-08-20T01:37:58.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.376+0000 7ff20dbec740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56181bd06700 con 0x56181be1a3b0 2024-08-20T01:37:58.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.376+0000 7ff20dbec740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56181be2ddc0 con 0x56181be1acd0 2024-08-20T01:37:58.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.376+0000 7ff20dbec740 10 client.0 _ll_register_callbacks cb 0x56181bd7b6f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:58.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.376+0000 7ff209d90640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56181be2b070 0x56181be28a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:58.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.376+0000 7ff209d90640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56181be2b070 0x56181be28a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45446/0 (socket says 172.21.15.79:45446) 2024-08-20T01:37:58.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.376+0000 7ff209d90640 1 -- 172.21.15.79:0/3056287989 learned_addr learned my addr 172.21.15.79:0/3056287989 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:58.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.376+0000 7ff20958f640 1 --2- 172.21.15.79:0/3056287989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56181be1a3b0 0x56181be27fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:58.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.376+0000 7ff208d8e640 1 --2- 172.21.15.79:0/3056287989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56181be1acd0 0x56181be284e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:58.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.377+0000 7ff209d90640 1 -- 172.21.15.79:0/3056287989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56181be1acd0 msgr2=0x56181be284e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:58.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.377+0000 7ff209d90640 1 --2- 172.21.15.79:0/3056287989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56181be1acd0 0x56181be284e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:58.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.377+0000 7ff209d90640 1 -- 172.21.15.79:0/3056287989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56181be1a3b0 msgr2=0x56181be27fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:58.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.377+0000 7ff209d90640 1 --2- 172.21.15.79:0/3056287989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56181be1a3b0 0x56181be27fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:58.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.377+0000 7ff209d90640 1 -- 172.21.15.79:0/3056287989 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56181badf930 con 0x56181be2b070 2024-08-20T01:37:58.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.377+0000 7ff208d8e640 1 --2- 172.21.15.79:0/3056287989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56181be1acd0 0x56181be284e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:37:58.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.377+0000 7ff20958f640 1 --2- 172.21.15.79:0/3056287989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56181be1a3b0 0x56181be27fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:37:58.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.377+0000 7ff209d90640 1 --2- 172.21.15.79:0/3056287989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56181be2b070 0x56181be28a20 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc009c00 tx=0x7ff1fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b405e5c58e4b4170 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:58.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.377+0000 7ff1ecff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:37:58.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.377+0000 7ff1ecff9640 1 -- 172.21.15.79:0/3056287989 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc003970 con 0x56181be2b070 2024-08-20T01:37:58.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.377+0000 7ff1ecff9640 1 -- 172.21.15.79:0/3056287989 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff1fc003b10 con 0x56181be2b070 2024-08-20T01:37:58.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.377+0000 7ff20dbec740 1 -- 172.21.15.79:0/3056287989 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1f80047a0 con 0x56181be2b070 2024-08-20T01:37:58.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.377+0000 7ff1ecff9640 1 -- 172.21.15.79:0/3056287989 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff1fc003d50 con 0x56181be2b070 2024-08-20T01:37:58.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.377+0000 7ff20dbec740 10 client.15759 fetch_fsmap learned FSMap version 28 2024-08-20T01:37:58.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.377+0000 7ff20dbec740 1 -- 172.21.15.79:0/3056287989 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56181be398e0 con 0x56181be2b070 2024-08-20T01:37:58.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.377+0000 7ff1ecff9640 1 -- 172.21.15.79:0/3056287989 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff1f80047a0 con 0x56181be2b070 2024-08-20T01:37:58.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.377+0000 7ff1ecff9640 1 -- 172.21.15.79:0/3056287989 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff1fc01a040 con 0x56181be2b070 2024-08-20T01:37:58.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.378+0000 7ff20dbec740 10 client.15759 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:37:58.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.378+0000 7ff20dbec740 10 client.15759 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:37:58.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.378+0000 7ff20dbec740 20 client.15759 populate_metadata read hostname 'smithi079' 2024-08-20T01:37:58.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.378+0000 7ff20dbec740 1 --2- 172.21.15.79:0/3056287989 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56181be3ae40 0x56181be3d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:58.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.378+0000 7ff20dbec740 4 client.15759 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:37:58.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.378+0000 7ff20dbec740 1 -- 172.21.15.79:0/3056287989 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56181bd92890 con 0x56181be3ae40 2024-08-20T01:37:58.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.378+0000 7ff20958f640 1 --2- 172.21.15.79:0/3056287989 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56181be3ae40 0x56181be3d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:58.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.378+0000 7ff1ecff9640 10 client.15759 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:37:58.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.378+0000 7ff20958f640 1 --2- 172.21.15.79:0/3056287989 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56181be3ae40 0x56181be3d270 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eff87be4853d85d6 server_cookie=1fd8509de5c889fd in_seq=0 out_seq=0 2024-08-20T01:37:58.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.379+0000 7ff1ecff9640 1 -- 172.21.15.79:0/3056287989 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56181bd92890 con 0x56181be3ae40 2024-08-20T01:37:58.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.379+0000 7ff1ecff9640 10 client.15759 handle_command_reply: tid=0 2024-08-20T01:37:58.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.379+0000 7ff20dbec740 1 client.15759 shutdown 2024-08-20T01:37:58.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.379+0000 7ff20dbec740 1 -- 172.21.15.79:0/3056287989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56181be2b070 msgr2=0x56181be28a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:58.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.379+0000 7ff20dbec740 1 --2- 172.21.15.79:0/3056287989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56181be2b070 0x56181be28a20 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc009c00 tx=0x7ff1fc004a40 comp rx=0 tx=0).stop 2024-08-20T01:37:58.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.379+0000 7ff20dbec740 1 -- 172.21.15.79:0/3056287989 shutdown_connections 2024-08-20T01:37:58.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.379+0000 7ff20dbec740 1 --2- 172.21.15.79:0/3056287989 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56181be3ae40 0x56181be3d270 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:58.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.379+0000 7ff20dbec740 1 --2- 172.21.15.79:0/3056287989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56181be2b070 0x56181be28a20 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:58.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.379+0000 7ff20dbec740 1 --2- 172.21.15.79:0/3056287989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56181be1acd0 0x56181be284e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:58.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.379+0000 7ff20dbec740 1 --2- 172.21.15.79:0/3056287989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56181be1a3b0 0x56181be27fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:58.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.379+0000 7ff20dbec740 1 -- 172.21.15.79:0/3056287989 >> 172.21.15.79:0/3056287989 conn(0x56181be181e0 msgr2=0x56181be1dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:58.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.379+0000 7ff1ecff9640 0 client.15759 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:37:58.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.379+0000 7ff20dbec740 1 -- 172.21.15.79:0/3056287989 shutdown_connections 2024-08-20T01:37:58.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.379+0000 7ff20dbec740 1 -- 172.21.15.79:0/3056287989 wait complete. 2024-08-20T01:37:58.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.379+0000 7ff20dbec740 20 client.15759 trim_cache size 0 max 16384 2024-08-20T01:37:58.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:57 smithi175 ceph-mon[22392]: pgmap v366: 97 pgs: 97 active+clean; 3.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 252 KiB/s wr, 64 op/s 2024-08-20T01:37:58.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.396+0000 7ff20dbec740 1 Processor -- start 2024-08-20T01:37:58.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.397+0000 7ff20dbec740 1 -- start start 2024-08-20T01:37:58.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.397+0000 7ff20dbec740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56181be1a3b0 0x56181be29c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:58.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.397+0000 7ff20dbec740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56181be1acd0 0x56181be25b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:58.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.397+0000 7ff20dbec740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56181be2b070 0x56181be17af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:58.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.397+0000 7ff20dbec740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff2041abd30 con 0x56181be2b070 2024-08-20T01:37:58.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.397+0000 7ff20dbec740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff2041ad870 con 0x56181be1acd0 2024-08-20T01:37:58.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.397+0000 7ff20dbec740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff2041ac400 con 0x56181be1a3b0 2024-08-20T01:37:58.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.397+0000 7ff209d90640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56181be2b070 0x56181be17af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:58.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.397+0000 7ff209d90640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56181be2b070 0x56181be17af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45454/0 (socket says 172.21.15.79:45454) 2024-08-20T01:37:58.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.397+0000 7ff209d90640 1 -- 172.21.15.79:0/724768482 learned_addr learned my addr 172.21.15.79:0/724768482 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:58.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.397+0000 7ff20958f640 1 --2- 172.21.15.79:0/724768482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56181be1a3b0 0x56181be29c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:58.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.397+0000 7ff208d8e640 1 --2- 172.21.15.79:0/724768482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56181be1acd0 0x56181be25b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:58.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.397+0000 7ff209d90640 1 -- 172.21.15.79:0/724768482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56181be1a3b0 msgr2=0x56181be29c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:58.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.397+0000 7ff209d90640 1 --2- 172.21.15.79:0/724768482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56181be1a3b0 0x56181be29c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:58.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.397+0000 7ff209d90640 1 -- 172.21.15.79:0/724768482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56181be1acd0 msgr2=0x56181be25b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:58.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.397+0000 7ff209d90640 1 --2- 172.21.15.79:0/724768482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56181be1acd0 0x56181be25b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:58.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.397+0000 7ff209d90640 1 -- 172.21.15.79:0/724768482 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56181be264a0 con 0x56181be2b070 2024-08-20T01:37:58.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.397+0000 7ff20958f640 1 --2- 172.21.15.79:0/724768482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56181be1a3b0 0x56181be29c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:37:58.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.397+0000 7ff209d90640 1 --2- 172.21.15.79:0/724768482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56181be2b070 0x56181be17af0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc006010 tx=0x7ff1fc0041d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e6d0aa8d7fa532f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:58.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.397+0000 7ff1eeffd640 1 -- 172.21.15.79:0/724768482 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc035030 con 0x56181be2b070 2024-08-20T01:37:58.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.398+0000 7ff1eeffd640 1 -- 172.21.15.79:0/724768482 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff1fc004540 con 0x56181be2b070 2024-08-20T01:37:58.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.398+0000 7ff1eeffd640 1 -- 172.21.15.79:0/724768482 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc01c9e0 con 0x56181be2b070 2024-08-20T01:37:58.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.398+0000 7ff20dbec740 1 -- 172.21.15.79:0/724768482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56181be2b070 msgr2=0x56181be17af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:58.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.398+0000 7ff20dbec740 1 --2- 172.21.15.79:0/724768482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56181be2b070 0x56181be17af0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc006010 tx=0x7ff1fc0041d0 comp rx=0 tx=0).stop 2024-08-20T01:37:58.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.398+0000 7ff20dbec740 1 -- 172.21.15.79:0/724768482 shutdown_connections 2024-08-20T01:37:58.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.398+0000 7ff20dbec740 1 --2- 172.21.15.79:0/724768482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56181be2b070 0x56181be17af0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:58.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.398+0000 7ff20dbec740 1 --2- 172.21.15.79:0/724768482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56181be1acd0 0x56181be25b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:58.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.398+0000 7ff20dbec740 1 --2- 172.21.15.79:0/724768482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56181be1a3b0 0x56181be29c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:58.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.398+0000 7ff20dbec740 1 -- 172.21.15.79:0/724768482 >> 172.21.15.79:0/724768482 conn(0x56181be181e0 msgr2=0x56181be27f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:58.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.398+0000 7ff20dbec740 1 -- 172.21.15.79:0/724768482 shutdown_connections 2024-08-20T01:37:58.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.398+0000 7ff20dbec740 1 -- 172.21.15.79:0/724768482 wait complete. 2024-08-20T01:37:58.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.399+0000 7ff20dbec740 1 -- start start 2024-08-20T01:37:58.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.399+0000 7ff20dbec740 1 Processor -- start 2024-08-20T01:37:58.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.399+0000 7ff20dbec740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56181be1a3b0 0x56181be1c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:58.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.399+0000 7ff20dbec740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56181be1acd0 0x56181be33080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:58.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.399+0000 7ff20dbec740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56181be2b070 0x56181be335c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:58.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.399+0000 7ff20dbec740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff2041ad1a0 con 0x56181be1acd0 2024-08-20T01:37:58.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.399+0000 7ff20dbec740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff2041acad0 con 0x56181be2b070 2024-08-20T01:37:58.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.399+0000 7ff20dbec740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff2041a9d10 con 0x56181be1a3b0 2024-08-20T01:37:58.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.399+0000 7ff20dbec740 10 client.0 _ll_register_callbacks cb 0x7ff1fc011ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:37:58.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.399+0000 7ff208d8e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56181be1acd0 0x56181be33080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:58.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.399+0000 7ff208d8e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56181be1acd0 0x56181be33080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45468/0 (socket says 172.21.15.79:45468) 2024-08-20T01:37:58.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.399+0000 7ff208d8e640 1 -- 172.21.15.79:0/1831840107 learned_addr learned my addr 172.21.15.79:0/1831840107 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:37:58.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.399+0000 7ff20958f640 1 --2- 172.21.15.79:0/1831840107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56181be1a3b0 0x56181be1c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:58.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.399+0000 7ff209d90640 1 --2- 172.21.15.79:0/1831840107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56181be2b070 0x56181be335c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:58.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.399+0000 7ff208d8e640 1 -- 172.21.15.79:0/1831840107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56181be1a3b0 msgr2=0x56181be1c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:58.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.399+0000 7ff208d8e640 1 --2- 172.21.15.79:0/1831840107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56181be1a3b0 0x56181be1c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:58.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.399+0000 7ff208d8e640 1 -- 172.21.15.79:0/1831840107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56181be2b070 msgr2=0x56181be335c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:37:58.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.399+0000 7ff208d8e640 1 --2- 172.21.15.79:0/1831840107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56181be2b070 0x56181be335c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:58.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.400+0000 7ff208d8e640 1 -- 172.21.15.79:0/1831840107 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56181be33bb0 con 0x56181be1acd0 2024-08-20T01:37:58.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.400+0000 7ff208d8e640 1 --2- 172.21.15.79:0/1831840107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56181be1acd0 0x56181be33080 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ff200101b60 tx=0x7ff200003e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8209dd4ba319eb41 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:37:58.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.400+0000 7ff1ecff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:37:58.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.400+0000 7ff1ecff9640 1 -- 172.21.15.79:0/1831840107 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff200049070 con 0x56181be1acd0 2024-08-20T01:37:58.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.400+0000 7ff1ecff9640 1 -- 172.21.15.79:0/1831840107 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff2000cb1f0 con 0x56181be1acd0 2024-08-20T01:37:58.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.400+0000 7ff20dbec740 1 -- 172.21.15.79:0/1831840107 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1fc004540 con 0x56181be1acd0 2024-08-20T01:37:58.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.400+0000 7ff1ecff9640 1 -- 172.21.15.79:0/1831840107 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff2000caaa0 con 0x56181be1acd0 2024-08-20T01:37:58.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.400+0000 7ff20dbec740 10 client.15765 fetch_fsmap learned FSMap version 28 2024-08-20T01:37:58.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.400+0000 7ff20dbec740 1 -- 172.21.15.79:0/1831840107 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56181bea5b10 con 0x56181be1acd0 2024-08-20T01:37:58.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.400+0000 7ff1ecff9640 1 -- 172.21.15.79:0/1831840107 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff1fc004540 con 0x56181be1acd0 2024-08-20T01:37:58.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.400+0000 7ff1ecff9640 1 -- 172.21.15.79:0/1831840107 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff2000d3bb0 con 0x56181be1acd0 2024-08-20T01:37:58.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.400+0000 7ff20dbec740 10 client.15765 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:37:58.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.400+0000 7ff20dbec740 10 client.15765 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:37:58.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.400+0000 7ff20dbec740 20 client.15765 populate_metadata read hostname 'smithi079' 2024-08-20T01:37:58.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.400+0000 7ff20dbec740 1 --2- 172.21.15.79:0/1831840107 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56181bea6290 0x56181bea86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:37:58.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.400+0000 7ff20dbec740 4 client.15765 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T01:37:58.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.400+0000 7ff20dbec740 1 -- 172.21.15.79:0/1831840107 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56181bd8e330 con 0x56181bea6290 2024-08-20T01:37:58.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.401+0000 7ff20958f640 1 --2- 172.21.15.79:0/1831840107 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56181bea6290 0x56181bea86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:37:58.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.401+0000 7ff20958f640 1 --2- 172.21.15.79:0/1831840107 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56181bea6290 0x56181bea86b0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87ad47b6e3cbb69d server_cookie=7de44311b24f6295 in_seq=0 out_seq=0 2024-08-20T01:37:58.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.401+0000 7ff1ecff9640 10 client.15765 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:37:58.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.402+0000 7ff1ecff9640 1 -- 172.21.15.79:0/1831840107 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56181bd8e330 con 0x56181bea6290 2024-08-20T01:37:58.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.402+0000 7ff1ecff9640 10 client.15765 handle_command_reply: tid=0 2024-08-20T01:37:58.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.402+0000 7ff20dbec740 1 client.15765 shutdown 2024-08-20T01:37:58.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.402+0000 7ff20dbec740 1 -- 172.21.15.79:0/1831840107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56181be1acd0 msgr2=0x56181be33080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:58.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.402+0000 7ff20dbec740 1 --2- 172.21.15.79:0/1831840107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56181be1acd0 0x56181be33080 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ff200101b60 tx=0x7ff200003e60 comp rx=0 tx=0).stop 2024-08-20T01:37:58.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.402+0000 7ff20dbec740 1 -- 172.21.15.79:0/1831840107 shutdown_connections 2024-08-20T01:37:58.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.402+0000 7ff20dbec740 1 --2- 172.21.15.79:0/1831840107 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56181bea6290 0x56181bea86b0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:58.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.402+0000 7ff20dbec740 1 --2- 172.21.15.79:0/1831840107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56181be2b070 0x56181be335c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:58.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.402+0000 7ff20dbec740 1 --2- 172.21.15.79:0/1831840107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56181be1acd0 0x56181be33080 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:58.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.402+0000 7ff20dbec740 1 --2- 172.21.15.79:0/1831840107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56181be1a3b0 0x56181be1c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:58.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.402+0000 7ff1ecff9640 0 client.15765 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:37:58.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.402+0000 7ff20dbec740 1 -- 172.21.15.79:0/1831840107 >> 172.21.15.79:0/1831840107 conn(0x56181be181e0 msgr2=0x56181be1fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:58.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.402+0000 7ff20dbec740 1 -- 172.21.15.79:0/1831840107 shutdown_connections 2024-08-20T01:37:58.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.402+0000 7ff20dbec740 1 -- 172.21.15.79:0/1831840107 wait complete. 2024-08-20T01:37:58.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.402+0000 7ff20dbec740 20 client.15765 trim_cache size 0 max 16384 2024-08-20T01:37:58.410 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:37:58.411 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-08-20T01:37:58.411 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "f16c14bc-7a26-4400-ad06-03afc4cd0669", 2024-08-20T01:37:58.411 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-08-20T01:37:58.411 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:37:58.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.403+0000 7ff20b7f3640 1 -- 172.21.15.79:0/3484606116 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff1f00b3c50 msgr2=0x7ff1f00b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:58.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.403+0000 7ff20b7f3640 1 --2- 172.21.15.79:0/3484606116 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff1f00b3c50 0x7ff1f00b6110 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc005f40 tx=0x7ff1fc009600 comp rx=0 tx=0).stop 2024-08-20T01:37:58.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.403+0000 7ff20b7f3640 1 -- 172.21.15.79:0/3484606116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2041073a0 msgr2=0x7ff204199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:37:58.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.403+0000 7ff20b7f3640 1 --2- 172.21.15.79:0/3484606116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2041073a0 0x7ff204199340 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7ff200009230 tx=0x7ff200004270 comp rx=0 tx=0).stop 2024-08-20T01:37:58.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.403+0000 7ff20b7f3640 1 -- 172.21.15.79:0/3484606116 shutdown_connections 2024-08-20T01:37:58.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.403+0000 7ff20b7f3640 1 --2- 172.21.15.79:0/3484606116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff204107d20 0x7ff20419e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:58.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.403+0000 7ff20b7f3640 1 --2- 172.21.15.79:0/3484606116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2041073a0 0x7ff204199340 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:58.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.403+0000 7ff20b7f3640 1 --2- 172.21.15.79:0/3484606116 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff1f00b3c50 0x7ff1f00b6110 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:58.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.403+0000 7ff20b7f3640 1 --2- 172.21.15.79:0/3484606116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff204101990 0x7ff204198e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:37:58.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.403+0000 7ff20b7f3640 1 -- 172.21.15.79:0/3484606116 >> 172.21.15.79:0/3484606116 conn(0x7ff2040fd400 msgr2=0x7ff2040ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:37:58.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.403+0000 7ff20b7f3640 1 -- 172.21.15.79:0/3484606116 shutdown_connections 2024-08-20T01:37:58.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:37:58.403+0000 7ff20b7f3640 1 -- 172.21.15.79:0/3484606116 wait complete. 2024-08-20T01:37:58.826 INFO:tasks.workunit.client.0.smithi079.stdout:checking whether build environment is sane... yes 2024-08-20T01:37:58.834 INFO:tasks.workunit.client.0.smithi079.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-08-20T01:37:58.835 INFO:tasks.workunit.client.0.smithi079.stdout:checking for gawk... gawk 2024-08-20T01:37:58.856 INFO:tasks.workunit.client.0.smithi079.stdout:checking whether make sets $(MAKE)... yes 2024-08-20T01:37:58.897 INFO:tasks.workunit.client.0.smithi079.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-08-20T01:37:58.897 INFO:tasks.workunit.client.0.smithi079.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-08-20T01:37:58.915 INFO:tasks.workunit.client.0.smithi079.stdout:checking for style of include used by make... GNU 2024-08-20T01:37:58.920 INFO:tasks.workunit.client.0.smithi079.stdout:checking for gcc... gcc 2024-08-20T01:37:59.034 INFO:tasks.workunit.client.0.smithi079.stdout:checking whether the C compiler works... yes 2024-08-20T01:37:59.034 INFO:tasks.workunit.client.0.smithi079.stdout:checking for C compiler default output file name... a.out 2024-08-20T01:37:59.088 INFO:tasks.workunit.client.0.smithi079.stdout:checking for suffix of executables... 2024-08-20T01:37:59.139 INFO:tasks.workunit.client.0.smithi079.stdout:checking whether we are cross compiling... no 2024-08-20T01:37:59.186 INFO:tasks.workunit.client.0.smithi079.stdout:checking for suffix of object files... o 2024-08-20T01:37:59.228 INFO:tasks.workunit.client.0.smithi079.stdout:checking whether we are using the GNU C compiler... yes 2024-08-20T01:37:59.261 INFO:tasks.workunit.client.0.smithi079.stdout:checking whether gcc accepts -g... yes 2024-08-20T01:37:59.262 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:59 smithi079 ceph-mon[18656]: scrub queued for path: / 2024-08-20T01:37:59.262 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:59 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:37:59.262 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:59 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:37:59.262 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:37:59 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:37:59.263 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:37:59.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:59 smithi081 ceph-mon[22209]: scrub queued for path: / 2024-08-20T01:37:59.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:59 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:37:59.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:59 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:37:59.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:37:59 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:37:59.304 INFO:tasks.workunit.client.0.smithi079.stdout:checking for gcc option to accept ISO C89... none needed 2024-08-20T01:37:59.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:59 smithi175 ceph-mon[22392]: scrub queued for path: / 2024-08-20T01:37:59.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:59 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:37:59.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:59 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:37:59.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:37:59 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:37:59.476 INFO:tasks.workunit.client.0.smithi079.stdout:checking dependency style of gcc... gcc3 2024-08-20T01:37:59.546 INFO:tasks.workunit.client.0.smithi079.stdout:checking how to run the C preprocessor... gcc -E 2024-08-20T01:37:59.573 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:37:59.620 INFO:tasks.workunit.client.0.smithi079.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-08-20T01:37:59.621 INFO:tasks.workunit.client.0.smithi079.stdout:checking for egrep... /usr/bin/grep -E 2024-08-20T01:37:59.785 INFO:tasks.workunit.client.0.smithi079.stdout:checking for ANSI C header files... yes 2024-08-20T01:37:59.831 INFO:tasks.workunit.client.0.smithi079.stdout:checking for sys/types.h... yes 2024-08-20T01:37:59.899 INFO:tasks.workunit.client.0.smithi079.stdout:checking for sys/stat.h... yes 2024-08-20T01:37:59.955 INFO:tasks.workunit.client.0.smithi079.stdout:checking for stdlib.h... yes 2024-08-20T01:38:00.012 INFO:tasks.workunit.client.0.smithi079.stdout:checking for string.h... yes 2024-08-20T01:38:00.066 INFO:tasks.workunit.client.0.smithi079.stdout:checking for memory.h... yes 2024-08-20T01:38:00.127 INFO:tasks.workunit.client.0.smithi079.stdout:checking for strings.h... yes 2024-08-20T01:38:00.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.101+0000 7fc45252a640 1 -- 172.21.15.79:0/4009161614 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc44c103850 msgr2=0x7fc44c103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:00.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.101+0000 7fc45252a640 1 --2- 172.21.15.79:0/4009161614 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc44c103850 0x7fc44c103c30 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fc43c009900 tx=0x7fc43c02a410 comp rx=0 tx=0).stop 2024-08-20T01:38:00.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.101+0000 7fc45252a640 1 -- 172.21.15.79:0/4009161614 shutdown_connections 2024-08-20T01:38:00.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.101+0000 7fc45252a640 1 --2- 172.21.15.79:0/4009161614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc44c10ce00 0x7fc44c10f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:00.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.101+0000 7fc45252a640 1 --2- 172.21.15.79:0/4009161614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc44c104250 0x7fc44c10c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:00.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.101+0000 7fc45252a640 1 --2- 172.21.15.79:0/4009161614 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc44c103850 0x7fc44c103c30 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:00.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.101+0000 7fc45252a640 1 -- 172.21.15.79:0/4009161614 >> 172.21.15.79:0/4009161614 conn(0x7fc44c0fd400 msgr2=0x7fc44c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:00.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.101+0000 7fc45252a640 1 -- 172.21.15.79:0/4009161614 shutdown_connections 2024-08-20T01:38:00.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.101+0000 7fc45252a640 1 -- 172.21.15.79:0/4009161614 wait complete. 2024-08-20T01:38:00.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.101+0000 7fc45252a640 1 Processor -- start 2024-08-20T01:38:00.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.102+0000 7fc45252a640 1 -- start start 2024-08-20T01:38:00.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.102+0000 7fc45252a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc44c103850 0x7fc44c1016d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:00.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.102+0000 7fc45252a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc44c104250 0x7fc44c101c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:00.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.102+0000 7fc45252a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc44c10ce00 0x7fc44c102150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:00.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.102+0000 7fc45252a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc44c112910 con 0x7fc44c103850 2024-08-20T01:38:00.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.102+0000 7fc45252a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc44c112790 con 0x7fc44c10ce00 2024-08-20T01:38:00.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.102+0000 7fc45252a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc44c112a90 con 0x7fc44c104250 2024-08-20T01:38:00.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.102+0000 7fc44bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc44c103850 0x7fc44c1016d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:00.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.102+0000 7fc44bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc44c103850 0x7fc44c1016d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45494/0 (socket says 172.21.15.79:45494) 2024-08-20T01:38:00.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.102+0000 7fc44bfff640 1 -- 172.21.15.79:0/120276585 learned_addr learned my addr 172.21.15.79:0/120276585 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:00.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.102+0000 7fc450ac7640 1 --2- 172.21.15.79:0/120276585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc44c10ce00 0x7fc44c102150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:00.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.102+0000 7fc44b7fe640 1 --2- 172.21.15.79:0/120276585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc44c104250 0x7fc44c101c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:00.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.102+0000 7fc44bfff640 1 -- 172.21.15.79:0/120276585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc44c104250 msgr2=0x7fc44c101c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:00.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.102+0000 7fc44bfff640 1 --2- 172.21.15.79:0/120276585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc44c104250 0x7fc44c101c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:00.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.102+0000 7fc44bfff640 1 -- 172.21.15.79:0/120276585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc44c10ce00 msgr2=0x7fc44c102150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:00.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.102+0000 7fc44bfff640 1 --2- 172.21.15.79:0/120276585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc44c10ce00 0x7fc44c102150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:00.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.102+0000 7fc44bfff640 1 -- 172.21.15.79:0/120276585 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc44c1a7290 con 0x7fc44c103850 2024-08-20T01:38:00.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.103+0000 7fc44bfff640 1 --2- 172.21.15.79:0/120276585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc44c103850 0x7fc44c1016d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fc43c009230 tx=0x7fc43c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:00.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.103+0000 7fc4497fa640 1 -- 172.21.15.79:0/120276585 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43c03f030 con 0x7fc44c103850 2024-08-20T01:38:00.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.103+0000 7fc45252a640 1 -- 172.21.15.79:0/120276585 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc44c1a7520 con 0x7fc44c103850 2024-08-20T01:38:00.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.103+0000 7fc4497fa640 1 -- 172.21.15.79:0/120276585 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc43c003a80 con 0x7fc44c103850 2024-08-20T01:38:00.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.103+0000 7fc4497fa640 1 -- 172.21.15.79:0/120276585 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43c035070 con 0x7fc44c103850 2024-08-20T01:38:00.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.103+0000 7fc45252a640 1 -- 172.21.15.79:0/120276585 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc44c1a7a50 con 0x7fc44c103850 2024-08-20T01:38:00.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.105+0000 7fc454923740 1 Processor -- start 2024-08-20T01:38:00.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.106+0000 7fc454923740 1 -- start start 2024-08-20T01:38:00.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.106+0000 7fc454923740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f580f5b830 0x55f580f5bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:00.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.106+0000 7fc454923740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f580f5c150 0x55f580f67ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:00.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.106+0000 7fc454923740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f580f680e0 0x55f580f6a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:00.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.106+0000 7fc454923740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f580ed28e0 con 0x55f580f5b830 2024-08-20T01:38:00.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.106+0000 7fc454923740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f580ec1de0 con 0x55f580f5c150 2024-08-20T01:38:00.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.106+0000 7fc454923740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f580ec5e20 con 0x55f580f680e0 2024-08-20T01:38:00.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.106+0000 7fc450ac7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f580f5b830 0x55f580f5bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:00.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.106+0000 7fc450ac7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f580f5b830 0x55f580f5bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45502/0 (socket says 172.21.15.79:45502) 2024-08-20T01:38:00.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.106+0000 7fc450ac7640 1 -- 172.21.15.79:0/1336562705 learned_addr learned my addr 172.21.15.79:0/1336562705 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:00.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.106+0000 7fc44b7fe640 1 --2- 172.21.15.79:0/1336562705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f580f680e0 0x55f580f6a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:00.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.106+0000 7fc4497fa640 1 -- 172.21.15.79:0/120276585 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc43c042030 con 0x7fc44c103850 2024-08-20T01:38:00.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.106+0000 7fc450ac7640 1 -- 172.21.15.79:0/1336562705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f580f680e0 msgr2=0x55f580f6a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:00.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.106+0000 7fc450ac7640 1 --2- 172.21.15.79:0/1336562705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f580f680e0 0x55f580f6a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:00.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.106+0000 7fc450ac7640 1 -- 172.21.15.79:0/1336562705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f580f5c150 msgr2=0x55f580f67ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:38:00.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.106+0000 7fc450ac7640 1 --2- 172.21.15.79:0/1336562705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f580f5c150 0x55f580f67ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:00.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.106+0000 7fc450ac7640 1 -- 172.21.15.79:0/1336562705 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f580c21650 con 0x55f580f5b830 2024-08-20T01:38:00.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.106+0000 7fc44b7fe640 1 --2- 172.21.15.79:0/1336562705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f580f680e0 0x55f580f6a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:00.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.106+0000 7fc450ac7640 1 --2- 172.21.15.79:0/1336562705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f580f5b830 0x55f580f5bc10 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fc444007ef0 tx=0x7fc44400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bfa98b5d295a4f6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:00.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.107+0000 7fc4327fc640 1 -- 172.21.15.79:0/1336562705 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc444010840 con 0x55f580f5b830 2024-08-20T01:38:00.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.107+0000 7fc4327fc640 1 -- 172.21.15.79:0/1336562705 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc4440183f0 con 0x55f580f5b830 2024-08-20T01:38:00.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.107+0000 7fc4327fc640 1 -- 172.21.15.79:0/1336562705 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc444017600 con 0x55f580f5b830 2024-08-20T01:38:00.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.107+0000 7fc4497fa640 1 --2- 172.21.15.79:0/120276585 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc4340b3bd0 0x7fc4340b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:00.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.107+0000 7fc44bfff640 1 --2- 172.21.15.79:0/120276585 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc4340b3bd0 0x7fc4340b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:00.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.107+0000 7fc4497fa640 1 -- 172.21.15.79:0/120276585 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc43c1042c0 con 0x7fc44c103850 2024-08-20T01:38:00.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.108+0000 7fc454923740 1 -- 172.21.15.79:0/1336562705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f580f5b830 msgr2=0x55f580f5bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:00.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.108+0000 7fc454923740 1 --2- 172.21.15.79:0/1336562705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f580f5b830 0x55f580f5bc10 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fc444007ef0 tx=0x7fc44400f790 comp rx=0 tx=0).stop 2024-08-20T01:38:00.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.108+0000 7fc44bfff640 1 --2- 172.21.15.79:0/120276585 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc4340b3bd0 0x7fc4340b6090 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc43c0c8540 tx=0x7fc43c090690 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:00.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.108+0000 7fc454923740 1 -- 172.21.15.79:0/1336562705 shutdown_connections 2024-08-20T01:38:00.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.108+0000 7fc454923740 1 --2- 172.21.15.79:0/1336562705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f580f680e0 0x55f580f6a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:00.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.108+0000 7fc454923740 1 --2- 172.21.15.79:0/1336562705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f580f5c150 0x55f580f67ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:00.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.108+0000 7fc454923740 1 --2- 172.21.15.79:0/1336562705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f580f5b830 0x55f580f5bc10 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:00.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.108+0000 7fc454923740 1 -- 172.21.15.79:0/1336562705 >> 172.21.15.79:0/1336562705 conn(0x55f580f59660 msgr2=0x55f580f5a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:00.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.108+0000 7fc454923740 1 -- 172.21.15.79:0/1336562705 shutdown_connections 2024-08-20T01:38:00.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.108+0000 7fc454923740 1 -- 172.21.15.79:0/1336562705 wait complete. 2024-08-20T01:38:00.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.108+0000 7fc454923740 1 -- start start 2024-08-20T01:38:00.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.108+0000 7fc454923740 1 Processor -- start 2024-08-20T01:38:00.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.109+0000 7fc454923740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f580f5b830 0x55f580f650e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:00.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.109+0000 7fc454923740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f580f5c150 0x55f580f65620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:00.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.109+0000 7fc454923740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f580f680e0 0x55f580f65b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:00.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.109+0000 7fc454923740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f580d24700 con 0x55f580f680e0 2024-08-20T01:38:00.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.109+0000 7fc454923740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f580e487c0 con 0x55f580f5b830 2024-08-20T01:38:00.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.109+0000 7fc454923740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f580f6ad90 con 0x55f580f5c150 2024-08-20T01:38:00.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.109+0000 7fc454923740 10 client.0 _ll_register_callbacks cb 0x55f580ebb6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:00.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.109+0000 7fc450ac7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f580f680e0 0x55f580f65b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:00.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.109+0000 7fc450ac7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f580f5b830 0x55f580f650e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:00.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.109+0000 7fc44b7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f580f5c150 0x55f580f65620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:00.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.109+0000 7fc450ac7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f580f5b830 0x55f580f650e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:46334/0 (socket says 172.21.15.79:46334) 2024-08-20T01:38:00.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.109+0000 7fc450ac7640 1 -- 172.21.15.79:0/2268071075 learned_addr learned my addr 172.21.15.79:0/2268071075 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:00.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.109+0000 7fc44b7fe640 1 -- 172.21.15.79:0/2268071075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f580f5b830 msgr2=0x55f580f650e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:00.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.109+0000 7fc44b7fe640 1 --2- 172.21.15.79:0/2268071075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f580f5b830 0x55f580f650e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:00.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.109+0000 7fc44b7fe640 1 -- 172.21.15.79:0/2268071075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f580f680e0 msgr2=0x55f580f65b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:00.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.109+0000 7fc44b7fe640 1 --2- 172.21.15.79:0/2268071075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f580f680e0 0x55f580f65b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:00.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.109+0000 7fc44b7fe640 1 -- 172.21.15.79:0/2268071075 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f580f74220 con 0x55f580f5c150 2024-08-20T01:38:00.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.109+0000 7fc450ac7640 1 --2- 172.21.15.79:0/2268071075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f580f680e0 0x55f580f65b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:00.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.109+0000 7fc44b7fe640 1 --2- 172.21.15.79:0/2268071075 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f580f5c150 0x55f580f65620 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc44c1031c0 tx=0x7fc44000bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cb24e86e9bc23e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:00.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.109+0000 7fc42b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:38:00.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.109+0000 7fc42b7fe640 1 -- 172.21.15.79:0/2268071075 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc440003df0 con 0x55f580f5c150 2024-08-20T01:38:00.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.109+0000 7fc42b7fe640 1 -- 172.21.15.79:0/2268071075 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc440005020 con 0x55f580f5c150 2024-08-20T01:38:00.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.109+0000 7fc454923740 1 -- 172.21.15.79:0/2268071075 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f580e71100 con 0x55f580f5c150 2024-08-20T01:38:00.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.110+0000 7fc42b7fe640 1 -- 172.21.15.79:0/2268071075 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc440005220 con 0x55f580f5c150 2024-08-20T01:38:00.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.110+0000 7fc454923740 10 client.25156 fetch_fsmap learned FSMap version 28 2024-08-20T01:38:00.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.110+0000 7fc454923740 1 -- 172.21.15.79:0/2268071075 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f580f76c10 con 0x55f580f5c150 2024-08-20T01:38:00.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.110+0000 7fc42b7fe640 1 -- 172.21.15.79:0/2268071075 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55f580e71100 con 0x55f580f5c150 2024-08-20T01:38:00.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.110+0000 7fc42b7fe640 1 -- 172.21.15.79:0/2268071075 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc44001b470 con 0x55f580f5c150 2024-08-20T01:38:00.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.110+0000 7fc454923740 10 client.25156 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:38:00.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.110+0000 7fc454923740 10 client.25156 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:38:00.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.110+0000 7fc454923740 20 client.25156 populate_metadata read hostname 'smithi079' 2024-08-20T01:38:00.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.110+0000 7fc454923740 1 --2- 172.21.15.79:0/2268071075 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f580f78170 0x55f580f7a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:00.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.110+0000 7fc454923740 4 client.25156 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:38:00.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.110+0000 7fc454923740 1 -- 172.21.15.79:0/2268071075 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f580ed4830 con 0x55f580f78170 2024-08-20T01:38:00.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.110+0000 7fc450ac7640 1 --2- 172.21.15.79:0/2268071075 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f580f78170 0x55f580f7a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:00.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.111+0000 7fc450ac7640 1 --2- 172.21.15.79:0/2268071075 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f580f78170 0x55f580f7a560 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bdc7fed83353a09 server_cookie=d655fb01f45000ec in_seq=0 out_seq=0 2024-08-20T01:38:00.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.111+0000 7fc42b7fe640 10 client.25156 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:00.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.111+0000 7fc42b7fe640 1 -- 172.21.15.79:0/2268071075 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f580ed4830 con 0x55f580f78170 2024-08-20T01:38:00.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.111+0000 7fc42b7fe640 10 client.25156 handle_command_reply: tid=0 2024-08-20T01:38:00.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.111+0000 7fc454923740 1 client.25156 shutdown 2024-08-20T01:38:00.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.112+0000 7fc454923740 1 -- 172.21.15.79:0/2268071075 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f580f5c150 msgr2=0x55f580f65620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:00.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.112+0000 7fc454923740 1 --2- 172.21.15.79:0/2268071075 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f580f5c150 0x55f580f65620 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc44c1031c0 tx=0x7fc44000bd80 comp rx=0 tx=0).stop 2024-08-20T01:38:00.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.112+0000 7fc454923740 1 -- 172.21.15.79:0/2268071075 shutdown_connections 2024-08-20T01:38:00.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.112+0000 7fc454923740 1 --2- 172.21.15.79:0/2268071075 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f580f78170 0x55f580f7a560 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:00.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.112+0000 7fc454923740 1 --2- 172.21.15.79:0/2268071075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f580f680e0 0x55f580f65b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:00.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.112+0000 7fc454923740 1 --2- 172.21.15.79:0/2268071075 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f580f5c150 0x55f580f65620 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:00.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.112+0000 7fc42b7fe640 0 client.25156 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:00.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.112+0000 7fc454923740 1 --2- 172.21.15.79:0/2268071075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f580f5b830 0x55f580f650e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:00.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.112+0000 7fc454923740 1 -- 172.21.15.79:0/2268071075 >> 172.21.15.79:0/2268071075 conn(0x55f580f59660 msgr2=0x55f580f5f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:00.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.112+0000 7fc454923740 1 -- 172.21.15.79:0/2268071075 shutdown_connections 2024-08-20T01:38:00.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.112+0000 7fc454923740 1 -- 172.21.15.79:0/2268071075 wait complete. 2024-08-20T01:38:00.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.112+0000 7fc454923740 20 client.25156 trim_cache size 0 max 16384 2024-08-20T01:38:00.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.131+0000 7fc454923740 1 Processor -- start 2024-08-20T01:38:00.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.131+0000 7fc454923740 1 -- start start 2024-08-20T01:38:00.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.131+0000 7fc454923740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f580f5b830 0x55f580f66e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:00.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.131+0000 7fc454923740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f580f5c150 0x55f580f7fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:00.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.131+0000 7fc454923740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f580f680e0 0x55f580f80320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:00.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.131+0000 7fc454923740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc44c1b00a0 con 0x55f580f5b830 2024-08-20T01:38:00.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.131+0000 7fc454923740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc44c1b1be0 con 0x55f580f680e0 2024-08-20T01:38:00.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.131+0000 7fc454923740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc44c1b0770 con 0x55f580f5c150 2024-08-20T01:38:00.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.131+0000 7fc450ac7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f580f5b830 0x55f580f66e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:00.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.131+0000 7fc450ac7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f580f5b830 0x55f580f66e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45526/0 (socket says 172.21.15.79:45526) 2024-08-20T01:38:00.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.131+0000 7fc450ac7640 1 -- 172.21.15.79:0/1783607911 learned_addr learned my addr 172.21.15.79:0/1783607911 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:00.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.132+0000 7fc450ac7640 1 --2- 172.21.15.79:0/1783607911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f580f680e0 0x55f580f80320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:00.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.132+0000 7fc44b7fe640 1 --2- 172.21.15.79:0/1783607911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f580f5c150 0x55f580f7fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:00.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.132+0000 7fc450ac7640 1 -- 172.21.15.79:0/1783607911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f580f5c150 msgr2=0x55f580f7fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:00.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.132+0000 7fc450ac7640 1 --2- 172.21.15.79:0/1783607911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f580f5c150 0x55f580f7fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:00.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.132+0000 7fc450ac7640 1 -- 172.21.15.79:0/1783607911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f580f680e0 msgr2=0x55f580f80320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:00.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.132+0000 7fc450ac7640 1 --2- 172.21.15.79:0/1783607911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f580f680e0 0x55f580f80320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:00.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.132+0000 7fc450ac7640 1 -- 172.21.15.79:0/1783607911 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f580f5a0e0 con 0x55f580f5b830 2024-08-20T01:38:00.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.132+0000 7fc450ac7640 1 --2- 172.21.15.79:0/1783607911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f580f5b830 0x55f580f66e20 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fc44401a010 tx=0x7fc444012040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90479e2f5aa867c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:00.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.132+0000 7fc431ffb640 1 -- 172.21.15.79:0/1783607911 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc444018870 con 0x55f580f5b830 2024-08-20T01:38:00.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.132+0000 7fc431ffb640 1 -- 172.21.15.79:0/1783607911 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc444003e00 con 0x55f580f5b830 2024-08-20T01:38:00.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.132+0000 7fc431ffb640 1 -- 172.21.15.79:0/1783607911 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc444010dd0 con 0x55f580f5b830 2024-08-20T01:38:00.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.133+0000 7fc454923740 1 -- 172.21.15.79:0/1783607911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f580f5b830 msgr2=0x55f580f66e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:00.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.133+0000 7fc454923740 1 --2- 172.21.15.79:0/1783607911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f580f5b830 0x55f580f66e20 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fc44401a010 tx=0x7fc444012040 comp rx=0 tx=0).stop 2024-08-20T01:38:00.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.133+0000 7fc454923740 1 -- 172.21.15.79:0/1783607911 shutdown_connections 2024-08-20T01:38:00.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.133+0000 7fc454923740 1 --2- 172.21.15.79:0/1783607911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f580f680e0 0x55f580f80320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:00.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.133+0000 7fc454923740 1 --2- 172.21.15.79:0/1783607911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f580f5c150 0x55f580f7fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:00.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.133+0000 7fc454923740 1 --2- 172.21.15.79:0/1783607911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f580f5b830 0x55f580f66e20 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:00.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.133+0000 7fc454923740 1 -- 172.21.15.79:0/1783607911 >> 172.21.15.79:0/1783607911 conn(0x55f580f59660 msgr2=0x55f580f66710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:00.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.133+0000 7fc454923740 1 -- 172.21.15.79:0/1783607911 shutdown_connections 2024-08-20T01:38:00.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.133+0000 7fc454923740 1 -- 172.21.15.79:0/1783607911 wait complete. 2024-08-20T01:38:00.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.133+0000 7fc454923740 1 -- start start 2024-08-20T01:38:00.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.134+0000 7fc454923740 1 Processor -- start 2024-08-20T01:38:00.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.134+0000 7fc454923740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f580f5b830 0x55f580f6d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:00.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.134+0000 7fc454923740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f580f5c150 0x55f580f6d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:00.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.134+0000 7fc454923740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f580f680e0 0x55f580f6da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:00.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.134+0000 7fc454923740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc44c1b1510 con 0x55f580f5c150 2024-08-20T01:38:00.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.134+0000 7fc454923740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc44c1b0e40 con 0x55f580f5b830 2024-08-20T01:38:00.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.134+0000 7fc454923740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc44c1ae080 con 0x55f580f680e0 2024-08-20T01:38:00.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.134+0000 7fc454923740 10 client.0 _ll_register_callbacks cb 0x7fc440004520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:00.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.134+0000 7fc44b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f580f5c150 0x55f580f6d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:00.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.134+0000 7fc450ac7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f580f5b830 0x55f580f6d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:00.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.134+0000 7fc44b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f580f5c150 0x55f580f6d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45542/0 (socket says 172.21.15.79:45542) 2024-08-20T01:38:00.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.134+0000 7fc44b7fe640 1 -- 172.21.15.79:0/1990041572 learned_addr learned my addr 172.21.15.79:0/1990041572 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:00.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.134+0000 7fc450ac7640 1 --2- 172.21.15.79:0/1990041572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f580f5b830 0x55f580f6d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:46352/0 (socket says 172.21.15.79:46352) 2024-08-20T01:38:00.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.134+0000 7fc450ac7640 1 --2- 172.21.15.79:0/1990041572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f580f680e0 0x55f580f6da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:00.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.134+0000 7fc450ac7640 1 -- 172.21.15.79:0/1990041572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f580f680e0 msgr2=0x55f580f6da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:00.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.134+0000 7fc450ac7640 1 --2- 172.21.15.79:0/1990041572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f580f680e0 0x55f580f6da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:00.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.134+0000 7fc450ac7640 1 -- 172.21.15.79:0/1990041572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f580f5c150 msgr2=0x55f580f6d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:00.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.134+0000 7fc450ac7640 1 --2- 172.21.15.79:0/1990041572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f580f5c150 0x55f580f6d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:00.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.134+0000 7fc450ac7640 1 -- 172.21.15.79:0/1990041572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f580fe0ee0 con 0x55f580f5b830 2024-08-20T01:38:00.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.134+0000 7fc44b7fe640 1 --2- 172.21.15.79:0/1990041572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f580f5c150 0x55f580f6d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:00.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.134+0000 7fc450ac7640 1 --2- 172.21.15.79:0/1990041572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f580f5b830 0x55f580f6d000 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc444018e80 tx=0x7fc444018f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d746a67161b1ee1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:00.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.134+0000 7fc42b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:38:00.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.135+0000 7fc42b7fe640 1 -- 172.21.15.79:0/1990041572 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44403f020 con 0x55f580f5b830 2024-08-20T01:38:00.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.135+0000 7fc42b7fe640 1 -- 172.21.15.79:0/1990041572 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc444010640 con 0x55f580f5b830 2024-08-20T01:38:00.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.135+0000 7fc454923740 1 -- 172.21.15.79:0/1990041572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc444003e00 con 0x55f580f5b830 2024-08-20T01:38:00.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.135+0000 7fc42b7fe640 1 -- 172.21.15.79:0/1990041572 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc444010840 con 0x55f580f5b830 2024-08-20T01:38:00.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.135+0000 7fc454923740 10 client.25160 fetch_fsmap learned FSMap version 28 2024-08-20T01:38:00.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.135+0000 7fc454923740 1 -- 172.21.15.79:0/1990041572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f580fe21d0 con 0x55f580f5b830 2024-08-20T01:38:00.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.135+0000 7fc42b7fe640 1 -- 172.21.15.79:0/1990041572 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc444003e00 con 0x55f580f5b830 2024-08-20T01:38:00.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.135+0000 7fc42b7fe640 1 -- 172.21.15.79:0/1990041572 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc444024040 con 0x55f580f5b830 2024-08-20T01:38:00.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.135+0000 7fc454923740 10 client.25160 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:38:00.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.135+0000 7fc454923740 10 client.25160 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:38:00.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.135+0000 7fc454923740 20 client.25160 populate_metadata read hostname 'smithi079' 2024-08-20T01:38:00.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.135+0000 7fc454923740 1 --2- 172.21.15.79:0/1990041572 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f580fe2650 0x55f580fe4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:00.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.135+0000 7fc454923740 4 client.25160 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:38:00.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.135+0000 7fc454923740 1 -- 172.21.15.79:0/1990041572 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f580ed02d0 con 0x55f580fe2650 2024-08-20T01:38:00.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.135+0000 7fc44b7fe640 1 --2- 172.21.15.79:0/1990041572 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f580fe2650 0x55f580fe4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:00.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.136+0000 7fc42b7fe640 10 client.25160 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:00.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.136+0000 7fc44b7fe640 1 --2- 172.21.15.79:0/1990041572 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f580fe2650 0x55f580fe4a40 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60dcf6aa921a3863 server_cookie=a77f898c2e431f78 in_seq=0 out_seq=0 2024-08-20T01:38:00.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.136+0000 7fc42b7fe640 1 -- 172.21.15.79:0/1990041572 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55f580ed02d0 con 0x55f580fe2650 2024-08-20T01:38:00.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.136+0000 7fc42b7fe640 10 client.25160 handle_command_reply: tid=0 2024-08-20T01:38:00.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.136+0000 7fc454923740 1 client.25160 shutdown 2024-08-20T01:38:00.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.136+0000 7fc454923740 1 -- 172.21.15.79:0/1990041572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f580f5b830 msgr2=0x55f580f6d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:00.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.136+0000 7fc454923740 1 --2- 172.21.15.79:0/1990041572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f580f5b830 0x55f580f6d000 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc444018e80 tx=0x7fc444018f30 comp rx=0 tx=0).stop 2024-08-20T01:38:00.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.136+0000 7fc454923740 1 -- 172.21.15.79:0/1990041572 shutdown_connections 2024-08-20T01:38:00.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.136+0000 7fc454923740 1 --2- 172.21.15.79:0/1990041572 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f580fe2650 0x55f580fe4a40 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:00.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.136+0000 7fc454923740 1 --2- 172.21.15.79:0/1990041572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f580f680e0 0x55f580f6da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:00.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.136+0000 7fc454923740 1 --2- 172.21.15.79:0/1990041572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f580f5c150 0x55f580f6d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:00.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.136+0000 7fc454923740 1 --2- 172.21.15.79:0/1990041572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f580f5b830 0x55f580f6d000 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:00.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.136+0000 7fc42b7fe640 0 client.25160 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:00.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.136+0000 7fc454923740 1 -- 172.21.15.79:0/1990041572 >> 172.21.15.79:0/1990041572 conn(0x55f580f59660 msgr2=0x55f580f73720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:00.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.136+0000 7fc454923740 1 -- 172.21.15.79:0/1990041572 shutdown_connections 2024-08-20T01:38:00.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.137+0000 7fc454923740 1 -- 172.21.15.79:0/1990041572 wait complete. 2024-08-20T01:38:00.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.137+0000 7fc454923740 20 client.25160 trim_cache size 0 max 16384 2024-08-20T01:38:00.157 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:38:00.157 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-08-20T01:38:00.157 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-08-20T01:38:00.157 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:38:00.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.137+0000 7fc45252a640 1 -- 172.21.15.79:0/120276585 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc4340b3bd0 msgr2=0x7fc4340b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:00.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.137+0000 7fc45252a640 1 --2- 172.21.15.79:0/120276585 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc4340b3bd0 0x7fc4340b6090 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc43c0c8540 tx=0x7fc43c090690 comp rx=0 tx=0).stop 2024-08-20T01:38:00.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.137+0000 7fc45252a640 1 -- 172.21.15.79:0/120276585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc44c103850 msgr2=0x7fc44c1016d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:00.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.137+0000 7fc45252a640 1 --2- 172.21.15.79:0/120276585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc44c103850 0x7fc44c1016d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fc43c009230 tx=0x7fc43c004270 comp rx=0 tx=0).stop 2024-08-20T01:38:00.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.137+0000 7fc45252a640 1 -- 172.21.15.79:0/120276585 shutdown_connections 2024-08-20T01:38:00.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.137+0000 7fc45252a640 1 --2- 172.21.15.79:0/120276585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc44c10ce00 0x7fc44c102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:00.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.137+0000 7fc45252a640 1 --2- 172.21.15.79:0/120276585 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc4340b3bd0 0x7fc4340b6090 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:00.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.137+0000 7fc45252a640 1 --2- 172.21.15.79:0/120276585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc44c104250 0x7fc44c101c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:00.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.137+0000 7fc45252a640 1 --2- 172.21.15.79:0/120276585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc44c103850 0x7fc44c1016d0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:00.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.137+0000 7fc45252a640 1 -- 172.21.15.79:0/120276585 >> 172.21.15.79:0/120276585 conn(0x7fc44c0fd400 msgr2=0x7fc44c0fe140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:00.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.137+0000 7fc45252a640 1 -- 172.21.15.79:0/120276585 shutdown_connections 2024-08-20T01:38:00.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:00.137+0000 7fc45252a640 1 -- 172.21.15.79:0/120276585 wait complete. 2024-08-20T01:38:00.183 INFO:tasks.workunit.client.0.smithi079.stdout:checking for inttypes.h... yes 2024-08-20T01:38:00.236 INFO:tasks.workunit.client.0.smithi079.stdout:checking for stdint.h... yes 2024-08-20T01:38:00.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:00 smithi081 ceph-mon[22209]: pgmap v367: 97 pgs: 97 active+clean; 5.9 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 495 KiB/s wr, 96 op/s 2024-08-20T01:38:00.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:00 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:38:00.291 INFO:tasks.workunit.client.0.smithi079.stdout:checking for unistd.h... yes 2024-08-20T01:38:00.352 INFO:tasks.workunit.client.0.smithi079.stdout:checking minix/config.h usability... no 2024-08-20T01:38:00.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:00 smithi175 ceph-mon[22392]: pgmap v367: 97 pgs: 97 active+clean; 5.9 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 495 KiB/s wr, 96 op/s 2024-08-20T01:38:00.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:00 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:38:00.390 INFO:tasks.workunit.client.0.smithi079.stdout:checking minix/config.h presence... no 2024-08-20T01:38:00.390 INFO:tasks.workunit.client.0.smithi079.stdout:checking for minix/config.h... no 2024-08-20T01:38:00.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:00 smithi079 ceph-mon[18656]: pgmap v367: 97 pgs: 97 active+clean; 5.9 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 495 KiB/s wr, 96 op/s 2024-08-20T01:38:00.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:00 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:38:00.437 INFO:tasks.workunit.client.0.smithi079.stdout:checking whether it is safe to define __EXTENSIONS__... yes 2024-08-20T01:38:00.448 INFO:tasks.workunit.client.0.smithi079.stdout:checking for gcc... (cached) gcc 2024-08-20T01:38:00.504 INFO:tasks.workunit.client.0.smithi079.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-08-20T01:38:00.504 INFO:tasks.workunit.client.0.smithi079.stdout:checking whether gcc accepts -g... (cached) yes 2024-08-20T01:38:00.505 INFO:tasks.workunit.client.0.smithi079.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-08-20T01:38:00.505 INFO:tasks.workunit.client.0.smithi079.stdout:checking dependency style of gcc... (cached) gcc3 2024-08-20T01:38:00.564 INFO:tasks.workunit.client.0.smithi079.stdout:checking for main in -lm... yes 2024-08-20T01:38:00.627 INFO:tasks.workunit.client.0.smithi079.stdout:checking for main in -lpthread... yes 2024-08-20T01:38:00.632 INFO:tasks.workunit.client.0.smithi079.stdout:checking for ANSI C header files... (cached) yes 2024-08-20T01:38:00.693 INFO:tasks.workunit.client.0.smithi079.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-08-20T01:38:00.749 INFO:tasks.workunit.client.0.smithi079.stdout:checking pthread.h usability... yes 2024-08-20T01:38:00.777 INFO:tasks.workunit.client.0.smithi079.stdout:checking pthread.h presence... yes 2024-08-20T01:38:00.777 INFO:tasks.workunit.client.0.smithi079.stdout:checking for pthread.h... yes 2024-08-20T01:38:00.839 INFO:tasks.workunit.client.0.smithi079.stdout:checking fcntl.h usability... yes 2024-08-20T01:38:00.861 INFO:tasks.workunit.client.0.smithi079.stdout:checking fcntl.h presence... yes 2024-08-20T01:38:00.862 INFO:tasks.workunit.client.0.smithi079.stdout:checking for fcntl.h... yes 2024-08-20T01:38:00.944 INFO:tasks.workunit.client.0.smithi079.stdout:checking limits.h usability... yes 2024-08-20T01:38:00.966 INFO:tasks.workunit.client.0.smithi079.stdout:checking limits.h presence... yes 2024-08-20T01:38:00.966 INFO:tasks.workunit.client.0.smithi079.stdout:checking for limits.h... yes 2024-08-20T01:38:00.985 INFO:tasks.workunit.client.0.smithi079.stdout:checking for stdint.h... (cached) yes 2024-08-20T01:38:01.046 INFO:tasks.workunit.client.0.smithi079.stdout:checking sys/time.h usability... yes 2024-08-20T01:38:01.069 INFO:tasks.workunit.client.0.smithi079.stdout:checking sys/time.h presence... yes 2024-08-20T01:38:01.069 INFO:tasks.workunit.client.0.smithi079.stdout:checking for sys/time.h... yes 2024-08-20T01:38:01.083 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T01:38:01.084 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:38:01.089 INFO:tasks.workunit.client.0.smithi079.stdout:checking for unistd.h... (cached) yes 2024-08-20T01:38:01.142 INFO:tasks.workunit.client.0.smithi079.stdout:checking sys/vfs.h usability... yes 2024-08-20T01:38:01.164 INFO:tasks.workunit.client.0.smithi079.stdout:checking sys/vfs.h presence... yes 2024-08-20T01:38:01.165 INFO:tasks.workunit.client.0.smithi079.stdout:checking for sys/vfs.h... yes 2024-08-20T01:38:01.242 INFO:tasks.workunit.client.0.smithi079.stdout:checking sys/limits.h usability... no 2024-08-20T01:38:01.284 INFO:tasks.workunit.client.0.smithi079.stdout:checking sys/limits.h presence... no 2024-08-20T01:38:01.284 INFO:tasks.workunit.client.0.smithi079.stdout:checking for sys/limits.h... no 2024-08-20T01:38:01.323 INFO:tasks.workunit.client.0.smithi079.stdout:checking for an ANSI C-conforming const... yes 2024-08-20T01:38:01.350 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:38:01.359 INFO:tasks.workunit.client.0.smithi079.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-08-20T01:38:01.447 INFO:tasks.workunit.client.0.smithi079.stdout:checking for system... yes 2024-08-20T01:38:01.540 INFO:tasks.workunit.client.0.smithi079.stdout:checking for gettimeofday... yes 2024-08-20T01:38:01.624 INFO:tasks.workunit.client.0.smithi079.stdout:checking for mkdir... yes 2024-08-20T01:38:01.703 INFO:tasks.workunit.client.0.smithi079.stdout:checking for strerror... yes 2024-08-20T01:38:01.788 INFO:tasks.workunit.client.0.smithi079.stdout:checking for open64... yes 2024-08-20T01:38:01.865 INFO:tasks.workunit.client.0.smithi079.stdout:checking for stat64... yes 2024-08-20T01:38:01.944 INFO:tasks.workunit.client.0.smithi079.stdout:checking for fseeko64... yes 2024-08-20T01:38:02.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:01.962+0000 7fafb6965640 1 -- 172.21.15.79:0/1950705307 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafb01073a0 msgr2=0x7fafb01077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:02.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:01.962+0000 7fafb6965640 1 --2- 172.21.15.79:0/1950705307 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafb01073a0 0x7fafb01077e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fafa4009900 tx=0x7fafa402a410 comp rx=0 tx=0).stop 2024-08-20T01:38:02.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:01.962+0000 7fafb6965640 1 -- 172.21.15.79:0/1950705307 shutdown_connections 2024-08-20T01:38:02.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:01.962+0000 7fafb6965640 1 --2- 172.21.15.79:0/1950705307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafb0107d20 0x7fafb010e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:02.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:01.962+0000 7fafb6965640 1 --2- 172.21.15.79:0/1950705307 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafb01073a0 0x7fafb01077e0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:02.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:01.962+0000 7fafb6965640 1 --2- 172.21.15.79:0/1950705307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fafb0101990 0x7fafb0101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:02.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:01.962+0000 7fafb6965640 1 -- 172.21.15.79:0/1950705307 >> 172.21.15.79:0/1950705307 conn(0x7fafb00fd400 msgr2=0x7fafb00ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:02.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:01.962+0000 7fafb6965640 1 -- 172.21.15.79:0/1950705307 shutdown_connections 2024-08-20T01:38:02.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:01.962+0000 7fafb6965640 1 -- 172.21.15.79:0/1950705307 wait complete. 2024-08-20T01:38:02.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:01.962+0000 7fafb6965640 1 Processor -- start 2024-08-20T01:38:02.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:01.962+0000 7fafb6965640 1 -- start start 2024-08-20T01:38:02.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:01.963+0000 7fafb6965640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafb0101990 0x7fafb0199d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:02.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:01.963+0000 7fafb6965640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafb01073a0 0x7fafb019a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:02.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:01.963+0000 7fafb6965640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fafb0107d20 0x7fafb019a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:02.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:01.963+0000 7fafb6965640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fafb0111850 con 0x7fafb0101990 2024-08-20T01:38:02.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:01.963+0000 7fafb6965640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fafb01116d0 con 0x7fafb01073a0 2024-08-20T01:38:02.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:01.963+0000 7fafb6965640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fafb01119d0 con 0x7fafb0107d20 2024-08-20T01:38:02.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:01.963+0000 7fafaf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafb01073a0 0x7fafb019a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:02.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:01.963+0000 7fafb4f02640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fafb0107d20 0x7fafb019a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:02.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:01.963+0000 7fafaf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafb01073a0 0x7fafb019a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:37420/0 (socket says 172.21.15.79:37420) 2024-08-20T01:38:02.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:01.963+0000 7fafaffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafb0101990 0x7fafb0199d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:02.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:01.963+0000 7fafaf7fe640 1 -- 172.21.15.79:0/3729062919 learned_addr learned my addr 172.21.15.79:0/3729062919 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:02.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:01.963+0000 7fafaf7fe640 1 -- 172.21.15.79:0/3729062919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fafb0107d20 msgr2=0x7fafb019a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:02.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:01.963+0000 7fafaf7fe640 1 --2- 172.21.15.79:0/3729062919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fafb0107d20 0x7fafb019a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:02.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:01.963+0000 7fafaf7fe640 1 -- 172.21.15.79:0/3729062919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafb0101990 msgr2=0x7fafb0199d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:02.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:01.963+0000 7fafaf7fe640 1 --2- 172.21.15.79:0/3729062919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafb0101990 0x7fafb0199d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:02.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:01.963+0000 7fafaf7fe640 1 -- 172.21.15.79:0/3729062919 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb01a5170 con 0x7fafb01073a0 2024-08-20T01:38:02.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:01.963+0000 7fafb4f02640 1 --2- 172.21.15.79:0/3729062919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fafb0107d20 0x7fafb019a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:02.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:01.963+0000 7fafaffff640 1 --2- 172.21.15.79:0/3729062919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafb0101990 0x7fafb0199d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:02.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:01.964+0000 7fafaf7fe640 1 --2- 172.21.15.79:0/3729062919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafb01073a0 0x7fafb019a2d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fafa4009230 tx=0x7fafa40319a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:02.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:01.964+0000 7fafad7fa640 1 -- 172.21.15.79:0/3729062919 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa403f030 con 0x7fafb01073a0 2024-08-20T01:38:02.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:01.964+0000 7fafb6965640 1 -- 172.21.15.79:0/3729062919 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafb0197b80 con 0x7fafb01073a0 2024-08-20T01:38:02.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:01.964+0000 7fafb6965640 1 -- 172.21.15.79:0/3729062919 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafb01980b0 con 0x7fafb01073a0 2024-08-20T01:38:02.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:01.964+0000 7fafad7fa640 1 -- 172.21.15.79:0/3729062919 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fafa40043d0 con 0x7fafb01073a0 2024-08-20T01:38:02.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:01.964+0000 7fafad7fa640 1 -- 172.21.15.79:0/3729062919 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa4049060 con 0x7fafb01073a0 2024-08-20T01:38:02.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:01.965+0000 7fafb6965640 1 -- 172.21.15.79:0/3729062919 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafb0101d70 con 0x7fafb01073a0 2024-08-20T01:38:02.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:01.966+0000 7fafad7fa640 1 -- 172.21.15.79:0/3729062919 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fafa4042030 con 0x7fafb01073a0 2024-08-20T01:38:02.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:01.967+0000 7fafad7fa640 1 --2- 172.21.15.79:0/3729062919 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7faf980b3bd0 0x7faf980b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:02.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:01.967+0000 7fafaffff640 1 --2- 172.21.15.79:0/3729062919 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7faf980b3bd0 0x7faf980b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:02.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:01.967+0000 7fafad7fa640 1 -- 172.21.15.79:0/3729062919 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fafa41043c0 con 0x7fafb01073a0 2024-08-20T01:38:02.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:01.968+0000 7fafaffff640 1 --2- 172.21.15.79:0/3729062919 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7faf980b3bd0 0x7faf980b6090 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fafa0009fc0 tx=0x7fafa0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:02.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:01.970+0000 7fafad7fa640 1 -- 172.21.15.79:0/3729062919 <== mon.2 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fafa40cb370 con 0x7fafb01073a0 2024-08-20T01:38:02.024 INFO:tasks.workunit.client.0.smithi079.stdout:checking for lrand48_r... yes 2024-08-20T01:38:02.101 INFO:tasks.workunit.client.0.smithi079.stdout:checking for srand48_r... yes 2024-08-20T01:38:02.126 INFO:tasks.workunit.client.0.smithi079.stdout:configure: creating ./config.status 2024-08-20T01:38:02.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:02 smithi079 ceph-mon[18656]: pgmap v368: 97 pgs: 97 active+clean; 6.0 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 526 KiB/s wr, 111 op/s 2024-08-20T01:38:02.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:02.221+0000 7fafb6965640 1 -- 172.21.15.79:0/3729062919 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fafb006abc0 con 0x7fafb01073a0 2024-08-20T01:38:02.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:02.222+0000 7fafad7fa640 1 -- 172.21.15.79:0/3729062919 <== mon.2 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7fafb006abc0 con 0x7fafb01073a0 2024-08-20T01:38:02.223 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:38:02.223 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":28,"btime":"2024-08-20T01:36:49:088329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14670,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/735082912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":735082912},{"type":"v1","addr":"172.21.15.79:6835","nonce":735082912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2150339873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2150339873},{"type":"v1","addr":"172.21.15.79:6837","nonce":2150339873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:34:55.133562+0000","modified":"2024-08-20T01:36:48.384274+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24539,"mds_1":24538,"mds_2":24523,"mds_3":24514,"mds_4":24512},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14724":{"gid":14724,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/1071242274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1071242274},{"type":"v1","addr":"172.21.15.79:6839","nonce":1071242274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14730":{"gid":14730,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6841/2448977611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":2448977611},{"type":"v1","addr":"172.21.15.79:6841","nonce":2448977611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/1257507005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1257507005},{"type":"v1","addr":"172.21.15.81:6833","nonce":1257507005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1499936216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1499936216},{"type":"v1","addr":"172.21.15.81:6835","nonce":1499936216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/1107229215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1107229215},{"type":"v1","addr":"172.21.15.175:6833","nonce":1107229215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6837/2073598870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2073598870},{"type":"v1","addr":"172.21.15.81:6837","nonce":2073598870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/2552601173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2552601173},{"type":"v1","addr":"172.21.15.175:6835","nonce":2552601173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6837/1767284089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1767284089},{"type":"v1","addr":"172.21.15.175:6837","nonce":1767284089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/1331748742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1331748742},{"type":"v1","addr":"172.21.15.175:6839","nonce":1331748742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/4098410583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":4098410583},{"type":"v1","addr":"172.21.15.81:6839","nonce":4098410583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24539,"qdb_cluster":[24512,24538,24514,24523,24539]},"id":1}]} 2024-08-20T01:38:02.223 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 28 2024-08-20T01:38:02.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:02.224+0000 7fafb6965640 1 -- 172.21.15.79:0/3729062919 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7faf980b3bd0 msgr2=0x7faf980b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:02.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:02.224+0000 7fafb6965640 1 --2- 172.21.15.79:0/3729062919 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7faf980b3bd0 0x7faf980b6090 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fafa0009fc0 tx=0x7fafa0005f90 comp rx=0 tx=0).stop 2024-08-20T01:38:02.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:02.224+0000 7fafb6965640 1 -- 172.21.15.79:0/3729062919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafb01073a0 msgr2=0x7fafb019a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:02.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:02.224+0000 7fafb6965640 1 --2- 172.21.15.79:0/3729062919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafb01073a0 0x7fafb019a2d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fafa4009230 tx=0x7fafa40319a0 comp rx=0 tx=0).stop 2024-08-20T01:38:02.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:02.224+0000 7fafb6965640 1 -- 172.21.15.79:0/3729062919 shutdown_connections 2024-08-20T01:38:02.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:02.224+0000 7fafb6965640 1 --2- 172.21.15.79:0/3729062919 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7faf980b3bd0 0x7faf980b6090 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:02.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:02.224+0000 7fafb6965640 1 --2- 172.21.15.79:0/3729062919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fafb0107d20 0x7fafb019a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:02.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:02.224+0000 7fafb6965640 1 --2- 172.21.15.79:0/3729062919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafb01073a0 0x7fafb019a2d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:02.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:02.224+0000 7fafb6965640 1 --2- 172.21.15.79:0/3729062919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafb0101990 0x7fafb0199d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:02.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:02.224+0000 7fafb6965640 1 -- 172.21.15.79:0/3729062919 >> 172.21.15.79:0/3729062919 conn(0x7fafb00fd400 msgr2=0x7fafb00ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:02.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:02.224+0000 7fafb6965640 1 -- 172.21.15.79:0/3729062919 shutdown_connections 2024-08-20T01:38:02.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:02.224+0000 7fafb6965640 1 -- 172.21.15.79:0/3729062919 wait complete. 2024-08-20T01:38:02.229 INFO:tasks.workunit.client.0.smithi079.stdout: /bin/sh ./config.status 2024-08-20T01:38:02.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:02 smithi081 ceph-mon[22209]: pgmap v368: 97 pgs: 97 active+clean; 6.0 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 526 KiB/s wr, 111 op/s 2024-08-20T01:38:02.293 INFO:tasks.workunit.client.0.smithi079.stdout:config.status: creating Makefile 2024-08-20T01:38:02.311 INFO:tasks.workunit.client.0.smithi079.stdout:config.status: creating config.h 2024-08-20T01:38:02.342 INFO:tasks.workunit.client.0.smithi079.stdout:config.status: executing depfiles commands 2024-08-20T01:38:02.360 INFO:tasks.workunit.client.0.smithi079.stdout:config.status: executing default commands 2024-08-20T01:38:02.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:02 smithi175 ceph-mon[22392]: pgmap v368: 97 pgs: 97 active+clean; 6.0 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 526 KiB/s wr, 111 op/s 2024-08-20T01:38:02.415 INFO:tasks.workunit.client.0.smithi079.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoheader 2024-08-20T01:38:02.607 INFO:tasks.workunit.client.0.smithi079.stdout:rm -f stamp-h1 2024-08-20T01:38:02.610 INFO:tasks.workunit.client.0.smithi079.stdout:touch config.h.in 2024-08-20T01:38:02.612 INFO:tasks.workunit.client.0.smithi079.stdout:cd . && /bin/sh ./config.status config.h 2024-08-20T01:38:02.668 INFO:tasks.workunit.client.0.smithi079.stdout:config.status: creating config.h 2024-08-20T01:38:02.711 INFO:tasks.workunit.client.0.smithi079.stdout:make all-am 2024-08-20T01:38:02.738 INFO:tasks.workunit.client.0.smithi079.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-08-20T01:38:02.739 INFO:tasks.workunit.client.0.smithi079.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2024-08-20T01:38:02.981 INFO:tasks.workunit.client.0.smithi079.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2024-08-20T01:38:02.986 INFO:tasks.workunit.client.0.smithi079.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2024-08-20T01:38:03.060 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-20T01:38:03.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.085+0000 7ff862e13640 1 -- 172.21.15.79:0/1581231491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff85c103070 msgr2=0x7ff85c1099f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:03.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.085+0000 7ff862e13640 1 --2- 172.21.15.79:0/1581231491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff85c103070 0x7ff85c1099f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7ff854009cd0 tx=0x7ff85402a8e0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.085+0000 7ff862e13640 1 -- 172.21.15.79:0/1581231491 shutdown_connections 2024-08-20T01:38:03.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.085+0000 7ff862e13640 1 --2- 172.21.15.79:0/1581231491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff85c103070 0x7ff85c1099f0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.085+0000 7ff862e13640 1 --2- 172.21.15.79:0/1581231491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff85c1026b0 0x7ff85c102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.085+0000 7ff862e13640 1 --2- 172.21.15.79:0/1581231491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff85c101560 0x7ff85c101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.085+0000 7ff862e13640 1 -- 172.21.15.79:0/1581231491 >> 172.21.15.79:0/1581231491 conn(0x7ff85c0fce40 msgr2=0x7ff85c0ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:03.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.085+0000 7ff862e13640 1 -- 172.21.15.79:0/1581231491 shutdown_connections 2024-08-20T01:38:03.088 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.086+0000 7ff862e13640 1 -- 172.21.15.79:0/1581231491 wait complete. 2024-08-20T01:38:03.088 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.086+0000 7ff862e13640 1 Processor -- start 2024-08-20T01:38:03.088 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.086+0000 7ff862e13640 1 -- start start 2024-08-20T01:38:03.090 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.087+0000 7ff862e13640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff85c101560 0x7ff85c197830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.090 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.087+0000 7ff862e13640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff85c1026b0 0x7ff85c197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.090 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.087+0000 7ff862e13640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff85c103070 0x7ff85c198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.090 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.087+0000 7ff862e13640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff85c10d080 con 0x7ff85c101560 2024-08-20T01:38:03.090 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.087+0000 7ff862e13640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff85c10cf00 con 0x7ff85c103070 2024-08-20T01:38:03.090 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.087+0000 7ff862e13640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff85c10d200 con 0x7ff85c1026b0 2024-08-20T01:38:03.090 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.087+0000 7ff860baf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff85c101560 0x7ff85c197830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.090 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.087+0000 7ff860baf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff85c101560 0x7ff85c197830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35406/0 (socket says 172.21.15.79:35406) 2024-08-20T01:38:03.090 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.087+0000 7ff860baf640 1 -- 172.21.15.79:0/1381934234 learned_addr learned my addr 172.21.15.79:0/1381934234 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:03.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.087+0000 7ff8613b0640 1 --2- 172.21.15.79:0/1381934234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff85c103070 0x7ff85c198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.087+0000 7ff85bfff640 1 --2- 172.21.15.79:0/1381934234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff85c1026b0 0x7ff85c197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.087+0000 7ff860baf640 1 -- 172.21.15.79:0/1381934234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff85c1026b0 msgr2=0x7ff85c197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:03.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.087+0000 7ff860baf640 1 --2- 172.21.15.79:0/1381934234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff85c1026b0 0x7ff85c197e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.087+0000 7ff860baf640 1 -- 172.21.15.79:0/1381934234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff85c103070 msgr2=0x7ff85c198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:03.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.087+0000 7ff860baf640 1 --2- 172.21.15.79:0/1381934234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff85c103070 0x7ff85c198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.087+0000 7ff860baf640 1 -- 172.21.15.79:0/1381934234 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff85c199370 con 0x7ff85c101560 2024-08-20T01:38:03.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.087+0000 7ff8613b0640 1 --2- 172.21.15.79:0/1381934234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff85c103070 0x7ff85c198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:38:03.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.087+0000 7ff860baf640 1 --2- 172.21.15.79:0/1381934234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff85c101560 0x7ff85c197830 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ff850009860 tx=0x7ff850009d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:03.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.087+0000 7ff859ffb640 1 -- 172.21.15.79:0/1381934234 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff850005020 con 0x7ff85c101560 2024-08-20T01:38:03.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.087+0000 7ff862e13640 1 -- 172.21.15.79:0/1381934234 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff85c199660 con 0x7ff85c101560 2024-08-20T01:38:03.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.087+0000 7ff859ffb640 1 -- 172.21.15.79:0/1381934234 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff8500047a0 con 0x7ff85c101560 2024-08-20T01:38:03.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.087+0000 7ff859ffb640 1 -- 172.21.15.79:0/1381934234 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff850007a00 con 0x7ff85c101560 2024-08-20T01:38:03.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.088+0000 7ff862e13640 1 -- 172.21.15.79:0/1381934234 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff85c06a710 con 0x7ff85c101560 2024-08-20T01:38:03.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.090+0000 7ff865bff740 1 Processor -- start 2024-08-20T01:38:03.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.090+0000 7ff865bff740 1 -- start start 2024-08-20T01:38:03.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.091+0000 7ff865bff740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587e7c358d0 0x5587e7c37cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.091+0000 7ff865bff740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587e7c38200 0x5587e7c3a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.091+0000 7ff865bff740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e7c3ac40 0x5587e7c3d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.091+0000 7ff865bff740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5587e7ba8360 con 0x5587e7c38200 2024-08-20T01:38:03.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.091+0000 7ff865bff740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5587e7b97860 con 0x5587e7c3ac40 2024-08-20T01:38:03.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.091+0000 7ff865bff740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5587e7b9b8a0 con 0x5587e7c358d0 2024-08-20T01:38:03.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.091+0000 7ff859ffb640 1 -- 172.21.15.79:0/1381934234 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff850004950 con 0x7ff85c101560 2024-08-20T01:38:03.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.091+0000 7ff85bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e7c3ac40 0x5587e7c3d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.091+0000 7ff85bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e7c3ac40 0x5587e7c3d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:37456/0 (socket says 172.21.15.79:37456) 2024-08-20T01:38:03.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.091+0000 7ff85bfff640 1 -- 172.21.15.79:0/1908537150 learned_addr learned my addr 172.21.15.79:0/1908537150 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:03.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.091+0000 7ff8613b0640 1 --2- 172.21.15.79:0/1908537150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587e7c358d0 0x5587e7c37cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.091+0000 7ff860baf640 1 --2- 172.21.15.79:0/1908537150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587e7c38200 0x5587e7c3a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.091+0000 7ff85bfff640 1 -- 172.21.15.79:0/1908537150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587e7c358d0 msgr2=0x5587e7c37cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.091+0000 7ff85bfff640 1 --2- 172.21.15.79:0/1908537150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587e7c358d0 0x5587e7c37cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.091+0000 7ff85bfff640 1 -- 172.21.15.79:0/1908537150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587e7c38200 msgr2=0x5587e7c3a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.091+0000 7ff85bfff640 1 --2- 172.21.15.79:0/1908537150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587e7c38200 0x5587e7c3a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.091+0000 7ff85bfff640 1 -- 172.21.15.79:0/1908537150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587e7b3ee40 con 0x5587e7c3ac40 2024-08-20T01:38:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.091+0000 7ff860baf640 1 --2- 172.21.15.79:0/1908537150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587e7c38200 0x5587e7c3a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:38:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.091+0000 7ff8613b0640 1 --2- 172.21.15.79:0/1908537150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587e7c358d0 0x5587e7c37cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.092+0000 7ff85bfff640 1 --2- 172.21.15.79:0/1908537150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e7c3ac40 0x5587e7c3d100 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff848009c50 tx=0x7ff848010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a6004e1e241be18 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.092+0000 7ff846ffd640 1 -- 172.21.15.79:0/1908537150 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff848004020 con 0x5587e7c3ac40 2024-08-20T01:38:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.092+0000 7ff846ffd640 1 -- 172.21.15.79:0/1908537150 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff8480041c0 con 0x5587e7c3ac40 2024-08-20T01:38:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.092+0000 7ff846ffd640 1 -- 172.21.15.79:0/1908537150 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8480126b0 con 0x5587e7c3ac40 2024-08-20T01:38:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.092+0000 7ff859ffb640 1 --2- 172.21.15.79:0/1381934234 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff84c0b3bd0 0x7ff84c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.092+0000 7ff8613b0640 1 --2- 172.21.15.79:0/1381934234 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff84c0b3bd0 0x7ff84c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.092+0000 7ff859ffb640 1 -- 172.21.15.79:0/1381934234 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff8500e5190 con 0x7ff85c101560 2024-08-20T01:38:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.093+0000 7ff865bff740 1 -- 172.21.15.79:0/1908537150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e7c3ac40 msgr2=0x5587e7c3d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.093+0000 7ff865bff740 1 --2- 172.21.15.79:0/1908537150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e7c3ac40 0x5587e7c3d100 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff848009c50 tx=0x7ff848010740 comp rx=0 tx=0).stop 2024-08-20T01:38:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.093+0000 7ff865bff740 1 -- 172.21.15.79:0/1908537150 shutdown_connections 2024-08-20T01:38:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.093+0000 7ff865bff740 1 --2- 172.21.15.79:0/1908537150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e7c3ac40 0x5587e7c3d100 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.093+0000 7ff865bff740 1 --2- 172.21.15.79:0/1908537150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587e7c38200 0x5587e7c3a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.093+0000 7ff865bff740 1 --2- 172.21.15.79:0/1908537150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587e7c358d0 0x5587e7c37cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.093+0000 7ff865bff740 1 -- 172.21.15.79:0/1908537150 >> 172.21.15.79:0/1908537150 conn(0x5587e7c30a20 msgr2=0x5587e7c317b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.093+0000 7ff8613b0640 1 --2- 172.21.15.79:0/1381934234 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff84c0b3bd0 0x7ff84c0b6090 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff854005e30 tx=0x7ff8540317b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.093+0000 7ff865bff740 1 -- 172.21.15.79:0/1908537150 shutdown_connections 2024-08-20T01:38:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.093+0000 7ff865bff740 1 -- 172.21.15.79:0/1908537150 wait complete. 2024-08-20T01:38:03.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.093+0000 7ff865bff740 1 -- start start 2024-08-20T01:38:03.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.093+0000 7ff865bff740 1 Processor -- start 2024-08-20T01:38:03.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.094+0000 7ff865bff740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e7c358d0 0x5587e7c3f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.094+0000 7ff865bff740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587e7c38200 0x5587e7c3f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.094+0000 7ff865bff740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587e7c3ac40 0x5587e7c40390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.094+0000 7ff865bff740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5587e7ad0ab0 con 0x5587e7c38200 2024-08-20T01:38:03.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.094+0000 7ff865bff740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5587e7b1e780 con 0x5587e7c358d0 2024-08-20T01:38:03.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.094+0000 7ff865bff740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5587e7c3dc20 con 0x5587e7c3ac40 2024-08-20T01:38:03.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.094+0000 7ff865bff740 10 client.0 _ll_register_callbacks cb 0x5587e78a6a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:03.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.094+0000 7ff85bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587e7c38200 0x5587e7c3f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.094+0000 7ff85bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587e7c38200 0x5587e7c3f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35438/0 (socket says 172.21.15.79:35438) 2024-08-20T01:38:03.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.094+0000 7ff85bfff640 1 -- 172.21.15.79:0/1365219389 learned_addr learned my addr 172.21.15.79:0/1365219389 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:03.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.094+0000 7ff860baf640 1 --2- 172.21.15.79:0/1365219389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e7c358d0 0x5587e7c3f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.094+0000 7ff8613b0640 1 --2- 172.21.15.79:0/1365219389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587e7c3ac40 0x5587e7c40390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.094+0000 7ff85bfff640 1 -- 172.21.15.79:0/1365219389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587e7c3ac40 msgr2=0x5587e7c40390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:03.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.094+0000 7ff85bfff640 1 --2- 172.21.15.79:0/1365219389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587e7c3ac40 0x5587e7c40390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.094+0000 7ff85bfff640 1 -- 172.21.15.79:0/1365219389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e7c358d0 msgr2=0x5587e7c3f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:03.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.094+0000 7ff85bfff640 1 --2- 172.21.15.79:0/1365219389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e7c358d0 0x5587e7c3f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.094+0000 7ff85bfff640 1 -- 172.21.15.79:0/1365219389 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587e78fa790 con 0x5587e7c38200 2024-08-20T01:38:03.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.094+0000 7ff860baf640 1 --2- 172.21.15.79:0/1365219389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e7c358d0 0x5587e7c3f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:03.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.094+0000 7ff85bfff640 1 --2- 172.21.15.79:0/1365219389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587e7c38200 0x5587e7c3f7c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff848009f70 tx=0x7ff848009fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9442a934f8148e6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:03.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.094+0000 7ff83bfff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:38:03.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.095+0000 7ff83bfff640 1 -- 172.21.15.79:0/1365219389 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff848005440 con 0x5587e7c38200 2024-08-20T01:38:03.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.095+0000 7ff83bfff640 1 -- 172.21.15.79:0/1365219389 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff8480055e0 con 0x5587e7c38200 2024-08-20T01:38:03.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.095+0000 7ff865bff740 1 -- 172.21.15.79:0/1365219389 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5587e7b46e00 con 0x5587e7c38200 2024-08-20T01:38:03.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.095+0000 7ff83bfff640 1 -- 172.21.15.79:0/1365219389 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff848003e40 con 0x5587e7c38200 2024-08-20T01:38:03.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.095+0000 7ff865bff740 10 client.15801 fetch_fsmap learned FSMap version 28 2024-08-20T01:38:03.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.095+0000 7ff865bff740 1 -- 172.21.15.79:0/1365219389 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5587e7973620 con 0x5587e7c38200 2024-08-20T01:38:03.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.095+0000 7ff83bfff640 1 -- 172.21.15.79:0/1365219389 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5587e7b46e00 con 0x5587e7c38200 2024-08-20T01:38:03.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.095+0000 7ff83bfff640 1 -- 172.21.15.79:0/1365219389 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff84800f040 con 0x5587e7c38200 2024-08-20T01:38:03.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.095+0000 7ff865bff740 10 client.15801 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:38:03.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.095+0000 7ff865bff740 10 client.15801 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:38:03.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.095+0000 7ff865bff740 20 client.15801 populate_metadata read hostname 'smithi079' 2024-08-20T01:38:03.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.095+0000 7ff865bff740 1 --2- 172.21.15.79:0/1365219389 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5587e7c4a7e0 0x5587e7c4cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.095+0000 7ff865bff740 4 client.15801 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:38:03.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.095+0000 7ff865bff740 1 -- 172.21.15.79:0/1365219389 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5587e7baa2b0 con 0x5587e7c4a7e0 2024-08-20T01:38:03.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.096+0000 7ff860baf640 1 --2- 172.21.15.79:0/1365219389 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5587e7c4a7e0 0x5587e7c4cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.096+0000 7ff860baf640 1 --2- 172.21.15.79:0/1365219389 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5587e7c4a7e0 0x5587e7c4cbf0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f59782fd05d7222f server_cookie=c0085cbcc9e29974 in_seq=0 out_seq=0 2024-08-20T01:38:03.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.096+0000 7ff83bfff640 10 client.15801 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:03.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.097+0000 7ff83bfff640 1 -- 172.21.15.79:0/1365219389 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5587e7baa2b0 con 0x5587e7c4a7e0 2024-08-20T01:38:03.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.097+0000 7ff83bfff640 10 client.15801 handle_command_reply: tid=0 2024-08-20T01:38:03.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.097+0000 7ff865bff740 1 client.15801 shutdown 2024-08-20T01:38:03.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.097+0000 7ff865bff740 1 -- 172.21.15.79:0/1365219389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587e7c38200 msgr2=0x5587e7c3f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:03.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.097+0000 7ff865bff740 1 --2- 172.21.15.79:0/1365219389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587e7c38200 0x5587e7c3f7c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff848009f70 tx=0x7ff848009fa0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.097+0000 7ff865bff740 1 -- 172.21.15.79:0/1365219389 shutdown_connections 2024-08-20T01:38:03.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.097+0000 7ff865bff740 1 --2- 172.21.15.79:0/1365219389 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5587e7c4a7e0 0x5587e7c4cbf0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.097+0000 7ff865bff740 1 --2- 172.21.15.79:0/1365219389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587e7c3ac40 0x5587e7c40390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.097+0000 7ff865bff740 1 --2- 172.21.15.79:0/1365219389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587e7c38200 0x5587e7c3f7c0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.097+0000 7ff865bff740 1 --2- 172.21.15.79:0/1365219389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e7c358d0 0x5587e7c3f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.097+0000 7ff865bff740 1 -- 172.21.15.79:0/1365219389 >> 172.21.15.79:0/1365219389 conn(0x5587e7c30a20 msgr2=0x5587e7c2fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:03.106 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.097+0000 7ff83bfff640 0 client.15801 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:03.106 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.097+0000 7ff865bff740 1 -- 172.21.15.79:0/1365219389 shutdown_connections 2024-08-20T01:38:03.106 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.097+0000 7ff865bff740 1 -- 172.21.15.79:0/1365219389 wait complete. 2024-08-20T01:38:03.106 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.097+0000 7ff865bff740 20 client.15801 trim_cache size 0 max 16384 2024-08-20T01:38:03.114 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.113+0000 7ff865bff740 1 Processor -- start 2024-08-20T01:38:03.114 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.113+0000 7ff865bff740 1 -- start start 2024-08-20T01:38:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.114+0000 7ff865bff740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587e7c358d0 0x5587e7c3f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.114+0000 7ff865bff740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e7c3ac40 0x5587e7c31470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.114+0000 7ff865bff740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587e7c3b020 0x5587e7c3b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.114+0000 7ff865bff740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff85c1a7920 con 0x5587e7c3b020 2024-08-20T01:38:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.114+0000 7ff865bff740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff85c1a9460 con 0x5587e7c3ac40 2024-08-20T01:38:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.114+0000 7ff865bff740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff85c1a7ff0 con 0x5587e7c358d0 2024-08-20T01:38:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.114+0000 7ff860baf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587e7c358d0 0x5587e7c3f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.114+0000 7ff860baf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587e7c358d0 0x5587e7c3f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:48384/0 (socket says 172.21.15.79:48384) 2024-08-20T01:38:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.114+0000 7ff860baf640 1 -- 172.21.15.79:0/2153956478 learned_addr learned my addr 172.21.15.79:0/2153956478 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.114+0000 7ff85bfff640 1 --2- 172.21.15.79:0/2153956478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e7c3ac40 0x5587e7c31470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.114+0000 7ff8613b0640 1 --2- 172.21.15.79:0/2153956478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587e7c3b020 0x5587e7c3b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.114+0000 7ff860baf640 1 -- 172.21.15.79:0/2153956478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e7c3ac40 msgr2=0x5587e7c31470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.114+0000 7ff860baf640 1 --2- 172.21.15.79:0/2153956478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e7c3ac40 0x5587e7c31470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.114+0000 7ff860baf640 1 -- 172.21.15.79:0/2153956478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587e7c3b020 msgr2=0x5587e7c3b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.114+0000 7ff860baf640 1 --2- 172.21.15.79:0/2153956478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587e7c3b020 0x5587e7c3b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.114+0000 7ff860baf640 1 -- 172.21.15.79:0/2153956478 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587e7c34af0 con 0x5587e7c358d0 2024-08-20T01:38:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.114+0000 7ff8613b0640 1 --2- 172.21.15.79:0/2153956478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587e7c3b020 0x5587e7c3b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:38:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.115+0000 7ff860baf640 1 --2- 172.21.15.79:0/2153956478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587e7c358d0 0x5587e7c3f830 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff850009830 tx=0x7ff8500e2b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31c3c67b9129488b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.115+0000 7ff8467fc640 1 -- 172.21.15.79:0/2153956478 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8500b06f0 con 0x5587e7c358d0 2024-08-20T01:38:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.115+0000 7ff8467fc640 1 -- 172.21.15.79:0/2153956478 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff8500b51a0 con 0x5587e7c358d0 2024-08-20T01:38:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.115+0000 7ff8467fc640 1 -- 172.21.15.79:0/2153956478 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8500ab5b0 con 0x5587e7c358d0 2024-08-20T01:38:03.120 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.116+0000 7ff865bff740 1 -- 172.21.15.79:0/2153956478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587e7c358d0 msgr2=0x5587e7c3f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:03.120 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.116+0000 7ff865bff740 1 --2- 172.21.15.79:0/2153956478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587e7c358d0 0x5587e7c3f830 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff850009830 tx=0x7ff8500e2b70 comp rx=0 tx=0).stop 2024-08-20T01:38:03.120 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.116+0000 7ff865bff740 1 -- 172.21.15.79:0/2153956478 shutdown_connections 2024-08-20T01:38:03.120 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.116+0000 7ff865bff740 1 --2- 172.21.15.79:0/2153956478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587e7c3b020 0x5587e7c3b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.120 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.116+0000 7ff865bff740 1 --2- 172.21.15.79:0/2153956478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e7c3ac40 0x5587e7c31470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.116+0000 7ff865bff740 1 --2- 172.21.15.79:0/2153956478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587e7c358d0 0x5587e7c3f830 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.116+0000 7ff865bff740 1 -- 172.21.15.79:0/2153956478 >> 172.21.15.79:0/2153956478 conn(0x5587e7c30a20 msgr2=0x5587e7c3f120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.116+0000 7ff865bff740 1 -- 172.21.15.79:0/2153956478 shutdown_connections 2024-08-20T01:38:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.116+0000 7ff865bff740 1 -- 172.21.15.79:0/2153956478 wait complete. 2024-08-20T01:38:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.116+0000 7ff865bff740 1 -- start start 2024-08-20T01:38:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.116+0000 7ff865bff740 1 Processor -- start 2024-08-20T01:38:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.117+0000 7ff865bff740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e7c358d0 0x5587e7c46c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.117+0000 7ff865bff740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587e7c3ac40 0x5587e7c45940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.117+0000 7ff865bff740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587e7c3b020 0x5587e7c45ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.117+0000 7ff865bff740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff85c1a8d90 con 0x5587e7c3ac40 2024-08-20T01:38:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.117+0000 7ff865bff740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff85c1a86c0 con 0x5587e7c358d0 2024-08-20T01:38:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.117+0000 7ff865bff740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff85c1a5900 con 0x5587e7c3b020 2024-08-20T01:38:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.117+0000 7ff865bff740 10 client.0 _ll_register_callbacks cb 0x7ff848005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:03.122 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.117+0000 7ff85bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587e7c3ac40 0x5587e7c45940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.122 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.117+0000 7ff85bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587e7c3ac40 0x5587e7c45940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35462/0 (socket says 172.21.15.79:35462) 2024-08-20T01:38:03.122 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.117+0000 7ff85bfff640 1 -- 172.21.15.79:0/2629747012 learned_addr learned my addr 172.21.15.79:0/2629747012 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:03.122 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.117+0000 7ff8613b0640 1 --2- 172.21.15.79:0/2629747012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587e7c3b020 0x5587e7c45ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.122 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.117+0000 7ff860baf640 1 --2- 172.21.15.79:0/2629747012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e7c358d0 0x5587e7c46c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.122 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.117+0000 7ff85bfff640 1 -- 172.21.15.79:0/2629747012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587e7c3b020 msgr2=0x5587e7c45ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:03.122 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.117+0000 7ff85bfff640 1 --2- 172.21.15.79:0/2629747012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587e7c3b020 0x5587e7c45ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.122 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.117+0000 7ff85bfff640 1 -- 172.21.15.79:0/2629747012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e7c358d0 msgr2=0x5587e7c46c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:03.122 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.117+0000 7ff85bfff640 1 --2- 172.21.15.79:0/2629747012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e7c358d0 0x5587e7c46c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.122 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.117+0000 7ff85bfff640 1 -- 172.21.15.79:0/2629747012 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587e7c466d0 con 0x5587e7c3ac40 2024-08-20T01:38:03.122 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.117+0000 7ff8613b0640 1 --2- 172.21.15.79:0/2629747012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587e7c3b020 0x5587e7c45ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:38:03.122 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.118+0000 7ff85bfff640 1 --2- 172.21.15.79:0/2629747012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587e7c3ac40 0x5587e7c45940 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x5587e7c3e5e0 tx=0x7ff848003c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18df9f921f4c7304 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:03.123 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.118+0000 7ff83bfff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:38:03.123 INFO:tasks.workunit.client.0.smithi079.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2024-08-20T01:38:03.124 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.118+0000 7ff83bfff640 1 -- 172.21.15.79:0/2629747012 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84803d020 con 0x5587e7c3ac40 2024-08-20T01:38:03.124 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.118+0000 7ff83bfff640 1 -- 172.21.15.79:0/2629747012 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff848004660 con 0x5587e7c3ac40 2024-08-20T01:38:03.124 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.118+0000 7ff865bff740 1 -- 172.21.15.79:0/2629747012 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8500b51a0 con 0x5587e7c3ac40 2024-08-20T01:38:03.124 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.118+0000 7ff83bfff640 1 -- 172.21.15.79:0/2629747012 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff848034070 con 0x5587e7c3ac40 2024-08-20T01:38:03.125 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.118+0000 7ff865bff740 10 client.15807 fetch_fsmap learned FSMap version 28 2024-08-20T01:38:03.125 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.118+0000 7ff865bff740 1 -- 172.21.15.79:0/2629747012 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5587e7cb5550 con 0x5587e7c3ac40 2024-08-20T01:38:03.125 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.118+0000 7ff83bfff640 1 -- 172.21.15.79:0/2629747012 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff8500b51a0 con 0x5587e7c3ac40 2024-08-20T01:38:03.125 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.119+0000 7ff83bfff640 1 -- 172.21.15.79:0/2629747012 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff848003fe0 con 0x5587e7c3ac40 2024-08-20T01:38:03.125 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.119+0000 7ff865bff740 10 client.15807 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:38:03.125 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.119+0000 7ff865bff740 10 client.15807 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:38:03.126 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.119+0000 7ff865bff740 20 client.15807 populate_metadata read hostname 'smithi079' 2024-08-20T01:38:03.126 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.119+0000 7ff865bff740 1 --2- 172.21.15.79:0/2629747012 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5587e7cb5f00 0x5587e7cb8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.126 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.119+0000 7ff865bff740 4 client.15807 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:38:03.126 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.119+0000 7ff865bff740 1 -- 172.21.15.79:0/2629747012 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5587e7ba5d50 con 0x5587e7cb5f00 2024-08-20T01:38:03.126 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.119+0000 7ff860baf640 1 --2- 172.21.15.79:0/2629747012 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5587e7cb5f00 0x5587e7cb8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.126 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.119+0000 7ff83bfff640 10 client.15807 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:03.126 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:03.119+0000 7ff860baf640 1 --2- 172.21.15.79:0/2629747012 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5587e7cb5f00 0x5587e7cb8320 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7c993e6a6f66d6d server_cookie=d4d4f6d67fe2884e in_seq=0 out_seq=0 2024-08-20T01:38:03.126 INFO:tasks.workunit.client.0.smithi079.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2024-08-20T01:38:03.257 INFO:tasks.workunit.client.0.smithi079.stdout:mv -f .deps/main.Tpo .deps/main.Po 2024-08-20T01:38:03.262 INFO:tasks.workunit.client.0.smithi079.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2024-08-20T01:38:03.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:03 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/3729062919' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:38:03.366 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:38:03.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:03 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/3729062919' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:38:03.393 INFO:tasks.workunit.client.0.smithi079.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2024-08-20T01:38:03.400 INFO:tasks.workunit.client.0.smithi079.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2024-08-20T01:38:03.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:03 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/3729062919' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:38:03.588 INFO:tasks.workunit.client.0.smithi079.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2024-08-20T01:38:03.594 INFO:tasks.workunit.client.0.smithi079.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2024-08-20T01:38:03.676 INFO:tasks.workunit.client.0.smithi079.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2024-08-20T01:38:03.682 INFO:tasks.workunit.client.0.smithi079.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2024-08-20T01:38:03.744 INFO:tasks.workunit.client.0.smithi079.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2024-08-20T01:38:03.750 INFO:tasks.workunit.client.0.smithi079.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2024-08-20T01:38:03.815 INFO:tasks.workunit.client.0.smithi079.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2024-08-20T01:38:03.820 INFO:tasks.workunit.client.0.smithi079.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2024-08-20T01:38:03.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.911+0000 7f7569162640 1 -- 172.21.15.79:0/2762932978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75641073a0 msgr2=0x7f75641077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:03.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.911+0000 7f7569162640 1 --2- 172.21.15.79:0/2762932978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75641073a0 0x7f75641077e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f7558009900 tx=0x7f755802a410 comp rx=0 tx=0).stop 2024-08-20T01:38:03.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.911+0000 7f7569162640 1 -- 172.21.15.79:0/2762932978 shutdown_connections 2024-08-20T01:38:03.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.911+0000 7f7569162640 1 --2- 172.21.15.79:0/2762932978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7564107d20 0x7f756410e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.911+0000 7f7569162640 1 --2- 172.21.15.79:0/2762932978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75641073a0 0x7f75641077e0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.912 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.911+0000 7f7569162640 1 --2- 172.21.15.79:0/2762932978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7564101990 0x7f7564101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.911+0000 7f7569162640 1 -- 172.21.15.79:0/2762932978 >> 172.21.15.79:0/2762932978 conn(0x7f75640fd400 msgr2=0x7f75640ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:03.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.911+0000 7f7569162640 1 -- 172.21.15.79:0/2762932978 shutdown_connections 2024-08-20T01:38:03.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.911+0000 7f7569162640 1 -- 172.21.15.79:0/2762932978 wait complete. 2024-08-20T01:38:03.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.912+0000 7f7569162640 1 Processor -- start 2024-08-20T01:38:03.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.912+0000 7f7569162640 1 -- start start 2024-08-20T01:38:03.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.912+0000 7f7569162640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7564101990 0x7f7564074970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.912+0000 7f7569162640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75641073a0 0x7f756406f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.912+0000 7f7569162640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7564107d20 0x7f756406fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.912+0000 7f7569162640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7564111890 con 0x7f7564101990 2024-08-20T01:38:03.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.912+0000 7f7569162640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7564111710 con 0x7f75641073a0 2024-08-20T01:38:03.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.912+0000 7f7569162640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7564111a10 con 0x7f7564107d20 2024-08-20T01:38:03.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.913+0000 7f7562d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7564101990 0x7f7564074970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.913+0000 7f7562d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7564101990 0x7f7564074970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35484/0 (socket says 172.21.15.79:35484) 2024-08-20T01:38:03.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.913+0000 7f7562d9d640 1 -- 172.21.15.79:0/3256369787 learned_addr learned my addr 172.21.15.79:0/3256369787 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:03.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.913+0000 7f756359e640 1 --2- 172.21.15.79:0/3256369787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7564107d20 0x7f756406fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.913+0000 7f756259c640 1 --2- 172.21.15.79:0/3256369787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75641073a0 0x7f756406f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.913+0000 7f7562d9d640 1 -- 172.21.15.79:0/3256369787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7564107d20 msgr2=0x7f756406fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:03.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.913+0000 7f7562d9d640 1 --2- 172.21.15.79:0/3256369787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7564107d20 0x7f756406fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.913+0000 7f7562d9d640 1 -- 172.21.15.79:0/3256369787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75641073a0 msgr2=0x7f756406f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:03.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.913+0000 7f7562d9d640 1 --2- 172.21.15.79:0/3256369787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75641073a0 0x7f756406f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.913+0000 7f7562d9d640 1 -- 172.21.15.79:0/3256369787 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7564070560 con 0x7f7564101990 2024-08-20T01:38:03.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.913+0000 7f756359e640 1 --2- 172.21.15.79:0/3256369787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7564107d20 0x7f756406fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:03.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.913+0000 7f7562d9d640 1 --2- 172.21.15.79:0/3256369787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7564101990 0x7f7564074970 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f755400b4a0 tx=0x7f755400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:03.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.917+0000 7f754bfff640 1 -- 172.21.15.79:0/3256369787 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7554014070 con 0x7f7564101990 2024-08-20T01:38:03.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.917+0000 7f7569162640 1 -- 172.21.15.79:0/3256369787 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75641add60 con 0x7f7564101990 2024-08-20T01:38:03.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.917+0000 7f754bfff640 1 -- 172.21.15.79:0/3256369787 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7554010aa0 con 0x7f7564101990 2024-08-20T01:38:03.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.917+0000 7f754bfff640 1 -- 172.21.15.79:0/3256369787 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7554017b70 con 0x7f7564101990 2024-08-20T01:38:03.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.917+0000 7f7569162640 1 -- 172.21.15.79:0/3256369787 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75641ae1c0 con 0x7f7564101990 2024-08-20T01:38:03.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.919+0000 7f756b55b740 1 Processor -- start 2024-08-20T01:38:03.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.919+0000 7f756b55b740 1 -- start start 2024-08-20T01:38:03.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.920+0000 7f756b55b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d82d547880 0x55d82d547c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.920+0000 7f756b55b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d82d5481a0 0x55d82d558000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.920+0000 7f756b55b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d82d558540 0x55d82d55a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.920+0000 7f756b55b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d82d4be930 con 0x55d82d547880 2024-08-20T01:38:03.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.920+0000 7f756b55b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d82d4ade30 con 0x55d82d558540 2024-08-20T01:38:03.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.920+0000 7f756b55b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d82d4b1e70 con 0x55d82d5481a0 2024-08-20T01:38:03.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.920+0000 7f756359e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d82d547880 0x55d82d547c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.920+0000 7f756359e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d82d547880 0x55d82d547c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35492/0 (socket says 172.21.15.79:35492) 2024-08-20T01:38:03.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.920+0000 7f756359e640 1 -- 172.21.15.79:0/1155085876 learned_addr learned my addr 172.21.15.79:0/1155085876 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:03.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.920+0000 7f756259c640 1 --2- 172.21.15.79:0/1155085876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d82d558540 0x55d82d55a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.920+0000 7f756359e640 1 -- 172.21.15.79:0/1155085876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d82d5481a0 msgr2=0x55d82d558000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:38:03.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.920+0000 7f756359e640 1 --2- 172.21.15.79:0/1155085876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d82d5481a0 0x55d82d558000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.920+0000 7f756359e640 1 -- 172.21.15.79:0/1155085876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d82d558540 msgr2=0x55d82d55a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:03.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.920+0000 7f756359e640 1 --2- 172.21.15.79:0/1155085876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d82d558540 0x55d82d55a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.920+0000 7f756359e640 1 -- 172.21.15.79:0/1155085876 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d82d20d650 con 0x55d82d547880 2024-08-20T01:38:03.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.920+0000 7f756259c640 1 --2- 172.21.15.79:0/1155085876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d82d558540 0x55d82d55a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:03.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.920+0000 7f754bfff640 1 -- 172.21.15.79:0/3256369787 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f7554017070 con 0x7f7564101990 2024-08-20T01:38:03.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.921+0000 7f756359e640 1 --2- 172.21.15.79:0/1155085876 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d82d547880 0x55d82d547c60 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f755c010780 tx=0x7f755c010c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ee333d45150a84 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:03.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.921+0000 7f75497fa640 1 -- 172.21.15.79:0/1155085876 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755c00ead0 con 0x55d82d547880 2024-08-20T01:38:03.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.921+0000 7f75497fa640 1 -- 172.21.15.79:0/1155085876 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f755c010e90 con 0x55d82d547880 2024-08-20T01:38:03.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.921+0000 7f75497fa640 1 -- 172.21.15.79:0/1155085876 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755c011640 con 0x55d82d547880 2024-08-20T01:38:03.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.922+0000 7f754bfff640 1 --2- 172.21.15.79:0/3256369787 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f754c0b3bd0 0x7f754c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.922+0000 7f7562d9d640 1 --2- 172.21.15.79:0/3256369787 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f754c0b3bd0 0x7f754c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.922+0000 7f754bfff640 1 -- 172.21.15.79:0/3256369787 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f75540e3250 con 0x7f7564101990 2024-08-20T01:38:03.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.922+0000 7f756b55b740 1 -- 172.21.15.79:0/1155085876 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d82d547880 msgr2=0x55d82d547c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:03.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.922+0000 7f756b55b740 1 --2- 172.21.15.79:0/1155085876 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d82d547880 0x55d82d547c60 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f755c010780 tx=0x7f755c010c40 comp rx=0 tx=0).stop 2024-08-20T01:38:03.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.922+0000 7f7562d9d640 1 --2- 172.21.15.79:0/3256369787 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f754c0b3bd0 0x7f754c0b6090 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f75540e0d00 tx=0x7f755401cce0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:03.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.922+0000 7f756b55b740 1 -- 172.21.15.79:0/1155085876 shutdown_connections 2024-08-20T01:38:03.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.922+0000 7f756b55b740 1 --2- 172.21.15.79:0/1155085876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d82d558540 0x55d82d55a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.922+0000 7f756b55b740 1 --2- 172.21.15.79:0/1155085876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d82d5481a0 0x55d82d558000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.922+0000 7f756b55b740 1 --2- 172.21.15.79:0/1155085876 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d82d547880 0x55d82d547c60 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.922+0000 7f756b55b740 1 -- 172.21.15.79:0/1155085876 >> 172.21.15.79:0/1155085876 conn(0x55d82d5456b0 msgr2=0x55d82d546850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:03.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.923+0000 7f756b55b740 1 -- 172.21.15.79:0/1155085876 shutdown_connections 2024-08-20T01:38:03.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.923+0000 7f756b55b740 1 -- 172.21.15.79:0/1155085876 wait complete. 2024-08-20T01:38:03.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.923+0000 7f756b55b740 1 -- start start 2024-08-20T01:38:03.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.923+0000 7f756b55b740 1 Processor -- start 2024-08-20T01:38:03.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.923+0000 7f756b55b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d82d547880 0x55d82d5554d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.923+0000 7f756b55b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d82d5481a0 0x55d82d555a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.923+0000 7f756b55b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d82d558540 0x55d82d555f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.924+0000 7f756b55b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d82d310700 con 0x55d82d5481a0 2024-08-20T01:38:03.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.924+0000 7f756b55b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d82d434810 con 0x55d82d547880 2024-08-20T01:38:03.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.924+0000 7f756b55b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d82d55b1f0 con 0x55d82d558540 2024-08-20T01:38:03.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.924+0000 7f756b55b740 10 client.0 _ll_register_callbacks cb 0x55d82d4a7700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:03.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.924+0000 7f756259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d82d5481a0 0x55d82d555a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.924+0000 7f756259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d82d5481a0 0x55d82d555a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35504/0 (socket says 172.21.15.79:35504) 2024-08-20T01:38:03.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.924+0000 7f756259c640 1 -- 172.21.15.79:0/2547460334 learned_addr learned my addr 172.21.15.79:0/2547460334 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:03.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.924+0000 7f756359e640 1 --2- 172.21.15.79:0/2547460334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d82d547880 0x55d82d5554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.924+0000 7f756359e640 1 --2- 172.21.15.79:0/2547460334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d82d558540 0x55d82d555f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.924+0000 7f756359e640 1 -- 172.21.15.79:0/2547460334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d82d558540 msgr2=0x55d82d555f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:03.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.924+0000 7f756359e640 1 --2- 172.21.15.79:0/2547460334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d82d558540 0x55d82d555f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.924+0000 7f756359e640 1 -- 172.21.15.79:0/2547460334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d82d5481a0 msgr2=0x55d82d555a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:03.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.924+0000 7f756359e640 1 --2- 172.21.15.79:0/2547460334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d82d5481a0 0x55d82d555a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.924+0000 7f756359e640 1 -- 172.21.15.79:0/2547460334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d82d5645d0 con 0x55d82d547880 2024-08-20T01:38:03.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.924+0000 7f756359e640 1 --2- 172.21.15.79:0/2547460334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d82d547880 0x55d82d5554d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f755c010780 tx=0x7f755c012c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=429c4314b7802c59 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:03.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.924+0000 7f7546ff5640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:38:03.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.924+0000 7f7546ff5640 1 -- 172.21.15.79:0/2547460334 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755c02f060 con 0x55d82d547880 2024-08-20T01:38:03.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.925+0000 7f756b55b740 1 -- 172.21.15.79:0/2547460334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d82d45d150 con 0x55d82d547880 2024-08-20T01:38:03.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.925+0000 7f7546ff5640 1 -- 172.21.15.79:0/2547460334 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f755c00eae0 con 0x55d82d547880 2024-08-20T01:38:03.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.925+0000 7f7546ff5640 1 -- 172.21.15.79:0/2547460334 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f755c0128b0 con 0x55d82d547880 2024-08-20T01:38:03.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.925+0000 7f756b55b740 10 client.25193 fetch_fsmap learned FSMap version 28 2024-08-20T01:38:03.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.925+0000 7f756b55b740 1 -- 172.21.15.79:0/2547460334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d82d566fd0 con 0x55d82d547880 2024-08-20T01:38:03.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.925+0000 7f7546ff5640 1 -- 172.21.15.79:0/2547460334 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55d82d45d150 con 0x55d82d547880 2024-08-20T01:38:03.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.925+0000 7f7546ff5640 1 -- 172.21.15.79:0/2547460334 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f755c00f040 con 0x55d82d547880 2024-08-20T01:38:03.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.925+0000 7f756b55b740 10 client.25193 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:38:03.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.925+0000 7f756b55b740 10 client.25193 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:38:03.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.925+0000 7f756b55b740 20 client.25193 populate_metadata read hostname 'smithi079' 2024-08-20T01:38:03.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.925+0000 7f756b55b740 1 --2- 172.21.15.79:0/2547460334 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55d82d568840 0x55d82d56ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.925+0000 7f756b55b740 4 client.25193 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:38:03.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.925+0000 7f756b55b740 1 -- 172.21.15.79:0/2547460334 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d82d4c0880 con 0x55d82d568840 2024-08-20T01:38:03.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.926+0000 7f756259c640 1 --2- 172.21.15.79:0/2547460334 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55d82d568840 0x55d82d56ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.926+0000 7f7546ff5640 10 client.25193 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:38:03.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.926+0000 7f756259c640 1 --2- 172.21.15.79:0/2547460334 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55d82d568840 0x55d82d56ac60 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6793abb5018ef3cf server_cookie=a1ef85a060a0338b in_seq=0 out_seq=0 2024-08-20T01:38:03.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.927+0000 7f7546ff5640 1 -- 172.21.15.79:0/2547460334 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d82d4c0880 con 0x55d82d568840 2024-08-20T01:38:03.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.927+0000 7f7546ff5640 10 client.25193 handle_command_reply: tid=0 2024-08-20T01:38:03.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.927+0000 7f756b55b740 1 client.25193 shutdown 2024-08-20T01:38:03.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.927+0000 7f756b55b740 1 -- 172.21.15.79:0/2547460334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d82d547880 msgr2=0x55d82d5554d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:03.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.927+0000 7f756b55b740 1 --2- 172.21.15.79:0/2547460334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d82d547880 0x55d82d5554d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f755c010780 tx=0x7f755c012c70 comp rx=0 tx=0).stop 2024-08-20T01:38:03.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.927+0000 7f756b55b740 1 -- 172.21.15.79:0/2547460334 shutdown_connections 2024-08-20T01:38:03.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.927+0000 7f756b55b740 1 --2- 172.21.15.79:0/2547460334 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55d82d568840 0x55d82d56ac60 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.927+0000 7f756b55b740 1 --2- 172.21.15.79:0/2547460334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d82d558540 0x55d82d555f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.927+0000 7f756b55b740 1 --2- 172.21.15.79:0/2547460334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d82d5481a0 0x55d82d555a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.927+0000 7f7546ff5640 0 client.25193 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:38:03.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.927+0000 7f756b55b740 1 --2- 172.21.15.79:0/2547460334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d82d547880 0x55d82d5554d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.927+0000 7f756b55b740 1 -- 172.21.15.79:0/2547460334 >> 172.21.15.79:0/2547460334 conn(0x55d82d5456b0 msgr2=0x55d82d54b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:03.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.927+0000 7f756b55b740 1 -- 172.21.15.79:0/2547460334 shutdown_connections 2024-08-20T01:38:03.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.927+0000 7f756b55b740 1 -- 172.21.15.79:0/2547460334 wait complete. 2024-08-20T01:38:03.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.927+0000 7f756b55b740 20 client.25193 trim_cache size 0 max 16384 2024-08-20T01:38:03.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.940+0000 7f756b55b740 1 Processor -- start 2024-08-20T01:38:03.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.940+0000 7f756b55b740 1 -- start start 2024-08-20T01:38:03.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.940+0000 7f756b55b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d82d547880 0x55d82d552fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.940+0000 7f756b55b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d82d5481a0 0x55d82d554d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.941+0000 7f756b55b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d82d558540 0x55d82d555b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.941+0000 7f756b55b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f75641b4660 con 0x55d82d558540 2024-08-20T01:38:03.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.941+0000 7f756b55b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f75641b61a0 con 0x55d82d5481a0 2024-08-20T01:38:03.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.941+0000 7f756b55b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f75641b4d30 con 0x55d82d547880 2024-08-20T01:38:03.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.941+0000 7f756359e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d82d558540 0x55d82d555b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.941+0000 7f756359e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d82d558540 0x55d82d555b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35512/0 (socket says 172.21.15.79:35512) 2024-08-20T01:38:03.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.941+0000 7f756359e640 1 -- 172.21.15.79:0/2447011263 learned_addr learned my addr 172.21.15.79:0/2447011263 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:03.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.941+0000 7f756359e640 1 --2- 172.21.15.79:0/2447011263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d82d547880 0x55d82d552fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.941+0000 7f756259c640 1 --2- 172.21.15.79:0/2447011263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d82d5481a0 0x55d82d554d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.941+0000 7f756359e640 1 -- 172.21.15.79:0/2447011263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d82d547880 msgr2=0x55d82d552fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:03.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.941+0000 7f756359e640 1 --2- 172.21.15.79:0/2447011263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d82d547880 0x55d82d552fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.941+0000 7f756359e640 1 -- 172.21.15.79:0/2447011263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d82d5481a0 msgr2=0x55d82d554d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:03.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.941+0000 7f756359e640 1 --2- 172.21.15.79:0/2447011263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d82d5481a0 0x55d82d554d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.941+0000 7f756359e640 1 -- 172.21.15.79:0/2447011263 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d82d56b2c0 con 0x55d82d558540 2024-08-20T01:38:03.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.941+0000 7f756359e640 1 --2- 172.21.15.79:0/2447011263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d82d558540 0x55d82d555b50 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f755c009eb0 tx=0x7f755c009600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1b29c06037b9352 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:03.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.941+0000 7f7548ff9640 1 -- 172.21.15.79:0/2447011263 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755c03a070 con 0x55d82d558540 2024-08-20T01:38:03.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.942+0000 7f7548ff9640 1 -- 172.21.15.79:0/2447011263 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f755c03b040 con 0x55d82d558540 2024-08-20T01:38:03.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.942+0000 7f7548ff9640 1 -- 172.21.15.79:0/2447011263 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755c02f040 con 0x55d82d558540 2024-08-20T01:38:03.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.942+0000 7f756b55b740 1 -- 172.21.15.79:0/2447011263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d82d558540 msgr2=0x55d82d555b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:03.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.942+0000 7f756b55b740 1 --2- 172.21.15.79:0/2447011263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d82d558540 0x55d82d555b50 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f755c009eb0 tx=0x7f755c009600 comp rx=0 tx=0).stop 2024-08-20T01:38:03.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.942+0000 7f756b55b740 1 -- 172.21.15.79:0/2447011263 shutdown_connections 2024-08-20T01:38:03.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.942+0000 7f756b55b740 1 --2- 172.21.15.79:0/2447011263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d82d558540 0x55d82d555b50 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.942+0000 7f756b55b740 1 --2- 172.21.15.79:0/2447011263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d82d5481a0 0x55d82d554d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.942+0000 7f756b55b740 1 --2- 172.21.15.79:0/2447011263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d82d547880 0x55d82d552fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.942+0000 7f756b55b740 1 -- 172.21.15.79:0/2447011263 >> 172.21.15.79:0/2447011263 conn(0x55d82d5456b0 msgr2=0x55d82d555440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:03.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.942+0000 7f756b55b740 1 -- 172.21.15.79:0/2447011263 shutdown_connections 2024-08-20T01:38:03.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.942+0000 7f756b55b740 1 -- 172.21.15.79:0/2447011263 wait complete. 2024-08-20T01:38:03.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.943+0000 7f756b55b740 1 -- start start 2024-08-20T01:38:03.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.943+0000 7f756b55b740 1 Processor -- start 2024-08-20T01:38:03.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.943+0000 7f756b55b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d82d547880 0x55d82d5604b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.943+0000 7f756b55b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d82d5481a0 0x55d82d560a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.943+0000 7f756b55b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d82d558540 0x55d82d56f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.943+0000 7f756b55b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f75641b5ad0 con 0x55d82d558540 2024-08-20T01:38:03.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.943+0000 7f756b55b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f75641b5400 con 0x55d82d5481a0 2024-08-20T01:38:03.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.943+0000 7f756b55b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f75641b2640 con 0x55d82d547880 2024-08-20T01:38:03.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.943+0000 7f756b55b740 10 client.0 _ll_register_callbacks cb 0x7f755c016070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:03.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.943+0000 7f756359e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d82d558540 0x55d82d56f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.943+0000 7f756359e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d82d558540 0x55d82d56f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35520/0 (socket says 172.21.15.79:35520) 2024-08-20T01:38:03.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.943+0000 7f756359e640 1 -- 172.21.15.79:0/3279581684 learned_addr learned my addr 172.21.15.79:0/3279581684 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:03.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.943+0000 7f756359e640 1 --2- 172.21.15.79:0/3279581684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d82d547880 0x55d82d5604b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.943+0000 7f756259c640 1 --2- 172.21.15.79:0/3279581684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d82d5481a0 0x55d82d560a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.944+0000 7f756359e640 1 -- 172.21.15.79:0/3279581684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d82d547880 msgr2=0x55d82d5604b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:03.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.944+0000 7f756359e640 1 --2- 172.21.15.79:0/3279581684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d82d547880 0x55d82d5604b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.944+0000 7f756359e640 1 -- 172.21.15.79:0/3279581684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d82d5481a0 msgr2=0x55d82d560a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:03.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.944+0000 7f756359e640 1 --2- 172.21.15.79:0/3279581684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d82d5481a0 0x55d82d560a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.944+0000 7f756359e640 1 -- 172.21.15.79:0/3279581684 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d82d570020 con 0x55d82d558540 2024-08-20T01:38:03.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.944+0000 7f756359e640 1 --2- 172.21.15.79:0/3279581684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d82d558540 0x55d82d56f930 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f755c01cfd0 tx=0x7f755c010c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb484334bd4aabae server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:03.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.944+0000 7f7546ff5640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:38:03.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.944+0000 7f7546ff5640 1 -- 172.21.15.79:0/3279581684 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755c03a040 con 0x55d82d558540 2024-08-20T01:38:03.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.944+0000 7f7546ff5640 1 -- 172.21.15.79:0/3279581684 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f755c01c820 con 0x55d82d558540 2024-08-20T01:38:03.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.944+0000 7f756b55b740 1 -- 172.21.15.79:0/3279581684 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f755c03b040 con 0x55d82d558540 2024-08-20T01:38:03.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.944+0000 7f7546ff5640 1 -- 172.21.15.79:0/3279581684 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f755c005b30 con 0x55d82d558540 2024-08-20T01:38:03.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.944+0000 7f756b55b740 10 client.15825 fetch_fsmap learned FSMap version 28 2024-08-20T01:38:03.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.944+0000 7f756b55b740 1 -- 172.21.15.79:0/3279581684 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d82d5d2ea0 con 0x55d82d558540 2024-08-20T01:38:03.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.945+0000 7f7546ff5640 1 -- 172.21.15.79:0/3279581684 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f755c03b040 con 0x55d82d558540 2024-08-20T01:38:03.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.945+0000 7f7546ff5640 1 -- 172.21.15.79:0/3279581684 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f755c012ce0 con 0x55d82d558540 2024-08-20T01:38:03.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.945+0000 7f756b55b740 10 client.15825 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:38:03.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.945+0000 7f756b55b740 10 client.15825 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:38:03.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.945+0000 7f756b55b740 20 client.15825 populate_metadata read hostname 'smithi079' 2024-08-20T01:38:03.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.945+0000 7f756b55b740 1 --2- 172.21.15.79:0/3279581684 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55d82d5d3530 0x55d82d5d5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:03.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.945+0000 7f756b55b740 4 client.15825 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:38:03.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.945+0000 7f756b55b740 1 -- 172.21.15.79:0/3279581684 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d82d4bc320 con 0x55d82d5d3530 2024-08-20T01:38:03.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.945+0000 7f756259c640 1 --2- 172.21.15.79:0/3279581684 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55d82d5d3530 0x55d82d5d5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:03.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.946+0000 7f7546ff5640 10 client.15825 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:38:03.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.946+0000 7f756259c640 1 --2- 172.21.15.79:0/3279581684 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55d82d5d3530 0x55d82d5d5950 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a4f78680d963590c server_cookie=346a7b5c23e875a8 in_seq=0 out_seq=0 2024-08-20T01:38:03.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.946+0000 7f7546ff5640 1 -- 172.21.15.79:0/3279581684 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d82d4bc320 con 0x55d82d5d3530 2024-08-20T01:38:03.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.946+0000 7f7546ff5640 10 client.15825 handle_command_reply: tid=0 2024-08-20T01:38:03.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.946+0000 7f756b55b740 1 client.15825 shutdown 2024-08-20T01:38:03.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.946+0000 7f756b55b740 1 -- 172.21.15.79:0/3279581684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d82d558540 msgr2=0x55d82d56f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:03.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.946+0000 7f756b55b740 1 --2- 172.21.15.79:0/3279581684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d82d558540 0x55d82d56f930 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f755c01cfd0 tx=0x7f755c010c40 comp rx=0 tx=0).stop 2024-08-20T01:38:03.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.946+0000 7f756b55b740 1 -- 172.21.15.79:0/3279581684 shutdown_connections 2024-08-20T01:38:03.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.946+0000 7f756b55b740 1 --2- 172.21.15.79:0/3279581684 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55d82d5d3530 0x55d82d5d5950 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.946+0000 7f756b55b740 1 --2- 172.21.15.79:0/3279581684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d82d558540 0x55d82d56f930 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.946+0000 7f756b55b740 1 --2- 172.21.15.79:0/3279581684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d82d5481a0 0x55d82d560a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.946+0000 7f756b55b740 1 --2- 172.21.15.79:0/3279581684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d82d547880 0x55d82d5604b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.946+0000 7f756b55b740 1 -- 172.21.15.79:0/3279581684 >> 172.21.15.79:0/3279581684 conn(0x55d82d5456b0 msgr2=0x55d82d544770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:03.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.947+0000 7f7546ff5640 0 client.15825 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:38:03.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.947+0000 7f756b55b740 1 -- 172.21.15.79:0/3279581684 shutdown_connections 2024-08-20T01:38:03.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.947+0000 7f756b55b740 1 -- 172.21.15.79:0/3279581684 wait complete. 2024-08-20T01:38:03.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.947+0000 7f756b55b740 20 client.15825 trim_cache size 0 max 16384 2024-08-20T01:38:03.955 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:38:03.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.947+0000 7f7569162640 1 -- 172.21.15.79:0/3256369787 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f754c0b3bd0 msgr2=0x7f754c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:03.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.947+0000 7f7569162640 1 --2- 172.21.15.79:0/3256369787 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f754c0b3bd0 0x7f754c0b6090 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f75540e0d00 tx=0x7f755401cce0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.948+0000 7f7569162640 1 -- 172.21.15.79:0/3256369787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7564101990 msgr2=0x7f7564074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:03.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.948+0000 7f7569162640 1 --2- 172.21.15.79:0/3256369787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7564101990 0x7f7564074970 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f755400b4a0 tx=0x7f755400b960 comp rx=0 tx=0).stop 2024-08-20T01:38:03.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.948+0000 7f7569162640 1 -- 172.21.15.79:0/3256369787 shutdown_connections 2024-08-20T01:38:03.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.948+0000 7f7569162640 1 --2- 172.21.15.79:0/3256369787 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f754c0b3bd0 0x7f754c0b6090 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.948+0000 7f7569162640 1 --2- 172.21.15.79:0/3256369787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7564107d20 0x7f756406fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.948+0000 7f7569162640 1 --2- 172.21.15.79:0/3256369787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75641073a0 0x7f756406f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.948+0000 7f7569162640 1 --2- 172.21.15.79:0/3256369787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7564101990 0x7f7564074970 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:03.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.948+0000 7f7569162640 1 -- 172.21.15.79:0/3256369787 >> 172.21.15.79:0/3256369787 conn(0x7f75640fd400 msgr2=0x7f75640ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:03.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.948+0000 7f7569162640 1 -- 172.21.15.79:0/3256369787 shutdown_connections 2024-08-20T01:38:03.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:03.948+0000 7f7569162640 1 -- 172.21.15.79:0/3256369787 wait complete. 2024-08-20T01:38:04.089 INFO:tasks.workunit.client.0.smithi079.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2024-08-20T01:38:04.094 INFO:tasks.workunit.client.0.smithi079.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2024-08-20T01:38:04.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:04 smithi079 ceph-mon[18656]: pgmap v369: 97 pgs: 97 active+clean; 5.9 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 560 KiB/s wr, 126 op/s 2024-08-20T01:38:04.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:04 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:38:04.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:04 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:38:04.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:04 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:38:04.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:04 smithi081 ceph-mon[22209]: pgmap v369: 97 pgs: 97 active+clean; 5.9 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 560 KiB/s wr, 126 op/s 2024-08-20T01:38:04.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:04 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:38:04.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:04 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:38:04.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:04 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:38:04.284 INFO:tasks.workunit.client.0.smithi079.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2024-08-20T01:38:04.290 INFO:tasks.workunit.client.0.smithi079.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2024-08-20T01:38:04.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:04 smithi175 ceph-mon[22392]: pgmap v369: 97 pgs: 97 active+clean; 5.9 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 560 KiB/s wr, 126 op/s 2024-08-20T01:38:04.391 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:04 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:38:04.391 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:04 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:38:04.391 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:04 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:38:04.498 INFO:tasks.workunit.client.0.smithi079.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2024-08-20T01:38:04.502 INFO:tasks.workunit.client.0.smithi079.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2024-08-20T01:38:04.588 INFO:tasks.workunit.client.0.smithi079.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2024-08-20T01:38:04.594 INFO:tasks.workunit.client.0.smithi079.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2024-08-20T01:38:04.682 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:04.680+0000 7ff83bfff640 1 -- 172.21.15.79:0/2629747012 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5587e7ba5d50 con 0x5587e7cb5f00 2024-08-20T01:38:04.682 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:04.680+0000 7ff83bfff640 10 client.15807 handle_command_reply: tid=0 2024-08-20T01:38:04.682 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:04.680+0000 7ff865bff740 1 client.15807 shutdown 2024-08-20T01:38:04.682 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:04.681+0000 7ff865bff740 1 -- 172.21.15.79:0/2629747012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587e7c3ac40 msgr2=0x5587e7c45940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:04.682 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:04.681+0000 7ff865bff740 1 --2- 172.21.15.79:0/2629747012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587e7c3ac40 0x5587e7c45940 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x5587e7c3e5e0 tx=0x7ff848003c70 comp rx=0 tx=0).stop 2024-08-20T01:38:04.683 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:04.681+0000 7ff865bff740 1 -- 172.21.15.79:0/2629747012 shutdown_connections 2024-08-20T01:38:04.683 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:04.681+0000 7ff865bff740 1 --2- 172.21.15.79:0/2629747012 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5587e7cb5f00 0x5587e7cb8320 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:04.683 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:04.681+0000 7ff865bff740 1 --2- 172.21.15.79:0/2629747012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587e7c3b020 0x5587e7c45ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:04.683 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:04.681+0000 7ff865bff740 1 --2- 172.21.15.79:0/2629747012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587e7c3ac40 0x5587e7c45940 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:04.683 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:04.681+0000 7ff83bfff640 0 client.15807 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:04.683 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:04.681+0000 7ff865bff740 1 --2- 172.21.15.79:0/2629747012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e7c358d0 0x5587e7c46c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:04.683 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:04.681+0000 7ff865bff740 1 -- 172.21.15.79:0/2629747012 >> 172.21.15.79:0/2629747012 conn(0x5587e7c30a20 msgr2=0x5587e7c3f100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:04.683 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:04.681+0000 7ff865bff740 1 -- 172.21.15.79:0/2629747012 shutdown_connections 2024-08-20T01:38:04.683 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:04.681+0000 7ff865bff740 1 -- 172.21.15.79:0/2629747012 wait complete. 2024-08-20T01:38:04.683 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:04.681+0000 7ff865bff740 20 client.15807 trim_cache size 0 max 16384 2024-08-20T01:38:04.684 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:38:04.684 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:38:04.684 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:38:04.684 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:38:04.685 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:04.682+0000 7ff862e13640 1 -- 172.21.15.79:0/1381934234 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff84c0b3bd0 msgr2=0x7ff84c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:04.685 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:04.682+0000 7ff862e13640 1 --2- 172.21.15.79:0/1381934234 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff84c0b3bd0 0x7ff84c0b6090 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff854005e30 tx=0x7ff8540317b0 comp rx=0 tx=0).stop 2024-08-20T01:38:04.685 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:04.682+0000 7ff862e13640 1 -- 172.21.15.79:0/1381934234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff85c101560 msgr2=0x7ff85c197830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:04.685 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:04.682+0000 7ff862e13640 1 --2- 172.21.15.79:0/1381934234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff85c101560 0x7ff85c197830 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ff850009860 tx=0x7ff850009d20 comp rx=0 tx=0).stop 2024-08-20T01:38:04.685 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:04.682+0000 7ff862e13640 1 -- 172.21.15.79:0/1381934234 shutdown_connections 2024-08-20T01:38:04.685 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:04.682+0000 7ff862e13640 1 --2- 172.21.15.79:0/1381934234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff85c103070 0x7ff85c198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:04.685 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:04.682+0000 7ff862e13640 1 --2- 172.21.15.79:0/1381934234 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff84c0b3bd0 0x7ff84c0b6090 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:04.685 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:04.682+0000 7ff862e13640 1 --2- 172.21.15.79:0/1381934234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff85c1026b0 0x7ff85c197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:04.685 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:04.682+0000 7ff862e13640 1 --2- 172.21.15.79:0/1381934234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff85c101560 0x7ff85c197830 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:04.685 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:04.682+0000 7ff862e13640 1 -- 172.21.15.79:0/1381934234 >> 172.21.15.79:0/1381934234 conn(0x7ff85c0fce40 msgr2=0x7ff85c105ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:04.685 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:04.682+0000 7ff862e13640 1 -- 172.21.15.79:0/1381934234 shutdown_connections 2024-08-20T01:38:04.686 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:04.682+0000 7ff862e13640 1 -- 172.21.15.79:0/1381934234 wait complete. 2024-08-20T01:38:04.704 INFO:tasks.workunit.client.0.smithi079.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2024-08-20T01:38:04.709 INFO:tasks.workunit.client.0.smithi079.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2024-08-20T01:38:04.769 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-20T01:38:04.842 INFO:tasks.workunit.client.0.smithi079.stdout:mv -f .deps/util.Tpo .deps/util.Po 2024-08-20T01:38:04.848 INFO:tasks.workunit.client.0.smithi079.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2024-08-20T01:38:04.891 INFO:tasks.workunit.client.0.smithi079.stderr:In file included from parser.h:22, 2024-08-20T01:38:04.891 INFO:tasks.workunit.client.0.smithi079.stderr: from parser.c:25: 2024-08-20T01:38:04.891 INFO:tasks.workunit.client.0.smithi079.stderr:parser.c: In function ‘init_filesys’: 2024-08-20T01:38:04.892 INFO:tasks.workunit.client.0.smithi079.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-08-20T01:38:04.893 INFO:tasks.workunit.client.0.smithi079.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-08-20T01:38:04.893 INFO:tasks.workunit.client.0.smithi079.stderr: | ^ 2024-08-20T01:38:04.893 INFO:tasks.workunit.client.0.smithi079.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-08-20T01:38:04.893 INFO:tasks.workunit.client.0.smithi079.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-08-20T01:38:04.893 INFO:tasks.workunit.client.0.smithi079.stderr: | ^~~~~~~~ 2024-08-20T01:38:04.893 INFO:tasks.workunit.client.0.smithi079.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-08-20T01:38:04.893 INFO:tasks.workunit.client.0.smithi079.stderr: 36 | container_of(ptr, type, member) 2024-08-20T01:38:04.893 INFO:tasks.workunit.client.0.smithi079.stderr: | ^~~~~~~~~~~~ 2024-08-20T01:38:04.893 INFO:tasks.workunit.client.0.smithi079.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-08-20T01:38:04.893 INFO:tasks.workunit.client.0.smithi079.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-08-20T01:38:04.893 INFO:tasks.workunit.client.0.smithi079.stderr: | ^~~~~~~~~~ 2024-08-20T01:38:04.893 INFO:tasks.workunit.client.0.smithi079.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-08-20T01:38:04.894 INFO:tasks.workunit.client.0.smithi079.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-08-20T01:38:04.894 INFO:tasks.workunit.client.0.smithi079.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-08-20T01:38:04.894 INFO:tasks.workunit.client.0.smithi079.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-08-20T01:38:04.894 INFO:tasks.workunit.client.0.smithi079.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-08-20T01:38:04.894 INFO:tasks.workunit.client.0.smithi079.stderr: | ^ 2024-08-20T01:38:04.894 INFO:tasks.workunit.client.0.smithi079.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-08-20T01:38:04.894 INFO:tasks.workunit.client.0.smithi079.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-08-20T01:38:04.894 INFO:tasks.workunit.client.0.smithi079.stderr: | ^~~~~~~~ 2024-08-20T01:38:04.894 INFO:tasks.workunit.client.0.smithi079.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-08-20T01:38:04.894 INFO:tasks.workunit.client.0.smithi079.stderr: 36 | container_of(ptr, type, member) 2024-08-20T01:38:04.894 INFO:tasks.workunit.client.0.smithi079.stderr: | ^~~~~~~~~~~~ 2024-08-20T01:38:04.895 INFO:tasks.workunit.client.0.smithi079.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-08-20T01:38:04.895 INFO:tasks.workunit.client.0.smithi079.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-08-20T01:38:04.895 INFO:tasks.workunit.client.0.smithi079.stderr: | ^~~~~~~~~~ 2024-08-20T01:38:04.895 INFO:tasks.workunit.client.0.smithi079.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-08-20T01:38:04.895 INFO:tasks.workunit.client.0.smithi079.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-08-20T01:38:04.895 INFO:tasks.workunit.client.0.smithi079.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-08-20T01:38:04.895 INFO:tasks.workunit.client.0.smithi079.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-08-20T01:38:04.895 INFO:tasks.workunit.client.0.smithi079.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-08-20T01:38:04.895 INFO:tasks.workunit.client.0.smithi079.stderr: | ^ 2024-08-20T01:38:04.895 INFO:tasks.workunit.client.0.smithi079.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-08-20T01:38:04.895 INFO:tasks.workunit.client.0.smithi079.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-08-20T01:38:04.895 INFO:tasks.workunit.client.0.smithi079.stderr: | ^~~~~~~~ 2024-08-20T01:38:04.896 INFO:tasks.workunit.client.0.smithi079.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-08-20T01:38:04.896 INFO:tasks.workunit.client.0.smithi079.stderr: 36 | container_of(ptr, type, member) 2024-08-20T01:38:04.896 INFO:tasks.workunit.client.0.smithi079.stderr: | ^~~~~~~~~~~~ 2024-08-20T01:38:04.896 INFO:tasks.workunit.client.0.smithi079.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-08-20T01:38:04.896 INFO:tasks.workunit.client.0.smithi079.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-08-20T01:38:04.896 INFO:tasks.workunit.client.0.smithi079.stderr: | ^~~~~~~~~~ 2024-08-20T01:38:04.896 INFO:tasks.workunit.client.0.smithi079.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-08-20T01:38:04.896 INFO:tasks.workunit.client.0.smithi079.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-08-20T01:38:04.896 INFO:tasks.workunit.client.0.smithi079.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-08-20T01:38:04.896 INFO:tasks.workunit.client.0.smithi079.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-08-20T01:38:04.896 INFO:tasks.workunit.client.0.smithi079.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-08-20T01:38:04.896 INFO:tasks.workunit.client.0.smithi079.stderr: | ^ 2024-08-20T01:38:04.897 INFO:tasks.workunit.client.0.smithi079.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-08-20T01:38:04.897 INFO:tasks.workunit.client.0.smithi079.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-08-20T01:38:04.897 INFO:tasks.workunit.client.0.smithi079.stderr: | ^~~~~~~~ 2024-08-20T01:38:04.897 INFO:tasks.workunit.client.0.smithi079.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-08-20T01:38:04.897 INFO:tasks.workunit.client.0.smithi079.stderr: 36 | container_of(ptr, type, member) 2024-08-20T01:38:04.897 INFO:tasks.workunit.client.0.smithi079.stderr: | ^~~~~~~~~~~~ 2024-08-20T01:38:04.897 INFO:tasks.workunit.client.0.smithi079.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-08-20T01:38:04.897 INFO:tasks.workunit.client.0.smithi079.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-08-20T01:38:04.897 INFO:tasks.workunit.client.0.smithi079.stderr: | ^~~~~~~~~~ 2024-08-20T01:38:04.897 INFO:tasks.workunit.client.0.smithi079.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-08-20T01:38:04.897 INFO:tasks.workunit.client.0.smithi079.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-08-20T01:38:04.897 INFO:tasks.workunit.client.0.smithi079.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-08-20T01:38:04.898 INFO:tasks.workunit.client.0.smithi079.stderr:parser.c: In function ‘init_tg_stats’: 2024-08-20T01:38:04.898 INFO:tasks.workunit.client.0.smithi079.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-08-20T01:38:04.898 INFO:tasks.workunit.client.0.smithi079.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-08-20T01:38:04.898 INFO:tasks.workunit.client.0.smithi079.stderr: | ^ 2024-08-20T01:38:04.898 INFO:tasks.workunit.client.0.smithi079.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-08-20T01:38:04.898 INFO:tasks.workunit.client.0.smithi079.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-08-20T01:38:04.898 INFO:tasks.workunit.client.0.smithi079.stderr: | ^~~~~~~~ 2024-08-20T01:38:04.898 INFO:tasks.workunit.client.0.smithi079.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-08-20T01:38:04.898 INFO:tasks.workunit.client.0.smithi079.stderr: 36 | container_of(ptr, type, member) 2024-08-20T01:38:04.898 INFO:tasks.workunit.client.0.smithi079.stderr: | ^~~~~~~~~~~~ 2024-08-20T01:38:04.898 INFO:tasks.workunit.client.0.smithi079.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-08-20T01:38:04.898 INFO:tasks.workunit.client.0.smithi079.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-08-20T01:38:04.899 INFO:tasks.workunit.client.0.smithi079.stderr: | ^~~~~~~~~~ 2024-08-20T01:38:04.899 INFO:tasks.workunit.client.0.smithi079.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-08-20T01:38:04.899 INFO:tasks.workunit.client.0.smithi079.stderr: 971 | list_for_each_entry(tmp_list, 2024-08-20T01:38:04.899 INFO:tasks.workunit.client.0.smithi079.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-08-20T01:38:04.899 INFO:tasks.workunit.client.0.smithi079.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-08-20T01:38:04.899 INFO:tasks.workunit.client.0.smithi079.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-08-20T01:38:04.899 INFO:tasks.workunit.client.0.smithi079.stderr: | ^ 2024-08-20T01:38:04.899 INFO:tasks.workunit.client.0.smithi079.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-08-20T01:38:04.899 INFO:tasks.workunit.client.0.smithi079.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-08-20T01:38:04.899 INFO:tasks.workunit.client.0.smithi079.stderr: | ^~~~~~~~ 2024-08-20T01:38:04.899 INFO:tasks.workunit.client.0.smithi079.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-08-20T01:38:04.900 INFO:tasks.workunit.client.0.smithi079.stderr: 36 | container_of(ptr, type, member) 2024-08-20T01:38:04.900 INFO:tasks.workunit.client.0.smithi079.stderr: | ^~~~~~~~~~~~ 2024-08-20T01:38:04.900 INFO:tasks.workunit.client.0.smithi079.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-08-20T01:38:04.900 INFO:tasks.workunit.client.0.smithi079.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-08-20T01:38:04.900 INFO:tasks.workunit.client.0.smithi079.stderr: | ^~~~~~~~~~ 2024-08-20T01:38:04.900 INFO:tasks.workunit.client.0.smithi079.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-08-20T01:38:04.900 INFO:tasks.workunit.client.0.smithi079.stderr: 971 | list_for_each_entry(tmp_list, 2024-08-20T01:38:04.900 INFO:tasks.workunit.client.0.smithi079.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-08-20T01:38:04.900 INFO:tasks.workunit.client.0.smithi079.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-08-20T01:38:04.900 INFO:tasks.workunit.client.0.smithi079.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-08-20T01:38:04.900 INFO:tasks.workunit.client.0.smithi079.stderr: | ^ 2024-08-20T01:38:04.900 INFO:tasks.workunit.client.0.smithi079.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-08-20T01:38:04.901 INFO:tasks.workunit.client.0.smithi079.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-08-20T01:38:04.901 INFO:tasks.workunit.client.0.smithi079.stderr: | ^~~~~~~~ 2024-08-20T01:38:04.901 INFO:tasks.workunit.client.0.smithi079.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-08-20T01:38:04.901 INFO:tasks.workunit.client.0.smithi079.stderr: 36 | container_of(ptr, type, member) 2024-08-20T01:38:04.901 INFO:tasks.workunit.client.0.smithi079.stderr: | ^~~~~~~~~~~~ 2024-08-20T01:38:04.901 INFO:tasks.workunit.client.0.smithi079.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-08-20T01:38:04.901 INFO:tasks.workunit.client.0.smithi079.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-08-20T01:38:04.901 INFO:tasks.workunit.client.0.smithi079.stderr: | ^~~~~~~~~~ 2024-08-20T01:38:04.901 INFO:tasks.workunit.client.0.smithi079.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-08-20T01:38:04.901 INFO:tasks.workunit.client.0.smithi079.stderr: 980 | list_for_each_entry(tmp_list, 2024-08-20T01:38:04.901 INFO:tasks.workunit.client.0.smithi079.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-08-20T01:38:04.901 INFO:tasks.workunit.client.0.smithi079.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-08-20T01:38:04.901 INFO:tasks.workunit.client.0.smithi079.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-08-20T01:38:04.902 INFO:tasks.workunit.client.0.smithi079.stderr: | ^ 2024-08-20T01:38:04.902 INFO:tasks.workunit.client.0.smithi079.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-08-20T01:38:04.902 INFO:tasks.workunit.client.0.smithi079.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-08-20T01:38:04.902 INFO:tasks.workunit.client.0.smithi079.stderr: | ^~~~~~~~ 2024-08-20T01:38:04.902 INFO:tasks.workunit.client.0.smithi079.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-08-20T01:38:04.902 INFO:tasks.workunit.client.0.smithi079.stderr: 36 | container_of(ptr, type, member) 2024-08-20T01:38:04.902 INFO:tasks.workunit.client.0.smithi079.stderr: | ^~~~~~~~~~~~ 2024-08-20T01:38:04.902 INFO:tasks.workunit.client.0.smithi079.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-08-20T01:38:04.902 INFO:tasks.workunit.client.0.smithi079.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-08-20T01:38:04.902 INFO:tasks.workunit.client.0.smithi079.stderr: | ^~~~~~~~~~ 2024-08-20T01:38:04.902 INFO:tasks.workunit.client.0.smithi079.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-08-20T01:38:04.902 INFO:tasks.workunit.client.0.smithi079.stderr: 980 | list_for_each_entry(tmp_list, 2024-08-20T01:38:04.903 INFO:tasks.workunit.client.0.smithi079.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-08-20T01:38:04.944 INFO:tasks.workunit.client.0.smithi079.stderr:parser.c: In function ‘get_optstr’: 2024-08-20T01:38:04.944 INFO:tasks.workunit.client.0.smithi079.stderr:parser.c:206:23: warning: ‘strnlen’ specified bound 4095 exceeds source size 1024 [-Wstringop-overread] 2024-08-20T01:38:04.945 INFO:tasks.workunit.client.0.smithi079.stderr: 206 | len = strnlen(temp, 4095) + 1; 2024-08-20T01:38:04.945 INFO:tasks.workunit.client.0.smithi079.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-08-20T01:38:04.945 INFO:tasks.workunit.client.0.smithi079.stderr:parser.c:200:14: note: source object declared here 2024-08-20T01:38:04.945 INFO:tasks.workunit.client.0.smithi079.stderr: 200 | char temp[BUFSIZE]; 2024-08-20T01:38:04.945 INFO:tasks.workunit.client.0.smithi079.stderr: | ^~~~ 2024-08-20T01:38:04.951 INFO:tasks.workunit.client.0.smithi079.stderr:parser.c: In function ‘size64_convert’: 2024-08-20T01:38:04.951 INFO:tasks.workunit.client.0.smithi079.stderr:parser.c:119:9: warning: ‘memcpy’ reading 3 bytes from a region of size 2 [-Wstringop-overread] 2024-08-20T01:38:04.951 INFO:tasks.workunit.client.0.smithi079.stderr: 119 | memcpy(unit, "\0", 3); 2024-08-20T01:38:04.951 INFO:tasks.workunit.client.0.smithi079.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-08-20T01:38:05.070 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:38:05.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:05 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:38:05.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:05 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:38:05.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:05 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:38:05.263 INFO:tasks.workunit.client.0.smithi079.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2024-08-20T01:38:05.268 INFO:tasks.workunit.client.0.smithi079.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2024-08-20T01:38:05.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:05 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:38:05.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:05 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:38:05.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:05 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:38:05.347 INFO:tasks.workunit.client.0.smithi079.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2024-08-20T01:38:05.352 INFO:tasks.workunit.client.0.smithi079.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2024-08-20T01:38:05.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:05 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:38:05.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:05 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:38:05.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:05 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:38:05.471 INFO:tasks.workunit.client.0.smithi079.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2024-08-20T01:38:05.476 INFO:tasks.workunit.client.0.smithi079.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2024-08-20T01:38:05.515 INFO:tasks.workunit.client.0.smithi079.stdout:mv -f .deps/list.Tpo .deps/list.Po 2024-08-20T01:38:05.520 INFO:tasks.workunit.client.0.smithi079.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2024-08-20T01:38:05.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.600+0000 7fe713b74640 1 -- 172.21.15.79:0/3722118079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe70c107d40 msgr2=0x7fe70c10e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:05.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.600+0000 7fe713b74640 1 --2- 172.21.15.79:0/3722118079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe70c107d40 0x7fe70c10e540 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fe704009ca0 tx=0x7fe70402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:38:05.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.600+0000 7fe713b74640 1 -- 172.21.15.79:0/3722118079 shutdown_connections 2024-08-20T01:38:05.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.600+0000 7fe713b74640 1 --2- 172.21.15.79:0/3722118079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe70c107d40 0x7fe70c10e540 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:05.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.600+0000 7fe713b74640 1 --2- 172.21.15.79:0/3722118079 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe70c1073c0 0x7fe70c107800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:05.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.600+0000 7fe713b74640 1 --2- 172.21.15.79:0/3722118079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe70c1019b0 0x7fe70c101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:05.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.600+0000 7fe713b74640 1 -- 172.21.15.79:0/3722118079 >> 172.21.15.79:0/3722118079 conn(0x7fe70c0fd460 msgr2=0x7fe70c0ff880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:05.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.600+0000 7fe713b74640 1 -- 172.21.15.79:0/3722118079 shutdown_connections 2024-08-20T01:38:05.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.601+0000 7fe713b74640 1 -- 172.21.15.79:0/3722118079 wait complete. 2024-08-20T01:38:05.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.601+0000 7fe713b74640 1 Processor -- start 2024-08-20T01:38:05.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.601+0000 7fe713b74640 1 -- start start 2024-08-20T01:38:05.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.602+0000 7fe713b74640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe70c1019b0 0x7fe70c197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:05.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.602+0000 7fe713b74640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe70c1073c0 0x7fe70c198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:05.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.602+0000 7fe713b74640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe70c107d40 0x7fe70c19d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:05.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.602+0000 7fe713b74640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe70c111900 con 0x7fe70c1019b0 2024-08-20T01:38:05.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.602+0000 7fe713b74640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe70c111780 con 0x7fe70c107d40 2024-08-20T01:38:05.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.602+0000 7fe713b74640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe70c111a80 con 0x7fe70c1073c0 2024-08-20T01:38:05.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.602+0000 7fe711910640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe70c1019b0 0x7fe70c197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:05.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.602+0000 7fe711910640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe70c1019b0 0x7fe70c197dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35538/0 (socket says 172.21.15.79:35538) 2024-08-20T01:38:05.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.602+0000 7fe711910640 1 -- 172.21.15.79:0/2188488980 learned_addr learned my addr 172.21.15.79:0/2188488980 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:05.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.602+0000 7fe712111640 1 --2- 172.21.15.79:0/2188488980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe70c107d40 0x7fe70c19d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:05.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.602+0000 7fe71110f640 1 --2- 172.21.15.79:0/2188488980 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe70c1073c0 0x7fe70c198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:05.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.602+0000 7fe711910640 1 -- 172.21.15.79:0/2188488980 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe70c1073c0 msgr2=0x7fe70c198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:05.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.602+0000 7fe711910640 1 --2- 172.21.15.79:0/2188488980 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe70c1073c0 0x7fe70c198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:05.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.602+0000 7fe711910640 1 -- 172.21.15.79:0/2188488980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe70c107d40 msgr2=0x7fe70c19d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:05.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.602+0000 7fe711910640 1 --2- 172.21.15.79:0/2188488980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe70c107d40 0x7fe70c19d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:05.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.602+0000 7fe711910640 1 -- 172.21.15.79:0/2188488980 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe70c19de80 con 0x7fe70c1019b0 2024-08-20T01:38:05.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.602+0000 7fe711910640 1 --2- 172.21.15.79:0/2188488980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe70c1019b0 0x7fe70c197dd0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fe70800d950 tx=0x7fe70800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:05.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.602+0000 7fe702ffd640 1 -- 172.21.15.79:0/2188488980 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe708017030 con 0x7fe70c1019b0 2024-08-20T01:38:05.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.602+0000 7fe702ffd640 1 -- 172.21.15.79:0/2188488980 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe708004020 con 0x7fe70c1019b0 2024-08-20T01:38:05.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.602+0000 7fe713b74640 1 -- 172.21.15.79:0/2188488980 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe70c19e110 con 0x7fe70c1019b0 2024-08-20T01:38:05.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.602+0000 7fe702ffd640 1 -- 172.21.15.79:0/2188488980 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7080055d0 con 0x7fe70c1019b0 2024-08-20T01:38:05.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.602+0000 7fe713b74640 1 -- 172.21.15.79:0/2188488980 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe70c06afd0 con 0x7fe70c1019b0 2024-08-20T01:38:05.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.605+0000 7fe715f6d740 1 Processor -- start 2024-08-20T01:38:05.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.606+0000 7fe715f6d740 1 -- start start 2024-08-20T01:38:05.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.606+0000 7fe702ffd640 1 -- 172.21.15.79:0/2188488980 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fe7080047a0 con 0x7fe70c1019b0 2024-08-20T01:38:05.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.606+0000 7fe715f6d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56183899d880 0x56183899dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:05.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.606+0000 7fe715f6d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56183899e1a0 0x5618389a9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:05.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.606+0000 7fe715f6d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618389aa130 0x5618389ac520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:05.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.606+0000 7fe715f6d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561838914930 con 0x56183899e1a0 2024-08-20T01:38:05.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.606+0000 7fe715f6d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561838903e30 con 0x5618389aa130 2024-08-20T01:38:05.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.606+0000 7fe715f6d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561838907e70 con 0x56183899d880 2024-08-20T01:38:05.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.606+0000 7fe711910640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56183899e1a0 0x5618389a9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:05.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.606+0000 7fe711910640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56183899e1a0 0x5618389a9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35544/0 (socket says 172.21.15.79:35544) 2024-08-20T01:38:05.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.606+0000 7fe711910640 1 -- 172.21.15.79:0/71831205 learned_addr learned my addr 172.21.15.79:0/71831205 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:05.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.606+0000 7fe712111640 1 --2- 172.21.15.79:0/71831205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56183899d880 0x56183899dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:05.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.606+0000 7fe71110f640 1 --2- 172.21.15.79:0/71831205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618389aa130 0x5618389ac520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:05.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.607+0000 7fe711910640 1 -- 172.21.15.79:0/71831205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56183899d880 msgr2=0x56183899dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:05.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.607+0000 7fe711910640 1 --2- 172.21.15.79:0/71831205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56183899d880 0x56183899dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:05.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.607+0000 7fe711910640 1 -- 172.21.15.79:0/71831205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618389aa130 msgr2=0x5618389ac520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:05.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.607+0000 7fe711910640 1 --2- 172.21.15.79:0/71831205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618389aa130 0x5618389ac520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:05.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.607+0000 7fe711910640 1 -- 172.21.15.79:0/71831205 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561838663650 con 0x56183899e1a0 2024-08-20T01:38:05.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.607+0000 7fe702ffd640 1 --2- 172.21.15.79:0/2188488980 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe6f80b3bd0 0x7fe6f80b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:05.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.607+0000 7fe711910640 1 --2- 172.21.15.79:0/71831205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56183899e1a0 0x5618389a9bf0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fe7080e9ab0 tx=0x7fe7080e9f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fa8917029286736 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:05.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.607+0000 7fe712111640 1 --2- 172.21.15.79:0/2188488980 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe6f80b3bd0 0x7fe6f80b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:05.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.607+0000 7fe702ffd640 1 -- 172.21.15.79:0/2188488980 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fe7080e36a0 con 0x7fe70c1019b0 2024-08-20T01:38:05.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.607+0000 7fe6f7fff640 1 -- 172.21.15.79:0/71831205 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7080a64c0 con 0x56183899e1a0 2024-08-20T01:38:05.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.607+0000 7fe6f7fff640 1 -- 172.21.15.79:0/71831205 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe7080aa110 con 0x56183899e1a0 2024-08-20T01:38:05.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.607+0000 7fe6f7fff640 1 -- 172.21.15.79:0/71831205 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7080a9d70 con 0x56183899e1a0 2024-08-20T01:38:05.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.608+0000 7fe715f6d740 1 -- 172.21.15.79:0/71831205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56183899e1a0 msgr2=0x5618389a9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:05.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.608+0000 7fe712111640 1 --2- 172.21.15.79:0/2188488980 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe6f80b3bd0 0x7fe6f80b6090 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe704006010 tx=0x7fe704005fa0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:05.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.608+0000 7fe715f6d740 1 --2- 172.21.15.79:0/71831205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56183899e1a0 0x5618389a9bf0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fe7080e9ab0 tx=0x7fe7080e9f70 comp rx=0 tx=0).stop 2024-08-20T01:38:05.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.608+0000 7fe715f6d740 1 -- 172.21.15.79:0/71831205 shutdown_connections 2024-08-20T01:38:05.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.608+0000 7fe715f6d740 1 --2- 172.21.15.79:0/71831205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618389aa130 0x5618389ac520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:05.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.608+0000 7fe715f6d740 1 --2- 172.21.15.79:0/71831205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56183899e1a0 0x5618389a9bf0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:05.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.608+0000 7fe715f6d740 1 --2- 172.21.15.79:0/71831205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56183899d880 0x56183899dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:05.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.608+0000 7fe715f6d740 1 -- 172.21.15.79:0/71831205 >> 172.21.15.79:0/71831205 conn(0x56183899b6b0 msgr2=0x56183899c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:05.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.608+0000 7fe715f6d740 1 -- 172.21.15.79:0/71831205 shutdown_connections 2024-08-20T01:38:05.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.608+0000 7fe715f6d740 1 -- 172.21.15.79:0/71831205 wait complete. 2024-08-20T01:38:05.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.609+0000 7fe715f6d740 1 -- start start 2024-08-20T01:38:05.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.609+0000 7fe715f6d740 1 Processor -- start 2024-08-20T01:38:05.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.609+0000 7fe715f6d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56183899d880 0x5618389a7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:05.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.609+0000 7fe715f6d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56183899e1a0 0x5618389a7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:05.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.609+0000 7fe715f6d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618389aa130 0x5618389a7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:05.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.609+0000 7fe715f6d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561838766700 con 0x56183899d880 2024-08-20T01:38:05.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.609+0000 7fe715f6d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56183888a810 con 0x56183899e1a0 2024-08-20T01:38:05.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.609+0000 7fe715f6d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5618389acde0 con 0x5618389aa130 2024-08-20T01:38:05.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.609+0000 7fe715f6d740 10 client.0 _ll_register_callbacks cb 0x5618388fd700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:05.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.609+0000 7fe711910640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56183899d880 0x5618389a7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:05.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.609+0000 7fe711910640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56183899d880 0x5618389a7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35550/0 (socket says 172.21.15.79:35550) 2024-08-20T01:38:05.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.609+0000 7fe711910640 1 -- 172.21.15.79:0/42210662 learned_addr learned my addr 172.21.15.79:0/42210662 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:05.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.609+0000 7fe71110f640 1 --2- 172.21.15.79:0/42210662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56183899e1a0 0x5618389a7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:05.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.610+0000 7fe712111640 1 --2- 172.21.15.79:0/42210662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618389aa130 0x5618389a7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:05.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.610+0000 7fe711910640 1 -- 172.21.15.79:0/42210662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618389aa130 msgr2=0x5618389a7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:05.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.610+0000 7fe711910640 1 --2- 172.21.15.79:0/42210662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618389aa130 0x5618389a7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:05.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.610+0000 7fe711910640 1 -- 172.21.15.79:0/42210662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56183899e1a0 msgr2=0x5618389a7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:05.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.610+0000 7fe711910640 1 --2- 172.21.15.79:0/42210662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56183899e1a0 0x5618389a7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:05.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.610+0000 7fe711910640 1 -- 172.21.15.79:0/42210662 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618389b61e0 con 0x56183899d880 2024-08-20T01:38:05.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.610+0000 7fe711910640 1 --2- 172.21.15.79:0/42210662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56183899d880 0x5618389a7110 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fe7080e9a80 tx=0x7fe70800df40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1f7d71024b40df4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:05.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.610+0000 7fe6f57fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:38:05.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.610+0000 7fe6f57fa640 1 -- 172.21.15.79:0/42210662 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7080a9f50 con 0x56183899d880 2024-08-20T01:38:05.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.610+0000 7fe6f57fa640 1 -- 172.21.15.79:0/42210662 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fe7080041d0 con 0x56183899d880 2024-08-20T01:38:05.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.610+0000 7fe715f6d740 1 -- 172.21.15.79:0/42210662 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5618388b3150 con 0x56183899d880 2024-08-20T01:38:05.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.610+0000 7fe6f57fa640 1 -- 172.21.15.79:0/42210662 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe7080aa3d0 con 0x56183899d880 2024-08-20T01:38:05.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.610+0000 7fe715f6d740 10 client.15837 fetch_fsmap learned FSMap version 28 2024-08-20T01:38:05.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.610+0000 7fe715f6d740 1 -- 172.21.15.79:0/42210662 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5618389b8b90 con 0x56183899d880 2024-08-20T01:38:05.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.611+0000 7fe6f57fa640 1 -- 172.21.15.79:0/42210662 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5618388b3150 con 0x56183899d880 2024-08-20T01:38:05.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.611+0000 7fe6f57fa640 1 -- 172.21.15.79:0/42210662 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe7080aa860 con 0x56183899d880 2024-08-20T01:38:05.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.611+0000 7fe715f6d740 10 client.15837 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:38:05.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.611+0000 7fe715f6d740 10 client.15837 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:38:05.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.611+0000 7fe715f6d740 20 client.15837 populate_metadata read hostname 'smithi079' 2024-08-20T01:38:05.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.611+0000 7fe715f6d740 1 --2- 172.21.15.79:0/42210662 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5618389b9ee0 0x5618389bc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:05.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.611+0000 7fe715f6d740 4 client.15837 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:38:05.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.611+0000 7fe715f6d740 1 -- 172.21.15.79:0/42210662 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561838916880 con 0x5618389b9ee0 2024-08-20T01:38:05.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.612+0000 7fe71110f640 1 --2- 172.21.15.79:0/42210662 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5618389b9ee0 0x5618389bc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:05.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.612+0000 7fe6f57fa640 10 client.15837 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:38:05.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.612+0000 7fe71110f640 1 --2- 172.21.15.79:0/42210662 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5618389b9ee0 0x5618389bc2d0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=dd1efa8d452e48b5 server_cookie=c7893478e3867324 in_seq=0 out_seq=0 2024-08-20T01:38:05.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.613+0000 7fe6f57fa640 1 -- 172.21.15.79:0/42210662 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561838916880 con 0x5618389b9ee0 2024-08-20T01:38:05.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.613+0000 7fe6f57fa640 10 client.15837 handle_command_reply: tid=0 2024-08-20T01:38:05.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.613+0000 7fe715f6d740 1 client.15837 shutdown 2024-08-20T01:38:05.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.613+0000 7fe715f6d740 1 -- 172.21.15.79:0/42210662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56183899d880 msgr2=0x5618389a7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:05.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.613+0000 7fe715f6d740 1 --2- 172.21.15.79:0/42210662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56183899d880 0x5618389a7110 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fe7080e9a80 tx=0x7fe70800df40 comp rx=0 tx=0).stop 2024-08-20T01:38:05.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.613+0000 7fe715f6d740 1 -- 172.21.15.79:0/42210662 shutdown_connections 2024-08-20T01:38:05.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.613+0000 7fe715f6d740 1 --2- 172.21.15.79:0/42210662 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5618389b9ee0 0x5618389bc2d0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:05.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.613+0000 7fe715f6d740 1 --2- 172.21.15.79:0/42210662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618389aa130 0x5618389a7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:05.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.613+0000 7fe715f6d740 1 --2- 172.21.15.79:0/42210662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56183899e1a0 0x5618389a7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:05.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.613+0000 7fe6f57fa640 0 client.15837 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:38:05.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.613+0000 7fe715f6d740 1 --2- 172.21.15.79:0/42210662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56183899d880 0x5618389a7110 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:05.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.613+0000 7fe715f6d740 1 -- 172.21.15.79:0/42210662 >> 172.21.15.79:0/42210662 conn(0x56183899b6b0 msgr2=0x5618389a1250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:05.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.613+0000 7fe715f6d740 1 -- 172.21.15.79:0/42210662 shutdown_connections 2024-08-20T01:38:05.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.613+0000 7fe715f6d740 1 -- 172.21.15.79:0/42210662 wait complete. 2024-08-20T01:38:05.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.614+0000 7fe715f6d740 20 client.15837 trim_cache size 0 max 16384 2024-08-20T01:38:05.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.630+0000 7fe715f6d740 1 Processor -- start 2024-08-20T01:38:05.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.630+0000 7fe715f6d740 1 -- start start 2024-08-20T01:38:05.640 INFO:tasks.workunit.client.0.smithi079.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-08-20T01:38:05.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.631+0000 7fe715f6d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56183899d880 0x5618389a1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:05.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.631+0000 7fe715f6d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56183899e1a0 0x5618389bf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:05.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.631+0000 7fe715f6d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618389aa130 0x5618389bf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:05.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.631+0000 7fe715f6d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe70c1ae020 con 0x5618389aa130 2024-08-20T01:38:05.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.631+0000 7fe715f6d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe70c1afb60 con 0x56183899d880 2024-08-20T01:38:05.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.631+0000 7fe715f6d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe70c1ae6f0 con 0x56183899e1a0 2024-08-20T01:38:05.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.631+0000 7fe711910640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56183899d880 0x5618389a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:05.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.631+0000 7fe712111640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618389aa130 0x5618389bf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:05.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.631+0000 7fe711910640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56183899d880 0x5618389a1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:37570/0 (socket says 172.21.15.79:37570) 2024-08-20T01:38:05.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.631+0000 7fe712111640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618389aa130 0x5618389bf830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35562/0 (socket says 172.21.15.79:35562) 2024-08-20T01:38:05.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.631+0000 7fe711910640 1 -- 172.21.15.79:0/2372905702 learned_addr learned my addr 172.21.15.79:0/2372905702 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:05.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.631+0000 7fe71110f640 1 --2- 172.21.15.79:0/2372905702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56183899e1a0 0x5618389bf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:05.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.631+0000 7fe711910640 1 -- 172.21.15.79:0/2372905702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56183899e1a0 msgr2=0x5618389bf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:05.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.631+0000 7fe711910640 1 --2- 172.21.15.79:0/2372905702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56183899e1a0 0x5618389bf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:05.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.631+0000 7fe711910640 1 -- 172.21.15.79:0/2372905702 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618389aa130 msgr2=0x5618389bf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:05.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.631+0000 7fe711910640 1 --2- 172.21.15.79:0/2372905702 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618389aa130 0x5618389bf830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:05.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.631+0000 7fe711910640 1 -- 172.21.15.79:0/2372905702 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56183899c130 con 0x56183899d880 2024-08-20T01:38:05.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.631+0000 7fe711910640 1 --2- 172.21.15.79:0/2372905702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56183899d880 0x5618389a1980 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe7080e9ab0 tx=0x7fe7080aa6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=754f70628f7aa48c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:05.642 INFO:tasks.workunit.client.0.smithi079.stderr:+ cd .. 2024-08-20T01:38:05.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.632+0000 7fe6f77fe640 1 -- 172.21.15.79:0/2372905702 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7080a9f50 con 0x56183899d880 2024-08-20T01:38:05.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.632+0000 7fe6f77fe640 1 -- 172.21.15.79:0/2372905702 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe7080e9320 con 0x56183899d880 2024-08-20T01:38:05.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.632+0000 7fe6f77fe640 1 -- 172.21.15.79:0/2372905702 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7080a9d70 con 0x56183899d880 2024-08-20T01:38:05.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.633+0000 7fe715f6d740 1 -- 172.21.15.79:0/2372905702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56183899d880 msgr2=0x5618389a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:05.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.633+0000 7fe715f6d740 1 --2- 172.21.15.79:0/2372905702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56183899d880 0x5618389a1980 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe7080e9ab0 tx=0x7fe7080aa6a0 comp rx=0 tx=0).stop 2024-08-20T01:38:05.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.633+0000 7fe715f6d740 1 -- 172.21.15.79:0/2372905702 shutdown_connections 2024-08-20T01:38:05.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.633+0000 7fe715f6d740 1 --2- 172.21.15.79:0/2372905702 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618389aa130 0x5618389bf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:05.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.633+0000 7fe715f6d740 1 --2- 172.21.15.79:0/2372905702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56183899e1a0 0x5618389bf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:05.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.633+0000 7fe715f6d740 1 --2- 172.21.15.79:0/2372905702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56183899d880 0x5618389a1980 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:05.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.633+0000 7fe715f6d740 1 -- 172.21.15.79:0/2372905702 >> 172.21.15.79:0/2372905702 conn(0x56183899b6b0 msgr2=0x5618389a8f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:05.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.633+0000 7fe715f6d740 1 -- 172.21.15.79:0/2372905702 shutdown_connections 2024-08-20T01:38:05.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.633+0000 7fe715f6d740 1 -- 172.21.15.79:0/2372905702 wait complete. 2024-08-20T01:38:05.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.633+0000 7fe715f6d740 1 -- start start 2024-08-20T01:38:05.644 INFO:tasks.workunit.client.0.smithi079.stderr:+ mkdir tmp 2024-08-20T01:38:05.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.633+0000 7fe715f6d740 1 Processor -- start 2024-08-20T01:38:05.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.633+0000 7fe715f6d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56183899d880 0x5618389bcac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:05.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.633+0000 7fe715f6d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56183899e1a0 0x5618389bd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:05.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.633+0000 7fe715f6d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618389aa130 0x561838a22810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:05.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.634+0000 7fe715f6d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe70c1af490 con 0x56183899e1a0 2024-08-20T01:38:05.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.634+0000 7fe715f6d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe70c1aedc0 con 0x5618389aa130 2024-08-20T01:38:05.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.634+0000 7fe715f6d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe70c1ac000 con 0x56183899d880 2024-08-20T01:38:05.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.634+0000 7fe715f6d740 10 client.0 _ll_register_callbacks cb 0x7fe6fc00b180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:05.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.634+0000 7fe71110f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56183899e1a0 0x5618389bd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:05.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.634+0000 7fe71110f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56183899e1a0 0x5618389bd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35578/0 (socket says 172.21.15.79:35578) 2024-08-20T01:38:05.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.634+0000 7fe71110f640 1 -- 172.21.15.79:0/2119417885 learned_addr learned my addr 172.21.15.79:0/2119417885 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:05.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.634+0000 7fe711910640 1 --2- 172.21.15.79:0/2119417885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56183899d880 0x5618389bcac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:05.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.634+0000 7fe712111640 1 --2- 172.21.15.79:0/2119417885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618389aa130 0x561838a22810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:05.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.634+0000 7fe71110f640 1 -- 172.21.15.79:0/2119417885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56183899d880 msgr2=0x5618389bcac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:05.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.634+0000 7fe71110f640 1 --2- 172.21.15.79:0/2119417885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56183899d880 0x5618389bcac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:05.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.634+0000 7fe71110f640 1 -- 172.21.15.79:0/2119417885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618389aa130 msgr2=0x561838a22810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:05.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.634+0000 7fe71110f640 1 --2- 172.21.15.79:0/2119417885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618389aa130 0x561838a22810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:05.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.634+0000 7fe71110f640 1 -- 172.21.15.79:0/2119417885 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561838a22f00 con 0x56183899e1a0 2024-08-20T01:38:05.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.634+0000 7fe711910640 1 --2- 172.21.15.79:0/2119417885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56183899d880 0x5618389bcac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:38:05.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.634+0000 7fe71110f640 1 --2- 172.21.15.79:0/2119417885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56183899e1a0 0x5618389bd020 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x56183899d830 tx=0x7fe6fc0157f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=376e21a8e10ff202 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:05.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.634+0000 7fe6f57fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:38:05.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.634+0000 7fe6f57fa640 1 -- 172.21.15.79:0/2119417885 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc025470 con 0x56183899e1a0 2024-08-20T01:38:05.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.634+0000 7fe6f57fa640 1 -- 172.21.15.79:0/2119417885 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fe6fc025610 con 0x56183899e1a0 2024-08-20T01:38:05.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.634+0000 7fe715f6d740 1 -- 172.21.15.79:0/2119417885 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7080e9320 con 0x56183899e1a0 2024-08-20T01:38:05.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.635+0000 7fe6f57fa640 1 -- 172.21.15.79:0/2119417885 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe6fc025810 con 0x56183899e1a0 2024-08-20T01:38:05.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.635+0000 7fe715f6d740 10 client.15843 fetch_fsmap learned FSMap version 28 2024-08-20T01:38:05.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.635+0000 7fe715f6d740 1 -- 172.21.15.79:0/2119417885 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561838a24290 con 0x56183899e1a0 2024-08-20T01:38:05.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.635+0000 7fe6f57fa640 1 -- 172.21.15.79:0/2119417885 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6fc020070 con 0x56183899e1a0 2024-08-20T01:38:05.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.635+0000 7fe6f57fa640 1 -- 172.21.15.79:0/2119417885 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe6fc0309a0 con 0x56183899e1a0 2024-08-20T01:38:05.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.635+0000 7fe715f6d740 10 client.15843 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:38:05.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.635+0000 7fe715f6d740 10 client.15843 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:38:05.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.635+0000 7fe715f6d740 20 client.15843 populate_metadata read hostname 'smithi079' 2024-08-20T01:38:05.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.635+0000 7fe715f6d740 1 --2- 172.21.15.79:0/2119417885 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5618389b9ee0 0x561838a26ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:05.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.635+0000 7fe715f6d740 4 client.15843 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:38:05.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.635+0000 7fe715f6d740 1 -- 172.21.15.79:0/2119417885 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fe7080e9320 con 0x5618389b9ee0 2024-08-20T01:38:05.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.635+0000 7fe711910640 1 --2- 172.21.15.79:0/2119417885 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5618389b9ee0 0x561838a26ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:05.650 INFO:tasks.workunit.client.0.smithi079.stderr:+ cd tmp 2024-08-20T01:38:05.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.636+0000 7fe6f57fa640 10 client.15843 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:38:05.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.636+0000 7fe711910640 1 --2- 172.21.15.79:0/2119417885 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5618389b9ee0 0x561838a26ab0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=20b10be48c440262 server_cookie=2f6961c821804fbe in_seq=0 out_seq=0 2024-08-20T01:38:05.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.636+0000 7fe6f57fa640 1 -- 172.21.15.79:0/2119417885 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fe7080e9320 con 0x5618389b9ee0 2024-08-20T01:38:05.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.636+0000 7fe6f57fa640 10 client.15843 handle_command_reply: tid=0 2024-08-20T01:38:05.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.636+0000 7fe715f6d740 1 client.15843 shutdown 2024-08-20T01:38:05.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.636+0000 7fe715f6d740 1 -- 172.21.15.79:0/2119417885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56183899e1a0 msgr2=0x5618389bd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:05.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.636+0000 7fe715f6d740 1 --2- 172.21.15.79:0/2119417885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56183899e1a0 0x5618389bd020 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x56183899d830 tx=0x7fe6fc0157f0 comp rx=0 tx=0).stop 2024-08-20T01:38:05.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.636+0000 7fe715f6d740 1 -- 172.21.15.79:0/2119417885 shutdown_connections 2024-08-20T01:38:05.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.636+0000 7fe715f6d740 1 --2- 172.21.15.79:0/2119417885 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5618389b9ee0 0x561838a26ab0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:05.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.636+0000 7fe715f6d740 1 --2- 172.21.15.79:0/2119417885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618389aa130 0x561838a22810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:05.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.636+0000 7fe6f57fa640 0 client.15843 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:38:05.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.636+0000 7fe715f6d740 1 --2- 172.21.15.79:0/2119417885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56183899e1a0 0x5618389bd020 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:05.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.636+0000 7fe715f6d740 1 --2- 172.21.15.79:0/2119417885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56183899d880 0x5618389bcac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:05.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.636+0000 7fe715f6d740 1 -- 172.21.15.79:0/2119417885 >> 172.21.15.79:0/2119417885 conn(0x56183899b6b0 msgr2=0x5618389b5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:05.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.636+0000 7fe715f6d740 1 -- 172.21.15.79:0/2119417885 shutdown_connections 2024-08-20T01:38:05.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.636+0000 7fe715f6d740 1 -- 172.21.15.79:0/2119417885 wait complete. 2024-08-20T01:38:05.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.636+0000 7fe715f6d740 20 client.15843 trim_cache size 0 max 16384 2024-08-20T01:38:05.653 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:38:05.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.637+0000 7fe713b74640 1 -- 172.21.15.79:0/2188488980 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe6f80b3bd0 msgr2=0x7fe6f80b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:05.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.637+0000 7fe713b74640 1 --2- 172.21.15.79:0/2188488980 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe6f80b3bd0 0x7fe6f80b6090 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe704006010 tx=0x7fe704005fa0 comp rx=0 tx=0).stop 2024-08-20T01:38:05.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.637+0000 7fe713b74640 1 -- 172.21.15.79:0/2188488980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe70c1019b0 msgr2=0x7fe70c197dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:05.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.637+0000 7fe713b74640 1 --2- 172.21.15.79:0/2188488980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe70c1019b0 0x7fe70c197dd0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fe70800d950 tx=0x7fe70800de10 comp rx=0 tx=0).stop 2024-08-20T01:38:05.654 INFO:tasks.workunit.client.0.smithi079.stderr:+ for f in $mydir/*.ffsb 2024-08-20T01:38:05.654 INFO:tasks.workunit.client.0.smithi079.stderr:+ ../ffsb/ffsb /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/random_write.32.ffsb 2024-08-20T01:38:05.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.637+0000 7fe713b74640 1 -- 172.21.15.79:0/2188488980 shutdown_connections 2024-08-20T01:38:05.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.637+0000 7fe713b74640 1 --2- 172.21.15.79:0/2188488980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe70c107d40 0x7fe70c19d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:05.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.637+0000 7fe713b74640 1 --2- 172.21.15.79:0/2188488980 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe6f80b3bd0 0x7fe6f80b6090 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:05.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.637+0000 7fe713b74640 1 --2- 172.21.15.79:0/2188488980 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe70c1073c0 0x7fe70c198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:05.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.637+0000 7fe713b74640 1 --2- 172.21.15.79:0/2188488980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe70c1019b0 0x7fe70c197dd0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:05.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.637+0000 7fe713b74640 1 -- 172.21.15.79:0/2188488980 >> 172.21.15.79:0/2188488980 conn(0x7fe70c0fd460 msgr2=0x7fe70c0ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:05.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.637+0000 7fe713b74640 1 -- 172.21.15.79:0/2188488980 shutdown_connections 2024-08-20T01:38:05.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:05.637+0000 7fe713b74640 1 -- 172.21.15.79:0/2188488980 wait complete. 2024-08-20T01:38:05.656 INFO:tasks.workunit.client.0.smithi079.stdout:FFSB version 6.0-RC2 started 2024-08-20T01:38:05.656 INFO:tasks.workunit.client.0.smithi079.stdout: 2024-08-20T01:38:05.656 INFO:tasks.workunit.client.0.smithi079.stdout:benchmark time = 300 2024-08-20T01:38:05.656 INFO:tasks.workunit.client.0.smithi079.stdout:ThreadGroup 0 2024-08-20T01:38:05.656 INFO:tasks.workunit.client.0.smithi079.stdout:================ 2024-08-20T01:38:05.656 INFO:tasks.workunit.client.0.smithi079.stdout: num_threads = 32 2024-08-20T01:38:05.656 INFO:tasks.workunit.client.0.smithi079.stdout: 2024-08-20T01:38:05.656 INFO:tasks.workunit.client.0.smithi079.stdout: read_random = off 2024-08-20T01:38:05.656 INFO:tasks.workunit.client.0.smithi079.stdout: read_size = 0 (0B) 2024-08-20T01:38:05.657 INFO:tasks.workunit.client.0.smithi079.stdout: read_blocksize = 0 (0B) 2024-08-20T01:38:05.657 INFO:tasks.workunit.client.0.smithi079.stdout: read_skip = off 2024-08-20T01:38:05.657 INFO:tasks.workunit.client.0.smithi079.stdout: read_skipsize = 0 (0B) 2024-08-20T01:38:05.657 INFO:tasks.workunit.client.0.smithi079.stdout: 2024-08-20T01:38:05.657 INFO:tasks.workunit.client.0.smithi079.stdout: write_random = on 2024-08-20T01:38:05.657 INFO:tasks.workunit.client.0.smithi079.stdout: write_size = 5242880 (5MB) 2024-08-20T01:38:05.657 INFO:tasks.workunit.client.0.smithi079.stdout: fsync_file = 0 2024-08-20T01:38:05.657 INFO:tasks.workunit.client.0.smithi079.stdout: write_blocksize = 4096 (4KB) 2024-08-20T01:38:05.657 INFO:tasks.workunit.client.0.smithi079.stdout: wait time = 0 2024-08-20T01:38:05.657 INFO:tasks.workunit.client.0.smithi079.stdout: 2024-08-20T01:38:05.657 INFO:tasks.workunit.client.0.smithi079.stdout: op weights 2024-08-20T01:38:05.657 INFO:tasks.workunit.client.0.smithi079.stdout: read = 0 (0.00%) 2024-08-20T01:38:05.658 INFO:tasks.workunit.client.0.smithi079.stdout: readall = 0 (0.00%) 2024-08-20T01:38:05.658 INFO:tasks.workunit.client.0.smithi079.stdout: write = 1 (100.00%) 2024-08-20T01:38:05.658 INFO:tasks.workunit.client.0.smithi079.stdout: create = 0 (0.00%) 2024-08-20T01:38:05.658 INFO:tasks.workunit.client.0.smithi079.stdout: append = 0 (0.00%) 2024-08-20T01:38:05.658 INFO:tasks.workunit.client.0.smithi079.stdout: delete = 0 (0.00%) 2024-08-20T01:38:05.658 INFO:tasks.workunit.client.0.smithi079.stdout: metaop = 0 (0.00%) 2024-08-20T01:38:05.658 INFO:tasks.workunit.client.0.smithi079.stdout: createdir = 0 (0.00%) 2024-08-20T01:38:05.658 INFO:tasks.workunit.client.0.smithi079.stdout: stat = 0 (0.00%) 2024-08-20T01:38:05.658 INFO:tasks.workunit.client.0.smithi079.stdout: writeall = 0 (0.00%) 2024-08-20T01:38:05.658 INFO:tasks.workunit.client.0.smithi079.stdout: writeall_fsync = 0 (0.00%) 2024-08-20T01:38:05.658 INFO:tasks.workunit.client.0.smithi079.stdout: open_close = 0 (0.00%) 2024-08-20T01:38:05.658 INFO:tasks.workunit.client.0.smithi079.stdout: write_fsync = 0 (0.00%) 2024-08-20T01:38:05.659 INFO:tasks.workunit.client.0.smithi079.stdout: create_fsync = 0 (0.00%) 2024-08-20T01:38:05.659 INFO:tasks.workunit.client.0.smithi079.stdout: append_fsync = 0 (0.00%) 2024-08-20T01:38:05.659 INFO:tasks.workunit.client.0.smithi079.stdout: 2024-08-20T01:38:05.659 INFO:tasks.workunit.client.0.smithi079.stdout:FileSystem . 2024-08-20T01:38:05.659 INFO:tasks.workunit.client.0.smithi079.stdout:========== 2024-08-20T01:38:05.659 INFO:tasks.workunit.client.0.smithi079.stdout: num_dirs = 0 2024-08-20T01:38:05.659 INFO:tasks.workunit.client.0.smithi079.stdout: starting files = 128 2024-08-20T01:38:05.659 INFO:tasks.workunit.client.0.smithi079.stdout: 2024-08-20T01:38:05.659 INFO:tasks.workunit.client.0.smithi079.stdout: min file size = 104857600 (100MB) 2024-08-20T01:38:05.659 INFO:tasks.workunit.client.0.smithi079.stdout: max file size = 104857600 (100MB) 2024-08-20T01:38:05.659 INFO:tasks.workunit.client.0.smithi079.stdout: directio = off 2024-08-20T01:38:05.659 INFO:tasks.workunit.client.0.smithi079.stdout: alignedio = on 2024-08-20T01:38:05.660 INFO:tasks.workunit.client.0.smithi079.stdout: bufferedio = off 2024-08-20T01:38:05.660 INFO:tasks.workunit.client.0.smithi079.stdout: 2024-08-20T01:38:05.660 INFO:tasks.workunit.client.0.smithi079.stdout: aging is off 2024-08-20T01:38:05.660 INFO:tasks.workunit.client.0.smithi079.stdout: current utilization = 0.00% 2024-08-20T01:38:05.660 INFO:tasks.workunit.client.0.smithi079.stdout: 2024-08-20T01:38:05.660 INFO:tasks.workunit.client.0.smithi079.stdout:checking existing fs: . 2024-08-20T01:38:05.660 INFO:tasks.workunit.client.0.smithi079.stdout:recreating new fileset 2024-08-20T01:38:05.660 INFO:tasks.workunit.client.0.smithi079.stderr:opendir: No such file or directory 2024-08-20T01:38:06.432 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T01:38:06.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:06 smithi079 ceph-mon[18656]: pgmap v370: 97 pgs: 97 active+clean; 8.2 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 746 KiB/s wr, 152 op/s 2024-08-20T01:38:06.753 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:38:06.777 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:06 smithi081 ceph-mon[22209]: pgmap v370: 97 pgs: 97 active+clean; 8.2 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 746 KiB/s wr, 152 op/s 2024-08-20T01:38:06.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:06 smithi175 ceph-mon[22392]: pgmap v370: 97 pgs: 97 active+clean; 8.2 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 746 KiB/s wr, 152 op/s 2024-08-20T01:38:07.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.271+0000 7f17333d8640 1 -- 172.21.15.79:0/3493047703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f172c102a90 msgr2=0x7f172c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:07.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.271+0000 7f17333d8640 1 --2- 172.21.15.79:0/3493047703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f172c102a90 0x7f172c102e70 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f1728009900 tx=0x7f172802a410 comp rx=0 tx=0).stop 2024-08-20T01:38:07.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.271+0000 7f17333d8640 1 -- 172.21.15.79:0/3493047703 shutdown_connections 2024-08-20T01:38:07.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.271+0000 7f17333d8640 1 --2- 172.21.15.79:0/3493047703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f172c108e20 0x7f172c10f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:07.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.271+0000 7f17333d8640 1 --2- 172.21.15.79:0/3493047703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f172c1084a0 0x7f172c1088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:07.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.271+0000 7f17333d8640 1 --2- 172.21.15.79:0/3493047703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f172c102a90 0x7f172c102e70 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:07.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.271+0000 7f17333d8640 1 -- 172.21.15.79:0/3493047703 >> 172.21.15.79:0/3493047703 conn(0x7f172c0fe540 msgr2=0x7f172c100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:07.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.271+0000 7f17333d8640 1 -- 172.21.15.79:0/3493047703 shutdown_connections 2024-08-20T01:38:07.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.271+0000 7f17333d8640 1 -- 172.21.15.79:0/3493047703 wait complete. 2024-08-20T01:38:07.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.272+0000 7f17333d8640 1 Processor -- start 2024-08-20T01:38:07.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.272+0000 7f17333d8640 1 -- start start 2024-08-20T01:38:07.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.272+0000 7f17333d8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f172c102a90 0x7f172c0751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:07.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.272+0000 7f17333d8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f172c1084a0 0x7f172c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:07.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.272+0000 7f17333d8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f172c108e20 0x7f172c075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:07.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.272+0000 7f17333d8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f172c112990 con 0x7f172c1084a0 2024-08-20T01:38:07.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.272+0000 7f17333d8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f172c112810 con 0x7f172c108e20 2024-08-20T01:38:07.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.272+0000 7f17333d8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f172c112b10 con 0x7f172c102a90 2024-08-20T01:38:07.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.272+0000 7f1730973640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f172c1084a0 0x7f172c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:07.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.272+0000 7f1730973640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f172c1084a0 0x7f172c075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35604/0 (socket says 172.21.15.79:35604) 2024-08-20T01:38:07.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.272+0000 7f1730973640 1 -- 172.21.15.79:0/3819725904 learned_addr learned my addr 172.21.15.79:0/3819725904 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:07.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.272+0000 7f1731174640 1 --2- 172.21.15.79:0/3819725904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f172c102a90 0x7f172c0751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:07.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.272+0000 7f1731975640 1 --2- 172.21.15.79:0/3819725904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f172c108e20 0x7f172c075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:07.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.272+0000 7f1730973640 1 -- 172.21.15.79:0/3819725904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f172c102a90 msgr2=0x7f172c0751d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:07.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.272+0000 7f1730973640 1 --2- 172.21.15.79:0/3819725904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f172c102a90 0x7f172c0751d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:07.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.272+0000 7f1730973640 1 -- 172.21.15.79:0/3819725904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f172c108e20 msgr2=0x7f172c075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:07.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.272+0000 7f1730973640 1 --2- 172.21.15.79:0/3819725904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f172c108e20 0x7f172c075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:07.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.272+0000 7f1730973640 1 -- 172.21.15.79:0/3819725904 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f172c1a72a0 con 0x7f172c1084a0 2024-08-20T01:38:07.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.272+0000 7f1731975640 1 --2- 172.21.15.79:0/3819725904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f172c108e20 0x7f172c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:38:07.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.273+0000 7f1730973640 1 --2- 172.21.15.79:0/3819725904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f172c1084a0 0x7f172c075710 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f171c00d770 tx=0x7f171c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:07.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.273+0000 7f17227fc640 1 -- 172.21.15.79:0/3819725904 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171c017070 con 0x7f172c1084a0 2024-08-20T01:38:07.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.273+0000 7f17227fc640 1 -- 172.21.15.79:0/3819725904 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f171c0054b0 con 0x7f172c1084a0 2024-08-20T01:38:07.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.273+0000 7f17333d8640 1 -- 172.21.15.79:0/3819725904 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f172c1a7590 con 0x7f172c1084a0 2024-08-20T01:38:07.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.273+0000 7f17227fc640 1 -- 172.21.15.79:0/3819725904 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171c004c60 con 0x7f172c1084a0 2024-08-20T01:38:07.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.273+0000 7f17333d8640 1 -- 172.21.15.79:0/3819725904 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f172c1a7a80 con 0x7f172c1084a0 2024-08-20T01:38:07.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.276+0000 7f17227fc640 1 -- 172.21.15.79:0/3819725904 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f171c004e00 con 0x7f172c1084a0 2024-08-20T01:38:07.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.276+0000 7f17357d1740 1 Processor -- start 2024-08-20T01:38:07.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.276+0000 7f17357d1740 1 -- start start 2024-08-20T01:38:07.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.276+0000 7f17357d1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b29cf3e880 0x55b29cf3ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:07.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.276+0000 7f17357d1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b29cf3f1a0 0x55b29cf4abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:07.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.276+0000 7f17357d1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b29cf4b130 0x55b29cf4d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:07.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.276+0000 7f17357d1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b29ceb5930 con 0x55b29cf4b130 2024-08-20T01:38:07.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.276+0000 7f17357d1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b29cea4e30 con 0x55b29cf3f1a0 2024-08-20T01:38:07.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.276+0000 7f17357d1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b29cea8e70 con 0x55b29cf3e880 2024-08-20T01:38:07.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.276+0000 7f1730973640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b29cf4b130 0x55b29cf4d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:07.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.277+0000 7f1730973640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b29cf4b130 0x55b29cf4d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35616/0 (socket says 172.21.15.79:35616) 2024-08-20T01:38:07.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.277+0000 7f1730973640 1 -- 172.21.15.79:0/729509014 learned_addr learned my addr 172.21.15.79:0/729509014 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:07.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.277+0000 7f1731174640 1 --2- 172.21.15.79:0/729509014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b29cf3f1a0 0x55b29cf4abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:07.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.277+0000 7f1731975640 1 --2- 172.21.15.79:0/729509014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b29cf3e880 0x55b29cf3ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:07.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.277+0000 7f17227fc640 1 --2- 172.21.15.79:0/3819725904 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f17180b3bd0 0x7f17180b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:07.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.277+0000 7f1730973640 1 -- 172.21.15.79:0/729509014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b29cf3e880 msgr2=0x55b29cf3ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:07.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.277+0000 7f1730973640 1 --2- 172.21.15.79:0/729509014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b29cf3e880 0x55b29cf3ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:07.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.277+0000 7f1730973640 1 -- 172.21.15.79:0/729509014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b29cf3f1a0 msgr2=0x55b29cf4abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:07.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.277+0000 7f1730973640 1 --2- 172.21.15.79:0/729509014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b29cf3f1a0 0x55b29cf4abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:07.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.277+0000 7f1730973640 1 -- 172.21.15.79:0/729509014 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b29cc04650 con 0x55b29cf4b130 2024-08-20T01:38:07.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.277+0000 7f1731975640 1 --2- 172.21.15.79:0/3819725904 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f17180b3bd0 0x7f17180b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:07.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.277+0000 7f17227fc640 1 -- 172.21.15.79:0/3819725904 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f171c0e3690 con 0x7f172c1084a0 2024-08-20T01:38:07.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.277+0000 7f1730973640 1 --2- 172.21.15.79:0/729509014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b29cf4b130 0x55b29cf4d520 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f171c0c5880 tx=0x7f171c0bbef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40a83862457bbb3f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:07.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.278+0000 7f1731975640 1 --2- 172.21.15.79:0/3819725904 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f17180b3bd0 0x7f17180b6090 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1724005fd0 tx=0x7f1724004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:07.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.278+0000 7f17177fe640 1 -- 172.21.15.79:0/729509014 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171c020070 con 0x55b29cf4b130 2024-08-20T01:38:07.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.278+0000 7f17177fe640 1 -- 172.21.15.79:0/729509014 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f171c0aa100 con 0x55b29cf4b130 2024-08-20T01:38:07.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.278+0000 7f17177fe640 1 -- 172.21.15.79:0/729509014 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171c0a9d60 con 0x55b29cf4b130 2024-08-20T01:38:07.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.279+0000 7f17357d1740 1 -- 172.21.15.79:0/729509014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b29cf4b130 msgr2=0x55b29cf4d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:07.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.279+0000 7f17357d1740 1 --2- 172.21.15.79:0/729509014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b29cf4b130 0x55b29cf4d520 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f171c0c5880 tx=0x7f171c0bbef0 comp rx=0 tx=0).stop 2024-08-20T01:38:07.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.279+0000 7f17357d1740 1 -- 172.21.15.79:0/729509014 shutdown_connections 2024-08-20T01:38:07.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.279+0000 7f17357d1740 1 --2- 172.21.15.79:0/729509014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b29cf4b130 0x55b29cf4d520 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:07.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.279+0000 7f17357d1740 1 --2- 172.21.15.79:0/729509014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b29cf3f1a0 0x55b29cf4abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:07.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.279+0000 7f17357d1740 1 --2- 172.21.15.79:0/729509014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b29cf3e880 0x55b29cf3ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:07.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.279+0000 7f17357d1740 1 -- 172.21.15.79:0/729509014 >> 172.21.15.79:0/729509014 conn(0x55b29cf3c6b0 msgr2=0x55b29cf3d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:07.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.279+0000 7f17357d1740 1 -- 172.21.15.79:0/729509014 shutdown_connections 2024-08-20T01:38:07.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.279+0000 7f17357d1740 1 -- 172.21.15.79:0/729509014 wait complete. 2024-08-20T01:38:07.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.279+0000 7f17357d1740 1 -- start start 2024-08-20T01:38:07.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.279+0000 7f17357d1740 1 Processor -- start 2024-08-20T01:38:07.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.280+0000 7f17357d1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b29cf3e880 0x55b29cf480a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:07.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.280+0000 7f17357d1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b29cf3f1a0 0x55b29cf485e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:07.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.280+0000 7f17357d1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b29cf4b130 0x55b29cf48b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:07.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.280+0000 7f17357d1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b29cd07700 con 0x55b29cf3e880 2024-08-20T01:38:07.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.280+0000 7f17357d1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b29ce2b810 con 0x55b29cf3f1a0 2024-08-20T01:38:07.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.280+0000 7f17357d1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b29cf4dd80 con 0x55b29cf4b130 2024-08-20T01:38:07.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.280+0000 7f1731174640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b29cf3e880 0x55b29cf480a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:07.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.280+0000 7f17357d1740 10 client.0 _ll_register_callbacks cb 0x55b29ce9e700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:07.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.280+0000 7f1731174640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b29cf3e880 0x55b29cf480a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35628/0 (socket says 172.21.15.79:35628) 2024-08-20T01:38:07.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.280+0000 7f1731174640 1 -- 172.21.15.79:0/3130502392 learned_addr learned my addr 172.21.15.79:0/3130502392 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:07.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.280+0000 7f1731975640 1 --2- 172.21.15.79:0/3130502392 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b29cf4b130 0x55b29cf48b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:07.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.280+0000 7f1730973640 1 --2- 172.21.15.79:0/3130502392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b29cf3f1a0 0x55b29cf485e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:07.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.280+0000 7f1731174640 1 -- 172.21.15.79:0/3130502392 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b29cf4b130 msgr2=0x55b29cf48b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:07.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.280+0000 7f1731174640 1 --2- 172.21.15.79:0/3130502392 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b29cf4b130 0x55b29cf48b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:07.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.280+0000 7f1731174640 1 -- 172.21.15.79:0/3130502392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b29cf3f1a0 msgr2=0x55b29cf485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:07.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.280+0000 7f1731174640 1 --2- 172.21.15.79:0/3130502392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b29cf3f1a0 0x55b29cf485e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:07.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.280+0000 7f1731174640 1 -- 172.21.15.79:0/3130502392 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b29cf57100 con 0x55b29cf3e880 2024-08-20T01:38:07.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.280+0000 7f1730973640 1 --2- 172.21.15.79:0/3130502392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b29cf3f1a0 0x55b29cf485e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:38:07.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.280+0000 7f1731174640 1 --2- 172.21.15.79:0/3130502392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b29cf3e880 0x55b29cf480a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f1728006010 tx=0x7f1728031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac3e64e037aa869e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:07.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.280+0000 7f1714ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:38:07.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.281+0000 7f1714ff9640 1 -- 172.21.15.79:0/3130502392 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1728035040 con 0x55b29cf3e880 2024-08-20T01:38:07.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.281+0000 7f1714ff9640 1 -- 172.21.15.79:0/3130502392 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f1728004240 con 0x55b29cf3e880 2024-08-20T01:38:07.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.281+0000 7f17357d1740 1 -- 172.21.15.79:0/3130502392 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b29ce54150 con 0x55b29cf3e880 2024-08-20T01:38:07.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.281+0000 7f1714ff9640 1 -- 172.21.15.79:0/3130502392 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1728004440 con 0x55b29cf3e880 2024-08-20T01:38:07.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.281+0000 7f17357d1740 10 client.15855 fetch_fsmap learned FSMap version 28 2024-08-20T01:38:07.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.281+0000 7f17357d1740 1 -- 172.21.15.79:0/3130502392 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b29cf59ab0 con 0x55b29cf3e880 2024-08-20T01:38:07.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.281+0000 7f1714ff9640 1 -- 172.21.15.79:0/3130502392 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55b29ce54150 con 0x55b29cf3e880 2024-08-20T01:38:07.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.281+0000 7f1714ff9640 1 -- 172.21.15.79:0/3130502392 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1728044020 con 0x55b29cf3e880 2024-08-20T01:38:07.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.281+0000 7f17357d1740 10 client.15855 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:38:07.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.281+0000 7f17357d1740 10 client.15855 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:38:07.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.281+0000 7f17357d1740 20 client.15855 populate_metadata read hostname 'smithi079' 2024-08-20T01:38:07.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.281+0000 7f17357d1740 1 --2- 172.21.15.79:0/3130502392 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55b29cf5af70 0x55b29cf5d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:07.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.281+0000 7f17357d1740 4 client.15855 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:38:07.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.281+0000 7f17357d1740 1 -- 172.21.15.79:0/3130502392 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b29ceb7880 con 0x55b29cf5af70 2024-08-20T01:38:07.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.282+0000 7f1730973640 1 --2- 172.21.15.79:0/3130502392 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55b29cf5af70 0x55b29cf5d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:07.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.282+0000 7f1714ff9640 10 client.15855 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:38:07.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.282+0000 7f1730973640 1 --2- 172.21.15.79:0/3130502392 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55b29cf5af70 0x55b29cf5d3a0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d4d1eed8f1eb8084 server_cookie=b55e9570d3d2cce5 in_seq=0 out_seq=0 2024-08-20T01:38:07.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.283+0000 7f1714ff9640 1 -- 172.21.15.79:0/3130502392 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b29ceb7880 con 0x55b29cf5af70 2024-08-20T01:38:07.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.283+0000 7f1714ff9640 10 client.15855 handle_command_reply: tid=0 2024-08-20T01:38:07.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.283+0000 7f17357d1740 1 client.15855 shutdown 2024-08-20T01:38:07.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.283+0000 7f17357d1740 1 -- 172.21.15.79:0/3130502392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b29cf3e880 msgr2=0x55b29cf480a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:07.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.283+0000 7f17357d1740 1 --2- 172.21.15.79:0/3130502392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b29cf3e880 0x55b29cf480a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f1728006010 tx=0x7f1728031400 comp rx=0 tx=0).stop 2024-08-20T01:38:07.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.283+0000 7f17357d1740 1 -- 172.21.15.79:0/3130502392 shutdown_connections 2024-08-20T01:38:07.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.283+0000 7f17357d1740 1 --2- 172.21.15.79:0/3130502392 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b29cf4b130 0x55b29cf48b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:07.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.283+0000 7f17357d1740 1 --2- 172.21.15.79:0/3130502392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b29cf3f1a0 0x55b29cf485e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:07.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.283+0000 7f17357d1740 1 --2- 172.21.15.79:0/3130502392 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55b29cf5af70 0x55b29cf5d3a0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:07.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.283+0000 7f17357d1740 1 --2- 172.21.15.79:0/3130502392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b29cf3e880 0x55b29cf480a0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:07.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.283+0000 7f1714ff9640 0 client.15855 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:38:07.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.283+0000 7f17357d1740 1 -- 172.21.15.79:0/3130502392 >> 172.21.15.79:0/3130502392 conn(0x55b29cf3c6b0 msgr2=0x55b29cf42220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:07.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.283+0000 7f17357d1740 1 -- 172.21.15.79:0/3130502392 shutdown_connections 2024-08-20T01:38:07.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.283+0000 7f17357d1740 1 -- 172.21.15.79:0/3130502392 wait complete. 2024-08-20T01:38:07.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.284+0000 7f17357d1740 20 client.15855 trim_cache size 0 max 16384 2024-08-20T01:38:07.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.299+0000 7f17357d1740 1 Processor -- start 2024-08-20T01:38:07.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.299+0000 7f17357d1740 1 -- start start 2024-08-20T01:38:07.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.299+0000 7f17357d1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b29cf3e880 0x55b29cf485a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:07.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.299+0000 7f17357d1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b29cf3f1a0 0x55b29cf48ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:07.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.299+0000 7f17357d1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b29cf4b130 0x55b29cf62c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:07.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.299+0000 7f17357d1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f172c1b0180 con 0x55b29cf4b130 2024-08-20T01:38:07.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.299+0000 7f17357d1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f172c1b1cc0 con 0x55b29cf3f1a0 2024-08-20T01:38:07.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.299+0000 7f17357d1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f172c1b0850 con 0x55b29cf3e880 2024-08-20T01:38:07.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.300+0000 7f1731975640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b29cf4b130 0x55b29cf62c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:07.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.300+0000 7f1731975640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b29cf4b130 0x55b29cf62c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35632/0 (socket says 172.21.15.79:35632) 2024-08-20T01:38:07.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.300+0000 7f1731975640 1 -- 172.21.15.79:0/2588581892 learned_addr learned my addr 172.21.15.79:0/2588581892 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:07.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.300+0000 7f1730973640 1 --2- 172.21.15.79:0/2588581892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b29cf3f1a0 0x55b29cf48ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:07.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.300+0000 7f1731174640 1 --2- 172.21.15.79:0/2588581892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b29cf3e880 0x55b29cf485a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:07.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.300+0000 7f1731975640 1 -- 172.21.15.79:0/2588581892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b29cf3e880 msgr2=0x55b29cf485a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:07.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.300+0000 7f1731975640 1 --2- 172.21.15.79:0/2588581892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b29cf3e880 0x55b29cf485a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:07.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.300+0000 7f1731975640 1 -- 172.21.15.79:0/2588581892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b29cf3f1a0 msgr2=0x55b29cf48ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:07.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.300+0000 7f1731975640 1 --2- 172.21.15.79:0/2588581892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b29cf3f1a0 0x55b29cf48ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:07.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.300+0000 7f1731975640 1 -- 172.21.15.79:0/2588581892 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b29cf465a0 con 0x55b29cf4b130 2024-08-20T01:38:07.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.300+0000 7f1730973640 1 --2- 172.21.15.79:0/2588581892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b29cf3f1a0 0x55b29cf48ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:07.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.300+0000 7f1731975640 1 --2- 172.21.15.79:0/2588581892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b29cf4b130 0x55b29cf62c70 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f172401c770 tx=0x7f1724015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51e6f117da22538c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:07.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.300+0000 7f1716ffd640 1 -- 172.21.15.79:0/2588581892 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17240116b0 con 0x55b29cf4b130 2024-08-20T01:38:07.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.300+0000 7f1716ffd640 1 -- 172.21.15.79:0/2588581892 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1724011ce0 con 0x55b29cf4b130 2024-08-20T01:38:07.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.300+0000 7f1716ffd640 1 -- 172.21.15.79:0/2588581892 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172401bd50 con 0x55b29cf4b130 2024-08-20T01:38:07.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.301+0000 7f17357d1740 1 -- 172.21.15.79:0/2588581892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b29cf4b130 msgr2=0x55b29cf62c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:07.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.301+0000 7f17357d1740 1 --2- 172.21.15.79:0/2588581892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b29cf4b130 0x55b29cf62c70 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f172401c770 tx=0x7f1724015000 comp rx=0 tx=0).stop 2024-08-20T01:38:07.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.301+0000 7f17357d1740 1 -- 172.21.15.79:0/2588581892 shutdown_connections 2024-08-20T01:38:07.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.301+0000 7f17357d1740 1 --2- 172.21.15.79:0/2588581892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b29cf4b130 0x55b29cf62c70 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:07.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.301+0000 7f17357d1740 1 --2- 172.21.15.79:0/2588581892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b29cf3f1a0 0x55b29cf48ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:07.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.301+0000 7f17357d1740 1 --2- 172.21.15.79:0/2588581892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b29cf3e880 0x55b29cf485a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:07.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.301+0000 7f17357d1740 1 -- 172.21.15.79:0/2588581892 >> 172.21.15.79:0/2588581892 conn(0x55b29cf3c6b0 msgr2=0x55b29cf49ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:07.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.301+0000 7f17357d1740 1 -- 172.21.15.79:0/2588581892 shutdown_connections 2024-08-20T01:38:07.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.301+0000 7f17357d1740 1 -- 172.21.15.79:0/2588581892 wait complete. 2024-08-20T01:38:07.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.302+0000 7f17357d1740 1 -- start start 2024-08-20T01:38:07.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.302+0000 7f17357d1740 1 Processor -- start 2024-08-20T01:38:07.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.302+0000 7f17357d1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b29cf3e880 0x55b29cf533c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:07.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.302+0000 7f17357d1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b29cf3f1a0 0x55b29cf53940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:07.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.302+0000 7f17357d1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b29cf4b130 0x55b29cf4eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:07.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.302+0000 7f17357d1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f172c1b15f0 con 0x55b29cf3e880 2024-08-20T01:38:07.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.302+0000 7f17357d1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f172c1b0f20 con 0x55b29cf3f1a0 2024-08-20T01:38:07.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.302+0000 7f17357d1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f172c1ae160 con 0x55b29cf4b130 2024-08-20T01:38:07.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.302+0000 7f1731174640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b29cf3e880 0x55b29cf533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:07.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.302+0000 7f1731174640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b29cf3e880 0x55b29cf533c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35648/0 (socket says 172.21.15.79:35648) 2024-08-20T01:38:07.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.302+0000 7f1731174640 1 -- 172.21.15.79:0/571386864 learned_addr learned my addr 172.21.15.79:0/571386864 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:07.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.302+0000 7f17357d1740 10 client.0 _ll_register_callbacks cb 0x7f1728009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:07.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.302+0000 7f1731975640 1 --2- 172.21.15.79:0/571386864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b29cf4b130 0x55b29cf4eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:07.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.302+0000 7f1730973640 1 --2- 172.21.15.79:0/571386864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b29cf3f1a0 0x55b29cf53940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:07.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.303+0000 7f1731174640 1 -- 172.21.15.79:0/571386864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b29cf4b130 msgr2=0x55b29cf4eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:07.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.303+0000 7f1731174640 1 --2- 172.21.15.79:0/571386864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b29cf4b130 0x55b29cf4eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:07.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.303+0000 7f1731174640 1 -- 172.21.15.79:0/571386864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b29cf3f1a0 msgr2=0x55b29cf53940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:07.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.303+0000 7f1731174640 1 --2- 172.21.15.79:0/571386864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b29cf3f1a0 0x55b29cf53940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:07.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.303+0000 7f1731174640 1 -- 172.21.15.79:0/571386864 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b29cf4f310 con 0x55b29cf3e880 2024-08-20T01:38:07.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.303+0000 7f1731174640 1 --2- 172.21.15.79:0/571386864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b29cf3e880 0x55b29cf533c0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f1728005940 tx=0x7f172803d680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=732c1e84de609fd4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:07.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.303+0000 7f1714ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:38:07.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.303+0000 7f1714ff9640 1 -- 172.21.15.79:0/571386864 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1728035040 con 0x55b29cf3e880 2024-08-20T01:38:07.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.303+0000 7f1714ff9640 1 -- 172.21.15.79:0/571386864 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f172803d980 con 0x55b29cf3e880 2024-08-20T01:38:07.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.303+0000 7f17357d1740 1 -- 172.21.15.79:0/571386864 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1724011ce0 con 0x55b29cf3e880 2024-08-20T01:38:07.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.303+0000 7f1714ff9640 1 -- 172.21.15.79:0/571386864 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f17280318c0 con 0x55b29cf3e880 2024-08-20T01:38:07.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.303+0000 7f17357d1740 10 client.15861 fetch_fsmap learned FSMap version 28 2024-08-20T01:38:07.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.303+0000 7f17357d1740 1 -- 172.21.15.79:0/571386864 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b29cfc5990 con 0x55b29cf3e880 2024-08-20T01:38:07.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.303+0000 7f1714ff9640 1 -- 172.21.15.79:0/571386864 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1724011ce0 con 0x55b29cf3e880 2024-08-20T01:38:07.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.304+0000 7f1714ff9640 1 -- 172.21.15.79:0/571386864 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1728044040 con 0x55b29cf3e880 2024-08-20T01:38:07.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.304+0000 7f17357d1740 10 client.15861 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:38:07.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.304+0000 7f17357d1740 10 client.15861 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:38:07.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.304+0000 7f17357d1740 20 client.15861 populate_metadata read hostname 'smithi079' 2024-08-20T01:38:07.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.304+0000 7f17357d1740 1 --2- 172.21.15.79:0/571386864 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55b29cf5af70 0x55b29cfc80f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:07.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.304+0000 7f17357d1740 4 client.15861 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:38:07.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.304+0000 7f17357d1740 1 -- 172.21.15.79:0/571386864 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b29ceb3320 con 0x55b29cf5af70 2024-08-20T01:38:07.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.304+0000 7f1730973640 1 --2- 172.21.15.79:0/571386864 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55b29cf5af70 0x55b29cfc80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:07.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.304+0000 7f1730973640 1 --2- 172.21.15.79:0/571386864 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55b29cf5af70 0x55b29cfc80f0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9f17a7b317a9c31f server_cookie=9457e69bdc6d228 in_seq=0 out_seq=0 2024-08-20T01:38:07.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.304+0000 7f1714ff9640 10 client.15861 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:38:07.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.305+0000 7f1714ff9640 1 -- 172.21.15.79:0/571386864 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b29ceb3320 con 0x55b29cf5af70 2024-08-20T01:38:07.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.305+0000 7f1714ff9640 10 client.15861 handle_command_reply: tid=0 2024-08-20T01:38:07.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.305+0000 7f17357d1740 1 client.15861 shutdown 2024-08-20T01:38:07.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.305+0000 7f17357d1740 1 -- 172.21.15.79:0/571386864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b29cf3e880 msgr2=0x55b29cf533c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:07.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.305+0000 7f17357d1740 1 --2- 172.21.15.79:0/571386864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b29cf3e880 0x55b29cf533c0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f1728005940 tx=0x7f172803d680 comp rx=0 tx=0).stop 2024-08-20T01:38:07.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.305+0000 7f17357d1740 1 -- 172.21.15.79:0/571386864 shutdown_connections 2024-08-20T01:38:07.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.305+0000 7f17357d1740 1 --2- 172.21.15.79:0/571386864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b29cf4b130 0x55b29cf4eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:07.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.305+0000 7f17357d1740 1 --2- 172.21.15.79:0/571386864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b29cf3f1a0 0x55b29cf53940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:07.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.305+0000 7f17357d1740 1 --2- 172.21.15.79:0/571386864 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55b29cf5af70 0x55b29cfc80f0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:07.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.305+0000 7f17357d1740 1 --2- 172.21.15.79:0/571386864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b29cf3e880 0x55b29cf533c0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:07.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.305+0000 7f17357d1740 1 -- 172.21.15.79:0/571386864 >> 172.21.15.79:0/571386864 conn(0x55b29cf3c6b0 msgr2=0x55b29cf55e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:07.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.305+0000 7f1714ff9640 0 client.15861 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:38:07.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.305+0000 7f17357d1740 1 -- 172.21.15.79:0/571386864 shutdown_connections 2024-08-20T01:38:07.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.305+0000 7f17357d1740 1 -- 172.21.15.79:0/571386864 wait complete. 2024-08-20T01:38:07.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.305+0000 7f17357d1740 20 client.15861 trim_cache size 0 max 16384 2024-08-20T01:38:07.333 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:38:07.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.306+0000 7f17333d8640 1 -- 172.21.15.79:0/3819725904 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f17180b3bd0 msgr2=0x7f17180b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:07.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.306+0000 7f17333d8640 1 --2- 172.21.15.79:0/3819725904 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f17180b3bd0 0x7f17180b6090 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1724005fd0 tx=0x7f1724004a40 comp rx=0 tx=0).stop 2024-08-20T01:38:07.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.306+0000 7f17333d8640 1 -- 172.21.15.79:0/3819725904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f172c1084a0 msgr2=0x7f172c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:07.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.306+0000 7f17333d8640 1 --2- 172.21.15.79:0/3819725904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f172c1084a0 0x7f172c075710 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f171c00d770 tx=0x7f171c00dc30 comp rx=0 tx=0).stop 2024-08-20T01:38:07.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.306+0000 7f17333d8640 1 -- 172.21.15.79:0/3819725904 shutdown_connections 2024-08-20T01:38:07.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.306+0000 7f17333d8640 1 --2- 172.21.15.79:0/3819725904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f172c108e20 0x7f172c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:07.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.306+0000 7f17333d8640 1 --2- 172.21.15.79:0/3819725904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f172c1084a0 0x7f172c075710 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:07.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.306+0000 7f17333d8640 1 --2- 172.21.15.79:0/3819725904 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f17180b3bd0 0x7f17180b6090 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:07.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.306+0000 7f17333d8640 1 --2- 172.21.15.79:0/3819725904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f172c102a90 0x7f172c0751d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:07.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.306+0000 7f17333d8640 1 -- 172.21.15.79:0/3819725904 >> 172.21.15.79:0/3819725904 conn(0x7f172c0fe540 msgr2=0x7f172c100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:07.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.306+0000 7f17333d8640 1 -- 172.21.15.79:0/3819725904 shutdown_connections 2024-08-20T01:38:07.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:07.306+0000 7f17333d8640 1 -- 172.21.15.79:0/3819725904 wait complete. 2024-08-20T01:38:08.082 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T01:38:08.363 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:38:08.652 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:08 smithi079 ceph-mon[18656]: pgmap v371: 97 pgs: 97 active+clean; 8.8 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 657 KiB/s wr, 172 op/s 2024-08-20T01:38:08.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:08 smithi081 ceph-mon[22209]: pgmap v371: 97 pgs: 97 active+clean; 8.8 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 657 KiB/s wr, 172 op/s 2024-08-20T01:38:08.905 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:08 smithi175 ceph-mon[22392]: pgmap v371: 97 pgs: 97 active+clean; 8.8 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 657 KiB/s wr, 172 op/s 2024-08-20T01:38:09.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.889+0000 7f63f998d640 1 -- 172.21.15.79:0/3598519417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63f4102a90 msgr2=0x7f63f4102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:09.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.889+0000 7f63f998d640 1 --2- 172.21.15.79:0/3598519417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63f4102a90 0x7f63f4102e70 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f63e4009900 tx=0x7f63e402a410 comp rx=0 tx=0).stop 2024-08-20T01:38:09.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.889+0000 7f63f998d640 1 -- 172.21.15.79:0/3598519417 shutdown_connections 2024-08-20T01:38:09.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.889+0000 7f63f998d640 1 --2- 172.21.15.79:0/3598519417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63f4108e20 0x7f63f410f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:09.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.889+0000 7f63f998d640 1 --2- 172.21.15.79:0/3598519417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63f41084a0 0x7f63f41088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:09.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.889+0000 7f63f998d640 1 --2- 172.21.15.79:0/3598519417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63f4102a90 0x7f63f4102e70 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:09.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.889+0000 7f63f998d640 1 -- 172.21.15.79:0/3598519417 >> 172.21.15.79:0/3598519417 conn(0x7f63f40fe540 msgr2=0x7f63f4100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:09.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.889+0000 7f63f998d640 1 -- 172.21.15.79:0/3598519417 shutdown_connections 2024-08-20T01:38:09.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.889+0000 7f63f998d640 1 -- 172.21.15.79:0/3598519417 wait complete. 2024-08-20T01:38:09.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.890+0000 7f63f998d640 1 Processor -- start 2024-08-20T01:38:09.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.890+0000 7f63f998d640 1 -- start start 2024-08-20T01:38:09.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.890+0000 7f63f998d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63f4102a90 0x7f63f40751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:09.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.890+0000 7f63f998d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63f41084a0 0x7f63f4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:09.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.890+0000 7f63f998d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63f4108e20 0x7f63f4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:09.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.890+0000 7f63f998d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f63f4112990 con 0x7f63f4108e20 2024-08-20T01:38:09.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.890+0000 7f63f998d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f63f4112810 con 0x7f63f4102a90 2024-08-20T01:38:09.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.890+0000 7f63f998d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f63f4112b10 con 0x7f63f41084a0 2024-08-20T01:38:09.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.890+0000 7f63f37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63f4108e20 0x7f63f4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:09.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.890+0000 7f63f2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63f4102a90 0x7f63f40751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:09.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.890+0000 7f63f37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63f4108e20 0x7f63f4075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35672/0 (socket says 172.21.15.79:35672) 2024-08-20T01:38:09.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.890+0000 7f63ea7fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63f41084a0 0x7f63f4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:09.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.891+0000 7f63f37fe640 1 -- 172.21.15.79:0/3044451019 learned_addr learned my addr 172.21.15.79:0/3044451019 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:09.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.891+0000 7f63f37fe640 1 -- 172.21.15.79:0/3044451019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63f41084a0 msgr2=0x7f63f4075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:09.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.891+0000 7f63f37fe640 1 --2- 172.21.15.79:0/3044451019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63f41084a0 0x7f63f4075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:09.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.891+0000 7f63f37fe640 1 -- 172.21.15.79:0/3044451019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63f4102a90 msgr2=0x7f63f40751d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:09.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.891+0000 7f63f37fe640 1 --2- 172.21.15.79:0/3044451019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63f4102a90 0x7f63f40751d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:09.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.891+0000 7f63f37fe640 1 -- 172.21.15.79:0/3044451019 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63f41a73a0 con 0x7f63f4108e20 2024-08-20T01:38:09.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.891+0000 7f63f37fe640 1 --2- 172.21.15.79:0/3044451019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63f4108e20 0x7f63f4075c50 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f63ec00eaa0 tx=0x7f63ec00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:09.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.891+0000 7f63f898b640 1 -- 172.21.15.79:0/3044451019 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ec00cdb0 con 0x7f63f4108e20 2024-08-20T01:38:09.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.891+0000 7f63f898b640 1 -- 172.21.15.79:0/3044451019 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f63ec005020 con 0x7f63f4108e20 2024-08-20T01:38:09.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.891+0000 7f63f998d640 1 -- 172.21.15.79:0/3044451019 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63f41a7690 con 0x7f63f4108e20 2024-08-20T01:38:09.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.891+0000 7f63f898b640 1 -- 172.21.15.79:0/3044451019 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ec0116d0 con 0x7f63f4108e20 2024-08-20T01:38:09.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.891+0000 7f63f998d640 1 -- 172.21.15.79:0/3044451019 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63f41a7bd0 con 0x7f63f4108e20 2024-08-20T01:38:09.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.894+0000 7f63f898b640 1 -- 172.21.15.79:0/3044451019 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f63ec0051d0 con 0x7f63f4108e20 2024-08-20T01:38:09.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.894+0000 7f63fbd86740 1 Processor -- start 2024-08-20T01:38:09.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.894+0000 7f63fbd86740 1 -- start start 2024-08-20T01:38:09.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.895+0000 7f63fbd86740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634c90fb880 0x5634c90fbc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:09.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.895+0000 7f63fbd86740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634c90fc1a0 0x5634c9107bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:09.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.895+0000 7f63fbd86740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634c9108130 0x5634c910a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:09.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.895+0000 7f63fbd86740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5634c9072930 con 0x5634c9108130 2024-08-20T01:38:09.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.895+0000 7f63fbd86740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5634c9061e30 con 0x5634c90fb880 2024-08-20T01:38:09.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.895+0000 7f63fbd86740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5634c9065e70 con 0x5634c90fc1a0 2024-08-20T01:38:09.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.895+0000 7f63ea7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634c9108130 0x5634c910a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:09.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.895+0000 7f63ea7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634c9108130 0x5634c910a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35688/0 (socket says 172.21.15.79:35688) 2024-08-20T01:38:09.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.895+0000 7f63ea7fc640 1 -- 172.21.15.79:0/676405942 learned_addr learned my addr 172.21.15.79:0/676405942 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:09.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.895+0000 7f63ea7fc640 1 --2- 172.21.15.79:0/676405942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634c90fb880 0x5634c90fbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:09.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.895+0000 7f63f2ffd640 1 --2- 172.21.15.79:0/676405942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634c90fc1a0 0x5634c9107bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:09.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.895+0000 7f63f898b640 1 --2- 172.21.15.79:0/3044451019 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f63e00b3c50 0x7f63e00b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:09.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.895+0000 7f63ea7fc640 1 -- 172.21.15.79:0/676405942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634c90fc1a0 msgr2=0x5634c9107bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:09.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.895+0000 7f63ea7fc640 1 --2- 172.21.15.79:0/676405942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634c90fc1a0 0x5634c9107bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:09.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.895+0000 7f63ea7fc640 1 -- 172.21.15.79:0/676405942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634c90fb880 msgr2=0x5634c90fbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:09.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.895+0000 7f63ea7fc640 1 --2- 172.21.15.79:0/676405942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634c90fb880 0x5634c90fbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:09.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.895+0000 7f63ea7fc640 1 -- 172.21.15.79:0/676405942 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634c8dc1650 con 0x5634c9108130 2024-08-20T01:38:09.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.895+0000 7f63f898b640 1 -- 172.21.15.79:0/3044451019 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f63ec0e3fa0 con 0x7f63f4108e20 2024-08-20T01:38:09.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.895+0000 7f63ea7fc640 1 --2- 172.21.15.79:0/676405942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634c9108130 0x5634c910a520 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f63dc0127f0 tx=0x7f63dc00b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d8b59ea594b5d3e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:09.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.895+0000 7f63f37fe640 1 --2- 172.21.15.79:0/3044451019 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f63e00b3c50 0x7f63e00b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:09.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.896+0000 7f63e9ffb640 1 -- 172.21.15.79:0/676405942 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63dc012e30 con 0x5634c9108130 2024-08-20T01:38:09.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.896+0000 7f63e9ffb640 1 -- 172.21.15.79:0/676405942 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f63dc010c00 con 0x5634c9108130 2024-08-20T01:38:09.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.896+0000 7f63e9ffb640 1 -- 172.21.15.79:0/676405942 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63dc01e9f0 con 0x5634c9108130 2024-08-20T01:38:09.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.897+0000 7f63fbd86740 1 -- 172.21.15.79:0/676405942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634c9108130 msgr2=0x5634c910a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:09.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.897+0000 7f63f37fe640 1 --2- 172.21.15.79:0/3044451019 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f63e00b3c50 0x7f63e00b6110 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f63ec0e1ab0 tx=0x7f63ec005b40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:09.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.897+0000 7f63fbd86740 1 --2- 172.21.15.79:0/676405942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634c9108130 0x5634c910a520 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f63dc0127f0 tx=0x7f63dc00b7c0 comp rx=0 tx=0).stop 2024-08-20T01:38:09.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.897+0000 7f63fbd86740 1 -- 172.21.15.79:0/676405942 shutdown_connections 2024-08-20T01:38:09.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.897+0000 7f63fbd86740 1 --2- 172.21.15.79:0/676405942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634c9108130 0x5634c910a520 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:09.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.897+0000 7f63fbd86740 1 --2- 172.21.15.79:0/676405942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634c90fc1a0 0x5634c9107bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:09.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.897+0000 7f63fbd86740 1 --2- 172.21.15.79:0/676405942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634c90fb880 0x5634c90fbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:09.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.897+0000 7f63fbd86740 1 -- 172.21.15.79:0/676405942 >> 172.21.15.79:0/676405942 conn(0x5634c90f96b0 msgr2=0x5634c90fa850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:09.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.897+0000 7f63fbd86740 1 -- 172.21.15.79:0/676405942 shutdown_connections 2024-08-20T01:38:09.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.897+0000 7f63fbd86740 1 -- 172.21.15.79:0/676405942 wait complete. 2024-08-20T01:38:09.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.897+0000 7f63fbd86740 1 -- start start 2024-08-20T01:38:09.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.897+0000 7f63fbd86740 1 Processor -- start 2024-08-20T01:38:09.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.898+0000 7f63fbd86740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634c90fb880 0x5634c9105080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:09.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.898+0000 7f63fbd86740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634c90fc1a0 0x5634c91055c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:09.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.898+0000 7f63fbd86740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634c9108130 0x5634c9105b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:09.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.898+0000 7f63f2ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634c90fc1a0 0x5634c91055c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:09.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.898+0000 7f63f2ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634c90fc1a0 0x5634c91055c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35690/0 (socket says 172.21.15.79:35690) 2024-08-20T01:38:09.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.898+0000 7f63f2ffd640 1 -- 172.21.15.79:0/394045504 learned_addr learned my addr 172.21.15.79:0/394045504 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:09.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.898+0000 7f63fbd86740 1 -- 172.21.15.79:0/394045504 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5634c8ec4700 con 0x5634c90fc1a0 2024-08-20T01:38:09.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.898+0000 7f63fbd86740 1 -- 172.21.15.79:0/394045504 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5634c8fe8810 con 0x5634c9108130 2024-08-20T01:38:09.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.898+0000 7f63fbd86740 1 -- 172.21.15.79:0/394045504 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5634c910ae30 con 0x5634c90fb880 2024-08-20T01:38:09.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.898+0000 7f63fbd86740 10 client.0 _ll_register_callbacks cb 0x5634c905b700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:09.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.898+0000 7f63ea7fc640 1 --2- 172.21.15.79:0/394045504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634c90fb880 0x5634c9105080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:09.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.898+0000 7f63ea7fc640 1 --2- 172.21.15.79:0/394045504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634c9108130 0x5634c9105b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:09.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.898+0000 7f63f2ffd640 1 -- 172.21.15.79:0/394045504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634c90fb880 msgr2=0x5634c9105080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:09.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.898+0000 7f63f2ffd640 1 --2- 172.21.15.79:0/394045504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634c90fb880 0x5634c9105080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:09.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.898+0000 7f63f2ffd640 1 -- 172.21.15.79:0/394045504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634c9108130 msgr2=0x5634c9105b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:09.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.898+0000 7f63f2ffd640 1 --2- 172.21.15.79:0/394045504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634c9108130 0x5634c9105b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:09.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.898+0000 7f63f2ffd640 1 -- 172.21.15.79:0/394045504 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634c9114190 con 0x5634c90fc1a0 2024-08-20T01:38:09.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.898+0000 7f63ea7fc640 1 --2- 172.21.15.79:0/394045504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634c9108130 0x5634c9105b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:38:09.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.898+0000 7f63f2ffd640 1 --2- 172.21.15.79:0/394045504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634c90fc1a0 0x5634c91055c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f63e402a930 tx=0x7f63e4031e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be184b7061a33033 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:09.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.899+0000 7f63d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:38:09.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.899+0000 7f63d2ffd640 1 -- 172.21.15.79:0/394045504 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e4035070 con 0x5634c90fc1a0 2024-08-20T01:38:09.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.899+0000 7f63d2ffd640 1 -- 172.21.15.79:0/394045504 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f63e4004040 con 0x5634c90fc1a0 2024-08-20T01:38:09.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.899+0000 7f63fbd86740 1 -- 172.21.15.79:0/394045504 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5634c9011150 con 0x5634c90fc1a0 2024-08-20T01:38:09.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.899+0000 7f63d2ffd640 1 -- 172.21.15.79:0/394045504 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f63e4004240 con 0x5634c90fc1a0 2024-08-20T01:38:09.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.899+0000 7f63fbd86740 10 client.15873 fetch_fsmap learned FSMap version 28 2024-08-20T01:38:09.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.899+0000 7f63fbd86740 1 -- 172.21.15.79:0/394045504 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5634c9116b20 con 0x5634c90fc1a0 2024-08-20T01:38:09.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.899+0000 7f63d2ffd640 1 -- 172.21.15.79:0/394045504 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5634c9011150 con 0x5634c90fc1a0 2024-08-20T01:38:09.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.899+0000 7f63d2ffd640 1 -- 172.21.15.79:0/394045504 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f63e4043020 con 0x5634c90fc1a0 2024-08-20T01:38:09.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.899+0000 7f63fbd86740 10 client.15873 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:38:09.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.899+0000 7f63fbd86740 10 client.15873 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:38:09.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.899+0000 7f63fbd86740 20 client.15873 populate_metadata read hostname 'smithi079' 2024-08-20T01:38:09.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.899+0000 7f63fbd86740 1 --2- 172.21.15.79:0/394045504 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x5634c91183f0 0x5634c911a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:09.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.899+0000 7f63fbd86740 4 client.15873 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:38:09.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.899+0000 7f63fbd86740 1 -- 172.21.15.79:0/394045504 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5634c9074880 con 0x5634c91183f0 2024-08-20T01:38:09.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.900+0000 7f63ea7fc640 1 --2- 172.21.15.79:0/394045504 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x5634c91183f0 0x5634c911a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:09.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.900+0000 7f63d2ffd640 10 client.15873 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:38:09.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.900+0000 7f63ea7fc640 1 --2- 172.21.15.79:0/394045504 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x5634c91183f0 0x5634c911a850 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=556a6e48a73458ab server_cookie=6b46352e6f83e139 in_seq=0 out_seq=0 2024-08-20T01:38:09.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.901+0000 7f63d2ffd640 1 -- 172.21.15.79:0/394045504 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5634c9074880 con 0x5634c91183f0 2024-08-20T01:38:09.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.901+0000 7f63d2ffd640 10 client.15873 handle_command_reply: tid=0 2024-08-20T01:38:09.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.901+0000 7f63fbd86740 1 client.15873 shutdown 2024-08-20T01:38:09.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.901+0000 7f63fbd86740 1 -- 172.21.15.79:0/394045504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634c90fc1a0 msgr2=0x5634c91055c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:09.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.901+0000 7f63fbd86740 1 --2- 172.21.15.79:0/394045504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634c90fc1a0 0x5634c91055c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f63e402a930 tx=0x7f63e4031e70 comp rx=0 tx=0).stop 2024-08-20T01:38:09.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.902+0000 7f63fbd86740 1 -- 172.21.15.79:0/394045504 shutdown_connections 2024-08-20T01:38:09.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.902+0000 7f63fbd86740 1 --2- 172.21.15.79:0/394045504 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x5634c91183f0 0x5634c911a850 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:09.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.902+0000 7f63fbd86740 1 --2- 172.21.15.79:0/394045504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634c9108130 0x5634c9105b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:09.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.902+0000 7f63d2ffd640 0 client.15873 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:38:09.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.902+0000 7f63fbd86740 1 --2- 172.21.15.79:0/394045504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634c90fc1a0 0x5634c91055c0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:09.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.902+0000 7f63fbd86740 1 --2- 172.21.15.79:0/394045504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634c90fb880 0x5634c9105080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:09.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.902+0000 7f63fbd86740 1 -- 172.21.15.79:0/394045504 >> 172.21.15.79:0/394045504 conn(0x5634c90f96b0 msgr2=0x5634c90ff220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:09.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.902+0000 7f63fbd86740 1 -- 172.21.15.79:0/394045504 shutdown_connections 2024-08-20T01:38:09.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.902+0000 7f63fbd86740 1 -- 172.21.15.79:0/394045504 wait complete. 2024-08-20T01:38:09.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.902+0000 7f63fbd86740 20 client.15873 trim_cache size 0 max 16384 2024-08-20T01:38:09.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.920+0000 7f63fbd86740 1 Processor -- start 2024-08-20T01:38:09.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.920+0000 7f63fbd86740 1 -- start start 2024-08-20T01:38:09.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.921+0000 7f63fbd86740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634c90fb880 0x5634c90fad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:09.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.921+0000 7f63fbd86740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634c90fc1a0 0x5634c9106dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:09.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.921+0000 7f63fbd86740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634c9108130 0x5634c9105580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:09.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.921+0000 7f63fbd86740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f63f41b01f0 con 0x5634c90fb880 2024-08-20T01:38:09.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.921+0000 7f63fbd86740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f63f41b1d30 con 0x5634c90fc1a0 2024-08-20T01:38:09.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.921+0000 7f63fbd86740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f63f41b08c0 con 0x5634c9108130 2024-08-20T01:38:09.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.921+0000 7f63ea7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634c90fb880 0x5634c90fad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:09.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.921+0000 7f63ea7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634c90fb880 0x5634c90fad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35700/0 (socket says 172.21.15.79:35700) 2024-08-20T01:38:09.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.921+0000 7f63ea7fc640 1 -- 172.21.15.79:0/1069905586 learned_addr learned my addr 172.21.15.79:0/1069905586 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:09.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.921+0000 7f63f2ffd640 1 --2- 172.21.15.79:0/1069905586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634c90fc1a0 0x5634c9106dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:09.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.921+0000 7f63ea7fc640 1 -- 172.21.15.79:0/1069905586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634c9108130 msgr2=0x5634c9105580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:09.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.921+0000 7f63ea7fc640 1 --2- 172.21.15.79:0/1069905586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634c9108130 0x5634c9105580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:09.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.921+0000 7f63ea7fc640 1 -- 172.21.15.79:0/1069905586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634c90fc1a0 msgr2=0x5634c9106dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:09.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.921+0000 7f63ea7fc640 1 --2- 172.21.15.79:0/1069905586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634c90fc1a0 0x5634c9106dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:09.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.921+0000 7f63ea7fc640 1 -- 172.21.15.79:0/1069905586 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634c90fbfd0 con 0x5634c90fb880 2024-08-20T01:38:09.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.921+0000 7f63f2ffd640 1 --2- 172.21.15.79:0/1069905586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634c90fc1a0 0x5634c9106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:09.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.921+0000 7f63ea7fc640 1 --2- 172.21.15.79:0/1069905586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634c90fb880 0x5634c90fad70 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x5634c90fb830 tx=0x7f63dc012560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b84764edcd54fc6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:09.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.922+0000 7f63e97fa640 1 -- 172.21.15.79:0/1069905586 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63dc024040 con 0x5634c90fb880 2024-08-20T01:38:09.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.922+0000 7f63e97fa640 1 -- 172.21.15.79:0/1069905586 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f63dc02f070 con 0x5634c90fb880 2024-08-20T01:38:09.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.922+0000 7f63e97fa640 1 -- 172.21.15.79:0/1069905586 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63dc010740 con 0x5634c90fb880 2024-08-20T01:38:09.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.922+0000 7f63fbd86740 1 -- 172.21.15.79:0/1069905586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634c90fb880 msgr2=0x5634c90fad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:09.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.922+0000 7f63fbd86740 1 --2- 172.21.15.79:0/1069905586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634c90fb880 0x5634c90fad70 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x5634c90fb830 tx=0x7f63dc012560 comp rx=0 tx=0).stop 2024-08-20T01:38:09.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.922+0000 7f63fbd86740 1 -- 172.21.15.79:0/1069905586 shutdown_connections 2024-08-20T01:38:09.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.922+0000 7f63fbd86740 1 --2- 172.21.15.79:0/1069905586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634c9108130 0x5634c9105580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:09.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.922+0000 7f63fbd86740 1 --2- 172.21.15.79:0/1069905586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634c90fc1a0 0x5634c9106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:09.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.922+0000 7f63fbd86740 1 --2- 172.21.15.79:0/1069905586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634c90fb880 0x5634c90fad70 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:09.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.922+0000 7f63fbd86740 1 -- 172.21.15.79:0/1069905586 >> 172.21.15.79:0/1069905586 conn(0x5634c90f96b0 msgr2=0x5634c91066b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:09.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.923+0000 7f63fbd86740 1 -- 172.21.15.79:0/1069905586 shutdown_connections 2024-08-20T01:38:09.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.923+0000 7f63fbd86740 1 -- 172.21.15.79:0/1069905586 wait complete. 2024-08-20T01:38:09.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.923+0000 7f63fbd86740 1 -- start start 2024-08-20T01:38:09.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.923+0000 7f63fbd86740 1 Processor -- start 2024-08-20T01:38:09.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.923+0000 7f63fbd86740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634c90fb880 0x5634c910b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:09.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.923+0000 7f63fbd86740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634c90fc1a0 0x5634c910b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:09.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.923+0000 7f63fbd86740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634c9108130 0x5634c910bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:09.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.923+0000 7f63fbd86740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f63f41b1660 con 0x5634c9108130 2024-08-20T01:38:09.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.923+0000 7f63fbd86740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f63f41b0f90 con 0x5634c90fc1a0 2024-08-20T01:38:09.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.923+0000 7f63fbd86740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f63f41ae1d0 con 0x5634c90fb880 2024-08-20T01:38:09.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.923+0000 7f63fbd86740 10 client.0 _ll_register_callbacks cb 0x7f63e4005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:09.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.924+0000 7f63ea7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634c9108130 0x5634c910bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:09.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.924+0000 7f63ea7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634c9108130 0x5634c910bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35702/0 (socket says 172.21.15.79:35702) 2024-08-20T01:38:09.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.924+0000 7f63ea7fc640 1 -- 172.21.15.79:0/1061208900 learned_addr learned my addr 172.21.15.79:0/1061208900 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:09.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.924+0000 7f63ea7fc640 1 --2- 172.21.15.79:0/1061208900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634c90fb880 0x5634c910b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:09.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.924+0000 7f63f2ffd640 1 --2- 172.21.15.79:0/1061208900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634c90fc1a0 0x5634c910b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:09.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.924+0000 7f63ea7fc640 1 -- 172.21.15.79:0/1061208900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634c90fb880 msgr2=0x5634c910b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:09.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.924+0000 7f63ea7fc640 1 --2- 172.21.15.79:0/1061208900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634c90fb880 0x5634c910b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:09.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.924+0000 7f63ea7fc640 1 -- 172.21.15.79:0/1061208900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634c90fc1a0 msgr2=0x5634c910b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:09.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.924+0000 7f63ea7fc640 1 --2- 172.21.15.79:0/1061208900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634c90fc1a0 0x5634c910b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:09.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.924+0000 7f63ea7fc640 1 -- 172.21.15.79:0/1061208900 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634c91812a0 con 0x5634c9108130 2024-08-20T01:38:09.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.924+0000 7f63ea7fc640 1 --2- 172.21.15.79:0/1061208900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634c9108130 0x5634c910bb00 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f63dc0125d0 tx=0x7f63dc01b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0e353f195ae2ea7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:09.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.924+0000 7f63d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:38:09.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.924+0000 7f63d2ffd640 1 -- 172.21.15.79:0/1061208900 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63dc024040 con 0x5634c9108130 2024-08-20T01:38:09.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.924+0000 7f63d2ffd640 1 -- 172.21.15.79:0/1061208900 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f63dc01e700 con 0x5634c9108130 2024-08-20T01:38:09.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.924+0000 7f63fbd86740 1 -- 172.21.15.79:0/1061208900 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63dc02f070 con 0x5634c9108130 2024-08-20T01:38:09.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.925+0000 7f63d2ffd640 1 -- 172.21.15.79:0/1061208900 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f63dc01e900 con 0x5634c9108130 2024-08-20T01:38:09.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.925+0000 7f63fbd86740 10 client.15879 fetch_fsmap learned FSMap version 28 2024-08-20T01:38:09.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.925+0000 7f63fbd86740 1 -- 172.21.15.79:0/1061208900 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5634c91825a0 con 0x5634c9108130 2024-08-20T01:38:09.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.925+0000 7f63d2ffd640 1 -- 172.21.15.79:0/1061208900 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f63dc02f070 con 0x5634c9108130 2024-08-20T01:38:09.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.925+0000 7f63d2ffd640 1 -- 172.21.15.79:0/1061208900 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f63dc041030 con 0x5634c9108130 2024-08-20T01:38:09.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.925+0000 7f63fbd86740 10 client.15879 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:38:09.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.925+0000 7f63fbd86740 10 client.15879 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:38:09.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.925+0000 7f63fbd86740 20 client.15879 populate_metadata read hostname 'smithi079' 2024-08-20T01:38:09.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.925+0000 7f63fbd86740 1 --2- 172.21.15.79:0/1061208900 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x5634c91183f0 0x5634c9184a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:09.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.925+0000 7f63fbd86740 4 client.15879 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:38:09.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.925+0000 7f63fbd86740 1 -- 172.21.15.79:0/1061208900 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5634c9070320 con 0x5634c91183f0 2024-08-20T01:38:09.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.925+0000 7f63f2ffd640 1 --2- 172.21.15.79:0/1061208900 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x5634c91183f0 0x5634c9184a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:09.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.926+0000 7f63f2ffd640 1 --2- 172.21.15.79:0/1061208900 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x5634c91183f0 0x5634c9184a60 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b9ed1dfb14e4e775 server_cookie=153500cf40bcc1e3 in_seq=0 out_seq=0 2024-08-20T01:38:09.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.926+0000 7f63d2ffd640 10 client.15879 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:38:09.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.926+0000 7f63d2ffd640 1 -- 172.21.15.79:0/1061208900 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5634c9070320 con 0x5634c91183f0 2024-08-20T01:38:09.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.926+0000 7f63d2ffd640 10 client.15879 handle_command_reply: tid=0 2024-08-20T01:38:09.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.926+0000 7f63fbd86740 1 client.15879 shutdown 2024-08-20T01:38:09.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.926+0000 7f63fbd86740 1 -- 172.21.15.79:0/1061208900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634c9108130 msgr2=0x5634c910bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:09.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.926+0000 7f63fbd86740 1 --2- 172.21.15.79:0/1061208900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634c9108130 0x5634c910bb00 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f63dc0125d0 tx=0x7f63dc01b040 comp rx=0 tx=0).stop 2024-08-20T01:38:09.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.926+0000 7f63fbd86740 1 -- 172.21.15.79:0/1061208900 shutdown_connections 2024-08-20T01:38:09.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.926+0000 7f63fbd86740 1 --2- 172.21.15.79:0/1061208900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634c9108130 0x5634c910bb00 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:09.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.926+0000 7f63fbd86740 1 --2- 172.21.15.79:0/1061208900 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x5634c91183f0 0x5634c9184a60 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:09.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.926+0000 7f63fbd86740 1 --2- 172.21.15.79:0/1061208900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634c90fc1a0 0x5634c910b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:09.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.926+0000 7f63fbd86740 1 --2- 172.21.15.79:0/1061208900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634c90fb880 0x5634c910b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:09.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.926+0000 7f63d2ffd640 0 client.15879 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:38:09.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.926+0000 7f63fbd86740 1 -- 172.21.15.79:0/1061208900 >> 172.21.15.79:0/1061208900 conn(0x5634c90f96b0 msgr2=0x5634c90f8770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:09.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.926+0000 7f63fbd86740 1 -- 172.21.15.79:0/1061208900 shutdown_connections 2024-08-20T01:38:09.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.926+0000 7f63fbd86740 1 -- 172.21.15.79:0/1061208900 wait complete. 2024-08-20T01:38:09.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.926+0000 7f63fbd86740 20 client.15879 trim_cache size 0 max 16384 2024-08-20T01:38:09.036 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:38:09.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.927+0000 7f63f998d640 1 -- 172.21.15.79:0/3044451019 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f63e00b3c50 msgr2=0x7f63e00b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:09.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.927+0000 7f63f998d640 1 --2- 172.21.15.79:0/3044451019 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f63e00b3c50 0x7f63e00b6110 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f63ec0e1ab0 tx=0x7f63ec005b40 comp rx=0 tx=0).stop 2024-08-20T01:38:09.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.927+0000 7f63f998d640 1 -- 172.21.15.79:0/3044451019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63f4108e20 msgr2=0x7f63f4075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:09.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.927+0000 7f63f998d640 1 --2- 172.21.15.79:0/3044451019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63f4108e20 0x7f63f4075c50 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f63ec00eaa0 tx=0x7f63ec00ef60 comp rx=0 tx=0).stop 2024-08-20T01:38:09.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.927+0000 7f63f998d640 1 -- 172.21.15.79:0/3044451019 shutdown_connections 2024-08-20T01:38:09.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.927+0000 7f63f998d640 1 --2- 172.21.15.79:0/3044451019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63f4108e20 0x7f63f4075c50 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:09.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.927+0000 7f63f998d640 1 --2- 172.21.15.79:0/3044451019 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f63e00b3c50 0x7f63e00b6110 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:09.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.927+0000 7f63f998d640 1 --2- 172.21.15.79:0/3044451019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63f41084a0 0x7f63f4075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:09.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.927+0000 7f63f998d640 1 --2- 172.21.15.79:0/3044451019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63f4102a90 0x7f63f40751d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:09.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.927+0000 7f63f998d640 1 -- 172.21.15.79:0/3044451019 >> 172.21.15.79:0/3044451019 conn(0x7f63f40fe540 msgr2=0x7f63f40fff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:09.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.927+0000 7f63f998d640 1 -- 172.21.15.79:0/3044451019 shutdown_connections 2024-08-20T01:38:09.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:08.927+0000 7f63f998d640 1 -- 172.21.15.79:0/3044451019 wait complete. 2024-08-20T01:38:09.726 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T01:38:09.995 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:38:10.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.468+0000 7f5df888b640 1 -- 172.21.15.79:0/560526698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5df4107d20 msgr2=0x7f5df410e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:10.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.468+0000 7f5df888b640 1 --2- 172.21.15.79:0/560526698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5df4107d20 0x7f5df410e520 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f5dec009ca0 tx=0x7f5dec02a8c0 comp rx=0 tx=0).stop 2024-08-20T01:38:10.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.468+0000 7f5df888b640 1 -- 172.21.15.79:0/560526698 shutdown_connections 2024-08-20T01:38:10.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.468+0000 7f5df888b640 1 --2- 172.21.15.79:0/560526698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5df4107d20 0x7f5df410e520 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:10.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.468+0000 7f5df888b640 1 --2- 172.21.15.79:0/560526698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5df41073a0 0x7f5df41077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:10.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.468+0000 7f5df888b640 1 --2- 172.21.15.79:0/560526698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5df4101990 0x7f5df4101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:10.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.468+0000 7f5df888b640 1 -- 172.21.15.79:0/560526698 >> 172.21.15.79:0/560526698 conn(0x7f5df40fd400 msgr2=0x7f5df40ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:10.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.468+0000 7f5df888b640 1 -- 172.21.15.79:0/560526698 shutdown_connections 2024-08-20T01:38:10.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.468+0000 7f5df888b640 1 -- 172.21.15.79:0/560526698 wait complete. 2024-08-20T01:38:10.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.469+0000 7f5df888b640 1 Processor -- start 2024-08-20T01:38:10.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.469+0000 7f5df888b640 1 -- start start 2024-08-20T01:38:10.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.469+0000 7f5df888b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5df4101990 0x7f5df4199c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:10.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.469+0000 7f5df888b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5df41073a0 0x7f5df419a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:10.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.469+0000 7f5df888b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5df4107d20 0x7f5df419a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:10.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.469+0000 7f5df888b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5df41118e0 con 0x7f5df41073a0 2024-08-20T01:38:10.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.469+0000 7f5df888b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5df4111760 con 0x7f5df4101990 2024-08-20T01:38:10.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.469+0000 7f5df888b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5df4111a60 con 0x7f5df4107d20 2024-08-20T01:38:10.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.470+0000 7f5df1d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5df41073a0 0x7f5df419a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:10.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.470+0000 7f5df1d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5df41073a0 0x7f5df419a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49318/0 (socket says 172.21.15.79:49318) 2024-08-20T01:38:10.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.470+0000 7f5df1d9b640 1 -- 172.21.15.79:0/3715141232 learned_addr learned my addr 172.21.15.79:0/3715141232 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:10.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.470+0000 7f5df259c640 1 --2- 172.21.15.79:0/3715141232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5df4101990 0x7f5df4199c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:10.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.470+0000 7f5df2d9d640 1 --2- 172.21.15.79:0/3715141232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5df4107d20 0x7f5df419a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:10.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.470+0000 7f5df1d9b640 1 -- 172.21.15.79:0/3715141232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5df4107d20 msgr2=0x7f5df419a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:10.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.470+0000 7f5df1d9b640 1 --2- 172.21.15.79:0/3715141232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5df4107d20 0x7f5df419a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:10.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.470+0000 7f5df1d9b640 1 -- 172.21.15.79:0/3715141232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5df4101990 msgr2=0x7f5df4199c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:10.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.470+0000 7f5df1d9b640 1 --2- 172.21.15.79:0/3715141232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5df4101990 0x7f5df4199c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:10.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.470+0000 7f5df1d9b640 1 -- 172.21.15.79:0/3715141232 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5df41a5070 con 0x7f5df41073a0 2024-08-20T01:38:10.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.470+0000 7f5df2d9d640 1 --2- 172.21.15.79:0/3715141232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5df4107d20 0x7f5df419a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:38:10.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.470+0000 7f5df1d9b640 1 --2- 172.21.15.79:0/3715141232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5df41073a0 0x7f5df419a1d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f5de800d950 tx=0x7f5de800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:10.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.470+0000 7f5de37fe640 1 -- 172.21.15.79:0/3715141232 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de8017070 con 0x7f5df41073a0 2024-08-20T01:38:10.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.470+0000 7f5df888b640 1 -- 172.21.15.79:0/3715141232 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5df41a5360 con 0x7f5df41073a0 2024-08-20T01:38:10.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.470+0000 7f5de37fe640 1 -- 172.21.15.79:0/3715141232 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5de8009c30 con 0x7f5df41073a0 2024-08-20T01:38:10.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.470+0000 7f5de37fe640 1 -- 172.21.15.79:0/3715141232 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de800f620 con 0x7f5df41073a0 2024-08-20T01:38:10.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.470+0000 7f5df888b640 1 -- 172.21.15.79:0/3715141232 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5df41a58f0 con 0x7f5df41073a0 2024-08-20T01:38:10.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.473+0000 7f5de37fe640 1 -- 172.21.15.79:0/3715141232 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5de8010460 con 0x7f5df41073a0 2024-08-20T01:38:10.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.473+0000 7f5dfac84740 1 Processor -- start 2024-08-20T01:38:10.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.474+0000 7f5dfac84740 1 -- start start 2024-08-20T01:38:10.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.474+0000 7f5dfac84740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cea3d11880 0x55cea3d11c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:10.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.474+0000 7f5dfac84740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cea3d121a0 0x55cea3d1dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:10.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.474+0000 7f5dfac84740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cea3d1e130 0x55cea3d20520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:10.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.474+0000 7f5dfac84740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55cea3c88930 con 0x55cea3d1e130 2024-08-20T01:38:10.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.474+0000 7f5dfac84740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55cea3c77e30 con 0x55cea3d121a0 2024-08-20T01:38:10.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.474+0000 7f5dfac84740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55cea3c7be70 con 0x55cea3d11880 2024-08-20T01:38:10.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.474+0000 7f5df1d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cea3d1e130 0x55cea3d20520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:10.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.474+0000 7f5df1d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cea3d1e130 0x55cea3d20520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49330/0 (socket says 172.21.15.79:49330) 2024-08-20T01:38:10.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.474+0000 7f5df1d9b640 1 -- 172.21.15.79:0/3668770068 learned_addr learned my addr 172.21.15.79:0/3668770068 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:10.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.474+0000 7f5de37fe640 1 --2- 172.21.15.79:0/3715141232 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5ddc0b3bd0 0x7f5ddc0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:10.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.474+0000 7f5df2d9d640 1 --2- 172.21.15.79:0/3715141232 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5ddc0b3bd0 0x7f5ddc0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:10.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.474+0000 7f5df1d9b640 1 -- 172.21.15.79:0/3668770068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cea3d11880 msgr2=0x55cea3d11c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:10.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.474+0000 7f5df1d9b640 1 --2- 172.21.15.79:0/3668770068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cea3d11880 0x55cea3d11c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:10.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.474+0000 7f5df259c640 1 --2- 172.21.15.79:0/3668770068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cea3d121a0 0x55cea3d1dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:10.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.474+0000 7f5df1d9b640 1 -- 172.21.15.79:0/3668770068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cea3d121a0 msgr2=0x55cea3d1dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:10.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.474+0000 7f5df1d9b640 1 --2- 172.21.15.79:0/3668770068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cea3d121a0 0x55cea3d1dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:10.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.475+0000 7f5df1d9b640 1 -- 172.21.15.79:0/3668770068 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cea39d7650 con 0x55cea3d1e130 2024-08-20T01:38:10.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.475+0000 7f5df259c640 1 --2- 172.21.15.79:0/3668770068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cea3d121a0 0x55cea3d1dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:38:10.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.475+0000 7f5de37fe640 1 -- 172.21.15.79:0/3715141232 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f5de80e38b0 con 0x7f5df41073a0 2024-08-20T01:38:10.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.475+0000 7f5df1d9b640 1 --2- 172.21.15.79:0/3668770068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cea3d1e130 0x55cea3d20520 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5de80e1300 tx=0x7f5de8063f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e74acd26229d7e5e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:10.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.475+0000 7f5df2d9d640 1 --2- 172.21.15.79:0/3715141232 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5ddc0b3bd0 0x7f5ddc0b6090 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5dec004af0 tx=0x7f5dec004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:10.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.475+0000 7f5de0ff9640 1 -- 172.21.15.79:0/3668770068 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de80aa160 con 0x55cea3d1e130 2024-08-20T01:38:10.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.475+0000 7f5de0ff9640 1 -- 172.21.15.79:0/3668770068 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5de80aaf10 con 0x55cea3d1e130 2024-08-20T01:38:10.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.475+0000 7f5de0ff9640 1 -- 172.21.15.79:0/3668770068 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de80a9f80 con 0x55cea3d1e130 2024-08-20T01:38:10.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.476+0000 7f5dfac84740 1 -- 172.21.15.79:0/3668770068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cea3d1e130 msgr2=0x55cea3d20520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:10.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.476+0000 7f5dfac84740 1 --2- 172.21.15.79:0/3668770068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cea3d1e130 0x55cea3d20520 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5de80e1300 tx=0x7f5de8063f10 comp rx=0 tx=0).stop 2024-08-20T01:38:10.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.476+0000 7f5dfac84740 1 -- 172.21.15.79:0/3668770068 shutdown_connections 2024-08-20T01:38:10.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.476+0000 7f5dfac84740 1 --2- 172.21.15.79:0/3668770068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cea3d1e130 0x55cea3d20520 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:10.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.476+0000 7f5dfac84740 1 --2- 172.21.15.79:0/3668770068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cea3d121a0 0x55cea3d1dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:10.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.476+0000 7f5dfac84740 1 --2- 172.21.15.79:0/3668770068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cea3d11880 0x55cea3d11c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:10.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.476+0000 7f5dfac84740 1 -- 172.21.15.79:0/3668770068 >> 172.21.15.79:0/3668770068 conn(0x55cea3d0f6b0 msgr2=0x55cea3d10850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:10.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.476+0000 7f5dfac84740 1 -- 172.21.15.79:0/3668770068 shutdown_connections 2024-08-20T01:38:10.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.476+0000 7f5dfac84740 1 -- 172.21.15.79:0/3668770068 wait complete. 2024-08-20T01:38:10.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.476+0000 7f5dfac84740 1 -- start start 2024-08-20T01:38:10.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.476+0000 7f5dfac84740 1 Processor -- start 2024-08-20T01:38:10.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.477+0000 7f5dfac84740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cea3d11880 0x55cea3d1b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:10.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.477+0000 7f5dfac84740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cea3d121a0 0x55cea3d1b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:10.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.477+0000 7f5dfac84740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cea3d1e130 0x55cea3d1bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:10.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.477+0000 7f5dfac84740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55cea3ada700 con 0x55cea3d1e130 2024-08-20T01:38:10.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.477+0000 7f5dfac84740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55cea3bfe810 con 0x55cea3d121a0 2024-08-20T01:38:10.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.477+0000 7f5dfac84740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55cea3d20d80 con 0x55cea3d11880 2024-08-20T01:38:10.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.477+0000 7f5dfac84740 10 client.0 _ll_register_callbacks cb 0x55cea3c71700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:10.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.477+0000 7f5df2d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cea3d1e130 0x55cea3d1bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:10.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.477+0000 7f5df2d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cea3d1e130 0x55cea3d1bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49334/0 (socket says 172.21.15.79:49334) 2024-08-20T01:38:10.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.477+0000 7f5df2d9d640 1 -- 172.21.15.79:0/4201668000 learned_addr learned my addr 172.21.15.79:0/4201668000 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:10.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.477+0000 7f5df1d9b640 1 --2- 172.21.15.79:0/4201668000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cea3d121a0 0x55cea3d1b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:10.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.477+0000 7f5df259c640 1 --2- 172.21.15.79:0/4201668000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cea3d11880 0x55cea3d1b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:10.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.477+0000 7f5df2d9d640 1 -- 172.21.15.79:0/4201668000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cea3d11880 msgr2=0x55cea3d1b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:10.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.477+0000 7f5df2d9d640 1 --2- 172.21.15.79:0/4201668000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cea3d11880 0x55cea3d1b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:10.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.477+0000 7f5df2d9d640 1 -- 172.21.15.79:0/4201668000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cea3d121a0 msgr2=0x55cea3d1b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:10.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.477+0000 7f5df2d9d640 1 --2- 172.21.15.79:0/4201668000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cea3d121a0 0x55cea3d1b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:10.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.477+0000 7f5df2d9d640 1 -- 172.21.15.79:0/4201668000 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cea3d2a0e0 con 0x55cea3d1e130 2024-08-20T01:38:10.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.477+0000 7f5df2d9d640 1 --2- 172.21.15.79:0/4201668000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cea3d1e130 0x55cea3d1bae0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f5dec0314f0 tx=0x7f5dec02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3daa3b236f790550 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:10.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.477+0000 7f5dd9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:38:10.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.477+0000 7f5dd9ffb640 1 -- 172.21.15.79:0/4201668000 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dec04c070 con 0x55cea3d1e130 2024-08-20T01:38:10.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.478+0000 7f5dd9ffb640 1 -- 172.21.15.79:0/4201668000 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f5dec004450 con 0x55cea3d1e130 2024-08-20T01:38:10.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.478+0000 7f5dfac84740 1 -- 172.21.15.79:0/4201668000 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cea3c27150 con 0x55cea3d1e130 2024-08-20T01:38:10.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.478+0000 7f5dd9ffb640 1 -- 172.21.15.79:0/4201668000 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5dec004650 con 0x55cea3d1e130 2024-08-20T01:38:10.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.478+0000 7f5dfac84740 10 client.15891 fetch_fsmap learned FSMap version 28 2024-08-20T01:38:10.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.478+0000 7f5dfac84740 1 -- 172.21.15.79:0/4201668000 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cea3d2c9e0 con 0x55cea3d1e130 2024-08-20T01:38:10.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.478+0000 7f5dd9ffb640 1 -- 172.21.15.79:0/4201668000 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55cea3c27150 con 0x55cea3d1e130 2024-08-20T01:38:10.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.478+0000 7f5dd9ffb640 1 -- 172.21.15.79:0/4201668000 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5dec045050 con 0x55cea3d1e130 2024-08-20T01:38:10.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.478+0000 7f5dfac84740 10 client.15891 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:38:10.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.478+0000 7f5dfac84740 10 client.15891 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:38:10.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.478+0000 7f5dfac84740 20 client.15891 populate_metadata read hostname 'smithi079' 2024-08-20T01:38:10.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.478+0000 7f5dfac84740 1 --2- 172.21.15.79:0/4201668000 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55cea3d2de90 0x55cea3d302f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:10.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.478+0000 7f5dfac84740 4 client.15891 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:38:10.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.478+0000 7f5dfac84740 1 -- 172.21.15.79:0/4201668000 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cea3c8a880 con 0x55cea3d2de90 2024-08-20T01:38:10.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.479+0000 7f5df259c640 1 --2- 172.21.15.79:0/4201668000 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55cea3d2de90 0x55cea3d302f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:10.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.479+0000 7f5dd9ffb640 10 client.15891 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:10.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.479+0000 7f5df259c640 1 --2- 172.21.15.79:0/4201668000 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55cea3d2de90 0x55cea3d302f0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8e8d86d9a12699b server_cookie=261a5b14003a3a2a in_seq=0 out_seq=0 2024-08-20T01:38:10.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.480+0000 7f5dd9ffb640 1 -- 172.21.15.79:0/4201668000 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cea3c8a880 con 0x55cea3d2de90 2024-08-20T01:38:10.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.480+0000 7f5dd9ffb640 10 client.15891 handle_command_reply: tid=0 2024-08-20T01:38:10.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.480+0000 7f5dfac84740 1 client.15891 shutdown 2024-08-20T01:38:10.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.480+0000 7f5dfac84740 1 -- 172.21.15.79:0/4201668000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cea3d1e130 msgr2=0x55cea3d1bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:10.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.480+0000 7f5dfac84740 1 --2- 172.21.15.79:0/4201668000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cea3d1e130 0x55cea3d1bae0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f5dec0314f0 tx=0x7f5dec02a8c0 comp rx=0 tx=0).stop 2024-08-20T01:38:10.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.480+0000 7f5dfac84740 1 -- 172.21.15.79:0/4201668000 shutdown_connections 2024-08-20T01:38:10.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.480+0000 7f5dfac84740 1 --2- 172.21.15.79:0/4201668000 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55cea3d2de90 0x55cea3d302f0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:10.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.480+0000 7f5dfac84740 1 --2- 172.21.15.79:0/4201668000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cea3d1e130 0x55cea3d1bae0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:10.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.480+0000 7f5dfac84740 1 --2- 172.21.15.79:0/4201668000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cea3d121a0 0x55cea3d1b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:10.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.480+0000 7f5dd9ffb640 0 client.15891 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:10.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.480+0000 7f5dfac84740 1 --2- 172.21.15.79:0/4201668000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cea3d11880 0x55cea3d1b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:10.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.480+0000 7f5dfac84740 1 -- 172.21.15.79:0/4201668000 >> 172.21.15.79:0/4201668000 conn(0x55cea3d0f6b0 msgr2=0x55cea3d15250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:10.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.480+0000 7f5dfac84740 1 -- 172.21.15.79:0/4201668000 shutdown_connections 2024-08-20T01:38:10.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.480+0000 7f5dfac84740 1 -- 172.21.15.79:0/4201668000 wait complete. 2024-08-20T01:38:10.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.480+0000 7f5dfac84740 20 client.15891 trim_cache size 0 max 16384 2024-08-20T01:38:10.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.495+0000 7f5dfac84740 1 Processor -- start 2024-08-20T01:38:10.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.495+0000 7f5dfac84740 1 -- start start 2024-08-20T01:38:10.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.495+0000 7f5dfac84740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cea3d11880 0x55cea3d10d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:10.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.495+0000 7f5dfac84740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cea3d121a0 0x55cea3d1cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:10.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.495+0000 7f5dfac84740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cea3d1e130 0x55cea3d35bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:10.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.495+0000 7f5dfac84740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5df41ae000 con 0x55cea3d1e130 2024-08-20T01:38:10.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.495+0000 7f5dfac84740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5df41afb40 con 0x55cea3d11880 2024-08-20T01:38:10.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.495+0000 7f5dfac84740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5df41ae6d0 con 0x55cea3d121a0 2024-08-20T01:38:10.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.496+0000 7f5df2d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cea3d1e130 0x55cea3d35bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:10.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.496+0000 7f5df2d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cea3d1e130 0x55cea3d35bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49336/0 (socket says 172.21.15.79:49336) 2024-08-20T01:38:10.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.496+0000 7f5df2d9d640 1 -- 172.21.15.79:0/3499850543 learned_addr learned my addr 172.21.15.79:0/3499850543 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:10.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.496+0000 7f5df259c640 1 --2- 172.21.15.79:0/3499850543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cea3d11880 0x55cea3d10d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:10.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.496+0000 7f5df1d9b640 1 --2- 172.21.15.79:0/3499850543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cea3d121a0 0x55cea3d1cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:10.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.496+0000 7f5df2d9d640 1 -- 172.21.15.79:0/3499850543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cea3d121a0 msgr2=0x55cea3d1cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:10.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.496+0000 7f5df2d9d640 1 --2- 172.21.15.79:0/3499850543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cea3d121a0 0x55cea3d1cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:10.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.496+0000 7f5df2d9d640 1 -- 172.21.15.79:0/3499850543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cea3d11880 msgr2=0x55cea3d10d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:10.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.496+0000 7f5df2d9d640 1 --2- 172.21.15.79:0/3499850543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cea3d11880 0x55cea3d10d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:10.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.496+0000 7f5df2d9d640 1 -- 172.21.15.79:0/3499850543 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cea3d11fd0 con 0x55cea3d1e130 2024-08-20T01:38:10.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.496+0000 7f5df1d9b640 1 --2- 172.21.15.79:0/3499850543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cea3d121a0 0x55cea3d1cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:38:10.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.496+0000 7f5df2d9d640 1 --2- 172.21.15.79:0/3499850543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cea3d1e130 0x55cea3d35bc0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f5dec006010 tx=0x7f5dec003df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b6d3d0ad3f4cc7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:10.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.496+0000 7f5ddbfff640 1 -- 172.21.15.79:0/3499850543 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dec05a030 con 0x55cea3d1e130 2024-08-20T01:38:10.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.496+0000 7f5ddbfff640 1 -- 172.21.15.79:0/3499850543 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5dec036070 con 0x55cea3d1e130 2024-08-20T01:38:10.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.496+0000 7f5ddbfff640 1 -- 172.21.15.79:0/3499850543 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dec04c040 con 0x55cea3d1e130 2024-08-20T01:38:10.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.497+0000 7f5dfac84740 1 -- 172.21.15.79:0/3499850543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cea3d1e130 msgr2=0x55cea3d35bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:10.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.497+0000 7f5dfac84740 1 --2- 172.21.15.79:0/3499850543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cea3d1e130 0x55cea3d35bc0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f5dec006010 tx=0x7f5dec003df0 comp rx=0 tx=0).stop 2024-08-20T01:38:10.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.497+0000 7f5dfac84740 1 -- 172.21.15.79:0/3499850543 shutdown_connections 2024-08-20T01:38:10.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.497+0000 7f5dfac84740 1 --2- 172.21.15.79:0/3499850543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cea3d1e130 0x55cea3d35bc0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:10.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.497+0000 7f5dfac84740 1 --2- 172.21.15.79:0/3499850543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cea3d121a0 0x55cea3d1cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:10.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.497+0000 7f5dfac84740 1 --2- 172.21.15.79:0/3499850543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cea3d11880 0x55cea3d10d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:10.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.497+0000 7f5dfac84740 1 -- 172.21.15.79:0/3499850543 >> 172.21.15.79:0/3499850543 conn(0x55cea3d0f6b0 msgr2=0x55cea3d1c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:10.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.497+0000 7f5dfac84740 1 -- 172.21.15.79:0/3499850543 shutdown_connections 2024-08-20T01:38:10.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.497+0000 7f5dfac84740 1 -- 172.21.15.79:0/3499850543 wait complete. 2024-08-20T01:38:10.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.498+0000 7f5dfac84740 1 -- start start 2024-08-20T01:38:10.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.498+0000 7f5dfac84740 1 Processor -- start 2024-08-20T01:38:10.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.498+0000 7f5dfac84740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cea3d11880 0x55cea3d266a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:10.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.498+0000 7f5dfac84740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cea3d121a0 0x55cea3d21b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:10.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.498+0000 7f5dfac84740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cea3d1e130 0x55cea3d220b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:10.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.498+0000 7f5dfac84740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5df41af470 con 0x55cea3d11880 2024-08-20T01:38:10.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.498+0000 7f5dfac84740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5df41aeda0 con 0x55cea3d121a0 2024-08-20T01:38:10.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.498+0000 7f5dfac84740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5df41abfe0 con 0x55cea3d1e130 2024-08-20T01:38:10.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.498+0000 7f5dfac84740 10 client.0 _ll_register_callbacks cb 0x7f5dec009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:10.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.498+0000 7f5df259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cea3d11880 0x55cea3d266a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:10.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.498+0000 7f5df259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cea3d11880 0x55cea3d266a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49340/0 (socket says 172.21.15.79:49340) 2024-08-20T01:38:10.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.498+0000 7f5df259c640 1 -- 172.21.15.79:0/3959738999 learned_addr learned my addr 172.21.15.79:0/3959738999 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:10.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.498+0000 7f5df2d9d640 1 --2- 172.21.15.79:0/3959738999 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cea3d1e130 0x55cea3d220b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:10.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.498+0000 7f5df1d9b640 1 --2- 172.21.15.79:0/3959738999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cea3d121a0 0x55cea3d21b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:10.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.498+0000 7f5df259c640 1 -- 172.21.15.79:0/3959738999 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cea3d1e130 msgr2=0x55cea3d220b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:10.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.498+0000 7f5df259c640 1 --2- 172.21.15.79:0/3959738999 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cea3d1e130 0x55cea3d220b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:10.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.498+0000 7f5df259c640 1 -- 172.21.15.79:0/3959738999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cea3d121a0 msgr2=0x55cea3d21b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:10.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.498+0000 7f5df259c640 1 --2- 172.21.15.79:0/3959738999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cea3d121a0 0x55cea3d21b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:10.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.498+0000 7f5df259c640 1 -- 172.21.15.79:0/3959738999 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cea3d228e0 con 0x55cea3d11880 2024-08-20T01:38:10.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.499+0000 7f5df1d9b640 1 --2- 172.21.15.79:0/3959738999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cea3d121a0 0x55cea3d21b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:38:10.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.499+0000 7f5df259c640 1 --2- 172.21.15.79:0/3959738999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cea3d11880 0x55cea3d266a0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x55cea3d14a00 tx=0x7f5de40128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64ec1a76fdcc3b2a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:10.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.499+0000 7f5dd9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:38:10.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.499+0000 7f5dd9ffb640 1 -- 172.21.15.79:0/3959738999 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de4005220 con 0x55cea3d11880 2024-08-20T01:38:10.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.499+0000 7f5dd9ffb640 1 -- 172.21.15.79:0/3959738999 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f5de40053c0 con 0x55cea3d11880 2024-08-20T01:38:10.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.499+0000 7f5dfac84740 1 -- 172.21.15.79:0/3959738999 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5dec036070 con 0x55cea3d11880 2024-08-20T01:38:10.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.499+0000 7f5dd9ffb640 1 -- 172.21.15.79:0/3959738999 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5de402c050 con 0x55cea3d11880 2024-08-20T01:38:10.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.499+0000 7f5dfac84740 10 client.15897 fetch_fsmap learned FSMap version 28 2024-08-20T01:38:10.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.499+0000 7f5dfac84740 1 -- 172.21.15.79:0/3959738999 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cea3d98bc0 con 0x55cea3d11880 2024-08-20T01:38:10.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.499+0000 7f5dd9ffb640 1 -- 172.21.15.79:0/3959738999 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5dec036070 con 0x55cea3d11880 2024-08-20T01:38:10.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.500+0000 7f5dd9ffb640 1 -- 172.21.15.79:0/3959738999 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5de401c800 con 0x55cea3d11880 2024-08-20T01:38:10.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.500+0000 7f5dfac84740 10 client.15897 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:38:10.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.500+0000 7f5dfac84740 10 client.15897 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:38:10.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.500+0000 7f5dfac84740 20 client.15897 populate_metadata read hostname 'smithi079' 2024-08-20T01:38:10.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.500+0000 7f5dfac84740 1 --2- 172.21.15.79:0/3959738999 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55cea3d99320 0x55cea3d9b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:10.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.500+0000 7f5dfac84740 4 client.15897 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:38:10.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.500+0000 7f5dfac84740 1 -- 172.21.15.79:0/3959738999 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cea3c86320 con 0x55cea3d99320 2024-08-20T01:38:10.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.500+0000 7f5df1d9b640 1 --2- 172.21.15.79:0/3959738999 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55cea3d99320 0x55cea3d9b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:10.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.501+0000 7f5dd9ffb640 10 client.15897 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:10.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.501+0000 7f5df1d9b640 1 --2- 172.21.15.79:0/3959738999 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55cea3d99320 0x55cea3d9b740 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=242160b706244242 server_cookie=5a56c23c827a7e40 in_seq=0 out_seq=0 2024-08-20T01:38:10.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.501+0000 7f5dd9ffb640 1 -- 172.21.15.79:0/3959738999 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cea3c86320 con 0x55cea3d99320 2024-08-20T01:38:10.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.501+0000 7f5dd9ffb640 10 client.15897 handle_command_reply: tid=0 2024-08-20T01:38:10.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.501+0000 7f5dfac84740 1 client.15897 shutdown 2024-08-20T01:38:10.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.501+0000 7f5dfac84740 1 -- 172.21.15.79:0/3959738999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cea3d11880 msgr2=0x55cea3d266a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:10.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.501+0000 7f5dfac84740 1 --2- 172.21.15.79:0/3959738999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cea3d11880 0x55cea3d266a0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x55cea3d14a00 tx=0x7f5de40128e0 comp rx=0 tx=0).stop 2024-08-20T01:38:10.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.501+0000 7f5dfac84740 1 -- 172.21.15.79:0/3959738999 shutdown_connections 2024-08-20T01:38:10.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.501+0000 7f5dfac84740 1 --2- 172.21.15.79:0/3959738999 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55cea3d99320 0x55cea3d9b740 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:10.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.501+0000 7f5dfac84740 1 --2- 172.21.15.79:0/3959738999 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cea3d1e130 0x55cea3d220b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:10.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.501+0000 7f5dfac84740 1 --2- 172.21.15.79:0/3959738999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cea3d121a0 0x55cea3d21b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:10.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.501+0000 7f5dfac84740 1 --2- 172.21.15.79:0/3959738999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cea3d11880 0x55cea3d266a0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:10.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.501+0000 7f5dfac84740 1 -- 172.21.15.79:0/3959738999 >> 172.21.15.79:0/3959738999 conn(0x55cea3d0f6b0 msgr2=0x55cea3d10c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:10.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.501+0000 7f5dd9ffb640 0 client.15897 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:10.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.501+0000 7f5dfac84740 1 -- 172.21.15.79:0/3959738999 shutdown_connections 2024-08-20T01:38:10.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.501+0000 7f5dfac84740 1 -- 172.21.15.79:0/3959738999 wait complete. 2024-08-20T01:38:10.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.502+0000 7f5dfac84740 20 client.15897 trim_cache size 0 max 16384 2024-08-20T01:38:10.524 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:38:10.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.502+0000 7f5df888b640 1 -- 172.21.15.79:0/3715141232 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5ddc0b3bd0 msgr2=0x7f5ddc0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:10.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.502+0000 7f5df888b640 1 --2- 172.21.15.79:0/3715141232 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5ddc0b3bd0 0x7f5ddc0b6090 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5dec004af0 tx=0x7f5dec004a40 comp rx=0 tx=0).stop 2024-08-20T01:38:10.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.502+0000 7f5df888b640 1 -- 172.21.15.79:0/3715141232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5df41073a0 msgr2=0x7f5df419a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:10.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.502+0000 7f5df888b640 1 --2- 172.21.15.79:0/3715141232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5df41073a0 0x7f5df419a1d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f5de800d950 tx=0x7f5de800de10 comp rx=0 tx=0).stop 2024-08-20T01:38:10.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.502+0000 7f5df888b640 1 -- 172.21.15.79:0/3715141232 shutdown_connections 2024-08-20T01:38:10.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.502+0000 7f5df888b640 1 --2- 172.21.15.79:0/3715141232 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5ddc0b3bd0 0x7f5ddc0b6090 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:10.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.502+0000 7f5df888b640 1 --2- 172.21.15.79:0/3715141232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5df4107d20 0x7f5df419a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:10.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.502+0000 7f5df888b640 1 --2- 172.21.15.79:0/3715141232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5df41073a0 0x7f5df419a1d0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:10.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.502+0000 7f5df888b640 1 --2- 172.21.15.79:0/3715141232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5df4101990 0x7f5df4199c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:10.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.502+0000 7f5df888b640 1 -- 172.21.15.79:0/3715141232 >> 172.21.15.79:0/3715141232 conn(0x7f5df40fd400 msgr2=0x7f5df40ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:10.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.502+0000 7f5df888b640 1 -- 172.21.15.79:0/3715141232 shutdown_connections 2024-08-20T01:38:10.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:10.502+0000 7f5df888b640 1 -- 172.21.15.79:0/3715141232 wait complete. 2024-08-20T01:38:10.691 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:10 smithi079 ceph-mon[18656]: pgmap v372: 97 pgs: 97 active+clean; 33 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 3.0 MiB/s wr, 190 op/s 2024-08-20T01:38:10.692 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:10 smithi175 ceph-mon[22392]: pgmap v372: 97 pgs: 97 active+clean; 33 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 3.0 MiB/s wr, 190 op/s 2024-08-20T01:38:10.782 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:10 smithi081 ceph-mon[22209]: pgmap v372: 97 pgs: 97 active+clean; 33 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 3.0 MiB/s wr, 190 op/s 2024-08-20T01:38:12.395 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T01:38:12.396 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T01:38:12.675 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:38:12.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:12 smithi079 ceph-mon[18656]: pgmap v373: 97 pgs: 97 active+clean; 78 MiB data, 593 MiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 6.4 MiB/s wr, 171 op/s 2024-08-20T01:38:12.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:12 smithi081 ceph-mon[22209]: pgmap v373: 97 pgs: 97 active+clean; 78 MiB data, 593 MiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 6.4 MiB/s wr, 171 op/s 2024-08-20T01:38:12.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:12 smithi175 ceph-mon[22392]: pgmap v373: 97 pgs: 97 active+clean; 78 MiB data, 593 MiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 6.4 MiB/s wr, 171 op/s 2024-08-20T01:38:14.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:14 smithi079 ceph-mon[18656]: pgmap v374: 97 pgs: 97 active+clean; 126 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 10 MiB/s wr, 155 op/s 2024-08-20T01:38:14.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:14 smithi081 ceph-mon[22209]: pgmap v374: 97 pgs: 97 active+clean; 126 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 10 MiB/s wr, 155 op/s 2024-08-20T01:38:14.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:14 smithi175 ceph-mon[22392]: pgmap v374: 97 pgs: 97 active+clean; 126 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 10 MiB/s wr, 155 op/s 2024-08-20T01:38:16.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:16 smithi079 ceph-mon[18656]: pgmap v375: 97 pgs: 97 active+clean; 174 MiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 14 MiB/s wr, 145 op/s 2024-08-20T01:38:16.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:16 smithi081 ceph-mon[22209]: pgmap v375: 97 pgs: 97 active+clean; 174 MiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 14 MiB/s wr, 145 op/s 2024-08-20T01:38:16.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.097+0000 7f23c2ba9640 1 -- 172.21.15.79:0/840565749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23bc1073a0 msgr2=0x7f23bc1077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:16.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.097+0000 7f23c2ba9640 1 --2- 172.21.15.79:0/840565749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23bc1073a0 0x7f23bc1077e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f23a8009900 tx=0x7f23a802a410 comp rx=0 tx=0).stop 2024-08-20T01:38:16.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.097+0000 7f23c2ba9640 1 -- 172.21.15.79:0/840565749 shutdown_connections 2024-08-20T01:38:16.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.097+0000 7f23c2ba9640 1 --2- 172.21.15.79:0/840565749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23bc107d20 0x7f23bc10e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:16.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.097+0000 7f23c2ba9640 1 --2- 172.21.15.79:0/840565749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23bc1073a0 0x7f23bc1077e0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:16.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.097+0000 7f23c2ba9640 1 --2- 172.21.15.79:0/840565749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23bc101990 0x7f23bc101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:16.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.097+0000 7f23c2ba9640 1 -- 172.21.15.79:0/840565749 >> 172.21.15.79:0/840565749 conn(0x7f23bc0fd400 msgr2=0x7f23bc0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:16.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.097+0000 7f23c2ba9640 1 -- 172.21.15.79:0/840565749 shutdown_connections 2024-08-20T01:38:16.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.097+0000 7f23c2ba9640 1 -- 172.21.15.79:0/840565749 wait complete. 2024-08-20T01:38:16.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.098+0000 7f23c2ba9640 1 Processor -- start 2024-08-20T01:38:16.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.098+0000 7f23c2ba9640 1 -- start start 2024-08-20T01:38:16.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.098+0000 7f23c2ba9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23bc101990 0x7f23bc19b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:16.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.098+0000 7f23c2ba9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23bc1073a0 0x7f23bc19b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:16.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.098+0000 7f23c2ba9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23bc107d20 0x7f23bc1a09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:16.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.098+0000 7f23c2ba9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f23bc1128e0 con 0x7f23bc1073a0 2024-08-20T01:38:16.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.098+0000 7f23c2ba9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f23bc112760 con 0x7f23bc101990 2024-08-20T01:38:16.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.098+0000 7f23c2ba9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f23bc112a60 con 0x7f23bc107d20 2024-08-20T01:38:16.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.098+0000 7f23bbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23bc1073a0 0x7f23bc19b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:16.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.098+0000 7f23bbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23bc1073a0 0x7f23bc19b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49356/0 (socket says 172.21.15.79:49356) 2024-08-20T01:38:16.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.098+0000 7f23bbfff640 1 -- 172.21.15.79:0/140923239 learned_addr learned my addr 172.21.15.79:0/140923239 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:16.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.098+0000 7f23c1146640 1 --2- 172.21.15.79:0/140923239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23bc107d20 0x7f23bc1a09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:16.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.098+0000 7f23c0945640 1 --2- 172.21.15.79:0/140923239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23bc101990 0x7f23bc19b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:16.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.099+0000 7f23bbfff640 1 -- 172.21.15.79:0/140923239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23bc107d20 msgr2=0x7f23bc1a09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:16.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.099+0000 7f23bbfff640 1 --2- 172.21.15.79:0/140923239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23bc107d20 0x7f23bc1a09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:16.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.099+0000 7f23bbfff640 1 -- 172.21.15.79:0/140923239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23bc101990 msgr2=0x7f23bc19b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:16.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.099+0000 7f23bbfff640 1 --2- 172.21.15.79:0/140923239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23bc101990 0x7f23bc19b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:16.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.099+0000 7f23bbfff640 1 -- 172.21.15.79:0/140923239 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23bc1a11c0 con 0x7f23bc1073a0 2024-08-20T01:38:16.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.099+0000 7f23c1146640 1 --2- 172.21.15.79:0/140923239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23bc107d20 0x7f23bc1a09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:38:16.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.099+0000 7f23c0945640 1 --2- 172.21.15.79:0/140923239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23bc101990 0x7f23bc19b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:38:16.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.099+0000 7f23bbfff640 1 --2- 172.21.15.79:0/140923239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23bc1073a0 0x7f23bc19b650 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f23a8009230 tx=0x7f23a8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:16.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.099+0000 7f23b9ffb640 1 -- 172.21.15.79:0/140923239 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a803f030 con 0x7f23bc1073a0 2024-08-20T01:38:16.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.099+0000 7f23b9ffb640 1 -- 172.21.15.79:0/140923239 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f23a8003a80 con 0x7f23bc1073a0 2024-08-20T01:38:16.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.099+0000 7f23b9ffb640 1 -- 172.21.15.79:0/140923239 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a8035070 con 0x7f23bc1073a0 2024-08-20T01:38:16.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.099+0000 7f23c2ba9640 1 -- 172.21.15.79:0/140923239 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23bc1a1450 con 0x7f23bc1073a0 2024-08-20T01:38:16.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.099+0000 7f23c2ba9640 1 -- 172.21.15.79:0/140923239 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23bc1a7b70 con 0x7f23bc1073a0 2024-08-20T01:38:16.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.102+0000 7f23b9ffb640 1 -- 172.21.15.79:0/140923239 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f23a8042030 con 0x7f23bc1073a0 2024-08-20T01:38:16.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.102+0000 7f23c4fa2740 1 Processor -- start 2024-08-20T01:38:16.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.102+0000 7f23c4fa2740 1 -- start start 2024-08-20T01:38:16.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.102+0000 7f23c4fa2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615cc2083b0 0x5615cc208790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:16.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.102+0000 7f23c4fa2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615cc208cd0 0x5615cc214720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:16.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.102+0000 7f23c4fa2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615cc214c60 0x5615cc217050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:16.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.103+0000 7f23c4fa2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5615cc17e940 con 0x5615cc214c60 2024-08-20T01:38:16.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.103+0000 7f23c4fa2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5615cc16de40 con 0x5615cc208cd0 2024-08-20T01:38:16.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.103+0000 7f23c4fa2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5615cc171e80 con 0x5615cc2083b0 2024-08-20T01:38:16.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.103+0000 7f23bbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615cc214c60 0x5615cc217050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:16.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.103+0000 7f23c0945640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615cc208cd0 0x5615cc214720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:16.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.103+0000 7f23bbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615cc214c60 0x5615cc217050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49372/0 (socket says 172.21.15.79:49372) 2024-08-20T01:38:16.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.103+0000 7f23bbfff640 1 -- 172.21.15.79:0/79902760 learned_addr learned my addr 172.21.15.79:0/79902760 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:16.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.103+0000 7f23c1146640 1 --2- 172.21.15.79:0/79902760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615cc2083b0 0x5615cc208790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:16.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.103+0000 7f23b9ffb640 1 --2- 172.21.15.79:0/140923239 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f23ac0b3bd0 0x7f23ac0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:16.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.103+0000 7f23c0945640 1 -- 172.21.15.79:0/79902760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615cc2083b0 msgr2=0x5615cc208790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:16.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.103+0000 7f23c0945640 1 --2- 172.21.15.79:0/79902760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615cc2083b0 0x5615cc208790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:16.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.103+0000 7f23c0945640 1 -- 172.21.15.79:0/79902760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615cc214c60 msgr2=0x5615cc217050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:16.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.103+0000 7f23c0945640 1 --2- 172.21.15.79:0/79902760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615cc214c60 0x5615cc217050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:16.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.103+0000 7f23c0945640 1 -- 172.21.15.79:0/79902760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615cc10a520 con 0x5615cc208cd0 2024-08-20T01:38:16.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.103+0000 7f23b9ffb640 1 -- 172.21.15.79:0/140923239 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f23a8104420 con 0x7f23bc1073a0 2024-08-20T01:38:16.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.103+0000 7f23c1146640 1 --2- 172.21.15.79:0/140923239 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f23ac0b3bd0 0x7f23ac0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:16.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.104+0000 7f23c0945640 1 --2- 172.21.15.79:0/79902760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615cc208cd0 0x5615cc214720 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f23b000bc80 tx=0x7f23b000f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ff51c2b2a45d01a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:16.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.104+0000 7f23a6ffd640 1 -- 172.21.15.79:0/79902760 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b0015070 con 0x5615cc208cd0 2024-08-20T01:38:16.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.104+0000 7f23a6ffd640 1 -- 172.21.15.79:0/79902760 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f23b00118d0 con 0x5615cc208cd0 2024-08-20T01:38:16.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.104+0000 7f23a6ffd640 1 -- 172.21.15.79:0/79902760 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b0010770 con 0x5615cc208cd0 2024-08-20T01:38:16.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.105+0000 7f23c4fa2740 1 -- 172.21.15.79:0/79902760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615cc208cd0 msgr2=0x5615cc214720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:16.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.105+0000 7f23c1146640 1 --2- 172.21.15.79:0/140923239 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f23ac0b3bd0 0x7f23ac0b6090 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f23b4005fd0 tx=0x7f23b4004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:16.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.105+0000 7f23c4fa2740 1 --2- 172.21.15.79:0/79902760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615cc208cd0 0x5615cc214720 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f23b000bc80 tx=0x7f23b000f730 comp rx=0 tx=0).stop 2024-08-20T01:38:16.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.105+0000 7f23c4fa2740 1 -- 172.21.15.79:0/79902760 shutdown_connections 2024-08-20T01:38:16.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.105+0000 7f23c4fa2740 1 --2- 172.21.15.79:0/79902760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615cc214c60 0x5615cc217050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:16.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.105+0000 7f23c4fa2740 1 --2- 172.21.15.79:0/79902760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615cc208cd0 0x5615cc214720 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:16.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.105+0000 7f23c4fa2740 1 --2- 172.21.15.79:0/79902760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615cc2083b0 0x5615cc208790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:16.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.105+0000 7f23c4fa2740 1 -- 172.21.15.79:0/79902760 >> 172.21.15.79:0/79902760 conn(0x5615cc2061e0 msgr2=0x5615cc207380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:16.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.105+0000 7f23c4fa2740 1 -- 172.21.15.79:0/79902760 shutdown_connections 2024-08-20T01:38:16.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.105+0000 7f23c4fa2740 1 -- 172.21.15.79:0/79902760 wait complete. 2024-08-20T01:38:16.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.105+0000 7f23c4fa2740 1 -- start start 2024-08-20T01:38:16.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.105+0000 7f23c4fa2740 1 Processor -- start 2024-08-20T01:38:16.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.106+0000 7f23c4fa2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615cc2083b0 0x5615cc211bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:16.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.106+0000 7f23c4fa2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615cc208cd0 0x5615cc212130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:16.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.106+0000 7f23c4fa2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615cc214c60 0x5615cc212670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:16.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.106+0000 7f23c4fa2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5615cbfd0890 con 0x5615cc2083b0 2024-08-20T01:38:16.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.106+0000 7f23c4fa2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5615cc0f4700 con 0x5615cc208cd0 2024-08-20T01:38:16.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.106+0000 7f23c4fa2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5615cc2179b0 con 0x5615cc214c60 2024-08-20T01:38:16.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.106+0000 7f23c4fa2740 10 client.0 _ll_register_callbacks cb 0x5615cc1696f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:16.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.106+0000 7f23c0945640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615cc2083b0 0x5615cc211bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:16.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.106+0000 7f23c0945640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615cc2083b0 0x5615cc211bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49378/0 (socket says 172.21.15.79:49378) 2024-08-20T01:38:16.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.106+0000 7f23c0945640 1 -- 172.21.15.79:0/2058292411 learned_addr learned my addr 172.21.15.79:0/2058292411 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:16.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.106+0000 7f23c1146640 1 --2- 172.21.15.79:0/2058292411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615cc214c60 0x5615cc212670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:16.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.106+0000 7f23bbfff640 1 --2- 172.21.15.79:0/2058292411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615cc208cd0 0x5615cc212130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:16.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.106+0000 7f23c0945640 1 -- 172.21.15.79:0/2058292411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615cc214c60 msgr2=0x5615cc212670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:16.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.106+0000 7f23c0945640 1 --2- 172.21.15.79:0/2058292411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615cc214c60 0x5615cc212670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:16.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.106+0000 7f23c0945640 1 -- 172.21.15.79:0/2058292411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615cc208cd0 msgr2=0x5615cc212130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:16.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.106+0000 7f23c0945640 1 --2- 172.21.15.79:0/2058292411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615cc208cd0 0x5615cc212130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:16.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.106+0000 7f23c0945640 1 -- 172.21.15.79:0/2058292411 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615cbecd930 con 0x5615cc2083b0 2024-08-20T01:38:16.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.106+0000 7f23bbfff640 1 --2- 172.21.15.79:0/2058292411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615cc208cd0 0x5615cc212130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:38:16.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.106+0000 7f23c0945640 1 --2- 172.21.15.79:0/2058292411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615cc2083b0 0x5615cc211bf0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f23b000bfd0 tx=0x7f23b000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9908431776e45ee server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:16.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.107+0000 7f239bfff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:38:16.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.107+0000 7f239bfff640 1 -- 172.21.15.79:0/2058292411 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b0015050 con 0x5615cc2083b0 2024-08-20T01:38:16.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.107+0000 7f239bfff640 1 -- 172.21.15.79:0/2058292411 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f23b0011a80 con 0x5615cc2083b0 2024-08-20T01:38:16.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.107+0000 7f23c4fa2740 1 -- 172.21.15.79:0/2058292411 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23b00118d0 con 0x5615cc2083b0 2024-08-20T01:38:16.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.107+0000 7f239bfff640 1 -- 172.21.15.79:0/2058292411 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f23b0011c80 con 0x5615cc2083b0 2024-08-20T01:38:16.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.107+0000 7f23c4fa2740 10 client.15909 fetch_fsmap learned FSMap version 28 2024-08-20T01:38:16.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.107+0000 7f23c4fa2740 1 -- 172.21.15.79:0/2058292411 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5615cc223540 con 0x5615cc2083b0 2024-08-20T01:38:16.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.107+0000 7f239bfff640 1 -- 172.21.15.79:0/2058292411 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f23b00118d0 con 0x5615cc2083b0 2024-08-20T01:38:16.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.108+0000 7f239bfff640 1 -- 172.21.15.79:0/2058292411 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f23b00046c0 con 0x5615cc2083b0 2024-08-20T01:38:16.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.108+0000 7f23c4fa2740 10 client.15909 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:38:16.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.108+0000 7f23c4fa2740 10 client.15909 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:38:16.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.108+0000 7f23c4fa2740 20 client.15909 populate_metadata read hostname 'smithi079' 2024-08-20T01:38:16.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.108+0000 7f23c4fa2740 1 --2- 172.21.15.79:0/2058292411 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5615cc2249a0 0x5615cc226d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:16.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.108+0000 7f23c4fa2740 4 client.15909 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:38:16.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.108+0000 7f23c4fa2740 1 -- 172.21.15.79:0/2058292411 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5615cc180890 con 0x5615cc2249a0 2024-08-20T01:38:16.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.108+0000 7f23bbfff640 1 --2- 172.21.15.79:0/2058292411 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5615cc2249a0 0x5615cc226d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:16.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.109+0000 7f23bbfff640 1 --2- 172.21.15.79:0/2058292411 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5615cc2249a0 0x5615cc226d90 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e980aeab5897c014 server_cookie=2cfcd8afe3f96452 in_seq=0 out_seq=0 2024-08-20T01:38:16.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.109+0000 7f239bfff640 10 client.15909 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:16.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.109+0000 7f239bfff640 1 -- 172.21.15.79:0/2058292411 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5615cc180890 con 0x5615cc2249a0 2024-08-20T01:38:16.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.109+0000 7f239bfff640 10 client.15909 handle_command_reply: tid=0 2024-08-20T01:38:16.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.109+0000 7f23c4fa2740 1 client.15909 shutdown 2024-08-20T01:38:16.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.110+0000 7f23c4fa2740 1 -- 172.21.15.79:0/2058292411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615cc2083b0 msgr2=0x5615cc211bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:16.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.110+0000 7f23c4fa2740 1 --2- 172.21.15.79:0/2058292411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615cc2083b0 0x5615cc211bf0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f23b000bfd0 tx=0x7f23b000b870 comp rx=0 tx=0).stop 2024-08-20T01:38:16.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.110+0000 7f23c4fa2740 1 -- 172.21.15.79:0/2058292411 shutdown_connections 2024-08-20T01:38:16.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.110+0000 7f23c4fa2740 1 --2- 172.21.15.79:0/2058292411 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5615cc2249a0 0x5615cc226d90 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:16.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.110+0000 7f23c4fa2740 1 --2- 172.21.15.79:0/2058292411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615cc214c60 0x5615cc212670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:16.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.110+0000 7f23c4fa2740 1 --2- 172.21.15.79:0/2058292411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615cc208cd0 0x5615cc212130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:16.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.110+0000 7f23c4fa2740 1 --2- 172.21.15.79:0/2058292411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615cc2083b0 0x5615cc211bf0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:16.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.110+0000 7f23c4fa2740 1 -- 172.21.15.79:0/2058292411 >> 172.21.15.79:0/2058292411 conn(0x5615cc2061e0 msgr2=0x5615cc20bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:16.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.110+0000 7f239bfff640 0 client.15909 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:16.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.110+0000 7f23c4fa2740 1 -- 172.21.15.79:0/2058292411 shutdown_connections 2024-08-20T01:38:16.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.110+0000 7f23c4fa2740 1 -- 172.21.15.79:0/2058292411 wait complete. 2024-08-20T01:38:16.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.110+0000 7f23c4fa2740 20 client.15909 trim_cache size 0 max 16384 2024-08-20T01:38:16.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.135+0000 7f23c4fa2740 1 Processor -- start 2024-08-20T01:38:16.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.135+0000 7f23c4fa2740 1 -- start start 2024-08-20T01:38:16.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.135+0000 7f23c4fa2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615cc2083b0 0x5615cc2299d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:16.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.135+0000 7f23c4fa2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615cc208cd0 0x5615cc229f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:16.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.135+0000 7f23c4fa2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615cc214c60 0x5615cc20ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:16.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.135+0000 7f23c4fa2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f23bc1b0200 con 0x5615cc214c60 2024-08-20T01:38:16.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.135+0000 7f23c4fa2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f23bc1b1d40 con 0x5615cc208cd0 2024-08-20T01:38:16.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.135+0000 7f23c4fa2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f23bc1b08d0 con 0x5615cc2083b0 2024-08-20T01:38:16.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.136+0000 7f23c1146640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615cc214c60 0x5615cc20ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:16.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.136+0000 7f23c1146640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615cc214c60 0x5615cc20ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49388/0 (socket says 172.21.15.79:49388) 2024-08-20T01:38:16.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.136+0000 7f23c1146640 1 -- 172.21.15.79:0/206178836 learned_addr learned my addr 172.21.15.79:0/206178836 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:16.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.136+0000 7f23bbfff640 1 --2- 172.21.15.79:0/206178836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615cc208cd0 0x5615cc229f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:16.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.136+0000 7f23c0945640 1 --2- 172.21.15.79:0/206178836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615cc2083b0 0x5615cc2299d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:16.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.136+0000 7f23c1146640 1 -- 172.21.15.79:0/206178836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615cc2083b0 msgr2=0x5615cc2299d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:16.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.136+0000 7f23c1146640 1 --2- 172.21.15.79:0/206178836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615cc2083b0 0x5615cc2299d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:16.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.136+0000 7f23c1146640 1 -- 172.21.15.79:0/206178836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615cc208cd0 msgr2=0x5615cc229f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:16.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.136+0000 7f23c1146640 1 --2- 172.21.15.79:0/206178836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615cc208cd0 0x5615cc229f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:16.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.136+0000 7f23c1146640 1 -- 172.21.15.79:0/206178836 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615cc206010 con 0x5615cc214c60 2024-08-20T01:38:16.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.136+0000 7f23c0945640 1 --2- 172.21.15.79:0/206178836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615cc2083b0 0x5615cc2299d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:38:16.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.136+0000 7f23c1146640 1 --2- 172.21.15.79:0/206178836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615cc214c60 0x5615cc20ee00 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f23b4014210 tx=0x7f23b4009b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9845dfde45c3f98e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:16.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.137+0000 7f23a67fc640 1 -- 172.21.15.79:0/206178836 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b4012700 con 0x5615cc214c60 2024-08-20T01:38:16.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.137+0000 7f23a67fc640 1 -- 172.21.15.79:0/206178836 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f23b4012d30 con 0x5615cc214c60 2024-08-20T01:38:16.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.137+0000 7f23a67fc640 1 -- 172.21.15.79:0/206178836 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b4024d10 con 0x5615cc214c60 2024-08-20T01:38:16.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.138+0000 7f23c4fa2740 1 -- 172.21.15.79:0/206178836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615cc214c60 msgr2=0x5615cc20ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:16.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.138+0000 7f23c4fa2740 1 --2- 172.21.15.79:0/206178836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615cc214c60 0x5615cc20ee00 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f23b4014210 tx=0x7f23b4009b10 comp rx=0 tx=0).stop 2024-08-20T01:38:16.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.138+0000 7f23c4fa2740 1 -- 172.21.15.79:0/206178836 shutdown_connections 2024-08-20T01:38:16.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.138+0000 7f23c4fa2740 1 --2- 172.21.15.79:0/206178836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615cc214c60 0x5615cc20ee00 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:16.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.138+0000 7f23c4fa2740 1 --2- 172.21.15.79:0/206178836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615cc208cd0 0x5615cc229f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:16.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.138+0000 7f23c4fa2740 1 --2- 172.21.15.79:0/206178836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615cc2083b0 0x5615cc2299d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:16.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.138+0000 7f23c4fa2740 1 -- 172.21.15.79:0/206178836 >> 172.21.15.79:0/206178836 conn(0x5615cc2061e0 msgr2=0x5615cc213a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:16.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.138+0000 7f23c4fa2740 1 -- 172.21.15.79:0/206178836 shutdown_connections 2024-08-20T01:38:16.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.138+0000 7f23c4fa2740 1 -- 172.21.15.79:0/206178836 wait complete. 2024-08-20T01:38:16.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.138+0000 7f23c4fa2740 1 -- start start 2024-08-20T01:38:16.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.138+0000 7f23c4fa2740 1 Processor -- start 2024-08-20T01:38:16.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.139+0000 7f23c4fa2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615cc2083b0 0x5615cc227a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:16.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.139+0000 7f23c4fa2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615cc208cd0 0x5615cc227fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:16.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.139+0000 7f23c4fa2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615cc214c60 0x5615cc228500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:16.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.139+0000 7f23c4fa2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f23bc1b1670 con 0x5615cc208cd0 2024-08-20T01:38:16.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.139+0000 7f23c4fa2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f23bc1b0fa0 con 0x5615cc214c60 2024-08-20T01:38:16.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.139+0000 7f23c4fa2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f23bc1ae1e0 con 0x5615cc2083b0 2024-08-20T01:38:16.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.139+0000 7f23c4fa2740 10 client.0 _ll_register_callbacks cb 0x7f23b0011f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:16.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.139+0000 7f23bbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615cc208cd0 0x5615cc227fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:16.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.139+0000 7f23bbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615cc208cd0 0x5615cc227fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49392/0 (socket says 172.21.15.79:49392) 2024-08-20T01:38:16.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.139+0000 7f23bbfff640 1 -- 172.21.15.79:0/158208488 learned_addr learned my addr 172.21.15.79:0/158208488 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:16.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.139+0000 7f23c0945640 1 --2- 172.21.15.79:0/158208488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615cc2083b0 0x5615cc227a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:16.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.139+0000 7f23bbfff640 1 -- 172.21.15.79:0/158208488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615cc2083b0 msgr2=0x5615cc227a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:16.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.139+0000 7f23bbfff640 1 --2- 172.21.15.79:0/158208488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615cc2083b0 0x5615cc227a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:16.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.139+0000 7f23bbfff640 1 -- 172.21.15.79:0/158208488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615cc214c60 msgr2=0x5615cc228500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:16.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.139+0000 7f23bbfff640 1 --2- 172.21.15.79:0/158208488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615cc214c60 0x5615cc228500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:16.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.139+0000 7f23bbfff640 1 -- 172.21.15.79:0/158208488 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615cc28e500 con 0x5615cc208cd0 2024-08-20T01:38:16.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.140+0000 7f23bbfff640 1 --2- 172.21.15.79:0/158208488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615cc208cd0 0x5615cc227fc0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f23a8101f80 tx=0x7f23a8005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a8e6e3a8f96367d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:16.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.140+0000 7f239bfff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:38:16.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.140+0000 7f239bfff640 1 -- 172.21.15.79:0/158208488 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a8049040 con 0x5615cc208cd0 2024-08-20T01:38:16.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.140+0000 7f23c4fa2740 1 -- 172.21.15.79:0/158208488 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23b4012d30 con 0x5615cc208cd0 2024-08-20T01:38:16.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.140+0000 7f239bfff640 1 -- 172.21.15.79:0/158208488 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f23a80c7610 con 0x5615cc208cd0 2024-08-20T01:38:16.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.140+0000 7f239bfff640 1 -- 172.21.15.79:0/158208488 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f23a80cacd0 con 0x5615cc208cd0 2024-08-20T01:38:16.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.140+0000 7f23c4fa2740 10 client.15915 fetch_fsmap learned FSMap version 28 2024-08-20T01:38:16.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.140+0000 7f23c4fa2740 1 -- 172.21.15.79:0/158208488 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5615cc28f810 con 0x5615cc208cd0 2024-08-20T01:38:16.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.141+0000 7f239bfff640 1 -- 172.21.15.79:0/158208488 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f23b4012d30 con 0x5615cc208cd0 2024-08-20T01:38:16.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.141+0000 7f239bfff640 1 -- 172.21.15.79:0/158208488 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f23a81040b0 con 0x5615cc208cd0 2024-08-20T01:38:16.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.141+0000 7f23c4fa2740 10 client.15915 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:38:16.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.141+0000 7f23c4fa2740 10 client.15915 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:38:16.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.141+0000 7f23c4fa2740 20 client.15915 populate_metadata read hostname 'smithi079' 2024-08-20T01:38:16.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.141+0000 7f23c4fa2740 1 --2- 172.21.15.79:0/158208488 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5615cc28ff70 0x5615cc292390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:16.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.141+0000 7f23c4fa2740 4 client.15915 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T01:38:16.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.141+0000 7f23c4fa2740 1 -- 172.21.15.79:0/158208488 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5615cc201910 con 0x5615cc28ff70 2024-08-20T01:38:16.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.141+0000 7f23c0945640 1 --2- 172.21.15.79:0/158208488 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5615cc28ff70 0x5615cc292390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:16.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.142+0000 7f23c0945640 1 --2- 172.21.15.79:0/158208488 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5615cc28ff70 0x5615cc292390 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66b23816623929f1 server_cookie=ac6fcac68d16eef2 in_seq=0 out_seq=0 2024-08-20T01:38:16.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.142+0000 7f239bfff640 10 client.15915 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:16.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.142+0000 7f239bfff640 1 -- 172.21.15.79:0/158208488 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5615cc201910 con 0x5615cc28ff70 2024-08-20T01:38:16.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.142+0000 7f239bfff640 10 client.15915 handle_command_reply: tid=0 2024-08-20T01:38:16.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.142+0000 7f23c4fa2740 1 client.15915 shutdown 2024-08-20T01:38:16.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.143+0000 7f23c4fa2740 1 -- 172.21.15.79:0/158208488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615cc208cd0 msgr2=0x5615cc227fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:16.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.143+0000 7f23c4fa2740 1 --2- 172.21.15.79:0/158208488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615cc208cd0 0x5615cc227fc0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f23a8101f80 tx=0x7f23a8005c90 comp rx=0 tx=0).stop 2024-08-20T01:38:16.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.143+0000 7f23c4fa2740 1 -- 172.21.15.79:0/158208488 shutdown_connections 2024-08-20T01:38:16.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.143+0000 7f23c4fa2740 1 --2- 172.21.15.79:0/158208488 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5615cc28ff70 0x5615cc292390 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:16.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.143+0000 7f23c4fa2740 1 --2- 172.21.15.79:0/158208488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615cc214c60 0x5615cc228500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:16.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.143+0000 7f23c4fa2740 1 --2- 172.21.15.79:0/158208488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615cc208cd0 0x5615cc227fc0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:16.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.143+0000 7f239bfff640 0 client.15915 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:16.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.143+0000 7f23c4fa2740 1 --2- 172.21.15.79:0/158208488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615cc2083b0 0x5615cc227a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:16.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.143+0000 7f23c4fa2740 1 -- 172.21.15.79:0/158208488 >> 172.21.15.79:0/158208488 conn(0x5615cc2061e0 msgr2=0x5615cc21fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:16.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.143+0000 7f23c4fa2740 1 -- 172.21.15.79:0/158208488 shutdown_connections 2024-08-20T01:38:16.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.143+0000 7f23c4fa2740 1 -- 172.21.15.79:0/158208488 wait complete. 2024-08-20T01:38:16.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.143+0000 7f23c4fa2740 20 client.15915 trim_cache size 0 max 16384 2024-08-20T01:38:16.845 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:38:16.846 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-08-20T01:38:16.846 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "91950288-fbce-4581-8f01-c56de8b14b30", 2024-08-20T01:38:16.846 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-08-20T01:38:16.846 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:38:16.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.144+0000 7f23c2ba9640 1 -- 172.21.15.79:0/140923239 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f23ac0b3bd0 msgr2=0x7f23ac0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:16.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.144+0000 7f23c2ba9640 1 --2- 172.21.15.79:0/140923239 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f23ac0b3bd0 0x7f23ac0b6090 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f23b4005fd0 tx=0x7f23b4004ab0 comp rx=0 tx=0).stop 2024-08-20T01:38:16.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.144+0000 7f23c2ba9640 1 -- 172.21.15.79:0/140923239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23bc1073a0 msgr2=0x7f23bc19b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:16.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.144+0000 7f23c2ba9640 1 --2- 172.21.15.79:0/140923239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23bc1073a0 0x7f23bc19b650 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f23a8009230 tx=0x7f23a8004270 comp rx=0 tx=0).stop 2024-08-20T01:38:16.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.144+0000 7f23c2ba9640 1 -- 172.21.15.79:0/140923239 shutdown_connections 2024-08-20T01:38:16.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.144+0000 7f23c2ba9640 1 --2- 172.21.15.79:0/140923239 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f23ac0b3bd0 0x7f23ac0b6090 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:16.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.144+0000 7f23c2ba9640 1 --2- 172.21.15.79:0/140923239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23bc107d20 0x7f23bc1a09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:16.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.144+0000 7f23c2ba9640 1 --2- 172.21.15.79:0/140923239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23bc1073a0 0x7f23bc19b650 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:16.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.144+0000 7f23c2ba9640 1 --2- 172.21.15.79:0/140923239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23bc101990 0x7f23bc19b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:16.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.145+0000 7f23c2ba9640 1 -- 172.21.15.79:0/140923239 >> 172.21.15.79:0/140923239 conn(0x7f23bc0fd400 msgr2=0x7f23bc1049e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:16.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.145+0000 7f23c2ba9640 1 -- 172.21.15.79:0/140923239 shutdown_connections 2024-08-20T01:38:16.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:16.145+0000 7f23c2ba9640 1 -- 172.21.15.79:0/140923239 wait complete. 2024-08-20T01:38:16.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:16 smithi175 ceph-mon[22392]: pgmap v375: 97 pgs: 97 active+clean; 174 MiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 14 MiB/s wr, 145 op/s 2024-08-20T01:38:17.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:17 smithi079 ceph-mon[18656]: scrub queued for path: / 2024-08-20T01:38:17.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:17 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:38:17.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:17 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:38:17.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:17 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:38:17.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:17 smithi081 ceph-mon[22209]: scrub queued for path: / 2024-08-20T01:38:17.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:17 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:38:17.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:17 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:38:17.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:17 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:38:17.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.787+0000 7f14a026e640 1 -- 172.21.15.79:0/2541246405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14981057c0 msgr2=0x7f1498107c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:17.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.787+0000 7f14a026e640 1 --2- 172.21.15.79:0/2541246405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14981057c0 0x7f1498107c30 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f1488009900 tx=0x7f148802a410 comp rx=0 tx=0).stop 2024-08-20T01:38:17.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.787+0000 7f14a026e640 1 -- 172.21.15.79:0/2541246405 shutdown_connections 2024-08-20T01:38:17.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.787+0000 7f14a026e640 1 --2- 172.21.15.79:0/2541246405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1498108370 0x7f149810a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:17.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.787+0000 7f14a026e640 1 --2- 172.21.15.79:0/2541246405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14981057c0 0x7f1498107c30 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:17.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.787+0000 7f14a026e640 1 --2- 172.21.15.79:0/2541246405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f149806b170 0x7f1498105230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:17.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.787+0000 7f14a026e640 1 -- 172.21.15.79:0/2541246405 >> 172.21.15.79:0/2541246405 conn(0x7f14980fce40 msgr2=0x7f14980ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:17.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.787+0000 7f14a026e640 1 -- 172.21.15.79:0/2541246405 shutdown_connections 2024-08-20T01:38:17.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.787+0000 7f14a026e640 1 -- 172.21.15.79:0/2541246405 wait complete. 2024-08-20T01:38:17.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.788+0000 7f14a026e640 1 Processor -- start 2024-08-20T01:38:17.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.788+0000 7f14a026e640 1 -- start start 2024-08-20T01:38:17.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.788+0000 7f14a026e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f149806b170 0x7f1498102970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:17.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.788+0000 7f14a026e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14981057c0 0x7f14981011d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:17.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.788+0000 7f14a026e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1498108370 0x7f1498101710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:17.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.788+0000 7f14a026e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f149810e150 con 0x7f14981057c0 2024-08-20T01:38:17.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.788+0000 7f14a026e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f149810dfd0 con 0x7f149806b170 2024-08-20T01:38:17.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.788+0000 7f14a026e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f149810e2d0 con 0x7f1498108370 2024-08-20T01:38:17.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.788+0000 7f149d809640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14981057c0 0x7f14981011d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:17.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.788+0000 7f149d809640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14981057c0 0x7f14981011d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49410/0 (socket says 172.21.15.79:49410) 2024-08-20T01:38:17.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.788+0000 7f149d809640 1 -- 172.21.15.79:0/2920962025 learned_addr learned my addr 172.21.15.79:0/2920962025 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:17.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.788+0000 7f149e00a640 1 --2- 172.21.15.79:0/2920962025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f149806b170 0x7f1498102970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:17.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.788+0000 7f149e80b640 1 --2- 172.21.15.79:0/2920962025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1498108370 0x7f1498101710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:17.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.789+0000 7f149d809640 1 -- 172.21.15.79:0/2920962025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1498108370 msgr2=0x7f1498101710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:17.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.789+0000 7f149d809640 1 --2- 172.21.15.79:0/2920962025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1498108370 0x7f1498101710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:17.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.789+0000 7f149d809640 1 -- 172.21.15.79:0/2920962025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f149806b170 msgr2=0x7f1498102970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:17.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.789+0000 7f149d809640 1 --2- 172.21.15.79:0/2920962025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f149806b170 0x7f1498102970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:17.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.789+0000 7f149d809640 1 -- 172.21.15.79:0/2920962025 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1498101f80 con 0x7f14981057c0 2024-08-20T01:38:17.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.789+0000 7f149d809640 1 --2- 172.21.15.79:0/2920962025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14981057c0 0x7f14981011d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f1488009a20 tx=0x7f14880040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:17.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.789+0000 7f148f7fe640 1 -- 172.21.15.79:0/2920962025 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f148803f030 con 0x7f14981057c0 2024-08-20T01:38:17.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.789+0000 7f148f7fe640 1 -- 172.21.15.79:0/2920962025 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1488003a80 con 0x7f14981057c0 2024-08-20T01:38:17.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.789+0000 7f148f7fe640 1 -- 172.21.15.79:0/2920962025 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1488035070 con 0x7f14981057c0 2024-08-20T01:38:17.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.789+0000 7f14a026e640 1 -- 172.21.15.79:0/2920962025 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14981a2a40 con 0x7f14981057c0 2024-08-20T01:38:17.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.789+0000 7f14a026e640 1 -- 172.21.15.79:0/2920962025 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14981a2eb0 con 0x7f14981057c0 2024-08-20T01:38:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.792+0000 7f14a3065740 1 Processor -- start 2024-08-20T01:38:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.792+0000 7f14a3065740 1 -- start start 2024-08-20T01:38:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.792+0000 7f148f7fe640 1 -- 172.21.15.79:0/2920962025 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1488042030 con 0x7f14981057c0 2024-08-20T01:38:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.792+0000 7f14a3065740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56493bec4630 0x56493bec6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.792+0000 7f14a3065740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56493bec6f60 0x56493bec9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.792+0000 7f14a3065740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56493bec99a0 0x56493becbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.792+0000 7f14a3065740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56493be37360 con 0x56493bec6f60 2024-08-20T01:38:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.792+0000 7f14a3065740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56493be26860 con 0x56493bec4630 2024-08-20T01:38:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.792+0000 7f14a3065740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56493be2a8a0 con 0x56493bec99a0 2024-08-20T01:38:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.793+0000 7f149e00a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56493bec6f60 0x56493bec9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.793+0000 7f149d809640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56493bec99a0 0x56493becbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.793+0000 7f149e00a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56493bec6f60 0x56493bec9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49414/0 (socket says 172.21.15.79:49414) 2024-08-20T01:38:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.793+0000 7f149e00a640 1 -- 172.21.15.79:0/2426293335 learned_addr learned my addr 172.21.15.79:0/2426293335 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:17.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.793+0000 7f149e80b640 1 --2- 172.21.15.79:0/2426293335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56493bec4630 0x56493bec6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:17.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.793+0000 7f149d809640 1 -- 172.21.15.79:0/2426293335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56493bec4630 msgr2=0x56493bec6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:17.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.793+0000 7f149d809640 1 --2- 172.21.15.79:0/2426293335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56493bec4630 0x56493bec6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:17.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.793+0000 7f149d809640 1 -- 172.21.15.79:0/2426293335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56493bec6f60 msgr2=0x56493bec9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:17.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.793+0000 7f149d809640 1 --2- 172.21.15.79:0/2426293335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56493bec6f60 0x56493bec9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:17.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.793+0000 7f149d809640 1 -- 172.21.15.79:0/2426293335 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56493bdcde40 con 0x56493bec99a0 2024-08-20T01:38:17.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.793+0000 7f149e80b640 1 --2- 172.21.15.79:0/2426293335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56493bec4630 0x56493bec6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:17.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.793+0000 7f149e00a640 1 --2- 172.21.15.79:0/2426293335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56493bec6f60 0x56493bec9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:17.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.793+0000 7f148f7fe640 1 --2- 172.21.15.79:0/2920962025 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f14840b3c50 0x7f14840b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:17.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.793+0000 7f149d809640 1 --2- 172.21.15.79:0/2426293335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56493bec99a0 0x56493becbe60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1488101c50 tx=0x7f148810c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82788c9066c8a2ff server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:17.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.793+0000 7f149e80b640 1 --2- 172.21.15.79:0/2920962025 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f14840b3c50 0x7f14840b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:17.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.793+0000 7f148f7fe640 1 -- 172.21.15.79:0/2920962025 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f1488104170 con 0x7f14981057c0 2024-08-20T01:38:17.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.793+0000 7f148cbfe640 1 -- 172.21.15.79:0/2426293335 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14880c7040 con 0x56493bec99a0 2024-08-20T01:38:17.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.794+0000 7f148cbfe640 1 -- 172.21.15.79:0/2426293335 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f14880cac90 con 0x56493bec99a0 2024-08-20T01:38:17.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.794+0000 7f148cbfe640 1 -- 172.21.15.79:0/2426293335 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14880ca8f0 con 0x56493bec99a0 2024-08-20T01:38:17.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.794+0000 7f14a3065740 1 -- 172.21.15.79:0/2426293335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56493bec99a0 msgr2=0x56493becbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:17.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.794+0000 7f14a3065740 1 --2- 172.21.15.79:0/2426293335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56493bec99a0 0x56493becbe60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1488101c50 tx=0x7f148810c540 comp rx=0 tx=0).stop 2024-08-20T01:38:17.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.794+0000 7f149e80b640 1 --2- 172.21.15.79:0/2920962025 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f14840b3c50 0x7f14840b6110 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1494005fd0 tx=0x7f1494009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:17.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.794+0000 7f14a3065740 1 -- 172.21.15.79:0/2426293335 shutdown_connections 2024-08-20T01:38:17.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.794+0000 7f14a3065740 1 --2- 172.21.15.79:0/2426293335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56493bec99a0 0x56493becbe60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:17.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.794+0000 7f14a3065740 1 --2- 172.21.15.79:0/2426293335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56493bec6f60 0x56493bec9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:17.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.794+0000 7f14a3065740 1 --2- 172.21.15.79:0/2426293335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56493bec4630 0x56493bec6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:17.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.794+0000 7f14a3065740 1 -- 172.21.15.79:0/2426293335 >> 172.21.15.79:0/2426293335 conn(0x56493bebf730 msgr2=0x56493bec0510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:17.803 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.795+0000 7f14a3065740 1 -- 172.21.15.79:0/2426293335 shutdown_connections 2024-08-20T01:38:17.803 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.795+0000 7f14a3065740 1 -- 172.21.15.79:0/2426293335 wait complete. 2024-08-20T01:38:17.803 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.795+0000 7f14a3065740 1 -- start start 2024-08-20T01:38:17.803 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.795+0000 7f14a3065740 1 Processor -- start 2024-08-20T01:38:17.803 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.795+0000 7f14a3065740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56493bec4630 0x56493becdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:17.803 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.795+0000 7f14a3065740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56493bec6f60 0x56493bece240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:17.803 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.795+0000 7f14a3065740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56493bec99a0 0x56493becee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:17.803 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.795+0000 7f14a3065740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56493bd5fab0 con 0x56493bec99a0 2024-08-20T01:38:17.803 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.795+0000 7f14a3065740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56493bdad780 con 0x56493bec4630 2024-08-20T01:38:17.803 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.795+0000 7f14a3065740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56493becc740 con 0x56493bec6f60 2024-08-20T01:38:17.803 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.795+0000 7f14a3065740 10 client.0 _ll_register_callbacks cb 0x56493bb35a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:17.803 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.795+0000 7f149e80b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56493bec99a0 0x56493becee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.795+0000 7f149e80b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56493bec99a0 0x56493becee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49430/0 (socket says 172.21.15.79:49430) 2024-08-20T01:38:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.795+0000 7f149d809640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56493bec6f60 0x56493bece240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.795+0000 7f149e80b640 1 -- 172.21.15.79:0/92138666 learned_addr learned my addr 172.21.15.79:0/92138666 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.795+0000 7f149e00a640 1 --2- 172.21.15.79:0/92138666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56493bec4630 0x56493becdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.796+0000 7f149e80b640 1 -- 172.21.15.79:0/92138666 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56493bec6f60 msgr2=0x56493bece240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.796+0000 7f149e80b640 1 --2- 172.21.15.79:0/92138666 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56493bec6f60 0x56493bece240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.796+0000 7f149e80b640 1 -- 172.21.15.79:0/92138666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56493bec4630 msgr2=0x56493becdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.796+0000 7f149e80b640 1 --2- 172.21.15.79:0/92138666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56493bec4630 0x56493becdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.796+0000 7f149e80b640 1 -- 172.21.15.79:0/92138666 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56493bb89790 con 0x56493bec99a0 2024-08-20T01:38:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.796+0000 7f149e80b640 1 --2- 172.21.15.79:0/92138666 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56493bec99a0 0x56493becee10 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f1494009b40 tx=0x7f1494004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27891eb5185a2b2c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.796+0000 7f1481ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:38:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.796+0000 7f1481ffb640 1 -- 172.21.15.79:0/92138666 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1494020620 con 0x56493bec99a0 2024-08-20T01:38:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.796+0000 7f1481ffb640 1 -- 172.21.15.79:0/92138666 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f14940207c0 con 0x56493bec99a0 2024-08-20T01:38:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.796+0000 7f14a3065740 1 -- 172.21.15.79:0/92138666 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56493bdd5e00 con 0x56493bec99a0 2024-08-20T01:38:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.796+0000 7f1481ffb640 1 -- 172.21.15.79:0/92138666 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f14940209c0 con 0x56493bec99a0 2024-08-20T01:38:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.796+0000 7f14a3065740 10 client.15927 fetch_fsmap learned FSMap version 28 2024-08-20T01:38:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.796+0000 7f14a3065740 1 -- 172.21.15.79:0/92138666 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56493bc02620 con 0x56493bec99a0 2024-08-20T01:38:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.797+0000 7f1481ffb640 1 -- 172.21.15.79:0/92138666 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56493bdd5e00 con 0x56493bec99a0 2024-08-20T01:38:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.797+0000 7f1481ffb640 1 -- 172.21.15.79:0/92138666 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f149400f040 con 0x56493bec99a0 2024-08-20T01:38:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.797+0000 7f14a3065740 10 client.15927 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:38:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.797+0000 7f14a3065740 10 client.15927 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:38:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.797+0000 7f14a3065740 20 client.15927 populate_metadata read hostname 'smithi079' 2024-08-20T01:38:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.797+0000 7f14a3065740 1 --2- 172.21.15.79:0/92138666 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56493bed9550 0x56493bedb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.797+0000 7f14a3065740 4 client.15927 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:38:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.797+0000 7f14a3065740 1 -- 172.21.15.79:0/92138666 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56493be392b0 con 0x56493bed9550 2024-08-20T01:38:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.797+0000 7f149e00a640 1 --2- 172.21.15.79:0/92138666 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56493bed9550 0x56493bedb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.798+0000 7f149e00a640 1 --2- 172.21.15.79:0/92138666 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56493bed9550 0x56493bedb980 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23a49f540b1eb224 server_cookie=f00fbc6671f8b182 in_seq=0 out_seq=0 2024-08-20T01:38:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.798+0000 7f1481ffb640 10 client.15927 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:17.807 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.798+0000 7f1481ffb640 1 -- 172.21.15.79:0/92138666 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56493be392b0 con 0x56493bed9550 2024-08-20T01:38:17.807 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.798+0000 7f1481ffb640 10 client.15927 handle_command_reply: tid=0 2024-08-20T01:38:17.807 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.798+0000 7f14a3065740 1 client.15927 shutdown 2024-08-20T01:38:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.799+0000 7f14a3065740 1 -- 172.21.15.79:0/92138666 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56493bec99a0 msgr2=0x56493becee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.799+0000 7f14a3065740 1 --2- 172.21.15.79:0/92138666 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56493bec99a0 0x56493becee10 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f1494009b40 tx=0x7f1494004a40 comp rx=0 tx=0).stop 2024-08-20T01:38:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.799+0000 7f14a3065740 1 -- 172.21.15.79:0/92138666 shutdown_connections 2024-08-20T01:38:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.799+0000 7f14a3065740 1 --2- 172.21.15.79:0/92138666 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56493bed9550 0x56493bedb980 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.799+0000 7f14a3065740 1 --2- 172.21.15.79:0/92138666 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56493bec99a0 0x56493becee10 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.799+0000 7f14a3065740 1 --2- 172.21.15.79:0/92138666 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56493bec6f60 0x56493bece240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.799+0000 7f14a3065740 1 --2- 172.21.15.79:0/92138666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56493bec4630 0x56493becdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.799+0000 7f1481ffb640 0 client.15927 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.799+0000 7f14a3065740 1 -- 172.21.15.79:0/92138666 >> 172.21.15.79:0/92138666 conn(0x56493bebf730 msgr2=0x56493bebe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.799+0000 7f14a3065740 1 -- 172.21.15.79:0/92138666 shutdown_connections 2024-08-20T01:38:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.799+0000 7f14a3065740 1 -- 172.21.15.79:0/92138666 wait complete. 2024-08-20T01:38:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.799+0000 7f14a3065740 20 client.15927 trim_cache size 0 max 16384 2024-08-20T01:38:17.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.821+0000 7f14a3065740 1 Processor -- start 2024-08-20T01:38:17.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.821+0000 7f14a3065740 1 -- start start 2024-08-20T01:38:17.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.821+0000 7f14a3065740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56493bec4630 0x56493bec9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:17.825 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.821+0000 7f14a3065740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56493bec6f60 0x56493beca350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:17.825 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.821+0000 7f14a3065740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56493bec99a0 0x56493beca890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:17.825 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.821+0000 7f14a3065740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f14981abcf0 con 0x56493bec4630 2024-08-20T01:38:17.825 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.821+0000 7f14a3065740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f14981ad830 con 0x56493bec99a0 2024-08-20T01:38:17.825 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.821+0000 7f14a3065740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f14981ac3c0 con 0x56493bec6f60 2024-08-20T01:38:17.825 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.822+0000 7f149e00a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56493bec4630 0x56493bec9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:17.825 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.822+0000 7f149e00a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56493bec4630 0x56493bec9e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49432/0 (socket says 172.21.15.79:49432) 2024-08-20T01:38:17.825 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.822+0000 7f149e00a640 1 -- 172.21.15.79:0/2329850629 learned_addr learned my addr 172.21.15.79:0/2329850629 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:17.825 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.822+0000 7f149e80b640 1 --2- 172.21.15.79:0/2329850629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56493bec99a0 0x56493beca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:17.825 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.822+0000 7f149d809640 1 --2- 172.21.15.79:0/2329850629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56493bec6f60 0x56493beca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:17.825 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.822+0000 7f149e00a640 1 -- 172.21.15.79:0/2329850629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56493bec6f60 msgr2=0x56493beca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:17.825 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.822+0000 7f149e00a640 1 --2- 172.21.15.79:0/2329850629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56493bec6f60 0x56493beca350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:17.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.822+0000 7f149e00a640 1 -- 172.21.15.79:0/2329850629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56493bec99a0 msgr2=0x56493beca890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:17.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.822+0000 7f149e00a640 1 --2- 172.21.15.79:0/2329850629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56493bec99a0 0x56493beca890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:17.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.822+0000 7f149e00a640 1 -- 172.21.15.79:0/2329850629 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56493bece5b0 con 0x56493bec4630 2024-08-20T01:38:17.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.822+0000 7f149e80b640 1 --2- 172.21.15.79:0/2329850629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56493bec99a0 0x56493beca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:17.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.822+0000 7f149e00a640 1 --2- 172.21.15.79:0/2329850629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56493bec4630 0x56493bec9e10 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f1490000c00 tx=0x7f1490005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d816c7df9ee0933f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:17.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.822+0000 7f1483fff640 1 -- 172.21.15.79:0/2329850629 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1490022070 con 0x56493bec4630 2024-08-20T01:38:17.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.822+0000 7f1483fff640 1 -- 172.21.15.79:0/2329850629 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f149000fc80 con 0x56493bec4630 2024-08-20T01:38:17.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.822+0000 7f1483fff640 1 -- 172.21.15.79:0/2329850629 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f149001eae0 con 0x56493bec4630 2024-08-20T01:38:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.823+0000 7f14a3065740 1 -- 172.21.15.79:0/2329850629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56493bec4630 msgr2=0x56493bec9e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.823+0000 7f14a3065740 1 --2- 172.21.15.79:0/2329850629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56493bec4630 0x56493bec9e10 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f1490000c00 tx=0x7f1490005f90 comp rx=0 tx=0).stop 2024-08-20T01:38:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.823+0000 7f14a3065740 1 -- 172.21.15.79:0/2329850629 shutdown_connections 2024-08-20T01:38:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.823+0000 7f14a3065740 1 --2- 172.21.15.79:0/2329850629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56493bec99a0 0x56493beca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.823+0000 7f14a3065740 1 --2- 172.21.15.79:0/2329850629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56493bec6f60 0x56493beca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.823+0000 7f14a3065740 1 --2- 172.21.15.79:0/2329850629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56493bec4630 0x56493bec9e10 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.823+0000 7f14a3065740 1 -- 172.21.15.79:0/2329850629 >> 172.21.15.79:0/2329850629 conn(0x56493bebf730 msgr2=0x56493beccaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.823+0000 7f14a3065740 1 -- 172.21.15.79:0/2329850629 shutdown_connections 2024-08-20T01:38:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.823+0000 7f14a3065740 1 -- 172.21.15.79:0/2329850629 wait complete. 2024-08-20T01:38:17.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.823+0000 7f14a3065740 1 -- start start 2024-08-20T01:38:17.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.824+0000 7f14a3065740 1 Processor -- start 2024-08-20T01:38:17.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.824+0000 7f14a3065740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56493bec4630 0x56493bed5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:17.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.824+0000 7f14a3065740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56493bec6f60 0x56493bed59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:17.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.824+0000 7f14a3065740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56493bec99a0 0x56493bed41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:17.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.824+0000 7f14a3065740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f14981ad160 con 0x56493bec4630 2024-08-20T01:38:17.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.824+0000 7f14a3065740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f14981aca90 con 0x56493bec6f60 2024-08-20T01:38:17.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.824+0000 7f14a3065740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f14981a9cd0 con 0x56493bec99a0 2024-08-20T01:38:17.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.824+0000 7f14a3065740 10 client.0 _ll_register_callbacks cb 0x7f1494009f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:17.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.824+0000 7f149e00a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56493bec4630 0x56493bed5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:17.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.824+0000 7f149e00a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56493bec4630 0x56493bed5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49442/0 (socket says 172.21.15.79:49442) 2024-08-20T01:38:17.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.824+0000 7f149e00a640 1 -- 172.21.15.79:0/4085820806 learned_addr learned my addr 172.21.15.79:0/4085820806 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:17.832 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.824+0000 7f149d809640 1 --2- 172.21.15.79:0/4085820806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56493bec6f60 0x56493bed59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:17.832 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.824+0000 7f149e80b640 1 --2- 172.21.15.79:0/4085820806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56493bec99a0 0x56493bed41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:17.832 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.824+0000 7f149e00a640 1 -- 172.21.15.79:0/4085820806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56493bec99a0 msgr2=0x56493bed41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:17.832 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.824+0000 7f149e00a640 1 --2- 172.21.15.79:0/4085820806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56493bec99a0 0x56493bed41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:17.832 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.824+0000 7f149e00a640 1 -- 172.21.15.79:0/4085820806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56493bec6f60 msgr2=0x56493bed59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:17.832 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.824+0000 7f149e00a640 1 --2- 172.21.15.79:0/4085820806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56493bec6f60 0x56493bed59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:17.832 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.824+0000 7f149e00a640 1 -- 172.21.15.79:0/4085820806 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56493bec96c0 con 0x56493bec4630 2024-08-20T01:38:17.832 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.824+0000 7f149d809640 1 --2- 172.21.15.79:0/4085820806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56493bec6f60 0x56493bed59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:38:17.832 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.824+0000 7f149e00a640 1 --2- 172.21.15.79:0/4085820806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56493bec4630 0x56493bed5300 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f1490010520 tx=0x7f1490010550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4b04da132b37fd7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:17.832 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.824+0000 7f1481ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:38:17.832 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.825+0000 7f1481ffb640 1 -- 172.21.15.79:0/4085820806 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1490022040 con 0x56493bec4630 2024-08-20T01:38:17.832 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.825+0000 7f1481ffb640 1 -- 172.21.15.79:0/4085820806 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f149000f7f0 con 0x56493bec4630 2024-08-20T01:38:17.833 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.825+0000 7f14a3065740 1 -- 172.21.15.79:0/4085820806 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f149000fc80 con 0x56493bec4630 2024-08-20T01:38:17.833 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.825+0000 7f1481ffb640 1 -- 172.21.15.79:0/4085820806 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f149000f9f0 con 0x56493bec4630 2024-08-20T01:38:17.833 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.825+0000 7f14a3065740 10 client.15933 fetch_fsmap learned FSMap version 28 2024-08-20T01:38:17.833 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.825+0000 7f14a3065740 1 -- 172.21.15.79:0/4085820806 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56493bed3660 con 0x56493bec4630 2024-08-20T01:38:17.833 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.825+0000 7f1481ffb640 1 -- 172.21.15.79:0/4085820806 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f149000fc80 con 0x56493bec4630 2024-08-20T01:38:17.833 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.825+0000 7f1481ffb640 1 -- 172.21.15.79:0/4085820806 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1490027750 con 0x56493bec4630 2024-08-20T01:38:17.833 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.825+0000 7f14a3065740 10 client.15933 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:38:17.833 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.825+0000 7f14a3065740 10 client.15933 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:38:17.833 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.825+0000 7f14a3065740 20 client.15933 populate_metadata read hostname 'smithi079' 2024-08-20T01:38:17.833 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.825+0000 7f14a3065740 1 --2- 172.21.15.79:0/4085820806 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56493bf446b0 0x56493bf46ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:17.834 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.825+0000 7f14a3065740 4 client.15933 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:38:17.834 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.825+0000 7f14a3065740 1 -- 172.21.15.79:0/4085820806 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56493be34d50 con 0x56493bf446b0 2024-08-20T01:38:17.834 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.826+0000 7f149d809640 1 --2- 172.21.15.79:0/4085820806 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56493bf446b0 0x56493bf46ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:17.834 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.826+0000 7f1481ffb640 10 client.15933 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:17.834 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.826+0000 7f149d809640 1 --2- 172.21.15.79:0/4085820806 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56493bf446b0 0x56493bf46ad0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fe9c9a35bc35626 server_cookie=f6878f82a1a3123c in_seq=0 out_seq=0 2024-08-20T01:38:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.847+0000 7f1481ffb640 1 -- 172.21.15.79:0/4085820806 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56493be34d50 con 0x56493bf446b0 2024-08-20T01:38:17.850 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.847+0000 7f1481ffb640 10 client.15933 handle_command_reply: tid=0 2024-08-20T01:38:17.850 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.847+0000 7f14a3065740 1 client.15933 shutdown 2024-08-20T01:38:17.850 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.847+0000 7f14a3065740 1 -- 172.21.15.79:0/4085820806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56493bec4630 msgr2=0x56493bed5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:17.850 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.847+0000 7f14a3065740 1 --2- 172.21.15.79:0/4085820806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56493bec4630 0x56493bed5300 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f1490010520 tx=0x7f1490010550 comp rx=0 tx=0).stop 2024-08-20T01:38:17.850 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.847+0000 7f14a3065740 1 -- 172.21.15.79:0/4085820806 shutdown_connections 2024-08-20T01:38:17.850 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.847+0000 7f14a3065740 1 --2- 172.21.15.79:0/4085820806 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56493bf446b0 0x56493bf46ad0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:17.850 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.847+0000 7f14a3065740 1 --2- 172.21.15.79:0/4085820806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56493bec99a0 0x56493bed41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:17.850 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.847+0000 7f1481ffb640 0 client.15933 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:17.850 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.847+0000 7f14a3065740 1 --2- 172.21.15.79:0/4085820806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56493bec6f60 0x56493bed59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:17.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.847+0000 7f14a3065740 1 --2- 172.21.15.79:0/4085820806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56493bec4630 0x56493bed5300 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:17.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.847+0000 7f14a3065740 1 -- 172.21.15.79:0/4085820806 >> 172.21.15.79:0/4085820806 conn(0x56493bebf730 msgr2=0x56493bebe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:17.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.847+0000 7f14a3065740 1 -- 172.21.15.79:0/4085820806 shutdown_connections 2024-08-20T01:38:17.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.847+0000 7f14a3065740 1 -- 172.21.15.79:0/4085820806 wait complete. 2024-08-20T01:38:17.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.847+0000 7f14a3065740 20 client.15933 trim_cache size 0 max 16384 2024-08-20T01:38:17.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:38:17.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:38:17.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:38:17.852 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:38:17.852 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.848+0000 7f14a026e640 1 -- 172.21.15.79:0/2920962025 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f14840b3c50 msgr2=0x7f14840b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:17.852 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.848+0000 7f14a026e640 1 --2- 172.21.15.79:0/2920962025 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f14840b3c50 0x7f14840b6110 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1494005fd0 tx=0x7f1494009600 comp rx=0 tx=0).stop 2024-08-20T01:38:17.853 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.848+0000 7f14a026e640 1 -- 172.21.15.79:0/2920962025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14981057c0 msgr2=0x7f14981011d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:17.853 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.848+0000 7f14a026e640 1 --2- 172.21.15.79:0/2920962025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14981057c0 0x7f14981011d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f1488009a20 tx=0x7f14880040c0 comp rx=0 tx=0).stop 2024-08-20T01:38:17.853 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.848+0000 7f14a026e640 1 -- 172.21.15.79:0/2920962025 shutdown_connections 2024-08-20T01:38:17.853 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.848+0000 7f14a026e640 1 --2- 172.21.15.79:0/2920962025 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f14840b3c50 0x7f14840b6110 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:17.853 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.848+0000 7f14a026e640 1 --2- 172.21.15.79:0/2920962025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1498108370 0x7f1498101710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:17.853 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.848+0000 7f14a026e640 1 --2- 172.21.15.79:0/2920962025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14981057c0 0x7f14981011d0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:17.853 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.848+0000 7f14a026e640 1 --2- 172.21.15.79:0/2920962025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f149806b170 0x7f1498102970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:17.853 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.848+0000 7f14a026e640 1 -- 172.21.15.79:0/2920962025 >> 172.21.15.79:0/2920962025 conn(0x7f14980fce40 msgr2=0x7f1498103b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:17.853 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.848+0000 7f14a026e640 1 -- 172.21.15.79:0/2920962025 shutdown_connections 2024-08-20T01:38:17.853 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:17.848+0000 7f14a026e640 1 -- 172.21.15.79:0/2920962025 wait complete. 2024-08-20T01:38:17.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:17 smithi175 ceph-mon[22392]: scrub queued for path: / 2024-08-20T01:38:17.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:17 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:38:17.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:17 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:38:17.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:17 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:38:18.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:18 smithi079 ceph-mon[18656]: pgmap v376: 97 pgs: 97 active+clean; 238 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 20 MiB/s wr, 114 op/s 2024-08-20T01:38:18.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:18 smithi081 ceph-mon[22209]: pgmap v376: 97 pgs: 97 active+clean; 238 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 20 MiB/s wr, 114 op/s 2024-08-20T01:38:18.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:18 smithi175 ceph-mon[22392]: pgmap v376: 97 pgs: 97 active+clean; 238 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 20 MiB/s wr, 114 op/s 2024-08-20T01:38:19.205 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:38:19.468 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:38:19.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.978+0000 7f293d8dd640 1 -- 172.21.15.79:0/941905710 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2938101990 msgr2=0x7f2938101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:19.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.978+0000 7f293d8dd640 1 --2- 172.21.15.79:0/941905710 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2938101990 0x7f2938101d70 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f2928009900 tx=0x7f292802a410 comp rx=0 tx=0).stop 2024-08-20T01:38:19.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.978+0000 7f293d8dd640 1 -- 172.21.15.79:0/941905710 shutdown_connections 2024-08-20T01:38:19.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.978+0000 7f293d8dd640 1 --2- 172.21.15.79:0/941905710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2938107d20 0x7f293810e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:19.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.978+0000 7f293d8dd640 1 --2- 172.21.15.79:0/941905710 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29381073a0 0x7f29381077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:19.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.978+0000 7f293d8dd640 1 --2- 172.21.15.79:0/941905710 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2938101990 0x7f2938101d70 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:19.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.978+0000 7f293d8dd640 1 -- 172.21.15.79:0/941905710 >> 172.21.15.79:0/941905710 conn(0x7f29380fd400 msgr2=0x7f29380ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:19.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.978+0000 7f293d8dd640 1 -- 172.21.15.79:0/941905710 shutdown_connections 2024-08-20T01:38:19.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.978+0000 7f293d8dd640 1 -- 172.21.15.79:0/941905710 wait complete. 2024-08-20T01:38:19.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.979+0000 7f293d8dd640 1 Processor -- start 2024-08-20T01:38:19.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.979+0000 7f293d8dd640 1 -- start start 2024-08-20T01:38:19.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.979+0000 7f293d8dd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2938101990 0x7f2938198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:19.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.979+0000 7f293d8dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29381073a0 0x7f2938199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:19.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.979+0000 7f293d8dd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2938107d20 0x7f293819e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:19.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.979+0000 7f293d8dd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f29381118e0 con 0x7f2938101990 2024-08-20T01:38:19.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.979+0000 7f293d8dd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2938111760 con 0x7f29381073a0 2024-08-20T01:38:19.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.979+0000 7f293d8dd640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2938111a60 con 0x7f2938107d20 2024-08-20T01:38:19.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.979+0000 7f2936ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2938101990 0x7f2938198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:19.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.980+0000 7f2936ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2938101990 0x7f2938198de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49464/0 (socket says 172.21.15.79:49464) 2024-08-20T01:38:19.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.980+0000 7f2936ffd640 1 -- 172.21.15.79:0/1559687770 learned_addr learned my addr 172.21.15.79:0/1559687770 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:19.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.980+0000 7f29377fe640 1 --2- 172.21.15.79:0/1559687770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2938107d20 0x7f293819e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.980+0000 7f292ffff640 1 --2- 172.21.15.79:0/1559687770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29381073a0 0x7f2938199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.980+0000 7f2936ffd640 1 -- 172.21.15.79:0/1559687770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2938107d20 msgr2=0x7f293819e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:20.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.980+0000 7f2936ffd640 1 --2- 172.21.15.79:0/1559687770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2938107d20 0x7f293819e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.980+0000 7f2936ffd640 1 -- 172.21.15.79:0/1559687770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29381073a0 msgr2=0x7f2938199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:20.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.980+0000 7f2936ffd640 1 --2- 172.21.15.79:0/1559687770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29381073a0 0x7f2938199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.980+0000 7f2936ffd640 1 -- 172.21.15.79:0/1559687770 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f293819ee90 con 0x7f2938101990 2024-08-20T01:38:20.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.980+0000 7f2936ffd640 1 --2- 172.21.15.79:0/1559687770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2938101990 0x7f2938198de0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f292802a930 tx=0x7f2928003d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:20.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.980+0000 7f293c8db640 1 -- 172.21.15.79:0/1559687770 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f292803f070 con 0x7f2938101990 2024-08-20T01:38:20.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.980+0000 7f293c8db640 1 -- 172.21.15.79:0/1559687770 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f292803bdc0 con 0x7f2938101990 2024-08-20T01:38:20.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.980+0000 7f293d8dd640 1 -- 172.21.15.79:0/1559687770 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f293819f120 con 0x7f2938101990 2024-08-20T01:38:20.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.980+0000 7f293c8db640 1 -- 172.21.15.79:0/1559687770 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2928035030 con 0x7f2938101990 2024-08-20T01:38:20.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.980+0000 7f293d8dd640 1 -- 172.21.15.79:0/1559687770 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29381a5840 con 0x7f2938101990 2024-08-20T01:38:20.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.983+0000 7f293c8db640 1 -- 172.21.15.79:0/1559687770 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2928042070 con 0x7f2938101990 2024-08-20T01:38:20.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.983+0000 7f293fcd6740 1 Processor -- start 2024-08-20T01:38:20.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.984+0000 7f293fcd6740 1 -- start start 2024-08-20T01:38:20.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.984+0000 7f293fcd6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55faef81b6e0 0x55faef81bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.984+0000 7f293fcd6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55faef81c000 0x55faef827a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.984+0000 7f293fcd6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55faef827f90 0x55faef82a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.984+0000 7f293c8db640 1 --2- 172.21.15.79:0/1559687770 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f29240b3bd0 0x7f29240b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.984+0000 7f293fcd6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55faef7928e0 con 0x55faef81c000 2024-08-20T01:38:20.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.984+0000 7f293fcd6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55faef781de0 con 0x55faef827f90 2024-08-20T01:38:20.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.984+0000 7f293fcd6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55faef785e20 con 0x55faef81b6e0 2024-08-20T01:38:20.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.984+0000 7f2936ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55faef81c000 0x55faef827a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.984+0000 7f29377fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55faef81b6e0 0x55faef81bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.984+0000 7f292ffff640 1 --2- 172.21.15.79:0/1559687770 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f29240b3bd0 0x7f29240b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.984+0000 7f29377fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55faef81b6e0 0x55faef81bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:57338/0 (socket says 172.21.15.79:57338) 2024-08-20T01:38:20.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.984+0000 7f29377fe640 1 -- 172.21.15.79:0/1108957726 learned_addr learned my addr 172.21.15.79:0/1108957726 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:20.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.984+0000 7f293c8db640 1 -- 172.21.15.79:0/1559687770 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f2928104600 con 0x7f2938101990 2024-08-20T01:38:20.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.984+0000 7f29377fe640 1 --2- 172.21.15.79:0/1108957726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55faef827f90 0x55faef82a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.984+0000 7f29377fe640 1 -- 172.21.15.79:0/1108957726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55faef827f90 msgr2=0x55faef82a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:20.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.984+0000 7f29377fe640 1 --2- 172.21.15.79:0/1108957726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55faef827f90 0x55faef82a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.984+0000 7f29377fe640 1 -- 172.21.15.79:0/1108957726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55faef81c000 msgr2=0x55faef827a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:20.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.984+0000 7f29377fe640 1 --2- 172.21.15.79:0/1108957726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55faef81c000 0x55faef827a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.984+0000 7f29377fe640 1 -- 172.21.15.79:0/1108957726 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55faef4e1650 con 0x55faef81b6e0 2024-08-20T01:38:20.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.985+0000 7f2936ffd640 1 --2- 172.21.15.79:0/1108957726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55faef81c000 0x55faef827a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:38:20.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.985+0000 7f292ffff640 1 --2- 172.21.15.79:0/1559687770 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f29240b3bd0 0x7f29240b6090 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2920005e10 tx=0x7f2920005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:20.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.985+0000 7f29377fe640 1 --2- 172.21.15.79:0/1108957726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55faef81b6e0 0x55faef81bac0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2930014ca0 tx=0x7f2930007a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19e7b9a610fbf835 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:20.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.985+0000 7f292dffb640 1 -- 172.21.15.79:0/1108957726 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2930014e50 con 0x55faef81b6e0 2024-08-20T01:38:20.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.985+0000 7f292dffb640 1 -- 172.21.15.79:0/1108957726 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29300140d0 con 0x55faef81b6e0 2024-08-20T01:38:20.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.985+0000 7f292dffb640 1 -- 172.21.15.79:0/1108957726 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2930005670 con 0x55faef81b6e0 2024-08-20T01:38:20.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.986+0000 7f293fcd6740 1 -- 172.21.15.79:0/1108957726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55faef81b6e0 msgr2=0x55faef81bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:20.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.986+0000 7f293fcd6740 1 --2- 172.21.15.79:0/1108957726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55faef81b6e0 0x55faef81bac0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2930014ca0 tx=0x7f2930007a10 comp rx=0 tx=0).stop 2024-08-20T01:38:20.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.986+0000 7f293fcd6740 1 -- 172.21.15.79:0/1108957726 shutdown_connections 2024-08-20T01:38:20.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.986+0000 7f293fcd6740 1 --2- 172.21.15.79:0/1108957726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55faef827f90 0x55faef82a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.986+0000 7f293fcd6740 1 --2- 172.21.15.79:0/1108957726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55faef81c000 0x55faef827a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.986+0000 7f293fcd6740 1 --2- 172.21.15.79:0/1108957726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55faef81b6e0 0x55faef81bac0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.986+0000 7f293fcd6740 1 -- 172.21.15.79:0/1108957726 >> 172.21.15.79:0/1108957726 conn(0x55faef819510 msgr2=0x55faef81a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:20.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.986+0000 7f293fcd6740 1 -- 172.21.15.79:0/1108957726 shutdown_connections 2024-08-20T01:38:20.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.986+0000 7f293fcd6740 1 -- 172.21.15.79:0/1108957726 wait complete. 2024-08-20T01:38:20.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.986+0000 7f293fcd6740 1 -- start start 2024-08-20T01:38:20.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.987+0000 7f293fcd6740 1 Processor -- start 2024-08-20T01:38:20.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.987+0000 7f293fcd6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55faef81b6e0 0x55faef824fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.987+0000 7f293fcd6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55faef81c000 0x55faef8254f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.987+0000 7f293fcd6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55faef827f90 0x55faef825a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.987+0000 7f293fcd6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55faef5e4700 con 0x55faef827f90 2024-08-20T01:38:20.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.987+0000 7f293fcd6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55faef7087c0 con 0x55faef81c000 2024-08-20T01:38:20.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.987+0000 7f293fcd6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55faef82abe0 con 0x55faef81b6e0 2024-08-20T01:38:20.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.987+0000 7f293fcd6740 10 client.0 _ll_register_callbacks cb 0x55faef77b6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:20.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.987+0000 7f29377fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55faef827f90 0x55faef825a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.987+0000 7f29377fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55faef827f90 0x55faef825a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49476/0 (socket says 172.21.15.79:49476) 2024-08-20T01:38:20.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.987+0000 7f29377fe640 1 -- 172.21.15.79:0/2495219701 learned_addr learned my addr 172.21.15.79:0/2495219701 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:20.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.987+0000 7f2936ffd640 1 --2- 172.21.15.79:0/2495219701 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55faef81b6e0 0x55faef824fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.987+0000 7f292ffff640 1 --2- 172.21.15.79:0/2495219701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55faef81c000 0x55faef8254f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.987+0000 7f29377fe640 1 -- 172.21.15.79:0/2495219701 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55faef81b6e0 msgr2=0x55faef824fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:20.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.987+0000 7f29377fe640 1 --2- 172.21.15.79:0/2495219701 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55faef81b6e0 0x55faef824fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.987+0000 7f29377fe640 1 -- 172.21.15.79:0/2495219701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55faef81c000 msgr2=0x55faef8254f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:20.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.987+0000 7f29377fe640 1 --2- 172.21.15.79:0/2495219701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55faef81c000 0x55faef8254f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.988+0000 7f29377fe640 1 -- 172.21.15.79:0/2495219701 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55faef8383e0 con 0x55faef827f90 2024-08-20T01:38:20.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.988+0000 7f292ffff640 1 --2- 172.21.15.79:0/2495219701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55faef81c000 0x55faef8254f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:38:20.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.988+0000 7f29377fe640 1 --2- 172.21.15.79:0/2495219701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55faef827f90 0x55faef825a30 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f2930010010 tx=0x7f2930007520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebf798ff68e0bc89 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:20.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.988+0000 7f2916ffd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:38:20.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.988+0000 7f2916ffd640 1 -- 172.21.15.79:0/2495219701 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2930004c40 con 0x55faef827f90 2024-08-20T01:38:20.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.988+0000 7f2916ffd640 1 -- 172.21.15.79:0/2495219701 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f2930004de0 con 0x55faef827f90 2024-08-20T01:38:20.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.988+0000 7f293fcd6740 1 -- 172.21.15.79:0/2495219701 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55faef731100 con 0x55faef827f90 2024-08-20T01:38:20.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.988+0000 7f2916ffd640 1 -- 172.21.15.79:0/2495219701 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f29300148e0 con 0x55faef827f90 2024-08-20T01:38:20.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.988+0000 7f293fcd6740 10 client.15945 fetch_fsmap learned FSMap version 28 2024-08-20T01:38:20.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.988+0000 7f293fcd6740 1 -- 172.21.15.79:0/2495219701 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55faef83ad90 con 0x55faef827f90 2024-08-20T01:38:20.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.988+0000 7f2916ffd640 1 -- 172.21.15.79:0/2495219701 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55faef731100 con 0x55faef827f90 2024-08-20T01:38:20.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.989+0000 7f2916ffd640 1 -- 172.21.15.79:0/2495219701 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f29300207c0 con 0x55faef827f90 2024-08-20T01:38:20.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.989+0000 7f293fcd6740 10 client.15945 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:38:20.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.989+0000 7f293fcd6740 10 client.15945 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:38:20.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.989+0000 7f293fcd6740 20 client.15945 populate_metadata read hostname 'smithi079' 2024-08-20T01:38:20.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.989+0000 7f293fcd6740 1 --2- 172.21.15.79:0/2495219701 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55faef83c140 0x55faef83e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.989+0000 7f293fcd6740 4 client.15945 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:38:20.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.989+0000 7f293fcd6740 1 -- 172.21.15.79:0/2495219701 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55faef794830 con 0x55faef83c140 2024-08-20T01:38:20.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.989+0000 7f2936ffd640 1 --2- 172.21.15.79:0/2495219701 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55faef83c140 0x55faef83e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.990+0000 7f2936ffd640 1 --2- 172.21.15.79:0/2495219701 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55faef83c140 0x55faef83e530 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eaa9ff5ed2d4efa8 server_cookie=e1d7789f8b063666 in_seq=0 out_seq=0 2024-08-20T01:38:20.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.990+0000 7f2916ffd640 10 client.15945 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:20.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.990+0000 7f2916ffd640 1 -- 172.21.15.79:0/2495219701 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55faef794830 con 0x55faef83c140 2024-08-20T01:38:20.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.990+0000 7f2916ffd640 10 client.15945 handle_command_reply: tid=0 2024-08-20T01:38:20.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.990+0000 7f293fcd6740 1 client.15945 shutdown 2024-08-20T01:38:20.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.990+0000 7f293fcd6740 1 -- 172.21.15.79:0/2495219701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55faef827f90 msgr2=0x55faef825a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:20.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.990+0000 7f293fcd6740 1 --2- 172.21.15.79:0/2495219701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55faef827f90 0x55faef825a30 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f2930010010 tx=0x7f2930007520 comp rx=0 tx=0).stop 2024-08-20T01:38:20.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.991+0000 7f293fcd6740 1 -- 172.21.15.79:0/2495219701 shutdown_connections 2024-08-20T01:38:20.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.991+0000 7f293fcd6740 1 --2- 172.21.15.79:0/2495219701 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55faef83c140 0x55faef83e530 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.991+0000 7f293fcd6740 1 --2- 172.21.15.79:0/2495219701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55faef827f90 0x55faef825a30 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.991+0000 7f293fcd6740 1 --2- 172.21.15.79:0/2495219701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55faef81c000 0x55faef8254f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.991+0000 7f2916ffd640 0 client.15945 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:20.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.991+0000 7f293fcd6740 1 --2- 172.21.15.79:0/2495219701 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55faef81b6e0 0x55faef824fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.991+0000 7f293fcd6740 1 -- 172.21.15.79:0/2495219701 >> 172.21.15.79:0/2495219701 conn(0x55faef819510 msgr2=0x55faef81f080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:20.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.991+0000 7f293fcd6740 1 -- 172.21.15.79:0/2495219701 shutdown_connections 2024-08-20T01:38:20.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.991+0000 7f293fcd6740 1 -- 172.21.15.79:0/2495219701 wait complete. 2024-08-20T01:38:20.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:19.991+0000 7f293fcd6740 20 client.15945 trim_cache size 0 max 16384 2024-08-20T01:38:20.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.012+0000 7f293fcd6740 1 Processor -- start 2024-08-20T01:38:20.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.012+0000 7f293fcd6740 1 -- start start 2024-08-20T01:38:20.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.012+0000 7f293fcd6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55faef81b6e0 0x55faef81ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.012+0000 7f293fcd6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55faef81c000 0x55faef843b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.012+0000 7f293fcd6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55faef827f90 0x55faef8440d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.012+0000 7f293fcd6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f29381abc50 con 0x55faef81b6e0 2024-08-20T01:38:20.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.012+0000 7f293fcd6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f29381ad790 con 0x55faef81c000 2024-08-20T01:38:20.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.012+0000 7f293fcd6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f29381ac320 con 0x55faef827f90 2024-08-20T01:38:20.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.012+0000 7f2936ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55faef81b6e0 0x55faef81ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.012+0000 7f2936ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55faef81b6e0 0x55faef81ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49488/0 (socket says 172.21.15.79:49488) 2024-08-20T01:38:20.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.012+0000 7f2936ffd640 1 -- 172.21.15.79:0/3982902515 learned_addr learned my addr 172.21.15.79:0/3982902515 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:20.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.012+0000 7f29377fe640 1 --2- 172.21.15.79:0/3982902515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55faef827f90 0x55faef8440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.013+0000 7f292ffff640 1 --2- 172.21.15.79:0/3982902515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55faef81c000 0x55faef843b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.013+0000 7f29377fe640 1 -- 172.21.15.79:0/3982902515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55faef81c000 msgr2=0x55faef843b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:20.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.013+0000 7f29377fe640 1 --2- 172.21.15.79:0/3982902515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55faef81c000 0x55faef843b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.013+0000 7f29377fe640 1 -- 172.21.15.79:0/3982902515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55faef81b6e0 msgr2=0x55faef81ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:20.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.013+0000 7f29377fe640 1 --2- 172.21.15.79:0/3982902515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55faef81b6e0 0x55faef81ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.013+0000 7f29377fe640 1 -- 172.21.15.79:0/3982902515 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55faef819d90 con 0x55faef827f90 2024-08-20T01:38:20.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.013+0000 7f29377fe640 1 --2- 172.21.15.79:0/3982902515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55faef827f90 0x55faef8440d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2930020b80 tx=0x7f2930007680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7869a488ddf0f9c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:20.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.013+0000 7f292d7fa640 1 -- 172.21.15.79:0/3982902515 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2930007d60 con 0x55faef827f90 2024-08-20T01:38:20.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.013+0000 7f292d7fa640 1 -- 172.21.15.79:0/3982902515 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2930038020 con 0x55faef827f90 2024-08-20T01:38:20.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.013+0000 7f292d7fa640 1 -- 172.21.15.79:0/3982902515 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29300208f0 con 0x55faef827f90 2024-08-20T01:38:20.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.014+0000 7f293fcd6740 1 -- 172.21.15.79:0/3982902515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55faef827f90 msgr2=0x55faef8440d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:20.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.014+0000 7f293fcd6740 1 --2- 172.21.15.79:0/3982902515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55faef827f90 0x55faef8440d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2930020b80 tx=0x7f2930007680 comp rx=0 tx=0).stop 2024-08-20T01:38:20.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.014+0000 7f293fcd6740 1 -- 172.21.15.79:0/3982902515 shutdown_connections 2024-08-20T01:38:20.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.014+0000 7f293fcd6740 1 --2- 172.21.15.79:0/3982902515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55faef827f90 0x55faef8440d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.014+0000 7f293fcd6740 1 --2- 172.21.15.79:0/3982902515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55faef81c000 0x55faef843b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.014+0000 7f293fcd6740 1 --2- 172.21.15.79:0/3982902515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55faef81b6e0 0x55faef81ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.014+0000 7f293fcd6740 1 -- 172.21.15.79:0/3982902515 >> 172.21.15.79:0/3982902515 conn(0x55faef819510 msgr2=0x55faef81a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:20.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.014+0000 7f293fcd6740 1 -- 172.21.15.79:0/3982902515 shutdown_connections 2024-08-20T01:38:20.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.014+0000 7f293fcd6740 1 -- 172.21.15.79:0/3982902515 wait complete. 2024-08-20T01:38:20.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.015+0000 7f293fcd6740 1 -- start start 2024-08-20T01:38:20.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.015+0000 7f293fcd6740 1 Processor -- start 2024-08-20T01:38:20.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.015+0000 7f293fcd6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55faef81b6e0 0x55faef82cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.015+0000 7f293fcd6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55faef81c000 0x55faef82d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.015+0000 7f293fcd6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55faef827f90 0x55faef82d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.015+0000 7f293fcd6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f29381ad0c0 con 0x55faef81b6e0 2024-08-20T01:38:20.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.015+0000 7f293fcd6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f29381ac9f0 con 0x55faef81c000 2024-08-20T01:38:20.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.015+0000 7f293fcd6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f29381a9c30 con 0x55faef827f90 2024-08-20T01:38:20.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.015+0000 7f293fcd6740 10 client.0 _ll_register_callbacks cb 0x7f2930014620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:20.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.015+0000 7f2936ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55faef81b6e0 0x55faef82cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.015+0000 7f2936ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55faef81b6e0 0x55faef82cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49500/0 (socket says 172.21.15.79:49500) 2024-08-20T01:38:20.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.015+0000 7f2936ffd640 1 -- 172.21.15.79:0/1683419588 learned_addr learned my addr 172.21.15.79:0/1683419588 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:20.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.015+0000 7f29377fe640 1 --2- 172.21.15.79:0/1683419588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55faef827f90 0x55faef82d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.015+0000 7f292ffff640 1 --2- 172.21.15.79:0/1683419588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55faef81c000 0x55faef82d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.016+0000 7f29377fe640 1 -- 172.21.15.79:0/1683419588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55faef81c000 msgr2=0x55faef82d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:20.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.016+0000 7f29377fe640 1 --2- 172.21.15.79:0/1683419588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55faef81c000 0x55faef82d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.016+0000 7f29377fe640 1 -- 172.21.15.79:0/1683419588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55faef81b6e0 msgr2=0x55faef82cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:20.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.016+0000 7f29377fe640 1 --2- 172.21.15.79:0/1683419588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55faef81b6e0 0x55faef82cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.016+0000 7f29377fe640 1 -- 172.21.15.79:0/1683419588 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55faef819f90 con 0x55faef827f90 2024-08-20T01:38:20.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.016+0000 7f2936ffd640 1 --2- 172.21.15.79:0/1683419588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55faef81b6e0 0x55faef82cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:20.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.016+0000 7f29377fe640 1 --2- 172.21.15.79:0/1683419588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55faef827f90 0x55faef82d920 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2930020b80 tx=0x7f2930020970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=440faca331e09c87 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:20.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.016+0000 7f2916ffd640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:38:20.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.016+0000 7f2916ffd640 1 -- 172.21.15.79:0/1683419588 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2930007d60 con 0x55faef827f90 2024-08-20T01:38:20.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.016+0000 7f2916ffd640 1 -- 172.21.15.79:0/1683419588 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f2930020d20 con 0x55faef827f90 2024-08-20T01:38:20.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.016+0000 7f293fcd6740 1 -- 172.21.15.79:0/1683419588 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2930038020 con 0x55faef827f90 2024-08-20T01:38:20.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.016+0000 7f2916ffd640 1 -- 172.21.15.79:0/1683419588 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2930003970 con 0x55faef827f90 2024-08-20T01:38:20.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.016+0000 7f293fcd6740 10 client.25294 fetch_fsmap learned FSMap version 28 2024-08-20T01:38:20.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.016+0000 7f293fcd6740 1 -- 172.21.15.79:0/1683419588 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55faef8a5ef0 con 0x55faef827f90 2024-08-20T01:38:20.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.016+0000 7f2916ffd640 1 -- 172.21.15.79:0/1683419588 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2930038020 con 0x55faef827f90 2024-08-20T01:38:20.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.017+0000 7f2916ffd640 1 -- 172.21.15.79:0/1683419588 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f29300056c0 con 0x55faef827f90 2024-08-20T01:38:20.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.017+0000 7f293fcd6740 10 client.25294 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T01:38:20.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.017+0000 7f293fcd6740 10 client.25294 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:38:20.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.017+0000 7f293fcd6740 20 client.25294 populate_metadata read hostname 'smithi079' 2024-08-20T01:38:20.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.017+0000 7f293fcd6740 1 --2- 172.21.15.79:0/1683419588 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55faef8a6550 0x55faef8a8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:20.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.017+0000 7f293fcd6740 4 client.25294 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:38:20.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.017+0000 7f293fcd6740 1 -- 172.21.15.79:0/1683419588 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55faef820b80 con 0x55faef8a6550 2024-08-20T01:38:20.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.017+0000 7f2936ffd640 1 --2- 172.21.15.79:0/1683419588 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55faef8a6550 0x55faef8a8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:20.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.017+0000 7f2916ffd640 10 client.25294 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:20.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.017+0000 7f2936ffd640 1 --2- 172.21.15.79:0/1683419588 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55faef8a6550 0x55faef8a8970 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f52984161c9b3df8 server_cookie=b693b5abdcac5030 in_seq=0 out_seq=0 2024-08-20T01:38:20.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.017+0000 7f2916ffd640 1 -- 172.21.15.79:0/1683419588 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55faef820b80 con 0x55faef8a6550 2024-08-20T01:38:20.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.017+0000 7f2916ffd640 10 client.25294 handle_command_reply: tid=0 2024-08-20T01:38:20.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.017+0000 7f293fcd6740 1 client.25294 shutdown 2024-08-20T01:38:20.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.018+0000 7f293fcd6740 1 -- 172.21.15.79:0/1683419588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55faef827f90 msgr2=0x55faef82d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:20.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.018+0000 7f293fcd6740 1 --2- 172.21.15.79:0/1683419588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55faef827f90 0x55faef82d920 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2930020b80 tx=0x7f2930020970 comp rx=0 tx=0).stop 2024-08-20T01:38:20.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.018+0000 7f293fcd6740 1 -- 172.21.15.79:0/1683419588 shutdown_connections 2024-08-20T01:38:20.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.018+0000 7f293fcd6740 1 --2- 172.21.15.79:0/1683419588 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55faef8a6550 0x55faef8a8970 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.018+0000 7f293fcd6740 1 --2- 172.21.15.79:0/1683419588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55faef827f90 0x55faef82d920 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.018+0000 7f293fcd6740 1 --2- 172.21.15.79:0/1683419588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55faef81c000 0x55faef82d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.018+0000 7f2916ffd640 0 client.25294 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:20.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.018+0000 7f293fcd6740 1 --2- 172.21.15.79:0/1683419588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55faef81b6e0 0x55faef82cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.018+0000 7f293fcd6740 1 -- 172.21.15.79:0/1683419588 >> 172.21.15.79:0/1683419588 conn(0x55faef819510 msgr2=0x55faef817b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:20.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.018+0000 7f293fcd6740 1 -- 172.21.15.79:0/1683419588 shutdown_connections 2024-08-20T01:38:20.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.018+0000 7f293fcd6740 1 -- 172.21.15.79:0/1683419588 wait complete. 2024-08-20T01:38:20.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.018+0000 7f293fcd6740 20 client.25294 trim_cache size 0 max 16384 2024-08-20T01:38:20.029 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:38:20.029 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-08-20T01:38:20.029 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-08-20T01:38:20.029 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:38:20.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.019+0000 7f293d8dd640 1 -- 172.21.15.79:0/1559687770 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f29240b3bd0 msgr2=0x7f29240b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:20.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.019+0000 7f293d8dd640 1 --2- 172.21.15.79:0/1559687770 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f29240b3bd0 0x7f29240b6090 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2920005e10 tx=0x7f2920005da0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.019+0000 7f293d8dd640 1 -- 172.21.15.79:0/1559687770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2938101990 msgr2=0x7f2938198de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:20.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.019+0000 7f293d8dd640 1 --2- 172.21.15.79:0/1559687770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2938101990 0x7f2938198de0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f292802a930 tx=0x7f2928003d60 comp rx=0 tx=0).stop 2024-08-20T01:38:20.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.019+0000 7f293d8dd640 1 -- 172.21.15.79:0/1559687770 shutdown_connections 2024-08-20T01:38:20.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.019+0000 7f293d8dd640 1 --2- 172.21.15.79:0/1559687770 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f29240b3bd0 0x7f29240b6090 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.019+0000 7f293d8dd640 1 --2- 172.21.15.79:0/1559687770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2938107d20 0x7f293819e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.019+0000 7f293d8dd640 1 --2- 172.21.15.79:0/1559687770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29381073a0 0x7f2938199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.019+0000 7f293d8dd640 1 --2- 172.21.15.79:0/1559687770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2938101990 0x7f2938198de0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:20.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.019+0000 7f293d8dd640 1 -- 172.21.15.79:0/1559687770 >> 172.21.15.79:0/1559687770 conn(0x7f29380fd400 msgr2=0x7f29380ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:20.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.019+0000 7f293d8dd640 1 -- 172.21.15.79:0/1559687770 shutdown_connections 2024-08-20T01:38:20.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:20.019+0000 7f293d8dd640 1 -- 172.21.15.79:0/1559687770 wait complete. 2024-08-20T01:38:20.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:20 smithi079 ceph-mon[18656]: pgmap v377: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 25 MiB/s wr, 88 op/s 2024-08-20T01:38:20.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:20 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:38:20.739 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T01:38:20.739 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:38:20.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:20 smithi081 ceph-mon[22209]: pgmap v377: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 25 MiB/s wr, 88 op/s 2024-08-20T01:38:20.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:20 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:38:20.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:20 smithi175 ceph-mon[22392]: pgmap v377: 97 pgs: 97 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 25 MiB/s wr, 88 op/s 2024-08-20T01:38:20.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:20 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:38:21.049 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:38:21.431 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:21 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:38:21.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.577+0000 7f6d69363640 1 -- 172.21.15.79:0/2133193005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d64101eb0 msgr2=0x7f6d6410ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:21.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.577+0000 7f6d69363640 1 --2- 172.21.15.79:0/2133193005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d64101eb0 0x7f6d6410ec00 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f6d58009900 tx=0x7f6d5802a480 comp rx=0 tx=0).stop 2024-08-20T01:38:21.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.577+0000 7f6d69363640 1 -- 172.21.15.79:0/2133193005 shutdown_connections 2024-08-20T01:38:21.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.577+0000 7f6d69363640 1 --2- 172.21.15.79:0/2133193005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d6410f140 0x7f6d64111530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:21.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.577+0000 7f6d69363640 1 --2- 172.21.15.79:0/2133193005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d64101eb0 0x7f6d6410ec00 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:21.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.577+0000 7f6d69363640 1 --2- 172.21.15.79:0/2133193005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d64101590 0x7f6d64101970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:21.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.577+0000 7f6d69363640 1 -- 172.21.15.79:0/2133193005 >> 172.21.15.79:0/2133193005 conn(0x7f6d640fd400 msgr2=0x7f6d640ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:21.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.577+0000 7f6d69363640 1 -- 172.21.15.79:0/2133193005 shutdown_connections 2024-08-20T01:38:21.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.577+0000 7f6d69363640 1 -- 172.21.15.79:0/2133193005 wait complete. 2024-08-20T01:38:21.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.577+0000 7f6d69363640 1 Processor -- start 2024-08-20T01:38:21.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.578+0000 7f6d69363640 1 -- start start 2024-08-20T01:38:21.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.578+0000 7f6d69363640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d64101590 0x7f6d6419b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:21.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.578+0000 7f6d69363640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d64101eb0 0x7f6d6419b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:21.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.578+0000 7f6d69363640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d6410f140 0x7f6d641a0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:21.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.578+0000 7f6d69363640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6d64114b80 con 0x7f6d6410f140 2024-08-20T01:38:21.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.578+0000 7f6d69363640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6d64114a00 con 0x7f6d64101eb0 2024-08-20T01:38:21.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.578+0000 7f6d69363640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6d64114d00 con 0x7f6d64101590 2024-08-20T01:38:21.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.578+0000 7f6d627fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d64101eb0 0x7f6d6419b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:21.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.578+0000 7f6d637fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d6410f140 0x7f6d641a0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:21.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.578+0000 7f6d627fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d64101eb0 0x7f6d6419b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:51694/0 (socket says 172.21.15.79:51694) 2024-08-20T01:38:21.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.578+0000 7f6d627fc640 1 -- 172.21.15.79:0/1101951811 learned_addr learned my addr 172.21.15.79:0/1101951811 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:21.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.578+0000 7f6d62ffd640 1 --2- 172.21.15.79:0/1101951811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d64101590 0x7f6d6419b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:21.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.579+0000 7f6d627fc640 1 -- 172.21.15.79:0/1101951811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d64101590 msgr2=0x7f6d6419b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:21.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.579+0000 7f6d627fc640 1 --2- 172.21.15.79:0/1101951811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d64101590 0x7f6d6419b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:21.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.579+0000 7f6d627fc640 1 -- 172.21.15.79:0/1101951811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d6410f140 msgr2=0x7f6d641a0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:21.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.579+0000 7f6d627fc640 1 --2- 172.21.15.79:0/1101951811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d6410f140 0x7f6d641a0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:21.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.579+0000 7f6d627fc640 1 -- 172.21.15.79:0/1101951811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d641a1200 con 0x7f6d64101eb0 2024-08-20T01:38:21.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.579+0000 7f6d637fe640 1 --2- 172.21.15.79:0/1101951811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d6410f140 0x7f6d641a0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:21.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.579+0000 7f6d627fc640 1 --2- 172.21.15.79:0/1101951811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d64101eb0 0x7f6d6419b690 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6d5802a9a0 tx=0x7f6d58003c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:21.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.579+0000 7f6d4bfff640 1 -- 172.21.15.79:0/1101951811 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d5803f070 con 0x7f6d64101eb0 2024-08-20T01:38:21.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.579+0000 7f6d69363640 1 -- 172.21.15.79:0/1101951811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d641a1490 con 0x7f6d64101eb0 2024-08-20T01:38:21.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.579+0000 7f6d4bfff640 1 -- 172.21.15.79:0/1101951811 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d58003e40 con 0x7f6d64101eb0 2024-08-20T01:38:21.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.579+0000 7f6d69363640 1 -- 172.21.15.79:0/1101951811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d641a7bb0 con 0x7f6d64101eb0 2024-08-20T01:38:21.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.579+0000 7f6d4bfff640 1 -- 172.21.15.79:0/1101951811 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d58035030 con 0x7f6d64101eb0 2024-08-20T01:38:21.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.580+0000 7f6d69363640 1 -- 172.21.15.79:0/1101951811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d64101970 con 0x7f6d64101eb0 2024-08-20T01:38:21.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.582+0000 7f6d4bfff640 1 -- 172.21.15.79:0/1101951811 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f6d58042070 con 0x7f6d64101eb0 2024-08-20T01:38:21.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.582+0000 7f6d4bfff640 1 --2- 172.21.15.79:0/1101951811 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6d4c0b3bd0 0x7f6d4c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:21.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.583+0000 7f6d62ffd640 1 --2- 172.21.15.79:0/1101951811 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6d4c0b3bd0 0x7f6d4c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:21.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.583+0000 7f6d4bfff640 1 -- 172.21.15.79:0/1101951811 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f6d581047e0 con 0x7f6d64101eb0 2024-08-20T01:38:21.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.583+0000 7f6d62ffd640 1 --2- 172.21.15.79:0/1101951811 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6d4c0b3bd0 0x7f6d4c0b6090 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6d54005d00 tx=0x7f6d5400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:21.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.585+0000 7f6d4bfff640 1 -- 172.21.15.79:0/1101951811 <== mon.2 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f6d580cb7f0 con 0x7f6d64101eb0 2024-08-20T01:38:21.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:21 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:38:21.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.867+0000 7f6d69363640 1 -- 172.21.15.79:0/1101951811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6d6410a2d0 con 0x7f6d64101eb0 2024-08-20T01:38:21.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.868+0000 7f6d4bfff640 1 -- 172.21.15.79:0/1101951811 <== mon.2 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11974 (secure 0 0 0) 0x7f6d580cfd40 con 0x7f6d64101eb0 2024-08-20T01:38:21.871 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:38:21.871 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":29,"btime":"2024-08-20T01:38:20:414433+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14670,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/735082912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":735082912},{"type":"v1","addr":"172.21.15.79:6835","nonce":735082912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2150339873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2150339873},{"type":"v1","addr":"172.21.15.79:6837","nonce":2150339873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:34:55.133562+0000","modified":"2024-08-20T01:38:19.602134+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24539,"mds_1":24538,"mds_2":24523,"mds_3":24514,"mds_4":24512},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14724":{"gid":14724,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/1071242274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1071242274},{"type":"v1","addr":"172.21.15.79:6839","nonce":1071242274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14730":{"gid":14730,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6841/2448977611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":2448977611},{"type":"v1","addr":"172.21.15.79:6841","nonce":2448977611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/1257507005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1257507005},{"type":"v1","addr":"172.21.15.81:6833","nonce":1257507005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1499936216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1499936216},{"type":"v1","addr":"172.21.15.81:6835","nonce":1499936216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/1107229215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1107229215},{"type":"v1","addr":"172.21.15.175:6833","nonce":1107229215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6837/2073598870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2073598870},{"type":"v1","addr":"172.21.15.81:6837","nonce":2073598870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/2552601173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2552601173},{"type":"v1","addr":"172.21.15.175:6835","nonce":2552601173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6837/1767284089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1767284089},{"type":"v1","addr":"172.21.15.175:6837","nonce":1767284089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/1331748742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1331748742},{"type":"v1","addr":"172.21.15.175:6839","nonce":1331748742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/4098410583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":4098410583},{"type":"v1","addr":"172.21.15.81:6839","nonce":4098410583}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24539,"qdb_cluster":[24539,24523,24514,24538,24512]},"id":1}]} 2024-08-20T01:38:21.871 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 29 2024-08-20T01:38:21.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.870+0000 7f6d69363640 1 -- 172.21.15.79:0/1101951811 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6d4c0b3bd0 msgr2=0x7f6d4c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:21.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.870+0000 7f6d69363640 1 --2- 172.21.15.79:0/1101951811 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6d4c0b3bd0 0x7f6d4c0b6090 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6d54005d00 tx=0x7f6d5400b410 comp rx=0 tx=0).stop 2024-08-20T01:38:21.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.870+0000 7f6d69363640 1 -- 172.21.15.79:0/1101951811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d64101eb0 msgr2=0x7f6d6419b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:21.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.870+0000 7f6d69363640 1 --2- 172.21.15.79:0/1101951811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d64101eb0 0x7f6d6419b690 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6d5802a9a0 tx=0x7f6d58003c20 comp rx=0 tx=0).stop 2024-08-20T01:38:21.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.871+0000 7f6d69363640 1 -- 172.21.15.79:0/1101951811 shutdown_connections 2024-08-20T01:38:21.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.871+0000 7f6d69363640 1 --2- 172.21.15.79:0/1101951811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d6410f140 0x7f6d641a0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:21.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.871+0000 7f6d69363640 1 --2- 172.21.15.79:0/1101951811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d64101eb0 0x7f6d6419b690 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:21.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.871+0000 7f6d69363640 1 --2- 172.21.15.79:0/1101951811 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6d4c0b3bd0 0x7f6d4c0b6090 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:21.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.871+0000 7f6d69363640 1 --2- 172.21.15.79:0/1101951811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d64101590 0x7f6d6419b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:21.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.871+0000 7f6d69363640 1 -- 172.21.15.79:0/1101951811 >> 172.21.15.79:0/1101951811 conn(0x7f6d640fd400 msgr2=0x7f6d640ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:21.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.871+0000 7f6d69363640 1 -- 172.21.15.79:0/1101951811 shutdown_connections 2024-08-20T01:38:21.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:21.871+0000 7f6d69363640 1 -- 172.21.15.79:0/1101951811 wait complete. 2024-08-20T01:38:21.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:21 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:38:22.564 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:22 smithi079 ceph-mon[18656]: pgmap v378: 97 pgs: 97 active+clean; 358 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 27 MiB/s wr, 61 op/s 2024-08-20T01:38:22.564 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:22 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/1101951811' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:38:22.591 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-20T01:38:22.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:22 smithi081 ceph-mon[22209]: pgmap v378: 97 pgs: 97 active+clean; 358 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 27 MiB/s wr, 61 op/s 2024-08-20T01:38:22.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:22 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/1101951811' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:38:22.865 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:38:22.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:22 smithi175 ceph-mon[22392]: pgmap v378: 97 pgs: 97 active+clean; 358 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 27 MiB/s wr, 61 op/s 2024-08-20T01:38:22.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:22 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/1101951811' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:38:23.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.410+0000 7f27ea79f640 1 -- 172.21.15.79:0/4292582423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27e4104130 msgr2=0x7f27e410c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:23.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.410+0000 7f27ea79f640 1 --2- 172.21.15.79:0/4292582423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27e4104130 0x7f27e410c620 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f27d4009900 tx=0x7f27d402a410 comp rx=0 tx=0).stop 2024-08-20T01:38:23.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.411+0000 7f27ea79f640 1 -- 172.21.15.79:0/4292582423 shutdown_connections 2024-08-20T01:38:23.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.411+0000 7f27ea79f640 1 --2- 172.21.15.79:0/4292582423 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27e410cc70 0x7f27e410f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:23.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.411+0000 7f27ea79f640 1 --2- 172.21.15.79:0/4292582423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27e4104130 0x7f27e410c620 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:23.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.411+0000 7f27ea79f640 1 --2- 172.21.15.79:0/4292582423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e4103810 0x7f27e4103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:23.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.411+0000 7f27ea79f640 1 -- 172.21.15.79:0/4292582423 >> 172.21.15.79:0/4292582423 conn(0x7f27e40fd2d0 msgr2=0x7f27e40ff6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:23.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.411+0000 7f27ea79f640 1 -- 172.21.15.79:0/4292582423 shutdown_connections 2024-08-20T01:38:23.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.411+0000 7f27ea79f640 1 -- 172.21.15.79:0/4292582423 wait complete. 2024-08-20T01:38:23.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.411+0000 7f27ea79f640 1 Processor -- start 2024-08-20T01:38:23.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.412+0000 7f27ea79f640 1 -- start start 2024-08-20T01:38:23.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.412+0000 7f27ea79f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27e4103810 0x7f27e41014c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:23.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.412+0000 7f27ea79f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e4104130 0x7f27e4101a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:23.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.412+0000 7f27ea79f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27e410cc70 0x7f27e4101f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:23.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.412+0000 7f27ea79f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f27e4112790 con 0x7f27e4103810 2024-08-20T01:38:23.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.412+0000 7f27ea79f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f27e4112610 con 0x7f27e4104130 2024-08-20T01:38:23.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.412+0000 7f27ea79f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f27e4112910 con 0x7f27e410cc70 2024-08-20T01:38:23.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.412+0000 7f27e979d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27e4103810 0x7f27e41014c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:23.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.412+0000 7f27e979d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27e4103810 0x7f27e41014c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36638/0 (socket says 172.21.15.79:36638) 2024-08-20T01:38:23.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.412+0000 7f27e979d640 1 -- 172.21.15.79:0/1626139306 learned_addr learned my addr 172.21.15.79:0/1626139306 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:23.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.412+0000 7f27e9f9e640 1 --2- 172.21.15.79:0/1626139306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27e410cc70 0x7f27e4101f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:23.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.412+0000 7f27e8f9c640 1 --2- 172.21.15.79:0/1626139306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e4104130 0x7f27e4101a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:23.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.412+0000 7f27e979d640 1 -- 172.21.15.79:0/1626139306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27e410cc70 msgr2=0x7f27e4101f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:23.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.412+0000 7f27e979d640 1 --2- 172.21.15.79:0/1626139306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27e410cc70 0x7f27e4101f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:23.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.412+0000 7f27e979d640 1 -- 172.21.15.79:0/1626139306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e4104130 msgr2=0x7f27e4101a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:23.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.412+0000 7f27e979d640 1 --2- 172.21.15.79:0/1626139306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e4104130 0x7f27e4101a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:23.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.412+0000 7f27e979d640 1 -- 172.21.15.79:0/1626139306 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27e41a7140 con 0x7f27e4103810 2024-08-20T01:38:23.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.413+0000 7f27e979d640 1 --2- 172.21.15.79:0/1626139306 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27e4103810 0x7f27e41014c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f27e000d950 tx=0x7f27e000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:23.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.413+0000 7f27da7fc640 1 -- 172.21.15.79:0/1626139306 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e0017030 con 0x7f27e4103810 2024-08-20T01:38:23.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.413+0000 7f27ea79f640 1 -- 172.21.15.79:0/1626139306 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27e41a7430 con 0x7f27e4103810 2024-08-20T01:38:23.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.413+0000 7f27da7fc640 1 -- 172.21.15.79:0/1626139306 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f27e0004020 con 0x7f27e4103810 2024-08-20T01:38:23.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.413+0000 7f27ea79f640 1 -- 172.21.15.79:0/1626139306 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27e41a7990 con 0x7f27e4103810 2024-08-20T01:38:23.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.413+0000 7f27da7fc640 1 -- 172.21.15.79:0/1626139306 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e00055d0 con 0x7f27e4103810 2024-08-20T01:38:23.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.415+0000 7f27da7fc640 1 -- 172.21.15.79:0/1626139306 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f27e00041d0 con 0x7f27e4103810 2024-08-20T01:38:23.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.416+0000 7f27eddfa740 1 Processor -- start 2024-08-20T01:38:23.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.416+0000 7f27eddfa740 1 -- start start 2024-08-20T01:38:23.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.416+0000 7f27eddfa740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c04993910 0x562c04993cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:23.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.416+0000 7f27eddfa740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c04994230 0x562c0499fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:23.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.416+0000 7f27eddfa740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c049a01c0 0x562c049a25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:23.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.416+0000 7f27eddfa740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562c0490a930 con 0x562c04993910 2024-08-20T01:38:23.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.416+0000 7f27eddfa740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562c048f9e30 con 0x562c04994230 2024-08-20T01:38:23.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.416+0000 7f27eddfa740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562c048fde70 con 0x562c049a01c0 2024-08-20T01:38:23.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.416+0000 7f27e9f9e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c04993910 0x562c04993cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:23.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.416+0000 7f27e9f9e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c04993910 0x562c04993cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36646/0 (socket says 172.21.15.79:36646) 2024-08-20T01:38:23.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.416+0000 7f27e9f9e640 1 -- 172.21.15.79:0/407508491 learned_addr learned my addr 172.21.15.79:0/407508491 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:23.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.416+0000 7f27e8f9c640 1 --2- 172.21.15.79:0/407508491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c049a01c0 0x562c049a25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:23.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.417+0000 7f27e979d640 1 --2- 172.21.15.79:0/407508491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c04994230 0x562c0499fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:23.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.417+0000 7f27da7fc640 1 --2- 172.21.15.79:0/1626139306 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f27d00b3c70 0x7f27d00b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:23.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.417+0000 7f27e9f9e640 1 -- 172.21.15.79:0/407508491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c049a01c0 msgr2=0x562c049a25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:23.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.417+0000 7f27e9f9e640 1 --2- 172.21.15.79:0/407508491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c049a01c0 0x562c049a25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:23.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.417+0000 7f27e9f9e640 1 -- 172.21.15.79:0/407508491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c04994230 msgr2=0x562c0499fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:23.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.417+0000 7f27e9f9e640 1 --2- 172.21.15.79:0/407508491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c04994230 0x562c0499fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:23.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.417+0000 7f27e9f9e640 1 -- 172.21.15.79:0/407508491 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c04659650 con 0x562c04993910 2024-08-20T01:38:23.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.417+0000 7f27e979d640 1 --2- 172.21.15.79:0/407508491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c04994230 0x562c0499fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:38:23.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.417+0000 7f27e8f9c640 1 --2- 172.21.15.79:0/407508491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c049a01c0 0x562c049a25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:38:23.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.417+0000 7f27da7fc640 1 -- 172.21.15.79:0/1626139306 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f27e00e3330 con 0x7f27e4103810 2024-08-20T01:38:23.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.417+0000 7f27e9f9e640 1 --2- 172.21.15.79:0/1626139306 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f27d00b3c70 0x7f27d00b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:23.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.417+0000 7f27e9f9e640 1 --2- 172.21.15.79:0/407508491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c04993910 0x562c04993cf0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f27dc0104b0 tx=0x7f27dc010970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b4337e7670a4f18 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:23.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.418+0000 7f27e9f9e640 1 --2- 172.21.15.79:0/1626139306 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f27d00b3c70 0x7f27d00b6130 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f27dc021000 tx=0x7f27dc01e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:23.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.418+0000 7f27cf7fe640 1 -- 172.21.15.79:0/407508491 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27dc024070 con 0x562c04993910 2024-08-20T01:38:23.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.418+0000 7f27cf7fe640 1 -- 172.21.15.79:0/407508491 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f27dc013c10 con 0x562c04993910 2024-08-20T01:38:23.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.418+0000 7f27cf7fe640 1 -- 172.21.15.79:0/407508491 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27dc01e9b0 con 0x562c04993910 2024-08-20T01:38:23.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.418+0000 7f27eddfa740 1 -- 172.21.15.79:0/407508491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c04993910 msgr2=0x562c04993cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:23.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.418+0000 7f27eddfa740 1 --2- 172.21.15.79:0/407508491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c04993910 0x562c04993cf0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f27dc0104b0 tx=0x7f27dc010970 comp rx=0 tx=0).stop 2024-08-20T01:38:23.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.418+0000 7f27eddfa740 1 -- 172.21.15.79:0/407508491 shutdown_connections 2024-08-20T01:38:23.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.418+0000 7f27eddfa740 1 --2- 172.21.15.79:0/407508491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c049a01c0 0x562c049a25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:23.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.418+0000 7f27eddfa740 1 --2- 172.21.15.79:0/407508491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c04994230 0x562c0499fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:23.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.418+0000 7f27eddfa740 1 --2- 172.21.15.79:0/407508491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c04993910 0x562c04993cf0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:23.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.418+0000 7f27eddfa740 1 -- 172.21.15.79:0/407508491 >> 172.21.15.79:0/407508491 conn(0x562c04991740 msgr2=0x562c049928e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:23.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.418+0000 7f27eddfa740 1 -- 172.21.15.79:0/407508491 shutdown_connections 2024-08-20T01:38:23.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.419+0000 7f27eddfa740 1 -- 172.21.15.79:0/407508491 wait complete. 2024-08-20T01:38:23.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.419+0000 7f27eddfa740 1 -- start start 2024-08-20T01:38:23.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.419+0000 7f27eddfa740 1 Processor -- start 2024-08-20T01:38:23.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.419+0000 7f27eddfa740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c04993910 0x562c0499d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:23.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.419+0000 7f27eddfa740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c04994230 0x562c0499d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:23.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.419+0000 7f27eddfa740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c049a01c0 0x562c0499dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:23.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.420+0000 7f27eddfa740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562c0475c700 con 0x562c04994230 2024-08-20T01:38:23.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.420+0000 7f27eddfa740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562c04880810 con 0x562c049a01c0 2024-08-20T01:38:23.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.420+0000 7f27eddfa740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562c049a2e70 con 0x562c04993910 2024-08-20T01:38:23.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.420+0000 7f27e8f9c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c04994230 0x562c0499d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:23.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.420+0000 7f27e8f9c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c04994230 0x562c0499d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36648/0 (socket says 172.21.15.79:36648) 2024-08-20T01:38:23.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.420+0000 7f27e8f9c640 1 -- 172.21.15.79:0/1102368856 learned_addr learned my addr 172.21.15.79:0/1102368856 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:23.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.420+0000 7f27eddfa740 10 client.0 _ll_register_callbacks cb 0x562c048f3700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:23.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.420+0000 7f27e9f9e640 1 --2- 172.21.15.79:0/1102368856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c049a01c0 0x562c0499dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:23.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.420+0000 7f27e979d640 1 --2- 172.21.15.79:0/1102368856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c04993910 0x562c0499d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:23.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.420+0000 7f27e8f9c640 1 -- 172.21.15.79:0/1102368856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c04993910 msgr2=0x562c0499d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:23.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.420+0000 7f27e8f9c640 1 --2- 172.21.15.79:0/1102368856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c04993910 0x562c0499d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:23.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.420+0000 7f27e8f9c640 1 -- 172.21.15.79:0/1102368856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c049a01c0 msgr2=0x562c0499dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:23.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.420+0000 7f27e8f9c640 1 --2- 172.21.15.79:0/1102368856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c049a01c0 0x562c0499dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:23.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.420+0000 7f27e8f9c640 1 -- 172.21.15.79:0/1102368856 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c049ac280 con 0x562c04994230 2024-08-20T01:38:23.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.420+0000 7f27e8f9c640 1 --2- 172.21.15.79:0/1102368856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c04994230 0x562c0499d680 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f27d4009900 tx=0x7f27d4031e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac898b38420ad92 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:23.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.420+0000 7f27ccff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:38:23.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.420+0000 7f27ccff9640 1 -- 172.21.15.79:0/1102368856 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d4035070 con 0x562c04994230 2024-08-20T01:38:23.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.421+0000 7f27ccff9640 1 -- 172.21.15.79:0/1102368856 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f27d4004040 con 0x562c04994230 2024-08-20T01:38:23.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.421+0000 7f27eddfa740 1 -- 172.21.15.79:0/1102368856 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562c048a9150 con 0x562c04994230 2024-08-20T01:38:23.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.421+0000 7f27ccff9640 1 -- 172.21.15.79:0/1102368856 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f27d4004240 con 0x562c04994230 2024-08-20T01:38:23.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.421+0000 7f27eddfa740 10 client.15969 fetch_fsmap learned FSMap version 29 2024-08-20T01:38:23.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.421+0000 7f27eddfa740 1 -- 172.21.15.79:0/1102368856 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562c049aec00 con 0x562c04994230 2024-08-20T01:38:23.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.421+0000 7f27ccff9640 1 -- 172.21.15.79:0/1102368856 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x562c048a9150 con 0x562c04994230 2024-08-20T01:38:23.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.421+0000 7f27ccff9640 1 -- 172.21.15.79:0/1102368856 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f27d4043020 con 0x562c04994230 2024-08-20T01:38:23.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.421+0000 7f27eddfa740 10 client.15969 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:38:23.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.421+0000 7f27eddfa740 10 client.15969 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:38:23.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.421+0000 7f27eddfa740 20 client.15969 populate_metadata read hostname 'smithi079' 2024-08-20T01:38:23.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.421+0000 7f27eddfa740 1 --2- 172.21.15.79:0/1102368856 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x562c049b0160 0x562c049b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:23.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.421+0000 7f27eddfa740 4 client.15969 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:38:23.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.421+0000 7f27eddfa740 1 -- 172.21.15.79:0/1102368856 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c0490c880 con 0x562c049b0160 2024-08-20T01:38:23.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.422+0000 7f27e979d640 1 --2- 172.21.15.79:0/1102368856 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x562c049b0160 0x562c049b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:23.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.422+0000 7f27e979d640 1 --2- 172.21.15.79:0/1102368856 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x562c049b0160 0x562c049b25c0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=dac0ec6374beb023 server_cookie=f03b2158332b73fd in_seq=0 out_seq=0 2024-08-20T01:38:23.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.422+0000 7f27ccff9640 10 client.15969 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:38:23.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.423+0000 7f27ccff9640 1 -- 172.21.15.79:0/1102368856 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562c0490c880 con 0x562c049b0160 2024-08-20T01:38:23.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.423+0000 7f27ccff9640 10 client.15969 handle_command_reply: tid=0 2024-08-20T01:38:23.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.423+0000 7f27eddfa740 1 client.15969 shutdown 2024-08-20T01:38:23.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.423+0000 7f27eddfa740 1 -- 172.21.15.79:0/1102368856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c04994230 msgr2=0x562c0499d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:23.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.423+0000 7f27eddfa740 1 --2- 172.21.15.79:0/1102368856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c04994230 0x562c0499d680 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f27d4009900 tx=0x7f27d4031e60 comp rx=0 tx=0).stop 2024-08-20T01:38:23.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.423+0000 7f27eddfa740 1 -- 172.21.15.79:0/1102368856 shutdown_connections 2024-08-20T01:38:23.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.423+0000 7f27eddfa740 1 --2- 172.21.15.79:0/1102368856 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x562c049b0160 0x562c049b25c0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:23.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.423+0000 7f27eddfa740 1 --2- 172.21.15.79:0/1102368856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c049a01c0 0x562c0499dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:23.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.423+0000 7f27eddfa740 1 --2- 172.21.15.79:0/1102368856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c04994230 0x562c0499d680 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:23.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.423+0000 7f27eddfa740 1 --2- 172.21.15.79:0/1102368856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c04993910 0x562c0499d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:23.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.423+0000 7f27eddfa740 1 -- 172.21.15.79:0/1102368856 >> 172.21.15.79:0/1102368856 conn(0x562c04991740 msgr2=0x562c049972e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:23.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.423+0000 7f27ccff9640 0 client.15969 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:38:23.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.423+0000 7f27eddfa740 1 -- 172.21.15.79:0/1102368856 shutdown_connections 2024-08-20T01:38:23.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.423+0000 7f27eddfa740 1 -- 172.21.15.79:0/1102368856 wait complete. 2024-08-20T01:38:23.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.423+0000 7f27eddfa740 20 client.15969 trim_cache size 0 max 16384 2024-08-20T01:38:23.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.439+0000 7f27eddfa740 1 Processor -- start 2024-08-20T01:38:23.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.439+0000 7f27eddfa740 1 -- start start 2024-08-20T01:38:23.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.439+0000 7f27eddfa740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c04993910 0x562c04992e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:23.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.440+0000 7f27eddfa740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c04994230 0x562c0499ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:23.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.440+0000 7f27eddfa740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c049a01c0 0x562c049b7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:23.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.440+0000 7f27eddfa740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f27c800e430 con 0x562c049a01c0 2024-08-20T01:38:23.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.440+0000 7f27eddfa740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f27c800ffa0 con 0x562c04993910 2024-08-20T01:38:23.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.440+0000 7f27eddfa740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f27c800eb00 con 0x562c04994230 2024-08-20T01:38:23.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.440+0000 7f27e9f9e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c049a01c0 0x562c049b7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:23.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.440+0000 7f27e9f9e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c049a01c0 0x562c049b7e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36652/0 (socket says 172.21.15.79:36652) 2024-08-20T01:38:23.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.440+0000 7f27e9f9e640 1 -- 172.21.15.79:0/2378813779 learned_addr learned my addr 172.21.15.79:0/2378813779 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:23.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.440+0000 7f27e979d640 1 --2- 172.21.15.79:0/2378813779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c04993910 0x562c04992e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:23.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.440+0000 7f27e8f9c640 1 --2- 172.21.15.79:0/2378813779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c04994230 0x562c0499ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:23.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.440+0000 7f27e9f9e640 1 -- 172.21.15.79:0/2378813779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c04994230 msgr2=0x562c0499ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:23.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.440+0000 7f27e9f9e640 1 --2- 172.21.15.79:0/2378813779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c04994230 0x562c0499ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:23.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.440+0000 7f27e9f9e640 1 -- 172.21.15.79:0/2378813779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c04993910 msgr2=0x562c04992e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:23.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.440+0000 7f27e9f9e640 1 --2- 172.21.15.79:0/2378813779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c04993910 0x562c04992e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:23.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.440+0000 7f27e9f9e640 1 -- 172.21.15.79:0/2378813779 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c049921c0 con 0x562c049a01c0 2024-08-20T01:38:23.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.440+0000 7f27e9f9e640 1 --2- 172.21.15.79:0/2378813779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c049a01c0 0x562c049b7e90 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f27dc010e70 tx=0x7f27dc003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b82d9c8e944ef6cd server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:23.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.441+0000 7f27ceffd640 1 -- 172.21.15.79:0/2378813779 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27dc024040 con 0x562c049a01c0 2024-08-20T01:38:23.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.441+0000 7f27ceffd640 1 -- 172.21.15.79:0/2378813779 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f27dc004dc0 con 0x562c049a01c0 2024-08-20T01:38:23.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.441+0000 7f27ceffd640 1 -- 172.21.15.79:0/2378813779 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27dc01e6e0 con 0x562c049a01c0 2024-08-20T01:38:23.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.441+0000 7f27eddfa740 1 -- 172.21.15.79:0/2378813779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c049a01c0 msgr2=0x562c049b7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:23.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.441+0000 7f27eddfa740 1 --2- 172.21.15.79:0/2378813779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c049a01c0 0x562c049b7e90 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f27dc010e70 tx=0x7f27dc003970 comp rx=0 tx=0).stop 2024-08-20T01:38:23.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.442+0000 7f27eddfa740 1 -- 172.21.15.79:0/2378813779 shutdown_connections 2024-08-20T01:38:23.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.442+0000 7f27eddfa740 1 --2- 172.21.15.79:0/2378813779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c049a01c0 0x562c049b7e90 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:23.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.442+0000 7f27eddfa740 1 --2- 172.21.15.79:0/2378813779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c04994230 0x562c0499ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:23.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.442+0000 7f27eddfa740 1 --2- 172.21.15.79:0/2378813779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c04993910 0x562c04992e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:23.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.442+0000 7f27eddfa740 1 -- 172.21.15.79:0/2378813779 >> 172.21.15.79:0/2378813779 conn(0x562c04991740 msgr2=0x562c0499e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:23.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.442+0000 7f27eddfa740 1 -- 172.21.15.79:0/2378813779 shutdown_connections 2024-08-20T01:38:23.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.442+0000 7f27eddfa740 1 -- 172.21.15.79:0/2378813779 wait complete. 2024-08-20T01:38:23.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.442+0000 7f27eddfa740 1 -- start start 2024-08-20T01:38:23.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.442+0000 7f27eddfa740 1 Processor -- start 2024-08-20T01:38:23.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.443+0000 7f27eddfa740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c04993910 0x562c049a5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:23.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.443+0000 7f27eddfa740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c04994230 0x562c049a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:23.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.443+0000 7f27eddfa740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c049a01c0 0x562c04a18e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:23.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.443+0000 7f27eddfa740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f27c800f8a0 con 0x562c04994230 2024-08-20T01:38:23.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.443+0000 7f27eddfa740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f27c800f1d0 con 0x562c04993910 2024-08-20T01:38:23.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.443+0000 7f27e8f9c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c04994230 0x562c049a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:23.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.443+0000 7f27eddfa740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f27c800c410 con 0x562c049a01c0 2024-08-20T01:38:23.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.443+0000 7f27e8f9c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c04994230 0x562c049a5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36656/0 (socket says 172.21.15.79:36656) 2024-08-20T01:38:23.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.443+0000 7f27e8f9c640 1 -- 172.21.15.79:0/3479270958 learned_addr learned my addr 172.21.15.79:0/3479270958 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:23.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.443+0000 7f27e979d640 1 --2- 172.21.15.79:0/3479270958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c04993910 0x562c049a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:23.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.443+0000 7f27eddfa740 10 client.0 _ll_register_callbacks cb 0x7f27d4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:23.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.443+0000 7f27e9f9e640 1 --2- 172.21.15.79:0/3479270958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c049a01c0 0x562c04a18e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:23.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.443+0000 7f27e8f9c640 1 -- 172.21.15.79:0/3479270958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c049a01c0 msgr2=0x562c04a18e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:23.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.443+0000 7f27e8f9c640 1 --2- 172.21.15.79:0/3479270958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c049a01c0 0x562c04a18e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:23.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.443+0000 7f27e8f9c640 1 -- 172.21.15.79:0/3479270958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c04993910 msgr2=0x562c049a5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:23.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.443+0000 7f27e8f9c640 1 --2- 172.21.15.79:0/3479270958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c04993910 0x562c049a5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:23.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.443+0000 7f27e8f9c640 1 -- 172.21.15.79:0/3479270958 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c04997e60 con 0x562c04994230 2024-08-20T01:38:23.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.443+0000 7f27e979d640 1 --2- 172.21.15.79:0/3479270958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c04993910 0x562c049a5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:23.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.444+0000 7f27e8f9c640 1 --2- 172.21.15.79:0/3479270958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c04994230 0x562c049a5cc0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f27d4009850 tx=0x7f27d4005960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9eea9ef5ff579a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:23.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.444+0000 7f27ccff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:38:23.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.444+0000 7f27ccff9640 1 -- 172.21.15.79:0/3479270958 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d4035040 con 0x562c04994230 2024-08-20T01:38:23.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.444+0000 7f27ccff9640 1 -- 172.21.15.79:0/3479270958 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f27d4045d10 con 0x562c04994230 2024-08-20T01:38:23.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.444+0000 7f27eddfa740 1 -- 172.21.15.79:0/3479270958 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27dc004dc0 con 0x562c04994230 2024-08-20T01:38:23.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.444+0000 7f27ccff9640 1 -- 172.21.15.79:0/3479270958 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f27d405f050 con 0x562c04994230 2024-08-20T01:38:23.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.444+0000 7f27eddfa740 10 client.15975 fetch_fsmap learned FSMap version 29 2024-08-20T01:38:23.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.444+0000 7f27eddfa740 1 -- 172.21.15.79:0/3479270958 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562c04a1a5e0 con 0x562c04994230 2024-08-20T01:38:23.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.444+0000 7f27ccff9640 1 -- 172.21.15.79:0/3479270958 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f27dc004dc0 con 0x562c04994230 2024-08-20T01:38:23.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.444+0000 7f27ccff9640 1 -- 172.21.15.79:0/3479270958 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f27d4043040 con 0x562c04994230 2024-08-20T01:38:23.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.445+0000 7f27eddfa740 10 client.15975 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:38:23.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.445+0000 7f27eddfa740 10 client.15975 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:38:23.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.445+0000 7f27eddfa740 20 client.15975 populate_metadata read hostname 'smithi079' 2024-08-20T01:38:23.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.445+0000 7f27eddfa740 1 --2- 172.21.15.79:0/3479270958 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x562c04a1ad90 0x562c04a1d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:23.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.445+0000 7f27eddfa740 4 client.15975 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:38:23.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.445+0000 7f27eddfa740 1 -- 172.21.15.79:0/3479270958 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562c0499e0b0 con 0x562c04a1ad90 2024-08-20T01:38:23.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.445+0000 7f27e979d640 1 --2- 172.21.15.79:0/3479270958 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x562c04a1ad90 0x562c04a1d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:23.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.445+0000 7f27ccff9640 10 client.15975 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:38:23.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.445+0000 7f27e979d640 1 --2- 172.21.15.79:0/3479270958 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x562c04a1ad90 0x562c04a1d1b0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9449e279ac420745 server_cookie=fbe5ac31d78530f9 in_seq=0 out_seq=0 2024-08-20T01:38:23.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.446+0000 7f27ccff9640 1 -- 172.21.15.79:0/3479270958 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562c0499e0b0 con 0x562c04a1ad90 2024-08-20T01:38:23.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.446+0000 7f27ccff9640 10 client.15975 handle_command_reply: tid=0 2024-08-20T01:38:23.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.446+0000 7f27eddfa740 1 client.15975 shutdown 2024-08-20T01:38:23.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.446+0000 7f27eddfa740 1 -- 172.21.15.79:0/3479270958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c04994230 msgr2=0x562c049a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:23.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.446+0000 7f27eddfa740 1 --2- 172.21.15.79:0/3479270958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c04994230 0x562c049a5cc0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f27d4009850 tx=0x7f27d4005960 comp rx=0 tx=0).stop 2024-08-20T01:38:23.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.446+0000 7f27eddfa740 1 -- 172.21.15.79:0/3479270958 shutdown_connections 2024-08-20T01:38:23.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.446+0000 7f27eddfa740 1 --2- 172.21.15.79:0/3479270958 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x562c04a1ad90 0x562c04a1d1b0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:23.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.446+0000 7f27eddfa740 1 --2- 172.21.15.79:0/3479270958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c049a01c0 0x562c04a18e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:23.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.446+0000 7f27ccff9640 0 client.15975 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:38:23.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.446+0000 7f27eddfa740 1 --2- 172.21.15.79:0/3479270958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c04994230 0x562c049a5cc0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:23.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.446+0000 7f27eddfa740 1 --2- 172.21.15.79:0/3479270958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c04993910 0x562c049a5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:23.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.446+0000 7f27eddfa740 1 -- 172.21.15.79:0/3479270958 >> 172.21.15.79:0/3479270958 conn(0x562c04991740 msgr2=0x562c049906f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:23.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.446+0000 7f27eddfa740 1 -- 172.21.15.79:0/3479270958 shutdown_connections 2024-08-20T01:38:23.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.446+0000 7f27eddfa740 1 -- 172.21.15.79:0/3479270958 wait complete. 2024-08-20T01:38:23.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.446+0000 7f27eddfa740 20 client.15975 trim_cache size 0 max 16384 2024-08-20T01:38:23.454 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:38:23.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.447+0000 7f27ea79f640 1 -- 172.21.15.79:0/1626139306 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f27d00b3c70 msgr2=0x7f27d00b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:23.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.447+0000 7f27ea79f640 1 --2- 172.21.15.79:0/1626139306 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f27d00b3c70 0x7f27d00b6130 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f27dc021000 tx=0x7f27dc01e000 comp rx=0 tx=0).stop 2024-08-20T01:38:23.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.447+0000 7f27ea79f640 1 -- 172.21.15.79:0/1626139306 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27e4103810 msgr2=0x7f27e41014c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:23.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.447+0000 7f27ea79f640 1 --2- 172.21.15.79:0/1626139306 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27e4103810 0x7f27e41014c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f27e000d950 tx=0x7f27e000de10 comp rx=0 tx=0).stop 2024-08-20T01:38:23.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.447+0000 7f27ea79f640 1 -- 172.21.15.79:0/1626139306 shutdown_connections 2024-08-20T01:38:23.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.447+0000 7f27ea79f640 1 --2- 172.21.15.79:0/1626139306 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f27d00b3c70 0x7f27d00b6130 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:23.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.447+0000 7f27ea79f640 1 --2- 172.21.15.79:0/1626139306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27e410cc70 0x7f27e4101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:23.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.447+0000 7f27ea79f640 1 --2- 172.21.15.79:0/1626139306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e4104130 0x7f27e4101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:23.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.447+0000 7f27ea79f640 1 --2- 172.21.15.79:0/1626139306 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27e4103810 0x7f27e41014c0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:23.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.447+0000 7f27ea79f640 1 -- 172.21.15.79:0/1626139306 >> 172.21.15.79:0/1626139306 conn(0x7f27e40fd2d0 msgr2=0x7f27e40fe070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:23.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.447+0000 7f27ea79f640 1 -- 172.21.15.79:0/1626139306 shutdown_connections 2024-08-20T01:38:23.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:23.447+0000 7f27ea79f640 1 -- 172.21.15.79:0/1626139306 wait complete. 2024-08-20T01:38:24.165 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-20T01:38:24.435 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:24 smithi079 ceph-mon[18656]: pgmap v379: 97 pgs: 97 active+clean; 414 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 28 MiB/s wr, 55 op/s 2024-08-20T01:38:24.443 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:38:24.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:24 smithi081 ceph-mon[22209]: pgmap v379: 97 pgs: 97 active+clean; 414 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 28 MiB/s wr, 55 op/s 2024-08-20T01:38:24.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:24 smithi175 ceph-mon[22392]: pgmap v379: 97 pgs: 97 active+clean; 414 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 28 MiB/s wr, 55 op/s 2024-08-20T01:38:24.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.981+0000 7f95b0bb2640 1 -- 172.21.15.79:0/2570864578 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95ac108e20 msgr2=0x7f95ac10f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:24.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.981+0000 7f95b0bb2640 1 --2- 172.21.15.79:0/2570864578 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95ac108e20 0x7f95ac10f620 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f95a4009ca0 tx=0x7f95a402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:38:24.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.981+0000 7f95b0bb2640 1 -- 172.21.15.79:0/2570864578 shutdown_connections 2024-08-20T01:38:24.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.981+0000 7f95b0bb2640 1 --2- 172.21.15.79:0/2570864578 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95ac108e20 0x7f95ac10f620 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:24.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.981+0000 7f95b0bb2640 1 --2- 172.21.15.79:0/2570864578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95ac1084a0 0x7f95ac1088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:24.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.981+0000 7f95b0bb2640 1 --2- 172.21.15.79:0/2570864578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95ac102a90 0x7f95ac102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:24.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.981+0000 7f95b0bb2640 1 -- 172.21.15.79:0/2570864578 >> 172.21.15.79:0/2570864578 conn(0x7f95ac0fe540 msgr2=0x7f95ac100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:24.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.981+0000 7f95b0bb2640 1 -- 172.21.15.79:0/2570864578 shutdown_connections 2024-08-20T01:38:24.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.981+0000 7f95b0bb2640 1 -- 172.21.15.79:0/2570864578 wait complete. 2024-08-20T01:38:24.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.982+0000 7f95b0bb2640 1 Processor -- start 2024-08-20T01:38:24.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.982+0000 7f95b0bb2640 1 -- start start 2024-08-20T01:38:24.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.982+0000 7f95b0bb2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95ac102a90 0x7f95ac0751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:24.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.982+0000 7f95b0bb2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95ac1084a0 0x7f95ac075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:24.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.982+0000 7f95b0bb2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95ac108e20 0x7f95ac075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:24.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.982+0000 7f95b0bb2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f95ac1129e0 con 0x7f95ac1084a0 2024-08-20T01:38:24.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.982+0000 7f95b0bb2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f95ac112860 con 0x7f95ac102a90 2024-08-20T01:38:24.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.982+0000 7f95b0bb2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f95ac112b60 con 0x7f95ac108e20 2024-08-20T01:38:24.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.982+0000 7f95a9d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95ac1084a0 0x7f95ac075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:24.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.982+0000 7f95a9d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95ac1084a0 0x7f95ac075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36684/0 (socket says 172.21.15.79:36684) 2024-08-20T01:38:24.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.982+0000 7f95a9d9b640 1 -- 172.21.15.79:0/956507047 learned_addr learned my addr 172.21.15.79:0/956507047 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:24.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.983+0000 7f95aad9d640 1 --2- 172.21.15.79:0/956507047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95ac108e20 0x7f95ac075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:24.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.983+0000 7f95aa59c640 1 --2- 172.21.15.79:0/956507047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95ac102a90 0x7f95ac0751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:24.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.983+0000 7f95a9d9b640 1 -- 172.21.15.79:0/956507047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95ac108e20 msgr2=0x7f95ac075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:24.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.983+0000 7f95a9d9b640 1 --2- 172.21.15.79:0/956507047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95ac108e20 0x7f95ac075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:24.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.983+0000 7f95a9d9b640 1 -- 172.21.15.79:0/956507047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95ac102a90 msgr2=0x7f95ac0751d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:24.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.983+0000 7f95a9d9b640 1 --2- 172.21.15.79:0/956507047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95ac102a90 0x7f95ac0751d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:24.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.983+0000 7f95a9d9b640 1 -- 172.21.15.79:0/956507047 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95ac1a72d0 con 0x7f95ac1084a0 2024-08-20T01:38:25.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.983+0000 7f95aad9d640 1 --2- 172.21.15.79:0/956507047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95ac108e20 0x7f95ac075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:38:25.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.983+0000 7f95a9d9b640 1 --2- 172.21.15.79:0/956507047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95ac1084a0 0x7f95ac075710 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f95a000b4a0 tx=0x7f95a000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:25.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.983+0000 7f959b7fe640 1 -- 172.21.15.79:0/956507047 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a0014070 con 0x7f95ac1084a0 2024-08-20T01:38:25.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.983+0000 7f959b7fe640 1 -- 172.21.15.79:0/956507047 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95a0010aa0 con 0x7f95ac1084a0 2024-08-20T01:38:25.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.983+0000 7f959b7fe640 1 -- 172.21.15.79:0/956507047 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a0017b70 con 0x7f95ac1084a0 2024-08-20T01:38:25.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.983+0000 7f95b0bb2640 1 -- 172.21.15.79:0/956507047 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95ac1a75c0 con 0x7f95ac1084a0 2024-08-20T01:38:25.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.983+0000 7f95b0bb2640 1 -- 172.21.15.79:0/956507047 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95ac1a7ab0 con 0x7f95ac1084a0 2024-08-20T01:38:25.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.986+0000 7f95b2fab740 1 Processor -- start 2024-08-20T01:38:25.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.987+0000 7f95b2fab740 1 -- start start 2024-08-20T01:38:25.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.987+0000 7f95b2fab740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e9e932730 0x564e9e932b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:25.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.987+0000 7f959b7fe640 1 -- 172.21.15.79:0/956507047 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f95a0017070 con 0x7f95ac1084a0 2024-08-20T01:38:25.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.987+0000 7f95b2fab740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e9e933050 0x564e9e93eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:25.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.987+0000 7f95b2fab740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e9e93efe0 0x564e9e9413d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:25.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.987+0000 7f95b2fab740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564e9e8a9930 con 0x564e9e932730 2024-08-20T01:38:25.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.987+0000 7f95b2fab740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564e9e898e30 con 0x564e9e933050 2024-08-20T01:38:25.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.987+0000 7f95b2fab740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564e9e89ce70 con 0x564e9e93efe0 2024-08-20T01:38:25.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.987+0000 7f95aad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e9e932730 0x564e9e932b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:25.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.987+0000 7f95aad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e9e932730 0x564e9e932b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36700/0 (socket says 172.21.15.79:36700) 2024-08-20T01:38:25.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.987+0000 7f95aad9d640 1 -- 172.21.15.79:0/87752665 learned_addr learned my addr 172.21.15.79:0/87752665 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:25.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.987+0000 7f95a9d9b640 1 --2- 172.21.15.79:0/87752665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e9e93efe0 0x564e9e9413d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:25.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.987+0000 7f95aa59c640 1 --2- 172.21.15.79:0/87752665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e9e933050 0x564e9e93eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:25.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.988+0000 7f95aad9d640 1 -- 172.21.15.79:0/87752665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e9e93efe0 msgr2=0x564e9e9413d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:25.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.988+0000 7f95aad9d640 1 --2- 172.21.15.79:0/87752665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e9e93efe0 0x564e9e9413d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:25.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.988+0000 7f95aad9d640 1 -- 172.21.15.79:0/87752665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e9e933050 msgr2=0x564e9e93eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:25.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.988+0000 7f95aad9d640 1 --2- 172.21.15.79:0/87752665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e9e933050 0x564e9e93eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:25.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.988+0000 7f95aad9d640 1 -- 172.21.15.79:0/87752665 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e9e5f8650 con 0x564e9e932730 2024-08-20T01:38:25.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.988+0000 7f95aa59c640 1 --2- 172.21.15.79:0/87752665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e9e933050 0x564e9e93eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:38:25.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.988+0000 7f95aad9d640 1 --2- 172.21.15.79:0/87752665 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e9e932730 0x564e9e932b10 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f95a4009a60 tx=0x7f95a4031610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de63000af1b2615 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:25.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.988+0000 7f9598ff9640 1 -- 172.21.15.79:0/87752665 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a4031b80 con 0x564e9e932730 2024-08-20T01:38:25.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.988+0000 7f9598ff9640 1 -- 172.21.15.79:0/87752665 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95a4040070 con 0x564e9e932730 2024-08-20T01:38:25.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.988+0000 7f9598ff9640 1 -- 172.21.15.79:0/87752665 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a40045a0 con 0x564e9e932730 2024-08-20T01:38:25.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.989+0000 7f959b7fe640 1 --2- 172.21.15.79:0/956507047 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f95940b3bd0 0x7f95940b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:25.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.989+0000 7f95aa59c640 1 --2- 172.21.15.79:0/956507047 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f95940b3bd0 0x7f95940b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:25.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.989+0000 7f959b7fe640 1 -- 172.21.15.79:0/956507047 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f95a00e2fb0 con 0x7f95ac1084a0 2024-08-20T01:38:25.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.989+0000 7f95b2fab740 1 -- 172.21.15.79:0/87752665 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e9e932730 msgr2=0x564e9e932b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:25.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.989+0000 7f95b2fab740 1 --2- 172.21.15.79:0/87752665 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e9e932730 0x564e9e932b10 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f95a4009a60 tx=0x7f95a4031610 comp rx=0 tx=0).stop 2024-08-20T01:38:25.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.989+0000 7f95aa59c640 1 --2- 172.21.15.79:0/956507047 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f95940b3bd0 0x7f95940b6090 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f959c0058c0 tx=0x7f959c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:25.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.989+0000 7f95b2fab740 1 -- 172.21.15.79:0/87752665 shutdown_connections 2024-08-20T01:38:25.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.989+0000 7f95b2fab740 1 --2- 172.21.15.79:0/87752665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e9e93efe0 0x564e9e9413d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:25.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.989+0000 7f95b2fab740 1 --2- 172.21.15.79:0/87752665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e9e933050 0x564e9e93eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:25.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.989+0000 7f95b2fab740 1 --2- 172.21.15.79:0/87752665 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e9e932730 0x564e9e932b10 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:25.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.989+0000 7f95b2fab740 1 -- 172.21.15.79:0/87752665 >> 172.21.15.79:0/87752665 conn(0x564e9e930560 msgr2=0x564e9e931700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:25.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.990+0000 7f95b2fab740 1 -- 172.21.15.79:0/87752665 shutdown_connections 2024-08-20T01:38:25.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.990+0000 7f95b2fab740 1 -- 172.21.15.79:0/87752665 wait complete. 2024-08-20T01:38:25.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.990+0000 7f95b2fab740 1 -- start start 2024-08-20T01:38:25.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.990+0000 7f95b2fab740 1 Processor -- start 2024-08-20T01:38:25.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.990+0000 7f95b2fab740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e9e932730 0x564e9e93c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:25.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.991+0000 7f95b2fab740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e9e933050 0x564e9e93c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:25.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.991+0000 7f95b2fab740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e9e93efe0 0x564e9e93cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:25.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.991+0000 7f95b2fab740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564e9e6fb700 con 0x564e9e933050 2024-08-20T01:38:25.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.991+0000 7f95b2fab740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564e9e81f810 con 0x564e9e932730 2024-08-20T01:38:25.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.991+0000 7f95b2fab740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564e9e941c30 con 0x564e9e93efe0 2024-08-20T01:38:25.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.991+0000 7f95b2fab740 10 client.0 _ll_register_callbacks cb 0x564e9e892700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:25.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.991+0000 7f95a9d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e9e933050 0x564e9e93c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:25.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.991+0000 7f95a9d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e9e933050 0x564e9e93c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36704/0 (socket says 172.21.15.79:36704) 2024-08-20T01:38:25.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.991+0000 7f95a9d9b640 1 -- 172.21.15.79:0/4198743909 learned_addr learned my addr 172.21.15.79:0/4198743909 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:25.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.991+0000 7f95aa59c640 1 --2- 172.21.15.79:0/4198743909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e9e932730 0x564e9e93c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:25.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.991+0000 7f95aad9d640 1 --2- 172.21.15.79:0/4198743909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e9e93efe0 0x564e9e93cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:25.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.991+0000 7f95a9d9b640 1 -- 172.21.15.79:0/4198743909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e9e93efe0 msgr2=0x564e9e93cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:25.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.991+0000 7f95a9d9b640 1 --2- 172.21.15.79:0/4198743909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e9e93efe0 0x564e9e93cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:25.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.991+0000 7f95a9d9b640 1 -- 172.21.15.79:0/4198743909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e9e932730 msgr2=0x564e9e93c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:25.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.991+0000 7f95a9d9b640 1 --2- 172.21.15.79:0/4198743909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e9e932730 0x564e9e93c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:25.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.991+0000 7f95a9d9b640 1 -- 172.21.15.79:0/4198743909 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e9e94b140 con 0x564e9e933050 2024-08-20T01:38:25.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.991+0000 7f95aa59c640 1 --2- 172.21.15.79:0/4198743909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e9e932730 0x564e9e93c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:38:25.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.991+0000 7f95a9d9b640 1 --2- 172.21.15.79:0/4198743909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e9e933050 0x564e9e93c5d0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f95a00a9cb0 tx=0x7f95a00a9e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e97dcd07de4c1df4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:25.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.991+0000 7f9591ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:38:25.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.991+0000 7f9591ffb640 1 -- 172.21.15.79:0/4198743909 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a001e030 con 0x564e9e933050 2024-08-20T01:38:25.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.991+0000 7f9591ffb640 1 -- 172.21.15.79:0/4198743909 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f95a0010c50 con 0x564e9e933050 2024-08-20T01:38:25.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.991+0000 7f95b2fab740 1 -- 172.21.15.79:0/4198743909 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564e9e848150 con 0x564e9e933050 2024-08-20T01:38:25.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.992+0000 7f9591ffb640 1 -- 172.21.15.79:0/4198743909 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f95a00a9ac0 con 0x564e9e933050 2024-08-20T01:38:25.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.992+0000 7f95b2fab740 10 client.15987 fetch_fsmap learned FSMap version 29 2024-08-20T01:38:25.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.992+0000 7f95b2fab740 1 -- 172.21.15.79:0/4198743909 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564e9e94dad0 con 0x564e9e933050 2024-08-20T01:38:25.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.992+0000 7f9591ffb640 1 -- 172.21.15.79:0/4198743909 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x564e9e848150 con 0x564e9e933050 2024-08-20T01:38:25.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.992+0000 7f9591ffb640 1 -- 172.21.15.79:0/4198743909 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f95a00a6240 con 0x564e9e933050 2024-08-20T01:38:25.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.992+0000 7f95b2fab740 10 client.15987 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:38:25.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.992+0000 7f95b2fab740 10 client.15987 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:38:25.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.992+0000 7f95b2fab740 20 client.15987 populate_metadata read hostname 'smithi079' 2024-08-20T01:38:25.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.992+0000 7f95b2fab740 1 --2- 172.21.15.79:0/4198743909 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x564e9e94ef90 0x564e9e951380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:25.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.992+0000 7f95b2fab740 4 client.15987 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:38:25.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.992+0000 7f95b2fab740 1 -- 172.21.15.79:0/4198743909 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e9e8ab880 con 0x564e9e94ef90 2024-08-20T01:38:25.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.993+0000 7f95aa59c640 1 --2- 172.21.15.79:0/4198743909 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x564e9e94ef90 0x564e9e951380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:25.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.993+0000 7f95aa59c640 1 --2- 172.21.15.79:0/4198743909 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x564e9e94ef90 0x564e9e951380 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ba81f21d6877e187 server_cookie=68890164d3528805 in_seq=0 out_seq=0 2024-08-20T01:38:25.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.993+0000 7f9591ffb640 10 client.15987 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:38:25.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.994+0000 7f9591ffb640 1 -- 172.21.15.79:0/4198743909 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564e9e8ab880 con 0x564e9e94ef90 2024-08-20T01:38:25.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.994+0000 7f9591ffb640 10 client.15987 handle_command_reply: tid=0 2024-08-20T01:38:25.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.994+0000 7f95b2fab740 1 client.15987 shutdown 2024-08-20T01:38:25.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.994+0000 7f95b2fab740 1 -- 172.21.15.79:0/4198743909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e9e933050 msgr2=0x564e9e93c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:25.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.994+0000 7f95b2fab740 1 --2- 172.21.15.79:0/4198743909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e9e933050 0x564e9e93c5d0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f95a00a9cb0 tx=0x7f95a00a9e40 comp rx=0 tx=0).stop 2024-08-20T01:38:25.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.994+0000 7f95b2fab740 1 -- 172.21.15.79:0/4198743909 shutdown_connections 2024-08-20T01:38:25.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.994+0000 7f95b2fab740 1 --2- 172.21.15.79:0/4198743909 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x564e9e94ef90 0x564e9e951380 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:25.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.994+0000 7f95b2fab740 1 --2- 172.21.15.79:0/4198743909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e9e93efe0 0x564e9e93cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:25.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.994+0000 7f95b2fab740 1 --2- 172.21.15.79:0/4198743909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e9e933050 0x564e9e93c5d0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:25.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.994+0000 7f95b2fab740 1 --2- 172.21.15.79:0/4198743909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e9e932730 0x564e9e93c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:25.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.994+0000 7f95b2fab740 1 -- 172.21.15.79:0/4198743909 >> 172.21.15.79:0/4198743909 conn(0x564e9e930560 msgr2=0x564e9e936100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:25.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.994+0000 7f9591ffb640 0 client.15987 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:38:25.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.994+0000 7f95b2fab740 1 -- 172.21.15.79:0/4198743909 shutdown_connections 2024-08-20T01:38:25.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.994+0000 7f95b2fab740 1 -- 172.21.15.79:0/4198743909 wait complete. 2024-08-20T01:38:25.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:24.995+0000 7f95b2fab740 20 client.15987 trim_cache size 0 max 16384 2024-08-20T01:38:25.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.013+0000 7f95b2fab740 1 Processor -- start 2024-08-20T01:38:25.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.013+0000 7f95b2fab740 1 -- start start 2024-08-20T01:38:25.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.013+0000 7f95b2fab740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e9e932730 0x564e9e9368f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:25.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.013+0000 7f95b2fab740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e9e933050 0x564e9e92f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:25.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.013+0000 7f95b2fab740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e9e93efe0 0x564e9e956be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:25.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.013+0000 7f95b2fab740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f95ac1b01c0 con 0x564e9e933050 2024-08-20T01:38:25.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.013+0000 7f95b2fab740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f95ac1b1d30 con 0x564e9e932730 2024-08-20T01:38:25.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.013+0000 7f95b2fab740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f95ac1b0890 con 0x564e9e93efe0 2024-08-20T01:38:25.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.013+0000 7f95a9d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e9e933050 0x564e9e92f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:25.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.013+0000 7f95a9d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e9e933050 0x564e9e92f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36720/0 (socket says 172.21.15.79:36720) 2024-08-20T01:38:25.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.013+0000 7f95a9d9b640 1 -- 172.21.15.79:0/1948975226 learned_addr learned my addr 172.21.15.79:0/1948975226 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:25.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.013+0000 7f95aad9d640 1 --2- 172.21.15.79:0/1948975226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e9e93efe0 0x564e9e956be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:25.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.013+0000 7f95aa59c640 1 --2- 172.21.15.79:0/1948975226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e9e932730 0x564e9e9368f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:25.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.014+0000 7f95a9d9b640 1 -- 172.21.15.79:0/1948975226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e9e93efe0 msgr2=0x564e9e956be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:25.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.014+0000 7f95a9d9b640 1 --2- 172.21.15.79:0/1948975226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e9e93efe0 0x564e9e956be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:25.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.014+0000 7f95a9d9b640 1 -- 172.21.15.79:0/1948975226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e9e932730 msgr2=0x564e9e9368f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:25.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.014+0000 7f95a9d9b640 1 --2- 172.21.15.79:0/1948975226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e9e932730 0x564e9e9368f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:25.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.014+0000 7f95a9d9b640 1 -- 172.21.15.79:0/1948975226 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e9e930fe0 con 0x564e9e933050 2024-08-20T01:38:25.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.014+0000 7f95a9d9b640 1 --2- 172.21.15.79:0/1948975226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e9e933050 0x564e9e92f3e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f95a000b470 tx=0x7f95a00047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4656b761b4e9356e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:25.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.014+0000 7f9593fff640 1 -- 172.21.15.79:0/1948975226 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a001e070 con 0x564e9e933050 2024-08-20T01:38:25.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.014+0000 7f9593fff640 1 -- 172.21.15.79:0/1948975226 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95a00e6e50 con 0x564e9e933050 2024-08-20T01:38:25.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.014+0000 7f9593fff640 1 -- 172.21.15.79:0/1948975226 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a00a6240 con 0x564e9e933050 2024-08-20T01:38:25.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.015+0000 7f95b2fab740 1 -- 172.21.15.79:0/1948975226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e9e933050 msgr2=0x564e9e92f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:25.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.015+0000 7f95b2fab740 1 --2- 172.21.15.79:0/1948975226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e9e933050 0x564e9e92f3e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f95a000b470 tx=0x7f95a00047d0 comp rx=0 tx=0).stop 2024-08-20T01:38:25.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.015+0000 7f95b2fab740 1 -- 172.21.15.79:0/1948975226 shutdown_connections 2024-08-20T01:38:25.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.015+0000 7f95b2fab740 1 --2- 172.21.15.79:0/1948975226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e9e93efe0 0x564e9e956be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:25.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.015+0000 7f95b2fab740 1 --2- 172.21.15.79:0/1948975226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e9e933050 0x564e9e92f3e0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:25.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.015+0000 7f95b2fab740 1 --2- 172.21.15.79:0/1948975226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e9e932730 0x564e9e9368f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:25.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.015+0000 7f95b2fab740 1 -- 172.21.15.79:0/1948975226 >> 172.21.15.79:0/1948975226 conn(0x564e9e930560 msgr2=0x564e9e92ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:25.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.015+0000 7f95b2fab740 1 -- 172.21.15.79:0/1948975226 shutdown_connections 2024-08-20T01:38:25.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.015+0000 7f95b2fab740 1 -- 172.21.15.79:0/1948975226 wait complete. 2024-08-20T01:38:25.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.015+0000 7f95b2fab740 1 -- start start 2024-08-20T01:38:25.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.016+0000 7f95b2fab740 1 Processor -- start 2024-08-20T01:38:25.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.016+0000 7f95b2fab740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e9e932730 0x564e9e946ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:25.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.016+0000 7f95b2fab740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e9e933050 0x564e9e947430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:25.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.016+0000 7f95b2fab740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e9e93efe0 0x564e9e938700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:25.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.016+0000 7f95b2fab740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f95ac1b1630 con 0x564e9e932730 2024-08-20T01:38:25.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.016+0000 7f95b2fab740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f95ac1b0f60 con 0x564e9e933050 2024-08-20T01:38:25.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.016+0000 7f95b2fab740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f95ac1ae1a0 con 0x564e9e93efe0 2024-08-20T01:38:25.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.016+0000 7f95b2fab740 10 client.0 _ll_register_callbacks cb 0x7f95a00e6810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:25.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.016+0000 7f95a9d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e9e933050 0x564e9e947430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:25.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.016+0000 7f95aad9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e9e93efe0 0x564e9e938700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:25.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.016+0000 7f95aad9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e9e93efe0 0x564e9e938700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:36192/0 (socket says 172.21.15.79:36192) 2024-08-20T01:38:25.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.016+0000 7f95aa59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e9e932730 0x564e9e946ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:25.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.016+0000 7f95aad9d640 1 -- 172.21.15.79:0/2038540947 learned_addr learned my addr 172.21.15.79:0/2038540947 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:25.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.016+0000 7f95a9d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e9e933050 0x564e9e947430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:51814/0 (socket says 172.21.15.79:51814) 2024-08-20T01:38:25.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.016+0000 7f95aad9d640 1 -- 172.21.15.79:0/2038540947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e9e933050 msgr2=0x564e9e947430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:25.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.016+0000 7f95aad9d640 1 --2- 172.21.15.79:0/2038540947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e9e933050 0x564e9e947430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:25.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.016+0000 7f95aad9d640 1 -- 172.21.15.79:0/2038540947 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e9e932730 msgr2=0x564e9e946ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:25.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.016+0000 7f95aad9d640 1 --2- 172.21.15.79:0/2038540947 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e9e932730 0x564e9e946ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:25.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.016+0000 7f95aad9d640 1 -- 172.21.15.79:0/2038540947 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e9e938c70 con 0x564e9e93efe0 2024-08-20T01:38:25.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.016+0000 7f95aa59c640 1 --2- 172.21.15.79:0/2038540947 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e9e932730 0x564e9e946ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:25.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.017+0000 7f95aad9d640 1 --2- 172.21.15.79:0/2038540947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e9e93efe0 0x564e9e938700 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f95a4009a60 tx=0x7f95a4003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=816c070cb0d7bf69 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:25.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.017+0000 7f9591ffb640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:38:25.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.017+0000 7f9591ffb640 1 -- 172.21.15.79:0/2038540947 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a4053060 con 0x564e9e93efe0 2024-08-20T01:38:25.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.017+0000 7f9591ffb640 1 -- 172.21.15.79:0/2038540947 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f95a40305c0 con 0x564e9e93efe0 2024-08-20T01:38:25.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.017+0000 7f95b2fab740 1 -- 172.21.15.79:0/2038540947 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95a00e6e50 con 0x564e9e93efe0 2024-08-20T01:38:25.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.017+0000 7f9591ffb640 1 -- 172.21.15.79:0/2038540947 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f95a4009b20 con 0x564e9e93efe0 2024-08-20T01:38:25.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.017+0000 7f95b2fab740 10 client.25333 fetch_fsmap learned FSMap version 29 2024-08-20T01:38:25.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.017+0000 7f95b2fab740 1 -- 172.21.15.79:0/2038540947 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564e9e9b9410 con 0x564e9e93efe0 2024-08-20T01:38:25.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.017+0000 7f9591ffb640 1 -- 172.21.15.79:0/2038540947 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95a00e6e50 con 0x564e9e93efe0 2024-08-20T01:38:25.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.018+0000 7f9591ffb640 1 -- 172.21.15.79:0/2038540947 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f95a4003f30 con 0x564e9e93efe0 2024-08-20T01:38:25.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.018+0000 7f95b2fab740 10 client.25333 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T01:38:25.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.018+0000 7f95b2fab740 10 client.25333 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:38:25.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.018+0000 7f95b2fab740 20 client.25333 populate_metadata read hostname 'smithi079' 2024-08-20T01:38:25.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.018+0000 7f95b2fab740 1 --2- 172.21.15.79:0/2038540947 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x564e9e9b9690 0x564e9e9bba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:25.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.018+0000 7f95b2fab740 4 client.25333 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:38:25.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.018+0000 7f95b2fab740 1 -- 172.21.15.79:0/2038540947 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564e9e8a7320 con 0x564e9e9b9690 2024-08-20T01:38:25.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.018+0000 7f95aa59c640 1 --2- 172.21.15.79:0/2038540947 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x564e9e9b9690 0x564e9e9bba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:25.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.018+0000 7f95aa59c640 1 --2- 172.21.15.79:0/2038540947 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x564e9e9b9690 0x564e9e9bba80 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d23d7f403de8324a server_cookie=98b1266149db64da in_seq=0 out_seq=0 2024-08-20T01:38:25.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.018+0000 7f9591ffb640 10 client.25333 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:38:25.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.019+0000 7f9591ffb640 1 -- 172.21.15.79:0/2038540947 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564e9e8a7320 con 0x564e9e9b9690 2024-08-20T01:38:25.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.019+0000 7f9591ffb640 10 client.25333 handle_command_reply: tid=0 2024-08-20T01:38:25.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.019+0000 7f95b2fab740 1 client.25333 shutdown 2024-08-20T01:38:25.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.019+0000 7f95b2fab740 1 -- 172.21.15.79:0/2038540947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e9e93efe0 msgr2=0x564e9e938700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:25.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.019+0000 7f95b2fab740 1 --2- 172.21.15.79:0/2038540947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e9e93efe0 0x564e9e938700 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f95a4009a60 tx=0x7f95a4003ba0 comp rx=0 tx=0).stop 2024-08-20T01:38:25.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.019+0000 7f95b2fab740 1 -- 172.21.15.79:0/2038540947 shutdown_connections 2024-08-20T01:38:25.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.019+0000 7f95b2fab740 1 --2- 172.21.15.79:0/2038540947 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x564e9e9b9690 0x564e9e9bba80 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:25.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.019+0000 7f95b2fab740 1 --2- 172.21.15.79:0/2038540947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e9e93efe0 0x564e9e938700 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:25.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.019+0000 7f95b2fab740 1 --2- 172.21.15.79:0/2038540947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e9e933050 0x564e9e947430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:25.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.019+0000 7f95b2fab740 1 --2- 172.21.15.79:0/2038540947 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e9e932730 0x564e9e946ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:25.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.019+0000 7f95b2fab740 1 -- 172.21.15.79:0/2038540947 >> 172.21.15.79:0/2038540947 conn(0x564e9e930560 msgr2=0x564e9e93dee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:25.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.019+0000 7f9591ffb640 0 client.25333 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:38:25.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.019+0000 7f95b2fab740 1 -- 172.21.15.79:0/2038540947 shutdown_connections 2024-08-20T01:38:25.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.019+0000 7f95b2fab740 1 -- 172.21.15.79:0/2038540947 wait complete. 2024-08-20T01:38:25.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.019+0000 7f95b2fab740 20 client.25333 trim_cache size 0 max 16384 2024-08-20T01:38:25.027 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:38:25.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.020+0000 7f95b0bb2640 1 -- 172.21.15.79:0/956507047 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f95940b3bd0 msgr2=0x7f95940b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:25.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.020+0000 7f95b0bb2640 1 --2- 172.21.15.79:0/956507047 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f95940b3bd0 0x7f95940b6090 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f959c0058c0 tx=0x7f959c005850 comp rx=0 tx=0).stop 2024-08-20T01:38:25.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.020+0000 7f95b0bb2640 1 -- 172.21.15.79:0/956507047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95ac1084a0 msgr2=0x7f95ac075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:25.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.020+0000 7f95b0bb2640 1 --2- 172.21.15.79:0/956507047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95ac1084a0 0x7f95ac075710 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f95a000b4a0 tx=0x7f95a000b960 comp rx=0 tx=0).stop 2024-08-20T01:38:25.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.020+0000 7f95b0bb2640 1 -- 172.21.15.79:0/956507047 shutdown_connections 2024-08-20T01:38:25.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.020+0000 7f95b0bb2640 1 --2- 172.21.15.79:0/956507047 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f95940b3bd0 0x7f95940b6090 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:25.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.020+0000 7f95b0bb2640 1 --2- 172.21.15.79:0/956507047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95ac108e20 0x7f95ac075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:25.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.020+0000 7f95b0bb2640 1 --2- 172.21.15.79:0/956507047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95ac1084a0 0x7f95ac075710 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:25.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.020+0000 7f95b0bb2640 1 --2- 172.21.15.79:0/956507047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95ac102a90 0x7f95ac0751d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:25.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.020+0000 7f95b0bb2640 1 -- 172.21.15.79:0/956507047 >> 172.21.15.79:0/956507047 conn(0x7f95ac0fe540 msgr2=0x7f95ac100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:25.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.020+0000 7f95b0bb2640 1 -- 172.21.15.79:0/956507047 shutdown_connections 2024-08-20T01:38:25.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:25.020+0000 7f95b0bb2640 1 -- 172.21.15.79:0/956507047 wait complete. 2024-08-20T01:38:25.781 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T01:38:26.056 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:38:26.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.579+0000 7fe8f047a640 1 -- 172.21.15.79:0/3472738172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8e8102af0 msgr2=0x7fe8e8102ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:26.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.579+0000 7fe8f047a640 1 --2- 172.21.15.79:0/3472738172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8e8102af0 0x7fe8e8102ed0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4009900 tx=0x7fe8e402a410 comp rx=0 tx=0).stop 2024-08-20T01:38:26.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.579+0000 7fe8f047a640 1 -- 172.21.15.79:0/3472738172 shutdown_connections 2024-08-20T01:38:26.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.579+0000 7fe8f047a640 1 --2- 172.21.15.79:0/3472738172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe8e8108e80 0x7fe8e810f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.579+0000 7fe8f047a640 1 --2- 172.21.15.79:0/3472738172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8e8108500 0x7fe8e8108940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.579+0000 7fe8f047a640 1 --2- 172.21.15.79:0/3472738172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8e8102af0 0x7fe8e8102ed0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.579+0000 7fe8f047a640 1 -- 172.21.15.79:0/3472738172 >> 172.21.15.79:0/3472738172 conn(0x7fe8e80fe540 msgr2=0x7fe8e8100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:26.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.579+0000 7fe8f047a640 1 -- 172.21.15.79:0/3472738172 shutdown_connections 2024-08-20T01:38:26.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.579+0000 7fe8f047a640 1 -- 172.21.15.79:0/3472738172 wait complete. 2024-08-20T01:38:26.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.580+0000 7fe8f047a640 1 Processor -- start 2024-08-20T01:38:26.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.580+0000 7fe8f047a640 1 -- start start 2024-08-20T01:38:26.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.580+0000 7fe8f047a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8e8102af0 0x7fe8e8198f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:26.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.580+0000 7fe8f047a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8e8108500 0x7fe8e8199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:26.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.580+0000 7fe8f047a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe8e8108e80 0x7fe8e819e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:26.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.580+0000 7fe8f047a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e81129b0 con 0x7fe8e8102af0 2024-08-20T01:38:26.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.580+0000 7fe8f047a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e8112830 con 0x7fe8e8108500 2024-08-20T01:38:26.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.580+0000 7fe8f047a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e8112b30 con 0x7fe8e8108e80 2024-08-20T01:38:26.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.580+0000 7fe8ee216640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8e8102af0 0x7fe8e8198f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:26.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.580+0000 7fe8ee216640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8e8102af0 0x7fe8e8198f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36746/0 (socket says 172.21.15.79:36746) 2024-08-20T01:38:26.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.580+0000 7fe8ee216640 1 -- 172.21.15.79:0/88889028 learned_addr learned my addr 172.21.15.79:0/88889028 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:26.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.580+0000 7fe8eda15640 1 --2- 172.21.15.79:0/88889028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8e8108500 0x7fe8e8199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:26.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.580+0000 7fe8eea17640 1 --2- 172.21.15.79:0/88889028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe8e8108e80 0x7fe8e819e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:26.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.580+0000 7fe8ee216640 1 -- 172.21.15.79:0/88889028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe8e8108e80 msgr2=0x7fe8e819e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:26.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.580+0000 7fe8ee216640 1 --2- 172.21.15.79:0/88889028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe8e8108e80 0x7fe8e819e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.580+0000 7fe8ee216640 1 -- 172.21.15.79:0/88889028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8e8108500 msgr2=0x7fe8e8199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:26.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.580+0000 7fe8ee216640 1 --2- 172.21.15.79:0/88889028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8e8108500 0x7fe8e8199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.580+0000 7fe8ee216640 1 -- 172.21.15.79:0/88889028 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e819efb0 con 0x7fe8e8102af0 2024-08-20T01:38:26.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.580+0000 7fe8eea17640 1 --2- 172.21.15.79:0/88889028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe8e8108e80 0x7fe8e819e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:38:26.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.580+0000 7fe8eda15640 1 --2- 172.21.15.79:0/88889028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8e8108500 0x7fe8e8199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:38:26.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.581+0000 7fe8ee216640 1 --2- 172.21.15.79:0/88889028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8e8102af0 0x7fe8e8198f00 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4009230 tx=0x7fe8e4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:26.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.581+0000 7fe8df7fe640 1 -- 172.21.15.79:0/88889028 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e403f030 con 0x7fe8e8102af0 2024-08-20T01:38:26.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.581+0000 7fe8df7fe640 1 -- 172.21.15.79:0/88889028 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe8e4003a80 con 0x7fe8e8102af0 2024-08-20T01:38:26.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.581+0000 7fe8f047a640 1 -- 172.21.15.79:0/88889028 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8e819f240 con 0x7fe8e8102af0 2024-08-20T01:38:26.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.581+0000 7fe8df7fe640 1 -- 172.21.15.79:0/88889028 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4035070 con 0x7fe8e8102af0 2024-08-20T01:38:26.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.581+0000 7fe8f047a640 1 -- 172.21.15.79:0/88889028 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8e80750b0 con 0x7fe8e8102af0 2024-08-20T01:38:26.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.583+0000 7fe8df7fe640 1 -- 172.21.15.79:0/88889028 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fe8e4042030 con 0x7fe8e8102af0 2024-08-20T01:38:26.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.584+0000 7fe8f2873740 1 Processor -- start 2024-08-20T01:38:26.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.584+0000 7fe8f2873740 1 -- start start 2024-08-20T01:38:26.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.584+0000 7fe8f2873740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e259a3880 0x564e259a3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:26.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.584+0000 7fe8f2873740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e259a41a0 0x564e259afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:26.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.584+0000 7fe8f2873740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e259b0130 0x564e259b2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:26.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.584+0000 7fe8f2873740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564e2591a930 con 0x564e259a41a0 2024-08-20T01:38:26.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.584+0000 7fe8f2873740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564e25909e30 con 0x564e259b0130 2024-08-20T01:38:26.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.584+0000 7fe8f2873740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564e2590de70 con 0x564e259a3880 2024-08-20T01:38:26.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.584+0000 7fe8df7fe640 1 --2- 172.21.15.79:0/88889028 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe8d40b8060 0x7fe8d40ba520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:26.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.585+0000 7fe8eea17640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e259a3880 0x564e259a3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:26.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.585+0000 7fe8eea17640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e259a3880 0x564e259a3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:36206/0 (socket says 172.21.15.79:36206) 2024-08-20T01:38:26.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.585+0000 7fe8eea17640 1 -- 172.21.15.79:0/2725306510 learned_addr learned my addr 172.21.15.79:0/2725306510 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:26.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.585+0000 7fe8ee216640 1 --2- 172.21.15.79:0/2725306510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e259a41a0 0x564e259afbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:26.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.585+0000 7fe8eea17640 1 --2- 172.21.15.79:0/88889028 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe8d40b8060 0x7fe8d40ba520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:26.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.585+0000 7fe8df7fe640 1 -- 172.21.15.79:0/88889028 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fe8e4104660 con 0x7fe8e8102af0 2024-08-20T01:38:26.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.585+0000 7fe8eea17640 1 -- 172.21.15.79:0/2725306510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e259b0130 msgr2=0x564e259b2520 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:38:26.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.585+0000 7fe8eea17640 1 --2- 172.21.15.79:0/2725306510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e259b0130 0x564e259b2520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.585+0000 7fe8eea17640 1 -- 172.21.15.79:0/2725306510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e259a41a0 msgr2=0x564e259afbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:26.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.585+0000 7fe8eea17640 1 --2- 172.21.15.79:0/2725306510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e259a41a0 0x564e259afbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.585+0000 7fe8eea17640 1 -- 172.21.15.79:0/2725306510 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e25669650 con 0x564e259a3880 2024-08-20T01:38:26.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.585+0000 7fe8eea17640 1 --2- 172.21.15.79:0/2725306510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e259a3880 0x564e259a3c60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0014e70 tx=0x7fe8e0011750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d45ad687de2f629 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:26.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.585+0000 7fe8eea17640 1 --2- 172.21.15.79:0/88889028 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe8d40b8060 0x7fe8d40ba520 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0009fd0 tx=0x7fe8e0016000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:26.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.586+0000 7fe8dcff9640 1 -- 172.21.15.79:0/2725306510 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0022070 con 0x564e259a3880 2024-08-20T01:38:26.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.586+0000 7fe8dcff9640 1 -- 172.21.15.79:0/2725306510 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe8e000cc00 con 0x564e259a3880 2024-08-20T01:38:26.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.586+0000 7fe8dcff9640 1 -- 172.21.15.79:0/2725306510 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0005280 con 0x564e259a3880 2024-08-20T01:38:26.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.586+0000 7fe8f2873740 1 -- 172.21.15.79:0/2725306510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e259a3880 msgr2=0x564e259a3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:26.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.586+0000 7fe8f2873740 1 --2- 172.21.15.79:0/2725306510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e259a3880 0x564e259a3c60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0014e70 tx=0x7fe8e0011750 comp rx=0 tx=0).stop 2024-08-20T01:38:26.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.586+0000 7fe8f2873740 1 -- 172.21.15.79:0/2725306510 shutdown_connections 2024-08-20T01:38:26.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.586+0000 7fe8f2873740 1 --2- 172.21.15.79:0/2725306510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e259b0130 0x564e259b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.586+0000 7fe8f2873740 1 --2- 172.21.15.79:0/2725306510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e259a41a0 0x564e259afbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.586+0000 7fe8f2873740 1 --2- 172.21.15.79:0/2725306510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e259a3880 0x564e259a3c60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.586+0000 7fe8f2873740 1 -- 172.21.15.79:0/2725306510 >> 172.21.15.79:0/2725306510 conn(0x564e259a16b0 msgr2=0x564e259a2850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:26.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.586+0000 7fe8f2873740 1 -- 172.21.15.79:0/2725306510 shutdown_connections 2024-08-20T01:38:26.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.587+0000 7fe8f2873740 1 -- 172.21.15.79:0/2725306510 wait complete. 2024-08-20T01:38:26.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.587+0000 7fe8f2873740 1 -- start start 2024-08-20T01:38:26.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.587+0000 7fe8f2873740 1 Processor -- start 2024-08-20T01:38:26.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.587+0000 7fe8f2873740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e259a3880 0x564e259ad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:26.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.587+0000 7fe8f2873740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e259a41a0 0x564e259ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:26.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.587+0000 7fe8f2873740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e259b0130 0x564e259adb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:26.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.587+0000 7fe8f2873740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564e2576c700 con 0x564e259a41a0 2024-08-20T01:38:26.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.587+0000 7fe8f2873740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564e25890810 con 0x564e259a3880 2024-08-20T01:38:26.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.587+0000 7fe8f2873740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564e259b2d80 con 0x564e259b0130 2024-08-20T01:38:26.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.587+0000 7fe8f2873740 10 client.0 _ll_register_callbacks cb 0x564e25903700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:26.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.587+0000 7fe8eda15640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e259a41a0 0x564e259ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:26.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.587+0000 7fe8eda15640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e259a41a0 0x564e259ad5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36760/0 (socket says 172.21.15.79:36760) 2024-08-20T01:38:26.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.587+0000 7fe8eda15640 1 -- 172.21.15.79:0/552145972 learned_addr learned my addr 172.21.15.79:0/552145972 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:26.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.587+0000 7fe8ee216640 1 --2- 172.21.15.79:0/552145972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e259a3880 0x564e259ad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:26.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.587+0000 7fe8eea17640 1 --2- 172.21.15.79:0/552145972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e259b0130 0x564e259adb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:26.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.588+0000 7fe8eda15640 1 -- 172.21.15.79:0/552145972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e259b0130 msgr2=0x564e259adb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:26.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.588+0000 7fe8eda15640 1 --2- 172.21.15.79:0/552145972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e259b0130 0x564e259adb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.588+0000 7fe8eda15640 1 -- 172.21.15.79:0/552145972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e259a3880 msgr2=0x564e259ad0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:26.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.588+0000 7fe8eda15640 1 --2- 172.21.15.79:0/552145972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e259a3880 0x564e259ad0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.588+0000 7fe8eda15640 1 -- 172.21.15.79:0/552145972 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e259bc130 con 0x564e259a41a0 2024-08-20T01:38:26.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.588+0000 7fe8eda15640 1 --2- 172.21.15.79:0/552145972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e259a41a0 0x564e259ad5f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8010620 tx=0x7fe8d8010ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed2b0b9a1564eded server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:26.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.588+0000 7fe8d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:38:26.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.588+0000 7fe8d1ffb640 1 -- 172.21.15.79:0/552145972 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8004230 con 0x564e259a41a0 2024-08-20T01:38:26.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.588+0000 7fe8d1ffb640 1 -- 172.21.15.79:0/552145972 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fe8d80043d0 con 0x564e259a41a0 2024-08-20T01:38:26.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.588+0000 7fe8f2873740 1 -- 172.21.15.79:0/552145972 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564e258b9150 con 0x564e259a41a0 2024-08-20T01:38:26.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.588+0000 7fe8d1ffb640 1 -- 172.21.15.79:0/552145972 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe8d8012720 con 0x564e259a41a0 2024-08-20T01:38:26.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.588+0000 7fe8f2873740 10 client.16005 fetch_fsmap learned FSMap version 30 2024-08-20T01:38:26.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.588+0000 7fe8f2873740 1 -- 172.21.15.79:0/552145972 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564e259beb20 con 0x564e259a41a0 2024-08-20T01:38:26.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.589+0000 7fe8d1ffb640 1 -- 172.21.15.79:0/552145972 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x564e258b9150 con 0x564e259a41a0 2024-08-20T01:38:26.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.589+0000 7fe8d1ffb640 1 -- 172.21.15.79:0/552145972 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fe8d800f040 con 0x564e259a41a0 2024-08-20T01:38:26.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.589+0000 7fe8f2873740 10 client.16005 fetch_fsmap finished waiting for FSMap version 30 2024-08-20T01:38:26.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.589+0000 7fe8f2873740 10 client.16005 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:38:26.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.589+0000 7fe8f2873740 20 client.16005 populate_metadata read hostname 'smithi079' 2024-08-20T01:38:26.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.589+0000 7fe8f2873740 1 --2- 172.21.15.79:0/552145972 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x564e259bff30 0x564e259c23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:26.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.589+0000 7fe8f2873740 4 client.16005 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:38:26.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.589+0000 7fe8f2873740 1 -- 172.21.15.79:0/552145972 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e2591c880 con 0x564e259bff30 2024-08-20T01:38:26.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.589+0000 7fe8ee216640 1 --2- 172.21.15.79:0/552145972 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x564e259bff30 0x564e259c23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:26.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.590+0000 7fe8d1ffb640 10 client.16005 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:38:26.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.590+0000 7fe8ee216640 1 --2- 172.21.15.79:0/552145972 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x564e259bff30 0x564e259c23b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c92c46ab4ef94d45 server_cookie=319ecc881a916d82 in_seq=0 out_seq=0 2024-08-20T01:38:26.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.590+0000 7fe8d1ffb640 1 -- 172.21.15.79:0/552145972 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564e2591c880 con 0x564e259bff30 2024-08-20T01:38:26.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.590+0000 7fe8d1ffb640 10 client.16005 handle_command_reply: tid=0 2024-08-20T01:38:26.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.590+0000 7fe8f2873740 1 client.16005 shutdown 2024-08-20T01:38:26.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.591+0000 7fe8f2873740 1 -- 172.21.15.79:0/552145972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e259a41a0 msgr2=0x564e259ad5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:26.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.591+0000 7fe8f2873740 1 --2- 172.21.15.79:0/552145972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e259a41a0 0x564e259ad5f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8010620 tx=0x7fe8d8010ae0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.591+0000 7fe8f2873740 1 -- 172.21.15.79:0/552145972 shutdown_connections 2024-08-20T01:38:26.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.591+0000 7fe8f2873740 1 --2- 172.21.15.79:0/552145972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e259b0130 0x564e259adb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.591+0000 7fe8f2873740 1 --2- 172.21.15.79:0/552145972 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x564e259bff30 0x564e259c23b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.591+0000 7fe8f2873740 1 --2- 172.21.15.79:0/552145972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e259a41a0 0x564e259ad5f0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.591+0000 7fe8f2873740 1 --2- 172.21.15.79:0/552145972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e259a3880 0x564e259ad0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.591+0000 7fe8f2873740 1 -- 172.21.15.79:0/552145972 >> 172.21.15.79:0/552145972 conn(0x564e259a16b0 msgr2=0x564e259a7250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:26.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.591+0000 7fe8d1ffb640 0 client.16005 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:38:26.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.591+0000 7fe8f2873740 1 -- 172.21.15.79:0/552145972 shutdown_connections 2024-08-20T01:38:26.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.591+0000 7fe8f2873740 1 -- 172.21.15.79:0/552145972 wait complete. 2024-08-20T01:38:26.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.591+0000 7fe8f2873740 20 client.16005 trim_cache size 0 max 16384 2024-08-20T01:38:26.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.607+0000 7fe8f2873740 1 Processor -- start 2024-08-20T01:38:26.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.607+0000 7fe8f2873740 1 -- start start 2024-08-20T01:38:26.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.608+0000 7fe8f2873740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e259a3880 0x564e259aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:26.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.608+0000 7fe8f2873740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e259a41a0 0x564e259c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:26.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.608+0000 7fe8f2873740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e259b0130 0x564e259c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:26.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.608+0000 7fe8f2873740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e81abdf0 con 0x564e259a3880 2024-08-20T01:38:26.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.608+0000 7fe8f2873740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e81ad9f0 con 0x564e259a41a0 2024-08-20T01:38:26.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.608+0000 7fe8f2873740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e81ac4c0 con 0x564e259b0130 2024-08-20T01:38:26.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.608+0000 7fe8ee216640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e259a3880 0x564e259aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:26.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.608+0000 7fe8ee216640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e259a3880 0x564e259aedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36768/0 (socket says 172.21.15.79:36768) 2024-08-20T01:38:26.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.608+0000 7fe8ee216640 1 -- 172.21.15.79:0/3914915449 learned_addr learned my addr 172.21.15.79:0/3914915449 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:26.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.608+0000 7fe8eea17640 1 --2- 172.21.15.79:0/3914915449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e259b0130 0x564e259c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:26.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.608+0000 7fe8eda15640 1 --2- 172.21.15.79:0/3914915449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e259a41a0 0x564e259c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:26.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.608+0000 7fe8ee216640 1 -- 172.21.15.79:0/3914915449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e259b0130 msgr2=0x564e259c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:26.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.608+0000 7fe8ee216640 1 --2- 172.21.15.79:0/3914915449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e259b0130 0x564e259c81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.608+0000 7fe8ee216640 1 -- 172.21.15.79:0/3914915449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e259a41a0 msgr2=0x564e259c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:26.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.608+0000 7fe8ee216640 1 --2- 172.21.15.79:0/3914915449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e259a41a0 0x564e259c7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.608+0000 7fe8ee216640 1 -- 172.21.15.79:0/3914915449 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e259a3fd0 con 0x564e259a3880 2024-08-20T01:38:26.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.608+0000 7fe8eea17640 1 --2- 172.21.15.79:0/3914915449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e259b0130 0x564e259c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:38:26.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.608+0000 7fe8eda15640 1 --2- 172.21.15.79:0/3914915449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e259a41a0 0x564e259c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:38:26.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.608+0000 7fe8ee216640 1 --2- 172.21.15.79:0/3914915449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e259a3880 0x564e259aedf0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fe8e403b4a0 tx=0x7fe8e40d4040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32f58ee26319ec8b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:26.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.608+0000 7fe8d3fff640 1 -- 172.21.15.79:0/3914915449 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4049040 con 0x564e259a3880 2024-08-20T01:38:26.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.609+0000 7fe8d3fff640 1 -- 172.21.15.79:0/3914915449 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe8e40cbcc0 con 0x564e259a3880 2024-08-20T01:38:26.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.609+0000 7fe8d3fff640 1 -- 172.21.15.79:0/3914915449 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4003c30 con 0x564e259a3880 2024-08-20T01:38:26.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.609+0000 7fe8f2873740 1 -- 172.21.15.79:0/3914915449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e259a3880 msgr2=0x564e259aedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:26.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.609+0000 7fe8f2873740 1 --2- 172.21.15.79:0/3914915449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e259a3880 0x564e259aedf0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fe8e403b4a0 tx=0x7fe8e40d4040 comp rx=0 tx=0).stop 2024-08-20T01:38:26.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.609+0000 7fe8f2873740 1 -- 172.21.15.79:0/3914915449 shutdown_connections 2024-08-20T01:38:26.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.609+0000 7fe8f2873740 1 --2- 172.21.15.79:0/3914915449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e259b0130 0x564e259c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.609+0000 7fe8f2873740 1 --2- 172.21.15.79:0/3914915449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e259a41a0 0x564e259c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.609+0000 7fe8f2873740 1 --2- 172.21.15.79:0/3914915449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e259a3880 0x564e259aedf0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.609+0000 7fe8f2873740 1 -- 172.21.15.79:0/3914915449 >> 172.21.15.79:0/3914915449 conn(0x564e259a16b0 msgr2=0x564e259ae6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:26.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.609+0000 7fe8f2873740 1 -- 172.21.15.79:0/3914915449 shutdown_connections 2024-08-20T01:38:26.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.610+0000 7fe8f2873740 1 -- 172.21.15.79:0/3914915449 wait complete. 2024-08-20T01:38:26.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.610+0000 7fe8f2873740 1 -- start start 2024-08-20T01:38:26.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.610+0000 7fe8f2873740 1 Processor -- start 2024-08-20T01:38:26.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.610+0000 7fe8f2873740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e259a3880 0x564e259b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:26.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.610+0000 7fe8f2873740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e259a41a0 0x564e259b44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:26.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.610+0000 7fe8f2873740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e259b0130 0x564e259b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:26.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.610+0000 7fe8f2873740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e81ad260 con 0x564e259a41a0 2024-08-20T01:38:26.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.610+0000 7fe8f2873740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e81acb90 con 0x564e259a3880 2024-08-20T01:38:26.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.610+0000 7fe8f2873740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e81a9dd0 con 0x564e259b0130 2024-08-20T01:38:26.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.610+0000 7fe8f2873740 10 client.0 _ll_register_callbacks cb 0x7fe8d8009610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:26.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.610+0000 7fe8eda15640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e259a41a0 0x564e259b44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:26.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.610+0000 7fe8eda15640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e259a41a0 0x564e259b44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36770/0 (socket says 172.21.15.79:36770) 2024-08-20T01:38:26.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.610+0000 7fe8eda15640 1 -- 172.21.15.79:0/2497771726 learned_addr learned my addr 172.21.15.79:0/2497771726 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:26.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.610+0000 7fe8eea17640 1 --2- 172.21.15.79:0/2497771726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e259b0130 0x564e259b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:26.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.611+0000 7fe8ee216640 1 --2- 172.21.15.79:0/2497771726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e259a3880 0x564e259b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:26.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.611+0000 7fe8eda15640 1 -- 172.21.15.79:0/2497771726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e259b0130 msgr2=0x564e259b49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:26.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.611+0000 7fe8eda15640 1 --2- 172.21.15.79:0/2497771726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e259b0130 0x564e259b49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.611+0000 7fe8eda15640 1 -- 172.21.15.79:0/2497771726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e259a3880 msgr2=0x564e259b3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:26.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.611+0000 7fe8eda15640 1 --2- 172.21.15.79:0/2497771726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e259a3880 0x564e259b3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.611+0000 7fe8eda15640 1 -- 172.21.15.79:0/2497771726 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e25a29d50 con 0x564e259a41a0 2024-08-20T01:38:26.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.611+0000 7fe8ee216640 1 --2- 172.21.15.79:0/2497771726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e259a3880 0x564e259b3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:38:26.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.611+0000 7fe8eda15640 1 --2- 172.21.15.79:0/2497771726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e259a41a0 0x564e259b44a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8000c00 tx=0x7fe8d80097d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d32058b094c1ac7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:26.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.611+0000 7fe8d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:38:26.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.611+0000 7fe8d1ffb640 1 -- 172.21.15.79:0/2497771726 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8003970 con 0x564e259a41a0 2024-08-20T01:38:26.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.611+0000 7fe8d1ffb640 1 -- 172.21.15.79:0/2497771726 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fe8d80050c0 con 0x564e259a41a0 2024-08-20T01:38:26.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.611+0000 7fe8f2873740 1 -- 172.21.15.79:0/2497771726 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8e40cbcc0 con 0x564e259a41a0 2024-08-20T01:38:26.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.611+0000 7fe8d1ffb640 1 -- 172.21.15.79:0/2497771726 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe8d80052c0 con 0x564e259a41a0 2024-08-20T01:38:26.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.611+0000 7fe8f2873740 10 client.16011 fetch_fsmap learned FSMap version 30 2024-08-20T01:38:26.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.611+0000 7fe8f2873740 1 -- 172.21.15.79:0/2497771726 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564e25a2b050 con 0x564e259a41a0 2024-08-20T01:38:26.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.612+0000 7fe8d1ffb640 1 -- 172.21.15.79:0/2497771726 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe8e40cbcc0 con 0x564e259a41a0 2024-08-20T01:38:26.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.612+0000 7fe8d1ffb640 1 -- 172.21.15.79:0/2497771726 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fe8d8011860 con 0x564e259a41a0 2024-08-20T01:38:26.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.612+0000 7fe8f2873740 10 client.16011 fetch_fsmap finished waiting for FSMap version 30 2024-08-20T01:38:26.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.612+0000 7fe8f2873740 10 client.16011 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:38:26.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.612+0000 7fe8f2873740 20 client.16011 populate_metadata read hostname 'smithi079' 2024-08-20T01:38:26.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.612+0000 7fe8f2873740 1 --2- 172.21.15.79:0/2497771726 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x564e25a2b7b0 0x564e25a2dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:26.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.612+0000 7fe8f2873740 4 client.16011 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:38:26.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.612+0000 7fe8f2873740 1 -- 172.21.15.79:0/2497771726 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564e25918320 con 0x564e25a2b7b0 2024-08-20T01:38:26.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.612+0000 7fe8ee216640 1 --2- 172.21.15.79:0/2497771726 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x564e25a2b7b0 0x564e25a2dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:26.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.613+0000 7fe8ee216640 1 --2- 172.21.15.79:0/2497771726 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x564e25a2b7b0 0x564e25a2dbd0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=948c3e46b46d8ba server_cookie=3c74b99034b35695 in_seq=0 out_seq=0 2024-08-20T01:38:26.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.613+0000 7fe8d1ffb640 10 client.16011 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:38:26.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.613+0000 7fe8d1ffb640 1 -- 172.21.15.79:0/2497771726 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564e25918320 con 0x564e25a2b7b0 2024-08-20T01:38:26.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.613+0000 7fe8d1ffb640 10 client.16011 handle_command_reply: tid=0 2024-08-20T01:38:26.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.613+0000 7fe8f2873740 1 client.16011 shutdown 2024-08-20T01:38:26.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.613+0000 7fe8f2873740 1 -- 172.21.15.79:0/2497771726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e259a41a0 msgr2=0x564e259b44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:26.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.613+0000 7fe8f2873740 1 --2- 172.21.15.79:0/2497771726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e259a41a0 0x564e259b44a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8000c00 tx=0x7fe8d80097d0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.613+0000 7fe8f2873740 1 -- 172.21.15.79:0/2497771726 shutdown_connections 2024-08-20T01:38:26.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.613+0000 7fe8f2873740 1 --2- 172.21.15.79:0/2497771726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e259b0130 0x564e259b49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.613+0000 7fe8f2873740 1 --2- 172.21.15.79:0/2497771726 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x564e25a2b7b0 0x564e25a2dbd0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.613+0000 7fe8f2873740 1 --2- 172.21.15.79:0/2497771726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e259a41a0 0x564e259b44a0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.613+0000 7fe8f2873740 1 --2- 172.21.15.79:0/2497771726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e259a3880 0x564e259b3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.613+0000 7fe8f2873740 1 -- 172.21.15.79:0/2497771726 >> 172.21.15.79:0/2497771726 conn(0x564e259a16b0 msgr2=0x564e259aef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:26.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.613+0000 7fe8d1ffb640 0 client.16011 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:38:26.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.613+0000 7fe8f2873740 1 -- 172.21.15.79:0/2497771726 shutdown_connections 2024-08-20T01:38:26.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.613+0000 7fe8f2873740 1 -- 172.21.15.79:0/2497771726 wait complete. 2024-08-20T01:38:26.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.613+0000 7fe8f2873740 20 client.16011 trim_cache size 0 max 16384 2024-08-20T01:38:26.622 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:38:26.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.614+0000 7fe8f047a640 1 -- 172.21.15.79:0/88889028 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe8d40b8060 msgr2=0x7fe8d40ba520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:26.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.614+0000 7fe8f047a640 1 --2- 172.21.15.79:0/88889028 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe8d40b8060 0x7fe8d40ba520 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0009fd0 tx=0x7fe8e0016000 comp rx=0 tx=0).stop 2024-08-20T01:38:26.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.614+0000 7fe8f047a640 1 -- 172.21.15.79:0/88889028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8e8102af0 msgr2=0x7fe8e8198f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:26.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.614+0000 7fe8f047a640 1 --2- 172.21.15.79:0/88889028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8e8102af0 0x7fe8e8198f00 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4009230 tx=0x7fe8e4004270 comp rx=0 tx=0).stop 2024-08-20T01:38:26.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.614+0000 7fe8f047a640 1 -- 172.21.15.79:0/88889028 shutdown_connections 2024-08-20T01:38:26.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.614+0000 7fe8f047a640 1 --2- 172.21.15.79:0/88889028 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe8d40b8060 0x7fe8d40ba520 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.614+0000 7fe8f047a640 1 --2- 172.21.15.79:0/88889028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe8e8108e80 0x7fe8e819e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.614+0000 7fe8f047a640 1 --2- 172.21.15.79:0/88889028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8e8108500 0x7fe8e8199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.614+0000 7fe8f047a640 1 --2- 172.21.15.79:0/88889028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8e8102af0 0x7fe8e8198f00 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:26.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.614+0000 7fe8f047a640 1 -- 172.21.15.79:0/88889028 >> 172.21.15.79:0/88889028 conn(0x7fe8e80fe540 msgr2=0x7fe8e8100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:26.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.614+0000 7fe8f047a640 1 -- 172.21.15.79:0/88889028 shutdown_connections 2024-08-20T01:38:26.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:26.615+0000 7fe8f047a640 1 -- 172.21.15.79:0/88889028 wait complete. 2024-08-20T01:38:26.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:26 smithi081 ceph-mon[22209]: pgmap v380: 97 pgs: 97 active+clean; 458 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 28 MiB/s wr, 58 op/s 2024-08-20T01:38:26.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:26 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:38:26.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:26 smithi175 ceph-mon[22392]: pgmap v380: 97 pgs: 97 active+clean; 458 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 28 MiB/s wr, 58 op/s 2024-08-20T01:38:26.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:26 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:38:26.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:26 smithi079 ceph-mon[18656]: pgmap v380: 97 pgs: 97 active+clean; 458 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 28 MiB/s wr, 58 op/s 2024-08-20T01:38:26.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:26 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:38:27.358 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T01:38:27.633 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:38:28.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.138+0000 7f6a0af93640 1 -- 172.21.15.79:0/5815305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a04107d20 msgr2=0x7f6a0410e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:28.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.138+0000 7f6a0af93640 1 --2- 172.21.15.79:0/5815305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a04107d20 0x7f6a0410e520 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f69fc009ca0 tx=0x7f69fc02a8c0 comp rx=0 tx=0).stop 2024-08-20T01:38:28.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.138+0000 7f6a0af93640 1 -- 172.21.15.79:0/5815305 shutdown_connections 2024-08-20T01:38:28.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.138+0000 7f6a0af93640 1 --2- 172.21.15.79:0/5815305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a04107d20 0x7f6a0410e520 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:28.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.138+0000 7f6a0af93640 1 --2- 172.21.15.79:0/5815305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a041073a0 0x7f6a041077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:28.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.138+0000 7f6a0af93640 1 --2- 172.21.15.79:0/5815305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a04101990 0x7f6a04101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:28.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.138+0000 7f6a0af93640 1 -- 172.21.15.79:0/5815305 >> 172.21.15.79:0/5815305 conn(0x7f6a040fd400 msgr2=0x7f6a040ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:28.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.138+0000 7f6a0af93640 1 -- 172.21.15.79:0/5815305 shutdown_connections 2024-08-20T01:38:28.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.138+0000 7f6a0af93640 1 -- 172.21.15.79:0/5815305 wait complete. 2024-08-20T01:38:28.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.139+0000 7f6a0af93640 1 Processor -- start 2024-08-20T01:38:28.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.139+0000 7f6a0af93640 1 -- start start 2024-08-20T01:38:28.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.139+0000 7f6a0af93640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a04101990 0x7f6a04199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:28.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.139+0000 7f6a0af93640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a041073a0 0x7f6a0419a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:28.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.139+0000 7f6a0af93640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a04107d20 0x7f6a041a4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:28.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.139+0000 7f6a0af93640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6a041118a0 con 0x7f6a04101990 2024-08-20T01:38:28.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.139+0000 7f6a0af93640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6a04111720 con 0x7f6a041073a0 2024-08-20T01:38:28.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.139+0000 7f6a0af93640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6a04111a20 con 0x7f6a04107d20 2024-08-20T01:38:28.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.139+0000 7f6a08d2f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a04101990 0x7f6a04199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:28.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.139+0000 7f6a08d2f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a04101990 0x7f6a04199c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36788/0 (socket says 172.21.15.79:36788) 2024-08-20T01:38:28.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.139+0000 7f6a08d2f640 1 -- 172.21.15.79:0/3404444915 learned_addr learned my addr 172.21.15.79:0/3404444915 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:28.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.139+0000 7f6a09530640 1 --2- 172.21.15.79:0/3404444915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a04107d20 0x7f6a041a4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:28.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.139+0000 7f6a03fff640 1 --2- 172.21.15.79:0/3404444915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a041073a0 0x7f6a0419a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:28.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.140+0000 7f6a08d2f640 1 -- 172.21.15.79:0/3404444915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a04107d20 msgr2=0x7f6a041a4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:28.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.140+0000 7f6a08d2f640 1 --2- 172.21.15.79:0/3404444915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a04107d20 0x7f6a041a4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:28.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.140+0000 7f6a08d2f640 1 -- 172.21.15.79:0/3404444915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a041073a0 msgr2=0x7f6a0419a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:28.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.140+0000 7f6a08d2f640 1 --2- 172.21.15.79:0/3404444915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a041073a0 0x7f6a0419a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:28.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.140+0000 7f6a08d2f640 1 -- 172.21.15.79:0/3404444915 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a041a51f0 con 0x7f6a04101990 2024-08-20T01:38:28.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.140+0000 7f6a09530640 1 --2- 172.21.15.79:0/3404444915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a04107d20 0x7f6a041a4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:38:28.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.140+0000 7f6a08d2f640 1 --2- 172.21.15.79:0/3404444915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a04101990 0x7f6a04199c30 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f69f800e9f0 tx=0x7f69f800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:28.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.140+0000 7f6a01ffb640 1 -- 172.21.15.79:0/3404444915 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f800cd80 con 0x7f6a04101990 2024-08-20T01:38:28.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.140+0000 7f6a0af93640 1 -- 172.21.15.79:0/3404444915 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a041a53c0 con 0x7f6a04101990 2024-08-20T01:38:28.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.140+0000 7f6a01ffb640 1 -- 172.21.15.79:0/3404444915 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69f80108c0 con 0x7f6a04101990 2024-08-20T01:38:28.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.140+0000 7f6a01ffb640 1 -- 172.21.15.79:0/3404444915 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f80187c0 con 0x7f6a04101990 2024-08-20T01:38:28.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.140+0000 7f6a0af93640 1 -- 172.21.15.79:0/3404444915 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a041a58a0 con 0x7f6a04101990 2024-08-20T01:38:28.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.143+0000 7f6a0d38c740 1 Processor -- start 2024-08-20T01:38:28.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.143+0000 7f6a0d38c740 1 -- start start 2024-08-20T01:38:28.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.143+0000 7f6a0d38c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbef2b4880 0x55cbef2b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:28.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.143+0000 7f6a0d38c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cbef2b51a0 0x55cbef2c0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:28.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.143+0000 7f6a0d38c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbef2c1130 0x55cbef2c3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:28.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.143+0000 7f6a01ffb640 1 -- 172.21.15.79:0/3404444915 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f69f8010430 con 0x7f6a04101990 2024-08-20T01:38:28.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.143+0000 7f6a0d38c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55cbef22b930 con 0x55cbef2c1130 2024-08-20T01:38:28.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.143+0000 7f6a0d38c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55cbef21ae30 con 0x55cbef2b51a0 2024-08-20T01:38:28.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.143+0000 7f6a0d38c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55cbef21ee70 con 0x55cbef2b4880 2024-08-20T01:38:28.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.143+0000 7f6a03fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbef2c1130 0x55cbef2c3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:28.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.143+0000 7f6a03fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbef2c1130 0x55cbef2c3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36792/0 (socket says 172.21.15.79:36792) 2024-08-20T01:38:28.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.143+0000 7f6a03fff640 1 -- 172.21.15.79:0/3584250394 learned_addr learned my addr 172.21.15.79:0/3584250394 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:28.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.143+0000 7f6a09530640 1 --2- 172.21.15.79:0/3584250394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbef2b4880 0x55cbef2b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:28.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.143+0000 7f6a08d2f640 1 --2- 172.21.15.79:0/3584250394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cbef2b51a0 0x55cbef2c0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:28.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.144+0000 7f6a03fff640 1 -- 172.21.15.79:0/3584250394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbef2b4880 msgr2=0x55cbef2b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:28.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.144+0000 7f6a03fff640 1 --2- 172.21.15.79:0/3584250394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbef2b4880 0x55cbef2b4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:28.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.144+0000 7f6a03fff640 1 -- 172.21.15.79:0/3584250394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cbef2b51a0 msgr2=0x55cbef2c0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:28.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.144+0000 7f6a03fff640 1 --2- 172.21.15.79:0/3584250394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cbef2b51a0 0x55cbef2c0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:28.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.144+0000 7f6a03fff640 1 -- 172.21.15.79:0/3584250394 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbeef7a650 con 0x55cbef2c1130 2024-08-20T01:38:28.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.144+0000 7f6a03fff640 1 --2- 172.21.15.79:0/3584250394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbef2c1130 0x55cbef2c3520 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f69f000bcc0 tx=0x7f69f000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fa7c4099fd03b6d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:28.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.144+0000 7f6a01ffb640 1 --2- 172.21.15.79:0/3404444915 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f69f40b3bd0 0x7f69f40b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:28.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.144+0000 7f69eeffd640 1 -- 172.21.15.79:0/3584250394 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f0015070 con 0x55cbef2c1130 2024-08-20T01:38:28.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.144+0000 7f69eeffd640 1 -- 172.21.15.79:0/3584250394 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69f001a8f0 con 0x55cbef2c1130 2024-08-20T01:38:28.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.144+0000 7f69eeffd640 1 -- 172.21.15.79:0/3584250394 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f0011810 con 0x55cbef2c1130 2024-08-20T01:38:28.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.144+0000 7f6a09530640 1 --2- 172.21.15.79:0/3404444915 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f69f40b3bd0 0x7f69f40b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:28.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.144+0000 7f6a01ffb640 1 -- 172.21.15.79:0/3404444915 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f69f80e3fc0 con 0x7f6a04101990 2024-08-20T01:38:28.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.145+0000 7f6a0d38c740 1 -- 172.21.15.79:0/3584250394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbef2c1130 msgr2=0x55cbef2c3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:28.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.145+0000 7f6a0d38c740 1 --2- 172.21.15.79:0/3584250394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbef2c1130 0x55cbef2c3520 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f69f000bcc0 tx=0x7f69f000f730 comp rx=0 tx=0).stop 2024-08-20T01:38:28.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.145+0000 7f6a09530640 1 --2- 172.21.15.79:0/3404444915 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f69f40b3bd0 0x7f69f40b6090 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f69fc005e30 tx=0x7f69fc005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:28.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.145+0000 7f6a0d38c740 1 -- 172.21.15.79:0/3584250394 shutdown_connections 2024-08-20T01:38:28.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.145+0000 7f6a0d38c740 1 --2- 172.21.15.79:0/3584250394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbef2c1130 0x55cbef2c3520 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:28.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.145+0000 7f6a0d38c740 1 --2- 172.21.15.79:0/3584250394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cbef2b51a0 0x55cbef2c0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:28.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.145+0000 7f6a0d38c740 1 --2- 172.21.15.79:0/3584250394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbef2b4880 0x55cbef2b4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:28.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.145+0000 7f6a0d38c740 1 -- 172.21.15.79:0/3584250394 >> 172.21.15.79:0/3584250394 conn(0x55cbef2b26b0 msgr2=0x55cbef2b3850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:28.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.145+0000 7f6a0d38c740 1 -- 172.21.15.79:0/3584250394 shutdown_connections 2024-08-20T01:38:28.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.145+0000 7f6a0d38c740 1 -- 172.21.15.79:0/3584250394 wait complete. 2024-08-20T01:38:28.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.145+0000 7f6a0d38c740 1 -- start start 2024-08-20T01:38:28.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.146+0000 7f6a0d38c740 1 Processor -- start 2024-08-20T01:38:28.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.146+0000 7f6a0d38c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cbef2b4880 0x55cbef2be0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:28.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.146+0000 7f6a0d38c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbef2b51a0 0x55cbef2be620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:28.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.146+0000 7f6a0d38c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbef2c1130 0x55cbef2beb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:28.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.146+0000 7f6a0d38c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55cbef07d700 con 0x55cbef2c1130 2024-08-20T01:38:28.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.146+0000 7f6a0d38c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55cbef1a1810 con 0x55cbef2b4880 2024-08-20T01:38:28.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.146+0000 7f6a0d38c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55cbef2c3de0 con 0x55cbef2b51a0 2024-08-20T01:38:28.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.146+0000 7f6a0d38c740 10 client.0 _ll_register_callbacks cb 0x55cbef214700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:28.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.146+0000 7f6a09530640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbef2c1130 0x55cbef2beb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:28.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.146+0000 7f6a09530640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbef2c1130 0x55cbef2beb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36800/0 (socket says 172.21.15.79:36800) 2024-08-20T01:38:28.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.146+0000 7f6a09530640 1 -- 172.21.15.79:0/1018736709 learned_addr learned my addr 172.21.15.79:0/1018736709 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:28.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.146+0000 7f6a03fff640 1 --2- 172.21.15.79:0/1018736709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbef2b51a0 0x55cbef2be620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:28.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.146+0000 7f6a08d2f640 1 --2- 172.21.15.79:0/1018736709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cbef2b4880 0x55cbef2be0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:28.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.147+0000 7f6a09530640 1 -- 172.21.15.79:0/1018736709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbef2b51a0 msgr2=0x55cbef2be620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:28.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.147+0000 7f6a09530640 1 --2- 172.21.15.79:0/1018736709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbef2b51a0 0x55cbef2be620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:28.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.147+0000 7f6a09530640 1 -- 172.21.15.79:0/1018736709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cbef2b4880 msgr2=0x55cbef2be0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:28.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.147+0000 7f6a09530640 1 --2- 172.21.15.79:0/1018736709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cbef2b4880 0x55cbef2be0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:28.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.147+0000 7f6a09530640 1 -- 172.21.15.79:0/1018736709 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbef2cd1c0 con 0x55cbef2c1130 2024-08-20T01:38:28.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.147+0000 7f6a08d2f640 1 --2- 172.21.15.79:0/1018736709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cbef2b4880 0x55cbef2be0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:38:28.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.147+0000 7f6a09530640 1 --2- 172.21.15.79:0/1018736709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbef2c1130 0x55cbef2beb60 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f69fc035000 tx=0x7f69fc02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc575e5cc68dfe54 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:28.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.147+0000 7f69e3fff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:38:28.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.147+0000 7f69e3fff640 1 -- 172.21.15.79:0/1018736709 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc004040 con 0x55cbef2c1130 2024-08-20T01:38:28.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.147+0000 7f69e3fff640 1 -- 172.21.15.79:0/1018736709 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f69fc0041e0 con 0x55cbef2c1130 2024-08-20T01:38:28.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.147+0000 7f6a0d38c740 1 -- 172.21.15.79:0/1018736709 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cbef1ca150 con 0x55cbef2c1130 2024-08-20T01:38:28.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.147+0000 7f69e3fff640 1 -- 172.21.15.79:0/1018736709 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f69fc0043e0 con 0x55cbef2c1130 2024-08-20T01:38:28.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.147+0000 7f6a0d38c740 10 client.16023 fetch_fsmap learned FSMap version 30 2024-08-20T01:38:28.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.147+0000 7f6a0d38c740 1 -- 172.21.15.79:0/1018736709 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55cbef2cfb50 con 0x55cbef2c1130 2024-08-20T01:38:28.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.147+0000 7f69e3fff640 1 -- 172.21.15.79:0/1018736709 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55cbef1ca150 con 0x55cbef2c1130 2024-08-20T01:38:28.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.148+0000 7f69e3fff640 1 -- 172.21.15.79:0/1018736709 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f69fc051070 con 0x55cbef2c1130 2024-08-20T01:38:28.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.148+0000 7f6a0d38c740 10 client.16023 fetch_fsmap finished waiting for FSMap version 30 2024-08-20T01:38:28.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.148+0000 7f6a0d38c740 10 client.16023 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:38:28.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.148+0000 7f6a0d38c740 20 client.16023 populate_metadata read hostname 'smithi079' 2024-08-20T01:38:28.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.148+0000 7f6a0d38c740 1 --2- 172.21.15.79:0/1018736709 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55cbef2d1000 0x55cbef2d3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:28.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.148+0000 7f6a0d38c740 4 client.16023 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:38:28.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.148+0000 7f6a0d38c740 1 -- 172.21.15.79:0/1018736709 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cbef22d880 con 0x55cbef2d1000 2024-08-20T01:38:28.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.148+0000 7f6a08d2f640 1 --2- 172.21.15.79:0/1018736709 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55cbef2d1000 0x55cbef2d3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:28.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.148+0000 7f6a08d2f640 1 --2- 172.21.15.79:0/1018736709 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55cbef2d1000 0x55cbef2d3440 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=728f84248e1c9dce server_cookie=fb2f9f4efa4d4da0 in_seq=0 out_seq=0 2024-08-20T01:38:28.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.148+0000 7f69e3fff640 10 client.16023 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:38:28.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.149+0000 7f69e3fff640 1 -- 172.21.15.79:0/1018736709 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cbef22d880 con 0x55cbef2d1000 2024-08-20T01:38:28.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.149+0000 7f69e3fff640 10 client.16023 handle_command_reply: tid=0 2024-08-20T01:38:28.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.149+0000 7f6a0d38c740 1 client.16023 shutdown 2024-08-20T01:38:28.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.149+0000 7f6a0d38c740 1 -- 172.21.15.79:0/1018736709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbef2c1130 msgr2=0x55cbef2beb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:28.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.149+0000 7f6a0d38c740 1 --2- 172.21.15.79:0/1018736709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbef2c1130 0x55cbef2beb60 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f69fc035000 tx=0x7f69fc02a8c0 comp rx=0 tx=0).stop 2024-08-20T01:38:28.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.149+0000 7f6a0d38c740 1 -- 172.21.15.79:0/1018736709 shutdown_connections 2024-08-20T01:38:28.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.149+0000 7f6a0d38c740 1 --2- 172.21.15.79:0/1018736709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbef2c1130 0x55cbef2beb60 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:28.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.149+0000 7f6a0d38c740 1 --2- 172.21.15.79:0/1018736709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbef2b51a0 0x55cbef2be620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:28.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.149+0000 7f6a0d38c740 1 --2- 172.21.15.79:0/1018736709 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55cbef2d1000 0x55cbef2d3440 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:28.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.149+0000 7f69e3fff640 0 client.16023 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:38:28.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.149+0000 7f6a0d38c740 1 --2- 172.21.15.79:0/1018736709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cbef2b4880 0x55cbef2be0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:28.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.149+0000 7f6a0d38c740 1 -- 172.21.15.79:0/1018736709 >> 172.21.15.79:0/1018736709 conn(0x55cbef2b26b0 msgr2=0x55cbef2b8250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:28.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.150+0000 7f6a0d38c740 1 -- 172.21.15.79:0/1018736709 shutdown_connections 2024-08-20T01:38:28.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.150+0000 7f6a0d38c740 1 -- 172.21.15.79:0/1018736709 wait complete. 2024-08-20T01:38:28.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.150+0000 7f6a0d38c740 20 client.16023 trim_cache size 0 max 16384 2024-08-20T01:38:28.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.165+0000 7f6a0d38c740 1 Processor -- start 2024-08-20T01:38:28.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.165+0000 7f6a0d38c740 1 -- start start 2024-08-20T01:38:28.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.165+0000 7f6a0d38c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbef2b4880 0x55cbef2b8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:28.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.165+0000 7f6a0d38c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbef2b51a0 0x55cbef2bfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:28.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.165+0000 7f6a0d38c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cbef2c1130 0x55cbef2d8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:28.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.165+0000 7f6a0d38c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6a041adf50 con 0x55cbef2b51a0 2024-08-20T01:38:28.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.165+0000 7f6a0d38c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6a041afb50 con 0x55cbef2c1130 2024-08-20T01:38:28.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.165+0000 7f6a0d38c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6a041ae620 con 0x55cbef2b4880 2024-08-20T01:38:28.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.165+0000 7f6a03fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbef2b51a0 0x55cbef2bfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:28.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.165+0000 7f6a03fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbef2b51a0 0x55cbef2bfe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36812/0 (socket says 172.21.15.79:36812) 2024-08-20T01:38:28.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.166+0000 7f6a03fff640 1 -- 172.21.15.79:0/983174281 learned_addr learned my addr 172.21.15.79:0/983174281 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:28.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.166+0000 7f6a09530640 1 --2- 172.21.15.79:0/983174281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cbef2c1130 0x55cbef2d8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:28.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.166+0000 7f6a08d2f640 1 --2- 172.21.15.79:0/983174281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbef2b4880 0x55cbef2b8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:28.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.166+0000 7f6a03fff640 1 -- 172.21.15.79:0/983174281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbef2b4880 msgr2=0x55cbef2b8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:28.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.166+0000 7f6a03fff640 1 --2- 172.21.15.79:0/983174281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbef2b4880 0x55cbef2b8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:28.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.166+0000 7f6a03fff640 1 -- 172.21.15.79:0/983174281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cbef2c1130 msgr2=0x55cbef2d8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:28.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.166+0000 7f6a03fff640 1 --2- 172.21.15.79:0/983174281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cbef2c1130 0x55cbef2d8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:28.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.166+0000 7f6a03fff640 1 -- 172.21.15.79:0/983174281 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbef2b3130 con 0x55cbef2b51a0 2024-08-20T01:38:28.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.166+0000 7f6a03fff640 1 --2- 172.21.15.79:0/983174281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbef2b51a0 0x55cbef2bfe20 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f69f000fc30 tx=0x7f69f0005c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c33cfe0725a25bc7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:28.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.166+0000 7f69ee7fc640 1 -- 172.21.15.79:0/983174281 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f0015050 con 0x55cbef2b51a0 2024-08-20T01:38:28.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.166+0000 7f69ee7fc640 1 -- 172.21.15.79:0/983174281 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69f0029070 con 0x55cbef2b51a0 2024-08-20T01:38:28.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.166+0000 7f69ee7fc640 1 -- 172.21.15.79:0/983174281 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f0004c50 con 0x55cbef2b51a0 2024-08-20T01:38:28.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.167+0000 7f6a0d38c740 1 -- 172.21.15.79:0/983174281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbef2b51a0 msgr2=0x55cbef2bfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:28.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.167+0000 7f6a0d38c740 1 --2- 172.21.15.79:0/983174281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbef2b51a0 0x55cbef2bfe20 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f69f000fc30 tx=0x7f69f0005c70 comp rx=0 tx=0).stop 2024-08-20T01:38:28.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.167+0000 7f6a0d38c740 1 -- 172.21.15.79:0/983174281 shutdown_connections 2024-08-20T01:38:28.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.167+0000 7f6a0d38c740 1 --2- 172.21.15.79:0/983174281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cbef2c1130 0x55cbef2d8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:28.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.167+0000 7f6a0d38c740 1 --2- 172.21.15.79:0/983174281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbef2b51a0 0x55cbef2bfe20 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:28.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.167+0000 7f6a0d38c740 1 --2- 172.21.15.79:0/983174281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbef2b4880 0x55cbef2b8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:28.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.167+0000 7f6a0d38c740 1 -- 172.21.15.79:0/983174281 >> 172.21.15.79:0/983174281 conn(0x55cbef2b26b0 msgr2=0x55cbef2bf710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:28.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.167+0000 7f6a0d38c740 1 -- 172.21.15.79:0/983174281 shutdown_connections 2024-08-20T01:38:28.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.168+0000 7f6a0d38c740 1 -- 172.21.15.79:0/983174281 wait complete. 2024-08-20T01:38:28.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.168+0000 7f6a0d38c740 1 -- start start 2024-08-20T01:38:28.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.168+0000 7f6a0d38c740 1 Processor -- start 2024-08-20T01:38:28.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.168+0000 7f6a0d38c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbef2b4880 0x55cbef3373d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:28.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.168+0000 7f6a0d38c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbef2b51a0 0x55cbef2c9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:28.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.168+0000 7f6a0d38c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cbef2c1130 0x55cbef2c95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:28.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.168+0000 7f6a0d38c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6a041af3c0 con 0x55cbef2b4880 2024-08-20T01:38:28.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.168+0000 7f6a0d38c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6a041aecf0 con 0x55cbef2c1130 2024-08-20T01:38:28.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.168+0000 7f6a0d38c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6a041abf30 con 0x55cbef2b51a0 2024-08-20T01:38:28.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.169+0000 7f6a08d2f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbef2b4880 0x55cbef3373d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:28.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.169+0000 7f6a0d38c740 10 client.0 _ll_register_callbacks cb 0x7f69fc009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:28.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.169+0000 7f6a08d2f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbef2b4880 0x55cbef3373d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36816/0 (socket says 172.21.15.79:36816) 2024-08-20T01:38:28.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.169+0000 7f6a08d2f640 1 -- 172.21.15.79:0/2414468381 learned_addr learned my addr 172.21.15.79:0/2414468381 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:28.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.169+0000 7f6a09530640 1 --2- 172.21.15.79:0/2414468381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cbef2c1130 0x55cbef2c95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:28.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.169+0000 7f6a03fff640 1 --2- 172.21.15.79:0/2414468381 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbef2b51a0 0x55cbef2c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:28.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.169+0000 7f6a08d2f640 1 -- 172.21.15.79:0/2414468381 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbef2b51a0 msgr2=0x55cbef2c9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:28.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.169+0000 7f6a08d2f640 1 --2- 172.21.15.79:0/2414468381 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbef2b51a0 0x55cbef2c9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:28.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.169+0000 7f6a08d2f640 1 -- 172.21.15.79:0/2414468381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cbef2c1130 msgr2=0x55cbef2c95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:28.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.169+0000 7f6a08d2f640 1 --2- 172.21.15.79:0/2414468381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cbef2c1130 0x55cbef2c95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:28.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.169+0000 7f6a08d2f640 1 -- 172.21.15.79:0/2414468381 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbef2c9cc0 con 0x55cbef2b4880 2024-08-20T01:38:28.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.169+0000 7f6a03fff640 1 --2- 172.21.15.79:0/2414468381 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbef2b51a0 0x55cbef2c9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:28.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.169+0000 7f6a09530640 1 --2- 172.21.15.79:0/2414468381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cbef2c1130 0x55cbef2c95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:28.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.169+0000 7f6a08d2f640 1 --2- 172.21.15.79:0/2414468381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbef2b4880 0x55cbef3373d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f69f80aaf50 tx=0x7f69f80e7660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6da9d2be19efdda7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:28.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.169+0000 7f69e3fff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:38:28.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.169+0000 7f69e3fff640 1 -- 172.21.15.79:0/2414468381 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f80ab6c0 con 0x55cbef2b4880 2024-08-20T01:38:28.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.169+0000 7f69e3fff640 1 -- 172.21.15.79:0/2414468381 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f69f8010a70 con 0x55cbef2b4880 2024-08-20T01:38:28.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.169+0000 7f6a0d38c740 1 -- 172.21.15.79:0/2414468381 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69f0029070 con 0x55cbef2b4880 2024-08-20T01:38:28.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.169+0000 7f69e3fff640 1 -- 172.21.15.79:0/2414468381 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f69f80aafc0 con 0x55cbef2b4880 2024-08-20T01:38:28.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.169+0000 7f6a0d38c740 10 client.16029 fetch_fsmap learned FSMap version 30 2024-08-20T01:38:28.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.169+0000 7f6a0d38c740 1 -- 172.21.15.79:0/2414468381 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55cbef340240 con 0x55cbef2b4880 2024-08-20T01:38:28.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.170+0000 7f69e3fff640 1 -- 172.21.15.79:0/2414468381 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69f0029070 con 0x55cbef2b4880 2024-08-20T01:38:28.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.170+0000 7f69e3fff640 1 -- 172.21.15.79:0/2414468381 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f69f80ad070 con 0x55cbef2b4880 2024-08-20T01:38:28.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.170+0000 7f6a0d38c740 10 client.16029 fetch_fsmap finished waiting for FSMap version 30 2024-08-20T01:38:28.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.170+0000 7f6a0d38c740 10 client.16029 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:38:28.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.170+0000 7f6a0d38c740 20 client.16029 populate_metadata read hostname 'smithi079' 2024-08-20T01:38:28.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.170+0000 7f6a0d38c740 1 --2- 172.21.15.79:0/2414468381 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55cbef340990 0x55cbef342db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:28.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.170+0000 7f6a0d38c740 4 client.16029 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:38:28.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.170+0000 7f6a0d38c740 1 -- 172.21.15.79:0/2414468381 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cbef229320 con 0x55cbef340990 2024-08-20T01:38:28.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.170+0000 7f6a03fff640 1 --2- 172.21.15.79:0/2414468381 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55cbef340990 0x55cbef342db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:28.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.171+0000 7f6a03fff640 1 --2- 172.21.15.79:0/2414468381 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55cbef340990 0x55cbef342db0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=68b8d0f25859ef9d server_cookie=bd9e7d6369fcf8f4 in_seq=0 out_seq=0 2024-08-20T01:38:28.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.171+0000 7f69e3fff640 10 client.16029 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:38:28.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.171+0000 7f69e3fff640 1 -- 172.21.15.79:0/2414468381 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cbef229320 con 0x55cbef340990 2024-08-20T01:38:28.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.171+0000 7f69e3fff640 10 client.16029 handle_command_reply: tid=0 2024-08-20T01:38:28.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.171+0000 7f6a0d38c740 1 client.16029 shutdown 2024-08-20T01:38:28.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.171+0000 7f6a0d38c740 1 -- 172.21.15.79:0/2414468381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbef2b4880 msgr2=0x55cbef3373d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:28.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.171+0000 7f6a0d38c740 1 --2- 172.21.15.79:0/2414468381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbef2b4880 0x55cbef3373d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f69f80aaf50 tx=0x7f69f80e7660 comp rx=0 tx=0).stop 2024-08-20T01:38:28.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.171+0000 7f6a0d38c740 1 -- 172.21.15.79:0/2414468381 shutdown_connections 2024-08-20T01:38:28.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.171+0000 7f6a0d38c740 1 --2- 172.21.15.79:0/2414468381 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55cbef340990 0x55cbef342db0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:28.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.171+0000 7f6a0d38c740 1 --2- 172.21.15.79:0/2414468381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cbef2c1130 0x55cbef2c95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:28.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.171+0000 7f6a0d38c740 1 --2- 172.21.15.79:0/2414468381 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbef2b51a0 0x55cbef2c9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:28.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.171+0000 7f6a0d38c740 1 --2- 172.21.15.79:0/2414468381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbef2b4880 0x55cbef3373d0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:28.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.171+0000 7f6a0d38c740 1 -- 172.21.15.79:0/2414468381 >> 172.21.15.79:0/2414468381 conn(0x55cbef2b26b0 msgr2=0x55cbef2bff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:28.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.171+0000 7f69e3fff640 0 client.16029 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:38:28.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.171+0000 7f6a0d38c740 1 -- 172.21.15.79:0/2414468381 shutdown_connections 2024-08-20T01:38:28.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.172+0000 7f6a0d38c740 1 -- 172.21.15.79:0/2414468381 wait complete. 2024-08-20T01:38:28.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.172+0000 7f6a0d38c740 20 client.16029 trim_cache size 0 max 16384 2024-08-20T01:38:28.188 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:38:28.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.172+0000 7f6a0af93640 1 -- 172.21.15.79:0/3404444915 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f69f40b3bd0 msgr2=0x7f69f40b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:28.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.172+0000 7f6a0af93640 1 --2- 172.21.15.79:0/3404444915 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f69f40b3bd0 0x7f69f40b6090 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f69fc005e30 tx=0x7f69fc005d80 comp rx=0 tx=0).stop 2024-08-20T01:38:28.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.172+0000 7f6a0af93640 1 -- 172.21.15.79:0/3404444915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a04101990 msgr2=0x7f6a04199c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:28.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.172+0000 7f6a0af93640 1 --2- 172.21.15.79:0/3404444915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a04101990 0x7f6a04199c30 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f69f800e9f0 tx=0x7f69f800eeb0 comp rx=0 tx=0).stop 2024-08-20T01:38:28.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.172+0000 7f6a0af93640 1 -- 172.21.15.79:0/3404444915 shutdown_connections 2024-08-20T01:38:28.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.172+0000 7f6a0af93640 1 --2- 172.21.15.79:0/3404444915 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f69f40b3bd0 0x7f69f40b6090 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:28.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.172+0000 7f6a0af93640 1 --2- 172.21.15.79:0/3404444915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a04107d20 0x7f6a041a4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:28.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.172+0000 7f6a0af93640 1 --2- 172.21.15.79:0/3404444915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a041073a0 0x7f6a0419a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:28.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.172+0000 7f6a0af93640 1 --2- 172.21.15.79:0/3404444915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a04101990 0x7f6a04199c30 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:28.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.173+0000 7f6a0af93640 1 -- 172.21.15.79:0/3404444915 >> 172.21.15.79:0/3404444915 conn(0x7f6a040fd400 msgr2=0x7f6a040ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:28.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.173+0000 7f6a0af93640 1 -- 172.21.15.79:0/3404444915 shutdown_connections 2024-08-20T01:38:28.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:28.173+0000 7f6a0af93640 1 -- 172.21.15.79:0/3404444915 wait complete. 2024-08-20T01:38:28.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:28 smithi081 ceph-mon[22209]: pgmap v381: 97 pgs: 97 active+clean; 530 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 30 MiB/s wr, 56 op/s 2024-08-20T01:38:28.881 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:28 smithi079 ceph-mon[18656]: pgmap v381: 97 pgs: 97 active+clean; 530 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 30 MiB/s wr, 56 op/s 2024-08-20T01:38:28.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:28 smithi175 ceph-mon[22392]: pgmap v381: 97 pgs: 97 active+clean; 530 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 30 MiB/s wr, 56 op/s 2024-08-20T01:38:28.910 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T01:38:29.187 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:38:29.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.695+0000 7fc936fa8640 1 -- 172.21.15.79:0/2726046963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9301073c0 msgr2=0x7fc930107800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:29.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.695+0000 7fc936fa8640 1 --2- 172.21.15.79:0/2726046963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9301073c0 0x7fc930107800 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fc91c009900 tx=0x7fc91c02a410 comp rx=0 tx=0).stop 2024-08-20T01:38:29.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.696+0000 7fc936fa8640 1 -- 172.21.15.79:0/2726046963 shutdown_connections 2024-08-20T01:38:29.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.696+0000 7fc936fa8640 1 --2- 172.21.15.79:0/2726046963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc930107d40 0x7fc93010e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:29.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.696+0000 7fc936fa8640 1 --2- 172.21.15.79:0/2726046963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9301073c0 0x7fc930107800 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:29.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.696+0000 7fc936fa8640 1 --2- 172.21.15.79:0/2726046963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9301019b0 0x7fc930101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:29.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.696+0000 7fc936fa8640 1 -- 172.21.15.79:0/2726046963 >> 172.21.15.79:0/2726046963 conn(0x7fc9300fd420 msgr2=0x7fc9300ff840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:29.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.696+0000 7fc936fa8640 1 -- 172.21.15.79:0/2726046963 shutdown_connections 2024-08-20T01:38:29.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.696+0000 7fc936fa8640 1 -- 172.21.15.79:0/2726046963 wait complete. 2024-08-20T01:38:29.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.696+0000 7fc936fa8640 1 Processor -- start 2024-08-20T01:38:29.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.696+0000 7fc936fa8640 1 -- start start 2024-08-20T01:38:29.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.697+0000 7fc936fa8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9301019b0 0x7fc930199030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:29.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.697+0000 7fc936fa8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9301073c0 0x7fc930199570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:29.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.697+0000 7fc936fa8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc930107d40 0x7fc93019e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:29.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.697+0000 7fc936fa8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc930111910 con 0x7fc9301073c0 2024-08-20T01:38:29.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.697+0000 7fc936fa8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc930111790 con 0x7fc930107d40 2024-08-20T01:38:29.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.697+0000 7fc936fa8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc930111a90 con 0x7fc9301019b0 2024-08-20T01:38:29.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.697+0000 7fc92ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9301073c0 0x7fc930199570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:29.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.697+0000 7fc92ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9301073c0 0x7fc930199570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36830/0 (socket says 172.21.15.79:36830) 2024-08-20T01:38:29.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.697+0000 7fc92ffff640 1 -- 172.21.15.79:0/1089138353 learned_addr learned my addr 172.21.15.79:0/1089138353 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:29.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.697+0000 7fc934d44640 1 --2- 172.21.15.79:0/1089138353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9301019b0 0x7fc930199030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:29.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.697+0000 7fc935545640 1 --2- 172.21.15.79:0/1089138353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc930107d40 0x7fc93019e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:29.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.697+0000 7fc92ffff640 1 -- 172.21.15.79:0/1089138353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9301019b0 msgr2=0x7fc930199030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:29.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.697+0000 7fc92ffff640 1 --2- 172.21.15.79:0/1089138353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9301019b0 0x7fc930199030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:29.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.697+0000 7fc92ffff640 1 -- 172.21.15.79:0/1089138353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc930107d40 msgr2=0x7fc93019e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:29.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.697+0000 7fc92ffff640 1 --2- 172.21.15.79:0/1089138353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc930107d40 0x7fc93019e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:29.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.697+0000 7fc92ffff640 1 -- 172.21.15.79:0/1089138353 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc93019f0e0 con 0x7fc9301073c0 2024-08-20T01:38:29.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.697+0000 7fc92ffff640 1 --2- 172.21.15.79:0/1089138353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9301073c0 0x7fc930199570 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fc91c006010 tx=0x7fc91c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:29.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.698+0000 7fc92dffb640 1 -- 172.21.15.79:0/1089138353 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c03f070 con 0x7fc9301073c0 2024-08-20T01:38:29.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.698+0000 7fc936fa8640 1 -- 172.21.15.79:0/1089138353 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc93019f370 con 0x7fc9301073c0 2024-08-20T01:38:29.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.698+0000 7fc92dffb640 1 -- 172.21.15.79:0/1089138353 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc91c003a80 con 0x7fc9301073c0 2024-08-20T01:38:29.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.698+0000 7fc92dffb640 1 -- 172.21.15.79:0/1089138353 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c035070 con 0x7fc9301073c0 2024-08-20T01:38:29.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.698+0000 7fc936fa8640 1 -- 172.21.15.79:0/1089138353 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9301a5a90 con 0x7fc9301073c0 2024-08-20T01:38:29.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.701+0000 7fc9393a1740 1 Processor -- start 2024-08-20T01:38:29.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.701+0000 7fc9393a1740 1 -- start start 2024-08-20T01:38:29.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.701+0000 7fc92dffb640 1 -- 172.21.15.79:0/1089138353 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc91c042070 con 0x7fc9301073c0 2024-08-20T01:38:29.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.701+0000 7fc9393a1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557608d7e880 0x557608d7ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:29.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.701+0000 7fc9393a1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557608d7f1a0 0x557608d8f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:29.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.701+0000 7fc9393a1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557608d8f540 0x557608d91930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:29.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.701+0000 7fc9393a1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557608cf5930 con 0x557608d7e880 2024-08-20T01:38:29.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.701+0000 7fc9393a1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557608ce4e30 con 0x557608d7f1a0 2024-08-20T01:38:29.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.701+0000 7fc9393a1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557608ce8e70 con 0x557608d8f540 2024-08-20T01:38:29.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.701+0000 7fc935545640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557608d7e880 0x557608d7ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:29.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.702+0000 7fc935545640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557608d7e880 0x557608d7ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36832/0 (socket says 172.21.15.79:36832) 2024-08-20T01:38:29.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.702+0000 7fc935545640 1 -- 172.21.15.79:0/3014165165 learned_addr learned my addr 172.21.15.79:0/3014165165 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:29.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.702+0000 7fc934d44640 1 --2- 172.21.15.79:0/3014165165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557608d7f1a0 0x557608d8f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:29.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.702+0000 7fc935545640 1 -- 172.21.15.79:0/3014165165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557608d8f540 msgr2=0x557608d91930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:29.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.702+0000 7fc935545640 1 --2- 172.21.15.79:0/3014165165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557608d8f540 0x557608d91930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:29.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.702+0000 7fc935545640 1 -- 172.21.15.79:0/3014165165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557608d7f1a0 msgr2=0x557608d8f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:29.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.702+0000 7fc935545640 1 --2- 172.21.15.79:0/3014165165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557608d7f1a0 0x557608d8f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:29.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.702+0000 7fc935545640 1 -- 172.21.15.79:0/3014165165 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557608a44650 con 0x557608d7e880 2024-08-20T01:38:29.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.702+0000 7fc934d44640 1 --2- 172.21.15.79:0/3014165165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557608d7f1a0 0x557608d8f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:38:29.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.702+0000 7fc92dffb640 1 --2- 172.21.15.79:0/1089138353 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc9200b3bd0 0x7fc9200b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:29.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.702+0000 7fc935545640 1 --2- 172.21.15.79:0/3014165165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557608d7e880 0x557608d7ec60 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fc928009f60 tx=0x7fc928009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49557b2df0bf771e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:29.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.702+0000 7fc92dffb640 1 -- 172.21.15.79:0/1089138353 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc91c104800 con 0x7fc9301073c0 2024-08-20T01:38:29.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.702+0000 7fc91affd640 1 -- 172.21.15.79:0/3014165165 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92801a070 con 0x557608d7e880 2024-08-20T01:38:29.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.702+0000 7fc934d44640 1 --2- 172.21.15.79:0/1089138353 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc9200b3bd0 0x7fc9200b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:29.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.702+0000 7fc91affd640 1 -- 172.21.15.79:0/3014165165 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc9280158a0 con 0x557608d7e880 2024-08-20T01:38:29.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.703+0000 7fc91affd640 1 -- 172.21.15.79:0/3014165165 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92800a750 con 0x557608d7e880 2024-08-20T01:38:29.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.703+0000 7fc9393a1740 1 -- 172.21.15.79:0/3014165165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557608d7e880 msgr2=0x557608d7ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:29.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.703+0000 7fc934d44640 1 --2- 172.21.15.79:0/1089138353 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc9200b3bd0 0x7fc9200b6090 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x557608d82ac0 tx=0x7fc924008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:29.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.703+0000 7fc9393a1740 1 --2- 172.21.15.79:0/3014165165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557608d7e880 0x557608d7ec60 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fc928009f60 tx=0x7fc928009f90 comp rx=0 tx=0).stop 2024-08-20T01:38:29.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.704+0000 7fc9393a1740 1 -- 172.21.15.79:0/3014165165 shutdown_connections 2024-08-20T01:38:29.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.704+0000 7fc9393a1740 1 --2- 172.21.15.79:0/3014165165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557608d8f540 0x557608d91930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:29.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.704+0000 7fc9393a1740 1 --2- 172.21.15.79:0/3014165165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557608d7f1a0 0x557608d8f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:29.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.704+0000 7fc9393a1740 1 --2- 172.21.15.79:0/3014165165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557608d7e880 0x557608d7ec60 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:29.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.704+0000 7fc9393a1740 1 -- 172.21.15.79:0/3014165165 >> 172.21.15.79:0/3014165165 conn(0x557608d7c6b0 msgr2=0x557608d7d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:29.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.704+0000 7fc9393a1740 1 -- 172.21.15.79:0/3014165165 shutdown_connections 2024-08-20T01:38:29.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.704+0000 7fc9393a1740 1 -- 172.21.15.79:0/3014165165 wait complete. 2024-08-20T01:38:29.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.704+0000 7fc9393a1740 1 -- start start 2024-08-20T01:38:29.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.704+0000 7fc9393a1740 1 Processor -- start 2024-08-20T01:38:29.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.705+0000 7fc9393a1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557608d7e880 0x557608d8c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:29.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.705+0000 7fc9393a1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557608d7f1a0 0x557608d8cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:29.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.705+0000 7fc9393a1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557608d8f540 0x557608d8d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:29.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.705+0000 7fc9393a1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557608b47700 con 0x557608d7f1a0 2024-08-20T01:38:29.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.705+0000 7fc9393a1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557608c6b810 con 0x557608d7e880 2024-08-20T01:38:29.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.705+0000 7fc9393a1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557608d921f0 con 0x557608d8f540 2024-08-20T01:38:29.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.705+0000 7fc9393a1740 10 client.0 _ll_register_callbacks cb 0x557608cde700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:29.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.705+0000 7fc92ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557608d7f1a0 0x557608d8cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:29.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.705+0000 7fc92ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557608d7f1a0 0x557608d8cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36844/0 (socket says 172.21.15.79:36844) 2024-08-20T01:38:29.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.705+0000 7fc92ffff640 1 -- 172.21.15.79:0/2823491441 learned_addr learned my addr 172.21.15.79:0/2823491441 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:29.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.705+0000 7fc934d44640 1 --2- 172.21.15.79:0/2823491441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557608d7e880 0x557608d8c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:29.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.705+0000 7fc935545640 1 --2- 172.21.15.79:0/2823491441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557608d8f540 0x557608d8d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:29.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.705+0000 7fc92ffff640 1 -- 172.21.15.79:0/2823491441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557608d8f540 msgr2=0x557608d8d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:29.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.705+0000 7fc92ffff640 1 --2- 172.21.15.79:0/2823491441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557608d8f540 0x557608d8d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:29.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.705+0000 7fc92ffff640 1 -- 172.21.15.79:0/2823491441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557608d7e880 msgr2=0x557608d8c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:29.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.705+0000 7fc92ffff640 1 --2- 172.21.15.79:0/2823491441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557608d7e880 0x557608d8c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:29.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.705+0000 7fc92ffff640 1 -- 172.21.15.79:0/2823491441 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557608d9b780 con 0x557608d7f1a0 2024-08-20T01:38:29.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.705+0000 7fc934d44640 1 --2- 172.21.15.79:0/2823491441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557608d7e880 0x557608d8c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:38:29.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.705+0000 7fc92ffff640 1 --2- 172.21.15.79:0/2823491441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557608d7f1a0 0x557608d8cb60 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fc91c0c77e0 tx=0x7fc91c0cb5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ef690f6ff793b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:29.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.705+0000 7fc90ffff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:38:29.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.705+0000 7fc90ffff640 1 -- 172.21.15.79:0/2823491441 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c049070 con 0x557608d7f1a0 2024-08-20T01:38:29.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.706+0000 7fc9393a1740 1 -- 172.21.15.79:0/2823491441 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557608c94150 con 0x557608d7f1a0 2024-08-20T01:38:29.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.706+0000 7fc90ffff640 1 -- 172.21.15.79:0/2823491441 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc91c0c79f0 con 0x557608d7f1a0 2024-08-20T01:38:29.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.706+0000 7fc90ffff640 1 -- 172.21.15.79:0/2823491441 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc91c0cbe60 con 0x557608d7f1a0 2024-08-20T01:38:29.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.706+0000 7fc9393a1740 10 client.16041 fetch_fsmap learned FSMap version 30 2024-08-20T01:38:29.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.706+0000 7fc9393a1740 1 -- 172.21.15.79:0/2823491441 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557608d9e0f0 con 0x557608d7f1a0 2024-08-20T01:38:29.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.706+0000 7fc90ffff640 1 -- 172.21.15.79:0/2823491441 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x557608c94150 con 0x557608d7f1a0 2024-08-20T01:38:29.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.706+0000 7fc90ffff640 1 -- 172.21.15.79:0/2823491441 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fc91c0ee0c0 con 0x557608d7f1a0 2024-08-20T01:38:29.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.706+0000 7fc9393a1740 10 client.16041 fetch_fsmap finished waiting for FSMap version 30 2024-08-20T01:38:29.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.706+0000 7fc9393a1740 10 client.16041 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:38:29.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.706+0000 7fc9393a1740 20 client.16041 populate_metadata read hostname 'smithi079' 2024-08-20T01:38:29.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.706+0000 7fc9393a1740 1 --2- 172.21.15.79:0/2823491441 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557608d9f670 0x557608da1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:29.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.706+0000 7fc9393a1740 4 client.16041 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:38:29.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.706+0000 7fc9393a1740 1 -- 172.21.15.79:0/2823491441 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557608cf7880 con 0x557608d9f670 2024-08-20T01:38:29.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.707+0000 7fc934d44640 1 --2- 172.21.15.79:0/2823491441 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557608d9f670 0x557608da1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:29.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.707+0000 7fc934d44640 1 --2- 172.21.15.79:0/2823491441 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557608d9f670 0x557608da1ad0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac974d345040ece7 server_cookie=6c0c082b63aa5626 in_seq=0 out_seq=0 2024-08-20T01:38:29.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.707+0000 7fc90ffff640 10 client.16041 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:29.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.708+0000 7fc90ffff640 1 -- 172.21.15.79:0/2823491441 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557608cf7880 con 0x557608d9f670 2024-08-20T01:38:29.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.708+0000 7fc90ffff640 10 client.16041 handle_command_reply: tid=0 2024-08-20T01:38:29.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.708+0000 7fc9393a1740 1 client.16041 shutdown 2024-08-20T01:38:29.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.708+0000 7fc9393a1740 1 -- 172.21.15.79:0/2823491441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557608d7f1a0 msgr2=0x557608d8cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:29.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.708+0000 7fc9393a1740 1 --2- 172.21.15.79:0/2823491441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557608d7f1a0 0x557608d8cb60 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fc91c0c77e0 tx=0x7fc91c0cb5f0 comp rx=0 tx=0).stop 2024-08-20T01:38:29.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.708+0000 7fc9393a1740 1 -- 172.21.15.79:0/2823491441 shutdown_connections 2024-08-20T01:38:29.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.708+0000 7fc9393a1740 1 --2- 172.21.15.79:0/2823491441 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557608d9f670 0x557608da1ad0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:29.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.708+0000 7fc9393a1740 1 --2- 172.21.15.79:0/2823491441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557608d8f540 0x557608d8d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:29.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.708+0000 7fc9393a1740 1 --2- 172.21.15.79:0/2823491441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557608d7f1a0 0x557608d8cb60 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:29.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.708+0000 7fc9393a1740 1 --2- 172.21.15.79:0/2823491441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557608d7e880 0x557608d8c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:29.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.708+0000 7fc9393a1740 1 -- 172.21.15.79:0/2823491441 >> 172.21.15.79:0/2823491441 conn(0x557608d7c6b0 msgr2=0x557608d82220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:29.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.708+0000 7fc90ffff640 0 client.16041 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:29.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.708+0000 7fc9393a1740 1 -- 172.21.15.79:0/2823491441 shutdown_connections 2024-08-20T01:38:29.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.708+0000 7fc9393a1740 1 -- 172.21.15.79:0/2823491441 wait complete. 2024-08-20T01:38:29.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.708+0000 7fc9393a1740 20 client.16041 trim_cache size 0 max 16384 2024-08-20T01:38:29.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.723+0000 7fc9393a1740 1 Processor -- start 2024-08-20T01:38:29.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.723+0000 7fc9393a1740 1 -- start start 2024-08-20T01:38:29.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.724+0000 7fc9393a1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557608d7e880 0x557608d89fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:29.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.724+0000 7fc9393a1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557608d8f540 0x557608d7d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:29.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.724+0000 7fc9393a1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557608d7bf60 0x557608d7dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:29.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.724+0000 7fc9393a1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc9301abe00 con 0x557608d8f540 2024-08-20T01:38:29.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.724+0000 7fc9393a1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc9301ada00 con 0x557608d7bf60 2024-08-20T01:38:29.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.724+0000 7fc9393a1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc9301ac4d0 con 0x557608d7e880 2024-08-20T01:38:29.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.724+0000 7fc92ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557608d8f540 0x557608d7d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:29.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.724+0000 7fc92ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557608d8f540 0x557608d7d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36858/0 (socket says 172.21.15.79:36858) 2024-08-20T01:38:29.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.724+0000 7fc92ffff640 1 -- 172.21.15.79:0/3656061693 learned_addr learned my addr 172.21.15.79:0/3656061693 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:29.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.724+0000 7fc935545640 1 --2- 172.21.15.79:0/3656061693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557608d7bf60 0x557608d7dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:29.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.724+0000 7fc934d44640 1 --2- 172.21.15.79:0/3656061693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557608d7e880 0x557608d89fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:29.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.724+0000 7fc92ffff640 1 -- 172.21.15.79:0/3656061693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557608d7e880 msgr2=0x557608d89fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:29.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.724+0000 7fc92ffff640 1 --2- 172.21.15.79:0/3656061693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557608d7e880 0x557608d89fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:29.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.724+0000 7fc92ffff640 1 -- 172.21.15.79:0/3656061693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557608d7bf60 msgr2=0x557608d7dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:29.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.724+0000 7fc92ffff640 1 --2- 172.21.15.79:0/3656061693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557608d7bf60 0x557608d7dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:29.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.724+0000 7fc92ffff640 1 -- 172.21.15.79:0/3656061693 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557608d902d0 con 0x557608d8f540 2024-08-20T01:38:29.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.724+0000 7fc92ffff640 1 --2- 172.21.15.79:0/3656061693 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557608d8f540 0x557608d7d7e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fc91c102360 tx=0x7fc91c0cb660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aee57d25fd635f93 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:29.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.724+0000 7fc91a7fc640 1 -- 172.21.15.79:0/3656061693 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c049070 con 0x557608d8f540 2024-08-20T01:38:29.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.724+0000 7fc91a7fc640 1 -- 172.21.15.79:0/3656061693 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc91c0cfd60 con 0x557608d8f540 2024-08-20T01:38:29.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.724+0000 7fc91a7fc640 1 -- 172.21.15.79:0/3656061693 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c0ee0b0 con 0x557608d8f540 2024-08-20T01:38:29.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.725+0000 7fc9393a1740 1 -- 172.21.15.79:0/3656061693 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557608d8f540 msgr2=0x557608d7d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:29.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.725+0000 7fc9393a1740 1 --2- 172.21.15.79:0/3656061693 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557608d8f540 0x557608d7d7e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fc91c102360 tx=0x7fc91c0cb660 comp rx=0 tx=0).stop 2024-08-20T01:38:29.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.725+0000 7fc9393a1740 1 -- 172.21.15.79:0/3656061693 shutdown_connections 2024-08-20T01:38:29.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.725+0000 7fc9393a1740 1 --2- 172.21.15.79:0/3656061693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557608d7bf60 0x557608d7dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:29.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.725+0000 7fc9393a1740 1 --2- 172.21.15.79:0/3656061693 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557608d8f540 0x557608d7d7e0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:29.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.725+0000 7fc9393a1740 1 --2- 172.21.15.79:0/3656061693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557608d7e880 0x557608d89fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:29.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.725+0000 7fc9393a1740 1 -- 172.21.15.79:0/3656061693 >> 172.21.15.79:0/3656061693 conn(0x557608d7c6b0 msgr2=0x557608d907e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:29.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.725+0000 7fc9393a1740 1 -- 172.21.15.79:0/3656061693 shutdown_connections 2024-08-20T01:38:29.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.726+0000 7fc9393a1740 1 -- 172.21.15.79:0/3656061693 wait complete. 2024-08-20T01:38:29.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.726+0000 7fc9393a1740 1 -- start start 2024-08-20T01:38:29.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.727+0000 7fc9393a1740 1 Processor -- start 2024-08-20T01:38:29.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.727+0000 7fc9393a1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557608d7bf60 0x557608d976c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:29.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.727+0000 7fc9393a1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557608d7e880 0x557608d97c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:29.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.727+0000 7fc9393a1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557608d8f540 0x557608da67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:29.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.727+0000 7fc9393a1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc9301ad270 con 0x557608d7e880 2024-08-20T01:38:29.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.727+0000 7fc9393a1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc9301acba0 con 0x557608d8f540 2024-08-20T01:38:29.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.727+0000 7fc9393a1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc9301a9e00 con 0x557608d7bf60 2024-08-20T01:38:29.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.727+0000 7fc9393a1740 10 client.0 _ll_register_callbacks cb 0x7fc91c005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:29.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.727+0000 7fc92ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557608d7e880 0x557608d97c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:29.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.727+0000 7fc92ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557608d7e880 0x557608d97c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36874/0 (socket says 172.21.15.79:36874) 2024-08-20T01:38:29.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.727+0000 7fc92ffff640 1 -- 172.21.15.79:0/2132393317 learned_addr learned my addr 172.21.15.79:0/2132393317 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:29.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.727+0000 7fc935545640 1 --2- 172.21.15.79:0/2132393317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557608d8f540 0x557608da67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:29.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.727+0000 7fc934d44640 1 --2- 172.21.15.79:0/2132393317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557608d7bf60 0x557608d976c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:29.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.728+0000 7fc935545640 1 -- 172.21.15.79:0/2132393317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557608d7bf60 msgr2=0x557608d976c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:29.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.728+0000 7fc935545640 1 --2- 172.21.15.79:0/2132393317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557608d7bf60 0x557608d976c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:29.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.728+0000 7fc935545640 1 -- 172.21.15.79:0/2132393317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557608d7e880 msgr2=0x557608d97c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:29.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.728+0000 7fc935545640 1 --2- 172.21.15.79:0/2132393317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557608d7e880 0x557608d97c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:29.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.728+0000 7fc935545640 1 -- 172.21.15.79:0/2132393317 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557608da6ef0 con 0x557608d8f540 2024-08-20T01:38:29.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.728+0000 7fc92ffff640 1 --2- 172.21.15.79:0/2132393317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557608d7e880 0x557608d97c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:29.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.728+0000 7fc935545640 1 --2- 172.21.15.79:0/2132393317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557608d8f540 0x557608da67b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc928018040 tx=0x7fc928003cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=235dcfaf3a653d29 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:29.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.728+0000 7fc90ffff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:38:29.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.728+0000 7fc90ffff640 1 -- 172.21.15.79:0/2132393317 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc928025020 con 0x557608d8f540 2024-08-20T01:38:29.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.728+0000 7fc9393a1740 1 -- 172.21.15.79:0/2132393317 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557608cf3320 con 0x557608d8f540 2024-08-20T01:38:29.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.728+0000 7fc90ffff640 1 -- 172.21.15.79:0/2132393317 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc928004040 con 0x557608d8f540 2024-08-20T01:38:29.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.729+0000 7fc90ffff640 1 -- 172.21.15.79:0/2132393317 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc92801a040 con 0x557608d8f540 2024-08-20T01:38:29.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.729+0000 7fc9393a1740 10 client.25373 fetch_fsmap learned FSMap version 30 2024-08-20T01:38:29.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.729+0000 7fc9393a1740 1 -- 172.21.15.79:0/2132393317 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557608e09da0 con 0x557608d8f540 2024-08-20T01:38:29.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.729+0000 7fc90ffff640 1 -- 172.21.15.79:0/2132393317 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x557608cf3320 con 0x557608d8f540 2024-08-20T01:38:29.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.729+0000 7fc90ffff640 1 -- 172.21.15.79:0/2132393317 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fc928020600 con 0x557608d8f540 2024-08-20T01:38:29.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.729+0000 7fc9393a1740 10 client.25373 fetch_fsmap finished waiting for FSMap version 30 2024-08-20T01:38:29.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.729+0000 7fc9393a1740 10 client.25373 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:38:29.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.729+0000 7fc9393a1740 20 client.25373 populate_metadata read hostname 'smithi079' 2024-08-20T01:38:29.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.729+0000 7fc9393a1740 1 --2- 172.21.15.79:0/2132393317 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557608e0a1c0 0x557608e0c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:29.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.729+0000 7fc9393a1740 4 client.25373 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:38:29.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.729+0000 7fc9393a1740 1 -- 172.21.15.79:0/2132393317 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557608cf0a60 con 0x557608e0a1c0 2024-08-20T01:38:29.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.729+0000 7fc934d44640 1 --2- 172.21.15.79:0/2132393317 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557608e0a1c0 0x557608e0c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:29.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.730+0000 7fc934d44640 1 --2- 172.21.15.79:0/2132393317 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557608e0a1c0 0x557608e0c5e0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d113c8190f20092d server_cookie=fa53652f88e66123 in_seq=0 out_seq=0 2024-08-20T01:38:29.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.730+0000 7fc90ffff640 10 client.25373 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:29.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.730+0000 7fc90ffff640 1 -- 172.21.15.79:0/2132393317 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557608cf0a60 con 0x557608e0a1c0 2024-08-20T01:38:29.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.730+0000 7fc90ffff640 10 client.25373 handle_command_reply: tid=0 2024-08-20T01:38:29.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.730+0000 7fc9393a1740 1 client.25373 shutdown 2024-08-20T01:38:29.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.730+0000 7fc9393a1740 1 -- 172.21.15.79:0/2132393317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557608d8f540 msgr2=0x557608da67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:29.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.730+0000 7fc9393a1740 1 --2- 172.21.15.79:0/2132393317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557608d8f540 0x557608da67b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc928018040 tx=0x7fc928003cb0 comp rx=0 tx=0).stop 2024-08-20T01:38:29.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.730+0000 7fc9393a1740 1 -- 172.21.15.79:0/2132393317 shutdown_connections 2024-08-20T01:38:29.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.730+0000 7fc9393a1740 1 --2- 172.21.15.79:0/2132393317 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557608e0a1c0 0x557608e0c5e0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:29.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.730+0000 7fc9393a1740 1 --2- 172.21.15.79:0/2132393317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557608d8f540 0x557608da67b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:29.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.730+0000 7fc9393a1740 1 --2- 172.21.15.79:0/2132393317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557608d7e880 0x557608d97c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:29.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.730+0000 7fc90ffff640 0 client.25373 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:29.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.730+0000 7fc9393a1740 1 --2- 172.21.15.79:0/2132393317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557608d7bf60 0x557608d976c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:29.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.730+0000 7fc9393a1740 1 -- 172.21.15.79:0/2132393317 >> 172.21.15.79:0/2132393317 conn(0x557608d7c6b0 msgr2=0x557608d7d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:29.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.731+0000 7fc9393a1740 1 -- 172.21.15.79:0/2132393317 shutdown_connections 2024-08-20T01:38:29.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.731+0000 7fc9393a1740 1 -- 172.21.15.79:0/2132393317 wait complete. 2024-08-20T01:38:29.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.731+0000 7fc9393a1740 20 client.25373 trim_cache size 0 max 16384 2024-08-20T01:38:29.750 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:38:29.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.731+0000 7fc936fa8640 1 -- 172.21.15.79:0/1089138353 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc9200b3bd0 msgr2=0x7fc9200b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:29.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.731+0000 7fc936fa8640 1 --2- 172.21.15.79:0/1089138353 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc9200b3bd0 0x7fc9200b6090 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x557608d82ac0 tx=0x7fc924008040 comp rx=0 tx=0).stop 2024-08-20T01:38:29.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.731+0000 7fc936fa8640 1 -- 172.21.15.79:0/1089138353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9301073c0 msgr2=0x7fc930199570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:29.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.731+0000 7fc936fa8640 1 --2- 172.21.15.79:0/1089138353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9301073c0 0x7fc930199570 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fc91c006010 tx=0x7fc91c0042f0 comp rx=0 tx=0).stop 2024-08-20T01:38:29.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.732+0000 7fc936fa8640 1 -- 172.21.15.79:0/1089138353 shutdown_connections 2024-08-20T01:38:29.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.732+0000 7fc936fa8640 1 --2- 172.21.15.79:0/1089138353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc930107d40 0x7fc93019e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:29.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.732+0000 7fc936fa8640 1 --2- 172.21.15.79:0/1089138353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9301073c0 0x7fc930199570 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:29.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.732+0000 7fc936fa8640 1 --2- 172.21.15.79:0/1089138353 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc9200b3bd0 0x7fc9200b6090 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:29.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.732+0000 7fc936fa8640 1 --2- 172.21.15.79:0/1089138353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9301019b0 0x7fc930199030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:29.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.732+0000 7fc936fa8640 1 -- 172.21.15.79:0/1089138353 >> 172.21.15.79:0/1089138353 conn(0x7fc9300fd420 msgr2=0x7fc93006b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:29.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.732+0000 7fc936fa8640 1 -- 172.21.15.79:0/1089138353 shutdown_connections 2024-08-20T01:38:29.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:29.732+0000 7fc936fa8640 1 -- 172.21.15.79:0/1089138353 wait complete. 2024-08-20T01:38:30.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:30 smithi079 ceph-mon[18656]: pgmap v382: 97 pgs: 97 active+clean; 590 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 29 MiB/s wr, 60 op/s 2024-08-20T01:38:30.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:30 smithi081 ceph-mon[22209]: pgmap v382: 97 pgs: 97 active+clean; 590 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 29 MiB/s wr, 60 op/s 2024-08-20T01:38:30.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:30 smithi175 ceph-mon[22392]: pgmap v382: 97 pgs: 97 active+clean; 590 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 29 MiB/s wr, 60 op/s 2024-08-20T01:38:30.944 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.940+0000 7f752fdfa640 1 -- 172.21.15.79:0/479571032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7528101560 msgr2=0x7f7528101960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:30.944 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.940+0000 7f752fdfa640 1 --2- 172.21.15.79:0/479571032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7528101560 0x7f7528101960 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7524009930 tx=0x7f752402a420 comp rx=0 tx=0).stop 2024-08-20T01:38:30.944 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.940+0000 7f752fdfa640 1 -- 172.21.15.79:0/479571032 shutdown_connections 2024-08-20T01:38:30.944 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.940+0000 7f752fdfa640 1 --2- 172.21.15.79:0/479571032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7528103070 0x7f75281099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:30.944 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.940+0000 7f752fdfa640 1 --2- 172.21.15.79:0/479571032 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75281026b0 0x7f7528102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:30.944 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.940+0000 7f752fdfa640 1 --2- 172.21.15.79:0/479571032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7528101560 0x7f7528101960 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:30.944 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.940+0000 7f752fdfa640 1 -- 172.21.15.79:0/479571032 >> 172.21.15.79:0/479571032 conn(0x7f75280fce40 msgr2=0x7f75280ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:30.944 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.940+0000 7f752fdfa640 1 -- 172.21.15.79:0/479571032 shutdown_connections 2024-08-20T01:38:30.944 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.940+0000 7f752fdfa640 1 -- 172.21.15.79:0/479571032 wait complete. 2024-08-20T01:38:30.944 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.940+0000 7f752fdfa640 1 Processor -- start 2024-08-20T01:38:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.940+0000 7f752fdfa640 1 -- start start 2024-08-20T01:38:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.941+0000 7f752fdfa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7528101560 0x7f75281988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.941+0000 7f752fdfa640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75281026b0 0x7f7528198f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.941+0000 7f752fdfa640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7528103070 0x7f7528199b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.941+0000 7f752fdfa640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f752810d0b0 con 0x7f75281026b0 2024-08-20T01:38:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.941+0000 7f752fdfa640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f752810cf30 con 0x7f7528101560 2024-08-20T01:38:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.941+0000 7f752fdfa640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f752810d230 con 0x7f7528103070 2024-08-20T01:38:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.941+0000 7f752d395640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75281026b0 0x7f7528198f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.941+0000 7f752d395640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75281026b0 0x7f7528198f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42882/0 (socket says 172.21.15.79:42882) 2024-08-20T01:38:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.941+0000 7f752d395640 1 -- 172.21.15.79:0/3518767814 learned_addr learned my addr 172.21.15.79:0/3518767814 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.941+0000 7f752db96640 1 --2- 172.21.15.79:0/3518767814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7528101560 0x7f75281988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.941+0000 7f752e397640 1 --2- 172.21.15.79:0/3518767814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7528103070 0x7f7528199b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.941+0000 7f752d395640 1 -- 172.21.15.79:0/3518767814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7528103070 msgr2=0x7f7528199b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:30.946 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.941+0000 7f752d395640 1 --2- 172.21.15.79:0/3518767814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7528103070 0x7f7528199b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:30.946 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.941+0000 7f752d395640 1 -- 172.21.15.79:0/3518767814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7528101560 msgr2=0x7f75281988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:30.946 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.941+0000 7f752d395640 1 --2- 172.21.15.79:0/3518767814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7528101560 0x7f75281988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:30.946 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.941+0000 7f752d395640 1 -- 172.21.15.79:0/3518767814 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f752819a410 con 0x7f75281026b0 2024-08-20T01:38:30.946 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.941+0000 7f752e397640 1 --2- 172.21.15.79:0/3518767814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7528103070 0x7f7528199b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:38:30.946 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.941+0000 7f752d395640 1 --2- 172.21.15.79:0/3518767814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75281026b0 0x7f7528198f20 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f751800c920 tx=0x7f751800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:30.946 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.941+0000 7f751effd640 1 -- 172.21.15.79:0/3518767814 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7518007c70 con 0x7f75281026b0 2024-08-20T01:38:30.946 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.941+0000 7f751effd640 1 -- 172.21.15.79:0/3518767814 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7518007e10 con 0x7f75281026b0 2024-08-20T01:38:30.946 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.941+0000 7f752fdfa640 1 -- 172.21.15.79:0/3518767814 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f752819a700 con 0x7f75281026b0 2024-08-20T01:38:30.946 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.941+0000 7f751effd640 1 -- 172.21.15.79:0/3518767814 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7518018710 con 0x7f75281026b0 2024-08-20T01:38:30.946 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.942+0000 7f752fdfa640 1 -- 172.21.15.79:0/3518767814 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75281a0dd0 con 0x7f75281026b0 2024-08-20T01:38:30.952 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.944+0000 7f7532be2740 1 Processor -- start 2024-08-20T01:38:30.952 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.944+0000 7f7532be2740 1 -- start start 2024-08-20T01:38:30.952 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.945+0000 7f7532be2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5a6cace0 0x560e5a6cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:30.952 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.945+0000 7f7532be2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e5a6cd610 0x560e5a6cfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:30.952 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.945+0000 7f7532be2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e5a6d0050 0x560e5a6d2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:30.952 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.945+0000 7f7532be2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560e5a639360 con 0x560e5a6d0050 2024-08-20T01:38:30.952 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.945+0000 7f7532be2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560e5a628860 con 0x560e5a6cd610 2024-08-20T01:38:30.952 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.945+0000 7f7532be2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560e5a62c8a0 con 0x560e5a6cace0 2024-08-20T01:38:30.952 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.945+0000 7f751effd640 1 -- 172.21.15.79:0/3518767814 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f751800f450 con 0x7f75281026b0 2024-08-20T01:38:30.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.945+0000 7f752d395640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e5a6d0050 0x560e5a6d2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:30.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.945+0000 7f752db96640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e5a6cd610 0x560e5a6cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:30.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.945+0000 7f752d395640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e5a6d0050 0x560e5a6d2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42884/0 (socket says 172.21.15.79:42884) 2024-08-20T01:38:30.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.945+0000 7f752d395640 1 -- 172.21.15.79:0/1402493535 learned_addr learned my addr 172.21.15.79:0/1402493535 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:30.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.945+0000 7f752e397640 1 --2- 172.21.15.79:0/1402493535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5a6cace0 0x560e5a6cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:30.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.945+0000 7f752d395640 1 -- 172.21.15.79:0/1402493535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5a6cace0 msgr2=0x560e5a6cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:30.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.945+0000 7f752d395640 1 --2- 172.21.15.79:0/1402493535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5a6cace0 0x560e5a6cd0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:30.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.945+0000 7f752d395640 1 -- 172.21.15.79:0/1402493535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e5a6cd610 msgr2=0x560e5a6cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:30.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.945+0000 7f752d395640 1 --2- 172.21.15.79:0/1402493535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e5a6cd610 0x560e5a6cfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:30.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.945+0000 7f752d395640 1 -- 172.21.15.79:0/1402493535 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e5a5cfe40 con 0x560e5a6d0050 2024-08-20T01:38:30.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.945+0000 7f752db96640 1 --2- 172.21.15.79:0/1402493535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e5a6cd610 0x560e5a6cfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:30.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.946+0000 7f752d395640 1 --2- 172.21.15.79:0/1402493535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e5a6d0050 0x560e5a6d2510 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f75180e7eb0 tx=0x7f75180ec410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a363d03e4e6ca0b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:30.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.946+0000 7f751effd640 1 --2- 172.21.15.79:0/3518767814 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f75140b3c50 0x7f75140b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:30.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.946+0000 7f7513fff640 1 -- 172.21.15.79:0/1402493535 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75180f5440 con 0x560e5a6d0050 2024-08-20T01:38:30.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.946+0000 7f7513fff640 1 -- 172.21.15.79:0/1402493535 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f75180aa780 con 0x560e5a6d0050 2024-08-20T01:38:30.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.946+0000 7f7513fff640 1 -- 172.21.15.79:0/1402493535 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75180aa3e0 con 0x560e5a6d0050 2024-08-20T01:38:30.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.946+0000 7f752e397640 1 --2- 172.21.15.79:0/3518767814 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f75140b3c50 0x7f75140b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:30.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.946+0000 7f751effd640 1 -- 172.21.15.79:0/3518767814 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f75180e3d10 con 0x7f75281026b0 2024-08-20T01:38:30.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.947+0000 7f7532be2740 1 -- 172.21.15.79:0/1402493535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e5a6d0050 msgr2=0x560e5a6d2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:30.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.947+0000 7f7532be2740 1 --2- 172.21.15.79:0/1402493535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e5a6d0050 0x560e5a6d2510 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f75180e7eb0 tx=0x7f75180ec410 comp rx=0 tx=0).stop 2024-08-20T01:38:30.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.947+0000 7f752e397640 1 --2- 172.21.15.79:0/3518767814 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f75140b3c50 0x7f75140b6110 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7528199650 tx=0x7f7520007720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:30.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.947+0000 7f7532be2740 1 -- 172.21.15.79:0/1402493535 shutdown_connections 2024-08-20T01:38:30.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.947+0000 7f7532be2740 1 --2- 172.21.15.79:0/1402493535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e5a6d0050 0x560e5a6d2510 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:30.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.947+0000 7f7532be2740 1 --2- 172.21.15.79:0/1402493535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e5a6cd610 0x560e5a6cfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.947+0000 7f7532be2740 1 --2- 172.21.15.79:0/1402493535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5a6cace0 0x560e5a6cd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.947+0000 7f7532be2740 1 -- 172.21.15.79:0/1402493535 >> 172.21.15.79:0/1402493535 conn(0x560e5a6c1a20 msgr2=0x560e5a6c27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.947+0000 7f7532be2740 1 -- 172.21.15.79:0/1402493535 shutdown_connections 2024-08-20T01:38:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.947+0000 7f7532be2740 1 -- 172.21.15.79:0/1402493535 wait complete. 2024-08-20T01:38:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.947+0000 7f7532be2740 1 -- start start 2024-08-20T01:38:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.947+0000 7f7532be2740 1 Processor -- start 2024-08-20T01:38:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.948+0000 7f7532be2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5a6cace0 0x560e5a6d4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.948+0000 7f7532be2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e5a6cd610 0x560e5a6d4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.948+0000 7f7532be2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e5a6d0050 0x560e5a6d56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.948+0000 7f7532be2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560e5a561ab0 con 0x560e5a6d0050 2024-08-20T01:38:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.948+0000 7f7532be2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560e5a5af780 con 0x560e5a6cd610 2024-08-20T01:38:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.948+0000 7f7532be2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560e5a6d3030 con 0x560e5a6cace0 2024-08-20T01:38:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.948+0000 7f7532be2740 10 client.0 _ll_register_callbacks cb 0x560e5a337a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.948+0000 7f752e397640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e5a6d0050 0x560e5a6d56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.948+0000 7f752e397640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e5a6d0050 0x560e5a6d56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42888/0 (socket says 172.21.15.79:42888) 2024-08-20T01:38:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.948+0000 7f752e397640 1 -- 172.21.15.79:0/861155556 learned_addr learned my addr 172.21.15.79:0/861155556 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.948+0000 7f752d395640 1 --2- 172.21.15.79:0/861155556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e5a6cd610 0x560e5a6d4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.948+0000 7f752db96640 1 --2- 172.21.15.79:0/861155556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5a6cace0 0x560e5a6d4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.948+0000 7f752e397640 1 -- 172.21.15.79:0/861155556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5a6cace0 msgr2=0x560e5a6d4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.948+0000 7f752e397640 1 --2- 172.21.15.79:0/861155556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5a6cace0 0x560e5a6d4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.948+0000 7f752e397640 1 -- 172.21.15.79:0/861155556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e5a6cd610 msgr2=0x560e5a6d4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.948+0000 7f752e397640 1 --2- 172.21.15.79:0/861155556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e5a6cd610 0x560e5a6d4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.948+0000 7f752e397640 1 -- 172.21.15.79:0/861155556 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e5a38b790 con 0x560e5a6d0050 2024-08-20T01:38:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.948+0000 7f752d395640 1 --2- 172.21.15.79:0/861155556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e5a6cd610 0x560e5a6d4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:38:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.948+0000 7f752e397640 1 --2- 172.21.15.79:0/861155556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e5a6d0050 0x560e5a6d56f0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f752000fe50 tx=0x7f7520004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aa96b33a6d55881 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.948+0000 7f75117fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:38:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.949+0000 7f75117fa640 1 -- 172.21.15.79:0/861155556 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7520029060 con 0x560e5a6d0050 2024-08-20T01:38:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.949+0000 7f75117fa640 1 -- 172.21.15.79:0/861155556 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f752001a670 con 0x560e5a6d0050 2024-08-20T01:38:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.949+0000 7f7532be2740 1 -- 172.21.15.79:0/861155556 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560e5a5d7e00 con 0x560e5a6d0050 2024-08-20T01:38:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.949+0000 7f75117fa640 1 -- 172.21.15.79:0/861155556 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f752001ce10 con 0x560e5a6d0050 2024-08-20T01:38:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.949+0000 7f7532be2740 10 client.16059 fetch_fsmap learned FSMap version 30 2024-08-20T01:38:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.949+0000 7f7532be2740 1 -- 172.21.15.79:0/861155556 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560e5a404620 con 0x560e5a6d0050 2024-08-20T01:38:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.949+0000 7f75117fa640 1 -- 172.21.15.79:0/861155556 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x560e5a5d7e00 con 0x560e5a6d0050 2024-08-20T01:38:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.949+0000 7f75117fa640 1 -- 172.21.15.79:0/861155556 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f7520018040 con 0x560e5a6d0050 2024-08-20T01:38:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.949+0000 7f7532be2740 10 client.16059 fetch_fsmap finished waiting for FSMap version 30 2024-08-20T01:38:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.949+0000 7f7532be2740 10 client.16059 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:38:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.949+0000 7f7532be2740 20 client.16059 populate_metadata read hostname 'smithi079' 2024-08-20T01:38:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.949+0000 7f7532be2740 1 --2- 172.21.15.79:0/861155556 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560e5a6dfeb0 0x560e5a6e22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.949+0000 7f7532be2740 4 client.16059 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:38:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.949+0000 7f7532be2740 1 -- 172.21.15.79:0/861155556 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e5a63b2b0 con 0x560e5a6dfeb0 2024-08-20T01:38:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.950+0000 7f752db96640 1 --2- 172.21.15.79:0/861155556 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560e5a6dfeb0 0x560e5a6e22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.950+0000 7f752db96640 1 --2- 172.21.15.79:0/861155556 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560e5a6dfeb0 0x560e5a6e22f0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95feabf6ad9f7fcd server_cookie=6eb927164087482d in_seq=0 out_seq=0 2024-08-20T01:38:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.950+0000 7f75117fa640 10 client.16059 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:30.959 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.951+0000 7f75117fa640 1 -- 172.21.15.79:0/861155556 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560e5a63b2b0 con 0x560e5a6dfeb0 2024-08-20T01:38:30.959 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.951+0000 7f75117fa640 10 client.16059 handle_command_reply: tid=0 2024-08-20T01:38:30.959 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.951+0000 7f7532be2740 1 client.16059 shutdown 2024-08-20T01:38:30.959 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.951+0000 7f7532be2740 1 -- 172.21.15.79:0/861155556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e5a6d0050 msgr2=0x560e5a6d56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.951+0000 7f7532be2740 1 --2- 172.21.15.79:0/861155556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e5a6d0050 0x560e5a6d56f0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f752000fe50 tx=0x7f7520004a40 comp rx=0 tx=0).stop 2024-08-20T01:38:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.951+0000 7f7532be2740 1 -- 172.21.15.79:0/861155556 shutdown_connections 2024-08-20T01:38:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.951+0000 7f7532be2740 1 --2- 172.21.15.79:0/861155556 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560e5a6dfeb0 0x560e5a6e22f0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.951+0000 7f7532be2740 1 --2- 172.21.15.79:0/861155556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e5a6d0050 0x560e5a6d56f0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.951+0000 7f7532be2740 1 --2- 172.21.15.79:0/861155556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e5a6cd610 0x560e5a6d4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.951+0000 7f75117fa640 0 client.16059 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.951+0000 7f7532be2740 1 --2- 172.21.15.79:0/861155556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5a6cace0 0x560e5a6d4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.951+0000 7f7532be2740 1 -- 172.21.15.79:0/861155556 >> 172.21.15.79:0/861155556 conn(0x560e5a6c1a20 msgr2=0x560e5a6c0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.951+0000 7f7532be2740 1 -- 172.21.15.79:0/861155556 shutdown_connections 2024-08-20T01:38:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.951+0000 7f7532be2740 1 -- 172.21.15.79:0/861155556 wait complete. 2024-08-20T01:38:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.951+0000 7f7532be2740 20 client.16059 trim_cache size 0 max 16384 2024-08-20T01:38:30.968 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.965+0000 7f7532be2740 1 Processor -- start 2024-08-20T01:38:30.968 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.965+0000 7f7532be2740 1 -- start start 2024-08-20T01:38:30.968 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.965+0000 7f7532be2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5a6cace0 0x560e5a6d0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:30.968 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.965+0000 7f7532be2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e5a6cd610 0x560e5a6d0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:30.968 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.965+0000 7f7532be2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e5a6d0050 0x560e5a6d0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:30.969 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.965+0000 7f7532be2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f75281a77a0 con 0x560e5a6cd610 2024-08-20T01:38:30.969 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.965+0000 7f7532be2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f75281a93a0 con 0x560e5a6d0050 2024-08-20T01:38:30.969 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.965+0000 7f7532be2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f75281a7e70 con 0x560e5a6cace0 2024-08-20T01:38:30.969 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.966+0000 7f752d395640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e5a6cd610 0x560e5a6d0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:30.969 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.966+0000 7f752e397640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e5a6d0050 0x560e5a6d0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:30.969 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.966+0000 7f752d395640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e5a6cd610 0x560e5a6d0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42900/0 (socket says 172.21.15.79:42900) 2024-08-20T01:38:30.969 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.966+0000 7f752d395640 1 -- 172.21.15.79:0/1708043553 learned_addr learned my addr 172.21.15.79:0/1708043553 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:30.969 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.966+0000 7f752e397640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e5a6d0050 0x560e5a6d0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:35928/0 (socket says 172.21.15.79:35928) 2024-08-20T01:38:30.969 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.966+0000 7f752db96640 1 --2- 172.21.15.79:0/1708043553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5a6cace0 0x560e5a6d0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:30.969 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.966+0000 7f752d395640 1 -- 172.21.15.79:0/1708043553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5a6cace0 msgr2=0x560e5a6d0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:30.969 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.966+0000 7f752d395640 1 --2- 172.21.15.79:0/1708043553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5a6cace0 0x560e5a6d0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:30.969 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.966+0000 7f752d395640 1 -- 172.21.15.79:0/1708043553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e5a6d0050 msgr2=0x560e5a6d0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.966+0000 7f752d395640 1 --2- 172.21.15.79:0/1708043553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e5a6d0050 0x560e5a6d0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.966+0000 7f752d395640 1 -- 172.21.15.79:0/1708043553 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e5a6d4e90 con 0x560e5a6cd610 2024-08-20T01:38:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.966+0000 7f752e397640 1 --2- 172.21.15.79:0/1708043553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e5a6d0050 0x560e5a6d0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.966+0000 7f752d395640 1 --2- 172.21.15.79:0/1708043553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e5a6cd610 0x560e5a6d0970 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f75180e1870 tx=0x7f7518000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a546d4d38564765c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.966+0000 7f75137fe640 1 -- 172.21.15.79:0/1708043553 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7518075400 con 0x560e5a6cd610 2024-08-20T01:38:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.966+0000 7f75137fe640 1 -- 172.21.15.79:0/1708043553 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f75180725c0 con 0x560e5a6cd610 2024-08-20T01:38:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.966+0000 7f75137fe640 1 -- 172.21.15.79:0/1708043553 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75180755f0 con 0x560e5a6cd610 2024-08-20T01:38:30.974 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.967+0000 7f7532be2740 1 -- 172.21.15.79:0/1708043553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e5a6cd610 msgr2=0x560e5a6d0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:30.974 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.967+0000 7f7532be2740 1 --2- 172.21.15.79:0/1708043553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e5a6cd610 0x560e5a6d0970 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f75180e1870 tx=0x7f7518000bc0 comp rx=0 tx=0).stop 2024-08-20T01:38:30.974 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.967+0000 7f7532be2740 1 -- 172.21.15.79:0/1708043553 shutdown_connections 2024-08-20T01:38:30.974 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.967+0000 7f7532be2740 1 --2- 172.21.15.79:0/1708043553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e5a6d0050 0x560e5a6d0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:30.974 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.967+0000 7f7532be2740 1 --2- 172.21.15.79:0/1708043553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e5a6cd610 0x560e5a6d0970 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:30.974 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.967+0000 7f7532be2740 1 --2- 172.21.15.79:0/1708043553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5a6cace0 0x560e5a6d0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:30.974 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.967+0000 7f7532be2740 1 -- 172.21.15.79:0/1708043553 >> 172.21.15.79:0/1708043553 conn(0x560e5a6c1a20 msgr2=0x560e5a6d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:30.975 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.967+0000 7f7532be2740 1 -- 172.21.15.79:0/1708043553 shutdown_connections 2024-08-20T01:38:30.975 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.967+0000 7f7532be2740 1 -- 172.21.15.79:0/1708043553 wait complete. 2024-08-20T01:38:30.975 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.967+0000 7f7532be2740 1 -- start start 2024-08-20T01:38:30.975 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.968+0000 7f7532be2740 1 Processor -- start 2024-08-20T01:38:30.975 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.968+0000 7f7532be2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e5a6cace0 0x560e5a6dbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:30.975 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.968+0000 7f7532be2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5a6cd610 0x560e5a6da910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:30.975 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.968+0000 7f7532be2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e5a6d0050 0x560e5a6dae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:30.975 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.968+0000 7f7532be2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f75281a8c10 con 0x560e5a6d0050 2024-08-20T01:38:30.975 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.968+0000 7f7532be2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f75281a8540 con 0x560e5a6cace0 2024-08-20T01:38:30.975 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.968+0000 7f7532be2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f75281a5780 con 0x560e5a6cd610 2024-08-20T01:38:30.975 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.968+0000 7f7532be2740 10 client.0 _ll_register_callbacks cb 0x7f7520011f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:30.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.968+0000 7f752e397640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e5a6d0050 0x560e5a6dae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:30.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.968+0000 7f752e397640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e5a6d0050 0x560e5a6dae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42916/0 (socket says 172.21.15.79:42916) 2024-08-20T01:38:30.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.968+0000 7f752e397640 1 -- 172.21.15.79:0/3552114870 learned_addr learned my addr 172.21.15.79:0/3552114870 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:30.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.968+0000 7f752db96640 1 --2- 172.21.15.79:0/3552114870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e5a6cace0 0x560e5a6dbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:30.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.968+0000 7f752d395640 1 --2- 172.21.15.79:0/3552114870 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5a6cd610 0x560e5a6da910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:30.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.968+0000 7f752e397640 1 -- 172.21.15.79:0/3552114870 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5a6cd610 msgr2=0x560e5a6da910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:30.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.968+0000 7f752e397640 1 --2- 172.21.15.79:0/3552114870 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5a6cd610 0x560e5a6da910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:30.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.968+0000 7f752e397640 1 -- 172.21.15.79:0/3552114870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e5a6cace0 msgr2=0x560e5a6dbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:30.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.968+0000 7f752e397640 1 --2- 172.21.15.79:0/3552114870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e5a6cace0 0x560e5a6dbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:30.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.968+0000 7f752e397640 1 -- 172.21.15.79:0/3552114870 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e5a6cd440 con 0x560e5a6d0050 2024-08-20T01:38:30.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.968+0000 7f752d395640 1 --2- 172.21.15.79:0/3552114870 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5a6cd610 0x560e5a6da910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:38:30.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.968+0000 7f752db96640 1 --2- 172.21.15.79:0/3552114870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e5a6cace0 0x560e5a6dbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:38:30.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.969+0000 7f752e397640 1 --2- 172.21.15.79:0/3552114870 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e5a6d0050 0x560e5a6dae50 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f7520011d40 tx=0x7f7520024e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e2e112fec1d3a8b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:30.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.969+0000 7f75117fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:38:30.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.969+0000 7f75117fa640 1 -- 172.21.15.79:0/3552114870 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752003d060 con 0x560e5a6d0050 2024-08-20T01:38:30.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.969+0000 7f75117fa640 1 -- 172.21.15.79:0/3552114870 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f7520004ab0 con 0x560e5a6d0050 2024-08-20T01:38:30.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.969+0000 7f7532be2740 1 -- 172.21.15.79:0/3552114870 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560e5a636d50 con 0x560e5a6d0050 2024-08-20T01:38:30.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.969+0000 7f75117fa640 1 -- 172.21.15.79:0/3552114870 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7520034070 con 0x560e5a6d0050 2024-08-20T01:38:30.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.969+0000 7f7532be2740 10 client.16065 fetch_fsmap learned FSMap version 30 2024-08-20T01:38:30.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.969+0000 7f7532be2740 1 -- 172.21.15.79:0/3552114870 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560e5a6d9f90 con 0x560e5a6d0050 2024-08-20T01:38:30.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.969+0000 7f75117fa640 1 -- 172.21.15.79:0/3552114870 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x560e5a636d50 con 0x560e5a6d0050 2024-08-20T01:38:30.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.969+0000 7f75117fa640 1 -- 172.21.15.79:0/3552114870 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f7520018050 con 0x560e5a6d0050 2024-08-20T01:38:30.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.969+0000 7f7532be2740 10 client.16065 fetch_fsmap finished waiting for FSMap version 30 2024-08-20T01:38:30.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.969+0000 7f7532be2740 10 client.16065 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:38:30.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.969+0000 7f7532be2740 20 client.16065 populate_metadata read hostname 'smithi079' 2024-08-20T01:38:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.969+0000 7f7532be2740 1 --2- 172.21.15.79:0/3552114870 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560e5a74b180 0x560e5a74d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.969+0000 7f7532be2740 4 client.16065 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:38:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.969+0000 7f7532be2740 1 -- 172.21.15.79:0/3552114870 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560e5a634490 con 0x560e5a74b180 2024-08-20T01:38:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.970+0000 7f752db96640 1 --2- 172.21.15.79:0/3552114870 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560e5a74b180 0x560e5a74d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.970+0000 7f75117fa640 10 client.16065 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.970+0000 7f752db96640 1 --2- 172.21.15.79:0/3552114870 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560e5a74b180 0x560e5a74d5a0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1d3d2f30c30baf6 server_cookie=bb9890474bf118c9 in_seq=0 out_seq=0 2024-08-20T01:38:30.986 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.984+0000 7f75117fa640 1 -- 172.21.15.79:0/3552114870 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560e5a634490 con 0x560e5a74b180 2024-08-20T01:38:30.986 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.984+0000 7f75117fa640 10 client.16065 handle_command_reply: tid=0 2024-08-20T01:38:30.987 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.984+0000 7f7532be2740 1 client.16065 shutdown 2024-08-20T01:38:30.987 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.984+0000 7f7532be2740 1 -- 172.21.15.79:0/3552114870 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e5a6d0050 msgr2=0x560e5a6dae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:30.987 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.984+0000 7f7532be2740 1 --2- 172.21.15.79:0/3552114870 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e5a6d0050 0x560e5a6dae50 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f7520011d40 tx=0x7f7520024e40 comp rx=0 tx=0).stop 2024-08-20T01:38:30.987 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.984+0000 7f7532be2740 1 -- 172.21.15.79:0/3552114870 shutdown_connections 2024-08-20T01:38:30.987 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.984+0000 7f7532be2740 1 --2- 172.21.15.79:0/3552114870 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560e5a74b180 0x560e5a74d5a0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:30.987 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.984+0000 7f7532be2740 1 --2- 172.21.15.79:0/3552114870 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e5a6d0050 0x560e5a6dae50 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:30.987 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.984+0000 7f7532be2740 1 --2- 172.21.15.79:0/3552114870 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5a6cd610 0x560e5a6da910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:30.987 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.984+0000 7f7532be2740 1 --2- 172.21.15.79:0/3552114870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e5a6cace0 0x560e5a6dbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:30.987 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.984+0000 7f7532be2740 1 -- 172.21.15.79:0/3552114870 >> 172.21.15.79:0/3552114870 conn(0x560e5a6c1a20 msgr2=0x560e5a6c02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:30.987 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.984+0000 7f75117fa640 0 client.16065 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:30.987 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.984+0000 7f7532be2740 1 -- 172.21.15.79:0/3552114870 shutdown_connections 2024-08-20T01:38:30.988 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.984+0000 7f7532be2740 1 -- 172.21.15.79:0/3552114870 wait complete. 2024-08-20T01:38:30.988 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.984+0000 7f7532be2740 20 client.16065 trim_cache size 0 max 16384 2024-08-20T01:38:30.988 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:38:30.988 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:38:30.988 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:38:30.988 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:38:30.989 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.985+0000 7f752fdfa640 1 -- 172.21.15.79:0/3518767814 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f75140b3c50 msgr2=0x7f75140b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:30.989 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.985+0000 7f752fdfa640 1 --2- 172.21.15.79:0/3518767814 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f75140b3c50 0x7f75140b6110 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7528199650 tx=0x7f7520007720 comp rx=0 tx=0).stop 2024-08-20T01:38:30.989 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.985+0000 7f752fdfa640 1 -- 172.21.15.79:0/3518767814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75281026b0 msgr2=0x7f7528198f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:30.989 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.985+0000 7f752fdfa640 1 --2- 172.21.15.79:0/3518767814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75281026b0 0x7f7528198f20 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f751800c920 tx=0x7f751800cde0 comp rx=0 tx=0).stop 2024-08-20T01:38:30.989 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.985+0000 7f752fdfa640 1 -- 172.21.15.79:0/3518767814 shutdown_connections 2024-08-20T01:38:30.989 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.985+0000 7f752fdfa640 1 --2- 172.21.15.79:0/3518767814 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f75140b3c50 0x7f75140b6110 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:30.989 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.985+0000 7f752fdfa640 1 --2- 172.21.15.79:0/3518767814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7528103070 0x7f7528199b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.985+0000 7f752fdfa640 1 --2- 172.21.15.79:0/3518767814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75281026b0 0x7f7528198f20 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.985+0000 7f752fdfa640 1 --2- 172.21.15.79:0/3518767814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7528101560 0x7f75281988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.985+0000 7f752fdfa640 1 -- 172.21.15.79:0/3518767814 >> 172.21.15.79:0/3518767814 conn(0x7f75280fce40 msgr2=0x7f75280fe800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.985+0000 7f752fdfa640 1 -- 172.21.15.79:0/3518767814 shutdown_connections 2024-08-20T01:38:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:30.985+0000 7f752fdfa640 1 -- 172.21.15.79:0/3518767814 wait complete. 2024-08-20T01:38:31.401 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T01:38:31.401 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T01:38:31.701 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:38:32.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.218+0000 7f9058264640 1 -- 172.21.15.79:0/221366338 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9050107d20 msgr2=0x7f905010e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:32.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.218+0000 7f9058264640 1 --2- 172.21.15.79:0/221366338 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9050107d20 0x7f905010e520 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f9048009ca0 tx=0x7f904802a8c0 comp rx=0 tx=0).stop 2024-08-20T01:38:32.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.218+0000 7f9058264640 1 -- 172.21.15.79:0/221366338 shutdown_connections 2024-08-20T01:38:32.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.218+0000 7f9058264640 1 --2- 172.21.15.79:0/221366338 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9050107d20 0x7f905010e520 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:32.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.218+0000 7f9058264640 1 --2- 172.21.15.79:0/221366338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90501073a0 0x7f90501077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:32.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.218+0000 7f9058264640 1 --2- 172.21.15.79:0/221366338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9050101990 0x7f9050101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:32.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.219+0000 7f9058264640 1 -- 172.21.15.79:0/221366338 >> 172.21.15.79:0/221366338 conn(0x7f90500fd400 msgr2=0x7f90500ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:32.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.219+0000 7f9058264640 1 -- 172.21.15.79:0/221366338 shutdown_connections 2024-08-20T01:38:32.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.219+0000 7f9058264640 1 -- 172.21.15.79:0/221366338 wait complete. 2024-08-20T01:38:32.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.219+0000 7f9058264640 1 Processor -- start 2024-08-20T01:38:32.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.219+0000 7f9058264640 1 -- start start 2024-08-20T01:38:32.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.220+0000 7f9058264640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9050101990 0x7f9050198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:32.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.220+0000 7f9058264640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90501073a0 0x7f9050199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:32.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.220+0000 7f9058264640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9050107d20 0x7f905019e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:32.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.220+0000 7f9058264640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f90501118a0 con 0x7f9050107d20 2024-08-20T01:38:32.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.220+0000 7f9058264640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9050111720 con 0x7f90501073a0 2024-08-20T01:38:32.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.220+0000 7f9058264640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9050111a20 con 0x7f9050101990 2024-08-20T01:38:32.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.220+0000 7f9056801640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9050107d20 0x7f905019e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:32.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.220+0000 7f9056801640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9050107d20 0x7f905019e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42940/0 (socket says 172.21.15.79:42940) 2024-08-20T01:38:32.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.220+0000 7f9056801640 1 -- 172.21.15.79:0/52905685 learned_addr learned my addr 172.21.15.79:0/52905685 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:32.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.220+0000 7f90557ff640 1 --2- 172.21.15.79:0/52905685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90501073a0 0x7f9050199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:32.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.220+0000 7f9056000640 1 --2- 172.21.15.79:0/52905685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9050101990 0x7f9050198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:32.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.220+0000 7f9056801640 1 -- 172.21.15.79:0/52905685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9050101990 msgr2=0x7f9050198ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:32.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.220+0000 7f9056801640 1 --2- 172.21.15.79:0/52905685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9050101990 0x7f9050198ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:32.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.220+0000 7f9056801640 1 -- 172.21.15.79:0/52905685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90501073a0 msgr2=0x7f9050199400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:32.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.220+0000 7f9056801640 1 --2- 172.21.15.79:0/52905685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90501073a0 0x7f9050199400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:32.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.220+0000 7f9056801640 1 -- 172.21.15.79:0/52905685 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f905019ef70 con 0x7f9050107d20 2024-08-20T01:38:32.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.220+0000 7f9056801640 1 --2- 172.21.15.79:0/52905685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9050107d20 0x7f905019e7a0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f9048005cc0 tx=0x7f9048003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:32.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.221+0000 7f9046ffd640 1 -- 172.21.15.79:0/52905685 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9048032c10 con 0x7f9050107d20 2024-08-20T01:38:32.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.221+0000 7f9046ffd640 1 -- 172.21.15.79:0/52905685 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9048032db0 con 0x7f9050107d20 2024-08-20T01:38:32.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.221+0000 7f9058264640 1 -- 172.21.15.79:0/52905685 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f905019f200 con 0x7f9050107d20 2024-08-20T01:38:32.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.221+0000 7f9046ffd640 1 -- 172.21.15.79:0/52905685 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9048030a60 con 0x7f9050107d20 2024-08-20T01:38:32.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.221+0000 7f9058264640 1 -- 172.21.15.79:0/52905685 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9050104160 con 0x7f9050107d20 2024-08-20T01:38:32.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.224+0000 7f905a65d740 1 Processor -- start 2024-08-20T01:38:32.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.224+0000 7f9046ffd640 1 -- 172.21.15.79:0/52905685 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f9048030c00 con 0x7f9050107d20 2024-08-20T01:38:32.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.224+0000 7f905a65d740 1 -- start start 2024-08-20T01:38:32.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.224+0000 7f905a65d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618ea8c03b0 0x5618ea8c0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:32.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.224+0000 7f905a65d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618ea8c0cd0 0x5618ea8cc720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:32.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.224+0000 7f905a65d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ea8ccc60 0x5618ea8cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:32.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.224+0000 7f905a65d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5618ea836940 con 0x5618ea8c03b0 2024-08-20T01:38:32.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.224+0000 7f905a65d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5618ea825e40 con 0x5618ea8c0cd0 2024-08-20T01:38:32.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.224+0000 7f905a65d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5618ea829e80 con 0x5618ea8ccc60 2024-08-20T01:38:32.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.225+0000 7f9056000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618ea8c0cd0 0x5618ea8cc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:32.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.225+0000 7f90557ff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618ea8c03b0 0x5618ea8c0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:32.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.225+0000 7f9056000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618ea8c0cd0 0x5618ea8cc720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:35964/0 (socket says 172.21.15.79:35964) 2024-08-20T01:38:32.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.225+0000 7f9056000640 1 -- 172.21.15.79:0/2885079402 learned_addr learned my addr 172.21.15.79:0/2885079402 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:32.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.225+0000 7f90557ff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618ea8c03b0 0x5618ea8c0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42944/0 (socket says 172.21.15.79:42944) 2024-08-20T01:38:32.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.225+0000 7f90557ff640 1 --2- 172.21.15.79:0/2885079402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ea8ccc60 0x5618ea8cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:32.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.225+0000 7f90557ff640 1 -- 172.21.15.79:0/2885079402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ea8ccc60 msgr2=0x5618ea8cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:32.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.225+0000 7f90557ff640 1 --2- 172.21.15.79:0/2885079402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ea8ccc60 0x5618ea8cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:32.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.225+0000 7f90557ff640 1 -- 172.21.15.79:0/2885079402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618ea8c0cd0 msgr2=0x5618ea8cc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:32.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.225+0000 7f9046ffd640 1 --2- 172.21.15.79:0/52905685 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f903c0b7fe0 0x7f903c0ba4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:32.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.225+0000 7f90557ff640 1 --2- 172.21.15.79:0/2885079402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618ea8c0cd0 0x5618ea8cc720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:32.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.225+0000 7f90557ff640 1 -- 172.21.15.79:0/2885079402 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618ea7c2520 con 0x5618ea8c03b0 2024-08-20T01:38:32.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.225+0000 7f9056000640 1 --2- 172.21.15.79:0/2885079402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618ea8c0cd0 0x5618ea8cc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:32.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.225+0000 7f90557ff640 1 --2- 172.21.15.79:0/52905685 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f903c0b7fe0 0x7f903c0ba4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:32.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.225+0000 7f9046ffd640 1 -- 172.21.15.79:0/52905685 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9048104f60 con 0x7f9050107d20 2024-08-20T01:38:32.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.225+0000 7f90557ff640 1 --2- 172.21.15.79:0/2885079402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618ea8c03b0 0x5618ea8c0790 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f9040013700 tx=0x7f9040005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77e01c1d552cfc3c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:32.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.226+0000 7f903bfff640 1 -- 172.21.15.79:0/2885079402 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9040013c80 con 0x5618ea8c03b0 2024-08-20T01:38:32.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.226+0000 7f903bfff640 1 -- 172.21.15.79:0/2885079402 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9040013260 con 0x5618ea8c03b0 2024-08-20T01:38:32.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.226+0000 7f903bfff640 1 -- 172.21.15.79:0/2885079402 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9040010b60 con 0x5618ea8c03b0 2024-08-20T01:38:32.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.227+0000 7f905a65d740 1 -- 172.21.15.79:0/2885079402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618ea8c03b0 msgr2=0x5618ea8c0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:32.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.227+0000 7f90557ff640 1 --2- 172.21.15.79:0/52905685 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f903c0b7fe0 0x7f903c0ba4a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9040021000 tx=0x7f9040010de0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:32.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.227+0000 7f905a65d740 1 --2- 172.21.15.79:0/2885079402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618ea8c03b0 0x5618ea8c0790 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f9040013700 tx=0x7f9040005f90 comp rx=0 tx=0).stop 2024-08-20T01:38:32.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.227+0000 7f905a65d740 1 -- 172.21.15.79:0/2885079402 shutdown_connections 2024-08-20T01:38:32.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.227+0000 7f905a65d740 1 --2- 172.21.15.79:0/2885079402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ea8ccc60 0x5618ea8cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:32.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.227+0000 7f905a65d740 1 --2- 172.21.15.79:0/2885079402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618ea8c0cd0 0x5618ea8cc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:32.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.227+0000 7f905a65d740 1 --2- 172.21.15.79:0/2885079402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618ea8c03b0 0x5618ea8c0790 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:32.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.227+0000 7f905a65d740 1 -- 172.21.15.79:0/2885079402 >> 172.21.15.79:0/2885079402 conn(0x5618ea8be1e0 msgr2=0x5618ea8bf380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:32.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.227+0000 7f905a65d740 1 -- 172.21.15.79:0/2885079402 shutdown_connections 2024-08-20T01:38:32.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.227+0000 7f905a65d740 1 -- 172.21.15.79:0/2885079402 wait complete. 2024-08-20T01:38:32.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.227+0000 7f905a65d740 1 -- start start 2024-08-20T01:38:32.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.227+0000 7f905a65d740 1 Processor -- start 2024-08-20T01:38:32.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.228+0000 7f905a65d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618ea8c03b0 0x5618ea8c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:32.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.228+0000 7f905a65d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618ea8c0cd0 0x5618ea8ca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:32.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.228+0000 7f905a65d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ea8ccc60 0x5618ea8ca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:32.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.228+0000 7f905a65d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5618ea688890 con 0x5618ea8c0cd0 2024-08-20T01:38:32.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.228+0000 7f905a65d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5618ea7ac700 con 0x5618ea8c03b0 2024-08-20T01:38:32.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.228+0000 7f905a65d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5618ea8cf950 con 0x5618ea8ccc60 2024-08-20T01:38:32.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.228+0000 7f905a65d740 10 client.0 _ll_register_callbacks cb 0x5618ea8216f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:32.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.228+0000 7f90557ff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618ea8c0cd0 0x5618ea8ca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:32.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.228+0000 7f90557ff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618ea8c0cd0 0x5618ea8ca1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42958/0 (socket says 172.21.15.79:42958) 2024-08-20T01:38:32.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.228+0000 7f90557ff640 1 -- 172.21.15.79:0/3806165580 learned_addr learned my addr 172.21.15.79:0/3806165580 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:32.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.228+0000 7f9056801640 1 --2- 172.21.15.79:0/3806165580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ea8ccc60 0x5618ea8ca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:32.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.228+0000 7f9056000640 1 --2- 172.21.15.79:0/3806165580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618ea8c03b0 0x5618ea8c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:32.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.228+0000 7f90557ff640 1 -- 172.21.15.79:0/3806165580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ea8ccc60 msgr2=0x5618ea8ca6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:32.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.228+0000 7f90557ff640 1 --2- 172.21.15.79:0/3806165580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ea8ccc60 0x5618ea8ca6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:32.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.228+0000 7f90557ff640 1 -- 172.21.15.79:0/3806165580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618ea8c03b0 msgr2=0x5618ea8c9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:32.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.228+0000 7f90557ff640 1 --2- 172.21.15.79:0/3806165580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618ea8c03b0 0x5618ea8c9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:32.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.228+0000 7f90557ff640 1 -- 172.21.15.79:0/3806165580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618ea585930 con 0x5618ea8c0cd0 2024-08-20T01:38:32.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.229+0000 7f90557ff640 1 --2- 172.21.15.79:0/3806165580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618ea8c0cd0 0x5618ea8ca1b0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f9040010450 tx=0x7f9040012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5a1af363d6b22f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:32.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.229+0000 7f90397fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:38:32.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.229+0000 7f90397fa640 1 -- 172.21.15.79:0/3806165580 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9040013c80 con 0x5618ea8c0cd0 2024-08-20T01:38:32.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.229+0000 7f90397fa640 1 -- 172.21.15.79:0/3806165580 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9040010a20 con 0x5618ea8c0cd0 2024-08-20T01:38:32.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.229+0000 7f905a65d740 1 -- 172.21.15.79:0/3806165580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9040013260 con 0x5618ea8c0cd0 2024-08-20T01:38:32.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.229+0000 7f90397fa640 1 -- 172.21.15.79:0/3806165580 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f9040022990 con 0x5618ea8c0cd0 2024-08-20T01:38:32.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.229+0000 7f905a65d740 10 client.16077 fetch_fsmap learned FSMap version 31 2024-08-20T01:38:32.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.229+0000 7f905a65d740 1 -- 172.21.15.79:0/3806165580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5618ea8db560 con 0x5618ea8c0cd0 2024-08-20T01:38:32.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.229+0000 7f90397fa640 1 -- 172.21.15.79:0/3806165580 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9040013260 con 0x5618ea8c0cd0 2024-08-20T01:38:32.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.229+0000 7f90397fa640 1 -- 172.21.15.79:0/3806165580 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f9040020020 con 0x5618ea8c0cd0 2024-08-20T01:38:32.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.229+0000 7f905a65d740 10 client.16077 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:38:32.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.229+0000 7f905a65d740 10 client.16077 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:38:32.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.230+0000 7f905a65d740 20 client.16077 populate_metadata read hostname 'smithi079' 2024-08-20T01:38:32.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.230+0000 7f905a65d740 1 --2- 172.21.15.79:0/3806165580 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5618ea8dc950 0x5618ea8ded80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:32.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.230+0000 7f905a65d740 4 client.16077 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:38:32.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.230+0000 7f905a65d740 1 -- 172.21.15.79:0/3806165580 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5618ea838890 con 0x5618ea8dc950 2024-08-20T01:38:32.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.230+0000 7f9056000640 1 --2- 172.21.15.79:0/3806165580 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5618ea8dc950 0x5618ea8ded80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:32.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.230+0000 7f9056000640 1 --2- 172.21.15.79:0/3806165580 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5618ea8dc950 0x5618ea8ded80 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=faf35a66919e68ad server_cookie=88fd27a62479c00b in_seq=0 out_seq=0 2024-08-20T01:38:32.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.230+0000 7f90397fa640 10 client.16077 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:32.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.231+0000 7f90397fa640 1 -- 172.21.15.79:0/3806165580 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5618ea838890 con 0x5618ea8dc950 2024-08-20T01:38:32.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.231+0000 7f90397fa640 10 client.16077 handle_command_reply: tid=0 2024-08-20T01:38:32.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.231+0000 7f905a65d740 1 client.16077 shutdown 2024-08-20T01:38:32.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.231+0000 7f905a65d740 1 -- 172.21.15.79:0/3806165580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618ea8c0cd0 msgr2=0x5618ea8ca1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:32.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.231+0000 7f905a65d740 1 --2- 172.21.15.79:0/3806165580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618ea8c0cd0 0x5618ea8ca1b0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f9040010450 tx=0x7f9040012000 comp rx=0 tx=0).stop 2024-08-20T01:38:32.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.231+0000 7f905a65d740 1 -- 172.21.15.79:0/3806165580 shutdown_connections 2024-08-20T01:38:32.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.231+0000 7f905a65d740 1 --2- 172.21.15.79:0/3806165580 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5618ea8dc950 0x5618ea8ded80 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:32.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.231+0000 7f905a65d740 1 --2- 172.21.15.79:0/3806165580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ea8ccc60 0x5618ea8ca6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:32.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.231+0000 7f905a65d740 1 --2- 172.21.15.79:0/3806165580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618ea8c0cd0 0x5618ea8ca1b0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:32.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.231+0000 7f90397fa640 0 client.16077 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:32.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.231+0000 7f905a65d740 1 --2- 172.21.15.79:0/3806165580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618ea8c03b0 0x5618ea8c9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:32.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.231+0000 7f905a65d740 1 -- 172.21.15.79:0/3806165580 >> 172.21.15.79:0/3806165580 conn(0x5618ea8be1e0 msgr2=0x5618ea8c3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:32.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.231+0000 7f905a65d740 1 -- 172.21.15.79:0/3806165580 shutdown_connections 2024-08-20T01:38:32.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.231+0000 7f905a65d740 1 -- 172.21.15.79:0/3806165580 wait complete. 2024-08-20T01:38:32.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.231+0000 7f905a65d740 20 client.16077 trim_cache size 0 max 16384 2024-08-20T01:38:32.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.250+0000 7f905a65d740 1 Processor -- start 2024-08-20T01:38:32.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.250+0000 7f905a65d740 1 -- start start 2024-08-20T01:38:32.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.250+0000 7f905a65d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ea8c03b0 0x5618ea8e4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:32.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.251+0000 7f905a65d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618ea8c0cd0 0x5618ea8e4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:32.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.251+0000 7f905a65d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618ea8ccc60 0x5618ea8c6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:32.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.251+0000 7f905a65d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f90501abda0 con 0x5618ea8ccc60 2024-08-20T01:38:32.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.251+0000 7f905a65d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f90501ad9d0 con 0x5618ea8c0cd0 2024-08-20T01:38:32.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.251+0000 7f905a65d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f90501ac470 con 0x5618ea8c03b0 2024-08-20T01:38:32.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.251+0000 7f9056801640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618ea8ccc60 0x5618ea8c6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:32.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.251+0000 7f9056801640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618ea8ccc60 0x5618ea8c6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42970/0 (socket says 172.21.15.79:42970) 2024-08-20T01:38:32.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.251+0000 7f9056801640 1 -- 172.21.15.79:0/426013941 learned_addr learned my addr 172.21.15.79:0/426013941 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:32.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.251+0000 7f9056000640 1 --2- 172.21.15.79:0/426013941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ea8c03b0 0x5618ea8e4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:32.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.251+0000 7f90557ff640 1 --2- 172.21.15.79:0/426013941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618ea8c0cd0 0x5618ea8e4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:32.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.251+0000 7f9056801640 1 -- 172.21.15.79:0/426013941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ea8c03b0 msgr2=0x5618ea8e4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:32.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.251+0000 7f9056801640 1 --2- 172.21.15.79:0/426013941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ea8c03b0 0x5618ea8e4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:32.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.251+0000 7f9056801640 1 -- 172.21.15.79:0/426013941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618ea8c0cd0 msgr2=0x5618ea8e4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:32.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.251+0000 7f9056801640 1 --2- 172.21.15.79:0/426013941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618ea8c0cd0 0x5618ea8e4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:32.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.251+0000 7f9056801640 1 -- 172.21.15.79:0/426013941 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618ea8df400 con 0x5618ea8ccc60 2024-08-20T01:38:32.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.251+0000 7f90557ff640 1 --2- 172.21.15.79:0/426013941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618ea8c0cd0 0x5618ea8e4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:38:32.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.251+0000 7f9056801640 1 --2- 172.21.15.79:0/426013941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618ea8ccc60 0x5618ea8c6e80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f9048102a70 tx=0x7f90480098d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3854954690d6f6f5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:32.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.251+0000 7f903b7fe640 1 -- 172.21.15.79:0/426013941 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90480e6070 con 0x5618ea8ccc60 2024-08-20T01:38:32.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.251+0000 7f903b7fe640 1 -- 172.21.15.79:0/426013941 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9048036040 con 0x5618ea8ccc60 2024-08-20T01:38:32.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.251+0000 7f903b7fe640 1 -- 172.21.15.79:0/426013941 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90480cc380 con 0x5618ea8ccc60 2024-08-20T01:38:32.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.252+0000 7f905a65d740 1 -- 172.21.15.79:0/426013941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618ea8ccc60 msgr2=0x5618ea8c6e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:32.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.252+0000 7f905a65d740 1 --2- 172.21.15.79:0/426013941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618ea8ccc60 0x5618ea8c6e80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f9048102a70 tx=0x7f90480098d0 comp rx=0 tx=0).stop 2024-08-20T01:38:32.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.252+0000 7f905a65d740 1 -- 172.21.15.79:0/426013941 shutdown_connections 2024-08-20T01:38:32.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.252+0000 7f905a65d740 1 --2- 172.21.15.79:0/426013941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618ea8ccc60 0x5618ea8c6e80 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:32.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.252+0000 7f905a65d740 1 --2- 172.21.15.79:0/426013941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618ea8c0cd0 0x5618ea8e4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:32.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.252+0000 7f905a65d740 1 --2- 172.21.15.79:0/426013941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ea8c03b0 0x5618ea8e4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:32.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.252+0000 7f905a65d740 1 -- 172.21.15.79:0/426013941 >> 172.21.15.79:0/426013941 conn(0x5618ea8be1e0 msgr2=0x5618ea8cbac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:32.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.252+0000 7f905a65d740 1 -- 172.21.15.79:0/426013941 shutdown_connections 2024-08-20T01:38:32.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.252+0000 7f905a65d740 1 -- 172.21.15.79:0/426013941 wait complete. 2024-08-20T01:38:32.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.253+0000 7f905a65d740 1 -- start start 2024-08-20T01:38:32.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.253+0000 7f905a65d740 1 Processor -- start 2024-08-20T01:38:32.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.253+0000 7f905a65d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618ea8c03b0 0x5618ea8c6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:32.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.253+0000 7f905a65d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ea8c0cd0 0x5618ea8c7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:32.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.253+0000 7f905a65d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618ea8ccc60 0x5618ea8c7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:32.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.253+0000 7f905a65d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f90501ad240 con 0x5618ea8ccc60 2024-08-20T01:38:32.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.253+0000 7f905a65d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f90501acb40 con 0x5618ea8c03b0 2024-08-20T01:38:32.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.253+0000 7f905a65d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f90501a9d80 con 0x5618ea8c0cd0 2024-08-20T01:38:32.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.253+0000 7f905a65d740 10 client.0 _ll_register_callbacks cb 0x7f904c0096a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:32.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.253+0000 7f9056801640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618ea8ccc60 0x5618ea8c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:32.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.253+0000 7f9056801640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618ea8ccc60 0x5618ea8c7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42974/0 (socket says 172.21.15.79:42974) 2024-08-20T01:38:32.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.253+0000 7f9056801640 1 -- 172.21.15.79:0/3516870056 learned_addr learned my addr 172.21.15.79:0/3516870056 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:32.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.253+0000 7f90557ff640 1 --2- 172.21.15.79:0/3516870056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ea8c0cd0 0x5618ea8c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:32.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.254+0000 7f9056000640 1 --2- 172.21.15.79:0/3516870056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618ea8c03b0 0x5618ea8c6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:32.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.254+0000 7f9056801640 1 -- 172.21.15.79:0/3516870056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ea8c0cd0 msgr2=0x5618ea8c7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:32.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.254+0000 7f9056801640 1 --2- 172.21.15.79:0/3516870056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ea8c0cd0 0x5618ea8c7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:32.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.254+0000 7f9056801640 1 -- 172.21.15.79:0/3516870056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618ea8c03b0 msgr2=0x5618ea8c6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:32.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.254+0000 7f9056801640 1 --2- 172.21.15.79:0/3516870056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618ea8c03b0 0x5618ea8c6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:32.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.254+0000 7f9056801640 1 -- 172.21.15.79:0/3516870056 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618ea946760 con 0x5618ea8ccc60 2024-08-20T01:38:32.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.254+0000 7f9056801640 1 --2- 172.21.15.79:0/3516870056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618ea8ccc60 0x5618ea8c7850 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f9048102ac0 tx=0x7f90480c8380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=115ec07581e015ef server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:32.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.254+0000 7f90397fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:38:32.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.254+0000 7f90397fa640 1 -- 172.21.15.79:0/3516870056 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90480e6030 con 0x5618ea8ccc60 2024-08-20T01:38:32.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.254+0000 7f90397fa640 1 -- 172.21.15.79:0/3516870056 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f90480cc330 con 0x5618ea8ccc60 2024-08-20T01:38:32.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.254+0000 7f905a65d740 1 -- 172.21.15.79:0/3516870056 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9048036040 con 0x5618ea8ccc60 2024-08-20T01:38:32.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.254+0000 7f90397fa640 1 -- 172.21.15.79:0/3516870056 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f90480d4f70 con 0x5618ea8ccc60 2024-08-20T01:38:32.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.254+0000 7f905a65d740 10 client.16083 fetch_fsmap learned FSMap version 31 2024-08-20T01:38:32.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.254+0000 7f905a65d740 1 -- 172.21.15.79:0/3516870056 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5618ea947ae0 con 0x5618ea8ccc60 2024-08-20T01:38:32.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.255+0000 7f90397fa640 1 -- 172.21.15.79:0/3516870056 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9048036040 con 0x5618ea8ccc60 2024-08-20T01:38:32.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.255+0000 7f90397fa640 1 -- 172.21.15.79:0/3516870056 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f90480cb120 con 0x5618ea8ccc60 2024-08-20T01:38:32.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.255+0000 7f905a65d740 10 client.16083 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:38:32.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.255+0000 7f905a65d740 10 client.16083 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:38:32.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.255+0000 7f905a65d740 20 client.16083 populate_metadata read hostname 'smithi079' 2024-08-20T01:38:32.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.255+0000 7f905a65d740 1 --2- 172.21.15.79:0/3516870056 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5618ea948140 0x5618ea94a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:32.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.255+0000 7f905a65d740 4 client.16083 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T01:38:32.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.255+0000 7f905a65d740 1 -- 172.21.15.79:0/3516870056 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5618ea834330 con 0x5618ea948140 2024-08-20T01:38:32.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.255+0000 7f9056000640 1 --2- 172.21.15.79:0/3516870056 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5618ea948140 0x5618ea94a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:32.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.256+0000 7f9056000640 1 --2- 172.21.15.79:0/3516870056 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5618ea948140 0x5618ea94a560 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a246c5a71f9c4aeb server_cookie=86e97153f47b1436 in_seq=0 out_seq=0 2024-08-20T01:38:32.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.256+0000 7f90397fa640 10 client.16083 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:32.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.256+0000 7f90397fa640 1 -- 172.21.15.79:0/3516870056 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5618ea834330 con 0x5618ea948140 2024-08-20T01:38:32.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.256+0000 7f90397fa640 10 client.16083 handle_command_reply: tid=0 2024-08-20T01:38:32.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.256+0000 7f905a65d740 1 client.16083 shutdown 2024-08-20T01:38:32.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.256+0000 7f905a65d740 1 -- 172.21.15.79:0/3516870056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618ea8ccc60 msgr2=0x5618ea8c7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:32.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.256+0000 7f905a65d740 1 --2- 172.21.15.79:0/3516870056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618ea8ccc60 0x5618ea8c7850 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f9048102ac0 tx=0x7f90480c8380 comp rx=0 tx=0).stop 2024-08-20T01:38:32.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.257+0000 7f905a65d740 1 -- 172.21.15.79:0/3516870056 shutdown_connections 2024-08-20T01:38:32.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.257+0000 7f905a65d740 1 --2- 172.21.15.79:0/3516870056 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5618ea948140 0x5618ea94a560 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:32.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.257+0000 7f905a65d740 1 --2- 172.21.15.79:0/3516870056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5618ea8ccc60 0x5618ea8c7850 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:32.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.257+0000 7f905a65d740 1 --2- 172.21.15.79:0/3516870056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618ea8c0cd0 0x5618ea8c7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:32.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.257+0000 7f905a65d740 1 --2- 172.21.15.79:0/3516870056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618ea8c03b0 0x5618ea8c6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:32.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.257+0000 7f90397fa640 0 client.16083 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:32.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.257+0000 7f905a65d740 1 -- 172.21.15.79:0/3516870056 >> 172.21.15.79:0/3516870056 conn(0x5618ea8be1e0 msgr2=0x5618ea8c3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:32.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.257+0000 7f905a65d740 1 -- 172.21.15.79:0/3516870056 shutdown_connections 2024-08-20T01:38:32.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.257+0000 7f905a65d740 1 -- 172.21.15.79:0/3516870056 wait complete. 2024-08-20T01:38:32.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.257+0000 7f905a65d740 20 client.16083 trim_cache size 0 max 16384 2024-08-20T01:38:32.272 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:38:32.272 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-08-20T01:38:32.272 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "a3559582-b579-4bfa-8384-0962d3f9c32d", 2024-08-20T01:38:32.273 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-08-20T01:38:32.273 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:38:32.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.258+0000 7f9058264640 1 -- 172.21.15.79:0/52905685 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f903c0b7fe0 msgr2=0x7f903c0ba4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:32.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.258+0000 7f9058264640 1 --2- 172.21.15.79:0/52905685 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f903c0b7fe0 0x7f903c0ba4a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9040021000 tx=0x7f9040010de0 comp rx=0 tx=0).stop 2024-08-20T01:38:32.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.258+0000 7f9058264640 1 -- 172.21.15.79:0/52905685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9050107d20 msgr2=0x7f905019e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:32.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.258+0000 7f9058264640 1 --2- 172.21.15.79:0/52905685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9050107d20 0x7f905019e7a0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f9048005cc0 tx=0x7f9048003f90 comp rx=0 tx=0).stop 2024-08-20T01:38:32.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.258+0000 7f9058264640 1 -- 172.21.15.79:0/52905685 shutdown_connections 2024-08-20T01:38:32.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.258+0000 7f9058264640 1 --2- 172.21.15.79:0/52905685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9050107d20 0x7f905019e7a0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:32.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.258+0000 7f9058264640 1 --2- 172.21.15.79:0/52905685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90501073a0 0x7f9050199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:32.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.258+0000 7f9058264640 1 --2- 172.21.15.79:0/52905685 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f903c0b7fe0 0x7f903c0ba4a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:32.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.258+0000 7f9058264640 1 --2- 172.21.15.79:0/52905685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9050101990 0x7f9050198ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:32.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.258+0000 7f9058264640 1 -- 172.21.15.79:0/52905685 >> 172.21.15.79:0/52905685 conn(0x7f90500fd400 msgr2=0x7f9050106510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:32.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.258+0000 7f9058264640 1 -- 172.21.15.79:0/52905685 shutdown_connections 2024-08-20T01:38:32.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:32.258+0000 7f9058264640 1 -- 172.21.15.79:0/52905685 wait complete. 2024-08-20T01:38:32.769 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:32 smithi079 ceph-mon[18656]: pgmap v383: 97 pgs: 97 active+clean; 662 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 30 MiB/s wr, 43 op/s 2024-08-20T01:38:32.769 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:32 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:38:32.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:32 smithi081 ceph-mon[22209]: pgmap v383: 97 pgs: 97 active+clean; 662 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 30 MiB/s wr, 43 op/s 2024-08-20T01:38:32.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:32 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:38:32.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:32 smithi175 ceph-mon[22392]: pgmap v383: 97 pgs: 97 active+clean; 662 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 30 MiB/s wr, 43 op/s 2024-08-20T01:38:32.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:32 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:38:32.961 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:38:33.263 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:38:33.684 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:33 smithi079 ceph-mon[18656]: scrub queued for path: / 2024-08-20T01:38:33.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:33 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:38:33.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:33 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:38:33.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:33 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:38:33.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:33 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:38:33.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:33 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:38:33.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:33 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:38:33.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:33 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:38:33.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:33 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:38:33.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:33 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:38:33.685 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:33 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:38:33.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:33 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:38:33.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:33 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:38:33.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:33 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:38:33.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:33 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:38:33.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:33 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:38:33.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:33 smithi081 ceph-mon[22209]: scrub queued for path: / 2024-08-20T01:38:33.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:33 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:38:33.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:33 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:38:33.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:33 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:38:33.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:33 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:38:33.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:33 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:38:33.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:33 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:38:33.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:33 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:38:33.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:33 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:38:33.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:33 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:38:33.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:33 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:38:33.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:33 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:38:33.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:33 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:38:33.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:33 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:38:33.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:33 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:38:33.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:33 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:38:33.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.790+0000 7f43eb27f640 1 -- 172.21.15.79:0/2650133535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43e4108e80 msgr2=0x7f43e410f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:33.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.790+0000 7f43eb27f640 1 --2- 172.21.15.79:0/2650133535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43e4108e80 0x7f43e410f680 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f43dc009ca0 tx=0x7f43dc02a8c0 comp rx=0 tx=0).stop 2024-08-20T01:38:33.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.790+0000 7f43eb27f640 1 -- 172.21.15.79:0/2650133535 shutdown_connections 2024-08-20T01:38:33.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.790+0000 7f43eb27f640 1 --2- 172.21.15.79:0/2650133535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43e4108e80 0x7f43e410f680 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:33.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.790+0000 7f43eb27f640 1 --2- 172.21.15.79:0/2650133535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43e4108500 0x7f43e4108940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:33.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.790+0000 7f43eb27f640 1 --2- 172.21.15.79:0/2650133535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43e4102af0 0x7f43e4102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:33.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.790+0000 7f43eb27f640 1 -- 172.21.15.79:0/2650133535 >> 172.21.15.79:0/2650133535 conn(0x7f43e40fe540 msgr2=0x7f43e4100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:33.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.790+0000 7f43eb27f640 1 -- 172.21.15.79:0/2650133535 shutdown_connections 2024-08-20T01:38:33.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.790+0000 7f43eb27f640 1 -- 172.21.15.79:0/2650133535 wait complete. 2024-08-20T01:38:33.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.790+0000 7f43eb27f640 1 Processor -- start 2024-08-20T01:38:33.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.791+0000 7f43eb27f640 1 -- start start 2024-08-20T01:38:33.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.791+0000 7f43eb27f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43e4102af0 0x7f43e4198ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:33.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.791+0000 7f43eb27f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43e4108500 0x7f43e4199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:33.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.791+0000 7f43eb27f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43e4108e80 0x7f43e419e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:33.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.791+0000 7f43eb27f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f43e4112a40 con 0x7f43e4108e80 2024-08-20T01:38:33.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.791+0000 7f43eb27f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f43e41128c0 con 0x7f43e4108500 2024-08-20T01:38:33.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.791+0000 7f43eb27f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f43e4112bc0 con 0x7f43e4102af0 2024-08-20T01:38:33.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.791+0000 7f43e981c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43e4108e80 0x7f43e419e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:33.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.791+0000 7f43e981c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43e4108e80 0x7f43e419e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42988/0 (socket says 172.21.15.79:42988) 2024-08-20T01:38:33.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.791+0000 7f43e901b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43e4102af0 0x7f43e4198ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:33.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.791+0000 7f43e981c640 1 -- 172.21.15.79:0/3330996412 learned_addr learned my addr 172.21.15.79:0/3330996412 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:33.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.791+0000 7f43e881a640 1 --2- 172.21.15.79:0/3330996412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43e4108500 0x7f43e4199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:33.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.791+0000 7f43e901b640 1 -- 172.21.15.79:0/3330996412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43e4108500 msgr2=0x7f43e4199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:33.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.791+0000 7f43e901b640 1 --2- 172.21.15.79:0/3330996412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43e4108500 0x7f43e4199430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:33.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.791+0000 7f43e901b640 1 -- 172.21.15.79:0/3330996412 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43e4108e80 msgr2=0x7f43e419e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:33.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.791+0000 7f43e901b640 1 --2- 172.21.15.79:0/3330996412 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43e4108e80 0x7f43e419e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:33.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.791+0000 7f43e901b640 1 -- 172.21.15.79:0/3330996412 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e419efa0 con 0x7f43e4102af0 2024-08-20T01:38:33.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.791+0000 7f43e981c640 1 --2- 172.21.15.79:0/3330996412 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43e4108e80 0x7f43e419e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:33.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.792+0000 7f43e901b640 1 --2- 172.21.15.79:0/3330996412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43e4102af0 0x7f43e4198ef0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f43e000e9f0 tx=0x7f43e000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:33.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.792+0000 7f43da7fc640 1 -- 172.21.15.79:0/3330996412 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e000ccc0 con 0x7f43e4102af0 2024-08-20T01:38:33.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.792+0000 7f43eb27f640 1 -- 172.21.15.79:0/3330996412 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43e419f290 con 0x7f43e4102af0 2024-08-20T01:38:33.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.792+0000 7f43da7fc640 1 -- 172.21.15.79:0/3330996412 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f43e00108c0 con 0x7f43e4102af0 2024-08-20T01:38:33.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.792+0000 7f43da7fc640 1 -- 172.21.15.79:0/3330996412 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e00187c0 con 0x7f43e4102af0 2024-08-20T01:38:33.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.792+0000 7f43eb27f640 1 -- 172.21.15.79:0/3330996412 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43e40750b0 con 0x7f43e4102af0 2024-08-20T01:38:33.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.794+0000 7f43da7fc640 1 -- 172.21.15.79:0/3330996412 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f43e0010430 con 0x7f43e4102af0 2024-08-20T01:38:33.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.795+0000 7f43ed678740 1 Processor -- start 2024-08-20T01:38:33.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.795+0000 7f43ed678740 1 -- start start 2024-08-20T01:38:33.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.795+0000 7f43ed678740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556642ed8830 0x556642ed8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:33.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.795+0000 7f43ed678740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556642ed9150 0x556642ee4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:33.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.795+0000 7f43ed678740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556642ee50e0 0x556642ee74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:33.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.795+0000 7f43ed678740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556642e4f8e0 con 0x556642ed8830 2024-08-20T01:38:33.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.795+0000 7f43ed678740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556642e3ede0 con 0x556642ee50e0 2024-08-20T01:38:33.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.795+0000 7f43ed678740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556642e42e20 con 0x556642ed9150 2024-08-20T01:38:33.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.795+0000 7f43da7fc640 1 --2- 172.21.15.79:0/3330996412 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f43d00b3bd0 0x7f43d00b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:33.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.796+0000 7f43e981c640 1 --2- 172.21.15.79:0/3330996412 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f43d00b3bd0 0x7f43d00b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:33.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.796+0000 7f43e981c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556642ed8830 0x556642ed8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:33.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.796+0000 7f43e881a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556642ee50e0 0x556642ee74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:33.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.796+0000 7f43da7fc640 1 -- 172.21.15.79:0/3330996412 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f43e00e3f10 con 0x7f43e4102af0 2024-08-20T01:38:33.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.796+0000 7f43e881a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556642ee50e0 0x556642ee74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:36044/0 (socket says 172.21.15.79:36044) 2024-08-20T01:38:33.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.796+0000 7f43e881a640 1 -- 172.21.15.79:0/2696907607 learned_addr learned my addr 172.21.15.79:0/2696907607 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:33.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.796+0000 7f43e901b640 1 --2- 172.21.15.79:0/2696907607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556642ed9150 0x556642ee4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:33.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.796+0000 7f43e881a640 1 -- 172.21.15.79:0/2696907607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556642ed9150 msgr2=0x556642ee4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:33.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.796+0000 7f43e881a640 1 --2- 172.21.15.79:0/2696907607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556642ed9150 0x556642ee4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:33.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.796+0000 7f43e881a640 1 -- 172.21.15.79:0/2696907607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556642ed8830 msgr2=0x556642ed8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:33.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.796+0000 7f43e881a640 1 --2- 172.21.15.79:0/2696907607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556642ed8830 0x556642ed8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:33.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.796+0000 7f43e881a640 1 -- 172.21.15.79:0/2696907607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556642b9e650 con 0x556642ee50e0 2024-08-20T01:38:33.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.796+0000 7f43e881a640 1 --2- 172.21.15.79:0/2696907607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556642ee50e0 0x556642ee74d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f43d400bc10 tx=0x7f43d40107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=366d64693601be20 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:33.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.796+0000 7f43e981c640 1 --2- 172.21.15.79:0/3330996412 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f43d00b3bd0 0x7f43d00b6090 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f43dc004af0 tx=0x7f43dc0098b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:33.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.797+0000 7f43cf7fe640 1 -- 172.21.15.79:0/2696907607 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d4005020 con 0x556642ee50e0 2024-08-20T01:38:33.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.797+0000 7f43cf7fe640 1 -- 172.21.15.79:0/2696907607 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f43d40047a0 con 0x556642ee50e0 2024-08-20T01:38:33.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.797+0000 7f43cf7fe640 1 -- 172.21.15.79:0/2696907607 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d40116a0 con 0x556642ee50e0 2024-08-20T01:38:33.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.797+0000 7f43ed678740 1 -- 172.21.15.79:0/2696907607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556642ee50e0 msgr2=0x556642ee74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:33.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.797+0000 7f43ed678740 1 --2- 172.21.15.79:0/2696907607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556642ee50e0 0x556642ee74d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f43d400bc10 tx=0x7f43d40107a0 comp rx=0 tx=0).stop 2024-08-20T01:38:33.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.797+0000 7f43ed678740 1 -- 172.21.15.79:0/2696907607 shutdown_connections 2024-08-20T01:38:33.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.797+0000 7f43ed678740 1 --2- 172.21.15.79:0/2696907607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556642ee50e0 0x556642ee74d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:33.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.797+0000 7f43ed678740 1 --2- 172.21.15.79:0/2696907607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556642ed9150 0x556642ee4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:33.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.797+0000 7f43ed678740 1 --2- 172.21.15.79:0/2696907607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556642ed8830 0x556642ed8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:33.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.797+0000 7f43ed678740 1 -- 172.21.15.79:0/2696907607 >> 172.21.15.79:0/2696907607 conn(0x556642ed6660 msgr2=0x556642ed7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:33.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.797+0000 7f43ed678740 1 -- 172.21.15.79:0/2696907607 shutdown_connections 2024-08-20T01:38:33.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.797+0000 7f43ed678740 1 -- 172.21.15.79:0/2696907607 wait complete. 2024-08-20T01:38:33.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.798+0000 7f43ed678740 1 -- start start 2024-08-20T01:38:33.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.798+0000 7f43ed678740 1 Processor -- start 2024-08-20T01:38:33.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.798+0000 7f43ed678740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556642ed8830 0x556642ee20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:33.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.798+0000 7f43ed678740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556642ed9150 0x556642ee25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:33.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.798+0000 7f43ed678740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556642ee50e0 0x556642ee2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:33.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.798+0000 7f43ed678740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556642ca1700 con 0x556642ed9150 2024-08-20T01:38:33.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.798+0000 7f43ed678740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556642dc57c0 con 0x556642ee50e0 2024-08-20T01:38:33.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.798+0000 7f43ed678740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556642ee7d90 con 0x556642ed8830 2024-08-20T01:38:33.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.798+0000 7f43ed678740 10 client.0 _ll_register_callbacks cb 0x556642e386b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:33.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.799+0000 7f43e901b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556642ed8830 0x556642ee20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:33.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.799+0000 7f43e881a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556642ed9150 0x556642ee25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:33.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.799+0000 7f43e901b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556642ed8830 0x556642ee20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:60716/0 (socket says 172.21.15.79:60716) 2024-08-20T01:38:33.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.799+0000 7f43e901b640 1 -- 172.21.15.79:0/537315832 learned_addr learned my addr 172.21.15.79:0/537315832 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:33.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.799+0000 7f43e981c640 1 --2- 172.21.15.79:0/537315832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556642ee50e0 0x556642ee2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:33.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.799+0000 7f43e901b640 1 -- 172.21.15.79:0/537315832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556642ee50e0 msgr2=0x556642ee2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:33.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.799+0000 7f43e901b640 1 --2- 172.21.15.79:0/537315832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556642ee50e0 0x556642ee2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:33.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.799+0000 7f43e901b640 1 -- 172.21.15.79:0/537315832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556642ed9150 msgr2=0x556642ee25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:33.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.799+0000 7f43e901b640 1 --2- 172.21.15.79:0/537315832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556642ed9150 0x556642ee25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:33.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.799+0000 7f43e901b640 1 -- 172.21.15.79:0/537315832 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556642ef1170 con 0x556642ed8830 2024-08-20T01:38:33.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.799+0000 7f43e901b640 1 --2- 172.21.15.79:0/537315832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556642ed8830 0x556642ee20b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f43e00e19c0 tx=0x7f43e00be6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2426c7014b0bb1ab server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:33.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.799+0000 7f43ccff9640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:38:33.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.799+0000 7f43ccff9640 1 -- 172.21.15.79:0/537315832 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e00be4c0 con 0x556642ed8830 2024-08-20T01:38:33.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.799+0000 7f43ccff9640 1 -- 172.21.15.79:0/537315832 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f43e0010a70 con 0x556642ed8830 2024-08-20T01:38:33.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.799+0000 7f43ed678740 1 -- 172.21.15.79:0/537315832 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556642dee100 con 0x556642ed8830 2024-08-20T01:38:33.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.799+0000 7f43ccff9640 1 -- 172.21.15.79:0/537315832 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f43e00aaec0 con 0x556642ed8830 2024-08-20T01:38:33.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.799+0000 7f43ed678740 10 client.25417 fetch_fsmap learned FSMap version 31 2024-08-20T01:38:33.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.799+0000 7f43ed678740 1 -- 172.21.15.79:0/537315832 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x556642ef3b20 con 0x556642ed8830 2024-08-20T01:38:33.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.800+0000 7f43ccff9640 1 -- 172.21.15.79:0/537315832 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x556642dee100 con 0x556642ed8830 2024-08-20T01:38:33.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.800+0000 7f43ccff9640 1 -- 172.21.15.79:0/537315832 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f43e00c23a0 con 0x556642ed8830 2024-08-20T01:38:33.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.800+0000 7f43ed678740 10 client.25417 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:38:33.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.800+0000 7f43ed678740 10 client.25417 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:38:33.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.800+0000 7f43ed678740 20 client.25417 populate_metadata read hostname 'smithi079' 2024-08-20T01:38:33.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.800+0000 7f43ed678740 1 --2- 172.21.15.79:0/537315832 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556642ef5020 0x556642ef74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:33.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.800+0000 7f43ed678740 4 client.25417 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:38:33.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.800+0000 7f43ed678740 1 -- 172.21.15.79:0/537315832 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556642e51830 con 0x556642ef5020 2024-08-20T01:38:33.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.800+0000 7f43e881a640 1 --2- 172.21.15.79:0/537315832 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556642ef5020 0x556642ef74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:33.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.801+0000 7f43e881a640 1 --2- 172.21.15.79:0/537315832 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556642ef5020 0x556642ef74e0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5848c395411f6adf server_cookie=ef850a14d0a170e5 in_seq=0 out_seq=0 2024-08-20T01:38:33.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.801+0000 7f43ccff9640 10 client.25417 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:33.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.801+0000 7f43ccff9640 1 -- 172.21.15.79:0/537315832 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556642e51830 con 0x556642ef5020 2024-08-20T01:38:33.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.801+0000 7f43ccff9640 10 client.25417 handle_command_reply: tid=0 2024-08-20T01:38:33.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.801+0000 7f43ed678740 1 client.25417 shutdown 2024-08-20T01:38:33.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.801+0000 7f43ed678740 1 -- 172.21.15.79:0/537315832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556642ed8830 msgr2=0x556642ee20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:33.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.801+0000 7f43ed678740 1 --2- 172.21.15.79:0/537315832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556642ed8830 0x556642ee20b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f43e00e19c0 tx=0x7f43e00be6f0 comp rx=0 tx=0).stop 2024-08-20T01:38:33.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.801+0000 7f43ed678740 1 -- 172.21.15.79:0/537315832 shutdown_connections 2024-08-20T01:38:33.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.801+0000 7f43ed678740 1 --2- 172.21.15.79:0/537315832 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556642ef5020 0x556642ef74e0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:33.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.802+0000 7f43ed678740 1 --2- 172.21.15.79:0/537315832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556642ee50e0 0x556642ee2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:33.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.802+0000 7f43ccff9640 0 client.25417 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:33.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.802+0000 7f43ed678740 1 --2- 172.21.15.79:0/537315832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556642ed9150 0x556642ee25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:33.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.802+0000 7f43ed678740 1 --2- 172.21.15.79:0/537315832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556642ed8830 0x556642ee20b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:33.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.802+0000 7f43ed678740 1 -- 172.21.15.79:0/537315832 >> 172.21.15.79:0/537315832 conn(0x556642ed6660 msgr2=0x556642edc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:33.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.802+0000 7f43ed678740 1 -- 172.21.15.79:0/537315832 shutdown_connections 2024-08-20T01:38:33.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.802+0000 7f43ed678740 1 -- 172.21.15.79:0/537315832 wait complete. 2024-08-20T01:38:33.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.802+0000 7f43ed678740 20 client.25417 trim_cache size 0 max 16384 2024-08-20T01:38:33.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.820+0000 7f43ed678740 1 Processor -- start 2024-08-20T01:38:33.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.820+0000 7f43ed678740 1 -- start start 2024-08-20T01:38:33.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.820+0000 7f43ed678740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556642ed8830 0x556642efcdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:33.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.820+0000 7f43ed678740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556642ed9150 0x556642efd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:33.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.820+0000 7f43ed678740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556642ee50e0 0x556642ee36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:33.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.820+0000 7f43ed678740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f43e41b02b0 con 0x556642ee50e0 2024-08-20T01:38:33.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.820+0000 7f43ed678740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f43e41b1ee0 con 0x556642ed8830 2024-08-20T01:38:33.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.820+0000 7f43ed678740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f43e41b0980 con 0x556642ed9150 2024-08-20T01:38:33.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.821+0000 7f43e981c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556642ee50e0 0x556642ee36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:33.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.821+0000 7f43e901b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556642ed8830 0x556642efcdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:33.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.821+0000 7f43e981c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556642ee50e0 0x556642ee36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43014/0 (socket says 172.21.15.79:43014) 2024-08-20T01:38:33.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.821+0000 7f43e981c640 1 -- 172.21.15.79:0/1295463127 learned_addr learned my addr 172.21.15.79:0/1295463127 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:33.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.821+0000 7f43e881a640 1 --2- 172.21.15.79:0/1295463127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556642ed9150 0x556642efd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:33.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.821+0000 7f43e901b640 1 -- 172.21.15.79:0/1295463127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556642ed9150 msgr2=0x556642efd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:33.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.821+0000 7f43e901b640 1 --2- 172.21.15.79:0/1295463127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556642ed9150 0x556642efd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:33.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.821+0000 7f43e901b640 1 -- 172.21.15.79:0/1295463127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556642ee50e0 msgr2=0x556642ee36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:33.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.821+0000 7f43e901b640 1 --2- 172.21.15.79:0/1295463127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556642ee50e0 0x556642ee36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:33.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.821+0000 7f43e901b640 1 -- 172.21.15.79:0/1295463127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556642ed6490 con 0x556642ed8830 2024-08-20T01:38:33.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.821+0000 7f43e881a640 1 --2- 172.21.15.79:0/1295463127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556642ed9150 0x556642efd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:38:33.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.821+0000 7f43e981c640 1 --2- 172.21.15.79:0/1295463127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556642ee50e0 0x556642ee36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:33.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.821+0000 7f43e901b640 1 --2- 172.21.15.79:0/1295463127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556642ed8830 0x556642efcdb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f43e00c2280 tx=0x7f43e0009700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2db998b330ca6ef1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:33.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.821+0000 7f43ceffd640 1 -- 172.21.15.79:0/1295463127 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e0010720 con 0x556642ed8830 2024-08-20T01:38:33.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.821+0000 7f43ceffd640 1 -- 172.21.15.79:0/1295463127 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f43e00af410 con 0x556642ed8830 2024-08-20T01:38:33.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.821+0000 7f43ceffd640 1 -- 172.21.15.79:0/1295463127 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e00a6920 con 0x556642ed8830 2024-08-20T01:38:33.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.822+0000 7f43ed678740 1 -- 172.21.15.79:0/1295463127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556642ed8830 msgr2=0x556642efcdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:33.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.822+0000 7f43ed678740 1 --2- 172.21.15.79:0/1295463127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556642ed8830 0x556642efcdb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f43e00c2280 tx=0x7f43e0009700 comp rx=0 tx=0).stop 2024-08-20T01:38:33.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.822+0000 7f43ed678740 1 -- 172.21.15.79:0/1295463127 shutdown_connections 2024-08-20T01:38:33.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.822+0000 7f43ed678740 1 --2- 172.21.15.79:0/1295463127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556642ee50e0 0x556642ee36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:33.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.822+0000 7f43ed678740 1 --2- 172.21.15.79:0/1295463127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556642ed9150 0x556642efd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:33.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.822+0000 7f43ed678740 1 --2- 172.21.15.79:0/1295463127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556642ed8830 0x556642efcdb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:33.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.822+0000 7f43ed678740 1 -- 172.21.15.79:0/1295463127 >> 172.21.15.79:0/1295463127 conn(0x556642ed6660 msgr2=0x556642ee0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:33.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.822+0000 7f43ed678740 1 -- 172.21.15.79:0/1295463127 shutdown_connections 2024-08-20T01:38:33.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.822+0000 7f43ed678740 1 -- 172.21.15.79:0/1295463127 wait complete. 2024-08-20T01:38:33.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.823+0000 7f43ed678740 1 -- start start 2024-08-20T01:38:33.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.823+0000 7f43ed678740 1 Processor -- start 2024-08-20T01:38:33.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.823+0000 7f43ed678740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556642ed8830 0x556642ee8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:33.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.823+0000 7f43ed678740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556642ed9150 0x556642ee8570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:33.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.823+0000 7f43ed678740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556642ee50e0 0x556642ee8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:33.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.823+0000 7f43ed678740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f43e41b1750 con 0x556642ed9150 2024-08-20T01:38:33.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.823+0000 7f43ed678740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f43e41b1050 con 0x556642ee50e0 2024-08-20T01:38:33.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.823+0000 7f43ed678740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f43e41ae290 con 0x556642ed8830 2024-08-20T01:38:33.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.823+0000 7f43ed678740 10 client.0 _ll_register_callbacks cb 0x7f43e00aa900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:33.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.823+0000 7f43e881a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556642ed9150 0x556642ee8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:33.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.823+0000 7f43e901b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556642ed8830 0x556642ee8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:33.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.823+0000 7f43e881a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556642ed9150 0x556642ee8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43020/0 (socket says 172.21.15.79:43020) 2024-08-20T01:38:33.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.823+0000 7f43e881a640 1 -- 172.21.15.79:0/2484556351 learned_addr learned my addr 172.21.15.79:0/2484556351 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:33.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.823+0000 7f43e981c640 1 --2- 172.21.15.79:0/2484556351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556642ee50e0 0x556642ee8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:33.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.824+0000 7f43e901b640 1 -- 172.21.15.79:0/2484556351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556642ee50e0 msgr2=0x556642ee8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:33.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.824+0000 7f43e901b640 1 --2- 172.21.15.79:0/2484556351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556642ee50e0 0x556642ee8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:33.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.824+0000 7f43e901b640 1 -- 172.21.15.79:0/2484556351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556642ed9150 msgr2=0x556642ee8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:33.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.824+0000 7f43e901b640 1 --2- 172.21.15.79:0/2484556351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556642ed9150 0x556642ee8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:33.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.824+0000 7f43e901b640 1 -- 172.21.15.79:0/2484556351 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556642f5df90 con 0x556642ed8830 2024-08-20T01:38:33.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.824+0000 7f43e881a640 1 --2- 172.21.15.79:0/2484556351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556642ed9150 0x556642ee8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:33.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.824+0000 7f43e901b640 1 --2- 172.21.15.79:0/2484556351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556642ed8830 0x556642ee8030 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f43e00ab080 tx=0x7f43e00e1a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1343a0e1ace03b18 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:33.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.824+0000 7f43ccff9640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:38:33.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.824+0000 7f43ccff9640 1 -- 172.21.15.79:0/2484556351 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e00ca060 con 0x556642ed8830 2024-08-20T01:38:33.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.824+0000 7f43ccff9640 1 -- 172.21.15.79:0/2484556351 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f43e00aa120 con 0x556642ed8830 2024-08-20T01:38:33.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.824+0000 7f43ed678740 1 -- 172.21.15.79:0/2484556351 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43e00af410 con 0x556642ed8830 2024-08-20T01:38:33.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.824+0000 7f43ccff9640 1 -- 172.21.15.79:0/2484556351 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f43e0010720 con 0x556642ed8830 2024-08-20T01:38:33.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.824+0000 7f43ed678740 10 client.25420 fetch_fsmap learned FSMap version 31 2024-08-20T01:38:33.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.824+0000 7f43ed678740 1 -- 172.21.15.79:0/2484556351 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x556642f5f210 con 0x556642ed8830 2024-08-20T01:38:33.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.824+0000 7f43ccff9640 1 -- 172.21.15.79:0/2484556351 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f43e00be820 con 0x556642ed8830 2024-08-20T01:38:33.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.825+0000 7f43ccff9640 1 -- 172.21.15.79:0/2484556351 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f43e00bea70 con 0x556642ed8830 2024-08-20T01:38:33.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.825+0000 7f43ed678740 10 client.25420 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T01:38:33.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.825+0000 7f43ed678740 10 client.25420 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:38:33.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.825+0000 7f43ed678740 20 client.25420 populate_metadata read hostname 'smithi079' 2024-08-20T01:38:33.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.825+0000 7f43ed678740 1 --2- 172.21.15.79:0/2484556351 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556642ef5020 0x556642f61810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:33.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.825+0000 7f43ed678740 4 client.25420 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:38:33.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.825+0000 7f43ed678740 1 -- 172.21.15.79:0/2484556351 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f43e00af410 con 0x556642ef5020 2024-08-20T01:38:33.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.825+0000 7f43e881a640 1 --2- 172.21.15.79:0/2484556351 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556642ef5020 0x556642f61810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:33.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.825+0000 7f43e881a640 1 --2- 172.21.15.79:0/2484556351 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556642ef5020 0x556642f61810 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d03f8992b5d2ac2 server_cookie=887c59ac95d788e8 in_seq=0 out_seq=0 2024-08-20T01:38:33.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.825+0000 7f43ccff9640 10 client.25420 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:33.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.826+0000 7f43ccff9640 1 -- 172.21.15.79:0/2484556351 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7f43e00af410 con 0x556642ef5020 2024-08-20T01:38:33.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.826+0000 7f43ccff9640 10 client.25420 handle_command_reply: tid=0 2024-08-20T01:38:33.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.826+0000 7f43ed678740 1 client.25420 shutdown 2024-08-20T01:38:33.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.826+0000 7f43ed678740 1 -- 172.21.15.79:0/2484556351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556642ed8830 msgr2=0x556642ee8030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:33.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.826+0000 7f43ed678740 1 --2- 172.21.15.79:0/2484556351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556642ed8830 0x556642ee8030 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f43e00ab080 tx=0x7f43e00e1a40 comp rx=0 tx=0).stop 2024-08-20T01:38:33.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.826+0000 7f43ed678740 1 -- 172.21.15.79:0/2484556351 shutdown_connections 2024-08-20T01:38:33.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.826+0000 7f43ed678740 1 --2- 172.21.15.79:0/2484556351 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556642ef5020 0x556642f61810 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:33.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.826+0000 7f43ed678740 1 --2- 172.21.15.79:0/2484556351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556642ee50e0 0x556642ee8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:33.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.826+0000 7f43ed678740 1 --2- 172.21.15.79:0/2484556351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556642ed9150 0x556642ee8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:33.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.826+0000 7f43ed678740 1 --2- 172.21.15.79:0/2484556351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556642ed8830 0x556642ee8030 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:33.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.826+0000 7f43ed678740 1 -- 172.21.15.79:0/2484556351 >> 172.21.15.79:0/2484556351 conn(0x556642ed6660 msgr2=0x556642ee0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:33.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.826+0000 7f43ccff9640 0 client.25420 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:33.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.826+0000 7f43ed678740 1 -- 172.21.15.79:0/2484556351 shutdown_connections 2024-08-20T01:38:33.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.826+0000 7f43ed678740 1 -- 172.21.15.79:0/2484556351 wait complete. 2024-08-20T01:38:33.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.826+0000 7f43ed678740 20 client.25420 trim_cache size 0 max 16384 2024-08-20T01:38:33.834 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:38:33.834 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-20T01:38:33.834 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": { 2024-08-20T01:38:33.835 INFO:teuthology.orchestra.run.smithi079.stdout: "a3559582-b579-4bfa-8384-0962d3f9c32d": { 2024-08-20T01:38:33.835 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/", 2024-08-20T01:38:33.835 INFO:teuthology.orchestra.run.smithi079.stdout: "tag": "a3559582-b579-4bfa-8384-0962d3f9c32d", 2024-08-20T01:38:33.835 INFO:teuthology.orchestra.run.smithi079.stdout: "options": "recursive,force" 2024-08-20T01:38:33.835 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:38:33.835 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:38:33.835 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:38:33.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.827+0000 7f43eb27f640 1 -- 172.21.15.79:0/3330996412 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f43d00b3bd0 msgr2=0x7f43d00b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:33.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.827+0000 7f43eb27f640 1 --2- 172.21.15.79:0/3330996412 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f43d00b3bd0 0x7f43d00b6090 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f43dc004af0 tx=0x7f43dc0098b0 comp rx=0 tx=0).stop 2024-08-20T01:38:33.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.827+0000 7f43eb27f640 1 -- 172.21.15.79:0/3330996412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43e4102af0 msgr2=0x7f43e4198ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:33.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.827+0000 7f43eb27f640 1 --2- 172.21.15.79:0/3330996412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43e4102af0 0x7f43e4198ef0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f43e000e9f0 tx=0x7f43e000eeb0 comp rx=0 tx=0).stop 2024-08-20T01:38:33.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.827+0000 7f43eb27f640 1 -- 172.21.15.79:0/3330996412 shutdown_connections 2024-08-20T01:38:33.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.827+0000 7f43eb27f640 1 --2- 172.21.15.79:0/3330996412 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43e4108e80 0x7f43e419e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:33.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.827+0000 7f43eb27f640 1 --2- 172.21.15.79:0/3330996412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43e4108500 0x7f43e4199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:33.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.827+0000 7f43eb27f640 1 --2- 172.21.15.79:0/3330996412 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f43d00b3bd0 0x7f43d00b6090 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:33.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.827+0000 7f43eb27f640 1 --2- 172.21.15.79:0/3330996412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43e4102af0 0x7f43e4198ef0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:33.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.827+0000 7f43eb27f640 1 -- 172.21.15.79:0/3330996412 >> 172.21.15.79:0/3330996412 conn(0x7f43e40fe540 msgr2=0x7f43e4100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:33.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.827+0000 7f43eb27f640 1 -- 172.21.15.79:0/3330996412 shutdown_connections 2024-08-20T01:38:33.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:38:33.827+0000 7f43eb27f640 1 -- 172.21.15.79:0/3330996412 wait complete. 2024-08-20T01:38:33.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:33 smithi175 ceph-mon[22392]: scrub queued for path: / 2024-08-20T01:38:33.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:33 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:38:33.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:33 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:38:33.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:33 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:38:33.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:33 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:38:33.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:33 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:38:33.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:33 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:38:33.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:33 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:38:33.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:33 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:38:33.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:33 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:38:33.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:33 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:38:33.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:33 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:38:33.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:33 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:38:33.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:33 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:38:33.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:33 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:38:33.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:33 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:38:34.631 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:34 smithi079 ceph-mon[18656]: pgmap v384: 97 pgs: 97 active+clean; 698 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 28 MiB/s wr, 32 op/s 2024-08-20T01:38:34.656 INFO:tasks.cephfs.filesystem:scrub status for tag:a3559582-b579-4bfa-8384-0962d3f9c32d - {'path': '/', 'tag': 'a3559582-b579-4bfa-8384-0962d3f9c32d', 'options': 'recursive,force'} 2024-08-20T01:38:34.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:34 smithi081 ceph-mon[22209]: pgmap v384: 97 pgs: 97 active+clean; 698 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 28 MiB/s wr, 32 op/s 2024-08-20T01:38:34.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:34 smithi175 ceph-mon[22392]: pgmap v384: 97 pgs: 97 active+clean; 698 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 28 MiB/s wr, 32 op/s 2024-08-20T01:38:35.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:35 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:38:35.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:35 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:38:35.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:35 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:38:36.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:36 smithi081 ceph-mon[22209]: pgmap v385: 97 pgs: 97 active+clean; 750 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 28 MiB/s wr, 42 op/s 2024-08-20T01:38:36.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:36 smithi175 ceph-mon[22392]: pgmap v385: 97 pgs: 97 active+clean; 750 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 28 MiB/s wr, 42 op/s 2024-08-20T01:38:36.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:36 smithi079 ceph-mon[18656]: pgmap v385: 97 pgs: 97 active+clean; 750 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 28 MiB/s wr, 42 op/s 2024-08-20T01:38:37.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:37 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:38:37.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:37 smithi081 ceph-mon[22209]: pgmap v386: 97 pgs: 97 active+clean; 810 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 29 MiB/s wr, 51 op/s 2024-08-20T01:38:37.837 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:37 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:38:37.837 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:37 smithi079 ceph-mon[18656]: pgmap v386: 97 pgs: 97 active+clean; 810 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 29 MiB/s wr, 51 op/s 2024-08-20T01:38:37.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:37 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:38:37.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:37 smithi175 ceph-mon[22392]: pgmap v386: 97 pgs: 97 active+clean; 810 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 29 MiB/s wr, 51 op/s 2024-08-20T01:38:39.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:39 smithi175 ceph-mon[22392]: pgmap v387: 97 pgs: 97 active+clean; 886 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 30 MiB/s wr, 56 op/s 2024-08-20T01:38:39.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:39 smithi079 ceph-mon[18656]: pgmap v387: 97 pgs: 97 active+clean; 886 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 30 MiB/s wr, 56 op/s 2024-08-20T01:38:40.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:39 smithi081 ceph-mon[22209]: pgmap v387: 97 pgs: 97 active+clean; 886 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 30 MiB/s wr, 56 op/s 2024-08-20T01:38:41.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:41 smithi175 ceph-mon[22392]: pgmap v388: 97 pgs: 97 active+clean; 938 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 29 MiB/s wr, 53 op/s 2024-08-20T01:38:41.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:41 smithi079 ceph-mon[18656]: pgmap v388: 97 pgs: 97 active+clean; 938 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 29 MiB/s wr, 53 op/s 2024-08-20T01:38:42.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:41 smithi081 ceph-mon[22209]: pgmap v388: 97 pgs: 97 active+clean; 938 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 29 MiB/s wr, 53 op/s 2024-08-20T01:38:43.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:43 smithi175 ceph-mon[22392]: pgmap v389: 97 pgs: 97 active+clean; 974 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 26 MiB/s wr, 50 op/s 2024-08-20T01:38:43.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:43 smithi079 ceph-mon[18656]: pgmap v389: 97 pgs: 97 active+clean; 974 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 26 MiB/s wr, 50 op/s 2024-08-20T01:38:44.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:43 smithi081 ceph-mon[22209]: pgmap v389: 97 pgs: 97 active+clean; 974 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 26 MiB/s wr, 50 op/s 2024-08-20T01:38:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.075+0000 7fd0c76f6640 1 -- 172.21.15.79:0/3616648758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0c01026b0 msgr2=0x7fd0c0102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.075+0000 7fd0c76f6640 1 --2- 172.21.15.79:0/3616648758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0c01026b0 0x7fd0c0102b30 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0009930 tx=0x7fd0b002a420 comp rx=0 tx=0).stop 2024-08-20T01:38:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.075+0000 7fd0c76f6640 1 -- 172.21.15.79:0/3616648758 shutdown_connections 2024-08-20T01:38:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.075+0000 7fd0c76f6640 1 --2- 172.21.15.79:0/3616648758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0c0103070 0x7fd0c01099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.075+0000 7fd0c76f6640 1 --2- 172.21.15.79:0/3616648758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0c01026b0 0x7fd0c0102b30 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.075+0000 7fd0c76f6640 1 --2- 172.21.15.79:0/3616648758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0c0101560 0x7fd0c0101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:44.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.075+0000 7fd0c76f6640 1 -- 172.21.15.79:0/3616648758 >> 172.21.15.79:0/3616648758 conn(0x7fd0c00fce40 msgr2=0x7fd0c00ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:44.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.076+0000 7fd0c76f6640 1 -- 172.21.15.79:0/3616648758 shutdown_connections 2024-08-20T01:38:44.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.076+0000 7fd0c76f6640 1 -- 172.21.15.79:0/3616648758 wait complete. 2024-08-20T01:38:44.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.076+0000 7fd0c76f6640 1 Processor -- start 2024-08-20T01:38:44.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.076+0000 7fd0c76f6640 1 -- start start 2024-08-20T01:38:44.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.076+0000 7fd0c76f6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0c0101560 0x7fd0c0197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:44.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.076+0000 7fd0c76f6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0c01026b0 0x7fd0c0197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:44.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.076+0000 7fd0c76f6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0c0103070 0x7fd0c0198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:44.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.076+0000 7fd0c76f6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c010d060 con 0x7fd0c01026b0 2024-08-20T01:38:44.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.076+0000 7fd0c76f6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c010cee0 con 0x7fd0c0103070 2024-08-20T01:38:44.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.076+0000 7fd0c76f6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c010d1e0 con 0x7fd0c0101560 2024-08-20T01:38:44.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.076+0000 7fd0c4c91640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0c01026b0 0x7fd0c0197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:44.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.076+0000 7fd0c4c91640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0c01026b0 0x7fd0c0197e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40852/0 (socket says 172.21.15.79:40852) 2024-08-20T01:38:44.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.076+0000 7fd0c4c91640 1 -- 172.21.15.79:0/1644155361 learned_addr learned my addr 172.21.15.79:0/1644155361 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:44.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.077+0000 7fd0c5c93640 1 --2- 172.21.15.79:0/1644155361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0c0103070 0x7fd0c0198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:44.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.077+0000 7fd0c5492640 1 --2- 172.21.15.79:0/1644155361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0c0101560 0x7fd0c0197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:44.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.077+0000 7fd0c4c91640 1 -- 172.21.15.79:0/1644155361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0c0101560 msgr2=0x7fd0c0197840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:44.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.077+0000 7fd0c4c91640 1 --2- 172.21.15.79:0/1644155361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0c0101560 0x7fd0c0197840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:44.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.077+0000 7fd0c4c91640 1 -- 172.21.15.79:0/1644155361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0c0103070 msgr2=0x7fd0c0198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:44.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.077+0000 7fd0c4c91640 1 --2- 172.21.15.79:0/1644155361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0c0103070 0x7fd0c0198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:44.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.077+0000 7fd0c4c91640 1 -- 172.21.15.79:0/1644155361 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0c0199380 con 0x7fd0c01026b0 2024-08-20T01:38:44.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.077+0000 7fd0c4c91640 1 --2- 172.21.15.79:0/1644155361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0c01026b0 0x7fd0c0197e90 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0009900 tx=0x7fd0b0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:44.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.077+0000 7fd0b67fc640 1 -- 172.21.15.79:0/1644155361 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b0046070 con 0x7fd0c01026b0 2024-08-20T01:38:44.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.077+0000 7fd0b67fc640 1 -- 172.21.15.79:0/1644155361 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd0b0004440 con 0x7fd0c01026b0 2024-08-20T01:38:44.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.077+0000 7fd0c76f6640 1 -- 172.21.15.79:0/1644155361 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0c0199610 con 0x7fd0c01026b0 2024-08-20T01:38:44.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.077+0000 7fd0b67fc640 1 -- 172.21.15.79:0/1644155361 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b0035050 con 0x7fd0c01026b0 2024-08-20T01:38:44.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.077+0000 7fd0c76f6640 1 -- 172.21.15.79:0/1644155361 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0c006a710 con 0x7fd0c01026b0 2024-08-20T01:38:44.090 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.080+0000 7fd0b67fc640 1 -- 172.21.15.79:0/1644155361 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fd0b0049070 con 0x7fd0c01026b0 2024-08-20T01:38:44.090 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.080+0000 7fd0ca122740 1 Processor -- start 2024-08-20T01:38:44.090 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.080+0000 7fd0ca122740 1 -- start start 2024-08-20T01:38:44.090 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.081+0000 7fd0ca122740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5a86a68d0 0x55f5a86a8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:44.090 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.081+0000 7fd0ca122740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f5a86a9200 0x55f5a86ab5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:44.090 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.081+0000 7fd0ca122740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f5a86abc40 0x55f5a86ae100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:44.090 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.081+0000 7fd0ca122740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f5a8619360 con 0x55f5a86a9200 2024-08-20T01:38:44.090 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.081+0000 7fd0ca122740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f5a8608860 con 0x55f5a86abc40 2024-08-20T01:38:44.090 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.081+0000 7fd0ca122740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f5a860c8a0 con 0x55f5a86a68d0 2024-08-20T01:38:44.090 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.081+0000 7fd0b67fc640 1 --2- 172.21.15.79:0/1644155361 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd0ac0b3c50 0x7fd0ac0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:44.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.081+0000 7fd0c5492640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f5a86a9200 0x55f5a86ab5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:44.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.081+0000 7fd0c5492640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f5a86a9200 0x55f5a86ab5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40864/0 (socket says 172.21.15.79:40864) 2024-08-20T01:38:44.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.081+0000 7fd0c5c93640 1 --2- 172.21.15.79:0/1644155361 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd0ac0b3c50 0x7fd0ac0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:44.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.081+0000 7fd0c5492640 1 -- 172.21.15.79:0/2123345591 learned_addr learned my addr 172.21.15.79:0/2123345591 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:44.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.081+0000 7fd0c5c93640 1 --2- 172.21.15.79:0/2123345591 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5a86a68d0 0x55f5a86a8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:44.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.081+0000 7fd0c4c91640 1 --2- 172.21.15.79:0/2123345591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f5a86abc40 0x55f5a86ae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:44.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.081+0000 7fd0b67fc640 1 -- 172.21.15.79:0/1644155361 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fd0b0105750 con 0x7fd0c01026b0 2024-08-20T01:38:44.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.081+0000 7fd0c5492640 1 -- 172.21.15.79:0/2123345591 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5a86a68d0 msgr2=0x55f5a86a8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:44.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.081+0000 7fd0c5492640 1 --2- 172.21.15.79:0/2123345591 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5a86a68d0 0x55f5a86a8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:44.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.081+0000 7fd0c5492640 1 -- 172.21.15.79:0/2123345591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f5a86abc40 msgr2=0x55f5a86ae100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:44.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.081+0000 7fd0c5492640 1 --2- 172.21.15.79:0/2123345591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f5a86abc40 0x55f5a86ae100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:44.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.081+0000 7fd0c5492640 1 -- 172.21.15.79:0/2123345591 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5a85afe40 con 0x55f5a86a9200 2024-08-20T01:38:44.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.081+0000 7fd0c5c93640 1 --2- 172.21.15.79:0/1644155361 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd0ac0b3c50 0x7fd0ac0b6110 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd0b80077f0 tx=0x7fd0b8007de0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:44.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.081+0000 7fd0c5492640 1 --2- 172.21.15.79:0/2123345591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f5a86a9200 0x55f5a86ab5f0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc009c80 tx=0x7fd0bc0117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4c5e6df865ce851 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:44.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.082+0000 7fd0ab7fe640 1 -- 172.21.15.79:0/2123345591 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc012450 con 0x55f5a86a9200 2024-08-20T01:38:44.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.082+0000 7fd0ab7fe640 1 -- 172.21.15.79:0/2123345591 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd0bc012a80 con 0x55f5a86a9200 2024-08-20T01:38:44.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.082+0000 7fd0ab7fe640 1 -- 172.21.15.79:0/2123345591 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc00f9b0 con 0x55f5a86a9200 2024-08-20T01:38:44.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.082+0000 7fd0ca122740 1 -- 172.21.15.79:0/2123345591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f5a86a9200 msgr2=0x55f5a86ab5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:44.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.082+0000 7fd0ca122740 1 --2- 172.21.15.79:0/2123345591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f5a86a9200 0x55f5a86ab5f0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc009c80 tx=0x7fd0bc0117b0 comp rx=0 tx=0).stop 2024-08-20T01:38:44.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.083+0000 7fd0ca122740 1 -- 172.21.15.79:0/2123345591 shutdown_connections 2024-08-20T01:38:44.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.083+0000 7fd0ca122740 1 --2- 172.21.15.79:0/2123345591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f5a86abc40 0x55f5a86ae100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:44.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.083+0000 7fd0ca122740 1 --2- 172.21.15.79:0/2123345591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f5a86a9200 0x55f5a86ab5f0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:44.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.083+0000 7fd0ca122740 1 --2- 172.21.15.79:0/2123345591 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5a86a68d0 0x55f5a86a8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:44.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.083+0000 7fd0ca122740 1 -- 172.21.15.79:0/2123345591 >> 172.21.15.79:0/2123345591 conn(0x55f5a86a1a20 msgr2=0x55f5a86a27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:44.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.083+0000 7fd0ca122740 1 -- 172.21.15.79:0/2123345591 shutdown_connections 2024-08-20T01:38:44.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.083+0000 7fd0ca122740 1 -- 172.21.15.79:0/2123345591 wait complete. 2024-08-20T01:38:44.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.083+0000 7fd0ca122740 1 -- start start 2024-08-20T01:38:44.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.083+0000 7fd0ca122740 1 Processor -- start 2024-08-20T01:38:44.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.083+0000 7fd0ca122740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f5a86a68d0 0x55f5a86b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:44.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.083+0000 7fd0ca122740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f5a86a9200 0x55f5a86b0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:44.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.083+0000 7fd0ca122740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5a86abc40 0x55f5a86b1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:44.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.084+0000 7fd0ca122740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f5a8541ab0 con 0x55f5a86a68d0 2024-08-20T01:38:44.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.084+0000 7fd0ca122740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f5a858f780 con 0x55f5a86a9200 2024-08-20T01:38:44.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.084+0000 7fd0c5492640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f5a86a68d0 0x55f5a86b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:44.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.084+0000 7fd0ca122740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f5a86aec20 con 0x55f5a86abc40 2024-08-20T01:38:44.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.084+0000 7fd0c5492640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f5a86a68d0 0x55f5a86b00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40870/0 (socket says 172.21.15.79:40870) 2024-08-20T01:38:44.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.084+0000 7fd0c5492640 1 -- 172.21.15.79:0/2426057367 learned_addr learned my addr 172.21.15.79:0/2426057367 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:44.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.084+0000 7fd0c4c91640 1 --2- 172.21.15.79:0/2426057367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f5a86a9200 0x55f5a86b0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:44.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.084+0000 7fd0ca122740 10 client.0 _ll_register_callbacks cb 0x55f5a8317a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:44.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.084+0000 7fd0c5c93640 1 --2- 172.21.15.79:0/2426057367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5a86abc40 0x55f5a86b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:44.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.084+0000 7fd0c5492640 1 -- 172.21.15.79:0/2426057367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5a86abc40 msgr2=0x55f5a86b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:44.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.084+0000 7fd0c5492640 1 --2- 172.21.15.79:0/2426057367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5a86abc40 0x55f5a86b1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:44.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.084+0000 7fd0c5492640 1 -- 172.21.15.79:0/2426057367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f5a86a9200 msgr2=0x55f5a86b0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:44.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.084+0000 7fd0c5492640 1 --2- 172.21.15.79:0/2426057367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f5a86a9200 0x55f5a86b0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:44.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.084+0000 7fd0c5492640 1 -- 172.21.15.79:0/2426057367 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5a836b790 con 0x55f5a86a68d0 2024-08-20T01:38:44.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.084+0000 7fd0c5492640 1 --2- 172.21.15.79:0/2426057367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f5a86a68d0 0x55f5a86b00d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc005d80 tx=0x7fd0bc0056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b99fa94f5bcd6b13 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:44.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.084+0000 7fd0a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:38:44.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.084+0000 7fd0a8ff9640 1 -- 172.21.15.79:0/2426057367 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc01f040 con 0x55f5a86a68d0 2024-08-20T01:38:44.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.084+0000 7fd0a8ff9640 1 -- 172.21.15.79:0/2426057367 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fd0bc004050 con 0x55f5a86a68d0 2024-08-20T01:38:44.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.084+0000 7fd0ca122740 1 -- 172.21.15.79:0/2426057367 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f5a85b7e00 con 0x55f5a86a68d0 2024-08-20T01:38:44.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.084+0000 7fd0a8ff9640 1 -- 172.21.15.79:0/2426057367 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fd0bc004250 con 0x55f5a86a68d0 2024-08-20T01:38:44.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.084+0000 7fd0ca122740 10 client.16113 fetch_fsmap learned FSMap version 33 2024-08-20T01:38:44.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.084+0000 7fd0ca122740 1 -- 172.21.15.79:0/2426057367 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55f5a83e4620 con 0x55f5a86a68d0 2024-08-20T01:38:44.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.085+0000 7fd0a8ff9640 1 -- 172.21.15.79:0/2426057367 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55f5a85b7e00 con 0x55f5a86a68d0 2024-08-20T01:38:44.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.085+0000 7fd0a8ff9640 1 -- 172.21.15.79:0/2426057367 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7fd0bc022070 con 0x55f5a86a68d0 2024-08-20T01:38:44.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.085+0000 7fd0ca122740 10 client.16113 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:38:44.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.085+0000 7fd0ca122740 10 client.16113 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:38:44.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.085+0000 7fd0ca122740 20 client.16113 populate_metadata read hostname 'smithi079' 2024-08-20T01:38:44.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.085+0000 7fd0ca122740 1 --2- 172.21.15.79:0/2426057367 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f5a86bb660 0x55f5a86bdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:44.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.085+0000 7fd0ca122740 4 client.16113 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:38:44.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.085+0000 7fd0ca122740 1 -- 172.21.15.79:0/2426057367 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f5a861b2b0 con 0x55f5a86bb660 2024-08-20T01:38:44.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.085+0000 7fd0c4c91640 1 --2- 172.21.15.79:0/2426057367 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f5a86bb660 0x55f5a86bdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:44.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.085+0000 7fd0a8ff9640 10 client.16113 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:44.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.085+0000 7fd0c4c91640 1 --2- 172.21.15.79:0/2426057367 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f5a86bb660 0x55f5a86bdae0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17b531c592d8cd8f server_cookie=26a96e4be06b2f47 in_seq=0 out_seq=0 2024-08-20T01:38:44.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.086+0000 7fd0a8ff9640 1 -- 172.21.15.79:0/2426057367 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f5a861b2b0 con 0x55f5a86bb660 2024-08-20T01:38:44.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.086+0000 7fd0a8ff9640 10 client.16113 handle_command_reply: tid=0 2024-08-20T01:38:44.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.086+0000 7fd0ca122740 1 client.16113 shutdown 2024-08-20T01:38:44.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.086+0000 7fd0ca122740 1 -- 172.21.15.79:0/2426057367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f5a86a68d0 msgr2=0x55f5a86b00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:44.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.086+0000 7fd0ca122740 1 --2- 172.21.15.79:0/2426057367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f5a86a68d0 0x55f5a86b00d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc005d80 tx=0x7fd0bc0056a0 comp rx=0 tx=0).stop 2024-08-20T01:38:44.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.086+0000 7fd0ca122740 1 -- 172.21.15.79:0/2426057367 shutdown_connections 2024-08-20T01:38:44.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.086+0000 7fd0ca122740 1 --2- 172.21.15.79:0/2426057367 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f5a86bb660 0x55f5a86bdae0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:44.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.086+0000 7fd0ca122740 1 --2- 172.21.15.79:0/2426057367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5a86abc40 0x55f5a86b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:44.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.086+0000 7fd0ca122740 1 --2- 172.21.15.79:0/2426057367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f5a86a9200 0x55f5a86b0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:44.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.086+0000 7fd0a8ff9640 0 client.16113 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:44.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.086+0000 7fd0ca122740 1 --2- 172.21.15.79:0/2426057367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f5a86a68d0 0x55f5a86b00d0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:44.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.086+0000 7fd0ca122740 1 -- 172.21.15.79:0/2426057367 >> 172.21.15.79:0/2426057367 conn(0x55f5a86a1a20 msgr2=0x55f5a86a0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:44.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.086+0000 7fd0ca122740 1 -- 172.21.15.79:0/2426057367 shutdown_connections 2024-08-20T01:38:44.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.086+0000 7fd0ca122740 1 -- 172.21.15.79:0/2426057367 wait complete. 2024-08-20T01:38:44.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.087+0000 7fd0ca122740 20 client.16113 trim_cache size 0 max 16384 2024-08-20T01:38:44.115 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.108+0000 7fd0ca122740 1 Processor -- start 2024-08-20T01:38:44.115 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.108+0000 7fd0ca122740 1 -- start start 2024-08-20T01:38:44.115 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.108+0000 7fd0ca122740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f5a86a68d0 0x55f5a869c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:44.115 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.108+0000 7fd0ca122740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5a86a9200 0x55f5a86a2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:44.115 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.108+0000 7fd0ca122740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f5a86abc40 0x55f5a86a2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:44.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.108+0000 7fd0ca122740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c01a78c0 con 0x55f5a86abc40 2024-08-20T01:38:44.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.108+0000 7fd0ca122740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c01a9550 con 0x55f5a86a68d0 2024-08-20T01:38:44.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.108+0000 7fd0ca122740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c01a7f90 con 0x55f5a86a9200 2024-08-20T01:38:44.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.108+0000 7fd0c5c93640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f5a86abc40 0x55f5a86a2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:44.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.108+0000 7fd0c5c93640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f5a86abc40 0x55f5a86a2860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40880/0 (socket says 172.21.15.79:40880) 2024-08-20T01:38:44.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.108+0000 7fd0c5c93640 1 -- 172.21.15.79:0/2933427915 learned_addr learned my addr 172.21.15.79:0/2933427915 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:44.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.109+0000 7fd0c4c91640 1 --2- 172.21.15.79:0/2933427915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5a86a9200 0x55f5a86a2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:44.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.109+0000 7fd0c5492640 1 --2- 172.21.15.79:0/2933427915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f5a86a68d0 0x55f5a869c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:44.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.109+0000 7fd0c5c93640 1 -- 172.21.15.79:0/2933427915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5a86a9200 msgr2=0x55f5a86a2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:44.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.109+0000 7fd0c5c93640 1 --2- 172.21.15.79:0/2933427915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5a86a9200 0x55f5a86a2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:44.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.109+0000 7fd0c5c93640 1 -- 172.21.15.79:0/2933427915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f5a86a68d0 msgr2=0x55f5a869c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:44.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.109+0000 7fd0c5c93640 1 --2- 172.21.15.79:0/2933427915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f5a86a68d0 0x55f5a869c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:44.117 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.109+0000 7fd0c5c93640 1 -- 172.21.15.79:0/2933427915 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5a869bd60 con 0x55f5a86abc40 2024-08-20T01:38:44.117 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.109+0000 7fd0c4c91640 1 --2- 172.21.15.79:0/2933427915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5a86a9200 0x55f5a86a2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:44.117 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.109+0000 7fd0c5c93640 1 --2- 172.21.15.79:0/2933427915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f5a86abc40 0x55f5a86a2860 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8014820 tx=0x7fd0b8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dec07efce4a3a11c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:44.117 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.109+0000 7fd0aaffd640 1 -- 172.21.15.79:0/2933427915 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b8025070 con 0x55f5a86abc40 2024-08-20T01:38:44.117 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.109+0000 7fd0aaffd640 1 -- 172.21.15.79:0/2933427915 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd0b8004d20 con 0x55f5a86abc40 2024-08-20T01:38:44.117 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.109+0000 7fd0aaffd640 1 -- 172.21.15.79:0/2933427915 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b8005480 con 0x55f5a86abc40 2024-08-20T01:38:44.117 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.110+0000 7fd0ca122740 1 -- 172.21.15.79:0/2933427915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f5a86abc40 msgr2=0x55f5a86a2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:44.117 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.110+0000 7fd0ca122740 1 --2- 172.21.15.79:0/2933427915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f5a86abc40 0x55f5a86a2860 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8014820 tx=0x7fd0b8004ab0 comp rx=0 tx=0).stop 2024-08-20T01:38:44.117 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.110+0000 7fd0ca122740 1 -- 172.21.15.79:0/2933427915 shutdown_connections 2024-08-20T01:38:44.117 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.110+0000 7fd0ca122740 1 --2- 172.21.15.79:0/2933427915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f5a86abc40 0x55f5a86a2860 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:44.117 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.110+0000 7fd0ca122740 1 --2- 172.21.15.79:0/2933427915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5a86a9200 0x55f5a86a2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:44.117 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.110+0000 7fd0ca122740 1 --2- 172.21.15.79:0/2933427915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f5a86a68d0 0x55f5a869c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.110+0000 7fd0ca122740 1 -- 172.21.15.79:0/2933427915 >> 172.21.15.79:0/2933427915 conn(0x55f5a86a1a20 msgr2=0x55f5a86af290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.110+0000 7fd0ca122740 1 -- 172.21.15.79:0/2933427915 shutdown_connections 2024-08-20T01:38:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.110+0000 7fd0ca122740 1 -- 172.21.15.79:0/2933427915 wait complete. 2024-08-20T01:38:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.110+0000 7fd0ca122740 1 -- start start 2024-08-20T01:38:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.110+0000 7fd0ca122740 1 Processor -- start 2024-08-20T01:38:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.111+0000 7fd0ca122740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f5a86a68d0 0x55f5a86b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.111+0000 7fd0ca122740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5a86a9200 0x55f5a86b5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.111+0000 7fd0ca122740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f5a86abc40 0x55f5a86b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.111+0000 7fd0ca122740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c01a8dc0 con 0x55f5a86abc40 2024-08-20T01:38:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.111+0000 7fd0ca122740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c01a8660 con 0x55f5a86a68d0 2024-08-20T01:38:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.111+0000 7fd0ca122740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c01a58a0 con 0x55f5a86a9200 2024-08-20T01:38:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.111+0000 7fd0ca122740 10 client.0 _ll_register_callbacks cb 0x7fd0b0005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.111+0000 7fd0c5c93640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f5a86abc40 0x55f5a86b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.111+0000 7fd0c5c93640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f5a86abc40 0x55f5a86b60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40892/0 (socket says 172.21.15.79:40892) 2024-08-20T01:38:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.111+0000 7fd0c5c93640 1 -- 172.21.15.79:0/1203111165 learned_addr learned my addr 172.21.15.79:0/1203111165 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.111+0000 7fd0c5492640 1 --2- 172.21.15.79:0/1203111165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f5a86a68d0 0x55f5a86b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.111+0000 7fd0c4c91640 1 --2- 172.21.15.79:0/1203111165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5a86a9200 0x55f5a86b5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.111+0000 7fd0c5c93640 1 -- 172.21.15.79:0/1203111165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5a86a9200 msgr2=0x55f5a86b5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.111+0000 7fd0c5c93640 1 --2- 172.21.15.79:0/1203111165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5a86a9200 0x55f5a86b5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.111+0000 7fd0c5c93640 1 -- 172.21.15.79:0/1203111165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f5a86a68d0 msgr2=0x55f5a86b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.111+0000 7fd0c5c93640 1 --2- 172.21.15.79:0/1203111165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f5a86a68d0 0x55f5a86b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.111+0000 7fd0c5c93640 1 -- 172.21.15.79:0/1203111165 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5a86b6900 con 0x55f5a86abc40 2024-08-20T01:38:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.111+0000 7fd0c4c91640 1 --2- 172.21.15.79:0/1203111165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5a86a9200 0x55f5a86b5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:38:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.111+0000 7fd0c5492640 1 --2- 172.21.15.79:0/1203111165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f5a86a68d0 0x55f5a86b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.112+0000 7fd0c5c93640 1 --2- 172.21.15.79:0/1203111165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f5a86abc40 0x55f5a86b60d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8012cf0 tx=0x7fd0b8007520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d05a189a54a5925e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.112+0000 7fd0a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:38:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.112+0000 7fd0a8ff9640 1 -- 172.21.15.79:0/1203111165 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b8037060 con 0x55f5a86abc40 2024-08-20T01:38:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.112+0000 7fd0a8ff9640 1 -- 172.21.15.79:0/1203111165 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fd0b80053b0 con 0x55f5a86abc40 2024-08-20T01:38:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.112+0000 7fd0ca122740 1 -- 172.21.15.79:0/1203111165 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0b8004d20 con 0x55f5a86abc40 2024-08-20T01:38:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.112+0000 7fd0a8ff9640 1 -- 172.21.15.79:0/1203111165 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fd0b8025070 con 0x55f5a86abc40 2024-08-20T01:38:44.121 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.112+0000 7fd0ca122740 10 client.16119 fetch_fsmap learned FSMap version 33 2024-08-20T01:38:44.121 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.112+0000 7fd0ca122740 1 -- 172.21.15.79:0/1203111165 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55f5a86b7ca0 con 0x55f5a86abc40 2024-08-20T01:38:44.121 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.112+0000 7fd0a8ff9640 1 -- 172.21.15.79:0/1203111165 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd0b8004d20 con 0x55f5a86abc40 2024-08-20T01:38:44.121 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.112+0000 7fd0a8ff9640 1 -- 172.21.15.79:0/1203111165 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7fd0b8031030 con 0x55f5a86abc40 2024-08-20T01:38:44.122 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.112+0000 7fd0ca122740 10 client.16119 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:38:44.122 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.112+0000 7fd0ca122740 10 client.16119 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:38:44.122 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.112+0000 7fd0ca122740 20 client.16119 populate_metadata read hostname 'smithi079' 2024-08-20T01:38:44.122 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.112+0000 7fd0ca122740 1 --2- 172.21.15.79:0/1203111165 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f5a872aac0 0x55f5a872cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:44.122 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.112+0000 7fd0ca122740 4 client.16119 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:38:44.122 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.112+0000 7fd0ca122740 1 -- 172.21.15.79:0/1203111165 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f5a86b0520 con 0x55f5a872aac0 2024-08-20T01:38:44.122 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.113+0000 7fd0c5492640 1 --2- 172.21.15.79:0/1203111165 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f5a872aac0 0x55f5a872cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:44.122 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.113+0000 7fd0c5492640 1 --2- 172.21.15.79:0/1203111165 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f5a872aac0 0x55f5a872cee0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a3a14c36d6ab9a0 server_cookie=19ff202d1137f8a in_seq=0 out_seq=0 2024-08-20T01:38:44.122 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.113+0000 7fd0a8ff9640 10 client.16119 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.124+0000 7fd0a8ff9640 1 -- 172.21.15.79:0/1203111165 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f5a86b0520 con 0x55f5a872aac0 2024-08-20T01:38:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.124+0000 7fd0a8ff9640 10 client.16119 handle_command_reply: tid=0 2024-08-20T01:38:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.124+0000 7fd0ca122740 1 client.16119 shutdown 2024-08-20T01:38:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.124+0000 7fd0ca122740 1 -- 172.21.15.79:0/1203111165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f5a86abc40 msgr2=0x55f5a86b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.124+0000 7fd0ca122740 1 --2- 172.21.15.79:0/1203111165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f5a86abc40 0x55f5a86b60d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8012cf0 tx=0x7fd0b8007520 comp rx=0 tx=0).stop 2024-08-20T01:38:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.124+0000 7fd0ca122740 1 -- 172.21.15.79:0/1203111165 shutdown_connections 2024-08-20T01:38:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.124+0000 7fd0ca122740 1 --2- 172.21.15.79:0/1203111165 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f5a872aac0 0x55f5a872cee0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:44.128 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.124+0000 7fd0ca122740 1 --2- 172.21.15.79:0/1203111165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f5a86abc40 0x55f5a86b60d0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:44.128 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.124+0000 7fd0a8ff9640 0 client.16119 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:44.128 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.124+0000 7fd0ca122740 1 --2- 172.21.15.79:0/1203111165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5a86a9200 0x55f5a86b5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:44.128 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.124+0000 7fd0ca122740 1 --2- 172.21.15.79:0/1203111165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f5a86a68d0 0x55f5a86b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:44.128 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.124+0000 7fd0ca122740 1 -- 172.21.15.79:0/1203111165 >> 172.21.15.79:0/1203111165 conn(0x55f5a86a1a20 msgr2=0x55f5a86a2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:44.128 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.124+0000 7fd0ca122740 1 -- 172.21.15.79:0/1203111165 shutdown_connections 2024-08-20T01:38:44.128 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.124+0000 7fd0ca122740 1 -- 172.21.15.79:0/1203111165 wait complete. 2024-08-20T01:38:44.128 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.125+0000 7fd0ca122740 20 client.16119 trim_cache size 0 max 16384 2024-08-20T01:38:44.128 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:38:44.128 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:38:44.128 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:38:44.129 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:38:44.129 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.125+0000 7fd0c76f6640 1 -- 172.21.15.79:0/1644155361 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd0ac0b3c50 msgr2=0x7fd0ac0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:44.129 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.125+0000 7fd0c76f6640 1 --2- 172.21.15.79:0/1644155361 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd0ac0b3c50 0x7fd0ac0b6110 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd0b80077f0 tx=0x7fd0b8007de0 comp rx=0 tx=0).stop 2024-08-20T01:38:44.129 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.125+0000 7fd0c76f6640 1 -- 172.21.15.79:0/1644155361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0c01026b0 msgr2=0x7fd0c0197e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:44.129 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.125+0000 7fd0c76f6640 1 --2- 172.21.15.79:0/1644155361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0c01026b0 0x7fd0c0197e90 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0009900 tx=0x7fd0b0004040 comp rx=0 tx=0).stop 2024-08-20T01:38:44.129 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.125+0000 7fd0c76f6640 1 -- 172.21.15.79:0/1644155361 shutdown_connections 2024-08-20T01:38:44.130 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.125+0000 7fd0c76f6640 1 --2- 172.21.15.79:0/1644155361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0c0103070 0x7fd0c0198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:44.130 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.125+0000 7fd0c76f6640 1 --2- 172.21.15.79:0/1644155361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0c01026b0 0x7fd0c0197e90 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:44.130 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.125+0000 7fd0c76f6640 1 --2- 172.21.15.79:0/1644155361 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd0ac0b3c50 0x7fd0ac0b6110 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:44.130 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.125+0000 7fd0c76f6640 1 --2- 172.21.15.79:0/1644155361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0c0101560 0x7fd0c0197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:44.130 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.125+0000 7fd0c76f6640 1 -- 172.21.15.79:0/1644155361 >> 172.21.15.79:0/1644155361 conn(0x7fd0c00fce40 msgr2=0x7fd0c0103a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:44.130 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.125+0000 7fd0c76f6640 1 -- 172.21.15.79:0/1644155361 shutdown_connections 2024-08-20T01:38:44.130 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:44.125+0000 7fd0c76f6640 1 -- 172.21.15.79:0/1644155361 wait complete. 2024-08-20T01:38:45.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:45 smithi175 ceph-mon[22392]: pgmap v390: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 30 MiB/s wr, 53 op/s 2024-08-20T01:38:45.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:45 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:38:45.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:45 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:38:45.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:45 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:38:45.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:45 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:38:45.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:45 smithi079 ceph-mon[18656]: pgmap v390: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 30 MiB/s wr, 53 op/s 2024-08-20T01:38:45.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:45 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:38:45.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:45 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:38:45.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:45 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:38:45.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:45 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:38:46.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:45 smithi081 ceph-mon[22209]: pgmap v390: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 30 MiB/s wr, 53 op/s 2024-08-20T01:38:46.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:45 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:38:46.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:45 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:38:46.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:45 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:38:46.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:45 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:38:47.882 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:47 smithi079 ceph-mon[18656]: pgmap v391: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 30 MiB/s wr, 39 op/s 2024-08-20T01:38:47.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:47 smithi175 ceph-mon[22392]: pgmap v391: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 30 MiB/s wr, 39 op/s 2024-08-20T01:38:48.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:47 smithi081 ceph-mon[22209]: pgmap v391: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 30 MiB/s wr, 39 op/s 2024-08-20T01:38:49.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:49 smithi175 ceph-mon[22392]: pgmap v392: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 30 MiB/s wr, 31 op/s 2024-08-20T01:38:49.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:49 smithi079 ceph-mon[18656]: pgmap v392: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 30 MiB/s wr, 31 op/s 2024-08-20T01:38:50.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:49 smithi081 ceph-mon[22209]: pgmap v392: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 30 MiB/s wr, 31 op/s 2024-08-20T01:38:51.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:51 smithi175 ceph-mon[22392]: pgmap v393: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 30 MiB/s wr, 26 op/s 2024-08-20T01:38:51.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:51 smithi079 ceph-mon[18656]: pgmap v393: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 30 MiB/s wr, 26 op/s 2024-08-20T01:38:52.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:51 smithi081 ceph-mon[22209]: pgmap v393: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 30 MiB/s wr, 26 op/s 2024-08-20T01:38:53.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:53 smithi175 ceph-mon[22392]: pgmap v394: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 29 MiB/s wr, 24 op/s 2024-08-20T01:38:53.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:53 smithi079 ceph-mon[18656]: pgmap v394: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 29 MiB/s wr, 24 op/s 2024-08-20T01:38:54.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:53 smithi081 ceph-mon[22209]: pgmap v394: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 29 MiB/s wr, 24 op/s 2024-08-20T01:38:55.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:55 smithi175 ceph-mon[22392]: pgmap v395: 97 pgs: 97 active+clean; 1.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 30 MiB/s wr, 28 op/s 2024-08-20T01:38:55.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:55 smithi079 ceph-mon[18656]: pgmap v395: 97 pgs: 97 active+clean; 1.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 30 MiB/s wr, 28 op/s 2024-08-20T01:38:56.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:55 smithi081 ceph-mon[22209]: pgmap v395: 97 pgs: 97 active+clean; 1.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 30 MiB/s wr, 28 op/s 2024-08-20T01:38:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.220+0000 7f07c274b640 1 -- 172.21.15.79:0/3390399721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07bc101560 msgr2=0x7f07bc101960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.220+0000 7f07c274b640 1 --2- 172.21.15.79:0/3390399721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07bc101560 0x7f07bc101960 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f07ac009930 tx=0x7f07ac02a420 comp rx=0 tx=0).stop 2024-08-20T01:38:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.220+0000 7f07c274b640 1 -- 172.21.15.79:0/3390399721 shutdown_connections 2024-08-20T01:38:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.220+0000 7f07c274b640 1 --2- 172.21.15.79:0/3390399721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07bc103070 0x7f07bc1099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.220+0000 7f07c274b640 1 --2- 172.21.15.79:0/3390399721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07bc1026b0 0x7f07bc102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.220+0000 7f07c274b640 1 --2- 172.21.15.79:0/3390399721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07bc101560 0x7f07bc101960 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.220+0000 7f07c274b640 1 -- 172.21.15.79:0/3390399721 >> 172.21.15.79:0/3390399721 conn(0x7f07bc0fce20 msgr2=0x7f07bc0ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.220+0000 7f07c274b640 1 -- 172.21.15.79:0/3390399721 shutdown_connections 2024-08-20T01:38:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.220+0000 7f07c274b640 1 -- 172.21.15.79:0/3390399721 wait complete. 2024-08-20T01:38:57.224 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.221+0000 7f07c274b640 1 Processor -- start 2024-08-20T01:38:57.224 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.221+0000 7f07c274b640 1 -- start start 2024-08-20T01:38:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.221+0000 7f07c274b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07bc101560 0x7f07bc06b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.221+0000 7f07c274b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07bc1026b0 0x7f07bc19d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.221+0000 7f07c274b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07bc103070 0x7f07bc19fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.221+0000 7f07c274b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f07bc10d0d0 con 0x7f07bc101560 2024-08-20T01:38:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.221+0000 7f07c274b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f07bc10cf50 con 0x7f07bc103070 2024-08-20T01:38:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.221+0000 7f07c274b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f07bc10d250 con 0x7f07bc1026b0 2024-08-20T01:38:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.221+0000 7f07bbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07bc101560 0x7f07bc06b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.221+0000 7f07bbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07bc101560 0x7f07bc06b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54964/0 (socket says 172.21.15.79:54964) 2024-08-20T01:38:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.222+0000 7f07bbfff640 1 -- 172.21.15.79:0/2768836126 learned_addr learned my addr 172.21.15.79:0/2768836126 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.222+0000 7f07bb7fe640 1 --2- 172.21.15.79:0/2768836126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07bc1026b0 0x7f07bc19d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.222+0000 7f07c0ce8640 1 --2- 172.21.15.79:0/2768836126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07bc103070 0x7f07bc19fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.222+0000 7f07bbfff640 1 -- 172.21.15.79:0/2768836126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07bc1026b0 msgr2=0x7f07bc19d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.222+0000 7f07bbfff640 1 --2- 172.21.15.79:0/2768836126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07bc1026b0 0x7f07bc19d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.222+0000 7f07bbfff640 1 -- 172.21.15.79:0/2768836126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07bc103070 msgr2=0x7f07bc19fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.222+0000 7f07bbfff640 1 --2- 172.21.15.79:0/2768836126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07bc103070 0x7f07bc19fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.222+0000 7f07bbfff640 1 -- 172.21.15.79:0/2768836126 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07bc1a0570 con 0x7f07bc101560 2024-08-20T01:38:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.222+0000 7f07bbfff640 1 --2- 172.21.15.79:0/2768836126 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07bc101560 0x7f07bc06b6a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f07ac031460 tx=0x7f07ac003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.222+0000 7f07b97fa640 1 -- 172.21.15.79:0/2768836126 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ac03f070 con 0x7f07bc101560 2024-08-20T01:38:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.222+0000 7f07c274b640 1 -- 172.21.15.79:0/2768836126 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07bc1a0800 con 0x7f07bc101560 2024-08-20T01:38:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.222+0000 7f07b97fa640 1 -- 172.21.15.79:0/2768836126 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07ac031ba0 con 0x7f07bc101560 2024-08-20T01:38:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.222+0000 7f07b97fa640 1 -- 172.21.15.79:0/2768836126 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ac035030 con 0x7f07bc101560 2024-08-20T01:38:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.222+0000 7f07c274b640 1 -- 172.21.15.79:0/2768836126 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07bc1a0d40 con 0x7f07bc101560 2024-08-20T01:38:57.234 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.225+0000 7f07b97fa640 1 -- 172.21.15.79:0/2768836126 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f07ac042070 con 0x7f07bc101560 2024-08-20T01:38:57.234 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.225+0000 7f07c5614740 1 Processor -- start 2024-08-20T01:38:57.234 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.225+0000 7f07c5614740 1 -- start start 2024-08-20T01:38:57.234 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.225+0000 7f07c5614740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7e749c630 0x55d7e749ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:57.234 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.225+0000 7f07c5614740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7e749ef60 0x55d7e74a1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:57.234 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.225+0000 7f07c5614740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7e74a19a0 0x55d7e74a3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:57.234 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.225+0000 7f07c5614740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d7e740f360 con 0x55d7e749c630 2024-08-20T01:38:57.234 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.225+0000 7f07c5614740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d7e73fe860 con 0x55d7e74a19a0 2024-08-20T01:38:57.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.226+0000 7f07c5614740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d7e74028a0 con 0x55d7e749ef60 2024-08-20T01:38:57.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.226+0000 7f07c0ce8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7e749c630 0x55d7e749ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:57.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.226+0000 7f07c0ce8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7e749c630 0x55d7e749ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54968/0 (socket says 172.21.15.79:54968) 2024-08-20T01:38:57.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.226+0000 7f07c0ce8640 1 -- 172.21.15.79:0/2652572922 learned_addr learned my addr 172.21.15.79:0/2652572922 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:57.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.226+0000 7f07bbfff640 1 --2- 172.21.15.79:0/2652572922 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7e749ef60 0x55d7e74a1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:57.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.226+0000 7f07b97fa640 1 --2- 172.21.15.79:0/2768836126 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f07a40b3bd0 0x7f07a40b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:57.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.226+0000 7f07bb7fe640 1 --2- 172.21.15.79:0/2652572922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7e74a19a0 0x55d7e74a3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:57.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.226+0000 7f07c0ce8640 1 --2- 172.21.15.79:0/2768836126 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f07a40b3bd0 0x7f07a40b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:57.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.226+0000 7f07c0ce8640 1 -- 172.21.15.79:0/2652572922 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7e749ef60 msgr2=0x55d7e74a1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:57.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.226+0000 7f07c0ce8640 1 --2- 172.21.15.79:0/2652572922 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7e749ef60 0x55d7e74a1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:57.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.226+0000 7f07c0ce8640 1 -- 172.21.15.79:0/2652572922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7e74a19a0 msgr2=0x55d7e74a3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:57.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.226+0000 7f07c0ce8640 1 --2- 172.21.15.79:0/2652572922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7e74a19a0 0x55d7e74a3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:57.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.226+0000 7f07c0ce8640 1 -- 172.21.15.79:0/2652572922 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7e73a5e40 con 0x55d7e749c630 2024-08-20T01:38:57.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.226+0000 7f07bbfff640 1 --2- 172.21.15.79:0/2652572922 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7e749ef60 0x55d7e74a1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:57.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.226+0000 7f07b97fa640 1 -- 172.21.15.79:0/2768836126 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f07ac104740 con 0x7f07bc101560 2024-08-20T01:38:57.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.226+0000 7f07c0ce8640 1 --2- 172.21.15.79:0/2652572922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7e749c630 0x55d7e749ea20 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f07b4005f40 tx=0x7f07b4014f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e28ab53876ee977 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:57.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.226+0000 7f07a27fc640 1 -- 172.21.15.79:0/2652572922 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b4012d90 con 0x55d7e749c630 2024-08-20T01:38:57.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.227+0000 7f07a27fc640 1 -- 172.21.15.79:0/2652572922 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07b4023070 con 0x55d7e749c630 2024-08-20T01:38:57.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.227+0000 7f07a27fc640 1 -- 172.21.15.79:0/2652572922 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b40055a0 con 0x55d7e749c630 2024-08-20T01:38:57.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.227+0000 7f07c5614740 1 -- 172.21.15.79:0/2652572922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7e749c630 msgr2=0x55d7e749ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:57.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.227+0000 7f07c0ce8640 1 --2- 172.21.15.79:0/2768836126 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f07a40b3bd0 0x7f07a40b6090 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f07b4022000 tx=0x7f07b4020000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:57.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.227+0000 7f07c5614740 1 --2- 172.21.15.79:0/2652572922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7e749c630 0x55d7e749ea20 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f07b4005f40 tx=0x7f07b4014f70 comp rx=0 tx=0).stop 2024-08-20T01:38:57.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.227+0000 7f07c5614740 1 -- 172.21.15.79:0/2652572922 shutdown_connections 2024-08-20T01:38:57.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.227+0000 7f07c5614740 1 --2- 172.21.15.79:0/2652572922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7e74a19a0 0x55d7e74a3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:57.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.227+0000 7f07c5614740 1 --2- 172.21.15.79:0/2652572922 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7e749ef60 0x55d7e74a1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:57.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.227+0000 7f07c5614740 1 --2- 172.21.15.79:0/2652572922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7e749c630 0x55d7e749ea20 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:57.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.227+0000 7f07c5614740 1 -- 172.21.15.79:0/2652572922 >> 172.21.15.79:0/2652572922 conn(0x55d7e7497730 msgr2=0x55d7e7498510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:57.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.227+0000 7f07c5614740 1 -- 172.21.15.79:0/2652572922 shutdown_connections 2024-08-20T01:38:57.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.227+0000 7f07c5614740 1 -- 172.21.15.79:0/2652572922 wait complete. 2024-08-20T01:38:57.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.228+0000 7f07c5614740 1 -- start start 2024-08-20T01:38:57.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.228+0000 7f07c5614740 1 Processor -- start 2024-08-20T01:38:57.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.228+0000 7f07c5614740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7e749c630 0x55d7e74a5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:57.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.228+0000 7f07c5614740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7e749ef60 0x55d7e74a64c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:57.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.228+0000 7f07c5614740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7e74a19a0 0x55d7e74a7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:57.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.228+0000 7f07c5614740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d7e7337ab0 con 0x55d7e749ef60 2024-08-20T01:38:57.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.228+0000 7f07c5614740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d7e7385780 con 0x55d7e749c630 2024-08-20T01:38:57.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.228+0000 7f07c5614740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d7e74a4980 con 0x55d7e74a19a0 2024-08-20T01:38:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.228+0000 7f07c5614740 10 client.0 _ll_register_callbacks cb 0x55d7e710da00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.228+0000 7f07bb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7e749ef60 0x55d7e74a64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.228+0000 7f07bb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7e749ef60 0x55d7e74a64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54976/0 (socket says 172.21.15.79:54976) 2024-08-20T01:38:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.228+0000 7f07bb7fe640 1 -- 172.21.15.79:0/2328717292 learned_addr learned my addr 172.21.15.79:0/2328717292 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.228+0000 7f07bbfff640 1 --2- 172.21.15.79:0/2328717292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7e749c630 0x55d7e74a5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.228+0000 7f07c0ce8640 1 --2- 172.21.15.79:0/2328717292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7e74a19a0 0x55d7e74a7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.229+0000 7f07bb7fe640 1 -- 172.21.15.79:0/2328717292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7e74a19a0 msgr2=0x55d7e74a7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.229+0000 7f07bb7fe640 1 --2- 172.21.15.79:0/2328717292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7e74a19a0 0x55d7e74a7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.229+0000 7f07bb7fe640 1 -- 172.21.15.79:0/2328717292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7e749c630 msgr2=0x55d7e74a5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.229+0000 7f07bb7fe640 1 --2- 172.21.15.79:0/2328717292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7e749c630 0x55d7e74a5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.229+0000 7f07bb7fe640 1 -- 172.21.15.79:0/2328717292 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7e7161790 con 0x55d7e749ef60 2024-08-20T01:38:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.229+0000 7f07bbfff640 1 --2- 172.21.15.79:0/2328717292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7e749c630 0x55d7e74a5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.229+0000 7f07bb7fe640 1 --2- 172.21.15.79:0/2328717292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7e749ef60 0x55d7e74a64c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f07b0012740 tx=0x7f07b0012c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3883f56ddcbcf911 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.229+0000 7f079b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:38:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.229+0000 7f079b7fe640 1 -- 172.21.15.79:0/2328717292 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b000f920 con 0x55d7e749ef60 2024-08-20T01:38:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.229+0000 7f079b7fe640 1 -- 172.21.15.79:0/2328717292 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f07b000fac0 con 0x55d7e749ef60 2024-08-20T01:38:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.229+0000 7f07c5614740 1 -- 172.21.15.79:0/2328717292 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d7e73ade00 con 0x55d7e749ef60 2024-08-20T01:38:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.229+0000 7f079b7fe640 1 -- 172.21.15.79:0/2328717292 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f07b000fcc0 con 0x55d7e749ef60 2024-08-20T01:38:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.229+0000 7f07c5614740 10 client.16131 fetch_fsmap learned FSMap version 33 2024-08-20T01:38:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.229+0000 7f07c5614740 1 -- 172.21.15.79:0/2328717292 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55d7e71da620 con 0x55d7e749ef60 2024-08-20T01:38:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.229+0000 7f079b7fe640 1 -- 172.21.15.79:0/2328717292 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55d7e73ade00 con 0x55d7e749ef60 2024-08-20T01:38:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.230+0000 7f079b7fe640 1 -- 172.21.15.79:0/2328717292 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7f07b001c420 con 0x55d7e749ef60 2024-08-20T01:38:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.230+0000 7f07c5614740 10 client.16131 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:38:57.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.230+0000 7f07c5614740 10 client.16131 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:38:57.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.230+0000 7f07c5614740 20 client.16131 populate_metadata read hostname 'smithi079' 2024-08-20T01:38:57.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.230+0000 7f07c5614740 1 --2- 172.21.15.79:0/2328717292 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d7e74b1c00 0x55d7e74b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:57.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.230+0000 7f07c5614740 4 client.16131 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:38:57.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.230+0000 7f07c5614740 1 -- 172.21.15.79:0/2328717292 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d7e74112b0 con 0x55d7e74b1c00 2024-08-20T01:38:57.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.230+0000 7f07bbfff640 1 --2- 172.21.15.79:0/2328717292 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d7e74b1c00 0x55d7e74b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:57.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.230+0000 7f079b7fe640 10 client.16131 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:57.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.230+0000 7f07bbfff640 1 --2- 172.21.15.79:0/2328717292 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d7e74b1c00 0x55d7e74b40a0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8aa93db72f82d5ac server_cookie=388d72e93ab1714e in_seq=0 out_seq=0 2024-08-20T01:38:57.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.231+0000 7f079b7fe640 1 -- 172.21.15.79:0/2328717292 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d7e74112b0 con 0x55d7e74b1c00 2024-08-20T01:38:57.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.231+0000 7f079b7fe640 10 client.16131 handle_command_reply: tid=0 2024-08-20T01:38:57.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.231+0000 7f07c5614740 1 client.16131 shutdown 2024-08-20T01:38:57.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.231+0000 7f07c5614740 1 -- 172.21.15.79:0/2328717292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7e749ef60 msgr2=0x55d7e74a64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.231+0000 7f07c5614740 1 --2- 172.21.15.79:0/2328717292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7e749ef60 0x55d7e74a64c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f07b0012740 tx=0x7f07b0012c00 comp rx=0 tx=0).stop 2024-08-20T01:38:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.231+0000 7f07c5614740 1 -- 172.21.15.79:0/2328717292 shutdown_connections 2024-08-20T01:38:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.231+0000 7f07c5614740 1 --2- 172.21.15.79:0/2328717292 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d7e74b1c00 0x55d7e74b40a0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.231+0000 7f07c5614740 1 --2- 172.21.15.79:0/2328717292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7e74a19a0 0x55d7e74a7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.231+0000 7f07c5614740 1 --2- 172.21.15.79:0/2328717292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7e749ef60 0x55d7e74a64c0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.231+0000 7f079b7fe640 0 client.16131 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.231+0000 7f07c5614740 1 --2- 172.21.15.79:0/2328717292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7e749c630 0x55d7e74a5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.231+0000 7f07c5614740 1 -- 172.21.15.79:0/2328717292 >> 172.21.15.79:0/2328717292 conn(0x55d7e7497730 msgr2=0x55d7e7496850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.231+0000 7f07c5614740 1 -- 172.21.15.79:0/2328717292 shutdown_connections 2024-08-20T01:38:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.231+0000 7f07c5614740 1 -- 172.21.15.79:0/2328717292 wait complete. 2024-08-20T01:38:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.232+0000 7f07c5614740 20 client.16131 trim_cache size 0 max 16384 2024-08-20T01:38:57.249 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.246+0000 7f07c5614740 1 Processor -- start 2024-08-20T01:38:57.249 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.246+0000 7f07c5614740 1 -- start start 2024-08-20T01:38:57.249 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.246+0000 7f07c5614740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7e749c630 0x55d7e74a6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:57.249 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.246+0000 7f07c5614740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7e749ef60 0x55d7e74a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:57.250 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.246+0000 7f07c5614740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7e74a19a0 0x55d7e74a22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:57.250 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.246+0000 7f07c5614740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f07bc1a9b50 con 0x55d7e749ef60 2024-08-20T01:38:57.250 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.246+0000 7f07c5614740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f07bc1ab7e0 con 0x55d7e74a19a0 2024-08-20T01:38:57.250 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.246+0000 7f07c5614740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f07bc1aa220 con 0x55d7e749c630 2024-08-20T01:38:57.250 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.247+0000 7f07bb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7e749ef60 0x55d7e74a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:57.250 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.247+0000 7f07bb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7e749ef60 0x55d7e74a1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54982/0 (socket says 172.21.15.79:54982) 2024-08-20T01:38:57.250 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.247+0000 7f07bbfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7e749c630 0x55d7e74a6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:57.250 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.247+0000 7f07c0ce8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7e74a19a0 0x55d7e74a22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:57.250 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.247+0000 7f07bb7fe640 1 -- 172.21.15.79:0/2457431600 learned_addr learned my addr 172.21.15.79:0/2457431600 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:57.250 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.247+0000 7f07bbfff640 1 -- 172.21.15.79:0/2457431600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7e74a19a0 msgr2=0x55d7e74a22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:57.250 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.247+0000 7f07bbfff640 1 --2- 172.21.15.79:0/2457431600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7e74a19a0 0x55d7e74a22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:57.251 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.247+0000 7f07bbfff640 1 -- 172.21.15.79:0/2457431600 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7e749ef60 msgr2=0x55d7e74a1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:57.251 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.247+0000 7f07bbfff640 1 --2- 172.21.15.79:0/2457431600 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7e749ef60 0x55d7e74a1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:57.251 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.247+0000 7f07bbfff640 1 -- 172.21.15.79:0/2457431600 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7e74a16c0 con 0x55d7e749c630 2024-08-20T01:38:57.251 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.247+0000 7f07bb7fe640 1 --2- 172.21.15.79:0/2457431600 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7e749ef60 0x55d7e74a1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:38:57.251 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.247+0000 7f07bbfff640 1 --2- 172.21.15.79:0/2457431600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7e749c630 0x55d7e74a6530 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f07ac1022a0 tx=0x7f07ac102120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38050e0ec7a87a19 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:57.251 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.247+0000 7f07a1ffb640 1 -- 172.21.15.79:0/2457431600 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ac049040 con 0x55d7e749c630 2024-08-20T01:38:57.251 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.247+0000 7f07a1ffb640 1 -- 172.21.15.79:0/2457431600 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07ac0cb260 con 0x55d7e749c630 2024-08-20T01:38:57.251 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.247+0000 7f07a1ffb640 1 -- 172.21.15.79:0/2457431600 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ac0c79e0 con 0x55d7e749c630 2024-08-20T01:38:57.254 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.248+0000 7f07c5614740 1 -- 172.21.15.79:0/2457431600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7e749c630 msgr2=0x55d7e74a6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:57.254 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.248+0000 7f07c5614740 1 --2- 172.21.15.79:0/2457431600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7e749c630 0x55d7e74a6530 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f07ac1022a0 tx=0x7f07ac102120 comp rx=0 tx=0).stop 2024-08-20T01:38:57.254 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.248+0000 7f07c5614740 1 -- 172.21.15.79:0/2457431600 shutdown_connections 2024-08-20T01:38:57.255 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.248+0000 7f07c5614740 1 --2- 172.21.15.79:0/2457431600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7e74a19a0 0x55d7e74a22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:57.255 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.248+0000 7f07c5614740 1 --2- 172.21.15.79:0/2457431600 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7e749ef60 0x55d7e74a1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:57.255 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.248+0000 7f07c5614740 1 --2- 172.21.15.79:0/2457431600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7e749c630 0x55d7e74a6530 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:57.255 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.248+0000 7f07c5614740 1 -- 172.21.15.79:0/2457431600 >> 172.21.15.79:0/2457431600 conn(0x55d7e7497730 msgr2=0x55d7e74a5e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:57.255 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.248+0000 7f07c5614740 1 -- 172.21.15.79:0/2457431600 shutdown_connections 2024-08-20T01:38:57.255 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.248+0000 7f07c5614740 1 -- 172.21.15.79:0/2457431600 wait complete. 2024-08-20T01:38:57.255 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.248+0000 7f07c5614740 1 -- start start 2024-08-20T01:38:57.255 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.249+0000 7f07c5614740 1 Processor -- start 2024-08-20T01:38:57.255 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.249+0000 7f07c5614740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7e749c630 0x55d7e74ad530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:57.255 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.249+0000 7f07c5614740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7e749ef60 0x55d7e74adbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:57.255 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.249+0000 7f07c5614740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7e74a19a0 0x55d7e74ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:57.256 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.249+0000 7f07c5614740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f07bc1ab050 con 0x55d7e749c630 2024-08-20T01:38:57.256 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.249+0000 7f07c5614740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f07bc1aa8f0 con 0x55d7e749ef60 2024-08-20T01:38:57.256 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.249+0000 7f07c5614740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f07bc1a7b30 con 0x55d7e74a19a0 2024-08-20T01:38:57.256 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.249+0000 7f07c5614740 10 client.0 _ll_register_callbacks cb 0x7f07b0009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:38:57.256 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.249+0000 7f07bbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7e749c630 0x55d7e74ad530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:57.256 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.249+0000 7f07bbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7e749c630 0x55d7e74ad530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54996/0 (socket says 172.21.15.79:54996) 2024-08-20T01:38:57.256 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.249+0000 7f07bbfff640 1 -- 172.21.15.79:0/813993737 learned_addr learned my addr 172.21.15.79:0/813993737 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:38:57.256 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.249+0000 7f07c0ce8640 1 --2- 172.21.15.79:0/813993737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7e74a19a0 0x55d7e74ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:57.256 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.249+0000 7f07bb7fe640 1 --2- 172.21.15.79:0/813993737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7e749ef60 0x55d7e74adbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:57.256 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.249+0000 7f07bbfff640 1 -- 172.21.15.79:0/813993737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7e74a19a0 msgr2=0x55d7e74ac2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:57.256 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.249+0000 7f07bbfff640 1 --2- 172.21.15.79:0/813993737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7e74a19a0 0x55d7e74ac2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:57.256 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.249+0000 7f07bbfff640 1 -- 172.21.15.79:0/813993737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7e749ef60 msgr2=0x55d7e74adbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:38:57.257 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.249+0000 7f07bbfff640 1 --2- 172.21.15.79:0/813993737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7e749ef60 0x55d7e74adbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:57.257 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.249+0000 7f07bbfff640 1 -- 172.21.15.79:0/813993737 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7e74acb50 con 0x55d7e749c630 2024-08-20T01:38:57.257 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.250+0000 7f07bbfff640 1 --2- 172.21.15.79:0/813993737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7e749c630 0x55d7e74ad530 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f07ac1022a0 tx=0x7f07ac047000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b290b78b2bc3f388 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:38:57.257 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.250+0000 7f079b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:38:57.257 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.250+0000 7f079b7fe640 1 -- 172.21.15.79:0/813993737 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ac049070 con 0x55d7e749c630 2024-08-20T01:38:57.257 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.250+0000 7f079b7fe640 1 -- 172.21.15.79:0/813993737 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f07ac0ee0b0 con 0x55d7e749c630 2024-08-20T01:38:57.257 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.250+0000 7f07c5614740 1 -- 172.21.15.79:0/813993737 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07ac0cb260 con 0x55d7e749c630 2024-08-20T01:38:57.257 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.250+0000 7f079b7fe640 1 -- 172.21.15.79:0/813993737 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f07ac0d4750 con 0x55d7e749c630 2024-08-20T01:38:57.257 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.250+0000 7f07c5614740 10 client.16137 fetch_fsmap learned FSMap version 33 2024-08-20T01:38:57.257 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.250+0000 7f07c5614740 1 -- 172.21.15.79:0/813993737 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55d7e74ab920 con 0x55d7e749c630 2024-08-20T01:38:57.257 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.250+0000 7f079b7fe640 1 -- 172.21.15.79:0/813993737 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07ac0cb260 con 0x55d7e749c630 2024-08-20T01:38:57.257 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.250+0000 7f079b7fe640 1 -- 172.21.15.79:0/813993737 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7f07ac0d42c0 con 0x55d7e749c630 2024-08-20T01:38:57.257 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.250+0000 7f07c5614740 10 client.16137 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:38:57.257 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.250+0000 7f07c5614740 10 client.16137 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:38:57.258 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.250+0000 7f07c5614740 20 client.16137 populate_metadata read hostname 'smithi079' 2024-08-20T01:38:57.258 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.250+0000 7f07c5614740 1 --2- 172.21.15.79:0/813993737 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d7e751cf50 0x55d7e751f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:38:57.258 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.250+0000 7f07c5614740 4 client.16137 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:38:57.258 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.250+0000 7f07c5614740 1 -- 172.21.15.79:0/813993737 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d7e740cd50 con 0x55d7e751cf50 2024-08-20T01:38:57.258 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.251+0000 7f07bb7fe640 1 --2- 172.21.15.79:0/813993737 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d7e751cf50 0x55d7e751f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:38:57.258 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.251+0000 7f079b7fe640 10 client.16137 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:57.258 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.251+0000 7f07bb7fe640 1 --2- 172.21.15.79:0/813993737 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d7e751cf50 0x55d7e751f370 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e3584ca1e6e6fdd server_cookie=3978b38d60c60da7 in_seq=0 out_seq=0 2024-08-20T01:38:57.264 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.261+0000 7f079b7fe640 1 -- 172.21.15.79:0/813993737 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d7e740cd50 con 0x55d7e751cf50 2024-08-20T01:38:57.264 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.261+0000 7f079b7fe640 10 client.16137 handle_command_reply: tid=0 2024-08-20T01:38:57.264 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.261+0000 7f07c5614740 1 client.16137 shutdown 2024-08-20T01:38:57.264 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.261+0000 7f07c5614740 1 -- 172.21.15.79:0/813993737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7e749c630 msgr2=0x55d7e74ad530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:57.264 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.261+0000 7f07c5614740 1 --2- 172.21.15.79:0/813993737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7e749c630 0x55d7e74ad530 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f07ac1022a0 tx=0x7f07ac047000 comp rx=0 tx=0).stop 2024-08-20T01:38:57.264 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.261+0000 7f07c5614740 1 -- 172.21.15.79:0/813993737 shutdown_connections 2024-08-20T01:38:57.264 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.261+0000 7f07c5614740 1 --2- 172.21.15.79:0/813993737 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d7e751cf50 0x55d7e751f370 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:57.264 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.261+0000 7f07c5614740 1 --2- 172.21.15.79:0/813993737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7e74a19a0 0x55d7e74ac2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:57.264 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.261+0000 7f07c5614740 1 --2- 172.21.15.79:0/813993737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7e749ef60 0x55d7e74adbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:57.264 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.261+0000 7f07c5614740 1 --2- 172.21.15.79:0/813993737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7e749c630 0x55d7e74ad530 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:57.265 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.261+0000 7f07c5614740 1 -- 172.21.15.79:0/813993737 >> 172.21.15.79:0/813993737 conn(0x55d7e7497730 msgr2=0x55d7e7496030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:57.265 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.261+0000 7f079b7fe640 0 client.16137 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:38:57.265 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.261+0000 7f07c5614740 1 -- 172.21.15.79:0/813993737 shutdown_connections 2024-08-20T01:38:57.265 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.261+0000 7f07c5614740 1 -- 172.21.15.79:0/813993737 wait complete. 2024-08-20T01:38:57.265 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.262+0000 7f07c5614740 20 client.16137 trim_cache size 0 max 16384 2024-08-20T01:38:57.265 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:38:57.265 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:38:57.265 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:38:57.265 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:38:57.266 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.262+0000 7f07c274b640 1 -- 172.21.15.79:0/2768836126 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f07a40b3bd0 msgr2=0x7f07a40b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:57.266 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.262+0000 7f07c274b640 1 --2- 172.21.15.79:0/2768836126 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f07a40b3bd0 0x7f07a40b6090 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f07b4022000 tx=0x7f07b4020000 comp rx=0 tx=0).stop 2024-08-20T01:38:57.266 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.262+0000 7f07c274b640 1 -- 172.21.15.79:0/2768836126 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07bc101560 msgr2=0x7f07bc06b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:38:57.266 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.262+0000 7f07c274b640 1 --2- 172.21.15.79:0/2768836126 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07bc101560 0x7f07bc06b6a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f07ac031460 tx=0x7f07ac003c10 comp rx=0 tx=0).stop 2024-08-20T01:38:57.267 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.262+0000 7f07c274b640 1 -- 172.21.15.79:0/2768836126 shutdown_connections 2024-08-20T01:38:57.267 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.262+0000 7f07c274b640 1 --2- 172.21.15.79:0/2768836126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07bc103070 0x7f07bc19fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:57.267 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.262+0000 7f07c274b640 1 --2- 172.21.15.79:0/2768836126 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f07a40b3bd0 0x7f07a40b6090 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:57.267 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.262+0000 7f07c274b640 1 --2- 172.21.15.79:0/2768836126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07bc1026b0 0x7f07bc19d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:57.267 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.262+0000 7f07c274b640 1 --2- 172.21.15.79:0/2768836126 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07bc101560 0x7f07bc06b6a0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:38:57.267 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.262+0000 7f07c274b640 1 -- 172.21.15.79:0/2768836126 >> 172.21.15.79:0/2768836126 conn(0x7f07bc0fce20 msgr2=0x7f07bc105af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:38:57.267 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.262+0000 7f07c274b640 1 -- 172.21.15.79:0/2768836126 shutdown_connections 2024-08-20T01:38:57.267 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:38:57.262+0000 7f07c274b640 1 -- 172.21.15.79:0/2768836126 wait complete. 2024-08-20T01:38:57.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:57 smithi175 ceph-mon[22392]: pgmap v396: 97 pgs: 97 active+clean; 1.4 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 30 MiB/s wr, 25 op/s 2024-08-20T01:38:57.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:57 smithi079 ceph-mon[18656]: pgmap v396: 97 pgs: 97 active+clean; 1.4 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 30 MiB/s wr, 25 op/s 2024-08-20T01:38:58.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:57 smithi081 ceph-mon[22209]: pgmap v396: 97 pgs: 97 active+clean; 1.4 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 30 MiB/s wr, 25 op/s 2024-08-20T01:38:59.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:38:59 smithi175 ceph-mon[22392]: pgmap v397: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 31 MiB/s wr, 28 op/s 2024-08-20T01:38:59.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:38:59 smithi079 ceph-mon[18656]: pgmap v397: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 31 MiB/s wr, 28 op/s 2024-08-20T01:39:00.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:38:59 smithi081 ceph-mon[22209]: pgmap v397: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 31 MiB/s wr, 28 op/s 2024-08-20T01:39:01.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:01 smithi175 ceph-mon[22392]: pgmap v398: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 31 MiB/s wr, 24 op/s 2024-08-20T01:39:01.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:01 smithi079 ceph-mon[18656]: pgmap v398: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 31 MiB/s wr, 24 op/s 2024-08-20T01:39:02.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:01 smithi081 ceph-mon[22209]: pgmap v398: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 31 MiB/s wr, 24 op/s 2024-08-20T01:39:03.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:03 smithi175 ceph-mon[22392]: pgmap v399: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 30 MiB/s wr, 23 op/s 2024-08-20T01:39:03.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:03 smithi079 ceph-mon[18656]: pgmap v399: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 30 MiB/s wr, 23 op/s 2024-08-20T01:39:04.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:03 smithi081 ceph-mon[22209]: pgmap v399: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 30 MiB/s wr, 23 op/s 2024-08-20T01:39:04.657 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:39:04.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:04 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:39:04.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:04 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:39:04.969 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:39:05.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:04 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:39:05.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.480+0000 7fc517e43640 1 -- 172.21.15.79:0/2985022149 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc510104230 msgr2=0x7fc51010c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:05.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.480+0000 7fc517e43640 1 --2- 172.21.15.79:0/2985022149 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc510104230 0x7fc51010c810 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fc500009900 tx=0x7fc50002a410 comp rx=0 tx=0).stop 2024-08-20T01:39:05.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.481+0000 7fc517e43640 1 -- 172.21.15.79:0/2985022149 shutdown_connections 2024-08-20T01:39:05.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.481+0000 7fc517e43640 1 --2- 172.21.15.79:0/2985022149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc51010cde0 0x7fc51010f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.481+0000 7fc517e43640 1 --2- 172.21.15.79:0/2985022149 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc510104230 0x7fc51010c810 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.481+0000 7fc517e43640 1 --2- 172.21.15.79:0/2985022149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc510103830 0x7fc510103c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.481+0000 7fc517e43640 1 -- 172.21.15.79:0/2985022149 >> 172.21.15.79:0/2985022149 conn(0x7fc5100fd400 msgr2=0x7fc5100ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:05.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.481+0000 7fc517e43640 1 -- 172.21.15.79:0/2985022149 shutdown_connections 2024-08-20T01:39:05.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.481+0000 7fc517e43640 1 -- 172.21.15.79:0/2985022149 wait complete. 2024-08-20T01:39:05.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.481+0000 7fc517e43640 1 Processor -- start 2024-08-20T01:39:05.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.481+0000 7fc517e43640 1 -- start start 2024-08-20T01:39:05.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.481+0000 7fc517e43640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc510103830 0x7fc51019b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:05.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.481+0000 7fc517e43640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc510104230 0x7fc51019b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:05.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.481+0000 7fc517e43640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc51010cde0 0x7fc5101a08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:05.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.481+0000 7fc517e43640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc510102090 con 0x7fc510103830 2024-08-20T01:39:05.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.481+0000 7fc517e43640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc510101f10 con 0x7fc510104230 2024-08-20T01:39:05.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.481+0000 7fc517e43640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc510102210 con 0x7fc51010cde0 2024-08-20T01:39:05.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.482+0000 7fc515bdf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc510103830 0x7fc51019b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:05.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.482+0000 7fc515bdf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc510103830 0x7fc51019b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51322/0 (socket says 172.21.15.79:51322) 2024-08-20T01:39:05.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.482+0000 7fc515bdf640 1 -- 172.21.15.79:0/2593077714 learned_addr learned my addr 172.21.15.79:0/2593077714 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:05.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.482+0000 7fc5153de640 1 --2- 172.21.15.79:0/2593077714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc510104230 0x7fc51019b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:05.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.482+0000 7fc5163e0640 1 --2- 172.21.15.79:0/2593077714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc51010cde0 0x7fc5101a08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:05.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.482+0000 7fc515bdf640 1 -- 172.21.15.79:0/2593077714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc51010cde0 msgr2=0x7fc5101a08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:05.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.482+0000 7fc515bdf640 1 --2- 172.21.15.79:0/2593077714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc51010cde0 0x7fc5101a08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.482+0000 7fc515bdf640 1 -- 172.21.15.79:0/2593077714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc510104230 msgr2=0x7fc51019b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:05.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.482+0000 7fc515bdf640 1 --2- 172.21.15.79:0/2593077714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc510104230 0x7fc51019b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.482+0000 7fc515bdf640 1 -- 172.21.15.79:0/2593077714 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5101a10c0 con 0x7fc510103830 2024-08-20T01:39:05.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.482+0000 7fc5153de640 1 --2- 172.21.15.79:0/2593077714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc510104230 0x7fc51019b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:05.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.482+0000 7fc5163e0640 1 --2- 172.21.15.79:0/2593077714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc51010cde0 0x7fc5101a08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:39:05.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.482+0000 7fc515bdf640 1 --2- 172.21.15.79:0/2593077714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc510103830 0x7fc51019b100 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fc50c00c920 tx=0x7fc50c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:05.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.482+0000 7fc506ffd640 1 -- 172.21.15.79:0/2593077714 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50c007c70 con 0x7fc510103830 2024-08-20T01:39:05.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.482+0000 7fc506ffd640 1 -- 172.21.15.79:0/2593077714 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc50c007e10 con 0x7fc510103830 2024-08-20T01:39:05.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.482+0000 7fc506ffd640 1 -- 172.21.15.79:0/2593077714 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50c018710 con 0x7fc510103830 2024-08-20T01:39:05.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.482+0000 7fc517e43640 1 -- 172.21.15.79:0/2593077714 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5101a13b0 con 0x7fc510103830 2024-08-20T01:39:05.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.483+0000 7fc517e43640 1 -- 172.21.15.79:0/2593077714 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5101a7a70 con 0x7fc510103830 2024-08-20T01:39:05.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.485+0000 7fc506ffd640 1 -- 172.21.15.79:0/2593077714 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc50c00f450 con 0x7fc510103830 2024-08-20T01:39:05.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.485+0000 7fc51a23c740 1 Processor -- start 2024-08-20T01:39:05.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.486+0000 7fc51a23c740 1 -- start start 2024-08-20T01:39:05.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.486+0000 7fc51a23c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558da0f956e0 0x558da0f95ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:05.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.486+0000 7fc51a23c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558da0f96000 0x558da0fa1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:05.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.486+0000 7fc51a23c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558da0fa1f90 0x558da0fa4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:05.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.486+0000 7fc51a23c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558da0f0c8e0 con 0x558da0f96000 2024-08-20T01:39:05.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.486+0000 7fc51a23c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558da0efbde0 con 0x558da0f956e0 2024-08-20T01:39:05.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.486+0000 7fc51a23c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558da0effe20 con 0x558da0fa1f90 2024-08-20T01:39:05.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.486+0000 7fc515bdf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558da0f96000 0x558da0fa1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:05.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.486+0000 7fc515bdf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558da0f96000 0x558da0fa1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51324/0 (socket says 172.21.15.79:51324) 2024-08-20T01:39:05.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.486+0000 7fc515bdf640 1 -- 172.21.15.79:0/4236479924 learned_addr learned my addr 172.21.15.79:0/4236479924 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:05.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.486+0000 7fc5163e0640 1 --2- 172.21.15.79:0/4236479924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558da0f956e0 0x558da0f95ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:05.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.486+0000 7fc5153de640 1 --2- 172.21.15.79:0/4236479924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558da0fa1f90 0x558da0fa4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:05.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.486+0000 7fc506ffd640 1 --2- 172.21.15.79:0/2593077714 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc4fc0b3bd0 0x7fc4fc0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:05.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.486+0000 7fc515bdf640 1 -- 172.21.15.79:0/4236479924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558da0fa1f90 msgr2=0x558da0fa4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:05.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.486+0000 7fc515bdf640 1 --2- 172.21.15.79:0/4236479924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558da0fa1f90 0x558da0fa4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.486+0000 7fc515bdf640 1 -- 172.21.15.79:0/4236479924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558da0f956e0 msgr2=0x558da0f95ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:05.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.486+0000 7fc515bdf640 1 --2- 172.21.15.79:0/4236479924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558da0f956e0 0x558da0f95ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.486+0000 7fc515bdf640 1 -- 172.21.15.79:0/4236479924 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558da0c5b650 con 0x558da0f96000 2024-08-20T01:39:05.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.486+0000 7fc5163e0640 1 --2- 172.21.15.79:0/4236479924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558da0f956e0 0x558da0f95ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:39:05.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.486+0000 7fc5163e0640 1 --2- 172.21.15.79:0/2593077714 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc4fc0b3bd0 0x7fc4fc0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:05.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.487+0000 7fc506ffd640 1 -- 172.21.15.79:0/2593077714 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc50c0e3e30 con 0x7fc510103830 2024-08-20T01:39:05.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.487+0000 7fc515bdf640 1 --2- 172.21.15.79:0/4236479924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558da0f96000 0x558da0fa1a50 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fc50c01c6e0 tx=0x7fc50c020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ee5e14070b875ac server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:05.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.487+0000 7fc4fbfff640 1 -- 172.21.15.79:0/4236479924 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50c0aab00 con 0x558da0f96000 2024-08-20T01:39:05.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.487+0000 7fc4fbfff640 1 -- 172.21.15.79:0/4236479924 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc50c01cbb0 con 0x558da0f96000 2024-08-20T01:39:05.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.487+0000 7fc4fbfff640 1 -- 172.21.15.79:0/4236479924 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50c0aa4a0 con 0x558da0f96000 2024-08-20T01:39:05.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.488+0000 7fc51a23c740 1 -- 172.21.15.79:0/4236479924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558da0f96000 msgr2=0x558da0fa1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:05.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.488+0000 7fc5163e0640 1 --2- 172.21.15.79:0/2593077714 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc4fc0b3bd0 0x7fc4fc0b6090 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc508005fd0 tx=0x7fc508004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:05.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.488+0000 7fc51a23c740 1 --2- 172.21.15.79:0/4236479924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558da0f96000 0x558da0fa1a50 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fc50c01c6e0 tx=0x7fc50c020000 comp rx=0 tx=0).stop 2024-08-20T01:39:05.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.488+0000 7fc51a23c740 1 -- 172.21.15.79:0/4236479924 shutdown_connections 2024-08-20T01:39:05.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.488+0000 7fc51a23c740 1 --2- 172.21.15.79:0/4236479924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558da0fa1f90 0x558da0fa4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.488+0000 7fc51a23c740 1 --2- 172.21.15.79:0/4236479924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558da0f96000 0x558da0fa1a50 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.488+0000 7fc51a23c740 1 --2- 172.21.15.79:0/4236479924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558da0f956e0 0x558da0f95ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.488+0000 7fc51a23c740 1 -- 172.21.15.79:0/4236479924 >> 172.21.15.79:0/4236479924 conn(0x558da0f93510 msgr2=0x558da0f946b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:05.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.489+0000 7fc51a23c740 1 -- 172.21.15.79:0/4236479924 shutdown_connections 2024-08-20T01:39:05.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.489+0000 7fc51a23c740 1 -- 172.21.15.79:0/4236479924 wait complete. 2024-08-20T01:39:05.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.489+0000 7fc51a23c740 1 -- start start 2024-08-20T01:39:05.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.489+0000 7fc51a23c740 1 Processor -- start 2024-08-20T01:39:05.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.490+0000 7fc51a23c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558da0f956e0 0x558da0f9ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:05.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.490+0000 7fc51a23c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558da0f96000 0x558da0f9f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:05.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.490+0000 7fc51a23c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558da0fa1f90 0x558da0f9f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:05.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.490+0000 7fc51a23c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558da0d5e700 con 0x558da0f96000 2024-08-20T01:39:05.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.490+0000 7fc51a23c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558da0e827c0 con 0x558da0fa1f90 2024-08-20T01:39:05.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.490+0000 7fc51a23c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558da0fa4be0 con 0x558da0f956e0 2024-08-20T01:39:05.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.490+0000 7fc51a23c740 10 client.0 _ll_register_callbacks cb 0x558da0ef56b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:05.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.490+0000 7fc5153de640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558da0f96000 0x558da0f9f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:05.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.490+0000 7fc5153de640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558da0f96000 0x558da0f9f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51328/0 (socket says 172.21.15.79:51328) 2024-08-20T01:39:05.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.490+0000 7fc5153de640 1 -- 172.21.15.79:0/3559610118 learned_addr learned my addr 172.21.15.79:0/3559610118 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:05.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.490+0000 7fc5163e0640 1 --2- 172.21.15.79:0/3559610118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558da0fa1f90 0x558da0f9f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:05.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.490+0000 7fc515bdf640 1 --2- 172.21.15.79:0/3559610118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558da0f956e0 0x558da0f9ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:05.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.490+0000 7fc5153de640 1 -- 172.21.15.79:0/3559610118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558da0f956e0 msgr2=0x558da0f9ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:05.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.490+0000 7fc5153de640 1 --2- 172.21.15.79:0/3559610118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558da0f956e0 0x558da0f9ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.490+0000 7fc5153de640 1 -- 172.21.15.79:0/3559610118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558da0fa1f90 msgr2=0x558da0f9f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:05.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.490+0000 7fc5153de640 1 --2- 172.21.15.79:0/3559610118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558da0fa1f90 0x558da0f9f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.490+0000 7fc5153de640 1 -- 172.21.15.79:0/3559610118 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558da0fb67a0 con 0x558da0f96000 2024-08-20T01:39:05.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.490+0000 7fc5163e0640 1 --2- 172.21.15.79:0/3559610118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558da0fa1f90 0x558da0f9f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:05.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.490+0000 7fc515bdf640 1 --2- 172.21.15.79:0/3559610118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558da0f956e0 0x558da0f9ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:39:05.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.491+0000 7fc5153de640 1 --2- 172.21.15.79:0/3559610118 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558da0f96000 0x558da0f9f460 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fc500009900 tx=0x7fc500031770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1406c9b54360c85 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:05.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.491+0000 7fc4f97fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:39:05.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.491+0000 7fc4f97fa640 1 -- 172.21.15.79:0/3559610118 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc500035070 con 0x558da0f96000 2024-08-20T01:39:05.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.491+0000 7fc4f97fa640 1 -- 172.21.15.79:0/3559610118 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc500004460 con 0x558da0f96000 2024-08-20T01:39:05.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.491+0000 7fc51a23c740 1 -- 172.21.15.79:0/3559610118 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558da0eab100 con 0x558da0f96000 2024-08-20T01:39:05.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.491+0000 7fc4f97fa640 1 -- 172.21.15.79:0/3559610118 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fc5000035f0 con 0x558da0f96000 2024-08-20T01:39:05.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.491+0000 7fc51a23c740 10 client.16149 fetch_fsmap learned FSMap version 33 2024-08-20T01:39:05.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.491+0000 7fc51a23c740 1 -- 172.21.15.79:0/3559610118 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x558da0fb9150 con 0x558da0f96000 2024-08-20T01:39:05.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.491+0000 7fc4f97fa640 1 -- 172.21.15.79:0/3559610118 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x558da0eab100 con 0x558da0f96000 2024-08-20T01:39:05.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.491+0000 7fc4f97fa640 1 -- 172.21.15.79:0/3559610118 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7fc500043020 con 0x558da0f96000 2024-08-20T01:39:05.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.491+0000 7fc51a23c740 10 client.16149 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:39:05.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.491+0000 7fc51a23c740 10 client.16149 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:39:05.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.491+0000 7fc51a23c740 20 client.16149 populate_metadata read hostname 'smithi079' 2024-08-20T01:39:05.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.492+0000 7fc51a23c740 1 --2- 172.21.15.79:0/3559610118 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558da0fba730 0x558da0fbcb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:05.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.492+0000 7fc51a23c740 4 client.16149 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:39:05.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.492+0000 7fc51a23c740 1 -- 172.21.15.79:0/3559610118 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558da0f0e830 con 0x558da0fba730 2024-08-20T01:39:05.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.492+0000 7fc515bdf640 1 --2- 172.21.15.79:0/3559610118 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558da0fba730 0x558da0fbcb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:05.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.492+0000 7fc515bdf640 1 --2- 172.21.15.79:0/3559610118 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558da0fba730 0x558da0fbcb50 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=865bbf7f4985ad12 server_cookie=ce8afdd3d4143fa2 in_seq=0 out_seq=0 2024-08-20T01:39:05.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.492+0000 7fc4f97fa640 10 client.16149 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:39:05.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.493+0000 7fc4f97fa640 1 -- 172.21.15.79:0/3559610118 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558da0f0e830 con 0x558da0fba730 2024-08-20T01:39:05.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.493+0000 7fc4f97fa640 10 client.16149 handle_command_reply: tid=0 2024-08-20T01:39:05.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.493+0000 7fc51a23c740 1 client.16149 shutdown 2024-08-20T01:39:05.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.493+0000 7fc51a23c740 1 -- 172.21.15.79:0/3559610118 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558da0f96000 msgr2=0x558da0f9f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:05.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.493+0000 7fc51a23c740 1 --2- 172.21.15.79:0/3559610118 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558da0f96000 0x558da0f9f460 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fc500009900 tx=0x7fc500031770 comp rx=0 tx=0).stop 2024-08-20T01:39:05.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.493+0000 7fc51a23c740 1 -- 172.21.15.79:0/3559610118 shutdown_connections 2024-08-20T01:39:05.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.493+0000 7fc51a23c740 1 --2- 172.21.15.79:0/3559610118 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558da0fba730 0x558da0fbcb50 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.493+0000 7fc51a23c740 1 --2- 172.21.15.79:0/3559610118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558da0fa1f90 0x558da0f9f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.493+0000 7fc51a23c740 1 --2- 172.21.15.79:0/3559610118 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558da0f96000 0x558da0f9f460 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.493+0000 7fc51a23c740 1 --2- 172.21.15.79:0/3559610118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558da0f956e0 0x558da0f9ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.493+0000 7fc51a23c740 1 -- 172.21.15.79:0/3559610118 >> 172.21.15.79:0/3559610118 conn(0x558da0f93510 msgr2=0x558da0f99080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:05.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.493+0000 7fc4f97fa640 0 client.16149 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:39:05.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.493+0000 7fc51a23c740 1 -- 172.21.15.79:0/3559610118 shutdown_connections 2024-08-20T01:39:05.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.493+0000 7fc51a23c740 1 -- 172.21.15.79:0/3559610118 wait complete. 2024-08-20T01:39:05.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.493+0000 7fc51a23c740 20 client.16149 trim_cache size 0 max 16384 2024-08-20T01:39:05.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.514+0000 7fc51a23c740 1 Processor -- start 2024-08-20T01:39:05.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.514+0000 7fc51a23c740 1 -- start start 2024-08-20T01:39:05.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.514+0000 7fc51a23c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558da0f956e0 0x558da0f94bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:05.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.514+0000 7fc51a23c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558da0f96000 0x558da0f92390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:05.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.514+0000 7fc51a23c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558da0fa1f90 0x558da0fc2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:05.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.515+0000 7fc51a23c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc5101abcf0 con 0x558da0f96000 2024-08-20T01:39:05.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.515+0000 7fc51a23c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc5101ad980 con 0x558da0f956e0 2024-08-20T01:39:05.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.515+0000 7fc51a23c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc5101ac3c0 con 0x558da0fa1f90 2024-08-20T01:39:05.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.515+0000 7fc5153de640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558da0f96000 0x558da0f92390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:05.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.515+0000 7fc5153de640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558da0f96000 0x558da0f92390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51336/0 (socket says 172.21.15.79:51336) 2024-08-20T01:39:05.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.515+0000 7fc5153de640 1 -- 172.21.15.79:0/1120161272 learned_addr learned my addr 172.21.15.79:0/1120161272 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:05.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.515+0000 7fc515bdf640 1 --2- 172.21.15.79:0/1120161272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558da0f956e0 0x558da0f94bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:05.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.515+0000 7fc5163e0640 1 --2- 172.21.15.79:0/1120161272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558da0fa1f90 0x558da0fc2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:05.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.515+0000 7fc515bdf640 1 -- 172.21.15.79:0/1120161272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558da0fa1f90 msgr2=0x558da0fc2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:05.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.515+0000 7fc515bdf640 1 --2- 172.21.15.79:0/1120161272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558da0fa1f90 0x558da0fc2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.515+0000 7fc515bdf640 1 -- 172.21.15.79:0/1120161272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558da0f96000 msgr2=0x558da0f92390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:05.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.515+0000 7fc515bdf640 1 --2- 172.21.15.79:0/1120161272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558da0f96000 0x558da0f92390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.515+0000 7fc515bdf640 1 -- 172.21.15.79:0/1120161272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558da0f93f90 con 0x558da0f956e0 2024-08-20T01:39:05.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.515+0000 7fc515bdf640 1 --2- 172.21.15.79:0/1120161272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558da0f956e0 0x558da0f94bd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc50c0a6db0 tx=0x7fc50c000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f93d02c444112c18 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:05.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.515+0000 7fc4fb7fe640 1 -- 172.21.15.79:0/1120161272 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50c0aa680 con 0x558da0f956e0 2024-08-20T01:39:05.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.515+0000 7fc4fb7fe640 1 -- 172.21.15.79:0/1120161272 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc50c096070 con 0x558da0f956e0 2024-08-20T01:39:05.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.515+0000 7fc4fb7fe640 1 -- 172.21.15.79:0/1120161272 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50c01c950 con 0x558da0f956e0 2024-08-20T01:39:05.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.516+0000 7fc51a23c740 1 -- 172.21.15.79:0/1120161272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558da0f956e0 msgr2=0x558da0f94bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:05.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.516+0000 7fc51a23c740 1 --2- 172.21.15.79:0/1120161272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558da0f956e0 0x558da0f94bd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc50c0a6db0 tx=0x7fc50c000bc0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.516+0000 7fc51a23c740 1 -- 172.21.15.79:0/1120161272 shutdown_connections 2024-08-20T01:39:05.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.516+0000 7fc51a23c740 1 --2- 172.21.15.79:0/1120161272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558da0fa1f90 0x558da0fc2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.516+0000 7fc51a23c740 1 --2- 172.21.15.79:0/1120161272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558da0f96000 0x558da0f92390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.516+0000 7fc51a23c740 1 --2- 172.21.15.79:0/1120161272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558da0f956e0 0x558da0f94bd0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.516+0000 7fc51a23c740 1 -- 172.21.15.79:0/1120161272 >> 172.21.15.79:0/1120161272 conn(0x558da0f93510 msgr2=0x558da0f91c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:05.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.516+0000 7fc51a23c740 1 -- 172.21.15.79:0/1120161272 shutdown_connections 2024-08-20T01:39:05.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.516+0000 7fc51a23c740 1 -- 172.21.15.79:0/1120161272 wait complete. 2024-08-20T01:39:05.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.517+0000 7fc51a23c740 1 -- start start 2024-08-20T01:39:05.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.517+0000 7fc51a23c740 1 Processor -- start 2024-08-20T01:39:05.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.517+0000 7fc51a23c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558da0f956e0 0x558da0fb2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:05.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.517+0000 7fc51a23c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558da0f96000 0x558da0faf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:05.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.517+0000 7fc51a23c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558da0fa1f90 0x558da0fafbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:05.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.517+0000 7fc51a23c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc5101ad1f0 con 0x558da0fa1f90 2024-08-20T01:39:05.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.517+0000 7fc51a23c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc5101aca90 con 0x558da0f956e0 2024-08-20T01:39:05.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.517+0000 7fc51a23c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc5101a9cd0 con 0x558da0f96000 2024-08-20T01:39:05.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.517+0000 7fc51a23c740 10 client.0 _ll_register_callbacks cb 0x7fc500009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:05.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.517+0000 7fc5163e0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558da0fa1f90 0x558da0fafbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:05.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.517+0000 7fc5163e0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558da0fa1f90 0x558da0fafbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51346/0 (socket says 172.21.15.79:51346) 2024-08-20T01:39:05.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.517+0000 7fc5163e0640 1 -- 172.21.15.79:0/2184182141 learned_addr learned my addr 172.21.15.79:0/2184182141 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:05.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.518+0000 7fc515bdf640 1 --2- 172.21.15.79:0/2184182141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558da0f956e0 0x558da0fb2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:05.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.518+0000 7fc5153de640 1 --2- 172.21.15.79:0/2184182141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558da0f96000 0x558da0faf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:05.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.518+0000 7fc5163e0640 1 -- 172.21.15.79:0/2184182141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558da0f96000 msgr2=0x558da0faf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:05.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.518+0000 7fc5163e0640 1 --2- 172.21.15.79:0/2184182141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558da0f96000 0x558da0faf480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.518+0000 7fc5163e0640 1 -- 172.21.15.79:0/2184182141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558da0f956e0 msgr2=0x558da0fb2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:05.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.518+0000 7fc5163e0640 1 --2- 172.21.15.79:0/2184182141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558da0f956e0 0x558da0fb2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.518+0000 7fc5163e0640 1 -- 172.21.15.79:0/2184182141 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558da10233f0 con 0x558da0fa1f90 2024-08-20T01:39:05.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.518+0000 7fc515bdf640 1 --2- 172.21.15.79:0/2184182141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558da0f956e0 0x558da0fb2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:05.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.518+0000 7fc5163e0640 1 --2- 172.21.15.79:0/2184182141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558da0fa1f90 0x558da0fafbc0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fc508013e90 tx=0x7fc508004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47263a7da0fc705b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:05.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.518+0000 7fc4f97fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:39:05.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.518+0000 7fc4f97fa640 1 -- 172.21.15.79:0/2184182141 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50802e060 con 0x558da0fa1f90 2024-08-20T01:39:05.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.518+0000 7fc4f97fa640 1 -- 172.21.15.79:0/2184182141 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc50801e670 con 0x558da0fa1f90 2024-08-20T01:39:05.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.518+0000 7fc51a23c740 1 -- 172.21.15.79:0/2184182141 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc50c096070 con 0x558da0fa1f90 2024-08-20T01:39:05.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.518+0000 7fc4f97fa640 1 -- 172.21.15.79:0/2184182141 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fc50801e870 con 0x558da0fa1f90 2024-08-20T01:39:05.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.518+0000 7fc51a23c740 10 client.16155 fetch_fsmap learned FSMap version 33 2024-08-20T01:39:05.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.518+0000 7fc51a23c740 1 -- 172.21.15.79:0/2184182141 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x558da10246c0 con 0x558da0fa1f90 2024-08-20T01:39:05.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.519+0000 7fc4f97fa640 1 -- 172.21.15.79:0/2184182141 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc50c096070 con 0x558da0fa1f90 2024-08-20T01:39:05.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.519+0000 7fc4f97fa640 1 -- 172.21.15.79:0/2184182141 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7fc508028030 con 0x558da0fa1f90 2024-08-20T01:39:05.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.519+0000 7fc51a23c740 10 client.16155 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:39:05.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.519+0000 7fc51a23c740 10 client.16155 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:39:05.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.519+0000 7fc51a23c740 20 client.16155 populate_metadata read hostname 'smithi079' 2024-08-20T01:39:05.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.519+0000 7fc51a23c740 1 --2- 172.21.15.79:0/2184182141 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558da1024f60 0x558da1027380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:05.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.519+0000 7fc51a23c740 4 client.16155 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:39:05.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.519+0000 7fc51a23c740 1 -- 172.21.15.79:0/2184182141 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558da0f0a2d0 con 0x558da1024f60 2024-08-20T01:39:05.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.519+0000 7fc515bdf640 1 --2- 172.21.15.79:0/2184182141 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558da1024f60 0x558da1027380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:05.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.520+0000 7fc4f97fa640 10 client.16155 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:39:05.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.520+0000 7fc515bdf640 1 --2- 172.21.15.79:0/2184182141 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558da1024f60 0x558da1027380 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b58e345c4009d11 server_cookie=688e98f1b17d7dcd in_seq=0 out_seq=0 2024-08-20T01:39:05.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.520+0000 7fc4f97fa640 1 -- 172.21.15.79:0/2184182141 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x558da0f0a2d0 con 0x558da1024f60 2024-08-20T01:39:05.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.520+0000 7fc4f97fa640 10 client.16155 handle_command_reply: tid=0 2024-08-20T01:39:05.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.520+0000 7fc51a23c740 1 client.16155 shutdown 2024-08-20T01:39:05.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.520+0000 7fc51a23c740 1 -- 172.21.15.79:0/2184182141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558da0fa1f90 msgr2=0x558da0fafbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:05.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.520+0000 7fc51a23c740 1 --2- 172.21.15.79:0/2184182141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558da0fa1f90 0x558da0fafbc0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fc508013e90 tx=0x7fc508004ab0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.520+0000 7fc51a23c740 1 -- 172.21.15.79:0/2184182141 shutdown_connections 2024-08-20T01:39:05.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.520+0000 7fc51a23c740 1 --2- 172.21.15.79:0/2184182141 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558da1024f60 0x558da1027380 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.520+0000 7fc51a23c740 1 --2- 172.21.15.79:0/2184182141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558da0fa1f90 0x558da0fafbc0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.520+0000 7fc51a23c740 1 --2- 172.21.15.79:0/2184182141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558da0f96000 0x558da0faf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.520+0000 7fc51a23c740 1 --2- 172.21.15.79:0/2184182141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558da0f956e0 0x558da0fb2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.520+0000 7fc4f97fa640 0 client.16155 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:39:05.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.520+0000 7fc51a23c740 1 -- 172.21.15.79:0/2184182141 >> 172.21.15.79:0/2184182141 conn(0x558da0f93510 msgr2=0x558da0f924a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:05.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.520+0000 7fc51a23c740 1 -- 172.21.15.79:0/2184182141 shutdown_connections 2024-08-20T01:39:05.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.520+0000 7fc51a23c740 1 -- 172.21.15.79:0/2184182141 wait complete. 2024-08-20T01:39:05.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.520+0000 7fc51a23c740 20 client.16155 trim_cache size 0 max 16384 2024-08-20T01:39:05.531 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:39:05.531 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-08-20T01:39:05.531 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-08-20T01:39:05.531 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:39:05.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.521+0000 7fc517e43640 1 -- 172.21.15.79:0/2593077714 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc4fc0b3bd0 msgr2=0x7fc4fc0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:05.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.521+0000 7fc517e43640 1 --2- 172.21.15.79:0/2593077714 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc4fc0b3bd0 0x7fc4fc0b6090 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc508005fd0 tx=0x7fc508004a40 comp rx=0 tx=0).stop 2024-08-20T01:39:05.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.521+0000 7fc517e43640 1 -- 172.21.15.79:0/2593077714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc510103830 msgr2=0x7fc51019b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:05.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.521+0000 7fc517e43640 1 --2- 172.21.15.79:0/2593077714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc510103830 0x7fc51019b100 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fc50c00c920 tx=0x7fc50c00cde0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.521+0000 7fc517e43640 1 -- 172.21.15.79:0/2593077714 shutdown_connections 2024-08-20T01:39:05.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.521+0000 7fc517e43640 1 --2- 172.21.15.79:0/2593077714 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc4fc0b3bd0 0x7fc4fc0b6090 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.521+0000 7fc517e43640 1 --2- 172.21.15.79:0/2593077714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc51010cde0 0x7fc5101a08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.521+0000 7fc517e43640 1 --2- 172.21.15.79:0/2593077714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc510104230 0x7fc51019b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.521+0000 7fc517e43640 1 --2- 172.21.15.79:0/2593077714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc510103830 0x7fc51019b100 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:05.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.521+0000 7fc517e43640 1 -- 172.21.15.79:0/2593077714 >> 172.21.15.79:0/2593077714 conn(0x7fc5100fd400 msgr2=0x7fc5100ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:05.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.521+0000 7fc517e43640 1 -- 172.21.15.79:0/2593077714 shutdown_connections 2024-08-20T01:39:05.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:05.521+0000 7fc517e43640 1 -- 172.21.15.79:0/2593077714 wait complete. 2024-08-20T01:39:06.123 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:05 smithi079 ceph-mon[18656]: pgmap v400: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 31 MiB/s wr, 26 op/s 2024-08-20T01:39:06.123 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:05 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:39:06.123 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:05 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:39:06.123 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:05 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:39:06.123 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:05 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:39:06.123 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:05 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:39:06.123 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:05 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:39:06.123 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:05 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:39:06.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:05 smithi175 ceph-mon[22392]: pgmap v400: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 31 MiB/s wr, 26 op/s 2024-08-20T01:39:06.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:05 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:39:06.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:05 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:39:06.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:05 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:39:06.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:05 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:39:06.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:05 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:39:06.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:05 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:39:06.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:05 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:39:06.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:05 smithi081 ceph-mon[22209]: pgmap v400: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 31 MiB/s wr, 26 op/s 2024-08-20T01:39:06.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:05 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:39:06.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:05 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:39:06.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:05 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:39:06.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:05 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:39:06.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:05 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:39:06.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:05 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:39:06.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:05 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:39:06.367 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T01:39:06.367 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:39:06.642 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:39:07.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.153+0000 7f8faecab640 1 -- 172.21.15.79:0/2179689937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fa8101500 msgr2=0x7f8fa81018e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:07.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.153+0000 7f8faecab640 1 --2- 172.21.15.79:0/2179689937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fa8101500 0x7f8fa81018e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c009900 tx=0x7f8f9c02a410 comp rx=0 tx=0).stop 2024-08-20T01:39:07.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.153+0000 7f8faecab640 1 -- 172.21.15.79:0/2179689937 shutdown_connections 2024-08-20T01:39:07.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.153+0000 7f8faecab640 1 --2- 172.21.15.79:0/2179689937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fa810cdc0 0x7f8fa810f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.153+0000 7f8faecab640 1 --2- 172.21.15.79:0/2179689937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fa8101f00 0x7f8fa810c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.153+0000 7f8faecab640 1 --2- 172.21.15.79:0/2179689937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fa8101500 0x7f8fa81018e0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.153+0000 7f8faecab640 1 -- 172.21.15.79:0/2179689937 >> 172.21.15.79:0/2179689937 conn(0x7f8fa8076bd0 msgr2=0x7f8fa8076fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:07.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.153+0000 7f8faecab640 1 -- 172.21.15.79:0/2179689937 shutdown_connections 2024-08-20T01:39:07.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.153+0000 7f8faecab640 1 -- 172.21.15.79:0/2179689937 wait complete. 2024-08-20T01:39:07.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.154+0000 7f8faecab640 1 Processor -- start 2024-08-20T01:39:07.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.154+0000 7f8faecab640 1 -- start start 2024-08-20T01:39:07.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.154+0000 7f8faecab640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fa8101500 0x7f8fa8198f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:07.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.154+0000 7f8faecab640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fa8101f00 0x7f8fa8199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:07.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.154+0000 7f8faecab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fa810cdc0 0x7f8fa819e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:07.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.154+0000 7f8faecab640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa8112970 con 0x7f8fa8101500 2024-08-20T01:39:07.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.154+0000 7f8faecab640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa81127f0 con 0x7f8fa810cdc0 2024-08-20T01:39:07.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.154+0000 7f8faecab640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa8112af0 con 0x7f8fa8101f00 2024-08-20T01:39:07.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.154+0000 7f8faca47640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fa8101500 0x7f8fa8198f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:07.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.154+0000 7f8faca47640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fa8101500 0x7f8fa8198f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51362/0 (socket says 172.21.15.79:51362) 2024-08-20T01:39:07.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.154+0000 7f8faca47640 1 -- 172.21.15.79:0/3480955109 learned_addr learned my addr 172.21.15.79:0/3480955109 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:07.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.154+0000 7f8fa7fff640 1 --2- 172.21.15.79:0/3480955109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fa8101f00 0x7f8fa8199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:07.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.155+0000 7f8fad248640 1 --2- 172.21.15.79:0/3480955109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fa810cdc0 0x7f8fa819e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:07.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.155+0000 7f8faca47640 1 -- 172.21.15.79:0/3480955109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fa8101f00 msgr2=0x7f8fa8199460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:07.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.155+0000 7f8faca47640 1 --2- 172.21.15.79:0/3480955109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fa8101f00 0x7f8fa8199460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.155+0000 7f8faca47640 1 -- 172.21.15.79:0/3480955109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fa810cdc0 msgr2=0x7f8fa819e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:07.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.155+0000 7f8faca47640 1 --2- 172.21.15.79:0/3480955109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fa810cdc0 0x7f8fa819e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.155+0000 7f8faca47640 1 -- 172.21.15.79:0/3480955109 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fa819efd0 con 0x7f8fa8101500 2024-08-20T01:39:07.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.155+0000 7f8faca47640 1 --2- 172.21.15.79:0/3480955109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fa8101500 0x7f8fa8198f20 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c02a930 tx=0x7f8f9c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:07.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.155+0000 7f8fa5ffb640 1 -- 172.21.15.79:0/3480955109 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c03f070 con 0x7f8fa8101500 2024-08-20T01:39:07.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.155+0000 7f8faecab640 1 -- 172.21.15.79:0/3480955109 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fa819f260 con 0x7f8fa8101500 2024-08-20T01:39:07.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.155+0000 7f8fa5ffb640 1 -- 172.21.15.79:0/3480955109 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8f9c003e40 con 0x7f8fa8101500 2024-08-20T01:39:07.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.155+0000 7f8fa5ffb640 1 -- 172.21.15.79:0/3480955109 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c035030 con 0x7f8fa8101500 2024-08-20T01:39:07.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.155+0000 7f8faecab640 1 -- 172.21.15.79:0/3480955109 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fa81a5980 con 0x7f8fa8101500 2024-08-20T01:39:07.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.157+0000 7f8faecab640 1 -- 172.21.15.79:0/3480955109 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fa81018e0 con 0x7f8fa8101500 2024-08-20T01:39:07.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.158+0000 7f8fa5ffb640 1 -- 172.21.15.79:0/3480955109 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f8f9c042070 con 0x7f8fa8101500 2024-08-20T01:39:07.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.159+0000 7f8fa5ffb640 1 --2- 172.21.15.79:0/3480955109 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f8f980b3bd0 0x7f8f980b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:07.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.159+0000 7f8fa7fff640 1 --2- 172.21.15.79:0/3480955109 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f8f980b3bd0 0x7f8f980b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:07.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.159+0000 7f8fa5ffb640 1 -- 172.21.15.79:0/3480955109 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f8f9c1043f0 con 0x7f8fa8101500 2024-08-20T01:39:07.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.159+0000 7f8fa7fff640 1 --2- 172.21.15.79:0/3480955109 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f8f980b3bd0 0x7f8f980b6090 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8fa81011a0 tx=0x7f8f9400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:07.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.163+0000 7f8fa5ffb640 1 -- 172.21.15.79:0/3480955109 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f8f9c0cba50 con 0x7f8fa8101500 2024-08-20T01:39:07.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.420+0000 7f8faecab640 1 -- 172.21.15.79:0/3480955109 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8fa81a5c70 con 0x7f8fa8101500 2024-08-20T01:39:07.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.421+0000 7f8fa5ffb640 1 -- 172.21.15.79:0/3480955109 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11986 (secure 0 0 0) 0x7f8f9c0cb350 con 0x7f8fa8101500 2024-08-20T01:39:07.423 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:39:07.423 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":33,"btime":"2024-08-20T01:38:36:482135+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14670,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/735082912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":735082912},{"type":"v1","addr":"172.21.15.79:6835","nonce":735082912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2150339873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2150339873},{"type":"v1","addr":"172.21.15.79:6837","nonce":2150339873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":33,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:34:55.133562+0000","modified":"2024-08-20T01:38:35.888862+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24539,"mds_1":24538,"mds_2":24523,"mds_3":24514,"mds_4":24512},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14724":{"gid":14724,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/1071242274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1071242274},{"type":"v1","addr":"172.21.15.79:6839","nonce":1071242274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14730":{"gid":14730,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6841/2448977611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":2448977611},{"type":"v1","addr":"172.21.15.79:6841","nonce":2448977611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/1257507005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1257507005},{"type":"v1","addr":"172.21.15.81:6833","nonce":1257507005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1499936216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1499936216},{"type":"v1","addr":"172.21.15.81:6835","nonce":1499936216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/1107229215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1107229215},{"type":"v1","addr":"172.21.15.175:6833","nonce":1107229215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6837/2073598870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2073598870},{"type":"v1","addr":"172.21.15.81:6837","nonce":2073598870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/2552601173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2552601173},{"type":"v1","addr":"172.21.15.175:6835","nonce":2552601173}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6837/1767284089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1767284089},{"type":"v1","addr":"172.21.15.175:6837","nonce":1767284089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/1331748742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1331748742},{"type":"v1","addr":"172.21.15.175:6839","nonce":1331748742}]},"join_fscid":-1,"export_targets":[2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/4098410583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":4098410583},{"type":"v1","addr":"172.21.15.81:6839","nonce":4098410583}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24539,"qdb_cluster":[24539,24523,24514,24538,24512]},"id":1}]} 2024-08-20T01:39:07.424 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 33 2024-08-20T01:39:07.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.424+0000 7f8faecab640 1 -- 172.21.15.79:0/3480955109 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f8f980b3bd0 msgr2=0x7f8f980b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:07.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.424+0000 7f8faecab640 1 --2- 172.21.15.79:0/3480955109 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f8f980b3bd0 0x7f8f980b6090 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8fa81011a0 tx=0x7f8f9400a2d0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.424+0000 7f8faecab640 1 -- 172.21.15.79:0/3480955109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fa8101500 msgr2=0x7f8fa8198f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:07.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.424+0000 7f8faecab640 1 --2- 172.21.15.79:0/3480955109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fa8101500 0x7f8fa8198f20 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c02a930 tx=0x7f8f9c003c20 comp rx=0 tx=0).stop 2024-08-20T01:39:07.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.424+0000 7f8faecab640 1 -- 172.21.15.79:0/3480955109 shutdown_connections 2024-08-20T01:39:07.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.424+0000 7f8faecab640 1 --2- 172.21.15.79:0/3480955109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fa810cdc0 0x7f8fa819e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.424+0000 7f8faecab640 1 --2- 172.21.15.79:0/3480955109 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f8f980b3bd0 0x7f8f980b6090 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.424+0000 7f8faecab640 1 --2- 172.21.15.79:0/3480955109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fa8101f00 0x7f8fa8199460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.424+0000 7f8faecab640 1 --2- 172.21.15.79:0/3480955109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fa8101500 0x7f8fa8198f20 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:07.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.424+0000 7f8faecab640 1 -- 172.21.15.79:0/3480955109 >> 172.21.15.79:0/3480955109 conn(0x7f8fa8076bd0 msgr2=0x7f8fa80fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:07.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.424+0000 7f8faecab640 1 -- 172.21.15.79:0/3480955109 shutdown_connections 2024-08-20T01:39:07.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:07.424+0000 7f8faecab640 1 -- 172.21.15.79:0/3480955109 wait complete. 2024-08-20T01:39:08.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:07 smithi175 ceph-mon[22392]: pgmap v401: 97 pgs: 97 active+clean; 1.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 33 MiB/s wr, 24 op/s 2024-08-20T01:39:08.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:07 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/3480955109' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:39:08.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:07 smithi079 ceph-mon[18656]: pgmap v401: 97 pgs: 97 active+clean; 1.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 33 MiB/s wr, 24 op/s 2024-08-20T01:39:08.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:07 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/3480955109' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:39:08.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:07 smithi081 ceph-mon[22209]: pgmap v401: 97 pgs: 97 active+clean; 1.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 33 MiB/s wr, 24 op/s 2024-08-20T01:39:08.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:07 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/3480955109' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:39:08.283 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-20T01:39:08.568 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:39:09.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.085+0000 7f34a18b8640 1 -- 172.21.15.79:0/3310313100 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f349c1039a0 msgr2=0x7f349c103d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:09.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.085+0000 7f34a18b8640 1 --2- 172.21.15.79:0/3310313100 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f349c1039a0 0x7f349c103d80 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f348c009900 tx=0x7f348c02a410 comp rx=0 tx=0).stop 2024-08-20T01:39:09.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.085+0000 7f34a18b8640 1 -- 172.21.15.79:0/3310313100 shutdown_connections 2024-08-20T01:39:09.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.085+0000 7f34a18b8640 1 --2- 172.21.15.79:0/3310313100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f349c10ce00 0x7f349c10f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.085+0000 7f34a18b8640 1 --2- 172.21.15.79:0/3310313100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f349c1042c0 0x7f349c10c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.085+0000 7f34a18b8640 1 --2- 172.21.15.79:0/3310313100 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f349c1039a0 0x7f349c103d80 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.085+0000 7f34a18b8640 1 -- 172.21.15.79:0/3310313100 >> 172.21.15.79:0/3310313100 conn(0x7f349c0fd400 msgr2=0x7f349c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:09.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.085+0000 7f34a18b8640 1 -- 172.21.15.79:0/3310313100 shutdown_connections 2024-08-20T01:39:09.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.085+0000 7f34a18b8640 1 -- 172.21.15.79:0/3310313100 wait complete. 2024-08-20T01:39:09.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.086+0000 7f34a18b8640 1 Processor -- start 2024-08-20T01:39:09.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.086+0000 7f34a18b8640 1 -- start start 2024-08-20T01:39:09.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.086+0000 7f34a18b8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f349c1039a0 0x7f349c198f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:09.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.086+0000 7f34a18b8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f349c1042c0 0x7f349c199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:09.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.086+0000 7f34a18b8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f349c10ce00 0x7f349c19e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:09.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.087+0000 7f34a18b8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f349c112980 con 0x7f349c1039a0 2024-08-20T01:39:09.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.087+0000 7f34a18b8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f349c112800 con 0x7f349c10ce00 2024-08-20T01:39:09.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.087+0000 7f34a18b8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f349c112b00 con 0x7f349c1042c0 2024-08-20T01:39:09.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.087+0000 7f349affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f349c1039a0 0x7f349c198f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:09.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.087+0000 7f349affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f349c1039a0 0x7f349c198f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51390/0 (socket says 172.21.15.79:51390) 2024-08-20T01:39:09.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.087+0000 7f349b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f349c10ce00 0x7f349c19e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:09.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.087+0000 7f349affd640 1 -- 172.21.15.79:0/2486484172 learned_addr learned my addr 172.21.15.79:0/2486484172 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:09.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.087+0000 7f349a7fc640 1 --2- 172.21.15.79:0/2486484172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f349c1042c0 0x7f349c199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:09.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.087+0000 7f349affd640 1 -- 172.21.15.79:0/2486484172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f349c1042c0 msgr2=0x7f349c199470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:09.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.087+0000 7f349affd640 1 --2- 172.21.15.79:0/2486484172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f349c1042c0 0x7f349c199470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.087+0000 7f349affd640 1 -- 172.21.15.79:0/2486484172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f349c10ce00 msgr2=0x7f349c19e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:09.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.087+0000 7f349affd640 1 --2- 172.21.15.79:0/2486484172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f349c10ce00 0x7f349c19e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.087+0000 7f349affd640 1 -- 172.21.15.79:0/2486484172 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f349c19efe0 con 0x7f349c1039a0 2024-08-20T01:39:09.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.087+0000 7f349affd640 1 --2- 172.21.15.79:0/2486484172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f349c1039a0 0x7f349c198f30 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f348c009a20 tx=0x7f348c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:09.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.087+0000 7f34a08b6640 1 -- 172.21.15.79:0/2486484172 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348c03f030 con 0x7f349c1039a0 2024-08-20T01:39:09.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.088+0000 7f34a08b6640 1 -- 172.21.15.79:0/2486484172 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f348c0035f0 con 0x7f349c1039a0 2024-08-20T01:39:09.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.088+0000 7f34a18b8640 1 -- 172.21.15.79:0/2486484172 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f349c19f270 con 0x7f349c1039a0 2024-08-20T01:39:09.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.088+0000 7f34a08b6640 1 -- 172.21.15.79:0/2486484172 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348c035070 con 0x7f349c1039a0 2024-08-20T01:39:09.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.088+0000 7f34a18b8640 1 -- 172.21.15.79:0/2486484172 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f349c1a5990 con 0x7f349c1039a0 2024-08-20T01:39:09.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.090+0000 7f34a3cb1740 1 Processor -- start 2024-08-20T01:39:09.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.090+0000 7f34a3cb1740 1 -- start start 2024-08-20T01:39:09.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.091+0000 7f34a3cb1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf1ee4a880 0x55bf1ee4ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:09.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.091+0000 7f34a3cb1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf1ee4b1a0 0x55bf1ee56bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:09.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.091+0000 7f34a3cb1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf1ee57130 0x55bf1ee59520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:09.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.091+0000 7f34a3cb1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bf1edc1930 con 0x55bf1ee57130 2024-08-20T01:39:09.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.091+0000 7f34a3cb1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bf1edb0e30 con 0x55bf1ee4b1a0 2024-08-20T01:39:09.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.091+0000 7f34a3cb1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55bf1edb4e70 con 0x55bf1ee4a880 2024-08-20T01:39:09.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.091+0000 7f349a7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf1ee57130 0x55bf1ee59520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:09.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.091+0000 7f34a08b6640 1 -- 172.21.15.79:0/2486484172 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f348c003aa0 con 0x7f349c1039a0 2024-08-20T01:39:09.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.091+0000 7f349a7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf1ee57130 0x55bf1ee59520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51392/0 (socket says 172.21.15.79:51392) 2024-08-20T01:39:09.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.091+0000 7f349a7fc640 1 -- 172.21.15.79:0/1811444596 learned_addr learned my addr 172.21.15.79:0/1811444596 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:09.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.091+0000 7f349b7fe640 1 --2- 172.21.15.79:0/1811444596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf1ee4a880 0x55bf1ee4ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:09.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.091+0000 7f349a7fc640 1 -- 172.21.15.79:0/1811444596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf1ee4a880 msgr2=0x55bf1ee4ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:09.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.091+0000 7f349a7fc640 1 --2- 172.21.15.79:0/1811444596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf1ee4a880 0x55bf1ee4ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.091+0000 7f349a7fc640 1 -- 172.21.15.79:0/1811444596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf1ee4b1a0 msgr2=0x55bf1ee56bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:09.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.091+0000 7f349a7fc640 1 --2- 172.21.15.79:0/1811444596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf1ee4b1a0 0x55bf1ee56bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.091+0000 7f349a7fc640 1 -- 172.21.15.79:0/1811444596 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf1eb10650 con 0x55bf1ee57130 2024-08-20T01:39:09.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.091+0000 7f349a7fc640 1 --2- 172.21.15.79:0/1811444596 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf1ee57130 0x55bf1ee59520 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f3490009a10 tx=0x7f3490009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=864e0813c0b2a571 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:09.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.092+0000 7f3481ffb640 1 -- 172.21.15.79:0/1811444596 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3490017070 con 0x55bf1ee57130 2024-08-20T01:39:09.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.092+0000 7f3481ffb640 1 -- 172.21.15.79:0/1811444596 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3490013470 con 0x55bf1ee57130 2024-08-20T01:39:09.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.092+0000 7f3481ffb640 1 -- 172.21.15.79:0/1811444596 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3490012630 con 0x55bf1ee57130 2024-08-20T01:39:09.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.092+0000 7f34a08b6640 1 --2- 172.21.15.79:0/2486484172 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f34840b3bd0 0x7f34840b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:09.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.092+0000 7f349b7fe640 1 --2- 172.21.15.79:0/2486484172 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f34840b3bd0 0x7f34840b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:09.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.092+0000 7f34a08b6640 1 -- 172.21.15.79:0/2486484172 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f348c1044c0 con 0x7f349c1039a0 2024-08-20T01:39:09.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.093+0000 7f349b7fe640 1 --2- 172.21.15.79:0/2486484172 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f34840b3bd0 0x7f34840b6090 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3494007ed0 tx=0x7f3494007520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:09.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.093+0000 7f34a3cb1740 1 -- 172.21.15.79:0/1811444596 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf1ee57130 msgr2=0x55bf1ee59520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:09.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.093+0000 7f34a3cb1740 1 --2- 172.21.15.79:0/1811444596 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf1ee57130 0x55bf1ee59520 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f3490009a10 tx=0x7f3490009ed0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.093+0000 7f34a3cb1740 1 -- 172.21.15.79:0/1811444596 shutdown_connections 2024-08-20T01:39:09.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.093+0000 7f34a3cb1740 1 --2- 172.21.15.79:0/1811444596 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf1ee57130 0x55bf1ee59520 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.093+0000 7f34a3cb1740 1 --2- 172.21.15.79:0/1811444596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf1ee4b1a0 0x55bf1ee56bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.093+0000 7f34a3cb1740 1 --2- 172.21.15.79:0/1811444596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf1ee4a880 0x55bf1ee4ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.093+0000 7f34a3cb1740 1 -- 172.21.15.79:0/1811444596 >> 172.21.15.79:0/1811444596 conn(0x55bf1ee486b0 msgr2=0x55bf1ee49850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:09.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.093+0000 7f34a3cb1740 1 -- 172.21.15.79:0/1811444596 shutdown_connections 2024-08-20T01:39:09.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.093+0000 7f34a3cb1740 1 -- 172.21.15.79:0/1811444596 wait complete. 2024-08-20T01:39:09.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.093+0000 7f34a3cb1740 1 -- start start 2024-08-20T01:39:09.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.093+0000 7f34a3cb1740 1 Processor -- start 2024-08-20T01:39:09.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.094+0000 7f34a3cb1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf1ee4a880 0x55bf1ee5b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:09.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.094+0000 7f34a3cb1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf1ee4b1a0 0x55bf1ee5bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:09.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.094+0000 7f34a3cb1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf1ee57130 0x55bf1ee60e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:09.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.094+0000 7f34a3cb1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bf1ec13700 con 0x55bf1ee4a880 2024-08-20T01:39:09.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.094+0000 7f34a3cb1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bf1ed37810 con 0x55bf1ee4b1a0 2024-08-20T01:39:09.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.094+0000 7f34a3cb1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55bf1ee59de0 con 0x55bf1ee57130 2024-08-20T01:39:09.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.094+0000 7f34a3cb1740 10 client.0 _ll_register_callbacks cb 0x55bf1edaa700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:09.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.094+0000 7f349affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf1ee4a880 0x55bf1ee5b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:09.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.094+0000 7f349affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf1ee4a880 0x55bf1ee5b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51398/0 (socket says 172.21.15.79:51398) 2024-08-20T01:39:09.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.094+0000 7f349affd640 1 -- 172.21.15.79:0/2191630087 learned_addr learned my addr 172.21.15.79:0/2191630087 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:09.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.094+0000 7f349b7fe640 1 --2- 172.21.15.79:0/2191630087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf1ee57130 0x55bf1ee60e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:09.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.094+0000 7f349a7fc640 1 --2- 172.21.15.79:0/2191630087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf1ee4b1a0 0x55bf1ee5bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:09.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.094+0000 7f349affd640 1 -- 172.21.15.79:0/2191630087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf1ee57130 msgr2=0x55bf1ee60e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:09.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.094+0000 7f349affd640 1 --2- 172.21.15.79:0/2191630087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf1ee57130 0x55bf1ee60e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.094+0000 7f349affd640 1 -- 172.21.15.79:0/2191630087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf1ee4b1a0 msgr2=0x55bf1ee5bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:09.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.094+0000 7f349affd640 1 --2- 172.21.15.79:0/2191630087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf1ee4b1a0 0x55bf1ee5bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.094+0000 7f349affd640 1 -- 172.21.15.79:0/2191630087 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf1ee61540 con 0x55bf1ee4a880 2024-08-20T01:39:09.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.094+0000 7f349b7fe640 1 --2- 172.21.15.79:0/2191630087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf1ee57130 0x55bf1ee60e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:39:09.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.094+0000 7f349a7fc640 1 --2- 172.21.15.79:0/2191630087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf1ee4b1a0 0x55bf1ee5bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:39:09.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.094+0000 7f349affd640 1 --2- 172.21.15.79:0/2191630087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf1ee4a880 0x55bf1ee5b740 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f348c032fd0 tx=0x7f348c0cad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f214328e4fcbc9e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:09.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.094+0000 7f347affd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:39:09.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.095+0000 7f347affd640 1 -- 172.21.15.79:0/2191630087 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348c049070 con 0x55bf1ee4a880 2024-08-20T01:39:09.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.095+0000 7f347affd640 1 -- 172.21.15.79:0/2191630087 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f348c0c7760 con 0x55bf1ee4a880 2024-08-20T01:39:09.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.095+0000 7f34a3cb1740 1 -- 172.21.15.79:0/2191630087 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bf1ed60150 con 0x55bf1ee4a880 2024-08-20T01:39:09.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.095+0000 7f347affd640 1 -- 172.21.15.79:0/2191630087 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f348c0cfa20 con 0x55bf1ee4a880 2024-08-20T01:39:09.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.095+0000 7f34a3cb1740 10 client.16173 fetch_fsmap learned FSMap version 33 2024-08-20T01:39:09.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.095+0000 7f34a3cb1740 1 -- 172.21.15.79:0/2191630087 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55bf1ee6a070 con 0x55bf1ee4a880 2024-08-20T01:39:09.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.095+0000 7f347affd640 1 -- 172.21.15.79:0/2191630087 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55bf1ed60150 con 0x55bf1ee4a880 2024-08-20T01:39:09.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.095+0000 7f347affd640 1 -- 172.21.15.79:0/2191630087 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7f348c0cb730 con 0x55bf1ee4a880 2024-08-20T01:39:09.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.095+0000 7f34a3cb1740 10 client.16173 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:39:09.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.095+0000 7f34a3cb1740 10 client.16173 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:39:09.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.095+0000 7f34a3cb1740 20 client.16173 populate_metadata read hostname 'smithi079' 2024-08-20T01:39:09.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.095+0000 7f34a3cb1740 1 --2- 172.21.15.79:0/2191630087 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55bf1ee6b3c0 0x55bf1ee6d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:09.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.095+0000 7f34a3cb1740 4 client.16173 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:39:09.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.095+0000 7f34a3cb1740 1 -- 172.21.15.79:0/2191630087 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bf1edc3880 con 0x55bf1ee6b3c0 2024-08-20T01:39:09.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.096+0000 7f349a7fc640 1 --2- 172.21.15.79:0/2191630087 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55bf1ee6b3c0 0x55bf1ee6d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:09.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.096+0000 7f347affd640 10 client.16173 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:39:09.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.096+0000 7f349a7fc640 1 --2- 172.21.15.79:0/2191630087 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55bf1ee6b3c0 0x55bf1ee6d7b0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=93808e786c133b2d server_cookie=93907b3716d325ce in_seq=0 out_seq=0 2024-08-20T01:39:09.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.097+0000 7f347affd640 1 -- 172.21.15.79:0/2191630087 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bf1edc3880 con 0x55bf1ee6b3c0 2024-08-20T01:39:09.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.097+0000 7f347affd640 10 client.16173 handle_command_reply: tid=0 2024-08-20T01:39:09.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.097+0000 7f34a3cb1740 1 client.16173 shutdown 2024-08-20T01:39:09.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.097+0000 7f34a3cb1740 1 -- 172.21.15.79:0/2191630087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf1ee4a880 msgr2=0x55bf1ee5b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:09.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.097+0000 7f34a3cb1740 1 --2- 172.21.15.79:0/2191630087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf1ee4a880 0x55bf1ee5b740 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f348c032fd0 tx=0x7f348c0cad00 comp rx=0 tx=0).stop 2024-08-20T01:39:09.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.097+0000 7f34a3cb1740 1 -- 172.21.15.79:0/2191630087 shutdown_connections 2024-08-20T01:39:09.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.097+0000 7f34a3cb1740 1 --2- 172.21.15.79:0/2191630087 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55bf1ee6b3c0 0x55bf1ee6d7b0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.097+0000 7f34a3cb1740 1 --2- 172.21.15.79:0/2191630087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf1ee57130 0x55bf1ee60e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.097+0000 7f347affd640 0 client.16173 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:39:09.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.097+0000 7f34a3cb1740 1 --2- 172.21.15.79:0/2191630087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf1ee4b1a0 0x55bf1ee5bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.097+0000 7f34a3cb1740 1 --2- 172.21.15.79:0/2191630087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf1ee4a880 0x55bf1ee5b740 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.097+0000 7f34a3cb1740 1 -- 172.21.15.79:0/2191630087 >> 172.21.15.79:0/2191630087 conn(0x55bf1ee486b0 msgr2=0x55bf1ee4e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:09.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.097+0000 7f34a3cb1740 1 -- 172.21.15.79:0/2191630087 shutdown_connections 2024-08-20T01:39:09.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.097+0000 7f34a3cb1740 1 -- 172.21.15.79:0/2191630087 wait complete. 2024-08-20T01:39:09.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.097+0000 7f34a3cb1740 20 client.16173 trim_cache size 0 max 16384 2024-08-20T01:39:09.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.112+0000 7f34a3cb1740 1 Processor -- start 2024-08-20T01:39:09.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.112+0000 7f34a3cb1740 1 -- start start 2024-08-20T01:39:09.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.112+0000 7f34a3cb1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf1ee4a880 0x55bf1ee49e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:09.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.112+0000 7f34a3cb1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf1ee4b1a0 0x55bf1ee433d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:09.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.112+0000 7f34a3cb1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf1ee57130 0x55bf1ee528c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:09.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.112+0000 7f34a3cb1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f349c1abd10 con 0x55bf1ee57130 2024-08-20T01:39:09.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.112+0000 7f34a3cb1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f349c1ad9a0 con 0x55bf1ee4a880 2024-08-20T01:39:09.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.112+0000 7f34a3cb1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f349c1ac3e0 con 0x55bf1ee4b1a0 2024-08-20T01:39:09.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.113+0000 7f349b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf1ee57130 0x55bf1ee528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:09.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.113+0000 7f349b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf1ee57130 0x55bf1ee528c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51410/0 (socket says 172.21.15.79:51410) 2024-08-20T01:39:09.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.113+0000 7f349b7fe640 1 -- 172.21.15.79:0/605762999 learned_addr learned my addr 172.21.15.79:0/605762999 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:09.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.113+0000 7f349affd640 1 --2- 172.21.15.79:0/605762999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf1ee4a880 0x55bf1ee49e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:09.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.113+0000 7f349a7fc640 1 --2- 172.21.15.79:0/605762999 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf1ee4b1a0 0x55bf1ee433d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:09.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.113+0000 7f349b7fe640 1 -- 172.21.15.79:0/605762999 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf1ee4b1a0 msgr2=0x55bf1ee433d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:09.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.113+0000 7f349b7fe640 1 --2- 172.21.15.79:0/605762999 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf1ee4b1a0 0x55bf1ee433d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.113+0000 7f349b7fe640 1 -- 172.21.15.79:0/605762999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf1ee4a880 msgr2=0x55bf1ee49e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:09.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.113+0000 7f349b7fe640 1 --2- 172.21.15.79:0/605762999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf1ee4a880 0x55bf1ee49e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.113+0000 7f349b7fe640 1 -- 172.21.15.79:0/605762999 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf1ee4afd0 con 0x55bf1ee57130 2024-08-20T01:39:09.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.113+0000 7f349a7fc640 1 --2- 172.21.15.79:0/605762999 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf1ee4b1a0 0x55bf1ee433d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:39:09.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.113+0000 7f349b7fe640 1 --2- 172.21.15.79:0/605762999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf1ee57130 0x55bf1ee528c0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f3494005c20 tx=0x7f3494014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d76b455a2d5bc5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:09.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.113+0000 7f34817fa640 1 -- 172.21.15.79:0/605762999 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3494028670 con 0x55bf1ee57130 2024-08-20T01:39:09.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.114+0000 7f34817fa640 1 -- 172.21.15.79:0/605762999 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3494023070 con 0x55bf1ee57130 2024-08-20T01:39:09.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.114+0000 7f34817fa640 1 -- 172.21.15.79:0/605762999 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f349401f9c0 con 0x55bf1ee57130 2024-08-20T01:39:09.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.114+0000 7f34a3cb1740 1 -- 172.21.15.79:0/605762999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf1ee57130 msgr2=0x55bf1ee528c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:09.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.114+0000 7f34a3cb1740 1 --2- 172.21.15.79:0/605762999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf1ee57130 0x55bf1ee528c0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f3494005c20 tx=0x7f3494014000 comp rx=0 tx=0).stop 2024-08-20T01:39:09.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.114+0000 7f34a3cb1740 1 -- 172.21.15.79:0/605762999 shutdown_connections 2024-08-20T01:39:09.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.114+0000 7f34a3cb1740 1 --2- 172.21.15.79:0/605762999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf1ee57130 0x55bf1ee528c0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.114+0000 7f34a3cb1740 1 --2- 172.21.15.79:0/605762999 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf1ee4b1a0 0x55bf1ee433d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.114+0000 7f34a3cb1740 1 --2- 172.21.15.79:0/605762999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf1ee4a880 0x55bf1ee49e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.114+0000 7f34a3cb1740 1 -- 172.21.15.79:0/605762999 >> 172.21.15.79:0/605762999 conn(0x55bf1ee486b0 msgr2=0x55bf1ee4e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:09.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.114+0000 7f34a3cb1740 1 -- 172.21.15.79:0/605762999 shutdown_connections 2024-08-20T01:39:09.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.114+0000 7f34a3cb1740 1 -- 172.21.15.79:0/605762999 wait complete. 2024-08-20T01:39:09.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.115+0000 7f34a3cb1740 1 -- start start 2024-08-20T01:39:09.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.115+0000 7f34a3cb1740 1 Processor -- start 2024-08-20T01:39:09.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.115+0000 7f34a3cb1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf1ee4a880 0x55bf1ee51430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:09.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.115+0000 7f34a3cb1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf1ee4b1a0 0x55bf1ee51970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:09.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.115+0000 7f34a3cb1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf1ee57130 0x55bf1ee65dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:09.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.115+0000 7f34a3cb1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f349c1ad210 con 0x55bf1ee57130 2024-08-20T01:39:09.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.115+0000 7f34a3cb1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f349c1acab0 con 0x55bf1ee4a880 2024-08-20T01:39:09.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.115+0000 7f34a3cb1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f349c1a9d10 con 0x55bf1ee4b1a0 2024-08-20T01:39:09.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.115+0000 7f34a3cb1740 10 client.0 _ll_register_callbacks cb 0x7f348c005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:09.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.116+0000 7f349b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf1ee57130 0x55bf1ee65dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:09.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.116+0000 7f349b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf1ee57130 0x55bf1ee65dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51422/0 (socket says 172.21.15.79:51422) 2024-08-20T01:39:09.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.116+0000 7f349b7fe640 1 -- 172.21.15.79:0/976568362 learned_addr learned my addr 172.21.15.79:0/976568362 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:09.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.116+0000 7f349affd640 1 --2- 172.21.15.79:0/976568362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf1ee4a880 0x55bf1ee51430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:09.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.116+0000 7f349a7fc640 1 --2- 172.21.15.79:0/976568362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf1ee4b1a0 0x55bf1ee51970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:09.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.116+0000 7f349b7fe640 1 -- 172.21.15.79:0/976568362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf1ee4b1a0 msgr2=0x55bf1ee51970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:09.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.116+0000 7f349b7fe640 1 --2- 172.21.15.79:0/976568362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf1ee4b1a0 0x55bf1ee51970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.116+0000 7f349b7fe640 1 -- 172.21.15.79:0/976568362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf1ee4a880 msgr2=0x55bf1ee51430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:09.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.116+0000 7f349b7fe640 1 --2- 172.21.15.79:0/976568362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf1ee4a880 0x55bf1ee51430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.116+0000 7f349b7fe640 1 -- 172.21.15.79:0/976568362 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf1ee66300 con 0x55bf1ee57130 2024-08-20T01:39:09.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.116+0000 7f349affd640 1 --2- 172.21.15.79:0/976568362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf1ee4a880 0x55bf1ee51430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:09.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.116+0000 7f349b7fe640 1 --2- 172.21.15.79:0/976568362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf1ee57130 0x55bf1ee65dc0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f34940077f0 tx=0x7f349401fed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=627b5d0998487bc server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:09.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.116+0000 7f347affd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:39:09.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.116+0000 7f347affd640 1 -- 172.21.15.79:0/976568362 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3494004e50 con 0x55bf1ee57130 2024-08-20T01:39:09.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.116+0000 7f347affd640 1 -- 172.21.15.79:0/976568362 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f3494005050 con 0x55bf1ee57130 2024-08-20T01:39:09.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.116+0000 7f34a3cb1740 1 -- 172.21.15.79:0/976568362 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3494023070 con 0x55bf1ee57130 2024-08-20T01:39:09.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.117+0000 7f347affd640 1 -- 172.21.15.79:0/976568362 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f349401f430 con 0x55bf1ee57130 2024-08-20T01:39:09.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.117+0000 7f34a3cb1740 10 client.16179 fetch_fsmap learned FSMap version 33 2024-08-20T01:39:09.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.117+0000 7f34a3cb1740 1 -- 172.21.15.79:0/976568362 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55bf1ee675c0 con 0x55bf1ee57130 2024-08-20T01:39:09.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.117+0000 7f347affd640 1 -- 172.21.15.79:0/976568362 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3494023070 con 0x55bf1ee57130 2024-08-20T01:39:09.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.117+0000 7f347affd640 1 -- 172.21.15.79:0/976568362 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7f3494028670 con 0x55bf1ee57130 2024-08-20T01:39:09.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.117+0000 7f34a3cb1740 10 client.16179 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:39:09.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.117+0000 7f34a3cb1740 10 client.16179 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:39:09.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.117+0000 7f34a3cb1740 20 client.16179 populate_metadata read hostname 'smithi079' 2024-08-20T01:39:09.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.117+0000 7f34a3cb1740 1 --2- 172.21.15.79:0/976568362 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55bf1eeda840 0x55bf1eedcc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:09.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.117+0000 7f34a3cb1740 4 client.16179 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:39:09.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.117+0000 7f34a3cb1740 1 -- 172.21.15.79:0/976568362 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bf1edbf320 con 0x55bf1eeda840 2024-08-20T01:39:09.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.117+0000 7f349affd640 1 --2- 172.21.15.79:0/976568362 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55bf1eeda840 0x55bf1eedcc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:09.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.118+0000 7f347affd640 10 client.16179 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:39:09.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.118+0000 7f349affd640 1 --2- 172.21.15.79:0/976568362 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55bf1eeda840 0x55bf1eedcc30 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=fa9b28b7d6b3c062 server_cookie=9e955ed2c6b5d034 in_seq=0 out_seq=0 2024-08-20T01:39:09.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.118+0000 7f347affd640 1 -- 172.21.15.79:0/976568362 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bf1edbf320 con 0x55bf1eeda840 2024-08-20T01:39:09.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.118+0000 7f347affd640 10 client.16179 handle_command_reply: tid=0 2024-08-20T01:39:09.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.118+0000 7f34a3cb1740 1 client.16179 shutdown 2024-08-20T01:39:09.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.118+0000 7f34a3cb1740 1 -- 172.21.15.79:0/976568362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf1ee57130 msgr2=0x55bf1ee65dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:09.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.118+0000 7f34a3cb1740 1 --2- 172.21.15.79:0/976568362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf1ee57130 0x55bf1ee65dc0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f34940077f0 tx=0x7f349401fed0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.118+0000 7f34a3cb1740 1 -- 172.21.15.79:0/976568362 shutdown_connections 2024-08-20T01:39:09.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.118+0000 7f34a3cb1740 1 --2- 172.21.15.79:0/976568362 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55bf1eeda840 0x55bf1eedcc30 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.118+0000 7f34a3cb1740 1 --2- 172.21.15.79:0/976568362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf1ee57130 0x55bf1ee65dc0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.118+0000 7f34a3cb1740 1 --2- 172.21.15.79:0/976568362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf1ee4b1a0 0x55bf1ee51970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.118+0000 7f34a3cb1740 1 --2- 172.21.15.79:0/976568362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf1ee4a880 0x55bf1ee51430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.118+0000 7f34a3cb1740 1 -- 172.21.15.79:0/976568362 >> 172.21.15.79:0/976568362 conn(0x55bf1ee486b0 msgr2=0x55bf1ee5a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:09.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.118+0000 7f347affd640 0 client.16179 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:39:09.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.118+0000 7f34a3cb1740 1 -- 172.21.15.79:0/976568362 shutdown_connections 2024-08-20T01:39:09.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.119+0000 7f34a3cb1740 1 -- 172.21.15.79:0/976568362 wait complete. 2024-08-20T01:39:09.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.119+0000 7f34a3cb1740 20 client.16179 trim_cache size 0 max 16384 2024-08-20T01:39:09.127 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:39:09.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.119+0000 7f34a18b8640 1 -- 172.21.15.79:0/2486484172 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f34840b3bd0 msgr2=0x7f34840b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:09.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.119+0000 7f34a18b8640 1 --2- 172.21.15.79:0/2486484172 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f34840b3bd0 0x7f34840b6090 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3494007ed0 tx=0x7f3494007520 comp rx=0 tx=0).stop 2024-08-20T01:39:09.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.119+0000 7f34a18b8640 1 -- 172.21.15.79:0/2486484172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f349c1039a0 msgr2=0x7f349c198f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:09.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.119+0000 7f34a18b8640 1 --2- 172.21.15.79:0/2486484172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f349c1039a0 0x7f349c198f30 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f348c009a20 tx=0x7f348c004270 comp rx=0 tx=0).stop 2024-08-20T01:39:09.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.119+0000 7f34a18b8640 1 -- 172.21.15.79:0/2486484172 shutdown_connections 2024-08-20T01:39:09.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.119+0000 7f34a18b8640 1 --2- 172.21.15.79:0/2486484172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f349c10ce00 0x7f349c19e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.119+0000 7f34a18b8640 1 --2- 172.21.15.79:0/2486484172 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f34840b3bd0 0x7f34840b6090 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.119+0000 7f34a18b8640 1 --2- 172.21.15.79:0/2486484172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f349c1042c0 0x7f349c199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.119+0000 7f34a18b8640 1 --2- 172.21.15.79:0/2486484172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f349c1039a0 0x7f349c198f30 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:09.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.119+0000 7f34a18b8640 1 -- 172.21.15.79:0/2486484172 >> 172.21.15.79:0/2486484172 conn(0x7f349c0fd400 msgr2=0x7f349c0fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:09.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.120+0000 7f34a18b8640 1 -- 172.21.15.79:0/2486484172 shutdown_connections 2024-08-20T01:39:09.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:09.120+0000 7f34a18b8640 1 -- 172.21.15.79:0/2486484172 wait complete. 2024-08-20T01:39:09.970 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:09 smithi079 ceph-mon[18656]: pgmap v402: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 30 MiB/s wr, 26 op/s 2024-08-20T01:39:10.004 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-20T01:39:10.080 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:09 smithi081 ceph-mon[22209]: pgmap v402: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 30 MiB/s wr, 26 op/s 2024-08-20T01:39:10.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:09 smithi175 ceph-mon[22392]: pgmap v402: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 30 MiB/s wr, 26 op/s 2024-08-20T01:39:10.285 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:39:10.366 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.362+0000 7f15b44bc640 1 -- 172.21.15.79:0/2996004744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15ac105830 msgr2=0x7f15ac107c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:10.366 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.362+0000 7f15b44bc640 1 --2- 172.21.15.79:0/2996004744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15ac105830 0x7f15ac107c40 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f159c009900 tx=0x7f159c02a410 comp rx=0 tx=0).stop 2024-08-20T01:39:10.367 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.362+0000 7f15b44bc640 1 -- 172.21.15.79:0/2996004744 shutdown_connections 2024-08-20T01:39:10.367 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.362+0000 7f15b44bc640 1 --2- 172.21.15.79:0/2996004744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15ac108380 0x7f15ac10a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.367 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.362+0000 7f15b44bc640 1 --2- 172.21.15.79:0/2996004744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15ac105830 0x7f15ac107c40 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.367 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.362+0000 7f15b44bc640 1 --2- 172.21.15.79:0/2996004744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15ac06b0b0 0x7f15ac1052f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.367 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.362+0000 7f15b44bc640 1 -- 172.21.15.79:0/2996004744 >> 172.21.15.79:0/2996004744 conn(0x7f15ac0fce40 msgr2=0x7f15ac0ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:10.367 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.362+0000 7f15b44bc640 1 -- 172.21.15.79:0/2996004744 shutdown_connections 2024-08-20T01:39:10.367 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.362+0000 7f15b44bc640 1 -- 172.21.15.79:0/2996004744 wait complete. 2024-08-20T01:39:10.367 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.363+0000 7f15b44bc640 1 Processor -- start 2024-08-20T01:39:10.367 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.363+0000 7f15b44bc640 1 -- start start 2024-08-20T01:39:10.367 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.363+0000 7f15b44bc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15ac06b0b0 0x7f15ac1989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:10.367 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.363+0000 7f15b44bc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15ac105830 0x7f15ac199010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:10.367 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.363+0000 7f15b44bc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15ac108380 0x7f15ac199c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:10.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.363+0000 7f15b44bc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f15ac10e160 con 0x7f15ac06b0b0 2024-08-20T01:39:10.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.363+0000 7f15b44bc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f15ac10dfe0 con 0x7f15ac108380 2024-08-20T01:39:10.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.363+0000 7f15b44bc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f15ac10e2e0 con 0x7f15ac105830 2024-08-20T01:39:10.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.363+0000 7f15b2258640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15ac06b0b0 0x7f15ac1989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:10.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.363+0000 7f15b2258640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15ac06b0b0 0x7f15ac1989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40386/0 (socket says 172.21.15.79:40386) 2024-08-20T01:39:10.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.363+0000 7f15b2258640 1 -- 172.21.15.79:0/2908414660 learned_addr learned my addr 172.21.15.79:0/2908414660 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:10.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.364+0000 7f15b2a59640 1 --2- 172.21.15.79:0/2908414660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15ac108380 0x7f15ac199c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:10.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.364+0000 7f15b1a57640 1 --2- 172.21.15.79:0/2908414660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15ac105830 0x7f15ac199010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:10.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.364+0000 7f15b2258640 1 -- 172.21.15.79:0/2908414660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15ac105830 msgr2=0x7f15ac199010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:10.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.364+0000 7f15b2258640 1 --2- 172.21.15.79:0/2908414660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15ac105830 0x7f15ac199010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.364+0000 7f15b2258640 1 -- 172.21.15.79:0/2908414660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15ac108380 msgr2=0x7f15ac199c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:10.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.364+0000 7f15b2258640 1 --2- 172.21.15.79:0/2908414660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15ac108380 0x7f15ac199c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.369 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.364+0000 7f15b2258640 1 -- 172.21.15.79:0/2908414660 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15ac19a500 con 0x7f15ac06b0b0 2024-08-20T01:39:10.369 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.364+0000 7f15b1a57640 1 --2- 172.21.15.79:0/2908414660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15ac105830 0x7f15ac199010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:39:10.369 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.364+0000 7f15b2258640 1 --2- 172.21.15.79:0/2908414660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15ac06b0b0 0x7f15ac1989c0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f15a800d950 tx=0x7f15a800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:10.369 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.364+0000 7f15a37fe640 1 -- 172.21.15.79:0/2908414660 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a8017070 con 0x7f15ac06b0b0 2024-08-20T01:39:10.369 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.364+0000 7f15a37fe640 1 -- 172.21.15.79:0/2908414660 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15a8009c30 con 0x7f15ac06b0b0 2024-08-20T01:39:10.369 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.364+0000 7f15b44bc640 1 -- 172.21.15.79:0/2908414660 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15ac19a7f0 con 0x7f15ac06b0b0 2024-08-20T01:39:10.369 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.364+0000 7f15a37fe640 1 -- 172.21.15.79:0/2908414660 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a800f620 con 0x7f15ac06b0b0 2024-08-20T01:39:10.369 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.364+0000 7f15b44bc640 1 -- 172.21.15.79:0/2908414660 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15ac1a0ec0 con 0x7f15ac06b0b0 2024-08-20T01:39:10.372 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.367+0000 7f15b72a9740 1 Processor -- start 2024-08-20T01:39:10.372 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.367+0000 7f15a37fe640 1 -- 172.21.15.79:0/2908414660 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f15a8010460 con 0x7f15ac06b0b0 2024-08-20T01:39:10.372 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.367+0000 7f15b72a9740 1 -- start start 2024-08-20T01:39:10.372 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.367+0000 7f15b72a9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556662c2ce0 0x5556662c50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:10.372 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.367+0000 7f15b72a9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556662c5610 0x5556662c7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:10.372 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.367+0000 7f15b72a9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556662c8050 0x5556662ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:10.372 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.367+0000 7f15b72a9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555666231360 con 0x5556662c8050 2024-08-20T01:39:10.372 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.367+0000 7f15b72a9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555666220860 con 0x5556662c2ce0 2024-08-20T01:39:10.372 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.367+0000 7f15b72a9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5556662248a0 con 0x5556662c5610 2024-08-20T01:39:10.372 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.368+0000 7f15b2a59640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556662c2ce0 0x5556662c50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:10.373 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.368+0000 7f15b2258640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556662c5610 0x5556662c7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:10.373 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.368+0000 7f15b1a57640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556662c8050 0x5556662ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:10.373 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.368+0000 7f15b2a59640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556662c2ce0 0x5556662c50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:49926/0 (socket says 172.21.15.79:49926) 2024-08-20T01:39:10.373 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.368+0000 7f15b1a57640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556662c8050 0x5556662ca510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40402/0 (socket says 172.21.15.79:40402) 2024-08-20T01:39:10.373 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.368+0000 7f15b2a59640 1 -- 172.21.15.79:0/505354187 learned_addr learned my addr 172.21.15.79:0/505354187 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:10.373 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.368+0000 7f15b2a59640 1 -- 172.21.15.79:0/505354187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556662c5610 msgr2=0x5556662c7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:10.373 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.368+0000 7f15b2a59640 1 --2- 172.21.15.79:0/505354187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556662c5610 0x5556662c7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.373 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.368+0000 7f15b2a59640 1 -- 172.21.15.79:0/505354187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556662c8050 msgr2=0x5556662ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:10.373 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.368+0000 7f15b2a59640 1 --2- 172.21.15.79:0/505354187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556662c8050 0x5556662ca510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.373 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.368+0000 7f15b2a59640 1 -- 172.21.15.79:0/505354187 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556661c7e40 con 0x5556662c2ce0 2024-08-20T01:39:10.373 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.368+0000 7f15a37fe640 1 --2- 172.21.15.79:0/2908414660 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f15980b3bd0 0x7f15980b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:10.373 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.368+0000 7f15b1a57640 1 --2- 172.21.15.79:0/505354187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556662c8050 0x5556662ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:10.374 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.368+0000 7f15b2258640 1 --2- 172.21.15.79:0/2908414660 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f15980b3bd0 0x7f15980b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:10.374 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.368+0000 7f15a37fe640 1 -- 172.21.15.79:0/2908414660 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f15a80e3800 con 0x7f15ac06b0b0 2024-08-20T01:39:10.374 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.368+0000 7f15b2a59640 1 --2- 172.21.15.79:0/505354187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556662c2ce0 0x5556662c50d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f15a4009fc0 tx=0x7f15a4010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eec50a49593c5ccd server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:10.374 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.369+0000 7f15a0bfe640 1 -- 172.21.15.79:0/505354187 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a4016070 con 0x5556662c2ce0 2024-08-20T01:39:10.374 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.369+0000 7f15a0bfe640 1 -- 172.21.15.79:0/505354187 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15a4004d20 con 0x5556662c2ce0 2024-08-20T01:39:10.374 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.369+0000 7f15a0bfe640 1 -- 172.21.15.79:0/505354187 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a4005390 con 0x5556662c2ce0 2024-08-20T01:39:10.374 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.369+0000 7f15b72a9740 1 -- 172.21.15.79:0/505354187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556662c2ce0 msgr2=0x5556662c50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:10.374 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.369+0000 7f15b2258640 1 --2- 172.21.15.79:0/2908414660 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f15980b3bd0 0x7f15980b6090 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f15a80aa6f0 tx=0x7f15a80e9550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:10.374 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.369+0000 7f15b72a9740 1 --2- 172.21.15.79:0/505354187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556662c2ce0 0x5556662c50d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f15a4009fc0 tx=0x7f15a4010800 comp rx=0 tx=0).stop 2024-08-20T01:39:10.374 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.370+0000 7f15b72a9740 1 -- 172.21.15.79:0/505354187 shutdown_connections 2024-08-20T01:39:10.374 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.370+0000 7f15b72a9740 1 --2- 172.21.15.79:0/505354187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556662c8050 0x5556662ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.370+0000 7f15b72a9740 1 --2- 172.21.15.79:0/505354187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556662c5610 0x5556662c7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.370+0000 7f15b72a9740 1 --2- 172.21.15.79:0/505354187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556662c2ce0 0x5556662c50d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.370+0000 7f15b72a9740 1 -- 172.21.15.79:0/505354187 >> 172.21.15.79:0/505354187 conn(0x5556662b9a20 msgr2=0x5556662ba7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:10.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.370+0000 7f15b72a9740 1 -- 172.21.15.79:0/505354187 shutdown_connections 2024-08-20T01:39:10.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.370+0000 7f15b72a9740 1 -- 172.21.15.79:0/505354187 wait complete. 2024-08-20T01:39:10.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.370+0000 7f15b72a9740 1 -- start start 2024-08-20T01:39:10.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.370+0000 7f15b72a9740 1 Processor -- start 2024-08-20T01:39:10.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.370+0000 7f15b72a9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556662c2ce0 0x5556662cc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:10.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.370+0000 7f15b72a9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556662c5610 0x5556662ccc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:10.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.370+0000 7f15b72a9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556662c8050 0x5556662cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:10.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.370+0000 7f15b72a9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555666159ab0 con 0x5556662c2ce0 2024-08-20T01:39:10.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.370+0000 7f15b72a9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5556661a7780 con 0x5556662c5610 2024-08-20T01:39:10.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.370+0000 7f15b72a9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5556662cb030 con 0x5556662c8050 2024-08-20T01:39:10.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.370+0000 7f15b72a9740 10 client.0 _ll_register_callbacks cb 0x555665f2fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:10.380 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.371+0000 7f15b2a59640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556662c2ce0 0x5556662cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:10.380 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.371+0000 7f15b2a59640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556662c2ce0 0x5556662cc560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40412/0 (socket says 172.21.15.79:40412) 2024-08-20T01:39:10.380 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.371+0000 7f15b2a59640 1 -- 172.21.15.79:0/3821518942 learned_addr learned my addr 172.21.15.79:0/3821518942 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:10.380 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.371+0000 7f15b1a57640 1 --2- 172.21.15.79:0/3821518942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556662c5610 0x5556662ccc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:10.380 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.371+0000 7f15b2a59640 1 -- 172.21.15.79:0/3821518942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556662c8050 msgr2=0x5556662cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:10.380 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.371+0000 7f15b2a59640 1 --2- 172.21.15.79:0/3821518942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556662c8050 0x5556662cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.380 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.371+0000 7f15b2a59640 1 -- 172.21.15.79:0/3821518942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556662c5610 msgr2=0x5556662ccc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:10.380 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.371+0000 7f15b2a59640 1 --2- 172.21.15.79:0/3821518942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556662c5610 0x5556662ccc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.380 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.371+0000 7f15b2a59640 1 -- 172.21.15.79:0/3821518942 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555665f83790 con 0x5556662c2ce0 2024-08-20T01:39:10.380 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.371+0000 7f15b2a59640 1 --2- 172.21.15.79:0/3821518942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556662c2ce0 0x5556662cc560 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f15a4009880 tx=0x7f15a4004d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ad9374f8a196153 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:10.380 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.371+0000 7f1595ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:39:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.371+0000 7f1595ffb640 1 -- 172.21.15.79:0/3821518942 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a4016070 con 0x5556662c2ce0 2024-08-20T01:39:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.371+0000 7f1595ffb640 1 -- 172.21.15.79:0/3821518942 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f15a40129e0 con 0x5556662c2ce0 2024-08-20T01:39:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.371+0000 7f15b72a9740 1 -- 172.21.15.79:0/3821518942 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5556661cfe00 con 0x5556662c2ce0 2024-08-20T01:39:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.371+0000 7f1595ffb640 1 -- 172.21.15.79:0/3821518942 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f15a4012be0 con 0x5556662c2ce0 2024-08-20T01:39:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.371+0000 7f15b72a9740 10 client.16191 fetch_fsmap learned FSMap version 33 2024-08-20T01:39:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.371+0000 7f15b72a9740 1 -- 172.21.15.79:0/3821518942 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x555665ffc620 con 0x5556662c2ce0 2024-08-20T01:39:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.372+0000 7f1595ffb640 1 -- 172.21.15.79:0/3821518942 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5556661cfe00 con 0x5556662c2ce0 2024-08-20T01:39:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.372+0000 7f1595ffb640 1 -- 172.21.15.79:0/3821518942 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7f15a400f040 con 0x5556662c2ce0 2024-08-20T01:39:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.372+0000 7f15b72a9740 10 client.16191 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:39:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.372+0000 7f15b72a9740 10 client.16191 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:39:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.372+0000 7f15b72a9740 20 client.16191 populate_metadata read hostname 'smithi079' 2024-08-20T01:39:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.372+0000 7f15b72a9740 1 --2- 172.21.15.79:0/3821518942 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5556662d7b10 0x5556662d9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.372+0000 7f15b72a9740 4 client.16191 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:39:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.372+0000 7f15b72a9740 1 -- 172.21.15.79:0/3821518942 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5556662332b0 con 0x5556662d7b10 2024-08-20T01:39:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.372+0000 7f15b1a57640 1 --2- 172.21.15.79:0/3821518942 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5556662d7b10 0x5556662d9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.373+0000 7f1595ffb640 10 client.16191 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:39:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.373+0000 7f15b1a57640 1 --2- 172.21.15.79:0/3821518942 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5556662d7b10 0x5556662d9f00 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c372ac1c2d3ae9d server_cookie=d510929491cfc777 in_seq=0 out_seq=0 2024-08-20T01:39:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.373+0000 7f1595ffb640 1 -- 172.21.15.79:0/3821518942 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5556662332b0 con 0x5556662d7b10 2024-08-20T01:39:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.373+0000 7f1595ffb640 10 client.16191 handle_command_reply: tid=0 2024-08-20T01:39:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.373+0000 7f15b72a9740 1 client.16191 shutdown 2024-08-20T01:39:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.373+0000 7f15b72a9740 1 -- 172.21.15.79:0/3821518942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556662c2ce0 msgr2=0x5556662cc560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.373+0000 7f15b72a9740 1 --2- 172.21.15.79:0/3821518942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556662c2ce0 0x5556662cc560 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f15a4009880 tx=0x7f15a4004d90 comp rx=0 tx=0).stop 2024-08-20T01:39:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.374+0000 7f15b72a9740 1 -- 172.21.15.79:0/3821518942 shutdown_connections 2024-08-20T01:39:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.374+0000 7f15b72a9740 1 --2- 172.21.15.79:0/3821518942 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5556662d7b10 0x5556662d9f00 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.374+0000 7f15b72a9740 1 --2- 172.21.15.79:0/3821518942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556662c8050 0x5556662cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.374+0000 7f15b72a9740 1 --2- 172.21.15.79:0/3821518942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556662c5610 0x5556662ccc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.374+0000 7f15b72a9740 1 --2- 172.21.15.79:0/3821518942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556662c2ce0 0x5556662cc560 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.374+0000 7f15b72a9740 1 -- 172.21.15.79:0/3821518942 >> 172.21.15.79:0/3821518942 conn(0x5556662b9a20 msgr2=0x5556662b8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.374+0000 7f1595ffb640 0 client.16191 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:39:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.374+0000 7f15b72a9740 1 -- 172.21.15.79:0/3821518942 shutdown_connections 2024-08-20T01:39:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.374+0000 7f15b72a9740 1 -- 172.21.15.79:0/3821518942 wait complete. 2024-08-20T01:39:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.374+0000 7f15b72a9740 20 client.16191 trim_cache size 0 max 16384 2024-08-20T01:39:10.394 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.391+0000 7f15b72a9740 1 Processor -- start 2024-08-20T01:39:10.394 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.391+0000 7f15b72a9740 1 -- start start 2024-08-20T01:39:10.394 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.391+0000 7f15b72a9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556662c2ce0 0x5556662b4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:10.394 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.391+0000 7f15b72a9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556662c5610 0x5556662b82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:10.394 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.391+0000 7f15b72a9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556662c8050 0x5556662b8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:10.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.391+0000 7f15b72a9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f15ac1a7930 con 0x5556662c5610 2024-08-20T01:39:10.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.391+0000 7f15b72a9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f15ac1a95c0 con 0x5556662c8050 2024-08-20T01:39:10.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.391+0000 7f15b72a9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f15ac1a8000 con 0x5556662c2ce0 2024-08-20T01:39:10.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.391+0000 7f15b1a57640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556662c5610 0x5556662b82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:10.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.391+0000 7f15b1a57640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556662c5610 0x5556662b82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40416/0 (socket says 172.21.15.79:40416) 2024-08-20T01:39:10.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.391+0000 7f15b1a57640 1 -- 172.21.15.79:0/2480548147 learned_addr learned my addr 172.21.15.79:0/2480548147 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:10.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.392+0000 7f15b2a59640 1 --2- 172.21.15.79:0/2480548147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556662c2ce0 0x5556662b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:10.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.392+0000 7f15b1a57640 1 -- 172.21.15.79:0/2480548147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556662c2ce0 msgr2=0x5556662b4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:10.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.392+0000 7f15b2a59640 1 --2- 172.21.15.79:0/2480548147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556662c8050 0x5556662b8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:10.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.392+0000 7f15b1a57640 1 --2- 172.21.15.79:0/2480548147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556662c2ce0 0x5556662b4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.392+0000 7f15b1a57640 1 -- 172.21.15.79:0/2480548147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556662c8050 msgr2=0x5556662b8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:10.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.392+0000 7f15b1a57640 1 --2- 172.21.15.79:0/2480548147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556662c8050 0x5556662b8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.392+0000 7f15b1a57640 1 -- 172.21.15.79:0/2480548147 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556662c5440 con 0x5556662c5610 2024-08-20T01:39:10.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.392+0000 7f15b2a59640 1 --2- 172.21.15.79:0/2480548147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556662c8050 0x5556662b8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:39:10.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.392+0000 7f15b1a57640 1 --2- 172.21.15.79:0/2480548147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556662c5610 0x5556662b82c0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f159c000c00 tx=0x7f159c0058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80bb545d12544979 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:10.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.392+0000 7f1597fff640 1 -- 172.21.15.79:0/2480548147 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159c04b070 con 0x5556662c5610 2024-08-20T01:39:10.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.392+0000 7f1597fff640 1 -- 172.21.15.79:0/2480548147 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f159c004240 con 0x5556662c5610 2024-08-20T01:39:10.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.392+0000 7f1597fff640 1 -- 172.21.15.79:0/2480548147 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159c035040 con 0x5556662c5610 2024-08-20T01:39:10.399 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.393+0000 7f15b72a9740 1 -- 172.21.15.79:0/2480548147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556662c5610 msgr2=0x5556662b82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:10.399 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.393+0000 7f15b72a9740 1 --2- 172.21.15.79:0/2480548147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556662c5610 0x5556662b82c0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f159c000c00 tx=0x7f159c0058b0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.399 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.393+0000 7f15b72a9740 1 -- 172.21.15.79:0/2480548147 shutdown_connections 2024-08-20T01:39:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.393+0000 7f15b72a9740 1 --2- 172.21.15.79:0/2480548147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556662c8050 0x5556662b8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.393+0000 7f15b72a9740 1 --2- 172.21.15.79:0/2480548147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556662c5610 0x5556662b82c0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.393+0000 7f15b72a9740 1 --2- 172.21.15.79:0/2480548147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556662c2ce0 0x5556662b4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.393+0000 7f15b72a9740 1 -- 172.21.15.79:0/2480548147 >> 172.21.15.79:0/2480548147 conn(0x5556662b9a20 msgr2=0x5556662cb430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.393+0000 7f15b72a9740 1 -- 172.21.15.79:0/2480548147 shutdown_connections 2024-08-20T01:39:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.393+0000 7f15b72a9740 1 -- 172.21.15.79:0/2480548147 wait complete. 2024-08-20T01:39:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.393+0000 7f15b72a9740 1 -- start start 2024-08-20T01:39:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.393+0000 7f15b72a9740 1 Processor -- start 2024-08-20T01:39:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.394+0000 7f15b72a9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556662c2ce0 0x5556662d1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.394+0000 7f15b72a9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556662c5610 0x5556662d1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.394+0000 7f15b72a9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556662c8050 0x5556662d24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.394+0000 7f15b72a9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f15ac1a8e30 con 0x5556662c2ce0 2024-08-20T01:39:10.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.394+0000 7f15b72a9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f15ac1a86d0 con 0x5556662c8050 2024-08-20T01:39:10.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.394+0000 7f15b72a9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f15ac1a5910 con 0x5556662c5610 2024-08-20T01:39:10.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.394+0000 7f15b72a9740 10 client.0 _ll_register_callbacks cb 0x7f159c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:10.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.394+0000 7f15b2a59640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556662c2ce0 0x5556662d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:10.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.394+0000 7f15b2a59640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556662c2ce0 0x5556662d1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40426/0 (socket says 172.21.15.79:40426) 2024-08-20T01:39:10.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.394+0000 7f15b2a59640 1 -- 172.21.15.79:0/1170357958 learned_addr learned my addr 172.21.15.79:0/1170357958 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:10.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.394+0000 7f15b1a57640 1 --2- 172.21.15.79:0/1170357958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556662c5610 0x5556662d1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:10.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.394+0000 7f15b2a59640 1 --2- 172.21.15.79:0/1170357958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556662c8050 0x5556662d24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:10.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.394+0000 7f15b2a59640 1 -- 172.21.15.79:0/1170357958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556662c5610 msgr2=0x5556662d1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:10.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.394+0000 7f15b2a59640 1 --2- 172.21.15.79:0/1170357958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556662c5610 0x5556662d1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.394+0000 7f15b2a59640 1 -- 172.21.15.79:0/1170357958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556662c8050 msgr2=0x5556662d24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:10.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.394+0000 7f15b2a59640 1 --2- 172.21.15.79:0/1170357958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556662c8050 0x5556662d24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.402 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.394+0000 7f15b2a59640 1 -- 172.21.15.79:0/1170357958 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556662d2d00 con 0x5556662c2ce0 2024-08-20T01:39:10.402 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.394+0000 7f15b1a57640 1 --2- 172.21.15.79:0/1170357958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556662c5610 0x5556662d1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:39:10.402 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.394+0000 7f15b2a59640 1 --2- 172.21.15.79:0/1170357958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556662c2ce0 0x5556662d1260 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f15a4010d80 tx=0x7f15a4004d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f759e77481715508 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:10.402 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.394+0000 7f1595ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:39:10.402 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.394+0000 7f1595ffb640 1 -- 172.21.15.79:0/1170357958 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a4016040 con 0x5556662c2ce0 2024-08-20T01:39:10.402 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.394+0000 7f1595ffb640 1 -- 172.21.15.79:0/1170357958 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f15a4003970 con 0x5556662c2ce0 2024-08-20T01:39:10.402 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.394+0000 7f15b72a9740 1 -- 172.21.15.79:0/1170357958 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f159c004240 con 0x5556662c2ce0 2024-08-20T01:39:10.402 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.395+0000 7f1595ffb640 1 -- 172.21.15.79:0/1170357958 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f15a4027470 con 0x5556662c2ce0 2024-08-20T01:39:10.402 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.395+0000 7f15b72a9740 10 client.16197 fetch_fsmap learned FSMap version 33 2024-08-20T01:39:10.402 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.395+0000 7f15b72a9740 1 -- 172.21.15.79:0/1170357958 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5556662d3fe0 con 0x5556662c2ce0 2024-08-20T01:39:10.402 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.395+0000 7f1595ffb640 1 -- 172.21.15.79:0/1170357958 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f159c004240 con 0x5556662c2ce0 2024-08-20T01:39:10.402 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.395+0000 7f1595ffb640 1 -- 172.21.15.79:0/1170357958 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7f15a4004f70 con 0x5556662c2ce0 2024-08-20T01:39:10.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.395+0000 7f15b72a9740 10 client.16197 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:39:10.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.395+0000 7f15b72a9740 10 client.16197 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:39:10.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.395+0000 7f15b72a9740 20 client.16197 populate_metadata read hostname 'smithi079' 2024-08-20T01:39:10.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.395+0000 7f15b72a9740 1 --2- 172.21.15.79:0/1170357958 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x555666342940 0x555666344d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:10.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.395+0000 7f15b72a9740 4 client.16197 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:39:10.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.395+0000 7f15b72a9740 1 -- 172.21.15.79:0/1170357958 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55566622ed50 con 0x555666342940 2024-08-20T01:39:10.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.395+0000 7f15b1a57640 1 --2- 172.21.15.79:0/1170357958 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x555666342940 0x555666344d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:10.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.396+0000 7f15b1a57640 1 --2- 172.21.15.79:0/1170357958 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x555666342940 0x555666344d60 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1dbc14bd56fb576e server_cookie=7a4411772c9ef8b4 in_seq=0 out_seq=0 2024-08-20T01:39:10.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.396+0000 7f1595ffb640 10 client.16197 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:39:10.406 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.404+0000 7f1595ffb640 1 -- 172.21.15.79:0/1170357958 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55566622ed50 con 0x555666342940 2024-08-20T01:39:10.407 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.404+0000 7f1595ffb640 10 client.16197 handle_command_reply: tid=0 2024-08-20T01:39:10.407 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.404+0000 7f15b72a9740 1 client.16197 shutdown 2024-08-20T01:39:10.407 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.404+0000 7f15b72a9740 1 -- 172.21.15.79:0/1170357958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556662c2ce0 msgr2=0x5556662d1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:10.407 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.404+0000 7f15b72a9740 1 --2- 172.21.15.79:0/1170357958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556662c2ce0 0x5556662d1260 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f15a4010d80 tx=0x7f15a4004d90 comp rx=0 tx=0).stop 2024-08-20T01:39:10.407 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.404+0000 7f15b72a9740 1 -- 172.21.15.79:0/1170357958 shutdown_connections 2024-08-20T01:39:10.407 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.404+0000 7f15b72a9740 1 --2- 172.21.15.79:0/1170357958 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x555666342940 0x555666344d60 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.407 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.404+0000 7f15b72a9740 1 --2- 172.21.15.79:0/1170357958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556662c8050 0x5556662d24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.407 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.404+0000 7f15b72a9740 1 --2- 172.21.15.79:0/1170357958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556662c5610 0x5556662d1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.407 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.404+0000 7f15b72a9740 1 --2- 172.21.15.79:0/1170357958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556662c2ce0 0x5556662d1260 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.407 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.404+0000 7f1595ffb640 0 client.16197 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:39:10.407 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.404+0000 7f15b72a9740 1 -- 172.21.15.79:0/1170357958 >> 172.21.15.79:0/1170357958 conn(0x5556662b9a20 msgr2=0x5556662c8430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:10.408 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.404+0000 7f15b72a9740 1 -- 172.21.15.79:0/1170357958 shutdown_connections 2024-08-20T01:39:10.408 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.404+0000 7f15b72a9740 1 -- 172.21.15.79:0/1170357958 wait complete. 2024-08-20T01:39:10.408 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.405+0000 7f15b72a9740 20 client.16197 trim_cache size 0 max 16384 2024-08-20T01:39:10.408 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:39:10.408 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:39:10.408 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:39:10.408 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:39:10.409 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.405+0000 7f15b44bc640 1 -- 172.21.15.79:0/2908414660 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f15980b3bd0 msgr2=0x7f15980b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:10.409 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.405+0000 7f15b44bc640 1 --2- 172.21.15.79:0/2908414660 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f15980b3bd0 0x7f15980b6090 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f15a80aa6f0 tx=0x7f15a80e9550 comp rx=0 tx=0).stop 2024-08-20T01:39:10.409 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.405+0000 7f15b44bc640 1 -- 172.21.15.79:0/2908414660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15ac06b0b0 msgr2=0x7f15ac1989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:10.409 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.405+0000 7f15b44bc640 1 --2- 172.21.15.79:0/2908414660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15ac06b0b0 0x7f15ac1989c0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f15a800d950 tx=0x7f15a800de10 comp rx=0 tx=0).stop 2024-08-20T01:39:10.409 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.405+0000 7f15b44bc640 1 -- 172.21.15.79:0/2908414660 shutdown_connections 2024-08-20T01:39:10.410 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.405+0000 7f15b44bc640 1 --2- 172.21.15.79:0/2908414660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15ac108380 0x7f15ac199c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.410 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.405+0000 7f15b44bc640 1 --2- 172.21.15.79:0/2908414660 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f15980b3bd0 0x7f15980b6090 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.410 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.405+0000 7f15b44bc640 1 --2- 172.21.15.79:0/2908414660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15ac105830 0x7f15ac199010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.410 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.405+0000 7f15b44bc640 1 --2- 172.21.15.79:0/2908414660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15ac06b0b0 0x7f15ac1989c0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.410 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.405+0000 7f15b44bc640 1 -- 172.21.15.79:0/2908414660 >> 172.21.15.79:0/2908414660 conn(0x7f15ac0fce40 msgr2=0x7f15ac103bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:10.410 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.405+0000 7f15b44bc640 1 -- 172.21.15.79:0/2908414660 shutdown_connections 2024-08-20T01:39:10.410 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:10.405+0000 7f15b44bc640 1 -- 172.21.15.79:0/2908414660 wait complete. 2024-08-20T01:39:10.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.752+0000 7f2340aa4640 1 -- 172.21.15.79:0/1312124256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f233c101500 msgr2=0x7f233c1018e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:10.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.752+0000 7f2340aa4640 1 --2- 172.21.15.79:0/1312124256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f233c101500 0x7f233c1018e0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f232c009900 tx=0x7f232c02a410 comp rx=0 tx=0).stop 2024-08-20T01:39:10.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.752+0000 7f2340aa4640 1 -- 172.21.15.79:0/1312124256 shutdown_connections 2024-08-20T01:39:10.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.752+0000 7f2340aa4640 1 --2- 172.21.15.79:0/1312124256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f233c10cdc0 0x7f233c10f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.752+0000 7f2340aa4640 1 --2- 172.21.15.79:0/1312124256 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f233c101f00 0x7f233c10c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.752+0000 7f2340aa4640 1 --2- 172.21.15.79:0/1312124256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f233c101500 0x7f233c1018e0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.752+0000 7f2340aa4640 1 -- 172.21.15.79:0/1312124256 >> 172.21.15.79:0/1312124256 conn(0x7f233c076bd0 msgr2=0x7f233c076fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:10.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.752+0000 7f2340aa4640 1 -- 172.21.15.79:0/1312124256 shutdown_connections 2024-08-20T01:39:10.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.752+0000 7f2340aa4640 1 -- 172.21.15.79:0/1312124256 wait complete. 2024-08-20T01:39:10.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.753+0000 7f2340aa4640 1 Processor -- start 2024-08-20T01:39:10.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.753+0000 7f2340aa4640 1 -- start start 2024-08-20T01:39:10.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.753+0000 7f2340aa4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f233c101500 0x7f233c102560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:10.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.753+0000 7f2340aa4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f233c101f00 0x7f233c102aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:10.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.753+0000 7f2340aa4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f233c10cdc0 0x7f233c102fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:10.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.753+0000 7f2340aa4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f233c112920 con 0x7f233c101f00 2024-08-20T01:39:10.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.753+0000 7f2340aa4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f233c1127a0 con 0x7f233c101500 2024-08-20T01:39:10.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.753+0000 7f2340aa4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f233c112aa0 con 0x7f233c10cdc0 2024-08-20T01:39:10.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.754+0000 7f2339d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f233c101f00 0x7f233c102aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:10.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.754+0000 7f2339d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f233c101f00 0x7f233c102aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40454/0 (socket says 172.21.15.79:40454) 2024-08-20T01:39:10.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.754+0000 7f2339d9b640 1 -- 172.21.15.79:0/1510942905 learned_addr learned my addr 172.21.15.79:0/1510942905 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:10.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.754+0000 7f233a59c640 1 --2- 172.21.15.79:0/1510942905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f233c101500 0x7f233c102560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:10.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.754+0000 7f233ad9d640 1 --2- 172.21.15.79:0/1510942905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f233c10cdc0 0x7f233c102fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:10.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.754+0000 7f2339d9b640 1 -- 172.21.15.79:0/1510942905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f233c10cdc0 msgr2=0x7f233c102fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:10.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.754+0000 7f2339d9b640 1 --2- 172.21.15.79:0/1510942905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f233c10cdc0 0x7f233c102fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.754+0000 7f2339d9b640 1 -- 172.21.15.79:0/1510942905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f233c101500 msgr2=0x7f233c102560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:10.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.754+0000 7f2339d9b640 1 --2- 172.21.15.79:0/1510942905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f233c101500 0x7f233c102560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.754+0000 7f2339d9b640 1 -- 172.21.15.79:0/1510942905 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f233c1a72f0 con 0x7f233c101f00 2024-08-20T01:39:10.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.754+0000 7f2339d9b640 1 --2- 172.21.15.79:0/1510942905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f233c101f00 0x7f233c102aa0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f233000c970 tx=0x7f233000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:10.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.754+0000 7f232b7fe640 1 -- 172.21.15.79:0/1510942905 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2330014070 con 0x7f233c101f00 2024-08-20T01:39:10.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.754+0000 7f2340aa4640 1 -- 172.21.15.79:0/1510942905 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f233c1a75e0 con 0x7f233c101f00 2024-08-20T01:39:10.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.754+0000 7f232b7fe640 1 -- 172.21.15.79:0/1510942905 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2330004440 con 0x7f233c101f00 2024-08-20T01:39:10.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.754+0000 7f232b7fe640 1 -- 172.21.15.79:0/1510942905 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2330003d40 con 0x7f233c101f00 2024-08-20T01:39:10.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.754+0000 7f2340aa4640 1 -- 172.21.15.79:0/1510942905 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f233c1a7b20 con 0x7f233c101f00 2024-08-20T01:39:10.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.757+0000 7f232b7fe640 1 -- 172.21.15.79:0/1510942905 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2330017070 con 0x7f233c101f00 2024-08-20T01:39:10.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.757+0000 7f2342e9d740 1 Processor -- start 2024-08-20T01:39:10.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.758+0000 7f2342e9d740 1 -- start start 2024-08-20T01:39:10.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.758+0000 7f2342e9d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564d1c5d880 0x5564d1c5dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:10.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.758+0000 7f2342e9d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564d1c5e1a0 0x5564d1c69bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:10.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.758+0000 7f2342e9d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d1c6a130 0x5564d1c6c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:10.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.758+0000 7f2342e9d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5564d1bd4930 con 0x5564d1c6a130 2024-08-20T01:39:10.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.758+0000 7f2342e9d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5564d1bc3e30 con 0x5564d1c5d880 2024-08-20T01:39:10.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.758+0000 7f2342e9d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5564d1bc7e70 con 0x5564d1c5e1a0 2024-08-20T01:39:10.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.758+0000 7f2339d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d1c6a130 0x5564d1c6c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:10.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.758+0000 7f2339d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d1c6a130 0x5564d1c6c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40458/0 (socket says 172.21.15.79:40458) 2024-08-20T01:39:10.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.758+0000 7f2339d9b640 1 -- 172.21.15.79:0/508713791 learned_addr learned my addr 172.21.15.79:0/508713791 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:10.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.758+0000 7f233ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564d1c5d880 0x5564d1c5dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:10.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.758+0000 7f233a59c640 1 --2- 172.21.15.79:0/508713791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564d1c5e1a0 0x5564d1c69bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:10.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.758+0000 7f2339d9b640 1 -- 172.21.15.79:0/508713791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564d1c5e1a0 msgr2=0x5564d1c69bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:10.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.758+0000 7f2339d9b640 1 --2- 172.21.15.79:0/508713791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564d1c5e1a0 0x5564d1c69bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.758+0000 7f2339d9b640 1 -- 172.21.15.79:0/508713791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564d1c5d880 msgr2=0x5564d1c5dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:10.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.758+0000 7f2339d9b640 1 --2- 172.21.15.79:0/508713791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564d1c5d880 0x5564d1c5dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.758+0000 7f2339d9b640 1 -- 172.21.15.79:0/508713791 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564d1923650 con 0x5564d1c6a130 2024-08-20T01:39:10.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.758+0000 7f233ad9d640 1 --2- 172.21.15.79:0/508713791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564d1c5d880 0x5564d1c5dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:10.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.759+0000 7f2339d9b640 1 --2- 172.21.15.79:0/508713791 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d1c6a130 0x5564d1c6c520 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f23300e7bb0 tx=0x7f23300ec500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c21d6f8b2cb568d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:10.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.759+0000 7f2328ff9640 1 -- 172.21.15.79:0/508713791 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23300f7070 con 0x5564d1c6a130 2024-08-20T01:39:10.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.759+0000 7f2328ff9640 1 -- 172.21.15.79:0/508713791 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f23300ece10 con 0x5564d1c6a130 2024-08-20T01:39:10.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.759+0000 7f232b7fe640 1 --2- 172.21.15.79:0/1510942905 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f23240b3bd0 0x7f23240b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:10.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.759+0000 7f233ad9d640 1 --2- 172.21.15.79:0/1510942905 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f23240b3bd0 0x7f23240b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:10.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.759+0000 7f2328ff9640 1 -- 172.21.15.79:0/508713791 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23300f1610 con 0x5564d1c6a130 2024-08-20T01:39:10.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.760+0000 7f232b7fe640 1 -- 172.21.15.79:0/1510942905 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f23300e3a30 con 0x7f233c101f00 2024-08-20T01:39:10.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.760+0000 7f2342e9d740 1 -- 172.21.15.79:0/508713791 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d1c6a130 msgr2=0x5564d1c6c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:10.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.760+0000 7f2342e9d740 1 --2- 172.21.15.79:0/508713791 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d1c6a130 0x5564d1c6c520 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f23300e7bb0 tx=0x7f23300ec500 comp rx=0 tx=0).stop 2024-08-20T01:39:10.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.760+0000 7f2342e9d740 1 -- 172.21.15.79:0/508713791 shutdown_connections 2024-08-20T01:39:10.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.760+0000 7f2342e9d740 1 --2- 172.21.15.79:0/508713791 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d1c6a130 0x5564d1c6c520 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.760+0000 7f2342e9d740 1 --2- 172.21.15.79:0/508713791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564d1c5e1a0 0x5564d1c69bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.760+0000 7f2342e9d740 1 --2- 172.21.15.79:0/508713791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564d1c5d880 0x5564d1c5dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.760+0000 7f2342e9d740 1 -- 172.21.15.79:0/508713791 >> 172.21.15.79:0/508713791 conn(0x5564d1c5b6b0 msgr2=0x5564d1c5c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:10.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.760+0000 7f233ad9d640 1 --2- 172.21.15.79:0/1510942905 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f23240b3bd0 0x7f23240b6090 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f233c104620 tx=0x7f2334009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:10.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.760+0000 7f2342e9d740 1 -- 172.21.15.79:0/508713791 shutdown_connections 2024-08-20T01:39:10.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.760+0000 7f2342e9d740 1 -- 172.21.15.79:0/508713791 wait complete. 2024-08-20T01:39:10.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.760+0000 7f2342e9d740 1 -- start start 2024-08-20T01:39:10.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.760+0000 7f2342e9d740 1 Processor -- start 2024-08-20T01:39:10.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.761+0000 7f2342e9d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564d1c5d880 0x5564d1c69bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:10.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.761+0000 7f2342e9d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d1c5e1a0 0x5564d1c67040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:10.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.761+0000 7f2342e9d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564d1c6a130 0x5564d1c677d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:10.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.761+0000 7f2342e9d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5564d1a26700 con 0x5564d1c5e1a0 2024-08-20T01:39:10.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.761+0000 7f2342e9d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5564d1b4a810 con 0x5564d1c5d880 2024-08-20T01:39:10.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.761+0000 7f2342e9d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5564d1c6ce30 con 0x5564d1c6a130 2024-08-20T01:39:10.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.761+0000 7f2342e9d740 10 client.0 _ll_register_callbacks cb 0x5564d1bbd700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:10.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.761+0000 7f233a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564d1c5d880 0x5564d1c69bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:10.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.761+0000 7f233a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564d1c5d880 0x5564d1c69bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:50004/0 (socket says 172.21.15.79:50004) 2024-08-20T01:39:10.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.761+0000 7f233a59c640 1 -- 172.21.15.79:0/2428251265 learned_addr learned my addr 172.21.15.79:0/2428251265 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:10.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.761+0000 7f233ad9d640 1 --2- 172.21.15.79:0/2428251265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564d1c6a130 0x5564d1c677d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:10.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.761+0000 7f2339d9b640 1 --2- 172.21.15.79:0/2428251265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d1c5e1a0 0x5564d1c67040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:10.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.761+0000 7f233a59c640 1 -- 172.21.15.79:0/2428251265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564d1c6a130 msgr2=0x5564d1c677d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:10.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.761+0000 7f233a59c640 1 --2- 172.21.15.79:0/2428251265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564d1c6a130 0x5564d1c677d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.761+0000 7f233a59c640 1 -- 172.21.15.79:0/2428251265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d1c5e1a0 msgr2=0x5564d1c67040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:10.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.761+0000 7f233a59c640 1 --2- 172.21.15.79:0/2428251265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d1c5e1a0 0x5564d1c67040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.761+0000 7f233a59c640 1 -- 172.21.15.79:0/2428251265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564d1c761e0 con 0x5564d1c5d880 2024-08-20T01:39:10.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.762+0000 7f233a59c640 1 --2- 172.21.15.79:0/2428251265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564d1c5d880 0x5564d1c69bd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f232c02a930 tx=0x7f232c031f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc9f582b9030cf64 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:10.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.762+0000 7f2321ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:39:10.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.762+0000 7f2321ffb640 1 -- 172.21.15.79:0/2428251265 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232c035070 con 0x5564d1c5d880 2024-08-20T01:39:10.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.762+0000 7f2342e9d740 1 -- 172.21.15.79:0/2428251265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5564d1b73150 con 0x5564d1c5d880 2024-08-20T01:39:10.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.762+0000 7f2321ffb640 1 -- 172.21.15.79:0/2428251265 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f232c004240 con 0x5564d1c5d880 2024-08-20T01:39:10.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.762+0000 7f2321ffb640 1 -- 172.21.15.79:0/2428251265 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f232c004440 con 0x5564d1c5d880 2024-08-20T01:39:10.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.762+0000 7f2342e9d740 10 client.25514 fetch_fsmap learned FSMap version 33 2024-08-20T01:39:10.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.762+0000 7f2342e9d740 1 -- 172.21.15.79:0/2428251265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5564d1c78bb0 con 0x5564d1c5d880 2024-08-20T01:39:10.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.762+0000 7f2321ffb640 1 -- 172.21.15.79:0/2428251265 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5564d1b73150 con 0x5564d1c5d880 2024-08-20T01:39:10.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.763+0000 7f2321ffb640 1 -- 172.21.15.79:0/2428251265 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7f232c043020 con 0x5564d1c5d880 2024-08-20T01:39:10.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.763+0000 7f2342e9d740 10 client.25514 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:39:10.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.763+0000 7f2342e9d740 10 client.25514 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:39:10.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.763+0000 7f2342e9d740 20 client.25514 populate_metadata read hostname 'smithi079' 2024-08-20T01:39:10.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.763+0000 7f2342e9d740 1 --2- 172.21.15.79:0/2428251265 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5564d1c7a390 0x5564d1c7c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:10.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.763+0000 7f2342e9d740 4 client.25514 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:39:10.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.763+0000 7f2342e9d740 1 -- 172.21.15.79:0/2428251265 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564d1bd6880 con 0x5564d1c7a390 2024-08-20T01:39:10.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.763+0000 7f2339d9b640 1 --2- 172.21.15.79:0/2428251265 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5564d1c7a390 0x5564d1c7c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:10.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.764+0000 7f2339d9b640 1 --2- 172.21.15.79:0/2428251265 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5564d1c7a390 0x5564d1c7c830 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f2952c3d74c60d3e server_cookie=d72b7b5372b0cdd6 in_seq=0 out_seq=0 2024-08-20T01:39:10.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.764+0000 7f2321ffb640 10 client.25514 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:39:10.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.764+0000 7f2321ffb640 1 -- 172.21.15.79:0/2428251265 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5564d1bd6880 con 0x5564d1c7a390 2024-08-20T01:39:10.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.764+0000 7f2321ffb640 10 client.25514 handle_command_reply: tid=0 2024-08-20T01:39:10.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.764+0000 7f2342e9d740 1 client.25514 shutdown 2024-08-20T01:39:10.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.765+0000 7f2342e9d740 1 -- 172.21.15.79:0/2428251265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564d1c5d880 msgr2=0x5564d1c69bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:10.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.765+0000 7f2342e9d740 1 --2- 172.21.15.79:0/2428251265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564d1c5d880 0x5564d1c69bd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f232c02a930 tx=0x7f232c031f70 comp rx=0 tx=0).stop 2024-08-20T01:39:10.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.765+0000 7f2342e9d740 1 -- 172.21.15.79:0/2428251265 shutdown_connections 2024-08-20T01:39:10.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.765+0000 7f2342e9d740 1 --2- 172.21.15.79:0/2428251265 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5564d1c7a390 0x5564d1c7c830 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.765+0000 7f2342e9d740 1 --2- 172.21.15.79:0/2428251265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564d1c6a130 0x5564d1c677d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.765+0000 7f2342e9d740 1 --2- 172.21.15.79:0/2428251265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d1c5e1a0 0x5564d1c67040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.765+0000 7f2342e9d740 1 --2- 172.21.15.79:0/2428251265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564d1c5d880 0x5564d1c69bd0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.765+0000 7f2342e9d740 1 -- 172.21.15.79:0/2428251265 >> 172.21.15.79:0/2428251265 conn(0x5564d1c5b6b0 msgr2=0x5564d1c61220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:10.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.765+0000 7f2321ffb640 0 client.25514 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:39:10.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.765+0000 7f2342e9d740 1 -- 172.21.15.79:0/2428251265 shutdown_connections 2024-08-20T01:39:10.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.765+0000 7f2342e9d740 1 -- 172.21.15.79:0/2428251265 wait complete. 2024-08-20T01:39:10.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.765+0000 7f2342e9d740 20 client.25514 trim_cache size 0 max 16384 2024-08-20T01:39:10.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.778+0000 7f2342e9d740 1 Processor -- start 2024-08-20T01:39:10.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.778+0000 7f2342e9d740 1 -- start start 2024-08-20T01:39:10.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.779+0000 7f2342e9d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564d1c5d880 0x5564d1c618f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:10.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.779+0000 7f2342e9d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564d1c5e1a0 0x5564d1c5c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:10.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.779+0000 7f2342e9d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d1c6a130 0x5564d1c5cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:10.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.779+0000 7f2342e9d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f233c1b0260 con 0x5564d1c6a130 2024-08-20T01:39:10.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.779+0000 7f2342e9d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f233c1b1ef0 con 0x5564d1c5d880 2024-08-20T01:39:10.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.779+0000 7f2342e9d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f233c1b0930 con 0x5564d1c5e1a0 2024-08-20T01:39:10.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.779+0000 7f233ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d1c6a130 0x5564d1c5cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:10.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.779+0000 7f233ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d1c6a130 0x5564d1c5cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40484/0 (socket says 172.21.15.79:40484) 2024-08-20T01:39:10.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.779+0000 7f233a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564d1c5d880 0x5564d1c618f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:10.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.779+0000 7f233ad9d640 1 -- 172.21.15.79:0/1942976180 learned_addr learned my addr 172.21.15.79:0/1942976180 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:10.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.779+0000 7f2339d9b640 1 --2- 172.21.15.79:0/1942976180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564d1c5e1a0 0x5564d1c5c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:10.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.779+0000 7f233a59c640 1 -- 172.21.15.79:0/1942976180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564d1c5e1a0 msgr2=0x5564d1c5c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:10.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.779+0000 7f233a59c640 1 --2- 172.21.15.79:0/1942976180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564d1c5e1a0 0x5564d1c5c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.779+0000 7f233a59c640 1 -- 172.21.15.79:0/1942976180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d1c6a130 msgr2=0x5564d1c5cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:10.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.779+0000 7f233a59c640 1 --2- 172.21.15.79:0/1942976180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d1c6a130 0x5564d1c5cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.779+0000 7f233a59c640 1 -- 172.21.15.79:0/1942976180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564d1c67b40 con 0x5564d1c5d880 2024-08-20T01:39:10.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.780+0000 7f233a59c640 1 --2- 172.21.15.79:0/1942976180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564d1c5d880 0x5564d1c618f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f232c0057c0 tx=0x7f232c02a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2ccc4a777d65a1b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:10.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.780+0000 7f2323fff640 1 -- 172.21.15.79:0/1942976180 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232c035040 con 0x5564d1c5d880 2024-08-20T01:39:10.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.780+0000 7f2323fff640 1 -- 172.21.15.79:0/1942976180 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f232c045a20 con 0x5564d1c5d880 2024-08-20T01:39:10.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.780+0000 7f2323fff640 1 -- 172.21.15.79:0/1942976180 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232c03be60 con 0x5564d1c5d880 2024-08-20T01:39:10.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.781+0000 7f2342e9d740 1 -- 172.21.15.79:0/1942976180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564d1c5d880 msgr2=0x5564d1c618f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:10.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.781+0000 7f2342e9d740 1 --2- 172.21.15.79:0/1942976180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564d1c5d880 0x5564d1c618f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f232c0057c0 tx=0x7f232c02a410 comp rx=0 tx=0).stop 2024-08-20T01:39:10.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.781+0000 7f2342e9d740 1 -- 172.21.15.79:0/1942976180 shutdown_connections 2024-08-20T01:39:10.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.781+0000 7f2342e9d740 1 --2- 172.21.15.79:0/1942976180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d1c6a130 0x5564d1c5cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.781+0000 7f2342e9d740 1 --2- 172.21.15.79:0/1942976180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564d1c5e1a0 0x5564d1c5c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.781+0000 7f2342e9d740 1 --2- 172.21.15.79:0/1942976180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564d1c5d880 0x5564d1c618f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.781+0000 7f2342e9d740 1 -- 172.21.15.79:0/1942976180 >> 172.21.15.79:0/1942976180 conn(0x5564d1c5b6b0 msgr2=0x5564d1c66510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:10.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.781+0000 7f2342e9d740 1 -- 172.21.15.79:0/1942976180 shutdown_connections 2024-08-20T01:39:10.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.781+0000 7f2342e9d740 1 -- 172.21.15.79:0/1942976180 wait complete. 2024-08-20T01:39:10.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.781+0000 7f2342e9d740 1 -- start start 2024-08-20T01:39:10.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.781+0000 7f2342e9d740 1 Processor -- start 2024-08-20T01:39:10.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.781+0000 7f2342e9d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564d1c5d880 0x5564d1c72a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:10.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.781+0000 7f2342e9d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d1c5e1a0 0x5564d1c6d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:10.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.781+0000 7f2342e9d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564d1c6a130 0x5564d1c6d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:10.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.781+0000 7f2342e9d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f233c1b1760 con 0x5564d1c5e1a0 2024-08-20T01:39:10.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.782+0000 7f2342e9d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f233c1b1000 con 0x5564d1c6a130 2024-08-20T01:39:10.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.782+0000 7f2342e9d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f233c1ae240 con 0x5564d1c5d880 2024-08-20T01:39:10.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.782+0000 7f2342e9d740 10 client.0 _ll_register_callbacks cb 0x7f232c009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:10.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.782+0000 7f2339d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d1c5e1a0 0x5564d1c6d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:10.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.782+0000 7f233ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564d1c6a130 0x5564d1c6d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:10.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.782+0000 7f2339d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d1c5e1a0 0x5564d1c6d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40496/0 (socket says 172.21.15.79:40496) 2024-08-20T01:39:10.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.782+0000 7f2339d9b640 1 -- 172.21.15.79:0/3673732845 learned_addr learned my addr 172.21.15.79:0/3673732845 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:10.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.782+0000 7f233a59c640 1 --2- 172.21.15.79:0/3673732845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564d1c5d880 0x5564d1c72a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:10.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.782+0000 7f2339d9b640 1 -- 172.21.15.79:0/3673732845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564d1c5d880 msgr2=0x5564d1c72a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:10.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.782+0000 7f2339d9b640 1 --2- 172.21.15.79:0/3673732845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564d1c5d880 0x5564d1c72a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.782+0000 7f2339d9b640 1 -- 172.21.15.79:0/3673732845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564d1c6a130 msgr2=0x5564d1c6d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:10.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.782+0000 7f2339d9b640 1 --2- 172.21.15.79:0/3673732845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564d1c6a130 0x5564d1c6d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.782+0000 7f2339d9b640 1 -- 172.21.15.79:0/3673732845 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564d1ce3100 con 0x5564d1c5e1a0 2024-08-20T01:39:10.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.782+0000 7f233ad9d640 1 --2- 172.21.15.79:0/3673732845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564d1c6a130 0x5564d1c6d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:10.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.782+0000 7f2339d9b640 1 --2- 172.21.15.79:0/3673732845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d1c5e1a0 0x5564d1c6d120 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f23300eca00 tx=0x7f2330003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a3fd888a2791aa server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:10.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.782+0000 7f2321ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:39:10.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.782+0000 7f2321ffb640 1 -- 172.21.15.79:0/3673732845 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23300a6850 con 0x5564d1c5e1a0 2024-08-20T01:39:10.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.782+0000 7f2321ffb640 1 -- 172.21.15.79:0/3673732845 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f23300920b0 con 0x5564d1c5e1a0 2024-08-20T01:39:10.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.782+0000 7f2342e9d740 1 -- 172.21.15.79:0/3673732845 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f232c045a20 con 0x5564d1c5e1a0 2024-08-20T01:39:10.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.783+0000 7f2321ffb640 1 -- 172.21.15.79:0/3673732845 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f23300a6120 con 0x5564d1c5e1a0 2024-08-20T01:39:10.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.783+0000 7f2342e9d740 10 client.16215 fetch_fsmap learned FSMap version 33 2024-08-20T01:39:10.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.783+0000 7f2342e9d740 1 -- 172.21.15.79:0/3673732845 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5564d1ce43d0 con 0x5564d1c5e1a0 2024-08-20T01:39:10.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.783+0000 7f2321ffb640 1 -- 172.21.15.79:0/3673732845 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f232c045a20 con 0x5564d1c5e1a0 2024-08-20T01:39:10.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.783+0000 7f2321ffb640 1 -- 172.21.15.79:0/3673732845 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7f23300a6c20 con 0x5564d1c5e1a0 2024-08-20T01:39:10.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.783+0000 7f2342e9d740 10 client.16215 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:39:10.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.783+0000 7f2342e9d740 10 client.16215 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:39:10.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.783+0000 7f2342e9d740 20 client.16215 populate_metadata read hostname 'smithi079' 2024-08-20T01:39:10.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.783+0000 7f2342e9d740 1 --2- 172.21.15.79:0/3673732845 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5564d1ce4660 0x5564d1ce6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:10.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.783+0000 7f2342e9d740 4 client.16215 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:39:10.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.783+0000 7f2342e9d740 1 -- 172.21.15.79:0/3673732845 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5564d1bd2320 con 0x5564d1ce4660 2024-08-20T01:39:10.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.783+0000 7f233a59c640 1 --2- 172.21.15.79:0/3673732845 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5564d1ce4660 0x5564d1ce6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:10.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.784+0000 7f233a59c640 1 --2- 172.21.15.79:0/3673732845 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5564d1ce4660 0x5564d1ce6a50 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=52d7eec5719b712a server_cookie=d993e33b120a4fb9 in_seq=0 out_seq=0 2024-08-20T01:39:10.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.784+0000 7f2321ffb640 10 client.16215 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:39:10.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.784+0000 7f2321ffb640 1 -- 172.21.15.79:0/3673732845 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5564d1bd2320 con 0x5564d1ce4660 2024-08-20T01:39:10.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.784+0000 7f2321ffb640 10 client.16215 handle_command_reply: tid=0 2024-08-20T01:39:10.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.784+0000 7f2342e9d740 1 client.16215 shutdown 2024-08-20T01:39:10.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.784+0000 7f2342e9d740 1 -- 172.21.15.79:0/3673732845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d1c5e1a0 msgr2=0x5564d1c6d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:10.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.784+0000 7f2342e9d740 1 --2- 172.21.15.79:0/3673732845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d1c5e1a0 0x5564d1c6d120 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f23300eca00 tx=0x7f2330003f60 comp rx=0 tx=0).stop 2024-08-20T01:39:10.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.784+0000 7f2342e9d740 1 -- 172.21.15.79:0/3673732845 shutdown_connections 2024-08-20T01:39:10.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.784+0000 7f2342e9d740 1 --2- 172.21.15.79:0/3673732845 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5564d1ce4660 0x5564d1ce6a50 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.784+0000 7f2342e9d740 1 --2- 172.21.15.79:0/3673732845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564d1c6a130 0x5564d1c6d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.784+0000 7f2342e9d740 1 --2- 172.21.15.79:0/3673732845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564d1c5e1a0 0x5564d1c6d120 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.784+0000 7f2321ffb640 0 client.16215 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:39:10.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.784+0000 7f2342e9d740 1 --2- 172.21.15.79:0/3673732845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564d1c5d880 0x5564d1c72a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.784+0000 7f2342e9d740 1 -- 172.21.15.79:0/3673732845 >> 172.21.15.79:0/3673732845 conn(0x5564d1c5b6b0 msgr2=0x5564d1c5c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:10.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.785+0000 7f2342e9d740 1 -- 172.21.15.79:0/3673732845 shutdown_connections 2024-08-20T01:39:10.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.785+0000 7f2342e9d740 1 -- 172.21.15.79:0/3673732845 wait complete. 2024-08-20T01:39:10.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.785+0000 7f2342e9d740 20 client.16215 trim_cache size 0 max 16384 2024-08-20T01:39:10.799 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:39:10.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.785+0000 7f2340aa4640 1 -- 172.21.15.79:0/1510942905 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f23240b3bd0 msgr2=0x7f23240b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:10.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.785+0000 7f2340aa4640 1 --2- 172.21.15.79:0/1510942905 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f23240b3bd0 0x7f23240b6090 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f233c104620 tx=0x7f2334009600 comp rx=0 tx=0).stop 2024-08-20T01:39:10.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.785+0000 7f2340aa4640 1 -- 172.21.15.79:0/1510942905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f233c101f00 msgr2=0x7f233c102aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:10.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.785+0000 7f2340aa4640 1 --2- 172.21.15.79:0/1510942905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f233c101f00 0x7f233c102aa0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f233000c970 tx=0x7f233000ce30 comp rx=0 tx=0).stop 2024-08-20T01:39:10.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.785+0000 7f2340aa4640 1 -- 172.21.15.79:0/1510942905 shutdown_connections 2024-08-20T01:39:10.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.785+0000 7f2340aa4640 1 --2- 172.21.15.79:0/1510942905 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f23240b3bd0 0x7f23240b6090 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.785+0000 7f2340aa4640 1 --2- 172.21.15.79:0/1510942905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f233c10cdc0 0x7f233c102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.785+0000 7f2340aa4640 1 --2- 172.21.15.79:0/1510942905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f233c101f00 0x7f233c102aa0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.785+0000 7f2340aa4640 1 --2- 172.21.15.79:0/1510942905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f233c101500 0x7f233c102560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:10.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.785+0000 7f2340aa4640 1 -- 172.21.15.79:0/1510942905 >> 172.21.15.79:0/1510942905 conn(0x7f233c076bd0 msgr2=0x7f233c0fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:10.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.786+0000 7f2340aa4640 1 -- 172.21.15.79:0/1510942905 shutdown_connections 2024-08-20T01:39:10.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:10.786+0000 7f2340aa4640 1 -- 172.21.15.79:0/1510942905 wait complete. 2024-08-20T01:39:11.633 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T01:39:11.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:11 smithi079 ceph-mon[18656]: pgmap v403: 97 pgs: 97 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 31 MiB/s wr, 22 op/s 2024-08-20T01:39:11.948 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:39:12.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:11 smithi175 ceph-mon[22392]: pgmap v403: 97 pgs: 97 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 31 MiB/s wr, 22 op/s 2024-08-20T01:39:12.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:11 smithi081 ceph-mon[22209]: pgmap v403: 97 pgs: 97 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 31 MiB/s wr, 22 op/s 2024-08-20T01:39:12.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.474+0000 7faeee374640 1 -- 172.21.15.79:0/1090090132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee810cde0 msgr2=0x7faee810f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:12.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.474+0000 7faeee374640 1 --2- 172.21.15.79:0/1090090132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee810cde0 0x7faee810f250 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7faee0009ca0 tx=0x7faee002a8c0 comp rx=0 tx=0).stop 2024-08-20T01:39:12.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.474+0000 7faeee374640 1 -- 172.21.15.79:0/1090090132 shutdown_connections 2024-08-20T01:39:12.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.474+0000 7faeee374640 1 --2- 172.21.15.79:0/1090090132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee810cde0 0x7faee810f250 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:12.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.474+0000 7faeee374640 1 --2- 172.21.15.79:0/1090090132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faee8104230 0x7faee810c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:12.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.474+0000 7faeee374640 1 --2- 172.21.15.79:0/1090090132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faee8103830 0x7faee8103c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:12.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.474+0000 7faeee374640 1 -- 172.21.15.79:0/1090090132 >> 172.21.15.79:0/1090090132 conn(0x7faee80fd400 msgr2=0x7faee80ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:12.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.474+0000 7faeee374640 1 -- 172.21.15.79:0/1090090132 shutdown_connections 2024-08-20T01:39:12.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.474+0000 7faeee374640 1 -- 172.21.15.79:0/1090090132 wait complete. 2024-08-20T01:39:12.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.475+0000 7faeee374640 1 Processor -- start 2024-08-20T01:39:12.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.475+0000 7faeee374640 1 -- start start 2024-08-20T01:39:12.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.475+0000 7faeee374640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faee8103830 0x7faee8198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:12.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.475+0000 7faeee374640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faee8104230 0x7faee8199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:12.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.475+0000 7faeee374640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee810cde0 0x7faee819e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:12.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.475+0000 7faeee374640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7faee8112960 con 0x7faee810cde0 2024-08-20T01:39:12.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.475+0000 7faeee374640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faee81127e0 con 0x7faee8104230 2024-08-20T01:39:12.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.475+0000 7faeee374640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faee8112ae0 con 0x7faee8103830 2024-08-20T01:39:12.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.476+0000 7faeec911640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee810cde0 0x7faee819e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:12.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.476+0000 7faeec911640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee810cde0 0x7faee819e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40504/0 (socket says 172.21.15.79:40504) 2024-08-20T01:39:12.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.476+0000 7faeec911640 1 -- 172.21.15.79:0/4080810900 learned_addr learned my addr 172.21.15.79:0/4080810900 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:12.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.476+0000 7faee77fe640 1 --2- 172.21.15.79:0/4080810900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faee8104230 0x7faee8199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:12.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.476+0000 7faee7fff640 1 --2- 172.21.15.79:0/4080810900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faee8103830 0x7faee8198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:12.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.476+0000 7faeec911640 1 -- 172.21.15.79:0/4080810900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faee8103830 msgr2=0x7faee8198e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:12.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.476+0000 7faeec911640 1 --2- 172.21.15.79:0/4080810900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faee8103830 0x7faee8198e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:12.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.476+0000 7faeec911640 1 -- 172.21.15.79:0/4080810900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faee8104230 msgr2=0x7faee8199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:12.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.476+0000 7faeec911640 1 --2- 172.21.15.79:0/4080810900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faee8104230 0x7faee8199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:12.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.476+0000 7faeec911640 1 -- 172.21.15.79:0/4080810900 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee819ef00 con 0x7faee810cde0 2024-08-20T01:39:12.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.476+0000 7faeec911640 1 --2- 172.21.15.79:0/4080810900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee810cde0 0x7faee819e730 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7faee0005e30 tx=0x7faee00093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:12.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.476+0000 7faee57fa640 1 -- 172.21.15.79:0/4080810900 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee0032d10 con 0x7faee810cde0 2024-08-20T01:39:12.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.476+0000 7faeee374640 1 -- 172.21.15.79:0/4080810900 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faee819f190 con 0x7faee810cde0 2024-08-20T01:39:12.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.476+0000 7faee57fa640 1 -- 172.21.15.79:0/4080810900 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faee0032eb0 con 0x7faee810cde0 2024-08-20T01:39:12.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.476+0000 7faee57fa640 1 -- 172.21.15.79:0/4080810900 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee0030b20 con 0x7faee810cde0 2024-08-20T01:39:12.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.477+0000 7faeee374640 1 -- 172.21.15.79:0/4080810900 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faee81a58b0 con 0x7faee810cde0 2024-08-20T01:39:12.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.479+0000 7faef076d740 1 Processor -- start 2024-08-20T01:39:12.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.479+0000 7faee57fa640 1 -- 172.21.15.79:0/4080810900 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7faee0030ce0 con 0x7faee810cde0 2024-08-20T01:39:12.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.480+0000 7faef076d740 1 -- start start 2024-08-20T01:39:12.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.480+0000 7faef076d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556ddcb7880 0x5556ddcb7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:12.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.480+0000 7faef076d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556ddcb81a0 0x5556ddcc3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:12.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.480+0000 7faef076d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556ddcc4130 0x5556ddcc6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:12.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.480+0000 7faef076d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5556ddc2e930 con 0x5556ddcc4130 2024-08-20T01:39:12.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.480+0000 7faef076d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5556ddc1de30 con 0x5556ddcb81a0 2024-08-20T01:39:12.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.480+0000 7faef076d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5556ddc21e70 con 0x5556ddcb7880 2024-08-20T01:39:12.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.480+0000 7faee77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556ddcc4130 0x5556ddcc6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:12.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.480+0000 7faee77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556ddcc4130 0x5556ddcc6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40510/0 (socket says 172.21.15.79:40510) 2024-08-20T01:39:12.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.480+0000 7faee77fe640 1 -- 172.21.15.79:0/3718918561 learned_addr learned my addr 172.21.15.79:0/3718918561 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:12.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.480+0000 7faee77fe640 1 --2- 172.21.15.79:0/3718918561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556ddcb7880 0x5556ddcb7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:12.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.480+0000 7faee7fff640 1 --2- 172.21.15.79:0/3718918561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556ddcb81a0 0x5556ddcc3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:12.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.480+0000 7faee77fe640 1 -- 172.21.15.79:0/3718918561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556ddcb7880 msgr2=0x5556ddcb7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:12.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.480+0000 7faee77fe640 1 --2- 172.21.15.79:0/3718918561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556ddcb7880 0x5556ddcb7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:12.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.480+0000 7faee77fe640 1 -- 172.21.15.79:0/3718918561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556ddcb81a0 msgr2=0x5556ddcc3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:12.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.480+0000 7faee77fe640 1 --2- 172.21.15.79:0/3718918561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556ddcb81a0 0x5556ddcc3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:12.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.480+0000 7faee77fe640 1 -- 172.21.15.79:0/3718918561 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556dd97d650 con 0x5556ddcc4130 2024-08-20T01:39:12.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.480+0000 7faee7fff640 1 --2- 172.21.15.79:0/3718918561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556ddcb81a0 0x5556ddcc3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:39:12.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.480+0000 7faee57fa640 1 --2- 172.21.15.79:0/4080810900 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7faed00b3c50 0x7faed00b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:12.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.481+0000 7faee77fe640 1 --2- 172.21.15.79:0/3718918561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556ddcc4130 0x5556ddcc6520 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7faedc011440 tx=0x7faedc009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad7d9af96cb0e99 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:12.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.481+0000 7faee7fff640 1 --2- 172.21.15.79:0/4080810900 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7faed00b3c50 0x7faed00b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:12.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.481+0000 7faee57fa640 1 -- 172.21.15.79:0/4080810900 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7faee0104e80 con 0x7faee810cde0 2024-08-20T01:39:12.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.481+0000 7faece7fc640 1 -- 172.21.15.79:0/3718918561 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faedc004050 con 0x5556ddcc4130 2024-08-20T01:39:12.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.481+0000 7faece7fc640 1 -- 172.21.15.79:0/3718918561 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faedc0035f0 con 0x5556ddcc4130 2024-08-20T01:39:12.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.481+0000 7faece7fc640 1 -- 172.21.15.79:0/3718918561 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faedc01d620 con 0x5556ddcc4130 2024-08-20T01:39:12.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.482+0000 7faef076d740 1 -- 172.21.15.79:0/3718918561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556ddcc4130 msgr2=0x5556ddcc6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:12.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.482+0000 7faef076d740 1 --2- 172.21.15.79:0/3718918561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556ddcc4130 0x5556ddcc6520 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7faedc011440 tx=0x7faedc009880 comp rx=0 tx=0).stop 2024-08-20T01:39:12.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.482+0000 7faee7fff640 1 --2- 172.21.15.79:0/4080810900 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7faed00b3c50 0x7faed00b6110 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x5556ddcbaa00 tx=0x7faed800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:12.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.482+0000 7faef076d740 1 -- 172.21.15.79:0/3718918561 shutdown_connections 2024-08-20T01:39:12.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.482+0000 7faef076d740 1 --2- 172.21.15.79:0/3718918561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556ddcc4130 0x5556ddcc6520 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:12.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.482+0000 7faef076d740 1 --2- 172.21.15.79:0/3718918561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556ddcb81a0 0x5556ddcc3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:12.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.482+0000 7faef076d740 1 --2- 172.21.15.79:0/3718918561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556ddcb7880 0x5556ddcb7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:12.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.482+0000 7faef076d740 1 -- 172.21.15.79:0/3718918561 >> 172.21.15.79:0/3718918561 conn(0x5556ddcb56b0 msgr2=0x5556ddcb6850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:12.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.482+0000 7faef076d740 1 -- 172.21.15.79:0/3718918561 shutdown_connections 2024-08-20T01:39:12.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.482+0000 7faef076d740 1 -- 172.21.15.79:0/3718918561 wait complete. 2024-08-20T01:39:12.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.482+0000 7faef076d740 1 -- start start 2024-08-20T01:39:12.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.483+0000 7faef076d740 1 Processor -- start 2024-08-20T01:39:12.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.483+0000 7faef076d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556ddcb7880 0x5556ddcc1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:12.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.483+0000 7faef076d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556ddcb81a0 0x5556ddcc16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:12.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.483+0000 7faef076d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556ddcc4130 0x5556ddcc1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:12.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.483+0000 7faef076d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5556dda80700 con 0x5556ddcb81a0 2024-08-20T01:39:12.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.483+0000 7faef076d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5556ddba4810 con 0x5556ddcc4130 2024-08-20T01:39:12.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.483+0000 7faef076d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5556ddcc6de0 con 0x5556ddcb7880 2024-08-20T01:39:12.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.483+0000 7faef076d740 10 client.0 _ll_register_callbacks cb 0x5556ddc17700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:12.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.483+0000 7faee7fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556ddcb7880 0x5556ddcc1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:12.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.483+0000 7faee7fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556ddcb7880 0x5556ddcc1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:46844/0 (socket says 172.21.15.79:46844) 2024-08-20T01:39:12.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.483+0000 7faee77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556ddcb81a0 0x5556ddcc16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:12.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.483+0000 7faee7fff640 1 -- 172.21.15.79:0/980652175 learned_addr learned my addr 172.21.15.79:0/980652175 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:12.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.483+0000 7faeec911640 1 --2- 172.21.15.79:0/980652175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556ddcc4130 0x5556ddcc1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:12.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.484+0000 7faee77fe640 1 -- 172.21.15.79:0/980652175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556ddcb7880 msgr2=0x5556ddcc1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:12.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.484+0000 7faee77fe640 1 --2- 172.21.15.79:0/980652175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556ddcb7880 0x5556ddcc1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:12.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.484+0000 7faee77fe640 1 -- 172.21.15.79:0/980652175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556ddcc4130 msgr2=0x5556ddcc1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:12.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.484+0000 7faee77fe640 1 --2- 172.21.15.79:0/980652175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556ddcc4130 0x5556ddcc1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:12.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.484+0000 7faee77fe640 1 -- 172.21.15.79:0/980652175 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556ddcd0270 con 0x5556ddcb81a0 2024-08-20T01:39:12.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.484+0000 7faeec911640 1 --2- 172.21.15.79:0/980652175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556ddcc4130 0x5556ddcc1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:12.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.484+0000 7faee77fe640 1 --2- 172.21.15.79:0/980652175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556ddcb81a0 0x5556ddcc16c0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7faedc0058c0 tx=0x7faedc0098f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6867ade0bbf3d7bb server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:12.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.484+0000 7faec77fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:39:12.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.484+0000 7faec77fe640 1 -- 172.21.15.79:0/980652175 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faedc003a00 con 0x5556ddcb81a0 2024-08-20T01:39:12.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.484+0000 7faec77fe640 1 -- 172.21.15.79:0/980652175 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7faedc005040 con 0x5556ddcb81a0 2024-08-20T01:39:12.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.484+0000 7faef076d740 1 -- 172.21.15.79:0/980652175 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5556ddbcd150 con 0x5556ddcb81a0 2024-08-20T01:39:12.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.485+0000 7faec77fe640 1 -- 172.21.15.79:0/980652175 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7faedc005c50 con 0x5556ddcb81a0 2024-08-20T01:39:12.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.485+0000 7faef076d740 10 client.16227 fetch_fsmap learned FSMap version 33 2024-08-20T01:39:12.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.485+0000 7faef076d740 1 -- 172.21.15.79:0/980652175 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5556ddcd7030 con 0x5556ddcb81a0 2024-08-20T01:39:12.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.485+0000 7faec77fe640 1 -- 172.21.15.79:0/980652175 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5556ddbcd150 con 0x5556ddcb81a0 2024-08-20T01:39:12.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.485+0000 7faec77fe640 1 -- 172.21.15.79:0/980652175 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7faedc004b80 con 0x5556ddcb81a0 2024-08-20T01:39:12.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.485+0000 7faef076d740 10 client.16227 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:39:12.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.485+0000 7faef076d740 10 client.16227 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:39:12.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.485+0000 7faef076d740 20 client.16227 populate_metadata read hostname 'smithi079' 2024-08-20T01:39:12.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.485+0000 7faef076d740 1 --2- 172.21.15.79:0/980652175 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x5556ddcd87b0 0x5556ddcdabd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:12.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.485+0000 7faef076d740 4 client.16227 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:39:12.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.485+0000 7faef076d740 1 -- 172.21.15.79:0/980652175 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5556ddc30880 con 0x5556ddcd87b0 2024-08-20T01:39:12.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.486+0000 7faee7fff640 1 --2- 172.21.15.79:0/980652175 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x5556ddcd87b0 0x5556ddcdabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:12.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.486+0000 7faec77fe640 10 client.16227 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:39:12.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.486+0000 7faee7fff640 1 --2- 172.21.15.79:0/980652175 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x5556ddcd87b0 0x5556ddcdabd0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=16d3191f9ee0baab server_cookie=385819eb5ebbbdab in_seq=0 out_seq=0 2024-08-20T01:39:12.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.487+0000 7faec77fe640 1 -- 172.21.15.79:0/980652175 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5556ddc30880 con 0x5556ddcd87b0 2024-08-20T01:39:12.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.487+0000 7faec77fe640 10 client.16227 handle_command_reply: tid=0 2024-08-20T01:39:12.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.487+0000 7faef076d740 1 client.16227 shutdown 2024-08-20T01:39:12.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.487+0000 7faef076d740 1 -- 172.21.15.79:0/980652175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556ddcb81a0 msgr2=0x5556ddcc16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:12.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.487+0000 7faef076d740 1 --2- 172.21.15.79:0/980652175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556ddcb81a0 0x5556ddcc16c0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7faedc0058c0 tx=0x7faedc0098f0 comp rx=0 tx=0).stop 2024-08-20T01:39:12.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.487+0000 7faef076d740 1 -- 172.21.15.79:0/980652175 shutdown_connections 2024-08-20T01:39:12.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.487+0000 7faef076d740 1 --2- 172.21.15.79:0/980652175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556ddcc4130 0x5556ddcc1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:12.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.487+0000 7faef076d740 1 --2- 172.21.15.79:0/980652175 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x5556ddcd87b0 0x5556ddcdabd0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:12.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.487+0000 7faef076d740 1 --2- 172.21.15.79:0/980652175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556ddcb81a0 0x5556ddcc16c0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:12.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.487+0000 7faef076d740 1 --2- 172.21.15.79:0/980652175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556ddcb7880 0x5556ddcc1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:12.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.487+0000 7faec77fe640 0 client.16227 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:39:12.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.487+0000 7faef076d740 1 -- 172.21.15.79:0/980652175 >> 172.21.15.79:0/980652175 conn(0x5556ddcb56b0 msgr2=0x5556ddcbb250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:12.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.487+0000 7faef076d740 1 -- 172.21.15.79:0/980652175 shutdown_connections 2024-08-20T01:39:12.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.487+0000 7faef076d740 1 -- 172.21.15.79:0/980652175 wait complete. 2024-08-20T01:39:12.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.488+0000 7faef076d740 20 client.16227 trim_cache size 0 max 16384 2024-08-20T01:39:12.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.500+0000 7faef076d740 1 Processor -- start 2024-08-20T01:39:12.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.500+0000 7faef076d740 1 -- start start 2024-08-20T01:39:12.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.500+0000 7faef076d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556ddcb7880 0x5556ddcb6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:12.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.500+0000 7faef076d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556ddcc4130 0x5556ddcc1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:12.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.500+0000 7faef076d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556ddcb4f60 0x5556ddce04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:12.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.500+0000 7faef076d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7faee81abd20 con 0x5556ddcc4130 2024-08-20T01:39:12.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.500+0000 7faef076d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faee81ad9b0 con 0x5556ddcb7880 2024-08-20T01:39:12.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.500+0000 7faef076d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faee81ac3f0 con 0x5556ddcb4f60 2024-08-20T01:39:12.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.501+0000 7faee77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556ddcc4130 0x5556ddcc1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:12.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.501+0000 7faee77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556ddcc4130 0x5556ddcc1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40526/0 (socket says 172.21.15.79:40526) 2024-08-20T01:39:12.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.501+0000 7faee77fe640 1 -- 172.21.15.79:0/2974950209 learned_addr learned my addr 172.21.15.79:0/2974950209 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.501+0000 7faee7fff640 1 --2- 172.21.15.79:0/2974950209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556ddcb7880 0x5556ddcb6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.501+0000 7faeec911640 1 --2- 172.21.15.79:0/2974950209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556ddcb4f60 0x5556ddce04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.501+0000 7faee77fe640 1 -- 172.21.15.79:0/2974950209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556ddcb4f60 msgr2=0x5556ddce04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.501+0000 7faee77fe640 1 --2- 172.21.15.79:0/2974950209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556ddcb4f60 0x5556ddce04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.501+0000 7faee77fe640 1 -- 172.21.15.79:0/2974950209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556ddcb7880 msgr2=0x5556ddcb6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.501+0000 7faee77fe640 1 --2- 172.21.15.79:0/2974950209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556ddcb7880 0x5556ddcb6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.501+0000 7faee77fe640 1 -- 172.21.15.79:0/2974950209 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556ddcb7fd0 con 0x5556ddcc4130 2024-08-20T01:39:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.501+0000 7faee77fe640 1 --2- 172.21.15.79:0/2974950209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556ddcc4130 0x5556ddcc1890 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7faedc014040 tx=0x7faedc02a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9416caac78859c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.501+0000 7faecdffb640 1 -- 172.21.15.79:0/2974950209 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faedc02a7c0 con 0x5556ddcc4130 2024-08-20T01:39:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.501+0000 7faecdffb640 1 -- 172.21.15.79:0/2974950209 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faedc02a0d0 con 0x5556ddcc4130 2024-08-20T01:39:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.501+0000 7faecdffb640 1 -- 172.21.15.79:0/2974950209 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faedc003d60 con 0x5556ddcc4130 2024-08-20T01:39:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.502+0000 7faef076d740 1 -- 172.21.15.79:0/2974950209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556ddcc4130 msgr2=0x5556ddcc1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:12.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.502+0000 7faef076d740 1 --2- 172.21.15.79:0/2974950209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556ddcc4130 0x5556ddcc1890 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7faedc014040 tx=0x7faedc02a640 comp rx=0 tx=0).stop 2024-08-20T01:39:12.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.502+0000 7faef076d740 1 -- 172.21.15.79:0/2974950209 shutdown_connections 2024-08-20T01:39:12.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.502+0000 7faef076d740 1 --2- 172.21.15.79:0/2974950209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556ddcb4f60 0x5556ddce04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:12.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.502+0000 7faef076d740 1 --2- 172.21.15.79:0/2974950209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556ddcc4130 0x5556ddcc1890 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:12.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.502+0000 7faef076d740 1 --2- 172.21.15.79:0/2974950209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556ddcb7880 0x5556ddcb6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:12.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.502+0000 7faef076d740 1 -- 172.21.15.79:0/2974950209 >> 172.21.15.79:0/2974950209 conn(0x5556ddcb56b0 msgr2=0x5556ddcc1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:12.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.502+0000 7faef076d740 1 -- 172.21.15.79:0/2974950209 shutdown_connections 2024-08-20T01:39:12.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.502+0000 7faef076d740 1 -- 172.21.15.79:0/2974950209 wait complete. 2024-08-20T01:39:12.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.503+0000 7faef076d740 1 -- start start 2024-08-20T01:39:12.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.503+0000 7faef076d740 1 Processor -- start 2024-08-20T01:39:12.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.503+0000 7faef076d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556ddcb4f60 0x5556ddccc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:12.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.503+0000 7faef076d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556ddcb7880 0x5556ddccc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:12.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.503+0000 7faef076d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556ddcc4130 0x5556ddcbd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:12.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.503+0000 7faef076d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7faee81ad220 con 0x5556ddcc4130 2024-08-20T01:39:12.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.503+0000 7faef076d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faee81acac0 con 0x5556ddcb7880 2024-08-20T01:39:12.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.503+0000 7faef076d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faee81a9d20 con 0x5556ddcb4f60 2024-08-20T01:39:12.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.503+0000 7faef076d740 10 client.0 _ll_register_callbacks cb 0x7faedc009e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:12.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.503+0000 7faeec911640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556ddcc4130 0x5556ddcbd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:12.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.503+0000 7faeec911640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556ddcc4130 0x5556ddcbd410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40528/0 (socket says 172.21.15.79:40528) 2024-08-20T01:39:12.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.503+0000 7faeec911640 1 -- 172.21.15.79:0/3547631191 learned_addr learned my addr 172.21.15.79:0/3547631191 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:12.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.504+0000 7faee77fe640 1 --2- 172.21.15.79:0/3547631191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556ddcb7880 0x5556ddccc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:12.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.504+0000 7faee7fff640 1 --2- 172.21.15.79:0/3547631191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556ddcb4f60 0x5556ddccc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:12.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.504+0000 7faeec911640 1 -- 172.21.15.79:0/3547631191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556ddcb4f60 msgr2=0x5556ddccc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:12.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.504+0000 7faeec911640 1 --2- 172.21.15.79:0/3547631191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556ddcb4f60 0x5556ddccc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:12.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.504+0000 7faeec911640 1 -- 172.21.15.79:0/3547631191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556ddcb7880 msgr2=0x5556ddccc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:12.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.504+0000 7faeec911640 1 --2- 172.21.15.79:0/3547631191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556ddcb7880 0x5556ddccc5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:12.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.504+0000 7faeec911640 1 -- 172.21.15.79:0/3547631191 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556ddcbf0a0 con 0x5556ddcc4130 2024-08-20T01:39:12.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.504+0000 7faee7fff640 1 --2- 172.21.15.79:0/3547631191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556ddcb4f60 0x5556ddccc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:39:12.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.504+0000 7faeec911640 1 --2- 172.21.15.79:0/3547631191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556ddcc4130 0x5556ddcbd410 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7faee00c9050 tx=0x7faee00cc5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=621699b9eb3408fa server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:12.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.504+0000 7faec77fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:39:12.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.504+0000 7faec77fe640 1 -- 172.21.15.79:0/3547631191 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee00d4e90 con 0x5556ddcc4130 2024-08-20T01:39:12.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.504+0000 7faec77fe640 1 -- 172.21.15.79:0/3547631191 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7faee00c83d0 con 0x5556ddcc4130 2024-08-20T01:39:12.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.504+0000 7faef076d740 1 -- 172.21.15.79:0/3547631191 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faedc02a0d0 con 0x5556ddcc4130 2024-08-20T01:39:12.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.504+0000 7faec77fe640 1 -- 172.21.15.79:0/3547631191 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7faee00ed050 con 0x5556ddcc4130 2024-08-20T01:39:12.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.504+0000 7faef076d740 10 client.16233 fetch_fsmap learned FSMap version 33 2024-08-20T01:39:12.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.504+0000 7faef076d740 1 -- 172.21.15.79:0/3547631191 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5556ddd429d0 con 0x5556ddcc4130 2024-08-20T01:39:12.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.505+0000 7faec77fe640 1 -- 172.21.15.79:0/3547631191 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faedc02a0d0 con 0x5556ddcc4130 2024-08-20T01:39:12.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.505+0000 7faec77fe640 1 -- 172.21.15.79:0/3547631191 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7faee00cb040 con 0x5556ddcc4130 2024-08-20T01:39:12.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.505+0000 7faef076d740 10 client.16233 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:39:12.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.505+0000 7faef076d740 10 client.16233 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:39:12.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.505+0000 7faef076d740 20 client.16233 populate_metadata read hostname 'smithi079' 2024-08-20T01:39:12.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.505+0000 7faef076d740 1 --2- 172.21.15.79:0/3547631191 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x5556ddd430d0 0x5556ddd454f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:12.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.505+0000 7faef076d740 4 client.16233 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:39:12.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.505+0000 7faef076d740 1 -- 172.21.15.79:0/3547631191 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5556ddc2c320 con 0x5556ddd430d0 2024-08-20T01:39:12.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.505+0000 7faee7fff640 1 --2- 172.21.15.79:0/3547631191 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x5556ddd430d0 0x5556ddd454f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:12.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.506+0000 7faec77fe640 10 client.16233 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:39:12.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.506+0000 7faee7fff640 1 --2- 172.21.15.79:0/3547631191 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x5556ddd430d0 0x5556ddd454f0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=74f0df95100ba044 server_cookie=bd8e69da2b58384a in_seq=0 out_seq=0 2024-08-20T01:39:12.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.506+0000 7faec77fe640 1 -- 172.21.15.79:0/3547631191 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5556ddc2c320 con 0x5556ddd430d0 2024-08-20T01:39:12.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.506+0000 7faec77fe640 10 client.16233 handle_command_reply: tid=0 2024-08-20T01:39:12.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.506+0000 7faef076d740 1 client.16233 shutdown 2024-08-20T01:39:12.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.506+0000 7faef076d740 1 -- 172.21.15.79:0/3547631191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556ddcc4130 msgr2=0x5556ddcbd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:12.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.506+0000 7faef076d740 1 --2- 172.21.15.79:0/3547631191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556ddcc4130 0x5556ddcbd410 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7faee00c9050 tx=0x7faee00cc5a0 comp rx=0 tx=0).stop 2024-08-20T01:39:12.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.506+0000 7faef076d740 1 -- 172.21.15.79:0/3547631191 shutdown_connections 2024-08-20T01:39:12.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.506+0000 7faef076d740 1 --2- 172.21.15.79:0/3547631191 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x5556ddd430d0 0x5556ddd454f0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:12.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.506+0000 7faec77fe640 0 client.16233 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:39:12.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.506+0000 7faef076d740 1 --2- 172.21.15.79:0/3547631191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5556ddcc4130 0x5556ddcbd410 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:12.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.506+0000 7faef076d740 1 --2- 172.21.15.79:0/3547631191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556ddcb7880 0x5556ddccc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:12.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.506+0000 7faef076d740 1 --2- 172.21.15.79:0/3547631191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5556ddcb4f60 0x5556ddccc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:12.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.506+0000 7faef076d740 1 -- 172.21.15.79:0/3547631191 >> 172.21.15.79:0/3547631191 conn(0x5556ddcb56b0 msgr2=0x5556ddcb6cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:12.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.506+0000 7faef076d740 1 -- 172.21.15.79:0/3547631191 shutdown_connections 2024-08-20T01:39:12.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.506+0000 7faef076d740 1 -- 172.21.15.79:0/3547631191 wait complete. 2024-08-20T01:39:12.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.506+0000 7faef076d740 20 client.16233 trim_cache size 0 max 16384 2024-08-20T01:39:12.515 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:39:12.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.507+0000 7faeee374640 1 -- 172.21.15.79:0/4080810900 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7faed00b3c50 msgr2=0x7faed00b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:12.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.507+0000 7faeee374640 1 --2- 172.21.15.79:0/4080810900 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7faed00b3c50 0x7faed00b6110 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x5556ddcbaa00 tx=0x7faed800a2d0 comp rx=0 tx=0).stop 2024-08-20T01:39:12.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.507+0000 7faeee374640 1 -- 172.21.15.79:0/4080810900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee810cde0 msgr2=0x7faee819e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:12.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.507+0000 7faeee374640 1 --2- 172.21.15.79:0/4080810900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee810cde0 0x7faee819e730 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7faee0005e30 tx=0x7faee00093d0 comp rx=0 tx=0).stop 2024-08-20T01:39:12.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.507+0000 7faeee374640 1 -- 172.21.15.79:0/4080810900 shutdown_connections 2024-08-20T01:39:12.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.507+0000 7faeee374640 1 --2- 172.21.15.79:0/4080810900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee810cde0 0x7faee819e730 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:12.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.507+0000 7faeee374640 1 --2- 172.21.15.79:0/4080810900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faee8104230 0x7faee8199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:12.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.507+0000 7faeee374640 1 --2- 172.21.15.79:0/4080810900 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7faed00b3c50 0x7faed00b6110 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:12.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.507+0000 7faeee374640 1 --2- 172.21.15.79:0/4080810900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faee8103830 0x7faee8198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:12.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.507+0000 7faeee374640 1 -- 172.21.15.79:0/4080810900 >> 172.21.15.79:0/4080810900 conn(0x7faee80fd400 msgr2=0x7faee80fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:12.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.507+0000 7faeee374640 1 -- 172.21.15.79:0/4080810900 shutdown_connections 2024-08-20T01:39:12.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:12.507+0000 7faeee374640 1 -- 172.21.15.79:0/4080810900 wait complete. 2024-08-20T01:39:13.237 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T01:39:13.508 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:39:13.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:13 smithi079 ceph-mon[18656]: pgmap v404: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 29 MiB/s wr, 21 op/s 2024-08-20T01:39:14.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.058+0000 7fc2aa9bf640 1 -- 172.21.15.79:0/1455180739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2a4108e60 msgr2=0x7fc2a410f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:14.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.058+0000 7fc2aa9bf640 1 --2- 172.21.15.79:0/1455180739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2a4108e60 0x7fc2a410f660 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fc29c009ca0 tx=0x7fc29c02a8c0 comp rx=0 tx=0).stop 2024-08-20T01:39:14.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.058+0000 7fc2aa9bf640 1 -- 172.21.15.79:0/1455180739 shutdown_connections 2024-08-20T01:39:14.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.058+0000 7fc2aa9bf640 1 --2- 172.21.15.79:0/1455180739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2a4108e60 0x7fc2a410f660 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:14.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.058+0000 7fc2aa9bf640 1 --2- 172.21.15.79:0/1455180739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2a41084e0 0x7fc2a4108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:14.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.058+0000 7fc2aa9bf640 1 --2- 172.21.15.79:0/1455180739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2a4102ad0 0x7fc2a4102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:14.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.058+0000 7fc2aa9bf640 1 -- 172.21.15.79:0/1455180739 >> 172.21.15.79:0/1455180739 conn(0x7fc2a40fe540 msgr2=0x7fc2a4100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:14.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.059+0000 7fc2aa9bf640 1 -- 172.21.15.79:0/1455180739 shutdown_connections 2024-08-20T01:39:14.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.059+0000 7fc2aa9bf640 1 -- 172.21.15.79:0/1455180739 wait complete. 2024-08-20T01:39:14.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.059+0000 7fc2aa9bf640 1 Processor -- start 2024-08-20T01:39:14.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.059+0000 7fc2aa9bf640 1 -- start start 2024-08-20T01:39:14.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.060+0000 7fc2aa9bf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2a4102ad0 0x7fc2a419b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:14.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.060+0000 7fc2aa9bf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2a41084e0 0x7fc2a419b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:14.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.060+0000 7fc2aa9bf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2a4108e60 0x7fc2a41a09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:14.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.060+0000 7fc2aa9bf640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a4112a20 con 0x7fc2a4102ad0 2024-08-20T01:39:14.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.060+0000 7fc2aa9bf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a41128a0 con 0x7fc2a4108e60 2024-08-20T01:39:14.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.060+0000 7fc2aa9bf640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a4112ba0 con 0x7fc2a41084e0 2024-08-20T01:39:14.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.060+0000 7fc2a3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2a4102ad0 0x7fc2a419b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:14.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.060+0000 7fc2a3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2a4102ad0 0x7fc2a419b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40554/0 (socket says 172.21.15.79:40554) 2024-08-20T01:39:14.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.060+0000 7fc2a3fff640 1 -- 172.21.15.79:0/1214674826 learned_addr learned my addr 172.21.15.79:0/1214674826 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:14.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.060+0000 7fc2a37fe640 1 --2- 172.21.15.79:0/1214674826 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2a41084e0 0x7fc2a419b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:14.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.060+0000 7fc2a8f5c640 1 --2- 172.21.15.79:0/1214674826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2a4108e60 0x7fc2a41a09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:14.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.060+0000 7fc2a3fff640 1 -- 172.21.15.79:0/1214674826 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2a41084e0 msgr2=0x7fc2a419b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:14.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.060+0000 7fc2a3fff640 1 --2- 172.21.15.79:0/1214674826 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2a41084e0 0x7fc2a419b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:14.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.060+0000 7fc2a3fff640 1 -- 172.21.15.79:0/1214674826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2a4108e60 msgr2=0x7fc2a41a09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:14.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.060+0000 7fc2a3fff640 1 --2- 172.21.15.79:0/1214674826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2a4108e60 0x7fc2a41a09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:14.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.060+0000 7fc2a3fff640 1 -- 172.21.15.79:0/1214674826 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2a41a1180 con 0x7fc2a4102ad0 2024-08-20T01:39:14.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.061+0000 7fc2a8f5c640 1 --2- 172.21.15.79:0/1214674826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2a4108e60 0x7fc2a41a09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:39:14.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.061+0000 7fc2a3fff640 1 --2- 172.21.15.79:0/1214674826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2a4102ad0 0x7fc2a419b0d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fc29400b4a0 tx=0x7fc29400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:14.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.061+0000 7fc2a17fa640 1 -- 172.21.15.79:0/1214674826 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc294014070 con 0x7fc2a4102ad0 2024-08-20T01:39:14.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.061+0000 7fc2a17fa640 1 -- 172.21.15.79:0/1214674826 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc294010aa0 con 0x7fc2a4102ad0 2024-08-20T01:39:14.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.061+0000 7fc2aa9bf640 1 -- 172.21.15.79:0/1214674826 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2a41a1470 con 0x7fc2a4102ad0 2024-08-20T01:39:14.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.061+0000 7fc2a17fa640 1 -- 172.21.15.79:0/1214674826 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc294017b70 con 0x7fc2a4102ad0 2024-08-20T01:39:14.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.061+0000 7fc2aa9bf640 1 -- 172.21.15.79:0/1214674826 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2a41a7d00 con 0x7fc2a4102ad0 2024-08-20T01:39:14.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.064+0000 7fc2a17fa640 1 -- 172.21.15.79:0/1214674826 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc294017070 con 0x7fc2a4102ad0 2024-08-20T01:39:14.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.064+0000 7fc2acdb8740 1 Processor -- start 2024-08-20T01:39:14.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.064+0000 7fc2acdb8740 1 -- start start 2024-08-20T01:39:14.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.065+0000 7fc2acdb8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fffb462880 0x55fffb462c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:14.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.065+0000 7fc2acdb8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fffb4631a0 0x55fffb46ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:14.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.065+0000 7fc2acdb8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fffb46f130 0x55fffb471520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:14.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.065+0000 7fc2acdb8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fffb3d9930 con 0x55fffb46f130 2024-08-20T01:39:14.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.065+0000 7fc2acdb8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55fffb3c8e30 con 0x55fffb462880 2024-08-20T01:39:14.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.065+0000 7fc2acdb8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55fffb3cce70 con 0x55fffb4631a0 2024-08-20T01:39:14.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.065+0000 7fc2a37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fffb46f130 0x55fffb471520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:14.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.065+0000 7fc2a37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fffb46f130 0x55fffb471520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40564/0 (socket says 172.21.15.79:40564) 2024-08-20T01:39:14.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.065+0000 7fc2a37fe640 1 -- 172.21.15.79:0/738353347 learned_addr learned my addr 172.21.15.79:0/738353347 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:14.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.065+0000 7fc2a8f5c640 1 --2- 172.21.15.79:0/738353347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fffb462880 0x55fffb462c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:14.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.065+0000 7fc2a3fff640 1 --2- 172.21.15.79:0/738353347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fffb4631a0 0x55fffb46ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:14.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.065+0000 7fc2a17fa640 1 --2- 172.21.15.79:0/1214674826 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc28c0b3c50 0x7fc28c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:14.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.065+0000 7fc2a8f5c640 1 -- 172.21.15.79:0/738353347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fffb4631a0 msgr2=0x55fffb46ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:14.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.065+0000 7fc2a8f5c640 1 --2- 172.21.15.79:0/738353347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fffb4631a0 0x55fffb46ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:14.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.065+0000 7fc2a8f5c640 1 -- 172.21.15.79:0/738353347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fffb46f130 msgr2=0x55fffb471520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:14.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.065+0000 7fc2a8f5c640 1 --2- 172.21.15.79:0/738353347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fffb46f130 0x55fffb471520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:14.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.065+0000 7fc2a8f5c640 1 -- 172.21.15.79:0/738353347 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fffb128650 con 0x55fffb462880 2024-08-20T01:39:14.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.066+0000 7fc2a17fa640 1 -- 172.21.15.79:0/1214674826 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc2940e3320 con 0x7fc2a4102ad0 2024-08-20T01:39:14.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.066+0000 7fc2a37fe640 1 --2- 172.21.15.79:0/738353347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fffb46f130 0x55fffb471520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:14.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.066+0000 7fc2a8f5c640 1 --2- 172.21.15.79:0/1214674826 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc28c0b3c50 0x7fc28c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:14.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.066+0000 7fc2a8f5c640 1 --2- 172.21.15.79:0/738353347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fffb462880 0x55fffb462c60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc29c02aeb0 tx=0x7fc29c031600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e16aa366ba7c9d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:14.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.066+0000 7fc28a7fc640 1 -- 172.21.15.79:0/738353347 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc29c04a070 con 0x55fffb462880 2024-08-20T01:39:14.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.066+0000 7fc28a7fc640 1 -- 172.21.15.79:0/738353347 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc29c036040 con 0x55fffb462880 2024-08-20T01:39:14.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.066+0000 7fc28a7fc640 1 -- 172.21.15.79:0/738353347 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc29c0305c0 con 0x55fffb462880 2024-08-20T01:39:14.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.067+0000 7fc2acdb8740 1 -- 172.21.15.79:0/738353347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fffb462880 msgr2=0x55fffb462c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:14.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.067+0000 7fc2a8f5c640 1 --2- 172.21.15.79:0/1214674826 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc28c0b3c50 0x7fc28c0b6110 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc29c009a60 tx=0x7fc29c0308c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:14.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.067+0000 7fc2acdb8740 1 --2- 172.21.15.79:0/738353347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fffb462880 0x55fffb462c60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc29c02aeb0 tx=0x7fc29c031600 comp rx=0 tx=0).stop 2024-08-20T01:39:14.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.067+0000 7fc2acdb8740 1 -- 172.21.15.79:0/738353347 shutdown_connections 2024-08-20T01:39:14.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.067+0000 7fc2acdb8740 1 --2- 172.21.15.79:0/738353347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fffb46f130 0x55fffb471520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:14.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.067+0000 7fc2acdb8740 1 --2- 172.21.15.79:0/738353347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fffb4631a0 0x55fffb46ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:14.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.067+0000 7fc2acdb8740 1 --2- 172.21.15.79:0/738353347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fffb462880 0x55fffb462c60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:14.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.067+0000 7fc2acdb8740 1 -- 172.21.15.79:0/738353347 >> 172.21.15.79:0/738353347 conn(0x55fffb4606b0 msgr2=0x55fffb461850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:14.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.067+0000 7fc2acdb8740 1 -- 172.21.15.79:0/738353347 shutdown_connections 2024-08-20T01:39:14.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.067+0000 7fc2acdb8740 1 -- 172.21.15.79:0/738353347 wait complete. 2024-08-20T01:39:14.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.068+0000 7fc2acdb8740 1 -- start start 2024-08-20T01:39:14.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.068+0000 7fc2acdb8740 1 Processor -- start 2024-08-20T01:39:14.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.068+0000 7fc2acdb8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fffb462880 0x55fffb46c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:14.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.068+0000 7fc2acdb8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fffb4631a0 0x55fffb46c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:14.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.068+0000 7fc2acdb8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fffb46f130 0x55fffb46cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:14.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.068+0000 7fc2acdb8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fffb22b700 con 0x55fffb4631a0 2024-08-20T01:39:14.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.068+0000 7fc2acdb8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55fffb34f810 con 0x55fffb462880 2024-08-20T01:39:14.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.068+0000 7fc2acdb8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55fffb471de0 con 0x55fffb46f130 2024-08-20T01:39:14.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.068+0000 7fc2acdb8740 10 client.0 _ll_register_callbacks cb 0x55fffb3c2700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:14.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.068+0000 7fc2a37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fffb4631a0 0x55fffb46c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:14.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.068+0000 7fc2a37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fffb4631a0 0x55fffb46c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40578/0 (socket says 172.21.15.79:40578) 2024-08-20T01:39:14.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.068+0000 7fc2a37fe640 1 -- 172.21.15.79:0/2357213233 learned_addr learned my addr 172.21.15.79:0/2357213233 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:14.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.068+0000 7fc2a3fff640 1 --2- 172.21.15.79:0/2357213233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fffb462880 0x55fffb46c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:14.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.069+0000 7fc2a8f5c640 1 --2- 172.21.15.79:0/2357213233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fffb46f130 0x55fffb46cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:14.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.069+0000 7fc2a37fe640 1 -- 172.21.15.79:0/2357213233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fffb46f130 msgr2=0x55fffb46cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:14.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.069+0000 7fc2a37fe640 1 --2- 172.21.15.79:0/2357213233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fffb46f130 0x55fffb46cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:14.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.069+0000 7fc2a37fe640 1 -- 172.21.15.79:0/2357213233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fffb462880 msgr2=0x55fffb46c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:14.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.069+0000 7fc2a37fe640 1 --2- 172.21.15.79:0/2357213233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fffb462880 0x55fffb46c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:14.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.069+0000 7fc2a37fe640 1 -- 172.21.15.79:0/2357213233 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fffb47b140 con 0x55fffb4631a0 2024-08-20T01:39:14.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.069+0000 7fc2a37fe640 1 --2- 172.21.15.79:0/2357213233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fffb4631a0 0x55fffb46c5a0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fc298012450 tx=0x7fc298012910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc523a6603a9e1d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:14.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.069+0000 7fc2837fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:39:14.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.069+0000 7fc2837fe640 1 -- 172.21.15.79:0/2357213233 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc29801f060 con 0x55fffb4631a0 2024-08-20T01:39:14.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.069+0000 7fc2837fe640 1 -- 172.21.15.79:0/2357213233 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc298010960 con 0x55fffb4631a0 2024-08-20T01:39:14.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.069+0000 7fc2acdb8740 1 -- 172.21.15.79:0/2357213233 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fffb378150 con 0x55fffb4631a0 2024-08-20T01:39:14.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.069+0000 7fc2837fe640 1 -- 172.21.15.79:0/2357213233 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fc298010b60 con 0x55fffb4631a0 2024-08-20T01:39:14.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.069+0000 7fc2acdb8740 10 client.16245 fetch_fsmap learned FSMap version 33 2024-08-20T01:39:14.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.069+0000 7fc2acdb8740 1 -- 172.21.15.79:0/2357213233 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55fffb47db30 con 0x55fffb4631a0 2024-08-20T01:39:14.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.070+0000 7fc2837fe640 1 -- 172.21.15.79:0/2357213233 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55fffb378150 con 0x55fffb4631a0 2024-08-20T01:39:14.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.070+0000 7fc2837fe640 1 -- 172.21.15.79:0/2357213233 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7fc298019030 con 0x55fffb4631a0 2024-08-20T01:39:14.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.070+0000 7fc2acdb8740 10 client.16245 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:39:14.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.070+0000 7fc2acdb8740 10 client.16245 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:39:14.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.070+0000 7fc2acdb8740 20 client.16245 populate_metadata read hostname 'smithi079' 2024-08-20T01:39:14.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.070+0000 7fc2acdb8740 1 --2- 172.21.15.79:0/2357213233 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55fffb47eff0 0x55fffb481460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:14.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.070+0000 7fc2acdb8740 4 client.16245 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:39:14.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.070+0000 7fc2acdb8740 1 -- 172.21.15.79:0/2357213233 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fffb3db880 con 0x55fffb47eff0 2024-08-20T01:39:14.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.070+0000 7fc2a3fff640 1 --2- 172.21.15.79:0/2357213233 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55fffb47eff0 0x55fffb481460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:14.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.071+0000 7fc2837fe640 10 client.16245 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:39:14.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.071+0000 7fc2a3fff640 1 --2- 172.21.15.79:0/2357213233 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55fffb47eff0 0x55fffb481460 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4b20350f327aee2 server_cookie=7bdd4d6c8c98ae29 in_seq=0 out_seq=0 2024-08-20T01:39:14.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.072+0000 7fc2837fe640 1 -- 172.21.15.79:0/2357213233 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fffb3db880 con 0x55fffb47eff0 2024-08-20T01:39:14.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.072+0000 7fc2837fe640 10 client.16245 handle_command_reply: tid=0 2024-08-20T01:39:14.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.072+0000 7fc2acdb8740 1 client.16245 shutdown 2024-08-20T01:39:14.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.072+0000 7fc2acdb8740 1 -- 172.21.15.79:0/2357213233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fffb4631a0 msgr2=0x55fffb46c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:14.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.072+0000 7fc2acdb8740 1 --2- 172.21.15.79:0/2357213233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fffb4631a0 0x55fffb46c5a0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fc298012450 tx=0x7fc298012910 comp rx=0 tx=0).stop 2024-08-20T01:39:14.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.072+0000 7fc2acdb8740 1 -- 172.21.15.79:0/2357213233 shutdown_connections 2024-08-20T01:39:14.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.072+0000 7fc2acdb8740 1 --2- 172.21.15.79:0/2357213233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fffb46f130 0x55fffb46cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:14.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.072+0000 7fc2acdb8740 1 --2- 172.21.15.79:0/2357213233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fffb4631a0 0x55fffb46c5a0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:14.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.072+0000 7fc2acdb8740 1 --2- 172.21.15.79:0/2357213233 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55fffb47eff0 0x55fffb481460 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:14.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.072+0000 7fc2acdb8740 1 --2- 172.21.15.79:0/2357213233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fffb462880 0x55fffb46c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:14.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.072+0000 7fc2837fe640 0 client.16245 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:39:14.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.072+0000 7fc2acdb8740 1 -- 172.21.15.79:0/2357213233 >> 172.21.15.79:0/2357213233 conn(0x55fffb4606b0 msgr2=0x55fffb466250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:14.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.072+0000 7fc2acdb8740 1 -- 172.21.15.79:0/2357213233 shutdown_connections 2024-08-20T01:39:14.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.072+0000 7fc2acdb8740 1 -- 172.21.15.79:0/2357213233 wait complete. 2024-08-20T01:39:14.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.072+0000 7fc2acdb8740 20 client.16245 trim_cache size 0 max 16384 2024-08-20T01:39:14.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.088+0000 7fc2acdb8740 1 Processor -- start 2024-08-20T01:39:14.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.088+0000 7fc2acdb8740 1 -- start start 2024-08-20T01:39:14.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.088+0000 7fc2acdb8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fffb462880 0x55fffb486dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:14.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.088+0000 7fc2acdb8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fffb4631a0 0x55fffb487300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:14.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.088+0000 7fc2acdb8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fffb46f130 0x55fffb46d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:14.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.088+0000 7fc2acdb8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a41b0190 con 0x55fffb46f130 2024-08-20T01:39:14.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.088+0000 7fc2acdb8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a41b1e20 con 0x55fffb462880 2024-08-20T01:39:14.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.088+0000 7fc2acdb8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a41b0860 con 0x55fffb4631a0 2024-08-20T01:39:14.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.088+0000 7fc2a8f5c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fffb46f130 0x55fffb46d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:14.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.088+0000 7fc2a8f5c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fffb46f130 0x55fffb46d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40594/0 (socket says 172.21.15.79:40594) 2024-08-20T01:39:14.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.088+0000 7fc2a8f5c640 1 -- 172.21.15.79:0/1915878152 learned_addr learned my addr 172.21.15.79:0/1915878152 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:14.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.088+0000 7fc2a37fe640 1 --2- 172.21.15.79:0/1915878152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fffb4631a0 0x55fffb487300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:14.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.088+0000 7fc2a3fff640 1 --2- 172.21.15.79:0/1915878152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fffb462880 0x55fffb486dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:14.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.089+0000 7fc2a8f5c640 1 -- 172.21.15.79:0/1915878152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fffb4631a0 msgr2=0x55fffb487300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:14.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.089+0000 7fc2a8f5c640 1 --2- 172.21.15.79:0/1915878152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fffb4631a0 0x55fffb487300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:14.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.089+0000 7fc2a8f5c640 1 -- 172.21.15.79:0/1915878152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fffb462880 msgr2=0x55fffb486dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:14.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.089+0000 7fc2a8f5c640 1 --2- 172.21.15.79:0/1915878152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fffb462880 0x55fffb486dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:14.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.089+0000 7fc2a8f5c640 1 -- 172.21.15.79:0/1915878152 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fffb461130 con 0x55fffb46f130 2024-08-20T01:39:14.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.089+0000 7fc2a8f5c640 1 --2- 172.21.15.79:0/1915878152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fffb46f130 0x55fffb46d690 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fc29c02ade0 tx=0x7fc29c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=502c076d34884557 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:14.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.089+0000 7fc289ffb640 1 -- 172.21.15.79:0/1915878152 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc29c04a040 con 0x55fffb46f130 2024-08-20T01:39:14.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.089+0000 7fc289ffb640 1 -- 172.21.15.79:0/1915878152 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc29c036050 con 0x55fffb46f130 2024-08-20T01:39:14.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.089+0000 7fc289ffb640 1 -- 172.21.15.79:0/1915878152 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc29c004040 con 0x55fffb46f130 2024-08-20T01:39:14.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.090+0000 7fc2acdb8740 1 -- 172.21.15.79:0/1915878152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fffb46f130 msgr2=0x55fffb46d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:14.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.090+0000 7fc2acdb8740 1 --2- 172.21.15.79:0/1915878152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fffb46f130 0x55fffb46d690 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fc29c02ade0 tx=0x7fc29c051000 comp rx=0 tx=0).stop 2024-08-20T01:39:14.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.090+0000 7fc2acdb8740 1 -- 172.21.15.79:0/1915878152 shutdown_connections 2024-08-20T01:39:14.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.090+0000 7fc2acdb8740 1 --2- 172.21.15.79:0/1915878152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fffb46f130 0x55fffb46d690 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:14.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.090+0000 7fc2acdb8740 1 --2- 172.21.15.79:0/1915878152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fffb4631a0 0x55fffb487300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:14.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.090+0000 7fc2acdb8740 1 --2- 172.21.15.79:0/1915878152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fffb462880 0x55fffb486dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:14.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.090+0000 7fc2acdb8740 1 -- 172.21.15.79:0/1915878152 >> 172.21.15.79:0/1915878152 conn(0x55fffb4606b0 msgr2=0x55fffb4672e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:14.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.090+0000 7fc2acdb8740 1 -- 172.21.15.79:0/1915878152 shutdown_connections 2024-08-20T01:39:14.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.090+0000 7fc2acdb8740 1 -- 172.21.15.79:0/1915878152 wait complete. 2024-08-20T01:39:14.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.091+0000 7fc2acdb8740 1 -- start start 2024-08-20T01:39:14.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.091+0000 7fc2acdb8740 1 Processor -- start 2024-08-20T01:39:14.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.091+0000 7fc2acdb8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fffb462880 0x55fffb477410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:14.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.091+0000 7fc2acdb8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fffb4631a0 0x55fffb477990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:14.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.091+0000 7fc2acdb8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fffb46f130 0x55fffb472b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:14.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.091+0000 7fc2acdb8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a41b1690 con 0x55fffb4631a0 2024-08-20T01:39:14.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.091+0000 7fc2acdb8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a41b0f30 con 0x55fffb462880 2024-08-20T01:39:14.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.091+0000 7fc2acdb8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a41ae170 con 0x55fffb46f130 2024-08-20T01:39:14.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.091+0000 7fc2acdb8740 10 client.0 _ll_register_callbacks cb 0x7fc29800b840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:14.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.091+0000 7fc2a37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fffb4631a0 0x55fffb477990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:14.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.091+0000 7fc2a37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fffb4631a0 0x55fffb477990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40606/0 (socket says 172.21.15.79:40606) 2024-08-20T01:39:14.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.091+0000 7fc2a37fe640 1 -- 172.21.15.79:0/501276514 learned_addr learned my addr 172.21.15.79:0/501276514 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:14.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.091+0000 7fc2a3fff640 1 --2- 172.21.15.79:0/501276514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fffb462880 0x55fffb477410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:14.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.091+0000 7fc2a8f5c640 1 --2- 172.21.15.79:0/501276514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fffb46f130 0x55fffb472b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:14.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.092+0000 7fc2a37fe640 1 -- 172.21.15.79:0/501276514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fffb46f130 msgr2=0x55fffb472b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:14.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.092+0000 7fc2a37fe640 1 --2- 172.21.15.79:0/501276514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fffb46f130 0x55fffb472b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:14.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.092+0000 7fc2a37fe640 1 -- 172.21.15.79:0/501276514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fffb462880 msgr2=0x55fffb477410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:14.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.092+0000 7fc2a37fe640 1 --2- 172.21.15.79:0/501276514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fffb462880 0x55fffb477410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:14.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.092+0000 7fc2a37fe640 1 -- 172.21.15.79:0/501276514 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fffb466dd0 con 0x55fffb4631a0 2024-08-20T01:39:14.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.092+0000 7fc2a37fe640 1 --2- 172.21.15.79:0/501276514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fffb4631a0 0x55fffb477990 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fc29800bb60 tx=0x7fc29800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad657ecb0f577c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:14.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.092+0000 7fc2837fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:39:14.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.092+0000 7fc2837fe640 1 -- 172.21.15.79:0/501276514 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc29802a040 con 0x55fffb4631a0 2024-08-20T01:39:14.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.092+0000 7fc2837fe640 1 -- 172.21.15.79:0/501276514 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc298010760 con 0x55fffb4631a0 2024-08-20T01:39:14.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.092+0000 7fc2acdb8740 1 -- 172.21.15.79:0/501276514 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc29c036050 con 0x55fffb4631a0 2024-08-20T01:39:14.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.092+0000 7fc2837fe640 1 -- 172.21.15.79:0/501276514 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fc298010960 con 0x55fffb4631a0 2024-08-20T01:39:14.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.092+0000 7fc2acdb8740 10 client.16251 fetch_fsmap learned FSMap version 33 2024-08-20T01:39:14.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.092+0000 7fc2acdb8740 1 -- 172.21.15.79:0/501276514 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55fffb4e9960 con 0x55fffb4631a0 2024-08-20T01:39:14.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.093+0000 7fc2837fe640 1 -- 172.21.15.79:0/501276514 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc29c036050 con 0x55fffb4631a0 2024-08-20T01:39:14.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.093+0000 7fc2837fe640 1 -- 172.21.15.79:0/501276514 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7fc29802d020 con 0x55fffb4631a0 2024-08-20T01:39:14.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.093+0000 7fc2acdb8740 10 client.16251 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:39:14.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.093+0000 7fc2acdb8740 10 client.16251 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:39:14.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.093+0000 7fc2acdb8740 20 client.16251 populate_metadata read hostname 'smithi079' 2024-08-20T01:39:14.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.093+0000 7fc2acdb8740 1 --2- 172.21.15.79:0/501276514 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55fffb4ea1a0 0x55fffb4ec5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:14.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.093+0000 7fc2acdb8740 4 client.16251 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:39:14.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.093+0000 7fc2acdb8740 1 -- 172.21.15.79:0/501276514 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fffb3d7320 con 0x55fffb4ea1a0 2024-08-20T01:39:14.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.093+0000 7fc2a3fff640 1 --2- 172.21.15.79:0/501276514 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55fffb4ea1a0 0x55fffb4ec5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:14.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.094+0000 7fc2837fe640 10 client.16251 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:39:14.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.094+0000 7fc2a3fff640 1 --2- 172.21.15.79:0/501276514 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55fffb4ea1a0 0x55fffb4ec5c0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c0d62fbe585b5d36 server_cookie=68f858c9ed3abc4f in_seq=0 out_seq=0 2024-08-20T01:39:14.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.094+0000 7fc2837fe640 1 -- 172.21.15.79:0/501276514 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fffb3d7320 con 0x55fffb4ea1a0 2024-08-20T01:39:14.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.094+0000 7fc2837fe640 10 client.16251 handle_command_reply: tid=0 2024-08-20T01:39:14.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.094+0000 7fc2acdb8740 1 client.16251 shutdown 2024-08-20T01:39:14.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.094+0000 7fc2acdb8740 1 -- 172.21.15.79:0/501276514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fffb4631a0 msgr2=0x55fffb477990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:14.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.094+0000 7fc2acdb8740 1 --2- 172.21.15.79:0/501276514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fffb4631a0 0x55fffb477990 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fc29800bb60 tx=0x7fc29800b330 comp rx=0 tx=0).stop 2024-08-20T01:39:14.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.094+0000 7fc2acdb8740 1 -- 172.21.15.79:0/501276514 shutdown_connections 2024-08-20T01:39:14.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.094+0000 7fc2acdb8740 1 --2- 172.21.15.79:0/501276514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fffb46f130 0x55fffb472b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:14.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.094+0000 7fc2acdb8740 1 --2- 172.21.15.79:0/501276514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fffb4631a0 0x55fffb477990 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:14.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.094+0000 7fc2acdb8740 1 --2- 172.21.15.79:0/501276514 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55fffb4ea1a0 0x55fffb4ec5c0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:14.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.094+0000 7fc2acdb8740 1 --2- 172.21.15.79:0/501276514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fffb462880 0x55fffb477410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:14.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.094+0000 7fc2837fe640 0 client.16251 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:39:14.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.094+0000 7fc2acdb8740 1 -- 172.21.15.79:0/501276514 >> 172.21.15.79:0/501276514 conn(0x55fffb4606b0 msgr2=0x55fffb46d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:14.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.094+0000 7fc2acdb8740 1 -- 172.21.15.79:0/501276514 shutdown_connections 2024-08-20T01:39:14.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.094+0000 7fc2acdb8740 1 -- 172.21.15.79:0/501276514 wait complete. 2024-08-20T01:39:14.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.094+0000 7fc2acdb8740 20 client.16251 trim_cache size 0 max 16384 2024-08-20T01:39:14.102 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:39:14.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.095+0000 7fc2aa9bf640 1 -- 172.21.15.79:0/1214674826 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc28c0b3c50 msgr2=0x7fc28c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:14.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.095+0000 7fc2aa9bf640 1 --2- 172.21.15.79:0/1214674826 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc28c0b3c50 0x7fc28c0b6110 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc29c009a60 tx=0x7fc29c0308c0 comp rx=0 tx=0).stop 2024-08-20T01:39:14.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.095+0000 7fc2aa9bf640 1 -- 172.21.15.79:0/1214674826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2a4102ad0 msgr2=0x7fc2a419b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:14.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.095+0000 7fc2aa9bf640 1 --2- 172.21.15.79:0/1214674826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2a4102ad0 0x7fc2a419b0d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fc29400b4a0 tx=0x7fc29400b960 comp rx=0 tx=0).stop 2024-08-20T01:39:14.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.095+0000 7fc2aa9bf640 1 -- 172.21.15.79:0/1214674826 shutdown_connections 2024-08-20T01:39:14.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.095+0000 7fc2aa9bf640 1 --2- 172.21.15.79:0/1214674826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2a4108e60 0x7fc2a41a09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:14.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.095+0000 7fc2aa9bf640 1 --2- 172.21.15.79:0/1214674826 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc28c0b3c50 0x7fc28c0b6110 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:14.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.095+0000 7fc2aa9bf640 1 --2- 172.21.15.79:0/1214674826 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2a41084e0 0x7fc2a419b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:14.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.095+0000 7fc2aa9bf640 1 --2- 172.21.15.79:0/1214674826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2a4102ad0 0x7fc2a419b0d0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:14.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.095+0000 7fc2aa9bf640 1 -- 172.21.15.79:0/1214674826 >> 172.21.15.79:0/1214674826 conn(0x7fc2a40fe540 msgr2=0x7fc2a4105ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:14.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.095+0000 7fc2aa9bf640 1 -- 172.21.15.79:0/1214674826 shutdown_connections 2024-08-20T01:39:14.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:14.095+0000 7fc2aa9bf640 1 -- 172.21.15.79:0/1214674826 wait complete. 2024-08-20T01:39:14.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:13 smithi175 ceph-mon[22392]: pgmap v404: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 29 MiB/s wr, 21 op/s 2024-08-20T01:39:14.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:13 smithi081 ceph-mon[22209]: pgmap v404: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 29 MiB/s wr, 21 op/s 2024-08-20T01:39:14.986 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T01:39:15.268 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:39:15.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.784+0000 7f43e4445640 1 -- 172.21.15.79:0/1017802577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43dc1039a0 msgr2=0x7f43dc103d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:15.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.784+0000 7f43e4445640 1 --2- 172.21.15.79:0/1017802577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43dc1039a0 0x7f43dc103d80 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f43d8009900 tx=0x7f43d802a410 comp rx=0 tx=0).stop 2024-08-20T01:39:15.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.784+0000 7f43e4445640 1 -- 172.21.15.79:0/1017802577 shutdown_connections 2024-08-20T01:39:15.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.784+0000 7f43e4445640 1 --2- 172.21.15.79:0/1017802577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43dc10ce00 0x7f43dc10f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:15.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.784+0000 7f43e4445640 1 --2- 172.21.15.79:0/1017802577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43dc1042c0 0x7f43dc10c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:15.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.784+0000 7f43e4445640 1 --2- 172.21.15.79:0/1017802577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43dc1039a0 0x7f43dc103d80 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:15.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.784+0000 7f43e4445640 1 -- 172.21.15.79:0/1017802577 >> 172.21.15.79:0/1017802577 conn(0x7f43dc0fd400 msgr2=0x7f43dc0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:15.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.784+0000 7f43e4445640 1 -- 172.21.15.79:0/1017802577 shutdown_connections 2024-08-20T01:39:15.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.784+0000 7f43e4445640 1 -- 172.21.15.79:0/1017802577 wait complete. 2024-08-20T01:39:15.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.785+0000 7f43e4445640 1 Processor -- start 2024-08-20T01:39:15.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.785+0000 7f43e4445640 1 -- start start 2024-08-20T01:39:15.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.785+0000 7f43e4445640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43dc1039a0 0x7f43dc101650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:15.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.785+0000 7f43e4445640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43dc1042c0 0x7f43dc101b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:15.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.785+0000 7f43e4445640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43dc10ce00 0x7f43dc1020d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:15.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.785+0000 7f43e4445640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc112920 con 0x7f43dc10ce00 2024-08-20T01:39:15.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.785+0000 7f43e4445640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc1127a0 con 0x7f43dc1042c0 2024-08-20T01:39:15.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.785+0000 7f43e4445640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc112aa0 con 0x7f43dc1039a0 2024-08-20T01:39:15.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.785+0000 7f43e29e2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43dc10ce00 0x7f43dc1020d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:15.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.785+0000 7f43e29e2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43dc10ce00 0x7f43dc1020d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40620/0 (socket says 172.21.15.79:40620) 2024-08-20T01:39:15.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.785+0000 7f43e29e2640 1 -- 172.21.15.79:0/793312240 learned_addr learned my addr 172.21.15.79:0/793312240 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:15.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.786+0000 7f43e21e1640 1 --2- 172.21.15.79:0/793312240 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43dc1039a0 0x7f43dc101650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:15.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.786+0000 7f43e19e0640 1 --2- 172.21.15.79:0/793312240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43dc1042c0 0x7f43dc101b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:15.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.786+0000 7f43e29e2640 1 -- 172.21.15.79:0/793312240 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43dc1039a0 msgr2=0x7f43dc101650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:15.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.786+0000 7f43e29e2640 1 --2- 172.21.15.79:0/793312240 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43dc1039a0 0x7f43dc101650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:15.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.786+0000 7f43e29e2640 1 -- 172.21.15.79:0/793312240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43dc1042c0 msgr2=0x7f43dc101b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:15.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.786+0000 7f43e29e2640 1 --2- 172.21.15.79:0/793312240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43dc1042c0 0x7f43dc101b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:15.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.786+0000 7f43e29e2640 1 -- 172.21.15.79:0/793312240 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43dc1a72b0 con 0x7f43dc10ce00 2024-08-20T01:39:15.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.786+0000 7f43e19e0640 1 --2- 172.21.15.79:0/793312240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43dc1042c0 0x7f43dc101b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:39:15.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.786+0000 7f43e21e1640 1 --2- 172.21.15.79:0/793312240 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43dc1039a0 0x7f43dc101650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:39:15.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.786+0000 7f43e29e2640 1 --2- 172.21.15.79:0/793312240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43dc10ce00 0x7f43dc1020d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f43d400eaa0 tx=0x7f43d400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:15.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.786+0000 7f43d37fe640 1 -- 172.21.15.79:0/793312240 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d400cdb0 con 0x7f43dc10ce00 2024-08-20T01:39:15.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.786+0000 7f43e4445640 1 -- 172.21.15.79:0/793312240 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43dc1a75a0 con 0x7f43dc10ce00 2024-08-20T01:39:15.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.786+0000 7f43d37fe640 1 -- 172.21.15.79:0/793312240 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f43d4005020 con 0x7f43dc10ce00 2024-08-20T01:39:15.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.786+0000 7f43d37fe640 1 -- 172.21.15.79:0/793312240 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d40116d0 con 0x7f43dc10ce00 2024-08-20T01:39:15.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.786+0000 7f43e4445640 1 -- 172.21.15.79:0/793312240 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43dc1a7ae0 con 0x7f43dc10ce00 2024-08-20T01:39:15.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.789+0000 7f43e683e740 1 Processor -- start 2024-08-20T01:39:15.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.789+0000 7f43d37fe640 1 -- 172.21.15.79:0/793312240 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f43d40051d0 con 0x7f43dc10ce00 2024-08-20T01:39:15.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.790+0000 7f43e683e740 1 -- start start 2024-08-20T01:39:15.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.790+0000 7f43e683e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e5b5a6880 0x558e5b5a6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:15.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.790+0000 7f43e683e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e5b5a71a0 0x558e5b5b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:15.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.790+0000 7f43e683e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e5b5b3130 0x558e5b5b5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:15.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.790+0000 7f43e683e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558e5b51d930 con 0x558e5b5a6880 2024-08-20T01:39:15.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.790+0000 7f43e683e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558e5b50ce30 con 0x558e5b5b3130 2024-08-20T01:39:15.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.790+0000 7f43e683e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558e5b510e70 con 0x558e5b5a71a0 2024-08-20T01:39:15.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.790+0000 7f43e19e0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e5b5a6880 0x558e5b5a6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:15.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.790+0000 7f43e19e0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e5b5a6880 0x558e5b5a6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40630/0 (socket says 172.21.15.79:40630) 2024-08-20T01:39:15.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.790+0000 7f43e19e0640 1 -- 172.21.15.79:0/1006267181 learned_addr learned my addr 172.21.15.79:0/1006267181 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:15.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.790+0000 7f43e21e1640 1 --2- 172.21.15.79:0/1006267181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e5b5a71a0 0x558e5b5b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:15.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.791+0000 7f43e19e0640 1 -- 172.21.15.79:0/1006267181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e5b5a71a0 msgr2=0x558e5b5b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:15.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.791+0000 7f43e19e0640 1 --2- 172.21.15.79:0/1006267181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e5b5a71a0 0x558e5b5b2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:15.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.791+0000 7f43e19e0640 1 -- 172.21.15.79:0/1006267181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e5b5b3130 msgr2=0x558e5b5b5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:15.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.791+0000 7f43e19e0640 1 --2- 172.21.15.79:0/1006267181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e5b5b3130 0x558e5b5b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:15.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.791+0000 7f43e19e0640 1 -- 172.21.15.79:0/1006267181 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e5b26c650 con 0x558e5b5a6880 2024-08-20T01:39:15.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.791+0000 7f43d37fe640 1 --2- 172.21.15.79:0/793312240 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f43c80b3bd0 0x7f43c80b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:15.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.791+0000 7f43e21e1640 1 --2- 172.21.15.79:0/1006267181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e5b5a71a0 0x558e5b5b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:39:15.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.791+0000 7f43e21e1640 1 --2- 172.21.15.79:0/793312240 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f43c80b3bd0 0x7f43c80b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:15.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.791+0000 7f43d37fe640 1 -- 172.21.15.79:0/793312240 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f43d40e3ee0 con 0x7f43dc10ce00 2024-08-20T01:39:15.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.791+0000 7f43e19e0640 1 --2- 172.21.15.79:0/1006267181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e5b5a6880 0x558e5b5a6c60 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f43cc00bd60 tx=0x7f43cc011750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8970407a2b7369c9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:15.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.791+0000 7f43d0de6640 1 -- 172.21.15.79:0/1006267181 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43cc016070 con 0x558e5b5a6880 2024-08-20T01:39:15.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.791+0000 7f43d0de6640 1 -- 172.21.15.79:0/1006267181 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f43cc00be50 con 0x558e5b5a6880 2024-08-20T01:39:15.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.791+0000 7f43d0de6640 1 -- 172.21.15.79:0/1006267181 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43cc01a640 con 0x558e5b5a6880 2024-08-20T01:39:15.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.792+0000 7f43e683e740 1 -- 172.21.15.79:0/1006267181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e5b5a6880 msgr2=0x558e5b5a6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:15.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.792+0000 7f43e21e1640 1 --2- 172.21.15.79:0/793312240 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f43c80b3bd0 0x7f43c80b6090 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f43d8000c00 tx=0x7f43d80058b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:15.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.792+0000 7f43e683e740 1 --2- 172.21.15.79:0/1006267181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e5b5a6880 0x558e5b5a6c60 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f43cc00bd60 tx=0x7f43cc011750 comp rx=0 tx=0).stop 2024-08-20T01:39:15.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.792+0000 7f43e683e740 1 -- 172.21.15.79:0/1006267181 shutdown_connections 2024-08-20T01:39:15.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.792+0000 7f43e683e740 1 --2- 172.21.15.79:0/1006267181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e5b5b3130 0x558e5b5b5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:15.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.792+0000 7f43e683e740 1 --2- 172.21.15.79:0/1006267181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e5b5a71a0 0x558e5b5b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:15.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.792+0000 7f43e683e740 1 --2- 172.21.15.79:0/1006267181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e5b5a6880 0x558e5b5a6c60 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:15.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.792+0000 7f43e683e740 1 -- 172.21.15.79:0/1006267181 >> 172.21.15.79:0/1006267181 conn(0x558e5b5a46b0 msgr2=0x558e5b5a5850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:15.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.792+0000 7f43e683e740 1 -- 172.21.15.79:0/1006267181 shutdown_connections 2024-08-20T01:39:15.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.792+0000 7f43e683e740 1 -- 172.21.15.79:0/1006267181 wait complete. 2024-08-20T01:39:15.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.792+0000 7f43e683e740 1 -- start start 2024-08-20T01:39:15.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.792+0000 7f43e683e740 1 Processor -- start 2024-08-20T01:39:15.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.793+0000 7f43e683e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e5b5a6880 0x558e5b5b0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:15.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.793+0000 7f43e683e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e5b5a71a0 0x558e5b5b0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:15.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.793+0000 7f43e683e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e5b5b3130 0x558e5b5b0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:15.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.793+0000 7f43e683e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558e5b36f700 con 0x558e5b5b3130 2024-08-20T01:39:15.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.793+0000 7f43e683e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558e5b493810 con 0x558e5b5a71a0 2024-08-20T01:39:15.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.793+0000 7f43e683e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558e5b5b5de0 con 0x558e5b5a6880 2024-08-20T01:39:15.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.793+0000 7f43e683e740 10 client.0 _ll_register_callbacks cb 0x558e5b506700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:15.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.793+0000 7f43e29e2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e5b5b3130 0x558e5b5b0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:15.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.793+0000 7f43e29e2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e5b5b3130 0x558e5b5b0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40632/0 (socket says 172.21.15.79:40632) 2024-08-20T01:39:15.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.793+0000 7f43e29e2640 1 -- 172.21.15.79:0/4252363133 learned_addr learned my addr 172.21.15.79:0/4252363133 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:15.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.793+0000 7f43e21e1640 1 --2- 172.21.15.79:0/4252363133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e5b5a6880 0x558e5b5b0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:15.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.793+0000 7f43e19e0640 1 --2- 172.21.15.79:0/4252363133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e5b5a71a0 0x558e5b5b0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:15.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.793+0000 7f43e29e2640 1 -- 172.21.15.79:0/4252363133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e5b5a6880 msgr2=0x558e5b5b0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:15.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.793+0000 7f43e29e2640 1 --2- 172.21.15.79:0/4252363133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e5b5a6880 0x558e5b5b0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:15.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.793+0000 7f43e29e2640 1 -- 172.21.15.79:0/4252363133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e5b5a71a0 msgr2=0x558e5b5b0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:15.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.793+0000 7f43e29e2640 1 --2- 172.21.15.79:0/4252363133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e5b5a71a0 0x558e5b5b0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:15.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.793+0000 7f43e29e2640 1 -- 172.21.15.79:0/4252363133 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e5b5bf1e0 con 0x558e5b5b3130 2024-08-20T01:39:15.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.793+0000 7f43e19e0640 1 --2- 172.21.15.79:0/4252363133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e5b5a71a0 0x558e5b5b0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:39:15.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.793+0000 7f43e29e2640 1 --2- 172.21.15.79:0/4252363133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e5b5b3130 0x558e5b5b0b90 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f43d40a6e60 tx=0x7f43d40ab5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a2c6c54ac69ba4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:15.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.793+0000 7f43c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:39:15.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.794+0000 7f43c5ffb640 1 -- 172.21.15.79:0/4252363133 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d40ae070 con 0x558e5b5b3130 2024-08-20T01:39:15.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.794+0000 7f43c5ffb640 1 -- 172.21.15.79:0/4252363133 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f43d40aa040 con 0x558e5b5b3130 2024-08-20T01:39:15.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.794+0000 7f43e683e740 1 -- 172.21.15.79:0/4252363133 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558e5b4bc150 con 0x558e5b5b3130 2024-08-20T01:39:15.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.794+0000 7f43c5ffb640 1 -- 172.21.15.79:0/4252363133 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f43d401f040 con 0x558e5b5b3130 2024-08-20T01:39:15.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.794+0000 7f43e683e740 10 client.16263 fetch_fsmap learned FSMap version 33 2024-08-20T01:39:15.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.794+0000 7f43e683e740 1 -- 172.21.15.79:0/4252363133 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x558e5b5c1bf0 con 0x558e5b5b3130 2024-08-20T01:39:15.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.794+0000 7f43c5ffb640 1 -- 172.21.15.79:0/4252363133 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f43d406b020 con 0x558e5b5b3130 2024-08-20T01:39:15.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.794+0000 7f43c5ffb640 1 -- 172.21.15.79:0/4252363133 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7f43d400f040 con 0x558e5b5b3130 2024-08-20T01:39:15.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.794+0000 7f43e683e740 10 client.16263 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:39:15.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.794+0000 7f43e683e740 10 client.16263 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:39:15.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.794+0000 7f43e683e740 20 client.16263 populate_metadata read hostname 'smithi079' 2024-08-20T01:39:15.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.794+0000 7f43e683e740 1 --2- 172.21.15.79:0/4252363133 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558e5b5c31f0 0x558e5b5c5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:15.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.794+0000 7f43e683e740 4 client.16263 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:39:15.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.794+0000 7f43e683e740 1 -- 172.21.15.79:0/4252363133 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e5b51f880 con 0x558e5b5c31f0 2024-08-20T01:39:15.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.795+0000 7f43e21e1640 1 --2- 172.21.15.79:0/4252363133 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558e5b5c31f0 0x558e5b5c5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:15.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.795+0000 7f43c5ffb640 10 client.16263 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:39:15.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.795+0000 7f43e21e1640 1 --2- 172.21.15.79:0/4252363133 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558e5b5c31f0 0x558e5b5c5650 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ea3ccb58d1c6ad2 server_cookie=7a0947ee867f9bdd in_seq=0 out_seq=0 2024-08-20T01:39:15.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.796+0000 7f43c5ffb640 1 -- 172.21.15.79:0/4252363133 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558e5b51f880 con 0x558e5b5c31f0 2024-08-20T01:39:15.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.796+0000 7f43c5ffb640 10 client.16263 handle_command_reply: tid=0 2024-08-20T01:39:15.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.796+0000 7f43e683e740 1 client.16263 shutdown 2024-08-20T01:39:15.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.796+0000 7f43e683e740 1 -- 172.21.15.79:0/4252363133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e5b5b3130 msgr2=0x558e5b5b0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:15.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.796+0000 7f43e683e740 1 --2- 172.21.15.79:0/4252363133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e5b5b3130 0x558e5b5b0b90 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f43d40a6e60 tx=0x7f43d40ab5a0 comp rx=0 tx=0).stop 2024-08-20T01:39:15.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.796+0000 7f43e683e740 1 -- 172.21.15.79:0/4252363133 shutdown_connections 2024-08-20T01:39:15.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.796+0000 7f43e683e740 1 --2- 172.21.15.79:0/4252363133 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558e5b5c31f0 0x558e5b5c5650 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:15.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.796+0000 7f43e683e740 1 --2- 172.21.15.79:0/4252363133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e5b5b3130 0x558e5b5b0b90 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:15.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.796+0000 7f43e683e740 1 --2- 172.21.15.79:0/4252363133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e5b5a71a0 0x558e5b5b0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:15.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.796+0000 7f43e683e740 1 --2- 172.21.15.79:0/4252363133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e5b5a6880 0x558e5b5b0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:15.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.796+0000 7f43c5ffb640 0 client.16263 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:39:15.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.796+0000 7f43e683e740 1 -- 172.21.15.79:0/4252363133 >> 172.21.15.79:0/4252363133 conn(0x558e5b5a46b0 msgr2=0x558e5b5aa220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:15.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.796+0000 7f43e683e740 1 -- 172.21.15.79:0/4252363133 shutdown_connections 2024-08-20T01:39:15.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.796+0000 7f43e683e740 1 -- 172.21.15.79:0/4252363133 wait complete. 2024-08-20T01:39:15.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.796+0000 7f43e683e740 20 client.16263 trim_cache size 0 max 16384 2024-08-20T01:39:15.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.809+0000 7f43e683e740 1 Processor -- start 2024-08-20T01:39:15.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.809+0000 7f43e683e740 1 -- start start 2024-08-20T01:39:15.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.809+0000 7f43e683e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e5b5a6880 0x558e5b5b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:15.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.809+0000 7f43e683e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e5b5a71a0 0x558e5b5af9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:15.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.809+0000 7f43e683e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e5b5b3130 0x558e5b5caf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:15.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.809+0000 7f43e683e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc1b01a0 con 0x558e5b5a6880 2024-08-20T01:39:15.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.809+0000 7f43e683e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc1b1e30 con 0x558e5b5a71a0 2024-08-20T01:39:15.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.809+0000 7f43e683e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc1b0870 con 0x558e5b5b3130 2024-08-20T01:39:15.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.809+0000 7f43e21e1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e5b5a6880 0x558e5b5b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:15.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.809+0000 7f43e21e1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e5b5a6880 0x558e5b5b2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40642/0 (socket says 172.21.15.79:40642) 2024-08-20T01:39:15.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.809+0000 7f43e21e1640 1 -- 172.21.15.79:0/1861151287 learned_addr learned my addr 172.21.15.79:0/1861151287 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:15.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.809+0000 7f43e29e2640 1 --2- 172.21.15.79:0/1861151287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e5b5b3130 0x558e5b5caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:15.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.809+0000 7f43e19e0640 1 --2- 172.21.15.79:0/1861151287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e5b5a71a0 0x558e5b5af9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:15.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.809+0000 7f43e21e1640 1 -- 172.21.15.79:0/1861151287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e5b5b3130 msgr2=0x558e5b5caf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:15.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.810+0000 7f43e21e1640 1 --2- 172.21.15.79:0/1861151287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e5b5b3130 0x558e5b5caf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:15.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.810+0000 7f43e21e1640 1 -- 172.21.15.79:0/1861151287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e5b5a71a0 msgr2=0x558e5b5af9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:15.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.810+0000 7f43e21e1640 1 --2- 172.21.15.79:0/1861151287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e5b5a71a0 0x558e5b5af9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:15.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.810+0000 7f43e21e1640 1 -- 172.21.15.79:0/1861151287 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e5b5a5130 con 0x558e5b5a6880 2024-08-20T01:39:15.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.810+0000 7f43e19e0640 1 --2- 172.21.15.79:0/1861151287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e5b5a71a0 0x558e5b5af9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:39:15.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.810+0000 7f43e21e1640 1 --2- 172.21.15.79:0/1861151287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e5b5a6880 0x558e5b5b2210 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f43d80316d0 tx=0x7f43d803d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93def2c754b0a764 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:15.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.810+0000 7f43c7fff640 1 -- 172.21.15.79:0/1861151287 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d8035050 con 0x558e5b5a6880 2024-08-20T01:39:15.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.810+0000 7f43c7fff640 1 -- 172.21.15.79:0/1861151287 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f43d8054070 con 0x558e5b5a6880 2024-08-20T01:39:15.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.810+0000 7f43c7fff640 1 -- 172.21.15.79:0/1861151287 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d8004900 con 0x558e5b5a6880 2024-08-20T01:39:15.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.811+0000 7f43e683e740 1 -- 172.21.15.79:0/1861151287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e5b5a6880 msgr2=0x558e5b5b2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:15.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.811+0000 7f43e683e740 1 --2- 172.21.15.79:0/1861151287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e5b5a6880 0x558e5b5b2210 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f43d80316d0 tx=0x7f43d803d000 comp rx=0 tx=0).stop 2024-08-20T01:39:15.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.811+0000 7f43e683e740 1 -- 172.21.15.79:0/1861151287 shutdown_connections 2024-08-20T01:39:15.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.811+0000 7f43e683e740 1 --2- 172.21.15.79:0/1861151287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e5b5b3130 0x558e5b5caf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:15.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.811+0000 7f43e683e740 1 --2- 172.21.15.79:0/1861151287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e5b5a71a0 0x558e5b5af9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:15.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.811+0000 7f43e683e740 1 --2- 172.21.15.79:0/1861151287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e5b5a6880 0x558e5b5b2210 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:15.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.811+0000 7f43e683e740 1 -- 172.21.15.79:0/1861151287 >> 172.21.15.79:0/1861151287 conn(0x558e5b5a46b0 msgr2=0x558e5b5b08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:15.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.811+0000 7f43e683e740 1 -- 172.21.15.79:0/1861151287 shutdown_connections 2024-08-20T01:39:15.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.811+0000 7f43e683e740 1 -- 172.21.15.79:0/1861151287 wait complete. 2024-08-20T01:39:15.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.811+0000 7f43e683e740 1 -- start start 2024-08-20T01:39:15.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.811+0000 7f43e683e740 1 Processor -- start 2024-08-20T01:39:15.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.811+0000 7f43e683e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e5b5a6880 0x558e5b5bb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:15.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.812+0000 7f43e683e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e5b5a71a0 0x558e5b5bb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:15.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.812+0000 7f43e683e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e5b5b3130 0x558e5b5b6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:15.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.812+0000 7f43e683e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc1b16a0 con 0x558e5b5a6880 2024-08-20T01:39:15.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.812+0000 7f43e683e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc1b0f40 con 0x558e5b5a71a0 2024-08-20T01:39:15.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.812+0000 7f43e683e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc1ae180 con 0x558e5b5b3130 2024-08-20T01:39:15.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.812+0000 7f43e683e740 10 client.0 _ll_register_callbacks cb 0x7f43d40a6ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:15.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.812+0000 7f43e21e1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e5b5a6880 0x558e5b5bb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:15.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.812+0000 7f43e21e1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e5b5a6880 0x558e5b5bb420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40644/0 (socket says 172.21.15.79:40644) 2024-08-20T01:39:15.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.812+0000 7f43e21e1640 1 -- 172.21.15.79:0/620324814 learned_addr learned my addr 172.21.15.79:0/620324814 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:15.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.812+0000 7f43e29e2640 1 --2- 172.21.15.79:0/620324814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e5b5b3130 0x558e5b5b6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:15.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.812+0000 7f43e19e0640 1 --2- 172.21.15.79:0/620324814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e5b5a71a0 0x558e5b5bb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:15.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.812+0000 7f43e21e1640 1 -- 172.21.15.79:0/620324814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e5b5b3130 msgr2=0x558e5b5b6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:15.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.812+0000 7f43e21e1640 1 --2- 172.21.15.79:0/620324814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e5b5b3130 0x558e5b5b6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:15.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.812+0000 7f43e21e1640 1 -- 172.21.15.79:0/620324814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e5b5a71a0 msgr2=0x558e5b5bb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:15.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.812+0000 7f43e21e1640 1 --2- 172.21.15.79:0/620324814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e5b5a71a0 0x558e5b5bb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:15.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.812+0000 7f43e21e1640 1 -- 172.21.15.79:0/620324814 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e5b5b0fb0 con 0x558e5b5a6880 2024-08-20T01:39:15.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.812+0000 7f43e21e1640 1 --2- 172.21.15.79:0/620324814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e5b5a6880 0x558e5b5bb420 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f43d80057c0 tx=0x7f43d8031490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6113cdfd325b53b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:15.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.812+0000 7f43c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:39:15.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.813+0000 7f43c5ffb640 1 -- 172.21.15.79:0/620324814 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d805c070 con 0x558e5b5a6880 2024-08-20T01:39:15.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.813+0000 7f43c5ffb640 1 -- 172.21.15.79:0/620324814 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f43d8005040 con 0x558e5b5a6880 2024-08-20T01:39:15.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.813+0000 7f43e683e740 1 -- 172.21.15.79:0/620324814 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43d8054070 con 0x558e5b5a6880 2024-08-20T01:39:15.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.813+0000 7f43c5ffb640 1 -- 172.21.15.79:0/620324814 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f43d8068050 con 0x558e5b5a6880 2024-08-20T01:39:15.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.813+0000 7f43e683e740 10 client.16269 fetch_fsmap learned FSMap version 33 2024-08-20T01:39:15.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.813+0000 7f43e683e740 1 -- 172.21.15.79:0/620324814 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x558e5b62da90 con 0x558e5b5a6880 2024-08-20T01:39:15.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.813+0000 7f43c5ffb640 1 -- 172.21.15.79:0/620324814 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f43d8054070 con 0x558e5b5a6880 2024-08-20T01:39:15.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.813+0000 7f43c5ffb640 1 -- 172.21.15.79:0/620324814 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7f43d80035f0 con 0x558e5b5a6880 2024-08-20T01:39:15.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.813+0000 7f43e683e740 10 client.16269 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:39:15.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.813+0000 7f43e683e740 10 client.16269 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:39:15.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.813+0000 7f43e683e740 20 client.16269 populate_metadata read hostname 'smithi079' 2024-08-20T01:39:15.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.813+0000 7f43e683e740 1 --2- 172.21.15.79:0/620324814 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558e5b62e270 0x558e5b630690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:15.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.813+0000 7f43e683e740 4 client.16269 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:39:15.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.813+0000 7f43e683e740 1 -- 172.21.15.79:0/620324814 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558e5b51b320 con 0x558e5b62e270 2024-08-20T01:39:15.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.814+0000 7f43e19e0640 1 --2- 172.21.15.79:0/620324814 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558e5b62e270 0x558e5b630690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:15.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.814+0000 7f43c5ffb640 10 client.16269 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:39:15.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.814+0000 7f43e19e0640 1 --2- 172.21.15.79:0/620324814 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558e5b62e270 0x558e5b630690 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd0ae4ceb83edff0 server_cookie=17b0fb4de9c1e880 in_seq=0 out_seq=0 2024-08-20T01:39:15.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.814+0000 7f43c5ffb640 1 -- 172.21.15.79:0/620324814 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558e5b51b320 con 0x558e5b62e270 2024-08-20T01:39:15.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.814+0000 7f43c5ffb640 10 client.16269 handle_command_reply: tid=0 2024-08-20T01:39:15.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.814+0000 7f43e683e740 1 client.16269 shutdown 2024-08-20T01:39:15.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.814+0000 7f43e683e740 1 -- 172.21.15.79:0/620324814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e5b5a6880 msgr2=0x558e5b5bb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:15.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.814+0000 7f43e683e740 1 --2- 172.21.15.79:0/620324814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e5b5a6880 0x558e5b5bb420 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f43d80057c0 tx=0x7f43d8031490 comp rx=0 tx=0).stop 2024-08-20T01:39:15.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.814+0000 7f43e683e740 1 -- 172.21.15.79:0/620324814 shutdown_connections 2024-08-20T01:39:15.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.814+0000 7f43e683e740 1 --2- 172.21.15.79:0/620324814 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558e5b62e270 0x558e5b630690 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:15.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.815+0000 7f43e683e740 1 --2- 172.21.15.79:0/620324814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e5b5b3130 0x558e5b5b6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:15.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.815+0000 7f43e683e740 1 --2- 172.21.15.79:0/620324814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e5b5a71a0 0x558e5b5bb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:15.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.815+0000 7f43e683e740 1 --2- 172.21.15.79:0/620324814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e5b5a6880 0x558e5b5bb420 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:15.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.815+0000 7f43e683e740 1 -- 172.21.15.79:0/620324814 >> 172.21.15.79:0/620324814 conn(0x558e5b5a46b0 msgr2=0x558e5b5a9910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:15.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.815+0000 7f43c5ffb640 0 client.16269 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:39:15.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.815+0000 7f43e683e740 1 -- 172.21.15.79:0/620324814 shutdown_connections 2024-08-20T01:39:15.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.815+0000 7f43e683e740 1 -- 172.21.15.79:0/620324814 wait complete. 2024-08-20T01:39:15.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.815+0000 7f43e683e740 20 client.16269 trim_cache size 0 max 16384 2024-08-20T01:39:15.851 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:39:15.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.815+0000 7f43e4445640 1 -- 172.21.15.79:0/793312240 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f43c80b3bd0 msgr2=0x7f43c80b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:15.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.815+0000 7f43e4445640 1 --2- 172.21.15.79:0/793312240 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f43c80b3bd0 0x7f43c80b6090 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f43d8000c00 tx=0x7f43d80058b0 comp rx=0 tx=0).stop 2024-08-20T01:39:15.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.815+0000 7f43e4445640 1 -- 172.21.15.79:0/793312240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43dc10ce00 msgr2=0x7f43dc1020d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:15.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.815+0000 7f43e4445640 1 --2- 172.21.15.79:0/793312240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43dc10ce00 0x7f43dc1020d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f43d400eaa0 tx=0x7f43d400ef60 comp rx=0 tx=0).stop 2024-08-20T01:39:15.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.816+0000 7f43e4445640 1 -- 172.21.15.79:0/793312240 shutdown_connections 2024-08-20T01:39:15.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.816+0000 7f43e4445640 1 --2- 172.21.15.79:0/793312240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43dc10ce00 0x7f43dc1020d0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:15.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.816+0000 7f43e4445640 1 --2- 172.21.15.79:0/793312240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43dc1042c0 0x7f43dc101b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:15.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.816+0000 7f43e4445640 1 --2- 172.21.15.79:0/793312240 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f43c80b3bd0 0x7f43c80b6090 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:15.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.816+0000 7f43e4445640 1 --2- 172.21.15.79:0/793312240 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43dc1039a0 0x7f43dc101650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:15.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.816+0000 7f43e4445640 1 -- 172.21.15.79:0/793312240 >> 172.21.15.79:0/793312240 conn(0x7f43dc0fd400 msgr2=0x7f43dc0fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:15.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.816+0000 7f43e4445640 1 -- 172.21.15.79:0/793312240 shutdown_connections 2024-08-20T01:39:15.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:15.816+0000 7f43e4445640 1 -- 172.21.15.79:0/793312240 wait complete. 2024-08-20T01:39:16.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:15 smithi175 ceph-mon[22392]: pgmap v405: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 25 op/s 2024-08-20T01:39:16.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:15 smithi079 ceph-mon[18656]: pgmap v405: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 25 op/s 2024-08-20T01:39:16.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:15 smithi081 ceph-mon[22209]: pgmap v405: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 25 op/s 2024-08-20T01:39:17.625 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T01:39:17.626 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T01:39:17.913 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:39:17.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:17 smithi079 ceph-mon[18656]: pgmap v406: 97 pgs: 97 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 23 op/s 2024-08-20T01:39:18.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:17 smithi175 ceph-mon[22392]: pgmap v406: 97 pgs: 97 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 23 op/s 2024-08-20T01:39:18.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:17 smithi081 ceph-mon[22209]: pgmap v406: 97 pgs: 97 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 23 op/s 2024-08-20T01:39:18.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.409+0000 7f758c5a4640 1 -- 172.21.15.79:0/2742386522 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7584108e20 msgr2=0x7f758410f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:18.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.409+0000 7f758c5a4640 1 --2- 172.21.15.79:0/2742386522 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7584108e20 0x7f758410f620 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f757c009ca0 tx=0x7f757c02a8c0 comp rx=0 tx=0).stop 2024-08-20T01:39:18.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.409+0000 7f758c5a4640 1 -- 172.21.15.79:0/2742386522 shutdown_connections 2024-08-20T01:39:18.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.409+0000 7f758c5a4640 1 --2- 172.21.15.79:0/2742386522 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7584108e20 0x7f758410f620 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:18.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.409+0000 7f758c5a4640 1 --2- 172.21.15.79:0/2742386522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75841084a0 0x7f75841088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:18.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.409+0000 7f758c5a4640 1 --2- 172.21.15.79:0/2742386522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7584102a90 0x7f7584102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:18.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.409+0000 7f758c5a4640 1 -- 172.21.15.79:0/2742386522 >> 172.21.15.79:0/2742386522 conn(0x7f75840fe540 msgr2=0x7f7584100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:18.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.409+0000 7f758c5a4640 1 -- 172.21.15.79:0/2742386522 shutdown_connections 2024-08-20T01:39:18.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.409+0000 7f758c5a4640 1 -- 172.21.15.79:0/2742386522 wait complete. 2024-08-20T01:39:18.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.410+0000 7f758c5a4640 1 Processor -- start 2024-08-20T01:39:18.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.410+0000 7f758c5a4640 1 -- start start 2024-08-20T01:39:18.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.411+0000 7f758c5a4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7584102a90 0x7f7584198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:18.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.411+0000 7f758c5a4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75841084a0 0x7f75841993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:18.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.411+0000 7f758c5a4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7584108e20 0x7f758419e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:18.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.411+0000 7f758c5a4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f75841129e0 con 0x7f75841084a0 2024-08-20T01:39:18.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.411+0000 7f758c5a4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7584112860 con 0x7f7584108e20 2024-08-20T01:39:18.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.411+0000 7f758c5a4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7584112b60 con 0x7f7584102a90 2024-08-20T01:39:18.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.411+0000 7f7589b3f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75841084a0 0x7f75841993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:18.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.411+0000 7f7589b3f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75841084a0 0x7f75841993b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40660/0 (socket says 172.21.15.79:40660) 2024-08-20T01:39:18.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.411+0000 7f7589b3f640 1 -- 172.21.15.79:0/4258617617 learned_addr learned my addr 172.21.15.79:0/4258617617 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:18.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.411+0000 7f758a340640 1 --2- 172.21.15.79:0/4258617617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7584102a90 0x7f7584198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:18.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.411+0000 7f758ab41640 1 --2- 172.21.15.79:0/4258617617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7584108e20 0x7f758419e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:18.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.411+0000 7f7589b3f640 1 -- 172.21.15.79:0/4258617617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7584102a90 msgr2=0x7f7584198e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:18.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.411+0000 7f7589b3f640 1 --2- 172.21.15.79:0/4258617617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7584102a90 0x7f7584198e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:18.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.411+0000 7f7589b3f640 1 -- 172.21.15.79:0/4258617617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7584108e20 msgr2=0x7f758419e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:18.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.411+0000 7f7589b3f640 1 --2- 172.21.15.79:0/4258617617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7584108e20 0x7f758419e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:18.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.411+0000 7f7589b3f640 1 -- 172.21.15.79:0/4258617617 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f758419ef20 con 0x7f75841084a0 2024-08-20T01:39:18.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.411+0000 7f758a340640 1 --2- 172.21.15.79:0/4258617617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7584102a90 0x7f7584198e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:39:18.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.411+0000 7f7589b3f640 1 --2- 172.21.15.79:0/4258617617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75841084a0 0x7f75841993b0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f757400d950 tx=0x7f757400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:18.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.412+0000 7f757b7fe640 1 -- 172.21.15.79:0/4258617617 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7574017070 con 0x7f75841084a0 2024-08-20T01:39:18.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.412+0000 7f757b7fe640 1 -- 172.21.15.79:0/4258617617 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7574009c30 con 0x7f75841084a0 2024-08-20T01:39:18.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.412+0000 7f758c5a4640 1 -- 172.21.15.79:0/4258617617 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f758419f210 con 0x7f75841084a0 2024-08-20T01:39:18.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.412+0000 7f757b7fe640 1 -- 172.21.15.79:0/4258617617 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f757400f620 con 0x7f75841084a0 2024-08-20T01:39:18.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.412+0000 7f758c5a4640 1 -- 172.21.15.79:0/4258617617 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75841a58d0 con 0x7f75841084a0 2024-08-20T01:39:18.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.415+0000 7f758e99d740 1 Processor -- start 2024-08-20T01:39:18.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.415+0000 7f758e99d740 1 -- start start 2024-08-20T01:39:18.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.415+0000 7f757b7fe640 1 -- 172.21.15.79:0/4258617617 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f7574010460 con 0x7f75841084a0 2024-08-20T01:39:18.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.415+0000 7f758e99d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b4f17c3b0 0x563b4f17c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:18.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.415+0000 7f758e99d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4f17ccd0 0x563b4f18cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:18.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.415+0000 7f758e99d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b4f18d070 0x563b4f18f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:18.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.415+0000 7f758e99d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563b4f0f2940 con 0x563b4f17ccd0 2024-08-20T01:39:18.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.415+0000 7f758e99d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563b4f0e1e40 con 0x563b4f17c3b0 2024-08-20T01:39:18.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.415+0000 7f758e99d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563b4f0e5e80 con 0x563b4f18d070 2024-08-20T01:39:18.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.416+0000 7f758a340640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4f17ccd0 0x563b4f18cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:18.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.416+0000 7f758ab41640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b4f17c3b0 0x563b4f17c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:18.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.416+0000 7f758a340640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4f17ccd0 0x563b4f18cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40666/0 (socket says 172.21.15.79:40666) 2024-08-20T01:39:18.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.416+0000 7f758a340640 1 -- 172.21.15.79:0/2825199641 learned_addr learned my addr 172.21.15.79:0/2825199641 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:18.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.416+0000 7f7589b3f640 1 --2- 172.21.15.79:0/2825199641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b4f18d070 0x563b4f18f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:18.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.416+0000 7f758ab41640 1 -- 172.21.15.79:0/2825199641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b4f18d070 msgr2=0x563b4f18f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:18.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.416+0000 7f758ab41640 1 --2- 172.21.15.79:0/2825199641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b4f18d070 0x563b4f18f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:18.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.416+0000 7f758ab41640 1 -- 172.21.15.79:0/2825199641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4f17ccd0 msgr2=0x563b4f18cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:18.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.416+0000 7f758ab41640 1 --2- 172.21.15.79:0/2825199641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4f17ccd0 0x563b4f18cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:18.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.416+0000 7f758ab41640 1 -- 172.21.15.79:0/2825199641 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b4f07e520 con 0x563b4f17c3b0 2024-08-20T01:39:18.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.416+0000 7f758a340640 1 --2- 172.21.15.79:0/2825199641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4f17ccd0 0x563b4f18cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:18.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.416+0000 7f758ab41640 1 --2- 172.21.15.79:0/2825199641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b4f17c3b0 0x563b4f17c790 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f757c031040 tx=0x7f757c0093f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b9fd663e6e9d4f4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:18.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.416+0000 7f757b7fe640 1 --2- 172.21.15.79:0/4258617617 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f75700b3bd0 0x7f75700b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:18.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.416+0000 7f7578ff9640 1 -- 172.21.15.79:0/2825199641 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f757c031980 con 0x563b4f17c3b0 2024-08-20T01:39:18.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.417+0000 7f7578ff9640 1 -- 172.21.15.79:0/2825199641 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f757c036030 con 0x563b4f17c3b0 2024-08-20T01:39:18.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.417+0000 7f7578ff9640 1 -- 172.21.15.79:0/2825199641 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f757c0043c0 con 0x563b4f17c3b0 2024-08-20T01:39:18.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.417+0000 7f758a340640 1 --2- 172.21.15.79:0/4258617617 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f75700b3bd0 0x7f75700b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:18.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.417+0000 7f757b7fe640 1 -- 172.21.15.79:0/4258617617 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f75740e3800 con 0x7f75841084a0 2024-08-20T01:39:18.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.417+0000 7f758e99d740 1 -- 172.21.15.79:0/2825199641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b4f17c3b0 msgr2=0x563b4f17c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:18.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.417+0000 7f758a340640 1 --2- 172.21.15.79:0/4258617617 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f75700b3bd0 0x7f75700b6090 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x563b4f17f530 tx=0x7f7580005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:18.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.417+0000 7f758e99d740 1 --2- 172.21.15.79:0/2825199641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b4f17c3b0 0x563b4f17c790 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f757c031040 tx=0x7f757c0093f0 comp rx=0 tx=0).stop 2024-08-20T01:39:18.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.418+0000 7f758e99d740 1 -- 172.21.15.79:0/2825199641 shutdown_connections 2024-08-20T01:39:18.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.418+0000 7f758e99d740 1 --2- 172.21.15.79:0/2825199641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b4f18d070 0x563b4f18f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:18.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.418+0000 7f758e99d740 1 --2- 172.21.15.79:0/2825199641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4f17ccd0 0x563b4f18cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:18.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.418+0000 7f758e99d740 1 --2- 172.21.15.79:0/2825199641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b4f17c3b0 0x563b4f17c790 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:18.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.418+0000 7f758e99d740 1 -- 172.21.15.79:0/2825199641 >> 172.21.15.79:0/2825199641 conn(0x563b4f17a1e0 msgr2=0x563b4f17b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:18.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.418+0000 7f758e99d740 1 -- 172.21.15.79:0/2825199641 shutdown_connections 2024-08-20T01:39:18.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.418+0000 7f758e99d740 1 -- 172.21.15.79:0/2825199641 wait complete. 2024-08-20T01:39:18.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.418+0000 7f758e99d740 1 -- start start 2024-08-20T01:39:18.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.418+0000 7f758e99d740 1 Processor -- start 2024-08-20T01:39:18.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.418+0000 7f758e99d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b4f17c3b0 0x563b4f18a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:18.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.418+0000 7f758e99d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b4f17ccd0 0x563b4f18a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:18.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.418+0000 7f758e99d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4f18d070 0x563b4f18aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:18.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.418+0000 7f758e99d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563b4ef44890 con 0x563b4f18d070 2024-08-20T01:39:18.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.418+0000 7f758e99d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563b4f068700 con 0x563b4f17ccd0 2024-08-20T01:39:18.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.418+0000 7f758e99d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563b4f18fbe0 con 0x563b4f17c3b0 2024-08-20T01:39:18.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.418+0000 7f758e99d740 10 client.0 _ll_register_callbacks cb 0x563b4f0dd6f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:18.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.418+0000 7f758ab41640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4f18d070 0x563b4f18aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:18.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.419+0000 7f758ab41640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4f18d070 0x563b4f18aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40674/0 (socket says 172.21.15.79:40674) 2024-08-20T01:39:18.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.419+0000 7f758ab41640 1 -- 172.21.15.79:0/911870304 learned_addr learned my addr 172.21.15.79:0/911870304 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:18.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.419+0000 7f7589b3f640 1 --2- 172.21.15.79:0/911870304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b4f17ccd0 0x563b4f18a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:18.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.419+0000 7f758a340640 1 --2- 172.21.15.79:0/911870304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b4f17c3b0 0x563b4f18a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:18.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.419+0000 7f758ab41640 1 -- 172.21.15.79:0/911870304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b4f17c3b0 msgr2=0x563b4f18a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:18.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.419+0000 7f758ab41640 1 --2- 172.21.15.79:0/911870304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b4f17c3b0 0x563b4f18a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:18.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.419+0000 7f758ab41640 1 -- 172.21.15.79:0/911870304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b4f17ccd0 msgr2=0x563b4f18a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:18.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.419+0000 7f758ab41640 1 --2- 172.21.15.79:0/911870304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b4f17ccd0 0x563b4f18a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:18.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.419+0000 7f758ab41640 1 -- 172.21.15.79:0/911870304 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b4ee41930 con 0x563b4f18d070 2024-08-20T01:39:18.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.419+0000 7f758ab41640 1 --2- 172.21.15.79:0/911870304 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4f18d070 0x563b4f18aa80 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f757c005cb0 tx=0x7f757c009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d5ccdd7da2b64fc server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:18.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.419+0000 7f756dffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:39:18.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.419+0000 7f756dffb640 1 -- 172.21.15.79:0/911870304 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f757c04a040 con 0x563b4f18d070 2024-08-20T01:39:18.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.419+0000 7f758e99d740 1 -- 172.21.15.79:0/911870304 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f757c036030 con 0x563b4f18d070 2024-08-20T01:39:18.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.419+0000 7f756dffb640 1 -- 172.21.15.79:0/911870304 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f757c003b70 con 0x563b4f18d070 2024-08-20T01:39:18.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.419+0000 7f756dffb640 1 -- 172.21.15.79:0/911870304 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f757c003d70 con 0x563b4f18d070 2024-08-20T01:39:18.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.419+0000 7f758e99d740 10 client.16281 fetch_fsmap learned FSMap version 33 2024-08-20T01:39:18.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.419+0000 7f758e99d740 1 -- 172.21.15.79:0/911870304 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x563b4f19b770 con 0x563b4f18d070 2024-08-20T01:39:18.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.420+0000 7f756dffb640 1 -- 172.21.15.79:0/911870304 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f757c036030 con 0x563b4f18d070 2024-08-20T01:39:18.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.420+0000 7f756dffb640 1 -- 172.21.15.79:0/911870304 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7f757c04d030 con 0x563b4f18d070 2024-08-20T01:39:18.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.420+0000 7f758e99d740 10 client.16281 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:39:18.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.420+0000 7f758e99d740 10 client.16281 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:39:18.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.420+0000 7f758e99d740 20 client.16281 populate_metadata read hostname 'smithi079' 2024-08-20T01:39:18.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.420+0000 7f758e99d740 1 --2- 172.21.15.79:0/911870304 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x563b4f19cac0 0x563b4f19eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:18.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.420+0000 7f758e99d740 4 client.16281 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:39:18.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.420+0000 7f758e99d740 1 -- 172.21.15.79:0/911870304 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563b4f0f4890 con 0x563b4f19cac0 2024-08-20T01:39:18.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.420+0000 7f758a340640 1 --2- 172.21.15.79:0/911870304 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x563b4f19cac0 0x563b4f19eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:18.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.421+0000 7f756dffb640 10 client.16281 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:39:18.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.421+0000 7f758a340640 1 --2- 172.21.15.79:0/911870304 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x563b4f19cac0 0x563b4f19eeb0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a959573eab7aee77 server_cookie=a4e1ff05ced63e68 in_seq=0 out_seq=0 2024-08-20T01:39:18.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.422+0000 7f756dffb640 1 -- 172.21.15.79:0/911870304 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563b4f0f4890 con 0x563b4f19cac0 2024-08-20T01:39:18.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.422+0000 7f756dffb640 10 client.16281 handle_command_reply: tid=0 2024-08-20T01:39:18.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.422+0000 7f758e99d740 1 client.16281 shutdown 2024-08-20T01:39:18.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.422+0000 7f758e99d740 1 -- 172.21.15.79:0/911870304 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4f18d070 msgr2=0x563b4f18aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:18.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.422+0000 7f758e99d740 1 --2- 172.21.15.79:0/911870304 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4f18d070 0x563b4f18aa80 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f757c005cb0 tx=0x7f757c009800 comp rx=0 tx=0).stop 2024-08-20T01:39:18.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.422+0000 7f758e99d740 1 -- 172.21.15.79:0/911870304 shutdown_connections 2024-08-20T01:39:18.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.422+0000 7f758e99d740 1 --2- 172.21.15.79:0/911870304 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x563b4f19cac0 0x563b4f19eeb0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:18.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.422+0000 7f756dffb640 0 client.16281 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:39:18.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.422+0000 7f758e99d740 1 --2- 172.21.15.79:0/911870304 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4f18d070 0x563b4f18aa80 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:18.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.422+0000 7f758e99d740 1 --2- 172.21.15.79:0/911870304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b4f17ccd0 0x563b4f18a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:18.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.422+0000 7f758e99d740 1 --2- 172.21.15.79:0/911870304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b4f17c3b0 0x563b4f18a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:18.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.422+0000 7f758e99d740 1 -- 172.21.15.79:0/911870304 >> 172.21.15.79:0/911870304 conn(0x563b4f17a1e0 msgr2=0x563b4f17fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:18.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.422+0000 7f758e99d740 1 -- 172.21.15.79:0/911870304 shutdown_connections 2024-08-20T01:39:18.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.422+0000 7f758e99d740 1 -- 172.21.15.79:0/911870304 wait complete. 2024-08-20T01:39:18.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.422+0000 7f758e99d740 20 client.16281 trim_cache size 0 max 16384 2024-08-20T01:39:18.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.443+0000 7f758e99d740 1 Processor -- start 2024-08-20T01:39:18.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.443+0000 7f758e99d740 1 -- start start 2024-08-20T01:39:18.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.444+0000 7f758e99d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b4f17c3b0 0x563b4f187b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:18.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.444+0000 7f758e99d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b4f17ccd0 0x563b4f18adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:18.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.444+0000 7f758e99d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4f18d070 0x563b4f1a4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:18.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.444+0000 7f758e99d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f75841abd00 con 0x563b4f18d070 2024-08-20T01:39:18.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.444+0000 7f758e99d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f75841ad990 con 0x563b4f17c3b0 2024-08-20T01:39:18.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.444+0000 7f758e99d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f75841ac3d0 con 0x563b4f17ccd0 2024-08-20T01:39:18.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.444+0000 7f758ab41640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4f18d070 0x563b4f1a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:18.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.444+0000 7f758ab41640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4f18d070 0x563b4f1a4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40686/0 (socket says 172.21.15.79:40686) 2024-08-20T01:39:18.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.444+0000 7f758ab41640 1 -- 172.21.15.79:0/1164675632 learned_addr learned my addr 172.21.15.79:0/1164675632 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:18.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.444+0000 7f758a340640 1 --2- 172.21.15.79:0/1164675632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b4f17c3b0 0x563b4f187b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:18.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.444+0000 7f7589b3f640 1 --2- 172.21.15.79:0/1164675632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b4f17ccd0 0x563b4f18adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:18.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.444+0000 7f758ab41640 1 -- 172.21.15.79:0/1164675632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b4f17ccd0 msgr2=0x563b4f18adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:18.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.444+0000 7f758ab41640 1 --2- 172.21.15.79:0/1164675632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b4f17ccd0 0x563b4f18adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:18.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.444+0000 7f758ab41640 1 -- 172.21.15.79:0/1164675632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b4f17c3b0 msgr2=0x563b4f187b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:18.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.444+0000 7f758ab41640 1 --2- 172.21.15.79:0/1164675632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b4f17c3b0 0x563b4f187b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:18.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.444+0000 7f758ab41640 1 -- 172.21.15.79:0/1164675632 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b4f17cb00 con 0x563b4f18d070 2024-08-20T01:39:18.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.444+0000 7f758ab41640 1 --2- 172.21.15.79:0/1164675632 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4f18d070 0x563b4f1a4710 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f757c005e30 tx=0x7f757c009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7a1c4a3fc6620ab server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:18.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.445+0000 7f756ffff640 1 -- 172.21.15.79:0/1164675632 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f757c003b70 con 0x563b4f18d070 2024-08-20T01:39:18.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.445+0000 7f756ffff640 1 -- 172.21.15.79:0/1164675632 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f757c036040 con 0x563b4f18d070 2024-08-20T01:39:18.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.445+0000 7f756ffff640 1 -- 172.21.15.79:0/1164675632 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f757c004170 con 0x563b4f18d070 2024-08-20T01:39:18.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.445+0000 7f758e99d740 1 -- 172.21.15.79:0/1164675632 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4f18d070 msgr2=0x563b4f1a4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:18.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.445+0000 7f758e99d740 1 --2- 172.21.15.79:0/1164675632 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4f18d070 0x563b4f1a4710 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f757c005e30 tx=0x7f757c009a20 comp rx=0 tx=0).stop 2024-08-20T01:39:18.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.445+0000 7f758e99d740 1 -- 172.21.15.79:0/1164675632 shutdown_connections 2024-08-20T01:39:18.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.445+0000 7f758e99d740 1 --2- 172.21.15.79:0/1164675632 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4f18d070 0x563b4f1a4710 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:18.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.445+0000 7f758e99d740 1 --2- 172.21.15.79:0/1164675632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b4f17ccd0 0x563b4f18adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:18.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.445+0000 7f758e99d740 1 --2- 172.21.15.79:0/1164675632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b4f17c3b0 0x563b4f187b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:18.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.445+0000 7f758e99d740 1 -- 172.21.15.79:0/1164675632 >> 172.21.15.79:0/1164675632 conn(0x563b4f17a1e0 msgr2=0x563b4f179300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:18.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.446+0000 7f758e99d740 1 -- 172.21.15.79:0/1164675632 shutdown_connections 2024-08-20T01:39:18.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.446+0000 7f758e99d740 1 -- 172.21.15.79:0/1164675632 wait complete. 2024-08-20T01:39:18.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.446+0000 7f758e99d740 1 -- start start 2024-08-20T01:39:18.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.446+0000 7f758e99d740 1 Processor -- start 2024-08-20T01:39:18.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.446+0000 7f758e99d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b4f17c3b0 0x563b4f194e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:18.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.446+0000 7f758e99d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4f17ccd0 0x563b4f195380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:18.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.446+0000 7f758e99d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b4f18d070 0x563b4f191e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:18.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.446+0000 7f758e99d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f75841ad200 con 0x563b4f17ccd0 2024-08-20T01:39:18.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.446+0000 7f758e99d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f75841acaa0 con 0x563b4f18d070 2024-08-20T01:39:18.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.446+0000 7f758e99d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f75841a9ce0 con 0x563b4f17c3b0 2024-08-20T01:39:18.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.446+0000 7f758e99d740 10 client.0 _ll_register_callbacks cb 0x7f75800096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:18.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.446+0000 7f7589b3f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4f17ccd0 0x563b4f195380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:18.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.446+0000 7f7589b3f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4f17ccd0 0x563b4f195380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40700/0 (socket says 172.21.15.79:40700) 2024-08-20T01:39:18.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.446+0000 7f7589b3f640 1 -- 172.21.15.79:0/2989377435 learned_addr learned my addr 172.21.15.79:0/2989377435 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:18.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.446+0000 7f758ab41640 1 --2- 172.21.15.79:0/2989377435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b4f18d070 0x563b4f191e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:18.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.447+0000 7f758a340640 1 --2- 172.21.15.79:0/2989377435 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b4f17c3b0 0x563b4f194e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:18.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.447+0000 7f7589b3f640 1 -- 172.21.15.79:0/2989377435 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b4f17c3b0 msgr2=0x563b4f194e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:18.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.447+0000 7f7589b3f640 1 --2- 172.21.15.79:0/2989377435 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b4f17c3b0 0x563b4f194e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:18.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.447+0000 7f7589b3f640 1 -- 172.21.15.79:0/2989377435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b4f18d070 msgr2=0x563b4f191e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:18.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.447+0000 7f7589b3f640 1 --2- 172.21.15.79:0/2989377435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b4f18d070 0x563b4f191e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:18.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.447+0000 7f7589b3f640 1 -- 172.21.15.79:0/2989377435 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b4f192350 con 0x563b4f17ccd0 2024-08-20T01:39:18.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.447+0000 7f758ab41640 1 --2- 172.21.15.79:0/2989377435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b4f18d070 0x563b4f191e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:39:18.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.447+0000 7f7589b3f640 1 --2- 172.21.15.79:0/2989377435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4f17ccd0 0x563b4f195380 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f75740e1310 tx=0x7f757400bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb7e2b40e29e2503 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:18.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.447+0000 7f756dffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:39:18.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.447+0000 7f756dffb640 1 -- 172.21.15.79:0/2989377435 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7574020040 con 0x563b4f17ccd0 2024-08-20T01:39:18.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.447+0000 7f756dffb640 1 -- 172.21.15.79:0/2989377435 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f75740b3380 con 0x563b4f17ccd0 2024-08-20T01:39:18.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.447+0000 7f758e99d740 1 -- 172.21.15.79:0/2989377435 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f757c036040 con 0x563b4f17ccd0 2024-08-20T01:39:18.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.447+0000 7f756dffb640 1 -- 172.21.15.79:0/2989377435 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f75740b3150 con 0x563b4f17ccd0 2024-08-20T01:39:18.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.447+0000 7f758e99d740 10 client.16287 fetch_fsmap learned FSMap version 33 2024-08-20T01:39:18.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.447+0000 7f758e99d740 1 -- 172.21.15.79:0/2989377435 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x563b4f207eb0 con 0x563b4f17ccd0 2024-08-20T01:39:18.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.447+0000 7f756dffb640 1 -- 172.21.15.79:0/2989377435 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f757c036040 con 0x563b4f17ccd0 2024-08-20T01:39:18.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.448+0000 7f756dffb640 1 -- 172.21.15.79:0/2989377435 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7f75740a60d0 con 0x563b4f17ccd0 2024-08-20T01:39:18.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.448+0000 7f758e99d740 10 client.16287 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:39:18.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.448+0000 7f758e99d740 10 client.16287 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:39:18.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.448+0000 7f758e99d740 20 client.16287 populate_metadata read hostname 'smithi079' 2024-08-20T01:39:18.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.448+0000 7f758e99d740 1 --2- 172.21.15.79:0/2989377435 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x563b4f19cac0 0x563b4f20a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:18.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.448+0000 7f758e99d740 4 client.16287 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T01:39:18.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.448+0000 7f758e99d740 1 -- 172.21.15.79:0/2989377435 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563b4f0f0330 con 0x563b4f19cac0 2024-08-20T01:39:18.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.448+0000 7f758a340640 1 --2- 172.21.15.79:0/2989377435 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x563b4f19cac0 0x563b4f20a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:18.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.448+0000 7f758a340640 1 --2- 172.21.15.79:0/2989377435 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x563b4f19cac0 0x563b4f20a760 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58be69ad171f74a2 server_cookie=374c2a15f58e2861 in_seq=0 out_seq=0 2024-08-20T01:39:18.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.448+0000 7f756dffb640 10 client.16287 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:39:18.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.450+0000 7f756dffb640 1 -- 172.21.15.79:0/2989377435 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563b4f0f0330 con 0x563b4f19cac0 2024-08-20T01:39:18.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.450+0000 7f756dffb640 10 client.16287 handle_command_reply: tid=0 2024-08-20T01:39:18.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.450+0000 7f758e99d740 1 client.16287 shutdown 2024-08-20T01:39:18.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.450+0000 7f758e99d740 1 -- 172.21.15.79:0/2989377435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4f17ccd0 msgr2=0x563b4f195380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:18.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.450+0000 7f758e99d740 1 --2- 172.21.15.79:0/2989377435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4f17ccd0 0x563b4f195380 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f75740e1310 tx=0x7f757400bf60 comp rx=0 tx=0).stop 2024-08-20T01:39:18.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.450+0000 7f758e99d740 1 -- 172.21.15.79:0/2989377435 shutdown_connections 2024-08-20T01:39:18.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.450+0000 7f758e99d740 1 --2- 172.21.15.79:0/2989377435 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x563b4f19cac0 0x563b4f20a760 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:18.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.450+0000 7f758e99d740 1 --2- 172.21.15.79:0/2989377435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b4f18d070 0x563b4f191e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:18.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.450+0000 7f756dffb640 0 client.16287 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:39:18.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.450+0000 7f758e99d740 1 --2- 172.21.15.79:0/2989377435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4f17ccd0 0x563b4f195380 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:18.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.450+0000 7f758e99d740 1 --2- 172.21.15.79:0/2989377435 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b4f17c3b0 0x563b4f194e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:18.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.450+0000 7f758e99d740 1 -- 172.21.15.79:0/2989377435 >> 172.21.15.79:0/2989377435 conn(0x563b4f17a1e0 msgr2=0x563b4f181570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:18.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.450+0000 7f758e99d740 1 -- 172.21.15.79:0/2989377435 shutdown_connections 2024-08-20T01:39:18.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.450+0000 7f758e99d740 1 -- 172.21.15.79:0/2989377435 wait complete. 2024-08-20T01:39:18.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.450+0000 7f758e99d740 20 client.16287 trim_cache size 0 max 16384 2024-08-20T01:39:18.457 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:39:18.457 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-08-20T01:39:18.457 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "810650a7-059d-4644-aa05-b46f7bdb6dfb", 2024-08-20T01:39:18.457 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-08-20T01:39:18.458 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:39:18.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.451+0000 7f758c5a4640 1 -- 172.21.15.79:0/4258617617 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f75700b3bd0 msgr2=0x7f75700b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:18.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.451+0000 7f758c5a4640 1 --2- 172.21.15.79:0/4258617617 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f75700b3bd0 0x7f75700b6090 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x563b4f17f530 tx=0x7f7580005f90 comp rx=0 tx=0).stop 2024-08-20T01:39:18.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.451+0000 7f758c5a4640 1 -- 172.21.15.79:0/4258617617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75841084a0 msgr2=0x7f75841993b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:18.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.451+0000 7f758c5a4640 1 --2- 172.21.15.79:0/4258617617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75841084a0 0x7f75841993b0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f757400d950 tx=0x7f757400de10 comp rx=0 tx=0).stop 2024-08-20T01:39:18.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.451+0000 7f758c5a4640 1 -- 172.21.15.79:0/4258617617 shutdown_connections 2024-08-20T01:39:18.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.451+0000 7f758c5a4640 1 --2- 172.21.15.79:0/4258617617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7584108e20 0x7f758419e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:18.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.451+0000 7f758c5a4640 1 --2- 172.21.15.79:0/4258617617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75841084a0 0x7f75841993b0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:18.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.451+0000 7f758c5a4640 1 --2- 172.21.15.79:0/4258617617 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f75700b3bd0 0x7f75700b6090 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:18.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.451+0000 7f758c5a4640 1 --2- 172.21.15.79:0/4258617617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7584102a90 0x7f7584198e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:18.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.451+0000 7f758c5a4640 1 -- 172.21.15.79:0/4258617617 >> 172.21.15.79:0/4258617617 conn(0x7f75840fe540 msgr2=0x7f7584100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:18.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.451+0000 7f758c5a4640 1 -- 172.21.15.79:0/4258617617 shutdown_connections 2024-08-20T01:39:18.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:18.451+0000 7f758c5a4640 1 -- 172.21.15.79:0/4258617617 wait complete. 2024-08-20T01:39:19.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:18 smithi175 ceph-mon[22392]: scrub queued for path: / 2024-08-20T01:39:19.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:18 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:19.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:18 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:39:19.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:18 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:39:19.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:18 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:19.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:18 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:19.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:18 smithi079 ceph-mon[18656]: scrub queued for path: / 2024-08-20T01:39:19.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:18 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:19.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:18 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:39:19.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:18 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:39:19.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:18 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:19.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:18 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:19.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:18 smithi081 ceph-mon[22209]: scrub queued for path: / 2024-08-20T01:39:19.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:18 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:19.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:18 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:39:19.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:18 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:39:19.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:18 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:19.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:18 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:19.286 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:39:19.587 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:39:19.962 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:19 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:39:19.962 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:19 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:19.962 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:19 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:39:19.962 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:19 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:39:19.962 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:19 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:19.962 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:19 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:19.962 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:19 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:39:19.962 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:19 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:19.963 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:19 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:39:19.963 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:19 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:19.963 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:19 smithi079 ceph-mon[18656]: pgmap v407: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 29 MiB/s wr, 26 op/s 2024-08-20T01:39:20.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:19 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:39:20.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:19 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:20.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:19 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:39:20.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:19 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:39:20.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:19 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:20.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:19 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:20.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:19 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:39:20.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:19 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:20.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:19 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:39:20.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:19 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:20.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:19 smithi175 ceph-mon[22392]: pgmap v407: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 29 MiB/s wr, 26 op/s 2024-08-20T01:39:20.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.162+0000 7fd880964640 1 -- 172.21.15.79:0/3024135515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd87c10cde0 msgr2=0x7fd87c10f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:20.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.162+0000 7fd880964640 1 --2- 172.21.15.79:0/3024135515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd87c10cde0 0x7fd87c10f250 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fd874009ca0 tx=0x7fd87402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:39:20.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.162+0000 7fd880964640 1 -- 172.21.15.79:0/3024135515 shutdown_connections 2024-08-20T01:39:20.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.162+0000 7fd880964640 1 --2- 172.21.15.79:0/3024135515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd87c10cde0 0x7fd87c10f250 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:20.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.162+0000 7fd880964640 1 --2- 172.21.15.79:0/3024135515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd87c104230 0x7fd87c10c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:20.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.162+0000 7fd880964640 1 --2- 172.21.15.79:0/3024135515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd87c103830 0x7fd87c103c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:20.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.162+0000 7fd880964640 1 -- 172.21.15.79:0/3024135515 >> 172.21.15.79:0/3024135515 conn(0x7fd87c0fd400 msgr2=0x7fd87c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:20.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.163+0000 7fd880964640 1 -- 172.21.15.79:0/3024135515 shutdown_connections 2024-08-20T01:39:20.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.163+0000 7fd880964640 1 -- 172.21.15.79:0/3024135515 wait complete. 2024-08-20T01:39:20.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.163+0000 7fd880964640 1 Processor -- start 2024-08-20T01:39:20.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.163+0000 7fd880964640 1 -- start start 2024-08-20T01:39:20.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.164+0000 7fd880964640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd87c103830 0x7fd87c198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:20.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.164+0000 7fd880964640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd87c104230 0x7fd87c199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:20.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.164+0000 7fd880964640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd87c10cde0 0x7fd87c19e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:20.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.164+0000 7fd880964640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd87c112960 con 0x7fd87c103830 2024-08-20T01:39:20.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.164+0000 7fd880964640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd87c1127e0 con 0x7fd87c10cde0 2024-08-20T01:39:20.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.164+0000 7fd880964640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd87c112ae0 con 0x7fd87c104230 2024-08-20T01:39:20.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.164+0000 7fd87a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd87c103830 0x7fd87c198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:20.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.164+0000 7fd87a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd87c103830 0x7fd87c198e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40716/0 (socket says 172.21.15.79:40716) 2024-08-20T01:39:20.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.164+0000 7fd87a59c640 1 -- 172.21.15.79:0/1373070563 learned_addr learned my addr 172.21.15.79:0/1373070563 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:20.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.164+0000 7fd87ad9d640 1 --2- 172.21.15.79:0/1373070563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd87c10cde0 0x7fd87c19e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:20.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.164+0000 7fd879d9b640 1 --2- 172.21.15.79:0/1373070563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd87c104230 0x7fd87c199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:20.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.164+0000 7fd87a59c640 1 -- 172.21.15.79:0/1373070563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd87c104230 msgr2=0x7fd87c199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:20.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.164+0000 7fd87a59c640 1 --2- 172.21.15.79:0/1373070563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd87c104230 0x7fd87c199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:20.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.164+0000 7fd87a59c640 1 -- 172.21.15.79:0/1373070563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd87c10cde0 msgr2=0x7fd87c19e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:20.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.164+0000 7fd87a59c640 1 --2- 172.21.15.79:0/1373070563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd87c10cde0 0x7fd87c19e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:20.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.164+0000 7fd87a59c640 1 -- 172.21.15.79:0/1373070563 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd87c19eee0 con 0x7fd87c103830 2024-08-20T01:39:20.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.164+0000 7fd879d9b640 1 --2- 172.21.15.79:0/1373070563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd87c104230 0x7fd87c199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:39:20.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.164+0000 7fd87a59c640 1 --2- 172.21.15.79:0/1373070563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd87c103830 0x7fd87c198e30 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fd86c00d770 tx=0x7fd86c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:20.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.165+0000 7fd86b7fe640 1 -- 172.21.15.79:0/1373070563 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd86c017070 con 0x7fd87c103830 2024-08-20T01:39:20.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.165+0000 7fd880964640 1 -- 172.21.15.79:0/1373070563 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd87c19f1d0 con 0x7fd87c103830 2024-08-20T01:39:20.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.165+0000 7fd86b7fe640 1 -- 172.21.15.79:0/1373070563 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd86c0054b0 con 0x7fd87c103830 2024-08-20T01:39:20.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.165+0000 7fd880964640 1 -- 172.21.15.79:0/1373070563 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd87c1a5890 con 0x7fd87c103830 2024-08-20T01:39:20.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.165+0000 7fd86b7fe640 1 -- 172.21.15.79:0/1373070563 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd86c004c60 con 0x7fd87c103830 2024-08-20T01:39:20.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.167+0000 7fd86b7fe640 1 -- 172.21.15.79:0/1373070563 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fd86c004e00 con 0x7fd87c103830 2024-08-20T01:39:20.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.168+0000 7fd882d5d740 1 Processor -- start 2024-08-20T01:39:20.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.168+0000 7fd882d5d740 1 -- start start 2024-08-20T01:39:20.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.168+0000 7fd882d5d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557847eb8830 0x557847eb8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:20.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.168+0000 7fd882d5d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557847eb9150 0x557847ec8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:20.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.168+0000 7fd882d5d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557847ec94f0 0x557847ecb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:20.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.168+0000 7fd882d5d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557847e2f8e0 con 0x557847eb9150 2024-08-20T01:39:20.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.168+0000 7fd882d5d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557847e1ede0 con 0x557847eb8830 2024-08-20T01:39:20.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.168+0000 7fd882d5d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557847e22e20 con 0x557847ec94f0 2024-08-20T01:39:20.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.168+0000 7fd86b7fe640 1 --2- 172.21.15.79:0/1373070563 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd8640b3bd0 0x7fd8640b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:20.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.168+0000 7fd87a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557847eb9150 0x557847ec8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:20.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.168+0000 7fd87a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557847eb9150 0x557847ec8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40730/0 (socket says 172.21.15.79:40730) 2024-08-20T01:39:20.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.168+0000 7fd87a59c640 1 -- 172.21.15.79:0/1108980978 learned_addr learned my addr 172.21.15.79:0/1108980978 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:20.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.168+0000 7fd879d9b640 1 --2- 172.21.15.79:0/1108980978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557847ec94f0 0x557847ecb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:20.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.168+0000 7fd87ad9d640 1 --2- 172.21.15.79:0/1373070563 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd8640b3bd0 0x7fd8640b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:20.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.168+0000 7fd87ad9d640 1 --2- 172.21.15.79:0/1108980978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557847eb8830 0x557847eb8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:20.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.169+0000 7fd86b7fe640 1 -- 172.21.15.79:0/1373070563 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fd86c0e3690 con 0x7fd87c103830 2024-08-20T01:39:20.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.169+0000 7fd879d9b640 1 -- 172.21.15.79:0/1108980978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557847eb8830 msgr2=0x557847eb8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:20.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.169+0000 7fd879d9b640 1 --2- 172.21.15.79:0/1108980978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557847eb8830 0x557847eb8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:20.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.169+0000 7fd879d9b640 1 -- 172.21.15.79:0/1108980978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557847eb9150 msgr2=0x557847ec8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:20.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.169+0000 7fd879d9b640 1 --2- 172.21.15.79:0/1108980978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557847eb9150 0x557847ec8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:20.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.169+0000 7fd879d9b640 1 -- 172.21.15.79:0/1108980978 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557847b7e650 con 0x557847ec94f0 2024-08-20T01:39:20.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.169+0000 7fd87a59c640 1 --2- 172.21.15.79:0/1108980978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557847eb9150 0x557847ec8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:20.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.169+0000 7fd87ad9d640 1 --2- 172.21.15.79:0/1373070563 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd8640b3bd0 0x7fd8640b6090 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd874006010 tx=0x7fd8740093d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:20.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.169+0000 7fd879d9b640 1 --2- 172.21.15.79:0/1108980978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557847ec94f0 0x557847ecb8e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd87c10f4d0 tx=0x7fd87000f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c94196ec3d33c325 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:20.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.169+0000 7fd868ff9640 1 -- 172.21.15.79:0/1108980978 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd870015070 con 0x557847ec94f0 2024-08-20T01:39:20.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.169+0000 7fd868ff9640 1 -- 172.21.15.79:0/1108980978 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd87001a8f0 con 0x557847ec94f0 2024-08-20T01:39:20.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.169+0000 7fd868ff9640 1 -- 172.21.15.79:0/1108980978 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd870011780 con 0x557847ec94f0 2024-08-20T01:39:20.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.170+0000 7fd882d5d740 1 -- 172.21.15.79:0/1108980978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557847ec94f0 msgr2=0x557847ecb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:20.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.170+0000 7fd882d5d740 1 --2- 172.21.15.79:0/1108980978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557847ec94f0 0x557847ecb8e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd87c10f4d0 tx=0x7fd87000f730 comp rx=0 tx=0).stop 2024-08-20T01:39:20.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.170+0000 7fd882d5d740 1 -- 172.21.15.79:0/1108980978 shutdown_connections 2024-08-20T01:39:20.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.170+0000 7fd882d5d740 1 --2- 172.21.15.79:0/1108980978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557847ec94f0 0x557847ecb8e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:20.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.170+0000 7fd882d5d740 1 --2- 172.21.15.79:0/1108980978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557847eb9150 0x557847ec8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:20.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.170+0000 7fd882d5d740 1 --2- 172.21.15.79:0/1108980978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557847eb8830 0x557847eb8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:20.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.170+0000 7fd882d5d740 1 -- 172.21.15.79:0/1108980978 >> 172.21.15.79:0/1108980978 conn(0x557847eb6660 msgr2=0x557847eb7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:20.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.170+0000 7fd882d5d740 1 -- 172.21.15.79:0/1108980978 shutdown_connections 2024-08-20T01:39:20.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.170+0000 7fd882d5d740 1 -- 172.21.15.79:0/1108980978 wait complete. 2024-08-20T01:39:20.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.171+0000 7fd882d5d740 1 -- start start 2024-08-20T01:39:20.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.171+0000 7fd882d5d740 1 Processor -- start 2024-08-20T01:39:20.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.171+0000 7fd882d5d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557847eb8830 0x557847ec8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:20.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.171+0000 7fd882d5d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557847eb9150 0x557847ec6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:20.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.171+0000 7fd882d5d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557847ec94f0 0x557847ec6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:20.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.171+0000 7fd882d5d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557847c81700 con 0x557847eb8830 2024-08-20T01:39:20.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.171+0000 7fd882d5d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557847da57c0 con 0x557847ec94f0 2024-08-20T01:39:20.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.171+0000 7fd882d5d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557847ecc1a0 con 0x557847eb9150 2024-08-20T01:39:20.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.171+0000 7fd882d5d740 10 client.0 _ll_register_callbacks cb 0x557847e186b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:20.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.171+0000 7fd87a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557847eb8830 0x557847ec8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:20.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.171+0000 7fd879d9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557847eb9150 0x557847ec6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:20.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.171+0000 7fd87a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557847eb8830 0x557847ec8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40744/0 (socket says 172.21.15.79:40744) 2024-08-20T01:39:20.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.171+0000 7fd879d9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557847eb9150 0x557847ec6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:47050/0 (socket says 172.21.15.79:47050) 2024-08-20T01:39:20.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.171+0000 7fd87a59c640 1 -- 172.21.15.79:0/3031874208 learned_addr learned my addr 172.21.15.79:0/3031874208 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:20.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.171+0000 7fd87ad9d640 1 --2- 172.21.15.79:0/3031874208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557847ec94f0 0x557847ec6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:20.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.172+0000 7fd879d9b640 1 -- 172.21.15.79:0/3031874208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557847ec94f0 msgr2=0x557847ec6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:20.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.172+0000 7fd879d9b640 1 --2- 172.21.15.79:0/3031874208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557847ec94f0 0x557847ec6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:20.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.172+0000 7fd879d9b640 1 -- 172.21.15.79:0/3031874208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557847eb8830 msgr2=0x557847ec8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:20.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.172+0000 7fd879d9b640 1 --2- 172.21.15.79:0/3031874208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557847eb8830 0x557847ec8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:20.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.172+0000 7fd879d9b640 1 -- 172.21.15.79:0/3031874208 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557847ed5500 con 0x557847eb9150 2024-08-20T01:39:20.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.172+0000 7fd87a59c640 1 --2- 172.21.15.79:0/3031874208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557847eb8830 0x557847ec8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:20.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.172+0000 7fd879d9b640 1 --2- 172.21.15.79:0/3031874208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557847eb9150 0x557847ec6440 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd87c10f4d0 tx=0x7fd87000b950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e77e4657088299bd server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:20.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.172+0000 7fd861ffb640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:39:20.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.172+0000 7fd861ffb640 1 -- 172.21.15.79:0/3031874208 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd870015070 con 0x557847eb9150 2024-08-20T01:39:20.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.172+0000 7fd882d5d740 1 -- 172.21.15.79:0/3031874208 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557847dce100 con 0x557847eb9150 2024-08-20T01:39:20.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.172+0000 7fd861ffb640 1 -- 172.21.15.79:0/3031874208 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fd870005350 con 0x557847eb9150 2024-08-20T01:39:20.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.172+0000 7fd861ffb640 1 -- 172.21.15.79:0/3031874208 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fd870005550 con 0x557847eb9150 2024-08-20T01:39:20.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.172+0000 7fd882d5d740 10 client.25600 fetch_fsmap learned FSMap version 33 2024-08-20T01:39:20.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.172+0000 7fd882d5d740 1 -- 172.21.15.79:0/3031874208 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x557847ed7eb0 con 0x557847eb9150 2024-08-20T01:39:20.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.173+0000 7fd861ffb640 1 -- 172.21.15.79:0/3031874208 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x557847dce100 con 0x557847eb9150 2024-08-20T01:39:20.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.173+0000 7fd861ffb640 1 -- 172.21.15.79:0/3031874208 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7fd870011820 con 0x557847eb9150 2024-08-20T01:39:20.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.173+0000 7fd882d5d740 10 client.25600 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:39:20.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.173+0000 7fd882d5d740 10 client.25600 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:39:20.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.173+0000 7fd882d5d740 20 client.25600 populate_metadata read hostname 'smithi079' 2024-08-20T01:39:20.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.173+0000 7fd882d5d740 1 --2- 172.21.15.79:0/3031874208 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557847ed9260 0x557847edb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:20.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.173+0000 7fd882d5d740 4 client.25600 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:39:20.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.173+0000 7fd882d5d740 1 -- 172.21.15.79:0/3031874208 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557847e31830 con 0x557847ed9260 2024-08-20T01:39:20.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.173+0000 7fd87a59c640 1 --2- 172.21.15.79:0/3031874208 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557847ed9260 0x557847edb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:20.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.174+0000 7fd861ffb640 10 client.25600 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:39:20.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.174+0000 7fd87a59c640 1 --2- 172.21.15.79:0/3031874208 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557847ed9260 0x557847edb650 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2738de8ff054b128 server_cookie=86a93e0c07ae6924 in_seq=0 out_seq=0 2024-08-20T01:39:20.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.174+0000 7fd861ffb640 1 -- 172.21.15.79:0/3031874208 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557847e31830 con 0x557847ed9260 2024-08-20T01:39:20.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.174+0000 7fd861ffb640 10 client.25600 handle_command_reply: tid=0 2024-08-20T01:39:20.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.174+0000 7fd882d5d740 1 client.25600 shutdown 2024-08-20T01:39:20.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.174+0000 7fd882d5d740 1 -- 172.21.15.79:0/3031874208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557847eb9150 msgr2=0x557847ec6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:20.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.174+0000 7fd882d5d740 1 --2- 172.21.15.79:0/3031874208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557847eb9150 0x557847ec6440 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd87c10f4d0 tx=0x7fd87000b950 comp rx=0 tx=0).stop 2024-08-20T01:39:20.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.174+0000 7fd882d5d740 1 -- 172.21.15.79:0/3031874208 shutdown_connections 2024-08-20T01:39:20.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.174+0000 7fd882d5d740 1 --2- 172.21.15.79:0/3031874208 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557847ed9260 0x557847edb650 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:20.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.174+0000 7fd882d5d740 1 --2- 172.21.15.79:0/3031874208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557847ec94f0 0x557847ec6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:20.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.174+0000 7fd882d5d740 1 --2- 172.21.15.79:0/3031874208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557847eb9150 0x557847ec6440 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:20.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.174+0000 7fd861ffb640 0 client.25600 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:39:20.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.174+0000 7fd882d5d740 1 --2- 172.21.15.79:0/3031874208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557847eb8830 0x557847ec8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:20.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.174+0000 7fd882d5d740 1 -- 172.21.15.79:0/3031874208 >> 172.21.15.79:0/3031874208 conn(0x557847eb6660 msgr2=0x557847ebc190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:20.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.175+0000 7fd882d5d740 1 -- 172.21.15.79:0/3031874208 shutdown_connections 2024-08-20T01:39:20.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.175+0000 7fd882d5d740 1 -- 172.21.15.79:0/3031874208 wait complete. 2024-08-20T01:39:20.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.175+0000 7fd882d5d740 20 client.25600 trim_cache size 0 max 16384 2024-08-20T01:39:20.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.196+0000 7fd882d5d740 1 Processor -- start 2024-08-20T01:39:20.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.196+0000 7fd882d5d740 1 -- start start 2024-08-20T01:39:20.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.196+0000 7fd882d5d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557847eb8830 0x557847ec6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:20.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.196+0000 7fd882d5d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557847eb9150 0x557847ec3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:20.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.197+0000 7fd882d5d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557847ec94f0 0x557847ec4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:20.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.197+0000 7fd882d5d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd87c1abd70 con 0x557847eb9150 2024-08-20T01:39:20.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.197+0000 7fd882d5d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd87c1ada00 con 0x557847eb8830 2024-08-20T01:39:20.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.197+0000 7fd882d5d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd87c1ac440 con 0x557847ec94f0 2024-08-20T01:39:20.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.197+0000 7fd879d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557847eb9150 0x557847ec3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:20.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.197+0000 7fd879d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557847eb9150 0x557847ec3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40760/0 (socket says 172.21.15.79:40760) 2024-08-20T01:39:20.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.197+0000 7fd879d9b640 1 -- 172.21.15.79:0/3224261869 learned_addr learned my addr 172.21.15.79:0/3224261869 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:20.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.197+0000 7fd87a59c640 1 --2- 172.21.15.79:0/3224261869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557847eb8830 0x557847ec6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:20.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.197+0000 7fd879d9b640 1 -- 172.21.15.79:0/3224261869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557847ec94f0 msgr2=0x557847ec4ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:39:20.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.197+0000 7fd879d9b640 1 --2- 172.21.15.79:0/3224261869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557847ec94f0 0x557847ec4ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:20.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.197+0000 7fd879d9b640 1 -- 172.21.15.79:0/3224261869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557847eb8830 msgr2=0x557847ec6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:20.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.197+0000 7fd879d9b640 1 --2- 172.21.15.79:0/3224261869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557847eb8830 0x557847ec6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:20.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.197+0000 7fd879d9b640 1 -- 172.21.15.79:0/3224261869 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557847eb8f40 con 0x557847eb9150 2024-08-20T01:39:20.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.197+0000 7fd87a59c640 1 --2- 172.21.15.79:0/3224261869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557847eb8830 0x557847ec6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:20.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.197+0000 7fd879d9b640 1 --2- 172.21.15.79:0/3224261869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557847eb9150 0x557847ec3f80 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fd870011cc0 tx=0x7fd87000ba00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=596cc23e00d7423f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:20.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.197+0000 7fd863fff640 1 -- 172.21.15.79:0/3224261869 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd870032070 con 0x557847eb9150 2024-08-20T01:39:20.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.198+0000 7fd863fff640 1 -- 172.21.15.79:0/3224261869 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd870005a70 con 0x557847eb9150 2024-08-20T01:39:20.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.198+0000 7fd863fff640 1 -- 172.21.15.79:0/3224261869 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd870015030 con 0x557847eb9150 2024-08-20T01:39:20.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.198+0000 7fd882d5d740 1 -- 172.21.15.79:0/3224261869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557847eb9150 msgr2=0x557847ec3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:20.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.198+0000 7fd882d5d740 1 --2- 172.21.15.79:0/3224261869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557847eb9150 0x557847ec3f80 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fd870011cc0 tx=0x7fd87000ba00 comp rx=0 tx=0).stop 2024-08-20T01:39:20.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.198+0000 7fd882d5d740 1 -- 172.21.15.79:0/3224261869 shutdown_connections 2024-08-20T01:39:20.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.198+0000 7fd882d5d740 1 --2- 172.21.15.79:0/3224261869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557847ec94f0 0x557847ec4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:20.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.198+0000 7fd882d5d740 1 --2- 172.21.15.79:0/3224261869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557847eb9150 0x557847ec3f80 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:20.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.198+0000 7fd882d5d740 1 --2- 172.21.15.79:0/3224261869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557847eb8830 0x557847ec6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:20.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.198+0000 7fd882d5d740 1 -- 172.21.15.79:0/3224261869 >> 172.21.15.79:0/3224261869 conn(0x557847eb6660 msgr2=0x557847eca510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:20.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.199+0000 7fd882d5d740 1 -- 172.21.15.79:0/3224261869 shutdown_connections 2024-08-20T01:39:20.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.199+0000 7fd882d5d740 1 -- 172.21.15.79:0/3224261869 wait complete. 2024-08-20T01:39:20.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.199+0000 7fd882d5d740 1 -- start start 2024-08-20T01:39:20.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.199+0000 7fd882d5d740 1 Processor -- start 2024-08-20T01:39:20.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.199+0000 7fd882d5d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557847eb8830 0x557847ed1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:20.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.199+0000 7fd882d5d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557847ec94f0 0x557847ed1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:20.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.199+0000 7fd882d5d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557847ee0140 0x557847ee05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:20.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.199+0000 7fd882d5d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd87c1ad270 con 0x557847ec94f0 2024-08-20T01:39:20.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.199+0000 7fd882d5d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd87c1acb10 con 0x557847ee0140 2024-08-20T01:39:20.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.199+0000 7fd882d5d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd87c1a9d50 con 0x557847eb8830 2024-08-20T01:39:20.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.199+0000 7fd882d5d740 10 client.0 _ll_register_callbacks cb 0x7fd86c0046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:20.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.200+0000 7fd879d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557847ec94f0 0x557847ed1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:20.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.200+0000 7fd879d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557847ec94f0 0x557847ed1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40768/0 (socket says 172.21.15.79:40768) 2024-08-20T01:39:20.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.200+0000 7fd879d9b640 1 -- 172.21.15.79:0/214939605 learned_addr learned my addr 172.21.15.79:0/214939605 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:20.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.200+0000 7fd879d9b640 1 -- 172.21.15.79:0/214939605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557847eb8830 msgr2=0x557847ed1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:20.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.200+0000 7fd879d9b640 1 --2- 172.21.15.79:0/214939605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557847eb8830 0x557847ed1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:20.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.200+0000 7fd87ad9d640 1 --2- 172.21.15.79:0/214939605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557847ee0140 0x557847ee05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:20.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.200+0000 7fd879d9b640 1 -- 172.21.15.79:0/214939605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557847ee0140 msgr2=0x557847ee05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:20.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.200+0000 7fd879d9b640 1 --2- 172.21.15.79:0/214939605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557847ee0140 0x557847ee05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:20.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.200+0000 7fd879d9b640 1 -- 172.21.15.79:0/214939605 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557847ee0d50 con 0x557847ec94f0 2024-08-20T01:39:20.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.200+0000 7fd879d9b640 1 --2- 172.21.15.79:0/214939605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557847ec94f0 0x557847ed1b80 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fd870004600 tx=0x7fd870005c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b76d66f4015688e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:20.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.200+0000 7fd861ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:39:20.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.200+0000 7fd861ffb640 1 -- 172.21.15.79:0/214939605 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd870032070 con 0x557847ec94f0 2024-08-20T01:39:20.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.200+0000 7fd861ffb640 1 -- 172.21.15.79:0/214939605 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fd870005350 con 0x557847ec94f0 2024-08-20T01:39:20.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.200+0000 7fd882d5d740 1 -- 172.21.15.79:0/214939605 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd870005a70 con 0x557847ec94f0 2024-08-20T01:39:20.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.201+0000 7fd861ffb640 1 -- 172.21.15.79:0/214939605 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fd870015040 con 0x557847ec94f0 2024-08-20T01:39:20.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.201+0000 7fd882d5d740 10 client.16305 fetch_fsmap learned FSMap version 33 2024-08-20T01:39:20.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.201+0000 7fd882d5d740 1 -- 172.21.15.79:0/214939605 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x557847f43c30 con 0x557847ec94f0 2024-08-20T01:39:20.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.201+0000 7fd861ffb640 1 -- 172.21.15.79:0/214939605 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd870005a70 con 0x557847ec94f0 2024-08-20T01:39:20.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.201+0000 7fd861ffb640 1 -- 172.21.15.79:0/214939605 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7fd870042690 con 0x557847ec94f0 2024-08-20T01:39:20.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.201+0000 7fd882d5d740 10 client.16305 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:39:20.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.201+0000 7fd882d5d740 10 client.16305 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:39:20.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.201+0000 7fd882d5d740 20 client.16305 populate_metadata read hostname 'smithi079' 2024-08-20T01:39:20.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.201+0000 7fd882d5d740 1 --2- 172.21.15.79:0/214939605 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557847f442f0 0x557847f46710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:20.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.201+0000 7fd882d5d740 4 client.16305 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:39:20.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.201+0000 7fd882d5d740 1 -- 172.21.15.79:0/214939605 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557847e2d2d0 con 0x557847f442f0 2024-08-20T01:39:20.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.201+0000 7fd87a59c640 1 --2- 172.21.15.79:0/214939605 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557847f442f0 0x557847f46710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:20.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.202+0000 7fd861ffb640 10 client.16305 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:39:20.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.202+0000 7fd87a59c640 1 --2- 172.21.15.79:0/214939605 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557847f442f0 0x557847f46710 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2df1e5ab107396db server_cookie=2dfcaf7d18d8639a in_seq=0 out_seq=0 2024-08-20T01:39:20.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.202+0000 7fd861ffb640 1 -- 172.21.15.79:0/214939605 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x557847e2d2d0 con 0x557847f442f0 2024-08-20T01:39:20.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.202+0000 7fd861ffb640 10 client.16305 handle_command_reply: tid=0 2024-08-20T01:39:20.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.202+0000 7fd882d5d740 1 client.16305 shutdown 2024-08-20T01:39:20.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.202+0000 7fd882d5d740 1 -- 172.21.15.79:0/214939605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557847ec94f0 msgr2=0x557847ed1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:20.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.202+0000 7fd882d5d740 1 --2- 172.21.15.79:0/214939605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557847ec94f0 0x557847ed1b80 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fd870004600 tx=0x7fd870005c20 comp rx=0 tx=0).stop 2024-08-20T01:39:20.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.202+0000 7fd882d5d740 1 -- 172.21.15.79:0/214939605 shutdown_connections 2024-08-20T01:39:20.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.202+0000 7fd882d5d740 1 --2- 172.21.15.79:0/214939605 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557847f442f0 0x557847f46710 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:20.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.202+0000 7fd882d5d740 1 --2- 172.21.15.79:0/214939605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557847ee0140 0x557847ee05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:20.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.202+0000 7fd882d5d740 1 --2- 172.21.15.79:0/214939605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557847ec94f0 0x557847ed1b80 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:20.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.202+0000 7fd882d5d740 1 --2- 172.21.15.79:0/214939605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557847eb8830 0x557847ed1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:20.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.202+0000 7fd882d5d740 1 -- 172.21.15.79:0/214939605 >> 172.21.15.79:0/214939605 conn(0x557847eb6660 msgr2=0x557847ec4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:20.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.202+0000 7fd861ffb640 0 client.16305 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:39:20.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.203+0000 7fd882d5d740 1 -- 172.21.15.79:0/214939605 shutdown_connections 2024-08-20T01:39:20.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.203+0000 7fd882d5d740 1 -- 172.21.15.79:0/214939605 wait complete. 2024-08-20T01:39:20.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.203+0000 7fd882d5d740 20 client.16305 trim_cache size 0 max 16384 2024-08-20T01:39:20.211 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:39:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-20T01:39:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": { 2024-08-20T01:39:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: "810650a7-059d-4644-aa05-b46f7bdb6dfb": { 2024-08-20T01:39:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/", 2024-08-20T01:39:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: "tag": "810650a7-059d-4644-aa05-b46f7bdb6dfb", 2024-08-20T01:39:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: "options": "recursive,force" 2024-08-20T01:39:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:39:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:39:20.211 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:39:20.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.203+0000 7fd880964640 1 -- 172.21.15.79:0/1373070563 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd8640b3bd0 msgr2=0x7fd8640b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:20.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.203+0000 7fd880964640 1 --2- 172.21.15.79:0/1373070563 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd8640b3bd0 0x7fd8640b6090 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd874006010 tx=0x7fd8740093d0 comp rx=0 tx=0).stop 2024-08-20T01:39:20.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.203+0000 7fd880964640 1 -- 172.21.15.79:0/1373070563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd87c103830 msgr2=0x7fd87c198e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:20.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.203+0000 7fd880964640 1 --2- 172.21.15.79:0/1373070563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd87c103830 0x7fd87c198e30 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fd86c00d770 tx=0x7fd86c00dc30 comp rx=0 tx=0).stop 2024-08-20T01:39:20.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.204+0000 7fd880964640 1 -- 172.21.15.79:0/1373070563 shutdown_connections 2024-08-20T01:39:20.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.204+0000 7fd880964640 1 --2- 172.21.15.79:0/1373070563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd87c10cde0 0x7fd87c19e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:20.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.204+0000 7fd880964640 1 --2- 172.21.15.79:0/1373070563 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd8640b3bd0 0x7fd8640b6090 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:20.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.204+0000 7fd880964640 1 --2- 172.21.15.79:0/1373070563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd87c104230 0x7fd87c199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:20.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.204+0000 7fd880964640 1 --2- 172.21.15.79:0/1373070563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd87c103830 0x7fd87c198e30 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:20.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.204+0000 7fd880964640 1 -- 172.21.15.79:0/1373070563 >> 172.21.15.79:0/1373070563 conn(0x7fd87c0fd400 msgr2=0x7fd87c0fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:20.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.204+0000 7fd880964640 1 -- 172.21.15.79:0/1373070563 shutdown_connections 2024-08-20T01:39:20.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:20.204+0000 7fd880964640 1 -- 172.21.15.79:0/1373070563 wait complete. 2024-08-20T01:39:20.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:19 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:39:20.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:19 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:20.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:19 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:39:20.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:19 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:39:20.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:19 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:20.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:19 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:20.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:19 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:39:20.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:19 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:20.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:19 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:39:20.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:19 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:39:20.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:19 smithi081 ceph-mon[22209]: pgmap v407: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 29 MiB/s wr, 26 op/s 2024-08-20T01:39:21.072 INFO:tasks.cephfs.filesystem:scrub status for tag:810650a7-059d-4644-aa05-b46f7bdb6dfb - {'path': '/', 'tag': '810650a7-059d-4644-aa05-b46f7bdb6dfb', 'options': 'recursive,force'} 2024-08-20T01:39:22.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:21 smithi175 ceph-mon[22392]: pgmap v408: 97 pgs: 97 active+clean; 2.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 30 MiB/s wr, 32 op/s 2024-08-20T01:39:22.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:21 smithi079 ceph-mon[18656]: pgmap v408: 97 pgs: 97 active+clean; 2.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 30 MiB/s wr, 32 op/s 2024-08-20T01:39:22.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:21 smithi081 ceph-mon[22209]: pgmap v408: 97 pgs: 97 active+clean; 2.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 30 MiB/s wr, 32 op/s 2024-08-20T01:39:23.508 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.504+0000 7f360d55c640 1 -- 172.21.15.79:0/790601677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3608105830 msgr2=0x7f3608107c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:23.508 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.504+0000 7f360d55c640 1 --2- 172.21.15.79:0/790601677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3608105830 0x7f3608107c40 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f35fc009900 tx=0x7f35fc02a410 comp rx=0 tx=0).stop 2024-08-20T01:39:23.508 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.504+0000 7f360d55c640 1 -- 172.21.15.79:0/790601677 shutdown_connections 2024-08-20T01:39:23.508 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.504+0000 7f360d55c640 1 --2- 172.21.15.79:0/790601677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3608108380 0x7f360810a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:23.508 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.504+0000 7f360d55c640 1 --2- 172.21.15.79:0/790601677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3608105830 0x7f3608107c40 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:23.508 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.504+0000 7f360d55c640 1 --2- 172.21.15.79:0/790601677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f360806b0b0 0x7f36081052f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:23.509 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.504+0000 7f360d55c640 1 -- 172.21.15.79:0/790601677 >> 172.21.15.79:0/790601677 conn(0x7f36080fce40 msgr2=0x7f36080ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:23.509 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.504+0000 7f360d55c640 1 -- 172.21.15.79:0/790601677 shutdown_connections 2024-08-20T01:39:23.509 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.504+0000 7f360d55c640 1 -- 172.21.15.79:0/790601677 wait complete. 2024-08-20T01:39:23.509 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.504+0000 7f360d55c640 1 Processor -- start 2024-08-20T01:39:23.509 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.505+0000 7f360d55c640 1 -- start start 2024-08-20T01:39:23.509 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.505+0000 7f360d55c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f360806b0b0 0x7f36081989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:23.509 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.505+0000 7f360d55c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3608105830 0x7f3608199010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:23.509 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.505+0000 7f360d55c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3608108380 0x7f3608199c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:23.509 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.505+0000 7f360d55c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f360810e160 con 0x7f3608105830 2024-08-20T01:39:23.509 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.505+0000 7f360d55c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f360810dfe0 con 0x7f360806b0b0 2024-08-20T01:39:23.509 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.505+0000 7f360d55c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f360810e2e0 con 0x7f3608108380 2024-08-20T01:39:23.509 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.505+0000 7f36067fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3608105830 0x7f3608199010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:23.509 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.505+0000 7f36067fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3608105830 0x7f3608199010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41638/0 (socket says 172.21.15.79:41638) 2024-08-20T01:39:23.510 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.505+0000 7f36067fc640 1 -- 172.21.15.79:0/2253982897 learned_addr learned my addr 172.21.15.79:0/2253982897 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:23.510 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.505+0000 7f3606ffd640 1 --2- 172.21.15.79:0/2253982897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f360806b0b0 0x7f36081989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:23.510 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.505+0000 7f36077fe640 1 --2- 172.21.15.79:0/2253982897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3608108380 0x7f3608199c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:23.510 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.505+0000 7f36067fc640 1 -- 172.21.15.79:0/2253982897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3608108380 msgr2=0x7f3608199c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:23.510 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.505+0000 7f36067fc640 1 --2- 172.21.15.79:0/2253982897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3608108380 0x7f3608199c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:23.510 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.505+0000 7f36067fc640 1 -- 172.21.15.79:0/2253982897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f360806b0b0 msgr2=0x7f36081989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:23.510 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.505+0000 7f36067fc640 1 --2- 172.21.15.79:0/2253982897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f360806b0b0 0x7f36081989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:23.510 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.505+0000 7f36067fc640 1 -- 172.21.15.79:0/2253982897 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f360819a500 con 0x7f3608105830 2024-08-20T01:39:23.510 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.505+0000 7f36067fc640 1 --2- 172.21.15.79:0/2253982897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3608105830 0x7f3608199010 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f35fc005ab0 tx=0x7f35fc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:23.510 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.506+0000 7f35effff640 1 -- 172.21.15.79:0/2253982897 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35fc03f030 con 0x7f3608105830 2024-08-20T01:39:23.510 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.506+0000 7f35effff640 1 -- 172.21.15.79:0/2253982897 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f35fc003c90 con 0x7f3608105830 2024-08-20T01:39:23.510 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.506+0000 7f360d55c640 1 -- 172.21.15.79:0/2253982897 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f360819a790 con 0x7f3608105830 2024-08-20T01:39:23.510 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.506+0000 7f35effff640 1 -- 172.21.15.79:0/2253982897 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35fc035070 con 0x7f3608105830 2024-08-20T01:39:23.511 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.506+0000 7f360d55c640 1 -- 172.21.15.79:0/2253982897 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36081a0ec0 con 0x7f3608105830 2024-08-20T01:39:23.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.508+0000 7f35effff640 1 -- 172.21.15.79:0/2253982897 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f35fc042030 con 0x7f3608105830 2024-08-20T01:39:23.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.508+0000 7f361042a740 1 Processor -- start 2024-08-20T01:39:23.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.509+0000 7f361042a740 1 -- start start 2024-08-20T01:39:23.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.509+0000 7f361042a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5601f74428d0 0x5601f7444cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:23.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.509+0000 7f361042a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601f7445200 0x5601f74475f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:23.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.509+0000 7f361042a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5601f7447c40 0x5601f744a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:23.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.509+0000 7f361042a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5601f73b5360 con 0x5601f74428d0 2024-08-20T01:39:23.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.509+0000 7f361042a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5601f73a4860 con 0x5601f7445200 2024-08-20T01:39:23.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.509+0000 7f361042a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5601f73a88a0 con 0x5601f7447c40 2024-08-20T01:39:23.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.509+0000 7f36077fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5601f74428d0 0x5601f7444cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:23.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.509+0000 7f36077fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5601f74428d0 0x5601f7444cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41644/0 (socket says 172.21.15.79:41644) 2024-08-20T01:39:23.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.509+0000 7f36077fe640 1 -- 172.21.15.79:0/4266392717 learned_addr learned my addr 172.21.15.79:0/4266392717 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:23.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.509+0000 7f36067fc640 1 --2- 172.21.15.79:0/4266392717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5601f7447c40 0x5601f744a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:23.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.509+0000 7f3606ffd640 1 --2- 172.21.15.79:0/4266392717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601f7445200 0x5601f74475f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:23.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.509+0000 7f36077fe640 1 -- 172.21.15.79:0/4266392717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5601f7447c40 msgr2=0x5601f744a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:23.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.509+0000 7f36077fe640 1 --2- 172.21.15.79:0/4266392717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5601f7447c40 0x5601f744a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:23.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.509+0000 7f36077fe640 1 -- 172.21.15.79:0/4266392717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601f7445200 msgr2=0x5601f74475f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:23.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.509+0000 7f36077fe640 1 --2- 172.21.15.79:0/4266392717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601f7445200 0x5601f74475f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:23.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.509+0000 7f36077fe640 1 -- 172.21.15.79:0/4266392717 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601f734be40 con 0x5601f74428d0 2024-08-20T01:39:23.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.509+0000 7f35effff640 1 --2- 172.21.15.79:0/2253982897 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f35f00b3c50 0x7f35f00b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:23.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.509+0000 7f36077fe640 1 --2- 172.21.15.79:0/4266392717 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5601f74428d0 0x5601f7444cc0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f3600009eb0 tx=0x7f3600010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c06ba60ab518b466 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:23.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.510+0000 7f3606ffd640 1 --2- 172.21.15.79:0/2253982897 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f35f00b3c50 0x7f35f00b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:23.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.510+0000 7f35effff640 1 -- 172.21.15.79:0/2253982897 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f35fc104520 con 0x7f3608105830 2024-08-20T01:39:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.510+0000 7f35ed7fa640 1 -- 172.21.15.79:0/4266392717 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3600016070 con 0x5601f74428d0 2024-08-20T01:39:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.510+0000 7f35ed7fa640 1 -- 172.21.15.79:0/4266392717 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3600004d20 con 0x5601f74428d0 2024-08-20T01:39:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.510+0000 7f35ed7fa640 1 -- 172.21.15.79:0/4266392717 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36000126b0 con 0x5601f74428d0 2024-08-20T01:39:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.511+0000 7f361042a740 1 -- 172.21.15.79:0/4266392717 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5601f74428d0 msgr2=0x5601f7444cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.511+0000 7f3606ffd640 1 --2- 172.21.15.79:0/2253982897 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f35f00b3c50 0x7f35f00b6110 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f35f8004610 tx=0x7f35f800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.511+0000 7f361042a740 1 --2- 172.21.15.79:0/4266392717 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5601f74428d0 0x5601f7444cc0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f3600009eb0 tx=0x7f3600010740 comp rx=0 tx=0).stop 2024-08-20T01:39:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.511+0000 7f361042a740 1 -- 172.21.15.79:0/4266392717 shutdown_connections 2024-08-20T01:39:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.511+0000 7f361042a740 1 --2- 172.21.15.79:0/4266392717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5601f7447c40 0x5601f744a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.511+0000 7f361042a740 1 --2- 172.21.15.79:0/4266392717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601f7445200 0x5601f74475f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.511+0000 7f361042a740 1 --2- 172.21.15.79:0/4266392717 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5601f74428d0 0x5601f7444cc0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.511+0000 7f361042a740 1 -- 172.21.15.79:0/4266392717 >> 172.21.15.79:0/4266392717 conn(0x5601f743da20 msgr2=0x5601f743e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.511+0000 7f361042a740 1 -- 172.21.15.79:0/4266392717 shutdown_connections 2024-08-20T01:39:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.511+0000 7f361042a740 1 -- 172.21.15.79:0/4266392717 wait complete. 2024-08-20T01:39:23.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.511+0000 7f361042a740 1 -- start start 2024-08-20T01:39:23.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.511+0000 7f361042a740 1 Processor -- start 2024-08-20T01:39:23.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.511+0000 7f361042a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5601f74428d0 0x5601f744c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:23.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.511+0000 7f361042a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5601f7445200 0x5601f744c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:23.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.511+0000 7f361042a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601f7447c40 0x5601f744d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:23.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.511+0000 7f361042a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5601f72ddab0 con 0x5601f7445200 2024-08-20T01:39:23.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.511+0000 7f361042a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5601f732b780 con 0x5601f7447c40 2024-08-20T01:39:23.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.511+0000 7f361042a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5601f744ac20 con 0x5601f74428d0 2024-08-20T01:39:23.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.511+0000 7f361042a740 10 client.0 _ll_register_callbacks cb 0x5601f70b3a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:23.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.511+0000 7f36067fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5601f7445200 0x5601f744c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:23.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.512+0000 7f36067fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5601f7445200 0x5601f744c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41646/0 (socket says 172.21.15.79:41646) 2024-08-20T01:39:23.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.512+0000 7f36067fc640 1 -- 172.21.15.79:0/2684549906 learned_addr learned my addr 172.21.15.79:0/2684549906 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:23.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.512+0000 7f36077fe640 1 --2- 172.21.15.79:0/2684549906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601f7447c40 0x5601f744d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:23.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.512+0000 7f3606ffd640 1 --2- 172.21.15.79:0/2684549906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5601f74428d0 0x5601f744c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:23.521 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.512+0000 7f36067fc640 1 -- 172.21.15.79:0/2684549906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5601f74428d0 msgr2=0x5601f744c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:23.521 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.512+0000 7f36067fc640 1 --2- 172.21.15.79:0/2684549906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5601f74428d0 0x5601f744c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:23.521 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.512+0000 7f36067fc640 1 -- 172.21.15.79:0/2684549906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601f7447c40 msgr2=0x5601f744d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:23.521 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.512+0000 7f36067fc640 1 --2- 172.21.15.79:0/2684549906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601f7447c40 0x5601f744d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:23.521 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.512+0000 7f36067fc640 1 -- 172.21.15.79:0/2684549906 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601f7107790 con 0x5601f7445200 2024-08-20T01:39:23.521 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.512+0000 7f36067fc640 1 --2- 172.21.15.79:0/2684549906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5601f7445200 0x5601f744c7d0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f35fc0cb180 tx=0x7f35fc0ee110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c318d80a9bbf2b25 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:23.521 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.512+0000 7f35eaff5640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:39:23.521 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.512+0000 7f35eaff5640 1 -- 172.21.15.79:0/2684549906 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35fc049040 con 0x5601f7445200 2024-08-20T01:39:23.521 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.512+0000 7f35eaff5640 1 -- 172.21.15.79:0/2684549906 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f35fc0cb6e0 con 0x5601f7445200 2024-08-20T01:39:23.521 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.512+0000 7f361042a740 1 -- 172.21.15.79:0/2684549906 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5601f7353e00 con 0x5601f7445200 2024-08-20T01:39:23.521 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.512+0000 7f35eaff5640 1 -- 172.21.15.79:0/2684549906 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f35fc0cabf0 con 0x5601f7445200 2024-08-20T01:39:23.521 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.512+0000 7f361042a740 10 client.16317 fetch_fsmap learned FSMap version 33 2024-08-20T01:39:23.521 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.512+0000 7f361042a740 1 -- 172.21.15.79:0/2684549906 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5601f7180620 con 0x5601f7445200 2024-08-20T01:39:23.522 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.512+0000 7f35eaff5640 1 -- 172.21.15.79:0/2684549906 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5601f7353e00 con 0x5601f7445200 2024-08-20T01:39:23.522 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.513+0000 7f35eaff5640 1 -- 172.21.15.79:0/2684549906 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7f35fc0d40a0 con 0x5601f7445200 2024-08-20T01:39:23.522 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.513+0000 7f361042a740 10 client.16317 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:39:23.522 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.513+0000 7f361042a740 10 client.16317 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:39:23.522 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.513+0000 7f361042a740 20 client.16317 populate_metadata read hostname 'smithi079' 2024-08-20T01:39:23.522 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.513+0000 7f361042a740 1 --2- 172.21.15.79:0/2684549906 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5601f7457b10 0x5601f7459f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:23.522 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.513+0000 7f361042a740 4 client.16317 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:39:23.522 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.513+0000 7f361042a740 1 -- 172.21.15.79:0/2684549906 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5601f73b72b0 con 0x5601f7457b10 2024-08-20T01:39:23.522 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.513+0000 7f3606ffd640 1 --2- 172.21.15.79:0/2684549906 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5601f7457b10 0x5601f7459f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:23.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.513+0000 7f35eaff5640 10 client.16317 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:39:23.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.513+0000 7f3606ffd640 1 --2- 172.21.15.79:0/2684549906 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5601f7457b10 0x5601f7459f50 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71eb2abac4d9c827 server_cookie=96eaeac4560cd0a6 in_seq=0 out_seq=0 2024-08-20T01:39:23.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.514+0000 7f35eaff5640 1 -- 172.21.15.79:0/2684549906 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5601f73b72b0 con 0x5601f7457b10 2024-08-20T01:39:23.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.514+0000 7f35eaff5640 10 client.16317 handle_command_reply: tid=0 2024-08-20T01:39:23.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.514+0000 7f361042a740 1 client.16317 shutdown 2024-08-20T01:39:23.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.514+0000 7f361042a740 1 -- 172.21.15.79:0/2684549906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5601f7445200 msgr2=0x5601f744c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:23.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.514+0000 7f361042a740 1 --2- 172.21.15.79:0/2684549906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5601f7445200 0x5601f744c7d0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f35fc0cb180 tx=0x7f35fc0ee110 comp rx=0 tx=0).stop 2024-08-20T01:39:23.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.514+0000 7f361042a740 1 -- 172.21.15.79:0/2684549906 shutdown_connections 2024-08-20T01:39:23.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.514+0000 7f361042a740 1 --2- 172.21.15.79:0/2684549906 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5601f7457b10 0x5601f7459f50 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:23.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.514+0000 7f361042a740 1 --2- 172.21.15.79:0/2684549906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601f7447c40 0x5601f744d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:23.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.514+0000 7f361042a740 1 --2- 172.21.15.79:0/2684549906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5601f7445200 0x5601f744c7d0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:23.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.514+0000 7f35eaff5640 0 client.16317 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:39:23.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.514+0000 7f361042a740 1 --2- 172.21.15.79:0/2684549906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5601f74428d0 0x5601f744c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:23.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.514+0000 7f361042a740 1 -- 172.21.15.79:0/2684549906 >> 172.21.15.79:0/2684549906 conn(0x5601f743da20 msgr2=0x5601f743cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:23.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.514+0000 7f361042a740 1 -- 172.21.15.79:0/2684549906 shutdown_connections 2024-08-20T01:39:23.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.514+0000 7f361042a740 1 -- 172.21.15.79:0/2684549906 wait complete. 2024-08-20T01:39:23.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.514+0000 7f361042a740 20 client.16317 trim_cache size 0 max 16384 2024-08-20T01:39:23.542 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.536+0000 7f361042a740 1 Processor -- start 2024-08-20T01:39:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.536+0000 7f361042a740 1 -- start start 2024-08-20T01:39:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.536+0000 7f361042a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601f74428d0 0x5601f743c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.536+0000 7f361042a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5601f7445200 0x5601f743c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.536+0000 7f361042a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5601f7447c40 0x5601f745e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.536+0000 7f361042a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f36081a9ae0 con 0x5601f7445200 2024-08-20T01:39:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.536+0000 7f361042a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f36081ab770 con 0x5601f74428d0 2024-08-20T01:39:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.536+0000 7f361042a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f36081aa1b0 con 0x5601f7447c40 2024-08-20T01:39:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.536+0000 7f36067fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5601f7445200 0x5601f743c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.536+0000 7f36067fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5601f7445200 0x5601f743c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41650/0 (socket says 172.21.15.79:41650) 2024-08-20T01:39:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.536+0000 7f36067fc640 1 -- 172.21.15.79:0/2872681001 learned_addr learned my addr 172.21.15.79:0/2872681001 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.536+0000 7f3606ffd640 1 --2- 172.21.15.79:0/2872681001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601f74428d0 0x5601f743c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:23.544 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.536+0000 7f36077fe640 1 --2- 172.21.15.79:0/2872681001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5601f7447c40 0x5601f745e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:23.544 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.536+0000 7f36067fc640 1 -- 172.21.15.79:0/2872681001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5601f7447c40 msgr2=0x5601f745e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:23.544 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.536+0000 7f36067fc640 1 --2- 172.21.15.79:0/2872681001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5601f7447c40 0x5601f745e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:23.544 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.536+0000 7f36067fc640 1 -- 172.21.15.79:0/2872681001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601f74428d0 msgr2=0x5601f743c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:23.544 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.536+0000 7f36067fc640 1 --2- 172.21.15.79:0/2872681001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601f74428d0 0x5601f743c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:23.544 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.536+0000 7f36067fc640 1 -- 172.21.15.79:0/2872681001 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601f744d710 con 0x5601f7445200 2024-08-20T01:39:23.544 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.536+0000 7f3606ffd640 1 --2- 172.21.15.79:0/2872681001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601f74428d0 0x5601f743c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:23.544 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.536+0000 7f36067fc640 1 --2- 172.21.15.79:0/2872681001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5601f7445200 0x5601f743c800 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f35fc004650 tx=0x7f35fc0c7340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=318e35b89899a6f6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:23.544 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.537+0000 7f35ecff9640 1 -- 172.21.15.79:0/2872681001 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35fc049030 con 0x5601f7445200 2024-08-20T01:39:23.544 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.537+0000 7f35ecff9640 1 -- 172.21.15.79:0/2872681001 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f35fc107e50 con 0x5601f7445200 2024-08-20T01:39:23.544 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.537+0000 7f35ecff9640 1 -- 172.21.15.79:0/2872681001 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35fc032e60 con 0x5601f7445200 2024-08-20T01:39:23.545 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.537+0000 7f361042a740 1 -- 172.21.15.79:0/2872681001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5601f7445200 msgr2=0x5601f743c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:23.545 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.537+0000 7f361042a740 1 --2- 172.21.15.79:0/2872681001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5601f7445200 0x5601f743c800 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f35fc004650 tx=0x7f35fc0c7340 comp rx=0 tx=0).stop 2024-08-20T01:39:23.545 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.537+0000 7f361042a740 1 -- 172.21.15.79:0/2872681001 shutdown_connections 2024-08-20T01:39:23.545 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.537+0000 7f361042a740 1 --2- 172.21.15.79:0/2872681001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5601f7447c40 0x5601f745e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:23.545 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.537+0000 7f361042a740 1 --2- 172.21.15.79:0/2872681001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5601f7445200 0x5601f743c800 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:23.545 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.537+0000 7f361042a740 1 --2- 172.21.15.79:0/2872681001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601f74428d0 0x5601f743c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:23.545 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.537+0000 7f361042a740 1 -- 172.21.15.79:0/2872681001 >> 172.21.15.79:0/2872681001 conn(0x5601f743da20 msgr2=0x5601f744b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:23.545 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.538+0000 7f361042a740 1 -- 172.21.15.79:0/2872681001 shutdown_connections 2024-08-20T01:39:23.545 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.538+0000 7f361042a740 1 -- 172.21.15.79:0/2872681001 wait complete. 2024-08-20T01:39:23.545 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.538+0000 7f361042a740 1 -- start start 2024-08-20T01:39:23.545 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.538+0000 7f361042a740 1 Processor -- start 2024-08-20T01:39:23.546 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.538+0000 7f361042a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5601f74428d0 0x5601f7451100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:23.546 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.538+0000 7f361042a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5601f7445200 0x5601f74517a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:23.546 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.538+0000 7f361042a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601f7447c40 0x5601f7452370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:23.546 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.538+0000 7f361042a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f36081aafe0 con 0x5601f74428d0 2024-08-20T01:39:23.546 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.538+0000 7f361042a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f36081aa880 con 0x5601f7447c40 2024-08-20T01:39:23.546 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.538+0000 7f361042a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f36081a7ac0 con 0x5601f7445200 2024-08-20T01:39:23.546 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.538+0000 7f361042a740 10 client.0 _ll_register_callbacks cb 0x7f35fc005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:23.546 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.538+0000 7f3606ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5601f74428d0 0x5601f7451100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:23.546 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.538+0000 7f3606ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5601f74428d0 0x5601f7451100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41656/0 (socket says 172.21.15.79:41656) 2024-08-20T01:39:23.546 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.538+0000 7f3606ffd640 1 -- 172.21.15.79:0/1697636586 learned_addr learned my addr 172.21.15.79:0/1697636586 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:23.546 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.538+0000 7f36067fc640 1 --2- 172.21.15.79:0/1697636586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5601f7445200 0x5601f74517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:23.546 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.539+0000 7f36077fe640 1 --2- 172.21.15.79:0/1697636586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601f7447c40 0x5601f7452370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:23.547 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.539+0000 7f3606ffd640 1 -- 172.21.15.79:0/1697636586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5601f7445200 msgr2=0x5601f74517a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:23.547 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.539+0000 7f3606ffd640 1 --2- 172.21.15.79:0/1697636586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5601f7445200 0x5601f74517a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:23.547 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.539+0000 7f3606ffd640 1 -- 172.21.15.79:0/1697636586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601f7447c40 msgr2=0x5601f7452370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:23.547 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.539+0000 7f3606ffd640 1 --2- 172.21.15.79:0/1697636586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601f7447c40 0x5601f7452370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:23.547 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.539+0000 7f3606ffd640 1 -- 172.21.15.79:0/1697636586 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601f7445030 con 0x5601f74428d0 2024-08-20T01:39:23.547 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.539+0000 7f36077fe640 1 --2- 172.21.15.79:0/1697636586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601f7447c40 0x5601f7452370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:39:23.547 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.539+0000 7f3606ffd640 1 --2- 172.21.15.79:0/1697636586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5601f74428d0 0x5601f7451100 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f35f8003d40 tx=0x7f35f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=627b0717ec32c08d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:23.547 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.539+0000 7f35eaff5640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:39:23.547 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.539+0000 7f35eaff5640 1 -- 172.21.15.79:0/1697636586 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f801ea90 con 0x5601f74428d0 2024-08-20T01:39:23.547 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.539+0000 7f35eaff5640 1 -- 172.21.15.79:0/1697636586 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f35f801ec30 con 0x5601f74428d0 2024-08-20T01:39:23.547 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.539+0000 7f361042a740 1 -- 172.21.15.79:0/1697636586 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35fc107e50 con 0x5601f74428d0 2024-08-20T01:39:23.547 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.539+0000 7f35eaff5640 1 -- 172.21.15.79:0/1697636586 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f35f801ee30 con 0x5601f74428d0 2024-08-20T01:39:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.539+0000 7f361042a740 10 client.16323 fetch_fsmap learned FSMap version 33 2024-08-20T01:39:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.539+0000 7f361042a740 1 -- 172.21.15.79:0/1697636586 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5601f7453e60 con 0x5601f74428d0 2024-08-20T01:39:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.539+0000 7f35eaff5640 1 -- 172.21.15.79:0/1697636586 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f35fc107e50 con 0x5601f74428d0 2024-08-20T01:39:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.540+0000 7f35eaff5640 1 -- 172.21.15.79:0/1697636586 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7f35f8033610 con 0x5601f74428d0 2024-08-20T01:39:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.540+0000 7f361042a740 10 client.16323 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:39:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.540+0000 7f361042a740 10 client.16323 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:39:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.540+0000 7f361042a740 20 client.16323 populate_metadata read hostname 'smithi079' 2024-08-20T01:39:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.540+0000 7f361042a740 1 --2- 172.21.15.79:0/1697636586 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5601f74c2bd0 0x5601f74c4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.540+0000 7f361042a740 4 client.16323 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:39:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.540+0000 7f361042a740 1 -- 172.21.15.79:0/1697636586 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5601f73b2d50 con 0x5601f74c2bd0 2024-08-20T01:39:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.540+0000 7f36067fc640 1 --2- 172.21.15.79:0/1697636586 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5601f74c2bd0 0x5601f74c4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.540+0000 7f36067fc640 1 --2- 172.21.15.79:0/1697636586 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5601f74c2bd0 0x5601f74c4ff0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac908bead9647121 server_cookie=89e023418cd70e67 in_seq=0 out_seq=0 2024-08-20T01:39:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.540+0000 7f35eaff5640 10 client.16323 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:39:23.550 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.547+0000 7f35eaff5640 1 -- 172.21.15.79:0/1697636586 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5601f73b2d50 con 0x5601f74c2bd0 2024-08-20T01:39:23.550 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.547+0000 7f35eaff5640 10 client.16323 handle_command_reply: tid=0 2024-08-20T01:39:23.550 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.547+0000 7f361042a740 1 client.16323 shutdown 2024-08-20T01:39:23.550 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.547+0000 7f361042a740 1 -- 172.21.15.79:0/1697636586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5601f74428d0 msgr2=0x5601f7451100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:23.550 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.547+0000 7f361042a740 1 --2- 172.21.15.79:0/1697636586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5601f74428d0 0x5601f7451100 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f35f8003d40 tx=0x7f35f80046c0 comp rx=0 tx=0).stop 2024-08-20T01:39:23.550 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.547+0000 7f361042a740 1 -- 172.21.15.79:0/1697636586 shutdown_connections 2024-08-20T01:39:23.551 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.547+0000 7f361042a740 1 --2- 172.21.15.79:0/1697636586 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5601f74c2bd0 0x5601f74c4ff0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:23.551 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.547+0000 7f35eaff5640 0 client.16323 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:39:23.551 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.547+0000 7f361042a740 1 --2- 172.21.15.79:0/1697636586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601f7447c40 0x5601f7452370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:23.551 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.547+0000 7f361042a740 1 --2- 172.21.15.79:0/1697636586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5601f7445200 0x5601f74517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:23.551 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.547+0000 7f361042a740 1 --2- 172.21.15.79:0/1697636586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5601f74428d0 0x5601f7451100 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:23.551 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.548+0000 7f361042a740 1 -- 172.21.15.79:0/1697636586 >> 172.21.15.79:0/1697636586 conn(0x5601f743da20 msgr2=0x5601f743c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:23.551 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.548+0000 7f361042a740 1 -- 172.21.15.79:0/1697636586 shutdown_connections 2024-08-20T01:39:23.551 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.548+0000 7f361042a740 1 -- 172.21.15.79:0/1697636586 wait complete. 2024-08-20T01:39:23.551 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.548+0000 7f361042a740 20 client.16323 trim_cache size 0 max 16384 2024-08-20T01:39:23.551 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:39:23.552 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:39:23.552 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:39:23.552 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:39:23.552 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.548+0000 7f360d55c640 1 -- 172.21.15.79:0/2253982897 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f35f00b3c50 msgr2=0x7f35f00b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:23.552 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.548+0000 7f360d55c640 1 --2- 172.21.15.79:0/2253982897 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f35f00b3c50 0x7f35f00b6110 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f35f8004610 tx=0x7f35f800b390 comp rx=0 tx=0).stop 2024-08-20T01:39:23.553 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.548+0000 7f360d55c640 1 -- 172.21.15.79:0/2253982897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3608105830 msgr2=0x7f3608199010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:23.553 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.548+0000 7f360d55c640 1 --2- 172.21.15.79:0/2253982897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3608105830 0x7f3608199010 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f35fc005ab0 tx=0x7f35fc0042f0 comp rx=0 tx=0).stop 2024-08-20T01:39:23.553 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.548+0000 7f360d55c640 1 -- 172.21.15.79:0/2253982897 shutdown_connections 2024-08-20T01:39:23.553 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.548+0000 7f360d55c640 1 --2- 172.21.15.79:0/2253982897 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f35f00b3c50 0x7f35f00b6110 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:23.553 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.548+0000 7f360d55c640 1 --2- 172.21.15.79:0/2253982897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3608108380 0x7f3608199c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:23.553 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.548+0000 7f360d55c640 1 --2- 172.21.15.79:0/2253982897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3608105830 0x7f3608199010 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:23.553 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.548+0000 7f360d55c640 1 --2- 172.21.15.79:0/2253982897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f360806b0b0 0x7f36081989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:23.553 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.548+0000 7f360d55c640 1 -- 172.21.15.79:0/2253982897 >> 172.21.15.79:0/2253982897 conn(0x7f36080fce40 msgr2=0x7f3608103bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:23.553 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.549+0000 7f360d55c640 1 -- 172.21.15.79:0/2253982897 shutdown_connections 2024-08-20T01:39:23.553 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:23.549+0000 7f360d55c640 1 -- 172.21.15.79:0/2253982897 wait complete. 2024-08-20T01:39:24.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:23 smithi175 ceph-mon[22392]: pgmap v409: 97 pgs: 97 active+clean; 2.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 MiB/s wr, 38 op/s 2024-08-20T01:39:24.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:23 smithi079 ceph-mon[18656]: pgmap v409: 97 pgs: 97 active+clean; 2.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 MiB/s wr, 38 op/s 2024-08-20T01:39:24.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:23 smithi081 ceph-mon[22209]: pgmap v409: 97 pgs: 97 active+clean; 2.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 MiB/s wr, 38 op/s 2024-08-20T01:39:26.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:25 smithi175 ceph-mon[22392]: pgmap v410: 97 pgs: 97 active+clean; 2.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 30 MiB/s wr, 50 op/s 2024-08-20T01:39:26.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:25 smithi079 ceph-mon[18656]: pgmap v410: 97 pgs: 97 active+clean; 2.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 30 MiB/s wr, 50 op/s 2024-08-20T01:39:26.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:25 smithi081 ceph-mon[22209]: pgmap v410: 97 pgs: 97 active+clean; 2.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 30 MiB/s wr, 50 op/s 2024-08-20T01:39:28.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:27 smithi175 ceph-mon[22392]: pgmap v411: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 29 MiB/s wr, 47 op/s 2024-08-20T01:39:28.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:27 smithi079 ceph-mon[18656]: pgmap v411: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 29 MiB/s wr, 47 op/s 2024-08-20T01:39:28.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:27 smithi081 ceph-mon[22209]: pgmap v411: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 29 MiB/s wr, 47 op/s 2024-08-20T01:39:30.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:29 smithi175 ceph-mon[22392]: pgmap v412: 97 pgs: 97 active+clean; 2.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 29 MiB/s wr, 51 op/s 2024-08-20T01:39:30.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:29 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:39:30.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:29 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:39:30.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:29 smithi079 ceph-mon[18656]: pgmap v412: 97 pgs: 97 active+clean; 2.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 29 MiB/s wr, 51 op/s 2024-08-20T01:39:30.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:29 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:39:30.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:29 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:39:30.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:29 smithi081 ceph-mon[22209]: pgmap v412: 97 pgs: 97 active+clean; 2.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 29 MiB/s wr, 51 op/s 2024-08-20T01:39:30.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:29 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:39:30.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:29 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:39:31.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:30 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:39:31.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:30 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:39:31.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:30 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:39:31.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:30 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:39:31.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:30 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:39:31.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:30 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:39:32.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:31 smithi175 ceph-mon[22392]: pgmap v413: 97 pgs: 97 active+clean; 2.4 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 29 MiB/s wr, 47 op/s 2024-08-20T01:39:32.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:31 smithi079 ceph-mon[18656]: pgmap v413: 97 pgs: 97 active+clean; 2.4 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 29 MiB/s wr, 47 op/s 2024-08-20T01:39:32.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:31 smithi081 ceph-mon[22209]: pgmap v413: 97 pgs: 97 active+clean; 2.4 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 29 MiB/s wr, 47 op/s 2024-08-20T01:39:34.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:33 smithi175 ceph-mon[22392]: pgmap v414: 97 pgs: 97 active+clean; 2.4 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 29 MiB/s wr, 37 op/s 2024-08-20T01:39:34.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:33 smithi079 ceph-mon[18656]: pgmap v414: 97 pgs: 97 active+clean; 2.4 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 29 MiB/s wr, 37 op/s 2024-08-20T01:39:34.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:33 smithi081 ceph-mon[22209]: pgmap v414: 97 pgs: 97 active+clean; 2.4 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 29 MiB/s wr, 37 op/s 2024-08-20T01:39:36.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:35 smithi175 ceph-mon[22392]: pgmap v415: 97 pgs: 97 active+clean; 2.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 31 MiB/s wr, 33 op/s 2024-08-20T01:39:36.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:35 smithi079 ceph-mon[18656]: pgmap v415: 97 pgs: 97 active+clean; 2.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 31 MiB/s wr, 33 op/s 2024-08-20T01:39:36.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:35 smithi081 ceph-mon[22209]: pgmap v415: 97 pgs: 97 active+clean; 2.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 31 MiB/s wr, 33 op/s 2024-08-20T01:39:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.641+0000 7f8920d88640 1 -- 172.21.15.79:0/722510925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f891c103070 msgr2=0x7f891c1099f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.641+0000 7f8920d88640 1 --2- 172.21.15.79:0/722510925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f891c103070 0x7f891c1099f0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f8914009cd0 tx=0x7f891402a8e0 comp rx=0 tx=0).stop 2024-08-20T01:39:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.641+0000 7f8920d88640 1 -- 172.21.15.79:0/722510925 shutdown_connections 2024-08-20T01:39:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.641+0000 7f8920d88640 1 --2- 172.21.15.79:0/722510925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f891c103070 0x7f891c1099f0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.641+0000 7f8920d88640 1 --2- 172.21.15.79:0/722510925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f891c1026b0 0x7f891c102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.641+0000 7f8920d88640 1 --2- 172.21.15.79:0/722510925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f891c101560 0x7f891c101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.641+0000 7f8920d88640 1 -- 172.21.15.79:0/722510925 >> 172.21.15.79:0/722510925 conn(0x7f891c0fce40 msgr2=0x7f891c0ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.641+0000 7f8920d88640 1 -- 172.21.15.79:0/722510925 shutdown_connections 2024-08-20T01:39:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.641+0000 7f8920d88640 1 -- 172.21.15.79:0/722510925 wait complete. 2024-08-20T01:39:36.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.642+0000 7f8920d88640 1 Processor -- start 2024-08-20T01:39:36.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.642+0000 7f8920d88640 1 -- start start 2024-08-20T01:39:36.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.642+0000 7f8920d88640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f891c101560 0x7f891c197870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:36.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.642+0000 7f8920d88640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f891c1026b0 0x7f891c197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:36.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.643+0000 7f8920d88640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f891c103070 0x7f891c198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:36.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.643+0000 7f8920d88640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f891c10d0e0 con 0x7f891c101560 2024-08-20T01:39:36.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.643+0000 7f8920d88640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f891c10cf60 con 0x7f891c1026b0 2024-08-20T01:39:36.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.643+0000 7f8920d88640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f891c10d260 con 0x7f891c103070 2024-08-20T01:39:36.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.643+0000 7f891a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f891c101560 0x7f891c197870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:36.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.643+0000 7f891a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f891c101560 0x7f891c197870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47722/0 (socket says 172.21.15.79:47722) 2024-08-20T01:39:36.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.643+0000 7f8913fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f891c1026b0 0x7f891c197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:36.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.643+0000 7f891a59c640 1 -- 172.21.15.79:0/15548905 learned_addr learned my addr 172.21.15.79:0/15548905 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:36.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.643+0000 7f891ad9d640 1 --2- 172.21.15.79:0/15548905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f891c103070 0x7f891c198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:36.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.643+0000 7f891a59c640 1 -- 172.21.15.79:0/15548905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f891c103070 msgr2=0x7f891c198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:36.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.643+0000 7f891a59c640 1 --2- 172.21.15.79:0/15548905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f891c103070 0x7f891c198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:36.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.643+0000 7f891a59c640 1 -- 172.21.15.79:0/15548905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f891c1026b0 msgr2=0x7f891c197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:36.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.643+0000 7f891a59c640 1 --2- 172.21.15.79:0/15548905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f891c1026b0 0x7f891c197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:36.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.643+0000 7f891a59c640 1 -- 172.21.15.79:0/15548905 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f891c1993b0 con 0x7f891c101560 2024-08-20T01:39:36.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.643+0000 7f891ad9d640 1 --2- 172.21.15.79:0/15548905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f891c103070 0x7f891c198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:39:36.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.643+0000 7f891a59c640 1 --2- 172.21.15.79:0/15548905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f891c101560 0x7f891c197870 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f890c00d990 tx=0x7f890c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:36.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.643+0000 7f89137fe640 1 -- 172.21.15.79:0/15548905 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890c01b070 con 0x7f891c101560 2024-08-20T01:39:36.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.643+0000 7f89137fe640 1 -- 172.21.15.79:0/15548905 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f890c00ed70 con 0x7f891c101560 2024-08-20T01:39:36.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.643+0000 7f89137fe640 1 -- 172.21.15.79:0/15548905 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890c0145c0 con 0x7f891c101560 2024-08-20T01:39:36.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.643+0000 7f8920d88640 1 -- 172.21.15.79:0/15548905 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f891c1996a0 con 0x7f891c101560 2024-08-20T01:39:36.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.643+0000 7f8920d88640 1 -- 172.21.15.79:0/15548905 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f891c06a790 con 0x7f891c101560 2024-08-20T01:39:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.646+0000 7f8923c4e740 1 Processor -- start 2024-08-20T01:39:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.647+0000 7f8923c4e740 1 -- start start 2024-08-20T01:39:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.647+0000 7f89137fe640 1 -- 172.21.15.79:0/15548905 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f890c01e070 con 0x7f891c101560 2024-08-20T01:39:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.647+0000 7f8923c4e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef48fc6a40 0x55ef48fc8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.647+0000 7f8923c4e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef48fc9370 0x55ef48fcb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.647+0000 7f8923c4e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef48fcbdb0 0x55ef48fce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.647+0000 7f8923c4e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ef48f35360 con 0x55ef48fc6a40 2024-08-20T01:39:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.647+0000 7f8923c4e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ef48f24860 con 0x55ef48fc9370 2024-08-20T01:39:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.647+0000 7f8923c4e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ef48f288a0 con 0x55ef48fcbdb0 2024-08-20T01:39:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.647+0000 7f891ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef48fc6a40 0x55ef48fc8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.647+0000 7f891ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef48fc6a40 0x55ef48fc8e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47728/0 (socket says 172.21.15.79:47728) 2024-08-20T01:39:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.647+0000 7f891ad9d640 1 -- 172.21.15.79:0/4084233695 learned_addr learned my addr 172.21.15.79:0/4084233695 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.647+0000 7f8913fff640 1 --2- 172.21.15.79:0/4084233695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef48fcbdb0 0x55ef48fce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.647+0000 7f891a59c640 1 --2- 172.21.15.79:0/4084233695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef48fc9370 0x55ef48fcb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.647+0000 7f891ad9d640 1 -- 172.21.15.79:0/4084233695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef48fcbdb0 msgr2=0x55ef48fce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.647+0000 7f891ad9d640 1 --2- 172.21.15.79:0/4084233695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef48fcbdb0 0x55ef48fce270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.647+0000 7f891ad9d640 1 -- 172.21.15.79:0/4084233695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef48fc9370 msgr2=0x55ef48fcb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.647+0000 7f891ad9d640 1 --2- 172.21.15.79:0/4084233695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef48fc9370 0x55ef48fcb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.647+0000 7f891ad9d640 1 -- 172.21.15.79:0/4084233695 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef48ecbe40 con 0x55ef48fc6a40 2024-08-20T01:39:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.648+0000 7f89137fe640 1 --2- 172.21.15.79:0/15548905 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f89080b3bd0 0x7f89080b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.648+0000 7f891ad9d640 1 --2- 172.21.15.79:0/4084233695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef48fc6a40 0x55ef48fc8e30 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f8914005cc0 tx=0x7f8914009930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=299a2faaecf6f667 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:36.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.648+0000 7f8910ff9640 1 -- 172.21.15.79:0/4084233695 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8914031b90 con 0x55ef48fc6a40 2024-08-20T01:39:36.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.648+0000 7f891a59c640 1 --2- 172.21.15.79:0/15548905 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f89080b3bd0 0x7f89080b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:36.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.648+0000 7f8910ff9640 1 -- 172.21.15.79:0/4084233695 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8914036040 con 0x55ef48fc6a40 2024-08-20T01:39:36.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.648+0000 7f8910ff9640 1 -- 172.21.15.79:0/4084233695 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89140047d0 con 0x55ef48fc6a40 2024-08-20T01:39:36.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.648+0000 7f89137fe640 1 -- 172.21.15.79:0/15548905 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f890c007500 con 0x7f891c101560 2024-08-20T01:39:36.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.649+0000 7f8923c4e740 1 -- 172.21.15.79:0/4084233695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef48fc6a40 msgr2=0x55ef48fc8e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:36.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.649+0000 7f891a59c640 1 --2- 172.21.15.79:0/15548905 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f89080b3bd0 0x7f89080b6090 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f890c0a82f0 tx=0x7f890c0046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:36.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.649+0000 7f8923c4e740 1 --2- 172.21.15.79:0/4084233695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef48fc6a40 0x55ef48fc8e30 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f8914005cc0 tx=0x7f8914009930 comp rx=0 tx=0).stop 2024-08-20T01:39:36.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.649+0000 7f8923c4e740 1 -- 172.21.15.79:0/4084233695 shutdown_connections 2024-08-20T01:39:36.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.649+0000 7f8923c4e740 1 --2- 172.21.15.79:0/4084233695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef48fcbdb0 0x55ef48fce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:36.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.649+0000 7f8923c4e740 1 --2- 172.21.15.79:0/4084233695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef48fc9370 0x55ef48fcb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:36.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.649+0000 7f8923c4e740 1 --2- 172.21.15.79:0/4084233695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef48fc6a40 0x55ef48fc8e30 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:36.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.649+0000 7f8923c4e740 1 -- 172.21.15.79:0/4084233695 >> 172.21.15.79:0/4084233695 conn(0x55ef48fbd730 msgr2=0x55ef48fbe510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:36.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.649+0000 7f8923c4e740 1 -- 172.21.15.79:0/4084233695 shutdown_connections 2024-08-20T01:39:36.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.649+0000 7f8923c4e740 1 -- 172.21.15.79:0/4084233695 wait complete. 2024-08-20T01:39:36.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.649+0000 7f8923c4e740 1 -- start start 2024-08-20T01:39:36.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.649+0000 7f8923c4e740 1 Processor -- start 2024-08-20T01:39:36.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.649+0000 7f8923c4e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef48fc6a40 0x55ef48fd0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:36.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.649+0000 7f8923c4e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef48fc9370 0x55ef48fd08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:36.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.649+0000 7f8923c4e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef48fcbdb0 0x55ef48fd14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:36.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.649+0000 7f8923c4e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ef48e5dab0 con 0x55ef48fc6a40 2024-08-20T01:39:36.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.649+0000 7f8923c4e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ef48eab780 con 0x55ef48fcbdb0 2024-08-20T01:39:36.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.649+0000 7f8923c4e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ef48fced30 con 0x55ef48fc9370 2024-08-20T01:39:36.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.650+0000 7f8923c4e740 10 client.0 _ll_register_callbacks cb 0x55ef48c33a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:36.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.650+0000 7f891ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef48fc6a40 0x55ef48fd0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:36.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.650+0000 7f891ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef48fc6a40 0x55ef48fd0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47738/0 (socket says 172.21.15.79:47738) 2024-08-20T01:39:36.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.650+0000 7f891ad9d640 1 -- 172.21.15.79:0/3642575159 learned_addr learned my addr 172.21.15.79:0/3642575159 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:36.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.650+0000 7f8913fff640 1 --2- 172.21.15.79:0/3642575159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef48fc9370 0x55ef48fd08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:36.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.650+0000 7f891ad9d640 1 --2- 172.21.15.79:0/3642575159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef48fcbdb0 0x55ef48fd14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:36.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.650+0000 7f891ad9d640 1 -- 172.21.15.79:0/3642575159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef48fc9370 msgr2=0x55ef48fd08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:36.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.650+0000 7f891ad9d640 1 --2- 172.21.15.79:0/3642575159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef48fc9370 0x55ef48fd08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:36.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.650+0000 7f891ad9d640 1 -- 172.21.15.79:0/3642575159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef48fcbdb0 msgr2=0x55ef48fd14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:36.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.650+0000 7f891ad9d640 1 --2- 172.21.15.79:0/3642575159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef48fcbdb0 0x55ef48fd14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:36.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.650+0000 7f891ad9d640 1 -- 172.21.15.79:0/3642575159 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef48c87790 con 0x55ef48fc6a40 2024-08-20T01:39:36.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.650+0000 7f891ad9d640 1 --2- 172.21.15.79:0/3642575159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef48fc6a40 0x55ef48fd0230 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f8914009a60 tx=0x7f8914005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bc261c4be39d923 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:36.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.650+0000 7f8901ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:39:36.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.650+0000 7f8901ffb640 1 -- 172.21.15.79:0/3642575159 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8914003c00 con 0x55ef48fc6a40 2024-08-20T01:39:36.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.650+0000 7f8901ffb640 1 -- 172.21.15.79:0/3642575159 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f8914003da0 con 0x55ef48fc6a40 2024-08-20T01:39:36.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.650+0000 7f8923c4e740 1 -- 172.21.15.79:0/3642575159 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ef48ed3e00 con 0x55ef48fc6a40 2024-08-20T01:39:36.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.651+0000 7f8901ffb640 1 -- 172.21.15.79:0/3642575159 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f8914003fa0 con 0x55ef48fc6a40 2024-08-20T01:39:36.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.651+0000 7f8923c4e740 10 client.16335 fetch_fsmap learned FSMap version 33 2024-08-20T01:39:36.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.651+0000 7f8923c4e740 1 -- 172.21.15.79:0/3642575159 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55ef48d00620 con 0x55ef48fc6a40 2024-08-20T01:39:36.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.651+0000 7f8901ffb640 1 -- 172.21.15.79:0/3642575159 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55ef48ed3e00 con 0x55ef48fc6a40 2024-08-20T01:39:36.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.651+0000 7f8901ffb640 1 -- 172.21.15.79:0/3642575159 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7f8914056020 con 0x55ef48fc6a40 2024-08-20T01:39:36.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.651+0000 7f8923c4e740 10 client.16335 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:39:36.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.651+0000 7f8923c4e740 10 client.16335 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:39:36.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.651+0000 7f8923c4e740 20 client.16335 populate_metadata read hostname 'smithi079' 2024-08-20T01:39:36.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.651+0000 7f8923c4e740 1 --2- 172.21.15.79:0/3642575159 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55ef48fdb6d0 0x55ef48fddaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:36.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.651+0000 7f8923c4e740 4 client.16335 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:39:36.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.651+0000 7f8923c4e740 1 -- 172.21.15.79:0/3642575159 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ef48f372b0 con 0x55ef48fdb6d0 2024-08-20T01:39:36.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.651+0000 7f8913fff640 1 --2- 172.21.15.79:0/3642575159 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55ef48fdb6d0 0x55ef48fddaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:36.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.652+0000 7f8901ffb640 10 client.16335 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:39:36.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.652+0000 7f8913fff640 1 --2- 172.21.15.79:0/3642575159 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55ef48fdb6d0 0x55ef48fddaf0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aabce78f851c1a4e server_cookie=f531348b8e206077 in_seq=0 out_seq=0 2024-08-20T01:39:36.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.652+0000 7f8901ffb640 1 -- 172.21.15.79:0/3642575159 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ef48f372b0 con 0x55ef48fdb6d0 2024-08-20T01:39:36.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.652+0000 7f8901ffb640 10 client.16335 handle_command_reply: tid=0 2024-08-20T01:39:36.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.652+0000 7f8923c4e740 1 client.16335 shutdown 2024-08-20T01:39:36.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.652+0000 7f8923c4e740 1 -- 172.21.15.79:0/3642575159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef48fc6a40 msgr2=0x55ef48fd0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:36.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.652+0000 7f8923c4e740 1 --2- 172.21.15.79:0/3642575159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef48fc6a40 0x55ef48fd0230 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f8914009a60 tx=0x7f8914005fb0 comp rx=0 tx=0).stop 2024-08-20T01:39:36.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.652+0000 7f8923c4e740 1 -- 172.21.15.79:0/3642575159 shutdown_connections 2024-08-20T01:39:36.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.652+0000 7f8923c4e740 1 --2- 172.21.15.79:0/3642575159 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55ef48fdb6d0 0x55ef48fddaf0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:36.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.653+0000 7f8923c4e740 1 --2- 172.21.15.79:0/3642575159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef48fcbdb0 0x55ef48fd14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:36.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.653+0000 7f8923c4e740 1 --2- 172.21.15.79:0/3642575159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef48fc9370 0x55ef48fd08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:36.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.653+0000 7f8901ffb640 0 client.16335 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:39:36.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.653+0000 7f8923c4e740 1 --2- 172.21.15.79:0/3642575159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef48fc6a40 0x55ef48fd0230 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:36.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.653+0000 7f8923c4e740 1 -- 172.21.15.79:0/3642575159 >> 172.21.15.79:0/3642575159 conn(0x55ef48fbd730 msgr2=0x55ef48fbc850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:36.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.653+0000 7f8923c4e740 1 -- 172.21.15.79:0/3642575159 shutdown_connections 2024-08-20T01:39:36.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.653+0000 7f8923c4e740 1 -- 172.21.15.79:0/3642575159 wait complete. 2024-08-20T01:39:36.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.653+0000 7f8923c4e740 20 client.16335 trim_cache size 0 max 16384 2024-08-20T01:39:36.674 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.668+0000 7f8923c4e740 1 Processor -- start 2024-08-20T01:39:36.674 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.668+0000 7f8923c4e740 1 -- start start 2024-08-20T01:39:36.675 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.668+0000 7f8923c4e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef48fc6a40 0x55ef48fbd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:36.675 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.668+0000 7f8923c4e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef48fc9370 0x55ef48fd8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:36.675 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.668+0000 7f8923c4e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef48fcbdb0 0x55ef48fcc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:36.675 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.668+0000 7f8923c4e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f891c1a78c0 con 0x55ef48fc6a40 2024-08-20T01:39:36.675 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.668+0000 7f8923c4e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f891c1a9550 con 0x55ef48fcbdb0 2024-08-20T01:39:36.675 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.668+0000 7f8923c4e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f891c1a7f90 con 0x55ef48fc9370 2024-08-20T01:39:36.675 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.668+0000 7f891ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef48fc6a40 0x55ef48fbd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:36.675 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.668+0000 7f891ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef48fc6a40 0x55ef48fbd040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47752/0 (socket says 172.21.15.79:47752) 2024-08-20T01:39:36.675 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.668+0000 7f891ad9d640 1 -- 172.21.15.79:0/2891763117 learned_addr learned my addr 172.21.15.79:0/2891763117 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:36.675 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.668+0000 7f8913fff640 1 --2- 172.21.15.79:0/2891763117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef48fc9370 0x55ef48fd8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:36.675 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.668+0000 7f891ad9d640 1 --2- 172.21.15.79:0/2891763117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef48fcbdb0 0x55ef48fcc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:36.675 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.668+0000 7f891ad9d640 1 -- 172.21.15.79:0/2891763117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef48fc9370 msgr2=0x55ef48fd8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:36.675 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.668+0000 7f891ad9d640 1 --2- 172.21.15.79:0/2891763117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef48fc9370 0x55ef48fd8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.668+0000 7f891ad9d640 1 -- 172.21.15.79:0/2891763117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef48fcbdb0 msgr2=0x55ef48fcc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.668+0000 7f891ad9d640 1 --2- 172.21.15.79:0/2891763117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef48fcbdb0 0x55ef48fcc8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.668+0000 7f891ad9d640 1 -- 172.21.15.79:0/2891763117 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef48fc91a0 con 0x55ef48fc6a40 2024-08-20T01:39:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.668+0000 7f8913fff640 1 --2- 172.21.15.79:0/2891763117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef48fc9370 0x55ef48fd8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:39:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.669+0000 7f891ad9d640 1 --2- 172.21.15.79:0/2891763117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef48fc6a40 0x55ef48fbd040 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f8914002230 tx=0x7f89140095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ee66ce3785497ab server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.669+0000 7f8903fff640 1 -- 172.21.15.79:0/2891763117 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8914049020 con 0x55ef48fc6a40 2024-08-20T01:39:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.669+0000 7f8903fff640 1 -- 172.21.15.79:0/2891763117 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8914053070 con 0x55ef48fc6a40 2024-08-20T01:39:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.669+0000 7f8903fff640 1 -- 172.21.15.79:0/2891763117 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89140305a0 con 0x55ef48fc6a40 2024-08-20T01:39:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.670+0000 7f8923c4e740 1 -- 172.21.15.79:0/2891763117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef48fc6a40 msgr2=0x55ef48fbd040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.670+0000 7f8923c4e740 1 --2- 172.21.15.79:0/2891763117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef48fc6a40 0x55ef48fbd040 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f8914002230 tx=0x7f89140095c0 comp rx=0 tx=0).stop 2024-08-20T01:39:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.670+0000 7f8923c4e740 1 -- 172.21.15.79:0/2891763117 shutdown_connections 2024-08-20T01:39:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.670+0000 7f8923c4e740 1 --2- 172.21.15.79:0/2891763117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef48fcbdb0 0x55ef48fcc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:36.677 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.670+0000 7f8923c4e740 1 --2- 172.21.15.79:0/2891763117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef48fc9370 0x55ef48fd8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:36.677 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.670+0000 7f8923c4e740 1 --2- 172.21.15.79:0/2891763117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef48fc6a40 0x55ef48fbd040 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:36.677 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.670+0000 7f8923c4e740 1 -- 172.21.15.79:0/2891763117 >> 172.21.15.79:0/2891763117 conn(0x55ef48fbd730 msgr2=0x55ef48fcc190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:36.677 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.670+0000 7f8923c4e740 1 -- 172.21.15.79:0/2891763117 shutdown_connections 2024-08-20T01:39:36.677 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.670+0000 7f8923c4e740 1 -- 172.21.15.79:0/2891763117 wait complete. 2024-08-20T01:39:36.677 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.670+0000 7f8923c4e740 1 -- start start 2024-08-20T01:39:36.677 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.670+0000 7f8923c4e740 1 Processor -- start 2024-08-20T01:39:36.677 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.670+0000 7f8923c4e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef48fc6a40 0x55ef48fd52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:36.677 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.670+0000 7f8923c4e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef48fc9370 0x55ef48fd5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:36.677 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.670+0000 7f8923c4e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef48fcbdb0 0x55ef48fd6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:36.677 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.670+0000 7f8923c4e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f891c1a8dc0 con 0x55ef48fc9370 2024-08-20T01:39:36.677 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.670+0000 7f8923c4e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f891c1a8660 con 0x55ef48fc6a40 2024-08-20T01:39:36.678 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.670+0000 7f8923c4e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f891c1a58a0 con 0x55ef48fcbdb0 2024-08-20T01:39:36.678 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.670+0000 7f8923c4e740 10 client.0 _ll_register_callbacks cb 0x7f891403f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:36.678 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.670+0000 7f8913fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef48fc9370 0x55ef48fd5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:36.678 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.670+0000 7f8913fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef48fc9370 0x55ef48fd5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47768/0 (socket says 172.21.15.79:47768) 2024-08-20T01:39:36.678 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.670+0000 7f8913fff640 1 -- 172.21.15.79:0/502626866 learned_addr learned my addr 172.21.15.79:0/502626866 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:36.678 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.671+0000 7f891ad9d640 1 --2- 172.21.15.79:0/502626866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef48fc6a40 0x55ef48fd52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:36.678 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.671+0000 7f891ad9d640 1 --2- 172.21.15.79:0/502626866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef48fcbdb0 0x55ef48fd6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:36.678 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.671+0000 7f8913fff640 1 -- 172.21.15.79:0/502626866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef48fcbdb0 msgr2=0x55ef48fd6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:36.678 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.671+0000 7f8913fff640 1 --2- 172.21.15.79:0/502626866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef48fcbdb0 0x55ef48fd6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:36.678 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.671+0000 7f8913fff640 1 -- 172.21.15.79:0/502626866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef48fc6a40 msgr2=0x55ef48fd52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:36.678 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.671+0000 7f8913fff640 1 --2- 172.21.15.79:0/502626866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef48fc6a40 0x55ef48fd52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:36.679 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.671+0000 7f8913fff640 1 -- 172.21.15.79:0/502626866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef48fd1810 con 0x55ef48fc9370 2024-08-20T01:39:36.679 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.671+0000 7f891ad9d640 1 --2- 172.21.15.79:0/502626866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef48fcbdb0 0x55ef48fd6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:39:36.679 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.671+0000 7f8913fff640 1 --2- 172.21.15.79:0/502626866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef48fc9370 0x55ef48fd5960 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f890400add0 tx=0x7f8904010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b59ffd8e5f01fe2f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:36.679 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.671+0000 7f8901ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:39:36.679 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.671+0000 7f8901ffb640 1 -- 172.21.15.79:0/502626866 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890402b060 con 0x55ef48fc9370 2024-08-20T01:39:36.679 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.671+0000 7f8901ffb640 1 -- 172.21.15.79:0/502626866 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f8904005230 con 0x55ef48fc9370 2024-08-20T01:39:36.679 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.671+0000 7f8923c4e740 1 -- 172.21.15.79:0/502626866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8914053070 con 0x55ef48fc9370 2024-08-20T01:39:36.679 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.671+0000 7f8901ffb640 1 -- 172.21.15.79:0/502626866 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f8904005430 con 0x55ef48fc9370 2024-08-20T01:39:36.679 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.671+0000 7f8923c4e740 10 client.16341 fetch_fsmap learned FSMap version 33 2024-08-20T01:39:36.679 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.671+0000 7f8923c4e740 1 -- 172.21.15.79:0/502626866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55ef48fd8020 con 0x55ef48fc9370 2024-08-20T01:39:36.679 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.671+0000 7f8901ffb640 1 -- 172.21.15.79:0/502626866 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8914053070 con 0x55ef48fc9370 2024-08-20T01:39:36.679 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.672+0000 7f8901ffb640 1 -- 172.21.15.79:0/502626866 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7f890401e8d0 con 0x55ef48fc9370 2024-08-20T01:39:36.679 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.672+0000 7f8923c4e740 10 client.16341 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:39:36.679 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.672+0000 7f8923c4e740 10 client.16341 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:39:36.680 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.672+0000 7f8923c4e740 20 client.16341 populate_metadata read hostname 'smithi079' 2024-08-20T01:39:36.680 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.672+0000 7f8923c4e740 1 --2- 172.21.15.79:0/502626866 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55ef490463e0 0x55ef49048800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:36.680 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.672+0000 7f8923c4e740 4 client.16341 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:39:36.680 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.672+0000 7f8923c4e740 1 -- 172.21.15.79:0/502626866 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ef48f32d50 con 0x55ef490463e0 2024-08-20T01:39:36.680 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.672+0000 7f891ad9d640 1 --2- 172.21.15.79:0/502626866 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55ef490463e0 0x55ef49048800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:36.680 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.672+0000 7f891ad9d640 1 --2- 172.21.15.79:0/502626866 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55ef490463e0 0x55ef49048800 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f25f9245777da357 server_cookie=92f2b9c5af3c25dd in_seq=0 out_seq=0 2024-08-20T01:39:36.680 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.672+0000 7f8901ffb640 10 client.16341 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:39:36.682 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.679+0000 7f8901ffb640 1 -- 172.21.15.79:0/502626866 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ef48f32d50 con 0x55ef490463e0 2024-08-20T01:39:36.682 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.679+0000 7f8901ffb640 10 client.16341 handle_command_reply: tid=0 2024-08-20T01:39:36.682 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.679+0000 7f8923c4e740 1 client.16341 shutdown 2024-08-20T01:39:36.682 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.679+0000 7f8923c4e740 1 -- 172.21.15.79:0/502626866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef48fc9370 msgr2=0x55ef48fd5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:36.682 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.679+0000 7f8923c4e740 1 --2- 172.21.15.79:0/502626866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef48fc9370 0x55ef48fd5960 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f890400add0 tx=0x7f8904010800 comp rx=0 tx=0).stop 2024-08-20T01:39:36.682 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.679+0000 7f8923c4e740 1 -- 172.21.15.79:0/502626866 shutdown_connections 2024-08-20T01:39:36.682 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.679+0000 7f8923c4e740 1 --2- 172.21.15.79:0/502626866 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55ef490463e0 0x55ef49048800 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:36.682 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.679+0000 7f8923c4e740 1 --2- 172.21.15.79:0/502626866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef48fcbdb0 0x55ef48fd6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:36.682 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.679+0000 7f8923c4e740 1 --2- 172.21.15.79:0/502626866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef48fc9370 0x55ef48fd5960 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:36.682 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.679+0000 7f8923c4e740 1 --2- 172.21.15.79:0/502626866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef48fc6a40 0x55ef48fd52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:36.682 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.679+0000 7f8923c4e740 1 -- 172.21.15.79:0/502626866 >> 172.21.15.79:0/502626866 conn(0x55ef48fbd730 msgr2=0x55ef48fcc190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:36.683 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.679+0000 7f8901ffb640 0 client.16341 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:39:36.683 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.679+0000 7f8923c4e740 1 -- 172.21.15.79:0/502626866 shutdown_connections 2024-08-20T01:39:36.683 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.679+0000 7f8923c4e740 1 -- 172.21.15.79:0/502626866 wait complete. 2024-08-20T01:39:36.683 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.679+0000 7f8923c4e740 20 client.16341 trim_cache size 0 max 16384 2024-08-20T01:39:36.683 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:39:36.683 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:39:36.683 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:39:36.683 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:39:36.684 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.680+0000 7f8920d88640 1 -- 172.21.15.79:0/15548905 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f89080b3bd0 msgr2=0x7f89080b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:36.684 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.680+0000 7f8920d88640 1 --2- 172.21.15.79:0/15548905 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f89080b3bd0 0x7f89080b6090 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f890c0a82f0 tx=0x7f890c0046c0 comp rx=0 tx=0).stop 2024-08-20T01:39:36.684 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.680+0000 7f8920d88640 1 -- 172.21.15.79:0/15548905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f891c101560 msgr2=0x7f891c197870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:36.684 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.680+0000 7f8920d88640 1 --2- 172.21.15.79:0/15548905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f891c101560 0x7f891c197870 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f890c00d990 tx=0x7f890c00dd90 comp rx=0 tx=0).stop 2024-08-20T01:39:36.684 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.680+0000 7f8920d88640 1 -- 172.21.15.79:0/15548905 shutdown_connections 2024-08-20T01:39:36.684 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.680+0000 7f8920d88640 1 --2- 172.21.15.79:0/15548905 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f89080b3bd0 0x7f89080b6090 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:36.684 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.680+0000 7f8920d88640 1 --2- 172.21.15.79:0/15548905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f891c103070 0x7f891c198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:36.684 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.680+0000 7f8920d88640 1 --2- 172.21.15.79:0/15548905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f891c1026b0 0x7f891c197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:36.685 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.680+0000 7f8920d88640 1 --2- 172.21.15.79:0/15548905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f891c101560 0x7f891c197870 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:36.685 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.680+0000 7f8920d88640 1 -- 172.21.15.79:0/15548905 >> 172.21.15.79:0/15548905 conn(0x7f891c0fce40 msgr2=0x7f891c105a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:36.685 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.680+0000 7f8920d88640 1 -- 172.21.15.79:0/15548905 shutdown_connections 2024-08-20T01:39:36.685 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:36.680+0000 7f8920d88640 1 -- 172.21.15.79:0/15548905 wait complete. 2024-08-20T01:39:38.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:37 smithi175 ceph-mon[22392]: pgmap v416: 97 pgs: 97 active+clean; 2.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 23 op/s 2024-08-20T01:39:38.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:37 smithi079 ceph-mon[18656]: pgmap v416: 97 pgs: 97 active+clean; 2.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 23 op/s 2024-08-20T01:39:38.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:37 smithi081 ceph-mon[22209]: pgmap v416: 97 pgs: 97 active+clean; 2.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 23 op/s 2024-08-20T01:39:40.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:39 smithi175 ceph-mon[22392]: pgmap v417: 97 pgs: 97 active+clean; 2.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 30 MiB/s wr, 27 op/s 2024-08-20T01:39:40.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:39 smithi079 ceph-mon[18656]: pgmap v417: 97 pgs: 97 active+clean; 2.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 30 MiB/s wr, 27 op/s 2024-08-20T01:39:40.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:39 smithi081 ceph-mon[22209]: pgmap v417: 97 pgs: 97 active+clean; 2.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 30 MiB/s wr, 27 op/s 2024-08-20T01:39:42.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:41 smithi175 ceph-mon[22392]: pgmap v418: 97 pgs: 97 active+clean; 2.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 32 MiB/s wr, 23 op/s 2024-08-20T01:39:42.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:41 smithi079 ceph-mon[18656]: pgmap v418: 97 pgs: 97 active+clean; 2.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 32 MiB/s wr, 23 op/s 2024-08-20T01:39:42.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:41 smithi081 ceph-mon[22209]: pgmap v418: 97 pgs: 97 active+clean; 2.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 32 MiB/s wr, 23 op/s 2024-08-20T01:39:44.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:43 smithi175 ceph-mon[22392]: pgmap v419: 97 pgs: 97 active+clean; 2.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-08-20T01:39:44.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:43 smithi079 ceph-mon[18656]: pgmap v419: 97 pgs: 97 active+clean; 2.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-08-20T01:39:44.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:43 smithi081 ceph-mon[22209]: pgmap v419: 97 pgs: 97 active+clean; 2.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-08-20T01:39:46.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:45 smithi175 ceph-mon[22392]: pgmap v420: 97 pgs: 97 active+clean; 2.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 30 MiB/s wr, 25 op/s 2024-08-20T01:39:46.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:45 smithi079 ceph-mon[18656]: pgmap v420: 97 pgs: 97 active+clean; 2.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 30 MiB/s wr, 25 op/s 2024-08-20T01:39:46.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:45 smithi081 ceph-mon[22209]: pgmap v420: 97 pgs: 97 active+clean; 2.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 30 MiB/s wr, 25 op/s 2024-08-20T01:39:48.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:47 smithi175 ceph-mon[22392]: pgmap v421: 97 pgs: 97 active+clean; 2.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 24 op/s 2024-08-20T01:39:48.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:47 smithi079 ceph-mon[18656]: pgmap v421: 97 pgs: 97 active+clean; 2.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 24 op/s 2024-08-20T01:39:48.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:47 smithi081 ceph-mon[22209]: pgmap v421: 97 pgs: 97 active+clean; 2.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 24 op/s 2024-08-20T01:39:49.781 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.776+0000 7ff795adc640 1 -- 172.21.15.79:0/2946920625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff790103070 msgr2=0x7ff7901099f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:49.781 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.776+0000 7ff795adc640 1 --2- 172.21.15.79:0/2946920625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff790103070 0x7ff7901099f0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7ff788009cd0 tx=0x7ff78802a8e0 comp rx=0 tx=0).stop 2024-08-20T01:39:49.781 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.776+0000 7ff795adc640 1 -- 172.21.15.79:0/2946920625 shutdown_connections 2024-08-20T01:39:49.781 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.776+0000 7ff795adc640 1 --2- 172.21.15.79:0/2946920625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff790103070 0x7ff7901099f0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:49.781 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.776+0000 7ff795adc640 1 --2- 172.21.15.79:0/2946920625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7901026b0 0x7ff790102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:49.781 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.776+0000 7ff795adc640 1 --2- 172.21.15.79:0/2946920625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff790101560 0x7ff790101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:49.781 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.776+0000 7ff795adc640 1 -- 172.21.15.79:0/2946920625 >> 172.21.15.79:0/2946920625 conn(0x7ff7900fce40 msgr2=0x7ff7900ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:49.781 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.776+0000 7ff795adc640 1 -- 172.21.15.79:0/2946920625 shutdown_connections 2024-08-20T01:39:49.781 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.776+0000 7ff795adc640 1 -- 172.21.15.79:0/2946920625 wait complete. 2024-08-20T01:39:49.781 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.777+0000 7ff795adc640 1 Processor -- start 2024-08-20T01:39:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.777+0000 7ff795adc640 1 -- start start 2024-08-20T01:39:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.777+0000 7ff795adc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff790101560 0x7ff7901989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.777+0000 7ff795adc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7901026b0 0x7ff790199000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.777+0000 7ff795adc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff790103070 0x7ff790199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.777+0000 7ff795adc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff79010d130 con 0x7ff790101560 2024-08-20T01:39:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.777+0000 7ff795adc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff79010cfb0 con 0x7ff7901026b0 2024-08-20T01:39:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.777+0000 7ff795adc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff79010d2b0 con 0x7ff790103070 2024-08-20T01:39:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.777+0000 7ff78f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff790101560 0x7ff7901989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.777+0000 7ff78f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff790101560 0x7ff7901989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41494/0 (socket says 172.21.15.79:41494) 2024-08-20T01:39:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.777+0000 7ff78f7fe640 1 -- 172.21.15.79:0/2152280832 learned_addr learned my addr 172.21.15.79:0/2152280832 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.778+0000 7ff787fff640 1 --2- 172.21.15.79:0/2152280832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7901026b0 0x7ff790199000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.778+0000 7ff78ffff640 1 --2- 172.21.15.79:0/2152280832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff790103070 0x7ff790199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:49.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.778+0000 7ff78f7fe640 1 -- 172.21.15.79:0/2152280832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff790103070 msgr2=0x7ff790199c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:49.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.778+0000 7ff78f7fe640 1 --2- 172.21.15.79:0/2152280832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff790103070 0x7ff790199c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:49.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.778+0000 7ff78f7fe640 1 -- 172.21.15.79:0/2152280832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7901026b0 msgr2=0x7ff790199000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:49.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.778+0000 7ff78f7fe640 1 --2- 172.21.15.79:0/2152280832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7901026b0 0x7ff790199000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:49.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.778+0000 7ff78f7fe640 1 -- 172.21.15.79:0/2152280832 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff79019a4f0 con 0x7ff790101560 2024-08-20T01:39:49.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.778+0000 7ff78ffff640 1 --2- 172.21.15.79:0/2152280832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff790103070 0x7ff790199c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:39:49.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.778+0000 7ff787fff640 1 --2- 172.21.15.79:0/2152280832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7901026b0 0x7ff790199000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:39:49.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.778+0000 7ff78f7fe640 1 --2- 172.21.15.79:0/2152280832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff790101560 0x7ff7901989b0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7ff78000b4a0 tx=0x7ff78000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:49.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.778+0000 7ff78d7fa640 1 -- 172.21.15.79:0/2152280832 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff780014070 con 0x7ff790101560 2024-08-20T01:39:49.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.778+0000 7ff78d7fa640 1 -- 172.21.15.79:0/2152280832 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff780010aa0 con 0x7ff790101560 2024-08-20T01:39:49.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.778+0000 7ff795adc640 1 -- 172.21.15.79:0/2152280832 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff79019a7e0 con 0x7ff790101560 2024-08-20T01:39:49.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.778+0000 7ff78d7fa640 1 -- 172.21.15.79:0/2152280832 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff780017b70 con 0x7ff790101560 2024-08-20T01:39:49.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.778+0000 7ff795adc640 1 -- 172.21.15.79:0/2152280832 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7901a0eb0 con 0x7ff790101560 2024-08-20T01:39:49.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.781+0000 7ff7988cd740 1 Processor -- start 2024-08-20T01:39:49.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.781+0000 7ff7988cd740 1 -- start start 2024-08-20T01:39:49.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.781+0000 7ff78d7fa640 1 -- 172.21.15.79:0/2152280832 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff780017070 con 0x7ff790101560 2024-08-20T01:39:49.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.781+0000 7ff7988cd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c6cb888d0 0x558c6cb8acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:49.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.781+0000 7ff7988cd740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c6cb8b200 0x558c6cb8d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:49.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.781+0000 7ff7988cd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c6cb8dc40 0x558c6cb90100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:49.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.781+0000 7ff7988cd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558c6cafb360 con 0x558c6cb888d0 2024-08-20T01:39:49.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.781+0000 7ff7988cd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558c6caea860 con 0x558c6cb8dc40 2024-08-20T01:39:49.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.781+0000 7ff7988cd740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558c6caee8a0 con 0x558c6cb8b200 2024-08-20T01:39:49.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.782+0000 7ff78ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c6cb888d0 0x558c6cb8acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:49.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.782+0000 7ff78ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c6cb888d0 0x558c6cb8acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41504/0 (socket says 172.21.15.79:41504) 2024-08-20T01:39:49.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.782+0000 7ff78ffff640 1 -- 172.21.15.79:0/2018857071 learned_addr learned my addr 172.21.15.79:0/2018857071 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:49.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.782+0000 7ff787fff640 1 --2- 172.21.15.79:0/2018857071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c6cb8dc40 0x558c6cb90100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:49.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.782+0000 7ff78ffff640 1 -- 172.21.15.79:0/2018857071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c6cb8b200 msgr2=0x558c6cb8d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:49.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.782+0000 7ff78ffff640 1 --2- 172.21.15.79:0/2018857071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c6cb8b200 0x558c6cb8d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:49.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.782+0000 7ff78ffff640 1 -- 172.21.15.79:0/2018857071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c6cb8dc40 msgr2=0x558c6cb90100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:49.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.782+0000 7ff78ffff640 1 --2- 172.21.15.79:0/2018857071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c6cb8dc40 0x558c6cb90100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:49.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.782+0000 7ff78ffff640 1 -- 172.21.15.79:0/2018857071 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c6ca91e40 con 0x558c6cb888d0 2024-08-20T01:39:49.791 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.782+0000 7ff78ffff640 1 --2- 172.21.15.79:0/2018857071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c6cb888d0 0x558c6cb8acc0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7ff7880098e0 tx=0x7ff788009910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=524f854d7c348bee server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:49.791 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.782+0000 7ff785ffb640 1 -- 172.21.15.79:0/2018857071 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff788031b10 con 0x558c6cb888d0 2024-08-20T01:39:49.791 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.782+0000 7ff78d7fa640 1 --2- 172.21.15.79:0/2152280832 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff77c0b3bd0 0x7ff77c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:49.791 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.783+0000 7ff785ffb640 1 -- 172.21.15.79:0/2018857071 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff788036040 con 0x558c6cb888d0 2024-08-20T01:39:49.791 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.783+0000 7ff785ffb640 1 -- 172.21.15.79:0/2018857071 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff788004850 con 0x558c6cb888d0 2024-08-20T01:39:49.791 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.783+0000 7ff78f7fe640 1 --2- 172.21.15.79:0/2152280832 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff77c0b3bd0 0x7ff77c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:49.791 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.783+0000 7ff78d7fa640 1 -- 172.21.15.79:0/2152280832 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff7800e3380 con 0x7ff790101560 2024-08-20T01:39:49.791 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.783+0000 7ff7988cd740 1 -- 172.21.15.79:0/2018857071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c6cb888d0 msgr2=0x558c6cb8acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:49.791 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.783+0000 7ff78f7fe640 1 --2- 172.21.15.79:0/2152280832 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff77c0b3bd0 0x7ff77c0b6090 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff7800aa270 tx=0x7ff78006f5f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:49.791 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.783+0000 7ff7988cd740 1 --2- 172.21.15.79:0/2018857071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c6cb888d0 0x558c6cb8acc0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7ff7880098e0 tx=0x7ff788009910 comp rx=0 tx=0).stop 2024-08-20T01:39:49.791 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.784+0000 7ff7988cd740 1 -- 172.21.15.79:0/2018857071 shutdown_connections 2024-08-20T01:39:49.791 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.784+0000 7ff7988cd740 1 --2- 172.21.15.79:0/2018857071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c6cb8dc40 0x558c6cb90100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:49.791 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.784+0000 7ff7988cd740 1 --2- 172.21.15.79:0/2018857071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c6cb8b200 0x558c6cb8d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:49.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.784+0000 7ff7988cd740 1 --2- 172.21.15.79:0/2018857071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c6cb888d0 0x558c6cb8acc0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:49.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.784+0000 7ff7988cd740 1 -- 172.21.15.79:0/2018857071 >> 172.21.15.79:0/2018857071 conn(0x558c6cb83a20 msgr2=0x558c6cb847b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:49.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.784+0000 7ff7988cd740 1 -- 172.21.15.79:0/2018857071 shutdown_connections 2024-08-20T01:39:49.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.784+0000 7ff7988cd740 1 -- 172.21.15.79:0/2018857071 wait complete. 2024-08-20T01:39:49.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.784+0000 7ff7988cd740 1 -- start start 2024-08-20T01:39:49.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.784+0000 7ff7988cd740 1 Processor -- start 2024-08-20T01:39:49.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.785+0000 7ff7988cd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c6cb888d0 0x558c6cb96540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:49.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.785+0000 7ff7988cd740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c6cb8b200 0x558c6cb96be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:49.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.785+0000 7ff7988cd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c6cb8dc40 0x558c6cb977b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:49.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.785+0000 7ff7988cd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558c6ca23ab0 con 0x558c6cb888d0 2024-08-20T01:39:49.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.785+0000 7ff7988cd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558c6ca71780 con 0x558c6cb8dc40 2024-08-20T01:39:49.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.785+0000 7ff7988cd740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558c6cb94fd0 con 0x558c6cb8b200 2024-08-20T01:39:49.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.785+0000 7ff7988cd740 10 client.0 _ll_register_callbacks cb 0x558c6c7f9a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:49.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.785+0000 7ff78ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c6cb888d0 0x558c6cb96540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:49.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.785+0000 7ff78ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c6cb888d0 0x558c6cb96540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41506/0 (socket says 172.21.15.79:41506) 2024-08-20T01:39:49.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.785+0000 7ff78ffff640 1 -- 172.21.15.79:0/139681227 learned_addr learned my addr 172.21.15.79:0/139681227 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:49.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.785+0000 7ff78ffff640 1 -- 172.21.15.79:0/139681227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c6cb8b200 msgr2=0x558c6cb96be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:49.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.785+0000 7ff78ffff640 1 --2- 172.21.15.79:0/139681227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c6cb8b200 0x558c6cb96be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:49.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.785+0000 7ff78ffff640 1 -- 172.21.15.79:0/139681227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c6cb8dc40 msgr2=0x558c6cb977b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:49.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.785+0000 7ff78ffff640 1 --2- 172.21.15.79:0/139681227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c6cb8dc40 0x558c6cb977b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:49.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.785+0000 7ff78ffff640 1 -- 172.21.15.79:0/139681227 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c6c84d790 con 0x558c6cb888d0 2024-08-20T01:39:49.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.786+0000 7ff78ffff640 1 --2- 172.21.15.79:0/139681227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c6cb888d0 0x558c6cb96540 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7ff788031650 tx=0x7ff788031b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=239446a329027be9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:49.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.786+0000 7ff76effd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:39:49.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.786+0000 7ff76effd640 1 -- 172.21.15.79:0/139681227 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff788003970 con 0x558c6cb888d0 2024-08-20T01:39:49.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.786+0000 7ff76effd640 1 -- 172.21.15.79:0/139681227 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff788003b10 con 0x558c6cb888d0 2024-08-20T01:39:49.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.786+0000 7ff7988cd740 1 -- 172.21.15.79:0/139681227 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558c6ca99e00 con 0x558c6cb888d0 2024-08-20T01:39:49.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.786+0000 7ff76effd640 1 -- 172.21.15.79:0/139681227 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7ff788003d10 con 0x558c6cb888d0 2024-08-20T01:39:49.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.786+0000 7ff7988cd740 10 client.16353 fetch_fsmap learned FSMap version 33 2024-08-20T01:39:49.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.786+0000 7ff7988cd740 1 -- 172.21.15.79:0/139681227 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x558c6c8c6620 con 0x558c6cb888d0 2024-08-20T01:39:49.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.786+0000 7ff76effd640 1 -- 172.21.15.79:0/139681227 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x558c6ca99e00 con 0x558c6cb888d0 2024-08-20T01:39:49.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.787+0000 7ff76effd640 1 -- 172.21.15.79:0/139681227 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7ff788057030 con 0x558c6cb888d0 2024-08-20T01:39:49.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.787+0000 7ff7988cd740 10 client.16353 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:39:49.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.787+0000 7ff7988cd740 10 client.16353 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:39:49.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.787+0000 7ff7988cd740 20 client.16353 populate_metadata read hostname 'smithi079' 2024-08-20T01:39:49.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.787+0000 7ff7988cd740 1 --2- 172.21.15.79:0/139681227 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558c6cba1a30 0x558c6cba3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:49.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.787+0000 7ff7988cd740 4 client.16353 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:39:49.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.787+0000 7ff7988cd740 1 -- 172.21.15.79:0/139681227 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c6cafd2b0 con 0x558c6cba1a30 2024-08-20T01:39:49.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.787+0000 7ff787fff640 1 --2- 172.21.15.79:0/139681227 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558c6cba1a30 0x558c6cba3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:49.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.788+0000 7ff787fff640 1 --2- 172.21.15.79:0/139681227 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558c6cba1a30 0x558c6cba3e40 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b7752db3fe5063f server_cookie=24a702d40ebb802 in_seq=0 out_seq=0 2024-08-20T01:39:49.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.788+0000 7ff76effd640 10 client.16353 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:39:49.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.789+0000 7ff76effd640 1 -- 172.21.15.79:0/139681227 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558c6cafd2b0 con 0x558c6cba1a30 2024-08-20T01:39:49.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.789+0000 7ff76effd640 10 client.16353 handle_command_reply: tid=0 2024-08-20T01:39:49.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.789+0000 7ff7988cd740 1 client.16353 shutdown 2024-08-20T01:39:49.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.790+0000 7ff7988cd740 1 -- 172.21.15.79:0/139681227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c6cb888d0 msgr2=0x558c6cb96540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:49.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.790+0000 7ff7988cd740 1 --2- 172.21.15.79:0/139681227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c6cb888d0 0x558c6cb96540 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7ff788031650 tx=0x7ff788031b40 comp rx=0 tx=0).stop 2024-08-20T01:39:49.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.790+0000 7ff7988cd740 1 -- 172.21.15.79:0/139681227 shutdown_connections 2024-08-20T01:39:49.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.790+0000 7ff7988cd740 1 --2- 172.21.15.79:0/139681227 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558c6cba1a30 0x558c6cba3e40 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:49.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.790+0000 7ff7988cd740 1 --2- 172.21.15.79:0/139681227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c6cb8dc40 0x558c6cb977b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:49.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.790+0000 7ff7988cd740 1 --2- 172.21.15.79:0/139681227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c6cb8b200 0x558c6cb96be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:49.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.790+0000 7ff7988cd740 1 --2- 172.21.15.79:0/139681227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c6cb888d0 0x558c6cb96540 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:49.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.790+0000 7ff7988cd740 1 -- 172.21.15.79:0/139681227 >> 172.21.15.79:0/139681227 conn(0x558c6cb83a20 msgr2=0x558c6cb82ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:49.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.790+0000 7ff76effd640 0 client.16353 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:39:49.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.790+0000 7ff7988cd740 1 -- 172.21.15.79:0/139681227 shutdown_connections 2024-08-20T01:39:49.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.790+0000 7ff7988cd740 1 -- 172.21.15.79:0/139681227 wait complete. 2024-08-20T01:39:49.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.790+0000 7ff7988cd740 20 client.16353 trim_cache size 0 max 16384 2024-08-20T01:39:49.811 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.808+0000 7ff7988cd740 1 Processor -- start 2024-08-20T01:39:49.812 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.808+0000 7ff7988cd740 1 -- start start 2024-08-20T01:39:49.812 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.808+0000 7ff7988cd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c6cb888d0 0x558c6cb822c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:49.812 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.808+0000 7ff7988cd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c6cb8b200 0x558c6cb82800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:49.812 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.808+0000 7ff7988cd740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c6cb8dc40 0x558c6cb82d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:49.812 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.808+0000 7ff7988cd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff7901a7900 con 0x558c6cb8b200 2024-08-20T01:39:49.812 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.808+0000 7ff7988cd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff7901a9590 con 0x558c6cb888d0 2024-08-20T01:39:49.812 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.808+0000 7ff7988cd740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff7901a7fd0 con 0x558c6cb8dc40 2024-08-20T01:39:49.812 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.808+0000 7ff787fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c6cb8b200 0x558c6cb82800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:49.812 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.808+0000 7ff787fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c6cb8b200 0x558c6cb82800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41518/0 (socket says 172.21.15.79:41518) 2024-08-20T01:39:49.812 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.808+0000 7ff787fff640 1 -- 172.21.15.79:0/2716817234 learned_addr learned my addr 172.21.15.79:0/2716817234 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:49.812 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.808+0000 7ff78ffff640 1 --2- 172.21.15.79:0/2716817234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c6cb888d0 0x558c6cb822c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:49.813 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.808+0000 7ff78ffff640 1 --2- 172.21.15.79:0/2716817234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c6cb8dc40 0x558c6cb82d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:49.813 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.808+0000 7ff787fff640 1 -- 172.21.15.79:0/2716817234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c6cb8dc40 msgr2=0x558c6cb82d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:49.813 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.808+0000 7ff787fff640 1 --2- 172.21.15.79:0/2716817234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c6cb8dc40 0x558c6cb82d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:49.813 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.808+0000 7ff787fff640 1 -- 172.21.15.79:0/2716817234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c6cb888d0 msgr2=0x558c6cb822c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:49.813 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.808+0000 7ff787fff640 1 --2- 172.21.15.79:0/2716817234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c6cb888d0 0x558c6cb822c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:49.813 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.808+0000 7ff787fff640 1 -- 172.21.15.79:0/2716817234 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c6cb96040 con 0x558c6cb8b200 2024-08-20T01:39:49.813 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.808+0000 7ff78ffff640 1 --2- 172.21.15.79:0/2716817234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c6cb8dc40 0x558c6cb82d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:39:49.813 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.808+0000 7ff787fff640 1 --2- 172.21.15.79:0/2716817234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c6cb8b200 0x558c6cb82800 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7ff77800bd80 tx=0x7ff778013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2df8ca9f199aa16a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:49.813 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.809+0000 7ff7857fa640 1 -- 172.21.15.79:0/2716817234 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7780040f0 con 0x558c6cb8b200 2024-08-20T01:39:49.813 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.809+0000 7ff7857fa640 1 -- 172.21.15.79:0/2716817234 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff778004290 con 0x558c6cb8b200 2024-08-20T01:39:49.813 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.809+0000 7ff7857fa640 1 -- 172.21.15.79:0/2716817234 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7780116a0 con 0x558c6cb8b200 2024-08-20T01:39:49.813 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.809+0000 7ff7988cd740 1 -- 172.21.15.79:0/2716817234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c6cb8b200 msgr2=0x558c6cb82800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.809+0000 7ff7988cd740 1 --2- 172.21.15.79:0/2716817234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c6cb8b200 0x558c6cb82800 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7ff77800bd80 tx=0x7ff778013830 comp rx=0 tx=0).stop 2024-08-20T01:39:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.809+0000 7ff7988cd740 1 -- 172.21.15.79:0/2716817234 shutdown_connections 2024-08-20T01:39:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.809+0000 7ff7988cd740 1 --2- 172.21.15.79:0/2716817234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c6cb8dc40 0x558c6cb82d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.809+0000 7ff7988cd740 1 --2- 172.21.15.79:0/2716817234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c6cb8b200 0x558c6cb82800 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.809+0000 7ff7988cd740 1 --2- 172.21.15.79:0/2716817234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c6cb888d0 0x558c6cb822c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.809+0000 7ff7988cd740 1 -- 172.21.15.79:0/2716817234 >> 172.21.15.79:0/2716817234 conn(0x558c6cb83a20 msgr2=0x558c6cb8f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.810+0000 7ff7988cd740 1 -- 172.21.15.79:0/2716817234 shutdown_connections 2024-08-20T01:39:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.810+0000 7ff7988cd740 1 -- 172.21.15.79:0/2716817234 wait complete. 2024-08-20T01:39:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.810+0000 7ff7988cd740 1 -- start start 2024-08-20T01:39:49.817 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.810+0000 7ff7988cd740 1 Processor -- start 2024-08-20T01:39:49.817 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.810+0000 7ff7988cd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c6cb888d0 0x558c6cb9b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:49.817 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.810+0000 7ff7988cd740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c6cb8b200 0x558c6cb9b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:49.817 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.810+0000 7ff7988cd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c6cb8dc40 0x558c6cb9c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:49.817 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.810+0000 7ff7988cd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff7901a8e00 con 0x558c6cb888d0 2024-08-20T01:39:49.817 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.810+0000 7ff7988cd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff7901a86a0 con 0x558c6cb8dc40 2024-08-20T01:39:49.817 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.810+0000 7ff7988cd740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff7901a58e0 con 0x558c6cb8b200 2024-08-20T01:39:49.817 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.810+0000 7ff7988cd740 10 client.0 _ll_register_callbacks cb 0x7ff78803f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:49.818 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.810+0000 7ff78ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c6cb888d0 0x558c6cb9b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:49.818 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.810+0000 7ff78ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c6cb888d0 0x558c6cb9b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41520/0 (socket says 172.21.15.79:41520) 2024-08-20T01:39:49.818 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.810+0000 7ff78ffff640 1 -- 172.21.15.79:0/2474656488 learned_addr learned my addr 172.21.15.79:0/2474656488 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:49.818 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.810+0000 7ff787fff640 1 --2- 172.21.15.79:0/2474656488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c6cb8b200 0x558c6cb9b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:49.818 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.811+0000 7ff78ffff640 1 --2- 172.21.15.79:0/2474656488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c6cb8dc40 0x558c6cb9c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:49.818 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.811+0000 7ff78ffff640 1 -- 172.21.15.79:0/2474656488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c6cb8b200 msgr2=0x558c6cb9b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:49.818 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.811+0000 7ff78ffff640 1 --2- 172.21.15.79:0/2474656488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c6cb8b200 0x558c6cb9b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:49.818 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.811+0000 7ff78ffff640 1 -- 172.21.15.79:0/2474656488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c6cb8dc40 msgr2=0x558c6cb9c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:49.818 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.811+0000 7ff78ffff640 1 --2- 172.21.15.79:0/2474656488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c6cb8dc40 0x558c6cb9c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:49.818 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.811+0000 7ff78ffff640 1 -- 172.21.15.79:0/2474656488 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c6cb9c9c0 con 0x558c6cb888d0 2024-08-20T01:39:49.818 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.811+0000 7ff78ffff640 1 --2- 172.21.15.79:0/2474656488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c6cb888d0 0x558c6cb9b120 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ff788031570 tx=0x7ff78802a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2305402c4f5bb7f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:49.819 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.811+0000 7ff76effd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:39:49.819 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.811+0000 7ff76effd640 1 -- 172.21.15.79:0/2474656488 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff788004140 con 0x558c6cb888d0 2024-08-20T01:39:49.819 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.811+0000 7ff76effd640 1 -- 172.21.15.79:0/2474656488 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff78802e040 con 0x558c6cb888d0 2024-08-20T01:39:49.819 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.811+0000 7ff7988cd740 1 -- 172.21.15.79:0/2474656488 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff778004290 con 0x558c6cb888d0 2024-08-20T01:39:49.819 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.811+0000 7ff76effd640 1 -- 172.21.15.79:0/2474656488 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7ff7880042e0 con 0x558c6cb888d0 2024-08-20T01:39:49.819 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.811+0000 7ff7988cd740 10 client.16359 fetch_fsmap learned FSMap version 33 2024-08-20T01:39:49.819 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.811+0000 7ff7988cd740 1 -- 172.21.15.79:0/2474656488 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x558c6cb9dd10 con 0x558c6cb888d0 2024-08-20T01:39:49.819 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.811+0000 7ff76effd640 1 -- 172.21.15.79:0/2474656488 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff778004290 con 0x558c6cb888d0 2024-08-20T01:39:49.819 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.812+0000 7ff76effd640 1 -- 172.21.15.79:0/2474656488 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7ff788057040 con 0x558c6cb888d0 2024-08-20T01:39:49.819 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.812+0000 7ff7988cd740 10 client.16359 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:39:49.819 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.812+0000 7ff7988cd740 10 client.16359 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:39:49.820 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.812+0000 7ff7988cd740 20 client.16359 populate_metadata read hostname 'smithi079' 2024-08-20T01:39:49.820 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.812+0000 7ff7988cd740 1 --2- 172.21.15.79:0/2474656488 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558c6cc0c6e0 0x558c6cc0ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:49.820 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.812+0000 7ff7988cd740 4 client.16359 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:39:49.820 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.812+0000 7ff7988cd740 1 -- 172.21.15.79:0/2474656488 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558c6caf8d50 con 0x558c6cc0c6e0 2024-08-20T01:39:49.820 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.812+0000 7ff787fff640 1 --2- 172.21.15.79:0/2474656488 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558c6cc0c6e0 0x558c6cc0ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:49.820 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.813+0000 7ff787fff640 1 --2- 172.21.15.79:0/2474656488 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558c6cc0c6e0 0x558c6cc0ead0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50bb6f8d404500d0 server_cookie=b6b94632a07ceab7 in_seq=0 out_seq=0 2024-08-20T01:39:49.820 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.813+0000 7ff76effd640 10 client.16359 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:39:49.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.821+0000 7ff76effd640 1 -- 172.21.15.79:0/2474656488 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558c6caf8d50 con 0x558c6cc0c6e0 2024-08-20T01:39:49.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.821+0000 7ff76effd640 10 client.16359 handle_command_reply: tid=0 2024-08-20T01:39:49.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.821+0000 7ff7988cd740 1 client.16359 shutdown 2024-08-20T01:39:49.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.821+0000 7ff7988cd740 1 -- 172.21.15.79:0/2474656488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c6cb888d0 msgr2=0x558c6cb9b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:49.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.821+0000 7ff7988cd740 1 --2- 172.21.15.79:0/2474656488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c6cb888d0 0x558c6cb9b120 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ff788031570 tx=0x7ff78802a8e0 comp rx=0 tx=0).stop 2024-08-20T01:39:49.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.821+0000 7ff7988cd740 1 -- 172.21.15.79:0/2474656488 shutdown_connections 2024-08-20T01:39:49.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.821+0000 7ff7988cd740 1 --2- 172.21.15.79:0/2474656488 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558c6cc0c6e0 0x558c6cc0ead0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:49.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.821+0000 7ff7988cd740 1 --2- 172.21.15.79:0/2474656488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c6cb8dc40 0x558c6cb9c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:49.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.821+0000 7ff7988cd740 1 --2- 172.21.15.79:0/2474656488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c6cb8b200 0x558c6cb9b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:49.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.821+0000 7ff7988cd740 1 --2- 172.21.15.79:0/2474656488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c6cb888d0 0x558c6cb9b120 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:49.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.821+0000 7ff76effd640 0 client.16359 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:39:49.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.821+0000 7ff7988cd740 1 -- 172.21.15.79:0/2474656488 >> 172.21.15.79:0/2474656488 conn(0x558c6cb83a20 msgr2=0x558c6cb8e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:49.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.821+0000 7ff7988cd740 1 -- 172.21.15.79:0/2474656488 shutdown_connections 2024-08-20T01:39:49.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.821+0000 7ff7988cd740 1 -- 172.21.15.79:0/2474656488 wait complete. 2024-08-20T01:39:49.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.821+0000 7ff7988cd740 20 client.16359 trim_cache size 0 max 16384 2024-08-20T01:39:49.825 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:39:49.825 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:39:49.825 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:39:49.825 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:39:49.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.822+0000 7ff795adc640 1 -- 172.21.15.79:0/2152280832 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff77c0b3bd0 msgr2=0x7ff77c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:49.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.822+0000 7ff795adc640 1 --2- 172.21.15.79:0/2152280832 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff77c0b3bd0 0x7ff77c0b6090 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff7800aa270 tx=0x7ff78006f5f0 comp rx=0 tx=0).stop 2024-08-20T01:39:49.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.822+0000 7ff795adc640 1 -- 172.21.15.79:0/2152280832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff790101560 msgr2=0x7ff7901989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:49.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.822+0000 7ff795adc640 1 --2- 172.21.15.79:0/2152280832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff790101560 0x7ff7901989b0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7ff78000b4a0 tx=0x7ff78000b960 comp rx=0 tx=0).stop 2024-08-20T01:39:49.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.822+0000 7ff795adc640 1 -- 172.21.15.79:0/2152280832 shutdown_connections 2024-08-20T01:39:49.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.822+0000 7ff795adc640 1 --2- 172.21.15.79:0/2152280832 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff77c0b3bd0 0x7ff77c0b6090 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:49.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.822+0000 7ff795adc640 1 --2- 172.21.15.79:0/2152280832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff790103070 0x7ff790199c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:49.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.822+0000 7ff795adc640 1 --2- 172.21.15.79:0/2152280832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7901026b0 0x7ff790199000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:49.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.822+0000 7ff795adc640 1 --2- 172.21.15.79:0/2152280832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff790101560 0x7ff7901989b0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:49.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.822+0000 7ff795adc640 1 -- 172.21.15.79:0/2152280832 >> 172.21.15.79:0/2152280832 conn(0x7ff7900fce40 msgr2=0x7ff7900fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:49.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.822+0000 7ff795adc640 1 -- 172.21.15.79:0/2152280832 shutdown_connections 2024-08-20T01:39:49.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:39:49.822+0000 7ff795adc640 1 -- 172.21.15.79:0/2152280832 wait complete. 2024-08-20T01:39:50.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:49 smithi079 ceph-mon[18656]: pgmap v422: 97 pgs: 97 active+clean; 2.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 31 MiB/s wr, 27 op/s 2024-08-20T01:39:50.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:49 smithi081 ceph-mon[22209]: pgmap v422: 97 pgs: 97 active+clean; 2.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 31 MiB/s wr, 27 op/s 2024-08-20T01:39:50.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:49 smithi175 ceph-mon[22392]: pgmap v422: 97 pgs: 97 active+clean; 2.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 31 MiB/s wr, 27 op/s 2024-08-20T01:39:51.074 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:39:51.360 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:39:51.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.861+0000 7fc0beeb7640 1 -- 172.21.15.79:0/1890108114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b810f140 msgr2=0x7fc0b8111530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:51.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.861+0000 7fc0beeb7640 1 --2- 172.21.15.79:0/1890108114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b810f140 0x7fc0b8111530 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0009ca0 tx=0x7fc0b002a950 comp rx=0 tx=0).stop 2024-08-20T01:39:51.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.861+0000 7fc0beeb7640 1 -- 172.21.15.79:0/1890108114 shutdown_connections 2024-08-20T01:39:51.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.861+0000 7fc0beeb7640 1 --2- 172.21.15.79:0/1890108114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b810f140 0x7fc0b8111530 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:51.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.861+0000 7fc0beeb7640 1 --2- 172.21.15.79:0/1890108114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0b8101eb0 0x7fc0b810ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:51.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.861+0000 7fc0beeb7640 1 --2- 172.21.15.79:0/1890108114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0b8101590 0x7fc0b8101970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:51.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.861+0000 7fc0beeb7640 1 -- 172.21.15.79:0/1890108114 >> 172.21.15.79:0/1890108114 conn(0x7fc0b80fd400 msgr2=0x7fc0b80ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:51.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.861+0000 7fc0beeb7640 1 -- 172.21.15.79:0/1890108114 shutdown_connections 2024-08-20T01:39:51.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.861+0000 7fc0beeb7640 1 -- 172.21.15.79:0/1890108114 wait complete. 2024-08-20T01:39:51.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.861+0000 7fc0beeb7640 1 Processor -- start 2024-08-20T01:39:51.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.861+0000 7fc0beeb7640 1 -- start start 2024-08-20T01:39:51.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.862+0000 7fc0beeb7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0b8101590 0x7fc0b819af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:51.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.862+0000 7fc0beeb7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0b8101eb0 0x7fc0b819b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:51.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.862+0000 7fc0beeb7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b810f140 0x7fc0b81a0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:51.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.862+0000 7fc0beeb7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b8114b30 con 0x7fc0b810f140 2024-08-20T01:39:51.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.862+0000 7fc0beeb7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b81149b0 con 0x7fc0b8101eb0 2024-08-20T01:39:51.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.862+0000 7fc0beeb7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b8114cb0 con 0x7fc0b8101590 2024-08-20T01:39:51.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.862+0000 7fc0bd454640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b810f140 0x7fc0b81a0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:51.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.862+0000 7fc0bd454640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b810f140 0x7fc0b81a0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48104/0 (socket says 172.21.15.79:48104) 2024-08-20T01:39:51.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.862+0000 7fc0bd454640 1 -- 172.21.15.79:0/1238528447 learned_addr learned my addr 172.21.15.79:0/1238528447 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:51.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.862+0000 7fc0bcc53640 1 --2- 172.21.15.79:0/1238528447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0b8101590 0x7fc0b819af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:51.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.862+0000 7fc0b7fff640 1 --2- 172.21.15.79:0/1238528447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0b8101eb0 0x7fc0b819b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:51.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.862+0000 7fc0bd454640 1 -- 172.21.15.79:0/1238528447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0b8101590 msgr2=0x7fc0b819af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:51.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.862+0000 7fc0bd454640 1 --2- 172.21.15.79:0/1238528447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0b8101590 0x7fc0b819af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:51.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.862+0000 7fc0bd454640 1 -- 172.21.15.79:0/1238528447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0b8101eb0 msgr2=0x7fc0b819b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:51.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.862+0000 7fc0bd454640 1 --2- 172.21.15.79:0/1238528447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0b8101eb0 0x7fc0b819b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:51.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.862+0000 7fc0bd454640 1 -- 172.21.15.79:0/1238528447 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b81a0ff0 con 0x7fc0b810f140 2024-08-20T01:39:51.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.862+0000 7fc0b7fff640 1 --2- 172.21.15.79:0/1238528447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0b8101eb0 0x7fc0b819b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:39:51.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.863+0000 7fc0bd454640 1 --2- 172.21.15.79:0/1238528447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b810f140 0x7fc0b81a0820 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fc0b002ae70 tx=0x7fc0b0003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:51.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.863+0000 7fc0b5ffb640 1 -- 172.21.15.79:0/1238528447 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0034040 con 0x7fc0b810f140 2024-08-20T01:39:51.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.863+0000 7fc0beeb7640 1 -- 172.21.15.79:0/1238528447 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0b81a1280 con 0x7fc0b810f140 2024-08-20T01:39:51.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.863+0000 7fc0b5ffb640 1 -- 172.21.15.79:0/1238528447 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc0b002fcf0 con 0x7fc0b810f140 2024-08-20T01:39:51.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.863+0000 7fc0b5ffb640 1 -- 172.21.15.79:0/1238528447 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0004510 con 0x7fc0b810f140 2024-08-20T01:39:51.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.863+0000 7fc0beeb7640 1 -- 172.21.15.79:0/1238528447 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0b81a79a0 con 0x7fc0b810f140 2024-08-20T01:39:51.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.865+0000 7fc0b5ffb640 1 -- 172.21.15.79:0/1238528447 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc0b0037020 con 0x7fc0b810f140 2024-08-20T01:39:51.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.866+0000 7fc0c12b0740 1 Processor -- start 2024-08-20T01:39:51.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.866+0000 7fc0c12b0740 1 -- start start 2024-08-20T01:39:51.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.866+0000 7fc0c12b0740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627b848830 0x55627b848c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:51.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.866+0000 7fc0c12b0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55627b849150 0x55627b85d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:51.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.866+0000 7fc0c12b0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55627b85d8f0 0x55627b85fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:51.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.866+0000 7fc0c12b0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55627b7bf8e0 con 0x55627b85d8f0 2024-08-20T01:39:51.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.866+0000 7fc0c12b0740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55627b7aede0 con 0x55627b848830 2024-08-20T01:39:51.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.866+0000 7fc0c12b0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55627b7b2e20 con 0x55627b849150 2024-08-20T01:39:51.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.866+0000 7fc0b7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55627b85d8f0 0x55627b85fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:51.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.866+0000 7fc0b7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55627b85d8f0 0x55627b85fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48118/0 (socket says 172.21.15.79:48118) 2024-08-20T01:39:51.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.866+0000 7fc0b7fff640 1 -- 172.21.15.79:0/1256751994 learned_addr learned my addr 172.21.15.79:0/1256751994 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:51.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.866+0000 7fc0bcc53640 1 --2- 172.21.15.79:0/1256751994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55627b849150 0x55627b85d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:51.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.866+0000 7fc0b5ffb640 1 --2- 172.21.15.79:0/1238528447 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc0a80b3c50 0x7fc0a80b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:51.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.867+0000 7fc0b7fff640 1 --2- 172.21.15.79:0/1256751994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627b848830 0x55627b848c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:51.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.867+0000 7fc0bd454640 1 --2- 172.21.15.79:0/1238528447 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc0a80b3c50 0x7fc0a80b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:51.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.867+0000 7fc0bcc53640 1 -- 172.21.15.79:0/1256751994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627b848830 msgr2=0x55627b848c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:51.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.867+0000 7fc0bcc53640 1 --2- 172.21.15.79:0/1256751994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627b848830 0x55627b848c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:51.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.867+0000 7fc0bcc53640 1 -- 172.21.15.79:0/1256751994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55627b85d8f0 msgr2=0x55627b85fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:51.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.867+0000 7fc0bcc53640 1 --2- 172.21.15.79:0/1256751994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55627b85d8f0 0x55627b85fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:51.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.867+0000 7fc0bcc53640 1 -- 172.21.15.79:0/1256751994 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55627b50e650 con 0x55627b849150 2024-08-20T01:39:51.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.867+0000 7fc0b7fff640 1 --2- 172.21.15.79:0/1256751994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55627b85d8f0 0x55627b85fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:51.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.867+0000 7fc0b5ffb640 1 -- 172.21.15.79:0/1238528447 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc0b0104e40 con 0x7fc0b810f140 2024-08-20T01:39:51.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.867+0000 7fc0bcc53640 1 --2- 172.21.15.79:0/1256751994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55627b849150 0x55627b85d3b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac00ac20 tx=0x7fc0ac00f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2482227d256c991 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:51.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.867+0000 7fc0bd454640 1 --2- 172.21.15.79:0/1238528447 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc0a80b3c50 0x7fc0a80b6110 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0105130 tx=0x7fc0b00a2c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:51.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.867+0000 7fc0a2ffd640 1 -- 172.21.15.79:0/1256751994 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac005220 con 0x55627b849150 2024-08-20T01:39:51.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.867+0000 7fc0a2ffd640 1 -- 172.21.15.79:0/1256751994 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc0ac0047a0 con 0x55627b849150 2024-08-20T01:39:51.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.867+0000 7fc0a2ffd640 1 -- 172.21.15.79:0/1256751994 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac0186a0 con 0x55627b849150 2024-08-20T01:39:51.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.868+0000 7fc0c12b0740 1 -- 172.21.15.79:0/1256751994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55627b849150 msgr2=0x55627b85d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:51.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.868+0000 7fc0c12b0740 1 --2- 172.21.15.79:0/1256751994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55627b849150 0x55627b85d3b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac00ac20 tx=0x7fc0ac00f790 comp rx=0 tx=0).stop 2024-08-20T01:39:51.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.868+0000 7fc0c12b0740 1 -- 172.21.15.79:0/1256751994 shutdown_connections 2024-08-20T01:39:51.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.868+0000 7fc0c12b0740 1 --2- 172.21.15.79:0/1256751994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55627b85d8f0 0x55627b85fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:51.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.868+0000 7fc0c12b0740 1 --2- 172.21.15.79:0/1256751994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55627b849150 0x55627b85d3b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:51.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.868+0000 7fc0c12b0740 1 --2- 172.21.15.79:0/1256751994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627b848830 0x55627b848c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:51.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.868+0000 7fc0c12b0740 1 -- 172.21.15.79:0/1256751994 >> 172.21.15.79:0/1256751994 conn(0x55627b846660 msgr2=0x55627b847800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:51.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.868+0000 7fc0c12b0740 1 -- 172.21.15.79:0/1256751994 shutdown_connections 2024-08-20T01:39:51.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.868+0000 7fc0c12b0740 1 -- 172.21.15.79:0/1256751994 wait complete. 2024-08-20T01:39:51.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.869+0000 7fc0c12b0740 1 -- start start 2024-08-20T01:39:51.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.869+0000 7fc0c12b0740 1 Processor -- start 2024-08-20T01:39:51.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.869+0000 7fc0c12b0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55627b848830 0x55627b85a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:51.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.870+0000 7fc0c12b0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55627b849150 0x55627b85adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:51.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.870+0000 7fc0c12b0740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627b85d8f0 0x55627b85b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:51.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.870+0000 7fc0c12b0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55627b611700 con 0x55627b848830 2024-08-20T01:39:51.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.870+0000 7fc0c12b0740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55627b7357c0 con 0x55627b85d8f0 2024-08-20T01:39:51.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.870+0000 7fc0c12b0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55627b8605a0 con 0x55627b849150 2024-08-20T01:39:51.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.870+0000 7fc0b7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55627b848830 0x55627b85a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:51.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.870+0000 7fc0b7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55627b848830 0x55627b85a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48124/0 (socket says 172.21.15.79:48124) 2024-08-20T01:39:51.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.870+0000 7fc0bcc53640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55627b849150 0x55627b85adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:51.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.870+0000 7fc0b7fff640 1 -- 172.21.15.79:0/1067028250 learned_addr learned my addr 172.21.15.79:0/1067028250 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:51.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.870+0000 7fc0c12b0740 10 client.0 _ll_register_callbacks cb 0x55627b7a86b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:51.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.870+0000 7fc0b7fff640 1 --2- 172.21.15.79:0/1067028250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627b85d8f0 0x55627b85b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:51.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.870+0000 7fc0b7fff640 1 -- 172.21.15.79:0/1067028250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55627b849150 msgr2=0x55627b85adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:51.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.870+0000 7fc0b7fff640 1 --2- 172.21.15.79:0/1067028250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55627b849150 0x55627b85adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:51.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.870+0000 7fc0b7fff640 1 -- 172.21.15.79:0/1067028250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627b85d8f0 msgr2=0x55627b85b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.870+0000 7fc0b7fff640 1 --2- 172.21.15.79:0/1067028250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627b85d8f0 0x55627b85b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.870+0000 7fc0b7fff640 1 -- 172.21.15.79:0/1067028250 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55627b8699b0 con 0x55627b848830 2024-08-20T01:39:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.870+0000 7fc0bcc53640 1 --2- 172.21.15.79:0/1067028250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55627b849150 0x55627b85adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.870+0000 7fc0b7fff640 1 --2- 172.21.15.79:0/1067028250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55627b848830 0x55627b85a870 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4011f40 tx=0x7fc0a4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a70db37e4cd214f7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.870+0000 7fc097fff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:39:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.870+0000 7fc097fff640 1 -- 172.21.15.79:0/1067028250 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a401b040 con 0x55627b848830 2024-08-20T01:39:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.870+0000 7fc097fff640 1 -- 172.21.15.79:0/1067028250 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc0a4005220 con 0x55627b848830 2024-08-20T01:39:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.870+0000 7fc0c12b0740 1 -- 172.21.15.79:0/1067028250 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55627b75e100 con 0x55627b848830 2024-08-20T01:39:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.871+0000 7fc097fff640 1 -- 172.21.15.79:0/1067028250 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fc0a4005420 con 0x55627b848830 2024-08-20T01:39:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.871+0000 7fc0c12b0740 10 client.16371 fetch_fsmap learned FSMap version 33 2024-08-20T01:39:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.871+0000 7fc0c12b0740 1 -- 172.21.15.79:0/1067028250 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55627b86c360 con 0x55627b848830 2024-08-20T01:39:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.871+0000 7fc097fff640 1 -- 172.21.15.79:0/1067028250 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55627b75e100 con 0x55627b848830 2024-08-20T01:39:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.871+0000 7fc097fff640 1 -- 172.21.15.79:0/1067028250 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7fc0a400d5c0 con 0x55627b848830 2024-08-20T01:39:51.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.871+0000 7fc0c12b0740 10 client.16371 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:39:51.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.871+0000 7fc0c12b0740 10 client.16371 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:39:51.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.871+0000 7fc0c12b0740 20 client.16371 populate_metadata read hostname 'smithi079' 2024-08-20T01:39:51.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.871+0000 7fc0c12b0740 1 --2- 172.21.15.79:0/1067028250 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55627b86d810 0x55627b86fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:51.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.871+0000 7fc0c12b0740 4 client.16371 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:39:51.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.871+0000 7fc0c12b0740 1 -- 172.21.15.79:0/1067028250 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55627b7c1830 con 0x55627b86d810 2024-08-20T01:39:51.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.871+0000 7fc0bcc53640 1 --2- 172.21.15.79:0/1067028250 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55627b86d810 0x55627b86fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:51.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.872+0000 7fc0bcc53640 1 --2- 172.21.15.79:0/1067028250 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55627b86d810 0x55627b86fc80 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8d9c7503ff54e1b server_cookie=c93fca77510eca51 in_seq=0 out_seq=0 2024-08-20T01:39:51.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.872+0000 7fc097fff640 10 client.16371 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:39:51.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.873+0000 7fc097fff640 1 -- 172.21.15.79:0/1067028250 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55627b7c1830 con 0x55627b86d810 2024-08-20T01:39:51.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.873+0000 7fc097fff640 10 client.16371 handle_command_reply: tid=0 2024-08-20T01:39:51.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.873+0000 7fc0c12b0740 1 client.16371 shutdown 2024-08-20T01:39:51.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.873+0000 7fc0c12b0740 1 -- 172.21.15.79:0/1067028250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55627b848830 msgr2=0x55627b85a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:51.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.873+0000 7fc0c12b0740 1 --2- 172.21.15.79:0/1067028250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55627b848830 0x55627b85a870 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4011f40 tx=0x7fc0a4004730 comp rx=0 tx=0).stop 2024-08-20T01:39:51.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.873+0000 7fc0c12b0740 1 -- 172.21.15.79:0/1067028250 shutdown_connections 2024-08-20T01:39:51.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.873+0000 7fc0c12b0740 1 --2- 172.21.15.79:0/1067028250 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55627b86d810 0x55627b86fc80 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:51.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.873+0000 7fc0c12b0740 1 --2- 172.21.15.79:0/1067028250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627b85d8f0 0x55627b85b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:51.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.873+0000 7fc0c12b0740 1 --2- 172.21.15.79:0/1067028250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55627b849150 0x55627b85adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:51.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.873+0000 7fc0c12b0740 1 --2- 172.21.15.79:0/1067028250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55627b848830 0x55627b85a870 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:51.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.873+0000 7fc0c12b0740 1 -- 172.21.15.79:0/1067028250 >> 172.21.15.79:0/1067028250 conn(0x55627b846660 msgr2=0x55627b84c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:51.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.873+0000 7fc097fff640 0 client.16371 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:39:51.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.873+0000 7fc0c12b0740 1 -- 172.21.15.79:0/1067028250 shutdown_connections 2024-08-20T01:39:51.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.873+0000 7fc0c12b0740 1 -- 172.21.15.79:0/1067028250 wait complete. 2024-08-20T01:39:51.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.873+0000 7fc0c12b0740 20 client.16371 trim_cache size 0 max 16384 2024-08-20T01:39:51.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.893+0000 7fc0c12b0740 1 Processor -- start 2024-08-20T01:39:51.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.893+0000 7fc0c12b0740 1 -- start start 2024-08-20T01:39:51.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.894+0000 7fc0c12b0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55627b846660 0x55627b875550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:51.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.894+0000 7fc0c12b0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55627b848830 0x55627b875a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:51.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.894+0000 7fc0c12b0740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627b849150 0x55627b844f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:51.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.894+0000 7fc0c12b0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b81abbe0 con 0x55627b848830 2024-08-20T01:39:51.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.894+0000 7fc0c12b0740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b81ad870 con 0x55627b849150 2024-08-20T01:39:51.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.894+0000 7fc0c12b0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b81ac2b0 con 0x55627b846660 2024-08-20T01:39:51.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.894+0000 7fc0bcc53640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55627b848830 0x55627b875a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:51.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.894+0000 7fc0bcc53640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55627b848830 0x55627b875a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48134/0 (socket says 172.21.15.79:48134) 2024-08-20T01:39:51.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.894+0000 7fc0bcc53640 1 -- 172.21.15.79:0/164066126 learned_addr learned my addr 172.21.15.79:0/164066126 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:51.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.894+0000 7fc0b7fff640 1 --2- 172.21.15.79:0/164066126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55627b846660 0x55627b875550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:51.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.894+0000 7fc0b7fff640 1 --2- 172.21.15.79:0/164066126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627b849150 0x55627b844f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:51.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.894+0000 7fc0bcc53640 1 -- 172.21.15.79:0/164066126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55627b846660 msgr2=0x55627b875550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:51.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.894+0000 7fc0bcc53640 1 --2- 172.21.15.79:0/164066126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55627b846660 0x55627b875550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:51.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.894+0000 7fc0bcc53640 1 -- 172.21.15.79:0/164066126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627b849150 msgr2=0x55627b844f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:51.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.894+0000 7fc0bcc53640 1 --2- 172.21.15.79:0/164066126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627b849150 0x55627b844f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:51.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.894+0000 7fc0bcc53640 1 -- 172.21.15.79:0/164066126 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55627b8470e0 con 0x55627b848830 2024-08-20T01:39:51.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.895+0000 7fc0bcc53640 1 --2- 172.21.15.79:0/164066126 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55627b848830 0x55627b875a90 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac00ac20 tx=0x7fc0ac00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16dfa59a8e644746 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:51.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.895+0000 7fc0a27fc640 1 -- 172.21.15.79:0/164066126 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac004fe0 con 0x55627b848830 2024-08-20T01:39:51.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.895+0000 7fc0a27fc640 1 -- 172.21.15.79:0/164066126 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc0ac005d80 con 0x55627b848830 2024-08-20T01:39:51.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.895+0000 7fc0a27fc640 1 -- 172.21.15.79:0/164066126 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac02a8e0 con 0x55627b848830 2024-08-20T01:39:51.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.896+0000 7fc0c12b0740 1 -- 172.21.15.79:0/164066126 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55627b848830 msgr2=0x55627b875a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:51.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.896+0000 7fc0c12b0740 1 --2- 172.21.15.79:0/164066126 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55627b848830 0x55627b875a90 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac00ac20 tx=0x7fc0ac00f790 comp rx=0 tx=0).stop 2024-08-20T01:39:51.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.896+0000 7fc0c12b0740 1 -- 172.21.15.79:0/164066126 shutdown_connections 2024-08-20T01:39:51.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.896+0000 7fc0c12b0740 1 --2- 172.21.15.79:0/164066126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627b849150 0x55627b844f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:51.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.896+0000 7fc0c12b0740 1 --2- 172.21.15.79:0/164066126 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55627b848830 0x55627b875a90 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:51.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.896+0000 7fc0c12b0740 1 --2- 172.21.15.79:0/164066126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55627b846660 0x55627b875550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:51.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.896+0000 7fc0c12b0740 1 -- 172.21.15.79:0/164066126 >> 172.21.15.79:0/164066126 conn(0x55627b84da00 msgr2=0x55627b85bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:51.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.896+0000 7fc0c12b0740 1 -- 172.21.15.79:0/164066126 shutdown_connections 2024-08-20T01:39:51.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.896+0000 7fc0c12b0740 1 -- 172.21.15.79:0/164066126 wait complete. 2024-08-20T01:39:51.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.896+0000 7fc0c12b0740 1 -- start start 2024-08-20T01:39:51.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.896+0000 7fc0c12b0740 1 Processor -- start 2024-08-20T01:39:51.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.897+0000 7fc0c12b0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55627b846660 0x55627b861ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:51.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.897+0000 7fc0c12b0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55627b848830 0x55627b8623e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:51.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.897+0000 7fc0c12b0740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627b849150 0x55627b862920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:51.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.897+0000 7fc0c12b0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b81ad0e0 con 0x55627b848830 2024-08-20T01:39:51.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.897+0000 7fc0c12b0740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b81ac980 con 0x55627b849150 2024-08-20T01:39:51.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.897+0000 7fc0c12b0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b81a9c20 con 0x55627b846660 2024-08-20T01:39:51.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.897+0000 7fc0c12b0740 10 client.0 _ll_register_callbacks cb 0x7fc0a400bc90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:51.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.897+0000 7fc0bcc53640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55627b848830 0x55627b8623e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:51.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.897+0000 7fc0bcc53640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55627b848830 0x55627b8623e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48138/0 (socket says 172.21.15.79:48138) 2024-08-20T01:39:51.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.897+0000 7fc0bcc53640 1 -- 172.21.15.79:0/471360445 learned_addr learned my addr 172.21.15.79:0/471360445 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:51.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.897+0000 7fc0b7fff640 1 --2- 172.21.15.79:0/471360445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627b849150 0x55627b862920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:51.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.897+0000 7fc0b7fff640 1 --2- 172.21.15.79:0/471360445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55627b846660 0x55627b861ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:51.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.897+0000 7fc0bcc53640 1 -- 172.21.15.79:0/471360445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55627b846660 msgr2=0x55627b861ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:51.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.897+0000 7fc0bcc53640 1 --2- 172.21.15.79:0/471360445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55627b846660 0x55627b861ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:51.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.897+0000 7fc0bcc53640 1 -- 172.21.15.79:0/471360445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627b849150 msgr2=0x55627b862920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:51.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.897+0000 7fc0bcc53640 1 --2- 172.21.15.79:0/471360445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627b849150 0x55627b862920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:51.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.897+0000 7fc0bcc53640 1 -- 172.21.15.79:0/471360445 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55627b8d67b0 con 0x55627b848830 2024-08-20T01:39:51.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.897+0000 7fc0bcc53640 1 --2- 172.21.15.79:0/471360445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55627b848830 0x55627b8623e0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac01a040 tx=0x7fc0ac004b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec6384df41c64a12 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:51.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.897+0000 7fc097fff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:39:51.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.898+0000 7fc097fff640 1 -- 172.21.15.79:0/471360445 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac02a880 con 0x55627b848830 2024-08-20T01:39:51.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.898+0000 7fc097fff640 1 -- 172.21.15.79:0/471360445 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc0ac02aa20 con 0x55627b848830 2024-08-20T01:39:51.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.898+0000 7fc0c12b0740 1 -- 172.21.15.79:0/471360445 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55627b7bd2d0 con 0x55627b848830 2024-08-20T01:39:51.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.898+0000 7fc097fff640 1 -- 172.21.15.79:0/471360445 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fc0ac02ac20 con 0x55627b848830 2024-08-20T01:39:51.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.898+0000 7fc0c12b0740 10 client.16377 fetch_fsmap learned FSMap version 33 2024-08-20T01:39:51.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.898+0000 7fc0c12b0740 1 -- 172.21.15.79:0/471360445 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55627b8d7aa0 con 0x55627b848830 2024-08-20T01:39:51.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.898+0000 7fc097fff640 1 -- 172.21.15.79:0/471360445 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55627b7bd2d0 con 0x55627b848830 2024-08-20T01:39:51.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.898+0000 7fc097fff640 1 -- 172.21.15.79:0/471360445 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7fc0ac018600 con 0x55627b848830 2024-08-20T01:39:51.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.898+0000 7fc0c12b0740 10 client.16377 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:39:51.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.898+0000 7fc0c12b0740 10 client.16377 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:39:51.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.898+0000 7fc0c12b0740 20 client.16377 populate_metadata read hostname 'smithi079' 2024-08-20T01:39:51.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.898+0000 7fc0c12b0740 1 --2- 172.21.15.79:0/471360445 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55627b85d8f0 0x55627b8da190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:51.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.898+0000 7fc0c12b0740 4 client.16377 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:39:51.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.898+0000 7fc0c12b0740 1 -- 172.21.15.79:0/471360445 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55627b7baa10 con 0x55627b85d8f0 2024-08-20T01:39:51.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.899+0000 7fc0b7fff640 1 --2- 172.21.15.79:0/471360445 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55627b85d8f0 0x55627b8da190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:51.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.899+0000 7fc0b7fff640 1 --2- 172.21.15.79:0/471360445 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55627b85d8f0 0x55627b8da190 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97213f35b2f74e2d server_cookie=9d293f01892df1a in_seq=0 out_seq=0 2024-08-20T01:39:51.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.899+0000 7fc097fff640 10 client.16377 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:39:51.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.899+0000 7fc097fff640 1 -- 172.21.15.79:0/471360445 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55627b7baa10 con 0x55627b85d8f0 2024-08-20T01:39:51.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.899+0000 7fc097fff640 10 client.16377 handle_command_reply: tid=0 2024-08-20T01:39:51.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.899+0000 7fc0c12b0740 1 client.16377 shutdown 2024-08-20T01:39:51.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.899+0000 7fc0c12b0740 1 -- 172.21.15.79:0/471360445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55627b848830 msgr2=0x55627b8623e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:51.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.899+0000 7fc0c12b0740 1 --2- 172.21.15.79:0/471360445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55627b848830 0x55627b8623e0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac01a040 tx=0x7fc0ac004b80 comp rx=0 tx=0).stop 2024-08-20T01:39:51.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.899+0000 7fc0c12b0740 1 -- 172.21.15.79:0/471360445 shutdown_connections 2024-08-20T01:39:51.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.899+0000 7fc0c12b0740 1 --2- 172.21.15.79:0/471360445 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55627b85d8f0 0x55627b8da190 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:51.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.899+0000 7fc0c12b0740 1 --2- 172.21.15.79:0/471360445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627b849150 0x55627b862920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:51.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.899+0000 7fc097fff640 0 client.16377 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:39:51.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.899+0000 7fc0c12b0740 1 --2- 172.21.15.79:0/471360445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55627b848830 0x55627b8623e0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:51.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.899+0000 7fc0c12b0740 1 --2- 172.21.15.79:0/471360445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55627b846660 0x55627b861ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:51.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.899+0000 7fc0c12b0740 1 -- 172.21.15.79:0/471360445 >> 172.21.15.79:0/471360445 conn(0x55627b84da00 msgr2=0x55627b84b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:51.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.900+0000 7fc0c12b0740 1 -- 172.21.15.79:0/471360445 shutdown_connections 2024-08-20T01:39:51.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.900+0000 7fc0c12b0740 1 -- 172.21.15.79:0/471360445 wait complete. 2024-08-20T01:39:51.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.900+0000 7fc0c12b0740 20 client.16377 trim_cache size 0 max 16384 2024-08-20T01:39:51.908 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:39:51.908 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-08-20T01:39:51.908 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-08-20T01:39:51.908 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:39:51.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.900+0000 7fc0beeb7640 1 -- 172.21.15.79:0/1238528447 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc0a80b3c50 msgr2=0x7fc0a80b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:51.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.900+0000 7fc0beeb7640 1 --2- 172.21.15.79:0/1238528447 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc0a80b3c50 0x7fc0a80b6110 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0105130 tx=0x7fc0b00a2c70 comp rx=0 tx=0).stop 2024-08-20T01:39:51.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.900+0000 7fc0beeb7640 1 -- 172.21.15.79:0/1238528447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b810f140 msgr2=0x7fc0b81a0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:51.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.900+0000 7fc0beeb7640 1 --2- 172.21.15.79:0/1238528447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b810f140 0x7fc0b81a0820 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fc0b002ae70 tx=0x7fc0b0003f10 comp rx=0 tx=0).stop 2024-08-20T01:39:51.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.900+0000 7fc0beeb7640 1 -- 172.21.15.79:0/1238528447 shutdown_connections 2024-08-20T01:39:51.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.900+0000 7fc0beeb7640 1 --2- 172.21.15.79:0/1238528447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b810f140 0x7fc0b81a0820 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:51.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.900+0000 7fc0beeb7640 1 --2- 172.21.15.79:0/1238528447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0b8101eb0 0x7fc0b819b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:51.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.900+0000 7fc0beeb7640 1 --2- 172.21.15.79:0/1238528447 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc0a80b3c50 0x7fc0a80b6110 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:51.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.900+0000 7fc0beeb7640 1 --2- 172.21.15.79:0/1238528447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0b8101590 0x7fc0b819af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:51.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.900+0000 7fc0beeb7640 1 -- 172.21.15.79:0/1238528447 >> 172.21.15.79:0/1238528447 conn(0x7fc0b80fd400 msgr2=0x7fc0b81113e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:51.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.901+0000 7fc0beeb7640 1 -- 172.21.15.79:0/1238528447 shutdown_connections 2024-08-20T01:39:51.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:51.901+0000 7fc0beeb7640 1 -- 172.21.15.79:0/1238528447 wait complete. 2024-08-20T01:39:52.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:51 smithi079 ceph-mon[18656]: pgmap v423: 97 pgs: 97 active+clean; 3.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 31 MiB/s wr, 22 op/s 2024-08-20T01:39:52.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:51 smithi081 ceph-mon[22209]: pgmap v423: 97 pgs: 97 active+clean; 3.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 31 MiB/s wr, 22 op/s 2024-08-20T01:39:52.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:51 smithi175 ceph-mon[22392]: pgmap v423: 97 pgs: 97 active+clean; 3.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 31 MiB/s wr, 22 op/s 2024-08-20T01:39:52.810 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T01:39:52.810 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:39:53.084 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:39:53.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.603+0000 7f0966b21640 1 -- 172.21.15.79:0/769103399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0960101990 msgr2=0x7f0960101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:53.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.603+0000 7f0966b21640 1 --2- 172.21.15.79:0/769103399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0960101990 0x7f0960101d70 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f0954009900 tx=0x7f095402a410 comp rx=0 tx=0).stop 2024-08-20T01:39:53.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.603+0000 7f0966b21640 1 -- 172.21.15.79:0/769103399 shutdown_connections 2024-08-20T01:39:53.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.603+0000 7f0966b21640 1 --2- 172.21.15.79:0/769103399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0960107d20 0x7f096010e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:53.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.603+0000 7f0966b21640 1 --2- 172.21.15.79:0/769103399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09601073a0 0x7f09601077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:53.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.603+0000 7f0966b21640 1 --2- 172.21.15.79:0/769103399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0960101990 0x7f0960101d70 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:53.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.603+0000 7f0966b21640 1 -- 172.21.15.79:0/769103399 >> 172.21.15.79:0/769103399 conn(0x7f09600fd400 msgr2=0x7f09600ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:53.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.603+0000 7f0966b21640 1 -- 172.21.15.79:0/769103399 shutdown_connections 2024-08-20T01:39:53.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.603+0000 7f0966b21640 1 -- 172.21.15.79:0/769103399 wait complete. 2024-08-20T01:39:53.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.603+0000 7f0966b21640 1 Processor -- start 2024-08-20T01:39:53.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.603+0000 7f0966b21640 1 -- start start 2024-08-20T01:39:53.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.604+0000 7f0966b21640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0960101990 0x7f0960103250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:53.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.604+0000 7f0966b21640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09601073a0 0x7f0960103790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:53.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.604+0000 7f0966b21640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0960107d20 0x7f0960103cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:53.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.604+0000 7f0966b21640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0960111890 con 0x7f0960107d20 2024-08-20T01:39:53.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.604+0000 7f0966b21640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0960111710 con 0x7f0960101990 2024-08-20T01:39:53.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.604+0000 7f0966b21640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0960111a10 con 0x7f09601073a0 2024-08-20T01:39:53.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.604+0000 7f09650be640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0960107d20 0x7f0960103cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:53.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.604+0000 7f09650be640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0960107d20 0x7f0960103cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48154/0 (socket says 172.21.15.79:48154) 2024-08-20T01:39:53.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.604+0000 7f095ffff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09601073a0 0x7f0960103790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:53.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.604+0000 7f09650be640 1 -- 172.21.15.79:0/2247635792 learned_addr learned my addr 172.21.15.79:0/2247635792 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:53.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.604+0000 7f09648bd640 1 --2- 172.21.15.79:0/2247635792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0960101990 0x7f0960103250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:53.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.604+0000 7f09650be640 1 -- 172.21.15.79:0/2247635792 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09601073a0 msgr2=0x7f0960103790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:53.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.604+0000 7f09650be640 1 --2- 172.21.15.79:0/2247635792 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09601073a0 0x7f0960103790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:53.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.604+0000 7f09650be640 1 -- 172.21.15.79:0/2247635792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0960101990 msgr2=0x7f0960103250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:53.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.604+0000 7f09650be640 1 --2- 172.21.15.79:0/2247635792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0960101990 0x7f0960103250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:53.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.604+0000 7f09650be640 1 -- 172.21.15.79:0/2247635792 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09601a7330 con 0x7f0960107d20 2024-08-20T01:39:53.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.604+0000 7f09650be640 1 --2- 172.21.15.79:0/2247635792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0960107d20 0x7f0960103cd0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f0958009fd0 tx=0x7f095800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:53.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.604+0000 7f095dffb640 1 -- 172.21.15.79:0/2247635792 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0958017070 con 0x7f0960107d20 2024-08-20T01:39:53.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.605+0000 7f095dffb640 1 -- 172.21.15.79:0/2247635792 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0958003e00 con 0x7f0960107d20 2024-08-20T01:39:53.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.605+0000 7f0966b21640 1 -- 172.21.15.79:0/2247635792 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09601a7620 con 0x7f0960107d20 2024-08-20T01:39:53.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.605+0000 7f095dffb640 1 -- 172.21.15.79:0/2247635792 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0958010460 con 0x7f0960107d20 2024-08-20T01:39:53.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.605+0000 7f0966b21640 1 -- 172.21.15.79:0/2247635792 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09601a7b60 con 0x7f0960107d20 2024-08-20T01:39:53.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.606+0000 7f0966b21640 1 -- 172.21.15.79:0/2247635792 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0960101d70 con 0x7f0960107d20 2024-08-20T01:39:53.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.607+0000 7f095dffb640 1 -- 172.21.15.79:0/2247635792 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f0958003970 con 0x7f0960107d20 2024-08-20T01:39:53.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.609+0000 7f095dffb640 1 --2- 172.21.15.79:0/2247635792 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f09500b3c50 0x7f09500b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:53.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.609+0000 7f09648bd640 1 --2- 172.21.15.79:0/2247635792 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f09500b3c50 0x7f09500b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:53.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.609+0000 7f095dffb640 1 -- 172.21.15.79:0/2247635792 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f09580e3cc0 con 0x7f0960107d20 2024-08-20T01:39:53.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.609+0000 7f09648bd640 1 --2- 172.21.15.79:0/2247635792 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f09500b3c50 0x7f09500b6110 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f09540057c0 tx=0x7f09540058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:53.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.615+0000 7f095dffb640 1 -- 172.21.15.79:0/2247635792 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f09580ea080 con 0x7f0960107d20 2024-08-20T01:39:53.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.851+0000 7f0966b21640 1 -- 172.21.15.79:0/2247635792 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f09601a7f60 con 0x7f0960107d20 2024-08-20T01:39:53.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.851+0000 7f095dffb640 1 -- 172.21.15.79:0/2247635792 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11986 (secure 0 0 0) 0x7f09580aac70 con 0x7f0960107d20 2024-08-20T01:39:53.854 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:39:53.854 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":33,"btime":"2024-08-20T01:38:36:482135+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14670,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/735082912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":735082912},{"type":"v1","addr":"172.21.15.79:6835","nonce":735082912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2150339873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2150339873},{"type":"v1","addr":"172.21.15.79:6837","nonce":2150339873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":33,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:34:55.133562+0000","modified":"2024-08-20T01:38:35.888862+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24539,"mds_1":24538,"mds_2":24523,"mds_3":24514,"mds_4":24512},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14724":{"gid":14724,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/1071242274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1071242274},{"type":"v1","addr":"172.21.15.79:6839","nonce":1071242274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14730":{"gid":14730,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6841/2448977611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":2448977611},{"type":"v1","addr":"172.21.15.79:6841","nonce":2448977611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/1257507005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1257507005},{"type":"v1","addr":"172.21.15.81:6833","nonce":1257507005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1499936216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1499936216},{"type":"v1","addr":"172.21.15.81:6835","nonce":1499936216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/1107229215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1107229215},{"type":"v1","addr":"172.21.15.175:6833","nonce":1107229215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6837/2073598870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2073598870},{"type":"v1","addr":"172.21.15.81:6837","nonce":2073598870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/2552601173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2552601173},{"type":"v1","addr":"172.21.15.175:6835","nonce":2552601173}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6837/1767284089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1767284089},{"type":"v1","addr":"172.21.15.175:6837","nonce":1767284089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/1331748742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1331748742},{"type":"v1","addr":"172.21.15.175:6839","nonce":1331748742}]},"join_fscid":-1,"export_targets":[2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/4098410583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":4098410583},{"type":"v1","addr":"172.21.15.81:6839","nonce":4098410583}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24539,"qdb_cluster":[24539,24523,24514,24538,24512]},"id":1}]} 2024-08-20T01:39:53.854 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 33 2024-08-20T01:39:53.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.854+0000 7f0966b21640 1 -- 172.21.15.79:0/2247635792 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f09500b3c50 msgr2=0x7f09500b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:53.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.854+0000 7f0966b21640 1 --2- 172.21.15.79:0/2247635792 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f09500b3c50 0x7f09500b6110 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f09540057c0 tx=0x7f09540058d0 comp rx=0 tx=0).stop 2024-08-20T01:39:53.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.854+0000 7f0966b21640 1 -- 172.21.15.79:0/2247635792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0960107d20 msgr2=0x7f0960103cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:53.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.854+0000 7f0966b21640 1 --2- 172.21.15.79:0/2247635792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0960107d20 0x7f0960103cd0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f0958009fd0 tx=0x7f095800b260 comp rx=0 tx=0).stop 2024-08-20T01:39:53.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.854+0000 7f0966b21640 1 -- 172.21.15.79:0/2247635792 shutdown_connections 2024-08-20T01:39:53.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.854+0000 7f0966b21640 1 --2- 172.21.15.79:0/2247635792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0960107d20 0x7f0960103cd0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:53.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.854+0000 7f0966b21640 1 --2- 172.21.15.79:0/2247635792 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f09500b3c50 0x7f09500b6110 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:53.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.854+0000 7f0966b21640 1 --2- 172.21.15.79:0/2247635792 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09601073a0 0x7f0960103790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:53.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.854+0000 7f0966b21640 1 --2- 172.21.15.79:0/2247635792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0960101990 0x7f0960103250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:53.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.854+0000 7f0966b21640 1 -- 172.21.15.79:0/2247635792 >> 172.21.15.79:0/2247635792 conn(0x7f09600fd400 msgr2=0x7f096006aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:53.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.854+0000 7f0966b21640 1 -- 172.21.15.79:0/2247635792 shutdown_connections 2024-08-20T01:39:53.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:53.854+0000 7f0966b21640 1 -- 172.21.15.79:0/2247635792 wait complete. 2024-08-20T01:39:54.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:53 smithi079 ceph-mon[18656]: pgmap v424: 97 pgs: 97 active+clean; 3.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 28 MiB/s wr, 20 op/s 2024-08-20T01:39:54.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:53 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2247635792' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:39:54.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:53 smithi081 ceph-mon[22209]: pgmap v424: 97 pgs: 97 active+clean; 3.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 28 MiB/s wr, 20 op/s 2024-08-20T01:39:54.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:53 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2247635792' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:39:54.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:53 smithi175 ceph-mon[22392]: pgmap v424: 97 pgs: 97 active+clean; 3.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 28 MiB/s wr, 20 op/s 2024-08-20T01:39:54.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:53 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2247635792' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:39:54.767 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-20T01:39:55.045 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:39:55.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.556+0000 7f0daa4e0640 1 -- 172.21.15.79:0/1035458727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0da4107d20 msgr2=0x7f0da410e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:55.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.556+0000 7f0daa4e0640 1 --2- 172.21.15.79:0/1035458727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0da4107d20 0x7f0da410e520 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c009ca0 tx=0x7f0d9c02a8c0 comp rx=0 tx=0).stop 2024-08-20T01:39:55.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.556+0000 7f0daa4e0640 1 -- 172.21.15.79:0/1035458727 shutdown_connections 2024-08-20T01:39:55.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.556+0000 7f0daa4e0640 1 --2- 172.21.15.79:0/1035458727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0da4107d20 0x7f0da410e520 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:55.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.556+0000 7f0daa4e0640 1 --2- 172.21.15.79:0/1035458727 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0da41073a0 0x7f0da41077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:55.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.556+0000 7f0daa4e0640 1 --2- 172.21.15.79:0/1035458727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da4101990 0x7f0da4101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:55.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.556+0000 7f0daa4e0640 1 -- 172.21.15.79:0/1035458727 >> 172.21.15.79:0/1035458727 conn(0x7f0da40fd400 msgr2=0x7f0da40ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:55.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.556+0000 7f0daa4e0640 1 -- 172.21.15.79:0/1035458727 shutdown_connections 2024-08-20T01:39:55.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.556+0000 7f0daa4e0640 1 -- 172.21.15.79:0/1035458727 wait complete. 2024-08-20T01:39:55.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.557+0000 7f0daa4e0640 1 Processor -- start 2024-08-20T01:39:55.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.557+0000 7f0daa4e0640 1 -- start start 2024-08-20T01:39:55.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.557+0000 7f0daa4e0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0da4101990 0x7f0da4198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:55.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.557+0000 7f0daa4e0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0da41073a0 0x7f0da41993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:55.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.557+0000 7f0daa4e0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da4107d20 0x7f0da419e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:55.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.557+0000 7f0daa4e0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0da41118e0 con 0x7f0da41073a0 2024-08-20T01:39:55.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.557+0000 7f0daa4e0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0da4111760 con 0x7f0da4107d20 2024-08-20T01:39:55.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.557+0000 7f0daa4e0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0da4111a60 con 0x7f0da4101990 2024-08-20T01:39:55.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.558+0000 7f0da37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0da41073a0 0x7f0da41993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:55.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.558+0000 7f0da37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0da41073a0 0x7f0da41993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48168/0 (socket says 172.21.15.79:48168) 2024-08-20T01:39:55.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.558+0000 7f0da37fe640 1 -- 172.21.15.79:0/1552277226 learned_addr learned my addr 172.21.15.79:0/1552277226 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:55.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.558+0000 7f0da8a7d640 1 --2- 172.21.15.79:0/1552277226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da4107d20 0x7f0da419e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:55.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.558+0000 7f0da3fff640 1 --2- 172.21.15.79:0/1552277226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0da4101990 0x7f0da4198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:55.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.558+0000 7f0da37fe640 1 -- 172.21.15.79:0/1552277226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0da4101990 msgr2=0x7f0da4198e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:55.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.558+0000 7f0da37fe640 1 --2- 172.21.15.79:0/1552277226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0da4101990 0x7f0da4198e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:55.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.558+0000 7f0da37fe640 1 -- 172.21.15.79:0/1552277226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da4107d20 msgr2=0x7f0da419e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:55.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.558+0000 7f0da37fe640 1 --2- 172.21.15.79:0/1552277226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da4107d20 0x7f0da419e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:55.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.558+0000 7f0da37fe640 1 -- 172.21.15.79:0/1552277226 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0da419ef40 con 0x7f0da41073a0 2024-08-20T01:39:55.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.558+0000 7f0da8a7d640 1 --2- 172.21.15.79:0/1552277226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da4107d20 0x7f0da419e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:39:55.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.558+0000 7f0da37fe640 1 --2- 172.21.15.79:0/1552277226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0da41073a0 0x7f0da41993d0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f0d9800c970 tx=0x7f0d9800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:55.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.558+0000 7f0da17fa640 1 -- 172.21.15.79:0/1552277226 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d98007bb0 con 0x7f0da41073a0 2024-08-20T01:39:55.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.559+0000 7f0da17fa640 1 -- 172.21.15.79:0/1552277226 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0d98007d50 con 0x7f0da41073a0 2024-08-20T01:39:55.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.559+0000 7f0daa4e0640 1 -- 172.21.15.79:0/1552277226 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0da419f230 con 0x7f0da41073a0 2024-08-20T01:39:55.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.559+0000 7f0da17fa640 1 -- 172.21.15.79:0/1552277226 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d98004e40 con 0x7f0da41073a0 2024-08-20T01:39:55.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.559+0000 7f0daa4e0640 1 -- 172.21.15.79:0/1552277226 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0da41a58f0 con 0x7f0da41073a0 2024-08-20T01:39:55.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.562+0000 7f0da17fa640 1 -- 172.21.15.79:0/1552277226 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f0d98005020 con 0x7f0da41073a0 2024-08-20T01:39:55.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.562+0000 7f0dac8d9740 1 Processor -- start 2024-08-20T01:39:55.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.563+0000 7f0dac8d9740 1 -- start start 2024-08-20T01:39:55.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.563+0000 7f0dac8d9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565253ec4c90 0x565253ec5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:55.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.563+0000 7f0dac8d9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565253ec55b0 0x565253ed1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:55.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.563+0000 7f0dac8d9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565253ed1540 0x565253ed3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:55.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.563+0000 7f0dac8d9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x565253e37930 con 0x565253ec4c90 2024-08-20T01:39:55.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.563+0000 7f0dac8d9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x565253e26e30 con 0x565253ed1540 2024-08-20T01:39:55.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.563+0000 7f0dac8d9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x565253e2ae70 con 0x565253ec55b0 2024-08-20T01:39:55.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.563+0000 7f0da8a7d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565253ec4c90 0x565253ec5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:55.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.563+0000 7f0da8a7d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565253ec4c90 0x565253ec5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48178/0 (socket says 172.21.15.79:48178) 2024-08-20T01:39:55.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.563+0000 7f0da8a7d640 1 -- 172.21.15.79:0/3786436096 learned_addr learned my addr 172.21.15.79:0/3786436096 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:55.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.564+0000 7f0da37fe640 1 --2- 172.21.15.79:0/3786436096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565253ed1540 0x565253ed3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:55.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.564+0000 7f0da8a7d640 1 -- 172.21.15.79:0/3786436096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565253ec55b0 msgr2=0x565253ed1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:55.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.564+0000 7f0da8a7d640 1 --2- 172.21.15.79:0/3786436096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565253ec55b0 0x565253ed1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:55.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.564+0000 7f0da8a7d640 1 -- 172.21.15.79:0/3786436096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565253ed1540 msgr2=0x565253ed3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:55.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.564+0000 7f0da8a7d640 1 --2- 172.21.15.79:0/3786436096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565253ed1540 0x565253ed3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:55.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.564+0000 7f0da8a7d640 1 -- 172.21.15.79:0/3786436096 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565253b86650 con 0x565253ec4c90 2024-08-20T01:39:55.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.564+0000 7f0da17fa640 1 --2- 172.21.15.79:0/1552277226 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0d8c0b3c50 0x7f0d8c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:55.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.564+0000 7f0da8a7d640 1 --2- 172.21.15.79:0/3786436096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565253ec4c90 0x565253ec5070 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c009ca0 tx=0x7f0d9c009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7217732efaba15dc server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:55.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.564+0000 7f0da3fff640 1 --2- 172.21.15.79:0/1552277226 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0d8c0b3c50 0x7f0d8c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:55.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.564+0000 7f0da17fa640 1 -- 172.21.15.79:0/1552277226 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f0d980e3870 con 0x7f0da41073a0 2024-08-20T01:39:55.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.565+0000 7f0d8a7fc640 1 -- 172.21.15.79:0/3786436096 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c031dc0 con 0x565253ec4c90 2024-08-20T01:39:55.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.565+0000 7f0d8a7fc640 1 -- 172.21.15.79:0/3786436096 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0d9c036030 con 0x565253ec4c90 2024-08-20T01:39:55.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.565+0000 7f0d8a7fc640 1 -- 172.21.15.79:0/3786436096 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c0305c0 con 0x565253ec4c90 2024-08-20T01:39:55.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.566+0000 7f0dac8d9740 1 -- 172.21.15.79:0/3786436096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565253ec4c90 msgr2=0x565253ec5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:55.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.566+0000 7f0da3fff640 1 --2- 172.21.15.79:0/1552277226 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0d8c0b3c50 0x7f0d8c0b6110 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x565253ec39a0 tx=0x7f0d9400b770 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:55.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.566+0000 7f0dac8d9740 1 --2- 172.21.15.79:0/3786436096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565253ec4c90 0x565253ec5070 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c009ca0 tx=0x7f0d9c009a20 comp rx=0 tx=0).stop 2024-08-20T01:39:55.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.566+0000 7f0dac8d9740 1 -- 172.21.15.79:0/3786436096 shutdown_connections 2024-08-20T01:39:55.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.566+0000 7f0dac8d9740 1 --2- 172.21.15.79:0/3786436096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565253ed1540 0x565253ed3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:55.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.566+0000 7f0dac8d9740 1 --2- 172.21.15.79:0/3786436096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565253ec55b0 0x565253ed1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:55.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.566+0000 7f0dac8d9740 1 --2- 172.21.15.79:0/3786436096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565253ec4c90 0x565253ec5070 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:55.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.566+0000 7f0dac8d9740 1 -- 172.21.15.79:0/3786436096 >> 172.21.15.79:0/3786436096 conn(0x565253ec2ac0 msgr2=0x565253ec3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:55.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.566+0000 7f0dac8d9740 1 -- 172.21.15.79:0/3786436096 shutdown_connections 2024-08-20T01:39:55.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.566+0000 7f0dac8d9740 1 -- 172.21.15.79:0/3786436096 wait complete. 2024-08-20T01:39:55.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.566+0000 7f0dac8d9740 1 -- start start 2024-08-20T01:39:55.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.567+0000 7f0dac8d9740 1 Processor -- start 2024-08-20T01:39:55.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.567+0000 7f0dac8d9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565253ec4c90 0x565253ece5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:55.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.567+0000 7f0dac8d9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565253ec55b0 0x565253eceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:55.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.567+0000 7f0dac8d9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565253ed1540 0x565253ecf020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:55.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.567+0000 7f0dac8d9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x565253c89700 con 0x565253ed1540 2024-08-20T01:39:55.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.567+0000 7f0dac8d9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x565253dad810 con 0x565253ec4c90 2024-08-20T01:39:55.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.567+0000 7f0dac8d9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x565253ed3fe0 con 0x565253ec55b0 2024-08-20T01:39:55.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.567+0000 7f0dac8d9740 10 client.0 _ll_register_callbacks cb 0x565253e20700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:55.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.567+0000 7f0da8a7d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565253ed1540 0x565253ecf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:55.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.567+0000 7f0da8a7d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565253ed1540 0x565253ecf020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48190/0 (socket says 172.21.15.79:48190) 2024-08-20T01:39:55.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.567+0000 7f0da8a7d640 1 -- 172.21.15.79:0/476139860 learned_addr learned my addr 172.21.15.79:0/476139860 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:55.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.567+0000 7f0da37fe640 1 --2- 172.21.15.79:0/476139860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565253ec55b0 0x565253eceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:55.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.567+0000 7f0da3fff640 1 --2- 172.21.15.79:0/476139860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565253ec4c90 0x565253ece5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:55.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.568+0000 7f0da8a7d640 1 -- 172.21.15.79:0/476139860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565253ec55b0 msgr2=0x565253eceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:55.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.568+0000 7f0da8a7d640 1 --2- 172.21.15.79:0/476139860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565253ec55b0 0x565253eceae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:55.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.568+0000 7f0da8a7d640 1 -- 172.21.15.79:0/476139860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565253ec4c90 msgr2=0x565253ece5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:55.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.568+0000 7f0da8a7d640 1 --2- 172.21.15.79:0/476139860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565253ec4c90 0x565253ece5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:55.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.568+0000 7f0da8a7d640 1 -- 172.21.15.79:0/476139860 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565253edd470 con 0x565253ed1540 2024-08-20T01:39:55.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.568+0000 7f0da8a7d640 1 --2- 172.21.15.79:0/476139860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565253ed1540 0x565253ecf020 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c02ade0 tx=0x7f0d9c031df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=908e62f625cedcee server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:55.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.568+0000 7f0d837fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:39:55.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.568+0000 7f0d837fe640 1 -- 172.21.15.79:0/476139860 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c0307d0 con 0x565253ed1540 2024-08-20T01:39:55.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.568+0000 7f0d837fe640 1 -- 172.21.15.79:0/476139860 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f0d9c030970 con 0x565253ed1540 2024-08-20T01:39:55.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.568+0000 7f0dac8d9740 1 -- 172.21.15.79:0/476139860 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x565253dd6150 con 0x565253ed1540 2024-08-20T01:39:55.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.569+0000 7f0d837fe640 1 -- 172.21.15.79:0/476139860 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f0d9c030bb0 con 0x565253ed1540 2024-08-20T01:39:55.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.569+0000 7f0dac8d9740 10 client.16395 fetch_fsmap learned FSMap version 33 2024-08-20T01:39:55.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.569+0000 7f0dac8d9740 1 -- 172.21.15.79:0/476139860 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x565253ebdf80 con 0x565253ed1540 2024-08-20T01:39:55.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.569+0000 7f0d837fe640 1 -- 172.21.15.79:0/476139860 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x565253dd6150 con 0x565253ed1540 2024-08-20T01:39:55.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.569+0000 7f0d837fe640 1 -- 172.21.15.79:0/476139860 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7f0d9c04e070 con 0x565253ed1540 2024-08-20T01:39:55.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.569+0000 7f0dac8d9740 10 client.16395 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:39:55.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.569+0000 7f0dac8d9740 10 client.16395 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:39:55.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.569+0000 7f0dac8d9740 20 client.16395 populate_metadata read hostname 'smithi079' 2024-08-20T01:39:55.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.569+0000 7f0dac8d9740 1 --2- 172.21.15.79:0/476139860 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x565253ebf3f0 0x565253ec1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:55.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.569+0000 7f0dac8d9740 4 client.16395 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:39:55.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.569+0000 7f0dac8d9740 1 -- 172.21.15.79:0/476139860 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565253e39880 con 0x565253ebf3f0 2024-08-20T01:39:55.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.569+0000 7f0da3fff640 1 --2- 172.21.15.79:0/476139860 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x565253ebf3f0 0x565253ec1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:55.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.570+0000 7f0d837fe640 10 client.16395 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:39:55.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.570+0000 7f0da3fff640 1 --2- 172.21.15.79:0/476139860 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x565253ebf3f0 0x565253ec1810 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=fd73919766ec7268 server_cookie=bb7e98a1fab5d257 in_seq=0 out_seq=0 2024-08-20T01:39:55.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.571+0000 7f0d837fe640 1 -- 172.21.15.79:0/476139860 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x565253e39880 con 0x565253ebf3f0 2024-08-20T01:39:55.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.571+0000 7f0d837fe640 10 client.16395 handle_command_reply: tid=0 2024-08-20T01:39:55.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.571+0000 7f0dac8d9740 1 client.16395 shutdown 2024-08-20T01:39:55.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.571+0000 7f0dac8d9740 1 -- 172.21.15.79:0/476139860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565253ed1540 msgr2=0x565253ecf020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:55.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.571+0000 7f0dac8d9740 1 --2- 172.21.15.79:0/476139860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565253ed1540 0x565253ecf020 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c02ade0 tx=0x7f0d9c031df0 comp rx=0 tx=0).stop 2024-08-20T01:39:55.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.571+0000 7f0dac8d9740 1 -- 172.21.15.79:0/476139860 shutdown_connections 2024-08-20T01:39:55.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.571+0000 7f0dac8d9740 1 --2- 172.21.15.79:0/476139860 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x565253ebf3f0 0x565253ec1810 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:55.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.571+0000 7f0dac8d9740 1 --2- 172.21.15.79:0/476139860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565253ed1540 0x565253ecf020 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:55.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.571+0000 7f0dac8d9740 1 --2- 172.21.15.79:0/476139860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565253ec55b0 0x565253eceae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:55.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.571+0000 7f0dac8d9740 1 --2- 172.21.15.79:0/476139860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565253ec4c90 0x565253ece5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:55.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.571+0000 7f0dac8d9740 1 -- 172.21.15.79:0/476139860 >> 172.21.15.79:0/476139860 conn(0x565253ec2ac0 msgr2=0x565253ebd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:55.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.571+0000 7f0d837fe640 0 client.16395 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:39:55.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.571+0000 7f0dac8d9740 1 -- 172.21.15.79:0/476139860 shutdown_connections 2024-08-20T01:39:55.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.571+0000 7f0dac8d9740 1 -- 172.21.15.79:0/476139860 wait complete. 2024-08-20T01:39:55.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.571+0000 7f0dac8d9740 20 client.16395 trim_cache size 0 max 16384 2024-08-20T01:39:55.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.587+0000 7f0dac8d9740 1 Processor -- start 2024-08-20T01:39:55.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.587+0000 7f0dac8d9740 1 -- start start 2024-08-20T01:39:55.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.587+0000 7f0dac8d9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565253ec4c90 0x565253edc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:55.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.587+0000 7f0dac8d9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565253ec55b0 0x565253ecb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:55.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.587+0000 7f0dac8d9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565253ed1540 0x565253ecbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:55.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.587+0000 7f0dac8d9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0da41abc70 con 0x565253ed1540 2024-08-20T01:39:55.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.587+0000 7f0dac8d9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0da41ad900 con 0x565253ec4c90 2024-08-20T01:39:55.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.587+0000 7f0dac8d9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0da41ac340 con 0x565253ec55b0 2024-08-20T01:39:55.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.587+0000 7f0da8a7d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565253ed1540 0x565253ecbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:55.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.587+0000 7f0da8a7d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565253ed1540 0x565253ecbcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48200/0 (socket says 172.21.15.79:48200) 2024-08-20T01:39:55.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.587+0000 7f0da8a7d640 1 -- 172.21.15.79:0/77225153 learned_addr learned my addr 172.21.15.79:0/77225153 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:55.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.587+0000 7f0da37fe640 1 --2- 172.21.15.79:0/77225153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565253ec55b0 0x565253ecb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:55.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.587+0000 7f0da3fff640 1 --2- 172.21.15.79:0/77225153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565253ec4c90 0x565253edc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:55.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.588+0000 7f0da8a7d640 1 -- 172.21.15.79:0/77225153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565253ec55b0 msgr2=0x565253ecb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:55.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.588+0000 7f0da8a7d640 1 --2- 172.21.15.79:0/77225153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565253ec55b0 0x565253ecb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:55.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.588+0000 7f0da8a7d640 1 -- 172.21.15.79:0/77225153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565253ec4c90 msgr2=0x565253edc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:55.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.588+0000 7f0da8a7d640 1 --2- 172.21.15.79:0/77225153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565253ec4c90 0x565253edc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:55.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.588+0000 7f0da8a7d640 1 -- 172.21.15.79:0/77225153 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565253ec9320 con 0x565253ed1540 2024-08-20T01:39:55.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.588+0000 7f0da37fe640 1 --2- 172.21.15.79:0/77225153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565253ec55b0 0x565253ecb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:39:55.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.588+0000 7f0da8a7d640 1 --2- 172.21.15.79:0/77225153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565253ed1540 0x565253ecbcf0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c005e30 tx=0x7f0d9c009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b12cd9212a1d1af server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:55.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.588+0000 7f0d89ffb640 1 -- 172.21.15.79:0/77225153 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c031e60 con 0x565253ed1540 2024-08-20T01:39:55.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.588+0000 7f0d89ffb640 1 -- 172.21.15.79:0/77225153 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0d9c054070 con 0x565253ed1540 2024-08-20T01:39:55.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.588+0000 7f0d89ffb640 1 -- 172.21.15.79:0/77225153 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c045a20 con 0x565253ed1540 2024-08-20T01:39:55.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.589+0000 7f0dac8d9740 1 -- 172.21.15.79:0/77225153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565253ed1540 msgr2=0x565253ecbcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:55.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.589+0000 7f0dac8d9740 1 --2- 172.21.15.79:0/77225153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565253ed1540 0x565253ecbcf0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c005e30 tx=0x7f0d9c009a20 comp rx=0 tx=0).stop 2024-08-20T01:39:55.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.589+0000 7f0dac8d9740 1 -- 172.21.15.79:0/77225153 shutdown_connections 2024-08-20T01:39:55.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.589+0000 7f0dac8d9740 1 --2- 172.21.15.79:0/77225153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565253ed1540 0x565253ecbcf0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:55.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.589+0000 7f0dac8d9740 1 --2- 172.21.15.79:0/77225153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565253ec55b0 0x565253ecb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:55.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.589+0000 7f0dac8d9740 1 --2- 172.21.15.79:0/77225153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565253ec4c90 0x565253edc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:55.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.589+0000 7f0dac8d9740 1 -- 172.21.15.79:0/77225153 >> 172.21.15.79:0/77225153 conn(0x565253ec2ac0 msgr2=0x565253edc270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:55.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.589+0000 7f0dac8d9740 1 -- 172.21.15.79:0/77225153 shutdown_connections 2024-08-20T01:39:55.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.589+0000 7f0dac8d9740 1 -- 172.21.15.79:0/77225153 wait complete. 2024-08-20T01:39:55.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.589+0000 7f0dac8d9740 1 -- start start 2024-08-20T01:39:55.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.590+0000 7f0dac8d9740 1 Processor -- start 2024-08-20T01:39:55.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.590+0000 7f0dac8d9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565253ec4c90 0x565253ee3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:55.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.590+0000 7f0dac8d9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565253ec55b0 0x565253ee4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:55.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.590+0000 7f0dac8d9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565253ed1540 0x565253ee4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:55.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.590+0000 7f0dac8d9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0da41ad170 con 0x565253ec55b0 2024-08-20T01:39:55.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.590+0000 7f0da37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565253ec55b0 0x565253ee4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:55.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.590+0000 7f0da37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565253ec55b0 0x565253ee4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48210/0 (socket says 172.21.15.79:48210) 2024-08-20T01:39:55.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.590+0000 7f0da37fe640 1 -- 172.21.15.79:0/3213855326 learned_addr learned my addr 172.21.15.79:0/3213855326 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:55.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.590+0000 7f0dac8d9740 1 -- 172.21.15.79:0/3213855326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0da41aca10 con 0x565253ed1540 2024-08-20T01:39:55.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.590+0000 7f0dac8d9740 1 -- 172.21.15.79:0/3213855326 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0da41a9c50 con 0x565253ec4c90 2024-08-20T01:39:55.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.590+0000 7f0dac8d9740 10 client.0 _ll_register_callbacks cb 0x7f0d9c031840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:55.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.590+0000 7f0da3fff640 1 --2- 172.21.15.79:0/3213855326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565253ec4c90 0x565253ee3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:55.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.590+0000 7f0da37fe640 1 -- 172.21.15.79:0/3213855326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565253ec4c90 msgr2=0x565253ee3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:55.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.590+0000 7f0da37fe640 1 --2- 172.21.15.79:0/3213855326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565253ec4c90 0x565253ee3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:55.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.590+0000 7f0da37fe640 1 -- 172.21.15.79:0/3213855326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565253ed1540 msgr2=0x565253ee4890 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:39:55.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.590+0000 7f0da37fe640 1 --2- 172.21.15.79:0/3213855326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565253ed1540 0x565253ee4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:55.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.590+0000 7f0da37fe640 1 -- 172.21.15.79:0/3213855326 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565253ed3e60 con 0x565253ec55b0 2024-08-20T01:39:55.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.591+0000 7f0da37fe640 1 --2- 172.21.15.79:0/3213855326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565253ec55b0 0x565253ee4350 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f0d980aa520 tx=0x7f0d98005540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=700b7d6ac481bd1b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:55.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.591+0000 7f0d837fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:39:55.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.591+0000 7f0d837fe640 1 -- 172.21.15.79:0/3213855326 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d9801d040 con 0x565253ec55b0 2024-08-20T01:39:55.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.591+0000 7f0d837fe640 1 -- 172.21.15.79:0/3213855326 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f0d980b3390 con 0x565253ec55b0 2024-08-20T01:39:55.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.591+0000 7f0dac8d9740 1 -- 172.21.15.79:0/3213855326 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d9c054070 con 0x565253ec55b0 2024-08-20T01:39:55.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.591+0000 7f0d837fe640 1 -- 172.21.15.79:0/3213855326 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f0d980b3160 con 0x565253ec55b0 2024-08-20T01:39:55.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.591+0000 7f0dac8d9740 10 client.16401 fetch_fsmap learned FSMap version 33 2024-08-20T01:39:55.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.591+0000 7f0dac8d9740 1 -- 172.21.15.79:0/3213855326 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x565253f470f0 con 0x565253ec55b0 2024-08-20T01:39:55.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.591+0000 7f0d837fe640 1 -- 172.21.15.79:0/3213855326 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0d9c054070 con 0x565253ec55b0 2024-08-20T01:39:55.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.591+0000 7f0d837fe640 1 -- 172.21.15.79:0/3213855326 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7f0d98090450 con 0x565253ec55b0 2024-08-20T01:39:55.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.592+0000 7f0dac8d9740 10 client.16401 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:39:55.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.592+0000 7f0dac8d9740 10 client.16401 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:39:55.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.592+0000 7f0dac8d9740 20 client.16401 populate_metadata read hostname 'smithi079' 2024-08-20T01:39:55.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.592+0000 7f0dac8d9740 1 --2- 172.21.15.79:0/3213855326 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x565253f478f0 0x565253f49d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:55.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.592+0000 7f0dac8d9740 4 client.16401 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:39:55.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.592+0000 7f0dac8d9740 1 -- 172.21.15.79:0/3213855326 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "damage ls"}) -- 0x565253e35320 con 0x565253f478f0 2024-08-20T01:39:55.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.592+0000 7f0da3fff640 1 --2- 172.21.15.79:0/3213855326 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x565253f478f0 0x565253f49d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:55.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.592+0000 7f0d837fe640 10 client.16401 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:39:55.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.592+0000 7f0da3fff640 1 --2- 172.21.15.79:0/3213855326 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x565253f478f0 0x565253f49d00 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3615ab2338d75d8a server_cookie=2934eb607dbf18f6 in_seq=0 out_seq=0 2024-08-20T01:39:55.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.593+0000 7f0d837fe640 1 -- 172.21.15.79:0/3213855326 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x565253e35320 con 0x565253f478f0 2024-08-20T01:39:55.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.593+0000 7f0d837fe640 10 client.16401 handle_command_reply: tid=0 2024-08-20T01:39:55.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.593+0000 7f0dac8d9740 1 client.16401 shutdown 2024-08-20T01:39:55.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.593+0000 7f0dac8d9740 1 -- 172.21.15.79:0/3213855326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565253ec55b0 msgr2=0x565253ee4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:55.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.593+0000 7f0dac8d9740 1 --2- 172.21.15.79:0/3213855326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565253ec55b0 0x565253ee4350 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f0d980aa520 tx=0x7f0d98005540 comp rx=0 tx=0).stop 2024-08-20T01:39:55.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.593+0000 7f0dac8d9740 1 -- 172.21.15.79:0/3213855326 shutdown_connections 2024-08-20T01:39:55.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.593+0000 7f0dac8d9740 1 --2- 172.21.15.79:0/3213855326 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x565253f478f0 0x565253f49d00 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:55.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.593+0000 7f0dac8d9740 1 --2- 172.21.15.79:0/3213855326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565253ed1540 0x565253ee4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:55.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.593+0000 7f0d837fe640 0 client.16401 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:39:55.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.593+0000 7f0dac8d9740 1 --2- 172.21.15.79:0/3213855326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565253ec55b0 0x565253ee4350 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:55.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.593+0000 7f0dac8d9740 1 --2- 172.21.15.79:0/3213855326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565253ec4c90 0x565253ee3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:55.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.593+0000 7f0dac8d9740 1 -- 172.21.15.79:0/3213855326 >> 172.21.15.79:0/3213855326 conn(0x565253ec2ac0 msgr2=0x565253ebd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:55.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.593+0000 7f0dac8d9740 1 -- 172.21.15.79:0/3213855326 shutdown_connections 2024-08-20T01:39:55.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.593+0000 7f0dac8d9740 1 -- 172.21.15.79:0/3213855326 wait complete. 2024-08-20T01:39:55.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.593+0000 7f0dac8d9740 20 client.16401 trim_cache size 0 max 16384 2024-08-20T01:39:55.600 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:39:55.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.594+0000 7f0daa4e0640 1 -- 172.21.15.79:0/1552277226 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0d8c0b3c50 msgr2=0x7f0d8c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:55.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.594+0000 7f0daa4e0640 1 --2- 172.21.15.79:0/1552277226 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0d8c0b3c50 0x7f0d8c0b6110 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x565253ec39a0 tx=0x7f0d9400b770 comp rx=0 tx=0).stop 2024-08-20T01:39:55.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.594+0000 7f0daa4e0640 1 -- 172.21.15.79:0/1552277226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0da41073a0 msgr2=0x7f0da41993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:55.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.594+0000 7f0daa4e0640 1 --2- 172.21.15.79:0/1552277226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0da41073a0 0x7f0da41993d0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f0d9800c970 tx=0x7f0d9800ce30 comp rx=0 tx=0).stop 2024-08-20T01:39:55.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.594+0000 7f0daa4e0640 1 -- 172.21.15.79:0/1552277226 shutdown_connections 2024-08-20T01:39:55.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.594+0000 7f0daa4e0640 1 --2- 172.21.15.79:0/1552277226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da4107d20 0x7f0da419e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:55.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.594+0000 7f0daa4e0640 1 --2- 172.21.15.79:0/1552277226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0da41073a0 0x7f0da41993d0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:55.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.594+0000 7f0daa4e0640 1 --2- 172.21.15.79:0/1552277226 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0d8c0b3c50 0x7f0d8c0b6110 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:55.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.594+0000 7f0daa4e0640 1 --2- 172.21.15.79:0/1552277226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0da4101990 0x7f0da4198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:55.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.594+0000 7f0daa4e0640 1 -- 172.21.15.79:0/1552277226 >> 172.21.15.79:0/1552277226 conn(0x7f0da40fd400 msgr2=0x7f0da406aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:55.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.594+0000 7f0daa4e0640 1 -- 172.21.15.79:0/1552277226 shutdown_connections 2024-08-20T01:39:55.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:55.594+0000 7f0daa4e0640 1 -- 172.21.15.79:0/1552277226 wait complete. 2024-08-20T01:39:56.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:55 smithi079 ceph-mon[18656]: pgmap v425: 97 pgs: 97 active+clean; 3.1 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 32 MiB/s wr, 26 op/s 2024-08-20T01:39:56.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:55 smithi081 ceph-mon[22209]: pgmap v425: 97 pgs: 97 active+clean; 3.1 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 32 MiB/s wr, 26 op/s 2024-08-20T01:39:56.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:55 smithi175 ceph-mon[22392]: pgmap v425: 97 pgs: 97 active+clean; 3.1 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 32 MiB/s wr, 26 op/s 2024-08-20T01:39:56.523 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-20T01:39:56.798 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:39:57.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.312+0000 7f2ea0336640 1 -- 172.21.15.79:0/3059370920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e98107d20 msgr2=0x7f2e9810e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:57.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.312+0000 7f2ea0336640 1 --2- 172.21.15.79:0/3059370920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e98107d20 0x7f2e9810e520 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f2e90009ca0 tx=0x7f2e9002a8c0 comp rx=0 tx=0).stop 2024-08-20T01:39:57.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.312+0000 7f2ea0336640 1 -- 172.21.15.79:0/3059370920 shutdown_connections 2024-08-20T01:39:57.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.312+0000 7f2ea0336640 1 --2- 172.21.15.79:0/3059370920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e98107d20 0x7f2e9810e520 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:57.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.312+0000 7f2ea0336640 1 --2- 172.21.15.79:0/3059370920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e981073a0 0x7f2e981077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:57.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.312+0000 7f2ea0336640 1 --2- 172.21.15.79:0/3059370920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e98101990 0x7f2e98101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:57.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.312+0000 7f2ea0336640 1 -- 172.21.15.79:0/3059370920 >> 172.21.15.79:0/3059370920 conn(0x7f2e980fd400 msgr2=0x7f2e980ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:57.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.312+0000 7f2ea0336640 1 -- 172.21.15.79:0/3059370920 shutdown_connections 2024-08-20T01:39:57.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.312+0000 7f2ea0336640 1 -- 172.21.15.79:0/3059370920 wait complete. 2024-08-20T01:39:57.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.313+0000 7f2ea0336640 1 Processor -- start 2024-08-20T01:39:57.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.313+0000 7f2ea0336640 1 -- start start 2024-08-20T01:39:57.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.313+0000 7f2ea0336640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e98101990 0x7f2e98199c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:57.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.313+0000 7f2ea0336640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e981073a0 0x7f2e9819a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:57.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.313+0000 7f2ea0336640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e98107d20 0x7f2e9819a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:57.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.313+0000 7f2ea0336640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2e981118e0 con 0x7f2e98107d20 2024-08-20T01:39:57.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.313+0000 7f2ea0336640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2e98111760 con 0x7f2e98101990 2024-08-20T01:39:57.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.313+0000 7f2ea0336640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2e98111a60 con 0x7f2e981073a0 2024-08-20T01:39:57.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.314+0000 7f2e9e8d3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e98107d20 0x7f2e9819a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:57.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.314+0000 7f2e9e8d3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e98107d20 0x7f2e9819a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48216/0 (socket says 172.21.15.79:48216) 2024-08-20T01:39:57.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.314+0000 7f2e9e8d3640 1 -- 172.21.15.79:0/1499574809 learned_addr learned my addr 172.21.15.79:0/1499574809 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:57.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.314+0000 7f2e9d8d1640 1 --2- 172.21.15.79:0/1499574809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e981073a0 0x7f2e9819a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:57.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.314+0000 7f2e9e0d2640 1 --2- 172.21.15.79:0/1499574809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e98101990 0x7f2e98199c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:57.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.314+0000 7f2e9e8d3640 1 -- 172.21.15.79:0/1499574809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e981073a0 msgr2=0x7f2e9819a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:57.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.314+0000 7f2e9e8d3640 1 --2- 172.21.15.79:0/1499574809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e981073a0 0x7f2e9819a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:57.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.314+0000 7f2e9e8d3640 1 -- 172.21.15.79:0/1499574809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e98101990 msgr2=0x7f2e98199c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:57.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.314+0000 7f2e9e8d3640 1 --2- 172.21.15.79:0/1499574809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e98101990 0x7f2e98199c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:57.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.314+0000 7f2e9e8d3640 1 -- 172.21.15.79:0/1499574809 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e981a5090 con 0x7f2e98107d20 2024-08-20T01:39:57.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.314+0000 7f2e9e8d3640 1 --2- 172.21.15.79:0/1499574809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e98107d20 0x7f2e9819a750 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f2e90005cc0 tx=0x7f2e90032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:57.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.314+0000 7f2e8f7fe640 1 -- 172.21.15.79:0/1499574809 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e90032e00 con 0x7f2e98107d20 2024-08-20T01:39:57.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.314+0000 7f2ea0336640 1 -- 172.21.15.79:0/1499574809 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e981a5320 con 0x7f2e98107d20 2024-08-20T01:39:57.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.314+0000 7f2e8f7fe640 1 -- 172.21.15.79:0/1499574809 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e900044d0 con 0x7f2e98107d20 2024-08-20T01:39:57.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.314+0000 7f2e8f7fe640 1 -- 172.21.15.79:0/1499574809 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e90030b70 con 0x7f2e98107d20 2024-08-20T01:39:57.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.314+0000 7f2ea0336640 1 -- 172.21.15.79:0/1499574809 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e981a58b0 con 0x7f2e98107d20 2024-08-20T01:39:57.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.317+0000 7f2ea272f740 1 Processor -- start 2024-08-20T01:39:57.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.317+0000 7f2e8f7fe640 1 -- 172.21.15.79:0/1499574809 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2e90004680 con 0x7f2e98107d20 2024-08-20T01:39:57.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.317+0000 7f2ea272f740 1 -- start start 2024-08-20T01:39:57.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.318+0000 7f2ea272f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f91088880 0x563f91088c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:57.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.318+0000 7f2ea272f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f910891a0 0x563f91099000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:57.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.318+0000 7f2ea272f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f91099540 0x563f9109b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:57.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.318+0000 7f2ea272f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563f90fff930 con 0x563f910891a0 2024-08-20T01:39:57.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.318+0000 7f2ea272f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563f90feee30 con 0x563f91088880 2024-08-20T01:39:57.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.318+0000 7f2ea272f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563f90ff2e70 con 0x563f91099540 2024-08-20T01:39:57.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.318+0000 7f2e9e0d2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f910891a0 0x563f91099000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:57.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.318+0000 7f2e9e0d2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f910891a0 0x563f91099000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48218/0 (socket says 172.21.15.79:48218) 2024-08-20T01:39:57.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.318+0000 7f2e9e0d2640 1 -- 172.21.15.79:0/921433174 learned_addr learned my addr 172.21.15.79:0/921433174 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:57.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.318+0000 7f2e9d8d1640 1 --2- 172.21.15.79:0/921433174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f91088880 0x563f91088c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:57.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.318+0000 7f2e9d8d1640 1 --2- 172.21.15.79:0/921433174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f91099540 0x563f9109b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:57.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.318+0000 7f2e8f7fe640 1 --2- 172.21.15.79:0/1499574809 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2e840b3c50 0x7f2e840b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:57.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.318+0000 7f2e9e0d2640 1 -- 172.21.15.79:0/921433174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f91099540 msgr2=0x563f9109b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:57.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.318+0000 7f2e9e0d2640 1 --2- 172.21.15.79:0/921433174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f91099540 0x563f9109b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:57.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.318+0000 7f2e9e0d2640 1 -- 172.21.15.79:0/921433174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f91088880 msgr2=0x563f91088c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:57.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.318+0000 7f2e9e0d2640 1 --2- 172.21.15.79:0/921433174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f91088880 0x563f91088c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:57.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.318+0000 7f2e9e0d2640 1 -- 172.21.15.79:0/921433174 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f90d4e650 con 0x563f910891a0 2024-08-20T01:39:57.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.318+0000 7f2e9d8d1640 1 --2- 172.21.15.79:0/921433174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f91099540 0x563f9109b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:39:57.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.318+0000 7f2e9e8d3640 1 --2- 172.21.15.79:0/1499574809 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2e840b3c50 0x7f2e840b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:57.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.319+0000 7f2e8f7fe640 1 -- 172.21.15.79:0/1499574809 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f2e90104f70 con 0x7f2e98107d20 2024-08-20T01:39:57.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.319+0000 7f2e9e0d2640 1 --2- 172.21.15.79:0/921433174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f910891a0 0x563f91099000 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f2e9400ac50 tx=0x7f2e9400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c22f76066b33817 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:57.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.319+0000 7f2e8cde6640 1 -- 172.21.15.79:0/921433174 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9401d070 con 0x563f910891a0 2024-08-20T01:39:57.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.319+0000 7f2e8cde6640 1 -- 172.21.15.79:0/921433174 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e94018ad0 con 0x563f910891a0 2024-08-20T01:39:57.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.319+0000 7f2e8cde6640 1 -- 172.21.15.79:0/921433174 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e940109c0 con 0x563f910891a0 2024-08-20T01:39:57.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.320+0000 7f2ea272f740 1 -- 172.21.15.79:0/921433174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f910891a0 msgr2=0x563f91099000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:57.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.320+0000 7f2ea272f740 1 --2- 172.21.15.79:0/921433174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f910891a0 0x563f91099000 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f2e9400ac50 tx=0x7f2e9400f790 comp rx=0 tx=0).stop 2024-08-20T01:39:57.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.320+0000 7f2e9e8d3640 1 --2- 172.21.15.79:0/1499574809 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2e840b3c50 0x7f2e840b6110 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2e90102a80 tx=0x7f2e900c07a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:57.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.320+0000 7f2ea272f740 1 -- 172.21.15.79:0/921433174 shutdown_connections 2024-08-20T01:39:57.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.320+0000 7f2ea272f740 1 --2- 172.21.15.79:0/921433174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f91099540 0x563f9109b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:57.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.320+0000 7f2ea272f740 1 --2- 172.21.15.79:0/921433174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f910891a0 0x563f91099000 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:57.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.320+0000 7f2ea272f740 1 --2- 172.21.15.79:0/921433174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f91088880 0x563f91088c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:57.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.320+0000 7f2ea272f740 1 -- 172.21.15.79:0/921433174 >> 172.21.15.79:0/921433174 conn(0x563f910866b0 msgr2=0x563f91087850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:57.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.320+0000 7f2ea272f740 1 -- 172.21.15.79:0/921433174 shutdown_connections 2024-08-20T01:39:57.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.320+0000 7f2ea272f740 1 -- 172.21.15.79:0/921433174 wait complete. 2024-08-20T01:39:57.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.320+0000 7f2ea272f740 1 -- start start 2024-08-20T01:39:57.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.320+0000 7f2ea272f740 1 Processor -- start 2024-08-20T01:39:57.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.321+0000 7f2ea272f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f91088880 0x563f91098fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:57.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.321+0000 7f2ea272f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f910891a0 0x563f91096440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:57.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.321+0000 7f2ea272f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f91099540 0x563f91096bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:57.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.321+0000 7f2ea272f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563f90e51700 con 0x563f910891a0 2024-08-20T01:39:57.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.321+0000 7f2ea272f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563f90f75810 con 0x563f91099540 2024-08-20T01:39:57.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.321+0000 7f2ea272f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563f9109c290 con 0x563f91088880 2024-08-20T01:39:57.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.321+0000 7f2ea272f740 10 client.0 _ll_register_callbacks cb 0x563f90fe8700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:57.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.321+0000 7f2e9e0d2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f910891a0 0x563f91096440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:57.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.321+0000 7f2e9e0d2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f910891a0 0x563f91096440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48224/0 (socket says 172.21.15.79:48224) 2024-08-20T01:39:57.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.321+0000 7f2e9e0d2640 1 -- 172.21.15.79:0/1691852440 learned_addr learned my addr 172.21.15.79:0/1691852440 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:57.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.321+0000 7f2e9d8d1640 1 --2- 172.21.15.79:0/1691852440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f91088880 0x563f91098fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:57.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.321+0000 7f2e9d8d1640 1 --2- 172.21.15.79:0/1691852440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f91099540 0x563f91096bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:57.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.321+0000 7f2e9e0d2640 1 -- 172.21.15.79:0/1691852440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f91088880 msgr2=0x563f91098fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:57.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.321+0000 7f2e9e0d2640 1 --2- 172.21.15.79:0/1691852440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f91088880 0x563f91098fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:57.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.321+0000 7f2e9e0d2640 1 -- 172.21.15.79:0/1691852440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f91099540 msgr2=0x563f91096bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:57.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.321+0000 7f2e9e0d2640 1 --2- 172.21.15.79:0/1691852440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f91099540 0x563f91096bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:57.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.321+0000 7f2e9e0d2640 1 -- 172.21.15.79:0/1691852440 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f910a5610 con 0x563f910891a0 2024-08-20T01:39:57.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.321+0000 7f2e9d8d1640 1 --2- 172.21.15.79:0/1691852440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f91099540 0x563f91096bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:39:57.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.321+0000 7f2e9e0d2640 1 --2- 172.21.15.79:0/1691852440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f910891a0 0x563f91096440 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f2e940056d0 tx=0x7f2e94005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f5dfd4809e20bb server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:57.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.321+0000 7f2e81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:39:57.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.321+0000 7f2e81ffb640 1 -- 172.21.15.79:0/1691852440 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e94026020 con 0x563f910891a0 2024-08-20T01:39:57.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.321+0000 7f2e81ffb640 1 -- 172.21.15.79:0/1691852440 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f2e94010940 con 0x563f910891a0 2024-08-20T01:39:57.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.321+0000 7f2ea272f740 1 -- 172.21.15.79:0/1691852440 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563f90f9e150 con 0x563f910891a0 2024-08-20T01:39:57.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.322+0000 7f2e81ffb640 1 -- 172.21.15.79:0/1691852440 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f2e9401d040 con 0x563f910891a0 2024-08-20T01:39:57.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.322+0000 7f2ea272f740 10 client.16413 fetch_fsmap learned FSMap version 33 2024-08-20T01:39:57.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.322+0000 7f2ea272f740 1 -- 172.21.15.79:0/1691852440 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x563f910a7f90 con 0x563f910891a0 2024-08-20T01:39:57.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.322+0000 7f2e81ffb640 1 -- 172.21.15.79:0/1691852440 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x563f90f9e150 con 0x563f910891a0 2024-08-20T01:39:57.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.322+0000 7f2e81ffb640 1 -- 172.21.15.79:0/1691852440 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7f2e94004b50 con 0x563f910891a0 2024-08-20T01:39:57.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.322+0000 7f2ea272f740 10 client.16413 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:39:57.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.322+0000 7f2ea272f740 10 client.16413 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:39:57.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.322+0000 7f2ea272f740 20 client.16413 populate_metadata read hostname 'smithi079' 2024-08-20T01:39:57.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.322+0000 7f2ea272f740 1 --2- 172.21.15.79:0/1691852440 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x563f910a92e0 0x563f910ab6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:57.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.322+0000 7f2ea272f740 4 client.16413 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:39:57.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.322+0000 7f2ea272f740 1 -- 172.21.15.79:0/1691852440 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f91001880 con 0x563f910a92e0 2024-08-20T01:39:57.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.322+0000 7f2e9d8d1640 1 --2- 172.21.15.79:0/1691852440 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x563f910a92e0 0x563f910ab6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:57.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.323+0000 7f2e81ffb640 10 client.16413 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:39:57.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.323+0000 7f2e9d8d1640 1 --2- 172.21.15.79:0/1691852440 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x563f910a92e0 0x563f910ab6d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=903a0bf664e8f83d server_cookie=e231c2e8d9230adc in_seq=0 out_seq=0 2024-08-20T01:39:57.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.323+0000 7f2e81ffb640 1 -- 172.21.15.79:0/1691852440 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563f91001880 con 0x563f910a92e0 2024-08-20T01:39:57.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.323+0000 7f2e81ffb640 10 client.16413 handle_command_reply: tid=0 2024-08-20T01:39:57.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.324+0000 7f2ea272f740 1 client.16413 shutdown 2024-08-20T01:39:57.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.324+0000 7f2ea272f740 1 -- 172.21.15.79:0/1691852440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f910891a0 msgr2=0x563f91096440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:57.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.324+0000 7f2ea272f740 1 --2- 172.21.15.79:0/1691852440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f910891a0 0x563f91096440 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f2e940056d0 tx=0x7f2e94005700 comp rx=0 tx=0).stop 2024-08-20T01:39:57.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.324+0000 7f2ea272f740 1 -- 172.21.15.79:0/1691852440 shutdown_connections 2024-08-20T01:39:57.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.324+0000 7f2ea272f740 1 --2- 172.21.15.79:0/1691852440 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x563f910a92e0 0x563f910ab6d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:57.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.324+0000 7f2ea272f740 1 --2- 172.21.15.79:0/1691852440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f91099540 0x563f91096bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:57.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.324+0000 7f2ea272f740 1 --2- 172.21.15.79:0/1691852440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f910891a0 0x563f91096440 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:57.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.324+0000 7f2e81ffb640 0 client.16413 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:39:57.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.324+0000 7f2ea272f740 1 --2- 172.21.15.79:0/1691852440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f91088880 0x563f91098fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:57.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.324+0000 7f2ea272f740 1 -- 172.21.15.79:0/1691852440 >> 172.21.15.79:0/1691852440 conn(0x563f910866b0 msgr2=0x563f9108c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:57.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.324+0000 7f2ea272f740 1 -- 172.21.15.79:0/1691852440 shutdown_connections 2024-08-20T01:39:57.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.324+0000 7f2ea272f740 1 -- 172.21.15.79:0/1691852440 wait complete. 2024-08-20T01:39:57.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.324+0000 7f2ea272f740 20 client.16413 trim_cache size 0 max 16384 2024-08-20T01:39:57.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.338+0000 7f2ea272f740 1 Processor -- start 2024-08-20T01:39:57.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.338+0000 7f2ea272f740 1 -- start start 2024-08-20T01:39:57.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.339+0000 7f2ea272f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f91088880 0x563f91093fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:57.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.339+0000 7f2ea272f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f910891a0 0x563f91085f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:57.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.339+0000 7f2ea272f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f91099540 0x563f91087aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:57.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.339+0000 7f2ea272f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2e981abda0 con 0x563f91099540 2024-08-20T01:39:57.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.339+0000 7f2ea272f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2e981ada30 con 0x563f910891a0 2024-08-20T01:39:57.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.339+0000 7f2ea272f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2e981ac470 con 0x563f91088880 2024-08-20T01:39:57.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.339+0000 7f2e9d8d1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f91099540 0x563f91087aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:57.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.339+0000 7f2e9d8d1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f91099540 0x563f91087aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48234/0 (socket says 172.21.15.79:48234) 2024-08-20T01:39:57.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.339+0000 7f2e9d8d1640 1 -- 172.21.15.79:0/1548324074 learned_addr learned my addr 172.21.15.79:0/1548324074 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:57.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.339+0000 7f2e9d8d1640 1 --2- 172.21.15.79:0/1548324074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f91088880 0x563f91093fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:57.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.339+0000 7f2e9e0d2640 1 --2- 172.21.15.79:0/1548324074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f910891a0 0x563f91085f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:57.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.339+0000 7f2e9d8d1640 1 -- 172.21.15.79:0/1548324074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f91088880 msgr2=0x563f91093fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:57.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.339+0000 7f2e9d8d1640 1 --2- 172.21.15.79:0/1548324074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f91088880 0x563f91093fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:57.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.339+0000 7f2e9d8d1640 1 -- 172.21.15.79:0/1548324074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f910891a0 msgr2=0x563f91085f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:57.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.339+0000 7f2e9d8d1640 1 --2- 172.21.15.79:0/1548324074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f910891a0 0x563f91085f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:57.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.339+0000 7f2e9d8d1640 1 -- 172.21.15.79:0/1548324074 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f9109c0d0 con 0x563f91099540 2024-08-20T01:39:57.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.339+0000 7f2e9d8d1640 1 --2- 172.21.15.79:0/1548324074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f91099540 0x563f91087aa0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f2e8800c010 tx=0x7f2e88005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=388ebf32e51b1b0e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:57.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.339+0000 7f2e83fff640 1 -- 172.21.15.79:0/1548324074 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e88003f50 con 0x563f91099540 2024-08-20T01:39:57.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.340+0000 7f2e83fff640 1 -- 172.21.15.79:0/1548324074 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e880054b0 con 0x563f91099540 2024-08-20T01:39:57.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.340+0000 7f2e83fff640 1 -- 172.21.15.79:0/1548324074 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e88004e10 con 0x563f91099540 2024-08-20T01:39:57.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.340+0000 7f2ea272f740 1 -- 172.21.15.79:0/1548324074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f91099540 msgr2=0x563f91087aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:57.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.340+0000 7f2ea272f740 1 --2- 172.21.15.79:0/1548324074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f91099540 0x563f91087aa0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f2e8800c010 tx=0x7f2e88005c90 comp rx=0 tx=0).stop 2024-08-20T01:39:57.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.340+0000 7f2ea272f740 1 -- 172.21.15.79:0/1548324074 shutdown_connections 2024-08-20T01:39:57.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.340+0000 7f2ea272f740 1 --2- 172.21.15.79:0/1548324074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f91099540 0x563f91087aa0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:57.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.340+0000 7f2ea272f740 1 --2- 172.21.15.79:0/1548324074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f910891a0 0x563f91085f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:57.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.340+0000 7f2ea272f740 1 --2- 172.21.15.79:0/1548324074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f91088880 0x563f91093fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:57.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.340+0000 7f2ea272f740 1 -- 172.21.15.79:0/1548324074 >> 172.21.15.79:0/1548324074 conn(0x563f910866b0 msgr2=0x563f91087390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:57.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.340+0000 7f2ea272f740 1 -- 172.21.15.79:0/1548324074 shutdown_connections 2024-08-20T01:39:57.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.340+0000 7f2ea272f740 1 -- 172.21.15.79:0/1548324074 wait complete. 2024-08-20T01:39:57.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.341+0000 7f2ea272f740 1 -- start start 2024-08-20T01:39:57.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.341+0000 7f2ea272f740 1 Processor -- start 2024-08-20T01:39:57.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.341+0000 7f2ea272f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f91088880 0x563f910b0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:57.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.341+0000 7f2ea272f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f910891a0 0x563f910b1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:57.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.341+0000 7f2ea272f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f91099540 0x563f910a1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:57.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.341+0000 7f2ea272f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2e981ad2a0 con 0x563f91099540 2024-08-20T01:39:57.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.341+0000 7f2ea272f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2e981acb40 con 0x563f910891a0 2024-08-20T01:39:57.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.341+0000 7f2ea272f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2e981a9d80 con 0x563f91088880 2024-08-20T01:39:57.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.341+0000 7f2ea272f740 10 client.0 _ll_register_callbacks cb 0x7f2e9401b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:57.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.341+0000 7f2e9d8d1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f91099540 0x563f910a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:57.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.341+0000 7f2e9d8d1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f91099540 0x563f910a1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48236/0 (socket says 172.21.15.79:48236) 2024-08-20T01:39:57.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.341+0000 7f2e9d8d1640 1 -- 172.21.15.79:0/2665120092 learned_addr learned my addr 172.21.15.79:0/2665120092 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:57.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.342+0000 7f2e9d8d1640 1 --2- 172.21.15.79:0/2665120092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f91088880 0x563f910b0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:57.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.342+0000 7f2e9e0d2640 1 --2- 172.21.15.79:0/2665120092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f910891a0 0x563f910b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:57.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.342+0000 7f2e9d8d1640 1 -- 172.21.15.79:0/2665120092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f91088880 msgr2=0x563f910b0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:57.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.342+0000 7f2e9d8d1640 1 --2- 172.21.15.79:0/2665120092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f91088880 0x563f910b0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:57.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.342+0000 7f2e9d8d1640 1 -- 172.21.15.79:0/2665120092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f910891a0 msgr2=0x563f910b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:57.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.342+0000 7f2e9d8d1640 1 --2- 172.21.15.79:0/2665120092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f910891a0 0x563f910b1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:57.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.342+0000 7f2e9d8d1640 1 -- 172.21.15.79:0/2665120092 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f9108b440 con 0x563f91099540 2024-08-20T01:39:57.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.342+0000 7f2e9d8d1640 1 --2- 172.21.15.79:0/2665120092 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f91099540 0x563f910a1570 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f2e88005fa0 tx=0x7f2e88005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35f1e9ce6292fbd3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:57.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.342+0000 7f2e81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:39:57.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.342+0000 7f2e81ffb640 1 -- 172.21.15.79:0/2665120092 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8802f020 con 0x563f91099540 2024-08-20T01:39:57.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.342+0000 7f2e81ffb640 1 -- 172.21.15.79:0/2665120092 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f2e880046c0 con 0x563f91099540 2024-08-20T01:39:57.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.342+0000 7f2ea272f740 1 -- 172.21.15.79:0/2665120092 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e880054b0 con 0x563f91099540 2024-08-20T01:39:57.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.342+0000 7f2e81ffb640 1 -- 172.21.15.79:0/2665120092 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f2e880048c0 con 0x563f91099540 2024-08-20T01:39:57.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.342+0000 7f2ea272f740 10 client.16419 fetch_fsmap learned FSMap version 33 2024-08-20T01:39:57.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.342+0000 7f2ea272f740 1 -- 172.21.15.79:0/2665120092 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x563f91089f90 con 0x563f91099540 2024-08-20T01:39:57.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.342+0000 7f2e81ffb640 1 -- 172.21.15.79:0/2665120092 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e880054b0 con 0x563f91099540 2024-08-20T01:39:57.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.343+0000 7f2e81ffb640 1 -- 172.21.15.79:0/2665120092 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7f2e8803fc80 con 0x563f91099540 2024-08-20T01:39:57.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.343+0000 7f2ea272f740 10 client.16419 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:39:57.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.343+0000 7f2ea272f740 10 client.16419 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:39:57.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.343+0000 7f2ea272f740 20 client.16419 populate_metadata read hostname 'smithi079' 2024-08-20T01:39:57.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.343+0000 7f2ea272f740 1 --2- 172.21.15.79:0/2665120092 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x563f91113cd0 0x563f911160c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:57.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.343+0000 7f2ea272f740 4 client.16419 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:39:57.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.343+0000 7f2ea272f740 1 -- 172.21.15.79:0/2665120092 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563f90ffd320 con 0x563f91113cd0 2024-08-20T01:39:57.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.343+0000 7f2e9e0d2640 1 --2- 172.21.15.79:0/2665120092 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x563f91113cd0 0x563f911160c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:57.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.343+0000 7f2e81ffb640 10 client.16419 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:39:57.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.343+0000 7f2e9e0d2640 1 --2- 172.21.15.79:0/2665120092 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x563f91113cd0 0x563f911160c0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b5c978f72526240e server_cookie=ee320a8175db1466 in_seq=0 out_seq=0 2024-08-20T01:39:57.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.343+0000 7f2e81ffb640 1 -- 172.21.15.79:0/2665120092 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563f90ffd320 con 0x563f91113cd0 2024-08-20T01:39:57.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.343+0000 7f2e81ffb640 10 client.16419 handle_command_reply: tid=0 2024-08-20T01:39:57.371 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:39:57.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.344+0000 7f2ea272f740 1 client.16419 shutdown 2024-08-20T01:39:57.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.344+0000 7f2ea272f740 1 -- 172.21.15.79:0/2665120092 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f91099540 msgr2=0x563f910a1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:57.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.344+0000 7f2ea272f740 1 --2- 172.21.15.79:0/2665120092 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f91099540 0x563f910a1570 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f2e88005fa0 tx=0x7f2e88005810 comp rx=0 tx=0).stop 2024-08-20T01:39:57.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.344+0000 7f2ea272f740 1 -- 172.21.15.79:0/2665120092 shutdown_connections 2024-08-20T01:39:57.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.344+0000 7f2ea272f740 1 --2- 172.21.15.79:0/2665120092 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x563f91113cd0 0x563f911160c0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:57.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.344+0000 7f2ea272f740 1 --2- 172.21.15.79:0/2665120092 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563f91099540 0x563f910a1570 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:57.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.344+0000 7f2e81ffb640 0 client.16419 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:39:57.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.344+0000 7f2ea272f740 1 --2- 172.21.15.79:0/2665120092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f910891a0 0x563f910b1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:57.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.344+0000 7f2ea272f740 1 --2- 172.21.15.79:0/2665120092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f91088880 0x563f910b0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:57.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.344+0000 7f2ea272f740 1 -- 172.21.15.79:0/2665120092 >> 172.21.15.79:0/2665120092 conn(0x563f910866b0 msgr2=0x563f91095930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:57.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.344+0000 7f2ea272f740 1 -- 172.21.15.79:0/2665120092 shutdown_connections 2024-08-20T01:39:57.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.344+0000 7f2ea272f740 1 -- 172.21.15.79:0/2665120092 wait complete. 2024-08-20T01:39:57.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.344+0000 7f2ea272f740 20 client.16419 trim_cache size 0 max 16384 2024-08-20T01:39:57.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.345+0000 7f2ea0336640 1 -- 172.21.15.79:0/1499574809 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2e840b3c50 msgr2=0x7f2e840b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:57.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.345+0000 7f2ea0336640 1 --2- 172.21.15.79:0/1499574809 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2e840b3c50 0x7f2e840b6110 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2e90102a80 tx=0x7f2e900c07a0 comp rx=0 tx=0).stop 2024-08-20T01:39:57.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.345+0000 7f2ea0336640 1 -- 172.21.15.79:0/1499574809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e98107d20 msgr2=0x7f2e9819a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:57.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.345+0000 7f2ea0336640 1 --2- 172.21.15.79:0/1499574809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e98107d20 0x7f2e9819a750 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f2e90005cc0 tx=0x7f2e90032a10 comp rx=0 tx=0).stop 2024-08-20T01:39:57.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.345+0000 7f2ea0336640 1 -- 172.21.15.79:0/1499574809 shutdown_connections 2024-08-20T01:39:57.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.345+0000 7f2ea0336640 1 --2- 172.21.15.79:0/1499574809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e98107d20 0x7f2e9819a750 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:57.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.345+0000 7f2ea0336640 1 --2- 172.21.15.79:0/1499574809 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2e840b3c50 0x7f2e840b6110 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:57.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.345+0000 7f2ea0336640 1 --2- 172.21.15.79:0/1499574809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e981073a0 0x7f2e9819a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:57.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.345+0000 7f2ea0336640 1 --2- 172.21.15.79:0/1499574809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e98101990 0x7f2e98199c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:57.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.345+0000 7f2ea0336640 1 -- 172.21.15.79:0/1499574809 >> 172.21.15.79:0/1499574809 conn(0x7f2e980fd400 msgr2=0x7f2e980ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:57.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.345+0000 7f2ea0336640 1 -- 172.21.15.79:0/1499574809 shutdown_connections 2024-08-20T01:39:57.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:57.345+0000 7f2ea0336640 1 -- 172.21.15.79:0/1499574809 wait complete. 2024-08-20T01:39:58.111 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:57 smithi079 ceph-mon[18656]: pgmap v426: 97 pgs: 97 active+clean; 3.1 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 29 MiB/s wr, 23 op/s 2024-08-20T01:39:58.139 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T01:39:58.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:57 smithi081 ceph-mon[22209]: pgmap v426: 97 pgs: 97 active+clean; 3.1 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 29 MiB/s wr, 23 op/s 2024-08-20T01:39:58.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:57 smithi175 ceph-mon[22392]: pgmap v426: 97 pgs: 97 active+clean; 3.1 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 29 MiB/s wr, 23 op/s 2024-08-20T01:39:58.429 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:39:58.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.931+0000 7f8810e8b640 1 -- 172.21.15.79:0/3698090095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f880c107d20 msgr2=0x7f880c10e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:58.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.931+0000 7f8810e8b640 1 --2- 172.21.15.79:0/3698090095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f880c107d20 0x7f880c10e520 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f8804009ca0 tx=0x7f880402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:39:58.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.932+0000 7f8810e8b640 1 -- 172.21.15.79:0/3698090095 shutdown_connections 2024-08-20T01:39:58.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.932+0000 7f8810e8b640 1 --2- 172.21.15.79:0/3698090095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f880c107d20 0x7f880c10e520 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:58.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.932+0000 7f8810e8b640 1 --2- 172.21.15.79:0/3698090095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f880c1073a0 0x7f880c1077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:58.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.932+0000 7f8810e8b640 1 --2- 172.21.15.79:0/3698090095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f880c101990 0x7f880c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:58.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.932+0000 7f8810e8b640 1 -- 172.21.15.79:0/3698090095 >> 172.21.15.79:0/3698090095 conn(0x7f880c0fd400 msgr2=0x7f880c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:58.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.932+0000 7f8810e8b640 1 -- 172.21.15.79:0/3698090095 shutdown_connections 2024-08-20T01:39:58.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.932+0000 7f8810e8b640 1 -- 172.21.15.79:0/3698090095 wait complete. 2024-08-20T01:39:58.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.933+0000 7f8810e8b640 1 Processor -- start 2024-08-20T01:39:58.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.933+0000 7f8810e8b640 1 -- start start 2024-08-20T01:39:58.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.933+0000 7f8810e8b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f880c101990 0x7f880c199d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:58.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.933+0000 7f8810e8b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f880c1073a0 0x7f880c19a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:58.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.933+0000 7f8810e8b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f880c107d20 0x7f880c19a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:58.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.933+0000 7f8810e8b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f880c1118a0 con 0x7f880c107d20 2024-08-20T01:39:58.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.933+0000 7f8810e8b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f880c111720 con 0x7f880c1073a0 2024-08-20T01:39:58.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.933+0000 7f8810e8b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f880c111a20 con 0x7f880c101990 2024-08-20T01:39:58.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.933+0000 7f880ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f880c107d20 0x7f880c19a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:58.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.933+0000 7f880ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f880c107d20 0x7f880c19a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48258/0 (socket says 172.21.15.79:48258) 2024-08-20T01:39:58.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.933+0000 7f880ad9d640 1 -- 172.21.15.79:0/1441975517 learned_addr learned my addr 172.21.15.79:0/1441975517 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:58.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.933+0000 7f8809d9b640 1 --2- 172.21.15.79:0/1441975517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f880c1073a0 0x7f880c19a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:58.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.933+0000 7f880a59c640 1 --2- 172.21.15.79:0/1441975517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f880c101990 0x7f880c199d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:58.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.933+0000 7f880ad9d640 1 -- 172.21.15.79:0/1441975517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f880c101990 msgr2=0x7f880c199d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:58.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.933+0000 7f880ad9d640 1 --2- 172.21.15.79:0/1441975517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f880c101990 0x7f880c199d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:58.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.933+0000 7f880ad9d640 1 -- 172.21.15.79:0/1441975517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f880c1073a0 msgr2=0x7f880c19a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:58.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.933+0000 7f880ad9d640 1 --2- 172.21.15.79:0/1441975517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f880c1073a0 0x7f880c19a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:58.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.933+0000 7f880ad9d640 1 -- 172.21.15.79:0/1441975517 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f880c1a5150 con 0x7f880c107d20 2024-08-20T01:39:58.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.933+0000 7f8809d9b640 1 --2- 172.21.15.79:0/1441975517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f880c1073a0 0x7f880c19a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:39:58.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.934+0000 7f880ad9d640 1 --2- 172.21.15.79:0/1441975517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f880c107d20 0x7f880c19a810 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f8804005cc0 tx=0x7f8804032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:58.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.934+0000 7f87fb7fe640 1 -- 172.21.15.79:0/1441975517 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8804032e00 con 0x7f880c107d20 2024-08-20T01:39:58.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.934+0000 7f87fb7fe640 1 -- 172.21.15.79:0/1441975517 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f88040044d0 con 0x7f880c107d20 2024-08-20T01:39:58.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.934+0000 7f87fb7fe640 1 -- 172.21.15.79:0/1441975517 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8804030b70 con 0x7f880c107d20 2024-08-20T01:39:58.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.934+0000 7f8810e8b640 1 -- 172.21.15.79:0/1441975517 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f880c197b40 con 0x7f880c107d20 2024-08-20T01:39:58.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.934+0000 7f8810e8b640 1 -- 172.21.15.79:0/1441975517 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f880c198030 con 0x7f880c107d20 2024-08-20T01:39:58.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.936+0000 7f87fb7fe640 1 -- 172.21.15.79:0/1441975517 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f8804004680 con 0x7f880c107d20 2024-08-20T01:39:58.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.937+0000 7f8813284740 1 Processor -- start 2024-08-20T01:39:58.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.937+0000 7f8813284740 1 -- start start 2024-08-20T01:39:58.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.937+0000 7f8813284740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea1fa45730 0x55ea1fa45b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:58.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.937+0000 7f8813284740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea1fa46050 0x55ea1fa51aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:58.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.937+0000 7f8813284740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea1fa51fe0 0x55ea1fa543d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:58.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.937+0000 7f8813284740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ea1f9bc930 con 0x55ea1fa46050 2024-08-20T01:39:58.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.937+0000 7f8813284740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ea1f9abe30 con 0x55ea1fa45730 2024-08-20T01:39:58.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.937+0000 7f8813284740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ea1f9afe70 con 0x55ea1fa51fe0 2024-08-20T01:39:58.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.937+0000 7f880a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea1fa46050 0x55ea1fa51aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:58.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.937+0000 7f880a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea1fa46050 0x55ea1fa51aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48268/0 (socket says 172.21.15.79:48268) 2024-08-20T01:39:58.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.937+0000 7f880a59c640 1 -- 172.21.15.79:0/785676031 learned_addr learned my addr 172.21.15.79:0/785676031 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:58.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.937+0000 7f8809d9b640 1 --2- 172.21.15.79:0/785676031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea1fa45730 0x55ea1fa45b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:58.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.937+0000 7f8809d9b640 1 --2- 172.21.15.79:0/785676031 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea1fa51fe0 0x55ea1fa543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:58.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.938+0000 7f87fb7fe640 1 --2- 172.21.15.79:0/1441975517 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f87f40b7fe0 0x7f87f40ba4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:58.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.938+0000 7f880a59c640 1 -- 172.21.15.79:0/785676031 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea1fa51fe0 msgr2=0x55ea1fa543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:58.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.938+0000 7f880a59c640 1 --2- 172.21.15.79:0/785676031 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea1fa51fe0 0x55ea1fa543d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:58.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.938+0000 7f880a59c640 1 -- 172.21.15.79:0/785676031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea1fa45730 msgr2=0x55ea1fa45b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:58.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.938+0000 7f880a59c640 1 --2- 172.21.15.79:0/785676031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea1fa45730 0x55ea1fa45b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:58.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.938+0000 7f880a59c640 1 -- 172.21.15.79:0/785676031 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea1f70b650 con 0x55ea1fa46050 2024-08-20T01:39:58.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.938+0000 7f880ad9d640 1 --2- 172.21.15.79:0/1441975517 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f87f40b7fe0 0x7f87f40ba4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:58.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.938+0000 7f87fb7fe640 1 -- 172.21.15.79:0/1441975517 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f8804105090 con 0x7f880c107d20 2024-08-20T01:39:58.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.938+0000 7f880a59c640 1 --2- 172.21.15.79:0/785676031 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea1fa46050 0x55ea1fa51aa0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f87fc00bd40 tx=0x7f87fc0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f74bf9555ca4a3a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:58.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.938+0000 7f880ad9d640 1 --2- 172.21.15.79:0/1441975517 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f87f40b7fe0 0x7f87f40ba4a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f88040cbf80 tx=0x7f8804041da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:58.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.938+0000 7f87f8ff9640 1 -- 172.21.15.79:0/785676031 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87fc004230 con 0x55ea1fa46050 2024-08-20T01:39:58.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.938+0000 7f87f8ff9640 1 -- 172.21.15.79:0/785676031 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f87fc00be30 con 0x55ea1fa46050 2024-08-20T01:39:58.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.938+0000 7f87f8ff9640 1 -- 172.21.15.79:0/785676031 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87fc01a6b0 con 0x55ea1fa46050 2024-08-20T01:39:58.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.939+0000 7f8813284740 1 -- 172.21.15.79:0/785676031 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea1fa46050 msgr2=0x55ea1fa51aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:58.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.939+0000 7f8813284740 1 --2- 172.21.15.79:0/785676031 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea1fa46050 0x55ea1fa51aa0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f87fc00bd40 tx=0x7f87fc0107a0 comp rx=0 tx=0).stop 2024-08-20T01:39:58.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.939+0000 7f8813284740 1 -- 172.21.15.79:0/785676031 shutdown_connections 2024-08-20T01:39:58.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.939+0000 7f8813284740 1 --2- 172.21.15.79:0/785676031 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea1fa51fe0 0x55ea1fa543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:58.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.939+0000 7f8813284740 1 --2- 172.21.15.79:0/785676031 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea1fa46050 0x55ea1fa51aa0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:58.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.939+0000 7f8813284740 1 --2- 172.21.15.79:0/785676031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea1fa45730 0x55ea1fa45b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:58.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.939+0000 7f8813284740 1 -- 172.21.15.79:0/785676031 >> 172.21.15.79:0/785676031 conn(0x55ea1fa43560 msgr2=0x55ea1fa44700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:58.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.939+0000 7f8813284740 1 -- 172.21.15.79:0/785676031 shutdown_connections 2024-08-20T01:39:58.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.939+0000 7f8813284740 1 -- 172.21.15.79:0/785676031 wait complete. 2024-08-20T01:39:58.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.940+0000 7f8813284740 1 -- start start 2024-08-20T01:39:58.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.940+0000 7f8813284740 1 Processor -- start 2024-08-20T01:39:58.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.940+0000 7f8813284740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea1fa45730 0x55ea1fa4ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:58.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.940+0000 7f8813284740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea1fa46050 0x55ea1fa4f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:58.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.940+0000 7f8813284740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea1fa51fe0 0x55ea1fa4fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:58.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.940+0000 7f8813284740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ea1f80e700 con 0x55ea1fa51fe0 2024-08-20T01:39:58.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.940+0000 7f8813284740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ea1f932810 con 0x55ea1fa46050 2024-08-20T01:39:58.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.940+0000 7f8813284740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ea1fa54c90 con 0x55ea1fa45730 2024-08-20T01:39:58.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.940+0000 7f8813284740 10 client.0 _ll_register_callbacks cb 0x55ea1f9a5700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:58.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.940+0000 7f8809d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea1fa51fe0 0x55ea1fa4fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:58.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.940+0000 7f8809d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea1fa51fe0 0x55ea1fa4fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48284/0 (socket says 172.21.15.79:48284) 2024-08-20T01:39:58.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.940+0000 7f8809d9b640 1 -- 172.21.15.79:0/1598204607 learned_addr learned my addr 172.21.15.79:0/1598204607 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:58.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.940+0000 7f8809d9b640 1 --2- 172.21.15.79:0/1598204607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea1fa45730 0x55ea1fa4ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:58.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.940+0000 7f880a59c640 1 --2- 172.21.15.79:0/1598204607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea1fa46050 0x55ea1fa4f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:58.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.940+0000 7f8809d9b640 1 -- 172.21.15.79:0/1598204607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea1fa45730 msgr2=0x55ea1fa4ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:58.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.940+0000 7f8809d9b640 1 --2- 172.21.15.79:0/1598204607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea1fa45730 0x55ea1fa4ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:58.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.940+0000 7f8809d9b640 1 -- 172.21.15.79:0/1598204607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea1fa46050 msgr2=0x55ea1fa4f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:58.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.940+0000 7f8809d9b640 1 --2- 172.21.15.79:0/1598204607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea1fa46050 0x55ea1fa4f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:58.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.940+0000 7f8809d9b640 1 -- 172.21.15.79:0/1598204607 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea1fa5e040 con 0x55ea1fa51fe0 2024-08-20T01:39:58.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.941+0000 7f8809d9b640 1 --2- 172.21.15.79:0/1598204607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea1fa51fe0 0x55ea1fa4fa00 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f8800013f40 tx=0x7f8800004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c83eb82cfa63a1e6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:58.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.941+0000 7f87f1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:39:58.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.941+0000 7f87f1ffb640 1 -- 172.21.15.79:0/1598204607 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8800013130 con 0x55ea1fa51fe0 2024-08-20T01:39:58.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.941+0000 7f87f1ffb640 1 -- 172.21.15.79:0/1598204607 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f88000132d0 con 0x55ea1fa51fe0 2024-08-20T01:39:58.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.941+0000 7f8813284740 1 -- 172.21.15.79:0/1598204607 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ea1f95b150 con 0x55ea1fa51fe0 2024-08-20T01:39:58.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.941+0000 7f87f1ffb640 1 -- 172.21.15.79:0/1598204607 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f8800012450 con 0x55ea1fa51fe0 2024-08-20T01:39:58.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.941+0000 7f8813284740 10 client.16431 fetch_fsmap learned FSMap version 33 2024-08-20T01:39:58.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.941+0000 7f8813284740 1 -- 172.21.15.79:0/1598204607 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55ea1fa60a50 con 0x55ea1fa51fe0 2024-08-20T01:39:58.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.941+0000 7f87f1ffb640 1 -- 172.21.15.79:0/1598204607 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55ea1f95b150 con 0x55ea1fa51fe0 2024-08-20T01:39:58.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.941+0000 7f87f1ffb640 1 -- 172.21.15.79:0/1598204607 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7f8800011560 con 0x55ea1fa51fe0 2024-08-20T01:39:58.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.941+0000 7f8813284740 10 client.16431 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:39:58.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.941+0000 7f8813284740 10 client.16431 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:39:58.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.942+0000 7f8813284740 20 client.16431 populate_metadata read hostname 'smithi079' 2024-08-20T01:39:58.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.942+0000 7f8813284740 1 --2- 172.21.15.79:0/1598204607 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55ea1fa61df0 0x55ea1fa64250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:58.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.942+0000 7f8813284740 4 client.16431 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:39:58.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.942+0000 7f8813284740 1 -- 172.21.15.79:0/1598204607 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea1f9be880 con 0x55ea1fa61df0 2024-08-20T01:39:58.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.942+0000 7f880a59c640 1 --2- 172.21.15.79:0/1598204607 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55ea1fa61df0 0x55ea1fa64250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:58.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.942+0000 7f87f1ffb640 10 client.16431 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:39:58.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.942+0000 7f880a59c640 1 --2- 172.21.15.79:0/1598204607 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55ea1fa61df0 0x55ea1fa64250 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=98e52ad8f72dd61a server_cookie=929398fde5f69551 in_seq=0 out_seq=0 2024-08-20T01:39:58.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.943+0000 7f87f1ffb640 1 -- 172.21.15.79:0/1598204607 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ea1f9be880 con 0x55ea1fa61df0 2024-08-20T01:39:58.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.943+0000 7f87f1ffb640 10 client.16431 handle_command_reply: tid=0 2024-08-20T01:39:58.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.943+0000 7f8813284740 1 client.16431 shutdown 2024-08-20T01:39:58.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.943+0000 7f8813284740 1 -- 172.21.15.79:0/1598204607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea1fa51fe0 msgr2=0x55ea1fa4fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:58.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.943+0000 7f8813284740 1 --2- 172.21.15.79:0/1598204607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea1fa51fe0 0x55ea1fa4fa00 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f8800013f40 tx=0x7f8800004730 comp rx=0 tx=0).stop 2024-08-20T01:39:58.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.943+0000 7f8813284740 1 -- 172.21.15.79:0/1598204607 shutdown_connections 2024-08-20T01:39:58.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.943+0000 7f8813284740 1 --2- 172.21.15.79:0/1598204607 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55ea1fa61df0 0x55ea1fa64250 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:58.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.943+0000 7f8813284740 1 --2- 172.21.15.79:0/1598204607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea1fa51fe0 0x55ea1fa4fa00 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:58.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.943+0000 7f8813284740 1 --2- 172.21.15.79:0/1598204607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea1fa46050 0x55ea1fa4f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:58.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.943+0000 7f8813284740 1 --2- 172.21.15.79:0/1598204607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea1fa45730 0x55ea1fa4ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:58.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.943+0000 7f87f1ffb640 0 client.16431 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:39:58.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.943+0000 7f8813284740 1 -- 172.21.15.79:0/1598204607 >> 172.21.15.79:0/1598204607 conn(0x55ea1fa43560 msgr2=0x55ea1fa49100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:58.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.943+0000 7f8813284740 1 -- 172.21.15.79:0/1598204607 shutdown_connections 2024-08-20T01:39:58.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.943+0000 7f8813284740 1 -- 172.21.15.79:0/1598204607 wait complete. 2024-08-20T01:39:58.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.943+0000 7f8813284740 20 client.16431 trim_cache size 0 max 16384 2024-08-20T01:39:58.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.958+0000 7f8813284740 1 Processor -- start 2024-08-20T01:39:58.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.958+0000 7f8813284740 1 -- start start 2024-08-20T01:39:58.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.959+0000 7f8813284740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea1fa45730 0x55ea1fa42ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:58.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.959+0000 7f8813284740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea1fa46050 0x55ea1fa4e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:58.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.959+0000 7f8813284740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea1fa51fe0 0x55ea1fa69b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:58.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.959+0000 7f8813284740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f880c1abe40 con 0x55ea1fa46050 2024-08-20T01:39:58.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.959+0000 7f8813284740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f880c1adad0 con 0x55ea1fa51fe0 2024-08-20T01:39:58.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.959+0000 7f8813284740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f880c1ac510 con 0x55ea1fa45730 2024-08-20T01:39:58.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.959+0000 7f880a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea1fa46050 0x55ea1fa4e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:58.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.959+0000 7f880a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea1fa46050 0x55ea1fa4e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48290/0 (socket says 172.21.15.79:48290) 2024-08-20T01:39:58.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.959+0000 7f880a59c640 1 -- 172.21.15.79:0/3209652279 learned_addr learned my addr 172.21.15.79:0/3209652279 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:58.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.959+0000 7f8809d9b640 1 --2- 172.21.15.79:0/3209652279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea1fa51fe0 0x55ea1fa69b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:58.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.959+0000 7f8809d9b640 1 --2- 172.21.15.79:0/3209652279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea1fa45730 0x55ea1fa42ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:58.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.959+0000 7f880a59c640 1 -- 172.21.15.79:0/3209652279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea1fa45730 msgr2=0x55ea1fa42ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:58.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.959+0000 7f880a59c640 1 --2- 172.21.15.79:0/3209652279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea1fa45730 0x55ea1fa42ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:58.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.959+0000 7f880a59c640 1 -- 172.21.15.79:0/3209652279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea1fa51fe0 msgr2=0x55ea1fa69b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:58.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.959+0000 7f880a59c640 1 --2- 172.21.15.79:0/3209652279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea1fa51fe0 0x55ea1fa69b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:58.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.959+0000 7f880a59c640 1 -- 172.21.15.79:0/3209652279 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea1fa43fe0 con 0x55ea1fa46050 2024-08-20T01:39:58.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.959+0000 7f880a59c640 1 --2- 172.21.15.79:0/3209652279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea1fa46050 0x55ea1fa4e6e0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f87fc00bd40 tx=0x7f87fc00ba00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a2e92b4e68a6a6c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:58.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.960+0000 7f87f3fff640 1 -- 172.21.15.79:0/3209652279 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87fc005300 con 0x55ea1fa46050 2024-08-20T01:39:58.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.960+0000 7f87f3fff640 1 -- 172.21.15.79:0/3209652279 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f87fc0054a0 con 0x55ea1fa46050 2024-08-20T01:39:58.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.960+0000 7f87f3fff640 1 -- 172.21.15.79:0/3209652279 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87fc0286b0 con 0x55ea1fa46050 2024-08-20T01:39:58.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.960+0000 7f8813284740 1 -- 172.21.15.79:0/3209652279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea1fa46050 msgr2=0x55ea1fa4e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:58.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.960+0000 7f8813284740 1 --2- 172.21.15.79:0/3209652279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea1fa46050 0x55ea1fa4e6e0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f87fc00bd40 tx=0x7f87fc00ba00 comp rx=0 tx=0).stop 2024-08-20T01:39:58.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.960+0000 7f8813284740 1 -- 172.21.15.79:0/3209652279 shutdown_connections 2024-08-20T01:39:58.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.960+0000 7f8813284740 1 --2- 172.21.15.79:0/3209652279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea1fa51fe0 0x55ea1fa69b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:58.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.960+0000 7f8813284740 1 --2- 172.21.15.79:0/3209652279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea1fa46050 0x55ea1fa4e6e0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:58.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.960+0000 7f8813284740 1 --2- 172.21.15.79:0/3209652279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea1fa45730 0x55ea1fa42ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:58.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.960+0000 7f8813284740 1 -- 172.21.15.79:0/3209652279 >> 172.21.15.79:0/3209652279 conn(0x55ea1fa43560 msgr2=0x55ea1fa4f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:58.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.960+0000 7f8813284740 1 -- 172.21.15.79:0/3209652279 shutdown_connections 2024-08-20T01:39:58.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.961+0000 7f8813284740 1 -- 172.21.15.79:0/3209652279 wait complete. 2024-08-20T01:39:58.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.961+0000 7f8813284740 1 -- start start 2024-08-20T01:39:58.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.961+0000 7f8813284740 1 Processor -- start 2024-08-20T01:39:58.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.961+0000 7f8813284740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea1fa45730 0x55ea1fa5a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:58.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.961+0000 7f8813284740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea1fa46050 0x55ea1fa4bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:58.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.961+0000 7f8813284740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea1fa51fe0 0x55ea1fa4c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:58.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.961+0000 7f8813284740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f880c1ad340 con 0x55ea1fa51fe0 2024-08-20T01:39:58.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.961+0000 7f8813284740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f880c1acbe0 con 0x55ea1fa46050 2024-08-20T01:39:58.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.961+0000 7f8813284740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f880c1a9e20 con 0x55ea1fa45730 2024-08-20T01:39:58.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.961+0000 7f8813284740 10 client.0 _ll_register_callbacks cb 0x7f880000cef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:39:58.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.961+0000 7f8809d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea1fa51fe0 0x55ea1fa4c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:58.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.961+0000 7f8809d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea1fa51fe0 0x55ea1fa4c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48302/0 (socket says 172.21.15.79:48302) 2024-08-20T01:39:58.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.961+0000 7f8809d9b640 1 -- 172.21.15.79:0/4072932602 learned_addr learned my addr 172.21.15.79:0/4072932602 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:39:58.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.961+0000 7f8809d9b640 1 --2- 172.21.15.79:0/4072932602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea1fa45730 0x55ea1fa5a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:58.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.962+0000 7f880a59c640 1 --2- 172.21.15.79:0/4072932602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea1fa46050 0x55ea1fa4bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:58.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.962+0000 7f8809d9b640 1 -- 172.21.15.79:0/4072932602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea1fa45730 msgr2=0x55ea1fa5a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:58.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.962+0000 7f8809d9b640 1 --2- 172.21.15.79:0/4072932602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea1fa45730 0x55ea1fa5a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:58.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.962+0000 7f8809d9b640 1 -- 172.21.15.79:0/4072932602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea1fa46050 msgr2=0x55ea1fa4bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:39:58.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.962+0000 7f8809d9b640 1 --2- 172.21.15.79:0/4072932602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea1fa46050 0x55ea1fa4bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:58.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.962+0000 7f8809d9b640 1 -- 172.21.15.79:0/4072932602 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea1fa4fe20 con 0x55ea1fa51fe0 2024-08-20T01:39:58.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.962+0000 7f8809d9b640 1 --2- 172.21.15.79:0/4072932602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea1fa51fe0 0x55ea1fa4c360 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f8800011930 tx=0x7f880000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5b269ad11a97eb2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:39:58.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.962+0000 7f87f1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:39:58.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.962+0000 7f87f1ffb640 1 -- 172.21.15.79:0/4072932602 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8800011db0 con 0x55ea1fa51fe0 2024-08-20T01:39:58.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.962+0000 7f87f1ffb640 1 -- 172.21.15.79:0/4072932602 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f8800011440 con 0x55ea1fa51fe0 2024-08-20T01:39:58.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.962+0000 7f8813284740 1 -- 172.21.15.79:0/4072932602 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87fc0054a0 con 0x55ea1fa51fe0 2024-08-20T01:39:58.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.962+0000 7f87f1ffb640 1 -- 172.21.15.79:0/4072932602 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f8800011640 con 0x55ea1fa51fe0 2024-08-20T01:39:58.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.962+0000 7f8813284740 10 client.16437 fetch_fsmap learned FSMap version 33 2024-08-20T01:39:58.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.962+0000 7f8813284740 1 -- 172.21.15.79:0/4072932602 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55ea1facca00 con 0x55ea1fa51fe0 2024-08-20T01:39:58.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.963+0000 7f87f1ffb640 1 -- 172.21.15.79:0/4072932602 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f87fc0054a0 con 0x55ea1fa51fe0 2024-08-20T01:39:58.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.963+0000 7f87f1ffb640 1 -- 172.21.15.79:0/4072932602 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7f8800022430 con 0x55ea1fa51fe0 2024-08-20T01:39:58.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.963+0000 7f8813284740 10 client.16437 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:39:58.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.963+0000 7f8813284740 10 client.16437 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:39:58.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.963+0000 7f8813284740 20 client.16437 populate_metadata read hostname 'smithi079' 2024-08-20T01:39:58.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.963+0000 7f8813284740 1 --2- 172.21.15.79:0/4072932602 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55ea1facd030 0x55ea1facf450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:39:58.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.963+0000 7f8813284740 4 client.16437 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:39:58.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.963+0000 7f8813284740 1 -- 172.21.15.79:0/4072932602 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ea1f9ba320 con 0x55ea1facd030 2024-08-20T01:39:58.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.963+0000 7f880a59c640 1 --2- 172.21.15.79:0/4072932602 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55ea1facd030 0x55ea1facf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:39:58.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.964+0000 7f880a59c640 1 --2- 172.21.15.79:0/4072932602 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55ea1facd030 0x55ea1facf450 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5249a97f7b08985c server_cookie=8bd3bfadc64d086 in_seq=0 out_seq=0 2024-08-20T01:39:58.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.964+0000 7f87f1ffb640 10 client.16437 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:39:58.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.964+0000 7f87f1ffb640 1 -- 172.21.15.79:0/4072932602 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ea1f9ba320 con 0x55ea1facd030 2024-08-20T01:39:58.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.964+0000 7f87f1ffb640 10 client.16437 handle_command_reply: tid=0 2024-08-20T01:39:58.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.964+0000 7f8813284740 1 client.16437 shutdown 2024-08-20T01:39:58.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.964+0000 7f8813284740 1 -- 172.21.15.79:0/4072932602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea1fa51fe0 msgr2=0x55ea1fa4c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:58.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.964+0000 7f8813284740 1 --2- 172.21.15.79:0/4072932602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea1fa51fe0 0x55ea1fa4c360 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f8800011930 tx=0x7f880000cb70 comp rx=0 tx=0).stop 2024-08-20T01:39:58.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.964+0000 7f8813284740 1 -- 172.21.15.79:0/4072932602 shutdown_connections 2024-08-20T01:39:58.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.964+0000 7f8813284740 1 --2- 172.21.15.79:0/4072932602 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55ea1facd030 0x55ea1facf450 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:58.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.964+0000 7f8813284740 1 --2- 172.21.15.79:0/4072932602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea1fa51fe0 0x55ea1fa4c360 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:58.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.964+0000 7f8813284740 1 --2- 172.21.15.79:0/4072932602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea1fa46050 0x55ea1fa4bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:58.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.964+0000 7f8813284740 1 --2- 172.21.15.79:0/4072932602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea1fa45730 0x55ea1fa5a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:58.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.964+0000 7f87f1ffb640 0 client.16437 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:39:58.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.964+0000 7f8813284740 1 -- 172.21.15.79:0/4072932602 >> 172.21.15.79:0/4072932602 conn(0x55ea1fa43560 msgr2=0x55ea1fa5cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:58.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.964+0000 7f8813284740 1 -- 172.21.15.79:0/4072932602 shutdown_connections 2024-08-20T01:39:58.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.964+0000 7f8813284740 1 -- 172.21.15.79:0/4072932602 wait complete. 2024-08-20T01:39:58.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.964+0000 7f8813284740 20 client.16437 trim_cache size 0 max 16384 2024-08-20T01:39:58.972 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:39:58.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.965+0000 7f8810e8b640 1 -- 172.21.15.79:0/1441975517 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f87f40b7fe0 msgr2=0x7f87f40ba4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:58.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.965+0000 7f8810e8b640 1 --2- 172.21.15.79:0/1441975517 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f87f40b7fe0 0x7f87f40ba4a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f88040cbf80 tx=0x7f8804041da0 comp rx=0 tx=0).stop 2024-08-20T01:39:58.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.965+0000 7f8810e8b640 1 -- 172.21.15.79:0/1441975517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f880c107d20 msgr2=0x7f880c19a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:39:58.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.965+0000 7f8810e8b640 1 --2- 172.21.15.79:0/1441975517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f880c107d20 0x7f880c19a810 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f8804005cc0 tx=0x7f8804032a10 comp rx=0 tx=0).stop 2024-08-20T01:39:58.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.965+0000 7f8810e8b640 1 -- 172.21.15.79:0/1441975517 shutdown_connections 2024-08-20T01:39:58.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.965+0000 7f8810e8b640 1 --2- 172.21.15.79:0/1441975517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f880c107d20 0x7f880c19a810 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:58.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.965+0000 7f8810e8b640 1 --2- 172.21.15.79:0/1441975517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f880c1073a0 0x7f880c19a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:58.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.965+0000 7f8810e8b640 1 --2- 172.21.15.79:0/1441975517 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f87f40b7fe0 0x7f87f40ba4a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:58.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.965+0000 7f8810e8b640 1 --2- 172.21.15.79:0/1441975517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f880c101990 0x7f880c199d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:39:58.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.965+0000 7f8810e8b640 1 -- 172.21.15.79:0/1441975517 >> 172.21.15.79:0/1441975517 conn(0x7f880c0fd400 msgr2=0x7f880c0fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:39:58.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.965+0000 7f8810e8b640 1 -- 172.21.15.79:0/1441975517 shutdown_connections 2024-08-20T01:39:58.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:39:58.966+0000 7f8810e8b640 1 -- 172.21.15.79:0/1441975517 wait complete. 2024-08-20T01:39:59.782 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T01:40:00.063 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:40:00.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:39:59 smithi079 ceph-mon[18656]: pgmap v427: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 29 MiB/s wr, 26 op/s 2024-08-20T01:40:00.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:39:59 smithi081 ceph-mon[22209]: pgmap v427: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 29 MiB/s wr, 26 op/s 2024-08-20T01:40:00.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:39:59 smithi175 ceph-mon[22392]: pgmap v427: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 29 MiB/s wr, 26 op/s 2024-08-20T01:40:00.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.564+0000 7ffb930be640 1 -- 172.21.15.79:0/3146754963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb8c101eb0 msgr2=0x7ffb8c10ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:00.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.564+0000 7ffb930be640 1 --2- 172.21.15.79:0/3146754963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb8c101eb0 0x7ffb8c10ec00 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7ffb78009900 tx=0x7ffb7802a480 comp rx=0 tx=0).stop 2024-08-20T01:40:00.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.565+0000 7ffb930be640 1 -- 172.21.15.79:0/3146754963 shutdown_connections 2024-08-20T01:40:00.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.565+0000 7ffb930be640 1 --2- 172.21.15.79:0/3146754963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb8c10f140 0x7ffb8c111530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:00.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.565+0000 7ffb930be640 1 --2- 172.21.15.79:0/3146754963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb8c101eb0 0x7ffb8c10ec00 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:00.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.565+0000 7ffb930be640 1 --2- 172.21.15.79:0/3146754963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb8c101590 0x7ffb8c101970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.565+0000 7ffb930be640 1 -- 172.21.15.79:0/3146754963 >> 172.21.15.79:0/3146754963 conn(0x7ffb8c0fd400 msgr2=0x7ffb8c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.565+0000 7ffb930be640 1 -- 172.21.15.79:0/3146754963 shutdown_connections 2024-08-20T01:40:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.565+0000 7ffb930be640 1 -- 172.21.15.79:0/3146754963 wait complete. 2024-08-20T01:40:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.565+0000 7ffb930be640 1 Processor -- start 2024-08-20T01:40:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.565+0000 7ffb930be640 1 -- start start 2024-08-20T01:40:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.565+0000 7ffb930be640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb8c101590 0x7ffb8c19b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.565+0000 7ffb930be640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb8c101eb0 0x7ffb8c19b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.565+0000 7ffb930be640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb8c10f140 0x7ffb8c1a0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.566+0000 7ffb930be640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8c114b40 con 0x7ffb8c101eb0 2024-08-20T01:40:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.566+0000 7ffb930be640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8c1149c0 con 0x7ffb8c101590 2024-08-20T01:40:00.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.566+0000 7ffb930be640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8c114cc0 con 0x7ffb8c10f140 2024-08-20T01:40:00.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.566+0000 7ffb8bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb8c101eb0 0x7ffb8c19b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:00.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.566+0000 7ffb90e5a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb8c101590 0x7ffb8c19b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:00.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.566+0000 7ffb90e5a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb8c101590 0x7ffb8c19b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:57298/0 (socket says 172.21.15.79:57298) 2024-08-20T01:40:00.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.566+0000 7ffb90e5a640 1 -- 172.21.15.79:0/376291146 learned_addr learned my addr 172.21.15.79:0/376291146 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:00.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.566+0000 7ffb8bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb8c101eb0 0x7ffb8c19b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59992/0 (socket says 172.21.15.79:59992) 2024-08-20T01:40:00.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.566+0000 7ffb9165b640 1 --2- 172.21.15.79:0/376291146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb8c10f140 0x7ffb8c1a0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:00.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.566+0000 7ffb8bfff640 1 -- 172.21.15.79:0/376291146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb8c10f140 msgr2=0x7ffb8c1a0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:00.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.566+0000 7ffb8bfff640 1 --2- 172.21.15.79:0/376291146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb8c10f140 0x7ffb8c1a0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:00.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.566+0000 7ffb8bfff640 1 -- 172.21.15.79:0/376291146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb8c101590 msgr2=0x7ffb8c19b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:00.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.566+0000 7ffb8bfff640 1 --2- 172.21.15.79:0/376291146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb8c101590 0x7ffb8c19b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:00.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.566+0000 7ffb8bfff640 1 -- 172.21.15.79:0/376291146 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb8c1a11e0 con 0x7ffb8c101eb0 2024-08-20T01:40:00.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.566+0000 7ffb90e5a640 1 --2- 172.21.15.79:0/376291146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb8c101590 0x7ffb8c19b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:40:00.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.566+0000 7ffb8bfff640 1 --2- 172.21.15.79:0/376291146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb8c101eb0 0x7ffb8c19b670 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7ffb7802a9a0 tx=0x7ffb78003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.566+0000 7ffb89ffb640 1 -- 172.21.15.79:0/376291146 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb7803f070 con 0x7ffb8c101eb0 2024-08-20T01:40:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.566+0000 7ffb930be640 1 -- 172.21.15.79:0/376291146 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb8c1a1470 con 0x7ffb8c101eb0 2024-08-20T01:40:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.566+0000 7ffb89ffb640 1 -- 172.21.15.79:0/376291146 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffb78003e10 con 0x7ffb8c101eb0 2024-08-20T01:40:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.566+0000 7ffb89ffb640 1 -- 172.21.15.79:0/376291146 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb78035030 con 0x7ffb8c101eb0 2024-08-20T01:40:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.567+0000 7ffb930be640 1 -- 172.21.15.79:0/376291146 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb8c1a7b90 con 0x7ffb8c101eb0 2024-08-20T01:40:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.569+0000 7ffb954b7740 1 Processor -- start 2024-08-20T01:40:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.569+0000 7ffb954b7740 1 -- start start 2024-08-20T01:40:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.569+0000 7ffb954b7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc422e2880 0x55cc422e2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.569+0000 7ffb954b7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc422e31a0 0x55cc422eebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.569+0000 7ffb954b7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc422ef130 0x55cc422f1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.569+0000 7ffb954b7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55cc42259930 con 0x55cc422e31a0 2024-08-20T01:40:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.569+0000 7ffb954b7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55cc42248e30 con 0x55cc422ef130 2024-08-20T01:40:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.569+0000 7ffb954b7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55cc4224ce70 con 0x55cc422e2880 2024-08-20T01:40:00.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.570+0000 7ffb90e5a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc422e31a0 0x55cc422eebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:00.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.570+0000 7ffb90e5a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc422e31a0 0x55cc422eebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60000/0 (socket says 172.21.15.79:60000) 2024-08-20T01:40:00.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.570+0000 7ffb90e5a640 1 -- 172.21.15.79:0/3199482728 learned_addr learned my addr 172.21.15.79:0/3199482728 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:00.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.570+0000 7ffb89ffb640 1 -- 172.21.15.79:0/376291146 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ffb78042070 con 0x7ffb8c101eb0 2024-08-20T01:40:00.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.570+0000 7ffb9165b640 1 --2- 172.21.15.79:0/3199482728 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc422e2880 0x55cc422e2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:00.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.570+0000 7ffb8bfff640 1 --2- 172.21.15.79:0/3199482728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc422ef130 0x55cc422f1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:00.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.570+0000 7ffb90e5a640 1 -- 172.21.15.79:0/3199482728 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc422e2880 msgr2=0x55cc422e2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:00.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.570+0000 7ffb90e5a640 1 --2- 172.21.15.79:0/3199482728 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc422e2880 0x55cc422e2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:00.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.570+0000 7ffb90e5a640 1 -- 172.21.15.79:0/3199482728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc422ef130 msgr2=0x55cc422f1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:00.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.570+0000 7ffb90e5a640 1 --2- 172.21.15.79:0/3199482728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc422ef130 0x55cc422f1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:00.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.570+0000 7ffb90e5a640 1 -- 172.21.15.79:0/3199482728 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc41fa8650 con 0x55cc422e31a0 2024-08-20T01:40:00.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.570+0000 7ffb8bfff640 1 --2- 172.21.15.79:0/3199482728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc422ef130 0x55cc422f1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:40:00.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.570+0000 7ffb90e5a640 1 --2- 172.21.15.79:0/3199482728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc422e31a0 0x55cc422eebf0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7ffb800105b0 tx=0x7ffb80010a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac44c1cffb103405 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:00.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.571+0000 7ffb76ffd640 1 -- 172.21.15.79:0/3199482728 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8000e8b0 con 0x55cc422e31a0 2024-08-20T01:40:00.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.571+0000 7ffb76ffd640 1 -- 172.21.15.79:0/3199482728 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffb8001c480 con 0x55cc422e31a0 2024-08-20T01:40:00.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.571+0000 7ffb76ffd640 1 -- 172.21.15.79:0/3199482728 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb800116a0 con 0x55cc422e31a0 2024-08-20T01:40:00.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.571+0000 7ffb89ffb640 1 --2- 172.21.15.79:0/376291146 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ffb7c0b3bd0 0x7ffb7c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:00.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.571+0000 7ffb9165b640 1 --2- 172.21.15.79:0/376291146 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ffb7c0b3bd0 0x7ffb7c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:00.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.571+0000 7ffb89ffb640 1 -- 172.21.15.79:0/376291146 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ffb78104290 con 0x7ffb8c101eb0 2024-08-20T01:40:00.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.572+0000 7ffb954b7740 1 -- 172.21.15.79:0/3199482728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc422e31a0 msgr2=0x55cc422eebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:00.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.572+0000 7ffb954b7740 1 --2- 172.21.15.79:0/3199482728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc422e31a0 0x55cc422eebf0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7ffb800105b0 tx=0x7ffb80010a70 comp rx=0 tx=0).stop 2024-08-20T01:40:00.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.572+0000 7ffb9165b640 1 --2- 172.21.15.79:0/376291146 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ffb7c0b3bd0 0x7ffb7c0b6090 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c102570 tx=0x7ffb84009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:00.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.572+0000 7ffb954b7740 1 -- 172.21.15.79:0/3199482728 shutdown_connections 2024-08-20T01:40:00.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.572+0000 7ffb954b7740 1 --2- 172.21.15.79:0/3199482728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc422ef130 0x55cc422f1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:00.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.572+0000 7ffb954b7740 1 --2- 172.21.15.79:0/3199482728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc422e31a0 0x55cc422eebf0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:00.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.572+0000 7ffb954b7740 1 --2- 172.21.15.79:0/3199482728 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc422e2880 0x55cc422e2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:00.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.572+0000 7ffb954b7740 1 -- 172.21.15.79:0/3199482728 >> 172.21.15.79:0/3199482728 conn(0x55cc422e06b0 msgr2=0x55cc422e1850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:00.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.572+0000 7ffb954b7740 1 -- 172.21.15.79:0/3199482728 shutdown_connections 2024-08-20T01:40:00.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.572+0000 7ffb954b7740 1 -- 172.21.15.79:0/3199482728 wait complete. 2024-08-20T01:40:00.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.572+0000 7ffb954b7740 1 -- start start 2024-08-20T01:40:00.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.572+0000 7ffb954b7740 1 Processor -- start 2024-08-20T01:40:00.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.573+0000 7ffb954b7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc422e2880 0x55cc422ec2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:00.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.573+0000 7ffb954b7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc422ef130 0x55cc422ec830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:00.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.573+0000 7ffb954b7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc422ecd70 0x55cc422fb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:00.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.573+0000 7ffb954b7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55cc420ab700 con 0x55cc422ef130 2024-08-20T01:40:00.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.573+0000 7ffb954b7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55cc421cf810 con 0x55cc422ecd70 2024-08-20T01:40:00.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.573+0000 7ffb954b7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55cc422f1de0 con 0x55cc422e2880 2024-08-20T01:40:00.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.573+0000 7ffb954b7740 10 client.0 _ll_register_callbacks cb 0x55cc42242700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:00.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.573+0000 7ffb8bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc422ef130 0x55cc422ec830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:00.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.573+0000 7ffb8bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc422ef130 0x55cc422ec830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60010/0 (socket says 172.21.15.79:60010) 2024-08-20T01:40:00.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.573+0000 7ffb90e5a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc422e2880 0x55cc422ec2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:00.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.573+0000 7ffb8bfff640 1 -- 172.21.15.79:0/603588710 learned_addr learned my addr 172.21.15.79:0/603588710 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:00.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.573+0000 7ffb9165b640 1 --2- 172.21.15.79:0/603588710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc422ecd70 0x55cc422fb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:00.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.573+0000 7ffb90e5a640 1 -- 172.21.15.79:0/603588710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc422ecd70 msgr2=0x55cc422fb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:00.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.573+0000 7ffb90e5a640 1 --2- 172.21.15.79:0/603588710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc422ecd70 0x55cc422fb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:00.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.573+0000 7ffb90e5a640 1 -- 172.21.15.79:0/603588710 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc422ef130 msgr2=0x55cc422ec830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:00.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.573+0000 7ffb90e5a640 1 --2- 172.21.15.79:0/603588710 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc422ef130 0x55cc422ec830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:00.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.573+0000 7ffb90e5a640 1 -- 172.21.15.79:0/603588710 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc422fb7e0 con 0x55cc422e2880 2024-08-20T01:40:00.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.573+0000 7ffb8bfff640 1 --2- 172.21.15.79:0/603588710 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc422ef130 0x55cc422ec830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:40:00.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.574+0000 7ffb90e5a640 1 --2- 172.21.15.79:0/603588710 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc422e2880 0x55cc422ec2f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x55cc422e2000 tx=0x7ffb80005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c37639ab7fb2c70f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:00.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.574+0000 7ffb6bfff640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:40:00.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.574+0000 7ffb6bfff640 1 -- 172.21.15.79:0/603588710 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8001c910 con 0x55cc422e2880 2024-08-20T01:40:00.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.574+0000 7ffb6bfff640 1 -- 172.21.15.79:0/603588710 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ffb8000e6b0 con 0x55cc422e2880 2024-08-20T01:40:00.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.574+0000 7ffb954b7740 1 -- 172.21.15.79:0/603588710 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cc421f8150 con 0x55cc422e2880 2024-08-20T01:40:00.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.574+0000 7ffb6bfff640 1 -- 172.21.15.79:0/603588710 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7ffb8000e8b0 con 0x55cc422e2880 2024-08-20T01:40:00.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.574+0000 7ffb954b7740 10 client.25708 fetch_fsmap learned FSMap version 33 2024-08-20T01:40:00.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.574+0000 7ffb954b7740 1 -- 172.21.15.79:0/603588710 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55cc422fe0e0 con 0x55cc422e2880 2024-08-20T01:40:00.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.574+0000 7ffb6bfff640 1 -- 172.21.15.79:0/603588710 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55cc421f8150 con 0x55cc422e2880 2024-08-20T01:40:00.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.575+0000 7ffb6bfff640 1 -- 172.21.15.79:0/603588710 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7ffb80028950 con 0x55cc422e2880 2024-08-20T01:40:00.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.575+0000 7ffb954b7740 10 client.25708 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:40:00.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.575+0000 7ffb954b7740 10 client.25708 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:40:00.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.575+0000 7ffb954b7740 20 client.25708 populate_metadata read hostname 'smithi079' 2024-08-20T01:40:00.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.575+0000 7ffb954b7740 1 --2- 172.21.15.79:0/603588710 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55cc422ff490 0x55cc42301880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:00.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.575+0000 7ffb954b7740 4 client.25708 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:40:00.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.575+0000 7ffb954b7740 1 -- 172.21.15.79:0/603588710 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc4225b880 con 0x55cc422ff490 2024-08-20T01:40:00.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.575+0000 7ffb8bfff640 1 --2- 172.21.15.79:0/603588710 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55cc422ff490 0x55cc42301880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:00.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.575+0000 7ffb8bfff640 1 --2- 172.21.15.79:0/603588710 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55cc422ff490 0x55cc42301880 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=77a879b64cfd553d server_cookie=cfad0eba969316ec in_seq=0 out_seq=0 2024-08-20T01:40:00.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.575+0000 7ffb6bfff640 10 client.25708 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:40:00.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.576+0000 7ffb6bfff640 1 -- 172.21.15.79:0/603588710 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cc4225b880 con 0x55cc422ff490 2024-08-20T01:40:00.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.576+0000 7ffb6bfff640 10 client.25708 handle_command_reply: tid=0 2024-08-20T01:40:00.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.576+0000 7ffb954b7740 1 client.25708 shutdown 2024-08-20T01:40:00.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.576+0000 7ffb954b7740 1 -- 172.21.15.79:0/603588710 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc422e2880 msgr2=0x55cc422ec2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:00.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.576+0000 7ffb954b7740 1 --2- 172.21.15.79:0/603588710 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc422e2880 0x55cc422ec2f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x55cc422e2000 tx=0x7ffb80005740 comp rx=0 tx=0).stop 2024-08-20T01:40:00.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.576+0000 7ffb954b7740 1 -- 172.21.15.79:0/603588710 shutdown_connections 2024-08-20T01:40:00.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.576+0000 7ffb954b7740 1 --2- 172.21.15.79:0/603588710 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55cc422ff490 0x55cc42301880 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:00.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.576+0000 7ffb6bfff640 0 client.25708 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:40:00.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.576+0000 7ffb954b7740 1 --2- 172.21.15.79:0/603588710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc422ecd70 0x55cc422fb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:00.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.576+0000 7ffb954b7740 1 --2- 172.21.15.79:0/603588710 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc422ef130 0x55cc422ec830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:00.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.576+0000 7ffb954b7740 1 --2- 172.21.15.79:0/603588710 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc422e2880 0x55cc422ec2f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:00.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.576+0000 7ffb954b7740 1 -- 172.21.15.79:0/603588710 >> 172.21.15.79:0/603588710 conn(0x55cc422e06b0 msgr2=0x55cc422e6250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:00.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.576+0000 7ffb954b7740 1 -- 172.21.15.79:0/603588710 shutdown_connections 2024-08-20T01:40:00.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.576+0000 7ffb954b7740 1 -- 172.21.15.79:0/603588710 wait complete. 2024-08-20T01:40:00.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.576+0000 7ffb954b7740 20 client.25708 trim_cache size 0 max 16384 2024-08-20T01:40:00.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.593+0000 7ffb954b7740 1 Processor -- start 2024-08-20T01:40:00.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.593+0000 7ffb954b7740 1 -- start start 2024-08-20T01:40:00.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.593+0000 7ffb954b7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc422e2880 0x55cc422ec7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:00.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.593+0000 7ffb954b7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc422ecd70 0x55cc422faf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:00.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.593+0000 7ffb954b7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc422ef130 0x55cc423070e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:00.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.593+0000 7ffb954b7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8c1b01c0 con 0x55cc422e2880 2024-08-20T01:40:00.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.593+0000 7ffb954b7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8c1b1e50 con 0x55cc422ecd70 2024-08-20T01:40:00.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.593+0000 7ffb954b7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8c1b0890 con 0x55cc422ef130 2024-08-20T01:40:00.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.594+0000 7ffb90e5a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc422e2880 0x55cc422ec7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:00.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.594+0000 7ffb90e5a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc422e2880 0x55cc422ec7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60018/0 (socket says 172.21.15.79:60018) 2024-08-20T01:40:00.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.594+0000 7ffb90e5a640 1 -- 172.21.15.79:0/2441219164 learned_addr learned my addr 172.21.15.79:0/2441219164 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:00.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.594+0000 7ffb8bfff640 1 --2- 172.21.15.79:0/2441219164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc422ecd70 0x55cc422faf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:00.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.594+0000 7ffb9165b640 1 --2- 172.21.15.79:0/2441219164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc422ef130 0x55cc423070e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:00.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.594+0000 7ffb90e5a640 1 -- 172.21.15.79:0/2441219164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc422ef130 msgr2=0x55cc423070e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:00.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.594+0000 7ffb90e5a640 1 --2- 172.21.15.79:0/2441219164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc422ef130 0x55cc423070e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:00.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.594+0000 7ffb90e5a640 1 -- 172.21.15.79:0/2441219164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc422ecd70 msgr2=0x55cc422faf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:00.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.594+0000 7ffb90e5a640 1 --2- 172.21.15.79:0/2441219164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc422ecd70 0x55cc422faf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:00.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.594+0000 7ffb90e5a640 1 -- 172.21.15.79:0/2441219164 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc422e1130 con 0x55cc422e2880 2024-08-20T01:40:00.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.594+0000 7ffb90e5a640 1 --2- 172.21.15.79:0/2441219164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc422e2880 0x55cc422ec7f0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7ffb80000c00 tx=0x7ffb80001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b46cb31ec7176a39 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:00.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.594+0000 7ffb767fc640 1 -- 172.21.15.79:0/2441219164 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb80038070 con 0x55cc422e2880 2024-08-20T01:40:00.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.594+0000 7ffb767fc640 1 -- 172.21.15.79:0/2441219164 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffb800050b0 con 0x55cc422e2880 2024-08-20T01:40:00.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.594+0000 7ffb767fc640 1 -- 172.21.15.79:0/2441219164 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb800286b0 con 0x55cc422e2880 2024-08-20T01:40:00.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.595+0000 7ffb954b7740 1 -- 172.21.15.79:0/2441219164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc422e2880 msgr2=0x55cc422ec7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:00.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.595+0000 7ffb954b7740 1 --2- 172.21.15.79:0/2441219164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc422e2880 0x55cc422ec7f0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7ffb80000c00 tx=0x7ffb80001e50 comp rx=0 tx=0).stop 2024-08-20T01:40:00.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.595+0000 7ffb954b7740 1 -- 172.21.15.79:0/2441219164 shutdown_connections 2024-08-20T01:40:00.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.595+0000 7ffb954b7740 1 --2- 172.21.15.79:0/2441219164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc422ef130 0x55cc423070e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:00.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.595+0000 7ffb954b7740 1 --2- 172.21.15.79:0/2441219164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc422ecd70 0x55cc422faf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:00.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.595+0000 7ffb954b7740 1 --2- 172.21.15.79:0/2441219164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc422e2880 0x55cc422ec7f0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:00.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.595+0000 7ffb954b7740 1 -- 172.21.15.79:0/2441219164 >> 172.21.15.79:0/2441219164 conn(0x55cc422e06b0 msgr2=0x55cc422e74b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:00.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.595+0000 7ffb954b7740 1 -- 172.21.15.79:0/2441219164 shutdown_connections 2024-08-20T01:40:00.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.596+0000 7ffb954b7740 1 -- 172.21.15.79:0/2441219164 wait complete. 2024-08-20T01:40:00.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.596+0000 7ffb954b7740 1 -- start start 2024-08-20T01:40:00.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.596+0000 7ffb954b7740 1 Processor -- start 2024-08-20T01:40:00.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.596+0000 7ffb954b7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc422e2880 0x55cc422f7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:00.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.596+0000 7ffb954b7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc422ecd70 0x55cc422f2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:00.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.596+0000 7ffb954b7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc422ef130 0x55cc422f25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:00.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.596+0000 7ffb954b7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8c1b16c0 con 0x55cc422ef130 2024-08-20T01:40:00.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.596+0000 7ffb954b7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8c1b0f60 con 0x55cc422ecd70 2024-08-20T01:40:00.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.596+0000 7ffb954b7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8c1ae1a0 con 0x55cc422e2880 2024-08-20T01:40:00.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.596+0000 7ffb90e5a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc422e2880 0x55cc422f7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:00.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.596+0000 7ffb954b7740 10 client.0 _ll_register_callbacks cb 0x7ffb84009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:00.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.597+0000 7ffb90e5a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc422e2880 0x55cc422f7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:33676/0 (socket says 172.21.15.79:33676) 2024-08-20T01:40:00.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.597+0000 7ffb90e5a640 1 -- 172.21.15.79:0/3497885425 learned_addr learned my addr 172.21.15.79:0/3497885425 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:00.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.597+0000 7ffb9165b640 1 --2- 172.21.15.79:0/3497885425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc422ef130 0x55cc422f25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:00.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.597+0000 7ffb8bfff640 1 --2- 172.21.15.79:0/3497885425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc422ecd70 0x55cc422f2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:00.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.597+0000 7ffb90e5a640 1 -- 172.21.15.79:0/3497885425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc422ecd70 msgr2=0x55cc422f2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:00.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.597+0000 7ffb90e5a640 1 --2- 172.21.15.79:0/3497885425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc422ecd70 0x55cc422f2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:00.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.597+0000 7ffb90e5a640 1 -- 172.21.15.79:0/3497885425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc422ef130 msgr2=0x55cc422f25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:00.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.597+0000 7ffb90e5a640 1 --2- 172.21.15.79:0/3497885425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc422ef130 0x55cc422f25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:00.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.597+0000 7ffb90e5a640 1 -- 172.21.15.79:0/3497885425 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc422f2ce0 con 0x55cc422e2880 2024-08-20T01:40:00.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.597+0000 7ffb9165b640 1 --2- 172.21.15.79:0/3497885425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc422ef130 0x55cc422f25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:40:00.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.597+0000 7ffb90e5a640 1 --2- 172.21.15.79:0/3497885425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc422e2880 0x55cc422f7630 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ffb80011010 tx=0x7ffb8000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33cb3201f3543301 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:00.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.597+0000 7ffb6bfff640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:40:00.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.597+0000 7ffb6bfff640 1 -- 172.21.15.79:0/3497885425 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb80038070 con 0x55cc422e2880 2024-08-20T01:40:00.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.597+0000 7ffb954b7740 1 -- 172.21.15.79:0/3497885425 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb800050b0 con 0x55cc422e2880 2024-08-20T01:40:00.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.597+0000 7ffb6bfff640 1 -- 172.21.15.79:0/3497885425 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ffb80005470 con 0x55cc422e2880 2024-08-20T01:40:00.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.597+0000 7ffb6bfff640 1 -- 172.21.15.79:0/3497885425 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7ffb80045050 con 0x55cc422e2880 2024-08-20T01:40:00.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.597+0000 7ffb954b7740 10 client.25714 fetch_fsmap learned FSMap version 33 2024-08-20T01:40:00.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.598+0000 7ffb954b7740 1 -- 172.21.15.79:0/3497885425 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55cc42368ff0 con 0x55cc422e2880 2024-08-20T01:40:00.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.598+0000 7ffb6bfff640 1 -- 172.21.15.79:0/3497885425 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffb800050b0 con 0x55cc422e2880 2024-08-20T01:40:00.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.598+0000 7ffb6bfff640 1 -- 172.21.15.79:0/3497885425 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7ffb8001c710 con 0x55cc422e2880 2024-08-20T01:40:00.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.598+0000 7ffb954b7740 10 client.25714 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:40:00.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.598+0000 7ffb954b7740 10 client.25714 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:40:00.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.598+0000 7ffb954b7740 20 client.25714 populate_metadata read hostname 'smithi079' 2024-08-20T01:40:00.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.598+0000 7ffb954b7740 1 --2- 172.21.15.79:0/3497885425 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55cc422ff490 0x55cc4236b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:00.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.598+0000 7ffb954b7740 4 client.25714 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:40:00.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.598+0000 7ffb954b7740 1 -- 172.21.15.79:0/3497885425 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cc42257320 con 0x55cc422ff490 2024-08-20T01:40:00.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.598+0000 7ffb8bfff640 1 --2- 172.21.15.79:0/3497885425 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55cc422ff490 0x55cc4236b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:00.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.599+0000 7ffb8bfff640 1 --2- 172.21.15.79:0/3497885425 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55cc422ff490 0x55cc4236b770 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2117bc0b3616a16c server_cookie=876a773b9fcc4025 in_seq=0 out_seq=0 2024-08-20T01:40:00.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.599+0000 7ffb6bfff640 10 client.25714 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:40:00.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.599+0000 7ffb6bfff640 1 -- 172.21.15.79:0/3497885425 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cc42257320 con 0x55cc422ff490 2024-08-20T01:40:00.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.599+0000 7ffb6bfff640 10 client.25714 handle_command_reply: tid=0 2024-08-20T01:40:00.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.599+0000 7ffb954b7740 1 client.25714 shutdown 2024-08-20T01:40:00.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.599+0000 7ffb954b7740 1 -- 172.21.15.79:0/3497885425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc422e2880 msgr2=0x55cc422f7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:00.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.599+0000 7ffb954b7740 1 --2- 172.21.15.79:0/3497885425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc422e2880 0x55cc422f7630 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ffb80011010 tx=0x7ffb8000eeb0 comp rx=0 tx=0).stop 2024-08-20T01:40:00.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.599+0000 7ffb954b7740 1 -- 172.21.15.79:0/3497885425 shutdown_connections 2024-08-20T01:40:00.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.599+0000 7ffb954b7740 1 --2- 172.21.15.79:0/3497885425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc422ef130 0x55cc422f25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:00.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.599+0000 7ffb954b7740 1 --2- 172.21.15.79:0/3497885425 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55cc422ff490 0x55cc4236b770 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:00.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.599+0000 7ffb954b7740 1 --2- 172.21.15.79:0/3497885425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc422ecd70 0x55cc422f2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:00.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.599+0000 7ffb954b7740 1 --2- 172.21.15.79:0/3497885425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc422e2880 0x55cc422f7630 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:00.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.599+0000 7ffb6bfff640 0 client.25714 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:40:00.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.599+0000 7ffb954b7740 1 -- 172.21.15.79:0/3497885425 >> 172.21.15.79:0/3497885425 conn(0x55cc422e06b0 msgr2=0x55cc422def50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:00.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.599+0000 7ffb954b7740 1 -- 172.21.15.79:0/3497885425 shutdown_connections 2024-08-20T01:40:00.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.599+0000 7ffb954b7740 1 -- 172.21.15.79:0/3497885425 wait complete. 2024-08-20T01:40:00.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.599+0000 7ffb954b7740 20 client.25714 trim_cache size 0 max 16384 2024-08-20T01:40:00.608 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:40:00.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.600+0000 7ffb930be640 1 -- 172.21.15.79:0/376291146 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ffb7c0b3bd0 msgr2=0x7ffb7c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:00.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.600+0000 7ffb930be640 1 --2- 172.21.15.79:0/376291146 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ffb7c0b3bd0 0x7ffb7c0b6090 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c102570 tx=0x7ffb84009600 comp rx=0 tx=0).stop 2024-08-20T01:40:00.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.600+0000 7ffb930be640 1 -- 172.21.15.79:0/376291146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb8c101eb0 msgr2=0x7ffb8c19b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:00.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.600+0000 7ffb930be640 1 --2- 172.21.15.79:0/376291146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb8c101eb0 0x7ffb8c19b670 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7ffb7802a9a0 tx=0x7ffb78003c20 comp rx=0 tx=0).stop 2024-08-20T01:40:00.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.600+0000 7ffb930be640 1 -- 172.21.15.79:0/376291146 shutdown_connections 2024-08-20T01:40:00.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.600+0000 7ffb930be640 1 --2- 172.21.15.79:0/376291146 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ffb7c0b3bd0 0x7ffb7c0b6090 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:00.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.600+0000 7ffb930be640 1 --2- 172.21.15.79:0/376291146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb8c10f140 0x7ffb8c1a0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:00.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.600+0000 7ffb930be640 1 --2- 172.21.15.79:0/376291146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb8c101eb0 0x7ffb8c19b670 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:00.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.600+0000 7ffb930be640 1 --2- 172.21.15.79:0/376291146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb8c101590 0x7ffb8c19b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:00.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.600+0000 7ffb930be640 1 -- 172.21.15.79:0/376291146 >> 172.21.15.79:0/376291146 conn(0x7ffb8c0fd400 msgr2=0x7ffb8c0ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:00.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.600+0000 7ffb930be640 1 -- 172.21.15.79:0/376291146 shutdown_connections 2024-08-20T01:40:00.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:00.600+0000 7ffb930be640 1 -- 172.21.15.79:0/376291146 wait complete. 2024-08-20T01:40:01.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:00 smithi079 ceph-mon[18656]: overall HEALTH_OK 2024-08-20T01:40:01.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:00 smithi081 ceph-mon[22209]: overall HEALTH_OK 2024-08-20T01:40:01.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:00 smithi175 ceph-mon[22392]: overall HEALTH_OK 2024-08-20T01:40:01.496 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T01:40:01.774 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:40:02.181 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:01 smithi079 ceph-mon[18656]: pgmap v428: 97 pgs: 97 active+clean; 3.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 29 MiB/s wr, 22 op/s 2024-08-20T01:40:02.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:01 smithi081 ceph-mon[22209]: pgmap v428: 97 pgs: 97 active+clean; 3.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 29 MiB/s wr, 22 op/s 2024-08-20T01:40:02.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.261+0000 7f4d2e70d640 1 -- 172.21.15.79:0/3917552435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d28107d40 msgr2=0x7f4d2810e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:02.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.261+0000 7f4d2e70d640 1 --2- 172.21.15.79:0/3917552435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d28107d40 0x7f4d2810e540 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f4d20009ca0 tx=0x7f4d2002a8c0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.262+0000 7f4d2e70d640 1 -- 172.21.15.79:0/3917552435 shutdown_connections 2024-08-20T01:40:02.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.262+0000 7f4d2e70d640 1 --2- 172.21.15.79:0/3917552435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d28107d40 0x7f4d2810e540 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.262+0000 7f4d2e70d640 1 --2- 172.21.15.79:0/3917552435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d281073c0 0x7f4d28107800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.262+0000 7f4d2e70d640 1 --2- 172.21.15.79:0/3917552435 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d281019b0 0x7f4d28101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.262+0000 7f4d2e70d640 1 -- 172.21.15.79:0/3917552435 >> 172.21.15.79:0/3917552435 conn(0x7f4d280fd400 msgr2=0x7f4d280ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:02.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.262+0000 7f4d2e70d640 1 -- 172.21.15.79:0/3917552435 shutdown_connections 2024-08-20T01:40:02.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.262+0000 7f4d2e70d640 1 -- 172.21.15.79:0/3917552435 wait complete. 2024-08-20T01:40:02.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.262+0000 7f4d2e70d640 1 Processor -- start 2024-08-20T01:40:02.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.262+0000 7f4d2e70d640 1 -- start start 2024-08-20T01:40:02.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.263+0000 7f4d2e70d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d281019b0 0x7f4d280fd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:02.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.263+0000 7f4d2e70d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d281073c0 0x7f4d280fde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:02.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.263+0000 7f4d2e70d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d28107d40 0x7f4d280fe380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:02.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.263+0000 7f4d2e70d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4d28111900 con 0x7f4d281019b0 2024-08-20T01:40:02.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.263+0000 7f4d2e70d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4d28111780 con 0x7f4d28107d40 2024-08-20T01:40:02.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.263+0000 7f4d2e70d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4d28111a80 con 0x7f4d281073c0 2024-08-20T01:40:02.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.263+0000 7f4d27fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d281019b0 0x7f4d280fd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:02.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.263+0000 7f4d27fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d281019b0 0x7f4d280fd900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60040/0 (socket says 172.21.15.79:60040) 2024-08-20T01:40:02.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.263+0000 7f4d27fff640 1 -- 172.21.15.79:0/3906401146 learned_addr learned my addr 172.21.15.79:0/3906401146 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:02.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.263+0000 7f4d2ccaa640 1 --2- 172.21.15.79:0/3906401146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d28107d40 0x7f4d280fe380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:02.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.263+0000 7f4d277fe640 1 --2- 172.21.15.79:0/3906401146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d281073c0 0x7f4d280fde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:02.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.263+0000 7f4d27fff640 1 -- 172.21.15.79:0/3906401146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d281073c0 msgr2=0x7f4d280fde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:02.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.263+0000 7f4d27fff640 1 --2- 172.21.15.79:0/3906401146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d281073c0 0x7f4d280fde40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.263+0000 7f4d27fff640 1 -- 172.21.15.79:0/3906401146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d28107d40 msgr2=0x7f4d280fe380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:02.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.263+0000 7f4d27fff640 1 --2- 172.21.15.79:0/3906401146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d28107d40 0x7f4d280fe380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.263+0000 7f4d27fff640 1 -- 172.21.15.79:0/3906401146 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d281a7200 con 0x7f4d281019b0 2024-08-20T01:40:02.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.263+0000 7f4d2ccaa640 1 --2- 172.21.15.79:0/3906401146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d28107d40 0x7f4d280fe380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:40:02.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.263+0000 7f4d277fe640 1 --2- 172.21.15.79:0/3906401146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d281073c0 0x7f4d280fde40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:40:02.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.263+0000 7f4d27fff640 1 --2- 172.21.15.79:0/3906401146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d281019b0 0x7f4d280fd900 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f4d1800c970 tx=0x7f4d1800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:02.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.264+0000 7f4d257fa640 1 -- 172.21.15.79:0/3906401146 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d18007bb0 con 0x7f4d281019b0 2024-08-20T01:40:02.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.264+0000 7f4d2e70d640 1 -- 172.21.15.79:0/3906401146 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d281a74f0 con 0x7f4d281019b0 2024-08-20T01:40:02.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.264+0000 7f4d257fa640 1 -- 172.21.15.79:0/3906401146 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4d18007d50 con 0x7f4d281019b0 2024-08-20T01:40:02.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.264+0000 7f4d257fa640 1 -- 172.21.15.79:0/3906401146 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d18004e40 con 0x7f4d281019b0 2024-08-20T01:40:02.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.264+0000 7f4d2e70d640 1 -- 172.21.15.79:0/3906401146 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d281a7a30 con 0x7f4d281019b0 2024-08-20T01:40:02.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.267+0000 7f4d30b06740 1 Processor -- start 2024-08-20T01:40:02.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.267+0000 7f4d30b06740 1 -- start start 2024-08-20T01:40:02.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.267+0000 7f4d30b06740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e509d6880 0x558e509d6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:02.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.267+0000 7f4d30b06740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e509d71a0 0x558e509e2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:02.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.267+0000 7f4d30b06740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e509e3130 0x558e509e5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:02.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.267+0000 7f4d30b06740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558e5094d930 con 0x558e509d71a0 2024-08-20T01:40:02.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.267+0000 7f4d30b06740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558e5093ce30 con 0x558e509e3130 2024-08-20T01:40:02.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.267+0000 7f4d30b06740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558e50940e70 con 0x558e509d6880 2024-08-20T01:40:02.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.267+0000 7f4d257fa640 1 -- 172.21.15.79:0/3906401146 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f4d18005020 con 0x7f4d281019b0 2024-08-20T01:40:02.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.267+0000 7f4d27fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e509d71a0 0x558e509e2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:02.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.267+0000 7f4d2ccaa640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e509d6880 0x558e509d6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:02.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.267+0000 7f4d27fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e509d71a0 0x558e509e2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60052/0 (socket says 172.21.15.79:60052) 2024-08-20T01:40:02.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.267+0000 7f4d27fff640 1 -- 172.21.15.79:0/3324925100 learned_addr learned my addr 172.21.15.79:0/3324925100 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:02.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.267+0000 7f4d277fe640 1 --2- 172.21.15.79:0/3324925100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e509e3130 0x558e509e5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:02.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.268+0000 7f4d27fff640 1 -- 172.21.15.79:0/3324925100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e509d6880 msgr2=0x558e509d6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:02.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.268+0000 7f4d27fff640 1 --2- 172.21.15.79:0/3324925100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e509d6880 0x558e509d6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.268+0000 7f4d27fff640 1 -- 172.21.15.79:0/3324925100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e509e3130 msgr2=0x558e509e5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:02.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.268+0000 7f4d27fff640 1 --2- 172.21.15.79:0/3324925100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e509e3130 0x558e509e5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.268+0000 7f4d27fff640 1 -- 172.21.15.79:0/3324925100 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e5069c650 con 0x558e509d71a0 2024-08-20T01:40:02.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.268+0000 7f4d27fff640 1 --2- 172.21.15.79:0/3324925100 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e509d71a0 0x558e509e2bf0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f4d180e9d00 tx=0x7f4d180eb750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0afb402dbeb08e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:02.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.268+0000 7f4d0e7fc640 1 -- 172.21.15.79:0/3324925100 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d180f5670 con 0x558e509d71a0 2024-08-20T01:40:02.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.268+0000 7f4d257fa640 1 --2- 172.21.15.79:0/3906401146 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4d100b3bd0 0x7f4d100b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:02.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.268+0000 7f4d0e7fc640 1 -- 172.21.15.79:0/3324925100 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4d180f0070 con 0x558e509d71a0 2024-08-20T01:40:02.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.268+0000 7f4d0e7fc640 1 -- 172.21.15.79:0/3324925100 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d180eca40 con 0x558e509d71a0 2024-08-20T01:40:02.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.268+0000 7f4d2ccaa640 1 --2- 172.21.15.79:0/3906401146 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4d100b3bd0 0x7f4d100b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:02.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.268+0000 7f4d257fa640 1 -- 172.21.15.79:0/3906401146 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f4d180e39f0 con 0x7f4d281019b0 2024-08-20T01:40:02.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.269+0000 7f4d30b06740 1 -- 172.21.15.79:0/3324925100 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e509d71a0 msgr2=0x558e509e2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:02.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.269+0000 7f4d2ccaa640 1 --2- 172.21.15.79:0/3906401146 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4d100b3bd0 0x7f4d100b6090 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4d2002ade0 tx=0x7f4d20031730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:02.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.269+0000 7f4d30b06740 1 --2- 172.21.15.79:0/3324925100 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e509d71a0 0x558e509e2bf0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f4d180e9d00 tx=0x7f4d180eb750 comp rx=0 tx=0).stop 2024-08-20T01:40:02.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.269+0000 7f4d30b06740 1 -- 172.21.15.79:0/3324925100 shutdown_connections 2024-08-20T01:40:02.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.269+0000 7f4d30b06740 1 --2- 172.21.15.79:0/3324925100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e509e3130 0x558e509e5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.269+0000 7f4d30b06740 1 --2- 172.21.15.79:0/3324925100 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e509d71a0 0x558e509e2bf0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.269+0000 7f4d30b06740 1 --2- 172.21.15.79:0/3324925100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e509d6880 0x558e509d6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.269+0000 7f4d30b06740 1 -- 172.21.15.79:0/3324925100 >> 172.21.15.79:0/3324925100 conn(0x558e509d46b0 msgr2=0x558e509d5850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:02.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.269+0000 7f4d30b06740 1 -- 172.21.15.79:0/3324925100 shutdown_connections 2024-08-20T01:40:02.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.269+0000 7f4d30b06740 1 -- 172.21.15.79:0/3324925100 wait complete. 2024-08-20T01:40:02.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.270+0000 7f4d30b06740 1 -- start start 2024-08-20T01:40:02.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.270+0000 7f4d30b06740 1 Processor -- start 2024-08-20T01:40:02.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.270+0000 7f4d30b06740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e509d6880 0x558e509e00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:02.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.270+0000 7f4d30b06740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e509d71a0 0x558e509e0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:02.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.270+0000 7f4d30b06740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e509e3130 0x558e509e0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:02.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.270+0000 7f4d30b06740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558e5079f700 con 0x558e509d6880 2024-08-20T01:40:02.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.270+0000 7f4d30b06740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558e508c3810 con 0x558e509d71a0 2024-08-20T01:40:02.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.270+0000 7f4d30b06740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558e509e5de0 con 0x558e509e3130 2024-08-20T01:40:02.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.271+0000 7f4d30b06740 10 client.0 _ll_register_callbacks cb 0x558e50936700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:02.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.271+0000 7f4d27fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e509d6880 0x558e509e00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:02.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.271+0000 7f4d27fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e509d6880 0x558e509e00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60064/0 (socket says 172.21.15.79:60064) 2024-08-20T01:40:02.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.271+0000 7f4d27fff640 1 -- 172.21.15.79:0/794929563 learned_addr learned my addr 172.21.15.79:0/794929563 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:02.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.271+0000 7f4d277fe640 1 --2- 172.21.15.79:0/794929563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e509d71a0 0x558e509e0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:02.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.271+0000 7f4d2ccaa640 1 --2- 172.21.15.79:0/794929563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e509e3130 0x558e509e0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:02.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.271+0000 7f4d27fff640 1 -- 172.21.15.79:0/794929563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e509e3130 msgr2=0x558e509e0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:02.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.271+0000 7f4d27fff640 1 --2- 172.21.15.79:0/794929563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e509e3130 0x558e509e0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.271+0000 7f4d27fff640 1 -- 172.21.15.79:0/794929563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e509d71a0 msgr2=0x558e509e0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:02.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.271+0000 7f4d27fff640 1 --2- 172.21.15.79:0/794929563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e509d71a0 0x558e509e0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.271+0000 7f4d27fff640 1 -- 172.21.15.79:0/794929563 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e509ef1f0 con 0x558e509d6880 2024-08-20T01:40:02.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.271+0000 7f4d27fff640 1 --2- 172.21.15.79:0/794929563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e509d6880 0x558e509e00f0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f4d180e1550 tx=0x7f4d18007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86f590082bb2104a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:02.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.271+0000 7f4d077fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:40:02.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.271+0000 7f4d077fe640 1 -- 172.21.15.79:0/794929563 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1801d030 con 0x558e509d6880 2024-08-20T01:40:02.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.271+0000 7f4d077fe640 1 -- 172.21.15.79:0/794929563 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f4d180046c0 con 0x558e509d6880 2024-08-20T01:40:02.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.271+0000 7f4d30b06740 1 -- 172.21.15.79:0/794929563 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558e508ec150 con 0x558e509d6880 2024-08-20T01:40:02.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.271+0000 7f4d077fe640 1 -- 172.21.15.79:0/794929563 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f4d180a6810 con 0x558e509d6880 2024-08-20T01:40:02.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.271+0000 7f4d30b06740 10 client.16467 fetch_fsmap learned FSMap version 33 2024-08-20T01:40:02.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.271+0000 7f4d30b06740 1 -- 172.21.15.79:0/794929563 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x558e509f1ba0 con 0x558e509d6880 2024-08-20T01:40:02.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.272+0000 7f4d077fe640 1 -- 172.21.15.79:0/794929563 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x558e508ec150 con 0x558e509d6880 2024-08-20T01:40:02.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.272+0000 7f4d077fe640 1 -- 172.21.15.79:0/794929563 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7f4d180aabb0 con 0x558e509d6880 2024-08-20T01:40:02.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.272+0000 7f4d30b06740 10 client.16467 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:40:02.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.272+0000 7f4d30b06740 10 client.16467 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:40:02.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.272+0000 7f4d30b06740 20 client.16467 populate_metadata read hostname 'smithi079' 2024-08-20T01:40:02.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.272+0000 7f4d30b06740 1 --2- 172.21.15.79:0/794929563 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558e509f2ef0 0x558e509f52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:02.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.272+0000 7f4d30b06740 4 client.16467 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:40:02.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.272+0000 7f4d30b06740 1 -- 172.21.15.79:0/794929563 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e5094f880 con 0x558e509f2ef0 2024-08-20T01:40:02.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.272+0000 7f4d277fe640 1 --2- 172.21.15.79:0/794929563 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558e509f2ef0 0x558e509f52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:02.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.273+0000 7f4d277fe640 1 --2- 172.21.15.79:0/794929563 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558e509f2ef0 0x558e509f52e0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa3c6405bca7ce8d server_cookie=c73c841d8f1ca5e2 in_seq=0 out_seq=0 2024-08-20T01:40:02.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.273+0000 7f4d077fe640 10 client.16467 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:02.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.273+0000 7f4d077fe640 1 -- 172.21.15.79:0/794929563 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558e5094f880 con 0x558e509f2ef0 2024-08-20T01:40:02.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.273+0000 7f4d077fe640 10 client.16467 handle_command_reply: tid=0 2024-08-20T01:40:02.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.273+0000 7f4d30b06740 1 client.16467 shutdown 2024-08-20T01:40:02.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.274+0000 7f4d30b06740 1 -- 172.21.15.79:0/794929563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e509d6880 msgr2=0x558e509e00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:02.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.274+0000 7f4d30b06740 1 --2- 172.21.15.79:0/794929563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e509d6880 0x558e509e00f0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f4d180e1550 tx=0x7f4d18007f00 comp rx=0 tx=0).stop 2024-08-20T01:40:02.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.274+0000 7f4d30b06740 1 -- 172.21.15.79:0/794929563 shutdown_connections 2024-08-20T01:40:02.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.274+0000 7f4d30b06740 1 --2- 172.21.15.79:0/794929563 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558e509f2ef0 0x558e509f52e0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.274+0000 7f4d30b06740 1 --2- 172.21.15.79:0/794929563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e509e3130 0x558e509e0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.274+0000 7f4d30b06740 1 --2- 172.21.15.79:0/794929563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e509d71a0 0x558e509e0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.274+0000 7f4d30b06740 1 --2- 172.21.15.79:0/794929563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e509d6880 0x558e509e00f0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.274+0000 7f4d077fe640 0 client.16467 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:02.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.274+0000 7f4d30b06740 1 -- 172.21.15.79:0/794929563 >> 172.21.15.79:0/794929563 conn(0x558e509d46b0 msgr2=0x558e509da250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:02.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.274+0000 7f4d30b06740 1 -- 172.21.15.79:0/794929563 shutdown_connections 2024-08-20T01:40:02.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.274+0000 7f4d30b06740 1 -- 172.21.15.79:0/794929563 wait complete. 2024-08-20T01:40:02.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.274+0000 7f4d30b06740 20 client.16467 trim_cache size 0 max 16384 2024-08-20T01:40:02.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.290+0000 7f4d30b06740 1 Processor -- start 2024-08-20T01:40:02.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.290+0000 7f4d30b06740 1 -- start start 2024-08-20T01:40:02.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.290+0000 7f4d30b06740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e509d6880 0x558e509defe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:02.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.290+0000 7f4d30b06740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e509d71a0 0x558e509da8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:02.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.290+0000 7f4d30b06740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e509e3130 0x558e509e1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:02.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.290+0000 7f4d30b06740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4d281b00d0 con 0x558e509d71a0 2024-08-20T01:40:02.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.290+0000 7f4d30b06740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4d281b1d60 con 0x558e509d6880 2024-08-20T01:40:02.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.290+0000 7f4d30b06740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4d281b07a0 con 0x558e509e3130 2024-08-20T01:40:02.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.290+0000 7f4d277fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e509d71a0 0x558e509da8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:02.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.290+0000 7f4d277fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e509d71a0 0x558e509da8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60080/0 (socket says 172.21.15.79:60080) 2024-08-20T01:40:02.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.290+0000 7f4d277fe640 1 -- 172.21.15.79:0/4283150677 learned_addr learned my addr 172.21.15.79:0/4283150677 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:02.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.290+0000 7f4d27fff640 1 --2- 172.21.15.79:0/4283150677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e509d6880 0x558e509defe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:02.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.290+0000 7f4d2ccaa640 1 --2- 172.21.15.79:0/4283150677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e509e3130 0x558e509e1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:02.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.290+0000 7f4d277fe640 1 -- 172.21.15.79:0/4283150677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e509e3130 msgr2=0x558e509e1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:02.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.290+0000 7f4d277fe640 1 --2- 172.21.15.79:0/4283150677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e509e3130 0x558e509e1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.291+0000 7f4d277fe640 1 -- 172.21.15.79:0/4283150677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e509d6880 msgr2=0x558e509defe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:02.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.291+0000 7f4d277fe640 1 --2- 172.21.15.79:0/4283150677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e509d6880 0x558e509defe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.291+0000 7f4d277fe640 1 -- 172.21.15.79:0/4283150677 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e509d44e0 con 0x558e509d71a0 2024-08-20T01:40:02.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.291+0000 7f4d27fff640 1 --2- 172.21.15.79:0/4283150677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e509d6880 0x558e509defe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:40:02.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.291+0000 7f4d277fe640 1 --2- 172.21.15.79:0/4283150677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e509d71a0 0x558e509da8f0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x558e509d6830 tx=0x7f4d1c00f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec9981ae71bf8cc5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:02.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.291+0000 7f4d0dffb640 1 -- 172.21.15.79:0/4283150677 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c01b620 con 0x558e509d71a0 2024-08-20T01:40:02.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.291+0000 7f4d0dffb640 1 -- 172.21.15.79:0/4283150677 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4d1c00fe50 con 0x558e509d71a0 2024-08-20T01:40:02.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.291+0000 7f4d0dffb640 1 -- 172.21.15.79:0/4283150677 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c01aa00 con 0x558e509d71a0 2024-08-20T01:40:02.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.292+0000 7f4d30b06740 1 -- 172.21.15.79:0/4283150677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e509d71a0 msgr2=0x558e509da8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:02.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.292+0000 7f4d30b06740 1 --2- 172.21.15.79:0/4283150677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e509d71a0 0x558e509da8f0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x558e509d6830 tx=0x7f4d1c00f7f0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.292+0000 7f4d30b06740 1 -- 172.21.15.79:0/4283150677 shutdown_connections 2024-08-20T01:40:02.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.292+0000 7f4d30b06740 1 --2- 172.21.15.79:0/4283150677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e509e3130 0x558e509e1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.292+0000 7f4d30b06740 1 --2- 172.21.15.79:0/4283150677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e509d71a0 0x558e509da8f0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.292+0000 7f4d30b06740 1 --2- 172.21.15.79:0/4283150677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e509d6880 0x558e509defe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.292+0000 7f4d30b06740 1 -- 172.21.15.79:0/4283150677 >> 172.21.15.79:0/4283150677 conn(0x558e509d46b0 msgr2=0x558e509e1720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:02.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.292+0000 7f4d30b06740 1 -- 172.21.15.79:0/4283150677 shutdown_connections 2024-08-20T01:40:02.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.292+0000 7f4d30b06740 1 -- 172.21.15.79:0/4283150677 wait complete. 2024-08-20T01:40:02.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.292+0000 7f4d30b06740 1 -- start start 2024-08-20T01:40:02.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.292+0000 7f4d30b06740 1 Processor -- start 2024-08-20T01:40:02.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.293+0000 7f4d30b06740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e509d6880 0x558e509f5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:02.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.293+0000 7f4d30b06740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e509d71a0 0x558e509f61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:02.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.293+0000 7f4d30b06740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e509e3130 0x558e50a55860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:02.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.293+0000 7f4d30b06740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4d281b15d0 con 0x558e509d6880 2024-08-20T01:40:02.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.293+0000 7f4d30b06740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4d281b0e70 con 0x558e509d71a0 2024-08-20T01:40:02.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.293+0000 7f4d30b06740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4d281ae0b0 con 0x558e509e3130 2024-08-20T01:40:02.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.293+0000 7f4d30b06740 10 client.0 _ll_register_callbacks cb 0x7f4d1c00b2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:02.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.293+0000 7f4d27fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e509d6880 0x558e509f5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:02.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.293+0000 7f4d27fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e509d6880 0x558e509f5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60088/0 (socket says 172.21.15.79:60088) 2024-08-20T01:40:02.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.293+0000 7f4d27fff640 1 -- 172.21.15.79:0/509374172 learned_addr learned my addr 172.21.15.79:0/509374172 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:02.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.293+0000 7f4d2ccaa640 1 --2- 172.21.15.79:0/509374172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e509e3130 0x558e50a55860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:02.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.293+0000 7f4d277fe640 1 --2- 172.21.15.79:0/509374172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e509d71a0 0x558e509f61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:02.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.293+0000 7f4d27fff640 1 -- 172.21.15.79:0/509374172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e509e3130 msgr2=0x558e50a55860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:02.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.293+0000 7f4d27fff640 1 --2- 172.21.15.79:0/509374172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e509e3130 0x558e50a55860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.293+0000 7f4d27fff640 1 -- 172.21.15.79:0/509374172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e509d71a0 msgr2=0x558e509f61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:02.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.293+0000 7f4d27fff640 1 --2- 172.21.15.79:0/509374172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e509d71a0 0x558e509f61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.293+0000 7f4d27fff640 1 -- 172.21.15.79:0/509374172 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e509d5130 con 0x558e509d6880 2024-08-20T01:40:02.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.294+0000 7f4d27fff640 1 --2- 172.21.15.79:0/509374172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e509d6880 0x558e509f5c20 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f4d180ebc50 tx=0x7f4d180057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37932f0fe1a186ee server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:02.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.294+0000 7f4d077fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:40:02.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.294+0000 7f4d077fe640 1 -- 172.21.15.79:0/509374172 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1801d040 con 0x558e509d6880 2024-08-20T01:40:02.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.294+0000 7f4d077fe640 1 -- 172.21.15.79:0/509374172 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f4d180c51b0 con 0x558e509d6880 2024-08-20T01:40:02.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.294+0000 7f4d30b06740 1 -- 172.21.15.79:0/509374172 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d1c00fe50 con 0x558e509d6880 2024-08-20T01:40:02.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.294+0000 7f4d077fe640 1 -- 172.21.15.79:0/509374172 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f4d180a60e0 con 0x558e509d6880 2024-08-20T01:40:02.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.294+0000 7f4d30b06740 10 client.16473 fetch_fsmap learned FSMap version 33 2024-08-20T01:40:02.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.294+0000 7f4d30b06740 1 -- 172.21.15.79:0/509374172 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x558e50a5d250 con 0x558e509d6880 2024-08-20T01:40:02.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.294+0000 7f4d077fe640 1 -- 172.21.15.79:0/509374172 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4d180c4030 con 0x558e509d6880 2024-08-20T01:40:02.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.295+0000 7f4d077fe640 1 -- 172.21.15.79:0/509374172 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7f4d180b3570 con 0x558e509d6880 2024-08-20T01:40:02.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.295+0000 7f4d30b06740 10 client.16473 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:40:02.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.295+0000 7f4d30b06740 10 client.16473 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:40:02.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.295+0000 7f4d30b06740 20 client.16473 populate_metadata read hostname 'smithi079' 2024-08-20T01:40:02.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.295+0000 7f4d30b06740 1 --2- 172.21.15.79:0/509374172 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558e50a5d8c0 0x558e50a5fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:02.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.295+0000 7f4d30b06740 4 client.16473 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:40:02.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.295+0000 7f4d30b06740 1 -- 172.21.15.79:0/509374172 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f4d1c00fe50 con 0x558e50a5d8c0 2024-08-20T01:40:02.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.295+0000 7f4d277fe640 1 --2- 172.21.15.79:0/509374172 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558e50a5d8c0 0x558e50a5fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:02.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.295+0000 7f4d077fe640 10 client.16473 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:02.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.295+0000 7f4d277fe640 1 --2- 172.21.15.79:0/509374172 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558e50a5d8c0 0x558e50a5fce0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e66dc972c9e0d9a server_cookie=8defcc013cb7d86c in_seq=0 out_seq=0 2024-08-20T01:40:02.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.295+0000 7f4d077fe640 1 -- 172.21.15.79:0/509374172 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f4d1c00fe50 con 0x558e50a5d8c0 2024-08-20T01:40:02.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.295+0000 7f4d077fe640 10 client.16473 handle_command_reply: tid=0 2024-08-20T01:40:02.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.296+0000 7f4d30b06740 1 client.16473 shutdown 2024-08-20T01:40:02.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.296+0000 7f4d30b06740 1 -- 172.21.15.79:0/509374172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e509d6880 msgr2=0x558e509f5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:02.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.296+0000 7f4d30b06740 1 --2- 172.21.15.79:0/509374172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e509d6880 0x558e509f5c20 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f4d180ebc50 tx=0x7f4d180057b0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.296+0000 7f4d30b06740 1 -- 172.21.15.79:0/509374172 shutdown_connections 2024-08-20T01:40:02.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.296+0000 7f4d30b06740 1 --2- 172.21.15.79:0/509374172 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558e50a5d8c0 0x558e50a5fce0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.296+0000 7f4d30b06740 1 --2- 172.21.15.79:0/509374172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e509e3130 0x558e50a55860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.296+0000 7f4d30b06740 1 --2- 172.21.15.79:0/509374172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e509d71a0 0x558e509f61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.296+0000 7f4d30b06740 1 --2- 172.21.15.79:0/509374172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e509d6880 0x558e509f5c20 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.296+0000 7f4d30b06740 1 -- 172.21.15.79:0/509374172 >> 172.21.15.79:0/509374172 conn(0x558e509d46b0 msgr2=0x558e509e0880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:02.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.296+0000 7f4d077fe640 0 client.16473 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:02.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.296+0000 7f4d30b06740 1 -- 172.21.15.79:0/509374172 shutdown_connections 2024-08-20T01:40:02.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.296+0000 7f4d30b06740 1 -- 172.21.15.79:0/509374172 wait complete. 2024-08-20T01:40:02.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.296+0000 7f4d30b06740 20 client.16473 trim_cache size 0 max 16384 2024-08-20T01:40:02.312 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:40:02.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.296+0000 7f4d2e70d640 1 -- 172.21.15.79:0/3906401146 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4d100b3bd0 msgr2=0x7f4d100b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:02.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.296+0000 7f4d2e70d640 1 --2- 172.21.15.79:0/3906401146 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4d100b3bd0 0x7f4d100b6090 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4d2002ade0 tx=0x7f4d20031730 comp rx=0 tx=0).stop 2024-08-20T01:40:02.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.297+0000 7f4d2e70d640 1 -- 172.21.15.79:0/3906401146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d281019b0 msgr2=0x7f4d280fd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:02.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.297+0000 7f4d2e70d640 1 --2- 172.21.15.79:0/3906401146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d281019b0 0x7f4d280fd900 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f4d1800c970 tx=0x7f4d1800ce30 comp rx=0 tx=0).stop 2024-08-20T01:40:02.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.297+0000 7f4d2e70d640 1 -- 172.21.15.79:0/3906401146 shutdown_connections 2024-08-20T01:40:02.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.297+0000 7f4d2e70d640 1 --2- 172.21.15.79:0/3906401146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d28107d40 0x7f4d280fe380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.297+0000 7f4d2e70d640 1 --2- 172.21.15.79:0/3906401146 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4d100b3bd0 0x7f4d100b6090 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.297+0000 7f4d2e70d640 1 --2- 172.21.15.79:0/3906401146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d281073c0 0x7f4d280fde40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.297+0000 7f4d2e70d640 1 --2- 172.21.15.79:0/3906401146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d281019b0 0x7f4d280fd900 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.297+0000 7f4d2e70d640 1 -- 172.21.15.79:0/3906401146 >> 172.21.15.79:0/3906401146 conn(0x7f4d280fd400 msgr2=0x7f4d2806b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:02.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.297+0000 7f4d2e70d640 1 -- 172.21.15.79:0/3906401146 shutdown_connections 2024-08-20T01:40:02.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:02.297+0000 7f4d2e70d640 1 -- 172.21.15.79:0/3906401146 wait complete. 2024-08-20T01:40:02.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:01 smithi175 ceph-mon[22392]: pgmap v428: 97 pgs: 97 active+clean; 3.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 29 MiB/s wr, 22 op/s 2024-08-20T01:40:02.921 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.918+0000 7f023af5c640 1 -- 172.21.15.79:0/2458110193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0234101560 msgr2=0x7f0234101960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:02.921 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.918+0000 7f023af5c640 1 --2- 172.21.15.79:0/2458110193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0234101560 0x7f0234101960 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f0228009930 tx=0x7f022802a440 comp rx=0 tx=0).stop 2024-08-20T01:40:02.921 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.918+0000 7f023af5c640 1 -- 172.21.15.79:0/2458110193 shutdown_connections 2024-08-20T01:40:02.921 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.918+0000 7f023af5c640 1 --2- 172.21.15.79:0/2458110193 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0234103070 0x7f02341099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.921 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.918+0000 7f023af5c640 1 --2- 172.21.15.79:0/2458110193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02341026b0 0x7f0234102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.921 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.918+0000 7f023af5c640 1 --2- 172.21.15.79:0/2458110193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0234101560 0x7f0234101960 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.921 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.918+0000 7f023af5c640 1 -- 172.21.15.79:0/2458110193 >> 172.21.15.79:0/2458110193 conn(0x7f02340fce40 msgr2=0x7f02340ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:02.921 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.918+0000 7f023af5c640 1 -- 172.21.15.79:0/2458110193 shutdown_connections 2024-08-20T01:40:02.921 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.918+0000 7f023af5c640 1 -- 172.21.15.79:0/2458110193 wait complete. 2024-08-20T01:40:02.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.919+0000 7f023af5c640 1 Processor -- start 2024-08-20T01:40:02.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.919+0000 7f023af5c640 1 -- start start 2024-08-20T01:40:02.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.919+0000 7f023af5c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0234101560 0x7f0234105480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:02.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.919+0000 7f023af5c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02341026b0 0x7f0234103ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:02.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.919+0000 7f023af5c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0234103070 0x7f0234104220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:02.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.919+0000 7f023af5c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f023410d100 con 0x7f02341026b0 2024-08-20T01:40:02.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.919+0000 7f023af5c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f023410cf80 con 0x7f0234101560 2024-08-20T01:40:02.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.919+0000 7f023af5c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f023410d280 con 0x7f0234103070 2024-08-20T01:40:02.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.919+0000 7f0233fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02341026b0 0x7f0234103ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:02.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.919+0000 7f0233fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02341026b0 0x7f0234103ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60112/0 (socket says 172.21.15.79:60112) 2024-08-20T01:40:02.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.919+0000 7f0233fff640 1 -- 172.21.15.79:0/2374782646 learned_addr learned my addr 172.21.15.79:0/2374782646 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:02.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.920+0000 7f0238cf8640 1 --2- 172.21.15.79:0/2374782646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0234101560 0x7f0234105480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:02.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.920+0000 7f0233fff640 1 -- 172.21.15.79:0/2374782646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0234103070 msgr2=0x7f0234104220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:02.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.920+0000 7f0233fff640 1 --2- 172.21.15.79:0/2374782646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0234103070 0x7f0234104220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.920+0000 7f0233fff640 1 -- 172.21.15.79:0/2374782646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0234101560 msgr2=0x7f0234105480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:02.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.920+0000 7f0233fff640 1 --2- 172.21.15.79:0/2374782646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0234101560 0x7f0234105480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.920+0000 7f0233fff640 1 -- 172.21.15.79:0/2374782646 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f023419c990 con 0x7f02341026b0 2024-08-20T01:40:02.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.920+0000 7f0233fff640 1 --2- 172.21.15.79:0/2374782646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02341026b0 0x7f0234103ce0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f022000d950 tx=0x7f022000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:02.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.921+0000 7f0231ffb640 1 -- 172.21.15.79:0/2374782646 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0220017070 con 0x7f02341026b0 2024-08-20T01:40:02.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.921+0000 7f0231ffb640 1 -- 172.21.15.79:0/2374782646 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0220009c30 con 0x7f02341026b0 2024-08-20T01:40:02.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.921+0000 7f0231ffb640 1 -- 172.21.15.79:0/2374782646 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f022000f620 con 0x7f02341026b0 2024-08-20T01:40:02.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.921+0000 7f023af5c640 1 -- 172.21.15.79:0/2374782646 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f023419cc80 con 0x7f02341026b0 2024-08-20T01:40:02.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.921+0000 7f023af5c640 1 -- 172.21.15.79:0/2374782646 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f023419d200 con 0x7f02341026b0 2024-08-20T01:40:02.927 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.924+0000 7f023de29740 1 Processor -- start 2024-08-20T01:40:02.927 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.924+0000 7f023de29740 1 -- start start 2024-08-20T01:40:02.927 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.924+0000 7f023de29740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de82bbd630 0x55de82bbfa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:02.927 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.924+0000 7f023de29740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de82bbff60 0x55de82bc2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:02.927 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.924+0000 7f023de29740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de82bc29a0 0x55de82bc4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:02.927 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.924+0000 7f023de29740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55de82b30360 con 0x55de82bbd630 2024-08-20T01:40:02.927 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.924+0000 7f023de29740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55de82b1f860 con 0x55de82bc29a0 2024-08-20T01:40:02.928 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.924+0000 7f023de29740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55de82b238a0 con 0x55de82bbff60 2024-08-20T01:40:02.928 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.924+0000 7f0231ffb640 1 -- 172.21.15.79:0/2374782646 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f0220010460 con 0x7f02341026b0 2024-08-20T01:40:02.928 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.924+0000 7f02394f9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de82bbd630 0x55de82bbfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:02.928 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.924+0000 7f02394f9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de82bbd630 0x55de82bbfa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60114/0 (socket says 172.21.15.79:60114) 2024-08-20T01:40:02.928 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.924+0000 7f02394f9640 1 -- 172.21.15.79:0/613246674 learned_addr learned my addr 172.21.15.79:0/613246674 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:02.928 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.924+0000 7f0238cf8640 1 --2- 172.21.15.79:0/613246674 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de82bbff60 0x55de82bc2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:02.928 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.924+0000 7f0233fff640 1 --2- 172.21.15.79:0/613246674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de82bc29a0 0x55de82bc4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:02.928 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.924+0000 7f02394f9640 1 -- 172.21.15.79:0/613246674 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de82bbff60 msgr2=0x55de82bc2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:02.928 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.924+0000 7f02394f9640 1 --2- 172.21.15.79:0/613246674 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de82bbff60 0x55de82bc2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.928 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.924+0000 7f02394f9640 1 -- 172.21.15.79:0/613246674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de82bc29a0 msgr2=0x55de82bc4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:02.928 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.924+0000 7f02394f9640 1 --2- 172.21.15.79:0/613246674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de82bc29a0 0x55de82bc4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.928 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.924+0000 7f02394f9640 1 -- 172.21.15.79:0/613246674 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de82ac6e40 con 0x55de82bbd630 2024-08-20T01:40:02.928 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.924+0000 7f0233fff640 1 --2- 172.21.15.79:0/613246674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de82bc29a0 0x55de82bc4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:40:02.929 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.925+0000 7f02394f9640 1 --2- 172.21.15.79:0/613246674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de82bbd630 0x55de82bbfa20 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f022c009d20 tx=0x7f022c00b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d943b6b0f412d183 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:02.929 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.925+0000 7f021effd640 1 -- 172.21.15.79:0/613246674 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f022c00bd40 con 0x55de82bbd630 2024-08-20T01:40:02.929 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.925+0000 7f021effd640 1 -- 172.21.15.79:0/613246674 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f022c017070 con 0x55de82bbd630 2024-08-20T01:40:02.929 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.925+0000 7f021effd640 1 -- 172.21.15.79:0/613246674 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f022c011590 con 0x55de82bbd630 2024-08-20T01:40:02.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.926+0000 7f0231ffb640 1 --2- 172.21.15.79:0/2374782646 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f02240b3c50 0x7f02240b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:02.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.926+0000 7f023de29740 1 -- 172.21.15.79:0/613246674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de82bbd630 msgr2=0x55de82bbfa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:02.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.926+0000 7f023de29740 1 --2- 172.21.15.79:0/613246674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de82bbd630 0x55de82bbfa20 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f022c009d20 tx=0x7f022c00b420 comp rx=0 tx=0).stop 2024-08-20T01:40:02.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.926+0000 7f0238cf8640 1 --2- 172.21.15.79:0/2374782646 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f02240b3c50 0x7f02240b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:02.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.926+0000 7f023de29740 1 -- 172.21.15.79:0/613246674 shutdown_connections 2024-08-20T01:40:02.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.926+0000 7f023de29740 1 --2- 172.21.15.79:0/613246674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de82bc29a0 0x55de82bc4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.926+0000 7f023de29740 1 --2- 172.21.15.79:0/613246674 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de82bbff60 0x55de82bc2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.926+0000 7f023de29740 1 --2- 172.21.15.79:0/613246674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de82bbd630 0x55de82bbfa20 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.926+0000 7f0231ffb640 1 -- 172.21.15.79:0/2374782646 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f02200e3780 con 0x7f02341026b0 2024-08-20T01:40:02.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.926+0000 7f023de29740 1 -- 172.21.15.79:0/613246674 >> 172.21.15.79:0/613246674 conn(0x55de82bb8730 msgr2=0x55de82bb9510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:02.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.926+0000 7f023de29740 1 -- 172.21.15.79:0/613246674 shutdown_connections 2024-08-20T01:40:02.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.926+0000 7f023de29740 1 -- 172.21.15.79:0/613246674 wait complete. 2024-08-20T01:40:02.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.926+0000 7f023de29740 1 -- start start 2024-08-20T01:40:02.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.926+0000 7f0238cf8640 1 --2- 172.21.15.79:0/2374782646 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f02240b3c50 0x7f02240b6110 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0228006010 tx=0x7f0228031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:02.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.926+0000 7f023de29740 1 Processor -- start 2024-08-20T01:40:02.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.927+0000 7f023de29740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de82bbd630 0x55de82bc6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:02.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.927+0000 7f023de29740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de82bbff60 0x55de82bc7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:02.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.927+0000 7f023de29740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de82bc29a0 0x55de82bc8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:02.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.927+0000 7f023de29740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55de82a58ab0 con 0x55de82bbd630 2024-08-20T01:40:02.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.927+0000 7f023de29740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55de82aa6780 con 0x55de82bbff60 2024-08-20T01:40:02.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.927+0000 7f023de29740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55de82bc5980 con 0x55de82bc29a0 2024-08-20T01:40:02.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.927+0000 7f023de29740 10 client.0 _ll_register_callbacks cb 0x55de8282ea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:02.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.927+0000 7f0238cf8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de82bbd630 0x55de82bc6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:02.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.927+0000 7f0238cf8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de82bbd630 0x55de82bc6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60130/0 (socket says 172.21.15.79:60130) 2024-08-20T01:40:02.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.927+0000 7f0238cf8640 1 -- 172.21.15.79:0/930305073 learned_addr learned my addr 172.21.15.79:0/930305073 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:02.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.927+0000 7f0233fff640 1 --2- 172.21.15.79:0/930305073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de82bbff60 0x55de82bc7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:02.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.927+0000 7f02394f9640 1 --2- 172.21.15.79:0/930305073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de82bc29a0 0x55de82bc8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:02.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.927+0000 7f0238cf8640 1 -- 172.21.15.79:0/930305073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de82bc29a0 msgr2=0x55de82bc8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:02.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.927+0000 7f0238cf8640 1 --2- 172.21.15.79:0/930305073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de82bc29a0 0x55de82bc8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.927+0000 7f0238cf8640 1 -- 172.21.15.79:0/930305073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de82bbff60 msgr2=0x55de82bc7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:02.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.927+0000 7f0238cf8640 1 --2- 172.21.15.79:0/930305073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de82bbff60 0x55de82bc7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.936 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.927+0000 7f0238cf8640 1 -- 172.21.15.79:0/930305073 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de82882790 con 0x55de82bbd630 2024-08-20T01:40:02.936 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.927+0000 7f0238cf8640 1 --2- 172.21.15.79:0/930305073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de82bbd630 0x55de82bc6df0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f0228009930 tx=0x7f0228009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac174ecbac11a709 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:02.936 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.927+0000 7f0213fff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:40:02.936 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.928+0000 7f0213fff640 1 -- 172.21.15.79:0/930305073 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0228035040 con 0x55de82bbd630 2024-08-20T01:40:02.936 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.928+0000 7f0213fff640 1 -- 172.21.15.79:0/930305073 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f02280037f0 con 0x55de82bbd630 2024-08-20T01:40:02.936 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.928+0000 7f023de29740 1 -- 172.21.15.79:0/930305073 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55de82acee00 con 0x55de82bbd630 2024-08-20T01:40:02.936 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.928+0000 7f0213fff640 1 -- 172.21.15.79:0/930305073 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f02280039f0 con 0x55de82bbd630 2024-08-20T01:40:02.936 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.928+0000 7f023de29740 10 client.16485 fetch_fsmap learned FSMap version 33 2024-08-20T01:40:02.936 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.928+0000 7f023de29740 1 -- 172.21.15.79:0/930305073 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55de828fb620 con 0x55de82bbd630 2024-08-20T01:40:02.936 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.928+0000 7f0213fff640 1 -- 172.21.15.79:0/930305073 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55de82acee00 con 0x55de82bbd630 2024-08-20T01:40:02.936 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.928+0000 7f0213fff640 1 -- 172.21.15.79:0/930305073 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7f0228059020 con 0x55de82bbd630 2024-08-20T01:40:02.936 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.928+0000 7f023de29740 10 client.16485 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:40:02.936 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.928+0000 7f023de29740 10 client.16485 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:40:02.937 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.928+0000 7f023de29740 20 client.16485 populate_metadata read hostname 'smithi079' 2024-08-20T01:40:02.937 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.928+0000 7f023de29740 1 --2- 172.21.15.79:0/930305073 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55de82bd2720 0x55de82bd4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:02.937 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.928+0000 7f023de29740 4 client.16485 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:40:02.937 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.928+0000 7f023de29740 1 -- 172.21.15.79:0/930305073 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de82b322b0 con 0x55de82bd2720 2024-08-20T01:40:02.937 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.929+0000 7f0233fff640 1 --2- 172.21.15.79:0/930305073 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55de82bd2720 0x55de82bd4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:02.937 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.929+0000 7f0233fff640 1 --2- 172.21.15.79:0/930305073 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55de82bd2720 0x55de82bd4ba0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0e8b72a5902c681 server_cookie=5fcdfb5219274638 in_seq=0 out_seq=0 2024-08-20T01:40:02.937 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.929+0000 7f0213fff640 10 client.16485 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:02.937 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.930+0000 7f0213fff640 1 -- 172.21.15.79:0/930305073 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55de82b322b0 con 0x55de82bd2720 2024-08-20T01:40:02.937 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.930+0000 7f0213fff640 10 client.16485 handle_command_reply: tid=0 2024-08-20T01:40:02.937 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.930+0000 7f023de29740 1 client.16485 shutdown 2024-08-20T01:40:02.937 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.930+0000 7f023de29740 1 -- 172.21.15.79:0/930305073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de82bbd630 msgr2=0x55de82bc6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:02.937 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.930+0000 7f023de29740 1 --2- 172.21.15.79:0/930305073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de82bbd630 0x55de82bc6df0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f0228009930 tx=0x7f0228009260 comp rx=0 tx=0).stop 2024-08-20T01:40:02.937 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.930+0000 7f023de29740 1 -- 172.21.15.79:0/930305073 shutdown_connections 2024-08-20T01:40:02.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.930+0000 7f023de29740 1 --2- 172.21.15.79:0/930305073 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55de82bd2720 0x55de82bd4ba0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.930+0000 7f023de29740 1 --2- 172.21.15.79:0/930305073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de82bc29a0 0x55de82bc8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.930+0000 7f023de29740 1 --2- 172.21.15.79:0/930305073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de82bbff60 0x55de82bc7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.930+0000 7f023de29740 1 --2- 172.21.15.79:0/930305073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de82bbd630 0x55de82bc6df0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.930+0000 7f023de29740 1 -- 172.21.15.79:0/930305073 >> 172.21.15.79:0/930305073 conn(0x55de82bb8730 msgr2=0x55de82bb7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:02.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.930+0000 7f0213fff640 0 client.16485 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:02.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.930+0000 7f023de29740 1 -- 172.21.15.79:0/930305073 shutdown_connections 2024-08-20T01:40:02.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.930+0000 7f023de29740 1 -- 172.21.15.79:0/930305073 wait complete. 2024-08-20T01:40:02.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.930+0000 7f023de29740 20 client.16485 trim_cache size 0 max 16384 2024-08-20T01:40:02.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.949+0000 7f023de29740 1 Processor -- start 2024-08-20T01:40:02.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.949+0000 7f023de29740 1 -- start start 2024-08-20T01:40:02.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.949+0000 7f023de29740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de82bbd630 0x55de82bd4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:02.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.949+0000 7f023de29740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de82bbff60 0x55de82bbcb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:02.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.949+0000 7f023de29740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de82bc29a0 0x55de82bbd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:02.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.949+0000 7f023de29740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f02341b8ad0 con 0x55de82bbff60 2024-08-20T01:40:02.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.949+0000 7f023de29740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f02341ba760 con 0x55de82bc29a0 2024-08-20T01:40:02.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.949+0000 7f023de29740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f02341b91a0 con 0x55de82bbd630 2024-08-20T01:40:02.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.949+0000 7f0233fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de82bbff60 0x55de82bbcb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:02.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.949+0000 7f0233fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de82bbff60 0x55de82bbcb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60134/0 (socket says 172.21.15.79:60134) 2024-08-20T01:40:02.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.949+0000 7f0233fff640 1 -- 172.21.15.79:0/4059188580 learned_addr learned my addr 172.21.15.79:0/4059188580 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:02.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.949+0000 7f0238cf8640 1 --2- 172.21.15.79:0/4059188580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de82bbd630 0x55de82bd4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:02.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.949+0000 7f02394f9640 1 --2- 172.21.15.79:0/4059188580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de82bc29a0 0x55de82bbd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:02.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.950+0000 7f0233fff640 1 -- 172.21.15.79:0/4059188580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de82bbd630 msgr2=0x55de82bd4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:02.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.950+0000 7f0233fff640 1 --2- 172.21.15.79:0/4059188580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de82bbd630 0x55de82bd4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.950+0000 7f0233fff640 1 -- 172.21.15.79:0/4059188580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de82bc29a0 msgr2=0x55de82bbd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:02.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.950+0000 7f0233fff640 1 --2- 172.21.15.79:0/4059188580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de82bc29a0 0x55de82bbd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.950+0000 7f0233fff640 1 -- 172.21.15.79:0/4059188580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de82bc68f0 con 0x55de82bbff60 2024-08-20T01:40:02.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.950+0000 7f02394f9640 1 --2- 172.21.15.79:0/4059188580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de82bc29a0 0x55de82bbd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:40:02.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.950+0000 7f0233fff640 1 --2- 172.21.15.79:0/4059188580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de82bbff60 0x55de82bbcb50 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f02200aa3e0 tx=0x7f02200e1160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f56f219cd071461 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:02.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.950+0000 7f021e7fc640 1 -- 172.21.15.79:0/4059188580 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0220020040 con 0x55de82bbff60 2024-08-20T01:40:02.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.950+0000 7f021e7fc640 1 -- 172.21.15.79:0/4059188580 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f02200aa6e0 con 0x55de82bbff60 2024-08-20T01:40:02.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.950+0000 7f021e7fc640 1 -- 172.21.15.79:0/4059188580 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02200e13a0 con 0x55de82bbff60 2024-08-20T01:40:02.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.951+0000 7f023de29740 1 -- 172.21.15.79:0/4059188580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de82bbff60 msgr2=0x55de82bbcb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:02.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.951+0000 7f023de29740 1 --2- 172.21.15.79:0/4059188580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de82bbff60 0x55de82bbcb50 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f02200aa3e0 tx=0x7f02200e1160 comp rx=0 tx=0).stop 2024-08-20T01:40:02.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.951+0000 7f023de29740 1 -- 172.21.15.79:0/4059188580 shutdown_connections 2024-08-20T01:40:02.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.951+0000 7f023de29740 1 --2- 172.21.15.79:0/4059188580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de82bc29a0 0x55de82bbd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.951+0000 7f023de29740 1 --2- 172.21.15.79:0/4059188580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de82bbff60 0x55de82bbcb50 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.951+0000 7f023de29740 1 --2- 172.21.15.79:0/4059188580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de82bbd630 0x55de82bd4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.951+0000 7f023de29740 1 -- 172.21.15.79:0/4059188580 >> 172.21.15.79:0/4059188580 conn(0x55de82bb8730 msgr2=0x55de82bc6b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:02.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.951+0000 7f023de29740 1 -- 172.21.15.79:0/4059188580 shutdown_connections 2024-08-20T01:40:02.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.951+0000 7f023de29740 1 -- 172.21.15.79:0/4059188580 wait complete. 2024-08-20T01:40:02.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.951+0000 7f023de29740 1 -- start start 2024-08-20T01:40:02.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.951+0000 7f023de29740 1 Processor -- start 2024-08-20T01:40:02.958 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.952+0000 7f023de29740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de82bbd630 0x55de82bcb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:02.958 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.952+0000 7f023de29740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de82bbff60 0x55de82bcbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:02.958 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.952+0000 7f023de29740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de82bc29a0 0x55de82bcc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:02.958 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.952+0000 7f023de29740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f02341b9fd0 con 0x55de82bc29a0 2024-08-20T01:40:02.958 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.952+0000 7f023de29740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f02341b9870 con 0x55de82bbd630 2024-08-20T01:40:02.958 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.952+0000 7f023de29740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f02341a3ad0 con 0x55de82bbff60 2024-08-20T01:40:02.958 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.952+0000 7f023de29740 10 client.0 _ll_register_callbacks cb 0x7f0228009610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:02.958 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.952+0000 7f02394f9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de82bc29a0 0x55de82bcc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:02.958 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.952+0000 7f02394f9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de82bc29a0 0x55de82bcc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60146/0 (socket says 172.21.15.79:60146) 2024-08-20T01:40:02.959 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.952+0000 7f02394f9640 1 -- 172.21.15.79:0/392250074 learned_addr learned my addr 172.21.15.79:0/392250074 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:02.959 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.952+0000 7f0233fff640 1 --2- 172.21.15.79:0/392250074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de82bbff60 0x55de82bcbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:02.959 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.952+0000 7f0238cf8640 1 --2- 172.21.15.79:0/392250074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de82bbd630 0x55de82bcb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:02.959 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.952+0000 7f02394f9640 1 -- 172.21.15.79:0/392250074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de82bbff60 msgr2=0x55de82bcbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:02.959 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.952+0000 7f02394f9640 1 --2- 172.21.15.79:0/392250074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de82bbff60 0x55de82bcbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.959 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.952+0000 7f02394f9640 1 -- 172.21.15.79:0/392250074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de82bbd630 msgr2=0x55de82bcb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:02.959 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.952+0000 7f02394f9640 1 --2- 172.21.15.79:0/392250074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de82bbd630 0x55de82bcb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.959 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.952+0000 7f02394f9640 1 -- 172.21.15.79:0/392250074 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de82bc5d80 con 0x55de82bc29a0 2024-08-20T01:40:02.959 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.952+0000 7f0233fff640 1 --2- 172.21.15.79:0/392250074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de82bbff60 0x55de82bcbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:40:02.959 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.952+0000 7f02394f9640 1 --2- 172.21.15.79:0/392250074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de82bc29a0 0x55de82bcc690 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f022c000f80 tx=0x7f022c012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6542caee732bfbb server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:02.959 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.952+0000 7f0213fff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:40:02.959 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.952+0000 7f0213fff640 1 -- 172.21.15.79:0/392250074 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f022c0255f0 con 0x55de82bc29a0 2024-08-20T01:40:02.960 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.952+0000 7f0213fff640 1 -- 172.21.15.79:0/392250074 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f022c025790 con 0x55de82bc29a0 2024-08-20T01:40:02.960 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.952+0000 7f023de29740 1 -- 172.21.15.79:0/392250074 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02200aa6e0 con 0x55de82bc29a0 2024-08-20T01:40:02.960 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.953+0000 7f0213fff640 1 -- 172.21.15.79:0/392250074 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f022c025990 con 0x55de82bc29a0 2024-08-20T01:40:02.960 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.953+0000 7f023de29740 10 client.16491 fetch_fsmap learned FSMap version 33 2024-08-20T01:40:02.960 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.953+0000 7f023de29740 1 -- 172.21.15.79:0/392250074 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55de82bc8640 con 0x55de82bc29a0 2024-08-20T01:40:02.960 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.953+0000 7f0213fff640 1 -- 172.21.15.79:0/392250074 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f02200aa6e0 con 0x55de82bc29a0 2024-08-20T01:40:02.960 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.953+0000 7f0213fff640 1 -- 172.21.15.79:0/392250074 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7f022c011070 con 0x55de82bc29a0 2024-08-20T01:40:02.960 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.953+0000 7f023de29740 10 client.16491 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:40:02.960 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.953+0000 7f023de29740 10 client.16491 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:40:02.960 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.953+0000 7f023de29740 20 client.16491 populate_metadata read hostname 'smithi079' 2024-08-20T01:40:02.960 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.953+0000 7f023de29740 1 --2- 172.21.15.79:0/392250074 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55de82bce820 0x55de82c3f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:02.960 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.953+0000 7f023de29740 4 client.16491 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:40:02.961 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.953+0000 7f023de29740 1 -- 172.21.15.79:0/392250074 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55de82b2dd50 con 0x55de82bce820 2024-08-20T01:40:02.961 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.953+0000 7f0238cf8640 1 --2- 172.21.15.79:0/392250074 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55de82bce820 0x55de82c3f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:02.961 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.954+0000 7f0238cf8640 1 --2- 172.21.15.79:0/392250074 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55de82bce820 0x55de82c3f450 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3f64c832e5c805d server_cookie=3c4246fb557bf84f in_seq=0 out_seq=0 2024-08-20T01:40:02.961 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.954+0000 7f0213fff640 10 client.16491 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:02.964 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.961+0000 7f0213fff640 1 -- 172.21.15.79:0/392250074 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55de82b2dd50 con 0x55de82bce820 2024-08-20T01:40:02.964 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.961+0000 7f0213fff640 10 client.16491 handle_command_reply: tid=0 2024-08-20T01:40:02.964 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.961+0000 7f023de29740 1 client.16491 shutdown 2024-08-20T01:40:02.964 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.961+0000 7f023de29740 1 -- 172.21.15.79:0/392250074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de82bc29a0 msgr2=0x55de82bcc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:02.964 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.961+0000 7f023de29740 1 --2- 172.21.15.79:0/392250074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de82bc29a0 0x55de82bcc690 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f022c000f80 tx=0x7f022c012bc0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.964 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.961+0000 7f023de29740 1 -- 172.21.15.79:0/392250074 shutdown_connections 2024-08-20T01:40:02.964 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.961+0000 7f023de29740 1 --2- 172.21.15.79:0/392250074 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55de82bce820 0x55de82c3f450 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.964 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.961+0000 7f023de29740 1 --2- 172.21.15.79:0/392250074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de82bc29a0 0x55de82bcc690 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.964 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.961+0000 7f023de29740 1 --2- 172.21.15.79:0/392250074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de82bbff60 0x55de82bcbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.964 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.961+0000 7f023de29740 1 --2- 172.21.15.79:0/392250074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de82bbd630 0x55de82bcb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.964 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.961+0000 7f023de29740 1 -- 172.21.15.79:0/392250074 >> 172.21.15.79:0/392250074 conn(0x55de82bb8730 msgr2=0x55de82bd4730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:02.964 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.961+0000 7f0213fff640 0 client.16491 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:02.965 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.961+0000 7f023de29740 1 -- 172.21.15.79:0/392250074 shutdown_connections 2024-08-20T01:40:02.965 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.961+0000 7f023de29740 1 -- 172.21.15.79:0/392250074 wait complete. 2024-08-20T01:40:02.965 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.961+0000 7f023de29740 20 client.16491 trim_cache size 0 max 16384 2024-08-20T01:40:02.965 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:40:02.965 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:40:02.965 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:40:02.965 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:40:02.966 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.962+0000 7f023af5c640 1 -- 172.21.15.79:0/2374782646 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f02240b3c50 msgr2=0x7f02240b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:02.966 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.962+0000 7f023af5c640 1 --2- 172.21.15.79:0/2374782646 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f02240b3c50 0x7f02240b6110 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0228006010 tx=0x7f0228031400 comp rx=0 tx=0).stop 2024-08-20T01:40:02.966 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.962+0000 7f023af5c640 1 -- 172.21.15.79:0/2374782646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02341026b0 msgr2=0x7f0234103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:02.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.962+0000 7f023af5c640 1 --2- 172.21.15.79:0/2374782646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02341026b0 0x7f0234103ce0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f022000d950 tx=0x7f022000de10 comp rx=0 tx=0).stop 2024-08-20T01:40:02.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.962+0000 7f023af5c640 1 -- 172.21.15.79:0/2374782646 shutdown_connections 2024-08-20T01:40:02.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.962+0000 7f023af5c640 1 --2- 172.21.15.79:0/2374782646 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f02240b3c50 0x7f02240b6110 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.962+0000 7f023af5c640 1 --2- 172.21.15.79:0/2374782646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0234103070 0x7f0234104220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.962+0000 7f023af5c640 1 --2- 172.21.15.79:0/2374782646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02341026b0 0x7f0234103ce0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.962+0000 7f023af5c640 1 --2- 172.21.15.79:0/2374782646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0234101560 0x7f0234105480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:02.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.962+0000 7f023af5c640 1 -- 172.21.15.79:0/2374782646 >> 172.21.15.79:0/2374782646 conn(0x7f02340fce40 msgr2=0x7f023406a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:02.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.962+0000 7f023af5c640 1 -- 172.21.15.79:0/2374782646 shutdown_connections 2024-08-20T01:40:02.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:02.962+0000 7f023af5c640 1 -- 172.21.15.79:0/2374782646 wait complete. 2024-08-20T01:40:04.125 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T01:40:04.125 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T01:40:04.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:03 smithi079 ceph-mon[18656]: pgmap v429: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-08-20T01:40:04.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:03 smithi081 ceph-mon[22209]: pgmap v429: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-08-20T01:40:04.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:03 smithi175 ceph-mon[22392]: pgmap v429: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-08-20T01:40:04.395 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:40:04.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.935+0000 7fc7cbf55640 1 -- 172.21.15.79:0/3364906296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7c410ce00 msgr2=0x7fc7c410f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:04.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.935+0000 7fc7cbf55640 1 --2- 172.21.15.79:0/3364906296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7c410ce00 0x7fc7c410f260 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009ca0 tx=0x7fc7bc02a8c0 comp rx=0 tx=0).stop 2024-08-20T01:40:04.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.935+0000 7fc7cbf55640 1 -- 172.21.15.79:0/3364906296 shutdown_connections 2024-08-20T01:40:04.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.935+0000 7fc7cbf55640 1 --2- 172.21.15.79:0/3364906296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7c410ce00 0x7fc7c410f260 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:04.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.935+0000 7fc7cbf55640 1 --2- 172.21.15.79:0/3364906296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7c41042c0 0x7fc7c410c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:04.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.935+0000 7fc7cbf55640 1 --2- 172.21.15.79:0/3364906296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7c41039a0 0x7fc7c4103d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:04.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.935+0000 7fc7cbf55640 1 -- 172.21.15.79:0/3364906296 >> 172.21.15.79:0/3364906296 conn(0x7fc7c40fd400 msgr2=0x7fc7c40ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:04.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.935+0000 7fc7cbf55640 1 -- 172.21.15.79:0/3364906296 shutdown_connections 2024-08-20T01:40:04.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.935+0000 7fc7cbf55640 1 -- 172.21.15.79:0/3364906296 wait complete. 2024-08-20T01:40:04.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.936+0000 7fc7cbf55640 1 Processor -- start 2024-08-20T01:40:04.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.936+0000 7fc7cbf55640 1 -- start start 2024-08-20T01:40:04.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.936+0000 7fc7cbf55640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7c41039a0 0x7fc7c4198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:04.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.936+0000 7fc7cbf55640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7c41042c0 0x7fc7c4199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:04.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.936+0000 7fc7cbf55640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7c410ce00 0x7fc7c419e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:04.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.936+0000 7fc7cbf55640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c4112970 con 0x7fc7c410ce00 2024-08-20T01:40:04.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.936+0000 7fc7cbf55640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c41127f0 con 0x7fc7c41039a0 2024-08-20T01:40:04.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.936+0000 7fc7cbf55640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c4112af0 con 0x7fc7c41042c0 2024-08-20T01:40:04.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.936+0000 7fc7ca4f2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7c410ce00 0x7fc7c419e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:04.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.936+0000 7fc7ca4f2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7c410ce00 0x7fc7c419e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60162/0 (socket says 172.21.15.79:60162) 2024-08-20T01:40:04.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.936+0000 7fc7ca4f2640 1 -- 172.21.15.79:0/3507951696 learned_addr learned my addr 172.21.15.79:0/3507951696 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:04.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.936+0000 7fc7c94f0640 1 --2- 172.21.15.79:0/3507951696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7c41042c0 0x7fc7c4199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:04.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.936+0000 7fc7c9cf1640 1 --2- 172.21.15.79:0/3507951696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7c41039a0 0x7fc7c4198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:04.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.937+0000 7fc7ca4f2640 1 -- 172.21.15.79:0/3507951696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7c41042c0 msgr2=0x7fc7c4199380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:04.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.937+0000 7fc7ca4f2640 1 --2- 172.21.15.79:0/3507951696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7c41042c0 0x7fc7c4199380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:04.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.937+0000 7fc7ca4f2640 1 -- 172.21.15.79:0/3507951696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7c41039a0 msgr2=0x7fc7c4198e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:04.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.937+0000 7fc7ca4f2640 1 --2- 172.21.15.79:0/3507951696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7c41039a0 0x7fc7c4198e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:04.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.937+0000 7fc7ca4f2640 1 -- 172.21.15.79:0/3507951696 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7c419eef0 con 0x7fc7c410ce00 2024-08-20T01:40:04.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.937+0000 7fc7ca4f2640 1 --2- 172.21.15.79:0/3507951696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7c410ce00 0x7fc7c419e720 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc005cc0 tx=0x7fc7bc032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:04.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.937+0000 7fc7baffd640 1 -- 172.21.15.79:0/3507951696 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc032e00 con 0x7fc7c410ce00 2024-08-20T01:40:04.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.937+0000 7fc7baffd640 1 -- 172.21.15.79:0/3507951696 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc7bc0044d0 con 0x7fc7c410ce00 2024-08-20T01:40:04.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.937+0000 7fc7cbf55640 1 -- 172.21.15.79:0/3507951696 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7c419f180 con 0x7fc7c410ce00 2024-08-20T01:40:04.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.937+0000 7fc7baffd640 1 -- 172.21.15.79:0/3507951696 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc030b70 con 0x7fc7c410ce00 2024-08-20T01:40:04.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.937+0000 7fc7cbf55640 1 -- 172.21.15.79:0/3507951696 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7c41a58a0 con 0x7fc7c410ce00 2024-08-20T01:40:04.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.940+0000 7fc7baffd640 1 -- 172.21.15.79:0/3507951696 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc7bc004680 con 0x7fc7c410ce00 2024-08-20T01:40:04.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.940+0000 7fc7ce34e740 1 Processor -- start 2024-08-20T01:40:04.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.940+0000 7fc7ce34e740 1 -- start start 2024-08-20T01:40:04.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.941+0000 7fc7ce34e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a0f4a43b0 0x557a0f4a4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:04.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.941+0000 7fc7ce34e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a0f4a4cd0 0x557a0f4b0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:04.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.941+0000 7fc7ce34e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a0f4b0c60 0x557a0f4b3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:04.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.941+0000 7fc7ce34e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557a0f41a940 con 0x557a0f4b0c60 2024-08-20T01:40:04.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.941+0000 7fc7ce34e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557a0f409e40 con 0x557a0f4a4cd0 2024-08-20T01:40:04.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.941+0000 7fc7ce34e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557a0f40de80 con 0x557a0f4a43b0 2024-08-20T01:40:04.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.941+0000 7fc7c94f0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a0f4b0c60 0x557a0f4b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:04.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.941+0000 7fc7c94f0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a0f4b0c60 0x557a0f4b3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60168/0 (socket says 172.21.15.79:60168) 2024-08-20T01:40:04.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.941+0000 7fc7c94f0640 1 -- 172.21.15.79:0/222873458 learned_addr learned my addr 172.21.15.79:0/222873458 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:04.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.941+0000 7fc7c9cf1640 1 --2- 172.21.15.79:0/222873458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a0f4a4cd0 0x557a0f4b0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:04.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.941+0000 7fc7c94f0640 1 --2- 172.21.15.79:0/222873458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a0f4a43b0 0x557a0f4a4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:04.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.941+0000 7fc7c94f0640 1 -- 172.21.15.79:0/222873458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a0f4a43b0 msgr2=0x557a0f4a4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:04.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.941+0000 7fc7c94f0640 1 --2- 172.21.15.79:0/222873458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a0f4a43b0 0x557a0f4a4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:04.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.941+0000 7fc7baffd640 1 --2- 172.21.15.79:0/3507951696 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc7b00b3bd0 0x7fc7b00b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:04.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.941+0000 7fc7c94f0640 1 -- 172.21.15.79:0/222873458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a0f4a4cd0 msgr2=0x557a0f4b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:04.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.941+0000 7fc7c94f0640 1 --2- 172.21.15.79:0/222873458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a0f4a4cd0 0x557a0f4b0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:04.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.941+0000 7fc7c94f0640 1 -- 172.21.15.79:0/222873458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a0f3a6520 con 0x557a0f4b0c60 2024-08-20T01:40:04.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.941+0000 7fc7c9cf1640 1 --2- 172.21.15.79:0/222873458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a0f4a4cd0 0x557a0f4b0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:40:04.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.941+0000 7fc7c94f0640 1 --2- 172.21.15.79:0/222873458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a0f4b0c60 0x557a0f4b3050 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fc7b40127b0 tx=0x7fc7b400b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d52614be19a2a40c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:04.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.941+0000 7fc7baffd640 1 -- 172.21.15.79:0/3507951696 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc7bc105010 con 0x7fc7c410ce00 2024-08-20T01:40:04.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.942+0000 7fc7affff640 1 -- 172.21.15.79:0/222873458 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b4004020 con 0x557a0f4b0c60 2024-08-20T01:40:04.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.942+0000 7fc7affff640 1 -- 172.21.15.79:0/222873458 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc7b4010c00 con 0x557a0f4b0c60 2024-08-20T01:40:04.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.942+0000 7fc7affff640 1 -- 172.21.15.79:0/222873458 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b4003850 con 0x557a0f4b0c60 2024-08-20T01:40:04.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.942+0000 7fc7ca4f2640 1 --2- 172.21.15.79:0/3507951696 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc7b00b3bd0 0x7fc7b00b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:04.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.942+0000 7fc7ce34e740 1 -- 172.21.15.79:0/222873458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a0f4b0c60 msgr2=0x557a0f4b3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:04.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.942+0000 7fc7ca4f2640 1 --2- 172.21.15.79:0/3507951696 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc7b00b3bd0 0x7fc7b00b6090 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009620 tx=0x7fc7bc004970 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:04.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.942+0000 7fc7ce34e740 1 --2- 172.21.15.79:0/222873458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a0f4b0c60 0x557a0f4b3050 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fc7b40127b0 tx=0x7fc7b400b9c0 comp rx=0 tx=0).stop 2024-08-20T01:40:04.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.943+0000 7fc7ce34e740 1 -- 172.21.15.79:0/222873458 shutdown_connections 2024-08-20T01:40:04.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.943+0000 7fc7ce34e740 1 --2- 172.21.15.79:0/222873458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a0f4b0c60 0x557a0f4b3050 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:04.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.943+0000 7fc7ce34e740 1 --2- 172.21.15.79:0/222873458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a0f4a4cd0 0x557a0f4b0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:04.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.943+0000 7fc7ce34e740 1 --2- 172.21.15.79:0/222873458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a0f4a43b0 0x557a0f4a4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:04.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.943+0000 7fc7ce34e740 1 -- 172.21.15.79:0/222873458 >> 172.21.15.79:0/222873458 conn(0x557a0f4a21e0 msgr2=0x557a0f4a3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:04.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.943+0000 7fc7ce34e740 1 -- 172.21.15.79:0/222873458 shutdown_connections 2024-08-20T01:40:04.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.943+0000 7fc7ce34e740 1 -- 172.21.15.79:0/222873458 wait complete. 2024-08-20T01:40:04.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.943+0000 7fc7ce34e740 1 -- start start 2024-08-20T01:40:04.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.943+0000 7fc7ce34e740 1 Processor -- start 2024-08-20T01:40:04.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.944+0000 7fc7ce34e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a0f4a43b0 0x557a0f4adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:04.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.944+0000 7fc7ce34e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a0f4a4cd0 0x557a0f4ae0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:04.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.944+0000 7fc7ce34e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a0f4b0c60 0x557a0f4ae630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:04.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.944+0000 7fc7ce34e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557a0f26c890 con 0x557a0f4b0c60 2024-08-20T01:40:04.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.944+0000 7fc7ce34e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557a0f390700 con 0x557a0f4a4cd0 2024-08-20T01:40:04.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.944+0000 7fc7ce34e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557a0f4b39b0 con 0x557a0f4a43b0 2024-08-20T01:40:04.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.944+0000 7fc7ce34e740 10 client.0 _ll_register_callbacks cb 0x557a0f4056f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:04.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.944+0000 7fc7c94f0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a0f4b0c60 0x557a0f4ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:04.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.944+0000 7fc7c94f0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a0f4b0c60 0x557a0f4ae630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60172/0 (socket says 172.21.15.79:60172) 2024-08-20T01:40:04.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.944+0000 7fc7c94f0640 1 -- 172.21.15.79:0/564325622 learned_addr learned my addr 172.21.15.79:0/564325622 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:04.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.944+0000 7fc7c9cf1640 1 --2- 172.21.15.79:0/564325622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a0f4a4cd0 0x557a0f4ae0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:04.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.944+0000 7fc7c94f0640 1 --2- 172.21.15.79:0/564325622 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a0f4a43b0 0x557a0f4adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:04.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.944+0000 7fc7c94f0640 1 -- 172.21.15.79:0/564325622 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a0f4a43b0 msgr2=0x557a0f4adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:04.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.944+0000 7fc7c94f0640 1 --2- 172.21.15.79:0/564325622 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a0f4a43b0 0x557a0f4adbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:04.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.944+0000 7fc7c94f0640 1 -- 172.21.15.79:0/564325622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a0f4a4cd0 msgr2=0x557a0f4ae0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:04.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.944+0000 7fc7c94f0640 1 --2- 172.21.15.79:0/564325622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a0f4a4cd0 0x557a0f4ae0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:04.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.944+0000 7fc7c94f0640 1 -- 172.21.15.79:0/564325622 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a0f169930 con 0x557a0f4b0c60 2024-08-20T01:40:04.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.945+0000 7fc7c94f0640 1 --2- 172.21.15.79:0/564325622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a0f4b0c60 0x557a0f4ae630 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4004650 tx=0x7fc7b401b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d870505a8998f829 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:04.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.945+0000 7fc7ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:40:04.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.945+0000 7fc7ad7fa640 1 -- 172.21.15.79:0/564325622 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b4010770 con 0x557a0f4b0c60 2024-08-20T01:40:04.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.945+0000 7fc7ce34e740 1 -- 172.21.15.79:0/564325622 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7b4010c00 con 0x557a0f4b0c60 2024-08-20T01:40:04.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.945+0000 7fc7ad7fa640 1 -- 172.21.15.79:0/564325622 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc7b4010910 con 0x557a0f4b0c60 2024-08-20T01:40:04.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.945+0000 7fc7ad7fa640 1 -- 172.21.15.79:0/564325622 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fc7b4005030 con 0x557a0f4b0c60 2024-08-20T01:40:04.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.945+0000 7fc7ce34e740 10 client.16503 fetch_fsmap learned FSMap version 33 2024-08-20T01:40:04.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.945+0000 7fc7ce34e740 1 -- 172.21.15.79:0/564325622 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x557a0f4bf520 con 0x557a0f4b0c60 2024-08-20T01:40:04.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.945+0000 7fc7ad7fa640 1 -- 172.21.15.79:0/564325622 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc7b4010c00 con 0x557a0f4b0c60 2024-08-20T01:40:04.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.946+0000 7fc7ad7fa640 1 -- 172.21.15.79:0/564325622 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7fc7b40049f0 con 0x557a0f4b0c60 2024-08-20T01:40:04.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.946+0000 7fc7ce34e740 10 client.16503 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:40:04.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.946+0000 7fc7ce34e740 10 client.16503 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:40:04.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.946+0000 7fc7ce34e740 20 client.16503 populate_metadata read hostname 'smithi079' 2024-08-20T01:40:04.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.946+0000 7fc7ce34e740 1 --2- 172.21.15.79:0/564325622 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557a0f4c0cd0 0x557a0f4c30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:04.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.946+0000 7fc7ce34e740 4 client.16503 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:40:04.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.946+0000 7fc7ce34e740 1 -- 172.21.15.79:0/564325622 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a0f41c890 con 0x557a0f4c0cd0 2024-08-20T01:40:04.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.946+0000 7fc7c9cf1640 1 --2- 172.21.15.79:0/564325622 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557a0f4c0cd0 0x557a0f4c30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:04.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.946+0000 7fc7ad7fa640 10 client.16503 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:04.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.946+0000 7fc7c9cf1640 1 --2- 172.21.15.79:0/564325622 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557a0f4c0cd0 0x557a0f4c30f0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=573a5ebc155af66a server_cookie=b7e77f619f1c8083 in_seq=0 out_seq=0 2024-08-20T01:40:04.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.947+0000 7fc7ad7fa640 1 -- 172.21.15.79:0/564325622 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557a0f41c890 con 0x557a0f4c0cd0 2024-08-20T01:40:04.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.947+0000 7fc7ad7fa640 10 client.16503 handle_command_reply: tid=0 2024-08-20T01:40:04.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.947+0000 7fc7ce34e740 1 client.16503 shutdown 2024-08-20T01:40:04.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.947+0000 7fc7ce34e740 1 -- 172.21.15.79:0/564325622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a0f4b0c60 msgr2=0x557a0f4ae630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:04.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.947+0000 7fc7ce34e740 1 --2- 172.21.15.79:0/564325622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a0f4b0c60 0x557a0f4ae630 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4004650 tx=0x7fc7b401b040 comp rx=0 tx=0).stop 2024-08-20T01:40:04.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.947+0000 7fc7ce34e740 1 -- 172.21.15.79:0/564325622 shutdown_connections 2024-08-20T01:40:04.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.947+0000 7fc7ce34e740 1 --2- 172.21.15.79:0/564325622 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557a0f4c0cd0 0x557a0f4c30f0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:04.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.947+0000 7fc7ce34e740 1 --2- 172.21.15.79:0/564325622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a0f4b0c60 0x557a0f4ae630 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:04.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.947+0000 7fc7ad7fa640 0 client.16503 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:04.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.947+0000 7fc7ce34e740 1 --2- 172.21.15.79:0/564325622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a0f4a4cd0 0x557a0f4ae0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:04.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.947+0000 7fc7ce34e740 1 --2- 172.21.15.79:0/564325622 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a0f4a43b0 0x557a0f4adbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:04.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.947+0000 7fc7ce34e740 1 -- 172.21.15.79:0/564325622 >> 172.21.15.79:0/564325622 conn(0x557a0f4a21e0 msgr2=0x557a0f4a7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:04.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.948+0000 7fc7ce34e740 1 -- 172.21.15.79:0/564325622 shutdown_connections 2024-08-20T01:40:04.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.948+0000 7fc7ce34e740 1 -- 172.21.15.79:0/564325622 wait complete. 2024-08-20T01:40:04.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.948+0000 7fc7ce34e740 20 client.16503 trim_cache size 0 max 16384 2024-08-20T01:40:04.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.970+0000 7fc7ce34e740 1 Processor -- start 2024-08-20T01:40:04.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.970+0000 7fc7ce34e740 1 -- start start 2024-08-20T01:40:04.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.970+0000 7fc7ce34e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a0f4a43b0 0x557a0f4a8570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:04.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.970+0000 7fc7ce34e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a0f4a4cd0 0x557a0f4c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:04.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.970+0000 7fc7ce34e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a0f4b0c60 0x557a0f4c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:04.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.970+0000 7fc7ce34e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c41b0130 con 0x557a0f4a4cd0 2024-08-20T01:40:04.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.970+0000 7fc7ce34e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c41b1dc0 con 0x557a0f4a43b0 2024-08-20T01:40:04.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.970+0000 7fc7ce34e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c41b0800 con 0x557a0f4b0c60 2024-08-20T01:40:04.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.970+0000 7fc7c9cf1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a0f4a4cd0 0x557a0f4c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:04.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.970+0000 7fc7c9cf1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a0f4a4cd0 0x557a0f4c89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60184/0 (socket says 172.21.15.79:60184) 2024-08-20T01:40:04.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.970+0000 7fc7c9cf1640 1 -- 172.21.15.79:0/3367919202 learned_addr learned my addr 172.21.15.79:0/3367919202 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:04.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.971+0000 7fc7c94f0640 1 --2- 172.21.15.79:0/3367919202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a0f4b0c60 0x557a0f4c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:04.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.971+0000 7fc7c94f0640 1 --2- 172.21.15.79:0/3367919202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a0f4a43b0 0x557a0f4a8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:04.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.971+0000 7fc7c9cf1640 1 -- 172.21.15.79:0/3367919202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a0f4b0c60 msgr2=0x557a0f4c8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:04.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.971+0000 7fc7c9cf1640 1 --2- 172.21.15.79:0/3367919202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a0f4b0c60 0x557a0f4c8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:04.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.971+0000 7fc7c9cf1640 1 -- 172.21.15.79:0/3367919202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a0f4a43b0 msgr2=0x557a0f4a8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:04.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.971+0000 7fc7c9cf1640 1 --2- 172.21.15.79:0/3367919202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a0f4a43b0 0x557a0f4a8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:04.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.971+0000 7fc7c9cf1640 1 -- 172.21.15.79:0/3367919202 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a0f4c3460 con 0x557a0f4a4cd0 2024-08-20T01:40:04.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.971+0000 7fc7c9cf1640 1 --2- 172.21.15.79:0/3367919202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a0f4a4cd0 0x557a0f4c89a0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x557a0f4c3940 tx=0x7fc7c000b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b4980f1403b9a6c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:04.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.971+0000 7fc7af7fe640 1 -- 172.21.15.79:0/3367919202 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c0011440 con 0x557a0f4a4cd0 2024-08-20T01:40:04.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.971+0000 7fc7af7fe640 1 -- 172.21.15.79:0/3367919202 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc7c0011a70 con 0x557a0f4a4cd0 2024-08-20T01:40:04.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.971+0000 7fc7af7fe640 1 -- 172.21.15.79:0/3367919202 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c001d8b0 con 0x557a0f4a4cd0 2024-08-20T01:40:04.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.972+0000 7fc7ce34e740 1 -- 172.21.15.79:0/3367919202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a0f4a4cd0 msgr2=0x557a0f4c89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:04.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.972+0000 7fc7ce34e740 1 --2- 172.21.15.79:0/3367919202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a0f4a4cd0 0x557a0f4c89a0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x557a0f4c3940 tx=0x7fc7c000b390 comp rx=0 tx=0).stop 2024-08-20T01:40:04.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.972+0000 7fc7ce34e740 1 -- 172.21.15.79:0/3367919202 shutdown_connections 2024-08-20T01:40:04.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.972+0000 7fc7ce34e740 1 --2- 172.21.15.79:0/3367919202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a0f4b0c60 0x557a0f4c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:04.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.972+0000 7fc7ce34e740 1 --2- 172.21.15.79:0/3367919202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a0f4a4cd0 0x557a0f4c89a0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:04.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.972+0000 7fc7ce34e740 1 --2- 172.21.15.79:0/3367919202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a0f4a43b0 0x557a0f4a8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:04.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.972+0000 7fc7ce34e740 1 -- 172.21.15.79:0/3367919202 >> 172.21.15.79:0/3367919202 conn(0x557a0f4a21e0 msgr2=0x557a0f4afa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:04.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.972+0000 7fc7ce34e740 1 -- 172.21.15.79:0/3367919202 shutdown_connections 2024-08-20T01:40:04.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.972+0000 7fc7ce34e740 1 -- 172.21.15.79:0/3367919202 wait complete. 2024-08-20T01:40:04.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.973+0000 7fc7ce34e740 1 -- start start 2024-08-20T01:40:04.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.973+0000 7fc7ce34e740 1 Processor -- start 2024-08-20T01:40:04.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.973+0000 7fc7ce34e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a0f4a43b0 0x557a0f4b5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:04.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.973+0000 7fc7ce34e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a0f4a4cd0 0x557a0f4b5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:04.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.973+0000 7fc7ce34e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a0f4b0c60 0x557a0f523930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:04.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.973+0000 7fc7ce34e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c41b1630 con 0x557a0f4b0c60 2024-08-20T01:40:04.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.973+0000 7fc7ce34e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c41b0ed0 con 0x557a0f4a43b0 2024-08-20T01:40:04.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.973+0000 7fc7ce34e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c41ae130 con 0x557a0f4a4cd0 2024-08-20T01:40:04.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.974+0000 7fc7ce34e740 10 client.0 _ll_register_callbacks cb 0x7fc7c0004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:04.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.974+0000 7fc7c94f0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a0f4a43b0 0x557a0f4b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:04.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.974+0000 7fc7c94f0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a0f4a43b0 0x557a0f4b5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:57526/0 (socket says 172.21.15.79:57526) 2024-08-20T01:40:04.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.974+0000 7fc7c94f0640 1 -- 172.21.15.79:0/521491818 learned_addr learned my addr 172.21.15.79:0/521491818 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:04.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.974+0000 7fc7c94f0640 1 --2- 172.21.15.79:0/521491818 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a0f4b0c60 0x557a0f523930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:04.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.974+0000 7fc7c9cf1640 1 --2- 172.21.15.79:0/521491818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a0f4a4cd0 0x557a0f4b5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:04.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.974+0000 7fc7c94f0640 1 -- 172.21.15.79:0/521491818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a0f4a4cd0 msgr2=0x557a0f4b5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:04.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.974+0000 7fc7c94f0640 1 --2- 172.21.15.79:0/521491818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a0f4a4cd0 0x557a0f4b5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:04.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.974+0000 7fc7c94f0640 1 -- 172.21.15.79:0/521491818 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a0f4b0c60 msgr2=0x557a0f523930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:04.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.974+0000 7fc7c94f0640 1 --2- 172.21.15.79:0/521491818 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a0f4b0c60 0x557a0f523930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:04.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.974+0000 7fc7c94f0640 1 -- 172.21.15.79:0/521491818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a0f524070 con 0x557a0f4a43b0 2024-08-20T01:40:04.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.974+0000 7fc7c94f0640 1 --2- 172.21.15.79:0/521491818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a0f4a43b0 0x557a0f4b5980 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4005940 tx=0x7fc7b4005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=217b6160507eeb64 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:04.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.974+0000 7fc7ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:40:04.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.974+0000 7fc7ad7fa640 1 -- 172.21.15.79:0/521491818 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b4005610 con 0x557a0f4a43b0 2024-08-20T01:40:04.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.975+0000 7fc7ad7fa640 1 -- 172.21.15.79:0/521491818 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc7b4004680 con 0x557a0f4a43b0 2024-08-20T01:40:04.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.975+0000 7fc7ce34e740 1 -- 172.21.15.79:0/521491818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7c0011a70 con 0x557a0f4a43b0 2024-08-20T01:40:04.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.975+0000 7fc7ad7fa640 1 -- 172.21.15.79:0/521491818 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fc7b4043070 con 0x557a0f4a43b0 2024-08-20T01:40:04.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.975+0000 7fc7ce34e740 10 client.25766 fetch_fsmap learned FSMap version 33 2024-08-20T01:40:04.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.975+0000 7fc7ce34e740 1 -- 172.21.15.79:0/521491818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x557a0f52b460 con 0x557a0f4a43b0 2024-08-20T01:40:04.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.975+0000 7fc7ad7fa640 1 -- 172.21.15.79:0/521491818 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc7c0011a70 con 0x557a0f4a43b0 2024-08-20T01:40:04.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.975+0000 7fc7ad7fa640 1 -- 172.21.15.79:0/521491818 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7fc7b4010740 con 0x557a0f4a43b0 2024-08-20T01:40:04.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.975+0000 7fc7ce34e740 10 client.25766 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:40:04.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.976+0000 7fc7ce34e740 10 client.25766 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:40:04.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.976+0000 7fc7ce34e740 20 client.25766 populate_metadata read hostname 'smithi079' 2024-08-20T01:40:04.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.976+0000 7fc7ce34e740 1 --2- 172.21.15.79:0/521491818 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557a0f52bb90 0x557a0f52dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:04.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.976+0000 7fc7ce34e740 4 client.25766 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T01:40:04.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.976+0000 7fc7ce34e740 1 -- 172.21.15.79:0/521491818 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557a0f418330 con 0x557a0f52bb90 2024-08-20T01:40:04.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.976+0000 7fc7c9cf1640 1 --2- 172.21.15.79:0/521491818 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557a0f52bb90 0x557a0f52dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:04.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.977+0000 7fc7c9cf1640 1 --2- 172.21.15.79:0/521491818 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557a0f52bb90 0x557a0f52dfb0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81e57f6c7c8daba6 server_cookie=195733e4f2c38ad7 in_seq=0 out_seq=0 2024-08-20T01:40:04.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.977+0000 7fc7ad7fa640 10 client.25766 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:04.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.979+0000 7fc7ad7fa640 1 -- 172.21.15.79:0/521491818 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557a0f418330 con 0x557a0f52bb90 2024-08-20T01:40:04.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.979+0000 7fc7ad7fa640 10 client.25766 handle_command_reply: tid=0 2024-08-20T01:40:04.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.979+0000 7fc7ce34e740 1 client.25766 shutdown 2024-08-20T01:40:04.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.979+0000 7fc7ce34e740 1 -- 172.21.15.79:0/521491818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a0f4a43b0 msgr2=0x557a0f4b5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:04.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.979+0000 7fc7ce34e740 1 --2- 172.21.15.79:0/521491818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a0f4a43b0 0x557a0f4b5980 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4005940 tx=0x7fc7b4005850 comp rx=0 tx=0).stop 2024-08-20T01:40:04.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.979+0000 7fc7ce34e740 1 -- 172.21.15.79:0/521491818 shutdown_connections 2024-08-20T01:40:04.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.979+0000 7fc7ce34e740 1 --2- 172.21.15.79:0/521491818 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557a0f52bb90 0x557a0f52dfb0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:04.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.979+0000 7fc7ad7fa640 0 client.25766 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:04.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.979+0000 7fc7ce34e740 1 --2- 172.21.15.79:0/521491818 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a0f4b0c60 0x557a0f523930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:04.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.979+0000 7fc7ce34e740 1 --2- 172.21.15.79:0/521491818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a0f4a4cd0 0x557a0f4b5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:04.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.979+0000 7fc7ce34e740 1 --2- 172.21.15.79:0/521491818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a0f4a43b0 0x557a0f4b5980 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:04.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.979+0000 7fc7ce34e740 1 -- 172.21.15.79:0/521491818 >> 172.21.15.79:0/521491818 conn(0x557a0f4a21e0 msgr2=0x557a0f4adb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:04.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.979+0000 7fc7ce34e740 1 -- 172.21.15.79:0/521491818 shutdown_connections 2024-08-20T01:40:04.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.979+0000 7fc7ce34e740 1 -- 172.21.15.79:0/521491818 wait complete. 2024-08-20T01:40:04.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.979+0000 7fc7ce34e740 20 client.25766 trim_cache size 0 max 16384 2024-08-20T01:40:04.984 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:40:04.984 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-08-20T01:40:04.984 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "0f8c74e8-cd51-4456-9ff0-4a29ba0b1942", 2024-08-20T01:40:04.984 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-08-20T01:40:04.984 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:40:04.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.980+0000 7fc7cbf55640 1 -- 172.21.15.79:0/3507951696 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc7b00b3bd0 msgr2=0x7fc7b00b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:04.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.980+0000 7fc7cbf55640 1 --2- 172.21.15.79:0/3507951696 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc7b00b3bd0 0x7fc7b00b6090 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009620 tx=0x7fc7bc004970 comp rx=0 tx=0).stop 2024-08-20T01:40:04.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.980+0000 7fc7cbf55640 1 -- 172.21.15.79:0/3507951696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7c410ce00 msgr2=0x7fc7c419e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:04.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.980+0000 7fc7cbf55640 1 --2- 172.21.15.79:0/3507951696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7c410ce00 0x7fc7c419e720 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc005cc0 tx=0x7fc7bc032a10 comp rx=0 tx=0).stop 2024-08-20T01:40:04.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.980+0000 7fc7cbf55640 1 -- 172.21.15.79:0/3507951696 shutdown_connections 2024-08-20T01:40:04.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.980+0000 7fc7cbf55640 1 --2- 172.21.15.79:0/3507951696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7c410ce00 0x7fc7c419e720 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:04.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.980+0000 7fc7cbf55640 1 --2- 172.21.15.79:0/3507951696 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc7b00b3bd0 0x7fc7b00b6090 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:04.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.980+0000 7fc7cbf55640 1 --2- 172.21.15.79:0/3507951696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7c41042c0 0x7fc7c4199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:04.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.980+0000 7fc7cbf55640 1 --2- 172.21.15.79:0/3507951696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7c41039a0 0x7fc7c4198e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:04.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.980+0000 7fc7cbf55640 1 -- 172.21.15.79:0/3507951696 >> 172.21.15.79:0/3507951696 conn(0x7fc7c40fd400 msgr2=0x7fc7c40fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:04.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.981+0000 7fc7cbf55640 1 -- 172.21.15.79:0/3507951696 shutdown_connections 2024-08-20T01:40:04.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:04.981+0000 7fc7cbf55640 1 -- 172.21.15.79:0/3507951696 wait complete. 2024-08-20T01:40:05.810 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:40:06.124 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:40:06.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:05 smithi079 ceph-mon[18656]: pgmap v430: 97 pgs: 97 active+clean; 3.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 32 MiB/s wr, 26 op/s 2024-08-20T01:40:06.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:05 smithi079 ceph-mon[18656]: scrub queued for path: / 2024-08-20T01:40:06.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:05 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:40:06.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:05 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:40:06.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:05 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:40:06.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:05 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:40:06.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:05 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:40:06.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:05 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:40:06.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:05 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:40:06.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:05 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:40:06.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:05 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:40:06.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:05 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:40:06.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:05 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:40:06.188 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:05 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:40:06.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:05 smithi081 ceph-mon[22209]: pgmap v430: 97 pgs: 97 active+clean; 3.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 32 MiB/s wr, 26 op/s 2024-08-20T01:40:06.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:05 smithi081 ceph-mon[22209]: scrub queued for path: / 2024-08-20T01:40:06.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:05 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:40:06.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:05 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:40:06.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:05 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:40:06.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:05 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:40:06.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:05 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:40:06.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:05 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:40:06.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:05 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:40:06.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:05 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:40:06.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:05 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:40:06.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:05 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:40:06.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:05 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:40:06.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:05 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:40:06.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:05 smithi175 ceph-mon[22392]: pgmap v430: 97 pgs: 97 active+clean; 3.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 32 MiB/s wr, 26 op/s 2024-08-20T01:40:06.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:05 smithi175 ceph-mon[22392]: scrub queued for path: / 2024-08-20T01:40:06.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:05 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:40:06.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:05 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:40:06.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:05 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:40:06.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:05 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:40:06.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:05 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:40:06.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:05 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:40:06.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:05 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:40:06.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:05 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:40:06.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:05 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:40:06.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:05 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:40:06.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:05 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:40:06.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:05 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:40:06.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.695+0000 7f930fff3640 1 -- 172.21.15.79:0/751988414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93081039c0 msgr2=0x7f9308103da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:06.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.695+0000 7f930fff3640 1 --2- 172.21.15.79:0/751988414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93081039c0 0x7f9308103da0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f9304009900 tx=0x7f930402a3f0 comp rx=0 tx=0).stop 2024-08-20T01:40:06.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.695+0000 7f930fff3640 1 -- 172.21.15.79:0/751988414 shutdown_connections 2024-08-20T01:40:06.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.696+0000 7f930fff3640 1 --2- 172.21.15.79:0/751988414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f930810ce20 0x7f930810f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:06.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.696+0000 7f930fff3640 1 --2- 172.21.15.79:0/751988414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93081042e0 0x7f930810c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:06.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.696+0000 7f930fff3640 1 --2- 172.21.15.79:0/751988414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93081039c0 0x7f9308103da0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:06.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.696+0000 7f930fff3640 1 -- 172.21.15.79:0/751988414 >> 172.21.15.79:0/751988414 conn(0x7f93080fd460 msgr2=0x7f93080ff880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:06.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.696+0000 7f930fff3640 1 -- 172.21.15.79:0/751988414 shutdown_connections 2024-08-20T01:40:06.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.696+0000 7f930fff3640 1 -- 172.21.15.79:0/751988414 wait complete. 2024-08-20T01:40:06.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.696+0000 7f930fff3640 1 Processor -- start 2024-08-20T01:40:06.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.696+0000 7f930fff3640 1 -- start start 2024-08-20T01:40:06.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.697+0000 7f930fff3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93081039c0 0x7f9308101670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:06.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.697+0000 7f930fff3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93081042e0 0x7f9308101bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:06.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.697+0000 7f930fff3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f930810ce20 0x7f93081020f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:06.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.697+0000 7f930fff3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9308112990 con 0x7f93081039c0 2024-08-20T01:40:06.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.697+0000 7f930fff3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9308112810 con 0x7f930810ce20 2024-08-20T01:40:06.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.697+0000 7f930fff3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9308112b10 con 0x7f93081042e0 2024-08-20T01:40:06.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.697+0000 7f930dd8f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93081039c0 0x7f9308101670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:06.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.697+0000 7f930dd8f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93081039c0 0x7f9308101670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60208/0 (socket says 172.21.15.79:60208) 2024-08-20T01:40:06.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.697+0000 7f930dd8f640 1 -- 172.21.15.79:0/3346133395 learned_addr learned my addr 172.21.15.79:0/3346133395 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:06.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.697+0000 7f930e590640 1 --2- 172.21.15.79:0/3346133395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f930810ce20 0x7f93081020f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:06.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.697+0000 7f930d58e640 1 --2- 172.21.15.79:0/3346133395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93081042e0 0x7f9308101bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:06.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.697+0000 7f930dd8f640 1 -- 172.21.15.79:0/3346133395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93081042e0 msgr2=0x7f9308101bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:06.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.697+0000 7f930dd8f640 1 --2- 172.21.15.79:0/3346133395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93081042e0 0x7f9308101bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:06.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.697+0000 7f930dd8f640 1 -- 172.21.15.79:0/3346133395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f930810ce20 msgr2=0x7f93081020f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:06.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.697+0000 7f930dd8f640 1 --2- 172.21.15.79:0/3346133395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f930810ce20 0x7f93081020f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:06.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.697+0000 7f930dd8f640 1 -- 172.21.15.79:0/3346133395 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93081a7320 con 0x7f93081039c0 2024-08-20T01:40:06.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.697+0000 7f930d58e640 1 --2- 172.21.15.79:0/3346133395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93081042e0 0x7f9308101bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:40:06.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.697+0000 7f930dd8f640 1 --2- 172.21.15.79:0/3346133395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93081039c0 0x7f9308101670 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f930402a910 tx=0x7f9304003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:06.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.698+0000 7f92feffd640 1 -- 172.21.15.79:0/3346133395 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f930403f070 con 0x7f93081039c0 2024-08-20T01:40:06.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.698+0000 7f930fff3640 1 -- 172.21.15.79:0/3346133395 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93081a75b0 con 0x7f93081039c0 2024-08-20T01:40:06.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.698+0000 7f92feffd640 1 -- 172.21.15.79:0/3346133395 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f930403baf0 con 0x7f93081039c0 2024-08-20T01:40:06.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.698+0000 7f92feffd640 1 -- 172.21.15.79:0/3346133395 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9304035030 con 0x7f93081039c0 2024-08-20T01:40:06.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.698+0000 7f930fff3640 1 -- 172.21.15.79:0/3346133395 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93081a7a90 con 0x7f93081039c0 2024-08-20T01:40:06.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.700+0000 7f92feffd640 1 -- 172.21.15.79:0/3346133395 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f9304042070 con 0x7f93081039c0 2024-08-20T01:40:06.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.701+0000 7f93123ec740 1 Processor -- start 2024-08-20T01:40:06.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.701+0000 7f93123ec740 1 -- start start 2024-08-20T01:40:06.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.701+0000 7f93123ec740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d7abbb830 0x560d7abbbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:06.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.701+0000 7f93123ec740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d7abbc150 0x560d7abc7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:06.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.701+0000 7f93123ec740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d7abc80e0 0x560d7abca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:06.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.701+0000 7f93123ec740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560d7ab328e0 con 0x560d7abc80e0 2024-08-20T01:40:06.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.701+0000 7f93123ec740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560d7ab21de0 con 0x560d7abbc150 2024-08-20T01:40:06.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.701+0000 7f93123ec740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560d7ab25e20 con 0x560d7abbb830 2024-08-20T01:40:06.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.701+0000 7f930d58e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d7abc80e0 0x560d7abca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:06.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.701+0000 7f930e590640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d7abbb830 0x560d7abbbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:06.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.701+0000 7f930e590640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d7abbb830 0x560d7abbbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:33888/0 (socket says 172.21.15.79:33888) 2024-08-20T01:40:06.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.701+0000 7f930e590640 1 -- 172.21.15.79:0/1623423514 learned_addr learned my addr 172.21.15.79:0/1623423514 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:06.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.702+0000 7f930dd8f640 1 --2- 172.21.15.79:0/1623423514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d7abbc150 0x560d7abc7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:06.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.702+0000 7f92feffd640 1 --2- 172.21.15.79:0/3346133395 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f92f40b3bd0 0x7f92f40b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:06.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.702+0000 7f930d58e640 1 -- 172.21.15.79:0/1623423514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d7abbb830 msgr2=0x560d7abbbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:06.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.702+0000 7f930d58e640 1 --2- 172.21.15.79:0/1623423514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d7abbb830 0x560d7abbbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:06.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.702+0000 7f930d58e640 1 -- 172.21.15.79:0/1623423514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d7abbc150 msgr2=0x560d7abc7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:06.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.702+0000 7f930d58e640 1 --2- 172.21.15.79:0/1623423514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d7abbc150 0x560d7abc7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:06.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.702+0000 7f930d58e640 1 -- 172.21.15.79:0/1623423514 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d7a881650 con 0x560d7abc80e0 2024-08-20T01:40:06.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.702+0000 7f930dd8f640 1 --2- 172.21.15.79:0/1623423514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d7abbc150 0x560d7abc7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:40:06.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.702+0000 7f930e590640 1 --2- 172.21.15.79:0/3346133395 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f92f40b3bd0 0x7f92f40b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:06.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.702+0000 7f92feffd640 1 -- 172.21.15.79:0/3346133395 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9304104350 con 0x7f93081039c0 2024-08-20T01:40:06.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.702+0000 7f930d58e640 1 --2- 172.21.15.79:0/1623423514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d7abc80e0 0x560d7abca4d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f92f8009bf0 tx=0x7f92f80117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d88cfdb6beabe14 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:06.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.702+0000 7f92f3fff640 1 -- 172.21.15.79:0/1623423514 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f8004050 con 0x560d7abc80e0 2024-08-20T01:40:06.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.702+0000 7f930e590640 1 --2- 172.21.15.79:0/3346133395 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f92f40b3bd0 0x7f92f40b6090 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9300003b70 tx=0x7f9300004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:06.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.702+0000 7f92f3fff640 1 -- 172.21.15.79:0/1623423514 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f92f8016070 con 0x560d7abc80e0 2024-08-20T01:40:06.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.702+0000 7f92f3fff640 1 -- 172.21.15.79:0/1623423514 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f801b470 con 0x560d7abc80e0 2024-08-20T01:40:06.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.703+0000 7f93123ec740 1 -- 172.21.15.79:0/1623423514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d7abc80e0 msgr2=0x560d7abca4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:06.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.703+0000 7f93123ec740 1 --2- 172.21.15.79:0/1623423514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d7abc80e0 0x560d7abca4d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f92f8009bf0 tx=0x7f92f80117b0 comp rx=0 tx=0).stop 2024-08-20T01:40:06.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.703+0000 7f93123ec740 1 -- 172.21.15.79:0/1623423514 shutdown_connections 2024-08-20T01:40:06.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.703+0000 7f93123ec740 1 --2- 172.21.15.79:0/1623423514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d7abc80e0 0x560d7abca4d0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:06.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.703+0000 7f93123ec740 1 --2- 172.21.15.79:0/1623423514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d7abbc150 0x560d7abc7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:06.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.703+0000 7f93123ec740 1 --2- 172.21.15.79:0/1623423514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d7abbb830 0x560d7abbbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:06.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.703+0000 7f93123ec740 1 -- 172.21.15.79:0/1623423514 >> 172.21.15.79:0/1623423514 conn(0x560d7abb9660 msgr2=0x560d7abba800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:06.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.703+0000 7f93123ec740 1 -- 172.21.15.79:0/1623423514 shutdown_connections 2024-08-20T01:40:06.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.703+0000 7f93123ec740 1 -- 172.21.15.79:0/1623423514 wait complete. 2024-08-20T01:40:06.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.704+0000 7f93123ec740 1 -- start start 2024-08-20T01:40:06.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.704+0000 7f93123ec740 1 Processor -- start 2024-08-20T01:40:06.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.704+0000 7f93123ec740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d7abbb830 0x560d7abc50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:06.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.704+0000 7f93123ec740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d7abbc150 0x560d7abc55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:06.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.704+0000 7f93123ec740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d7abc80e0 0x560d7abc5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:06.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.704+0000 7f93123ec740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560d7a984700 con 0x560d7abbc150 2024-08-20T01:40:06.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.704+0000 7f93123ec740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560d7aaa87c0 con 0x560d7abbb830 2024-08-20T01:40:06.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.704+0000 7f93123ec740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560d7abcad90 con 0x560d7abc80e0 2024-08-20T01:40:06.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.705+0000 7f93123ec740 10 client.0 _ll_register_callbacks cb 0x560d7ab1b6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:06.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.705+0000 7f930d58e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d7abbc150 0x560d7abc55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:06.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.705+0000 7f930d58e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d7abbc150 0x560d7abc55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60222/0 (socket says 172.21.15.79:60222) 2024-08-20T01:40:06.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.705+0000 7f930d58e640 1 -- 172.21.15.79:0/44846336 learned_addr learned my addr 172.21.15.79:0/44846336 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:06.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.705+0000 7f930dd8f640 1 --2- 172.21.15.79:0/44846336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d7abbb830 0x560d7abc50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:06.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.705+0000 7f930e590640 1 --2- 172.21.15.79:0/44846336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d7abc80e0 0x560d7abc5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:06.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.705+0000 7f930d58e640 1 -- 172.21.15.79:0/44846336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d7abc80e0 msgr2=0x560d7abc5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:06.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.705+0000 7f930d58e640 1 --2- 172.21.15.79:0/44846336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d7abc80e0 0x560d7abc5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:06.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.705+0000 7f930d58e640 1 -- 172.21.15.79:0/44846336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d7abbb830 msgr2=0x560d7abc50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:06.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.705+0000 7f930d58e640 1 --2- 172.21.15.79:0/44846336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d7abbb830 0x560d7abc50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:06.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.705+0000 7f930d58e640 1 -- 172.21.15.79:0/44846336 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d7abd41a0 con 0x560d7abbc150 2024-08-20T01:40:06.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.705+0000 7f930dd8f640 1 --2- 172.21.15.79:0/44846336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d7abbb830 0x560d7abc50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:40:06.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.705+0000 7f930d58e640 1 --2- 172.21.15.79:0/44846336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d7abbc150 0x560d7abc55f0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f92f8003ae0 tx=0x7f92f8009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bd32fbcfc7ad802 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:06.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.705+0000 7f92f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:40:06.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.705+0000 7f92f17fa640 1 -- 172.21.15.79:0/44846336 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f8004050 con 0x560d7abbc150 2024-08-20T01:40:06.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.705+0000 7f92f17fa640 1 -- 172.21.15.79:0/44846336 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f92f80041f0 con 0x560d7abbc150 2024-08-20T01:40:06.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.705+0000 7f93123ec740 1 -- 172.21.15.79:0/44846336 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560d7aad1100 con 0x560d7abbc150 2024-08-20T01:40:06.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.706+0000 7f92f17fa640 1 -- 172.21.15.79:0/44846336 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f92f80043f0 con 0x560d7abbc150 2024-08-20T01:40:06.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.706+0000 7f93123ec740 10 client.16521 fetch_fsmap learned FSMap version 33 2024-08-20T01:40:06.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.706+0000 7f93123ec740 1 -- 172.21.15.79:0/44846336 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x560d7abd6b50 con 0x560d7abbc150 2024-08-20T01:40:06.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.706+0000 7f92f17fa640 1 -- 172.21.15.79:0/44846336 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x560d7aad1100 con 0x560d7abbc150 2024-08-20T01:40:06.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.706+0000 7f92f17fa640 1 -- 172.21.15.79:0/44846336 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7f92f8004a80 con 0x560d7abbc150 2024-08-20T01:40:06.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.706+0000 7f93123ec740 10 client.16521 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:40:06.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.706+0000 7f93123ec740 10 client.16521 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:40:06.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.706+0000 7f93123ec740 20 client.16521 populate_metadata read hostname 'smithi079' 2024-08-20T01:40:06.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.706+0000 7f93123ec740 1 --2- 172.21.15.79:0/44846336 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560d7abd7ea0 0x560d7abda290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:06.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.706+0000 7f93123ec740 4 client.16521 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:40:06.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.706+0000 7f93123ec740 1 -- 172.21.15.79:0/44846336 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d7ab34830 con 0x560d7abd7ea0 2024-08-20T01:40:06.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.706+0000 7f930dd8f640 1 --2- 172.21.15.79:0/44846336 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560d7abd7ea0 0x560d7abda290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:06.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.707+0000 7f92f17fa640 10 client.16521 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:06.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.707+0000 7f930dd8f640 1 --2- 172.21.15.79:0/44846336 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560d7abd7ea0 0x560d7abda290 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2493b39fa79d336c server_cookie=8dfd7355bd4a7467 in_seq=0 out_seq=0 2024-08-20T01:40:06.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.707+0000 7f92f17fa640 1 -- 172.21.15.79:0/44846336 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560d7ab34830 con 0x560d7abd7ea0 2024-08-20T01:40:06.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.707+0000 7f92f17fa640 10 client.16521 handle_command_reply: tid=0 2024-08-20T01:40:06.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.708+0000 7f93123ec740 1 client.16521 shutdown 2024-08-20T01:40:06.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.708+0000 7f93123ec740 1 -- 172.21.15.79:0/44846336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d7abbc150 msgr2=0x560d7abc55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:06.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.708+0000 7f93123ec740 1 --2- 172.21.15.79:0/44846336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d7abbc150 0x560d7abc55f0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f92f8003ae0 tx=0x7f92f8009f10 comp rx=0 tx=0).stop 2024-08-20T01:40:06.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.708+0000 7f93123ec740 1 -- 172.21.15.79:0/44846336 shutdown_connections 2024-08-20T01:40:06.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.708+0000 7f93123ec740 1 --2- 172.21.15.79:0/44846336 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560d7abd7ea0 0x560d7abda290 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:06.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.708+0000 7f93123ec740 1 --2- 172.21.15.79:0/44846336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d7abc80e0 0x560d7abc5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:06.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.708+0000 7f92f17fa640 0 client.16521 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:06.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.708+0000 7f93123ec740 1 --2- 172.21.15.79:0/44846336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d7abbc150 0x560d7abc55f0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:06.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.708+0000 7f93123ec740 1 --2- 172.21.15.79:0/44846336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d7abbb830 0x560d7abc50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:06.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.708+0000 7f93123ec740 1 -- 172.21.15.79:0/44846336 >> 172.21.15.79:0/44846336 conn(0x560d7abb9660 msgr2=0x560d7abbf200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:06.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.708+0000 7f93123ec740 1 -- 172.21.15.79:0/44846336 shutdown_connections 2024-08-20T01:40:06.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.708+0000 7f93123ec740 1 -- 172.21.15.79:0/44846336 wait complete. 2024-08-20T01:40:06.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.708+0000 7f93123ec740 20 client.16521 trim_cache size 0 max 16384 2024-08-20T01:40:06.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.728+0000 7f93123ec740 1 Processor -- start 2024-08-20T01:40:06.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.728+0000 7f93123ec740 1 -- start start 2024-08-20T01:40:06.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.728+0000 7f93123ec740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d7abbb830 0x560d7abdf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:06.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.728+0000 7f93123ec740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d7abbc150 0x560d7abdfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:06.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.728+0000 7f93123ec740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d7abc80e0 0x560d7abbe9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:06.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.728+0000 7f93123ec740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f93081b0170 con 0x560d7abc80e0 2024-08-20T01:40:06.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.728+0000 7f93123ec740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f93081b1e00 con 0x560d7abbb830 2024-08-20T01:40:06.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.728+0000 7f93123ec740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f93081b0840 con 0x560d7abbc150 2024-08-20T01:40:06.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.728+0000 7f930e590640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d7abc80e0 0x560d7abbe9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:06.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.728+0000 7f930e590640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d7abc80e0 0x560d7abbe9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60228/0 (socket says 172.21.15.79:60228) 2024-08-20T01:40:06.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.728+0000 7f930d58e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d7abbc150 0x560d7abdfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:06.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.728+0000 7f930e590640 1 -- 172.21.15.79:0/3021383653 learned_addr learned my addr 172.21.15.79:0/3021383653 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:06.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.728+0000 7f930dd8f640 1 --2- 172.21.15.79:0/3021383653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d7abbb830 0x560d7abdf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:06.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.728+0000 7f930d58e640 1 -- 172.21.15.79:0/3021383653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d7abbb830 msgr2=0x560d7abdf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:06.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.728+0000 7f930d58e640 1 --2- 172.21.15.79:0/3021383653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d7abbb830 0x560d7abdf980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:06.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.728+0000 7f930d58e640 1 -- 172.21.15.79:0/3021383653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d7abc80e0 msgr2=0x560d7abbe9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:06.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.728+0000 7f930d58e640 1 --2- 172.21.15.79:0/3021383653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d7abc80e0 0x560d7abbe9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:06.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.729+0000 7f930d58e640 1 -- 172.21.15.79:0/3021383653 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d7abba0e0 con 0x560d7abbc150 2024-08-20T01:40:06.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.729+0000 7f930dd8f640 1 --2- 172.21.15.79:0/3021383653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d7abbb830 0x560d7abdf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:40:06.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.729+0000 7f930d58e640 1 --2- 172.21.15.79:0/3021383653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d7abbc150 0x560d7abdfec0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f92f8000c00 tx=0x7f92f8009240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26ba3528fb0803e0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:06.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.729+0000 7f92f37fe640 1 -- 172.21.15.79:0/3021383653 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f8000e60 con 0x560d7abbc150 2024-08-20T01:40:06.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.729+0000 7f92f37fe640 1 -- 172.21.15.79:0/3021383653 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f92f8016040 con 0x560d7abbc150 2024-08-20T01:40:06.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.729+0000 7f92f37fe640 1 -- 172.21.15.79:0/3021383653 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f8004730 con 0x560d7abbc150 2024-08-20T01:40:06.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.730+0000 7f93123ec740 1 -- 172.21.15.79:0/3021383653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d7abbc150 msgr2=0x560d7abdfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:06.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.730+0000 7f93123ec740 1 --2- 172.21.15.79:0/3021383653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d7abbc150 0x560d7abdfec0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f92f8000c00 tx=0x7f92f8009240 comp rx=0 tx=0).stop 2024-08-20T01:40:06.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.730+0000 7f93123ec740 1 -- 172.21.15.79:0/3021383653 shutdown_connections 2024-08-20T01:40:06.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.730+0000 7f93123ec740 1 --2- 172.21.15.79:0/3021383653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d7abc80e0 0x560d7abbe9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:06.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.730+0000 7f93123ec740 1 --2- 172.21.15.79:0/3021383653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d7abbc150 0x560d7abdfec0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:06.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.730+0000 7f93123ec740 1 --2- 172.21.15.79:0/3021383653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d7abbb830 0x560d7abdf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:06.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.730+0000 7f93123ec740 1 -- 172.21.15.79:0/3021383653 >> 172.21.15.79:0/3021383653 conn(0x560d7abb9660 msgr2=0x560d7abc6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:06.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.730+0000 7f93123ec740 1 -- 172.21.15.79:0/3021383653 shutdown_connections 2024-08-20T01:40:06.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.730+0000 7f93123ec740 1 -- 172.21.15.79:0/3021383653 wait complete. 2024-08-20T01:40:06.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.730+0000 7f93123ec740 1 -- start start 2024-08-20T01:40:06.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.730+0000 7f93123ec740 1 Processor -- start 2024-08-20T01:40:06.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.731+0000 7f93123ec740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d7abbb830 0x560d7abcb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:06.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.731+0000 7f93123ec740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d7abbc150 0x560d7abcb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:06.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.731+0000 7f93123ec740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d7abc80e0 0x560d7abcbb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:06.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.731+0000 7f93123ec740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f93081b1670 con 0x560d7abc80e0 2024-08-20T01:40:06.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.731+0000 7f93123ec740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f93081b0f10 con 0x560d7abbc150 2024-08-20T01:40:06.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.731+0000 7f93123ec740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f93081ae150 con 0x560d7abbb830 2024-08-20T01:40:06.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.731+0000 7f93123ec740 10 client.0 _ll_register_callbacks cb 0x7f9300009ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:06.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.731+0000 7f930e590640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d7abc80e0 0x560d7abcbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:06.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.731+0000 7f930e590640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d7abc80e0 0x560d7abcbb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60234/0 (socket says 172.21.15.79:60234) 2024-08-20T01:40:06.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.731+0000 7f930e590640 1 -- 172.21.15.79:0/45949630 learned_addr learned my addr 172.21.15.79:0/45949630 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:06.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.731+0000 7f930dd8f640 1 --2- 172.21.15.79:0/45949630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d7abbb830 0x560d7abcb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:06.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.731+0000 7f930d58e640 1 --2- 172.21.15.79:0/45949630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d7abbc150 0x560d7abcb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:06.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.731+0000 7f930e590640 1 -- 172.21.15.79:0/45949630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d7abbb830 msgr2=0x560d7abcb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:06.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.731+0000 7f930e590640 1 --2- 172.21.15.79:0/45949630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d7abbb830 0x560d7abcb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:06.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.731+0000 7f930e590640 1 -- 172.21.15.79:0/45949630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d7abbc150 msgr2=0x560d7abcb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:06.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.731+0000 7f930e590640 1 --2- 172.21.15.79:0/45949630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d7abbc150 0x560d7abcb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:06.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.731+0000 7f930e590640 1 -- 172.21.15.79:0/45949630 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d7ac493f0 con 0x560d7abc80e0 2024-08-20T01:40:06.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.731+0000 7f930dd8f640 1 --2- 172.21.15.79:0/45949630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d7abbb830 0x560d7abcb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:40:06.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.732+0000 7f930e590640 1 --2- 172.21.15.79:0/45949630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d7abc80e0 0x560d7abcbb40 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f9300010860 tx=0x7f9300004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49ca80d4f4778edc server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:06.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.732+0000 7f92f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:40:06.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.732+0000 7f92f17fa640 1 -- 172.21.15.79:0/45949630 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9300011940 con 0x560d7abc80e0 2024-08-20T01:40:06.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.732+0000 7f93123ec740 1 -- 172.21.15.79:0/45949630 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92f8016040 con 0x560d7abc80e0 2024-08-20T01:40:06.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.732+0000 7f92f17fa640 1 -- 172.21.15.79:0/45949630 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9300011ae0 con 0x560d7abc80e0 2024-08-20T01:40:06.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.732+0000 7f92f17fa640 1 -- 172.21.15.79:0/45949630 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f9300011ce0 con 0x560d7abc80e0 2024-08-20T01:40:06.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.732+0000 7f93123ec740 10 client.16527 fetch_fsmap learned FSMap version 33 2024-08-20T01:40:06.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.732+0000 7f93123ec740 1 -- 172.21.15.79:0/45949630 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x560d7ac4a770 con 0x560d7abc80e0 2024-08-20T01:40:06.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.732+0000 7f92f17fa640 1 -- 172.21.15.79:0/45949630 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f92f8016040 con 0x560d7abc80e0 2024-08-20T01:40:06.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.732+0000 7f92f17fa640 1 -- 172.21.15.79:0/45949630 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7f9300020400 con 0x560d7abc80e0 2024-08-20T01:40:06.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.733+0000 7f93123ec740 10 client.16527 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:40:06.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.733+0000 7f93123ec740 10 client.16527 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:40:06.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.733+0000 7f93123ec740 20 client.16527 populate_metadata read hostname 'smithi079' 2024-08-20T01:40:06.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.733+0000 7f93123ec740 1 --2- 172.21.15.79:0/45949630 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560d7abd7ea0 0x560d7ac4d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:06.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.733+0000 7f93123ec740 4 client.16527 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:40:06.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.733+0000 7f93123ec740 1 -- 172.21.15.79:0/45949630 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560d7ab302d0 con 0x560d7abd7ea0 2024-08-20T01:40:06.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.733+0000 7f930dd8f640 1 --2- 172.21.15.79:0/45949630 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560d7abd7ea0 0x560d7ac4d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:06.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.733+0000 7f92f17fa640 10 client.16527 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:06.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.733+0000 7f930dd8f640 1 --2- 172.21.15.79:0/45949630 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560d7abd7ea0 0x560d7ac4d020 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0abf3086f140a4f server_cookie=e53f6905b715e960 in_seq=0 out_seq=0 2024-08-20T01:40:06.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.734+0000 7f92f17fa640 1 -- 172.21.15.79:0/45949630 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x560d7ab302d0 con 0x560d7abd7ea0 2024-08-20T01:40:06.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.734+0000 7f92f17fa640 10 client.16527 handle_command_reply: tid=0 2024-08-20T01:40:06.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.734+0000 7f93123ec740 1 client.16527 shutdown 2024-08-20T01:40:06.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.734+0000 7f93123ec740 1 -- 172.21.15.79:0/45949630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d7abc80e0 msgr2=0x560d7abcbb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:06.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.734+0000 7f93123ec740 1 --2- 172.21.15.79:0/45949630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d7abc80e0 0x560d7abcbb40 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f9300010860 tx=0x7f9300004ab0 comp rx=0 tx=0).stop 2024-08-20T01:40:06.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.734+0000 7f93123ec740 1 -- 172.21.15.79:0/45949630 shutdown_connections 2024-08-20T01:40:06.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.734+0000 7f93123ec740 1 --2- 172.21.15.79:0/45949630 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560d7abd7ea0 0x560d7ac4d020 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:06.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.734+0000 7f93123ec740 1 --2- 172.21.15.79:0/45949630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d7abc80e0 0x560d7abcbb40 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:06.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.734+0000 7f93123ec740 1 --2- 172.21.15.79:0/45949630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d7abbc150 0x560d7abcb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:06.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.734+0000 7f92f17fa640 0 client.16527 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:06.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.734+0000 7f93123ec740 1 --2- 172.21.15.79:0/45949630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d7abbb830 0x560d7abcb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:06.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.734+0000 7f93123ec740 1 -- 172.21.15.79:0/45949630 >> 172.21.15.79:0/45949630 conn(0x560d7abb9660 msgr2=0x560d7abba340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:06.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.734+0000 7f93123ec740 1 -- 172.21.15.79:0/45949630 shutdown_connections 2024-08-20T01:40:06.757 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:40:06.757 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-20T01:40:06.757 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": { 2024-08-20T01:40:06.758 INFO:teuthology.orchestra.run.smithi079.stdout: "0f8c74e8-cd51-4456-9ff0-4a29ba0b1942": { 2024-08-20T01:40:06.758 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/", 2024-08-20T01:40:06.758 INFO:teuthology.orchestra.run.smithi079.stdout: "tag": "0f8c74e8-cd51-4456-9ff0-4a29ba0b1942", 2024-08-20T01:40:06.758 INFO:teuthology.orchestra.run.smithi079.stdout: "options": "recursive,force" 2024-08-20T01:40:06.758 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:40:06.758 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:40:06.758 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:40:06.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.734+0000 7f93123ec740 1 -- 172.21.15.79:0/45949630 wait complete. 2024-08-20T01:40:06.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.734+0000 7f93123ec740 20 client.16527 trim_cache size 0 max 16384 2024-08-20T01:40:06.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.735+0000 7f930fff3640 1 -- 172.21.15.79:0/3346133395 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f92f40b3bd0 msgr2=0x7f92f40b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:06.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.735+0000 7f930fff3640 1 --2- 172.21.15.79:0/3346133395 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f92f40b3bd0 0x7f92f40b6090 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9300003b70 tx=0x7f9300004a40 comp rx=0 tx=0).stop 2024-08-20T01:40:06.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.735+0000 7f930fff3640 1 -- 172.21.15.79:0/3346133395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93081039c0 msgr2=0x7f9308101670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:06.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.735+0000 7f930fff3640 1 --2- 172.21.15.79:0/3346133395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93081039c0 0x7f9308101670 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f930402a910 tx=0x7f9304003b90 comp rx=0 tx=0).stop 2024-08-20T01:40:06.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.735+0000 7f930fff3640 1 -- 172.21.15.79:0/3346133395 shutdown_connections 2024-08-20T01:40:06.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.735+0000 7f930fff3640 1 --2- 172.21.15.79:0/3346133395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f930810ce20 0x7f93081020f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:06.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.735+0000 7f930fff3640 1 --2- 172.21.15.79:0/3346133395 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f92f40b3bd0 0x7f92f40b6090 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:06.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.735+0000 7f930fff3640 1 --2- 172.21.15.79:0/3346133395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93081042e0 0x7f9308101bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:06.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.735+0000 7f930fff3640 1 --2- 172.21.15.79:0/3346133395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93081039c0 0x7f9308101670 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:06.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.735+0000 7f930fff3640 1 -- 172.21.15.79:0/3346133395 >> 172.21.15.79:0/3346133395 conn(0x7f93080fd460 msgr2=0x7f93080fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:06.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.735+0000 7f930fff3640 1 -- 172.21.15.79:0/3346133395 shutdown_connections 2024-08-20T01:40:06.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:06.736+0000 7f930fff3640 1 -- 172.21.15.79:0/3346133395 wait complete. 2024-08-20T01:40:07.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:06 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:40:07.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:06 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:40:07.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:06 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:40:07.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:06 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:40:07.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:06 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:40:07.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:06 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:40:07.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:06 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:40:07.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:06 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:40:07.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:06 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:40:07.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:06 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:40:07.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:06 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:40:07.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:06 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:40:07.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:06 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:40:07.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:06 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:40:07.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:06 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:40:07.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:06 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:40:07.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:06 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:40:07.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:06 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:40:07.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:06 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:40:07.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:06 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:40:07.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:06 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:40:07.554 INFO:tasks.cephfs.filesystem:scrub status for tag:0f8c74e8-cd51-4456-9ff0-4a29ba0b1942 - {'path': '/', 'tag': '0f8c74e8-cd51-4456-9ff0-4a29ba0b1942', 'options': 'recursive,force'} 2024-08-20T01:40:08.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:08 smithi081 ceph-mon[22209]: pgmap v431: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 27 op/s 2024-08-20T01:40:08.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:08 smithi175 ceph-mon[22392]: pgmap v431: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 27 op/s 2024-08-20T01:40:08.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:08 smithi079 ceph-mon[18656]: pgmap v431: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 27 op/s 2024-08-20T01:40:10.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:10 smithi081 ceph-mon[22209]: pgmap v432: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 MiB/s wr, 43 op/s 2024-08-20T01:40:10.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:10 smithi175 ceph-mon[22392]: pgmap v432: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 MiB/s wr, 43 op/s 2024-08-20T01:40:10.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:10 smithi079 ceph-mon[18656]: pgmap v432: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 MiB/s wr, 43 op/s 2024-08-20T01:40:12.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:12 smithi081 ceph-mon[22209]: pgmap v433: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 29 MiB/s wr, 47 op/s 2024-08-20T01:40:12.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:12 smithi175 ceph-mon[22392]: pgmap v433: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 29 MiB/s wr, 47 op/s 2024-08-20T01:40:12.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:12 smithi079 ceph-mon[18656]: pgmap v433: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 29 MiB/s wr, 47 op/s 2024-08-20T01:40:14.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:14 smithi081 ceph-mon[22209]: pgmap v434: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 26 MiB/s wr, 46 op/s 2024-08-20T01:40:14.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:14 smithi175 ceph-mon[22392]: pgmap v434: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 26 MiB/s wr, 46 op/s 2024-08-20T01:40:14.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:14 smithi079 ceph-mon[18656]: pgmap v434: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 26 MiB/s wr, 46 op/s 2024-08-20T01:40:16.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.055+0000 7fa9b5067640 1 -- 172.21.15.79:0/1410382680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9b01026b0 msgr2=0x7fa9b0102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:16.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.055+0000 7fa9b5067640 1 --2- 172.21.15.79:0/1410382680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9b01026b0 0x7fa9b0102b30 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fa9a4009930 tx=0x7fa9a402a420 comp rx=0 tx=0).stop 2024-08-20T01:40:16.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.055+0000 7fa9b5067640 1 -- 172.21.15.79:0/1410382680 shutdown_connections 2024-08-20T01:40:16.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.055+0000 7fa9b5067640 1 --2- 172.21.15.79:0/1410382680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9b0103070 0x7fa9b01099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:16.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.055+0000 7fa9b5067640 1 --2- 172.21.15.79:0/1410382680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9b01026b0 0x7fa9b0102b30 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:16.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.055+0000 7fa9b5067640 1 --2- 172.21.15.79:0/1410382680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9b0101560 0x7fa9b0101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:16.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.055+0000 7fa9b5067640 1 -- 172.21.15.79:0/1410382680 >> 172.21.15.79:0/1410382680 conn(0x7fa9b00fce20 msgr2=0x7fa9b00ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:16.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.055+0000 7fa9b5067640 1 -- 172.21.15.79:0/1410382680 shutdown_connections 2024-08-20T01:40:16.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.055+0000 7fa9b5067640 1 -- 172.21.15.79:0/1410382680 wait complete. 2024-08-20T01:40:16.061 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.056+0000 7fa9b5067640 1 Processor -- start 2024-08-20T01:40:16.061 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.056+0000 7fa9b5067640 1 -- start start 2024-08-20T01:40:16.061 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.056+0000 7fa9b5067640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9b0101560 0x7fa9b01989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:16.061 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.056+0000 7fa9b5067640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9b01026b0 0x7fa9b0199040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:16.061 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.056+0000 7fa9b5067640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9b0103070 0x7fa9b0199c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:16.061 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.056+0000 7fa9b5067640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b010d080 con 0x7fa9b01026b0 2024-08-20T01:40:16.061 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.056+0000 7fa9b5067640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b010cf00 con 0x7fa9b0103070 2024-08-20T01:40:16.061 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.056+0000 7fa9b5067640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b010d200 con 0x7fa9b0101560 2024-08-20T01:40:16.061 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.057+0000 7fa9ae59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9b01026b0 0x7fa9b0199040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:16.061 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.057+0000 7fa9ae59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9b01026b0 0x7fa9b0199040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41116/0 (socket says 172.21.15.79:41116) 2024-08-20T01:40:16.061 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.057+0000 7fa9ae59c640 1 -- 172.21.15.79:0/3830340363 learned_addr learned my addr 172.21.15.79:0/3830340363 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:16.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.057+0000 7fa9aed9d640 1 --2- 172.21.15.79:0/3830340363 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9b0101560 0x7fa9b01989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:16.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.057+0000 7fa9af59e640 1 --2- 172.21.15.79:0/3830340363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9b0103070 0x7fa9b0199c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:16.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.057+0000 7fa9ae59c640 1 -- 172.21.15.79:0/3830340363 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9b0101560 msgr2=0x7fa9b01989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:16.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.057+0000 7fa9ae59c640 1 --2- 172.21.15.79:0/3830340363 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9b0101560 0x7fa9b01989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:16.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.057+0000 7fa9ae59c640 1 -- 172.21.15.79:0/3830340363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9b0103070 msgr2=0x7fa9b0199c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:16.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.057+0000 7fa9ae59c640 1 --2- 172.21.15.79:0/3830340363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9b0103070 0x7fa9b0199c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:16.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.057+0000 7fa9ae59c640 1 -- 172.21.15.79:0/3830340363 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9b019a530 con 0x7fa9b01026b0 2024-08-20T01:40:16.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.057+0000 7fa9af59e640 1 --2- 172.21.15.79:0/3830340363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9b0103070 0x7fa9b0199c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:40:16.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.057+0000 7fa9aed9d640 1 --2- 172.21.15.79:0/3830340363 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9b0101560 0x7fa9b01989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:40:16.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.057+0000 7fa9ae59c640 1 --2- 172.21.15.79:0/3830340363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9b01026b0 0x7fa9b0199040 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fa9a4005ab0 tx=0x7fa9a40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:16.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.057+0000 7fa997fff640 1 -- 172.21.15.79:0/3830340363 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a403f030 con 0x7fa9b01026b0 2024-08-20T01:40:16.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.057+0000 7fa997fff640 1 -- 172.21.15.79:0/3830340363 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa9a4003c90 con 0x7fa9b01026b0 2024-08-20T01:40:16.063 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.057+0000 7fa9b5067640 1 -- 172.21.15.79:0/3830340363 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9b019a7c0 con 0x7fa9b01026b0 2024-08-20T01:40:16.063 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.058+0000 7fa997fff640 1 -- 172.21.15.79:0/3830340363 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a4035070 con 0x7fa9b01026b0 2024-08-20T01:40:16.063 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.058+0000 7fa9b5067640 1 -- 172.21.15.79:0/3830340363 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9b01a0ef0 con 0x7fa9b01026b0 2024-08-20T01:40:16.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.060+0000 7fa997fff640 1 -- 172.21.15.79:0/3830340363 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa9a4042030 con 0x7fa9b01026b0 2024-08-20T01:40:16.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.060+0000 7fa9b7e61740 1 Processor -- start 2024-08-20T01:40:16.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.060+0000 7fa9b7e61740 1 -- start start 2024-08-20T01:40:16.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.061+0000 7fa9b7e61740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562acb7308d0 0x562acb732cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:16.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.061+0000 7fa9b7e61740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562acb733200 0x562acb7355f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:16.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.061+0000 7fa9b7e61740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562acb735c40 0x562acb738100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:16.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.061+0000 7fa9b7e61740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562acb6a3360 con 0x562acb7308d0 2024-08-20T01:40:16.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.061+0000 7fa9b7e61740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562acb692860 con 0x562acb735c40 2024-08-20T01:40:16.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.061+0000 7fa9b7e61740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562acb6968a0 con 0x562acb733200 2024-08-20T01:40:16.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.061+0000 7fa9af59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562acb7308d0 0x562acb732cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:16.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.061+0000 7fa9af59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562acb7308d0 0x562acb732cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41122/0 (socket says 172.21.15.79:41122) 2024-08-20T01:40:16.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.061+0000 7fa9af59e640 1 -- 172.21.15.79:0/2705147220 learned_addr learned my addr 172.21.15.79:0/2705147220 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:16.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.061+0000 7fa9aed9d640 1 --2- 172.21.15.79:0/2705147220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562acb733200 0x562acb7355f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:16.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.061+0000 7fa9ae59c640 1 --2- 172.21.15.79:0/2705147220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562acb735c40 0x562acb738100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:16.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.061+0000 7fa997fff640 1 --2- 172.21.15.79:0/3830340363 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa9980b3bd0 0x7fa9980b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:16.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.061+0000 7fa9af59e640 1 -- 172.21.15.79:0/2705147220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562acb733200 msgr2=0x562acb7355f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:16.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.061+0000 7fa9af59e640 1 --2- 172.21.15.79:0/2705147220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562acb733200 0x562acb7355f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:16.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.061+0000 7fa9af59e640 1 -- 172.21.15.79:0/2705147220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562acb735c40 msgr2=0x562acb738100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:16.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.061+0000 7fa9af59e640 1 --2- 172.21.15.79:0/2705147220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562acb735c40 0x562acb738100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:16.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.061+0000 7fa9af59e640 1 -- 172.21.15.79:0/2705147220 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562acb639e40 con 0x562acb7308d0 2024-08-20T01:40:16.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.061+0000 7fa9ae59c640 1 --2- 172.21.15.79:0/2705147220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562acb735c40 0x562acb738100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:40:16.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.061+0000 7fa9af59e640 1 --2- 172.21.15.79:0/3830340363 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa9980b3bd0 0x7fa9980b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:16.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.061+0000 7fa997fff640 1 -- 172.21.15.79:0/3830340363 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fa9a41045e0 con 0x7fa9b01026b0 2024-08-20T01:40:16.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.061+0000 7fa9af59e640 1 --2- 172.21.15.79:0/2705147220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562acb7308d0 0x562acb732cc0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fa9a800f500 tx=0x7fa9a800f900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfeb53c185e6653 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:16.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.062+0000 7fa9957fa640 1 -- 172.21.15.79:0/2705147220 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a801c400 con 0x562acb7308d0 2024-08-20T01:40:16.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.062+0000 7fa9957fa640 1 -- 172.21.15.79:0/2705147220 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa9a80124b0 con 0x562acb7308d0 2024-08-20T01:40:16.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.062+0000 7fa9957fa640 1 -- 172.21.15.79:0/2705147220 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a8010680 con 0x562acb7308d0 2024-08-20T01:40:16.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.062+0000 7fa9af59e640 1 --2- 172.21.15.79:0/3830340363 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa9980b3bd0 0x7fa9980b6090 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8020000 tx=0x7fa9a801d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:16.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.062+0000 7fa9b7e61740 1 -- 172.21.15.79:0/2705147220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562acb7308d0 msgr2=0x562acb732cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.062+0000 7fa9b7e61740 1 --2- 172.21.15.79:0/2705147220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562acb7308d0 0x562acb732cc0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fa9a800f500 tx=0x7fa9a800f900 comp rx=0 tx=0).stop 2024-08-20T01:40:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.063+0000 7fa9b7e61740 1 -- 172.21.15.79:0/2705147220 shutdown_connections 2024-08-20T01:40:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.063+0000 7fa9b7e61740 1 --2- 172.21.15.79:0/2705147220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562acb735c40 0x562acb738100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.063+0000 7fa9b7e61740 1 --2- 172.21.15.79:0/2705147220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562acb733200 0x562acb7355f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.063+0000 7fa9b7e61740 1 --2- 172.21.15.79:0/2705147220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562acb7308d0 0x562acb732cc0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.063+0000 7fa9b7e61740 1 -- 172.21.15.79:0/2705147220 >> 172.21.15.79:0/2705147220 conn(0x562acb72ba20 msgr2=0x562acb72c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.063+0000 7fa9b7e61740 1 -- 172.21.15.79:0/2705147220 shutdown_connections 2024-08-20T01:40:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.063+0000 7fa9b7e61740 1 -- 172.21.15.79:0/2705147220 wait complete. 2024-08-20T01:40:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.063+0000 7fa9b7e61740 1 -- start start 2024-08-20T01:40:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.063+0000 7fa9b7e61740 1 Processor -- start 2024-08-20T01:40:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.063+0000 7fa9b7e61740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562acb7308d0 0x562acb73a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.063+0000 7fa9b7e61740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562acb733200 0x562acb73a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.063+0000 7fa9b7e61740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562acb735c40 0x562acb73b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:16.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.063+0000 7fa9b7e61740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562acb5cbab0 con 0x562acb735c40 2024-08-20T01:40:16.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.063+0000 7fa9b7e61740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562acb619780 con 0x562acb7308d0 2024-08-20T01:40:16.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.063+0000 7fa9b7e61740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562acb738c20 con 0x562acb733200 2024-08-20T01:40:16.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.063+0000 7fa9b7e61740 10 client.0 _ll_register_callbacks cb 0x562acb3a1a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:16.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.063+0000 7fa9af59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562acb735c40 0x562acb73b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:16.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.063+0000 7fa9af59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562acb735c40 0x562acb73b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41126/0 (socket says 172.21.15.79:41126) 2024-08-20T01:40:16.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.063+0000 7fa9af59e640 1 -- 172.21.15.79:0/375002018 learned_addr learned my addr 172.21.15.79:0/375002018 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:16.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.064+0000 7fa9ae59c640 1 --2- 172.21.15.79:0/375002018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562acb733200 0x562acb73a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:16.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.064+0000 7fa9aed9d640 1 --2- 172.21.15.79:0/375002018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562acb7308d0 0x562acb73a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:16.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.064+0000 7fa9af59e640 1 -- 172.21.15.79:0/375002018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562acb733200 msgr2=0x562acb73a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:16.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.064+0000 7fa9af59e640 1 --2- 172.21.15.79:0/375002018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562acb733200 0x562acb73a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:16.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.064+0000 7fa9af59e640 1 -- 172.21.15.79:0/375002018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562acb7308d0 msgr2=0x562acb73a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:16.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.064+0000 7fa9af59e640 1 --2- 172.21.15.79:0/375002018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562acb7308d0 0x562acb73a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:16.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.064+0000 7fa9af59e640 1 -- 172.21.15.79:0/375002018 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562acb3f5790 con 0x562acb735c40 2024-08-20T01:40:16.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.064+0000 7fa9aed9d640 1 --2- 172.21.15.79:0/375002018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562acb7308d0 0x562acb73a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:40:16.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.064+0000 7fa9af59e640 1 --2- 172.21.15.79:0/375002018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562acb735c40 0x562acb73b350 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8009960 tx=0x7fa9a8005af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69d8e87597a90748 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:16.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.064+0000 7fa992ff5640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:40:16.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.064+0000 7fa992ff5640 1 -- 172.21.15.79:0/375002018 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a8010990 con 0x562acb735c40 2024-08-20T01:40:16.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.064+0000 7fa992ff5640 1 -- 172.21.15.79:0/375002018 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fa9a8010b30 con 0x562acb735c40 2024-08-20T01:40:16.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.064+0000 7fa9b7e61740 1 -- 172.21.15.79:0/375002018 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562acb641e00 con 0x562acb735c40 2024-08-20T01:40:16.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.064+0000 7fa992ff5640 1 -- 172.21.15.79:0/375002018 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fa9a8010d30 con 0x562acb735c40 2024-08-20T01:40:16.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.064+0000 7fa9b7e61740 10 client.16539 fetch_fsmap learned FSMap version 33 2024-08-20T01:40:16.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.064+0000 7fa9b7e61740 1 -- 172.21.15.79:0/375002018 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x562acb46e620 con 0x562acb735c40 2024-08-20T01:40:16.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.064+0000 7fa992ff5640 1 -- 172.21.15.79:0/375002018 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x562acb641e00 con 0x562acb735c40 2024-08-20T01:40:16.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.065+0000 7fa992ff5640 1 -- 172.21.15.79:0/375002018 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7fa9a802d070 con 0x562acb735c40 2024-08-20T01:40:16.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.065+0000 7fa9b7e61740 10 client.16539 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:40:16.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.065+0000 7fa9b7e61740 10 client.16539 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:40:16.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.065+0000 7fa9b7e61740 20 client.16539 populate_metadata read hostname 'smithi079' 2024-08-20T01:40:16.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.065+0000 7fa9b7e61740 1 --2- 172.21.15.79:0/375002018 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x562acb745880 0x562acb747ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:16.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.065+0000 7fa9b7e61740 4 client.16539 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:40:16.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.065+0000 7fa9b7e61740 1 -- 172.21.15.79:0/375002018 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562acb6a52b0 con 0x562acb745880 2024-08-20T01:40:16.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.065+0000 7fa9aed9d640 1 --2- 172.21.15.79:0/375002018 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x562acb745880 0x562acb747ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:16.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.066+0000 7fa9aed9d640 1 --2- 172.21.15.79:0/375002018 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x562acb745880 0x562acb747ce0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d1db0089baae3b7 server_cookie=1168f355bcdbac5f in_seq=0 out_seq=0 2024-08-20T01:40:16.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.066+0000 7fa992ff5640 10 client.16539 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:16.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.066+0000 7fa992ff5640 1 -- 172.21.15.79:0/375002018 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562acb6a52b0 con 0x562acb745880 2024-08-20T01:40:16.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.066+0000 7fa992ff5640 10 client.16539 handle_command_reply: tid=0 2024-08-20T01:40:16.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.066+0000 7fa9b7e61740 1 client.16539 shutdown 2024-08-20T01:40:16.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.066+0000 7fa9b7e61740 1 -- 172.21.15.79:0/375002018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562acb735c40 msgr2=0x562acb73b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:16.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.066+0000 7fa9b7e61740 1 --2- 172.21.15.79:0/375002018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562acb735c40 0x562acb73b350 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8009960 tx=0x7fa9a8005af0 comp rx=0 tx=0).stop 2024-08-20T01:40:16.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.066+0000 7fa9b7e61740 1 -- 172.21.15.79:0/375002018 shutdown_connections 2024-08-20T01:40:16.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.066+0000 7fa9b7e61740 1 --2- 172.21.15.79:0/375002018 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x562acb745880 0x562acb747ce0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:16.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.066+0000 7fa9b7e61740 1 --2- 172.21.15.79:0/375002018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562acb735c40 0x562acb73b350 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:16.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.066+0000 7fa9b7e61740 1 --2- 172.21.15.79:0/375002018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562acb733200 0x562acb73a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:16.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.066+0000 7fa9b7e61740 1 --2- 172.21.15.79:0/375002018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562acb7308d0 0x562acb73a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:16.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.066+0000 7fa9b7e61740 1 -- 172.21.15.79:0/375002018 >> 172.21.15.79:0/375002018 conn(0x562acb72ba20 msgr2=0x562acb72aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:16.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.066+0000 7fa992ff5640 0 client.16539 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:16.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.067+0000 7fa9b7e61740 1 -- 172.21.15.79:0/375002018 shutdown_connections 2024-08-20T01:40:16.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.067+0000 7fa9b7e61740 1 -- 172.21.15.79:0/375002018 wait complete. 2024-08-20T01:40:16.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.067+0000 7fa9b7e61740 20 client.16539 trim_cache size 0 max 16384 2024-08-20T01:40:16.088 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.085+0000 7fa9b7e61740 1 Processor -- start 2024-08-20T01:40:16.088 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.085+0000 7fa9b7e61740 1 -- start start 2024-08-20T01:40:16.088 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.085+0000 7fa9b7e61740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562acb7308d0 0x562acb726780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:16.088 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.085+0000 7fa9b7e61740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562acb733200 0x562acb739020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:16.088 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.085+0000 7fa9b7e61740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562acb735c40 0x562acb739560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:16.089 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.085+0000 7fa9b7e61740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b01a9a30 con 0x562acb7308d0 2024-08-20T01:40:16.089 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.085+0000 7fa9b7e61740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b01ab6c0 con 0x562acb735c40 2024-08-20T01:40:16.089 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.085+0000 7fa9b7e61740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b01aa100 con 0x562acb733200 2024-08-20T01:40:16.089 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.085+0000 7fa9aed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562acb7308d0 0x562acb726780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:16.089 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.086+0000 7fa9aed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562acb7308d0 0x562acb726780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41132/0 (socket says 172.21.15.79:41132) 2024-08-20T01:40:16.089 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.086+0000 7fa9aed9d640 1 -- 172.21.15.79:0/2412627025 learned_addr learned my addr 172.21.15.79:0/2412627025 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:16.089 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.086+0000 7fa9af59e640 1 --2- 172.21.15.79:0/2412627025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562acb735c40 0x562acb739560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:16.089 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.086+0000 7fa9ae59c640 1 --2- 172.21.15.79:0/2412627025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562acb733200 0x562acb739020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:16.089 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.086+0000 7fa9aed9d640 1 -- 172.21.15.79:0/2412627025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562acb733200 msgr2=0x562acb739020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:16.089 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.086+0000 7fa9aed9d640 1 --2- 172.21.15.79:0/2412627025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562acb733200 0x562acb739020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:16.089 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.086+0000 7fa9aed9d640 1 -- 172.21.15.79:0/2412627025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562acb735c40 msgr2=0x562acb739560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:16.090 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.086+0000 7fa9aed9d640 1 --2- 172.21.15.79:0/2412627025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562acb735c40 0x562acb739560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:16.090 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.086+0000 7fa9aed9d640 1 -- 172.21.15.79:0/2412627025 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562acb733030 con 0x562acb7308d0 2024-08-20T01:40:16.090 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.086+0000 7fa9ae59c640 1 --2- 172.21.15.79:0/2412627025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562acb733200 0x562acb739020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:40:16.090 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.086+0000 7fa9aed9d640 1 --2- 172.21.15.79:0/2412627025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562acb7308d0 0x562acb726780 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0011600 tx=0x7fa9a000b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fc061a3bf949ea2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:16.090 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.086+0000 7fa994ff9640 1 -- 172.21.15.79:0/2412627025 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a0005220 con 0x562acb7308d0 2024-08-20T01:40:16.090 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.086+0000 7fa994ff9640 1 -- 172.21.15.79:0/2412627025 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa9a0004c30 con 0x562acb7308d0 2024-08-20T01:40:16.090 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.086+0000 7fa994ff9640 1 -- 172.21.15.79:0/2412627025 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a0010a90 con 0x562acb7308d0 2024-08-20T01:40:16.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.087+0000 7fa9b7e61740 1 -- 172.21.15.79:0/2412627025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562acb7308d0 msgr2=0x562acb726780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:16.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.087+0000 7fa9b7e61740 1 --2- 172.21.15.79:0/2412627025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562acb7308d0 0x562acb726780 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0011600 tx=0x7fa9a000b390 comp rx=0 tx=0).stop 2024-08-20T01:40:16.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.087+0000 7fa9b7e61740 1 -- 172.21.15.79:0/2412627025 shutdown_connections 2024-08-20T01:40:16.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.087+0000 7fa9b7e61740 1 --2- 172.21.15.79:0/2412627025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562acb735c40 0x562acb739560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:16.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.087+0000 7fa9b7e61740 1 --2- 172.21.15.79:0/2412627025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562acb733200 0x562acb739020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:16.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.087+0000 7fa9b7e61740 1 --2- 172.21.15.79:0/2412627025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562acb7308d0 0x562acb726780 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:16.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.087+0000 7fa9b7e61740 1 -- 172.21.15.79:0/2412627025 >> 172.21.15.79:0/2412627025 conn(0x562acb72ba20 msgr2=0x562acb73a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:16.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.087+0000 7fa9b7e61740 1 -- 172.21.15.79:0/2412627025 shutdown_connections 2024-08-20T01:40:16.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.087+0000 7fa9b7e61740 1 -- 172.21.15.79:0/2412627025 wait complete. 2024-08-20T01:40:16.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.088+0000 7fa9b7e61740 1 -- start start 2024-08-20T01:40:16.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.088+0000 7fa9b7e61740 1 Processor -- start 2024-08-20T01:40:16.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.088+0000 7fa9b7e61740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562acb7308d0 0x562acb73c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:16.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.088+0000 7fa9b7e61740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562acb733200 0x562acb73cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:16.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.088+0000 7fa9b7e61740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562acb735c40 0x562acb73d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:16.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.088+0000 7fa9b7e61740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b01aaf30 con 0x562acb7308d0 2024-08-20T01:40:16.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.088+0000 7fa9b7e61740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b01aa7d0 con 0x562acb733200 2024-08-20T01:40:16.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.088+0000 7fa9b7e61740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b01a7a10 con 0x562acb735c40 2024-08-20T01:40:16.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.088+0000 7fa9b7e61740 10 client.0 _ll_register_callbacks cb 0x7fa9a801f020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:16.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.088+0000 7fa9aed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562acb7308d0 0x562acb73c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:16.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.088+0000 7fa9aed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562acb7308d0 0x562acb73c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41144/0 (socket says 172.21.15.79:41144) 2024-08-20T01:40:16.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.088+0000 7fa9aed9d640 1 -- 172.21.15.79:0/895261915 learned_addr learned my addr 172.21.15.79:0/895261915 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:16.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.088+0000 7fa9ae59c640 1 --2- 172.21.15.79:0/895261915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562acb733200 0x562acb73cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.088+0000 7fa9af59e640 1 --2- 172.21.15.79:0/895261915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562acb735c40 0x562acb73d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.088+0000 7fa9aed9d640 1 -- 172.21.15.79:0/895261915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562acb735c40 msgr2=0x562acb73d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.088+0000 7fa9aed9d640 1 --2- 172.21.15.79:0/895261915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562acb735c40 0x562acb73d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.088+0000 7fa9aed9d640 1 -- 172.21.15.79:0/895261915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562acb733200 msgr2=0x562acb73cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.088+0000 7fa9aed9d640 1 --2- 172.21.15.79:0/895261915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562acb733200 0x562acb73cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.088+0000 7fa9aed9d640 1 -- 172.21.15.79:0/895261915 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562acb73e140 con 0x562acb7308d0 2024-08-20T01:40:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.089+0000 7fa9af59e640 1 --2- 172.21.15.79:0/895261915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562acb735c40 0x562acb73d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:40:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.089+0000 7fa9aed9d640 1 --2- 172.21.15.79:0/895261915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562acb7308d0 0x562acb73c6a0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0010610 tx=0x7fa9a0004550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bcfb711f4b9d171 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.089+0000 7fa992ff5640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:40:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.089+0000 7fa992ff5640 1 -- 172.21.15.79:0/895261915 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a0005220 con 0x562acb7308d0 2024-08-20T01:40:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.089+0000 7fa992ff5640 1 -- 172.21.15.79:0/895261915 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fa9a00053c0 con 0x562acb7308d0 2024-08-20T01:40:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.089+0000 7fa9b7e61740 1 -- 172.21.15.79:0/895261915 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9a0004c30 con 0x562acb7308d0 2024-08-20T01:40:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.089+0000 7fa992ff5640 1 -- 172.21.15.79:0/895261915 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fa9a0004a40 con 0x562acb7308d0 2024-08-20T01:40:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.089+0000 7fa9b7e61740 10 client.16545 fetch_fsmap learned FSMap version 33 2024-08-20T01:40:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.089+0000 7fa9b7e61740 1 -- 172.21.15.79:0/895261915 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x562acb741430 con 0x562acb7308d0 2024-08-20T01:40:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.089+0000 7fa992ff5640 1 -- 172.21.15.79:0/895261915 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa9a0004c30 con 0x562acb7308d0 2024-08-20T01:40:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.089+0000 7fa992ff5640 1 -- 172.21.15.79:0/895261915 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7fa9a0026590 con 0x562acb7308d0 2024-08-20T01:40:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.089+0000 7fa9b7e61740 10 client.16545 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:40:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.089+0000 7fa9b7e61740 10 client.16545 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:40:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.089+0000 7fa9b7e61740 20 client.16545 populate_metadata read hostname 'smithi079' 2024-08-20T01:40:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.090+0000 7fa9b7e61740 1 --2- 172.21.15.79:0/895261915 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x562acb741eb0 0x562acb7b69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.090+0000 7fa9b7e61740 4 client.16545 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:40:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.090+0000 7fa9b7e61740 1 -- 172.21.15.79:0/895261915 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562acb6a0d50 con 0x562acb741eb0 2024-08-20T01:40:16.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.090+0000 7fa9ae59c640 1 --2- 172.21.15.79:0/895261915 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x562acb741eb0 0x562acb7b69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:16.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.090+0000 7fa9ae59c640 1 --2- 172.21.15.79:0/895261915 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x562acb741eb0 0x562acb7b69a0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a421fa6ed4ff7dc server_cookie=f00978e43b9d6642 in_seq=0 out_seq=0 2024-08-20T01:40:16.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.090+0000 7fa992ff5640 10 client.16545 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:16.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.098+0000 7fa992ff5640 1 -- 172.21.15.79:0/895261915 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562acb6a0d50 con 0x562acb741eb0 2024-08-20T01:40:16.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.098+0000 7fa992ff5640 10 client.16545 handle_command_reply: tid=0 2024-08-20T01:40:16.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.098+0000 7fa9b7e61740 1 client.16545 shutdown 2024-08-20T01:40:16.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.098+0000 7fa9b7e61740 1 -- 172.21.15.79:0/895261915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562acb7308d0 msgr2=0x562acb73c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:16.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.098+0000 7fa9b7e61740 1 --2- 172.21.15.79:0/895261915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562acb7308d0 0x562acb73c6a0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0010610 tx=0x7fa9a0004550 comp rx=0 tx=0).stop 2024-08-20T01:40:16.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.098+0000 7fa9b7e61740 1 -- 172.21.15.79:0/895261915 shutdown_connections 2024-08-20T01:40:16.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.098+0000 7fa9b7e61740 1 --2- 172.21.15.79:0/895261915 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x562acb741eb0 0x562acb7b69a0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:16.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.098+0000 7fa9b7e61740 1 --2- 172.21.15.79:0/895261915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562acb735c40 0x562acb73d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:16.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.098+0000 7fa9b7e61740 1 --2- 172.21.15.79:0/895261915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562acb733200 0x562acb73cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:16.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.098+0000 7fa9b7e61740 1 --2- 172.21.15.79:0/895261915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562acb7308d0 0x562acb73c6a0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:16.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.098+0000 7fa9b7e61740 1 -- 172.21.15.79:0/895261915 >> 172.21.15.79:0/895261915 conn(0x562acb72ba20 msgr2=0x562acb73a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:16.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.098+0000 7fa992ff5640 0 client.16545 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:16.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.098+0000 7fa9b7e61740 1 -- 172.21.15.79:0/895261915 shutdown_connections 2024-08-20T01:40:16.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.098+0000 7fa9b7e61740 1 -- 172.21.15.79:0/895261915 wait complete. 2024-08-20T01:40:16.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.098+0000 7fa9b7e61740 20 client.16545 trim_cache size 0 max 16384 2024-08-20T01:40:16.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:40:16.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:40:16.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:40:16.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:40:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.098+0000 7fa9b5067640 1 -- 172.21.15.79:0/3830340363 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa9980b3bd0 msgr2=0x7fa9980b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.098+0000 7fa9b5067640 1 --2- 172.21.15.79:0/3830340363 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa9980b3bd0 0x7fa9980b6090 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8020000 tx=0x7fa9a801d000 comp rx=0 tx=0).stop 2024-08-20T01:40:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.098+0000 7fa9b5067640 1 -- 172.21.15.79:0/3830340363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9b01026b0 msgr2=0x7fa9b0199040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.098+0000 7fa9b5067640 1 --2- 172.21.15.79:0/3830340363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9b01026b0 0x7fa9b0199040 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fa9a4005ab0 tx=0x7fa9a40042f0 comp rx=0 tx=0).stop 2024-08-20T01:40:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.099+0000 7fa9b5067640 1 -- 172.21.15.79:0/3830340363 shutdown_connections 2024-08-20T01:40:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.099+0000 7fa9b5067640 1 --2- 172.21.15.79:0/3830340363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9b0103070 0x7fa9b0199c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.099+0000 7fa9b5067640 1 --2- 172.21.15.79:0/3830340363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9b01026b0 0x7fa9b0199040 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.099+0000 7fa9b5067640 1 --2- 172.21.15.79:0/3830340363 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa9980b3bd0 0x7fa9980b6090 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.099+0000 7fa9b5067640 1 --2- 172.21.15.79:0/3830340363 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9b0101560 0x7fa9b01989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.099+0000 7fa9b5067640 1 -- 172.21.15.79:0/3830340363 >> 172.21.15.79:0/3830340363 conn(0x7fa9b00fce20 msgr2=0x7fa9b006ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.099+0000 7fa9b5067640 1 -- 172.21.15.79:0/3830340363 shutdown_connections 2024-08-20T01:40:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:16.099+0000 7fa9b5067640 1 -- 172.21.15.79:0/3830340363 wait complete. 2024-08-20T01:40:16.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:16 smithi175 ceph-mon[22392]: pgmap v435: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 29 MiB/s wr, 50 op/s 2024-08-20T01:40:16.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:16 smithi079 ceph-mon[18656]: pgmap v435: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 29 MiB/s wr, 50 op/s 2024-08-20T01:40:16.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:16 smithi081 ceph-mon[22209]: pgmap v435: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 29 MiB/s wr, 50 op/s 2024-08-20T01:40:18.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:18 smithi175 ceph-mon[22392]: pgmap v436: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 26 MiB/s wr, 46 op/s 2024-08-20T01:40:18.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:18 smithi079 ceph-mon[18656]: pgmap v436: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 26 MiB/s wr, 46 op/s 2024-08-20T01:40:18.527 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:18 smithi081 ceph-mon[22209]: pgmap v436: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 26 MiB/s wr, 46 op/s 2024-08-20T01:40:20.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:20 smithi175 ceph-mon[22392]: pgmap v437: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 30 MiB/s wr, 46 op/s 2024-08-20T01:40:20.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:20 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:40:20.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:20 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:40:20.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:20 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:40:20.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:20 smithi079 ceph-mon[18656]: pgmap v437: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 30 MiB/s wr, 46 op/s 2024-08-20T01:40:20.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:20 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:40:20.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:20 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:40:20.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:20 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:40:20.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:20 smithi081 ceph-mon[22209]: pgmap v437: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 30 MiB/s wr, 46 op/s 2024-08-20T01:40:20.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:20 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:40:20.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:20 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:40:20.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:20 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:40:21.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:21 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:40:21.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:21 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:40:21.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:21 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:40:22.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:22 smithi175 ceph-mon[22392]: pgmap v438: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 29 MiB/s wr, 31 op/s 2024-08-20T01:40:22.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:22 smithi079 ceph-mon[18656]: pgmap v438: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 29 MiB/s wr, 31 op/s 2024-08-20T01:40:22.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:22 smithi081 ceph-mon[22209]: pgmap v438: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 29 MiB/s wr, 31 op/s 2024-08-20T01:40:24.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:24 smithi175 ceph-mon[22392]: pgmap v439: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 29 MiB/s wr, 22 op/s 2024-08-20T01:40:24.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:24 smithi079 ceph-mon[18656]: pgmap v439: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 29 MiB/s wr, 22 op/s 2024-08-20T01:40:24.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:24 smithi081 ceph-mon[22209]: pgmap v439: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 29 MiB/s wr, 22 op/s 2024-08-20T01:40:26.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:26 smithi175 ceph-mon[22392]: pgmap v440: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 31 MiB/s wr, 26 op/s 2024-08-20T01:40:26.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:26 smithi079 ceph-mon[18656]: pgmap v440: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 31 MiB/s wr, 26 op/s 2024-08-20T01:40:26.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:26 smithi081 ceph-mon[22209]: pgmap v440: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 31 MiB/s wr, 26 op/s 2024-08-20T01:40:28.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:28 smithi175 ceph-mon[22392]: pgmap v441: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 29 MiB/s wr, 23 op/s 2024-08-20T01:40:28.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:28 smithi079 ceph-mon[18656]: pgmap v441: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 29 MiB/s wr, 23 op/s 2024-08-20T01:40:28.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:28 smithi081 ceph-mon[22209]: pgmap v441: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 29 MiB/s wr, 23 op/s 2024-08-20T01:40:29.202 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.197+0000 7f4dd3183640 1 -- 172.21.15.79:0/1278035266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4dcc104170 msgr2=0x7f4dcc10aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:29.202 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.197+0000 7f4dd3183640 1 --2- 172.21.15.79:0/1278035266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4dcc104170 0x7f4dcc10aaf0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4009cd0 tx=0x7f4dc402a8e0 comp rx=0 tx=0).stop 2024-08-20T01:40:29.203 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.197+0000 7f4dd3183640 1 -- 172.21.15.79:0/1278035266 shutdown_connections 2024-08-20T01:40:29.203 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.197+0000 7f4dd3183640 1 --2- 172.21.15.79:0/1278035266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4dcc104170 0x7f4dcc10aaf0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:29.203 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.197+0000 7f4dd3183640 1 --2- 172.21.15.79:0/1278035266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4dcc1037b0 0x7f4dcc103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:29.203 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.197+0000 7f4dd3183640 1 --2- 172.21.15.79:0/1278035266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dcc102660 0x7f4dcc102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:29.203 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.197+0000 7f4dd3183640 1 -- 172.21.15.79:0/1278035266 >> 172.21.15.79:0/1278035266 conn(0x7f4dcc0fdf20 msgr2=0x7f4dcc100340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:29.203 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.197+0000 7f4dd3183640 1 -- 172.21.15.79:0/1278035266 shutdown_connections 2024-08-20T01:40:29.203 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.197+0000 7f4dd3183640 1 -- 172.21.15.79:0/1278035266 wait complete. 2024-08-20T01:40:29.203 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.197+0000 7f4dd3183640 1 Processor -- start 2024-08-20T01:40:29.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.197+0000 7f4dd3183640 1 -- start start 2024-08-20T01:40:29.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.197+0000 7f4dd3183640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4dcc102660 0x7f4dcc198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:29.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.197+0000 7f4dd3183640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4dcc1037b0 0x7f4dcc198f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:29.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.197+0000 7f4dd3183640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dcc104170 0x7f4dcc199bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:29.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.197+0000 7f4dd3183640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4dcc10e1d0 con 0x7f4dcc1037b0 2024-08-20T01:40:29.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.197+0000 7f4dd3183640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4dcc10e050 con 0x7f4dcc104170 2024-08-20T01:40:29.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.197+0000 7f4dd3183640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4dcc10e350 con 0x7f4dcc102660 2024-08-20T01:40:29.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.198+0000 7f4dcbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4dcc1037b0 0x7f4dcc198f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:29.205 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.198+0000 7f4dcbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4dcc1037b0 0x7f4dcc198f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33250/0 (socket says 172.21.15.79:33250) 2024-08-20T01:40:29.205 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.198+0000 7f4dcbfff640 1 -- 172.21.15.79:0/4115893722 learned_addr learned my addr 172.21.15.79:0/4115893722 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:29.205 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.198+0000 7f4dd0f1f640 1 --2- 172.21.15.79:0/4115893722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4dcc102660 0x7f4dcc198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:29.205 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.198+0000 7f4dd1720640 1 --2- 172.21.15.79:0/4115893722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dcc104170 0x7f4dcc199bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:29.205 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.198+0000 7f4dcbfff640 1 -- 172.21.15.79:0/4115893722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4dcc102660 msgr2=0x7f4dcc198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:29.205 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.198+0000 7f4dcbfff640 1 --2- 172.21.15.79:0/4115893722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4dcc102660 0x7f4dcc198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:29.205 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.198+0000 7f4dcbfff640 1 -- 172.21.15.79:0/4115893722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dcc104170 msgr2=0x7f4dcc199bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:29.205 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.198+0000 7f4dcbfff640 1 --2- 172.21.15.79:0/4115893722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dcc104170 0x7f4dcc199bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:29.205 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.198+0000 7f4dcbfff640 1 -- 172.21.15.79:0/4115893722 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dcc19a470 con 0x7f4dcc1037b0 2024-08-20T01:40:29.206 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.198+0000 7f4dcbfff640 1 --2- 172.21.15.79:0/4115893722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4dcc1037b0 0x7f4dcc198f80 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f4db800e9f0 tx=0x7f4db800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:29.206 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.198+0000 7f4dc9ffb640 1 -- 172.21.15.79:0/4115893722 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db800cd80 con 0x7f4dcc1037b0 2024-08-20T01:40:29.206 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.198+0000 7f4dc9ffb640 1 -- 172.21.15.79:0/4115893722 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4db80054b0 con 0x7f4dcc1037b0 2024-08-20T01:40:29.206 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.198+0000 7f4dd3183640 1 -- 172.21.15.79:0/4115893722 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dcc19a760 con 0x7f4dcc1037b0 2024-08-20T01:40:29.206 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.198+0000 7f4dc9ffb640 1 -- 172.21.15.79:0/4115893722 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db8010430 con 0x7f4dcc1037b0 2024-08-20T01:40:29.206 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.199+0000 7f4dd3183640 1 -- 172.21.15.79:0/4115893722 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dcc1a0e30 con 0x7f4dcc1037b0 2024-08-20T01:40:29.215 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.201+0000 7f4dc9ffb640 1 -- 172.21.15.79:0/4115893722 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f4db80046c0 con 0x7f4dcc1037b0 2024-08-20T01:40:29.215 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.201+0000 7f4dd6048740 1 Processor -- start 2024-08-20T01:40:29.215 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.202+0000 7f4dd6048740 1 -- start start 2024-08-20T01:40:29.215 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.202+0000 7f4dd6048740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b1e46fa40 0x557b1e471e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:29.215 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.202+0000 7f4dd6048740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b1e472370 0x557b1e474760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:29.215 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.202+0000 7f4dd6048740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b1e474db0 0x557b1e477270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:29.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.202+0000 7f4dd6048740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557b1e3de360 con 0x557b1e474db0 2024-08-20T01:40:29.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.202+0000 7f4dd6048740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557b1e3cd860 con 0x557b1e46fa40 2024-08-20T01:40:29.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.202+0000 7f4dd6048740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557b1e3d18a0 con 0x557b1e472370 2024-08-20T01:40:29.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.202+0000 7f4dc9ffb640 1 --2- 172.21.15.79:0/4115893722 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4dbc0b3bd0 0x7f4dbc0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:29.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.202+0000 7f4dcbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b1e474db0 0x557b1e477270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:29.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.202+0000 7f4dcbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b1e474db0 0x557b1e477270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33260/0 (socket says 172.21.15.79:33260) 2024-08-20T01:40:29.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.202+0000 7f4dcbfff640 1 -- 172.21.15.79:0/2189881515 learned_addr learned my addr 172.21.15.79:0/2189881515 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:29.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.202+0000 7f4dd1720640 1 --2- 172.21.15.79:0/2189881515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b1e46fa40 0x557b1e471e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:29.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.202+0000 7f4dd0f1f640 1 --2- 172.21.15.79:0/2189881515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b1e472370 0x557b1e474760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:29.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.202+0000 7f4dd1720640 1 --2- 172.21.15.79:0/4115893722 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4dbc0b3bd0 0x7f4dbc0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:29.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.202+0000 7f4dc9ffb640 1 -- 172.21.15.79:0/4115893722 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f4db80e3f50 con 0x7f4dcc1037b0 2024-08-20T01:40:29.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.202+0000 7f4dcbfff640 1 -- 172.21.15.79:0/2189881515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b1e472370 msgr2=0x557b1e474760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:29.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.202+0000 7f4dcbfff640 1 --2- 172.21.15.79:0/2189881515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b1e472370 0x557b1e474760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:29.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.202+0000 7f4dcbfff640 1 -- 172.21.15.79:0/2189881515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b1e46fa40 msgr2=0x557b1e471e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:29.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.202+0000 7f4dcbfff640 1 --2- 172.21.15.79:0/2189881515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b1e46fa40 0x557b1e471e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:29.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.202+0000 7f4dcbfff640 1 -- 172.21.15.79:0/2189881515 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b1e374e40 con 0x557b1e474db0 2024-08-20T01:40:29.218 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.203+0000 7f4dcbfff640 1 --2- 172.21.15.79:0/2189881515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b1e474db0 0x557b1e477270 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f4db8023080 tx=0x7f4db8009720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8981395e5fb84968 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:29.218 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.203+0000 7f4db6ffd640 1 -- 172.21.15.79:0/2189881515 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db80ab5b0 con 0x557b1e474db0 2024-08-20T01:40:29.218 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.203+0000 7f4dd1720640 1 --2- 172.21.15.79:0/4115893722 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4dbc0b3bd0 0x7f4dbc0b6090 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4005e30 tx=0x7f4dc4031790 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:29.218 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.203+0000 7f4db6ffd640 1 -- 172.21.15.79:0/2189881515 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4db80aaeb0 con 0x557b1e474db0 2024-08-20T01:40:29.218 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.203+0000 7f4db6ffd640 1 -- 172.21.15.79:0/2189881515 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db80c00e0 con 0x557b1e474db0 2024-08-20T01:40:29.218 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.204+0000 7f4dd6048740 1 -- 172.21.15.79:0/2189881515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b1e474db0 msgr2=0x557b1e477270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:29.218 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.204+0000 7f4dd6048740 1 --2- 172.21.15.79:0/2189881515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b1e474db0 0x557b1e477270 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f4db8023080 tx=0x7f4db8009720 comp rx=0 tx=0).stop 2024-08-20T01:40:29.218 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.204+0000 7f4dd6048740 1 -- 172.21.15.79:0/2189881515 shutdown_connections 2024-08-20T01:40:29.218 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.204+0000 7f4dd6048740 1 --2- 172.21.15.79:0/2189881515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b1e474db0 0x557b1e477270 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.204+0000 7f4dd6048740 1 --2- 172.21.15.79:0/2189881515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b1e472370 0x557b1e474760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.204+0000 7f4dd6048740 1 --2- 172.21.15.79:0/2189881515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b1e46fa40 0x557b1e471e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.204+0000 7f4dd6048740 1 -- 172.21.15.79:0/2189881515 >> 172.21.15.79:0/2189881515 conn(0x557b1e466730 msgr2=0x557b1e467510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.204+0000 7f4dd6048740 1 -- 172.21.15.79:0/2189881515 shutdown_connections 2024-08-20T01:40:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.204+0000 7f4dd6048740 1 -- 172.21.15.79:0/2189881515 wait complete. 2024-08-20T01:40:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.204+0000 7f4dd6048740 1 -- start start 2024-08-20T01:40:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.204+0000 7f4dd6048740 1 Processor -- start 2024-08-20T01:40:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.205+0000 7f4dd6048740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b1e46fa40 0x557b1e479310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.205+0000 7f4dd6048740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b1e472370 0x557b1e4799b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:29.220 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.205+0000 7f4dd6048740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b1e474db0 0x557b1e47a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:29.220 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.205+0000 7f4dd6048740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557b1e306ab0 con 0x557b1e46fa40 2024-08-20T01:40:29.220 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.205+0000 7f4dd6048740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557b1e354780 con 0x557b1e472370 2024-08-20T01:40:29.220 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.205+0000 7f4dd6048740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557b1e477d90 con 0x557b1e474db0 2024-08-20T01:40:29.220 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.205+0000 7f4dd0f1f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b1e46fa40 0x557b1e479310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:29.220 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.205+0000 7f4dd6048740 10 client.0 _ll_register_callbacks cb 0x557b1e0dca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:29.220 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.205+0000 7f4dd0f1f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b1e46fa40 0x557b1e479310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33272/0 (socket says 172.21.15.79:33272) 2024-08-20T01:40:29.220 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.205+0000 7f4dd0f1f640 1 -- 172.21.15.79:0/904703160 learned_addr learned my addr 172.21.15.79:0/904703160 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:29.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.205+0000 7f4dcbfff640 1 --2- 172.21.15.79:0/904703160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b1e472370 0x557b1e4799b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:29.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.205+0000 7f4dd1720640 1 --2- 172.21.15.79:0/904703160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b1e474db0 0x557b1e47a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:29.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.205+0000 7f4dd0f1f640 1 -- 172.21.15.79:0/904703160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b1e474db0 msgr2=0x557b1e47a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:29.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.205+0000 7f4dd0f1f640 1 --2- 172.21.15.79:0/904703160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b1e474db0 0x557b1e47a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:29.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.205+0000 7f4dd0f1f640 1 -- 172.21.15.79:0/904703160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b1e472370 msgr2=0x557b1e4799b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:29.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.205+0000 7f4dd0f1f640 1 --2- 172.21.15.79:0/904703160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b1e472370 0x557b1e4799b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:29.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.205+0000 7f4dd0f1f640 1 -- 172.21.15.79:0/904703160 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b1e130790 con 0x557b1e46fa40 2024-08-20T01:40:29.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.205+0000 7f4dd1720640 1 --2- 172.21.15.79:0/904703160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b1e474db0 0x557b1e47a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:40:29.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.205+0000 7f4dd0f1f640 1 --2- 172.21.15.79:0/904703160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b1e46fa40 0x557b1e479310 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0012840 tx=0x7f4dc0012d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b40b984a7a4aeae8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:29.222 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.205+0000 7f4dabfff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:40:29.222 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.205+0000 7f4dabfff640 1 -- 172.21.15.79:0/904703160 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc000f8a0 con 0x557b1e46fa40 2024-08-20T01:40:29.222 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.205+0000 7f4dd6048740 1 -- 172.21.15.79:0/904703160 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557b1e37ce00 con 0x557b1e46fa40 2024-08-20T01:40:29.222 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.205+0000 7f4dabfff640 1 -- 172.21.15.79:0/904703160 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f4dc000fa40 con 0x557b1e46fa40 2024-08-20T01:40:29.222 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.206+0000 7f4dabfff640 1 -- 172.21.15.79:0/904703160 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f4dc000fc40 con 0x557b1e46fa40 2024-08-20T01:40:29.222 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.206+0000 7f4dd6048740 10 client.16557 fetch_fsmap learned FSMap version 33 2024-08-20T01:40:29.222 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.206+0000 7f4dd6048740 1 -- 172.21.15.79:0/904703160 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x557b1e1a9620 con 0x557b1e46fa40 2024-08-20T01:40:29.222 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.206+0000 7f4dabfff640 1 -- 172.21.15.79:0/904703160 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x557b1e37ce00 con 0x557b1e46fa40 2024-08-20T01:40:29.227 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.206+0000 7f4dabfff640 1 -- 172.21.15.79:0/904703160 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7f4dc001c420 con 0x557b1e46fa40 2024-08-20T01:40:29.227 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.206+0000 7f4dd6048740 10 client.16557 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:40:29.227 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.206+0000 7f4dd6048740 10 client.16557 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:40:29.228 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.206+0000 7f4dd6048740 20 client.16557 populate_metadata read hostname 'smithi079' 2024-08-20T01:40:29.228 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.206+0000 7f4dd6048740 1 --2- 172.21.15.79:0/904703160 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557b1e484cc0 0x557b1e4870f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:29.228 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.206+0000 7f4dd6048740 4 client.16557 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:40:29.228 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.206+0000 7f4dd6048740 1 -- 172.21.15.79:0/904703160 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b1e3e02b0 con 0x557b1e484cc0 2024-08-20T01:40:29.228 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.206+0000 7f4dcbfff640 1 --2- 172.21.15.79:0/904703160 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557b1e484cc0 0x557b1e4870f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:29.228 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.207+0000 7f4dcbfff640 1 --2- 172.21.15.79:0/904703160 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557b1e484cc0 0x557b1e4870f0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2639ea322f95f2f6 server_cookie=c98e6c4624967d78 in_seq=0 out_seq=0 2024-08-20T01:40:29.228 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.207+0000 7f4dabfff640 10 client.16557 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:29.228 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.207+0000 7f4dabfff640 1 -- 172.21.15.79:0/904703160 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557b1e3e02b0 con 0x557b1e484cc0 2024-08-20T01:40:29.229 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.207+0000 7f4dabfff640 10 client.16557 handle_command_reply: tid=0 2024-08-20T01:40:29.229 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.207+0000 7f4dd6048740 1 client.16557 shutdown 2024-08-20T01:40:29.229 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.208+0000 7f4dd6048740 1 -- 172.21.15.79:0/904703160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b1e46fa40 msgr2=0x557b1e479310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:29.229 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.208+0000 7f4dd6048740 1 --2- 172.21.15.79:0/904703160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b1e46fa40 0x557b1e479310 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0012840 tx=0x7f4dc0012d00 comp rx=0 tx=0).stop 2024-08-20T01:40:29.229 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.208+0000 7f4dd6048740 1 -- 172.21.15.79:0/904703160 shutdown_connections 2024-08-20T01:40:29.229 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.208+0000 7f4dd6048740 1 --2- 172.21.15.79:0/904703160 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557b1e484cc0 0x557b1e4870f0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:29.229 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.208+0000 7f4dd6048740 1 --2- 172.21.15.79:0/904703160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b1e474db0 0x557b1e47a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:29.230 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.208+0000 7f4dabfff640 0 client.16557 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:29.230 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.208+0000 7f4dd6048740 1 --2- 172.21.15.79:0/904703160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b1e472370 0x557b1e4799b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:29.230 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.208+0000 7f4dd6048740 1 --2- 172.21.15.79:0/904703160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b1e46fa40 0x557b1e479310 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:29.230 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.208+0000 7f4dd6048740 1 -- 172.21.15.79:0/904703160 >> 172.21.15.79:0/904703160 conn(0x557b1e466730 msgr2=0x557b1e465850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:29.230 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.208+0000 7f4dd6048740 1 -- 172.21.15.79:0/904703160 shutdown_connections 2024-08-20T01:40:29.230 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.208+0000 7f4dd6048740 1 -- 172.21.15.79:0/904703160 wait complete. 2024-08-20T01:40:29.230 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.208+0000 7f4dd6048740 20 client.16557 trim_cache size 0 max 16384 2024-08-20T01:40:29.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.226+0000 7f4dd6048740 1 Processor -- start 2024-08-20T01:40:29.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.226+0000 7f4dd6048740 1 -- start start 2024-08-20T01:40:29.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.227+0000 7f4dd6048740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b1e46fa40 0x557b1e465030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:29.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.227+0000 7f4dd6048740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b1e472370 0x557b1e465570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:29.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.227+0000 7f4dd6048740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b1e474db0 0x557b1e4687a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:29.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.227+0000 7f4dd6048740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4dcc1a7870 con 0x557b1e46fa40 2024-08-20T01:40:29.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.227+0000 7f4dd6048740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4dcc1a9500 con 0x557b1e474db0 2024-08-20T01:40:29.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.227+0000 7f4dd6048740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4dcc1a7f40 con 0x557b1e472370 2024-08-20T01:40:29.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.227+0000 7f4dd0f1f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b1e46fa40 0x557b1e465030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:29.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.227+0000 7f4dd0f1f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b1e46fa40 0x557b1e465030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33280/0 (socket says 172.21.15.79:33280) 2024-08-20T01:40:29.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.227+0000 7f4dd0f1f640 1 -- 172.21.15.79:0/2462329402 learned_addr learned my addr 172.21.15.79:0/2462329402 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:29.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.227+0000 7f4dcbfff640 1 --2- 172.21.15.79:0/2462329402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b1e472370 0x557b1e465570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:29.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.227+0000 7f4dd1720640 1 --2- 172.21.15.79:0/2462329402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b1e474db0 0x557b1e4687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:29.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.227+0000 7f4dd0f1f640 1 -- 172.21.15.79:0/2462329402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b1e472370 msgr2=0x557b1e465570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:29.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.227+0000 7f4dd0f1f640 1 --2- 172.21.15.79:0/2462329402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b1e472370 0x557b1e465570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:29.241 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.227+0000 7f4dd0f1f640 1 -- 172.21.15.79:0/2462329402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b1e474db0 msgr2=0x557b1e4687a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:29.241 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.227+0000 7f4dd0f1f640 1 --2- 172.21.15.79:0/2462329402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b1e474db0 0x557b1e4687a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:29.241 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.227+0000 7f4dd0f1f640 1 -- 172.21.15.79:0/2462329402 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b1e47a8f0 con 0x557b1e46fa40 2024-08-20T01:40:29.241 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.227+0000 7f4dd1720640 1 --2- 172.21.15.79:0/2462329402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b1e474db0 0x557b1e4687a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:40:29.241 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.227+0000 7f4dcbfff640 1 --2- 172.21.15.79:0/2462329402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b1e472370 0x557b1e465570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:40:29.241 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.227+0000 7f4dd0f1f640 1 --2- 172.21.15.79:0/2462329402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b1e46fa40 0x557b1e465030 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0001eb0 tx=0x7f4dc0009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=580503eb0275c3d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:29.241 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.227+0000 7f4db67fc640 1 -- 172.21.15.79:0/2462329402 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc002b070 con 0x557b1e46fa40 2024-08-20T01:40:29.242 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.228+0000 7f4db67fc640 1 -- 172.21.15.79:0/2462329402 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4dc0022030 con 0x557b1e46fa40 2024-08-20T01:40:29.242 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.228+0000 7f4db67fc640 1 -- 172.21.15.79:0/2462329402 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc001cc60 con 0x557b1e46fa40 2024-08-20T01:40:29.242 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.228+0000 7f4dd6048740 1 -- 172.21.15.79:0/2462329402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b1e46fa40 msgr2=0x557b1e465030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:29.242 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.228+0000 7f4dd6048740 1 --2- 172.21.15.79:0/2462329402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b1e46fa40 0x557b1e465030 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0001eb0 tx=0x7f4dc0009f60 comp rx=0 tx=0).stop 2024-08-20T01:40:29.242 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.228+0000 7f4dd6048740 1 -- 172.21.15.79:0/2462329402 shutdown_connections 2024-08-20T01:40:29.242 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.228+0000 7f4dd6048740 1 --2- 172.21.15.79:0/2462329402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b1e474db0 0x557b1e4687a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:29.243 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.228+0000 7f4dd6048740 1 --2- 172.21.15.79:0/2462329402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b1e472370 0x557b1e465570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:29.243 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.228+0000 7f4dd6048740 1 --2- 172.21.15.79:0/2462329402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b1e46fa40 0x557b1e465030 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:29.243 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.228+0000 7f4dd6048740 1 -- 172.21.15.79:0/2462329402 >> 172.21.15.79:0/2462329402 conn(0x557b1e466730 msgr2=0x557b1e4671d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:29.243 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.228+0000 7f4dd6048740 1 -- 172.21.15.79:0/2462329402 shutdown_connections 2024-08-20T01:40:29.243 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.229+0000 7f4dd6048740 1 -- 172.21.15.79:0/2462329402 wait complete. 2024-08-20T01:40:29.243 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.229+0000 7f4dd6048740 1 -- start start 2024-08-20T01:40:29.244 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.229+0000 7f4dd6048740 1 Processor -- start 2024-08-20T01:40:29.244 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.229+0000 7f4dd6048740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b1e46fa40 0x557b1e47e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:29.244 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.229+0000 7f4dd6048740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b1e472370 0x557b1e47e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:29.244 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.229+0000 7f4dd6048740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b1e474db0 0x557b1e47f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:29.244 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.229+0000 7f4dd6048740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4dcc1a8d70 con 0x557b1e472370 2024-08-20T01:40:29.244 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.229+0000 7f4dd6048740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4dcc1a8610 con 0x557b1e474db0 2024-08-20T01:40:29.244 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.229+0000 7f4dd6048740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4dcc1a5850 con 0x557b1e46fa40 2024-08-20T01:40:29.245 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.229+0000 7f4dd6048740 10 client.0 _ll_register_callbacks cb 0x7f4dc0009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:29.245 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.229+0000 7f4dcbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b1e472370 0x557b1e47e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:29.245 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.229+0000 7f4dd0f1f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b1e46fa40 0x557b1e47e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:29.245 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.229+0000 7f4dcbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b1e472370 0x557b1e47e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33290/0 (socket says 172.21.15.79:33290) 2024-08-20T01:40:29.245 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.229+0000 7f4dcbfff640 1 -- 172.21.15.79:0/516016630 learned_addr learned my addr 172.21.15.79:0/516016630 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:29.245 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.230+0000 7f4dd1720640 1 --2- 172.21.15.79:0/516016630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b1e474db0 0x557b1e47f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:29.245 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.230+0000 7f4dcbfff640 1 -- 172.21.15.79:0/516016630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b1e46fa40 msgr2=0x557b1e47e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:29.246 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.230+0000 7f4dcbfff640 1 --2- 172.21.15.79:0/516016630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b1e46fa40 0x557b1e47e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:29.246 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.230+0000 7f4dcbfff640 1 -- 172.21.15.79:0/516016630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b1e474db0 msgr2=0x557b1e47f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:29.246 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.230+0000 7f4dcbfff640 1 --2- 172.21.15.79:0/516016630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b1e474db0 0x557b1e47f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:29.246 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.230+0000 7f4dcbfff640 1 -- 172.21.15.79:0/516016630 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b1e47fd20 con 0x557b1e472370 2024-08-20T01:40:29.246 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.230+0000 7f4dd0f1f640 1 --2- 172.21.15.79:0/516016630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b1e46fa40 0x557b1e47e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:40:29.247 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.230+0000 7f4dcbfff640 1 --2- 172.21.15.79:0/516016630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b1e472370 0x557b1e47e920 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f4db800e9c0 tx=0x7f4db80a7500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed8831bbdad55a21 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:29.247 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.230+0000 7f4dabfff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:40:29.247 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.230+0000 7f4dabfff640 1 -- 172.21.15.79:0/516016630 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db80b3f60 con 0x557b1e472370 2024-08-20T01:40:29.247 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.230+0000 7f4dabfff640 1 -- 172.21.15.79:0/516016630 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f4db80b5220 con 0x557b1e472370 2024-08-20T01:40:29.247 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.230+0000 7f4dd6048740 1 -- 172.21.15.79:0/516016630 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4dc0022030 con 0x557b1e472370 2024-08-20T01:40:29.247 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.230+0000 7f4dabfff640 1 -- 172.21.15.79:0/516016630 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f4db80b5420 con 0x557b1e472370 2024-08-20T01:40:29.247 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.230+0000 7f4dd6048740 10 client.16563 fetch_fsmap learned FSMap version 33 2024-08-20T01:40:29.248 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.230+0000 7f4dd6048740 1 -- 172.21.15.79:0/516016630 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x557b1e481100 con 0x557b1e472370 2024-08-20T01:40:29.248 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.230+0000 7f4dabfff640 1 -- 172.21.15.79:0/516016630 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4dc0022030 con 0x557b1e472370 2024-08-20T01:40:29.248 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.231+0000 7f4dabfff640 1 -- 172.21.15.79:0/516016630 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7f4db80c00b0 con 0x557b1e472370 2024-08-20T01:40:29.248 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.231+0000 7f4dd6048740 10 client.16563 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:40:29.248 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.231+0000 7f4dd6048740 10 client.16563 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:40:29.248 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.231+0000 7f4dd6048740 20 client.16563 populate_metadata read hostname 'smithi079' 2024-08-20T01:40:29.248 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.231+0000 7f4dd6048740 1 --2- 172.21.15.79:0/516016630 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557b1e484cc0 0x557b1e4f19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:29.248 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.231+0000 7f4dd6048740 4 client.16563 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:40:29.249 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.231+0000 7f4dd6048740 1 -- 172.21.15.79:0/516016630 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557b1e3dbd50 con 0x557b1e484cc0 2024-08-20T01:40:29.249 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.231+0000 7f4dd0f1f640 1 --2- 172.21.15.79:0/516016630 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557b1e484cc0 0x557b1e4f19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:29.249 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.231+0000 7f4dd0f1f640 1 --2- 172.21.15.79:0/516016630 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557b1e484cc0 0x557b1e4f19f0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e016b2ab6400de6c server_cookie=6c653a95223ee580 in_seq=0 out_seq=0 2024-08-20T01:40:29.249 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.231+0000 7f4dabfff640 10 client.16563 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:29.251 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.239+0000 7f4dabfff640 1 -- 172.21.15.79:0/516016630 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557b1e3dbd50 con 0x557b1e484cc0 2024-08-20T01:40:29.251 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.239+0000 7f4dabfff640 10 client.16563 handle_command_reply: tid=0 2024-08-20T01:40:29.251 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.239+0000 7f4dd6048740 1 client.16563 shutdown 2024-08-20T01:40:29.252 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.239+0000 7f4dd6048740 1 -- 172.21.15.79:0/516016630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b1e472370 msgr2=0x557b1e47e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:29.252 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.239+0000 7f4dd6048740 1 --2- 172.21.15.79:0/516016630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b1e472370 0x557b1e47e920 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f4db800e9c0 tx=0x7f4db80a7500 comp rx=0 tx=0).stop 2024-08-20T01:40:29.252 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.240+0000 7f4dd6048740 1 -- 172.21.15.79:0/516016630 shutdown_connections 2024-08-20T01:40:29.252 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.240+0000 7f4dd6048740 1 --2- 172.21.15.79:0/516016630 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557b1e484cc0 0x557b1e4f19f0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:29.252 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.240+0000 7f4dd6048740 1 --2- 172.21.15.79:0/516016630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b1e474db0 0x557b1e47f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:29.252 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.240+0000 7f4dabfff640 0 client.16563 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:29.252 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.240+0000 7f4dd6048740 1 --2- 172.21.15.79:0/516016630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b1e472370 0x557b1e47e920 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:29.253 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.240+0000 7f4dd6048740 1 --2- 172.21.15.79:0/516016630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b1e46fa40 0x557b1e47e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:29.253 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.240+0000 7f4dd6048740 1 -- 172.21.15.79:0/516016630 >> 172.21.15.79:0/516016630 conn(0x557b1e466730 msgr2=0x557b1e4671d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:29.253 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.240+0000 7f4dd6048740 1 -- 172.21.15.79:0/516016630 shutdown_connections 2024-08-20T01:40:29.253 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.240+0000 7f4dd6048740 1 -- 172.21.15.79:0/516016630 wait complete. 2024-08-20T01:40:29.253 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.240+0000 7f4dd6048740 20 client.16563 trim_cache size 0 max 16384 2024-08-20T01:40:29.254 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:40:29.254 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:40:29.254 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:40:29.254 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:40:29.255 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.240+0000 7f4dd3183640 1 -- 172.21.15.79:0/4115893722 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4dbc0b3bd0 msgr2=0x7f4dbc0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:29.255 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.240+0000 7f4dd3183640 1 --2- 172.21.15.79:0/4115893722 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4dbc0b3bd0 0x7f4dbc0b6090 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4005e30 tx=0x7f4dc4031790 comp rx=0 tx=0).stop 2024-08-20T01:40:29.255 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.240+0000 7f4dd3183640 1 -- 172.21.15.79:0/4115893722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4dcc1037b0 msgr2=0x7f4dcc198f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:29.255 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.240+0000 7f4dd3183640 1 --2- 172.21.15.79:0/4115893722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4dcc1037b0 0x7f4dcc198f80 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f4db800e9f0 tx=0x7f4db800edf0 comp rx=0 tx=0).stop 2024-08-20T01:40:29.256 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.241+0000 7f4dd3183640 1 -- 172.21.15.79:0/4115893722 shutdown_connections 2024-08-20T01:40:29.256 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.241+0000 7f4dd3183640 1 --2- 172.21.15.79:0/4115893722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dcc104170 0x7f4dcc199bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:29.256 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.241+0000 7f4dd3183640 1 --2- 172.21.15.79:0/4115893722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4dcc1037b0 0x7f4dcc198f80 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:29.256 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.241+0000 7f4dd3183640 1 --2- 172.21.15.79:0/4115893722 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4dbc0b3bd0 0x7f4dbc0b6090 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:29.256 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.241+0000 7f4dd3183640 1 --2- 172.21.15.79:0/4115893722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4dcc102660 0x7f4dcc198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:29.256 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.241+0000 7f4dd3183640 1 -- 172.21.15.79:0/4115893722 >> 172.21.15.79:0/4115893722 conn(0x7f4dcc0fdf20 msgr2=0x7f4dcc106b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:29.256 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.241+0000 7f4dd3183640 1 -- 172.21.15.79:0/4115893722 shutdown_connections 2024-08-20T01:40:29.257 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:29.241+0000 7f4dd3183640 1 -- 172.21.15.79:0/4115893722 wait complete. 2024-08-20T01:40:30.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:30 smithi175 ceph-mon[22392]: pgmap v442: 97 pgs: 97 active+clean; 4.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 31 MiB/s wr, 26 op/s 2024-08-20T01:40:30.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:30 smithi079 ceph-mon[18656]: pgmap v442: 97 pgs: 97 active+clean; 4.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 31 MiB/s wr, 26 op/s 2024-08-20T01:40:30.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:30 smithi081 ceph-mon[22209]: pgmap v442: 97 pgs: 97 active+clean; 4.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 31 MiB/s wr, 26 op/s 2024-08-20T01:40:32.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:32 smithi175 ceph-mon[22392]: pgmap v443: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 28 MiB/s wr, 21 op/s 2024-08-20T01:40:32.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:32 smithi079 ceph-mon[18656]: pgmap v443: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 28 MiB/s wr, 21 op/s 2024-08-20T01:40:32.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:32 smithi081 ceph-mon[22209]: pgmap v443: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 28 MiB/s wr, 21 op/s 2024-08-20T01:40:34.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:34 smithi175 ceph-mon[22392]: pgmap v444: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 21 op/s 2024-08-20T01:40:34.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:34 smithi079 ceph-mon[18656]: pgmap v444: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 21 op/s 2024-08-20T01:40:34.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:34 smithi081 ceph-mon[22209]: pgmap v444: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 21 op/s 2024-08-20T01:40:36.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:36 smithi175 ceph-mon[22392]: pgmap v445: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 32 MiB/s wr, 26 op/s 2024-08-20T01:40:36.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:36 smithi079 ceph-mon[18656]: pgmap v445: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 32 MiB/s wr, 26 op/s 2024-08-20T01:40:36.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:36 smithi081 ceph-mon[22209]: pgmap v445: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 32 MiB/s wr, 26 op/s 2024-08-20T01:40:37.555 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:40:37.833 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:40:38.261 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:38 smithi079 ceph-mon[18656]: pgmap v446: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 31 MiB/s wr, 23 op/s 2024-08-20T01:40:38.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.356+0000 7f124c92d640 1 -- 172.21.15.79:0/194573988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12481084a0 msgr2=0x7f12481088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:38.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.356+0000 7f124c92d640 1 --2- 172.21.15.79:0/194573988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12481084a0 0x7f12481088e0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f123c009900 tx=0x7f123c02a410 comp rx=0 tx=0).stop 2024-08-20T01:40:38.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.357+0000 7f124c92d640 1 -- 172.21.15.79:0/194573988 shutdown_connections 2024-08-20T01:40:38.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.357+0000 7f124c92d640 1 --2- 172.21.15.79:0/194573988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1248108e20 0x7f124810f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:38.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.357+0000 7f124c92d640 1 --2- 172.21.15.79:0/194573988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12481084a0 0x7f12481088e0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:38.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.357+0000 7f124c92d640 1 --2- 172.21.15.79:0/194573988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1248102a90 0x7f1248102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:38.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.357+0000 7f124c92d640 1 -- 172.21.15.79:0/194573988 >> 172.21.15.79:0/194573988 conn(0x7f12480fe540 msgr2=0x7f1248100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:38.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.357+0000 7f124c92d640 1 -- 172.21.15.79:0/194573988 shutdown_connections 2024-08-20T01:40:38.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.357+0000 7f124c92d640 1 -- 172.21.15.79:0/194573988 wait complete. 2024-08-20T01:40:38.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.357+0000 7f124c92d640 1 Processor -- start 2024-08-20T01:40:38.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.358+0000 7f124c92d640 1 -- start start 2024-08-20T01:40:38.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.358+0000 7f124c92d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1248102a90 0x7f12480751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:38.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.358+0000 7f124c92d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12481084a0 0x7f1248075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:38.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.358+0000 7f124c92d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1248108e20 0x7f1248075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:38.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.358+0000 7f124c92d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1248112990 con 0x7f1248108e20 2024-08-20T01:40:38.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.358+0000 7f124c92d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1248112810 con 0x7f1248102a90 2024-08-20T01:40:38.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.358+0000 7f124c92d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1248112b10 con 0x7f12481084a0 2024-08-20T01:40:38.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.358+0000 7f1246d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1248108e20 0x7f1248075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:38.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.358+0000 7f1246d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1248108e20 0x7f1248075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39726/0 (socket says 172.21.15.79:39726) 2024-08-20T01:40:38.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.358+0000 7f1246d9d640 1 -- 172.21.15.79:0/2299189072 learned_addr learned my addr 172.21.15.79:0/2299189072 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:38.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.358+0000 7f1245d9b640 1 --2- 172.21.15.79:0/2299189072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12481084a0 0x7f1248075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:38.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.358+0000 7f124659c640 1 --2- 172.21.15.79:0/2299189072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1248102a90 0x7f12480751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:38.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.358+0000 7f1246d9d640 1 -- 172.21.15.79:0/2299189072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12481084a0 msgr2=0x7f1248075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:38.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.358+0000 7f1246d9d640 1 --2- 172.21.15.79:0/2299189072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12481084a0 0x7f1248075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:38.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.358+0000 7f1246d9d640 1 -- 172.21.15.79:0/2299189072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1248102a90 msgr2=0x7f12480751d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:38.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.358+0000 7f1246d9d640 1 --2- 172.21.15.79:0/2299189072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1248102a90 0x7f12480751d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:38.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.358+0000 7f1246d9d640 1 -- 172.21.15.79:0/2299189072 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12481a7340 con 0x7f1248108e20 2024-08-20T01:40:38.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.358+0000 7f124659c640 1 --2- 172.21.15.79:0/2299189072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1248102a90 0x7f12480751d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:40:38.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.359+0000 7f1246d9d640 1 --2- 172.21.15.79:0/2299189072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1248108e20 0x7f1248075c50 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f124000cad0 tx=0x7f124000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:38.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.359+0000 7f12377fe640 1 -- 172.21.15.79:0/2299189072 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f124000ae20 con 0x7f1248108e20 2024-08-20T01:40:38.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.359+0000 7f124c92d640 1 -- 172.21.15.79:0/2299189072 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12481a7630 con 0x7f1248108e20 2024-08-20T01:40:38.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.359+0000 7f12377fe640 1 -- 172.21.15.79:0/2299189072 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1240005020 con 0x7f1248108e20 2024-08-20T01:40:38.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.359+0000 7f12377fe640 1 -- 172.21.15.79:0/2299189072 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f124000f6b0 con 0x7f1248108e20 2024-08-20T01:40:38.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.359+0000 7f124c92d640 1 -- 172.21.15.79:0/2299189072 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12481a7af0 con 0x7f1248108e20 2024-08-20T01:40:38.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.362+0000 7f124ed26740 1 Processor -- start 2024-08-20T01:40:38.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.362+0000 7f12377fe640 1 -- 172.21.15.79:0/2299189072 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f12400051d0 con 0x7f1248108e20 2024-08-20T01:40:38.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.362+0000 7f124ed26740 1 -- start start 2024-08-20T01:40:38.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.363+0000 7f124ed26740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55750dcd36e0 0x55750dcd3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:38.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.363+0000 7f124ed26740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55750dcd4000 0x55750dcdfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:38.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.363+0000 7f124ed26740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55750dcdff90 0x55750dce2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:38.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.363+0000 7f124ed26740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55750dc4a8e0 con 0x55750dcd36e0 2024-08-20T01:40:38.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.363+0000 7f124ed26740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55750dc39de0 con 0x55750dcdff90 2024-08-20T01:40:38.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.363+0000 7f124ed26740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55750dc3de20 con 0x55750dcd4000 2024-08-20T01:40:38.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.363+0000 7f1245d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55750dcd36e0 0x55750dcd3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:38.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.363+0000 7f1245d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55750dcd36e0 0x55750dcd3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39732/0 (socket says 172.21.15.79:39732) 2024-08-20T01:40:38.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.363+0000 7f1245d9b640 1 -- 172.21.15.79:0/1642708451 learned_addr learned my addr 172.21.15.79:0/1642708451 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:38.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.363+0000 7f124659c640 1 --2- 172.21.15.79:0/1642708451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55750dcd4000 0x55750dcdfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:38.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.363+0000 7f1245d9b640 1 --2- 172.21.15.79:0/1642708451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55750dcdff90 0x55750dce2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:38.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.363+0000 7f124659c640 1 -- 172.21.15.79:0/1642708451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55750dcdff90 msgr2=0x55750dce2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:38.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.363+0000 7f124659c640 1 --2- 172.21.15.79:0/1642708451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55750dcdff90 0x55750dce2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:38.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.363+0000 7f124659c640 1 -- 172.21.15.79:0/1642708451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55750dcd36e0 msgr2=0x55750dcd3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:38.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.363+0000 7f124659c640 1 --2- 172.21.15.79:0/1642708451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55750dcd36e0 0x55750dcd3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:38.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.363+0000 7f124659c640 1 -- 172.21.15.79:0/1642708451 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55750d999650 con 0x55750dcd4000 2024-08-20T01:40:38.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.363+0000 7f1245d9b640 1 --2- 172.21.15.79:0/1642708451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55750dcd36e0 0x55750dcd3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:40:38.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.364+0000 7f12377fe640 1 --2- 172.21.15.79:0/2299189072 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f12300b3bd0 0x7f12300b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:38.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.364+0000 7f124659c640 1 --2- 172.21.15.79:0/1642708451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55750dcd4000 0x55750dcdfa50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f123800bc30 tx=0x7f123800f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebf718ad27116d2f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:38.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.364+0000 7f1245d9b640 1 --2- 172.21.15.79:0/2299189072 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f12300b3bd0 0x7f12300b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:38.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.364+0000 7f12377fe640 1 -- 172.21.15.79:0/2299189072 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f12400e3f20 con 0x7f1248108e20 2024-08-20T01:40:38.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.364+0000 7f1234ff9640 1 -- 172.21.15.79:0/1642708451 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1238004030 con 0x55750dcd4000 2024-08-20T01:40:38.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.364+0000 7f1234ff9640 1 -- 172.21.15.79:0/1642708451 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1238005020 con 0x55750dcd4000 2024-08-20T01:40:38.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.364+0000 7f1234ff9640 1 -- 172.21.15.79:0/1642708451 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1238004c00 con 0x55750dcd4000 2024-08-20T01:40:38.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.365+0000 7f124ed26740 1 -- 172.21.15.79:0/1642708451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55750dcd4000 msgr2=0x55750dcdfa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:38.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.365+0000 7f124ed26740 1 --2- 172.21.15.79:0/1642708451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55750dcd4000 0x55750dcdfa50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f123800bc30 tx=0x7f123800f730 comp rx=0 tx=0).stop 2024-08-20T01:40:38.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.365+0000 7f1245d9b640 1 --2- 172.21.15.79:0/2299189072 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f12300b3bd0 0x7f12300b6090 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x55750dcd3690 tx=0x7f123c005c00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:38.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.365+0000 7f124ed26740 1 -- 172.21.15.79:0/1642708451 shutdown_connections 2024-08-20T01:40:38.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.365+0000 7f124ed26740 1 --2- 172.21.15.79:0/1642708451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55750dcdff90 0x55750dce2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:38.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.365+0000 7f124ed26740 1 --2- 172.21.15.79:0/1642708451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55750dcd4000 0x55750dcdfa50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:38.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.365+0000 7f124ed26740 1 --2- 172.21.15.79:0/1642708451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55750dcd36e0 0x55750dcd3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:38.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.365+0000 7f124ed26740 1 -- 172.21.15.79:0/1642708451 >> 172.21.15.79:0/1642708451 conn(0x55750dcd1510 msgr2=0x55750dcd26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:38.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.365+0000 7f124ed26740 1 -- 172.21.15.79:0/1642708451 shutdown_connections 2024-08-20T01:40:38.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.365+0000 7f124ed26740 1 -- 172.21.15.79:0/1642708451 wait complete. 2024-08-20T01:40:38.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.365+0000 7f124ed26740 1 -- start start 2024-08-20T01:40:38.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.365+0000 7f124ed26740 1 Processor -- start 2024-08-20T01:40:38.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.365+0000 7f124ed26740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55750dcd36e0 0x55750dcdcfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:38.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.366+0000 7f124ed26740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55750dcd4000 0x55750dcdd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:38.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.366+0000 7f124ed26740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55750dcdff90 0x55750dcdda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:38.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.366+0000 7f124ed26740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55750da9c700 con 0x55750dcd4000 2024-08-20T01:40:38.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.366+0000 7f124ed26740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55750dbc07c0 con 0x55750dcd36e0 2024-08-20T01:40:38.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.366+0000 7f124ed26740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55750dce2c40 con 0x55750dcdff90 2024-08-20T01:40:38.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.366+0000 7f1245d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55750dcd4000 0x55750dcdd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:38.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.366+0000 7f1245d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55750dcd4000 0x55750dcdd4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39736/0 (socket says 172.21.15.79:39736) 2024-08-20T01:40:38.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.366+0000 7f1245d9b640 1 -- 172.21.15.79:0/1887956629 learned_addr learned my addr 172.21.15.79:0/1887956629 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:38.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.366+0000 7f124659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55750dcd36e0 0x55750dcdcfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:38.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.366+0000 7f124ed26740 10 client.0 _ll_register_callbacks cb 0x55750dc336b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:38.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.366+0000 7f1246d9d640 1 --2- 172.21.15.79:0/1887956629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55750dcdff90 0x55750dcdda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:38.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.366+0000 7f1245d9b640 1 -- 172.21.15.79:0/1887956629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55750dcdff90 msgr2=0x55750dcdda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:38.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.366+0000 7f1245d9b640 1 --2- 172.21.15.79:0/1887956629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55750dcdff90 0x55750dcdda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:38.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.366+0000 7f1245d9b640 1 -- 172.21.15.79:0/1887956629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55750dcd36e0 msgr2=0x55750dcdcfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:38.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.366+0000 7f1245d9b640 1 --2- 172.21.15.79:0/1887956629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55750dcd36e0 0x55750dcdcfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:38.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.366+0000 7f1245d9b640 1 -- 172.21.15.79:0/1887956629 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55750dcec070 con 0x55750dcd4000 2024-08-20T01:40:38.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.366+0000 7f124659c640 1 --2- 172.21.15.79:0/1887956629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55750dcd36e0 0x55750dcdcfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:40:38.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.366+0000 7f1245d9b640 1 --2- 172.21.15.79:0/1887956629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55750dcd4000 0x55750dcdd4e0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f123c0057c0 tx=0x7f123c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=806fa1d9c01964a8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:38.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.366+0000 7f122dffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:40:38.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.366+0000 7f122dffb640 1 -- 172.21.15.79:0/1887956629 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123c04e030 con 0x55750dcd4000 2024-08-20T01:40:38.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.366+0000 7f122dffb640 1 -- 172.21.15.79:0/1887956629 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f123c0043d0 con 0x55750dcd4000 2024-08-20T01:40:38.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.366+0000 7f124ed26740 1 -- 172.21.15.79:0/1887956629 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55750dbe9100 con 0x55750dcd4000 2024-08-20T01:40:38.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.367+0000 7f122dffb640 1 -- 172.21.15.79:0/1887956629 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f123c035040 con 0x55750dcd4000 2024-08-20T01:40:38.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.367+0000 7f124ed26740 10 client.16575 fetch_fsmap learned FSMap version 33 2024-08-20T01:40:38.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.367+0000 7f124ed26740 1 -- 172.21.15.79:0/1887956629 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55750dceea00 con 0x55750dcd4000 2024-08-20T01:40:38.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.367+0000 7f122dffb640 1 -- 172.21.15.79:0/1887956629 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55750dbe9100 con 0x55750dcd4000 2024-08-20T01:40:38.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.367+0000 7f122dffb640 1 -- 172.21.15.79:0/1887956629 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7f123c049040 con 0x55750dcd4000 2024-08-20T01:40:38.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.367+0000 7f124ed26740 10 client.16575 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:40:38.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.367+0000 7f124ed26740 10 client.16575 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:40:38.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.367+0000 7f124ed26740 20 client.16575 populate_metadata read hostname 'smithi079' 2024-08-20T01:40:38.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.367+0000 7f124ed26740 1 --2- 172.21.15.79:0/1887956629 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55750dceff60 0x55750dcf2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:38.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.367+0000 7f124ed26740 4 client.16575 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:40:38.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.367+0000 7f124ed26740 1 -- 172.21.15.79:0/1887956629 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55750dc4c830 con 0x55750dceff60 2024-08-20T01:40:38.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.367+0000 7f124659c640 1 --2- 172.21.15.79:0/1887956629 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55750dceff60 0x55750dcf2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:38.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.368+0000 7f124659c640 1 --2- 172.21.15.79:0/1887956629 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55750dceff60 0x55750dcf2420 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51ecfcbf73d8687d server_cookie=d2f86c781b542b94 in_seq=0 out_seq=0 2024-08-20T01:40:38.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.368+0000 7f122dffb640 10 client.16575 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:38.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.369+0000 7f122dffb640 1 -- 172.21.15.79:0/1887956629 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55750dc4c830 con 0x55750dceff60 2024-08-20T01:40:38.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.369+0000 7f122dffb640 10 client.16575 handle_command_reply: tid=0 2024-08-20T01:40:38.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.369+0000 7f124ed26740 1 client.16575 shutdown 2024-08-20T01:40:38.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.369+0000 7f124ed26740 1 -- 172.21.15.79:0/1887956629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55750dcd4000 msgr2=0x55750dcdd4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:38.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.369+0000 7f124ed26740 1 --2- 172.21.15.79:0/1887956629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55750dcd4000 0x55750dcdd4e0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f123c0057c0 tx=0x7f123c02a410 comp rx=0 tx=0).stop 2024-08-20T01:40:38.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.369+0000 7f124ed26740 1 -- 172.21.15.79:0/1887956629 shutdown_connections 2024-08-20T01:40:38.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.369+0000 7f124ed26740 1 --2- 172.21.15.79:0/1887956629 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55750dceff60 0x55750dcf2420 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:38.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.369+0000 7f124ed26740 1 --2- 172.21.15.79:0/1887956629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55750dcdff90 0x55750dcdda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:38.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.369+0000 7f124ed26740 1 --2- 172.21.15.79:0/1887956629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55750dcd4000 0x55750dcdd4e0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:38.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.369+0000 7f124ed26740 1 --2- 172.21.15.79:0/1887956629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55750dcd36e0 0x55750dcdcfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:38.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.369+0000 7f122dffb640 0 client.16575 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:38.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.369+0000 7f124ed26740 1 -- 172.21.15.79:0/1887956629 >> 172.21.15.79:0/1887956629 conn(0x55750dcd1510 msgr2=0x55750dcd70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:38.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.369+0000 7f124ed26740 1 -- 172.21.15.79:0/1887956629 shutdown_connections 2024-08-20T01:40:38.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.369+0000 7f124ed26740 1 -- 172.21.15.79:0/1887956629 wait complete. 2024-08-20T01:40:38.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.369+0000 7f124ed26740 20 client.16575 trim_cache size 0 max 16384 2024-08-20T01:40:38.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:38 smithi175 ceph-mon[22392]: pgmap v446: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 31 MiB/s wr, 23 op/s 2024-08-20T01:40:38.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.387+0000 7f124ed26740 1 Processor -- start 2024-08-20T01:40:38.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.387+0000 7f124ed26740 1 -- start start 2024-08-20T01:40:38.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.388+0000 7f124ed26740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55750dcd36e0 0x55750dcf7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:38.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.388+0000 7f124ed26740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55750dcdff90 0x55750dcf8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:38.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.388+0000 7f124ed26740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55750dcde5d0 0x55750dcdea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:38.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.388+0000 7f124ed26740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f12481b01a0 con 0x55750dcdff90 2024-08-20T01:40:38.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.388+0000 7f124ed26740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f12481b1e30 con 0x55750dcde5d0 2024-08-20T01:40:38.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.388+0000 7f124ed26740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f12481b0870 con 0x55750dcd36e0 2024-08-20T01:40:38.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.388+0000 7f1245d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55750dcdff90 0x55750dcf8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:38.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.388+0000 7f1245d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55750dcdff90 0x55750dcf8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39742/0 (socket says 172.21.15.79:39742) 2024-08-20T01:40:38.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.388+0000 7f1245d9b640 1 -- 172.21.15.79:0/2421460398 learned_addr learned my addr 172.21.15.79:0/2421460398 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:38.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.388+0000 7f124659c640 1 --2- 172.21.15.79:0/2421460398 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55750dcd36e0 0x55750dcf7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:38.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.388+0000 7f1246d9d640 1 --2- 172.21.15.79:0/2421460398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55750dcde5d0 0x55750dcdea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:38.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.388+0000 7f124659c640 1 -- 172.21.15.79:0/2421460398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55750dcde5d0 msgr2=0x55750dcdea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:38.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.388+0000 7f124659c640 1 --2- 172.21.15.79:0/2421460398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55750dcde5d0 0x55750dcdea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:38.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.388+0000 7f124659c640 1 -- 172.21.15.79:0/2421460398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55750dcdff90 msgr2=0x55750dcf8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:38.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.388+0000 7f124659c640 1 --2- 172.21.15.79:0/2421460398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55750dcdff90 0x55750dcf8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:38.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.388+0000 7f124659c640 1 -- 172.21.15.79:0/2421460398 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55750dcd1f90 con 0x55750dcd36e0 2024-08-20T01:40:38.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.388+0000 7f124659c640 1 --2- 172.21.15.79:0/2421460398 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55750dcd36e0 0x55750dcf7cf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1238000c00 tx=0x7f1238005040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9e7bfe2d4327318 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:38.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.389+0000 7f122ffff640 1 -- 172.21.15.79:0/2421460398 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12380052b0 con 0x55750dcd36e0 2024-08-20T01:40:38.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.389+0000 7f122ffff640 1 -- 172.21.15.79:0/2421460398 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1238005450 con 0x55750dcd36e0 2024-08-20T01:40:38.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.389+0000 7f122ffff640 1 -- 172.21.15.79:0/2421460398 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123801b6b0 con 0x55750dcd36e0 2024-08-20T01:40:38.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.389+0000 7f124ed26740 1 -- 172.21.15.79:0/2421460398 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55750dcd36e0 msgr2=0x55750dcf7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:38.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.389+0000 7f124ed26740 1 --2- 172.21.15.79:0/2421460398 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55750dcd36e0 0x55750dcf7cf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1238000c00 tx=0x7f1238005040 comp rx=0 tx=0).stop 2024-08-20T01:40:38.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.390+0000 7f124ed26740 1 -- 172.21.15.79:0/2421460398 shutdown_connections 2024-08-20T01:40:38.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.390+0000 7f124ed26740 1 --2- 172.21.15.79:0/2421460398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55750dcde5d0 0x55750dcdea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:38.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.390+0000 7f124ed26740 1 --2- 172.21.15.79:0/2421460398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55750dcdff90 0x55750dcf8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:38.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.390+0000 7f124ed26740 1 --2- 172.21.15.79:0/2421460398 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55750dcd36e0 0x55750dcf7cf0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:38.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.390+0000 7f124ed26740 1 -- 172.21.15.79:0/2421460398 >> 172.21.15.79:0/2421460398 conn(0x55750dcd1510 msgr2=0x55750dcdc040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:38.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.390+0000 7f124ed26740 1 -- 172.21.15.79:0/2421460398 shutdown_connections 2024-08-20T01:40:38.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.390+0000 7f124ed26740 1 -- 172.21.15.79:0/2421460398 wait complete. 2024-08-20T01:40:38.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.390+0000 7f124ed26740 1 -- start start 2024-08-20T01:40:38.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.390+0000 7f124ed26740 1 Processor -- start 2024-08-20T01:40:38.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.390+0000 7f124ed26740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55750dcd36e0 0x55750dce8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:38.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.390+0000 7f124ed26740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55750dcde5d0 0x55750dcd9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:38.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.391+0000 7f124ed26740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55750dcdff90 0x55750dcda130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:38.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.391+0000 7f124ed26740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f12481b16a0 con 0x55750dcdff90 2024-08-20T01:40:38.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.391+0000 7f124ed26740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f12481b0f40 con 0x55750dcd36e0 2024-08-20T01:40:38.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.391+0000 7f124ed26740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f12481ae180 con 0x55750dcde5d0 2024-08-20T01:40:38.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.391+0000 7f124ed26740 10 client.0 _ll_register_callbacks cb 0x7f123c03f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:38.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.391+0000 7f124659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55750dcd36e0 0x55750dce8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:38.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.391+0000 7f1245d9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55750dcde5d0 0x55750dcd9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:38.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.391+0000 7f124659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55750dcd36e0 0x55750dce8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:55170/0 (socket says 172.21.15.79:55170) 2024-08-20T01:40:38.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.391+0000 7f124659c640 1 -- 172.21.15.79:0/4083751217 learned_addr learned my addr 172.21.15.79:0/4083751217 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:38.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.391+0000 7f1246d9d640 1 --2- 172.21.15.79:0/4083751217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55750dcdff90 0x55750dcda130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:38.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.391+0000 7f124659c640 1 -- 172.21.15.79:0/4083751217 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55750dcde5d0 msgr2=0x55750dcd9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:38.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.391+0000 7f124659c640 1 --2- 172.21.15.79:0/4083751217 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55750dcde5d0 0x55750dcd9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:38.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.391+0000 7f124659c640 1 -- 172.21.15.79:0/4083751217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55750dcdff90 msgr2=0x55750dcda130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:38.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.391+0000 7f124659c640 1 --2- 172.21.15.79:0/4083751217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55750dcdff90 0x55750dcda130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:38.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.391+0000 7f124659c640 1 -- 172.21.15.79:0/4083751217 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55750dcda7f0 con 0x55750dcd36e0 2024-08-20T01:40:38.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.391+0000 7f124659c640 1 --2- 172.21.15.79:0/4083751217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55750dcd36e0 0x55750dce8400 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f123800b9f0 tx=0x7f1238005680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7aa4fe9de1fe39b8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:38.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.391+0000 7f122dffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:40:38.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.391+0000 7f122dffb640 1 -- 172.21.15.79:0/4083751217 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12380035f0 con 0x55750dcd36e0 2024-08-20T01:40:38.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.392+0000 7f124ed26740 1 -- 172.21.15.79:0/4083751217 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1238005450 con 0x55750dcd36e0 2024-08-20T01:40:38.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.392+0000 7f122dffb640 1 -- 172.21.15.79:0/4083751217 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f1238003790 con 0x55750dcd36e0 2024-08-20T01:40:38.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.392+0000 7f122dffb640 1 -- 172.21.15.79:0/4083751217 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f1238003990 con 0x55750dcd36e0 2024-08-20T01:40:38.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.392+0000 7f124ed26740 10 client.25835 fetch_fsmap learned FSMap version 33 2024-08-20T01:40:38.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.392+0000 7f124ed26740 1 -- 172.21.15.79:0/4083751217 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55750dd5abc0 con 0x55750dcd36e0 2024-08-20T01:40:38.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.392+0000 7f122dffb640 1 -- 172.21.15.79:0/4083751217 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1238005450 con 0x55750dcd36e0 2024-08-20T01:40:38.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.392+0000 7f122dffb640 1 -- 172.21.15.79:0/4083751217 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 33) ==== 8394+0+0 (secure 0 0 0) 0x7f123803bbc0 con 0x55750dcd36e0 2024-08-20T01:40:38.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.392+0000 7f124ed26740 10 client.25835 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T01:40:38.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.392+0000 7f124ed26740 10 client.25835 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:40:38.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.392+0000 7f124ed26740 20 client.25835 populate_metadata read hostname 'smithi079' 2024-08-20T01:40:38.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.392+0000 7f124ed26740 1 --2- 172.21.15.79:0/4083751217 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55750dd5b290 0x55750dd5d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:38.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.392+0000 7f124ed26740 4 client.25835 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:40:38.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.392+0000 7f124ed26740 1 -- 172.21.15.79:0/4083751217 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55750dc482d0 con 0x55750dd5b290 2024-08-20T01:40:38.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.392+0000 7f1245d9b640 1 --2- 172.21.15.79:0/4083751217 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55750dd5b290 0x55750dd5d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:38.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.393+0000 7f1245d9b640 1 --2- 172.21.15.79:0/4083751217 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55750dd5b290 0x55750dd5d680 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31a2bb7a9efa971f server_cookie=a3bff622907447a in_seq=0 out_seq=0 2024-08-20T01:40:38.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.393+0000 7f122dffb640 10 client.25835 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:38.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.393+0000 7f122dffb640 1 -- 172.21.15.79:0/4083751217 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55750dc482d0 con 0x55750dd5b290 2024-08-20T01:40:38.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.393+0000 7f122dffb640 10 client.25835 handle_command_reply: tid=0 2024-08-20T01:40:38.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.393+0000 7f124ed26740 1 client.25835 shutdown 2024-08-20T01:40:38.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.393+0000 7f124ed26740 1 -- 172.21.15.79:0/4083751217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55750dcd36e0 msgr2=0x55750dce8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:38.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.393+0000 7f124ed26740 1 --2- 172.21.15.79:0/4083751217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55750dcd36e0 0x55750dce8400 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f123800b9f0 tx=0x7f1238005680 comp rx=0 tx=0).stop 2024-08-20T01:40:38.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.393+0000 7f124ed26740 1 -- 172.21.15.79:0/4083751217 shutdown_connections 2024-08-20T01:40:38.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.393+0000 7f124ed26740 1 --2- 172.21.15.79:0/4083751217 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55750dd5b290 0x55750dd5d680 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:38.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.393+0000 7f124ed26740 1 --2- 172.21.15.79:0/4083751217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55750dcdff90 0x55750dcda130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:38.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.393+0000 7f124ed26740 1 --2- 172.21.15.79:0/4083751217 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55750dcde5d0 0x55750dcd9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:38.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.393+0000 7f122dffb640 0 client.25835 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:38.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.393+0000 7f124ed26740 1 --2- 172.21.15.79:0/4083751217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55750dcd36e0 0x55750dce8400 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:38.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.393+0000 7f124ed26740 1 -- 172.21.15.79:0/4083751217 >> 172.21.15.79:0/4083751217 conn(0x55750dcd1510 msgr2=0x55750dcdc040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:38.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.393+0000 7f124ed26740 1 -- 172.21.15.79:0/4083751217 shutdown_connections 2024-08-20T01:40:38.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.393+0000 7f124ed26740 1 -- 172.21.15.79:0/4083751217 wait complete. 2024-08-20T01:40:38.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.393+0000 7f124ed26740 20 client.25835 trim_cache size 0 max 16384 2024-08-20T01:40:38.401 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:40:38.401 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-08-20T01:40:38.401 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-08-20T01:40:38.401 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:40:38.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.394+0000 7f124c92d640 1 -- 172.21.15.79:0/2299189072 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f12300b3bd0 msgr2=0x7f12300b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:38.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.394+0000 7f124c92d640 1 --2- 172.21.15.79:0/2299189072 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f12300b3bd0 0x7f12300b6090 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x55750dcd3690 tx=0x7f123c005c00 comp rx=0 tx=0).stop 2024-08-20T01:40:38.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.394+0000 7f124c92d640 1 -- 172.21.15.79:0/2299189072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1248108e20 msgr2=0x7f1248075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:38.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.394+0000 7f124c92d640 1 --2- 172.21.15.79:0/2299189072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1248108e20 0x7f1248075c50 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f124000cad0 tx=0x7f124000cf90 comp rx=0 tx=0).stop 2024-08-20T01:40:38.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.394+0000 7f124c92d640 1 -- 172.21.15.79:0/2299189072 shutdown_connections 2024-08-20T01:40:38.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.394+0000 7f124c92d640 1 --2- 172.21.15.79:0/2299189072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1248108e20 0x7f1248075c50 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:38.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.394+0000 7f124c92d640 1 --2- 172.21.15.79:0/2299189072 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f12300b3bd0 0x7f12300b6090 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:38.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.394+0000 7f124c92d640 1 --2- 172.21.15.79:0/2299189072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12481084a0 0x7f1248075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:38.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.394+0000 7f124c92d640 1 --2- 172.21.15.79:0/2299189072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1248102a90 0x7f12480751d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:38.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.394+0000 7f124c92d640 1 -- 172.21.15.79:0/2299189072 >> 172.21.15.79:0/2299189072 conn(0x7f12480fe540 msgr2=0x7f1248100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:38.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.394+0000 7f124c92d640 1 -- 172.21.15.79:0/2299189072 shutdown_connections 2024-08-20T01:40:38.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:38.394+0000 7f124c92d640 1 -- 172.21.15.79:0/2299189072 wait complete. 2024-08-20T01:40:38.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:38 smithi081 ceph-mon[22209]: pgmap v446: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 31 MiB/s wr, 23 op/s 2024-08-20T01:40:39.307 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T01:40:39.308 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:40:39.585 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:40:40.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.111+0000 7f708622b640 1 -- 172.21.15.79:0/3880842454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70801042e0 msgr2=0x7f708010c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:40.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.111+0000 7f708622b640 1 --2- 172.21.15.79:0/3880842454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70801042e0 0x7f708010c7d0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f7074009900 tx=0x7f707402a410 comp rx=0 tx=0).stop 2024-08-20T01:40:40.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.111+0000 7f708622b640 1 -- 172.21.15.79:0/3880842454 shutdown_connections 2024-08-20T01:40:40.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.111+0000 7f708622b640 1 --2- 172.21.15.79:0/3880842454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f708010ce20 0x7f708010f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:40.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.111+0000 7f708622b640 1 --2- 172.21.15.79:0/3880842454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70801042e0 0x7f708010c7d0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:40.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.111+0000 7f708622b640 1 --2- 172.21.15.79:0/3880842454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70801039c0 0x7f7080103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:40.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.111+0000 7f708622b640 1 -- 172.21.15.79:0/3880842454 >> 172.21.15.79:0/3880842454 conn(0x7f70800fd460 msgr2=0x7f70800ff880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:40.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.111+0000 7f708622b640 1 -- 172.21.15.79:0/3880842454 shutdown_connections 2024-08-20T01:40:40.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.111+0000 7f708622b640 1 -- 172.21.15.79:0/3880842454 wait complete. 2024-08-20T01:40:40.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.112+0000 7f708622b640 1 Processor -- start 2024-08-20T01:40:40.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.112+0000 7f708622b640 1 -- start start 2024-08-20T01:40:40.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.112+0000 7f708622b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70801039c0 0x7f7080101670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:40.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.112+0000 7f708622b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70801042e0 0x7f7080101bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:40.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.112+0000 7f708622b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f708010ce20 0x7f70801020f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:40.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.112+0000 7f708622b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7080112a00 con 0x7f70801042e0 2024-08-20T01:40:40.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.112+0000 7f708622b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7080112880 con 0x7f70801039c0 2024-08-20T01:40:40.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.112+0000 7f708622b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7080112b80 con 0x7f708010ce20 2024-08-20T01:40:40.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.113+0000 7f707effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70801042e0 0x7f7080101bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:40.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.113+0000 7f707f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70801039c0 0x7f7080101670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:40.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.113+0000 7f707effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70801042e0 0x7f7080101bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39782/0 (socket says 172.21.15.79:39782) 2024-08-20T01:40:40.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.113+0000 7f707effd640 1 -- 172.21.15.79:0/1617373589 learned_addr learned my addr 172.21.15.79:0/1617373589 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:40.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.113+0000 7f707ffff640 1 --2- 172.21.15.79:0/1617373589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f708010ce20 0x7f70801020f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:40.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.113+0000 7f707effd640 1 -- 172.21.15.79:0/1617373589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f708010ce20 msgr2=0x7f70801020f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:40.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.113+0000 7f707effd640 1 --2- 172.21.15.79:0/1617373589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f708010ce20 0x7f70801020f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:40.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.113+0000 7f707effd640 1 -- 172.21.15.79:0/1617373589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70801039c0 msgr2=0x7f7080101670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:40.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.113+0000 7f707effd640 1 --2- 172.21.15.79:0/1617373589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70801039c0 0x7f7080101670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:40.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.113+0000 7f707effd640 1 -- 172.21.15.79:0/1617373589 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70801a7430 con 0x7f70801042e0 2024-08-20T01:40:40.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.113+0000 7f707f7fe640 1 --2- 172.21.15.79:0/1617373589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70801039c0 0x7f7080101670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:40:40.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.113+0000 7f707effd640 1 --2- 172.21.15.79:0/1617373589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70801042e0 0x7f7080101bb0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f7074005940 tx=0x7f70740042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:40.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.113+0000 7f707cff9640 1 -- 172.21.15.79:0/1617373589 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f707403f030 con 0x7f70801042e0 2024-08-20T01:40:40.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.113+0000 7f707cff9640 1 -- 172.21.15.79:0/1617373589 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7074031840 con 0x7f70801042e0 2024-08-20T01:40:40.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.113+0000 7f708622b640 1 -- 172.21.15.79:0/1617373589 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70801a76c0 con 0x7f70801042e0 2024-08-20T01:40:40.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.113+0000 7f707cff9640 1 -- 172.21.15.79:0/1617373589 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7074035070 con 0x7f70801042e0 2024-08-20T01:40:40.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.113+0000 7f708622b640 1 -- 172.21.15.79:0/1617373589 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70801a7c20 con 0x7f70801042e0 2024-08-20T01:40:40.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.115+0000 7f708622b640 1 -- 172.21.15.79:0/1617373589 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7080103e20 con 0x7f70801042e0 2024-08-20T01:40:40.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.116+0000 7f707cff9640 1 -- 172.21.15.79:0/1617373589 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f7074042030 con 0x7f70801042e0 2024-08-20T01:40:40.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.117+0000 7f707cff9640 1 --2- 172.21.15.79:0/1617373589 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f70680b3bd0 0x7f70680b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:40.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.117+0000 7f707f7fe640 1 --2- 172.21.15.79:0/1617373589 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f70680b3bd0 0x7f70680b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:40.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.117+0000 7f707cff9640 1 -- 172.21.15.79:0/1617373589 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f70741040f0 con 0x7f70801042e0 2024-08-20T01:40:40.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.117+0000 7f707f7fe640 1 --2- 172.21.15.79:0/1617373589 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f70680b3bd0 0x7f70680b6090 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7070009d60 tx=0x7f7070009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:40.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.123+0000 7f707cff9640 1 -- 172.21.15.79:0/1617373589 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f70740cb750 con 0x7f70801042e0 2024-08-20T01:40:40.330 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:40 smithi081 ceph-mon[22209]: pgmap v447: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 30 MiB/s wr, 26 op/s 2024-08-20T01:40:40.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.349+0000 7f708622b640 1 -- 172.21.15.79:0/1617373589 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f708002e340 con 0x7f70801042e0 2024-08-20T01:40:40.351 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:40 smithi079 ceph-mon[18656]: pgmap v447: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 30 MiB/s wr, 26 op/s 2024-08-20T01:40:40.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.350+0000 7f707cff9640 1 -- 172.21.15.79:0/1617373589 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11982 (secure 0 0 0) 0x7f70740cb050 con 0x7f70801042e0 2024-08-20T01:40:40.352 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:40:40.353 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":34,"btime":"2024-08-20T01:40:40:061996+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14670,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/735082912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":735082912},{"type":"v1","addr":"172.21.15.79:6835","nonce":735082912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2150339873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2150339873},{"type":"v1","addr":"172.21.15.79:6837","nonce":2150339873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:34:55.133562+0000","modified":"2024-08-20T01:40:39.605554+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24539,"mds_1":24538,"mds_2":24523,"mds_3":24514,"mds_4":24512},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14724":{"gid":14724,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/1071242274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1071242274},{"type":"v1","addr":"172.21.15.79:6839","nonce":1071242274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14730":{"gid":14730,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6841/2448977611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":2448977611},{"type":"v1","addr":"172.21.15.79:6841","nonce":2448977611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/1257507005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1257507005},{"type":"v1","addr":"172.21.15.81:6833","nonce":1257507005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1499936216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1499936216},{"type":"v1","addr":"172.21.15.81:6835","nonce":1499936216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/1107229215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1107229215},{"type":"v1","addr":"172.21.15.175:6833","nonce":1107229215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6837/2073598870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2073598870},{"type":"v1","addr":"172.21.15.81:6837","nonce":2073598870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/2552601173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2552601173},{"type":"v1","addr":"172.21.15.175:6835","nonce":2552601173}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6837/1767284089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1767284089},{"type":"v1","addr":"172.21.15.175:6837","nonce":1767284089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/1331748742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1331748742},{"type":"v1","addr":"172.21.15.175:6839","nonce":1331748742}]},"join_fscid":-1,"export_targets":[2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/4098410583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":4098410583},{"type":"v1","addr":"172.21.15.81:6839","nonce":4098410583}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24539,"qdb_cluster":[24512,24538,24514,24523,24539]},"id":1}]} 2024-08-20T01:40:40.353 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 34 2024-08-20T01:40:40.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.353+0000 7f708622b640 1 -- 172.21.15.79:0/1617373589 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f70680b3bd0 msgr2=0x7f70680b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:40.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.353+0000 7f708622b640 1 --2- 172.21.15.79:0/1617373589 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f70680b3bd0 0x7f70680b6090 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7070009d60 tx=0x7f7070009110 comp rx=0 tx=0).stop 2024-08-20T01:40:40.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.353+0000 7f708622b640 1 -- 172.21.15.79:0/1617373589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70801042e0 msgr2=0x7f7080101bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:40.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.353+0000 7f708622b640 1 --2- 172.21.15.79:0/1617373589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70801042e0 0x7f7080101bb0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f7074005940 tx=0x7f70740042f0 comp rx=0 tx=0).stop 2024-08-20T01:40:40.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.353+0000 7f708622b640 1 -- 172.21.15.79:0/1617373589 shutdown_connections 2024-08-20T01:40:40.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.353+0000 7f708622b640 1 --2- 172.21.15.79:0/1617373589 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f70680b3bd0 0x7f70680b6090 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:40.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.353+0000 7f708622b640 1 --2- 172.21.15.79:0/1617373589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f708010ce20 0x7f70801020f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:40.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.353+0000 7f708622b640 1 --2- 172.21.15.79:0/1617373589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70801042e0 0x7f7080101bb0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:40.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.353+0000 7f708622b640 1 --2- 172.21.15.79:0/1617373589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70801039c0 0x7f7080101670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:40.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.353+0000 7f708622b640 1 -- 172.21.15.79:0/1617373589 >> 172.21.15.79:0/1617373589 conn(0x7f70800fd460 msgr2=0x7f70800fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:40.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.353+0000 7f708622b640 1 -- 172.21.15.79:0/1617373589 shutdown_connections 2024-08-20T01:40:40.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:40.353+0000 7f708622b640 1 -- 172.21.15.79:0/1617373589 wait complete. 2024-08-20T01:40:40.388 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:40 smithi175 ceph-mon[22392]: pgmap v447: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 30 MiB/s wr, 26 op/s 2024-08-20T01:40:41.219 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-20T01:40:41.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:41 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:40:41.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:41 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/1617373589' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:40:41.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:41 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:40:41.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:41 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/1617373589' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:40:41.503 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:40:41.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:41 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:40:41.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:41 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/1617373589' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:40:42.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.023+0000 7f8e360a5640 1 -- 172.21.15.79:0/2680101791 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e3010ce00 msgr2=0x7f8e3010f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:42.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.023+0000 7f8e360a5640 1 --2- 172.21.15.79:0/2680101791 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e3010ce00 0x7f8e3010f260 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f8e28009ca0 tx=0x7f8e2802a8c0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.024+0000 7f8e360a5640 1 -- 172.21.15.79:0/2680101791 shutdown_connections 2024-08-20T01:40:42.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.024+0000 7f8e360a5640 1 --2- 172.21.15.79:0/2680101791 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e3010ce00 0x7f8e3010f260 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.024+0000 7f8e360a5640 1 --2- 172.21.15.79:0/2680101791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e301042c0 0x7f8e3010c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.024+0000 7f8e360a5640 1 --2- 172.21.15.79:0/2680101791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e301039a0 0x7f8e30103d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.024+0000 7f8e360a5640 1 -- 172.21.15.79:0/2680101791 >> 172.21.15.79:0/2680101791 conn(0x7f8e300fd400 msgr2=0x7f8e300ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:42.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.024+0000 7f8e360a5640 1 -- 172.21.15.79:0/2680101791 shutdown_connections 2024-08-20T01:40:42.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.024+0000 7f8e360a5640 1 -- 172.21.15.79:0/2680101791 wait complete. 2024-08-20T01:40:42.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.024+0000 7f8e360a5640 1 Processor -- start 2024-08-20T01:40:42.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.024+0000 7f8e360a5640 1 -- start start 2024-08-20T01:40:42.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.025+0000 7f8e360a5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e301039a0 0x7f8e30101650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:42.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.025+0000 7f8e360a5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e301042c0 0x7f8e30101b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:42.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.025+0000 7f8e360a5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e3010ce00 0x7f8e301020d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:42.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.025+0000 7f8e360a5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8e30112970 con 0x7f8e3010ce00 2024-08-20T01:40:42.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.025+0000 7f8e360a5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8e301127f0 con 0x7f8e301042c0 2024-08-20T01:40:42.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.025+0000 7f8e360a5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8e30112af0 con 0x7f8e301039a0 2024-08-20T01:40:42.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.025+0000 7f8e2ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e3010ce00 0x7f8e301020d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:42.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.025+0000 7f8e2ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e3010ce00 0x7f8e301020d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41888/0 (socket says 172.21.15.79:41888) 2024-08-20T01:40:42.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.025+0000 7f8e2ffff640 1 -- 172.21.15.79:0/3753774320 learned_addr learned my addr 172.21.15.79:0/3753774320 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:42.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.025+0000 7f8e2effd640 1 --2- 172.21.15.79:0/3753774320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e301042c0 0x7f8e30101b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:42.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.025+0000 7f8e2f7fe640 1 --2- 172.21.15.79:0/3753774320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e301039a0 0x7f8e30101650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:42.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.025+0000 7f8e2ffff640 1 -- 172.21.15.79:0/3753774320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e301039a0 msgr2=0x7f8e30101650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:42.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.025+0000 7f8e2ffff640 1 --2- 172.21.15.79:0/3753774320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e301039a0 0x7f8e30101650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.025+0000 7f8e2ffff640 1 -- 172.21.15.79:0/3753774320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e301042c0 msgr2=0x7f8e30101b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:42.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.025+0000 7f8e2ffff640 1 --2- 172.21.15.79:0/3753774320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e301042c0 0x7f8e30101b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.025+0000 7f8e2ffff640 1 -- 172.21.15.79:0/3753774320 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e301a7240 con 0x7f8e3010ce00 2024-08-20T01:40:42.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.025+0000 7f8e2ffff640 1 --2- 172.21.15.79:0/3753774320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e3010ce00 0x7f8e301020d0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f8e28031040 tx=0x7f8e28032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:42.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.026+0000 7f8e2cff9640 1 -- 172.21.15.79:0/3753774320 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e28004040 con 0x7f8e3010ce00 2024-08-20T01:40:42.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.026+0000 7f8e360a5640 1 -- 172.21.15.79:0/3753774320 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e301a74d0 con 0x7f8e3010ce00 2024-08-20T01:40:42.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.026+0000 7f8e2cff9640 1 -- 172.21.15.79:0/3753774320 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8e28004670 con 0x7f8e3010ce00 2024-08-20T01:40:42.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.026+0000 7f8e2cff9640 1 -- 172.21.15.79:0/3753774320 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e28030d50 con 0x7f8e3010ce00 2024-08-20T01:40:42.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.026+0000 7f8e360a5640 1 -- 172.21.15.79:0/3753774320 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e301a7a60 con 0x7f8e3010ce00 2024-08-20T01:40:42.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.028+0000 7f8e3849e740 1 Processor -- start 2024-08-20T01:40:42.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.029+0000 7f8e2cff9640 1 -- 172.21.15.79:0/3753774320 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f8e280305c0 con 0x7f8e3010ce00 2024-08-20T01:40:42.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.029+0000 7f8e3849e740 1 -- start start 2024-08-20T01:40:42.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.029+0000 7f8e3849e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7a2396730 0x55b7a2396b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:42.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.029+0000 7f8e3849e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7a2397050 0x55b7a23a2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:42.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.029+0000 7f8e3849e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7a23a2fe0 0x55b7a23a53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:42.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.029+0000 7f8e3849e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b7a230d930 con 0x55b7a2397050 2024-08-20T01:40:42.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.029+0000 7f8e3849e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b7a22fce30 con 0x55b7a23a2fe0 2024-08-20T01:40:42.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.029+0000 7f8e3849e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b7a2300e70 con 0x55b7a2396730 2024-08-20T01:40:42.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.029+0000 7f8e2f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7a2397050 0x55b7a23a2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:42.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.029+0000 7f8e2f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7a2397050 0x55b7a23a2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41904/0 (socket says 172.21.15.79:41904) 2024-08-20T01:40:42.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.029+0000 7f8e2f7fe640 1 -- 172.21.15.79:0/2904016665 learned_addr learned my addr 172.21.15.79:0/2904016665 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:42.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.029+0000 7f8e2effd640 1 --2- 172.21.15.79:0/2904016665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7a2396730 0x55b7a2396b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:42.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.029+0000 7f8e2effd640 1 --2- 172.21.15.79:0/2904016665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7a23a2fe0 0x55b7a23a53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:42.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.029+0000 7f8e2f7fe640 1 -- 172.21.15.79:0/2904016665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7a2396730 msgr2=0x55b7a2396b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:42.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.029+0000 7f8e2f7fe640 1 --2- 172.21.15.79:0/2904016665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7a2396730 0x55b7a2396b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.030+0000 7f8e2f7fe640 1 -- 172.21.15.79:0/2904016665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7a23a2fe0 msgr2=0x55b7a23a53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:42.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.030+0000 7f8e2f7fe640 1 --2- 172.21.15.79:0/2904016665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7a23a2fe0 0x55b7a23a53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.030+0000 7f8e2f7fe640 1 -- 172.21.15.79:0/2904016665 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7a205c650 con 0x55b7a2397050 2024-08-20T01:40:42.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.030+0000 7f8e2cff9640 1 --2- 172.21.15.79:0/3753774320 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f8e180b3c50 0x7f8e180b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:42.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.030+0000 7f8e2effd640 1 --2- 172.21.15.79:0/3753774320 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f8e180b3c50 0x7f8e180b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:42.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.030+0000 7f8e2f7fe640 1 --2- 172.21.15.79:0/2904016665 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7a2397050 0x55b7a23a2aa0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f8e2000cc10 tx=0x7f8e2000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35a0614112211a18 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:42.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.030+0000 7f8e2cff9640 1 -- 172.21.15.79:0/3753774320 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f8e28105160 con 0x7f8e3010ce00 2024-08-20T01:40:42.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.030+0000 7f8e15ffb640 1 -- 172.21.15.79:0/2904016665 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e20010630 con 0x55b7a2397050 2024-08-20T01:40:42.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.030+0000 7f8e15ffb640 1 -- 172.21.15.79:0/2904016665 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8e20010c60 con 0x55b7a2397050 2024-08-20T01:40:42.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.030+0000 7f8e15ffb640 1 -- 172.21.15.79:0/2904016665 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2001aaa0 con 0x55b7a2397050 2024-08-20T01:40:42.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.031+0000 7f8e3849e740 1 -- 172.21.15.79:0/2904016665 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7a2397050 msgr2=0x55b7a23a2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:42.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.031+0000 7f8e3849e740 1 --2- 172.21.15.79:0/2904016665 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7a2397050 0x55b7a23a2aa0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f8e2000cc10 tx=0x7f8e2000e720 comp rx=0 tx=0).stop 2024-08-20T01:40:42.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.031+0000 7f8e2effd640 1 --2- 172.21.15.79:0/3753774320 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f8e180b3c50 0x7f8e180b6110 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x55b7a23966e0 tx=0x7f8e24012040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:42.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.031+0000 7f8e3849e740 1 -- 172.21.15.79:0/2904016665 shutdown_connections 2024-08-20T01:40:42.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.031+0000 7f8e3849e740 1 --2- 172.21.15.79:0/2904016665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7a23a2fe0 0x55b7a23a53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.031+0000 7f8e3849e740 1 --2- 172.21.15.79:0/2904016665 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7a2397050 0x55b7a23a2aa0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.031+0000 7f8e3849e740 1 --2- 172.21.15.79:0/2904016665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7a2396730 0x55b7a2396b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.031+0000 7f8e3849e740 1 -- 172.21.15.79:0/2904016665 >> 172.21.15.79:0/2904016665 conn(0x55b7a2394560 msgr2=0x55b7a2395700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:42.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.031+0000 7f8e3849e740 1 -- 172.21.15.79:0/2904016665 shutdown_connections 2024-08-20T01:40:42.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.031+0000 7f8e3849e740 1 -- 172.21.15.79:0/2904016665 wait complete. 2024-08-20T01:40:42.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.031+0000 7f8e3849e740 1 -- start start 2024-08-20T01:40:42.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.032+0000 7f8e3849e740 1 Processor -- start 2024-08-20T01:40:42.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.032+0000 7f8e3849e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7a2396730 0x55b7a239ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:42.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.032+0000 7f8e3849e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7a2397050 0x55b7a23a04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:42.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.032+0000 7f8e3849e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7a23a2fe0 0x55b7a23a0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:42.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.032+0000 7f8e3849e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b7a215f700 con 0x55b7a2397050 2024-08-20T01:40:42.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.032+0000 7f8e3849e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b7a2283810 con 0x55b7a2396730 2024-08-20T01:40:42.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.032+0000 7f8e3849e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b7a23a5c90 con 0x55b7a23a2fe0 2024-08-20T01:40:42.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.032+0000 7f8e3849e740 10 client.0 _ll_register_callbacks cb 0x55b7a22f6700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:42.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.032+0000 7f8e2effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7a2397050 0x55b7a23a04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:42.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.032+0000 7f8e2effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7a2397050 0x55b7a23a04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41908/0 (socket says 172.21.15.79:41908) 2024-08-20T01:40:42.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.032+0000 7f8e2effd640 1 -- 172.21.15.79:0/3033641012 learned_addr learned my addr 172.21.15.79:0/3033641012 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:42.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.032+0000 7f8e2f7fe640 1 --2- 172.21.15.79:0/3033641012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7a2396730 0x55b7a239ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:42.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.032+0000 7f8e2ffff640 1 --2- 172.21.15.79:0/3033641012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7a23a2fe0 0x55b7a23a0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:42.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.033+0000 7f8e2effd640 1 -- 172.21.15.79:0/3033641012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7a23a2fe0 msgr2=0x55b7a23a0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:42.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.033+0000 7f8e2effd640 1 --2- 172.21.15.79:0/3033641012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7a23a2fe0 0x55b7a23a0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.033+0000 7f8e2effd640 1 -- 172.21.15.79:0/3033641012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7a2396730 msgr2=0x55b7a239ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:42.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.033+0000 7f8e2effd640 1 --2- 172.21.15.79:0/3033641012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7a2396730 0x55b7a239ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.033+0000 7f8e2effd640 1 -- 172.21.15.79:0/3033641012 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7a23af070 con 0x55b7a2397050 2024-08-20T01:40:42.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.033+0000 7f8e2effd640 1 --2- 172.21.15.79:0/3033641012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7a2397050 0x55b7a23a04c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f8e2400fd60 tx=0x7f8e24005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d02559f94800cd9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:42.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.033+0000 7f8e0effd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:40:42.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.033+0000 7f8e0effd640 1 -- 172.21.15.79:0/3033641012 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e24025070 con 0x55b7a2397050 2024-08-20T01:40:42.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.033+0000 7f8e0effd640 1 -- 172.21.15.79:0/3033641012 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f8e2401f470 con 0x55b7a2397050 2024-08-20T01:40:42.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.033+0000 7f8e3849e740 1 -- 172.21.15.79:0/3033641012 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b7a22ac150 con 0x55b7a2397050 2024-08-20T01:40:42.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.033+0000 7f8e0effd640 1 -- 172.21.15.79:0/3033641012 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8e24031050 con 0x55b7a2397050 2024-08-20T01:40:42.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.033+0000 7f8e3849e740 10 client.16599 fetch_fsmap learned FSMap version 34 2024-08-20T01:40:42.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.033+0000 7f8e3849e740 1 -- 172.21.15.79:0/3033641012 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b7a23b1a80 con 0x55b7a2397050 2024-08-20T01:40:42.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.034+0000 7f8e0effd640 1 -- 172.21.15.79:0/3033641012 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55b7a22ac150 con 0x55b7a2397050 2024-08-20T01:40:42.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.034+0000 7f8e0effd640 1 -- 172.21.15.79:0/3033641012 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 34) ==== 8386+0+0 (secure 0 0 0) 0x7f8e2401d040 con 0x55b7a2397050 2024-08-20T01:40:42.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.034+0000 7f8e3849e740 10 client.16599 fetch_fsmap finished waiting for FSMap version 34 2024-08-20T01:40:42.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.034+0000 7f8e3849e740 10 client.16599 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:40:42.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.034+0000 7f8e3849e740 20 client.16599 populate_metadata read hostname 'smithi079' 2024-08-20T01:40:42.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.034+0000 7f8e3849e740 1 --2- 172.21.15.79:0/3033641012 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55b7a23b2ee0 0x55b7a23b53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:42.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.034+0000 7f8e3849e740 4 client.16599 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:40:42.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.034+0000 7f8e3849e740 1 -- 172.21.15.79:0/3033641012 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b7a230f880 con 0x55b7a23b2ee0 2024-08-20T01:40:42.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.034+0000 7f8e2f7fe640 1 --2- 172.21.15.79:0/3033641012 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55b7a23b2ee0 0x55b7a23b53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:42.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.035+0000 7f8e2f7fe640 1 --2- 172.21.15.79:0/3033641012 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55b7a23b2ee0 0x55b7a23b53a0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=836823ffc68878b0 server_cookie=edd65974efc080eb in_seq=0 out_seq=0 2024-08-20T01:40:42.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.035+0000 7f8e0effd640 10 client.16599 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:40:42.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.035+0000 7f8e0effd640 1 -- 172.21.15.79:0/3033641012 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b7a230f880 con 0x55b7a23b2ee0 2024-08-20T01:40:42.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.035+0000 7f8e0effd640 10 client.16599 handle_command_reply: tid=0 2024-08-20T01:40:42.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.035+0000 7f8e3849e740 1 client.16599 shutdown 2024-08-20T01:40:42.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.035+0000 7f8e3849e740 1 -- 172.21.15.79:0/3033641012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7a2397050 msgr2=0x55b7a23a04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:42.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.035+0000 7f8e3849e740 1 --2- 172.21.15.79:0/3033641012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7a2397050 0x55b7a23a04c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f8e2400fd60 tx=0x7f8e24005f90 comp rx=0 tx=0).stop 2024-08-20T01:40:42.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.035+0000 7f8e3849e740 1 -- 172.21.15.79:0/3033641012 shutdown_connections 2024-08-20T01:40:42.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.035+0000 7f8e3849e740 1 --2- 172.21.15.79:0/3033641012 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55b7a23b2ee0 0x55b7a23b53a0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.036+0000 7f8e3849e740 1 --2- 172.21.15.79:0/3033641012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7a23a2fe0 0x55b7a23a0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.036+0000 7f8e0effd640 0 client.16599 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:40:42.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.036+0000 7f8e3849e740 1 --2- 172.21.15.79:0/3033641012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7a2397050 0x55b7a23a04c0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.036+0000 7f8e3849e740 1 --2- 172.21.15.79:0/3033641012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7a2396730 0x55b7a239ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.036+0000 7f8e3849e740 1 -- 172.21.15.79:0/3033641012 >> 172.21.15.79:0/3033641012 conn(0x55b7a2394560 msgr2=0x55b7a239a100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:42.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.036+0000 7f8e3849e740 1 -- 172.21.15.79:0/3033641012 shutdown_connections 2024-08-20T01:40:42.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.036+0000 7f8e3849e740 1 -- 172.21.15.79:0/3033641012 wait complete. 2024-08-20T01:40:42.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.036+0000 7f8e3849e740 20 client.16599 trim_cache size 0 max 16384 2024-08-20T01:40:42.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.053+0000 7f8e3849e740 1 Processor -- start 2024-08-20T01:40:42.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.053+0000 7f8e3849e740 1 -- start start 2024-08-20T01:40:42.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.053+0000 7f8e3849e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7a2396730 0x55b7a23937a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:42.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.053+0000 7f8e3849e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7a2397050 0x55b7a239f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:42.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.053+0000 7f8e3849e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7a23a2fe0 0x55b7a23bac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:42.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.053+0000 7f8e3849e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8e301b0130 con 0x55b7a23a2fe0 2024-08-20T01:40:42.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.053+0000 7f8e3849e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8e301b1d60 con 0x55b7a2397050 2024-08-20T01:40:42.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.053+0000 7f8e3849e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8e301b0800 con 0x55b7a2396730 2024-08-20T01:40:42.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.053+0000 7f8e2f7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7a2396730 0x55b7a23937a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:42.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.053+0000 7f8e2ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7a23a2fe0 0x55b7a23bac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:42.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.053+0000 7f8e2f7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7a2396730 0x55b7a23937a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:34256/0 (socket says 172.21.15.79:34256) 2024-08-20T01:40:42.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.053+0000 7f8e2f7fe640 1 -- 172.21.15.79:0/63373747 learned_addr learned my addr 172.21.15.79:0/63373747 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:42.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.053+0000 7f8e2ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7a23a2fe0 0x55b7a23bac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41916/0 (socket says 172.21.15.79:41916) 2024-08-20T01:40:42.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.053+0000 7f8e2effd640 1 --2- 172.21.15.79:0/63373747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7a2397050 0x55b7a239f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:42.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.054+0000 7f8e2ffff640 1 -- 172.21.15.79:0/63373747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7a2396730 msgr2=0x55b7a23937a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:42.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.054+0000 7f8e2ffff640 1 --2- 172.21.15.79:0/63373747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7a2396730 0x55b7a23937a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.054+0000 7f8e2ffff640 1 -- 172.21.15.79:0/63373747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7a2397050 msgr2=0x55b7a239f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:42.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.054+0000 7f8e2ffff640 1 --2- 172.21.15.79:0/63373747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7a2397050 0x55b7a239f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.054+0000 7f8e2ffff640 1 -- 172.21.15.79:0/63373747 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7a2394fe0 con 0x55b7a23a2fe0 2024-08-20T01:40:42.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.054+0000 7f8e2ffff640 1 --2- 172.21.15.79:0/63373747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7a23a2fe0 0x55b7a23bac70 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f8e28102c70 tx=0x7f8e28102b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2634f4042455c42 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:42.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.054+0000 7f8e157fa640 1 -- 172.21.15.79:0/63373747 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e280cc7c0 con 0x55b7a23a2fe0 2024-08-20T01:40:42.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.054+0000 7f8e157fa640 1 -- 172.21.15.79:0/63373747 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8e28036040 con 0x55b7a23a2fe0 2024-08-20T01:40:42.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.054+0000 7f8e157fa640 1 -- 172.21.15.79:0/63373747 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e280cc320 con 0x55b7a23a2fe0 2024-08-20T01:40:42.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.055+0000 7f8e3849e740 1 -- 172.21.15.79:0/63373747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7a23a2fe0 msgr2=0x55b7a23bac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:42.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.055+0000 7f8e3849e740 1 --2- 172.21.15.79:0/63373747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7a23a2fe0 0x55b7a23bac70 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f8e28102c70 tx=0x7f8e28102b40 comp rx=0 tx=0).stop 2024-08-20T01:40:42.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.055+0000 7f8e3849e740 1 -- 172.21.15.79:0/63373747 shutdown_connections 2024-08-20T01:40:42.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.055+0000 7f8e3849e740 1 --2- 172.21.15.79:0/63373747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7a23a2fe0 0x55b7a23bac70 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.055+0000 7f8e3849e740 1 --2- 172.21.15.79:0/63373747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7a2397050 0x55b7a239f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.055+0000 7f8e3849e740 1 --2- 172.21.15.79:0/63373747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7a2396730 0x55b7a23937a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.055+0000 7f8e3849e740 1 -- 172.21.15.79:0/63373747 >> 172.21.15.79:0/63373747 conn(0x55b7a2394560 msgr2=0x55b7a23a1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:42.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.055+0000 7f8e3849e740 1 -- 172.21.15.79:0/63373747 shutdown_connections 2024-08-20T01:40:42.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.055+0000 7f8e3849e740 1 -- 172.21.15.79:0/63373747 wait complete. 2024-08-20T01:40:42.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.055+0000 7f8e3849e740 1 -- start start 2024-08-20T01:40:42.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.055+0000 7f8e3849e740 1 Processor -- start 2024-08-20T01:40:42.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.056+0000 7f8e3849e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7a2396730 0x55b7a23ab220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:42.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.056+0000 7f8e3849e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7a2397050 0x55b7a23ab7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:42.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.056+0000 7f8e3849e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7a23a2fe0 0x55b7a23a6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:42.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.056+0000 7f8e3849e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8e301b1630 con 0x55b7a2397050 2024-08-20T01:40:42.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.056+0000 7f8e3849e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8e301b0ed0 con 0x55b7a23a2fe0 2024-08-20T01:40:42.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.056+0000 7f8e3849e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8e301ae110 con 0x55b7a2396730 2024-08-20T01:40:42.063 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.056+0000 7f8e3849e740 10 client.0 _ll_register_callbacks cb 0x7f8e2400aea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:42.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.056+0000 7f8e2effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7a2397050 0x55b7a23ab7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:42.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.056+0000 7f8e2effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7a2397050 0x55b7a23ab7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41926/0 (socket says 172.21.15.79:41926) 2024-08-20T01:40:42.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.056+0000 7f8e2effd640 1 -- 172.21.15.79:0/4170771908 learned_addr learned my addr 172.21.15.79:0/4170771908 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:42.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.056+0000 7f8e2ffff640 1 --2- 172.21.15.79:0/4170771908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7a23a2fe0 0x55b7a23a6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:42.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.056+0000 7f8e2f7fe640 1 --2- 172.21.15.79:0/4170771908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7a2396730 0x55b7a23ab220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:42.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.056+0000 7f8e2effd640 1 -- 172.21.15.79:0/4170771908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7a2396730 msgr2=0x55b7a23ab220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:42.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.056+0000 7f8e2effd640 1 --2- 172.21.15.79:0/4170771908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7a2396730 0x55b7a23ab220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.056+0000 7f8e2effd640 1 -- 172.21.15.79:0/4170771908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7a23a2fe0 msgr2=0x55b7a23a6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:42.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.056+0000 7f8e2effd640 1 --2- 172.21.15.79:0/4170771908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7a23a2fe0 0x55b7a23a6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.056+0000 7f8e2effd640 1 -- 172.21.15.79:0/4170771908 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7a23a7090 con 0x55b7a2397050 2024-08-20T01:40:42.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.056+0000 7f8e2ffff640 1 --2- 172.21.15.79:0/4170771908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7a23a2fe0 0x55b7a23a6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:40:42.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.056+0000 7f8e2effd640 1 --2- 172.21.15.79:0/4170771908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7a2397050 0x55b7a23ab7a0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f8e2400b010 tx=0x7f8e2400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9929edc3bacc6f4f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:42.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.056+0000 7f8e0effd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:40:42.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.057+0000 7f8e0effd640 1 -- 172.21.15.79:0/4170771908 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e24025040 con 0x55b7a2397050 2024-08-20T01:40:42.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.057+0000 7f8e0effd640 1 -- 172.21.15.79:0/4170771908 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f8e2401ebf0 con 0x55b7a2397050 2024-08-20T01:40:42.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.057+0000 7f8e3849e740 1 -- 172.21.15.79:0/4170771908 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e28036040 con 0x55b7a2397050 2024-08-20T01:40:42.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.057+0000 7f8e0effd640 1 -- 172.21.15.79:0/4170771908 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8e24017070 con 0x55b7a2397050 2024-08-20T01:40:42.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.057+0000 7f8e3849e740 10 client.16605 fetch_fsmap learned FSMap version 34 2024-08-20T01:40:42.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.057+0000 7f8e3849e740 1 -- 172.21.15.79:0/4170771908 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b7a241d900 con 0x55b7a2397050 2024-08-20T01:40:42.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.057+0000 7f8e0effd640 1 -- 172.21.15.79:0/4170771908 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8e2403c070 con 0x55b7a2397050 2024-08-20T01:40:42.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.057+0000 7f8e0effd640 1 -- 172.21.15.79:0/4170771908 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 34) ==== 8386+0+0 (secure 0 0 0) 0x7f8e24043910 con 0x55b7a2397050 2024-08-20T01:40:42.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.057+0000 7f8e3849e740 10 client.16605 fetch_fsmap finished waiting for FSMap version 34 2024-08-20T01:40:42.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.057+0000 7f8e3849e740 10 client.16605 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:40:42.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.057+0000 7f8e3849e740 20 client.16605 populate_metadata read hostname 'smithi079' 2024-08-20T01:40:42.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.057+0000 7f8e3849e740 1 --2- 172.21.15.79:0/4170771908 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55b7a23b2ee0 0x55b7a24200e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:42.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.057+0000 7f8e3849e740 4 client.16605 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:40:42.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.057+0000 7f8e3849e740 1 -- 172.21.15.79:0/4170771908 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f8e28036040 con 0x55b7a23b2ee0 2024-08-20T01:40:42.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.058+0000 7f8e2f7fe640 1 --2- 172.21.15.79:0/4170771908 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55b7a23b2ee0 0x55b7a24200e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:42.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.058+0000 7f8e2f7fe640 1 --2- 172.21.15.79:0/4170771908 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55b7a23b2ee0 0x55b7a24200e0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a0de81b05cb13f13 server_cookie=3917b39121be1a6c in_seq=0 out_seq=0 2024-08-20T01:40:42.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.058+0000 7f8e0effd640 10 client.16605 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:40:42.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.058+0000 7f8e0effd640 1 -- 172.21.15.79:0/4170771908 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f8e28036040 con 0x55b7a23b2ee0 2024-08-20T01:40:42.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.058+0000 7f8e0effd640 10 client.16605 handle_command_reply: tid=0 2024-08-20T01:40:42.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.058+0000 7f8e3849e740 1 client.16605 shutdown 2024-08-20T01:40:42.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.058+0000 7f8e3849e740 1 -- 172.21.15.79:0/4170771908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7a2397050 msgr2=0x55b7a23ab7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:42.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.058+0000 7f8e3849e740 1 --2- 172.21.15.79:0/4170771908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7a2397050 0x55b7a23ab7a0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f8e2400b010 tx=0x7f8e2400ee20 comp rx=0 tx=0).stop 2024-08-20T01:40:42.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.058+0000 7f8e3849e740 1 -- 172.21.15.79:0/4170771908 shutdown_connections 2024-08-20T01:40:42.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.058+0000 7f8e3849e740 1 --2- 172.21.15.79:0/4170771908 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55b7a23b2ee0 0x55b7a24200e0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.058+0000 7f8e3849e740 1 --2- 172.21.15.79:0/4170771908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7a23a2fe0 0x55b7a23a6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.058+0000 7f8e3849e740 1 --2- 172.21.15.79:0/4170771908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7a2397050 0x55b7a23ab7a0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.058+0000 7f8e3849e740 1 --2- 172.21.15.79:0/4170771908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7a2396730 0x55b7a23ab220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.058+0000 7f8e3849e740 1 -- 172.21.15.79:0/4170771908 >> 172.21.15.79:0/4170771908 conn(0x55b7a2394560 msgr2=0x55b7a239fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:42.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.058+0000 7f8e0effd640 0 client.16605 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:40:42.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.059+0000 7f8e3849e740 1 -- 172.21.15.79:0/4170771908 shutdown_connections 2024-08-20T01:40:42.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.059+0000 7f8e3849e740 1 -- 172.21.15.79:0/4170771908 wait complete. 2024-08-20T01:40:42.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.059+0000 7f8e3849e740 20 client.16605 trim_cache size 0 max 16384 2024-08-20T01:40:42.068 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:40:42.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.059+0000 7f8e360a5640 1 -- 172.21.15.79:0/3753774320 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f8e180b3c50 msgr2=0x7f8e180b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:42.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.059+0000 7f8e360a5640 1 --2- 172.21.15.79:0/3753774320 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f8e180b3c50 0x7f8e180b6110 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x55b7a23966e0 tx=0x7f8e24012040 comp rx=0 tx=0).stop 2024-08-20T01:40:42.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.059+0000 7f8e360a5640 1 -- 172.21.15.79:0/3753774320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e3010ce00 msgr2=0x7f8e301020d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:42.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.059+0000 7f8e360a5640 1 --2- 172.21.15.79:0/3753774320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e3010ce00 0x7f8e301020d0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f8e28031040 tx=0x7f8e28032bc0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.059+0000 7f8e360a5640 1 -- 172.21.15.79:0/3753774320 shutdown_connections 2024-08-20T01:40:42.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.059+0000 7f8e360a5640 1 --2- 172.21.15.79:0/3753774320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e3010ce00 0x7f8e301020d0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.059+0000 7f8e360a5640 1 --2- 172.21.15.79:0/3753774320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e301042c0 0x7f8e30101b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.059+0000 7f8e360a5640 1 --2- 172.21.15.79:0/3753774320 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f8e180b3c50 0x7f8e180b6110 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.059+0000 7f8e360a5640 1 --2- 172.21.15.79:0/3753774320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e301039a0 0x7f8e30101650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.059+0000 7f8e360a5640 1 -- 172.21.15.79:0/3753774320 >> 172.21.15.79:0/3753774320 conn(0x7f8e300fd400 msgr2=0x7f8e3010f070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:42.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.059+0000 7f8e360a5640 1 -- 172.21.15.79:0/3753774320 shutdown_connections 2024-08-20T01:40:42.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:42.060+0000 7f8e360a5640 1 -- 172.21.15.79:0/3753774320 wait complete. 2024-08-20T01:40:42.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:42 smithi079 ceph-mon[18656]: pgmap v448: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 30 MiB/s wr, 23 op/s 2024-08-20T01:40:42.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.341+0000 7f9f75d7b640 1 -- 172.21.15.79:0/846073137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f70101580 msgr2=0x7f9f70101980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:42.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.341+0000 7f9f75d7b640 1 --2- 172.21.15.79:0/846073137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f70101580 0x7f9f70101980 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f9f60009930 tx=0x7f9f6002a420 comp rx=0 tx=0).stop 2024-08-20T01:40:42.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.341+0000 7f9f75d7b640 1 -- 172.21.15.79:0/846073137 shutdown_connections 2024-08-20T01:40:42.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.341+0000 7f9f75d7b640 1 --2- 172.21.15.79:0/846073137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f70103090 0x7f9f70109a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.341+0000 7f9f75d7b640 1 --2- 172.21.15.79:0/846073137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f701026d0 0x7f9f70102b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.341+0000 7f9f75d7b640 1 --2- 172.21.15.79:0/846073137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f70101580 0x7f9f70101980 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.341+0000 7f9f75d7b640 1 -- 172.21.15.79:0/846073137 >> 172.21.15.79:0/846073137 conn(0x7f9f700fce40 msgr2=0x7f9f700ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:42.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.341+0000 7f9f75d7b640 1 -- 172.21.15.79:0/846073137 shutdown_connections 2024-08-20T01:40:42.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.341+0000 7f9f75d7b640 1 -- 172.21.15.79:0/846073137 wait complete. 2024-08-20T01:40:42.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.342+0000 7f9f75d7b640 1 Processor -- start 2024-08-20T01:40:42.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.342+0000 7f9f75d7b640 1 -- start start 2024-08-20T01:40:42.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.342+0000 7f9f75d7b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f70101580 0x7f9f701978f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:42.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.342+0000 7f9f75d7b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f701026d0 0x7f9f70197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:42.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.342+0000 7f9f75d7b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f70103090 0x7f9f70198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:42.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.342+0000 7f9f75d7b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7010d0d0 con 0x7f9f701026d0 2024-08-20T01:40:42.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.342+0000 7f9f75d7b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7010cf50 con 0x7f9f70103090 2024-08-20T01:40:42.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.342+0000 7f9f75d7b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7010d250 con 0x7f9f70101580 2024-08-20T01:40:42.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.343+0000 7f9f6effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f701026d0 0x7f9f70197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:42.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.343+0000 7f9f6effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f701026d0 0x7f9f70197f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41944/0 (socket says 172.21.15.79:41944) 2024-08-20T01:40:42.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.343+0000 7f9f6effd640 1 -- 172.21.15.79:0/3184717367 learned_addr learned my addr 172.21.15.79:0/3184717367 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:42.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.343+0000 7f9f6f7fe640 1 --2- 172.21.15.79:0/3184717367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f70101580 0x7f9f701978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:42.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.343+0000 7f9f6ffff640 1 --2- 172.21.15.79:0/3184717367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f70103090 0x7f9f70198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:42.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.343+0000 7f9f6effd640 1 -- 172.21.15.79:0/3184717367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f70101580 msgr2=0x7f9f701978f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:42.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.343+0000 7f9f6effd640 1 --2- 172.21.15.79:0/3184717367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f70101580 0x7f9f701978f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.343+0000 7f9f6effd640 1 -- 172.21.15.79:0/3184717367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f70103090 msgr2=0x7f9f70198b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:42.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.343+0000 7f9f6effd640 1 --2- 172.21.15.79:0/3184717367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f70103090 0x7f9f70198b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.343+0000 7f9f6effd640 1 -- 172.21.15.79:0/3184717367 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f70199430 con 0x7f9f701026d0 2024-08-20T01:40:42.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.343+0000 7f9f6ffff640 1 --2- 172.21.15.79:0/3184717367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f70103090 0x7f9f70198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:40:42.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.343+0000 7f9f6effd640 1 --2- 172.21.15.79:0/3184717367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f701026d0 0x7f9f70197f40 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f9f6400e9f0 tx=0x7f9f6400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:42.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.343+0000 7f9f6cff9640 1 -- 172.21.15.79:0/3184717367 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f6400cd80 con 0x7f9f701026d0 2024-08-20T01:40:42.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.343+0000 7f9f6cff9640 1 -- 172.21.15.79:0/3184717367 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9f640108c0 con 0x7f9f701026d0 2024-08-20T01:40:42.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.343+0000 7f9f75d7b640 1 -- 172.21.15.79:0/3184717367 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f70199720 con 0x7f9f701026d0 2024-08-20T01:40:42.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.343+0000 7f9f6cff9640 1 -- 172.21.15.79:0/3184717367 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f640187c0 con 0x7f9f701026d0 2024-08-20T01:40:42.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.343+0000 7f9f75d7b640 1 -- 172.21.15.79:0/3184717367 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f7019fdf0 con 0x7f9f701026d0 2024-08-20T01:40:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.346+0000 7f9f6cff9640 1 -- 172.21.15.79:0/3184717367 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f9f64010430 con 0x7f9f701026d0 2024-08-20T01:40:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.346+0000 7f9f78c43740 1 Processor -- start 2024-08-20T01:40:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.346+0000 7f9f78c43740 1 -- start start 2024-08-20T01:40:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.346+0000 7f9f78c43740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56243df1d840 0x56243df1fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.346+0000 7f9f78c43740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56243df20170 0x56243df22560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.346+0000 7f9f78c43740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56243df22bb0 0x56243df25070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.346+0000 7f9f78c43740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56243de8e360 con 0x56243df22bb0 2024-08-20T01:40:42.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.346+0000 7f9f78c43740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56243de7d860 con 0x56243df20170 2024-08-20T01:40:42.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.346+0000 7f9f78c43740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56243de818a0 con 0x56243df1d840 2024-08-20T01:40:42.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.347+0000 7f9f6effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56243df22bb0 0x56243df25070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:42.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.347+0000 7f9f6f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56243df20170 0x56243df22560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:42.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.347+0000 7f9f6effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56243df22bb0 0x56243df25070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41956/0 (socket says 172.21.15.79:41956) 2024-08-20T01:40:42.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.347+0000 7f9f6effd640 1 -- 172.21.15.79:0/3828323685 learned_addr learned my addr 172.21.15.79:0/3828323685 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:42.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.347+0000 7f9f6ffff640 1 --2- 172.21.15.79:0/3828323685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56243df1d840 0x56243df1fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:42.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.347+0000 7f9f6cff9640 1 --2- 172.21.15.79:0/3184717367 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9f580b8060 0x7f9f580ba520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:42.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.347+0000 7f9f6f7fe640 1 -- 172.21.15.79:0/3828323685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56243df1d840 msgr2=0x56243df1fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:42.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.347+0000 7f9f6f7fe640 1 --2- 172.21.15.79:0/3828323685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56243df1d840 0x56243df1fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.347+0000 7f9f6f7fe640 1 -- 172.21.15.79:0/3828323685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56243df22bb0 msgr2=0x56243df25070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:42.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.347+0000 7f9f6f7fe640 1 --2- 172.21.15.79:0/3828323685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56243df22bb0 0x56243df25070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.347+0000 7f9f6f7fe640 1 -- 172.21.15.79:0/3828323685 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56243de24e40 con 0x56243df20170 2024-08-20T01:40:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.347+0000 7f9f6ffff640 1 --2- 172.21.15.79:0/3828323685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56243df1d840 0x56243df1fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:40:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.347+0000 7f9f6ffff640 1 --2- 172.21.15.79:0/3184717367 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9f580b8060 0x7f9f580ba520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.347+0000 7f9f6cff9640 1 -- 172.21.15.79:0/3184717367 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9f640e3fc0 con 0x7f9f701026d0 2024-08-20T01:40:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.347+0000 7f9f6f7fe640 1 --2- 172.21.15.79:0/3828323685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56243df20170 0x56243df22560 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9f6002a940 tx=0x7f9f60005bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24986cdf93c67ff1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.347+0000 7f9f55ffb640 1 -- 172.21.15.79:0/3828323685 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f60035030 con 0x56243df20170 2024-08-20T01:40:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.348+0000 7f9f55ffb640 1 -- 172.21.15.79:0/3828323685 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9f60040070 con 0x56243df20170 2024-08-20T01:40:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.348+0000 7f9f6ffff640 1 --2- 172.21.15.79:0/3184717367 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9f580b8060 0x7f9f580ba520 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9f70198670 tx=0x7f9f68004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.348+0000 7f9f55ffb640 1 -- 172.21.15.79:0/3828323685 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f600317f0 con 0x56243df20170 2024-08-20T01:40:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.348+0000 7f9f78c43740 1 -- 172.21.15.79:0/3828323685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56243df20170 msgr2=0x56243df22560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.348+0000 7f9f78c43740 1 --2- 172.21.15.79:0/3828323685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56243df20170 0x56243df22560 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9f6002a940 tx=0x7f9f60005bd0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.348+0000 7f9f78c43740 1 -- 172.21.15.79:0/3828323685 shutdown_connections 2024-08-20T01:40:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.348+0000 7f9f78c43740 1 --2- 172.21.15.79:0/3828323685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56243df22bb0 0x56243df25070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.348+0000 7f9f78c43740 1 --2- 172.21.15.79:0/3828323685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56243df20170 0x56243df22560 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.348+0000 7f9f78c43740 1 --2- 172.21.15.79:0/3828323685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56243df1d840 0x56243df1fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.348+0000 7f9f78c43740 1 -- 172.21.15.79:0/3828323685 >> 172.21.15.79:0/3828323685 conn(0x56243df18940 msgr2=0x56243df19720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.348+0000 7f9f78c43740 1 -- 172.21.15.79:0/3828323685 shutdown_connections 2024-08-20T01:40:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.348+0000 7f9f78c43740 1 -- 172.21.15.79:0/3828323685 wait complete. 2024-08-20T01:40:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.349+0000 7f9f78c43740 1 -- start start 2024-08-20T01:40:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.349+0000 7f9f78c43740 1 Processor -- start 2024-08-20T01:40:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.349+0000 7f9f78c43740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56243df1d840 0x56243df1d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.349+0000 7f9f78c43740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56243df20170 0x56243df29a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.349+0000 7f9f78c43740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56243df22bb0 0x56243df2c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.349+0000 7f9f78c43740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56243ddb6ab0 con 0x56243df20170 2024-08-20T01:40:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.349+0000 7f9f78c43740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56243de04780 con 0x56243df1d840 2024-08-20T01:40:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.349+0000 7f9f78c43740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56243df16240 con 0x56243df22bb0 2024-08-20T01:40:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.349+0000 7f9f78c43740 10 client.0 _ll_register_callbacks cb 0x56243db8ca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.349+0000 7f9f6effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56243df20170 0x56243df29a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.349+0000 7f9f6f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56243df1d840 0x56243df1d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.349+0000 7f9f6effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56243df20170 0x56243df29a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41960/0 (socket says 172.21.15.79:41960) 2024-08-20T01:40:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.349+0000 7f9f6effd640 1 -- 172.21.15.79:0/2586613833 learned_addr learned my addr 172.21.15.79:0/2586613833 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.349+0000 7f9f6ffff640 1 --2- 172.21.15.79:0/2586613833 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56243df22bb0 0x56243df2c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.349+0000 7f9f6f7fe640 1 -- 172.21.15.79:0/2586613833 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56243df22bb0 msgr2=0x56243df2c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.349+0000 7f9f6f7fe640 1 --2- 172.21.15.79:0/2586613833 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56243df22bb0 0x56243df2c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.350+0000 7f9f6f7fe640 1 -- 172.21.15.79:0/2586613833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56243df20170 msgr2=0x56243df29a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.350+0000 7f9f6f7fe640 1 --2- 172.21.15.79:0/2586613833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56243df20170 0x56243df29a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.350+0000 7f9f6f7fe640 1 -- 172.21.15.79:0/2586613833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56243dbe0790 con 0x56243df1d840 2024-08-20T01:40:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.350+0000 7f9f6effd640 1 --2- 172.21.15.79:0/2586613833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56243df20170 0x56243df29a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:40:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.350+0000 7f9f6ffff640 1 --2- 172.21.15.79:0/2586613833 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56243df22bb0 0x56243df2c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:40:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.350+0000 7f9f6f7fe640 1 --2- 172.21.15.79:0/2586613833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56243df1d840 0x56243df1d240 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9f60006010 tx=0x7f9f60004530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=471289e487ed190d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.350+0000 7f9f4effd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:40:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.350+0000 7f9f4effd640 1 -- 172.21.15.79:0/2586613833 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f6004e060 con 0x56243df1d840 2024-08-20T01:40:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.350+0000 7f9f4effd640 1 -- 172.21.15.79:0/2586613833 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9f60003a80 con 0x56243df1d840 2024-08-20T01:40:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.350+0000 7f9f78c43740 1 -- 172.21.15.79:0/2586613833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56243de2ce00 con 0x56243df1d840 2024-08-20T01:40:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.350+0000 7f9f4effd640 1 -- 172.21.15.79:0/2586613833 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f9f60035070 con 0x56243df1d840 2024-08-20T01:40:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.350+0000 7f9f78c43740 10 client.25865 fetch_fsmap learned FSMap version 34 2024-08-20T01:40:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.350+0000 7f9f78c43740 1 -- 172.21.15.79:0/2586613833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56243dc59620 con 0x56243df1d840 2024-08-20T01:40:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.350+0000 7f9f4effd640 1 -- 172.21.15.79:0/2586613833 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56243de2ce00 con 0x56243df1d840 2024-08-20T01:40:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.351+0000 7f9f4effd640 1 -- 172.21.15.79:0/2586613833 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 34) ==== 8386+0+0 (secure 0 0 0) 0x7f9f60045470 con 0x56243df1d840 2024-08-20T01:40:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.351+0000 7f9f78c43740 10 client.25865 fetch_fsmap finished waiting for FSMap version 34 2024-08-20T01:40:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.351+0000 7f9f78c43740 10 client.25865 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:40:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.351+0000 7f9f78c43740 20 client.25865 populate_metadata read hostname 'smithi079' 2024-08-20T01:40:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.351+0000 7f9f78c43740 1 --2- 172.21.15.79:0/2586613833 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56243df302a0 0x56243df32690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.351+0000 7f9f78c43740 4 client.25865 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:40:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.351+0000 7f9f78c43740 1 -- 172.21.15.79:0/2586613833 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56243de902b0 con 0x56243df302a0 2024-08-20T01:40:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.351+0000 7f9f6effd640 1 --2- 172.21.15.79:0/2586613833 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56243df302a0 0x56243df32690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.351+0000 7f9f6effd640 1 --2- 172.21.15.79:0/2586613833 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56243df302a0 0x56243df32690 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=838d2a6dc3869ea2 server_cookie=8396d79d39f1fce7 in_seq=0 out_seq=0 2024-08-20T01:40:42.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.351+0000 7f9f4effd640 10 client.25865 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:42.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.352+0000 7f9f4effd640 1 -- 172.21.15.79:0/2586613833 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56243de902b0 con 0x56243df302a0 2024-08-20T01:40:42.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.352+0000 7f9f4effd640 10 client.25865 handle_command_reply: tid=0 2024-08-20T01:40:42.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.352+0000 7f9f78c43740 1 client.25865 shutdown 2024-08-20T01:40:42.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.352+0000 7f9f78c43740 1 -- 172.21.15.79:0/2586613833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56243df1d840 msgr2=0x56243df1d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:42.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.352+0000 7f9f78c43740 1 --2- 172.21.15.79:0/2586613833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56243df1d840 0x56243df1d240 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9f60006010 tx=0x7f9f60004530 comp rx=0 tx=0).stop 2024-08-20T01:40:42.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.352+0000 7f9f78c43740 1 -- 172.21.15.79:0/2586613833 shutdown_connections 2024-08-20T01:40:42.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.352+0000 7f9f78c43740 1 --2- 172.21.15.79:0/2586613833 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56243df302a0 0x56243df32690 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.352+0000 7f9f78c43740 1 --2- 172.21.15.79:0/2586613833 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56243df22bb0 0x56243df2c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.352+0000 7f9f4effd640 0 client.25865 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:42.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.352+0000 7f9f78c43740 1 --2- 172.21.15.79:0/2586613833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56243df20170 0x56243df29a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.352+0000 7f9f78c43740 1 --2- 172.21.15.79:0/2586613833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56243df1d840 0x56243df1d240 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.352+0000 7f9f78c43740 1 -- 172.21.15.79:0/2586613833 >> 172.21.15.79:0/2586613833 conn(0x56243df18940 msgr2=0x56243df15850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:42.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.352+0000 7f9f78c43740 1 -- 172.21.15.79:0/2586613833 shutdown_connections 2024-08-20T01:40:42.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.352+0000 7f9f78c43740 1 -- 172.21.15.79:0/2586613833 wait complete. 2024-08-20T01:40:42.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.352+0000 7f9f78c43740 20 client.25865 trim_cache size 0 max 16384 2024-08-20T01:40:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.374+0000 7f9f78c43740 1 Processor -- start 2024-08-20T01:40:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.374+0000 7f9f78c43740 1 -- start start 2024-08-20T01:40:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.374+0000 7f9f78c43740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56243df1d840 0x56243df20550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.374+0000 7f9f78c43740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56243df20170 0x56243df20a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:42.378 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.374+0000 7f9f78c43740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56243df22bb0 0x56243df20fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:42.378 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.374+0000 7f9f78c43740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9f701a78b0 con 0x56243df1d840 2024-08-20T01:40:42.378 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.374+0000 7f9f78c43740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9f701a94e0 con 0x56243df22bb0 2024-08-20T01:40:42.378 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.374+0000 7f9f78c43740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9f701a7f80 con 0x56243df20170 2024-08-20T01:40:42.378 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.374+0000 7f9f6f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56243df1d840 0x56243df20550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:42.378 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.374+0000 7f9f6f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56243df1d840 0x56243df20550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41974/0 (socket says 172.21.15.79:41974) 2024-08-20T01:40:42.378 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.374+0000 7f9f6f7fe640 1 -- 172.21.15.79:0/3030698367 learned_addr learned my addr 172.21.15.79:0/3030698367 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:42.378 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.375+0000 7f9f6effd640 1 --2- 172.21.15.79:0/3030698367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56243df20170 0x56243df20a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:42.378 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.375+0000 7f9f6ffff640 1 --2- 172.21.15.79:0/3030698367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56243df22bb0 0x56243df20fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:42.378 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.375+0000 7f9f6f7fe640 1 -- 172.21.15.79:0/3030698367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56243df20170 msgr2=0x56243df20a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:42.378 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.375+0000 7f9f6f7fe640 1 --2- 172.21.15.79:0/3030698367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56243df20170 0x56243df20a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.375+0000 7f9f6f7fe640 1 -- 172.21.15.79:0/3030698367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56243df22bb0 msgr2=0x56243df20fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:42.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.375+0000 7f9f6f7fe640 1 --2- 172.21.15.79:0/3030698367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56243df22bb0 0x56243df20fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.375+0000 7f9f6f7fe640 1 -- 172.21.15.79:0/3030698367 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56243df19bf0 con 0x56243df1d840 2024-08-20T01:40:42.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.375+0000 7f9f6ffff640 1 --2- 172.21.15.79:0/3030698367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56243df22bb0 0x56243df20fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:40:42.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.375+0000 7f9f6f7fe640 1 --2- 172.21.15.79:0/3030698367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56243df1d840 0x56243df20550 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f9f60005ec0 tx=0x7f9f60004490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e0e192f471cda5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:42.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.375+0000 7f9f557fa640 1 -- 172.21.15.79:0/3030698367 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f60059070 con 0x56243df1d840 2024-08-20T01:40:42.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.375+0000 7f9f557fa640 1 -- 172.21.15.79:0/3030698367 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9f60040030 con 0x56243df1d840 2024-08-20T01:40:42.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.375+0000 7f9f557fa640 1 -- 172.21.15.79:0/3030698367 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f6004e040 con 0x56243df1d840 2024-08-20T01:40:42.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.376+0000 7f9f78c43740 1 -- 172.21.15.79:0/3030698367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56243df1d840 msgr2=0x56243df20550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:42.382 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.376+0000 7f9f78c43740 1 --2- 172.21.15.79:0/3030698367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56243df1d840 0x56243df20550 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f9f60005ec0 tx=0x7f9f60004490 comp rx=0 tx=0).stop 2024-08-20T01:40:42.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.376+0000 7f9f78c43740 1 -- 172.21.15.79:0/3030698367 shutdown_connections 2024-08-20T01:40:42.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.376+0000 7f9f78c43740 1 --2- 172.21.15.79:0/3030698367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56243df22bb0 0x56243df20fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.376+0000 7f9f78c43740 1 --2- 172.21.15.79:0/3030698367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56243df20170 0x56243df20a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.376+0000 7f9f78c43740 1 --2- 172.21.15.79:0/3030698367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56243df1d840 0x56243df20550 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.376+0000 7f9f78c43740 1 -- 172.21.15.79:0/3030698367 >> 172.21.15.79:0/3030698367 conn(0x56243df18940 msgr2=0x56243df1bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:42.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.376+0000 7f9f78c43740 1 -- 172.21.15.79:0/3030698367 shutdown_connections 2024-08-20T01:40:42.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.376+0000 7f9f78c43740 1 -- 172.21.15.79:0/3030698367 wait complete. 2024-08-20T01:40:42.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.376+0000 7f9f78c43740 1 -- start start 2024-08-20T01:40:42.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.376+0000 7f9f78c43740 1 Processor -- start 2024-08-20T01:40:42.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.377+0000 7f9f78c43740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56243df1d840 0x56243df43f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:42.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.377+0000 7f9f78c43740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56243df20170 0x56243df445c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:42.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.377+0000 7f9f78c43740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56243df22bb0 0x56243df37f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:42.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.377+0000 7f9f78c43740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9f701a8db0 con 0x56243df22bb0 2024-08-20T01:40:42.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.377+0000 7f9f78c43740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9f701a8650 con 0x56243df20170 2024-08-20T01:40:42.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.377+0000 7f9f78c43740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9f701a5890 con 0x56243df1d840 2024-08-20T01:40:42.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.377+0000 7f9f78c43740 10 client.0 _ll_register_callbacks cb 0x7f9f640e7970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:42.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.377+0000 7f9f6ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56243df22bb0 0x56243df37f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:42.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.377+0000 7f9f6ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56243df22bb0 0x56243df37f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41980/0 (socket says 172.21.15.79:41980) 2024-08-20T01:40:42.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.377+0000 7f9f6ffff640 1 -- 172.21.15.79:0/3353908642 learned_addr learned my addr 172.21.15.79:0/3353908642 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:42.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.377+0000 7f9f6f7fe640 1 --2- 172.21.15.79:0/3353908642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56243df1d840 0x56243df43f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:42.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.377+0000 7f9f6effd640 1 --2- 172.21.15.79:0/3353908642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56243df20170 0x56243df445c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:42.385 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.377+0000 7f9f6ffff640 1 -- 172.21.15.79:0/3353908642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56243df1d840 msgr2=0x56243df43f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:42.385 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.377+0000 7f9f6ffff640 1 --2- 172.21.15.79:0/3353908642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56243df1d840 0x56243df43f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.385 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.377+0000 7f9f6ffff640 1 -- 172.21.15.79:0/3353908642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56243df20170 msgr2=0x56243df445c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:42.385 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.377+0000 7f9f6ffff640 1 --2- 172.21.15.79:0/3353908642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56243df20170 0x56243df445c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.385 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.377+0000 7f9f6ffff640 1 -- 172.21.15.79:0/3353908642 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56243df38760 con 0x56243df22bb0 2024-08-20T01:40:42.385 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.377+0000 7f9f6effd640 1 --2- 172.21.15.79:0/3353908642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56243df20170 0x56243df445c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:40:42.385 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.377+0000 7f9f6f7fe640 1 --2- 172.21.15.79:0/3353908642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56243df1d840 0x56243df43f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:40:42.385 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.377+0000 7f9f6ffff640 1 --2- 172.21.15.79:0/3353908642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56243df22bb0 0x56243df37f30 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f9f68009810 tx=0x7f9f68014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f0b265a0dda7bb1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:42.386 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.377+0000 7f9f4effd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:40:42.386 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.378+0000 7f9f4effd640 1 -- 172.21.15.79:0/3353908642 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f68025410 con 0x56243df22bb0 2024-08-20T01:40:42.386 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.378+0000 7f9f4effd640 1 -- 172.21.15.79:0/3353908642 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9f680255b0 con 0x56243df22bb0 2024-08-20T01:40:42.386 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.378+0000 7f9f78c43740 1 -- 172.21.15.79:0/3353908642 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f60040030 con 0x56243df22bb0 2024-08-20T01:40:42.386 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.378+0000 7f9f4effd640 1 -- 172.21.15.79:0/3353908642 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f9f680257b0 con 0x56243df22bb0 2024-08-20T01:40:42.386 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.378+0000 7f9f78c43740 10 client.16623 fetch_fsmap learned FSMap version 34 2024-08-20T01:40:42.386 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.378+0000 7f9f78c43740 1 -- 172.21.15.79:0/3353908642 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56243df9add0 con 0x56243df22bb0 2024-08-20T01:40:42.386 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.378+0000 7f9f4effd640 1 -- 172.21.15.79:0/3353908642 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9f60040030 con 0x56243df22bb0 2024-08-20T01:40:42.386 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.378+0000 7f9f4effd640 1 -- 172.21.15.79:0/3353908642 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 34) ==== 8386+0+0 (secure 0 0 0) 0x7f9f6802e980 con 0x56243df22bb0 2024-08-20T01:40:42.386 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.378+0000 7f9f78c43740 10 client.16623 fetch_fsmap finished waiting for FSMap version 34 2024-08-20T01:40:42.386 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.378+0000 7f9f78c43740 10 client.16623 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:40:42.387 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.378+0000 7f9f78c43740 20 client.16623 populate_metadata read hostname 'smithi079' 2024-08-20T01:40:42.387 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.378+0000 7f9f78c43740 1 --2- 172.21.15.79:0/3353908642 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56243df9b840 0x56243df9dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:42.387 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.378+0000 7f9f78c43740 4 client.16623 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:40:42.387 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.378+0000 7f9f78c43740 1 -- 172.21.15.79:0/3353908642 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56243de8bd50 con 0x56243df9b840 2024-08-20T01:40:42.387 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.378+0000 7f9f6f7fe640 1 --2- 172.21.15.79:0/3353908642 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56243df9b840 0x56243df9dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:42.387 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.379+0000 7f9f6f7fe640 1 --2- 172.21.15.79:0/3353908642 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56243df9b840 0x56243df9dc60 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=863e64e63bad31ba server_cookie=dae6121901c77740 in_seq=0 out_seq=0 2024-08-20T01:40:42.387 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.379+0000 7f9f4effd640 10 client.16623 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:42.389 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.386+0000 7f9f4effd640 1 -- 172.21.15.79:0/3353908642 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56243de8bd50 con 0x56243df9b840 2024-08-20T01:40:42.389 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.386+0000 7f9f4effd640 10 client.16623 handle_command_reply: tid=0 2024-08-20T01:40:42.389 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.386+0000 7f9f78c43740 1 client.16623 shutdown 2024-08-20T01:40:42.390 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.387+0000 7f9f78c43740 1 -- 172.21.15.79:0/3353908642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56243df22bb0 msgr2=0x56243df37f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:42.390 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.387+0000 7f9f78c43740 1 --2- 172.21.15.79:0/3353908642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56243df22bb0 0x56243df37f30 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f9f68009810 tx=0x7f9f68014040 comp rx=0 tx=0).stop 2024-08-20T01:40:42.390 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.387+0000 7f9f78c43740 1 -- 172.21.15.79:0/3353908642 shutdown_connections 2024-08-20T01:40:42.390 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.387+0000 7f9f78c43740 1 --2- 172.21.15.79:0/3353908642 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56243df9b840 0x56243df9dc60 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.390 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.387+0000 7f9f78c43740 1 --2- 172.21.15.79:0/3353908642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56243df22bb0 0x56243df37f30 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.390 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.387+0000 7f9f78c43740 1 --2- 172.21.15.79:0/3353908642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56243df20170 0x56243df445c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.390 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.387+0000 7f9f78c43740 1 --2- 172.21.15.79:0/3353908642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56243df1d840 0x56243df43f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.390 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.387+0000 7f9f78c43740 1 -- 172.21.15.79:0/3353908642 >> 172.21.15.79:0/3353908642 conn(0x56243df18940 msgr2=0x56243df15030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:42.390 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.387+0000 7f9f4effd640 0 client.16623 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:42.390 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.387+0000 7f9f78c43740 1 -- 172.21.15.79:0/3353908642 shutdown_connections 2024-08-20T01:40:42.390 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.387+0000 7f9f78c43740 1 -- 172.21.15.79:0/3353908642 wait complete. 2024-08-20T01:40:42.391 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.387+0000 7f9f78c43740 20 client.16623 trim_cache size 0 max 16384 2024-08-20T01:40:42.391 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:40:42.391 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:40:42.391 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:40:42.391 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:40:42.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.387+0000 7f9f75d7b640 1 -- 172.21.15.79:0/3184717367 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9f580b8060 msgr2=0x7f9f580ba520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:42.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.387+0000 7f9f75d7b640 1 --2- 172.21.15.79:0/3184717367 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9f580b8060 0x7f9f580ba520 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9f70198670 tx=0x7f9f68004a40 comp rx=0 tx=0).stop 2024-08-20T01:40:42.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.387+0000 7f9f75d7b640 1 -- 172.21.15.79:0/3184717367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f701026d0 msgr2=0x7f9f70197f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:42.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.387+0000 7f9f75d7b640 1 --2- 172.21.15.79:0/3184717367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f701026d0 0x7f9f70197f40 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f9f6400e9f0 tx=0x7f9f6400eeb0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.388+0000 7f9f75d7b640 1 -- 172.21.15.79:0/3184717367 shutdown_connections 2024-08-20T01:40:42.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.388+0000 7f9f75d7b640 1 --2- 172.21.15.79:0/3184717367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f70103090 0x7f9f70198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.388+0000 7f9f75d7b640 1 --2- 172.21.15.79:0/3184717367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f701026d0 0x7f9f70197f40 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.388+0000 7f9f75d7b640 1 --2- 172.21.15.79:0/3184717367 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9f580b8060 0x7f9f580ba520 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.388+0000 7f9f75d7b640 1 --2- 172.21.15.79:0/3184717367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f70101580 0x7f9f701978f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:42.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.388+0000 7f9f75d7b640 1 -- 172.21.15.79:0/3184717367 >> 172.21.15.79:0/3184717367 conn(0x7f9f700fce40 msgr2=0x7f9f70105ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:42.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.388+0000 7f9f75d7b640 1 -- 172.21.15.79:0/3184717367 shutdown_connections 2024-08-20T01:40:42.392 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:42.388+0000 7f9f75d7b640 1 -- 172.21.15.79:0/3184717367 wait complete. 2024-08-20T01:40:42.393 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:42 smithi175 ceph-mon[22392]: pgmap v448: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 30 MiB/s wr, 23 op/s 2024-08-20T01:40:42.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:42 smithi081 ceph-mon[22209]: pgmap v448: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 30 MiB/s wr, 23 op/s 2024-08-20T01:40:42.894 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-20T01:40:43.163 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:40:43.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.653+0000 7fea7a5b0640 1 -- 172.21.15.79:0/1842882720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea74101990 msgr2=0x7fea74101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:43.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.653+0000 7fea7a5b0640 1 --2- 172.21.15.79:0/1842882720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea74101990 0x7fea74101d70 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fea64009900 tx=0x7fea6402a410 comp rx=0 tx=0).stop 2024-08-20T01:40:43.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.653+0000 7fea7a5b0640 1 -- 172.21.15.79:0/1842882720 shutdown_connections 2024-08-20T01:40:43.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.653+0000 7fea7a5b0640 1 --2- 172.21.15.79:0/1842882720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea74107d20 0x7fea7410e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:43.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.653+0000 7fea7a5b0640 1 --2- 172.21.15.79:0/1842882720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea741073a0 0x7fea741077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:43.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.653+0000 7fea7a5b0640 1 --2- 172.21.15.79:0/1842882720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea74101990 0x7fea74101d70 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:43.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.653+0000 7fea7a5b0640 1 -- 172.21.15.79:0/1842882720 >> 172.21.15.79:0/1842882720 conn(0x7fea740fd400 msgr2=0x7fea740ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:43.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.653+0000 7fea7a5b0640 1 -- 172.21.15.79:0/1842882720 shutdown_connections 2024-08-20T01:40:43.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.653+0000 7fea7a5b0640 1 -- 172.21.15.79:0/1842882720 wait complete. 2024-08-20T01:40:43.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.654+0000 7fea7a5b0640 1 Processor -- start 2024-08-20T01:40:43.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.654+0000 7fea7a5b0640 1 -- start start 2024-08-20T01:40:43.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.654+0000 7fea7a5b0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea741073a0 0x7fea7419a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:43.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.654+0000 7fea7a5b0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea74107d20 0x7fea7419a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:43.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.654+0000 7fea7a5b0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea7419aaa0 0x7fea741a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:43.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.654+0000 7fea7a5b0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fea74111920 con 0x7fea741073a0 2024-08-20T01:40:43.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.654+0000 7fea7a5b0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fea741117a0 con 0x7fea7419aaa0 2024-08-20T01:40:43.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.655+0000 7fea7a5b0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fea74111aa0 con 0x7fea74107d20 2024-08-20T01:40:43.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.655+0000 7fea73fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea741073a0 0x7fea7419a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:43.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.655+0000 7fea73fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea741073a0 0x7fea7419a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41994/0 (socket says 172.21.15.79:41994) 2024-08-20T01:40:43.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.655+0000 7fea73fff640 1 -- 172.21.15.79:0/1840835832 learned_addr learned my addr 172.21.15.79:0/1840835832 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:43.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.655+0000 7fea78b4d640 1 --2- 172.21.15.79:0/1840835832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea7419aaa0 0x7fea741a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:43.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.655+0000 7fea737fe640 1 --2- 172.21.15.79:0/1840835832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea74107d20 0x7fea7419a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:43.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.655+0000 7fea73fff640 1 -- 172.21.15.79:0/1840835832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea74107d20 msgr2=0x7fea7419a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:43.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.655+0000 7fea73fff640 1 --2- 172.21.15.79:0/1840835832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea74107d20 0x7fea7419a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:43.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.655+0000 7fea73fff640 1 -- 172.21.15.79:0/1840835832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea7419aaa0 msgr2=0x7fea741a50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:43.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.655+0000 7fea73fff640 1 --2- 172.21.15.79:0/1840835832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea7419aaa0 0x7fea741a50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:43.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.655+0000 7fea73fff640 1 -- 172.21.15.79:0/1840835832 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea741a57f0 con 0x7fea741073a0 2024-08-20T01:40:43.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.655+0000 7fea73fff640 1 --2- 172.21.15.79:0/1840835832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea741073a0 0x7fea7419a020 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fea64006010 tx=0x7fea64003d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:43.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.655+0000 7fea717fa640 1 -- 172.21.15.79:0/1840835832 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea6403f020 con 0x7fea741073a0 2024-08-20T01:40:43.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.655+0000 7fea7a5b0640 1 -- 172.21.15.79:0/1840835832 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea741a5a80 con 0x7fea741073a0 2024-08-20T01:40:43.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.655+0000 7fea717fa640 1 -- 172.21.15.79:0/1840835832 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fea6403bd00 con 0x7fea741073a0 2024-08-20T01:40:43.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.655+0000 7fea717fa640 1 -- 172.21.15.79:0/1840835832 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea64035070 con 0x7fea741073a0 2024-08-20T01:40:43.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.656+0000 7fea7a5b0640 1 -- 172.21.15.79:0/1840835832 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea741a5f90 con 0x7fea741073a0 2024-08-20T01:40:43.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.658+0000 7fea7c9a9740 1 Processor -- start 2024-08-20T01:40:43.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.658+0000 7fea7c9a9740 1 -- start start 2024-08-20T01:40:43.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.658+0000 7fea7c9a9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611ddbe2730 0x5611ddbe2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:43.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.658+0000 7fea7c9a9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611ddbe3050 0x5611ddbeeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:43.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.658+0000 7fea7c9a9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611ddbeefe0 0x5611ddbf13d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:43.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.659+0000 7fea717fa640 1 -- 172.21.15.79:0/1840835832 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fea64042020 con 0x7fea741073a0 2024-08-20T01:40:43.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.659+0000 7fea7c9a9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5611ddb59930 con 0x5611ddbe3050 2024-08-20T01:40:43.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.659+0000 7fea7c9a9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5611ddb48e30 con 0x5611ddbeefe0 2024-08-20T01:40:43.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.659+0000 7fea7c9a9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5611ddb4ce70 con 0x5611ddbe2730 2024-08-20T01:40:43.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.659+0000 7fea78b4d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611ddbe2730 0x5611ddbe2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:43.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.659+0000 7fea73fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611ddbe3050 0x5611ddbeeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:43.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.659+0000 7fea737fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611ddbeefe0 0x5611ddbf13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:43.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.659+0000 7fea78b4d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611ddbe2730 0x5611ddbe2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:34354/0 (socket says 172.21.15.79:34354) 2024-08-20T01:40:43.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.659+0000 7fea78b4d640 1 -- 172.21.15.79:0/1830454614 learned_addr learned my addr 172.21.15.79:0/1830454614 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:43.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.659+0000 7fea73fff640 1 -- 172.21.15.79:0/1830454614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611ddbe2730 msgr2=0x5611ddbe2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:43.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.659+0000 7fea73fff640 1 --2- 172.21.15.79:0/1830454614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611ddbe2730 0x5611ddbe2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:43.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.659+0000 7fea73fff640 1 -- 172.21.15.79:0/1830454614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611ddbeefe0 msgr2=0x5611ddbf13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:43.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.659+0000 7fea73fff640 1 --2- 172.21.15.79:0/1830454614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611ddbeefe0 0x5611ddbf13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:43.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.659+0000 7fea73fff640 1 -- 172.21.15.79:0/1830454614 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611dd8a8650 con 0x5611ddbe3050 2024-08-20T01:40:43.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.659+0000 7fea737fe640 1 --2- 172.21.15.79:0/1830454614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611ddbeefe0 0x5611ddbf13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:40:43.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.659+0000 7fea73fff640 1 --2- 172.21.15.79:0/1830454614 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611ddbe3050 0x5611ddbeeaa0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fea64101be0 tx=0x7fea6410e630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f4d79f791d14694 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:43.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.660+0000 7fea5a7fc640 1 -- 172.21.15.79:0/1830454614 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea641060d0 con 0x5611ddbe3050 2024-08-20T01:40:43.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.660+0000 7fea717fa640 1 --2- 172.21.15.79:0/1840835832 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fea5c0b3c00 0x7fea5c0b60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:43.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.660+0000 7fea5a7fc640 1 -- 172.21.15.79:0/1830454614 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fea64106270 con 0x5611ddbe3050 2024-08-20T01:40:43.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.660+0000 7fea5a7fc640 1 -- 172.21.15.79:0/1830454614 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea640c6f50 con 0x5611ddbe3050 2024-08-20T01:40:43.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.660+0000 7fea78b4d640 1 --2- 172.21.15.79:0/1840835832 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fea5c0b3c00 0x7fea5c0b60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:43.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.660+0000 7fea717fa640 1 -- 172.21.15.79:0/1840835832 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fea64104130 con 0x7fea741073a0 2024-08-20T01:40:43.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.660+0000 7fea7c9a9740 1 -- 172.21.15.79:0/1830454614 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611ddbe3050 msgr2=0x5611ddbeeaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:43.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.660+0000 7fea78b4d640 1 --2- 172.21.15.79:0/1840835832 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fea5c0b3c00 0x7fea5c0b60c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fea6c00a510 tx=0x7fea6c00d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:43.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.660+0000 7fea7c9a9740 1 --2- 172.21.15.79:0/1830454614 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611ddbe3050 0x5611ddbeeaa0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fea64101be0 tx=0x7fea6410e630 comp rx=0 tx=0).stop 2024-08-20T01:40:43.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.661+0000 7fea7c9a9740 1 -- 172.21.15.79:0/1830454614 shutdown_connections 2024-08-20T01:40:43.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.661+0000 7fea7c9a9740 1 --2- 172.21.15.79:0/1830454614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611ddbeefe0 0x5611ddbf13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:43.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.661+0000 7fea7c9a9740 1 --2- 172.21.15.79:0/1830454614 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611ddbe3050 0x5611ddbeeaa0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:43.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.661+0000 7fea7c9a9740 1 --2- 172.21.15.79:0/1830454614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611ddbe2730 0x5611ddbe2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:43.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.661+0000 7fea7c9a9740 1 -- 172.21.15.79:0/1830454614 >> 172.21.15.79:0/1830454614 conn(0x5611ddbe0560 msgr2=0x5611ddbe1700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:43.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.661+0000 7fea7c9a9740 1 -- 172.21.15.79:0/1830454614 shutdown_connections 2024-08-20T01:40:43.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.661+0000 7fea7c9a9740 1 -- 172.21.15.79:0/1830454614 wait complete. 2024-08-20T01:40:43.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.661+0000 7fea7c9a9740 1 -- start start 2024-08-20T01:40:43.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.661+0000 7fea7c9a9740 1 Processor -- start 2024-08-20T01:40:43.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.662+0000 7fea7c9a9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611ddbe2730 0x5611ddbebfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:43.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.662+0000 7fea7c9a9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611ddbe3050 0x5611ddbec500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:43.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.662+0000 7fea7c9a9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611ddbeefe0 0x5611ddbeca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:43.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.662+0000 7fea7c9a9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5611dd9ab700 con 0x5611ddbeefe0 2024-08-20T01:40:43.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.662+0000 7fea7c9a9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5611ddacf810 con 0x5611ddbe2730 2024-08-20T01:40:43.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.662+0000 7fea7c9a9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5611ddbf1a50 con 0x5611ddbe3050 2024-08-20T01:40:43.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.662+0000 7fea7c9a9740 10 client.0 _ll_register_callbacks cb 0x5611ddb42700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:43.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.662+0000 7fea78b4d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611ddbeefe0 0x5611ddbeca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:43.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.662+0000 7fea78b4d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611ddbeefe0 0x5611ddbeca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42018/0 (socket says 172.21.15.79:42018) 2024-08-20T01:40:43.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.662+0000 7fea78b4d640 1 -- 172.21.15.79:0/2331346747 learned_addr learned my addr 172.21.15.79:0/2331346747 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:43.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.662+0000 7fea73fff640 1 --2- 172.21.15.79:0/2331346747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611ddbe2730 0x5611ddbebfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:43.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.662+0000 7fea737fe640 1 --2- 172.21.15.79:0/2331346747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611ddbe3050 0x5611ddbec500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:43.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.662+0000 7fea78b4d640 1 -- 172.21.15.79:0/2331346747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611ddbe3050 msgr2=0x5611ddbec500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:43.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.662+0000 7fea78b4d640 1 --2- 172.21.15.79:0/2331346747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611ddbe3050 0x5611ddbec500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:43.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.662+0000 7fea78b4d640 1 -- 172.21.15.79:0/2331346747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611ddbe2730 msgr2=0x5611ddbebfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:43.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.662+0000 7fea78b4d640 1 --2- 172.21.15.79:0/2331346747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611ddbe2730 0x5611ddbebfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:43.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.662+0000 7fea78b4d640 1 -- 172.21.15.79:0/2331346747 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611ddbfad90 con 0x5611ddbeefe0 2024-08-20T01:40:43.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.662+0000 7fea78b4d640 1 --2- 172.21.15.79:0/2331346747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611ddbeefe0 0x5611ddbeca40 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fea6c009900 tx=0x7fea6c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e6c8b2ad698a2e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:43.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.662+0000 7fea537fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:40:43.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.662+0000 7fea537fe640 1 -- 172.21.15.79:0/2331346747 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea6c028060 con 0x5611ddbeefe0 2024-08-20T01:40:43.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.663+0000 7fea7c9a9740 1 -- 172.21.15.79:0/2331346747 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5611ddaf8150 con 0x5611ddbeefe0 2024-08-20T01:40:43.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.663+0000 7fea537fe640 1 -- 172.21.15.79:0/2331346747 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fea6c023670 con 0x5611ddbeefe0 2024-08-20T01:40:43.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.663+0000 7fea537fe640 1 -- 172.21.15.79:0/2331346747 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fea6c023870 con 0x5611ddbeefe0 2024-08-20T01:40:43.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.663+0000 7fea7c9a9740 10 client.16635 fetch_fsmap learned FSMap version 34 2024-08-20T01:40:43.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.663+0000 7fea7c9a9740 1 -- 172.21.15.79:0/2331346747 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5611ddbfd7f0 con 0x5611ddbeefe0 2024-08-20T01:40:43.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.663+0000 7fea537fe640 1 -- 172.21.15.79:0/2331346747 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5611ddaf8150 con 0x5611ddbeefe0 2024-08-20T01:40:43.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.663+0000 7fea537fe640 1 -- 172.21.15.79:0/2331346747 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 34) ==== 8386+0+0 (secure 0 0 0) 0x7fea6c02e890 con 0x5611ddbeefe0 2024-08-20T01:40:43.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.663+0000 7fea7c9a9740 10 client.16635 fetch_fsmap finished waiting for FSMap version 34 2024-08-20T01:40:43.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.663+0000 7fea7c9a9740 10 client.16635 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:40:43.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.663+0000 7fea7c9a9740 20 client.16635 populate_metadata read hostname 'smithi079' 2024-08-20T01:40:43.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.663+0000 7fea7c9a9740 1 --2- 172.21.15.79:0/2331346747 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5611ddbfecd0 0x5611ddc010f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:43.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.663+0000 7fea7c9a9740 4 client.16635 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:40:43.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.663+0000 7fea7c9a9740 1 -- 172.21.15.79:0/2331346747 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5611ddb5b880 con 0x5611ddbfecd0 2024-08-20T01:40:43.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.664+0000 7fea73fff640 1 --2- 172.21.15.79:0/2331346747 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5611ddbfecd0 0x5611ddc010f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:43.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.664+0000 7fea537fe640 10 client.16635 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:40:43.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.664+0000 7fea73fff640 1 --2- 172.21.15.79:0/2331346747 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5611ddbfecd0 0x5611ddc010f0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f8f853c40aa9542c server_cookie=e1f9f580bae57293 in_seq=0 out_seq=0 2024-08-20T01:40:43.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.665+0000 7fea537fe640 1 -- 172.21.15.79:0/2331346747 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5611ddb5b880 con 0x5611ddbfecd0 2024-08-20T01:40:43.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.665+0000 7fea537fe640 10 client.16635 handle_command_reply: tid=0 2024-08-20T01:40:43.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.665+0000 7fea7c9a9740 1 client.16635 shutdown 2024-08-20T01:40:43.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.665+0000 7fea7c9a9740 1 -- 172.21.15.79:0/2331346747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611ddbeefe0 msgr2=0x5611ddbeca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:43.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.665+0000 7fea7c9a9740 1 --2- 172.21.15.79:0/2331346747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611ddbeefe0 0x5611ddbeca40 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fea6c009900 tx=0x7fea6c004a40 comp rx=0 tx=0).stop 2024-08-20T01:40:43.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.665+0000 7fea7c9a9740 1 -- 172.21.15.79:0/2331346747 shutdown_connections 2024-08-20T01:40:43.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.665+0000 7fea7c9a9740 1 --2- 172.21.15.79:0/2331346747 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5611ddbfecd0 0x5611ddc010f0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:43.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.665+0000 7fea7c9a9740 1 --2- 172.21.15.79:0/2331346747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611ddbeefe0 0x5611ddbeca40 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:43.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.665+0000 7fea7c9a9740 1 --2- 172.21.15.79:0/2331346747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611ddbe3050 0x5611ddbec500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:43.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.665+0000 7fea7c9a9740 1 --2- 172.21.15.79:0/2331346747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611ddbe2730 0x5611ddbebfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:43.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.665+0000 7fea7c9a9740 1 -- 172.21.15.79:0/2331346747 >> 172.21.15.79:0/2331346747 conn(0x5611ddbe0560 msgr2=0x5611ddbe6100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:43.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.665+0000 7fea537fe640 0 client.16635 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:40:43.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.665+0000 7fea7c9a9740 1 -- 172.21.15.79:0/2331346747 shutdown_connections 2024-08-20T01:40:43.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.665+0000 7fea7c9a9740 1 -- 172.21.15.79:0/2331346747 wait complete. 2024-08-20T01:40:43.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.665+0000 7fea7c9a9740 20 client.16635 trim_cache size 0 max 16384 2024-08-20T01:40:43.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.680+0000 7fea7c9a9740 1 Processor -- start 2024-08-20T01:40:43.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.680+0000 7fea7c9a9740 1 -- start start 2024-08-20T01:40:43.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.680+0000 7fea7c9a9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611ddbe2730 0x5611ddbdf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:43.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.680+0000 7fea7c9a9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611ddbe3050 0x5611ddbec4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:43.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.680+0000 7fea7c9a9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611ddbeefe0 0x5611ddbeca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:43.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.680+0000 7fea7c9a9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fea741ac4d0 con 0x5611ddbe2730 2024-08-20T01:40:43.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.680+0000 7fea7c9a9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fea741ae100 con 0x5611ddbe3050 2024-08-20T01:40:43.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.680+0000 7fea7c9a9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fea741acba0 con 0x5611ddbeefe0 2024-08-20T01:40:43.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.680+0000 7fea73fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611ddbe2730 0x5611ddbdf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:43.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.680+0000 7fea73fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611ddbe2730 0x5611ddbdf7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42024/0 (socket says 172.21.15.79:42024) 2024-08-20T01:40:43.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.680+0000 7fea73fff640 1 -- 172.21.15.79:0/3267106548 learned_addr learned my addr 172.21.15.79:0/3267106548 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:43.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.680+0000 7fea78b4d640 1 --2- 172.21.15.79:0/3267106548 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611ddbeefe0 0x5611ddbeca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:43.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.680+0000 7fea737fe640 1 --2- 172.21.15.79:0/3267106548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611ddbe3050 0x5611ddbec4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:43.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.681+0000 7fea73fff640 1 -- 172.21.15.79:0/3267106548 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611ddbeefe0 msgr2=0x5611ddbeca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:43.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.681+0000 7fea73fff640 1 --2- 172.21.15.79:0/3267106548 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611ddbeefe0 0x5611ddbeca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:43.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.681+0000 7fea73fff640 1 -- 172.21.15.79:0/3267106548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611ddbe3050 msgr2=0x5611ddbec4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:43.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.681+0000 7fea73fff640 1 --2- 172.21.15.79:0/3267106548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611ddbe3050 0x5611ddbec4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:43.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.681+0000 7fea73fff640 1 -- 172.21.15.79:0/3267106548 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611ddbe0fe0 con 0x5611ddbe2730 2024-08-20T01:40:43.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.681+0000 7fea78b4d640 1 --2- 172.21.15.79:0/3267106548 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611ddbeefe0 0x5611ddbeca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:40:43.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.681+0000 7fea737fe640 1 --2- 172.21.15.79:0/3267106548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611ddbe3050 0x5611ddbec4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:40:43.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.681+0000 7fea73fff640 1 --2- 172.21.15.79:0/3267106548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611ddbe2730 0x5611ddbdf7a0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fea640caba0 tx=0x7fea64001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3097b3ef2cee053a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:43.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.681+0000 7fea59ffb640 1 -- 172.21.15.79:0/3267106548 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea640ca800 con 0x5611ddbe2730 2024-08-20T01:40:43.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.681+0000 7fea59ffb640 1 -- 172.21.15.79:0/3267106548 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fea640b2040 con 0x5611ddbe2730 2024-08-20T01:40:43.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.681+0000 7fea59ffb640 1 -- 172.21.15.79:0/3267106548 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea640ca9e0 con 0x5611ddbe2730 2024-08-20T01:40:43.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.682+0000 7fea7c9a9740 1 -- 172.21.15.79:0/3267106548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611ddbe2730 msgr2=0x5611ddbdf7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:43.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.682+0000 7fea7c9a9740 1 --2- 172.21.15.79:0/3267106548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611ddbe2730 0x5611ddbdf7a0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fea640caba0 tx=0x7fea64001e70 comp rx=0 tx=0).stop 2024-08-20T01:40:43.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.682+0000 7fea7c9a9740 1 -- 172.21.15.79:0/3267106548 shutdown_connections 2024-08-20T01:40:43.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.682+0000 7fea7c9a9740 1 --2- 172.21.15.79:0/3267106548 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611ddbeefe0 0x5611ddbeca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:43.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.682+0000 7fea7c9a9740 1 --2- 172.21.15.79:0/3267106548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611ddbe3050 0x5611ddbec4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:43.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.682+0000 7fea7c9a9740 1 --2- 172.21.15.79:0/3267106548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611ddbe2730 0x5611ddbdf7a0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:43.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.682+0000 7fea7c9a9740 1 -- 172.21.15.79:0/3267106548 >> 172.21.15.79:0/3267106548 conn(0x5611ddbe0560 msgr2=0x5611ddbede10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:43.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.682+0000 7fea7c9a9740 1 -- 172.21.15.79:0/3267106548 shutdown_connections 2024-08-20T01:40:43.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.682+0000 7fea7c9a9740 1 -- 172.21.15.79:0/3267106548 wait complete. 2024-08-20T01:40:43.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.682+0000 7fea7c9a9740 1 -- start start 2024-08-20T01:40:43.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.682+0000 7fea7c9a9740 1 Processor -- start 2024-08-20T01:40:43.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.683+0000 7fea7c9a9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611ddbe2730 0x5611ddbf2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:43.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.683+0000 7fea7c9a9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611ddbe3050 0x5611ddbf3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:43.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.683+0000 7fea7c9a9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611ddbeefe0 0x5611ddbf3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:43.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.683+0000 7fea7c9a9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fea741ad9d0 con 0x5611ddbe3050 2024-08-20T01:40:43.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.683+0000 7fea7c9a9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fea741ad270 con 0x5611ddbeefe0 2024-08-20T01:40:43.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.683+0000 7fea737fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611ddbe3050 0x5611ddbf3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:43.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.683+0000 7fea7c9a9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fea741aa4b0 con 0x5611ddbe2730 2024-08-20T01:40:43.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.683+0000 7fea73fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611ddbe2730 0x5611ddbf2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:43.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.683+0000 7fea737fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611ddbe3050 0x5611ddbf3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42030/0 (socket says 172.21.15.79:42030) 2024-08-20T01:40:43.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.683+0000 7fea73fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611ddbe2730 0x5611ddbf2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:34388/0 (socket says 172.21.15.79:34388) 2024-08-20T01:40:43.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.683+0000 7fea737fe640 1 -- 172.21.15.79:0/3297212573 learned_addr learned my addr 172.21.15.79:0/3297212573 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:43.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.683+0000 7fea7c9a9740 10 client.0 _ll_register_callbacks cb 0x7fea6c009a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:43.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.683+0000 7fea737fe640 1 -- 172.21.15.79:0/3297212573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611ddbe2730 msgr2=0x5611ddbf2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:43.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.683+0000 7fea737fe640 1 --2- 172.21.15.79:0/3297212573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611ddbe2730 0x5611ddbf2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:43.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.683+0000 7fea737fe640 1 -- 172.21.15.79:0/3297212573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611ddbeefe0 msgr2=0x5611ddbf3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:43.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.683+0000 7fea78b4d640 1 --2- 172.21.15.79:0/3297212573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611ddbeefe0 0x5611ddbf3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:43.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.683+0000 7fea737fe640 1 --2- 172.21.15.79:0/3297212573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611ddbeefe0 0x5611ddbf3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:43.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.683+0000 7fea737fe640 1 -- 172.21.15.79:0/3297212573 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611ddc68be0 con 0x5611ddbe3050 2024-08-20T01:40:43.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.683+0000 7fea73fff640 1 --2- 172.21.15.79:0/3297212573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611ddbe2730 0x5611ddbf2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:40:43.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.684+0000 7fea737fe640 1 --2- 172.21.15.79:0/3297212573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611ddbe3050 0x5611ddbf3230 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fea7406b3b0 tx=0x7fea68016b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f3cfd6b9d509b73 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:43.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.684+0000 7fea537fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:40:43.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.684+0000 7fea537fe640 1 -- 172.21.15.79:0/3297212573 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea680148b0 con 0x5611ddbe3050 2024-08-20T01:40:43.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.684+0000 7fea537fe640 1 -- 172.21.15.79:0/3297212573 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fea68014a50 con 0x5611ddbe3050 2024-08-20T01:40:43.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.684+0000 7fea7c9a9740 1 -- 172.21.15.79:0/3297212573 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea640b2040 con 0x5611ddbe3050 2024-08-20T01:40:43.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.684+0000 7fea537fe640 1 -- 172.21.15.79:0/3297212573 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fea68014c50 con 0x5611ddbe3050 2024-08-20T01:40:43.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.684+0000 7fea7c9a9740 10 client.16641 fetch_fsmap learned FSMap version 34 2024-08-20T01:40:43.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.684+0000 7fea7c9a9740 1 -- 172.21.15.79:0/3297212573 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5611ddc69f30 con 0x5611ddbe3050 2024-08-20T01:40:43.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.684+0000 7fea537fe640 1 -- 172.21.15.79:0/3297212573 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fea68014df0 con 0x5611ddbe3050 2024-08-20T01:40:43.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.685+0000 7fea537fe640 1 -- 172.21.15.79:0/3297212573 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 34) ==== 8386+0+0 (secure 0 0 0) 0x7fea68017560 con 0x5611ddbe3050 2024-08-20T01:40:43.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.685+0000 7fea7c9a9740 10 client.16641 fetch_fsmap finished waiting for FSMap version 34 2024-08-20T01:40:43.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.685+0000 7fea7c9a9740 10 client.16641 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:40:43.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.685+0000 7fea7c9a9740 20 client.16641 populate_metadata read hostname 'smithi079' 2024-08-20T01:40:43.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.685+0000 7fea7c9a9740 1 --2- 172.21.15.79:0/3297212573 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5611ddc6a6f0 0x5611ddc6cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:43.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.685+0000 7fea7c9a9740 4 client.16641 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:40:43.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.685+0000 7fea7c9a9740 1 -- 172.21.15.79:0/3297212573 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fea640b2040 con 0x5611ddc6a6f0 2024-08-20T01:40:43.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.685+0000 7fea73fff640 1 --2- 172.21.15.79:0/3297212573 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5611ddc6a6f0 0x5611ddc6cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:43.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.685+0000 7fea537fe640 10 client.16641 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:40:43.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.686+0000 7fea73fff640 1 --2- 172.21.15.79:0/3297212573 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5611ddc6a6f0 0x5611ddc6cb10 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e802bcfff785621f server_cookie=ab60e33a9e4b5b64 in_seq=0 out_seq=0 2024-08-20T01:40:43.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.686+0000 7fea537fe640 1 -- 172.21.15.79:0/3297212573 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fea640b2040 con 0x5611ddc6a6f0 2024-08-20T01:40:43.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.686+0000 7fea537fe640 10 client.16641 handle_command_reply: tid=0 2024-08-20T01:40:43.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.686+0000 7fea7c9a9740 1 client.16641 shutdown 2024-08-20T01:40:43.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.686+0000 7fea7c9a9740 1 -- 172.21.15.79:0/3297212573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611ddbe3050 msgr2=0x5611ddbf3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:43.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.686+0000 7fea7c9a9740 1 --2- 172.21.15.79:0/3297212573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611ddbe3050 0x5611ddbf3230 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fea7406b3b0 tx=0x7fea68016b50 comp rx=0 tx=0).stop 2024-08-20T01:40:43.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.686+0000 7fea7c9a9740 1 -- 172.21.15.79:0/3297212573 shutdown_connections 2024-08-20T01:40:43.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.686+0000 7fea7c9a9740 1 --2- 172.21.15.79:0/3297212573 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5611ddc6a6f0 0x5611ddc6cb10 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:43.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.686+0000 7fea7c9a9740 1 --2- 172.21.15.79:0/3297212573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611ddbeefe0 0x5611ddbf3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:43.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.686+0000 7fea7c9a9740 1 --2- 172.21.15.79:0/3297212573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5611ddbe3050 0x5611ddbf3230 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:43.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.686+0000 7fea7c9a9740 1 --2- 172.21.15.79:0/3297212573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611ddbe2730 0x5611ddbf2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:43.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.686+0000 7fea7c9a9740 1 -- 172.21.15.79:0/3297212573 >> 172.21.15.79:0/3297212573 conn(0x5611ddbe0560 msgr2=0x5611ddbf9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:43.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.686+0000 7fea537fe640 0 client.16641 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:40:43.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.686+0000 7fea7c9a9740 1 -- 172.21.15.79:0/3297212573 shutdown_connections 2024-08-20T01:40:43.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.686+0000 7fea7c9a9740 1 -- 172.21.15.79:0/3297212573 wait complete. 2024-08-20T01:40:43.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.686+0000 7fea7c9a9740 20 client.16641 trim_cache size 0 max 16384 2024-08-20T01:40:43.707 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:40:43.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.687+0000 7fea7a5b0640 1 -- 172.21.15.79:0/1840835832 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fea5c0b3c00 msgr2=0x7fea5c0b60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:43.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.687+0000 7fea7a5b0640 1 --2- 172.21.15.79:0/1840835832 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fea5c0b3c00 0x7fea5c0b60c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fea6c00a510 tx=0x7fea6c00d040 comp rx=0 tx=0).stop 2024-08-20T01:40:43.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.687+0000 7fea7a5b0640 1 -- 172.21.15.79:0/1840835832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea741073a0 msgr2=0x7fea7419a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:43.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.687+0000 7fea7a5b0640 1 --2- 172.21.15.79:0/1840835832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea741073a0 0x7fea7419a020 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fea64006010 tx=0x7fea64003d30 comp rx=0 tx=0).stop 2024-08-20T01:40:43.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.687+0000 7fea7a5b0640 1 -- 172.21.15.79:0/1840835832 shutdown_connections 2024-08-20T01:40:43.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.687+0000 7fea7a5b0640 1 --2- 172.21.15.79:0/1840835832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea7419aaa0 0x7fea741a50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:43.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.687+0000 7fea7a5b0640 1 --2- 172.21.15.79:0/1840835832 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fea5c0b3c00 0x7fea5c0b60c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:43.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.687+0000 7fea7a5b0640 1 --2- 172.21.15.79:0/1840835832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea74107d20 0x7fea7419a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:43.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.687+0000 7fea7a5b0640 1 --2- 172.21.15.79:0/1840835832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea741073a0 0x7fea7419a020 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:43.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.687+0000 7fea7a5b0640 1 -- 172.21.15.79:0/1840835832 >> 172.21.15.79:0/1840835832 conn(0x7fea740fd400 msgr2=0x7fea740ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:43.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.687+0000 7fea7a5b0640 1 -- 172.21.15.79:0/1840835832 shutdown_connections 2024-08-20T01:40:43.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:43.687+0000 7fea7a5b0640 1 -- 172.21.15.79:0/1840835832 wait complete. 2024-08-20T01:40:44.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:44 smithi175 ceph-mon[22392]: pgmap v449: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 29 MiB/s wr, 22 op/s 2024-08-20T01:40:44.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:44 smithi079 ceph-mon[18656]: pgmap v449: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 29 MiB/s wr, 22 op/s 2024-08-20T01:40:44.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:44 smithi081 ceph-mon[22209]: pgmap v449: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 29 MiB/s wr, 22 op/s 2024-08-20T01:40:44.545 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T01:40:44.817 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:40:45.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.340+0000 7fbc0f023640 1 -- 172.21.15.79:0/4116942946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc08103870 msgr2=0x7fbc08103c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:45.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.340+0000 7fbc0f023640 1 --2- 172.21.15.79:0/4116942946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc08103870 0x7fbc08103c50 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc009900 tx=0x7fbbfc02a410 comp rx=0 tx=0).stop 2024-08-20T01:40:45.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.340+0000 7fbc0f023640 1 -- 172.21.15.79:0/4116942946 shutdown_connections 2024-08-20T01:40:45.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.340+0000 7fbc0f023640 1 --2- 172.21.15.79:0/4116942946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc0810ce20 0x7fbc0810f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:45.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.340+0000 7fbc0f023640 1 --2- 172.21.15.79:0/4116942946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc08104270 0x7fbc0810c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:45.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.340+0000 7fbc0f023640 1 --2- 172.21.15.79:0/4116942946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc08103870 0x7fbc08103c50 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:45.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.340+0000 7fbc0f023640 1 -- 172.21.15.79:0/4116942946 >> 172.21.15.79:0/4116942946 conn(0x7fbc080fd460 msgr2=0x7fbc080ff880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:45.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.340+0000 7fbc0f023640 1 -- 172.21.15.79:0/4116942946 shutdown_connections 2024-08-20T01:40:45.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.340+0000 7fbc0f023640 1 -- 172.21.15.79:0/4116942946 wait complete. 2024-08-20T01:40:45.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.341+0000 7fbc0f023640 1 Processor -- start 2024-08-20T01:40:45.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.341+0000 7fbc0f023640 1 -- start start 2024-08-20T01:40:45.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.341+0000 7fbc0f023640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc08103870 0x7fbc08198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:45.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.341+0000 7fbc0f023640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc08104270 0x7fbc081993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:45.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.341+0000 7fbc0f023640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc0810ce20 0x7fbc0819e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:45.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.341+0000 7fbc0f023640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbc08112950 con 0x7fbc0810ce20 2024-08-20T01:40:45.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.341+0000 7fbc0f023640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbc081127d0 con 0x7fbc08103870 2024-08-20T01:40:45.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.341+0000 7fbc0f023640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbc08112ad0 con 0x7fbc08104270 2024-08-20T01:40:45.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.341+0000 7fbc0d5c0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc0810ce20 0x7fbc0819e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:45.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.341+0000 7fbc0d5c0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc0810ce20 0x7fbc0819e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42062/0 (socket says 172.21.15.79:42062) 2024-08-20T01:40:45.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.341+0000 7fbc0d5c0640 1 -- 172.21.15.79:0/174406008 learned_addr learned my addr 172.21.15.79:0/174406008 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:45.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.341+0000 7fbc0cdbf640 1 --2- 172.21.15.79:0/174406008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc08103870 0x7fbc08198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:45.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.341+0000 7fbc07fff640 1 --2- 172.21.15.79:0/174406008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc08104270 0x7fbc081993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:45.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.342+0000 7fbc0d5c0640 1 -- 172.21.15.79:0/174406008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc08104270 msgr2=0x7fbc081993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:45.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.342+0000 7fbc0d5c0640 1 --2- 172.21.15.79:0/174406008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc08104270 0x7fbc081993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:45.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.342+0000 7fbc0d5c0640 1 -- 172.21.15.79:0/174406008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc08103870 msgr2=0x7fbc08198e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:45.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.342+0000 7fbc0d5c0640 1 --2- 172.21.15.79:0/174406008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc08103870 0x7fbc08198e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:45.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.342+0000 7fbc0d5c0640 1 -- 172.21.15.79:0/174406008 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc0819ef10 con 0x7fbc0810ce20 2024-08-20T01:40:45.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.342+0000 7fbc07fff640 1 --2- 172.21.15.79:0/174406008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc08104270 0x7fbc081993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:40:45.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.342+0000 7fbc0d5c0640 1 --2- 172.21.15.79:0/174406008 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc0810ce20 0x7fbc0819e740 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fbc0000cce0 tx=0x7fbc0000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:45.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.342+0000 7fbc05ffb640 1 -- 172.21.15.79:0/174406008 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc0000f450 con 0x7fbc0810ce20 2024-08-20T01:40:45.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.342+0000 7fbc05ffb640 1 -- 172.21.15.79:0/174406008 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbc0000fa80 con 0x7fbc0810ce20 2024-08-20T01:40:45.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.342+0000 7fbc0f023640 1 -- 172.21.15.79:0/174406008 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc0819f200 con 0x7fbc0810ce20 2024-08-20T01:40:45.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.342+0000 7fbc05ffb640 1 -- 172.21.15.79:0/174406008 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc00018ad0 con 0x7fbc0810ce20 2024-08-20T01:40:45.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.342+0000 7fbc0f023640 1 -- 172.21.15.79:0/174406008 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc081a58c0 con 0x7fbc0810ce20 2024-08-20T01:40:45.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.345+0000 7fbc05ffb640 1 -- 172.21.15.79:0/174406008 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fbc0000f5f0 con 0x7fbc0810ce20 2024-08-20T01:40:45.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.345+0000 7fbc1141c740 1 Processor -- start 2024-08-20T01:40:45.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.345+0000 7fbc1141c740 1 -- start start 2024-08-20T01:40:45.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.345+0000 7fbc1141c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5612456e6880 0x5612456e6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:45.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.345+0000 7fbc1141c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612456e71a0 0x5612456f2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:45.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.345+0000 7fbc1141c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5612456f3130 0x5612456f5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:45.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.345+0000 7fbc1141c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56124565d930 con 0x5612456e71a0 2024-08-20T01:40:45.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.345+0000 7fbc1141c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56124564ce30 con 0x5612456f3130 2024-08-20T01:40:45.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.345+0000 7fbc1141c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561245650e70 con 0x5612456e6880 2024-08-20T01:40:45.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.346+0000 7fbc0cdbf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612456e71a0 0x5612456f2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:45.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.346+0000 7fbc0cdbf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612456e71a0 0x5612456f2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42078/0 (socket says 172.21.15.79:42078) 2024-08-20T01:40:45.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.346+0000 7fbc0cdbf640 1 -- 172.21.15.79:0/3875064104 learned_addr learned my addr 172.21.15.79:0/3875064104 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:45.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.346+0000 7fbc07fff640 1 --2- 172.21.15.79:0/3875064104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5612456f3130 0x5612456f5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:45.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.346+0000 7fbc07fff640 1 --2- 172.21.15.79:0/3875064104 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5612456e6880 0x5612456e6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:45.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.346+0000 7fbc0cdbf640 1 -- 172.21.15.79:0/3875064104 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5612456e6880 msgr2=0x5612456e6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:45.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.346+0000 7fbc0cdbf640 1 --2- 172.21.15.79:0/3875064104 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5612456e6880 0x5612456e6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:45.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.346+0000 7fbc0cdbf640 1 -- 172.21.15.79:0/3875064104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5612456f3130 msgr2=0x5612456f5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:45.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.346+0000 7fbc0cdbf640 1 --2- 172.21.15.79:0/3875064104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5612456f3130 0x5612456f5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:45.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.346+0000 7fbc0cdbf640 1 -- 172.21.15.79:0/3875064104 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612453ac650 con 0x5612456e71a0 2024-08-20T01:40:45.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.346+0000 7fbc05ffb640 1 --2- 172.21.15.79:0/174406008 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbbf80b3c50 0x7fbbf80b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:45.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.346+0000 7fbc07fff640 1 --2- 172.21.15.79:0/174406008 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbbf80b3c50 0x7fbbf80b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:45.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.346+0000 7fbc0cdbf640 1 --2- 172.21.15.79:0/3875064104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612456e71a0 0x5612456f2bf0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc02a930 tx=0x7fbbfc031dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63e240a4a67c8bc0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:45.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.346+0000 7fbc05ffb640 1 -- 172.21.15.79:0/174406008 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fbc000e42b0 con 0x7fbc0810ce20 2024-08-20T01:40:45.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.346+0000 7fbbf2ffd640 1 -- 172.21.15.79:0/3875064104 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc035030 con 0x5612456e71a0 2024-08-20T01:40:45.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.346+0000 7fbbf2ffd640 1 -- 172.21.15.79:0/3875064104 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbbfc040070 con 0x5612456e71a0 2024-08-20T01:40:45.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.347+0000 7fbbf2ffd640 1 -- 172.21.15.79:0/3875064104 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc003970 con 0x5612456e71a0 2024-08-20T01:40:45.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.347+0000 7fbc1141c740 1 -- 172.21.15.79:0/3875064104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612456e71a0 msgr2=0x5612456f2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:45.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.347+0000 7fbc1141c740 1 --2- 172.21.15.79:0/3875064104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612456e71a0 0x5612456f2bf0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc02a930 tx=0x7fbbfc031dc0 comp rx=0 tx=0).stop 2024-08-20T01:40:45.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.347+0000 7fbc07fff640 1 --2- 172.21.15.79:0/174406008 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbbf80b3c50 0x7fbbf80b6110 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x5612456e6830 tx=0x7fbbf400c510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:45.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.347+0000 7fbc1141c740 1 -- 172.21.15.79:0/3875064104 shutdown_connections 2024-08-20T01:40:45.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.347+0000 7fbc1141c740 1 --2- 172.21.15.79:0/3875064104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5612456f3130 0x5612456f5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:45.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.347+0000 7fbc1141c740 1 --2- 172.21.15.79:0/3875064104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612456e71a0 0x5612456f2bf0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:45.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.347+0000 7fbc1141c740 1 --2- 172.21.15.79:0/3875064104 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5612456e6880 0x5612456e6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:45.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.347+0000 7fbc1141c740 1 -- 172.21.15.79:0/3875064104 >> 172.21.15.79:0/3875064104 conn(0x5612456e46b0 msgr2=0x5612456e5850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:45.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.347+0000 7fbc1141c740 1 -- 172.21.15.79:0/3875064104 shutdown_connections 2024-08-20T01:40:45.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.347+0000 7fbc1141c740 1 -- 172.21.15.79:0/3875064104 wait complete. 2024-08-20T01:40:45.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.348+0000 7fbc1141c740 1 -- start start 2024-08-20T01:40:45.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.348+0000 7fbc1141c740 1 Processor -- start 2024-08-20T01:40:45.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.348+0000 7fbc1141c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5612456e6880 0x5612456f00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:45.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.348+0000 7fbc1141c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5612456e71a0 0x5612456f0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:45.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.348+0000 7fbc1141c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612456f3130 0x5612456f0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:45.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.348+0000 7fbc1141c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5612454af700 con 0x5612456f3130 2024-08-20T01:40:45.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.348+0000 7fbc1141c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5612455d3810 con 0x5612456e6880 2024-08-20T01:40:45.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.348+0000 7fbc1141c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5612456f5d80 con 0x5612456e71a0 2024-08-20T01:40:45.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.348+0000 7fbc1141c740 10 client.0 _ll_register_callbacks cb 0x561245646700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:45.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.348+0000 7fbc0d5c0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612456f3130 0x5612456f0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:45.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.348+0000 7fbc07fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5612456e71a0 0x5612456f0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:45.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.348+0000 7fbc0cdbf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5612456e6880 0x5612456f00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:45.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.348+0000 7fbc0d5c0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612456f3130 0x5612456f0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42084/0 (socket says 172.21.15.79:42084) 2024-08-20T01:40:45.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.348+0000 7fbc0d5c0640 1 -- 172.21.15.79:0/1684669072 learned_addr learned my addr 172.21.15.79:0/1684669072 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:45.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.349+0000 7fbc0cdbf640 1 -- 172.21.15.79:0/1684669072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5612456e71a0 msgr2=0x5612456f0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:45.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.349+0000 7fbc0cdbf640 1 --2- 172.21.15.79:0/1684669072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5612456e71a0 0x5612456f0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:45.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.349+0000 7fbc0cdbf640 1 -- 172.21.15.79:0/1684669072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612456f3130 msgr2=0x5612456f0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:45.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.349+0000 7fbc0cdbf640 1 --2- 172.21.15.79:0/1684669072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612456f3130 0x5612456f0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:45.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.349+0000 7fbc0cdbf640 1 -- 172.21.15.79:0/1684669072 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612456ff190 con 0x5612456e6880 2024-08-20T01:40:45.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.349+0000 7fbc07fff640 1 --2- 172.21.15.79:0/1684669072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5612456e71a0 0x5612456f0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:40:45.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.349+0000 7fbc0cdbf640 1 --2- 172.21.15.79:0/1684669072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5612456e6880 0x5612456f00f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc0057c0 tx=0x7fbbfc0316b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91998fecab0c00c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:45.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.349+0000 7fbbe7fff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:40:45.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.349+0000 7fbbe7fff640 1 -- 172.21.15.79:0/1684669072 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc04c060 con 0x5612456e6880 2024-08-20T01:40:45.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.349+0000 7fbbe7fff640 1 -- 172.21.15.79:0/1684669072 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fbbfc03c850 con 0x5612456e6880 2024-08-20T01:40:45.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.349+0000 7fbc1141c740 1 -- 172.21.15.79:0/1684669072 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5612455fc150 con 0x5612456e6880 2024-08-20T01:40:45.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.349+0000 7fbbe7fff640 1 -- 172.21.15.79:0/1684669072 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fbbfc035070 con 0x5612456e6880 2024-08-20T01:40:45.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.349+0000 7fbc1141c740 10 client.25889 fetch_fsmap learned FSMap version 34 2024-08-20T01:40:45.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.349+0000 7fbc1141c740 1 -- 172.21.15.79:0/1684669072 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x561245701b40 con 0x5612456e6880 2024-08-20T01:40:45.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.350+0000 7fbbe7fff640 1 -- 172.21.15.79:0/1684669072 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5612455fc150 con 0x5612456e6880 2024-08-20T01:40:45.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.350+0000 7fbbe7fff640 1 -- 172.21.15.79:0/1684669072 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 34) ==== 8386+0+0 (secure 0 0 0) 0x7fbbfc044720 con 0x5612456e6880 2024-08-20T01:40:45.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.350+0000 7fbc1141c740 10 client.25889 fetch_fsmap finished waiting for FSMap version 34 2024-08-20T01:40:45.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.350+0000 7fbc1141c740 10 client.25889 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:40:45.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.350+0000 7fbc1141c740 20 client.25889 populate_metadata read hostname 'smithi079' 2024-08-20T01:40:45.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.350+0000 7fbc1141c740 1 --2- 172.21.15.79:0/1684669072 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x561245702e90 0x561245705280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:45.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.350+0000 7fbc1141c740 4 client.25889 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:40:45.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.350+0000 7fbc1141c740 1 -- 172.21.15.79:0/1684669072 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56124565f880 con 0x561245702e90 2024-08-20T01:40:45.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.350+0000 7fbc07fff640 1 --2- 172.21.15.79:0/1684669072 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x561245702e90 0x561245705280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:45.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.351+0000 7fbbe7fff640 10 client.25889 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:40:45.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.351+0000 7fbc07fff640 1 --2- 172.21.15.79:0/1684669072 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x561245702e90 0x561245705280 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3ea446162b5a898f server_cookie=d3bbf31161b9a13c in_seq=0 out_seq=0 2024-08-20T01:40:45.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.352+0000 7fbbe7fff640 1 -- 172.21.15.79:0/1684669072 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56124565f880 con 0x561245702e90 2024-08-20T01:40:45.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.352+0000 7fbbe7fff640 10 client.25889 handle_command_reply: tid=0 2024-08-20T01:40:45.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.352+0000 7fbc1141c740 1 client.25889 shutdown 2024-08-20T01:40:45.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.352+0000 7fbc1141c740 1 -- 172.21.15.79:0/1684669072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5612456e6880 msgr2=0x5612456f00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:45.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.352+0000 7fbc1141c740 1 --2- 172.21.15.79:0/1684669072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5612456e6880 0x5612456f00f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc0057c0 tx=0x7fbbfc0316b0 comp rx=0 tx=0).stop 2024-08-20T01:40:45.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.352+0000 7fbc1141c740 1 -- 172.21.15.79:0/1684669072 shutdown_connections 2024-08-20T01:40:45.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.352+0000 7fbc1141c740 1 --2- 172.21.15.79:0/1684669072 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x561245702e90 0x561245705280 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:45.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.352+0000 7fbc1141c740 1 --2- 172.21.15.79:0/1684669072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612456f3130 0x5612456f0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:45.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.352+0000 7fbbe7fff640 0 client.25889 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:40:45.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.352+0000 7fbc1141c740 1 --2- 172.21.15.79:0/1684669072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5612456e71a0 0x5612456f0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:45.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.352+0000 7fbc1141c740 1 --2- 172.21.15.79:0/1684669072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5612456e6880 0x5612456f00f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:45.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.352+0000 7fbc1141c740 1 -- 172.21.15.79:0/1684669072 >> 172.21.15.79:0/1684669072 conn(0x5612456e46b0 msgr2=0x5612456ea250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:45.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.352+0000 7fbc1141c740 1 -- 172.21.15.79:0/1684669072 shutdown_connections 2024-08-20T01:40:45.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.352+0000 7fbc1141c740 1 -- 172.21.15.79:0/1684669072 wait complete. 2024-08-20T01:40:45.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.352+0000 7fbc1141c740 20 client.25889 trim_cache size 0 max 16384 2024-08-20T01:40:45.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.368+0000 7fbc1141c740 1 Processor -- start 2024-08-20T01:40:45.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.368+0000 7fbc1141c740 1 -- start start 2024-08-20T01:40:45.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.368+0000 7fbc1141c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612456e6880 0x5612456f1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:45.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.368+0000 7fbc1141c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5612456e71a0 0x5612456f05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:45.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.368+0000 7fbc1141c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5612456f3130 0x5612456f0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:45.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.368+0000 7fbc1141c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbc081ade80 con 0x5612456e6880 2024-08-20T01:40:45.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.368+0000 7fbc1141c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbc081afab0 con 0x5612456f3130 2024-08-20T01:40:45.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.368+0000 7fbc1141c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbc081ae550 con 0x5612456e71a0 2024-08-20T01:40:45.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.368+0000 7fbc0cdbf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612456e6880 0x5612456f1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:45.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.368+0000 7fbc0cdbf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612456e6880 0x5612456f1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42096/0 (socket says 172.21.15.79:42096) 2024-08-20T01:40:45.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.368+0000 7fbc0cdbf640 1 -- 172.21.15.79:0/3069520755 learned_addr learned my addr 172.21.15.79:0/3069520755 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:45.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.368+0000 7fbc07fff640 1 --2- 172.21.15.79:0/3069520755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5612456e71a0 0x5612456f05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:45.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.368+0000 7fbc0cdbf640 1 -- 172.21.15.79:0/3069520755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5612456e71a0 msgr2=0x5612456f05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:45.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.368+0000 7fbc0cdbf640 1 --2- 172.21.15.79:0/3069520755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5612456e71a0 0x5612456f05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:45.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.369+0000 7fbc0d5c0640 1 --2- 172.21.15.79:0/3069520755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5612456f3130 0x5612456f0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:45.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.369+0000 7fbc0cdbf640 1 -- 172.21.15.79:0/3069520755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5612456f3130 msgr2=0x5612456f0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:45.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.369+0000 7fbc0cdbf640 1 --2- 172.21.15.79:0/3069520755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5612456f3130 0x5612456f0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:45.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.369+0000 7fbc0cdbf640 1 -- 172.21.15.79:0/3069520755 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612456ef050 con 0x5612456e6880 2024-08-20T01:40:45.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.369+0000 7fbc0d5c0640 1 --2- 172.21.15.79:0/3069520755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5612456f3130 0x5612456f0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:40:45.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.369+0000 7fbc0cdbf640 1 --2- 172.21.15.79:0/3069520755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612456e6880 0x5612456f1e30 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc009900 tx=0x7fbbfc005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=440c370a6bb35349 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:45.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.369+0000 7fbbf27fc640 1 -- 172.21.15.79:0/3069520755 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc057070 con 0x5612456e6880 2024-08-20T01:40:45.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.369+0000 7fbbf27fc640 1 -- 172.21.15.79:0/3069520755 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbbfc040070 con 0x5612456e6880 2024-08-20T01:40:45.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.369+0000 7fbbf27fc640 1 -- 172.21.15.79:0/3069520755 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc04c030 con 0x5612456e6880 2024-08-20T01:40:45.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.370+0000 7fbc1141c740 1 -- 172.21.15.79:0/3069520755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612456e6880 msgr2=0x5612456f1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:45.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.370+0000 7fbc1141c740 1 --2- 172.21.15.79:0/3069520755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612456e6880 0x5612456f1e30 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc009900 tx=0x7fbbfc005bd0 comp rx=0 tx=0).stop 2024-08-20T01:40:45.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.370+0000 7fbc1141c740 1 -- 172.21.15.79:0/3069520755 shutdown_connections 2024-08-20T01:40:45.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.370+0000 7fbc1141c740 1 --2- 172.21.15.79:0/3069520755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5612456f3130 0x5612456f0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:45.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.370+0000 7fbc1141c740 1 --2- 172.21.15.79:0/3069520755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5612456e71a0 0x5612456f05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:45.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.370+0000 7fbc1141c740 1 --2- 172.21.15.79:0/3069520755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612456e6880 0x5612456f1e30 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:45.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.370+0000 7fbc1141c740 1 -- 172.21.15.79:0/3069520755 >> 172.21.15.79:0/3069520755 conn(0x5612456e46b0 msgr2=0x5612456f1720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:45.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.370+0000 7fbc1141c740 1 -- 172.21.15.79:0/3069520755 shutdown_connections 2024-08-20T01:40:45.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.370+0000 7fbc1141c740 1 -- 172.21.15.79:0/3069520755 wait complete. 2024-08-20T01:40:45.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.370+0000 7fbc1141c740 1 -- start start 2024-08-20T01:40:45.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.370+0000 7fbc1141c740 1 Processor -- start 2024-08-20T01:40:45.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.371+0000 7fbc1141c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5612456e6880 0x5612456f6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:45.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.371+0000 7fbc1141c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612456e71a0 0x5612456f6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:45.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.371+0000 7fbc1141c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5612456f3130 0x56124576b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:45.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.371+0000 7fbc1141c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbc081af380 con 0x5612456e71a0 2024-08-20T01:40:45.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.371+0000 7fbc07fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612456e71a0 0x5612456f6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:45.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.371+0000 7fbc07fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612456e71a0 0x5612456f6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42106/0 (socket says 172.21.15.79:42106) 2024-08-20T01:40:45.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.371+0000 7fbc07fff640 1 -- 172.21.15.79:0/477523489 learned_addr learned my addr 172.21.15.79:0/477523489 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:45.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.371+0000 7fbc1141c740 1 -- 172.21.15.79:0/477523489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbc081aec20 con 0x5612456e6880 2024-08-20T01:40:45.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.371+0000 7fbc1141c740 1 -- 172.21.15.79:0/477523489 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbc081abe60 con 0x5612456f3130 2024-08-20T01:40:45.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.371+0000 7fbc1141c740 10 client.0 _ll_register_callbacks cb 0x7fbbf400cab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:45.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.371+0000 7fbc0cdbf640 1 --2- 172.21.15.79:0/477523489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5612456e6880 0x5612456f6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:45.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.371+0000 7fbc0d5c0640 1 --2- 172.21.15.79:0/477523489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5612456f3130 0x56124576b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:45.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.371+0000 7fbc07fff640 1 -- 172.21.15.79:0/477523489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5612456f3130 msgr2=0x56124576b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:45.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.371+0000 7fbc07fff640 1 --2- 172.21.15.79:0/477523489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5612456f3130 0x56124576b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:45.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.371+0000 7fbc07fff640 1 -- 172.21.15.79:0/477523489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5612456e6880 msgr2=0x5612456f6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:45.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.371+0000 7fbc07fff640 1 --2- 172.21.15.79:0/477523489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5612456e6880 0x5612456f6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:45.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.371+0000 7fbc07fff640 1 -- 172.21.15.79:0/477523489 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56124576bdd0 con 0x5612456e71a0 2024-08-20T01:40:45.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.371+0000 7fbc0d5c0640 1 --2- 172.21.15.79:0/477523489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5612456f3130 0x56124576b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:40:45.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.371+0000 7fbc0cdbf640 1 --2- 172.21.15.79:0/477523489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5612456e6880 0x5612456f6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:40:45.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.371+0000 7fbc07fff640 1 --2- 172.21.15.79:0/477523489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612456e71a0 0x5612456f6b50 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fbbf40058c0 tx=0x7fbbf40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=184b0f756e9bf309 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:45.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.371+0000 7fbbe7fff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:40:45.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.372+0000 7fbbe7fff640 1 -- 172.21.15.79:0/477523489 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf4013e60 con 0x5612456e71a0 2024-08-20T01:40:45.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.372+0000 7fbbe7fff640 1 -- 172.21.15.79:0/477523489 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fbbf40037f0 con 0x5612456e71a0 2024-08-20T01:40:45.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.372+0000 7fbc1141c740 1 -- 172.21.15.79:0/477523489 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbfc040070 con 0x5612456e71a0 2024-08-20T01:40:45.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.372+0000 7fbbe7fff640 1 -- 172.21.15.79:0/477523489 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fbbf4039050 con 0x5612456e71a0 2024-08-20T01:40:45.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.372+0000 7fbc1141c740 10 client.16659 fetch_fsmap learned FSMap version 34 2024-08-20T01:40:45.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.372+0000 7fbc1141c740 1 -- 172.21.15.79:0/477523489 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56124576d0d0 con 0x5612456e71a0 2024-08-20T01:40:45.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.372+0000 7fbbe7fff640 1 -- 172.21.15.79:0/477523489 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbbfc040070 con 0x5612456e71a0 2024-08-20T01:40:45.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.372+0000 7fbbe7fff640 1 -- 172.21.15.79:0/477523489 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 34) ==== 8386+0+0 (secure 0 0 0) 0x7fbbf4020040 con 0x5612456e71a0 2024-08-20T01:40:45.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.372+0000 7fbc1141c740 10 client.16659 fetch_fsmap finished waiting for FSMap version 34 2024-08-20T01:40:45.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.372+0000 7fbc1141c740 10 client.16659 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:40:45.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.372+0000 7fbc1141c740 20 client.16659 populate_metadata read hostname 'smithi079' 2024-08-20T01:40:45.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.372+0000 7fbc1141c740 1 --2- 172.21.15.79:0/477523489 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x56124576d880 0x56124576fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:45.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.372+0000 7fbc1141c740 4 client.16659 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:40:45.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.372+0000 7fbc1141c740 1 -- 172.21.15.79:0/477523489 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56124565b320 con 0x56124576d880 2024-08-20T01:40:45.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.373+0000 7fbc0cdbf640 1 --2- 172.21.15.79:0/477523489 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x56124576d880 0x56124576fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:45.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.373+0000 7fbbe7fff640 10 client.16659 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:40:45.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.373+0000 7fbc0cdbf640 1 --2- 172.21.15.79:0/477523489 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x56124576d880 0x56124576fca0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b05587cabd38a219 server_cookie=96b67700efa64f6d in_seq=0 out_seq=0 2024-08-20T01:40:45.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.373+0000 7fbbe7fff640 1 -- 172.21.15.79:0/477523489 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56124565b320 con 0x56124576d880 2024-08-20T01:40:45.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.373+0000 7fbbe7fff640 10 client.16659 handle_command_reply: tid=0 2024-08-20T01:40:45.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.373+0000 7fbc1141c740 1 client.16659 shutdown 2024-08-20T01:40:45.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.373+0000 7fbc1141c740 1 -- 172.21.15.79:0/477523489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612456e71a0 msgr2=0x5612456f6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:45.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.373+0000 7fbc1141c740 1 --2- 172.21.15.79:0/477523489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612456e71a0 0x5612456f6b50 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fbbf40058c0 tx=0x7fbbf40046c0 comp rx=0 tx=0).stop 2024-08-20T01:40:45.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.373+0000 7fbc1141c740 1 -- 172.21.15.79:0/477523489 shutdown_connections 2024-08-20T01:40:45.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.373+0000 7fbc1141c740 1 --2- 172.21.15.79:0/477523489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5612456f3130 0x56124576b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:45.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.373+0000 7fbc1141c740 1 --2- 172.21.15.79:0/477523489 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x56124576d880 0x56124576fca0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:45.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.373+0000 7fbc1141c740 1 --2- 172.21.15.79:0/477523489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612456e71a0 0x5612456f6b50 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:45.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.373+0000 7fbc1141c740 1 --2- 172.21.15.79:0/477523489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5612456e6880 0x5612456f6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:45.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.373+0000 7fbc1141c740 1 -- 172.21.15.79:0/477523489 >> 172.21.15.79:0/477523489 conn(0x5612456e46b0 msgr2=0x5612456f1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:45.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.374+0000 7fbbe7fff640 0 client.16659 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:40:45.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.374+0000 7fbc1141c740 1 -- 172.21.15.79:0/477523489 shutdown_connections 2024-08-20T01:40:45.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.374+0000 7fbc1141c740 1 -- 172.21.15.79:0/477523489 wait complete. 2024-08-20T01:40:45.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.374+0000 7fbc1141c740 20 client.16659 trim_cache size 0 max 16384 2024-08-20T01:40:45.387 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:40:45.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.374+0000 7fbc0f023640 1 -- 172.21.15.79:0/174406008 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbbf80b3c50 msgr2=0x7fbbf80b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:45.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.374+0000 7fbc0f023640 1 --2- 172.21.15.79:0/174406008 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbbf80b3c50 0x7fbbf80b6110 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x5612456e6830 tx=0x7fbbf400c510 comp rx=0 tx=0).stop 2024-08-20T01:40:45.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.374+0000 7fbc0f023640 1 -- 172.21.15.79:0/174406008 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc0810ce20 msgr2=0x7fbc0819e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:45.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.374+0000 7fbc0f023640 1 --2- 172.21.15.79:0/174406008 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc0810ce20 0x7fbc0819e740 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fbc0000cce0 tx=0x7fbc0000a620 comp rx=0 tx=0).stop 2024-08-20T01:40:45.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.375+0000 7fbc0f023640 1 -- 172.21.15.79:0/174406008 shutdown_connections 2024-08-20T01:40:45.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.375+0000 7fbc0f023640 1 --2- 172.21.15.79:0/174406008 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc0810ce20 0x7fbc0819e740 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:45.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.375+0000 7fbc0f023640 1 --2- 172.21.15.79:0/174406008 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbbf80b3c50 0x7fbbf80b6110 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:45.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.375+0000 7fbc0f023640 1 --2- 172.21.15.79:0/174406008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc08104270 0x7fbc081993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:45.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.375+0000 7fbc0f023640 1 --2- 172.21.15.79:0/174406008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc08103870 0x7fbc08198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:45.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.375+0000 7fbc0f023640 1 -- 172.21.15.79:0/174406008 >> 172.21.15.79:0/174406008 conn(0x7fbc080fd460 msgr2=0x7fbc080fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:45.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.375+0000 7fbc0f023640 1 -- 172.21.15.79:0/174406008 shutdown_connections 2024-08-20T01:40:45.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:45.375+0000 7fbc0f023640 1 -- 172.21.15.79:0/174406008 wait complete. 2024-08-20T01:40:46.185 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T01:40:46.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:46 smithi175 ceph-mon[22392]: pgmap v450: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 30 MiB/s wr, 26 op/s 2024-08-20T01:40:46.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:46 smithi079 ceph-mon[18656]: pgmap v450: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 30 MiB/s wr, 26 op/s 2024-08-20T01:40:46.476 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:40:46.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:46 smithi081 ceph-mon[22209]: pgmap v450: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 30 MiB/s wr, 26 op/s 2024-08-20T01:40:47.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.989+0000 7fc0bce0b640 1 -- 172.21.15.79:0/3190630481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b81042c0 msgr2=0x7fc0b810c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:47.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.989+0000 7fc0bce0b640 1 --2- 172.21.15.79:0/3190630481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b81042c0 0x7fc0b810c7b0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0009900 tx=0x7fc0a002a410 comp rx=0 tx=0).stop 2024-08-20T01:40:47.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.989+0000 7fc0bce0b640 1 -- 172.21.15.79:0/3190630481 shutdown_connections 2024-08-20T01:40:47.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.989+0000 7fc0bce0b640 1 --2- 172.21.15.79:0/3190630481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0b810ce00 0x7fc0b810f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:47.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.989+0000 7fc0bce0b640 1 --2- 172.21.15.79:0/3190630481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b81042c0 0x7fc0b810c7b0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:47.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.989+0000 7fc0bce0b640 1 --2- 172.21.15.79:0/3190630481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0b81039a0 0x7fc0b8103d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:47.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.989+0000 7fc0bce0b640 1 -- 172.21.15.79:0/3190630481 >> 172.21.15.79:0/3190630481 conn(0x7fc0b80fd400 msgr2=0x7fc0b80ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:47.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.989+0000 7fc0bce0b640 1 -- 172.21.15.79:0/3190630481 shutdown_connections 2024-08-20T01:40:47.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.989+0000 7fc0bce0b640 1 -- 172.21.15.79:0/3190630481 wait complete. 2024-08-20T01:40:47.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.990+0000 7fc0bce0b640 1 Processor -- start 2024-08-20T01:40:47.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.990+0000 7fc0bce0b640 1 -- start start 2024-08-20T01:40:47.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.990+0000 7fc0bce0b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b81039a0 0x7fc0b8198f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:47.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.990+0000 7fc0bce0b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0b81042c0 0x7fc0b8199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:47.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.990+0000 7fc0bce0b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0b810ce00 0x7fc0b819e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:47.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.990+0000 7fc0bce0b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b8112960 con 0x7fc0b81039a0 2024-08-20T01:40:47.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.990+0000 7fc0bce0b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b81127e0 con 0x7fc0b81042c0 2024-08-20T01:40:47.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.990+0000 7fc0bce0b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b8112ae0 con 0x7fc0b810ce00 2024-08-20T01:40:47.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.991+0000 7fc0b659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b81039a0 0x7fc0b8198f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:47.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.991+0000 7fc0b659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b81039a0 0x7fc0b8198f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42118/0 (socket says 172.21.15.79:42118) 2024-08-20T01:40:47.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.991+0000 7fc0b659c640 1 -- 172.21.15.79:0/718296517 learned_addr learned my addr 172.21.15.79:0/718296517 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:47.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.991+0000 7fc0b6d9d640 1 --2- 172.21.15.79:0/718296517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0b810ce00 0x7fc0b819e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:47.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.991+0000 7fc0affff640 1 --2- 172.21.15.79:0/718296517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0b81042c0 0x7fc0b8199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:47.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.991+0000 7fc0b659c640 1 -- 172.21.15.79:0/718296517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0b810ce00 msgr2=0x7fc0b819e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:47.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.991+0000 7fc0b659c640 1 --2- 172.21.15.79:0/718296517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0b810ce00 0x7fc0b819e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:47.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.991+0000 7fc0b659c640 1 -- 172.21.15.79:0/718296517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0b81042c0 msgr2=0x7fc0b8199470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:47.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.991+0000 7fc0b659c640 1 --2- 172.21.15.79:0/718296517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0b81042c0 0x7fc0b8199470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:47.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.991+0000 7fc0b659c640 1 -- 172.21.15.79:0/718296517 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b819efe0 con 0x7fc0b81039a0 2024-08-20T01:40:47.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.991+0000 7fc0affff640 1 --2- 172.21.15.79:0/718296517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0b81042c0 0x7fc0b8199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:40:47.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.991+0000 7fc0b659c640 1 --2- 172.21.15.79:0/718296517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b81039a0 0x7fc0b8198f30 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fc0a800d950 tx=0x7fc0a800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:47.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.991+0000 7fc0af7fe640 1 -- 172.21.15.79:0/718296517 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a8018070 con 0x7fc0b81039a0 2024-08-20T01:40:47.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.991+0000 7fc0af7fe640 1 -- 172.21.15.79:0/718296517 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc0a8016070 con 0x7fc0b81039a0 2024-08-20T01:40:47.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.991+0000 7fc0bce0b640 1 -- 172.21.15.79:0/718296517 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0b819f2d0 con 0x7fc0b81039a0 2024-08-20T01:40:47.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.991+0000 7fc0af7fe640 1 -- 172.21.15.79:0/718296517 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a80047a0 con 0x7fc0b81039a0 2024-08-20T01:40:47.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.991+0000 7fc0bce0b640 1 -- 172.21.15.79:0/718296517 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0b8101700 con 0x7fc0b81039a0 2024-08-20T01:40:47.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.994+0000 7fc0af7fe640 1 -- 172.21.15.79:0/718296517 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc0a80099d0 con 0x7fc0b81039a0 2024-08-20T01:40:47.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.994+0000 7fc0bf204740 1 Processor -- start 2024-08-20T01:40:47.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.995+0000 7fc0bf204740 1 -- start start 2024-08-20T01:40:47.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.995+0000 7fc0bf204740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56274b756880 0x56274b756c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:47.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.995+0000 7fc0bf204740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56274b7571a0 0x56274b762bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:47.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.995+0000 7fc0bf204740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274b763130 0x56274b765520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:47.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.995+0000 7fc0bf204740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56274b6cd930 con 0x56274b763130 2024-08-20T01:40:47.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.995+0000 7fc0bf204740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56274b6bce30 con 0x56274b7571a0 2024-08-20T01:40:47.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.995+0000 7fc0bf204740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56274b6c0e70 con 0x56274b756880 2024-08-20T01:40:47.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.995+0000 7fc0affff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274b763130 0x56274b765520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:47.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.995+0000 7fc0affff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274b763130 0x56274b765520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42130/0 (socket says 172.21.15.79:42130) 2024-08-20T01:40:47.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.995+0000 7fc0affff640 1 -- 172.21.15.79:0/6339908 learned_addr learned my addr 172.21.15.79:0/6339908 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:47.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.995+0000 7fc0b6d9d640 1 --2- 172.21.15.79:0/6339908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56274b756880 0x56274b756c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:47.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.995+0000 7fc0af7fe640 1 --2- 172.21.15.79:0/718296517 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc0a40b3c50 0x7fc0a40b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:47.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.995+0000 7fc0b659c640 1 --2- 172.21.15.79:0/6339908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56274b7571a0 0x56274b762bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:47.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.996+0000 7fc0b6d9d640 1 -- 172.21.15.79:0/6339908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56274b7571a0 msgr2=0x56274b762bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:47.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.996+0000 7fc0b6d9d640 1 --2- 172.21.15.79:0/6339908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56274b7571a0 0x56274b762bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:47.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.996+0000 7fc0b6d9d640 1 -- 172.21.15.79:0/6339908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274b763130 msgr2=0x56274b765520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:47.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.996+0000 7fc0b6d9d640 1 --2- 172.21.15.79:0/6339908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274b763130 0x56274b765520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:47.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.996+0000 7fc0b6d9d640 1 -- 172.21.15.79:0/6339908 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56274b41c650 con 0x56274b756880 2024-08-20T01:40:47.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.996+0000 7fc0b6d9d640 1 --2- 172.21.15.79:0/718296517 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc0a40b3c50 0x7fc0a40b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:47.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.996+0000 7fc0af7fe640 1 -- 172.21.15.79:0/718296517 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc0a80e7750 con 0x7fc0b81039a0 2024-08-20T01:40:47.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.996+0000 7fc0b6d9d640 1 --2- 172.21.15.79:0/6339908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56274b756880 0x56274b756c60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc0b000a430 tx=0x7fc0b000a8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c5d390a4723efd1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:47.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.996+0000 7fc0acff9640 1 -- 172.21.15.79:0/6339908 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b00177a0 con 0x56274b756880 2024-08-20T01:40:47.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.996+0000 7fc0acff9640 1 -- 172.21.15.79:0/6339908 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc0b0017dd0 con 0x56274b756880 2024-08-20T01:40:47.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.996+0000 7fc0acff9640 1 -- 172.21.15.79:0/6339908 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0023d00 con 0x56274b756880 2024-08-20T01:40:47.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.996+0000 7fc0b6d9d640 1 --2- 172.21.15.79:0/718296517 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc0a40b3c50 0x7fc0a40b6110 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0020000 tx=0x7fc0b0021000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:47.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.997+0000 7fc0bf204740 1 -- 172.21.15.79:0/6339908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56274b756880 msgr2=0x56274b756c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:47.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.997+0000 7fc0bf204740 1 --2- 172.21.15.79:0/6339908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56274b756880 0x56274b756c60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc0b000a430 tx=0x7fc0b000a8f0 comp rx=0 tx=0).stop 2024-08-20T01:40:47.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.997+0000 7fc0bf204740 1 -- 172.21.15.79:0/6339908 shutdown_connections 2024-08-20T01:40:47.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.997+0000 7fc0bf204740 1 --2- 172.21.15.79:0/6339908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274b763130 0x56274b765520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:47.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.997+0000 7fc0bf204740 1 --2- 172.21.15.79:0/6339908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56274b7571a0 0x56274b762bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:47.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.997+0000 7fc0bf204740 1 --2- 172.21.15.79:0/6339908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56274b756880 0x56274b756c60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:47.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.997+0000 7fc0bf204740 1 -- 172.21.15.79:0/6339908 >> 172.21.15.79:0/6339908 conn(0x56274b7546b0 msgr2=0x56274b755850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:47.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.997+0000 7fc0bf204740 1 -- 172.21.15.79:0/6339908 shutdown_connections 2024-08-20T01:40:47.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.997+0000 7fc0bf204740 1 -- 172.21.15.79:0/6339908 wait complete. 2024-08-20T01:40:47.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.998+0000 7fc0bf204740 1 -- start start 2024-08-20T01:40:47.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.998+0000 7fc0bf204740 1 Processor -- start 2024-08-20T01:40:47.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.998+0000 7fc0bf204740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56274b756880 0x56274b7600f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:47.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.998+0000 7fc0bf204740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274b7571a0 0x56274b760630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:47.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.998+0000 7fc0bf204740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56274b763130 0x56274b760b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:47.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.998+0000 7fc0bf204740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56274b51f700 con 0x56274b7571a0 2024-08-20T01:40:47.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.998+0000 7fc0bf204740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56274b643810 con 0x56274b756880 2024-08-20T01:40:47.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.998+0000 7fc0bf204740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56274b765de0 con 0x56274b763130 2024-08-20T01:40:47.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.998+0000 7fc0bf204740 10 client.0 _ll_register_callbacks cb 0x56274b6b6700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:47.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.998+0000 7fc0affff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274b7571a0 0x56274b760630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:47.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.998+0000 7fc0affff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274b7571a0 0x56274b760630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42138/0 (socket says 172.21.15.79:42138) 2024-08-20T01:40:47.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.998+0000 7fc0affff640 1 -- 172.21.15.79:0/3450514716 learned_addr learned my addr 172.21.15.79:0/3450514716 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:47.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.998+0000 7fc0b6d9d640 1 --2- 172.21.15.79:0/3450514716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56274b763130 0x56274b760b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:47.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.998+0000 7fc0b659c640 1 --2- 172.21.15.79:0/3450514716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56274b756880 0x56274b7600f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:47.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.998+0000 7fc0affff640 1 -- 172.21.15.79:0/3450514716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56274b763130 msgr2=0x56274b760b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:47.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.998+0000 7fc0affff640 1 --2- 172.21.15.79:0/3450514716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56274b763130 0x56274b760b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:47.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.998+0000 7fc0affff640 1 -- 172.21.15.79:0/3450514716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56274b756880 msgr2=0x56274b7600f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:47.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.998+0000 7fc0affff640 1 --2- 172.21.15.79:0/3450514716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56274b756880 0x56274b7600f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:47.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.998+0000 7fc0affff640 1 -- 172.21.15.79:0/3450514716 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56274b76f1f0 con 0x56274b7571a0 2024-08-20T01:40:47.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.998+0000 7fc0b6d9d640 1 --2- 172.21.15.79:0/3450514716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56274b763130 0x56274b760b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:40:47.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.998+0000 7fc0b659c640 1 --2- 172.21.15.79:0/3450514716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56274b756880 0x56274b7600f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:40:47.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.999+0000 7fc0affff640 1 --2- 172.21.15.79:0/3450514716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274b7571a0 0x56274b760630 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fc0a00057c0 tx=0x7fc0a0031800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4147517fdd5316e9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:47.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.999+0000 7fc09dffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:40:47.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.999+0000 7fc09dffb640 1 -- 172.21.15.79:0/3450514716 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a0035040 con 0x56274b7571a0 2024-08-20T01:40:47.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.999+0000 7fc09dffb640 1 -- 172.21.15.79:0/3450514716 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc0a0004040 con 0x56274b7571a0 2024-08-20T01:40:47.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.999+0000 7fc0bf204740 1 -- 172.21.15.79:0/3450514716 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56274b66c150 con 0x56274b7571a0 2024-08-20T01:40:47.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.999+0000 7fc09dffb640 1 -- 172.21.15.79:0/3450514716 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fc0a0004240 con 0x56274b7571a0 2024-08-20T01:40:47.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.999+0000 7fc0bf204740 10 client.16671 fetch_fsmap learned FSMap version 35 2024-08-20T01:40:47.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.999+0000 7fc0bf204740 1 -- 172.21.15.79:0/3450514716 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56274b771ba0 con 0x56274b7571a0 2024-08-20T01:40:47.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.999+0000 7fc09dffb640 1 -- 172.21.15.79:0/3450514716 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56274b66c150 con 0x56274b7571a0 2024-08-20T01:40:47.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.999+0000 7fc09dffb640 1 -- 172.21.15.79:0/3450514716 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 35) ==== 8378+0+0 (secure 0 0 0) 0x7fc0a0004950 con 0x56274b7571a0 2024-08-20T01:40:47.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.999+0000 7fc0bf204740 10 client.16671 fetch_fsmap finished waiting for FSMap version 35 2024-08-20T01:40:47.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.999+0000 7fc0bf204740 10 client.16671 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:40:47.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.999+0000 7fc0bf204740 20 client.16671 populate_metadata read hostname 'smithi079' 2024-08-20T01:40:47.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.999+0000 7fc0bf204740 1 --2- 172.21.15.79:0/3450514716 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x56274b773060 0x56274b775500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:47.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.999+0000 7fc0bf204740 4 client.16671 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:40:47.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:46.999+0000 7fc0bf204740 1 -- 172.21.15.79:0/3450514716 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56274b6cf880 con 0x56274b773060 2024-08-20T01:40:47.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.000+0000 7fc0b659c640 1 --2- 172.21.15.79:0/3450514716 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x56274b773060 0x56274b775500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:47.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.000+0000 7fc0b659c640 1 --2- 172.21.15.79:0/3450514716 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x56274b773060 0x56274b775500 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2bb5433a63cf5d7 server_cookie=15b892e93a884bee in_seq=0 out_seq=0 2024-08-20T01:40:47.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.000+0000 7fc09dffb640 10 client.16671 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:40:47.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.001+0000 7fc09dffb640 1 -- 172.21.15.79:0/3450514716 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56274b6cf880 con 0x56274b773060 2024-08-20T01:40:47.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.001+0000 7fc09dffb640 10 client.16671 handle_command_reply: tid=0 2024-08-20T01:40:47.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.001+0000 7fc0bf204740 1 client.16671 shutdown 2024-08-20T01:40:47.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.001+0000 7fc0bf204740 1 -- 172.21.15.79:0/3450514716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274b7571a0 msgr2=0x56274b760630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:47.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.001+0000 7fc0bf204740 1 --2- 172.21.15.79:0/3450514716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274b7571a0 0x56274b760630 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fc0a00057c0 tx=0x7fc0a0031800 comp rx=0 tx=0).stop 2024-08-20T01:40:47.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.001+0000 7fc0bf204740 1 -- 172.21.15.79:0/3450514716 shutdown_connections 2024-08-20T01:40:47.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.001+0000 7fc0bf204740 1 --2- 172.21.15.79:0/3450514716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56274b763130 0x56274b760b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:47.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.001+0000 7fc0bf204740 1 --2- 172.21.15.79:0/3450514716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274b7571a0 0x56274b760630 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:47.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.001+0000 7fc0bf204740 1 --2- 172.21.15.79:0/3450514716 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x56274b773060 0x56274b775500 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:47.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.001+0000 7fc09dffb640 0 client.16671 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:40:47.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.001+0000 7fc0bf204740 1 --2- 172.21.15.79:0/3450514716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56274b756880 0x56274b7600f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:47.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.001+0000 7fc0bf204740 1 -- 172.21.15.79:0/3450514716 >> 172.21.15.79:0/3450514716 conn(0x56274b7546b0 msgr2=0x56274b75a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:47.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.001+0000 7fc0bf204740 1 -- 172.21.15.79:0/3450514716 shutdown_connections 2024-08-20T01:40:47.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.001+0000 7fc0bf204740 1 -- 172.21.15.79:0/3450514716 wait complete. 2024-08-20T01:40:47.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.001+0000 7fc0bf204740 20 client.16671 trim_cache size 0 max 16384 2024-08-20T01:40:47.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.021+0000 7fc0bf204740 1 Processor -- start 2024-08-20T01:40:47.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.021+0000 7fc0bf204740 1 -- start start 2024-08-20T01:40:47.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.021+0000 7fc0bf204740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56274b756880 0x56274b77add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:47.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.021+0000 7fc0bf204740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274b763130 0x56274b77b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:47.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.021+0000 7fc0bf204740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56274b755b60 0x56274b75d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:47.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.021+0000 7fc0bf204740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b81abdb0 con 0x56274b763130 2024-08-20T01:40:47.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.021+0000 7fc0bf204740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b81ad980 con 0x56274b756880 2024-08-20T01:40:47.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.021+0000 7fc0bf204740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b81ac480 con 0x56274b755b60 2024-08-20T01:40:47.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.021+0000 7fc0affff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274b763130 0x56274b77b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:47.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.022+0000 7fc0affff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274b763130 0x56274b77b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42152/0 (socket says 172.21.15.79:42152) 2024-08-20T01:40:47.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.022+0000 7fc0affff640 1 -- 172.21.15.79:0/3124733904 learned_addr learned my addr 172.21.15.79:0/3124733904 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:47.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.022+0000 7fc0b659c640 1 --2- 172.21.15.79:0/3124733904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56274b756880 0x56274b77add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:47.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.022+0000 7fc0b6d9d640 1 --2- 172.21.15.79:0/3124733904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56274b755b60 0x56274b75d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:47.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.022+0000 7fc0affff640 1 -- 172.21.15.79:0/3124733904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56274b755b60 msgr2=0x56274b75d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:47.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.022+0000 7fc0affff640 1 --2- 172.21.15.79:0/3124733904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56274b755b60 0x56274b75d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:47.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.022+0000 7fc0affff640 1 -- 172.21.15.79:0/3124733904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56274b756880 msgr2=0x56274b77add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:47.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.022+0000 7fc0affff640 1 --2- 172.21.15.79:0/3124733904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56274b756880 0x56274b77add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:47.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.022+0000 7fc0affff640 1 -- 172.21.15.79:0/3124733904 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56274b756fd0 con 0x56274b763130 2024-08-20T01:40:47.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.022+0000 7fc0affff640 1 --2- 172.21.15.79:0/3124733904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274b763130 0x56274b77b310 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fc0a002a930 tx=0x7fc0a00095d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c740cea9c285bc5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:47.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.022+0000 7fc09ffff640 1 -- 172.21.15.79:0/3124733904 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a0035040 con 0x56274b763130 2024-08-20T01:40:47.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.022+0000 7fc09ffff640 1 -- 172.21.15.79:0/3124733904 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc0a0040070 con 0x56274b763130 2024-08-20T01:40:47.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.022+0000 7fc09ffff640 1 -- 172.21.15.79:0/3124733904 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a0005500 con 0x56274b763130 2024-08-20T01:40:47.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.023+0000 7fc0bf204740 1 -- 172.21.15.79:0/3124733904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274b763130 msgr2=0x56274b77b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:47.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.023+0000 7fc0bf204740 1 --2- 172.21.15.79:0/3124733904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274b763130 0x56274b77b310 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fc0a002a930 tx=0x7fc0a00095d0 comp rx=0 tx=0).stop 2024-08-20T01:40:47.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.023+0000 7fc0bf204740 1 -- 172.21.15.79:0/3124733904 shutdown_connections 2024-08-20T01:40:47.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.023+0000 7fc0bf204740 1 --2- 172.21.15.79:0/3124733904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56274b755b60 0x56274b75d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:47.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.023+0000 7fc0bf204740 1 --2- 172.21.15.79:0/3124733904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274b763130 0x56274b77b310 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:47.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.023+0000 7fc0bf204740 1 --2- 172.21.15.79:0/3124733904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56274b756880 0x56274b77add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:47.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.023+0000 7fc0bf204740 1 -- 172.21.15.79:0/3124733904 >> 172.21.15.79:0/3124733904 conn(0x56274b7546b0 msgr2=0x56274b761f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:47.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.023+0000 7fc0bf204740 1 -- 172.21.15.79:0/3124733904 shutdown_connections 2024-08-20T01:40:47.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.023+0000 7fc0bf204740 1 -- 172.21.15.79:0/3124733904 wait complete. 2024-08-20T01:40:47.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.024+0000 7fc0bf204740 1 -- start start 2024-08-20T01:40:47.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.024+0000 7fc0bf204740 1 Processor -- start 2024-08-20T01:40:47.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.024+0000 7fc0bf204740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56274b755b60 0x56274b767140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:47.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.024+0000 7fc0bf204740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56274b756880 0x56274b767680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:47.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.024+0000 7fc0bf204740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274b763130 0x56274b767bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:47.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.024+0000 7fc0bf204740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b81ad250 con 0x56274b763130 2024-08-20T01:40:47.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.024+0000 7fc0bf204740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b81acb50 con 0x56274b755b60 2024-08-20T01:40:47.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.024+0000 7fc0bf204740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b81a9d90 con 0x56274b756880 2024-08-20T01:40:47.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.024+0000 7fc0bf204740 10 client.0 _ll_register_callbacks cb 0x7fc0a0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:47.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.024+0000 7fc0b6d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274b763130 0x56274b767bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:47.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.024+0000 7fc0b6d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274b763130 0x56274b767bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42164/0 (socket says 172.21.15.79:42164) 2024-08-20T01:40:47.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.024+0000 7fc0b6d9d640 1 -- 172.21.15.79:0/2086461175 learned_addr learned my addr 172.21.15.79:0/2086461175 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:47.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.024+0000 7fc0b659c640 1 --2- 172.21.15.79:0/2086461175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56274b755b60 0x56274b767140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:47.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.024+0000 7fc0affff640 1 --2- 172.21.15.79:0/2086461175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56274b756880 0x56274b767680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:47.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.024+0000 7fc0b6d9d640 1 -- 172.21.15.79:0/2086461175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56274b756880 msgr2=0x56274b767680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:47.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.024+0000 7fc0b6d9d640 1 --2- 172.21.15.79:0/2086461175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56274b756880 0x56274b767680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:47.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.024+0000 7fc0b6d9d640 1 -- 172.21.15.79:0/2086461175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56274b755b60 msgr2=0x56274b767140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:47.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.024+0000 7fc0b6d9d640 1 --2- 172.21.15.79:0/2086461175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56274b755b60 0x56274b767140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:47.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.024+0000 7fc0b6d9d640 1 -- 172.21.15.79:0/2086461175 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56274b7dd040 con 0x56274b763130 2024-08-20T01:40:47.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.025+0000 7fc0b6d9d640 1 --2- 172.21.15.79:0/2086461175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274b763130 0x56274b767bc0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0019fd0 tx=0x7fc0b0017d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f134cf83bf87f65 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:47.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.025+0000 7fc09dffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:40:47.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.025+0000 7fc09dffb640 1 -- 172.21.15.79:0/2086461175 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0032020 con 0x56274b763130 2024-08-20T01:40:47.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.025+0000 7fc09dffb640 1 -- 172.21.15.79:0/2086461175 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc0b0023640 con 0x56274b763130 2024-08-20T01:40:47.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.025+0000 7fc0bf204740 1 -- 172.21.15.79:0/2086461175 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0a0040070 con 0x56274b763130 2024-08-20T01:40:47.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.025+0000 7fc09dffb640 1 -- 172.21.15.79:0/2086461175 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fc0b0028040 con 0x56274b763130 2024-08-20T01:40:47.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.025+0000 7fc0bf204740 10 client.16677 fetch_fsmap learned FSMap version 35 2024-08-20T01:40:47.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.025+0000 7fc0bf204740 1 -- 172.21.15.79:0/2086461175 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56274b7de340 con 0x56274b763130 2024-08-20T01:40:47.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.025+0000 7fc09dffb640 1 -- 172.21.15.79:0/2086461175 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc0a0040070 con 0x56274b763130 2024-08-20T01:40:47.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.026+0000 7fc09dffb640 1 -- 172.21.15.79:0/2086461175 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 35) ==== 8378+0+0 (secure 0 0 0) 0x7fc0b002e470 con 0x56274b763130 2024-08-20T01:40:47.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.026+0000 7fc0bf204740 10 client.16677 fetch_fsmap finished waiting for FSMap version 35 2024-08-20T01:40:47.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.026+0000 7fc0bf204740 10 client.16677 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:40:47.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.026+0000 7fc0bf204740 20 client.16677 populate_metadata read hostname 'smithi079' 2024-08-20T01:40:47.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.026+0000 7fc0bf204740 1 --2- 172.21.15.79:0/2086461175 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x56274b7de9e0 0x56274b7e0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:47.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.026+0000 7fc0bf204740 4 client.16677 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:40:47.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.026+0000 7fc0bf204740 1 -- 172.21.15.79:0/2086461175 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56274b6cb320 con 0x56274b7de9e0 2024-08-20T01:40:47.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.026+0000 7fc0b659c640 1 --2- 172.21.15.79:0/2086461175 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x56274b7de9e0 0x56274b7e0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:47.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.026+0000 7fc0b659c640 1 --2- 172.21.15.79:0/2086461175 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x56274b7de9e0 0x56274b7e0e00 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8abd108b5a2084ae server_cookie=8b1c5ea83aa5aecc in_seq=0 out_seq=0 2024-08-20T01:40:47.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.026+0000 7fc09dffb640 10 client.16677 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:40:47.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.027+0000 7fc09dffb640 1 -- 172.21.15.79:0/2086461175 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56274b6cb320 con 0x56274b7de9e0 2024-08-20T01:40:47.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.027+0000 7fc09dffb640 10 client.16677 handle_command_reply: tid=0 2024-08-20T01:40:47.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.027+0000 7fc0bf204740 1 client.16677 shutdown 2024-08-20T01:40:47.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.027+0000 7fc0bf204740 1 -- 172.21.15.79:0/2086461175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274b763130 msgr2=0x56274b767bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:47.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.027+0000 7fc0bf204740 1 --2- 172.21.15.79:0/2086461175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274b763130 0x56274b767bc0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0019fd0 tx=0x7fc0b0017d50 comp rx=0 tx=0).stop 2024-08-20T01:40:47.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.027+0000 7fc0bf204740 1 -- 172.21.15.79:0/2086461175 shutdown_connections 2024-08-20T01:40:47.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.027+0000 7fc0bf204740 1 --2- 172.21.15.79:0/2086461175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274b763130 0x56274b767bc0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:47.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.027+0000 7fc0bf204740 1 --2- 172.21.15.79:0/2086461175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56274b756880 0x56274b767680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:47.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.027+0000 7fc0bf204740 1 --2- 172.21.15.79:0/2086461175 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x56274b7de9e0 0x56274b7e0e00 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:47.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.027+0000 7fc09dffb640 0 client.16677 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:40:47.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.027+0000 7fc0bf204740 1 --2- 172.21.15.79:0/2086461175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56274b755b60 0x56274b767140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:47.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.027+0000 7fc0bf204740 1 -- 172.21.15.79:0/2086461175 >> 172.21.15.79:0/2086461175 conn(0x56274b7546b0 msgr2=0x56274b760060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:47.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.027+0000 7fc0bf204740 1 -- 172.21.15.79:0/2086461175 shutdown_connections 2024-08-20T01:40:47.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.027+0000 7fc0bf204740 1 -- 172.21.15.79:0/2086461175 wait complete. 2024-08-20T01:40:47.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.027+0000 7fc0bf204740 20 client.16677 trim_cache size 0 max 16384 2024-08-20T01:40:47.036 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:40:47.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.028+0000 7fc0bce0b640 1 -- 172.21.15.79:0/718296517 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc0a40b3c50 msgr2=0x7fc0a40b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:47.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.028+0000 7fc0bce0b640 1 --2- 172.21.15.79:0/718296517 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc0a40b3c50 0x7fc0a40b6110 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0020000 tx=0x7fc0b0021000 comp rx=0 tx=0).stop 2024-08-20T01:40:47.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.028+0000 7fc0bce0b640 1 -- 172.21.15.79:0/718296517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b81039a0 msgr2=0x7fc0b8198f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:47.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.028+0000 7fc0bce0b640 1 --2- 172.21.15.79:0/718296517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b81039a0 0x7fc0b8198f30 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fc0a800d950 tx=0x7fc0a800de10 comp rx=0 tx=0).stop 2024-08-20T01:40:47.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.028+0000 7fc0bce0b640 1 -- 172.21.15.79:0/718296517 shutdown_connections 2024-08-20T01:40:47.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.028+0000 7fc0bce0b640 1 --2- 172.21.15.79:0/718296517 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc0a40b3c50 0x7fc0a40b6110 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:47.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.028+0000 7fc0bce0b640 1 --2- 172.21.15.79:0/718296517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0b810ce00 0x7fc0b819e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:47.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.028+0000 7fc0bce0b640 1 --2- 172.21.15.79:0/718296517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0b81042c0 0x7fc0b8199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:47.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.028+0000 7fc0bce0b640 1 --2- 172.21.15.79:0/718296517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b81039a0 0x7fc0b8198f30 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:47.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.028+0000 7fc0bce0b640 1 -- 172.21.15.79:0/718296517 >> 172.21.15.79:0/718296517 conn(0x7fc0b80fd400 msgr2=0x7fc0b80fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:47.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.028+0000 7fc0bce0b640 1 -- 172.21.15.79:0/718296517 shutdown_connections 2024-08-20T01:40:47.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:47.028+0000 7fc0bce0b640 1 -- 172.21.15.79:0/718296517 wait complete. 2024-08-20T01:40:47.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:47 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:40:47.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:47 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:40:47.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:47 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:40:47.963 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T01:40:48.245 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:40:48.366 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:48 smithi079 ceph-mon[18656]: pgmap v451: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 23 op/s 2024-08-20T01:40:48.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:48 smithi175 ceph-mon[22392]: pgmap v451: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 23 op/s 2024-08-20T01:40:48.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:48 smithi081 ceph-mon[22209]: pgmap v451: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 23 op/s 2024-08-20T01:40:49.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.748+0000 7fee25d30640 1 -- 172.21.15.79:0/4273229745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee2010cdc0 msgr2=0x7fee2010f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:49.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.748+0000 7fee25d30640 1 --2- 172.21.15.79:0/4273229745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee2010cdc0 0x7fee2010f260 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fee18009ca0 tx=0x7fee1802a8c0 comp rx=0 tx=0).stop 2024-08-20T01:40:49.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.748+0000 7fee25d30640 1 -- 172.21.15.79:0/4273229745 shutdown_connections 2024-08-20T01:40:49.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.748+0000 7fee25d30640 1 --2- 172.21.15.79:0/4273229745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee2010cdc0 0x7fee2010f260 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:49.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.748+0000 7fee25d30640 1 --2- 172.21.15.79:0/4273229745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee20101f00 0x7fee2010c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:49.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.748+0000 7fee25d30640 1 --2- 172.21.15.79:0/4273229745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee20101500 0x7fee201018e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:49.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.748+0000 7fee25d30640 1 -- 172.21.15.79:0/4273229745 >> 172.21.15.79:0/4273229745 conn(0x7fee20076bd0 msgr2=0x7fee20076fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:49.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.748+0000 7fee25d30640 1 -- 172.21.15.79:0/4273229745 shutdown_connections 2024-08-20T01:40:49.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.749+0000 7fee25d30640 1 -- 172.21.15.79:0/4273229745 wait complete. 2024-08-20T01:40:49.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.749+0000 7fee25d30640 1 Processor -- start 2024-08-20T01:40:49.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.749+0000 7fee25d30640 1 -- start start 2024-08-20T01:40:49.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.750+0000 7fee25d30640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee20101500 0x7fee2019b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:49.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.750+0000 7fee25d30640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee20101f00 0x7fee2019b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:49.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.750+0000 7fee25d30640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee2010cdc0 0x7fee201a0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:49.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.750+0000 7fee25d30640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fee201128d0 con 0x7fee2010cdc0 2024-08-20T01:40:49.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.750+0000 7fee25d30640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fee20112750 con 0x7fee20101500 2024-08-20T01:40:49.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.750+0000 7fee25d30640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fee20112a50 con 0x7fee20101f00 2024-08-20T01:40:49.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.750+0000 7fee1ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee2010cdc0 0x7fee201a0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:49.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.750+0000 7fee1ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee2010cdc0 0x7fee201a0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42184/0 (socket says 172.21.15.79:42184) 2024-08-20T01:40:49.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.750+0000 7fee1ffff640 1 -- 172.21.15.79:0/4187689425 learned_addr learned my addr 172.21.15.79:0/4187689425 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:49.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.750+0000 7fee1f7fe640 1 --2- 172.21.15.79:0/4187689425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee20101500 0x7fee2019b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:49.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.750+0000 7fee1effd640 1 --2- 172.21.15.79:0/4187689425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee20101f00 0x7fee2019b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:49.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.750+0000 7fee1ffff640 1 -- 172.21.15.79:0/4187689425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee20101f00 msgr2=0x7fee2019b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:49.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.750+0000 7fee1ffff640 1 --2- 172.21.15.79:0/4187689425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee20101f00 0x7fee2019b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:49.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.750+0000 7fee1ffff640 1 -- 172.21.15.79:0/4187689425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee20101500 msgr2=0x7fee2019b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:49.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.750+0000 7fee1ffff640 1 --2- 172.21.15.79:0/4187689425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee20101500 0x7fee2019b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:49.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.750+0000 7fee1ffff640 1 -- 172.21.15.79:0/4187689425 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee201a1150 con 0x7fee2010cdc0 2024-08-20T01:40:49.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.750+0000 7fee1f7fe640 1 --2- 172.21.15.79:0/4187689425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee20101500 0x7fee2019b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:40:49.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.750+0000 7fee1ffff640 1 --2- 172.21.15.79:0/4187689425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee2010cdc0 0x7fee201a0980 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fee18009dc0 tx=0x7fee18003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:49.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.751+0000 7fee1cff9640 1 -- 172.21.15.79:0/4187689425 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee18003d60 con 0x7fee2010cdc0 2024-08-20T01:40:49.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.751+0000 7fee1cff9640 1 -- 172.21.15.79:0/4187689425 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fee180044d0 con 0x7fee2010cdc0 2024-08-20T01:40:49.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.751+0000 7fee25d30640 1 -- 172.21.15.79:0/4187689425 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee201a13e0 con 0x7fee2010cdc0 2024-08-20T01:40:49.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.751+0000 7fee1cff9640 1 -- 172.21.15.79:0/4187689425 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee18030c10 con 0x7fee2010cdc0 2024-08-20T01:40:49.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.751+0000 7fee25d30640 1 -- 172.21.15.79:0/4187689425 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee201a7b00 con 0x7fee2010cdc0 2024-08-20T01:40:49.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.753+0000 7fee1cff9640 1 -- 172.21.15.79:0/4187689425 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fee18004680 con 0x7fee2010cdc0 2024-08-20T01:40:49.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.754+0000 7fee28129740 1 Processor -- start 2024-08-20T01:40:49.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.754+0000 7fee28129740 1 -- start start 2024-08-20T01:40:49.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.754+0000 7fee28129740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4f2721730 0x55c4f2721b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:49.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.754+0000 7fee28129740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c4f2722050 0x55c4f272daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:49.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.754+0000 7fee28129740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4f272dfe0 0x55c4f27303d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:49.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.754+0000 7fee28129740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c4f2698930 con 0x55c4f2721730 2024-08-20T01:40:49.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.754+0000 7fee28129740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c4f2687e30 con 0x55c4f2722050 2024-08-20T01:40:49.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.754+0000 7fee28129740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c4f268be70 con 0x55c4f272dfe0 2024-08-20T01:40:49.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.754+0000 7fee1effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4f2721730 0x55c4f2721b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:49.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.754+0000 7fee1effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4f2721730 0x55c4f2721b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42190/0 (socket says 172.21.15.79:42190) 2024-08-20T01:40:49.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.754+0000 7fee1effd640 1 -- 172.21.15.79:0/3964353908 learned_addr learned my addr 172.21.15.79:0/3964353908 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:49.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.754+0000 7fee1f7fe640 1 --2- 172.21.15.79:0/3964353908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c4f2722050 0x55c4f272daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:49.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.754+0000 7fee1effd640 1 --2- 172.21.15.79:0/3964353908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4f272dfe0 0x55c4f27303d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:49.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.754+0000 7fee1effd640 1 -- 172.21.15.79:0/3964353908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4f272dfe0 msgr2=0x55c4f27303d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:49.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.755+0000 7fee1effd640 1 --2- 172.21.15.79:0/3964353908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4f272dfe0 0x55c4f27303d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:49.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.755+0000 7fee1effd640 1 -- 172.21.15.79:0/3964353908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c4f2722050 msgr2=0x55c4f272daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:49.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.755+0000 7fee1effd640 1 --2- 172.21.15.79:0/3964353908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c4f2722050 0x55c4f272daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:49.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.755+0000 7fee1cff9640 1 --2- 172.21.15.79:0/4187689425 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fee080b3c50 0x7fee080b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:49.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.755+0000 7fee1effd640 1 -- 172.21.15.79:0/3964353908 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4f23e7650 con 0x55c4f2721730 2024-08-20T01:40:49.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.755+0000 7fee1effd640 1 --2- 172.21.15.79:0/4187689425 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fee080b3c50 0x7fee080b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:49.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.755+0000 7fee1cff9640 1 -- 172.21.15.79:0/4187689425 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fee18104f70 con 0x7fee2010cdc0 2024-08-20T01:40:49.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.755+0000 7fee1effd640 1 --2- 172.21.15.79:0/3964353908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4f2721730 0x55c4f2721b10 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fee140145a0 tx=0x7fee1400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea17166f7b5f1a0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:49.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.755+0000 7fee05ffb640 1 -- 172.21.15.79:0/3964353908 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1401a040 con 0x55c4f2721730 2024-08-20T01:40:49.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.755+0000 7fee05ffb640 1 -- 172.21.15.79:0/3964353908 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fee14011da0 con 0x55c4f2721730 2024-08-20T01:40:49.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.755+0000 7fee05ffb640 1 -- 172.21.15.79:0/3964353908 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee14022930 con 0x55c4f2721730 2024-08-20T01:40:49.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.756+0000 7fee1effd640 1 --2- 172.21.15.79:0/4187689425 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fee080b3c50 0x7fee080b6110 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fee14021000 tx=0x7fee1401e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:49.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.756+0000 7fee28129740 1 -- 172.21.15.79:0/3964353908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4f2721730 msgr2=0x55c4f2721b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:49.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.756+0000 7fee28129740 1 --2- 172.21.15.79:0/3964353908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4f2721730 0x55c4f2721b10 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fee140145a0 tx=0x7fee1400b900 comp rx=0 tx=0).stop 2024-08-20T01:40:49.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.756+0000 7fee28129740 1 -- 172.21.15.79:0/3964353908 shutdown_connections 2024-08-20T01:40:49.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.756+0000 7fee28129740 1 --2- 172.21.15.79:0/3964353908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4f272dfe0 0x55c4f27303d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:49.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.756+0000 7fee28129740 1 --2- 172.21.15.79:0/3964353908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c4f2722050 0x55c4f272daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:49.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.756+0000 7fee28129740 1 --2- 172.21.15.79:0/3964353908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4f2721730 0x55c4f2721b10 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:49.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.756+0000 7fee28129740 1 -- 172.21.15.79:0/3964353908 >> 172.21.15.79:0/3964353908 conn(0x55c4f271f560 msgr2=0x55c4f2720700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:49.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.756+0000 7fee28129740 1 -- 172.21.15.79:0/3964353908 shutdown_connections 2024-08-20T01:40:49.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.756+0000 7fee28129740 1 -- 172.21.15.79:0/3964353908 wait complete. 2024-08-20T01:40:49.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.757+0000 7fee28129740 1 -- start start 2024-08-20T01:40:49.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.757+0000 7fee28129740 1 Processor -- start 2024-08-20T01:40:49.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.757+0000 7fee28129740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4f2721730 0x55c4f272afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:49.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.757+0000 7fee28129740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4f2722050 0x55c4f272b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:49.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.757+0000 7fee28129740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c4f272dfe0 0x55c4f272ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:49.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.757+0000 7fee28129740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c4f24ea700 con 0x55c4f2721730 2024-08-20T01:40:49.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.757+0000 7fee28129740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c4f260e810 con 0x55c4f272dfe0 2024-08-20T01:40:49.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.757+0000 7fee28129740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c4f2730c30 con 0x55c4f2722050 2024-08-20T01:40:49.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.757+0000 7fee28129740 10 client.0 _ll_register_callbacks cb 0x55c4f2681700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:49.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.757+0000 7fee1f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4f2721730 0x55c4f272afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:49.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.757+0000 7fee1f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4f2721730 0x55c4f272afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42204/0 (socket says 172.21.15.79:42204) 2024-08-20T01:40:49.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.757+0000 7fee1f7fe640 1 -- 172.21.15.79:0/3346268958 learned_addr learned my addr 172.21.15.79:0/3346268958 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:49.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.757+0000 7fee1effd640 1 --2- 172.21.15.79:0/3346268958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4f2722050 0x55c4f272b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:49.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.757+0000 7fee1ffff640 1 --2- 172.21.15.79:0/3346268958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c4f272dfe0 0x55c4f272ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:49.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.758+0000 7fee1f7fe640 1 -- 172.21.15.79:0/3346268958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4f2722050 msgr2=0x55c4f272b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:49.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.758+0000 7fee1f7fe640 1 --2- 172.21.15.79:0/3346268958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4f2722050 0x55c4f272b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:49.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.758+0000 7fee1f7fe640 1 -- 172.21.15.79:0/3346268958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c4f272dfe0 msgr2=0x55c4f272ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:49.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.758+0000 7fee1f7fe640 1 --2- 172.21.15.79:0/3346268958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c4f272dfe0 0x55c4f272ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:49.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.758+0000 7fee1f7fe640 1 -- 172.21.15.79:0/3346268958 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4f273a060 con 0x55c4f2721730 2024-08-20T01:40:49.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.758+0000 7fee1effd640 1 --2- 172.21.15.79:0/3346268958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4f2722050 0x55c4f272b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:40:49.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.758+0000 7fee1ffff640 1 --2- 172.21.15.79:0/3346268958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c4f272dfe0 0x55c4f272ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:40:49.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.758+0000 7fee1f7fe640 1 --2- 172.21.15.79:0/3346268958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4f2721730 0x55c4f272afe0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fee10010f10 tx=0x7fee1000f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27551a6beb211cd server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:49.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.758+0000 7fedfeffd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:40:49.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.758+0000 7fedfeffd640 1 -- 172.21.15.79:0/3346268958 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee10005020 con 0x55c4f2721730 2024-08-20T01:40:49.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.758+0000 7fedfeffd640 1 -- 172.21.15.79:0/3346268958 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fee100051c0 con 0x55c4f2721730 2024-08-20T01:40:49.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.758+0000 7fee28129740 1 -- 172.21.15.79:0/3346268958 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c4f2637150 con 0x55c4f2721730 2024-08-20T01:40:49.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.758+0000 7fedfeffd640 1 -- 172.21.15.79:0/3346268958 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fee10005400 con 0x55c4f2721730 2024-08-20T01:40:49.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.758+0000 7fee28129740 10 client.16689 fetch_fsmap learned FSMap version 35 2024-08-20T01:40:49.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.758+0000 7fee28129740 1 -- 172.21.15.79:0/3346268958 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c4f273ca50 con 0x55c4f2721730 2024-08-20T01:40:49.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.758+0000 7fedfeffd640 1 -- 172.21.15.79:0/3346268958 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55c4f2637150 con 0x55c4f2721730 2024-08-20T01:40:49.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.759+0000 7fedfeffd640 1 -- 172.21.15.79:0/3346268958 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 35) ==== 8378+0+0 (secure 0 0 0) 0x7fee10019530 con 0x55c4f2721730 2024-08-20T01:40:49.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.759+0000 7fee28129740 10 client.16689 fetch_fsmap finished waiting for FSMap version 35 2024-08-20T01:40:49.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.759+0000 7fee28129740 10 client.16689 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:40:49.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.759+0000 7fee28129740 20 client.16689 populate_metadata read hostname 'smithi079' 2024-08-20T01:40:49.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.759+0000 7fee28129740 1 --2- 172.21.15.79:0/3346268958 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55c4f273dfd0 0x55c4f2740430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:49.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.759+0000 7fee28129740 4 client.16689 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:40:49.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.759+0000 7fee28129740 1 -- 172.21.15.79:0/3346268958 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c4f269a880 con 0x55c4f273dfd0 2024-08-20T01:40:49.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.759+0000 7fee1effd640 1 --2- 172.21.15.79:0/3346268958 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55c4f273dfd0 0x55c4f2740430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:49.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.759+0000 7fedfeffd640 10 client.16689 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:49.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.759+0000 7fee1effd640 1 --2- 172.21.15.79:0/3346268958 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55c4f273dfd0 0x55c4f2740430 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b7a410da0a26ce4 server_cookie=7a0a2d887c3fc862 in_seq=0 out_seq=0 2024-08-20T01:40:49.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.760+0000 7fedfeffd640 1 -- 172.21.15.79:0/3346268958 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c4f269a880 con 0x55c4f273dfd0 2024-08-20T01:40:49.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.760+0000 7fedfeffd640 10 client.16689 handle_command_reply: tid=0 2024-08-20T01:40:49.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.760+0000 7fee28129740 1 client.16689 shutdown 2024-08-20T01:40:49.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.760+0000 7fee28129740 1 -- 172.21.15.79:0/3346268958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4f2721730 msgr2=0x55c4f272afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:49.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.760+0000 7fee28129740 1 --2- 172.21.15.79:0/3346268958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4f2721730 0x55c4f272afe0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fee10010f10 tx=0x7fee1000f7f0 comp rx=0 tx=0).stop 2024-08-20T01:40:49.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.760+0000 7fee28129740 1 -- 172.21.15.79:0/3346268958 shutdown_connections 2024-08-20T01:40:49.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.760+0000 7fee28129740 1 --2- 172.21.15.79:0/3346268958 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55c4f273dfd0 0x55c4f2740430 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:49.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.760+0000 7fee28129740 1 --2- 172.21.15.79:0/3346268958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c4f272dfe0 0x55c4f272ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:49.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.760+0000 7fee28129740 1 --2- 172.21.15.79:0/3346268958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4f2722050 0x55c4f272b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:49.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.760+0000 7fee28129740 1 --2- 172.21.15.79:0/3346268958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4f2721730 0x55c4f272afe0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:49.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.760+0000 7fee28129740 1 -- 172.21.15.79:0/3346268958 >> 172.21.15.79:0/3346268958 conn(0x55c4f271f560 msgr2=0x55c4f2725100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:49.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.760+0000 7fedfeffd640 0 client.16689 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:49.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.761+0000 7fee28129740 1 -- 172.21.15.79:0/3346268958 shutdown_connections 2024-08-20T01:40:49.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.761+0000 7fee28129740 1 -- 172.21.15.79:0/3346268958 wait complete. 2024-08-20T01:40:49.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.761+0000 7fee28129740 20 client.16689 trim_cache size 0 max 16384 2024-08-20T01:40:49.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.777+0000 7fee28129740 1 Processor -- start 2024-08-20T01:40:49.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.777+0000 7fee28129740 1 -- start start 2024-08-20T01:40:49.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.778+0000 7fee28129740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4f2721730 0x55c4f2745d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:49.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.778+0000 7fee28129740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c4f2722050 0x55c4f2746280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:49.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.778+0000 7fee28129740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4f272dfe0 0x55c4f2735eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:49.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.778+0000 7fee28129740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fee201b0180 con 0x55c4f2721730 2024-08-20T01:40:49.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.778+0000 7fee28129740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fee201b1d50 con 0x55c4f2722050 2024-08-20T01:40:49.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.778+0000 7fee28129740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fee201b0850 con 0x55c4f272dfe0 2024-08-20T01:40:49.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.778+0000 7fee1f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4f2721730 0x55c4f2745d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:49.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.778+0000 7fee1f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4f2721730 0x55c4f2745d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42220/0 (socket says 172.21.15.79:42220) 2024-08-20T01:40:49.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.778+0000 7fee1f7fe640 1 -- 172.21.15.79:0/137623081 learned_addr learned my addr 172.21.15.79:0/137623081 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:49.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.778+0000 7fee1f7fe640 1 -- 172.21.15.79:0/137623081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4f272dfe0 msgr2=0x55c4f2735eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:49.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.778+0000 7fee1f7fe640 1 --2- 172.21.15.79:0/137623081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4f272dfe0 0x55c4f2735eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:49.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.778+0000 7fee1f7fe640 1 -- 172.21.15.79:0/137623081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c4f2722050 msgr2=0x55c4f2746280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:49.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.778+0000 7fee1f7fe640 1 --2- 172.21.15.79:0/137623081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c4f2722050 0x55c4f2746280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:49.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.778+0000 7fee1f7fe640 1 -- 172.21.15.79:0/137623081 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4f27294e0 con 0x55c4f2721730 2024-08-20T01:40:49.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.778+0000 7fee1f7fe640 1 --2- 172.21.15.79:0/137623081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4f2721730 0x55c4f2745d40 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fee100058c0 tx=0x7fee1000afb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81a3cc03cac11408 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:49.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.778+0000 7fee057fa640 1 -- 172.21.15.79:0/137623081 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee10028040 con 0x55c4f2721730 2024-08-20T01:40:49.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.778+0000 7fee057fa640 1 -- 172.21.15.79:0/137623081 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fee10019bb0 con 0x55c4f2721730 2024-08-20T01:40:49.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.778+0000 7fee057fa640 1 -- 172.21.15.79:0/137623081 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee10024800 con 0x55c4f2721730 2024-08-20T01:40:49.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.779+0000 7fee28129740 1 -- 172.21.15.79:0/137623081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4f2721730 msgr2=0x55c4f2745d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:49.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.779+0000 7fee28129740 1 --2- 172.21.15.79:0/137623081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4f2721730 0x55c4f2745d40 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fee100058c0 tx=0x7fee1000afb0 comp rx=0 tx=0).stop 2024-08-20T01:40:49.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.779+0000 7fee28129740 1 -- 172.21.15.79:0/137623081 shutdown_connections 2024-08-20T01:40:49.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.779+0000 7fee28129740 1 --2- 172.21.15.79:0/137623081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4f272dfe0 0x55c4f2735eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:49.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.779+0000 7fee28129740 1 --2- 172.21.15.79:0/137623081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c4f2722050 0x55c4f2746280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:49.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.779+0000 7fee28129740 1 --2- 172.21.15.79:0/137623081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4f2721730 0x55c4f2745d40 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:49.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.779+0000 7fee28129740 1 -- 172.21.15.79:0/137623081 >> 172.21.15.79:0/137623081 conn(0x55c4f271f560 msgr2=0x55c4f272ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:49.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.779+0000 7fee28129740 1 -- 172.21.15.79:0/137623081 shutdown_connections 2024-08-20T01:40:49.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.779+0000 7fee28129740 1 -- 172.21.15.79:0/137623081 wait complete. 2024-08-20T01:40:49.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.779+0000 7fee28129740 1 -- start start 2024-08-20T01:40:49.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.780+0000 7fee28129740 1 Processor -- start 2024-08-20T01:40:49.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.780+0000 7fee28129740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4f2721730 0x55c4f2733920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:49.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.780+0000 7fee28129740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c4f2722050 0x55c4f2733ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:49.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.780+0000 7fee28129740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4f272dfe0 0x55c4f279fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:49.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.780+0000 7fee28129740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fee201b1620 con 0x55c4f272dfe0 2024-08-20T01:40:49.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.780+0000 7fee28129740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fee201b0f20 con 0x55c4f2722050 2024-08-20T01:40:49.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.780+0000 7fee28129740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fee201ae160 con 0x55c4f2721730 2024-08-20T01:40:49.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.780+0000 7fee28129740 10 client.0 _ll_register_callbacks cb 0x7fee1000ab90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:49.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.780+0000 7fee1ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4f272dfe0 0x55c4f279fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:49.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.780+0000 7fee1ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4f272dfe0 0x55c4f279fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42232/0 (socket says 172.21.15.79:42232) 2024-08-20T01:40:49.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.780+0000 7fee1ffff640 1 -- 172.21.15.79:0/4186020108 learned_addr learned my addr 172.21.15.79:0/4186020108 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:49.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.780+0000 7fee1effd640 1 --2- 172.21.15.79:0/4186020108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c4f2722050 0x55c4f2733ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:49.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.780+0000 7fee1f7fe640 1 --2- 172.21.15.79:0/4186020108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4f2721730 0x55c4f2733920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:49.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.780+0000 7fee1ffff640 1 -- 172.21.15.79:0/4186020108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4f2721730 msgr2=0x55c4f2733920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:49.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.780+0000 7fee1ffff640 1 --2- 172.21.15.79:0/4186020108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4f2721730 0x55c4f2733920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:49.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.780+0000 7fee1ffff640 1 -- 172.21.15.79:0/4186020108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c4f2722050 msgr2=0x55c4f2733ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:49.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.780+0000 7fee1ffff640 1 --2- 172.21.15.79:0/4186020108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c4f2722050 0x55c4f2733ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:49.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.780+0000 7fee1ffff640 1 -- 172.21.15.79:0/4186020108 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4f27a0470 con 0x55c4f272dfe0 2024-08-20T01:40:49.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.780+0000 7fee1f7fe640 1 --2- 172.21.15.79:0/4186020108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4f2721730 0x55c4f2733920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:40:49.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.781+0000 7fee1ffff640 1 --2- 172.21.15.79:0/4186020108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4f272dfe0 0x55c4f279fd60 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fee18102a80 tx=0x7fee180305c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=400d1ec0ba88ad71 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:49.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.781+0000 7fedfeffd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:40:49.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.781+0000 7fedfeffd640 1 -- 172.21.15.79:0/4186020108 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee180e6060 con 0x55c4f272dfe0 2024-08-20T01:40:49.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.781+0000 7fedfeffd640 1 -- 172.21.15.79:0/4186020108 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fee180c8160 con 0x55c4f272dfe0 2024-08-20T01:40:49.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.781+0000 7fee28129740 1 -- 172.21.15.79:0/4186020108 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee10019bb0 con 0x55c4f272dfe0 2024-08-20T01:40:49.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.781+0000 7fedfeffd640 1 -- 172.21.15.79:0/4186020108 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fee180ed050 con 0x55c4f272dfe0 2024-08-20T01:40:49.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.781+0000 7fee28129740 10 client.16695 fetch_fsmap learned FSMap version 35 2024-08-20T01:40:49.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.781+0000 7fee28129740 1 -- 172.21.15.79:0/4186020108 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c4f27a8a90 con 0x55c4f272dfe0 2024-08-20T01:40:49.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.781+0000 7fedfeffd640 1 -- 172.21.15.79:0/4186020108 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fee10019bb0 con 0x55c4f272dfe0 2024-08-20T01:40:49.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.781+0000 7fedfeffd640 1 -- 172.21.15.79:0/4186020108 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 35) ==== 8378+0+0 (secure 0 0 0) 0x7fee180cc130 con 0x55c4f272dfe0 2024-08-20T01:40:49.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.781+0000 7fee28129740 10 client.16695 fetch_fsmap finished waiting for FSMap version 35 2024-08-20T01:40:49.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.781+0000 7fee28129740 10 client.16695 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:40:49.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.781+0000 7fee28129740 20 client.16695 populate_metadata read hostname 'smithi079' 2024-08-20T01:40:49.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.781+0000 7fee28129740 1 --2- 172.21.15.79:0/4186020108 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55c4f27a9160 0x55c4f27ab580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:49.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.781+0000 7fee28129740 4 client.16695 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:40:49.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.781+0000 7fee28129740 1 -- 172.21.15.79:0/4186020108 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c4f2696320 con 0x55c4f27a9160 2024-08-20T01:40:49.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.781+0000 7fee1f7fe640 1 --2- 172.21.15.79:0/4186020108 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55c4f27a9160 0x55c4f27ab580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:49.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.782+0000 7fee1f7fe640 1 --2- 172.21.15.79:0/4186020108 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55c4f27a9160 0x55c4f27ab580 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a6efb816ec854b3 server_cookie=13cdc05502e56d89 in_seq=0 out_seq=0 2024-08-20T01:40:49.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.782+0000 7fedfeffd640 10 client.16695 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:49.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.782+0000 7fedfeffd640 1 -- 172.21.15.79:0/4186020108 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c4f2696320 con 0x55c4f27a9160 2024-08-20T01:40:49.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.782+0000 7fedfeffd640 10 client.16695 handle_command_reply: tid=0 2024-08-20T01:40:49.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.782+0000 7fee28129740 1 client.16695 shutdown 2024-08-20T01:40:49.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.782+0000 7fee28129740 1 -- 172.21.15.79:0/4186020108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4f272dfe0 msgr2=0x55c4f279fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:49.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.782+0000 7fee28129740 1 --2- 172.21.15.79:0/4186020108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4f272dfe0 0x55c4f279fd60 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fee18102a80 tx=0x7fee180305c0 comp rx=0 tx=0).stop 2024-08-20T01:40:49.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.782+0000 7fee28129740 1 -- 172.21.15.79:0/4186020108 shutdown_connections 2024-08-20T01:40:49.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.782+0000 7fee28129740 1 --2- 172.21.15.79:0/4186020108 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55c4f27a9160 0x55c4f27ab580 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:49.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.782+0000 7fee28129740 1 --2- 172.21.15.79:0/4186020108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c4f272dfe0 0x55c4f279fd60 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:49.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.782+0000 7fedfeffd640 0 client.16695 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:49.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.782+0000 7fee28129740 1 --2- 172.21.15.79:0/4186020108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c4f2722050 0x55c4f2733ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:49.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.782+0000 7fee28129740 1 --2- 172.21.15.79:0/4186020108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4f2721730 0x55c4f2733920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:49.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.782+0000 7fee28129740 1 -- 172.21.15.79:0/4186020108 >> 172.21.15.79:0/4186020108 conn(0x55c4f271f560 msgr2=0x55c4f272c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:49.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.782+0000 7fee28129740 1 -- 172.21.15.79:0/4186020108 shutdown_connections 2024-08-20T01:40:49.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.782+0000 7fee28129740 1 -- 172.21.15.79:0/4186020108 wait complete. 2024-08-20T01:40:49.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.782+0000 7fee28129740 20 client.16695 trim_cache size 0 max 16384 2024-08-20T01:40:49.515 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:40:49.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.783+0000 7fee25d30640 1 -- 172.21.15.79:0/4187689425 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fee080b3c50 msgr2=0x7fee080b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:49.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.783+0000 7fee25d30640 1 --2- 172.21.15.79:0/4187689425 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fee080b3c50 0x7fee080b6110 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fee14021000 tx=0x7fee1401e000 comp rx=0 tx=0).stop 2024-08-20T01:40:49.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.783+0000 7fee25d30640 1 -- 172.21.15.79:0/4187689425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee2010cdc0 msgr2=0x7fee201a0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:49.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.783+0000 7fee25d30640 1 --2- 172.21.15.79:0/4187689425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee2010cdc0 0x7fee201a0980 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fee18009dc0 tx=0x7fee18003970 comp rx=0 tx=0).stop 2024-08-20T01:40:49.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.783+0000 7fee25d30640 1 -- 172.21.15.79:0/4187689425 shutdown_connections 2024-08-20T01:40:49.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.783+0000 7fee25d30640 1 --2- 172.21.15.79:0/4187689425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee2010cdc0 0x7fee201a0980 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:49.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.783+0000 7fee25d30640 1 --2- 172.21.15.79:0/4187689425 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fee080b3c50 0x7fee080b6110 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:49.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.783+0000 7fee25d30640 1 --2- 172.21.15.79:0/4187689425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee20101f00 0x7fee2019b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:49.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.783+0000 7fee25d30640 1 --2- 172.21.15.79:0/4187689425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee20101500 0x7fee2019b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:49.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.783+0000 7fee25d30640 1 -- 172.21.15.79:0/4187689425 >> 172.21.15.79:0/4187689425 conn(0x7fee20076bd0 msgr2=0x7fee20100320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:49.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.783+0000 7fee25d30640 1 -- 172.21.15.79:0/4187689425 shutdown_connections 2024-08-20T01:40:49.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:48.783+0000 7fee25d30640 1 -- 172.21.15.79:0/4187689425 wait complete. 2024-08-20T01:40:50.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:50 smithi175 ceph-mon[22392]: pgmap v452: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 31 MiB/s wr, 26 op/s 2024-08-20T01:40:50.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:50 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:40:50.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:50 smithi079 ceph-mon[18656]: pgmap v452: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 31 MiB/s wr, 26 op/s 2024-08-20T01:40:50.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:50 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:40:50.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:50 smithi081 ceph-mon[22209]: pgmap v452: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 31 MiB/s wr, 26 op/s 2024-08-20T01:40:50.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:50 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:40:52.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:52 smithi175 ceph-mon[22392]: pgmap v453: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 31 MiB/s wr, 23 op/s 2024-08-20T01:40:52.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:52 smithi079 ceph-mon[18656]: pgmap v453: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 31 MiB/s wr, 23 op/s 2024-08-20T01:40:52.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:52 smithi081 ceph-mon[22209]: pgmap v453: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 31 MiB/s wr, 23 op/s 2024-08-20T01:40:54.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:54 smithi175 ceph-mon[22392]: pgmap v454: 97 pgs: 97 active+clean; 4.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 22 op/s 2024-08-20T01:40:54.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:54 smithi079 ceph-mon[18656]: pgmap v454: 97 pgs: 97 active+clean; 4.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 22 op/s 2024-08-20T01:40:54.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:54 smithi081 ceph-mon[22209]: pgmap v454: 97 pgs: 97 active+clean; 4.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 22 op/s 2024-08-20T01:40:55.484 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.480+0000 7f7fa0a85640 1 -- 172.21.15.79:0/2373846290 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f9c1026b0 msgr2=0x7f7f9c102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:55.484 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.480+0000 7f7fa0a85640 1 --2- 172.21.15.79:0/2373846290 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f9c1026b0 0x7f7f9c102b30 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f7f84009930 tx=0x7f7f8402a420 comp rx=0 tx=0).stop 2024-08-20T01:40:55.484 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.480+0000 7f7fa0a85640 1 -- 172.21.15.79:0/2373846290 shutdown_connections 2024-08-20T01:40:55.484 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.480+0000 7f7fa0a85640 1 --2- 172.21.15.79:0/2373846290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f9c103070 0x7f7f9c1099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:55.484 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.480+0000 7f7fa0a85640 1 --2- 172.21.15.79:0/2373846290 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f9c1026b0 0x7f7f9c102b30 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:55.484 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.480+0000 7f7fa0a85640 1 --2- 172.21.15.79:0/2373846290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f9c101560 0x7f7f9c101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:55.484 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.480+0000 7f7fa0a85640 1 -- 172.21.15.79:0/2373846290 >> 172.21.15.79:0/2373846290 conn(0x7f7f9c0fce40 msgr2=0x7f7f9c0ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:55.484 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.480+0000 7f7fa0a85640 1 -- 172.21.15.79:0/2373846290 shutdown_connections 2024-08-20T01:40:55.484 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.481+0000 7f7fa0a85640 1 -- 172.21.15.79:0/2373846290 wait complete. 2024-08-20T01:40:55.485 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.481+0000 7f7fa0a85640 1 Processor -- start 2024-08-20T01:40:55.485 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.481+0000 7f7fa0a85640 1 -- start start 2024-08-20T01:40:55.485 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.481+0000 7f7fa0a85640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f9c101560 0x7f7f9c198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:55.485 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.481+0000 7f7fa0a85640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f9c1026b0 0x7f7f9c198f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:55.485 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.481+0000 7f7fa0a85640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f9c103070 0x7f7f9c199ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:55.485 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.481+0000 7f7fa0a85640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9c10d060 con 0x7f7f9c101560 2024-08-20T01:40:55.485 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.481+0000 7f7fa0a85640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9c10cee0 con 0x7f7f9c103070 2024-08-20T01:40:55.485 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.481+0000 7f7fa0a85640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9c10d1e0 con 0x7f7f9c1026b0 2024-08-20T01:40:55.485 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.482+0000 7f7f9a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f9c101560 0x7f7f9c198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:55.485 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.482+0000 7f7f9a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f9c101560 0x7f7f9c198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52002/0 (socket says 172.21.15.79:52002) 2024-08-20T01:40:55.485 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.482+0000 7f7f9a59c640 1 -- 172.21.15.79:0/4077840874 learned_addr learned my addr 172.21.15.79:0/4077840874 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:55.485 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.482+0000 7f7f9ad9d640 1 --2- 172.21.15.79:0/4077840874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f9c103070 0x7f7f9c199ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.482+0000 7f7f99d9b640 1 --2- 172.21.15.79:0/4077840874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f9c1026b0 0x7f7f9c198f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.482+0000 7f7f9a59c640 1 -- 172.21.15.79:0/4077840874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f9c1026b0 msgr2=0x7f7f9c198f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.482+0000 7f7f9a59c640 1 --2- 172.21.15.79:0/4077840874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f9c1026b0 0x7f7f9c198f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.482+0000 7f7f9a59c640 1 -- 172.21.15.79:0/4077840874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f9c103070 msgr2=0x7f7f9c199ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.482+0000 7f7f9a59c640 1 --2- 172.21.15.79:0/4077840874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f9c103070 0x7f7f9c199ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.482+0000 7f7f9a59c640 1 -- 172.21.15.79:0/4077840874 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f9c19a460 con 0x7f7f9c101560 2024-08-20T01:40:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.482+0000 7f7f9a59c640 1 --2- 172.21.15.79:0/4077840874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f9c101560 0x7f7f9c198920 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c00cce0 tx=0x7f7f8c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.482+0000 7f7f937fe640 1 -- 172.21.15.79:0/4077840874 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c00f650 con 0x7f7f9c101560 2024-08-20T01:40:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.482+0000 7f7f937fe640 1 -- 172.21.15.79:0/4077840874 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7f8c00fc80 con 0x7f7f9c101560 2024-08-20T01:40:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.482+0000 7f7fa0a85640 1 -- 172.21.15.79:0/4077840874 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f9c19a750 con 0x7f7f9c101560 2024-08-20T01:40:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.482+0000 7f7f937fe640 1 -- 172.21.15.79:0/4077840874 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c018ae0 con 0x7f7f9c101560 2024-08-20T01:40:55.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.482+0000 7f7fa0a85640 1 -- 172.21.15.79:0/4077840874 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f9c1a0e20 con 0x7f7f9c101560 2024-08-20T01:40:55.493 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.485+0000 7f7f937fe640 1 -- 172.21.15.79:0/4077840874 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f7f8c018c80 con 0x7f7f9c101560 2024-08-20T01:40:55.493 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.485+0000 7f7fa3872740 1 Processor -- start 2024-08-20T01:40:55.493 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.485+0000 7f7fa3872740 1 -- start start 2024-08-20T01:40:55.493 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.485+0000 7f7fa3872740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbc2df4ce0 0x55dbc2df70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:55.494 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.485+0000 7f7fa3872740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbc2df7610 0x55dbc2df9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:55.494 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.485+0000 7f7fa3872740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc2dfa050 0x55dbc2dfc510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:55.494 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.485+0000 7f7fa3872740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55dbc2d63360 con 0x55dbc2df4ce0 2024-08-20T01:40:55.494 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.485+0000 7f7fa3872740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55dbc2d52860 con 0x55dbc2dfa050 2024-08-20T01:40:55.494 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.485+0000 7f7fa3872740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55dbc2d568a0 con 0x55dbc2df7610 2024-08-20T01:40:55.494 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.485+0000 7f7f9ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbc2df4ce0 0x55dbc2df70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:55.494 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.485+0000 7f7f9ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbc2df4ce0 0x55dbc2df70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52010/0 (socket says 172.21.15.79:52010) 2024-08-20T01:40:55.494 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.485+0000 7f7f9ad9d640 1 -- 172.21.15.79:0/2117822147 learned_addr learned my addr 172.21.15.79:0/2117822147 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:55.494 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.485+0000 7f7f9a59c640 1 --2- 172.21.15.79:0/2117822147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbc2df7610 0x55dbc2df9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:55.494 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.485+0000 7f7f99d9b640 1 --2- 172.21.15.79:0/2117822147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc2dfa050 0x55dbc2dfc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:55.494 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.485+0000 7f7f9ad9d640 1 -- 172.21.15.79:0/2117822147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbc2df7610 msgr2=0x55dbc2df9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:55.494 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.485+0000 7f7f9ad9d640 1 --2- 172.21.15.79:0/2117822147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbc2df7610 0x55dbc2df9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:55.495 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.485+0000 7f7f9ad9d640 1 -- 172.21.15.79:0/2117822147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc2dfa050 msgr2=0x55dbc2dfc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:55.495 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.486+0000 7f7f9ad9d640 1 --2- 172.21.15.79:0/2117822147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc2dfa050 0x55dbc2dfc510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:55.495 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.486+0000 7f7f9ad9d640 1 -- 172.21.15.79:0/2117822147 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbc2cf9e40 con 0x55dbc2df4ce0 2024-08-20T01:40:55.495 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.486+0000 7f7f99d9b640 1 --2- 172.21.15.79:0/2117822147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc2dfa050 0x55dbc2dfc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:40:55.495 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.486+0000 7f7f937fe640 1 --2- 172.21.15.79:0/4077840874 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f7f880b3c50 0x7f7f880b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:55.495 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.486+0000 7f7f9ad9d640 1 --2- 172.21.15.79:0/2117822147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbc2df4ce0 0x55dbc2df70d0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f7f9400b6b0 tx=0x7f7f9400bb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3139712a9f842b93 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:55.495 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.486+0000 7f7f9a59c640 1 --2- 172.21.15.79:0/4077840874 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f7f880b3c50 0x7f7f880b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:55.495 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.486+0000 7f7f90ff9640 1 -- 172.21.15.79:0/2117822147 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f94003bd0 con 0x55dbc2df4ce0 2024-08-20T01:40:55.495 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.486+0000 7f7f937fe640 1 -- 172.21.15.79:0/4077840874 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f7f8c0e3fb0 con 0x7f7f9c101560 2024-08-20T01:40:55.495 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.486+0000 7f7f90ff9640 1 -- 172.21.15.79:0/2117822147 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7f94015070 con 0x55dbc2df4ce0 2024-08-20T01:40:55.495 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.486+0000 7f7f90ff9640 1 -- 172.21.15.79:0/2117822147 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f940106a0 con 0x55dbc2df4ce0 2024-08-20T01:40:55.495 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.487+0000 7f7fa3872740 1 -- 172.21.15.79:0/2117822147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbc2df4ce0 msgr2=0x55dbc2df70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:55.496 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.487+0000 7f7f9a59c640 1 --2- 172.21.15.79:0/4077840874 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f7f880b3c50 0x7f7f880b6110 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c00ccb0 tx=0x7f7f8c000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:55.496 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.487+0000 7f7fa3872740 1 --2- 172.21.15.79:0/2117822147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbc2df4ce0 0x55dbc2df70d0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f7f9400b6b0 tx=0x7f7f9400bb70 comp rx=0 tx=0).stop 2024-08-20T01:40:55.496 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.487+0000 7f7fa3872740 1 -- 172.21.15.79:0/2117822147 shutdown_connections 2024-08-20T01:40:55.496 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.487+0000 7f7fa3872740 1 --2- 172.21.15.79:0/2117822147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc2dfa050 0x55dbc2dfc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:55.496 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.487+0000 7f7fa3872740 1 --2- 172.21.15.79:0/2117822147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbc2df7610 0x55dbc2df9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:55.496 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.487+0000 7f7fa3872740 1 --2- 172.21.15.79:0/2117822147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbc2df4ce0 0x55dbc2df70d0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:55.496 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.487+0000 7f7fa3872740 1 -- 172.21.15.79:0/2117822147 >> 172.21.15.79:0/2117822147 conn(0x55dbc2deba20 msgr2=0x55dbc2dec7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:55.496 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.487+0000 7f7fa3872740 1 -- 172.21.15.79:0/2117822147 shutdown_connections 2024-08-20T01:40:55.496 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.487+0000 7f7fa3872740 1 -- 172.21.15.79:0/2117822147 wait complete. 2024-08-20T01:40:55.496 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.487+0000 7f7fa3872740 1 -- start start 2024-08-20T01:40:55.496 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.487+0000 7f7fa3872740 1 Processor -- start 2024-08-20T01:40:55.496 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.487+0000 7f7fa3872740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbc2df4ce0 0x55dbc2dfe5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:55.496 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.487+0000 7f7fa3872740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbc2df7610 0x55dbc2dfec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:55.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.487+0000 7f7fa3872740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc2dfa050 0x55dbc2dff7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:55.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.487+0000 7f7fa3872740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55dbc2c8bab0 con 0x55dbc2df7610 2024-08-20T01:40:55.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.487+0000 7f7fa3872740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55dbc2cd9780 con 0x55dbc2dfa050 2024-08-20T01:40:55.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.487+0000 7f7fa3872740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55dbc2dfd030 con 0x55dbc2df4ce0 2024-08-20T01:40:55.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.487+0000 7f7fa3872740 10 client.0 _ll_register_callbacks cb 0x55dbc2a61a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:55.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.487+0000 7f7f99d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbc2df7610 0x55dbc2dfec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:55.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.487+0000 7f7f99d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbc2df7610 0x55dbc2dfec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52020/0 (socket says 172.21.15.79:52020) 2024-08-20T01:40:55.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.487+0000 7f7f99d9b640 1 -- 172.21.15.79:0/2423988539 learned_addr learned my addr 172.21.15.79:0/2423988539 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:55.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.488+0000 7f7f9ad9d640 1 --2- 172.21.15.79:0/2423988539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbc2df4ce0 0x55dbc2dfe5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:55.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.488+0000 7f7f9ad9d640 1 --2- 172.21.15.79:0/2423988539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc2dfa050 0x55dbc2dff7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:55.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.488+0000 7f7f99d9b640 1 -- 172.21.15.79:0/2423988539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbc2df4ce0 msgr2=0x55dbc2dfe5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:55.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.488+0000 7f7f99d9b640 1 --2- 172.21.15.79:0/2423988539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbc2df4ce0 0x55dbc2dfe5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.488+0000 7f7f99d9b640 1 -- 172.21.15.79:0/2423988539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc2dfa050 msgr2=0x55dbc2dff7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.488+0000 7f7f99d9b640 1 --2- 172.21.15.79:0/2423988539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc2dfa050 0x55dbc2dff7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.488+0000 7f7f99d9b640 1 -- 172.21.15.79:0/2423988539 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbc2ab5790 con 0x55dbc2df7610 2024-08-20T01:40:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.488+0000 7f7f9ad9d640 1 --2- 172.21.15.79:0/2423988539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbc2df4ce0 0x55dbc2dfe5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:40:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.488+0000 7f7f99d9b640 1 --2- 172.21.15.79:0/2423988539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbc2df7610 0x55dbc2dfec50 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f7f84000c00 tx=0x7f7f840318e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=435edf5c85ba31f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.488+0000 7f7f81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:40:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.488+0000 7f7f81ffb640 1 -- 172.21.15.79:0/2423988539 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f84035030 con 0x55dbc2df7610 2024-08-20T01:40:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.488+0000 7f7f81ffb640 1 -- 172.21.15.79:0/2423988539 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f7f84004240 con 0x55dbc2df7610 2024-08-20T01:40:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.488+0000 7f7fa3872740 1 -- 172.21.15.79:0/2423988539 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dbc2d01e00 con 0x55dbc2df7610 2024-08-20T01:40:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.488+0000 7f7f81ffb640 1 -- 172.21.15.79:0/2423988539 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f7f84004440 con 0x55dbc2df7610 2024-08-20T01:40:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.488+0000 7f7fa3872740 10 client.16707 fetch_fsmap learned FSMap version 37 2024-08-20T01:40:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.488+0000 7f7fa3872740 1 -- 172.21.15.79:0/2423988539 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55dbc2b2e620 con 0x55dbc2df7610 2024-08-20T01:40:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.488+0000 7f7f81ffb640 1 -- 172.21.15.79:0/2423988539 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55dbc2d01e00 con 0x55dbc2df7610 2024-08-20T01:40:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.488+0000 7f7f81ffb640 1 -- 172.21.15.79:0/2423988539 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 37) ==== 8366+0+0 (secure 0 0 0) 0x7f7f8403c670 con 0x55dbc2df7610 2024-08-20T01:40:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.488+0000 7f7fa3872740 10 client.16707 fetch_fsmap finished waiting for FSMap version 37 2024-08-20T01:40:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.488+0000 7f7fa3872740 10 client.16707 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:40:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.489+0000 7f7fa3872740 20 client.16707 populate_metadata read hostname 'smithi079' 2024-08-20T01:40:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.489+0000 7f7fa3872740 1 --2- 172.21.15.79:0/2423988539 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55dbc2e09de0 0x55dbc2e0c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.489+0000 7f7fa3872740 4 client.16707 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:40:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.489+0000 7f7fa3872740 1 -- 172.21.15.79:0/2423988539 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dbc2d652b0 con 0x55dbc2e09de0 2024-08-20T01:40:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.489+0000 7f7f9ad9d640 1 --2- 172.21.15.79:0/2423988539 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55dbc2e09de0 0x55dbc2e0c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.489+0000 7f7f81ffb640 10 client.16707 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.489+0000 7f7f9ad9d640 1 --2- 172.21.15.79:0/2423988539 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55dbc2e09de0 0x55dbc2e0c1d0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6267f22c22fa31e7 server_cookie=a2b6b59b87c1c58b in_seq=0 out_seq=0 2024-08-20T01:40:55.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.490+0000 7f7f81ffb640 1 -- 172.21.15.79:0/2423988539 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dbc2d652b0 con 0x55dbc2e09de0 2024-08-20T01:40:55.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.490+0000 7f7f81ffb640 10 client.16707 handle_command_reply: tid=0 2024-08-20T01:40:55.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.490+0000 7f7fa3872740 1 client.16707 shutdown 2024-08-20T01:40:55.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.490+0000 7f7fa3872740 1 -- 172.21.15.79:0/2423988539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbc2df7610 msgr2=0x55dbc2dfec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:55.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.490+0000 7f7fa3872740 1 --2- 172.21.15.79:0/2423988539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbc2df7610 0x55dbc2dfec50 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f7f84000c00 tx=0x7f7f840318e0 comp rx=0 tx=0).stop 2024-08-20T01:40:55.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.490+0000 7f7fa3872740 1 -- 172.21.15.79:0/2423988539 shutdown_connections 2024-08-20T01:40:55.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.490+0000 7f7fa3872740 1 --2- 172.21.15.79:0/2423988539 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55dbc2e09de0 0x55dbc2e0c1d0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:55.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.490+0000 7f7fa3872740 1 --2- 172.21.15.79:0/2423988539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc2dfa050 0x55dbc2dff7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:55.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.490+0000 7f7fa3872740 1 --2- 172.21.15.79:0/2423988539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbc2df7610 0x55dbc2dfec50 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:55.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.490+0000 7f7fa3872740 1 --2- 172.21.15.79:0/2423988539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbc2df4ce0 0x55dbc2dfe5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:55.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.490+0000 7f7f81ffb640 0 client.16707 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:55.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.490+0000 7f7fa3872740 1 -- 172.21.15.79:0/2423988539 >> 172.21.15.79:0/2423988539 conn(0x55dbc2deba20 msgr2=0x55dbc2deaae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:55.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.490+0000 7f7fa3872740 1 -- 172.21.15.79:0/2423988539 shutdown_connections 2024-08-20T01:40:55.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.490+0000 7f7fa3872740 1 -- 172.21.15.79:0/2423988539 wait complete. 2024-08-20T01:40:55.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.490+0000 7f7fa3872740 20 client.16707 trim_cache size 0 max 16384 2024-08-20T01:40:55.510 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.504+0000 7f7fa3872740 1 Processor -- start 2024-08-20T01:40:55.510 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.504+0000 7f7fa3872740 1 -- start start 2024-08-20T01:40:55.510 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.504+0000 7f7fa3872740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc2df4ce0 0x55dbc2dfecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:55.510 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.504+0000 7f7fa3872740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbc2df7610 0x55dbc2dfa430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:55.511 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.504+0000 7f7fa3872740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbc2dfa050 0x55dbc2dfa970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:55.511 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.504+0000 7f7fa3872740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9c1a7810 con 0x55dbc2df7610 2024-08-20T01:40:55.511 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.504+0000 7f7fa3872740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9c1a9380 con 0x55dbc2df4ce0 2024-08-20T01:40:55.511 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.504+0000 7f7fa3872740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9c1a7ee0 con 0x55dbc2dfa050 2024-08-20T01:40:55.511 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.504+0000 7f7f99d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbc2df7610 0x55dbc2dfa430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:55.511 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.504+0000 7f7f99d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbc2df7610 0x55dbc2dfa430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52034/0 (socket says 172.21.15.79:52034) 2024-08-20T01:40:55.511 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.504+0000 7f7f99d9b640 1 -- 172.21.15.79:0/1495731647 learned_addr learned my addr 172.21.15.79:0/1495731647 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:55.511 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.505+0000 7f7f99d9b640 1 -- 172.21.15.79:0/1495731647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbc2dfa050 msgr2=0x55dbc2dfa970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:55.511 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.505+0000 7f7f99d9b640 1 --2- 172.21.15.79:0/1495731647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbc2dfa050 0x55dbc2dfa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:55.511 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.505+0000 7f7f99d9b640 1 -- 172.21.15.79:0/1495731647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc2df4ce0 msgr2=0x55dbc2dfecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:55.511 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.505+0000 7f7f9ad9d640 1 --2- 172.21.15.79:0/1495731647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc2df4ce0 0x55dbc2dfecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:55.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.505+0000 7f7f99d9b640 1 --2- 172.21.15.79:0/1495731647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc2df4ce0 0x55dbc2dfecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:55.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.505+0000 7f7f99d9b640 1 -- 172.21.15.79:0/1495731647 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbc2dffb20 con 0x55dbc2df7610 2024-08-20T01:40:55.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.505+0000 7f7f9ad9d640 1 --2- 172.21.15.79:0/1495731647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc2df4ce0 0x55dbc2dfecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:40:55.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.505+0000 7f7f99d9b640 1 --2- 172.21.15.79:0/1495731647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbc2df7610 0x55dbc2dfa430 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f7f8403ca10 tx=0x7f7f84005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c574968bc270a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:55.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.505+0000 7f7f83fff640 1 -- 172.21.15.79:0/1495731647 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f84000e60 con 0x55dbc2df7610 2024-08-20T01:40:55.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.505+0000 7f7f83fff640 1 -- 172.21.15.79:0/1495731647 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7f84040070 con 0x55dbc2df7610 2024-08-20T01:40:55.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.505+0000 7f7f83fff640 1 -- 172.21.15.79:0/1495731647 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f84035070 con 0x55dbc2df7610 2024-08-20T01:40:55.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.505+0000 7f7fa3872740 1 -- 172.21.15.79:0/1495731647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbc2df7610 msgr2=0x55dbc2dfa430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:55.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.505+0000 7f7fa3872740 1 --2- 172.21.15.79:0/1495731647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbc2df7610 0x55dbc2dfa430 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f7f8403ca10 tx=0x7f7f84005b50 comp rx=0 tx=0).stop 2024-08-20T01:40:55.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.505+0000 7f7fa3872740 1 -- 172.21.15.79:0/1495731647 shutdown_connections 2024-08-20T01:40:55.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.505+0000 7f7fa3872740 1 --2- 172.21.15.79:0/1495731647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbc2dfa050 0x55dbc2dfa970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:55.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.505+0000 7f7fa3872740 1 --2- 172.21.15.79:0/1495731647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbc2df7610 0x55dbc2dfa430 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:55.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.505+0000 7f7fa3872740 1 --2- 172.21.15.79:0/1495731647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc2df4ce0 0x55dbc2dfecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.506+0000 7f7fa3872740 1 -- 172.21.15.79:0/1495731647 >> 172.21.15.79:0/1495731647 conn(0x55dbc2deba20 msgr2=0x55dbc2dfe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.506+0000 7f7fa3872740 1 -- 172.21.15.79:0/1495731647 shutdown_connections 2024-08-20T01:40:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.506+0000 7f7fa3872740 1 -- 172.21.15.79:0/1495731647 wait complete. 2024-08-20T01:40:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.506+0000 7f7fa3872740 1 -- start start 2024-08-20T01:40:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.506+0000 7f7fa3872740 1 Processor -- start 2024-08-20T01:40:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.506+0000 7f7fa3872740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbc2df4ce0 0x55dbc2e03630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.506+0000 7f7fa3872740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc2df7610 0x55dbc2e03cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.506+0000 7f7fa3872740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbc2dfa050 0x55dbc2e047e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.506+0000 7f7fa3872740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9c1a8cb0 con 0x55dbc2df4ce0 2024-08-20T01:40:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.506+0000 7f7fa3872740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9c1a85b0 con 0x55dbc2df7610 2024-08-20T01:40:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.506+0000 7f7fa3872740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9c1a57f0 con 0x55dbc2dfa050 2024-08-20T01:40:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.506+0000 7f7fa3872740 10 client.0 _ll_register_callbacks cb 0x7f7f84009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.506+0000 7f7f9ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbc2df4ce0 0x55dbc2e03630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:55.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.506+0000 7f7f9ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbc2df4ce0 0x55dbc2e03630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52048/0 (socket says 172.21.15.79:52048) 2024-08-20T01:40:55.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.506+0000 7f7f9ad9d640 1 -- 172.21.15.79:0/3778509184 learned_addr learned my addr 172.21.15.79:0/3778509184 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:55.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.506+0000 7f7f9ad9d640 1 --2- 172.21.15.79:0/3778509184 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbc2dfa050 0x55dbc2e047e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:55.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.506+0000 7f7f99d9b640 1 --2- 172.21.15.79:0/3778509184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc2df7610 0x55dbc2e03cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:55.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.506+0000 7f7f9ad9d640 1 -- 172.21.15.79:0/3778509184 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbc2dfa050 msgr2=0x55dbc2e047e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:55.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.506+0000 7f7f9ad9d640 1 --2- 172.21.15.79:0/3778509184 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbc2dfa050 0x55dbc2e047e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:55.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.506+0000 7f7f9ad9d640 1 -- 172.21.15.79:0/3778509184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc2df7610 msgr2=0x55dbc2e03cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:55.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.506+0000 7f7f9ad9d640 1 --2- 172.21.15.79:0/3778509184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc2df7610 0x55dbc2e03cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:55.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.506+0000 7f7f9ad9d640 1 -- 172.21.15.79:0/3778509184 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbc2e05010 con 0x55dbc2df4ce0 2024-08-20T01:40:55.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.507+0000 7f7f9ad9d640 1 --2- 172.21.15.79:0/3778509184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbc2df4ce0 0x55dbc2e03630 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f7f94004620 tx=0x7f7f94000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe13cf5894d8517c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:55.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.507+0000 7f7f81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:40:55.515 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.507+0000 7f7f81ffb640 1 -- 172.21.15.79:0/3778509184 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9401e030 con 0x55dbc2df4ce0 2024-08-20T01:40:55.515 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.507+0000 7f7f81ffb640 1 -- 172.21.15.79:0/3778509184 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f7f94023040 con 0x55dbc2df4ce0 2024-08-20T01:40:55.515 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.507+0000 7f7fa3872740 1 -- 172.21.15.79:0/3778509184 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f84040070 con 0x55dbc2df4ce0 2024-08-20T01:40:55.515 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.507+0000 7f7f81ffb640 1 -- 172.21.15.79:0/3778509184 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f7f94039050 con 0x55dbc2df4ce0 2024-08-20T01:40:55.515 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.507+0000 7f7fa3872740 10 client.16713 fetch_fsmap learned FSMap version 37 2024-08-20T01:40:55.515 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.507+0000 7f7fa3872740 1 -- 172.21.15.79:0/3778509184 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55dbc2e063f0 con 0x55dbc2df4ce0 2024-08-20T01:40:55.515 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.507+0000 7f7f81ffb640 1 -- 172.21.15.79:0/3778509184 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7f84040070 con 0x55dbc2df4ce0 2024-08-20T01:40:55.515 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.507+0000 7f7f81ffb640 1 -- 172.21.15.79:0/3778509184 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 37) ==== 8366+0+0 (secure 0 0 0) 0x7f7f9402a820 con 0x55dbc2df4ce0 2024-08-20T01:40:55.515 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.507+0000 7f7fa3872740 10 client.16713 fetch_fsmap finished waiting for FSMap version 37 2024-08-20T01:40:55.515 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.507+0000 7f7fa3872740 10 client.16713 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:40:55.515 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.507+0000 7f7fa3872740 20 client.16713 populate_metadata read hostname 'smithi079' 2024-08-20T01:40:55.515 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.507+0000 7f7fa3872740 1 --2- 172.21.15.79:0/3778509184 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55dbc2e74d40 0x55dbc2e77130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:55.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.507+0000 7f7fa3872740 4 client.16713 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:40:55.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.507+0000 7f7fa3872740 1 -- 172.21.15.79:0/3778509184 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dbc2d60d50 con 0x55dbc2e74d40 2024-08-20T01:40:55.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.507+0000 7f7f99d9b640 1 --2- 172.21.15.79:0/3778509184 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55dbc2e74d40 0x55dbc2e77130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:55.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.508+0000 7f7f81ffb640 10 client.16713 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:55.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.508+0000 7f7f99d9b640 1 --2- 172.21.15.79:0/3778509184 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55dbc2e74d40 0x55dbc2e77130 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c04e0c4506da30b1 server_cookie=b4d5032ec636bf44 in_seq=0 out_seq=0 2024-08-20T01:40:55.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.515+0000 7f7f81ffb640 1 -- 172.21.15.79:0/3778509184 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dbc2d60d50 con 0x55dbc2e74d40 2024-08-20T01:40:55.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.515+0000 7f7f81ffb640 10 client.16713 handle_command_reply: tid=0 2024-08-20T01:40:55.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.515+0000 7f7fa3872740 1 client.16713 shutdown 2024-08-20T01:40:55.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.515+0000 7f7fa3872740 1 -- 172.21.15.79:0/3778509184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbc2df4ce0 msgr2=0x55dbc2e03630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:55.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.515+0000 7f7fa3872740 1 --2- 172.21.15.79:0/3778509184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbc2df4ce0 0x55dbc2e03630 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f7f94004620 tx=0x7f7f94000bc0 comp rx=0 tx=0).stop 2024-08-20T01:40:55.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.515+0000 7f7fa3872740 1 -- 172.21.15.79:0/3778509184 shutdown_connections 2024-08-20T01:40:55.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.515+0000 7f7fa3872740 1 --2- 172.21.15.79:0/3778509184 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55dbc2e74d40 0x55dbc2e77130 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:55.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.515+0000 7f7fa3872740 1 --2- 172.21.15.79:0/3778509184 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbc2dfa050 0x55dbc2e047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:55.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.515+0000 7f7fa3872740 1 --2- 172.21.15.79:0/3778509184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc2df7610 0x55dbc2e03cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:55.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.515+0000 7f7f81ffb640 0 client.16713 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:55.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.515+0000 7f7fa3872740 1 --2- 172.21.15.79:0/3778509184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dbc2df4ce0 0x55dbc2e03630 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:55.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.515+0000 7f7fa3872740 1 -- 172.21.15.79:0/3778509184 >> 172.21.15.79:0/3778509184 conn(0x55dbc2deba20 msgr2=0x55dbc2dea2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:55.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.515+0000 7f7fa3872740 1 -- 172.21.15.79:0/3778509184 shutdown_connections 2024-08-20T01:40:55.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.515+0000 7f7fa3872740 1 -- 172.21.15.79:0/3778509184 wait complete. 2024-08-20T01:40:55.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.515+0000 7f7fa3872740 20 client.16713 trim_cache size 0 max 16384 2024-08-20T01:40:55.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:40:55.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:40:55.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:40:55.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:40:55.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.516+0000 7f7fa0a85640 1 -- 172.21.15.79:0/4077840874 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f7f880b3c50 msgr2=0x7f7f880b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:55.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.516+0000 7f7fa0a85640 1 --2- 172.21.15.79:0/4077840874 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f7f880b3c50 0x7f7f880b6110 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c00ccb0 tx=0x7f7f8c000f40 comp rx=0 tx=0).stop 2024-08-20T01:40:55.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.516+0000 7f7fa0a85640 1 -- 172.21.15.79:0/4077840874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f9c101560 msgr2=0x7f7f9c198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:55.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.516+0000 7f7fa0a85640 1 --2- 172.21.15.79:0/4077840874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f9c101560 0x7f7f9c198920 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c00cce0 tx=0x7f7f8c00a620 comp rx=0 tx=0).stop 2024-08-20T01:40:55.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.516+0000 7f7fa0a85640 1 -- 172.21.15.79:0/4077840874 shutdown_connections 2024-08-20T01:40:55.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.516+0000 7f7fa0a85640 1 --2- 172.21.15.79:0/4077840874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f9c103070 0x7f7f9c199ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:55.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.516+0000 7f7fa0a85640 1 --2- 172.21.15.79:0/4077840874 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f7f880b3c50 0x7f7f880b6110 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:55.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.516+0000 7f7fa0a85640 1 --2- 172.21.15.79:0/4077840874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f9c1026b0 0x7f7f9c198f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:55.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.516+0000 7f7fa0a85640 1 --2- 172.21.15.79:0/4077840874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f9c101560 0x7f7f9c198920 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:55.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.516+0000 7f7fa0a85640 1 -- 172.21.15.79:0/4077840874 >> 172.21.15.79:0/4077840874 conn(0x7f7f9c0fce40 msgr2=0x7f7f9c06a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:55.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.516+0000 7f7fa0a85640 1 -- 172.21.15.79:0/4077840874 shutdown_connections 2024-08-20T01:40:55.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:40:55.516+0000 7f7fa0a85640 1 -- 172.21.15.79:0/4077840874 wait complete. 2024-08-20T01:40:56.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:56 smithi175 ceph-mon[22392]: pgmap v455: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 32 MiB/s wr, 26 op/s 2024-08-20T01:40:56.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:56 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:40:56.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:56 smithi079 ceph-mon[18656]: pgmap v455: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 32 MiB/s wr, 26 op/s 2024-08-20T01:40:56.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:56 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:40:56.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:56 smithi081 ceph-mon[22209]: pgmap v455: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 32 MiB/s wr, 26 op/s 2024-08-20T01:40:56.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:56 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:40:57.717 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T01:40:57.717 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T01:40:58.000 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:40:58.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:40:58 smithi175 ceph-mon[22392]: pgmap v456: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 29 MiB/s wr, 22 op/s 2024-08-20T01:40:58.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:40:58 smithi079 ceph-mon[18656]: pgmap v456: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 29 MiB/s wr, 22 op/s 2024-08-20T01:40:58.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:40:58 smithi081 ceph-mon[22209]: pgmap v456: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 29 MiB/s wr, 22 op/s 2024-08-20T01:40:59.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.631+0000 7f302a4f0640 1 -- 172.21.15.79:0/2615836646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3024108e40 msgr2=0x7f302410f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:59.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.631+0000 7f302a4f0640 1 --2- 172.21.15.79:0/2615836646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3024108e40 0x7f302410f640 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f301c009ca0 tx=0x7f301c02a8c0 comp rx=0 tx=0).stop 2024-08-20T01:40:59.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.631+0000 7f302a4f0640 1 -- 172.21.15.79:0/2615836646 shutdown_connections 2024-08-20T01:40:59.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.631+0000 7f302a4f0640 1 --2- 172.21.15.79:0/2615836646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3024108e40 0x7f302410f640 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:59.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.631+0000 7f302a4f0640 1 --2- 172.21.15.79:0/2615836646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30241084c0 0x7f3024108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:59.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.631+0000 7f302a4f0640 1 --2- 172.21.15.79:0/2615836646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3024102ab0 0x7f3024102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:59.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.631+0000 7f302a4f0640 1 -- 172.21.15.79:0/2615836646 >> 172.21.15.79:0/2615836646 conn(0x7f30240fe520 msgr2=0x7f3024100940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:59.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.631+0000 7f302a4f0640 1 -- 172.21.15.79:0/2615836646 shutdown_connections 2024-08-20T01:40:59.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.631+0000 7f302a4f0640 1 -- 172.21.15.79:0/2615836646 wait complete. 2024-08-20T01:40:59.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.632+0000 7f302a4f0640 1 Processor -- start 2024-08-20T01:40:59.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.632+0000 7f302a4f0640 1 -- start start 2024-08-20T01:40:59.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.633+0000 7f302a4f0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3024102ab0 0x7f3024198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:59.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.633+0000 7f302a4f0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30241084c0 0x7f30241993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:59.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.633+0000 7f302a4f0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3024108e40 0x7f302419e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:59.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.633+0000 7f302a4f0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f30241129c0 con 0x7f3024108e40 2024-08-20T01:40:59.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.633+0000 7f302a4f0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3024112840 con 0x7f3024102ab0 2024-08-20T01:40:59.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.633+0000 7f302a4f0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3024112b40 con 0x7f30241084c0 2024-08-20T01:40:59.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.633+0000 7f3028a8d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3024108e40 0x7f302419e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:59.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.633+0000 7f3028a8d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3024108e40 0x7f302419e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52064/0 (socket says 172.21.15.79:52064) 2024-08-20T01:40:59.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.633+0000 7f3028a8d640 1 -- 172.21.15.79:0/3624917592 learned_addr learned my addr 172.21.15.79:0/3624917592 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:59.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.633+0000 7f3023fff640 1 --2- 172.21.15.79:0/3624917592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3024102ab0 0x7f3024198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:59.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.633+0000 7f30237fe640 1 --2- 172.21.15.79:0/3624917592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30241084c0 0x7f30241993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:59.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.633+0000 7f3028a8d640 1 -- 172.21.15.79:0/3624917592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30241084c0 msgr2=0x7f30241993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:59.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.633+0000 7f3028a8d640 1 --2- 172.21.15.79:0/3624917592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30241084c0 0x7f30241993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:59.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.633+0000 7f3028a8d640 1 -- 172.21.15.79:0/3624917592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3024102ab0 msgr2=0x7f3024198e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:59.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.633+0000 7f3028a8d640 1 --2- 172.21.15.79:0/3624917592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3024102ab0 0x7f3024198e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:59.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.633+0000 7f3028a8d640 1 -- 172.21.15.79:0/3624917592 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f302419ef40 con 0x7f3024108e40 2024-08-20T01:40:59.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.633+0000 7f3028a8d640 1 --2- 172.21.15.79:0/3624917592 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3024108e40 0x7f302419e770 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f301c005e30 tx=0x7f301c0093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:59.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.634+0000 7f30217fa640 1 -- 172.21.15.79:0/3624917592 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301c032d10 con 0x7f3024108e40 2024-08-20T01:40:59.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.634+0000 7f30217fa640 1 -- 172.21.15.79:0/3624917592 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f301c032eb0 con 0x7f3024108e40 2024-08-20T01:40:59.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.634+0000 7f302a4f0640 1 -- 172.21.15.79:0/3624917592 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f302419f1d0 con 0x7f3024108e40 2024-08-20T01:40:59.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.634+0000 7f30217fa640 1 -- 172.21.15.79:0/3624917592 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301c030b20 con 0x7f3024108e40 2024-08-20T01:40:59.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.634+0000 7f302a4f0640 1 -- 172.21.15.79:0/3624917592 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30241a58f0 con 0x7f3024108e40 2024-08-20T01:40:59.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.636+0000 7f302c8e9740 1 Processor -- start 2024-08-20T01:40:59.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.636+0000 7f30217fa640 1 -- 172.21.15.79:0/3624917592 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f301c030cc0 con 0x7f3024108e40 2024-08-20T01:40:59.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.637+0000 7f302c8e9740 1 -- start start 2024-08-20T01:40:59.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.637+0000 7f302c8e9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559615b323b0 0x559615b32790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:59.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.637+0000 7f302c8e9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559615b32cd0 0x559615b3e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:59.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.637+0000 7f302c8e9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559615b3ec60 0x559615b41050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:59.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.637+0000 7f302c8e9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559615aa8940 con 0x559615b32cd0 2024-08-20T01:40:59.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.637+0000 7f302c8e9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559615a97e40 con 0x559615b323b0 2024-08-20T01:40:59.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.637+0000 7f302c8e9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559615a9be80 con 0x559615b3ec60 2024-08-20T01:40:59.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.637+0000 7f3023fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559615b32cd0 0x559615b3e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:59.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.637+0000 7f3023fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559615b32cd0 0x559615b3e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52072/0 (socket says 172.21.15.79:52072) 2024-08-20T01:40:59.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.637+0000 7f3023fff640 1 -- 172.21.15.79:0/1523291380 learned_addr learned my addr 172.21.15.79:0/1523291380 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:59.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.637+0000 7f30237fe640 1 --2- 172.21.15.79:0/1523291380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559615b323b0 0x559615b32790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:59.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.637+0000 7f30237fe640 1 --2- 172.21.15.79:0/1523291380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559615b3ec60 0x559615b41050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:59.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.637+0000 7f3023fff640 1 -- 172.21.15.79:0/1523291380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559615b3ec60 msgr2=0x559615b41050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:59.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.637+0000 7f3023fff640 1 --2- 172.21.15.79:0/1523291380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559615b3ec60 0x559615b41050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:59.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.637+0000 7f3023fff640 1 -- 172.21.15.79:0/1523291380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559615b323b0 msgr2=0x559615b32790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:59.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.637+0000 7f3023fff640 1 --2- 172.21.15.79:0/1523291380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559615b323b0 0x559615b32790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:59.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.637+0000 7f3023fff640 1 -- 172.21.15.79:0/1523291380 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559615a34520 con 0x559615b32cd0 2024-08-20T01:40:59.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.637+0000 7f30237fe640 1 --2- 172.21.15.79:0/1523291380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559615b3ec60 0x559615b41050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:40:59.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.637+0000 7f30217fa640 1 --2- 172.21.15.79:0/3624917592 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f300c0b3bd0 0x7f300c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:59.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.638+0000 7f30237fe640 1 --2- 172.21.15.79:0/3624917592 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f300c0b3bd0 0x7f300c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:59.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.638+0000 7f3023fff640 1 --2- 172.21.15.79:0/1523291380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559615b32cd0 0x559615b3e720 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f301400bd40 tx=0x7f30140107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7a14006d86384b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:59.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.638+0000 7f30217fa640 1 -- 172.21.15.79:0/3624917592 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f301c104f00 con 0x7f3024108e40 2024-08-20T01:40:59.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.638+0000 7f300a7fc640 1 -- 172.21.15.79:0/1523291380 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3014004230 con 0x559615b32cd0 2024-08-20T01:40:59.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.638+0000 7f300a7fc640 1 -- 172.21.15.79:0/1523291380 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f301400be30 con 0x559615b32cd0 2024-08-20T01:40:59.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.638+0000 7f300a7fc640 1 -- 172.21.15.79:0/1523291380 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301401a690 con 0x559615b32cd0 2024-08-20T01:40:59.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.639+0000 7f302c8e9740 1 -- 172.21.15.79:0/1523291380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559615b32cd0 msgr2=0x559615b3e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:59.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.639+0000 7f30237fe640 1 --2- 172.21.15.79:0/3624917592 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f300c0b3bd0 0x7f300c0b6090 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x559615b32360 tx=0x7f3018004730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:59.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.639+0000 7f302c8e9740 1 --2- 172.21.15.79:0/1523291380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559615b32cd0 0x559615b3e720 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f301400bd40 tx=0x7f30140107a0 comp rx=0 tx=0).stop 2024-08-20T01:40:59.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.639+0000 7f302c8e9740 1 -- 172.21.15.79:0/1523291380 shutdown_connections 2024-08-20T01:40:59.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.639+0000 7f302c8e9740 1 --2- 172.21.15.79:0/1523291380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559615b3ec60 0x559615b41050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:59.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.639+0000 7f302c8e9740 1 --2- 172.21.15.79:0/1523291380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559615b32cd0 0x559615b3e720 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:59.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.639+0000 7f302c8e9740 1 --2- 172.21.15.79:0/1523291380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559615b323b0 0x559615b32790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:59.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.639+0000 7f302c8e9740 1 -- 172.21.15.79:0/1523291380 >> 172.21.15.79:0/1523291380 conn(0x559615b301e0 msgr2=0x559615b31380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:59.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.639+0000 7f302c8e9740 1 -- 172.21.15.79:0/1523291380 shutdown_connections 2024-08-20T01:40:59.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.639+0000 7f302c8e9740 1 -- 172.21.15.79:0/1523291380 wait complete. 2024-08-20T01:40:59.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.639+0000 7f302c8e9740 1 -- start start 2024-08-20T01:40:59.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.639+0000 7f302c8e9740 1 Processor -- start 2024-08-20T01:40:59.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.640+0000 7f302c8e9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559615b323b0 0x559615b3bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:59.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.640+0000 7f302c8e9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559615b32cd0 0x559615b3c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:59.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.640+0000 7f302c8e9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559615b3ec60 0x559615b3c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:59.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.640+0000 7f302c8e9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5596158fa890 con 0x559615b323b0 2024-08-20T01:40:59.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.640+0000 7f302c8e9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559615a1e700 con 0x559615b3ec60 2024-08-20T01:40:59.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.640+0000 7f302c8e9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559615b419b0 con 0x559615b32cd0 2024-08-20T01:40:59.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.640+0000 7f302c8e9740 10 client.0 _ll_register_callbacks cb 0x559615a936f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:59.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.640+0000 7f3023fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559615b323b0 0x559615b3bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:59.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.640+0000 7f3023fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559615b323b0 0x559615b3bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52076/0 (socket says 172.21.15.79:52076) 2024-08-20T01:40:59.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.640+0000 7f3023fff640 1 -- 172.21.15.79:0/3061803961 learned_addr learned my addr 172.21.15.79:0/3061803961 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:59.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.640+0000 7f3028a8d640 1 --2- 172.21.15.79:0/3061803961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559615b3ec60 0x559615b3c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:59.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.640+0000 7f30237fe640 1 --2- 172.21.15.79:0/3061803961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559615b32cd0 0x559615b3c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:59.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.640+0000 7f3023fff640 1 -- 172.21.15.79:0/3061803961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559615b32cd0 msgr2=0x559615b3c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:59.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.640+0000 7f3023fff640 1 --2- 172.21.15.79:0/3061803961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559615b32cd0 0x559615b3c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:59.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.640+0000 7f3023fff640 1 -- 172.21.15.79:0/3061803961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559615b3ec60 msgr2=0x559615b3c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:59.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.640+0000 7f3023fff640 1 --2- 172.21.15.79:0/3061803961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559615b3ec60 0x559615b3c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:59.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.640+0000 7f3023fff640 1 -- 172.21.15.79:0/3061803961 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596157f7930 con 0x559615b323b0 2024-08-20T01:40:59.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.641+0000 7f3023fff640 1 --2- 172.21.15.79:0/3061803961 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559615b323b0 0x559615b3bc70 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f301400ba70 tx=0x7f30140058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c603137b4fdeee27 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:59.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.641+0000 7f30037fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:40:59.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.641+0000 7f30037fe640 1 -- 172.21.15.79:0/3061803961 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3014029060 con 0x559615b323b0 2024-08-20T01:40:59.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.641+0000 7f30037fe640 1 -- 172.21.15.79:0/3061803961 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f3014005040 con 0x559615b323b0 2024-08-20T01:40:59.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.641+0000 7f302c8e9740 1 -- 172.21.15.79:0/3061803961 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f301400be30 con 0x559615b323b0 2024-08-20T01:40:59.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.641+0000 7f30037fe640 1 -- 172.21.15.79:0/3061803961 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f3014005240 con 0x559615b323b0 2024-08-20T01:40:59.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.641+0000 7f302c8e9740 10 client.16725 fetch_fsmap learned FSMap version 37 2024-08-20T01:40:59.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.641+0000 7f302c8e9740 1 -- 172.21.15.79:0/3061803961 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x559615b4d640 con 0x559615b323b0 2024-08-20T01:40:59.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.641+0000 7f30037fe640 1 -- 172.21.15.79:0/3061803961 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f301400be30 con 0x559615b323b0 2024-08-20T01:40:59.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.641+0000 7f30037fe640 1 -- 172.21.15.79:0/3061803961 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 37) ==== 8366+0+0 (secure 0 0 0) 0x7f3014004750 con 0x559615b323b0 2024-08-20T01:40:59.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.642+0000 7f302c8e9740 10 client.16725 fetch_fsmap finished waiting for FSMap version 37 2024-08-20T01:40:59.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.642+0000 7f302c8e9740 10 client.16725 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:40:59.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.642+0000 7f302c8e9740 20 client.16725 populate_metadata read hostname 'smithi079' 2024-08-20T01:40:59.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.642+0000 7f302c8e9740 1 --2- 172.21.15.79:0/3061803961 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x559615b4eaa0 0x559615b50e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:59.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.642+0000 7f302c8e9740 4 client.16725 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:40:59.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.642+0000 7f302c8e9740 1 -- 172.21.15.79:0/3061803961 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559615aaa890 con 0x559615b4eaa0 2024-08-20T01:40:59.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.642+0000 7f30237fe640 1 --2- 172.21.15.79:0/3061803961 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x559615b4eaa0 0x559615b50e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:59.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.642+0000 7f30237fe640 1 --2- 172.21.15.79:0/3061803961 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x559615b4eaa0 0x559615b50e90 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b1d7272c81606d6 server_cookie=228f7b64699e7da7 in_seq=0 out_seq=0 2024-08-20T01:40:59.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.642+0000 7f30037fe640 10 client.16725 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:59.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.643+0000 7f30037fe640 1 -- 172.21.15.79:0/3061803961 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559615aaa890 con 0x559615b4eaa0 2024-08-20T01:40:59.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.643+0000 7f30037fe640 10 client.16725 handle_command_reply: tid=0 2024-08-20T01:40:59.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.643+0000 7f302c8e9740 1 client.16725 shutdown 2024-08-20T01:40:59.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.643+0000 7f302c8e9740 1 -- 172.21.15.79:0/3061803961 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559615b323b0 msgr2=0x559615b3bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:59.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.643+0000 7f302c8e9740 1 --2- 172.21.15.79:0/3061803961 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559615b323b0 0x559615b3bc70 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f301400ba70 tx=0x7f30140058e0 comp rx=0 tx=0).stop 2024-08-20T01:40:59.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.643+0000 7f302c8e9740 1 -- 172.21.15.79:0/3061803961 shutdown_connections 2024-08-20T01:40:59.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.643+0000 7f302c8e9740 1 --2- 172.21.15.79:0/3061803961 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x559615b4eaa0 0x559615b50e90 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:59.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.643+0000 7f302c8e9740 1 --2- 172.21.15.79:0/3061803961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559615b3ec60 0x559615b3c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:59.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.643+0000 7f30037fe640 0 client.16725 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:59.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.643+0000 7f302c8e9740 1 --2- 172.21.15.79:0/3061803961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559615b32cd0 0x559615b3c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:59.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.643+0000 7f302c8e9740 1 --2- 172.21.15.79:0/3061803961 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559615b323b0 0x559615b3bc70 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:59.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.643+0000 7f302c8e9740 1 -- 172.21.15.79:0/3061803961 >> 172.21.15.79:0/3061803961 conn(0x559615b301e0 msgr2=0x559615b35d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:59.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.643+0000 7f302c8e9740 1 -- 172.21.15.79:0/3061803961 shutdown_connections 2024-08-20T01:40:59.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.643+0000 7f302c8e9740 1 -- 172.21.15.79:0/3061803961 wait complete. 2024-08-20T01:40:59.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.644+0000 7f302c8e9740 20 client.16725 trim_cache size 0 max 16384 2024-08-20T01:40:59.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.665+0000 7f302c8e9740 1 Processor -- start 2024-08-20T01:40:59.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.665+0000 7f302c8e9740 1 -- start start 2024-08-20T01:40:59.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.665+0000 7f302c8e9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559615b323b0 0x559615b3d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:59.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.665+0000 7f302c8e9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559615b32cd0 0x559615b35bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:59.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.665+0000 7f302c8e9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559615b3ec60 0x559615b360f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:59.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.665+0000 7f302c8e9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f30241adf40 con 0x559615b32cd0 2024-08-20T01:40:59.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.665+0000 7f302c8e9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f30241afab0 con 0x559615b3ec60 2024-08-20T01:40:59.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.665+0000 7f302c8e9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f30241ae610 con 0x559615b323b0 2024-08-20T01:40:59.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.665+0000 7f30237fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559615b32cd0 0x559615b35bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:59.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.665+0000 7f30237fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559615b32cd0 0x559615b35bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52082/0 (socket says 172.21.15.79:52082) 2024-08-20T01:40:59.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.665+0000 7f30237fe640 1 -- 172.21.15.79:0/1966669861 learned_addr learned my addr 172.21.15.79:0/1966669861 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:59.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.666+0000 7f3028a8d640 1 --2- 172.21.15.79:0/1966669861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559615b3ec60 0x559615b360f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:59.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.666+0000 7f3023fff640 1 --2- 172.21.15.79:0/1966669861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559615b323b0 0x559615b3d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:59.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.666+0000 7f3028a8d640 1 -- 172.21.15.79:0/1966669861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559615b323b0 msgr2=0x559615b3d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:59.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.666+0000 7f3028a8d640 1 --2- 172.21.15.79:0/1966669861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559615b323b0 0x559615b3d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:59.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.666+0000 7f3028a8d640 1 -- 172.21.15.79:0/1966669861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559615b32cd0 msgr2=0x559615b35bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:59.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.666+0000 7f3028a8d640 1 --2- 172.21.15.79:0/1966669861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559615b32cd0 0x559615b35bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:59.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.666+0000 7f3028a8d640 1 -- 172.21.15.79:0/1966669861 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559615b315a0 con 0x559615b3ec60 2024-08-20T01:40:59.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.666+0000 7f30237fe640 1 --2- 172.21.15.79:0/1966669861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559615b32cd0 0x559615b35bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:40:59.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.666+0000 7f3028a8d640 1 --2- 172.21.15.79:0/1966669861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559615b3ec60 0x559615b360f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f301c003fd0 tx=0x7f301c009900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80e51cdc00013b5a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:59.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.666+0000 7f3009ffb640 1 -- 172.21.15.79:0/1966669861 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301c0e6070 con 0x559615b3ec60 2024-08-20T01:40:59.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.666+0000 7f3009ffb640 1 -- 172.21.15.79:0/1966669861 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f301c036070 con 0x559615b3ec60 2024-08-20T01:40:59.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.666+0000 7f3009ffb640 1 -- 172.21.15.79:0/1966669861 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301c0cc0c0 con 0x559615b3ec60 2024-08-20T01:40:59.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.667+0000 7f302c8e9740 1 -- 172.21.15.79:0/1966669861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559615b3ec60 msgr2=0x559615b360f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:59.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.667+0000 7f302c8e9740 1 --2- 172.21.15.79:0/1966669861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559615b3ec60 0x559615b360f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f301c003fd0 tx=0x7f301c009900 comp rx=0 tx=0).stop 2024-08-20T01:40:59.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.667+0000 7f302c8e9740 1 -- 172.21.15.79:0/1966669861 shutdown_connections 2024-08-20T01:40:59.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.667+0000 7f302c8e9740 1 --2- 172.21.15.79:0/1966669861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559615b3ec60 0x559615b360f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:59.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.667+0000 7f302c8e9740 1 --2- 172.21.15.79:0/1966669861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559615b32cd0 0x559615b35bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:59.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.667+0000 7f302c8e9740 1 --2- 172.21.15.79:0/1966669861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559615b323b0 0x559615b3d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:59.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.667+0000 7f302c8e9740 1 -- 172.21.15.79:0/1966669861 >> 172.21.15.79:0/1966669861 conn(0x559615b301e0 msgr2=0x559615b354a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:59.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.667+0000 7f302c8e9740 1 -- 172.21.15.79:0/1966669861 shutdown_connections 2024-08-20T01:40:59.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.667+0000 7f302c8e9740 1 -- 172.21.15.79:0/1966669861 wait complete. 2024-08-20T01:40:59.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.667+0000 7f302c8e9740 1 -- start start 2024-08-20T01:40:59.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.668+0000 7f302c8e9740 1 Processor -- start 2024-08-20T01:40:59.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.668+0000 7f302c8e9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559615b323b0 0x559615b42fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:59.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.668+0000 7f302c8e9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559615b32cd0 0x559615b43530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:59.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.668+0000 7f302c8e9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559615b3ec60 0x559615bb8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:59.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.668+0000 7f302c8e9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f30241af3e0 con 0x559615b32cd0 2024-08-20T01:40:59.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.668+0000 7f302c8e9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f30241aece0 con 0x559615b323b0 2024-08-20T01:40:59.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.668+0000 7f302c8e9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f30241abf20 con 0x559615b3ec60 2024-08-20T01:40:59.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.668+0000 7f302c8e9740 10 client.0 _ll_register_callbacks cb 0x7f3018009a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:40:59.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.668+0000 7f30237fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559615b32cd0 0x559615b43530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:59.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.668+0000 7f30237fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559615b32cd0 0x559615b43530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52096/0 (socket says 172.21.15.79:52096) 2024-08-20T01:40:59.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.668+0000 7f30237fe640 1 -- 172.21.15.79:0/1466578771 learned_addr learned my addr 172.21.15.79:0/1466578771 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:40:59.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.668+0000 7f3023fff640 1 --2- 172.21.15.79:0/1466578771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559615b323b0 0x559615b42fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:59.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.668+0000 7f3028a8d640 1 --2- 172.21.15.79:0/1466578771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559615b3ec60 0x559615bb8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:59.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.669+0000 7f30237fe640 1 -- 172.21.15.79:0/1466578771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559615b3ec60 msgr2=0x559615bb8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:59.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.669+0000 7f30237fe640 1 --2- 172.21.15.79:0/1466578771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559615b3ec60 0x559615bb8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:59.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.669+0000 7f30237fe640 1 -- 172.21.15.79:0/1466578771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559615b323b0 msgr2=0x559615b42fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:40:59.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.669+0000 7f30237fe640 1 --2- 172.21.15.79:0/1466578771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559615b323b0 0x559615b42fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:59.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.669+0000 7f30237fe640 1 -- 172.21.15.79:0/1466578771 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559615bb89d0 con 0x559615b32cd0 2024-08-20T01:40:59.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.669+0000 7f3023fff640 1 --2- 172.21.15.79:0/1466578771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559615b323b0 0x559615b42fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:40:59.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.669+0000 7f30237fe640 1 --2- 172.21.15.79:0/1466578771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559615b32cd0 0x559615b43530 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f3018004640 tx=0x7f3018005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91c498cfbd08fd31 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:40:59.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.669+0000 7f30037fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:40:59.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.669+0000 7f30037fe640 1 -- 172.21.15.79:0/1466578771 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3018030070 con 0x559615b32cd0 2024-08-20T01:40:59.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.669+0000 7f30037fe640 1 -- 172.21.15.79:0/1466578771 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f3018010430 con 0x559615b32cd0 2024-08-20T01:40:59.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.669+0000 7f302c8e9740 1 -- 172.21.15.79:0/1466578771 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f301c036070 con 0x559615b32cd0 2024-08-20T01:40:59.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.669+0000 7f30037fe640 1 -- 172.21.15.79:0/1466578771 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f3018010630 con 0x559615b32cd0 2024-08-20T01:40:59.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.669+0000 7f302c8e9740 10 client.16731 fetch_fsmap learned FSMap version 37 2024-08-20T01:40:59.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.669+0000 7f302c8e9740 1 -- 172.21.15.79:0/1466578771 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x559615bb9d70 con 0x559615b32cd0 2024-08-20T01:40:59.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.669+0000 7f30037fe640 1 -- 172.21.15.79:0/1466578771 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f301c036070 con 0x559615b32cd0 2024-08-20T01:40:59.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.670+0000 7f30037fe640 1 -- 172.21.15.79:0/1466578771 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 37) ==== 8366+0+0 (secure 0 0 0) 0x7f3018021920 con 0x559615b32cd0 2024-08-20T01:40:59.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.670+0000 7f302c8e9740 10 client.16731 fetch_fsmap finished waiting for FSMap version 37 2024-08-20T01:40:59.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.670+0000 7f302c8e9740 10 client.16731 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:40:59.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.670+0000 7f302c8e9740 20 client.16731 populate_metadata read hostname 'smithi079' 2024-08-20T01:40:59.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.670+0000 7f302c8e9740 1 --2- 172.21.15.79:0/1466578771 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x559615b4eaa0 0x559615bbc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:40:59.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.670+0000 7f302c8e9740 4 client.16731 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T01:40:59.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.670+0000 7f302c8e9740 1 -- 172.21.15.79:0/1466578771 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559615aa6330 con 0x559615b4eaa0 2024-08-20T01:40:59.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.670+0000 7f3023fff640 1 --2- 172.21.15.79:0/1466578771 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x559615b4eaa0 0x559615bbc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:40:59.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.670+0000 7f3023fff640 1 --2- 172.21.15.79:0/1466578771 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x559615b4eaa0 0x559615bbc530 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c64de8d730b6e3d server_cookie=21d7a8f5a3cd1d7a in_seq=0 out_seq=0 2024-08-20T01:40:59.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.670+0000 7f30037fe640 10 client.16731 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:59.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.671+0000 7f30037fe640 1 -- 172.21.15.79:0/1466578771 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559615aa6330 con 0x559615b4eaa0 2024-08-20T01:40:59.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.671+0000 7f30037fe640 10 client.16731 handle_command_reply: tid=0 2024-08-20T01:40:59.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.671+0000 7f302c8e9740 1 client.16731 shutdown 2024-08-20T01:40:59.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.671+0000 7f302c8e9740 1 -- 172.21.15.79:0/1466578771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559615b32cd0 msgr2=0x559615b43530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:59.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.671+0000 7f302c8e9740 1 --2- 172.21.15.79:0/1466578771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559615b32cd0 0x559615b43530 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f3018004640 tx=0x7f3018005f90 comp rx=0 tx=0).stop 2024-08-20T01:40:59.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.671+0000 7f302c8e9740 1 -- 172.21.15.79:0/1466578771 shutdown_connections 2024-08-20T01:40:59.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.671+0000 7f302c8e9740 1 --2- 172.21.15.79:0/1466578771 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x559615b4eaa0 0x559615bbc530 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:59.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.671+0000 7f302c8e9740 1 --2- 172.21.15.79:0/1466578771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559615b3ec60 0x559615bb8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:59.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.671+0000 7f30037fe640 0 client.16731 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:40:59.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.671+0000 7f302c8e9740 1 --2- 172.21.15.79:0/1466578771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559615b32cd0 0x559615b43530 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:59.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.671+0000 7f302c8e9740 1 --2- 172.21.15.79:0/1466578771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559615b323b0 0x559615b42fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:59.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.671+0000 7f302c8e9740 1 -- 172.21.15.79:0/1466578771 >> 172.21.15.79:0/1466578771 conn(0x559615b301e0 msgr2=0x559615b35c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:59.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.672+0000 7f302c8e9740 1 -- 172.21.15.79:0/1466578771 shutdown_connections 2024-08-20T01:40:59.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.672+0000 7f302c8e9740 1 -- 172.21.15.79:0/1466578771 wait complete. 2024-08-20T01:40:59.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.672+0000 7f302c8e9740 20 client.16731 trim_cache size 0 max 16384 2024-08-20T01:40:59.681 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:40:59.681 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-08-20T01:40:59.681 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "02179b41-8552-4983-b7a3-49ed838a9d64", 2024-08-20T01:40:59.681 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-08-20T01:40:59.681 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:40:59.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.672+0000 7f302a4f0640 1 -- 172.21.15.79:0/3624917592 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f300c0b3bd0 msgr2=0x7f300c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:59.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.672+0000 7f302a4f0640 1 --2- 172.21.15.79:0/3624917592 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f300c0b3bd0 0x7f300c0b6090 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x559615b32360 tx=0x7f3018004730 comp rx=0 tx=0).stop 2024-08-20T01:40:59.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.672+0000 7f302a4f0640 1 -- 172.21.15.79:0/3624917592 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3024108e40 msgr2=0x7f302419e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:40:59.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.672+0000 7f302a4f0640 1 --2- 172.21.15.79:0/3624917592 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3024108e40 0x7f302419e770 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f301c005e30 tx=0x7f301c0093d0 comp rx=0 tx=0).stop 2024-08-20T01:40:59.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.672+0000 7f302a4f0640 1 -- 172.21.15.79:0/3624917592 shutdown_connections 2024-08-20T01:40:59.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.672+0000 7f302a4f0640 1 --2- 172.21.15.79:0/3624917592 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3024108e40 0x7f302419e770 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:59.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.672+0000 7f302a4f0640 1 --2- 172.21.15.79:0/3624917592 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f300c0b3bd0 0x7f300c0b6090 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:59.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.672+0000 7f302a4f0640 1 --2- 172.21.15.79:0/3624917592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30241084c0 0x7f30241993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:59.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.672+0000 7f302a4f0640 1 --2- 172.21.15.79:0/3624917592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3024102ab0 0x7f3024198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:40:59.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.672+0000 7f302a4f0640 1 -- 172.21.15.79:0/3624917592 >> 172.21.15.79:0/3624917592 conn(0x7f30240fe520 msgr2=0x7f3024100910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:40:59.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.672+0000 7f302a4f0640 1 -- 172.21.15.79:0/3624917592 shutdown_connections 2024-08-20T01:40:59.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:40:59.672+0000 7f302a4f0640 1 -- 172.21.15.79:0/3624917592 wait complete. 2024-08-20T01:41:00.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:00 smithi175 ceph-mon[22392]: pgmap v457: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 29 MiB/s wr, 25 op/s 2024-08-20T01:41:00.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:00 smithi175 ceph-mon[22392]: scrub queued for path: / 2024-08-20T01:41:00.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:00 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:00.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:00 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:41:00.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:00 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:41:00.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:00 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:00.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:00 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:41:00.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:00 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:41:00.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:00 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:00.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:00 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:00.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:00 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:00.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:00 smithi079 ceph-mon[18656]: pgmap v457: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 29 MiB/s wr, 25 op/s 2024-08-20T01:41:00.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:00 smithi079 ceph-mon[18656]: scrub queued for path: / 2024-08-20T01:41:00.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:00 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:00.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:00 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:41:00.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:00 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:41:00.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:00 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:00.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:00 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:41:00.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:00 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:41:00.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:00 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:00.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:00 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:00.438 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:00 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:00.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:00 smithi081 ceph-mon[22209]: pgmap v457: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 29 MiB/s wr, 25 op/s 2024-08-20T01:41:00.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:00 smithi081 ceph-mon[22209]: scrub queued for path: / 2024-08-20T01:41:00.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:00 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:00.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:00 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:41:00.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:00 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:41:00.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:00 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:00.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:00 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:41:00.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:00 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:41:00.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:00 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:00.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:00 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:00.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:00 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:00.575 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:41:00.845 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:41:01.275 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:01 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:41:01.275 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:01 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:01.275 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:01 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:41:01.275 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:01 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:01.275 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:01 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:41:01.275 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:01 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:01.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.363+0000 7fe022844640 1 -- 172.21.15.79:0/1682326934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe01c1084a0 msgr2=0x7fe01c1088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:01.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.363+0000 7fe022844640 1 --2- 172.21.15.79:0/1682326934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe01c1084a0 0x7fe01c1088e0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fe004009900 tx=0x7fe00402a410 comp rx=0 tx=0).stop 2024-08-20T01:41:01.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.364+0000 7fe022844640 1 -- 172.21.15.79:0/1682326934 shutdown_connections 2024-08-20T01:41:01.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.364+0000 7fe022844640 1 --2- 172.21.15.79:0/1682326934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe01c108e20 0x7fe01c10f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:01.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.364+0000 7fe022844640 1 --2- 172.21.15.79:0/1682326934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe01c1084a0 0x7fe01c1088e0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:01.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.364+0000 7fe022844640 1 --2- 172.21.15.79:0/1682326934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe01c102a90 0x7fe01c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:01.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.364+0000 7fe022844640 1 -- 172.21.15.79:0/1682326934 >> 172.21.15.79:0/1682326934 conn(0x7fe01c0fe540 msgr2=0x7fe01c100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:01.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.364+0000 7fe022844640 1 -- 172.21.15.79:0/1682326934 shutdown_connections 2024-08-20T01:41:01.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.364+0000 7fe022844640 1 -- 172.21.15.79:0/1682326934 wait complete. 2024-08-20T01:41:01.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.364+0000 7fe022844640 1 Processor -- start 2024-08-20T01:41:01.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.364+0000 7fe022844640 1 -- start start 2024-08-20T01:41:01.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.365+0000 7fe022844640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe01c102a90 0x7fe01c198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:01.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.365+0000 7fe022844640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe01c1084a0 0x7fe01c1993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:01.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.365+0000 7fe022844640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe01c108e20 0x7fe01c19e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:01.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.365+0000 7fe022844640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe01c112950 con 0x7fe01c108e20 2024-08-20T01:41:01.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.365+0000 7fe022844640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe01c1127d0 con 0x7fe01c1084a0 2024-08-20T01:41:01.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.365+0000 7fe022844640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe01c112ad0 con 0x7fe01c102a90 2024-08-20T01:41:01.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.365+0000 7fe020de1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe01c108e20 0x7fe01c19e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:01.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.365+0000 7fe020de1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe01c108e20 0x7fe01c19e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57394/0 (socket says 172.21.15.79:57394) 2024-08-20T01:41:01.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.365+0000 7fe020de1640 1 -- 172.21.15.79:0/3582802810 learned_addr learned my addr 172.21.15.79:0/3582802810 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:01.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.365+0000 7fe013fff640 1 --2- 172.21.15.79:0/3582802810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe01c1084a0 0x7fe01c1993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:01.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.365+0000 7fe01bfff640 1 --2- 172.21.15.79:0/3582802810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe01c102a90 0x7fe01c198e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:01.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.365+0000 7fe020de1640 1 -- 172.21.15.79:0/3582802810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe01c102a90 msgr2=0x7fe01c198e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:01.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.365+0000 7fe020de1640 1 --2- 172.21.15.79:0/3582802810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe01c102a90 0x7fe01c198e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:01.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.365+0000 7fe020de1640 1 -- 172.21.15.79:0/3582802810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe01c1084a0 msgr2=0x7fe01c1993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:01.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.365+0000 7fe020de1640 1 --2- 172.21.15.79:0/3582802810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe01c1084a0 0x7fe01c1993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:01.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.365+0000 7fe020de1640 1 -- 172.21.15.79:0/3582802810 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe01c19ef30 con 0x7fe01c108e20 2024-08-20T01:41:01.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.365+0000 7fe020de1640 1 --2- 172.21.15.79:0/3582802810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe01c108e20 0x7fe01c19e760 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fe01400eb10 tx=0x7fe01400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:01.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.366+0000 7fe019ffb640 1 -- 172.21.15.79:0/3582802810 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe014004b20 con 0x7fe01c108e20 2024-08-20T01:41:01.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.366+0000 7fe022844640 1 -- 172.21.15.79:0/3582802810 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe01c19f220 con 0x7fe01c108e20 2024-08-20T01:41:01.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.366+0000 7fe019ffb640 1 -- 172.21.15.79:0/3582802810 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe014004cc0 con 0x7fe01c108e20 2024-08-20T01:41:01.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.366+0000 7fe019ffb640 1 -- 172.21.15.79:0/3582802810 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe014010690 con 0x7fe01c108e20 2024-08-20T01:41:01.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.366+0000 7fe022844640 1 -- 172.21.15.79:0/3582802810 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe01c1a5ab0 con 0x7fe01c108e20 2024-08-20T01:41:01.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.368+0000 7fe019ffb640 1 -- 172.21.15.79:0/3582802810 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fe014005020 con 0x7fe01c108e20 2024-08-20T01:41:01.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.369+0000 7fe024c3d740 1 Processor -- start 2024-08-20T01:41:01.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.369+0000 7fe024c3d740 1 -- start start 2024-08-20T01:41:01.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.369+0000 7fe019ffb640 1 --2- 172.21.15.79:0/3582802810 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe0080b3c50 0x7fe0080b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:01.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.370+0000 7fe024c3d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0942b4830 0x55d0942b4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:01.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.370+0000 7fe024c3d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0942b5150 0x55d0942c4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:01.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.370+0000 7fe024c3d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0942c54f0 0x55d0942c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:01.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.370+0000 7fe024c3d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d09422b8e0 con 0x55d0942b5150 2024-08-20T01:41:01.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.370+0000 7fe024c3d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d09421ade0 con 0x55d0942b4830 2024-08-20T01:41:01.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.370+0000 7fe024c3d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d09421ee20 con 0x55d0942c54f0 2024-08-20T01:41:01.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.370+0000 7fe013fff640 1 --2- 172.21.15.79:0/3582802810 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe0080b3c50 0x7fe0080b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:01.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.370+0000 7fe019ffb640 1 -- 172.21.15.79:0/3582802810 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fe0140e4170 con 0x7fe01c108e20 2024-08-20T01:41:01.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.370+0000 7fe013fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0942b5150 0x55d0942c4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:01.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.370+0000 7fe013fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0942b5150 0x55d0942c4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57408/0 (socket says 172.21.15.79:57408) 2024-08-20T01:41:01.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.370+0000 7fe013fff640 1 -- 172.21.15.79:0/730143116 learned_addr learned my addr 172.21.15.79:0/730143116 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:01.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.370+0000 7fe020de1640 1 --2- 172.21.15.79:0/730143116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0942c54f0 0x55d0942c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:01.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.370+0000 7fe01bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0942b4830 0x55d0942b4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:01.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.370+0000 7fe020de1640 1 -- 172.21.15.79:0/730143116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0942b4830 msgr2=0x55d0942b4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:01.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.370+0000 7fe020de1640 1 --2- 172.21.15.79:0/730143116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0942b4830 0x55d0942b4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:01.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.370+0000 7fe020de1640 1 -- 172.21.15.79:0/730143116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0942b5150 msgr2=0x55d0942c4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:01.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.370+0000 7fe020de1640 1 --2- 172.21.15.79:0/730143116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0942b5150 0x55d0942c4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:01.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.370+0000 7fe020de1640 1 -- 172.21.15.79:0/730143116 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d093f7a650 con 0x55d0942c54f0 2024-08-20T01:41:01.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.370+0000 7fe013fff640 1 --2- 172.21.15.79:0/3582802810 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe0080b3c50 0x7fe0080b6110 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe0040096c0 tx=0x7fe004005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:01.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.371+0000 7fe020de1640 1 --2- 172.21.15.79:0/730143116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0942c54f0 0x55d0942c78e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe014000f80 tx=0x7fe0140aaf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0243a1bb4384470 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:01.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.371+0000 7fe0127fc640 1 -- 172.21.15.79:0/730143116 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0140ab7d0 con 0x55d0942c54f0 2024-08-20T01:41:01.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.371+0000 7fe0127fc640 1 -- 172.21.15.79:0/730143116 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0140ab0d0 con 0x55d0942c54f0 2024-08-20T01:41:01.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.371+0000 7fe0127fc640 1 -- 172.21.15.79:0/730143116 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0140ab590 con 0x55d0942c54f0 2024-08-20T01:41:01.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.371+0000 7fe024c3d740 1 -- 172.21.15.79:0/730143116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0942c54f0 msgr2=0x55d0942c78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:01.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.371+0000 7fe024c3d740 1 --2- 172.21.15.79:0/730143116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0942c54f0 0x55d0942c78e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe014000f80 tx=0x7fe0140aaf60 comp rx=0 tx=0).stop 2024-08-20T01:41:01.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.372+0000 7fe024c3d740 1 -- 172.21.15.79:0/730143116 shutdown_connections 2024-08-20T01:41:01.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.372+0000 7fe024c3d740 1 --2- 172.21.15.79:0/730143116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0942c54f0 0x55d0942c78e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:01.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.372+0000 7fe024c3d740 1 --2- 172.21.15.79:0/730143116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0942b5150 0x55d0942c4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:01.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.372+0000 7fe024c3d740 1 --2- 172.21.15.79:0/730143116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0942b4830 0x55d0942b4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:01.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.372+0000 7fe024c3d740 1 -- 172.21.15.79:0/730143116 >> 172.21.15.79:0/730143116 conn(0x55d0942b2660 msgr2=0x55d0942b3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:01.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.372+0000 7fe024c3d740 1 -- 172.21.15.79:0/730143116 shutdown_connections 2024-08-20T01:41:01.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.372+0000 7fe024c3d740 1 -- 172.21.15.79:0/730143116 wait complete. 2024-08-20T01:41:01.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.372+0000 7fe024c3d740 1 -- start start 2024-08-20T01:41:01.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.372+0000 7fe024c3d740 1 Processor -- start 2024-08-20T01:41:01.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.373+0000 7fe024c3d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0942b4830 0x55d0942c4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:01.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.373+0000 7fe024c3d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0942b5150 0x55d0942c2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:01.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.373+0000 7fe024c3d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0942c54f0 0x55d0942c2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:01.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.373+0000 7fe024c3d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d09407d700 con 0x55d0942b5150 2024-08-20T01:41:01.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.373+0000 7fe024c3d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d0941a17c0 con 0x55d0942b4830 2024-08-20T01:41:01.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.373+0000 7fe024c3d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d0942c81a0 con 0x55d0942c54f0 2024-08-20T01:41:01.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.373+0000 7fe024c3d740 10 client.0 _ll_register_callbacks cb 0x55d0942146b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:01.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.373+0000 7fe013fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0942b5150 0x55d0942c2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:01.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.373+0000 7fe013fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0942b5150 0x55d0942c2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57412/0 (socket says 172.21.15.79:57412) 2024-08-20T01:41:01.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.373+0000 7fe013fff640 1 -- 172.21.15.79:0/219058322 learned_addr learned my addr 172.21.15.79:0/219058322 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:01.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.373+0000 7fe01bfff640 1 --2- 172.21.15.79:0/219058322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0942b4830 0x55d0942c4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:01.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.373+0000 7fe013fff640 1 -- 172.21.15.79:0/219058322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0942c54f0 msgr2=0x55d0942c2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:01.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.373+0000 7fe020de1640 1 --2- 172.21.15.79:0/219058322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0942c54f0 0x55d0942c2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:01.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.373+0000 7fe013fff640 1 --2- 172.21.15.79:0/219058322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0942c54f0 0x55d0942c2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:01.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.373+0000 7fe013fff640 1 -- 172.21.15.79:0/219058322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0942b4830 msgr2=0x55d0942c4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:01.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.373+0000 7fe013fff640 1 --2- 172.21.15.79:0/219058322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0942b4830 0x55d0942c4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:01.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.373+0000 7fe013fff640 1 -- 172.21.15.79:0/219058322 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0942d14d0 con 0x55d0942b5150 2024-08-20T01:41:01.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.373+0000 7fe013fff640 1 --2- 172.21.15.79:0/219058322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0942b5150 0x55d0942c2390 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fe0040057c0 tx=0x7fe0040058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae87b6d765cde102 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:01.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.373+0000 7fdffb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:41:01.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.374+0000 7fe020de1640 1 --2- 172.21.15.79:0/219058322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0942c54f0 0x55d0942c2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:41:01.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.374+0000 7fdffb7fe640 1 -- 172.21.15.79:0/219058322 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe004035040 con 0x55d0942b5150 2024-08-20T01:41:01.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.374+0000 7fdffb7fe640 1 -- 172.21.15.79:0/219058322 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fe0040035f0 con 0x55d0942b5150 2024-08-20T01:41:01.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.374+0000 7fe024c3d740 1 -- 172.21.15.79:0/219058322 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d0941ca100 con 0x55d0942b5150 2024-08-20T01:41:01.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.374+0000 7fdffb7fe640 1 -- 172.21.15.79:0/219058322 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fe0040037f0 con 0x55d0942b5150 2024-08-20T01:41:01.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.374+0000 7fe024c3d740 10 client.16743 fetch_fsmap learned FSMap version 37 2024-08-20T01:41:01.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.374+0000 7fe024c3d740 1 -- 172.21.15.79:0/219058322 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55d0942d3e00 con 0x55d0942b5150 2024-08-20T01:41:01.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.374+0000 7fdffb7fe640 1 -- 172.21.15.79:0/219058322 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55d0941ca100 con 0x55d0942b5150 2024-08-20T01:41:01.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.374+0000 7fdffb7fe640 1 -- 172.21.15.79:0/219058322 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 37) ==== 8366+0+0 (secure 0 0 0) 0x7fe0040528d0 con 0x55d0942b5150 2024-08-20T01:41:01.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.375+0000 7fe024c3d740 10 client.16743 fetch_fsmap finished waiting for FSMap version 37 2024-08-20T01:41:01.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.375+0000 7fe024c3d740 10 client.16743 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:41:01.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.375+0000 7fe024c3d740 20 client.16743 populate_metadata read hostname 'smithi079' 2024-08-20T01:41:01.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.375+0000 7fe024c3d740 1 --2- 172.21.15.79:0/219058322 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d0942d5560 0x55d0942d79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:01.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.375+0000 7fe024c3d740 4 client.16743 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:41:01.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.375+0000 7fe024c3d740 1 -- 172.21.15.79:0/219058322 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d09422d830 con 0x55d0942d5560 2024-08-20T01:41:01.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.375+0000 7fe01bfff640 1 --2- 172.21.15.79:0/219058322 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d0942d5560 0x55d0942d79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:01.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.375+0000 7fe01bfff640 1 --2- 172.21.15.79:0/219058322 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d0942d5560 0x55d0942d79c0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=681545d578e42339 server_cookie=a71ba5acf3c8239c in_seq=0 out_seq=0 2024-08-20T01:41:01.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.375+0000 7fdffb7fe640 10 client.16743 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:41:01.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.376+0000 7fdffb7fe640 1 -- 172.21.15.79:0/219058322 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d09422d830 con 0x55d0942d5560 2024-08-20T01:41:01.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.376+0000 7fdffb7fe640 10 client.16743 handle_command_reply: tid=0 2024-08-20T01:41:01.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.376+0000 7fe024c3d740 1 client.16743 shutdown 2024-08-20T01:41:01.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.376+0000 7fe024c3d740 1 -- 172.21.15.79:0/219058322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0942b5150 msgr2=0x55d0942c2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:01.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.376+0000 7fe024c3d740 1 --2- 172.21.15.79:0/219058322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0942b5150 0x55d0942c2390 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fe0040057c0 tx=0x7fe0040058d0 comp rx=0 tx=0).stop 2024-08-20T01:41:01.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.376+0000 7fe024c3d740 1 -- 172.21.15.79:0/219058322 shutdown_connections 2024-08-20T01:41:01.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.376+0000 7fe024c3d740 1 --2- 172.21.15.79:0/219058322 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d0942d5560 0x55d0942d79c0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:01.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.376+0000 7fe024c3d740 1 --2- 172.21.15.79:0/219058322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0942c54f0 0x55d0942c2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:01.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.376+0000 7fe024c3d740 1 --2- 172.21.15.79:0/219058322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0942b5150 0x55d0942c2390 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:01.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.376+0000 7fe024c3d740 1 --2- 172.21.15.79:0/219058322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0942b4830 0x55d0942c4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:01.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.376+0000 7fe024c3d740 1 -- 172.21.15.79:0/219058322 >> 172.21.15.79:0/219058322 conn(0x55d0942b2660 msgr2=0x55d0942b8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:01.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.376+0000 7fdffb7fe640 0 client.16743 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:41:01.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.376+0000 7fe024c3d740 1 -- 172.21.15.79:0/219058322 shutdown_connections 2024-08-20T01:41:01.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.377+0000 7fe024c3d740 1 -- 172.21.15.79:0/219058322 wait complete. 2024-08-20T01:41:01.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.377+0000 7fe024c3d740 20 client.16743 trim_cache size 0 max 16384 2024-08-20T01:41:01.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:01 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:41:01.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:01 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:01.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:01 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:41:01.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:01 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:01.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:01 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:41:01.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:01 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:01.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.397+0000 7fe024c3d740 1 Processor -- start 2024-08-20T01:41:01.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.397+0000 7fe024c3d740 1 -- start start 2024-08-20T01:41:01.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.397+0000 7fe024c3d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0942b4830 0x55d0942bff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:01.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.397+0000 7fe024c3d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0942b5150 0x55d0942c40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:01.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.397+0000 7fe024c3d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0942c54f0 0x55d0942c1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:01.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.397+0000 7fe024c3d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe01c1abd70 con 0x55d0942b4830 2024-08-20T01:41:01.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.397+0000 7fe024c3d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe01c1ad8e0 con 0x55d0942c54f0 2024-08-20T01:41:01.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.397+0000 7fe024c3d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe01c1ac440 con 0x55d0942b5150 2024-08-20T01:41:01.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.398+0000 7fe01bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0942b4830 0x55d0942bff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:01.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.398+0000 7fe01bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0942b4830 0x55d0942bff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57428/0 (socket says 172.21.15.79:57428) 2024-08-20T01:41:01.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.398+0000 7fe01bfff640 1 -- 172.21.15.79:0/2520856837 learned_addr learned my addr 172.21.15.79:0/2520856837 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:01.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.398+0000 7fe01bfff640 1 -- 172.21.15.79:0/2520856837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0942b5150 msgr2=0x55d0942c40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:01.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.398+0000 7fe01bfff640 1 --2- 172.21.15.79:0/2520856837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0942b5150 0x55d0942c40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:01.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.398+0000 7fe01bfff640 1 -- 172.21.15.79:0/2520856837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0942c54f0 msgr2=0x55d0942c1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:01.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.398+0000 7fe01bfff640 1 --2- 172.21.15.79:0/2520856837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0942c54f0 0x55d0942c1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:01.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.398+0000 7fe01bfff640 1 -- 172.21.15.79:0/2520856837 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0942c2e90 con 0x55d0942b4830 2024-08-20T01:41:01.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.398+0000 7fe01bfff640 1 --2- 172.21.15.79:0/2520856837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0942b4830 0x55d0942bff80 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fe00c000c00 tx=0x7fe00c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55706d69ba7e3ce1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:01.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.398+0000 7fe011ffb640 1 -- 172.21.15.79:0/2520856837 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00c004250 con 0x55d0942b4830 2024-08-20T01:41:01.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.399+0000 7fe011ffb640 1 -- 172.21.15.79:0/2520856837 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe00c0043f0 con 0x55d0942b4830 2024-08-20T01:41:01.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.399+0000 7fe011ffb640 1 -- 172.21.15.79:0/2520856837 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00c01f8d0 con 0x55d0942b4830 2024-08-20T01:41:01.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.399+0000 7fe024c3d740 1 -- 172.21.15.79:0/2520856837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0942b4830 msgr2=0x55d0942bff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:01.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.399+0000 7fe024c3d740 1 --2- 172.21.15.79:0/2520856837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0942b4830 0x55d0942bff80 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fe00c000c00 tx=0x7fe00c005f90 comp rx=0 tx=0).stop 2024-08-20T01:41:01.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.399+0000 7fe024c3d740 1 -- 172.21.15.79:0/2520856837 shutdown_connections 2024-08-20T01:41:01.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.399+0000 7fe024c3d740 1 --2- 172.21.15.79:0/2520856837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0942c54f0 0x55d0942c1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:01.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.399+0000 7fe024c3d740 1 --2- 172.21.15.79:0/2520856837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0942b5150 0x55d0942c40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:01.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.399+0000 7fe024c3d740 1 --2- 172.21.15.79:0/2520856837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0942b4830 0x55d0942bff80 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:01.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.399+0000 7fe024c3d740 1 -- 172.21.15.79:0/2520856837 >> 172.21.15.79:0/2520856837 conn(0x55d0942b2660 msgr2=0x55d0942c39c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:01.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.400+0000 7fe024c3d740 1 -- 172.21.15.79:0/2520856837 shutdown_connections 2024-08-20T01:41:01.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.400+0000 7fe024c3d740 1 -- 172.21.15.79:0/2520856837 wait complete. 2024-08-20T01:41:01.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.400+0000 7fe024c3d740 1 -- start start 2024-08-20T01:41:01.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.400+0000 7fe024c3d740 1 Processor -- start 2024-08-20T01:41:01.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.401+0000 7fe024c3d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0942b4830 0x55d0942da7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:01.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.401+0000 7fe024c3d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0942b5150 0x55d0942dace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:01.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.401+0000 7fe024c3d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0942c54f0 0x55d09433e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:01.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.401+0000 7fe024c3d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe01c1ad210 con 0x55d0942c54f0 2024-08-20T01:41:01.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.401+0000 7fe024c3d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe01c1acb10 con 0x55d0942b4830 2024-08-20T01:41:01.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.401+0000 7fe024c3d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe01c1a9d50 con 0x55d0942b5150 2024-08-20T01:41:01.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.401+0000 7fe024c3d740 10 client.0 _ll_register_callbacks cb 0x7fe004031480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:01.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.401+0000 7fe020de1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0942c54f0 0x55d09433e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:01.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.401+0000 7fe020de1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0942c54f0 0x55d09433e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57444/0 (socket says 172.21.15.79:57444) 2024-08-20T01:41:01.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.401+0000 7fe020de1640 1 -- 172.21.15.79:0/1358061343 learned_addr learned my addr 172.21.15.79:0/1358061343 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:01.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.401+0000 7fe013fff640 1 --2- 172.21.15.79:0/1358061343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0942b5150 0x55d0942dace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:01.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.401+0000 7fe01bfff640 1 --2- 172.21.15.79:0/1358061343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0942b4830 0x55d0942da7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:01.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.401+0000 7fe020de1640 1 -- 172.21.15.79:0/1358061343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0942b5150 msgr2=0x55d0942dace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:01.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.401+0000 7fe020de1640 1 --2- 172.21.15.79:0/1358061343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0942b5150 0x55d0942dace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:01.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.401+0000 7fe020de1640 1 -- 172.21.15.79:0/1358061343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0942b4830 msgr2=0x55d0942da7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:01.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.401+0000 7fe020de1640 1 --2- 172.21.15.79:0/1358061343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0942b4830 0x55d0942da7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:01.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.401+0000 7fe020de1640 1 -- 172.21.15.79:0/1358061343 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d09433e650 con 0x55d0942c54f0 2024-08-20T01:41:01.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.401+0000 7fe01bfff640 1 --2- 172.21.15.79:0/1358061343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0942b4830 0x55d0942da7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:41:01.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.402+0000 7fe020de1640 1 --2- 172.21.15.79:0/1358061343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0942c54f0 0x55d09433e040 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fe0140e1cd0 tx=0x7fe0140ab5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e23289093ebfb6c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:01.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.402+0000 7fdffb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:41:01.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.402+0000 7fdffb7fe640 1 -- 172.21.15.79:0/1358061343 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0140ca060 con 0x55d0942c54f0 2024-08-20T01:41:01.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.402+0000 7fe024c3d740 1 -- 172.21.15.79:0/1358061343 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe00c0043f0 con 0x55d0942c54f0 2024-08-20T01:41:01.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.402+0000 7fdffb7fe640 1 -- 172.21.15.79:0/1358061343 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fe0140a76c0 con 0x55d0942c54f0 2024-08-20T01:41:01.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.402+0000 7fdffb7fe640 1 -- 172.21.15.79:0/1358061343 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fe0140c4030 con 0x55d0942c54f0 2024-08-20T01:41:01.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.402+0000 7fe024c3d740 10 client.16749 fetch_fsmap learned FSMap version 37 2024-08-20T01:41:01.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.402+0000 7fe024c3d740 1 -- 172.21.15.79:0/1358061343 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55d09433f960 con 0x55d0942c54f0 2024-08-20T01:41:01.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.402+0000 7fdffb7fe640 1 -- 172.21.15.79:0/1358061343 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe00c0043f0 con 0x55d0942c54f0 2024-08-20T01:41:01.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.402+0000 7fdffb7fe640 1 -- 172.21.15.79:0/1358061343 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 37) ==== 8366+0+0 (secure 0 0 0) 0x7fe0140a6a40 con 0x55d0942c54f0 2024-08-20T01:41:01.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.403+0000 7fe024c3d740 10 client.16749 fetch_fsmap finished waiting for FSMap version 37 2024-08-20T01:41:01.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.403+0000 7fe024c3d740 10 client.16749 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:41:01.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.403+0000 7fe024c3d740 20 client.16749 populate_metadata read hostname 'smithi079' 2024-08-20T01:41:01.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.403+0000 7fe024c3d740 1 --2- 172.21.15.79:0/1358061343 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d09433fc90 0x55d094342080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:01.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.403+0000 7fe024c3d740 4 client.16749 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:41:01.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.403+0000 7fe024c3d740 1 -- 172.21.15.79:0/1358061343 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d0942292d0 con 0x55d09433fc90 2024-08-20T01:41:01.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.403+0000 7fe01bfff640 1 --2- 172.21.15.79:0/1358061343 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d09433fc90 0x55d094342080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:01.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.403+0000 7fe01bfff640 1 --2- 172.21.15.79:0/1358061343 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d09433fc90 0x55d094342080 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee943cb251eca9f5 server_cookie=33644310294d4aa3 in_seq=0 out_seq=0 2024-08-20T01:41:01.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.403+0000 7fdffb7fe640 10 client.16749 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:41:01.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.404+0000 7fdffb7fe640 1 -- 172.21.15.79:0/1358061343 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55d0942292d0 con 0x55d09433fc90 2024-08-20T01:41:01.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.404+0000 7fdffb7fe640 10 client.16749 handle_command_reply: tid=0 2024-08-20T01:41:01.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.404+0000 7fe024c3d740 1 client.16749 shutdown 2024-08-20T01:41:01.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.404+0000 7fe024c3d740 1 -- 172.21.15.79:0/1358061343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0942c54f0 msgr2=0x55d09433e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:01.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.404+0000 7fe024c3d740 1 --2- 172.21.15.79:0/1358061343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0942c54f0 0x55d09433e040 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fe0140e1cd0 tx=0x7fe0140ab5e0 comp rx=0 tx=0).stop 2024-08-20T01:41:01.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.404+0000 7fe024c3d740 1 -- 172.21.15.79:0/1358061343 shutdown_connections 2024-08-20T01:41:01.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.404+0000 7fe024c3d740 1 --2- 172.21.15.79:0/1358061343 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d09433fc90 0x55d094342080 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:01.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.404+0000 7fe024c3d740 1 --2- 172.21.15.79:0/1358061343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d0942c54f0 0x55d09433e040 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:01.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.404+0000 7fe024c3d740 1 --2- 172.21.15.79:0/1358061343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0942b5150 0x55d0942dace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:01.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.404+0000 7fe024c3d740 1 --2- 172.21.15.79:0/1358061343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0942b4830 0x55d0942da7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:01.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.404+0000 7fe024c3d740 1 -- 172.21.15.79:0/1358061343 >> 172.21.15.79:0/1358061343 conn(0x55d0942b2660 msgr2=0x55d0942c41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:01.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.404+0000 7fdffb7fe640 0 client.16749 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:41:01.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.404+0000 7fe024c3d740 1 -- 172.21.15.79:0/1358061343 shutdown_connections 2024-08-20T01:41:01.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.404+0000 7fe024c3d740 1 -- 172.21.15.79:0/1358061343 wait complete. 2024-08-20T01:41:01.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.404+0000 7fe024c3d740 20 client.16749 trim_cache size 0 max 16384 2024-08-20T01:41:01.414 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:41:01.414 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-20T01:41:01.414 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": { 2024-08-20T01:41:01.414 INFO:teuthology.orchestra.run.smithi079.stdout: "02179b41-8552-4983-b7a3-49ed838a9d64": { 2024-08-20T01:41:01.414 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/", 2024-08-20T01:41:01.414 INFO:teuthology.orchestra.run.smithi079.stdout: "tag": "02179b41-8552-4983-b7a3-49ed838a9d64", 2024-08-20T01:41:01.415 INFO:teuthology.orchestra.run.smithi079.stdout: "options": "recursive,force" 2024-08-20T01:41:01.415 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:41:01.415 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:41:01.415 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:41:01.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.405+0000 7fe022844640 1 -- 172.21.15.79:0/3582802810 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe0080b3c50 msgr2=0x7fe0080b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:01.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.405+0000 7fe022844640 1 --2- 172.21.15.79:0/3582802810 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe0080b3c50 0x7fe0080b6110 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe0040096c0 tx=0x7fe004005fd0 comp rx=0 tx=0).stop 2024-08-20T01:41:01.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.405+0000 7fe022844640 1 -- 172.21.15.79:0/3582802810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe01c108e20 msgr2=0x7fe01c19e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:01.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.405+0000 7fe022844640 1 --2- 172.21.15.79:0/3582802810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe01c108e20 0x7fe01c19e760 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fe01400eb10 tx=0x7fe01400c2d0 comp rx=0 tx=0).stop 2024-08-20T01:41:01.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.405+0000 7fe022844640 1 -- 172.21.15.79:0/3582802810 shutdown_connections 2024-08-20T01:41:01.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.405+0000 7fe022844640 1 --2- 172.21.15.79:0/3582802810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe01c108e20 0x7fe01c19e760 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:01.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.405+0000 7fe022844640 1 --2- 172.21.15.79:0/3582802810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe01c1084a0 0x7fe01c1993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:01.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.405+0000 7fe022844640 1 --2- 172.21.15.79:0/3582802810 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe0080b3c50 0x7fe0080b6110 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:01.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.405+0000 7fe022844640 1 --2- 172.21.15.79:0/3582802810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe01c102a90 0x7fe01c198e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:01.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.405+0000 7fe022844640 1 -- 172.21.15.79:0/3582802810 >> 172.21.15.79:0/3582802810 conn(0x7fe01c0fe540 msgr2=0x7fe01c100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:01.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.405+0000 7fe022844640 1 -- 172.21.15.79:0/3582802810 shutdown_connections 2024-08-20T01:41:01.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:01.405+0000 7fe022844640 1 -- 172.21.15.79:0/3582802810 wait complete. 2024-08-20T01:41:01.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:01 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:41:01.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:01 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:01.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:01 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:41:01.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:01 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:01.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:01 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:41:01.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:01 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:02.294 INFO:tasks.cephfs.filesystem:scrub status for tag:02179b41-8552-4983-b7a3-49ed838a9d64 - {'path': '/', 'tag': '02179b41-8552-4983-b7a3-49ed838a9d64', 'options': 'recursive,force'} 2024-08-20T01:41:02.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:02 smithi175 ceph-mon[22392]: pgmap v458: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 26 op/s 2024-08-20T01:41:02.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:02 smithi079 ceph-mon[18656]: pgmap v458: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 26 op/s 2024-08-20T01:41:02.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:02 smithi081 ceph-mon[22209]: pgmap v458: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 26 op/s 2024-08-20T01:41:04.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:04 smithi175 ceph-mon[22392]: pgmap v459: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 MiB/s wr, 33 op/s 2024-08-20T01:41:04.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:04 smithi079 ceph-mon[18656]: pgmap v459: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 MiB/s wr, 33 op/s 2024-08-20T01:41:04.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:04 smithi081 ceph-mon[22209]: pgmap v459: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 MiB/s wr, 33 op/s 2024-08-20T01:41:06.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:06 smithi175 ceph-mon[22392]: pgmap v460: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 27 MiB/s wr, 49 op/s 2024-08-20T01:41:06.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:06 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:41:06.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:06 smithi079 ceph-mon[18656]: pgmap v460: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 27 MiB/s wr, 49 op/s 2024-08-20T01:41:06.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:06 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:41:06.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:06 smithi081 ceph-mon[22209]: pgmap v460: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 27 MiB/s wr, 49 op/s 2024-08-20T01:41:06.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:06 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:41:07.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:07 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:41:07.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:07 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:41:07.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:07 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:41:07.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:07 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:41:07.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:07 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:41:07.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:07 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:41:07.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:07 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:41:07.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:07 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:41:07.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:07 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:41:08.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:08 smithi079 ceph-mon[18656]: pgmap v461: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 26 MiB/s wr, 46 op/s 2024-08-20T01:41:08.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:08 smithi081 ceph-mon[22209]: pgmap v461: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 26 MiB/s wr, 46 op/s 2024-08-20T01:41:08.612 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.608+0000 7f9079415640 1 -- 172.21.15.79:0/659885249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9074101560 msgr2=0x7f9074101960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:08.613 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.608+0000 7f9079415640 1 --2- 172.21.15.79:0/659885249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9074101560 0x7f9074101960 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f9064009930 tx=0x7f906402a420 comp rx=0 tx=0).stop 2024-08-20T01:41:08.613 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.608+0000 7f9079415640 1 -- 172.21.15.79:0/659885249 shutdown_connections 2024-08-20T01:41:08.613 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.608+0000 7f9079415640 1 --2- 172.21.15.79:0/659885249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9074103070 0x7f90741099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:08.613 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.608+0000 7f9079415640 1 --2- 172.21.15.79:0/659885249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90741026b0 0x7f9074102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:08.613 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.608+0000 7f9079415640 1 --2- 172.21.15.79:0/659885249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9074101560 0x7f9074101960 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:08.613 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.608+0000 7f9079415640 1 -- 172.21.15.79:0/659885249 >> 172.21.15.79:0/659885249 conn(0x7f90740fce40 msgr2=0x7f90740ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:08.613 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.608+0000 7f9079415640 1 -- 172.21.15.79:0/659885249 shutdown_connections 2024-08-20T01:41:08.613 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.608+0000 7f9079415640 1 -- 172.21.15.79:0/659885249 wait complete. 2024-08-20T01:41:08.613 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.609+0000 7f9079415640 1 Processor -- start 2024-08-20T01:41:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.609+0000 7f9079415640 1 -- start start 2024-08-20T01:41:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.609+0000 7f9079415640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9074101560 0x7f9074198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.609+0000 7f9079415640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90741026b0 0x7f9074198fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.609+0000 7f9079415640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9074103070 0x7f9074199c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.609+0000 7f9079415640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f907410d0b0 con 0x7f90741026b0 2024-08-20T01:41:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.609+0000 7f9079415640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f907410cf30 con 0x7f9074103070 2024-08-20T01:41:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.609+0000 7f9079415640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f907410d230 con 0x7f9074101560 2024-08-20T01:41:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.609+0000 7f90727fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90741026b0 0x7f9074198fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.609+0000 7f90727fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90741026b0 0x7f9074198fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57466/0 (socket says 172.21.15.79:57466) 2024-08-20T01:41:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.609+0000 7f90727fc640 1 -- 172.21.15.79:0/1869891726 learned_addr learned my addr 172.21.15.79:0/1869891726 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.609+0000 7f9072ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9074101560 0x7f9074198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.610+0000 7f90737fe640 1 --2- 172.21.15.79:0/1869891726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9074103070 0x7f9074199c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:08.615 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.610+0000 7f90727fc640 1 -- 172.21.15.79:0/1869891726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9074101560 msgr2=0x7f9074198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:08.615 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.610+0000 7f90727fc640 1 --2- 172.21.15.79:0/1869891726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9074101560 0x7f9074198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:08.615 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.610+0000 7f90727fc640 1 -- 172.21.15.79:0/1869891726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9074103070 msgr2=0x7f9074199c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:08.615 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.610+0000 7f90727fc640 1 --2- 172.21.15.79:0/1869891726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9074103070 0x7f9074199c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:08.615 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.610+0000 7f90727fc640 1 -- 172.21.15.79:0/1869891726 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f907419a4c0 con 0x7f90741026b0 2024-08-20T01:41:08.615 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.610+0000 7f90727fc640 1 --2- 172.21.15.79:0/1869891726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90741026b0 0x7f9074198fd0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f906800c920 tx=0x7f906800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:08.615 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.610+0000 7f905bfff640 1 -- 172.21.15.79:0/1869891726 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9068007c70 con 0x7f90741026b0 2024-08-20T01:41:08.615 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.610+0000 7f905bfff640 1 -- 172.21.15.79:0/1869891726 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9068007e10 con 0x7f90741026b0 2024-08-20T01:41:08.615 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.610+0000 7f905bfff640 1 -- 172.21.15.79:0/1869891726 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9068018710 con 0x7f90741026b0 2024-08-20T01:41:08.615 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.610+0000 7f9079415640 1 -- 172.21.15.79:0/1869891726 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f907419a7b0 con 0x7f90741026b0 2024-08-20T01:41:08.615 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.610+0000 7f9079415640 1 -- 172.21.15.79:0/1869891726 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90741a0e80 con 0x7f90741026b0 2024-08-20T01:41:08.621 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.613+0000 7f907c209740 1 Processor -- start 2024-08-20T01:41:08.622 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.613+0000 7f907c209740 1 -- start start 2024-08-20T01:41:08.622 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.613+0000 7f905bfff640 1 -- 172.21.15.79:0/1869891726 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f906800f450 con 0x7f90741026b0 2024-08-20T01:41:08.622 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.613+0000 7f907c209740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f865d658d0 0x55f865d67cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:08.622 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.613+0000 7f907c209740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f865d68200 0x55f865d6a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:08.622 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.613+0000 7f907c209740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f865d6ac40 0x55f865d6d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:08.622 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.613+0000 7f907c209740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f865cd8360 con 0x55f865d68200 2024-08-20T01:41:08.622 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.613+0000 7f907c209740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f865cc7860 con 0x55f865d658d0 2024-08-20T01:41:08.622 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.613+0000 7f907c209740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f865ccb8a0 con 0x55f865d6ac40 2024-08-20T01:41:08.622 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.613+0000 7f9072ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f865d68200 0x55f865d6a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:08.622 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.613+0000 7f9072ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f865d68200 0x55f865d6a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57476/0 (socket says 172.21.15.79:57476) 2024-08-20T01:41:08.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.613+0000 7f9072ffd640 1 -- 172.21.15.79:0/917530392 learned_addr learned my addr 172.21.15.79:0/917530392 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:08.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.613+0000 7f90737fe640 1 --2- 172.21.15.79:0/917530392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f865d658d0 0x55f865d67cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:08.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.613+0000 7f90727fc640 1 --2- 172.21.15.79:0/917530392 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f865d6ac40 0x55f865d6d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:08.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.614+0000 7f9072ffd640 1 -- 172.21.15.79:0/917530392 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f865d6ac40 msgr2=0x55f865d6d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:08.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.614+0000 7f9072ffd640 1 --2- 172.21.15.79:0/917530392 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f865d6ac40 0x55f865d6d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:08.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.614+0000 7f9072ffd640 1 -- 172.21.15.79:0/917530392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f865d658d0 msgr2=0x55f865d67cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:08.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.614+0000 7f9072ffd640 1 --2- 172.21.15.79:0/917530392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f865d658d0 0x55f865d67cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:08.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.614+0000 7f9072ffd640 1 -- 172.21.15.79:0/917530392 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f865c6ee40 con 0x55f865d68200 2024-08-20T01:41:08.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.614+0000 7f9072ffd640 1 --2- 172.21.15.79:0/917530392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f865d68200 0x55f865d6a5f0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f9064009900 tx=0x7f9064004200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b10fef7c562ab24d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:08.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.614+0000 7f905bfff640 1 --2- 172.21.15.79:0/1869891726 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f905c0b3bd0 0x7f905c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:08.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.614+0000 7f90597fa640 1 -- 172.21.15.79:0/917530392 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9064035030 con 0x55f865d68200 2024-08-20T01:41:08.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.614+0000 7f90597fa640 1 -- 172.21.15.79:0/917530392 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9064040070 con 0x55f865d68200 2024-08-20T01:41:08.624 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.614+0000 7f90597fa640 1 -- 172.21.15.79:0/917530392 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90640319a0 con 0x55f865d68200 2024-08-20T01:41:08.624 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.614+0000 7f90737fe640 1 --2- 172.21.15.79:0/1869891726 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f905c0b3bd0 0x7f905c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:08.624 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.614+0000 7f905bfff640 1 -- 172.21.15.79:0/1869891726 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f90680e3d40 con 0x7f90741026b0 2024-08-20T01:41:08.624 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.615+0000 7f907c209740 1 -- 172.21.15.79:0/917530392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f865d68200 msgr2=0x55f865d6a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:08.624 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.615+0000 7f90737fe640 1 --2- 172.21.15.79:0/1869891726 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f905c0b3bd0 0x7f905c0b6090 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9074199700 tx=0x7f906c009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:08.624 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.615+0000 7f907c209740 1 --2- 172.21.15.79:0/917530392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f865d68200 0x55f865d6a5f0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f9064009900 tx=0x7f9064004200 comp rx=0 tx=0).stop 2024-08-20T01:41:08.624 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.615+0000 7f907c209740 1 -- 172.21.15.79:0/917530392 shutdown_connections 2024-08-20T01:41:08.624 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.615+0000 7f907c209740 1 --2- 172.21.15.79:0/917530392 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f865d6ac40 0x55f865d6d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:08.624 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.615+0000 7f907c209740 1 --2- 172.21.15.79:0/917530392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f865d68200 0x55f865d6a5f0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:08.624 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.615+0000 7f907c209740 1 --2- 172.21.15.79:0/917530392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f865d658d0 0x55f865d67cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:08.624 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.615+0000 7f907c209740 1 -- 172.21.15.79:0/917530392 >> 172.21.15.79:0/917530392 conn(0x55f865d60a20 msgr2=0x55f865d617b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:08.624 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.615+0000 7f907c209740 1 -- 172.21.15.79:0/917530392 shutdown_connections 2024-08-20T01:41:08.625 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.615+0000 7f907c209740 1 -- 172.21.15.79:0/917530392 wait complete. 2024-08-20T01:41:08.625 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.615+0000 7f907c209740 1 -- start start 2024-08-20T01:41:08.625 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.615+0000 7f907c209740 1 Processor -- start 2024-08-20T01:41:08.625 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.616+0000 7f907c209740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f865d658d0 0x55f865d6f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:08.625 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.616+0000 7f907c209740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f865d68200 0x55f865d6f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:08.625 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.616+0000 7f907c209740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f865d6ac40 0x55f865d70300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:08.625 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.616+0000 7f907c209740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f865c00ab0 con 0x55f865d68200 2024-08-20T01:41:08.625 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.616+0000 7f907c209740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f865c4e780 con 0x55f865d6ac40 2024-08-20T01:41:08.625 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.616+0000 7f907c209740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f865d6dbc0 con 0x55f865d658d0 2024-08-20T01:41:08.625 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.616+0000 7f907c209740 10 client.0 _ll_register_callbacks cb 0x55f8659d6a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:08.625 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.616+0000 7f90727fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f865d68200 0x55f865d6f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:08.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.616+0000 7f90727fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f865d68200 0x55f865d6f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57486/0 (socket says 172.21.15.79:57486) 2024-08-20T01:41:08.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.616+0000 7f90727fc640 1 -- 172.21.15.79:0/2060906761 learned_addr learned my addr 172.21.15.79:0/2060906761 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:08.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.616+0000 7f90737fe640 1 --2- 172.21.15.79:0/2060906761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f865d6ac40 0x55f865d70300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:08.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.616+0000 7f9072ffd640 1 --2- 172.21.15.79:0/2060906761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f865d658d0 0x55f865d6f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:08.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.616+0000 7f90727fc640 1 -- 172.21.15.79:0/2060906761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f865d658d0 msgr2=0x55f865d6f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:08.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.616+0000 7f90727fc640 1 --2- 172.21.15.79:0/2060906761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f865d658d0 0x55f865d6f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:08.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.616+0000 7f90727fc640 1 -- 172.21.15.79:0/2060906761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f865d6ac40 msgr2=0x55f865d70300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:08.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.616+0000 7f90727fc640 1 --2- 172.21.15.79:0/2060906761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f865d6ac40 0x55f865d70300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:08.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.616+0000 7f90727fc640 1 -- 172.21.15.79:0/2060906761 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f865a2a790 con 0x55f865d68200 2024-08-20T01:41:08.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.616+0000 7f90727fc640 1 --2- 172.21.15.79:0/2060906761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f865d68200 0x55f865d6f730 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f90680a7eb0 tx=0x7f90680aa610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df4423a6e7f438c7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:08.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.616+0000 7f9056ff5640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:41:08.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.616+0000 7f9056ff5640 1 -- 172.21.15.79:0/2060906761 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90680ab340 con 0x55f865d68200 2024-08-20T01:41:08.627 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.616+0000 7f9056ff5640 1 -- 172.21.15.79:0/2060906761 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f90680a6ed0 con 0x55f865d68200 2024-08-20T01:41:08.627 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.616+0000 7f907c209740 1 -- 172.21.15.79:0/2060906761 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f865c76e00 con 0x55f865d68200 2024-08-20T01:41:08.627 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.616+0000 7f9056ff5640 1 -- 172.21.15.79:0/2060906761 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f90680aac40 con 0x55f865d68200 2024-08-20T01:41:08.627 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.616+0000 7f907c209740 10 client.16761 fetch_fsmap learned FSMap version 37 2024-08-20T01:41:08.627 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.617+0000 7f907c209740 1 -- 172.21.15.79:0/2060906761 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55f865aa3620 con 0x55f865d68200 2024-08-20T01:41:08.627 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.617+0000 7f9056ff5640 1 -- 172.21.15.79:0/2060906761 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55f865c76e00 con 0x55f865d68200 2024-08-20T01:41:08.627 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.617+0000 7f9056ff5640 1 -- 172.21.15.79:0/2060906761 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 37) ==== 8366+0+0 (secure 0 0 0) 0x7f90680a9ea0 con 0x55f865d68200 2024-08-20T01:41:08.627 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.617+0000 7f907c209740 10 client.16761 fetch_fsmap finished waiting for FSMap version 37 2024-08-20T01:41:08.627 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.617+0000 7f907c209740 10 client.16761 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:41:08.627 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.617+0000 7f907c209740 20 client.16761 populate_metadata read hostname 'smithi079' 2024-08-20T01:41:08.627 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.617+0000 7f907c209740 1 --2- 172.21.15.79:0/2060906761 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f865d7a940 0x55f865d7cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:08.627 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.617+0000 7f907c209740 4 client.16761 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:41:08.628 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.617+0000 7f907c209740 1 -- 172.21.15.79:0/2060906761 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f865cda2b0 con 0x55f865d7a940 2024-08-20T01:41:08.628 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.617+0000 7f9072ffd640 1 --2- 172.21.15.79:0/2060906761 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f865d7a940 0x55f865d7cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:08.628 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.618+0000 7f9056ff5640 10 client.16761 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:41:08.628 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.618+0000 7f9072ffd640 1 --2- 172.21.15.79:0/2060906761 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f865d7a940 0x55f865d7cd30 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b611e16a4787703c server_cookie=318bf2bfefad219f in_seq=0 out_seq=0 2024-08-20T01:41:08.628 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.618+0000 7f9056ff5640 1 -- 172.21.15.79:0/2060906761 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f865cda2b0 con 0x55f865d7a940 2024-08-20T01:41:08.628 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.618+0000 7f9056ff5640 10 client.16761 handle_command_reply: tid=0 2024-08-20T01:41:08.628 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.618+0000 7f907c209740 1 client.16761 shutdown 2024-08-20T01:41:08.628 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.618+0000 7f907c209740 1 -- 172.21.15.79:0/2060906761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f865d68200 msgr2=0x55f865d6f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:08.628 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.618+0000 7f907c209740 1 --2- 172.21.15.79:0/2060906761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f865d68200 0x55f865d6f730 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f90680a7eb0 tx=0x7f90680aa610 comp rx=0 tx=0).stop 2024-08-20T01:41:08.628 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.618+0000 7f907c209740 1 -- 172.21.15.79:0/2060906761 shutdown_connections 2024-08-20T01:41:08.628 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.618+0000 7f907c209740 1 --2- 172.21.15.79:0/2060906761 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f865d7a940 0x55f865d7cd30 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:08.628 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.618+0000 7f907c209740 1 --2- 172.21.15.79:0/2060906761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f865d6ac40 0x55f865d70300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:08.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.618+0000 7f907c209740 1 --2- 172.21.15.79:0/2060906761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f865d68200 0x55f865d6f730 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:08.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.618+0000 7f9056ff5640 0 client.16761 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:41:08.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.618+0000 7f907c209740 1 --2- 172.21.15.79:0/2060906761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f865d658d0 0x55f865d6f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:08.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.619+0000 7f907c209740 1 -- 172.21.15.79:0/2060906761 >> 172.21.15.79:0/2060906761 conn(0x55f865d60a20 msgr2=0x55f865d5fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:08.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.619+0000 7f907c209740 1 -- 172.21.15.79:0/2060906761 shutdown_connections 2024-08-20T01:41:08.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.619+0000 7f907c209740 1 -- 172.21.15.79:0/2060906761 wait complete. 2024-08-20T01:41:08.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.619+0000 7f907c209740 20 client.16761 trim_cache size 0 max 16384 2024-08-20T01:41:08.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:08 smithi175 ceph-mon[22392]: pgmap v461: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 26 MiB/s wr, 46 op/s 2024-08-20T01:41:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.638+0000 7f907c209740 1 Processor -- start 2024-08-20T01:41:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.638+0000 7f907c209740 1 -- start start 2024-08-20T01:41:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.638+0000 7f907c209740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f865d658d0 0x55f865d5b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.638+0000 7f907c209740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f865d68200 0x55f865d6b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.638+0000 7f907c209740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f865d6ac40 0x55f865d6b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.638+0000 7f907c209740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f90741a9ab0 con 0x55f865d6ac40 2024-08-20T01:41:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.638+0000 7f907c209740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f90741ab620 con 0x55f865d68200 2024-08-20T01:41:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.638+0000 7f907c209740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f90741aa180 con 0x55f865d658d0 2024-08-20T01:41:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.638+0000 7f90737fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f865d6ac40 0x55f865d6b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.638+0000 7f90737fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f865d6ac40 0x55f865d6b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57488/0 (socket says 172.21.15.79:57488) 2024-08-20T01:41:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.638+0000 7f90737fe640 1 -- 172.21.15.79:0/3491154301 learned_addr learned my addr 172.21.15.79:0/3491154301 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.639+0000 7f90727fc640 1 --2- 172.21.15.79:0/3491154301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f865d68200 0x55f865d6b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.639+0000 7f9072ffd640 1 --2- 172.21.15.79:0/3491154301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f865d658d0 0x55f865d5b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.639+0000 7f90737fe640 1 -- 172.21.15.79:0/3491154301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f865d658d0 msgr2=0x55f865d5b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.639+0000 7f90737fe640 1 --2- 172.21.15.79:0/3491154301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f865d658d0 0x55f865d5b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.639+0000 7f90737fe640 1 -- 172.21.15.79:0/3491154301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f865d68200 msgr2=0x55f865d6b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.639+0000 7f90737fe640 1 --2- 172.21.15.79:0/3491154301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f865d68200 0x55f865d6b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.639+0000 7f90737fe640 1 -- 172.21.15.79:0/3491154301 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f865d7d0a0 con 0x55f865d6ac40 2024-08-20T01:41:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.639+0000 7f90727fc640 1 --2- 172.21.15.79:0/3491154301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f865d68200 0x55f865d6b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:41:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.639+0000 7f90737fe640 1 --2- 172.21.15.79:0/3491154301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f865d6ac40 0x55f865d6b560 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f906c011780 tx=0x7f906c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=366535a203b421ec server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.639+0000 7f9058ff9640 1 -- 172.21.15.79:0/3491154301 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f906c011db0 con 0x55f865d6ac40 2024-08-20T01:41:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.639+0000 7f9058ff9640 1 -- 172.21.15.79:0/3491154301 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f906c01d8c0 con 0x55f865d6ac40 2024-08-20T01:41:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.639+0000 7f9058ff9640 1 -- 172.21.15.79:0/3491154301 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f906c0208e0 con 0x55f865d6ac40 2024-08-20T01:41:08.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.640+0000 7f907c209740 1 -- 172.21.15.79:0/3491154301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f865d6ac40 msgr2=0x55f865d6b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:08.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.640+0000 7f907c209740 1 --2- 172.21.15.79:0/3491154301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f865d6ac40 0x55f865d6b560 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f906c011780 tx=0x7f906c016000 comp rx=0 tx=0).stop 2024-08-20T01:41:08.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.640+0000 7f907c209740 1 -- 172.21.15.79:0/3491154301 shutdown_connections 2024-08-20T01:41:08.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.640+0000 7f907c209740 1 --2- 172.21.15.79:0/3491154301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f865d6ac40 0x55f865d6b560 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:08.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.640+0000 7f907c209740 1 --2- 172.21.15.79:0/3491154301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f865d68200 0x55f865d6b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:08.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.640+0000 7f907c209740 1 --2- 172.21.15.79:0/3491154301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f865d658d0 0x55f865d5b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:08.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.640+0000 7f907c209740 1 -- 172.21.15.79:0/3491154301 >> 172.21.15.79:0/3491154301 conn(0x55f865d60a20 msgr2=0x55f865d6c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:08.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.640+0000 7f907c209740 1 -- 172.21.15.79:0/3491154301 shutdown_connections 2024-08-20T01:41:08.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.640+0000 7f907c209740 1 -- 172.21.15.79:0/3491154301 wait complete. 2024-08-20T01:41:08.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.640+0000 7f907c209740 1 -- start start 2024-08-20T01:41:08.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.641+0000 7f907c209740 1 Processor -- start 2024-08-20T01:41:08.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.641+0000 7f907c209740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f865d658d0 0x55f865d769f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:08.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.641+0000 7f907c209740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f865d68200 0x55f865d756f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:08.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.641+0000 7f907c209740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f865d6ac40 0x55f865d75c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:08.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.641+0000 7f907c209740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f90741aaf50 con 0x55f865d658d0 2024-08-20T01:41:08.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.641+0000 7f907c209740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f90741aa850 con 0x55f865d68200 2024-08-20T01:41:08.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.641+0000 7f907c209740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f90741a7a90 con 0x55f865d6ac40 2024-08-20T01:41:08.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.641+0000 7f907c209740 10 client.0 _ll_register_callbacks cb 0x7f90680aaae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:08.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.641+0000 7f9072ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f865d658d0 0x55f865d769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:08.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.641+0000 7f9072ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f865d658d0 0x55f865d769f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57494/0 (socket says 172.21.15.79:57494) 2024-08-20T01:41:08.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.641+0000 7f9072ffd640 1 -- 172.21.15.79:0/371224860 learned_addr learned my addr 172.21.15.79:0/371224860 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:08.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.641+0000 7f90737fe640 1 --2- 172.21.15.79:0/371224860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f865d6ac40 0x55f865d75c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:08.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.641+0000 7f90727fc640 1 --2- 172.21.15.79:0/371224860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f865d68200 0x55f865d756f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:08.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.641+0000 7f9072ffd640 1 -- 172.21.15.79:0/371224860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f865d6ac40 msgr2=0x55f865d75c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:08.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.641+0000 7f9072ffd640 1 --2- 172.21.15.79:0/371224860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f865d6ac40 0x55f865d75c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:08.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.641+0000 7f9072ffd640 1 -- 172.21.15.79:0/371224860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f865d68200 msgr2=0x55f865d756f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:08.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.641+0000 7f9072ffd640 1 --2- 172.21.15.79:0/371224860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f865d68200 0x55f865d756f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:08.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.641+0000 7f9072ffd640 1 -- 172.21.15.79:0/371224860 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f865d70670 con 0x55f865d658d0 2024-08-20T01:41:08.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.641+0000 7f9072ffd640 1 --2- 172.21.15.79:0/371224860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f865d658d0 0x55f865d769f0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f90640057c0 tx=0x7f9064005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be64e0a82821fab2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:08.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.641+0000 7f9056ff5640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:41:08.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.642+0000 7f9056ff5640 1 -- 172.21.15.79:0/371224860 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9064035040 con 0x55f865d658d0 2024-08-20T01:41:08.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.642+0000 7f9056ff5640 1 -- 172.21.15.79:0/371224860 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9064031d10 con 0x55f865d658d0 2024-08-20T01:41:08.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.642+0000 7f907c209740 1 -- 172.21.15.79:0/371224860 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f906c01d8c0 con 0x55f865d658d0 2024-08-20T01:41:08.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.642+0000 7f9056ff5640 1 -- 172.21.15.79:0/371224860 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f90640035f0 con 0x55f865d658d0 2024-08-20T01:41:08.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.642+0000 7f907c209740 10 client.16767 fetch_fsmap learned FSMap version 37 2024-08-20T01:41:08.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.642+0000 7f907c209740 1 -- 172.21.15.79:0/371224860 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55f865d75070 con 0x55f865d658d0 2024-08-20T01:41:08.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.642+0000 7f9056ff5640 1 -- 172.21.15.79:0/371224860 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f906c01d8c0 con 0x55f865d658d0 2024-08-20T01:41:08.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.642+0000 7f9056ff5640 1 -- 172.21.15.79:0/371224860 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 37) ==== 8366+0+0 (secure 0 0 0) 0x7f906404d550 con 0x55f865d658d0 2024-08-20T01:41:08.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.642+0000 7f907c209740 10 client.16767 fetch_fsmap finished waiting for FSMap version 37 2024-08-20T01:41:08.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.642+0000 7f907c209740 10 client.16767 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:41:08.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.642+0000 7f907c209740 20 client.16767 populate_metadata read hostname 'smithi079' 2024-08-20T01:41:08.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.642+0000 7f907c209740 1 --2- 172.21.15.79:0/371224860 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f865de5960 0x55f865de7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:08.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.642+0000 7f907c209740 4 client.16767 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:41:08.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.642+0000 7f907c209740 1 -- 172.21.15.79:0/371224860 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f865cd5d50 con 0x55f865de5960 2024-08-20T01:41:08.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.642+0000 7f90727fc640 1 --2- 172.21.15.79:0/371224860 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f865de5960 0x55f865de7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:08.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.643+0000 7f90727fc640 1 --2- 172.21.15.79:0/371224860 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f865de5960 0x55f865de7d50 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a8732fa3a2bfd4f server_cookie=942180a27684b9f6 in_seq=0 out_seq=0 2024-08-20T01:41:08.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.643+0000 7f9056ff5640 10 client.16767 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:41:08.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.658+0000 7f9056ff5640 1 -- 172.21.15.79:0/371224860 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f865cd5d50 con 0x55f865de5960 2024-08-20T01:41:08.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.658+0000 7f9056ff5640 10 client.16767 handle_command_reply: tid=0 2024-08-20T01:41:08.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.658+0000 7f907c209740 1 client.16767 shutdown 2024-08-20T01:41:08.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.658+0000 7f907c209740 1 -- 172.21.15.79:0/371224860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f865d658d0 msgr2=0x55f865d769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:08.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.658+0000 7f907c209740 1 --2- 172.21.15.79:0/371224860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f865d658d0 0x55f865d769f0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f90640057c0 tx=0x7f9064005c00 comp rx=0 tx=0).stop 2024-08-20T01:41:08.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.658+0000 7f907c209740 1 -- 172.21.15.79:0/371224860 shutdown_connections 2024-08-20T01:41:08.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.658+0000 7f907c209740 1 --2- 172.21.15.79:0/371224860 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f865de5960 0x55f865de7d50 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:08.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.658+0000 7f907c209740 1 --2- 172.21.15.79:0/371224860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f865d6ac40 0x55f865d75c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:08.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.658+0000 7f907c209740 1 --2- 172.21.15.79:0/371224860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f865d68200 0x55f865d756f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:08.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.658+0000 7f907c209740 1 --2- 172.21.15.79:0/371224860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f865d658d0 0x55f865d769f0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:08.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.658+0000 7f907c209740 1 -- 172.21.15.79:0/371224860 >> 172.21.15.79:0/371224860 conn(0x55f865d60a20 msgr2=0x55f865d5f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:08.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.658+0000 7f9056ff5640 0 client.16767 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:41:08.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.658+0000 7f907c209740 1 -- 172.21.15.79:0/371224860 shutdown_connections 2024-08-20T01:41:08.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.658+0000 7f907c209740 1 -- 172.21.15.79:0/371224860 wait complete. 2024-08-20T01:41:08.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.658+0000 7f907c209740 20 client.16767 trim_cache size 0 max 16384 2024-08-20T01:41:08.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:41:08.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:41:08.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:41:08.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:41:08.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.659+0000 7f9079415640 1 -- 172.21.15.79:0/1869891726 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f905c0b3bd0 msgr2=0x7f905c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:08.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.659+0000 7f9079415640 1 --2- 172.21.15.79:0/1869891726 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f905c0b3bd0 0x7f905c0b6090 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9074199700 tx=0x7f906c009600 comp rx=0 tx=0).stop 2024-08-20T01:41:08.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.659+0000 7f9079415640 1 -- 172.21.15.79:0/1869891726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90741026b0 msgr2=0x7f9074198fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:08.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.659+0000 7f9079415640 1 --2- 172.21.15.79:0/1869891726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90741026b0 0x7f9074198fd0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f906800c920 tx=0x7f906800cde0 comp rx=0 tx=0).stop 2024-08-20T01:41:08.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.659+0000 7f9079415640 1 -- 172.21.15.79:0/1869891726 shutdown_connections 2024-08-20T01:41:08.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.659+0000 7f9079415640 1 --2- 172.21.15.79:0/1869891726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9074103070 0x7f9074199c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:08.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.659+0000 7f9079415640 1 --2- 172.21.15.79:0/1869891726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90741026b0 0x7f9074198fd0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:08.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.659+0000 7f9079415640 1 --2- 172.21.15.79:0/1869891726 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f905c0b3bd0 0x7f905c0b6090 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:08.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.659+0000 7f9079415640 1 --2- 172.21.15.79:0/1869891726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9074101560 0x7f9074198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:08.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.659+0000 7f9079415640 1 -- 172.21.15.79:0/1869891726 >> 172.21.15.79:0/1869891726 conn(0x7f90740fce40 msgr2=0x7f90740fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:08.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.659+0000 7f9079415640 1 -- 172.21.15.79:0/1869891726 shutdown_connections 2024-08-20T01:41:08.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:08.659+0000 7f9079415640 1 -- 172.21.15.79:0/1869891726 wait complete. 2024-08-20T01:41:10.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:10 smithi079 ceph-mon[18656]: pgmap v462: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 27 MiB/s wr, 49 op/s 2024-08-20T01:41:10.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:10 smithi081 ceph-mon[22209]: pgmap v462: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 27 MiB/s wr, 49 op/s 2024-08-20T01:41:10.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:10 smithi175 ceph-mon[22392]: pgmap v462: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 27 MiB/s wr, 49 op/s 2024-08-20T01:41:12.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:12 smithi079 ceph-mon[18656]: pgmap v463: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 27 MiB/s wr, 46 op/s 2024-08-20T01:41:12.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:12 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:41:12.441 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:12 smithi175 ceph-mon[22392]: pgmap v463: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 27 MiB/s wr, 46 op/s 2024-08-20T01:41:12.441 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:12 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:41:12.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:12 smithi081 ceph-mon[22209]: pgmap v463: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 27 MiB/s wr, 46 op/s 2024-08-20T01:41:12.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:12 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:41:14.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:14 smithi079 ceph-mon[18656]: pgmap v464: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 31 MiB/s wr, 41 op/s 2024-08-20T01:41:14.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:14 smithi081 ceph-mon[22209]: pgmap v464: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 31 MiB/s wr, 41 op/s 2024-08-20T01:41:14.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:14 smithi175 ceph-mon[22392]: pgmap v464: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 31 MiB/s wr, 41 op/s 2024-08-20T01:41:15.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:15 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:41:15.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:15 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:41:15.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:15 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:41:15.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:15 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:41:15.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:15 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:41:15.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:15 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:41:15.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:15 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:41:15.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:15 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:41:15.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:15 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:41:15.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:15 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:41:15.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:15 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:41:15.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:15 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:41:16.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:16 smithi079 ceph-mon[18656]: pgmap v465: 97 pgs: 97 active+clean; 5.4 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 32 MiB/s wr, 39 op/s 2024-08-20T01:41:16.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:16 smithi081 ceph-mon[22209]: pgmap v465: 97 pgs: 97 active+clean; 5.4 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 32 MiB/s wr, 39 op/s 2024-08-20T01:41:16.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:16 smithi175 ceph-mon[22392]: pgmap v465: 97 pgs: 97 active+clean; 5.4 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 32 MiB/s wr, 39 op/s 2024-08-20T01:41:18.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:18 smithi079 ceph-mon[18656]: pgmap v466: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 23 op/s 2024-08-20T01:41:18.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:18 smithi081 ceph-mon[22209]: pgmap v466: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 23 op/s 2024-08-20T01:41:18.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:18 smithi175 ceph-mon[22392]: pgmap v466: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 23 op/s 2024-08-20T01:41:20.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:20 smithi079 ceph-mon[18656]: pgmap v467: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 31 MiB/s wr, 26 op/s 2024-08-20T01:41:20.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:20 smithi081 ceph-mon[22209]: pgmap v467: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 31 MiB/s wr, 26 op/s 2024-08-20T01:41:20.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:20 smithi175 ceph-mon[22392]: pgmap v467: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 31 MiB/s wr, 26 op/s 2024-08-20T01:41:21.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.748+0000 7f61dab89640 1 -- 172.21.15.79:0/3068792488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61d4101560 msgr2=0x7f61d4101960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:21.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.748+0000 7f61dab89640 1 --2- 172.21.15.79:0/3068792488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61d4101560 0x7f61d4101960 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f61c8009930 tx=0x7f61c802a420 comp rx=0 tx=0).stop 2024-08-20T01:41:21.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.748+0000 7f61dab89640 1 -- 172.21.15.79:0/3068792488 shutdown_connections 2024-08-20T01:41:21.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.748+0000 7f61dab89640 1 --2- 172.21.15.79:0/3068792488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61d4103070 0x7f61d41099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:21.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.748+0000 7f61dab89640 1 --2- 172.21.15.79:0/3068792488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61d41026b0 0x7f61d4102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:21.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.748+0000 7f61dab89640 1 --2- 172.21.15.79:0/3068792488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61d4101560 0x7f61d4101960 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:21.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.748+0000 7f61dab89640 1 -- 172.21.15.79:0/3068792488 >> 172.21.15.79:0/3068792488 conn(0x7f61d40fce40 msgr2=0x7f61d40ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:21.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.748+0000 7f61dab89640 1 -- 172.21.15.79:0/3068792488 shutdown_connections 2024-08-20T01:41:21.754 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.748+0000 7f61dab89640 1 -- 172.21.15.79:0/3068792488 wait complete. 2024-08-20T01:41:21.754 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.748+0000 7f61dab89640 1 Processor -- start 2024-08-20T01:41:21.754 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.749+0000 7f61dab89640 1 -- start start 2024-08-20T01:41:21.754 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.749+0000 7f61dab89640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61d4101560 0x7f61d41989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:21.754 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.749+0000 7f61dab89640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61d41026b0 0x7f61d4199020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:21.754 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.749+0000 7f61dab89640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61d4103070 0x7f61d4199c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:21.754 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.749+0000 7f61dab89640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f61d410d090 con 0x7f61d41026b0 2024-08-20T01:41:21.754 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.749+0000 7f61dab89640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f61d410cf10 con 0x7f61d4103070 2024-08-20T01:41:21.754 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.749+0000 7f61dab89640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f61d410d210 con 0x7f61d4101560 2024-08-20T01:41:21.754 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.749+0000 7f61d3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61d41026b0 0x7f61d4199020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:21.754 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.749+0000 7f61d3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61d41026b0 0x7f61d4199020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35210/0 (socket says 172.21.15.79:35210) 2024-08-20T01:41:21.754 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.749+0000 7f61d3fff640 1 -- 172.21.15.79:0/2777999468 learned_addr learned my addr 172.21.15.79:0/2777999468 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:21.755 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.749+0000 7f61d8925640 1 --2- 172.21.15.79:0/2777999468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61d4101560 0x7f61d41989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:21.755 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.749+0000 7f61d9126640 1 --2- 172.21.15.79:0/2777999468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61d4103070 0x7f61d4199c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:21.755 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.749+0000 7f61d3fff640 1 -- 172.21.15.79:0/2777999468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61d4101560 msgr2=0x7f61d41989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:21.755 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.749+0000 7f61d3fff640 1 --2- 172.21.15.79:0/2777999468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61d4101560 0x7f61d41989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:21.755 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.749+0000 7f61d3fff640 1 -- 172.21.15.79:0/2777999468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61d4103070 msgr2=0x7f61d4199c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:21.755 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.749+0000 7f61d3fff640 1 --2- 172.21.15.79:0/2777999468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61d4103070 0x7f61d4199c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:21.755 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.749+0000 7f61d3fff640 1 -- 172.21.15.79:0/2777999468 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61d419a510 con 0x7f61d41026b0 2024-08-20T01:41:21.755 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.749+0000 7f61d9126640 1 --2- 172.21.15.79:0/2777999468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61d4103070 0x7f61d4199c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:41:21.755 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.749+0000 7f61d3fff640 1 --2- 172.21.15.79:0/2777999468 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61d41026b0 0x7f61d4199020 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f61c000e9f0 tx=0x7f61c000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:21.755 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.749+0000 7f61d1ffb640 1 -- 172.21.15.79:0/2777999468 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c000cd80 con 0x7f61d41026b0 2024-08-20T01:41:21.755 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.750+0000 7f61d1ffb640 1 -- 172.21.15.79:0/2777999468 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f61c00108c0 con 0x7f61d41026b0 2024-08-20T01:41:21.755 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.750+0000 7f61d1ffb640 1 -- 172.21.15.79:0/2777999468 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c00187c0 con 0x7f61d41026b0 2024-08-20T01:41:21.755 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.750+0000 7f61dab89640 1 -- 172.21.15.79:0/2777999468 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61d419a800 con 0x7f61d41026b0 2024-08-20T01:41:21.756 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.750+0000 7f61dab89640 1 -- 172.21.15.79:0/2777999468 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61d41a0ed0 con 0x7f61d41026b0 2024-08-20T01:41:21.762 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.752+0000 7f61d1ffb640 1 -- 172.21.15.79:0/2777999468 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f61c0010430 con 0x7f61d41026b0 2024-08-20T01:41:21.762 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.752+0000 7f61dda4c740 1 Processor -- start 2024-08-20T01:41:21.762 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.753+0000 7f61dda4c740 1 -- start start 2024-08-20T01:41:21.762 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.753+0000 7f61dda4c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe227168d0 0x55fe22718cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:21.762 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.753+0000 7f61dda4c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fe22719200 0x55fe2271b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:21.762 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.753+0000 7f61dda4c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe2271bc40 0x55fe2271e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:21.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.753+0000 7f61dda4c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fe22689360 con 0x55fe2271bc40 2024-08-20T01:41:21.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.753+0000 7f61dda4c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55fe22678860 con 0x55fe22719200 2024-08-20T01:41:21.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.753+0000 7f61dda4c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55fe2267c8a0 con 0x55fe227168d0 2024-08-20T01:41:21.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.753+0000 7f61d3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe2271bc40 0x55fe2271e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:21.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.753+0000 7f61d3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe2271bc40 0x55fe2271e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35212/0 (socket says 172.21.15.79:35212) 2024-08-20T01:41:21.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.753+0000 7f61d3fff640 1 -- 172.21.15.79:0/2627454294 learned_addr learned my addr 172.21.15.79:0/2627454294 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:21.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.753+0000 7f61d9126640 1 --2- 172.21.15.79:0/2627454294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe227168d0 0x55fe22718cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:21.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.753+0000 7f61d8925640 1 --2- 172.21.15.79:0/2627454294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fe22719200 0x55fe2271b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:21.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.753+0000 7f61d1ffb640 1 --2- 172.21.15.79:0/2777999468 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f61c40b3c50 0x7f61c40b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:21.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.753+0000 7f61d3fff640 1 -- 172.21.15.79:0/2627454294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe227168d0 msgr2=0x55fe22718cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:21.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.753+0000 7f61d3fff640 1 --2- 172.21.15.79:0/2627454294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe227168d0 0x55fe22718cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:21.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.753+0000 7f61d3fff640 1 -- 172.21.15.79:0/2627454294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fe22719200 msgr2=0x55fe2271b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:21.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.753+0000 7f61d3fff640 1 --2- 172.21.15.79:0/2627454294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fe22719200 0x55fe2271b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:21.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.753+0000 7f61d3fff640 1 -- 172.21.15.79:0/2627454294 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe2261fe40 con 0x55fe2271bc40 2024-08-20T01:41:21.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.753+0000 7f61d9126640 1 --2- 172.21.15.79:0/2627454294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe227168d0 0x55fe22718cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:41:21.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.754+0000 7f61d9126640 1 --2- 172.21.15.79:0/2777999468 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f61c40b3c50 0x7f61c40b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:21.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.754+0000 7f61d1ffb640 1 -- 172.21.15.79:0/2777999468 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f61c00e3fc0 con 0x7f61d41026b0 2024-08-20T01:41:21.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.754+0000 7f61d3fff640 1 --2- 172.21.15.79:0/2627454294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe2271bc40 0x55fe2271e100 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f61c0016870 tx=0x7f61c00073b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63731343a220ca44 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:21.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.754+0000 7f61beffd640 1 -- 172.21.15.79:0/2627454294 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c006e020 con 0x55fe2271bc40 2024-08-20T01:41:21.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.754+0000 7f61d9126640 1 --2- 172.21.15.79:0/2777999468 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f61c40b3c50 0x7f61c40b6110 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f61d4199750 tx=0x7f61cc004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:21.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.754+0000 7f61beffd640 1 -- 172.21.15.79:0/2627454294 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f61c00168a0 con 0x55fe2271bc40 2024-08-20T01:41:21.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.754+0000 7f61beffd640 1 -- 172.21.15.79:0/2627454294 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c00aaa30 con 0x55fe2271bc40 2024-08-20T01:41:21.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.755+0000 7f61dda4c740 1 -- 172.21.15.79:0/2627454294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe2271bc40 msgr2=0x55fe2271e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:21.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.755+0000 7f61dda4c740 1 --2- 172.21.15.79:0/2627454294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe2271bc40 0x55fe2271e100 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f61c0016870 tx=0x7f61c00073b0 comp rx=0 tx=0).stop 2024-08-20T01:41:21.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.755+0000 7f61dda4c740 1 -- 172.21.15.79:0/2627454294 shutdown_connections 2024-08-20T01:41:21.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.755+0000 7f61dda4c740 1 --2- 172.21.15.79:0/2627454294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe2271bc40 0x55fe2271e100 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:21.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.755+0000 7f61dda4c740 1 --2- 172.21.15.79:0/2627454294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fe22719200 0x55fe2271b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:21.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.755+0000 7f61dda4c740 1 --2- 172.21.15.79:0/2627454294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe227168d0 0x55fe22718cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:21.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.755+0000 7f61dda4c740 1 -- 172.21.15.79:0/2627454294 >> 172.21.15.79:0/2627454294 conn(0x55fe22711a20 msgr2=0x55fe227127b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:21.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.755+0000 7f61dda4c740 1 -- 172.21.15.79:0/2627454294 shutdown_connections 2024-08-20T01:41:21.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.755+0000 7f61dda4c740 1 -- 172.21.15.79:0/2627454294 wait complete. 2024-08-20T01:41:21.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.755+0000 7f61dda4c740 1 -- start start 2024-08-20T01:41:21.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.755+0000 7f61dda4c740 1 Processor -- start 2024-08-20T01:41:21.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.756+0000 7f61dda4c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe227168d0 0x55fe227200a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:21.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.756+0000 7f61dda4c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe22719200 0x55fe22720740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:21.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.756+0000 7f61dda4c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fe2271bc40 0x55fe227212a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:21.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.756+0000 7f61dda4c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fe225b1ab0 con 0x55fe227168d0 2024-08-20T01:41:21.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.756+0000 7f61dda4c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55fe225ff780 con 0x55fe2271bc40 2024-08-20T01:41:21.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.756+0000 7f61dda4c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55fe2271ebc0 con 0x55fe22719200 2024-08-20T01:41:21.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.756+0000 7f61dda4c740 10 client.0 _ll_register_callbacks cb 0x55fe22387a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:21.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.756+0000 7f61d8925640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe227168d0 0x55fe227200a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:21.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.756+0000 7f61d8925640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe227168d0 0x55fe227200a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35228/0 (socket says 172.21.15.79:35228) 2024-08-20T01:41:21.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.756+0000 7f61d8925640 1 -- 172.21.15.79:0/1797361410 learned_addr learned my addr 172.21.15.79:0/1797361410 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:21.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.756+0000 7f61d3fff640 1 --2- 172.21.15.79:0/1797361410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe22719200 0x55fe22720740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:21.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.756+0000 7f61d9126640 1 --2- 172.21.15.79:0/1797361410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fe2271bc40 0x55fe227212a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:21.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.756+0000 7f61d8925640 1 -- 172.21.15.79:0/1797361410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe22719200 msgr2=0x55fe22720740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:21.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.756+0000 7f61d8925640 1 --2- 172.21.15.79:0/1797361410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe22719200 0x55fe22720740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:21.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.756+0000 7f61d8925640 1 -- 172.21.15.79:0/1797361410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fe2271bc40 msgr2=0x55fe227212a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:21.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.756+0000 7f61d8925640 1 --2- 172.21.15.79:0/1797361410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fe2271bc40 0x55fe227212a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:21.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.756+0000 7f61d8925640 1 -- 172.21.15.79:0/1797361410 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe223db790 con 0x55fe227168d0 2024-08-20T01:41:21.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.756+0000 7f61d8925640 1 --2- 172.21.15.79:0/1797361410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe227168d0 0x55fe227200a0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f61c8006010 tx=0x7f61c8031900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f7e5e52c4cd258b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:21.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.756+0000 7f61b3fff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:41:21.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.756+0000 7f61b3fff640 1 -- 172.21.15.79:0/1797361410 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c8035040 con 0x55fe227168d0 2024-08-20T01:41:21.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.756+0000 7f61b3fff640 1 -- 172.21.15.79:0/1797361410 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f61c8004240 con 0x55fe227168d0 2024-08-20T01:41:21.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.756+0000 7f61dda4c740 1 -- 172.21.15.79:0/1797361410 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fe22627e00 con 0x55fe227168d0 2024-08-20T01:41:21.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.757+0000 7f61b3fff640 1 -- 172.21.15.79:0/1797361410 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f61c8004440 con 0x55fe227168d0 2024-08-20T01:41:21.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.757+0000 7f61dda4c740 10 client.16779 fetch_fsmap learned FSMap version 38 2024-08-20T01:41:21.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.757+0000 7f61dda4c740 1 -- 172.21.15.79:0/1797361410 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55fe22454620 con 0x55fe227168d0 2024-08-20T01:41:21.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.757+0000 7f61b3fff640 1 -- 172.21.15.79:0/1797361410 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55fe22627e00 con 0x55fe227168d0 2024-08-20T01:41:21.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.757+0000 7f61b3fff640 1 -- 172.21.15.79:0/1797361410 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f61c803c6d0 con 0x55fe227168d0 2024-08-20T01:41:21.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.757+0000 7f61dda4c740 10 client.16779 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:41:21.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.757+0000 7f61dda4c740 10 client.16779 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:41:21.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.757+0000 7f61dda4c740 20 client.16779 populate_metadata read hostname 'smithi079' 2024-08-20T01:41:21.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.757+0000 7f61dda4c740 1 --2- 172.21.15.79:0/1797361410 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55fe2272b930 0x55fe2272dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:21.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.757+0000 7f61dda4c740 4 client.16779 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:41:21.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.757+0000 7f61dda4c740 1 -- 172.21.15.79:0/1797361410 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe2268b2b0 con 0x55fe2272b930 2024-08-20T01:41:21.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.757+0000 7f61d3fff640 1 --2- 172.21.15.79:0/1797361410 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55fe2272b930 0x55fe2272dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:21.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.758+0000 7f61d3fff640 1 --2- 172.21.15.79:0/1797361410 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55fe2272b930 0x55fe2272dd80 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=809896664113faef server_cookie=396d452003f61974 in_seq=0 out_seq=0 2024-08-20T01:41:21.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.758+0000 7f61b3fff640 10 client.16779 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:41:21.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.758+0000 7f61b3fff640 1 -- 172.21.15.79:0/1797361410 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fe2268b2b0 con 0x55fe2272b930 2024-08-20T01:41:21.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.758+0000 7f61b3fff640 10 client.16779 handle_command_reply: tid=0 2024-08-20T01:41:21.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.758+0000 7f61dda4c740 1 client.16779 shutdown 2024-08-20T01:41:21.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.759+0000 7f61dda4c740 1 -- 172.21.15.79:0/1797361410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe227168d0 msgr2=0x55fe227200a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:21.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.759+0000 7f61dda4c740 1 --2- 172.21.15.79:0/1797361410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe227168d0 0x55fe227200a0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f61c8006010 tx=0x7f61c8031900 comp rx=0 tx=0).stop 2024-08-20T01:41:21.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.759+0000 7f61dda4c740 1 -- 172.21.15.79:0/1797361410 shutdown_connections 2024-08-20T01:41:21.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.759+0000 7f61dda4c740 1 --2- 172.21.15.79:0/1797361410 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55fe2272b930 0x55fe2272dd80 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:21.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.759+0000 7f61dda4c740 1 --2- 172.21.15.79:0/1797361410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fe2271bc40 0x55fe227212a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:21.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.759+0000 7f61dda4c740 1 --2- 172.21.15.79:0/1797361410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe22719200 0x55fe22720740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:21.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.759+0000 7f61dda4c740 1 --2- 172.21.15.79:0/1797361410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe227168d0 0x55fe227200a0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:21.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.759+0000 7f61dda4c740 1 -- 172.21.15.79:0/1797361410 >> 172.21.15.79:0/1797361410 conn(0x55fe22711a20 msgr2=0x55fe22710ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:21.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.759+0000 7f61b3fff640 0 client.16779 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:41:21.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.759+0000 7f61dda4c740 1 -- 172.21.15.79:0/1797361410 shutdown_connections 2024-08-20T01:41:21.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.759+0000 7f61dda4c740 1 -- 172.21.15.79:0/1797361410 wait complete. 2024-08-20T01:41:21.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.759+0000 7f61dda4c740 20 client.16779 trim_cache size 0 max 16384 2024-08-20T01:41:21.779 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.776+0000 7f61dda4c740 1 Processor -- start 2024-08-20T01:41:21.779 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.776+0000 7f61dda4c740 1 -- start start 2024-08-20T01:41:21.779 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.776+0000 7f61dda4c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe227168d0 0x55fe2271f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:21.779 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.776+0000 7f61dda4c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe22719200 0x55fe2271f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:21.780 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.776+0000 7f61dda4c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fe2271bc40 0x55fe227102c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:21.781 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.776+0000 7f61dda4c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f61d41a9ac0 con 0x55fe227168d0 2024-08-20T01:41:21.781 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.776+0000 7f61dda4c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f61d41ab600 con 0x55fe2271bc40 2024-08-20T01:41:21.781 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.776+0000 7f61dda4c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f61d41aa190 con 0x55fe22719200 2024-08-20T01:41:21.781 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.776+0000 7f61d8925640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe227168d0 0x55fe2271f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:21.781 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.776+0000 7f61d8925640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe227168d0 0x55fe2271f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35238/0 (socket says 172.21.15.79:35238) 2024-08-20T01:41:21.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.776+0000 7f61d8925640 1 -- 172.21.15.79:0/31636651 learned_addr learned my addr 172.21.15.79:0/31636651 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:21.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.776+0000 7f61d3fff640 1 --2- 172.21.15.79:0/31636651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe22719200 0x55fe2271f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:21.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.777+0000 7f61d9126640 1 --2- 172.21.15.79:0/31636651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fe2271bc40 0x55fe227102c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:21.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.777+0000 7f61d8925640 1 -- 172.21.15.79:0/31636651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe22719200 msgr2=0x55fe2271f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:21.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.777+0000 7f61d8925640 1 --2- 172.21.15.79:0/31636651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe22719200 0x55fe2271f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:21.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.777+0000 7f61d8925640 1 -- 172.21.15.79:0/31636651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fe2271bc40 msgr2=0x55fe227102c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:21.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.777+0000 7f61d8925640 1 --2- 172.21.15.79:0/31636651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fe2271bc40 0x55fe227102c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:21.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.777+0000 7f61d8925640 1 -- 172.21.15.79:0/31636651 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe22721610 con 0x55fe227168d0 2024-08-20T01:41:21.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.777+0000 7f61d8925640 1 --2- 172.21.15.79:0/31636651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe227168d0 0x55fe2271f260 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f61c803ca70 tx=0x7f61c802a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d318c618b293ac0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:21.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.777+0000 7f61be7fc640 1 -- 172.21.15.79:0/31636651 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c8035050 con 0x55fe227168d0 2024-08-20T01:41:21.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.777+0000 7f61be7fc640 1 -- 172.21.15.79:0/31636651 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f61c803c640 con 0x55fe227168d0 2024-08-20T01:41:21.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.777+0000 7f61be7fc640 1 -- 172.21.15.79:0/31636651 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c80516b0 con 0x55fe227168d0 2024-08-20T01:41:21.786 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.778+0000 7f61dda4c740 1 -- 172.21.15.79:0/31636651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe227168d0 msgr2=0x55fe2271f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:21.786 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.778+0000 7f61dda4c740 1 --2- 172.21.15.79:0/31636651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe227168d0 0x55fe2271f260 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f61c803ca70 tx=0x7f61c802a420 comp rx=0 tx=0).stop 2024-08-20T01:41:21.786 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.778+0000 7f61dda4c740 1 -- 172.21.15.79:0/31636651 shutdown_connections 2024-08-20T01:41:21.786 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.778+0000 7f61dda4c740 1 --2- 172.21.15.79:0/31636651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fe2271bc40 0x55fe227102c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:21.786 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.778+0000 7f61dda4c740 1 --2- 172.21.15.79:0/31636651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe22719200 0x55fe2271f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:21.787 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.778+0000 7f61dda4c740 1 --2- 172.21.15.79:0/31636651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe227168d0 0x55fe2271f260 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:21.787 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.778+0000 7f61dda4c740 1 -- 172.21.15.79:0/31636651 >> 172.21.15.79:0/31636651 conn(0x55fe22711a20 msgr2=0x55fe22715e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:21.787 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.778+0000 7f61dda4c740 1 -- 172.21.15.79:0/31636651 shutdown_connections 2024-08-20T01:41:21.787 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.778+0000 7f61dda4c740 1 -- 172.21.15.79:0/31636651 wait complete. 2024-08-20T01:41:21.787 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.778+0000 7f61dda4c740 1 -- start start 2024-08-20T01:41:21.787 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.778+0000 7f61dda4c740 1 Processor -- start 2024-08-20T01:41:21.787 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.779+0000 7f61dda4c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fe227168d0 0x55fe227249d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:21.787 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.779+0000 7f61dda4c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe22719200 0x55fe22725070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:21.787 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.779+0000 7f61dda4c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe2271bc40 0x55fe22725bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:21.787 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.779+0000 7f61dda4c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f61d41aaf30 con 0x55fe22719200 2024-08-20T01:41:21.787 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.779+0000 7f61dda4c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f61d41aa860 con 0x55fe227168d0 2024-08-20T01:41:21.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.779+0000 7f61dda4c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f61d41a7aa0 con 0x55fe2271bc40 2024-08-20T01:41:21.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.779+0000 7f61dda4c740 10 client.0 _ll_register_callbacks cb 0x7f61c8009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:21.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.779+0000 7f61d3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe22719200 0x55fe22725070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:21.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.779+0000 7f61d3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe22719200 0x55fe22725070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35250/0 (socket says 172.21.15.79:35250) 2024-08-20T01:41:21.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.779+0000 7f61d3fff640 1 -- 172.21.15.79:0/2874181136 learned_addr learned my addr 172.21.15.79:0/2874181136 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:21.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.779+0000 7f61d8925640 1 --2- 172.21.15.79:0/2874181136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fe227168d0 0x55fe227249d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:21.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.779+0000 7f61d9126640 1 --2- 172.21.15.79:0/2874181136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe2271bc40 0x55fe22725bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:21.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.779+0000 7f61d3fff640 1 -- 172.21.15.79:0/2874181136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe2271bc40 msgr2=0x55fe22725bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:21.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.779+0000 7f61d3fff640 1 --2- 172.21.15.79:0/2874181136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe2271bc40 0x55fe22725bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:21.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.779+0000 7f61d3fff640 1 -- 172.21.15.79:0/2874181136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fe227168d0 msgr2=0x55fe227249d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:21.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.779+0000 7f61d3fff640 1 --2- 172.21.15.79:0/2874181136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fe227168d0 0x55fe227249d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:21.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.779+0000 7f61d3fff640 1 -- 172.21.15.79:0/2874181136 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe227263f0 con 0x55fe22719200 2024-08-20T01:41:21.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.779+0000 7f61d8925640 1 --2- 172.21.15.79:0/2874181136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fe227168d0 0x55fe227249d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:41:21.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.780+0000 7f61d3fff640 1 --2- 172.21.15.79:0/2874181136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe22719200 0x55fe22725070 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f61c0000c00 tx=0x7f61c0009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3ca0fb9fe781316 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:21.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.780+0000 7f61b3fff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:41:21.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.780+0000 7f61b3fff640 1 -- 172.21.15.79:0/2874181136 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c00aa690 con 0x55fe22719200 2024-08-20T01:41:21.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.780+0000 7f61b3fff640 1 -- 172.21.15.79:0/2874181136 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f61c00bc140 con 0x55fe22719200 2024-08-20T01:41:21.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.780+0000 7f61dda4c740 1 -- 172.21.15.79:0/2874181136 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61c803c640 con 0x55fe22719200 2024-08-20T01:41:21.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.780+0000 7f61b3fff640 1 -- 172.21.15.79:0/2874181136 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f61c00aaa30 con 0x55fe22719200 2024-08-20T01:41:21.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.780+0000 7f61dda4c740 10 client.16785 fetch_fsmap learned FSMap version 38 2024-08-20T01:41:21.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.780+0000 7f61dda4c740 1 -- 172.21.15.79:0/2874181136 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55fe227277d0 con 0x55fe22719200 2024-08-20T01:41:21.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.780+0000 7f61b3fff640 1 -- 172.21.15.79:0/2874181136 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f61c803c640 con 0x55fe22719200 2024-08-20T01:41:21.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.780+0000 7f61b3fff640 1 -- 172.21.15.79:0/2874181136 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f61c00a71b0 con 0x55fe22719200 2024-08-20T01:41:21.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.780+0000 7f61dda4c740 10 client.16785 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:41:21.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.780+0000 7f61dda4c740 10 client.16785 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:41:21.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.780+0000 7f61dda4c740 20 client.16785 populate_metadata read hostname 'smithi079' 2024-08-20T01:41:21.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.780+0000 7f61dda4c740 1 --2- 172.21.15.79:0/2874181136 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55fe22727d00 0x55fe22798670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:21.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.781+0000 7f61dda4c740 4 client.16785 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:41:21.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.781+0000 7f61dda4c740 1 -- 172.21.15.79:0/2874181136 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fe22686d50 con 0x55fe22727d00 2024-08-20T01:41:21.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.781+0000 7f61d8925640 1 --2- 172.21.15.79:0/2874181136 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55fe22727d00 0x55fe22798670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:21.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.781+0000 7f61b3fff640 10 client.16785 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:41:21.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.781+0000 7f61d8925640 1 --2- 172.21.15.79:0/2874181136 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55fe22727d00 0x55fe22798670 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddf6ab8d631a7392 server_cookie=ce0d2090c778bf1d in_seq=0 out_seq=0 2024-08-20T01:41:21.792 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.789+0000 7f61b3fff640 1 -- 172.21.15.79:0/2874181136 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fe22686d50 con 0x55fe22727d00 2024-08-20T01:41:21.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.789+0000 7f61b3fff640 10 client.16785 handle_command_reply: tid=0 2024-08-20T01:41:21.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.789+0000 7f61dda4c740 1 client.16785 shutdown 2024-08-20T01:41:21.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.789+0000 7f61dda4c740 1 -- 172.21.15.79:0/2874181136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe22719200 msgr2=0x55fe22725070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:21.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.789+0000 7f61dda4c740 1 --2- 172.21.15.79:0/2874181136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe22719200 0x55fe22725070 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f61c0000c00 tx=0x7f61c0009310 comp rx=0 tx=0).stop 2024-08-20T01:41:21.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.790+0000 7f61dda4c740 1 -- 172.21.15.79:0/2874181136 shutdown_connections 2024-08-20T01:41:21.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.790+0000 7f61dda4c740 1 --2- 172.21.15.79:0/2874181136 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55fe22727d00 0x55fe22798670 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:21.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.790+0000 7f61dda4c740 1 --2- 172.21.15.79:0/2874181136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe2271bc40 0x55fe22725bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:21.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.790+0000 7f61b3fff640 0 client.16785 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:41:21.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.790+0000 7f61dda4c740 1 --2- 172.21.15.79:0/2874181136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe22719200 0x55fe22725070 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:21.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.790+0000 7f61dda4c740 1 --2- 172.21.15.79:0/2874181136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fe227168d0 0x55fe227249d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:21.793 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.790+0000 7f61dda4c740 1 -- 172.21.15.79:0/2874181136 >> 172.21.15.79:0/2874181136 conn(0x55fe22711a20 msgr2=0x55fe22715a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:21.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.790+0000 7f61dda4c740 1 -- 172.21.15.79:0/2874181136 shutdown_connections 2024-08-20T01:41:21.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.790+0000 7f61dda4c740 1 -- 172.21.15.79:0/2874181136 wait complete. 2024-08-20T01:41:21.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.790+0000 7f61dda4c740 20 client.16785 trim_cache size 0 max 16384 2024-08-20T01:41:21.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:41:21.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:41:21.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:41:21.794 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:41:21.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.790+0000 7f61dab89640 1 -- 172.21.15.79:0/2777999468 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f61c40b3c50 msgr2=0x7f61c40b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:21.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.790+0000 7f61dab89640 1 --2- 172.21.15.79:0/2777999468 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f61c40b3c50 0x7f61c40b6110 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f61d4199750 tx=0x7f61cc004a40 comp rx=0 tx=0).stop 2024-08-20T01:41:21.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.790+0000 7f61dab89640 1 -- 172.21.15.79:0/2777999468 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61d41026b0 msgr2=0x7f61d4199020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:21.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.790+0000 7f61dab89640 1 --2- 172.21.15.79:0/2777999468 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61d41026b0 0x7f61d4199020 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f61c000e9f0 tx=0x7f61c000eeb0 comp rx=0 tx=0).stop 2024-08-20T01:41:21.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.790+0000 7f61dab89640 1 -- 172.21.15.79:0/2777999468 shutdown_connections 2024-08-20T01:41:21.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.790+0000 7f61dab89640 1 --2- 172.21.15.79:0/2777999468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61d4103070 0x7f61d4199c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:21.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.790+0000 7f61dab89640 1 --2- 172.21.15.79:0/2777999468 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61d41026b0 0x7f61d4199020 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:21.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.790+0000 7f61dab89640 1 --2- 172.21.15.79:0/2777999468 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f61c40b3c50 0x7f61c40b6110 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:21.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.790+0000 7f61dab89640 1 --2- 172.21.15.79:0/2777999468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61d4101560 0x7f61d41989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:21.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.790+0000 7f61dab89640 1 -- 172.21.15.79:0/2777999468 >> 172.21.15.79:0/2777999468 conn(0x7f61d40fce40 msgr2=0x7f61d40fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:21.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.791+0000 7f61dab89640 1 -- 172.21.15.79:0/2777999468 shutdown_connections 2024-08-20T01:41:21.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:21.791+0000 7f61dab89640 1 -- 172.21.15.79:0/2777999468 wait complete. 2024-08-20T01:41:22.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:22 smithi079 ceph-mon[18656]: pgmap v468: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 23 op/s 2024-08-20T01:41:22.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:22 smithi081 ceph-mon[22209]: pgmap v468: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 23 op/s 2024-08-20T01:41:22.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:22 smithi175 ceph-mon[22392]: pgmap v468: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 23 op/s 2024-08-20T01:41:24.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:24 smithi079 ceph-mon[18656]: pgmap v469: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 22 op/s 2024-08-20T01:41:24.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:24 smithi081 ceph-mon[22209]: pgmap v469: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 22 op/s 2024-08-20T01:41:24.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:24 smithi175 ceph-mon[22392]: pgmap v469: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 22 op/s 2024-08-20T01:41:26.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:26 smithi079 ceph-mon[18656]: pgmap v470: 97 pgs: 97 active+clean; 5.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 31 MiB/s wr, 26 op/s 2024-08-20T01:41:26.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:26 smithi081 ceph-mon[22209]: pgmap v470: 97 pgs: 97 active+clean; 5.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 31 MiB/s wr, 26 op/s 2024-08-20T01:41:26.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:26 smithi175 ceph-mon[22392]: pgmap v470: 97 pgs: 97 active+clean; 5.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 31 MiB/s wr, 26 op/s 2024-08-20T01:41:28.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:28 smithi079 ceph-mon[18656]: pgmap v471: 97 pgs: 97 active+clean; 5.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 23 op/s 2024-08-20T01:41:28.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:28 smithi081 ceph-mon[22209]: pgmap v471: 97 pgs: 97 active+clean; 5.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 23 op/s 2024-08-20T01:41:28.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:28 smithi175 ceph-mon[22392]: pgmap v471: 97 pgs: 97 active+clean; 5.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 23 op/s 2024-08-20T01:41:30.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:30 smithi079 ceph-mon[18656]: pgmap v472: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 30 MiB/s wr, 26 op/s 2024-08-20T01:41:30.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:30 smithi081 ceph-mon[22209]: pgmap v472: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 30 MiB/s wr, 26 op/s 2024-08-20T01:41:30.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:30 smithi175 ceph-mon[22392]: pgmap v472: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 30 MiB/s wr, 26 op/s 2024-08-20T01:41:32.296 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:41:32.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:32 smithi081 ceph-mon[22209]: pgmap v473: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 31 MiB/s wr, 23 op/s 2024-08-20T01:41:32.572 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:41:32.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:32 smithi175 ceph-mon[22392]: pgmap v473: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 31 MiB/s wr, 23 op/s 2024-08-20T01:41:32.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:32 smithi079 ceph-mon[18656]: pgmap v473: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 31 MiB/s wr, 23 op/s 2024-08-20T01:41:34.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:34 smithi081 ceph-mon[22209]: pgmap v474: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 22 op/s 2024-08-20T01:41:34.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:34 smithi175 ceph-mon[22392]: pgmap v474: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 22 op/s 2024-08-20T01:41:34.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:34 smithi079 ceph-mon[18656]: pgmap v474: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 22 op/s 2024-08-20T01:41:34.890 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.887+0000 7f4bace4f640 1 -- 172.21.15.79:0/1720369453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ba8103070 msgr2=0x7f4ba81099f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:34.890 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.887+0000 7f4bace4f640 1 --2- 172.21.15.79:0/1720369453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ba8103070 0x7f4ba81099f0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0009cd0 tx=0x7f4ba002a8e0 comp rx=0 tx=0).stop 2024-08-20T01:41:34.890 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.887+0000 7f4bace4f640 1 -- 172.21.15.79:0/1720369453 shutdown_connections 2024-08-20T01:41:34.890 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.887+0000 7f4bace4f640 1 --2- 172.21.15.79:0/1720369453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ba8103070 0x7f4ba81099f0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:34.890 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.887+0000 7f4bace4f640 1 --2- 172.21.15.79:0/1720369453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba81026b0 0x7f4ba8102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:34.890 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.887+0000 7f4bace4f640 1 --2- 172.21.15.79:0/1720369453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ba8101560 0x7f4ba8101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:34.890 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.887+0000 7f4bace4f640 1 -- 172.21.15.79:0/1720369453 >> 172.21.15.79:0/1720369453 conn(0x7f4ba80fce40 msgr2=0x7f4ba80ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:34.890 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.887+0000 7f4bace4f640 1 -- 172.21.15.79:0/1720369453 shutdown_connections 2024-08-20T01:41:34.890 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.887+0000 7f4bace4f640 1 -- 172.21.15.79:0/1720369453 wait complete. 2024-08-20T01:41:34.892 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.888+0000 7f4bace4f640 1 Processor -- start 2024-08-20T01:41:34.892 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.888+0000 7f4bace4f640 1 -- start start 2024-08-20T01:41:34.892 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.888+0000 7f4bace4f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ba8101560 0x7f4ba806ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:34.893 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.888+0000 7f4bace4f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba81026b0 0x7f4ba819d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:34.893 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.888+0000 7f4bace4f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ba8103070 0x7f4ba819fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:34.893 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.888+0000 7f4bace4f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba810d060 con 0x7f4ba8103070 2024-08-20T01:41:34.893 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.888+0000 7f4bace4f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba810cee0 con 0x7f4ba81026b0 2024-08-20T01:41:34.893 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.888+0000 7f4bace4f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba810d1e0 con 0x7f4ba8101560 2024-08-20T01:41:34.893 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.888+0000 7f4ba6d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ba8103070 0x7f4ba819fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:34.893 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.888+0000 7f4ba6d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ba8103070 0x7f4ba819fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39046/0 (socket says 172.21.15.79:39046) 2024-08-20T01:41:34.893 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.888+0000 7f4b9ffff640 1 --2- 172.21.15.79:0/2732683368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba81026b0 0x7f4ba819d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:34.893 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.888+0000 7f4ba6d9d640 1 -- 172.21.15.79:0/2732683368 learned_addr learned my addr 172.21.15.79:0/2732683368 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:34.893 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.889+0000 7f4ba659c640 1 --2- 172.21.15.79:0/2732683368 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ba8101560 0x7f4ba806ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:34.893 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.889+0000 7f4b9ffff640 1 -- 172.21.15.79:0/2732683368 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ba8101560 msgr2=0x7f4ba806ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:34.893 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.889+0000 7f4b9ffff640 1 --2- 172.21.15.79:0/2732683368 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ba8101560 0x7f4ba806ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:34.894 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.889+0000 7f4b9ffff640 1 -- 172.21.15.79:0/2732683368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ba8103070 msgr2=0x7f4ba819fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:34.894 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.889+0000 7f4b9ffff640 1 --2- 172.21.15.79:0/2732683368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ba8103070 0x7f4ba819fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:34.894 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.889+0000 7f4b9ffff640 1 -- 172.21.15.79:0/2732683368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba81a04e0 con 0x7f4ba81026b0 2024-08-20T01:41:34.894 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.889+0000 7f4ba6d9d640 1 --2- 172.21.15.79:0/2732683368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ba8103070 0x7f4ba819fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:41:34.894 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.889+0000 7f4b9ffff640 1 --2- 172.21.15.79:0/2732683368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba81026b0 0x7f4ba819d630 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4b9000e9f0 tx=0x7f4b9000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:34.894 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.889+0000 7f4b9f7fe640 1 -- 172.21.15.79:0/2732683368 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9000ccc0 con 0x7f4ba81026b0 2024-08-20T01:41:34.894 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.889+0000 7f4bace4f640 1 -- 172.21.15.79:0/2732683368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ba81a07d0 con 0x7f4ba81026b0 2024-08-20T01:41:34.894 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.889+0000 7f4bace4f640 1 -- 172.21.15.79:0/2732683368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ba81a0d70 con 0x7f4ba81026b0 2024-08-20T01:41:34.894 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.889+0000 7f4b9f7fe640 1 -- 172.21.15.79:0/2732683368 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b900108c0 con 0x7f4ba81026b0 2024-08-20T01:41:34.894 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.889+0000 7f4b9f7fe640 1 -- 172.21.15.79:0/2732683368 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b90018660 con 0x7f4ba81026b0 2024-08-20T01:41:34.899 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.892+0000 7f4bafc47740 1 Processor -- start 2024-08-20T01:41:34.899 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.892+0000 7f4bafc47740 1 -- start start 2024-08-20T01:41:34.899 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.892+0000 7f4bafc47740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fabdb8a40 0x561fabdbae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:34.900 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.892+0000 7f4bafc47740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fabdbb370 0x561fabdbd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:34.900 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.892+0000 7f4bafc47740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fabdbddb0 0x561fabdc0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:34.900 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.892+0000 7f4bafc47740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561fabd27360 con 0x561fabdbb370 2024-08-20T01:41:34.900 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.892+0000 7f4bafc47740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561fabd16860 con 0x561fabdb8a40 2024-08-20T01:41:34.900 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.892+0000 7f4bafc47740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561fabd1a8a0 con 0x561fabdbddb0 2024-08-20T01:41:34.900 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.892+0000 7f4b9f7fe640 1 -- 172.21.15.79:0/2732683368 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f4b90010430 con 0x7f4ba81026b0 2024-08-20T01:41:34.900 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.893+0000 7f4ba659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fabdbb370 0x561fabdbd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:34.900 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.893+0000 7f4ba6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fabdb8a40 0x561fabdbae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:34.900 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.893+0000 7f4ba659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fabdbb370 0x561fabdbd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39050/0 (socket says 172.21.15.79:39050) 2024-08-20T01:41:34.900 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.893+0000 7f4ba659c640 1 -- 172.21.15.79:0/2566938885 learned_addr learned my addr 172.21.15.79:0/2566938885 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:34.900 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.893+0000 7f4b9ffff640 1 --2- 172.21.15.79:0/2566938885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fabdbddb0 0x561fabdc0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:34.900 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.893+0000 7f4ba6d9d640 1 -- 172.21.15.79:0/2566938885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fabdbddb0 msgr2=0x561fabdc0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:34.901 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.893+0000 7f4ba6d9d640 1 --2- 172.21.15.79:0/2566938885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fabdbddb0 0x561fabdc0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:34.901 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.893+0000 7f4ba6d9d640 1 -- 172.21.15.79:0/2566938885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fabdbb370 msgr2=0x561fabdbd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:34.901 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.893+0000 7f4ba6d9d640 1 --2- 172.21.15.79:0/2566938885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fabdbb370 0x561fabdbd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:34.901 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.893+0000 7f4ba6d9d640 1 -- 172.21.15.79:0/2566938885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fabcbde40 con 0x561fabdb8a40 2024-08-20T01:41:34.901 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.893+0000 7f4ba6d9d640 1 --2- 172.21.15.79:0/2566938885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fabdb8a40 0x561fabdbae30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0009ca0 tx=0x7f4ba0005fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11aa4a4cbf3f3508 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:34.901 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.893+0000 7f4b9cff9640 1 -- 172.21.15.79:0/2566938885 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0048070 con 0x561fabdb8a40 2024-08-20T01:41:34.901 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.893+0000 7f4b9cff9640 1 -- 172.21.15.79:0/2566938885 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4ba0036070 con 0x561fabdb8a40 2024-08-20T01:41:34.901 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.893+0000 7f4b9cff9640 1 -- 172.21.15.79:0/2566938885 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba00305a0 con 0x561fabdb8a40 2024-08-20T01:41:34.901 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.893+0000 7f4b9f7fe640 1 --2- 172.21.15.79:0/2732683368 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4b940b3bd0 0x7f4b940b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:34.901 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.894+0000 7f4ba659c640 1 --2- 172.21.15.79:0/2732683368 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4b940b3bd0 0x7f4b940b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:34.901 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.894+0000 7f4b9f7fe640 1 -- 172.21.15.79:0/2732683368 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f4b900e4080 con 0x7f4ba81026b0 2024-08-20T01:41:34.901 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.894+0000 7f4ba659c640 1 --2- 172.21.15.79:0/2732683368 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4b940b3bd0 0x7f4b940b6090 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4b98005fd0 tx=0x7f4b9800b5a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:34.901 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.894+0000 7f4bafc47740 1 -- 172.21.15.79:0/2566938885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fabdb8a40 msgr2=0x561fabdbae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:34.902 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.894+0000 7f4bafc47740 1 --2- 172.21.15.79:0/2566938885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fabdb8a40 0x561fabdbae30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0009ca0 tx=0x7f4ba0005fa0 comp rx=0 tx=0).stop 2024-08-20T01:41:34.902 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.894+0000 7f4bafc47740 1 -- 172.21.15.79:0/2566938885 shutdown_connections 2024-08-20T01:41:34.902 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.894+0000 7f4bafc47740 1 --2- 172.21.15.79:0/2566938885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fabdbddb0 0x561fabdc0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:34.902 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.894+0000 7f4bafc47740 1 --2- 172.21.15.79:0/2566938885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fabdbb370 0x561fabdbd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:34.902 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.894+0000 7f4bafc47740 1 --2- 172.21.15.79:0/2566938885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fabdb8a40 0x561fabdbae30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:34.902 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.894+0000 7f4bafc47740 1 -- 172.21.15.79:0/2566938885 >> 172.21.15.79:0/2566938885 conn(0x561fabdaf730 msgr2=0x561fabdb0510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:34.902 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.894+0000 7f4bafc47740 1 -- 172.21.15.79:0/2566938885 shutdown_connections 2024-08-20T01:41:34.902 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.894+0000 7f4bafc47740 1 -- 172.21.15.79:0/2566938885 wait complete. 2024-08-20T01:41:34.902 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.895+0000 7f4bafc47740 1 -- start start 2024-08-20T01:41:34.902 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.895+0000 7f4bafc47740 1 Processor -- start 2024-08-20T01:41:34.902 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.895+0000 7f4bafc47740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fabdb8a40 0x561fabdc22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:34.902 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.895+0000 7f4bafc47740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fabdbb370 0x561fabdc2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:34.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.895+0000 7f4bafc47740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fabdbddb0 0x561fabdc3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:34.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.895+0000 7f4bafc47740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561fabc4fab0 con 0x561fabdb8a40 2024-08-20T01:41:34.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.895+0000 7f4bafc47740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561fabc9d780 con 0x561fabdbb370 2024-08-20T01:41:34.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.895+0000 7f4bafc47740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561fabdc0d30 con 0x561fabdbddb0 2024-08-20T01:41:34.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.895+0000 7f4bafc47740 10 client.0 _ll_register_callbacks cb 0x561faba25a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:34.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.895+0000 7f4ba659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fabdb8a40 0x561fabdc22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:34.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.895+0000 7f4ba659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fabdb8a40 0x561fabdc22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39062/0 (socket says 172.21.15.79:39062) 2024-08-20T01:41:34.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.895+0000 7f4ba659c640 1 -- 172.21.15.79:0/3649285804 learned_addr learned my addr 172.21.15.79:0/3649285804 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:34.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.895+0000 7f4b9ffff640 1 --2- 172.21.15.79:0/3649285804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fabdbb370 0x561fabdc2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:34.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.895+0000 7f4ba6d9d640 1 --2- 172.21.15.79:0/3649285804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fabdbddb0 0x561fabdc3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:34.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.896+0000 7f4ba659c640 1 -- 172.21.15.79:0/3649285804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fabdbddb0 msgr2=0x561fabdc3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:34.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.896+0000 7f4ba659c640 1 --2- 172.21.15.79:0/3649285804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fabdbddb0 0x561fabdc3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:34.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.896+0000 7f4ba659c640 1 -- 172.21.15.79:0/3649285804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fabdbb370 msgr2=0x561fabdc2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:34.904 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.896+0000 7f4ba659c640 1 --2- 172.21.15.79:0/3649285804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fabdbb370 0x561fabdc2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:34.904 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.896+0000 7f4ba659c640 1 -- 172.21.15.79:0/3649285804 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561faba79790 con 0x561fabdb8a40 2024-08-20T01:41:34.904 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.896+0000 7f4ba659c640 1 --2- 172.21.15.79:0/3649285804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fabdb8a40 0x561fabdc22d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f4b98004370 tx=0x7f4b980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f04a3523724f4a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:34.904 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.896+0000 7f4b8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:41:34.904 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.896+0000 7f4b8dffb640 1 -- 172.21.15.79:0/3649285804 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9801f630 con 0x561fabdb8a40 2024-08-20T01:41:34.904 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.896+0000 7f4b8dffb640 1 -- 172.21.15.79:0/3649285804 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f4b9801f7d0 con 0x561fabdb8a40 2024-08-20T01:41:34.904 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.896+0000 7f4bafc47740 1 -- 172.21.15.79:0/3649285804 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561fabcc5e00 con 0x561fabdb8a40 2024-08-20T01:41:34.904 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.896+0000 7f4b8dffb640 1 -- 172.21.15.79:0/3649285804 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f4b9801f9d0 con 0x561fabdb8a40 2024-08-20T01:41:34.904 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.896+0000 7f4bafc47740 10 client.16797 fetch_fsmap learned FSMap version 38 2024-08-20T01:41:34.904 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.896+0000 7f4bafc47740 1 -- 172.21.15.79:0/3649285804 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x561fabaf2620 con 0x561fabdb8a40 2024-08-20T01:41:34.904 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.896+0000 7f4b8dffb640 1 -- 172.21.15.79:0/3649285804 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x561fabcc5e00 con 0x561fabdb8a40 2024-08-20T01:41:34.904 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.897+0000 7f4b8dffb640 1 -- 172.21.15.79:0/3649285804 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f4b98027c70 con 0x561fabdb8a40 2024-08-20T01:41:34.904 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.897+0000 7f4bafc47740 10 client.16797 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:41:34.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.897+0000 7f4bafc47740 10 client.16797 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:41:34.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.897+0000 7f4bafc47740 20 client.16797 populate_metadata read hostname 'smithi079' 2024-08-20T01:41:34.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.897+0000 7f4bafc47740 1 --2- 172.21.15.79:0/3649285804 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x561fabdcdce0 0x561fabdd0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:34.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.897+0000 7f4bafc47740 4 client.16797 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:41:34.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.897+0000 7f4bafc47740 1 -- 172.21.15.79:0/3649285804 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561fabd292b0 con 0x561fabdcdce0 2024-08-20T01:41:34.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.897+0000 7f4b9ffff640 1 --2- 172.21.15.79:0/3649285804 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x561fabdcdce0 0x561fabdd0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:34.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.897+0000 7f4b8dffb640 10 client.16797 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:41:34.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.897+0000 7f4b9ffff640 1 --2- 172.21.15.79:0/3649285804 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x561fabdcdce0 0x561fabdd0140 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f465ad8dad37603a server_cookie=b19516291f722632 in_seq=0 out_seq=0 2024-08-20T01:41:34.906 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.898+0000 7f4b8dffb640 1 -- 172.21.15.79:0/3649285804 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561fabd292b0 con 0x561fabdcdce0 2024-08-20T01:41:34.906 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.898+0000 7f4b8dffb640 10 client.16797 handle_command_reply: tid=0 2024-08-20T01:41:34.906 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.898+0000 7f4bafc47740 1 client.16797 shutdown 2024-08-20T01:41:34.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.898+0000 7f4bafc47740 1 -- 172.21.15.79:0/3649285804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fabdb8a40 msgr2=0x561fabdc22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:34.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.898+0000 7f4bafc47740 1 --2- 172.21.15.79:0/3649285804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fabdb8a40 0x561fabdc22d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f4b98004370 tx=0x7f4b980046c0 comp rx=0 tx=0).stop 2024-08-20T01:41:34.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.898+0000 7f4bafc47740 1 -- 172.21.15.79:0/3649285804 shutdown_connections 2024-08-20T01:41:34.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.898+0000 7f4bafc47740 1 --2- 172.21.15.79:0/3649285804 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x561fabdcdce0 0x561fabdd0140 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:34.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.898+0000 7f4bafc47740 1 --2- 172.21.15.79:0/3649285804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fabdbddb0 0x561fabdc3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:34.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.898+0000 7f4bafc47740 1 --2- 172.21.15.79:0/3649285804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fabdbb370 0x561fabdc2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:34.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.898+0000 7f4bafc47740 1 --2- 172.21.15.79:0/3649285804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fabdb8a40 0x561fabdc22d0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:34.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.898+0000 7f4bafc47740 1 -- 172.21.15.79:0/3649285804 >> 172.21.15.79:0/3649285804 conn(0x561fabdaf730 msgr2=0x561fabdae850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:34.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.898+0000 7f4b8dffb640 0 client.16797 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:41:34.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.898+0000 7f4bafc47740 1 -- 172.21.15.79:0/3649285804 shutdown_connections 2024-08-20T01:41:34.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.898+0000 7f4bafc47740 1 -- 172.21.15.79:0/3649285804 wait complete. 2024-08-20T01:41:34.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.898+0000 7f4bafc47740 20 client.16797 trim_cache size 0 max 16384 2024-08-20T01:41:34.916 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.914+0000 7f4bafc47740 1 Processor -- start 2024-08-20T01:41:34.916 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.914+0000 7f4bafc47740 1 -- start start 2024-08-20T01:41:34.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.914+0000 7f4bafc47740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fabdb8a40 0x561fabdaa640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:34.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.914+0000 7f4bafc47740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fabdbb370 0x561fabdaff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:34.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.914+0000 7f4bafc47740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fabdbddb0 0x561fabdb04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:34.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.914+0000 7f4bafc47740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba81a77c0 con 0x561fabdb8a40 2024-08-20T01:41:34.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.914+0000 7f4bafc47740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba81a9300 con 0x561fabdbb370 2024-08-20T01:41:34.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.914+0000 7f4bafc47740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba81a7e90 con 0x561fabdbddb0 2024-08-20T01:41:34.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.914+0000 7f4ba659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fabdb8a40 0x561fabdaa640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:34.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.914+0000 7f4ba659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fabdb8a40 0x561fabdaa640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39070/0 (socket says 172.21.15.79:39070) 2024-08-20T01:41:34.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.914+0000 7f4ba659c640 1 -- 172.21.15.79:0/3425571804 learned_addr learned my addr 172.21.15.79:0/3425571804 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:34.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.914+0000 7f4b9ffff640 1 --2- 172.21.15.79:0/3425571804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fabdbb370 0x561fabdaff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:34.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.915+0000 7f4ba6d9d640 1 --2- 172.21.15.79:0/3425571804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fabdbddb0 0x561fabdb04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:34.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.915+0000 7f4ba659c640 1 -- 172.21.15.79:0/3425571804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fabdbddb0 msgr2=0x561fabdb04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:34.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.915+0000 7f4ba659c640 1 --2- 172.21.15.79:0/3425571804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fabdbddb0 0x561fabdb04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:34.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.915+0000 7f4ba659c640 1 -- 172.21.15.79:0/3425571804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fabdbb370 msgr2=0x561fabdaff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:34.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.915+0000 7f4ba659c640 1 --2- 172.21.15.79:0/3425571804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fabdbb370 0x561fabdaff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:34.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.915+0000 7f4ba659c640 1 -- 172.21.15.79:0/3425571804 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fabdc38b0 con 0x561fabdb8a40 2024-08-20T01:41:34.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.915+0000 7f4ba6d9d640 1 --2- 172.21.15.79:0/3425571804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fabdbddb0 0x561fabdb04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:41:34.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.915+0000 7f4ba659c640 1 --2- 172.21.15.79:0/3425571804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fabdb8a40 0x561fabdaa640 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f4b98032540 tx=0x7f4b9800bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=106fa182dfeb0b61 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:34.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.915+0000 7f4b8ffff640 1 -- 172.21.15.79:0/3425571804 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b98004460 con 0x561fabdb8a40 2024-08-20T01:41:34.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.915+0000 7f4b8ffff640 1 -- 172.21.15.79:0/3425571804 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b98042020 con 0x561fabdb8a40 2024-08-20T01:41:34.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.915+0000 7f4b8ffff640 1 -- 172.21.15.79:0/3425571804 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b98005030 con 0x561fabdb8a40 2024-08-20T01:41:34.922 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.916+0000 7f4bafc47740 1 -- 172.21.15.79:0/3425571804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fabdb8a40 msgr2=0x561fabdaa640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:34.922 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.916+0000 7f4bafc47740 1 --2- 172.21.15.79:0/3425571804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fabdb8a40 0x561fabdaa640 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f4b98032540 tx=0x7f4b9800bbb0 comp rx=0 tx=0).stop 2024-08-20T01:41:34.922 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.916+0000 7f4bafc47740 1 -- 172.21.15.79:0/3425571804 shutdown_connections 2024-08-20T01:41:34.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.916+0000 7f4bafc47740 1 --2- 172.21.15.79:0/3425571804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fabdbddb0 0x561fabdb04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:34.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.916+0000 7f4bafc47740 1 --2- 172.21.15.79:0/3425571804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fabdbb370 0x561fabdaff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:34.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.916+0000 7f4bafc47740 1 --2- 172.21.15.79:0/3425571804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fabdb8a40 0x561fabdaa640 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:34.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.916+0000 7f4bafc47740 1 -- 172.21.15.79:0/3425571804 >> 172.21.15.79:0/3425571804 conn(0x561fabdaf730 msgr2=0x561fabdbf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:34.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.916+0000 7f4bafc47740 1 -- 172.21.15.79:0/3425571804 shutdown_connections 2024-08-20T01:41:34.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.916+0000 7f4bafc47740 1 -- 172.21.15.79:0/3425571804 wait complete. 2024-08-20T01:41:34.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.917+0000 7f4bafc47740 1 -- start start 2024-08-20T01:41:34.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.917+0000 7f4bafc47740 1 Processor -- start 2024-08-20T01:41:34.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.917+0000 7f4bafc47740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fabdb8a40 0x561fabdb8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:34.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.917+0000 7f4bafc47740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fabdbb370 0x561fabdb6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:34.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.917+0000 7f4bafc47740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fabdbddb0 0x561fabdb7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:34.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.917+0000 7f4bafc47740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba81a8c30 con 0x561fabdb8a40 2024-08-20T01:41:34.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.917+0000 7f4bafc47740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba81a8560 con 0x561fabdbddb0 2024-08-20T01:41:34.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.917+0000 7f4bafc47740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba81a57a0 con 0x561fabdbb370 2024-08-20T01:41:34.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.917+0000 7f4bafc47740 10 client.0 _ll_register_callbacks cb 0x7f4b98004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:34.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.917+0000 7f4ba659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fabdb8a40 0x561fabdb8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:34.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.917+0000 7f4ba659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fabdb8a40 0x561fabdb8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39086/0 (socket says 172.21.15.79:39086) 2024-08-20T01:41:34.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.917+0000 7f4ba659c640 1 -- 172.21.15.79:0/3680059404 learned_addr learned my addr 172.21.15.79:0/3680059404 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:34.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.917+0000 7f4ba6d9d640 1 --2- 172.21.15.79:0/3680059404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fabdbddb0 0x561fabdb7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:34.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.917+0000 7f4b9ffff640 1 --2- 172.21.15.79:0/3680059404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fabdbb370 0x561fabdb6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:34.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.917+0000 7f4ba659c640 1 -- 172.21.15.79:0/3680059404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fabdbb370 msgr2=0x561fabdb6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:34.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.917+0000 7f4ba659c640 1 --2- 172.21.15.79:0/3680059404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fabdbb370 0x561fabdb6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:34.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.917+0000 7f4ba659c640 1 -- 172.21.15.79:0/3680059404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fabdbddb0 msgr2=0x561fabdb7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:34.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.917+0000 7f4ba659c640 1 --2- 172.21.15.79:0/3680059404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fabdbddb0 0x561fabdb7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:34.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.918+0000 7f4ba659c640 1 -- 172.21.15.79:0/3680059404 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fabe329b0 con 0x561fabdb8a40 2024-08-20T01:41:34.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.918+0000 7f4b9ffff640 1 --2- 172.21.15.79:0/3680059404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fabdbb370 0x561fabdb6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:41:34.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.918+0000 7f4ba6d9d640 1 --2- 172.21.15.79:0/3680059404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fabdbddb0 0x561fabdb7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:41:34.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.918+0000 7f4ba659c640 1 --2- 172.21.15.79:0/3680059404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fabdb8a40 0x561fabdb8480 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f4b98044040 tx=0x7f4b98020db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=156e766338837ae6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:34.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.918+0000 7f4b8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:41:34.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.918+0000 7f4b8dffb640 1 -- 172.21.15.79:0/3680059404 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b98005450 con 0x561fabdb8a40 2024-08-20T01:41:34.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.918+0000 7f4b8dffb640 1 -- 172.21.15.79:0/3680059404 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f4b980326b0 con 0x561fabdb8a40 2024-08-20T01:41:34.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.918+0000 7f4bafc47740 1 -- 172.21.15.79:0/3680059404 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b98042020 con 0x561fabdb8a40 2024-08-20T01:41:34.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.918+0000 7f4b8dffb640 1 -- 172.21.15.79:0/3680059404 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f4b980055f0 con 0x561fabdb8a40 2024-08-20T01:41:34.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.918+0000 7f4bafc47740 10 client.16803 fetch_fsmap learned FSMap version 38 2024-08-20T01:41:34.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.918+0000 7f4bafc47740 1 -- 172.21.15.79:0/3680059404 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x561fabe33bb0 con 0x561fabdb8a40 2024-08-20T01:41:34.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.918+0000 7f4b8dffb640 1 -- 172.21.15.79:0/3680059404 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b98042020 con 0x561fabdb8a40 2024-08-20T01:41:34.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.918+0000 7f4b8dffb640 1 -- 172.21.15.79:0/3680059404 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f4b980049d0 con 0x561fabdb8a40 2024-08-20T01:41:34.926 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.919+0000 7f4bafc47740 10 client.16803 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:41:34.926 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.919+0000 7f4bafc47740 10 client.16803 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:41:34.926 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.919+0000 7f4bafc47740 20 client.16803 populate_metadata read hostname 'smithi079' 2024-08-20T01:41:34.926 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.919+0000 7f4bafc47740 1 --2- 172.21.15.79:0/3680059404 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x561fabe34440 0x561fabe36860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:34.926 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.919+0000 7f4bafc47740 4 client.16803 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:41:34.926 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.919+0000 7f4bafc47740 1 -- 172.21.15.79:0/3680059404 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561fabd24d50 con 0x561fabe34440 2024-08-20T01:41:34.926 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.919+0000 7f4b9ffff640 1 --2- 172.21.15.79:0/3680059404 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x561fabe34440 0x561fabe36860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:34.926 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.919+0000 7f4b8dffb640 10 client.16803 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:41:34.926 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.919+0000 7f4b9ffff640 1 --2- 172.21.15.79:0/3680059404 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x561fabe34440 0x561fabe36860 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=278edb2e8974d2d1 server_cookie=b29fabb557084761 in_seq=0 out_seq=0 2024-08-20T01:41:34.931 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.927+0000 7f4b8dffb640 1 -- 172.21.15.79:0/3680059404 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561fabd24d50 con 0x561fabe34440 2024-08-20T01:41:34.931 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.927+0000 7f4b8dffb640 10 client.16803 handle_command_reply: tid=0 2024-08-20T01:41:34.931 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.928+0000 7f4bafc47740 1 client.16803 shutdown 2024-08-20T01:41:34.931 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.928+0000 7f4bafc47740 1 -- 172.21.15.79:0/3680059404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fabdb8a40 msgr2=0x561fabdb8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:34.931 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.928+0000 7f4bafc47740 1 --2- 172.21.15.79:0/3680059404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fabdb8a40 0x561fabdb8480 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f4b98044040 tx=0x7f4b98020db0 comp rx=0 tx=0).stop 2024-08-20T01:41:34.931 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.928+0000 7f4bafc47740 1 -- 172.21.15.79:0/3680059404 shutdown_connections 2024-08-20T01:41:34.931 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.928+0000 7f4bafc47740 1 --2- 172.21.15.79:0/3680059404 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x561fabe34440 0x561fabe36860 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:34.931 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.928+0000 7f4bafc47740 1 --2- 172.21.15.79:0/3680059404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fabdbddb0 0x561fabdb7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:34.931 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.928+0000 7f4b8dffb640 0 client.16803 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:41:34.931 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.928+0000 7f4bafc47740 1 --2- 172.21.15.79:0/3680059404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fabdbb370 0x561fabdb6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:34.932 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.928+0000 7f4bafc47740 1 --2- 172.21.15.79:0/3680059404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fabdb8a40 0x561fabdb8480 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:34.932 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.928+0000 7f4bafc47740 1 -- 172.21.15.79:0/3680059404 >> 172.21.15.79:0/3680059404 conn(0x561fabdaf730 msgr2=0x561fabdbf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:34.932 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.928+0000 7f4bafc47740 1 -- 172.21.15.79:0/3680059404 shutdown_connections 2024-08-20T01:41:34.932 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.928+0000 7f4bafc47740 1 -- 172.21.15.79:0/3680059404 wait complete. 2024-08-20T01:41:34.932 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.928+0000 7f4bafc47740 20 client.16803 trim_cache size 0 max 16384 2024-08-20T01:41:34.932 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:41:34.932 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:41:34.932 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:41:34.932 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:41:34.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.929+0000 7f4bace4f640 1 -- 172.21.15.79:0/2732683368 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4b940b3bd0 msgr2=0x7f4b940b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:34.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.929+0000 7f4bace4f640 1 --2- 172.21.15.79:0/2732683368 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4b940b3bd0 0x7f4b940b6090 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4b98005fd0 tx=0x7f4b9800b5a0 comp rx=0 tx=0).stop 2024-08-20T01:41:34.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.929+0000 7f4bace4f640 1 -- 172.21.15.79:0/2732683368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba81026b0 msgr2=0x7f4ba819d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:34.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.929+0000 7f4bace4f640 1 --2- 172.21.15.79:0/2732683368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba81026b0 0x7f4ba819d630 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4b9000e9f0 tx=0x7f4b9000eeb0 comp rx=0 tx=0).stop 2024-08-20T01:41:34.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.929+0000 7f4bace4f640 1 -- 172.21.15.79:0/2732683368 shutdown_connections 2024-08-20T01:41:34.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.929+0000 7f4bace4f640 1 --2- 172.21.15.79:0/2732683368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ba8103070 0x7f4ba819fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:34.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.929+0000 7f4bace4f640 1 --2- 172.21.15.79:0/2732683368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba81026b0 0x7f4ba819d630 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:34.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.929+0000 7f4bace4f640 1 --2- 172.21.15.79:0/2732683368 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4b940b3bd0 0x7f4b940b6090 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:34.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.929+0000 7f4bace4f640 1 --2- 172.21.15.79:0/2732683368 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ba8101560 0x7f4ba806ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:34.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.929+0000 7f4bace4f640 1 -- 172.21.15.79:0/2732683368 >> 172.21.15.79:0/2732683368 conn(0x7f4ba80fce40 msgr2=0x7f4ba8105aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:34.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.929+0000 7f4bace4f640 1 -- 172.21.15.79:0/2732683368 shutdown_connections 2024-08-20T01:41:34.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:34.929+0000 7f4bace4f640 1 -- 172.21.15.79:0/2732683368 wait complete. 2024-08-20T01:41:36.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:36 smithi079 ceph-mon[18656]: pgmap v475: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 31 MiB/s wr, 25 op/s 2024-08-20T01:41:36.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:36 smithi081 ceph-mon[22209]: pgmap v475: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 31 MiB/s wr, 25 op/s 2024-08-20T01:41:36.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:36 smithi175 ceph-mon[22392]: pgmap v475: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 31 MiB/s wr, 25 op/s 2024-08-20T01:41:37.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.098+0000 7fbbcb09d640 1 -- 172.21.15.79:0/2349126320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbc41073c0 msgr2=0x7fbbc4107800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:37.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.098+0000 7fbbcb09d640 1 --2- 172.21.15.79:0/2349126320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbc41073c0 0x7fbbc4107800 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0009900 tx=0x7fbbb002a410 comp rx=0 tx=0).stop 2024-08-20T01:41:37.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.098+0000 7fbbcb09d640 1 -- 172.21.15.79:0/2349126320 shutdown_connections 2024-08-20T01:41:37.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.098+0000 7fbbcb09d640 1 --2- 172.21.15.79:0/2349126320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbc4107d40 0x7fbbc410e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:37.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.098+0000 7fbbcb09d640 1 --2- 172.21.15.79:0/2349126320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbc41073c0 0x7fbbc4107800 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:37.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.098+0000 7fbbcb09d640 1 --2- 172.21.15.79:0/2349126320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbc41019b0 0x7fbbc4101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:37.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.098+0000 7fbbcb09d640 1 -- 172.21.15.79:0/2349126320 >> 172.21.15.79:0/2349126320 conn(0x7fbbc40fd400 msgr2=0x7fbbc40ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:37.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.099+0000 7fbbcb09d640 1 -- 172.21.15.79:0/2349126320 shutdown_connections 2024-08-20T01:41:37.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.099+0000 7fbbcb09d640 1 -- 172.21.15.79:0/2349126320 wait complete. 2024-08-20T01:41:37.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.100+0000 7fbbcb09d640 1 Processor -- start 2024-08-20T01:41:37.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.100+0000 7fbbcb09d640 1 -- start start 2024-08-20T01:41:37.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.100+0000 7fbbcb09d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbc41019b0 0x7fbbc4198f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:37.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.100+0000 7fbbcb09d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbc41073c0 0x7fbbc4199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:37.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.100+0000 7fbbcb09d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbc4107d40 0x7fbbc419e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:37.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.100+0000 7fbbcb09d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc4111900 con 0x7fbbc41019b0 2024-08-20T01:41:37.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.100+0000 7fbbcb09d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc4111780 con 0x7fbbc4107d40 2024-08-20T01:41:37.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.100+0000 7fbbcb09d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc4111a80 con 0x7fbbc41073c0 2024-08-20T01:41:37.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.100+0000 7fbbc8e39640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbc41019b0 0x7fbbc4198f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:37.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.100+0000 7fbbc8e39640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbc41019b0 0x7fbbc4198f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39098/0 (socket says 172.21.15.79:39098) 2024-08-20T01:41:37.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.100+0000 7fbbc8e39640 1 -- 172.21.15.79:0/2838883667 learned_addr learned my addr 172.21.15.79:0/2838883667 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:37.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.101+0000 7fbbc963a640 1 --2- 172.21.15.79:0/2838883667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbc4107d40 0x7fbbc419e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:37.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.101+0000 7fbbc8e39640 1 -- 172.21.15.79:0/2838883667 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbc41073c0 msgr2=0x7fbbc4199470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:37.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.101+0000 7fbbc8e39640 1 --2- 172.21.15.79:0/2838883667 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbc41073c0 0x7fbbc4199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:37.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.101+0000 7fbbc8e39640 1 -- 172.21.15.79:0/2838883667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbc4107d40 msgr2=0x7fbbc419e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:37.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.101+0000 7fbbc8e39640 1 --2- 172.21.15.79:0/2838883667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbc4107d40 0x7fbbc419e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:37.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.101+0000 7fbbc8e39640 1 -- 172.21.15.79:0/2838883667 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbc419efe0 con 0x7fbbc41019b0 2024-08-20T01:41:37.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.101+0000 7fbbc8e39640 1 --2- 172.21.15.79:0/2838883667 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbc41019b0 0x7fbbc4198f30 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fbbb800d950 tx=0x7fbbb800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:37.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.101+0000 7fbbc1ffb640 1 -- 172.21.15.79:0/2838883667 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb8017030 con 0x7fbbc41019b0 2024-08-20T01:41:37.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.101+0000 7fbbcb09d640 1 -- 172.21.15.79:0/2838883667 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbc419f2d0 con 0x7fbbc41019b0 2024-08-20T01:41:37.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.101+0000 7fbbc1ffb640 1 -- 172.21.15.79:0/2838883667 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbbb8004020 con 0x7fbbc41019b0 2024-08-20T01:41:37.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.101+0000 7fbbc1ffb640 1 -- 172.21.15.79:0/2838883667 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb80055d0 con 0x7fbbc41019b0 2024-08-20T01:41:37.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.102+0000 7fbbcb09d640 1 -- 172.21.15.79:0/2838883667 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbc41a5b60 con 0x7fbbc41019b0 2024-08-20T01:41:37.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.105+0000 7fbbcd496740 1 Processor -- start 2024-08-20T01:41:37.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.105+0000 7fbbcd496740 1 -- start start 2024-08-20T01:41:37.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.106+0000 7fbbcd496740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587614ed830 0x5587614edc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:37.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.106+0000 7fbbc1ffb640 1 -- 172.21.15.79:0/2838883667 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fbbb8009a30 con 0x7fbbc41019b0 2024-08-20T01:41:37.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.106+0000 7fbbcd496740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587614ee150 0x5587614fdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:37.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.106+0000 7fbbcd496740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587614fe4f0 0x5587615008e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:37.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.106+0000 7fbbcd496740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5587614648e0 con 0x5587614ee150 2024-08-20T01:41:37.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.106+0000 7fbbcd496740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558761453de0 con 0x5587614ed830 2024-08-20T01:41:37.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.106+0000 7fbbcd496740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558761457e20 con 0x5587614fe4f0 2024-08-20T01:41:37.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.106+0000 7fbbc3fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587614fe4f0 0x5587615008e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:37.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.106+0000 7fbbc963a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587614ed830 0x5587614edc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:37.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.106+0000 7fbbc963a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587614ed830 0x5587614edc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:47998/0 (socket says 172.21.15.79:47998) 2024-08-20T01:41:37.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.106+0000 7fbbc3fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587614fe4f0 0x5587615008e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:33750/0 (socket says 172.21.15.79:33750) 2024-08-20T01:41:37.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.106+0000 7fbbc963a640 1 -- 172.21.15.79:0/3152448056 learned_addr learned my addr 172.21.15.79:0/3152448056 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:37.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.106+0000 7fbbc8e39640 1 --2- 172.21.15.79:0/3152448056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587614ee150 0x5587614fdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:37.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.106+0000 7fbbc963a640 1 -- 172.21.15.79:0/3152448056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587614fe4f0 msgr2=0x5587615008e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:37.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.106+0000 7fbbc963a640 1 --2- 172.21.15.79:0/3152448056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587614fe4f0 0x5587615008e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:37.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.106+0000 7fbbc963a640 1 -- 172.21.15.79:0/3152448056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587614ee150 msgr2=0x5587614fdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:37.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.107+0000 7fbbc963a640 1 --2- 172.21.15.79:0/3152448056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587614ee150 0x5587614fdfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:37.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.107+0000 7fbbc963a640 1 -- 172.21.15.79:0/3152448056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587611b3650 con 0x5587614ed830 2024-08-20T01:41:37.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.107+0000 7fbbc963a640 1 --2- 172.21.15.79:0/3152448056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587614ed830 0x5587614edc10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc009f20 tx=0x7fbbbc00f7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb87f95649e8240e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:37.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.107+0000 7fbbc1ffb640 1 --2- 172.21.15.79:0/2838883667 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbbb40b3cd0 0x7fbbb40b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:37.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.107+0000 7fbbaeffd640 1 -- 172.21.15.79:0/3152448056 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc015070 con 0x5587614ed830 2024-08-20T01:41:37.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.107+0000 7fbbc8e39640 1 --2- 172.21.15.79:0/2838883667 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbbb40b3cd0 0x7fbbb40b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:37.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.107+0000 7fbbaeffd640 1 -- 172.21.15.79:0/3152448056 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbbbc0118d0 con 0x5587614ed830 2024-08-20T01:41:37.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.107+0000 7fbbaeffd640 1 -- 172.21.15.79:0/3152448056 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc010890 con 0x5587614ed830 2024-08-20T01:41:37.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.107+0000 7fbbc1ffb640 1 -- 172.21.15.79:0/2838883667 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fbbb80e36d0 con 0x7fbbc41019b0 2024-08-20T01:41:37.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.108+0000 7fbbc8e39640 1 --2- 172.21.15.79:0/2838883667 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbbb40b3cd0 0x7fbbb40b6190 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbbb801b000 tx=0x7fbbb8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:37.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.108+0000 7fbbcd496740 1 -- 172.21.15.79:0/3152448056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587614ed830 msgr2=0x5587614edc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:37.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.108+0000 7fbbcd496740 1 --2- 172.21.15.79:0/3152448056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587614ed830 0x5587614edc10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc009f20 tx=0x7fbbbc00f7f0 comp rx=0 tx=0).stop 2024-08-20T01:41:37.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.108+0000 7fbbcd496740 1 -- 172.21.15.79:0/3152448056 shutdown_connections 2024-08-20T01:41:37.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.108+0000 7fbbcd496740 1 --2- 172.21.15.79:0/3152448056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587614fe4f0 0x5587615008e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:37.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.108+0000 7fbbcd496740 1 --2- 172.21.15.79:0/3152448056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587614ee150 0x5587614fdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:37.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.108+0000 7fbbcd496740 1 --2- 172.21.15.79:0/3152448056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587614ed830 0x5587614edc10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:37.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.108+0000 7fbbcd496740 1 -- 172.21.15.79:0/3152448056 >> 172.21.15.79:0/3152448056 conn(0x5587614eb660 msgr2=0x5587614ec800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:37.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.108+0000 7fbbcd496740 1 -- 172.21.15.79:0/3152448056 shutdown_connections 2024-08-20T01:41:37.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.108+0000 7fbbcd496740 1 -- 172.21.15.79:0/3152448056 wait complete. 2024-08-20T01:41:37.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.109+0000 7fbbcd496740 1 -- start start 2024-08-20T01:41:37.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.109+0000 7fbbcd496740 1 Processor -- start 2024-08-20T01:41:37.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.109+0000 7fbbcd496740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587614ed830 0x5587614fb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:37.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.109+0000 7fbbcd496740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587614ee150 0x5587614fb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:37.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.109+0000 7fbbcd496740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587614fe4f0 0x5587614fbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:37.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.109+0000 7fbbcd496740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5587612b6700 con 0x5587614fe4f0 2024-08-20T01:41:37.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.109+0000 7fbbcd496740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5587613da7c0 con 0x5587614ed830 2024-08-20T01:41:37.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.109+0000 7fbbcd496740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5587615011f0 con 0x5587614ee150 2024-08-20T01:41:37.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.109+0000 7fbbcd496740 10 client.0 _ll_register_callbacks cb 0x55876144d6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:37.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.109+0000 7fbbc963a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587614fe4f0 0x5587614fbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:37.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.109+0000 7fbbc963a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587614fe4f0 0x5587614fbf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39110/0 (socket says 172.21.15.79:39110) 2024-08-20T01:41:37.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.109+0000 7fbbc963a640 1 -- 172.21.15.79:0/1648728207 learned_addr learned my addr 172.21.15.79:0/1648728207 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:37.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.109+0000 7fbbc3fff640 1 --2- 172.21.15.79:0/1648728207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587614ee150 0x5587614fb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:37.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.110+0000 7fbbc963a640 1 --2- 172.21.15.79:0/1648728207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587614ed830 0x5587614fb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:37.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.110+0000 7fbbc963a640 1 -- 172.21.15.79:0/1648728207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587614ee150 msgr2=0x5587614fb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:37.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.110+0000 7fbbc963a640 1 --2- 172.21.15.79:0/1648728207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587614ee150 0x5587614fb9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:37.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.110+0000 7fbbc963a640 1 -- 172.21.15.79:0/1648728207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587614ed830 msgr2=0x5587614fb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:37.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.110+0000 7fbbc963a640 1 --2- 172.21.15.79:0/1648728207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587614ed830 0x5587614fb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:37.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.110+0000 7fbbc963a640 1 -- 172.21.15.79:0/1648728207 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55876150a5a0 con 0x5587614fe4f0 2024-08-20T01:41:37.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.110+0000 7fbbc963a640 1 --2- 172.21.15.79:0/1648728207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587614fe4f0 0x5587614fbf00 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc009c80 tx=0x7fbbbc010470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73c0a9250c4092ac server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:37.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.110+0000 7fbba3fff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:41:37.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.110+0000 7fbba3fff640 1 -- 172.21.15.79:0/1648728207 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc015040 con 0x5587614fe4f0 2024-08-20T01:41:37.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.110+0000 7fbba3fff640 1 -- 172.21.15.79:0/1648728207 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fbbbc010940 con 0x5587614fe4f0 2024-08-20T01:41:37.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.110+0000 7fbbcd496740 1 -- 172.21.15.79:0/1648728207 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558761403100 con 0x5587614fe4f0 2024-08-20T01:41:37.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.111+0000 7fbba3fff640 1 -- 172.21.15.79:0/1648728207 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fbbbc010b40 con 0x5587614fe4f0 2024-08-20T01:41:37.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.111+0000 7fbbcd496740 10 client.16815 fetch_fsmap learned FSMap version 38 2024-08-20T01:41:37.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.111+0000 7fbbcd496740 1 -- 172.21.15.79:0/1648728207 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55876150cf50 con 0x5587614fe4f0 2024-08-20T01:41:37.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.111+0000 7fbba3fff640 1 -- 172.21.15.79:0/1648728207 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x558761403100 con 0x5587614fe4f0 2024-08-20T01:41:37.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.111+0000 7fbba3fff640 1 -- 172.21.15.79:0/1648728207 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7fbbbc01a460 con 0x5587614fe4f0 2024-08-20T01:41:37.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.111+0000 7fbbcd496740 10 client.16815 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:41:37.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.111+0000 7fbbcd496740 10 client.16815 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:41:37.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.111+0000 7fbbcd496740 20 client.16815 populate_metadata read hostname 'smithi079' 2024-08-20T01:41:37.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.111+0000 7fbbcd496740 1 --2- 172.21.15.79:0/1648728207 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55876150e2a0 0x558761510690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:37.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.111+0000 7fbbcd496740 4 client.16815 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:41:37.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.111+0000 7fbbcd496740 1 -- 172.21.15.79:0/1648728207 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558761466830 con 0x55876150e2a0 2024-08-20T01:41:37.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.111+0000 7fbbc3fff640 1 --2- 172.21.15.79:0/1648728207 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55876150e2a0 0x558761510690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:37.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.112+0000 7fbbc3fff640 1 --2- 172.21.15.79:0/1648728207 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55876150e2a0 0x558761510690 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9ea32fd75ce37da server_cookie=494bc483f577abf0 in_seq=0 out_seq=0 2024-08-20T01:41:37.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.112+0000 7fbba3fff640 10 client.16815 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:41:37.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.113+0000 7fbba3fff640 1 -- 172.21.15.79:0/1648728207 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558761466830 con 0x55876150e2a0 2024-08-20T01:41:37.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.113+0000 7fbba3fff640 10 client.16815 handle_command_reply: tid=0 2024-08-20T01:41:37.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.113+0000 7fbbcd496740 1 client.16815 shutdown 2024-08-20T01:41:37.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.113+0000 7fbbcd496740 1 -- 172.21.15.79:0/1648728207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587614fe4f0 msgr2=0x5587614fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:37.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.113+0000 7fbbcd496740 1 --2- 172.21.15.79:0/1648728207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587614fe4f0 0x5587614fbf00 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc009c80 tx=0x7fbbbc010470 comp rx=0 tx=0).stop 2024-08-20T01:41:37.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.113+0000 7fbbcd496740 1 -- 172.21.15.79:0/1648728207 shutdown_connections 2024-08-20T01:41:37.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.113+0000 7fbbcd496740 1 --2- 172.21.15.79:0/1648728207 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55876150e2a0 0x558761510690 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:37.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.113+0000 7fbbcd496740 1 --2- 172.21.15.79:0/1648728207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587614fe4f0 0x5587614fbf00 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:37.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.113+0000 7fbba3fff640 0 client.16815 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:41:37.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.113+0000 7fbbcd496740 1 --2- 172.21.15.79:0/1648728207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587614ee150 0x5587614fb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:37.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.113+0000 7fbbcd496740 1 --2- 172.21.15.79:0/1648728207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587614ed830 0x5587614fb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:37.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.113+0000 7fbbcd496740 1 -- 172.21.15.79:0/1648728207 >> 172.21.15.79:0/1648728207 conn(0x5587614eb660 msgr2=0x5587614f1190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:37.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.113+0000 7fbbcd496740 1 -- 172.21.15.79:0/1648728207 shutdown_connections 2024-08-20T01:41:37.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.113+0000 7fbbcd496740 1 -- 172.21.15.79:0/1648728207 wait complete. 2024-08-20T01:41:37.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.113+0000 7fbbcd496740 20 client.16815 trim_cache size 0 max 16384 2024-08-20T01:41:37.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.141+0000 7fbbcd496740 1 Processor -- start 2024-08-20T01:41:37.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.141+0000 7fbbcd496740 1 -- start start 2024-08-20T01:41:37.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.141+0000 7fbbcd496740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587614ed830 0x5587614f8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:37.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.141+0000 7fbbcd496740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587614ee150 0x5587614eaf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:37.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.141+0000 7fbbcd496740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587614fe4f0 0x5587614fabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:37.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.141+0000 7fbbcd496740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc41abf00 con 0x5587614ee150 2024-08-20T01:41:37.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.141+0000 7fbbcd496740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc41ada40 con 0x5587614ed830 2024-08-20T01:41:37.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.141+0000 7fbbcd496740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc41ac5d0 con 0x5587614fe4f0 2024-08-20T01:41:37.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.141+0000 7fbbc3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587614ee150 0x5587614eaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:37.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.141+0000 7fbbc3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587614ee150 0x5587614eaf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39116/0 (socket says 172.21.15.79:39116) 2024-08-20T01:41:37.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.141+0000 7fbbc3fff640 1 -- 172.21.15.79:0/1611935361 learned_addr learned my addr 172.21.15.79:0/1611935361 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:37.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.141+0000 7fbbc963a640 1 --2- 172.21.15.79:0/1611935361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587614fe4f0 0x5587614fabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:37.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.141+0000 7fbbc963a640 1 --2- 172.21.15.79:0/1611935361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587614ed830 0x5587614f8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:37.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.141+0000 7fbbc3fff640 1 -- 172.21.15.79:0/1611935361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587614fe4f0 msgr2=0x5587614fabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:37.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.141+0000 7fbbc3fff640 1 --2- 172.21.15.79:0/1611935361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587614fe4f0 0x5587614fabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:37.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.141+0000 7fbbc3fff640 1 -- 172.21.15.79:0/1611935361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587614ed830 msgr2=0x5587614f8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:37.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.141+0000 7fbbc3fff640 1 --2- 172.21.15.79:0/1611935361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587614ed830 0x5587614f8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:37.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.141+0000 7fbbc3fff640 1 -- 172.21.15.79:0/1611935361 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587614f9980 con 0x5587614ee150 2024-08-20T01:41:37.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.142+0000 7fbbc963a640 1 --2- 172.21.15.79:0/1611935361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587614fe4f0 0x5587614fabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:41:37.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.142+0000 7fbbc3fff640 1 --2- 172.21.15.79:0/1611935361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587614ee150 0x5587614eaf10 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fbbc4107060 tx=0x7fbbb0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94a4a17e363cce15 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:37.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.142+0000 7fbbae7fc640 1 -- 172.21.15.79:0/1611935361 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb004b070 con 0x5587614ee150 2024-08-20T01:41:37.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.142+0000 7fbbae7fc640 1 -- 172.21.15.79:0/1611935361 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbbb00044d0 con 0x5587614ee150 2024-08-20T01:41:37.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.142+0000 7fbbae7fc640 1 -- 172.21.15.79:0/1611935361 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb0035040 con 0x5587614ee150 2024-08-20T01:41:37.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.143+0000 7fbbcd496740 1 -- 172.21.15.79:0/1611935361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587614ee150 msgr2=0x5587614eaf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:37.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.143+0000 7fbbcd496740 1 --2- 172.21.15.79:0/1611935361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587614ee150 0x5587614eaf10 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fbbc4107060 tx=0x7fbbb0000bc0 comp rx=0 tx=0).stop 2024-08-20T01:41:37.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.143+0000 7fbbcd496740 1 -- 172.21.15.79:0/1611935361 shutdown_connections 2024-08-20T01:41:37.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.143+0000 7fbbcd496740 1 --2- 172.21.15.79:0/1611935361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587614fe4f0 0x5587614fabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:37.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.143+0000 7fbbcd496740 1 --2- 172.21.15.79:0/1611935361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587614ee150 0x5587614eaf10 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:37.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.143+0000 7fbbcd496740 1 --2- 172.21.15.79:0/1611935361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587614ed830 0x5587614f8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:37.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.143+0000 7fbbcd496740 1 -- 172.21.15.79:0/1611935361 >> 172.21.15.79:0/1611935361 conn(0x5587614eb660 msgr2=0x5587614ecb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:37.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.143+0000 7fbbcd496740 1 -- 172.21.15.79:0/1611935361 shutdown_connections 2024-08-20T01:41:37.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.143+0000 7fbbcd496740 1 -- 172.21.15.79:0/1611935361 wait complete. 2024-08-20T01:41:37.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.143+0000 7fbbcd496740 1 -- start start 2024-08-20T01:41:37.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.143+0000 7fbbcd496740 1 Processor -- start 2024-08-20T01:41:37.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.144+0000 7fbbcd496740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587614ed830 0x5587615138a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:37.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.144+0000 7fbbcd496740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587614ee150 0x558761513de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:37.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.144+0000 7fbbcd496740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587614fe4f0 0x5587614eee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:37.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.144+0000 7fbbcd496740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc41ad370 con 0x5587614ee150 2024-08-20T01:41:37.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.144+0000 7fbbcd496740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc41acca0 con 0x5587614fe4f0 2024-08-20T01:41:37.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.144+0000 7fbbcd496740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc41a9ee0 con 0x5587614ed830 2024-08-20T01:41:37.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.144+0000 7fbbcd496740 10 client.0 _ll_register_callbacks cb 0x7fbbb0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:37.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.144+0000 7fbbc3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587614ee150 0x558761513de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:37.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.144+0000 7fbbc3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587614ee150 0x558761513de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39128/0 (socket says 172.21.15.79:39128) 2024-08-20T01:41:37.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.144+0000 7fbbc3fff640 1 -- 172.21.15.79:0/2732329919 learned_addr learned my addr 172.21.15.79:0/2732329919 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:37.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.144+0000 7fbbc3fff640 1 -- 172.21.15.79:0/2732329919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587614ed830 msgr2=0x5587615138a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:37.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.144+0000 7fbbc963a640 1 --2- 172.21.15.79:0/2732329919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587614ed830 0x5587615138a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:37.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.144+0000 7fbbc3fff640 1 --2- 172.21.15.79:0/2732329919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587614ed830 0x5587615138a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:37.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.144+0000 7fbbc3fff640 1 -- 172.21.15.79:0/2732329919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587614fe4f0 msgr2=0x5587614eee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:37.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.144+0000 7fbbc3fff640 1 --2- 172.21.15.79:0/2732329919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587614fe4f0 0x5587614eee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:37.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.144+0000 7fbbc3fff640 1 -- 172.21.15.79:0/2732329919 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587614ef670 con 0x5587614ee150 2024-08-20T01:41:37.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.144+0000 7fbbc963a640 1 --2- 172.21.15.79:0/2732329919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587614ed830 0x5587615138a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:41:37.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.145+0000 7fbbc3fff640 1 --2- 172.21.15.79:0/2732329919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587614ee150 0x558761513de0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0049040 tx=0x7fbbb0003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3bedaa59f11b07f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:37.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.145+0000 7fbba3fff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:41:37.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.145+0000 7fbba3fff640 1 -- 172.21.15.79:0/2732329919 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb0035070 con 0x5587614ee150 2024-08-20T01:41:37.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.145+0000 7fbba3fff640 1 -- 172.21.15.79:0/2732329919 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fbbb00035f0 con 0x5587614ee150 2024-08-20T01:41:37.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.145+0000 7fbbcd496740 1 -- 172.21.15.79:0/2732329919 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbb00044d0 con 0x5587614ee150 2024-08-20T01:41:37.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.145+0000 7fbba3fff640 1 -- 172.21.15.79:0/2732329919 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fbbb004b070 con 0x5587614ee150 2024-08-20T01:41:37.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.145+0000 7fbbcd496740 10 client.16821 fetch_fsmap learned FSMap version 38 2024-08-20T01:41:37.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.145+0000 7fbbcd496740 1 -- 172.21.15.79:0/2732329919 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5587615786e0 con 0x5587614ee150 2024-08-20T01:41:37.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.145+0000 7fbba3fff640 1 -- 172.21.15.79:0/2732329919 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbbb00044d0 con 0x5587614ee150 2024-08-20T01:41:37.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.145+0000 7fbba3fff640 1 -- 172.21.15.79:0/2732329919 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7fbbb0004d30 con 0x5587614ee150 2024-08-20T01:41:37.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.145+0000 7fbbcd496740 10 client.16821 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:41:37.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.145+0000 7fbbcd496740 10 client.16821 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:41:37.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.145+0000 7fbbcd496740 20 client.16821 populate_metadata read hostname 'smithi079' 2024-08-20T01:41:37.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.145+0000 7fbbcd496740 1 --2- 172.21.15.79:0/2732329919 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558761578de0 0x55876157b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:37.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.145+0000 7fbbcd496740 4 client.16821 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:41:37.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.145+0000 7fbbcd496740 1 -- 172.21.15.79:0/2732329919 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5587614622d0 con 0x558761578de0 2024-08-20T01:41:37.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.146+0000 7fbbc963a640 1 --2- 172.21.15.79:0/2732329919 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558761578de0 0x55876157b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:37.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.146+0000 7fbba3fff640 10 client.16821 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:41:37.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.146+0000 7fbbc963a640 1 --2- 172.21.15.79:0/2732329919 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558761578de0 0x55876157b200 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62a9051782782cbd server_cookie=bc6f9e4216429534 in_seq=0 out_seq=0 2024-08-20T01:41:37.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.146+0000 7fbba3fff640 1 -- 172.21.15.79:0/2732329919 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5587614622d0 con 0x558761578de0 2024-08-20T01:41:37.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.146+0000 7fbba3fff640 10 client.16821 handle_command_reply: tid=0 2024-08-20T01:41:37.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.146+0000 7fbbcd496740 1 client.16821 shutdown 2024-08-20T01:41:37.048 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:41:37.048 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-08-20T01:41:37.048 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-08-20T01:41:37.048 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:41:37.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.146+0000 7fbbcd496740 1 -- 172.21.15.79:0/2732329919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587614ee150 msgr2=0x558761513de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:37.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.146+0000 7fbbcd496740 1 --2- 172.21.15.79:0/2732329919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587614ee150 0x558761513de0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0049040 tx=0x7fbbb0003f90 comp rx=0 tx=0).stop 2024-08-20T01:41:37.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.146+0000 7fbbcd496740 1 -- 172.21.15.79:0/2732329919 shutdown_connections 2024-08-20T01:41:37.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.146+0000 7fbbcd496740 1 --2- 172.21.15.79:0/2732329919 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558761578de0 0x55876157b200 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:37.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.146+0000 7fbbcd496740 1 --2- 172.21.15.79:0/2732329919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587614fe4f0 0x5587614eee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:37.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.146+0000 7fbbcd496740 1 --2- 172.21.15.79:0/2732329919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587614ee150 0x558761513de0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:37.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.146+0000 7fbba3fff640 0 client.16821 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:41:37.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.146+0000 7fbbcd496740 1 --2- 172.21.15.79:0/2732329919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587614ed830 0x5587615138a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:37.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.146+0000 7fbbcd496740 1 -- 172.21.15.79:0/2732329919 >> 172.21.15.79:0/2732329919 conn(0x5587614eb660 msgr2=0x558761509480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:37.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.147+0000 7fbbcd496740 1 -- 172.21.15.79:0/2732329919 shutdown_connections 2024-08-20T01:41:37.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.147+0000 7fbbcd496740 1 -- 172.21.15.79:0/2732329919 wait complete. 2024-08-20T01:41:37.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.147+0000 7fbbcd496740 20 client.16821 trim_cache size 0 max 16384 2024-08-20T01:41:37.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.147+0000 7fbbcb09d640 1 -- 172.21.15.79:0/2838883667 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbbb40b3cd0 msgr2=0x7fbbb40b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:37.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.147+0000 7fbbcb09d640 1 --2- 172.21.15.79:0/2838883667 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbbb40b3cd0 0x7fbbb40b6190 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbbb801b000 tx=0x7fbbb8000bc0 comp rx=0 tx=0).stop 2024-08-20T01:41:37.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.147+0000 7fbbcb09d640 1 -- 172.21.15.79:0/2838883667 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbc41019b0 msgr2=0x7fbbc4198f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:37.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.147+0000 7fbbcb09d640 1 --2- 172.21.15.79:0/2838883667 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbc41019b0 0x7fbbc4198f30 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fbbb800d950 tx=0x7fbbb800de10 comp rx=0 tx=0).stop 2024-08-20T01:41:37.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.147+0000 7fbbcb09d640 1 -- 172.21.15.79:0/2838883667 shutdown_connections 2024-08-20T01:41:37.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.147+0000 7fbbcb09d640 1 --2- 172.21.15.79:0/2838883667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbc4107d40 0x7fbbc419e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:37.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.147+0000 7fbbcb09d640 1 --2- 172.21.15.79:0/2838883667 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbbb40b3cd0 0x7fbbb40b6190 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:37.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.147+0000 7fbbcb09d640 1 --2- 172.21.15.79:0/2838883667 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbc41073c0 0x7fbbc4199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:37.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.147+0000 7fbbcb09d640 1 --2- 172.21.15.79:0/2838883667 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbc41019b0 0x7fbbc4198f30 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:37.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.147+0000 7fbbcb09d640 1 -- 172.21.15.79:0/2838883667 >> 172.21.15.79:0/2838883667 conn(0x7fbbc40fd400 msgr2=0x7fbbc406b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:37.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.147+0000 7fbbcb09d640 1 -- 172.21.15.79:0/2838883667 shutdown_connections 2024-08-20T01:41:37.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:36.148+0000 7fbbcb09d640 1 -- 172.21.15.79:0/2838883667 wait complete. 2024-08-20T01:41:38.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:38 smithi081 ceph-mon[22209]: pgmap v476: 97 pgs: 97 active+clean; 6.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 27 MiB/s wr, 21 op/s 2024-08-20T01:41:38.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:38 smithi175 ceph-mon[22392]: pgmap v476: 97 pgs: 97 active+clean; 6.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 27 MiB/s wr, 21 op/s 2024-08-20T01:41:38.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:38 smithi079 ceph-mon[18656]: pgmap v476: 97 pgs: 97 active+clean; 6.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 27 MiB/s wr, 21 op/s 2024-08-20T01:41:40.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:40 smithi081 ceph-mon[22209]: pgmap v477: 97 pgs: 97 active+clean; 6.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 29 MiB/s wr, 25 op/s 2024-08-20T01:41:40.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:40 smithi175 ceph-mon[22392]: pgmap v477: 97 pgs: 97 active+clean; 6.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 29 MiB/s wr, 25 op/s 2024-08-20T01:41:40.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:40 smithi079 ceph-mon[18656]: pgmap v477: 97 pgs: 97 active+clean; 6.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 29 MiB/s wr, 25 op/s 2024-08-20T01:41:41.140 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T01:41:41.140 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:41:41.422 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:41:41.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:41.940+0000 7f9269aa2640 1 -- 172.21.15.79:0/2988836120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92641084a0 msgr2=0x7f92641088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:41.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:41.940+0000 7f9269aa2640 1 --2- 172.21.15.79:0/2988836120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92641084a0 0x7f92641088e0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f9258009900 tx=0x7f925802a410 comp rx=0 tx=0).stop 2024-08-20T01:41:41.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:41.940+0000 7f9269aa2640 1 -- 172.21.15.79:0/2988836120 shutdown_connections 2024-08-20T01:41:41.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:41.940+0000 7f9269aa2640 1 --2- 172.21.15.79:0/2988836120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9264108e20 0x7f926410f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:41.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:41.940+0000 7f9269aa2640 1 --2- 172.21.15.79:0/2988836120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92641084a0 0x7f92641088e0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:41.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:41.940+0000 7f9269aa2640 1 --2- 172.21.15.79:0/2988836120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9264102a90 0x7f9264102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:41.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:41.940+0000 7f9269aa2640 1 -- 172.21.15.79:0/2988836120 >> 172.21.15.79:0/2988836120 conn(0x7f92640fe540 msgr2=0x7f9264100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:41.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:41.940+0000 7f9269aa2640 1 -- 172.21.15.79:0/2988836120 shutdown_connections 2024-08-20T01:41:41.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:41.940+0000 7f9269aa2640 1 -- 172.21.15.79:0/2988836120 wait complete. 2024-08-20T01:41:41.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:41.940+0000 7f9269aa2640 1 Processor -- start 2024-08-20T01:41:41.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:41.941+0000 7f9269aa2640 1 -- start start 2024-08-20T01:41:41.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:41.941+0000 7f9269aa2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9264102a90 0x7f92640751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:41.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:41.941+0000 7f9269aa2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92641084a0 0x7f9264075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:41.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:41.941+0000 7f9269aa2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9264108e20 0x7f9264075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:41.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:41.941+0000 7f9269aa2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9264112950 con 0x7f9264108e20 2024-08-20T01:41:41.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:41.941+0000 7f9269aa2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f92641127d0 con 0x7f9264102a90 2024-08-20T01:41:41.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:41.941+0000 7f9269aa2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9264112ad0 con 0x7f92641084a0 2024-08-20T01:41:41.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:41.941+0000 7f9263fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9264108e20 0x7f9264075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:41.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:41.941+0000 7f9263fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9264108e20 0x7f9264075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40370/0 (socket says 172.21.15.79:40370) 2024-08-20T01:41:41.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:41.941+0000 7f9263fff640 1 -- 172.21.15.79:0/325377580 learned_addr learned my addr 172.21.15.79:0/325377580 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:41.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:41.941+0000 7f9262ffd640 1 --2- 172.21.15.79:0/325377580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92641084a0 0x7f9264075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:41.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:41.941+0000 7f92637fe640 1 --2- 172.21.15.79:0/325377580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9264102a90 0x7f92640751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:41.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:41.941+0000 7f9263fff640 1 -- 172.21.15.79:0/325377580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92641084a0 msgr2=0x7f9264075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:41.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:41.941+0000 7f9263fff640 1 --2- 172.21.15.79:0/325377580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92641084a0 0x7f9264075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:41.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:41.941+0000 7f9263fff640 1 -- 172.21.15.79:0/325377580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9264102a90 msgr2=0x7f92640751d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:41.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:41.941+0000 7f9263fff640 1 --2- 172.21.15.79:0/325377580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9264102a90 0x7f92640751d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:41.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:41.941+0000 7f9263fff640 1 -- 172.21.15.79:0/325377580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92641a72a0 con 0x7f9264108e20 2024-08-20T01:41:41.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:41.941+0000 7f92637fe640 1 --2- 172.21.15.79:0/325377580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9264102a90 0x7f92640751d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:41:41.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:41.942+0000 7f9263fff640 1 --2- 172.21.15.79:0/325377580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9264108e20 0x7f9264075c50 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f925c00eaa0 tx=0x7f925c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:41.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:41.942+0000 7f9260ff9640 1 -- 172.21.15.79:0/325377580 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925c00cdb0 con 0x7f9264108e20 2024-08-20T01:41:41.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:41.942+0000 7f9260ff9640 1 -- 172.21.15.79:0/325377580 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f925c005020 con 0x7f9264108e20 2024-08-20T01:41:41.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:41.942+0000 7f9269aa2640 1 -- 172.21.15.79:0/325377580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92641a7590 con 0x7f9264108e20 2024-08-20T01:41:41.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:41.942+0000 7f9260ff9640 1 -- 172.21.15.79:0/325377580 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925c0116d0 con 0x7f9264108e20 2024-08-20T01:41:41.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:41.942+0000 7f9269aa2640 1 -- 172.21.15.79:0/325377580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92641a7aa0 con 0x7f9264108e20 2024-08-20T01:41:41.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:41.943+0000 7f9269aa2640 1 -- 172.21.15.79:0/325377580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9264103d40 con 0x7f9264108e20 2024-08-20T01:41:41.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:41.945+0000 7f9260ff9640 1 -- 172.21.15.79:0/325377580 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f925c0051d0 con 0x7f9264108e20 2024-08-20T01:41:41.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:41.946+0000 7f9260ff9640 1 --2- 172.21.15.79:0/325377580 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f924c0b3bd0 0x7f924c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:41.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:41.946+0000 7f92637fe640 1 --2- 172.21.15.79:0/325377580 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f924c0b3bd0 0x7f924c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:41.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:41.946+0000 7f9260ff9640 1 -- 172.21.15.79:0/325377580 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f925c0e3d00 con 0x7f9264108e20 2024-08-20T01:41:41.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:41.947+0000 7f92637fe640 1 --2- 172.21.15.79:0/325377580 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f924c0b3bd0 0x7f924c0b6090 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f925400abe0 tx=0x7f925400a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:41.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:41.950+0000 7f9260ff9640 1 -- 172.21.15.79:0/325377580 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f925c016030 con 0x7f9264108e20 2024-08-20T01:41:42.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:42.207+0000 7f9269aa2640 1 -- 172.21.15.79:0/325377580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f926402e340 con 0x7f9264108e20 2024-08-20T01:41:42.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:42.208+0000 7f9260ff9640 1 -- 172.21.15.79:0/325377580 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+11973 (secure 0 0 0) 0x7f925c0ab360 con 0x7f9264108e20 2024-08-20T01:41:42.209 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:41:42.210 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":38,"btime":"2024-08-20T01:41:11:144850+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14670,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/735082912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":735082912},{"type":"v1","addr":"172.21.15.79:6835","nonce":735082912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2150339873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2150339873},{"type":"v1","addr":"172.21.15.79:6837","nonce":2150339873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":38,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:34:55.133562+0000","modified":"2024-08-20T01:41:10.892487+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24539,"mds_1":24538,"mds_2":24523,"mds_3":24514,"mds_4":24512},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14724":{"gid":14724,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/1071242274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1071242274},{"type":"v1","addr":"172.21.15.79:6839","nonce":1071242274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14730":{"gid":14730,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6841/2448977611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":2448977611},{"type":"v1","addr":"172.21.15.79:6841","nonce":2448977611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/1257507005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1257507005},{"type":"v1","addr":"172.21.15.81:6833","nonce":1257507005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1499936216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1499936216},{"type":"v1","addr":"172.21.15.81:6835","nonce":1499936216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/1107229215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1107229215},{"type":"v1","addr":"172.21.15.175:6833","nonce":1107229215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6837/2073598870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2073598870},{"type":"v1","addr":"172.21.15.81:6837","nonce":2073598870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/2552601173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2552601173},{"type":"v1","addr":"172.21.15.175:6835","nonce":2552601173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6837/1767284089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1767284089},{"type":"v1","addr":"172.21.15.175:6837","nonce":1767284089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/1331748742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1331748742},{"type":"v1","addr":"172.21.15.175:6839","nonce":1331748742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/4098410583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":4098410583},{"type":"v1","addr":"172.21.15.81:6839","nonce":4098410583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24539,"qdb_cluster":[24512,24538,24514,24523,24539]},"id":1}]} 2024-08-20T01:41:42.210 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 38 2024-08-20T01:41:42.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:42.210+0000 7f9269aa2640 1 -- 172.21.15.79:0/325377580 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f924c0b3bd0 msgr2=0x7f924c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:42.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:42.210+0000 7f9269aa2640 1 --2- 172.21.15.79:0/325377580 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f924c0b3bd0 0x7f924c0b6090 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f925400abe0 tx=0x7f925400a5c0 comp rx=0 tx=0).stop 2024-08-20T01:41:42.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:42.210+0000 7f9269aa2640 1 -- 172.21.15.79:0/325377580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9264108e20 msgr2=0x7f9264075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:42.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:42.210+0000 7f9269aa2640 1 --2- 172.21.15.79:0/325377580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9264108e20 0x7f9264075c50 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f925c00eaa0 tx=0x7f925c00ef60 comp rx=0 tx=0).stop 2024-08-20T01:41:42.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:42.211+0000 7f9269aa2640 1 -- 172.21.15.79:0/325377580 shutdown_connections 2024-08-20T01:41:42.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:42.211+0000 7f9269aa2640 1 --2- 172.21.15.79:0/325377580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9264108e20 0x7f9264075c50 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:42.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:42.211+0000 7f9269aa2640 1 --2- 172.21.15.79:0/325377580 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f924c0b3bd0 0x7f924c0b6090 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:42.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:42.211+0000 7f9269aa2640 1 --2- 172.21.15.79:0/325377580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92641084a0 0x7f9264075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:42.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:42.211+0000 7f9269aa2640 1 --2- 172.21.15.79:0/325377580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9264102a90 0x7f92640751d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:42.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:42.211+0000 7f9269aa2640 1 -- 172.21.15.79:0/325377580 >> 172.21.15.79:0/325377580 conn(0x7f92640fe540 msgr2=0x7f9264100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:42.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:42.211+0000 7f9269aa2640 1 -- 172.21.15.79:0/325377580 shutdown_connections 2024-08-20T01:41:42.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:42.211+0000 7f9269aa2640 1 -- 172.21.15.79:0/325377580 wait complete. 2024-08-20T01:41:42.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:42 smithi081 ceph-mon[22209]: pgmap v478: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-08-20T01:41:42.585 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:42 smithi079 ceph-mon[18656]: pgmap v478: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-08-20T01:41:42.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:42 smithi175 ceph-mon[22392]: pgmap v478: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-08-20T01:41:43.026 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-20T01:41:43.318 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:41:43.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:43 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/325377580' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:41:43.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:43 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/325377580' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:41:43.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:43 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/325377580' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:41:43.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.844+0000 7f27ad00b640 1 -- 172.21.15.79:0/2358509580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27a8101990 msgr2=0x7f27a8101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:43.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.844+0000 7f27ad00b640 1 --2- 172.21.15.79:0/2358509580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27a8101990 0x7f27a8101d70 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f2798009900 tx=0x7f279802a410 comp rx=0 tx=0).stop 2024-08-20T01:41:43.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.844+0000 7f27ad00b640 1 -- 172.21.15.79:0/2358509580 shutdown_connections 2024-08-20T01:41:43.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.844+0000 7f27ad00b640 1 --2- 172.21.15.79:0/2358509580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27a8107d20 0x7f27a810e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:43.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.844+0000 7f27ad00b640 1 --2- 172.21.15.79:0/2358509580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27a81073a0 0x7f27a81077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:43.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.844+0000 7f27ad00b640 1 --2- 172.21.15.79:0/2358509580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27a8101990 0x7f27a8101d70 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:43.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.844+0000 7f27ad00b640 1 -- 172.21.15.79:0/2358509580 >> 172.21.15.79:0/2358509580 conn(0x7f27a80fd400 msgr2=0x7f27a80ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:43.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.844+0000 7f27ad00b640 1 -- 172.21.15.79:0/2358509580 shutdown_connections 2024-08-20T01:41:43.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.844+0000 7f27ad00b640 1 -- 172.21.15.79:0/2358509580 wait complete. 2024-08-20T01:41:43.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.845+0000 7f27ad00b640 1 Processor -- start 2024-08-20T01:41:43.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.845+0000 7f27ad00b640 1 -- start start 2024-08-20T01:41:43.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.845+0000 7f27ad00b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27a8101990 0x7f27a8198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:43.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.845+0000 7f27ad00b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27a81073a0 0x7f27a81993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:43.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.845+0000 7f27ad00b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27a8107d20 0x7f27a819e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:43.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.845+0000 7f27ad00b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f27a81118a0 con 0x7f27a81073a0 2024-08-20T01:41:43.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.845+0000 7f27ad00b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f27a8111720 con 0x7f27a8101990 2024-08-20T01:41:43.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.845+0000 7f27ad00b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f27a8111a20 con 0x7f27a8107d20 2024-08-20T01:41:43.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.845+0000 7f279ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27a81073a0 0x7f27a81993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:43.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.845+0000 7f279ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27a81073a0 0x7f27a81993f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40388/0 (socket says 172.21.15.79:40388) 2024-08-20T01:41:43.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.845+0000 7f279ffff640 1 -- 172.21.15.79:0/2305433673 learned_addr learned my addr 172.21.15.79:0/2305433673 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:43.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.845+0000 7f27a6d9d640 1 --2- 172.21.15.79:0/2305433673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27a8101990 0x7f27a8198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:43.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.845+0000 7f27a759e640 1 --2- 172.21.15.79:0/2305433673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27a8107d20 0x7f27a819e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:43.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.846+0000 7f279ffff640 1 -- 172.21.15.79:0/2305433673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27a8107d20 msgr2=0x7f27a819e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:43.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.846+0000 7f279ffff640 1 --2- 172.21.15.79:0/2305433673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27a8107d20 0x7f27a819e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:43.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.846+0000 7f279ffff640 1 -- 172.21.15.79:0/2305433673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27a8101990 msgr2=0x7f27a8198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:43.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.846+0000 7f279ffff640 1 --2- 172.21.15.79:0/2305433673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27a8101990 0x7f27a8198eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:43.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.846+0000 7f279ffff640 1 -- 172.21.15.79:0/2305433673 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27a819ef60 con 0x7f27a81073a0 2024-08-20T01:41:43.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.846+0000 7f27a759e640 1 --2- 172.21.15.79:0/2305433673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27a8107d20 0x7f27a819e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:41:43.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.846+0000 7f27a6d9d640 1 --2- 172.21.15.79:0/2305433673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27a8101990 0x7f27a8198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:41:43.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.846+0000 7f279ffff640 1 --2- 172.21.15.79:0/2305433673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27a81073a0 0x7f27a81993f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f279000d950 tx=0x7f279000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:43.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.846+0000 7f27a4d99640 1 -- 172.21.15.79:0/2305433673 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2790017070 con 0x7f27a81073a0 2024-08-20T01:41:43.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.846+0000 7f27ad00b640 1 -- 172.21.15.79:0/2305433673 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27a819f250 con 0x7f27a81073a0 2024-08-20T01:41:43.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.846+0000 7f27a4d99640 1 -- 172.21.15.79:0/2305433673 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2790009c30 con 0x7f27a81073a0 2024-08-20T01:41:43.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.846+0000 7f27a4d99640 1 -- 172.21.15.79:0/2305433673 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279000f620 con 0x7f27a81073a0 2024-08-20T01:41:43.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.846+0000 7f27ad00b640 1 -- 172.21.15.79:0/2305433673 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27a81a5ae0 con 0x7f27a81073a0 2024-08-20T01:41:43.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.849+0000 7f27af404740 1 Processor -- start 2024-08-20T01:41:43.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.849+0000 7f27af404740 1 -- start start 2024-08-20T01:41:43.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.850+0000 7f27a4d99640 1 -- 172.21.15.79:0/2305433673 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2790010460 con 0x7f27a81073a0 2024-08-20T01:41:43.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.850+0000 7f27af404740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa4f597880 0x55fa4f597c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:43.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.850+0000 7f27af404740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa4f5981a0 0x55fa4f5a3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:43.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.850+0000 7f27af404740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa4f5a4130 0x55fa4f5a6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:43.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.850+0000 7f27af404740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fa4f50e930 con 0x55fa4f5a4130 2024-08-20T01:41:43.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.850+0000 7f27af404740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55fa4f4fde30 con 0x55fa4f5981a0 2024-08-20T01:41:43.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.850+0000 7f27af404740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55fa4f501e70 con 0x55fa4f597880 2024-08-20T01:41:43.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.850+0000 7f279ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa4f5a4130 0x55fa4f5a6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:43.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.850+0000 7f279ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa4f5a4130 0x55fa4f5a6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40394/0 (socket says 172.21.15.79:40394) 2024-08-20T01:41:43.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.850+0000 7f279ffff640 1 -- 172.21.15.79:0/2610349824 learned_addr learned my addr 172.21.15.79:0/2610349824 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:43.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.850+0000 7f27a6d9d640 1 --2- 172.21.15.79:0/2610349824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa4f5981a0 0x55fa4f5a3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:43.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.850+0000 7f27a759e640 1 --2- 172.21.15.79:0/2610349824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa4f597880 0x55fa4f597c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:43.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.851+0000 7f279ffff640 1 -- 172.21.15.79:0/2610349824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa4f597880 msgr2=0x55fa4f597c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:43.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.851+0000 7f279ffff640 1 --2- 172.21.15.79:0/2610349824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa4f597880 0x55fa4f597c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:43.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.851+0000 7f279ffff640 1 -- 172.21.15.79:0/2610349824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa4f5981a0 msgr2=0x55fa4f5a3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:43.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.851+0000 7f279ffff640 1 --2- 172.21.15.79:0/2610349824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa4f5981a0 0x55fa4f5a3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:43.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.851+0000 7f279ffff640 1 -- 172.21.15.79:0/2610349824 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa4f25d650 con 0x55fa4f5a4130 2024-08-20T01:41:43.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.851+0000 7f279ffff640 1 --2- 172.21.15.79:0/2610349824 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa4f5a4130 0x55fa4f5a6520 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f27900e9c40 tx=0x7f27900eb690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=101e249915713169 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:43.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.851+0000 7f27a4d99640 1 --2- 172.21.15.79:0/2305433673 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f27940b3c50 0x7f27940b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:43.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.851+0000 7f27a759e640 1 --2- 172.21.15.79:0/2305433673 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f27940b3c50 0x7f27940b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:43.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.851+0000 7f279d7fa640 1 -- 172.21.15.79:0/2610349824 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27900f2070 con 0x55fa4f5a4130 2024-08-20T01:41:43.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.851+0000 7f27a4d99640 1 -- 172.21.15.79:0/2305433673 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f27900e3830 con 0x7f27a81073a0 2024-08-20T01:41:43.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.851+0000 7f279d7fa640 1 -- 172.21.15.79:0/2610349824 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2790059d00 con 0x55fa4f5a4130 2024-08-20T01:41:43.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.851+0000 7f279d7fa640 1 -- 172.21.15.79:0/2610349824 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27900aa0e0 con 0x55fa4f5a4130 2024-08-20T01:41:43.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.852+0000 7f27af404740 1 -- 172.21.15.79:0/2610349824 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa4f5a4130 msgr2=0x55fa4f5a6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:43.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.852+0000 7f27a759e640 1 --2- 172.21.15.79:0/2305433673 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f27940b3c50 0x7f27940b6110 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f27a0005fd0 tx=0x7f27a0009700 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:43.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.852+0000 7f27af404740 1 --2- 172.21.15.79:0/2610349824 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa4f5a4130 0x55fa4f5a6520 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f27900e9c40 tx=0x7f27900eb690 comp rx=0 tx=0).stop 2024-08-20T01:41:43.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.852+0000 7f27af404740 1 -- 172.21.15.79:0/2610349824 shutdown_connections 2024-08-20T01:41:43.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.852+0000 7f27af404740 1 --2- 172.21.15.79:0/2610349824 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa4f5a4130 0x55fa4f5a6520 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:43.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.852+0000 7f27af404740 1 --2- 172.21.15.79:0/2610349824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa4f5981a0 0x55fa4f5a3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:43.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.852+0000 7f27af404740 1 --2- 172.21.15.79:0/2610349824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa4f597880 0x55fa4f597c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:43.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.852+0000 7f27af404740 1 -- 172.21.15.79:0/2610349824 >> 172.21.15.79:0/2610349824 conn(0x55fa4f5956b0 msgr2=0x55fa4f596850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:43.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.853+0000 7f27af404740 1 -- 172.21.15.79:0/2610349824 shutdown_connections 2024-08-20T01:41:43.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.853+0000 7f27af404740 1 -- 172.21.15.79:0/2610349824 wait complete. 2024-08-20T01:41:43.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.853+0000 7f27af404740 1 -- start start 2024-08-20T01:41:43.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.853+0000 7f27af404740 1 Processor -- start 2024-08-20T01:41:43.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.853+0000 7f27af404740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa4f597880 0x55fa4f5a10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:43.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.853+0000 7f27af404740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa4f5981a0 0x55fa4f5a1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:43.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.853+0000 7f27af404740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa4f5a4130 0x55fa4f5a1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:43.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.853+0000 7f27af404740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fa4f360700 con 0x55fa4f597880 2024-08-20T01:41:43.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.853+0000 7f27af404740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55fa4f484810 con 0x55fa4f5a4130 2024-08-20T01:41:43.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.853+0000 7f27af404740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55fa4f5a6de0 con 0x55fa4f5981a0 2024-08-20T01:41:43.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.853+0000 7f27af404740 10 client.0 _ll_register_callbacks cb 0x55fa4f4f7700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:43.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.853+0000 7f27a6d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa4f597880 0x55fa4f5a10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:43.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.854+0000 7f279ffff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa4f5981a0 0x55fa4f5a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:43.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.854+0000 7f27a6d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa4f597880 0x55fa4f5a10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40408/0 (socket says 172.21.15.79:40408) 2024-08-20T01:41:43.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.854+0000 7f27a6d9d640 1 -- 172.21.15.79:0/1156317545 learned_addr learned my addr 172.21.15.79:0/1156317545 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:43.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.854+0000 7f27a759e640 1 --2- 172.21.15.79:0/1156317545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa4f5a4130 0x55fa4f5a1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:43.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.854+0000 7f279ffff640 1 -- 172.21.15.79:0/1156317545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa4f5a4130 msgr2=0x55fa4f5a1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:43.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.854+0000 7f279ffff640 1 --2- 172.21.15.79:0/1156317545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa4f5a4130 0x55fa4f5a1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:43.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.854+0000 7f279ffff640 1 -- 172.21.15.79:0/1156317545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa4f597880 msgr2=0x55fa4f5a10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:43.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.854+0000 7f279ffff640 1 --2- 172.21.15.79:0/1156317545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa4f597880 0x55fa4f5a10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:43.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.854+0000 7f279ffff640 1 -- 172.21.15.79:0/1156317545 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa4f5b0190 con 0x55fa4f5981a0 2024-08-20T01:41:43.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.854+0000 7f27a6d9d640 1 --2- 172.21.15.79:0/1156317545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa4f597880 0x55fa4f5a10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:41:43.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.854+0000 7f279ffff640 1 --2- 172.21.15.79:0/1156317545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa4f5981a0 0x55fa4f5a1610 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f27900aa720 tx=0x7f2790005ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bd7c3e2959c373e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:43.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.854+0000 7f278e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:41:43.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.854+0000 7f278e7fc640 1 -- 172.21.15.79:0/1156317545 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2790020020 con 0x55fa4f5981a0 2024-08-20T01:41:43.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.854+0000 7f27af404740 1 -- 172.21.15.79:0/1156317545 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fa4f4ad150 con 0x55fa4f5981a0 2024-08-20T01:41:43.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.854+0000 7f278e7fc640 1 -- 172.21.15.79:0/1156317545 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f27900590d0 con 0x55fa4f5981a0 2024-08-20T01:41:43.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.855+0000 7f278e7fc640 1 -- 172.21.15.79:0/1156317545 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f27900f2070 con 0x55fa4f5981a0 2024-08-20T01:41:43.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.855+0000 7f27af404740 10 client.26011 fetch_fsmap learned FSMap version 38 2024-08-20T01:41:43.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.855+0000 7f27af404740 1 -- 172.21.15.79:0/1156317545 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55fa4f5b2b40 con 0x55fa4f5981a0 2024-08-20T01:41:43.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.855+0000 7f278e7fc640 1 -- 172.21.15.79:0/1156317545 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55fa4f4ad150 con 0x55fa4f5981a0 2024-08-20T01:41:43.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.855+0000 7f278e7fc640 1 -- 172.21.15.79:0/1156317545 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f27900e3ce0 con 0x55fa4f5981a0 2024-08-20T01:41:43.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.855+0000 7f27af404740 10 client.26011 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:41:43.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.855+0000 7f27af404740 10 client.26011 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:41:43.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.855+0000 7f27af404740 20 client.26011 populate_metadata read hostname 'smithi079' 2024-08-20T01:41:43.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.855+0000 7f27af404740 1 --2- 172.21.15.79:0/1156317545 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55fa4f5b3cc0 0x55fa4f5b60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:43.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.855+0000 7f27af404740 4 client.26011 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:41:43.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.855+0000 7f27af404740 1 -- 172.21.15.79:0/1156317545 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fa4f510880 con 0x55fa4f5b3cc0 2024-08-20T01:41:43.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.855+0000 7f27a6d9d640 1 --2- 172.21.15.79:0/1156317545 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55fa4f5b3cc0 0x55fa4f5b60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:43.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.856+0000 7f278e7fc640 10 client.26011 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:41:43.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.856+0000 7f27a6d9d640 1 --2- 172.21.15.79:0/1156317545 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55fa4f5b3cc0 0x55fa4f5b60b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2f6609d86a895600 server_cookie=ca9ad8d1cdb9415e in_seq=0 out_seq=0 2024-08-20T01:41:43.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.857+0000 7f278e7fc640 1 -- 172.21.15.79:0/1156317545 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fa4f510880 con 0x55fa4f5b3cc0 2024-08-20T01:41:43.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.857+0000 7f278e7fc640 10 client.26011 handle_command_reply: tid=0 2024-08-20T01:41:43.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.857+0000 7f27af404740 1 client.26011 shutdown 2024-08-20T01:41:43.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.857+0000 7f27af404740 1 -- 172.21.15.79:0/1156317545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa4f5981a0 msgr2=0x55fa4f5a1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:43.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.857+0000 7f27af404740 1 --2- 172.21.15.79:0/1156317545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa4f5981a0 0x55fa4f5a1610 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f27900aa720 tx=0x7f2790005ab0 comp rx=0 tx=0).stop 2024-08-20T01:41:43.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.857+0000 7f27af404740 1 -- 172.21.15.79:0/1156317545 shutdown_connections 2024-08-20T01:41:43.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.857+0000 7f27af404740 1 --2- 172.21.15.79:0/1156317545 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55fa4f5b3cc0 0x55fa4f5b60b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:43.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.857+0000 7f27af404740 1 --2- 172.21.15.79:0/1156317545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa4f5a4130 0x55fa4f5a1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:43.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.857+0000 7f27af404740 1 --2- 172.21.15.79:0/1156317545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa4f5981a0 0x55fa4f5a1610 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:43.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.857+0000 7f278e7fc640 0 client.26011 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:41:43.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.857+0000 7f27af404740 1 --2- 172.21.15.79:0/1156317545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa4f597880 0x55fa4f5a10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:43.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.857+0000 7f27af404740 1 -- 172.21.15.79:0/1156317545 >> 172.21.15.79:0/1156317545 conn(0x55fa4f5956b0 msgr2=0x55fa4f59b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:43.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.857+0000 7f27af404740 1 -- 172.21.15.79:0/1156317545 shutdown_connections 2024-08-20T01:41:43.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.857+0000 7f27af404740 1 -- 172.21.15.79:0/1156317545 wait complete. 2024-08-20T01:41:43.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.857+0000 7f27af404740 20 client.26011 trim_cache size 0 max 16384 2024-08-20T01:41:43.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.870+0000 7f27af404740 1 Processor -- start 2024-08-20T01:41:43.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.870+0000 7f27af404740 1 -- start start 2024-08-20T01:41:43.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.870+0000 7f27af404740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa4f597880 0x55fa4f596dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:43.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.870+0000 7f27af404740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa4f5981a0 0x55fa4f59b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:43.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.870+0000 7f27af404740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa4f5a4130 0x55fa4f5a2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:43.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.870+0000 7f27af404740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f27a81adfa0 con 0x55fa4f597880 2024-08-20T01:41:43.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.870+0000 7f27af404740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f27a81afae0 con 0x55fa4f5981a0 2024-08-20T01:41:43.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.870+0000 7f27af404740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f27a81ae670 con 0x55fa4f5a4130 2024-08-20T01:41:43.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.871+0000 7f27a6d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa4f597880 0x55fa4f596dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:43.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.871+0000 7f27a6d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa4f597880 0x55fa4f596dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40412/0 (socket says 172.21.15.79:40412) 2024-08-20T01:41:43.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.871+0000 7f27a6d9d640 1 -- 172.21.15.79:0/2492008864 learned_addr learned my addr 172.21.15.79:0/2492008864 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:43.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.871+0000 7f27a759e640 1 --2- 172.21.15.79:0/2492008864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa4f5a4130 0x55fa4f5a2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:43.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.871+0000 7f279ffff640 1 --2- 172.21.15.79:0/2492008864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa4f5981a0 0x55fa4f59b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:43.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.871+0000 7f27a6d9d640 1 -- 172.21.15.79:0/2492008864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa4f5a4130 msgr2=0x55fa4f5a2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:43.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.871+0000 7f27a6d9d640 1 --2- 172.21.15.79:0/2492008864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa4f5a4130 0x55fa4f5a2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:43.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.871+0000 7f27a6d9d640 1 -- 172.21.15.79:0/2492008864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa4f5981a0 msgr2=0x55fa4f59b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:43.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.871+0000 7f27a6d9d640 1 --2- 172.21.15.79:0/2492008864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa4f5981a0 0x55fa4f59b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:43.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.871+0000 7f27a6d9d640 1 -- 172.21.15.79:0/2492008864 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa4f596130 con 0x55fa4f597880 2024-08-20T01:41:43.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.871+0000 7f279ffff640 1 --2- 172.21.15.79:0/2492008864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa4f5981a0 0x55fa4f59b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:41:43.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.871+0000 7f27a6d9d640 1 --2- 172.21.15.79:0/2492008864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa4f597880 0x55fa4f596dc0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f2798006010 tx=0x7f2798005b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b94c4de59bf843b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:43.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.871+0000 7f279cff9640 1 -- 172.21.15.79:0/2492008864 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2798049020 con 0x55fa4f597880 2024-08-20T01:41:43.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.871+0000 7f279cff9640 1 -- 172.21.15.79:0/2492008864 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2798003dc0 con 0x55fa4f597880 2024-08-20T01:41:43.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.871+0000 7f279cff9640 1 -- 172.21.15.79:0/2492008864 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2798035040 con 0x55fa4f597880 2024-08-20T01:41:43.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.872+0000 7f27af404740 1 -- 172.21.15.79:0/2492008864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa4f597880 msgr2=0x55fa4f596dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:43.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.872+0000 7f27af404740 1 --2- 172.21.15.79:0/2492008864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa4f597880 0x55fa4f596dc0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f2798006010 tx=0x7f2798005b70 comp rx=0 tx=0).stop 2024-08-20T01:41:43.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.872+0000 7f27af404740 1 -- 172.21.15.79:0/2492008864 shutdown_connections 2024-08-20T01:41:43.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.872+0000 7f27af404740 1 --2- 172.21.15.79:0/2492008864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa4f5a4130 0x55fa4f5a2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:43.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.872+0000 7f27af404740 1 --2- 172.21.15.79:0/2492008864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa4f5981a0 0x55fa4f59b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:43.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.872+0000 7f27af404740 1 --2- 172.21.15.79:0/2492008864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa4f597880 0x55fa4f596dc0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:43.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.872+0000 7f27af404740 1 -- 172.21.15.79:0/2492008864 >> 172.21.15.79:0/2492008864 conn(0x55fa4f5956b0 msgr2=0x55fa4f5a2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:43.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.872+0000 7f27af404740 1 -- 172.21.15.79:0/2492008864 shutdown_connections 2024-08-20T01:41:43.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.872+0000 7f27af404740 1 -- 172.21.15.79:0/2492008864 wait complete. 2024-08-20T01:41:43.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.873+0000 7f27af404740 1 -- start start 2024-08-20T01:41:43.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.873+0000 7f27af404740 1 Processor -- start 2024-08-20T01:41:43.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.873+0000 7f27af404740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa4f597880 0x55fa4f5b7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:43.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.873+0000 7f27af404740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa4f5981a0 0x55fa4f5b83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:43.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.873+0000 7f27af404740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa4f5a4130 0x55fa4f6165c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:43.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.873+0000 7f27af404740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f27a81af410 con 0x55fa4f597880 2024-08-20T01:41:43.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.873+0000 7f27af404740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f27a81aed40 con 0x55fa4f5a4130 2024-08-20T01:41:43.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.873+0000 7f27af404740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f27a81abf80 con 0x55fa4f5981a0 2024-08-20T01:41:43.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.873+0000 7f27af404740 10 client.0 _ll_register_callbacks cb 0x7f2798009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:43.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.873+0000 7f27a6d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa4f597880 0x55fa4f5b7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:43.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.873+0000 7f27a6d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa4f597880 0x55fa4f5b7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40418/0 (socket says 172.21.15.79:40418) 2024-08-20T01:41:43.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.873+0000 7f27a6d9d640 1 -- 172.21.15.79:0/706055642 learned_addr learned my addr 172.21.15.79:0/706055642 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:43.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.873+0000 7f279ffff640 1 --2- 172.21.15.79:0/706055642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa4f5981a0 0x55fa4f5b83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:43.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.874+0000 7f27a6d9d640 1 -- 172.21.15.79:0/706055642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa4f5981a0 msgr2=0x55fa4f5b83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:43.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.874+0000 7f27a6d9d640 1 --2- 172.21.15.79:0/706055642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa4f5981a0 0x55fa4f5b83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:43.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.874+0000 7f27a6d9d640 1 -- 172.21.15.79:0/706055642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa4f5a4130 msgr2=0x55fa4f6165c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:43.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.874+0000 7f27a759e640 1 --2- 172.21.15.79:0/706055642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa4f5a4130 0x55fa4f6165c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:43.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.874+0000 7f27a6d9d640 1 --2- 172.21.15.79:0/706055642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa4f5a4130 0x55fa4f6165c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:43.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.874+0000 7f27a6d9d640 1 -- 172.21.15.79:0/706055642 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa4f59bec0 con 0x55fa4f597880 2024-08-20T01:41:43.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.874+0000 7f27a6d9d640 1 --2- 172.21.15.79:0/706055642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa4f597880 0x55fa4f5b7e40 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f2798005760 tx=0x7f2798005410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1828dd7be526d447 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:43.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.874+0000 7f278e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:41:43.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.874+0000 7f278e7fc640 1 -- 172.21.15.79:0/706055642 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2798049030 con 0x55fa4f597880 2024-08-20T01:41:43.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.874+0000 7f278e7fc640 1 -- 172.21.15.79:0/706055642 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f2798004e70 con 0x55fa4f597880 2024-08-20T01:41:43.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.874+0000 7f27af404740 1 -- 172.21.15.79:0/706055642 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2798003dc0 con 0x55fa4f597880 2024-08-20T01:41:43.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.874+0000 7f278e7fc640 1 -- 172.21.15.79:0/706055642 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f2798035040 con 0x55fa4f597880 2024-08-20T01:41:43.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.874+0000 7f27af404740 10 client.16845 fetch_fsmap learned FSMap version 38 2024-08-20T01:41:43.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.874+0000 7f27af404740 1 -- 172.21.15.79:0/706055642 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55fa4f61def0 con 0x55fa4f597880 2024-08-20T01:41:43.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.875+0000 7f278e7fc640 1 -- 172.21.15.79:0/706055642 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2798003dc0 con 0x55fa4f597880 2024-08-20T01:41:43.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.875+0000 7f278e7fc640 1 -- 172.21.15.79:0/706055642 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f279803c740 con 0x55fa4f597880 2024-08-20T01:41:43.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.875+0000 7f27af404740 10 client.16845 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:41:43.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.875+0000 7f27af404740 10 client.16845 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:41:43.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.875+0000 7f27af404740 20 client.16845 populate_metadata read hostname 'smithi079' 2024-08-20T01:41:43.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.875+0000 7f27af404740 1 --2- 172.21.15.79:0/706055642 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55fa4f5b3cc0 0x55fa4f620680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:43.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.875+0000 7f27af404740 4 client.16845 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:41:43.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.875+0000 7f27af404740 1 -- 172.21.15.79:0/706055642 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fa4f50c320 con 0x55fa4f5b3cc0 2024-08-20T01:41:43.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.875+0000 7f279ffff640 1 --2- 172.21.15.79:0/706055642 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55fa4f5b3cc0 0x55fa4f620680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:43.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.876+0000 7f278e7fc640 10 client.16845 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:41:43.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.876+0000 7f279ffff640 1 --2- 172.21.15.79:0/706055642 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55fa4f5b3cc0 0x55fa4f620680 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4f50a2ad30b871 server_cookie=515e496b44d495a3 in_seq=0 out_seq=0 2024-08-20T01:41:43.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.876+0000 7f278e7fc640 1 -- 172.21.15.79:0/706055642 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fa4f50c320 con 0x55fa4f5b3cc0 2024-08-20T01:41:43.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.876+0000 7f278e7fc640 10 client.16845 handle_command_reply: tid=0 2024-08-20T01:41:43.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.876+0000 7f27af404740 1 client.16845 shutdown 2024-08-20T01:41:43.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.876+0000 7f27af404740 1 -- 172.21.15.79:0/706055642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa4f597880 msgr2=0x55fa4f5b7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:43.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.876+0000 7f27af404740 1 --2- 172.21.15.79:0/706055642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa4f597880 0x55fa4f5b7e40 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f2798005760 tx=0x7f2798005410 comp rx=0 tx=0).stop 2024-08-20T01:41:43.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.876+0000 7f27af404740 1 -- 172.21.15.79:0/706055642 shutdown_connections 2024-08-20T01:41:43.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.876+0000 7f27af404740 1 --2- 172.21.15.79:0/706055642 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55fa4f5b3cc0 0x55fa4f620680 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:43.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.876+0000 7f27af404740 1 --2- 172.21.15.79:0/706055642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa4f5a4130 0x55fa4f6165c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:43.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.876+0000 7f27af404740 1 --2- 172.21.15.79:0/706055642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa4f5981a0 0x55fa4f5b83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:43.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.876+0000 7f278e7fc640 0 client.16845 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:41:43.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.876+0000 7f27af404740 1 --2- 172.21.15.79:0/706055642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa4f597880 0x55fa4f5b7e40 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:43.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.876+0000 7f27af404740 1 -- 172.21.15.79:0/706055642 >> 172.21.15.79:0/706055642 conn(0x55fa4f5956b0 msgr2=0x55fa4f5a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:43.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.876+0000 7f27af404740 1 -- 172.21.15.79:0/706055642 shutdown_connections 2024-08-20T01:41:43.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.876+0000 7f27af404740 1 -- 172.21.15.79:0/706055642 wait complete. 2024-08-20T01:41:43.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.876+0000 7f27af404740 20 client.16845 trim_cache size 0 max 16384 2024-08-20T01:41:43.885 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:41:43.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.877+0000 7f27ad00b640 1 -- 172.21.15.79:0/2305433673 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f27940b3c50 msgr2=0x7f27940b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:43.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.877+0000 7f27ad00b640 1 --2- 172.21.15.79:0/2305433673 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f27940b3c50 0x7f27940b6110 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f27a0005fd0 tx=0x7f27a0009700 comp rx=0 tx=0).stop 2024-08-20T01:41:43.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.877+0000 7f27ad00b640 1 -- 172.21.15.79:0/2305433673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27a81073a0 msgr2=0x7f27a81993f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:43.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.877+0000 7f27ad00b640 1 --2- 172.21.15.79:0/2305433673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27a81073a0 0x7f27a81993f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f279000d950 tx=0x7f279000de10 comp rx=0 tx=0).stop 2024-08-20T01:41:43.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.877+0000 7f27ad00b640 1 -- 172.21.15.79:0/2305433673 shutdown_connections 2024-08-20T01:41:43.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.877+0000 7f27ad00b640 1 --2- 172.21.15.79:0/2305433673 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f27940b3c50 0x7f27940b6110 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:43.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.877+0000 7f27ad00b640 1 --2- 172.21.15.79:0/2305433673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27a8107d20 0x7f27a819e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:43.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.877+0000 7f27ad00b640 1 --2- 172.21.15.79:0/2305433673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27a81073a0 0x7f27a81993f0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:43.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.877+0000 7f27ad00b640 1 --2- 172.21.15.79:0/2305433673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27a8101990 0x7f27a8198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:43.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.877+0000 7f27ad00b640 1 -- 172.21.15.79:0/2305433673 >> 172.21.15.79:0/2305433673 conn(0x7f27a80fd400 msgr2=0x7f27a806ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:43.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.877+0000 7f27ad00b640 1 -- 172.21.15.79:0/2305433673 shutdown_connections 2024-08-20T01:41:43.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:43.877+0000 7f27ad00b640 1 -- 172.21.15.79:0/2305433673 wait complete. 2024-08-20T01:41:44.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:44 smithi081 ceph-mon[22209]: pgmap v479: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 25 MiB/s wr, 21 op/s 2024-08-20T01:41:44.595 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:44 smithi079 ceph-mon[18656]: pgmap v479: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 25 MiB/s wr, 21 op/s 2024-08-20T01:41:44.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:44 smithi175 ceph-mon[22392]: pgmap v479: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 25 MiB/s wr, 21 op/s 2024-08-20T01:41:44.768 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-20T01:41:45.042 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:41:45.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.533+0000 7f16c65a9640 1 -- 172.21.15.79:0/464327155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16c01084c0 msgr2=0x7f16c0108900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:45.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.533+0000 7f16c65a9640 1 --2- 172.21.15.79:0/464327155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16c01084c0 0x7f16c0108900 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f16b4009900 tx=0x7f16b402a410 comp rx=0 tx=0).stop 2024-08-20T01:41:45.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.533+0000 7f16c65a9640 1 -- 172.21.15.79:0/464327155 shutdown_connections 2024-08-20T01:41:45.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.533+0000 7f16c65a9640 1 --2- 172.21.15.79:0/464327155 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16c0108e40 0x7f16c010f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:45.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.533+0000 7f16c65a9640 1 --2- 172.21.15.79:0/464327155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16c01084c0 0x7f16c0108900 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:45.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.533+0000 7f16c65a9640 1 --2- 172.21.15.79:0/464327155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16c0102ab0 0x7f16c0102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:45.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.533+0000 7f16c65a9640 1 -- 172.21.15.79:0/464327155 >> 172.21.15.79:0/464327155 conn(0x7f16c00fe520 msgr2=0x7f16c0100940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:45.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.533+0000 7f16c65a9640 1 -- 172.21.15.79:0/464327155 shutdown_connections 2024-08-20T01:41:45.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.533+0000 7f16c65a9640 1 -- 172.21.15.79:0/464327155 wait complete. 2024-08-20T01:41:45.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.533+0000 7f16c65a9640 1 Processor -- start 2024-08-20T01:41:45.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.534+0000 7f16c65a9640 1 -- start start 2024-08-20T01:41:45.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.534+0000 7f16c65a9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16c0102ab0 0x7f16c00751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:45.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.534+0000 7f16c65a9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16c01084c0 0x7f16c0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:45.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.534+0000 7f16c65a9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16c0108e40 0x7f16c0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:45.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.534+0000 7f16c65a9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f16c0112a00 con 0x7f16c0108e40 2024-08-20T01:41:45.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.534+0000 7f16c65a9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f16c0112880 con 0x7f16c0102ab0 2024-08-20T01:41:45.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.534+0000 7f16c65a9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f16c0112b80 con 0x7f16c01084c0 2024-08-20T01:41:45.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.534+0000 7f16c4b46640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16c0108e40 0x7f16c0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:45.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.534+0000 7f16bffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16c0102ab0 0x7f16c00751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:45.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.534+0000 7f16c4b46640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16c0108e40 0x7f16c0075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40446/0 (socket says 172.21.15.79:40446) 2024-08-20T01:41:45.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.534+0000 7f16bffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16c0102ab0 0x7f16c00751d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:50116/0 (socket says 172.21.15.79:50116) 2024-08-20T01:41:45.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.534+0000 7f16c4b46640 1 -- 172.21.15.79:0/2772105398 learned_addr learned my addr 172.21.15.79:0/2772105398 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:45.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.534+0000 7f16bf7fe640 1 --2- 172.21.15.79:0/2772105398 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16c01084c0 0x7f16c0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:45.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.534+0000 7f16bffff640 1 -- 172.21.15.79:0/2772105398 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16c01084c0 msgr2=0x7f16c0075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:45.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.534+0000 7f16bffff640 1 --2- 172.21.15.79:0/2772105398 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16c01084c0 0x7f16c0075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:45.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.534+0000 7f16bffff640 1 -- 172.21.15.79:0/2772105398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16c0108e40 msgr2=0x7f16c0075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:45.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.534+0000 7f16bffff640 1 --2- 172.21.15.79:0/2772105398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16c0108e40 0x7f16c0075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:45.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.534+0000 7f16bffff640 1 -- 172.21.15.79:0/2772105398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16c01a7300 con 0x7f16c0102ab0 2024-08-20T01:41:45.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.535+0000 7f16bffff640 1 --2- 172.21.15.79:0/2772105398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16c0102ab0 0x7f16c00751d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f16b000e9f0 tx=0x7f16b000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:45.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.535+0000 7f16bd7fa640 1 -- 172.21.15.79:0/2772105398 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b000ccc0 con 0x7f16c0102ab0 2024-08-20T01:41:45.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.535+0000 7f16c65a9640 1 -- 172.21.15.79:0/2772105398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16c01a75f0 con 0x7f16c0102ab0 2024-08-20T01:41:45.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.535+0000 7f16bd7fa640 1 -- 172.21.15.79:0/2772105398 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f16b00108c0 con 0x7f16c0102ab0 2024-08-20T01:41:45.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.535+0000 7f16bd7fa640 1 -- 172.21.15.79:0/2772105398 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b00187c0 con 0x7f16c0102ab0 2024-08-20T01:41:45.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.535+0000 7f16c65a9640 1 -- 172.21.15.79:0/2772105398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16c01a7b00 con 0x7f16c0102ab0 2024-08-20T01:41:45.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.538+0000 7f16c89a2740 1 Processor -- start 2024-08-20T01:41:45.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.538+0000 7f16c89a2740 1 -- start start 2024-08-20T01:41:45.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.538+0000 7f16c89a2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649b8406880 0x5649b8406c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:45.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.538+0000 7f16c89a2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649b84071a0 0x5649b8412bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:45.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.538+0000 7f16bd7fa640 1 -- 172.21.15.79:0/2772105398 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f16b0010430 con 0x7f16c0102ab0 2024-08-20T01:41:45.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.538+0000 7f16c89a2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649b8413130 0x5649b8415520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:45.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.538+0000 7f16c89a2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5649b837d930 con 0x5649b8413130 2024-08-20T01:41:45.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.538+0000 7f16c89a2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5649b836ce30 con 0x5649b84071a0 2024-08-20T01:41:45.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.538+0000 7f16c89a2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5649b8370e70 con 0x5649b8406880 2024-08-20T01:41:45.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.539+0000 7f16bf7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649b8413130 0x5649b8415520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:45.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.539+0000 7f16bf7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649b8413130 0x5649b8415520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40448/0 (socket says 172.21.15.79:40448) 2024-08-20T01:41:45.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.539+0000 7f16bf7fe640 1 -- 172.21.15.79:0/2848855583 learned_addr learned my addr 172.21.15.79:0/2848855583 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:45.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.539+0000 7f16c4b46640 1 --2- 172.21.15.79:0/2848855583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649b8406880 0x5649b8406c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:45.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.539+0000 7f16bffff640 1 --2- 172.21.15.79:0/2848855583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649b84071a0 0x5649b8412bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:45.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.539+0000 7f16bf7fe640 1 -- 172.21.15.79:0/2848855583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649b8406880 msgr2=0x5649b8406c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:45.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.539+0000 7f16bf7fe640 1 --2- 172.21.15.79:0/2848855583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649b8406880 0x5649b8406c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:45.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.539+0000 7f16bf7fe640 1 -- 172.21.15.79:0/2848855583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649b84071a0 msgr2=0x5649b8412bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:45.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.539+0000 7f16bf7fe640 1 --2- 172.21.15.79:0/2848855583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649b84071a0 0x5649b8412bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:45.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.539+0000 7f16bf7fe640 1 -- 172.21.15.79:0/2848855583 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649b80cc650 con 0x5649b8413130 2024-08-20T01:41:45.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.539+0000 7f16bffff640 1 --2- 172.21.15.79:0/2848855583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649b84071a0 0x5649b8412bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:41:45.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.539+0000 7f16bf7fe640 1 --2- 172.21.15.79:0/2848855583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649b8413130 0x5649b8415520 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f16b4033000 tx=0x7f16b4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2965e013191f398 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:45.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.539+0000 7f16a67fc640 1 -- 172.21.15.79:0/2848855583 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b4035040 con 0x5649b8413130 2024-08-20T01:41:45.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.540+0000 7f16a67fc640 1 -- 172.21.15.79:0/2848855583 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f16b40054b0 con 0x5649b8413130 2024-08-20T01:41:45.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.540+0000 7f16a67fc640 1 -- 172.21.15.79:0/2848855583 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b4003850 con 0x5649b8413130 2024-08-20T01:41:45.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.540+0000 7f16bd7fa640 1 --2- 172.21.15.79:0/2772105398 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f16a80b3bd0 0x7f16a80b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:45.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.540+0000 7f16c4b46640 1 --2- 172.21.15.79:0/2772105398 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f16a80b3bd0 0x7f16a80b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:45.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.540+0000 7f16bd7fa640 1 -- 172.21.15.79:0/2772105398 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f16b00e3eb0 con 0x7f16c0102ab0 2024-08-20T01:41:45.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.540+0000 7f16c89a2740 1 -- 172.21.15.79:0/2848855583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649b8413130 msgr2=0x5649b8415520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:45.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.540+0000 7f16c4b46640 1 --2- 172.21.15.79:0/2772105398 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f16a80b3bd0 0x7f16a80b6090 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f16c0077290 tx=0x7f16b8009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:45.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.540+0000 7f16c89a2740 1 --2- 172.21.15.79:0/2848855583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649b8413130 0x5649b8415520 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f16b4033000 tx=0x7f16b4000bc0 comp rx=0 tx=0).stop 2024-08-20T01:41:45.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.540+0000 7f16c89a2740 1 -- 172.21.15.79:0/2848855583 shutdown_connections 2024-08-20T01:41:45.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.540+0000 7f16c89a2740 1 --2- 172.21.15.79:0/2848855583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649b8413130 0x5649b8415520 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:45.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.540+0000 7f16c89a2740 1 --2- 172.21.15.79:0/2848855583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649b84071a0 0x5649b8412bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:45.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.540+0000 7f16c89a2740 1 --2- 172.21.15.79:0/2848855583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649b8406880 0x5649b8406c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:45.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.540+0000 7f16c89a2740 1 -- 172.21.15.79:0/2848855583 >> 172.21.15.79:0/2848855583 conn(0x5649b84046b0 msgr2=0x5649b8405850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:45.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.541+0000 7f16c89a2740 1 -- 172.21.15.79:0/2848855583 shutdown_connections 2024-08-20T01:41:45.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.541+0000 7f16c89a2740 1 -- 172.21.15.79:0/2848855583 wait complete. 2024-08-20T01:41:45.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.541+0000 7f16c89a2740 1 -- start start 2024-08-20T01:41:45.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.541+0000 7f16c89a2740 1 Processor -- start 2024-08-20T01:41:45.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.541+0000 7f16c89a2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649b8406880 0x5649b8410120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:45.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.541+0000 7f16c89a2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649b84071a0 0x5649b8410660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:45.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.541+0000 7f16c89a2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649b8413130 0x5649b8410ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:45.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.542+0000 7f16c89a2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5649b81cf700 con 0x5649b8413130 2024-08-20T01:41:45.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.542+0000 7f16c89a2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5649b82f3810 con 0x5649b8406880 2024-08-20T01:41:45.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.542+0000 7f16c89a2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5649b8415d80 con 0x5649b84071a0 2024-08-20T01:41:45.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.542+0000 7f16c89a2740 10 client.0 _ll_register_callbacks cb 0x5649b8366700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:45.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.542+0000 7f16c4b46640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649b8413130 0x5649b8410ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:45.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.542+0000 7f16c4b46640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649b8413130 0x5649b8410ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40464/0 (socket says 172.21.15.79:40464) 2024-08-20T01:41:45.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.542+0000 7f16bffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649b8406880 0x5649b8410120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:45.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.542+0000 7f16c4b46640 1 -- 172.21.15.79:0/887925184 learned_addr learned my addr 172.21.15.79:0/887925184 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:45.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.542+0000 7f16bf7fe640 1 --2- 172.21.15.79:0/887925184 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649b84071a0 0x5649b8410660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:45.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.542+0000 7f16bf7fe640 1 -- 172.21.15.79:0/887925184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649b8406880 msgr2=0x5649b8410120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:45.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.542+0000 7f16bf7fe640 1 --2- 172.21.15.79:0/887925184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649b8406880 0x5649b8410120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:45.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.542+0000 7f16bf7fe640 1 -- 172.21.15.79:0/887925184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649b8413130 msgr2=0x5649b8410ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:45.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.542+0000 7f16bf7fe640 1 --2- 172.21.15.79:0/887925184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649b8413130 0x5649b8410ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:45.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.542+0000 7f16bf7fe640 1 -- 172.21.15.79:0/887925184 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649b841f180 con 0x5649b84071a0 2024-08-20T01:41:45.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.542+0000 7f16c4b46640 1 --2- 172.21.15.79:0/887925184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649b8413130 0x5649b8410ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:41:45.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.542+0000 7f16bf7fe640 1 --2- 172.21.15.79:0/887925184 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649b84071a0 0x5649b8410660 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f16b402a930 tx=0x7f16b402a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9368972521d140 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:45.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.542+0000 7f169f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:41:45.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.542+0000 7f169f7fe640 1 -- 172.21.15.79:0/887925184 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b4035050 con 0x5649b84071a0 2024-08-20T01:41:45.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.543+0000 7f16c89a2740 1 -- 172.21.15.79:0/887925184 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5649b831c150 con 0x5649b84071a0 2024-08-20T01:41:45.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.543+0000 7f169f7fe640 1 -- 172.21.15.79:0/887925184 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f16b4004330 con 0x5649b84071a0 2024-08-20T01:41:45.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.543+0000 7f169f7fe640 1 -- 172.21.15.79:0/887925184 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f16b4009520 con 0x5649b84071a0 2024-08-20T01:41:45.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.543+0000 7f16c89a2740 10 client.26029 fetch_fsmap learned FSMap version 38 2024-08-20T01:41:45.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.543+0000 7f16c89a2740 1 -- 172.21.15.79:0/887925184 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5649b8421b30 con 0x5649b84071a0 2024-08-20T01:41:45.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.543+0000 7f169f7fe640 1 -- 172.21.15.79:0/887925184 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5649b831c150 con 0x5649b84071a0 2024-08-20T01:41:45.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.543+0000 7f169f7fe640 1 -- 172.21.15.79:0/887925184 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f16b4003960 con 0x5649b84071a0 2024-08-20T01:41:45.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.543+0000 7f16c89a2740 10 client.26029 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:41:45.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.543+0000 7f16c89a2740 10 client.26029 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:41:45.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.543+0000 7f16c89a2740 20 client.26029 populate_metadata read hostname 'smithi079' 2024-08-20T01:41:45.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.543+0000 7f16c89a2740 1 --2- 172.21.15.79:0/887925184 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5649b8422e80 0x5649b8425270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:45.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.543+0000 7f16c89a2740 4 client.26029 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:41:45.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.543+0000 7f16c89a2740 1 -- 172.21.15.79:0/887925184 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5649b837f880 con 0x5649b8422e80 2024-08-20T01:41:45.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.543+0000 7f16bffff640 1 --2- 172.21.15.79:0/887925184 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5649b8422e80 0x5649b8425270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:45.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.544+0000 7f169f7fe640 10 client.26029 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:41:45.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.544+0000 7f16bffff640 1 --2- 172.21.15.79:0/887925184 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5649b8422e80 0x5649b8425270 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=df0c8c6de5805714 server_cookie=3de99cbef0bdcf04 in_seq=0 out_seq=0 2024-08-20T01:41:45.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.544+0000 7f169f7fe640 1 -- 172.21.15.79:0/887925184 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5649b837f880 con 0x5649b8422e80 2024-08-20T01:41:45.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.544+0000 7f169f7fe640 10 client.26029 handle_command_reply: tid=0 2024-08-20T01:41:45.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.544+0000 7f16c89a2740 1 client.26029 shutdown 2024-08-20T01:41:45.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.545+0000 7f16c89a2740 1 -- 172.21.15.79:0/887925184 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649b84071a0 msgr2=0x5649b8410660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:45.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.545+0000 7f16c89a2740 1 --2- 172.21.15.79:0/887925184 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649b84071a0 0x5649b8410660 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f16b402a930 tx=0x7f16b402a410 comp rx=0 tx=0).stop 2024-08-20T01:41:45.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.545+0000 7f16c89a2740 1 -- 172.21.15.79:0/887925184 shutdown_connections 2024-08-20T01:41:45.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.545+0000 7f16c89a2740 1 --2- 172.21.15.79:0/887925184 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5649b8422e80 0x5649b8425270 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:45.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.545+0000 7f16c89a2740 1 --2- 172.21.15.79:0/887925184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649b8413130 0x5649b8410ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:45.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.545+0000 7f16c89a2740 1 --2- 172.21.15.79:0/887925184 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649b84071a0 0x5649b8410660 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:45.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.545+0000 7f16c89a2740 1 --2- 172.21.15.79:0/887925184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649b8406880 0x5649b8410120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:45.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.545+0000 7f169f7fe640 0 client.26029 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:41:45.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.545+0000 7f16c89a2740 1 -- 172.21.15.79:0/887925184 >> 172.21.15.79:0/887925184 conn(0x5649b84046b0 msgr2=0x5649b840a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:45.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.545+0000 7f16c89a2740 1 -- 172.21.15.79:0/887925184 shutdown_connections 2024-08-20T01:41:45.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.545+0000 7f16c89a2740 1 -- 172.21.15.79:0/887925184 wait complete. 2024-08-20T01:41:45.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.545+0000 7f16c89a2740 20 client.26029 trim_cache size 0 max 16384 2024-08-20T01:41:45.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.559+0000 7f16c89a2740 1 Processor -- start 2024-08-20T01:41:45.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.559+0000 7f16c89a2740 1 -- start start 2024-08-20T01:41:45.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.559+0000 7f16c89a2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649b8406880 0x5649b840aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:45.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.559+0000 7f16c89a2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649b84071a0 0x5649b8405dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:45.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.559+0000 7f16c89a2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649b8413130 0x5649b8411e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:45.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.559+0000 7f16c89a2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f16c01b0150 con 0x5649b84071a0 2024-08-20T01:41:45.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.559+0000 7f16c89a2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f16c01b1c90 con 0x5649b8413130 2024-08-20T01:41:45.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.559+0000 7f16c89a2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f16c01b0820 con 0x5649b8406880 2024-08-20T01:41:45.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.559+0000 7f16bf7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649b84071a0 0x5649b8405dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:45.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.559+0000 7f16bf7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649b84071a0 0x5649b8405dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40472/0 (socket says 172.21.15.79:40472) 2024-08-20T01:41:45.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.559+0000 7f16bf7fe640 1 -- 172.21.15.79:0/2068837544 learned_addr learned my addr 172.21.15.79:0/2068837544 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:45.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.559+0000 7f16bffff640 1 --2- 172.21.15.79:0/2068837544 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649b8406880 0x5649b840aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:45.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.559+0000 7f16c4b46640 1 --2- 172.21.15.79:0/2068837544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649b8413130 0x5649b8411e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:45.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.560+0000 7f16bffff640 1 -- 172.21.15.79:0/2068837544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649b8413130 msgr2=0x5649b8411e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:45.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.560+0000 7f16bffff640 1 --2- 172.21.15.79:0/2068837544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649b8413130 0x5649b8411e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:45.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.560+0000 7f16bffff640 1 -- 172.21.15.79:0/2068837544 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649b84071a0 msgr2=0x5649b8405dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:45.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.560+0000 7f16bffff640 1 --2- 172.21.15.79:0/2068837544 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649b84071a0 0x5649b8405dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:45.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.560+0000 7f16bffff640 1 -- 172.21.15.79:0/2068837544 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649b8405130 con 0x5649b8406880 2024-08-20T01:41:45.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.560+0000 7f16bf7fe640 1 --2- 172.21.15.79:0/2068837544 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649b84071a0 0x5649b8405dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:41:45.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.560+0000 7f16bffff640 1 --2- 172.21.15.79:0/2068837544 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649b8406880 0x5649b840aa40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f16b00e1a10 tx=0x7f16b000ce60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80f05861c2b5c07c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:45.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.560+0000 7f16a5ffb640 1 -- 172.21.15.79:0/2068837544 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b00aaec0 con 0x5649b8406880 2024-08-20T01:41:45.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.560+0000 7f16a5ffb640 1 -- 172.21.15.79:0/2068837544 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f16b00af410 con 0x5649b8406880 2024-08-20T01:41:45.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.560+0000 7f16a5ffb640 1 -- 172.21.15.79:0/2068837544 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b00a6830 con 0x5649b8406880 2024-08-20T01:41:45.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.561+0000 7f16c89a2740 1 -- 172.21.15.79:0/2068837544 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649b8406880 msgr2=0x5649b840aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:45.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.561+0000 7f16c89a2740 1 --2- 172.21.15.79:0/2068837544 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649b8406880 0x5649b840aa40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f16b00e1a10 tx=0x7f16b000ce60 comp rx=0 tx=0).stop 2024-08-20T01:41:45.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.561+0000 7f16c89a2740 1 -- 172.21.15.79:0/2068837544 shutdown_connections 2024-08-20T01:41:45.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.561+0000 7f16c89a2740 1 --2- 172.21.15.79:0/2068837544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649b8413130 0x5649b8411e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:45.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.561+0000 7f16c89a2740 1 --2- 172.21.15.79:0/2068837544 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649b84071a0 0x5649b8405dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:45.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.561+0000 7f16c89a2740 1 --2- 172.21.15.79:0/2068837544 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649b8406880 0x5649b840aa40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:45.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.561+0000 7f16c89a2740 1 -- 172.21.15.79:0/2068837544 >> 172.21.15.79:0/2068837544 conn(0x5649b84046b0 msgr2=0x5649b8411750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:45.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.561+0000 7f16c89a2740 1 -- 172.21.15.79:0/2068837544 shutdown_connections 2024-08-20T01:41:45.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.561+0000 7f16c89a2740 1 -- 172.21.15.79:0/2068837544 wait complete. 2024-08-20T01:41:45.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.561+0000 7f16c89a2740 1 -- start start 2024-08-20T01:41:45.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.561+0000 7f16c89a2740 1 Processor -- start 2024-08-20T01:41:45.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.562+0000 7f16c89a2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649b8406880 0x5649b841b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:45.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.562+0000 7f16c89a2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649b84071a0 0x5649b8417e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:45.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.562+0000 7f16c89a2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649b8413130 0x5649b84185a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:45.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.562+0000 7f16c89a2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f16c01b15c0 con 0x5649b8413130 2024-08-20T01:41:45.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.562+0000 7f16c89a2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f16c01b0ef0 con 0x5649b84071a0 2024-08-20T01:41:45.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.562+0000 7f16c89a2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f16c01ae130 con 0x5649b8406880 2024-08-20T01:41:45.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.562+0000 7f16c89a2740 10 client.0 _ll_register_callbacks cb 0x7f16b8009ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:45.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.562+0000 7f16c4b46640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649b8413130 0x5649b84185a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:45.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.562+0000 7f16c4b46640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649b8413130 0x5649b84185a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40478/0 (socket says 172.21.15.79:40478) 2024-08-20T01:41:45.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.562+0000 7f16c4b46640 1 -- 172.21.15.79:0/4162441242 learned_addr learned my addr 172.21.15.79:0/4162441242 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:45.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.562+0000 7f16bffff640 1 --2- 172.21.15.79:0/4162441242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649b8406880 0x5649b841b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:45.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.562+0000 7f16bf7fe640 1 --2- 172.21.15.79:0/4162441242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649b84071a0 0x5649b8417e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:45.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.562+0000 7f16bffff640 1 -- 172.21.15.79:0/4162441242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649b84071a0 msgr2=0x5649b8417e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:45.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.562+0000 7f16bffff640 1 --2- 172.21.15.79:0/4162441242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649b84071a0 0x5649b8417e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:45.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.562+0000 7f16bffff640 1 -- 172.21.15.79:0/4162441242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649b8413130 msgr2=0x5649b84185a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:45.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.562+0000 7f16bffff640 1 --2- 172.21.15.79:0/4162441242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649b8413130 0x5649b84185a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:45.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.563+0000 7f16bffff640 1 -- 172.21.15.79:0/4162441242 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649b848b870 con 0x5649b8406880 2024-08-20T01:41:45.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.563+0000 7f16c4b46640 1 --2- 172.21.15.79:0/4162441242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649b8413130 0x5649b84185a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:41:45.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.563+0000 7f16bffff640 1 --2- 172.21.15.79:0/4162441242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649b8406880 0x5649b841b910 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f16b00e1a10 tx=0x7f16b00e7550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61a48be26d26c1ba server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:45.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.563+0000 7f169f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:41:45.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.563+0000 7f169f7fe640 1 -- 172.21.15.79:0/4162441242 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b008f020 con 0x5649b8406880 2024-08-20T01:41:45.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.563+0000 7f169f7fe640 1 -- 172.21.15.79:0/4162441242 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f16b00a7150 con 0x5649b8406880 2024-08-20T01:41:45.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.563+0000 7f16c89a2740 1 -- 172.21.15.79:0/4162441242 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16b00af410 con 0x5649b8406880 2024-08-20T01:41:45.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.563+0000 7f169f7fe640 1 -- 172.21.15.79:0/4162441242 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f16b00b3ec0 con 0x5649b8406880 2024-08-20T01:41:45.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.563+0000 7f16c89a2740 10 client.26035 fetch_fsmap learned FSMap version 38 2024-08-20T01:41:45.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.563+0000 7f16c89a2740 1 -- 172.21.15.79:0/4162441242 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5649b848cb40 con 0x5649b8406880 2024-08-20T01:41:45.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.563+0000 7f169f7fe640 1 -- 172.21.15.79:0/4162441242 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f16b00af410 con 0x5649b8406880 2024-08-20T01:41:45.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.563+0000 7f169f7fe640 1 -- 172.21.15.79:0/4162441242 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f16b00a9d90 con 0x5649b8406880 2024-08-20T01:41:45.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.563+0000 7f16c89a2740 10 client.26035 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:41:45.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.563+0000 7f16c89a2740 10 client.26035 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:41:45.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.563+0000 7f16c89a2740 20 client.26035 populate_metadata read hostname 'smithi079' 2024-08-20T01:41:45.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.564+0000 7f16c89a2740 1 --2- 172.21.15.79:0/4162441242 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5649b848d020 0x5649b848f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:45.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.564+0000 7f16c89a2740 4 client.26035 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:41:45.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.564+0000 7f16c89a2740 1 -- 172.21.15.79:0/4162441242 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5649b837b320 con 0x5649b848d020 2024-08-20T01:41:45.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.564+0000 7f16bf7fe640 1 --2- 172.21.15.79:0/4162441242 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5649b848d020 0x5649b848f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:45.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.564+0000 7f16bf7fe640 1 --2- 172.21.15.79:0/4162441242 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5649b848d020 0x5649b848f410 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=977d6ba1f85769c3 server_cookie=2c5eebe7e62899e0 in_seq=0 out_seq=0 2024-08-20T01:41:45.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.564+0000 7f169f7fe640 10 client.26035 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:41:45.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.564+0000 7f169f7fe640 1 -- 172.21.15.79:0/4162441242 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5649b837b320 con 0x5649b848d020 2024-08-20T01:41:45.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.564+0000 7f169f7fe640 10 client.26035 handle_command_reply: tid=0 2024-08-20T01:41:45.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.564+0000 7f16c89a2740 1 client.26035 shutdown 2024-08-20T01:41:45.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.564+0000 7f16c89a2740 1 -- 172.21.15.79:0/4162441242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649b8406880 msgr2=0x5649b841b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:45.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.564+0000 7f16c89a2740 1 --2- 172.21.15.79:0/4162441242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649b8406880 0x5649b841b910 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f16b00e1a10 tx=0x7f16b00e7550 comp rx=0 tx=0).stop 2024-08-20T01:41:45.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.564+0000 7f16c89a2740 1 -- 172.21.15.79:0/4162441242 shutdown_connections 2024-08-20T01:41:45.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.564+0000 7f16c89a2740 1 --2- 172.21.15.79:0/4162441242 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5649b848d020 0x5649b848f410 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:45.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.565+0000 7f16c89a2740 1 --2- 172.21.15.79:0/4162441242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5649b8413130 0x5649b84185a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:45.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.565+0000 7f16c89a2740 1 --2- 172.21.15.79:0/4162441242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649b84071a0 0x5649b8417e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:45.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.565+0000 7f16c89a2740 1 --2- 172.21.15.79:0/4162441242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649b8406880 0x5649b841b910 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:45.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.565+0000 7f169f7fe640 0 client.26035 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:41:45.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.565+0000 7f16c89a2740 1 -- 172.21.15.79:0/4162441242 >> 172.21.15.79:0/4162441242 conn(0x5649b84046b0 msgr2=0x5649b8411f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:45.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.565+0000 7f16c89a2740 1 -- 172.21.15.79:0/4162441242 shutdown_connections 2024-08-20T01:41:45.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.565+0000 7f16c89a2740 1 -- 172.21.15.79:0/4162441242 wait complete. 2024-08-20T01:41:45.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.565+0000 7f16c89a2740 20 client.26035 trim_cache size 0 max 16384 2024-08-20T01:41:45.576 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:41:45.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.565+0000 7f16c65a9640 1 -- 172.21.15.79:0/2772105398 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f16a80b3bd0 msgr2=0x7f16a80b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:45.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.565+0000 7f16c65a9640 1 --2- 172.21.15.79:0/2772105398 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f16a80b3bd0 0x7f16a80b6090 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f16c0077290 tx=0x7f16b8009680 comp rx=0 tx=0).stop 2024-08-20T01:41:45.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.565+0000 7f16c65a9640 1 -- 172.21.15.79:0/2772105398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16c0102ab0 msgr2=0x7f16c00751d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:45.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.565+0000 7f16c65a9640 1 --2- 172.21.15.79:0/2772105398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16c0102ab0 0x7f16c00751d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f16b000e9f0 tx=0x7f16b000eeb0 comp rx=0 tx=0).stop 2024-08-20T01:41:45.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.566+0000 7f16c65a9640 1 -- 172.21.15.79:0/2772105398 shutdown_connections 2024-08-20T01:41:45.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.566+0000 7f16c65a9640 1 --2- 172.21.15.79:0/2772105398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16c0108e40 0x7f16c0075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:45.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.566+0000 7f16c65a9640 1 --2- 172.21.15.79:0/2772105398 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f16a80b3bd0 0x7f16a80b6090 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:45.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.566+0000 7f16c65a9640 1 --2- 172.21.15.79:0/2772105398 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16c01084c0 0x7f16c0075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:45.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.566+0000 7f16c65a9640 1 --2- 172.21.15.79:0/2772105398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16c0102ab0 0x7f16c00751d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:45.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.566+0000 7f16c65a9640 1 -- 172.21.15.79:0/2772105398 >> 172.21.15.79:0/2772105398 conn(0x7f16c00fe520 msgr2=0x7f16c0100910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:45.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.566+0000 7f16c65a9640 1 -- 172.21.15.79:0/2772105398 shutdown_connections 2024-08-20T01:41:45.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:45.566+0000 7f16c65a9640 1 -- 172.21.15.79:0/2772105398 wait complete. 2024-08-20T01:41:46.394 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T01:41:46.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:46 smithi081 ceph-mon[22209]: pgmap v480: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 30 MiB/s wr, 25 op/s 2024-08-20T01:41:46.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:46 smithi175 ceph-mon[22392]: pgmap v480: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 30 MiB/s wr, 25 op/s 2024-08-20T01:41:46.676 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:41:46.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:46 smithi079 ceph-mon[18656]: pgmap v480: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 30 MiB/s wr, 25 op/s 2024-08-20T01:41:47.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.175+0000 7f09e8f9d640 1 -- 172.21.15.79:0/1883292493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09e4108cb0 msgr2=0x7f09e410f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:47.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.175+0000 7f09e8f9d640 1 --2- 172.21.15.79:0/1883292493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09e4108cb0 0x7f09e410f4b0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f09dc009ca0 tx=0x7f09dc02a8c0 comp rx=0 tx=0).stop 2024-08-20T01:41:47.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.175+0000 7f09e8f9d640 1 -- 172.21.15.79:0/1883292493 shutdown_connections 2024-08-20T01:41:47.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.175+0000 7f09e8f9d640 1 --2- 172.21.15.79:0/1883292493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09e4108cb0 0x7f09e410f4b0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:47.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.175+0000 7f09e8f9d640 1 --2- 172.21.15.79:0/1883292493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09e4108330 0x7f09e4108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:47.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.175+0000 7f09e8f9d640 1 --2- 172.21.15.79:0/1883292493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09e4102920 0x7f09e4102d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:47.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.175+0000 7f09e8f9d640 1 -- 172.21.15.79:0/1883292493 >> 172.21.15.79:0/1883292493 conn(0x7f09e40fe350 msgr2=0x7f09e4100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:47.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.175+0000 7f09e8f9d640 1 -- 172.21.15.79:0/1883292493 shutdown_connections 2024-08-20T01:41:47.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.175+0000 7f09e8f9d640 1 -- 172.21.15.79:0/1883292493 wait complete. 2024-08-20T01:41:47.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.176+0000 7f09e8f9d640 1 Processor -- start 2024-08-20T01:41:47.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.176+0000 7f09e8f9d640 1 -- start start 2024-08-20T01:41:47.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.176+0000 7f09e8f9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09e4102920 0x7f09e4198c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:47.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.176+0000 7f09e8f9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09e4108330 0x7f09e4199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:47.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.176+0000 7f09e8f9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09e4108cb0 0x7f09e419e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:47.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.176+0000 7f09e8f9d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f09e4112870 con 0x7f09e4108330 2024-08-20T01:41:47.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.176+0000 7f09e8f9d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f09e41126f0 con 0x7f09e4102920 2024-08-20T01:41:47.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.176+0000 7f09e8f9d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f09e41129f0 con 0x7f09e4108cb0 2024-08-20T01:41:47.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.176+0000 7f09e2ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09e4108330 0x7f09e4199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:47.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.176+0000 7f09e2ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09e4108330 0x7f09e4199140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40508/0 (socket says 172.21.15.79:40508) 2024-08-20T01:41:47.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.176+0000 7f09e2ffd640 1 -- 172.21.15.79:0/3589551361 learned_addr learned my addr 172.21.15.79:0/3589551361 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:47.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.177+0000 7f09e37fe640 1 --2- 172.21.15.79:0/3589551361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09e4102920 0x7f09e4198c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:47.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.177+0000 7f09e3fff640 1 --2- 172.21.15.79:0/3589551361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09e4108cb0 0x7f09e419e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:47.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.177+0000 7f09e2ffd640 1 -- 172.21.15.79:0/3589551361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09e4108cb0 msgr2=0x7f09e419e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:47.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.177+0000 7f09e2ffd640 1 --2- 172.21.15.79:0/3589551361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09e4108cb0 0x7f09e419e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:47.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.177+0000 7f09e2ffd640 1 -- 172.21.15.79:0/3589551361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09e4102920 msgr2=0x7f09e4198c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:47.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.177+0000 7f09e2ffd640 1 --2- 172.21.15.79:0/3589551361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09e4102920 0x7f09e4198c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:47.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.177+0000 7f09e2ffd640 1 -- 172.21.15.79:0/3589551361 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09e419ecb0 con 0x7f09e4108330 2024-08-20T01:41:47.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.177+0000 7f09e3fff640 1 --2- 172.21.15.79:0/3589551361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09e4108cb0 0x7f09e419e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:41:47.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.177+0000 7f09e2ffd640 1 --2- 172.21.15.79:0/3589551361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09e4108330 0x7f09e4199140 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f09d800d950 tx=0x7f09d800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:47.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.177+0000 7f09e0ff9640 1 -- 172.21.15.79:0/3589551361 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d8017070 con 0x7f09e4108330 2024-08-20T01:41:47.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.177+0000 7f09e0ff9640 1 -- 172.21.15.79:0/3589551361 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f09d8009c30 con 0x7f09e4108330 2024-08-20T01:41:47.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.177+0000 7f09e0ff9640 1 -- 172.21.15.79:0/3589551361 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d800f620 con 0x7f09e4108330 2024-08-20T01:41:47.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.177+0000 7f09e8f9d640 1 -- 172.21.15.79:0/3589551361 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09e419efa0 con 0x7f09e4108330 2024-08-20T01:41:47.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.177+0000 7f09e8f9d640 1 -- 172.21.15.79:0/3589551361 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09e41a5660 con 0x7f09e4108330 2024-08-20T01:41:47.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.180+0000 7f09e0ff9640 1 -- 172.21.15.79:0/3589551361 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f09d8010460 con 0x7f09e4108330 2024-08-20T01:41:47.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.180+0000 7f09ec5f8740 1 Processor -- start 2024-08-20T01:41:47.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.180+0000 7f09ec5f8740 1 -- start start 2024-08-20T01:41:47.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.181+0000 7f09ec5f8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b57250a30 0x563b57250e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:47.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.181+0000 7f09ec5f8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b57251350 0x563b572611b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:47.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.181+0000 7f09ec5f8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b572616f0 0x563b57263ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:47.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.181+0000 7f09ec5f8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563b571c7930 con 0x563b57250a30 2024-08-20T01:41:47.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.181+0000 7f09ec5f8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563b571b6e30 con 0x563b57251350 2024-08-20T01:41:47.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.181+0000 7f09ec5f8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563b571bae70 con 0x563b572616f0 2024-08-20T01:41:47.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.181+0000 7f09e3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b57250a30 0x563b57250e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:47.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.181+0000 7f09e3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b57250a30 0x563b57250e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40520/0 (socket says 172.21.15.79:40520) 2024-08-20T01:41:47.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.181+0000 7f09e3fff640 1 -- 172.21.15.79:0/4118841152 learned_addr learned my addr 172.21.15.79:0/4118841152 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:47.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.181+0000 7f09e0ff9640 1 --2- 172.21.15.79:0/3589551361 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f09cc0b3c70 0x7f09cc0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:47.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.181+0000 7f09e37fe640 1 --2- 172.21.15.79:0/4118841152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b57251350 0x563b572611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:47.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.181+0000 7f09e3fff640 1 --2- 172.21.15.79:0/3589551361 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f09cc0b3c70 0x7f09cc0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:47.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.181+0000 7f09e2ffd640 1 --2- 172.21.15.79:0/4118841152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b572616f0 0x563b57263ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:47.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.181+0000 7f09e0ff9640 1 -- 172.21.15.79:0/3589551361 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f09d80e3800 con 0x7f09e4108330 2024-08-20T01:41:47.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.181+0000 7f09e3fff640 1 -- 172.21.15.79:0/4118841152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b572616f0 msgr2=0x563b57263ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:47.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.181+0000 7f09e3fff640 1 --2- 172.21.15.79:0/4118841152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b572616f0 0x563b57263ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:47.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.181+0000 7f09e3fff640 1 -- 172.21.15.79:0/4118841152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b57251350 msgr2=0x563b572611b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:47.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.181+0000 7f09e3fff640 1 --2- 172.21.15.79:0/4118841152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b57251350 0x563b572611b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:47.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.181+0000 7f09e3fff640 1 -- 172.21.15.79:0/4118841152 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b56f16650 con 0x563b57250a30 2024-08-20T01:41:47.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.181+0000 7f09e2ffd640 1 --2- 172.21.15.79:0/4118841152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b572616f0 0x563b57263ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:41:47.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.182+0000 7f09e3fff640 1 --2- 172.21.15.79:0/4118841152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b57250a30 0x563b57250e10 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f09dc031cc0 tx=0x7f09dc031cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e4a3a479d49ccaa server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:47.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.182+0000 7f09c9ffb640 1 -- 172.21.15.79:0/4118841152 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09dc004b40 con 0x563b57250a30 2024-08-20T01:41:47.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.182+0000 7f09c9ffb640 1 -- 172.21.15.79:0/4118841152 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f09dc04e070 con 0x563b57250a30 2024-08-20T01:41:47.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.182+0000 7f09c9ffb640 1 -- 172.21.15.79:0/4118841152 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09dc030960 con 0x563b57250a30 2024-08-20T01:41:47.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.182+0000 7f09e3fff640 1 --2- 172.21.15.79:0/3589551361 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f09cc0b3c70 0x7f09cc0b6130 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f09dc04d000 tx=0x7f09dc04b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:47.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.182+0000 7f09ec5f8740 1 -- 172.21.15.79:0/4118841152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b57250a30 msgr2=0x563b57250e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:47.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.182+0000 7f09ec5f8740 1 --2- 172.21.15.79:0/4118841152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b57250a30 0x563b57250e10 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f09dc031cc0 tx=0x7f09dc031cf0 comp rx=0 tx=0).stop 2024-08-20T01:41:47.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.183+0000 7f09ec5f8740 1 -- 172.21.15.79:0/4118841152 shutdown_connections 2024-08-20T01:41:47.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.183+0000 7f09ec5f8740 1 --2- 172.21.15.79:0/4118841152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b572616f0 0x563b57263ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:47.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.183+0000 7f09ec5f8740 1 --2- 172.21.15.79:0/4118841152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b57251350 0x563b572611b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:47.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.183+0000 7f09ec5f8740 1 --2- 172.21.15.79:0/4118841152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b57250a30 0x563b57250e10 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:47.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.183+0000 7f09ec5f8740 1 -- 172.21.15.79:0/4118841152 >> 172.21.15.79:0/4118841152 conn(0x563b5724e860 msgr2=0x563b5724fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:47.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.183+0000 7f09ec5f8740 1 -- 172.21.15.79:0/4118841152 shutdown_connections 2024-08-20T01:41:47.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.183+0000 7f09ec5f8740 1 -- 172.21.15.79:0/4118841152 wait complete. 2024-08-20T01:41:47.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.183+0000 7f09ec5f8740 1 -- start start 2024-08-20T01:41:47.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.183+0000 7f09ec5f8740 1 Processor -- start 2024-08-20T01:41:47.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.184+0000 7f09ec5f8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b57250a30 0x563b5725a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:47.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.184+0000 7f09ec5f8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b57251350 0x563b5725acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:47.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.184+0000 7f09ec5f8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b572616f0 0x563b5725b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:47.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.184+0000 7f09ec5f8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563b57019700 con 0x563b57251350 2024-08-20T01:41:47.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.184+0000 7f09ec5f8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563b5713d810 con 0x563b57250a30 2024-08-20T01:41:47.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.184+0000 7f09ec5f8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563b57256fa0 con 0x563b572616f0 2024-08-20T01:41:47.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.184+0000 7f09ec5f8740 10 client.0 _ll_register_callbacks cb 0x563b571b0700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:47.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.184+0000 7f09e2ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b57251350 0x563b5725acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:47.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.184+0000 7f09e2ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b57251350 0x563b5725acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40534/0 (socket says 172.21.15.79:40534) 2024-08-20T01:41:47.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.184+0000 7f09e2ffd640 1 -- 172.21.15.79:0/1349604730 learned_addr learned my addr 172.21.15.79:0/1349604730 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:47.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.184+0000 7f09e37fe640 1 --2- 172.21.15.79:0/1349604730 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b57250a30 0x563b5725a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:47.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.184+0000 7f09e3fff640 1 --2- 172.21.15.79:0/1349604730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b572616f0 0x563b5725b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:47.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.184+0000 7f09e2ffd640 1 -- 172.21.15.79:0/1349604730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b572616f0 msgr2=0x563b5725b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:47.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.184+0000 7f09e2ffd640 1 --2- 172.21.15.79:0/1349604730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b572616f0 0x563b5725b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:47.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.184+0000 7f09e2ffd640 1 -- 172.21.15.79:0/1349604730 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b57250a30 msgr2=0x563b5725a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:47.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.184+0000 7f09e2ffd640 1 --2- 172.21.15.79:0/1349604730 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b57250a30 0x563b5725a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:47.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.184+0000 7f09e2ffd640 1 -- 172.21.15.79:0/1349604730 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b572601e0 con 0x563b57251350 2024-08-20T01:41:47.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.184+0000 7f09e2ffd640 1 --2- 172.21.15.79:0/1349604730 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b57251350 0x563b5725acf0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f09d80aa6f0 tx=0x7f09d800bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e8da3fbefdc0de5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:47.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.184+0000 7f09c2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:41:47.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.185+0000 7f09c2ffd640 1 -- 172.21.15.79:0/1349604730 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d8020050 con 0x563b57251350 2024-08-20T01:41:47.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.185+0000 7f09ec5f8740 1 -- 172.21.15.79:0/1349604730 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563b57166150 con 0x563b57251350 2024-08-20T01:41:47.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.185+0000 7f09c2ffd640 1 -- 172.21.15.79:0/1349604730 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f09d80cd0e0 con 0x563b57251350 2024-08-20T01:41:47.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.185+0000 7f09c2ffd640 1 -- 172.21.15.79:0/1349604730 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f09d80aa270 con 0x563b57251350 2024-08-20T01:41:47.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.185+0000 7f09ec5f8740 10 client.16875 fetch_fsmap learned FSMap version 38 2024-08-20T01:41:47.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.185+0000 7f09ec5f8740 1 -- 172.21.15.79:0/1349604730 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x563b5726bc90 con 0x563b57251350 2024-08-20T01:41:47.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.185+0000 7f09c2ffd640 1 -- 172.21.15.79:0/1349604730 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x563b57166150 con 0x563b57251350 2024-08-20T01:41:47.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.185+0000 7f09c2ffd640 1 -- 172.21.15.79:0/1349604730 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f09d80b3380 con 0x563b57251350 2024-08-20T01:41:47.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.185+0000 7f09ec5f8740 10 client.16875 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:41:47.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.185+0000 7f09ec5f8740 10 client.16875 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:41:47.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.185+0000 7f09ec5f8740 20 client.16875 populate_metadata read hostname 'smithi079' 2024-08-20T01:41:47.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.185+0000 7f09ec5f8740 1 --2- 172.21.15.79:0/1349604730 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x563b5726d3c0 0x563b5726f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:47.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.185+0000 7f09ec5f8740 4 client.16875 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:41:47.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.185+0000 7f09ec5f8740 1 -- 172.21.15.79:0/1349604730 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563b571c9880 con 0x563b5726d3c0 2024-08-20T01:41:47.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.185+0000 7f09e37fe640 1 --2- 172.21.15.79:0/1349604730 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x563b5726d3c0 0x563b5726f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:47.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.186+0000 7f09c2ffd640 10 client.16875 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:41:47.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.186+0000 7f09e37fe640 1 --2- 172.21.15.79:0/1349604730 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x563b5726d3c0 0x563b5726f7b0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e0bcbaaa0a16abcd server_cookie=4eba867534ba142c in_seq=0 out_seq=0 2024-08-20T01:41:47.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.187+0000 7f09c2ffd640 1 -- 172.21.15.79:0/1349604730 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563b571c9880 con 0x563b5726d3c0 2024-08-20T01:41:47.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.187+0000 7f09c2ffd640 10 client.16875 handle_command_reply: tid=0 2024-08-20T01:41:47.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.187+0000 7f09ec5f8740 1 client.16875 shutdown 2024-08-20T01:41:47.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.187+0000 7f09ec5f8740 1 -- 172.21.15.79:0/1349604730 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b57251350 msgr2=0x563b5725acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:47.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.187+0000 7f09ec5f8740 1 --2- 172.21.15.79:0/1349604730 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b57251350 0x563b5725acf0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f09d80aa6f0 tx=0x7f09d800bf90 comp rx=0 tx=0).stop 2024-08-20T01:41:47.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.187+0000 7f09ec5f8740 1 -- 172.21.15.79:0/1349604730 shutdown_connections 2024-08-20T01:41:47.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.187+0000 7f09ec5f8740 1 --2- 172.21.15.79:0/1349604730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b572616f0 0x563b5725b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:47.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.187+0000 7f09ec5f8740 1 --2- 172.21.15.79:0/1349604730 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x563b5726d3c0 0x563b5726f7b0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:47.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.187+0000 7f09ec5f8740 1 --2- 172.21.15.79:0/1349604730 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b57251350 0x563b5725acf0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:47.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.187+0000 7f09ec5f8740 1 --2- 172.21.15.79:0/1349604730 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b57250a30 0x563b5725a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:47.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.187+0000 7f09ec5f8740 1 -- 172.21.15.79:0/1349604730 >> 172.21.15.79:0/1349604730 conn(0x563b5724e860 msgr2=0x563b57254400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:47.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.187+0000 7f09c2ffd640 0 client.16875 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:41:47.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.187+0000 7f09ec5f8740 1 -- 172.21.15.79:0/1349604730 shutdown_connections 2024-08-20T01:41:47.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.187+0000 7f09ec5f8740 1 -- 172.21.15.79:0/1349604730 wait complete. 2024-08-20T01:41:47.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.187+0000 7f09ec5f8740 20 client.16875 trim_cache size 0 max 16384 2024-08-20T01:41:47.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.204+0000 7f09ec5f8740 1 Processor -- start 2024-08-20T01:41:47.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.204+0000 7f09ec5f8740 1 -- start start 2024-08-20T01:41:47.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.204+0000 7f09ec5f8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b57250a30 0x563b5725a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:47.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.204+0000 7f09ec5f8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b57251350 0x563b57258200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:47.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.204+0000 7f09ec5f8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b572616f0 0x563b5724cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:47.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.204+0000 7f09ec5f8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f09e41aba20 con 0x563b57251350 2024-08-20T01:41:47.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.204+0000 7f09ec5f8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f09e41ad560 con 0x563b572616f0 2024-08-20T01:41:47.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.204+0000 7f09ec5f8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f09e41ac0f0 con 0x563b57250a30 2024-08-20T01:41:47.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.205+0000 7f09e2ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b57251350 0x563b57258200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:47.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.205+0000 7f09e2ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b57251350 0x563b57258200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40550/0 (socket says 172.21.15.79:40550) 2024-08-20T01:41:47.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.205+0000 7f09e2ffd640 1 -- 172.21.15.79:0/101238664 learned_addr learned my addr 172.21.15.79:0/101238664 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:47.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.205+0000 7f09e37fe640 1 --2- 172.21.15.79:0/101238664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b57250a30 0x563b5725a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:47.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.205+0000 7f09e3fff640 1 --2- 172.21.15.79:0/101238664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b572616f0 0x563b5724cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:47.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.205+0000 7f09e2ffd640 1 -- 172.21.15.79:0/101238664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b57250a30 msgr2=0x563b5725a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:47.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.205+0000 7f09e2ffd640 1 --2- 172.21.15.79:0/101238664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b57250a30 0x563b5725a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:47.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.205+0000 7f09e2ffd640 1 -- 172.21.15.79:0/101238664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b572616f0 msgr2=0x563b5724cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:47.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.205+0000 7f09e2ffd640 1 --2- 172.21.15.79:0/101238664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b572616f0 0x563b5724cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:47.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.205+0000 7f09e2ffd640 1 -- 172.21.15.79:0/101238664 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b57248b10 con 0x563b57251350 2024-08-20T01:41:47.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.205+0000 7f09e2ffd640 1 --2- 172.21.15.79:0/101238664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b57251350 0x563b57258200 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f09d80aa460 tx=0x7f09d8005bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a6d09bacf809259 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:47.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.205+0000 7f09c97fa640 1 -- 172.21.15.79:0/101238664 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d8020070 con 0x563b57251350 2024-08-20T01:41:47.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.205+0000 7f09c97fa640 1 -- 172.21.15.79:0/101238664 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f09d80aae60 con 0x563b57251350 2024-08-20T01:41:47.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.205+0000 7f09c97fa640 1 -- 172.21.15.79:0/101238664 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d80cd0f0 con 0x563b57251350 2024-08-20T01:41:47.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.206+0000 7f09ec5f8740 1 -- 172.21.15.79:0/101238664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b57251350 msgr2=0x563b57258200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:47.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.206+0000 7f09ec5f8740 1 --2- 172.21.15.79:0/101238664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b57251350 0x563b57258200 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f09d80aa460 tx=0x7f09d8005bb0 comp rx=0 tx=0).stop 2024-08-20T01:41:47.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.206+0000 7f09ec5f8740 1 -- 172.21.15.79:0/101238664 shutdown_connections 2024-08-20T01:41:47.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.206+0000 7f09ec5f8740 1 --2- 172.21.15.79:0/101238664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b572616f0 0x563b5724cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:47.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.206+0000 7f09ec5f8740 1 --2- 172.21.15.79:0/101238664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b57251350 0x563b57258200 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:47.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.206+0000 7f09ec5f8740 1 --2- 172.21.15.79:0/101238664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b57250a30 0x563b5725a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:47.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.206+0000 7f09ec5f8740 1 -- 172.21.15.79:0/101238664 >> 172.21.15.79:0/101238664 conn(0x563b5724e860 msgr2=0x563b5725c600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:47.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.206+0000 7f09ec5f8740 1 -- 172.21.15.79:0/101238664 shutdown_connections 2024-08-20T01:41:47.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.206+0000 7f09ec5f8740 1 -- 172.21.15.79:0/101238664 wait complete. 2024-08-20T01:41:47.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.207+0000 7f09ec5f8740 1 -- start start 2024-08-20T01:41:47.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.207+0000 7f09ec5f8740 1 Processor -- start 2024-08-20T01:41:47.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.207+0000 7f09ec5f8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b57250a30 0x563b572696d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:47.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.207+0000 7f09ec5f8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b57251350 0x563b57269c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:47.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.207+0000 7f09ec5f8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b572616f0 0x563b572524f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:47.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.207+0000 7f09ec5f8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f09e41ace90 con 0x563b572616f0 2024-08-20T01:41:47.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.207+0000 7f09ec5f8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f09e41ac7c0 con 0x563b57250a30 2024-08-20T01:41:47.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.207+0000 7f09ec5f8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f09e41a9a20 con 0x563b57251350 2024-08-20T01:41:47.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.207+0000 7f09ec5f8740 10 client.0 _ll_register_callbacks cb 0x7f09d800df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:47.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.207+0000 7f09e37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b57250a30 0x563b572696d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:47.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.207+0000 7f09e3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b572616f0 0x563b572524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:47.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.207+0000 7f09e37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b57250a30 0x563b572696d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:50238/0 (socket says 172.21.15.79:50238) 2024-08-20T01:41:47.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.207+0000 7f09e37fe640 1 -- 172.21.15.79:0/3381662669 learned_addr learned my addr 172.21.15.79:0/3381662669 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:47.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.207+0000 7f09e2ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b57251350 0x563b57269c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:47.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.208+0000 7f09e37fe640 1 -- 172.21.15.79:0/3381662669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b57251350 msgr2=0x563b57269c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:47.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.208+0000 7f09e37fe640 1 --2- 172.21.15.79:0/3381662669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b57251350 0x563b57269c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:47.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.208+0000 7f09e37fe640 1 -- 172.21.15.79:0/3381662669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b572616f0 msgr2=0x563b572524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:47.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.208+0000 7f09e37fe640 1 --2- 172.21.15.79:0/3381662669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b572616f0 0x563b572524f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:47.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.208+0000 7f09e37fe640 1 -- 172.21.15.79:0/3381662669 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b57252d20 con 0x563b57250a30 2024-08-20T01:41:47.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.208+0000 7f09e37fe640 1 --2- 172.21.15.79:0/3381662669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b57250a30 0x563b572696d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f09d4005e70 tx=0x7f09d40054d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37abf80597a13e7e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:47.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.208+0000 7f09c2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:41:47.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.211+0000 7f09c2ffd640 1 -- 172.21.15.79:0/3381662669 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d4029040 con 0x563b57250a30 2024-08-20T01:41:47.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.211+0000 7f09ec5f8740 1 -- 172.21.15.79:0/3381662669 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09d80aae60 con 0x563b57250a30 2024-08-20T01:41:47.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.211+0000 7f09c2ffd640 1 -- 172.21.15.79:0/3381662669 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f09d401e040 con 0x563b57250a30 2024-08-20T01:41:47.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.215+0000 7f09c2ffd640 1 -- 172.21.15.79:0/3381662669 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f09d40056c0 con 0x563b57250a30 2024-08-20T01:41:47.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.216+0000 7f09ec5f8740 10 client.26081 fetch_fsmap learned FSMap version 38 2024-08-20T01:41:47.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.216+0000 7f09ec5f8740 1 -- 172.21.15.79:0/3381662669 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x563b572d7aa0 con 0x563b57250a30 2024-08-20T01:41:47.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.216+0000 7f09c2ffd640 1 -- 172.21.15.79:0/3381662669 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f09d80aae60 con 0x563b57250a30 2024-08-20T01:41:47.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.216+0000 7f09c2ffd640 1 -- 172.21.15.79:0/3381662669 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f09d402d420 con 0x563b57250a30 2024-08-20T01:41:47.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.216+0000 7f09ec5f8740 10 client.26081 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:41:47.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.216+0000 7f09ec5f8740 10 client.26081 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:41:47.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.216+0000 7f09ec5f8740 20 client.26081 populate_metadata read hostname 'smithi079' 2024-08-20T01:41:47.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.216+0000 7f09ec5f8740 1 --2- 172.21.15.79:0/3381662669 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x563b572d81c0 0x563b572da5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:47.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.216+0000 7f09ec5f8740 4 client.26081 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:41:47.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.216+0000 7f09ec5f8740 1 -- 172.21.15.79:0/3381662669 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563b571c5320 con 0x563b572d81c0 2024-08-20T01:41:47.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.216+0000 7f09e2ffd640 1 --2- 172.21.15.79:0/3381662669 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x563b572d81c0 0x563b572da5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:47.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.217+0000 7f09c2ffd640 10 client.26081 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:41:47.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.217+0000 7f09e2ffd640 1 --2- 172.21.15.79:0/3381662669 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x563b572d81c0 0x563b572da5b0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e8ac38ed62edbdf4 server_cookie=901ccb48645d491 in_seq=0 out_seq=0 2024-08-20T01:41:47.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.217+0000 7f09c2ffd640 1 -- 172.21.15.79:0/3381662669 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563b571c5320 con 0x563b572d81c0 2024-08-20T01:41:47.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.217+0000 7f09c2ffd640 10 client.26081 handle_command_reply: tid=0 2024-08-20T01:41:47.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.217+0000 7f09ec5f8740 1 client.26081 shutdown 2024-08-20T01:41:47.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.217+0000 7f09ec5f8740 1 -- 172.21.15.79:0/3381662669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b57250a30 msgr2=0x563b572696d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:47.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.217+0000 7f09ec5f8740 1 --2- 172.21.15.79:0/3381662669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b57250a30 0x563b572696d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f09d4005e70 tx=0x7f09d40054d0 comp rx=0 tx=0).stop 2024-08-20T01:41:47.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.217+0000 7f09ec5f8740 1 -- 172.21.15.79:0/3381662669 shutdown_connections 2024-08-20T01:41:47.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.217+0000 7f09ec5f8740 1 --2- 172.21.15.79:0/3381662669 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x563b572d81c0 0x563b572da5b0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:47.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.217+0000 7f09ec5f8740 1 --2- 172.21.15.79:0/3381662669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b572616f0 0x563b572524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:47.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.217+0000 7f09ec5f8740 1 --2- 172.21.15.79:0/3381662669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b57251350 0x563b57269c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:47.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.217+0000 7f09ec5f8740 1 --2- 172.21.15.79:0/3381662669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563b57250a30 0x563b572696d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:47.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.217+0000 7f09c2ffd640 0 client.26081 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:41:47.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.218+0000 7f09ec5f8740 1 -- 172.21.15.79:0/3381662669 >> 172.21.15.79:0/3381662669 conn(0x563b5724e860 msgr2=0x563b5725a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:47.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.218+0000 7f09ec5f8740 1 -- 172.21.15.79:0/3381662669 shutdown_connections 2024-08-20T01:41:47.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.218+0000 7f09ec5f8740 1 -- 172.21.15.79:0/3381662669 wait complete. 2024-08-20T01:41:47.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.218+0000 7f09ec5f8740 20 client.26081 trim_cache size 0 max 16384 2024-08-20T01:41:47.222 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:41:47.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.218+0000 7f09e8f9d640 1 -- 172.21.15.79:0/3589551361 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f09cc0b3c70 msgr2=0x7f09cc0b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:47.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.218+0000 7f09e8f9d640 1 --2- 172.21.15.79:0/3589551361 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f09cc0b3c70 0x7f09cc0b6130 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f09dc04d000 tx=0x7f09dc04b000 comp rx=0 tx=0).stop 2024-08-20T01:41:47.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.218+0000 7f09e8f9d640 1 -- 172.21.15.79:0/3589551361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09e4108330 msgr2=0x7f09e4199140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:47.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.218+0000 7f09e8f9d640 1 --2- 172.21.15.79:0/3589551361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09e4108330 0x7f09e4199140 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f09d800d950 tx=0x7f09d800de10 comp rx=0 tx=0).stop 2024-08-20T01:41:47.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.219+0000 7f09e8f9d640 1 -- 172.21.15.79:0/3589551361 shutdown_connections 2024-08-20T01:41:47.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.219+0000 7f09e8f9d640 1 --2- 172.21.15.79:0/3589551361 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f09cc0b3c70 0x7f09cc0b6130 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:47.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.219+0000 7f09e8f9d640 1 --2- 172.21.15.79:0/3589551361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09e4108cb0 0x7f09e419e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:47.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.219+0000 7f09e8f9d640 1 --2- 172.21.15.79:0/3589551361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09e4108330 0x7f09e4199140 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:47.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.219+0000 7f09e8f9d640 1 --2- 172.21.15.79:0/3589551361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09e4102920 0x7f09e4198c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:47.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.219+0000 7f09e8f9d640 1 -- 172.21.15.79:0/3589551361 >> 172.21.15.79:0/3589551361 conn(0x7f09e40fe350 msgr2=0x7f09e4100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:47.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.219+0000 7f09e8f9d640 1 -- 172.21.15.79:0/3589551361 shutdown_connections 2024-08-20T01:41:47.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:47.219+0000 7f09e8f9d640 1 -- 172.21.15.79:0/3589551361 wait complete. 2024-08-20T01:41:47.954 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T01:41:48.040 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.037+0000 7fc4351a1640 1 -- 172.21.15.79:0/888972125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4301015a0 msgr2=0x7fc4301019a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:48.040 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.037+0000 7fc4351a1640 1 --2- 172.21.15.79:0/888972125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4301015a0 0x7fc4301019a0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fc420009930 tx=0x7fc42002a420 comp rx=0 tx=0).stop 2024-08-20T01:41:48.040 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.037+0000 7fc4351a1640 1 -- 172.21.15.79:0/888972125 shutdown_connections 2024-08-20T01:41:48.040 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.037+0000 7fc4351a1640 1 --2- 172.21.15.79:0/888972125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4301030b0 0x7fc430109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.040 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.037+0000 7fc4351a1640 1 --2- 172.21.15.79:0/888972125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4301026f0 0x7fc430102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.040 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.037+0000 7fc4351a1640 1 --2- 172.21.15.79:0/888972125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4301015a0 0x7fc4301019a0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.040 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.037+0000 7fc4351a1640 1 -- 172.21.15.79:0/888972125 >> 172.21.15.79:0/888972125 conn(0x7fc4300fce40 msgr2=0x7fc4300ff280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:48.040 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.037+0000 7fc4351a1640 1 -- 172.21.15.79:0/888972125 shutdown_connections 2024-08-20T01:41:48.040 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.037+0000 7fc4351a1640 1 -- 172.21.15.79:0/888972125 wait complete. 2024-08-20T01:41:48.040 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.038+0000 7fc4351a1640 1 Processor -- start 2024-08-20T01:41:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.038+0000 7fc4351a1640 1 -- start start 2024-08-20T01:41:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.038+0000 7fc4351a1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4301015a0 0x7fc430198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.038+0000 7fc4351a1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4301026f0 0x7fc4301990a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.038+0000 7fc4351a1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4301030b0 0x7fc430199cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.038+0000 7fc4351a1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc43010d0d0 con 0x7fc4301030b0 2024-08-20T01:41:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.038+0000 7fc4351a1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc43010cf50 con 0x7fc4301026f0 2024-08-20T01:41:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.038+0000 7fc4351a1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc43010d250 con 0x7fc4301015a0 2024-08-20T01:41:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.038+0000 7fc42f59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4301030b0 0x7fc430199cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.038+0000 7fc42ed9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4301015a0 0x7fc430198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.038+0000 7fc42ed9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4301015a0 0x7fc430198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:59928/0 (socket says 172.21.15.79:59928) 2024-08-20T01:41:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.038+0000 7fc42ed9d640 1 -- 172.21.15.79:0/2957031579 learned_addr learned my addr 172.21.15.79:0/2957031579 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.038+0000 7fc42f59e640 1 --2- 172.21.15.79:0/2957031579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4301030b0 0x7fc430199cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40574/0 (socket says 172.21.15.79:40574) 2024-08-20T01:41:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.038+0000 7fc42e59c640 1 --2- 172.21.15.79:0/2957031579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4301026f0 0x7fc4301990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.039+0000 7fc42ed9d640 1 -- 172.21.15.79:0/2957031579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4301026f0 msgr2=0x7fc4301990a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.039+0000 7fc42ed9d640 1 --2- 172.21.15.79:0/2957031579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4301026f0 0x7fc4301990a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.039+0000 7fc42ed9d640 1 -- 172.21.15.79:0/2957031579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4301030b0 msgr2=0x7fc430199cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.039+0000 7fc42ed9d640 1 --2- 172.21.15.79:0/2957031579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4301030b0 0x7fc430199cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.039+0000 7fc42ed9d640 1 -- 172.21.15.79:0/2957031579 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc43019a590 con 0x7fc4301015a0 2024-08-20T01:41:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.039+0000 7fc42e59c640 1 --2- 172.21.15.79:0/2957031579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4301026f0 0x7fc4301990a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:41:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.039+0000 7fc42f59e640 1 --2- 172.21.15.79:0/2957031579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4301030b0 0x7fc430199cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:41:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.039+0000 7fc42ed9d640 1 --2- 172.21.15.79:0/2957031579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4301015a0 0x7fc430198a50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc420005ab0 tx=0x7fc4200042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.039+0000 7fc417fff640 1 -- 172.21.15.79:0/2957031579 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42003f030 con 0x7fc4301015a0 2024-08-20T01:41:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.039+0000 7fc4351a1640 1 -- 172.21.15.79:0/2957031579 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc43019a820 con 0x7fc4301015a0 2024-08-20T01:41:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.039+0000 7fc417fff640 1 -- 172.21.15.79:0/2957031579 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc420003c90 con 0x7fc4301015a0 2024-08-20T01:41:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.039+0000 7fc417fff640 1 -- 172.21.15.79:0/2957031579 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc420035070 con 0x7fc4301015a0 2024-08-20T01:41:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.040+0000 7fc4351a1640 1 -- 172.21.15.79:0/2957031579 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4301a0f50 con 0x7fc4301015a0 2024-08-20T01:41:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.042+0000 7fc43806d740 1 Processor -- start 2024-08-20T01:41:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.042+0000 7fc43806d740 1 -- start start 2024-08-20T01:41:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.042+0000 7fc417fff640 1 -- 172.21.15.79:0/2957031579 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc420042030 con 0x7fc4301015a0 2024-08-20T01:41:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.043+0000 7fc43806d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558454be38d0 0x558454be5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.043+0000 7fc43806d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558454be6200 0x558454be85f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.043+0000 7fc43806d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558454be8c40 0x558454beb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.043+0000 7fc43806d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558454b56360 con 0x558454be8c40 2024-08-20T01:41:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.043+0000 7fc43806d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558454b45860 con 0x558454be6200 2024-08-20T01:41:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.043+0000 7fc43806d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558454b498a0 con 0x558454be38d0 2024-08-20T01:41:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.043+0000 7fc42f59e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558454be38d0 0x558454be5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.043+0000 7fc42e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558454be8c40 0x558454beb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.043+0000 7fc42e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558454be8c40 0x558454beb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40590/0 (socket says 172.21.15.79:40590) 2024-08-20T01:41:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.043+0000 7fc42e59c640 1 -- 172.21.15.79:0/1247807911 learned_addr learned my addr 172.21.15.79:0/1247807911 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.043+0000 7fc42ed9d640 1 --2- 172.21.15.79:0/1247807911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558454be6200 0x558454be85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.043+0000 7fc42e59c640 1 -- 172.21.15.79:0/1247807911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558454be38d0 msgr2=0x558454be5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.043+0000 7fc42e59c640 1 --2- 172.21.15.79:0/1247807911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558454be38d0 0x558454be5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.043+0000 7fc42e59c640 1 -- 172.21.15.79:0/1247807911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558454be6200 msgr2=0x558454be85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.043+0000 7fc42e59c640 1 --2- 172.21.15.79:0/1247807911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558454be6200 0x558454be85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.043+0000 7fc42e59c640 1 -- 172.21.15.79:0/1247807911 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558454aece40 con 0x558454be8c40 2024-08-20T01:41:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.043+0000 7fc417fff640 1 --2- 172.21.15.79:0/2957031579 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc4180b3bd0 0x7fc4180b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.043+0000 7fc42e59c640 1 --2- 172.21.15.79:0/1247807911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558454be8c40 0x558454beb100 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fc4240104d0 tx=0x7fc424010990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88fec4f97872f4b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:48.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.044+0000 7fc42f59e640 1 --2- 172.21.15.79:0/2957031579 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc4180b3bd0 0x7fc4180b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:48.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.044+0000 7fc417fff640 1 -- 172.21.15.79:0/2957031579 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc4201044a0 con 0x7fc4301015a0 2024-08-20T01:41:48.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.044+0000 7fc4157fa640 1 -- 172.21.15.79:0/1247807911 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc424011760 con 0x558454be8c40 2024-08-20T01:41:48.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.044+0000 7fc4157fa640 1 -- 172.21.15.79:0/1247807911 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc424011d90 con 0x558454be8c40 2024-08-20T01:41:48.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.044+0000 7fc4157fa640 1 -- 172.21.15.79:0/1247807911 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42401cd80 con 0x558454be8c40 2024-08-20T01:41:48.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.045+0000 7fc42f59e640 1 --2- 172.21.15.79:0/2957031579 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc4180b3bd0 0x7fc4180b6090 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc4301997d0 tx=0x7fc428009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:48.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.045+0000 7fc43806d740 1 -- 172.21.15.79:0/1247807911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558454be8c40 msgr2=0x558454beb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:48.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.045+0000 7fc43806d740 1 --2- 172.21.15.79:0/1247807911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558454be8c40 0x558454beb100 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fc4240104d0 tx=0x7fc424010990 comp rx=0 tx=0).stop 2024-08-20T01:41:48.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.045+0000 7fc43806d740 1 -- 172.21.15.79:0/1247807911 shutdown_connections 2024-08-20T01:41:48.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.045+0000 7fc43806d740 1 --2- 172.21.15.79:0/1247807911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558454be8c40 0x558454beb100 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.045+0000 7fc43806d740 1 --2- 172.21.15.79:0/1247807911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558454be6200 0x558454be85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.045+0000 7fc43806d740 1 --2- 172.21.15.79:0/1247807911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558454be38d0 0x558454be5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.045+0000 7fc43806d740 1 -- 172.21.15.79:0/1247807911 >> 172.21.15.79:0/1247807911 conn(0x558454bdea20 msgr2=0x558454bdf7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.045+0000 7fc43806d740 1 -- 172.21.15.79:0/1247807911 shutdown_connections 2024-08-20T01:41:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.045+0000 7fc43806d740 1 -- 172.21.15.79:0/1247807911 wait complete. 2024-08-20T01:41:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.045+0000 7fc43806d740 1 -- start start 2024-08-20T01:41:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.045+0000 7fc43806d740 1 Processor -- start 2024-08-20T01:41:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.046+0000 7fc43806d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558454be38d0 0x558454bed100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.046+0000 7fc43806d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558454be6200 0x558454bed7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.046+0000 7fc43806d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558454be8c40 0x558454bee370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.046+0000 7fc43806d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558454a7eab0 con 0x558454be38d0 2024-08-20T01:41:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.046+0000 7fc43806d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558454acc780 con 0x558454be8c40 2024-08-20T01:41:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.046+0000 7fc43806d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558454bebc20 con 0x558454be6200 2024-08-20T01:41:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.046+0000 7fc43806d740 10 client.0 _ll_register_callbacks cb 0x558454854a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.046+0000 7fc42ed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558454be38d0 0x558454bed100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.046+0000 7fc42ed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558454be38d0 0x558454bed100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40592/0 (socket says 172.21.15.79:40592) 2024-08-20T01:41:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.046+0000 7fc42ed9d640 1 -- 172.21.15.79:0/2399717855 learned_addr learned my addr 172.21.15.79:0/2399717855 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.046+0000 7fc42f59e640 1 --2- 172.21.15.79:0/2399717855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558454be8c40 0x558454bee370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.046+0000 7fc42e59c640 1 --2- 172.21.15.79:0/2399717855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558454be6200 0x558454bed7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.046+0000 7fc42ed9d640 1 -- 172.21.15.79:0/2399717855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558454be6200 msgr2=0x558454bed7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.046+0000 7fc42ed9d640 1 --2- 172.21.15.79:0/2399717855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558454be6200 0x558454bed7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.046+0000 7fc42ed9d640 1 -- 172.21.15.79:0/2399717855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558454be8c40 msgr2=0x558454bee370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.046+0000 7fc42ed9d640 1 --2- 172.21.15.79:0/2399717855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558454be8c40 0x558454bee370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.046+0000 7fc42ed9d640 1 -- 172.21.15.79:0/2399717855 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584548a8790 con 0x558454be38d0 2024-08-20T01:41:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.046+0000 7fc42ed9d640 1 --2- 172.21.15.79:0/2399717855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558454be38d0 0x558454bed100 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fc420004650 tx=0x7fc4200058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42bf8df75105b976 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.047+0000 7fc412ff5640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:41:48.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.047+0000 7fc412ff5640 1 -- 172.21.15.79:0/2399717855 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc420049040 con 0x558454be38d0 2024-08-20T01:41:48.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.047+0000 7fc412ff5640 1 -- 172.21.15.79:0/2399717855 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc4200c7740 con 0x558454be38d0 2024-08-20T01:41:48.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.047+0000 7fc43806d740 1 -- 172.21.15.79:0/2399717855 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558454af4e00 con 0x558454be38d0 2024-08-20T01:41:48.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.047+0000 7fc412ff5640 1 -- 172.21.15.79:0/2399717855 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fc4200cb280 con 0x558454be38d0 2024-08-20T01:41:48.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.047+0000 7fc43806d740 10 client.16893 fetch_fsmap learned FSMap version 38 2024-08-20T01:41:48.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.047+0000 7fc43806d740 1 -- 172.21.15.79:0/2399717855 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x558454921620 con 0x558454be38d0 2024-08-20T01:41:48.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.047+0000 7fc412ff5640 1 -- 172.21.15.79:0/2399717855 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x558454af4e00 con 0x558454be38d0 2024-08-20T01:41:48.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.047+0000 7fc412ff5640 1 -- 172.21.15.79:0/2399717855 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7fc4201040d0 con 0x558454be38d0 2024-08-20T01:41:48.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.047+0000 7fc43806d740 10 client.16893 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:41:48.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.047+0000 7fc43806d740 10 client.16893 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:41:48.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.047+0000 7fc43806d740 20 client.16893 populate_metadata read hostname 'smithi079' 2024-08-20T01:41:48.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.047+0000 7fc43806d740 1 --2- 172.21.15.79:0/2399717855 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558454bf89d0 0x558454bfadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:48.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.047+0000 7fc43806d740 4 client.16893 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:41:48.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.047+0000 7fc43806d740 1 -- 172.21.15.79:0/2399717855 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558454b582b0 con 0x558454bf89d0 2024-08-20T01:41:48.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.048+0000 7fc42e59c640 1 --2- 172.21.15.79:0/2399717855 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558454bf89d0 0x558454bfadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:48.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.048+0000 7fc412ff5640 10 client.16893 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:41:48.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.048+0000 7fc42e59c640 1 --2- 172.21.15.79:0/2399717855 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558454bf89d0 0x558454bfadc0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=219a720ebf030975 server_cookie=a4b5c23f9ef35aff in_seq=0 out_seq=0 2024-08-20T01:41:48.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.049+0000 7fc412ff5640 1 -- 172.21.15.79:0/2399717855 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558454b582b0 con 0x558454bf89d0 2024-08-20T01:41:48.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.049+0000 7fc412ff5640 10 client.16893 handle_command_reply: tid=0 2024-08-20T01:41:48.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.049+0000 7fc43806d740 1 client.16893 shutdown 2024-08-20T01:41:48.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.049+0000 7fc43806d740 1 -- 172.21.15.79:0/2399717855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558454be38d0 msgr2=0x558454bed100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:48.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.049+0000 7fc43806d740 1 --2- 172.21.15.79:0/2399717855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558454be38d0 0x558454bed100 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fc420004650 tx=0x7fc4200058d0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.049+0000 7fc43806d740 1 -- 172.21.15.79:0/2399717855 shutdown_connections 2024-08-20T01:41:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.049+0000 7fc43806d740 1 --2- 172.21.15.79:0/2399717855 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558454bf89d0 0x558454bfadc0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.049+0000 7fc43806d740 1 --2- 172.21.15.79:0/2399717855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558454be8c40 0x558454bee370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.049+0000 7fc43806d740 1 --2- 172.21.15.79:0/2399717855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558454be6200 0x558454bed7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.049+0000 7fc43806d740 1 --2- 172.21.15.79:0/2399717855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558454be38d0 0x558454bed100 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.049+0000 7fc43806d740 1 -- 172.21.15.79:0/2399717855 >> 172.21.15.79:0/2399717855 conn(0x558454bdea20 msgr2=0x558454bddae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.049+0000 7fc412ff5640 0 client.16893 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:41:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.049+0000 7fc43806d740 1 -- 172.21.15.79:0/2399717855 shutdown_connections 2024-08-20T01:41:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.049+0000 7fc43806d740 1 -- 172.21.15.79:0/2399717855 wait complete. 2024-08-20T01:41:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.049+0000 7fc43806d740 20 client.16893 trim_cache size 0 max 16384 2024-08-20T01:41:48.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.066+0000 7fc43806d740 1 Processor -- start 2024-08-20T01:41:48.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.066+0000 7fc43806d740 1 -- start start 2024-08-20T01:41:48.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.066+0000 7fc43806d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558454be38d0 0x558454be2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:48.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.066+0000 7fc43806d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558454be6200 0x558454be9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:48.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.066+0000 7fc43806d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558454be8c40 0x558454be9560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:48.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.066+0000 7fc43806d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc4301a9ad0 con 0x558454be38d0 2024-08-20T01:41:48.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.066+0000 7fc43806d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc4301ab610 con 0x558454be8c40 2024-08-20T01:41:48.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.066+0000 7fc43806d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc4301aa1a0 con 0x558454be6200 2024-08-20T01:41:48.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.066+0000 7fc42ed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558454be38d0 0x558454be2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:48.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.066+0000 7fc42ed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558454be38d0 0x558454be2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40608/0 (socket says 172.21.15.79:40608) 2024-08-20T01:41:48.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.066+0000 7fc42ed9d640 1 -- 172.21.15.79:0/962922675 learned_addr learned my addr 172.21.15.79:0/962922675 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:48.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.066+0000 7fc42f59e640 1 --2- 172.21.15.79:0/962922675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558454be8c40 0x558454be9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:48.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.066+0000 7fc42e59c640 1 --2- 172.21.15.79:0/962922675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558454be6200 0x558454be9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:48.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.066+0000 7fc42ed9d640 1 -- 172.21.15.79:0/962922675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558454be6200 msgr2=0x558454be9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:48.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.066+0000 7fc42ed9d640 1 --2- 172.21.15.79:0/962922675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558454be6200 0x558454be9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.066+0000 7fc42ed9d640 1 -- 172.21.15.79:0/962922675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558454be8c40 msgr2=0x558454be9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:48.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.066+0000 7fc42ed9d640 1 --2- 172.21.15.79:0/962922675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558454be8c40 0x558454be9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.066+0000 7fc42ed9d640 1 -- 172.21.15.79:0/962922675 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558454bee6e0 con 0x558454be38d0 2024-08-20T01:41:48.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.067+0000 7fc42ed9d640 1 --2- 172.21.15.79:0/962922675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558454be38d0 0x558454be2e90 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fc420107d20 tx=0x7fc4200cfb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23006ea6d6bfd6d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:48.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.067+0000 7fc414ff9640 1 -- 172.21.15.79:0/962922675 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc420049030 con 0x558454be38d0 2024-08-20T01:41:48.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.067+0000 7fc414ff9640 1 -- 172.21.15.79:0/962922675 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc4200e9020 con 0x558454be38d0 2024-08-20T01:41:48.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.067+0000 7fc414ff9640 1 -- 172.21.15.79:0/962922675 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc420032e60 con 0x558454be38d0 2024-08-20T01:41:48.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.068+0000 7fc43806d740 1 -- 172.21.15.79:0/962922675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558454be38d0 msgr2=0x558454be2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:48.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.068+0000 7fc43806d740 1 --2- 172.21.15.79:0/962922675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558454be38d0 0x558454be2e90 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fc420107d20 tx=0x7fc4200cfb20 comp rx=0 tx=0).stop 2024-08-20T01:41:48.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.068+0000 7fc43806d740 1 -- 172.21.15.79:0/962922675 shutdown_connections 2024-08-20T01:41:48.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.068+0000 7fc43806d740 1 --2- 172.21.15.79:0/962922675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558454be8c40 0x558454be9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.068+0000 7fc43806d740 1 --2- 172.21.15.79:0/962922675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558454be6200 0x558454be9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.068+0000 7fc43806d740 1 --2- 172.21.15.79:0/962922675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558454be38d0 0x558454be2e90 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.068+0000 7fc43806d740 1 -- 172.21.15.79:0/962922675 >> 172.21.15.79:0/962922675 conn(0x558454bdea20 msgr2=0x558454bea620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:48.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.068+0000 7fc43806d740 1 -- 172.21.15.79:0/962922675 shutdown_connections 2024-08-20T01:41:48.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.068+0000 7fc43806d740 1 -- 172.21.15.79:0/962922675 wait complete. 2024-08-20T01:41:48.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.068+0000 7fc43806d740 1 -- start start 2024-08-20T01:41:48.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.068+0000 7fc43806d740 1 Processor -- start 2024-08-20T01:41:48.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.069+0000 7fc43806d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558454be38d0 0x558454bf1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:48.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.069+0000 7fc43806d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558454be6200 0x558454bf2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:48.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.069+0000 7fc43806d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558454be8c40 0x558454bf2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:48.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.069+0000 7fc43806d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc4301aaf40 con 0x558454be8c40 2024-08-20T01:41:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.069+0000 7fc43806d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc4301aa870 con 0x558454be38d0 2024-08-20T01:41:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.069+0000 7fc43806d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc4301a7ab0 con 0x558454be6200 2024-08-20T01:41:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.069+0000 7fc43806d740 10 client.0 _ll_register_callbacks cb 0x7fc420107c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.069+0000 7fc42f59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558454be8c40 0x558454bf2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.069+0000 7fc42f59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558454be8c40 0x558454bf2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40618/0 (socket says 172.21.15.79:40618) 2024-08-20T01:41:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.069+0000 7fc42f59e640 1 -- 172.21.15.79:0/1628218752 learned_addr learned my addr 172.21.15.79:0/1628218752 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.069+0000 7fc42e59c640 1 --2- 172.21.15.79:0/1628218752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558454be6200 0x558454bf2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.069+0000 7fc42ed9d640 1 --2- 172.21.15.79:0/1628218752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558454be38d0 0x558454bf1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.069+0000 7fc42f59e640 1 -- 172.21.15.79:0/1628218752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558454be6200 msgr2=0x558454bf2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.069+0000 7fc42f59e640 1 --2- 172.21.15.79:0/1628218752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558454be6200 0x558454bf2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.069+0000 7fc42f59e640 1 -- 172.21.15.79:0/1628218752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558454be38d0 msgr2=0x558454bf1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.069+0000 7fc42f59e640 1 --2- 172.21.15.79:0/1628218752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558454be38d0 0x558454bf1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.077 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.069+0000 7fc42f59e640 1 -- 172.21.15.79:0/1628218752 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558454bf3540 con 0x558454be8c40 2024-08-20T01:41:48.077 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.070+0000 7fc42f59e640 1 --2- 172.21.15.79:0/1628218752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558454be8c40 0x558454bf2d10 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fc4280098b0 tx=0x7fc428004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bad18af83ab22227 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:48.077 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.070+0000 7fc412ff5640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:41:48.077 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.070+0000 7fc412ff5640 1 -- 172.21.15.79:0/1628218752 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42801c7f0 con 0x558454be8c40 2024-08-20T01:41:48.077 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.070+0000 7fc412ff5640 1 -- 172.21.15.79:0/1628218752 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc42801c990 con 0x558454be8c40 2024-08-20T01:41:48.077 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.070+0000 7fc43806d740 1 -- 172.21.15.79:0/1628218752 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4200e9020 con 0x558454be8c40 2024-08-20T01:41:48.077 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.070+0000 7fc412ff5640 1 -- 172.21.15.79:0/1628218752 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fc42801cb90 con 0x558454be8c40 2024-08-20T01:41:48.077 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.070+0000 7fc43806d740 10 client.16899 fetch_fsmap learned FSMap version 38 2024-08-20T01:41:48.077 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.070+0000 7fc43806d740 1 -- 172.21.15.79:0/1628218752 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x558454bf49b0 con 0x558454be8c40 2024-08-20T01:41:48.077 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.070+0000 7fc412ff5640 1 -- 172.21.15.79:0/1628218752 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc4200e9020 con 0x558454be8c40 2024-08-20T01:41:48.077 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.070+0000 7fc412ff5640 1 -- 172.21.15.79:0/1628218752 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7fc42801a040 con 0x558454be8c40 2024-08-20T01:41:48.077 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.070+0000 7fc43806d740 10 client.16899 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:41:48.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.070+0000 7fc43806d740 10 client.16899 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:41:48.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.070+0000 7fc43806d740 20 client.16899 populate_metadata read hostname 'smithi079' 2024-08-20T01:41:48.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.070+0000 7fc43806d740 1 --2- 172.21.15.79:0/1628218752 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558454c63650 0x558454c65a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:48.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.070+0000 7fc43806d740 4 client.16899 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:41:48.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.070+0000 7fc43806d740 1 -- 172.21.15.79:0/1628218752 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558454b53d50 con 0x558454c63650 2024-08-20T01:41:48.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.071+0000 7fc42ed9d640 1 --2- 172.21.15.79:0/1628218752 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558454c63650 0x558454c65a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:48.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.071+0000 7fc412ff5640 10 client.16899 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:41:48.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.071+0000 7fc42ed9d640 1 --2- 172.21.15.79:0/1628218752 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558454c63650 0x558454c65a40 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68280de61ab26991 server_cookie=e74c312b5932f6d1 in_seq=0 out_seq=0 2024-08-20T01:41:48.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.078+0000 7fc412ff5640 1 -- 172.21.15.79:0/1628218752 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558454b53d50 con 0x558454c63650 2024-08-20T01:41:48.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.078+0000 7fc412ff5640 10 client.16899 handle_command_reply: tid=0 2024-08-20T01:41:48.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.078+0000 7fc43806d740 1 client.16899 shutdown 2024-08-20T01:41:48.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.078+0000 7fc43806d740 1 -- 172.21.15.79:0/1628218752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558454be8c40 msgr2=0x558454bf2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:48.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.078+0000 7fc43806d740 1 --2- 172.21.15.79:0/1628218752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558454be8c40 0x558454bf2d10 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fc4280098b0 tx=0x7fc428004a40 comp rx=0 tx=0).stop 2024-08-20T01:41:48.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.078+0000 7fc43806d740 1 -- 172.21.15.79:0/1628218752 shutdown_connections 2024-08-20T01:41:48.081 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.078+0000 7fc43806d740 1 --2- 172.21.15.79:0/1628218752 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558454c63650 0x558454c65a40 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.078+0000 7fc43806d740 1 --2- 172.21.15.79:0/1628218752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558454be8c40 0x558454bf2d10 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.078+0000 7fc43806d740 1 --2- 172.21.15.79:0/1628218752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558454be6200 0x558454bf2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.078+0000 7fc43806d740 1 --2- 172.21.15.79:0/1628218752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558454be38d0 0x558454bf1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.078+0000 7fc412ff5640 0 client.16899 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:41:48.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.078+0000 7fc43806d740 1 -- 172.21.15.79:0/1628218752 >> 172.21.15.79:0/1628218752 conn(0x558454bdea20 msgr2=0x558454be2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:48.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.079+0000 7fc43806d740 1 -- 172.21.15.79:0/1628218752 shutdown_connections 2024-08-20T01:41:48.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.079+0000 7fc43806d740 1 -- 172.21.15.79:0/1628218752 wait complete. 2024-08-20T01:41:48.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.079+0000 7fc43806d740 20 client.16899 trim_cache size 0 max 16384 2024-08-20T01:41:48.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:41:48.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:41:48.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:41:48.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:41:48.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.079+0000 7fc4351a1640 1 -- 172.21.15.79:0/2957031579 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc4180b3bd0 msgr2=0x7fc4180b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:48.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.079+0000 7fc4351a1640 1 --2- 172.21.15.79:0/2957031579 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc4180b3bd0 0x7fc4180b6090 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc4301997d0 tx=0x7fc428009600 comp rx=0 tx=0).stop 2024-08-20T01:41:48.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.079+0000 7fc4351a1640 1 -- 172.21.15.79:0/2957031579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4301015a0 msgr2=0x7fc430198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:48.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.079+0000 7fc4351a1640 1 --2- 172.21.15.79:0/2957031579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4301015a0 0x7fc430198a50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc420005ab0 tx=0x7fc4200042f0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.079+0000 7fc4351a1640 1 -- 172.21.15.79:0/2957031579 shutdown_connections 2024-08-20T01:41:48.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.079+0000 7fc4351a1640 1 --2- 172.21.15.79:0/2957031579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4301030b0 0x7fc430199cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.079+0000 7fc4351a1640 1 --2- 172.21.15.79:0/2957031579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4301026f0 0x7fc4301990a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.079+0000 7fc4351a1640 1 --2- 172.21.15.79:0/2957031579 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc4180b3bd0 0x7fc4180b6090 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.079+0000 7fc4351a1640 1 --2- 172.21.15.79:0/2957031579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4301015a0 0x7fc430198a50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.080+0000 7fc4351a1640 1 -- 172.21.15.79:0/2957031579 >> 172.21.15.79:0/2957031579 conn(0x7fc4300fce40 msgr2=0x7fc4300fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:48.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.080+0000 7fc4351a1640 1 -- 172.21.15.79:0/2957031579 shutdown_connections 2024-08-20T01:41:48.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:41:48.080+0000 7fc4351a1640 1 -- 172.21.15.79:0/2957031579 wait complete. 2024-08-20T01:41:48.242 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:41:48.486 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:48 smithi079 ceph-mon[18656]: pgmap v481: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 28 MiB/s wr, 23 op/s 2024-08-20T01:41:48.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:48 smithi081 ceph-mon[22209]: pgmap v481: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 28 MiB/s wr, 23 op/s 2024-08-20T01:41:48.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:48 smithi175 ceph-mon[22392]: pgmap v481: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 28 MiB/s wr, 23 op/s 2024-08-20T01:41:48.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.745+0000 7f3e1216a640 1 -- 172.21.15.79:0/432634776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e0c10cdc0 msgr2=0x7f3e0c10f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:48.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.745+0000 7f3e1216a640 1 --2- 172.21.15.79:0/432634776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e0c10cdc0 0x7f3e0c10f260 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f3e04009ca0 tx=0x7f3e0402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.745+0000 7f3e1216a640 1 -- 172.21.15.79:0/432634776 shutdown_connections 2024-08-20T01:41:48.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.745+0000 7f3e1216a640 1 --2- 172.21.15.79:0/432634776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e0c10cdc0 0x7f3e0c10f260 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.745+0000 7f3e1216a640 1 --2- 172.21.15.79:0/432634776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e0c101f00 0x7f3e0c10c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.745+0000 7f3e1216a640 1 --2- 172.21.15.79:0/432634776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e0c101500 0x7f3e0c1018e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.745+0000 7f3e1216a640 1 -- 172.21.15.79:0/432634776 >> 172.21.15.79:0/432634776 conn(0x7f3e0c076bd0 msgr2=0x7f3e0c076fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:48.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.746+0000 7f3e1216a640 1 -- 172.21.15.79:0/432634776 shutdown_connections 2024-08-20T01:41:48.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.746+0000 7f3e1216a640 1 -- 172.21.15.79:0/432634776 wait complete. 2024-08-20T01:41:48.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.746+0000 7f3e1216a640 1 Processor -- start 2024-08-20T01:41:48.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.746+0000 7f3e1216a640 1 -- start start 2024-08-20T01:41:48.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.747+0000 7f3e1216a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e0c101500 0x7f3e0c198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:48.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.747+0000 7f3e1216a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e0c101f00 0x7f3e0c199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:48.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.747+0000 7f3e1216a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e0c10cdc0 0x7f3e0c19e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:48.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.747+0000 7f3e1216a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c1128d0 con 0x7f3e0c10cdc0 2024-08-20T01:41:48.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.747+0000 7f3e1216a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c112750 con 0x7f3e0c101f00 2024-08-20T01:41:48.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.747+0000 7f3e1216a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c112a50 con 0x7f3e0c101500 2024-08-20T01:41:48.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.747+0000 7f3e0bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e0c10cdc0 0x7f3e0c19e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:48.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.747+0000 7f3e0bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e0c10cdc0 0x7f3e0c19e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40640/0 (socket says 172.21.15.79:40640) 2024-08-20T01:41:48.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.747+0000 7f3e0bfff640 1 -- 172.21.15.79:0/1147248941 learned_addr learned my addr 172.21.15.79:0/1147248941 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:48.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.747+0000 7f3e0b7fe640 1 --2- 172.21.15.79:0/1147248941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e0c101500 0x7f3e0c198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:48.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.747+0000 7f3e0affd640 1 --2- 172.21.15.79:0/1147248941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e0c101f00 0x7f3e0c199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:48.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.747+0000 7f3e0bfff640 1 -- 172.21.15.79:0/1147248941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e0c101500 msgr2=0x7f3e0c198e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:48.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.747+0000 7f3e0bfff640 1 --2- 172.21.15.79:0/1147248941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e0c101500 0x7f3e0c198e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.747+0000 7f3e0bfff640 1 -- 172.21.15.79:0/1147248941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e0c101f00 msgr2=0x7f3e0c199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:48.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.747+0000 7f3e0bfff640 1 --2- 172.21.15.79:0/1147248941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e0c101f00 0x7f3e0c199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.747+0000 7f3e0bfff640 1 -- 172.21.15.79:0/1147248941 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e0c19eeb0 con 0x7f3e0c10cdc0 2024-08-20T01:41:48.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.747+0000 7f3e0bfff640 1 --2- 172.21.15.79:0/1147248941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e0c10cdc0 0x7f3e0c19e6e0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f3e04009dc0 tx=0x7f3e04003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:48.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.748+0000 7f3e08ff9640 1 -- 172.21.15.79:0/1147248941 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e04004040 con 0x7f3e0c10cdc0 2024-08-20T01:41:48.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.748+0000 7f3e08ff9640 1 -- 172.21.15.79:0/1147248941 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e04004670 con 0x7f3e0c10cdc0 2024-08-20T01:41:48.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.748+0000 7f3e08ff9640 1 -- 172.21.15.79:0/1147248941 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e04030d80 con 0x7f3e0c10cdc0 2024-08-20T01:41:48.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.748+0000 7f3e1216a640 1 -- 172.21.15.79:0/1147248941 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e0c19f140 con 0x7f3e0c10cdc0 2024-08-20T01:41:48.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.748+0000 7f3e1216a640 1 -- 172.21.15.79:0/1147248941 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e0c1a5860 con 0x7f3e0c10cdc0 2024-08-20T01:41:48.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.750+0000 7f3e14563740 1 Processor -- start 2024-08-20T01:41:48.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.751+0000 7f3e08ff9640 1 -- 172.21.15.79:0/1147248941 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3e040305c0 con 0x7f3e0c10cdc0 2024-08-20T01:41:48.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.751+0000 7f3e14563740 1 -- start start 2024-08-20T01:41:48.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.751+0000 7f3e14563740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561636d0f880 0x561636d0fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:48.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.751+0000 7f3e14563740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561636d101a0 0x561636d20000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:48.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.751+0000 7f3e14563740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561636d20540 0x561636d22930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:48.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.751+0000 7f3e14563740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561636c86930 con 0x561636d20540 2024-08-20T01:41:48.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.751+0000 7f3e14563740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561636c75e30 con 0x561636d0f880 2024-08-20T01:41:48.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.751+0000 7f3e14563740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561636c79e70 con 0x561636d101a0 2024-08-20T01:41:48.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.751+0000 7f3e0affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561636d0f880 0x561636d0fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:48.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.752+0000 7f3e0affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561636d0f880 0x561636d0fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:50306/0 (socket says 172.21.15.79:50306) 2024-08-20T01:41:48.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.752+0000 7f3e0affd640 1 -- 172.21.15.79:0/3791485396 learned_addr learned my addr 172.21.15.79:0/3791485396 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:48.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.752+0000 7f3e0b7fe640 1 --2- 172.21.15.79:0/3791485396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561636d101a0 0x561636d20000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:48.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.752+0000 7f3e0affd640 1 --2- 172.21.15.79:0/3791485396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561636d20540 0x561636d22930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:48.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.752+0000 7f3e08ff9640 1 --2- 172.21.15.79:0/1147248941 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3df40b3bd0 0x7f3df40b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:48.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.752+0000 7f3e0affd640 1 -- 172.21.15.79:0/3791485396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561636d101a0 msgr2=0x561636d20000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:48.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.752+0000 7f3e0affd640 1 --2- 172.21.15.79:0/3791485396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561636d101a0 0x561636d20000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.752+0000 7f3e0affd640 1 -- 172.21.15.79:0/3791485396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561636d20540 msgr2=0x561636d22930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:48.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.752+0000 7f3e0affd640 1 --2- 172.21.15.79:0/3791485396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561636d20540 0x561636d22930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.752+0000 7f3e0affd640 1 -- 172.21.15.79:0/3791485396 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616369d5650 con 0x561636d0f880 2024-08-20T01:41:48.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.752+0000 7f3e08ff9640 1 -- 172.21.15.79:0/1147248941 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f3e041054b0 con 0x7f3e0c10cdc0 2024-08-20T01:41:48.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.752+0000 7f3e0bfff640 1 --2- 172.21.15.79:0/1147248941 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3df40b3bd0 0x7f3df40b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:48.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.752+0000 7f3e0affd640 1 --2- 172.21.15.79:0/3791485396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561636d0f880 0x561636d0fc60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3e00012570 tx=0x7f3e0000e610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91fac1d883b0335d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:48.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.752+0000 7f3df1ffb640 1 -- 172.21.15.79:0/3791485396 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e00018070 con 0x561636d0f880 2024-08-20T01:41:48.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.753+0000 7f3df1ffb640 1 -- 172.21.15.79:0/3791485396 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e000054b0 con 0x561636d0f880 2024-08-20T01:41:48.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.753+0000 7f3df1ffb640 1 -- 172.21.15.79:0/3791485396 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e00004d50 con 0x561636d0f880 2024-08-20T01:41:48.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.753+0000 7f3e14563740 1 -- 172.21.15.79:0/3791485396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561636d0f880 msgr2=0x561636d0fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:48.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.753+0000 7f3e0bfff640 1 --2- 172.21.15.79:0/1147248941 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3df40b3bd0 0x7f3df40b6090 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f3e040c8490 tx=0x7f3e04005c30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:48.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.753+0000 7f3e14563740 1 --2- 172.21.15.79:0/3791485396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561636d0f880 0x561636d0fc60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3e00012570 tx=0x7f3e0000e610 comp rx=0 tx=0).stop 2024-08-20T01:41:48.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.753+0000 7f3e14563740 1 -- 172.21.15.79:0/3791485396 shutdown_connections 2024-08-20T01:41:48.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.753+0000 7f3e14563740 1 --2- 172.21.15.79:0/3791485396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561636d20540 0x561636d22930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.753+0000 7f3e14563740 1 --2- 172.21.15.79:0/3791485396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561636d101a0 0x561636d20000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.753+0000 7f3e14563740 1 --2- 172.21.15.79:0/3791485396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561636d0f880 0x561636d0fc60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.753+0000 7f3e14563740 1 -- 172.21.15.79:0/3791485396 >> 172.21.15.79:0/3791485396 conn(0x561636d0d6b0 msgr2=0x561636d0e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:48.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.753+0000 7f3e14563740 1 -- 172.21.15.79:0/3791485396 shutdown_connections 2024-08-20T01:41:48.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.754+0000 7f3e14563740 1 -- 172.21.15.79:0/3791485396 wait complete. 2024-08-20T01:41:48.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.754+0000 7f3e14563740 1 -- start start 2024-08-20T01:41:48.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.754+0000 7f3e14563740 1 Processor -- start 2024-08-20T01:41:48.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.754+0000 7f3e14563740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561636d0f880 0x561636d1d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:48.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.754+0000 7f3e14563740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561636d101a0 0x561636d1da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:48.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.755+0000 7f3e14563740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561636d20540 0x561636d1dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:48.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.755+0000 7f3e14563740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561636ad8700 con 0x561636d101a0 2024-08-20T01:41:48.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.755+0000 7f3e14563740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561636bfc810 con 0x561636d0f880 2024-08-20T01:41:48.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.755+0000 7f3e14563740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561636d231f0 con 0x561636d20540 2024-08-20T01:41:48.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.755+0000 7f3e0b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561636d101a0 0x561636d1da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:48.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.755+0000 7f3e0affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561636d0f880 0x561636d1d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:48.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.755+0000 7f3e0affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561636d0f880 0x561636d1d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:50318/0 (socket says 172.21.15.79:50318) 2024-08-20T01:41:48.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.755+0000 7f3e0b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561636d101a0 0x561636d1da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40654/0 (socket says 172.21.15.79:40654) 2024-08-20T01:41:48.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.755+0000 7f3e0affd640 1 -- 172.21.15.79:0/2064358900 learned_addr learned my addr 172.21.15.79:0/2064358900 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:48.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.755+0000 7f3e14563740 10 client.0 _ll_register_callbacks cb 0x561636c6f700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:48.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.755+0000 7f3e0affd640 1 -- 172.21.15.79:0/2064358900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561636d20540 msgr2=0x561636d1dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:48.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.755+0000 7f3e0affd640 1 --2- 172.21.15.79:0/2064358900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561636d20540 0x561636d1dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.755+0000 7f3e0affd640 1 -- 172.21.15.79:0/2064358900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561636d101a0 msgr2=0x561636d1da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:48.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.755+0000 7f3e0affd640 1 --2- 172.21.15.79:0/2064358900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561636d101a0 0x561636d1da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.755+0000 7f3e0affd640 1 -- 172.21.15.79:0/2064358900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561636d2c5f0 con 0x561636d0f880 2024-08-20T01:41:48.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.755+0000 7f3e0affd640 1 --2- 172.21.15.79:0/2064358900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561636d0f880 0x561636d1d530 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3e0000ee60 tx=0x7f3e000044b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50d5ed94d66b4596 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:48.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.755+0000 7f3deaffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:41:48.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.755+0000 7f3deaffd640 1 -- 172.21.15.79:0/2064358900 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e00018070 con 0x561636d0f880 2024-08-20T01:41:48.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.755+0000 7f3deaffd640 1 -- 172.21.15.79:0/2064358900 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f3e00010ae0 con 0x561636d0f880 2024-08-20T01:41:48.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.755+0000 7f3e14563740 1 -- 172.21.15.79:0/2064358900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561636c25150 con 0x561636d0f880 2024-08-20T01:41:48.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.756+0000 7f3deaffd640 1 -- 172.21.15.79:0/2064358900 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f3e00010ce0 con 0x561636d0f880 2024-08-20T01:41:48.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.756+0000 7f3e14563740 10 client.26108 fetch_fsmap learned FSMap version 38 2024-08-20T01:41:48.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.756+0000 7f3e14563740 1 -- 172.21.15.79:0/2064358900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x561636d2ef80 con 0x561636d0f880 2024-08-20T01:41:48.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.756+0000 7f3deaffd640 1 -- 172.21.15.79:0/2064358900 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x561636c25150 con 0x561636d0f880 2024-08-20T01:41:48.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.756+0000 7f3deaffd640 1 -- 172.21.15.79:0/2064358900 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f3e00024020 con 0x561636d0f880 2024-08-20T01:41:48.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.756+0000 7f3e14563740 10 client.26108 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:41:48.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.756+0000 7f3e14563740 10 client.26108 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:41:48.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.756+0000 7f3e14563740 20 client.26108 populate_metadata read hostname 'smithi079' 2024-08-20T01:41:48.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.756+0000 7f3e14563740 1 --2- 172.21.15.79:0/2064358900 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x561636d302d0 0x561636d326c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:48.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.756+0000 7f3e14563740 4 client.26108 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:41:48.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.756+0000 7f3e14563740 1 -- 172.21.15.79:0/2064358900 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561636c88880 con 0x561636d302d0 2024-08-20T01:41:48.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.756+0000 7f3e0b7fe640 1 --2- 172.21.15.79:0/2064358900 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x561636d302d0 0x561636d326c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:48.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.757+0000 7f3deaffd640 10 client.26108 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:41:48.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.757+0000 7f3e0b7fe640 1 --2- 172.21.15.79:0/2064358900 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x561636d302d0 0x561636d326c0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3d207d5acb8a8f4e server_cookie=605cdec760d9e59c in_seq=0 out_seq=0 2024-08-20T01:41:48.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.758+0000 7f3deaffd640 1 -- 172.21.15.79:0/2064358900 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561636c88880 con 0x561636d302d0 2024-08-20T01:41:48.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.758+0000 7f3deaffd640 10 client.26108 handle_command_reply: tid=0 2024-08-20T01:41:48.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.758+0000 7f3e14563740 1 client.26108 shutdown 2024-08-20T01:41:48.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.758+0000 7f3e14563740 1 -- 172.21.15.79:0/2064358900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561636d0f880 msgr2=0x561636d1d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:48.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.758+0000 7f3e14563740 1 --2- 172.21.15.79:0/2064358900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561636d0f880 0x561636d1d530 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3e0000ee60 tx=0x7f3e000044b0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.758+0000 7f3e14563740 1 -- 172.21.15.79:0/2064358900 shutdown_connections 2024-08-20T01:41:48.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.758+0000 7f3e14563740 1 --2- 172.21.15.79:0/2064358900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561636d20540 0x561636d1dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.758+0000 7f3e14563740 1 --2- 172.21.15.79:0/2064358900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561636d101a0 0x561636d1da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.758+0000 7f3e14563740 1 --2- 172.21.15.79:0/2064358900 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x561636d302d0 0x561636d326c0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.758+0000 7f3deaffd640 0 client.26108 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:41:48.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.758+0000 7f3e14563740 1 --2- 172.21.15.79:0/2064358900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561636d0f880 0x561636d1d530 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.758+0000 7f3e14563740 1 -- 172.21.15.79:0/2064358900 >> 172.21.15.79:0/2064358900 conn(0x561636d0d6b0 msgr2=0x561636d131e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:48.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.758+0000 7f3e14563740 1 -- 172.21.15.79:0/2064358900 shutdown_connections 2024-08-20T01:41:48.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.758+0000 7f3e14563740 1 -- 172.21.15.79:0/2064358900 wait complete. 2024-08-20T01:41:48.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.758+0000 7f3e14563740 20 client.26108 trim_cache size 0 max 16384 2024-08-20T01:41:48.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.773+0000 7f3e14563740 1 Processor -- start 2024-08-20T01:41:48.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.773+0000 7f3e14563740 1 -- start start 2024-08-20T01:41:48.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.774+0000 7f3e14563740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561636d0f880 0x561636d1afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:48.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.774+0000 7f3e14563740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561636d101a0 0x561636d1cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:48.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.774+0000 7f3e14563740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561636d20540 0x561636d129c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:48.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.774+0000 7f3e14563740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c1abca0 con 0x561636d20540 2024-08-20T01:41:48.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.774+0000 7f3e14563740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c1ad7e0 con 0x561636d0f880 2024-08-20T01:41:48.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.774+0000 7f3e14563740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c1ac370 con 0x561636d101a0 2024-08-20T01:41:48.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.774+0000 7f3e0affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561636d20540 0x561636d129c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:48.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.774+0000 7f3e0affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561636d20540 0x561636d129c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40668/0 (socket says 172.21.15.79:40668) 2024-08-20T01:41:48.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.774+0000 7f3e0affd640 1 -- 172.21.15.79:0/4074186762 learned_addr learned my addr 172.21.15.79:0/4074186762 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:48.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.774+0000 7f3e0affd640 1 --2- 172.21.15.79:0/4074186762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561636d0f880 0x561636d1afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:48.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.774+0000 7f3e0b7fe640 1 --2- 172.21.15.79:0/4074186762 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561636d101a0 0x561636d1cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:48.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.774+0000 7f3e0affd640 1 -- 172.21.15.79:0/4074186762 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561636d101a0 msgr2=0x561636d1cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:48.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.774+0000 7f3e0affd640 1 --2- 172.21.15.79:0/4074186762 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561636d101a0 0x561636d1cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.774+0000 7f3e0affd640 1 -- 172.21.15.79:0/4074186762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561636d20540 msgr2=0x561636d129c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:48.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.774+0000 7f3e0affd640 1 --2- 172.21.15.79:0/4074186762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561636d20540 0x561636d129c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.774+0000 7f3e0affd640 1 -- 172.21.15.79:0/4074186762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561636d08830 con 0x561636d0f880 2024-08-20T01:41:48.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.774+0000 7f3e0affd640 1 --2- 172.21.15.79:0/4074186762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561636d0f880 0x561636d1afd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3e00026660 tx=0x7f3e00005a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7510e3bb7b6c8706 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:48.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.775+0000 7f3df17fa640 1 -- 172.21.15.79:0/4074186762 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e00018040 con 0x561636d0f880 2024-08-20T01:41:48.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.775+0000 7f3df17fa640 1 -- 172.21.15.79:0/4074186762 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e00037070 con 0x561636d0f880 2024-08-20T01:41:48.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.775+0000 7f3df17fa640 1 -- 172.21.15.79:0/4074186762 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e00003950 con 0x561636d0f880 2024-08-20T01:41:48.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.775+0000 7f3e14563740 1 -- 172.21.15.79:0/4074186762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561636d0f880 msgr2=0x561636d1afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:48.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.775+0000 7f3e14563740 1 --2- 172.21.15.79:0/4074186762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561636d0f880 0x561636d1afd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3e00026660 tx=0x7f3e00005a10 comp rx=0 tx=0).stop 2024-08-20T01:41:48.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.775+0000 7f3e14563740 1 -- 172.21.15.79:0/4074186762 shutdown_connections 2024-08-20T01:41:48.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.775+0000 7f3e14563740 1 --2- 172.21.15.79:0/4074186762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561636d20540 0x561636d129c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.775+0000 7f3e14563740 1 --2- 172.21.15.79:0/4074186762 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561636d101a0 0x561636d1cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.775+0000 7f3e14563740 1 --2- 172.21.15.79:0/4074186762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561636d0f880 0x561636d1afd0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.775+0000 7f3e14563740 1 -- 172.21.15.79:0/4074186762 >> 172.21.15.79:0/4074186762 conn(0x561636d0d6b0 msgr2=0x561636d1f380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:48.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.776+0000 7f3e14563740 1 -- 172.21.15.79:0/4074186762 shutdown_connections 2024-08-20T01:41:48.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.776+0000 7f3e14563740 1 -- 172.21.15.79:0/4074186762 wait complete. 2024-08-20T01:41:48.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.776+0000 7f3e14563740 1 -- start start 2024-08-20T01:41:48.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.776+0000 7f3e14563740 1 Processor -- start 2024-08-20T01:41:48.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.776+0000 7f3e14563740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561636d0f880 0x561636d28480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:48.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.776+0000 7f3e14563740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561636d101a0 0x561636d289e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:48.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.776+0000 7f3e14563740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561636d20540 0x561636d371d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:48.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.776+0000 7f3e14563740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c1ad110 con 0x561636d0f880 2024-08-20T01:41:48.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.776+0000 7f3e14563740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c1aca40 con 0x561636d101a0 2024-08-20T01:41:48.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.776+0000 7f3e14563740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c1a9c80 con 0x561636d20540 2024-08-20T01:41:48.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.777+0000 7f3e14563740 10 client.0 _ll_register_callbacks cb 0x7f3dfc00c350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:48.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.777+0000 7f3e0affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561636d0f880 0x561636d28480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:48.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.777+0000 7f3e0affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561636d0f880 0x561636d28480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40676/0 (socket says 172.21.15.79:40676) 2024-08-20T01:41:48.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.777+0000 7f3e0affd640 1 -- 172.21.15.79:0/1919987836 learned_addr learned my addr 172.21.15.79:0/1919987836 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:48.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.777+0000 7f3e0b7fe640 1 --2- 172.21.15.79:0/1919987836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561636d101a0 0x561636d289e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:48.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.777+0000 7f3e0affd640 1 --2- 172.21.15.79:0/1919987836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561636d20540 0x561636d371d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:48.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.777+0000 7f3e0affd640 1 -- 172.21.15.79:0/1919987836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561636d20540 msgr2=0x561636d371d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:48.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.777+0000 7f3e0affd640 1 --2- 172.21.15.79:0/1919987836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561636d20540 0x561636d371d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.777+0000 7f3e0affd640 1 -- 172.21.15.79:0/1919987836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561636d101a0 msgr2=0x561636d289e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:48.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.777+0000 7f3e0affd640 1 --2- 172.21.15.79:0/1919987836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561636d101a0 0x561636d289e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.777+0000 7f3e0affd640 1 -- 172.21.15.79:0/1919987836 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561636d378c0 con 0x561636d0f880 2024-08-20T01:41:48.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.777+0000 7f3e0affd640 1 --2- 172.21.15.79:0/1919987836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561636d0f880 0x561636d28480 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f3e000044f0 tx=0x7f3e000035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f37af2164b81c0a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:48.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.777+0000 7f3deaffd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:41:48.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.777+0000 7f3deaffd640 1 -- 172.21.15.79:0/1919987836 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e00018040 con 0x561636d0f880 2024-08-20T01:41:48.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.777+0000 7f3e14563740 1 -- 172.21.15.79:0/1919987836 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e00037070 con 0x561636d0f880 2024-08-20T01:41:48.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.777+0000 7f3deaffd640 1 -- 172.21.15.79:0/1919987836 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f3e00026b60 con 0x561636d0f880 2024-08-20T01:41:48.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.778+0000 7f3deaffd640 1 -- 172.21.15.79:0/1919987836 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f3e000036d0 con 0x561636d0f880 2024-08-20T01:41:48.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.778+0000 7f3e14563740 10 client.16917 fetch_fsmap learned FSMap version 38 2024-08-20T01:41:48.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.778+0000 7f3e14563740 1 -- 172.21.15.79:0/1919987836 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x561636d9a720 con 0x561636d0f880 2024-08-20T01:41:48.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.778+0000 7f3deaffd640 1 -- 172.21.15.79:0/1919987836 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e00003d00 con 0x561636d0f880 2024-08-20T01:41:48.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.778+0000 7f3deaffd640 1 -- 172.21.15.79:0/1919987836 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f3e0003b070 con 0x561636d0f880 2024-08-20T01:41:48.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.778+0000 7f3e14563740 10 client.16917 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:41:48.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.778+0000 7f3e14563740 10 client.16917 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:41:48.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.778+0000 7f3e14563740 20 client.16917 populate_metadata read hostname 'smithi079' 2024-08-20T01:41:48.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.778+0000 7f3e14563740 1 --2- 172.21.15.79:0/1919987836 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x561636d9ad60 0x561636d9d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:48.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.778+0000 7f3e14563740 4 client.16917 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:41:48.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.778+0000 7f3e14563740 1 -- 172.21.15.79:0/1919987836 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f3e00037070 con 0x561636d9ad60 2024-08-20T01:41:48.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.778+0000 7f3e0b7fe640 1 --2- 172.21.15.79:0/1919987836 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x561636d9ad60 0x561636d9d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:48.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.779+0000 7f3deaffd640 10 client.16917 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:41:48.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.779+0000 7f3e0b7fe640 1 --2- 172.21.15.79:0/1919987836 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x561636d9ad60 0x561636d9d180 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=59106f5727bb57c0 server_cookie=af42a8c645a51dd8 in_seq=0 out_seq=0 2024-08-20T01:41:48.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.779+0000 7f3deaffd640 1 -- 172.21.15.79:0/1919987836 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f3e00037070 con 0x561636d9ad60 2024-08-20T01:41:48.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.779+0000 7f3deaffd640 10 client.16917 handle_command_reply: tid=0 2024-08-20T01:41:48.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.779+0000 7f3e14563740 1 client.16917 shutdown 2024-08-20T01:41:48.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.779+0000 7f3e14563740 1 -- 172.21.15.79:0/1919987836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561636d0f880 msgr2=0x561636d28480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:48.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.779+0000 7f3e14563740 1 --2- 172.21.15.79:0/1919987836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561636d0f880 0x561636d28480 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f3e000044f0 tx=0x7f3e000035f0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.779+0000 7f3e14563740 1 -- 172.21.15.79:0/1919987836 shutdown_connections 2024-08-20T01:41:48.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.779+0000 7f3e14563740 1 --2- 172.21.15.79:0/1919987836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561636d20540 0x561636d371d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.779+0000 7f3e14563740 1 --2- 172.21.15.79:0/1919987836 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x561636d9ad60 0x561636d9d180 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.779+0000 7f3e14563740 1 --2- 172.21.15.79:0/1919987836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561636d101a0 0x561636d289e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.779+0000 7f3e14563740 1 --2- 172.21.15.79:0/1919987836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561636d0f880 0x561636d28480 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.779+0000 7f3e14563740 1 -- 172.21.15.79:0/1919987836 >> 172.21.15.79:0/1919987836 conn(0x561636d0d6b0 msgr2=0x561636d129c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:48.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.779+0000 7f3deaffd640 0 client.16917 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:41:48.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.779+0000 7f3e14563740 1 -- 172.21.15.79:0/1919987836 shutdown_connections 2024-08-20T01:41:48.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.779+0000 7f3e14563740 1 -- 172.21.15.79:0/1919987836 wait complete. 2024-08-20T01:41:48.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.779+0000 7f3e14563740 20 client.16917 trim_cache size 0 max 16384 2024-08-20T01:41:48.789 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:41:48.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.780+0000 7f3e1216a640 1 -- 172.21.15.79:0/1147248941 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3df40b3bd0 msgr2=0x7f3df40b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:48.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.780+0000 7f3e1216a640 1 --2- 172.21.15.79:0/1147248941 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3df40b3bd0 0x7f3df40b6090 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f3e040c8490 tx=0x7f3e04005c30 comp rx=0 tx=0).stop 2024-08-20T01:41:48.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.780+0000 7f3e1216a640 1 -- 172.21.15.79:0/1147248941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e0c10cdc0 msgr2=0x7f3e0c19e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:48.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.780+0000 7f3e1216a640 1 --2- 172.21.15.79:0/1147248941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e0c10cdc0 0x7f3e0c19e6e0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f3e04009dc0 tx=0x7f3e04003ba0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.780+0000 7f3e1216a640 1 -- 172.21.15.79:0/1147248941 shutdown_connections 2024-08-20T01:41:48.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.780+0000 7f3e1216a640 1 --2- 172.21.15.79:0/1147248941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e0c10cdc0 0x7f3e0c19e6e0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.780+0000 7f3e1216a640 1 --2- 172.21.15.79:0/1147248941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e0c101f00 0x7f3e0c199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.780+0000 7f3e1216a640 1 --2- 172.21.15.79:0/1147248941 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3df40b3bd0 0x7f3df40b6090 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.780+0000 7f3e1216a640 1 --2- 172.21.15.79:0/1147248941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e0c101500 0x7f3e0c198e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:48.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.780+0000 7f3e1216a640 1 -- 172.21.15.79:0/1147248941 >> 172.21.15.79:0/1147248941 conn(0x7f3e0c076bd0 msgr2=0x7f3e0c0ff4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:48.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.780+0000 7f3e1216a640 1 -- 172.21.15.79:0/1147248941 shutdown_connections 2024-08-20T01:41:48.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:48.780+0000 7f3e1216a640 1 -- 172.21.15.79:0/1147248941 wait complete. 2024-08-20T01:41:49.573 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T01:41:49.846 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:41:50.271 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:50 smithi079 ceph-mon[18656]: pgmap v482: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 30 MiB/s wr, 27 op/s 2024-08-20T01:41:50.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.370+0000 7ff54adf5640 1 -- 172.21.15.79:0/1932626273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff54410f140 msgr2=0x7ff544111530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:50.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.370+0000 7ff54adf5640 1 --2- 172.21.15.79:0/1932626273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff54410f140 0x7ff544111530 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7ff53c009ca0 tx=0x7ff53c02a950 comp rx=0 tx=0).stop 2024-08-20T01:41:50.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.371+0000 7ff54adf5640 1 -- 172.21.15.79:0/1932626273 shutdown_connections 2024-08-20T01:41:50.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.371+0000 7ff54adf5640 1 --2- 172.21.15.79:0/1932626273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff54410f140 0x7ff544111530 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.371+0000 7ff54adf5640 1 --2- 172.21.15.79:0/1932626273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff544101eb0 0x7ff54410ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.371+0000 7ff54adf5640 1 --2- 172.21.15.79:0/1932626273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff544101590 0x7ff544101970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.371+0000 7ff54adf5640 1 -- 172.21.15.79:0/1932626273 >> 172.21.15.79:0/1932626273 conn(0x7ff5440fd400 msgr2=0x7ff5440ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:50.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.371+0000 7ff54adf5640 1 -- 172.21.15.79:0/1932626273 shutdown_connections 2024-08-20T01:41:50.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.371+0000 7ff54adf5640 1 -- 172.21.15.79:0/1932626273 wait complete. 2024-08-20T01:41:50.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.371+0000 7ff54adf5640 1 Processor -- start 2024-08-20T01:41:50.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.371+0000 7ff54adf5640 1 -- start start 2024-08-20T01:41:50.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.372+0000 7ff54adf5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff544101590 0x7ff54419b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:50.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.372+0000 7ff54adf5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff544101eb0 0x7ff54419b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:50.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.372+0000 7ff54adf5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff54410f140 0x7ff5441a0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:50.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.372+0000 7ff54adf5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff544114b80 con 0x7ff544101590 2024-08-20T01:41:50.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.372+0000 7ff54adf5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff544114a00 con 0x7ff54410f140 2024-08-20T01:41:50.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.372+0000 7ff54adf5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff544114d00 con 0x7ff544101eb0 2024-08-20T01:41:50.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.372+0000 7ff548b91640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff544101590 0x7ff54419b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:50.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.372+0000 7ff548b91640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff544101590 0x7ff54419b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53216/0 (socket says 172.21.15.79:53216) 2024-08-20T01:41:50.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.372+0000 7ff548b91640 1 -- 172.21.15.79:0/245407420 learned_addr learned my addr 172.21.15.79:0/245407420 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:50.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.372+0000 7ff549392640 1 --2- 172.21.15.79:0/245407420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff54410f140 0x7ff5441a0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:50.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.372+0000 7ff543fff640 1 --2- 172.21.15.79:0/245407420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff544101eb0 0x7ff54419b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:50.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.372+0000 7ff548b91640 1 -- 172.21.15.79:0/245407420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff544101eb0 msgr2=0x7ff54419b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:50.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.372+0000 7ff548b91640 1 --2- 172.21.15.79:0/245407420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff544101eb0 0x7ff54419b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.372+0000 7ff548b91640 1 -- 172.21.15.79:0/245407420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff54410f140 msgr2=0x7ff5441a0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:50.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.372+0000 7ff548b91640 1 --2- 172.21.15.79:0/245407420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff54410f140 0x7ff5441a0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.372+0000 7ff548b91640 1 -- 172.21.15.79:0/245407420 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5441a11e0 con 0x7ff544101590 2024-08-20T01:41:50.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.372+0000 7ff549392640 1 --2- 172.21.15.79:0/245407420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff54410f140 0x7ff5441a0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:41:50.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.372+0000 7ff543fff640 1 --2- 172.21.15.79:0/245407420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff544101eb0 0x7ff54419b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:41:50.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.372+0000 7ff548b91640 1 --2- 172.21.15.79:0/245407420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff544101590 0x7ff54419b130 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7ff53800d950 tx=0x7ff53800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:50.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.373+0000 7ff541ffb640 1 -- 172.21.15.79:0/245407420 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff538017030 con 0x7ff544101590 2024-08-20T01:41:50.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.373+0000 7ff54adf5640 1 -- 172.21.15.79:0/245407420 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5441a14d0 con 0x7ff544101590 2024-08-20T01:41:50.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.373+0000 7ff541ffb640 1 -- 172.21.15.79:0/245407420 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff538004020 con 0x7ff544101590 2024-08-20T01:41:50.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.373+0000 7ff541ffb640 1 -- 172.21.15.79:0/245407420 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5380055d0 con 0x7ff544101590 2024-08-20T01:41:50.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.373+0000 7ff54adf5640 1 -- 172.21.15.79:0/245407420 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5441a7d60 con 0x7ff544101590 2024-08-20T01:41:50.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.375+0000 7ff54d1ee740 1 Processor -- start 2024-08-20T01:41:50.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.376+0000 7ff541ffb640 1 -- 172.21.15.79:0/245407420 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff538009a30 con 0x7ff544101590 2024-08-20T01:41:50.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.376+0000 7ff54d1ee740 1 -- start start 2024-08-20T01:41:50.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.376+0000 7ff54d1ee740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f17bb9880 0x564f17bb9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:50.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.376+0000 7ff54d1ee740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f17bba1a0 0x564f17bc5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:50.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.376+0000 7ff54d1ee740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f17bc6130 0x564f17bc8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:50.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.376+0000 7ff54d1ee740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564f17b30930 con 0x564f17bc6130 2024-08-20T01:41:50.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.376+0000 7ff54d1ee740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564f17b1fe30 con 0x564f17bb9880 2024-08-20T01:41:50.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.376+0000 7ff54d1ee740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564f17b23e70 con 0x564f17bba1a0 2024-08-20T01:41:50.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.376+0000 7ff543fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f17bc6130 0x564f17bc8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:50.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.376+0000 7ff543fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f17bc6130 0x564f17bc8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53220/0 (socket says 172.21.15.79:53220) 2024-08-20T01:41:50.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.376+0000 7ff543fff640 1 -- 172.21.15.79:0/1559991671 learned_addr learned my addr 172.21.15.79:0/1559991671 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:50.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.376+0000 7ff549392640 1 --2- 172.21.15.79:0/1559991671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f17bb9880 0x564f17bb9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:50.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.376+0000 7ff548b91640 1 --2- 172.21.15.79:0/1559991671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f17bba1a0 0x564f17bc5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:50.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.377+0000 7ff543fff640 1 -- 172.21.15.79:0/1559991671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f17bba1a0 msgr2=0x564f17bc5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:50.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.377+0000 7ff543fff640 1 --2- 172.21.15.79:0/1559991671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f17bba1a0 0x564f17bc5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.377+0000 7ff543fff640 1 -- 172.21.15.79:0/1559991671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f17bb9880 msgr2=0x564f17bb9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:50.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.377+0000 7ff543fff640 1 --2- 172.21.15.79:0/1559991671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f17bb9880 0x564f17bb9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.377+0000 7ff543fff640 1 -- 172.21.15.79:0/1559991671 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f1787f650 con 0x564f17bc6130 2024-08-20T01:41:50.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.377+0000 7ff541ffb640 1 --2- 172.21.15.79:0/245407420 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff5340b3bd0 0x7ff5340b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:50.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.377+0000 7ff543fff640 1 --2- 172.21.15.79:0/1559991671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f17bc6130 0x564f17bc8520 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7ff530009bd0 tx=0x7ff53000e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0dfa12b90209bb1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:50.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.377+0000 7ff52effd640 1 -- 172.21.15.79:0/1559991671 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff530016070 con 0x564f17bc6130 2024-08-20T01:41:50.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.377+0000 7ff549392640 1 --2- 172.21.15.79:0/245407420 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff5340b3bd0 0x7ff5340b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:50.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.377+0000 7ff541ffb640 1 -- 172.21.15.79:0/245407420 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff5380e36f0 con 0x7ff544101590 2024-08-20T01:41:50.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.377+0000 7ff52effd640 1 -- 172.21.15.79:0/1559991671 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff530011900 con 0x564f17bc6130 2024-08-20T01:41:50.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.377+0000 7ff52effd640 1 -- 172.21.15.79:0/1559991671 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5300107f0 con 0x564f17bc6130 2024-08-20T01:41:50.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.378+0000 7ff54d1ee740 1 -- 172.21.15.79:0/1559991671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f17bc6130 msgr2=0x564f17bc8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:50.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.378+0000 7ff549392640 1 --2- 172.21.15.79:0/245407420 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff5340b3bd0 0x7ff5340b6090 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff53c009a60 tx=0x7ff53c03c040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:50.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.378+0000 7ff54d1ee740 1 --2- 172.21.15.79:0/1559991671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f17bc6130 0x564f17bc8520 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7ff530009bd0 tx=0x7ff53000e6c0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.378+0000 7ff54d1ee740 1 -- 172.21.15.79:0/1559991671 shutdown_connections 2024-08-20T01:41:50.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.378+0000 7ff54d1ee740 1 --2- 172.21.15.79:0/1559991671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f17bc6130 0x564f17bc8520 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.378+0000 7ff54d1ee740 1 --2- 172.21.15.79:0/1559991671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f17bba1a0 0x564f17bc5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.378+0000 7ff54d1ee740 1 --2- 172.21.15.79:0/1559991671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f17bb9880 0x564f17bb9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.378+0000 7ff54d1ee740 1 -- 172.21.15.79:0/1559991671 >> 172.21.15.79:0/1559991671 conn(0x564f17bb76b0 msgr2=0x564f17bb8850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:50.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.378+0000 7ff54d1ee740 1 -- 172.21.15.79:0/1559991671 shutdown_connections 2024-08-20T01:41:50.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.378+0000 7ff54d1ee740 1 -- 172.21.15.79:0/1559991671 wait complete. 2024-08-20T01:41:50.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.378+0000 7ff54d1ee740 1 -- start start 2024-08-20T01:41:50.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.379+0000 7ff54d1ee740 1 Processor -- start 2024-08-20T01:41:50.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.379+0000 7ff54d1ee740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f17bb9880 0x564f17bc5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:50.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.379+0000 7ff54d1ee740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f17bba1a0 0x564f17bc2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:50.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.379+0000 7ff54d1ee740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f17bc6130 0x564f17bc36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:50.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.379+0000 7ff54d1ee740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564f17982700 con 0x564f17bc6130 2024-08-20T01:41:50.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.379+0000 7ff54d1ee740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564f17aa6810 con 0x564f17bb9880 2024-08-20T01:41:50.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.379+0000 7ff54d1ee740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564f17bc8e80 con 0x564f17bba1a0 2024-08-20T01:41:50.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.379+0000 7ff54d1ee740 10 client.0 _ll_register_callbacks cb 0x564f17b19700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:50.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.379+0000 7ff549392640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f17bc6130 0x564f17bc36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:50.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.379+0000 7ff549392640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f17bc6130 0x564f17bc36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53228/0 (socket says 172.21.15.79:53228) 2024-08-20T01:41:50.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.379+0000 7ff549392640 1 -- 172.21.15.79:0/4028388834 learned_addr learned my addr 172.21.15.79:0/4028388834 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:50.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.379+0000 7ff543fff640 1 --2- 172.21.15.79:0/4028388834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f17bba1a0 0x564f17bc2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:50.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.379+0000 7ff548b91640 1 --2- 172.21.15.79:0/4028388834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f17bb9880 0x564f17bc5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:50.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.380+0000 7ff549392640 1 -- 172.21.15.79:0/4028388834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f17bba1a0 msgr2=0x564f17bc2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:50.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.380+0000 7ff549392640 1 --2- 172.21.15.79:0/4028388834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f17bba1a0 0x564f17bc2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.380+0000 7ff549392640 1 -- 172.21.15.79:0/4028388834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f17bb9880 msgr2=0x564f17bc5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:50.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.380+0000 7ff549392640 1 --2- 172.21.15.79:0/4028388834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f17bb9880 0x564f17bc5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.380+0000 7ff549392640 1 -- 172.21.15.79:0/4028388834 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f17bd21b0 con 0x564f17bc6130 2024-08-20T01:41:50.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.380+0000 7ff549392640 1 --2- 172.21.15.79:0/4028388834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f17bc6130 0x564f17bc36f0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7ff544102570 tx=0x7ff53c02a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88d80cda9d09de92 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:50.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.380+0000 7ff523fff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:41:50.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.380+0000 7ff523fff640 1 -- 172.21.15.79:0/4028388834 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53c034050 con 0x564f17bc6130 2024-08-20T01:41:50.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.380+0000 7ff523fff640 1 -- 172.21.15.79:0/4028388834 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff53c004250 con 0x564f17bc6130 2024-08-20T01:41:50.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.380+0000 7ff54d1ee740 1 -- 172.21.15.79:0/4028388834 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564f17acf150 con 0x564f17bc6130 2024-08-20T01:41:50.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.380+0000 7ff523fff640 1 -- 172.21.15.79:0/4028388834 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7ff53c004450 con 0x564f17bc6130 2024-08-20T01:41:50.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.380+0000 7ff54d1ee740 10 client.16929 fetch_fsmap learned FSMap version 38 2024-08-20T01:41:50.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.380+0000 7ff54d1ee740 1 -- 172.21.15.79:0/4028388834 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x564f17bd4ac0 con 0x564f17bc6130 2024-08-20T01:41:50.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.380+0000 7ff523fff640 1 -- 172.21.15.79:0/4028388834 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x564f17acf150 con 0x564f17bc6130 2024-08-20T01:41:50.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.381+0000 7ff523fff640 1 -- 172.21.15.79:0/4028388834 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7ff53c04f070 con 0x564f17bc6130 2024-08-20T01:41:50.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.381+0000 7ff54d1ee740 10 client.16929 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:41:50.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.381+0000 7ff54d1ee740 10 client.16929 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:41:50.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.381+0000 7ff54d1ee740 20 client.16929 populate_metadata read hostname 'smithi079' 2024-08-20T01:41:50.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.381+0000 7ff54d1ee740 1 --2- 172.21.15.79:0/4028388834 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564f17bd6130 0x564f17bd85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:50.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.381+0000 7ff54d1ee740 4 client.16929 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:41:50.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.381+0000 7ff54d1ee740 1 -- 172.21.15.79:0/4028388834 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f17b32880 con 0x564f17bd6130 2024-08-20T01:41:50.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.382+0000 7ff548b91640 1 --2- 172.21.15.79:0/4028388834 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564f17bd6130 0x564f17bd85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:50.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.383+0000 7ff548b91640 1 --2- 172.21.15.79:0/4028388834 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564f17bd6130 0x564f17bd85b0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14af2fef202b7ef4 server_cookie=912d446c211bad6 in_seq=0 out_seq=0 2024-08-20T01:41:50.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.383+0000 7ff523fff640 10 client.16929 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:41:50.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.384+0000 7ff523fff640 1 -- 172.21.15.79:0/4028388834 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564f17b32880 con 0x564f17bd6130 2024-08-20T01:41:50.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.384+0000 7ff523fff640 10 client.16929 handle_command_reply: tid=0 2024-08-20T01:41:50.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.384+0000 7ff54d1ee740 1 client.16929 shutdown 2024-08-20T01:41:50.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.384+0000 7ff54d1ee740 1 -- 172.21.15.79:0/4028388834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f17bc6130 msgr2=0x564f17bc36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:50.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.384+0000 7ff54d1ee740 1 --2- 172.21.15.79:0/4028388834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f17bc6130 0x564f17bc36f0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7ff544102570 tx=0x7ff53c02a950 comp rx=0 tx=0).stop 2024-08-20T01:41:50.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.384+0000 7ff54d1ee740 1 -- 172.21.15.79:0/4028388834 shutdown_connections 2024-08-20T01:41:50.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.384+0000 7ff54d1ee740 1 --2- 172.21.15.79:0/4028388834 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564f17bd6130 0x564f17bd85b0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.384+0000 7ff54d1ee740 1 --2- 172.21.15.79:0/4028388834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f17bc6130 0x564f17bc36f0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.384+0000 7ff54d1ee740 1 --2- 172.21.15.79:0/4028388834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f17bba1a0 0x564f17bc2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.384+0000 7ff54d1ee740 1 --2- 172.21.15.79:0/4028388834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f17bb9880 0x564f17bc5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.384+0000 7ff54d1ee740 1 -- 172.21.15.79:0/4028388834 >> 172.21.15.79:0/4028388834 conn(0x564f17bb76b0 msgr2=0x564f17bbd250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:50.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.384+0000 7ff523fff640 0 client.16929 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:41:50.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.385+0000 7ff54d1ee740 1 -- 172.21.15.79:0/4028388834 shutdown_connections 2024-08-20T01:41:50.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.385+0000 7ff54d1ee740 1 -- 172.21.15.79:0/4028388834 wait complete. 2024-08-20T01:41:50.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.385+0000 7ff54d1ee740 20 client.16929 trim_cache size 0 max 16384 2024-08-20T01:41:50.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.403+0000 7ff54d1ee740 1 Processor -- start 2024-08-20T01:41:50.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.403+0000 7ff54d1ee740 1 -- start start 2024-08-20T01:41:50.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.404+0000 7ff54d1ee740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f17bb9880 0x564f17bd85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:50.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.404+0000 7ff54d1ee740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f17bba1a0 0x564f17bdde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:50.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.404+0000 7ff54d1ee740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f17bc6130 0x564f17bde3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:50.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.404+0000 7ff54d1ee740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff5441b0270 con 0x564f17bb9880 2024-08-20T01:41:50.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.404+0000 7ff54d1ee740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff5441b1db0 con 0x564f17bc6130 2024-08-20T01:41:50.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.404+0000 7ff54d1ee740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff5441b0940 con 0x564f17bba1a0 2024-08-20T01:41:50.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.404+0000 7ff548b91640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f17bb9880 0x564f17bd85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:50.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.404+0000 7ff548b91640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f17bb9880 0x564f17bd85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53240/0 (socket says 172.21.15.79:53240) 2024-08-20T01:41:50.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.404+0000 7ff548b91640 1 -- 172.21.15.79:0/1185855433 learned_addr learned my addr 172.21.15.79:0/1185855433 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:50.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.404+0000 7ff543fff640 1 --2- 172.21.15.79:0/1185855433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f17bba1a0 0x564f17bdde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:50.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.404+0000 7ff549392640 1 --2- 172.21.15.79:0/1185855433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f17bc6130 0x564f17bde3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:50.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.404+0000 7ff548b91640 1 -- 172.21.15.79:0/1185855433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f17bba1a0 msgr2=0x564f17bdde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:50.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.404+0000 7ff548b91640 1 --2- 172.21.15.79:0/1185855433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f17bba1a0 0x564f17bdde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.404+0000 7ff548b91640 1 -- 172.21.15.79:0/1185855433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f17bc6130 msgr2=0x564f17bde3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:50.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.404+0000 7ff548b91640 1 --2- 172.21.15.79:0/1185855433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f17bc6130 0x564f17bde3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.404+0000 7ff548b91640 1 -- 172.21.15.79:0/1185855433 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f17bc5ed0 con 0x564f17bb9880 2024-08-20T01:41:50.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.404+0000 7ff549392640 1 --2- 172.21.15.79:0/1185855433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f17bc6130 0x564f17bde3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:41:50.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.405+0000 7ff548b91640 1 --2- 172.21.15.79:0/1185855433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f17bb9880 0x564f17bd85a0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7ff5380a78c0 tx=0x7ff5380e9550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c9325862ef3fc9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:50.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.405+0000 7ff52e7fc640 1 -- 172.21.15.79:0/1185855433 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5380a9dc0 con 0x564f17bb9880 2024-08-20T01:41:50.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.405+0000 7ff52e7fc640 1 -- 172.21.15.79:0/1185855433 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff5380aa160 con 0x564f17bb9880 2024-08-20T01:41:50.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.405+0000 7ff52e7fc640 1 -- 172.21.15.79:0/1185855433 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5380b3700 con 0x564f17bb9880 2024-08-20T01:41:50.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.405+0000 7ff54d1ee740 1 -- 172.21.15.79:0/1185855433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f17bb9880 msgr2=0x564f17bd85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:50.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.405+0000 7ff54d1ee740 1 --2- 172.21.15.79:0/1185855433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f17bb9880 0x564f17bd85a0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7ff5380a78c0 tx=0x7ff5380e9550 comp rx=0 tx=0).stop 2024-08-20T01:41:50.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.406+0000 7ff54d1ee740 1 -- 172.21.15.79:0/1185855433 shutdown_connections 2024-08-20T01:41:50.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.406+0000 7ff54d1ee740 1 --2- 172.21.15.79:0/1185855433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f17bc6130 0x564f17bde3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.406+0000 7ff54d1ee740 1 --2- 172.21.15.79:0/1185855433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f17bba1a0 0x564f17bdde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.406+0000 7ff54d1ee740 1 --2- 172.21.15.79:0/1185855433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f17bb9880 0x564f17bd85a0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.406+0000 7ff54d1ee740 1 -- 172.21.15.79:0/1185855433 >> 172.21.15.79:0/1185855433 conn(0x564f17bb76b0 msgr2=0x564f17bc1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:50.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.406+0000 7ff54d1ee740 1 -- 172.21.15.79:0/1185855433 shutdown_connections 2024-08-20T01:41:50.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.406+0000 7ff54d1ee740 1 -- 172.21.15.79:0/1185855433 wait complete. 2024-08-20T01:41:50.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.406+0000 7ff54d1ee740 1 -- start start 2024-08-20T01:41:50.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.406+0000 7ff54d1ee740 1 Processor -- start 2024-08-20T01:41:50.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.407+0000 7ff54d1ee740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f17bb9880 0x564f17bce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:50.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.407+0000 7ff54d1ee740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f17bba1a0 0x564f17bc01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:50.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.407+0000 7ff54d1ee740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f17bc6130 0x564f17bc0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:50.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.407+0000 7ff54d1ee740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff5441b16e0 con 0x564f17bba1a0 2024-08-20T01:41:50.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.407+0000 7ff54d1ee740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff5441b1010 con 0x564f17bc6130 2024-08-20T01:41:50.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.407+0000 7ff54d1ee740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff5441ae250 con 0x564f17bb9880 2024-08-20T01:41:50.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.407+0000 7ff54d1ee740 10 client.0 _ll_register_callbacks cb 0x7ff53c02f3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:50.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.407+0000 7ff543fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f17bba1a0 0x564f17bc01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:50.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.407+0000 7ff543fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f17bba1a0 0x564f17bc01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53248/0 (socket says 172.21.15.79:53248) 2024-08-20T01:41:50.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.407+0000 7ff543fff640 1 -- 172.21.15.79:0/1660198826 learned_addr learned my addr 172.21.15.79:0/1660198826 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:50.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.407+0000 7ff548b91640 1 --2- 172.21.15.79:0/1660198826 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f17bb9880 0x564f17bce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:50.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.407+0000 7ff549392640 1 --2- 172.21.15.79:0/1660198826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f17bc6130 0x564f17bc0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:50.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.407+0000 7ff543fff640 1 -- 172.21.15.79:0/1660198826 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f17bb9880 msgr2=0x564f17bce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:50.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.407+0000 7ff543fff640 1 --2- 172.21.15.79:0/1660198826 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f17bb9880 0x564f17bce5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.407+0000 7ff543fff640 1 -- 172.21.15.79:0/1660198826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f17bc6130 msgr2=0x564f17bc0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:50.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.407+0000 7ff543fff640 1 --2- 172.21.15.79:0/1660198826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f17bc6130 0x564f17bc0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.407+0000 7ff543fff640 1 -- 172.21.15.79:0/1660198826 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f17bc0d60 con 0x564f17bba1a0 2024-08-20T01:41:50.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.407+0000 7ff549392640 1 --2- 172.21.15.79:0/1660198826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f17bc6130 0x564f17bc0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:41:50.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.407+0000 7ff543fff640 1 --2- 172.21.15.79:0/1660198826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f17bba1a0 0x564f17bc01e0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x564f17bb9830 tx=0x7ff530005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1e5bd2d9c3a4f08 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:50.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.407+0000 7ff523fff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:41:50.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.408+0000 7ff523fff640 1 -- 172.21.15.79:0/1660198826 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53002a060 con 0x564f17bba1a0 2024-08-20T01:41:50.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.408+0000 7ff523fff640 1 -- 172.21.15.79:0/1660198826 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff530004620 con 0x564f17bba1a0 2024-08-20T01:41:50.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.408+0000 7ff54d1ee740 1 -- 172.21.15.79:0/1660198826 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5380aa160 con 0x564f17bba1a0 2024-08-20T01:41:50.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.408+0000 7ff523fff640 1 -- 172.21.15.79:0/1660198826 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7ff530016040 con 0x564f17bba1a0 2024-08-20T01:41:50.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.408+0000 7ff54d1ee740 10 client.16935 fetch_fsmap learned FSMap version 38 2024-08-20T01:41:50.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.408+0000 7ff54d1ee740 1 -- 172.21.15.79:0/1660198826 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x564f17c40e50 con 0x564f17bba1a0 2024-08-20T01:41:50.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.408+0000 7ff523fff640 1 -- 172.21.15.79:0/1660198826 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff5380aa160 con 0x564f17bba1a0 2024-08-20T01:41:50.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.408+0000 7ff523fff640 1 -- 172.21.15.79:0/1660198826 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7ff530024070 con 0x564f17bba1a0 2024-08-20T01:41:50.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.408+0000 7ff54d1ee740 10 client.16935 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:41:50.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.408+0000 7ff54d1ee740 10 client.16935 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:41:50.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.408+0000 7ff54d1ee740 20 client.16935 populate_metadata read hostname 'smithi079' 2024-08-20T01:41:50.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.408+0000 7ff54d1ee740 1 --2- 172.21.15.79:0/1660198826 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564f17c41180 0x564f17c435a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:50.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.408+0000 7ff54d1ee740 4 client.16935 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:41:50.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.408+0000 7ff54d1ee740 1 -- 172.21.15.79:0/1660198826 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564f17b2e320 con 0x564f17c41180 2024-08-20T01:41:50.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.409+0000 7ff548b91640 1 --2- 172.21.15.79:0/1660198826 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564f17c41180 0x564f17c435a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:50.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.409+0000 7ff523fff640 10 client.16935 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:41:50.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.409+0000 7ff548b91640 1 --2- 172.21.15.79:0/1660198826 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564f17c41180 0x564f17c435a0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=186b44c67333cf94 server_cookie=53bb14086f558071 in_seq=0 out_seq=0 2024-08-20T01:41:50.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.409+0000 7ff523fff640 1 -- 172.21.15.79:0/1660198826 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564f17b2e320 con 0x564f17c41180 2024-08-20T01:41:50.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.409+0000 7ff523fff640 10 client.16935 handle_command_reply: tid=0 2024-08-20T01:41:50.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.409+0000 7ff54d1ee740 1 client.16935 shutdown 2024-08-20T01:41:50.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.409+0000 7ff54d1ee740 1 -- 172.21.15.79:0/1660198826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f17bba1a0 msgr2=0x564f17bc01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:50.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.409+0000 7ff54d1ee740 1 --2- 172.21.15.79:0/1660198826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f17bba1a0 0x564f17bc01e0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x564f17bb9830 tx=0x7ff530005270 comp rx=0 tx=0).stop 2024-08-20T01:41:50.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.409+0000 7ff54d1ee740 1 -- 172.21.15.79:0/1660198826 shutdown_connections 2024-08-20T01:41:50.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.409+0000 7ff54d1ee740 1 --2- 172.21.15.79:0/1660198826 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564f17c41180 0x564f17c435a0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.409+0000 7ff54d1ee740 1 --2- 172.21.15.79:0/1660198826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f17bc6130 0x564f17bc0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.409+0000 7ff54d1ee740 1 --2- 172.21.15.79:0/1660198826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f17bba1a0 0x564f17bc01e0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.409+0000 7ff54d1ee740 1 --2- 172.21.15.79:0/1660198826 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f17bb9880 0x564f17bce5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.409+0000 7ff54d1ee740 1 -- 172.21.15.79:0/1660198826 >> 172.21.15.79:0/1660198826 conn(0x564f17bb76b0 msgr2=0x564f17bc45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:50.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.409+0000 7ff523fff640 0 client.16935 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:41:50.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.410+0000 7ff54d1ee740 1 -- 172.21.15.79:0/1660198826 shutdown_connections 2024-08-20T01:41:50.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.410+0000 7ff54d1ee740 1 -- 172.21.15.79:0/1660198826 wait complete. 2024-08-20T01:41:50.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.410+0000 7ff54d1ee740 20 client.16935 trim_cache size 0 max 16384 2024-08-20T01:41:50.420 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:41:50.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.410+0000 7ff54adf5640 1 -- 172.21.15.79:0/245407420 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff5340b3bd0 msgr2=0x7ff5340b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:50.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.410+0000 7ff54adf5640 1 --2- 172.21.15.79:0/245407420 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff5340b3bd0 0x7ff5340b6090 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff53c009a60 tx=0x7ff53c03c040 comp rx=0 tx=0).stop 2024-08-20T01:41:50.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.410+0000 7ff54adf5640 1 -- 172.21.15.79:0/245407420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff544101590 msgr2=0x7ff54419b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:50.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.410+0000 7ff54adf5640 1 --2- 172.21.15.79:0/245407420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff544101590 0x7ff54419b130 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7ff53800d950 tx=0x7ff53800de10 comp rx=0 tx=0).stop 2024-08-20T01:41:50.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.411+0000 7ff54adf5640 1 -- 172.21.15.79:0/245407420 shutdown_connections 2024-08-20T01:41:50.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.411+0000 7ff54adf5640 1 --2- 172.21.15.79:0/245407420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff54410f140 0x7ff5441a0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.411+0000 7ff54adf5640 1 --2- 172.21.15.79:0/245407420 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff5340b3bd0 0x7ff5340b6090 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.411+0000 7ff54adf5640 1 --2- 172.21.15.79:0/245407420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff544101eb0 0x7ff54419b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.411+0000 7ff54adf5640 1 --2- 172.21.15.79:0/245407420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff544101590 0x7ff54419b130 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:50.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.411+0000 7ff54adf5640 1 -- 172.21.15.79:0/245407420 >> 172.21.15.79:0/245407420 conn(0x7ff5440fd400 msgr2=0x7ff5440ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:50.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.411+0000 7ff54adf5640 1 -- 172.21.15.79:0/245407420 shutdown_connections 2024-08-20T01:41:50.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:50.411+0000 7ff54adf5640 1 -- 172.21.15.79:0/245407420 wait complete. 2024-08-20T01:41:50.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:50 smithi081 ceph-mon[22209]: pgmap v482: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 30 MiB/s wr, 27 op/s 2024-08-20T01:41:50.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:50 smithi175 ceph-mon[22392]: pgmap v482: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 30 MiB/s wr, 27 op/s 2024-08-20T01:41:52.211 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T01:41:52.212 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T01:41:52.491 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:41:52.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:52 smithi081 ceph-mon[22209]: pgmap v483: 97 pgs: 97 active+clean; 6.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-08-20T01:41:52.616 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:52 smithi079 ceph-mon[18656]: pgmap v483: 97 pgs: 97 active+clean; 6.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-08-20T01:41:52.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:52 smithi175 ceph-mon[22392]: pgmap v483: 97 pgs: 97 active+clean; 6.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-08-20T01:41:53.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.000+0000 7fc6d6ec7640 1 -- 172.21.15.79:0/2539042627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6d0108e30 msgr2=0x7fc6d010f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:53.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.000+0000 7fc6d6ec7640 1 --2- 172.21.15.79:0/2539042627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6d0108e30 0x7fc6d010f630 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8009ca0 tx=0x7fc6c802a8c0 comp rx=0 tx=0).stop 2024-08-20T01:41:53.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.000+0000 7fc6d6ec7640 1 -- 172.21.15.79:0/2539042627 shutdown_connections 2024-08-20T01:41:53.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.000+0000 7fc6d6ec7640 1 --2- 172.21.15.79:0/2539042627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6d0108e30 0x7fc6d010f630 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:53.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.000+0000 7fc6d6ec7640 1 --2- 172.21.15.79:0/2539042627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6d01084b0 0x7fc6d01088f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:53.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.000+0000 7fc6d6ec7640 1 --2- 172.21.15.79:0/2539042627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6d0102aa0 0x7fc6d0102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:53.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.000+0000 7fc6d6ec7640 1 -- 172.21.15.79:0/2539042627 >> 172.21.15.79:0/2539042627 conn(0x7fc6d00fe550 msgr2=0x7fc6d0100970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:53.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.000+0000 7fc6d6ec7640 1 -- 172.21.15.79:0/2539042627 shutdown_connections 2024-08-20T01:41:53.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.000+0000 7fc6d6ec7640 1 -- 172.21.15.79:0/2539042627 wait complete. 2024-08-20T01:41:53.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.001+0000 7fc6d6ec7640 1 Processor -- start 2024-08-20T01:41:53.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.001+0000 7fc6d6ec7640 1 -- start start 2024-08-20T01:41:53.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.001+0000 7fc6d6ec7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6d0102aa0 0x7fc6d0198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:53.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.001+0000 7fc6d6ec7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6d01084b0 0x7fc6d0199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:53.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.001+0000 7fc6d6ec7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6d0108e30 0x7fc6d019e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:53.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.001+0000 7fc6d6ec7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d01129f0 con 0x7fc6d0108e30 2024-08-20T01:41:53.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.001+0000 7fc6d6ec7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d0112870 con 0x7fc6d0102aa0 2024-08-20T01:41:53.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.001+0000 7fc6d6ec7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d0112b70 con 0x7fc6d01084b0 2024-08-20T01:41:53.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.001+0000 7fc6d5464640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6d0108e30 0x7fc6d019e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:53.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.001+0000 7fc6d5464640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6d0108e30 0x7fc6d019e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53276/0 (socket says 172.21.15.79:53276) 2024-08-20T01:41:53.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.001+0000 7fc6d5464640 1 -- 172.21.15.79:0/1567765987 learned_addr learned my addr 172.21.15.79:0/1567765987 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:53.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.001+0000 7fc6cffff640 1 --2- 172.21.15.79:0/1567765987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6d01084b0 0x7fc6d0199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:53.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.001+0000 7fc6d4c63640 1 --2- 172.21.15.79:0/1567765987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6d0102aa0 0x7fc6d0198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:53.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.002+0000 7fc6d5464640 1 -- 172.21.15.79:0/1567765987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6d01084b0 msgr2=0x7fc6d0199400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:53.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.002+0000 7fc6d5464640 1 --2- 172.21.15.79:0/1567765987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6d01084b0 0x7fc6d0199400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:53.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.002+0000 7fc6d5464640 1 -- 172.21.15.79:0/1567765987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6d0102aa0 msgr2=0x7fc6d0198ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:53.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.002+0000 7fc6d5464640 1 --2- 172.21.15.79:0/1567765987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6d0102aa0 0x7fc6d0198ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:53.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.002+0000 7fc6d5464640 1 -- 172.21.15.79:0/1567765987 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6d019ef70 con 0x7fc6d0108e30 2024-08-20T01:41:53.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.002+0000 7fc6d4c63640 1 --2- 172.21.15.79:0/1567765987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6d0102aa0 0x7fc6d0198ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:41:53.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.002+0000 7fc6d5464640 1 --2- 172.21.15.79:0/1567765987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6d0108e30 0x7fc6d019e7a0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8005cc0 tx=0x7fc6c8032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:53.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.002+0000 7fc6cdffb640 1 -- 172.21.15.79:0/1567765987 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c8032e00 con 0x7fc6d0108e30 2024-08-20T01:41:53.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.002+0000 7fc6d6ec7640 1 -- 172.21.15.79:0/1567765987 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6d019f200 con 0x7fc6d0108e30 2024-08-20T01:41:53.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.002+0000 7fc6d6ec7640 1 -- 172.21.15.79:0/1567765987 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6d01a5920 con 0x7fc6d0108e30 2024-08-20T01:41:53.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.002+0000 7fc6cdffb640 1 -- 172.21.15.79:0/1567765987 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc6c80044d0 con 0x7fc6d0108e30 2024-08-20T01:41:53.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.002+0000 7fc6cdffb640 1 -- 172.21.15.79:0/1567765987 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c8030b90 con 0x7fc6d0108e30 2024-08-20T01:41:53.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.005+0000 7fc6cdffb640 1 -- 172.21.15.79:0/1567765987 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc6c8004680 con 0x7fc6d0108e30 2024-08-20T01:41:53.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.005+0000 7fc6d92c0740 1 Processor -- start 2024-08-20T01:41:53.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.005+0000 7fc6d92c0740 1 -- start start 2024-08-20T01:41:53.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.006+0000 7fc6d92c0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5599dd3283b0 0x5599dd328790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:53.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.006+0000 7fc6d92c0740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5599dd328cd0 0x5599dd334720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:53.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.006+0000 7fc6d92c0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599dd334c60 0x5599dd337050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:53.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.006+0000 7fc6d92c0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5599dd29e940 con 0x5599dd334c60 2024-08-20T01:41:53.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.006+0000 7fc6d92c0740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5599dd28de40 con 0x5599dd328cd0 2024-08-20T01:41:53.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.006+0000 7fc6d92c0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5599dd291e80 con 0x5599dd3283b0 2024-08-20T01:41:53.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.006+0000 7fc6cffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599dd334c60 0x5599dd337050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:53.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.006+0000 7fc6cffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599dd334c60 0x5599dd337050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53284/0 (socket says 172.21.15.79:53284) 2024-08-20T01:41:53.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.006+0000 7fc6cffff640 1 -- 172.21.15.79:0/660266093 learned_addr learned my addr 172.21.15.79:0/660266093 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:53.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.006+0000 7fc6d4c63640 1 --2- 172.21.15.79:0/660266093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5599dd328cd0 0x5599dd334720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:53.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.006+0000 7fc6cffff640 1 --2- 172.21.15.79:0/660266093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5599dd3283b0 0x5599dd328790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:53.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.006+0000 7fc6cdffb640 1 --2- 172.21.15.79:0/1567765987 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc6c00b3bd0 0x7fc6c00b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:53.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.006+0000 7fc6cffff640 1 -- 172.21.15.79:0/660266093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5599dd3283b0 msgr2=0x5599dd328790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:53.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.006+0000 7fc6cffff640 1 --2- 172.21.15.79:0/660266093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5599dd3283b0 0x5599dd328790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:53.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.006+0000 7fc6cffff640 1 -- 172.21.15.79:0/660266093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5599dd328cd0 msgr2=0x5599dd334720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:53.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.006+0000 7fc6cffff640 1 --2- 172.21.15.79:0/660266093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5599dd328cd0 0x5599dd334720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:53.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.006+0000 7fc6cffff640 1 -- 172.21.15.79:0/660266093 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599dd22a520 con 0x5599dd334c60 2024-08-20T01:41:53.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.006+0000 7fc6cdffb640 1 -- 172.21.15.79:0/1567765987 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc6c8105140 con 0x7fc6d0108e30 2024-08-20T01:41:53.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.006+0000 7fc6cffff640 1 --2- 172.21.15.79:0/660266093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599dd334c60 0x5599dd337050 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc009f80 tx=0x7fc6bc0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f9ddb456ad861dc server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:53.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.007+0000 7fc6baffd640 1 -- 172.21.15.79:0/660266093 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc017470 con 0x5599dd334c60 2024-08-20T01:41:53.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.007+0000 7fc6d5464640 1 --2- 172.21.15.79:0/1567765987 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc6c00b3bd0 0x7fc6c00b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:53.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.007+0000 7fc6baffd640 1 -- 172.21.15.79:0/660266093 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc6bc01c070 con 0x5599dd334c60 2024-08-20T01:41:53.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.007+0000 7fc6baffd640 1 -- 172.21.15.79:0/660266093 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc015820 con 0x5599dd334c60 2024-08-20T01:41:53.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.007+0000 7fc6d92c0740 1 -- 172.21.15.79:0/660266093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599dd334c60 msgr2=0x5599dd337050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:53.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.007+0000 7fc6d92c0740 1 --2- 172.21.15.79:0/660266093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599dd334c60 0x5599dd337050 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc009f80 tx=0x7fc6bc0095c0 comp rx=0 tx=0).stop 2024-08-20T01:41:53.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.007+0000 7fc6d5464640 1 --2- 172.21.15.79:0/1567765987 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc6c00b3bd0 0x7fc6c00b6090 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8009620 tx=0x7fc6c8032fa0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:53.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.007+0000 7fc6d92c0740 1 -- 172.21.15.79:0/660266093 shutdown_connections 2024-08-20T01:41:53.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.007+0000 7fc6d92c0740 1 --2- 172.21.15.79:0/660266093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599dd334c60 0x5599dd337050 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:53.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.007+0000 7fc6d92c0740 1 --2- 172.21.15.79:0/660266093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5599dd328cd0 0x5599dd334720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:53.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.007+0000 7fc6d92c0740 1 --2- 172.21.15.79:0/660266093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5599dd3283b0 0x5599dd328790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:53.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.007+0000 7fc6d92c0740 1 -- 172.21.15.79:0/660266093 >> 172.21.15.79:0/660266093 conn(0x5599dd3261e0 msgr2=0x5599dd327380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:53.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.007+0000 7fc6d92c0740 1 -- 172.21.15.79:0/660266093 shutdown_connections 2024-08-20T01:41:53.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.008+0000 7fc6d92c0740 1 -- 172.21.15.79:0/660266093 wait complete. 2024-08-20T01:41:53.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.008+0000 7fc6d92c0740 1 -- start start 2024-08-20T01:41:53.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.008+0000 7fc6d92c0740 1 Processor -- start 2024-08-20T01:41:53.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.008+0000 7fc6d92c0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599dd3283b0 0x5599dd331c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:53.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.008+0000 7fc6d92c0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5599dd328cd0 0x5599dd3321c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:53.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.008+0000 7fc6d92c0740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5599dd334c60 0x5599dd332700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:53.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.008+0000 7fc6d92c0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5599dd0f0890 con 0x5599dd3283b0 2024-08-20T01:41:53.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.009+0000 7fc6d92c0740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5599dd214700 con 0x5599dd334c60 2024-08-20T01:41:53.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.009+0000 7fc6d92c0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5599dd3379b0 con 0x5599dd328cd0 2024-08-20T01:41:53.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.009+0000 7fc6d92c0740 10 client.0 _ll_register_callbacks cb 0x5599dd2896f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:53.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.009+0000 7fc6cffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599dd3283b0 0x5599dd331c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:53.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.009+0000 7fc6cffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599dd3283b0 0x5599dd331c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53290/0 (socket says 172.21.15.79:53290) 2024-08-20T01:41:53.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.009+0000 7fc6cffff640 1 -- 172.21.15.79:0/2422217630 learned_addr learned my addr 172.21.15.79:0/2422217630 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:53.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.009+0000 7fc6d4c63640 1 --2- 172.21.15.79:0/2422217630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5599dd328cd0 0x5599dd3321c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:53.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.009+0000 7fc6cffff640 1 --2- 172.21.15.79:0/2422217630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5599dd334c60 0x5599dd332700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:53.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.009+0000 7fc6cffff640 1 -- 172.21.15.79:0/2422217630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5599dd328cd0 msgr2=0x5599dd3321c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:53.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.009+0000 7fc6cffff640 1 --2- 172.21.15.79:0/2422217630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5599dd328cd0 0x5599dd3321c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:53.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.009+0000 7fc6cffff640 1 -- 172.21.15.79:0/2422217630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5599dd334c60 msgr2=0x5599dd332700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:53.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.009+0000 7fc6cffff640 1 --2- 172.21.15.79:0/2422217630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5599dd334c60 0x5599dd332700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:53.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.009+0000 7fc6cffff640 1 -- 172.21.15.79:0/2422217630 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599dcfed930 con 0x5599dd3283b0 2024-08-20T01:41:53.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.009+0000 7fc6d4c63640 1 --2- 172.21.15.79:0/2422217630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5599dd328cd0 0x5599dd3321c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:41:53.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.009+0000 7fc6cffff640 1 --2- 172.21.15.79:0/2422217630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599dd3283b0 0x5599dd331c80 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc00a010 tx=0x7fc6bc0154e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8dd626c395ec3ae server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:53.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.009+0000 7fc6affff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:41:53.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.009+0000 7fc6affff640 1 -- 172.21.15.79:0/2422217630 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc02a060 con 0x5599dd3283b0 2024-08-20T01:41:53.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.009+0000 7fc6affff640 1 -- 172.21.15.79:0/2422217630 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc6bc005bc0 con 0x5599dd3283b0 2024-08-20T01:41:53.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.009+0000 7fc6d92c0740 1 -- 172.21.15.79:0/2422217630 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6bc01c070 con 0x5599dd3283b0 2024-08-20T01:41:53.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.010+0000 7fc6affff640 1 -- 172.21.15.79:0/2422217630 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fc6bc005dc0 con 0x5599dd3283b0 2024-08-20T01:41:53.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.010+0000 7fc6d92c0740 10 client.16947 fetch_fsmap learned FSMap version 38 2024-08-20T01:41:53.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.010+0000 7fc6d92c0740 1 -- 172.21.15.79:0/2422217630 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5599dd3435f0 con 0x5599dd3283b0 2024-08-20T01:41:53.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.010+0000 7fc6affff640 1 -- 172.21.15.79:0/2422217630 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc6bc01c070 con 0x5599dd3283b0 2024-08-20T01:41:53.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.010+0000 7fc6affff640 1 -- 172.21.15.79:0/2422217630 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7fc6bc0156e0 con 0x5599dd3283b0 2024-08-20T01:41:53.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.010+0000 7fc6d92c0740 10 client.16947 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:41:53.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.010+0000 7fc6d92c0740 10 client.16947 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:41:53.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.010+0000 7fc6d92c0740 20 client.16947 populate_metadata read hostname 'smithi079' 2024-08-20T01:41:53.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.010+0000 7fc6d92c0740 1 --2- 172.21.15.79:0/2422217630 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5599dd344a50 0x5599dd346e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:53.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.010+0000 7fc6d92c0740 4 client.16947 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:41:53.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.010+0000 7fc6d92c0740 1 -- 172.21.15.79:0/2422217630 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599dd2a0890 con 0x5599dd344a50 2024-08-20T01:41:53.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.010+0000 7fc6d4c63640 1 --2- 172.21.15.79:0/2422217630 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5599dd344a50 0x5599dd346e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:53.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.011+0000 7fc6affff640 10 client.16947 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:41:53.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.011+0000 7fc6d4c63640 1 --2- 172.21.15.79:0/2422217630 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5599dd344a50 0x5599dd346e40 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=975c149cdf2cb32f server_cookie=edd1006fb1a6f4ce in_seq=0 out_seq=0 2024-08-20T01:41:53.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.011+0000 7fc6affff640 1 -- 172.21.15.79:0/2422217630 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5599dd2a0890 con 0x5599dd344a50 2024-08-20T01:41:53.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.011+0000 7fc6affff640 10 client.16947 handle_command_reply: tid=0 2024-08-20T01:41:53.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.011+0000 7fc6d92c0740 1 client.16947 shutdown 2024-08-20T01:41:53.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.012+0000 7fc6d92c0740 1 -- 172.21.15.79:0/2422217630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599dd3283b0 msgr2=0x5599dd331c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:53.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.012+0000 7fc6d92c0740 1 --2- 172.21.15.79:0/2422217630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599dd3283b0 0x5599dd331c80 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc00a010 tx=0x7fc6bc0154e0 comp rx=0 tx=0).stop 2024-08-20T01:41:53.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.012+0000 7fc6d92c0740 1 -- 172.21.15.79:0/2422217630 shutdown_connections 2024-08-20T01:41:53.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.012+0000 7fc6d92c0740 1 --2- 172.21.15.79:0/2422217630 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5599dd344a50 0x5599dd346e40 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:53.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.012+0000 7fc6d92c0740 1 --2- 172.21.15.79:0/2422217630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5599dd334c60 0x5599dd332700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:53.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.012+0000 7fc6d92c0740 1 --2- 172.21.15.79:0/2422217630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5599dd328cd0 0x5599dd3321c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:53.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.012+0000 7fc6d92c0740 1 --2- 172.21.15.79:0/2422217630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599dd3283b0 0x5599dd331c80 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:53.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.012+0000 7fc6affff640 0 client.16947 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:41:53.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.012+0000 7fc6d92c0740 1 -- 172.21.15.79:0/2422217630 >> 172.21.15.79:0/2422217630 conn(0x5599dd3261e0 msgr2=0x5599dd32bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:53.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.012+0000 7fc6d92c0740 1 -- 172.21.15.79:0/2422217630 shutdown_connections 2024-08-20T01:41:53.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.012+0000 7fc6d92c0740 1 -- 172.21.15.79:0/2422217630 wait complete. 2024-08-20T01:41:53.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.012+0000 7fc6d92c0740 20 client.16947 trim_cache size 0 max 16384 2024-08-20T01:41:53.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.031+0000 7fc6d92c0740 1 Processor -- start 2024-08-20T01:41:53.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.031+0000 7fc6d92c0740 1 -- start start 2024-08-20T01:41:53.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.031+0000 7fc6d92c0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5599dd3283b0 0x5599dd34c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:53.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.031+0000 7fc6d92c0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599dd328cd0 0x5599dd34c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:53.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.031+0000 7fc6d92c0740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5599dd334c60 0x5599dd32ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:53.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.031+0000 7fc6d92c0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d01abd80 con 0x5599dd328cd0 2024-08-20T01:41:53.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.031+0000 7fc6d92c0740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d01ad8c0 con 0x5599dd334c60 2024-08-20T01:41:53.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.031+0000 7fc6d92c0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d01ac450 con 0x5599dd3283b0 2024-08-20T01:41:53.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.031+0000 7fc6d4c63640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599dd328cd0 0x5599dd34c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:53.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.031+0000 7fc6d4c63640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599dd328cd0 0x5599dd34c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53294/0 (socket says 172.21.15.79:53294) 2024-08-20T01:41:53.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.031+0000 7fc6d4c63640 1 -- 172.21.15.79:0/2039139757 learned_addr learned my addr 172.21.15.79:0/2039139757 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:53.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.031+0000 7fc6cffff640 1 --2- 172.21.15.79:0/2039139757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5599dd3283b0 0x5599dd34c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:53.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.031+0000 7fc6cffff640 1 --2- 172.21.15.79:0/2039139757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5599dd334c60 0x5599dd32ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:53.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.031+0000 7fc6d4c63640 1 -- 172.21.15.79:0/2039139757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5599dd3283b0 msgr2=0x5599dd34c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:53.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.031+0000 7fc6d4c63640 1 --2- 172.21.15.79:0/2039139757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5599dd3283b0 0x5599dd34c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:53.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.031+0000 7fc6d4c63640 1 -- 172.21.15.79:0/2039139757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5599dd334c60 msgr2=0x5599dd32ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:53.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.031+0000 7fc6d4c63640 1 --2- 172.21.15.79:0/2039139757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5599dd334c60 0x5599dd32ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:53.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.031+0000 7fc6d4c63640 1 -- 172.21.15.79:0/2039139757 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599dd321b10 con 0x5599dd328cd0 2024-08-20T01:41:53.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.032+0000 7fc6d4c63640 1 --2- 172.21.15.79:0/2039139757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599dd328cd0 0x5599dd34c950 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x5599dd3473b0 tx=0x7fc6c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6d0447e2b43f4e7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:53.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.032+0000 7fc6ba7fc640 1 -- 172.21.15.79:0/2039139757 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c4004030 con 0x5599dd328cd0 2024-08-20T01:41:53.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.032+0000 7fc6ba7fc640 1 -- 172.21.15.79:0/2039139757 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc6c40035f0 con 0x5599dd328cd0 2024-08-20T01:41:53.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.032+0000 7fc6ba7fc640 1 -- 172.21.15.79:0/2039139757 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c40106d0 con 0x5599dd328cd0 2024-08-20T01:41:53.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.033+0000 7fc6d92c0740 1 -- 172.21.15.79:0/2039139757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599dd328cd0 msgr2=0x5599dd34c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:53.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.033+0000 7fc6d92c0740 1 --2- 172.21.15.79:0/2039139757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599dd328cd0 0x5599dd34c950 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x5599dd3473b0 tx=0x7fc6c40046c0 comp rx=0 tx=0).stop 2024-08-20T01:41:53.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.033+0000 7fc6d92c0740 1 -- 172.21.15.79:0/2039139757 shutdown_connections 2024-08-20T01:41:53.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.033+0000 7fc6d92c0740 1 --2- 172.21.15.79:0/2039139757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5599dd334c60 0x5599dd32ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:53.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.033+0000 7fc6d92c0740 1 --2- 172.21.15.79:0/2039139757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599dd328cd0 0x5599dd34c950 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:53.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.033+0000 7fc6d92c0740 1 --2- 172.21.15.79:0/2039139757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5599dd3283b0 0x5599dd34c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:53.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.033+0000 7fc6d92c0740 1 -- 172.21.15.79:0/2039139757 >> 172.21.15.79:0/2039139757 conn(0x5599dd3261e0 msgr2=0x5599dd333ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:53.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.033+0000 7fc6d92c0740 1 -- 172.21.15.79:0/2039139757 shutdown_connections 2024-08-20T01:41:53.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.033+0000 7fc6d92c0740 1 -- 172.21.15.79:0/2039139757 wait complete. 2024-08-20T01:41:53.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.033+0000 7fc6d92c0740 1 -- start start 2024-08-20T01:41:53.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.033+0000 7fc6d92c0740 1 Processor -- start 2024-08-20T01:41:53.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.034+0000 7fc6d92c0740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5599dd3283b0 0x5599dd338b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:53.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.034+0000 7fc6d92c0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5599dd328cd0 0x5599dd3390c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:53.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.034+0000 7fc6d92c0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599dd334c60 0x5599dd339600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:53.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.034+0000 7fc6d92c0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d01ad1f0 con 0x5599dd334c60 2024-08-20T01:41:53.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.034+0000 7fc6d92c0740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d01acb20 con 0x5599dd3283b0 2024-08-20T01:41:53.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.034+0000 7fc6d92c0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d01a9d60 con 0x5599dd328cd0 2024-08-20T01:41:53.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.034+0000 7fc6d92c0740 10 client.0 _ll_register_callbacks cb 0x7fc6c400b440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:53.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.034+0000 7fc6cffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599dd334c60 0x5599dd339600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:53.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.034+0000 7fc6cffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599dd334c60 0x5599dd339600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53306/0 (socket says 172.21.15.79:53306) 2024-08-20T01:41:53.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.034+0000 7fc6cffff640 1 -- 172.21.15.79:0/3243156123 learned_addr learned my addr 172.21.15.79:0/3243156123 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:53.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.034+0000 7fc6d4c63640 1 --2- 172.21.15.79:0/3243156123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5599dd328cd0 0x5599dd3390c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:53.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.034+0000 7fc6cffff640 1 --2- 172.21.15.79:0/3243156123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5599dd3283b0 0x5599dd338b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:53.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.034+0000 7fc6cffff640 1 -- 172.21.15.79:0/3243156123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5599dd328cd0 msgr2=0x5599dd3390c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:53.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.034+0000 7fc6cffff640 1 --2- 172.21.15.79:0/3243156123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5599dd328cd0 0x5599dd3390c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:53.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.034+0000 7fc6cffff640 1 -- 172.21.15.79:0/3243156123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5599dd3283b0 msgr2=0x5599dd338b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:53.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.034+0000 7fc6cffff640 1 --2- 172.21.15.79:0/3243156123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5599dd3283b0 0x5599dd338b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:53.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.034+0000 7fc6cffff640 1 -- 172.21.15.79:0/3243156123 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599dd3ae4e0 con 0x5599dd334c60 2024-08-20T01:41:53.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.034+0000 7fc6cffff640 1 --2- 172.21.15.79:0/3243156123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599dd334c60 0x5599dd339600 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc015ca0 tx=0x7fc6bc0154e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3fa8bf53c3203c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:53.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.034+0000 7fc6affff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:41:53.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.035+0000 7fc6affff640 1 -- 172.21.15.79:0/3243156123 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc035070 con 0x5599dd334c60 2024-08-20T01:41:53.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.035+0000 7fc6affff640 1 -- 172.21.15.79:0/3243156123 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc6bc005bc0 con 0x5599dd334c60 2024-08-20T01:41:53.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.035+0000 7fc6d92c0740 1 -- 172.21.15.79:0/3243156123 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6c40035f0 con 0x5599dd334c60 2024-08-20T01:41:53.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.035+0000 7fc6affff640 1 -- 172.21.15.79:0/3243156123 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fc6bc02a040 con 0x5599dd334c60 2024-08-20T01:41:53.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.035+0000 7fc6d92c0740 10 client.16953 fetch_fsmap learned FSMap version 38 2024-08-20T01:41:53.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.035+0000 7fc6d92c0740 1 -- 172.21.15.79:0/3243156123 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5599dd3af820 con 0x5599dd334c60 2024-08-20T01:41:53.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.035+0000 7fc6affff640 1 -- 172.21.15.79:0/3243156123 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc6c40035f0 con 0x5599dd334c60 2024-08-20T01:41:53.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.035+0000 7fc6affff640 1 -- 172.21.15.79:0/3243156123 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7fc6bc0063c0 con 0x5599dd334c60 2024-08-20T01:41:53.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.035+0000 7fc6d92c0740 10 client.16953 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:41:53.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.035+0000 7fc6d92c0740 10 client.16953 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:41:53.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.035+0000 7fc6d92c0740 20 client.16953 populate_metadata read hostname 'smithi079' 2024-08-20T01:41:53.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.035+0000 7fc6d92c0740 1 --2- 172.21.15.79:0/3243156123 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5599dd3afe50 0x5599dd3b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:53.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.035+0000 7fc6d92c0740 4 client.16953 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T01:41:53.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.035+0000 7fc6d92c0740 1 -- 172.21.15.79:0/3243156123 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5599dd29c330 con 0x5599dd3afe50 2024-08-20T01:41:53.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.036+0000 7fc6d4c63640 1 --2- 172.21.15.79:0/3243156123 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5599dd3afe50 0x5599dd3b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:53.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.036+0000 7fc6d4c63640 1 --2- 172.21.15.79:0/3243156123 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5599dd3afe50 0x5599dd3b2270 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=697b73fdaa0bf438 server_cookie=69cd01757d03413c in_seq=0 out_seq=0 2024-08-20T01:41:53.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.036+0000 7fc6affff640 10 client.16953 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:41:53.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.037+0000 7fc6affff640 1 -- 172.21.15.79:0/3243156123 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5599dd29c330 con 0x5599dd3afe50 2024-08-20T01:41:53.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.037+0000 7fc6affff640 10 client.16953 handle_command_reply: tid=0 2024-08-20T01:41:53.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.037+0000 7fc6d92c0740 1 client.16953 shutdown 2024-08-20T01:41:53.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.037+0000 7fc6d92c0740 1 -- 172.21.15.79:0/3243156123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599dd334c60 msgr2=0x5599dd339600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:53.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.037+0000 7fc6d92c0740 1 --2- 172.21.15.79:0/3243156123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599dd334c60 0x5599dd339600 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc015ca0 tx=0x7fc6bc0154e0 comp rx=0 tx=0).stop 2024-08-20T01:41:53.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.037+0000 7fc6d92c0740 1 -- 172.21.15.79:0/3243156123 shutdown_connections 2024-08-20T01:41:53.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.037+0000 7fc6d92c0740 1 --2- 172.21.15.79:0/3243156123 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5599dd3afe50 0x5599dd3b2270 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:53.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.037+0000 7fc6d92c0740 1 --2- 172.21.15.79:0/3243156123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5599dd334c60 0x5599dd339600 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:53.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.037+0000 7fc6d92c0740 1 --2- 172.21.15.79:0/3243156123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5599dd328cd0 0x5599dd3390c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:53.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.037+0000 7fc6affff640 0 client.16953 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:41:53.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.037+0000 7fc6d92c0740 1 --2- 172.21.15.79:0/3243156123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5599dd3283b0 0x5599dd338b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:53.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.037+0000 7fc6d92c0740 1 -- 172.21.15.79:0/3243156123 >> 172.21.15.79:0/3243156123 conn(0x5599dd3261e0 msgr2=0x5599dd32b560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:53.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.037+0000 7fc6d92c0740 1 -- 172.21.15.79:0/3243156123 shutdown_connections 2024-08-20T01:41:53.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.037+0000 7fc6d92c0740 1 -- 172.21.15.79:0/3243156123 wait complete. 2024-08-20T01:41:53.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.038+0000 7fc6d92c0740 20 client.16953 trim_cache size 0 max 16384 2024-08-20T01:41:53.054 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:41:53.054 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-08-20T01:41:53.055 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "eeb36d0f-bf8f-4ebe-9898-6b8483a68a60", 2024-08-20T01:41:53.055 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-08-20T01:41:53.055 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:41:53.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.038+0000 7fc6d6ec7640 1 -- 172.21.15.79:0/1567765987 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc6c00b3bd0 msgr2=0x7fc6c00b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:53.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.038+0000 7fc6d6ec7640 1 --2- 172.21.15.79:0/1567765987 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc6c00b3bd0 0x7fc6c00b6090 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8009620 tx=0x7fc6c8032fa0 comp rx=0 tx=0).stop 2024-08-20T01:41:53.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.038+0000 7fc6d6ec7640 1 -- 172.21.15.79:0/1567765987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6d0108e30 msgr2=0x7fc6d019e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:53.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.038+0000 7fc6d6ec7640 1 --2- 172.21.15.79:0/1567765987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6d0108e30 0x7fc6d019e7a0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8005cc0 tx=0x7fc6c8032a10 comp rx=0 tx=0).stop 2024-08-20T01:41:53.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.038+0000 7fc6d6ec7640 1 -- 172.21.15.79:0/1567765987 shutdown_connections 2024-08-20T01:41:53.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.038+0000 7fc6d6ec7640 1 --2- 172.21.15.79:0/1567765987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6d0108e30 0x7fc6d019e7a0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:53.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.038+0000 7fc6d6ec7640 1 --2- 172.21.15.79:0/1567765987 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc6c00b3bd0 0x7fc6c00b6090 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:53.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.038+0000 7fc6d6ec7640 1 --2- 172.21.15.79:0/1567765987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6d01084b0 0x7fc6d0199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:53.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.038+0000 7fc6d6ec7640 1 --2- 172.21.15.79:0/1567765987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6d0102aa0 0x7fc6d0198ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:53.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.038+0000 7fc6d6ec7640 1 -- 172.21.15.79:0/1567765987 >> 172.21.15.79:0/1567765987 conn(0x7fc6d00fe550 msgr2=0x7fc6d0100940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:53.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.038+0000 7fc6d6ec7640 1 -- 172.21.15.79:0/1567765987 shutdown_connections 2024-08-20T01:41:53.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:53.038+0000 7fc6d6ec7640 1 -- 172.21.15.79:0/1567765987 wait complete. 2024-08-20T01:41:53.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:53 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:41:53.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:53 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:53.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:53 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:41:53.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:53 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:53.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:53 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:41:53.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:53 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:53.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:53 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:41:53.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:53 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:53.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:53 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:41:53.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:53 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:53.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:53 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:41:53.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:53 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:53.649 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:53 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:41:53.649 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:53 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:53.649 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:53 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:41:53.649 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:53 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:53.649 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:53 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:41:53.649 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:53 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:53.883 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:41:54.150 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:41:54.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:54 smithi081 ceph-mon[22209]: pgmap v484: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-08-20T01:41:54.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:54 smithi081 ceph-mon[22209]: scrub queued for path: / 2024-08-20T01:41:54.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:54 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:54.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:54 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:41:54.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:54 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:41:54.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:54 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:54.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:54 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:41:54.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:54 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:41:54.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:54 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:54.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:54 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:54.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:54 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:54.584 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:54 smithi079 ceph-mon[18656]: pgmap v484: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-08-20T01:41:54.584 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:54 smithi079 ceph-mon[18656]: scrub queued for path: / 2024-08-20T01:41:54.584 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:54 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:54.584 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:54 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:41:54.584 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:54 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:41:54.584 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:54 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:54.584 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:54 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:41:54.584 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:54 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:41:54.584 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:54 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:54.585 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:54 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:54.585 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:54 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:54.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:54 smithi175 ceph-mon[22392]: pgmap v484: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-08-20T01:41:54.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:54 smithi175 ceph-mon[22392]: scrub queued for path: / 2024-08-20T01:41:54.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:54 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:54.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:54 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:41:54.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:54 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:41:54.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:54 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:54.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:54 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:41:54.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:54 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:41:54.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:54 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:54.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:54 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:54.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:54 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:41:54.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.669+0000 7fc77af8b640 1 -- 172.21.15.79:0/937758560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc774101eb0 msgr2=0x7fc77410ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:54.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.669+0000 7fc77af8b640 1 --2- 172.21.15.79:0/937758560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc774101eb0 0x7fc77410ec00 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fc760009900 tx=0x7fc76002a480 comp rx=0 tx=0).stop 2024-08-20T01:41:54.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.669+0000 7fc77af8b640 1 -- 172.21.15.79:0/937758560 shutdown_connections 2024-08-20T01:41:54.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.669+0000 7fc77af8b640 1 --2- 172.21.15.79:0/937758560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc77410f140 0x7fc774111530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.669+0000 7fc77af8b640 1 --2- 172.21.15.79:0/937758560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc774101eb0 0x7fc77410ec00 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.669+0000 7fc77af8b640 1 --2- 172.21.15.79:0/937758560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc774101590 0x7fc774101970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.669+0000 7fc77af8b640 1 -- 172.21.15.79:0/937758560 >> 172.21.15.79:0/937758560 conn(0x7fc7740fd400 msgr2=0x7fc7740ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:54.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.669+0000 7fc77af8b640 1 -- 172.21.15.79:0/937758560 shutdown_connections 2024-08-20T01:41:54.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.669+0000 7fc77af8b640 1 -- 172.21.15.79:0/937758560 wait complete. 2024-08-20T01:41:54.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.670+0000 7fc77af8b640 1 Processor -- start 2024-08-20T01:41:54.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.670+0000 7fc77af8b640 1 -- start start 2024-08-20T01:41:54.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.670+0000 7fc77af8b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc774101590 0x7fc77419b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:54.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.670+0000 7fc77af8b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc774101eb0 0x7fc77419b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:54.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.670+0000 7fc77af8b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc77410f140 0x7fc7741a0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:54.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.670+0000 7fc77af8b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc774114b30 con 0x7fc774101590 2024-08-20T01:41:54.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.670+0000 7fc77af8b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc7741149b0 con 0x7fc77410f140 2024-08-20T01:41:54.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.670+0000 7fc77af8b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc774114cb0 con 0x7fc774101eb0 2024-08-20T01:41:54.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.670+0000 7fc778d27640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc774101590 0x7fc77419b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:54.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.670+0000 7fc778d27640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc774101590 0x7fc77419b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53330/0 (socket says 172.21.15.79:53330) 2024-08-20T01:41:54.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.670+0000 7fc778d27640 1 -- 172.21.15.79:0/2917871413 learned_addr learned my addr 172.21.15.79:0/2917871413 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:54.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.670+0000 7fc773fff640 1 --2- 172.21.15.79:0/2917871413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc774101eb0 0x7fc77419b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:54.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.670+0000 7fc779528640 1 --2- 172.21.15.79:0/2917871413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc77410f140 0x7fc7741a0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:54.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.671+0000 7fc778d27640 1 -- 172.21.15.79:0/2917871413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc774101eb0 msgr2=0x7fc77419b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:54.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.671+0000 7fc778d27640 1 --2- 172.21.15.79:0/2917871413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc774101eb0 0x7fc77419b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.671+0000 7fc778d27640 1 -- 172.21.15.79:0/2917871413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc77410f140 msgr2=0x7fc7741a0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:54.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.671+0000 7fc778d27640 1 --2- 172.21.15.79:0/2917871413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc77410f140 0x7fc7741a0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.671+0000 7fc778d27640 1 -- 172.21.15.79:0/2917871413 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7741a1130 con 0x7fc774101590 2024-08-20T01:41:54.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.671+0000 7fc778d27640 1 --2- 172.21.15.79:0/2917871413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc774101590 0x7fc77419b080 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fc76800d950 tx=0x7fc76800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:54.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.671+0000 7fc771ffb640 1 -- 172.21.15.79:0/2917871413 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc768017070 con 0x7fc774101590 2024-08-20T01:41:54.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.671+0000 7fc771ffb640 1 -- 172.21.15.79:0/2917871413 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc768009c30 con 0x7fc774101590 2024-08-20T01:41:54.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.671+0000 7fc77af8b640 1 -- 172.21.15.79:0/2917871413 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7741a1420 con 0x7fc774101590 2024-08-20T01:41:54.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.671+0000 7fc771ffb640 1 -- 172.21.15.79:0/2917871413 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76800f620 con 0x7fc774101590 2024-08-20T01:41:54.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.672+0000 7fc77af8b640 1 -- 172.21.15.79:0/2917871413 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7741a7cb0 con 0x7fc774101590 2024-08-20T01:41:54.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.674+0000 7fc771ffb640 1 -- 172.21.15.79:0/2917871413 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc768005070 con 0x7fc774101590 2024-08-20T01:41:54.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.675+0000 7fc77d384740 1 Processor -- start 2024-08-20T01:41:54.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.675+0000 7fc77d384740 1 -- start start 2024-08-20T01:41:54.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.675+0000 7fc77d384740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d52d504830 0x55d52d504c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:54.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.675+0000 7fc77d384740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d52d505150 0x55d52d510ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:54.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.675+0000 7fc771ffb640 1 --2- 172.21.15.79:0/2917871413 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc7640b3c50 0x7fc7640b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:54.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.675+0000 7fc77d384740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d52d5110e0 0x55d52d5134d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:54.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.675+0000 7fc77d384740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d52d47b8e0 con 0x55d52d504830 2024-08-20T01:41:54.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.675+0000 7fc77d384740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d52d46ade0 con 0x55d52d505150 2024-08-20T01:41:54.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.675+0000 7fc77d384740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d52d46ee20 con 0x55d52d5110e0 2024-08-20T01:41:54.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.675+0000 7fc779528640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d52d504830 0x55d52d504c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:54.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.675+0000 7fc779528640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d52d504830 0x55d52d504c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53336/0 (socket says 172.21.15.79:53336) 2024-08-20T01:41:54.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.675+0000 7fc779528640 1 -- 172.21.15.79:0/2093801438 learned_addr learned my addr 172.21.15.79:0/2093801438 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:54.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.675+0000 7fc773fff640 1 --2- 172.21.15.79:0/2917871413 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc7640b3c50 0x7fc7640b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:54.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.675+0000 7fc779528640 1 --2- 172.21.15.79:0/2093801438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d52d5110e0 0x55d52d5134d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:54.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.675+0000 7fc779528640 1 -- 172.21.15.79:0/2093801438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d52d5110e0 msgr2=0x55d52d5134d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:54.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.675+0000 7fc779528640 1 --2- 172.21.15.79:0/2093801438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d52d5110e0 0x55d52d5134d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.675+0000 7fc779528640 1 -- 172.21.15.79:0/2093801438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d52d505150 msgr2=0x55d52d510ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:54.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.675+0000 7fc771ffb640 1 -- 172.21.15.79:0/2917871413 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc7680e2fa0 con 0x7fc774101590 2024-08-20T01:41:54.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.675+0000 7fc778d27640 1 --2- 172.21.15.79:0/2093801438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d52d505150 0x55d52d510ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:54.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.675+0000 7fc779528640 1 --2- 172.21.15.79:0/2093801438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d52d505150 0x55d52d510ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.676+0000 7fc779528640 1 -- 172.21.15.79:0/2093801438 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d52d1ca650 con 0x55d52d504830 2024-08-20T01:41:54.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.676+0000 7fc778d27640 1 --2- 172.21.15.79:0/2093801438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d52d505150 0x55d52d510ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:41:54.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.676+0000 7fc779528640 1 --2- 172.21.15.79:0/2093801438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d52d504830 0x55d52d504c10 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fc76c005c20 tx=0x7fc76c007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2679c31c6e0aa681 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:54.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.676+0000 7fc773fff640 1 --2- 172.21.15.79:0/2917871413 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc7640b3c50 0x7fc7640b6110 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc7600057c0 tx=0x7fc7600058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:54.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.676+0000 7fc75effd640 1 -- 172.21.15.79:0/2093801438 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76c011960 con 0x55d52d504830 2024-08-20T01:41:54.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.676+0000 7fc75effd640 1 -- 172.21.15.79:0/2093801438 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc76c024070 con 0x55d52d504830 2024-08-20T01:41:54.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.676+0000 7fc75effd640 1 -- 172.21.15.79:0/2093801438 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76c00f680 con 0x55d52d504830 2024-08-20T01:41:54.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.677+0000 7fc77d384740 1 -- 172.21.15.79:0/2093801438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d52d504830 msgr2=0x55d52d504c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:54.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.677+0000 7fc77d384740 1 --2- 172.21.15.79:0/2093801438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d52d504830 0x55d52d504c10 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fc76c005c20 tx=0x7fc76c007a50 comp rx=0 tx=0).stop 2024-08-20T01:41:54.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.677+0000 7fc77d384740 1 -- 172.21.15.79:0/2093801438 shutdown_connections 2024-08-20T01:41:54.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.677+0000 7fc77d384740 1 --2- 172.21.15.79:0/2093801438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d52d5110e0 0x55d52d5134d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.677+0000 7fc77d384740 1 --2- 172.21.15.79:0/2093801438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d52d505150 0x55d52d510ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.677+0000 7fc77d384740 1 --2- 172.21.15.79:0/2093801438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d52d504830 0x55d52d504c10 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.677+0000 7fc77d384740 1 -- 172.21.15.79:0/2093801438 >> 172.21.15.79:0/2093801438 conn(0x55d52d502660 msgr2=0x55d52d503800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:54.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.677+0000 7fc77d384740 1 -- 172.21.15.79:0/2093801438 shutdown_connections 2024-08-20T01:41:54.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.677+0000 7fc77d384740 1 -- 172.21.15.79:0/2093801438 wait complete. 2024-08-20T01:41:54.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.677+0000 7fc77d384740 1 -- start start 2024-08-20T01:41:54.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.677+0000 7fc77d384740 1 Processor -- start 2024-08-20T01:41:54.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.678+0000 7fc77d384740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d52d504830 0x55d52d50e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:54.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.678+0000 7fc77d384740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d52d505150 0x55d52d50e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:54.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.678+0000 7fc77d384740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d52d5110e0 0x55d52d50eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:54.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.678+0000 7fc77d384740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d52d2cd700 con 0x55d52d505150 2024-08-20T01:41:54.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.678+0000 7fc77d384740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d52d3f17c0 con 0x55d52d5110e0 2024-08-20T01:41:54.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.678+0000 7fc77d384740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d52d513d90 con 0x55d52d504830 2024-08-20T01:41:54.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.678+0000 7fc773fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d52d505150 0x55d52d50e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:54.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.678+0000 7fc773fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d52d505150 0x55d52d50e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53352/0 (socket says 172.21.15.79:53352) 2024-08-20T01:41:54.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.678+0000 7fc773fff640 1 -- 172.21.15.79:0/1944756737 learned_addr learned my addr 172.21.15.79:0/1944756737 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:54.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.678+0000 7fc77d384740 10 client.0 _ll_register_callbacks cb 0x55d52d4646b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:54.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.678+0000 7fc778d27640 1 --2- 172.21.15.79:0/1944756737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d52d504830 0x55d52d50e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:54.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.678+0000 7fc779528640 1 --2- 172.21.15.79:0/1944756737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d52d5110e0 0x55d52d50eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:54.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.678+0000 7fc773fff640 1 -- 172.21.15.79:0/1944756737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d52d504830 msgr2=0x55d52d50e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:54.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.678+0000 7fc773fff640 1 --2- 172.21.15.79:0/1944756737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d52d504830 0x55d52d50e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.678+0000 7fc773fff640 1 -- 172.21.15.79:0/1944756737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d52d5110e0 msgr2=0x55d52d50eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:54.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.678+0000 7fc773fff640 1 --2- 172.21.15.79:0/1944756737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d52d5110e0 0x55d52d50eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.678+0000 7fc773fff640 1 -- 172.21.15.79:0/1944756737 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d52d51d250 con 0x55d52d505150 2024-08-20T01:41:54.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.678+0000 7fc779528640 1 --2- 172.21.15.79:0/1944756737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d52d5110e0 0x55d52d50eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:41:54.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.678+0000 7fc773fff640 1 --2- 172.21.15.79:0/1944756737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d52d505150 0x55d52d50e650 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fc760009900 tx=0x7fc76002a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5e92197c196f3aa server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:54.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.678+0000 7fc753fff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:41:54.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.679+0000 7fc753fff640 1 -- 172.21.15.79:0/1944756737 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76004c030 con 0x55d52d505150 2024-08-20T01:41:54.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.679+0000 7fc753fff640 1 -- 172.21.15.79:0/1944756737 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc7600035f0 con 0x55d52d505150 2024-08-20T01:41:54.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.679+0000 7fc77d384740 1 -- 172.21.15.79:0/1944756737 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d52d41a100 con 0x55d52d505150 2024-08-20T01:41:54.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.679+0000 7fc753fff640 1 -- 172.21.15.79:0/1944756737 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fc760035050 con 0x55d52d505150 2024-08-20T01:41:54.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.679+0000 7fc77d384740 10 client.16965 fetch_fsmap learned FSMap version 38 2024-08-20T01:41:54.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.679+0000 7fc77d384740 1 -- 172.21.15.79:0/1944756737 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55d52d51fb50 con 0x55d52d505150 2024-08-20T01:41:54.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.679+0000 7fc753fff640 1 -- 172.21.15.79:0/1944756737 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55d52d41a100 con 0x55d52d505150 2024-08-20T01:41:54.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.679+0000 7fc753fff640 1 -- 172.21.15.79:0/1944756737 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7fc760048820 con 0x55d52d505150 2024-08-20T01:41:54.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.679+0000 7fc77d384740 10 client.16965 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:41:54.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.679+0000 7fc77d384740 10 client.16965 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:41:54.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.679+0000 7fc77d384740 20 client.16965 populate_metadata read hostname 'smithi079' 2024-08-20T01:41:54.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.679+0000 7fc77d384740 1 --2- 172.21.15.79:0/1944756737 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d52d5210b0 0x55d52d523510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:54.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.680+0000 7fc77d384740 4 client.16965 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:41:54.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.680+0000 7fc77d384740 1 -- 172.21.15.79:0/1944756737 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d52d47d830 con 0x55d52d5210b0 2024-08-20T01:41:54.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.680+0000 7fc778d27640 1 --2- 172.21.15.79:0/1944756737 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d52d5210b0 0x55d52d523510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:54.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.680+0000 7fc778d27640 1 --2- 172.21.15.79:0/1944756737 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d52d5210b0 0x55d52d523510 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c47784c1f38fecf server_cookie=487c71c722330979 in_seq=0 out_seq=0 2024-08-20T01:41:54.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.680+0000 7fc753fff640 10 client.16965 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:41:54.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.681+0000 7fc753fff640 1 -- 172.21.15.79:0/1944756737 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d52d47d830 con 0x55d52d5210b0 2024-08-20T01:41:54.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.681+0000 7fc753fff640 10 client.16965 handle_command_reply: tid=0 2024-08-20T01:41:54.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.681+0000 7fc77d384740 1 client.16965 shutdown 2024-08-20T01:41:54.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.681+0000 7fc77d384740 1 -- 172.21.15.79:0/1944756737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d52d505150 msgr2=0x55d52d50e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:54.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.681+0000 7fc77d384740 1 --2- 172.21.15.79:0/1944756737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d52d505150 0x55d52d50e650 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fc760009900 tx=0x7fc76002a480 comp rx=0 tx=0).stop 2024-08-20T01:41:54.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.681+0000 7fc77d384740 1 -- 172.21.15.79:0/1944756737 shutdown_connections 2024-08-20T01:41:54.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.681+0000 7fc77d384740 1 --2- 172.21.15.79:0/1944756737 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d52d5210b0 0x55d52d523510 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.681+0000 7fc77d384740 1 --2- 172.21.15.79:0/1944756737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d52d5110e0 0x55d52d50eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.681+0000 7fc77d384740 1 --2- 172.21.15.79:0/1944756737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d52d505150 0x55d52d50e650 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.681+0000 7fc77d384740 1 --2- 172.21.15.79:0/1944756737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d52d504830 0x55d52d50e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.681+0000 7fc77d384740 1 -- 172.21.15.79:0/1944756737 >> 172.21.15.79:0/1944756737 conn(0x55d52d502660 msgr2=0x55d52d508200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:54.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.681+0000 7fc753fff640 0 client.16965 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:41:54.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.681+0000 7fc77d384740 1 -- 172.21.15.79:0/1944756737 shutdown_connections 2024-08-20T01:41:54.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.681+0000 7fc77d384740 1 -- 172.21.15.79:0/1944756737 wait complete. 2024-08-20T01:41:54.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.681+0000 7fc77d384740 20 client.16965 trim_cache size 0 max 16384 2024-08-20T01:41:54.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.698+0000 7fc77d384740 1 Processor -- start 2024-08-20T01:41:54.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.698+0000 7fc77d384740 1 -- start start 2024-08-20T01:41:54.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.699+0000 7fc77d384740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d52d504830 0x55d52d501610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:54.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.699+0000 7fc77d384740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d52d505150 0x55d52d528de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:54.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.699+0000 7fc77d384740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d52d5110e0 0x55d52d529320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:54.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.699+0000 7fc77d384740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc7741abe10 con 0x55d52d504830 2024-08-20T01:41:54.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.699+0000 7fc77d384740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc7741ad950 con 0x55d52d505150 2024-08-20T01:41:54.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.699+0000 7fc77d384740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc7741ac4e0 con 0x55d52d5110e0 2024-08-20T01:41:54.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.699+0000 7fc778d27640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d52d504830 0x55d52d501610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:54.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.699+0000 7fc778d27640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d52d504830 0x55d52d501610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53360/0 (socket says 172.21.15.79:53360) 2024-08-20T01:41:54.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.699+0000 7fc778d27640 1 -- 172.21.15.79:0/1160044796 learned_addr learned my addr 172.21.15.79:0/1160044796 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:54.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.699+0000 7fc773fff640 1 --2- 172.21.15.79:0/1160044796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d52d505150 0x55d52d528de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:54.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.699+0000 7fc778d27640 1 -- 172.21.15.79:0/1160044796 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d52d5110e0 msgr2=0x55d52d529320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:54.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.699+0000 7fc778d27640 1 --2- 172.21.15.79:0/1160044796 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d52d5110e0 0x55d52d529320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.699+0000 7fc778d27640 1 -- 172.21.15.79:0/1160044796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d52d505150 msgr2=0x55d52d528de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:54.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.699+0000 7fc778d27640 1 --2- 172.21.15.79:0/1160044796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d52d505150 0x55d52d528de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.699+0000 7fc778d27640 1 -- 172.21.15.79:0/1160044796 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d52d5030e0 con 0x55d52d504830 2024-08-20T01:41:54.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.699+0000 7fc773fff640 1 --2- 172.21.15.79:0/1160044796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d52d505150 0x55d52d528de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:41:54.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.699+0000 7fc778d27640 1 --2- 172.21.15.79:0/1160044796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d52d504830 0x55d52d501610 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fc7680a60d0 tx=0x7fc7680a5f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaa4976a0d12c576 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:54.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.699+0000 7fc75e7fc640 1 -- 172.21.15.79:0/1160044796 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc768020040 con 0x55d52d504830 2024-08-20T01:41:54.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.699+0000 7fc75e7fc640 1 -- 172.21.15.79:0/1160044796 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc768009de0 con 0x55d52d504830 2024-08-20T01:41:54.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.699+0000 7fc75e7fc640 1 -- 172.21.15.79:0/1160044796 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7680b1d50 con 0x55d52d504830 2024-08-20T01:41:54.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.700+0000 7fc77d384740 1 -- 172.21.15.79:0/1160044796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d52d504830 msgr2=0x55d52d501610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:54.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.700+0000 7fc77d384740 1 --2- 172.21.15.79:0/1160044796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d52d504830 0x55d52d501610 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fc7680a60d0 tx=0x7fc7680a5f10 comp rx=0 tx=0).stop 2024-08-20T01:41:54.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.700+0000 7fc77d384740 1 -- 172.21.15.79:0/1160044796 shutdown_connections 2024-08-20T01:41:54.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.700+0000 7fc77d384740 1 --2- 172.21.15.79:0/1160044796 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d52d5110e0 0x55d52d529320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.700+0000 7fc77d384740 1 --2- 172.21.15.79:0/1160044796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d52d505150 0x55d52d528de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.700+0000 7fc77d384740 1 --2- 172.21.15.79:0/1160044796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d52d504830 0x55d52d501610 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.700+0000 7fc77d384740 1 -- 172.21.15.79:0/1160044796 >> 172.21.15.79:0/1160044796 conn(0x55d52d502660 msgr2=0x55d52d500f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:54.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.700+0000 7fc77d384740 1 -- 172.21.15.79:0/1160044796 shutdown_connections 2024-08-20T01:41:54.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.700+0000 7fc77d384740 1 -- 172.21.15.79:0/1160044796 wait complete. 2024-08-20T01:41:54.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.701+0000 7fc77d384740 1 -- start start 2024-08-20T01:41:54.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.701+0000 7fc77d384740 1 Processor -- start 2024-08-20T01:41:54.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.701+0000 7fc77d384740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d52d504830 0x55d52d5197a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:54.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.701+0000 7fc77d384740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d52d505150 0x55d52d516c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:54.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.701+0000 7fc77d384740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d52d5110e0 0x55d52d517250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:54.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.701+0000 7fc77d384740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc7741ad280 con 0x55d52d505150 2024-08-20T01:41:54.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.701+0000 7fc77d384740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc7741acbb0 con 0x55d52d5110e0 2024-08-20T01:41:54.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.701+0000 7fc77d384740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc7741a9df0 con 0x55d52d504830 2024-08-20T01:41:54.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.701+0000 7fc77d384740 10 client.0 _ll_register_callbacks cb 0x7fc760009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:41:54.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.701+0000 7fc773fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d52d505150 0x55d52d516c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:54.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.701+0000 7fc773fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d52d505150 0x55d52d516c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53364/0 (socket says 172.21.15.79:53364) 2024-08-20T01:41:54.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.701+0000 7fc773fff640 1 -- 172.21.15.79:0/710905037 learned_addr learned my addr 172.21.15.79:0/710905037 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:41:54.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.701+0000 7fc778d27640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d52d504830 0x55d52d5197a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:54.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.702+0000 7fc779528640 1 --2- 172.21.15.79:0/710905037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d52d5110e0 0x55d52d517250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:54.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.702+0000 7fc773fff640 1 -- 172.21.15.79:0/710905037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d52d504830 msgr2=0x55d52d5197a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:54.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.702+0000 7fc773fff640 1 --2- 172.21.15.79:0/710905037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d52d504830 0x55d52d5197a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.702+0000 7fc773fff640 1 -- 172.21.15.79:0/710905037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d52d5110e0 msgr2=0x55d52d517250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:41:54.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.702+0000 7fc773fff640 1 --2- 172.21.15.79:0/710905037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d52d5110e0 0x55d52d517250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.702+0000 7fc773fff640 1 -- 172.21.15.79:0/710905037 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d52d517a80 con 0x55d52d505150 2024-08-20T01:41:54.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.702+0000 7fc773fff640 1 --2- 172.21.15.79:0/710905037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d52d505150 0x55d52d516c90 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fc760006010 tx=0x7fc760048b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d38d263661817aa server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:41:54.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.702+0000 7fc753fff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:41:54.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.702+0000 7fc753fff640 1 -- 172.21.15.79:0/710905037 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc760060070 con 0x55d52d505150 2024-08-20T01:41:54.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.702+0000 7fc753fff640 1 -- 172.21.15.79:0/710905037 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc76003c800 con 0x55d52d505150 2024-08-20T01:41:54.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.702+0000 7fc77d384740 1 -- 172.21.15.79:0/710905037 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc768009de0 con 0x55d52d505150 2024-08-20T01:41:54.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.702+0000 7fc753fff640 1 -- 172.21.15.79:0/710905037 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fc76004c070 con 0x55d52d505150 2024-08-20T01:41:54.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.702+0000 7fc77d384740 10 client.16971 fetch_fsmap learned FSMap version 38 2024-08-20T01:41:54.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.702+0000 7fc77d384740 1 -- 172.21.15.79:0/710905037 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55d52d58be50 con 0x55d52d505150 2024-08-20T01:41:54.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.703+0000 7fc753fff640 1 -- 172.21.15.79:0/710905037 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc768009de0 con 0x55d52d505150 2024-08-20T01:41:54.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.703+0000 7fc753fff640 1 -- 172.21.15.79:0/710905037 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7fc760063030 con 0x55d52d505150 2024-08-20T01:41:54.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.703+0000 7fc77d384740 10 client.16971 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:41:54.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.703+0000 7fc77d384740 10 client.16971 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:41:54.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.703+0000 7fc77d384740 20 client.16971 populate_metadata read hostname 'smithi079' 2024-08-20T01:41:54.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.703+0000 7fc77d384740 1 --2- 172.21.15.79:0/710905037 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d52d58c5d0 0x55d52d58e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:41:54.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.703+0000 7fc77d384740 4 client.16971 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:41:54.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.703+0000 7fc77d384740 1 -- 172.21.15.79:0/710905037 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d52d4792d0 con 0x55d52d58c5d0 2024-08-20T01:41:54.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.703+0000 7fc778d27640 1 --2- 172.21.15.79:0/710905037 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d52d58c5d0 0x55d52d58e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:41:54.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.703+0000 7fc778d27640 1 --2- 172.21.15.79:0/710905037 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d52d58c5d0 0x55d52d58e9f0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb88d3fb9a0abcef server_cookie=fb63d87d42a8a0c7 in_seq=0 out_seq=0 2024-08-20T01:41:54.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.703+0000 7fc753fff640 10 client.16971 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:41:54.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.704+0000 7fc753fff640 1 -- 172.21.15.79:0/710905037 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55d52d4792d0 con 0x55d52d58c5d0 2024-08-20T01:41:54.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.704+0000 7fc753fff640 10 client.16971 handle_command_reply: tid=0 2024-08-20T01:41:54.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.704+0000 7fc77d384740 1 client.16971 shutdown 2024-08-20T01:41:54.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.704+0000 7fc77d384740 1 -- 172.21.15.79:0/710905037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d52d505150 msgr2=0x55d52d516c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:54.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.704+0000 7fc77d384740 1 --2- 172.21.15.79:0/710905037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d52d505150 0x55d52d516c90 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fc760006010 tx=0x7fc760048b70 comp rx=0 tx=0).stop 2024-08-20T01:41:54.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.704+0000 7fc77d384740 1 -- 172.21.15.79:0/710905037 shutdown_connections 2024-08-20T01:41:54.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.704+0000 7fc77d384740 1 --2- 172.21.15.79:0/710905037 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d52d58c5d0 0x55d52d58e9f0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.704+0000 7fc77d384740 1 --2- 172.21.15.79:0/710905037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d52d5110e0 0x55d52d517250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.704+0000 7fc77d384740 1 --2- 172.21.15.79:0/710905037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d52d505150 0x55d52d516c90 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.704+0000 7fc77d384740 1 --2- 172.21.15.79:0/710905037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d52d504830 0x55d52d5197a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.704+0000 7fc77d384740 1 -- 172.21.15.79:0/710905037 >> 172.21.15.79:0/710905037 conn(0x55d52d502660 msgr2=0x55d52d501720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:54.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.704+0000 7fc753fff640 0 client.16971 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:41:54.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.704+0000 7fc77d384740 1 -- 172.21.15.79:0/710905037 shutdown_connections 2024-08-20T01:41:54.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.704+0000 7fc77d384740 1 -- 172.21.15.79:0/710905037 wait complete. 2024-08-20T01:41:54.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.704+0000 7fc77d384740 20 client.16971 trim_cache size 0 max 16384 2024-08-20T01:41:54.727 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:41:54.727 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-20T01:41:54.727 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": { 2024-08-20T01:41:54.727 INFO:teuthology.orchestra.run.smithi079.stdout: "eeb36d0f-bf8f-4ebe-9898-6b8483a68a60": { 2024-08-20T01:41:54.727 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/", 2024-08-20T01:41:54.727 INFO:teuthology.orchestra.run.smithi079.stdout: "tag": "eeb36d0f-bf8f-4ebe-9898-6b8483a68a60", 2024-08-20T01:41:54.727 INFO:teuthology.orchestra.run.smithi079.stdout: "options": "recursive,force" 2024-08-20T01:41:54.727 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:41:54.727 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:41:54.728 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:41:54.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.705+0000 7fc77af8b640 1 -- 172.21.15.79:0/2917871413 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc7640b3c50 msgr2=0x7fc7640b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:54.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.705+0000 7fc77af8b640 1 --2- 172.21.15.79:0/2917871413 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc7640b3c50 0x7fc7640b6110 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc7600057c0 tx=0x7fc7600058d0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.705+0000 7fc77af8b640 1 -- 172.21.15.79:0/2917871413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc774101590 msgr2=0x7fc77419b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:41:54.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.705+0000 7fc77af8b640 1 --2- 172.21.15.79:0/2917871413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc774101590 0x7fc77419b080 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fc76800d950 tx=0x7fc76800de10 comp rx=0 tx=0).stop 2024-08-20T01:41:54.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.705+0000 7fc77af8b640 1 -- 172.21.15.79:0/2917871413 shutdown_connections 2024-08-20T01:41:54.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.705+0000 7fc77af8b640 1 --2- 172.21.15.79:0/2917871413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc77410f140 0x7fc7741a0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.705+0000 7fc77af8b640 1 --2- 172.21.15.79:0/2917871413 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc7640b3c50 0x7fc7640b6110 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.705+0000 7fc77af8b640 1 --2- 172.21.15.79:0/2917871413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc774101eb0 0x7fc77419b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.705+0000 7fc77af8b640 1 --2- 172.21.15.79:0/2917871413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc774101590 0x7fc77419b080 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:41:54.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.705+0000 7fc77af8b640 1 -- 172.21.15.79:0/2917871413 >> 172.21.15.79:0/2917871413 conn(0x7fc7740fd400 msgr2=0x7fc774110560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:41:54.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.705+0000 7fc77af8b640 1 -- 172.21.15.79:0/2917871413 shutdown_connections 2024-08-20T01:41:54.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:41:54.705+0000 7fc77af8b640 1 -- 172.21.15.79:0/2917871413 wait complete. 2024-08-20T01:41:55.525 INFO:tasks.cephfs.filesystem:scrub status for tag:eeb36d0f-bf8f-4ebe-9898-6b8483a68a60 - {'path': '/', 'tag': 'eeb36d0f-bf8f-4ebe-9898-6b8483a68a60', 'options': 'recursive,force'} 2024-08-20T01:41:56.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:56 smithi081 ceph-mon[22209]: pgmap v485: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 31 MiB/s wr, 36 op/s 2024-08-20T01:41:56.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:56 smithi175 ceph-mon[22392]: pgmap v485: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 31 MiB/s wr, 36 op/s 2024-08-20T01:41:56.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:56 smithi079 ceph-mon[18656]: pgmap v485: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 31 MiB/s wr, 36 op/s 2024-08-20T01:41:58.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:41:58 smithi081 ceph-mon[22209]: pgmap v486: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 MiB/s wr, 41 op/s 2024-08-20T01:41:58.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:41:58 smithi175 ceph-mon[22392]: pgmap v486: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 MiB/s wr, 41 op/s 2024-08-20T01:41:58.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:41:58 smithi079 ceph-mon[18656]: pgmap v486: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 MiB/s wr, 41 op/s 2024-08-20T01:42:00.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:00 smithi081 ceph-mon[22209]: pgmap v487: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 27 MiB/s wr, 50 op/s 2024-08-20T01:42:00.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:00 smithi175 ceph-mon[22392]: pgmap v487: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 27 MiB/s wr, 50 op/s 2024-08-20T01:42:00.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:00 smithi079 ceph-mon[18656]: pgmap v487: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 27 MiB/s wr, 50 op/s 2024-08-20T01:42:01.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.179+0000 7f40f39d2640 1 -- 172.21.15.79:0/70816149 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40ec103070 msgr2=0x7f40ec1099f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:01.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.179+0000 7f40f39d2640 1 --2- 172.21.15.79:0/70816149 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40ec103070 0x7f40ec1099f0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f40e4009cd0 tx=0x7f40e402a8e0 comp rx=0 tx=0).stop 2024-08-20T01:42:01.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.179+0000 7f40f39d2640 1 -- 172.21.15.79:0/70816149 shutdown_connections 2024-08-20T01:42:01.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.179+0000 7f40f39d2640 1 --2- 172.21.15.79:0/70816149 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40ec103070 0x7f40ec1099f0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:01.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.179+0000 7f40f39d2640 1 --2- 172.21.15.79:0/70816149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40ec1026b0 0x7f40ec102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:01.183 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.179+0000 7f40f39d2640 1 --2- 172.21.15.79:0/70816149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40ec101560 0x7f40ec101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:01.183 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.179+0000 7f40f39d2640 1 -- 172.21.15.79:0/70816149 >> 172.21.15.79:0/70816149 conn(0x7f40ec0fce40 msgr2=0x7f40ec0ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:01.183 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.179+0000 7f40f39d2640 1 -- 172.21.15.79:0/70816149 shutdown_connections 2024-08-20T01:42:01.183 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.179+0000 7f40f39d2640 1 -- 172.21.15.79:0/70816149 wait complete. 2024-08-20T01:42:01.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.180+0000 7f40f39d2640 1 Processor -- start 2024-08-20T01:42:01.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.180+0000 7f40f39d2640 1 -- start start 2024-08-20T01:42:01.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.181+0000 7f40f39d2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40ec101560 0x7f40ec197850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:01.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.181+0000 7f40f39d2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40ec1026b0 0x7f40ec197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:01.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.181+0000 7f40f39d2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40ec103070 0x7f40ec198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:01.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.181+0000 7f40f39d2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f40ec10d060 con 0x7f40ec103070 2024-08-20T01:42:01.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.181+0000 7f40f39d2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f40ec10cee0 con 0x7f40ec1026b0 2024-08-20T01:42:01.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.181+0000 7f40f39d2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f40ec10d1e0 con 0x7f40ec101560 2024-08-20T01:42:01.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.181+0000 7f40f1f6f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40ec103070 0x7f40ec198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:01.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.181+0000 7f40f1f6f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40ec103070 0x7f40ec198ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36456/0 (socket says 172.21.15.79:36456) 2024-08-20T01:42:01.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.181+0000 7f40f1f6f640 1 -- 172.21.15.79:0/2799738584 learned_addr learned my addr 172.21.15.79:0/2799738584 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:01.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.181+0000 7f40f0f6d640 1 --2- 172.21.15.79:0/2799738584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40ec1026b0 0x7f40ec197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:01.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.181+0000 7f40f176e640 1 --2- 172.21.15.79:0/2799738584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40ec101560 0x7f40ec197850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:01.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.181+0000 7f40f1f6f640 1 -- 172.21.15.79:0/2799738584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40ec101560 msgr2=0x7f40ec197850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:01.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.181+0000 7f40f1f6f640 1 --2- 172.21.15.79:0/2799738584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40ec101560 0x7f40ec197850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:01.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.181+0000 7f40f1f6f640 1 -- 172.21.15.79:0/2799738584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40ec1026b0 msgr2=0x7f40ec197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:01.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.181+0000 7f40f1f6f640 1 --2- 172.21.15.79:0/2799738584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40ec1026b0 0x7f40ec197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:01.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.181+0000 7f40f1f6f640 1 -- 172.21.15.79:0/2799738584 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40ec199390 con 0x7f40ec103070 2024-08-20T01:42:01.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.181+0000 7f40f0f6d640 1 --2- 172.21.15.79:0/2799738584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40ec1026b0 0x7f40ec197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:42:01.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.181+0000 7f40f176e640 1 --2- 172.21.15.79:0/2799738584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40ec101560 0x7f40ec197850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:42:01.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.181+0000 7f40f1f6f640 1 --2- 172.21.15.79:0/2799738584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40ec103070 0x7f40ec198ad0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f40e40097b0 tx=0x7f40e4003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:01.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.181+0000 7f40e27fc640 1 -- 172.21.15.79:0/2799738584 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e4004450 con 0x7f40ec103070 2024-08-20T01:42:01.187 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.181+0000 7f40e27fc640 1 -- 172.21.15.79:0/2799738584 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40e4003e10 con 0x7f40ec103070 2024-08-20T01:42:01.187 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.181+0000 7f40f39d2640 1 -- 172.21.15.79:0/2799738584 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40ec199620 con 0x7f40ec103070 2024-08-20T01:42:01.187 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.181+0000 7f40e27fc640 1 -- 172.21.15.79:0/2799738584 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e4046480 con 0x7f40ec103070 2024-08-20T01:42:01.187 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.182+0000 7f40f39d2640 1 -- 172.21.15.79:0/2799738584 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40ec19fd50 con 0x7f40ec103070 2024-08-20T01:42:01.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.184+0000 7f40e27fc640 1 -- 172.21.15.79:0/2799738584 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f40e40305a0 con 0x7f40ec103070 2024-08-20T01:42:01.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.184+0000 7f40f67c5740 1 Processor -- start 2024-08-20T01:42:01.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.184+0000 7f40f67c5740 1 -- start start 2024-08-20T01:42:01.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.185+0000 7f40f67c5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b4ad27ae0 0x557b4ad29ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:01.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.185+0000 7f40f67c5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b4ad2a410 0x557b4ad2c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:01.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.185+0000 7f40f67c5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b4ad2ce50 0x557b4ad2f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:01.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.185+0000 7f40f67c5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557b4ac98360 con 0x557b4ad2ce50 2024-08-20T01:42:01.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.185+0000 7f40f67c5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557b4ac87860 con 0x557b4ad2a410 2024-08-20T01:42:01.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.185+0000 7f40f67c5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557b4ac8b8a0 con 0x557b4ad27ae0 2024-08-20T01:42:01.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.185+0000 7f40f0f6d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b4ad2ce50 0x557b4ad2f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:01.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.185+0000 7f40e27fc640 1 --2- 172.21.15.79:0/2799738584 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f40d80b3bd0 0x7f40d80b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:01.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.185+0000 7f40f0f6d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b4ad2ce50 0x557b4ad2f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36458/0 (socket says 172.21.15.79:36458) 2024-08-20T01:42:01.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.185+0000 7f40f0f6d640 1 -- 172.21.15.79:0/3316666676 learned_addr learned my addr 172.21.15.79:0/3316666676 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:01.193 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.185+0000 7f40f0f6d640 1 --2- 172.21.15.79:0/3316666676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b4ad27ae0 0x557b4ad29ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:01.193 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.185+0000 7f40f176e640 1 --2- 172.21.15.79:0/3316666676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b4ad2a410 0x557b4ad2c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:01.193 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.185+0000 7f40f1f6f640 1 --2- 172.21.15.79:0/2799738584 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f40d80b3bd0 0x7f40d80b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:01.193 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.185+0000 7f40f0f6d640 1 -- 172.21.15.79:0/3316666676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b4ad27ae0 msgr2=0x557b4ad29ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:01.193 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.185+0000 7f40f0f6d640 1 --2- 172.21.15.79:0/3316666676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b4ad27ae0 0x557b4ad29ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:01.193 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.185+0000 7f40f0f6d640 1 -- 172.21.15.79:0/3316666676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b4ad2a410 msgr2=0x557b4ad2c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:01.193 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.185+0000 7f40f0f6d640 1 --2- 172.21.15.79:0/3316666676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b4ad2a410 0x557b4ad2c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:01.193 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.185+0000 7f40f0f6d640 1 -- 172.21.15.79:0/3316666676 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b4ac2ee40 con 0x557b4ad2ce50 2024-08-20T01:42:01.193 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.185+0000 7f40f176e640 1 --2- 172.21.15.79:0/3316666676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b4ad2a410 0x557b4ad2c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:42:01.193 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.185+0000 7f40e27fc640 1 -- 172.21.15.79:0/2799738584 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f40e402e030 con 0x7f40ec103070 2024-08-20T01:42:01.193 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.186+0000 7f40f0f6d640 1 --2- 172.21.15.79:0/3316666676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b4ad2ce50 0x557b4ad2f310 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f40dc014a80 tx=0x7f40dc00c5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8a8a08faaeae43b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:01.193 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.186+0000 7f40f1f6f640 1 --2- 172.21.15.79:0/2799738584 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f40d80b3bd0 0x7f40d80b6090 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f40e40c8520 tx=0x7f40e4099c40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:01.194 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.186+0000 7f40d77fe640 1 -- 172.21.15.79:0/3316666676 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40dc0142d0 con 0x557b4ad2ce50 2024-08-20T01:42:01.194 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.186+0000 7f40d77fe640 1 -- 172.21.15.79:0/3316666676 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40dc00f760 con 0x557b4ad2ce50 2024-08-20T01:42:01.194 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.186+0000 7f40d77fe640 1 -- 172.21.15.79:0/3316666676 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40dc0044c0 con 0x557b4ad2ce50 2024-08-20T01:42:01.194 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.186+0000 7f40f67c5740 1 -- 172.21.15.79:0/3316666676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b4ad2ce50 msgr2=0x557b4ad2f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:01.194 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.186+0000 7f40f67c5740 1 --2- 172.21.15.79:0/3316666676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b4ad2ce50 0x557b4ad2f310 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f40dc014a80 tx=0x7f40dc00c5a0 comp rx=0 tx=0).stop 2024-08-20T01:42:01.194 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.187+0000 7f40f67c5740 1 -- 172.21.15.79:0/3316666676 shutdown_connections 2024-08-20T01:42:01.194 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.187+0000 7f40f67c5740 1 --2- 172.21.15.79:0/3316666676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b4ad2ce50 0x557b4ad2f310 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:01.194 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.187+0000 7f40f67c5740 1 --2- 172.21.15.79:0/3316666676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b4ad2a410 0x557b4ad2c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:01.194 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.187+0000 7f40f67c5740 1 --2- 172.21.15.79:0/3316666676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b4ad27ae0 0x557b4ad29ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:01.194 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.187+0000 7f40f67c5740 1 -- 172.21.15.79:0/3316666676 >> 172.21.15.79:0/3316666676 conn(0x557b4ad22c30 msgr2=0x557b4ad239c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:01.194 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.187+0000 7f40f67c5740 1 -- 172.21.15.79:0/3316666676 shutdown_connections 2024-08-20T01:42:01.194 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.187+0000 7f40f67c5740 1 -- 172.21.15.79:0/3316666676 wait complete. 2024-08-20T01:42:01.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.187+0000 7f40f67c5740 1 -- start start 2024-08-20T01:42:01.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.187+0000 7f40f67c5740 1 Processor -- start 2024-08-20T01:42:01.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.187+0000 7f40f67c5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b4ad27ae0 0x557b4ad312b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:01.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.187+0000 7f40f67c5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b4ad2a410 0x557b4ad31950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:01.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.187+0000 7f40f67c5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b4ad2ce50 0x557b4ad32520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:01.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.187+0000 7f40f67c5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557b4abc0ab0 con 0x557b4ad27ae0 2024-08-20T01:42:01.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.187+0000 7f40f67c5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557b4ac0e780 con 0x557b4ad2a410 2024-08-20T01:42:01.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.187+0000 7f40f67c5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557b4ad2fdd0 con 0x557b4ad2ce50 2024-08-20T01:42:01.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.187+0000 7f40f67c5740 10 client.0 _ll_register_callbacks cb 0x557b4a996a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:42:01.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.188+0000 7f40f0f6d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b4ad27ae0 0x557b4ad312b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:01.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.188+0000 7f40f0f6d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b4ad27ae0 0x557b4ad312b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36474/0 (socket says 172.21.15.79:36474) 2024-08-20T01:42:01.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.188+0000 7f40f0f6d640 1 -- 172.21.15.79:0/617760835 learned_addr learned my addr 172.21.15.79:0/617760835 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:01.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.188+0000 7f40f176e640 1 --2- 172.21.15.79:0/617760835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b4ad2a410 0x557b4ad31950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:01.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.188+0000 7f40f0f6d640 1 -- 172.21.15.79:0/617760835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b4ad2ce50 msgr2=0x557b4ad32520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:01.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.188+0000 7f40f0f6d640 1 --2- 172.21.15.79:0/617760835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b4ad2ce50 0x557b4ad32520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:01.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.188+0000 7f40f0f6d640 1 -- 172.21.15.79:0/617760835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b4ad2a410 msgr2=0x557b4ad31950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:01.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.188+0000 7f40f0f6d640 1 --2- 172.21.15.79:0/617760835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b4ad2a410 0x557b4ad31950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:01.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.188+0000 7f40f0f6d640 1 -- 172.21.15.79:0/617760835 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b4a9ea790 con 0x557b4ad27ae0 2024-08-20T01:42:01.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.188+0000 7f40f0f6d640 1 --2- 172.21.15.79:0/617760835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b4ad27ae0 0x557b4ad312b0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f40dc00fec0 tx=0x7f40dc014830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4a4000ac370bcba server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:01.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.188+0000 7f40d4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:42:01.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.188+0000 7f40d4ff9640 1 -- 172.21.15.79:0/617760835 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40dc00fc30 con 0x557b4ad27ae0 2024-08-20T01:42:01.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.188+0000 7f40d4ff9640 1 -- 172.21.15.79:0/617760835 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f40dc004030 con 0x557b4ad27ae0 2024-08-20T01:42:01.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.188+0000 7f40f67c5740 1 -- 172.21.15.79:0/617760835 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557b4ac36e00 con 0x557b4ad27ae0 2024-08-20T01:42:01.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.188+0000 7f40d4ff9640 1 -- 172.21.15.79:0/617760835 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f40dc030050 con 0x557b4ad27ae0 2024-08-20T01:42:01.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.188+0000 7f40f67c5740 10 client.16983 fetch_fsmap learned FSMap version 38 2024-08-20T01:42:01.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.188+0000 7f40f67c5740 1 -- 172.21.15.79:0/617760835 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x557b4aa63620 con 0x557b4ad27ae0 2024-08-20T01:42:01.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.189+0000 7f40d4ff9640 1 -- 172.21.15.79:0/617760835 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x557b4ac36e00 con 0x557b4ad27ae0 2024-08-20T01:42:01.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.189+0000 7f40d4ff9640 1 -- 172.21.15.79:0/617760835 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f40dc012450 con 0x557b4ad27ae0 2024-08-20T01:42:01.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.189+0000 7f40f67c5740 10 client.16983 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:42:01.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.189+0000 7f40f67c5740 10 client.16983 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:42:01.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.189+0000 7f40f67c5740 20 client.16983 populate_metadata read hostname 'smithi079' 2024-08-20T01:42:01.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.189+0000 7f40f67c5740 1 --2- 172.21.15.79:0/617760835 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557b4ad3c870 0x557b4ad3ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:01.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.189+0000 7f40f67c5740 4 client.16983 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:42:01.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.189+0000 7f40f67c5740 1 -- 172.21.15.79:0/617760835 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b4ac9a2b0 con 0x557b4ad3c870 2024-08-20T01:42:01.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.189+0000 7f40f176e640 1 --2- 172.21.15.79:0/617760835 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557b4ad3c870 0x557b4ad3ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:01.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.190+0000 7f40f176e640 1 --2- 172.21.15.79:0/617760835 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557b4ad3c870 0x557b4ad3ec60 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c9963ad225ab2c5 server_cookie=50b329a4021a4ec8 in_seq=0 out_seq=0 2024-08-20T01:42:01.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.190+0000 7f40d4ff9640 10 client.16983 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:42:01.198 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.190+0000 7f40d4ff9640 1 -- 172.21.15.79:0/617760835 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557b4ac9a2b0 con 0x557b4ad3c870 2024-08-20T01:42:01.198 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.190+0000 7f40d4ff9640 10 client.16983 handle_command_reply: tid=0 2024-08-20T01:42:01.199 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.190+0000 7f40f67c5740 1 client.16983 shutdown 2024-08-20T01:42:01.199 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.190+0000 7f40f67c5740 1 -- 172.21.15.79:0/617760835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b4ad27ae0 msgr2=0x557b4ad312b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:01.199 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.190+0000 7f40f67c5740 1 --2- 172.21.15.79:0/617760835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b4ad27ae0 0x557b4ad312b0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f40dc00fec0 tx=0x7f40dc014830 comp rx=0 tx=0).stop 2024-08-20T01:42:01.199 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.190+0000 7f40f67c5740 1 -- 172.21.15.79:0/617760835 shutdown_connections 2024-08-20T01:42:01.199 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.190+0000 7f40f67c5740 1 --2- 172.21.15.79:0/617760835 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557b4ad3c870 0x557b4ad3ec60 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:01.199 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.190+0000 7f40f67c5740 1 --2- 172.21.15.79:0/617760835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b4ad2ce50 0x557b4ad32520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:01.199 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.190+0000 7f40d4ff9640 0 client.16983 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:42:01.199 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.190+0000 7f40f67c5740 1 --2- 172.21.15.79:0/617760835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b4ad2a410 0x557b4ad31950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:01.199 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.190+0000 7f40f67c5740 1 --2- 172.21.15.79:0/617760835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b4ad27ae0 0x557b4ad312b0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:01.199 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.190+0000 7f40f67c5740 1 -- 172.21.15.79:0/617760835 >> 172.21.15.79:0/617760835 conn(0x557b4ad22c30 msgr2=0x557b4ad1fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:01.199 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.191+0000 7f40f67c5740 1 -- 172.21.15.79:0/617760835 shutdown_connections 2024-08-20T01:42:01.199 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.191+0000 7f40f67c5740 1 -- 172.21.15.79:0/617760835 wait complete. 2024-08-20T01:42:01.200 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.191+0000 7f40f67c5740 20 client.16983 trim_cache size 0 max 16384 2024-08-20T01:42:01.208 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.206+0000 7f40f67c5740 1 Processor -- start 2024-08-20T01:42:01.208 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.206+0000 7f40f67c5740 1 -- start start 2024-08-20T01:42:01.209 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.206+0000 7f40f67c5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b4ad27ae0 0x557b4ad2e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:01.209 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.206+0000 7f40f67c5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b4ad2a410 0x557b4ad1f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:01.210 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.206+0000 7f40f67c5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b4ad2ce50 0x557b4ad43470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:01.210 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.206+0000 7f40f67c5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f40ec1a78e0 con 0x557b4ad2a410 2024-08-20T01:42:01.210 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.206+0000 7f40f67c5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f40ec1a9420 con 0x557b4ad2ce50 2024-08-20T01:42:01.210 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.206+0000 7f40f67c5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f40ec1a7fb0 con 0x557b4ad27ae0 2024-08-20T01:42:01.210 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.206+0000 7f40f0f6d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b4ad27ae0 0x557b4ad2e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:01.210 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.206+0000 7f40f176e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b4ad2a410 0x557b4ad1f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:01.210 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.206+0000 7f40f0f6d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b4ad27ae0 0x557b4ad2e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:46286/0 (socket says 172.21.15.79:46286) 2024-08-20T01:42:01.210 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.206+0000 7f40f0f6d640 1 -- 172.21.15.79:0/4180675156 learned_addr learned my addr 172.21.15.79:0/4180675156 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:01.210 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.206+0000 7f40f0f6d640 1 --2- 172.21.15.79:0/4180675156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b4ad2ce50 0x557b4ad43470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:01.210 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.207+0000 7f40f0f6d640 1 -- 172.21.15.79:0/4180675156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b4ad2ce50 msgr2=0x557b4ad43470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:01.210 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.207+0000 7f40f0f6d640 1 --2- 172.21.15.79:0/4180675156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b4ad2ce50 0x557b4ad43470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:01.210 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.207+0000 7f40f0f6d640 1 -- 172.21.15.79:0/4180675156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b4ad2a410 msgr2=0x557b4ad1f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:01.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.207+0000 7f40f0f6d640 1 --2- 172.21.15.79:0/4180675156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b4ad2a410 0x557b4ad1f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:01.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.207+0000 7f40f0f6d640 1 -- 172.21.15.79:0/4180675156 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b4ad2cb70 con 0x557b4ad27ae0 2024-08-20T01:42:01.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.207+0000 7f40f176e640 1 --2- 172.21.15.79:0/4180675156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b4ad2a410 0x557b4ad1f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:42:01.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.207+0000 7f40f0f6d640 1 --2- 172.21.15.79:0/4180675156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b4ad27ae0 0x557b4ad2e840 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f40dc00ff50 tx=0x7f40dc005970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc3924866638d4c3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:01.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.207+0000 7f40d6ffd640 1 -- 172.21.15.79:0/4180675156 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40dc012450 con 0x557b4ad27ae0 2024-08-20T01:42:01.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.207+0000 7f40d6ffd640 1 -- 172.21.15.79:0/4180675156 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40dc0054b0 con 0x557b4ad27ae0 2024-08-20T01:42:01.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.207+0000 7f40d6ffd640 1 -- 172.21.15.79:0/4180675156 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40dc004680 con 0x557b4ad27ae0 2024-08-20T01:42:01.214 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.208+0000 7f40f67c5740 1 -- 172.21.15.79:0/4180675156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b4ad27ae0 msgr2=0x557b4ad2e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:01.214 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.208+0000 7f40f67c5740 1 --2- 172.21.15.79:0/4180675156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b4ad27ae0 0x557b4ad2e840 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f40dc00ff50 tx=0x7f40dc005970 comp rx=0 tx=0).stop 2024-08-20T01:42:01.214 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.208+0000 7f40f67c5740 1 -- 172.21.15.79:0/4180675156 shutdown_connections 2024-08-20T01:42:01.214 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.208+0000 7f40f67c5740 1 --2- 172.21.15.79:0/4180675156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b4ad2ce50 0x557b4ad43470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:01.214 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.208+0000 7f40f67c5740 1 --2- 172.21.15.79:0/4180675156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b4ad2a410 0x557b4ad1f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:01.214 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.208+0000 7f40f67c5740 1 --2- 172.21.15.79:0/4180675156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b4ad27ae0 0x557b4ad2e840 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:01.215 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.208+0000 7f40f67c5740 1 -- 172.21.15.79:0/4180675156 >> 172.21.15.79:0/4180675156 conn(0x557b4ad22c30 msgr2=0x557b4ad1f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:01.215 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.208+0000 7f40f67c5740 1 -- 172.21.15.79:0/4180675156 shutdown_connections 2024-08-20T01:42:01.215 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.208+0000 7f40f67c5740 1 -- 172.21.15.79:0/4180675156 wait complete. 2024-08-20T01:42:01.215 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.208+0000 7f40f67c5740 1 -- start start 2024-08-20T01:42:01.215 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.209+0000 7f40f67c5740 1 Processor -- start 2024-08-20T01:42:01.215 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.209+0000 7f40f67c5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b4ad27ae0 0x557b4ad341a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:01.215 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.209+0000 7f40f67c5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b4ad2a410 0x557b4ad34840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:01.215 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.209+0000 7f40f67c5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b4ad2ce50 0x557b4ad353a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:01.215 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.209+0000 7f40f67c5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f40ec1a8d50 con 0x557b4ad2a410 2024-08-20T01:42:01.215 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.209+0000 7f40f67c5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f40ec1a8680 con 0x557b4ad2ce50 2024-08-20T01:42:01.215 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.209+0000 7f40f67c5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f40ec1a58c0 con 0x557b4ad27ae0 2024-08-20T01:42:01.215 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.209+0000 7f40f67c5740 10 client.0 _ll_register_callbacks cb 0x7f40dc014470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:42:01.215 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.209+0000 7f40f176e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b4ad2a410 0x557b4ad34840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:01.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.209+0000 7f40f176e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b4ad2a410 0x557b4ad34840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36490/0 (socket says 172.21.15.79:36490) 2024-08-20T01:42:01.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.209+0000 7f40f176e640 1 -- 172.21.15.79:0/1998216917 learned_addr learned my addr 172.21.15.79:0/1998216917 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:01.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.209+0000 7f40f0f6d640 1 --2- 172.21.15.79:0/1998216917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b4ad27ae0 0x557b4ad341a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:01.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.209+0000 7f40f0f6d640 1 --2- 172.21.15.79:0/1998216917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b4ad2ce50 0x557b4ad353a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:01.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.209+0000 7f40f176e640 1 -- 172.21.15.79:0/1998216917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b4ad27ae0 msgr2=0x557b4ad341a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:01.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.209+0000 7f40f176e640 1 --2- 172.21.15.79:0/1998216917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b4ad27ae0 0x557b4ad341a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:01.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.209+0000 7f40f176e640 1 -- 172.21.15.79:0/1998216917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b4ad2ce50 msgr2=0x557b4ad353a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:01.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.209+0000 7f40f176e640 1 --2- 172.21.15.79:0/1998216917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b4ad2ce50 0x557b4ad353a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:01.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.209+0000 7f40f176e640 1 -- 172.21.15.79:0/1998216917 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b4ad35bd0 con 0x557b4ad2a410 2024-08-20T01:42:01.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.210+0000 7f40f176e640 1 --2- 172.21.15.79:0/1998216917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b4ad2a410 0x557b4ad34840 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x557b4ad3f3c0 tx=0x7f40e801dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dda86eb7437f009 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:01.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.210+0000 7f40d4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:42:01.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.210+0000 7f40d4ff9640 1 -- 172.21.15.79:0/1998216917 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e8004220 con 0x557b4ad2a410 2024-08-20T01:42:01.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.210+0000 7f40d4ff9640 1 -- 172.21.15.79:0/1998216917 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f40e80043c0 con 0x557b4ad2a410 2024-08-20T01:42:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.210+0000 7f40f67c5740 1 -- 172.21.15.79:0/1998216917 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40dc0054b0 con 0x557b4ad2a410 2024-08-20T01:42:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.210+0000 7f40d4ff9640 1 -- 172.21.15.79:0/1998216917 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f40e8013910 con 0x557b4ad2a410 2024-08-20T01:42:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.210+0000 7f40f67c5740 10 client.16989 fetch_fsmap learned FSMap version 38 2024-08-20T01:42:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.210+0000 7f40f67c5740 1 -- 172.21.15.79:0/1998216917 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x557b4ad38fc0 con 0x557b4ad2a410 2024-08-20T01:42:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.210+0000 7f40d4ff9640 1 -- 172.21.15.79:0/1998216917 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40dc0054b0 con 0x557b4ad2a410 2024-08-20T01:42:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.210+0000 7f40d4ff9640 1 -- 172.21.15.79:0/1998216917 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f40e8003b20 con 0x557b4ad2a410 2024-08-20T01:42:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.210+0000 7f40f67c5740 10 client.16989 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:42:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.210+0000 7f40f67c5740 10 client.16989 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:42:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.210+0000 7f40f67c5740 20 client.16989 populate_metadata read hostname 'smithi079' 2024-08-20T01:42:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.210+0000 7f40f67c5740 1 --2- 172.21.15.79:0/1998216917 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557b4ada5800 0x557b4ada5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.210+0000 7f40f67c5740 4 client.16989 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:42:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.210+0000 7f40f67c5740 1 -- 172.21.15.79:0/1998216917 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557b4ac95d50 con 0x557b4ada5800 2024-08-20T01:42:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.211+0000 7f40f0f6d640 1 --2- 172.21.15.79:0/1998216917 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557b4ada5800 0x557b4ada5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:01.218 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.211+0000 7f40d4ff9640 10 client.16989 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:42:01.218 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.211+0000 7f40f0f6d640 1 --2- 172.21.15.79:0/1998216917 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557b4ada5800 0x557b4ada5c10 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c340a30b84215c98 server_cookie=a7e0211837bd9f9 in_seq=0 out_seq=0 2024-08-20T01:42:01.220 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.217+0000 7f40d4ff9640 1 -- 172.21.15.79:0/1998216917 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557b4ac95d50 con 0x557b4ada5800 2024-08-20T01:42:01.220 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.217+0000 7f40d4ff9640 10 client.16989 handle_command_reply: tid=0 2024-08-20T01:42:01.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.217+0000 7f40f67c5740 1 client.16989 shutdown 2024-08-20T01:42:01.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.218+0000 7f40f67c5740 1 -- 172.21.15.79:0/1998216917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b4ad2a410 msgr2=0x557b4ad34840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:01.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.218+0000 7f40f67c5740 1 --2- 172.21.15.79:0/1998216917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b4ad2a410 0x557b4ad34840 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x557b4ad3f3c0 tx=0x7f40e801dab0 comp rx=0 tx=0).stop 2024-08-20T01:42:01.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.218+0000 7f40f67c5740 1 -- 172.21.15.79:0/1998216917 shutdown_connections 2024-08-20T01:42:01.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.218+0000 7f40f67c5740 1 --2- 172.21.15.79:0/1998216917 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557b4ada5800 0x557b4ada5c10 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:01.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.218+0000 7f40f67c5740 1 --2- 172.21.15.79:0/1998216917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b4ad2ce50 0x557b4ad353a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:01.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.218+0000 7f40f67c5740 1 --2- 172.21.15.79:0/1998216917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557b4ad2a410 0x557b4ad34840 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:01.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.218+0000 7f40d4ff9640 0 client.16989 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:42:01.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.218+0000 7f40f67c5740 1 --2- 172.21.15.79:0/1998216917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557b4ad27ae0 0x557b4ad341a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:01.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.218+0000 7f40f67c5740 1 -- 172.21.15.79:0/1998216917 >> 172.21.15.79:0/1998216917 conn(0x557b4ad22c30 msgr2=0x557b4ad1fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:01.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.218+0000 7f40f67c5740 1 -- 172.21.15.79:0/1998216917 shutdown_connections 2024-08-20T01:42:01.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.218+0000 7f40f67c5740 1 -- 172.21.15.79:0/1998216917 wait complete. 2024-08-20T01:42:01.222 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.218+0000 7f40f67c5740 20 client.16989 trim_cache size 0 max 16384 2024-08-20T01:42:01.222 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:42:01.222 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:42:01.222 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:42:01.222 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:42:01.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.218+0000 7f40f39d2640 1 -- 172.21.15.79:0/2799738584 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f40d80b3bd0 msgr2=0x7f40d80b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:01.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.218+0000 7f40f39d2640 1 --2- 172.21.15.79:0/2799738584 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f40d80b3bd0 0x7f40d80b6090 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f40e40c8520 tx=0x7f40e4099c40 comp rx=0 tx=0).stop 2024-08-20T01:42:01.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.218+0000 7f40f39d2640 1 -- 172.21.15.79:0/2799738584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40ec103070 msgr2=0x7f40ec198ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:01.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.218+0000 7f40f39d2640 1 --2- 172.21.15.79:0/2799738584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40ec103070 0x7f40ec198ad0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f40e40097b0 tx=0x7f40e4003c20 comp rx=0 tx=0).stop 2024-08-20T01:42:01.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.219+0000 7f40f39d2640 1 -- 172.21.15.79:0/2799738584 shutdown_connections 2024-08-20T01:42:01.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.219+0000 7f40f39d2640 1 --2- 172.21.15.79:0/2799738584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40ec103070 0x7f40ec198ad0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:01.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.219+0000 7f40f39d2640 1 --2- 172.21.15.79:0/2799738584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40ec1026b0 0x7f40ec197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:01.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.219+0000 7f40f39d2640 1 --2- 172.21.15.79:0/2799738584 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f40d80b3bd0 0x7f40d80b6090 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:01.224 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.219+0000 7f40f39d2640 1 --2- 172.21.15.79:0/2799738584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40ec101560 0x7f40ec197850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:01.224 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.219+0000 7f40f39d2640 1 -- 172.21.15.79:0/2799738584 >> 172.21.15.79:0/2799738584 conn(0x7f40ec0fce40 msgr2=0x7f40ec105aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:01.224 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.219+0000 7f40f39d2640 1 -- 172.21.15.79:0/2799738584 shutdown_connections 2024-08-20T01:42:01.224 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:01.219+0000 7f40f39d2640 1 -- 172.21.15.79:0/2799738584 wait complete. 2024-08-20T01:42:02.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:02 smithi081 ceph-mon[22209]: pgmap v488: 97 pgs: 97 active+clean; 6.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 28 MiB/s wr, 46 op/s 2024-08-20T01:42:02.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:02 smithi175 ceph-mon[22392]: pgmap v488: 97 pgs: 97 active+clean; 6.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 28 MiB/s wr, 46 op/s 2024-08-20T01:42:02.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:02 smithi079 ceph-mon[18656]: pgmap v488: 97 pgs: 97 active+clean; 6.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 28 MiB/s wr, 46 op/s 2024-08-20T01:42:04.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:04 smithi081 ceph-mon[22209]: pgmap v489: 97 pgs: 97 active+clean; 6.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 28 MiB/s wr, 45 op/s 2024-08-20T01:42:04.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:04 smithi175 ceph-mon[22392]: pgmap v489: 97 pgs: 97 active+clean; 6.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 28 MiB/s wr, 45 op/s 2024-08-20T01:42:04.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:04 smithi079 ceph-mon[18656]: pgmap v489: 97 pgs: 97 active+clean; 6.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 28 MiB/s wr, 45 op/s 2024-08-20T01:42:05.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:05 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:42:05.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:05 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:42:05.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:05 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:42:05.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:05 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:42:05.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:05 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:42:05.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:05 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:42:05.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:05 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:42:05.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:05 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:42:05.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:05 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:42:05.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:05 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:42:05.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:05 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:42:05.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:05 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:42:06.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:06 smithi081 ceph-mon[22209]: pgmap v490: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 30 MiB/s wr, 49 op/s 2024-08-20T01:42:06.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:06 smithi175 ceph-mon[22392]: pgmap v490: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 30 MiB/s wr, 49 op/s 2024-08-20T01:42:06.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:06 smithi079 ceph-mon[18656]: pgmap v490: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 30 MiB/s wr, 49 op/s 2024-08-20T01:42:07.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:07 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:42:07.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:07 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:42:07.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:07 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:42:07.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:07 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:42:07.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:07 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:42:07.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:07 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:42:07.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:07 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:42:07.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:07 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:42:07.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:07 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:42:07.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:07 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:42:07.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:07 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:42:07.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:07 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:42:08.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:08 smithi081 ceph-mon[22209]: pgmap v491: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 28 MiB/s wr, 37 op/s 2024-08-20T01:42:08.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:08 smithi175 ceph-mon[22392]: pgmap v491: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 28 MiB/s wr, 37 op/s 2024-08-20T01:42:08.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:08 smithi079 ceph-mon[18656]: pgmap v491: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 28 MiB/s wr, 37 op/s 2024-08-20T01:42:10.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:10 smithi081 ceph-mon[22209]: pgmap v492: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 31 MiB/s wr, 32 op/s 2024-08-20T01:42:10.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:10 smithi175 ceph-mon[22392]: pgmap v492: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 31 MiB/s wr, 32 op/s 2024-08-20T01:42:10.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:10 smithi079 ceph-mon[18656]: pgmap v492: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 31 MiB/s wr, 32 op/s 2024-08-20T01:42:12.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:12 smithi081 ceph-mon[22209]: pgmap v493: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 31 MiB/s wr, 23 op/s 2024-08-20T01:42:12.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:12 smithi175 ceph-mon[22392]: pgmap v493: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 31 MiB/s wr, 23 op/s 2024-08-20T01:42:12.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:12 smithi079 ceph-mon[18656]: pgmap v493: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 31 MiB/s wr, 23 op/s 2024-08-20T01:42:14.318 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.313+0000 7f91b4f43640 1 -- 172.21.15.79:0/2338529290 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91b0104170 msgr2=0x7f91b010aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:14.318 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.313+0000 7f91b4f43640 1 --2- 172.21.15.79:0/2338529290 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91b0104170 0x7f91b010aaf0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f91a8009cd0 tx=0x7f91a802a8e0 comp rx=0 tx=0).stop 2024-08-20T01:42:14.318 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.313+0000 7f91b4f43640 1 -- 172.21.15.79:0/2338529290 shutdown_connections 2024-08-20T01:42:14.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.313+0000 7f91b4f43640 1 --2- 172.21.15.79:0/2338529290 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91b0104170 0x7f91b010aaf0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:14.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.313+0000 7f91b4f43640 1 --2- 172.21.15.79:0/2338529290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91b01037b0 0x7f91b0103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:14.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.313+0000 7f91b4f43640 1 --2- 172.21.15.79:0/2338529290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91b0102660 0x7f91b0102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:14.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.313+0000 7f91b4f43640 1 -- 172.21.15.79:0/2338529290 >> 172.21.15.79:0/2338529290 conn(0x7f91b00fdf20 msgr2=0x7f91b0100340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:14.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.313+0000 7f91b4f43640 1 -- 172.21.15.79:0/2338529290 shutdown_connections 2024-08-20T01:42:14.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.313+0000 7f91b4f43640 1 -- 172.21.15.79:0/2338529290 wait complete. 2024-08-20T01:42:14.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.314+0000 7f91b4f43640 1 Processor -- start 2024-08-20T01:42:14.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.314+0000 7f91b4f43640 1 -- start start 2024-08-20T01:42:14.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.314+0000 7f91b4f43640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91b0102660 0x7f91b01988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:14.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.314+0000 7f91b4f43640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91b01037b0 0x7f91b0198f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:14.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.314+0000 7f91b4f43640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91b0104170 0x7f91b0199b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:14.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.314+0000 7f91b4f43640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f91b010e180 con 0x7f91b0102660 2024-08-20T01:42:14.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.314+0000 7f91b4f43640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f91b010e000 con 0x7f91b0104170 2024-08-20T01:42:14.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.314+0000 7f91b4f43640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f91b010e300 con 0x7f91b01037b0 2024-08-20T01:42:14.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.314+0000 7f91ae59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91b0102660 0x7f91b01988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:14.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.314+0000 7f91ae59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91b0102660 0x7f91b01988d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42240/0 (socket says 172.21.15.79:42240) 2024-08-20T01:42:14.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.314+0000 7f91ae59c640 1 -- 172.21.15.79:0/2312666104 learned_addr learned my addr 172.21.15.79:0/2312666104 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:14.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.314+0000 7f91add9b640 1 --2- 172.21.15.79:0/2312666104 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91b01037b0 0x7f91b0198f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:14.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.314+0000 7f91aed9d640 1 --2- 172.21.15.79:0/2312666104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91b0104170 0x7f91b0199b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:14.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.314+0000 7f91ae59c640 1 -- 172.21.15.79:0/2312666104 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91b01037b0 msgr2=0x7f91b0198f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:14.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.314+0000 7f91ae59c640 1 --2- 172.21.15.79:0/2312666104 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91b01037b0 0x7f91b0198f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:14.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.314+0000 7f91ae59c640 1 -- 172.21.15.79:0/2312666104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91b0104170 msgr2=0x7f91b0199b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:14.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.314+0000 7f91ae59c640 1 --2- 172.21.15.79:0/2312666104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91b0104170 0x7f91b0199b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:14.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.314+0000 7f91ae59c640 1 -- 172.21.15.79:0/2312666104 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b019a410 con 0x7f91b0102660 2024-08-20T01:42:14.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.315+0000 7f91ae59c640 1 --2- 172.21.15.79:0/2312666104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91b0102660 0x7f91b01988d0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f91a000c920 tx=0x7f91a000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:14.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.315+0000 7f919f7fe640 1 -- 172.21.15.79:0/2312666104 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a0007c70 con 0x7f91b0102660 2024-08-20T01:42:14.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.315+0000 7f91b4f43640 1 -- 172.21.15.79:0/2312666104 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91b019a700 con 0x7f91b0102660 2024-08-20T01:42:14.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.315+0000 7f919f7fe640 1 -- 172.21.15.79:0/2312666104 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f91a0007e10 con 0x7f91b0102660 2024-08-20T01:42:14.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.315+0000 7f919f7fe640 1 -- 172.21.15.79:0/2312666104 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a00186f0 con 0x7f91b0102660 2024-08-20T01:42:14.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.315+0000 7f91b4f43640 1 -- 172.21.15.79:0/2312666104 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91b01a0dd0 con 0x7f91b0102660 2024-08-20T01:42:14.329 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.317+0000 7f919f7fe640 1 -- 172.21.15.79:0/2312666104 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f91a000f450 con 0x7f91b0102660 2024-08-20T01:42:14.329 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.318+0000 7f91b7e11740 1 Processor -- start 2024-08-20T01:42:14.329 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.318+0000 7f91b7e11740 1 -- start start 2024-08-20T01:42:14.329 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.318+0000 7f91b7e11740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5586c979d630 0x5586c979fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:14.329 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.318+0000 7f91b7e11740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5586c979ff60 0x5586c97a2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:14.329 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.318+0000 7f91b7e11740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586c97a29a0 0x5586c97a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:14.329 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.318+0000 7f91b7e11740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5586c9710360 con 0x5586c97a29a0 2024-08-20T01:42:14.329 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.318+0000 7f91b7e11740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5586c96ff860 con 0x5586c979d630 2024-08-20T01:42:14.330 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.318+0000 7f91b7e11740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5586c97038a0 con 0x5586c979ff60 2024-08-20T01:42:14.330 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.318+0000 7f91add9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586c97a29a0 0x5586c97a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:14.330 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.318+0000 7f91add9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586c97a29a0 0x5586c97a4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42248/0 (socket says 172.21.15.79:42248) 2024-08-20T01:42:14.330 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.318+0000 7f91add9b640 1 -- 172.21.15.79:0/605253672 learned_addr learned my addr 172.21.15.79:0/605253672 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:14.330 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.318+0000 7f919f7fe640 1 --2- 172.21.15.79:0/2312666104 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f91980b3bd0 0x7f91980b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:14.330 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.319+0000 7f91ae59c640 1 --2- 172.21.15.79:0/605253672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5586c979ff60 0x5586c97a2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:14.330 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.319+0000 7f91aed9d640 1 --2- 172.21.15.79:0/605253672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5586c979d630 0x5586c979fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:14.330 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.319+0000 7f91aed9d640 1 --2- 172.21.15.79:0/2312666104 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f91980b3bd0 0x7f91980b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:14.330 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.319+0000 7f91add9b640 1 -- 172.21.15.79:0/605253672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5586c979ff60 msgr2=0x5586c97a2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:14.330 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.319+0000 7f91add9b640 1 --2- 172.21.15.79:0/605253672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5586c979ff60 0x5586c97a2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.319+0000 7f91add9b640 1 -- 172.21.15.79:0/605253672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5586c979d630 msgr2=0x5586c979fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.319+0000 7f91add9b640 1 --2- 172.21.15.79:0/605253672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5586c979d630 0x5586c979fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.319+0000 7f91add9b640 1 -- 172.21.15.79:0/605253672 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586c96a6e40 con 0x5586c97a29a0 2024-08-20T01:42:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.319+0000 7f91aed9d640 1 --2- 172.21.15.79:0/605253672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5586c979d630 0x5586c979fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:42:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.319+0000 7f919f7fe640 1 -- 172.21.15.79:0/2312666104 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f91a00e3ce0 con 0x7f91b0102660 2024-08-20T01:42:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.319+0000 7f91add9b640 1 --2- 172.21.15.79:0/605253672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586c97a29a0 0x5586c97a4e60 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f91a400b760 tx=0x7f91a400bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f730b2a75f9624a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.319+0000 7f91aed9d640 1 --2- 172.21.15.79:0/2312666104 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f91980b3bd0 0x7f91980b6090 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f91a8005fe0 tx=0x7f91a8004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.319+0000 7f919cff9640 1 -- 172.21.15.79:0/605253672 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a4003dd0 con 0x5586c97a29a0 2024-08-20T01:42:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.319+0000 7f919cff9640 1 -- 172.21.15.79:0/605253672 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f91a4015070 con 0x5586c97a29a0 2024-08-20T01:42:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.319+0000 7f919cff9640 1 -- 172.21.15.79:0/605253672 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a4004cf0 con 0x5586c97a29a0 2024-08-20T01:42:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.320+0000 7f91b7e11740 1 -- 172.21.15.79:0/605253672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586c97a29a0 msgr2=0x5586c97a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:14.332 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.320+0000 7f91b7e11740 1 --2- 172.21.15.79:0/605253672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586c97a29a0 0x5586c97a4e60 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f91a400b760 tx=0x7f91a400bc20 comp rx=0 tx=0).stop 2024-08-20T01:42:14.332 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.320+0000 7f91b7e11740 1 -- 172.21.15.79:0/605253672 shutdown_connections 2024-08-20T01:42:14.332 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.320+0000 7f91b7e11740 1 --2- 172.21.15.79:0/605253672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586c97a29a0 0x5586c97a4e60 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:14.332 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.320+0000 7f91b7e11740 1 --2- 172.21.15.79:0/605253672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5586c979ff60 0x5586c97a2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:14.332 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.320+0000 7f91b7e11740 1 --2- 172.21.15.79:0/605253672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5586c979d630 0x5586c979fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:14.332 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.320+0000 7f91b7e11740 1 -- 172.21.15.79:0/605253672 >> 172.21.15.79:0/605253672 conn(0x5586c9798730 msgr2=0x5586c9799510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:14.332 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.320+0000 7f91b7e11740 1 -- 172.21.15.79:0/605253672 shutdown_connections 2024-08-20T01:42:14.332 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.320+0000 7f91b7e11740 1 -- 172.21.15.79:0/605253672 wait complete. 2024-08-20T01:42:14.332 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.320+0000 7f91b7e11740 1 -- start start 2024-08-20T01:42:14.332 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.321+0000 7f91b7e11740 1 Processor -- start 2024-08-20T01:42:14.333 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.321+0000 7f91b7e11740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5586c979d630 0x5586c97a6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:14.333 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.321+0000 7f91b7e11740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5586c979ff60 0x5586c97a74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:14.333 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.321+0000 7f91b7e11740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586c97a29a0 0x5586c97a8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:14.333 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.321+0000 7f91b7e11740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5586c9638ab0 con 0x5586c97a29a0 2024-08-20T01:42:14.333 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.321+0000 7f91b7e11740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5586c9686780 con 0x5586c979ff60 2024-08-20T01:42:14.333 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.321+0000 7f91b7e11740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5586c97a5980 con 0x5586c979d630 2024-08-20T01:42:14.333 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.321+0000 7f91b7e11740 10 client.0 _ll_register_callbacks cb 0x5586c940ea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:42:14.333 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.321+0000 7f91aed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586c97a29a0 0x5586c97a8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:14.333 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.321+0000 7f91aed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586c97a29a0 0x5586c97a8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42264/0 (socket says 172.21.15.79:42264) 2024-08-20T01:42:14.333 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.321+0000 7f91aed9d640 1 -- 172.21.15.79:0/2083286918 learned_addr learned my addr 172.21.15.79:0/2083286918 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.321+0000 7f91add9b640 1 --2- 172.21.15.79:0/2083286918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5586c979ff60 0x5586c97a74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.321+0000 7f91ae59c640 1 --2- 172.21.15.79:0/2083286918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5586c979d630 0x5586c97a6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.321+0000 7f91aed9d640 1 -- 172.21.15.79:0/2083286918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5586c979d630 msgr2=0x5586c97a6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.321+0000 7f91aed9d640 1 --2- 172.21.15.79:0/2083286918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5586c979d630 0x5586c97a6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.321+0000 7f91aed9d640 1 -- 172.21.15.79:0/2083286918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5586c979ff60 msgr2=0x5586c97a74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.321+0000 7f91aed9d640 1 --2- 172.21.15.79:0/2083286918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5586c979ff60 0x5586c97a74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.321+0000 7f91aed9d640 1 -- 172.21.15.79:0/2083286918 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586c9462790 con 0x5586c97a29a0 2024-08-20T01:42:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.322+0000 7f91aed9d640 1 --2- 172.21.15.79:0/2083286918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586c97a29a0 0x5586c97a8090 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f91a8035000 tx=0x7f91a80095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5aba1cad76a6d38 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.322+0000 7f9195ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:42:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.322+0000 7f9195ffb640 1 -- 172.21.15.79:0/2083286918 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a80309b0 con 0x5586c97a29a0 2024-08-20T01:42:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.322+0000 7f9195ffb640 1 -- 172.21.15.79:0/2083286918 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f91a8030b50 con 0x5586c97a29a0 2024-08-20T01:42:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.322+0000 7f91b7e11740 1 -- 172.21.15.79:0/2083286918 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5586c96aee00 con 0x5586c97a29a0 2024-08-20T01:42:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.322+0000 7f9195ffb640 1 -- 172.21.15.79:0/2083286918 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f91a8003e20 con 0x5586c97a29a0 2024-08-20T01:42:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.322+0000 7f91b7e11740 10 client.17001 fetch_fsmap learned FSMap version 38 2024-08-20T01:42:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.322+0000 7f91b7e11740 1 -- 172.21.15.79:0/2083286918 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5586c94db620 con 0x5586c97a29a0 2024-08-20T01:42:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.322+0000 7f9195ffb640 1 -- 172.21.15.79:0/2083286918 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5586c96aee00 con 0x5586c97a29a0 2024-08-20T01:42:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.322+0000 7f9195ffb640 1 -- 172.21.15.79:0/2083286918 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f91a8050030 con 0x5586c97a29a0 2024-08-20T01:42:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.322+0000 7f91b7e11740 10 client.17001 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:42:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.322+0000 7f91b7e11740 10 client.17001 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:42:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.322+0000 7f91b7e11740 20 client.17001 populate_metadata read hostname 'smithi079' 2024-08-20T01:42:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.322+0000 7f91b7e11740 1 --2- 172.21.15.79:0/2083286918 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5586c97b2700 0x5586c97b4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.322+0000 7f91b7e11740 4 client.17001 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:42:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.322+0000 7f91b7e11740 1 -- 172.21.15.79:0/2083286918 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5586c97122b0 con 0x5586c97b2700 2024-08-20T01:42:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.323+0000 7f91ae59c640 1 --2- 172.21.15.79:0/2083286918 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5586c97b2700 0x5586c97b4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.323+0000 7f91ae59c640 1 --2- 172.21.15.79:0/2083286918 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5586c97b2700 0x5586c97b4b80 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=236ea48ddc30a10b server_cookie=10ff69211ca099a0 in_seq=0 out_seq=0 2024-08-20T01:42:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.323+0000 7f9195ffb640 10 client.17001 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:42:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.324+0000 7f9195ffb640 1 -- 172.21.15.79:0/2083286918 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5586c97122b0 con 0x5586c97b2700 2024-08-20T01:42:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.324+0000 7f9195ffb640 10 client.17001 handle_command_reply: tid=0 2024-08-20T01:42:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.324+0000 7f91b7e11740 1 client.17001 shutdown 2024-08-20T01:42:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.324+0000 7f91b7e11740 1 -- 172.21.15.79:0/2083286918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586c97a29a0 msgr2=0x5586c97a8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.324+0000 7f91b7e11740 1 --2- 172.21.15.79:0/2083286918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586c97a29a0 0x5586c97a8090 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f91a8035000 tx=0x7f91a80095c0 comp rx=0 tx=0).stop 2024-08-20T01:42:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.324+0000 7f91b7e11740 1 -- 172.21.15.79:0/2083286918 shutdown_connections 2024-08-20T01:42:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.324+0000 7f91b7e11740 1 --2- 172.21.15.79:0/2083286918 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5586c97b2700 0x5586c97b4b80 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.324+0000 7f91b7e11740 1 --2- 172.21.15.79:0/2083286918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586c97a29a0 0x5586c97a8090 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.324+0000 7f91b7e11740 1 --2- 172.21.15.79:0/2083286918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5586c979ff60 0x5586c97a74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.324+0000 7f91b7e11740 1 --2- 172.21.15.79:0/2083286918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5586c979d630 0x5586c97a6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.324+0000 7f91b7e11740 1 -- 172.21.15.79:0/2083286918 >> 172.21.15.79:0/2083286918 conn(0x5586c9798730 msgr2=0x5586c9797850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.324+0000 7f9195ffb640 0 client.17001 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:42:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.324+0000 7f91b7e11740 1 -- 172.21.15.79:0/2083286918 shutdown_connections 2024-08-20T01:42:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.324+0000 7f91b7e11740 1 -- 172.21.15.79:0/2083286918 wait complete. 2024-08-20T01:42:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.324+0000 7f91b7e11740 20 client.17001 trim_cache size 0 max 16384 2024-08-20T01:42:14.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.339+0000 7f91b7e11740 1 Processor -- start 2024-08-20T01:42:14.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.339+0000 7f91b7e11740 1 -- start start 2024-08-20T01:42:14.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.339+0000 7f91b7e11740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5586c979d630 0x5586c97a5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:14.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.339+0000 7f91b7e11740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5586c979ff60 0x5586c97a6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:14.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.339+0000 7f91b7e11740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586c97a29a0 0x5586c97a2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:14.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.339+0000 7f91b7e11740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f91b01a99c0 con 0x5586c97a29a0 2024-08-20T01:42:14.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.339+0000 7f91b7e11740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f91b01ab500 con 0x5586c979d630 2024-08-20T01:42:14.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.339+0000 7f91b7e11740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f91b01aa090 con 0x5586c979ff60 2024-08-20T01:42:14.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.340+0000 7f91aed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586c97a29a0 0x5586c97a2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:14.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.340+0000 7f91aed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586c97a29a0 0x5586c97a2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42268/0 (socket says 172.21.15.79:42268) 2024-08-20T01:42:14.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.340+0000 7f91aed9d640 1 -- 172.21.15.79:0/3362976444 learned_addr learned my addr 172.21.15.79:0/3362976444 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:14.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.340+0000 7f91aed9d640 1 -- 172.21.15.79:0/3362976444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5586c979ff60 msgr2=0x5586c97a6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:14.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.340+0000 7f91ae59c640 1 --2- 172.21.15.79:0/3362976444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5586c979d630 0x5586c97a5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:14.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.340+0000 7f91aed9d640 1 --2- 172.21.15.79:0/3362976444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5586c979ff60 0x5586c97a6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:14.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.340+0000 7f91aed9d640 1 -- 172.21.15.79:0/3362976444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5586c979d630 msgr2=0x5586c97a5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:14.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.340+0000 7f91aed9d640 1 --2- 172.21.15.79:0/3362976444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5586c979d630 0x5586c97a5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:14.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.340+0000 7f91aed9d640 1 -- 172.21.15.79:0/3362976444 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586c9798560 con 0x5586c97a29a0 2024-08-20T01:42:14.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.340+0000 7f91aed9d640 1 --2- 172.21.15.79:0/3362976444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586c97a29a0 0x5586c97a2d80 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f91a80314e0 tx=0x7f91a8005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9141adaa9c7b16 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:14.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.340+0000 7f9197fff640 1 -- 172.21.15.79:0/3362976444 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a8060070 con 0x5586c97a29a0 2024-08-20T01:42:14.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.340+0000 7f9197fff640 1 -- 172.21.15.79:0/3362976444 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f91a8036040 con 0x5586c97a29a0 2024-08-20T01:42:14.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.340+0000 7f9197fff640 1 -- 172.21.15.79:0/3362976444 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a8047a30 con 0x5586c97a29a0 2024-08-20T01:42:14.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.341+0000 7f91b7e11740 1 -- 172.21.15.79:0/3362976444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586c97a29a0 msgr2=0x5586c97a2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:14.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.341+0000 7f91b7e11740 1 --2- 172.21.15.79:0/3362976444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586c97a29a0 0x5586c97a2d80 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f91a80314e0 tx=0x7f91a8005f10 comp rx=0 tx=0).stop 2024-08-20T01:42:14.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.341+0000 7f91b7e11740 1 -- 172.21.15.79:0/3362976444 shutdown_connections 2024-08-20T01:42:14.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.341+0000 7f91b7e11740 1 --2- 172.21.15.79:0/3362976444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586c97a29a0 0x5586c97a2d80 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:14.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.341+0000 7f91b7e11740 1 --2- 172.21.15.79:0/3362976444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5586c979ff60 0x5586c97a6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:14.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.341+0000 7f91b7e11740 1 --2- 172.21.15.79:0/3362976444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5586c979d630 0x5586c97a5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:14.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.341+0000 7f91b7e11740 1 -- 172.21.15.79:0/3362976444 >> 172.21.15.79:0/3362976444 conn(0x5586c9798730 msgr2=0x5586c9798f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:14.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.341+0000 7f91b7e11740 1 -- 172.21.15.79:0/3362976444 shutdown_connections 2024-08-20T01:42:14.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.341+0000 7f91b7e11740 1 -- 172.21.15.79:0/3362976444 wait complete. 2024-08-20T01:42:14.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.341+0000 7f91b7e11740 1 -- start start 2024-08-20T01:42:14.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.341+0000 7f91b7e11740 1 Processor -- start 2024-08-20T01:42:14.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.341+0000 7f91b7e11740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586c979d630 0x5586c97abab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:14.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.341+0000 7f91b7e11740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5586c979ff60 0x5586c97ac150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:14.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.342+0000 7f91b7e11740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5586c97a29a0 0x5586c97accb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:14.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.342+0000 7f91b7e11740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f91b01aae30 con 0x5586c979d630 2024-08-20T01:42:14.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.342+0000 7f91b7e11740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f91b01aa760 con 0x5586c979ff60 2024-08-20T01:42:14.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.342+0000 7f91b7e11740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f91b01a7a00 con 0x5586c97a29a0 2024-08-20T01:42:14.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.342+0000 7f91b7e11740 10 client.0 _ll_register_callbacks cb 0x7f91a8031890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:42:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.342+0000 7f91ae59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586c979d630 0x5586c97abab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.342+0000 7f91ae59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586c979d630 0x5586c97abab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42282/0 (socket says 172.21.15.79:42282) 2024-08-20T01:42:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.342+0000 7f91ae59c640 1 -- 172.21.15.79:0/2510080430 learned_addr learned my addr 172.21.15.79:0/2510080430 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.342+0000 7f91aed9d640 1 --2- 172.21.15.79:0/2510080430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5586c97a29a0 0x5586c97accb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.342+0000 7f91add9b640 1 --2- 172.21.15.79:0/2510080430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5586c979ff60 0x5586c97ac150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.342+0000 7f91ae59c640 1 -- 172.21.15.79:0/2510080430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5586c97a29a0 msgr2=0x5586c97accb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.342+0000 7f91ae59c640 1 --2- 172.21.15.79:0/2510080430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5586c97a29a0 0x5586c97accb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.342+0000 7f91ae59c640 1 -- 172.21.15.79:0/2510080430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5586c979ff60 msgr2=0x5586c97ac150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.342+0000 7f91ae59c640 1 --2- 172.21.15.79:0/2510080430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5586c979ff60 0x5586c97ac150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.342+0000 7f91ae59c640 1 -- 172.21.15.79:0/2510080430 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586c97ad4e0 con 0x5586c979d630 2024-08-20T01:42:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.342+0000 7f91aed9d640 1 --2- 172.21.15.79:0/2510080430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5586c97a29a0 0x5586c97accb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:42:14.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.342+0000 7f91ae59c640 1 --2- 172.21.15.79:0/2510080430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586c979d630 0x5586c97abab0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f91a001f000 tx=0x7f91a00aa810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fab0211a97e3157 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:14.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.342+0000 7f9195ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:42:14.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.342+0000 7f9195ffb640 1 -- 172.21.15.79:0/2510080430 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a00af240 con 0x5586c979d630 2024-08-20T01:42:14.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.342+0000 7f9195ffb640 1 -- 172.21.15.79:0/2510080430 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f91a00a7230 con 0x5586c979d630 2024-08-20T01:42:14.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.342+0000 7f91b7e11740 1 -- 172.21.15.79:0/2510080430 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91a8036040 con 0x5586c979d630 2024-08-20T01:42:14.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.342+0000 7f9195ffb640 1 -- 172.21.15.79:0/2510080430 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f91a00b3cf0 con 0x5586c979d630 2024-08-20T01:42:14.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.342+0000 7f91b7e11740 10 client.17007 fetch_fsmap learned FSMap version 38 2024-08-20T01:42:14.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.342+0000 7f91b7e11740 1 -- 172.21.15.79:0/2510080430 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5586c97ae920 con 0x5586c979d630 2024-08-20T01:42:14.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.343+0000 7f9195ffb640 1 -- 172.21.15.79:0/2510080430 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f91a8036040 con 0x5586c979d630 2024-08-20T01:42:14.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.343+0000 7f9195ffb640 1 -- 172.21.15.79:0/2510080430 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f91a00b3860 con 0x5586c979d630 2024-08-20T01:42:14.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.343+0000 7f91b7e11740 10 client.17007 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:42:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.343+0000 7f91b7e11740 10 client.17007 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:42:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.343+0000 7f91b7e11740 20 client.17007 populate_metadata read hostname 'smithi079' 2024-08-20T01:42:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.343+0000 7f91b7e11740 1 --2- 172.21.15.79:0/2510080430 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5586c981d4e0 0x5586c981f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.343+0000 7f91b7e11740 4 client.17007 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:42:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.343+0000 7f91b7e11740 1 -- 172.21.15.79:0/2510080430 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5586c970dd50 con 0x5586c981d4e0 2024-08-20T01:42:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.343+0000 7f91add9b640 1 --2- 172.21.15.79:0/2510080430 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5586c981d4e0 0x5586c981f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.343+0000 7f91add9b640 1 --2- 172.21.15.79:0/2510080430 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5586c981d4e0 0x5586c981f900 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf55e6b9c3e8b138 server_cookie=86ed1256d0ebe672 in_seq=0 out_seq=0 2024-08-20T01:42:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.343+0000 7f9195ffb640 10 client.17007 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:42:14.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.351+0000 7f9195ffb640 1 -- 172.21.15.79:0/2510080430 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5586c970dd50 con 0x5586c981d4e0 2024-08-20T01:42:14.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.351+0000 7f9195ffb640 10 client.17007 handle_command_reply: tid=0 2024-08-20T01:42:14.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.351+0000 7f91b7e11740 1 client.17007 shutdown 2024-08-20T01:42:14.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.351+0000 7f91b7e11740 1 -- 172.21.15.79:0/2510080430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586c979d630 msgr2=0x5586c97abab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:14.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.351+0000 7f91b7e11740 1 --2- 172.21.15.79:0/2510080430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586c979d630 0x5586c97abab0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f91a001f000 tx=0x7f91a00aa810 comp rx=0 tx=0).stop 2024-08-20T01:42:14.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.351+0000 7f91b7e11740 1 -- 172.21.15.79:0/2510080430 shutdown_connections 2024-08-20T01:42:14.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.351+0000 7f91b7e11740 1 --2- 172.21.15.79:0/2510080430 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5586c981d4e0 0x5586c981f900 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:14.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.351+0000 7f91b7e11740 1 --2- 172.21.15.79:0/2510080430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5586c97a29a0 0x5586c97accb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:14.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.351+0000 7f9195ffb640 0 client.17007 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:42:14.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.351+0000 7f91b7e11740 1 --2- 172.21.15.79:0/2510080430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5586c979ff60 0x5586c97ac150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:14.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.351+0000 7f91b7e11740 1 --2- 172.21.15.79:0/2510080430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5586c979d630 0x5586c97abab0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:14.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.351+0000 7f91b7e11740 1 -- 172.21.15.79:0/2510080430 >> 172.21.15.79:0/2510080430 conn(0x5586c9798730 msgr2=0x5586c97a5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:14.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.351+0000 7f91b7e11740 1 -- 172.21.15.79:0/2510080430 shutdown_connections 2024-08-20T01:42:14.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.351+0000 7f91b7e11740 1 -- 172.21.15.79:0/2510080430 wait complete. 2024-08-20T01:42:14.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.351+0000 7f91b7e11740 20 client.17007 trim_cache size 0 max 16384 2024-08-20T01:42:14.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:42:14.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:42:14.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:42:14.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:42:14.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.352+0000 7f91b4f43640 1 -- 172.21.15.79:0/2312666104 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f91980b3bd0 msgr2=0x7f91980b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:14.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.352+0000 7f91b4f43640 1 --2- 172.21.15.79:0/2312666104 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f91980b3bd0 0x7f91980b6090 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f91a8005fe0 tx=0x7f91a8004a40 comp rx=0 tx=0).stop 2024-08-20T01:42:14.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.352+0000 7f91b4f43640 1 -- 172.21.15.79:0/2312666104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91b0102660 msgr2=0x7f91b01988d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:14.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.352+0000 7f91b4f43640 1 --2- 172.21.15.79:0/2312666104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91b0102660 0x7f91b01988d0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f91a000c920 tx=0x7f91a000cde0 comp rx=0 tx=0).stop 2024-08-20T01:42:14.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.352+0000 7f91b4f43640 1 -- 172.21.15.79:0/2312666104 shutdown_connections 2024-08-20T01:42:14.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.352+0000 7f91b4f43640 1 --2- 172.21.15.79:0/2312666104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91b0104170 0x7f91b0199b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:14.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.352+0000 7f91b4f43640 1 --2- 172.21.15.79:0/2312666104 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f91980b3bd0 0x7f91980b6090 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:14.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.352+0000 7f91b4f43640 1 --2- 172.21.15.79:0/2312666104 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91b01037b0 0x7f91b0198f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:14.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.352+0000 7f91b4f43640 1 --2- 172.21.15.79:0/2312666104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91b0102660 0x7f91b01988d0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:14.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.352+0000 7f91b4f43640 1 -- 172.21.15.79:0/2312666104 >> 172.21.15.79:0/2312666104 conn(0x7f91b00fdf20 msgr2=0x7f91b0106ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:14.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.352+0000 7f91b4f43640 1 -- 172.21.15.79:0/2312666104 shutdown_connections 2024-08-20T01:42:14.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:14.352+0000 7f91b4f43640 1 -- 172.21.15.79:0/2312666104 wait complete. 2024-08-20T01:42:14.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:14 smithi081 ceph-mon[22209]: pgmap v494: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-08-20T01:42:14.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:14 smithi175 ceph-mon[22392]: pgmap v494: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-08-20T01:42:14.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:14 smithi079 ceph-mon[18656]: pgmap v494: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-08-20T01:42:16.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:16 smithi081 ceph-mon[22209]: pgmap v495: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 31 MiB/s wr, 25 op/s 2024-08-20T01:42:16.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:16 smithi175 ceph-mon[22392]: pgmap v495: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 31 MiB/s wr, 25 op/s 2024-08-20T01:42:16.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:16 smithi079 ceph-mon[18656]: pgmap v495: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 31 MiB/s wr, 25 op/s 2024-08-20T01:42:18.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:18 smithi081 ceph-mon[22209]: pgmap v496: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 29 MiB/s wr, 22 op/s 2024-08-20T01:42:18.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:18 smithi175 ceph-mon[22392]: pgmap v496: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 29 MiB/s wr, 22 op/s 2024-08-20T01:42:18.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:18 smithi079 ceph-mon[18656]: pgmap v496: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 29 MiB/s wr, 22 op/s 2024-08-20T01:42:20.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:20 smithi081 ceph-mon[22209]: pgmap v497: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 32 MiB/s wr, 26 op/s 2024-08-20T01:42:20.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:20 smithi175 ceph-mon[22392]: pgmap v497: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 32 MiB/s wr, 26 op/s 2024-08-20T01:42:20.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:20 smithi079 ceph-mon[18656]: pgmap v497: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 32 MiB/s wr, 26 op/s 2024-08-20T01:42:22.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:22 smithi081 ceph-mon[22209]: pgmap v498: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 23 op/s 2024-08-20T01:42:22.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:22 smithi175 ceph-mon[22392]: pgmap v498: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 23 op/s 2024-08-20T01:42:22.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:22 smithi079 ceph-mon[18656]: pgmap v498: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 23 op/s 2024-08-20T01:42:24.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:24 smithi175 ceph-mon[22392]: pgmap v499: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 29 MiB/s wr, 22 op/s 2024-08-20T01:42:24.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:24 smithi079 ceph-mon[18656]: pgmap v499: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 29 MiB/s wr, 22 op/s 2024-08-20T01:42:24.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:24 smithi081 ceph-mon[22209]: pgmap v499: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 29 MiB/s wr, 22 op/s 2024-08-20T01:42:25.527 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:42:25.798 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:42:26.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.362+0000 7f15e58ab640 1 -- 172.21.15.79:0/1871963049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15e010cdc0 msgr2=0x7f15e010f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:26.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.362+0000 7f15e58ab640 1 --2- 172.21.15.79:0/1871963049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15e010cdc0 0x7f15e010f260 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f15d8009ca0 tx=0x7f15d802a8c0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.363+0000 7f15e58ab640 1 -- 172.21.15.79:0/1871963049 shutdown_connections 2024-08-20T01:42:26.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.363+0000 7f15e58ab640 1 --2- 172.21.15.79:0/1871963049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15e010cdc0 0x7f15e010f260 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.363+0000 7f15e58ab640 1 --2- 172.21.15.79:0/1871963049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15e0101f00 0x7f15e010c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.363+0000 7f15e58ab640 1 --2- 172.21.15.79:0/1871963049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15e0101500 0x7f15e01018e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.363+0000 7f15e58ab640 1 -- 172.21.15.79:0/1871963049 >> 172.21.15.79:0/1871963049 conn(0x7f15e0076bd0 msgr2=0x7f15e0076fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:26.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.363+0000 7f15e58ab640 1 -- 172.21.15.79:0/1871963049 shutdown_connections 2024-08-20T01:42:26.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.363+0000 7f15e58ab640 1 -- 172.21.15.79:0/1871963049 wait complete. 2024-08-20T01:42:26.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.363+0000 7f15e58ab640 1 Processor -- start 2024-08-20T01:42:26.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.364+0000 7f15e58ab640 1 -- start start 2024-08-20T01:42:26.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.364+0000 7f15e58ab640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15e0101500 0x7f15e0198f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:26.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.364+0000 7f15e58ab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15e0101f00 0x7f15e01994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:26.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.364+0000 7f15e58ab640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15e010cdc0 0x7f15e019e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:26.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.364+0000 7f15e58ab640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f15e01128d0 con 0x7f15e010cdc0 2024-08-20T01:42:26.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.364+0000 7f15e58ab640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f15e0112750 con 0x7f15e0101f00 2024-08-20T01:42:26.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.364+0000 7f15e58ab640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f15e0112a50 con 0x7f15e0101500 2024-08-20T01:42:26.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.364+0000 7f15deffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15e0101500 0x7f15e0198f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:26.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.364+0000 7f15df7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15e010cdc0 0x7f15e019e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:26.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.364+0000 7f15deffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15e0101500 0x7f15e0198f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:43192/0 (socket says 172.21.15.79:43192) 2024-08-20T01:42:26.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.364+0000 7f15deffd640 1 -- 172.21.15.79:0/2717922157 learned_addr learned my addr 172.21.15.79:0/2717922157 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:26.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.364+0000 7f15de7fc640 1 --2- 172.21.15.79:0/2717922157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15e0101f00 0x7f15e01994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:26.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.364+0000 7f15df7fe640 1 -- 172.21.15.79:0/2717922157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15e0101500 msgr2=0x7f15e0198f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:26.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.364+0000 7f15df7fe640 1 --2- 172.21.15.79:0/2717922157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15e0101500 0x7f15e0198f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.364+0000 7f15df7fe640 1 -- 172.21.15.79:0/2717922157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15e0101f00 msgr2=0x7f15e01994b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:26.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.364+0000 7f15df7fe640 1 --2- 172.21.15.79:0/2717922157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15e0101f00 0x7f15e01994b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.364+0000 7f15df7fe640 1 -- 172.21.15.79:0/2717922157 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15e019f020 con 0x7f15e010cdc0 2024-08-20T01:42:26.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.365+0000 7f15deffd640 1 --2- 172.21.15.79:0/2717922157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15e0101500 0x7f15e0198f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:42:26.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.365+0000 7f15df7fe640 1 --2- 172.21.15.79:0/2717922157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15e010cdc0 0x7f15e019e850 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f15d8009ca0 tx=0x7f15d8009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:26.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.365+0000 7f15e48a9640 1 -- 172.21.15.79:0/2717922157 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d8003c70 con 0x7f15e010cdc0 2024-08-20T01:42:26.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.365+0000 7f15e48a9640 1 -- 172.21.15.79:0/2717922157 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15d8003e10 con 0x7f15e010cdc0 2024-08-20T01:42:26.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.365+0000 7f15e58ab640 1 -- 172.21.15.79:0/2717922157 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15e019f2b0 con 0x7f15e010cdc0 2024-08-20T01:42:26.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.365+0000 7f15e48a9640 1 -- 172.21.15.79:0/2717922157 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d8030b20 con 0x7f15e010cdc0 2024-08-20T01:42:26.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.365+0000 7f15e58ab640 1 -- 172.21.15.79:0/2717922157 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15e01a59d0 con 0x7f15e010cdc0 2024-08-20T01:42:26.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.368+0000 7f15e48a9640 1 -- 172.21.15.79:0/2717922157 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f15d8030cc0 con 0x7f15e010cdc0 2024-08-20T01:42:26.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.368+0000 7f15e7ca4740 1 Processor -- start 2024-08-20T01:42:26.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.368+0000 7f15e7ca4740 1 -- start start 2024-08-20T01:42:26.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.368+0000 7f15e7ca4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f823dd4830 0x55f823dd4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:26.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.368+0000 7f15e7ca4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f823dd5150 0x55f823de4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:26.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.368+0000 7f15e7ca4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f823de54f0 0x55f823de78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:26.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.368+0000 7f15e7ca4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f823d4b8e0 con 0x55f823dd5150 2024-08-20T01:42:26.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.368+0000 7f15e7ca4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f823d3ade0 con 0x55f823de54f0 2024-08-20T01:42:26.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.368+0000 7f15e7ca4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f823d3ee20 con 0x55f823dd4830 2024-08-20T01:42:26.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.369+0000 7f15e48a9640 1 --2- 172.21.15.79:0/2717922157 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f15c80b3c50 0x7f15c80b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:26.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.369+0000 7f15deffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f823dd5150 0x55f823de4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:26.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.369+0000 7f15deffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f823dd5150 0x55f823de4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33224/0 (socket says 172.21.15.79:33224) 2024-08-20T01:42:26.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.369+0000 7f15deffd640 1 -- 172.21.15.79:0/772254998 learned_addr learned my addr 172.21.15.79:0/772254998 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:26.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.369+0000 7f15df7fe640 1 --2- 172.21.15.79:0/2717922157 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f15c80b3c50 0x7f15c80b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:26.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.369+0000 7f15de7fc640 1 --2- 172.21.15.79:0/772254998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f823de54f0 0x55f823de78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:26.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.369+0000 7f15e48a9640 1 -- 172.21.15.79:0/2717922157 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f15d8104f70 con 0x7f15e010cdc0 2024-08-20T01:42:26.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.369+0000 7f15deffd640 1 -- 172.21.15.79:0/772254998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f823dd4830 msgr2=0x55f823dd4c10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:42:26.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.369+0000 7f15deffd640 1 --2- 172.21.15.79:0/772254998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f823dd4830 0x55f823dd4c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.369+0000 7f15deffd640 1 -- 172.21.15.79:0/772254998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f823de54f0 msgr2=0x55f823de78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:26.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.369+0000 7f15deffd640 1 --2- 172.21.15.79:0/772254998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f823de54f0 0x55f823de78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.369+0000 7f15deffd640 1 -- 172.21.15.79:0/772254998 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f823a9a650 con 0x55f823dd5150 2024-08-20T01:42:26.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.369+0000 7f15deffd640 1 --2- 172.21.15.79:0/772254998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f823dd5150 0x55f823de4fb0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f15d0011650 tx=0x7f15d0011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b87fdb5042326136 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:26.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.369+0000 7f15df7fe640 1 --2- 172.21.15.79:0/2717922157 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f15c80b3c50 0x7f15c80b6110 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f15d80c91d0 tx=0x7f15d8091270 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:26.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.369+0000 7f15c5ffb640 1 -- 172.21.15.79:0/772254998 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d001e070 con 0x55f823dd5150 2024-08-20T01:42:26.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.370+0000 7f15c5ffb640 1 -- 172.21.15.79:0/772254998 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15d0019430 con 0x55f823dd5150 2024-08-20T01:42:26.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.370+0000 7f15c5ffb640 1 -- 172.21.15.79:0/772254998 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d000e610 con 0x55f823dd5150 2024-08-20T01:42:26.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.370+0000 7f15e7ca4740 1 -- 172.21.15.79:0/772254998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f823dd5150 msgr2=0x55f823de4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:26.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.370+0000 7f15e7ca4740 1 --2- 172.21.15.79:0/772254998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f823dd5150 0x55f823de4fb0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f15d0011650 tx=0x7f15d0011b10 comp rx=0 tx=0).stop 2024-08-20T01:42:26.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.370+0000 7f15e7ca4740 1 -- 172.21.15.79:0/772254998 shutdown_connections 2024-08-20T01:42:26.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.370+0000 7f15e7ca4740 1 --2- 172.21.15.79:0/772254998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f823de54f0 0x55f823de78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.370+0000 7f15e7ca4740 1 --2- 172.21.15.79:0/772254998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f823dd5150 0x55f823de4fb0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.370+0000 7f15e7ca4740 1 --2- 172.21.15.79:0/772254998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f823dd4830 0x55f823dd4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.370+0000 7f15e7ca4740 1 -- 172.21.15.79:0/772254998 >> 172.21.15.79:0/772254998 conn(0x55f823dd2660 msgr2=0x55f823dd3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:26.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.370+0000 7f15e7ca4740 1 -- 172.21.15.79:0/772254998 shutdown_connections 2024-08-20T01:42:26.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.370+0000 7f15e7ca4740 1 -- 172.21.15.79:0/772254998 wait complete. 2024-08-20T01:42:26.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.371+0000 7f15e7ca4740 1 -- start start 2024-08-20T01:42:26.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.371+0000 7f15e7ca4740 1 Processor -- start 2024-08-20T01:42:26.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.371+0000 7f15e7ca4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f823dd4830 0x55f823de24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:26.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.371+0000 7f15e7ca4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f823dd5150 0x55f823de29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:26.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.371+0000 7f15e7ca4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f823de54f0 0x55f823de2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:26.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.371+0000 7f15e7ca4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f823b9d700 con 0x55f823dd4830 2024-08-20T01:42:26.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.371+0000 7f15e7ca4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f823cc17c0 con 0x55f823de54f0 2024-08-20T01:42:26.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.371+0000 7f15e7ca4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f823de81f0 con 0x55f823dd5150 2024-08-20T01:42:26.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.371+0000 7f15e7ca4740 10 client.0 _ll_register_callbacks cb 0x55f823d346b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:42:26.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.371+0000 7f15de7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f823dd4830 0x55f823de24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:26.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.372+0000 7f15de7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f823dd4830 0x55f823de24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33236/0 (socket says 172.21.15.79:33236) 2024-08-20T01:42:26.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.372+0000 7f15de7fc640 1 -- 172.21.15.79:0/148829419 learned_addr learned my addr 172.21.15.79:0/148829419 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:26.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.372+0000 7f15de7fc640 1 --2- 172.21.15.79:0/148829419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f823de54f0 0x55f823de2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:26.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.372+0000 7f15de7fc640 1 -- 172.21.15.79:0/148829419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f823dd5150 msgr2=0x55f823de29f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:42:26.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.372+0000 7f15de7fc640 1 --2- 172.21.15.79:0/148829419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f823dd5150 0x55f823de29f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.372+0000 7f15de7fc640 1 -- 172.21.15.79:0/148829419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f823de54f0 msgr2=0x55f823de2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:26.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.372+0000 7f15de7fc640 1 --2- 172.21.15.79:0/148829419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f823de54f0 0x55f823de2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.372+0000 7f15de7fc640 1 -- 172.21.15.79:0/148829419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f823df15d0 con 0x55f823dd4830 2024-08-20T01:42:26.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.372+0000 7f15de7fc640 1 --2- 172.21.15.79:0/148829419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f823dd4830 0x55f823de24b0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f15d4005ca0 tx=0x7f15d40042b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc89bd669bbf956c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:26.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.372+0000 7f15beffd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:42:26.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.372+0000 7f15beffd640 1 -- 172.21.15.79:0/148829419 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d4005020 con 0x55f823dd4830 2024-08-20T01:42:26.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.372+0000 7f15beffd640 1 -- 172.21.15.79:0/148829419 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f15d40051c0 con 0x55f823dd4830 2024-08-20T01:42:26.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.372+0000 7f15e7ca4740 1 -- 172.21.15.79:0/148829419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f823cea100 con 0x55f823dd4830 2024-08-20T01:42:26.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.373+0000 7f15beffd640 1 -- 172.21.15.79:0/148829419 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f15d4027050 con 0x55f823dd4830 2024-08-20T01:42:26.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.373+0000 7f15e7ca4740 10 client.17019 fetch_fsmap learned FSMap version 38 2024-08-20T01:42:26.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.373+0000 7f15e7ca4740 1 -- 172.21.15.79:0/148829419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55f823df3f80 con 0x55f823dd4830 2024-08-20T01:42:26.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.373+0000 7f15beffd640 1 -- 172.21.15.79:0/148829419 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55f823cea100 con 0x55f823dd4830 2024-08-20T01:42:26.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.373+0000 7f15beffd640 1 -- 172.21.15.79:0/148829419 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f15d40054c0 con 0x55f823dd4830 2024-08-20T01:42:26.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.373+0000 7f15e7ca4740 10 client.17019 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:42:26.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.373+0000 7f15e7ca4740 10 client.17019 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:42:26.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.373+0000 7f15e7ca4740 20 client.17019 populate_metadata read hostname 'smithi079' 2024-08-20T01:42:26.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.373+0000 7f15e7ca4740 1 --2- 172.21.15.79:0/148829419 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f823df58a0 0x55f823df7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:26.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.373+0000 7f15e7ca4740 4 client.17019 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:42:26.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.373+0000 7f15e7ca4740 1 -- 172.21.15.79:0/148829419 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f823d4d830 con 0x55f823df58a0 2024-08-20T01:42:26.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.373+0000 7f15deffd640 1 --2- 172.21.15.79:0/148829419 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f823df58a0 0x55f823df7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:26.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.374+0000 7f15beffd640 10 client.17019 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:42:26.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.374+0000 7f15deffd640 1 --2- 172.21.15.79:0/148829419 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f823df58a0 0x55f823df7d20 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=908dd50c5d075aef server_cookie=2b92713088413983 in_seq=0 out_seq=0 2024-08-20T01:42:26.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.375+0000 7f15beffd640 1 -- 172.21.15.79:0/148829419 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f823d4d830 con 0x55f823df58a0 2024-08-20T01:42:26.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.375+0000 7f15beffd640 10 client.17019 handle_command_reply: tid=0 2024-08-20T01:42:26.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.375+0000 7f15e7ca4740 1 client.17019 shutdown 2024-08-20T01:42:26.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.375+0000 7f15e7ca4740 1 -- 172.21.15.79:0/148829419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f823dd4830 msgr2=0x55f823de24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:26.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.375+0000 7f15e7ca4740 1 --2- 172.21.15.79:0/148829419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f823dd4830 0x55f823de24b0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f15d4005ca0 tx=0x7f15d40042b0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.375+0000 7f15e7ca4740 1 -- 172.21.15.79:0/148829419 shutdown_connections 2024-08-20T01:42:26.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.375+0000 7f15e7ca4740 1 --2- 172.21.15.79:0/148829419 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f823df58a0 0x55f823df7d20 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.375+0000 7f15e7ca4740 1 --2- 172.21.15.79:0/148829419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f823de54f0 0x55f823de2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.375+0000 7f15e7ca4740 1 --2- 172.21.15.79:0/148829419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f823dd5150 0x55f823de29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.375+0000 7f15e7ca4740 1 --2- 172.21.15.79:0/148829419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f823dd4830 0x55f823de24b0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.375+0000 7f15e7ca4740 1 -- 172.21.15.79:0/148829419 >> 172.21.15.79:0/148829419 conn(0x55f823dd2660 msgr2=0x55f823dd8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:26.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.375+0000 7f15beffd640 0 client.17019 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:42:26.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.375+0000 7f15e7ca4740 1 -- 172.21.15.79:0/148829419 shutdown_connections 2024-08-20T01:42:26.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.375+0000 7f15e7ca4740 1 -- 172.21.15.79:0/148829419 wait complete. 2024-08-20T01:42:26.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.375+0000 7f15e7ca4740 20 client.17019 trim_cache size 0 max 16384 2024-08-20T01:42:26.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.398+0000 7f15e7ca4740 1 Processor -- start 2024-08-20T01:42:26.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.398+0000 7f15e7ca4740 1 -- start start 2024-08-20T01:42:26.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.398+0000 7f15e7ca4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f823dd4830 0x55f823dcd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:26.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.398+0000 7f15e7ca4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f823dd5150 0x55f823ddff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:26.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.398+0000 7f15e7ca4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f823de54f0 0x55f823de0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:26.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.398+0000 7f15e7ca4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f15e01abe80 con 0x55f823dd4830 2024-08-20T01:42:26.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.398+0000 7f15e7ca4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f15e01ad9c0 con 0x55f823dd5150 2024-08-20T01:42:26.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.398+0000 7f15e7ca4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f15e01ac550 con 0x55f823de54f0 2024-08-20T01:42:26.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.399+0000 7f15de7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f823dd4830 0x55f823dcd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:26.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.399+0000 7f15de7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f823dd4830 0x55f823dcd380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33242/0 (socket says 172.21.15.79:33242) 2024-08-20T01:42:26.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.399+0000 7f15de7fc640 1 -- 172.21.15.79:0/1206805648 learned_addr learned my addr 172.21.15.79:0/1206805648 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:26.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.399+0000 7f15deffd640 1 --2- 172.21.15.79:0/1206805648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f823dd5150 0x55f823ddff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:26.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.399+0000 7f15de7fc640 1 --2- 172.21.15.79:0/1206805648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f823de54f0 0x55f823de0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:26.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.399+0000 7f15de7fc640 1 -- 172.21.15.79:0/1206805648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f823de54f0 msgr2=0x55f823de0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:26.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.399+0000 7f15de7fc640 1 --2- 172.21.15.79:0/1206805648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f823de54f0 0x55f823de0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.399+0000 7f15de7fc640 1 -- 172.21.15.79:0/1206805648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f823dd5150 msgr2=0x55f823ddff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:26.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.399+0000 7f15de7fc640 1 --2- 172.21.15.79:0/1206805648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f823dd5150 0x55f823ddff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.399+0000 7f15de7fc640 1 -- 172.21.15.79:0/1206805648 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f823de09b0 con 0x55f823dd4830 2024-08-20T01:42:26.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.399+0000 7f15deffd640 1 --2- 172.21.15.79:0/1206805648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f823dd5150 0x55f823ddff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:42:26.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.399+0000 7f15de7fc640 1 --2- 172.21.15.79:0/1206805648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f823dd4830 0x55f823dcd380 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f15d40059f0 tx=0x7f15d400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76379c77a126228c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:26.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.399+0000 7f15c57fa640 1 -- 172.21.15.79:0/1206805648 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d4032020 con 0x55f823dd4830 2024-08-20T01:42:26.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.399+0000 7f15c57fa640 1 -- 172.21.15.79:0/1206805648 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15d4024070 con 0x55f823dd4830 2024-08-20T01:42:26.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.399+0000 7f15c57fa640 1 -- 172.21.15.79:0/1206805648 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d40129a0 con 0x55f823dd4830 2024-08-20T01:42:26.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.400+0000 7f15e7ca4740 1 -- 172.21.15.79:0/1206805648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f823dd4830 msgr2=0x55f823dcd380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:26.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.400+0000 7f15e7ca4740 1 --2- 172.21.15.79:0/1206805648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f823dd4830 0x55f823dcd380 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f15d40059f0 tx=0x7f15d400dd40 comp rx=0 tx=0).stop 2024-08-20T01:42:26.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.400+0000 7f15e7ca4740 1 -- 172.21.15.79:0/1206805648 shutdown_connections 2024-08-20T01:42:26.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.400+0000 7f15e7ca4740 1 --2- 172.21.15.79:0/1206805648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f823de54f0 0x55f823de0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.400+0000 7f15e7ca4740 1 --2- 172.21.15.79:0/1206805648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f823dd5150 0x55f823ddff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.400+0000 7f15e7ca4740 1 --2- 172.21.15.79:0/1206805648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f823dd4830 0x55f823dcd380 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.400+0000 7f15e7ca4740 1 -- 172.21.15.79:0/1206805648 >> 172.21.15.79:0/1206805648 conn(0x55f823dd2660 msgr2=0x55f823dd3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:26.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.400+0000 7f15e7ca4740 1 -- 172.21.15.79:0/1206805648 shutdown_connections 2024-08-20T01:42:26.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.400+0000 7f15e7ca4740 1 -- 172.21.15.79:0/1206805648 wait complete. 2024-08-20T01:42:26.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.401+0000 7f15e7ca4740 1 -- start start 2024-08-20T01:42:26.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.401+0000 7f15e7ca4740 1 Processor -- start 2024-08-20T01:42:26.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.401+0000 7f15e7ca4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f823dd4830 0x55f823ded480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:26.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.401+0000 7f15e7ca4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f823dd5150 0x55f823ded9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:26.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.401+0000 7f15e7ca4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f823de54f0 0x55f823dfc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:26.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.401+0000 7f15e7ca4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f15e01ad2f0 con 0x55f823dd4830 2024-08-20T01:42:26.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.401+0000 7f15e7ca4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f15e01acc20 con 0x55f823de54f0 2024-08-20T01:42:26.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.401+0000 7f15e7ca4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f15e01a9e60 con 0x55f823dd5150 2024-08-20T01:42:26.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.401+0000 7f15e7ca4740 10 client.0 _ll_register_callbacks cb 0x7f15d4004200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:42:26.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.401+0000 7f15de7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f823dd4830 0x55f823ded480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:26.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.401+0000 7f15de7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f823dd4830 0x55f823ded480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33246/0 (socket says 172.21.15.79:33246) 2024-08-20T01:42:26.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.401+0000 7f15de7fc640 1 -- 172.21.15.79:0/369726501 learned_addr learned my addr 172.21.15.79:0/369726501 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:26.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.402+0000 7f15deffd640 1 --2- 172.21.15.79:0/369726501 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f823dd5150 0x55f823ded9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:26.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.402+0000 7f15de7fc640 1 --2- 172.21.15.79:0/369726501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f823de54f0 0x55f823dfc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:26.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.402+0000 7f15de7fc640 1 -- 172.21.15.79:0/369726501 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f823dd5150 msgr2=0x55f823ded9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:26.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.402+0000 7f15de7fc640 1 --2- 172.21.15.79:0/369726501 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f823dd5150 0x55f823ded9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.402+0000 7f15de7fc640 1 -- 172.21.15.79:0/369726501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f823de54f0 msgr2=0x55f823dfc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:26.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.402+0000 7f15de7fc640 1 --2- 172.21.15.79:0/369726501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f823de54f0 0x55f823dfc5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.402+0000 7f15de7fc640 1 -- 172.21.15.79:0/369726501 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f823dfe0c0 con 0x55f823dd4830 2024-08-20T01:42:26.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.402+0000 7f15de7fc640 1 --2- 172.21.15.79:0/369726501 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f823dd4830 0x55f823ded480 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f15d40058c0 tx=0x7f15d4005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9370a230c19057f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:26.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.402+0000 7f15beffd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:42:26.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.402+0000 7f15beffd640 1 -- 172.21.15.79:0/369726501 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d403f060 con 0x55f823dd4830 2024-08-20T01:42:26.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.402+0000 7f15beffd640 1 -- 172.21.15.79:0/369726501 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f15d40124b0 con 0x55f823dd4830 2024-08-20T01:42:26.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.402+0000 7f15e7ca4740 1 -- 172.21.15.79:0/369726501 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15d4024070 con 0x55f823dd4830 2024-08-20T01:42:26.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.402+0000 7f15beffd640 1 -- 172.21.15.79:0/369726501 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f15d4032050 con 0x55f823dd4830 2024-08-20T01:42:26.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.402+0000 7f15e7ca4740 10 client.17025 fetch_fsmap learned FSMap version 38 2024-08-20T01:42:26.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.402+0000 7f15e7ca4740 1 -- 172.21.15.79:0/369726501 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55f823e5fa90 con 0x55f823dd4830 2024-08-20T01:42:26.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.403+0000 7f15beffd640 1 -- 172.21.15.79:0/369726501 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15d4024070 con 0x55f823dd4830 2024-08-20T01:42:26.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.403+0000 7f15beffd640 1 -- 172.21.15.79:0/369726501 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f15d40205c0 con 0x55f823dd4830 2024-08-20T01:42:26.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.403+0000 7f15e7ca4740 10 client.17025 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:42:26.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.403+0000 7f15e7ca4740 10 client.17025 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:42:26.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.403+0000 7f15e7ca4740 20 client.17025 populate_metadata read hostname 'smithi079' 2024-08-20T01:42:26.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.403+0000 7f15e7ca4740 1 --2- 172.21.15.79:0/369726501 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f823e601b0 0x55f823e625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:26.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.403+0000 7f15e7ca4740 4 client.17025 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:42:26.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.403+0000 7f15e7ca4740 1 -- 172.21.15.79:0/369726501 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f823d492d0 con 0x55f823e601b0 2024-08-20T01:42:26.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.403+0000 7f15deffd640 1 --2- 172.21.15.79:0/369726501 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f823e601b0 0x55f823e625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:26.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.404+0000 7f15beffd640 10 client.17025 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:42:26.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.404+0000 7f15deffd640 1 --2- 172.21.15.79:0/369726501 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f823e601b0 0x55f823e625d0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f9ea0f8d03a5510 server_cookie=ee7e1007f2a88115 in_seq=0 out_seq=0 2024-08-20T01:42:26.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.404+0000 7f15beffd640 1 -- 172.21.15.79:0/369726501 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55f823d492d0 con 0x55f823e601b0 2024-08-20T01:42:26.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.404+0000 7f15beffd640 10 client.17025 handle_command_reply: tid=0 2024-08-20T01:42:26.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.404+0000 7f15e7ca4740 1 client.17025 shutdown 2024-08-20T01:42:26.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.404+0000 7f15e7ca4740 1 -- 172.21.15.79:0/369726501 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f823dd4830 msgr2=0x55f823ded480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:26.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.404+0000 7f15e7ca4740 1 --2- 172.21.15.79:0/369726501 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f823dd4830 0x55f823ded480 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f15d40058c0 tx=0x7f15d4005850 comp rx=0 tx=0).stop 2024-08-20T01:42:26.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.404+0000 7f15e7ca4740 1 -- 172.21.15.79:0/369726501 shutdown_connections 2024-08-20T01:42:26.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.404+0000 7f15e7ca4740 1 --2- 172.21.15.79:0/369726501 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f823e601b0 0x55f823e625d0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.404+0000 7f15e7ca4740 1 --2- 172.21.15.79:0/369726501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f823de54f0 0x55f823dfc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.404+0000 7f15e7ca4740 1 --2- 172.21.15.79:0/369726501 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f823dd5150 0x55f823ded9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.404+0000 7f15beffd640 0 client.17025 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:42:26.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.404+0000 7f15e7ca4740 1 --2- 172.21.15.79:0/369726501 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f823dd4830 0x55f823ded480 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.404+0000 7f15e7ca4740 1 -- 172.21.15.79:0/369726501 >> 172.21.15.79:0/369726501 conn(0x55f823dd2660 msgr2=0x55f823de0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:26.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.404+0000 7f15e7ca4740 1 -- 172.21.15.79:0/369726501 shutdown_connections 2024-08-20T01:42:26.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.405+0000 7f15e7ca4740 1 -- 172.21.15.79:0/369726501 wait complete. 2024-08-20T01:42:26.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.405+0000 7f15e7ca4740 20 client.17025 trim_cache size 0 max 16384 2024-08-20T01:42:26.412 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:42:26.412 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-08-20T01:42:26.412 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-08-20T01:42:26.412 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:42:26.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.405+0000 7f15e58ab640 1 -- 172.21.15.79:0/2717922157 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f15c80b3c50 msgr2=0x7f15c80b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:26.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.405+0000 7f15e58ab640 1 --2- 172.21.15.79:0/2717922157 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f15c80b3c50 0x7f15c80b6110 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f15d80c91d0 tx=0x7f15d8091270 comp rx=0 tx=0).stop 2024-08-20T01:42:26.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.405+0000 7f15e58ab640 1 -- 172.21.15.79:0/2717922157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15e010cdc0 msgr2=0x7f15e019e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:26.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.405+0000 7f15e58ab640 1 --2- 172.21.15.79:0/2717922157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15e010cdc0 0x7f15e019e850 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f15d8009ca0 tx=0x7f15d8009360 comp rx=0 tx=0).stop 2024-08-20T01:42:26.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.405+0000 7f15e58ab640 1 -- 172.21.15.79:0/2717922157 shutdown_connections 2024-08-20T01:42:26.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.405+0000 7f15e58ab640 1 --2- 172.21.15.79:0/2717922157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15e010cdc0 0x7f15e019e850 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.405+0000 7f15e58ab640 1 --2- 172.21.15.79:0/2717922157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15e0101f00 0x7f15e01994b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.405+0000 7f15e58ab640 1 --2- 172.21.15.79:0/2717922157 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f15c80b3c50 0x7f15c80b6110 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.405+0000 7f15e58ab640 1 --2- 172.21.15.79:0/2717922157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15e0101500 0x7f15e0198f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:26.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.405+0000 7f15e58ab640 1 -- 172.21.15.79:0/2717922157 >> 172.21.15.79:0/2717922157 conn(0x7f15e0076bd0 msgr2=0x7f15e00ff5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:26.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.406+0000 7f15e58ab640 1 -- 172.21.15.79:0/2717922157 shutdown_connections 2024-08-20T01:42:26.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:26.406+0000 7f15e58ab640 1 -- 172.21.15.79:0/2717922157 wait complete. 2024-08-20T01:42:26.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:26 smithi175 ceph-mon[22392]: pgmap v500: 97 pgs: 97 active+clean; 7.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 31 MiB/s wr, 26 op/s 2024-08-20T01:42:26.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:26 smithi079 ceph-mon[18656]: pgmap v500: 97 pgs: 97 active+clean; 7.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 31 MiB/s wr, 26 op/s 2024-08-20T01:42:26.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:26 smithi081 ceph-mon[22209]: pgmap v500: 97 pgs: 97 active+clean; 7.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 31 MiB/s wr, 26 op/s 2024-08-20T01:42:27.318 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T01:42:27.318 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:42:27.456 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.453+0000 7fc6d98a1640 1 -- 172.21.15.79:0/3385440570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6d4104170 msgr2=0x7fc6d410aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:27.456 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.453+0000 7fc6d98a1640 1 --2- 172.21.15.79:0/3385440570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6d4104170 0x7fc6d410aaf0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc009930 tx=0x7fc6cc02a420 comp rx=0 tx=0).stop 2024-08-20T01:42:27.456 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.453+0000 7fc6d98a1640 1 -- 172.21.15.79:0/3385440570 shutdown_connections 2024-08-20T01:42:27.456 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.453+0000 7fc6d98a1640 1 --2- 172.21.15.79:0/3385440570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6d4104170 0x7fc6d410aaf0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:27.456 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.453+0000 7fc6d98a1640 1 --2- 172.21.15.79:0/3385440570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6d41037b0 0x7fc6d4103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:27.456 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.453+0000 7fc6d98a1640 1 --2- 172.21.15.79:0/3385440570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6d4102660 0x7fc6d4102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:27.456 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.453+0000 7fc6d98a1640 1 -- 172.21.15.79:0/3385440570 >> 172.21.15.79:0/3385440570 conn(0x7fc6d40fdf20 msgr2=0x7fc6d4100340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:27.456 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.453+0000 7fc6d98a1640 1 -- 172.21.15.79:0/3385440570 shutdown_connections 2024-08-20T01:42:27.456 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.453+0000 7fc6d98a1640 1 -- 172.21.15.79:0/3385440570 wait complete. 2024-08-20T01:42:27.457 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.454+0000 7fc6d98a1640 1 Processor -- start 2024-08-20T01:42:27.458 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.454+0000 7fc6d98a1640 1 -- start start 2024-08-20T01:42:27.458 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.454+0000 7fc6d98a1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6d4102660 0x7fc6d4198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:27.458 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.454+0000 7fc6d98a1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6d41037b0 0x7fc6d4198f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:27.459 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.454+0000 7fc6d98a1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6d4104170 0x7fc6d4199ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:27.459 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.454+0000 7fc6d98a1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d410e160 con 0x7fc6d4104170 2024-08-20T01:42:27.459 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.454+0000 7fc6d98a1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d410dfe0 con 0x7fc6d41037b0 2024-08-20T01:42:27.459 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.454+0000 7fc6d98a1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d410e2e0 con 0x7fc6d4102660 2024-08-20T01:42:27.459 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.454+0000 7fc6d27fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6d41037b0 0x7fc6d4198f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:27.459 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.454+0000 7fc6d2ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6d4102660 0x7fc6d4198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:27.459 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.454+0000 7fc6d37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6d4104170 0x7fc6d4199ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:27.459 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.454+0000 7fc6d27fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6d41037b0 0x7fc6d4198f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:55478/0 (socket says 172.21.15.79:55478) 2024-08-20T01:42:27.459 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.454+0000 7fc6d27fc640 1 -- 172.21.15.79:0/2862396231 learned_addr learned my addr 172.21.15.79:0/2862396231 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:27.459 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.455+0000 7fc6d27fc640 1 -- 172.21.15.79:0/2862396231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6d4102660 msgr2=0x7fc6d4198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:27.459 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.455+0000 7fc6d27fc640 1 --2- 172.21.15.79:0/2862396231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6d4102660 0x7fc6d4198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:27.459 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.455+0000 7fc6d27fc640 1 -- 172.21.15.79:0/2862396231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6d4104170 msgr2=0x7fc6d4199ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:27.460 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.455+0000 7fc6d27fc640 1 --2- 172.21.15.79:0/2862396231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6d4104170 0x7fc6d4199ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:27.460 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.455+0000 7fc6d27fc640 1 -- 172.21.15.79:0/2862396231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6d419a460 con 0x7fc6d41037b0 2024-08-20T01:42:27.460 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.455+0000 7fc6d27fc640 1 --2- 172.21.15.79:0/2862396231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6d41037b0 0x7fc6d4198f70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc6c800d950 tx=0x7fc6c800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:27.460 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.455+0000 7fc6d889f640 1 -- 172.21.15.79:0/2862396231 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c8017030 con 0x7fc6d41037b0 2024-08-20T01:42:27.460 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.455+0000 7fc6d889f640 1 -- 172.21.15.79:0/2862396231 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc6c8004020 con 0x7fc6d41037b0 2024-08-20T01:42:27.460 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.455+0000 7fc6d98a1640 1 -- 172.21.15.79:0/2862396231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6d419a750 con 0x7fc6d41037b0 2024-08-20T01:42:27.460 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.455+0000 7fc6d889f640 1 -- 172.21.15.79:0/2862396231 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c80055d0 con 0x7fc6d41037b0 2024-08-20T01:42:27.460 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.455+0000 7fc6d98a1640 1 -- 172.21.15.79:0/2862396231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6d41a0e20 con 0x7fc6d41037b0 2024-08-20T01:42:27.461 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.459+0000 7fc6dc68e740 1 Processor -- start 2024-08-20T01:42:27.461 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.459+0000 7fc6d889f640 1 -- 172.21.15.79:0/2862396231 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc6c8009a30 con 0x7fc6d41037b0 2024-08-20T01:42:27.462 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.460+0000 7fc6dc68e740 1 -- start start 2024-08-20T01:42:27.463 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.460+0000 7fc6dc68e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee62e2f8d0 0x55ee62e31cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:27.463 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.460+0000 7fc6dc68e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ee62e32200 0x55ee62e345f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:27.463 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.460+0000 7fc6dc68e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee62e34c40 0x55ee62e37100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:27.463 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.460+0000 7fc6dc68e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ee62da2360 con 0x55ee62e32200 2024-08-20T01:42:27.463 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.460+0000 7fc6dc68e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ee62d91860 con 0x55ee62e34c40 2024-08-20T01:42:27.463 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.460+0000 7fc6dc68e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ee62d958a0 con 0x55ee62e2f8d0 2024-08-20T01:42:27.463 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.461+0000 7fc6d889f640 1 --2- 172.21.15.79:0/2862396231 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc6bc0b3c50 0x7fc6bc0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:27.463 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.461+0000 7fc6d2ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ee62e32200 0x55ee62e345f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:27.464 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.461+0000 7fc6d2ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ee62e32200 0x55ee62e345f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33270/0 (socket says 172.21.15.79:33270) 2024-08-20T01:42:27.464 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.461+0000 7fc6d2ffd640 1 -- 172.21.15.79:0/2062164133 learned_addr learned my addr 172.21.15.79:0/2062164133 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:27.464 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.461+0000 7fc6d37fe640 1 --2- 172.21.15.79:0/2862396231 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc6bc0b3c50 0x7fc6bc0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:27.465 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.461+0000 7fc6d37fe640 1 --2- 172.21.15.79:0/2062164133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee62e2f8d0 0x55ee62e31cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:27.465 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.461+0000 7fc6d889f640 1 -- 172.21.15.79:0/2862396231 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc6c80e35e0 con 0x7fc6d41037b0 2024-08-20T01:42:27.465 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.461+0000 7fc6d2ffd640 1 -- 172.21.15.79:0/2062164133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee62e2f8d0 msgr2=0x55ee62e31cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:27.465 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.461+0000 7fc6d2ffd640 1 --2- 172.21.15.79:0/2062164133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee62e2f8d0 0x55ee62e31cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:27.465 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.461+0000 7fc6d2ffd640 1 -- 172.21.15.79:0/2062164133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee62e34c40 msgr2=0x55ee62e37100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:27.465 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.461+0000 7fc6d2ffd640 1 --2- 172.21.15.79:0/2062164133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee62e34c40 0x55ee62e37100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:27.465 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.461+0000 7fc6d2ffd640 1 -- 172.21.15.79:0/2062164133 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee62d38e40 con 0x55ee62e32200 2024-08-20T01:42:27.465 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.462+0000 7fc6d2ffd640 1 --2- 172.21.15.79:0/2062164133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ee62e32200 0x55ee62e345f0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4009fa0 tx=0x7fc6c4011980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd7878706a77318f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:27.465 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.462+0000 7fc6d37fe640 1 --2- 172.21.15.79:0/2862396231 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc6bc0b3c50 0x7fc6bc0b6110 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc005ab0 tx=0x7fc6cc005e60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:27.465 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.462+0000 7fc6b9ffb640 1 -- 172.21.15.79:0/2062164133 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c4027070 con 0x55ee62e32200 2024-08-20T01:42:27.465 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.462+0000 7fc6b9ffb640 1 -- 172.21.15.79:0/2062164133 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc6c401ac30 con 0x55ee62e32200 2024-08-20T01:42:27.465 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.462+0000 7fc6b9ffb640 1 -- 172.21.15.79:0/2062164133 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c400f420 con 0x55ee62e32200 2024-08-20T01:42:27.469 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.463+0000 7fc6dc68e740 1 -- 172.21.15.79:0/2062164133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ee62e32200 msgr2=0x55ee62e345f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:27.469 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.463+0000 7fc6dc68e740 1 --2- 172.21.15.79:0/2062164133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ee62e32200 0x55ee62e345f0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4009fa0 tx=0x7fc6c4011980 comp rx=0 tx=0).stop 2024-08-20T01:42:27.469 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.463+0000 7fc6dc68e740 1 -- 172.21.15.79:0/2062164133 shutdown_connections 2024-08-20T01:42:27.470 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.463+0000 7fc6dc68e740 1 --2- 172.21.15.79:0/2062164133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee62e34c40 0x55ee62e37100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:27.470 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.463+0000 7fc6dc68e740 1 --2- 172.21.15.79:0/2062164133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ee62e32200 0x55ee62e345f0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:27.470 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.463+0000 7fc6dc68e740 1 --2- 172.21.15.79:0/2062164133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee62e2f8d0 0x55ee62e31cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:27.470 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.463+0000 7fc6dc68e740 1 -- 172.21.15.79:0/2062164133 >> 172.21.15.79:0/2062164133 conn(0x55ee62e2aa20 msgr2=0x55ee62e2b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:27.470 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.463+0000 7fc6dc68e740 1 -- 172.21.15.79:0/2062164133 shutdown_connections 2024-08-20T01:42:27.470 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.463+0000 7fc6dc68e740 1 -- 172.21.15.79:0/2062164133 wait complete. 2024-08-20T01:42:27.470 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.464+0000 7fc6dc68e740 1 -- start start 2024-08-20T01:42:27.470 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.464+0000 7fc6dc68e740 1 Processor -- start 2024-08-20T01:42:27.470 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.464+0000 7fc6dc68e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee62e2f8d0 0x55ee62e39160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:27.470 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.464+0000 7fc6dc68e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee62e32200 0x55ee62e39800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:27.470 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.464+0000 7fc6dc68e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ee62e34c40 0x55ee62e3a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:27.471 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.464+0000 7fc6dc68e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ee62ccaab0 con 0x55ee62e34c40 2024-08-20T01:42:27.471 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.464+0000 7fc6dc68e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ee62d18780 con 0x55ee62e2f8d0 2024-08-20T01:42:27.471 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.464+0000 7fc6dc68e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ee62e37c20 con 0x55ee62e32200 2024-08-20T01:42:27.471 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.464+0000 7fc6dc68e740 10 client.0 _ll_register_callbacks cb 0x55ee62aa0a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:42:27.471 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.465+0000 7fc6d37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ee62e34c40 0x55ee62e3a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:27.471 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.465+0000 7fc6d2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee62e2f8d0 0x55ee62e39160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:27.471 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.465+0000 7fc6d37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ee62e34c40 0x55ee62e3a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33286/0 (socket says 172.21.15.79:33286) 2024-08-20T01:42:27.471 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.465+0000 7fc6d37fe640 1 -- 172.21.15.79:0/1718902871 learned_addr learned my addr 172.21.15.79:0/1718902871 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:27.471 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.465+0000 7fc6d27fc640 1 --2- 172.21.15.79:0/1718902871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee62e32200 0x55ee62e39800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:27.471 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.465+0000 7fc6d37fe640 1 -- 172.21.15.79:0/1718902871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee62e32200 msgr2=0x55ee62e39800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:27.471 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.465+0000 7fc6d37fe640 1 --2- 172.21.15.79:0/1718902871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee62e32200 0x55ee62e39800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:27.471 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.465+0000 7fc6d37fe640 1 -- 172.21.15.79:0/1718902871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee62e2f8d0 msgr2=0x55ee62e39160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:27.471 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.465+0000 7fc6d37fe640 1 --2- 172.21.15.79:0/1718902871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee62e2f8d0 0x55ee62e39160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:27.472 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.465+0000 7fc6d37fe640 1 -- 172.21.15.79:0/1718902871 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee62af4790 con 0x55ee62e34c40 2024-08-20T01:42:27.472 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.465+0000 7fc6d27fc640 1 --2- 172.21.15.79:0/1718902871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee62e32200 0x55ee62e39800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:42:27.472 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.465+0000 7fc6d2ffd640 1 --2- 172.21.15.79:0/1718902871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee62e2f8d0 0x55ee62e39160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:42:27.472 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.465+0000 7fc6d37fe640 1 --2- 172.21.15.79:0/1718902871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ee62e34c40 0x55ee62e3a3d0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc009930 tx=0x7fc6cc031420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6662ad02170fb9d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:27.472 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.465+0000 7fc6b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:42:27.472 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.465+0000 7fc6b2ffd640 1 -- 172.21.15.79:0/1718902871 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc053060 con 0x55ee62e34c40 2024-08-20T01:42:27.472 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.466+0000 7fc6b2ffd640 1 -- 172.21.15.79:0/1718902871 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc6cc043050 con 0x55ee62e34c40 2024-08-20T01:42:27.472 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.466+0000 7fc6dc68e740 1 -- 172.21.15.79:0/1718902871 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ee62d40e00 con 0x55ee62e34c40 2024-08-20T01:42:27.472 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.466+0000 7fc6b2ffd640 1 -- 172.21.15.79:0/1718902871 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fc6cc035040 con 0x55ee62e34c40 2024-08-20T01:42:27.472 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.466+0000 7fc6dc68e740 10 client.17037 fetch_fsmap learned FSMap version 38 2024-08-20T01:42:27.472 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.466+0000 7fc6dc68e740 1 -- 172.21.15.79:0/1718902871 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55ee62b6d620 con 0x55ee62e34c40 2024-08-20T01:42:27.472 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.466+0000 7fc6b2ffd640 1 -- 172.21.15.79:0/1718902871 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55ee62d40e00 con 0x55ee62e34c40 2024-08-20T01:42:27.473 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.466+0000 7fc6b2ffd640 1 -- 172.21.15.79:0/1718902871 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7fc6cc03d510 con 0x55ee62e34c40 2024-08-20T01:42:27.473 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.466+0000 7fc6dc68e740 10 client.17037 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:42:27.473 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.466+0000 7fc6dc68e740 10 client.17037 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:42:27.473 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.466+0000 7fc6dc68e740 20 client.17037 populate_metadata read hostname 'smithi079' 2024-08-20T01:42:27.473 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.466+0000 7fc6dc68e740 1 --2- 172.21.15.79:0/1718902871 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55ee62e449a0 0x55ee62e46e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:27.473 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.466+0000 7fc6dc68e740 4 client.17037 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:42:27.473 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.466+0000 7fc6dc68e740 1 -- 172.21.15.79:0/1718902871 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee62da42b0 con 0x55ee62e449a0 2024-08-20T01:42:27.473 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.467+0000 7fc6d2ffd640 1 --2- 172.21.15.79:0/1718902871 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55ee62e449a0 0x55ee62e46e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:27.473 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.467+0000 7fc6d2ffd640 1 --2- 172.21.15.79:0/1718902871 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55ee62e449a0 0x55ee62e46e10 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d9a1555677651d3 server_cookie=a122e80af0d72502 in_seq=0 out_seq=0 2024-08-20T01:42:27.473 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.467+0000 7fc6b2ffd640 10 client.17037 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:42:27.475 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.468+0000 7fc6b2ffd640 1 -- 172.21.15.79:0/1718902871 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ee62da42b0 con 0x55ee62e449a0 2024-08-20T01:42:27.475 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.468+0000 7fc6b2ffd640 10 client.17037 handle_command_reply: tid=0 2024-08-20T01:42:27.475 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.468+0000 7fc6dc68e740 1 client.17037 shutdown 2024-08-20T01:42:27.475 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.468+0000 7fc6dc68e740 1 -- 172.21.15.79:0/1718902871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ee62e34c40 msgr2=0x55ee62e3a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:27.475 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.468+0000 7fc6dc68e740 1 --2- 172.21.15.79:0/1718902871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ee62e34c40 0x55ee62e3a3d0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc009930 tx=0x7fc6cc031420 comp rx=0 tx=0).stop 2024-08-20T01:42:27.475 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.468+0000 7fc6dc68e740 1 -- 172.21.15.79:0/1718902871 shutdown_connections 2024-08-20T01:42:27.475 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.468+0000 7fc6dc68e740 1 --2- 172.21.15.79:0/1718902871 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55ee62e449a0 0x55ee62e46e10 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:27.475 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.468+0000 7fc6dc68e740 1 --2- 172.21.15.79:0/1718902871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ee62e34c40 0x55ee62e3a3d0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:27.475 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.468+0000 7fc6b2ffd640 0 client.17037 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:42:27.476 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.468+0000 7fc6dc68e740 1 --2- 172.21.15.79:0/1718902871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee62e32200 0x55ee62e39800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:27.476 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.468+0000 7fc6dc68e740 1 --2- 172.21.15.79:0/1718902871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee62e2f8d0 0x55ee62e39160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:27.476 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.468+0000 7fc6dc68e740 1 -- 172.21.15.79:0/1718902871 >> 172.21.15.79:0/1718902871 conn(0x55ee62e2aa20 msgr2=0x55ee62e29ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:27.476 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.469+0000 7fc6dc68e740 1 -- 172.21.15.79:0/1718902871 shutdown_connections 2024-08-20T01:42:27.476 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.469+0000 7fc6dc68e740 1 -- 172.21.15.79:0/1718902871 wait complete. 2024-08-20T01:42:27.476 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.469+0000 7fc6dc68e740 20 client.17037 trim_cache size 0 max 16384 2024-08-20T01:42:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.486+0000 7fc6dc68e740 1 Processor -- start 2024-08-20T01:42:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.486+0000 7fc6dc68e740 1 -- start start 2024-08-20T01:42:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.486+0000 7fc6dc68e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee62e2f8d0 0x55ee62e2b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.486+0000 7fc6dc68e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ee62e32200 0x55ee62e2eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.486+0000 7fc6dc68e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee62e34c40 0x55ee62e350d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.486+0000 7fc6dc68e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d41a7950 con 0x55ee62e32200 2024-08-20T01:42:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.486+0000 7fc6dc68e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d41a9490 con 0x55ee62e2f8d0 2024-08-20T01:42:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.486+0000 7fc6dc68e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d41a8020 con 0x55ee62e34c40 2024-08-20T01:42:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.486+0000 7fc6d27fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ee62e32200 0x55ee62e2eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.486+0000 7fc6d27fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ee62e32200 0x55ee62e2eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33292/0 (socket says 172.21.15.79:33292) 2024-08-20T01:42:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.486+0000 7fc6d27fc640 1 -- 172.21.15.79:0/2903965026 learned_addr learned my addr 172.21.15.79:0/2903965026 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.486+0000 7fc6d37fe640 1 --2- 172.21.15.79:0/2903965026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee62e34c40 0x55ee62e350d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.486+0000 7fc6d2ffd640 1 --2- 172.21.15.79:0/2903965026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee62e2f8d0 0x55ee62e2b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.486+0000 7fc6d27fc640 1 -- 172.21.15.79:0/2903965026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee62e34c40 msgr2=0x55ee62e350d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.486+0000 7fc6d27fc640 1 --2- 172.21.15.79:0/2903965026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee62e34c40 0x55ee62e350d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:27.491 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.486+0000 7fc6d27fc640 1 -- 172.21.15.79:0/2903965026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee62e2f8d0 msgr2=0x55ee62e2b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:27.491 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.486+0000 7fc6d27fc640 1 --2- 172.21.15.79:0/2903965026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee62e2f8d0 0x55ee62e2b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:27.491 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.486+0000 7fc6d27fc640 1 -- 172.21.15.79:0/2903965026 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee62e38c60 con 0x55ee62e32200 2024-08-20T01:42:27.491 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.486+0000 7fc6d2ffd640 1 --2- 172.21.15.79:0/2903965026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee62e2f8d0 0x55ee62e2b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:42:27.491 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.487+0000 7fc6d27fc640 1 --2- 172.21.15.79:0/2903965026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ee62e32200 0x55ee62e2eef0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fc6c80aa1e0 tx=0x7fc6c80a9ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a35c11f955d4e24 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:27.491 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.487+0000 7fc6b97fa640 1 -- 172.21.15.79:0/2903965026 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c80c4070 con 0x55ee62e32200 2024-08-20T01:42:27.491 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.487+0000 7fc6b97fa640 1 -- 172.21.15.79:0/2903965026 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc6c80cd070 con 0x55ee62e32200 2024-08-20T01:42:27.491 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.487+0000 7fc6b97fa640 1 -- 172.21.15.79:0/2903965026 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c80b1e60 con 0x55ee62e32200 2024-08-20T01:42:27.494 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.488+0000 7fc6dc68e740 1 -- 172.21.15.79:0/2903965026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ee62e32200 msgr2=0x55ee62e2eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:27.495 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.488+0000 7fc6dc68e740 1 --2- 172.21.15.79:0/2903965026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ee62e32200 0x55ee62e2eef0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fc6c80aa1e0 tx=0x7fc6c80a9ff0 comp rx=0 tx=0).stop 2024-08-20T01:42:27.495 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.488+0000 7fc6dc68e740 1 -- 172.21.15.79:0/2903965026 shutdown_connections 2024-08-20T01:42:27.495 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.488+0000 7fc6dc68e740 1 --2- 172.21.15.79:0/2903965026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee62e34c40 0x55ee62e350d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:27.495 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.488+0000 7fc6dc68e740 1 --2- 172.21.15.79:0/2903965026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ee62e32200 0x55ee62e2eef0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:27.495 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.488+0000 7fc6dc68e740 1 --2- 172.21.15.79:0/2903965026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee62e2f8d0 0x55ee62e2b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:27.495 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.488+0000 7fc6dc68e740 1 -- 172.21.15.79:0/2903965026 >> 172.21.15.79:0/2903965026 conn(0x55ee62e2aa20 msgr2=0x55ee62e2b280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:27.495 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.488+0000 7fc6dc68e740 1 -- 172.21.15.79:0/2903965026 shutdown_connections 2024-08-20T01:42:27.495 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.488+0000 7fc6dc68e740 1 -- 172.21.15.79:0/2903965026 wait complete. 2024-08-20T01:42:27.495 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.488+0000 7fc6dc68e740 1 -- start start 2024-08-20T01:42:27.495 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.488+0000 7fc6dc68e740 1 Processor -- start 2024-08-20T01:42:27.495 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.489+0000 7fc6dc68e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee62e2f8d0 0x55ee62e40bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:27.495 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.489+0000 7fc6dc68e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ee62e32200 0x55ee62e3f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:27.496 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.489+0000 7fc6dc68e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee62e34c40 0x55ee62e3fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:27.496 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.489+0000 7fc6dc68e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d41a8dc0 con 0x55ee62e32200 2024-08-20T01:42:27.496 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.489+0000 7fc6dc68e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d41a86f0 con 0x55ee62e34c40 2024-08-20T01:42:27.496 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.489+0000 7fc6dc68e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d41a5930 con 0x55ee62e2f8d0 2024-08-20T01:42:27.496 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.489+0000 7fc6dc68e740 10 client.0 _ll_register_callbacks cb 0x7fc6cc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:42:27.496 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.489+0000 7fc6d27fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ee62e32200 0x55ee62e3f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:27.496 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.489+0000 7fc6d27fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ee62e32200 0x55ee62e3f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33302/0 (socket says 172.21.15.79:33302) 2024-08-20T01:42:27.496 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.489+0000 7fc6d27fc640 1 -- 172.21.15.79:0/1294132489 learned_addr learned my addr 172.21.15.79:0/1294132489 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:27.496 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.489+0000 7fc6d2ffd640 1 --2- 172.21.15.79:0/1294132489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee62e2f8d0 0x55ee62e40bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:27.496 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.489+0000 7fc6d37fe640 1 --2- 172.21.15.79:0/1294132489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee62e34c40 0x55ee62e3fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:27.496 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.489+0000 7fc6d27fc640 1 -- 172.21.15.79:0/1294132489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee62e2f8d0 msgr2=0x55ee62e40bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:27.496 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.489+0000 7fc6d27fc640 1 --2- 172.21.15.79:0/1294132489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee62e2f8d0 0x55ee62e40bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.489+0000 7fc6d27fc640 1 -- 172.21.15.79:0/1294132489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee62e34c40 msgr2=0x55ee62e3fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.489+0000 7fc6d27fc640 1 --2- 172.21.15.79:0/1294132489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee62e34c40 0x55ee62e3fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.489+0000 7fc6d27fc640 1 -- 172.21.15.79:0/1294132489 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee62e2a850 con 0x55ee62e32200 2024-08-20T01:42:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.489+0000 7fc6d37fe640 1 --2- 172.21.15.79:0/1294132489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee62e34c40 0x55ee62e3fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:42:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.489+0000 7fc6d27fc640 1 --2- 172.21.15.79:0/1294132489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ee62e32200 0x55ee62e3f8d0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fc6c80aa470 tx=0x7fc6c8005790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf14a9036e78c8d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.489+0000 7fc6b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:42:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.489+0000 7fc6b2ffd640 1 -- 172.21.15.79:0/1294132489 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c80c9070 con 0x55ee62e32200 2024-08-20T01:42:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.490+0000 7fc6dc68e740 1 -- 172.21.15.79:0/1294132489 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ee62d9fd50 con 0x55ee62e32200 2024-08-20T01:42:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.490+0000 7fc6b2ffd640 1 -- 172.21.15.79:0/1294132489 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc6c80bfd90 con 0x55ee62e32200 2024-08-20T01:42:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.490+0000 7fc6b2ffd640 1 -- 172.21.15.79:0/1294132489 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fc6c80c4040 con 0x55ee62e32200 2024-08-20T01:42:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.490+0000 7fc6dc68e740 10 client.17043 fetch_fsmap learned FSMap version 38 2024-08-20T01:42:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.490+0000 7fc6dc68e740 1 -- 172.21.15.79:0/1294132489 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55ee62eaf6f0 con 0x55ee62e32200 2024-08-20T01:42:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.490+0000 7fc6b2ffd640 1 -- 172.21.15.79:0/1294132489 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55ee62d9fd50 con 0x55ee62e32200 2024-08-20T01:42:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.490+0000 7fc6b2ffd640 1 -- 172.21.15.79:0/1294132489 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7fc6c80a5e50 con 0x55ee62e32200 2024-08-20T01:42:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.490+0000 7fc6dc68e740 10 client.17043 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:42:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.490+0000 7fc6dc68e740 10 client.17043 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:42:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.490+0000 7fc6dc68e740 20 client.17043 populate_metadata read hostname 'smithi079' 2024-08-20T01:42:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.490+0000 7fc6dc68e740 1 --2- 172.21.15.79:0/1294132489 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55ee62e449a0 0x55ee62eb1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.490+0000 7fc6dc68e740 4 client.17043 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:42:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.490+0000 7fc6dc68e740 1 -- 172.21.15.79:0/1294132489 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ee62d9d490 con 0x55ee62e449a0 2024-08-20T01:42:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.490+0000 7fc6d2ffd640 1 --2- 172.21.15.79:0/1294132489 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55ee62e449a0 0x55ee62eb1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.491+0000 7fc6b2ffd640 10 client.17043 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:42:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.491+0000 7fc6d2ffd640 1 --2- 172.21.15.79:0/1294132489 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55ee62e449a0 0x55ee62eb1f20 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd18e73567870bb7 server_cookie=569f59d395089116 in_seq=0 out_seq=0 2024-08-20T01:42:27.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.499+0000 7fc6b2ffd640 1 -- 172.21.15.79:0/1294132489 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ee62d9d490 con 0x55ee62e449a0 2024-08-20T01:42:27.502 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.499+0000 7fc6b2ffd640 10 client.17043 handle_command_reply: tid=0 2024-08-20T01:42:27.502 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.499+0000 7fc6dc68e740 1 client.17043 shutdown 2024-08-20T01:42:27.502 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.499+0000 7fc6dc68e740 1 -- 172.21.15.79:0/1294132489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ee62e32200 msgr2=0x55ee62e3f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:27.502 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.499+0000 7fc6dc68e740 1 --2- 172.21.15.79:0/1294132489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ee62e32200 0x55ee62e3f8d0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fc6c80aa470 tx=0x7fc6c8005790 comp rx=0 tx=0).stop 2024-08-20T01:42:27.502 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.499+0000 7fc6dc68e740 1 -- 172.21.15.79:0/1294132489 shutdown_connections 2024-08-20T01:42:27.502 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.499+0000 7fc6dc68e740 1 --2- 172.21.15.79:0/1294132489 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55ee62e449a0 0x55ee62eb1f20 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:27.502 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.499+0000 7fc6dc68e740 1 --2- 172.21.15.79:0/1294132489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee62e34c40 0x55ee62e3fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:27.502 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.499+0000 7fc6dc68e740 1 --2- 172.21.15.79:0/1294132489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ee62e32200 0x55ee62e3f8d0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:27.502 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.499+0000 7fc6dc68e740 1 --2- 172.21.15.79:0/1294132489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee62e2f8d0 0x55ee62e40bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:27.502 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.499+0000 7fc6dc68e740 1 -- 172.21.15.79:0/1294132489 >> 172.21.15.79:0/1294132489 conn(0x55ee62e2aa20 msgr2=0x55ee62e292c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:27.502 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.499+0000 7fc6b2ffd640 0 client.17043 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:42:27.502 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.499+0000 7fc6dc68e740 1 -- 172.21.15.79:0/1294132489 shutdown_connections 2024-08-20T01:42:27.503 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.499+0000 7fc6dc68e740 1 -- 172.21.15.79:0/1294132489 wait complete. 2024-08-20T01:42:27.503 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.499+0000 7fc6dc68e740 20 client.17043 trim_cache size 0 max 16384 2024-08-20T01:42:27.503 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:42:27.503 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:42:27.503 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:42:27.503 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:42:27.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.500+0000 7fc6d98a1640 1 -- 172.21.15.79:0/2862396231 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc6bc0b3c50 msgr2=0x7fc6bc0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:27.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.500+0000 7fc6d98a1640 1 --2- 172.21.15.79:0/2862396231 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc6bc0b3c50 0x7fc6bc0b6110 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc005ab0 tx=0x7fc6cc005e60 comp rx=0 tx=0).stop 2024-08-20T01:42:27.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.500+0000 7fc6d98a1640 1 -- 172.21.15.79:0/2862396231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6d41037b0 msgr2=0x7fc6d4198f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:27.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.500+0000 7fc6d98a1640 1 --2- 172.21.15.79:0/2862396231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6d41037b0 0x7fc6d4198f70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc6c800d950 tx=0x7fc6c800de10 comp rx=0 tx=0).stop 2024-08-20T01:42:27.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.500+0000 7fc6d98a1640 1 -- 172.21.15.79:0/2862396231 shutdown_connections 2024-08-20T01:42:27.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.500+0000 7fc6d98a1640 1 --2- 172.21.15.79:0/2862396231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6d4104170 0x7fc6d4199ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:27.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.500+0000 7fc6d98a1640 1 --2- 172.21.15.79:0/2862396231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6d41037b0 0x7fc6d4198f70 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:27.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.500+0000 7fc6d98a1640 1 --2- 172.21.15.79:0/2862396231 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc6bc0b3c50 0x7fc6bc0b6110 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:27.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.500+0000 7fc6d98a1640 1 --2- 172.21.15.79:0/2862396231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6d4102660 0x7fc6d4198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:27.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.500+0000 7fc6d98a1640 1 -- 172.21.15.79:0/2862396231 >> 172.21.15.79:0/2862396231 conn(0x7fc6d40fdf20 msgr2=0x7fc6d4106ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:27.505 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.500+0000 7fc6d98a1640 1 -- 172.21.15.79:0/2862396231 shutdown_connections 2024-08-20T01:42:27.505 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:27.500+0000 7fc6d98a1640 1 -- 172.21.15.79:0/2862396231 wait complete. 2024-08-20T01:42:27.604 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:42:28.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.120+0000 7fc90aed4640 1 -- 172.21.15.79:0/327347164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc904107d20 msgr2=0x7fc90410e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:28.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.120+0000 7fc90aed4640 1 --2- 172.21.15.79:0/327347164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc904107d20 0x7fc90410e520 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc009ca0 tx=0x7fc8fc02a8c0 comp rx=0 tx=0).stop 2024-08-20T01:42:28.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.120+0000 7fc90aed4640 1 -- 172.21.15.79:0/327347164 shutdown_connections 2024-08-20T01:42:28.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.120+0000 7fc90aed4640 1 --2- 172.21.15.79:0/327347164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc904107d20 0x7fc90410e520 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:28.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.120+0000 7fc90aed4640 1 --2- 172.21.15.79:0/327347164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9041073a0 0x7fc9041077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:28.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.120+0000 7fc90aed4640 1 --2- 172.21.15.79:0/327347164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc904101990 0x7fc904101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:28.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.120+0000 7fc90aed4640 1 -- 172.21.15.79:0/327347164 >> 172.21.15.79:0/327347164 conn(0x7fc9040fd400 msgr2=0x7fc9040ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:28.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.120+0000 7fc90aed4640 1 -- 172.21.15.79:0/327347164 shutdown_connections 2024-08-20T01:42:28.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.120+0000 7fc90aed4640 1 -- 172.21.15.79:0/327347164 wait complete. 2024-08-20T01:42:28.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.121+0000 7fc90aed4640 1 Processor -- start 2024-08-20T01:42:28.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.121+0000 7fc90aed4640 1 -- start start 2024-08-20T01:42:28.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.121+0000 7fc90aed4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc904101990 0x7fc904198f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:28.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.121+0000 7fc90aed4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9041073a0 0x7fc904199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:28.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.121+0000 7fc90aed4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc904107d20 0x7fc90419e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:28.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.121+0000 7fc90aed4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc9041118a0 con 0x7fc9041073a0 2024-08-20T01:42:28.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.121+0000 7fc90aed4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc904111720 con 0x7fc904107d20 2024-08-20T01:42:28.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.121+0000 7fc90aed4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc904111a20 con 0x7fc904101990 2024-08-20T01:42:28.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.121+0000 7fc903fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9041073a0 0x7fc904199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:28.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.121+0000 7fc903fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9041073a0 0x7fc904199460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33316/0 (socket says 172.21.15.79:33316) 2024-08-20T01:42:28.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.121+0000 7fc903fff640 1 -- 172.21.15.79:0/2173665422 learned_addr learned my addr 172.21.15.79:0/2173665422 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:28.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.122+0000 7fc909471640 1 --2- 172.21.15.79:0/2173665422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc904107d20 0x7fc90419e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:28.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.122+0000 7fc908c70640 1 --2- 172.21.15.79:0/2173665422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc904101990 0x7fc904198f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:28.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.122+0000 7fc903fff640 1 -- 172.21.15.79:0/2173665422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc904101990 msgr2=0x7fc904198f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:28.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.122+0000 7fc903fff640 1 --2- 172.21.15.79:0/2173665422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc904101990 0x7fc904198f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:28.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.122+0000 7fc903fff640 1 -- 172.21.15.79:0/2173665422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc904107d20 msgr2=0x7fc90419e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:28.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.122+0000 7fc903fff640 1 --2- 172.21.15.79:0/2173665422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc904107d20 0x7fc90419e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:28.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.122+0000 7fc903fff640 1 -- 172.21.15.79:0/2173665422 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc90419efd0 con 0x7fc9041073a0 2024-08-20T01:42:28.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.122+0000 7fc903fff640 1 --2- 172.21.15.79:0/2173665422 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9041073a0 0x7fc904199460 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fc8f000c970 tx=0x7fc8f000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:28.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.122+0000 7fc901ffb640 1 -- 172.21.15.79:0/2173665422 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f0007bb0 con 0x7fc9041073a0 2024-08-20T01:42:28.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.122+0000 7fc90aed4640 1 -- 172.21.15.79:0/2173665422 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc90419f2c0 con 0x7fc9041073a0 2024-08-20T01:42:28.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.122+0000 7fc901ffb640 1 -- 172.21.15.79:0/2173665422 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc8f0007d50 con 0x7fc9041073a0 2024-08-20T01:42:28.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.122+0000 7fc901ffb640 1 -- 172.21.15.79:0/2173665422 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f0004e40 con 0x7fc9041073a0 2024-08-20T01:42:28.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.123+0000 7fc90aed4640 1 -- 172.21.15.79:0/2173665422 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9041a5980 con 0x7fc9041073a0 2024-08-20T01:42:28.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.123+0000 7fc90aed4640 1 -- 172.21.15.79:0/2173665422 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc904101d70 con 0x7fc9041073a0 2024-08-20T01:42:28.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.125+0000 7fc901ffb640 1 -- 172.21.15.79:0/2173665422 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc8f0005020 con 0x7fc9041073a0 2024-08-20T01:42:28.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.125+0000 7fc901ffb640 1 --2- 172.21.15.79:0/2173665422 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc8f40b3c50 0x7fc8f40b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:28.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.126+0000 7fc908c70640 1 --2- 172.21.15.79:0/2173665422 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc8f40b3c50 0x7fc8f40b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:28.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.126+0000 7fc901ffb640 1 -- 172.21.15.79:0/2173665422 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc8f00e39a0 con 0x7fc9041073a0 2024-08-20T01:42:28.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.126+0000 7fc908c70640 1 --2- 172.21.15.79:0/2173665422 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc8f40b3c50 0x7fc8f40b6110 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8005e10 tx=0x7fc8f8005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:28.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.130+0000 7fc901ffb640 1 -- 172.21.15.79:0/2173665422 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fc8f0014030 con 0x7fc9041073a0 2024-08-20T01:42:28.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.389+0000 7fc90aed4640 1 -- 172.21.15.79:0/2173665422 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc90410ab10 con 0x7fc9041073a0 2024-08-20T01:42:28.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.389+0000 7fc901ffb640 1 -- 172.21.15.79:0/2173665422 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+11973 (secure 0 0 0) 0x7fc8f00aafa0 con 0x7fc9041073a0 2024-08-20T01:42:28.392 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:42:28.392 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":38,"btime":"2024-08-20T01:41:11:144850+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14670,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/735082912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":735082912},{"type":"v1","addr":"172.21.15.79:6835","nonce":735082912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2150339873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2150339873},{"type":"v1","addr":"172.21.15.79:6837","nonce":2150339873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":38,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:34:55.133562+0000","modified":"2024-08-20T01:41:10.892487+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24539,"mds_1":24538,"mds_2":24523,"mds_3":24514,"mds_4":24512},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14724":{"gid":14724,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/1071242274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1071242274},{"type":"v1","addr":"172.21.15.79:6839","nonce":1071242274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14730":{"gid":14730,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6841/2448977611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":2448977611},{"type":"v1","addr":"172.21.15.79:6841","nonce":2448977611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/1257507005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1257507005},{"type":"v1","addr":"172.21.15.81:6833","nonce":1257507005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1499936216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1499936216},{"type":"v1","addr":"172.21.15.81:6835","nonce":1499936216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/1107229215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1107229215},{"type":"v1","addr":"172.21.15.175:6833","nonce":1107229215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6837/2073598870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2073598870},{"type":"v1","addr":"172.21.15.81:6837","nonce":2073598870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/2552601173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2552601173},{"type":"v1","addr":"172.21.15.175:6835","nonce":2552601173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6837/1767284089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1767284089},{"type":"v1","addr":"172.21.15.175:6837","nonce":1767284089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/1331748742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1331748742},{"type":"v1","addr":"172.21.15.175:6839","nonce":1331748742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/4098410583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":4098410583},{"type":"v1","addr":"172.21.15.81:6839","nonce":4098410583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24539,"qdb_cluster":[24512,24538,24514,24523,24539]},"id":1}]} 2024-08-20T01:42:28.392 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 38 2024-08-20T01:42:28.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.392+0000 7fc90aed4640 1 -- 172.21.15.79:0/2173665422 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc8f40b3c50 msgr2=0x7fc8f40b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:28.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.392+0000 7fc90aed4640 1 --2- 172.21.15.79:0/2173665422 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc8f40b3c50 0x7fc8f40b6110 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8005e10 tx=0x7fc8f8005da0 comp rx=0 tx=0).stop 2024-08-20T01:42:28.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.392+0000 7fc90aed4640 1 -- 172.21.15.79:0/2173665422 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9041073a0 msgr2=0x7fc904199460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:28.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.392+0000 7fc90aed4640 1 --2- 172.21.15.79:0/2173665422 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9041073a0 0x7fc904199460 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fc8f000c970 tx=0x7fc8f000ce30 comp rx=0 tx=0).stop 2024-08-20T01:42:28.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.392+0000 7fc90aed4640 1 -- 172.21.15.79:0/2173665422 shutdown_connections 2024-08-20T01:42:28.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.392+0000 7fc90aed4640 1 --2- 172.21.15.79:0/2173665422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc904107d20 0x7fc90419e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:28.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.392+0000 7fc90aed4640 1 --2- 172.21.15.79:0/2173665422 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9041073a0 0x7fc904199460 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:28.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.392+0000 7fc90aed4640 1 --2- 172.21.15.79:0/2173665422 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc8f40b3c50 0x7fc8f40b6110 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:28.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.392+0000 7fc90aed4640 1 --2- 172.21.15.79:0/2173665422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc904101990 0x7fc904198f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:28.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.392+0000 7fc90aed4640 1 -- 172.21.15.79:0/2173665422 >> 172.21.15.79:0/2173665422 conn(0x7fc9040fd400 msgr2=0x7fc90406ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:28.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.392+0000 7fc90aed4640 1 -- 172.21.15.79:0/2173665422 shutdown_connections 2024-08-20T01:42:28.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:28.392+0000 7fc90aed4640 1 -- 172.21.15.79:0/2173665422 wait complete. 2024-08-20T01:42:28.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:28 smithi175 ceph-mon[22392]: pgmap v501: 97 pgs: 97 active+clean; 7.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 23 op/s 2024-08-20T01:42:28.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:28 smithi079 ceph-mon[18656]: pgmap v501: 97 pgs: 97 active+clean; 7.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 23 op/s 2024-08-20T01:42:28.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:28 smithi081 ceph-mon[22209]: pgmap v501: 97 pgs: 97 active+clean; 7.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 23 op/s 2024-08-20T01:42:29.128 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-20T01:42:29.407 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:42:29.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:29 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2173665422' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:42:29.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:29 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2173665422' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:42:29.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:29 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2173665422' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:42:29.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.925+0000 7fd11e6dc640 1 -- 172.21.15.79:0/3718463752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd118101990 msgr2=0x7fd118101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:29.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.925+0000 7fd11e6dc640 1 --2- 172.21.15.79:0/3718463752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd118101990 0x7fd118101d70 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fd108009900 tx=0x7fd10802a410 comp rx=0 tx=0).stop 2024-08-20T01:42:29.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.925+0000 7fd11e6dc640 1 -- 172.21.15.79:0/3718463752 shutdown_connections 2024-08-20T01:42:29.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.925+0000 7fd11e6dc640 1 --2- 172.21.15.79:0/3718463752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd118107d20 0x7fd11810e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:29.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.925+0000 7fd11e6dc640 1 --2- 172.21.15.79:0/3718463752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1181073a0 0x7fd1181077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:29.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.925+0000 7fd11e6dc640 1 --2- 172.21.15.79:0/3718463752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd118101990 0x7fd118101d70 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:29.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.925+0000 7fd11e6dc640 1 -- 172.21.15.79:0/3718463752 >> 172.21.15.79:0/3718463752 conn(0x7fd1180fd400 msgr2=0x7fd1180ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:29.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.925+0000 7fd11e6dc640 1 -- 172.21.15.79:0/3718463752 shutdown_connections 2024-08-20T01:42:29.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.925+0000 7fd11e6dc640 1 -- 172.21.15.79:0/3718463752 wait complete. 2024-08-20T01:42:29.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.926+0000 7fd11e6dc640 1 Processor -- start 2024-08-20T01:42:29.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.926+0000 7fd11e6dc640 1 -- start start 2024-08-20T01:42:29.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.926+0000 7fd11e6dc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd118101990 0x7fd118198f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:29.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.926+0000 7fd11e6dc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1181073a0 0x7fd118199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:29.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.926+0000 7fd11e6dc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd118107d20 0x7fd11819e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:29.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.926+0000 7fd11e6dc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd118111890 con 0x7fd118101990 2024-08-20T01:42:29.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.926+0000 7fd11e6dc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd118111710 con 0x7fd118107d20 2024-08-20T01:42:29.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.926+0000 7fd11e6dc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd118111a10 con 0x7fd1181073a0 2024-08-20T01:42:29.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.927+0000 7fd117fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd118101990 0x7fd118198f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:29.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.927+0000 7fd117fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd118101990 0x7fd118198f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33346/0 (socket says 172.21.15.79:33346) 2024-08-20T01:42:29.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.927+0000 7fd117fff640 1 -- 172.21.15.79:0/3671960642 learned_addr learned my addr 172.21.15.79:0/3671960642 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:29.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.927+0000 7fd11cc79640 1 --2- 172.21.15.79:0/3671960642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd118107d20 0x7fd11819e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:29.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.927+0000 7fd1177fe640 1 --2- 172.21.15.79:0/3671960642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1181073a0 0x7fd118199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:29.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.927+0000 7fd117fff640 1 -- 172.21.15.79:0/3671960642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1181073a0 msgr2=0x7fd118199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:29.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.927+0000 7fd117fff640 1 --2- 172.21.15.79:0/3671960642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1181073a0 0x7fd118199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:29.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.927+0000 7fd117fff640 1 -- 172.21.15.79:0/3671960642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd118107d20 msgr2=0x7fd11819e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:29.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.927+0000 7fd117fff640 1 --2- 172.21.15.79:0/3671960642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd118107d20 0x7fd11819e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:29.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.927+0000 7fd117fff640 1 -- 172.21.15.79:0/3671960642 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd11819efb0 con 0x7fd118101990 2024-08-20T01:42:29.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.927+0000 7fd11cc79640 1 --2- 172.21.15.79:0/3671960642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd118107d20 0x7fd11819e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:42:29.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.927+0000 7fd117fff640 1 --2- 172.21.15.79:0/3671960642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd118101990 0x7fd118198f00 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fd108009230 tx=0x7fd108004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:29.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.927+0000 7fd1157fa640 1 -- 172.21.15.79:0/3671960642 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd10803f030 con 0x7fd118101990 2024-08-20T01:42:29.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.927+0000 7fd1157fa640 1 -- 172.21.15.79:0/3671960642 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd108003a80 con 0x7fd118101990 2024-08-20T01:42:29.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.927+0000 7fd1157fa640 1 -- 172.21.15.79:0/3671960642 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd108035070 con 0x7fd118101990 2024-08-20T01:42:29.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.927+0000 7fd11e6dc640 1 -- 172.21.15.79:0/3671960642 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd11819f240 con 0x7fd118101990 2024-08-20T01:42:29.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.928+0000 7fd11e6dc640 1 -- 172.21.15.79:0/3671960642 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1180fdb10 con 0x7fd118101990 2024-08-20T01:42:29.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.930+0000 7fd120ad5740 1 Processor -- start 2024-08-20T01:42:29.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.930+0000 7fd120ad5740 1 -- start start 2024-08-20T01:42:29.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.930+0000 7fd120ad5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcf1145880 0x55bcf1145c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:29.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.930+0000 7fd1157fa640 1 -- 172.21.15.79:0/3671960642 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fd108042030 con 0x7fd118101990 2024-08-20T01:42:29.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.930+0000 7fd120ad5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcf11461a0 0x55bcf1151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:29.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.930+0000 7fd120ad5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bcf1152130 0x55bcf1154520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:29.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.930+0000 7fd120ad5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bcf10bc930 con 0x55bcf1152130 2024-08-20T01:42:29.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.930+0000 7fd120ad5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bcf10abe30 con 0x55bcf11461a0 2024-08-20T01:42:29.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.930+0000 7fd120ad5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55bcf10afe70 con 0x55bcf1145880 2024-08-20T01:42:29.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.931+0000 7fd1177fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bcf1152130 0x55bcf1154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:29.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.931+0000 7fd1177fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bcf1152130 0x55bcf1154520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33362/0 (socket says 172.21.15.79:33362) 2024-08-20T01:42:29.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.931+0000 7fd1177fe640 1 -- 172.21.15.79:0/3893666639 learned_addr learned my addr 172.21.15.79:0/3893666639 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:29.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.931+0000 7fd117fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcf11461a0 0x55bcf1151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:29.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.931+0000 7fd11cc79640 1 --2- 172.21.15.79:0/3893666639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcf1145880 0x55bcf1145c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:29.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.931+0000 7fd1177fe640 1 -- 172.21.15.79:0/3893666639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcf1145880 msgr2=0x55bcf1145c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:29.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.931+0000 7fd1177fe640 1 --2- 172.21.15.79:0/3893666639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcf1145880 0x55bcf1145c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:29.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.931+0000 7fd1177fe640 1 -- 172.21.15.79:0/3893666639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcf11461a0 msgr2=0x55bcf1151bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:29.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.931+0000 7fd1177fe640 1 --2- 172.21.15.79:0/3893666639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcf11461a0 0x55bcf1151bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:29.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.931+0000 7fd1177fe640 1 -- 172.21.15.79:0/3893666639 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcf0e0b650 con 0x55bcf1152130 2024-08-20T01:42:29.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.931+0000 7fd1177fe640 1 --2- 172.21.15.79:0/3893666639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bcf1152130 0x55bcf1154520 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fd10c00bce0 tx=0x7fd10c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eff0509d54be3ed server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:29.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.931+0000 7fd0fe7fc640 1 -- 172.21.15.79:0/3893666639 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd10c004030 con 0x55bcf1152130 2024-08-20T01:42:29.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.931+0000 7fd1157fa640 1 --2- 172.21.15.79:0/3671960642 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd1000b3c50 0x7fd1000b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:29.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.931+0000 7fd0fe7fc640 1 -- 172.21.15.79:0/3893666639 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd10c0035f0 con 0x55bcf1152130 2024-08-20T01:42:29.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.931+0000 7fd0fe7fc640 1 -- 172.21.15.79:0/3893666639 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd10c011680 con 0x55bcf1152130 2024-08-20T01:42:29.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.932+0000 7fd11cc79640 1 --2- 172.21.15.79:0/3671960642 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd1000b3c50 0x7fd1000b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:29.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.932+0000 7fd1157fa640 1 -- 172.21.15.79:0/3671960642 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fd108104020 con 0x7fd118101990 2024-08-20T01:42:29.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.932+0000 7fd120ad5740 1 -- 172.21.15.79:0/3893666639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bcf1152130 msgr2=0x55bcf1154520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:29.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.932+0000 7fd11cc79640 1 --2- 172.21.15.79:0/3671960642 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd1000b3c50 0x7fd1000b6110 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd11000a870 tx=0x7fd11000d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:29.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.932+0000 7fd120ad5740 1 --2- 172.21.15.79:0/3893666639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bcf1152130 0x55bcf1154520 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fd10c00bce0 tx=0x7fd10c0107a0 comp rx=0 tx=0).stop 2024-08-20T01:42:29.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.932+0000 7fd120ad5740 1 -- 172.21.15.79:0/3893666639 shutdown_connections 2024-08-20T01:42:29.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.932+0000 7fd120ad5740 1 --2- 172.21.15.79:0/3893666639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bcf1152130 0x55bcf1154520 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:29.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.932+0000 7fd120ad5740 1 --2- 172.21.15.79:0/3893666639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcf11461a0 0x55bcf1151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:29.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.932+0000 7fd120ad5740 1 --2- 172.21.15.79:0/3893666639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcf1145880 0x55bcf1145c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:29.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.932+0000 7fd120ad5740 1 -- 172.21.15.79:0/3893666639 >> 172.21.15.79:0/3893666639 conn(0x55bcf11436b0 msgr2=0x55bcf1144850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:29.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.932+0000 7fd120ad5740 1 -- 172.21.15.79:0/3893666639 shutdown_connections 2024-08-20T01:42:29.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.932+0000 7fd120ad5740 1 -- 172.21.15.79:0/3893666639 wait complete. 2024-08-20T01:42:29.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.933+0000 7fd120ad5740 1 -- start start 2024-08-20T01:42:29.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.933+0000 7fd120ad5740 1 Processor -- start 2024-08-20T01:42:29.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.933+0000 7fd120ad5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bcf1145880 0x55bcf114f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:29.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.933+0000 7fd120ad5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcf11461a0 0x55bcf114f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:29.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.933+0000 7fd120ad5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcf1152130 0x55bcf114fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:29.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.933+0000 7fd120ad5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bcf0f0e700 con 0x55bcf1145880 2024-08-20T01:42:29.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.933+0000 7fd120ad5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bcf1032810 con 0x55bcf1152130 2024-08-20T01:42:29.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.933+0000 7fd120ad5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55bcf1154de0 con 0x55bcf11461a0 2024-08-20T01:42:29.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.933+0000 7fd120ad5740 10 client.0 _ll_register_callbacks cb 0x55bcf10a5700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:42:29.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.934+0000 7fd117fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bcf1145880 0x55bcf114f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:29.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.934+0000 7fd117fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bcf1145880 0x55bcf114f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33374/0 (socket says 172.21.15.79:33374) 2024-08-20T01:42:29.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.934+0000 7fd117fff640 1 -- 172.21.15.79:0/412235203 learned_addr learned my addr 172.21.15.79:0/412235203 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:29.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.934+0000 7fd11cc79640 1 --2- 172.21.15.79:0/412235203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcf1152130 0x55bcf114fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:29.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.934+0000 7fd1177fe640 1 --2- 172.21.15.79:0/412235203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcf11461a0 0x55bcf114f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:29.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.934+0000 7fd117fff640 1 -- 172.21.15.79:0/412235203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcf11461a0 msgr2=0x55bcf114f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:29.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.934+0000 7fd117fff640 1 --2- 172.21.15.79:0/412235203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcf11461a0 0x55bcf114f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:29.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.934+0000 7fd117fff640 1 -- 172.21.15.79:0/412235203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcf1152130 msgr2=0x55bcf114fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:29.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.934+0000 7fd117fff640 1 --2- 172.21.15.79:0/412235203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcf1152130 0x55bcf114fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:29.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.934+0000 7fd117fff640 1 -- 172.21.15.79:0/412235203 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcf115e1f0 con 0x55bcf1145880 2024-08-20T01:42:29.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.934+0000 7fd11cc79640 1 --2- 172.21.15.79:0/412235203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcf1152130 0x55bcf114fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:42:29.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.934+0000 7fd117fff640 1 --2- 172.21.15.79:0/412235203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bcf1145880 0x55bcf114f100 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fd1080cafc0 tx=0x7fd108009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0cd3f7482cfa74f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:29.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.934+0000 7fd0f77fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:42:29.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.934+0000 7fd0f77fe640 1 -- 172.21.15.79:0/412235203 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd108049070 con 0x55bcf1145880 2024-08-20T01:42:29.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.934+0000 7fd0f77fe640 1 -- 172.21.15.79:0/412235203 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fd1080c72c0 con 0x55bcf1145880 2024-08-20T01:42:29.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.934+0000 7fd120ad5740 1 -- 172.21.15.79:0/412235203 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bcf105b150 con 0x55bcf1145880 2024-08-20T01:42:29.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.934+0000 7fd0f77fe640 1 -- 172.21.15.79:0/412235203 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fd1080cae00 con 0x55bcf1145880 2024-08-20T01:42:29.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.935+0000 7fd120ad5740 10 client.17061 fetch_fsmap learned FSMap version 38 2024-08-20T01:42:29.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.935+0000 7fd120ad5740 1 -- 172.21.15.79:0/412235203 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55bcf1160ba0 con 0x55bcf1145880 2024-08-20T01:42:29.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.935+0000 7fd0f77fe640 1 -- 172.21.15.79:0/412235203 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55bcf105b150 con 0x55bcf1145880 2024-08-20T01:42:29.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.935+0000 7fd0f77fe640 1 -- 172.21.15.79:0/412235203 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7fd1080cb290 con 0x55bcf1145880 2024-08-20T01:42:29.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.935+0000 7fd120ad5740 10 client.17061 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:42:29.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.935+0000 7fd120ad5740 10 client.17061 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:42:29.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.935+0000 7fd120ad5740 20 client.17061 populate_metadata read hostname 'smithi079' 2024-08-20T01:42:29.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.935+0000 7fd120ad5740 1 --2- 172.21.15.79:0/412235203 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55bcf1162000 0x55bcf1164440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:29.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.935+0000 7fd120ad5740 4 client.17061 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:42:29.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.935+0000 7fd120ad5740 1 -- 172.21.15.79:0/412235203 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bcf10be880 con 0x55bcf1162000 2024-08-20T01:42:29.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.935+0000 7fd1177fe640 1 --2- 172.21.15.79:0/412235203 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55bcf1162000 0x55bcf1164440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:29.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.936+0000 7fd1177fe640 1 --2- 172.21.15.79:0/412235203 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55bcf1162000 0x55bcf1164440 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e90e77dd45887e13 server_cookie=87adc1d8a26e28cc in_seq=0 out_seq=0 2024-08-20T01:42:29.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.936+0000 7fd0f77fe640 10 client.17061 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:42:29.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.936+0000 7fd0f77fe640 1 -- 172.21.15.79:0/412235203 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bcf10be880 con 0x55bcf1162000 2024-08-20T01:42:29.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.936+0000 7fd0f77fe640 10 client.17061 handle_command_reply: tid=0 2024-08-20T01:42:29.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.936+0000 7fd120ad5740 1 client.17061 shutdown 2024-08-20T01:42:29.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.937+0000 7fd120ad5740 1 -- 172.21.15.79:0/412235203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bcf1145880 msgr2=0x55bcf114f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:29.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.937+0000 7fd120ad5740 1 --2- 172.21.15.79:0/412235203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bcf1145880 0x55bcf114f100 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fd1080cafc0 tx=0x7fd108009260 comp rx=0 tx=0).stop 2024-08-20T01:42:29.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.937+0000 7fd120ad5740 1 -- 172.21.15.79:0/412235203 shutdown_connections 2024-08-20T01:42:29.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.937+0000 7fd120ad5740 1 --2- 172.21.15.79:0/412235203 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55bcf1162000 0x55bcf1164440 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:29.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.937+0000 7fd120ad5740 1 --2- 172.21.15.79:0/412235203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcf1152130 0x55bcf114fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:29.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.937+0000 7fd120ad5740 1 --2- 172.21.15.79:0/412235203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcf11461a0 0x55bcf114f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:29.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.937+0000 7fd120ad5740 1 --2- 172.21.15.79:0/412235203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bcf1145880 0x55bcf114f100 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:29.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.937+0000 7fd0f77fe640 0 client.17061 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:42:29.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.937+0000 7fd120ad5740 1 -- 172.21.15.79:0/412235203 >> 172.21.15.79:0/412235203 conn(0x55bcf11436b0 msgr2=0x55bcf1149250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:29.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.937+0000 7fd120ad5740 1 -- 172.21.15.79:0/412235203 shutdown_connections 2024-08-20T01:42:29.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.937+0000 7fd120ad5740 1 -- 172.21.15.79:0/412235203 wait complete. 2024-08-20T01:42:29.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.937+0000 7fd120ad5740 20 client.17061 trim_cache size 0 max 16384 2024-08-20T01:42:29.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.954+0000 7fd120ad5740 1 Processor -- start 2024-08-20T01:42:29.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.954+0000 7fd120ad5740 1 -- start start 2024-08-20T01:42:29.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.954+0000 7fd120ad5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcf1145880 0x55bcf1149920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:29.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.954+0000 7fd120ad5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bcf11461a0 0x55bcf114f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:29.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.954+0000 7fd120ad5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcf1152130 0x55bcf1169d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:29.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.954+0000 7fd120ad5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd1181b01f0 con 0x55bcf11461a0 2024-08-20T01:42:29.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.954+0000 7fd120ad5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd1181b1d30 con 0x55bcf1152130 2024-08-20T01:42:29.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.954+0000 7fd120ad5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd1181b08c0 con 0x55bcf1145880 2024-08-20T01:42:29.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.954+0000 7fd1177fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bcf11461a0 0x55bcf114f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:29.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.954+0000 7fd1177fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bcf11461a0 0x55bcf114f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33380/0 (socket says 172.21.15.79:33380) 2024-08-20T01:42:29.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.954+0000 7fd1177fe640 1 -- 172.21.15.79:0/1299062933 learned_addr learned my addr 172.21.15.79:0/1299062933 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:29.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.954+0000 7fd117fff640 1 --2- 172.21.15.79:0/1299062933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcf1145880 0x55bcf1149920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:29.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.954+0000 7fd11cc79640 1 --2- 172.21.15.79:0/1299062933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcf1152130 0x55bcf1169d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:29.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.955+0000 7fd1177fe640 1 -- 172.21.15.79:0/1299062933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcf1145880 msgr2=0x55bcf1149920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:29.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.955+0000 7fd1177fe640 1 --2- 172.21.15.79:0/1299062933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcf1145880 0x55bcf1149920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:29.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.955+0000 7fd1177fe640 1 -- 172.21.15.79:0/1299062933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcf1152130 msgr2=0x55bcf1169d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:29.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.955+0000 7fd1177fe640 1 --2- 172.21.15.79:0/1299062933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcf1152130 0x55bcf1169d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:29.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.955+0000 7fd1177fe640 1 -- 172.21.15.79:0/1299062933 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcf1145fd0 con 0x55bcf11461a0 2024-08-20T01:42:29.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.955+0000 7fd117fff640 1 --2- 172.21.15.79:0/1299062933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcf1145880 0x55bcf1149920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:42:29.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.955+0000 7fd1177fe640 1 --2- 172.21.15.79:0/1299062933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bcf11461a0 0x55bcf114f780 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x55bcf1145830 tx=0x7fd10c00b5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dbb2f3301436ff3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:29.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.955+0000 7fd0fdffb640 1 -- 172.21.15.79:0/1299062933 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd10c005040 con 0x55bcf11461a0 2024-08-20T01:42:29.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.955+0000 7fd0fdffb640 1 -- 172.21.15.79:0/1299062933 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd10c0035f0 con 0x55bcf11461a0 2024-08-20T01:42:29.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.955+0000 7fd0fdffb640 1 -- 172.21.15.79:0/1299062933 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd10c0116a0 con 0x55bcf11461a0 2024-08-20T01:42:29.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.956+0000 7fd120ad5740 1 -- 172.21.15.79:0/1299062933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bcf11461a0 msgr2=0x55bcf114f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:29.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.956+0000 7fd120ad5740 1 --2- 172.21.15.79:0/1299062933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bcf11461a0 0x55bcf114f780 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x55bcf1145830 tx=0x7fd10c00b5d0 comp rx=0 tx=0).stop 2024-08-20T01:42:29.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.956+0000 7fd120ad5740 1 -- 172.21.15.79:0/1299062933 shutdown_connections 2024-08-20T01:42:29.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.956+0000 7fd120ad5740 1 --2- 172.21.15.79:0/1299062933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcf1152130 0x55bcf1169d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:29.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.956+0000 7fd120ad5740 1 --2- 172.21.15.79:0/1299062933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bcf11461a0 0x55bcf114f780 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:29.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.956+0000 7fd120ad5740 1 --2- 172.21.15.79:0/1299062933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcf1145880 0x55bcf1149920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:29.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.956+0000 7fd120ad5740 1 -- 172.21.15.79:0/1299062933 >> 172.21.15.79:0/1299062933 conn(0x55bcf11436b0 msgr2=0x55bcf114f070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:29.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.956+0000 7fd120ad5740 1 -- 172.21.15.79:0/1299062933 shutdown_connections 2024-08-20T01:42:29.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.956+0000 7fd120ad5740 1 -- 172.21.15.79:0/1299062933 wait complete. 2024-08-20T01:42:29.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.956+0000 7fd120ad5740 1 -- start start 2024-08-20T01:42:29.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.957+0000 7fd120ad5740 1 Processor -- start 2024-08-20T01:42:29.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.957+0000 7fd120ad5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcf1145880 0x55bcf115a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:29.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.957+0000 7fd120ad5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcf11461a0 0x55bcf115a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:29.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.957+0000 7fd120ad5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bcf1152130 0x55bcf1155b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:29.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.957+0000 7fd120ad5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd1181b1660 con 0x55bcf1152130 2024-08-20T01:42:29.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.957+0000 7fd120ad5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd1181b0f90 con 0x55bcf1145880 2024-08-20T01:42:29.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.957+0000 7fd120ad5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd1181ae1d0 con 0x55bcf11461a0 2024-08-20T01:42:29.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.957+0000 7fd120ad5740 10 client.0 _ll_register_callbacks cb 0x7fd108107a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:42:29.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.957+0000 7fd117fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcf1145880 0x55bcf115a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:29.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.957+0000 7fd11cc79640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bcf1152130 0x55bcf1155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:29.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.957+0000 7fd117fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcf1145880 0x55bcf115a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:55558/0 (socket says 172.21.15.79:55558) 2024-08-20T01:42:29.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.957+0000 7fd117fff640 1 -- 172.21.15.79:0/1137906958 learned_addr learned my addr 172.21.15.79:0/1137906958 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:29.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.957+0000 7fd1177fe640 1 --2- 172.21.15.79:0/1137906958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcf11461a0 0x55bcf115a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:29.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.957+0000 7fd117fff640 1 -- 172.21.15.79:0/1137906958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcf11461a0 msgr2=0x55bcf115a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:29.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.957+0000 7fd117fff640 1 --2- 172.21.15.79:0/1137906958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcf11461a0 0x55bcf115a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:29.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.958+0000 7fd117fff640 1 -- 172.21.15.79:0/1137906958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bcf1152130 msgr2=0x55bcf1155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:29.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.958+0000 7fd117fff640 1 --2- 172.21.15.79:0/1137906958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bcf1152130 0x55bcf1155b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:29.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.958+0000 7fd117fff640 1 -- 172.21.15.79:0/1137906958 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcf1156360 con 0x55bcf1145880 2024-08-20T01:42:29.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.958+0000 7fd11cc79640 1 --2- 172.21.15.79:0/1137906958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bcf1152130 0x55bcf1155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:42:29.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.958+0000 7fd117fff640 1 --2- 172.21.15.79:0/1137906958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcf1145880 0x55bcf115a3c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd108000c00 tx=0x7fd10803b4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b66eb578e2e0284c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:29.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.958+0000 7fd0f77fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:42:29.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.958+0000 7fd0f77fe640 1 -- 172.21.15.79:0/1137906958 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd108049040 con 0x55bcf1145880 2024-08-20T01:42:29.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.958+0000 7fd0f77fe640 1 -- 172.21.15.79:0/1137906958 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fd108003800 con 0x55bcf1145880 2024-08-20T01:42:29.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.958+0000 7fd120ad5740 1 -- 172.21.15.79:0/1137906958 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd10c0035f0 con 0x55bcf1145880 2024-08-20T01:42:29.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.958+0000 7fd0f77fe640 1 -- 172.21.15.79:0/1137906958 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fd1080ca7a0 con 0x55bcf1145880 2024-08-20T01:42:29.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.958+0000 7fd120ad5740 10 client.26219 fetch_fsmap learned FSMap version 38 2024-08-20T01:42:29.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.958+0000 7fd120ad5740 1 -- 172.21.15.79:0/1137906958 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55bcf11cc9c0 con 0x55bcf1145880 2024-08-20T01:42:29.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.958+0000 7fd0f77fe640 1 -- 172.21.15.79:0/1137906958 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd1080cab40 con 0x55bcf1145880 2024-08-20T01:42:29.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.959+0000 7fd0f77fe640 1 -- 172.21.15.79:0/1137906958 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7fd1080c69a0 con 0x55bcf1145880 2024-08-20T01:42:29.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.959+0000 7fd120ad5740 10 client.26219 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:42:29.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.959+0000 7fd120ad5740 10 client.26219 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:42:29.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.959+0000 7fd120ad5740 20 client.26219 populate_metadata read hostname 'smithi079' 2024-08-20T01:42:29.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.959+0000 7fd120ad5740 1 --2- 172.21.15.79:0/1137906958 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55bcf11ccf90 0x55bcf11cf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:29.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.959+0000 7fd120ad5740 4 client.26219 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:42:29.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.959+0000 7fd120ad5740 1 -- 172.21.15.79:0/1137906958 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fd10c0035f0 con 0x55bcf11ccf90 2024-08-20T01:42:29.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.959+0000 7fd1177fe640 1 --2- 172.21.15.79:0/1137906958 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55bcf11ccf90 0x55bcf11cf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:29.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.959+0000 7fd1177fe640 1 --2- 172.21.15.79:0/1137906958 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55bcf11ccf90 0x55bcf11cf3b0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=44f141c16264121a server_cookie=6f35b7baa28d45ba in_seq=0 out_seq=0 2024-08-20T01:42:29.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.959+0000 7fd0f77fe640 10 client.26219 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:42:29.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.959+0000 7fd0f77fe640 1 -- 172.21.15.79:0/1137906958 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fd10c0035f0 con 0x55bcf11ccf90 2024-08-20T01:42:29.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.959+0000 7fd0f77fe640 10 client.26219 handle_command_reply: tid=0 2024-08-20T01:42:29.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.960+0000 7fd120ad5740 1 client.26219 shutdown 2024-08-20T01:42:29.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.960+0000 7fd120ad5740 1 -- 172.21.15.79:0/1137906958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcf1145880 msgr2=0x55bcf115a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:29.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.960+0000 7fd120ad5740 1 --2- 172.21.15.79:0/1137906958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcf1145880 0x55bcf115a3c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd108000c00 tx=0x7fd10803b4d0 comp rx=0 tx=0).stop 2024-08-20T01:42:29.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.960+0000 7fd120ad5740 1 -- 172.21.15.79:0/1137906958 shutdown_connections 2024-08-20T01:42:29.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.960+0000 7fd120ad5740 1 --2- 172.21.15.79:0/1137906958 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55bcf11ccf90 0x55bcf11cf3b0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:29.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.960+0000 7fd120ad5740 1 --2- 172.21.15.79:0/1137906958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bcf1152130 0x55bcf1155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:29.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.960+0000 7fd120ad5740 1 --2- 172.21.15.79:0/1137906958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bcf11461a0 0x55bcf115a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:29.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.960+0000 7fd0f77fe640 0 client.26219 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:42:29.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.960+0000 7fd120ad5740 1 --2- 172.21.15.79:0/1137906958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcf1145880 0x55bcf115a3c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:29.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.960+0000 7fd120ad5740 1 -- 172.21.15.79:0/1137906958 >> 172.21.15.79:0/1137906958 conn(0x55bcf11436b0 msgr2=0x55bcf1150f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:29.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.960+0000 7fd120ad5740 1 -- 172.21.15.79:0/1137906958 shutdown_connections 2024-08-20T01:42:29.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.960+0000 7fd120ad5740 1 -- 172.21.15.79:0/1137906958 wait complete. 2024-08-20T01:42:29.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.960+0000 7fd120ad5740 20 client.26219 trim_cache size 0 max 16384 2024-08-20T01:42:29.975 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:42:29.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.960+0000 7fd11e6dc640 1 -- 172.21.15.79:0/3671960642 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd1000b3c50 msgr2=0x7fd1000b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:29.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.960+0000 7fd11e6dc640 1 --2- 172.21.15.79:0/3671960642 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd1000b3c50 0x7fd1000b6110 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd11000a870 tx=0x7fd11000d040 comp rx=0 tx=0).stop 2024-08-20T01:42:29.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.960+0000 7fd11e6dc640 1 -- 172.21.15.79:0/3671960642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd118101990 msgr2=0x7fd118198f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:29.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.961+0000 7fd11e6dc640 1 --2- 172.21.15.79:0/3671960642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd118101990 0x7fd118198f00 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fd108009230 tx=0x7fd108004270 comp rx=0 tx=0).stop 2024-08-20T01:42:29.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.961+0000 7fd11e6dc640 1 -- 172.21.15.79:0/3671960642 shutdown_connections 2024-08-20T01:42:29.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.961+0000 7fd11e6dc640 1 --2- 172.21.15.79:0/3671960642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd118107d20 0x7fd11819e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:29.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.961+0000 7fd11e6dc640 1 --2- 172.21.15.79:0/3671960642 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd1000b3c50 0x7fd1000b6110 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:29.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.961+0000 7fd11e6dc640 1 --2- 172.21.15.79:0/3671960642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1181073a0 0x7fd118199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:29.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.961+0000 7fd11e6dc640 1 --2- 172.21.15.79:0/3671960642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd118101990 0x7fd118198f00 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:29.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.961+0000 7fd11e6dc640 1 -- 172.21.15.79:0/3671960642 >> 172.21.15.79:0/3671960642 conn(0x7fd1180fd400 msgr2=0x7fd11806ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:29.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.961+0000 7fd11e6dc640 1 -- 172.21.15.79:0/3671960642 shutdown_connections 2024-08-20T01:42:29.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:29.961+0000 7fd11e6dc640 1 -- 172.21.15.79:0/3671960642 wait complete. 2024-08-20T01:42:30.562 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:30 smithi079 ceph-mon[18656]: pgmap v502: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 32 MiB/s wr, 27 op/s 2024-08-20T01:42:30.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:30 smithi175 ceph-mon[22392]: pgmap v502: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 32 MiB/s wr, 27 op/s 2024-08-20T01:42:30.679 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-20T01:42:30.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:30 smithi081 ceph-mon[22209]: pgmap v502: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 32 MiB/s wr, 27 op/s 2024-08-20T01:42:30.967 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:42:31.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.453+0000 7f69d9c64640 1 -- 172.21.15.79:0/2109587310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69d41042c0 msgr2=0x7f69d410c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:31.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.453+0000 7f69d9c64640 1 --2- 172.21.15.79:0/2109587310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69d41042c0 0x7f69d410c7b0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f69c8009900 tx=0x7f69c802a410 comp rx=0 tx=0).stop 2024-08-20T01:42:31.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.453+0000 7f69d9c64640 1 -- 172.21.15.79:0/2109587310 shutdown_connections 2024-08-20T01:42:31.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.453+0000 7f69d9c64640 1 --2- 172.21.15.79:0/2109587310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69d410ce00 0x7f69d410f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:31.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.453+0000 7f69d9c64640 1 --2- 172.21.15.79:0/2109587310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69d41042c0 0x7f69d410c7b0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:31.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.453+0000 7f69d9c64640 1 --2- 172.21.15.79:0/2109587310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69d41039a0 0x7f69d4103d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:31.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.453+0000 7f69d9c64640 1 -- 172.21.15.79:0/2109587310 >> 172.21.15.79:0/2109587310 conn(0x7f69d40fd400 msgr2=0x7f69d40ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:31.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.453+0000 7f69d9c64640 1 -- 172.21.15.79:0/2109587310 shutdown_connections 2024-08-20T01:42:31.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.453+0000 7f69d9c64640 1 -- 172.21.15.79:0/2109587310 wait complete. 2024-08-20T01:42:31.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.454+0000 7f69d9c64640 1 Processor -- start 2024-08-20T01:42:31.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.455+0000 7f69d9c64640 1 -- start start 2024-08-20T01:42:31.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.455+0000 7f69d9c64640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69d41039a0 0x7f69d4198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:31.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.455+0000 7f69d9c64640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69d41042c0 0x7f69d41993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:31.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.455+0000 7f69d9c64640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69d410ce00 0x7f69d419e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:31.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.455+0000 7f69d9c64640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f69d4112970 con 0x7f69d41042c0 2024-08-20T01:42:31.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.455+0000 7f69d9c64640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f69d41127f0 con 0x7f69d410ce00 2024-08-20T01:42:31.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.455+0000 7f69d9c64640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f69d4112af0 con 0x7f69d41039a0 2024-08-20T01:42:31.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.455+0000 7f69d2ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69d41042c0 0x7f69d41993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:31.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.455+0000 7f69d2ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69d41042c0 0x7f69d41993c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51592/0 (socket says 172.21.15.79:51592) 2024-08-20T01:42:31.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.455+0000 7f69d2ffd640 1 -- 172.21.15.79:0/1727194213 learned_addr learned my addr 172.21.15.79:0/1727194213 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:31.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.455+0000 7f69d3fff640 1 --2- 172.21.15.79:0/1727194213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69d410ce00 0x7f69d419e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:31.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.455+0000 7f69d2ffd640 1 -- 172.21.15.79:0/1727194213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69d41039a0 msgr2=0x7f69d4198e80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-20T01:42:31.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.455+0000 7f69d2ffd640 1 --2- 172.21.15.79:0/1727194213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69d41039a0 0x7f69d4198e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:31.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.455+0000 7f69d2ffd640 1 -- 172.21.15.79:0/1727194213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69d410ce00 msgr2=0x7f69d419e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:31.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.455+0000 7f69d2ffd640 1 --2- 172.21.15.79:0/1727194213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69d410ce00 0x7f69d419e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:31.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.455+0000 7f69d2ffd640 1 -- 172.21.15.79:0/1727194213 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69d419ef30 con 0x7f69d41042c0 2024-08-20T01:42:31.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.455+0000 7f69d3fff640 1 --2- 172.21.15.79:0/1727194213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69d410ce00 0x7f69d419e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:42:31.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.455+0000 7f69d2ffd640 1 --2- 172.21.15.79:0/1727194213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69d41042c0 0x7f69d41993c0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f69c802a930 tx=0x7f69c8003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:31.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.456+0000 7f69d0ff9640 1 -- 172.21.15.79:0/1727194213 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c803f070 con 0x7f69d41042c0 2024-08-20T01:42:31.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.456+0000 7f69d0ff9640 1 -- 172.21.15.79:0/1727194213 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69c803baf0 con 0x7f69d41042c0 2024-08-20T01:42:31.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.456+0000 7f69d9c64640 1 -- 172.21.15.79:0/1727194213 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69d419f1c0 con 0x7f69d41042c0 2024-08-20T01:42:31.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.456+0000 7f69d0ff9640 1 -- 172.21.15.79:0/1727194213 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c8035030 con 0x7f69d41042c0 2024-08-20T01:42:31.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.456+0000 7f69d9c64640 1 -- 172.21.15.79:0/1727194213 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69d41a58e0 con 0x7f69d41042c0 2024-08-20T01:42:31.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.458+0000 7f69dc05d740 1 Processor -- start 2024-08-20T01:42:31.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.459+0000 7f69dc05d740 1 -- start start 2024-08-20T01:42:31.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.459+0000 7f69dc05d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cd557f880 0x558cd557fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:31.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.459+0000 7f69dc05d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cd55801a0 0x558cd558bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:31.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.459+0000 7f69dc05d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cd558c130 0x558cd558e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:31.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.459+0000 7f69dc05d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558cd54f6930 con 0x558cd55801a0 2024-08-20T01:42:31.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.459+0000 7f69dc05d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558cd54e5e30 con 0x558cd558c130 2024-08-20T01:42:31.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.459+0000 7f69dc05d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558cd54e9e70 con 0x558cd557f880 2024-08-20T01:42:31.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.459+0000 7f69d0ff9640 1 -- 172.21.15.79:0/1727194213 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f69c8042070 con 0x7f69d41042c0 2024-08-20T01:42:31.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.459+0000 7f69d37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cd55801a0 0x558cd558bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:31.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.459+0000 7f69d37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cd55801a0 0x558cd558bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51606/0 (socket says 172.21.15.79:51606) 2024-08-20T01:42:31.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.459+0000 7f69d37fe640 1 -- 172.21.15.79:0/787882329 learned_addr learned my addr 172.21.15.79:0/787882329 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:31.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.459+0000 7f69d3fff640 1 --2- 172.21.15.79:0/787882329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cd557f880 0x558cd557fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:31.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.459+0000 7f69d2ffd640 1 --2- 172.21.15.79:0/787882329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cd558c130 0x558cd558e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:31.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.459+0000 7f69d37fe640 1 -- 172.21.15.79:0/787882329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cd557f880 msgr2=0x558cd557fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:31.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.459+0000 7f69d37fe640 1 --2- 172.21.15.79:0/787882329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cd557f880 0x558cd557fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:31.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.459+0000 7f69d37fe640 1 -- 172.21.15.79:0/787882329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cd558c130 msgr2=0x558cd558e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:31.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.459+0000 7f69d37fe640 1 --2- 172.21.15.79:0/787882329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cd558c130 0x558cd558e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:31.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.459+0000 7f69d37fe640 1 -- 172.21.15.79:0/787882329 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cd5245650 con 0x558cd55801a0 2024-08-20T01:42:31.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.459+0000 7f69d3fff640 1 --2- 172.21.15.79:0/787882329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cd557f880 0x558cd557fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:42:31.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.460+0000 7f69d37fe640 1 --2- 172.21.15.79:0/787882329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cd55801a0 0x558cd558bbf0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f69c400aa50 tx=0x7f69c400af10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f54dac8a27c24ba5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:31.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.460+0000 7f69b9ffb640 1 -- 172.21.15.79:0/787882329 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c400ce20 con 0x558cd55801a0 2024-08-20T01:42:31.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.460+0000 7f69b9ffb640 1 -- 172.21.15.79:0/787882329 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69c400f8e0 con 0x558cd55801a0 2024-08-20T01:42:31.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.460+0000 7f69b9ffb640 1 -- 172.21.15.79:0/787882329 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c400e890 con 0x558cd55801a0 2024-08-20T01:42:31.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.460+0000 7f69d0ff9640 1 --2- 172.21.15.79:0/1727194213 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f69bc0b3c50 0x7f69bc0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:31.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.460+0000 7f69d3fff640 1 --2- 172.21.15.79:0/1727194213 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f69bc0b3c50 0x7f69bc0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:31.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.461+0000 7f69d0ff9640 1 -- 172.21.15.79:0/1727194213 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f69c8104320 con 0x7f69d41042c0 2024-08-20T01:42:31.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.461+0000 7f69dc05d740 1 -- 172.21.15.79:0/787882329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cd55801a0 msgr2=0x558cd558bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:31.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.461+0000 7f69d3fff640 1 --2- 172.21.15.79:0/1727194213 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f69bc0b3c50 0x7f69bc0b6110 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f69cc005fd0 tx=0x7f69cc009590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:31.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.461+0000 7f69dc05d740 1 --2- 172.21.15.79:0/787882329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cd55801a0 0x558cd558bbf0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f69c400aa50 tx=0x7f69c400af10 comp rx=0 tx=0).stop 2024-08-20T01:42:31.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.461+0000 7f69dc05d740 1 -- 172.21.15.79:0/787882329 shutdown_connections 2024-08-20T01:42:31.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.461+0000 7f69dc05d740 1 --2- 172.21.15.79:0/787882329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cd558c130 0x558cd558e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:31.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.461+0000 7f69dc05d740 1 --2- 172.21.15.79:0/787882329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cd55801a0 0x558cd558bbf0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:31.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.461+0000 7f69dc05d740 1 --2- 172.21.15.79:0/787882329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cd557f880 0x558cd557fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:31.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.461+0000 7f69dc05d740 1 -- 172.21.15.79:0/787882329 >> 172.21.15.79:0/787882329 conn(0x558cd557d6b0 msgr2=0x558cd557e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:31.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.461+0000 7f69dc05d740 1 -- 172.21.15.79:0/787882329 shutdown_connections 2024-08-20T01:42:31.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.461+0000 7f69dc05d740 1 -- 172.21.15.79:0/787882329 wait complete. 2024-08-20T01:42:31.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.461+0000 7f69dc05d740 1 -- start start 2024-08-20T01:42:31.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.461+0000 7f69dc05d740 1 Processor -- start 2024-08-20T01:42:31.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.462+0000 7f69dc05d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cd557f880 0x558cd558b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:31.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.462+0000 7f69dc05d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cd55801a0 0x558cd55890d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:31.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.462+0000 7f69dc05d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cd558c130 0x558cd5589610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:31.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.462+0000 7f69dc05d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558cd5348700 con 0x558cd558c130 2024-08-20T01:42:31.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.462+0000 7f69dc05d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558cd546c810 con 0x558cd557f880 2024-08-20T01:42:31.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.462+0000 7f69dc05d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558cd558ede0 con 0x558cd55801a0 2024-08-20T01:42:31.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.462+0000 7f69dc05d740 10 client.0 _ll_register_callbacks cb 0x558cd54df700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:42:31.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.462+0000 7f69d3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cd558c130 0x558cd5589610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:31.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.462+0000 7f69d37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cd557f880 0x558cd558b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:31.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.462+0000 7f69d3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cd558c130 0x558cd5589610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51618/0 (socket says 172.21.15.79:51618) 2024-08-20T01:42:31.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.462+0000 7f69d37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cd557f880 0x558cd558b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:37528/0 (socket says 172.21.15.79:37528) 2024-08-20T01:42:31.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.462+0000 7f69d3fff640 1 -- 172.21.15.79:0/3501670517 learned_addr learned my addr 172.21.15.79:0/3501670517 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:31.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.462+0000 7f69d2ffd640 1 --2- 172.21.15.79:0/3501670517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cd55801a0 0x558cd55890d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:31.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.462+0000 7f69d3fff640 1 -- 172.21.15.79:0/3501670517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cd55801a0 msgr2=0x558cd55890d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:31.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.462+0000 7f69d3fff640 1 --2- 172.21.15.79:0/3501670517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cd55801a0 0x558cd55890d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:31.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.462+0000 7f69d3fff640 1 -- 172.21.15.79:0/3501670517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cd557f880 msgr2=0x558cd558b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:31.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.462+0000 7f69d3fff640 1 --2- 172.21.15.79:0/3501670517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cd557f880 0x558cd558b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:31.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.462+0000 7f69d3fff640 1 -- 172.21.15.79:0/3501670517 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cd5589da0 con 0x558cd558c130 2024-08-20T01:42:31.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.462+0000 7f69d3fff640 1 --2- 172.21.15.79:0/3501670517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cd558c130 0x558cd5589610 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f69cc009de0 tx=0x7f69cc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef9b192d20bb15eb server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:31.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.462+0000 7f69b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:42:31.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.463+0000 7f69b2ffd640 1 -- 172.21.15.79:0/3501670517 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69cc00fd60 con 0x558cd558c130 2024-08-20T01:42:31.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.463+0000 7f69dc05d740 1 -- 172.21.15.79:0/3501670517 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558cd5495150 con 0x558cd558c130 2024-08-20T01:42:31.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.463+0000 7f69b2ffd640 1 -- 172.21.15.79:0/3501670517 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f69cc01f420 con 0x558cd558c130 2024-08-20T01:42:31.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.463+0000 7f69b2ffd640 1 -- 172.21.15.79:0/3501670517 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f69cc01f620 con 0x558cd558c130 2024-08-20T01:42:31.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.463+0000 7f69dc05d740 10 client.17079 fetch_fsmap learned FSMap version 38 2024-08-20T01:42:31.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.463+0000 7f69dc05d740 1 -- 172.21.15.79:0/3501670517 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x558cd55a3440 con 0x558cd558c130 2024-08-20T01:42:31.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.463+0000 7f69b2ffd640 1 -- 172.21.15.79:0/3501670517 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x558cd5495150 con 0x558cd558c130 2024-08-20T01:42:31.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.463+0000 7f69b2ffd640 1 -- 172.21.15.79:0/3501670517 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f69cc01d680 con 0x558cd558c130 2024-08-20T01:42:31.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.463+0000 7f69dc05d740 10 client.17079 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:42:31.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.463+0000 7f69dc05d740 10 client.17079 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:42:31.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.463+0000 7f69dc05d740 20 client.17079 populate_metadata read hostname 'smithi079' 2024-08-20T01:42:31.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.463+0000 7f69dc05d740 1 --2- 172.21.15.79:0/3501670517 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x558cd55a4a40 0x558cd55a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:31.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.463+0000 7f69dc05d740 4 client.17079 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:42:31.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.463+0000 7f69dc05d740 1 -- 172.21.15.79:0/3501670517 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558cd54f8880 con 0x558cd55a4a40 2024-08-20T01:42:31.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.464+0000 7f69d37fe640 1 --2- 172.21.15.79:0/3501670517 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x558cd55a4a40 0x558cd55a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:31.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.464+0000 7f69b2ffd640 10 client.17079 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:42:31.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.464+0000 7f69d37fe640 1 --2- 172.21.15.79:0/3501670517 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x558cd55a4a40 0x558cd55a6e30 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5606e1ece39af459 server_cookie=480c610da93f46e7 in_seq=0 out_seq=0 2024-08-20T01:42:31.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.465+0000 7f69b2ffd640 1 -- 172.21.15.79:0/3501670517 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558cd54f8880 con 0x558cd55a4a40 2024-08-20T01:42:31.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.465+0000 7f69b2ffd640 10 client.17079 handle_command_reply: tid=0 2024-08-20T01:42:31.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.465+0000 7f69dc05d740 1 client.17079 shutdown 2024-08-20T01:42:31.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.465+0000 7f69dc05d740 1 -- 172.21.15.79:0/3501670517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cd558c130 msgr2=0x558cd5589610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:31.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.465+0000 7f69dc05d740 1 --2- 172.21.15.79:0/3501670517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cd558c130 0x558cd5589610 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f69cc009de0 tx=0x7f69cc004a40 comp rx=0 tx=0).stop 2024-08-20T01:42:31.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.465+0000 7f69dc05d740 1 -- 172.21.15.79:0/3501670517 shutdown_connections 2024-08-20T01:42:31.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.465+0000 7f69dc05d740 1 --2- 172.21.15.79:0/3501670517 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x558cd55a4a40 0x558cd55a6e30 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:31.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.465+0000 7f69dc05d740 1 --2- 172.21.15.79:0/3501670517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cd558c130 0x558cd5589610 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:31.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.465+0000 7f69dc05d740 1 --2- 172.21.15.79:0/3501670517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cd55801a0 0x558cd55890d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:31.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.465+0000 7f69dc05d740 1 --2- 172.21.15.79:0/3501670517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cd557f880 0x558cd558b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:31.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.465+0000 7f69dc05d740 1 -- 172.21.15.79:0/3501670517 >> 172.21.15.79:0/3501670517 conn(0x558cd557d6b0 msgr2=0x558cd5583250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:31.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.465+0000 7f69b2ffd640 0 client.17079 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:42:31.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.465+0000 7f69dc05d740 1 -- 172.21.15.79:0/3501670517 shutdown_connections 2024-08-20T01:42:31.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.465+0000 7f69dc05d740 1 -- 172.21.15.79:0/3501670517 wait complete. 2024-08-20T01:42:31.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.465+0000 7f69dc05d740 20 client.17079 trim_cache size 0 max 16384 2024-08-20T01:42:31.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.478+0000 7f69dc05d740 1 Processor -- start 2024-08-20T01:42:31.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.478+0000 7f69dc05d740 1 -- start start 2024-08-20T01:42:31.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.479+0000 7f69dc05d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cd557f880 0x558cd5583a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:31.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.479+0000 7f69dc05d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cd55801a0 0x558cd558ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:31.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.479+0000 7f69dc05d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cd558c130 0x558cd55ac5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:31.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.479+0000 7f69dc05d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f69d41abdb0 con 0x558cd557f880 2024-08-20T01:42:31.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.479+0000 7f69dc05d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f69d41ad8f0 con 0x558cd55801a0 2024-08-20T01:42:31.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.479+0000 7f69dc05d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f69d41ac480 con 0x558cd558c130 2024-08-20T01:42:31.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.479+0000 7f69d37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cd557f880 0x558cd5583a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:31.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.479+0000 7f69d37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cd557f880 0x558cd5583a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51632/0 (socket says 172.21.15.79:51632) 2024-08-20T01:42:31.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.479+0000 7f69d37fe640 1 -- 172.21.15.79:0/276914638 learned_addr learned my addr 172.21.15.79:0/276914638 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:31.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.479+0000 7f69d3fff640 1 --2- 172.21.15.79:0/276914638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cd558c130 0x558cd55ac5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:31.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.479+0000 7f69d2ffd640 1 --2- 172.21.15.79:0/276914638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cd55801a0 0x558cd558ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:31.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.479+0000 7f69d37fe640 1 -- 172.21.15.79:0/276914638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cd558c130 msgr2=0x558cd55ac5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:31.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.479+0000 7f69d37fe640 1 --2- 172.21.15.79:0/276914638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cd558c130 0x558cd55ac5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:31.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.479+0000 7f69d37fe640 1 -- 172.21.15.79:0/276914638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cd55801a0 msgr2=0x558cd558ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:31.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.479+0000 7f69d37fe640 1 --2- 172.21.15.79:0/276914638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cd55801a0 0x558cd558ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:31.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.479+0000 7f69d37fe640 1 -- 172.21.15.79:0/276914638 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cd557d4e0 con 0x558cd557f880 2024-08-20T01:42:31.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.479+0000 7f69d37fe640 1 --2- 172.21.15.79:0/276914638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cd557f880 0x558cd5583a40 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f69c400aa50 tx=0x7f69c400a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=143625808cd7ef07 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:31.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.479+0000 7f69b97fa640 1 -- 172.21.15.79:0/276914638 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c4005240 con 0x558cd557f880 2024-08-20T01:42:31.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.480+0000 7f69b97fa640 1 -- 172.21.15.79:0/276914638 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69c40053e0 con 0x558cd557f880 2024-08-20T01:42:31.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.480+0000 7f69b97fa640 1 -- 172.21.15.79:0/276914638 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c4025450 con 0x558cd557f880 2024-08-20T01:42:31.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.480+0000 7f69dc05d740 1 -- 172.21.15.79:0/276914638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cd557f880 msgr2=0x558cd5583a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:31.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.480+0000 7f69dc05d740 1 --2- 172.21.15.79:0/276914638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cd557f880 0x558cd5583a40 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f69c400aa50 tx=0x7f69c400a300 comp rx=0 tx=0).stop 2024-08-20T01:42:31.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.480+0000 7f69dc05d740 1 -- 172.21.15.79:0/276914638 shutdown_connections 2024-08-20T01:42:31.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.480+0000 7f69dc05d740 1 --2- 172.21.15.79:0/276914638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cd558c130 0x558cd55ac5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:31.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.480+0000 7f69dc05d740 1 --2- 172.21.15.79:0/276914638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cd55801a0 0x558cd558ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:31.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.480+0000 7f69dc05d740 1 --2- 172.21.15.79:0/276914638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cd557f880 0x558cd5583a40 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:31.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.480+0000 7f69dc05d740 1 -- 172.21.15.79:0/276914638 >> 172.21.15.79:0/276914638 conn(0x558cd557d6b0 msgr2=0x558cd558a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:31.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.480+0000 7f69dc05d740 1 -- 172.21.15.79:0/276914638 shutdown_connections 2024-08-20T01:42:31.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.480+0000 7f69dc05d740 1 -- 172.21.15.79:0/276914638 wait complete. 2024-08-20T01:42:31.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.481+0000 7f69dc05d740 1 -- start start 2024-08-20T01:42:31.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.481+0000 7f69dc05d740 1 Processor -- start 2024-08-20T01:42:31.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.481+0000 7f69dc05d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cd557f880 0x558cd55a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:31.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.481+0000 7f69dc05d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cd55801a0 0x558cd55a1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:31.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.481+0000 7f69dc05d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cd558c130 0x558cd55a17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:31.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.481+0000 7f69dc05d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f69d41ad220 con 0x558cd558c130 2024-08-20T01:42:31.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.481+0000 7f69dc05d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f69d41acb50 con 0x558cd557f880 2024-08-20T01:42:31.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.481+0000 7f69dc05d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f69d41a9d90 con 0x558cd55801a0 2024-08-20T01:42:31.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.481+0000 7f69dc05d740 10 client.0 _ll_register_callbacks cb 0x7f69cc009860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:42:31.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.481+0000 7f69d37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cd557f880 0x558cd55a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:31.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.481+0000 7f69d37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cd557f880 0x558cd55a0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:37552/0 (socket says 172.21.15.79:37552) 2024-08-20T01:42:31.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.481+0000 7f69d37fe640 1 -- 172.21.15.79:0/1477547105 learned_addr learned my addr 172.21.15.79:0/1477547105 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:31.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.481+0000 7f69d3fff640 1 --2- 172.21.15.79:0/1477547105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cd558c130 0x558cd55a17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:31.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.482+0000 7f69d2ffd640 1 --2- 172.21.15.79:0/1477547105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cd55801a0 0x558cd55a1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:31.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.482+0000 7f69d3fff640 1 -- 172.21.15.79:0/1477547105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cd55801a0 msgr2=0x558cd55a1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:31.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.482+0000 7f69d3fff640 1 --2- 172.21.15.79:0/1477547105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cd55801a0 0x558cd55a1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:31.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.482+0000 7f69d3fff640 1 -- 172.21.15.79:0/1477547105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cd557f880 msgr2=0x558cd55a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:31.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.482+0000 7f69d3fff640 1 --2- 172.21.15.79:0/1477547105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cd557f880 0x558cd55a0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:31.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.482+0000 7f69d3fff640 1 -- 172.21.15.79:0/1477547105 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cd557ed90 con 0x558cd558c130 2024-08-20T01:42:31.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.482+0000 7f69d3fff640 1 --2- 172.21.15.79:0/1477547105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cd558c130 0x558cd55a17c0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f69cc005b00 tx=0x7f69cc009430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73eacb8da809fe8c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:31.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.482+0000 7f69b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:42:31.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.482+0000 7f69b2ffd640 1 -- 172.21.15.79:0/1477547105 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69cc040060 con 0x558cd558c130 2024-08-20T01:42:31.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.482+0000 7f69b2ffd640 1 -- 172.21.15.79:0/1477547105 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f69cc01f420 con 0x558cd558c130 2024-08-20T01:42:31.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.482+0000 7f69dc05d740 1 -- 172.21.15.79:0/1477547105 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69c40053e0 con 0x558cd558c130 2024-08-20T01:42:31.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.482+0000 7f69b2ffd640 1 -- 172.21.15.79:0/1477547105 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f69cc012510 con 0x558cd558c130 2024-08-20T01:42:31.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.482+0000 7f69dc05d740 10 client.17085 fetch_fsmap learned FSMap version 38 2024-08-20T01:42:31.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.482+0000 7f69dc05d740 1 -- 172.21.15.79:0/1477547105 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x558cd560f960 con 0x558cd558c130 2024-08-20T01:42:31.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.483+0000 7f69b2ffd640 1 -- 172.21.15.79:0/1477547105 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69c40053e0 con 0x558cd558c130 2024-08-20T01:42:31.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.483+0000 7f69b2ffd640 1 -- 172.21.15.79:0/1477547105 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f69cc01f7c0 con 0x558cd558c130 2024-08-20T01:42:31.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.483+0000 7f69dc05d740 10 client.17085 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:42:31.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.483+0000 7f69dc05d740 10 client.17085 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:42:31.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.483+0000 7f69dc05d740 20 client.17085 populate_metadata read hostname 'smithi079' 2024-08-20T01:42:31.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.483+0000 7f69dc05d740 1 --2- 172.21.15.79:0/1477547105 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x558cd5610030 0x558cd5612450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:31.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.483+0000 7f69dc05d740 4 client.17085 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:42:31.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.483+0000 7f69dc05d740 1 -- 172.21.15.79:0/1477547105 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558cd54f4320 con 0x558cd5610030 2024-08-20T01:42:31.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.483+0000 7f69d37fe640 1 --2- 172.21.15.79:0/1477547105 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x558cd5610030 0x558cd5612450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:31.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.484+0000 7f69b2ffd640 10 client.17085 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:42:31.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.484+0000 7f69d37fe640 1 --2- 172.21.15.79:0/1477547105 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x558cd5610030 0x558cd5612450 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=65284aa0dbd763e6 server_cookie=c39dbeca443e60e in_seq=0 out_seq=0 2024-08-20T01:42:31.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.484+0000 7f69b2ffd640 1 -- 172.21.15.79:0/1477547105 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558cd54f4320 con 0x558cd5610030 2024-08-20T01:42:31.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.484+0000 7f69b2ffd640 10 client.17085 handle_command_reply: tid=0 2024-08-20T01:42:31.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.484+0000 7f69dc05d740 1 client.17085 shutdown 2024-08-20T01:42:31.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.484+0000 7f69dc05d740 1 -- 172.21.15.79:0/1477547105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cd558c130 msgr2=0x558cd55a17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:31.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.484+0000 7f69dc05d740 1 --2- 172.21.15.79:0/1477547105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cd558c130 0x558cd55a17c0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f69cc005b00 tx=0x7f69cc009430 comp rx=0 tx=0).stop 2024-08-20T01:42:31.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.485+0000 7f69dc05d740 1 -- 172.21.15.79:0/1477547105 shutdown_connections 2024-08-20T01:42:31.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.485+0000 7f69dc05d740 1 --2- 172.21.15.79:0/1477547105 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x558cd5610030 0x558cd5612450 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:31.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.485+0000 7f69dc05d740 1 --2- 172.21.15.79:0/1477547105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cd558c130 0x558cd55a17c0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:31.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.485+0000 7f69b2ffd640 0 client.17085 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:42:31.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.485+0000 7f69dc05d740 1 --2- 172.21.15.79:0/1477547105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cd55801a0 0x558cd55a1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:31.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.485+0000 7f69dc05d740 1 --2- 172.21.15.79:0/1477547105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cd557f880 0x558cd55a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:31.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.485+0000 7f69dc05d740 1 -- 172.21.15.79:0/1477547105 >> 172.21.15.79:0/1477547105 conn(0x558cd557d6b0 msgr2=0x558cd558af20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:31.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.485+0000 7f69dc05d740 1 -- 172.21.15.79:0/1477547105 shutdown_connections 2024-08-20T01:42:31.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.485+0000 7f69dc05d740 1 -- 172.21.15.79:0/1477547105 wait complete. 2024-08-20T01:42:31.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.485+0000 7f69dc05d740 20 client.17085 trim_cache size 0 max 16384 2024-08-20T01:42:31.501 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:42:31.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.485+0000 7f69d9c64640 1 -- 172.21.15.79:0/1727194213 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f69bc0b3c50 msgr2=0x7f69bc0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:31.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.485+0000 7f69d9c64640 1 --2- 172.21.15.79:0/1727194213 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f69bc0b3c50 0x7f69bc0b6110 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f69cc005fd0 tx=0x7f69cc009590 comp rx=0 tx=0).stop 2024-08-20T01:42:31.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.485+0000 7f69d9c64640 1 -- 172.21.15.79:0/1727194213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69d41042c0 msgr2=0x7f69d41993c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:31.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.485+0000 7f69d9c64640 1 --2- 172.21.15.79:0/1727194213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69d41042c0 0x7f69d41993c0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f69c802a930 tx=0x7f69c8003b90 comp rx=0 tx=0).stop 2024-08-20T01:42:31.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.486+0000 7f69d9c64640 1 -- 172.21.15.79:0/1727194213 shutdown_connections 2024-08-20T01:42:31.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.486+0000 7f69d9c64640 1 --2- 172.21.15.79:0/1727194213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69d410ce00 0x7f69d419e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:31.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.486+0000 7f69d9c64640 1 --2- 172.21.15.79:0/1727194213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69d41042c0 0x7f69d41993c0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:31.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.486+0000 7f69d9c64640 1 --2- 172.21.15.79:0/1727194213 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f69bc0b3c50 0x7f69bc0b6110 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:31.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.486+0000 7f69d9c64640 1 --2- 172.21.15.79:0/1727194213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69d41039a0 0x7f69d4198e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:31.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.486+0000 7f69d9c64640 1 -- 172.21.15.79:0/1727194213 >> 172.21.15.79:0/1727194213 conn(0x7f69d40fd400 msgr2=0x7f69d40fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:31.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.486+0000 7f69d9c64640 1 -- 172.21.15.79:0/1727194213 shutdown_connections 2024-08-20T01:42:31.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:31.486+0000 7f69d9c64640 1 -- 172.21.15.79:0/1727194213 wait complete. 2024-08-20T01:42:32.313 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T01:42:32.591 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:42:32.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:32 smithi175 ceph-mon[22392]: pgmap v503: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 29 MiB/s wr, 23 op/s 2024-08-20T01:42:32.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:32 smithi079 ceph-mon[18656]: pgmap v503: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 29 MiB/s wr, 23 op/s 2024-08-20T01:42:32.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:32 smithi081 ceph-mon[22209]: pgmap v503: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 29 MiB/s wr, 23 op/s 2024-08-20T01:42:33.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.101+0000 7f5955414640 1 -- 172.21.15.79:0/3242106943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5950104230 msgr2=0x7f595010c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:33.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.101+0000 7f5955414640 1 --2- 172.21.15.79:0/3242106943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5950104230 0x7f595010c810 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f5944009900 tx=0x7f594402a410 comp rx=0 tx=0).stop 2024-08-20T01:42:33.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.101+0000 7f5955414640 1 -- 172.21.15.79:0/3242106943 shutdown_connections 2024-08-20T01:42:33.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.101+0000 7f5955414640 1 --2- 172.21.15.79:0/3242106943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f595010cde0 0x7f595010f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:33.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.101+0000 7f5955414640 1 --2- 172.21.15.79:0/3242106943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5950104230 0x7f595010c810 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:33.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.101+0000 7f5955414640 1 --2- 172.21.15.79:0/3242106943 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5950103830 0x7f5950103c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:33.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.101+0000 7f5955414640 1 -- 172.21.15.79:0/3242106943 >> 172.21.15.79:0/3242106943 conn(0x7f59500fd400 msgr2=0x7f59500ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:33.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.101+0000 7f5955414640 1 -- 172.21.15.79:0/3242106943 shutdown_connections 2024-08-20T01:42:33.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.101+0000 7f5955414640 1 -- 172.21.15.79:0/3242106943 wait complete. 2024-08-20T01:42:33.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.102+0000 7f5955414640 1 Processor -- start 2024-08-20T01:42:33.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.102+0000 7f5955414640 1 -- start start 2024-08-20T01:42:33.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.103+0000 7f5955414640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5950103830 0x7f5950198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:33.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.103+0000 7f5955414640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5950104230 0x7f59501993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:33.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.103+0000 7f5955414640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f595010cde0 0x7f595019e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:33.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.103+0000 7f5955414640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5950112910 con 0x7f5950103830 2024-08-20T01:42:33.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.103+0000 7f5955414640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5950112790 con 0x7f5950104230 2024-08-20T01:42:33.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.103+0000 7f5955414640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5950112a90 con 0x7f595010cde0 2024-08-20T01:42:33.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.103+0000 7f594effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5950103830 0x7f5950198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:33.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.103+0000 7f594effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5950103830 0x7f5950198e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51654/0 (socket says 172.21.15.79:51654) 2024-08-20T01:42:33.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.103+0000 7f594effd640 1 -- 172.21.15.79:0/4272318353 learned_addr learned my addr 172.21.15.79:0/4272318353 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:33.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.103+0000 7f594f7fe640 1 --2- 172.21.15.79:0/4272318353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f595010cde0 0x7f595019e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:33.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.103+0000 7f594e7fc640 1 --2- 172.21.15.79:0/4272318353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5950104230 0x7f59501993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:33.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.103+0000 7f594effd640 1 -- 172.21.15.79:0/4272318353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f595010cde0 msgr2=0x7f595019e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:33.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.103+0000 7f594effd640 1 --2- 172.21.15.79:0/4272318353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f595010cde0 0x7f595019e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:33.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.103+0000 7f594effd640 1 -- 172.21.15.79:0/4272318353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5950104230 msgr2=0x7f59501993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:33.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.103+0000 7f594effd640 1 --2- 172.21.15.79:0/4272318353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5950104230 0x7f59501993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:33.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.103+0000 7f594effd640 1 -- 172.21.15.79:0/4272318353 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f595019ef10 con 0x7f5950103830 2024-08-20T01:42:33.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.103+0000 7f594effd640 1 --2- 172.21.15.79:0/4272318353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5950103830 0x7f5950198e60 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f594000c970 tx=0x7f594000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:33.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.103+0000 7f5937fff640 1 -- 172.21.15.79:0/4272318353 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5940007bb0 con 0x7f5950103830 2024-08-20T01:42:33.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.103+0000 7f5955414640 1 -- 172.21.15.79:0/4272318353 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f595019f200 con 0x7f5950103830 2024-08-20T01:42:33.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.103+0000 7f5937fff640 1 -- 172.21.15.79:0/4272318353 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5940007d50 con 0x7f5950103830 2024-08-20T01:42:33.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.103+0000 7f5937fff640 1 -- 172.21.15.79:0/4272318353 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5940004e40 con 0x7f5950103830 2024-08-20T01:42:33.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.104+0000 7f5955414640 1 -- 172.21.15.79:0/4272318353 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59501a58c0 con 0x7f5950103830 2024-08-20T01:42:33.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.106+0000 7f5937fff640 1 -- 172.21.15.79:0/4272318353 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5940005020 con 0x7f5950103830 2024-08-20T01:42:33.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.107+0000 7f595780d740 1 Processor -- start 2024-08-20T01:42:33.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.107+0000 7f595780d740 1 -- start start 2024-08-20T01:42:33.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.107+0000 7f595780d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558580d7a880 0x558580d7ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:33.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.107+0000 7f595780d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558580d7b1a0 0x558580d86bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:33.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.107+0000 7f595780d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558580d87130 0x558580d89520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:33.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.107+0000 7f595780d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558580cf1930 con 0x558580d7b1a0 2024-08-20T01:42:33.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.107+0000 7f595780d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558580ce0e30 con 0x558580d87130 2024-08-20T01:42:33.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.107+0000 7f595780d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558580ce4e70 con 0x558580d7a880 2024-08-20T01:42:33.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.107+0000 7f594e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558580d87130 0x558580d89520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:33.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.107+0000 7f594f7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558580d7a880 0x558580d7ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:33.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.107+0000 7f594e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558580d87130 0x558580d89520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:37588/0 (socket says 172.21.15.79:37588) 2024-08-20T01:42:33.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.107+0000 7f594f7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558580d7a880 0x558580d7ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:54732/0 (socket says 172.21.15.79:54732) 2024-08-20T01:42:33.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.107+0000 7f594e7fc640 1 -- 172.21.15.79:0/2846556473 learned_addr learned my addr 172.21.15.79:0/2846556473 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:33.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.107+0000 7f594effd640 1 --2- 172.21.15.79:0/2846556473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558580d7b1a0 0x558580d86bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:33.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.107+0000 7f5937fff640 1 --2- 172.21.15.79:0/4272318353 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f59380b3bd0 0x7f59380b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:33.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.107+0000 7f594e7fc640 1 -- 172.21.15.79:0/2846556473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558580d7a880 msgr2=0x558580d7ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:33.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.108+0000 7f594e7fc640 1 --2- 172.21.15.79:0/2846556473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558580d7a880 0x558580d7ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:33.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.108+0000 7f594e7fc640 1 -- 172.21.15.79:0/2846556473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558580d7b1a0 msgr2=0x558580d86bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:33.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.108+0000 7f594e7fc640 1 --2- 172.21.15.79:0/2846556473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558580d7b1a0 0x558580d86bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:33.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.108+0000 7f594e7fc640 1 -- 172.21.15.79:0/2846556473 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558580a40650 con 0x558580d87130 2024-08-20T01:42:33.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.108+0000 7f594f7fe640 1 --2- 172.21.15.79:0/4272318353 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f59380b3bd0 0x7f59380b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:33.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.108+0000 7f594e7fc640 1 --2- 172.21.15.79:0/2846556473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558580d87130 0x558580d89520 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5944009900 tx=0x7f5944032d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c379ff43eee6ad02 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:33.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.108+0000 7f5937fff640 1 -- 172.21.15.79:0/4272318353 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f59400e39f0 con 0x7f5950103830 2024-08-20T01:42:33.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.108+0000 7f59357fa640 1 -- 172.21.15.79:0/2846556473 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f594403f070 con 0x558580d87130 2024-08-20T01:42:33.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.108+0000 7f59357fa640 1 -- 172.21.15.79:0/2846556473 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f59440044c0 con 0x558580d87130 2024-08-20T01:42:33.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.108+0000 7f59357fa640 1 -- 172.21.15.79:0/2846556473 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5944035070 con 0x558580d87130 2024-08-20T01:42:33.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.109+0000 7f595780d740 1 -- 172.21.15.79:0/2846556473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558580d87130 msgr2=0x558580d89520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:33.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.109+0000 7f595780d740 1 --2- 172.21.15.79:0/2846556473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558580d87130 0x558580d89520 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5944009900 tx=0x7f5944032d10 comp rx=0 tx=0).stop 2024-08-20T01:42:33.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.109+0000 7f594f7fe640 1 --2- 172.21.15.79:0/4272318353 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f59380b3bd0 0x7f59380b6090 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5948005fd0 tx=0x7f5948004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:33.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.109+0000 7f595780d740 1 -- 172.21.15.79:0/2846556473 shutdown_connections 2024-08-20T01:42:33.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.109+0000 7f595780d740 1 --2- 172.21.15.79:0/2846556473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558580d87130 0x558580d89520 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:33.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.109+0000 7f595780d740 1 --2- 172.21.15.79:0/2846556473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558580d7b1a0 0x558580d86bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:33.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.109+0000 7f595780d740 1 --2- 172.21.15.79:0/2846556473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558580d7a880 0x558580d7ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:33.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.109+0000 7f595780d740 1 -- 172.21.15.79:0/2846556473 >> 172.21.15.79:0/2846556473 conn(0x558580d786b0 msgr2=0x558580d79850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:33.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.109+0000 7f595780d740 1 -- 172.21.15.79:0/2846556473 shutdown_connections 2024-08-20T01:42:33.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.109+0000 7f595780d740 1 -- 172.21.15.79:0/2846556473 wait complete. 2024-08-20T01:42:33.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.109+0000 7f595780d740 1 -- start start 2024-08-20T01:42:33.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.110+0000 7f595780d740 1 Processor -- start 2024-08-20T01:42:33.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.110+0000 7f595780d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558580d7a880 0x558580d84070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:33.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.110+0000 7f595780d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558580d7b1a0 0x558580d845b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:33.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.110+0000 7f595780d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558580d87130 0x558580d84af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:33.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.110+0000 7f595780d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558580b43700 con 0x558580d7b1a0 2024-08-20T01:42:33.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.110+0000 7f595780d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558580c67810 con 0x558580d7a880 2024-08-20T01:42:33.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.110+0000 7f595780d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558580d89d80 con 0x558580d87130 2024-08-20T01:42:33.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.110+0000 7f595780d740 10 client.0 _ll_register_callbacks cb 0x558580cda700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:42:33.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.110+0000 7f594e7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558580d7b1a0 0x558580d845b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:33.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.110+0000 7f594e7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558580d7b1a0 0x558580d845b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51670/0 (socket says 172.21.15.79:51670) 2024-08-20T01:42:33.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.110+0000 7f594e7fc640 1 -- 172.21.15.79:0/617735407 learned_addr learned my addr 172.21.15.79:0/617735407 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:33.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.110+0000 7f594effd640 1 --2- 172.21.15.79:0/617735407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558580d7a880 0x558580d84070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:33.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.110+0000 7f594e7fc640 1 -- 172.21.15.79:0/617735407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558580d87130 msgr2=0x558580d84af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:33.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.110+0000 7f594e7fc640 1 --2- 172.21.15.79:0/617735407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558580d87130 0x558580d84af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:33.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.110+0000 7f594e7fc640 1 -- 172.21.15.79:0/617735407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558580d7a880 msgr2=0x558580d84070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:33.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.110+0000 7f594e7fc640 1 --2- 172.21.15.79:0/617735407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558580d7a880 0x558580d84070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:33.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.110+0000 7f594e7fc640 1 -- 172.21.15.79:0/617735407 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558580d93140 con 0x558580d7b1a0 2024-08-20T01:42:33.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.110+0000 7f594effd640 1 --2- 172.21.15.79:0/617735407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558580d7a880 0x558580d84070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:42:33.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.110+0000 7f594e7fc640 1 --2- 172.21.15.79:0/617735407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558580d7b1a0 0x558580d845b0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f59440057c0 tx=0x7f5944031750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f33554fe97f4cd7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:33.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.110+0000 7f5932ff5640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:42:33.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.111+0000 7f5932ff5640 1 -- 172.21.15.79:0/617735407 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f594403f070 con 0x558580d7b1a0 2024-08-20T01:42:33.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.111+0000 7f5932ff5640 1 -- 172.21.15.79:0/617735407 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f59440046c0 con 0x558580d7b1a0 2024-08-20T01:42:33.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.111+0000 7f595780d740 1 -- 172.21.15.79:0/617735407 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558580c90150 con 0x558580d7b1a0 2024-08-20T01:42:33.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.111+0000 7f5932ff5640 1 -- 172.21.15.79:0/617735407 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f5944035040 con 0x558580d7b1a0 2024-08-20T01:42:33.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.111+0000 7f595780d740 10 client.17097 fetch_fsmap learned FSMap version 38 2024-08-20T01:42:33.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.111+0000 7f595780d740 1 -- 172.21.15.79:0/617735407 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x558580d95af0 con 0x558580d7b1a0 2024-08-20T01:42:33.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.111+0000 7f5932ff5640 1 -- 172.21.15.79:0/617735407 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x558580c90150 con 0x558580d7b1a0 2024-08-20T01:42:33.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.111+0000 7f5932ff5640 1 -- 172.21.15.79:0/617735407 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f594403b430 con 0x558580d7b1a0 2024-08-20T01:42:33.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.112+0000 7f595780d740 10 client.17097 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:42:33.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.112+0000 7f595780d740 10 client.17097 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:42:33.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.112+0000 7f595780d740 20 client.17097 populate_metadata read hostname 'smithi079' 2024-08-20T01:42:33.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.112+0000 7f595780d740 1 --2- 172.21.15.79:0/617735407 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x558580d96e40 0x558580d99230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:33.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.112+0000 7f595780d740 4 client.17097 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:42:33.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.112+0000 7f595780d740 1 -- 172.21.15.79:0/617735407 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558580cf3880 con 0x558580d96e40 2024-08-20T01:42:33.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.112+0000 7f594effd640 1 --2- 172.21.15.79:0/617735407 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x558580d96e40 0x558580d99230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:33.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.112+0000 7f5932ff5640 10 client.17097 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:42:33.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.112+0000 7f594effd640 1 --2- 172.21.15.79:0/617735407 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x558580d96e40 0x558580d99230 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=11a14d8fa3512db7 server_cookie=544167ae52f7a0f7 in_seq=0 out_seq=0 2024-08-20T01:42:33.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.113+0000 7f5932ff5640 1 -- 172.21.15.79:0/617735407 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558580cf3880 con 0x558580d96e40 2024-08-20T01:42:33.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.113+0000 7f5932ff5640 10 client.17097 handle_command_reply: tid=0 2024-08-20T01:42:33.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.113+0000 7f595780d740 1 client.17097 shutdown 2024-08-20T01:42:33.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.113+0000 7f595780d740 1 -- 172.21.15.79:0/617735407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558580d7b1a0 msgr2=0x558580d845b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:33.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.113+0000 7f595780d740 1 --2- 172.21.15.79:0/617735407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558580d7b1a0 0x558580d845b0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f59440057c0 tx=0x7f5944031750 comp rx=0 tx=0).stop 2024-08-20T01:42:33.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.113+0000 7f595780d740 1 -- 172.21.15.79:0/617735407 shutdown_connections 2024-08-20T01:42:33.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.113+0000 7f595780d740 1 --2- 172.21.15.79:0/617735407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558580d87130 0x558580d84af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:33.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.113+0000 7f595780d740 1 --2- 172.21.15.79:0/617735407 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x558580d96e40 0x558580d99230 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:33.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.113+0000 7f5932ff5640 0 client.17097 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:42:33.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.113+0000 7f595780d740 1 --2- 172.21.15.79:0/617735407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558580d7b1a0 0x558580d845b0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:33.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.113+0000 7f595780d740 1 --2- 172.21.15.79:0/617735407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558580d7a880 0x558580d84070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:33.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.114+0000 7f595780d740 1 -- 172.21.15.79:0/617735407 >> 172.21.15.79:0/617735407 conn(0x558580d786b0 msgr2=0x558580d7e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:33.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.114+0000 7f595780d740 1 -- 172.21.15.79:0/617735407 shutdown_connections 2024-08-20T01:42:33.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.114+0000 7f595780d740 1 -- 172.21.15.79:0/617735407 wait complete. 2024-08-20T01:42:33.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.114+0000 7f595780d740 20 client.17097 trim_cache size 0 max 16384 2024-08-20T01:42:33.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.127+0000 7f595780d740 1 Processor -- start 2024-08-20T01:42:33.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.127+0000 7f595780d740 1 -- start start 2024-08-20T01:42:33.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.127+0000 7f595780d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558580d7a880 0x558580d79d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:33.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.127+0000 7f595780d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558580d87130 0x558580d85db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:33.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.127+0000 7f595780d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558580d73600 0x558580d9e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:33.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.127+0000 7f595780d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f59501adf20 con 0x558580d7a880 2024-08-20T01:42:33.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.127+0000 7f595780d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f59501afa60 con 0x558580d87130 2024-08-20T01:42:33.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.127+0000 7f595780d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f59501ae5f0 con 0x558580d73600 2024-08-20T01:42:33.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.127+0000 7f594effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558580d7a880 0x558580d79d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:33.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.127+0000 7f594effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558580d7a880 0x558580d79d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51684/0 (socket says 172.21.15.79:51684) 2024-08-20T01:42:33.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.127+0000 7f594effd640 1 -- 172.21.15.79:0/813106821 learned_addr learned my addr 172.21.15.79:0/813106821 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:33.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.127+0000 7f594f7fe640 1 --2- 172.21.15.79:0/813106821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558580d73600 0x558580d9e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:33.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.127+0000 7f594e7fc640 1 --2- 172.21.15.79:0/813106821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558580d87130 0x558580d85db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:33.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.128+0000 7f594effd640 1 -- 172.21.15.79:0/813106821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558580d73600 msgr2=0x558580d9e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:33.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.128+0000 7f594effd640 1 --2- 172.21.15.79:0/813106821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558580d73600 0x558580d9e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:33.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.128+0000 7f594effd640 1 -- 172.21.15.79:0/813106821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558580d87130 msgr2=0x558580d85db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:33.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.128+0000 7f594effd640 1 --2- 172.21.15.79:0/813106821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558580d87130 0x558580d85db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:33.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.128+0000 7f594effd640 1 -- 172.21.15.79:0/813106821 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558580d79130 con 0x558580d7a880 2024-08-20T01:42:33.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.128+0000 7f594e7fc640 1 --2- 172.21.15.79:0/813106821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558580d87130 0x558580d85db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:42:33.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.128+0000 7f594effd640 1 --2- 172.21.15.79:0/813106821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558580d7a880 0x558580d79d70 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f59400a7bc0 tx=0x7f59400e13d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37521aef0184d23 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:33.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.128+0000 7f5934ff9640 1 -- 172.21.15.79:0/813106821 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f594001d040 con 0x558580d7a880 2024-08-20T01:42:33.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.128+0000 7f5934ff9640 1 -- 172.21.15.79:0/813106821 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f59400cbe50 con 0x558580d7a880 2024-08-20T01:42:33.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.128+0000 7f5934ff9640 1 -- 172.21.15.79:0/813106821 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59400aef50 con 0x558580d7a880 2024-08-20T01:42:33.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.129+0000 7f595780d740 1 -- 172.21.15.79:0/813106821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558580d7a880 msgr2=0x558580d79d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:33.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.129+0000 7f595780d740 1 --2- 172.21.15.79:0/813106821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558580d7a880 0x558580d79d70 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f59400a7bc0 tx=0x7f59400e13d0 comp rx=0 tx=0).stop 2024-08-20T01:42:33.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.129+0000 7f595780d740 1 -- 172.21.15.79:0/813106821 shutdown_connections 2024-08-20T01:42:33.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.129+0000 7f595780d740 1 --2- 172.21.15.79:0/813106821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558580d73600 0x558580d9e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:33.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.129+0000 7f595780d740 1 --2- 172.21.15.79:0/813106821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558580d87130 0x558580d85db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:33.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.129+0000 7f595780d740 1 --2- 172.21.15.79:0/813106821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558580d7a880 0x558580d79d70 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:33.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.129+0000 7f595780d740 1 -- 172.21.15.79:0/813106821 >> 172.21.15.79:0/813106821 conn(0x558580d786b0 msgr2=0x558580d856a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:33.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.129+0000 7f595780d740 1 -- 172.21.15.79:0/813106821 shutdown_connections 2024-08-20T01:42:33.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.129+0000 7f595780d740 1 -- 172.21.15.79:0/813106821 wait complete. 2024-08-20T01:42:33.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.129+0000 7f595780d740 1 -- start start 2024-08-20T01:42:33.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.129+0000 7f595780d740 1 Processor -- start 2024-08-20T01:42:33.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.130+0000 7f595780d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558580d73600 0x558580d81170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:33.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.130+0000 7f595780d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558580d7a880 0x558580d816b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:33.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.130+0000 7f595780d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558580d87130 0x558580d81bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:33.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.130+0000 7f595780d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f59501af390 con 0x558580d87130 2024-08-20T01:42:33.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.130+0000 7f595780d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f59501aecc0 con 0x558580d73600 2024-08-20T01:42:33.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.130+0000 7f595780d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f59501abf00 con 0x558580d7a880 2024-08-20T01:42:33.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.130+0000 7f595780d740 10 client.0 _ll_register_callbacks cb 0x7f59400e9400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:42:33.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.130+0000 7f594f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558580d87130 0x558580d81bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:33.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.130+0000 7f594f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558580d87130 0x558580d81bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51696/0 (socket says 172.21.15.79:51696) 2024-08-20T01:42:33.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.130+0000 7f594f7fe640 1 -- 172.21.15.79:0/1514145385 learned_addr learned my addr 172.21.15.79:0/1514145385 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:33.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.130+0000 7f594effd640 1 --2- 172.21.15.79:0/1514145385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558580d73600 0x558580d81170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:33.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.130+0000 7f594e7fc640 1 --2- 172.21.15.79:0/1514145385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558580d7a880 0x558580d816b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:33.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.130+0000 7f594f7fe640 1 -- 172.21.15.79:0/1514145385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558580d7a880 msgr2=0x558580d816b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:33.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.130+0000 7f594f7fe640 1 --2- 172.21.15.79:0/1514145385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558580d7a880 0x558580d816b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:33.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.130+0000 7f594f7fe640 1 -- 172.21.15.79:0/1514145385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558580d73600 msgr2=0x558580d81170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:33.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.130+0000 7f594f7fe640 1 --2- 172.21.15.79:0/1514145385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558580d73600 0x558580d81170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:33.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.130+0000 7f594f7fe640 1 -- 172.21.15.79:0/1514145385 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558580d8e750 con 0x558580d87130 2024-08-20T01:42:33.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.130+0000 7f594f7fe640 1 --2- 172.21.15.79:0/1514145385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558580d87130 0x558580d81bf0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f5948009420 tx=0x7f5948009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6642aae32cb93fc1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:33.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.130+0000 7f5932ff5640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:42:33.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.131+0000 7f5932ff5640 1 -- 172.21.15.79:0/1514145385 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5948011cd0 con 0x558580d87130 2024-08-20T01:42:33.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.131+0000 7f5932ff5640 1 -- 172.21.15.79:0/1514145385 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f594801f420 con 0x558580d87130 2024-08-20T01:42:33.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.131+0000 7f595780d740 1 -- 172.21.15.79:0/1514145385 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59400cbe50 con 0x558580d87130 2024-08-20T01:42:33.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.131+0000 7f5932ff5640 1 -- 172.21.15.79:0/1514145385 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f5948010e20 con 0x558580d87130 2024-08-20T01:42:33.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.131+0000 7f595780d740 10 client.17103 fetch_fsmap learned FSMap version 38 2024-08-20T01:42:33.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.131+0000 7f595780d740 1 -- 172.21.15.79:0/1514145385 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x558580e05fb0 con 0x558580d87130 2024-08-20T01:42:33.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.131+0000 7f5932ff5640 1 -- 172.21.15.79:0/1514145385 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f59400cbe50 con 0x558580d87130 2024-08-20T01:42:33.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.131+0000 7f5932ff5640 1 -- 172.21.15.79:0/1514145385 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f594801e560 con 0x558580d87130 2024-08-20T01:42:33.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.131+0000 7f595780d740 10 client.17103 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:42:33.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.131+0000 7f595780d740 10 client.17103 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:42:33.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.131+0000 7f595780d740 20 client.17103 populate_metadata read hostname 'smithi079' 2024-08-20T01:42:33.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.131+0000 7f595780d740 1 --2- 172.21.15.79:0/1514145385 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x558580e067e0 0x558580e08c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:33.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.131+0000 7f595780d740 4 client.17103 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:42:33.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.131+0000 7f595780d740 1 -- 172.21.15.79:0/1514145385 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558580cef320 con 0x558580e067e0 2024-08-20T01:42:33.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.132+0000 7f594effd640 1 --2- 172.21.15.79:0/1514145385 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x558580e067e0 0x558580e08c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:33.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.133+0000 7f594effd640 1 --2- 172.21.15.79:0/1514145385 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x558580e067e0 0x558580e08c00 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e10d2575c7fbad72 server_cookie=abf0efa4fe497241 in_seq=0 out_seq=0 2024-08-20T01:42:33.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.133+0000 7f5932ff5640 10 client.17103 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:42:33.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.133+0000 7f5932ff5640 1 -- 172.21.15.79:0/1514145385 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558580cef320 con 0x558580e067e0 2024-08-20T01:42:33.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.133+0000 7f5932ff5640 10 client.17103 handle_command_reply: tid=0 2024-08-20T01:42:33.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.133+0000 7f595780d740 1 client.17103 shutdown 2024-08-20T01:42:33.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.133+0000 7f595780d740 1 -- 172.21.15.79:0/1514145385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558580d87130 msgr2=0x558580d81bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:33.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.133+0000 7f595780d740 1 --2- 172.21.15.79:0/1514145385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558580d87130 0x558580d81bf0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f5948009420 tx=0x7f5948009500 comp rx=0 tx=0).stop 2024-08-20T01:42:33.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.133+0000 7f595780d740 1 -- 172.21.15.79:0/1514145385 shutdown_connections 2024-08-20T01:42:33.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.133+0000 7f595780d740 1 --2- 172.21.15.79:0/1514145385 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x558580e067e0 0x558580e08c00 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:33.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.133+0000 7f595780d740 1 --2- 172.21.15.79:0/1514145385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558580d87130 0x558580d81bf0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:33.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.133+0000 7f595780d740 1 --2- 172.21.15.79:0/1514145385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558580d7a880 0x558580d816b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:33.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.133+0000 7f595780d740 1 --2- 172.21.15.79:0/1514145385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558580d73600 0x558580d81170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:33.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.133+0000 7f595780d740 1 -- 172.21.15.79:0/1514145385 >> 172.21.15.79:0/1514145385 conn(0x558580d786b0 msgr2=0x558580d79c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:33.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.133+0000 7f5932ff5640 0 client.17103 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:42:33.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.133+0000 7f595780d740 1 -- 172.21.15.79:0/1514145385 shutdown_connections 2024-08-20T01:42:33.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.133+0000 7f595780d740 1 -- 172.21.15.79:0/1514145385 wait complete. 2024-08-20T01:42:33.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.133+0000 7f595780d740 20 client.17103 trim_cache size 0 max 16384 2024-08-20T01:42:33.142 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:42:33.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.134+0000 7f5955414640 1 -- 172.21.15.79:0/4272318353 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f59380b3bd0 msgr2=0x7f59380b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:33.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.134+0000 7f5955414640 1 --2- 172.21.15.79:0/4272318353 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f59380b3bd0 0x7f59380b6090 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5948005fd0 tx=0x7f5948004a40 comp rx=0 tx=0).stop 2024-08-20T01:42:33.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.134+0000 7f5955414640 1 -- 172.21.15.79:0/4272318353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5950103830 msgr2=0x7f5950198e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:33.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.134+0000 7f5955414640 1 --2- 172.21.15.79:0/4272318353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5950103830 0x7f5950198e60 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f594000c970 tx=0x7f594000ce30 comp rx=0 tx=0).stop 2024-08-20T01:42:33.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.134+0000 7f5955414640 1 -- 172.21.15.79:0/4272318353 shutdown_connections 2024-08-20T01:42:33.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.134+0000 7f5955414640 1 --2- 172.21.15.79:0/4272318353 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f59380b3bd0 0x7f59380b6090 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:33.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.134+0000 7f5955414640 1 --2- 172.21.15.79:0/4272318353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f595010cde0 0x7f595019e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:33.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.134+0000 7f5955414640 1 --2- 172.21.15.79:0/4272318353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5950104230 0x7f59501993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:33.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.134+0000 7f5955414640 1 --2- 172.21.15.79:0/4272318353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5950103830 0x7f5950198e60 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:33.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.134+0000 7f5955414640 1 -- 172.21.15.79:0/4272318353 >> 172.21.15.79:0/4272318353 conn(0x7f59500fd400 msgr2=0x7f59500fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:33.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.134+0000 7f5955414640 1 -- 172.21.15.79:0/4272318353 shutdown_connections 2024-08-20T01:42:33.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:33.134+0000 7f5955414640 1 -- 172.21.15.79:0/4272318353 wait complete. 2024-08-20T01:42:34.014 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T01:42:34.297 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:42:34.570 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:34 smithi079 ceph-mon[18656]: pgmap v504: 97 pgs: 97 active+clean; 7.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 27 MiB/s wr, 22 op/s 2024-08-20T01:42:34.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:34 smithi175 ceph-mon[22392]: pgmap v504: 97 pgs: 97 active+clean; 7.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 27 MiB/s wr, 22 op/s 2024-08-20T01:42:34.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:34 smithi081 ceph-mon[22209]: pgmap v504: 97 pgs: 97 active+clean; 7.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 27 MiB/s wr, 22 op/s 2024-08-20T01:42:34.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.810+0000 7fba5044b640 1 -- 172.21.15.79:0/728310007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba48101990 msgr2=0x7fba48101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:34.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.810+0000 7fba5044b640 1 --2- 172.21.15.79:0/728310007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba48101990 0x7fba48101d70 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fba44009900 tx=0x7fba4402a410 comp rx=0 tx=0).stop 2024-08-20T01:42:34.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.810+0000 7fba5044b640 1 -- 172.21.15.79:0/728310007 shutdown_connections 2024-08-20T01:42:34.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.810+0000 7fba5044b640 1 --2- 172.21.15.79:0/728310007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba48107d20 0x7fba4810e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:34.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.810+0000 7fba5044b640 1 --2- 172.21.15.79:0/728310007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba481073a0 0x7fba481077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:34.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.810+0000 7fba5044b640 1 --2- 172.21.15.79:0/728310007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba48101990 0x7fba48101d70 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:34.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.810+0000 7fba5044b640 1 -- 172.21.15.79:0/728310007 >> 172.21.15.79:0/728310007 conn(0x7fba480fd400 msgr2=0x7fba480ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:34.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.810+0000 7fba5044b640 1 -- 172.21.15.79:0/728310007 shutdown_connections 2024-08-20T01:42:34.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.810+0000 7fba5044b640 1 -- 172.21.15.79:0/728310007 wait complete. 2024-08-20T01:42:34.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.811+0000 7fba5044b640 1 Processor -- start 2024-08-20T01:42:34.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.811+0000 7fba5044b640 1 -- start start 2024-08-20T01:42:34.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.811+0000 7fba5044b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba48101990 0x7fba480fd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:34.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.811+0000 7fba5044b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba481073a0 0x7fba480fde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:34.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.811+0000 7fba5044b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba48107d20 0x7fba480fe380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:34.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.811+0000 7fba5044b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fba48111850 con 0x7fba48101990 2024-08-20T01:42:34.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.811+0000 7fba5044b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fba481116d0 con 0x7fba481073a0 2024-08-20T01:42:34.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.811+0000 7fba5044b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fba481119d0 con 0x7fba48107d20 2024-08-20T01:42:34.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.811+0000 7fba4e1e7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba48101990 0x7fba480fd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:34.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.811+0000 7fba4e1e7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba48101990 0x7fba480fd900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51720/0 (socket says 172.21.15.79:51720) 2024-08-20T01:42:34.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.812+0000 7fba4e1e7640 1 -- 172.21.15.79:0/456177510 learned_addr learned my addr 172.21.15.79:0/456177510 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:34.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.812+0000 7fba4d9e6640 1 --2- 172.21.15.79:0/456177510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba481073a0 0x7fba480fde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:34.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.812+0000 7fba4e9e8640 1 --2- 172.21.15.79:0/456177510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba48107d20 0x7fba480fe380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:34.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.812+0000 7fba4e1e7640 1 -- 172.21.15.79:0/456177510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba48107d20 msgr2=0x7fba480fe380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:34.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.812+0000 7fba4e1e7640 1 --2- 172.21.15.79:0/456177510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba48107d20 0x7fba480fe380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:34.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.812+0000 7fba4e1e7640 1 -- 172.21.15.79:0/456177510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba481073a0 msgr2=0x7fba480fde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:34.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.812+0000 7fba4e1e7640 1 --2- 172.21.15.79:0/456177510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba481073a0 0x7fba480fde40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:34.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.812+0000 7fba4e1e7640 1 -- 172.21.15.79:0/456177510 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba481a72b0 con 0x7fba48101990 2024-08-20T01:42:34.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.812+0000 7fba4e1e7640 1 --2- 172.21.15.79:0/456177510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba48101990 0x7fba480fd900 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fba44009230 tx=0x7fba44004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:34.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.812+0000 7fba3f7fe640 1 -- 172.21.15.79:0/456177510 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4403f030 con 0x7fba48101990 2024-08-20T01:42:34.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.812+0000 7fba5044b640 1 -- 172.21.15.79:0/456177510 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba481a7540 con 0x7fba48101990 2024-08-20T01:42:34.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.812+0000 7fba3f7fe640 1 -- 172.21.15.79:0/456177510 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba44003a80 con 0x7fba48101990 2024-08-20T01:42:34.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.812+0000 7fba3f7fe640 1 -- 172.21.15.79:0/456177510 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba44035070 con 0x7fba48101990 2024-08-20T01:42:34.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.812+0000 7fba5044b640 1 -- 172.21.15.79:0/456177510 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba481a7a70 con 0x7fba48101990 2024-08-20T01:42:34.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.815+0000 7fba3f7fe640 1 -- 172.21.15.79:0/456177510 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fba44042030 con 0x7fba48101990 2024-08-20T01:42:34.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.815+0000 7fba52844740 1 Processor -- start 2024-08-20T01:42:34.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.816+0000 7fba52844740 1 -- start start 2024-08-20T01:42:34.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.816+0000 7fba52844740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559548d9b730 0x559548d9bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:34.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.816+0000 7fba52844740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559548d9c050 0x559548da7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:34.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.816+0000 7fba52844740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559548da7fe0 0x559548daa3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:34.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.816+0000 7fba52844740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559548d12930 con 0x559548d9c050 2024-08-20T01:42:34.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.816+0000 7fba52844740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559548d01e30 con 0x559548da7fe0 2024-08-20T01:42:34.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.816+0000 7fba52844740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559548d05e70 con 0x559548d9b730 2024-08-20T01:42:34.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.816+0000 7fba4e1e7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559548d9c050 0x559548da7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:34.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.816+0000 7fba4e1e7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559548d9c050 0x559548da7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51734/0 (socket says 172.21.15.79:51734) 2024-08-20T01:42:34.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.816+0000 7fba4e1e7640 1 -- 172.21.15.79:0/1099675490 learned_addr learned my addr 172.21.15.79:0/1099675490 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:34.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.816+0000 7fba4e9e8640 1 --2- 172.21.15.79:0/1099675490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559548d9b730 0x559548d9bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:34.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.816+0000 7fba4d9e6640 1 --2- 172.21.15.79:0/1099675490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559548da7fe0 0x559548daa3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:34.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.816+0000 7fba3f7fe640 1 --2- 172.21.15.79:0/456177510 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fba340b3bd0 0x7fba340b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:34.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.817+0000 7fba4e1e7640 1 -- 172.21.15.79:0/1099675490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559548d9b730 msgr2=0x559548d9bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:34.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.817+0000 7fba4e1e7640 1 --2- 172.21.15.79:0/1099675490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559548d9b730 0x559548d9bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:34.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.817+0000 7fba4e1e7640 1 -- 172.21.15.79:0/1099675490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559548da7fe0 msgr2=0x559548daa3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:34.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.817+0000 7fba4e1e7640 1 --2- 172.21.15.79:0/1099675490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559548da7fe0 0x559548daa3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:34.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.817+0000 7fba4e1e7640 1 -- 172.21.15.79:0/1099675490 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559548a61650 con 0x559548d9c050 2024-08-20T01:42:34.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.817+0000 7fba4e9e8640 1 --2- 172.21.15.79:0/456177510 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fba340b3bd0 0x7fba340b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:34.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.817+0000 7fba4e1e7640 1 --2- 172.21.15.79:0/1099675490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559548d9c050 0x559548da7aa0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fba4409d5f0 tx=0x7fba4408ff20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ea1354258dacdcb server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:34.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.817+0000 7fba3f7fe640 1 -- 172.21.15.79:0/456177510 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fba441040a0 con 0x7fba48101990 2024-08-20T01:42:34.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.817+0000 7fba3cde6640 1 -- 172.21.15.79:0/1099675490 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba440ca950 con 0x559548d9c050 2024-08-20T01:42:34.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.817+0000 7fba3cde6640 1 -- 172.21.15.79:0/1099675490 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba4409cff0 con 0x559548d9c050 2024-08-20T01:42:34.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.817+0000 7fba3cde6640 1 -- 172.21.15.79:0/1099675490 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4409d220 con 0x559548d9c050 2024-08-20T01:42:34.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.818+0000 7fba52844740 1 -- 172.21.15.79:0/1099675490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559548d9c050 msgr2=0x559548da7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:34.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.818+0000 7fba52844740 1 --2- 172.21.15.79:0/1099675490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559548d9c050 0x559548da7aa0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fba4409d5f0 tx=0x7fba4408ff20 comp rx=0 tx=0).stop 2024-08-20T01:42:34.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.818+0000 7fba4e9e8640 1 --2- 172.21.15.79:0/456177510 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fba340b3bd0 0x7fba340b6090 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fba480ff9c0 tx=0x7fba40004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:34.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.818+0000 7fba52844740 1 -- 172.21.15.79:0/1099675490 shutdown_connections 2024-08-20T01:42:34.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.818+0000 7fba52844740 1 --2- 172.21.15.79:0/1099675490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559548da7fe0 0x559548daa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:34.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.818+0000 7fba52844740 1 --2- 172.21.15.79:0/1099675490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559548d9c050 0x559548da7aa0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:34.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.818+0000 7fba52844740 1 --2- 172.21.15.79:0/1099675490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559548d9b730 0x559548d9bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:34.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.818+0000 7fba52844740 1 -- 172.21.15.79:0/1099675490 >> 172.21.15.79:0/1099675490 conn(0x559548d99560 msgr2=0x559548d9a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:34.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.818+0000 7fba52844740 1 -- 172.21.15.79:0/1099675490 shutdown_connections 2024-08-20T01:42:34.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.818+0000 7fba52844740 1 -- 172.21.15.79:0/1099675490 wait complete. 2024-08-20T01:42:34.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.819+0000 7fba52844740 1 -- start start 2024-08-20T01:42:34.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.819+0000 7fba52844740 1 Processor -- start 2024-08-20T01:42:34.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.819+0000 7fba52844740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559548d9b730 0x559548da4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:34.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.819+0000 7fba52844740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559548d9c050 0x559548da54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:34.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.819+0000 7fba52844740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559548da7fe0 0x559548da5a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:34.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.819+0000 7fba52844740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559548b64700 con 0x559548d9c050 2024-08-20T01:42:34.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.819+0000 7fba52844740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559548c88810 con 0x559548d9b730 2024-08-20T01:42:34.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.819+0000 7fba52844740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559548daaa50 con 0x559548da7fe0 2024-08-20T01:42:34.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.819+0000 7fba4d9e6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559548d9c050 0x559548da54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:34.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.819+0000 7fba4d9e6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559548d9c050 0x559548da54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51736/0 (socket says 172.21.15.79:51736) 2024-08-20T01:42:34.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.819+0000 7fba4d9e6640 1 -- 172.21.15.79:0/2905452023 learned_addr learned my addr 172.21.15.79:0/2905452023 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:34.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.819+0000 7fba52844740 10 client.0 _ll_register_callbacks cb 0x559548cfb700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:42:34.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.819+0000 7fba4e1e7640 1 --2- 172.21.15.79:0/2905452023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559548d9b730 0x559548da4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:34.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.820+0000 7fba4e9e8640 1 --2- 172.21.15.79:0/2905452023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559548da7fe0 0x559548da5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:34.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.820+0000 7fba4d9e6640 1 -- 172.21.15.79:0/2905452023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559548da7fe0 msgr2=0x559548da5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:34.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.820+0000 7fba4d9e6640 1 --2- 172.21.15.79:0/2905452023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559548da7fe0 0x559548da5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:34.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.820+0000 7fba4d9e6640 1 -- 172.21.15.79:0/2905452023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559548d9b730 msgr2=0x559548da4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:34.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.820+0000 7fba4d9e6640 1 --2- 172.21.15.79:0/2905452023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559548d9b730 0x559548da4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:34.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.820+0000 7fba4d9e6640 1 -- 172.21.15.79:0/2905452023 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559548db3d30 con 0x559548d9c050 2024-08-20T01:42:34.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.820+0000 7fba4e9e8640 1 --2- 172.21.15.79:0/2905452023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559548da7fe0 0x559548da5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:42:34.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.820+0000 7fba4d9e6640 1 --2- 172.21.15.79:0/2905452023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559548d9c050 0x559548da54c0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fba38012700 tx=0x7fba38012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8758f5e3258c92fe server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:34.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.820+0000 7fba31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:42:34.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.820+0000 7fba31ffb640 1 -- 172.21.15.79:0/2905452023 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3801f060 con 0x559548d9c050 2024-08-20T01:42:34.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.820+0000 7fba31ffb640 1 -- 172.21.15.79:0/2905452023 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fba38010dc0 con 0x559548d9c050 2024-08-20T01:42:34.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.820+0000 7fba52844740 1 -- 172.21.15.79:0/2905452023 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559548cb1150 con 0x559548d9c050 2024-08-20T01:42:34.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.820+0000 7fba31ffb640 1 -- 172.21.15.79:0/2905452023 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fba3801a430 con 0x559548d9c050 2024-08-20T01:42:34.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.820+0000 7fba52844740 10 client.17115 fetch_fsmap learned FSMap version 38 2024-08-20T01:42:34.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.821+0000 7fba52844740 1 -- 172.21.15.79:0/2905452023 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x559548db6740 con 0x559548d9c050 2024-08-20T01:42:34.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.821+0000 7fba31ffb640 1 -- 172.21.15.79:0/2905452023 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x559548cb1150 con 0x559548d9c050 2024-08-20T01:42:34.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.821+0000 7fba31ffb640 1 -- 172.21.15.79:0/2905452023 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7fba3800e3b0 con 0x559548d9c050 2024-08-20T01:42:34.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.821+0000 7fba52844740 10 client.17115 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:42:34.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.821+0000 7fba52844740 10 client.17115 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:42:34.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.821+0000 7fba52844740 20 client.17115 populate_metadata read hostname 'smithi079' 2024-08-20T01:42:34.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.821+0000 7fba52844740 1 --2- 172.21.15.79:0/2905452023 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x559548db7c50 0x559548dba070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:34.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.821+0000 7fba52844740 4 client.17115 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:42:34.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.821+0000 7fba52844740 1 -- 172.21.15.79:0/2905452023 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559548d14880 con 0x559548db7c50 2024-08-20T01:42:34.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.821+0000 7fba4e1e7640 1 --2- 172.21.15.79:0/2905452023 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x559548db7c50 0x559548dba070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:34.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.822+0000 7fba4e1e7640 1 --2- 172.21.15.79:0/2905452023 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x559548db7c50 0x559548dba070 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4f9391e50451b36b server_cookie=f6181e2ffa6f1871 in_seq=0 out_seq=0 2024-08-20T01:42:34.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.822+0000 7fba31ffb640 10 client.17115 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:42:34.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.822+0000 7fba31ffb640 1 -- 172.21.15.79:0/2905452023 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559548d14880 con 0x559548db7c50 2024-08-20T01:42:34.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.822+0000 7fba31ffb640 10 client.17115 handle_command_reply: tid=0 2024-08-20T01:42:34.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.822+0000 7fba52844740 1 client.17115 shutdown 2024-08-20T01:42:34.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.823+0000 7fba52844740 1 -- 172.21.15.79:0/2905452023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559548d9c050 msgr2=0x559548da54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:34.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.823+0000 7fba52844740 1 --2- 172.21.15.79:0/2905452023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559548d9c050 0x559548da54c0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fba38012700 tx=0x7fba38012bc0 comp rx=0 tx=0).stop 2024-08-20T01:42:34.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.823+0000 7fba52844740 1 -- 172.21.15.79:0/2905452023 shutdown_connections 2024-08-20T01:42:34.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.823+0000 7fba52844740 1 --2- 172.21.15.79:0/2905452023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559548da7fe0 0x559548da5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:34.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.823+0000 7fba52844740 1 --2- 172.21.15.79:0/2905452023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559548d9c050 0x559548da54c0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:34.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.823+0000 7fba52844740 1 --2- 172.21.15.79:0/2905452023 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x559548db7c50 0x559548dba070 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:34.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.823+0000 7fba52844740 1 --2- 172.21.15.79:0/2905452023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559548d9b730 0x559548da4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:34.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.823+0000 7fba31ffb640 0 client.17115 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:42:34.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.823+0000 7fba52844740 1 -- 172.21.15.79:0/2905452023 >> 172.21.15.79:0/2905452023 conn(0x559548d99560 msgr2=0x559548d9f100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:34.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.823+0000 7fba52844740 1 -- 172.21.15.79:0/2905452023 shutdown_connections 2024-08-20T01:42:34.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.823+0000 7fba52844740 1 -- 172.21.15.79:0/2905452023 wait complete. 2024-08-20T01:42:34.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.823+0000 7fba52844740 20 client.17115 trim_cache size 0 max 16384 2024-08-20T01:42:34.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.839+0000 7fba52844740 1 Processor -- start 2024-08-20T01:42:34.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.839+0000 7fba52844740 1 -- start start 2024-08-20T01:42:34.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.840+0000 7fba52844740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559548d9b730 0x559548d9a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:34.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.840+0000 7fba52844740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559548d9c050 0x559548dbf920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:34.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.840+0000 7fba52844740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559548da7fe0 0x559548dbfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:34.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.840+0000 7fba52844740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fba481b01d0 con 0x559548da7fe0 2024-08-20T01:42:34.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.840+0000 7fba52844740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fba481b1d10 con 0x559548d9c050 2024-08-20T01:42:34.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.840+0000 7fba52844740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fba481b08a0 con 0x559548d9b730 2024-08-20T01:42:34.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.840+0000 7fba4e9e8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559548da7fe0 0x559548dbfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:34.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.840+0000 7fba4e9e8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559548da7fe0 0x559548dbfe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51748/0 (socket says 172.21.15.79:51748) 2024-08-20T01:42:34.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.840+0000 7fba4e9e8640 1 -- 172.21.15.79:0/3113669713 learned_addr learned my addr 172.21.15.79:0/3113669713 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:34.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.840+0000 7fba4d9e6640 1 --2- 172.21.15.79:0/3113669713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559548d9c050 0x559548dbf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:34.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.840+0000 7fba4e1e7640 1 --2- 172.21.15.79:0/3113669713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559548d9b730 0x559548d9a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:34.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.840+0000 7fba4e9e8640 1 -- 172.21.15.79:0/3113669713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559548d9b730 msgr2=0x559548d9a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:34.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.840+0000 7fba4e9e8640 1 --2- 172.21.15.79:0/3113669713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559548d9b730 0x559548d9a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:34.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.840+0000 7fba4e9e8640 1 -- 172.21.15.79:0/3113669713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559548d9c050 msgr2=0x559548dbf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:34.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.840+0000 7fba4e9e8640 1 --2- 172.21.15.79:0/3113669713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559548d9c050 0x559548dbf920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:34.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.840+0000 7fba4e9e8640 1 -- 172.21.15.79:0/3113669713 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559548d99fe0 con 0x559548da7fe0 2024-08-20T01:42:34.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.840+0000 7fba4e9e8640 1 --2- 172.21.15.79:0/3113669713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559548da7fe0 0x559548dbfe60 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fba40013920 tx=0x7fba40015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3431de009b2f768 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:34.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.841+0000 7fba33fff640 1 -- 172.21.15.79:0/3113669713 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4001fbd0 con 0x559548da7fe0 2024-08-20T01:42:34.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.841+0000 7fba33fff640 1 -- 172.21.15.79:0/3113669713 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba40017070 con 0x559548da7fe0 2024-08-20T01:42:34.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.841+0000 7fba33fff640 1 -- 172.21.15.79:0/3113669713 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba40027640 con 0x559548da7fe0 2024-08-20T01:42:34.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.842+0000 7fba52844740 1 -- 172.21.15.79:0/3113669713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559548da7fe0 msgr2=0x559548dbfe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:34.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.842+0000 7fba52844740 1 --2- 172.21.15.79:0/3113669713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559548da7fe0 0x559548dbfe60 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fba40013920 tx=0x7fba40015000 comp rx=0 tx=0).stop 2024-08-20T01:42:34.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.842+0000 7fba52844740 1 -- 172.21.15.79:0/3113669713 shutdown_connections 2024-08-20T01:42:34.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.842+0000 7fba52844740 1 --2- 172.21.15.79:0/3113669713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559548da7fe0 0x559548dbfe60 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:34.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.842+0000 7fba52844740 1 --2- 172.21.15.79:0/3113669713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559548d9c050 0x559548dbf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:34.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.842+0000 7fba52844740 1 --2- 172.21.15.79:0/3113669713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559548d9b730 0x559548d9a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:34.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.842+0000 7fba52844740 1 -- 172.21.15.79:0/3113669713 >> 172.21.15.79:0/3113669713 conn(0x559548d99560 msgr2=0x559548d9a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:34.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.842+0000 7fba52844740 1 -- 172.21.15.79:0/3113669713 shutdown_connections 2024-08-20T01:42:34.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.842+0000 7fba52844740 1 -- 172.21.15.79:0/3113669713 wait complete. 2024-08-20T01:42:34.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.842+0000 7fba52844740 1 -- start start 2024-08-20T01:42:34.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.842+0000 7fba52844740 1 Processor -- start 2024-08-20T01:42:34.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.842+0000 7fba52844740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559548d9b730 0x559548dad490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:34.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.842+0000 7fba52844740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559548d9c050 0x559548dada30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:34.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.842+0000 7fba52844740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559548da7fe0 0x559548e1a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:34.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.842+0000 7fba52844740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fba481b1640 con 0x559548d9b730 2024-08-20T01:42:34.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.842+0000 7fba52844740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fba481b0f70 con 0x559548da7fe0 2024-08-20T01:42:34.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.842+0000 7fba52844740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fba481ae1b0 con 0x559548d9c050 2024-08-20T01:42:34.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.842+0000 7fba52844740 10 client.0 _ll_register_callbacks cb 0x7fba3800ae80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:42:34.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.842+0000 7fba4e1e7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559548d9b730 0x559548dad490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:34.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.843+0000 7fba4e1e7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559548d9b730 0x559548dad490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51754/0 (socket says 172.21.15.79:51754) 2024-08-20T01:42:34.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.843+0000 7fba4e1e7640 1 -- 172.21.15.79:0/930860457 learned_addr learned my addr 172.21.15.79:0/930860457 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:34.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.843+0000 7fba4d9e6640 1 --2- 172.21.15.79:0/930860457 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559548d9c050 0x559548dada30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:34.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.843+0000 7fba4e1e7640 1 -- 172.21.15.79:0/930860457 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559548d9c050 msgr2=0x559548dada30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:34.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.843+0000 7fba4e9e8640 1 --2- 172.21.15.79:0/930860457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559548da7fe0 0x559548e1a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:34.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.843+0000 7fba4e1e7640 1 --2- 172.21.15.79:0/930860457 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559548d9c050 0x559548dada30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:34.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.843+0000 7fba4e1e7640 1 -- 172.21.15.79:0/930860457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559548da7fe0 msgr2=0x559548e1a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:34.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.843+0000 7fba4e1e7640 1 --2- 172.21.15.79:0/930860457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559548da7fe0 0x559548e1a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:34.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.843+0000 7fba4e1e7640 1 -- 172.21.15.79:0/930860457 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559548e1b070 con 0x559548d9b730 2024-08-20T01:42:34.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.843+0000 7fba4e9e8640 1 --2- 172.21.15.79:0/930860457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559548da7fe0 0x559548e1a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:42:34.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.843+0000 7fba4e1e7640 1 --2- 172.21.15.79:0/930860457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559548d9b730 0x559548dad490 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fba44101f20 tx=0x7fba440caed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=965f3d4c33e84367 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:34.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.843+0000 7fba31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:42:34.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.843+0000 7fba31ffb640 1 -- 172.21.15.79:0/930860457 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba44049040 con 0x559548d9b730 2024-08-20T01:42:34.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.843+0000 7fba31ffb640 1 -- 172.21.15.79:0/930860457 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fba440c6ab0 con 0x559548d9b730 2024-08-20T01:42:34.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.843+0000 7fba52844740 1 -- 172.21.15.79:0/930860457 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba40017070 con 0x559548d9b730 2024-08-20T01:42:34.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.843+0000 7fba31ffb640 1 -- 172.21.15.79:0/930860457 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fba4409d420 con 0x559548d9b730 2024-08-20T01:42:34.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.843+0000 7fba52844740 10 client.17121 fetch_fsmap learned FSMap version 38 2024-08-20T01:42:34.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.843+0000 7fba52844740 1 -- 172.21.15.79:0/930860457 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x559548e224d0 con 0x559548d9b730 2024-08-20T01:42:34.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.844+0000 7fba31ffb640 1 -- 172.21.15.79:0/930860457 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba40017070 con 0x559548d9b730 2024-08-20T01:42:34.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.844+0000 7fba31ffb640 1 -- 172.21.15.79:0/930860457 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7fba440a0100 con 0x559548d9b730 2024-08-20T01:42:34.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.844+0000 7fba52844740 10 client.17121 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:42:34.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.844+0000 7fba52844740 10 client.17121 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:42:34.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.844+0000 7fba52844740 20 client.17121 populate_metadata read hostname 'smithi079' 2024-08-20T01:42:34.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.844+0000 7fba52844740 1 --2- 172.21.15.79:0/930860457 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x559548e22b40 0x559548e24f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:34.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.844+0000 7fba52844740 4 client.17121 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:42:34.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.844+0000 7fba52844740 1 -- 172.21.15.79:0/930860457 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559548d10320 con 0x559548e22b40 2024-08-20T01:42:34.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.844+0000 7fba4d9e6640 1 --2- 172.21.15.79:0/930860457 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x559548e22b40 0x559548e24f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:34.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.845+0000 7fba31ffb640 10 client.17121 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:42:34.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.845+0000 7fba4d9e6640 1 --2- 172.21.15.79:0/930860457 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x559548e22b40 0x559548e24f60 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f62a16dfb1e30b64 server_cookie=b0ef46ca9666d8b7 in_seq=0 out_seq=0 2024-08-20T01:42:34.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.845+0000 7fba31ffb640 1 -- 172.21.15.79:0/930860457 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559548d10320 con 0x559548e22b40 2024-08-20T01:42:34.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.845+0000 7fba31ffb640 10 client.17121 handle_command_reply: tid=0 2024-08-20T01:42:34.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.845+0000 7fba52844740 1 client.17121 shutdown 2024-08-20T01:42:34.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.845+0000 7fba52844740 1 -- 172.21.15.79:0/930860457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559548d9b730 msgr2=0x559548dad490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:34.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.845+0000 7fba52844740 1 --2- 172.21.15.79:0/930860457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559548d9b730 0x559548dad490 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fba44101f20 tx=0x7fba440caed0 comp rx=0 tx=0).stop 2024-08-20T01:42:34.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.845+0000 7fba52844740 1 -- 172.21.15.79:0/930860457 shutdown_connections 2024-08-20T01:42:34.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.845+0000 7fba52844740 1 --2- 172.21.15.79:0/930860457 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x559548e22b40 0x559548e24f60 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:34.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.845+0000 7fba52844740 1 --2- 172.21.15.79:0/930860457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559548da7fe0 0x559548e1a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:34.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.845+0000 7fba52844740 1 --2- 172.21.15.79:0/930860457 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559548d9c050 0x559548dada30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:34.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.845+0000 7fba52844740 1 --2- 172.21.15.79:0/930860457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559548d9b730 0x559548dad490 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:34.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.845+0000 7fba52844740 1 -- 172.21.15.79:0/930860457 >> 172.21.15.79:0/930860457 conn(0x559548d99560 msgr2=0x559548d9aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:34.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.845+0000 7fba31ffb640 0 client.17121 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:42:34.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.845+0000 7fba52844740 1 -- 172.21.15.79:0/930860457 shutdown_connections 2024-08-20T01:42:34.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.845+0000 7fba52844740 1 -- 172.21.15.79:0/930860457 wait complete. 2024-08-20T01:42:34.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.845+0000 7fba52844740 20 client.17121 trim_cache size 0 max 16384 2024-08-20T01:42:34.854 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:42:34.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.846+0000 7fba5044b640 1 -- 172.21.15.79:0/456177510 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fba340b3bd0 msgr2=0x7fba340b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:34.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.846+0000 7fba5044b640 1 --2- 172.21.15.79:0/456177510 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fba340b3bd0 0x7fba340b6090 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fba480ff9c0 tx=0x7fba40004a40 comp rx=0 tx=0).stop 2024-08-20T01:42:34.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.846+0000 7fba5044b640 1 -- 172.21.15.79:0/456177510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba48101990 msgr2=0x7fba480fd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:34.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.846+0000 7fba5044b640 1 --2- 172.21.15.79:0/456177510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba48101990 0x7fba480fd900 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fba44009230 tx=0x7fba44004270 comp rx=0 tx=0).stop 2024-08-20T01:42:34.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.846+0000 7fba5044b640 1 -- 172.21.15.79:0/456177510 shutdown_connections 2024-08-20T01:42:34.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.846+0000 7fba5044b640 1 --2- 172.21.15.79:0/456177510 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fba340b3bd0 0x7fba340b6090 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:34.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.846+0000 7fba5044b640 1 --2- 172.21.15.79:0/456177510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba48107d20 0x7fba480fe380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:34.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.846+0000 7fba5044b640 1 --2- 172.21.15.79:0/456177510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba481073a0 0x7fba480fde40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:34.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.846+0000 7fba5044b640 1 --2- 172.21.15.79:0/456177510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba48101990 0x7fba480fd900 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:34.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.846+0000 7fba5044b640 1 -- 172.21.15.79:0/456177510 >> 172.21.15.79:0/456177510 conn(0x7fba480fd400 msgr2=0x7fba4806aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:34.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.846+0000 7fba5044b640 1 -- 172.21.15.79:0/456177510 shutdown_connections 2024-08-20T01:42:34.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:34.846+0000 7fba5044b640 1 -- 172.21.15.79:0/456177510 wait complete. 2024-08-20T01:42:35.719 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T01:42:35.999 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:42:36.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:36 smithi079 ceph-mon[18656]: pgmap v505: 97 pgs: 97 active+clean; 7.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 25 op/s 2024-08-20T01:42:36.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.583+0000 7fa797754640 1 -- 172.21.15.79:0/2967154269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa790101990 msgr2=0x7fa790101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:36.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.583+0000 7fa797754640 1 --2- 172.21.15.79:0/2967154269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa790101990 0x7fa790101d70 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fa78c009900 tx=0x7fa78c02a410 comp rx=0 tx=0).stop 2024-08-20T01:42:36.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.583+0000 7fa797754640 1 -- 172.21.15.79:0/2967154269 shutdown_connections 2024-08-20T01:42:36.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.583+0000 7fa797754640 1 --2- 172.21.15.79:0/2967154269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa790107d20 0x7fa79010e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:36.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.583+0000 7fa797754640 1 --2- 172.21.15.79:0/2967154269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7901073a0 0x7fa7901077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:36.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.583+0000 7fa797754640 1 --2- 172.21.15.79:0/2967154269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa790101990 0x7fa790101d70 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:36.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.583+0000 7fa797754640 1 -- 172.21.15.79:0/2967154269 >> 172.21.15.79:0/2967154269 conn(0x7fa7900fd400 msgr2=0x7fa7900ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:36.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.584+0000 7fa797754640 1 -- 172.21.15.79:0/2967154269 shutdown_connections 2024-08-20T01:42:36.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.584+0000 7fa797754640 1 -- 172.21.15.79:0/2967154269 wait complete. 2024-08-20T01:42:36.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.584+0000 7fa797754640 1 Processor -- start 2024-08-20T01:42:36.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.584+0000 7fa797754640 1 -- start start 2024-08-20T01:42:36.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.584+0000 7fa797754640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa790101990 0x7fa790198ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:36.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.585+0000 7fa797754640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7901073a0 0x7fa790199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:36.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.585+0000 7fa797754640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa790107d20 0x7fa79019e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:36.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.585+0000 7fa797754640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa790111890 con 0x7fa790101990 2024-08-20T01:42:36.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.585+0000 7fa797754640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa790111710 con 0x7fa790107d20 2024-08-20T01:42:36.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.585+0000 7fa797754640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa790111a10 con 0x7fa7901073a0 2024-08-20T01:42:36.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.585+0000 7fa7954f0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa790101990 0x7fa790198ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:36.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.585+0000 7fa7954f0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa790101990 0x7fa790198ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51774/0 (socket says 172.21.15.79:51774) 2024-08-20T01:42:36.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.585+0000 7fa7954f0640 1 -- 172.21.15.79:0/4024513367 learned_addr learned my addr 172.21.15.79:0/4024513367 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:36.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.585+0000 7fa795cf1640 1 --2- 172.21.15.79:0/4024513367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa790107d20 0x7fa79019e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:36.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.585+0000 7fa794cef640 1 --2- 172.21.15.79:0/4024513367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7901073a0 0x7fa790199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:36.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.585+0000 7fa7954f0640 1 -- 172.21.15.79:0/4024513367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7901073a0 msgr2=0x7fa790199410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:36.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.585+0000 7fa7954f0640 1 --2- 172.21.15.79:0/4024513367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7901073a0 0x7fa790199410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:36.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.585+0000 7fa7954f0640 1 -- 172.21.15.79:0/4024513367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa790107d20 msgr2=0x7fa79019e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:36.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.585+0000 7fa7954f0640 1 --2- 172.21.15.79:0/4024513367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa790107d20 0x7fa79019e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:36.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.585+0000 7fa7954f0640 1 -- 172.21.15.79:0/4024513367 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa79019ef80 con 0x7fa790101990 2024-08-20T01:42:36.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.585+0000 7fa794cef640 1 --2- 172.21.15.79:0/4024513367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7901073a0 0x7fa790199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:42:36.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.585+0000 7fa7954f0640 1 --2- 172.21.15.79:0/4024513367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa790101990 0x7fa790198ed0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fa78c009230 tx=0x7fa78c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:36.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.586+0000 7fa7867fc640 1 -- 172.21.15.79:0/4024513367 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa78c03f030 con 0x7fa790101990 2024-08-20T01:42:36.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.586+0000 7fa797754640 1 -- 172.21.15.79:0/4024513367 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa79019f210 con 0x7fa790101990 2024-08-20T01:42:36.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.586+0000 7fa7867fc640 1 -- 172.21.15.79:0/4024513367 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa78c003a80 con 0x7fa790101990 2024-08-20T01:42:36.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.586+0000 7fa797754640 1 -- 172.21.15.79:0/4024513367 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7901a5930 con 0x7fa790101990 2024-08-20T01:42:36.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.586+0000 7fa7867fc640 1 -- 172.21.15.79:0/4024513367 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa78c049060 con 0x7fa790101990 2024-08-20T01:42:36.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.588+0000 7fa7867fc640 1 -- 172.21.15.79:0/4024513367 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa78c042030 con 0x7fa790101990 2024-08-20T01:42:36.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.589+0000 7fa799b4d740 1 Processor -- start 2024-08-20T01:42:36.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.589+0000 7fa799b4d740 1 -- start start 2024-08-20T01:42:36.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.589+0000 7fa799b4d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593b98e9880 0x5593b98e9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:36.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.589+0000 7fa799b4d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593b98ea1a0 0x5593b98fa000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:36.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.589+0000 7fa799b4d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593b98fa540 0x5593b98fc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:36.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.589+0000 7fa799b4d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5593b9860930 con 0x5593b98fa540 2024-08-20T01:42:36.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.589+0000 7fa799b4d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5593b984fe30 con 0x5593b98ea1a0 2024-08-20T01:42:36.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.589+0000 7fa799b4d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5593b9853e70 con 0x5593b98e9880 2024-08-20T01:42:36.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.589+0000 7fa794cef640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593b98fa540 0x5593b98fc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:36.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.589+0000 7fa7867fc640 1 --2- 172.21.15.79:0/4024513367 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa77c0b3bd0 0x7fa77c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:36.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.590+0000 7fa794cef640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593b98fa540 0x5593b98fc930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51780/0 (socket says 172.21.15.79:51780) 2024-08-20T01:42:36.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.590+0000 7fa794cef640 1 -- 172.21.15.79:0/3274027270 learned_addr learned my addr 172.21.15.79:0/3274027270 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:36.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.590+0000 7fa7954f0640 1 --2- 172.21.15.79:0/3274027270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593b98ea1a0 0x5593b98fa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:36.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.590+0000 7fa795cf1640 1 --2- 172.21.15.79:0/3274027270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593b98e9880 0x5593b98e9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:36.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.590+0000 7fa795cf1640 1 --2- 172.21.15.79:0/4024513367 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa77c0b3bd0 0x7fa77c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:36.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.590+0000 7fa7867fc640 1 -- 172.21.15.79:0/4024513367 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fa78c104110 con 0x7fa790101990 2024-08-20T01:42:36.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.590+0000 7fa794cef640 1 -- 172.21.15.79:0/3274027270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593b98e9880 msgr2=0x5593b98e9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:36.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.590+0000 7fa794cef640 1 --2- 172.21.15.79:0/3274027270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593b98e9880 0x5593b98e9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:36.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.590+0000 7fa794cef640 1 -- 172.21.15.79:0/3274027270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593b98ea1a0 msgr2=0x5593b98fa000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:36.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.590+0000 7fa794cef640 1 --2- 172.21.15.79:0/3274027270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593b98ea1a0 0x5593b98fa000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:36.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.590+0000 7fa794cef640 1 -- 172.21.15.79:0/3274027270 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593b95af650 con 0x5593b98fa540 2024-08-20T01:42:36.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.590+0000 7fa7954f0640 1 --2- 172.21.15.79:0/3274027270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593b98ea1a0 0x5593b98fa000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:42:36.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.590+0000 7fa794cef640 1 --2- 172.21.15.79:0/3274027270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593b98fa540 0x5593b98fc930 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fa78000bd60 tx=0x7fa78000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bc4bce6b3892de9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:36.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.590+0000 7fa795cf1640 1 --2- 172.21.15.79:0/4024513367 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa77c0b3bd0 0x7fa77c0b6090 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa788007fd0 tx=0x7fa788007520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:36.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.590+0000 7fa77b7fe640 1 -- 172.21.15.79:0/3274027270 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa780015070 con 0x5593b98fa540 2024-08-20T01:42:36.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.590+0000 7fa77b7fe640 1 -- 172.21.15.79:0/3274027270 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa78001a8f0 con 0x5593b98fa540 2024-08-20T01:42:36.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.591+0000 7fa77b7fe640 1 -- 172.21.15.79:0/3274027270 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7800117a0 con 0x5593b98fa540 2024-08-20T01:42:36.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.591+0000 7fa799b4d740 1 -- 172.21.15.79:0/3274027270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593b98fa540 msgr2=0x5593b98fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:36.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.591+0000 7fa799b4d740 1 --2- 172.21.15.79:0/3274027270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593b98fa540 0x5593b98fc930 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fa78000bd60 tx=0x7fa78000f730 comp rx=0 tx=0).stop 2024-08-20T01:42:36.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.591+0000 7fa799b4d740 1 -- 172.21.15.79:0/3274027270 shutdown_connections 2024-08-20T01:42:36.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.591+0000 7fa799b4d740 1 --2- 172.21.15.79:0/3274027270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593b98fa540 0x5593b98fc930 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:36.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.591+0000 7fa799b4d740 1 --2- 172.21.15.79:0/3274027270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593b98ea1a0 0x5593b98fa000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:36.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.591+0000 7fa799b4d740 1 --2- 172.21.15.79:0/3274027270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593b98e9880 0x5593b98e9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:36.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.591+0000 7fa799b4d740 1 -- 172.21.15.79:0/3274027270 >> 172.21.15.79:0/3274027270 conn(0x5593b98e76b0 msgr2=0x5593b98e8850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:36.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.591+0000 7fa799b4d740 1 -- 172.21.15.79:0/3274027270 shutdown_connections 2024-08-20T01:42:36.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.591+0000 7fa799b4d740 1 -- 172.21.15.79:0/3274027270 wait complete. 2024-08-20T01:42:36.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.592+0000 7fa799b4d740 1 -- start start 2024-08-20T01:42:36.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.592+0000 7fa799b4d740 1 Processor -- start 2024-08-20T01:42:36.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.592+0000 7fa799b4d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593b98e9880 0x5593b98f7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:36.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.592+0000 7fa799b4d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593b98ea1a0 0x5593b98f79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:36.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.592+0000 7fa799b4d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593b98fa540 0x5593b98f7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:36.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.592+0000 7fa799b4d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5593b96b2700 con 0x5593b98ea1a0 2024-08-20T01:42:36.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.592+0000 7fa799b4d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5593b97d6810 con 0x5593b98fa540 2024-08-20T01:42:36.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.592+0000 7fa799b4d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5593b98fd1f0 con 0x5593b98e9880 2024-08-20T01:42:36.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.592+0000 7fa799b4d740 10 client.0 _ll_register_callbacks cb 0x5593b9849700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:42:36.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.592+0000 7fa794cef640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593b98ea1a0 0x5593b98f79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:36.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.592+0000 7fa794cef640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593b98ea1a0 0x5593b98f79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51794/0 (socket says 172.21.15.79:51794) 2024-08-20T01:42:36.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.593+0000 7fa794cef640 1 -- 172.21.15.79:0/3629339958 learned_addr learned my addr 172.21.15.79:0/3629339958 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:36.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.593+0000 7fa7954f0640 1 --2- 172.21.15.79:0/3629339958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593b98e9880 0x5593b98f7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:36.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.593+0000 7fa795cf1640 1 --2- 172.21.15.79:0/3629339958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593b98fa540 0x5593b98f7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:36.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.593+0000 7fa794cef640 1 -- 172.21.15.79:0/3629339958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593b98e9880 msgr2=0x5593b98f7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:36.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.593+0000 7fa794cef640 1 --2- 172.21.15.79:0/3629339958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593b98e9880 0x5593b98f7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:36.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.593+0000 7fa794cef640 1 -- 172.21.15.79:0/3629339958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593b98fa540 msgr2=0x5593b98f7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:36.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.593+0000 7fa794cef640 1 --2- 172.21.15.79:0/3629339958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593b98fa540 0x5593b98f7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:36.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.593+0000 7fa794cef640 1 -- 172.21.15.79:0/3629339958 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593b9906580 con 0x5593b98ea1a0 2024-08-20T01:42:36.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.593+0000 7fa794cef640 1 --2- 172.21.15.79:0/3629339958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593b98ea1a0 0x5593b98f79d0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fa780006010 tx=0x7fa780005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0123dd7daee7c4c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:36.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.593+0000 7fa778ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:42:36.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.593+0000 7fa778ff9640 1 -- 172.21.15.79:0/3629339958 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa780028060 con 0x5593b98ea1a0 2024-08-20T01:42:36.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.593+0000 7fa778ff9640 1 -- 172.21.15.79:0/3629339958 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fa78000fe40 con 0x5593b98ea1a0 2024-08-20T01:42:36.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.593+0000 7fa799b4d740 1 -- 172.21.15.79:0/3629339958 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5593b97ff150 con 0x5593b98ea1a0 2024-08-20T01:42:36.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.593+0000 7fa778ff9640 1 -- 172.21.15.79:0/3629339958 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fa780015070 con 0x5593b98ea1a0 2024-08-20T01:42:36.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.594+0000 7fa799b4d740 10 client.17133 fetch_fsmap learned FSMap version 38 2024-08-20T01:42:36.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.594+0000 7fa799b4d740 1 -- 172.21.15.79:0/3629339958 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5593b9908f30 con 0x5593b98ea1a0 2024-08-20T01:42:36.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.594+0000 7fa778ff9640 1 -- 172.21.15.79:0/3629339958 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5593b97ff150 con 0x5593b98ea1a0 2024-08-20T01:42:36.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.594+0000 7fa778ff9640 1 -- 172.21.15.79:0/3629339958 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7fa7800118d0 con 0x5593b98ea1a0 2024-08-20T01:42:36.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.594+0000 7fa799b4d740 10 client.17133 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:42:36.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.594+0000 7fa799b4d740 10 client.17133 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:42:36.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.594+0000 7fa799b4d740 20 client.17133 populate_metadata read hostname 'smithi079' 2024-08-20T01:42:36.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.594+0000 7fa799b4d740 1 --2- 172.21.15.79:0/3629339958 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5593b990a390 0x5593b990c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:36.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.594+0000 7fa799b4d740 4 client.17133 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:42:36.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.594+0000 7fa799b4d740 1 -- 172.21.15.79:0/3629339958 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5593b9862880 con 0x5593b990a390 2024-08-20T01:42:36.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.594+0000 7fa7954f0640 1 --2- 172.21.15.79:0/3629339958 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5593b990a390 0x5593b990c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:36.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.595+0000 7fa778ff9640 10 client.17133 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:42:36.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.595+0000 7fa7954f0640 1 --2- 172.21.15.79:0/3629339958 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5593b990a390 0x5593b990c780 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adfbd690299a7547 server_cookie=8680e821580e520c in_seq=0 out_seq=0 2024-08-20T01:42:36.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.595+0000 7fa778ff9640 1 -- 172.21.15.79:0/3629339958 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5593b9862880 con 0x5593b990a390 2024-08-20T01:42:36.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.595+0000 7fa778ff9640 10 client.17133 handle_command_reply: tid=0 2024-08-20T01:42:36.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.595+0000 7fa799b4d740 1 client.17133 shutdown 2024-08-20T01:42:36.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.596+0000 7fa799b4d740 1 -- 172.21.15.79:0/3629339958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593b98ea1a0 msgr2=0x5593b98f79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:36.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.596+0000 7fa799b4d740 1 --2- 172.21.15.79:0/3629339958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593b98ea1a0 0x5593b98f79d0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fa780006010 tx=0x7fa780005270 comp rx=0 tx=0).stop 2024-08-20T01:42:36.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.596+0000 7fa799b4d740 1 -- 172.21.15.79:0/3629339958 shutdown_connections 2024-08-20T01:42:36.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.596+0000 7fa799b4d740 1 --2- 172.21.15.79:0/3629339958 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5593b990a390 0x5593b990c780 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:36.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.596+0000 7fa799b4d740 1 --2- 172.21.15.79:0/3629339958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593b98fa540 0x5593b98f7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:36.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.596+0000 7fa778ff9640 0 client.17133 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:42:36.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.596+0000 7fa799b4d740 1 --2- 172.21.15.79:0/3629339958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593b98ea1a0 0x5593b98f79d0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:36.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.596+0000 7fa799b4d740 1 --2- 172.21.15.79:0/3629339958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593b98e9880 0x5593b98f7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:36.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.596+0000 7fa799b4d740 1 -- 172.21.15.79:0/3629339958 >> 172.21.15.79:0/3629339958 conn(0x5593b98e76b0 msgr2=0x5593b98ed250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:36.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.596+0000 7fa799b4d740 1 -- 172.21.15.79:0/3629339958 shutdown_connections 2024-08-20T01:42:36.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.596+0000 7fa799b4d740 1 -- 172.21.15.79:0/3629339958 wait complete. 2024-08-20T01:42:36.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.596+0000 7fa799b4d740 20 client.17133 trim_cache size 0 max 16384 2024-08-20T01:42:36.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.611+0000 7fa799b4d740 1 Processor -- start 2024-08-20T01:42:36.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.611+0000 7fa799b4d740 1 -- start start 2024-08-20T01:42:36.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.612+0000 7fa799b4d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593b98e9880 0x5593b98e8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:36.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.612+0000 7fa799b4d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593b98ea1a0 0x5593b98f4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:36.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.612+0000 7fa799b4d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593b98fa540 0x5593b98f7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:36.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.612+0000 7fa799b4d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa7901abd70 con 0x5593b98e9880 2024-08-20T01:42:36.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.612+0000 7fa799b4d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa7901ad8b0 con 0x5593b98fa540 2024-08-20T01:42:36.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.612+0000 7fa799b4d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa7901ac440 con 0x5593b98ea1a0 2024-08-20T01:42:36.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.612+0000 7fa7954f0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593b98e9880 0x5593b98e8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:36.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.612+0000 7fa7954f0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593b98e9880 0x5593b98e8ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51796/0 (socket says 172.21.15.79:51796) 2024-08-20T01:42:36.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.612+0000 7fa7954f0640 1 -- 172.21.15.79:0/3739679244 learned_addr learned my addr 172.21.15.79:0/3739679244 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:36.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.612+0000 7fa7954f0640 1 -- 172.21.15.79:0/3739679244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593b98ea1a0 msgr2=0x5593b98f4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:36.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.612+0000 7fa795cf1640 1 --2- 172.21.15.79:0/3739679244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593b98fa540 0x5593b98f7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:36.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.612+0000 7fa7954f0640 1 --2- 172.21.15.79:0/3739679244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593b98ea1a0 0x5593b98f4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:36.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.612+0000 7fa7954f0640 1 -- 172.21.15.79:0/3739679244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593b98fa540 msgr2=0x5593b98f7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:36.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.612+0000 7fa7954f0640 1 --2- 172.21.15.79:0/3739679244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593b98fa540 0x5593b98f7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:36.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.612+0000 7fa7954f0640 1 -- 172.21.15.79:0/3739679244 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593b98ea640 con 0x5593b98e9880 2024-08-20T01:42:36.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.612+0000 7fa7954f0640 1 --2- 172.21.15.79:0/3739679244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593b98e9880 0x5593b98e8ef0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fa78c0caf50 tx=0x7fa78c04a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf0a13b9e104b2ea server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:36.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.613+0000 7fa77affd640 1 -- 172.21.15.79:0/3739679244 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa78c035040 con 0x5593b98e9880 2024-08-20T01:42:36.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.613+0000 7fa77affd640 1 -- 172.21.15.79:0/3739679244 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa78c02f300 con 0x5593b98e9880 2024-08-20T01:42:36.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.613+0000 7fa77affd640 1 -- 172.21.15.79:0/3739679244 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa78c0c72a0 con 0x5593b98e9880 2024-08-20T01:42:36.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.613+0000 7fa799b4d740 1 -- 172.21.15.79:0/3739679244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593b98e9880 msgr2=0x5593b98e8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:36.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.613+0000 7fa799b4d740 1 --2- 172.21.15.79:0/3739679244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593b98e9880 0x5593b98e8ef0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fa78c0caf50 tx=0x7fa78c04a890 comp rx=0 tx=0).stop 2024-08-20T01:42:36.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.613+0000 7fa799b4d740 1 -- 172.21.15.79:0/3739679244 shutdown_connections 2024-08-20T01:42:36.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.613+0000 7fa799b4d740 1 --2- 172.21.15.79:0/3739679244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593b98fa540 0x5593b98f7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:36.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.613+0000 7fa799b4d740 1 --2- 172.21.15.79:0/3739679244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593b98ea1a0 0x5593b98f4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:36.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.613+0000 7fa799b4d740 1 --2- 172.21.15.79:0/3739679244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593b98e9880 0x5593b98e8ef0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:36.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.613+0000 7fa799b4d740 1 -- 172.21.15.79:0/3739679244 >> 172.21.15.79:0/3739679244 conn(0x5593b98e76b0 msgr2=0x5593b98e87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:36.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.614+0000 7fa799b4d740 1 -- 172.21.15.79:0/3739679244 shutdown_connections 2024-08-20T01:42:36.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.614+0000 7fa799b4d740 1 -- 172.21.15.79:0/3739679244 wait complete. 2024-08-20T01:42:36.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.614+0000 7fa799b4d740 1 -- start start 2024-08-20T01:42:36.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.614+0000 7fa799b4d740 1 Processor -- start 2024-08-20T01:42:36.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.614+0000 7fa799b4d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593b98e9880 0x5593b9902800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:36.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.614+0000 7fa799b4d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593b98ea1a0 0x5593b9902d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:36.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.614+0000 7fa799b4d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593b98fa540 0x5593b9911670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:36.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.614+0000 7fa799b4d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa7901ad1e0 con 0x5593b98e9880 2024-08-20T01:42:36.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.614+0000 7fa799b4d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa7901acb10 con 0x5593b98ea1a0 2024-08-20T01:42:36.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.614+0000 7fa799b4d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa7901a9d50 con 0x5593b98fa540 2024-08-20T01:42:36.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.614+0000 7fa799b4d740 10 client.0 _ll_register_callbacks cb 0x7fa788007e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:42:36.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.615+0000 7fa7954f0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593b98e9880 0x5593b9902800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:36.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.615+0000 7fa7954f0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593b98e9880 0x5593b9902800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51798/0 (socket says 172.21.15.79:51798) 2024-08-20T01:42:36.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.615+0000 7fa7954f0640 1 -- 172.21.15.79:0/99379091 learned_addr learned my addr 172.21.15.79:0/99379091 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:36.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.615+0000 7fa794cef640 1 --2- 172.21.15.79:0/99379091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593b98ea1a0 0x5593b9902d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:36.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.615+0000 7fa7954f0640 1 -- 172.21.15.79:0/99379091 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593b98fa540 msgr2=0x5593b9911670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:36.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.615+0000 7fa7954f0640 1 --2- 172.21.15.79:0/99379091 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593b98fa540 0x5593b9911670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:36.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.615+0000 7fa7954f0640 1 -- 172.21.15.79:0/99379091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593b98ea1a0 msgr2=0x5593b9902d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:36.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.615+0000 7fa7954f0640 1 --2- 172.21.15.79:0/99379091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593b98ea1a0 0x5593b9902d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:36.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.615+0000 7fa7954f0640 1 -- 172.21.15.79:0/99379091 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593b9911ea0 con 0x5593b98e9880 2024-08-20T01:42:36.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.615+0000 7fa794cef640 1 --2- 172.21.15.79:0/99379091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593b98ea1a0 0x5593b9902d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:42:36.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.615+0000 7fa7954f0640 1 --2- 172.21.15.79:0/99379091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593b98e9880 0x5593b9902800 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fa78c005c40 tx=0x7fa78c0d41d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcf7a7bcda6f02a8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:36.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.615+0000 7fa778ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:42:36.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.615+0000 7fa778ff9640 1 -- 172.21.15.79:0/99379091 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa78c0e9070 con 0x5593b98e9880 2024-08-20T01:42:36.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.615+0000 7fa778ff9640 1 -- 172.21.15.79:0/99379091 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fa78c0c72a0 con 0x5593b98e9880 2024-08-20T01:42:36.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.615+0000 7fa799b4d740 1 -- 172.21.15.79:0/99379091 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa78c02f300 con 0x5593b98e9880 2024-08-20T01:42:36.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.615+0000 7fa778ff9640 1 -- 172.21.15.79:0/99379091 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fa78c035070 con 0x5593b98e9880 2024-08-20T01:42:36.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.615+0000 7fa799b4d740 10 client.17139 fetch_fsmap learned FSMap version 38 2024-08-20T01:42:36.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.615+0000 7fa799b4d740 1 -- 172.21.15.79:0/99379091 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5593b99021c0 con 0x5593b98e9880 2024-08-20T01:42:36.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.616+0000 7fa778ff9640 1 -- 172.21.15.79:0/99379091 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa78c02f300 con 0x5593b98e9880 2024-08-20T01:42:36.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.616+0000 7fa778ff9640 1 -- 172.21.15.79:0/99379091 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7fa78c0ec020 con 0x5593b98e9880 2024-08-20T01:42:36.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.616+0000 7fa799b4d740 10 client.17139 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:42:36.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.616+0000 7fa799b4d740 10 client.17139 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:42:36.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.616+0000 7fa799b4d740 20 client.17139 populate_metadata read hostname 'smithi079' 2024-08-20T01:42:36.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.616+0000 7fa799b4d740 1 --2- 172.21.15.79:0/99379091 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5593b9975190 0x5593b99775b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:36.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.616+0000 7fa799b4d740 4 client.17139 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:42:36.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.616+0000 7fa799b4d740 1 -- 172.21.15.79:0/99379091 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5593b985e320 con 0x5593b9975190 2024-08-20T01:42:36.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.616+0000 7fa794cef640 1 --2- 172.21.15.79:0/99379091 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5593b9975190 0x5593b99775b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:36.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.616+0000 7fa778ff9640 10 client.17139 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:42:36.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.617+0000 7fa794cef640 1 --2- 172.21.15.79:0/99379091 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5593b9975190 0x5593b99775b0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac761c124a8517f server_cookie=1c0d3389dd30e251 in_seq=0 out_seq=0 2024-08-20T01:42:36.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.617+0000 7fa778ff9640 1 -- 172.21.15.79:0/99379091 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5593b985e320 con 0x5593b9975190 2024-08-20T01:42:36.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.617+0000 7fa778ff9640 10 client.17139 handle_command_reply: tid=0 2024-08-20T01:42:36.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.617+0000 7fa799b4d740 1 client.17139 shutdown 2024-08-20T01:42:36.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.617+0000 7fa799b4d740 1 -- 172.21.15.79:0/99379091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593b98e9880 msgr2=0x5593b9902800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:36.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.617+0000 7fa799b4d740 1 --2- 172.21.15.79:0/99379091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593b98e9880 0x5593b9902800 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fa78c005c40 tx=0x7fa78c0d41d0 comp rx=0 tx=0).stop 2024-08-20T01:42:36.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.617+0000 7fa799b4d740 1 -- 172.21.15.79:0/99379091 shutdown_connections 2024-08-20T01:42:36.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.617+0000 7fa799b4d740 1 --2- 172.21.15.79:0/99379091 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5593b9975190 0x5593b99775b0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:36.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.617+0000 7fa799b4d740 1 --2- 172.21.15.79:0/99379091 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5593b98fa540 0x5593b9911670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:36.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.617+0000 7fa799b4d740 1 --2- 172.21.15.79:0/99379091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593b98ea1a0 0x5593b9902d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:36.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.617+0000 7fa799b4d740 1 --2- 172.21.15.79:0/99379091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593b98e9880 0x5593b9902800 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:36.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.617+0000 7fa799b4d740 1 -- 172.21.15.79:0/99379091 >> 172.21.15.79:0/99379091 conn(0x5593b98e76b0 msgr2=0x5593b98eea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:36.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.617+0000 7fa778ff9640 0 client.17139 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:42:36.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.617+0000 7fa799b4d740 1 -- 172.21.15.79:0/99379091 shutdown_connections 2024-08-20T01:42:36.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.618+0000 7fa799b4d740 1 -- 172.21.15.79:0/99379091 wait complete. 2024-08-20T01:42:36.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.618+0000 7fa799b4d740 20 client.17139 trim_cache size 0 max 16384 2024-08-20T01:42:36.626 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:42:36.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.618+0000 7fa797754640 1 -- 172.21.15.79:0/4024513367 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa77c0b3bd0 msgr2=0x7fa77c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:36.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.618+0000 7fa797754640 1 --2- 172.21.15.79:0/4024513367 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa77c0b3bd0 0x7fa77c0b6090 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa788007fd0 tx=0x7fa788007520 comp rx=0 tx=0).stop 2024-08-20T01:42:36.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.618+0000 7fa797754640 1 -- 172.21.15.79:0/4024513367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa790101990 msgr2=0x7fa790198ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:36.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.618+0000 7fa797754640 1 --2- 172.21.15.79:0/4024513367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa790101990 0x7fa790198ed0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fa78c009230 tx=0x7fa78c004270 comp rx=0 tx=0).stop 2024-08-20T01:42:36.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.618+0000 7fa797754640 1 -- 172.21.15.79:0/4024513367 shutdown_connections 2024-08-20T01:42:36.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.618+0000 7fa797754640 1 --2- 172.21.15.79:0/4024513367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa790107d20 0x7fa79019e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:36.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.618+0000 7fa797754640 1 --2- 172.21.15.79:0/4024513367 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa77c0b3bd0 0x7fa77c0b6090 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:36.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.618+0000 7fa797754640 1 --2- 172.21.15.79:0/4024513367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7901073a0 0x7fa790199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:36.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.618+0000 7fa797754640 1 --2- 172.21.15.79:0/4024513367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa790101990 0x7fa790198ed0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:36.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.618+0000 7fa797754640 1 -- 172.21.15.79:0/4024513367 >> 172.21.15.79:0/4024513367 conn(0x7fa7900fd400 msgr2=0x7fa79006aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:36.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.619+0000 7fa797754640 1 -- 172.21.15.79:0/4024513367 shutdown_connections 2024-08-20T01:42:36.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:36.619+0000 7fa797754640 1 -- 172.21.15.79:0/4024513367 wait complete. 2024-08-20T01:42:36.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:36 smithi175 ceph-mon[22392]: pgmap v505: 97 pgs: 97 active+clean; 7.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 25 op/s 2024-08-20T01:42:36.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:36 smithi081 ceph-mon[22209]: pgmap v505: 97 pgs: 97 active+clean; 7.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 25 op/s 2024-08-20T01:42:38.511 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T01:42:38.511 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T01:42:38.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:38 smithi175 ceph-mon[22392]: pgmap v506: 97 pgs: 97 active+clean; 7.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 23 op/s 2024-08-20T01:42:38.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:38 smithi079 ceph-mon[18656]: pgmap v506: 97 pgs: 97 active+clean; 7.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 23 op/s 2024-08-20T01:42:38.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:38 smithi081 ceph-mon[22209]: pgmap v506: 97 pgs: 97 active+clean; 7.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 23 op/s 2024-08-20T01:42:38.787 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:42:39.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.338+0000 7fb56d78c640 1 -- 172.21.15.79:0/3209242368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5681073a0 msgr2=0x7fb5681077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:39.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.338+0000 7fb56d78c640 1 --2- 172.21.15.79:0/3209242368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5681073a0 0x7fb5681077e0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fb550009900 tx=0x7fb55002a410 comp rx=0 tx=0).stop 2024-08-20T01:42:39.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.338+0000 7fb56d78c640 1 -- 172.21.15.79:0/3209242368 shutdown_connections 2024-08-20T01:42:39.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.338+0000 7fb56d78c640 1 --2- 172.21.15.79:0/3209242368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb568107d20 0x7fb56810e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:39.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.338+0000 7fb56d78c640 1 --2- 172.21.15.79:0/3209242368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5681073a0 0x7fb5681077e0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:39.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.338+0000 7fb56d78c640 1 --2- 172.21.15.79:0/3209242368 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb568101990 0x7fb568101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:39.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.338+0000 7fb56d78c640 1 -- 172.21.15.79:0/3209242368 >> 172.21.15.79:0/3209242368 conn(0x7fb5680fd400 msgr2=0x7fb5680ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:39.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.338+0000 7fb56d78c640 1 -- 172.21.15.79:0/3209242368 shutdown_connections 2024-08-20T01:42:39.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.338+0000 7fb56d78c640 1 -- 172.21.15.79:0/3209242368 wait complete. 2024-08-20T01:42:39.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.338+0000 7fb56d78c640 1 Processor -- start 2024-08-20T01:42:39.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.338+0000 7fb56d78c640 1 -- start start 2024-08-20T01:42:39.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.339+0000 7fb56d78c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb568101990 0x7fb568198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:39.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.339+0000 7fb56d78c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5681073a0 0x7fb5681993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:39.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.339+0000 7fb56d78c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb568107d20 0x7fb56819e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:39.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.339+0000 7fb56d78c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb568112980 con 0x7fb568101990 2024-08-20T01:42:39.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.339+0000 7fb56d78c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb568112800 con 0x7fb5681073a0 2024-08-20T01:42:39.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.339+0000 7fb56d78c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb568112b00 con 0x7fb568107d20 2024-08-20T01:42:39.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.339+0000 7fb566ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb568101990 0x7fb568198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:39.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.339+0000 7fb566ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb568101990 0x7fb568198e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51822/0 (socket says 172.21.15.79:51822) 2024-08-20T01:42:39.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.339+0000 7fb566ffd640 1 -- 172.21.15.79:0/2974063507 learned_addr learned my addr 172.21.15.79:0/2974063507 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:39.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.339+0000 7fb55ffff640 1 --2- 172.21.15.79:0/2974063507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5681073a0 0x7fb5681993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:39.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.339+0000 7fb566ffd640 1 -- 172.21.15.79:0/2974063507 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb568107d20 msgr2=0x7fb56819e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:39.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.339+0000 7fb566ffd640 1 --2- 172.21.15.79:0/2974063507 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb568107d20 0x7fb56819e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:39.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.339+0000 7fb566ffd640 1 -- 172.21.15.79:0/2974063507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5681073a0 msgr2=0x7fb5681993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:39.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.339+0000 7fb566ffd640 1 --2- 172.21.15.79:0/2974063507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5681073a0 0x7fb5681993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:39.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.339+0000 7fb566ffd640 1 -- 172.21.15.79:0/2974063507 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb56819ef10 con 0x7fb568101990 2024-08-20T01:42:39.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.339+0000 7fb55ffff640 1 --2- 172.21.15.79:0/2974063507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5681073a0 0x7fb5681993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:42:39.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.339+0000 7fb566ffd640 1 --2- 172.21.15.79:0/2974063507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb568101990 0x7fb568198e60 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fb55800eab0 tx=0x7fb55800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:39.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.339+0000 7fb564ff9640 1 -- 172.21.15.79:0/2974063507 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55800ce40 con 0x7fb568101990 2024-08-20T01:42:39.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.339+0000 7fb564ff9640 1 -- 172.21.15.79:0/2974063507 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb558011900 con 0x7fb568101990 2024-08-20T01:42:39.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.339+0000 7fb56d78c640 1 -- 172.21.15.79:0/2974063507 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb56819f200 con 0x7fb568101990 2024-08-20T01:42:39.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.339+0000 7fb564ff9640 1 -- 172.21.15.79:0/2974063507 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb558010990 con 0x7fb568101990 2024-08-20T01:42:39.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.340+0000 7fb56d78c640 1 -- 172.21.15.79:0/2974063507 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5681a5a90 con 0x7fb568101990 2024-08-20T01:42:39.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.342+0000 7fb564ff9640 1 -- 172.21.15.79:0/2974063507 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb558011470 con 0x7fb568101990 2024-08-20T01:42:39.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.342+0000 7fb56fb85740 1 Processor -- start 2024-08-20T01:42:39.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.343+0000 7fb56fb85740 1 -- start start 2024-08-20T01:42:39.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.343+0000 7fb56fb85740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e2ba833b0 0x560e2ba83790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:39.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.343+0000 7fb56fb85740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e2ba83cd0 0x560e2ba8f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:39.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.343+0000 7fb56fb85740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e2ba8fc60 0x560e2ba92050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:39.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.343+0000 7fb56fb85740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560e2b9f9940 con 0x560e2ba833b0 2024-08-20T01:42:39.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.343+0000 7fb56fb85740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560e2b9e8e40 con 0x560e2ba8fc60 2024-08-20T01:42:39.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.343+0000 7fb56fb85740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560e2b9ece80 con 0x560e2ba83cd0 2024-08-20T01:42:39.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.343+0000 7fb564ff9640 1 --2- 172.21.15.79:0/2974063507 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb5540b3c50 0x7fb5540b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:39.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.343+0000 7fb5677fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e2ba833b0 0x560e2ba83790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:39.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.343+0000 7fb5677fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e2ba833b0 0x560e2ba83790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51828/0 (socket says 172.21.15.79:51828) 2024-08-20T01:42:39.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.343+0000 7fb5677fe640 1 -- 172.21.15.79:0/1069756015 learned_addr learned my addr 172.21.15.79:0/1069756015 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:39.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.343+0000 7fb5677fe640 1 --2- 172.21.15.79:0/2974063507 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb5540b3c50 0x7fb5540b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:39.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.343+0000 7fb566ffd640 1 --2- 172.21.15.79:0/1069756015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e2ba83cd0 0x560e2ba8f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:39.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.343+0000 7fb55ffff640 1 --2- 172.21.15.79:0/1069756015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e2ba8fc60 0x560e2ba92050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:39.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.344+0000 7fb564ff9640 1 -- 172.21.15.79:0/2974063507 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fb5580e4220 con 0x7fb568101990 2024-08-20T01:42:39.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.344+0000 7fb5677fe640 1 -- 172.21.15.79:0/1069756015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e2ba83cd0 msgr2=0x560e2ba8f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:39.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.344+0000 7fb5677fe640 1 --2- 172.21.15.79:0/1069756015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e2ba83cd0 0x560e2ba8f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:39.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.344+0000 7fb5677fe640 1 -- 172.21.15.79:0/1069756015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e2ba8fc60 msgr2=0x560e2ba92050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:39.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.344+0000 7fb5677fe640 1 --2- 172.21.15.79:0/1069756015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e2ba8fc60 0x560e2ba92050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:39.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.344+0000 7fb5677fe640 1 -- 172.21.15.79:0/1069756015 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e2b985520 con 0x560e2ba833b0 2024-08-20T01:42:39.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.344+0000 7fb5677fe640 1 --2- 172.21.15.79:0/1069756015 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e2ba833b0 0x560e2ba83790 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fb560005fd0 tx=0x7fb560012ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a28ac1b0fd3c4415 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:39.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.344+0000 7fb5677fe640 1 --2- 172.21.15.79:0/2974063507 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb5540b3c50 0x7fb5540b6110 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb5600058c0 tx=0x7fb560014000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:39.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.344+0000 7fb55d7fa640 1 -- 172.21.15.79:0/1069756015 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb560020070 con 0x560e2ba833b0 2024-08-20T01:42:39.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.344+0000 7fb55d7fa640 1 -- 172.21.15.79:0/1069756015 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb560012460 con 0x560e2ba833b0 2024-08-20T01:42:39.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.344+0000 7fb55d7fa640 1 -- 172.21.15.79:0/1069756015 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb560004ad0 con 0x560e2ba833b0 2024-08-20T01:42:39.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.345+0000 7fb56fb85740 1 -- 172.21.15.79:0/1069756015 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e2ba833b0 msgr2=0x560e2ba83790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:39.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.345+0000 7fb56fb85740 1 --2- 172.21.15.79:0/1069756015 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e2ba833b0 0x560e2ba83790 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fb560005fd0 tx=0x7fb560012ee0 comp rx=0 tx=0).stop 2024-08-20T01:42:39.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.345+0000 7fb56fb85740 1 -- 172.21.15.79:0/1069756015 shutdown_connections 2024-08-20T01:42:39.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.345+0000 7fb56fb85740 1 --2- 172.21.15.79:0/1069756015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e2ba8fc60 0x560e2ba92050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:39.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.345+0000 7fb56fb85740 1 --2- 172.21.15.79:0/1069756015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e2ba83cd0 0x560e2ba8f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:39.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.345+0000 7fb56fb85740 1 --2- 172.21.15.79:0/1069756015 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e2ba833b0 0x560e2ba83790 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:39.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.345+0000 7fb56fb85740 1 -- 172.21.15.79:0/1069756015 >> 172.21.15.79:0/1069756015 conn(0x560e2ba811e0 msgr2=0x560e2ba82380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:39.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.345+0000 7fb56fb85740 1 -- 172.21.15.79:0/1069756015 shutdown_connections 2024-08-20T01:42:39.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.345+0000 7fb56fb85740 1 -- 172.21.15.79:0/1069756015 wait complete. 2024-08-20T01:42:39.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.346+0000 7fb56fb85740 1 -- start start 2024-08-20T01:42:39.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.346+0000 7fb56fb85740 1 Processor -- start 2024-08-20T01:42:39.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.346+0000 7fb56fb85740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e2ba833b0 0x560e2ba8cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:39.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.346+0000 7fb56fb85740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e2ba83cd0 0x560e2ba8d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:39.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.346+0000 7fb56fb85740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e2ba8fc60 0x560e2ba8d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:39.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.346+0000 7fb56fb85740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560e2b84b890 con 0x560e2ba8fc60 2024-08-20T01:42:39.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.346+0000 7fb56fb85740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560e2b96f700 con 0x560e2ba833b0 2024-08-20T01:42:39.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.346+0000 7fb56fb85740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560e2ba92950 con 0x560e2ba83cd0 2024-08-20T01:42:39.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.346+0000 7fb56fb85740 10 client.0 _ll_register_callbacks cb 0x560e2b9e46f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:42:39.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.346+0000 7fb5677fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e2ba8fc60 0x560e2ba8d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:39.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.346+0000 7fb5677fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e2ba8fc60 0x560e2ba8d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51840/0 (socket says 172.21.15.79:51840) 2024-08-20T01:42:39.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.346+0000 7fb5677fe640 1 -- 172.21.15.79:0/3449123295 learned_addr learned my addr 172.21.15.79:0/3449123295 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:39.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.346+0000 7fb55ffff640 1 --2- 172.21.15.79:0/3449123295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e2ba83cd0 0x560e2ba8d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:39.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.346+0000 7fb566ffd640 1 --2- 172.21.15.79:0/3449123295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e2ba833b0 0x560e2ba8cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:39.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.346+0000 7fb5677fe640 1 -- 172.21.15.79:0/3449123295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e2ba83cd0 msgr2=0x560e2ba8d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:39.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.347+0000 7fb5677fe640 1 --2- 172.21.15.79:0/3449123295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e2ba83cd0 0x560e2ba8d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:39.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.347+0000 7fb5677fe640 1 -- 172.21.15.79:0/3449123295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e2ba833b0 msgr2=0x560e2ba8cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:39.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.347+0000 7fb5677fe640 1 --2- 172.21.15.79:0/3449123295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e2ba833b0 0x560e2ba8cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:39.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.347+0000 7fb5677fe640 1 -- 172.21.15.79:0/3449123295 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e2b748930 con 0x560e2ba8fc60 2024-08-20T01:42:39.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.347+0000 7fb5677fe640 1 --2- 172.21.15.79:0/3449123295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e2ba8fc60 0x560e2ba8d640 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fb560005f70 tx=0x7fb5600050a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9bca1a41741674c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:39.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.347+0000 7fb54e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:42:39.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.347+0000 7fb54e7fc640 1 -- 172.21.15.79:0/3449123295 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb560020040 con 0x560e2ba8fc60 2024-08-20T01:42:39.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.347+0000 7fb54e7fc640 1 -- 172.21.15.79:0/3449123295 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fb560004810 con 0x560e2ba8fc60 2024-08-20T01:42:39.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.347+0000 7fb56fb85740 1 -- 172.21.15.79:0/3449123295 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb560012460 con 0x560e2ba8fc60 2024-08-20T01:42:39.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.347+0000 7fb54e7fc640 1 -- 172.21.15.79:0/3449123295 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fb560004a10 con 0x560e2ba8fc60 2024-08-20T01:42:39.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.347+0000 7fb56fb85740 10 client.17151 fetch_fsmap learned FSMap version 38 2024-08-20T01:42:39.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.347+0000 7fb56fb85740 1 -- 172.21.15.79:0/3449123295 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x560e2ba9e4b0 con 0x560e2ba8fc60 2024-08-20T01:42:39.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.347+0000 7fb54e7fc640 1 -- 172.21.15.79:0/3449123295 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb560012460 con 0x560e2ba8fc60 2024-08-20T01:42:39.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.348+0000 7fb54e7fc640 1 -- 172.21.15.79:0/3449123295 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7fb56002c070 con 0x560e2ba8fc60 2024-08-20T01:42:39.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.348+0000 7fb56fb85740 10 client.17151 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:42:39.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.348+0000 7fb56fb85740 10 client.17151 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:42:39.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.348+0000 7fb56fb85740 20 client.17151 populate_metadata read hostname 'smithi079' 2024-08-20T01:42:39.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.348+0000 7fb56fb85740 1 --2- 172.21.15.79:0/3449123295 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560e2ba9f8c0 0x560e2baa1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:39.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.348+0000 7fb56fb85740 4 client.17151 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:42:39.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.348+0000 7fb56fb85740 1 -- 172.21.15.79:0/3449123295 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e2b9fb890 con 0x560e2ba9f8c0 2024-08-20T01:42:39.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.348+0000 7fb566ffd640 1 --2- 172.21.15.79:0/3449123295 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560e2ba9f8c0 0x560e2baa1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:39.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.348+0000 7fb54e7fc640 10 client.17151 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:42:39.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.348+0000 7fb566ffd640 1 --2- 172.21.15.79:0/3449123295 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560e2ba9f8c0 0x560e2baa1cb0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7496391092cc41c server_cookie=c30565c922a89fa2 in_seq=0 out_seq=0 2024-08-20T01:42:39.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.349+0000 7fb54e7fc640 1 -- 172.21.15.79:0/3449123295 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560e2b9fb890 con 0x560e2ba9f8c0 2024-08-20T01:42:39.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.349+0000 7fb54e7fc640 10 client.17151 handle_command_reply: tid=0 2024-08-20T01:42:39.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.349+0000 7fb56fb85740 1 client.17151 shutdown 2024-08-20T01:42:39.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.349+0000 7fb56fb85740 1 -- 172.21.15.79:0/3449123295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e2ba8fc60 msgr2=0x560e2ba8d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:39.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.349+0000 7fb56fb85740 1 --2- 172.21.15.79:0/3449123295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e2ba8fc60 0x560e2ba8d640 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fb560005f70 tx=0x7fb5600050a0 comp rx=0 tx=0).stop 2024-08-20T01:42:39.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.349+0000 7fb56fb85740 1 -- 172.21.15.79:0/3449123295 shutdown_connections 2024-08-20T01:42:39.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.349+0000 7fb56fb85740 1 --2- 172.21.15.79:0/3449123295 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560e2ba9f8c0 0x560e2baa1cb0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:39.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.349+0000 7fb56fb85740 1 --2- 172.21.15.79:0/3449123295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e2ba8fc60 0x560e2ba8d640 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:39.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.349+0000 7fb56fb85740 1 --2- 172.21.15.79:0/3449123295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e2ba83cd0 0x560e2ba8d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:39.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.349+0000 7fb56fb85740 1 --2- 172.21.15.79:0/3449123295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e2ba833b0 0x560e2ba8cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:39.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.349+0000 7fb56fb85740 1 -- 172.21.15.79:0/3449123295 >> 172.21.15.79:0/3449123295 conn(0x560e2ba811e0 msgr2=0x560e2ba86d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:39.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.349+0000 7fb54e7fc640 0 client.17151 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:42:39.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.349+0000 7fb56fb85740 1 -- 172.21.15.79:0/3449123295 shutdown_connections 2024-08-20T01:42:39.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.349+0000 7fb56fb85740 1 -- 172.21.15.79:0/3449123295 wait complete. 2024-08-20T01:42:39.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.350+0000 7fb56fb85740 20 client.17151 trim_cache size 0 max 16384 2024-08-20T01:42:39.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.368+0000 7fb56fb85740 1 Processor -- start 2024-08-20T01:42:39.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.368+0000 7fb56fb85740 1 -- start start 2024-08-20T01:42:39.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.369+0000 7fb56fb85740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e2ba833b0 0x560e2ba87470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:39.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.369+0000 7fb56fb85740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e2ba83cd0 0x560e2baa74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:39.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.369+0000 7fb56fb85740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e2ba8fc60 0x560e2baa7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:39.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.369+0000 7fb56fb85740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb5681adf10 con 0x560e2ba83cd0 2024-08-20T01:42:39.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.369+0000 7fb56fb85740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb5681afa50 con 0x560e2ba833b0 2024-08-20T01:42:39.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.369+0000 7fb56fb85740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb5681ae5e0 con 0x560e2ba8fc60 2024-08-20T01:42:39.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.369+0000 7fb55ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e2ba83cd0 0x560e2baa74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:39.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.369+0000 7fb55ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e2ba83cd0 0x560e2baa74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51852/0 (socket says 172.21.15.79:51852) 2024-08-20T01:42:39.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.369+0000 7fb55ffff640 1 -- 172.21.15.79:0/1114940191 learned_addr learned my addr 172.21.15.79:0/1114940191 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:39.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.369+0000 7fb566ffd640 1 --2- 172.21.15.79:0/1114940191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e2ba833b0 0x560e2ba87470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:39.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.369+0000 7fb5677fe640 1 --2- 172.21.15.79:0/1114940191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e2ba8fc60 0x560e2baa7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:39.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.369+0000 7fb55ffff640 1 -- 172.21.15.79:0/1114940191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e2ba8fc60 msgr2=0x560e2baa7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:39.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.369+0000 7fb55ffff640 1 --2- 172.21.15.79:0/1114940191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e2ba8fc60 0x560e2baa7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:39.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.369+0000 7fb55ffff640 1 -- 172.21.15.79:0/1114940191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e2ba833b0 msgr2=0x560e2ba87470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:39.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.369+0000 7fb55ffff640 1 --2- 172.21.15.79:0/1114940191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e2ba833b0 0x560e2ba87470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:39.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.369+0000 7fb55ffff640 1 -- 172.21.15.79:0/1114940191 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e2ba81c60 con 0x560e2ba83cd0 2024-08-20T01:42:39.373 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.369+0000 7fb55ffff640 1 --2- 172.21.15.79:0/1114940191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e2ba83cd0 0x560e2baa74c0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fb55002a930 tx=0x7fb550032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=465e9a70c06184cc server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:39.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.370+0000 7fb55cff9640 1 -- 172.21.15.79:0/1114940191 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb550035040 con 0x560e2ba83cd0 2024-08-20T01:42:39.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.370+0000 7fb55cff9640 1 -- 172.21.15.79:0/1114940191 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb5500044c0 con 0x560e2ba83cd0 2024-08-20T01:42:39.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.370+0000 7fb55cff9640 1 -- 172.21.15.79:0/1114940191 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5500046c0 con 0x560e2ba83cd0 2024-08-20T01:42:39.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.370+0000 7fb56fb85740 1 -- 172.21.15.79:0/1114940191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e2ba83cd0 msgr2=0x560e2baa74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:39.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.370+0000 7fb56fb85740 1 --2- 172.21.15.79:0/1114940191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e2ba83cd0 0x560e2baa74c0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fb55002a930 tx=0x7fb550032d50 comp rx=0 tx=0).stop 2024-08-20T01:42:39.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.371+0000 7fb56fb85740 1 -- 172.21.15.79:0/1114940191 shutdown_connections 2024-08-20T01:42:39.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.371+0000 7fb56fb85740 1 --2- 172.21.15.79:0/1114940191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e2ba8fc60 0x560e2baa7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:39.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.371+0000 7fb56fb85740 1 --2- 172.21.15.79:0/1114940191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e2ba83cd0 0x560e2baa74c0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:39.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.371+0000 7fb56fb85740 1 --2- 172.21.15.79:0/1114940191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e2ba833b0 0x560e2ba87470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:39.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.371+0000 7fb56fb85740 1 -- 172.21.15.79:0/1114940191 >> 172.21.15.79:0/1114940191 conn(0x560e2ba811e0 msgr2=0x560e2ba8d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:39.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.371+0000 7fb56fb85740 1 -- 172.21.15.79:0/1114940191 shutdown_connections 2024-08-20T01:42:39.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.371+0000 7fb56fb85740 1 -- 172.21.15.79:0/1114940191 wait complete. 2024-08-20T01:42:39.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.371+0000 7fb56fb85740 1 -- start start 2024-08-20T01:42:39.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.371+0000 7fb56fb85740 1 Processor -- start 2024-08-20T01:42:39.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.371+0000 7fb56fb85740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e2ba833b0 0x560e2ba97f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:39.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.371+0000 7fb56fb85740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e2ba83cd0 0x560e2ba984b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:39.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.371+0000 7fb56fb85740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e2ba8fc60 0x560e2ba93650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:39.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.371+0000 7fb56fb85740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb5681af380 con 0x560e2ba8fc60 2024-08-20T01:42:39.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.371+0000 7fb56fb85740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb5681aecb0 con 0x560e2ba83cd0 2024-08-20T01:42:39.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.371+0000 7fb56fb85740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb5681abef0 con 0x560e2ba833b0 2024-08-20T01:42:39.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.371+0000 7fb56fb85740 10 client.0 _ll_register_callbacks cb 0x7fb560012850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:42:39.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.371+0000 7fb5677fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e2ba8fc60 0x560e2ba93650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:39.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.372+0000 7fb5677fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e2ba8fc60 0x560e2ba93650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51860/0 (socket says 172.21.15.79:51860) 2024-08-20T01:42:39.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.372+0000 7fb5677fe640 1 -- 172.21.15.79:0/1535697677 learned_addr learned my addr 172.21.15.79:0/1535697677 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:39.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.372+0000 7fb55ffff640 1 --2- 172.21.15.79:0/1535697677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e2ba83cd0 0x560e2ba984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:39.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.372+0000 7fb566ffd640 1 --2- 172.21.15.79:0/1535697677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e2ba833b0 0x560e2ba97f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:39.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.372+0000 7fb5677fe640 1 -- 172.21.15.79:0/1535697677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e2ba833b0 msgr2=0x560e2ba97f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:39.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.372+0000 7fb5677fe640 1 --2- 172.21.15.79:0/1535697677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e2ba833b0 0x560e2ba97f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:39.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.372+0000 7fb5677fe640 1 -- 172.21.15.79:0/1535697677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e2ba83cd0 msgr2=0x560e2ba984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:39.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.372+0000 7fb5677fe640 1 --2- 172.21.15.79:0/1535697677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e2ba83cd0 0x560e2ba984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:39.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.372+0000 7fb5677fe640 1 -- 172.21.15.79:0/1535697677 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e2ba8da60 con 0x560e2ba8fc60 2024-08-20T01:42:39.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.372+0000 7fb55ffff640 1 --2- 172.21.15.79:0/1535697677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e2ba83cd0 0x560e2ba984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:42:39.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.372+0000 7fb5677fe640 1 --2- 172.21.15.79:0/1535697677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e2ba8fc60 0x560e2ba93650 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fb560005ed0 tx=0x7fb560000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=253fe7f2782d1c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:39.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.372+0000 7fb54e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:42:39.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.372+0000 7fb54e7fc640 1 -- 172.21.15.79:0/1535697677 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56003d030 con 0x560e2ba8fc60 2024-08-20T01:42:39.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.372+0000 7fb54e7fc640 1 -- 172.21.15.79:0/1535697677 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fb560012460 con 0x560e2ba8fc60 2024-08-20T01:42:39.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.372+0000 7fb56fb85740 1 -- 172.21.15.79:0/1535697677 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560e2b9f7330 con 0x560e2ba8fc60 2024-08-20T01:42:39.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.372+0000 7fb54e7fc640 1 -- 172.21.15.79:0/1535697677 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fb560020070 con 0x560e2ba8fc60 2024-08-20T01:42:39.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.373+0000 7fb56fb85740 10 client.17157 fetch_fsmap learned FSMap version 38 2024-08-20T01:42:39.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.373+0000 7fb56fb85740 1 -- 172.21.15.79:0/1535697677 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x560e2bb0a010 con 0x560e2ba8fc60 2024-08-20T01:42:39.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.373+0000 7fb54e7fc640 1 -- 172.21.15.79:0/1535697677 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x560e2b9f7330 con 0x560e2ba8fc60 2024-08-20T01:42:39.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.373+0000 7fb54e7fc640 1 -- 172.21.15.79:0/1535697677 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7fb56002c040 con 0x560e2ba8fc60 2024-08-20T01:42:39.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.373+0000 7fb56fb85740 10 client.17157 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:42:39.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.373+0000 7fb56fb85740 10 client.17157 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:42:39.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.373+0000 7fb56fb85740 20 client.17157 populate_metadata read hostname 'smithi079' 2024-08-20T01:42:39.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.373+0000 7fb56fb85740 1 --2- 172.21.15.79:0/1535697677 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560e2bb0a780 0x560e2bb0cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:39.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.373+0000 7fb56fb85740 4 client.17157 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T01:42:39.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.373+0000 7fb56fb85740 1 -- 172.21.15.79:0/1535697677 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560e2b9f4a70 con 0x560e2bb0a780 2024-08-20T01:42:39.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.373+0000 7fb566ffd640 1 --2- 172.21.15.79:0/1535697677 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560e2bb0a780 0x560e2bb0cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:39.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.374+0000 7fb54e7fc640 10 client.17157 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:42:39.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.374+0000 7fb566ffd640 1 --2- 172.21.15.79:0/1535697677 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560e2bb0a780 0x560e2bb0cba0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=426df2e57714f194 server_cookie=89979906d922e80e in_seq=0 out_seq=0 2024-08-20T01:42:39.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.375+0000 7fb54e7fc640 1 -- 172.21.15.79:0/1535697677 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560e2b9f4a70 con 0x560e2bb0a780 2024-08-20T01:42:39.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.375+0000 7fb54e7fc640 10 client.17157 handle_command_reply: tid=0 2024-08-20T01:42:39.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.375+0000 7fb56fb85740 1 client.17157 shutdown 2024-08-20T01:42:39.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.375+0000 7fb56fb85740 1 -- 172.21.15.79:0/1535697677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e2ba8fc60 msgr2=0x560e2ba93650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:39.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.375+0000 7fb56fb85740 1 --2- 172.21.15.79:0/1535697677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e2ba8fc60 0x560e2ba93650 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fb560005ed0 tx=0x7fb560000bc0 comp rx=0 tx=0).stop 2024-08-20T01:42:39.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.375+0000 7fb56fb85740 1 -- 172.21.15.79:0/1535697677 shutdown_connections 2024-08-20T01:42:39.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.375+0000 7fb56fb85740 1 --2- 172.21.15.79:0/1535697677 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560e2bb0a780 0x560e2bb0cba0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:39.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.375+0000 7fb56fb85740 1 --2- 172.21.15.79:0/1535697677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e2ba8fc60 0x560e2ba93650 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:39.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.375+0000 7fb56fb85740 1 --2- 172.21.15.79:0/1535697677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e2ba83cd0 0x560e2ba984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:39.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.375+0000 7fb56fb85740 1 --2- 172.21.15.79:0/1535697677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e2ba833b0 0x560e2ba97f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:39.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.375+0000 7fb56fb85740 1 -- 172.21.15.79:0/1535697677 >> 172.21.15.79:0/1535697677 conn(0x560e2ba811e0 msgr2=0x560e2ba7fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:39.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.375+0000 7fb54e7fc640 0 client.17157 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:42:39.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.375+0000 7fb56fb85740 1 -- 172.21.15.79:0/1535697677 shutdown_connections 2024-08-20T01:42:39.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.375+0000 7fb56fb85740 1 -- 172.21.15.79:0/1535697677 wait complete. 2024-08-20T01:42:39.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.375+0000 7fb56fb85740 20 client.17157 trim_cache size 0 max 16384 2024-08-20T01:42:39.383 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:42:39.383 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-08-20T01:42:39.383 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "df0ea2ec-ecb6-420c-8e72-4073cf1d8e74", 2024-08-20T01:42:39.383 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-08-20T01:42:39.383 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:42:39.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.376+0000 7fb56d78c640 1 -- 172.21.15.79:0/2974063507 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb5540b3c50 msgr2=0x7fb5540b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:39.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.376+0000 7fb56d78c640 1 --2- 172.21.15.79:0/2974063507 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb5540b3c50 0x7fb5540b6110 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb5600058c0 tx=0x7fb560014000 comp rx=0 tx=0).stop 2024-08-20T01:42:39.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.376+0000 7fb56d78c640 1 -- 172.21.15.79:0/2974063507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb568101990 msgr2=0x7fb568198e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:39.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.376+0000 7fb56d78c640 1 --2- 172.21.15.79:0/2974063507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb568101990 0x7fb568198e60 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fb55800eab0 tx=0x7fb55800ef70 comp rx=0 tx=0).stop 2024-08-20T01:42:39.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.376+0000 7fb56d78c640 1 -- 172.21.15.79:0/2974063507 shutdown_connections 2024-08-20T01:42:39.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.376+0000 7fb56d78c640 1 --2- 172.21.15.79:0/2974063507 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb5540b3c50 0x7fb5540b6110 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:39.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.376+0000 7fb56d78c640 1 --2- 172.21.15.79:0/2974063507 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb568107d20 0x7fb56819e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:39.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.376+0000 7fb56d78c640 1 --2- 172.21.15.79:0/2974063507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5681073a0 0x7fb5681993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:39.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.376+0000 7fb56d78c640 1 --2- 172.21.15.79:0/2974063507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb568101990 0x7fb568198e60 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:39.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.376+0000 7fb56d78c640 1 -- 172.21.15.79:0/2974063507 >> 172.21.15.79:0/2974063507 conn(0x7fb5680fd400 msgr2=0x7fb5680ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:39.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.376+0000 7fb56d78c640 1 -- 172.21.15.79:0/2974063507 shutdown_connections 2024-08-20T01:42:39.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:39.376+0000 7fb56d78c640 1 -- 172.21.15.79:0/2974063507 wait complete. 2024-08-20T01:42:40.318 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:42:40.580 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:40 smithi081 ceph-mon[22209]: pgmap v507: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 31 MiB/s wr, 26 op/s 2024-08-20T01:42:40.581 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:40 smithi081 ceph-mon[22209]: scrub queued for path: / 2024-08-20T01:42:40.581 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:40 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:42:40.581 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:40 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:42:40.581 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:40 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:42:40.581 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:40 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:42:40.581 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:40 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:42:40.581 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:40 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:42:40.581 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:40 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:42:40.581 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:40 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:42:40.581 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:40 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:42:40.581 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:40 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:42:40.581 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:40 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:42:40.582 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:40 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:42:40.582 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:40 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:42:40.582 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:40 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:42:40.582 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:40 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:42:40.589 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:42:40.615 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.612+0000 7f76dd163640 1 -- 172.21.15.79:0/1404287483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76d81026b0 msgr2=0x7f76d8102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:40.615 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.612+0000 7f76dd163640 1 --2- 172.21.15.79:0/1404287483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76d81026b0 0x7f76d8102b30 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f76cc009930 tx=0x7f76cc02a420 comp rx=0 tx=0).stop 2024-08-20T01:42:40.615 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.612+0000 7f76dd163640 1 -- 172.21.15.79:0/1404287483 shutdown_connections 2024-08-20T01:42:40.615 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.612+0000 7f76dd163640 1 --2- 172.21.15.79:0/1404287483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76d8103070 0x7f76d81099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:40.615 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.612+0000 7f76dd163640 1 --2- 172.21.15.79:0/1404287483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76d81026b0 0x7f76d8102b30 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:40.615 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.612+0000 7f76dd163640 1 --2- 172.21.15.79:0/1404287483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76d8101560 0x7f76d8101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:40.615 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.612+0000 7f76dd163640 1 -- 172.21.15.79:0/1404287483 >> 172.21.15.79:0/1404287483 conn(0x7f76d80fce40 msgr2=0x7f76d80ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:40.615 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.612+0000 7f76dd163640 1 -- 172.21.15.79:0/1404287483 shutdown_connections 2024-08-20T01:42:40.615 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.612+0000 7f76dd163640 1 -- 172.21.15.79:0/1404287483 wait complete. 2024-08-20T01:42:40.617 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.613+0000 7f76dd163640 1 Processor -- start 2024-08-20T01:42:40.617 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.613+0000 7f76dd163640 1 -- start start 2024-08-20T01:42:40.617 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.614+0000 7f76dd163640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76d8101560 0x7f76d819abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.614+0000 7f76dd163640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76d81026b0 0x7f76d819b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.614+0000 7f76dd163640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76d8103070 0x7f76d819be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.614+0000 7f76dd163640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f76d810d0b0 con 0x7f76d81026b0 2024-08-20T01:42:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.614+0000 7f76dd163640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f76d810cf30 con 0x7f76d8103070 2024-08-20T01:42:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.614+0000 7f76dd163640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f76d810d230 con 0x7f76d8101560 2024-08-20T01:42:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.614+0000 7f76d659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76d81026b0 0x7f76d819b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.614+0000 7f76d659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76d81026b0 0x7f76d819b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48034/0 (socket says 172.21.15.79:48034) 2024-08-20T01:42:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.614+0000 7f76d659c640 1 -- 172.21.15.79:0/2724385024 learned_addr learned my addr 172.21.15.79:0/2724385024 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.614+0000 7f76d759e640 1 --2- 172.21.15.79:0/2724385024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76d8103070 0x7f76d819be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.614+0000 7f76d6d9d640 1 --2- 172.21.15.79:0/2724385024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76d8101560 0x7f76d819abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.614+0000 7f76d659c640 1 -- 172.21.15.79:0/2724385024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76d8101560 msgr2=0x7f76d819abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.614+0000 7f76d659c640 1 --2- 172.21.15.79:0/2724385024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76d8101560 0x7f76d819abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.614+0000 7f76d659c640 1 -- 172.21.15.79:0/2724385024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76d8103070 msgr2=0x7f76d819be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.614+0000 7f76d659c640 1 --2- 172.21.15.79:0/2724385024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76d8103070 0x7f76d819be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.614+0000 7f76d659c640 1 -- 172.21.15.79:0/2724385024 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d819c6f0 con 0x7f76d81026b0 2024-08-20T01:42:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.614+0000 7f76d659c640 1 --2- 172.21.15.79:0/2724385024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76d81026b0 0x7f76d819b200 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f76cc031460 tx=0x7f76cc003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.615+0000 7f76bffff640 1 -- 172.21.15.79:0/2724385024 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76cc03f070 con 0x7f76d81026b0 2024-08-20T01:42:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.615+0000 7f76bffff640 1 -- 172.21.15.79:0/2724385024 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f76cc031da0 con 0x7f76d81026b0 2024-08-20T01:42:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.615+0000 7f76bffff640 1 -- 172.21.15.79:0/2724385024 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76cc035030 con 0x7f76d81026b0 2024-08-20T01:42:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.615+0000 7f76dd163640 1 -- 172.21.15.79:0/2724385024 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76d819c980 con 0x7f76d81026b0 2024-08-20T01:42:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.615+0000 7f76dd163640 1 -- 172.21.15.79:0/2724385024 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76d81a30b0 con 0x7f76d81026b0 2024-08-20T01:42:40.622 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.617+0000 7f76bffff640 1 -- 172.21.15.79:0/2724385024 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f76cc042070 con 0x7f76d81026b0 2024-08-20T01:42:40.622 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.618+0000 7f76e0035740 1 Processor -- start 2024-08-20T01:42:40.622 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.618+0000 7f76e0035740 1 -- start start 2024-08-20T01:42:40.622 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.618+0000 7f76e0035740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e12ab48d0 0x562e12ab6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:40.622 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.618+0000 7f76e0035740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e12ab7200 0x562e12ab95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:40.622 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.618+0000 7f76e0035740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e12ab9c40 0x562e12abc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:40.622 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.618+0000 7f76e0035740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562e12a27360 con 0x562e12ab7200 2024-08-20T01:42:40.622 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.618+0000 7f76e0035740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562e12a16860 con 0x562e12ab9c40 2024-08-20T01:42:40.622 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.618+0000 7f76e0035740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562e12a1a8a0 con 0x562e12ab48d0 2024-08-20T01:42:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.618+0000 7f76d6d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e12ab7200 0x562e12ab95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.618+0000 7f76d6d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e12ab7200 0x562e12ab95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48044/0 (socket says 172.21.15.79:48044) 2024-08-20T01:42:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.618+0000 7f76d6d9d640 1 -- 172.21.15.79:0/3627408518 learned_addr learned my addr 172.21.15.79:0/3627408518 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.618+0000 7f76d759e640 1 --2- 172.21.15.79:0/3627408518 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e12ab48d0 0x562e12ab6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.618+0000 7f76bffff640 1 --2- 172.21.15.79:0/2724385024 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f76c00b3c50 0x7f76c00b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.619+0000 7f76d759e640 1 --2- 172.21.15.79:0/2724385024 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f76c00b3c50 0x7f76c00b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.619+0000 7f76bffff640 1 -- 172.21.15.79:0/2724385024 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f76cc104330 con 0x7f76d81026b0 2024-08-20T01:42:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.619+0000 7f76d659c640 1 --2- 172.21.15.79:0/3627408518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e12ab9c40 0x562e12abc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.619+0000 7f76d759e640 1 -- 172.21.15.79:0/3627408518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e12ab9c40 msgr2=0x562e12abc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.619+0000 7f76d759e640 1 --2- 172.21.15.79:0/3627408518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e12ab9c40 0x562e12abc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.619+0000 7f76d759e640 1 -- 172.21.15.79:0/3627408518 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e12ab7200 msgr2=0x562e12ab95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.619+0000 7f76d759e640 1 --2- 172.21.15.79:0/3627408518 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e12ab7200 0x562e12ab95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.619+0000 7f76d759e640 1 -- 172.21.15.79:0/3627408518 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e129bde40 con 0x562e12ab48d0 2024-08-20T01:42:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.619+0000 7f76d6d9d640 1 --2- 172.21.15.79:0/3627408518 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e12ab7200 0x562e12ab95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:42:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.619+0000 7f76d659c640 1 --2- 172.21.15.79:0/3627408518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e12ab9c40 0x562e12abc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:42:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.619+0000 7f76d759e640 1 --2- 172.21.15.79:0/3627408518 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e12ab48d0 0x562e12ab6cc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f76d0005fd0 tx=0x7f76d0012760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f68adb02524eefc server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.619+0000 7f76d759e640 1 --2- 172.21.15.79:0/2724385024 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f76c00b3c50 0x7f76c00b6110 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f76d0012ba0 tx=0x7f76d000b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.620+0000 7f76bd7fa640 1 -- 172.21.15.79:0/3627408518 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d0012030 con 0x562e12ab48d0 2024-08-20T01:42:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.620+0000 7f76bd7fa640 1 -- 172.21.15.79:0/3627408518 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f76d00121d0 con 0x562e12ab48d0 2024-08-20T01:42:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.620+0000 7f76bd7fa640 1 -- 172.21.15.79:0/3627408518 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d0003d30 con 0x562e12ab48d0 2024-08-20T01:42:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.620+0000 7f76e0035740 1 -- 172.21.15.79:0/3627408518 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e12ab48d0 msgr2=0x562e12ab6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.620+0000 7f76e0035740 1 --2- 172.21.15.79:0/3627408518 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e12ab48d0 0x562e12ab6cc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f76d0005fd0 tx=0x7f76d0012760 comp rx=0 tx=0).stop 2024-08-20T01:42:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.620+0000 7f76e0035740 1 -- 172.21.15.79:0/3627408518 shutdown_connections 2024-08-20T01:42:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.620+0000 7f76e0035740 1 --2- 172.21.15.79:0/3627408518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e12ab9c40 0x562e12abc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.620+0000 7f76e0035740 1 --2- 172.21.15.79:0/3627408518 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e12ab7200 0x562e12ab95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.620+0000 7f76e0035740 1 --2- 172.21.15.79:0/3627408518 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e12ab48d0 0x562e12ab6cc0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.620+0000 7f76e0035740 1 -- 172.21.15.79:0/3627408518 >> 172.21.15.79:0/3627408518 conn(0x562e12aafa20 msgr2=0x562e12ab07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.621+0000 7f76e0035740 1 -- 172.21.15.79:0/3627408518 shutdown_connections 2024-08-20T01:42:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.621+0000 7f76e0035740 1 -- 172.21.15.79:0/3627408518 wait complete. 2024-08-20T01:42:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.621+0000 7f76e0035740 1 -- start start 2024-08-20T01:42:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.621+0000 7f76e0035740 1 Processor -- start 2024-08-20T01:42:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.621+0000 7f76e0035740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e12ab48d0 0x562e12abe090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.621+0000 7f76e0035740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e12ab7200 0x562e12abe730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.621+0000 7f76e0035740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e12ab9c40 0x562e12abf300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.621+0000 7f76e0035740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562e1294fab0 con 0x562e12ab48d0 2024-08-20T01:42:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.621+0000 7f76e0035740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562e1299d780 con 0x562e12ab9c40 2024-08-20T01:42:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.621+0000 7f76e0035740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562e12abcb60 con 0x562e12ab7200 2024-08-20T01:42:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.621+0000 7f76e0035740 10 client.0 _ll_register_callbacks cb 0x562e12725a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:42:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.621+0000 7f76d6d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e12ab48d0 0x562e12abe090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.621+0000 7f76d659c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e12ab7200 0x562e12abe730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.621+0000 7f76d659c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e12ab7200 0x562e12abe730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:37588/0 (socket says 172.21.15.79:37588) 2024-08-20T01:42:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.621+0000 7f76d659c640 1 -- 172.21.15.79:0/1379367738 learned_addr learned my addr 172.21.15.79:0/1379367738 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.622+0000 7f76d759e640 1 --2- 172.21.15.79:0/1379367738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e12ab9c40 0x562e12abf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.622+0000 7f76d659c640 1 -- 172.21.15.79:0/1379367738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e12ab9c40 msgr2=0x562e12abf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.622+0000 7f76d659c640 1 --2- 172.21.15.79:0/1379367738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e12ab9c40 0x562e12abf300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.622+0000 7f76d659c640 1 -- 172.21.15.79:0/1379367738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e12ab48d0 msgr2=0x562e12abe090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.622+0000 7f76d659c640 1 --2- 172.21.15.79:0/1379367738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e12ab48d0 0x562e12abe090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.622+0000 7f76d659c640 1 -- 172.21.15.79:0/1379367738 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e12779790 con 0x562e12ab7200 2024-08-20T01:42:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.622+0000 7f76d6d9d640 1 --2- 172.21.15.79:0/1379367738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e12ab48d0 0x562e12abe090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:42:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.622+0000 7f76d659c640 1 --2- 172.21.15.79:0/1379367738 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e12ab7200 0x562e12abe730 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f76cc1021b0 tx=0x7f76cc03d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86fc5188a2aac0f6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.622+0000 7f76baff5640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:42:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.622+0000 7f76baff5640 1 -- 172.21.15.79:0/1379367738 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76cc049070 con 0x562e12ab7200 2024-08-20T01:42:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.622+0000 7f76e0035740 1 -- 172.21.15.79:0/1379367738 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562e129c5e00 con 0x562e12ab7200 2024-08-20T01:42:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.622+0000 7f76baff5640 1 -- 172.21.15.79:0/1379367738 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f76cc0d3eb0 con 0x562e12ab7200 2024-08-20T01:42:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.622+0000 7f76baff5640 1 -- 172.21.15.79:0/1379367738 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f76cc0cb340 con 0x562e12ab7200 2024-08-20T01:42:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.622+0000 7f76e0035740 10 client.26275 fetch_fsmap learned FSMap version 38 2024-08-20T01:42:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.622+0000 7f76e0035740 1 -- 172.21.15.79:0/1379367738 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x562e127f2620 con 0x562e12ab7200 2024-08-20T01:42:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.623+0000 7f76baff5640 1 -- 172.21.15.79:0/1379367738 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x562e129c5e00 con 0x562e12ab7200 2024-08-20T01:42:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.623+0000 7f76baff5640 1 -- 172.21.15.79:0/1379367738 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f76cc0ec300 con 0x562e12ab7200 2024-08-20T01:42:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.623+0000 7f76e0035740 10 client.26275 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:42:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.623+0000 7f76e0035740 10 client.26275 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:42:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.623+0000 7f76e0035740 20 client.26275 populate_metadata read hostname 'smithi079' 2024-08-20T01:42:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.623+0000 7f76e0035740 1 --2- 172.21.15.79:0/1379367738 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x562e12ac98d0 0x562e12acbce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.623+0000 7f76e0035740 4 client.26275 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:42:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.623+0000 7f76e0035740 1 -- 172.21.15.79:0/1379367738 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e12a292b0 con 0x562e12ac98d0 2024-08-20T01:42:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.623+0000 7f76d6d9d640 1 --2- 172.21.15.79:0/1379367738 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x562e12ac98d0 0x562e12acbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.624+0000 7f76d6d9d640 1 --2- 172.21.15.79:0/1379367738 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x562e12ac98d0 0x562e12acbce0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c60fce295730a72 server_cookie=a7094cba0af71af in_seq=0 out_seq=0 2024-08-20T01:42:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.624+0000 7f76baff5640 10 client.26275 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:42:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.624+0000 7f76baff5640 1 -- 172.21.15.79:0/1379367738 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562e12a292b0 con 0x562e12ac98d0 2024-08-20T01:42:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.624+0000 7f76baff5640 10 client.26275 handle_command_reply: tid=0 2024-08-20T01:42:40.633 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.624+0000 7f76e0035740 1 client.26275 shutdown 2024-08-20T01:42:40.633 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.625+0000 7f76e0035740 1 -- 172.21.15.79:0/1379367738 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e12ab7200 msgr2=0x562e12abe730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:40.633 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.625+0000 7f76e0035740 1 --2- 172.21.15.79:0/1379367738 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e12ab7200 0x562e12abe730 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f76cc1021b0 tx=0x7f76cc03d000 comp rx=0 tx=0).stop 2024-08-20T01:42:40.633 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.625+0000 7f76e0035740 1 -- 172.21.15.79:0/1379367738 shutdown_connections 2024-08-20T01:42:40.633 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.625+0000 7f76e0035740 1 --2- 172.21.15.79:0/1379367738 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x562e12ac98d0 0x562e12acbce0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:40.633 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.625+0000 7f76e0035740 1 --2- 172.21.15.79:0/1379367738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e12ab9c40 0x562e12abf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:40.633 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.625+0000 7f76e0035740 1 --2- 172.21.15.79:0/1379367738 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e12ab7200 0x562e12abe730 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:40.633 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.625+0000 7f76e0035740 1 --2- 172.21.15.79:0/1379367738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e12ab48d0 0x562e12abe090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:40.633 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.625+0000 7f76e0035740 1 -- 172.21.15.79:0/1379367738 >> 172.21.15.79:0/1379367738 conn(0x562e12aafa20 msgr2=0x562e12aaeae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:40.633 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.625+0000 7f76baff5640 0 client.26275 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:42:40.633 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.625+0000 7f76e0035740 1 -- 172.21.15.79:0/1379367738 shutdown_connections 2024-08-20T01:42:40.633 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.625+0000 7f76e0035740 1 -- 172.21.15.79:0/1379367738 wait complete. 2024-08-20T01:42:40.633 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.625+0000 7f76e0035740 20 client.26275 trim_cache size 0 max 16384 2024-08-20T01:42:40.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:40 smithi175 ceph-mon[22392]: pgmap v507: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 31 MiB/s wr, 26 op/s 2024-08-20T01:42:40.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:40 smithi175 ceph-mon[22392]: scrub queued for path: / 2024-08-20T01:42:40.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:40 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:42:40.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:40 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:42:40.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:40 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:42:40.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:40 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:42:40.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:40 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:42:40.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:40 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:42:40.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:40 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:42:40.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:40 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:42:40.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:40 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:42:40.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:40 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:42:40.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:40 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:42:40.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:40 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:42:40.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:40 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:42:40.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:40 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:42:40.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:40 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:42:40.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.647+0000 7f76e0035740 1 Processor -- start 2024-08-20T01:42:40.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.647+0000 7f76e0035740 1 -- start start 2024-08-20T01:42:40.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.647+0000 7f76e0035740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e12ab48d0 0x562e12acb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:40.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.647+0000 7f76e0035740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e12ab7200 0x562e12ab0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:40.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.647+0000 7f76e0035740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e12ab9c40 0x562e12ab09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:40.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.647+0000 7f76e0035740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f76d81abbd0 con 0x562e12ab9c40 2024-08-20T01:42:40.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.647+0000 7f76e0035740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f76d81ad710 con 0x562e12ab7200 2024-08-20T01:42:40.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.647+0000 7f76e0035740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f76d81ac2a0 con 0x562e12ab48d0 2024-08-20T01:42:40.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.647+0000 7f76d759e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e12ab9c40 0x562e12ab09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:40.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.647+0000 7f76d759e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e12ab9c40 0x562e12ab09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48064/0 (socket says 172.21.15.79:48064) 2024-08-20T01:42:40.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.647+0000 7f76d759e640 1 -- 172.21.15.79:0/636677959 learned_addr learned my addr 172.21.15.79:0/636677959 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:40.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.647+0000 7f76d6d9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e12ab48d0 0x562e12acb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:40.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.648+0000 7f76d659c640 1 --2- 172.21.15.79:0/636677959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e12ab7200 0x562e12ab0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:40.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.648+0000 7f76d759e640 1 -- 172.21.15.79:0/636677959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e12ab48d0 msgr2=0x562e12acb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:40.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.648+0000 7f76d759e640 1 --2- 172.21.15.79:0/636677959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e12ab48d0 0x562e12acb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:40.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.648+0000 7f76d759e640 1 -- 172.21.15.79:0/636677959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e12ab7200 msgr2=0x562e12ab0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:40.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.648+0000 7f76d759e640 1 --2- 172.21.15.79:0/636677959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e12ab7200 0x562e12ab0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:40.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.648+0000 7f76d759e640 1 -- 172.21.15.79:0/636677959 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e12ab9960 con 0x562e12ab9c40 2024-08-20T01:42:40.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.648+0000 7f76d6d9d640 1 --2- 172.21.15.79:0/636677959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e12ab48d0 0x562e12acb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:42:40.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.648+0000 7f76d759e640 1 --2- 172.21.15.79:0/636677959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e12ab9c40 0x562e12ab09b0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f76d0015dd0 tx=0x7f76d00096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ac4b669e63762f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:40.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.648+0000 7f76bcff9640 1 -- 172.21.15.79:0/636677959 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d002c070 con 0x562e12ab9c40 2024-08-20T01:42:40.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.648+0000 7f76bcff9640 1 -- 172.21.15.79:0/636677959 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f76d0003e00 con 0x562e12ab9c40 2024-08-20T01:42:40.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.648+0000 7f76bcff9640 1 -- 172.21.15.79:0/636677959 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d00053e0 con 0x562e12ab9c40 2024-08-20T01:42:40.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.649+0000 7f76e0035740 1 -- 172.21.15.79:0/636677959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e12ab9c40 msgr2=0x562e12ab09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:40.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.649+0000 7f76e0035740 1 --2- 172.21.15.79:0/636677959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e12ab9c40 0x562e12ab09b0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f76d0015dd0 tx=0x7f76d00096a0 comp rx=0 tx=0).stop 2024-08-20T01:42:40.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.649+0000 7f76e0035740 1 -- 172.21.15.79:0/636677959 shutdown_connections 2024-08-20T01:42:40.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.649+0000 7f76e0035740 1 --2- 172.21.15.79:0/636677959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e12ab9c40 0x562e12ab09b0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:40.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.649+0000 7f76e0035740 1 --2- 172.21.15.79:0/636677959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e12ab7200 0x562e12ab0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:40.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.649+0000 7f76e0035740 1 --2- 172.21.15.79:0/636677959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e12ab48d0 0x562e12acb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:40.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.649+0000 7f76e0035740 1 -- 172.21.15.79:0/636677959 >> 172.21.15.79:0/636677959 conn(0x562e12aafa20 msgr2=0x562e12abb610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:40.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.649+0000 7f76e0035740 1 -- 172.21.15.79:0/636677959 shutdown_connections 2024-08-20T01:42:40.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.649+0000 7f76e0035740 1 -- 172.21.15.79:0/636677959 wait complete. 2024-08-20T01:42:40.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.649+0000 7f76e0035740 1 -- start start 2024-08-20T01:42:40.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.649+0000 7f76e0035740 1 Processor -- start 2024-08-20T01:42:40.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.650+0000 7f76e0035740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e12ab48d0 0x562e12ac55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:40.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.650+0000 7f76e0035740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e12ab7200 0x562e12ac5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:40.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.650+0000 7f76e0035740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e12ab9c40 0x562e12ac4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:40.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.650+0000 7f76e0035740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f76d81ad040 con 0x562e12ab7200 2024-08-20T01:42:40.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.650+0000 7f76e0035740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f76d81ac970 con 0x562e12ab9c40 2024-08-20T01:42:40.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.650+0000 7f76e0035740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f76d81a9bb0 con 0x562e12ab48d0 2024-08-20T01:42:40.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.650+0000 7f76e0035740 10 client.0 _ll_register_callbacks cb 0x7f76cc005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:42:40.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.650+0000 7f76d659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e12ab7200 0x562e12ac5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:40.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.650+0000 7f76d659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e12ab7200 0x562e12ac5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48072/0 (socket says 172.21.15.79:48072) 2024-08-20T01:42:40.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.650+0000 7f76d659c640 1 -- 172.21.15.79:0/3412492901 learned_addr learned my addr 172.21.15.79:0/3412492901 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:40.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.650+0000 7f76d659c640 1 -- 172.21.15.79:0/3412492901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e12ab48d0 msgr2=0x562e12ac55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:40.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.650+0000 7f76d759e640 1 --2- 172.21.15.79:0/3412492901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e12ab9c40 0x562e12ac4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:40.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.650+0000 7f76d6d9d640 1 --2- 172.21.15.79:0/3412492901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e12ab48d0 0x562e12ac55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:40.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.650+0000 7f76d659c640 1 --2- 172.21.15.79:0/3412492901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e12ab48d0 0x562e12ac55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:40.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.650+0000 7f76d659c640 1 -- 172.21.15.79:0/3412492901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e12ab9c40 msgr2=0x562e12ac4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:40.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.650+0000 7f76d659c640 1 --2- 172.21.15.79:0/3412492901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e12ab9c40 0x562e12ac4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:40.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.650+0000 7f76d659c640 1 -- 172.21.15.79:0/3412492901 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e12ac4b50 con 0x562e12ab7200 2024-08-20T01:42:40.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.650+0000 7f76d759e640 1 --2- 172.21.15.79:0/3412492901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e12ab9c40 0x562e12ac4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:42:40.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.650+0000 7f76d659c640 1 --2- 172.21.15.79:0/3412492901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e12ab7200 0x562e12ac5c80 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f76cc02a9e0 tx=0x7f76cc003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2315e5a558d877fb server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:40.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.650+0000 7f76baff5640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:42:40.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.650+0000 7f76baff5640 1 -- 172.21.15.79:0/3412492901 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76cc0a9020 con 0x562e12ab7200 2024-08-20T01:42:40.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.650+0000 7f76baff5640 1 -- 172.21.15.79:0/3412492901 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f76cc031910 con 0x562e12ab7200 2024-08-20T01:42:40.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.650+0000 7f76e0035740 1 -- 172.21.15.79:0/3412492901 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76d0003e00 con 0x562e12ab7200 2024-08-20T01:42:40.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.651+0000 7f76baff5640 1 -- 172.21.15.79:0/3412492901 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f76cc049040 con 0x562e12ab7200 2024-08-20T01:42:40.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.651+0000 7f76e0035740 10 client.17175 fetch_fsmap learned FSMap version 38 2024-08-20T01:42:40.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.651+0000 7f76e0035740 1 -- 172.21.15.79:0/3412492901 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x562e12ac3a30 con 0x562e12ab7200 2024-08-20T01:42:40.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.651+0000 7f76baff5640 1 -- 172.21.15.79:0/3412492901 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f76d0003e00 con 0x562e12ab7200 2024-08-20T01:42:40.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.651+0000 7f76baff5640 1 -- 172.21.15.79:0/3412492901 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f76cc0ca010 con 0x562e12ab7200 2024-08-20T01:42:40.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.651+0000 7f76e0035740 10 client.17175 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:42:40.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.651+0000 7f76e0035740 10 client.17175 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:42:40.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.651+0000 7f76e0035740 20 client.17175 populate_metadata read hostname 'smithi079' 2024-08-20T01:42:40.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.651+0000 7f76e0035740 1 --2- 172.21.15.79:0/3412492901 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x562e12b349d0 0x562e12b36df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:40.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.651+0000 7f76e0035740 4 client.17175 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:42:40.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.651+0000 7f76e0035740 1 -- 172.21.15.79:0/3412492901 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562e12a24d50 con 0x562e12b349d0 2024-08-20T01:42:40.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.651+0000 7f76d6d9d640 1 --2- 172.21.15.79:0/3412492901 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x562e12b349d0 0x562e12b36df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:40.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.652+0000 7f76baff5640 10 client.17175 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:42:40.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.652+0000 7f76d6d9d640 1 --2- 172.21.15.79:0/3412492901 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x562e12b349d0 0x562e12b36df0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5bde2bc93ecb730 server_cookie=f82540ad4ae14b53 in_seq=0 out_seq=0 2024-08-20T01:42:40.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.660+0000 7f76baff5640 1 -- 172.21.15.79:0/3412492901 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562e12a24d50 con 0x562e12b349d0 2024-08-20T01:42:40.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.660+0000 7f76baff5640 10 client.17175 handle_command_reply: tid=0 2024-08-20T01:42:40.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.660+0000 7f76e0035740 1 client.17175 shutdown 2024-08-20T01:42:40.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.660+0000 7f76e0035740 1 -- 172.21.15.79:0/3412492901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e12ab7200 msgr2=0x562e12ac5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:40.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.660+0000 7f76e0035740 1 --2- 172.21.15.79:0/3412492901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e12ab7200 0x562e12ac5c80 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f76cc02a9e0 tx=0x7f76cc003f30 comp rx=0 tx=0).stop 2024-08-20T01:42:40.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.660+0000 7f76e0035740 1 -- 172.21.15.79:0/3412492901 shutdown_connections 2024-08-20T01:42:40.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.660+0000 7f76e0035740 1 --2- 172.21.15.79:0/3412492901 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x562e12b349d0 0x562e12b36df0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:40.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.660+0000 7f76e0035740 1 --2- 172.21.15.79:0/3412492901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e12ab9c40 0x562e12ac4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:40.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.660+0000 7f76baff5640 0 client.17175 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:42:40.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.660+0000 7f76e0035740 1 --2- 172.21.15.79:0/3412492901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e12ab7200 0x562e12ac5c80 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:40.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.660+0000 7f76e0035740 1 --2- 172.21.15.79:0/3412492901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e12ab48d0 0x562e12ac55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:40.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.660+0000 7f76e0035740 1 -- 172.21.15.79:0/3412492901 >> 172.21.15.79:0/3412492901 conn(0x562e12aafa20 msgr2=0x562e12abb610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:40.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.660+0000 7f76e0035740 1 -- 172.21.15.79:0/3412492901 shutdown_connections 2024-08-20T01:42:40.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.660+0000 7f76e0035740 1 -- 172.21.15.79:0/3412492901 wait complete. 2024-08-20T01:42:40.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.660+0000 7f76e0035740 20 client.17175 trim_cache size 0 max 16384 2024-08-20T01:42:40.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:42:40.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:42:40.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:42:40.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:42:40.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.661+0000 7f76dd163640 1 -- 172.21.15.79:0/2724385024 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f76c00b3c50 msgr2=0x7f76c00b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:40.666 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.661+0000 7f76dd163640 1 --2- 172.21.15.79:0/2724385024 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f76c00b3c50 0x7f76c00b6110 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f76d0012ba0 tx=0x7f76d000b000 comp rx=0 tx=0).stop 2024-08-20T01:42:40.666 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.661+0000 7f76dd163640 1 -- 172.21.15.79:0/2724385024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76d81026b0 msgr2=0x7f76d819b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:40.666 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.661+0000 7f76dd163640 1 --2- 172.21.15.79:0/2724385024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76d81026b0 0x7f76d819b200 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f76cc031460 tx=0x7f76cc003c80 comp rx=0 tx=0).stop 2024-08-20T01:42:40.666 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.661+0000 7f76dd163640 1 -- 172.21.15.79:0/2724385024 shutdown_connections 2024-08-20T01:42:40.666 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.661+0000 7f76dd163640 1 --2- 172.21.15.79:0/2724385024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76d8103070 0x7f76d819be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:40.666 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.661+0000 7f76dd163640 1 --2- 172.21.15.79:0/2724385024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76d81026b0 0x7f76d819b200 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:40.666 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.661+0000 7f76dd163640 1 --2- 172.21.15.79:0/2724385024 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f76c00b3c50 0x7f76c00b6110 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:40.666 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.661+0000 7f76dd163640 1 --2- 172.21.15.79:0/2724385024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76d8101560 0x7f76d819abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:40.666 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.661+0000 7f76dd163640 1 -- 172.21.15.79:0/2724385024 >> 172.21.15.79:0/2724385024 conn(0x7f76d80fce40 msgr2=0x7f76d80fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:40.666 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.661+0000 7f76dd163640 1 -- 172.21.15.79:0/2724385024 shutdown_connections 2024-08-20T01:42:40.666 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:40.661+0000 7f76dd163640 1 -- 172.21.15.79:0/2724385024 wait complete. 2024-08-20T01:42:40.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:40 smithi079 ceph-mon[18656]: pgmap v507: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 31 MiB/s wr, 26 op/s 2024-08-20T01:42:40.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:40 smithi079 ceph-mon[18656]: scrub queued for path: / 2024-08-20T01:42:40.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:40 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:42:40.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:40 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:42:40.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:40 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:42:40.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:40 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:42:40.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:40 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:42:40.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:40 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:42:40.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:40 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:42:40.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:40 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:42:40.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:40 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:42:40.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:40 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:42:40.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:40 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:42:40.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:40 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:42:40.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:40 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:42:40.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:40 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:42:40.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:40 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:42:41.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.103+0000 7f0e31ebc640 1 -- 172.21.15.79:0/1519981111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e2c1019b0 msgr2=0x7f0e2c101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:41.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.103+0000 7f0e31ebc640 1 --2- 172.21.15.79:0/1519981111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e2c1019b0 0x7f0e2c101d90 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c009900 tx=0x7f0e1c02a410 comp rx=0 tx=0).stop 2024-08-20T01:42:41.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.103+0000 7f0e31ebc640 1 -- 172.21.15.79:0/1519981111 shutdown_connections 2024-08-20T01:42:41.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.103+0000 7f0e31ebc640 1 --2- 172.21.15.79:0/1519981111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e2c107d40 0x7f0e2c10e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:41.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.103+0000 7f0e31ebc640 1 --2- 172.21.15.79:0/1519981111 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e2c1073c0 0x7f0e2c107800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:41.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.103+0000 7f0e31ebc640 1 --2- 172.21.15.79:0/1519981111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e2c1019b0 0x7f0e2c101d90 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:41.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.103+0000 7f0e31ebc640 1 -- 172.21.15.79:0/1519981111 >> 172.21.15.79:0/1519981111 conn(0x7f0e2c0fd400 msgr2=0x7f0e2c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:41.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.103+0000 7f0e31ebc640 1 -- 172.21.15.79:0/1519981111 shutdown_connections 2024-08-20T01:42:41.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.103+0000 7f0e31ebc640 1 -- 172.21.15.79:0/1519981111 wait complete. 2024-08-20T01:42:41.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.104+0000 7f0e31ebc640 1 Processor -- start 2024-08-20T01:42:41.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.104+0000 7f0e31ebc640 1 -- start start 2024-08-20T01:42:41.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.104+0000 7f0e31ebc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e2c1019b0 0x7f0e2c198fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:41.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.104+0000 7f0e31ebc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e2c1073c0 0x7f0e2c199500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:41.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.104+0000 7f0e31ebc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e2c107d40 0x7f0e2c19e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:41.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.104+0000 7f0e31ebc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2c1118b0 con 0x7f0e2c1019b0 2024-08-20T01:42:41.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.104+0000 7f0e31ebc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2c111730 con 0x7f0e2c107d40 2024-08-20T01:42:41.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.104+0000 7f0e31ebc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2c111a30 con 0x7f0e2c1073c0 2024-08-20T01:42:41.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.104+0000 7f0e2b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e2c1019b0 0x7f0e2c198fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:41.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.104+0000 7f0e2affd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e2c1073c0 0x7f0e2c199500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:41.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.104+0000 7f0e2b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e2c1019b0 0x7f0e2c198fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48100/0 (socket says 172.21.15.79:48100) 2024-08-20T01:42:41.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.104+0000 7f0e2affd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e2c1073c0 0x7f0e2c199500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:37626/0 (socket says 172.21.15.79:37626) 2024-08-20T01:42:41.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.104+0000 7f0e2b7fe640 1 -- 172.21.15.79:0/1709098530 learned_addr learned my addr 172.21.15.79:0/1709098530 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:41.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.104+0000 7f0e2bfff640 1 --2- 172.21.15.79:0/1709098530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e2c107d40 0x7f0e2c19e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:41.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.105+0000 7f0e2b7fe640 1 -- 172.21.15.79:0/1709098530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e2c1073c0 msgr2=0x7f0e2c199500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:41.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.105+0000 7f0e2b7fe640 1 --2- 172.21.15.79:0/1709098530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e2c1073c0 0x7f0e2c199500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:41.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.105+0000 7f0e2b7fe640 1 -- 172.21.15.79:0/1709098530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e2c107d40 msgr2=0x7f0e2c19e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:41.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.105+0000 7f0e2b7fe640 1 --2- 172.21.15.79:0/1709098530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e2c107d40 0x7f0e2c19e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:41.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.105+0000 7f0e2b7fe640 1 -- 172.21.15.79:0/1709098530 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e2c19f070 con 0x7f0e2c1019b0 2024-08-20T01:42:41.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.105+0000 7f0e2bfff640 1 --2- 172.21.15.79:0/1709098530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e2c107d40 0x7f0e2c19e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:42:41.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.105+0000 7f0e2b7fe640 1 --2- 172.21.15.79:0/1709098530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e2c1019b0 0x7f0e2c198fc0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c009230 tx=0x7f0e1c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:41.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.105+0000 7f0e28ff9640 1 -- 172.21.15.79:0/1709098530 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c03f030 con 0x7f0e2c1019b0 2024-08-20T01:42:41.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.105+0000 7f0e31ebc640 1 -- 172.21.15.79:0/1709098530 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e2c19f300 con 0x7f0e2c1019b0 2024-08-20T01:42:41.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.105+0000 7f0e28ff9640 1 -- 172.21.15.79:0/1709098530 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0e1c003a80 con 0x7f0e2c1019b0 2024-08-20T01:42:41.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.105+0000 7f0e28ff9640 1 -- 172.21.15.79:0/1709098530 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c035070 con 0x7f0e2c1019b0 2024-08-20T01:42:41.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.105+0000 7f0e31ebc640 1 -- 172.21.15.79:0/1709098530 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e2c1a5a20 con 0x7f0e2c1019b0 2024-08-20T01:42:41.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.108+0000 7f0e342b5740 1 Processor -- start 2024-08-20T01:42:41.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.108+0000 7f0e342b5740 1 -- start start 2024-08-20T01:42:41.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.108+0000 7f0e28ff9640 1 -- 172.21.15.79:0/1709098530 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f0e1c042030 con 0x7f0e2c1019b0 2024-08-20T01:42:41.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.108+0000 7f0e342b5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf74423830 0x55cf74423c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:41.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.108+0000 7f0e342b5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf74424150 0x55cf7442fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:41.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.108+0000 7f0e342b5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf744300e0 0x55cf744324d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:41.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.108+0000 7f0e342b5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55cf7439a8e0 con 0x55cf744300e0 2024-08-20T01:42:41.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.108+0000 7f0e342b5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55cf74389de0 con 0x55cf74424150 2024-08-20T01:42:41.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.108+0000 7f0e342b5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55cf7438de20 con 0x55cf74423830 2024-08-20T01:42:41.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.108+0000 7f0e2bfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf74423830 0x55cf74423c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:41.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.108+0000 7f0e2affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf744300e0 0x55cf744324d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:41.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.108+0000 7f0e2affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf744300e0 0x55cf744324d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48106/0 (socket says 172.21.15.79:48106) 2024-08-20T01:42:41.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.109+0000 7f0e2affd640 1 -- 172.21.15.79:0/2012249585 learned_addr learned my addr 172.21.15.79:0/2012249585 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:41.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.109+0000 7f0e2b7fe640 1 --2- 172.21.15.79:0/2012249585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf74424150 0x55cf7442fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:41.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.109+0000 7f0e2affd640 1 -- 172.21.15.79:0/2012249585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf74423830 msgr2=0x55cf74423c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:41.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.109+0000 7f0e2affd640 1 --2- 172.21.15.79:0/2012249585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf74423830 0x55cf74423c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:41.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.109+0000 7f0e2affd640 1 -- 172.21.15.79:0/2012249585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf74424150 msgr2=0x55cf7442fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:41.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.109+0000 7f0e2affd640 1 --2- 172.21.15.79:0/2012249585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf74424150 0x55cf7442fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:41.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.109+0000 7f0e2affd640 1 -- 172.21.15.79:0/2012249585 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf740e9650 con 0x55cf744300e0 2024-08-20T01:42:41.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.109+0000 7f0e2bfff640 1 --2- 172.21.15.79:0/2012249585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf74423830 0x55cf74423c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:42:41.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.109+0000 7f0e2affd640 1 --2- 172.21.15.79:0/2012249585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf744300e0 0x55cf744324d0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f0e2000b770 tx=0x7f0e2000bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=748738be6121a257 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:41.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.109+0000 7f0e28ff9640 1 --2- 172.21.15.79:0/1709098530 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0e140b3bd0 0x7f0e140b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:41.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.109+0000 7f0e11ffb640 1 -- 172.21.15.79:0/2012249585 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e20003dd0 con 0x55cf744300e0 2024-08-20T01:42:41.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.110+0000 7f0e2bfff640 1 --2- 172.21.15.79:0/1709098530 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0e140b3bd0 0x7f0e140b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:41.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.110+0000 7f0e11ffb640 1 -- 172.21.15.79:0/2012249585 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0e20015070 con 0x55cf744300e0 2024-08-20T01:42:41.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.110+0000 7f0e11ffb640 1 -- 172.21.15.79:0/2012249585 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e20004d30 con 0x55cf744300e0 2024-08-20T01:42:41.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.110+0000 7f0e28ff9640 1 -- 172.21.15.79:0/1709098530 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f0e1c103f30 con 0x7f0e2c1019b0 2024-08-20T01:42:41.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.110+0000 7f0e2bfff640 1 --2- 172.21.15.79:0/1709098530 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0e140b3bd0 0x7f0e140b6090 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0e2400a4c0 tx=0x7f0e240096f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:41.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.110+0000 7f0e342b5740 1 -- 172.21.15.79:0/2012249585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf744300e0 msgr2=0x55cf744324d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:41.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.111+0000 7f0e342b5740 1 --2- 172.21.15.79:0/2012249585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf744300e0 0x55cf744324d0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f0e2000b770 tx=0x7f0e2000bc30 comp rx=0 tx=0).stop 2024-08-20T01:42:41.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.111+0000 7f0e342b5740 1 -- 172.21.15.79:0/2012249585 shutdown_connections 2024-08-20T01:42:41.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.111+0000 7f0e342b5740 1 --2- 172.21.15.79:0/2012249585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf744300e0 0x55cf744324d0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:41.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.111+0000 7f0e342b5740 1 --2- 172.21.15.79:0/2012249585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf74424150 0x55cf7442fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:41.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.111+0000 7f0e342b5740 1 --2- 172.21.15.79:0/2012249585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf74423830 0x55cf74423c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:41.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.111+0000 7f0e342b5740 1 -- 172.21.15.79:0/2012249585 >> 172.21.15.79:0/2012249585 conn(0x55cf74421660 msgr2=0x55cf74422800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:41.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.111+0000 7f0e342b5740 1 -- 172.21.15.79:0/2012249585 shutdown_connections 2024-08-20T01:42:41.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.111+0000 7f0e342b5740 1 -- 172.21.15.79:0/2012249585 wait complete. 2024-08-20T01:42:41.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.111+0000 7f0e342b5740 1 -- start start 2024-08-20T01:42:41.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.112+0000 7f0e342b5740 1 Processor -- start 2024-08-20T01:42:41.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.112+0000 7f0e342b5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf74423830 0x55cf7442b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:41.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.112+0000 7f0e2b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf74423830 0x55cf7442b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:41.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.112+0000 7f0e2b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf74423830 0x55cf7442b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48118/0 (socket says 172.21.15.79:48118) 2024-08-20T01:42:41.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.112+0000 7f0e2b7fe640 1 -- 172.21.15.79:0/1501280815 learned_addr learned my addr 172.21.15.79:0/1501280815 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:41.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.112+0000 7f0e342b5740 1 --2- 172.21.15.79:0/1501280815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf74424150 0x55cf74427c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:41.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.112+0000 7f0e342b5740 1 --2- 172.21.15.79:0/1501280815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf744300e0 0x55cf74428240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:41.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.112+0000 7f0e342b5740 1 -- 172.21.15.79:0/1501280815 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55cf741ec700 con 0x55cf74423830 2024-08-20T01:42:41.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.112+0000 7f0e342b5740 1 -- 172.21.15.79:0/1501280815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55cf743107c0 con 0x55cf744300e0 2024-08-20T01:42:41.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.112+0000 7f0e342b5740 1 -- 172.21.15.79:0/1501280815 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55cf74432d90 con 0x55cf74424150 2024-08-20T01:42:41.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.112+0000 7f0e342b5740 10 client.0 _ll_register_callbacks cb 0x55cf743836b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:42:41.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.113+0000 7f0e2b7fe640 1 -- 172.21.15.79:0/1501280815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf74424150 msgr2=0x55cf74427c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:41.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.113+0000 7f0e2b7fe640 1 --2- 172.21.15.79:0/1501280815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf74424150 0x55cf74427c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:41.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.113+0000 7f0e2b7fe640 1 -- 172.21.15.79:0/1501280815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf744300e0 msgr2=0x55cf74428240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:41.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.113+0000 7f0e2b7fe640 1 --2- 172.21.15.79:0/1501280815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf744300e0 0x55cf74428240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:41.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.113+0000 7f0e2b7fe640 1 -- 172.21.15.79:0/1501280815 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf74444c00 con 0x55cf74423830 2024-08-20T01:42:41.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.113+0000 7f0e2b7fe640 1 --2- 172.21.15.79:0/1501280815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf74423830 0x55cf7442b820 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c006010 tx=0x7f0e1c009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c88ed7231174e0e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:41.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.113+0000 7f0e0affd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:42:41.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.113+0000 7f0e0affd640 1 -- 172.21.15.79:0/1501280815 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c049050 con 0x55cf74423830 2024-08-20T01:42:41.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.113+0000 7f0e342b5740 1 -- 172.21.15.79:0/1501280815 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cf74339100 con 0x55cf74423830 2024-08-20T01:42:41.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.113+0000 7f0e0affd640 1 -- 172.21.15.79:0/1501280815 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f0e1c0c7120 con 0x55cf74423830 2024-08-20T01:42:41.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.113+0000 7f0e0affd640 1 -- 172.21.15.79:0/1501280815 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f0e1c0ca600 con 0x55cf74423830 2024-08-20T01:42:41.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.113+0000 7f0e342b5740 10 client.17187 fetch_fsmap learned FSMap version 38 2024-08-20T01:42:41.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.113+0000 7f0e342b5740 1 -- 172.21.15.79:0/1501280815 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55cf744473a0 con 0x55cf74423830 2024-08-20T01:42:41.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.113+0000 7f0e0affd640 1 -- 172.21.15.79:0/1501280815 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55cf74339100 con 0x55cf74423830 2024-08-20T01:42:41.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.114+0000 7f0e0affd640 1 -- 172.21.15.79:0/1501280815 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f0e1c0cf020 con 0x55cf74423830 2024-08-20T01:42:41.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.114+0000 7f0e342b5740 10 client.17187 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:42:41.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.114+0000 7f0e342b5740 10 client.17187 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:42:41.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.114+0000 7f0e342b5740 20 client.17187 populate_metadata read hostname 'smithi079' 2024-08-20T01:42:41.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.114+0000 7f0e342b5740 1 --2- 172.21.15.79:0/1501280815 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55cf744488b0 0x55cf7444ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:41.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.114+0000 7f0e342b5740 4 client.17187 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:42:41.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.114+0000 7f0e342b5740 1 -- 172.21.15.79:0/1501280815 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cf7439c830 con 0x55cf744488b0 2024-08-20T01:42:41.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.114+0000 7f0e2affd640 1 --2- 172.21.15.79:0/1501280815 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55cf744488b0 0x55cf7444ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:41.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.115+0000 7f0e2affd640 1 --2- 172.21.15.79:0/1501280815 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55cf744488b0 0x55cf7444ad50 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eac468d15e6d4402 server_cookie=fa8120947d033b84 in_seq=0 out_seq=0 2024-08-20T01:42:41.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.115+0000 7f0e0affd640 10 client.17187 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:42:41.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.116+0000 7f0e0affd640 1 -- 172.21.15.79:0/1501280815 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cf7439c830 con 0x55cf744488b0 2024-08-20T01:42:41.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.116+0000 7f0e0affd640 10 client.17187 handle_command_reply: tid=0 2024-08-20T01:42:41.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.116+0000 7f0e342b5740 1 client.17187 shutdown 2024-08-20T01:42:41.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.116+0000 7f0e342b5740 1 -- 172.21.15.79:0/1501280815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf74423830 msgr2=0x55cf7442b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:41.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.116+0000 7f0e342b5740 1 --2- 172.21.15.79:0/1501280815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf74423830 0x55cf7442b820 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c006010 tx=0x7f0e1c009620 comp rx=0 tx=0).stop 2024-08-20T01:42:41.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.116+0000 7f0e342b5740 1 -- 172.21.15.79:0/1501280815 shutdown_connections 2024-08-20T01:42:41.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.116+0000 7f0e342b5740 1 --2- 172.21.15.79:0/1501280815 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55cf744488b0 0x55cf7444ad50 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:41.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.116+0000 7f0e342b5740 1 --2- 172.21.15.79:0/1501280815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf744300e0 0x55cf74428240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:41.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.116+0000 7f0e342b5740 1 --2- 172.21.15.79:0/1501280815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf74424150 0x55cf74427c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:41.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.116+0000 7f0e342b5740 1 --2- 172.21.15.79:0/1501280815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf74423830 0x55cf7442b820 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:41.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.116+0000 7f0e342b5740 1 -- 172.21.15.79:0/1501280815 >> 172.21.15.79:0/1501280815 conn(0x55cf74421660 msgr2=0x55cf74427200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:41.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.116+0000 7f0e0affd640 0 client.17187 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:42:41.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.116+0000 7f0e342b5740 1 -- 172.21.15.79:0/1501280815 shutdown_connections 2024-08-20T01:42:41.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.116+0000 7f0e342b5740 1 -- 172.21.15.79:0/1501280815 wait complete. 2024-08-20T01:42:41.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.116+0000 7f0e342b5740 20 client.17187 trim_cache size 0 max 16384 2024-08-20T01:42:41.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.134+0000 7f0e342b5740 1 Processor -- start 2024-08-20T01:42:41.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.134+0000 7f0e342b5740 1 -- start start 2024-08-20T01:42:41.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.134+0000 7f0e342b5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf74423830 0x55cf74422440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:41.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.134+0000 7f0e342b5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf74424150 0x55cf74422980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:41.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.134+0000 7f0e342b5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf744300e0 0x55cf74450660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:41.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.134+0000 7f0e342b5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1800e430 con 0x55cf744300e0 2024-08-20T01:42:41.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.134+0000 7f0e342b5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1800ff70 con 0x55cf74424150 2024-08-20T01:42:41.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.134+0000 7f0e342b5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1800eb00 con 0x55cf74423830 2024-08-20T01:42:41.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.134+0000 7f0e2bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf744300e0 0x55cf74450660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:41.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.134+0000 7f0e2bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf744300e0 0x55cf74450660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48122/0 (socket says 172.21.15.79:48122) 2024-08-20T01:42:41.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.134+0000 7f0e2bfff640 1 -- 172.21.15.79:0/3032432526 learned_addr learned my addr 172.21.15.79:0/3032432526 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:41.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.134+0000 7f0e2affd640 1 --2- 172.21.15.79:0/3032432526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf74424150 0x55cf74422980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:41.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.134+0000 7f0e2b7fe640 1 --2- 172.21.15.79:0/3032432526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf74423830 0x55cf74422440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:41.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.135+0000 7f0e2bfff640 1 -- 172.21.15.79:0/3032432526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf74423830 msgr2=0x55cf74422440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:41.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.135+0000 7f0e2bfff640 1 --2- 172.21.15.79:0/3032432526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf74423830 0x55cf74422440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:41.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.135+0000 7f0e2bfff640 1 -- 172.21.15.79:0/3032432526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf74424150 msgr2=0x55cf74422980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:41.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.135+0000 7f0e2bfff640 1 --2- 172.21.15.79:0/3032432526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf74424150 0x55cf74422980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:41.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.135+0000 7f0e2bfff640 1 -- 172.21.15.79:0/3032432526 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf744285b0 con 0x55cf744300e0 2024-08-20T01:42:41.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.135+0000 7f0e2affd640 1 --2- 172.21.15.79:0/3032432526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf74424150 0x55cf74422980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:42:41.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.135+0000 7f0e2bfff640 1 --2- 172.21.15.79:0/3032432526 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf744300e0 0x55cf74450660 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f0e2401a880 tx=0x7f0e2400e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=677ed0264f2d4f63 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:41.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.135+0000 7f0e117fa640 1 -- 172.21.15.79:0/3032432526 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e2401a2e0 con 0x55cf744300e0 2024-08-20T01:42:41.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.135+0000 7f0e117fa640 1 -- 172.21.15.79:0/3032432526 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0e240188a0 con 0x55cf744300e0 2024-08-20T01:42:41.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.135+0000 7f0e117fa640 1 -- 172.21.15.79:0/3032432526 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e24023800 con 0x55cf744300e0 2024-08-20T01:42:41.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.136+0000 7f0e342b5740 1 -- 172.21.15.79:0/3032432526 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf744300e0 msgr2=0x55cf74450660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:41.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.136+0000 7f0e342b5740 1 --2- 172.21.15.79:0/3032432526 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf744300e0 0x55cf74450660 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f0e2401a880 tx=0x7f0e2400e050 comp rx=0 tx=0).stop 2024-08-20T01:42:41.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.136+0000 7f0e342b5740 1 -- 172.21.15.79:0/3032432526 shutdown_connections 2024-08-20T01:42:41.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.136+0000 7f0e342b5740 1 --2- 172.21.15.79:0/3032432526 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf744300e0 0x55cf74450660 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:41.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.136+0000 7f0e342b5740 1 --2- 172.21.15.79:0/3032432526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf74424150 0x55cf74422980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:41.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.136+0000 7f0e342b5740 1 --2- 172.21.15.79:0/3032432526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf74423830 0x55cf74422440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:41.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.136+0000 7f0e342b5740 1 -- 172.21.15.79:0/3032432526 >> 172.21.15.79:0/3032432526 conn(0x55cf74421660 msgr2=0x55cf7442c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:41.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.136+0000 7f0e342b5740 1 -- 172.21.15.79:0/3032432526 shutdown_connections 2024-08-20T01:42:41.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.136+0000 7f0e342b5740 1 -- 172.21.15.79:0/3032432526 wait complete. 2024-08-20T01:42:41.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.136+0000 7f0e342b5740 1 -- start start 2024-08-20T01:42:41.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.137+0000 7f0e342b5740 1 Processor -- start 2024-08-20T01:42:41.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.137+0000 7f0e342b5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf74423830 0x55cf74442400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:41.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.137+0000 7f0e342b5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf74424150 0x55cf7443e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:41.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.137+0000 7f0e342b5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf744300e0 0x55cf7443ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:41.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.137+0000 7f0e342b5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1800f8a0 con 0x55cf74423830 2024-08-20T01:42:41.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.137+0000 7f0e342b5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1800f1d0 con 0x55cf744300e0 2024-08-20T01:42:41.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.137+0000 7f0e342b5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1800c410 con 0x55cf74424150 2024-08-20T01:42:41.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.137+0000 7f0e342b5740 10 client.0 _ll_register_callbacks cb 0x7f0e1c107910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:42:41.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.137+0000 7f0e2b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf74423830 0x55cf74442400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:41.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.137+0000 7f0e2b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf74423830 0x55cf74442400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48128/0 (socket says 172.21.15.79:48128) 2024-08-20T01:42:41.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.137+0000 7f0e2b7fe640 1 -- 172.21.15.79:0/122588449 learned_addr learned my addr 172.21.15.79:0/122588449 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:41.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.137+0000 7f0e2affd640 1 --2- 172.21.15.79:0/122588449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf74424150 0x55cf7443e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:41.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.137+0000 7f0e2bfff640 1 --2- 172.21.15.79:0/122588449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf744300e0 0x55cf7443ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:41.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.137+0000 7f0e2b7fe640 1 -- 172.21.15.79:0/122588449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf74424150 msgr2=0x55cf7443e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:41.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.137+0000 7f0e2b7fe640 1 --2- 172.21.15.79:0/122588449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf74424150 0x55cf7443e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:41.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.137+0000 7f0e2b7fe640 1 -- 172.21.15.79:0/122588449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf744300e0 msgr2=0x55cf7443ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:41.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.137+0000 7f0e2b7fe640 1 --2- 172.21.15.79:0/122588449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf744300e0 0x55cf7443ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:41.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.137+0000 7f0e2b7fe640 1 -- 172.21.15.79:0/122588449 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf74423f80 con 0x55cf74423830 2024-08-20T01:42:41.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.138+0000 7f0e2b7fe640 1 --2- 172.21.15.79:0/122588449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf74423830 0x55cf74442400 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c0caf30 tx=0x7f0e1c003e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c87d918035dd0eb server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:41.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.138+0000 7f0e0affd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:42:41.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.138+0000 7f0e0affd640 1 -- 172.21.15.79:0/122588449 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c049050 con 0x55cf74423830 2024-08-20T01:42:41.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.138+0000 7f0e0affd640 1 -- 172.21.15.79:0/122588449 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f0e1c0d3cc0 con 0x55cf74423830 2024-08-20T01:42:41.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.138+0000 7f0e342b5740 1 -- 172.21.15.79:0/122588449 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e240188a0 con 0x55cf74423830 2024-08-20T01:42:41.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.138+0000 7f0e0affd640 1 -- 172.21.15.79:0/122588449 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f0e1c0ca9a0 con 0x55cf74423830 2024-08-20T01:42:41.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.138+0000 7f0e342b5740 10 client.17193 fetch_fsmap learned FSMap version 38 2024-08-20T01:42:41.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.138+0000 7f0e342b5740 1 -- 172.21.15.79:0/122588449 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55cf744b2640 con 0x55cf74423830 2024-08-20T01:42:41.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.138+0000 7f0e0affd640 1 -- 172.21.15.79:0/122588449 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0e240188a0 con 0x55cf74423830 2024-08-20T01:42:41.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.138+0000 7f0e0affd640 1 -- 172.21.15.79:0/122588449 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f0e1c0cf040 con 0x55cf74423830 2024-08-20T01:42:41.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.139+0000 7f0e342b5740 10 client.17193 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:42:41.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.139+0000 7f0e342b5740 10 client.17193 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:42:41.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.139+0000 7f0e342b5740 20 client.17193 populate_metadata read hostname 'smithi079' 2024-08-20T01:42:41.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.139+0000 7f0e342b5740 1 --2- 172.21.15.79:0/122588449 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55cf744b2c20 0x55cf744b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:41.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.139+0000 7f0e342b5740 4 client.17193 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:42:41.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.139+0000 7f0e342b5740 1 -- 172.21.15.79:0/122588449 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cf743982d0 con 0x55cf744b2c20 2024-08-20T01:42:41.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.139+0000 7f0e2affd640 1 --2- 172.21.15.79:0/122588449 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55cf744b2c20 0x55cf744b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:41.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.139+0000 7f0e0affd640 10 client.17193 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:42:41.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.139+0000 7f0e2affd640 1 --2- 172.21.15.79:0/122588449 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55cf744b2c20 0x55cf744b5040 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1f8cf1983e951bd server_cookie=64ba69de82112562 in_seq=0 out_seq=0 2024-08-20T01:42:41.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.140+0000 7f0e0affd640 1 -- 172.21.15.79:0/122588449 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55cf743982d0 con 0x55cf744b2c20 2024-08-20T01:42:41.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.140+0000 7f0e0affd640 10 client.17193 handle_command_reply: tid=0 2024-08-20T01:42:41.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.140+0000 7f0e342b5740 1 client.17193 shutdown 2024-08-20T01:42:41.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.140+0000 7f0e342b5740 1 -- 172.21.15.79:0/122588449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf74423830 msgr2=0x55cf74442400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:41.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.140+0000 7f0e342b5740 1 --2- 172.21.15.79:0/122588449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf74423830 0x55cf74442400 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c0caf30 tx=0x7f0e1c003e60 comp rx=0 tx=0).stop 2024-08-20T01:42:41.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.140+0000 7f0e342b5740 1 -- 172.21.15.79:0/122588449 shutdown_connections 2024-08-20T01:42:41.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.140+0000 7f0e342b5740 1 --2- 172.21.15.79:0/122588449 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55cf744b2c20 0x55cf744b5040 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:41.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.140+0000 7f0e342b5740 1 --2- 172.21.15.79:0/122588449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf744300e0 0x55cf7443ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:41.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.140+0000 7f0e342b5740 1 --2- 172.21.15.79:0/122588449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf74424150 0x55cf7443e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:41.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.140+0000 7f0e0affd640 0 client.17193 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:42:41.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.140+0000 7f0e342b5740 1 --2- 172.21.15.79:0/122588449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cf74423830 0x55cf74442400 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:41.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.140+0000 7f0e342b5740 1 -- 172.21.15.79:0/122588449 >> 172.21.15.79:0/122588449 conn(0x55cf74421660 msgr2=0x55cf74422440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:41.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.140+0000 7f0e342b5740 1 -- 172.21.15.79:0/122588449 shutdown_connections 2024-08-20T01:42:41.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.140+0000 7f0e342b5740 1 -- 172.21.15.79:0/122588449 wait complete. 2024-08-20T01:42:41.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.140+0000 7f0e342b5740 20 client.17193 trim_cache size 0 max 16384 2024-08-20T01:42:41.148 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:42:41.148 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-20T01:42:41.149 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": { 2024-08-20T01:42:41.149 INFO:teuthology.orchestra.run.smithi079.stdout: "df0ea2ec-ecb6-420c-8e72-4073cf1d8e74": { 2024-08-20T01:42:41.149 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/", 2024-08-20T01:42:41.149 INFO:teuthology.orchestra.run.smithi079.stdout: "tag": "df0ea2ec-ecb6-420c-8e72-4073cf1d8e74", 2024-08-20T01:42:41.149 INFO:teuthology.orchestra.run.smithi079.stdout: "options": "recursive,force" 2024-08-20T01:42:41.149 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:42:41.149 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:42:41.149 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:42:41.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.141+0000 7f0e31ebc640 1 -- 172.21.15.79:0/1709098530 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0e140b3bd0 msgr2=0x7f0e140b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:41.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.141+0000 7f0e31ebc640 1 --2- 172.21.15.79:0/1709098530 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0e140b3bd0 0x7f0e140b6090 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0e2400a4c0 tx=0x7f0e240096f0 comp rx=0 tx=0).stop 2024-08-20T01:42:41.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.141+0000 7f0e31ebc640 1 -- 172.21.15.79:0/1709098530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e2c1019b0 msgr2=0x7f0e2c198fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:41.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.141+0000 7f0e31ebc640 1 --2- 172.21.15.79:0/1709098530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e2c1019b0 0x7f0e2c198fc0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c009230 tx=0x7f0e1c004270 comp rx=0 tx=0).stop 2024-08-20T01:42:41.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.141+0000 7f0e31ebc640 1 -- 172.21.15.79:0/1709098530 shutdown_connections 2024-08-20T01:42:41.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.141+0000 7f0e31ebc640 1 --2- 172.21.15.79:0/1709098530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e2c107d40 0x7f0e2c19e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:41.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.141+0000 7f0e31ebc640 1 --2- 172.21.15.79:0/1709098530 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0e140b3bd0 0x7f0e140b6090 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:41.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.141+0000 7f0e31ebc640 1 --2- 172.21.15.79:0/1709098530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e2c1073c0 0x7f0e2c199500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:41.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.141+0000 7f0e31ebc640 1 --2- 172.21.15.79:0/1709098530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e2c1019b0 0x7f0e2c198fc0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:41.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.141+0000 7f0e31ebc640 1 -- 172.21.15.79:0/1709098530 >> 172.21.15.79:0/1709098530 conn(0x7f0e2c0fd400 msgr2=0x7f0e2c06b510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:41.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.141+0000 7f0e31ebc640 1 -- 172.21.15.79:0/1709098530 shutdown_connections 2024-08-20T01:42:41.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:42:41.141+0000 7f0e31ebc640 1 -- 172.21.15.79:0/1709098530 wait complete. 2024-08-20T01:42:42.093 INFO:tasks.cephfs.filesystem:scrub status for tag:df0ea2ec-ecb6-420c-8e72-4073cf1d8e74 - {'path': '/', 'tag': 'df0ea2ec-ecb6-420c-8e72-4073cf1d8e74', 'options': 'recursive,force'} 2024-08-20T01:42:42.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:42 smithi079 ceph-mon[18656]: pgmap v508: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 27 MiB/s wr, 28 op/s 2024-08-20T01:42:42.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:42 smithi175 ceph-mon[22392]: pgmap v508: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 27 MiB/s wr, 28 op/s 2024-08-20T01:42:42.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:42 smithi081 ceph-mon[22209]: pgmap v508: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 27 MiB/s wr, 28 op/s 2024-08-20T01:42:44.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:44 smithi175 ceph-mon[22392]: pgmap v509: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 MiB/s wr, 35 op/s 2024-08-20T01:42:44.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:44 smithi079 ceph-mon[18656]: pgmap v509: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 MiB/s wr, 35 op/s 2024-08-20T01:42:44.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:44 smithi081 ceph-mon[22209]: pgmap v509: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 MiB/s wr, 35 op/s 2024-08-20T01:42:46.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:46 smithi175 ceph-mon[22392]: pgmap v510: 97 pgs: 97 active+clean; 7.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 29 MiB/s wr, 50 op/s 2024-08-20T01:42:46.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:46 smithi079 ceph-mon[18656]: pgmap v510: 97 pgs: 97 active+clean; 7.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 29 MiB/s wr, 50 op/s 2024-08-20T01:42:46.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:46 smithi081 ceph-mon[22209]: pgmap v510: 97 pgs: 97 active+clean; 7.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 29 MiB/s wr, 50 op/s 2024-08-20T01:42:48.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:48 smithi175 ceph-mon[22392]: pgmap v511: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 29 MiB/s wr, 48 op/s 2024-08-20T01:42:48.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:48 smithi079 ceph-mon[18656]: pgmap v511: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 29 MiB/s wr, 48 op/s 2024-08-20T01:42:48.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:48 smithi081 ceph-mon[22209]: pgmap v511: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 29 MiB/s wr, 48 op/s 2024-08-20T01:42:50.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:50 smithi175 ceph-mon[22392]: pgmap v512: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 30 MiB/s wr, 51 op/s 2024-08-20T01:42:50.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:50 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:42:50.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:50 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:42:50.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:50 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:42:50.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:50 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:42:50.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:50 smithi079 ceph-mon[18656]: pgmap v512: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 30 MiB/s wr, 51 op/s 2024-08-20T01:42:50.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:50 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:42:50.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:50 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:42:50.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:50 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:42:50.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:50 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:42:50.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:50 smithi081 ceph-mon[22209]: pgmap v512: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 30 MiB/s wr, 51 op/s 2024-08-20T01:42:50.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:50 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:42:50.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:50 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:42:50.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:50 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:42:50.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:50 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:42:52.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:52 smithi175 ceph-mon[22392]: pgmap v513: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 29 MiB/s wr, 48 op/s 2024-08-20T01:42:52.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:52 smithi079 ceph-mon[18656]: pgmap v513: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 29 MiB/s wr, 48 op/s 2024-08-20T01:42:52.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:52 smithi081 ceph-mon[22209]: pgmap v513: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 29 MiB/s wr, 48 op/s 2024-08-20T01:42:53.772 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.767+0000 7fcc8b12a640 1 -- 172.21.15.79:0/4104572722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc841026b0 msgr2=0x7fcc84102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:53.772 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.767+0000 7fcc8b12a640 1 --2- 172.21.15.79:0/4104572722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc841026b0 0x7fcc84102b30 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fcc74009930 tx=0x7fcc7402a420 comp rx=0 tx=0).stop 2024-08-20T01:42:53.772 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.767+0000 7fcc8b12a640 1 -- 172.21.15.79:0/4104572722 shutdown_connections 2024-08-20T01:42:53.773 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.767+0000 7fcc8b12a640 1 --2- 172.21.15.79:0/4104572722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc84103070 0x7fcc841099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:53.773 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.767+0000 7fcc8b12a640 1 --2- 172.21.15.79:0/4104572722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc841026b0 0x7fcc84102b30 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:53.773 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.767+0000 7fcc8b12a640 1 --2- 172.21.15.79:0/4104572722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc84101560 0x7fcc84101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:53.773 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.767+0000 7fcc8b12a640 1 -- 172.21.15.79:0/4104572722 >> 172.21.15.79:0/4104572722 conn(0x7fcc840fce40 msgr2=0x7fcc840ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:53.773 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.767+0000 7fcc8b12a640 1 -- 172.21.15.79:0/4104572722 shutdown_connections 2024-08-20T01:42:53.773 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.767+0000 7fcc8b12a640 1 -- 172.21.15.79:0/4104572722 wait complete. 2024-08-20T01:42:53.773 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.768+0000 7fcc8b12a640 1 Processor -- start 2024-08-20T01:42:53.773 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.768+0000 7fcc8b12a640 1 -- start start 2024-08-20T01:42:53.773 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.768+0000 7fcc8b12a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc84101560 0x7fcc84198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:53.773 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.768+0000 7fcc8b12a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc841026b0 0x7fcc84198fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:53.773 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.768+0000 7fcc8b12a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc84103070 0x7fcc84199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:53.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.768+0000 7fcc8b12a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcc8410d080 con 0x7fcc84103070 2024-08-20T01:42:53.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.768+0000 7fcc8b12a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcc8410cf00 con 0x7fcc84101560 2024-08-20T01:42:53.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.768+0000 7fcc8b12a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcc8410d200 con 0x7fcc841026b0 2024-08-20T01:42:53.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.768+0000 7fcc896c7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc84103070 0x7fcc84199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:53.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.768+0000 7fcc7bfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc841026b0 0x7fcc84198fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:53.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.768+0000 7fcc896c7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc84103070 0x7fcc84199c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42864/0 (socket says 172.21.15.79:42864) 2024-08-20T01:42:53.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.768+0000 7fcc896c7640 1 -- 172.21.15.79:0/1456476661 learned_addr learned my addr 172.21.15.79:0/1456476661 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:53.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.768+0000 7fcc88ec6640 1 --2- 172.21.15.79:0/1456476661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc84101560 0x7fcc84198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:53.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.769+0000 7fcc896c7640 1 -- 172.21.15.79:0/1456476661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc841026b0 msgr2=0x7fcc84198fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:53.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.769+0000 7fcc896c7640 1 --2- 172.21.15.79:0/1456476661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc841026b0 0x7fcc84198fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:53.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.769+0000 7fcc896c7640 1 -- 172.21.15.79:0/1456476661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc84101560 msgr2=0x7fcc84198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:53.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.769+0000 7fcc896c7640 1 --2- 172.21.15.79:0/1456476661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc84101560 0x7fcc84198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:53.775 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.769+0000 7fcc896c7640 1 -- 172.21.15.79:0/1456476661 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc8419a4d0 con 0x7fcc84103070 2024-08-20T01:42:53.775 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.769+0000 7fcc88ec6640 1 --2- 172.21.15.79:0/1456476661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc84101560 0x7fcc84198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:42:53.775 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.769+0000 7fcc896c7640 1 --2- 172.21.15.79:0/1456476661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc84103070 0x7fcc84199c10 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c00eb10 tx=0x7fcc7c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:53.775 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.769+0000 7fcc79ffb640 1 -- 172.21.15.79:0/1456476661 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c004b20 con 0x7fcc84103070 2024-08-20T01:42:53.775 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.769+0000 7fcc79ffb640 1 -- 172.21.15.79:0/1456476661 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc7c004cc0 con 0x7fcc84103070 2024-08-20T01:42:53.775 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.769+0000 7fcc8b12a640 1 -- 172.21.15.79:0/1456476661 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc8419a7c0 con 0x7fcc84103070 2024-08-20T01:42:53.775 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.769+0000 7fcc79ffb640 1 -- 172.21.15.79:0/1456476661 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c010690 con 0x7fcc84103070 2024-08-20T01:42:53.775 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.769+0000 7fcc8b12a640 1 -- 172.21.15.79:0/1456476661 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc841a0e90 con 0x7fcc84103070 2024-08-20T01:42:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.772+0000 7fcc8dff5740 1 Processor -- start 2024-08-20T01:42:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.772+0000 7fcc79ffb640 1 -- 172.21.15.79:0/1456476661 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fcc7c005020 con 0x7fcc84103070 2024-08-20T01:42:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.772+0000 7fcc8dff5740 1 -- start start 2024-08-20T01:42:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.773+0000 7fcc8dff5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e30ad2630 0x558e30ad4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.773+0000 7fcc8dff5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e30ad4f60 0x558e30ad7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.773+0000 7fcc8dff5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e30ad79a0 0x558e30ad9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.773+0000 7fcc8dff5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558e30a45360 con 0x558e30ad79a0 2024-08-20T01:42:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.773+0000 7fcc8dff5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558e30a34860 con 0x558e30ad4f60 2024-08-20T01:42:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.773+0000 7fcc8dff5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558e30a388a0 con 0x558e30ad2630 2024-08-20T01:42:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.773+0000 7fcc7bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e30ad79a0 0x558e30ad9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.773+0000 7fcc7bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e30ad79a0 0x558e30ad9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42876/0 (socket says 172.21.15.79:42876) 2024-08-20T01:42:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.773+0000 7fcc7bfff640 1 -- 172.21.15.79:0/3549271720 learned_addr learned my addr 172.21.15.79:0/3549271720 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.773+0000 7fcc88ec6640 1 --2- 172.21.15.79:0/3549271720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e30ad4f60 0x558e30ad7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.773+0000 7fcc7bfff640 1 --2- 172.21.15.79:0/3549271720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e30ad2630 0x558e30ad4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.773+0000 7fcc88ec6640 1 -- 172.21.15.79:0/3549271720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e30ad2630 msgr2=0x558e30ad4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.773+0000 7fcc88ec6640 1 --2- 172.21.15.79:0/3549271720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e30ad2630 0x558e30ad4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.773+0000 7fcc88ec6640 1 -- 172.21.15.79:0/3549271720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e30ad79a0 msgr2=0x558e30ad9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.773+0000 7fcc88ec6640 1 --2- 172.21.15.79:0/3549271720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e30ad79a0 0x558e30ad9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.773+0000 7fcc88ec6640 1 -- 172.21.15.79:0/3549271720 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e309dbe40 con 0x558e30ad4f60 2024-08-20T01:42:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.773+0000 7fcc7bfff640 1 --2- 172.21.15.79:0/3549271720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e30ad79a0 0x558e30ad9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:42:53.784 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.773+0000 7fcc79ffb640 1 --2- 172.21.15.79:0/1456476661 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fcc6c0b3bd0 0x7fcc6c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:53.784 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.773+0000 7fcc7bfff640 1 --2- 172.21.15.79:0/1456476661 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fcc6c0b3bd0 0x7fcc6c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:53.784 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.773+0000 7fcc88ec6640 1 --2- 172.21.15.79:0/3549271720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e30ad4f60 0x558e30ad7350 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcc80009fd0 tx=0x7fcc800118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=948d412f39351ab server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:53.784 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.773+0000 7fcc79ffb640 1 -- 172.21.15.79:0/1456476661 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fcc7c0e4140 con 0x7fcc84103070 2024-08-20T01:42:53.784 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.774+0000 7fcc6affd640 1 -- 172.21.15.79:0/3549271720 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc80004030 con 0x558e30ad4f60 2024-08-20T01:42:53.784 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.774+0000 7fcc6affd640 1 -- 172.21.15.79:0/3549271720 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc80005020 con 0x558e30ad4f60 2024-08-20T01:42:53.784 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.774+0000 7fcc6affd640 1 -- 172.21.15.79:0/3549271720 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc80004ad0 con 0x558e30ad4f60 2024-08-20T01:42:53.784 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.774+0000 7fcc8dff5740 1 -- 172.21.15.79:0/3549271720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e30ad4f60 msgr2=0x558e30ad7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:53.784 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.774+0000 7fcc7bfff640 1 --2- 172.21.15.79:0/1456476661 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fcc6c0b3bd0 0x7fcc6c0b6090 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fcc74006010 tx=0x7fcc740046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:53.784 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.774+0000 7fcc8dff5740 1 --2- 172.21.15.79:0/3549271720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e30ad4f60 0x558e30ad7350 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcc80009fd0 tx=0x7fcc800118d0 comp rx=0 tx=0).stop 2024-08-20T01:42:53.784 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.774+0000 7fcc8dff5740 1 -- 172.21.15.79:0/3549271720 shutdown_connections 2024-08-20T01:42:53.784 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.774+0000 7fcc8dff5740 1 --2- 172.21.15.79:0/3549271720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e30ad79a0 0x558e30ad9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:53.784 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.775+0000 7fcc8dff5740 1 --2- 172.21.15.79:0/3549271720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e30ad4f60 0x558e30ad7350 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.775+0000 7fcc8dff5740 1 --2- 172.21.15.79:0/3549271720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e30ad2630 0x558e30ad4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.775+0000 7fcc8dff5740 1 -- 172.21.15.79:0/3549271720 >> 172.21.15.79:0/3549271720 conn(0x558e30acd730 msgr2=0x558e30ace510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.775+0000 7fcc8dff5740 1 -- 172.21.15.79:0/3549271720 shutdown_connections 2024-08-20T01:42:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.775+0000 7fcc8dff5740 1 -- 172.21.15.79:0/3549271720 wait complete. 2024-08-20T01:42:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.775+0000 7fcc8dff5740 1 -- start start 2024-08-20T01:42:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.775+0000 7fcc8dff5740 1 Processor -- start 2024-08-20T01:42:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.775+0000 7fcc8dff5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e30ad2630 0x558e30adbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.775+0000 7fcc8dff5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e30ad4f60 0x558e30adc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.775+0000 7fcc8dff5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e30ad79a0 0x558e30add040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.775+0000 7fcc8dff5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558e3096dab0 con 0x558e30ad2630 2024-08-20T01:42:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.775+0000 7fcc8dff5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558e309bb780 con 0x558e30ad4f60 2024-08-20T01:42:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.775+0000 7fcc8dff5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558e30ada980 con 0x558e30ad79a0 2024-08-20T01:42:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.775+0000 7fcc8dff5740 10 client.0 _ll_register_callbacks cb 0x558e30743a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:42:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.776+0000 7fcc88ec6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e30ad2630 0x558e30adbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.776+0000 7fcc7bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e30ad4f60 0x558e30adc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.776+0000 7fcc88ec6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e30ad2630 0x558e30adbdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42892/0 (socket says 172.21.15.79:42892) 2024-08-20T01:42:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.776+0000 7fcc88ec6640 1 -- 172.21.15.79:0/604524790 learned_addr learned my addr 172.21.15.79:0/604524790 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.776+0000 7fcc896c7640 1 --2- 172.21.15.79:0/604524790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e30ad79a0 0x558e30add040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.776+0000 7fcc7bfff640 1 -- 172.21.15.79:0/604524790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e30ad79a0 msgr2=0x558e30add040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.776+0000 7fcc7bfff640 1 --2- 172.21.15.79:0/604524790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e30ad79a0 0x558e30add040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.776+0000 7fcc7bfff640 1 -- 172.21.15.79:0/604524790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e30ad2630 msgr2=0x558e30adbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.776+0000 7fcc7bfff640 1 --2- 172.21.15.79:0/604524790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e30ad2630 0x558e30adbdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.776+0000 7fcc7bfff640 1 -- 172.21.15.79:0/604524790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e30797790 con 0x558e30ad4f60 2024-08-20T01:42:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.776+0000 7fcc88ec6640 1 --2- 172.21.15.79:0/604524790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e30ad2630 0x558e30adbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:42:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.776+0000 7fcc896c7640 1 --2- 172.21.15.79:0/604524790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e30ad79a0 0x558e30add040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:42:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.776+0000 7fcc7bfff640 1 --2- 172.21.15.79:0/604524790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e30ad4f60 0x558e30adc470 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcc74000c00 tx=0x7fcc74031400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a1ec8deedb0dbf7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.776+0000 7fcc63fff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:42:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.776+0000 7fcc63fff640 1 -- 172.21.15.79:0/604524790 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc74035040 con 0x558e30ad4f60 2024-08-20T01:42:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.776+0000 7fcc8dff5740 1 -- 172.21.15.79:0/604524790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558e309e3e00 con 0x558e30ad4f60 2024-08-20T01:42:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.776+0000 7fcc63fff640 1 -- 172.21.15.79:0/604524790 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fcc74003a00 con 0x558e30ad4f60 2024-08-20T01:42:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.777+0000 7fcc63fff640 1 -- 172.21.15.79:0/604524790 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fcc74003c00 con 0x558e30ad4f60 2024-08-20T01:42:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.777+0000 7fcc8dff5740 10 client.26324 fetch_fsmap learned FSMap version 38 2024-08-20T01:42:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.777+0000 7fcc8dff5740 1 -- 172.21.15.79:0/604524790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x558e30810620 con 0x558e30ad4f60 2024-08-20T01:42:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.777+0000 7fcc63fff640 1 -- 172.21.15.79:0/604524790 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x558e309e3e00 con 0x558e30ad4f60 2024-08-20T01:42:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.777+0000 7fcc63fff640 1 -- 172.21.15.79:0/604524790 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7fcc74047030 con 0x558e30ad4f60 2024-08-20T01:42:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.777+0000 7fcc8dff5740 10 client.26324 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:42:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.777+0000 7fcc8dff5740 10 client.26324 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:42:53.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.777+0000 7fcc8dff5740 20 client.26324 populate_metadata read hostname 'smithi079' 2024-08-20T01:42:53.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.777+0000 7fcc8dff5740 1 --2- 172.21.15.79:0/604524790 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558e30ae7660 0x558e30ae9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:53.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.777+0000 7fcc8dff5740 4 client.26324 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:42:53.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.777+0000 7fcc8dff5740 1 -- 172.21.15.79:0/604524790 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e30a472b0 con 0x558e30ae7660 2024-08-20T01:42:53.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.777+0000 7fcc88ec6640 1 --2- 172.21.15.79:0/604524790 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558e30ae7660 0x558e30ae9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:53.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.778+0000 7fcc63fff640 10 client.26324 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:42:53.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.778+0000 7fcc88ec6640 1 --2- 172.21.15.79:0/604524790 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558e30ae7660 0x558e30ae9ab0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e762658a3c7b629 server_cookie=fd1a45a31b3ea185 in_seq=0 out_seq=0 2024-08-20T01:42:53.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.778+0000 7fcc63fff640 1 -- 172.21.15.79:0/604524790 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558e30a472b0 con 0x558e30ae7660 2024-08-20T01:42:53.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.778+0000 7fcc63fff640 10 client.26324 handle_command_reply: tid=0 2024-08-20T01:42:53.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.778+0000 7fcc8dff5740 1 client.26324 shutdown 2024-08-20T01:42:53.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.778+0000 7fcc8dff5740 1 -- 172.21.15.79:0/604524790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e30ad4f60 msgr2=0x558e30adc470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:53.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.778+0000 7fcc8dff5740 1 --2- 172.21.15.79:0/604524790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e30ad4f60 0x558e30adc470 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcc74000c00 tx=0x7fcc74031400 comp rx=0 tx=0).stop 2024-08-20T01:42:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.778+0000 7fcc8dff5740 1 -- 172.21.15.79:0/604524790 shutdown_connections 2024-08-20T01:42:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.778+0000 7fcc8dff5740 1 --2- 172.21.15.79:0/604524790 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558e30ae7660 0x558e30ae9ab0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.778+0000 7fcc8dff5740 1 --2- 172.21.15.79:0/604524790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e30ad79a0 0x558e30add040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.778+0000 7fcc63fff640 0 client.26324 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:42:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.778+0000 7fcc8dff5740 1 --2- 172.21.15.79:0/604524790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e30ad4f60 0x558e30adc470 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.778+0000 7fcc8dff5740 1 --2- 172.21.15.79:0/604524790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e30ad2630 0x558e30adbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.778+0000 7fcc8dff5740 1 -- 172.21.15.79:0/604524790 >> 172.21.15.79:0/604524790 conn(0x558e30acd730 msgr2=0x558e30acc850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.779+0000 7fcc8dff5740 1 -- 172.21.15.79:0/604524790 shutdown_connections 2024-08-20T01:42:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.779+0000 7fcc8dff5740 1 -- 172.21.15.79:0/604524790 wait complete. 2024-08-20T01:42:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.779+0000 7fcc8dff5740 20 client.26324 trim_cache size 0 max 16384 2024-08-20T01:42:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.797+0000 7fcc8dff5740 1 Processor -- start 2024-08-20T01:42:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.797+0000 7fcc8dff5740 1 -- start start 2024-08-20T01:42:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.798+0000 7fcc8dff5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e30ad2630 0x558e30ad7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.798+0000 7fcc8dff5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e30ad4f60 0x558e30ad82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.798+0000 7fcc8dff5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e30ad79a0 0x558e30ad8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.798+0000 7fcc8dff5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcc841a9b20 con 0x558e30ad2630 2024-08-20T01:42:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.798+0000 7fcc8dff5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcc841ab660 con 0x558e30ad4f60 2024-08-20T01:42:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.798+0000 7fcc8dff5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcc841aa1f0 con 0x558e30ad79a0 2024-08-20T01:42:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.798+0000 7fcc88ec6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e30ad2630 0x558e30ad7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.798+0000 7fcc88ec6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e30ad2630 0x558e30ad7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42896/0 (socket says 172.21.15.79:42896) 2024-08-20T01:42:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.798+0000 7fcc88ec6640 1 -- 172.21.15.79:0/454459429 learned_addr learned my addr 172.21.15.79:0/454459429 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.798+0000 7fcc896c7640 1 --2- 172.21.15.79:0/454459429 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e30ad79a0 0x558e30ad8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.798+0000 7fcc7bfff640 1 --2- 172.21.15.79:0/454459429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e30ad4f60 0x558e30ad82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.798+0000 7fcc88ec6640 1 -- 172.21.15.79:0/454459429 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e30ad79a0 msgr2=0x558e30ad8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.798+0000 7fcc88ec6640 1 --2- 172.21.15.79:0/454459429 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e30ad79a0 0x558e30ad8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.798+0000 7fcc88ec6640 1 -- 172.21.15.79:0/454459429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e30ad4f60 msgr2=0x558e30ad82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.798+0000 7fcc88ec6640 1 --2- 172.21.15.79:0/454459429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e30ad4f60 0x558e30ad82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.798+0000 7fcc88ec6640 1 -- 172.21.15.79:0/454459429 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e30ad4d90 con 0x558e30ad2630 2024-08-20T01:42:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.798+0000 7fcc7bfff640 1 --2- 172.21.15.79:0/454459429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e30ad4f60 0x558e30ad82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:42:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.798+0000 7fcc88ec6640 1 --2- 172.21.15.79:0/454459429 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e30ad2630 0x558e30ad7d80 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fcc80009530 tx=0x7fcc80009ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=464413bb25c7b3ba server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.799+0000 7fcc6a7fc640 1 -- 172.21.15.79:0/454459429 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc80005100 con 0x558e30ad2630 2024-08-20T01:42:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.799+0000 7fcc6a7fc640 1 -- 172.21.15.79:0/454459429 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc80003860 con 0x558e30ad2630 2024-08-20T01:42:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.799+0000 7fcc6a7fc640 1 -- 172.21.15.79:0/454459429 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc8000f790 con 0x558e30ad2630 2024-08-20T01:42:53.806 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.799+0000 7fcc8dff5740 1 -- 172.21.15.79:0/454459429 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e30ad2630 msgr2=0x558e30ad7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:53.806 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.799+0000 7fcc8dff5740 1 --2- 172.21.15.79:0/454459429 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e30ad2630 0x558e30ad7d80 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fcc80009530 tx=0x7fcc80009ce0 comp rx=0 tx=0).stop 2024-08-20T01:42:53.806 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.799+0000 7fcc8dff5740 1 -- 172.21.15.79:0/454459429 shutdown_connections 2024-08-20T01:42:53.806 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.799+0000 7fcc8dff5740 1 --2- 172.21.15.79:0/454459429 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e30ad79a0 0x558e30ad8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.799+0000 7fcc8dff5740 1 --2- 172.21.15.79:0/454459429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e30ad4f60 0x558e30ad82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.799+0000 7fcc8dff5740 1 --2- 172.21.15.79:0/454459429 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e30ad2630 0x558e30ad7d80 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.799+0000 7fcc8dff5740 1 -- 172.21.15.79:0/454459429 >> 172.21.15.79:0/454459429 conn(0x558e30acd730 msgr2=0x558e30ad92b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.799+0000 7fcc8dff5740 1 -- 172.21.15.79:0/454459429 shutdown_connections 2024-08-20T01:42:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.799+0000 7fcc8dff5740 1 -- 172.21.15.79:0/454459429 wait complete. 2024-08-20T01:42:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.800+0000 7fcc8dff5740 1 -- start start 2024-08-20T01:42:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.800+0000 7fcc8dff5740 1 Processor -- start 2024-08-20T01:42:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.800+0000 7fcc8dff5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e30ad2630 0x558e30ae0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.800+0000 7fcc8dff5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e30ad4f60 0x558e30ae1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.800+0000 7fcc8dff5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e30ad79a0 0x558e30ae1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.800+0000 7fcc8dff5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcc841aaf90 con 0x558e30ad2630 2024-08-20T01:42:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.800+0000 7fcc8dff5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcc841aa8c0 con 0x558e30ad4f60 2024-08-20T01:42:53.808 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.800+0000 7fcc8dff5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcc841a7b00 con 0x558e30ad79a0 2024-08-20T01:42:53.808 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.800+0000 7fcc8dff5740 10 client.0 _ll_register_callbacks cb 0x7fcc74009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:42:53.808 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.800+0000 7fcc88ec6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e30ad2630 0x558e30ae0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:53.808 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.800+0000 7fcc88ec6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e30ad2630 0x558e30ae0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42910/0 (socket says 172.21.15.79:42910) 2024-08-20T01:42:53.808 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.800+0000 7fcc88ec6640 1 -- 172.21.15.79:0/3641362001 learned_addr learned my addr 172.21.15.79:0/3641362001 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:42:53.808 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.800+0000 7fcc896c7640 1 --2- 172.21.15.79:0/3641362001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e30ad79a0 0x558e30ae1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:53.808 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.800+0000 7fcc7bfff640 1 --2- 172.21.15.79:0/3641362001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e30ad4f60 0x558e30ae1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:53.808 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.801+0000 7fcc88ec6640 1 -- 172.21.15.79:0/3641362001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e30ad79a0 msgr2=0x558e30ae1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:53.808 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.801+0000 7fcc88ec6640 1 --2- 172.21.15.79:0/3641362001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e30ad79a0 0x558e30ae1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:53.808 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.801+0000 7fcc88ec6640 1 -- 172.21.15.79:0/3641362001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e30ad4f60 msgr2=0x558e30ae1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:42:53.808 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.801+0000 7fcc88ec6640 1 --2- 172.21.15.79:0/3641362001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e30ad4f60 0x558e30ae1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:53.808 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.801+0000 7fcc88ec6640 1 -- 172.21.15.79:0/3641362001 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e30add3b0 con 0x558e30ad2630 2024-08-20T01:42:53.809 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.801+0000 7fcc7bfff640 1 --2- 172.21.15.79:0/3641362001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e30ad4f60 0x558e30ae1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:42:53.809 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.801+0000 7fcc88ec6640 1 --2- 172.21.15.79:0/3641362001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e30ad2630 0x558e30ae0ad0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fcc80013040 tx=0x7fcc80003a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b201b30b531f679b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:42:53.809 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.801+0000 7fcc63fff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:42:53.809 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.801+0000 7fcc63fff640 1 -- 172.21.15.79:0/3641362001 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc80003e50 con 0x558e30ad2630 2024-08-20T01:42:53.809 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.801+0000 7fcc63fff640 1 -- 172.21.15.79:0/3641362001 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fcc80005100 con 0x558e30ad2630 2024-08-20T01:42:53.809 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.801+0000 7fcc8dff5740 1 -- 172.21.15.79:0/3641362001 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc80003860 con 0x558e30ad2630 2024-08-20T01:42:53.809 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.801+0000 7fcc63fff640 1 -- 172.21.15.79:0/3641362001 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fcc80005320 con 0x558e30ad2630 2024-08-20T01:42:53.809 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.801+0000 7fcc8dff5740 10 client.17211 fetch_fsmap learned FSMap version 38 2024-08-20T01:42:53.809 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.801+0000 7fcc8dff5740 1 -- 172.21.15.79:0/3641362001 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x558e30ae3760 con 0x558e30ad2630 2024-08-20T01:42:53.809 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.801+0000 7fcc63fff640 1 -- 172.21.15.79:0/3641362001 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc80003860 con 0x558e30ad2630 2024-08-20T01:42:53.809 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.801+0000 7fcc63fff640 1 -- 172.21.15.79:0/3641362001 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7fcc8003e070 con 0x558e30ad2630 2024-08-20T01:42:53.809 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.801+0000 7fcc8dff5740 10 client.17211 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:42:53.809 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.801+0000 7fcc8dff5740 10 client.17211 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:42:53.810 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.801+0000 7fcc8dff5740 20 client.17211 populate_metadata read hostname 'smithi079' 2024-08-20T01:42:53.810 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.801+0000 7fcc8dff5740 1 --2- 172.21.15.79:0/3641362001 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558e30ae7660 0x558e30b54310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:42:53.810 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.802+0000 7fcc8dff5740 4 client.17211 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:42:53.810 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.802+0000 7fcc8dff5740 1 -- 172.21.15.79:0/3641362001 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558e30a42d50 con 0x558e30ae7660 2024-08-20T01:42:53.810 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.802+0000 7fcc7bfff640 1 --2- 172.21.15.79:0/3641362001 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558e30ae7660 0x558e30b54310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:42:53.810 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.802+0000 7fcc63fff640 10 client.17211 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:42:53.810 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.802+0000 7fcc7bfff640 1 --2- 172.21.15.79:0/3641362001 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558e30ae7660 0x558e30b54310 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd94ac59a12f53cb server_cookie=9d207dd40bca89a5 in_seq=0 out_seq=0 2024-08-20T01:42:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.810+0000 7fcc63fff640 1 -- 172.21.15.79:0/3641362001 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558e30a42d50 con 0x558e30ae7660 2024-08-20T01:42:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.810+0000 7fcc63fff640 10 client.17211 handle_command_reply: tid=0 2024-08-20T01:42:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.810+0000 7fcc8dff5740 1 client.17211 shutdown 2024-08-20T01:42:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.810+0000 7fcc8dff5740 1 -- 172.21.15.79:0/3641362001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e30ad2630 msgr2=0x558e30ae0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.810+0000 7fcc8dff5740 1 --2- 172.21.15.79:0/3641362001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e30ad2630 0x558e30ae0ad0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fcc80013040 tx=0x7fcc80003a10 comp rx=0 tx=0).stop 2024-08-20T01:42:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.810+0000 7fcc8dff5740 1 -- 172.21.15.79:0/3641362001 shutdown_connections 2024-08-20T01:42:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.810+0000 7fcc8dff5740 1 --2- 172.21.15.79:0/3641362001 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558e30ae7660 0x558e30b54310 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.810+0000 7fcc8dff5740 1 --2- 172.21.15.79:0/3641362001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e30ad79a0 0x558e30ae1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.810+0000 7fcc8dff5740 1 --2- 172.21.15.79:0/3641362001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e30ad4f60 0x558e30ae1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.810+0000 7fcc8dff5740 1 --2- 172.21.15.79:0/3641362001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e30ad2630 0x558e30ae0ad0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.810+0000 7fcc8dff5740 1 -- 172.21.15.79:0/3641362001 >> 172.21.15.79:0/3641362001 conn(0x558e30acd730 msgr2=0x558e30acc030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.810+0000 7fcc63fff640 0 client.17211 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:42:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.811+0000 7fcc8dff5740 1 -- 172.21.15.79:0/3641362001 shutdown_connections 2024-08-20T01:42:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.811+0000 7fcc8dff5740 1 -- 172.21.15.79:0/3641362001 wait complete. 2024-08-20T01:42:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.811+0000 7fcc8dff5740 20 client.17211 trim_cache size 0 max 16384 2024-08-20T01:42:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:42:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:42:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:42:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:42:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.811+0000 7fcc8b12a640 1 -- 172.21.15.79:0/1456476661 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fcc6c0b3bd0 msgr2=0x7fcc6c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.811+0000 7fcc8b12a640 1 --2- 172.21.15.79:0/1456476661 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fcc6c0b3bd0 0x7fcc6c0b6090 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fcc74006010 tx=0x7fcc740046c0 comp rx=0 tx=0).stop 2024-08-20T01:42:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.811+0000 7fcc8b12a640 1 -- 172.21.15.79:0/1456476661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc84103070 msgr2=0x7fcc84199c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:42:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.811+0000 7fcc8b12a640 1 --2- 172.21.15.79:0/1456476661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc84103070 0x7fcc84199c10 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c00eb10 tx=0x7fcc7c00c2d0 comp rx=0 tx=0).stop 2024-08-20T01:42:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.811+0000 7fcc8b12a640 1 -- 172.21.15.79:0/1456476661 shutdown_connections 2024-08-20T01:42:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.811+0000 7fcc8b12a640 1 --2- 172.21.15.79:0/1456476661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc84103070 0x7fcc84199c10 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.811+0000 7fcc8b12a640 1 --2- 172.21.15.79:0/1456476661 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fcc6c0b3bd0 0x7fcc6c0b6090 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.811+0000 7fcc8b12a640 1 --2- 172.21.15.79:0/1456476661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc841026b0 0x7fcc84198fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.811+0000 7fcc8b12a640 1 --2- 172.21.15.79:0/1456476661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc84101560 0x7fcc84198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:42:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.811+0000 7fcc8b12a640 1 -- 172.21.15.79:0/1456476661 >> 172.21.15.79:0/1456476661 conn(0x7fcc840fce40 msgr2=0x7fcc8406a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:42:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.812+0000 7fcc8b12a640 1 -- 172.21.15.79:0/1456476661 shutdown_connections 2024-08-20T01:42:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:42:53.812+0000 7fcc8b12a640 1 -- 172.21.15.79:0/1456476661 wait complete. 2024-08-20T01:42:54.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:54 smithi175 ceph-mon[22392]: pgmap v514: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 29 MiB/s wr, 39 op/s 2024-08-20T01:42:54.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:54 smithi079 ceph-mon[18656]: pgmap v514: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 29 MiB/s wr, 39 op/s 2024-08-20T01:42:54.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:54 smithi081 ceph-mon[22209]: pgmap v514: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 29 MiB/s wr, 39 op/s 2024-08-20T01:42:56.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:56 smithi175 ceph-mon[22392]: pgmap v515: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 32 MiB/s wr, 36 op/s 2024-08-20T01:42:56.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:56 smithi079 ceph-mon[18656]: pgmap v515: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 32 MiB/s wr, 36 op/s 2024-08-20T01:42:56.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:56 smithi081 ceph-mon[22209]: pgmap v515: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 32 MiB/s wr, 36 op/s 2024-08-20T01:42:58.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:42:58 smithi175 ceph-mon[22392]: pgmap v516: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 29 MiB/s wr, 22 op/s 2024-08-20T01:42:58.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:42:58 smithi079 ceph-mon[18656]: pgmap v516: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 29 MiB/s wr, 22 op/s 2024-08-20T01:42:58.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:42:58 smithi081 ceph-mon[22209]: pgmap v516: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 29 MiB/s wr, 22 op/s 2024-08-20T01:43:00.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:00 smithi175 ceph-mon[22392]: pgmap v517: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 30 MiB/s wr, 26 op/s 2024-08-20T01:43:00.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:00 smithi079 ceph-mon[18656]: pgmap v517: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 30 MiB/s wr, 26 op/s 2024-08-20T01:43:00.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:00 smithi081 ceph-mon[22209]: pgmap v517: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 30 MiB/s wr, 26 op/s 2024-08-20T01:43:02.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:02 smithi175 ceph-mon[22392]: pgmap v518: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 27 MiB/s wr, 22 op/s 2024-08-20T01:43:02.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:02 smithi079 ceph-mon[18656]: pgmap v518: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 27 MiB/s wr, 22 op/s 2024-08-20T01:43:02.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:02 smithi081 ceph-mon[22209]: pgmap v518: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 27 MiB/s wr, 22 op/s 2024-08-20T01:43:04.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:04 smithi175 ceph-mon[22392]: pgmap v519: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-08-20T01:43:04.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:04 smithi079 ceph-mon[18656]: pgmap v519: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-08-20T01:43:04.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:04 smithi081 ceph-mon[22209]: pgmap v519: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-08-20T01:43:06.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:06 smithi175 ceph-mon[22392]: pgmap v520: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 32 MiB/s wr, 26 op/s 2024-08-20T01:43:06.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:06 smithi079 ceph-mon[18656]: pgmap v520: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 32 MiB/s wr, 26 op/s 2024-08-20T01:43:06.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:06 smithi081 ceph-mon[22209]: pgmap v520: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 32 MiB/s wr, 26 op/s 2024-08-20T01:43:06.906 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.902+0000 7fe6c075c640 1 -- 172.21.15.79:0/2381947420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6b8106170 msgr2=0x7fe6b8110e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:06.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.902+0000 7fe6c075c640 1 --2- 172.21.15.79:0/2381947420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6b8106170 0x7fe6b8110e50 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0009ca0 tx=0x7fe6b002a8c0 comp rx=0 tx=0).stop 2024-08-20T01:43:06.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.902+0000 7fe6c075c640 1 -- 172.21.15.79:0/2381947420 shutdown_connections 2024-08-20T01:43:06.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.902+0000 7fe6c075c640 1 --2- 172.21.15.79:0/2381947420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6b8106170 0x7fe6b8110e50 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:06.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.902+0000 7fe6c075c640 1 --2- 172.21.15.79:0/2381947420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6b8075850 0x7fe6b8075cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:06.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.902+0000 7fe6c075c640 1 --2- 172.21.15.79:0/2381947420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6b8076cc0 0x7fe6b8075310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:06.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.902+0000 7fe6c075c640 1 -- 172.21.15.79:0/2381947420 >> 172.21.15.79:0/2381947420 conn(0x7fe6b80fdf20 msgr2=0x7fe6b8100340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:06.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.902+0000 7fe6c075c640 1 -- 172.21.15.79:0/2381947420 shutdown_connections 2024-08-20T01:43:06.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.902+0000 7fe6c075c640 1 -- 172.21.15.79:0/2381947420 wait complete. 2024-08-20T01:43:06.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.903+0000 7fe6c075c640 1 Processor -- start 2024-08-20T01:43:06.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.903+0000 7fe6c075c640 1 -- start start 2024-08-20T01:43:06.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.903+0000 7fe6c075c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6b8075850 0x7fe6b819ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:06.908 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.903+0000 7fe6c075c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6b8076cc0 0x7fe6b819f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:06.908 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.903+0000 7fe6c075c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6b81a0210 0x7fe6b81a06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:06.908 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.903+0000 7fe6c075c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b8114840 con 0x7fe6b8076cc0 2024-08-20T01:43:06.908 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.903+0000 7fe6c075c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b81146c0 con 0x7fe6b81a0210 2024-08-20T01:43:06.908 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.903+0000 7fe6c075c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b81149c0 con 0x7fe6b8075850 2024-08-20T01:43:06.908 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.903+0000 7fe6bdcf7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6b8076cc0 0x7fe6b819f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:06.908 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.903+0000 7fe6bdcf7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6b8076cc0 0x7fe6b819f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36942/0 (socket says 172.21.15.79:36942) 2024-08-20T01:43:06.908 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.903+0000 7fe6bdcf7640 1 -- 172.21.15.79:0/3117052929 learned_addr learned my addr 172.21.15.79:0/3117052929 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:06.908 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.903+0000 7fe6becf9640 1 --2- 172.21.15.79:0/3117052929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6b81a0210 0x7fe6b81a06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:06.908 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.904+0000 7fe6bdcf7640 1 -- 172.21.15.79:0/3117052929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6b8075850 msgr2=0x7fe6b819ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:06.908 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.904+0000 7fe6bdcf7640 1 --2- 172.21.15.79:0/3117052929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6b8075850 0x7fe6b819ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:06.908 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.904+0000 7fe6bdcf7640 1 -- 172.21.15.79:0/3117052929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6b81a0210 msgr2=0x7fe6b81a06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:06.908 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.904+0000 7fe6bdcf7640 1 --2- 172.21.15.79:0/3117052929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6b81a0210 0x7fe6b81a06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:06.909 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.904+0000 7fe6bdcf7640 1 -- 172.21.15.79:0/3117052929 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6b81a0ec0 con 0x7fe6b8076cc0 2024-08-20T01:43:06.909 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.904+0000 7fe6bdcf7640 1 --2- 172.21.15.79:0/3117052929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6b8076cc0 0x7fe6b819f5e0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fe6a800b4a0 tx=0x7fe6a800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:06.909 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.904+0000 7fe6af7fe640 1 -- 172.21.15.79:0/3117052929 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a8014070 con 0x7fe6b8076cc0 2024-08-20T01:43:06.909 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.904+0000 7fe6af7fe640 1 -- 172.21.15.79:0/3117052929 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6a8010aa0 con 0x7fe6b8076cc0 2024-08-20T01:43:06.909 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.904+0000 7fe6af7fe640 1 -- 172.21.15.79:0/3117052929 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a8017b70 con 0x7fe6b8076cc0 2024-08-20T01:43:06.909 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.904+0000 7fe6c075c640 1 -- 172.21.15.79:0/3117052929 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6b81a72b0 con 0x7fe6b8076cc0 2024-08-20T01:43:06.909 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.904+0000 7fe6c075c640 1 -- 172.21.15.79:0/3117052929 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6b81a77f0 con 0x7fe6b8076cc0 2024-08-20T01:43:06.910 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.907+0000 7fe6af7fe640 1 -- 172.21.15.79:0/3117052929 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fe6a8017070 con 0x7fe6b8076cc0 2024-08-20T01:43:06.910 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.907+0000 7fe6c362a740 1 Processor -- start 2024-08-20T01:43:06.910 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.908+0000 7fe6c362a740 1 -- start start 2024-08-20T01:43:06.910 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.908+0000 7fe6af7fe640 1 --2- 172.21.15.79:0/3117052929 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe6a40b3c50 0x7fe6a40b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:06.910 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.908+0000 7fe6c362a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5642bfbcf8d0 0x5642bfbd1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:06.911 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.908+0000 7fe6c362a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642bfbd2200 0x5642bfbd45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:06.911 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.908+0000 7fe6c362a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642bfbd4c40 0x5642bfbd7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:06.911 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.908+0000 7fe6c362a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5642bfb42360 con 0x5642bfbd4c40 2024-08-20T01:43:06.911 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.908+0000 7fe6c362a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5642bfb31860 con 0x5642bfbcf8d0 2024-08-20T01:43:06.911 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.908+0000 7fe6c362a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5642bfb358a0 con 0x5642bfbd2200 2024-08-20T01:43:06.911 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.908+0000 7fe6becf9640 1 --2- 172.21.15.79:0/3117052929 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe6a40b3c50 0x7fe6a40b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:06.911 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.908+0000 7fe6becf9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642bfbd4c40 0x5642bfbd7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:06.911 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.908+0000 7fe6af7fe640 1 -- 172.21.15.79:0/3117052929 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fe6a80e3260 con 0x7fe6b8076cc0 2024-08-20T01:43:06.911 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.908+0000 7fe6bdcf7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642bfbd2200 0x5642bfbd45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:06.911 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.908+0000 7fe6be4f8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5642bfbcf8d0 0x5642bfbd1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:06.911 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.908+0000 7fe6becf9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642bfbd4c40 0x5642bfbd7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36950/0 (socket says 172.21.15.79:36950) 2024-08-20T01:43:06.911 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.908+0000 7fe6becf9640 1 -- 172.21.15.79:0/1321039610 learned_addr learned my addr 172.21.15.79:0/1321039610 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:06.916 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.908+0000 7fe6bdcf7640 1 -- 172.21.15.79:0/1321039610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5642bfbcf8d0 msgr2=0x5642bfbd1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:06.916 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.909+0000 7fe6bdcf7640 1 --2- 172.21.15.79:0/1321039610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5642bfbcf8d0 0x5642bfbd1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:06.916 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.909+0000 7fe6bdcf7640 1 -- 172.21.15.79:0/1321039610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642bfbd4c40 msgr2=0x5642bfbd7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:06.916 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.909+0000 7fe6bdcf7640 1 --2- 172.21.15.79:0/1321039610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642bfbd4c40 0x5642bfbd7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:06.916 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.909+0000 7fe6bdcf7640 1 -- 172.21.15.79:0/1321039610 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642bfad8e40 con 0x5642bfbd2200 2024-08-20T01:43:06.916 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.909+0000 7fe6be4f8640 1 --2- 172.21.15.79:0/1321039610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5642bfbcf8d0 0x5642bfbd1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:43:06.916 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.909+0000 7fe6becf9640 1 --2- 172.21.15.79:0/1321039610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642bfbd4c40 0x5642bfbd7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:43:06.916 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.909+0000 7fe6becf9640 1 --2- 172.21.15.79:0/3117052929 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe6a40b3c50 0x7fe6a40b6110 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0009430 tx=0x7fe6b00098e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:06.916 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.909+0000 7fe6bdcf7640 1 --2- 172.21.15.79:0/1321039610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642bfbd2200 0x5642bfbd45f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe6a80e10e0 tx=0x7fe6a80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53777393c0ad80ff server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:06.916 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.909+0000 7fe6acff9640 1 -- 172.21.15.79:0/1321039610 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a801e070 con 0x5642bfbd2200 2024-08-20T01:43:06.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.909+0000 7fe6acff9640 1 -- 172.21.15.79:0/1321039610 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6a80703a0 con 0x5642bfbd2200 2024-08-20T01:43:06.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.909+0000 7fe6acff9640 1 -- 172.21.15.79:0/1321039610 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a80a6450 con 0x5642bfbd2200 2024-08-20T01:43:06.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.910+0000 7fe6c362a740 1 -- 172.21.15.79:0/1321039610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642bfbd2200 msgr2=0x5642bfbd45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:06.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.910+0000 7fe6c362a740 1 --2- 172.21.15.79:0/1321039610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642bfbd2200 0x5642bfbd45f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe6a80e10e0 tx=0x7fe6a80046c0 comp rx=0 tx=0).stop 2024-08-20T01:43:06.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.910+0000 7fe6c362a740 1 -- 172.21.15.79:0/1321039610 shutdown_connections 2024-08-20T01:43:06.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.910+0000 7fe6c362a740 1 --2- 172.21.15.79:0/1321039610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642bfbd4c40 0x5642bfbd7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:06.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.910+0000 7fe6c362a740 1 --2- 172.21.15.79:0/1321039610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642bfbd2200 0x5642bfbd45f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:06.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.910+0000 7fe6c362a740 1 --2- 172.21.15.79:0/1321039610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5642bfbcf8d0 0x5642bfbd1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:06.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.910+0000 7fe6c362a740 1 -- 172.21.15.79:0/1321039610 >> 172.21.15.79:0/1321039610 conn(0x5642bfbcaa20 msgr2=0x5642bfbcb7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:06.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.910+0000 7fe6c362a740 1 -- 172.21.15.79:0/1321039610 shutdown_connections 2024-08-20T01:43:06.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.910+0000 7fe6c362a740 1 -- 172.21.15.79:0/1321039610 wait complete. 2024-08-20T01:43:06.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.910+0000 7fe6c362a740 1 -- start start 2024-08-20T01:43:06.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.911+0000 7fe6c362a740 1 Processor -- start 2024-08-20T01:43:06.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.911+0000 7fe6c362a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642bfbcf8d0 0x5642bfbd9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:06.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.911+0000 7fe6c362a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642bfbd2200 0x5642bfbd97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:06.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.911+0000 7fe6c362a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5642bfbd4c40 0x5642bfbda390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:06.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.911+0000 7fe6c362a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5642bfa6aab0 con 0x5642bfbd2200 2024-08-20T01:43:06.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.911+0000 7fe6c362a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5642bfab8780 con 0x5642bfbd4c40 2024-08-20T01:43:06.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.911+0000 7fe6c362a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5642bfbd7c20 con 0x5642bfbcf8d0 2024-08-20T01:43:06.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.911+0000 7fe6c362a740 10 client.0 _ll_register_callbacks cb 0x5642bf840a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:43:06.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.911+0000 7fe6bdcf7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642bfbd2200 0x5642bfbd97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:06.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.911+0000 7fe6be4f8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642bfbcf8d0 0x5642bfbd9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:06.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.911+0000 7fe6be4f8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642bfbcf8d0 0x5642bfbd9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:45046/0 (socket says 172.21.15.79:45046) 2024-08-20T01:43:06.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.911+0000 7fe6bdcf7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642bfbd2200 0x5642bfbd97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36964/0 (socket says 172.21.15.79:36964) 2024-08-20T01:43:06.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.911+0000 7fe6be4f8640 1 -- 172.21.15.79:0/71259703 learned_addr learned my addr 172.21.15.79:0/71259703 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:06.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.911+0000 7fe6becf9640 1 --2- 172.21.15.79:0/71259703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5642bfbd4c40 0x5642bfbda390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:06.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.911+0000 7fe6bdcf7640 1 -- 172.21.15.79:0/71259703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642bfbcf8d0 msgr2=0x5642bfbd9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:06.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.911+0000 7fe6bdcf7640 1 --2- 172.21.15.79:0/71259703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642bfbcf8d0 0x5642bfbd9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:06.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.911+0000 7fe6bdcf7640 1 -- 172.21.15.79:0/71259703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5642bfbd4c40 msgr2=0x5642bfbda390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:06.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.911+0000 7fe6bdcf7640 1 --2- 172.21.15.79:0/71259703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5642bfbd4c40 0x5642bfbda390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:06.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.911+0000 7fe6bdcf7640 1 -- 172.21.15.79:0/71259703 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642bf894790 con 0x5642bfbd2200 2024-08-20T01:43:06.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.911+0000 7fe6be4f8640 1 --2- 172.21.15.79:0/71259703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642bfbcf8d0 0x5642bfbd9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:43:06.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.911+0000 7fe6becf9640 1 --2- 172.21.15.79:0/71259703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5642bfbd4c40 0x5642bfbda390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:43:06.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.912+0000 7fe6bdcf7640 1 --2- 172.21.15.79:0/71259703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642bfbd2200 0x5642bfbd97c0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fe6a80174f0 tx=0x7fe6a800bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd8aa2b57b595cb3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:06.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.912+0000 7fe6a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:43:06.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.912+0000 7fe6a1ffb640 1 -- 172.21.15.79:0/71259703 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a801e040 con 0x5642bfbd2200 2024-08-20T01:43:06.920 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.912+0000 7fe6a1ffb640 1 -- 172.21.15.79:0/71259703 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fe6a8084190 con 0x5642bfbd2200 2024-08-20T01:43:06.920 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.912+0000 7fe6c362a740 1 -- 172.21.15.79:0/71259703 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5642bfae0e00 con 0x5642bfbd2200 2024-08-20T01:43:06.920 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.912+0000 7fe6a1ffb640 1 -- 172.21.15.79:0/71259703 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fe6a8017e10 con 0x5642bfbd2200 2024-08-20T01:43:06.920 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.912+0000 7fe6c362a740 10 client.17223 fetch_fsmap learned FSMap version 38 2024-08-20T01:43:06.920 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.912+0000 7fe6c362a740 1 -- 172.21.15.79:0/71259703 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5642bf90d620 con 0x5642bfbd2200 2024-08-20T01:43:06.920 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.912+0000 7fe6a1ffb640 1 -- 172.21.15.79:0/71259703 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5642bfae0e00 con 0x5642bfbd2200 2024-08-20T01:43:06.920 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.912+0000 7fe6a1ffb640 1 -- 172.21.15.79:0/71259703 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7fe6a807f730 con 0x5642bfbd2200 2024-08-20T01:43:06.920 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.913+0000 7fe6c362a740 10 client.17223 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:43:06.920 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.913+0000 7fe6c362a740 10 client.17223 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:43:06.920 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.913+0000 7fe6c362a740 20 client.17223 populate_metadata read hostname 'smithi079' 2024-08-20T01:43:06.920 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.913+0000 7fe6c362a740 1 --2- 172.21.15.79:0/71259703 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5642bfbe45c0 0x5642bfbe69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:06.920 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.913+0000 7fe6c362a740 4 client.17223 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:43:06.921 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.913+0000 7fe6c362a740 1 -- 172.21.15.79:0/71259703 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5642bfb442b0 con 0x5642bfbe45c0 2024-08-20T01:43:06.921 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.913+0000 7fe6be4f8640 1 --2- 172.21.15.79:0/71259703 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5642bfbe45c0 0x5642bfbe69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:06.921 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.913+0000 7fe6be4f8640 1 --2- 172.21.15.79:0/71259703 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5642bfbe45c0 0x5642bfbe69b0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45d9c8b622aa74db server_cookie=7139a319b920ee41 in_seq=0 out_seq=0 2024-08-20T01:43:06.921 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.913+0000 7fe6a1ffb640 10 client.17223 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:43:06.922 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.914+0000 7fe6a1ffb640 1 -- 172.21.15.79:0/71259703 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5642bfb442b0 con 0x5642bfbe45c0 2024-08-20T01:43:06.922 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.914+0000 7fe6a1ffb640 10 client.17223 handle_command_reply: tid=0 2024-08-20T01:43:06.922 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.914+0000 7fe6c362a740 1 client.17223 shutdown 2024-08-20T01:43:06.922 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.914+0000 7fe6c362a740 1 -- 172.21.15.79:0/71259703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642bfbd2200 msgr2=0x5642bfbd97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:06.922 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.914+0000 7fe6c362a740 1 --2- 172.21.15.79:0/71259703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642bfbd2200 0x5642bfbd97c0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fe6a80174f0 tx=0x7fe6a800bf90 comp rx=0 tx=0).stop 2024-08-20T01:43:06.922 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.914+0000 7fe6c362a740 1 -- 172.21.15.79:0/71259703 shutdown_connections 2024-08-20T01:43:06.922 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.914+0000 7fe6c362a740 1 --2- 172.21.15.79:0/71259703 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5642bfbe45c0 0x5642bfbe69b0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:06.922 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.914+0000 7fe6c362a740 1 --2- 172.21.15.79:0/71259703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5642bfbd4c40 0x5642bfbda390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:06.922 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.914+0000 7fe6c362a740 1 --2- 172.21.15.79:0/71259703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642bfbd2200 0x5642bfbd97c0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:06.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.914+0000 7fe6c362a740 1 --2- 172.21.15.79:0/71259703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642bfbcf8d0 0x5642bfbd9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:06.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.914+0000 7fe6a1ffb640 0 client.17223 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:43:06.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.914+0000 7fe6c362a740 1 -- 172.21.15.79:0/71259703 >> 172.21.15.79:0/71259703 conn(0x5642bfbcaa20 msgr2=0x5642bfbc9ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:06.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.914+0000 7fe6c362a740 1 -- 172.21.15.79:0/71259703 shutdown_connections 2024-08-20T01:43:06.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.914+0000 7fe6c362a740 1 -- 172.21.15.79:0/71259703 wait complete. 2024-08-20T01:43:06.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.915+0000 7fe6c362a740 20 client.17223 trim_cache size 0 max 16384 2024-08-20T01:43:06.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.929+0000 7fe6c362a740 1 Processor -- start 2024-08-20T01:43:06.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.929+0000 7fe6c362a740 1 -- start start 2024-08-20T01:43:06.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.930+0000 7fe6c362a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642bfbcf8d0 0x5642bfbd6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:06.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.930+0000 7fe6c362a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642bfbd4c40 0x5642bfbd6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:06.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.930+0000 7fe6c362a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5642bfbcb280 0x5642bfbcb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:06.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.930+0000 7fe6c362a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b81b0170 con 0x5642bfbd4c40 2024-08-20T01:43:06.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.930+0000 7fe6c362a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b81b1cb0 con 0x5642bfbcb280 2024-08-20T01:43:06.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.930+0000 7fe6c362a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b81b0840 con 0x5642bfbcf8d0 2024-08-20T01:43:06.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.930+0000 7fe6bdcf7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642bfbd4c40 0x5642bfbd6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:06.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.930+0000 7fe6bdcf7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642bfbd4c40 0x5642bfbd6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36966/0 (socket says 172.21.15.79:36966) 2024-08-20T01:43:06.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.930+0000 7fe6bdcf7640 1 -- 172.21.15.79:0/2815792248 learned_addr learned my addr 172.21.15.79:0/2815792248 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:06.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.930+0000 7fe6be4f8640 1 --2- 172.21.15.79:0/2815792248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642bfbcf8d0 0x5642bfbd6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:06.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.930+0000 7fe6becf9640 1 --2- 172.21.15.79:0/2815792248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5642bfbcb280 0x5642bfbcb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:06.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.930+0000 7fe6bdcf7640 1 -- 172.21.15.79:0/2815792248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642bfbcf8d0 msgr2=0x5642bfbd6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:06.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.930+0000 7fe6bdcf7640 1 --2- 172.21.15.79:0/2815792248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642bfbcf8d0 0x5642bfbd6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:06.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.930+0000 7fe6bdcf7640 1 -- 172.21.15.79:0/2815792248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5642bfbcb280 msgr2=0x5642bfbcb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:06.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.930+0000 7fe6bdcf7640 1 --2- 172.21.15.79:0/2815792248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5642bfbcb280 0x5642bfbcb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:06.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.930+0000 7fe6bdcf7640 1 -- 172.21.15.79:0/2815792248 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642bfbda700 con 0x5642bfbd4c40 2024-08-20T01:43:06.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.930+0000 7fe6be4f8640 1 --2- 172.21.15.79:0/2815792248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642bfbcf8d0 0x5642bfbd6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:43:06.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.930+0000 7fe6bdcf7640 1 --2- 172.21.15.79:0/2815792248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642bfbd4c40 0x5642bfbd6b90 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fe6a80a7430 tx=0x7fe6a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c32376ad8e2f6b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:06.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.930+0000 7fe6a3fff640 1 -- 172.21.15.79:0/2815792248 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a801e070 con 0x5642bfbd4c40 2024-08-20T01:43:06.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.930+0000 7fe6a3fff640 1 -- 172.21.15.79:0/2815792248 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6a80ae7c0 con 0x5642bfbd4c40 2024-08-20T01:43:06.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.931+0000 7fe6a3fff640 1 -- 172.21.15.79:0/2815792248 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a80b2de0 con 0x5642bfbd4c40 2024-08-20T01:43:06.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.931+0000 7fe6c362a740 1 -- 172.21.15.79:0/2815792248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642bfbd4c40 msgr2=0x5642bfbd6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:06.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.931+0000 7fe6c362a740 1 --2- 172.21.15.79:0/2815792248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642bfbd4c40 0x5642bfbd6b90 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fe6a80a7430 tx=0x7fe6a80046c0 comp rx=0 tx=0).stop 2024-08-20T01:43:06.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.931+0000 7fe6c362a740 1 -- 172.21.15.79:0/2815792248 shutdown_connections 2024-08-20T01:43:06.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.931+0000 7fe6c362a740 1 --2- 172.21.15.79:0/2815792248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5642bfbcb280 0x5642bfbcb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:06.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.931+0000 7fe6c362a740 1 --2- 172.21.15.79:0/2815792248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642bfbd4c40 0x5642bfbd6b90 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:06.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.931+0000 7fe6c362a740 1 --2- 172.21.15.79:0/2815792248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642bfbcf8d0 0x5642bfbd6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:06.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.931+0000 7fe6c362a740 1 -- 172.21.15.79:0/2815792248 >> 172.21.15.79:0/2815792248 conn(0x5642bfbcaa20 msgr2=0x5642bfbc5780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:06.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.931+0000 7fe6c362a740 1 -- 172.21.15.79:0/2815792248 shutdown_connections 2024-08-20T01:43:06.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.931+0000 7fe6c362a740 1 -- 172.21.15.79:0/2815792248 wait complete. 2024-08-20T01:43:06.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.932+0000 7fe6c362a740 1 -- start start 2024-08-20T01:43:06.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.932+0000 7fe6c362a740 1 Processor -- start 2024-08-20T01:43:06.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.932+0000 7fe6c362a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5642bfbcb280 0x5642bfbdd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:06.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.932+0000 7fe6c362a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642bfbcf8d0 0x5642bfbddba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:06.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.932+0000 7fe6c362a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642bfbd4c40 0x5642bfbde720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:06.940 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.932+0000 7fe6c362a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b81b15e0 con 0x5642bfbd4c40 2024-08-20T01:43:06.940 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.932+0000 7fe6c362a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b81b0f10 con 0x5642bfbcb280 2024-08-20T01:43:06.940 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.932+0000 7fe6c362a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b81ae150 con 0x5642bfbcf8d0 2024-08-20T01:43:06.940 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.932+0000 7fe6c362a740 10 client.0 _ll_register_callbacks cb 0x7fe6b0009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:43:06.940 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.932+0000 7fe6becf9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642bfbd4c40 0x5642bfbde720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:06.940 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.932+0000 7fe6becf9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642bfbd4c40 0x5642bfbde720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36974/0 (socket says 172.21.15.79:36974) 2024-08-20T01:43:06.940 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.932+0000 7fe6becf9640 1 -- 172.21.15.79:0/586491238 learned_addr learned my addr 172.21.15.79:0/586491238 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:06.940 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.932+0000 7fe6be4f8640 1 --2- 172.21.15.79:0/586491238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5642bfbcb280 0x5642bfbdd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:06.940 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.932+0000 7fe6bdcf7640 1 --2- 172.21.15.79:0/586491238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642bfbcf8d0 0x5642bfbddba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:06.940 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.932+0000 7fe6becf9640 1 -- 172.21.15.79:0/586491238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642bfbcf8d0 msgr2=0x5642bfbddba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:06.940 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.932+0000 7fe6becf9640 1 --2- 172.21.15.79:0/586491238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642bfbcf8d0 0x5642bfbddba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:06.940 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.932+0000 7fe6becf9640 1 -- 172.21.15.79:0/586491238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5642bfbcb280 msgr2=0x5642bfbdd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:06.941 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.932+0000 7fe6becf9640 1 --2- 172.21.15.79:0/586491238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5642bfbcb280 0x5642bfbdd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:06.941 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.932+0000 7fe6becf9640 1 -- 172.21.15.79:0/586491238 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642bfbdef50 con 0x5642bfbd4c40 2024-08-20T01:43:06.941 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.932+0000 7fe6bdcf7640 1 --2- 172.21.15.79:0/586491238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642bfbcf8d0 0x5642bfbddba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:43:06.941 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.933+0000 7fe6becf9640 1 --2- 172.21.15.79:0/586491238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642bfbd4c40 0x5642bfbde720 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fe6b00317a0 tx=0x7fe6b0048000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f302f954c6eae6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:06.941 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.933+0000 7fe6a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:43:06.941 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.933+0000 7fe6a1ffb640 1 -- 172.21.15.79:0/586491238 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b0050070 con 0x5642bfbd4c40 2024-08-20T01:43:06.941 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.933+0000 7fe6a1ffb640 1 -- 172.21.15.79:0/586491238 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fe6b00305c0 con 0x5642bfbd4c40 2024-08-20T01:43:06.941 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.933+0000 7fe6c362a740 1 -- 172.21.15.79:0/586491238 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6a80ae7c0 con 0x5642bfbd4c40 2024-08-20T01:43:06.941 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.933+0000 7fe6a1ffb640 1 -- 172.21.15.79:0/586491238 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fe6b00307c0 con 0x5642bfbd4c40 2024-08-20T01:43:06.941 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.933+0000 7fe6c362a740 10 client.17229 fetch_fsmap learned FSMap version 38 2024-08-20T01:43:06.942 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.933+0000 7fe6c362a740 1 -- 172.21.15.79:0/586491238 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5642bfbe0360 con 0x5642bfbd4c40 2024-08-20T01:43:06.942 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.933+0000 7fe6a1ffb640 1 -- 172.21.15.79:0/586491238 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6a80ae7c0 con 0x5642bfbd4c40 2024-08-20T01:43:06.942 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.933+0000 7fe6a1ffb640 1 -- 172.21.15.79:0/586491238 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7fe6b00046b0 con 0x5642bfbd4c40 2024-08-20T01:43:06.942 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.933+0000 7fe6c362a740 10 client.17229 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:43:06.942 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.933+0000 7fe6c362a740 10 client.17229 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:43:06.942 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.933+0000 7fe6c362a740 20 client.17229 populate_metadata read hostname 'smithi079' 2024-08-20T01:43:06.942 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.933+0000 7fe6c362a740 1 --2- 172.21.15.79:0/586491238 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5642bfc4f320 0x5642bfc51740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:06.942 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.933+0000 7fe6c362a740 4 client.17229 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:43:06.942 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.933+0000 7fe6c362a740 1 -- 172.21.15.79:0/586491238 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5642bfb3fd50 con 0x5642bfc4f320 2024-08-20T01:43:06.942 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.934+0000 7fe6be4f8640 1 --2- 172.21.15.79:0/586491238 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5642bfc4f320 0x5642bfc51740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:06.942 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.934+0000 7fe6a1ffb640 10 client.17229 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:43:06.943 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.934+0000 7fe6be4f8640 1 --2- 172.21.15.79:0/586491238 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5642bfc4f320 0x5642bfc51740 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6aace13ecd3dcd3b server_cookie=6203c65b43999416 in_seq=0 out_seq=0 2024-08-20T01:43:06.945 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.942+0000 7fe6a1ffb640 1 -- 172.21.15.79:0/586491238 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5642bfb3fd50 con 0x5642bfc4f320 2024-08-20T01:43:06.945 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.942+0000 7fe6a1ffb640 10 client.17229 handle_command_reply: tid=0 2024-08-20T01:43:06.945 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.942+0000 7fe6c362a740 1 client.17229 shutdown 2024-08-20T01:43:06.945 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.942+0000 7fe6c362a740 1 -- 172.21.15.79:0/586491238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642bfbd4c40 msgr2=0x5642bfbde720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:06.945 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.942+0000 7fe6c362a740 1 --2- 172.21.15.79:0/586491238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642bfbd4c40 0x5642bfbde720 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fe6b00317a0 tx=0x7fe6b0048000 comp rx=0 tx=0).stop 2024-08-20T01:43:06.945 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.942+0000 7fe6c362a740 1 -- 172.21.15.79:0/586491238 shutdown_connections 2024-08-20T01:43:06.945 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.942+0000 7fe6c362a740 1 --2- 172.21.15.79:0/586491238 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5642bfc4f320 0x5642bfc51740 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:06.946 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.942+0000 7fe6c362a740 1 --2- 172.21.15.79:0/586491238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642bfbd4c40 0x5642bfbde720 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:06.946 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.942+0000 7fe6c362a740 1 --2- 172.21.15.79:0/586491238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5642bfbcf8d0 0x5642bfbddba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:06.946 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.942+0000 7fe6a1ffb640 0 client.17229 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:43:06.946 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.942+0000 7fe6c362a740 1 --2- 172.21.15.79:0/586491238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5642bfbcb280 0x5642bfbdd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:06.946 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.942+0000 7fe6c362a740 1 -- 172.21.15.79:0/586491238 >> 172.21.15.79:0/586491238 conn(0x5642bfbcaa20 msgr2=0x5642bfbd6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:06.946 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.942+0000 7fe6c362a740 1 -- 172.21.15.79:0/586491238 shutdown_connections 2024-08-20T01:43:06.946 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.942+0000 7fe6c362a740 1 -- 172.21.15.79:0/586491238 wait complete. 2024-08-20T01:43:06.946 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.943+0000 7fe6c362a740 20 client.17229 trim_cache size 0 max 16384 2024-08-20T01:43:06.946 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:43:06.947 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:43:06.947 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:43:06.947 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:43:06.947 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.943+0000 7fe6c075c640 1 -- 172.21.15.79:0/3117052929 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe6a40b3c50 msgr2=0x7fe6a40b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:06.948 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.943+0000 7fe6c075c640 1 --2- 172.21.15.79:0/3117052929 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe6a40b3c50 0x7fe6a40b6110 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0009430 tx=0x7fe6b00098e0 comp rx=0 tx=0).stop 2024-08-20T01:43:06.948 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.943+0000 7fe6c075c640 1 -- 172.21.15.79:0/3117052929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6b8076cc0 msgr2=0x7fe6b819f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:06.948 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.943+0000 7fe6c075c640 1 --2- 172.21.15.79:0/3117052929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6b8076cc0 0x7fe6b819f5e0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fe6a800b4a0 tx=0x7fe6a800b960 comp rx=0 tx=0).stop 2024-08-20T01:43:06.948 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.943+0000 7fe6c075c640 1 -- 172.21.15.79:0/3117052929 shutdown_connections 2024-08-20T01:43:06.948 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.943+0000 7fe6c075c640 1 --2- 172.21.15.79:0/3117052929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6b81a0210 0x7fe6b81a06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:06.948 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.943+0000 7fe6c075c640 1 --2- 172.21.15.79:0/3117052929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6b8076cc0 0x7fe6b819f5e0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:06.948 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.943+0000 7fe6c075c640 1 --2- 172.21.15.79:0/3117052929 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe6a40b3c50 0x7fe6a40b6110 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:06.948 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.943+0000 7fe6c075c640 1 --2- 172.21.15.79:0/3117052929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6b8075850 0x7fe6b819ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:06.948 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.943+0000 7fe6c075c640 1 -- 172.21.15.79:0/3117052929 >> 172.21.15.79:0/3117052929 conn(0x7fe6b80fdf20 msgr2=0x7fe6b80fe540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:06.948 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.943+0000 7fe6c075c640 1 -- 172.21.15.79:0/3117052929 shutdown_connections 2024-08-20T01:43:06.948 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:06.943+0000 7fe6c075c640 1 -- 172.21.15.79:0/3117052929 wait complete. 2024-08-20T01:43:07.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:07 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:43:07.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:07 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:43:07.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:07 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:43:08.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:08 smithi175 ceph-mon[22392]: pgmap v521: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 29 MiB/s wr, 23 op/s 2024-08-20T01:43:08.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:08 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:43:08.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:08 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:43:08.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:08 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:43:08.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:08 smithi079 ceph-mon[18656]: pgmap v521: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 29 MiB/s wr, 23 op/s 2024-08-20T01:43:08.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:08 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:43:08.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:08 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:43:08.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:08 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:43:08.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:08 smithi081 ceph-mon[22209]: pgmap v521: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 29 MiB/s wr, 23 op/s 2024-08-20T01:43:08.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:08 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:43:08.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:08 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:43:08.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:08 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:43:10.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:10 smithi175 ceph-mon[22392]: pgmap v522: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 32 MiB/s wr, 27 op/s 2024-08-20T01:43:10.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:10 smithi079 ceph-mon[18656]: pgmap v522: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 32 MiB/s wr, 27 op/s 2024-08-20T01:43:10.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:10 smithi081 ceph-mon[22209]: pgmap v522: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 32 MiB/s wr, 27 op/s 2024-08-20T01:43:12.094 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:43:12.367 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:43:12.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:12 smithi079 ceph-mon[18656]: pgmap v523: 97 pgs: 97 active+clean; 8.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-08-20T01:43:12.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:12 smithi175 ceph-mon[22392]: pgmap v523: 97 pgs: 97 active+clean; 8.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-08-20T01:43:12.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:12 smithi081 ceph-mon[22209]: pgmap v523: 97 pgs: 97 active+clean; 8.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-08-20T01:43:12.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.884+0000 7f8aa3e1c640 1 -- 172.21.15.79:0/4047257554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a9c1039a0 msgr2=0x7f8a9c103d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:12.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.884+0000 7f8aa3e1c640 1 --2- 172.21.15.79:0/4047257554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a9c1039a0 0x7f8a9c103d80 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f8a98009900 tx=0x7f8a9802a410 comp rx=0 tx=0).stop 2024-08-20T01:43:12.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.884+0000 7f8aa3e1c640 1 -- 172.21.15.79:0/4047257554 shutdown_connections 2024-08-20T01:43:12.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.884+0000 7f8aa3e1c640 1 --2- 172.21.15.79:0/4047257554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a9c10ce00 0x7f8a9c10f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:12.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.884+0000 7f8aa3e1c640 1 --2- 172.21.15.79:0/4047257554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a9c1042c0 0x7f8a9c10c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:12.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.884+0000 7f8aa3e1c640 1 --2- 172.21.15.79:0/4047257554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a9c1039a0 0x7f8a9c103d80 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:12.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.884+0000 7f8aa3e1c640 1 -- 172.21.15.79:0/4047257554 >> 172.21.15.79:0/4047257554 conn(0x7f8a9c0fd3e0 msgr2=0x7f8a9c0ff800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:12.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.884+0000 7f8aa3e1c640 1 -- 172.21.15.79:0/4047257554 shutdown_connections 2024-08-20T01:43:12.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.884+0000 7f8aa3e1c640 1 -- 172.21.15.79:0/4047257554 wait complete. 2024-08-20T01:43:12.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.884+0000 7f8aa3e1c640 1 Processor -- start 2024-08-20T01:43:12.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.885+0000 7f8aa3e1c640 1 -- start start 2024-08-20T01:43:12.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.885+0000 7f8aa3e1c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a9c1039a0 0x7f8a9c198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:12.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.885+0000 7f8aa3e1c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a9c1042c0 0x7f8a9c199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:12.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.885+0000 7f8aa3e1c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a9c10ce00 0x7f8a9c19e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:12.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.885+0000 7f8aa3e1c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c112920 con 0x7f8a9c1042c0 2024-08-20T01:43:12.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.885+0000 7f8aa3e1c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c1127a0 con 0x7f8a9c1039a0 2024-08-20T01:43:12.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.885+0000 7f8aa3e1c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c112aa0 con 0x7f8a9c10ce00 2024-08-20T01:43:12.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.885+0000 7f8aa13b7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a9c1042c0 0x7f8a9c199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:12.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.885+0000 7f8aa13b7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a9c1042c0 0x7f8a9c199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52918/0 (socket says 172.21.15.79:52918) 2024-08-20T01:43:12.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.885+0000 7f8aa13b7640 1 -- 172.21.15.79:0/14531884 learned_addr learned my addr 172.21.15.79:0/14531884 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:12.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.885+0000 7f8aa1bb8640 1 --2- 172.21.15.79:0/14531884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a9c1039a0 0x7f8a9c198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:12.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.885+0000 7f8aa23b9640 1 --2- 172.21.15.79:0/14531884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a9c10ce00 0x7f8a9c19e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:12.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.885+0000 7f8aa13b7640 1 -- 172.21.15.79:0/14531884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a9c10ce00 msgr2=0x7f8a9c19e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:12.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.885+0000 7f8aa13b7640 1 --2- 172.21.15.79:0/14531884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a9c10ce00 0x7f8a9c19e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:12.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.885+0000 7f8aa13b7640 1 -- 172.21.15.79:0/14531884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a9c1039a0 msgr2=0x7f8a9c198e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:12.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.885+0000 7f8aa13b7640 1 --2- 172.21.15.79:0/14531884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a9c1039a0 0x7f8a9c198e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:12.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.885+0000 7f8aa13b7640 1 -- 172.21.15.79:0/14531884 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a9c19eec0 con 0x7f8a9c1042c0 2024-08-20T01:43:12.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.886+0000 7f8aa13b7640 1 --2- 172.21.15.79:0/14531884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a9c1042c0 0x7f8a9c199350 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c00c970 tx=0x7f8a8c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:12.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.886+0000 7f8a92ffd640 1 -- 172.21.15.79:0/14531884 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c007bb0 con 0x7f8a9c1042c0 2024-08-20T01:43:12.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.886+0000 7f8a92ffd640 1 -- 172.21.15.79:0/14531884 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8a8c007d50 con 0x7f8a9c1042c0 2024-08-20T01:43:12.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.886+0000 7f8aa3e1c640 1 -- 172.21.15.79:0/14531884 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a9c19f1b0 con 0x7f8a9c1042c0 2024-08-20T01:43:12.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.886+0000 7f8a92ffd640 1 -- 172.21.15.79:0/14531884 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c00f6b0 con 0x7f8a9c1042c0 2024-08-20T01:43:12.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.886+0000 7f8aa3e1c640 1 -- 172.21.15.79:0/14531884 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a9c1a5870 con 0x7f8a9c1042c0 2024-08-20T01:43:12.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.889+0000 7f8aa6215740 1 Processor -- start 2024-08-20T01:43:12.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.889+0000 7f8aa6215740 1 -- start start 2024-08-20T01:43:12.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.890+0000 7f8aa6215740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56326bd7ac40 0x56326bd7b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:12.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.890+0000 7f8aa6215740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326bd7b560 0x56326bd86fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:12.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.890+0000 7f8aa6215740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56326bd874f0 0x56326bd898e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:12.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.890+0000 7f8aa6215740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56326bced8e0 con 0x56326bd7b560 2024-08-20T01:43:12.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.890+0000 7f8aa6215740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56326bcdcde0 con 0x56326bd7ac40 2024-08-20T01:43:12.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.890+0000 7f8aa6215740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56326bce0e20 con 0x56326bd874f0 2024-08-20T01:43:12.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.890+0000 7f8a92ffd640 1 -- 172.21.15.79:0/14531884 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f8a8c018480 con 0x7f8a9c1042c0 2024-08-20T01:43:12.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.890+0000 7f8aa1bb8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326bd7b560 0x56326bd86fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:12.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.890+0000 7f8aa23b9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56326bd7ac40 0x56326bd7b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:12.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.890+0000 7f8aa23b9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56326bd7ac40 0x56326bd7b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:46154/0 (socket says 172.21.15.79:46154) 2024-08-20T01:43:12.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.890+0000 7f8aa23b9640 1 -- 172.21.15.79:0/686583326 learned_addr learned my addr 172.21.15.79:0/686583326 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:12.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.890+0000 7f8aa13b7640 1 --2- 172.21.15.79:0/686583326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56326bd874f0 0x56326bd898e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:12.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.890+0000 7f8aa23b9640 1 -- 172.21.15.79:0/686583326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56326bd874f0 msgr2=0x56326bd898e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:12.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.890+0000 7f8aa23b9640 1 --2- 172.21.15.79:0/686583326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56326bd874f0 0x56326bd898e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:12.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.890+0000 7f8aa23b9640 1 -- 172.21.15.79:0/686583326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326bd7b560 msgr2=0x56326bd86fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:12.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.890+0000 7f8aa23b9640 1 --2- 172.21.15.79:0/686583326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326bd7b560 0x56326bd86fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:12.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.890+0000 7f8aa23b9640 1 -- 172.21.15.79:0/686583326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56326ba3c650 con 0x56326bd7ac40 2024-08-20T01:43:12.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.890+0000 7f8aa13b7640 1 --2- 172.21.15.79:0/686583326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56326bd874f0 0x56326bd898e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:43:12.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.891+0000 7f8aa23b9640 1 --2- 172.21.15.79:0/686583326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56326bd7ac40 0x56326bd7b020 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8a94009fd0 tx=0x7f8a940118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b891bb40ecf52e4d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:12.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.891+0000 7f8a87fff640 1 -- 172.21.15.79:0/686583326 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a94004d20 con 0x56326bd7ac40 2024-08-20T01:43:12.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.891+0000 7f8a87fff640 1 -- 172.21.15.79:0/686583326 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8a94004050 con 0x56326bd7ac40 2024-08-20T01:43:12.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.891+0000 7f8a87fff640 1 -- 172.21.15.79:0/686583326 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a94005260 con 0x56326bd7ac40 2024-08-20T01:43:12.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.891+0000 7f8a92ffd640 1 --2- 172.21.15.79:0/14531884 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f8a880b3bd0 0x7f8a880b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:12.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.891+0000 7f8a92ffd640 1 -- 172.21.15.79:0/14531884 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f8a8c0e3e50 con 0x7f8a9c1042c0 2024-08-20T01:43:12.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.891+0000 7f8aa1bb8640 1 --2- 172.21.15.79:0/14531884 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f8a880b3bd0 0x7f8a880b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:12.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.892+0000 7f8aa6215740 1 -- 172.21.15.79:0/686583326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56326bd7ac40 msgr2=0x56326bd7b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:12.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.892+0000 7f8aa6215740 1 --2- 172.21.15.79:0/686583326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56326bd7ac40 0x56326bd7b020 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8a94009fd0 tx=0x7f8a940118d0 comp rx=0 tx=0).stop 2024-08-20T01:43:12.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.892+0000 7f8aa6215740 1 -- 172.21.15.79:0/686583326 shutdown_connections 2024-08-20T01:43:12.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.892+0000 7f8aa6215740 1 --2- 172.21.15.79:0/686583326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56326bd874f0 0x56326bd898e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:12.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.892+0000 7f8aa6215740 1 --2- 172.21.15.79:0/686583326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326bd7b560 0x56326bd86fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:12.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.892+0000 7f8aa6215740 1 --2- 172.21.15.79:0/686583326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56326bd7ac40 0x56326bd7b020 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:12.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.892+0000 7f8aa6215740 1 -- 172.21.15.79:0/686583326 >> 172.21.15.79:0/686583326 conn(0x56326bd78a70 msgr2=0x56326bd79c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:12.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.892+0000 7f8aa6215740 1 -- 172.21.15.79:0/686583326 shutdown_connections 2024-08-20T01:43:12.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.892+0000 7f8aa6215740 1 -- 172.21.15.79:0/686583326 wait complete. 2024-08-20T01:43:12.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.892+0000 7f8aa1bb8640 1 --2- 172.21.15.79:0/14531884 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f8a880b3bd0 0x7f8a880b6090 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8a980057c0 tx=0x7f8a980058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:12.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.892+0000 7f8aa6215740 1 -- start start 2024-08-20T01:43:12.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.892+0000 7f8aa6215740 1 Processor -- start 2024-08-20T01:43:12.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.893+0000 7f8aa6215740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56326bd7ac40 0x56326bd84430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:12.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.893+0000 7f8aa6215740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326bd7b560 0x56326bd84970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:12.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.893+0000 7f8aa6215740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56326bd874f0 0x56326bd84eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:12.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.893+0000 7f8aa6215740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56326bb3f700 con 0x56326bd7b560 2024-08-20T01:43:12.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.893+0000 7f8aa6215740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56326bc637c0 con 0x56326bd874f0 2024-08-20T01:43:12.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.893+0000 7f8aa6215740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56326bd8a170 con 0x56326bd7ac40 2024-08-20T01:43:12.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.893+0000 7f8aa13b7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326bd7b560 0x56326bd84970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:12.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.893+0000 7f8aa6215740 10 client.0 _ll_register_callbacks cb 0x56326bcd66b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:43:12.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.893+0000 7f8aa13b7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326bd7b560 0x56326bd84970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52936/0 (socket says 172.21.15.79:52936) 2024-08-20T01:43:12.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.893+0000 7f8aa13b7640 1 -- 172.21.15.79:0/1026370318 learned_addr learned my addr 172.21.15.79:0/1026370318 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:12.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.893+0000 7f8aa1bb8640 1 --2- 172.21.15.79:0/1026370318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56326bd7ac40 0x56326bd84430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:12.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.893+0000 7f8aa13b7640 1 -- 172.21.15.79:0/1026370318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56326bd7ac40 msgr2=0x56326bd84430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:12.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.894+0000 7f8aa13b7640 1 --2- 172.21.15.79:0/1026370318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56326bd7ac40 0x56326bd84430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:12.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.894+0000 7f8aa13b7640 1 -- 172.21.15.79:0/1026370318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56326bd874f0 msgr2=0x56326bd84eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:12.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.894+0000 7f8aa13b7640 1 --2- 172.21.15.79:0/1026370318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56326bd874f0 0x56326bd84eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:12.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.894+0000 7f8aa13b7640 1 -- 172.21.15.79:0/1026370318 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56326bd93500 con 0x56326bd7b560 2024-08-20T01:43:12.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.894+0000 7f8aa1bb8640 1 --2- 172.21.15.79:0/1026370318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56326bd7ac40 0x56326bd84430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:43:12.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.894+0000 7f8aa13b7640 1 --2- 172.21.15.79:0/1026370318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326bd7b560 0x56326bd84970 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c0aad70 tx=0x7f8a8c0ab400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a549c4a306f4f6da server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:12.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.894+0000 7f8a857fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:43:12.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.894+0000 7f8a857fa640 1 -- 172.21.15.79:0/1026370318 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c0ae070 con 0x56326bd7b560 2024-08-20T01:43:12.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.894+0000 7f8a857fa640 1 -- 172.21.15.79:0/1026370318 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f8a8c018980 con 0x56326bd7b560 2024-08-20T01:43:12.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.894+0000 7f8aa6215740 1 -- 172.21.15.79:0/1026370318 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56326bc8c100 con 0x56326bd7b560 2024-08-20T01:43:12.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.894+0000 7f8a857fa640 1 -- 172.21.15.79:0/1026370318 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f8a8c0aade0 con 0x56326bd7b560 2024-08-20T01:43:12.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.894+0000 7f8aa6215740 10 client.17241 fetch_fsmap learned FSMap version 38 2024-08-20T01:43:12.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.894+0000 7f8aa6215740 1 -- 172.21.15.79:0/1026370318 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x56326bd95e80 con 0x56326bd7b560 2024-08-20T01:43:12.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.895+0000 7f8a857fa640 1 -- 172.21.15.79:0/1026370318 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8a8c0af3e0 con 0x56326bd7b560 2024-08-20T01:43:12.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.895+0000 7f8a857fa640 1 -- 172.21.15.79:0/1026370318 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f8a8c0a9ab0 con 0x56326bd7b560 2024-08-20T01:43:12.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.895+0000 7f8aa6215740 10 client.17241 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:43:12.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.895+0000 7f8aa6215740 10 client.17241 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:43:12.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.895+0000 7f8aa6215740 20 client.17241 populate_metadata read hostname 'smithi079' 2024-08-20T01:43:12.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.895+0000 7f8aa6215740 1 --2- 172.21.15.79:0/1026370318 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56326bd97850 0x56326bd99cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:12.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.895+0000 7f8aa6215740 4 client.17241 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:43:12.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.895+0000 7f8aa6215740 1 -- 172.21.15.79:0/1026370318 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56326bc8c100 con 0x56326bd97850 2024-08-20T01:43:12.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.895+0000 7f8aa1bb8640 1 --2- 172.21.15.79:0/1026370318 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56326bd97850 0x56326bd99cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:12.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.895+0000 7f8a857fa640 10 client.17241 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:43:12.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.896+0000 7f8aa1bb8640 1 --2- 172.21.15.79:0/1026370318 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56326bd97850 0x56326bd99cf0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d595aeead5ca3c81 server_cookie=455ff1c6a675c4a3 in_seq=0 out_seq=0 2024-08-20T01:43:12.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.896+0000 7f8a857fa640 1 -- 172.21.15.79:0/1026370318 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56326bc8c100 con 0x56326bd97850 2024-08-20T01:43:12.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.896+0000 7f8a857fa640 10 client.17241 handle_command_reply: tid=0 2024-08-20T01:43:12.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.896+0000 7f8aa6215740 1 client.17241 shutdown 2024-08-20T01:43:12.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.897+0000 7f8aa6215740 1 -- 172.21.15.79:0/1026370318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326bd7b560 msgr2=0x56326bd84970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:12.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.897+0000 7f8aa6215740 1 --2- 172.21.15.79:0/1026370318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326bd7b560 0x56326bd84970 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c0aad70 tx=0x7f8a8c0ab400 comp rx=0 tx=0).stop 2024-08-20T01:43:12.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.897+0000 7f8aa6215740 1 -- 172.21.15.79:0/1026370318 shutdown_connections 2024-08-20T01:43:12.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.897+0000 7f8aa6215740 1 --2- 172.21.15.79:0/1026370318 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56326bd97850 0x56326bd99cf0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:12.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.897+0000 7f8aa6215740 1 --2- 172.21.15.79:0/1026370318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56326bd874f0 0x56326bd84eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:12.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.897+0000 7f8a857fa640 0 client.17241 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:43:12.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.897+0000 7f8aa6215740 1 --2- 172.21.15.79:0/1026370318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326bd7b560 0x56326bd84970 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:12.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.897+0000 7f8aa6215740 1 --2- 172.21.15.79:0/1026370318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56326bd7ac40 0x56326bd84430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:12.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.897+0000 7f8aa6215740 1 -- 172.21.15.79:0/1026370318 >> 172.21.15.79:0/1026370318 conn(0x56326bd78a70 msgr2=0x56326bd7e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:12.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.897+0000 7f8aa6215740 1 -- 172.21.15.79:0/1026370318 shutdown_connections 2024-08-20T01:43:12.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.897+0000 7f8aa6215740 1 -- 172.21.15.79:0/1026370318 wait complete. 2024-08-20T01:43:12.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.897+0000 7f8aa6215740 20 client.17241 trim_cache size 0 max 16384 2024-08-20T01:43:12.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.919+0000 7f8aa6215740 1 Processor -- start 2024-08-20T01:43:12.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.919+0000 7f8aa6215740 1 -- start start 2024-08-20T01:43:12.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.919+0000 7f8aa6215740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56326bd7ac40 0x56326bd7a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:12.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.919+0000 7f8aa6215740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56326bd7b560 0x56326bd7ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:12.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.919+0000 7f8aa6215740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326bd874f0 0x56326bd9f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:12.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.919+0000 7f8aa6215740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c1abcd0 con 0x56326bd874f0 2024-08-20T01:43:12.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.919+0000 7f8aa6215740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c1ad810 con 0x56326bd7b560 2024-08-20T01:43:12.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.919+0000 7f8aa6215740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c1ac3a0 con 0x56326bd7ac40 2024-08-20T01:43:12.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.919+0000 7f8aa23b9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326bd874f0 0x56326bd9f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:12.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.920+0000 7f8aa23b9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326bd874f0 0x56326bd9f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52938/0 (socket says 172.21.15.79:52938) 2024-08-20T01:43:12.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.920+0000 7f8aa23b9640 1 -- 172.21.15.79:0/671299251 learned_addr learned my addr 172.21.15.79:0/671299251 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:12.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.920+0000 7f8aa13b7640 1 --2- 172.21.15.79:0/671299251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56326bd7b560 0x56326bd7ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:12.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.920+0000 7f8aa1bb8640 1 --2- 172.21.15.79:0/671299251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56326bd7ac40 0x56326bd7a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:12.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.920+0000 7f8aa23b9640 1 -- 172.21.15.79:0/671299251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56326bd7ac40 msgr2=0x56326bd7a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:12.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.920+0000 7f8aa23b9640 1 --2- 172.21.15.79:0/671299251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56326bd7ac40 0x56326bd7a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:12.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.920+0000 7f8aa23b9640 1 -- 172.21.15.79:0/671299251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56326bd7b560 msgr2=0x56326bd7ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:12.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.920+0000 7f8aa23b9640 1 --2- 172.21.15.79:0/671299251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56326bd7b560 0x56326bd7ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:12.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.920+0000 7f8aa23b9640 1 -- 172.21.15.79:0/671299251 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56326bd7f1f0 con 0x56326bd874f0 2024-08-20T01:43:12.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.920+0000 7f8aa13b7640 1 --2- 172.21.15.79:0/671299251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56326bd7b560 0x56326bd7ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:43:12.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.920+0000 7f8aa23b9640 1 --2- 172.21.15.79:0/671299251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326bd874f0 0x56326bd9f600 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f8a94009be0 tx=0x7f8a94009c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf91a29f0653c45d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:12.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.920+0000 7f8a877fe640 1 -- 172.21.15.79:0/671299251 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a94003a30 con 0x56326bd874f0 2024-08-20T01:43:12.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.920+0000 7f8a877fe640 1 -- 172.21.15.79:0/671299251 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8a94005550 con 0x56326bd874f0 2024-08-20T01:43:12.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.920+0000 7f8a877fe640 1 -- 172.21.15.79:0/671299251 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9400f950 con 0x56326bd874f0 2024-08-20T01:43:12.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.921+0000 7f8aa6215740 1 -- 172.21.15.79:0/671299251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326bd874f0 msgr2=0x56326bd9f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:12.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.921+0000 7f8aa6215740 1 --2- 172.21.15.79:0/671299251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326bd874f0 0x56326bd9f600 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f8a94009be0 tx=0x7f8a94009c10 comp rx=0 tx=0).stop 2024-08-20T01:43:12.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.921+0000 7f8aa6215740 1 -- 172.21.15.79:0/671299251 shutdown_connections 2024-08-20T01:43:12.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.921+0000 7f8aa6215740 1 --2- 172.21.15.79:0/671299251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326bd874f0 0x56326bd9f600 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:12.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.921+0000 7f8aa6215740 1 --2- 172.21.15.79:0/671299251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56326bd7b560 0x56326bd7ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:12.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.921+0000 7f8aa6215740 1 --2- 172.21.15.79:0/671299251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56326bd7ac40 0x56326bd7a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:12.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.921+0000 7f8aa6215740 1 -- 172.21.15.79:0/671299251 >> 172.21.15.79:0/671299251 conn(0x56326bd78a70 msgr2=0x56326bd79b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:12.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.921+0000 7f8aa6215740 1 -- 172.21.15.79:0/671299251 shutdown_connections 2024-08-20T01:43:12.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.921+0000 7f8aa6215740 1 -- 172.21.15.79:0/671299251 wait complete. 2024-08-20T01:43:12.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.922+0000 7f8aa6215740 1 -- start start 2024-08-20T01:43:12.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.922+0000 7f8aa6215740 1 Processor -- start 2024-08-20T01:43:12.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.922+0000 7f8aa6215740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326bd7ac40 0x56326bd8fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:12.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.922+0000 7f8aa6215740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56326bd7b560 0x56326bd8a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:12.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.922+0000 7f8aa6215740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56326bd874f0 0x56326bd8ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:12.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.922+0000 7f8aa6215740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c1ad140 con 0x56326bd7ac40 2024-08-20T01:43:12.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.922+0000 7f8aa6215740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c1aca70 con 0x56326bd874f0 2024-08-20T01:43:12.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.922+0000 7f8aa6215740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c1a9cd0 con 0x56326bd7b560 2024-08-20T01:43:12.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.922+0000 7f8aa6215740 10 client.0 _ll_register_callbacks cb 0x7f8a8c0046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:43:12.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.922+0000 7f8aa1bb8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326bd7ac40 0x56326bd8fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:12.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.922+0000 7f8aa1bb8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326bd7ac40 0x56326bd8fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52954/0 (socket says 172.21.15.79:52954) 2024-08-20T01:43:12.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.922+0000 7f8aa1bb8640 1 -- 172.21.15.79:0/2711552379 learned_addr learned my addr 172.21.15.79:0/2711552379 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:12.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.922+0000 7f8aa13b7640 1 --2- 172.21.15.79:0/2711552379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56326bd7b560 0x56326bd8a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:12.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.922+0000 7f8aa23b9640 1 --2- 172.21.15.79:0/2711552379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56326bd874f0 0x56326bd8ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:12.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.923+0000 7f8aa13b7640 1 -- 172.21.15.79:0/2711552379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56326bd874f0 msgr2=0x56326bd8ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:12.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.923+0000 7f8aa13b7640 1 --2- 172.21.15.79:0/2711552379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56326bd874f0 0x56326bd8ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:12.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.923+0000 7f8aa13b7640 1 -- 172.21.15.79:0/2711552379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326bd7ac40 msgr2=0x56326bd8fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:12.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.923+0000 7f8aa13b7640 1 --2- 172.21.15.79:0/2711552379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326bd7ac40 0x56326bd8fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:12.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.923+0000 7f8aa13b7640 1 -- 172.21.15.79:0/2711552379 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56326be005c0 con 0x56326bd7b560 2024-08-20T01:43:12.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.923+0000 7f8aa23b9640 1 --2- 172.21.15.79:0/2711552379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56326bd874f0 0x56326bd8ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:43:12.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.923+0000 7f8aa1bb8640 1 --2- 172.21.15.79:0/2711552379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326bd7ac40 0x56326bd8fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:43:12.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.923+0000 7f8aa13b7640 1 --2- 172.21.15.79:0/2711552379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56326bd7b560 0x56326bd8a3f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c01f000 tx=0x7f8a8c018bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8485f68a5be4355e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:12.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.923+0000 7f8a857fa640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:43:12.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.923+0000 7f8a857fa640 1 -- 172.21.15.79:0/2711552379 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c0ae070 con 0x56326bd7b560 2024-08-20T01:43:12.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.923+0000 7f8a857fa640 1 -- 172.21.15.79:0/2711552379 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f8a8c0aa040 con 0x56326bd7b560 2024-08-20T01:43:12.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.923+0000 7f8aa6215740 1 -- 172.21.15.79:0/2711552379 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56326bd6f830 con 0x56326bd7b560 2024-08-20T01:43:12.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.923+0000 7f8a857fa640 1 -- 172.21.15.79:0/2711552379 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f8a8c0aa730 con 0x56326bd7b560 2024-08-20T01:43:12.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.923+0000 7f8aa6215740 10 client.26338 fetch_fsmap learned FSMap version 38 2024-08-20T01:43:12.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.923+0000 7f8aa6215740 1 -- 172.21.15.79:0/2711552379 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x56326be017f0 con 0x56326bd7b560 2024-08-20T01:43:12.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.924+0000 7f8a857fa640 1 -- 172.21.15.79:0/2711552379 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56326bd6f830 con 0x56326bd7b560 2024-08-20T01:43:12.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.924+0000 7f8a857fa640 1 -- 172.21.15.79:0/2711552379 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f8a8c0920c0 con 0x56326bd7b560 2024-08-20T01:43:12.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.924+0000 7f8aa6215740 10 client.26338 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:43:12.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.924+0000 7f8aa6215740 10 client.26338 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:43:12.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.924+0000 7f8aa6215740 20 client.26338 populate_metadata read hostname 'smithi079' 2024-08-20T01:43:12.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.924+0000 7f8aa6215740 1 --2- 172.21.15.79:0/2711552379 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56326bd97850 0x56326be03fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:12.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.924+0000 7f8aa6215740 4 client.26338 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:43:12.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.924+0000 7f8aa6215740 1 -- 172.21.15.79:0/2711552379 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56326bcef830 con 0x56326bd97850 2024-08-20T01:43:12.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.924+0000 7f8aa1bb8640 1 --2- 172.21.15.79:0/2711552379 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56326bd97850 0x56326be03fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:12.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.925+0000 7f8a857fa640 10 client.26338 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:43:12.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.925+0000 7f8aa1bb8640 1 --2- 172.21.15.79:0/2711552379 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56326bd97850 0x56326be03fb0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a031335c7b839e19 server_cookie=bee585ee21e49372 in_seq=0 out_seq=0 2024-08-20T01:43:12.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.925+0000 7f8a857fa640 1 -- 172.21.15.79:0/2711552379 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56326bcef830 con 0x56326bd97850 2024-08-20T01:43:12.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.925+0000 7f8a857fa640 10 client.26338 handle_command_reply: tid=0 2024-08-20T01:43:12.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.925+0000 7f8aa6215740 1 client.26338 shutdown 2024-08-20T01:43:12.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.925+0000 7f8aa6215740 1 -- 172.21.15.79:0/2711552379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56326bd7b560 msgr2=0x56326bd8a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:12.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.925+0000 7f8aa6215740 1 --2- 172.21.15.79:0/2711552379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56326bd7b560 0x56326bd8a3f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c01f000 tx=0x7f8a8c018bb0 comp rx=0 tx=0).stop 2024-08-20T01:43:12.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.925+0000 7f8aa6215740 1 -- 172.21.15.79:0/2711552379 shutdown_connections 2024-08-20T01:43:12.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.925+0000 7f8aa6215740 1 --2- 172.21.15.79:0/2711552379 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56326bd97850 0x56326be03fb0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:12.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.925+0000 7f8aa6215740 1 --2- 172.21.15.79:0/2711552379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56326bd874f0 0x56326bd8ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:12.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.925+0000 7f8aa6215740 1 --2- 172.21.15.79:0/2711552379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56326bd7b560 0x56326bd8a3f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:12.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.925+0000 7f8aa6215740 1 --2- 172.21.15.79:0/2711552379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56326bd7ac40 0x56326bd8fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:12.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.925+0000 7f8aa6215740 1 -- 172.21.15.79:0/2711552379 >> 172.21.15.79:0/2711552379 conn(0x56326bd78a70 msgr2=0x56326bd85a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:12.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.925+0000 7f8a857fa640 0 client.26338 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:43:12.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.925+0000 7f8aa6215740 1 -- 172.21.15.79:0/2711552379 shutdown_connections 2024-08-20T01:43:12.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.925+0000 7f8aa6215740 1 -- 172.21.15.79:0/2711552379 wait complete. 2024-08-20T01:43:12.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.925+0000 7f8aa6215740 20 client.26338 trim_cache size 0 max 16384 2024-08-20T01:43:12.933 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:43:12.933 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-08-20T01:43:12.933 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-08-20T01:43:12.933 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:43:12.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.926+0000 7f8aa3e1c640 1 -- 172.21.15.79:0/14531884 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f8a880b3bd0 msgr2=0x7f8a880b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:12.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.926+0000 7f8aa3e1c640 1 --2- 172.21.15.79:0/14531884 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f8a880b3bd0 0x7f8a880b6090 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8a980057c0 tx=0x7f8a980058d0 comp rx=0 tx=0).stop 2024-08-20T01:43:12.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.926+0000 7f8aa3e1c640 1 -- 172.21.15.79:0/14531884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a9c1042c0 msgr2=0x7f8a9c199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:12.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.926+0000 7f8aa3e1c640 1 --2- 172.21.15.79:0/14531884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a9c1042c0 0x7f8a9c199350 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c00c970 tx=0x7f8a8c00ce30 comp rx=0 tx=0).stop 2024-08-20T01:43:12.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.926+0000 7f8aa3e1c640 1 -- 172.21.15.79:0/14531884 shutdown_connections 2024-08-20T01:43:12.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.926+0000 7f8aa3e1c640 1 --2- 172.21.15.79:0/14531884 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f8a880b3bd0 0x7f8a880b6090 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:12.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.926+0000 7f8aa3e1c640 1 --2- 172.21.15.79:0/14531884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a9c10ce00 0x7f8a9c19e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:12.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.926+0000 7f8aa3e1c640 1 --2- 172.21.15.79:0/14531884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a9c1042c0 0x7f8a9c199350 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:12.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.926+0000 7f8aa3e1c640 1 --2- 172.21.15.79:0/14531884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a9c1039a0 0x7f8a9c198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:12.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.926+0000 7f8aa3e1c640 1 -- 172.21.15.79:0/14531884 >> 172.21.15.79:0/14531884 conn(0x7f8a9c0fd3e0 msgr2=0x7f8a9c0fdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:12.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.926+0000 7f8aa3e1c640 1 -- 172.21.15.79:0/14531884 shutdown_connections 2024-08-20T01:43:12.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:12.926+0000 7f8aa3e1c640 1 -- 172.21.15.79:0/14531884 wait complete. 2024-08-20T01:43:13.827 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T01:43:13.827 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:43:14.101 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:43:14.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:14 smithi079 ceph-mon[18656]: pgmap v524: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 29 MiB/s wr, 22 op/s 2024-08-20T01:43:14.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:14 smithi175 ceph-mon[22392]: pgmap v524: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 29 MiB/s wr, 22 op/s 2024-08-20T01:43:14.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.629+0000 7fd377b12640 1 -- 172.21.15.79:0/2945919512 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd37010f160 msgr2=0x7fd370111550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:14.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.629+0000 7fd377b12640 1 --2- 172.21.15.79:0/2945919512 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd37010f160 0x7fd370111550 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fd368009ca0 tx=0x7fd36802a8c0 comp rx=0 tx=0).stop 2024-08-20T01:43:14.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.629+0000 7fd377b12640 1 -- 172.21.15.79:0/2945919512 shutdown_connections 2024-08-20T01:43:14.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.629+0000 7fd377b12640 1 --2- 172.21.15.79:0/2945919512 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd37010f160 0x7fd370111550 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:14.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.629+0000 7fd377b12640 1 --2- 172.21.15.79:0/2945919512 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd370101ed0 0x7fd37010ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:14.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.629+0000 7fd377b12640 1 --2- 172.21.15.79:0/2945919512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3701015b0 0x7fd370101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:14.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.629+0000 7fd377b12640 1 -- 172.21.15.79:0/2945919512 >> 172.21.15.79:0/2945919512 conn(0x7fd3700fd420 msgr2=0x7fd3700ff840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:14.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.629+0000 7fd377b12640 1 -- 172.21.15.79:0/2945919512 shutdown_connections 2024-08-20T01:43:14.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.629+0000 7fd377b12640 1 -- 172.21.15.79:0/2945919512 wait complete. 2024-08-20T01:43:14.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.629+0000 7fd377b12640 1 Processor -- start 2024-08-20T01:43:14.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.630+0000 7fd377b12640 1 -- start start 2024-08-20T01:43:14.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.630+0000 7fd377b12640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3701015b0 0x7fd37019b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:14.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.630+0000 7fd377b12640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd370101ed0 0x7fd37019b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:14.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.630+0000 7fd377b12640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd37010f160 0x7fd3701a0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:14.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.630+0000 7fd377b12640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd370114bc0 con 0x7fd370101ed0 2024-08-20T01:43:14.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.630+0000 7fd377b12640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd370114a40 con 0x7fd37010f160 2024-08-20T01:43:14.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.630+0000 7fd377b12640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd370114d40 con 0x7fd3701015b0 2024-08-20T01:43:14.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.630+0000 7fd3750ad640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd370101ed0 0x7fd37019b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:14.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.630+0000 7fd3750ad640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd370101ed0 0x7fd37019b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52978/0 (socket says 172.21.15.79:52978) 2024-08-20T01:43:14.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.630+0000 7fd3758ae640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3701015b0 0x7fd37019b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:14.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.630+0000 7fd3750ad640 1 -- 172.21.15.79:0/4205054706 learned_addr learned my addr 172.21.15.79:0/4205054706 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:14.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.630+0000 7fd3750ad640 1 -- 172.21.15.79:0/4205054706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3701015b0 msgr2=0x7fd37019b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:14.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.630+0000 7fd3750ad640 1 --2- 172.21.15.79:0/4205054706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3701015b0 0x7fd37019b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:14.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.630+0000 7fd3750ad640 1 -- 172.21.15.79:0/4205054706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd37010f160 msgr2=0x7fd3701a0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:14.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.630+0000 7fd3760af640 1 --2- 172.21.15.79:0/4205054706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd37010f160 0x7fd3701a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:14.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.630+0000 7fd3750ad640 1 --2- 172.21.15.79:0/4205054706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd37010f160 0x7fd3701a0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:14.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.630+0000 7fd3750ad640 1 -- 172.21.15.79:0/4205054706 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3701a1140 con 0x7fd370101ed0 2024-08-20T01:43:14.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.630+0000 7fd3760af640 1 --2- 172.21.15.79:0/4205054706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd37010f160 0x7fd3701a0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:43:14.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.631+0000 7fd3750ad640 1 --2- 172.21.15.79:0/4205054706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd370101ed0 0x7fd37019b5d0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fd36000d950 tx=0x7fd36000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:14.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.631+0000 7fd366ffd640 1 -- 172.21.15.79:0/4205054706 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd360017070 con 0x7fd370101ed0 2024-08-20T01:43:14.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.631+0000 7fd366ffd640 1 -- 172.21.15.79:0/4205054706 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd360009c30 con 0x7fd370101ed0 2024-08-20T01:43:14.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.631+0000 7fd366ffd640 1 -- 172.21.15.79:0/4205054706 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd36000f620 con 0x7fd370101ed0 2024-08-20T01:43:14.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.631+0000 7fd377b12640 1 -- 172.21.15.79:0/4205054706 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3701a1430 con 0x7fd370101ed0 2024-08-20T01:43:14.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.631+0000 7fd377b12640 1 -- 172.21.15.79:0/4205054706 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3701a7cc0 con 0x7fd370101ed0 2024-08-20T01:43:14.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.632+0000 7fd377b12640 1 -- 172.21.15.79:0/4205054706 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd37006b830 con 0x7fd370101ed0 2024-08-20T01:43:14.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.633+0000 7fd366ffd640 1 -- 172.21.15.79:0/4205054706 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fd360010460 con 0x7fd370101ed0 2024-08-20T01:43:14.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.634+0000 7fd366ffd640 1 --2- 172.21.15.79:0/4205054706 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd35c0b3c50 0x7fd35c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:14.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.634+0000 7fd3758ae640 1 --2- 172.21.15.79:0/4205054706 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd35c0b3c50 0x7fd35c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:14.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.634+0000 7fd366ffd640 1 -- 172.21.15.79:0/4205054706 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fd3600e37a0 con 0x7fd370101ed0 2024-08-20T01:43:14.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.635+0000 7fd3758ae640 1 --2- 172.21.15.79:0/4205054706 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd35c0b3c50 0x7fd35c0b6110 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd36c00bbe0 tx=0x7fd36c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:14.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.638+0000 7fd366ffd640 1 -- 172.21.15.79:0/4205054706 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fd3600aae80 con 0x7fd370101ed0 2024-08-20T01:43:14.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:14 smithi081 ceph-mon[22209]: pgmap v524: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 29 MiB/s wr, 22 op/s 2024-08-20T01:43:14.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.897+0000 7fd377b12640 1 -- 172.21.15.79:0/4205054706 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd370101990 con 0x7fd370101ed0 2024-08-20T01:43:14.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.898+0000 7fd366ffd640 1 -- 172.21.15.79:0/4205054706 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+11973 (secure 0 0 0) 0x7fd3600bfe20 con 0x7fd370101ed0 2024-08-20T01:43:14.900 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:43:14.901 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":38,"btime":"2024-08-20T01:41:11:144850+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14670,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/735082912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":735082912},{"type":"v1","addr":"172.21.15.79:6835","nonce":735082912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2150339873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2150339873},{"type":"v1","addr":"172.21.15.79:6837","nonce":2150339873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":38,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:34:55.133562+0000","modified":"2024-08-20T01:41:10.892487+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24539,"mds_1":24538,"mds_2":24523,"mds_3":24514,"mds_4":24512},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14724":{"gid":14724,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/1071242274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1071242274},{"type":"v1","addr":"172.21.15.79:6839","nonce":1071242274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14730":{"gid":14730,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6841/2448977611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":2448977611},{"type":"v1","addr":"172.21.15.79:6841","nonce":2448977611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/1257507005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1257507005},{"type":"v1","addr":"172.21.15.81:6833","nonce":1257507005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1499936216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1499936216},{"type":"v1","addr":"172.21.15.81:6835","nonce":1499936216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/1107229215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1107229215},{"type":"v1","addr":"172.21.15.175:6833","nonce":1107229215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6837/2073598870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2073598870},{"type":"v1","addr":"172.21.15.81:6837","nonce":2073598870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/2552601173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2552601173},{"type":"v1","addr":"172.21.15.175:6835","nonce":2552601173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6837/1767284089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1767284089},{"type":"v1","addr":"172.21.15.175:6837","nonce":1767284089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/1331748742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1331748742},{"type":"v1","addr":"172.21.15.175:6839","nonce":1331748742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/4098410583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":4098410583},{"type":"v1","addr":"172.21.15.81:6839","nonce":4098410583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24539,"qdb_cluster":[24512,24538,24514,24523,24539]},"id":1}]} 2024-08-20T01:43:14.901 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 38 2024-08-20T01:43:14.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.900+0000 7fd377b12640 1 -- 172.21.15.79:0/4205054706 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd35c0b3c50 msgr2=0x7fd35c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:14.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.900+0000 7fd377b12640 1 --2- 172.21.15.79:0/4205054706 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd35c0b3c50 0x7fd35c0b6110 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd36c00bbe0 tx=0x7fd36c00b390 comp rx=0 tx=0).stop 2024-08-20T01:43:14.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.900+0000 7fd377b12640 1 -- 172.21.15.79:0/4205054706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd370101ed0 msgr2=0x7fd37019b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:14.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.900+0000 7fd377b12640 1 --2- 172.21.15.79:0/4205054706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd370101ed0 0x7fd37019b5d0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fd36000d950 tx=0x7fd36000de10 comp rx=0 tx=0).stop 2024-08-20T01:43:14.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.900+0000 7fd377b12640 1 -- 172.21.15.79:0/4205054706 shutdown_connections 2024-08-20T01:43:14.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.900+0000 7fd377b12640 1 --2- 172.21.15.79:0/4205054706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd37010f160 0x7fd3701a0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:14.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.900+0000 7fd377b12640 1 --2- 172.21.15.79:0/4205054706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd370101ed0 0x7fd37019b5d0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:14.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.900+0000 7fd377b12640 1 --2- 172.21.15.79:0/4205054706 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd35c0b3c50 0x7fd35c0b6110 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:14.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.900+0000 7fd377b12640 1 --2- 172.21.15.79:0/4205054706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3701015b0 0x7fd37019b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:14.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.900+0000 7fd377b12640 1 -- 172.21.15.79:0/4205054706 >> 172.21.15.79:0/4205054706 conn(0x7fd3700fd420 msgr2=0x7fd3700ff810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:14.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.901+0000 7fd377b12640 1 -- 172.21.15.79:0/4205054706 shutdown_connections 2024-08-20T01:43:14.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:14.901+0000 7fd377b12640 1 -- 172.21.15.79:0/4205054706 wait complete. 2024-08-20T01:43:15.606 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:15 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/4205054706' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:43:15.635 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-20T01:43:15.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:15 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/4205054706' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:43:15.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:15 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/4205054706' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:43:15.908 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:43:16.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.455+0000 7f96197fe640 1 -- 172.21.15.79:0/1826519106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9614107d20 msgr2=0x7f961410e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:16.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.455+0000 7f96197fe640 1 --2- 172.21.15.79:0/1826519106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9614107d20 0x7f961410e520 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f960c009ca0 tx=0x7f960c02a8c0 comp rx=0 tx=0).stop 2024-08-20T01:43:16.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.455+0000 7f96197fe640 1 -- 172.21.15.79:0/1826519106 shutdown_connections 2024-08-20T01:43:16.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.455+0000 7f96197fe640 1 --2- 172.21.15.79:0/1826519106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9614107d20 0x7f961410e520 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:16.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.455+0000 7f96197fe640 1 --2- 172.21.15.79:0/1826519106 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96141073a0 0x7f96141077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:16.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.455+0000 7f96197fe640 1 --2- 172.21.15.79:0/1826519106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9614101990 0x7f9614101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:16.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.455+0000 7f96197fe640 1 -- 172.21.15.79:0/1826519106 >> 172.21.15.79:0/1826519106 conn(0x7f96140fd400 msgr2=0x7f96140ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:16.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.455+0000 7f96197fe640 1 -- 172.21.15.79:0/1826519106 shutdown_connections 2024-08-20T01:43:16.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.455+0000 7f96197fe640 1 -- 172.21.15.79:0/1826519106 wait complete. 2024-08-20T01:43:16.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.456+0000 7f96197fe640 1 Processor -- start 2024-08-20T01:43:16.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.456+0000 7f96197fe640 1 -- start start 2024-08-20T01:43:16.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.456+0000 7f96197fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9614101990 0x7f961419aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:16.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.456+0000 7f96197fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96141073a0 0x7f961419b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:16.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.456+0000 7f96197fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9614107d20 0x7f96141a08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:16.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.456+0000 7f96197fe640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f96141118a0 con 0x7f9614107d20 2024-08-20T01:43:16.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.456+0000 7f96197fe640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9614111720 con 0x7f9614101990 2024-08-20T01:43:16.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.456+0000 7f96197fe640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9614111a20 con 0x7f96141073a0 2024-08-20T01:43:16.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.456+0000 7f96137fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9614107d20 0x7f96141a08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:16.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.456+0000 7f96137fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9614107d20 0x7f96141a08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52992/0 (socket says 172.21.15.79:52992) 2024-08-20T01:43:16.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.456+0000 7f96137fe640 1 -- 172.21.15.79:0/2256752171 learned_addr learned my addr 172.21.15.79:0/2256752171 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:16.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.456+0000 7f9612ffd640 1 --2- 172.21.15.79:0/2256752171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9614101990 0x7f961419aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:16.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.456+0000 7f960bfff640 1 --2- 172.21.15.79:0/2256752171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96141073a0 0x7f961419b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:16.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.456+0000 7f96137fe640 1 -- 172.21.15.79:0/2256752171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96141073a0 msgr2=0x7f961419b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:16.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.456+0000 7f96137fe640 1 --2- 172.21.15.79:0/2256752171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96141073a0 0x7f961419b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:16.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.456+0000 7f96137fe640 1 -- 172.21.15.79:0/2256752171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9614101990 msgr2=0x7f961419aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:16.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.456+0000 7f96137fe640 1 --2- 172.21.15.79:0/2256752171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9614101990 0x7f961419aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:16.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.456+0000 7f96137fe640 1 -- 172.21.15.79:0/2256752171 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96141a10a0 con 0x7f9614107d20 2024-08-20T01:43:16.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.457+0000 7f96137fe640 1 --2- 172.21.15.79:0/2256752171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9614107d20 0x7f96141a08d0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f960c005cc0 tx=0x7f960c032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:16.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.457+0000 7f9610ff9640 1 -- 172.21.15.79:0/2256752171 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960c032e00 con 0x7f9614107d20 2024-08-20T01:43:16.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.457+0000 7f9610ff9640 1 -- 172.21.15.79:0/2256752171 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f960c0044d0 con 0x7f9614107d20 2024-08-20T01:43:16.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.457+0000 7f96197fe640 1 -- 172.21.15.79:0/2256752171 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96141a1330 con 0x7f9614107d20 2024-08-20T01:43:16.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.457+0000 7f9610ff9640 1 -- 172.21.15.79:0/2256752171 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960c030b70 con 0x7f9614107d20 2024-08-20T01:43:16.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.457+0000 7f96197fe640 1 -- 172.21.15.79:0/2256752171 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96141a7a50 con 0x7f9614107d20 2024-08-20T01:43:16.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.460+0000 7f961bbf7740 1 Processor -- start 2024-08-20T01:43:16.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.460+0000 7f9610ff9640 1 -- 172.21.15.79:0/2256752171 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f960c004680 con 0x7f9614107d20 2024-08-20T01:43:16.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.460+0000 7f961bbf7740 1 -- start start 2024-08-20T01:43:16.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.460+0000 7f961bbf7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b9d8ea3880 0x55b9d8ea3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:16.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.460+0000 7f961bbf7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9d8ea41a0 0x55b9d8eafbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:16.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.460+0000 7f961bbf7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d8eb0130 0x55b9d8eb2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:16.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.460+0000 7f961bbf7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b9d8e1a930 con 0x55b9d8ea41a0 2024-08-20T01:43:16.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.460+0000 7f961bbf7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b9d8e09e30 con 0x55b9d8ea3880 2024-08-20T01:43:16.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.460+0000 7f961bbf7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b9d8e0de70 con 0x55b9d8eb0130 2024-08-20T01:43:16.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.461+0000 7f9612ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9d8ea41a0 0x55b9d8eafbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:16.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.461+0000 7f960bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b9d8ea3880 0x55b9d8ea3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:16.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.461+0000 7f9612ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9d8ea41a0 0x55b9d8eafbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53002/0 (socket says 172.21.15.79:53002) 2024-08-20T01:43:16.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.461+0000 7f9612ffd640 1 -- 172.21.15.79:0/4131473028 learned_addr learned my addr 172.21.15.79:0/4131473028 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:16.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.461+0000 7f960bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b9d8ea3880 0x55b9d8ea3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:46218/0 (socket says 172.21.15.79:46218) 2024-08-20T01:43:16.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.461+0000 7f960bfff640 1 --2- 172.21.15.79:0/4131473028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d8eb0130 0x55b9d8eb2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:16.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.461+0000 7f9612ffd640 1 -- 172.21.15.79:0/4131473028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d8eb0130 msgr2=0x55b9d8eb2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:16.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.461+0000 7f9612ffd640 1 --2- 172.21.15.79:0/4131473028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d8eb0130 0x55b9d8eb2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:16.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.461+0000 7f9612ffd640 1 -- 172.21.15.79:0/4131473028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b9d8ea3880 msgr2=0x55b9d8ea3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:16.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.461+0000 7f9612ffd640 1 --2- 172.21.15.79:0/4131473028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b9d8ea3880 0x55b9d8ea3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:16.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.461+0000 7f9612ffd640 1 -- 172.21.15.79:0/4131473028 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9d8b69650 con 0x55b9d8ea41a0 2024-08-20T01:43:16.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.461+0000 7f9610ff9640 1 --2- 172.21.15.79:0/2256752171 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f96000b3bd0 0x7f96000b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:16.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.461+0000 7f960bfff640 1 --2- 172.21.15.79:0/2256752171 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f96000b3bd0 0x7f96000b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:16.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.461+0000 7f9612ffd640 1 --2- 172.21.15.79:0/4131473028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9d8ea41a0 0x55b9d8eafbf0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f960400ad30 tx=0x7f960400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=796bacb2b2814989 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:16.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.461+0000 7f9610ff9640 1 -- 172.21.15.79:0/2256752171 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f960c105000 con 0x7f9614107d20 2024-08-20T01:43:16.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.462+0000 7f96097fa640 1 -- 172.21.15.79:0/4131473028 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9604010840 con 0x55b9d8ea41a0 2024-08-20T01:43:16.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.462+0000 7f96097fa640 1 -- 172.21.15.79:0/4131473028 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9604014070 con 0x55b9d8ea41a0 2024-08-20T01:43:16.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.462+0000 7f96097fa640 1 -- 172.21.15.79:0/4131473028 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96040189f0 con 0x55b9d8ea41a0 2024-08-20T01:43:16.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.462+0000 7f961bbf7740 1 -- 172.21.15.79:0/4131473028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9d8ea41a0 msgr2=0x55b9d8eafbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:16.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.462+0000 7f961bbf7740 1 --2- 172.21.15.79:0/4131473028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9d8ea41a0 0x55b9d8eafbf0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f960400ad30 tx=0x7f960400f790 comp rx=0 tx=0).stop 2024-08-20T01:43:16.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.462+0000 7f960bfff640 1 --2- 172.21.15.79:0/2256752171 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f96000b3bd0 0x7f96000b6090 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x55b9d8ea3830 tx=0x7f95fc005c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:16.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.463+0000 7f961bbf7740 1 -- 172.21.15.79:0/4131473028 shutdown_connections 2024-08-20T01:43:16.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.463+0000 7f961bbf7740 1 --2- 172.21.15.79:0/4131473028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d8eb0130 0x55b9d8eb2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:16.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.463+0000 7f961bbf7740 1 --2- 172.21.15.79:0/4131473028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9d8ea41a0 0x55b9d8eafbf0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:16.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.463+0000 7f961bbf7740 1 --2- 172.21.15.79:0/4131473028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b9d8ea3880 0x55b9d8ea3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:16.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.463+0000 7f961bbf7740 1 -- 172.21.15.79:0/4131473028 >> 172.21.15.79:0/4131473028 conn(0x55b9d8ea16b0 msgr2=0x55b9d8ea2850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:16.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.463+0000 7f961bbf7740 1 -- 172.21.15.79:0/4131473028 shutdown_connections 2024-08-20T01:43:16.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.463+0000 7f961bbf7740 1 -- 172.21.15.79:0/4131473028 wait complete. 2024-08-20T01:43:16.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.463+0000 7f961bbf7740 1 -- start start 2024-08-20T01:43:16.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.463+0000 7f961bbf7740 1 Processor -- start 2024-08-20T01:43:16.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.463+0000 7f961bbf7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9d8ea3880 0x55b9d8ead080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:16.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.463+0000 7f961bbf7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d8ea41a0 0x55b9d8ead5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:16.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.463+0000 7f961bbf7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b9d8eb0130 0x55b9d8eadb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:16.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.463+0000 7f961bbf7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b9d8c6c700 con 0x55b9d8ea3880 2024-08-20T01:43:16.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.463+0000 7f961bbf7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b9d8d90810 con 0x55b9d8eb0130 2024-08-20T01:43:16.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.463+0000 7f961bbf7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b9d8eb2de0 con 0x55b9d8ea41a0 2024-08-20T01:43:16.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.463+0000 7f961bbf7740 10 client.0 _ll_register_callbacks cb 0x55b9d8e03700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:43:16.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.463+0000 7f9612ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9d8ea3880 0x55b9d8ead080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:16.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.464+0000 7f9612ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9d8ea3880 0x55b9d8ead080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53006/0 (socket says 172.21.15.79:53006) 2024-08-20T01:43:16.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.464+0000 7f9612ffd640 1 -- 172.21.15.79:0/2566701601 learned_addr learned my addr 172.21.15.79:0/2566701601 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:16.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.464+0000 7f96137fe640 1 --2- 172.21.15.79:0/2566701601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b9d8eb0130 0x55b9d8eadb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:16.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.464+0000 7f960bfff640 1 --2- 172.21.15.79:0/2566701601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d8ea41a0 0x55b9d8ead5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:16.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.464+0000 7f9612ffd640 1 -- 172.21.15.79:0/2566701601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d8ea41a0 msgr2=0x55b9d8ead5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:16.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.464+0000 7f9612ffd640 1 --2- 172.21.15.79:0/2566701601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d8ea41a0 0x55b9d8ead5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:16.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.464+0000 7f9612ffd640 1 -- 172.21.15.79:0/2566701601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b9d8eb0130 msgr2=0x55b9d8eadb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:16.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.464+0000 7f9612ffd640 1 --2- 172.21.15.79:0/2566701601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b9d8eb0130 0x55b9d8eadb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:16.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.464+0000 7f9612ffd640 1 -- 172.21.15.79:0/2566701601 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9d8ebc170 con 0x55b9d8ea3880 2024-08-20T01:43:16.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.464+0000 7f96137fe640 1 --2- 172.21.15.79:0/2566701601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b9d8eb0130 0x55b9d8eadb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:43:16.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.464+0000 7f960bfff640 1 --2- 172.21.15.79:0/2566701601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d8ea41a0 0x55b9d8ead5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:43:16.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.464+0000 7f9612ffd640 1 --2- 172.21.15.79:0/2566701601 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9d8ea3880 0x55b9d8ead080 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f9604018690 tx=0x7f96040056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bb0d9ba608ab3a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:16.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.464+0000 7f95fa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:43:16.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.464+0000 7f95fa7fc640 1 -- 172.21.15.79:0/2566701601 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9604026020 con 0x55b9d8ea3880 2024-08-20T01:43:16.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.464+0000 7f95fa7fc640 1 -- 172.21.15.79:0/2566701601 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9604018940 con 0x55b9d8ea3880 2024-08-20T01:43:16.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.464+0000 7f961bbf7740 1 -- 172.21.15.79:0/2566701601 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b9d8db9150 con 0x55b9d8ea3880 2024-08-20T01:43:16.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.464+0000 7f95fa7fc640 1 -- 172.21.15.79:0/2566701601 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f9604005d60 con 0x55b9d8ea3880 2024-08-20T01:43:16.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.464+0000 7f961bbf7740 10 client.17265 fetch_fsmap learned FSMap version 38 2024-08-20T01:43:16.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.464+0000 7f961bbf7740 1 -- 172.21.15.79:0/2566701601 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55b9d8ebeb20 con 0x55b9d8ea3880 2024-08-20T01:43:16.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.465+0000 7f95fa7fc640 1 -- 172.21.15.79:0/2566701601 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55b9d8db9150 con 0x55b9d8ea3880 2024-08-20T01:43:16.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.465+0000 7f95fa7fc640 1 -- 172.21.15.79:0/2566701601 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f9604004b50 con 0x55b9d8ea3880 2024-08-20T01:43:16.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.465+0000 7f961bbf7740 10 client.17265 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:43:16.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.465+0000 7f961bbf7740 10 client.17265 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:43:16.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.465+0000 7f961bbf7740 20 client.17265 populate_metadata read hostname 'smithi079' 2024-08-20T01:43:16.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.465+0000 7f961bbf7740 1 --2- 172.21.15.79:0/2566701601 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55b9d8ebff30 0x55b9d8ec2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:16.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.465+0000 7f961bbf7740 4 client.17265 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:43:16.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.465+0000 7f961bbf7740 1 -- 172.21.15.79:0/2566701601 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b9d8e1c880 con 0x55b9d8ebff30 2024-08-20T01:43:16.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.465+0000 7f960bfff640 1 --2- 172.21.15.79:0/2566701601 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55b9d8ebff30 0x55b9d8ec2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:16.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.466+0000 7f95fa7fc640 10 client.17265 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:43:16.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.466+0000 7f960bfff640 1 --2- 172.21.15.79:0/2566701601 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55b9d8ebff30 0x55b9d8ec2320 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=397bb974edab3915 server_cookie=681e99f9c1a4e1aa in_seq=0 out_seq=0 2024-08-20T01:43:16.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.466+0000 7f95fa7fc640 1 -- 172.21.15.79:0/2566701601 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b9d8e1c880 con 0x55b9d8ebff30 2024-08-20T01:43:16.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.466+0000 7f95fa7fc640 10 client.17265 handle_command_reply: tid=0 2024-08-20T01:43:16.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.466+0000 7f961bbf7740 1 client.17265 shutdown 2024-08-20T01:43:16.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.467+0000 7f961bbf7740 1 -- 172.21.15.79:0/2566701601 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9d8ea3880 msgr2=0x55b9d8ead080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:16.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.467+0000 7f961bbf7740 1 --2- 172.21.15.79:0/2566701601 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9d8ea3880 0x55b9d8ead080 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f9604018690 tx=0x7f96040056a0 comp rx=0 tx=0).stop 2024-08-20T01:43:16.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.467+0000 7f961bbf7740 1 -- 172.21.15.79:0/2566701601 shutdown_connections 2024-08-20T01:43:16.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.467+0000 7f961bbf7740 1 --2- 172.21.15.79:0/2566701601 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55b9d8ebff30 0x55b9d8ec2320 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:16.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.467+0000 7f961bbf7740 1 --2- 172.21.15.79:0/2566701601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b9d8eb0130 0x55b9d8eadb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:16.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.467+0000 7f961bbf7740 1 --2- 172.21.15.79:0/2566701601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d8ea41a0 0x55b9d8ead5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:16.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.467+0000 7f961bbf7740 1 --2- 172.21.15.79:0/2566701601 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9d8ea3880 0x55b9d8ead080 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:16.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.467+0000 7f961bbf7740 1 -- 172.21.15.79:0/2566701601 >> 172.21.15.79:0/2566701601 conn(0x55b9d8ea16b0 msgr2=0x55b9d8ea7250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:16.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.467+0000 7f95fa7fc640 0 client.17265 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:43:16.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.467+0000 7f961bbf7740 1 -- 172.21.15.79:0/2566701601 shutdown_connections 2024-08-20T01:43:16.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.467+0000 7f961bbf7740 1 -- 172.21.15.79:0/2566701601 wait complete. 2024-08-20T01:43:16.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.467+0000 7f961bbf7740 20 client.17265 trim_cache size 0 max 16384 2024-08-20T01:43:16.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.484+0000 7f961bbf7740 1 Processor -- start 2024-08-20T01:43:16.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.484+0000 7f961bbf7740 1 -- start start 2024-08-20T01:43:16.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.485+0000 7f961bbf7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9d8ea3880 0x55b9d8ea7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:16.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.485+0000 7f961bbf7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b9d8ea41a0 0x55b9d8eaedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:16.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.485+0000 7f961bbf7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d8eb0130 0x55b9d8ec7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:16.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.485+0000 7f961bbf7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f96141b00c0 con 0x55b9d8ea3880 2024-08-20T01:43:16.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.485+0000 7f961bbf7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f96141b1c00 con 0x55b9d8ea41a0 2024-08-20T01:43:16.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.485+0000 7f961bbf7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f96141b0790 con 0x55b9d8eb0130 2024-08-20T01:43:16.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.485+0000 7f9612ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9d8ea3880 0x55b9d8ea7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:16.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.485+0000 7f96137fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d8eb0130 0x55b9d8ec7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:16.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.485+0000 7f9612ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9d8ea3880 0x55b9d8ea7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53010/0 (socket says 172.21.15.79:53010) 2024-08-20T01:43:16.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.485+0000 7f9612ffd640 1 -- 172.21.15.79:0/1912235565 learned_addr learned my addr 172.21.15.79:0/1912235565 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:16.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.485+0000 7f960bfff640 1 --2- 172.21.15.79:0/1912235565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b9d8ea41a0 0x55b9d8eaedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:16.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.485+0000 7f96137fe640 1 -- 172.21.15.79:0/1912235565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b9d8ea41a0 msgr2=0x55b9d8eaedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:16.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.485+0000 7f96137fe640 1 --2- 172.21.15.79:0/1912235565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b9d8ea41a0 0x55b9d8eaedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:16.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.485+0000 7f96137fe640 1 -- 172.21.15.79:0/1912235565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9d8ea3880 msgr2=0x55b9d8ea7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:16.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.485+0000 7f96137fe640 1 --2- 172.21.15.79:0/1912235565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9d8ea3880 0x55b9d8ea7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:16.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.485+0000 7f96137fe640 1 -- 172.21.15.79:0/1912235565 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9d8ea2130 con 0x55b9d8eb0130 2024-08-20T01:43:16.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.486+0000 7f96137fe640 1 --2- 172.21.15.79:0/1912235565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d8eb0130 0x55b9d8ec7a40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f960c102b10 tx=0x7f960c009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7807f809463c529d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:16.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.486+0000 7f9608ff9640 1 -- 172.21.15.79:0/1912235565 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960c0cc660 con 0x55b9d8eb0130 2024-08-20T01:43:16.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.486+0000 7f9608ff9640 1 -- 172.21.15.79:0/1912235565 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f960c036040 con 0x55b9d8eb0130 2024-08-20T01:43:16.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.486+0000 7f9608ff9640 1 -- 172.21.15.79:0/1912235565 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960c0c81f0 con 0x55b9d8eb0130 2024-08-20T01:43:16.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.487+0000 7f961bbf7740 1 -- 172.21.15.79:0/1912235565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d8eb0130 msgr2=0x55b9d8ec7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:16.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.487+0000 7f961bbf7740 1 --2- 172.21.15.79:0/1912235565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d8eb0130 0x55b9d8ec7a40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f960c102b10 tx=0x7f960c009a20 comp rx=0 tx=0).stop 2024-08-20T01:43:16.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.487+0000 7f961bbf7740 1 -- 172.21.15.79:0/1912235565 shutdown_connections 2024-08-20T01:43:16.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.487+0000 7f961bbf7740 1 --2- 172.21.15.79:0/1912235565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d8eb0130 0x55b9d8ec7a40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:16.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.487+0000 7f961bbf7740 1 --2- 172.21.15.79:0/1912235565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b9d8ea41a0 0x55b9d8eaedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:16.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.487+0000 7f961bbf7740 1 --2- 172.21.15.79:0/1912235565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9d8ea3880 0x55b9d8ea7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:16.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.487+0000 7f961bbf7740 1 -- 172.21.15.79:0/1912235565 >> 172.21.15.79:0/1912235565 conn(0x55b9d8ea16b0 msgr2=0x55b9d8eae6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:16.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.487+0000 7f961bbf7740 1 -- 172.21.15.79:0/1912235565 shutdown_connections 2024-08-20T01:43:16.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.487+0000 7f961bbf7740 1 -- 172.21.15.79:0/1912235565 wait complete. 2024-08-20T01:43:16.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.487+0000 7f961bbf7740 1 -- start start 2024-08-20T01:43:16.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.487+0000 7f961bbf7740 1 Processor -- start 2024-08-20T01:43:16.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.487+0000 7f961bbf7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b9d8ea3880 0x55b9d8eb8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:16.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.487+0000 7f961bbf7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d8ea41a0 0x55b9d8eb4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:16.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.487+0000 7f961bbf7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9d8eb0130 0x55b9d8eb50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:16.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.487+0000 7f961bbf7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f96141b1530 con 0x55b9d8eb0130 2024-08-20T01:43:16.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.487+0000 7f961bbf7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f96141b0e60 con 0x55b9d8ea3880 2024-08-20T01:43:16.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.487+0000 7f961bbf7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f96141ae0a0 con 0x55b9d8ea41a0 2024-08-20T01:43:16.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.488+0000 7f961bbf7740 10 client.0 _ll_register_callbacks cb 0x7f95fc00ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:43:16.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.488+0000 7f96137fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9d8eb0130 0x55b9d8eb50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:16.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.488+0000 7f9612ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b9d8ea3880 0x55b9d8eb8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:16.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.488+0000 7f96137fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9d8eb0130 0x55b9d8eb50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53012/0 (socket says 172.21.15.79:53012) 2024-08-20T01:43:16.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.488+0000 7f96137fe640 1 -- 172.21.15.79:0/2535778917 learned_addr learned my addr 172.21.15.79:0/2535778917 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:16.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.488+0000 7f960bfff640 1 --2- 172.21.15.79:0/2535778917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d8ea41a0 0x55b9d8eb4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:16.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.488+0000 7f96137fe640 1 -- 172.21.15.79:0/2535778917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d8ea41a0 msgr2=0x55b9d8eb4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:16.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.488+0000 7f96137fe640 1 --2- 172.21.15.79:0/2535778917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d8ea41a0 0x55b9d8eb4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:16.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.488+0000 7f96137fe640 1 -- 172.21.15.79:0/2535778917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b9d8ea3880 msgr2=0x55b9d8eb8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:16.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.488+0000 7f96137fe640 1 --2- 172.21.15.79:0/2535778917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b9d8ea3880 0x55b9d8eb8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:16.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.488+0000 7f96137fe640 1 -- 172.21.15.79:0/2535778917 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9d8eb5840 con 0x55b9d8eb0130 2024-08-20T01:43:16.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.488+0000 7f960bfff640 1 --2- 172.21.15.79:0/2535778917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d8ea41a0 0x55b9d8eb4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:43:16.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.488+0000 7f9612ffd640 1 --2- 172.21.15.79:0/2535778917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b9d8ea3880 0x55b9d8eb8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:43:16.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.488+0000 7f96137fe640 1 --2- 172.21.15.79:0/2535778917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9d8eb0130 0x55b9d8eb50b0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f960c102e80 tx=0x7f960c0c86b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd8aa2e6bb861c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:16.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.488+0000 7f95fa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:43:16.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.488+0000 7f95fa7fc640 1 -- 172.21.15.79:0/2535778917 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960c090020 con 0x55b9d8eb0130 2024-08-20T01:43:16.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.488+0000 7f95fa7fc640 1 -- 172.21.15.79:0/2535778917 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f960c0c81f0 con 0x55b9d8eb0130 2024-08-20T01:43:16.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.488+0000 7f961bbf7740 1 -- 172.21.15.79:0/2535778917 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f960c036040 con 0x55b9d8eb0130 2024-08-20T01:43:16.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.489+0000 7f95fa7fc640 1 -- 172.21.15.79:0/2535778917 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f960c0d0560 con 0x55b9d8eb0130 2024-08-20T01:43:16.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.489+0000 7f961bbf7740 10 client.17271 fetch_fsmap learned FSMap version 38 2024-08-20T01:43:16.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.489+0000 7f961bbf7740 1 -- 172.21.15.79:0/2535778917 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55b9d8f299e0 con 0x55b9d8eb0130 2024-08-20T01:43:16.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.489+0000 7f95fa7fc640 1 -- 172.21.15.79:0/2535778917 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f960c036040 con 0x55b9d8eb0130 2024-08-20T01:43:16.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.489+0000 7f95fa7fc640 1 -- 172.21.15.79:0/2535778917 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f960c091220 con 0x55b9d8eb0130 2024-08-20T01:43:16.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.489+0000 7f961bbf7740 10 client.17271 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:43:16.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.489+0000 7f961bbf7740 10 client.17271 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:43:16.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.489+0000 7f961bbf7740 20 client.17271 populate_metadata read hostname 'smithi079' 2024-08-20T01:43:16.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.489+0000 7f961bbf7740 1 --2- 172.21.15.79:0/2535778917 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55b9d8f2a0a0 0x55b9d8f2c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:16.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.489+0000 7f961bbf7740 4 client.17271 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:43:16.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.489+0000 7f961bbf7740 1 -- 172.21.15.79:0/2535778917 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b9d8e18320 con 0x55b9d8f2a0a0 2024-08-20T01:43:16.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.490+0000 7f9612ffd640 1 --2- 172.21.15.79:0/2535778917 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55b9d8f2a0a0 0x55b9d8f2c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:16.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.490+0000 7f95fa7fc640 10 client.17271 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:43:16.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.490+0000 7f9612ffd640 1 --2- 172.21.15.79:0/2535778917 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55b9d8f2a0a0 0x55b9d8f2c4c0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=bb9ab7cae6c8cf4e server_cookie=e05208bbd23230ee in_seq=0 out_seq=0 2024-08-20T01:43:16.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.490+0000 7f95fa7fc640 1 -- 172.21.15.79:0/2535778917 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b9d8e18320 con 0x55b9d8f2a0a0 2024-08-20T01:43:16.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.490+0000 7f95fa7fc640 10 client.17271 handle_command_reply: tid=0 2024-08-20T01:43:16.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.490+0000 7f961bbf7740 1 client.17271 shutdown 2024-08-20T01:43:16.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.490+0000 7f961bbf7740 1 -- 172.21.15.79:0/2535778917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9d8eb0130 msgr2=0x55b9d8eb50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:16.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.490+0000 7f961bbf7740 1 --2- 172.21.15.79:0/2535778917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9d8eb0130 0x55b9d8eb50b0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f960c102e80 tx=0x7f960c0c86b0 comp rx=0 tx=0).stop 2024-08-20T01:43:16.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.490+0000 7f961bbf7740 1 -- 172.21.15.79:0/2535778917 shutdown_connections 2024-08-20T01:43:16.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.490+0000 7f961bbf7740 1 --2- 172.21.15.79:0/2535778917 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55b9d8f2a0a0 0x55b9d8f2c4c0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:16.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.491+0000 7f961bbf7740 1 --2- 172.21.15.79:0/2535778917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9d8eb0130 0x55b9d8eb50b0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:16.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.491+0000 7f961bbf7740 1 --2- 172.21.15.79:0/2535778917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9d8ea41a0 0x55b9d8eb4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:16.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.491+0000 7f961bbf7740 1 --2- 172.21.15.79:0/2535778917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b9d8ea3880 0x55b9d8eb8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:16.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.491+0000 7f961bbf7740 1 -- 172.21.15.79:0/2535778917 >> 172.21.15.79:0/2535778917 conn(0x55b9d8ea16b0 msgr2=0x55b9d8ea0770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:16.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.491+0000 7f95fa7fc640 0 client.17271 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:43:16.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.491+0000 7f961bbf7740 1 -- 172.21.15.79:0/2535778917 shutdown_connections 2024-08-20T01:43:16.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.491+0000 7f961bbf7740 1 -- 172.21.15.79:0/2535778917 wait complete. 2024-08-20T01:43:16.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.491+0000 7f961bbf7740 20 client.17271 trim_cache size 0 max 16384 2024-08-20T01:43:16.512 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:43:16.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.491+0000 7f96197fe640 1 -- 172.21.15.79:0/2256752171 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f96000b3bd0 msgr2=0x7f96000b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:16.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.491+0000 7f96197fe640 1 --2- 172.21.15.79:0/2256752171 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f96000b3bd0 0x7f96000b6090 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x55b9d8ea3830 tx=0x7f95fc005c90 comp rx=0 tx=0).stop 2024-08-20T01:43:16.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.491+0000 7f96197fe640 1 -- 172.21.15.79:0/2256752171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9614107d20 msgr2=0x7f96141a08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:16.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.491+0000 7f96197fe640 1 --2- 172.21.15.79:0/2256752171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9614107d20 0x7f96141a08d0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f960c005cc0 tx=0x7f960c032a10 comp rx=0 tx=0).stop 2024-08-20T01:43:16.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.491+0000 7f96197fe640 1 -- 172.21.15.79:0/2256752171 shutdown_connections 2024-08-20T01:43:16.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.491+0000 7f96197fe640 1 --2- 172.21.15.79:0/2256752171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9614107d20 0x7f96141a08d0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:16.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.491+0000 7f96197fe640 1 --2- 172.21.15.79:0/2256752171 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f96000b3bd0 0x7f96000b6090 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:16.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.491+0000 7f96197fe640 1 --2- 172.21.15.79:0/2256752171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96141073a0 0x7f961419b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:16.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.491+0000 7f96197fe640 1 --2- 172.21.15.79:0/2256752171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9614101990 0x7f961419aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:16.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.492+0000 7f96197fe640 1 -- 172.21.15.79:0/2256752171 >> 172.21.15.79:0/2256752171 conn(0x7f96140fd400 msgr2=0x7f961406a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:16.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.492+0000 7f96197fe640 1 -- 172.21.15.79:0/2256752171 shutdown_connections 2024-08-20T01:43:16.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:16.492+0000 7f96197fe640 1 -- 172.21.15.79:0/2256752171 wait complete. 2024-08-20T01:43:16.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:16 smithi175 ceph-mon[22392]: pgmap v525: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 32 MiB/s wr, 26 op/s 2024-08-20T01:43:16.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:16 smithi079 ceph-mon[18656]: pgmap v525: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 32 MiB/s wr, 26 op/s 2024-08-20T01:43:16.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:16 smithi081 ceph-mon[22209]: pgmap v525: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 32 MiB/s wr, 26 op/s 2024-08-20T01:43:17.345 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-20T01:43:17.624 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:43:18.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.163+0000 7f17840e1640 1 -- 172.21.15.79:0/2976622954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f177c075b30 msgr2=0x7f177c10eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:18.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.163+0000 7f17840e1640 1 --2- 172.21.15.79:0/2976622954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f177c075b30 0x7f177c10eb60 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f176c009900 tx=0x7f176c02a410 comp rx=0 tx=0).stop 2024-08-20T01:43:18.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.163+0000 7f17840e1640 1 -- 172.21.15.79:0/2976622954 shutdown_connections 2024-08-20T01:43:18.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.163+0000 7f17840e1640 1 --2- 172.21.15.79:0/2976622954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f177c10f0a0 0x7f177c111490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:18.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.163+0000 7f17840e1640 1 --2- 172.21.15.79:0/2976622954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f177c075b30 0x7f177c10eb60 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:18.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.163+0000 7f17840e1640 1 --2- 172.21.15.79:0/2976622954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f177c075210 0x7f177c0755f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:18.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.163+0000 7f17840e1640 1 -- 172.21.15.79:0/2976622954 >> 172.21.15.79:0/2976622954 conn(0x7f177c0fe520 msgr2=0x7f177c100940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:18.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.163+0000 7f17840e1640 1 -- 172.21.15.79:0/2976622954 shutdown_connections 2024-08-20T01:43:18.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.163+0000 7f17840e1640 1 -- 172.21.15.79:0/2976622954 wait complete. 2024-08-20T01:43:18.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.164+0000 7f17840e1640 1 Processor -- start 2024-08-20T01:43:18.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.164+0000 7f17840e1640 1 -- start start 2024-08-20T01:43:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.164+0000 7f17840e1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f177c075210 0x7f177c19b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.164+0000 7f17840e1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f177c075b30 0x7f177c19b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.164+0000 7f17840e1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f177c10f0a0 0x7f177c1a0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.164+0000 7f17840e1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f177c114b30 con 0x7f177c10f0a0 2024-08-20T01:43:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.164+0000 7f17840e1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f177c1149b0 con 0x7f177c075b30 2024-08-20T01:43:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.164+0000 7f17840e1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f177c114cb0 con 0x7f177c075210 2024-08-20T01:43:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.165+0000 7f178267e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f177c10f0a0 0x7f177c1a0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.165+0000 7f1781e7d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f177c075210 0x7f177c19b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.165+0000 7f178267e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f177c10f0a0 0x7f177c1a0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53034/0 (socket says 172.21.15.79:53034) 2024-08-20T01:43:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.165+0000 7f178267e640 1 -- 172.21.15.79:0/1501286335 learned_addr learned my addr 172.21.15.79:0/1501286335 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.165+0000 7f178167c640 1 --2- 172.21.15.79:0/1501286335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f177c075b30 0x7f177c19b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.165+0000 7f178267e640 1 -- 172.21.15.79:0/1501286335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f177c075210 msgr2=0x7f177c19b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.165+0000 7f178267e640 1 --2- 172.21.15.79:0/1501286335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f177c075210 0x7f177c19b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.165+0000 7f178267e640 1 -- 172.21.15.79:0/1501286335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f177c075b30 msgr2=0x7f177c19b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.165+0000 7f178267e640 1 --2- 172.21.15.79:0/1501286335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f177c075b30 0x7f177c19b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.165+0000 7f178267e640 1 -- 172.21.15.79:0/1501286335 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f177c1a1130 con 0x7f177c10f0a0 2024-08-20T01:43:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.165+0000 7f1781e7d640 1 --2- 172.21.15.79:0/1501286335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f177c075210 0x7f177c19b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:43:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.165+0000 7f178267e640 1 --2- 172.21.15.79:0/1501286335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f177c10f0a0 0x7f177c1a0960 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f177400cad0 tx=0x7f177400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.165+0000 7f1772ffd640 1 -- 172.21.15.79:0/1501286335 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177400ad60 con 0x7f177c10f0a0 2024-08-20T01:43:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.165+0000 7f1772ffd640 1 -- 172.21.15.79:0/1501286335 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1774003e20 con 0x7f177c10f0a0 2024-08-20T01:43:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.165+0000 7f1772ffd640 1 -- 172.21.15.79:0/1501286335 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177400f6b0 con 0x7f177c10f0a0 2024-08-20T01:43:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.165+0000 7f17840e1640 1 -- 172.21.15.79:0/1501286335 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f177c1a1420 con 0x7f177c10f0a0 2024-08-20T01:43:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.165+0000 7f17840e1640 1 -- 172.21.15.79:0/1501286335 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f177c1a7ae0 con 0x7f177c10f0a0 2024-08-20T01:43:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.168+0000 7f17864da740 1 Processor -- start 2024-08-20T01:43:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.168+0000 7f1772ffd640 1 -- 172.21.15.79:0/1501286335 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1774003990 con 0x7f177c10f0a0 2024-08-20T01:43:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.169+0000 7f17864da740 1 -- start start 2024-08-20T01:43:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.169+0000 7f17864da740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a70725730 0x555a70725b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.169+0000 7f17864da740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a70726050 0x555a70731aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.169+0000 7f17864da740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555a70731fe0 0x555a707343d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.169+0000 7f17864da740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555a7069c930 con 0x555a70726050 2024-08-20T01:43:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.169+0000 7f17864da740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555a7068be30 con 0x555a70725730 2024-08-20T01:43:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.169+0000 7f17864da740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555a7068fe70 con 0x555a70731fe0 2024-08-20T01:43:18.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.169+0000 7f1781e7d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a70726050 0x555a70731aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:18.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.169+0000 7f1781e7d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a70726050 0x555a70731aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53048/0 (socket says 172.21.15.79:53048) 2024-08-20T01:43:18.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.169+0000 7f1781e7d640 1 -- 172.21.15.79:0/1337368658 learned_addr learned my addr 172.21.15.79:0/1337368658 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:18.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.169+0000 7f178167c640 1 --2- 172.21.15.79:0/1337368658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a70725730 0x555a70725b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:18.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.169+0000 7f178167c640 1 --2- 172.21.15.79:0/1337368658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555a70731fe0 0x555a707343d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:18.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.169+0000 7f1781e7d640 1 -- 172.21.15.79:0/1337368658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555a70731fe0 msgr2=0x555a707343d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:18.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.169+0000 7f1781e7d640 1 --2- 172.21.15.79:0/1337368658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555a70731fe0 0x555a707343d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:18.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.169+0000 7f1781e7d640 1 -- 172.21.15.79:0/1337368658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a70725730 msgr2=0x555a70725b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:18.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.169+0000 7f1781e7d640 1 --2- 172.21.15.79:0/1337368658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a70725730 0x555a70725b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:18.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.169+0000 7f1781e7d640 1 -- 172.21.15.79:0/1337368658 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a703eb650 con 0x555a70726050 2024-08-20T01:43:18.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.169+0000 7f1772ffd640 1 --2- 172.21.15.79:0/1501286335 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f17680b3bd0 0x7f17680b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:18.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.170+0000 7f1781e7d640 1 --2- 172.21.15.79:0/1337368658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a70726050 0x555a70731aa0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f177800f4f0 tx=0x7f177800f9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7554d1c051dbe3be server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:18.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.170+0000 7f178167c640 1 --2- 172.21.15.79:0/1501286335 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f17680b3bd0 0x7f17680b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:18.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.170+0000 7f1772ffd640 1 -- 172.21.15.79:0/1501286335 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f17740e3f20 con 0x7f177c10f0a0 2024-08-20T01:43:18.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.170+0000 7f1767fff640 1 -- 172.21.15.79:0/1337368658 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1778005220 con 0x555a70726050 2024-08-20T01:43:18.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.170+0000 7f1767fff640 1 -- 172.21.15.79:0/1337368658 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1778014070 con 0x555a70726050 2024-08-20T01:43:18.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.170+0000 7f1767fff640 1 -- 172.21.15.79:0/1337368658 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17780109f0 con 0x555a70726050 2024-08-20T01:43:18.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.171+0000 7f17864da740 1 -- 172.21.15.79:0/1337368658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a70726050 msgr2=0x555a70731aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:18.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.171+0000 7f178167c640 1 --2- 172.21.15.79:0/1501286335 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f17680b3bd0 0x7f17680b6090 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f176c000c00 tx=0x7f176c02a410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:18.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.171+0000 7f17864da740 1 --2- 172.21.15.79:0/1337368658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a70726050 0x555a70731aa0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f177800f4f0 tx=0x7f177800f9b0 comp rx=0 tx=0).stop 2024-08-20T01:43:18.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.171+0000 7f17864da740 1 -- 172.21.15.79:0/1337368658 shutdown_connections 2024-08-20T01:43:18.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.171+0000 7f17864da740 1 --2- 172.21.15.79:0/1337368658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555a70731fe0 0x555a707343d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:18.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.171+0000 7f17864da740 1 --2- 172.21.15.79:0/1337368658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a70726050 0x555a70731aa0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:18.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.171+0000 7f17864da740 1 --2- 172.21.15.79:0/1337368658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a70725730 0x555a70725b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:18.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.171+0000 7f17864da740 1 -- 172.21.15.79:0/1337368658 >> 172.21.15.79:0/1337368658 conn(0x555a70723560 msgr2=0x555a70724700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.171+0000 7f17864da740 1 -- 172.21.15.79:0/1337368658 shutdown_connections 2024-08-20T01:43:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.171+0000 7f17864da740 1 -- 172.21.15.79:0/1337368658 wait complete. 2024-08-20T01:43:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.171+0000 7f17864da740 1 -- start start 2024-08-20T01:43:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.171+0000 7f17864da740 1 Processor -- start 2024-08-20T01:43:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.172+0000 7f17864da740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a70725730 0x555a7072ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.172+0000 7f17864da740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a70726050 0x555a7072f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.172+0000 7f17864da740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555a70731fe0 0x555a7072fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.172+0000 7f17864da740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555a704ee700 con 0x555a70725730 2024-08-20T01:43:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.172+0000 7f17864da740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555a70612810 con 0x555a70726050 2024-08-20T01:43:18.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.172+0000 7f17864da740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555a70734c90 con 0x555a70731fe0 2024-08-20T01:43:18.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.172+0000 7f17864da740 10 client.0 _ll_register_callbacks cb 0x555a70685700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:43:18.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.172+0000 7f1781e7d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a70725730 0x555a7072ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:18.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.172+0000 7f1781e7d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a70725730 0x555a7072ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53060/0 (socket says 172.21.15.79:53060) 2024-08-20T01:43:18.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.172+0000 7f1781e7d640 1 -- 172.21.15.79:0/832255940 learned_addr learned my addr 172.21.15.79:0/832255940 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:18.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.172+0000 7f178267e640 1 --2- 172.21.15.79:0/832255940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555a70731fe0 0x555a7072fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:18.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.172+0000 7f178167c640 1 --2- 172.21.15.79:0/832255940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a70726050 0x555a7072f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:18.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.172+0000 7f1781e7d640 1 -- 172.21.15.79:0/832255940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555a70731fe0 msgr2=0x555a7072fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:18.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.172+0000 7f1781e7d640 1 --2- 172.21.15.79:0/832255940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555a70731fe0 0x555a7072fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:18.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.172+0000 7f1781e7d640 1 -- 172.21.15.79:0/832255940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a70726050 msgr2=0x555a7072f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:18.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.172+0000 7f1781e7d640 1 --2- 172.21.15.79:0/832255940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a70726050 0x555a7072f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:18.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.172+0000 7f1781e7d640 1 -- 172.21.15.79:0/832255940 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a7073e070 con 0x555a70725730 2024-08-20T01:43:18.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.173+0000 7f1781e7d640 1 --2- 172.21.15.79:0/832255940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a70725730 0x555a7072ef80 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f1778000c00 tx=0x7f1778010e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd26c4b903e35e48 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:18.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.173+0000 7f17657fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:43:18.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.173+0000 7f17657fa640 1 -- 172.21.15.79:0/832255940 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1778024070 con 0x555a70725730 2024-08-20T01:43:18.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.173+0000 7f17864da740 1 -- 172.21.15.79:0/832255940 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555a7063b150 con 0x555a70725730 2024-08-20T01:43:18.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.173+0000 7f17657fa640 1 -- 172.21.15.79:0/832255940 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f1778018630 con 0x555a70725730 2024-08-20T01:43:18.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.173+0000 7f17657fa640 1 -- 172.21.15.79:0/832255940 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f1778030050 con 0x555a70725730 2024-08-20T01:43:18.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.173+0000 7f17864da740 10 client.17283 fetch_fsmap learned FSMap version 38 2024-08-20T01:43:18.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.173+0000 7f17864da740 1 -- 172.21.15.79:0/832255940 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x555a70740a20 con 0x555a70725730 2024-08-20T01:43:18.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.173+0000 7f17657fa640 1 -- 172.21.15.79:0/832255940 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x555a7063b150 con 0x555a70725730 2024-08-20T01:43:18.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.173+0000 7f17657fa640 1 -- 172.21.15.79:0/832255940 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f17780205b0 con 0x555a70725730 2024-08-20T01:43:18.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.173+0000 7f17864da740 10 client.17283 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:43:18.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.173+0000 7f17864da740 10 client.17283 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:43:18.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.174+0000 7f17864da740 20 client.17283 populate_metadata read hostname 'smithi079' 2024-08-20T01:43:18.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.174+0000 7f17864da740 1 --2- 172.21.15.79:0/832255940 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x555a70741dd0 0x555a707441c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:18.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.174+0000 7f17864da740 4 client.17283 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:43:18.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.174+0000 7f17864da740 1 -- 172.21.15.79:0/832255940 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555a7069e880 con 0x555a70741dd0 2024-08-20T01:43:18.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.174+0000 7f178167c640 1 --2- 172.21.15.79:0/832255940 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x555a70741dd0 0x555a707441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:18.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.174+0000 7f178167c640 1 --2- 172.21.15.79:0/832255940 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x555a70741dd0 0x555a707441c0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a186cde8ac583195 server_cookie=1c769810ea1906c3 in_seq=0 out_seq=0 2024-08-20T01:43:18.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.174+0000 7f17657fa640 10 client.17283 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:43:18.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.175+0000 7f17657fa640 1 -- 172.21.15.79:0/832255940 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555a7069e880 con 0x555a70741dd0 2024-08-20T01:43:18.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.175+0000 7f17657fa640 10 client.17283 handle_command_reply: tid=0 2024-08-20T01:43:18.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.175+0000 7f17864da740 1 client.17283 shutdown 2024-08-20T01:43:18.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.175+0000 7f17864da740 1 -- 172.21.15.79:0/832255940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a70725730 msgr2=0x555a7072ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:18.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.175+0000 7f17864da740 1 --2- 172.21.15.79:0/832255940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a70725730 0x555a7072ef80 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f1778000c00 tx=0x7f1778010e80 comp rx=0 tx=0).stop 2024-08-20T01:43:18.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.175+0000 7f17864da740 1 -- 172.21.15.79:0/832255940 shutdown_connections 2024-08-20T01:43:18.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.175+0000 7f17864da740 1 --2- 172.21.15.79:0/832255940 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x555a70741dd0 0x555a707441c0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:18.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.175+0000 7f17864da740 1 --2- 172.21.15.79:0/832255940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555a70731fe0 0x555a7072fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:18.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.175+0000 7f17657fa640 0 client.17283 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:43:18.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.175+0000 7f17864da740 1 --2- 172.21.15.79:0/832255940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a70726050 0x555a7072f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:18.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.175+0000 7f17864da740 1 --2- 172.21.15.79:0/832255940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a70725730 0x555a7072ef80 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:18.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.175+0000 7f17864da740 1 -- 172.21.15.79:0/832255940 >> 172.21.15.79:0/832255940 conn(0x555a70723560 msgr2=0x555a70729100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:18.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.176+0000 7f17864da740 1 -- 172.21.15.79:0/832255940 shutdown_connections 2024-08-20T01:43:18.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.176+0000 7f17864da740 1 -- 172.21.15.79:0/832255940 wait complete. 2024-08-20T01:43:18.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.176+0000 7f17864da740 20 client.17283 trim_cache size 0 max 16384 2024-08-20T01:43:18.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.192+0000 7f17864da740 1 Processor -- start 2024-08-20T01:43:18.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.192+0000 7f17864da740 1 -- start start 2024-08-20T01:43:18.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.192+0000 7f17864da740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a70725730 0x555a70749900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:18.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.192+0000 7f17864da740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a70726050 0x555a70749e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:18.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.192+0000 7f17864da740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555a70731fe0 0x555a70739f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:18.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.192+0000 7f17864da740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f177c1b0210 con 0x555a70725730 2024-08-20T01:43:18.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.192+0000 7f17864da740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f177c1b1d50 con 0x555a70726050 2024-08-20T01:43:18.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.192+0000 7f17864da740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f177c1b08e0 con 0x555a70731fe0 2024-08-20T01:43:18.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.192+0000 7f1781e7d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a70725730 0x555a70749900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:18.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.192+0000 7f1781e7d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a70725730 0x555a70749900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53070/0 (socket says 172.21.15.79:53070) 2024-08-20T01:43:18.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.192+0000 7f1781e7d640 1 -- 172.21.15.79:0/4063001156 learned_addr learned my addr 172.21.15.79:0/4063001156 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:18.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.192+0000 7f178167c640 1 --2- 172.21.15.79:0/4063001156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a70726050 0x555a70749e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:18.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.192+0000 7f178267e640 1 --2- 172.21.15.79:0/4063001156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555a70731fe0 0x555a70739f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:18.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.192+0000 7f1781e7d640 1 -- 172.21.15.79:0/4063001156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555a70731fe0 msgr2=0x555a70739f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:18.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.192+0000 7f1781e7d640 1 --2- 172.21.15.79:0/4063001156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555a70731fe0 0x555a70739f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:18.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.192+0000 7f1781e7d640 1 -- 172.21.15.79:0/4063001156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a70726050 msgr2=0x555a70749e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:18.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.192+0000 7f1781e7d640 1 --2- 172.21.15.79:0/4063001156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a70726050 0x555a70749e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:18.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.192+0000 7f1781e7d640 1 -- 172.21.15.79:0/4063001156 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a70723fe0 con 0x555a70725730 2024-08-20T01:43:18.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.192+0000 7f178167c640 1 --2- 172.21.15.79:0/4063001156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a70726050 0x555a70749e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:43:18.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.193+0000 7f1781e7d640 1 --2- 172.21.15.79:0/4063001156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a70725730 0x555a70749900 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f177800a310 tx=0x7f177800fef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73b8f75d9a0e1879 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:18.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.193+0000 7f17677fe640 1 -- 172.21.15.79:0/4063001156 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177802d030 con 0x555a70725730 2024-08-20T01:43:18.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.193+0000 7f17677fe640 1 -- 172.21.15.79:0/4063001156 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1778014050 con 0x555a70725730 2024-08-20T01:43:18.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.193+0000 7f17677fe640 1 -- 172.21.15.79:0/4063001156 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1778024070 con 0x555a70725730 2024-08-20T01:43:18.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.194+0000 7f17864da740 1 -- 172.21.15.79:0/4063001156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a70725730 msgr2=0x555a70749900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:18.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.194+0000 7f17864da740 1 --2- 172.21.15.79:0/4063001156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a70725730 0x555a70749900 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f177800a310 tx=0x7f177800fef0 comp rx=0 tx=0).stop 2024-08-20T01:43:18.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.194+0000 7f17864da740 1 -- 172.21.15.79:0/4063001156 shutdown_connections 2024-08-20T01:43:18.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.194+0000 7f17864da740 1 --2- 172.21.15.79:0/4063001156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555a70731fe0 0x555a70739f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:18.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.194+0000 7f17864da740 1 --2- 172.21.15.79:0/4063001156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a70726050 0x555a70749e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:18.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.194+0000 7f17864da740 1 --2- 172.21.15.79:0/4063001156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a70725730 0x555a70749900 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:18.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.194+0000 7f17864da740 1 -- 172.21.15.79:0/4063001156 >> 172.21.15.79:0/4063001156 conn(0x555a70723560 msgr2=0x555a707224f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:18.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.194+0000 7f17864da740 1 -- 172.21.15.79:0/4063001156 shutdown_connections 2024-08-20T01:43:18.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.194+0000 7f17864da740 1 -- 172.21.15.79:0/4063001156 wait complete. 2024-08-20T01:43:18.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.194+0000 7f17864da740 1 -- start start 2024-08-20T01:43:18.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.195+0000 7f17864da740 1 Processor -- start 2024-08-20T01:43:18.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.195+0000 7f17864da740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a70725730 0x555a707371d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:18.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.195+0000 7f17864da740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a70726050 0x555a70737710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:18.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.195+0000 7f17864da740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555a70731fe0 0x555a707aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:18.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.195+0000 7f17864da740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f177c1b1680 con 0x555a70725730 2024-08-20T01:43:18.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.195+0000 7f17864da740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f177c1b0fb0 con 0x555a70726050 2024-08-20T01:43:18.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.195+0000 7f17864da740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f177c1ae1f0 con 0x555a70731fe0 2024-08-20T01:43:18.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.195+0000 7f17864da740 10 client.0 _ll_register_callbacks cb 0x7f176c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:43:18.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.195+0000 7f1781e7d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a70725730 0x555a707371d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:18.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.195+0000 7f1781e7d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a70725730 0x555a707371d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53076/0 (socket says 172.21.15.79:53076) 2024-08-20T01:43:18.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.195+0000 7f1781e7d640 1 -- 172.21.15.79:0/2062216090 learned_addr learned my addr 172.21.15.79:0/2062216090 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:18.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.195+0000 7f178267e640 1 --2- 172.21.15.79:0/2062216090 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555a70731fe0 0x555a707aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:18.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.195+0000 7f178167c640 1 --2- 172.21.15.79:0/2062216090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a70726050 0x555a70737710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:18.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.195+0000 7f1781e7d640 1 -- 172.21.15.79:0/2062216090 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555a70731fe0 msgr2=0x555a707aa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:18.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.195+0000 7f1781e7d640 1 --2- 172.21.15.79:0/2062216090 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555a70731fe0 0x555a707aa8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:18.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.196+0000 7f1781e7d640 1 -- 172.21.15.79:0/2062216090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a70726050 msgr2=0x555a70737710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:18.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.196+0000 7f1781e7d640 1 --2- 172.21.15.79:0/2062216090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a70726050 0x555a70737710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:18.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.196+0000 7f1781e7d640 1 -- 172.21.15.79:0/2062216090 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a70729c80 con 0x555a70725730 2024-08-20T01:43:18.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.196+0000 7f178167c640 1 --2- 172.21.15.79:0/2062216090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a70726050 0x555a70737710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:43:18.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.196+0000 7f1781e7d640 1 --2- 172.21.15.79:0/2062216090 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a70725730 0x555a707371d0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f177800a480 tx=0x7f1778020f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50bfab91ec34a7a1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:18.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.196+0000 7f17657fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:43:18.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.196+0000 7f17657fa640 1 -- 172.21.15.79:0/2062216090 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1778039060 con 0x555a70725730 2024-08-20T01:43:18.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.196+0000 7f17657fa640 1 -- 172.21.15.79:0/2062216090 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f1778018630 con 0x555a70725730 2024-08-20T01:43:18.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.196+0000 7f17864da740 1 -- 172.21.15.79:0/2062216090 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1778014050 con 0x555a70725730 2024-08-20T01:43:18.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.196+0000 7f17657fa640 1 -- 172.21.15.79:0/2062216090 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f1778024070 con 0x555a70725730 2024-08-20T01:43:18.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.196+0000 7f17864da740 10 client.17289 fetch_fsmap learned FSMap version 38 2024-08-20T01:43:18.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.196+0000 7f17864da740 1 -- 172.21.15.79:0/2062216090 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x555a707abe60 con 0x555a70725730 2024-08-20T01:43:18.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.196+0000 7f17657fa640 1 -- 172.21.15.79:0/2062216090 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1778014050 con 0x555a70725730 2024-08-20T01:43:18.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.197+0000 7f17657fa640 1 -- 172.21.15.79:0/2062216090 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f1778029440 con 0x555a70725730 2024-08-20T01:43:18.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.197+0000 7f17864da740 10 client.17289 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:43:18.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.197+0000 7f17864da740 10 client.17289 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:43:18.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.197+0000 7f17864da740 20 client.17289 populate_metadata read hostname 'smithi079' 2024-08-20T01:43:18.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.197+0000 7f17864da740 1 --2- 172.21.15.79:0/2062216090 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x555a70741dd0 0x555a707ae530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:18.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.197+0000 7f17864da740 4 client.17289 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:43:18.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.197+0000 7f17864da740 1 -- 172.21.15.79:0/2062216090 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555a7069a320 con 0x555a70741dd0 2024-08-20T01:43:18.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.197+0000 7f178167c640 1 --2- 172.21.15.79:0/2062216090 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x555a70741dd0 0x555a707ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:18.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.198+0000 7f17657fa640 10 client.17289 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:43:18.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.198+0000 7f178167c640 1 --2- 172.21.15.79:0/2062216090 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x555a70741dd0 0x555a707ae530 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9bbbd6bf23327d25 server_cookie=a8b6f2da632abce9 in_seq=0 out_seq=0 2024-08-20T01:43:18.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.198+0000 7f17657fa640 1 -- 172.21.15.79:0/2062216090 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555a7069a320 con 0x555a70741dd0 2024-08-20T01:43:18.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.198+0000 7f17657fa640 10 client.17289 handle_command_reply: tid=0 2024-08-20T01:43:18.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.198+0000 7f17864da740 1 client.17289 shutdown 2024-08-20T01:43:18.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.198+0000 7f17864da740 1 -- 172.21.15.79:0/2062216090 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a70725730 msgr2=0x555a707371d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:18.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.198+0000 7f17864da740 1 --2- 172.21.15.79:0/2062216090 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a70725730 0x555a707371d0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f177800a480 tx=0x7f1778020f00 comp rx=0 tx=0).stop 2024-08-20T01:43:18.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.198+0000 7f17864da740 1 -- 172.21.15.79:0/2062216090 shutdown_connections 2024-08-20T01:43:18.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.198+0000 7f17864da740 1 --2- 172.21.15.79:0/2062216090 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x555a70741dd0 0x555a707ae530 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:18.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.198+0000 7f17864da740 1 --2- 172.21.15.79:0/2062216090 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555a70731fe0 0x555a707aa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:18.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.198+0000 7f17657fa640 0 client.17289 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:43:18.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.198+0000 7f17864da740 1 --2- 172.21.15.79:0/2062216090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a70726050 0x555a70737710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:18.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.198+0000 7f17864da740 1 --2- 172.21.15.79:0/2062216090 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a70725730 0x555a707371d0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:18.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.198+0000 7f17864da740 1 -- 172.21.15.79:0/2062216090 >> 172.21.15.79:0/2062216090 conn(0x555a70723560 msgr2=0x555a707305b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:18.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.198+0000 7f17864da740 1 -- 172.21.15.79:0/2062216090 shutdown_connections 2024-08-20T01:43:18.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.198+0000 7f17864da740 1 -- 172.21.15.79:0/2062216090 wait complete. 2024-08-20T01:43:18.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.198+0000 7f17864da740 20 client.17289 trim_cache size 0 max 16384 2024-08-20T01:43:18.218 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:43:18.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.199+0000 7f17840e1640 1 -- 172.21.15.79:0/1501286335 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f17680b3bd0 msgr2=0x7f17680b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:18.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.199+0000 7f17840e1640 1 --2- 172.21.15.79:0/1501286335 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f17680b3bd0 0x7f17680b6090 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f176c000c00 tx=0x7f176c02a410 comp rx=0 tx=0).stop 2024-08-20T01:43:18.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.199+0000 7f17840e1640 1 -- 172.21.15.79:0/1501286335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f177c10f0a0 msgr2=0x7f177c1a0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:18.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.199+0000 7f17840e1640 1 --2- 172.21.15.79:0/1501286335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f177c10f0a0 0x7f177c1a0960 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f177400cad0 tx=0x7f177400ced0 comp rx=0 tx=0).stop 2024-08-20T01:43:18.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.199+0000 7f17840e1640 1 -- 172.21.15.79:0/1501286335 shutdown_connections 2024-08-20T01:43:18.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.199+0000 7f17840e1640 1 --2- 172.21.15.79:0/1501286335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f177c10f0a0 0x7f177c1a0960 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:18.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.199+0000 7f17840e1640 1 --2- 172.21.15.79:0/1501286335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f177c075b30 0x7f177c19b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:18.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.199+0000 7f17840e1640 1 --2- 172.21.15.79:0/1501286335 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f17680b3bd0 0x7f17680b6090 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:18.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.199+0000 7f17840e1640 1 --2- 172.21.15.79:0/1501286335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f177c075210 0x7f177c19b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:18.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.199+0000 7f17840e1640 1 -- 172.21.15.79:0/1501286335 >> 172.21.15.79:0/1501286335 conn(0x7f177c0fe520 msgr2=0x7f177c0ff120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:18.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.199+0000 7f17840e1640 1 -- 172.21.15.79:0/1501286335 shutdown_connections 2024-08-20T01:43:18.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:18.199+0000 7f17840e1640 1 -- 172.21.15.79:0/1501286335 wait complete. 2024-08-20T01:43:18.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:18 smithi175 ceph-mon[22392]: pgmap v526: 97 pgs: 97 active+clean; 8.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 29 MiB/s wr, 23 op/s 2024-08-20T01:43:18.676 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:18 smithi079 ceph-mon[18656]: pgmap v526: 97 pgs: 97 active+clean; 8.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 29 MiB/s wr, 23 op/s 2024-08-20T01:43:18.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:18 smithi081 ceph-mon[22209]: pgmap v526: 97 pgs: 97 active+clean; 8.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 29 MiB/s wr, 23 op/s 2024-08-20T01:43:19.020 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T01:43:19.303 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:43:19.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.835+0000 7fc1728ad640 1 -- 172.21.15.79:0/2821576752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc16c102aa0 msgr2=0x7fc16c102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:19.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.835+0000 7fc1728ad640 1 --2- 172.21.15.79:0/2821576752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc16c102aa0 0x7fc16c102e80 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fc15c009900 tx=0x7fc15c02a410 comp rx=0 tx=0).stop 2024-08-20T01:43:19.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.835+0000 7fc1728ad640 1 -- 172.21.15.79:0/2821576752 shutdown_connections 2024-08-20T01:43:19.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.835+0000 7fc1728ad640 1 --2- 172.21.15.79:0/2821576752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc16c108e30 0x7fc16c10f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:19.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.835+0000 7fc1728ad640 1 --2- 172.21.15.79:0/2821576752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc16c1084b0 0x7fc16c1088f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:19.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.835+0000 7fc1728ad640 1 --2- 172.21.15.79:0/2821576752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc16c102aa0 0x7fc16c102e80 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:19.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.835+0000 7fc1728ad640 1 -- 172.21.15.79:0/2821576752 >> 172.21.15.79:0/2821576752 conn(0x7fc16c0fe550 msgr2=0x7fc16c100970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:19.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.835+0000 7fc1728ad640 1 -- 172.21.15.79:0/2821576752 shutdown_connections 2024-08-20T01:43:19.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.835+0000 7fc1728ad640 1 -- 172.21.15.79:0/2821576752 wait complete. 2024-08-20T01:43:19.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.836+0000 7fc1728ad640 1 Processor -- start 2024-08-20T01:43:19.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.836+0000 7fc1728ad640 1 -- start start 2024-08-20T01:43:19.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.836+0000 7fc1728ad640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc16c102aa0 0x7fc16c19b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:19.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.836+0000 7fc1728ad640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc16c1084b0 0x7fc16c19b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:19.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.836+0000 7fc1728ad640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc16c108e30 0x7fc16c1a09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:19.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.836+0000 7fc1728ad640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc16c1129a0 con 0x7fc16c102aa0 2024-08-20T01:43:19.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.836+0000 7fc1728ad640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc16c112820 con 0x7fc16c108e30 2024-08-20T01:43:19.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.836+0000 7fc1728ad640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc16c112b20 con 0x7fc16c1084b0 2024-08-20T01:43:19.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.836+0000 7fc16bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc16c102aa0 0x7fc16c19b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:19.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.836+0000 7fc16bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc16c102aa0 0x7fc16c19b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53106/0 (socket says 172.21.15.79:53106) 2024-08-20T01:43:19.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.836+0000 7fc16bfff640 1 -- 172.21.15.79:0/4255816399 learned_addr learned my addr 172.21.15.79:0/4255816399 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:19.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.836+0000 7fc16b7fe640 1 --2- 172.21.15.79:0/4255816399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc16c1084b0 0x7fc16c19b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:19.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.836+0000 7fc170e4a640 1 --2- 172.21.15.79:0/4255816399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc16c108e30 0x7fc16c1a09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:19.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.837+0000 7fc16bfff640 1 -- 172.21.15.79:0/4255816399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc16c1084b0 msgr2=0x7fc16c19b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:19.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.837+0000 7fc16bfff640 1 --2- 172.21.15.79:0/4255816399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc16c1084b0 0x7fc16c19b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:19.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.837+0000 7fc16bfff640 1 -- 172.21.15.79:0/4255816399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc16c108e30 msgr2=0x7fc16c1a09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:19.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.837+0000 7fc16bfff640 1 --2- 172.21.15.79:0/4255816399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc16c108e30 0x7fc16c1a09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:19.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.837+0000 7fc16bfff640 1 -- 172.21.15.79:0/4255816399 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc16c1a11a0 con 0x7fc16c102aa0 2024-08-20T01:43:19.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.837+0000 7fc16b7fe640 1 --2- 172.21.15.79:0/4255816399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc16c1084b0 0x7fc16c19b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:43:19.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.837+0000 7fc16bfff640 1 --2- 172.21.15.79:0/4255816399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc16c102aa0 0x7fc16c19b0f0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fc15c009230 tx=0x7fc15c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:19.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.837+0000 7fc1697fa640 1 -- 172.21.15.79:0/4255816399 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c03f030 con 0x7fc16c102aa0 2024-08-20T01:43:19.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.837+0000 7fc1728ad640 1 -- 172.21.15.79:0/4255816399 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc16c1a1430 con 0x7fc16c102aa0 2024-08-20T01:43:19.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.837+0000 7fc1697fa640 1 -- 172.21.15.79:0/4255816399 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc15c003a80 con 0x7fc16c102aa0 2024-08-20T01:43:19.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.837+0000 7fc1697fa640 1 -- 172.21.15.79:0/4255816399 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c035070 con 0x7fc16c102aa0 2024-08-20T01:43:19.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.837+0000 7fc1728ad640 1 -- 172.21.15.79:0/4255816399 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc16c1a7b50 con 0x7fc16c102aa0 2024-08-20T01:43:19.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.840+0000 7fc1697fa640 1 -- 172.21.15.79:0/4255816399 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc15c042030 con 0x7fc16c102aa0 2024-08-20T01:43:19.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.840+0000 7fc174ca6740 1 Processor -- start 2024-08-20T01:43:19.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.840+0000 7fc174ca6740 1 -- start start 2024-08-20T01:43:19.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.840+0000 7fc1697fa640 1 --2- 172.21.15.79:0/4255816399 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc1540b3bd0 0x7fc1540b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:19.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.841+0000 7fc174ca6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56301ca4a880 0x56301ca4ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:19.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.841+0000 7fc170e4a640 1 --2- 172.21.15.79:0/4255816399 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc1540b3bd0 0x7fc1540b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:19.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.841+0000 7fc174ca6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56301ca4b1a0 0x56301ca56bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:19.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.841+0000 7fc174ca6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56301ca57130 0x56301ca59520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:19.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.841+0000 7fc174ca6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56301c9c1930 con 0x56301ca4a880 2024-08-20T01:43:19.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.841+0000 7fc174ca6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56301c9b0e30 con 0x56301ca4b1a0 2024-08-20T01:43:19.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.841+0000 7fc174ca6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56301c9b4e70 con 0x56301ca57130 2024-08-20T01:43:19.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.841+0000 7fc1697fa640 1 -- 172.21.15.79:0/4255816399 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc15c103fe0 con 0x7fc16c102aa0 2024-08-20T01:43:19.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.841+0000 7fc16bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56301ca4a880 0x56301ca4ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:19.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.841+0000 7fc16bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56301ca4a880 0x56301ca4ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53122/0 (socket says 172.21.15.79:53122) 2024-08-20T01:43:19.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.841+0000 7fc16bfff640 1 -- 172.21.15.79:0/9451335 learned_addr learned my addr 172.21.15.79:0/9451335 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:19.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.841+0000 7fc170e4a640 1 --2- 172.21.15.79:0/9451335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56301ca57130 0x56301ca59520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:19.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.841+0000 7fc16b7fe640 1 --2- 172.21.15.79:0/9451335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56301ca4b1a0 0x56301ca56bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:19.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.841+0000 7fc16bfff640 1 -- 172.21.15.79:0/9451335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56301ca57130 msgr2=0x56301ca59520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:19.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.841+0000 7fc16bfff640 1 --2- 172.21.15.79:0/9451335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56301ca57130 0x56301ca59520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:19.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.841+0000 7fc16bfff640 1 -- 172.21.15.79:0/9451335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56301ca4b1a0 msgr2=0x56301ca56bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:19.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.841+0000 7fc16bfff640 1 --2- 172.21.15.79:0/9451335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56301ca4b1a0 0x56301ca56bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:19.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.841+0000 7fc16bfff640 1 -- 172.21.15.79:0/9451335 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56301c710650 con 0x56301ca4a880 2024-08-20T01:43:19.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.841+0000 7fc16b7fe640 1 --2- 172.21.15.79:0/9451335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56301ca4b1a0 0x56301ca56bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:43:19.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.841+0000 7fc170e4a640 1 --2- 172.21.15.79:0/4255816399 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc1540b3bd0 0x7fc1540b6090 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc164005fd0 tx=0x7fc164014bf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:19.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.841+0000 7fc16bfff640 1 --2- 172.21.15.79:0/9451335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56301ca4a880 0x56301ca4ac60 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fc15c032a50 tx=0x7fc15c03b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63058967f4eb9de1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:19.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.842+0000 7fc1527fc640 1 -- 172.21.15.79:0/9451335 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c049040 con 0x56301ca4a880 2024-08-20T01:43:19.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.842+0000 7fc1527fc640 1 -- 172.21.15.79:0/9451335 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc15c0b2070 con 0x56301ca4a880 2024-08-20T01:43:19.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.842+0000 7fc1527fc640 1 -- 172.21.15.79:0/9451335 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c0d3c00 con 0x56301ca4a880 2024-08-20T01:43:19.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.842+0000 7fc174ca6740 1 -- 172.21.15.79:0/9451335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56301ca4a880 msgr2=0x56301ca4ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:19.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.842+0000 7fc174ca6740 1 --2- 172.21.15.79:0/9451335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56301ca4a880 0x56301ca4ac60 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fc15c032a50 tx=0x7fc15c03b460 comp rx=0 tx=0).stop 2024-08-20T01:43:19.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.843+0000 7fc174ca6740 1 -- 172.21.15.79:0/9451335 shutdown_connections 2024-08-20T01:43:19.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.843+0000 7fc174ca6740 1 --2- 172.21.15.79:0/9451335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56301ca57130 0x56301ca59520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:19.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.843+0000 7fc174ca6740 1 --2- 172.21.15.79:0/9451335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56301ca4b1a0 0x56301ca56bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:19.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.843+0000 7fc174ca6740 1 --2- 172.21.15.79:0/9451335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56301ca4a880 0x56301ca4ac60 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:19.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.843+0000 7fc174ca6740 1 -- 172.21.15.79:0/9451335 >> 172.21.15.79:0/9451335 conn(0x56301ca486b0 msgr2=0x56301ca49850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:19.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.843+0000 7fc174ca6740 1 -- 172.21.15.79:0/9451335 shutdown_connections 2024-08-20T01:43:19.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.843+0000 7fc174ca6740 1 -- 172.21.15.79:0/9451335 wait complete. 2024-08-20T01:43:19.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.843+0000 7fc174ca6740 1 -- start start 2024-08-20T01:43:19.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.843+0000 7fc174ca6740 1 Processor -- start 2024-08-20T01:43:19.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.844+0000 7fc174ca6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56301ca4a880 0x56301ca540e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:19.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.844+0000 7fc174ca6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56301ca4b1a0 0x56301ca54620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:19.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.844+0000 7fc174ca6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56301ca57130 0x56301ca54b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:19.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.844+0000 7fc174ca6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56301c813700 con 0x56301ca4a880 2024-08-20T01:43:19.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.844+0000 7fc174ca6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56301c937810 con 0x56301ca4b1a0 2024-08-20T01:43:19.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.844+0000 7fc174ca6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56301ca59ba0 con 0x56301ca57130 2024-08-20T01:43:19.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.844+0000 7fc16bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56301ca4a880 0x56301ca540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:19.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.844+0000 7fc174ca6740 10 client.0 _ll_register_callbacks cb 0x56301c9aa700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:43:19.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.844+0000 7fc16bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56301ca4a880 0x56301ca540e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53138/0 (socket says 172.21.15.79:53138) 2024-08-20T01:43:19.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.844+0000 7fc16bfff640 1 -- 172.21.15.79:0/440189072 learned_addr learned my addr 172.21.15.79:0/440189072 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:19.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.844+0000 7fc16b7fe640 1 --2- 172.21.15.79:0/440189072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56301ca4b1a0 0x56301ca54620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:19.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.844+0000 7fc170e4a640 1 --2- 172.21.15.79:0/440189072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56301ca57130 0x56301ca54b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:19.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.844+0000 7fc16bfff640 1 -- 172.21.15.79:0/440189072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56301ca57130 msgr2=0x56301ca54b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:19.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.844+0000 7fc16bfff640 1 --2- 172.21.15.79:0/440189072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56301ca57130 0x56301ca54b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:19.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.844+0000 7fc16bfff640 1 -- 172.21.15.79:0/440189072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56301ca4b1a0 msgr2=0x56301ca54620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:19.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.844+0000 7fc16bfff640 1 --2- 172.21.15.79:0/440189072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56301ca4b1a0 0x56301ca54620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:19.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.844+0000 7fc16bfff640 1 -- 172.21.15.79:0/440189072 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56301ca62f40 con 0x56301ca4a880 2024-08-20T01:43:19.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.844+0000 7fc16bfff640 1 --2- 172.21.15.79:0/440189072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56301ca4a880 0x56301ca540e0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fc15c0096c0 tx=0x7fc15c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7858fc5852de8f5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:19.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.844+0000 7fc14b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:43:19.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.844+0000 7fc14b7fe640 1 -- 172.21.15.79:0/440189072 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c0ea060 con 0x56301ca4a880 2024-08-20T01:43:19.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.844+0000 7fc14b7fe640 1 -- 172.21.15.79:0/440189072 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc15c0ec230 con 0x56301ca4a880 2024-08-20T01:43:19.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.844+0000 7fc174ca6740 1 -- 172.21.15.79:0/440189072 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56301c960150 con 0x56301ca4a880 2024-08-20T01:43:19.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.845+0000 7fc14b7fe640 1 -- 172.21.15.79:0/440189072 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fc15c049070 con 0x56301ca4a880 2024-08-20T01:43:19.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.845+0000 7fc174ca6740 10 client.17301 fetch_fsmap learned FSMap version 38 2024-08-20T01:43:19.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.845+0000 7fc174ca6740 1 -- 172.21.15.79:0/440189072 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x56301ca658d0 con 0x56301ca4a880 2024-08-20T01:43:19.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.845+0000 7fc14b7fe640 1 -- 172.21.15.79:0/440189072 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc15c0b2040 con 0x56301ca4a880 2024-08-20T01:43:19.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.845+0000 7fc14b7fe640 1 -- 172.21.15.79:0/440189072 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7fc15c0e5b20 con 0x56301ca4a880 2024-08-20T01:43:19.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.845+0000 7fc174ca6740 10 client.17301 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:43:19.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.845+0000 7fc174ca6740 10 client.17301 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:43:19.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.845+0000 7fc174ca6740 20 client.17301 populate_metadata read hostname 'smithi079' 2024-08-20T01:43:19.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.845+0000 7fc174ca6740 1 --2- 172.21.15.79:0/440189072 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x56301ca66b60 0x56301ca68f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:19.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.845+0000 7fc174ca6740 4 client.17301 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:43:19.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.845+0000 7fc174ca6740 1 -- 172.21.15.79:0/440189072 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56301c960150 con 0x56301ca66b60 2024-08-20T01:43:19.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.845+0000 7fc16b7fe640 1 --2- 172.21.15.79:0/440189072 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x56301ca66b60 0x56301ca68f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:19.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.846+0000 7fc14b7fe640 10 client.17301 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:43:19.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.846+0000 7fc16b7fe640 1 --2- 172.21.15.79:0/440189072 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x56301ca66b60 0x56301ca68f70 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bd2045cf2f102bab server_cookie=d3fb209fc84cb82e in_seq=0 out_seq=0 2024-08-20T01:43:19.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.847+0000 7fc14b7fe640 1 -- 172.21.15.79:0/440189072 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56301c960150 con 0x56301ca66b60 2024-08-20T01:43:19.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.847+0000 7fc14b7fe640 10 client.17301 handle_command_reply: tid=0 2024-08-20T01:43:19.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.847+0000 7fc174ca6740 1 client.17301 shutdown 2024-08-20T01:43:19.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.847+0000 7fc174ca6740 1 -- 172.21.15.79:0/440189072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56301ca4a880 msgr2=0x56301ca540e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:19.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.847+0000 7fc174ca6740 1 --2- 172.21.15.79:0/440189072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56301ca4a880 0x56301ca540e0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fc15c0096c0 tx=0x7fc15c009260 comp rx=0 tx=0).stop 2024-08-20T01:43:19.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.847+0000 7fc174ca6740 1 -- 172.21.15.79:0/440189072 shutdown_connections 2024-08-20T01:43:19.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.847+0000 7fc174ca6740 1 --2- 172.21.15.79:0/440189072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56301ca57130 0x56301ca54b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:19.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.847+0000 7fc174ca6740 1 --2- 172.21.15.79:0/440189072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56301ca4b1a0 0x56301ca54620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:19.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.847+0000 7fc174ca6740 1 --2- 172.21.15.79:0/440189072 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x56301ca66b60 0x56301ca68f70 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:19.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.847+0000 7fc174ca6740 1 --2- 172.21.15.79:0/440189072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56301ca4a880 0x56301ca540e0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:19.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.847+0000 7fc174ca6740 1 -- 172.21.15.79:0/440189072 >> 172.21.15.79:0/440189072 conn(0x56301ca486b0 msgr2=0x56301ca4e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:19.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.847+0000 7fc14b7fe640 0 client.17301 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:43:19.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.847+0000 7fc174ca6740 1 -- 172.21.15.79:0/440189072 shutdown_connections 2024-08-20T01:43:19.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.847+0000 7fc174ca6740 1 -- 172.21.15.79:0/440189072 wait complete. 2024-08-20T01:43:19.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.847+0000 7fc174ca6740 20 client.17301 trim_cache size 0 max 16384 2024-08-20T01:43:19.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.860+0000 7fc174ca6740 1 Processor -- start 2024-08-20T01:43:19.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.860+0000 7fc174ca6740 1 -- start start 2024-08-20T01:43:19.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.860+0000 7fc174ca6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56301ca4a880 0x56301ca49cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:19.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.860+0000 7fc174ca6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56301ca4b1a0 0x56301ca6e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:19.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.860+0000 7fc174ca6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56301ca57130 0x56301ca6ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:19.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.860+0000 7fc174ca6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc16c1b0180 con 0x56301ca4b1a0 2024-08-20T01:43:19.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.860+0000 7fc174ca6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc16c1b1cc0 con 0x56301ca57130 2024-08-20T01:43:19.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.860+0000 7fc174ca6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc16c1b0850 con 0x56301ca4a880 2024-08-20T01:43:19.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.860+0000 7fc16b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56301ca4b1a0 0x56301ca6e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:19.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.861+0000 7fc16b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56301ca4b1a0 0x56301ca6e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53142/0 (socket says 172.21.15.79:53142) 2024-08-20T01:43:19.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.861+0000 7fc16b7fe640 1 -- 172.21.15.79:0/1663966504 learned_addr learned my addr 172.21.15.79:0/1663966504 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:19.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.861+0000 7fc16bfff640 1 --2- 172.21.15.79:0/1663966504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56301ca4a880 0x56301ca49cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:19.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.861+0000 7fc170e4a640 1 --2- 172.21.15.79:0/1663966504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56301ca57130 0x56301ca6ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:19.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.861+0000 7fc16b7fe640 1 -- 172.21.15.79:0/1663966504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56301ca4a880 msgr2=0x56301ca49cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:19.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.861+0000 7fc16b7fe640 1 --2- 172.21.15.79:0/1663966504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56301ca4a880 0x56301ca49cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:19.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.861+0000 7fc16b7fe640 1 -- 172.21.15.79:0/1663966504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56301ca57130 msgr2=0x56301ca6ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:19.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.861+0000 7fc16b7fe640 1 --2- 172.21.15.79:0/1663966504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56301ca57130 0x56301ca6ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:19.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.861+0000 7fc16b7fe640 1 -- 172.21.15.79:0/1663966504 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56301ca4afd0 con 0x56301ca4b1a0 2024-08-20T01:43:19.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.861+0000 7fc16b7fe640 1 --2- 172.21.15.79:0/1663966504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56301ca4b1a0 0x56301ca6e840 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fc160004300 tx=0x7fc160005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b0ad846fdcf88f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:19.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.861+0000 7fc151ffb640 1 -- 172.21.15.79:0/1663966504 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc160005020 con 0x56301ca4b1a0 2024-08-20T01:43:19.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.861+0000 7fc151ffb640 1 -- 172.21.15.79:0/1663966504 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc1600047a0 con 0x56301ca4b1a0 2024-08-20T01:43:19.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.861+0000 7fc151ffb640 1 -- 172.21.15.79:0/1663966504 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc160005650 con 0x56301ca4b1a0 2024-08-20T01:43:19.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.862+0000 7fc174ca6740 1 -- 172.21.15.79:0/1663966504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56301ca4b1a0 msgr2=0x56301ca6e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:19.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.862+0000 7fc174ca6740 1 --2- 172.21.15.79:0/1663966504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56301ca4b1a0 0x56301ca6e840 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fc160004300 tx=0x7fc160005f90 comp rx=0 tx=0).stop 2024-08-20T01:43:19.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.862+0000 7fc174ca6740 1 -- 172.21.15.79:0/1663966504 shutdown_connections 2024-08-20T01:43:19.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.862+0000 7fc174ca6740 1 --2- 172.21.15.79:0/1663966504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56301ca57130 0x56301ca6ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:19.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.862+0000 7fc174ca6740 1 --2- 172.21.15.79:0/1663966504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56301ca4b1a0 0x56301ca6e840 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:19.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.862+0000 7fc174ca6740 1 --2- 172.21.15.79:0/1663966504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56301ca4a880 0x56301ca49cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:19.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.862+0000 7fc174ca6740 1 -- 172.21.15.79:0/1663966504 >> 172.21.15.79:0/1663966504 conn(0x56301ca486b0 msgr2=0x56301ca495c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:19.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.862+0000 7fc174ca6740 1 -- 172.21.15.79:0/1663966504 shutdown_connections 2024-08-20T01:43:19.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.862+0000 7fc174ca6740 1 -- 172.21.15.79:0/1663966504 wait complete. 2024-08-20T01:43:19.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.862+0000 7fc174ca6740 1 -- start start 2024-08-20T01:43:19.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.863+0000 7fc174ca6740 1 Processor -- start 2024-08-20T01:43:19.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.863+0000 7fc174ca6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56301ca4a880 0x56301ca5edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:19.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.863+0000 7fc174ca6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56301ca4b1a0 0x56301ca5f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:19.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.863+0000 7fc174ca6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56301ca57130 0x56301ca50730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:19.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.863+0000 7fc174ca6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc16c1b15f0 con 0x56301ca57130 2024-08-20T01:43:19.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.863+0000 7fc174ca6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc16c1b0f20 con 0x56301ca4b1a0 2024-08-20T01:43:19.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.863+0000 7fc174ca6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc16c1ae160 con 0x56301ca4a880 2024-08-20T01:43:19.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.863+0000 7fc174ca6740 10 client.0 _ll_register_callbacks cb 0x7fc164009d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:43:19.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.863+0000 7fc170e4a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56301ca57130 0x56301ca50730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:19.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.863+0000 7fc170e4a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56301ca57130 0x56301ca50730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53156/0 (socket says 172.21.15.79:53156) 2024-08-20T01:43:19.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.863+0000 7fc170e4a640 1 -- 172.21.15.79:0/2287079760 learned_addr learned my addr 172.21.15.79:0/2287079760 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:19.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.863+0000 7fc16bfff640 1 --2- 172.21.15.79:0/2287079760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56301ca4a880 0x56301ca5edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:19.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.863+0000 7fc16b7fe640 1 --2- 172.21.15.79:0/2287079760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56301ca4b1a0 0x56301ca5f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:19.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.863+0000 7fc170e4a640 1 -- 172.21.15.79:0/2287079760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56301ca4a880 msgr2=0x56301ca5edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:19.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.863+0000 7fc170e4a640 1 --2- 172.21.15.79:0/2287079760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56301ca4a880 0x56301ca5edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:19.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.864+0000 7fc170e4a640 1 -- 172.21.15.79:0/2287079760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56301ca4b1a0 msgr2=0x56301ca5f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:19.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.864+0000 7fc170e4a640 1 --2- 172.21.15.79:0/2287079760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56301ca4b1a0 0x56301ca5f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:19.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.864+0000 7fc170e4a640 1 -- 172.21.15.79:0/2287079760 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56301ca50c70 con 0x56301ca57130 2024-08-20T01:43:19.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.864+0000 7fc16b7fe640 1 --2- 172.21.15.79:0/2287079760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56301ca4b1a0 0x56301ca5f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:43:19.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.864+0000 7fc170e4a640 1 --2- 172.21.15.79:0/2287079760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56301ca57130 0x56301ca50730 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fc164012ee0 tx=0x7fc164004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fff8d6c653fc61d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:19.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.864+0000 7fc14b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:43:19.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.864+0000 7fc14b7fe640 1 -- 172.21.15.79:0/2287079760 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc164003970 con 0x56301ca57130 2024-08-20T01:43:19.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.864+0000 7fc14b7fe640 1 -- 172.21.15.79:0/2287079760 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc164003b10 con 0x56301ca57130 2024-08-20T01:43:19.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.864+0000 7fc174ca6740 1 -- 172.21.15.79:0/2287079760 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1600047a0 con 0x56301ca57130 2024-08-20T01:43:19.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.864+0000 7fc14b7fe640 1 -- 172.21.15.79:0/2287079760 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fc164003d10 con 0x56301ca57130 2024-08-20T01:43:19.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.864+0000 7fc174ca6740 10 client.17307 fetch_fsmap learned FSMap version 38 2024-08-20T01:43:19.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.864+0000 7fc174ca6740 1 -- 172.21.15.79:0/2287079760 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x56301cad1000 con 0x56301ca57130 2024-08-20T01:43:19.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.864+0000 7fc14b7fe640 1 -- 172.21.15.79:0/2287079760 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc1600047a0 con 0x56301ca57130 2024-08-20T01:43:19.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.865+0000 7fc14b7fe640 1 -- 172.21.15.79:0/2287079760 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7fc164028070 con 0x56301ca57130 2024-08-20T01:43:19.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.865+0000 7fc174ca6740 10 client.17307 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:43:19.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.865+0000 7fc174ca6740 10 client.17307 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:43:19.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.865+0000 7fc174ca6740 20 client.17307 populate_metadata read hostname 'smithi079' 2024-08-20T01:43:19.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.865+0000 7fc174ca6740 1 --2- 172.21.15.79:0/2287079760 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x56301cad1800 0x56301cad3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:19.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.865+0000 7fc174ca6740 4 client.17307 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:43:19.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.865+0000 7fc174ca6740 1 -- 172.21.15.79:0/2287079760 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56301c9c3880 con 0x56301cad1800 2024-08-20T01:43:19.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.865+0000 7fc16bfff640 1 --2- 172.21.15.79:0/2287079760 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x56301cad1800 0x56301cad3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:19.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.865+0000 7fc14b7fe640 10 client.17307 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:43:19.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.865+0000 7fc16bfff640 1 --2- 172.21.15.79:0/2287079760 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x56301cad1800 0x56301cad3c20 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e908ddbee60c9762 server_cookie=ffed0f9bc9872fbf in_seq=0 out_seq=0 2024-08-20T01:43:19.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.865+0000 7fc14b7fe640 1 -- 172.21.15.79:0/2287079760 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56301c9c3880 con 0x56301cad1800 2024-08-20T01:43:19.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.865+0000 7fc14b7fe640 10 client.17307 handle_command_reply: tid=0 2024-08-20T01:43:19.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.866+0000 7fc174ca6740 1 client.17307 shutdown 2024-08-20T01:43:19.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.866+0000 7fc174ca6740 1 -- 172.21.15.79:0/2287079760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56301ca57130 msgr2=0x56301ca50730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:19.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.866+0000 7fc174ca6740 1 --2- 172.21.15.79:0/2287079760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56301ca57130 0x56301ca50730 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fc164012ee0 tx=0x7fc164004ab0 comp rx=0 tx=0).stop 2024-08-20T01:43:19.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.866+0000 7fc174ca6740 1 -- 172.21.15.79:0/2287079760 shutdown_connections 2024-08-20T01:43:19.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.866+0000 7fc174ca6740 1 --2- 172.21.15.79:0/2287079760 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x56301cad1800 0x56301cad3c20 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:19.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.866+0000 7fc174ca6740 1 --2- 172.21.15.79:0/2287079760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56301ca57130 0x56301ca50730 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:19.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.866+0000 7fc174ca6740 1 --2- 172.21.15.79:0/2287079760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56301ca4b1a0 0x56301ca5f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:19.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.866+0000 7fc174ca6740 1 --2- 172.21.15.79:0/2287079760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56301ca4a880 0x56301ca5edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:19.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.866+0000 7fc174ca6740 1 -- 172.21.15.79:0/2287079760 >> 172.21.15.79:0/2287079760 conn(0x56301ca486b0 msgr2=0x56301ca49cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:19.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.866+0000 7fc14b7fe640 0 client.17307 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:43:19.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.866+0000 7fc174ca6740 1 -- 172.21.15.79:0/2287079760 shutdown_connections 2024-08-20T01:43:19.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.866+0000 7fc174ca6740 1 -- 172.21.15.79:0/2287079760 wait complete. 2024-08-20T01:43:19.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.866+0000 7fc174ca6740 20 client.17307 trim_cache size 0 max 16384 2024-08-20T01:43:19.878 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:43:19.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.867+0000 7fc1728ad640 1 -- 172.21.15.79:0/4255816399 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc1540b3bd0 msgr2=0x7fc1540b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:19.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.867+0000 7fc1728ad640 1 --2- 172.21.15.79:0/4255816399 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc1540b3bd0 0x7fc1540b6090 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc164005fd0 tx=0x7fc164014bf0 comp rx=0 tx=0).stop 2024-08-20T01:43:19.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.867+0000 7fc1728ad640 1 -- 172.21.15.79:0/4255816399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc16c102aa0 msgr2=0x7fc16c19b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:19.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.867+0000 7fc1728ad640 1 --2- 172.21.15.79:0/4255816399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc16c102aa0 0x7fc16c19b0f0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fc15c009230 tx=0x7fc15c004270 comp rx=0 tx=0).stop 2024-08-20T01:43:19.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.867+0000 7fc1728ad640 1 -- 172.21.15.79:0/4255816399 shutdown_connections 2024-08-20T01:43:19.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.867+0000 7fc1728ad640 1 --2- 172.21.15.79:0/4255816399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc16c108e30 0x7fc16c1a09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:19.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.867+0000 7fc1728ad640 1 --2- 172.21.15.79:0/4255816399 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc1540b3bd0 0x7fc1540b6090 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:19.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.867+0000 7fc1728ad640 1 --2- 172.21.15.79:0/4255816399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc16c1084b0 0x7fc16c19b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:19.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.867+0000 7fc1728ad640 1 --2- 172.21.15.79:0/4255816399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc16c102aa0 0x7fc16c19b0f0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:19.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.867+0000 7fc1728ad640 1 -- 172.21.15.79:0/4255816399 >> 172.21.15.79:0/4255816399 conn(0x7fc16c0fe550 msgr2=0x7fc16c104a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:19.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.867+0000 7fc1728ad640 1 -- 172.21.15.79:0/4255816399 shutdown_connections 2024-08-20T01:43:19.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:19.867+0000 7fc1728ad640 1 -- 172.21.15.79:0/4255816399 wait complete. 2024-08-20T01:43:20.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.055+0000 7f6a2c060640 1 -- 172.21.15.79:0/443333756 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a24104170 msgr2=0x7f6a2410aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:20.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.055+0000 7f6a2c060640 1 --2- 172.21.15.79:0/443333756 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a24104170 0x7f6a2410aaf0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c009cd0 tx=0x7f6a1c02a8e0 comp rx=0 tx=0).stop 2024-08-20T01:43:20.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.055+0000 7f6a2c060640 1 -- 172.21.15.79:0/443333756 shutdown_connections 2024-08-20T01:43:20.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.055+0000 7f6a2c060640 1 --2- 172.21.15.79:0/443333756 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a24104170 0x7f6a2410aaf0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:20.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.055+0000 7f6a2c060640 1 --2- 172.21.15.79:0/443333756 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a241037b0 0x7f6a24103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:20.059 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.055+0000 7f6a2c060640 1 --2- 172.21.15.79:0/443333756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a24102660 0x7f6a24102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:20.059 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.055+0000 7f6a2c060640 1 -- 172.21.15.79:0/443333756 >> 172.21.15.79:0/443333756 conn(0x7f6a240fdf20 msgr2=0x7f6a24100340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:20.059 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.055+0000 7f6a2c060640 1 -- 172.21.15.79:0/443333756 shutdown_connections 2024-08-20T01:43:20.059 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.055+0000 7f6a2c060640 1 -- 172.21.15.79:0/443333756 wait complete. 2024-08-20T01:43:20.059 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.056+0000 7f6a2c060640 1 Processor -- start 2024-08-20T01:43:20.059 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.056+0000 7f6a2c060640 1 -- start start 2024-08-20T01:43:20.061 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.056+0000 7f6a2c060640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a24102660 0x7f6a24198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:20.061 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.056+0000 7f6a2c060640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a241037b0 0x7f6a24198fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:20.061 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.056+0000 7f6a2c060640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a24104170 0x7f6a24199be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:20.061 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.056+0000 7f6a2c060640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6a2410e180 con 0x7f6a24102660 2024-08-20T01:43:20.061 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.056+0000 7f6a2c060640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6a2410e000 con 0x7f6a241037b0 2024-08-20T01:43:20.061 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.056+0000 7f6a2c060640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6a2410e300 con 0x7f6a24104170 2024-08-20T01:43:20.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.056+0000 7f6a29dfc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a24102660 0x7f6a24198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:20.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.056+0000 7f6a29dfc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a24102660 0x7f6a24198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53182/0 (socket says 172.21.15.79:53182) 2024-08-20T01:43:20.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.056+0000 7f6a29dfc640 1 -- 172.21.15.79:0/2097961346 learned_addr learned my addr 172.21.15.79:0/2097961346 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:20.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.056+0000 7f6a295fb640 1 --2- 172.21.15.79:0/2097961346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a241037b0 0x7f6a24198fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:20.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.056+0000 7f6a29dfc640 1 -- 172.21.15.79:0/2097961346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a24104170 msgr2=0x7f6a24199be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:20.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.056+0000 7f6a29dfc640 1 --2- 172.21.15.79:0/2097961346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a24104170 0x7f6a24199be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:20.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.056+0000 7f6a29dfc640 1 -- 172.21.15.79:0/2097961346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a241037b0 msgr2=0x7f6a24198fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:20.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.056+0000 7f6a29dfc640 1 --2- 172.21.15.79:0/2097961346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a241037b0 0x7f6a24198fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:20.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.056+0000 7f6a29dfc640 1 -- 172.21.15.79:0/2097961346 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a2419a4a0 con 0x7f6a24102660 2024-08-20T01:43:20.063 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.057+0000 7f6a29dfc640 1 --2- 172.21.15.79:0/2097961346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a24102660 0x7f6a24198960 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000d950 tx=0x7f6a2000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:20.063 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.057+0000 7f6a1affd640 1 -- 172.21.15.79:0/2097961346 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a20017070 con 0x7f6a24102660 2024-08-20T01:43:20.063 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.057+0000 7f6a2c060640 1 -- 172.21.15.79:0/2097961346 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a2419a790 con 0x7f6a24102660 2024-08-20T01:43:20.063 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.057+0000 7f6a1affd640 1 -- 172.21.15.79:0/2097961346 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a20009c30 con 0x7f6a24102660 2024-08-20T01:43:20.063 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.057+0000 7f6a1affd640 1 -- 172.21.15.79:0/2097961346 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a2000f620 con 0x7f6a24102660 2024-08-20T01:43:20.063 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.057+0000 7f6a2c060640 1 -- 172.21.15.79:0/2097961346 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a241a0e60 con 0x7f6a24102660 2024-08-20T01:43:20.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.059+0000 7f6a2ee5b740 1 Processor -- start 2024-08-20T01:43:20.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.059+0000 7f6a1affd640 1 -- 172.21.15.79:0/2097961346 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f6a20010460 con 0x7f6a24102660 2024-08-20T01:43:20.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.060+0000 7f6a2ee5b740 1 -- start start 2024-08-20T01:43:20.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.060+0000 7f6a2ee5b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fedebee8d0 0x55fedebf0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:20.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.060+0000 7f6a2ee5b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedebf1200 0x55fedebf35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:20.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.060+0000 7f6a2ee5b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedebf3c40 0x55fedebf6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:20.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.060+0000 7f6a2ee5b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fedeb61360 con 0x55fedebee8d0 2024-08-20T01:43:20.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.060+0000 7f6a2ee5b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55fedeb50860 con 0x55fedebf3c40 2024-08-20T01:43:20.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.060+0000 7f6a2ee5b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55fedeb548a0 con 0x55fedebf1200 2024-08-20T01:43:20.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.060+0000 7f6a2a5fd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fedebee8d0 0x55fedebf0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:20.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.060+0000 7f6a2a5fd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fedebee8d0 0x55fedebf0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53190/0 (socket says 172.21.15.79:53190) 2024-08-20T01:43:20.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.060+0000 7f6a2a5fd640 1 -- 172.21.15.79:0/2800340447 learned_addr learned my addr 172.21.15.79:0/2800340447 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:20.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.060+0000 7f6a29dfc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedebf1200 0x55fedebf35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:20.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.060+0000 7f6a295fb640 1 --2- 172.21.15.79:0/2800340447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedebf3c40 0x55fedebf6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:20.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.060+0000 7f6a2a5fd640 1 -- 172.21.15.79:0/2800340447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedebf1200 msgr2=0x55fedebf35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:20.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.060+0000 7f6a2a5fd640 1 --2- 172.21.15.79:0/2800340447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedebf1200 0x55fedebf35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:20.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.060+0000 7f6a2a5fd640 1 -- 172.21.15.79:0/2800340447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedebf3c40 msgr2=0x55fedebf6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:20.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.060+0000 7f6a2a5fd640 1 --2- 172.21.15.79:0/2800340447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedebf3c40 0x55fedebf6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:20.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.060+0000 7f6a2a5fd640 1 -- 172.21.15.79:0/2800340447 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fedeaf7e40 con 0x55fedebee8d0 2024-08-20T01:43:20.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.061+0000 7f6a2a5fd640 1 --2- 172.21.15.79:0/2800340447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fedebee8d0 0x55fedebf0cc0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c031650 tx=0x7f6a1c009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e1fe69be83cda6c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:20.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.061+0000 7f6a1affd640 1 --2- 172.21.15.79:0/2097961346 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6a100b3bd0 0x7f6a100b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:20.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.061+0000 7f6a29dfc640 1 --2- 172.21.15.79:0/2097961346 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6a100b3bd0 0x7f6a100b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:20.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.061+0000 7f6a0ffff640 1 -- 172.21.15.79:0/2800340447 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c031890 con 0x55fedebee8d0 2024-08-20T01:43:20.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.061+0000 7f6a0ffff640 1 -- 172.21.15.79:0/2800340447 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a1c036040 con 0x55fedebee8d0 2024-08-20T01:43:20.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.061+0000 7f6a0ffff640 1 -- 172.21.15.79:0/2800340447 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c004400 con 0x55fedebee8d0 2024-08-20T01:43:20.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.061+0000 7f6a1affd640 1 -- 172.21.15.79:0/2097961346 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f6a200e38b0 con 0x7f6a24102660 2024-08-20T01:43:20.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.062+0000 7f6a2ee5b740 1 -- 172.21.15.79:0/2800340447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fedebee8d0 msgr2=0x55fedebf0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:20.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.062+0000 7f6a2ee5b740 1 --2- 172.21.15.79:0/2800340447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fedebee8d0 0x55fedebf0cc0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c031650 tx=0x7f6a1c009360 comp rx=0 tx=0).stop 2024-08-20T01:43:20.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.062+0000 7f6a29dfc640 1 --2- 172.21.15.79:0/2097961346 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6a100b3bd0 0x7f6a100b6090 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6a200aa7a0 tx=0x7f6a20092040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:20.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.062+0000 7f6a2ee5b740 1 -- 172.21.15.79:0/2800340447 shutdown_connections 2024-08-20T01:43:20.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.062+0000 7f6a2ee5b740 1 --2- 172.21.15.79:0/2800340447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedebf3c40 0x55fedebf6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:20.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.062+0000 7f6a2ee5b740 1 --2- 172.21.15.79:0/2800340447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedebf1200 0x55fedebf35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:20.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.062+0000 7f6a2ee5b740 1 --2- 172.21.15.79:0/2800340447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fedebee8d0 0x55fedebf0cc0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:20.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.062+0000 7f6a2ee5b740 1 -- 172.21.15.79:0/2800340447 >> 172.21.15.79:0/2800340447 conn(0x55fedebe9a20 msgr2=0x55fedebea7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:20.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.062+0000 7f6a2ee5b740 1 -- 172.21.15.79:0/2800340447 shutdown_connections 2024-08-20T01:43:20.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.062+0000 7f6a2ee5b740 1 -- 172.21.15.79:0/2800340447 wait complete. 2024-08-20T01:43:20.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.062+0000 7f6a2ee5b740 1 -- start start 2024-08-20T01:43:20.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.062+0000 7f6a2ee5b740 1 Processor -- start 2024-08-20T01:43:20.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.063+0000 7f6a2ee5b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedebee8d0 0x55fedebf80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:20.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.063+0000 7f6a2ee5b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedebf1200 0x55fedebf8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:20.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.063+0000 7f6a2ee5b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fedebf3c40 0x55fedebf9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:20.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.063+0000 7f6a2ee5b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fedea89ab0 con 0x55fedebf3c40 2024-08-20T01:43:20.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.063+0000 7f6a2ee5b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55fedead7780 con 0x55fedebf1200 2024-08-20T01:43:20.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.063+0000 7f6a2ee5b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55fedebf6bc0 con 0x55fedebee8d0 2024-08-20T01:43:20.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.063+0000 7f6a2ee5b740 10 client.0 _ll_register_callbacks cb 0x55fede85fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:43:20.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.063+0000 7f6a2a5fd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fedebf3c40 0x55fedebf9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:20.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.063+0000 7f6a2a5fd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fedebf3c40 0x55fedebf9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53194/0 (socket says 172.21.15.79:53194) 2024-08-20T01:43:20.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.063+0000 7f6a2a5fd640 1 -- 172.21.15.79:0/3101830540 learned_addr learned my addr 172.21.15.79:0/3101830540 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:20.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.063+0000 7f6a295fb640 1 --2- 172.21.15.79:0/3101830540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedebf1200 0x55fedebf8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:20.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.063+0000 7f6a2a5fd640 1 --2- 172.21.15.79:0/3101830540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedebee8d0 0x55fedebf80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:20.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.063+0000 7f6a2a5fd640 1 -- 172.21.15.79:0/3101830540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedebee8d0 msgr2=0x55fedebf80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:20.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.063+0000 7f6a2a5fd640 1 --2- 172.21.15.79:0/3101830540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedebee8d0 0x55fedebf80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:20.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.063+0000 7f6a2a5fd640 1 -- 172.21.15.79:0/3101830540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedebf1200 msgr2=0x55fedebf8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:20.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.063+0000 7f6a2a5fd640 1 --2- 172.21.15.79:0/3101830540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedebf1200 0x55fedebf8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:20.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.063+0000 7f6a2a5fd640 1 -- 172.21.15.79:0/3101830540 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fede8b3790 con 0x55fedebf3c40 2024-08-20T01:43:20.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.063+0000 7f6a2a5fd640 1 --2- 172.21.15.79:0/3101830540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fedebf3c40 0x55fedebf9310 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c005cc0 tx=0x7f6a1c005c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca298371ae6e32b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:20.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.063+0000 7f6a0d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:43:20.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.064+0000 7f6a0d7fa640 1 -- 172.21.15.79:0/3101830540 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c031a90 con 0x55fedebf3c40 2024-08-20T01:43:20.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.064+0000 7f6a0d7fa640 1 -- 172.21.15.79:0/3101830540 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f6a1c04d040 con 0x55fedebf3c40 2024-08-20T01:43:20.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.064+0000 7f6a2ee5b740 1 -- 172.21.15.79:0/3101830540 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fedeaffe00 con 0x55fedebf3c40 2024-08-20T01:43:20.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.064+0000 7f6a0d7fa640 1 -- 172.21.15.79:0/3101830540 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f6a1c004b40 con 0x55fedebf3c40 2024-08-20T01:43:20.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.064+0000 7f6a2ee5b740 10 client.17319 fetch_fsmap learned FSMap version 38 2024-08-20T01:43:20.076 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.064+0000 7f6a2ee5b740 1 -- 172.21.15.79:0/3101830540 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55fede92c620 con 0x55fedebf3c40 2024-08-20T01:43:20.077 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.064+0000 7f6a0d7fa640 1 -- 172.21.15.79:0/3101830540 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55fedeaffe00 con 0x55fedebf3c40 2024-08-20T01:43:20.077 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.064+0000 7f6a0d7fa640 1 -- 172.21.15.79:0/3101830540 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f6a1c05b020 con 0x55fedebf3c40 2024-08-20T01:43:20.077 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.064+0000 7f6a2ee5b740 10 client.17319 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:43:20.077 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.064+0000 7f6a2ee5b740 10 client.17319 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:43:20.077 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.064+0000 7f6a2ee5b740 20 client.17319 populate_metadata read hostname 'smithi079' 2024-08-20T01:43:20.077 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.064+0000 7f6a2ee5b740 1 --2- 172.21.15.79:0/3101830540 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55fedec03540 0x55fedec05930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:20.077 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.064+0000 7f6a2ee5b740 4 client.17319 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:43:20.077 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.064+0000 7f6a2ee5b740 1 -- 172.21.15.79:0/3101830540 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fedeb632b0 con 0x55fedec03540 2024-08-20T01:43:20.077 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.065+0000 7f6a295fb640 1 --2- 172.21.15.79:0/3101830540 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55fedec03540 0x55fedec05930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:20.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.065+0000 7f6a295fb640 1 --2- 172.21.15.79:0/3101830540 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55fedec03540 0x55fedec05930 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a5d8ae3bd1d9113 server_cookie=c7250aec854f8aa0 in_seq=0 out_seq=0 2024-08-20T01:43:20.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.065+0000 7f6a0d7fa640 10 client.17319 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:43:20.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.066+0000 7f6a0d7fa640 1 -- 172.21.15.79:0/3101830540 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fedeb632b0 con 0x55fedec03540 2024-08-20T01:43:20.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.066+0000 7f6a0d7fa640 10 client.17319 handle_command_reply: tid=0 2024-08-20T01:43:20.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.066+0000 7f6a2ee5b740 1 client.17319 shutdown 2024-08-20T01:43:20.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.066+0000 7f6a2ee5b740 1 -- 172.21.15.79:0/3101830540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fedebf3c40 msgr2=0x55fedebf9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:20.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.066+0000 7f6a2ee5b740 1 --2- 172.21.15.79:0/3101830540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fedebf3c40 0x55fedebf9310 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c005cc0 tx=0x7f6a1c005c30 comp rx=0 tx=0).stop 2024-08-20T01:43:20.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.066+0000 7f6a2ee5b740 1 -- 172.21.15.79:0/3101830540 shutdown_connections 2024-08-20T01:43:20.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.066+0000 7f6a2ee5b740 1 --2- 172.21.15.79:0/3101830540 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55fedec03540 0x55fedec05930 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:20.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.066+0000 7f6a2ee5b740 1 --2- 172.21.15.79:0/3101830540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fedebf3c40 0x55fedebf9310 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:20.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.066+0000 7f6a2ee5b740 1 --2- 172.21.15.79:0/3101830540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedebf1200 0x55fedebf8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:20.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.066+0000 7f6a0d7fa640 0 client.17319 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:43:20.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.066+0000 7f6a2ee5b740 1 --2- 172.21.15.79:0/3101830540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedebee8d0 0x55fedebf80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:20.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.066+0000 7f6a2ee5b740 1 -- 172.21.15.79:0/3101830540 >> 172.21.15.79:0/3101830540 conn(0x55fedebe9a20 msgr2=0x55fedebe8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:20.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.066+0000 7f6a2ee5b740 1 -- 172.21.15.79:0/3101830540 shutdown_connections 2024-08-20T01:43:20.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.066+0000 7f6a2ee5b740 1 -- 172.21.15.79:0/3101830540 wait complete. 2024-08-20T01:43:20.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.066+0000 7f6a2ee5b740 20 client.17319 trim_cache size 0 max 16384 2024-08-20T01:43:20.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.082+0000 7f6a2ee5b740 1 Processor -- start 2024-08-20T01:43:20.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.082+0000 7f6a2ee5b740 1 -- start start 2024-08-20T01:43:20.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.083+0000 7f6a2ee5b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedebee8d0 0x55fedebe92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:20.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.083+0000 7f6a2ee5b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fedebf1200 0x55fedebe4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:20.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.083+0000 7f6a2ee5b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedebf3c40 0x55fedebf4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:20.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.083+0000 7f6a2ee5b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6a241a9b30 con 0x55fedebf1200 2024-08-20T01:43:20.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.083+0000 7f6a2ee5b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6a241ab670 con 0x55fedebf3c40 2024-08-20T01:43:20.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.083+0000 7f6a2ee5b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6a241aa200 con 0x55fedebee8d0 2024-08-20T01:43:20.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.083+0000 7f6a295fb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fedebf1200 0x55fedebe4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:20.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.083+0000 7f6a295fb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fedebf1200 0x55fedebe4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53206/0 (socket says 172.21.15.79:53206) 2024-08-20T01:43:20.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.083+0000 7f6a295fb640 1 -- 172.21.15.79:0/477993405 learned_addr learned my addr 172.21.15.79:0/477993405 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:20.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.083+0000 7f6a2a5fd640 1 --2- 172.21.15.79:0/477993405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedebee8d0 0x55fedebe92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:20.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.083+0000 7f6a295fb640 1 -- 172.21.15.79:0/477993405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedebee8d0 msgr2=0x55fedebe92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:20.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.083+0000 7f6a295fb640 1 --2- 172.21.15.79:0/477993405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedebee8d0 0x55fedebe92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:20.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.083+0000 7f6a295fb640 1 -- 172.21.15.79:0/477993405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedebf3c40 msgr2=0x55fedebf4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:20.088 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.083+0000 7f6a295fb640 1 --2- 172.21.15.79:0/477993405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedebf3c40 0x55fedebf4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:20.088 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.083+0000 7f6a295fb640 1 -- 172.21.15.79:0/477993405 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fedebeac80 con 0x55fedebf1200 2024-08-20T01:43:20.088 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.083+0000 7f6a2a5fd640 1 --2- 172.21.15.79:0/477993405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedebee8d0 0x55fedebe92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:43:20.088 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.083+0000 7f6a295fb640 1 --2- 172.21.15.79:0/477993405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fedebf1200 0x55fedebe4900 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x55fedec06110 tx=0x7f6a14005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b811b6e845bd74e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:20.088 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.083+0000 7f6a0f7fe640 1 -- 172.21.15.79:0/477993405 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a14004250 con 0x55fedebf1200 2024-08-20T01:43:20.088 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.083+0000 7f6a0f7fe640 1 -- 172.21.15.79:0/477993405 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a140043f0 con 0x55fedebf1200 2024-08-20T01:43:20.088 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.083+0000 7f6a0f7fe640 1 -- 172.21.15.79:0/477993405 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a1401f820 con 0x55fedebf1200 2024-08-20T01:43:20.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.084+0000 7f6a2ee5b740 1 -- 172.21.15.79:0/477993405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fedebf1200 msgr2=0x55fedebe4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:20.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.084+0000 7f6a2ee5b740 1 --2- 172.21.15.79:0/477993405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fedebf1200 0x55fedebe4900 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x55fedec06110 tx=0x7f6a14005f90 comp rx=0 tx=0).stop 2024-08-20T01:43:20.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.084+0000 7f6a2ee5b740 1 -- 172.21.15.79:0/477993405 shutdown_connections 2024-08-20T01:43:20.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.084+0000 7f6a2ee5b740 1 --2- 172.21.15.79:0/477993405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedebf3c40 0x55fedebf4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:20.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.084+0000 7f6a2ee5b740 1 --2- 172.21.15.79:0/477993405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fedebf1200 0x55fedebe4900 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:20.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.084+0000 7f6a2ee5b740 1 --2- 172.21.15.79:0/477993405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedebee8d0 0x55fedebe92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:20.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.084+0000 7f6a2ee5b740 1 -- 172.21.15.79:0/477993405 >> 172.21.15.79:0/477993405 conn(0x55fedebe9a20 msgr2=0x55fedebf4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:20.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.084+0000 7f6a2ee5b740 1 -- 172.21.15.79:0/477993405 shutdown_connections 2024-08-20T01:43:20.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.084+0000 7f6a2ee5b740 1 -- 172.21.15.79:0/477993405 wait complete. 2024-08-20T01:43:20.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.085+0000 7f6a2ee5b740 1 -- start start 2024-08-20T01:43:20.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.085+0000 7f6a2ee5b740 1 Processor -- start 2024-08-20T01:43:20.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.085+0000 7f6a2ee5b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedebee8d0 0x55fedebffa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:20.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.085+0000 7f6a2ee5b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fedebf1200 0x55fedebfe700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:20.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.085+0000 7f6a2ee5b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedebf3c40 0x55fedebfec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:20.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.085+0000 7f6a2ee5b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6a241aafa0 con 0x55fedebf1200 2024-08-20T01:43:20.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.085+0000 7f6a2ee5b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6a241aa8d0 con 0x55fedebf3c40 2024-08-20T01:43:20.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.085+0000 7f6a2ee5b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6a241a7b10 con 0x55fedebee8d0 2024-08-20T01:43:20.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.085+0000 7f6a2ee5b740 10 client.0 _ll_register_callbacks cb 0x7f6a1c03f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:43:20.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.085+0000 7f6a295fb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fedebf1200 0x55fedebfe700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:20.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.085+0000 7f6a295fb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fedebf1200 0x55fedebfe700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53210/0 (socket says 172.21.15.79:53210) 2024-08-20T01:43:20.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.085+0000 7f6a295fb640 1 -- 172.21.15.79:0/603261156 learned_addr learned my addr 172.21.15.79:0/603261156 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:20.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.085+0000 7f6a2a5fd640 1 --2- 172.21.15.79:0/603261156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedebee8d0 0x55fedebffa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:20.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.085+0000 7f6a2a5fd640 1 --2- 172.21.15.79:0/603261156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedebf3c40 0x55fedebfec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:20.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.086+0000 7f6a295fb640 1 -- 172.21.15.79:0/603261156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedebee8d0 msgr2=0x55fedebffa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:20.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.086+0000 7f6a295fb640 1 --2- 172.21.15.79:0/603261156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedebee8d0 0x55fedebffa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:20.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.086+0000 7f6a295fb640 1 -- 172.21.15.79:0/603261156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedebf3c40 msgr2=0x55fedebfec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:20.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.086+0000 7f6a295fb640 1 --2- 172.21.15.79:0/603261156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedebf3c40 0x55fedebfec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:20.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.086+0000 7f6a295fb640 1 -- 172.21.15.79:0/603261156 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fedebf3960 con 0x55fedebf1200 2024-08-20T01:43:20.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.086+0000 7f6a295fb640 1 --2- 172.21.15.79:0/603261156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fedebf1200 0x55fedebfe700 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f6a14003620 tx=0x7f6a14003650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cd9abc4f9d33e41 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:20.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.086+0000 7f6a0d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:43:20.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.086+0000 7f6a0d7fa640 1 -- 172.21.15.79:0/603261156 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a14037060 con 0x55fedebf1200 2024-08-20T01:43:20.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.086+0000 7f6a0d7fa640 1 -- 172.21.15.79:0/603261156 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f6a14005310 con 0x55fedebf1200 2024-08-20T01:43:20.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.086+0000 7f6a2ee5b740 1 -- 172.21.15.79:0/603261156 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a140043f0 con 0x55fedebf1200 2024-08-20T01:43:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.086+0000 7f6a0d7fa640 1 -- 172.21.15.79:0/603261156 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f6a1402c040 con 0x55fedebf1200 2024-08-20T01:43:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.086+0000 7f6a2ee5b740 10 client.17325 fetch_fsmap learned FSMap version 38 2024-08-20T01:43:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.086+0000 7f6a2ee5b740 1 -- 172.21.15.79:0/603261156 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55fedebfded0 con 0x55fedebf1200 2024-08-20T01:43:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.086+0000 7f6a0d7fa640 1 -- 172.21.15.79:0/603261156 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a140043f0 con 0x55fedebf1200 2024-08-20T01:43:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.087+0000 7f6a0d7fa640 1 -- 172.21.15.79:0/603261156 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f6a14004a10 con 0x55fedebf1200 2024-08-20T01:43:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.087+0000 7f6a2ee5b740 10 client.17325 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:43:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.087+0000 7f6a2ee5b740 10 client.17325 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:43:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.087+0000 7f6a2ee5b740 20 client.17325 populate_metadata read hostname 'smithi079' 2024-08-20T01:43:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.087+0000 7f6a2ee5b740 1 --2- 172.21.15.79:0/603261156 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55fedec6e740 0x55fedec70b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.087+0000 7f6a2ee5b740 4 client.17325 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:43:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.087+0000 7f6a2ee5b740 1 -- 172.21.15.79:0/603261156 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fedeb5ed50 con 0x55fedec6e740 2024-08-20T01:43:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.087+0000 7f6a2a5fd640 1 --2- 172.21.15.79:0/603261156 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55fedec6e740 0x55fedec70b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:20.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.087+0000 7f6a0d7fa640 10 client.17325 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:43:20.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.087+0000 7f6a2a5fd640 1 --2- 172.21.15.79:0/603261156 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55fedec6e740 0x55fedec70b60 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d34230e3f02fdb6 server_cookie=7737f0e716739a4e in_seq=0 out_seq=0 2024-08-20T01:43:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.095+0000 7f6a0d7fa640 1 -- 172.21.15.79:0/603261156 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fedeb5ed50 con 0x55fedec6e740 2024-08-20T01:43:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.095+0000 7f6a0d7fa640 10 client.17325 handle_command_reply: tid=0 2024-08-20T01:43:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.095+0000 7f6a2ee5b740 1 client.17325 shutdown 2024-08-20T01:43:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.095+0000 7f6a2ee5b740 1 -- 172.21.15.79:0/603261156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fedebf1200 msgr2=0x55fedebfe700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.095+0000 7f6a2ee5b740 1 --2- 172.21.15.79:0/603261156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fedebf1200 0x55fedebfe700 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f6a14003620 tx=0x7f6a14003650 comp rx=0 tx=0).stop 2024-08-20T01:43:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.095+0000 7f6a2ee5b740 1 -- 172.21.15.79:0/603261156 shutdown_connections 2024-08-20T01:43:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.095+0000 7f6a2ee5b740 1 --2- 172.21.15.79:0/603261156 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55fedec6e740 0x55fedec70b60 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.095+0000 7f6a2ee5b740 1 --2- 172.21.15.79:0/603261156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fedebf3c40 0x55fedebfec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.095+0000 7f6a0d7fa640 0 client.17325 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:43:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.095+0000 7f6a2ee5b740 1 --2- 172.21.15.79:0/603261156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fedebf1200 0x55fedebfe700 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.095+0000 7f6a2ee5b740 1 --2- 172.21.15.79:0/603261156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedebee8d0 0x55fedebffa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.095+0000 7f6a2ee5b740 1 -- 172.21.15.79:0/603261156 >> 172.21.15.79:0/603261156 conn(0x55fedebe9a20 msgr2=0x55fedebf4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.095+0000 7f6a2ee5b740 1 -- 172.21.15.79:0/603261156 shutdown_connections 2024-08-20T01:43:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.095+0000 7f6a2ee5b740 1 -- 172.21.15.79:0/603261156 wait complete. 2024-08-20T01:43:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.095+0000 7f6a2ee5b740 20 client.17325 trim_cache size 0 max 16384 2024-08-20T01:43:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:43:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:43:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:43:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:43:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.096+0000 7f6a2c060640 1 -- 172.21.15.79:0/2097961346 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6a100b3bd0 msgr2=0x7f6a100b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.096+0000 7f6a2c060640 1 --2- 172.21.15.79:0/2097961346 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6a100b3bd0 0x7f6a100b6090 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6a200aa7a0 tx=0x7f6a20092040 comp rx=0 tx=0).stop 2024-08-20T01:43:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.096+0000 7f6a2c060640 1 -- 172.21.15.79:0/2097961346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a24102660 msgr2=0x7f6a24198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.096+0000 7f6a2c060640 1 --2- 172.21.15.79:0/2097961346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a24102660 0x7f6a24198960 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000d950 tx=0x7f6a2000de10 comp rx=0 tx=0).stop 2024-08-20T01:43:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.096+0000 7f6a2c060640 1 -- 172.21.15.79:0/2097961346 shutdown_connections 2024-08-20T01:43:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.096+0000 7f6a2c060640 1 --2- 172.21.15.79:0/2097961346 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6a100b3bd0 0x7f6a100b6090 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.096+0000 7f6a2c060640 1 --2- 172.21.15.79:0/2097961346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a24104170 0x7f6a24199be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.096+0000 7f6a2c060640 1 --2- 172.21.15.79:0/2097961346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a241037b0 0x7f6a24198fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.096+0000 7f6a2c060640 1 --2- 172.21.15.79:0/2097961346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a24102660 0x7f6a24198960 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.096+0000 7f6a2c060640 1 -- 172.21.15.79:0/2097961346 >> 172.21.15.79:0/2097961346 conn(0x7f6a240fdf20 msgr2=0x7f6a24106bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.096+0000 7f6a2c060640 1 -- 172.21.15.79:0/2097961346 shutdown_connections 2024-08-20T01:43:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:20.096+0000 7f6a2c060640 1 -- 172.21.15.79:0/2097961346 wait complete. 2024-08-20T01:43:20.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:20 smithi175 ceph-mon[22392]: pgmap v527: 97 pgs: 97 active+clean; 8.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 30 MiB/s wr, 26 op/s 2024-08-20T01:43:20.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:20 smithi079 ceph-mon[18656]: pgmap v527: 97 pgs: 97 active+clean; 8.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 30 MiB/s wr, 26 op/s 2024-08-20T01:43:20.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:20 smithi081 ceph-mon[22209]: pgmap v527: 97 pgs: 97 active+clean; 8.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 30 MiB/s wr, 26 op/s 2024-08-20T01:43:20.939 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T01:43:21.257 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:43:21.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.752+0000 7fbce886d640 1 -- 172.21.15.79:0/809927234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbce41084f0 msgr2=0x7fbce4108930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:21.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.752+0000 7fbce886d640 1 --2- 172.21.15.79:0/809927234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbce41084f0 0x7fbce4108930 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fbcd8009900 tx=0x7fbcd802a410 comp rx=0 tx=0).stop 2024-08-20T01:43:21.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.752+0000 7fbce886d640 1 -- 172.21.15.79:0/809927234 shutdown_connections 2024-08-20T01:43:21.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.752+0000 7fbce886d640 1 --2- 172.21.15.79:0/809927234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbce4108e70 0x7fbce410f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:21.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.752+0000 7fbce886d640 1 --2- 172.21.15.79:0/809927234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbce41084f0 0x7fbce4108930 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:21.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.752+0000 7fbce886d640 1 --2- 172.21.15.79:0/809927234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbce4102ae0 0x7fbce4102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:21.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.752+0000 7fbce886d640 1 -- 172.21.15.79:0/809927234 >> 172.21.15.79:0/809927234 conn(0x7fbce40fe510 msgr2=0x7fbce4100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:21.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.752+0000 7fbce886d640 1 -- 172.21.15.79:0/809927234 shutdown_connections 2024-08-20T01:43:21.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.752+0000 7fbce886d640 1 -- 172.21.15.79:0/809927234 wait complete. 2024-08-20T01:43:21.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.753+0000 7fbce886d640 1 Processor -- start 2024-08-20T01:43:21.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.753+0000 7fbce886d640 1 -- start start 2024-08-20T01:43:21.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.753+0000 7fbce886d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbce4102ae0 0x7fbce40751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:21.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.753+0000 7fbce886d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbce41084f0 0x7fbce4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:21.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.753+0000 7fbce886d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbce4108e70 0x7fbce4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:21.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.753+0000 7fbce886d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbce41129e0 con 0x7fbce41084f0 2024-08-20T01:43:21.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.753+0000 7fbce886d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbce4112860 con 0x7fbce4108e70 2024-08-20T01:43:21.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.753+0000 7fbce886d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbce4112b60 con 0x7fbce4102ae0 2024-08-20T01:43:21.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.753+0000 7fbce1d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbce41084f0 0x7fbce4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:21.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.753+0000 7fbce259c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbce4102ae0 0x7fbce40751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:21.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.753+0000 7fbce1d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbce41084f0 0x7fbce4075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34128/0 (socket says 172.21.15.79:34128) 2024-08-20T01:43:21.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.753+0000 7fbce1d9b640 1 -- 172.21.15.79:0/2292374678 learned_addr learned my addr 172.21.15.79:0/2292374678 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:21.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.754+0000 7fbce2d9d640 1 --2- 172.21.15.79:0/2292374678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbce4108e70 0x7fbce4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:21.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.754+0000 7fbce259c640 1 -- 172.21.15.79:0/2292374678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbce4108e70 msgr2=0x7fbce4075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:21.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.754+0000 7fbce259c640 1 --2- 172.21.15.79:0/2292374678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbce4108e70 0x7fbce4075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:21.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.754+0000 7fbce259c640 1 -- 172.21.15.79:0/2292374678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbce41084f0 msgr2=0x7fbce4075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:21.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.754+0000 7fbce259c640 1 --2- 172.21.15.79:0/2292374678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbce41084f0 0x7fbce4075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:21.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.754+0000 7fbce259c640 1 -- 172.21.15.79:0/2292374678 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbce41a7310 con 0x7fbce4102ae0 2024-08-20T01:43:21.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.754+0000 7fbce1d9b640 1 --2- 172.21.15.79:0/2292374678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbce41084f0 0x7fbce4075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:43:21.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.754+0000 7fbce259c640 1 --2- 172.21.15.79:0/2292374678 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbce4102ae0 0x7fbce40751d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbcd400d6d0 tx=0x7fbcd400db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:21.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.754+0000 7fbcd37fe640 1 -- 172.21.15.79:0/2292374678 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4017070 con 0x7fbce4102ae0 2024-08-20T01:43:21.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.754+0000 7fbce886d640 1 -- 172.21.15.79:0/2292374678 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbce41a7600 con 0x7fbce4102ae0 2024-08-20T01:43:21.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.754+0000 7fbcd37fe640 1 -- 172.21.15.79:0/2292374678 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbcd4009820 con 0x7fbce4102ae0 2024-08-20T01:43:21.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.754+0000 7fbcd37fe640 1 -- 172.21.15.79:0/2292374678 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4004bc0 con 0x7fbce4102ae0 2024-08-20T01:43:21.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.754+0000 7fbce886d640 1 -- 172.21.15.79:0/2292374678 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbce41a7bc0 con 0x7fbce4102ae0 2024-08-20T01:43:21.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.757+0000 7fbcd37fe640 1 -- 172.21.15.79:0/2292374678 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fbcd4005220 con 0x7fbce4102ae0 2024-08-20T01:43:21.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.757+0000 7fbceac66740 1 Processor -- start 2024-08-20T01:43:21.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.758+0000 7fbceac66740 1 -- start start 2024-08-20T01:43:21.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.758+0000 7fbceac66740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af0a565880 0x55af0a565c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:21.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.758+0000 7fbceac66740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af0a5661a0 0x55af0a571bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:21.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.758+0000 7fbceac66740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af0a572130 0x55af0a574520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:21.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.758+0000 7fbceac66740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55af0a4dc930 con 0x55af0a5661a0 2024-08-20T01:43:21.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.758+0000 7fbceac66740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55af0a4cbe30 con 0x55af0a572130 2024-08-20T01:43:21.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.758+0000 7fbceac66740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55af0a4cfe70 con 0x55af0a565880 2024-08-20T01:43:21.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.758+0000 7fbce259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af0a5661a0 0x55af0a571bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:21.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.758+0000 7fbce2d9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af0a565880 0x55af0a565c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:21.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.758+0000 7fbce259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af0a5661a0 0x55af0a571bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34144/0 (socket says 172.21.15.79:34144) 2024-08-20T01:43:21.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.758+0000 7fbcd37fe640 1 --2- 172.21.15.79:0/2292374678 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbccc0b3bd0 0x7fbccc0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:21.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.758+0000 7fbce259c640 1 -- 172.21.15.79:0/3106060180 learned_addr learned my addr 172.21.15.79:0/3106060180 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:21.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.758+0000 7fbce1d9b640 1 --2- 172.21.15.79:0/3106060180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af0a572130 0x55af0a574520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:21.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.758+0000 7fbce2d9d640 1 --2- 172.21.15.79:0/2292374678 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbccc0b3bd0 0x7fbccc0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:21.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.758+0000 7fbce1d9b640 1 -- 172.21.15.79:0/3106060180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af0a565880 msgr2=0x55af0a565c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:21.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.758+0000 7fbce1d9b640 1 --2- 172.21.15.79:0/3106060180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af0a565880 0x55af0a565c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:21.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.758+0000 7fbce1d9b640 1 -- 172.21.15.79:0/3106060180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af0a5661a0 msgr2=0x55af0a571bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:21.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.758+0000 7fbce1d9b640 1 --2- 172.21.15.79:0/3106060180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af0a5661a0 0x55af0a571bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:21.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.758+0000 7fbce1d9b640 1 -- 172.21.15.79:0/3106060180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af0a22b650 con 0x55af0a572130 2024-08-20T01:43:21.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.759+0000 7fbce2d9d640 1 --2- 172.21.15.79:0/3106060180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af0a565880 0x55af0a565c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:43:21.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.759+0000 7fbce259c640 1 --2- 172.21.15.79:0/3106060180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af0a5661a0 0x55af0a571bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:43:21.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.759+0000 7fbcd37fe640 1 -- 172.21.15.79:0/2292374678 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fbcd40e36f0 con 0x7fbce4102ae0 2024-08-20T01:43:21.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.759+0000 7fbce1d9b640 1 --2- 172.21.15.79:0/3106060180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af0a572130 0x55af0a574520 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbcd80057c0 tx=0x7fbcd8009680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75e94290727ef076 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:21.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.759+0000 7fbce2d9d640 1 --2- 172.21.15.79:0/2292374678 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbccc0b3bd0 0x7fbccc0b6090 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc009fd0 tx=0x7fbcdc00d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:21.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.759+0000 7fbcd0ff9640 1 -- 172.21.15.79:0/3106060180 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd8035070 con 0x55af0a572130 2024-08-20T01:43:21.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.759+0000 7fbcd0ff9640 1 -- 172.21.15.79:0/3106060180 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbcd80044c0 con 0x55af0a572130 2024-08-20T01:43:21.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.759+0000 7fbcd0ff9640 1 -- 172.21.15.79:0/3106060180 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd803c440 con 0x55af0a572130 2024-08-20T01:43:21.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.760+0000 7fbceac66740 1 -- 172.21.15.79:0/3106060180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af0a572130 msgr2=0x55af0a574520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:21.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.760+0000 7fbceac66740 1 --2- 172.21.15.79:0/3106060180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af0a572130 0x55af0a574520 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbcd80057c0 tx=0x7fbcd8009680 comp rx=0 tx=0).stop 2024-08-20T01:43:21.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.760+0000 7fbceac66740 1 -- 172.21.15.79:0/3106060180 shutdown_connections 2024-08-20T01:43:21.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.760+0000 7fbceac66740 1 --2- 172.21.15.79:0/3106060180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af0a572130 0x55af0a574520 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:21.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.760+0000 7fbceac66740 1 --2- 172.21.15.79:0/3106060180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af0a5661a0 0x55af0a571bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:21.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.760+0000 7fbceac66740 1 --2- 172.21.15.79:0/3106060180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af0a565880 0x55af0a565c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:21.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.760+0000 7fbceac66740 1 -- 172.21.15.79:0/3106060180 >> 172.21.15.79:0/3106060180 conn(0x55af0a5636b0 msgr2=0x55af0a564850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:21.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.760+0000 7fbceac66740 1 -- 172.21.15.79:0/3106060180 shutdown_connections 2024-08-20T01:43:21.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.760+0000 7fbceac66740 1 -- 172.21.15.79:0/3106060180 wait complete. 2024-08-20T01:43:21.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.760+0000 7fbceac66740 1 -- start start 2024-08-20T01:43:21.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.760+0000 7fbceac66740 1 Processor -- start 2024-08-20T01:43:21.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.761+0000 7fbceac66740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af0a565880 0x55af0a56f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:21.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.761+0000 7fbceac66740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af0a5661a0 0x55af0a56f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:21.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.761+0000 7fbceac66740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af0a572130 0x55af0a56fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:21.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.761+0000 7fbce2d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af0a572130 0x55af0a56fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:21.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.761+0000 7fbceac66740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55af0a32e700 con 0x55af0a572130 2024-08-20T01:43:21.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.761+0000 7fbceac66740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55af0a452810 con 0x55af0a565880 2024-08-20T01:43:21.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.761+0000 7fbceac66740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55af0a574d80 con 0x55af0a5661a0 2024-08-20T01:43:21.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.761+0000 7fbce1d9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af0a5661a0 0x55af0a56f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:21.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.761+0000 7fbce1d9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af0a5661a0 0x55af0a56f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:57200/0 (socket says 172.21.15.79:57200) 2024-08-20T01:43:21.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.761+0000 7fbce1d9b640 1 -- 172.21.15.79:0/3728554206 learned_addr learned my addr 172.21.15.79:0/3728554206 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:21.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.761+0000 7fbceac66740 10 client.0 _ll_register_callbacks cb 0x55af0a4c5700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:43:21.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.761+0000 7fbce259c640 1 --2- 172.21.15.79:0/3728554206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af0a565880 0x55af0a56f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:21.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.761+0000 7fbce1d9b640 1 -- 172.21.15.79:0/3728554206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af0a565880 msgr2=0x55af0a56f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:21.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.761+0000 7fbce1d9b640 1 --2- 172.21.15.79:0/3728554206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af0a565880 0x55af0a56f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:21.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.761+0000 7fbce1d9b640 1 -- 172.21.15.79:0/3728554206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af0a572130 msgr2=0x55af0a56fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:21.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.761+0000 7fbce1d9b640 1 --2- 172.21.15.79:0/3728554206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af0a572130 0x55af0a56fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:21.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.761+0000 7fbce1d9b640 1 -- 172.21.15.79:0/3728554206 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af0a586970 con 0x55af0a5661a0 2024-08-20T01:43:21.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.761+0000 7fbce2d9d640 1 --2- 172.21.15.79:0/3728554206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af0a572130 0x55af0a56fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:43:21.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.762+0000 7fbce1d9b640 1 --2- 172.21.15.79:0/3728554206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af0a5661a0 0x55af0a56f640 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbcd80092a0 tx=0x7fbcd8032f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe3087d94f8f683e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:21.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.762+0000 7fbcc9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:43:21.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.762+0000 7fbcc9ffb640 1 -- 172.21.15.79:0/3728554206 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd804e020 con 0x55af0a5661a0 2024-08-20T01:43:21.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.762+0000 7fbcc9ffb640 1 -- 172.21.15.79:0/3728554206 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fbcd8003a00 con 0x55af0a5661a0 2024-08-20T01:43:21.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.762+0000 7fbceac66740 1 -- 172.21.15.79:0/3728554206 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55af0a47b150 con 0x55af0a5661a0 2024-08-20T01:43:21.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.762+0000 7fbcc9ffb640 1 -- 172.21.15.79:0/3728554206 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fbcd8035040 con 0x55af0a5661a0 2024-08-20T01:43:21.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.762+0000 7fbceac66740 10 client.26413 fetch_fsmap learned FSMap version 38 2024-08-20T01:43:21.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.762+0000 7fbceac66740 1 -- 172.21.15.79:0/3728554206 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55af0a589300 con 0x55af0a5661a0 2024-08-20T01:43:21.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.762+0000 7fbcc9ffb640 1 -- 172.21.15.79:0/3728554206 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55af0a47b150 con 0x55af0a5661a0 2024-08-20T01:43:21.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.762+0000 7fbcc9ffb640 1 -- 172.21.15.79:0/3728554206 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7fbcd8045890 con 0x55af0a5661a0 2024-08-20T01:43:21.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.762+0000 7fbceac66740 10 client.26413 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:43:21.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.762+0000 7fbceac66740 10 client.26413 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:43:21.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.762+0000 7fbceac66740 20 client.26413 populate_metadata read hostname 'smithi079' 2024-08-20T01:43:21.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.762+0000 7fbceac66740 1 --2- 172.21.15.79:0/3728554206 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55af0a58a650 0x55af0a58ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:21.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.762+0000 7fbceac66740 4 client.26413 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:43:21.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.762+0000 7fbceac66740 1 -- 172.21.15.79:0/3728554206 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55af0a4de880 con 0x55af0a58a650 2024-08-20T01:43:21.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.763+0000 7fbce259c640 1 --2- 172.21.15.79:0/3728554206 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55af0a58a650 0x55af0a58ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:21.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.763+0000 7fbcc9ffb640 10 client.26413 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:43:21.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.763+0000 7fbce259c640 1 --2- 172.21.15.79:0/3728554206 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55af0a58a650 0x55af0a58ca40 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ebd94241d9b8b123 server_cookie=eae9e93719f851ff in_seq=0 out_seq=0 2024-08-20T01:43:21.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.764+0000 7fbcc9ffb640 1 -- 172.21.15.79:0/3728554206 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55af0a4de880 con 0x55af0a58a650 2024-08-20T01:43:21.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.764+0000 7fbcc9ffb640 10 client.26413 handle_command_reply: tid=0 2024-08-20T01:43:21.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.764+0000 7fbceac66740 1 client.26413 shutdown 2024-08-20T01:43:21.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.764+0000 7fbceac66740 1 -- 172.21.15.79:0/3728554206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af0a5661a0 msgr2=0x55af0a56f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:21.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.764+0000 7fbceac66740 1 --2- 172.21.15.79:0/3728554206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af0a5661a0 0x55af0a56f640 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbcd80092a0 tx=0x7fbcd8032f90 comp rx=0 tx=0).stop 2024-08-20T01:43:21.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.764+0000 7fbceac66740 1 -- 172.21.15.79:0/3728554206 shutdown_connections 2024-08-20T01:43:21.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.764+0000 7fbceac66740 1 --2- 172.21.15.79:0/3728554206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af0a572130 0x55af0a56fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:21.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.764+0000 7fbceac66740 1 --2- 172.21.15.79:0/3728554206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af0a5661a0 0x55af0a56f640 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:21.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.764+0000 7fbceac66740 1 --2- 172.21.15.79:0/3728554206 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55af0a58a650 0x55af0a58ca40 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:21.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.764+0000 7fbceac66740 1 --2- 172.21.15.79:0/3728554206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af0a565880 0x55af0a56f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:21.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.764+0000 7fbcc9ffb640 0 client.26413 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:43:21.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.764+0000 7fbceac66740 1 -- 172.21.15.79:0/3728554206 >> 172.21.15.79:0/3728554206 conn(0x55af0a5636b0 msgr2=0x55af0a569250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:21.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.764+0000 7fbceac66740 1 -- 172.21.15.79:0/3728554206 shutdown_connections 2024-08-20T01:43:21.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.764+0000 7fbceac66740 1 -- 172.21.15.79:0/3728554206 wait complete. 2024-08-20T01:43:21.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.764+0000 7fbceac66740 20 client.26413 trim_cache size 0 max 16384 2024-08-20T01:43:21.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.788+0000 7fbceac66740 1 Processor -- start 2024-08-20T01:43:21.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.788+0000 7fbceac66740 1 -- start start 2024-08-20T01:43:21.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.789+0000 7fbceac66740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af0a565880 0x55af0a56dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:21.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.789+0000 7fbceac66740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af0a5661a0 0x55af0a56ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:21.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.789+0000 7fbceac66740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af0a572130 0x55af0a56f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:21.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.789+0000 7fbceac66740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbce41abd90 con 0x55af0a572130 2024-08-20T01:43:21.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.789+0000 7fbceac66740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbce41ad8d0 con 0x55af0a5661a0 2024-08-20T01:43:21.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.789+0000 7fbceac66740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbce41ac460 con 0x55af0a565880 2024-08-20T01:43:21.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.789+0000 7fbce259c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af0a565880 0x55af0a56dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:21.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.789+0000 7fbce2d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af0a572130 0x55af0a56f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:21.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.789+0000 7fbce259c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af0a565880 0x55af0a56dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:57202/0 (socket says 172.21.15.79:57202) 2024-08-20T01:43:21.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.789+0000 7fbce259c640 1 -- 172.21.15.79:0/1363793106 learned_addr learned my addr 172.21.15.79:0/1363793106 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:21.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.789+0000 7fbce1d9b640 1 --2- 172.21.15.79:0/1363793106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af0a5661a0 0x55af0a56ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:21.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.789+0000 7fbce2d9d640 1 -- 172.21.15.79:0/1363793106 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af0a565880 msgr2=0x55af0a56dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:21.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.789+0000 7fbce2d9d640 1 --2- 172.21.15.79:0/1363793106 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af0a565880 0x55af0a56dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:21.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.789+0000 7fbce2d9d640 1 -- 172.21.15.79:0/1363793106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af0a5661a0 msgr2=0x55af0a56ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:21.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.789+0000 7fbce2d9d640 1 --2- 172.21.15.79:0/1363793106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af0a5661a0 0x55af0a56ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:21.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.789+0000 7fbce2d9d640 1 -- 172.21.15.79:0/1363793106 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af0a5634e0 con 0x55af0a572130 2024-08-20T01:43:21.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.789+0000 7fbce259c640 1 --2- 172.21.15.79:0/1363793106 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af0a565880 0x55af0a56dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:43:21.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.789+0000 7fbce1d9b640 1 --2- 172.21.15.79:0/1363793106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af0a5661a0 0x55af0a56ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:43:21.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.790+0000 7fbce2d9d640 1 --2- 172.21.15.79:0/1363793106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af0a572130 0x55af0a56f7e0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fbce4077290 tx=0x7fbcdc009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c88afc0b174fce6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:21.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.790+0000 7fbccbfff640 1 -- 172.21.15.79:0/1363793106 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc014040 con 0x55af0a572130 2024-08-20T01:43:21.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.790+0000 7fbccbfff640 1 -- 172.21.15.79:0/1363793106 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbcdc029070 con 0x55af0a572130 2024-08-20T01:43:21.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.790+0000 7fbccbfff640 1 -- 172.21.15.79:0/1363793106 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc024ce0 con 0x55af0a572130 2024-08-20T01:43:21.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.791+0000 7fbceac66740 1 -- 172.21.15.79:0/1363793106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af0a572130 msgr2=0x55af0a56f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:21.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.791+0000 7fbceac66740 1 --2- 172.21.15.79:0/1363793106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af0a572130 0x55af0a56f7e0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fbce4077290 tx=0x7fbcdc009650 comp rx=0 tx=0).stop 2024-08-20T01:43:21.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.791+0000 7fbceac66740 1 -- 172.21.15.79:0/1363793106 shutdown_connections 2024-08-20T01:43:21.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.791+0000 7fbceac66740 1 --2- 172.21.15.79:0/1363793106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af0a572130 0x55af0a56f7e0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:21.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.791+0000 7fbceac66740 1 --2- 172.21.15.79:0/1363793106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af0a5661a0 0x55af0a56ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:21.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.791+0000 7fbceac66740 1 --2- 172.21.15.79:0/1363793106 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af0a565880 0x55af0a56dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:21.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.791+0000 7fbceac66740 1 -- 172.21.15.79:0/1363793106 >> 172.21.15.79:0/1363793106 conn(0x55af0a5636b0 msgr2=0x55af0a56f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:21.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.791+0000 7fbceac66740 1 -- 172.21.15.79:0/1363793106 shutdown_connections 2024-08-20T01:43:21.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.791+0000 7fbceac66740 1 -- 172.21.15.79:0/1363793106 wait complete. 2024-08-20T01:43:21.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.791+0000 7fbceac66740 1 -- start start 2024-08-20T01:43:21.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.791+0000 7fbceac66740 1 Processor -- start 2024-08-20T01:43:21.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.791+0000 7fbceac66740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af0a565880 0x55af0a57e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:21.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.791+0000 7fbceac66740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af0a5661a0 0x55af0a57e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:21.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.791+0000 7fbceac66740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af0a572130 0x55af0a5ed0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:21.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.791+0000 7fbceac66740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbce41ad200 con 0x55af0a565880 2024-08-20T01:43:21.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.791+0000 7fbceac66740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbce41acb30 con 0x55af0a572130 2024-08-20T01:43:21.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.791+0000 7fbceac66740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbce41a9d90 con 0x55af0a5661a0 2024-08-20T01:43:21.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.791+0000 7fbceac66740 10 client.0 _ll_register_callbacks cb 0x7fbcd40aa1e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:43:21.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.792+0000 7fbce259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af0a565880 0x55af0a57e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:21.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.792+0000 7fbce259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af0a565880 0x55af0a57e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34174/0 (socket says 172.21.15.79:34174) 2024-08-20T01:43:21.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.792+0000 7fbce259c640 1 -- 172.21.15.79:0/1477512981 learned_addr learned my addr 172.21.15.79:0/1477512981 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:21.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.792+0000 7fbce1d9b640 1 --2- 172.21.15.79:0/1477512981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af0a5661a0 0x55af0a57e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:21.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.792+0000 7fbce2d9d640 1 --2- 172.21.15.79:0/1477512981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af0a572130 0x55af0a5ed0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:21.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.792+0000 7fbce259c640 1 -- 172.21.15.79:0/1477512981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af0a5661a0 msgr2=0x55af0a57e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:21.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.792+0000 7fbce259c640 1 --2- 172.21.15.79:0/1477512981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af0a5661a0 0x55af0a57e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:21.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.792+0000 7fbce259c640 1 -- 172.21.15.79:0/1477512981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af0a572130 msgr2=0x55af0a5ed0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:21.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.792+0000 7fbce259c640 1 --2- 172.21.15.79:0/1477512981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af0a572130 0x55af0a5ed0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:21.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.792+0000 7fbce259c640 1 -- 172.21.15.79:0/1477512981 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af0a564130 con 0x55af0a565880 2024-08-20T01:43:21.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.792+0000 7fbce2d9d640 1 --2- 172.21.15.79:0/1477512981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af0a572130 0x55af0a5ed0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:43:21.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.792+0000 7fbce259c640 1 --2- 172.21.15.79:0/1477512981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af0a565880 0x55af0a57e150 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fbcd40aa3a0 tx=0x7fbcd40b3040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84719c516bd6f5cf server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:21.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.792+0000 7fbcc9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:43:21.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.792+0000 7fbcc9ffb640 1 -- 172.21.15.79:0/1477512981 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4020040 con 0x55af0a565880 2024-08-20T01:43:21.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.792+0000 7fbcc9ffb640 1 -- 172.21.15.79:0/1477512981 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fbcd4009cd0 con 0x55af0a565880 2024-08-20T01:43:21.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.792+0000 7fbceac66740 1 -- 172.21.15.79:0/1477512981 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcdc029070 con 0x55af0a565880 2024-08-20T01:43:21.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.792+0000 7fbcc9ffb640 1 -- 172.21.15.79:0/1477512981 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fbcd40099d0 con 0x55af0a565880 2024-08-20T01:43:21.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.792+0000 7fbceac66740 10 client.17343 fetch_fsmap learned FSMap version 38 2024-08-20T01:43:21.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.792+0000 7fbceac66740 1 -- 172.21.15.79:0/1477512981 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55af0a5f4a20 con 0x55af0a565880 2024-08-20T01:43:21.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.793+0000 7fbcc9ffb640 1 -- 172.21.15.79:0/1477512981 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbcdc029070 con 0x55af0a565880 2024-08-20T01:43:21.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.793+0000 7fbcc9ffb640 1 -- 172.21.15.79:0/1477512981 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7fbcd40cbaf0 con 0x55af0a565880 2024-08-20T01:43:21.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.793+0000 7fbceac66740 10 client.17343 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:43:21.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.793+0000 7fbceac66740 10 client.17343 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:43:21.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.793+0000 7fbceac66740 20 client.17343 populate_metadata read hostname 'smithi079' 2024-08-20T01:43:21.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.793+0000 7fbceac66740 1 --2- 172.21.15.79:0/1477512981 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55af0a5f51d0 0x55af0a5f75f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:21.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.793+0000 7fbceac66740 4 client.17343 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:43:21.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.793+0000 7fbceac66740 1 -- 172.21.15.79:0/1477512981 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55af0a4da320 con 0x55af0a5f51d0 2024-08-20T01:43:21.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.793+0000 7fbce1d9b640 1 --2- 172.21.15.79:0/1477512981 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55af0a5f51d0 0x55af0a5f75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:21.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.794+0000 7fbce1d9b640 1 --2- 172.21.15.79:0/1477512981 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55af0a5f51d0 0x55af0a5f75f0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=348046add1403173 server_cookie=24bb60da00ba35fe in_seq=0 out_seq=0 2024-08-20T01:43:21.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.794+0000 7fbcc9ffb640 10 client.17343 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:43:21.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.794+0000 7fbcc9ffb640 1 -- 172.21.15.79:0/1477512981 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55af0a4da320 con 0x55af0a5f51d0 2024-08-20T01:43:21.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.794+0000 7fbcc9ffb640 10 client.17343 handle_command_reply: tid=0 2024-08-20T01:43:21.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.794+0000 7fbceac66740 1 client.17343 shutdown 2024-08-20T01:43:21.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.794+0000 7fbceac66740 1 -- 172.21.15.79:0/1477512981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af0a565880 msgr2=0x55af0a57e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:21.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.794+0000 7fbceac66740 1 --2- 172.21.15.79:0/1477512981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af0a565880 0x55af0a57e150 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fbcd40aa3a0 tx=0x7fbcd40b3040 comp rx=0 tx=0).stop 2024-08-20T01:43:21.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.794+0000 7fbceac66740 1 -- 172.21.15.79:0/1477512981 shutdown_connections 2024-08-20T01:43:21.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.794+0000 7fbceac66740 1 --2- 172.21.15.79:0/1477512981 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55af0a5f51d0 0x55af0a5f75f0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:21.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.794+0000 7fbceac66740 1 --2- 172.21.15.79:0/1477512981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af0a572130 0x55af0a5ed0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:21.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.794+0000 7fbceac66740 1 --2- 172.21.15.79:0/1477512981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af0a5661a0 0x55af0a57e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:21.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.794+0000 7fbceac66740 1 --2- 172.21.15.79:0/1477512981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af0a565880 0x55af0a57e150 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:21.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.794+0000 7fbceac66740 1 -- 172.21.15.79:0/1477512981 >> 172.21.15.79:0/1477512981 conn(0x55af0a5636b0 msgr2=0x55af0a570f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:21.817 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:43:21.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.794+0000 7fbcc9ffb640 0 client.17343 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:43:21.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.794+0000 7fbceac66740 1 -- 172.21.15.79:0/1477512981 shutdown_connections 2024-08-20T01:43:21.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.794+0000 7fbceac66740 1 -- 172.21.15.79:0/1477512981 wait complete. 2024-08-20T01:43:21.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.794+0000 7fbceac66740 20 client.17343 trim_cache size 0 max 16384 2024-08-20T01:43:21.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.795+0000 7fbce886d640 1 -- 172.21.15.79:0/2292374678 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbccc0b3bd0 msgr2=0x7fbccc0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:21.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.795+0000 7fbce886d640 1 --2- 172.21.15.79:0/2292374678 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbccc0b3bd0 0x7fbccc0b6090 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc009fd0 tx=0x7fbcdc00d040 comp rx=0 tx=0).stop 2024-08-20T01:43:21.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.795+0000 7fbce886d640 1 -- 172.21.15.79:0/2292374678 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbce4102ae0 msgr2=0x7fbce40751d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:21.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.795+0000 7fbce886d640 1 --2- 172.21.15.79:0/2292374678 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbce4102ae0 0x7fbce40751d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbcd400d6d0 tx=0x7fbcd400db90 comp rx=0 tx=0).stop 2024-08-20T01:43:21.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.795+0000 7fbce886d640 1 -- 172.21.15.79:0/2292374678 shutdown_connections 2024-08-20T01:43:21.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.795+0000 7fbce886d640 1 --2- 172.21.15.79:0/2292374678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbce4108e70 0x7fbce4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:21.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.795+0000 7fbce886d640 1 --2- 172.21.15.79:0/2292374678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbce41084f0 0x7fbce4075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:21.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.795+0000 7fbce886d640 1 --2- 172.21.15.79:0/2292374678 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbccc0b3bd0 0x7fbccc0b6090 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:21.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.795+0000 7fbce886d640 1 --2- 172.21.15.79:0/2292374678 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbce4102ae0 0x7fbce40751d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:21.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.795+0000 7fbce886d640 1 -- 172.21.15.79:0/2292374678 >> 172.21.15.79:0/2292374678 conn(0x7fbce40fe510 msgr2=0x7fbce4100900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:21.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.795+0000 7fbce886d640 1 -- 172.21.15.79:0/2292374678 shutdown_connections 2024-08-20T01:43:21.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:21.795+0000 7fbce886d640 1 -- 172.21.15.79:0/2292374678 wait complete. 2024-08-20T01:43:22.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:22 smithi175 ceph-mon[22392]: pgmap v528: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 28 MiB/s wr, 21 op/s 2024-08-20T01:43:22.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:22 smithi079 ceph-mon[18656]: pgmap v528: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 28 MiB/s wr, 21 op/s 2024-08-20T01:43:22.741 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T01:43:22.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:22 smithi081 ceph-mon[22209]: pgmap v528: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 28 MiB/s wr, 21 op/s 2024-08-20T01:43:23.028 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:43:23.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.548+0000 7f0608670640 1 -- 172.21.15.79:0/2480837920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0600107d20 msgr2=0x7f060010e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:23.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.548+0000 7f0608670640 1 --2- 172.21.15.79:0/2480837920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0600107d20 0x7f060010e520 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f05f8009ca0 tx=0x7f05f802a8c0 comp rx=0 tx=0).stop 2024-08-20T01:43:23.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.549+0000 7f0608670640 1 -- 172.21.15.79:0/2480837920 shutdown_connections 2024-08-20T01:43:23.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.549+0000 7f0608670640 1 --2- 172.21.15.79:0/2480837920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0600107d20 0x7f060010e520 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:23.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.549+0000 7f0608670640 1 --2- 172.21.15.79:0/2480837920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06001073a0 0x7f06001077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:23.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.549+0000 7f0608670640 1 --2- 172.21.15.79:0/2480837920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0600101990 0x7f0600101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:23.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.549+0000 7f0608670640 1 -- 172.21.15.79:0/2480837920 >> 172.21.15.79:0/2480837920 conn(0x7f06000fd400 msgr2=0x7f06000ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:23.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.549+0000 7f0608670640 1 -- 172.21.15.79:0/2480837920 shutdown_connections 2024-08-20T01:43:23.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.549+0000 7f0608670640 1 -- 172.21.15.79:0/2480837920 wait complete. 2024-08-20T01:43:23.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.549+0000 7f0608670640 1 Processor -- start 2024-08-20T01:43:23.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.549+0000 7f0608670640 1 -- start start 2024-08-20T01:43:23.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.550+0000 7f0608670640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0600101990 0x7f0600199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:23.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.550+0000 7f0608670640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06001073a0 0x7f060019a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:23.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.550+0000 7f0608670640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0600107d20 0x7f06001a4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:23.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.550+0000 7f0608670640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f06001118a0 con 0x7f06001073a0 2024-08-20T01:43:23.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.550+0000 7f0608670640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0600111720 con 0x7f0600101990 2024-08-20T01:43:23.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.550+0000 7f0608670640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0600111a20 con 0x7f0600107d20 2024-08-20T01:43:23.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.550+0000 7f0605c0b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06001073a0 0x7f060019a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:23.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.550+0000 7f0605c0b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06001073a0 0x7f060019a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34192/0 (socket says 172.21.15.79:34192) 2024-08-20T01:43:23.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.550+0000 7f0605c0b640 1 -- 172.21.15.79:0/3266701100 learned_addr learned my addr 172.21.15.79:0/3266701100 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:23.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.550+0000 7f060640c640 1 --2- 172.21.15.79:0/3266701100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0600101990 0x7f0600199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:23.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.550+0000 7f0606c0d640 1 --2- 172.21.15.79:0/3266701100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0600107d20 0x7f06001a4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:23.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.550+0000 7f0605c0b640 1 -- 172.21.15.79:0/3266701100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0600107d20 msgr2=0x7f06001a4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:23.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.550+0000 7f0605c0b640 1 --2- 172.21.15.79:0/3266701100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0600107d20 0x7f06001a4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:23.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.550+0000 7f0605c0b640 1 -- 172.21.15.79:0/3266701100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0600101990 msgr2=0x7f0600199c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:23.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.550+0000 7f0605c0b640 1 --2- 172.21.15.79:0/3266701100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0600101990 0x7f0600199c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:23.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.550+0000 7f0605c0b640 1 -- 172.21.15.79:0/3266701100 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06001a51f0 con 0x7f06001073a0 2024-08-20T01:43:23.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.550+0000 7f0605c0b640 1 --2- 172.21.15.79:0/3266701100 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06001073a0 0x7f060019a170 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f05f000e9f0 tx=0x7f05f000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:23.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.550+0000 7f05f77fe640 1 -- 172.21.15.79:0/3266701100 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f000cd80 con 0x7f06001073a0 2024-08-20T01:43:23.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.550+0000 7f05f77fe640 1 -- 172.21.15.79:0/3266701100 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f05f00054b0 con 0x7f06001073a0 2024-08-20T01:43:23.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.551+0000 7f0608670640 1 -- 172.21.15.79:0/3266701100 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06001a53c0 con 0x7f06001073a0 2024-08-20T01:43:23.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.551+0000 7f05f77fe640 1 -- 172.21.15.79:0/3266701100 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f0010430 con 0x7f06001073a0 2024-08-20T01:43:23.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.551+0000 7f0608670640 1 -- 172.21.15.79:0/3266701100 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06001a58a0 con 0x7f06001073a0 2024-08-20T01:43:23.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.553+0000 7f05f77fe640 1 -- 172.21.15.79:0/3266701100 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f05f00046c0 con 0x7f06001073a0 2024-08-20T01:43:23.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.553+0000 7f060aa69740 1 Processor -- start 2024-08-20T01:43:23.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.554+0000 7f060aa69740 1 -- start start 2024-08-20T01:43:23.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.554+0000 7f060aa69740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584e13fd880 0x5584e13fdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:23.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.554+0000 7f060aa69740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584e13fe1a0 0x5584e1409bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:23.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.554+0000 7f060aa69740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584e140a130 0x5584e140c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:23.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.554+0000 7f060aa69740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5584e1374930 con 0x5584e140a130 2024-08-20T01:43:23.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.554+0000 7f060aa69740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5584e1363e30 con 0x5584e13fd880 2024-08-20T01:43:23.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.554+0000 7f060aa69740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5584e1367e70 con 0x5584e13fe1a0 2024-08-20T01:43:23.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.554+0000 7f05f77fe640 1 --2- 172.21.15.79:0/3266701100 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f05ec0b3c50 0x7f05ec0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:23.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.554+0000 7f060640c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584e13fe1a0 0x5584e1409bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:23.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.554+0000 7f060640c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584e13fe1a0 0x5584e1409bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:57228/0 (socket says 172.21.15.79:57228) 2024-08-20T01:43:23.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.554+0000 7f060640c640 1 -- 172.21.15.79:0/2211561480 learned_addr learned my addr 172.21.15.79:0/2211561480 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:23.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.554+0000 7f0605c0b640 1 --2- 172.21.15.79:0/2211561480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584e140a130 0x5584e140c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:23.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.554+0000 7f0606c0d640 1 --2- 172.21.15.79:0/2211561480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584e13fd880 0x5584e13fdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:23.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.554+0000 7f0606c0d640 1 --2- 172.21.15.79:0/3266701100 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f05ec0b3c50 0x7f05ec0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:23.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.555+0000 7f060640c640 1 -- 172.21.15.79:0/2211561480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584e13fd880 msgr2=0x5584e13fdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:23.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.555+0000 7f060640c640 1 --2- 172.21.15.79:0/2211561480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584e13fd880 0x5584e13fdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:23.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.555+0000 7f060640c640 1 -- 172.21.15.79:0/2211561480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584e140a130 msgr2=0x5584e140c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:23.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.555+0000 7f060640c640 1 --2- 172.21.15.79:0/2211561480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584e140a130 0x5584e140c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:23.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.555+0000 7f060640c640 1 -- 172.21.15.79:0/2211561480 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584e10c3650 con 0x5584e13fe1a0 2024-08-20T01:43:23.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.555+0000 7f05f77fe640 1 -- 172.21.15.79:0/3266701100 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f05f00e3e80 con 0x7f06001073a0 2024-08-20T01:43:23.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.555+0000 7f0606c0d640 1 --2- 172.21.15.79:0/2211561480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584e13fd880 0x5584e13fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:43:23.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.555+0000 7f060640c640 1 --2- 172.21.15.79:0/2211561480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584e13fe1a0 0x5584e1409bf0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f05fc009d10 tx=0x7f05fc011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a7bf1519452e010 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:23.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.555+0000 7f0606c0d640 1 --2- 172.21.15.79:0/3266701100 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f05ec0b3c50 0x7f05ec0b6110 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f05f8006010 tx=0x7f05f8009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:23.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.555+0000 7f05f4ff9640 1 -- 172.21.15.79:0/2211561480 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05fc004220 con 0x5584e13fe1a0 2024-08-20T01:43:23.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.555+0000 7f05f4ff9640 1 -- 172.21.15.79:0/2211561480 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f05fc0043c0 con 0x5584e13fe1a0 2024-08-20T01:43:23.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.555+0000 7f05f4ff9640 1 -- 172.21.15.79:0/2211561480 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05fc019720 con 0x5584e13fe1a0 2024-08-20T01:43:23.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.556+0000 7f060aa69740 1 -- 172.21.15.79:0/2211561480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584e13fe1a0 msgr2=0x5584e1409bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:23.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.556+0000 7f060aa69740 1 --2- 172.21.15.79:0/2211561480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584e13fe1a0 0x5584e1409bf0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f05fc009d10 tx=0x7f05fc011810 comp rx=0 tx=0).stop 2024-08-20T01:43:23.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.556+0000 7f060aa69740 1 -- 172.21.15.79:0/2211561480 shutdown_connections 2024-08-20T01:43:23.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.556+0000 7f060aa69740 1 --2- 172.21.15.79:0/2211561480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584e140a130 0x5584e140c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:23.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.556+0000 7f060aa69740 1 --2- 172.21.15.79:0/2211561480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584e13fe1a0 0x5584e1409bf0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:23.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.556+0000 7f060aa69740 1 --2- 172.21.15.79:0/2211561480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584e13fd880 0x5584e13fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:23.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.556+0000 7f060aa69740 1 -- 172.21.15.79:0/2211561480 >> 172.21.15.79:0/2211561480 conn(0x5584e13fb6b0 msgr2=0x5584e13fc850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:23.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.556+0000 7f060aa69740 1 -- 172.21.15.79:0/2211561480 shutdown_connections 2024-08-20T01:43:23.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.556+0000 7f060aa69740 1 -- 172.21.15.79:0/2211561480 wait complete. 2024-08-20T01:43:23.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.556+0000 7f060aa69740 1 -- start start 2024-08-20T01:43:23.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.557+0000 7f060aa69740 1 Processor -- start 2024-08-20T01:43:23.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.557+0000 7f060aa69740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584e13fd880 0x5584e1407080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:23.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.557+0000 7f060aa69740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584e13fe1a0 0x5584e14075c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:23.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.557+0000 7f060aa69740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584e140a130 0x5584e1407b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:23.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.557+0000 7f060aa69740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5584e11c6700 con 0x5584e13fe1a0 2024-08-20T01:43:23.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.557+0000 7f060aa69740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5584e12ea810 con 0x5584e140a130 2024-08-20T01:43:23.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.557+0000 7f060aa69740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5584e140cde0 con 0x5584e13fd880 2024-08-20T01:43:23.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.557+0000 7f060aa69740 10 client.0 _ll_register_callbacks cb 0x5584e135d700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:43:23.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.557+0000 7f0605c0b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584e13fe1a0 0x5584e14075c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:23.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.557+0000 7f0605c0b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584e13fe1a0 0x5584e14075c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34214/0 (socket says 172.21.15.79:34214) 2024-08-20T01:43:23.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.557+0000 7f0605c0b640 1 -- 172.21.15.79:0/821860396 learned_addr learned my addr 172.21.15.79:0/821860396 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:23.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.557+0000 7f0606c0d640 1 --2- 172.21.15.79:0/821860396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584e140a130 0x5584e1407b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:23.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.557+0000 7f060640c640 1 --2- 172.21.15.79:0/821860396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584e13fd880 0x5584e1407080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:23.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.557+0000 7f0605c0b640 1 -- 172.21.15.79:0/821860396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584e13fd880 msgr2=0x5584e1407080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:23.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.557+0000 7f0605c0b640 1 --2- 172.21.15.79:0/821860396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584e13fd880 0x5584e1407080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:23.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.557+0000 7f0605c0b640 1 -- 172.21.15.79:0/821860396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584e140a130 msgr2=0x5584e1407b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:23.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.557+0000 7f0605c0b640 1 --2- 172.21.15.79:0/821860396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584e140a130 0x5584e1407b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:23.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.557+0000 7f0605c0b640 1 -- 172.21.15.79:0/821860396 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584e1416140 con 0x5584e13fe1a0 2024-08-20T01:43:23.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.558+0000 7f0605c0b640 1 --2- 172.21.15.79:0/821860396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584e13fe1a0 0x5584e14075c0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f05f00aad70 tx=0x7f05f0074310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d95c11f0f1cef21c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:23.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.558+0000 7f05e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:43:23.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.558+0000 7f05e9ffb640 1 -- 172.21.15.79:0/821860396 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f00ab4e0 con 0x5584e13fe1a0 2024-08-20T01:43:23.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.558+0000 7f05e9ffb640 1 -- 172.21.15.79:0/821860396 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f05f00b3a00 con 0x5584e13fe1a0 2024-08-20T01:43:23.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.558+0000 7f060aa69740 1 -- 172.21.15.79:0/821860396 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5584e1313150 con 0x5584e13fe1a0 2024-08-20T01:43:23.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.558+0000 7f05e9ffb640 1 -- 172.21.15.79:0/821860396 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f05f00af1d0 con 0x5584e13fe1a0 2024-08-20T01:43:23.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.558+0000 7f060aa69740 10 client.17355 fetch_fsmap learned FSMap version 38 2024-08-20T01:43:23.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.558+0000 7f060aa69740 1 -- 172.21.15.79:0/821860396 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5584e1418b50 con 0x5584e13fe1a0 2024-08-20T01:43:23.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.558+0000 7f05e9ffb640 1 -- 172.21.15.79:0/821860396 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5584e1313150 con 0x5584e13fe1a0 2024-08-20T01:43:23.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.558+0000 7f05e9ffb640 1 -- 172.21.15.79:0/821860396 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f05f00aa0d0 con 0x5584e13fe1a0 2024-08-20T01:43:23.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.558+0000 7f060aa69740 10 client.17355 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:43:23.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.558+0000 7f060aa69740 10 client.17355 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:43:23.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.558+0000 7f060aa69740 20 client.17355 populate_metadata read hostname 'smithi079' 2024-08-20T01:43:23.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.558+0000 7f060aa69740 1 --2- 172.21.15.79:0/821860396 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5584e141a300 0x5584e141c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:23.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.558+0000 7f060aa69740 4 client.17355 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:43:23.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.558+0000 7f060aa69740 1 -- 172.21.15.79:0/821860396 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5584e1376880 con 0x5584e141a300 2024-08-20T01:43:23.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.559+0000 7f060640c640 1 --2- 172.21.15.79:0/821860396 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5584e141a300 0x5584e141c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:23.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.559+0000 7f060640c640 1 --2- 172.21.15.79:0/821860396 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5584e141a300 0x5584e141c770 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92284f09e01b585b server_cookie=c5479f8ead5d658a in_seq=0 out_seq=0 2024-08-20T01:43:23.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.559+0000 7f05e9ffb640 10 client.17355 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:43:23.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.560+0000 7f05e9ffb640 1 -- 172.21.15.79:0/821860396 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5584e1376880 con 0x5584e141a300 2024-08-20T01:43:23.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.560+0000 7f05e9ffb640 10 client.17355 handle_command_reply: tid=0 2024-08-20T01:43:23.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.560+0000 7f060aa69740 1 client.17355 shutdown 2024-08-20T01:43:23.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.560+0000 7f060aa69740 1 -- 172.21.15.79:0/821860396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584e13fe1a0 msgr2=0x5584e14075c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:23.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.560+0000 7f060aa69740 1 --2- 172.21.15.79:0/821860396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584e13fe1a0 0x5584e14075c0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f05f00aad70 tx=0x7f05f0074310 comp rx=0 tx=0).stop 2024-08-20T01:43:23.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.560+0000 7f060aa69740 1 -- 172.21.15.79:0/821860396 shutdown_connections 2024-08-20T01:43:23.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.560+0000 7f060aa69740 1 --2- 172.21.15.79:0/821860396 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5584e141a300 0x5584e141c770 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:23.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.560+0000 7f060aa69740 1 --2- 172.21.15.79:0/821860396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584e140a130 0x5584e1407b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:23.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.560+0000 7f060aa69740 1 --2- 172.21.15.79:0/821860396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584e13fe1a0 0x5584e14075c0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:23.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.560+0000 7f060aa69740 1 --2- 172.21.15.79:0/821860396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584e13fd880 0x5584e1407080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:23.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.560+0000 7f060aa69740 1 -- 172.21.15.79:0/821860396 >> 172.21.15.79:0/821860396 conn(0x5584e13fb6b0 msgr2=0x5584e1401250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:23.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.560+0000 7f05e9ffb640 0 client.17355 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:43:23.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.560+0000 7f060aa69740 1 -- 172.21.15.79:0/821860396 shutdown_connections 2024-08-20T01:43:23.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.560+0000 7f060aa69740 1 -- 172.21.15.79:0/821860396 wait complete. 2024-08-20T01:43:23.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.560+0000 7f060aa69740 20 client.17355 trim_cache size 0 max 16384 2024-08-20T01:43:23.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.576+0000 7f060aa69740 1 Processor -- start 2024-08-20T01:43:23.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.576+0000 7f060aa69740 1 -- start start 2024-08-20T01:43:23.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.576+0000 7f060aa69740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584e13fd880 0x5584e1408dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:23.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.576+0000 7f060aa69740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584e13fe1a0 0x5584e1422080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:23.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.576+0000 7f060aa69740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584e140a130 0x5584e14225c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:23.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.576+0000 7f060aa69740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f06001adf50 con 0x5584e13fe1a0 2024-08-20T01:43:23.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.576+0000 7f060aa69740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f06001afa90 con 0x5584e140a130 2024-08-20T01:43:23.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.576+0000 7f060aa69740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f06001ae620 con 0x5584e13fd880 2024-08-20T01:43:23.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.576+0000 7f0605c0b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584e13fe1a0 0x5584e1422080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:23.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.576+0000 7f0605c0b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584e13fe1a0 0x5584e1422080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34230/0 (socket says 172.21.15.79:34230) 2024-08-20T01:43:23.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.576+0000 7f0605c0b640 1 -- 172.21.15.79:0/3260888855 learned_addr learned my addr 172.21.15.79:0/3260888855 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:23.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.576+0000 7f0606c0d640 1 --2- 172.21.15.79:0/3260888855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584e140a130 0x5584e14225c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:23.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.576+0000 7f060640c640 1 --2- 172.21.15.79:0/3260888855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584e13fd880 0x5584e1408dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:23.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.577+0000 7f0605c0b640 1 -- 172.21.15.79:0/3260888855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584e13fd880 msgr2=0x5584e1408dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:23.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.577+0000 7f0605c0b640 1 --2- 172.21.15.79:0/3260888855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584e13fd880 0x5584e1408dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:23.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.577+0000 7f0605c0b640 1 -- 172.21.15.79:0/3260888855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584e140a130 msgr2=0x5584e14225c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:23.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.577+0000 7f0605c0b640 1 --2- 172.21.15.79:0/3260888855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584e140a130 0x5584e14225c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:23.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.577+0000 7f0605c0b640 1 -- 172.21.15.79:0/3260888855 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584e13fc130 con 0x5584e13fe1a0 2024-08-20T01:43:23.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.577+0000 7f0605c0b640 1 --2- 172.21.15.79:0/3260888855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584e13fe1a0 0x5584e1422080 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f05f00aaae0 tx=0x7f05f00a5050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae9843d0e2ba4db2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:23.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.577+0000 7f05ebfff640 1 -- 172.21.15.79:0/3260888855 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f00c9070 con 0x5584e13fe1a0 2024-08-20T01:43:23.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.577+0000 7f05ebfff640 1 -- 172.21.15.79:0/3260888855 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f05f00e1e50 con 0x5584e13fe1a0 2024-08-20T01:43:23.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.577+0000 7f05ebfff640 1 -- 172.21.15.79:0/3260888855 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f00b3e90 con 0x5584e13fe1a0 2024-08-20T01:43:23.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.578+0000 7f060aa69740 1 -- 172.21.15.79:0/3260888855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584e13fe1a0 msgr2=0x5584e1422080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:23.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.578+0000 7f060aa69740 1 --2- 172.21.15.79:0/3260888855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584e13fe1a0 0x5584e1422080 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f05f00aaae0 tx=0x7f05f00a5050 comp rx=0 tx=0).stop 2024-08-20T01:43:23.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.578+0000 7f060aa69740 1 -- 172.21.15.79:0/3260888855 shutdown_connections 2024-08-20T01:43:23.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.578+0000 7f060aa69740 1 --2- 172.21.15.79:0/3260888855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584e140a130 0x5584e14225c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:23.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.578+0000 7f060aa69740 1 --2- 172.21.15.79:0/3260888855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584e13fe1a0 0x5584e1422080 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:23.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.578+0000 7f060aa69740 1 --2- 172.21.15.79:0/3260888855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584e13fd880 0x5584e1408dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:23.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.578+0000 7f060aa69740 1 -- 172.21.15.79:0/3260888855 >> 172.21.15.79:0/3260888855 conn(0x5584e13fb6b0 msgr2=0x5584e14086b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:23.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.578+0000 7f060aa69740 1 -- 172.21.15.79:0/3260888855 shutdown_connections 2024-08-20T01:43:23.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.578+0000 7f060aa69740 1 -- 172.21.15.79:0/3260888855 wait complete. 2024-08-20T01:43:23.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.578+0000 7f060aa69740 1 -- start start 2024-08-20T01:43:23.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.578+0000 7f060aa69740 1 Processor -- start 2024-08-20T01:43:23.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.579+0000 7f060aa69740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584e13fd880 0x5584e140d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:23.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.579+0000 7f060aa69740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584e140a130 0x5584e140d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:23.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.579+0000 7f060aa69740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584e140dae0 0x5584e1483040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:23.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.579+0000 7f060aa69740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f06001af3c0 con 0x5584e140dae0 2024-08-20T01:43:23.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.579+0000 7f060aa69740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f06001aecf0 con 0x5584e13fd880 2024-08-20T01:43:23.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.579+0000 7f060aa69740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f06001abf30 con 0x5584e140a130 2024-08-20T01:43:23.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.579+0000 7f060aa69740 10 client.0 _ll_register_callbacks cb 0x7f05f0004a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:43:23.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.579+0000 7f0606c0d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584e140dae0 0x5584e1483040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:23.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.579+0000 7f0606c0d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584e140dae0 0x5584e1483040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34244/0 (socket says 172.21.15.79:34244) 2024-08-20T01:43:23.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.579+0000 7f0606c0d640 1 -- 172.21.15.79:0/1315998263 learned_addr learned my addr 172.21.15.79:0/1315998263 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:23.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.579+0000 7f0605c0b640 1 --2- 172.21.15.79:0/1315998263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584e140a130 0x5584e140d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:23.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.579+0000 7f060640c640 1 --2- 172.21.15.79:0/1315998263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584e13fd880 0x5584e140d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:23.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.579+0000 7f0606c0d640 1 -- 172.21.15.79:0/1315998263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584e140a130 msgr2=0x5584e140d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:23.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.579+0000 7f0606c0d640 1 --2- 172.21.15.79:0/1315998263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584e140a130 0x5584e140d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:23.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.579+0000 7f0606c0d640 1 -- 172.21.15.79:0/1315998263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584e13fd880 msgr2=0x5584e140d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:23.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.579+0000 7f0606c0d640 1 --2- 172.21.15.79:0/1315998263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584e13fd880 0x5584e140d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:23.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.579+0000 7f0606c0d640 1 -- 172.21.15.79:0/1315998263 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584e14836b0 con 0x5584e140dae0 2024-08-20T01:43:23.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.579+0000 7f0605c0b640 1 --2- 172.21.15.79:0/1315998263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584e140a130 0x5584e140d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:43:23.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.579+0000 7f060640c640 1 --2- 172.21.15.79:0/1315998263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584e13fd880 0x5584e140d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:43:23.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.579+0000 7f0606c0d640 1 --2- 172.21.15.79:0/1315998263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584e140dae0 0x5584e1483040 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f05f8009ca0 tx=0x7f05f80095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9637edcc0b4463 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:23.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.579+0000 7f05e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:43:23.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.580+0000 7f05e9ffb640 1 -- 172.21.15.79:0/1315998263 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f8004040 con 0x5584e140dae0 2024-08-20T01:43:23.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.580+0000 7f05e9ffb640 1 -- 172.21.15.79:0/1315998263 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f05f80041e0 con 0x5584e140dae0 2024-08-20T01:43:23.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.580+0000 7f060aa69740 1 -- 172.21.15.79:0/1315998263 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05f00e1e50 con 0x5584e140dae0 2024-08-20T01:43:23.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.580+0000 7f05e9ffb640 1 -- 172.21.15.79:0/1315998263 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f05f80043e0 con 0x5584e140dae0 2024-08-20T01:43:23.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.580+0000 7f060aa69740 10 client.17361 fetch_fsmap learned FSMap version 38 2024-08-20T01:43:23.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.580+0000 7f060aa69740 1 -- 172.21.15.79:0/1315998263 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5584e14849b0 con 0x5584e140dae0 2024-08-20T01:43:23.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.580+0000 7f05e9ffb640 1 -- 172.21.15.79:0/1315998263 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f05f00e1e50 con 0x5584e140dae0 2024-08-20T01:43:23.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.580+0000 7f05e9ffb640 1 -- 172.21.15.79:0/1315998263 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f05f805f080 con 0x5584e140dae0 2024-08-20T01:43:23.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.580+0000 7f060aa69740 10 client.17361 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:43:23.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.580+0000 7f060aa69740 10 client.17361 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:43:23.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.580+0000 7f060aa69740 20 client.17361 populate_metadata read hostname 'smithi079' 2024-08-20T01:43:23.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.580+0000 7f060aa69740 1 --2- 172.21.15.79:0/1315998263 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5584e14851e0 0x5584e1487600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:23.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.580+0000 7f060aa69740 4 client.17361 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:43:23.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.580+0000 7f060aa69740 1 -- 172.21.15.79:0/1315998263 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5584e1372320 con 0x5584e14851e0 2024-08-20T01:43:23.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.581+0000 7f060640c640 1 --2- 172.21.15.79:0/1315998263 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5584e14851e0 0x5584e1487600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:23.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.581+0000 7f05e9ffb640 10 client.17361 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:43:23.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.581+0000 7f060640c640 1 --2- 172.21.15.79:0/1315998263 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5584e14851e0 0x5584e1487600 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52120586720ac729 server_cookie=d06eac7d62457b11 in_seq=0 out_seq=0 2024-08-20T01:43:23.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.581+0000 7f05e9ffb640 1 -- 172.21.15.79:0/1315998263 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5584e1372320 con 0x5584e14851e0 2024-08-20T01:43:23.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.581+0000 7f05e9ffb640 10 client.17361 handle_command_reply: tid=0 2024-08-20T01:43:23.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.581+0000 7f060aa69740 1 client.17361 shutdown 2024-08-20T01:43:23.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.581+0000 7f060aa69740 1 -- 172.21.15.79:0/1315998263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584e140dae0 msgr2=0x5584e1483040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:23.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.581+0000 7f060aa69740 1 --2- 172.21.15.79:0/1315998263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584e140dae0 0x5584e1483040 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f05f8009ca0 tx=0x7f05f80095c0 comp rx=0 tx=0).stop 2024-08-20T01:43:23.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.581+0000 7f060aa69740 1 -- 172.21.15.79:0/1315998263 shutdown_connections 2024-08-20T01:43:23.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.581+0000 7f060aa69740 1 --2- 172.21.15.79:0/1315998263 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5584e14851e0 0x5584e1487600 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:23.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.581+0000 7f060aa69740 1 --2- 172.21.15.79:0/1315998263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584e140dae0 0x5584e1483040 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:23.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.581+0000 7f060aa69740 1 --2- 172.21.15.79:0/1315998263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584e140a130 0x5584e140d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:23.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.581+0000 7f060aa69740 1 --2- 172.21.15.79:0/1315998263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584e13fd880 0x5584e140d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:23.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.582+0000 7f05e9ffb640 0 client.17361 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:43:23.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.582+0000 7f060aa69740 1 -- 172.21.15.79:0/1315998263 >> 172.21.15.79:0/1315998263 conn(0x5584e13fb6b0 msgr2=0x5584e1408ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:23.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.582+0000 7f060aa69740 1 -- 172.21.15.79:0/1315998263 shutdown_connections 2024-08-20T01:43:23.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.582+0000 7f060aa69740 1 -- 172.21.15.79:0/1315998263 wait complete. 2024-08-20T01:43:23.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.582+0000 7f060aa69740 20 client.17361 trim_cache size 0 max 16384 2024-08-20T01:43:23.594 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:43:23.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.582+0000 7f0608670640 1 -- 172.21.15.79:0/3266701100 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f05ec0b3c50 msgr2=0x7f05ec0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:23.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.582+0000 7f0608670640 1 --2- 172.21.15.79:0/3266701100 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f05ec0b3c50 0x7f05ec0b6110 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f05f8006010 tx=0x7f05f8009360 comp rx=0 tx=0).stop 2024-08-20T01:43:23.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.582+0000 7f0608670640 1 -- 172.21.15.79:0/3266701100 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06001073a0 msgr2=0x7f060019a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:23.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.582+0000 7f0608670640 1 --2- 172.21.15.79:0/3266701100 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06001073a0 0x7f060019a170 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f05f000e9f0 tx=0x7f05f000edf0 comp rx=0 tx=0).stop 2024-08-20T01:43:23.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.582+0000 7f0608670640 1 -- 172.21.15.79:0/3266701100 shutdown_connections 2024-08-20T01:43:23.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.582+0000 7f0608670640 1 --2- 172.21.15.79:0/3266701100 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f05ec0b3c50 0x7f05ec0b6110 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:23.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.582+0000 7f0608670640 1 --2- 172.21.15.79:0/3266701100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0600107d20 0x7f06001a4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:23.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.582+0000 7f0608670640 1 --2- 172.21.15.79:0/3266701100 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06001073a0 0x7f060019a170 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:23.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.582+0000 7f0608670640 1 --2- 172.21.15.79:0/3266701100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0600101990 0x7f0600199c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:23.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.582+0000 7f0608670640 1 -- 172.21.15.79:0/3266701100 >> 172.21.15.79:0/3266701100 conn(0x7f06000fd400 msgr2=0x7f06000ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:23.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.582+0000 7f0608670640 1 -- 172.21.15.79:0/3266701100 shutdown_connections 2024-08-20T01:43:23.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:23.582+0000 7f0608670640 1 -- 172.21.15.79:0/3266701100 wait complete. 2024-08-20T01:43:24.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:24 smithi175 ceph-mon[22392]: pgmap v529: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 29 MiB/s wr, 21 op/s 2024-08-20T01:43:24.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:24 smithi079 ceph-mon[18656]: pgmap v529: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 29 MiB/s wr, 21 op/s 2024-08-20T01:43:24.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:24 smithi081 ceph-mon[22209]: pgmap v529: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 29 MiB/s wr, 21 op/s 2024-08-20T01:43:25.494 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T01:43:25.495 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T01:43:25.773 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:43:26.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.273+0000 7f1b805f0640 1 -- 172.21.15.79:0/3354084571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b78102aa0 msgr2=0x7f1b78102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:26.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.273+0000 7f1b805f0640 1 --2- 172.21.15.79:0/3354084571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b78102aa0 0x7f1b78102e80 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f1b74009900 tx=0x7f1b7402a410 comp rx=0 tx=0).stop 2024-08-20T01:43:26.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.273+0000 7f1b805f0640 1 -- 172.21.15.79:0/3354084571 shutdown_connections 2024-08-20T01:43:26.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.273+0000 7f1b805f0640 1 --2- 172.21.15.79:0/3354084571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b78108e30 0x7f1b7810f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:26.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.273+0000 7f1b805f0640 1 --2- 172.21.15.79:0/3354084571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b781084b0 0x7f1b781088f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:26.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.273+0000 7f1b805f0640 1 --2- 172.21.15.79:0/3354084571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b78102aa0 0x7f1b78102e80 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:26.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.273+0000 7f1b805f0640 1 -- 172.21.15.79:0/3354084571 >> 172.21.15.79:0/3354084571 conn(0x7f1b780fe550 msgr2=0x7f1b78100970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:26.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.273+0000 7f1b805f0640 1 -- 172.21.15.79:0/3354084571 shutdown_connections 2024-08-20T01:43:26.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.273+0000 7f1b805f0640 1 -- 172.21.15.79:0/3354084571 wait complete. 2024-08-20T01:43:26.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.274+0000 7f1b805f0640 1 Processor -- start 2024-08-20T01:43:26.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.274+0000 7f1b805f0640 1 -- start start 2024-08-20T01:43:26.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.274+0000 7f1b805f0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b78102aa0 0x7f1b780751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:26.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.274+0000 7f1b805f0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b781084b0 0x7f1b78075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:26.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.274+0000 7f1b805f0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b78108e30 0x7f1b78075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:26.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.274+0000 7f1b7e38c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b78102aa0 0x7f1b780751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:26.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.274+0000 7f1b7e38c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b78102aa0 0x7f1b780751d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34272/0 (socket says 172.21.15.79:34272) 2024-08-20T01:43:26.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.274+0000 7f1b7db8b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b781084b0 0x7f1b78075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:26.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.275+0000 7f1b7db8b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b781084b0 0x7f1b78075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:57276/0 (socket says 172.21.15.79:57276) 2024-08-20T01:43:26.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.275+0000 7f1b805f0640 1 -- 172.21.15.79:0/138109030 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1b781129a0 con 0x7f1b78102aa0 2024-08-20T01:43:26.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.275+0000 7f1b7db8b640 1 -- 172.21.15.79:0/138109030 learned_addr learned my addr 172.21.15.79:0/138109030 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:26.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.275+0000 7f1b805f0640 1 -- 172.21.15.79:0/138109030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1b78112820 con 0x7f1b78108e30 2024-08-20T01:43:26.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.275+0000 7f1b805f0640 1 -- 172.21.15.79:0/138109030 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1b78112b20 con 0x7f1b781084b0 2024-08-20T01:43:26.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.275+0000 7f1b7eb8d640 1 --2- 172.21.15.79:0/138109030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b78108e30 0x7f1b78075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:26.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.275+0000 7f1b7e38c640 1 -- 172.21.15.79:0/138109030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b781084b0 msgr2=0x7f1b78075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:26.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.275+0000 7f1b7e38c640 1 --2- 172.21.15.79:0/138109030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b781084b0 0x7f1b78075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:26.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.275+0000 7f1b7e38c640 1 -- 172.21.15.79:0/138109030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b78108e30 msgr2=0x7f1b78075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:26.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.275+0000 7f1b7e38c640 1 --2- 172.21.15.79:0/138109030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b78108e30 0x7f1b78075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:26.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.275+0000 7f1b7e38c640 1 -- 172.21.15.79:0/138109030 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b781a72f0 con 0x7f1b78102aa0 2024-08-20T01:43:26.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.275+0000 7f1b7eb8d640 1 --2- 172.21.15.79:0/138109030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b78108e30 0x7f1b78075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:43:26.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.275+0000 7f1b7e38c640 1 --2- 172.21.15.79:0/138109030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b78102aa0 0x7f1b780751d0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f1b74005940 tx=0x7f1b74004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:26.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.276+0000 7f1b6f7fe640 1 -- 172.21.15.79:0/138109030 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7403f070 con 0x7f1b78102aa0 2024-08-20T01:43:26.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.276+0000 7f1b805f0640 1 -- 172.21.15.79:0/138109030 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b781a7580 con 0x7f1b78102aa0 2024-08-20T01:43:26.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.276+0000 7f1b6f7fe640 1 -- 172.21.15.79:0/138109030 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b74003a80 con 0x7f1b78102aa0 2024-08-20T01:43:26.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.276+0000 7f1b6f7fe640 1 -- 172.21.15.79:0/138109030 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b74035070 con 0x7f1b78102aa0 2024-08-20T01:43:26.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.276+0000 7f1b805f0640 1 -- 172.21.15.79:0/138109030 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b781a7a30 con 0x7f1b78102aa0 2024-08-20T01:43:26.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.278+0000 7f1b829e9740 1 Processor -- start 2024-08-20T01:43:26.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.278+0000 7f1b6f7fe640 1 -- 172.21.15.79:0/138109030 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1b740035f0 con 0x7f1b78102aa0 2024-08-20T01:43:26.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.279+0000 7f1b829e9740 1 -- start start 2024-08-20T01:43:26.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.279+0000 7f1b829e9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e7da7c3b0 0x562e7da7c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:26.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.279+0000 7f1b829e9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e7da7ccd0 0x562e7da88720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:26.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.279+0000 7f1b829e9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e7da88c60 0x562e7da8b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:26.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.279+0000 7f1b829e9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562e7d9f2940 con 0x562e7da7c3b0 2024-08-20T01:43:26.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.279+0000 7f1b829e9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562e7d9e1e40 con 0x562e7da88c60 2024-08-20T01:43:26.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.279+0000 7f1b829e9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562e7d9e5e80 con 0x562e7da7ccd0 2024-08-20T01:43:26.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.279+0000 7f1b7eb8d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e7da7c3b0 0x562e7da7c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:26.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.279+0000 7f1b7eb8d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e7da7c3b0 0x562e7da7c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34280/0 (socket says 172.21.15.79:34280) 2024-08-20T01:43:26.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.279+0000 7f1b7eb8d640 1 -- 172.21.15.79:0/611300784 learned_addr learned my addr 172.21.15.79:0/611300784 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:26.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.279+0000 7f1b7e38c640 1 --2- 172.21.15.79:0/611300784 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e7da7ccd0 0x562e7da88720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:26.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.279+0000 7f1b7db8b640 1 --2- 172.21.15.79:0/611300784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e7da88c60 0x562e7da8b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:26.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.279+0000 7f1b7eb8d640 1 -- 172.21.15.79:0/611300784 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e7da7ccd0 msgr2=0x562e7da88720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:26.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.279+0000 7f1b7eb8d640 1 --2- 172.21.15.79:0/611300784 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e7da7ccd0 0x562e7da88720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:26.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.279+0000 7f1b7eb8d640 1 -- 172.21.15.79:0/611300784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e7da88c60 msgr2=0x562e7da8b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:26.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.279+0000 7f1b7eb8d640 1 --2- 172.21.15.79:0/611300784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e7da88c60 0x562e7da8b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:26.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.280+0000 7f1b7eb8d640 1 -- 172.21.15.79:0/611300784 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e7d97e520 con 0x562e7da7c3b0 2024-08-20T01:43:26.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.280+0000 7f1b7db8b640 1 --2- 172.21.15.79:0/611300784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e7da88c60 0x562e7da8b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:43:26.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.280+0000 7f1b7eb8d640 1 --2- 172.21.15.79:0/611300784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e7da7c3b0 0x562e7da7c790 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f1b70009f30 tx=0x7f1b7000e780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3f67bfec6b66c90 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:26.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.280+0000 7f1b6f7fe640 1 --2- 172.21.15.79:0/138109030 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1b640b3bd0 0x7f1b640b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:26.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.280+0000 7f1b7e38c640 1 --2- 172.21.15.79:0/138109030 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1b640b3bd0 0x7f1b640b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:26.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.280+0000 7f1b6cff9640 1 -- 172.21.15.79:0/611300784 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b70003b70 con 0x562e7da7c3b0 2024-08-20T01:43:26.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.280+0000 7f1b6cff9640 1 -- 172.21.15.79:0/611300784 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b70003d10 con 0x562e7da7c3b0 2024-08-20T01:43:26.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.280+0000 7f1b6cff9640 1 -- 172.21.15.79:0/611300784 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b70011860 con 0x562e7da7c3b0 2024-08-20T01:43:26.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.280+0000 7f1b6f7fe640 1 -- 172.21.15.79:0/138109030 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f1b74103e70 con 0x7f1b78102aa0 2024-08-20T01:43:26.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.281+0000 7f1b829e9740 1 -- 172.21.15.79:0/611300784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e7da7c3b0 msgr2=0x562e7da7c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:26.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.281+0000 7f1b7e38c640 1 --2- 172.21.15.79:0/138109030 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1b640b3bd0 0x7f1b640b6090 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1b74101cf0 tx=0x7f1b74109040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:26.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.281+0000 7f1b829e9740 1 --2- 172.21.15.79:0/611300784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e7da7c3b0 0x562e7da7c790 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f1b70009f30 tx=0x7f1b7000e780 comp rx=0 tx=0).stop 2024-08-20T01:43:26.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.281+0000 7f1b829e9740 1 -- 172.21.15.79:0/611300784 shutdown_connections 2024-08-20T01:43:26.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.281+0000 7f1b829e9740 1 --2- 172.21.15.79:0/611300784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e7da88c60 0x562e7da8b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:26.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.281+0000 7f1b829e9740 1 --2- 172.21.15.79:0/611300784 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e7da7ccd0 0x562e7da88720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:26.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.281+0000 7f1b829e9740 1 --2- 172.21.15.79:0/611300784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e7da7c3b0 0x562e7da7c790 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:26.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.281+0000 7f1b829e9740 1 -- 172.21.15.79:0/611300784 >> 172.21.15.79:0/611300784 conn(0x562e7da7a1e0 msgr2=0x562e7da7b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:26.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.281+0000 7f1b829e9740 1 -- 172.21.15.79:0/611300784 shutdown_connections 2024-08-20T01:43:26.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.281+0000 7f1b829e9740 1 -- 172.21.15.79:0/611300784 wait complete. 2024-08-20T01:43:26.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.282+0000 7f1b829e9740 1 -- start start 2024-08-20T01:43:26.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.282+0000 7f1b829e9740 1 Processor -- start 2024-08-20T01:43:26.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.282+0000 7f1b829e9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e7da7c3b0 0x562e7da85ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:26.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.282+0000 7f1b829e9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e7da7ccd0 0x562e7da86220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:26.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.282+0000 7f1b829e9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e7da88c60 0x562e7da86760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:26.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.282+0000 7f1b829e9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562e7d844890 con 0x562e7da7ccd0 2024-08-20T01:43:26.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.282+0000 7f1b829e9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562e7d968700 con 0x562e7da7c3b0 2024-08-20T01:43:26.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.282+0000 7f1b829e9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562e7da8b9b0 con 0x562e7da88c60 2024-08-20T01:43:26.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.282+0000 7f1b829e9740 10 client.0 _ll_register_callbacks cb 0x562e7d9dd6f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:43:26.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.282+0000 7f1b7db8b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e7da7ccd0 0x562e7da86220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:26.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.282+0000 7f1b7db8b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e7da7ccd0 0x562e7da86220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34290/0 (socket says 172.21.15.79:34290) 2024-08-20T01:43:26.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.282+0000 7f1b7db8b640 1 -- 172.21.15.79:0/2735726462 learned_addr learned my addr 172.21.15.79:0/2735726462 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:26.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.282+0000 7f1b7eb8d640 1 --2- 172.21.15.79:0/2735726462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e7da88c60 0x562e7da86760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:26.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.282+0000 7f1b7eb8d640 1 --2- 172.21.15.79:0/2735726462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e7da7c3b0 0x562e7da85ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:26.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.283+0000 7f1b7db8b640 1 -- 172.21.15.79:0/2735726462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e7da88c60 msgr2=0x562e7da86760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:26.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.283+0000 7f1b7db8b640 1 --2- 172.21.15.79:0/2735726462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e7da88c60 0x562e7da86760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:26.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.283+0000 7f1b7db8b640 1 -- 172.21.15.79:0/2735726462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e7da7c3b0 msgr2=0x562e7da85ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:26.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.283+0000 7f1b7db8b640 1 --2- 172.21.15.79:0/2735726462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e7da7c3b0 0x562e7da85ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:26.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.283+0000 7f1b7db8b640 1 -- 172.21.15.79:0/2735726462 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e7d741930 con 0x562e7da7ccd0 2024-08-20T01:43:26.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.283+0000 7f1b7eb8d640 1 --2- 172.21.15.79:0/2735726462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e7da88c60 0x562e7da86760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:43:26.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.283+0000 7f1b7db8b640 1 --2- 172.21.15.79:0/2735726462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e7da7ccd0 0x562e7da86220 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f1b68012700 tx=0x7f1b68012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d7a7d5b138f2360 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:26.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.283+0000 7f1b61ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:43:26.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.283+0000 7f1b61ffb640 1 -- 172.21.15.79:0/2735726462 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b68010dc0 con 0x562e7da7ccd0 2024-08-20T01:43:26.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.283+0000 7f1b61ffb640 1 -- 172.21.15.79:0/2735726462 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f1b68005020 con 0x562e7da7ccd0 2024-08-20T01:43:26.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.283+0000 7f1b829e9740 1 -- 172.21.15.79:0/2735726462 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b70003d10 con 0x562e7da7ccd0 2024-08-20T01:43:26.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.283+0000 7f1b61ffb640 1 -- 172.21.15.79:0/2735726462 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f1b68005220 con 0x562e7da7ccd0 2024-08-20T01:43:26.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.283+0000 7f1b829e9740 10 client.17373 fetch_fsmap learned FSMap version 38 2024-08-20T01:43:26.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.283+0000 7f1b829e9740 1 -- 172.21.15.79:0/2735726462 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x562e7da97620 con 0x562e7da7ccd0 2024-08-20T01:43:26.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.283+0000 7f1b61ffb640 1 -- 172.21.15.79:0/2735726462 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b70003d10 con 0x562e7da7ccd0 2024-08-20T01:43:26.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.284+0000 7f1b61ffb640 1 -- 172.21.15.79:0/2735726462 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f1b6801a430 con 0x562e7da7ccd0 2024-08-20T01:43:26.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.284+0000 7f1b829e9740 10 client.17373 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:43:26.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.284+0000 7f1b829e9740 10 client.17373 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:43:26.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.284+0000 7f1b829e9740 20 client.17373 populate_metadata read hostname 'smithi079' 2024-08-20T01:43:26.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.284+0000 7f1b829e9740 1 --2- 172.21.15.79:0/2735726462 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x562e7da98ae0 0x562e7da9af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:26.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.284+0000 7f1b829e9740 4 client.17373 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:43:26.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.284+0000 7f1b829e9740 1 -- 172.21.15.79:0/2735726462 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e7d9f4890 con 0x562e7da98ae0 2024-08-20T01:43:26.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.284+0000 7f1b7eb8d640 1 --2- 172.21.15.79:0/2735726462 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x562e7da98ae0 0x562e7da9af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:26.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.285+0000 7f1b61ffb640 10 client.17373 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:43:26.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.285+0000 7f1b7eb8d640 1 --2- 172.21.15.79:0/2735726462 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x562e7da98ae0 0x562e7da9af60 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41d408fd87e59be6 server_cookie=287f81b0f439bd01 in_seq=0 out_seq=0 2024-08-20T01:43:26.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.285+0000 7f1b61ffb640 1 -- 172.21.15.79:0/2735726462 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562e7d9f4890 con 0x562e7da98ae0 2024-08-20T01:43:26.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.285+0000 7f1b61ffb640 10 client.17373 handle_command_reply: tid=0 2024-08-20T01:43:26.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.285+0000 7f1b829e9740 1 client.17373 shutdown 2024-08-20T01:43:26.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.285+0000 7f1b829e9740 1 -- 172.21.15.79:0/2735726462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e7da7ccd0 msgr2=0x562e7da86220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:26.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.285+0000 7f1b829e9740 1 --2- 172.21.15.79:0/2735726462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e7da7ccd0 0x562e7da86220 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f1b68012700 tx=0x7f1b68012bc0 comp rx=0 tx=0).stop 2024-08-20T01:43:26.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.285+0000 7f1b829e9740 1 -- 172.21.15.79:0/2735726462 shutdown_connections 2024-08-20T01:43:26.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.285+0000 7f1b829e9740 1 --2- 172.21.15.79:0/2735726462 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x562e7da98ae0 0x562e7da9af60 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:26.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.285+0000 7f1b829e9740 1 --2- 172.21.15.79:0/2735726462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e7da88c60 0x562e7da86760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:26.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.285+0000 7f1b829e9740 1 --2- 172.21.15.79:0/2735726462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e7da7ccd0 0x562e7da86220 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:26.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.285+0000 7f1b829e9740 1 --2- 172.21.15.79:0/2735726462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e7da7c3b0 0x562e7da85ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:26.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.285+0000 7f1b829e9740 1 -- 172.21.15.79:0/2735726462 >> 172.21.15.79:0/2735726462 conn(0x562e7da7a1e0 msgr2=0x562e7da7fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:26.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.285+0000 7f1b61ffb640 0 client.17373 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:43:26.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.286+0000 7f1b829e9740 1 -- 172.21.15.79:0/2735726462 shutdown_connections 2024-08-20T01:43:26.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.286+0000 7f1b829e9740 1 -- 172.21.15.79:0/2735726462 wait complete. 2024-08-20T01:43:26.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.286+0000 7f1b829e9740 20 client.17373 trim_cache size 0 max 16384 2024-08-20T01:43:26.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.305+0000 7f1b829e9740 1 Processor -- start 2024-08-20T01:43:26.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.305+0000 7f1b829e9740 1 -- start start 2024-08-20T01:43:26.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.305+0000 7f1b829e9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e7da7c3b0 0x562e7da86360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:26.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.305+0000 7f1b829e9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e7da7ccd0 0x562e7daa0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:26.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.305+0000 7f1b829e9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e7da88c60 0x562e7daa0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:26.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.305+0000 7f1b829e9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1b781b0140 con 0x562e7da88c60 2024-08-20T01:43:26.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.305+0000 7f1b829e9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1b781b1c80 con 0x562e7da7ccd0 2024-08-20T01:43:26.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.305+0000 7f1b829e9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1b781b0810 con 0x562e7da7c3b0 2024-08-20T01:43:26.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.306+0000 7f1b7eb8d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e7da88c60 0x562e7daa0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:26.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.306+0000 7f1b7eb8d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e7da88c60 0x562e7daa0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34296/0 (socket says 172.21.15.79:34296) 2024-08-20T01:43:26.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.306+0000 7f1b7eb8d640 1 -- 172.21.15.79:0/431504849 learned_addr learned my addr 172.21.15.79:0/431504849 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:26.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.306+0000 7f1b7db8b640 1 --2- 172.21.15.79:0/431504849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e7da7ccd0 0x562e7daa0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:26.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.306+0000 7f1b7eb8d640 1 --2- 172.21.15.79:0/431504849 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e7da7c3b0 0x562e7da86360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:26.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.306+0000 7f1b7eb8d640 1 -- 172.21.15.79:0/431504849 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e7da7c3b0 msgr2=0x562e7da86360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:26.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.306+0000 7f1b7eb8d640 1 --2- 172.21.15.79:0/431504849 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e7da7c3b0 0x562e7da86360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:26.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.306+0000 7f1b7eb8d640 1 -- 172.21.15.79:0/431504849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e7da7ccd0 msgr2=0x562e7daa0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:26.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.306+0000 7f1b7eb8d640 1 --2- 172.21.15.79:0/431504849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e7da7ccd0 0x562e7daa0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:26.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.306+0000 7f1b7eb8d640 1 -- 172.21.15.79:0/431504849 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e7da7ac60 con 0x562e7da88c60 2024-08-20T01:43:26.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.306+0000 7f1b7eb8d640 1 --2- 172.21.15.79:0/431504849 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e7da88c60 0x562e7daa0d70 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f1b700114b0 tx=0x7f1b7000e780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52efa9861d07ee67 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:26.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.306+0000 7f1b63fff640 1 -- 172.21.15.79:0/431504849 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b70023040 con 0x562e7da88c60 2024-08-20T01:43:26.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.306+0000 7f1b63fff640 1 -- 172.21.15.79:0/431504849 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b7002f030 con 0x562e7da88c60 2024-08-20T01:43:26.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.306+0000 7f1b63fff640 1 -- 172.21.15.79:0/431504849 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b70005040 con 0x562e7da88c60 2024-08-20T01:43:26.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.307+0000 7f1b829e9740 1 -- 172.21.15.79:0/431504849 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e7da88c60 msgr2=0x562e7daa0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:26.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.307+0000 7f1b829e9740 1 --2- 172.21.15.79:0/431504849 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e7da88c60 0x562e7daa0d70 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f1b700114b0 tx=0x7f1b7000e780 comp rx=0 tx=0).stop 2024-08-20T01:43:26.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.307+0000 7f1b829e9740 1 -- 172.21.15.79:0/431504849 shutdown_connections 2024-08-20T01:43:26.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.307+0000 7f1b829e9740 1 --2- 172.21.15.79:0/431504849 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e7da88c60 0x562e7daa0d70 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:26.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.307+0000 7f1b829e9740 1 --2- 172.21.15.79:0/431504849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e7da7ccd0 0x562e7daa0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:26.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.307+0000 7f1b829e9740 1 --2- 172.21.15.79:0/431504849 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e7da7c3b0 0x562e7da86360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:26.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.307+0000 7f1b829e9740 1 -- 172.21.15.79:0/431504849 >> 172.21.15.79:0/431504849 conn(0x562e7da7a1e0 msgr2=0x562e7da85c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:26.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.307+0000 7f1b829e9740 1 -- 172.21.15.79:0/431504849 shutdown_connections 2024-08-20T01:43:26.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.307+0000 7f1b829e9740 1 -- 172.21.15.79:0/431504849 wait complete. 2024-08-20T01:43:26.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.308+0000 7f1b829e9740 1 -- start start 2024-08-20T01:43:26.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.308+0000 7f1b829e9740 1 Processor -- start 2024-08-20T01:43:26.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.308+0000 7f1b829e9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e7da7c3b0 0x562e7da8d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:26.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.308+0000 7f1b829e9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e7da7ccd0 0x562e7da8d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:26.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.308+0000 7f1b829e9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e7da88c60 0x562e7dafc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:26.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.308+0000 7f1b829e9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1b781b15b0 con 0x562e7da7c3b0 2024-08-20T01:43:26.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.308+0000 7f1b829e9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1b781b0ee0 con 0x562e7da7ccd0 2024-08-20T01:43:26.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.308+0000 7f1b829e9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1b781ae120 con 0x562e7da88c60 2024-08-20T01:43:26.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.308+0000 7f1b829e9740 10 client.0 _ll_register_callbacks cb 0x7f1b68009690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:43:26.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.308+0000 7f1b7eb8d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e7da7c3b0 0x562e7da8d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:26.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.308+0000 7f1b7eb8d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e7da7c3b0 0x562e7da8d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34306/0 (socket says 172.21.15.79:34306) 2024-08-20T01:43:26.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.308+0000 7f1b7eb8d640 1 -- 172.21.15.79:0/2031849214 learned_addr learned my addr 172.21.15.79:0/2031849214 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:26.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.308+0000 7f1b7db8b640 1 --2- 172.21.15.79:0/2031849214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e7da7ccd0 0x562e7da8d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:26.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.309+0000 7f1b7eb8d640 1 -- 172.21.15.79:0/2031849214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e7da88c60 msgr2=0x562e7dafc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:26.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.309+0000 7f1b7eb8d640 1 --2- 172.21.15.79:0/2031849214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e7da88c60 0x562e7dafc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:26.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.309+0000 7f1b7eb8d640 1 -- 172.21.15.79:0/2031849214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e7da7ccd0 msgr2=0x562e7da8d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:26.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.309+0000 7f1b7eb8d640 1 --2- 172.21.15.79:0/2031849214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e7da7ccd0 0x562e7da8d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:26.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.309+0000 7f1b7eb8d640 1 -- 172.21.15.79:0/2031849214 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e7dafcec0 con 0x562e7da7c3b0 2024-08-20T01:43:26.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.309+0000 7f1b7db8b640 1 --2- 172.21.15.79:0/2031849214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e7da7ccd0 0x562e7da8d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:43:26.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.309+0000 7f1b7eb8d640 1 --2- 172.21.15.79:0/2031849214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e7da7c3b0 0x562e7da8d400 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f1b70009820 tx=0x7f1b70003e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccf3204d27d21ff9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:26.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.309+0000 7f1b61ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:43:26.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.309+0000 7f1b61ffb640 1 -- 172.21.15.79:0/2031849214 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b70004250 con 0x562e7da7c3b0 2024-08-20T01:43:26.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.309+0000 7f1b61ffb640 1 -- 172.21.15.79:0/2031849214 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f1b70004600 con 0x562e7da7c3b0 2024-08-20T01:43:26.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.309+0000 7f1b829e9740 1 -- 172.21.15.79:0/2031849214 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b7002f030 con 0x562e7da7c3b0 2024-08-20T01:43:26.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.309+0000 7f1b61ffb640 1 -- 172.21.15.79:0/2031849214 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f1b70004800 con 0x562e7da7c3b0 2024-08-20T01:43:26.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.309+0000 7f1b829e9740 10 client.17379 fetch_fsmap learned FSMap version 38 2024-08-20T01:43:26.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.309+0000 7f1b829e9740 1 -- 172.21.15.79:0/2031849214 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x562e7db042a0 con 0x562e7da7c3b0 2024-08-20T01:43:26.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.310+0000 7f1b61ffb640 1 -- 172.21.15.79:0/2031849214 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b7002f030 con 0x562e7da7c3b0 2024-08-20T01:43:26.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.310+0000 7f1b61ffb640 1 -- 172.21.15.79:0/2031849214 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f1b7002a040 con 0x562e7da7c3b0 2024-08-20T01:43:26.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.310+0000 7f1b829e9740 10 client.17379 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:43:26.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.310+0000 7f1b829e9740 10 client.17379 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:43:26.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.310+0000 7f1b829e9740 20 client.17379 populate_metadata read hostname 'smithi079' 2024-08-20T01:43:26.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.310+0000 7f1b829e9740 1 --2- 172.21.15.79:0/2031849214 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x562e7db047f0 0x562e7db06c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:26.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.310+0000 7f1b829e9740 4 client.17379 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T01:43:26.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.310+0000 7f1b829e9740 1 -- 172.21.15.79:0/2031849214 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562e7d9f0330 con 0x562e7db047f0 2024-08-20T01:43:26.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.310+0000 7f1b7db8b640 1 --2- 172.21.15.79:0/2031849214 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x562e7db047f0 0x562e7db06c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:26.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.311+0000 7f1b7db8b640 1 --2- 172.21.15.79:0/2031849214 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x562e7db047f0 0x562e7db06c10 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35fb61b5bdab1b48 server_cookie=54104620a09843b8 in_seq=0 out_seq=0 2024-08-20T01:43:26.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.311+0000 7f1b61ffb640 10 client.17379 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:43:26.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.311+0000 7f1b61ffb640 1 -- 172.21.15.79:0/2031849214 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562e7d9f0330 con 0x562e7db047f0 2024-08-20T01:43:26.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.312+0000 7f1b61ffb640 10 client.17379 handle_command_reply: tid=0 2024-08-20T01:43:26.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.312+0000 7f1b829e9740 1 client.17379 shutdown 2024-08-20T01:43:26.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.312+0000 7f1b829e9740 1 -- 172.21.15.79:0/2031849214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e7da7c3b0 msgr2=0x562e7da8d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:26.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.312+0000 7f1b829e9740 1 --2- 172.21.15.79:0/2031849214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e7da7c3b0 0x562e7da8d400 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f1b70009820 tx=0x7f1b70003e60 comp rx=0 tx=0).stop 2024-08-20T01:43:26.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.312+0000 7f1b829e9740 1 -- 172.21.15.79:0/2031849214 shutdown_connections 2024-08-20T01:43:26.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.312+0000 7f1b829e9740 1 --2- 172.21.15.79:0/2031849214 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x562e7db047f0 0x562e7db06c10 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:26.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.312+0000 7f1b829e9740 1 --2- 172.21.15.79:0/2031849214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562e7da88c60 0x562e7dafc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:26.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.312+0000 7f1b829e9740 1 --2- 172.21.15.79:0/2031849214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e7da7ccd0 0x562e7da8d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:26.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.312+0000 7f1b829e9740 1 --2- 172.21.15.79:0/2031849214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562e7da7c3b0 0x562e7da8d400 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:26.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.312+0000 7f1b829e9740 1 -- 172.21.15.79:0/2031849214 >> 172.21.15.79:0/2031849214 conn(0x562e7da7a1e0 msgr2=0x562e7da79300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:26.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.312+0000 7f1b61ffb640 0 client.17379 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:43:26.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.312+0000 7f1b829e9740 1 -- 172.21.15.79:0/2031849214 shutdown_connections 2024-08-20T01:43:26.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.312+0000 7f1b829e9740 1 -- 172.21.15.79:0/2031849214 wait complete. 2024-08-20T01:43:26.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.312+0000 7f1b829e9740 20 client.17379 trim_cache size 0 max 16384 2024-08-20T01:43:26.321 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:43:26.322 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-08-20T01:43:26.322 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "5bd2fc93-e7b2-41b2-a02b-ee1d5245ab3c", 2024-08-20T01:43:26.322 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-08-20T01:43:26.322 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:43:26.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.313+0000 7f1b805f0640 1 -- 172.21.15.79:0/138109030 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1b640b3bd0 msgr2=0x7f1b640b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:26.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.313+0000 7f1b805f0640 1 --2- 172.21.15.79:0/138109030 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1b640b3bd0 0x7f1b640b6090 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1b74101cf0 tx=0x7f1b74109040 comp rx=0 tx=0).stop 2024-08-20T01:43:26.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.313+0000 7f1b805f0640 1 -- 172.21.15.79:0/138109030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b78102aa0 msgr2=0x7f1b780751d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:26.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.313+0000 7f1b805f0640 1 --2- 172.21.15.79:0/138109030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b78102aa0 0x7f1b780751d0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f1b74005940 tx=0x7f1b74004040 comp rx=0 tx=0).stop 2024-08-20T01:43:26.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.313+0000 7f1b805f0640 1 -- 172.21.15.79:0/138109030 shutdown_connections 2024-08-20T01:43:26.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.313+0000 7f1b805f0640 1 --2- 172.21.15.79:0/138109030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b78108e30 0x7f1b78075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:26.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.313+0000 7f1b805f0640 1 --2- 172.21.15.79:0/138109030 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1b640b3bd0 0x7f1b640b6090 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:26.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.313+0000 7f1b805f0640 1 --2- 172.21.15.79:0/138109030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b781084b0 0x7f1b78075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:26.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.313+0000 7f1b805f0640 1 --2- 172.21.15.79:0/138109030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b78102aa0 0x7f1b780751d0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:26.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.313+0000 7f1b805f0640 1 -- 172.21.15.79:0/138109030 >> 172.21.15.79:0/138109030 conn(0x7f1b780fe550 msgr2=0x7f1b78100940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:26.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.313+0000 7f1b805f0640 1 -- 172.21.15.79:0/138109030 shutdown_connections 2024-08-20T01:43:26.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:26.313+0000 7f1b805f0640 1 -- 172.21.15.79:0/138109030 wait complete. 2024-08-20T01:43:26.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:26 smithi079 ceph-mon[18656]: pgmap v530: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 32 MiB/s wr, 25 op/s 2024-08-20T01:43:26.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:26 smithi081 ceph-mon[22209]: pgmap v530: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 32 MiB/s wr, 25 op/s 2024-08-20T01:43:26.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:26 smithi175 ceph-mon[22392]: pgmap v530: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 32 MiB/s wr, 25 op/s 2024-08-20T01:43:27.261 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:43:27.533 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:43:27.655 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:27 smithi079 ceph-mon[18656]: scrub queued for path: / 2024-08-20T01:43:27.655 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:27 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:43:27.655 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:27 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:43:27.655 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:27 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:43:27.655 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:27 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:43:27.655 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:27 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:43:27.655 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:27 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:43:27.656 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:27 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:43:27.656 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:27 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:43:27.656 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:27 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:43:27.656 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:27 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:43:27.656 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:27 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:43:27.656 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:27 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:43:27.656 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:27 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:43:27.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:27 smithi081 ceph-mon[22209]: scrub queued for path: / 2024-08-20T01:43:27.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:27 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:43:27.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:27 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:43:27.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:27 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:43:27.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:27 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:43:27.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:27 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:43:27.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:27 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:43:27.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:27 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:43:27.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:27 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:43:27.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:27 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:43:27.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:27 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:43:27.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:27 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:43:27.780 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:27 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:43:27.780 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:27 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:43:27.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:27 smithi175 ceph-mon[22392]: scrub queued for path: / 2024-08-20T01:43:27.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:27 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:43:27.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:27 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:43:27.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:27 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:43:27.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:27 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:43:27.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:27 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:43:27.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:27 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:43:27.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:27 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:43:27.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:27 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:43:27.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:27 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:43:27.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:27 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:43:27.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:27 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:43:27.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:27 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:43:27.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:27 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:43:28.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.070+0000 7f93ceb66640 1 -- 172.21.15.79:0/1845171587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93c81084b0 msgr2=0x7f93c81088f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:28.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.070+0000 7f93ceb66640 1 --2- 172.21.15.79:0/1845171587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93c81084b0 0x7f93c81088f0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f93b4009900 tx=0x7f93b402a410 comp rx=0 tx=0).stop 2024-08-20T01:43:28.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.070+0000 7f93ceb66640 1 -- 172.21.15.79:0/1845171587 shutdown_connections 2024-08-20T01:43:28.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.070+0000 7f93ceb66640 1 --2- 172.21.15.79:0/1845171587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93c8108e30 0x7f93c810f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:28.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.070+0000 7f93ceb66640 1 --2- 172.21.15.79:0/1845171587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93c81084b0 0x7f93c81088f0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:28.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.070+0000 7f93ceb66640 1 --2- 172.21.15.79:0/1845171587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93c8102aa0 0x7f93c8102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:28.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.070+0000 7f93ceb66640 1 -- 172.21.15.79:0/1845171587 >> 172.21.15.79:0/1845171587 conn(0x7f93c80fe550 msgr2=0x7f93c8100970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:28.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.070+0000 7f93ceb66640 1 -- 172.21.15.79:0/1845171587 shutdown_connections 2024-08-20T01:43:28.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.070+0000 7f93ceb66640 1 -- 172.21.15.79:0/1845171587 wait complete. 2024-08-20T01:43:28.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.071+0000 7f93ceb66640 1 Processor -- start 2024-08-20T01:43:28.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.071+0000 7f93ceb66640 1 -- start start 2024-08-20T01:43:28.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.071+0000 7f93ceb66640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93c8102aa0 0x7f93c8198f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:28.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.071+0000 7f93ceb66640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93c81084b0 0x7f93c81994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:28.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.071+0000 7f93ceb66640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93c8108e30 0x7f93c819e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:28.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.071+0000 7f93ceb66640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f93c8112930 con 0x7f93c8108e30 2024-08-20T01:43:28.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.071+0000 7f93ceb66640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f93c81127b0 con 0x7f93c8102aa0 2024-08-20T01:43:28.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.072+0000 7f93ceb66640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f93c8112ab0 con 0x7f93c81084b0 2024-08-20T01:43:28.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.072+0000 7f93cd103640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93c8108e30 0x7f93c819e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:28.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.072+0000 7f93cd103640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93c8108e30 0x7f93c819e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34324/0 (socket says 172.21.15.79:34324) 2024-08-20T01:43:28.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.072+0000 7f93cc902640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93c8102aa0 0x7f93c8198f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:28.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.072+0000 7f93cd103640 1 -- 172.21.15.79:0/2027659561 learned_addr learned my addr 172.21.15.79:0/2027659561 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:28.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.072+0000 7f93c7fff640 1 --2- 172.21.15.79:0/2027659561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93c81084b0 0x7f93c81994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:28.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.072+0000 7f93cd103640 1 -- 172.21.15.79:0/2027659561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93c81084b0 msgr2=0x7f93c81994b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:28.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.072+0000 7f93cd103640 1 --2- 172.21.15.79:0/2027659561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93c81084b0 0x7f93c81994b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:28.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.072+0000 7f93cd103640 1 -- 172.21.15.79:0/2027659561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93c8102aa0 msgr2=0x7f93c8198f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:28.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.072+0000 7f93cd103640 1 --2- 172.21.15.79:0/2027659561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93c8102aa0 0x7f93c8198f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:28.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.072+0000 7f93cd103640 1 -- 172.21.15.79:0/2027659561 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93c819f020 con 0x7f93c8108e30 2024-08-20T01:43:28.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.072+0000 7f93cd103640 1 --2- 172.21.15.79:0/2027659561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93c8108e30 0x7f93c819e850 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f93c000eaa0 tx=0x7f93c000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:28.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.072+0000 7f93c5ffb640 1 -- 172.21.15.79:0/2027659561 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c000cdb0 con 0x7f93c8108e30 2024-08-20T01:43:28.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.072+0000 7f93c5ffb640 1 -- 172.21.15.79:0/2027659561 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f93c0005020 con 0x7f93c8108e30 2024-08-20T01:43:28.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.072+0000 7f93c5ffb640 1 -- 172.21.15.79:0/2027659561 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c00116d0 con 0x7f93c8108e30 2024-08-20T01:43:28.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.072+0000 7f93ceb66640 1 -- 172.21.15.79:0/2027659561 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93c819f310 con 0x7f93c8108e30 2024-08-20T01:43:28.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.073+0000 7f93ceb66640 1 -- 172.21.15.79:0/2027659561 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93c81a59d0 con 0x7f93c8108e30 2024-08-20T01:43:28.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.075+0000 7f93c5ffb640 1 -- 172.21.15.79:0/2027659561 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f93c00051d0 con 0x7f93c8108e30 2024-08-20T01:43:28.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.075+0000 7f93d0f5f740 1 Processor -- start 2024-08-20T01:43:28.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.075+0000 7f93d0f5f740 1 -- start start 2024-08-20T01:43:28.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.076+0000 7f93d0f5f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574b3912830 0x5574b3912c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:28.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.076+0000 7f93d0f5f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574b3913150 0x5574b391eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:28.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.076+0000 7f93d0f5f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574b391f0e0 0x5574b39214d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:28.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.076+0000 7f93d0f5f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5574b38898e0 con 0x5574b3912830 2024-08-20T01:43:28.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.076+0000 7f93d0f5f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5574b3878de0 con 0x5574b391f0e0 2024-08-20T01:43:28.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.076+0000 7f93d0f5f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5574b387ce20 con 0x5574b3913150 2024-08-20T01:43:28.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.076+0000 7f93c7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574b3912830 0x5574b3912c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:28.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.076+0000 7f93c7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574b3912830 0x5574b3912c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34336/0 (socket says 172.21.15.79:34336) 2024-08-20T01:43:28.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.076+0000 7f93c7fff640 1 -- 172.21.15.79:0/421459032 learned_addr learned my addr 172.21.15.79:0/421459032 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:28.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.076+0000 7f93cc902640 1 --2- 172.21.15.79:0/421459032 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574b3913150 0x5574b391eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:28.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.076+0000 7f93c5ffb640 1 --2- 172.21.15.79:0/2027659561 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f93b80b3bd0 0x7f93b80b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:28.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.076+0000 7f93c7fff640 1 -- 172.21.15.79:0/421459032 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574b3913150 msgr2=0x5574b391eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:28.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.076+0000 7f93c7fff640 1 --2- 172.21.15.79:0/421459032 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574b3913150 0x5574b391eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:28.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.076+0000 7f93c7fff640 1 -- 172.21.15.79:0/421459032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574b391f0e0 msgr2=0x5574b39214d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:28.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.076+0000 7f93c7fff640 1 --2- 172.21.15.79:0/421459032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574b391f0e0 0x5574b39214d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:28.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.076+0000 7f93c7fff640 1 -- 172.21.15.79:0/421459032 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574b35d8650 con 0x5574b3912830 2024-08-20T01:43:28.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.077+0000 7f93c5ffb640 1 -- 172.21.15.79:0/2027659561 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f93c00e3ce0 con 0x7f93c8108e30 2024-08-20T01:43:28.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.077+0000 7f93c7fff640 1 --2- 172.21.15.79:0/421459032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574b3912830 0x5574b3912c10 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f93b402a930 tx=0x7f93b4031bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8810581bb209c8f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:28.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.077+0000 7f93cd103640 1 --2- 172.21.15.79:0/2027659561 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f93b80b3bd0 0x7f93b80b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:28.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.077+0000 7f93b2ffd640 1 -- 172.21.15.79:0/421459032 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b4035030 con 0x5574b3912830 2024-08-20T01:43:28.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.077+0000 7f93b2ffd640 1 -- 172.21.15.79:0/421459032 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f93b4041020 con 0x5574b3912830 2024-08-20T01:43:28.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.077+0000 7f93b2ffd640 1 -- 172.21.15.79:0/421459032 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b4003850 con 0x5574b3912830 2024-08-20T01:43:28.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.078+0000 7f93d0f5f740 1 -- 172.21.15.79:0/421459032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574b3912830 msgr2=0x5574b3912c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:28.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.078+0000 7f93cd103640 1 --2- 172.21.15.79:0/2027659561 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f93b80b3bd0 0x7f93b80b6090 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f93c0004fd0 tx=0x7f93c000cf50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:28.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.078+0000 7f93d0f5f740 1 --2- 172.21.15.79:0/421459032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574b3912830 0x5574b3912c10 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f93b402a930 tx=0x7f93b4031bb0 comp rx=0 tx=0).stop 2024-08-20T01:43:28.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.078+0000 7f93d0f5f740 1 -- 172.21.15.79:0/421459032 shutdown_connections 2024-08-20T01:43:28.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.078+0000 7f93d0f5f740 1 --2- 172.21.15.79:0/421459032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574b391f0e0 0x5574b39214d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:28.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.078+0000 7f93d0f5f740 1 --2- 172.21.15.79:0/421459032 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574b3913150 0x5574b391eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:28.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.078+0000 7f93d0f5f740 1 --2- 172.21.15.79:0/421459032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574b3912830 0x5574b3912c10 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:28.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.078+0000 7f93d0f5f740 1 -- 172.21.15.79:0/421459032 >> 172.21.15.79:0/421459032 conn(0x5574b3910660 msgr2=0x5574b3911800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:28.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.078+0000 7f93d0f5f740 1 -- 172.21.15.79:0/421459032 shutdown_connections 2024-08-20T01:43:28.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.078+0000 7f93d0f5f740 1 -- 172.21.15.79:0/421459032 wait complete. 2024-08-20T01:43:28.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.079+0000 7f93d0f5f740 1 -- start start 2024-08-20T01:43:28.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.079+0000 7f93d0f5f740 1 Processor -- start 2024-08-20T01:43:28.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.079+0000 7f93d0f5f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574b3912830 0x5574b391c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:28.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.079+0000 7f93d0f5f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574b3913150 0x5574b391c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:28.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.079+0000 7f93d0f5f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574b391f0e0 0x5574b391cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:28.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.079+0000 7f93d0f5f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5574b36db700 con 0x5574b3912830 2024-08-20T01:43:28.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.079+0000 7f93d0f5f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5574b37ff7c0 con 0x5574b391f0e0 2024-08-20T01:43:28.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.079+0000 7f93d0f5f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5574b3921d30 con 0x5574b3913150 2024-08-20T01:43:28.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.079+0000 7f93d0f5f740 10 client.0 _ll_register_callbacks cb 0x5574b38726b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:43:28.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.079+0000 7f93c7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574b3912830 0x5574b391c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:28.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.079+0000 7f93c7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574b3912830 0x5574b391c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34338/0 (socket says 172.21.15.79:34338) 2024-08-20T01:43:28.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.079+0000 7f93c7fff640 1 -- 172.21.15.79:0/333195350 learned_addr learned my addr 172.21.15.79:0/333195350 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:28.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.079+0000 7f93cc902640 1 --2- 172.21.15.79:0/333195350 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574b3913150 0x5574b391c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:28.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.080+0000 7f93c7fff640 1 --2- 172.21.15.79:0/333195350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574b391f0e0 0x5574b391cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:28.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.080+0000 7f93c7fff640 1 -- 172.21.15.79:0/333195350 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574b3913150 msgr2=0x5574b391c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:28.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.080+0000 7f93c7fff640 1 --2- 172.21.15.79:0/333195350 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574b3913150 0x5574b391c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:28.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.080+0000 7f93c7fff640 1 -- 172.21.15.79:0/333195350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574b391f0e0 msgr2=0x5574b391cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:28.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.080+0000 7f93c7fff640 1 --2- 172.21.15.79:0/333195350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574b391f0e0 0x5574b391cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:28.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.080+0000 7f93c7fff640 1 -- 172.21.15.79:0/333195350 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574b392b130 con 0x5574b3912830 2024-08-20T01:43:28.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.080+0000 7f93a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:43:28.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.080+0000 7f93c7fff640 1 --2- 172.21.15.79:0/333195350 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574b3912830 0x5574b391c0d0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f93b4004650 tx=0x7f93b4005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db93f41a2eb190e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:28.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.080+0000 7f93a7fff640 1 -- 172.21.15.79:0/333195350 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b4055060 con 0x5574b3912830 2024-08-20T01:43:28.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.080+0000 7f93a7fff640 1 -- 172.21.15.79:0/333195350 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f93b40499d0 con 0x5574b3912830 2024-08-20T01:43:28.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.080+0000 7f93d0f5f740 1 -- 172.21.15.79:0/333195350 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5574b3828100 con 0x5574b3912830 2024-08-20T01:43:28.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.081+0000 7f93a7fff640 1 -- 172.21.15.79:0/333195350 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f93b403f070 con 0x5574b3912830 2024-08-20T01:43:28.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.081+0000 7f93d0f5f740 10 client.17391 fetch_fsmap learned FSMap version 38 2024-08-20T01:43:28.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.081+0000 7f93d0f5f740 1 -- 172.21.15.79:0/333195350 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5574b392dae0 con 0x5574b3912830 2024-08-20T01:43:28.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.081+0000 7f93a7fff640 1 -- 172.21.15.79:0/333195350 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5574b3828100 con 0x5574b3912830 2024-08-20T01:43:28.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.081+0000 7f93a7fff640 1 -- 172.21.15.79:0/333195350 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f93b405bb10 con 0x5574b3912830 2024-08-20T01:43:28.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.081+0000 7f93d0f5f740 10 client.17391 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:43:28.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.081+0000 7f93d0f5f740 10 client.17391 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:43:28.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.081+0000 7f93d0f5f740 20 client.17391 populate_metadata read hostname 'smithi079' 2024-08-20T01:43:28.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.081+0000 7f93d0f5f740 1 --2- 172.21.15.79:0/333195350 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5574b392ee30 0x5574b3931220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:28.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.081+0000 7f93d0f5f740 4 client.17391 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:43:28.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.081+0000 7f93d0f5f740 1 -- 172.21.15.79:0/333195350 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5574b388b830 con 0x5574b392ee30 2024-08-20T01:43:28.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.081+0000 7f93cc902640 1 --2- 172.21.15.79:0/333195350 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5574b392ee30 0x5574b3931220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:28.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.082+0000 7f93cc902640 1 --2- 172.21.15.79:0/333195350 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5574b392ee30 0x5574b3931220 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d831f8be10c84dd server_cookie=c318f69b2b6bf26a in_seq=0 out_seq=0 2024-08-20T01:43:28.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.082+0000 7f93a7fff640 10 client.17391 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:43:28.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.083+0000 7f93a7fff640 1 -- 172.21.15.79:0/333195350 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5574b388b830 con 0x5574b392ee30 2024-08-20T01:43:28.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.083+0000 7f93a7fff640 10 client.17391 handle_command_reply: tid=0 2024-08-20T01:43:28.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.083+0000 7f93d0f5f740 1 client.17391 shutdown 2024-08-20T01:43:28.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.083+0000 7f93d0f5f740 1 -- 172.21.15.79:0/333195350 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574b3912830 msgr2=0x5574b391c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:28.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.083+0000 7f93d0f5f740 1 --2- 172.21.15.79:0/333195350 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574b3912830 0x5574b391c0d0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f93b4004650 tx=0x7f93b4005850 comp rx=0 tx=0).stop 2024-08-20T01:43:28.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.083+0000 7f93d0f5f740 1 -- 172.21.15.79:0/333195350 shutdown_connections 2024-08-20T01:43:28.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.083+0000 7f93d0f5f740 1 --2- 172.21.15.79:0/333195350 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5574b392ee30 0x5574b3931220 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:28.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.083+0000 7f93d0f5f740 1 --2- 172.21.15.79:0/333195350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574b391f0e0 0x5574b391cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:28.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.083+0000 7f93d0f5f740 1 --2- 172.21.15.79:0/333195350 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574b3913150 0x5574b391c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:28.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.083+0000 7f93d0f5f740 1 --2- 172.21.15.79:0/333195350 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574b3912830 0x5574b391c0d0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:28.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.083+0000 7f93a7fff640 0 client.17391 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:43:28.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.083+0000 7f93d0f5f740 1 -- 172.21.15.79:0/333195350 >> 172.21.15.79:0/333195350 conn(0x5574b3910660 msgr2=0x5574b3916200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:28.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.083+0000 7f93d0f5f740 1 -- 172.21.15.79:0/333195350 shutdown_connections 2024-08-20T01:43:28.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.083+0000 7f93d0f5f740 1 -- 172.21.15.79:0/333195350 wait complete. 2024-08-20T01:43:28.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.083+0000 7f93d0f5f740 20 client.17391 trim_cache size 0 max 16384 2024-08-20T01:43:28.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.104+0000 7f93d0f5f740 1 Processor -- start 2024-08-20T01:43:28.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.104+0000 7f93d0f5f740 1 -- start start 2024-08-20T01:43:28.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.104+0000 7f93d0f5f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574b3912830 0x5574b39169f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:28.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.104+0000 7f93d0f5f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574b3913150 0x5574b3933e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:28.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.104+0000 7f93d0f5f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574b391f0e0 0x5574b39343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:28.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.104+0000 7f93d0f5f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f93c81abd80 con 0x5574b391f0e0 2024-08-20T01:43:28.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.104+0000 7f93d0f5f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f93c81ad8c0 con 0x5574b3913150 2024-08-20T01:43:28.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.104+0000 7f93d0f5f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f93c81ac450 con 0x5574b3912830 2024-08-20T01:43:28.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.104+0000 7f93c7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574b391f0e0 0x5574b39343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:28.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.104+0000 7f93c7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574b391f0e0 0x5574b39343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34342/0 (socket says 172.21.15.79:34342) 2024-08-20T01:43:28.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.104+0000 7f93c7fff640 1 -- 172.21.15.79:0/2747546892 learned_addr learned my addr 172.21.15.79:0/2747546892 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:28.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.104+0000 7f93c7fff640 1 --2- 172.21.15.79:0/2747546892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574b3912830 0x5574b39169f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:28.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.104+0000 7f93cc902640 1 --2- 172.21.15.79:0/2747546892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574b3913150 0x5574b3933e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:28.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.105+0000 7f93c7fff640 1 -- 172.21.15.79:0/2747546892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574b3912830 msgr2=0x5574b39169f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:28.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.105+0000 7f93c7fff640 1 --2- 172.21.15.79:0/2747546892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574b3912830 0x5574b39169f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:28.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.105+0000 7f93c7fff640 1 -- 172.21.15.79:0/2747546892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574b3913150 msgr2=0x5574b3933e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:28.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.105+0000 7f93c7fff640 1 --2- 172.21.15.79:0/2747546892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574b3913150 0x5574b3933e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:28.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.105+0000 7f93c7fff640 1 -- 172.21.15.79:0/2747546892 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574b3912f80 con 0x5574b391f0e0 2024-08-20T01:43:28.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.105+0000 7f93c7fff640 1 --2- 172.21.15.79:0/2747546892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574b391f0e0 0x5574b39343a0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f93b40095d0 tx=0x7f93b402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8599c0b54c10a7e7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:28.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.105+0000 7f93b27fc640 1 -- 172.21.15.79:0/2747546892 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b4055070 con 0x5574b391f0e0 2024-08-20T01:43:28.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.105+0000 7f93b27fc640 1 -- 172.21.15.79:0/2747546892 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f93b4062070 con 0x5574b391f0e0 2024-08-20T01:43:28.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.105+0000 7f93b27fc640 1 -- 172.21.15.79:0/2747546892 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b4035040 con 0x5574b391f0e0 2024-08-20T01:43:28.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.106+0000 7f93d0f5f740 1 -- 172.21.15.79:0/2747546892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574b391f0e0 msgr2=0x5574b39343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:28.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.106+0000 7f93d0f5f740 1 --2- 172.21.15.79:0/2747546892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574b391f0e0 0x5574b39343a0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f93b40095d0 tx=0x7f93b402a410 comp rx=0 tx=0).stop 2024-08-20T01:43:28.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.106+0000 7f93d0f5f740 1 -- 172.21.15.79:0/2747546892 shutdown_connections 2024-08-20T01:43:28.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.106+0000 7f93d0f5f740 1 --2- 172.21.15.79:0/2747546892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574b391f0e0 0x5574b39343a0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:28.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.106+0000 7f93d0f5f740 1 --2- 172.21.15.79:0/2747546892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574b3913150 0x5574b3933e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:28.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.106+0000 7f93d0f5f740 1 --2- 172.21.15.79:0/2747546892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574b3912830 0x5574b39169f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:28.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.106+0000 7f93d0f5f740 1 -- 172.21.15.79:0/2747546892 >> 172.21.15.79:0/2747546892 conn(0x5574b3910660 msgr2=0x5574b391a950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:28.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.106+0000 7f93d0f5f740 1 -- 172.21.15.79:0/2747546892 shutdown_connections 2024-08-20T01:43:28.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.106+0000 7f93d0f5f740 1 -- 172.21.15.79:0/2747546892 wait complete. 2024-08-20T01:43:28.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.106+0000 7f93d0f5f740 1 -- start start 2024-08-20T01:43:28.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.106+0000 7f93d0f5f740 1 Processor -- start 2024-08-20T01:43:28.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.107+0000 7f93d0f5f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574b3912830 0x5574b3931840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:28.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.107+0000 7f93d0f5f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574b3913150 0x5574b3931dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:28.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.107+0000 7f93d0f5f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574b391f0e0 0x5574b3990720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:28.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.107+0000 7f93d0f5f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f93c81ad1f0 con 0x5574b391f0e0 2024-08-20T01:43:28.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.107+0000 7f93d0f5f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f93c81acb20 con 0x5574b3912830 2024-08-20T01:43:28.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.107+0000 7f93d0f5f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f93c81a9d60 con 0x5574b3913150 2024-08-20T01:43:28.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.107+0000 7f93d0f5f740 10 client.0 _ll_register_callbacks cb 0x7f93bc00b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:43:28.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.107+0000 7f93c7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574b391f0e0 0x5574b3990720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:28.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.107+0000 7f93c7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574b391f0e0 0x5574b3990720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34358/0 (socket says 172.21.15.79:34358) 2024-08-20T01:43:28.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.107+0000 7f93c7fff640 1 -- 172.21.15.79:0/3397020642 learned_addr learned my addr 172.21.15.79:0/3397020642 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:28.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.107+0000 7f93c7fff640 1 --2- 172.21.15.79:0/3397020642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574b3912830 0x5574b3931840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:28.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.107+0000 7f93cc902640 1 --2- 172.21.15.79:0/3397020642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574b3913150 0x5574b3931dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:28.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.107+0000 7f93c7fff640 1 -- 172.21.15.79:0/3397020642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574b3913150 msgr2=0x5574b3931dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:28.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.107+0000 7f93c7fff640 1 --2- 172.21.15.79:0/3397020642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574b3913150 0x5574b3931dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:28.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.107+0000 7f93c7fff640 1 -- 172.21.15.79:0/3397020642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574b3912830 msgr2=0x5574b3931840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:28.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.107+0000 7f93c7fff640 1 --2- 172.21.15.79:0/3397020642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574b3912830 0x5574b3931840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:28.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.107+0000 7f93c7fff640 1 -- 172.21.15.79:0/3397020642 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574b3990e30 con 0x5574b391f0e0 2024-08-20T01:43:28.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.108+0000 7f93c7fff640 1 --2- 172.21.15.79:0/3397020642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574b391f0e0 0x5574b3990720 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f93b4004650 tx=0x7f93b4005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddcf76d547cb0e3a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:28.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.108+0000 7f93a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:43:28.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.108+0000 7f93a7fff640 1 -- 172.21.15.79:0/3397020642 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b4055070 con 0x5574b391f0e0 2024-08-20T01:43:28.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.108+0000 7f93a7fff640 1 -- 172.21.15.79:0/3397020642 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f93b40499d0 con 0x5574b391f0e0 2024-08-20T01:43:28.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.108+0000 7f93d0f5f740 1 -- 172.21.15.79:0/3397020642 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93b4062070 con 0x5574b391f0e0 2024-08-20T01:43:28.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.108+0000 7f93a7fff640 1 -- 172.21.15.79:0/3397020642 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f93b4035070 con 0x5574b391f0e0 2024-08-20T01:43:28.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.108+0000 7f93d0f5f740 10 client.17397 fetch_fsmap learned FSMap version 38 2024-08-20T01:43:28.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.108+0000 7f93d0f5f740 1 -- 172.21.15.79:0/3397020642 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5574b39993e0 con 0x5574b391f0e0 2024-08-20T01:43:28.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.108+0000 7f93a7fff640 1 -- 172.21.15.79:0/3397020642 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f93b4062070 con 0x5574b391f0e0 2024-08-20T01:43:28.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.108+0000 7f93a7fff640 1 -- 172.21.15.79:0/3397020642 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f93b4066040 con 0x5574b391f0e0 2024-08-20T01:43:28.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.108+0000 7f93d0f5f740 10 client.17397 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:43:28.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.108+0000 7f93d0f5f740 10 client.17397 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:43:28.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.108+0000 7f93d0f5f740 20 client.17397 populate_metadata read hostname 'smithi079' 2024-08-20T01:43:28.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.108+0000 7f93d0f5f740 1 --2- 172.21.15.79:0/3397020642 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5574b3999b20 0x5574b399bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:28.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.109+0000 7f93d0f5f740 4 client.17397 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:43:28.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.109+0000 7f93d0f5f740 1 -- 172.21.15.79:0/3397020642 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5574b38872d0 con 0x5574b3999b20 2024-08-20T01:43:28.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.109+0000 7f93cc902640 1 --2- 172.21.15.79:0/3397020642 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5574b3999b20 0x5574b399bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:28.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.109+0000 7f93a7fff640 10 client.17397 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:43:28.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.109+0000 7f93cc902640 1 --2- 172.21.15.79:0/3397020642 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5574b3999b20 0x5574b399bf40 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6bc1bb8f49266b2 server_cookie=45a73bbbb5e984be in_seq=0 out_seq=0 2024-08-20T01:43:28.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.109+0000 7f93a7fff640 1 -- 172.21.15.79:0/3397020642 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5574b38872d0 con 0x5574b3999b20 2024-08-20T01:43:28.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.109+0000 7f93a7fff640 10 client.17397 handle_command_reply: tid=0 2024-08-20T01:43:28.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.109+0000 7f93d0f5f740 1 client.17397 shutdown 2024-08-20T01:43:28.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.110+0000 7f93d0f5f740 1 -- 172.21.15.79:0/3397020642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574b391f0e0 msgr2=0x5574b3990720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:28.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.110+0000 7f93d0f5f740 1 --2- 172.21.15.79:0/3397020642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574b391f0e0 0x5574b3990720 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f93b4004650 tx=0x7f93b4005fd0 comp rx=0 tx=0).stop 2024-08-20T01:43:28.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.110+0000 7f93d0f5f740 1 -- 172.21.15.79:0/3397020642 shutdown_connections 2024-08-20T01:43:28.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.110+0000 7f93d0f5f740 1 --2- 172.21.15.79:0/3397020642 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5574b3999b20 0x5574b399bf40 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:28.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.110+0000 7f93d0f5f740 1 --2- 172.21.15.79:0/3397020642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574b391f0e0 0x5574b3990720 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:28.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.110+0000 7f93d0f5f740 1 --2- 172.21.15.79:0/3397020642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5574b3913150 0x5574b3931dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:28.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.110+0000 7f93d0f5f740 1 --2- 172.21.15.79:0/3397020642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574b3912830 0x5574b3931840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:28.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.110+0000 7f93d0f5f740 1 -- 172.21.15.79:0/3397020642 >> 172.21.15.79:0/3397020642 conn(0x5574b3910660 msgr2=0x5574b390f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:28.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.110+0000 7f93a7fff640 0 client.17397 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:43:28.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.110+0000 7f93d0f5f740 1 -- 172.21.15.79:0/3397020642 shutdown_connections 2024-08-20T01:43:28.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.110+0000 7f93d0f5f740 1 -- 172.21.15.79:0/3397020642 wait complete. 2024-08-20T01:43:28.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.110+0000 7f93d0f5f740 20 client.17397 trim_cache size 0 max 16384 2024-08-20T01:43:28.117 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:43:28.118 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-20T01:43:28.118 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": { 2024-08-20T01:43:28.118 INFO:teuthology.orchestra.run.smithi079.stdout: "5bd2fc93-e7b2-41b2-a02b-ee1d5245ab3c": { 2024-08-20T01:43:28.118 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/", 2024-08-20T01:43:28.118 INFO:teuthology.orchestra.run.smithi079.stdout: "tag": "5bd2fc93-e7b2-41b2-a02b-ee1d5245ab3c", 2024-08-20T01:43:28.118 INFO:teuthology.orchestra.run.smithi079.stdout: "options": "recursive,force" 2024-08-20T01:43:28.118 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:43:28.118 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:43:28.118 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:43:28.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.111+0000 7f93ceb66640 1 -- 172.21.15.79:0/2027659561 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f93b80b3bd0 msgr2=0x7f93b80b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:28.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.111+0000 7f93ceb66640 1 --2- 172.21.15.79:0/2027659561 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f93b80b3bd0 0x7f93b80b6090 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f93c0004fd0 tx=0x7f93c000cf50 comp rx=0 tx=0).stop 2024-08-20T01:43:28.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.111+0000 7f93ceb66640 1 -- 172.21.15.79:0/2027659561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93c8108e30 msgr2=0x7f93c819e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:28.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.111+0000 7f93ceb66640 1 --2- 172.21.15.79:0/2027659561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93c8108e30 0x7f93c819e850 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f93c000eaa0 tx=0x7f93c000ef60 comp rx=0 tx=0).stop 2024-08-20T01:43:28.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.111+0000 7f93ceb66640 1 -- 172.21.15.79:0/2027659561 shutdown_connections 2024-08-20T01:43:28.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.111+0000 7f93ceb66640 1 --2- 172.21.15.79:0/2027659561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93c8108e30 0x7f93c819e850 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:28.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.111+0000 7f93ceb66640 1 --2- 172.21.15.79:0/2027659561 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f93b80b3bd0 0x7f93b80b6090 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:28.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.111+0000 7f93ceb66640 1 --2- 172.21.15.79:0/2027659561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93c81084b0 0x7f93c81994b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:28.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.111+0000 7f93ceb66640 1 --2- 172.21.15.79:0/2027659561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93c8102aa0 0x7f93c8198f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:28.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.111+0000 7f93ceb66640 1 -- 172.21.15.79:0/2027659561 >> 172.21.15.79:0/2027659561 conn(0x7f93c80fe550 msgr2=0x7f93c8100940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:28.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.111+0000 7f93ceb66640 1 -- 172.21.15.79:0/2027659561 shutdown_connections 2024-08-20T01:43:28.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:28.111+0000 7f93ceb66640 1 -- 172.21.15.79:0/2027659561 wait complete. 2024-08-20T01:43:28.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:28 smithi079 ceph-mon[18656]: pgmap v531: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 26 MiB/s wr, 22 op/s 2024-08-20T01:43:28.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:28 smithi081 ceph-mon[22209]: pgmap v531: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 26 MiB/s wr, 22 op/s 2024-08-20T01:43:28.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:28 smithi175 ceph-mon[22392]: pgmap v531: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 26 MiB/s wr, 22 op/s 2024-08-20T01:43:29.019 INFO:tasks.cephfs.filesystem:scrub status for tag:5bd2fc93-e7b2-41b2-a02b-ee1d5245ab3c - {'path': '/', 'tag': '5bd2fc93-e7b2-41b2-a02b-ee1d5245ab3c', 'options': 'recursive,force'} 2024-08-20T01:43:30.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:30 smithi079 ceph-mon[18656]: pgmap v532: 97 pgs: 97 active+clean; 9.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 28 MiB/s wr, 37 op/s 2024-08-20T01:43:30.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:30 smithi081 ceph-mon[22209]: pgmap v532: 97 pgs: 97 active+clean; 9.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 28 MiB/s wr, 37 op/s 2024-08-20T01:43:30.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:30 smithi175 ceph-mon[22392]: pgmap v532: 97 pgs: 97 active+clean; 9.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 28 MiB/s wr, 37 op/s 2024-08-20T01:43:32.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:32 smithi079 ceph-mon[18656]: pgmap v533: 97 pgs: 97 active+clean; 9.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 28 MiB/s wr, 44 op/s 2024-08-20T01:43:32.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:32 smithi081 ceph-mon[22209]: pgmap v533: 97 pgs: 97 active+clean; 9.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 28 MiB/s wr, 44 op/s 2024-08-20T01:43:32.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:32 smithi175 ceph-mon[22392]: pgmap v533: 97 pgs: 97 active+clean; 9.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 28 MiB/s wr, 44 op/s 2024-08-20T01:43:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.198+0000 7f2810faa640 1 -- 172.21.15.79:0/4007181363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f280c103070 msgr2=0x7f280c1099f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.198+0000 7f2810faa640 1 --2- 172.21.15.79:0/4007181363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f280c103070 0x7f280c1099f0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f2804009cd0 tx=0x7f280402a8e0 comp rx=0 tx=0).stop 2024-08-20T01:43:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.198+0000 7f2810faa640 1 -- 172.21.15.79:0/4007181363 shutdown_connections 2024-08-20T01:43:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.198+0000 7f2810faa640 1 --2- 172.21.15.79:0/4007181363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f280c103070 0x7f280c1099f0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:33.202 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.198+0000 7f2810faa640 1 --2- 172.21.15.79:0/4007181363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f280c1026b0 0x7f280c102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:33.202 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.198+0000 7f2810faa640 1 --2- 172.21.15.79:0/4007181363 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f280c101560 0x7f280c101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:33.202 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.198+0000 7f2810faa640 1 -- 172.21.15.79:0/4007181363 >> 172.21.15.79:0/4007181363 conn(0x7f280c0fce40 msgr2=0x7f280c0ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:33.202 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.198+0000 7f2810faa640 1 -- 172.21.15.79:0/4007181363 shutdown_connections 2024-08-20T01:43:33.202 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.198+0000 7f2810faa640 1 -- 172.21.15.79:0/4007181363 wait complete. 2024-08-20T01:43:33.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.199+0000 7f2810faa640 1 Processor -- start 2024-08-20T01:43:33.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.199+0000 7f2810faa640 1 -- start start 2024-08-20T01:43:33.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.199+0000 7f2810faa640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f280c101560 0x7f280c06ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:33.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.199+0000 7f2810faa640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f280c1026b0 0x7f280c19fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.199+0000 7f2810faa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f280c103070 0x7f280c1a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.199+0000 7f2810faa640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f280c10d080 con 0x7f280c101560 2024-08-20T01:43:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.199+0000 7f2810faa640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f280c10cf00 con 0x7f280c103070 2024-08-20T01:43:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.199+0000 7f2810faa640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f280c10d200 con 0x7f280c1026b0 2024-08-20T01:43:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.199+0000 7f280a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f280c101560 0x7f280c06ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.199+0000 7f280a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f280c101560 0x7f280c06ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41660/0 (socket says 172.21.15.79:41660) 2024-08-20T01:43:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.199+0000 7f280a59c640 1 -- 172.21.15.79:0/2819437627 learned_addr learned my addr 172.21.15.79:0/2819437627 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.199+0000 7f280ad9d640 1 --2- 172.21.15.79:0/2819437627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f280c103070 0x7f280c1a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.199+0000 7f2809d9b640 1 --2- 172.21.15.79:0/2819437627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f280c1026b0 0x7f280c19fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.199+0000 7f280a59c640 1 -- 172.21.15.79:0/2819437627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f280c1026b0 msgr2=0x7f280c19fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.199+0000 7f280a59c640 1 --2- 172.21.15.79:0/2819437627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f280c1026b0 0x7f280c19fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.199+0000 7f280a59c640 1 -- 172.21.15.79:0/2819437627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f280c103070 msgr2=0x7f280c1a1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.199+0000 7f280a59c640 1 --2- 172.21.15.79:0/2819437627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f280c103070 0x7f280c1a1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.199+0000 7f280a59c640 1 -- 172.21.15.79:0/2819437627 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f280c1a2710 con 0x7f280c101560 2024-08-20T01:43:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.200+0000 7f280a59c640 1 --2- 172.21.15.79:0/2819437627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f280c101560 0x7f280c06ade0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f27fc00e9f0 tx=0x7f27fc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.200+0000 7f27fb7fe640 1 -- 172.21.15.79:0/2819437627 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27fc00cd80 con 0x7f280c101560 2024-08-20T01:43:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.200+0000 7f27fb7fe640 1 -- 172.21.15.79:0/2819437627 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f27fc0054b0 con 0x7f280c101560 2024-08-20T01:43:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.200+0000 7f2810faa640 1 -- 172.21.15.79:0/2819437627 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f280c1a2a00 con 0x7f280c101560 2024-08-20T01:43:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.200+0000 7f27fb7fe640 1 -- 172.21.15.79:0/2819437627 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27fc010430 con 0x7f280c101560 2024-08-20T01:43:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.200+0000 7f2810faa640 1 -- 172.21.15.79:0/2819437627 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f280c1a2f50 con 0x7f280c101560 2024-08-20T01:43:33.214 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.203+0000 7f2813e81740 1 Processor -- start 2024-08-20T01:43:33.214 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.203+0000 7f2813e81740 1 -- start start 2024-08-20T01:43:33.215 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.203+0000 7f2813e81740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ba06f88d0 0x557ba06facc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:33.215 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.203+0000 7f2813e81740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ba06fb200 0x557ba06fd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:33.215 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.203+0000 7f2813e81740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ba06fdc40 0x557ba0700100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:33.215 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.203+0000 7f2813e81740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557ba066b360 con 0x557ba06fdc40 2024-08-20T01:43:33.215 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.203+0000 7f2813e81740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557ba065a860 con 0x557ba06f88d0 2024-08-20T01:43:33.215 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.203+0000 7f2813e81740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557ba065e8a0 con 0x557ba06fb200 2024-08-20T01:43:33.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.203+0000 7f2809d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ba06fdc40 0x557ba0700100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:33.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.203+0000 7f280ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ba06f88d0 0x557ba06facc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:33.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.203+0000 7f2809d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ba06fdc40 0x557ba0700100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41662/0 (socket says 172.21.15.79:41662) 2024-08-20T01:43:33.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.203+0000 7f2809d9b640 1 -- 172.21.15.79:0/1019858200 learned_addr learned my addr 172.21.15.79:0/1019858200 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:33.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.203+0000 7f27fb7fe640 1 -- 172.21.15.79:0/2819437627 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f27fc0046c0 con 0x7f280c101560 2024-08-20T01:43:33.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.204+0000 7f2809d9b640 1 -- 172.21.15.79:0/1019858200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ba06fb200 msgr2=0x557ba06fd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:33.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.204+0000 7f2809d9b640 1 --2- 172.21.15.79:0/1019858200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ba06fb200 0x557ba06fd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:33.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.204+0000 7f2809d9b640 1 -- 172.21.15.79:0/1019858200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ba06f88d0 msgr2=0x557ba06facc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:33.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.204+0000 7f2809d9b640 1 --2- 172.21.15.79:0/1019858200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ba06f88d0 0x557ba06facc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:33.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.204+0000 7f2809d9b640 1 -- 172.21.15.79:0/1019858200 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ba0601e40 con 0x557ba06fdc40 2024-08-20T01:43:33.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.204+0000 7f280ad9d640 1 --2- 172.21.15.79:0/1019858200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ba06f88d0 0x557ba06facc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:43:33.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.204+0000 7f2809d9b640 1 --2- 172.21.15.79:0/1019858200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ba06fdc40 0x557ba0700100 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f280000bcb0 tx=0x7f280000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f73f9ead06ad707 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:33.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.204+0000 7f27f8ff9640 1 -- 172.21.15.79:0/1019858200 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2800015070 con 0x557ba06fdc40 2024-08-20T01:43:33.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.204+0000 7f27f8ff9640 1 -- 172.21.15.79:0/1019858200 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f280001a8f0 con 0x557ba06fdc40 2024-08-20T01:43:33.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.204+0000 7f27f8ff9640 1 -- 172.21.15.79:0/1019858200 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28000118c0 con 0x557ba06fdc40 2024-08-20T01:43:33.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.204+0000 7f27fb7fe640 1 --2- 172.21.15.79:0/2819437627 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f27f40b3c50 0x7f27f40b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:33.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.205+0000 7f280ad9d640 1 --2- 172.21.15.79:0/2819437627 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f27f40b3c50 0x7f27f40b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:33.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.205+0000 7f27fb7fe640 1 -- 172.21.15.79:0/2819437627 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f27fc0e3f80 con 0x7f280c101560 2024-08-20T01:43:33.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.205+0000 7f280ad9d640 1 --2- 172.21.15.79:0/2819437627 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f27f40b3c50 0x7f27f40b6110 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2804004af0 tx=0x7f2804004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:33.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.205+0000 7f2813e81740 1 -- 172.21.15.79:0/1019858200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ba06fdc40 msgr2=0x557ba0700100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:33.218 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.205+0000 7f2813e81740 1 --2- 172.21.15.79:0/1019858200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ba06fdc40 0x557ba0700100 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f280000bcb0 tx=0x7f280000f730 comp rx=0 tx=0).stop 2024-08-20T01:43:33.218 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.205+0000 7f2813e81740 1 -- 172.21.15.79:0/1019858200 shutdown_connections 2024-08-20T01:43:33.218 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.205+0000 7f2813e81740 1 --2- 172.21.15.79:0/1019858200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ba06fdc40 0x557ba0700100 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:33.218 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.205+0000 7f2813e81740 1 --2- 172.21.15.79:0/1019858200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ba06fb200 0x557ba06fd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:33.218 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.205+0000 7f2813e81740 1 --2- 172.21.15.79:0/1019858200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ba06f88d0 0x557ba06facc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:33.218 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.205+0000 7f2813e81740 1 -- 172.21.15.79:0/1019858200 >> 172.21.15.79:0/1019858200 conn(0x557ba06f3a20 msgr2=0x557ba06f47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:33.218 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.205+0000 7f2813e81740 1 -- 172.21.15.79:0/1019858200 shutdown_connections 2024-08-20T01:43:33.218 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.205+0000 7f2813e81740 1 -- 172.21.15.79:0/1019858200 wait complete. 2024-08-20T01:43:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.205+0000 7f2813e81740 1 -- start start 2024-08-20T01:43:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.206+0000 7f2813e81740 1 Processor -- start 2024-08-20T01:43:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.206+0000 7f2813e81740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ba06f88d0 0x557ba0702190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.206+0000 7f2813e81740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ba06fb200 0x557ba0702830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.206+0000 7f2813e81740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ba06fdc40 0x557ba0703390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.206+0000 7f2813e81740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557ba0593ab0 con 0x557ba06fb200 2024-08-20T01:43:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.206+0000 7f2813e81740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557ba05e1780 con 0x557ba06fdc40 2024-08-20T01:43:33.220 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.206+0000 7f2813e81740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557ba0700c20 con 0x557ba06f88d0 2024-08-20T01:43:33.220 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.206+0000 7f2813e81740 10 client.0 _ll_register_callbacks cb 0x557ba0369a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:43:33.220 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.206+0000 7f2809d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ba06fb200 0x557ba0702830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:33.220 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.206+0000 7f2809d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ba06fb200 0x557ba0702830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41674/0 (socket says 172.21.15.79:41674) 2024-08-20T01:43:33.220 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.206+0000 7f2809d9b640 1 -- 172.21.15.79:0/2680474960 learned_addr learned my addr 172.21.15.79:0/2680474960 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:33.220 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.206+0000 7f280ad9d640 1 --2- 172.21.15.79:0/2680474960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ba06fdc40 0x557ba0703390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:33.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.206+0000 7f2809d9b640 1 -- 172.21.15.79:0/2680474960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ba06f88d0 msgr2=0x557ba0702190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:33.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.206+0000 7f280a59c640 1 --2- 172.21.15.79:0/2680474960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ba06f88d0 0x557ba0702190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:33.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.206+0000 7f2809d9b640 1 --2- 172.21.15.79:0/2680474960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ba06f88d0 0x557ba0702190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:33.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.206+0000 7f2809d9b640 1 -- 172.21.15.79:0/2680474960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ba06fdc40 msgr2=0x557ba0703390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:33.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.206+0000 7f2809d9b640 1 --2- 172.21.15.79:0/2680474960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ba06fdc40 0x557ba0703390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:33.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.206+0000 7f2809d9b640 1 -- 172.21.15.79:0/2680474960 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ba03bd790 con 0x557ba06fb200 2024-08-20T01:43:33.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.206+0000 7f280ad9d640 1 --2- 172.21.15.79:0/2680474960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ba06fdc40 0x557ba0703390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:43:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.206+0000 7f2809d9b640 1 --2- 172.21.15.79:0/2680474960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ba06fb200 0x557ba0702830 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f2800000c00 tx=0x7f280000b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dcc65c01527ffe6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.206+0000 7f27f1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:43:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.207+0000 7f27f1ffb640 1 -- 172.21.15.79:0/2680474960 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2800028060 con 0x557ba06fb200 2024-08-20T01:43:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.207+0000 7f27f1ffb640 1 -- 172.21.15.79:0/2680474960 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f2800005490 con 0x557ba06fb200 2024-08-20T01:43:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.207+0000 7f2813e81740 1 -- 172.21.15.79:0/2680474960 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557ba0609e00 con 0x557ba06fb200 2024-08-20T01:43:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.207+0000 7f27f1ffb640 1 -- 172.21.15.79:0/2680474960 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f2800015070 con 0x557ba06fb200 2024-08-20T01:43:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.207+0000 7f2813e81740 10 client.17409 fetch_fsmap learned FSMap version 38 2024-08-20T01:43:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.207+0000 7f2813e81740 1 -- 172.21.15.79:0/2680474960 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x557ba0436620 con 0x557ba06fb200 2024-08-20T01:43:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.207+0000 7f27f1ffb640 1 -- 172.21.15.79:0/2680474960 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x557ba0609e00 con 0x557ba06fb200 2024-08-20T01:43:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.207+0000 7f27f1ffb640 1 -- 172.21.15.79:0/2680474960 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f28000118f0 con 0x557ba06fb200 2024-08-20T01:43:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.207+0000 7f2813e81740 10 client.17409 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:43:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.207+0000 7f2813e81740 10 client.17409 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:43:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.207+0000 7f2813e81740 20 client.17409 populate_metadata read hostname 'smithi079' 2024-08-20T01:43:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.207+0000 7f2813e81740 1 --2- 172.21.15.79:0/2680474960 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557ba070d6d0 0x557ba070fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.207+0000 7f2813e81740 4 client.17409 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:43:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.207+0000 7f2813e81740 1 -- 172.21.15.79:0/2680474960 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557ba066d2b0 con 0x557ba070d6d0 2024-08-20T01:43:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.208+0000 7f280a59c640 1 --2- 172.21.15.79:0/2680474960 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557ba070d6d0 0x557ba070fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.208+0000 7f27f1ffb640 10 client.17409 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:43:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.208+0000 7f280a59c640 1 --2- 172.21.15.79:0/2680474960 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557ba070d6d0 0x557ba070fac0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e309af149567d472 server_cookie=1ffcd5952061a02e in_seq=0 out_seq=0 2024-08-20T01:43:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.209+0000 7f27f1ffb640 1 -- 172.21.15.79:0/2680474960 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557ba066d2b0 con 0x557ba070d6d0 2024-08-20T01:43:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.209+0000 7f27f1ffb640 10 client.17409 handle_command_reply: tid=0 2024-08-20T01:43:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.209+0000 7f2813e81740 1 client.17409 shutdown 2024-08-20T01:43:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.209+0000 7f2813e81740 1 -- 172.21.15.79:0/2680474960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ba06fb200 msgr2=0x557ba0702830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.209+0000 7f2813e81740 1 --2- 172.21.15.79:0/2680474960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ba06fb200 0x557ba0702830 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f2800000c00 tx=0x7f280000b9f0 comp rx=0 tx=0).stop 2024-08-20T01:43:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.209+0000 7f2813e81740 1 -- 172.21.15.79:0/2680474960 shutdown_connections 2024-08-20T01:43:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.209+0000 7f2813e81740 1 --2- 172.21.15.79:0/2680474960 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557ba070d6d0 0x557ba070fac0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.209+0000 7f2813e81740 1 --2- 172.21.15.79:0/2680474960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ba06fdc40 0x557ba0703390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.209+0000 7f2813e81740 1 --2- 172.21.15.79:0/2680474960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ba06fb200 0x557ba0702830 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.209+0000 7f2813e81740 1 --2- 172.21.15.79:0/2680474960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ba06f88d0 0x557ba0702190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.209+0000 7f2813e81740 1 -- 172.21.15.79:0/2680474960 >> 172.21.15.79:0/2680474960 conn(0x557ba06f3a20 msgr2=0x557ba06f2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.209+0000 7f27f1ffb640 0 client.17409 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:43:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.209+0000 7f2813e81740 1 -- 172.21.15.79:0/2680474960 shutdown_connections 2024-08-20T01:43:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.209+0000 7f2813e81740 1 -- 172.21.15.79:0/2680474960 wait complete. 2024-08-20T01:43:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.209+0000 7f2813e81740 20 client.17409 trim_cache size 0 max 16384 2024-08-20T01:43:33.234 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.226+0000 7f2813e81740 1 Processor -- start 2024-08-20T01:43:33.234 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.226+0000 7f2813e81740 1 -- start start 2024-08-20T01:43:33.234 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.226+0000 7f2813e81740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ba06f88d0 0x557ba07028a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:33.234 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.226+0000 7f2813e81740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ba06fb200 0x557ba0700ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:33.234 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.226+0000 7f2813e81740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ba06fdc40 0x557ba0701530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:33.234 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.226+0000 7f2813e81740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f280c1abcc0 con 0x557ba06fb200 2024-08-20T01:43:33.234 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.226+0000 7f2813e81740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f280c1ad800 con 0x557ba06fdc40 2024-08-20T01:43:33.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.226+0000 7f2813e81740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f280c1ac390 con 0x557ba06f88d0 2024-08-20T01:43:33.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.226+0000 7f2809d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ba06fb200 0x557ba0700ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:33.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.226+0000 7f2809d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ba06fb200 0x557ba0700ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41676/0 (socket says 172.21.15.79:41676) 2024-08-20T01:43:33.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.226+0000 7f2809d9b640 1 -- 172.21.15.79:0/971605292 learned_addr learned my addr 172.21.15.79:0/971605292 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:33.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.226+0000 7f280a59c640 1 --2- 172.21.15.79:0/971605292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ba06f88d0 0x557ba07028a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:33.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.226+0000 7f280ad9d640 1 --2- 172.21.15.79:0/971605292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ba06fdc40 0x557ba0701530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:33.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.226+0000 7f2809d9b640 1 -- 172.21.15.79:0/971605292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ba06f88d0 msgr2=0x557ba07028a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:33.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.226+0000 7f2809d9b640 1 --2- 172.21.15.79:0/971605292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ba06f88d0 0x557ba07028a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:33.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.226+0000 7f2809d9b640 1 -- 172.21.15.79:0/971605292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ba06fdc40 msgr2=0x557ba0701530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:33.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.226+0000 7f2809d9b640 1 --2- 172.21.15.79:0/971605292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ba06fdc40 0x557ba0701530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:33.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.226+0000 7f2809d9b640 1 -- 172.21.15.79:0/971605292 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ba06ee780 con 0x557ba06fb200 2024-08-20T01:43:33.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.227+0000 7f2809d9b640 1 --2- 172.21.15.79:0/971605292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ba06fb200 0x557ba0700ff0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f2800011cc0 tx=0x7f280001a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eb94609b068904 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:33.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.227+0000 7f27f3fff640 1 -- 172.21.15.79:0/971605292 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2800033070 con 0x557ba06fb200 2024-08-20T01:43:33.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.227+0000 7f27f3fff640 1 -- 172.21.15.79:0/971605292 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f28000119e0 con 0x557ba06fb200 2024-08-20T01:43:33.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.227+0000 7f27f3fff640 1 -- 172.21.15.79:0/971605292 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2800028070 con 0x557ba06fb200 2024-08-20T01:43:33.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.227+0000 7f2813e81740 1 -- 172.21.15.79:0/971605292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ba06fb200 msgr2=0x557ba0700ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:33.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.227+0000 7f2813e81740 1 --2- 172.21.15.79:0/971605292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ba06fb200 0x557ba0700ff0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f2800011cc0 tx=0x7f280001a660 comp rx=0 tx=0).stop 2024-08-20T01:43:33.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.227+0000 7f2813e81740 1 -- 172.21.15.79:0/971605292 shutdown_connections 2024-08-20T01:43:33.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.227+0000 7f2813e81740 1 --2- 172.21.15.79:0/971605292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ba06fdc40 0x557ba0701530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:33.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.228+0000 7f2813e81740 1 --2- 172.21.15.79:0/971605292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ba06fb200 0x557ba0700ff0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:33.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.228+0000 7f2813e81740 1 --2- 172.21.15.79:0/971605292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ba06f88d0 0x557ba07028a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:33.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.228+0000 7f2813e81740 1 -- 172.21.15.79:0/971605292 >> 172.21.15.79:0/971605292 conn(0x557ba06f3a20 msgr2=0x557ba0702190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:33.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.228+0000 7f2813e81740 1 -- 172.21.15.79:0/971605292 shutdown_connections 2024-08-20T01:43:33.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.228+0000 7f2813e81740 1 -- 172.21.15.79:0/971605292 wait complete. 2024-08-20T01:43:33.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.228+0000 7f2813e81740 1 -- start start 2024-08-20T01:43:33.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.228+0000 7f2813e81740 1 Processor -- start 2024-08-20T01:43:33.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.228+0000 7f2813e81740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ba06f88d0 0x557ba0706740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:33.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.228+0000 7f2813e81740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ba06fb200 0x557ba0706de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:33.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.228+0000 7f2813e81740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ba06fdc40 0x557ba07079b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:33.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.228+0000 7f2813e81740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f280c1ad130 con 0x557ba06fdc40 2024-08-20T01:43:33.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.228+0000 7f2813e81740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f280c1aca60 con 0x557ba06fb200 2024-08-20T01:43:33.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.228+0000 7f2813e81740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f280c1a9ca0 con 0x557ba06f88d0 2024-08-20T01:43:33.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.228+0000 7f2813e81740 10 client.0 _ll_register_callbacks cb 0x7f2804009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:43:33.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.228+0000 7f280ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ba06fdc40 0x557ba07079b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:33.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.228+0000 7f280ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ba06fdc40 0x557ba07079b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41688/0 (socket says 172.21.15.79:41688) 2024-08-20T01:43:33.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.228+0000 7f280ad9d640 1 -- 172.21.15.79:0/1997230083 learned_addr learned my addr 172.21.15.79:0/1997230083 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:33.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.228+0000 7f280a59c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ba06f88d0 0x557ba0706740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:33.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.228+0000 7f2809d9b640 1 --2- 172.21.15.79:0/1997230083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ba06fb200 0x557ba0706de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:33.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.228+0000 7f280ad9d640 1 -- 172.21.15.79:0/1997230083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ba06f88d0 msgr2=0x557ba0706740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:33.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.228+0000 7f280ad9d640 1 --2- 172.21.15.79:0/1997230083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ba06f88d0 0x557ba0706740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:33.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.228+0000 7f280ad9d640 1 -- 172.21.15.79:0/1997230083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ba06fb200 msgr2=0x557ba0706de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:33.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.228+0000 7f280ad9d640 1 --2- 172.21.15.79:0/1997230083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ba06fb200 0x557ba0706de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:33.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.229+0000 7f280ad9d640 1 -- 172.21.15.79:0/1997230083 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ba07081e0 con 0x557ba06fdc40 2024-08-20T01:43:33.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.229+0000 7f280ad9d640 1 --2- 172.21.15.79:0/1997230083 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ba06fdc40 0x557ba07079b0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f2804009cd0 tx=0x7f280402a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bad55cdf303603f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:33.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.229+0000 7f27f1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:43:33.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.229+0000 7f27f1ffb640 1 -- 172.21.15.79:0/1997230083 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2804056060 con 0x557ba06fdc40 2024-08-20T01:43:33.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.229+0000 7f27f1ffb640 1 -- 172.21.15.79:0/1997230083 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f2804004310 con 0x557ba06fdc40 2024-08-20T01:43:33.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.229+0000 7f2813e81740 1 -- 172.21.15.79:0/1997230083 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28000119e0 con 0x557ba06fdc40 2024-08-20T01:43:33.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.229+0000 7f27f1ffb640 1 -- 172.21.15.79:0/1997230083 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f2804004510 con 0x557ba06fdc40 2024-08-20T01:43:33.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.229+0000 7f2813e81740 10 client.17415 fetch_fsmap learned FSMap version 38 2024-08-20T01:43:33.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.229+0000 7f2813e81740 1 -- 172.21.15.79:0/1997230083 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x557ba07095c0 con 0x557ba06fdc40 2024-08-20T01:43:33.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.229+0000 7f27f1ffb640 1 -- 172.21.15.79:0/1997230083 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f28000119e0 con 0x557ba06fdc40 2024-08-20T01:43:33.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.229+0000 7f27f1ffb640 1 -- 172.21.15.79:0/1997230083 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f2804030070 con 0x557ba06fdc40 2024-08-20T01:43:33.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.230+0000 7f2813e81740 10 client.17415 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:43:33.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.230+0000 7f2813e81740 10 client.17415 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:43:33.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.230+0000 7f2813e81740 20 client.17415 populate_metadata read hostname 'smithi079' 2024-08-20T01:43:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.230+0000 7f2813e81740 1 --2- 172.21.15.79:0/1997230083 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557ba0709fa0 0x557ba077a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.230+0000 7f2813e81740 4 client.17415 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:43:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.230+0000 7f2813e81740 1 -- 172.21.15.79:0/1997230083 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557ba0668d50 con 0x557ba0709fa0 2024-08-20T01:43:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.230+0000 7f280a59c640 1 --2- 172.21.15.79:0/1997230083 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557ba0709fa0 0x557ba077a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.230+0000 7f27f1ffb640 10 client.17415 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:43:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.230+0000 7f280a59c640 1 --2- 172.21.15.79:0/1997230083 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557ba0709fa0 0x557ba077a310 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e9673a794ae30a8 server_cookie=43375affc19257e6 in_seq=0 out_seq=0 2024-08-20T01:43:33.243 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.239+0000 7f27f1ffb640 1 -- 172.21.15.79:0/1997230083 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557ba0668d50 con 0x557ba0709fa0 2024-08-20T01:43:33.243 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.239+0000 7f27f1ffb640 10 client.17415 handle_command_reply: tid=0 2024-08-20T01:43:33.243 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.239+0000 7f2813e81740 1 client.17415 shutdown 2024-08-20T01:43:33.243 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.240+0000 7f2813e81740 1 -- 172.21.15.79:0/1997230083 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ba06fdc40 msgr2=0x557ba07079b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:33.244 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.240+0000 7f2813e81740 1 --2- 172.21.15.79:0/1997230083 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ba06fdc40 0x557ba07079b0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f2804009cd0 tx=0x7f280402a8e0 comp rx=0 tx=0).stop 2024-08-20T01:43:33.244 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.240+0000 7f2813e81740 1 -- 172.21.15.79:0/1997230083 shutdown_connections 2024-08-20T01:43:33.244 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.240+0000 7f2813e81740 1 --2- 172.21.15.79:0/1997230083 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557ba0709fa0 0x557ba077a310 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:33.244 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.240+0000 7f2813e81740 1 --2- 172.21.15.79:0/1997230083 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ba06fdc40 0x557ba07079b0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:33.244 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.240+0000 7f2813e81740 1 --2- 172.21.15.79:0/1997230083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ba06fb200 0x557ba0706de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:33.244 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.240+0000 7f2813e81740 1 --2- 172.21.15.79:0/1997230083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ba06f88d0 0x557ba0706740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:33.244 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.240+0000 7f2813e81740 1 -- 172.21.15.79:0/1997230083 >> 172.21.15.79:0/1997230083 conn(0x557ba06f3a20 msgr2=0x557ba0700ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:33.244 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.240+0000 7f27f1ffb640 0 client.17415 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:43:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.240+0000 7f2813e81740 1 -- 172.21.15.79:0/1997230083 shutdown_connections 2024-08-20T01:43:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.240+0000 7f2813e81740 1 -- 172.21.15.79:0/1997230083 wait complete. 2024-08-20T01:43:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.240+0000 7f2813e81740 20 client.17415 trim_cache size 0 max 16384 2024-08-20T01:43:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:43:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:43:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:43:33.246 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:43:33.246 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.240+0000 7f2810faa640 1 -- 172.21.15.79:0/2819437627 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f27f40b3c50 msgr2=0x7f27f40b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:33.247 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.241+0000 7f2810faa640 1 --2- 172.21.15.79:0/2819437627 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f27f40b3c50 0x7f27f40b6110 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2804004af0 tx=0x7f2804004a40 comp rx=0 tx=0).stop 2024-08-20T01:43:33.247 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.241+0000 7f2810faa640 1 -- 172.21.15.79:0/2819437627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f280c101560 msgr2=0x7f280c06ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:33.247 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.241+0000 7f2810faa640 1 --2- 172.21.15.79:0/2819437627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f280c101560 0x7f280c06ade0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f27fc00e9f0 tx=0x7f27fc00edf0 comp rx=0 tx=0).stop 2024-08-20T01:43:33.247 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.241+0000 7f2810faa640 1 -- 172.21.15.79:0/2819437627 shutdown_connections 2024-08-20T01:43:33.247 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.241+0000 7f2810faa640 1 --2- 172.21.15.79:0/2819437627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f280c103070 0x7f280c1a1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:33.247 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.241+0000 7f2810faa640 1 --2- 172.21.15.79:0/2819437627 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f27f40b3c50 0x7f27f40b6110 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:33.247 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.241+0000 7f2810faa640 1 --2- 172.21.15.79:0/2819437627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f280c1026b0 0x7f280c19fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:33.247 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.241+0000 7f2810faa640 1 --2- 172.21.15.79:0/2819437627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f280c101560 0x7f280c06ade0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:33.248 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.241+0000 7f2810faa640 1 -- 172.21.15.79:0/2819437627 >> 172.21.15.79:0/2819437627 conn(0x7f280c0fce40 msgr2=0x7f280c105ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:33.248 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.241+0000 7f2810faa640 1 -- 172.21.15.79:0/2819437627 shutdown_connections 2024-08-20T01:43:33.248 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:33.241+0000 7f2810faa640 1 -- 172.21.15.79:0/2819437627 wait complete. 2024-08-20T01:43:34.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:34 smithi079 ceph-mon[18656]: pgmap v534: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 28 MiB/s wr, 46 op/s 2024-08-20T01:43:34.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:34 smithi081 ceph-mon[22209]: pgmap v534: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 28 MiB/s wr, 46 op/s 2024-08-20T01:43:34.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:34 smithi175 ceph-mon[22392]: pgmap v534: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 28 MiB/s wr, 46 op/s 2024-08-20T01:43:36.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:36 smithi079 ceph-mon[18656]: pgmap v535: 97 pgs: 97 active+clean; 9.4 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 31 MiB/s wr, 51 op/s 2024-08-20T01:43:36.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:36 smithi081 ceph-mon[22209]: pgmap v535: 97 pgs: 97 active+clean; 9.4 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 31 MiB/s wr, 51 op/s 2024-08-20T01:43:36.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:36 smithi175 ceph-mon[22392]: pgmap v535: 97 pgs: 97 active+clean; 9.4 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 31 MiB/s wr, 51 op/s 2024-08-20T01:43:38.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:38 smithi079 ceph-mon[18656]: pgmap v536: 97 pgs: 97 active+clean; 9.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 28 MiB/s wr, 47 op/s 2024-08-20T01:43:38.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:38 smithi081 ceph-mon[22209]: pgmap v536: 97 pgs: 97 active+clean; 9.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 28 MiB/s wr, 47 op/s 2024-08-20T01:43:38.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:38 smithi175 ceph-mon[22392]: pgmap v536: 97 pgs: 97 active+clean; 9.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 28 MiB/s wr, 47 op/s 2024-08-20T01:43:40.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:40 smithi079 ceph-mon[18656]: pgmap v537: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 32 MiB/s wr, 51 op/s 2024-08-20T01:43:40.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:40 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:43:40.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:40 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:43:40.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:40 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:43:40.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:40 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:43:40.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:40 smithi081 ceph-mon[22209]: pgmap v537: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 32 MiB/s wr, 51 op/s 2024-08-20T01:43:40.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:40 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:43:40.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:40 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:43:40.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:40 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:43:40.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:40 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:43:40.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:40 smithi175 ceph-mon[22392]: pgmap v537: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 32 MiB/s wr, 51 op/s 2024-08-20T01:43:40.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:40 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:43:40.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:40 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:43:40.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:40 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:43:40.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:40 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:43:42.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:42 smithi079 ceph-mon[18656]: pgmap v538: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 30 MiB/s wr, 35 op/s 2024-08-20T01:43:42.691 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:42 smithi175 ceph-mon[22392]: pgmap v538: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 30 MiB/s wr, 35 op/s 2024-08-20T01:43:42.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:42 smithi081 ceph-mon[22209]: pgmap v538: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 30 MiB/s wr, 35 op/s 2024-08-20T01:43:44.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:44 smithi079 ceph-mon[18656]: pgmap v539: 97 pgs: 97 active+clean; 9.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 29 MiB/s wr, 25 op/s 2024-08-20T01:43:44.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:44 smithi081 ceph-mon[22209]: pgmap v539: 97 pgs: 97 active+clean; 9.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 29 MiB/s wr, 25 op/s 2024-08-20T01:43:44.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:44 smithi175 ceph-mon[22392]: pgmap v539: 97 pgs: 97 active+clean; 9.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 29 MiB/s wr, 25 op/s 2024-08-20T01:43:46.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.333+0000 7f10714e7640 1 -- 172.21.15.79:0/778787767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f106c1026b0 msgr2=0x7f106c102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:46.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.333+0000 7f10714e7640 1 --2- 172.21.15.79:0/778787767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f106c1026b0 0x7f106c102b30 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f1060009930 tx=0x7f106002a420 comp rx=0 tx=0).stop 2024-08-20T01:43:46.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.334+0000 7f10714e7640 1 -- 172.21.15.79:0/778787767 shutdown_connections 2024-08-20T01:43:46.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.334+0000 7f10714e7640 1 --2- 172.21.15.79:0/778787767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f106c103070 0x7f106c1099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:46.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.334+0000 7f10714e7640 1 --2- 172.21.15.79:0/778787767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f106c1026b0 0x7f106c102b30 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:46.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.334+0000 7f10714e7640 1 --2- 172.21.15.79:0/778787767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f106c101560 0x7f106c101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:46.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.334+0000 7f10714e7640 1 -- 172.21.15.79:0/778787767 >> 172.21.15.79:0/778787767 conn(0x7f106c0fce40 msgr2=0x7f106c0ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:46.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.334+0000 7f10714e7640 1 -- 172.21.15.79:0/778787767 shutdown_connections 2024-08-20T01:43:46.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.334+0000 7f10714e7640 1 -- 172.21.15.79:0/778787767 wait complete. 2024-08-20T01:43:46.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.334+0000 7f10714e7640 1 Processor -- start 2024-08-20T01:43:46.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.334+0000 7f10714e7640 1 -- start start 2024-08-20T01:43:46.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.335+0000 7f10714e7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f106c101560 0x7f106c105320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:46.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.335+0000 7f10714e7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f106c1026b0 0x7f106c103b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:46.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.335+0000 7f10714e7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f106c103070 0x7f106c1040c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:46.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.335+0000 7f10714e7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f106c10d080 con 0x7f106c101560 2024-08-20T01:43:46.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.335+0000 7f10714e7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f106c10cf00 con 0x7f106c103070 2024-08-20T01:43:46.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.335+0000 7f10714e7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f106c10d200 con 0x7f106c1026b0 2024-08-20T01:43:46.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.335+0000 7f106affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f106c101560 0x7f106c105320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:46.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.335+0000 7f106affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f106c101560 0x7f106c105320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47672/0 (socket says 172.21.15.79:47672) 2024-08-20T01:43:46.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.335+0000 7f106affd640 1 -- 172.21.15.79:0/154519039 learned_addr learned my addr 172.21.15.79:0/154519039 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:46.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.335+0000 7f106a7fc640 1 --2- 172.21.15.79:0/154519039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f106c1026b0 0x7f106c103b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:46.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.335+0000 7f106b7fe640 1 --2- 172.21.15.79:0/154519039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f106c103070 0x7f106c1040c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:46.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.335+0000 7f106affd640 1 -- 172.21.15.79:0/154519039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f106c1026b0 msgr2=0x7f106c103b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:46.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.335+0000 7f106affd640 1 --2- 172.21.15.79:0/154519039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f106c1026b0 0x7f106c103b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:46.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.335+0000 7f106affd640 1 -- 172.21.15.79:0/154519039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f106c103070 msgr2=0x7f106c1040c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:46.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.335+0000 7f106affd640 1 --2- 172.21.15.79:0/154519039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f106c103070 0x7f106c1040c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:46.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.335+0000 7f106affd640 1 -- 172.21.15.79:0/154519039 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f106c104930 con 0x7f106c101560 2024-08-20T01:43:46.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.335+0000 7f106affd640 1 --2- 172.21.15.79:0/154519039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f106c101560 0x7f106c105320 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f105c00d950 tx=0x7f105c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:46.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.335+0000 7f1053fff640 1 -- 172.21.15.79:0/154519039 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105c017030 con 0x7f106c101560 2024-08-20T01:43:46.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.336+0000 7f10714e7640 1 -- 172.21.15.79:0/154519039 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f106c1a2a90 con 0x7f106c101560 2024-08-20T01:43:46.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.336+0000 7f1053fff640 1 -- 172.21.15.79:0/154519039 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f105c004020 con 0x7f106c101560 2024-08-20T01:43:46.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.336+0000 7f1053fff640 1 -- 172.21.15.79:0/154519039 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105c0055d0 con 0x7f106c101560 2024-08-20T01:43:46.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.336+0000 7f10714e7640 1 -- 172.21.15.79:0/154519039 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f106c1a2fb0 con 0x7f106c101560 2024-08-20T01:43:46.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.338+0000 7f10742d8740 1 Processor -- start 2024-08-20T01:43:46.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.338+0000 7f10742d8740 1 -- start start 2024-08-20T01:43:46.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.339+0000 7f10742d8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56152819d630 0x56152819fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:46.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.339+0000 7f10742d8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152819ff60 0x5615281a2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:46.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.339+0000 7f1053fff640 1 -- 172.21.15.79:0/154519039 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f105c009a30 con 0x7f106c101560 2024-08-20T01:43:46.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.339+0000 7f10742d8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615281a29a0 0x5615281a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:46.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.339+0000 7f10742d8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561528110360 con 0x5615281a29a0 2024-08-20T01:43:46.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.339+0000 7f10742d8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5615280ff860 con 0x56152819ff60 2024-08-20T01:43:46.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.339+0000 7f10742d8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5615281038a0 con 0x56152819d630 2024-08-20T01:43:46.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.339+0000 7f106a7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615281a29a0 0x5615281a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:46.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.339+0000 7f106a7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615281a29a0 0x5615281a4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47688/0 (socket says 172.21.15.79:47688) 2024-08-20T01:43:46.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.339+0000 7f106affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152819ff60 0x5615281a2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:46.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.339+0000 7f106a7fc640 1 -- 172.21.15.79:0/2634526448 learned_addr learned my addr 172.21.15.79:0/2634526448 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:46.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.339+0000 7f106b7fe640 1 --2- 172.21.15.79:0/2634526448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56152819d630 0x56152819fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:46.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.339+0000 7f106a7fc640 1 -- 172.21.15.79:0/2634526448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56152819d630 msgr2=0x56152819fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:46.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.339+0000 7f106a7fc640 1 --2- 172.21.15.79:0/2634526448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56152819d630 0x56152819fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:46.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.339+0000 7f106a7fc640 1 -- 172.21.15.79:0/2634526448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152819ff60 msgr2=0x5615281a2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:46.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.339+0000 7f106a7fc640 1 --2- 172.21.15.79:0/2634526448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152819ff60 0x5615281a2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:46.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.339+0000 7f106a7fc640 1 -- 172.21.15.79:0/2634526448 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615280a6e40 con 0x5615281a29a0 2024-08-20T01:43:46.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.339+0000 7f106a7fc640 1 --2- 172.21.15.79:0/2634526448 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615281a29a0 0x5615281a4e60 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f1060009230 tx=0x7f1060005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd9150cd285d538b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:46.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.340+0000 7f1053fff640 1 --2- 172.21.15.79:0/154519039 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f10540b3bd0 0x7f10540b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:46.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.340+0000 7f10517fa640 1 -- 172.21.15.79:0/2634526448 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1060035030 con 0x5615281a29a0 2024-08-20T01:43:46.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.340+0000 7f10517fa640 1 -- 172.21.15.79:0/2634526448 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1060040070 con 0x5615281a29a0 2024-08-20T01:43:46.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.340+0000 7f106b7fe640 1 --2- 172.21.15.79:0/154519039 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f10540b3bd0 0x7f10540b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:46.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.340+0000 7f10517fa640 1 -- 172.21.15.79:0/2634526448 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1060003830 con 0x5615281a29a0 2024-08-20T01:43:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.340+0000 7f1053fff640 1 -- 172.21.15.79:0/154519039 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f105c0e35b0 con 0x7f106c101560 2024-08-20T01:43:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.340+0000 7f106b7fe640 1 --2- 172.21.15.79:0/154519039 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f10540b3bd0 0x7f10540b6090 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1064005fd0 tx=0x7f1064009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.340+0000 7f10742d8740 1 -- 172.21.15.79:0/2634526448 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615281a29a0 msgr2=0x5615281a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.341+0000 7f10742d8740 1 --2- 172.21.15.79:0/2634526448 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615281a29a0 0x5615281a4e60 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f1060009230 tx=0x7f1060005e80 comp rx=0 tx=0).stop 2024-08-20T01:43:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.341+0000 7f10742d8740 1 -- 172.21.15.79:0/2634526448 shutdown_connections 2024-08-20T01:43:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.341+0000 7f10742d8740 1 --2- 172.21.15.79:0/2634526448 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615281a29a0 0x5615281a4e60 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.341+0000 7f10742d8740 1 --2- 172.21.15.79:0/2634526448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152819ff60 0x5615281a2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.341+0000 7f10742d8740 1 --2- 172.21.15.79:0/2634526448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56152819d630 0x56152819fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.341+0000 7f10742d8740 1 -- 172.21.15.79:0/2634526448 >> 172.21.15.79:0/2634526448 conn(0x561528198730 msgr2=0x561528199510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.341+0000 7f10742d8740 1 -- 172.21.15.79:0/2634526448 shutdown_connections 2024-08-20T01:43:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.341+0000 7f10742d8740 1 -- 172.21.15.79:0/2634526448 wait complete. 2024-08-20T01:43:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.341+0000 7f10742d8740 1 -- start start 2024-08-20T01:43:46.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.341+0000 7f10742d8740 1 Processor -- start 2024-08-20T01:43:46.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.341+0000 7f10742d8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152819d630 0x5615281a6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:46.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.341+0000 7f10742d8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56152819ff60 0x5615281a7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:46.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.341+0000 7f10742d8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615281a29a0 0x5615281a8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:46.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.341+0000 7f10742d8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561528038ab0 con 0x56152819ff60 2024-08-20T01:43:46.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.341+0000 7f10742d8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561528086780 con 0x56152819d630 2024-08-20T01:43:46.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.341+0000 7f10742d8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5615281a5920 con 0x5615281a29a0 2024-08-20T01:43:46.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.341+0000 7f10742d8740 10 client.0 _ll_register_callbacks cb 0x561527e0ea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:43:46.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.341+0000 7f106a7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56152819ff60 0x5615281a7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:46.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.341+0000 7f106a7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56152819ff60 0x5615281a7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47694/0 (socket says 172.21.15.79:47694) 2024-08-20T01:43:46.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.341+0000 7f106a7fc640 1 -- 172.21.15.79:0/3328503372 learned_addr learned my addr 172.21.15.79:0/3328503372 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:46.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.341+0000 7f106affd640 1 --2- 172.21.15.79:0/3328503372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152819d630 0x5615281a6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:46.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.342+0000 7f106b7fe640 1 --2- 172.21.15.79:0/3328503372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615281a29a0 0x5615281a8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:46.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.342+0000 7f106a7fc640 1 -- 172.21.15.79:0/3328503372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615281a29a0 msgr2=0x5615281a8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:46.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.342+0000 7f106a7fc640 1 --2- 172.21.15.79:0/3328503372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615281a29a0 0x5615281a8060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:46.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.342+0000 7f106a7fc640 1 -- 172.21.15.79:0/3328503372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152819d630 msgr2=0x5615281a6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:46.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.342+0000 7f106a7fc640 1 --2- 172.21.15.79:0/3328503372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152819d630 0x5615281a6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:46.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.342+0000 7f106a7fc640 1 -- 172.21.15.79:0/3328503372 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561527e62790 con 0x56152819ff60 2024-08-20T01:43:46.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.342+0000 7f106affd640 1 --2- 172.21.15.79:0/3328503372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152819d630 0x5615281a6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:43:46.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.342+0000 7f106a7fc640 1 --2- 172.21.15.79:0/3328503372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56152819ff60 0x5615281a7490 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f106002a940 tx=0x7f106002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0c47b26e3d3f4e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:46.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.342+0000 7f104eff5640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:43:46.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.342+0000 7f104eff5640 1 -- 172.21.15.79:0/3328503372 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1060035040 con 0x56152819ff60 2024-08-20T01:43:46.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.342+0000 7f10742d8740 1 -- 172.21.15.79:0/3328503372 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5615280aee00 con 0x56152819ff60 2024-08-20T01:43:46.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.342+0000 7f104eff5640 1 -- 172.21.15.79:0/3328503372 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f106003c440 con 0x56152819ff60 2024-08-20T01:43:46.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.342+0000 7f104eff5640 1 -- 172.21.15.79:0/3328503372 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f106003c660 con 0x56152819ff60 2024-08-20T01:43:46.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.342+0000 7f10742d8740 10 client.17427 fetch_fsmap learned FSMap version 38 2024-08-20T01:43:46.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.342+0000 7f10742d8740 1 -- 172.21.15.79:0/3328503372 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x561527edb620 con 0x56152819ff60 2024-08-20T01:43:46.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.342+0000 7f104eff5640 1 -- 172.21.15.79:0/3328503372 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5615280aee00 con 0x56152819ff60 2024-08-20T01:43:46.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.343+0000 7f104eff5640 1 -- 172.21.15.79:0/3328503372 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f106004d730 con 0x56152819ff60 2024-08-20T01:43:46.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.343+0000 7f10742d8740 10 client.17427 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:43:46.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.343+0000 7f10742d8740 10 client.17427 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:43:46.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.343+0000 7f10742d8740 20 client.17427 populate_metadata read hostname 'smithi079' 2024-08-20T01:43:46.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.343+0000 7f10742d8740 1 --2- 172.21.15.79:0/3328503372 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5615281b2290 0x5615281b4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:46.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.343+0000 7f10742d8740 4 client.17427 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:43:46.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.343+0000 7f10742d8740 1 -- 172.21.15.79:0/3328503372 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5615281122b0 con 0x5615281b2290 2024-08-20T01:43:46.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.343+0000 7f106affd640 1 --2- 172.21.15.79:0/3328503372 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5615281b2290 0x5615281b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:46.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.343+0000 7f106affd640 1 --2- 172.21.15.79:0/3328503372 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5615281b2290 0x5615281b4680 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=633d42b288d84d23 server_cookie=3bed9e6deac2d691 in_seq=0 out_seq=0 2024-08-20T01:43:46.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.343+0000 7f104eff5640 10 client.17427 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:43:46.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.344+0000 7f104eff5640 1 -- 172.21.15.79:0/3328503372 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5615281122b0 con 0x5615281b2290 2024-08-20T01:43:46.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.344+0000 7f104eff5640 10 client.17427 handle_command_reply: tid=0 2024-08-20T01:43:46.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.344+0000 7f10742d8740 1 client.17427 shutdown 2024-08-20T01:43:46.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.344+0000 7f10742d8740 1 -- 172.21.15.79:0/3328503372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56152819ff60 msgr2=0x5615281a7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:46.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.344+0000 7f10742d8740 1 --2- 172.21.15.79:0/3328503372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56152819ff60 0x5615281a7490 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f106002a940 tx=0x7f106002a420 comp rx=0 tx=0).stop 2024-08-20T01:43:46.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.344+0000 7f10742d8740 1 -- 172.21.15.79:0/3328503372 shutdown_connections 2024-08-20T01:43:46.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.344+0000 7f10742d8740 1 --2- 172.21.15.79:0/3328503372 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5615281b2290 0x5615281b4680 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:46.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.344+0000 7f10742d8740 1 --2- 172.21.15.79:0/3328503372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5615281a29a0 0x5615281a8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:46.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.344+0000 7f10742d8740 1 --2- 172.21.15.79:0/3328503372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56152819ff60 0x5615281a7490 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:46.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.344+0000 7f10742d8740 1 --2- 172.21.15.79:0/3328503372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152819d630 0x5615281a6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:46.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.344+0000 7f10742d8740 1 -- 172.21.15.79:0/3328503372 >> 172.21.15.79:0/3328503372 conn(0x561528198730 msgr2=0x561528197850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:46.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.344+0000 7f104eff5640 0 client.17427 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:43:46.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.344+0000 7f10742d8740 1 -- 172.21.15.79:0/3328503372 shutdown_connections 2024-08-20T01:43:46.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.345+0000 7f10742d8740 1 -- 172.21.15.79:0/3328503372 wait complete. 2024-08-20T01:43:46.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.345+0000 7f10742d8740 20 client.17427 trim_cache size 0 max 16384 2024-08-20T01:43:46.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.359+0000 7f10742d8740 1 Processor -- start 2024-08-20T01:43:46.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.359+0000 7f10742d8740 1 -- start start 2024-08-20T01:43:46.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.359+0000 7f10742d8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56152819d630 0x5615281a6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:46.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.359+0000 7f10742d8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152819ff60 0x5615281a7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:46.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.359+0000 7f10742d8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615281a29a0 0x561528197030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:46.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.359+0000 7f10742d8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f106c1abcc0 con 0x5615281a29a0 2024-08-20T01:43:46.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.359+0000 7f10742d8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f106c1ad800 con 0x56152819ff60 2024-08-20T01:43:46.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.359+0000 7f10742d8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f106c1ac390 con 0x56152819d630 2024-08-20T01:43:46.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.359+0000 7f106b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615281a29a0 0x561528197030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:46.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.359+0000 7f106b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615281a29a0 0x561528197030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47698/0 (socket says 172.21.15.79:47698) 2024-08-20T01:43:46.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.359+0000 7f106b7fe640 1 -- 172.21.15.79:0/1048313779 learned_addr learned my addr 172.21.15.79:0/1048313779 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:46.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.359+0000 7f106a7fc640 1 --2- 172.21.15.79:0/1048313779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152819ff60 0x5615281a7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:46.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.359+0000 7f106affd640 1 --2- 172.21.15.79:0/1048313779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56152819d630 0x5615281a6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:46.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.359+0000 7f106b7fe640 1 -- 172.21.15.79:0/1048313779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56152819d630 msgr2=0x5615281a6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:46.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.359+0000 7f106b7fe640 1 --2- 172.21.15.79:0/1048313779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56152819d630 0x5615281a6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:46.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.359+0000 7f106b7fe640 1 -- 172.21.15.79:0/1048313779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152819ff60 msgr2=0x5615281a7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:46.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.359+0000 7f106b7fe640 1 --2- 172.21.15.79:0/1048313779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152819ff60 0x5615281a7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:46.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.359+0000 7f106b7fe640 1 -- 172.21.15.79:0/1048313779 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56152819fd90 con 0x5615281a29a0 2024-08-20T01:43:46.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.360+0000 7f106b7fe640 1 --2- 172.21.15.79:0/1048313779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615281a29a0 0x561528197030 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f1064003d20 tx=0x7f1064016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa9782f6f7d41394 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:46.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.360+0000 7f1050ff9640 1 -- 172.21.15.79:0/1048313779 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1064003e10 con 0x5615281a29a0 2024-08-20T01:43:46.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.360+0000 7f1050ff9640 1 -- 172.21.15.79:0/1048313779 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f106400f480 con 0x5615281a29a0 2024-08-20T01:43:46.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.360+0000 7f1050ff9640 1 -- 172.21.15.79:0/1048313779 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106401c410 con 0x5615281a29a0 2024-08-20T01:43:46.367 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.361+0000 7f10742d8740 1 -- 172.21.15.79:0/1048313779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615281a29a0 msgr2=0x561528197030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:46.367 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.361+0000 7f10742d8740 1 --2- 172.21.15.79:0/1048313779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615281a29a0 0x561528197030 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f1064003d20 tx=0x7f1064016000 comp rx=0 tx=0).stop 2024-08-20T01:43:46.367 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.361+0000 7f10742d8740 1 -- 172.21.15.79:0/1048313779 shutdown_connections 2024-08-20T01:43:46.367 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.361+0000 7f10742d8740 1 --2- 172.21.15.79:0/1048313779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615281a29a0 0x561528197030 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:46.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.361+0000 7f10742d8740 1 --2- 172.21.15.79:0/1048313779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152819ff60 0x5615281a7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:46.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.361+0000 7f10742d8740 1 --2- 172.21.15.79:0/1048313779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56152819d630 0x5615281a6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:46.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.361+0000 7f10742d8740 1 -- 172.21.15.79:0/1048313779 >> 172.21.15.79:0/1048313779 conn(0x561528198730 msgr2=0x5615281a5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:46.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.361+0000 7f10742d8740 1 -- 172.21.15.79:0/1048313779 shutdown_connections 2024-08-20T01:43:46.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.361+0000 7f10742d8740 1 -- 172.21.15.79:0/1048313779 wait complete. 2024-08-20T01:43:46.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.361+0000 7f10742d8740 1 -- start start 2024-08-20T01:43:46.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.361+0000 7f10742d8740 1 Processor -- start 2024-08-20T01:43:46.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.361+0000 7f10742d8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56152819d630 0x5615281ab940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:46.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.361+0000 7f10742d8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56152819ff60 0x5615281abfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:46.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.361+0000 7f10742d8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615281a29a0 0x5615281acaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:46.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.361+0000 7f10742d8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f106c1ad130 con 0x56152819ff60 2024-08-20T01:43:46.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.361+0000 7f10742d8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f106c1aca60 con 0x5615281a29a0 2024-08-20T01:43:46.369 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.361+0000 7f10742d8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f106c1a9ca0 con 0x56152819d630 2024-08-20T01:43:46.369 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.361+0000 7f10742d8740 10 client.0 _ll_register_callbacks cb 0x7f105c0e9060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:43:46.369 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.362+0000 7f106a7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56152819ff60 0x5615281abfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:46.369 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.362+0000 7f106a7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56152819ff60 0x5615281abfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47714/0 (socket says 172.21.15.79:47714) 2024-08-20T01:43:46.369 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.362+0000 7f106a7fc640 1 -- 172.21.15.79:0/1022141866 learned_addr learned my addr 172.21.15.79:0/1022141866 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:46.369 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.362+0000 7f106affd640 1 --2- 172.21.15.79:0/1022141866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56152819d630 0x5615281ab940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:46.369 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.362+0000 7f106b7fe640 1 --2- 172.21.15.79:0/1022141866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615281a29a0 0x5615281acaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:46.369 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.362+0000 7f106a7fc640 1 -- 172.21.15.79:0/1022141866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56152819d630 msgr2=0x5615281ab940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:46.369 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.362+0000 7f106a7fc640 1 --2- 172.21.15.79:0/1022141866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56152819d630 0x5615281ab940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:46.369 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.362+0000 7f106a7fc640 1 -- 172.21.15.79:0/1022141866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615281a29a0 msgr2=0x5615281acaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:46.369 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.362+0000 7f106a7fc640 1 --2- 172.21.15.79:0/1022141866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615281a29a0 0x5615281acaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.362+0000 7f106a7fc640 1 -- 172.21.15.79:0/1022141866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615281ad2d0 con 0x56152819ff60 2024-08-20T01:43:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.362+0000 7f106a7fc640 1 --2- 172.21.15.79:0/1022141866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56152819ff60 0x5615281abfe0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f106004db50 tx=0x7f106002aae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=769df55a9e37fd93 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.362+0000 7f104eff5640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:43:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.362+0000 7f104eff5640 1 -- 172.21.15.79:0/1022141866 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1060035070 con 0x56152819ff60 2024-08-20T01:43:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.362+0000 7f104eff5640 1 -- 172.21.15.79:0/1022141866 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f1060004450 con 0x56152819ff60 2024-08-20T01:43:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.362+0000 7f10742d8740 1 -- 172.21.15.79:0/1022141866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f106400f480 con 0x56152819ff60 2024-08-20T01:43:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.362+0000 7f104eff5640 1 -- 172.21.15.79:0/1022141866 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f106005c070 con 0x56152819ff60 2024-08-20T01:43:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.362+0000 7f10742d8740 10 client.17433 fetch_fsmap learned FSMap version 38 2024-08-20T01:43:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.362+0000 7f10742d8740 1 -- 172.21.15.79:0/1022141866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5615281ae640 con 0x56152819ff60 2024-08-20T01:43:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.363+0000 7f104eff5640 1 -- 172.21.15.79:0/1022141866 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f106400f480 con 0x56152819ff60 2024-08-20T01:43:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.363+0000 7f104eff5640 1 -- 172.21.15.79:0/1022141866 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f106003cb70 con 0x56152819ff60 2024-08-20T01:43:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.363+0000 7f10742d8740 10 client.17433 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:43:46.371 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.363+0000 7f10742d8740 10 client.17433 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:43:46.371 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.363+0000 7f10742d8740 20 client.17433 populate_metadata read hostname 'smithi079' 2024-08-20T01:43:46.371 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.363+0000 7f10742d8740 1 --2- 172.21.15.79:0/1022141866 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56152821cf20 0x56152821f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:46.371 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.363+0000 7f10742d8740 4 client.17433 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:43:46.371 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.363+0000 7f10742d8740 1 -- 172.21.15.79:0/1022141866 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56152810dd50 con 0x56152821cf20 2024-08-20T01:43:46.371 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.363+0000 7f106affd640 1 --2- 172.21.15.79:0/1022141866 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56152821cf20 0x56152821f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:46.371 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.363+0000 7f104eff5640 10 client.17433 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:43:46.371 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.363+0000 7f106affd640 1 --2- 172.21.15.79:0/1022141866 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56152821cf20 0x56152821f310 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12980bd72e02c5df server_cookie=c17f1589f6c4ed36 in_seq=0 out_seq=0 2024-08-20T01:43:46.374 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.371+0000 7f104eff5640 1 -- 172.21.15.79:0/1022141866 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56152810dd50 con 0x56152821cf20 2024-08-20T01:43:46.374 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.371+0000 7f104eff5640 10 client.17433 handle_command_reply: tid=0 2024-08-20T01:43:46.374 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.371+0000 7f10742d8740 1 client.17433 shutdown 2024-08-20T01:43:46.374 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.371+0000 7f10742d8740 1 -- 172.21.15.79:0/1022141866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56152819ff60 msgr2=0x5615281abfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:46.374 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.371+0000 7f10742d8740 1 --2- 172.21.15.79:0/1022141866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56152819ff60 0x5615281abfe0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f106004db50 tx=0x7f106002aae0 comp rx=0 tx=0).stop 2024-08-20T01:43:46.374 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.371+0000 7f10742d8740 1 -- 172.21.15.79:0/1022141866 shutdown_connections 2024-08-20T01:43:46.374 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.371+0000 7f10742d8740 1 --2- 172.21.15.79:0/1022141866 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56152821cf20 0x56152821f310 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:46.374 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.371+0000 7f10742d8740 1 --2- 172.21.15.79:0/1022141866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615281a29a0 0x5615281acaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:46.374 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.371+0000 7f10742d8740 1 --2- 172.21.15.79:0/1022141866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56152819ff60 0x5615281abfe0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:46.374 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.371+0000 7f10742d8740 1 --2- 172.21.15.79:0/1022141866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56152819d630 0x5615281ab940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:46.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.371+0000 7f10742d8740 1 -- 172.21.15.79:0/1022141866 >> 172.21.15.79:0/1022141866 conn(0x561528198730 msgr2=0x561528197030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:46.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.371+0000 7f104eff5640 0 client.17433 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:43:46.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.371+0000 7f10742d8740 1 -- 172.21.15.79:0/1022141866 shutdown_connections 2024-08-20T01:43:46.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.371+0000 7f10742d8740 1 -- 172.21.15.79:0/1022141866 wait complete. 2024-08-20T01:43:46.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.371+0000 7f10742d8740 20 client.17433 trim_cache size 0 max 16384 2024-08-20T01:43:46.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:43:46.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:43:46.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:43:46.375 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:43:46.376 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.372+0000 7f10714e7640 1 -- 172.21.15.79:0/154519039 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f10540b3bd0 msgr2=0x7f10540b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:46.376 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.372+0000 7f10714e7640 1 --2- 172.21.15.79:0/154519039 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f10540b3bd0 0x7f10540b6090 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1064005fd0 tx=0x7f1064009500 comp rx=0 tx=0).stop 2024-08-20T01:43:46.376 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.372+0000 7f10714e7640 1 -- 172.21.15.79:0/154519039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f106c101560 msgr2=0x7f106c105320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:46.377 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.372+0000 7f10714e7640 1 --2- 172.21.15.79:0/154519039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f106c101560 0x7f106c105320 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f105c00d950 tx=0x7f105c00de10 comp rx=0 tx=0).stop 2024-08-20T01:43:46.377 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.372+0000 7f10714e7640 1 -- 172.21.15.79:0/154519039 shutdown_connections 2024-08-20T01:43:46.377 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.372+0000 7f10714e7640 1 --2- 172.21.15.79:0/154519039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f106c103070 0x7f106c1040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:46.377 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.372+0000 7f10714e7640 1 --2- 172.21.15.79:0/154519039 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f10540b3bd0 0x7f10540b6090 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:46.377 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.372+0000 7f10714e7640 1 --2- 172.21.15.79:0/154519039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f106c1026b0 0x7f106c103b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:46.377 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.372+0000 7f10714e7640 1 --2- 172.21.15.79:0/154519039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f106c101560 0x7f106c105320 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:46.377 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.372+0000 7f10714e7640 1 -- 172.21.15.79:0/154519039 >> 172.21.15.79:0/154519039 conn(0x7f106c0fce40 msgr2=0x7f106c0fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:46.377 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.372+0000 7f10714e7640 1 -- 172.21.15.79:0/154519039 shutdown_connections 2024-08-20T01:43:46.377 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:46.372+0000 7f10714e7640 1 -- 172.21.15.79:0/154519039 wait complete. 2024-08-20T01:43:46.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:46 smithi079 ceph-mon[18656]: pgmap v540: 97 pgs: 97 active+clean; 9.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 30 MiB/s wr, 26 op/s 2024-08-20T01:43:46.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:46 smithi081 ceph-mon[22209]: pgmap v540: 97 pgs: 97 active+clean; 9.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 30 MiB/s wr, 26 op/s 2024-08-20T01:43:46.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:46 smithi175 ceph-mon[22392]: pgmap v540: 97 pgs: 97 active+clean; 9.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 30 MiB/s wr, 26 op/s 2024-08-20T01:43:48.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:48 smithi079 ceph-mon[18656]: pgmap v541: 97 pgs: 97 active+clean; 9.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-08-20T01:43:48.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:48 smithi081 ceph-mon[22209]: pgmap v541: 97 pgs: 97 active+clean; 9.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-08-20T01:43:48.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:48 smithi175 ceph-mon[22392]: pgmap v541: 97 pgs: 97 active+clean; 9.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-08-20T01:43:50.686 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:50 smithi079 ceph-mon[18656]: pgmap v542: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 32 MiB/s wr, 26 op/s 2024-08-20T01:43:50.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:50 smithi081 ceph-mon[22209]: pgmap v542: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 32 MiB/s wr, 26 op/s 2024-08-20T01:43:50.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:50 smithi175 ceph-mon[22392]: pgmap v542: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 32 MiB/s wr, 26 op/s 2024-08-20T01:43:52.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:52 smithi079 ceph-mon[18656]: pgmap v543: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-08-20T01:43:52.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:52 smithi081 ceph-mon[22209]: pgmap v543: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-08-20T01:43:52.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:52 smithi175 ceph-mon[22392]: pgmap v543: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-08-20T01:43:54.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:54 smithi081 ceph-mon[22209]: pgmap v544: 97 pgs: 97 active+clean; 9.9 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 29 MiB/s wr, 23 op/s 2024-08-20T01:43:54.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:54 smithi175 ceph-mon[22392]: pgmap v544: 97 pgs: 97 active+clean; 9.9 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 29 MiB/s wr, 23 op/s 2024-08-20T01:43:54.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:54 smithi079 ceph-mon[18656]: pgmap v544: 97 pgs: 97 active+clean; 9.9 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 29 MiB/s wr, 23 op/s 2024-08-20T01:43:56.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:56 smithi081 ceph-mon[22209]: pgmap v545: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 32 MiB/s wr, 27 op/s 2024-08-20T01:43:56.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:56 smithi175 ceph-mon[22392]: pgmap v545: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 32 MiB/s wr, 27 op/s 2024-08-20T01:43:56.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:56 smithi079 ceph-mon[18656]: pgmap v545: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 32 MiB/s wr, 27 op/s 2024-08-20T01:43:58.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:43:58 smithi081 ceph-mon[22209]: pgmap v546: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 25 op/s 2024-08-20T01:43:58.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:43:58 smithi175 ceph-mon[22392]: pgmap v546: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 25 op/s 2024-08-20T01:43:58.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:43:58 smithi079 ceph-mon[18656]: pgmap v546: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 25 op/s 2024-08-20T01:43:59.021 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:43:59.309 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:43:59.468 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.465+0000 7fa9d4ea8640 1 -- 172.21.15.79:0/2591708425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9d01026b0 msgr2=0x7fa9d0102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:59.468 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.465+0000 7fa9d4ea8640 1 --2- 172.21.15.79:0/2591708425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9d01026b0 0x7fa9d0102b30 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4009930 tx=0x7fa9c402a420 comp rx=0 tx=0).stop 2024-08-20T01:43:59.468 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.465+0000 7fa9d4ea8640 1 -- 172.21.15.79:0/2591708425 shutdown_connections 2024-08-20T01:43:59.468 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.465+0000 7fa9d4ea8640 1 --2- 172.21.15.79:0/2591708425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9d0103070 0x7fa9d01099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.468 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.465+0000 7fa9d4ea8640 1 --2- 172.21.15.79:0/2591708425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9d01026b0 0x7fa9d0102b30 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.468 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.465+0000 7fa9d4ea8640 1 --2- 172.21.15.79:0/2591708425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9d0101560 0x7fa9d0101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.468 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.465+0000 7fa9d4ea8640 1 -- 172.21.15.79:0/2591708425 >> 172.21.15.79:0/2591708425 conn(0x7fa9d00fce40 msgr2=0x7fa9d00ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:59.468 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.465+0000 7fa9d4ea8640 1 -- 172.21.15.79:0/2591708425 shutdown_connections 2024-08-20T01:43:59.468 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.465+0000 7fa9d4ea8640 1 -- 172.21.15.79:0/2591708425 wait complete. 2024-08-20T01:43:59.471 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.466+0000 7fa9d4ea8640 1 Processor -- start 2024-08-20T01:43:59.471 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.466+0000 7fa9d4ea8640 1 -- start start 2024-08-20T01:43:59.471 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.466+0000 7fa9d4ea8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9d0101560 0x7fa9d0198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:59.471 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.466+0000 7fa9d4ea8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9d01026b0 0x7fa9d0198fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:59.471 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.466+0000 7fa9cdd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9d01026b0 0x7fa9d0198fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:59.471 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.466+0000 7fa9cdd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9d01026b0 0x7fa9d0198fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40250/0 (socket says 172.21.15.79:40250) 2024-08-20T01:43:59.471 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.466+0000 7fa9cdd9b640 1 -- 172.21.15.79:0/372861747 learned_addr learned my addr 172.21.15.79:0/372861747 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:59.471 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.466+0000 7fa9ce59c640 1 --2- 172.21.15.79:0/372861747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9d0101560 0x7fa9d0198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:59.471 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.466+0000 7fa9d4ea8640 1 --2- 172.21.15.79:0/372861747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9d0103070 0x7fa9d0199c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:59.471 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.466+0000 7fa9d4ea8640 1 -- 172.21.15.79:0/372861747 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d010d0b0 con 0x7fa9d01026b0 2024-08-20T01:43:59.471 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.466+0000 7fa9d4ea8640 1 -- 172.21.15.79:0/372861747 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d010cf30 con 0x7fa9d0103070 2024-08-20T01:43:59.472 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.466+0000 7fa9d4ea8640 1 -- 172.21.15.79:0/372861747 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d010d230 con 0x7fa9d0101560 2024-08-20T01:43:59.472 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.467+0000 7fa9cdd9b640 1 -- 172.21.15.79:0/372861747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9d0101560 msgr2=0x7fa9d0198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:59.472 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.467+0000 7fa9cdd9b640 1 --2- 172.21.15.79:0/372861747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9d0101560 0x7fa9d0198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.472 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.467+0000 7fa9ced9d640 1 --2- 172.21.15.79:0/372861747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9d0103070 0x7fa9d0199c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:59.472 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.467+0000 7fa9cdd9b640 1 -- 172.21.15.79:0/372861747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9d0103070 msgr2=0x7fa9d0199c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:59.472 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.467+0000 7fa9cdd9b640 1 --2- 172.21.15.79:0/372861747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9d0103070 0x7fa9d0199c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.472 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.467+0000 7fa9cdd9b640 1 -- 172.21.15.79:0/372861747 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9d019a4c0 con 0x7fa9d01026b0 2024-08-20T01:43:59.472 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.467+0000 7fa9ced9d640 1 --2- 172.21.15.79:0/372861747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9d0103070 0x7fa9d0199c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:43:59.472 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.467+0000 7fa9cdd9b640 1 --2- 172.21.15.79:0/372861747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9d01026b0 0x7fa9d0198fd0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4031460 tx=0x7fa9c4003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:59.473 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.467+0000 7fa9bf7fe640 1 -- 172.21.15.79:0/372861747 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c403f070 con 0x7fa9d01026b0 2024-08-20T01:43:59.473 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.467+0000 7fa9d4ea8640 1 -- 172.21.15.79:0/372861747 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9d019a750 con 0x7fa9d01026b0 2024-08-20T01:43:59.473 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.467+0000 7fa9bf7fe640 1 -- 172.21.15.79:0/372861747 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa9c4031da0 con 0x7fa9d01026b0 2024-08-20T01:43:59.473 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.467+0000 7fa9d4ea8640 1 -- 172.21.15.79:0/372861747 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9d01a0e80 con 0x7fa9d01026b0 2024-08-20T01:43:59.473 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.467+0000 7fa9bf7fe640 1 -- 172.21.15.79:0/372861747 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c4035030 con 0x7fa9d01026b0 2024-08-20T01:43:59.480 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.470+0000 7fa9d7c9b740 1 Processor -- start 2024-08-20T01:43:59.480 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.471+0000 7fa9d7c9b740 1 -- start start 2024-08-20T01:43:59.480 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.471+0000 7fa9d7c9b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609339968d0 0x560933998cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:59.480 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.471+0000 7fa9d7c9b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560933999200 0x56093399b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:59.480 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.471+0000 7fa9d7c9b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56093399bc40 0x56093399e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:59.480 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.471+0000 7fa9d7c9b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560933909360 con 0x56093399bc40 2024-08-20T01:43:59.480 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.471+0000 7fa9d7c9b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5609338f8860 con 0x5609339968d0 2024-08-20T01:43:59.480 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.471+0000 7fa9d7c9b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5609338fc8a0 con 0x560933999200 2024-08-20T01:43:59.481 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.471+0000 7fa9bf7fe640 1 -- 172.21.15.79:0/372861747 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa9c4042070 con 0x7fa9d01026b0 2024-08-20T01:43:59.481 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.471+0000 7fa9ced9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609339968d0 0x560933998cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:59.481 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.471+0000 7fa9ced9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609339968d0 0x560933998cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:34054/0 (socket says 172.21.15.79:34054) 2024-08-20T01:43:59.481 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.471+0000 7fa9ced9d640 1 -- 172.21.15.79:0/1947600377 learned_addr learned my addr 172.21.15.79:0/1947600377 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:59.481 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.471+0000 7fa9ce59c640 1 --2- 172.21.15.79:0/1947600377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560933999200 0x56093399b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:59.481 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.471+0000 7fa9cdd9b640 1 --2- 172.21.15.79:0/1947600377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56093399bc40 0x56093399e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:59.481 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.471+0000 7fa9ced9d640 1 -- 172.21.15.79:0/1947600377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560933999200 msgr2=0x56093399b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:59.481 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.472+0000 7fa9ced9d640 1 --2- 172.21.15.79:0/1947600377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560933999200 0x56093399b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.481 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.472+0000 7fa9ced9d640 1 -- 172.21.15.79:0/1947600377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56093399bc40 msgr2=0x56093399e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:59.481 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.472+0000 7fa9ced9d640 1 --2- 172.21.15.79:0/1947600377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56093399bc40 0x56093399e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.481 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.472+0000 7fa9ced9d640 1 -- 172.21.15.79:0/1947600377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56093389fe40 con 0x5609339968d0 2024-08-20T01:43:59.482 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.472+0000 7fa9ce59c640 1 --2- 172.21.15.79:0/1947600377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560933999200 0x56093399b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:43:59.482 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.472+0000 7fa9cdd9b640 1 --2- 172.21.15.79:0/1947600377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56093399bc40 0x56093399e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:43:59.482 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.472+0000 7fa9ced9d640 1 --2- 172.21.15.79:0/1947600377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609339968d0 0x560933998cc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8008e30 tx=0x7fa9c800d710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8c10ed812698cba server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:59.482 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.472+0000 7fa9bcff9640 1 -- 172.21.15.79:0/1947600377 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c800f830 con 0x5609339968d0 2024-08-20T01:43:59.482 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.472+0000 7fa9bcff9640 1 -- 172.21.15.79:0/1947600377 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa9c8018480 con 0x5609339968d0 2024-08-20T01:43:59.482 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.472+0000 7fa9bcff9640 1 -- 172.21.15.79:0/1947600377 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c800fe60 con 0x5609339968d0 2024-08-20T01:43:59.482 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.472+0000 7fa9bf7fe640 1 --2- 172.21.15.79:0/372861747 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa9b80b3bd0 0x7fa9b80b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:59.482 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.472+0000 7fa9ce59c640 1 --2- 172.21.15.79:0/372861747 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa9b80b3bd0 0x7fa9b80b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:59.482 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.473+0000 7fa9bf7fe640 1 -- 172.21.15.79:0/372861747 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fa9c41044b0 con 0x7fa9d01026b0 2024-08-20T01:43:59.483 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.473+0000 7fa9d7c9b740 1 -- 172.21.15.79:0/1947600377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609339968d0 msgr2=0x560933998cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:59.484 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.473+0000 7fa9d7c9b740 1 --2- 172.21.15.79:0/1947600377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609339968d0 0x560933998cc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8008e30 tx=0x7fa9c800d710 comp rx=0 tx=0).stop 2024-08-20T01:43:59.484 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.473+0000 7fa9d7c9b740 1 -- 172.21.15.79:0/1947600377 shutdown_connections 2024-08-20T01:43:59.484 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.473+0000 7fa9d7c9b740 1 --2- 172.21.15.79:0/1947600377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56093399bc40 0x56093399e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.484 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.473+0000 7fa9d7c9b740 1 --2- 172.21.15.79:0/1947600377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560933999200 0x56093399b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.484 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.473+0000 7fa9ce59c640 1 --2- 172.21.15.79:0/372861747 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa9b80b3bd0 0x7fa9b80b6090 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa9c000b7c0 tx=0x7fa9c000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:59.484 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.473+0000 7fa9d7c9b740 1 --2- 172.21.15.79:0/1947600377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609339968d0 0x560933998cc0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.484 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.473+0000 7fa9d7c9b740 1 -- 172.21.15.79:0/1947600377 >> 172.21.15.79:0/1947600377 conn(0x560933991a20 msgr2=0x5609339927b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:59.484 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.473+0000 7fa9d7c9b740 1 -- 172.21.15.79:0/1947600377 shutdown_connections 2024-08-20T01:43:59.484 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.473+0000 7fa9d7c9b740 1 -- 172.21.15.79:0/1947600377 wait complete. 2024-08-20T01:43:59.484 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.473+0000 7fa9d7c9b740 1 -- start start 2024-08-20T01:43:59.485 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.473+0000 7fa9d7c9b740 1 Processor -- start 2024-08-20T01:43:59.485 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.474+0000 7fa9d7c9b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609339968d0 0x5609339a0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:59.485 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.474+0000 7fa9d7c9b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560933999200 0x5609339a07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:59.485 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.474+0000 7fa9d7c9b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56093399bc40 0x5609339a1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:59.485 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.474+0000 7fa9d7c9b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560933831ab0 con 0x56093399bc40 2024-08-20T01:43:59.485 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.474+0000 7fa9d7c9b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56093387f780 con 0x5609339968d0 2024-08-20T01:43:59.485 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.474+0000 7fa9d7c9b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56093399ec20 con 0x560933999200 2024-08-20T01:43:59.485 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.474+0000 7fa9d7c9b740 10 client.0 _ll_register_callbacks cb 0x560933607a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:43:59.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.474+0000 7fa9ced9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56093399bc40 0x5609339a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:59.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.474+0000 7fa9ced9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56093399bc40 0x5609339a1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40280/0 (socket says 172.21.15.79:40280) 2024-08-20T01:43:59.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.474+0000 7fa9ced9d640 1 -- 172.21.15.79:0/173980377 learned_addr learned my addr 172.21.15.79:0/173980377 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:59.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.474+0000 7fa9ce59c640 1 --2- 172.21.15.79:0/173980377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609339968d0 0x5609339a0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:59.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.474+0000 7fa9cdd9b640 1 --2- 172.21.15.79:0/173980377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560933999200 0x5609339a07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:59.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.474+0000 7fa9ced9d640 1 -- 172.21.15.79:0/173980377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560933999200 msgr2=0x5609339a07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:59.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.474+0000 7fa9ced9d640 1 --2- 172.21.15.79:0/173980377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560933999200 0x5609339a07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.474+0000 7fa9ced9d640 1 -- 172.21.15.79:0/173980377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609339968d0 msgr2=0x5609339a0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:59.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.474+0000 7fa9ced9d640 1 --2- 172.21.15.79:0/173980377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609339968d0 0x5609339a0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.474+0000 7fa9ced9d640 1 -- 172.21.15.79:0/173980377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56093365b790 con 0x56093399bc40 2024-08-20T01:43:59.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.474+0000 7fa9ce59c640 1 --2- 172.21.15.79:0/173980377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609339968d0 0x5609339a0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:43:59.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.474+0000 7fa9ced9d640 1 --2- 172.21.15.79:0/173980377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56093399bc40 0x5609339a1390 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8006010 tx=0x7fa9c8008b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b96389b386501ef server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:59.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.474+0000 7fa9b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:43:59.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.475+0000 7fa9b5ffb640 1 -- 172.21.15.79:0/173980377 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c8004e50 con 0x56093399bc40 2024-08-20T01:43:59.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.475+0000 7fa9b5ffb640 1 -- 172.21.15.79:0/173980377 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fa9c800f630 con 0x56093399bc40 2024-08-20T01:43:59.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.475+0000 7fa9d7c9b740 1 -- 172.21.15.79:0/173980377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5609338a7e00 con 0x56093399bc40 2024-08-20T01:43:59.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.475+0000 7fa9b5ffb640 1 -- 172.21.15.79:0/173980377 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fa9c800f830 con 0x56093399bc40 2024-08-20T01:43:59.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.475+0000 7fa9d7c9b740 10 client.17445 fetch_fsmap learned FSMap version 38 2024-08-20T01:43:59.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.475+0000 7fa9d7c9b740 1 -- 172.21.15.79:0/173980377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5609336d4620 con 0x56093399bc40 2024-08-20T01:43:59.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.475+0000 7fa9b5ffb640 1 -- 172.21.15.79:0/173980377 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5609338a7e00 con 0x56093399bc40 2024-08-20T01:43:59.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.475+0000 7fa9b5ffb640 1 -- 172.21.15.79:0/173980377 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7fa9c8029030 con 0x56093399bc40 2024-08-20T01:43:59.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.475+0000 7fa9d7c9b740 10 client.17445 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:43:59.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.475+0000 7fa9d7c9b740 10 client.17445 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:43:59.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.475+0000 7fa9d7c9b740 20 client.17445 populate_metadata read hostname 'smithi079' 2024-08-20T01:43:59.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.475+0000 7fa9d7c9b740 1 --2- 172.21.15.79:0/173980377 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5609339ab720 0x5609339adb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:59.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.475+0000 7fa9d7c9b740 4 client.17445 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:43:59.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.475+0000 7fa9d7c9b740 1 -- 172.21.15.79:0/173980377 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56093390b2b0 con 0x5609339ab720 2024-08-20T01:43:59.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.475+0000 7fa9ce59c640 1 --2- 172.21.15.79:0/173980377 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5609339ab720 0x5609339adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:59.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.476+0000 7fa9b5ffb640 10 client.17445 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:43:59.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.476+0000 7fa9ce59c640 1 --2- 172.21.15.79:0/173980377 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5609339ab720 0x5609339adb10 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbd2b0245b0c452 server_cookie=7c4efb5c5976c5fe in_seq=0 out_seq=0 2024-08-20T01:43:59.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.476+0000 7fa9b5ffb640 1 -- 172.21.15.79:0/173980377 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56093390b2b0 con 0x5609339ab720 2024-08-20T01:43:59.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.476+0000 7fa9b5ffb640 10 client.17445 handle_command_reply: tid=0 2024-08-20T01:43:59.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.477+0000 7fa9d7c9b740 1 client.17445 shutdown 2024-08-20T01:43:59.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.477+0000 7fa9d7c9b740 1 -- 172.21.15.79:0/173980377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56093399bc40 msgr2=0x5609339a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:59.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.477+0000 7fa9d7c9b740 1 --2- 172.21.15.79:0/173980377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56093399bc40 0x5609339a1390 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8006010 tx=0x7fa9c8008b70 comp rx=0 tx=0).stop 2024-08-20T01:43:59.489 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.477+0000 7fa9d7c9b740 1 -- 172.21.15.79:0/173980377 shutdown_connections 2024-08-20T01:43:59.489 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.477+0000 7fa9d7c9b740 1 --2- 172.21.15.79:0/173980377 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5609339ab720 0x5609339adb10 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.489 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.477+0000 7fa9b5ffb640 0 client.17445 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:43:59.489 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.477+0000 7fa9d7c9b740 1 --2- 172.21.15.79:0/173980377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56093399bc40 0x5609339a1390 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.489 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.477+0000 7fa9d7c9b740 1 --2- 172.21.15.79:0/173980377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560933999200 0x5609339a07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.489 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.477+0000 7fa9d7c9b740 1 --2- 172.21.15.79:0/173980377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609339968d0 0x5609339a0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.489 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.477+0000 7fa9d7c9b740 1 -- 172.21.15.79:0/173980377 >> 172.21.15.79:0/173980377 conn(0x560933991a20 msgr2=0x560933990ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:59.489 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.477+0000 7fa9d7c9b740 1 -- 172.21.15.79:0/173980377 shutdown_connections 2024-08-20T01:43:59.489 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.477+0000 7fa9d7c9b740 1 -- 172.21.15.79:0/173980377 wait complete. 2024-08-20T01:43:59.489 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.477+0000 7fa9d7c9b740 20 client.17445 trim_cache size 0 max 16384 2024-08-20T01:43:59.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.496+0000 7fa9d7c9b740 1 Processor -- start 2024-08-20T01:43:59.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.496+0000 7fa9d7c9b740 1 -- start start 2024-08-20T01:43:59.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.496+0000 7fa9d7c9b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609339968d0 0x56093399f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:59.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.496+0000 7fa9d7c9b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560933999200 0x5609339909d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:59.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.496+0000 7fa9d7c9b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56093399bc40 0x5609339b2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:59.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.496+0000 7fa9d7c9b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d01a9a60 con 0x56093399bc40 2024-08-20T01:43:59.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.496+0000 7fa9d7c9b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d01ab5a0 con 0x560933999200 2024-08-20T01:43:59.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.496+0000 7fa9d7c9b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d01aa130 con 0x5609339968d0 2024-08-20T01:43:59.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.496+0000 7fa9ced9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56093399bc40 0x5609339b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:59.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.496+0000 7fa9ced9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56093399bc40 0x5609339b2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40282/0 (socket says 172.21.15.79:40282) 2024-08-20T01:43:59.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.496+0000 7fa9ced9d640 1 -- 172.21.15.79:0/660324821 learned_addr learned my addr 172.21.15.79:0/660324821 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:59.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.496+0000 7fa9ce59c640 1 --2- 172.21.15.79:0/660324821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609339968d0 0x56093399f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:59.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.496+0000 7fa9cdd9b640 1 --2- 172.21.15.79:0/660324821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560933999200 0x5609339909d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:59.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.496+0000 7fa9ced9d640 1 -- 172.21.15.79:0/660324821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609339968d0 msgr2=0x56093399f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:59.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.496+0000 7fa9ced9d640 1 --2- 172.21.15.79:0/660324821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609339968d0 0x56093399f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.496+0000 7fa9ced9d640 1 -- 172.21.15.79:0/660324821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560933999200 msgr2=0x5609339909d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:59.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.496+0000 7fa9ced9d640 1 --2- 172.21.15.79:0/660324821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560933999200 0x5609339909d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.496+0000 7fa9ced9d640 1 -- 172.21.15.79:0/660324821 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560933999030 con 0x56093399bc40 2024-08-20T01:43:59.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.496+0000 7fa9cdd9b640 1 --2- 172.21.15.79:0/660324821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560933999200 0x5609339909d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:43:59.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.497+0000 7fa9ced9d640 1 --2- 172.21.15.79:0/660324821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56093399bc40 0x5609339b2300 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8008d50 tx=0x7fa9c800f7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dccadf70a2fedca2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:59.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.497+0000 7fa9b7fff640 1 -- 172.21.15.79:0/660324821 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c8008550 con 0x56093399bc40 2024-08-20T01:43:59.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.497+0000 7fa9b7fff640 1 -- 172.21.15.79:0/660324821 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa9c80058c0 con 0x56093399bc40 2024-08-20T01:43:59.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.497+0000 7fa9b7fff640 1 -- 172.21.15.79:0/660324821 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c8004eb0 con 0x56093399bc40 2024-08-20T01:43:59.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.498+0000 7fa9d7c9b740 1 -- 172.21.15.79:0/660324821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56093399bc40 msgr2=0x5609339b2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:59.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.498+0000 7fa9d7c9b740 1 --2- 172.21.15.79:0/660324821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56093399bc40 0x5609339b2300 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8008d50 tx=0x7fa9c800f7c0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.498+0000 7fa9d7c9b740 1 -- 172.21.15.79:0/660324821 shutdown_connections 2024-08-20T01:43:59.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.498+0000 7fa9d7c9b740 1 --2- 172.21.15.79:0/660324821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56093399bc40 0x5609339b2300 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.498+0000 7fa9d7c9b740 1 --2- 172.21.15.79:0/660324821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560933999200 0x5609339909d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.498+0000 7fa9d7c9b740 1 --2- 172.21.15.79:0/660324821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609339968d0 0x56093399f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.505 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.498+0000 7fa9d7c9b740 1 -- 172.21.15.79:0/660324821 >> 172.21.15.79:0/660324821 conn(0x560933991a20 msgr2=0x5609339902c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:59.505 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.498+0000 7fa9d7c9b740 1 -- 172.21.15.79:0/660324821 shutdown_connections 2024-08-20T01:43:59.505 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.498+0000 7fa9d7c9b740 1 -- 172.21.15.79:0/660324821 wait complete. 2024-08-20T01:43:59.505 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.498+0000 7fa9d7c9b740 1 -- start start 2024-08-20T01:43:59.505 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.498+0000 7fa9d7c9b740 1 Processor -- start 2024-08-20T01:43:59.505 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.498+0000 7fa9d7c9b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609339968d0 0x5609339a7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:59.505 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.498+0000 7fa9d7c9b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560933999200 0x5609339a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:59.505 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.498+0000 7fa9d7c9b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56093399bc40 0x5609339a6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:59.505 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.498+0000 7fa9d7c9b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d01aaed0 con 0x56093399bc40 2024-08-20T01:43:59.505 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.498+0000 7fa9d7c9b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d01aa800 con 0x560933999200 2024-08-20T01:43:59.505 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.498+0000 7fa9d7c9b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d01a7a40 con 0x5609339968d0 2024-08-20T01:43:59.505 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.498+0000 7fa9ced9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56093399bc40 0x5609339a6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:59.505 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.498+0000 7fa9d7c9b740 10 client.0 _ll_register_callbacks cb 0x7fa9c8008c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:43:59.506 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.498+0000 7fa9cdd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560933999200 0x5609339a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:59.506 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.498+0000 7fa9ced9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56093399bc40 0x5609339a6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40284/0 (socket says 172.21.15.79:40284) 2024-08-20T01:43:59.506 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.499+0000 7fa9ced9d640 1 -- 172.21.15.79:0/745297166 learned_addr learned my addr 172.21.15.79:0/745297166 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:59.506 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.499+0000 7fa9ce59c640 1 --2- 172.21.15.79:0/745297166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609339968d0 0x5609339a7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:59.506 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.499+0000 7fa9ced9d640 1 -- 172.21.15.79:0/745297166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609339968d0 msgr2=0x5609339a7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:59.506 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.499+0000 7fa9ced9d640 1 --2- 172.21.15.79:0/745297166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609339968d0 0x5609339a7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.506 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.499+0000 7fa9ced9d640 1 -- 172.21.15.79:0/745297166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560933999200 msgr2=0x5609339a6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:59.506 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.499+0000 7fa9ced9d640 1 --2- 172.21.15.79:0/745297166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560933999200 0x5609339a6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.506 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.499+0000 7fa9ced9d640 1 -- 172.21.15.79:0/745297166 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609339a0b30 con 0x56093399bc40 2024-08-20T01:43:59.506 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.499+0000 7fa9ced9d640 1 --2- 172.21.15.79:0/745297166 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56093399bc40 0x5609339a6db0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8005650 tx=0x7fa9c8019fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a47a9593c5fc6d0a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:59.506 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.499+0000 7fa9b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:43:59.506 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.499+0000 7fa9b5ffb640 1 -- 172.21.15.79:0/745297166 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c800fde0 con 0x56093399bc40 2024-08-20T01:43:59.507 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.499+0000 7fa9b5ffb640 1 -- 172.21.15.79:0/745297166 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fa9c8004c50 con 0x56093399bc40 2024-08-20T01:43:59.507 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.499+0000 7fa9d7c9b740 1 -- 172.21.15.79:0/745297166 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9c80058c0 con 0x56093399bc40 2024-08-20T01:43:59.507 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.499+0000 7fa9b5ffb640 1 -- 172.21.15.79:0/745297166 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fa9c8018920 con 0x56093399bc40 2024-08-20T01:43:59.507 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.499+0000 7fa9d7c9b740 10 client.17451 fetch_fsmap learned FSMap version 38 2024-08-20T01:43:59.507 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.499+0000 7fa9d7c9b740 1 -- 172.21.15.79:0/745297166 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5609339a6190 con 0x56093399bc40 2024-08-20T01:43:59.507 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.500+0000 7fa9b5ffb640 1 -- 172.21.15.79:0/745297166 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa9c80058c0 con 0x56093399bc40 2024-08-20T01:43:59.507 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.500+0000 7fa9b5ffb640 1 -- 172.21.15.79:0/745297166 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7fa9c8029040 con 0x56093399bc40 2024-08-20T01:43:59.507 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.500+0000 7fa9d7c9b740 10 client.17451 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:43:59.507 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.500+0000 7fa9d7c9b740 10 client.17451 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:43:59.507 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.500+0000 7fa9d7c9b740 20 client.17451 populate_metadata read hostname 'smithi079' 2024-08-20T01:43:59.507 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.500+0000 7fa9d7c9b740 1 --2- 172.21.15.79:0/745297166 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5609339ab720 0x560933a18a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:59.507 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.500+0000 7fa9d7c9b740 4 client.17451 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:43:59.508 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.500+0000 7fa9d7c9b740 1 -- 172.21.15.79:0/745297166 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560933906d50 con 0x5609339ab720 2024-08-20T01:43:59.508 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.500+0000 7fa9ce59c640 1 --2- 172.21.15.79:0/745297166 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5609339ab720 0x560933a18a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:59.508 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.500+0000 7fa9ce59c640 1 --2- 172.21.15.79:0/745297166 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5609339ab720 0x560933a18a70 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=871c6a3b18953c30 server_cookie=5ead84d429228aa4 in_seq=0 out_seq=0 2024-08-20T01:43:59.508 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.500+0000 7fa9b5ffb640 10 client.17451 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:43:59.510 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.508+0000 7fa9b5ffb640 1 -- 172.21.15.79:0/745297166 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560933906d50 con 0x5609339ab720 2024-08-20T01:43:59.511 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.508+0000 7fa9b5ffb640 10 client.17451 handle_command_reply: tid=0 2024-08-20T01:43:59.511 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.508+0000 7fa9d7c9b740 1 client.17451 shutdown 2024-08-20T01:43:59.511 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.508+0000 7fa9d7c9b740 1 -- 172.21.15.79:0/745297166 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56093399bc40 msgr2=0x5609339a6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:59.511 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.508+0000 7fa9d7c9b740 1 --2- 172.21.15.79:0/745297166 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56093399bc40 0x5609339a6db0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8005650 tx=0x7fa9c8019fa0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.511 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.508+0000 7fa9d7c9b740 1 -- 172.21.15.79:0/745297166 shutdown_connections 2024-08-20T01:43:59.511 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.508+0000 7fa9d7c9b740 1 --2- 172.21.15.79:0/745297166 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5609339ab720 0x560933a18a70 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.511 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.508+0000 7fa9d7c9b740 1 --2- 172.21.15.79:0/745297166 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56093399bc40 0x5609339a6db0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.511 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.508+0000 7fa9b5ffb640 0 client.17451 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:43:59.511 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.508+0000 7fa9d7c9b740 1 --2- 172.21.15.79:0/745297166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560933999200 0x5609339a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.511 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.508+0000 7fa9d7c9b740 1 --2- 172.21.15.79:0/745297166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609339968d0 0x5609339a7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.511 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.508+0000 7fa9d7c9b740 1 -- 172.21.15.79:0/745297166 >> 172.21.15.79:0/745297166 conn(0x560933991a20 msgr2=0x560933990ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:59.511 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.508+0000 7fa9d7c9b740 1 -- 172.21.15.79:0/745297166 shutdown_connections 2024-08-20T01:43:59.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.508+0000 7fa9d7c9b740 1 -- 172.21.15.79:0/745297166 wait complete. 2024-08-20T01:43:59.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.508+0000 7fa9d7c9b740 20 client.17451 trim_cache size 0 max 16384 2024-08-20T01:43:59.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:43:59.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:43:59.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:43:59.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:43:59.513 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.509+0000 7fa9d4ea8640 1 -- 172.21.15.79:0/372861747 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa9b80b3bd0 msgr2=0x7fa9b80b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:59.513 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.509+0000 7fa9d4ea8640 1 --2- 172.21.15.79:0/372861747 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa9b80b3bd0 0x7fa9b80b6090 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa9c000b7c0 tx=0x7fa9c000b390 comp rx=0 tx=0).stop 2024-08-20T01:43:59.513 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.509+0000 7fa9d4ea8640 1 -- 172.21.15.79:0/372861747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9d01026b0 msgr2=0x7fa9d0198fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:59.513 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.509+0000 7fa9d4ea8640 1 --2- 172.21.15.79:0/372861747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9d01026b0 0x7fa9d0198fd0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4031460 tx=0x7fa9c4003c80 comp rx=0 tx=0).stop 2024-08-20T01:43:59.513 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.509+0000 7fa9d4ea8640 1 -- 172.21.15.79:0/372861747 shutdown_connections 2024-08-20T01:43:59.513 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.509+0000 7fa9d4ea8640 1 --2- 172.21.15.79:0/372861747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9d0103070 0x7fa9d0199c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.513 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.509+0000 7fa9d4ea8640 1 --2- 172.21.15.79:0/372861747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9d01026b0 0x7fa9d0198fd0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.513 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.509+0000 7fa9d4ea8640 1 --2- 172.21.15.79:0/372861747 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa9b80b3bd0 0x7fa9b80b6090 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.509+0000 7fa9d4ea8640 1 --2- 172.21.15.79:0/372861747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9d0101560 0x7fa9d0198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.509+0000 7fa9d4ea8640 1 -- 172.21.15.79:0/372861747 >> 172.21.15.79:0/372861747 conn(0x7fa9d00fce40 msgr2=0x7fa9d00fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:59.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.509+0000 7fa9d4ea8640 1 -- 172.21.15.79:0/372861747 shutdown_connections 2024-08-20T01:43:59.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:43:59.509+0000 7fa9d4ea8640 1 -- 172.21.15.79:0/372861747 wait complete. 2024-08-20T01:43:59.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.842+0000 7fbb00a9c640 1 -- 172.21.15.79:0/1674517755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbafc1073a0 msgr2=0x7fbafc1077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:59.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.842+0000 7fbb00a9c640 1 --2- 172.21.15.79:0/1674517755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbafc1073a0 0x7fbafc1077e0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fbae4009900 tx=0x7fbae402a410 comp rx=0 tx=0).stop 2024-08-20T01:43:59.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.842+0000 7fbb00a9c640 1 -- 172.21.15.79:0/1674517755 shutdown_connections 2024-08-20T01:43:59.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.842+0000 7fbb00a9c640 1 --2- 172.21.15.79:0/1674517755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbafc107d20 0x7fbafc10e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.842+0000 7fbb00a9c640 1 --2- 172.21.15.79:0/1674517755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbafc1073a0 0x7fbafc1077e0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.842+0000 7fbb00a9c640 1 --2- 172.21.15.79:0/1674517755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbafc101990 0x7fbafc101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.842+0000 7fbb00a9c640 1 -- 172.21.15.79:0/1674517755 >> 172.21.15.79:0/1674517755 conn(0x7fbafc0fd400 msgr2=0x7fbafc0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:59.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.842+0000 7fbb00a9c640 1 -- 172.21.15.79:0/1674517755 shutdown_connections 2024-08-20T01:43:59.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.842+0000 7fbb00a9c640 1 -- 172.21.15.79:0/1674517755 wait complete. 2024-08-20T01:43:59.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.843+0000 7fbb00a9c640 1 Processor -- start 2024-08-20T01:43:59.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.843+0000 7fbb00a9c640 1 -- start start 2024-08-20T01:43:59.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.843+0000 7fbb00a9c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbafc101990 0x7fbafc0fd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:59.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.843+0000 7fbb00a9c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbafc1073a0 0x7fbafc0fde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:59.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.843+0000 7fbb00a9c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbafc107d20 0x7fbafc0fe380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:59.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.843+0000 7fbb00a9c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc1118d0 con 0x7fbafc101990 2024-08-20T01:43:59.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.843+0000 7fbb00a9c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc111750 con 0x7fbafc1073a0 2024-08-20T01:43:59.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.843+0000 7fbb00a9c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc111a50 con 0x7fbafc107d20 2024-08-20T01:43:59.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.844+0000 7fbafa59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbafc101990 0x7fbafc0fd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:59.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.844+0000 7fbafa59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbafc101990 0x7fbafc0fd900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40302/0 (socket says 172.21.15.79:40302) 2024-08-20T01:43:59.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.844+0000 7fbafa59c640 1 -- 172.21.15.79:0/3706595172 learned_addr learned my addr 172.21.15.79:0/3706595172 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:59.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.844+0000 7fbafad9d640 1 --2- 172.21.15.79:0/3706595172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbafc107d20 0x7fbafc0fe380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:59.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.844+0000 7fbaf3fff640 1 --2- 172.21.15.79:0/3706595172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbafc1073a0 0x7fbafc0fde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:59.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.844+0000 7fbafa59c640 1 -- 172.21.15.79:0/3706595172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbafc107d20 msgr2=0x7fbafc0fe380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:59.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.844+0000 7fbafa59c640 1 --2- 172.21.15.79:0/3706595172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbafc107d20 0x7fbafc0fe380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.844+0000 7fbafa59c640 1 -- 172.21.15.79:0/3706595172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbafc1073a0 msgr2=0x7fbafc0fde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:59.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.844+0000 7fbafa59c640 1 --2- 172.21.15.79:0/3706595172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbafc1073a0 0x7fbafc0fde40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.844+0000 7fbafa59c640 1 -- 172.21.15.79:0/3706595172 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbafc1a7450 con 0x7fbafc101990 2024-08-20T01:43:59.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.844+0000 7fbafad9d640 1 --2- 172.21.15.79:0/3706595172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbafc107d20 0x7fbafc0fe380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:43:59.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.844+0000 7fbaf3fff640 1 --2- 172.21.15.79:0/3706595172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbafc1073a0 0x7fbafc0fde40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:43:59.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.844+0000 7fbafa59c640 1 --2- 172.21.15.79:0/3706595172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbafc101990 0x7fbafc0fd900 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fbaec00b4a0 tx=0x7fbaec00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:59.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.844+0000 7fbaf37fe640 1 -- 172.21.15.79:0/3706595172 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaec014070 con 0x7fbafc101990 2024-08-20T01:43:59.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.844+0000 7fbaf37fe640 1 -- 172.21.15.79:0/3706595172 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbaec010aa0 con 0x7fbafc101990 2024-08-20T01:43:59.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.844+0000 7fbb00a9c640 1 -- 172.21.15.79:0/3706595172 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbafc1a7740 con 0x7fbafc101990 2024-08-20T01:43:59.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.845+0000 7fbaf37fe640 1 -- 172.21.15.79:0/3706595172 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaec017b70 con 0x7fbafc101990 2024-08-20T01:43:59.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.845+0000 7fbb00a9c640 1 -- 172.21.15.79:0/3706595172 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbafc1a7cb0 con 0x7fbafc101990 2024-08-20T01:43:59.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.847+0000 7fbaf37fe640 1 -- 172.21.15.79:0/3706595172 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fbaec017070 con 0x7fbafc101990 2024-08-20T01:43:59.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.847+0000 7fbb02e95740 1 Processor -- start 2024-08-20T01:43:59.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.848+0000 7fbb02e95740 1 -- start start 2024-08-20T01:43:59.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.848+0000 7fbb02e95740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556940475830 0x556940475c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:59.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.848+0000 7fbb02e95740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556940476150 0x556940481ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:59.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.848+0000 7fbb02e95740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569404820e0 0x5569404844d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:59.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.848+0000 7fbb02e95740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5569403ec8e0 con 0x556940475830 2024-08-20T01:43:59.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.848+0000 7fbb02e95740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5569403dbde0 con 0x5569404820e0 2024-08-20T01:43:59.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.848+0000 7fbb02e95740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5569403dfe20 con 0x556940476150 2024-08-20T01:43:59.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.848+0000 7fbaf37fe640 1 --2- 172.21.15.79:0/3706595172 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbae80b3c50 0x7fbae80b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:59.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.848+0000 7fbafad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556940475830 0x556940475c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:59.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.848+0000 7fbaf3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569404820e0 0x5569404844d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:59.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.848+0000 7fbafad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556940475830 0x556940475c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40312/0 (socket says 172.21.15.79:40312) 2024-08-20T01:43:59.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.848+0000 7fbaf3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569404820e0 0x5569404844d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:34116/0 (socket says 172.21.15.79:34116) 2024-08-20T01:43:59.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.848+0000 7fbaf3fff640 1 -- 172.21.15.79:0/2273800326 learned_addr learned my addr 172.21.15.79:0/2273800326 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:59.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.848+0000 7fbafa59c640 1 --2- 172.21.15.79:0/2273800326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556940476150 0x556940481ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:59.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.849+0000 7fbafad9d640 1 --2- 172.21.15.79:0/3706595172 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbae80b3c50 0x7fbae80b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:59.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.849+0000 7fbaf37fe640 1 -- 172.21.15.79:0/3706595172 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fbaec0e2fd0 con 0x7fbafc101990 2024-08-20T01:43:59.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.849+0000 7fbaf3fff640 1 -- 172.21.15.79:0/2273800326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556940476150 msgr2=0x556940481ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:59.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.849+0000 7fbaf3fff640 1 --2- 172.21.15.79:0/2273800326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556940476150 0x556940481ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.849+0000 7fbaf3fff640 1 -- 172.21.15.79:0/2273800326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556940475830 msgr2=0x556940475c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:59.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.849+0000 7fbaf3fff640 1 --2- 172.21.15.79:0/2273800326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556940475830 0x556940475c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.849+0000 7fbaf3fff640 1 -- 172.21.15.79:0/2273800326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55694013b650 con 0x5569404820e0 2024-08-20T01:43:59.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.849+0000 7fbafad9d640 1 --2- 172.21.15.79:0/2273800326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556940475830 0x556940475c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:43:59.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.849+0000 7fbaf3fff640 1 --2- 172.21.15.79:0/2273800326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569404820e0 0x5569404844d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbae4000c00 tx=0x7fbae4032dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ef2b7e38643e9d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:59.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.849+0000 7fbafad9d640 1 --2- 172.21.15.79:0/3706595172 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbae80b3c50 0x7fbae80b6110 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4009440 tx=0x7fbaf40093d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:59.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.849+0000 7fbaf0ff9640 1 -- 172.21.15.79:0/2273800326 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae403f070 con 0x5569404820e0 2024-08-20T01:43:59.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.849+0000 7fbaf0ff9640 1 -- 172.21.15.79:0/2273800326 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbae40044c0 con 0x5569404820e0 2024-08-20T01:43:59.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.850+0000 7fbaf0ff9640 1 -- 172.21.15.79:0/2273800326 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae4035070 con 0x5569404820e0 2024-08-20T01:43:59.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.850+0000 7fbb02e95740 1 -- 172.21.15.79:0/2273800326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569404820e0 msgr2=0x5569404844d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:59.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.850+0000 7fbb02e95740 1 --2- 172.21.15.79:0/2273800326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569404820e0 0x5569404844d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbae4000c00 tx=0x7fbae4032dd0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.850+0000 7fbb02e95740 1 -- 172.21.15.79:0/2273800326 shutdown_connections 2024-08-20T01:43:59.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.850+0000 7fbb02e95740 1 --2- 172.21.15.79:0/2273800326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569404820e0 0x5569404844d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.850+0000 7fbb02e95740 1 --2- 172.21.15.79:0/2273800326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556940476150 0x556940481ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.850+0000 7fbb02e95740 1 --2- 172.21.15.79:0/2273800326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556940475830 0x556940475c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.850+0000 7fbb02e95740 1 -- 172.21.15.79:0/2273800326 >> 172.21.15.79:0/2273800326 conn(0x556940473660 msgr2=0x556940474800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:59.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.850+0000 7fbb02e95740 1 -- 172.21.15.79:0/2273800326 shutdown_connections 2024-08-20T01:43:59.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.850+0000 7fbb02e95740 1 -- 172.21.15.79:0/2273800326 wait complete. 2024-08-20T01:43:59.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.851+0000 7fbb02e95740 1 -- start start 2024-08-20T01:43:59.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.851+0000 7fbb02e95740 1 Processor -- start 2024-08-20T01:43:59.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.851+0000 7fbb02e95740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556940475830 0x55694047f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:59.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.851+0000 7fbb02e95740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556940476150 0x55694047f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:59.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.851+0000 7fbb02e95740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569404820e0 0x55694047fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:59.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.851+0000 7fbb02e95740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55694023e700 con 0x556940476150 2024-08-20T01:43:59.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.851+0000 7fbb02e95740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5569403627c0 con 0x5569404820e0 2024-08-20T01:43:59.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.851+0000 7fbb02e95740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556940484d30 con 0x556940475830 2024-08-20T01:43:59.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.851+0000 7fbaf3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556940476150 0x55694047f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:59.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.851+0000 7fbb02e95740 10 client.0 _ll_register_callbacks cb 0x5569403d56b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:43:59.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.851+0000 7fbaf3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556940476150 0x55694047f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40328/0 (socket says 172.21.15.79:40328) 2024-08-20T01:43:59.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.851+0000 7fbaf3fff640 1 -- 172.21.15.79:0/1433629213 learned_addr learned my addr 172.21.15.79:0/1433629213 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:59.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.851+0000 7fbafad9d640 1 --2- 172.21.15.79:0/1433629213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569404820e0 0x55694047fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:59.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.852+0000 7fbafa59c640 1 --2- 172.21.15.79:0/1433629213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556940475830 0x55694047f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:59.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.852+0000 7fbaf3fff640 1 -- 172.21.15.79:0/1433629213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556940475830 msgr2=0x55694047f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:59.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.852+0000 7fbaf3fff640 1 --2- 172.21.15.79:0/1433629213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556940475830 0x55694047f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.852+0000 7fbaf3fff640 1 -- 172.21.15.79:0/1433629213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569404820e0 msgr2=0x55694047fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:59.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.852+0000 7fbaf3fff640 1 --2- 172.21.15.79:0/1433629213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569404820e0 0x55694047fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.852+0000 7fbaf3fff640 1 -- 172.21.15.79:0/1433629213 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55694048e0b0 con 0x556940476150 2024-08-20T01:43:59.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.852+0000 7fbaf3fff640 1 --2- 172.21.15.79:0/1433629213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556940476150 0x55694047f580 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fbae4009900 tx=0x7fbae4005630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8e36cd1126fd660 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:59.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.852+0000 7fbae1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:43:59.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.852+0000 7fbae1ffb640 1 -- 172.21.15.79:0/1433629213 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae4035030 con 0x556940476150 2024-08-20T01:43:59.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.852+0000 7fbae1ffb640 1 -- 172.21.15.79:0/1433629213 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fbae4031400 con 0x556940476150 2024-08-20T01:43:59.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.852+0000 7fbb02e95740 1 -- 172.21.15.79:0/1433629213 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55694038b100 con 0x556940476150 2024-08-20T01:43:59.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.852+0000 7fbae1ffb640 1 -- 172.21.15.79:0/1433629213 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fbae403f070 con 0x556940476150 2024-08-20T01:43:59.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.852+0000 7fbb02e95740 10 client.17463 fetch_fsmap learned FSMap version 38 2024-08-20T01:43:59.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.852+0000 7fbb02e95740 1 -- 172.21.15.79:0/1433629213 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x556940490a60 con 0x556940476150 2024-08-20T01:43:59.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.853+0000 7fbae1ffb640 1 -- 172.21.15.79:0/1433629213 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55694038b100 con 0x556940476150 2024-08-20T01:43:59.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.853+0000 7fbae1ffb640 1 -- 172.21.15.79:0/1433629213 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7fbae4004d10 con 0x556940476150 2024-08-20T01:43:59.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.853+0000 7fbb02e95740 10 client.17463 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:43:59.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.853+0000 7fbb02e95740 10 client.17463 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:43:59.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.853+0000 7fbb02e95740 20 client.17463 populate_metadata read hostname 'smithi079' 2024-08-20T01:43:59.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.853+0000 7fbb02e95740 1 --2- 172.21.15.79:0/1433629213 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556940491db0 0x5569404941a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:59.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.853+0000 7fbb02e95740 4 client.17463 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:43:59.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.853+0000 7fbb02e95740 1 -- 172.21.15.79:0/1433629213 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569403ee830 con 0x556940491db0 2024-08-20T01:43:59.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.853+0000 7fbafa59c640 1 --2- 172.21.15.79:0/1433629213 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556940491db0 0x5569404941a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:59.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.854+0000 7fbae1ffb640 10 client.17463 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:43:59.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.854+0000 7fbafa59c640 1 --2- 172.21.15.79:0/1433629213 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556940491db0 0x5569404941a0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fadf9de4f28d09e server_cookie=c335375b28b8ea07 in_seq=0 out_seq=0 2024-08-20T01:43:59.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.854+0000 7fbae1ffb640 1 -- 172.21.15.79:0/1433629213 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5569403ee830 con 0x556940491db0 2024-08-20T01:43:59.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.854+0000 7fbae1ffb640 10 client.17463 handle_command_reply: tid=0 2024-08-20T01:43:59.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.854+0000 7fbb02e95740 1 client.17463 shutdown 2024-08-20T01:43:59.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.854+0000 7fbb02e95740 1 -- 172.21.15.79:0/1433629213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556940476150 msgr2=0x55694047f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:59.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.854+0000 7fbb02e95740 1 --2- 172.21.15.79:0/1433629213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556940476150 0x55694047f580 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fbae4009900 tx=0x7fbae4005630 comp rx=0 tx=0).stop 2024-08-20T01:43:59.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.855+0000 7fbb02e95740 1 -- 172.21.15.79:0/1433629213 shutdown_connections 2024-08-20T01:43:59.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.855+0000 7fbb02e95740 1 --2- 172.21.15.79:0/1433629213 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556940491db0 0x5569404941a0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.855+0000 7fbb02e95740 1 --2- 172.21.15.79:0/1433629213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569404820e0 0x55694047fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.855+0000 7fbb02e95740 1 --2- 172.21.15.79:0/1433629213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556940476150 0x55694047f580 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.855+0000 7fbae1ffb640 0 client.17463 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:43:59.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.855+0000 7fbb02e95740 1 --2- 172.21.15.79:0/1433629213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556940475830 0x55694047f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.855+0000 7fbb02e95740 1 -- 172.21.15.79:0/1433629213 >> 172.21.15.79:0/1433629213 conn(0x556940473660 msgr2=0x5569404791d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:59.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.855+0000 7fbb02e95740 1 -- 172.21.15.79:0/1433629213 shutdown_connections 2024-08-20T01:43:59.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.855+0000 7fbb02e95740 1 -- 172.21.15.79:0/1433629213 wait complete. 2024-08-20T01:43:59.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.855+0000 7fbb02e95740 20 client.17463 trim_cache size 0 max 16384 2024-08-20T01:43:59.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.872+0000 7fbb02e95740 1 Processor -- start 2024-08-20T01:43:59.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.872+0000 7fbb02e95740 1 -- start start 2024-08-20T01:43:59.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.872+0000 7fbb02e95740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556940475830 0x556940474d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:59.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.872+0000 7fbb02e95740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556940476150 0x5569404798a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:59.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.872+0000 7fbb02e95740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5569404820e0 0x55694047f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:59.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.872+0000 7fbb02e95740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc1b0360 con 0x5569404820e0 2024-08-20T01:43:59.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.872+0000 7fbb02e95740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc1b1ea0 con 0x556940475830 2024-08-20T01:43:59.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.872+0000 7fbb02e95740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc1b0a30 con 0x556940476150 2024-08-20T01:43:59.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.872+0000 7fbafad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5569404820e0 0x55694047f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:59.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.872+0000 7fbafad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5569404820e0 0x55694047f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40334/0 (socket says 172.21.15.79:40334) 2024-08-20T01:43:59.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.872+0000 7fbafad9d640 1 -- 172.21.15.79:0/3428734721 learned_addr learned my addr 172.21.15.79:0/3428734721 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:59.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.872+0000 7fbaf3fff640 1 --2- 172.21.15.79:0/3428734721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556940476150 0x5569404798a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:59.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.872+0000 7fbafa59c640 1 --2- 172.21.15.79:0/3428734721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556940475830 0x556940474d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:59.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.873+0000 7fbaf3fff640 1 -- 172.21.15.79:0/3428734721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556940475830 msgr2=0x556940474d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:59.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.873+0000 7fbaf3fff640 1 --2- 172.21.15.79:0/3428734721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556940475830 0x556940474d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.873+0000 7fbaf3fff640 1 -- 172.21.15.79:0/3428734721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5569404820e0 msgr2=0x55694047f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:59.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.873+0000 7fbaf3fff640 1 --2- 172.21.15.79:0/3428734721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5569404820e0 0x55694047f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.873+0000 7fbaf3fff640 1 -- 172.21.15.79:0/3428734721 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556940473eb0 con 0x556940476150 2024-08-20T01:43:59.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.873+0000 7fbafad9d640 1 --2- 172.21.15.79:0/3428734721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5569404820e0 0x55694047f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:43:59.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.873+0000 7fbaf3fff640 1 --2- 172.21.15.79:0/3428734721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556940476150 0x5569404798a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbae403b550 tx=0x7fbae4005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40dca05c25d6b7b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:59.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.873+0000 7fbae3fff640 1 -- 172.21.15.79:0/3428734721 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae4035040 con 0x556940476150 2024-08-20T01:43:59.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.873+0000 7fbae3fff640 1 -- 172.21.15.79:0/3428734721 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbae404c070 con 0x556940476150 2024-08-20T01:43:59.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.873+0000 7fbae3fff640 1 -- 172.21.15.79:0/3428734721 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae4004c00 con 0x556940476150 2024-08-20T01:43:59.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.874+0000 7fbb02e95740 1 -- 172.21.15.79:0/3428734721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556940476150 msgr2=0x5569404798a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:59.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.874+0000 7fbb02e95740 1 --2- 172.21.15.79:0/3428734721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556940476150 0x5569404798a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbae403b550 tx=0x7fbae4005fd0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.874+0000 7fbb02e95740 1 -- 172.21.15.79:0/3428734721 shutdown_connections 2024-08-20T01:43:59.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.874+0000 7fbb02e95740 1 --2- 172.21.15.79:0/3428734721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5569404820e0 0x55694047f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.874+0000 7fbb02e95740 1 --2- 172.21.15.79:0/3428734721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556940476150 0x5569404798a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.874+0000 7fbb02e95740 1 --2- 172.21.15.79:0/3428734721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556940475830 0x556940474d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.874+0000 7fbb02e95740 1 -- 172.21.15.79:0/3428734721 >> 172.21.15.79:0/3428734721 conn(0x556940473660 msgr2=0x556940480e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:59.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.874+0000 7fbb02e95740 1 -- 172.21.15.79:0/3428734721 shutdown_connections 2024-08-20T01:43:59.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.874+0000 7fbb02e95740 1 -- 172.21.15.79:0/3428734721 wait complete. 2024-08-20T01:43:59.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.874+0000 7fbb02e95740 1 -- start start 2024-08-20T01:43:59.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.875+0000 7fbb02e95740 1 Processor -- start 2024-08-20T01:43:59.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.875+0000 7fbb02e95740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556940475830 0x5569404865d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:59.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.875+0000 7fbb02e95740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556940476150 0x556940486b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:59.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.875+0000 7fbb02e95740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5569404820e0 0x556940487050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:59.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.875+0000 7fbb02e95740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc1b17d0 con 0x5569404820e0 2024-08-20T01:43:59.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.875+0000 7fbb02e95740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc1b1100 con 0x556940475830 2024-08-20T01:43:59.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.875+0000 7fbb02e95740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc1ae340 con 0x556940476150 2024-08-20T01:43:59.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.875+0000 7fbb02e95740 10 client.0 _ll_register_callbacks cb 0x7fbaf4009ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:43:59.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.875+0000 7fbafad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5569404820e0 0x556940487050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:59.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.875+0000 7fbafa59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556940475830 0x5569404865d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:59.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.875+0000 7fbaf3fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556940476150 0x556940486b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:59.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.875+0000 7fbafa59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556940475830 0x5569404865d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:34146/0 (socket says 172.21.15.79:34146) 2024-08-20T01:43:59.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.875+0000 7fbafa59c640 1 -- 172.21.15.79:0/8649742 learned_addr learned my addr 172.21.15.79:0/8649742 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:43:59.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.875+0000 7fbaf3fff640 1 -- 172.21.15.79:0/8649742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556940475830 msgr2=0x5569404865d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:59.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.875+0000 7fbaf3fff640 1 --2- 172.21.15.79:0/8649742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556940475830 0x5569404865d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.875+0000 7fbaf3fff640 1 -- 172.21.15.79:0/8649742 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5569404820e0 msgr2=0x556940487050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:43:59.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.875+0000 7fbaf3fff640 1 --2- 172.21.15.79:0/8649742 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5569404820e0 0x556940487050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.875+0000 7fbaf3fff640 1 -- 172.21.15.79:0/8649742 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569404faa30 con 0x556940476150 2024-08-20T01:43:59.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.875+0000 7fbafad9d640 1 --2- 172.21.15.79:0/8649742 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5569404820e0 0x556940487050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:43:59.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.875+0000 7fbafa59c640 1 --2- 172.21.15.79:0/8649742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556940475830 0x5569404865d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:43:59.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.876+0000 7fbaf3fff640 1 --2- 172.21.15.79:0/8649742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556940476150 0x556940486b10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbae403b550 tx=0x7fbae4005630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a0ffe3017b46309 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:43:59.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.876+0000 7fbae1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:43:59.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.876+0000 7fbae1ffb640 1 -- 172.21.15.79:0/8649742 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae4035070 con 0x556940476150 2024-08-20T01:43:59.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.876+0000 7fbae1ffb640 1 -- 172.21.15.79:0/8649742 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fbae40048c0 con 0x556940476150 2024-08-20T01:43:59.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.876+0000 7fbb02e95740 1 -- 172.21.15.79:0/8649742 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbae404c070 con 0x556940476150 2024-08-20T01:43:59.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.876+0000 7fbae1ffb640 1 -- 172.21.15.79:0/8649742 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fbae4004b00 con 0x556940476150 2024-08-20T01:43:59.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.876+0000 7fbb02e95740 10 client.26527 fetch_fsmap learned FSMap version 38 2024-08-20T01:43:59.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.876+0000 7fbb02e95740 1 -- 172.21.15.79:0/8649742 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5569404fbd20 con 0x556940476150 2024-08-20T01:43:59.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.876+0000 7fbae1ffb640 1 -- 172.21.15.79:0/8649742 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbae404c070 con 0x556940476150 2024-08-20T01:43:59.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.877+0000 7fbae1ffb640 1 -- 172.21.15.79:0/8649742 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7fbae4064030 con 0x556940476150 2024-08-20T01:43:59.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.877+0000 7fbb02e95740 10 client.26527 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T01:43:59.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.877+0000 7fbb02e95740 10 client.26527 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:43:59.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.877+0000 7fbb02e95740 20 client.26527 populate_metadata read hostname 'smithi079' 2024-08-20T01:43:59.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.877+0000 7fbb02e95740 1 --2- 172.21.15.79:0/8649742 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5569404fc350 0x5569404fe770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:43:59.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.877+0000 7fbb02e95740 4 client.26527 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:43:59.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.877+0000 7fbb02e95740 1 -- 172.21.15.79:0/8649742 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5569403ea2d0 con 0x5569404fc350 2024-08-20T01:43:59.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.877+0000 7fbafa59c640 1 --2- 172.21.15.79:0/8649742 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5569404fc350 0x5569404fe770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:43:59.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.877+0000 7fbae1ffb640 10 client.26527 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:43:59.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.877+0000 7fbafa59c640 1 --2- 172.21.15.79:0/8649742 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5569404fc350 0x5569404fe770 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7dd8c647ce21f225 server_cookie=2cfbd665df82dced in_seq=0 out_seq=0 2024-08-20T01:43:59.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.877+0000 7fbae1ffb640 1 -- 172.21.15.79:0/8649742 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5569403ea2d0 con 0x5569404fc350 2024-08-20T01:43:59.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.878+0000 7fbae1ffb640 10 client.26527 handle_command_reply: tid=0 2024-08-20T01:43:59.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.878+0000 7fbb02e95740 1 client.26527 shutdown 2024-08-20T01:43:59.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.878+0000 7fbb02e95740 1 -- 172.21.15.79:0/8649742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556940476150 msgr2=0x556940486b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:59.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.878+0000 7fbb02e95740 1 --2- 172.21.15.79:0/8649742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556940476150 0x556940486b10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbae403b550 tx=0x7fbae4005630 comp rx=0 tx=0).stop 2024-08-20T01:43:59.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.878+0000 7fbb02e95740 1 -- 172.21.15.79:0/8649742 shutdown_connections 2024-08-20T01:43:59.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.878+0000 7fbb02e95740 1 --2- 172.21.15.79:0/8649742 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5569404fc350 0x5569404fe770 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.878+0000 7fbae1ffb640 0 client.26527 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:43:59.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.878+0000 7fbb02e95740 1 --2- 172.21.15.79:0/8649742 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5569404820e0 0x556940487050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.878+0000 7fbb02e95740 1 --2- 172.21.15.79:0/8649742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556940476150 0x556940486b10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.878+0000 7fbb02e95740 1 --2- 172.21.15.79:0/8649742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556940475830 0x5569404865d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.878+0000 7fbb02e95740 1 -- 172.21.15.79:0/8649742 >> 172.21.15.79:0/8649742 conn(0x556940473660 msgr2=0x55694048ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:59.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.878+0000 7fbb02e95740 1 -- 172.21.15.79:0/8649742 shutdown_connections 2024-08-20T01:43:59.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.878+0000 7fbb02e95740 1 -- 172.21.15.79:0/8649742 wait complete. 2024-08-20T01:43:59.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.878+0000 7fbb02e95740 20 client.26527 trim_cache size 0 max 16384 2024-08-20T01:43:59.886 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:43:59.886 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-08-20T01:43:59.886 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-08-20T01:43:59.886 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:43:59.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.879+0000 7fbb00a9c640 1 -- 172.21.15.79:0/3706595172 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbae80b3c50 msgr2=0x7fbae80b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:59.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.879+0000 7fbb00a9c640 1 --2- 172.21.15.79:0/3706595172 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbae80b3c50 0x7fbae80b6110 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4009440 tx=0x7fbaf40093d0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.879+0000 7fbb00a9c640 1 -- 172.21.15.79:0/3706595172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbafc101990 msgr2=0x7fbafc0fd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:43:59.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.879+0000 7fbb00a9c640 1 --2- 172.21.15.79:0/3706595172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbafc101990 0x7fbafc0fd900 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fbaec00b4a0 tx=0x7fbaec00b960 comp rx=0 tx=0).stop 2024-08-20T01:43:59.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.879+0000 7fbb00a9c640 1 -- 172.21.15.79:0/3706595172 shutdown_connections 2024-08-20T01:43:59.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.879+0000 7fbb00a9c640 1 --2- 172.21.15.79:0/3706595172 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbae80b3c50 0x7fbae80b6110 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.879+0000 7fbb00a9c640 1 --2- 172.21.15.79:0/3706595172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbafc107d20 0x7fbafc0fe380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.879+0000 7fbb00a9c640 1 --2- 172.21.15.79:0/3706595172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbafc1073a0 0x7fbafc0fde40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.879+0000 7fbb00a9c640 1 --2- 172.21.15.79:0/3706595172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbafc101990 0x7fbafc0fd900 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:43:59.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.879+0000 7fbb00a9c640 1 -- 172.21.15.79:0/3706595172 >> 172.21.15.79:0/3706595172 conn(0x7fbafc0fd400 msgr2=0x7fbafc06abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:43:59.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.879+0000 7fbb00a9c640 1 -- 172.21.15.79:0/3706595172 shutdown_connections 2024-08-20T01:43:59.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:43:59.879+0000 7fbb00a9c640 1 -- 172.21.15.79:0/3706595172 wait complete. 2024-08-20T01:44:00.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:00 smithi081 ceph-mon[22209]: pgmap v547: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 32 MiB/s wr, 28 op/s 2024-08-20T01:44:00.798 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:00 smithi079 ceph-mon[18656]: pgmap v547: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 32 MiB/s wr, 28 op/s 2024-08-20T01:44:00.827 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T01:44:00.828 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:44:00.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:00 smithi175 ceph-mon[22392]: pgmap v547: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 32 MiB/s wr, 28 op/s 2024-08-20T01:44:01.112 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:44:01.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.608+0000 7f4589fe8640 1 -- 172.21.15.79:0/3323140689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45841084a0 msgr2=0x7f45841088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:01.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.608+0000 7f4589fe8640 1 --2- 172.21.15.79:0/3323140689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45841084a0 0x7f45841088e0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f4578009900 tx=0x7f457802a410 comp rx=0 tx=0).stop 2024-08-20T01:44:01.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.608+0000 7f4589fe8640 1 -- 172.21.15.79:0/3323140689 shutdown_connections 2024-08-20T01:44:01.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.608+0000 7f4589fe8640 1 --2- 172.21.15.79:0/3323140689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4584108e20 0x7f458410f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:01.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.608+0000 7f4589fe8640 1 --2- 172.21.15.79:0/3323140689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45841084a0 0x7f45841088e0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:01.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.608+0000 7f4589fe8640 1 --2- 172.21.15.79:0/3323140689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4584102a90 0x7f4584102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:01.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.608+0000 7f4589fe8640 1 -- 172.21.15.79:0/3323140689 >> 172.21.15.79:0/3323140689 conn(0x7f45840fe540 msgr2=0x7f4584100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:01.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.608+0000 7f4589fe8640 1 -- 172.21.15.79:0/3323140689 shutdown_connections 2024-08-20T01:44:01.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.608+0000 7f4589fe8640 1 -- 172.21.15.79:0/3323140689 wait complete. 2024-08-20T01:44:01.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.609+0000 7f4589fe8640 1 Processor -- start 2024-08-20T01:44:01.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.609+0000 7f4589fe8640 1 -- start start 2024-08-20T01:44:01.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.609+0000 7f4589fe8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4584102a90 0x7f45840751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:01.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.609+0000 7f4589fe8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45841084a0 0x7f4584075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:01.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.609+0000 7f4589fe8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4584108e20 0x7f4584075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:01.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.609+0000 7f4589fe8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f45841129e0 con 0x7f4584108e20 2024-08-20T01:44:01.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.609+0000 7f4589fe8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4584112860 con 0x7f4584102a90 2024-08-20T01:44:01.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.609+0000 7f4589fe8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4584112b60 con 0x7f45841084a0 2024-08-20T01:44:01.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.610+0000 7f4583fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4584108e20 0x7f4584075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:01.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.610+0000 7f4583fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4584108e20 0x7f4584075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58652/0 (socket says 172.21.15.79:58652) 2024-08-20T01:44:01.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.610+0000 7f4583fff640 1 -- 172.21.15.79:0/3649887198 learned_addr learned my addr 172.21.15.79:0/3649887198 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:01.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.610+0000 7f4582ffd640 1 --2- 172.21.15.79:0/3649887198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45841084a0 0x7f4584075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:01.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.610+0000 7f45837fe640 1 --2- 172.21.15.79:0/3649887198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4584102a90 0x7f45840751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:01.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.610+0000 7f4583fff640 1 -- 172.21.15.79:0/3649887198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45841084a0 msgr2=0x7f4584075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:01.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.610+0000 7f4583fff640 1 --2- 172.21.15.79:0/3649887198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45841084a0 0x7f4584075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:01.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.610+0000 7f4583fff640 1 -- 172.21.15.79:0/3649887198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4584102a90 msgr2=0x7f45840751d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:01.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.610+0000 7f4583fff640 1 --2- 172.21.15.79:0/3649887198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4584102a90 0x7f45840751d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:01.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.610+0000 7f4583fff640 1 -- 172.21.15.79:0/3649887198 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45841a72d0 con 0x7f4584108e20 2024-08-20T01:44:01.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.610+0000 7f4583fff640 1 --2- 172.21.15.79:0/3649887198 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4584108e20 0x7f4584075c50 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f457c00cce0 tx=0x7f457c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:01.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.610+0000 7f4580ff9640 1 -- 172.21.15.79:0/3649887198 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457c00f450 con 0x7f4584108e20 2024-08-20T01:44:01.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.610+0000 7f4589fe8640 1 -- 172.21.15.79:0/3649887198 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45841a75c0 con 0x7f4584108e20 2024-08-20T01:44:01.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.610+0000 7f4580ff9640 1 -- 172.21.15.79:0/3649887198 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f457c00fa80 con 0x7f4584108e20 2024-08-20T01:44:01.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.610+0000 7f4580ff9640 1 -- 172.21.15.79:0/3649887198 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457c018ad0 con 0x7f4584108e20 2024-08-20T01:44:01.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.610+0000 7f4589fe8640 1 -- 172.21.15.79:0/3649887198 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45841a7ad0 con 0x7f4584108e20 2024-08-20T01:44:01.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.611+0000 7f4589fe8640 1 -- 172.21.15.79:0/3649887198 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4584103d40 con 0x7f4584108e20 2024-08-20T01:44:01.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.613+0000 7f4580ff9640 1 -- 172.21.15.79:0/3649887198 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f457c00f5f0 con 0x7f4584108e20 2024-08-20T01:44:01.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.614+0000 7f4580ff9640 1 --2- 172.21.15.79:0/3649887198 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f456c0b3bd0 0x7f456c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:01.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.615+0000 7f45837fe640 1 --2- 172.21.15.79:0/3649887198 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f456c0b3bd0 0x7f456c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:01.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.615+0000 7f4580ff9640 1 -- 172.21.15.79:0/3649887198 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f457c0e4440 con 0x7f4584108e20 2024-08-20T01:44:01.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.615+0000 7f45837fe640 1 --2- 172.21.15.79:0/3649887198 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f456c0b3bd0 0x7f456c0b6090 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f4574005fd0 tx=0x7f4574005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:01.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.618+0000 7f4580ff9640 1 -- 172.21.15.79:0/3649887198 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f457c014030 con 0x7f4584108e20 2024-08-20T01:44:01.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.915+0000 7f4589fe8640 1 -- 172.21.15.79:0/3649887198 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4584102e70 con 0x7f4584108e20 2024-08-20T01:44:01.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.915+0000 7f4580ff9640 1 -- 172.21.15.79:0/3649887198 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+11976 (secure 0 0 0) 0x7f457c0abb30 con 0x7f4584108e20 2024-08-20T01:44:01.918 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:44:01.918 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":39,"btime":"2024-08-20T01:44:01:451490+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14670,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/735082912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":735082912},{"type":"v1","addr":"172.21.15.79:6835","nonce":735082912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2150339873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2150339873},{"type":"v1","addr":"172.21.15.79:6837","nonce":2150339873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":39,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:34:55.133562+0000","modified":"2024-08-20T01:44:00.896512+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24539,"mds_1":24538,"mds_2":24523,"mds_3":24514,"mds_4":24512},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14724":{"gid":14724,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/1071242274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1071242274},{"type":"v1","addr":"172.21.15.79:6839","nonce":1071242274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14730":{"gid":14730,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6841/2448977611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":2448977611},{"type":"v1","addr":"172.21.15.79:6841","nonce":2448977611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/1257507005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1257507005},{"type":"v1","addr":"172.21.15.81:6833","nonce":1257507005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1499936216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1499936216},{"type":"v1","addr":"172.21.15.81:6835","nonce":1499936216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/1107229215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1107229215},{"type":"v1","addr":"172.21.15.175:6833","nonce":1107229215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6837/2073598870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2073598870},{"type":"v1","addr":"172.21.15.81:6837","nonce":2073598870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/2552601173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2552601173},{"type":"v1","addr":"172.21.15.175:6835","nonce":2552601173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6837/1767284089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1767284089},{"type":"v1","addr":"172.21.15.175:6837","nonce":1767284089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/1331748742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1331748742},{"type":"v1","addr":"172.21.15.175:6839","nonce":1331748742}]},"join_fscid":-1,"export_targets":[2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/4098410583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":4098410583},{"type":"v1","addr":"172.21.15.81:6839","nonce":4098410583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24539,"qdb_cluster":[24539,24523,24514,24538,24512]},"id":1}]} 2024-08-20T01:44:01.919 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 39 2024-08-20T01:44:01.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.918+0000 7f4589fe8640 1 -- 172.21.15.79:0/3649887198 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f456c0b3bd0 msgr2=0x7f456c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:01.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.918+0000 7f4589fe8640 1 --2- 172.21.15.79:0/3649887198 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f456c0b3bd0 0x7f456c0b6090 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f4574005fd0 tx=0x7f4574005850 comp rx=0 tx=0).stop 2024-08-20T01:44:01.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.918+0000 7f4589fe8640 1 -- 172.21.15.79:0/3649887198 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4584108e20 msgr2=0x7f4584075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:01.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.918+0000 7f4589fe8640 1 --2- 172.21.15.79:0/3649887198 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4584108e20 0x7f4584075c50 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f457c00cce0 tx=0x7f457c00a620 comp rx=0 tx=0).stop 2024-08-20T01:44:01.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.918+0000 7f4589fe8640 1 -- 172.21.15.79:0/3649887198 shutdown_connections 2024-08-20T01:44:01.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.918+0000 7f4589fe8640 1 --2- 172.21.15.79:0/3649887198 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4584108e20 0x7f4584075c50 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:01.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.918+0000 7f4589fe8640 1 --2- 172.21.15.79:0/3649887198 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f456c0b3bd0 0x7f456c0b6090 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:01.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.918+0000 7f4589fe8640 1 --2- 172.21.15.79:0/3649887198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45841084a0 0x7f4584075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:01.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.918+0000 7f4589fe8640 1 --2- 172.21.15.79:0/3649887198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4584102a90 0x7f45840751d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:01.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.918+0000 7f4589fe8640 1 -- 172.21.15.79:0/3649887198 >> 172.21.15.79:0/3649887198 conn(0x7f45840fe540 msgr2=0x7f4584100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:01.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.918+0000 7f4589fe8640 1 -- 172.21.15.79:0/3649887198 shutdown_connections 2024-08-20T01:44:01.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:01.918+0000 7f4589fe8640 1 -- 172.21.15.79:0/3649887198 wait complete. 2024-08-20T01:44:02.602 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:02 smithi079 ceph-mon[18656]: pgmap v548: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 28 MiB/s wr, 23 op/s 2024-08-20T01:44:02.602 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:02 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:44:02.602 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:02 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/3649887198' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:44:02.629 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-20T01:44:02.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:02 smithi081 ceph-mon[22209]: pgmap v548: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 28 MiB/s wr, 23 op/s 2024-08-20T01:44:02.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:02 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:44:02.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:02 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/3649887198' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:44:02.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:02 smithi175 ceph-mon[22392]: pgmap v548: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 28 MiB/s wr, 23 op/s 2024-08-20T01:44:02.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:02 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:44:02.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:02 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/3649887198' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:44:02.906 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:44:03.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.408+0000 7f1b3d1a5640 1 -- 172.21.15.79:0/3635554731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b381073a0 msgr2=0x7f1b381077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:03.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.408+0000 7f1b3d1a5640 1 --2- 172.21.15.79:0/3635554731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b381073a0 0x7f1b381077e0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c009900 tx=0x7f1b2c02a410 comp rx=0 tx=0).stop 2024-08-20T01:44:03.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.408+0000 7f1b3d1a5640 1 -- 172.21.15.79:0/3635554731 shutdown_connections 2024-08-20T01:44:03.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.408+0000 7f1b3d1a5640 1 --2- 172.21.15.79:0/3635554731 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b38107d20 0x7f1b3810e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:03.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.408+0000 7f1b3d1a5640 1 --2- 172.21.15.79:0/3635554731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b381073a0 0x7f1b381077e0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:03.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.408+0000 7f1b3d1a5640 1 --2- 172.21.15.79:0/3635554731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b38101990 0x7f1b38101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:03.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.408+0000 7f1b3d1a5640 1 -- 172.21.15.79:0/3635554731 >> 172.21.15.79:0/3635554731 conn(0x7f1b380fd400 msgr2=0x7f1b380ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:03.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.409+0000 7f1b3d1a5640 1 -- 172.21.15.79:0/3635554731 shutdown_connections 2024-08-20T01:44:03.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.409+0000 7f1b3d1a5640 1 -- 172.21.15.79:0/3635554731 wait complete. 2024-08-20T01:44:03.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.409+0000 7f1b3d1a5640 1 Processor -- start 2024-08-20T01:44:03.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.410+0000 7f1b3d1a5640 1 -- start start 2024-08-20T01:44:03.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.410+0000 7f1b3d1a5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b38101990 0x7f1b380fd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:03.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.410+0000 7f1b3d1a5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b381073a0 0x7f1b380fde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:03.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.410+0000 7f1b3d1a5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b38107d20 0x7f1b380fe380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:03.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.410+0000 7f1b3d1a5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1b381118e0 con 0x7f1b38101990 2024-08-20T01:44:03.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.410+0000 7f1b3d1a5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1b38111760 con 0x7f1b381073a0 2024-08-20T01:44:03.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.410+0000 7f1b3d1a5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1b38111a60 con 0x7f1b38107d20 2024-08-20T01:44:03.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.410+0000 7f1b36d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b38101990 0x7f1b380fd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:03.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.410+0000 7f1b36d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b38101990 0x7f1b380fd900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58662/0 (socket says 172.21.15.79:58662) 2024-08-20T01:44:03.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.410+0000 7f1b36d9d640 1 -- 172.21.15.79:0/3308955593 learned_addr learned my addr 172.21.15.79:0/3308955593 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:03.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.410+0000 7f1b3659c640 1 --2- 172.21.15.79:0/3308955593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b381073a0 0x7f1b380fde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:03.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.410+0000 7f1b3759e640 1 --2- 172.21.15.79:0/3308955593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b38107d20 0x7f1b380fe380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:03.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.410+0000 7f1b36d9d640 1 -- 172.21.15.79:0/3308955593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b38107d20 msgr2=0x7f1b380fe380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:03.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.410+0000 7f1b36d9d640 1 --2- 172.21.15.79:0/3308955593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b38107d20 0x7f1b380fe380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:03.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.410+0000 7f1b36d9d640 1 -- 172.21.15.79:0/3308955593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b381073a0 msgr2=0x7f1b380fde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:03.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.410+0000 7f1b36d9d640 1 --2- 172.21.15.79:0/3308955593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b381073a0 0x7f1b380fde40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:03.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.410+0000 7f1b36d9d640 1 -- 172.21.15.79:0/3308955593 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b381a73a0 con 0x7f1b38101990 2024-08-20T01:44:03.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.410+0000 7f1b3759e640 1 --2- 172.21.15.79:0/3308955593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b38107d20 0x7f1b380fe380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:44:03.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.411+0000 7f1b36d9d640 1 --2- 172.21.15.79:0/3308955593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b38101990 0x7f1b380fd900 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f1b2800b4a0 tx=0x7f1b2800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:03.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.411+0000 7f1b1ffff640 1 -- 172.21.15.79:0/3308955593 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b28014070 con 0x7f1b38101990 2024-08-20T01:44:03.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.411+0000 7f1b3d1a5640 1 -- 172.21.15.79:0/3308955593 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b381a7690 con 0x7f1b38101990 2024-08-20T01:44:03.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.411+0000 7f1b1ffff640 1 -- 172.21.15.79:0/3308955593 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b28010aa0 con 0x7f1b38101990 2024-08-20T01:44:03.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.411+0000 7f1b1ffff640 1 -- 172.21.15.79:0/3308955593 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b28014070 con 0x7f1b38101990 2024-08-20T01:44:03.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.411+0000 7f1b3d1a5640 1 -- 172.21.15.79:0/3308955593 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b381a7bf0 con 0x7f1b38101990 2024-08-20T01:44:03.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.414+0000 7f1b3f59e740 1 Processor -- start 2024-08-20T01:44:03.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.414+0000 7f1b3f59e740 1 -- start start 2024-08-20T01:44:03.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.414+0000 7f1b1ffff640 1 -- 172.21.15.79:0/3308955593 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1b28017070 con 0x7f1b38101990 2024-08-20T01:44:03.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.414+0000 7f1b3f59e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d69cb73730 0x55d69cb73b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:03.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.414+0000 7f1b3f59e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d69cb74050 0x55d69cb7faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:03.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.414+0000 7f1b3f59e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d69cb7ffe0 0x55d69cb823d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:03.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.414+0000 7f1b3f59e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d69caea930 con 0x55d69cb73730 2024-08-20T01:44:03.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.414+0000 7f1b3f59e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d69cad9e30 con 0x55d69cb74050 2024-08-20T01:44:03.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.414+0000 7f1b3f59e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d69cadde70 con 0x55d69cb7ffe0 2024-08-20T01:44:03.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.414+0000 7f1b3759e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d69cb73730 0x55d69cb73b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:03.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.414+0000 7f1b3759e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d69cb73730 0x55d69cb73b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58674/0 (socket says 172.21.15.79:58674) 2024-08-20T01:44:03.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.414+0000 7f1b3759e640 1 -- 172.21.15.79:0/2005384652 learned_addr learned my addr 172.21.15.79:0/2005384652 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:03.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.414+0000 7f1b36d9d640 1 --2- 172.21.15.79:0/2005384652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d69cb74050 0x55d69cb7faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:03.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.414+0000 7f1b3659c640 1 --2- 172.21.15.79:0/2005384652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d69cb7ffe0 0x55d69cb823d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:03.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.415+0000 7f1b3759e640 1 -- 172.21.15.79:0/2005384652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d69cb7ffe0 msgr2=0x55d69cb823d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:03.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.415+0000 7f1b3759e640 1 --2- 172.21.15.79:0/2005384652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d69cb7ffe0 0x55d69cb823d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:03.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.415+0000 7f1b3759e640 1 -- 172.21.15.79:0/2005384652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d69cb74050 msgr2=0x55d69cb7faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:03.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.415+0000 7f1b3759e640 1 --2- 172.21.15.79:0/2005384652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d69cb74050 0x55d69cb7faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:03.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.415+0000 7f1b3759e640 1 -- 172.21.15.79:0/2005384652 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d69c839650 con 0x55d69cb73730 2024-08-20T01:44:03.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.415+0000 7f1b1ffff640 1 --2- 172.21.15.79:0/3308955593 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1b200b3fc0 0x7f1b200b6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:03.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.415+0000 7f1b3759e640 1 --2- 172.21.15.79:0/2005384652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d69cb73730 0x55d69cb73b10 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f1b3000f440 tx=0x7f1b3000f900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa6b192910d7fcd9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:03.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.415+0000 7f1b1d7fa640 1 -- 172.21.15.79:0/2005384652 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b30004d20 con 0x55d69cb73730 2024-08-20T01:44:03.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.415+0000 7f1b1ffff640 1 -- 172.21.15.79:0/3308955593 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f1b2800d040 con 0x7f1b38101990 2024-08-20T01:44:03.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.415+0000 7f1b36d9d640 1 --2- 172.21.15.79:0/3308955593 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1b200b3fc0 0x7f1b200b6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:03.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.415+0000 7f1b1d7fa640 1 -- 172.21.15.79:0/2005384652 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b30003e00 con 0x55d69cb73730 2024-08-20T01:44:03.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.415+0000 7f1b1d7fa640 1 -- 172.21.15.79:0/2005384652 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b30011500 con 0x55d69cb73730 2024-08-20T01:44:03.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.416+0000 7f1b3f59e740 1 -- 172.21.15.79:0/2005384652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d69cb73730 msgr2=0x55d69cb73b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:03.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.416+0000 7f1b36d9d640 1 --2- 172.21.15.79:0/3308955593 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1b200b3fc0 0x7f1b200b6480 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1b280e0820 tx=0x7f1b280e8550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:03.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.416+0000 7f1b3f59e740 1 --2- 172.21.15.79:0/2005384652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d69cb73730 0x55d69cb73b10 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f1b3000f440 tx=0x7f1b3000f900 comp rx=0 tx=0).stop 2024-08-20T01:44:03.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.416+0000 7f1b3f59e740 1 -- 172.21.15.79:0/2005384652 shutdown_connections 2024-08-20T01:44:03.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.416+0000 7f1b3f59e740 1 --2- 172.21.15.79:0/2005384652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d69cb7ffe0 0x55d69cb823d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:03.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.416+0000 7f1b3f59e740 1 --2- 172.21.15.79:0/2005384652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d69cb74050 0x55d69cb7faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:03.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.416+0000 7f1b3f59e740 1 --2- 172.21.15.79:0/2005384652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d69cb73730 0x55d69cb73b10 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:03.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.416+0000 7f1b3f59e740 1 -- 172.21.15.79:0/2005384652 >> 172.21.15.79:0/2005384652 conn(0x55d69cb71560 msgr2=0x55d69cb72700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:03.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.416+0000 7f1b3f59e740 1 -- 172.21.15.79:0/2005384652 shutdown_connections 2024-08-20T01:44:03.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.416+0000 7f1b3f59e740 1 -- 172.21.15.79:0/2005384652 wait complete. 2024-08-20T01:44:03.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.417+0000 7f1b3f59e740 1 -- start start 2024-08-20T01:44:03.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.417+0000 7f1b3f59e740 1 Processor -- start 2024-08-20T01:44:03.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.417+0000 7f1b3f59e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d69cb73730 0x55d69cb7cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:03.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.417+0000 7f1b3f59e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d69cb74050 0x55d69cb7d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:03.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.417+0000 7f1b3f59e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d69cb7ffe0 0x55d69cb7da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:03.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.417+0000 7f1b3f59e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d69c93c700 con 0x55d69cb73730 2024-08-20T01:44:03.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.417+0000 7f1b3f59e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d69ca60810 con 0x55d69cb7ffe0 2024-08-20T01:44:03.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.417+0000 7f1b3f59e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d69cb82c90 con 0x55d69cb74050 2024-08-20T01:44:03.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.417+0000 7f1b3f59e740 10 client.0 _ll_register_callbacks cb 0x55d69cad3700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:44:03.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.417+0000 7f1b3659c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d69cb74050 0x55d69cb7d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:03.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.418+0000 7f1b3659c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d69cb74050 0x55d69cb7d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:55506/0 (socket says 172.21.15.79:55506) 2024-08-20T01:44:03.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.418+0000 7f1b3659c640 1 -- 172.21.15.79:0/1788034868 learned_addr learned my addr 172.21.15.79:0/1788034868 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:03.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.418+0000 7f1b3759e640 1 --2- 172.21.15.79:0/1788034868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d69cb73730 0x55d69cb7cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:03.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.418+0000 7f1b3659c640 1 -- 172.21.15.79:0/1788034868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d69cb7ffe0 msgr2=0x55d69cb7da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:03.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.418+0000 7f1b3659c640 1 --2- 172.21.15.79:0/1788034868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d69cb7ffe0 0x55d69cb7da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:03.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.418+0000 7f1b3659c640 1 -- 172.21.15.79:0/1788034868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d69cb73730 msgr2=0x55d69cb7cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:03.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.418+0000 7f1b3659c640 1 --2- 172.21.15.79:0/1788034868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d69cb73730 0x55d69cb7cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:03.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.418+0000 7f1b3659c640 1 -- 172.21.15.79:0/1788034868 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d69cb948a0 con 0x55d69cb74050 2024-08-20T01:44:03.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.418+0000 7f1b3759e640 1 --2- 172.21.15.79:0/1788034868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d69cb73730 0x55d69cb7cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:44:03.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.418+0000 7f1b3659c640 1 --2- 172.21.15.79:0/1788034868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d69cb74050 0x55d69cb7d500 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c033000 tx=0x7f1b2c0035f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d85a8361db688ebe server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:03.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.418+0000 7f1b1aff5640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:44:03.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.419+0000 7f1b1aff5640 1 -- 172.21.15.79:0/1788034868 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c035040 con 0x55d69cb74050 2024-08-20T01:44:03.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.419+0000 7f1b3f59e740 1 -- 172.21.15.79:0/1788034868 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d69ca89150 con 0x55d69cb74050 2024-08-20T01:44:03.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.419+0000 7f1b1aff5640 1 -- 172.21.15.79:0/1788034868 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f1b2c003a20 con 0x55d69cb74050 2024-08-20T01:44:03.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.419+0000 7f1b1aff5640 1 -- 172.21.15.79:0/1788034868 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f1b2c003c20 con 0x55d69cb74050 2024-08-20T01:44:03.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.419+0000 7f1b3f59e740 10 client.26545 fetch_fsmap learned FSMap version 39 2024-08-20T01:44:03.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.419+0000 7f1b3f59e740 1 -- 172.21.15.79:0/1788034868 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55d69cb972a0 con 0x55d69cb74050 2024-08-20T01:44:03.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.419+0000 7f1b1aff5640 1 -- 172.21.15.79:0/1788034868 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55d69ca89150 con 0x55d69cb74050 2024-08-20T01:44:03.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.419+0000 7f1b1aff5640 1 -- 172.21.15.79:0/1788034868 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 39) ==== 8370+0+0 (secure 0 0 0) 0x7f1b2c03c450 con 0x55d69cb74050 2024-08-20T01:44:03.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.419+0000 7f1b3f59e740 10 client.26545 fetch_fsmap finished waiting for FSMap version 39 2024-08-20T01:44:03.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.419+0000 7f1b3f59e740 10 client.26545 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:44:03.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.419+0000 7f1b3f59e740 20 client.26545 populate_metadata read hostname 'smithi079' 2024-08-20T01:44:03.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.419+0000 7f1b3f59e740 1 --2- 172.21.15.79:0/1788034868 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55d69cb98750 0x55d69cb9abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:03.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.419+0000 7f1b3f59e740 4 client.26545 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:44:03.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.419+0000 7f1b3f59e740 1 -- 172.21.15.79:0/1788034868 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d69caec880 con 0x55d69cb98750 2024-08-20T01:44:03.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.420+0000 7f1b3759e640 1 --2- 172.21.15.79:0/1788034868 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55d69cb98750 0x55d69cb9abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:03.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.420+0000 7f1b1aff5640 10 client.26545 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:44:03.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.420+0000 7f1b3759e640 1 --2- 172.21.15.79:0/1788034868 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55d69cb98750 0x55d69cb9abb0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=89a27141e8ebdbcd server_cookie=ee1825db2e5d871 in_seq=0 out_seq=0 2024-08-20T01:44:03.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.421+0000 7f1b1aff5640 1 -- 172.21.15.79:0/1788034868 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d69caec880 con 0x55d69cb98750 2024-08-20T01:44:03.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.421+0000 7f1b1aff5640 10 client.26545 handle_command_reply: tid=0 2024-08-20T01:44:03.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.421+0000 7f1b3f59e740 1 client.26545 shutdown 2024-08-20T01:44:03.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.421+0000 7f1b3f59e740 1 -- 172.21.15.79:0/1788034868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d69cb74050 msgr2=0x55d69cb7d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:03.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.421+0000 7f1b3f59e740 1 --2- 172.21.15.79:0/1788034868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d69cb74050 0x55d69cb7d500 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c033000 tx=0x7f1b2c0035f0 comp rx=0 tx=0).stop 2024-08-20T01:44:03.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.421+0000 7f1b3f59e740 1 -- 172.21.15.79:0/1788034868 shutdown_connections 2024-08-20T01:44:03.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.421+0000 7f1b3f59e740 1 --2- 172.21.15.79:0/1788034868 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55d69cb98750 0x55d69cb9abb0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:03.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.421+0000 7f1b3f59e740 1 --2- 172.21.15.79:0/1788034868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d69cb7ffe0 0x55d69cb7da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:03.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.421+0000 7f1b3f59e740 1 --2- 172.21.15.79:0/1788034868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d69cb74050 0x55d69cb7d500 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:03.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.421+0000 7f1b1aff5640 0 client.26545 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:44:03.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.421+0000 7f1b3f59e740 1 --2- 172.21.15.79:0/1788034868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d69cb73730 0x55d69cb7cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:03.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.421+0000 7f1b3f59e740 1 -- 172.21.15.79:0/1788034868 >> 172.21.15.79:0/1788034868 conn(0x55d69cb71560 msgr2=0x55d69cb77100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:03.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.422+0000 7f1b3f59e740 1 -- 172.21.15.79:0/1788034868 shutdown_connections 2024-08-20T01:44:03.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.422+0000 7f1b3f59e740 1 -- 172.21.15.79:0/1788034868 wait complete. 2024-08-20T01:44:03.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.422+0000 7f1b3f59e740 20 client.26545 trim_cache size 0 max 16384 2024-08-20T01:44:03.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.436+0000 7f1b3f59e740 1 Processor -- start 2024-08-20T01:44:03.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.436+0000 7f1b3f59e740 1 -- start start 2024-08-20T01:44:03.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.436+0000 7f1b3f59e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d69cb73730 0x55d69cb703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:03.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.436+0000 7f1b3f59e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d69cb74050 0x55d69cba0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:03.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.436+0000 7f1b3f59e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d69cb7ffe0 0x55d69cba09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:03.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.436+0000 7f1b3f59e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1b381abe40 con 0x55d69cb73730 2024-08-20T01:44:03.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.436+0000 7f1b3f59e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1b381ad9e0 con 0x55d69cb74050 2024-08-20T01:44:03.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.436+0000 7f1b3f59e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1b381ac510 con 0x55d69cb7ffe0 2024-08-20T01:44:03.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.436+0000 7f1b3759e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d69cb73730 0x55d69cb703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:03.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.436+0000 7f1b3759e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d69cb73730 0x55d69cb703e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58696/0 (socket says 172.21.15.79:58696) 2024-08-20T01:44:03.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.436+0000 7f1b3759e640 1 -- 172.21.15.79:0/2190182205 learned_addr learned my addr 172.21.15.79:0/2190182205 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:03.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.436+0000 7f1b3659c640 1 --2- 172.21.15.79:0/2190182205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d69cb74050 0x55d69cba0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:03.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.437+0000 7f1b3759e640 1 --2- 172.21.15.79:0/2190182205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d69cb7ffe0 0x55d69cba09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:03.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.437+0000 7f1b3759e640 1 -- 172.21.15.79:0/2190182205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d69cb7ffe0 msgr2=0x55d69cba09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:03.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.437+0000 7f1b3759e640 1 --2- 172.21.15.79:0/2190182205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d69cb7ffe0 0x55d69cba09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:03.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.437+0000 7f1b3759e640 1 -- 172.21.15.79:0/2190182205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d69cb74050 msgr2=0x55d69cba0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:03.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.437+0000 7f1b3759e640 1 --2- 172.21.15.79:0/2190182205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d69cb74050 0x55d69cba0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:03.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.437+0000 7f1b3759e640 1 -- 172.21.15.79:0/2190182205 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d69cb71fe0 con 0x55d69cb73730 2024-08-20T01:44:03.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.437+0000 7f1b3659c640 1 --2- 172.21.15.79:0/2190182205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d69cb74050 0x55d69cba0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:44:03.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.437+0000 7f1b3759e640 1 --2- 172.21.15.79:0/2190182205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d69cb73730 0x55d69cb703e0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f1b30004590 tx=0x7f1b30004660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ec2bfe8ec821255 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:03.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.437+0000 7f1b1cff9640 1 -- 172.21.15.79:0/2190182205 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3002e070 con 0x55d69cb73730 2024-08-20T01:44:03.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.437+0000 7f1b1cff9640 1 -- 172.21.15.79:0/2190182205 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b30004be0 con 0x55d69cb73730 2024-08-20T01:44:03.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.437+0000 7f1b1cff9640 1 -- 172.21.15.79:0/2190182205 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b30003970 con 0x55d69cb73730 2024-08-20T01:44:03.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.438+0000 7f1b3f59e740 1 -- 172.21.15.79:0/2190182205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d69cb73730 msgr2=0x55d69cb703e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:03.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.438+0000 7f1b3f59e740 1 --2- 172.21.15.79:0/2190182205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d69cb73730 0x55d69cb703e0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f1b30004590 tx=0x7f1b30004660 comp rx=0 tx=0).stop 2024-08-20T01:44:03.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.438+0000 7f1b3f59e740 1 -- 172.21.15.79:0/2190182205 shutdown_connections 2024-08-20T01:44:03.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.438+0000 7f1b3f59e740 1 --2- 172.21.15.79:0/2190182205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d69cb7ffe0 0x55d69cba09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:03.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.438+0000 7f1b3f59e740 1 --2- 172.21.15.79:0/2190182205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d69cb74050 0x55d69cba0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:03.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.438+0000 7f1b3f59e740 1 --2- 172.21.15.79:0/2190182205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d69cb73730 0x55d69cb703e0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:03.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.438+0000 7f1b3f59e740 1 -- 172.21.15.79:0/2190182205 >> 172.21.15.79:0/2190182205 conn(0x55d69cb71560 msgr2=0x55d69cb6fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:03.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.438+0000 7f1b3f59e740 1 -- 172.21.15.79:0/2190182205 shutdown_connections 2024-08-20T01:44:03.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.438+0000 7f1b3f59e740 1 -- 172.21.15.79:0/2190182205 wait complete. 2024-08-20T01:44:03.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.438+0000 7f1b3f59e740 1 -- start start 2024-08-20T01:44:03.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.439+0000 7f1b3f59e740 1 Processor -- start 2024-08-20T01:44:03.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.439+0000 7f1b3f59e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d69cb73730 0x55d69cb90a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:03.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.439+0000 7f1b3f59e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d69cb74050 0x55d69cb90fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:03.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.439+0000 7f1b3f59e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d69cb7ffe0 0x55d69cb79aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:03.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.439+0000 7f1b3f59e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1b381ad310 con 0x55d69cb7ffe0 2024-08-20T01:44:03.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.439+0000 7f1b3f59e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1b381acbe0 con 0x55d69cb74050 2024-08-20T01:44:03.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.439+0000 7f1b3f59e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1b381a9ee0 con 0x55d69cb73730 2024-08-20T01:44:03.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.439+0000 7f1b3f59e740 10 client.0 _ll_register_callbacks cb 0x7f1b2c0042e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:44:03.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.439+0000 7f1b3759e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d69cb7ffe0 0x55d69cb79aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:03.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.439+0000 7f1b3759e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d69cb7ffe0 0x55d69cb79aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58704/0 (socket says 172.21.15.79:58704) 2024-08-20T01:44:03.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.439+0000 7f1b3759e640 1 -- 172.21.15.79:0/2271549409 learned_addr learned my addr 172.21.15.79:0/2271549409 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:03.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.439+0000 7f1b3759e640 1 --2- 172.21.15.79:0/2271549409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d69cb73730 0x55d69cb90a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:03.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.439+0000 7f1b3659c640 1 --2- 172.21.15.79:0/2271549409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d69cb74050 0x55d69cb90fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:03.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.439+0000 7f1b3759e640 1 -- 172.21.15.79:0/2271549409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d69cb73730 msgr2=0x55d69cb90a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:03.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.439+0000 7f1b3759e640 1 --2- 172.21.15.79:0/2271549409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d69cb73730 0x55d69cb90a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:03.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.439+0000 7f1b3759e640 1 -- 172.21.15.79:0/2271549409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d69cb74050 msgr2=0x55d69cb90fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:03.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.439+0000 7f1b3759e640 1 --2- 172.21.15.79:0/2271549409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d69cb74050 0x55d69cb90fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:03.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.439+0000 7f1b3759e640 1 -- 172.21.15.79:0/2271549409 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d69cb7a2d0 con 0x55d69cb7ffe0 2024-08-20T01:44:03.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.440+0000 7f1b3759e640 1 --2- 172.21.15.79:0/2271549409 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d69cb7ffe0 0x55d69cb79aa0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f1b30006010 tx=0x7f1b300045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c6294e0a6af9167 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:03.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.440+0000 7f1b1aff5640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:44:03.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.440+0000 7f1b1aff5640 1 -- 172.21.15.79:0/2271549409 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3002e020 con 0x55d69cb7ffe0 2024-08-20T01:44:03.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.440+0000 7f1b1aff5640 1 -- 172.21.15.79:0/2271549409 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f1b300283b0 con 0x55d69cb7ffe0 2024-08-20T01:44:03.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.440+0000 7f1b3f59e740 1 -- 172.21.15.79:0/2271549409 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b30004be0 con 0x55d69cb7ffe0 2024-08-20T01:44:03.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.440+0000 7f1b1aff5640 1 -- 172.21.15.79:0/2271549409 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f1b300285b0 con 0x55d69cb7ffe0 2024-08-20T01:44:03.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.440+0000 7f1b3f59e740 10 client.17493 fetch_fsmap learned FSMap version 39 2024-08-20T01:44:03.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.440+0000 7f1b3f59e740 1 -- 172.21.15.79:0/2271549409 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55d69cc030b0 con 0x55d69cb7ffe0 2024-08-20T01:44:03.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.440+0000 7f1b1aff5640 1 -- 172.21.15.79:0/2271549409 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b30004be0 con 0x55d69cb7ffe0 2024-08-20T01:44:03.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.440+0000 7f1b1aff5640 1 -- 172.21.15.79:0/2271549409 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 39) ==== 8370+0+0 (secure 0 0 0) 0x7f1b30011500 con 0x55d69cb7ffe0 2024-08-20T01:44:03.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.441+0000 7f1b3f59e740 10 client.17493 fetch_fsmap finished waiting for FSMap version 39 2024-08-20T01:44:03.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.441+0000 7f1b3f59e740 10 client.17493 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:44:03.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.441+0000 7f1b3f59e740 20 client.17493 populate_metadata read hostname 'smithi079' 2024-08-20T01:44:03.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.441+0000 7f1b3f59e740 1 --2- 172.21.15.79:0/2271549409 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55d69cb98750 0x55d69cc05520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:03.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.441+0000 7f1b3f59e740 4 client.17493 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:44:03.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.441+0000 7f1b3f59e740 1 -- 172.21.15.79:0/2271549409 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d69cae8320 con 0x55d69cb98750 2024-08-20T01:44:03.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.441+0000 7f1b3659c640 1 --2- 172.21.15.79:0/2271549409 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55d69cb98750 0x55d69cc05520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:03.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.441+0000 7f1b1aff5640 10 client.17493 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:44:03.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.441+0000 7f1b3659c640 1 --2- 172.21.15.79:0/2271549409 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55d69cb98750 0x55d69cc05520 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=658d28f416c462f1 server_cookie=36a0faa5aacc2152 in_seq=0 out_seq=0 2024-08-20T01:44:03.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.442+0000 7f1b1aff5640 1 -- 172.21.15.79:0/2271549409 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d69cae8320 con 0x55d69cb98750 2024-08-20T01:44:03.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.442+0000 7f1b1aff5640 10 client.17493 handle_command_reply: tid=0 2024-08-20T01:44:03.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.442+0000 7f1b3f59e740 1 client.17493 shutdown 2024-08-20T01:44:03.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.442+0000 7f1b3f59e740 1 -- 172.21.15.79:0/2271549409 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d69cb7ffe0 msgr2=0x55d69cb79aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:03.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.442+0000 7f1b3f59e740 1 --2- 172.21.15.79:0/2271549409 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d69cb7ffe0 0x55d69cb79aa0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f1b30006010 tx=0x7f1b300045c0 comp rx=0 tx=0).stop 2024-08-20T01:44:03.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.442+0000 7f1b3f59e740 1 -- 172.21.15.79:0/2271549409 shutdown_connections 2024-08-20T01:44:03.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.442+0000 7f1b3f59e740 1 --2- 172.21.15.79:0/2271549409 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55d69cb98750 0x55d69cc05520 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:03.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.442+0000 7f1b3f59e740 1 --2- 172.21.15.79:0/2271549409 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d69cb7ffe0 0x55d69cb79aa0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:03.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.442+0000 7f1b3f59e740 1 --2- 172.21.15.79:0/2271549409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d69cb74050 0x55d69cb90fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:03.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.442+0000 7f1b3f59e740 1 --2- 172.21.15.79:0/2271549409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d69cb73730 0x55d69cb90a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:03.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.442+0000 7f1b1aff5640 0 client.17493 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:44:03.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.442+0000 7f1b3f59e740 1 -- 172.21.15.79:0/2271549409 >> 172.21.15.79:0/2271549409 conn(0x55d69cb71560 msgr2=0x55d69cb7e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:03.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.442+0000 7f1b3f59e740 1 -- 172.21.15.79:0/2271549409 shutdown_connections 2024-08-20T01:44:03.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.442+0000 7f1b3f59e740 1 -- 172.21.15.79:0/2271549409 wait complete. 2024-08-20T01:44:03.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.442+0000 7f1b3f59e740 20 client.17493 trim_cache size 0 max 16384 2024-08-20T01:44:03.450 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:44:03.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.443+0000 7f1b3d1a5640 1 -- 172.21.15.79:0/3308955593 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1b200b3fc0 msgr2=0x7f1b200b6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:03.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.443+0000 7f1b3d1a5640 1 --2- 172.21.15.79:0/3308955593 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1b200b3fc0 0x7f1b200b6480 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1b280e0820 tx=0x7f1b280e8550 comp rx=0 tx=0).stop 2024-08-20T01:44:03.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.443+0000 7f1b3d1a5640 1 -- 172.21.15.79:0/3308955593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b38101990 msgr2=0x7f1b380fd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:03.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.443+0000 7f1b3d1a5640 1 --2- 172.21.15.79:0/3308955593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b38101990 0x7f1b380fd900 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f1b2800b4a0 tx=0x7f1b2800b960 comp rx=0 tx=0).stop 2024-08-20T01:44:03.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.443+0000 7f1b3d1a5640 1 -- 172.21.15.79:0/3308955593 shutdown_connections 2024-08-20T01:44:03.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.443+0000 7f1b3d1a5640 1 --2- 172.21.15.79:0/3308955593 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1b200b3fc0 0x7f1b200b6480 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:03.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.443+0000 7f1b3d1a5640 1 --2- 172.21.15.79:0/3308955593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b38107d20 0x7f1b380fe380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:03.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.443+0000 7f1b3d1a5640 1 --2- 172.21.15.79:0/3308955593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b381073a0 0x7f1b380fde40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:03.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.443+0000 7f1b3d1a5640 1 --2- 172.21.15.79:0/3308955593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b38101990 0x7f1b380fd900 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:03.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.443+0000 7f1b3d1a5640 1 -- 172.21.15.79:0/3308955593 >> 172.21.15.79:0/3308955593 conn(0x7f1b380fd400 msgr2=0x7f1b38100310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:03.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.443+0000 7f1b3d1a5640 1 -- 172.21.15.79:0/3308955593 shutdown_connections 2024-08-20T01:44:03.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:03.443+0000 7f1b3d1a5640 1 -- 172.21.15.79:0/3308955593 wait complete. 2024-08-20T01:44:04.198 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-20T01:44:04.480 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:44:04.745 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:04 smithi079 ceph-mon[18656]: pgmap v549: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 29 MiB/s wr, 23 op/s 2024-08-20T01:44:04.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:04 smithi081 ceph-mon[22209]: pgmap v549: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 29 MiB/s wr, 23 op/s 2024-08-20T01:44:04.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:04 smithi175 ceph-mon[22392]: pgmap v549: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 29 MiB/s wr, 23 op/s 2024-08-20T01:44:04.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.973+0000 7f9728177640 1 -- 172.21.15.79:0/3766768790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9720108e30 msgr2=0x7f972010f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:04.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.973+0000 7f9728177640 1 --2- 172.21.15.79:0/3766768790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9720108e30 0x7f972010f630 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f9718009ca0 tx=0x7f971802a8c0 comp rx=0 tx=0).stop 2024-08-20T01:44:04.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.973+0000 7f9728177640 1 -- 172.21.15.79:0/3766768790 shutdown_connections 2024-08-20T01:44:04.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.973+0000 7f9728177640 1 --2- 172.21.15.79:0/3766768790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9720108e30 0x7f972010f630 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:04.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.973+0000 7f9728177640 1 --2- 172.21.15.79:0/3766768790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97201084b0 0x7f97201088f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:04.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.973+0000 7f9728177640 1 --2- 172.21.15.79:0/3766768790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9720102aa0 0x7f9720102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:04.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.973+0000 7f9728177640 1 -- 172.21.15.79:0/3766768790 >> 172.21.15.79:0/3766768790 conn(0x7f97200fe550 msgr2=0x7f9720100970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:04.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.973+0000 7f9728177640 1 -- 172.21.15.79:0/3766768790 shutdown_connections 2024-08-20T01:44:04.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.973+0000 7f9728177640 1 -- 172.21.15.79:0/3766768790 wait complete. 2024-08-20T01:44:04.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.974+0000 7f9728177640 1 Processor -- start 2024-08-20T01:44:04.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.974+0000 7f9728177640 1 -- start start 2024-08-20T01:44:04.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.974+0000 7f9728177640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9720102aa0 0x7f97200751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:04.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.974+0000 7f9728177640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97201084b0 0x7f9720075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:04.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.974+0000 7f9728177640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9720108e30 0x7f9720075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:04.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.974+0000 7f9728177640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f97201129f0 con 0x7f9720102aa0 2024-08-20T01:44:04.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.974+0000 7f9728177640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9720112870 con 0x7f97201084b0 2024-08-20T01:44:04.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.974+0000 7f9728177640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9720112b70 con 0x7f9720108e30 2024-08-20T01:44:04.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.974+0000 7f9725f13640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9720102aa0 0x7f97200751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:04.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.974+0000 7f9725f13640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9720102aa0 0x7f97200751d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58718/0 (socket says 172.21.15.79:58718) 2024-08-20T01:44:04.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.974+0000 7f9725f13640 1 -- 172.21.15.79:0/2008604780 learned_addr learned my addr 172.21.15.79:0/2008604780 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:04.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.974+0000 7f9725712640 1 --2- 172.21.15.79:0/2008604780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97201084b0 0x7f9720075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:04.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.974+0000 7f9726714640 1 --2- 172.21.15.79:0/2008604780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9720108e30 0x7f9720075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:04.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.974+0000 7f9725f13640 1 -- 172.21.15.79:0/2008604780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9720108e30 msgr2=0x7f9720075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:04.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.974+0000 7f9725f13640 1 --2- 172.21.15.79:0/2008604780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9720108e30 0x7f9720075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:04.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.974+0000 7f9725f13640 1 -- 172.21.15.79:0/2008604780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97201084b0 msgr2=0x7f9720075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:04.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.974+0000 7f9725f13640 1 --2- 172.21.15.79:0/2008604780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97201084b0 0x7f9720075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:04.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.974+0000 7f9725f13640 1 -- 172.21.15.79:0/2008604780 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97201a72e0 con 0x7f9720102aa0 2024-08-20T01:44:04.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.975+0000 7f9725f13640 1 --2- 172.21.15.79:0/2008604780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9720102aa0 0x7f97200751d0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f971c00c890 tx=0x7f971c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:04.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.975+0000 7f9716ffd640 1 -- 172.21.15.79:0/2008604780 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971c004220 con 0x7f9720102aa0 2024-08-20T01:44:04.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.975+0000 7f9716ffd640 1 -- 172.21.15.79:0/2008604780 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f971c007e40 con 0x7f9720102aa0 2024-08-20T01:44:04.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.975+0000 7f9716ffd640 1 -- 172.21.15.79:0/2008604780 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971c0047a0 con 0x7f9720102aa0 2024-08-20T01:44:04.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.975+0000 7f9728177640 1 -- 172.21.15.79:0/2008604780 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97201a75d0 con 0x7f9720102aa0 2024-08-20T01:44:04.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.975+0000 7f9728177640 1 -- 172.21.15.79:0/2008604780 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97201a7ac0 con 0x7f9720102aa0 2024-08-20T01:44:04.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.977+0000 7f9716ffd640 1 -- 172.21.15.79:0/2008604780 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f971c0079b0 con 0x7f9720102aa0 2024-08-20T01:44:04.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.978+0000 7f972a570740 1 Processor -- start 2024-08-20T01:44:04.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.978+0000 7f972a570740 1 -- start start 2024-08-20T01:44:04.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.978+0000 7f972a570740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c74215880 0x555c74215c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:04.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.978+0000 7f972a570740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c742161a0 0x555c74221bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:04.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.978+0000 7f972a570740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c74222130 0x555c74224520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:04.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.978+0000 7f972a570740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555c7418c930 con 0x555c742161a0 2024-08-20T01:44:04.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.978+0000 7f972a570740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555c7417be30 con 0x555c74215880 2024-08-20T01:44:04.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.978+0000 7f972a570740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555c7417fe70 con 0x555c74222130 2024-08-20T01:44:04.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.978+0000 7f9725f13640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c742161a0 0x555c74221bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:04.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.978+0000 7f9726714640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c74215880 0x555c74215c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:04.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.978+0000 7f9726714640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c74215880 0x555c74215c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:54346/0 (socket says 172.21.15.79:54346) 2024-08-20T01:44:04.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.978+0000 7f9726714640 1 -- 172.21.15.79:0/16232428 learned_addr learned my addr 172.21.15.79:0/16232428 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:04.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.978+0000 7f9725712640 1 --2- 172.21.15.79:0/16232428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c74222130 0x555c74224520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:04.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.979+0000 7f9716ffd640 1 --2- 172.21.15.79:0/2008604780 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f970c0b3c50 0x7f970c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:04.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.979+0000 7f9726714640 1 -- 172.21.15.79:0/16232428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c74222130 msgr2=0x555c74224520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:04.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.979+0000 7f9726714640 1 --2- 172.21.15.79:0/16232428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c74222130 0x555c74224520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:04.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.979+0000 7f9726714640 1 -- 172.21.15.79:0/16232428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c742161a0 msgr2=0x555c74221bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:04.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.979+0000 7f9726714640 1 --2- 172.21.15.79:0/16232428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c742161a0 0x555c74221bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:04.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.979+0000 7f9726714640 1 -- 172.21.15.79:0/16232428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c73edb650 con 0x555c74215880 2024-08-20T01:44:04.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.979+0000 7f9716ffd640 1 -- 172.21.15.79:0/2008604780 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f971c0e3880 con 0x7f9720102aa0 2024-08-20T01:44:04.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.979+0000 7f9726714640 1 --2- 172.21.15.79:0/16232428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c74215880 0x555c74215c60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9718005cc0 tx=0x7f9718009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ca4ba8833123467 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:04.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.979+0000 7f9726714640 1 --2- 172.21.15.79:0/2008604780 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f970c0b3c50 0x7f970c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:04.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.979+0000 7f970bfff640 1 -- 172.21.15.79:0/16232428 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971804d070 con 0x555c74215880 2024-08-20T01:44:04.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.980+0000 7f970bfff640 1 -- 172.21.15.79:0/16232428 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9718036040 con 0x555c74215880 2024-08-20T01:44:04.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.980+0000 7f970bfff640 1 -- 172.21.15.79:0/16232428 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9718030820 con 0x555c74215880 2024-08-20T01:44:04.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.980+0000 7f972a570740 1 -- 172.21.15.79:0/16232428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c74215880 msgr2=0x555c74215c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:04.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.980+0000 7f972a570740 1 --2- 172.21.15.79:0/16232428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c74215880 0x555c74215c60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9718005cc0 tx=0x7f9718009a20 comp rx=0 tx=0).stop 2024-08-20T01:44:04.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.980+0000 7f9726714640 1 --2- 172.21.15.79:0/2008604780 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f970c0b3c50 0x7f970c0b6110 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f971804a000 tx=0x7f971804b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:04.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.980+0000 7f972a570740 1 -- 172.21.15.79:0/16232428 shutdown_connections 2024-08-20T01:44:04.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.980+0000 7f972a570740 1 --2- 172.21.15.79:0/16232428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c74222130 0x555c74224520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:04.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.980+0000 7f972a570740 1 --2- 172.21.15.79:0/16232428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c742161a0 0x555c74221bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:04.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.980+0000 7f972a570740 1 --2- 172.21.15.79:0/16232428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c74215880 0x555c74215c60 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:04.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.980+0000 7f972a570740 1 -- 172.21.15.79:0/16232428 >> 172.21.15.79:0/16232428 conn(0x555c742136b0 msgr2=0x555c74214850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:04.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.981+0000 7f972a570740 1 -- 172.21.15.79:0/16232428 shutdown_connections 2024-08-20T01:44:04.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.981+0000 7f972a570740 1 -- 172.21.15.79:0/16232428 wait complete. 2024-08-20T01:44:04.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.981+0000 7f972a570740 1 -- start start 2024-08-20T01:44:04.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.981+0000 7f972a570740 1 Processor -- start 2024-08-20T01:44:04.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.981+0000 7f972a570740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c74215880 0x555c7421f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:04.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.981+0000 7f972a570740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c742161a0 0x555c7421f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:04.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.981+0000 7f972a570740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c74222130 0x555c7421fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:04.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.981+0000 7f972a570740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555c73fde700 con 0x555c74215880 2024-08-20T01:44:04.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.981+0000 7f972a570740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555c74102810 con 0x555c74222130 2024-08-20T01:44:04.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.982+0000 7f972a570740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555c74224de0 con 0x555c742161a0 2024-08-20T01:44:04.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.982+0000 7f9725f13640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c74215880 0x555c7421f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:04.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.982+0000 7f9725f13640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c74215880 0x555c7421f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58726/0 (socket says 172.21.15.79:58726) 2024-08-20T01:44:04.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.982+0000 7f9725f13640 1 -- 172.21.15.79:0/1025932479 learned_addr learned my addr 172.21.15.79:0/1025932479 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:04.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.982+0000 7f972a570740 10 client.0 _ll_register_callbacks cb 0x555c74175700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:44:04.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.982+0000 7f9726714640 1 --2- 172.21.15.79:0/1025932479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c74222130 0x555c7421fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:04.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.982+0000 7f9725712640 1 --2- 172.21.15.79:0/1025932479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c742161a0 0x555c7421f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:04.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.982+0000 7f9725f13640 1 -- 172.21.15.79:0/1025932479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c742161a0 msgr2=0x555c7421f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:04.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.982+0000 7f9725f13640 1 --2- 172.21.15.79:0/1025932479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c742161a0 0x555c7421f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:04.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.982+0000 7f9725f13640 1 -- 172.21.15.79:0/1025932479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c74222130 msgr2=0x555c7421fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:04.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.982+0000 7f9725f13640 1 --2- 172.21.15.79:0/1025932479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c74222130 0x555c7421fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:04.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.982+0000 7f9725f13640 1 -- 172.21.15.79:0/1025932479 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c7422e1b0 con 0x555c74215880 2024-08-20T01:44:04.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.982+0000 7f9726714640 1 --2- 172.21.15.79:0/1025932479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c74222130 0x555c7421fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:44:04.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.982+0000 7f9725f13640 1 --2- 172.21.15.79:0/1025932479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c74215880 0x555c7421f090 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f971c0a7a50 tx=0x7f971c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5644bbd39bfce4b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:04.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.982+0000 7f97097fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:44:04.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.982+0000 7f97097fa640 1 -- 172.21.15.79:0/1025932479 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971c01d070 con 0x555c74215880 2024-08-20T01:44:04.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.982+0000 7f97097fa640 1 -- 172.21.15.79:0/1025932479 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f971c0cd280 con 0x555c74215880 2024-08-20T01:44:04.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.982+0000 7f972a570740 1 -- 172.21.15.79:0/1025932479 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555c7412b150 con 0x555c74215880 2024-08-20T01:44:04.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.983+0000 7f97097fa640 1 -- 172.21.15.79:0/1025932479 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f971c0aa5b0 con 0x555c74215880 2024-08-20T01:44:04.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.983+0000 7f972a570740 10 client.17505 fetch_fsmap learned FSMap version 39 2024-08-20T01:44:04.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.983+0000 7f972a570740 1 -- 172.21.15.79:0/1025932479 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x555c74230b60 con 0x555c74215880 2024-08-20T01:44:04.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.983+0000 7f97097fa640 1 -- 172.21.15.79:0/1025932479 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x555c7412b150 con 0x555c74215880 2024-08-20T01:44:04.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.983+0000 7f97097fa640 1 -- 172.21.15.79:0/1025932479 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 39) ==== 8370+0+0 (secure 0 0 0) 0x7f971c0cbce0 con 0x555c74215880 2024-08-20T01:44:04.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.983+0000 7f972a570740 10 client.17505 fetch_fsmap finished waiting for FSMap version 39 2024-08-20T01:44:04.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.983+0000 7f972a570740 10 client.17505 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:44:04.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.983+0000 7f972a570740 20 client.17505 populate_metadata read hostname 'smithi079' 2024-08-20T01:44:04.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.983+0000 7f972a570740 1 --2- 172.21.15.79:0/1025932479 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x555c74232070 0x555c742344d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:04.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.983+0000 7f972a570740 4 client.17505 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:44:04.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.983+0000 7f972a570740 1 -- 172.21.15.79:0/1025932479 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c7418e880 con 0x555c74232070 2024-08-20T01:44:04.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.983+0000 7f9725712640 1 --2- 172.21.15.79:0/1025932479 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x555c74232070 0x555c742344d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:04.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.984+0000 7f97097fa640 10 client.17505 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:44:04.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.984+0000 7f9725712640 1 --2- 172.21.15.79:0/1025932479 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x555c74232070 0x555c742344d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=17b61ba60aca49f5 server_cookie=3aca2c23f307ee02 in_seq=0 out_seq=0 2024-08-20T01:44:04.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.985+0000 7f97097fa640 1 -- 172.21.15.79:0/1025932479 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555c7418e880 con 0x555c74232070 2024-08-20T01:44:04.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.985+0000 7f97097fa640 10 client.17505 handle_command_reply: tid=0 2024-08-20T01:44:04.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.985+0000 7f972a570740 1 client.17505 shutdown 2024-08-20T01:44:04.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.985+0000 7f972a570740 1 -- 172.21.15.79:0/1025932479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c74215880 msgr2=0x555c7421f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:04.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.985+0000 7f972a570740 1 --2- 172.21.15.79:0/1025932479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c74215880 0x555c7421f090 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f971c0a7a50 tx=0x7f971c004730 comp rx=0 tx=0).stop 2024-08-20T01:44:04.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.985+0000 7f972a570740 1 -- 172.21.15.79:0/1025932479 shutdown_connections 2024-08-20T01:44:04.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.985+0000 7f972a570740 1 --2- 172.21.15.79:0/1025932479 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x555c74232070 0x555c742344d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:04.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.985+0000 7f97097fa640 0 client.17505 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:44:04.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.985+0000 7f972a570740 1 --2- 172.21.15.79:0/1025932479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c74222130 0x555c7421fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:04.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.985+0000 7f972a570740 1 --2- 172.21.15.79:0/1025932479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c742161a0 0x555c7421f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:04.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.985+0000 7f972a570740 1 --2- 172.21.15.79:0/1025932479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c74215880 0x555c7421f090 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:04.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.985+0000 7f972a570740 1 -- 172.21.15.79:0/1025932479 >> 172.21.15.79:0/1025932479 conn(0x555c742136b0 msgr2=0x555c74219250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:04.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.985+0000 7f972a570740 1 -- 172.21.15.79:0/1025932479 shutdown_connections 2024-08-20T01:44:04.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.985+0000 7f972a570740 1 -- 172.21.15.79:0/1025932479 wait complete. 2024-08-20T01:44:04.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.985+0000 7f972a570740 20 client.17505 trim_cache size 0 max 16384 2024-08-20T01:44:05.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.998+0000 7f972a570740 1 Processor -- start 2024-08-20T01:44:05.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.998+0000 7f972a570740 1 -- start start 2024-08-20T01:44:05.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.998+0000 7f972a570740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c74215880 0x555c7421f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:05.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.998+0000 7f972a570740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c742161a0 0x555c7421fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:05.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.998+0000 7f972a570740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c74222130 0x555c74239da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:05.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.998+0000 7f972a570740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f97201b0180 con 0x555c742161a0 2024-08-20T01:44:05.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.998+0000 7f972a570740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f97201b1d20 con 0x555c74215880 2024-08-20T01:44:05.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.998+0000 7f972a570740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f97201b0850 con 0x555c74222130 2024-08-20T01:44:05.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.998+0000 7f9725712640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c742161a0 0x555c7421fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:05.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.998+0000 7f9725712640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c742161a0 0x555c7421fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58742/0 (socket says 172.21.15.79:58742) 2024-08-20T01:44:05.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.998+0000 7f9725712640 1 -- 172.21.15.79:0/1694559897 learned_addr learned my addr 172.21.15.79:0/1694559897 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:05.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.998+0000 7f9725f13640 1 --2- 172.21.15.79:0/1694559897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c74215880 0x555c7421f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:05.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.998+0000 7f9726714640 1 --2- 172.21.15.79:0/1694559897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c74222130 0x555c74239da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:05.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.999+0000 7f9725712640 1 -- 172.21.15.79:0/1694559897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c74222130 msgr2=0x555c74239da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:05.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.999+0000 7f9725712640 1 --2- 172.21.15.79:0/1694559897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c74222130 0x555c74239da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:05.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.999+0000 7f9725712640 1 -- 172.21.15.79:0/1694559897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c74215880 msgr2=0x555c7421f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:05.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.999+0000 7f9725712640 1 --2- 172.21.15.79:0/1694559897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c74215880 0x555c7421f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:05.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.999+0000 7f9725712640 1 -- 172.21.15.79:0/1694559897 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c74214130 con 0x555c742161a0 2024-08-20T01:44:05.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.999+0000 7f9725f13640 1 --2- 172.21.15.79:0/1694559897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c74215880 0x555c7421f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:44:05.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.999+0000 7f9725712640 1 --2- 172.21.15.79:0/1694559897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c742161a0 0x555c7421fad0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f9720076cc0 tx=0x7f9710009110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ae97e2f831187f5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:05.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.999+0000 7f970b7fe640 1 -- 172.21.15.79:0/1694559897 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9710026420 con 0x555c742161a0 2024-08-20T01:44:05.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.999+0000 7f970b7fe640 1 -- 172.21.15.79:0/1694559897 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9710021030 con 0x555c742161a0 2024-08-20T01:44:05.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:04.999+0000 7f970b7fe640 1 -- 172.21.15.79:0/1694559897 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971001d250 con 0x555c742161a0 2024-08-20T01:44:05.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.000+0000 7f972a570740 1 -- 172.21.15.79:0/1694559897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c742161a0 msgr2=0x555c7421fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:05.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.000+0000 7f972a570740 1 --2- 172.21.15.79:0/1694559897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c742161a0 0x555c7421fad0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f9720076cc0 tx=0x7f9710009110 comp rx=0 tx=0).stop 2024-08-20T01:44:05.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.000+0000 7f972a570740 1 -- 172.21.15.79:0/1694559897 shutdown_connections 2024-08-20T01:44:05.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.000+0000 7f972a570740 1 --2- 172.21.15.79:0/1694559897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c74222130 0x555c74239da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:05.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.000+0000 7f972a570740 1 --2- 172.21.15.79:0/1694559897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c742161a0 0x555c7421fad0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:05.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.000+0000 7f972a570740 1 --2- 172.21.15.79:0/1694559897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c74215880 0x555c7421f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:05.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.000+0000 7f972a570740 1 -- 172.21.15.79:0/1694559897 >> 172.21.15.79:0/1694559897 conn(0x555c742136b0 msgr2=0x555c7421d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:05.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.000+0000 7f972a570740 1 -- 172.21.15.79:0/1694559897 shutdown_connections 2024-08-20T01:44:05.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.000+0000 7f972a570740 1 -- 172.21.15.79:0/1694559897 wait complete. 2024-08-20T01:44:05.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.001+0000 7f972a570740 1 -- start start 2024-08-20T01:44:05.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.001+0000 7f972a570740 1 Processor -- start 2024-08-20T01:44:05.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.001+0000 7f972a570740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c74215880 0x555c74225870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:05.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.001+0000 7f972a570740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c742161a0 0x555c74225db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:05.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.001+0000 7f972a570740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c74222130 0x555c7429ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:05.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.001+0000 7f972a570740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f97201b1650 con 0x555c74222130 2024-08-20T01:44:05.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.001+0000 7f972a570740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f97201b0f20 con 0x555c74215880 2024-08-20T01:44:05.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.001+0000 7f972a570740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f97201ae160 con 0x555c742161a0 2024-08-20T01:44:05.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.001+0000 7f972a570740 10 client.0 _ll_register_callbacks cb 0x7f971c0057c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:44:05.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.002+0000 7f9726714640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c74222130 0x555c7429ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:05.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.002+0000 7f9725f13640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c74215880 0x555c74225870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:05.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.002+0000 7f9726714640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c74222130 0x555c7429ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58748/0 (socket says 172.21.15.79:58748) 2024-08-20T01:44:05.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.002+0000 7f9726714640 1 -- 172.21.15.79:0/1373978889 learned_addr learned my addr 172.21.15.79:0/1373978889 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:05.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.002+0000 7f9725712640 1 --2- 172.21.15.79:0/1373978889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c742161a0 0x555c74225db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:05.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.002+0000 7f9725f13640 1 -- 172.21.15.79:0/1373978889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c742161a0 msgr2=0x555c74225db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:05.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.002+0000 7f9725f13640 1 --2- 172.21.15.79:0/1373978889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c742161a0 0x555c74225db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:05.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.002+0000 7f9725f13640 1 -- 172.21.15.79:0/1373978889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c74222130 msgr2=0x555c7429ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:05.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.002+0000 7f9725f13640 1 --2- 172.21.15.79:0/1373978889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c74222130 0x555c7429ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:05.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.002+0000 7f9725f13640 1 -- 172.21.15.79:0/1373978889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c7429b400 con 0x555c74215880 2024-08-20T01:44:05.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.002+0000 7f9726714640 1 --2- 172.21.15.79:0/1373978889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c74222130 0x555c7429ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:44:05.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.002+0000 7f9725712640 1 --2- 172.21.15.79:0/1373978889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c742161a0 0x555c74225db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:44:05.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.002+0000 7f9725f13640 1 --2- 172.21.15.79:0/1373978889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c74215880 0x555c74225870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f971c005fd0 tx=0x7f971c0e95c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb44d54d3b0fd2b8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:05.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.002+0000 7f97097fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:44:05.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.002+0000 7f97097fa640 1 -- 172.21.15.79:0/1373978889 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971c01d040 con 0x555c74215880 2024-08-20T01:44:05.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.003+0000 7f972a570740 1 -- 172.21.15.79:0/1373978889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9710021030 con 0x555c74215880 2024-08-20T01:44:05.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.003+0000 7f97097fa640 1 -- 172.21.15.79:0/1373978889 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f971c0a6dd0 con 0x555c74215880 2024-08-20T01:44:05.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.003+0000 7f97097fa640 1 -- 172.21.15.79:0/1373978889 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f971c007ca0 con 0x555c74215880 2024-08-20T01:44:05.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.003+0000 7f972a570740 10 client.26564 fetch_fsmap learned FSMap version 39 2024-08-20T01:44:05.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.003+0000 7f972a570740 1 -- 172.21.15.79:0/1373978889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x555c7429c6e0 con 0x555c74215880 2024-08-20T01:44:05.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.003+0000 7f97097fa640 1 -- 172.21.15.79:0/1373978889 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9710021030 con 0x555c74215880 2024-08-20T01:44:05.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.003+0000 7f97097fa640 1 -- 172.21.15.79:0/1373978889 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 39) ==== 8370+0+0 (secure 0 0 0) 0x7f971c0cbce0 con 0x555c74215880 2024-08-20T01:44:05.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.003+0000 7f972a570740 10 client.26564 fetch_fsmap finished waiting for FSMap version 39 2024-08-20T01:44:05.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.003+0000 7f972a570740 10 client.26564 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:44:05.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.003+0000 7f972a570740 20 client.26564 populate_metadata read hostname 'smithi079' 2024-08-20T01:44:05.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.003+0000 7f972a570740 1 --2- 172.21.15.79:0/1373978889 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x555c74232070 0x555c7429eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:05.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.003+0000 7f972a570740 4 client.26564 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:44:05.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.003+0000 7f972a570740 1 -- 172.21.15.79:0/1373978889 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555c7418a320 con 0x555c74232070 2024-08-20T01:44:05.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.004+0000 7f9725712640 1 --2- 172.21.15.79:0/1373978889 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x555c74232070 0x555c7429eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:05.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.004+0000 7f97097fa640 10 client.26564 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:44:05.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.004+0000 7f9725712640 1 --2- 172.21.15.79:0/1373978889 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x555c74232070 0x555c7429eef0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e1e3b51a5182615b server_cookie=85e744e30d1c6783 in_seq=0 out_seq=0 2024-08-20T01:44:05.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.004+0000 7f97097fa640 1 -- 172.21.15.79:0/1373978889 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555c7418a320 con 0x555c74232070 2024-08-20T01:44:05.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.004+0000 7f97097fa640 10 client.26564 handle_command_reply: tid=0 2024-08-20T01:44:05.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.004+0000 7f972a570740 1 client.26564 shutdown 2024-08-20T01:44:05.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.005+0000 7f972a570740 1 -- 172.21.15.79:0/1373978889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c74215880 msgr2=0x555c74225870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:05.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.005+0000 7f972a570740 1 --2- 172.21.15.79:0/1373978889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c74215880 0x555c74225870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f971c005fd0 tx=0x7f971c0e95c0 comp rx=0 tx=0).stop 2024-08-20T01:44:05.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.005+0000 7f972a570740 1 -- 172.21.15.79:0/1373978889 shutdown_connections 2024-08-20T01:44:05.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.005+0000 7f972a570740 1 --2- 172.21.15.79:0/1373978889 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x555c74232070 0x555c7429eef0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:05.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.005+0000 7f972a570740 1 --2- 172.21.15.79:0/1373978889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555c74222130 0x555c7429ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:05.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.005+0000 7f972a570740 1 --2- 172.21.15.79:0/1373978889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c742161a0 0x555c74225db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:05.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.005+0000 7f972a570740 1 --2- 172.21.15.79:0/1373978889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c74215880 0x555c74225870 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:05.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.005+0000 7f97097fa640 0 client.26564 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:44:05.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.005+0000 7f972a570740 1 -- 172.21.15.79:0/1373978889 >> 172.21.15.79:0/1373978889 conn(0x555c742136b0 msgr2=0x555c742206c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:05.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.005+0000 7f972a570740 1 -- 172.21.15.79:0/1373978889 shutdown_connections 2024-08-20T01:44:05.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.005+0000 7f972a570740 1 -- 172.21.15.79:0/1373978889 wait complete. 2024-08-20T01:44:05.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.005+0000 7f972a570740 20 client.26564 trim_cache size 0 max 16384 2024-08-20T01:44:05.013 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:44:05.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.006+0000 7f9728177640 1 -- 172.21.15.79:0/2008604780 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f970c0b3c50 msgr2=0x7f970c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:05.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.006+0000 7f9728177640 1 --2- 172.21.15.79:0/2008604780 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f970c0b3c50 0x7f970c0b6110 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f971804a000 tx=0x7f971804b000 comp rx=0 tx=0).stop 2024-08-20T01:44:05.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.006+0000 7f9728177640 1 -- 172.21.15.79:0/2008604780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9720102aa0 msgr2=0x7f97200751d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:05.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.006+0000 7f9728177640 1 --2- 172.21.15.79:0/2008604780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9720102aa0 0x7f97200751d0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f971c00c890 tx=0x7f971c00cc90 comp rx=0 tx=0).stop 2024-08-20T01:44:05.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.006+0000 7f9728177640 1 -- 172.21.15.79:0/2008604780 shutdown_connections 2024-08-20T01:44:05.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.006+0000 7f9728177640 1 --2- 172.21.15.79:0/2008604780 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f970c0b3c50 0x7f970c0b6110 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:05.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.006+0000 7f9728177640 1 --2- 172.21.15.79:0/2008604780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9720108e30 0x7f9720075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:05.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.006+0000 7f9728177640 1 --2- 172.21.15.79:0/2008604780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97201084b0 0x7f9720075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:05.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.006+0000 7f9728177640 1 --2- 172.21.15.79:0/2008604780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9720102aa0 0x7f97200751d0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:05.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.006+0000 7f9728177640 1 -- 172.21.15.79:0/2008604780 >> 172.21.15.79:0/2008604780 conn(0x7f97200fe550 msgr2=0x7f9720100940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:05.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.006+0000 7f9728177640 1 -- 172.21.15.79:0/2008604780 shutdown_connections 2024-08-20T01:44:05.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:05.006+0000 7f9728177640 1 -- 172.21.15.79:0/2008604780 wait complete. 2024-08-20T01:44:05.802 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T01:44:06.073 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:44:06.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.625+0000 7fa5b1877640 1 -- 172.21.15.79:0/294287171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5ac108e20 msgr2=0x7fa5ac10f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:06.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.625+0000 7fa5b1877640 1 --2- 172.21.15.79:0/294287171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5ac108e20 0x7fa5ac10f620 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fa5a4009ca0 tx=0x7fa5a402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:44:06.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.625+0000 7fa5b1877640 1 -- 172.21.15.79:0/294287171 shutdown_connections 2024-08-20T01:44:06.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.625+0000 7fa5b1877640 1 --2- 172.21.15.79:0/294287171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5ac108e20 0x7fa5ac10f620 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:06.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.625+0000 7fa5b1877640 1 --2- 172.21.15.79:0/294287171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5ac1084a0 0x7fa5ac1088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:06.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.625+0000 7fa5b1877640 1 --2- 172.21.15.79:0/294287171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5ac102a90 0x7fa5ac102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:06.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.625+0000 7fa5b1877640 1 -- 172.21.15.79:0/294287171 >> 172.21.15.79:0/294287171 conn(0x7fa5ac0fe540 msgr2=0x7fa5ac100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:06.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.625+0000 7fa5b1877640 1 -- 172.21.15.79:0/294287171 shutdown_connections 2024-08-20T01:44:06.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.625+0000 7fa5b1877640 1 -- 172.21.15.79:0/294287171 wait complete. 2024-08-20T01:44:06.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.625+0000 7fa5b1877640 1 Processor -- start 2024-08-20T01:44:06.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.625+0000 7fa5b1877640 1 -- start start 2024-08-20T01:44:06.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.626+0000 7fa5b1877640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5ac102a90 0x7fa5ac0751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:06.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.626+0000 7fa5b1877640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5ac1084a0 0x7fa5ac075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:06.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.626+0000 7fa5b1877640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5ac108e20 0x7fa5ac075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:06.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.626+0000 7fa5b1877640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ac1129e0 con 0x7fa5ac1084a0 2024-08-20T01:44:06.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.626+0000 7fa5b1877640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ac112860 con 0x7fa5ac108e20 2024-08-20T01:44:06.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.626+0000 7fa5b1877640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ac112b60 con 0x7fa5ac102a90 2024-08-20T01:44:06.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.626+0000 7fa5aa7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5ac1084a0 0x7fa5ac075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:06.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.626+0000 7fa5aa7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5ac1084a0 0x7fa5ac075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58770/0 (socket says 172.21.15.79:58770) 2024-08-20T01:44:06.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.626+0000 7fa5aa7fc640 1 -- 172.21.15.79:0/3996192066 learned_addr learned my addr 172.21.15.79:0/3996192066 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:06.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.626+0000 7fa5ab7fe640 1 --2- 172.21.15.79:0/3996192066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5ac108e20 0x7fa5ac075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:06.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.626+0000 7fa5aaffd640 1 --2- 172.21.15.79:0/3996192066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5ac102a90 0x7fa5ac0751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:06.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.626+0000 7fa5ab7fe640 1 -- 172.21.15.79:0/3996192066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5ac102a90 msgr2=0x7fa5ac0751d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:06.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.626+0000 7fa5ab7fe640 1 --2- 172.21.15.79:0/3996192066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5ac102a90 0x7fa5ac0751d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:06.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.626+0000 7fa5ab7fe640 1 -- 172.21.15.79:0/3996192066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5ac1084a0 msgr2=0x7fa5ac075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:06.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.626+0000 7fa5ab7fe640 1 --2- 172.21.15.79:0/3996192066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5ac1084a0 0x7fa5ac075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:06.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.626+0000 7fa5ab7fe640 1 -- 172.21.15.79:0/3996192066 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5ac1a7220 con 0x7fa5ac108e20 2024-08-20T01:44:06.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.626+0000 7fa5aa7fc640 1 --2- 172.21.15.79:0/3996192066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5ac1084a0 0x7fa5ac075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:44:06.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.627+0000 7fa5ab7fe640 1 --2- 172.21.15.79:0/3996192066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5ac108e20 0x7fa5ac075c50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa5a4031040 tx=0x7fa5a4003f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:06.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.627+0000 7fa5b0875640 1 -- 172.21.15.79:0/3996192066 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a4032c90 con 0x7fa5ac108e20 2024-08-20T01:44:06.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.627+0000 7fa5b0875640 1 -- 172.21.15.79:0/3996192066 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa5a4032e30 con 0x7fa5ac108e20 2024-08-20T01:44:06.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.627+0000 7fa5b0875640 1 -- 172.21.15.79:0/3996192066 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a4030a90 con 0x7fa5ac108e20 2024-08-20T01:44:06.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.627+0000 7fa5b1877640 1 -- 172.21.15.79:0/3996192066 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5ac1a74b0 con 0x7fa5ac108e20 2024-08-20T01:44:06.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.627+0000 7fa5b1877640 1 -- 172.21.15.79:0/3996192066 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5ac1a78e0 con 0x7fa5ac108e20 2024-08-20T01:44:06.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.630+0000 7fa5b0875640 1 -- 172.21.15.79:0/3996192066 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa5a40046d0 con 0x7fa5ac108e20 2024-08-20T01:44:06.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.630+0000 7fa5b3c70740 1 Processor -- start 2024-08-20T01:44:06.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.630+0000 7fa5b3c70740 1 -- start start 2024-08-20T01:44:06.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.630+0000 7fa5b3c70740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9f5b9c880 0x55d9f5b9cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:06.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.630+0000 7fa5b3c70740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9f5b9d1a0 0x55d9f5ba8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:06.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.630+0000 7fa5b3c70740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9f5ba9130 0x55d9f5bab520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:06.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.630+0000 7fa5b3c70740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d9f5b13930 con 0x55d9f5b9d1a0 2024-08-20T01:44:06.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.630+0000 7fa5b3c70740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d9f5b02e30 con 0x55d9f5ba9130 2024-08-20T01:44:06.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.630+0000 7fa5b3c70740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d9f5b06e70 con 0x55d9f5b9c880 2024-08-20T01:44:06.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.630+0000 7fa5aaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9f5b9d1a0 0x55d9f5ba8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:06.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.630+0000 7fa5aaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9f5b9d1a0 0x55d9f5ba8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58784/0 (socket says 172.21.15.79:58784) 2024-08-20T01:44:06.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.630+0000 7fa5aa7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9f5ba9130 0x55d9f5bab520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:06.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.630+0000 7fa5aaffd640 1 -- 172.21.15.79:0/873896916 learned_addr learned my addr 172.21.15.79:0/873896916 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:06.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.630+0000 7fa5aa7fc640 1 --2- 172.21.15.79:0/873896916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9f5b9c880 0x55d9f5b9cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:06.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.630+0000 7fa5b0875640 1 --2- 172.21.15.79:0/3996192066 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa5940b3bd0 0x7fa5940b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:06.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.631+0000 7fa5aaffd640 1 -- 172.21.15.79:0/873896916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9f5b9c880 msgr2=0x55d9f5b9cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:06.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.631+0000 7fa5aaffd640 1 --2- 172.21.15.79:0/873896916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9f5b9c880 0x55d9f5b9cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:06.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.631+0000 7fa5aaffd640 1 -- 172.21.15.79:0/873896916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9f5ba9130 msgr2=0x55d9f5bab520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:06.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.631+0000 7fa5aaffd640 1 --2- 172.21.15.79:0/873896916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9f5ba9130 0x55d9f5bab520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:06.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.631+0000 7fa5aaffd640 1 -- 172.21.15.79:0/873896916 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9f5862650 con 0x55d9f5b9d1a0 2024-08-20T01:44:06.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.631+0000 7fa5aa7fc640 1 --2- 172.21.15.79:0/873896916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9f5ba9130 0x55d9f5bab520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:44:06.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.631+0000 7fa5ab7fe640 1 --2- 172.21.15.79:0/3996192066 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa5940b3bd0 0x7fa5940b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:06.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.631+0000 7fa5b0875640 1 -- 172.21.15.79:0/3996192066 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fa5a4104e90 con 0x7fa5ac108e20 2024-08-20T01:44:06.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.631+0000 7fa5aaffd640 1 --2- 172.21.15.79:0/873896916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9f5b9d1a0 0x55d9f5ba8bf0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fa59c009d20 tx=0x7fa59c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea9d270e3c6d36d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:06.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.631+0000 7fa591ffb640 1 -- 172.21.15.79:0/873896916 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa59c004230 con 0x55d9f5b9d1a0 2024-08-20T01:44:06.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.631+0000 7fa591ffb640 1 -- 172.21.15.79:0/873896916 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa59c0043d0 con 0x55d9f5b9d1a0 2024-08-20T01:44:06.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.631+0000 7fa591ffb640 1 -- 172.21.15.79:0/873896916 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa59c019790 con 0x55d9f5b9d1a0 2024-08-20T01:44:06.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.632+0000 7fa5b3c70740 1 -- 172.21.15.79:0/873896916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9f5b9d1a0 msgr2=0x55d9f5ba8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:06.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.632+0000 7fa5ab7fe640 1 --2- 172.21.15.79:0/3996192066 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa5940b3bd0 0x7fa5940b6090 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40cba90 tx=0x7fa5a40fba70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:06.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.632+0000 7fa5b3c70740 1 --2- 172.21.15.79:0/873896916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9f5b9d1a0 0x55d9f5ba8bf0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fa59c009d20 tx=0x7fa59c011810 comp rx=0 tx=0).stop 2024-08-20T01:44:06.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.632+0000 7fa5b3c70740 1 -- 172.21.15.79:0/873896916 shutdown_connections 2024-08-20T01:44:06.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.632+0000 7fa5b3c70740 1 --2- 172.21.15.79:0/873896916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9f5ba9130 0x55d9f5bab520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:06.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.632+0000 7fa5b3c70740 1 --2- 172.21.15.79:0/873896916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9f5b9d1a0 0x55d9f5ba8bf0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:06.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.632+0000 7fa5b3c70740 1 --2- 172.21.15.79:0/873896916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9f5b9c880 0x55d9f5b9cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:06.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.632+0000 7fa5b3c70740 1 -- 172.21.15.79:0/873896916 >> 172.21.15.79:0/873896916 conn(0x55d9f5b9a6b0 msgr2=0x55d9f5b9b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:06.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.632+0000 7fa5b3c70740 1 -- 172.21.15.79:0/873896916 shutdown_connections 2024-08-20T01:44:06.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.632+0000 7fa5b3c70740 1 -- 172.21.15.79:0/873896916 wait complete. 2024-08-20T01:44:06.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.632+0000 7fa5b3c70740 1 -- start start 2024-08-20T01:44:06.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.633+0000 7fa5b3c70740 1 Processor -- start 2024-08-20T01:44:06.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.633+0000 7fa5b3c70740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9f5b9c880 0x55d9f5ba6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:06.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.633+0000 7fa5b3c70740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9f5b9d1a0 0x55d9f5ba6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:06.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.633+0000 7fa5b3c70740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9f5ba9130 0x55d9f5ba6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:06.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.633+0000 7fa5b3c70740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d9f5965700 con 0x55d9f5b9d1a0 2024-08-20T01:44:06.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.633+0000 7fa5b3c70740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d9f5a89810 con 0x55d9f5b9c880 2024-08-20T01:44:06.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.633+0000 7fa5b3c70740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d9f5babde0 con 0x55d9f5ba9130 2024-08-20T01:44:06.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.633+0000 7fa5b3c70740 10 client.0 _ll_register_callbacks cb 0x55d9f5afc700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:44:06.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.633+0000 7fa5aaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9f5b9d1a0 0x55d9f5ba6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:06.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.633+0000 7fa5aaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9f5b9d1a0 0x55d9f5ba6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58786/0 (socket says 172.21.15.79:58786) 2024-08-20T01:44:06.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.633+0000 7fa5aaffd640 1 -- 172.21.15.79:0/4201673523 learned_addr learned my addr 172.21.15.79:0/4201673523 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:06.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.633+0000 7fa5aa7fc640 1 --2- 172.21.15.79:0/4201673523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9f5ba9130 0x55d9f5ba6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:06.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.633+0000 7fa5aa7fc640 1 --2- 172.21.15.79:0/4201673523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9f5b9c880 0x55d9f5ba6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:06.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.633+0000 7fa5aaffd640 1 -- 172.21.15.79:0/4201673523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9f5ba9130 msgr2=0x55d9f5ba6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:06.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.633+0000 7fa5aaffd640 1 --2- 172.21.15.79:0/4201673523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9f5ba9130 0x55d9f5ba6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:06.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.633+0000 7fa5aaffd640 1 -- 172.21.15.79:0/4201673523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9f5b9c880 msgr2=0x55d9f5ba6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:06.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.633+0000 7fa5aaffd640 1 --2- 172.21.15.79:0/4201673523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9f5b9c880 0x55d9f5ba6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:06.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.633+0000 7fa5aaffd640 1 -- 172.21.15.79:0/4201673523 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9f5bb51e0 con 0x55d9f5b9d1a0 2024-08-20T01:44:06.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.634+0000 7fa5aaffd640 1 --2- 172.21.15.79:0/4201673523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9f5b9d1a0 0x55d9f5ba6660 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fa59c003820 tx=0x7fa59c003850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af035a8e4e51d967 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:06.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.634+0000 7fa58affd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:44:06.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.634+0000 7fa58affd640 1 -- 172.21.15.79:0/4201673523 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa59c027070 con 0x55d9f5b9d1a0 2024-08-20T01:44:06.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.634+0000 7fa58affd640 1 -- 172.21.15.79:0/4201673523 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fa59c005040 con 0x55d9f5b9d1a0 2024-08-20T01:44:06.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.634+0000 7fa5b3c70740 1 -- 172.21.15.79:0/4201673523 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d9f5ab2150 con 0x55d9f5b9d1a0 2024-08-20T01:44:06.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.634+0000 7fa58affd640 1 -- 172.21.15.79:0/4201673523 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fa59c033050 con 0x55d9f5b9d1a0 2024-08-20T01:44:06.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.634+0000 7fa5b3c70740 10 client.17523 fetch_fsmap learned FSMap version 40 2024-08-20T01:44:06.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.634+0000 7fa5b3c70740 1 -- 172.21.15.79:0/4201673523 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55d9f5bb7b90 con 0x55d9f5b9d1a0 2024-08-20T01:44:06.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.634+0000 7fa58affd640 1 -- 172.21.15.79:0/4201673523 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55d9f5ab2150 con 0x55d9f5b9d1a0 2024-08-20T01:44:06.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.634+0000 7fa58affd640 1 -- 172.21.15.79:0/4201673523 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 40) ==== 8374+0+0 (secure 0 0 0) 0x7fa59c004850 con 0x55d9f5b9d1a0 2024-08-20T01:44:06.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.635+0000 7fa5b3c70740 10 client.17523 fetch_fsmap finished waiting for FSMap version 40 2024-08-20T01:44:06.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.635+0000 7fa5b3c70740 10 client.17523 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:44:06.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.635+0000 7fa5b3c70740 20 client.17523 populate_metadata read hostname 'smithi079' 2024-08-20T01:44:06.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.635+0000 7fa5b3c70740 1 --2- 172.21.15.79:0/4201673523 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55d9f5bb8fa0 0x55d9f5bbb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:06.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.635+0000 7fa5b3c70740 4 client.17523 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:44:06.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.635+0000 7fa5b3c70740 1 -- 172.21.15.79:0/4201673523 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d9f5b15880 con 0x55d9f5bb8fa0 2024-08-20T01:44:06.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.635+0000 7fa5aa7fc640 1 --2- 172.21.15.79:0/4201673523 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55d9f5bb8fa0 0x55d9f5bbb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:06.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.636+0000 7fa5aa7fc640 1 --2- 172.21.15.79:0/4201673523 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55d9f5bb8fa0 0x55d9f5bbb390 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=641ce26b3837e2dd server_cookie=f4464c1d9548e5ba in_seq=0 out_seq=0 2024-08-20T01:44:06.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.636+0000 7fa58affd640 10 client.17523 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:44:06.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.636+0000 7fa58affd640 1 -- 172.21.15.79:0/4201673523 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d9f5b15880 con 0x55d9f5bb8fa0 2024-08-20T01:44:06.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.636+0000 7fa58affd640 10 client.17523 handle_command_reply: tid=0 2024-08-20T01:44:06.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.636+0000 7fa5b3c70740 1 client.17523 shutdown 2024-08-20T01:44:06.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.637+0000 7fa5b3c70740 1 -- 172.21.15.79:0/4201673523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9f5b9d1a0 msgr2=0x55d9f5ba6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:06.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.637+0000 7fa5b3c70740 1 --2- 172.21.15.79:0/4201673523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9f5b9d1a0 0x55d9f5ba6660 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fa59c003820 tx=0x7fa59c003850 comp rx=0 tx=0).stop 2024-08-20T01:44:06.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.637+0000 7fa5b3c70740 1 -- 172.21.15.79:0/4201673523 shutdown_connections 2024-08-20T01:44:06.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.637+0000 7fa5b3c70740 1 --2- 172.21.15.79:0/4201673523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9f5ba9130 0x55d9f5ba6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:06.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.637+0000 7fa5b3c70740 1 --2- 172.21.15.79:0/4201673523 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55d9f5bb8fa0 0x55d9f5bbb390 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:06.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.637+0000 7fa5b3c70740 1 --2- 172.21.15.79:0/4201673523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9f5b9d1a0 0x55d9f5ba6660 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:06.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.637+0000 7fa5b3c70740 1 --2- 172.21.15.79:0/4201673523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9f5b9c880 0x55d9f5ba6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:06.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.637+0000 7fa58affd640 0 client.17523 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:44:06.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.637+0000 7fa5b3c70740 1 -- 172.21.15.79:0/4201673523 >> 172.21.15.79:0/4201673523 conn(0x55d9f5b9a6b0 msgr2=0x55d9f5ba0250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:06.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.637+0000 7fa5b3c70740 1 -- 172.21.15.79:0/4201673523 shutdown_connections 2024-08-20T01:44:06.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.637+0000 7fa5b3c70740 1 -- 172.21.15.79:0/4201673523 wait complete. 2024-08-20T01:44:06.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.637+0000 7fa5b3c70740 20 client.17523 trim_cache size 0 max 16384 2024-08-20T01:44:06.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.651+0000 7fa5b3c70740 1 Processor -- start 2024-08-20T01:44:06.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.651+0000 7fa5b3c70740 1 -- start start 2024-08-20T01:44:06.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.652+0000 7fa5b3c70740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9f5b9c880 0x55d9f5ba0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:06.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.652+0000 7fa5b3c70740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9f5b9d1a0 0x55d9f5ba7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:06.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.652+0000 7fa5b3c70740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9f5ba9130 0x55d9f5bc0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:06.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.652+0000 7fa5b3c70740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ac1b00c0 con 0x55d9f5b9c880 2024-08-20T01:44:06.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.652+0000 7fa5b3c70740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ac1b1c90 con 0x55d9f5b9d1a0 2024-08-20T01:44:06.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.652+0000 7fa5b3c70740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ac1b0790 con 0x55d9f5ba9130 2024-08-20T01:44:06.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.652+0000 7fa5aa7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9f5b9c880 0x55d9f5ba0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:06.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.652+0000 7fa5aa7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9f5b9c880 0x55d9f5ba0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58796/0 (socket says 172.21.15.79:58796) 2024-08-20T01:44:06.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.652+0000 7fa5aa7fc640 1 -- 172.21.15.79:0/1751311792 learned_addr learned my addr 172.21.15.79:0/1751311792 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:06.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.652+0000 7fa5aaffd640 1 --2- 172.21.15.79:0/1751311792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9f5b9d1a0 0x55d9f5ba7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:06.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.652+0000 7fa5aa7fc640 1 -- 172.21.15.79:0/1751311792 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9f5ba9130 msgr2=0x55d9f5bc0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:06.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.652+0000 7fa5aa7fc640 1 --2- 172.21.15.79:0/1751311792 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9f5ba9130 0x55d9f5bc0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:06.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.652+0000 7fa5aa7fc640 1 -- 172.21.15.79:0/1751311792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9f5b9d1a0 msgr2=0x55d9f5ba7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:06.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.652+0000 7fa5aa7fc640 1 --2- 172.21.15.79:0/1751311792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9f5b9d1a0 0x55d9f5ba7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:06.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.652+0000 7fa5aa7fc640 1 -- 172.21.15.79:0/1751311792 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9f5ba4620 con 0x55d9f5b9c880 2024-08-20T01:44:06.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.652+0000 7fa5aa7fc640 1 --2- 172.21.15.79:0/1751311792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9f5b9c880 0x55d9f5ba0980 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fa5a0005d00 tx=0x7fa5a000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deb2e840ec93dab6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:06.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.653+0000 7fa5917fa640 1 -- 172.21.15.79:0/1751311792 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a0025040 con 0x55d9f5b9c880 2024-08-20T01:44:06.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.653+0000 7fa5917fa640 1 -- 172.21.15.79:0/1751311792 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa5a0005020 con 0x55d9f5b9c880 2024-08-20T01:44:06.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.653+0000 7fa5917fa640 1 -- 172.21.15.79:0/1751311792 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a001b040 con 0x55d9f5b9c880 2024-08-20T01:44:06.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.654+0000 7fa5b3c70740 1 -- 172.21.15.79:0/1751311792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9f5b9c880 msgr2=0x55d9f5ba0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:06.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.654+0000 7fa5b3c70740 1 --2- 172.21.15.79:0/1751311792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9f5b9c880 0x55d9f5ba0980 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fa5a0005d00 tx=0x7fa5a000bd70 comp rx=0 tx=0).stop 2024-08-20T01:44:06.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.654+0000 7fa5b3c70740 1 -- 172.21.15.79:0/1751311792 shutdown_connections 2024-08-20T01:44:06.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.654+0000 7fa5b3c70740 1 --2- 172.21.15.79:0/1751311792 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9f5ba9130 0x55d9f5bc0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:06.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.654+0000 7fa5b3c70740 1 --2- 172.21.15.79:0/1751311792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9f5b9d1a0 0x55d9f5ba7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:06.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.654+0000 7fa5b3c70740 1 --2- 172.21.15.79:0/1751311792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9f5b9c880 0x55d9f5ba0980 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:06.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.654+0000 7fa5b3c70740 1 -- 172.21.15.79:0/1751311792 >> 172.21.15.79:0/1751311792 conn(0x55d9f5b9a6b0 msgr2=0x55d9f5ba7750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:06.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.654+0000 7fa5b3c70740 1 -- 172.21.15.79:0/1751311792 shutdown_connections 2024-08-20T01:44:06.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.654+0000 7fa5b3c70740 1 -- 172.21.15.79:0/1751311792 wait complete. 2024-08-20T01:44:06.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.654+0000 7fa5b3c70740 1 -- start start 2024-08-20T01:44:06.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.654+0000 7fa5b3c70740 1 Processor -- start 2024-08-20T01:44:06.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.655+0000 7fa5b3c70740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9f5b9c880 0x55d9f5ba3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:06.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.655+0000 7fa5b3c70740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9f5b9d1a0 0x55d9f5bb1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:06.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.655+0000 7fa5b3c70740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9f5ba9130 0x55d9f5bb1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:06.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.655+0000 7fa5b3c70740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ac1b1590 con 0x55d9f5b9d1a0 2024-08-20T01:44:06.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.655+0000 7fa5b3c70740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ac1b0e60 con 0x55d9f5b9c880 2024-08-20T01:44:06.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.655+0000 7fa5b3c70740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ac1ae0a0 con 0x55d9f5ba9130 2024-08-20T01:44:06.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.655+0000 7fa5b3c70740 10 client.0 _ll_register_callbacks cb 0x7fa5a000bcc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:44:06.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.655+0000 7fa5aaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9f5b9d1a0 0x55d9f5bb1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:06.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.655+0000 7fa5aa7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9f5b9c880 0x55d9f5ba3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:06.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.655+0000 7fa5aaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9f5b9d1a0 0x55d9f5bb1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58802/0 (socket says 172.21.15.79:58802) 2024-08-20T01:44:06.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.655+0000 7fa5aa7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9f5b9c880 0x55d9f5ba3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:54430/0 (socket says 172.21.15.79:54430) 2024-08-20T01:44:06.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.655+0000 7fa5aaffd640 1 -- 172.21.15.79:0/2748019957 learned_addr learned my addr 172.21.15.79:0/2748019957 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:06.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.655+0000 7fa5aa7fc640 1 --2- 172.21.15.79:0/2748019957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9f5ba9130 0x55d9f5bb1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:06.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.655+0000 7fa5aaffd640 1 -- 172.21.15.79:0/2748019957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9f5ba9130 msgr2=0x55d9f5bb1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:06.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.655+0000 7fa5aaffd640 1 --2- 172.21.15.79:0/2748019957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9f5ba9130 0x55d9f5bb1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:06.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.655+0000 7fa5aaffd640 1 -- 172.21.15.79:0/2748019957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9f5b9c880 msgr2=0x55d9f5ba3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:06.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.655+0000 7fa5aaffd640 1 --2- 172.21.15.79:0/2748019957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9f5b9c880 0x55d9f5ba3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:06.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.655+0000 7fa5aaffd640 1 -- 172.21.15.79:0/2748019957 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9f5ba24a0 con 0x55d9f5b9d1a0 2024-08-20T01:44:06.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.655+0000 7fa5aa7fc640 1 --2- 172.21.15.79:0/2748019957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9f5b9c880 0x55d9f5ba3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:44:06.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.656+0000 7fa5aaffd640 1 --2- 172.21.15.79:0/2748019957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9f5b9d1a0 0x55d9f5bb1070 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fa59c004d60 tx=0x7fa59c009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93da5de77b2efe9f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:06.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.656+0000 7fa58affd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:44:06.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.656+0000 7fa58affd640 1 -- 172.21.15.79:0/2748019957 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa59c03b020 con 0x55d9f5b9d1a0 2024-08-20T01:44:06.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.656+0000 7fa58affd640 1 -- 172.21.15.79:0/2748019957 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fa59c005160 con 0x55d9f5b9d1a0 2024-08-20T01:44:06.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.656+0000 7fa5b3c70740 1 -- 172.21.15.79:0/2748019957 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5a0005020 con 0x55d9f5b9d1a0 2024-08-20T01:44:06.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.656+0000 7fa58affd640 1 -- 172.21.15.79:0/2748019957 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fa59c027040 con 0x55d9f5b9d1a0 2024-08-20T01:44:06.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.656+0000 7fa5b3c70740 10 client.17529 fetch_fsmap learned FSMap version 40 2024-08-20T01:44:06.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.656+0000 7fa5b3c70740 1 -- 172.21.15.79:0/2748019957 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55d9f5c22f50 con 0x55d9f5b9d1a0 2024-08-20T01:44:06.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.656+0000 7fa58affd640 1 -- 172.21.15.79:0/2748019957 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa59c0038c0 con 0x55d9f5b9d1a0 2024-08-20T01:44:06.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.656+0000 7fa58affd640 1 -- 172.21.15.79:0/2748019957 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 40) ==== 8374+0+0 (secure 0 0 0) 0x7fa59c0045f0 con 0x55d9f5b9d1a0 2024-08-20T01:44:06.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.657+0000 7fa5b3c70740 10 client.17529 fetch_fsmap finished waiting for FSMap version 40 2024-08-20T01:44:06.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.657+0000 7fa5b3c70740 10 client.17529 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:44:06.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.657+0000 7fa5b3c70740 20 client.17529 populate_metadata read hostname 'smithi079' 2024-08-20T01:44:06.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.657+0000 7fa5b3c70740 1 --2- 172.21.15.79:0/2748019957 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55d9f5c23600 0x55d9f5c25a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:06.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.657+0000 7fa5b3c70740 4 client.17529 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:44:06.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.657+0000 7fa5b3c70740 1 -- 172.21.15.79:0/2748019957 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fa5a0005020 con 0x55d9f5c23600 2024-08-20T01:44:06.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.657+0000 7fa5aa7fc640 1 --2- 172.21.15.79:0/2748019957 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55d9f5c23600 0x55d9f5c25a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:06.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.657+0000 7fa5aa7fc640 1 --2- 172.21.15.79:0/2748019957 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55d9f5c23600 0x55d9f5c25a20 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e58f46b12c9abfc5 server_cookie=50564d21626bc930 in_seq=0 out_seq=0 2024-08-20T01:44:06.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.657+0000 7fa58affd640 10 client.17529 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:44:06.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.658+0000 7fa58affd640 1 -- 172.21.15.79:0/2748019957 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fa5a0005020 con 0x55d9f5c23600 2024-08-20T01:44:06.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.658+0000 7fa58affd640 10 client.17529 handle_command_reply: tid=0 2024-08-20T01:44:06.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.658+0000 7fa5b3c70740 1 client.17529 shutdown 2024-08-20T01:44:06.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.658+0000 7fa5b3c70740 1 -- 172.21.15.79:0/2748019957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9f5b9d1a0 msgr2=0x55d9f5bb1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:06.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.658+0000 7fa5b3c70740 1 --2- 172.21.15.79:0/2748019957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9f5b9d1a0 0x55d9f5bb1070 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fa59c004d60 tx=0x7fa59c009ed0 comp rx=0 tx=0).stop 2024-08-20T01:44:06.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.658+0000 7fa5b3c70740 1 -- 172.21.15.79:0/2748019957 shutdown_connections 2024-08-20T01:44:06.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.658+0000 7fa5b3c70740 1 --2- 172.21.15.79:0/2748019957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9f5ba9130 0x55d9f5bb1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:06.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.658+0000 7fa5b3c70740 1 --2- 172.21.15.79:0/2748019957 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55d9f5c23600 0x55d9f5c25a20 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:06.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.658+0000 7fa5b3c70740 1 --2- 172.21.15.79:0/2748019957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9f5b9d1a0 0x55d9f5bb1070 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:06.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.658+0000 7fa5b3c70740 1 --2- 172.21.15.79:0/2748019957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9f5b9c880 0x55d9f5ba3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:06.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.658+0000 7fa5b3c70740 1 -- 172.21.15.79:0/2748019957 >> 172.21.15.79:0/2748019957 conn(0x55d9f5b9a6b0 msgr2=0x55d9f5ba7f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:06.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.658+0000 7fa58affd640 0 client.17529 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:44:06.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.658+0000 7fa5b3c70740 1 -- 172.21.15.79:0/2748019957 shutdown_connections 2024-08-20T01:44:06.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.658+0000 7fa5b3c70740 1 -- 172.21.15.79:0/2748019957 wait complete. 2024-08-20T01:44:06.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.658+0000 7fa5b3c70740 20 client.17529 trim_cache size 0 max 16384 2024-08-20T01:44:06.666 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:44:06.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.659+0000 7fa5b1877640 1 -- 172.21.15.79:0/3996192066 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa5940b3bd0 msgr2=0x7fa5940b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:06.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.659+0000 7fa5b1877640 1 --2- 172.21.15.79:0/3996192066 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa5940b3bd0 0x7fa5940b6090 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40cba90 tx=0x7fa5a40fba70 comp rx=0 tx=0).stop 2024-08-20T01:44:06.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.659+0000 7fa5b1877640 1 -- 172.21.15.79:0/3996192066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5ac108e20 msgr2=0x7fa5ac075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:06.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.659+0000 7fa5b1877640 1 --2- 172.21.15.79:0/3996192066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5ac108e20 0x7fa5ac075c50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa5a4031040 tx=0x7fa5a4003f10 comp rx=0 tx=0).stop 2024-08-20T01:44:06.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.659+0000 7fa5b1877640 1 -- 172.21.15.79:0/3996192066 shutdown_connections 2024-08-20T01:44:06.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.659+0000 7fa5b1877640 1 --2- 172.21.15.79:0/3996192066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5ac108e20 0x7fa5ac075c50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:06.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.659+0000 7fa5b1877640 1 --2- 172.21.15.79:0/3996192066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5ac1084a0 0x7fa5ac075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:06.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.659+0000 7fa5b1877640 1 --2- 172.21.15.79:0/3996192066 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa5940b3bd0 0x7fa5940b6090 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:06.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.659+0000 7fa5b1877640 1 --2- 172.21.15.79:0/3996192066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5ac102a90 0x7fa5ac0751d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:06.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.659+0000 7fa5b1877640 1 -- 172.21.15.79:0/3996192066 >> 172.21.15.79:0/3996192066 conn(0x7fa5ac0fe540 msgr2=0x7fa5ac100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:06.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.659+0000 7fa5b1877640 1 -- 172.21.15.79:0/3996192066 shutdown_connections 2024-08-20T01:44:06.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:06.659+0000 7fa5b1877640 1 -- 172.21.15.79:0/3996192066 wait complete. 2024-08-20T01:44:06.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:06 smithi081 ceph-mon[22209]: pgmap v550: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 29 MiB/s wr, 27 op/s 2024-08-20T01:44:06.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:06 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:44:06.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:06 smithi175 ceph-mon[22392]: pgmap v550: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 29 MiB/s wr, 27 op/s 2024-08-20T01:44:06.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:06 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:44:06.936 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:06 smithi079 ceph-mon[18656]: pgmap v550: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 29 MiB/s wr, 27 op/s 2024-08-20T01:44:06.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:06 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:44:07.556 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T01:44:07.845 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:44:08.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.385+0000 7ff5c110d640 1 -- 172.21.15.79:0/1758064135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5bc102ad0 msgr2=0x7ff5bc102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:08.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.385+0000 7ff5c110d640 1 --2- 172.21.15.79:0/1758064135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5bc102ad0 0x7ff5bc102eb0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac009900 tx=0x7ff5ac02a410 comp rx=0 tx=0).stop 2024-08-20T01:44:08.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.385+0000 7ff5c110d640 1 -- 172.21.15.79:0/1758064135 shutdown_connections 2024-08-20T01:44:08.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.385+0000 7ff5c110d640 1 --2- 172.21.15.79:0/1758064135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5bc108e60 0x7ff5bc10f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:08.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.385+0000 7ff5c110d640 1 --2- 172.21.15.79:0/1758064135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5bc1084e0 0x7ff5bc108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:08.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.385+0000 7ff5c110d640 1 --2- 172.21.15.79:0/1758064135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5bc102ad0 0x7ff5bc102eb0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:08.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.385+0000 7ff5c110d640 1 -- 172.21.15.79:0/1758064135 >> 172.21.15.79:0/1758064135 conn(0x7ff5bc0fe540 msgr2=0x7ff5bc100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:08.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.385+0000 7ff5c110d640 1 -- 172.21.15.79:0/1758064135 shutdown_connections 2024-08-20T01:44:08.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.385+0000 7ff5c110d640 1 -- 172.21.15.79:0/1758064135 wait complete. 2024-08-20T01:44:08.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.386+0000 7ff5c110d640 1 Processor -- start 2024-08-20T01:44:08.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.386+0000 7ff5c110d640 1 -- start start 2024-08-20T01:44:08.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.386+0000 7ff5c110d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5bc1084e0 0x7ff5bc196ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:08.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.387+0000 7ff5c110d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5bc108e60 0x7ff5bc197410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:08.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.387+0000 7ff5c110d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5bc19c7b0 0x7ff5bc19cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:08.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.387+0000 7ff5c110d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc110840 con 0x7ff5bc108e60 2024-08-20T01:44:08.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.387+0000 7ff5c110d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc1106c0 con 0x7ff5bc1084e0 2024-08-20T01:44:08.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.387+0000 7ff5c110d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc1109c0 con 0x7ff5bc19c7b0 2024-08-20T01:44:08.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.387+0000 7ff5b3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5bc108e60 0x7ff5bc197410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:08.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.387+0000 7ff5b3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5bc108e60 0x7ff5bc197410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58814/0 (socket says 172.21.15.79:58814) 2024-08-20T01:44:08.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.387+0000 7ff5b3fff640 1 -- 172.21.15.79:0/1931428388 learned_addr learned my addr 172.21.15.79:0/1931428388 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:08.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.387+0000 7ff5bad9d640 1 --2- 172.21.15.79:0/1931428388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5bc1084e0 0x7ff5bc196ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:08.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.387+0000 7ff5bb59e640 1 --2- 172.21.15.79:0/1931428388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5bc19c7b0 0x7ff5bc19cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:08.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.387+0000 7ff5b3fff640 1 -- 172.21.15.79:0/1931428388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5bc19c7b0 msgr2=0x7ff5bc19cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:08.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.387+0000 7ff5b3fff640 1 --2- 172.21.15.79:0/1931428388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5bc19c7b0 0x7ff5bc19cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:08.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.387+0000 7ff5b3fff640 1 -- 172.21.15.79:0/1931428388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5bc1084e0 msgr2=0x7ff5bc196ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:08.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.387+0000 7ff5b3fff640 1 --2- 172.21.15.79:0/1931428388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5bc1084e0 0x7ff5bc196ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:08.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.387+0000 7ff5b3fff640 1 -- 172.21.15.79:0/1931428388 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5bc19d340 con 0x7ff5bc108e60 2024-08-20T01:44:08.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.387+0000 7ff5bb59e640 1 --2- 172.21.15.79:0/1931428388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5bc19c7b0 0x7ff5bc19cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:44:08.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.387+0000 7ff5b3fff640 1 --2- 172.21.15.79:0/1931428388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5bc108e60 0x7ff5bc197410 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7ff5a400e9f0 tx=0x7ff5a400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:08.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.388+0000 7ff5b8d99640 1 -- 172.21.15.79:0/1931428388 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a400cd80 con 0x7ff5bc108e60 2024-08-20T01:44:08.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.388+0000 7ff5b8d99640 1 -- 172.21.15.79:0/1931428388 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff5a40108c0 con 0x7ff5bc108e60 2024-08-20T01:44:08.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.388+0000 7ff5c110d640 1 -- 172.21.15.79:0/1931428388 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5bc1a3930 con 0x7ff5bc108e60 2024-08-20T01:44:08.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.388+0000 7ff5c110d640 1 -- 172.21.15.79:0/1931428388 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5bc1a3cd0 con 0x7ff5bc108e60 2024-08-20T01:44:08.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.388+0000 7ff5b8d99640 1 -- 172.21.15.79:0/1931428388 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a40187c0 con 0x7ff5bc108e60 2024-08-20T01:44:08.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.391+0000 7ff5b8d99640 1 -- 172.21.15.79:0/1931428388 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff5a4010430 con 0x7ff5bc108e60 2024-08-20T01:44:08.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.391+0000 7ff5c3506740 1 Processor -- start 2024-08-20T01:44:08.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.391+0000 7ff5c3506740 1 -- start start 2024-08-20T01:44:08.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.391+0000 7ff5b8d99640 1 --2- 172.21.15.79:0/1931428388 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff5a80b8020 0x7ff5a80ba4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:08.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.392+0000 7ff5b8d99640 1 -- 172.21.15.79:0/1931428388 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff5a40e4010 con 0x7ff5bc108e60 2024-08-20T01:44:08.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.392+0000 7ff5bb59e640 1 --2- 172.21.15.79:0/1931428388 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff5a80b8020 0x7ff5a80ba4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:08.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.392+0000 7ff5c3506740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1069e3730 0x55e1069e3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:08.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.392+0000 7ff5c3506740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e1069e4050 0x55e1069efaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:08.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.392+0000 7ff5c3506740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e1069effe0 0x55e1069f23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:08.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.392+0000 7ff5c3506740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e10695a930 con 0x55e1069e4050 2024-08-20T01:44:08.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.392+0000 7ff5c3506740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e106949e30 con 0x55e1069e3730 2024-08-20T01:44:08.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.392+0000 7ff5c3506740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e10694de70 con 0x55e1069effe0 2024-08-20T01:44:08.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.392+0000 7ff5b3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e1069e4050 0x55e1069efaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:08.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.392+0000 7ff5b3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e1069e4050 0x55e1069efaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58822/0 (socket says 172.21.15.79:58822) 2024-08-20T01:44:08.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.392+0000 7ff5b3fff640 1 -- 172.21.15.79:0/3784848121 learned_addr learned my addr 172.21.15.79:0/3784848121 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:08.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.392+0000 7ff5bb59e640 1 --2- 172.21.15.79:0/3784848121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e1069effe0 0x55e1069f23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:08.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.392+0000 7ff5bb59e640 1 --2- 172.21.15.79:0/1931428388 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff5a80b8020 0x7ff5a80ba4e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4005fd0 tx=0x7ff5b40094a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:08.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.392+0000 7ff5bad9d640 1 --2- 172.21.15.79:0/3784848121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1069e3730 0x55e1069e3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:08.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.392+0000 7ff5b3fff640 1 -- 172.21.15.79:0/3784848121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e1069effe0 msgr2=0x55e1069f23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:08.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.392+0000 7ff5b3fff640 1 --2- 172.21.15.79:0/3784848121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e1069effe0 0x55e1069f23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:08.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.392+0000 7ff5b3fff640 1 -- 172.21.15.79:0/3784848121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1069e3730 msgr2=0x55e1069e3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:08.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.392+0000 7ff5b3fff640 1 --2- 172.21.15.79:0/3784848121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1069e3730 0x55e1069e3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:08.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.392+0000 7ff5b3fff640 1 -- 172.21.15.79:0/3784848121 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1066a9650 con 0x55e1069e4050 2024-08-20T01:44:08.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.392+0000 7ff5bad9d640 1 --2- 172.21.15.79:0/3784848121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1069e3730 0x55e1069e3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:44:08.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.393+0000 7ff5b3fff640 1 --2- 172.21.15.79:0/3784848121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e1069e4050 0x55e1069efaa0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7ff5a40aac70 tx=0x7ff5a4010850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a06e6ca3618581de server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:08.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.393+0000 7ff5b17fa640 1 -- 172.21.15.79:0/3784848121 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a40af570 con 0x55e1069e4050 2024-08-20T01:44:08.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.393+0000 7ff5b17fa640 1 -- 172.21.15.79:0/3784848121 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff5a40b4020 con 0x55e1069e4050 2024-08-20T01:44:08.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.393+0000 7ff5b17fa640 1 -- 172.21.15.79:0/3784848121 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a40a6b40 con 0x55e1069e4050 2024-08-20T01:44:08.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.394+0000 7ff5c3506740 1 -- 172.21.15.79:0/3784848121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e1069e4050 msgr2=0x55e1069efaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:08.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.394+0000 7ff5c3506740 1 --2- 172.21.15.79:0/3784848121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e1069e4050 0x55e1069efaa0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7ff5a40aac70 tx=0x7ff5a4010850 comp rx=0 tx=0).stop 2024-08-20T01:44:08.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.394+0000 7ff5c3506740 1 -- 172.21.15.79:0/3784848121 shutdown_connections 2024-08-20T01:44:08.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.394+0000 7ff5c3506740 1 --2- 172.21.15.79:0/3784848121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e1069effe0 0x55e1069f23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:08.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.394+0000 7ff5c3506740 1 --2- 172.21.15.79:0/3784848121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e1069e4050 0x55e1069efaa0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:08.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.394+0000 7ff5c3506740 1 --2- 172.21.15.79:0/3784848121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1069e3730 0x55e1069e3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:08.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.394+0000 7ff5c3506740 1 -- 172.21.15.79:0/3784848121 >> 172.21.15.79:0/3784848121 conn(0x55e1069e1560 msgr2=0x55e1069e2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:08.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.394+0000 7ff5c3506740 1 -- 172.21.15.79:0/3784848121 shutdown_connections 2024-08-20T01:44:08.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.394+0000 7ff5c3506740 1 -- 172.21.15.79:0/3784848121 wait complete. 2024-08-20T01:44:08.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.394+0000 7ff5c3506740 1 -- start start 2024-08-20T01:44:08.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.395+0000 7ff5c3506740 1 Processor -- start 2024-08-20T01:44:08.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.395+0000 7ff5c3506740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1069e3730 0x55e1069ed000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:08.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.395+0000 7ff5c3506740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e1069e4050 0x55e1069ed540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:08.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.395+0000 7ff5c3506740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e1069effe0 0x55e1069eda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:08.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.395+0000 7ff5c3506740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e1067ac700 con 0x55e1069e4050 2024-08-20T01:44:08.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.395+0000 7ff5c3506740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e1068d0810 con 0x55e1069e3730 2024-08-20T01:44:08.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.395+0000 7ff5c3506740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e1069f2c90 con 0x55e1069effe0 2024-08-20T01:44:08.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.395+0000 7ff5b3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e1069e4050 0x55e1069ed540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:08.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.395+0000 7ff5b3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e1069e4050 0x55e1069ed540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58832/0 (socket says 172.21.15.79:58832) 2024-08-20T01:44:08.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.395+0000 7ff5b3fff640 1 -- 172.21.15.79:0/3566229769 learned_addr learned my addr 172.21.15.79:0/3566229769 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:08.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.395+0000 7ff5bad9d640 1 --2- 172.21.15.79:0/3566229769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1069e3730 0x55e1069ed000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:08.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.395+0000 7ff5c3506740 10 client.0 _ll_register_callbacks cb 0x55e106943700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:44:08.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.395+0000 7ff5bb59e640 1 --2- 172.21.15.79:0/3566229769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e1069effe0 0x55e1069eda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:08.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.395+0000 7ff5b3fff640 1 -- 172.21.15.79:0/3566229769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e1069effe0 msgr2=0x55e1069eda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:08.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.395+0000 7ff5b3fff640 1 --2- 172.21.15.79:0/3566229769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e1069effe0 0x55e1069eda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:08.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.395+0000 7ff5b3fff640 1 -- 172.21.15.79:0/3566229769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1069e3730 msgr2=0x55e1069ed000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:08.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.396+0000 7ff5b3fff640 1 --2- 172.21.15.79:0/3566229769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1069e3730 0x55e1069ed000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:08.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.396+0000 7ff5b3fff640 1 -- 172.21.15.79:0/3566229769 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1069fc0c0 con 0x55e1069e4050 2024-08-20T01:44:08.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.396+0000 7ff5b3fff640 1 --2- 172.21.15.79:0/3566229769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e1069e4050 0x55e1069ed540 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7ff5a400c6a0 tx=0x7ff5a4005ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91d5d79c1527883a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:08.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.396+0000 7ff5a27fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:44:08.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.396+0000 7ff5a27fc640 1 -- 172.21.15.79:0/3566229769 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a40c9020 con 0x55e1069e4050 2024-08-20T01:44:08.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.396+0000 7ff5a27fc640 1 -- 172.21.15.79:0/3566229769 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff5a4010d50 con 0x55e1069e4050 2024-08-20T01:44:08.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.396+0000 7ff5c3506740 1 -- 172.21.15.79:0/3566229769 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e1068f9150 con 0x55e1069e4050 2024-08-20T01:44:08.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.396+0000 7ff5a27fc640 1 -- 172.21.15.79:0/3566229769 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7ff5a40af570 con 0x55e1069e4050 2024-08-20T01:44:08.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.396+0000 7ff5c3506740 10 client.17541 fetch_fsmap learned FSMap version 40 2024-08-20T01:44:08.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.396+0000 7ff5c3506740 1 -- 172.21.15.79:0/3566229769 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55e106a071f0 con 0x55e1069e4050 2024-08-20T01:44:08.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.396+0000 7ff5a27fc640 1 -- 172.21.15.79:0/3566229769 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff5a40b4020 con 0x55e1069e4050 2024-08-20T01:44:08.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.397+0000 7ff5a27fc640 1 -- 172.21.15.79:0/3566229769 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 40) ==== 8374+0+0 (secure 0 0 0) 0x7ff5a40a9c40 con 0x55e1069e4050 2024-08-20T01:44:08.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.397+0000 7ff5c3506740 10 client.17541 fetch_fsmap finished waiting for FSMap version 40 2024-08-20T01:44:08.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.397+0000 7ff5c3506740 10 client.17541 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:44:08.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.397+0000 7ff5c3506740 20 client.17541 populate_metadata read hostname 'smithi079' 2024-08-20T01:44:08.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.397+0000 7ff5c3506740 1 --2- 172.21.15.79:0/3566229769 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55e106a08540 0x55e106a0a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:08.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.397+0000 7ff5c3506740 4 client.17541 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:44:08.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.397+0000 7ff5c3506740 1 -- 172.21.15.79:0/3566229769 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e1068f9150 con 0x55e106a08540 2024-08-20T01:44:08.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.397+0000 7ff5bad9d640 1 --2- 172.21.15.79:0/3566229769 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55e106a08540 0x55e106a0a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:08.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.398+0000 7ff5bad9d640 1 --2- 172.21.15.79:0/3566229769 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55e106a08540 0x55e106a0a930 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9ad4234b4f6440af server_cookie=35d493a056fe8869 in_seq=0 out_seq=0 2024-08-20T01:44:08.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.398+0000 7ff5a27fc640 10 client.17541 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:44:08.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.398+0000 7ff5a27fc640 1 -- 172.21.15.79:0/3566229769 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e1068f9150 con 0x55e106a08540 2024-08-20T01:44:08.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.398+0000 7ff5a27fc640 10 client.17541 handle_command_reply: tid=0 2024-08-20T01:44:08.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.398+0000 7ff5c3506740 1 client.17541 shutdown 2024-08-20T01:44:08.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.398+0000 7ff5c3506740 1 -- 172.21.15.79:0/3566229769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e1069e4050 msgr2=0x55e1069ed540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:08.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.398+0000 7ff5c3506740 1 --2- 172.21.15.79:0/3566229769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e1069e4050 0x55e1069ed540 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7ff5a400c6a0 tx=0x7ff5a4005ab0 comp rx=0 tx=0).stop 2024-08-20T01:44:08.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.399+0000 7ff5c3506740 1 -- 172.21.15.79:0/3566229769 shutdown_connections 2024-08-20T01:44:08.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.399+0000 7ff5c3506740 1 --2- 172.21.15.79:0/3566229769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e1069effe0 0x55e1069eda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:08.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.399+0000 7ff5c3506740 1 --2- 172.21.15.79:0/3566229769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e1069e4050 0x55e1069ed540 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:08.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.399+0000 7ff5c3506740 1 --2- 172.21.15.79:0/3566229769 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55e106a08540 0x55e106a0a930 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:08.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.399+0000 7ff5a27fc640 0 client.17541 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:44:08.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.399+0000 7ff5c3506740 1 --2- 172.21.15.79:0/3566229769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1069e3730 0x55e1069ed000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:08.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.399+0000 7ff5c3506740 1 -- 172.21.15.79:0/3566229769 >> 172.21.15.79:0/3566229769 conn(0x55e1069e1560 msgr2=0x55e1069e7100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:08.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.399+0000 7ff5c3506740 1 -- 172.21.15.79:0/3566229769 shutdown_connections 2024-08-20T01:44:08.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.399+0000 7ff5c3506740 1 -- 172.21.15.79:0/3566229769 wait complete. 2024-08-20T01:44:08.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.399+0000 7ff5c3506740 20 client.17541 trim_cache size 0 max 16384 2024-08-20T01:44:08.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.414+0000 7ff5c3506740 1 Processor -- start 2024-08-20T01:44:08.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.414+0000 7ff5c3506740 1 -- start start 2024-08-20T01:44:08.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.414+0000 7ff5c3506740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1069e3730 0x55e1069e7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:08.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.414+0000 7ff5c3506740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e1069e4050 0x55e1069e03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:08.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.414+0000 7ff5c3506740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e1069effe0 0x55e1069ed500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:08.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.414+0000 7ff5c3506740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc1ac3b0 con 0x55e1069e4050 2024-08-20T01:44:08.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.414+0000 7ff5c3506740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc1adf80 con 0x55e1069e3730 2024-08-20T01:44:08.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.414+0000 7ff5c3506740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc1aca80 con 0x55e1069effe0 2024-08-20T01:44:08.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.415+0000 7ff5b3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e1069e4050 0x55e1069e03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:08.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.415+0000 7ff5bad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1069e3730 0x55e1069e7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:08.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.415+0000 7ff5b3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e1069e4050 0x55e1069e03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58836/0 (socket says 172.21.15.79:58836) 2024-08-20T01:44:08.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.415+0000 7ff5bad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1069e3730 0x55e1069e7830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:54458/0 (socket says 172.21.15.79:54458) 2024-08-20T01:44:08.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.415+0000 7ff5b3fff640 1 -- 172.21.15.79:0/2181112899 learned_addr learned my addr 172.21.15.79:0/2181112899 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:08.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.415+0000 7ff5bb59e640 1 --2- 172.21.15.79:0/2181112899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e1069effe0 0x55e1069ed500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:08.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.415+0000 7ff5b3fff640 1 -- 172.21.15.79:0/2181112899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e1069effe0 msgr2=0x55e1069ed500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:08.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.415+0000 7ff5b3fff640 1 --2- 172.21.15.79:0/2181112899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e1069effe0 0x55e1069ed500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:08.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.415+0000 7ff5b3fff640 1 -- 172.21.15.79:0/2181112899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1069e3730 msgr2=0x55e1069e7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:08.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.415+0000 7ff5b3fff640 1 --2- 172.21.15.79:0/2181112899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1069e3730 0x55e1069e7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:08.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.415+0000 7ff5b3fff640 1 -- 172.21.15.79:0/2181112899 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1069e1fe0 con 0x55e1069e4050 2024-08-20T01:44:08.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.415+0000 7ff5bb59e640 1 --2- 172.21.15.79:0/2181112899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e1069effe0 0x55e1069ed500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:44:08.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.415+0000 7ff5bad9d640 1 --2- 172.21.15.79:0/2181112899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1069e3730 0x55e1069e7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:44:08.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.415+0000 7ff5b3fff640 1 --2- 172.21.15.79:0/2181112899 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e1069e4050 0x55e1069e03e0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4009380 tx=0x7ff5a4010850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a859de0c269d0d58 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:08.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.415+0000 7ff5b0ff9640 1 -- 172.21.15.79:0/2181112899 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a40c9070 con 0x55e1069e4050 2024-08-20T01:44:08.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.415+0000 7ff5b0ff9640 1 -- 172.21.15.79:0/2181112899 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff5a40a7200 con 0x55e1069e4050 2024-08-20T01:44:08.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.415+0000 7ff5b0ff9640 1 -- 172.21.15.79:0/2181112899 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a40a9c40 con 0x55e1069e4050 2024-08-20T01:44:08.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.416+0000 7ff5c3506740 1 -- 172.21.15.79:0/2181112899 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e1069e4050 msgr2=0x55e1069e03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:08.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.416+0000 7ff5c3506740 1 --2- 172.21.15.79:0/2181112899 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e1069e4050 0x55e1069e03e0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4009380 tx=0x7ff5a4010850 comp rx=0 tx=0).stop 2024-08-20T01:44:08.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.416+0000 7ff5c3506740 1 -- 172.21.15.79:0/2181112899 shutdown_connections 2024-08-20T01:44:08.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.416+0000 7ff5c3506740 1 --2- 172.21.15.79:0/2181112899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e1069effe0 0x55e1069ed500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:08.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.417+0000 7ff5c3506740 1 --2- 172.21.15.79:0/2181112899 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e1069e4050 0x55e1069e03e0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:08.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.417+0000 7ff5c3506740 1 --2- 172.21.15.79:0/2181112899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1069e3730 0x55e1069e7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:08.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.417+0000 7ff5c3506740 1 -- 172.21.15.79:0/2181112899 >> 172.21.15.79:0/2181112899 conn(0x55e1069e1560 msgr2=0x55e1069dfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:08.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.417+0000 7ff5c3506740 1 -- 172.21.15.79:0/2181112899 shutdown_connections 2024-08-20T01:44:08.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.417+0000 7ff5c3506740 1 -- 172.21.15.79:0/2181112899 wait complete. 2024-08-20T01:44:08.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.417+0000 7ff5c3506740 1 -- start start 2024-08-20T01:44:08.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.417+0000 7ff5c3506740 1 Processor -- start 2024-08-20T01:44:08.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.417+0000 7ff5c3506740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1069e3730 0x55e106a0aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:08.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.417+0000 7ff5c3506740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e1069e4050 0x55e106a0b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:08.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.417+0000 7ff5c3506740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e1069effe0 0x55e106a70e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:08.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.417+0000 7ff5c3506740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc1ad880 con 0x55e1069e4050 2024-08-20T01:44:08.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.417+0000 7ff5c3506740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc1ad150 con 0x55e1069e3730 2024-08-20T01:44:08.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.417+0000 7ff5c3506740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc1aa390 con 0x55e1069effe0 2024-08-20T01:44:08.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.418+0000 7ff5c3506740 10 client.0 _ll_register_callbacks cb 0x7ff5b4016070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:44:08.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.418+0000 7ff5b3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e1069e4050 0x55e106a0b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:08.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.418+0000 7ff5b3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e1069e4050 0x55e106a0b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58848/0 (socket says 172.21.15.79:58848) 2024-08-20T01:44:08.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.418+0000 7ff5b3fff640 1 -- 172.21.15.79:0/508061877 learned_addr learned my addr 172.21.15.79:0/508061877 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:08.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.418+0000 7ff5bb59e640 1 --2- 172.21.15.79:0/508061877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e1069effe0 0x55e106a70e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:08.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.418+0000 7ff5bad9d640 1 --2- 172.21.15.79:0/508061877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1069e3730 0x55e106a0aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:08.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.418+0000 7ff5b3fff640 1 -- 172.21.15.79:0/508061877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e1069effe0 msgr2=0x55e106a70e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:08.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.418+0000 7ff5b3fff640 1 --2- 172.21.15.79:0/508061877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e1069effe0 0x55e106a70e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:08.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.418+0000 7ff5b3fff640 1 -- 172.21.15.79:0/508061877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1069e3730 msgr2=0x55e106a0aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:08.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.418+0000 7ff5b3fff640 1 --2- 172.21.15.79:0/508061877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1069e3730 0x55e106a0aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:08.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.418+0000 7ff5b3fff640 1 -- 172.21.15.79:0/508061877 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1069e7d70 con 0x55e1069e4050 2024-08-20T01:44:08.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.418+0000 7ff5bad9d640 1 --2- 172.21.15.79:0/508061877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1069e3730 0x55e106a0aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:44:08.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.418+0000 7ff5b3fff640 1 --2- 172.21.15.79:0/508061877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e1069e4050 0x55e106a0b400 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7ff5a400c6a0 tx=0x7ff5a4010cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=668bc9072c486274 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:08.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.418+0000 7ff5a27fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:44:08.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.418+0000 7ff5a27fc640 1 -- 172.21.15.79:0/508061877 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a40c9070 con 0x55e1069e4050 2024-08-20T01:44:08.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.418+0000 7ff5a27fc640 1 -- 172.21.15.79:0/508061877 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff5a40a7560 con 0x55e1069e4050 2024-08-20T01:44:08.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.418+0000 7ff5c3506740 1 -- 172.21.15.79:0/508061877 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5a40a7200 con 0x55e1069e4050 2024-08-20T01:44:08.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.419+0000 7ff5a27fc640 1 -- 172.21.15.79:0/508061877 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7ff5a40a6e30 con 0x55e1069e4050 2024-08-20T01:44:08.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.419+0000 7ff5c3506740 10 client.17547 fetch_fsmap learned FSMap version 40 2024-08-20T01:44:08.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.419+0000 7ff5c3506740 1 -- 172.21.15.79:0/508061877 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55e1069e7d70 con 0x55e1069e4050 2024-08-20T01:44:08.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.419+0000 7ff5a27fc640 1 -- 172.21.15.79:0/508061877 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff5a40a7200 con 0x55e1069e4050 2024-08-20T01:44:08.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.419+0000 7ff5a27fc640 1 -- 172.21.15.79:0/508061877 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 40) ==== 8374+0+0 (secure 0 0 0) 0x7ff5a4018a40 con 0x55e1069e4050 2024-08-20T01:44:08.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.419+0000 7ff5c3506740 10 client.17547 fetch_fsmap finished waiting for FSMap version 40 2024-08-20T01:44:08.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.419+0000 7ff5c3506740 10 client.17547 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:44:08.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.419+0000 7ff5c3506740 20 client.17547 populate_metadata read hostname 'smithi079' 2024-08-20T01:44:08.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.419+0000 7ff5c3506740 1 --2- 172.21.15.79:0/508061877 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55e106a72820 0x55e106a74c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:08.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.419+0000 7ff5c3506740 4 client.17547 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:44:08.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.419+0000 7ff5c3506740 1 -- 172.21.15.79:0/508061877 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e10695c880 con 0x55e106a72820 2024-08-20T01:44:08.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.419+0000 7ff5bad9d640 1 --2- 172.21.15.79:0/508061877 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55e106a72820 0x55e106a74c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:08.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.420+0000 7ff5bad9d640 1 --2- 172.21.15.79:0/508061877 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55e106a72820 0x55e106a74c40 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=af2a6e4758b53809 server_cookie=b580d33563543555 in_seq=0 out_seq=0 2024-08-20T01:44:08.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.420+0000 7ff5a27fc640 10 client.17547 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:44:08.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.420+0000 7ff5a27fc640 1 -- 172.21.15.79:0/508061877 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e10695c880 con 0x55e106a72820 2024-08-20T01:44:08.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.420+0000 7ff5a27fc640 10 client.17547 handle_command_reply: tid=0 2024-08-20T01:44:08.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.420+0000 7ff5c3506740 1 client.17547 shutdown 2024-08-20T01:44:08.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.420+0000 7ff5c3506740 1 -- 172.21.15.79:0/508061877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e1069e4050 msgr2=0x55e106a0b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:08.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.420+0000 7ff5c3506740 1 --2- 172.21.15.79:0/508061877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e1069e4050 0x55e106a0b400 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7ff5a400c6a0 tx=0x7ff5a4010cc0 comp rx=0 tx=0).stop 2024-08-20T01:44:08.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.421+0000 7ff5c3506740 1 -- 172.21.15.79:0/508061877 shutdown_connections 2024-08-20T01:44:08.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.421+0000 7ff5c3506740 1 --2- 172.21.15.79:0/508061877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e1069effe0 0x55e106a70e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:08.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.421+0000 7ff5c3506740 1 --2- 172.21.15.79:0/508061877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e1069e4050 0x55e106a0b400 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:08.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.421+0000 7ff5c3506740 1 --2- 172.21.15.79:0/508061877 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55e106a72820 0x55e106a74c40 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:08.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.421+0000 7ff5c3506740 1 --2- 172.21.15.79:0/508061877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e1069e3730 0x55e106a0aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:08.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.421+0000 7ff5a27fc640 0 client.17547 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:44:08.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.421+0000 7ff5c3506740 1 -- 172.21.15.79:0/508061877 >> 172.21.15.79:0/508061877 conn(0x55e1069e1560 msgr2=0x55e1069e04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:08.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.421+0000 7ff5c3506740 1 -- 172.21.15.79:0/508061877 shutdown_connections 2024-08-20T01:44:08.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.421+0000 7ff5c3506740 1 -- 172.21.15.79:0/508061877 wait complete. 2024-08-20T01:44:08.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.421+0000 7ff5c3506740 20 client.17547 trim_cache size 0 max 16384 2024-08-20T01:44:08.429 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:44:08.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.422+0000 7ff5c110d640 1 -- 172.21.15.79:0/1931428388 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff5a80b8020 msgr2=0x7ff5a80ba4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:08.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.422+0000 7ff5c110d640 1 --2- 172.21.15.79:0/1931428388 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff5a80b8020 0x7ff5a80ba4e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4005fd0 tx=0x7ff5b40094a0 comp rx=0 tx=0).stop 2024-08-20T01:44:08.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.422+0000 7ff5c110d640 1 -- 172.21.15.79:0/1931428388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5bc108e60 msgr2=0x7ff5bc197410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:08.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.422+0000 7ff5c110d640 1 --2- 172.21.15.79:0/1931428388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5bc108e60 0x7ff5bc197410 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7ff5a400e9f0 tx=0x7ff5a400eeb0 comp rx=0 tx=0).stop 2024-08-20T01:44:08.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.422+0000 7ff5c110d640 1 -- 172.21.15.79:0/1931428388 shutdown_connections 2024-08-20T01:44:08.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.422+0000 7ff5c110d640 1 --2- 172.21.15.79:0/1931428388 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff5a80b8020 0x7ff5a80ba4e0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:08.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.422+0000 7ff5c110d640 1 --2- 172.21.15.79:0/1931428388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5bc19c7b0 0x7ff5bc19cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:08.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.422+0000 7ff5c110d640 1 --2- 172.21.15.79:0/1931428388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5bc108e60 0x7ff5bc197410 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:08.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.422+0000 7ff5c110d640 1 --2- 172.21.15.79:0/1931428388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5bc1084e0 0x7ff5bc196ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:08.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.422+0000 7ff5c110d640 1 -- 172.21.15.79:0/1931428388 >> 172.21.15.79:0/1931428388 conn(0x7ff5bc0fe540 msgr2=0x7ff5bc100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:08.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.422+0000 7ff5c110d640 1 -- 172.21.15.79:0/1931428388 shutdown_connections 2024-08-20T01:44:08.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:08.422+0000 7ff5c110d640 1 -- 172.21.15.79:0/1931428388 wait complete. 2024-08-20T01:44:08.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:08 smithi079 ceph-mon[18656]: pgmap v551: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 24 op/s 2024-08-20T01:44:08.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:08 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:44:08.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:08 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T01:44:08.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:08 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-20T01:44:08.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:08 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-20T01:44:08.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:08 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T01:44:08.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:08 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T01:44:08.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:08 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-20T01:44:08.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:08 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-20T01:44:08.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:08 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-20T01:44:08.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:08 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-20T01:44:08.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:08 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-20T01:44:08.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:08 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-20T01:44:08.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:08 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-20T01:44:08.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:08 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:44:08.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:08 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:44:08.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:08 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:44:08.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:08 smithi081 ceph-mon[22209]: pgmap v551: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 24 op/s 2024-08-20T01:44:08.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:08 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:44:08.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:08 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T01:44:08.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:08 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-20T01:44:08.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:08 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-20T01:44:08.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:08 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T01:44:08.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:08 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T01:44:08.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:08 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-20T01:44:08.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:08 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-20T01:44:08.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:08 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-20T01:44:08.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:08 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-20T01:44:08.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:08 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-20T01:44:08.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:08 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-20T01:44:08.780 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:08 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-20T01:44:08.780 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:08 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:44:08.780 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:08 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:44:08.780 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:08 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:44:08.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:08 smithi175 ceph-mon[22392]: pgmap v551: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 24 op/s 2024-08-20T01:44:08.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:08 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:44:08.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:08 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T01:44:08.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:08 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-20T01:44:08.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:08 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-20T01:44:08.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:08 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T01:44:08.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:08 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T01:44:08.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:08 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-20T01:44:08.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:08 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-20T01:44:08.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:08 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-20T01:44:08.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:08 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-20T01:44:08.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:08 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-20T01:44:08.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:08 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-20T01:44:08.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:08 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-20T01:44:08.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:08 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:44:08.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:08 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:44:08.891 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:08 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:44:09.224 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T01:44:09.503 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:44:09.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:09 smithi081 ceph-mon[22209]: Adjusting osd_memory_target on smithi175 to 176.0M 2024-08-20T01:44:09.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:09 smithi081 ceph-mon[22209]: Unable to set osd_memory_target on smithi175 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-08-20T01:44:09.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:09 smithi081 ceph-mon[22209]: Adjusting osd_memory_target on smithi079 to 176.0M 2024-08-20T01:44:09.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:09 smithi081 ceph-mon[22209]: Adjusting osd_memory_target on smithi081 to 176.0M 2024-08-20T01:44:09.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:09 smithi081 ceph-mon[22209]: Unable to set osd_memory_target on smithi079 to 184590336: error parsing value: Value '184590336' is below minimum 939524096 2024-08-20T01:44:09.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:09 smithi081 ceph-mon[22209]: Unable to set osd_memory_target on smithi081 to 184590336: error parsing value: Value '184590336' is below minimum 939524096 2024-08-20T01:44:09.779 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:09 smithi079 ceph-mon[18656]: Adjusting osd_memory_target on smithi175 to 176.0M 2024-08-20T01:44:09.779 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:09 smithi079 ceph-mon[18656]: Unable to set osd_memory_target on smithi175 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-08-20T01:44:09.779 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:09 smithi079 ceph-mon[18656]: Adjusting osd_memory_target on smithi079 to 176.0M 2024-08-20T01:44:09.779 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:09 smithi079 ceph-mon[18656]: Adjusting osd_memory_target on smithi081 to 176.0M 2024-08-20T01:44:09.780 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:09 smithi079 ceph-mon[18656]: Unable to set osd_memory_target on smithi079 to 184590336: error parsing value: Value '184590336' is below minimum 939524096 2024-08-20T01:44:09.780 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:09 smithi079 ceph-mon[18656]: Unable to set osd_memory_target on smithi081 to 184590336: error parsing value: Value '184590336' is below minimum 939524096 2024-08-20T01:44:09.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:09 smithi175 ceph-mon[22392]: Adjusting osd_memory_target on smithi175 to 176.0M 2024-08-20T01:44:09.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:09 smithi175 ceph-mon[22392]: Unable to set osd_memory_target on smithi175 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-08-20T01:44:09.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:09 smithi175 ceph-mon[22392]: Adjusting osd_memory_target on smithi079 to 176.0M 2024-08-20T01:44:09.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:09 smithi175 ceph-mon[22392]: Adjusting osd_memory_target on smithi081 to 176.0M 2024-08-20T01:44:09.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:09 smithi175 ceph-mon[22392]: Unable to set osd_memory_target on smithi079 to 184590336: error parsing value: Value '184590336' is below minimum 939524096 2024-08-20T01:44:09.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:09 smithi175 ceph-mon[22392]: Unable to set osd_memory_target on smithi081 to 184590336: error parsing value: Value '184590336' is below minimum 939524096 2024-08-20T01:44:10.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:10 smithi081 ceph-mon[22209]: pgmap v552: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 28 MiB/s wr, 27 op/s 2024-08-20T01:44:10.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:10 smithi175 ceph-mon[22392]: pgmap v552: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 28 MiB/s wr, 27 op/s 2024-08-20T01:44:10.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:10 smithi079 ceph-mon[18656]: pgmap v552: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 28 MiB/s wr, 27 op/s 2024-08-20T01:44:11.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.260+0000 7f3cb6246640 1 -- 172.21.15.79:0/3003571119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cb0101990 msgr2=0x7f3cb0101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:11.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.260+0000 7f3cb6246640 1 --2- 172.21.15.79:0/3003571119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cb0101990 0x7f3cb0101d70 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0009900 tx=0x7f3ca002a410 comp rx=0 tx=0).stop 2024-08-20T01:44:11.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.260+0000 7f3cb6246640 1 -- 172.21.15.79:0/3003571119 shutdown_connections 2024-08-20T01:44:11.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.260+0000 7f3cb6246640 1 --2- 172.21.15.79:0/3003571119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cb0107d20 0x7f3cb010e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:11.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.260+0000 7f3cb6246640 1 --2- 172.21.15.79:0/3003571119 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cb01073a0 0x7f3cb01077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:11.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.260+0000 7f3cb6246640 1 --2- 172.21.15.79:0/3003571119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cb0101990 0x7f3cb0101d70 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:11.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.260+0000 7f3cb6246640 1 -- 172.21.15.79:0/3003571119 >> 172.21.15.79:0/3003571119 conn(0x7f3cb00fd400 msgr2=0x7f3cb00ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:11.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.260+0000 7f3cb6246640 1 -- 172.21.15.79:0/3003571119 shutdown_connections 2024-08-20T01:44:11.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.260+0000 7f3cb6246640 1 -- 172.21.15.79:0/3003571119 wait complete. 2024-08-20T01:44:11.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.260+0000 7f3cb6246640 1 Processor -- start 2024-08-20T01:44:11.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.261+0000 7f3cb6246640 1 -- start start 2024-08-20T01:44:11.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.261+0000 7f3cb6246640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cb0101990 0x7f3cb0198f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:11.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.261+0000 7f3cb6246640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cb01073a0 0x7f3cb0199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:11.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.261+0000 7f3cb6246640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cb0107d20 0x7f3cb019e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:11.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.261+0000 7f3cb6246640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb0111890 con 0x7f3cb0101990 2024-08-20T01:44:11.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.261+0000 7f3cb6246640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb0111710 con 0x7f3cb01073a0 2024-08-20T01:44:11.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.261+0000 7f3cb6246640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb0111a10 con 0x7f3cb0107d20 2024-08-20T01:44:11.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.261+0000 7f3caf7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cb0101990 0x7f3cb0198f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:11.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.261+0000 7f3caf7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cb0101990 0x7f3cb0198f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58866/0 (socket says 172.21.15.79:58866) 2024-08-20T01:44:11.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.261+0000 7f3caf7fe640 1 -- 172.21.15.79:0/2234301311 learned_addr learned my addr 172.21.15.79:0/2234301311 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:11.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.261+0000 7f3caffff640 1 --2- 172.21.15.79:0/2234301311 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cb0107d20 0x7f3cb019e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:11.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.261+0000 7f3caeffd640 1 --2- 172.21.15.79:0/2234301311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cb01073a0 0x7f3cb0199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:11.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.261+0000 7f3caf7fe640 1 -- 172.21.15.79:0/2234301311 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cb0107d20 msgr2=0x7f3cb019e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:11.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.261+0000 7f3caf7fe640 1 --2- 172.21.15.79:0/2234301311 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cb0107d20 0x7f3cb019e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:11.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.261+0000 7f3caf7fe640 1 -- 172.21.15.79:0/2234301311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cb01073a0 msgr2=0x7f3cb0199450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:11.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.261+0000 7f3caf7fe640 1 --2- 172.21.15.79:0/2234301311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cb01073a0 0x7f3cb0199450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:11.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.261+0000 7f3caf7fe640 1 -- 172.21.15.79:0/2234301311 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb019efc0 con 0x7f3cb0101990 2024-08-20T01:44:11.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.261+0000 7f3caeffd640 1 --2- 172.21.15.79:0/2234301311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cb01073a0 0x7f3cb0199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:44:11.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.262+0000 7f3caf7fe640 1 --2- 172.21.15.79:0/2234301311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cb0101990 0x7f3cb0198f10 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0009230 tx=0x7f3ca0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:11.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.262+0000 7f3cacff9640 1 -- 172.21.15.79:0/2234301311 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca003f030 con 0x7f3cb0101990 2024-08-20T01:44:11.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.262+0000 7f3cacff9640 1 -- 172.21.15.79:0/2234301311 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3ca0003a80 con 0x7f3cb0101990 2024-08-20T01:44:11.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.262+0000 7f3cacff9640 1 -- 172.21.15.79:0/2234301311 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca0035070 con 0x7f3cb0101990 2024-08-20T01:44:11.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.262+0000 7f3cb6246640 1 -- 172.21.15.79:0/2234301311 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cb019f250 con 0x7f3cb0101990 2024-08-20T01:44:11.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.262+0000 7f3cb6246640 1 -- 172.21.15.79:0/2234301311 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cb01a5970 con 0x7f3cb0101990 2024-08-20T01:44:11.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.264+0000 7f3cacff9640 1 -- 172.21.15.79:0/2234301311 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3ca0042030 con 0x7f3cb0101990 2024-08-20T01:44:11.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.265+0000 7f3cb863f740 1 Processor -- start 2024-08-20T01:44:11.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.265+0000 7f3cb863f740 1 -- start start 2024-08-20T01:44:11.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.265+0000 7f3cb863f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fecb38d880 0x55fecb38dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:11.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.265+0000 7f3cb863f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fecb38e1a0 0x55fecb39e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:11.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.265+0000 7f3cb863f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fecb39e540 0x55fecb3a0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:11.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.265+0000 7f3cb863f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fecb304930 con 0x55fecb39e540 2024-08-20T01:44:11.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.265+0000 7f3cb863f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55fecb2f3e30 con 0x55fecb38e1a0 2024-08-20T01:44:11.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.265+0000 7f3cb863f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55fecb2f7e70 con 0x55fecb38d880 2024-08-20T01:44:11.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.265+0000 7f3caeffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fecb39e540 0x55fecb3a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:11.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.265+0000 7f3caffff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fecb38d880 0x55fecb38dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:11.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.265+0000 7f3caffff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fecb38d880 0x55fecb38dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:55722/0 (socket says 172.21.15.79:55722) 2024-08-20T01:44:11.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.265+0000 7f3caffff640 1 -- 172.21.15.79:0/1061017736 learned_addr learned my addr 172.21.15.79:0/1061017736 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:11.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.266+0000 7f3caf7fe640 1 --2- 172.21.15.79:0/1061017736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fecb38e1a0 0x55fecb39e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:11.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.266+0000 7f3cacff9640 1 --2- 172.21.15.79:0/2234301311 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3c980b3bd0 0x7f3c980b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:11.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.266+0000 7f3caffff640 1 -- 172.21.15.79:0/1061017736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fecb38e1a0 msgr2=0x55fecb39e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:11.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.266+0000 7f3caffff640 1 --2- 172.21.15.79:0/1061017736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fecb38e1a0 0x55fecb39e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:11.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.266+0000 7f3caffff640 1 -- 172.21.15.79:0/1061017736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fecb39e540 msgr2=0x55fecb3a0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:11.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.266+0000 7f3caffff640 1 --2- 172.21.15.79:0/1061017736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fecb39e540 0x55fecb3a0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:11.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.266+0000 7f3caffff640 1 -- 172.21.15.79:0/1061017736 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fecb053650 con 0x55fecb38d880 2024-08-20T01:44:11.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.266+0000 7f3caeffd640 1 --2- 172.21.15.79:0/1061017736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fecb39e540 0x55fecb3a0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:44:11.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.266+0000 7f3cacff9640 1 -- 172.21.15.79:0/2234301311 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f3ca0104180 con 0x7f3cb0101990 2024-08-20T01:44:11.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.266+0000 7f3caffff640 1 --2- 172.21.15.79:0/2234301311 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3c980b3bd0 0x7f3c980b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:11.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.266+0000 7f3caffff640 1 --2- 172.21.15.79:0/1061017736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fecb38d880 0x55fecb38dc60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8003a20 tx=0x7f3ca8003ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1486101508fbbbc6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:11.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.266+0000 7f3c95ffb640 1 -- 172.21.15.79:0/1061017736 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8022070 con 0x55fecb38d880 2024-08-20T01:44:11.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.266+0000 7f3c95ffb640 1 -- 172.21.15.79:0/1061017736 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3ca8015070 con 0x55fecb38d880 2024-08-20T01:44:11.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.266+0000 7f3c95ffb640 1 -- 172.21.15.79:0/1061017736 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca80108a0 con 0x55fecb38d880 2024-08-20T01:44:11.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.267+0000 7f3cb863f740 1 -- 172.21.15.79:0/1061017736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fecb38d880 msgr2=0x55fecb38dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:11.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.267+0000 7f3cb863f740 1 --2- 172.21.15.79:0/1061017736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fecb38d880 0x55fecb38dc60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8003a20 tx=0x7f3ca8003ee0 comp rx=0 tx=0).stop 2024-08-20T01:44:11.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.267+0000 7f3caffff640 1 --2- 172.21.15.79:0/2234301311 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3c980b3bd0 0x7f3c980b6090 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8009fd0 tx=0x7f3ca8020000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:11.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.267+0000 7f3cb863f740 1 -- 172.21.15.79:0/1061017736 shutdown_connections 2024-08-20T01:44:11.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.267+0000 7f3cb863f740 1 --2- 172.21.15.79:0/1061017736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fecb39e540 0x55fecb3a0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:11.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.267+0000 7f3cb863f740 1 --2- 172.21.15.79:0/1061017736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fecb38e1a0 0x55fecb39e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:11.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.267+0000 7f3cb863f740 1 --2- 172.21.15.79:0/1061017736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fecb38d880 0x55fecb38dc60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:11.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.267+0000 7f3cb863f740 1 -- 172.21.15.79:0/1061017736 >> 172.21.15.79:0/1061017736 conn(0x55fecb38b6b0 msgr2=0x55fecb38c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:11.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.267+0000 7f3cb863f740 1 -- 172.21.15.79:0/1061017736 shutdown_connections 2024-08-20T01:44:11.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.267+0000 7f3cb863f740 1 -- 172.21.15.79:0/1061017736 wait complete. 2024-08-20T01:44:11.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.268+0000 7f3cb863f740 1 -- start start 2024-08-20T01:44:11.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.268+0000 7f3cb863f740 1 Processor -- start 2024-08-20T01:44:11.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.268+0000 7f3cb863f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fecb38d880 0x55fecb39b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:11.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.268+0000 7f3cb863f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fecb38e1a0 0x55fecb39bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:11.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.268+0000 7f3cb863f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fecb39e540 0x55fecb39bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:11.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.268+0000 7f3cb863f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fecb156700 con 0x55fecb38d880 2024-08-20T01:44:11.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.268+0000 7f3cb863f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55fecb27a810 con 0x55fecb39e540 2024-08-20T01:44:11.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.268+0000 7f3cb863f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55fecb3a11f0 con 0x55fecb38e1a0 2024-08-20T01:44:11.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.268+0000 7f3cb863f740 10 client.0 _ll_register_callbacks cb 0x55fecb2ed700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:44:11.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.268+0000 7f3caf7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fecb38d880 0x55fecb39b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:11.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.268+0000 7f3caf7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fecb38d880 0x55fecb39b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58884/0 (socket says 172.21.15.79:58884) 2024-08-20T01:44:11.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.268+0000 7f3caf7fe640 1 -- 172.21.15.79:0/2047123498 learned_addr learned my addr 172.21.15.79:0/2047123498 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:11.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.268+0000 7f3caeffd640 1 --2- 172.21.15.79:0/2047123498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fecb38e1a0 0x55fecb39bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:11.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.269+0000 7f3caffff640 1 --2- 172.21.15.79:0/2047123498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fecb39e540 0x55fecb39bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:11.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.269+0000 7f3caf7fe640 1 -- 172.21.15.79:0/2047123498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fecb38e1a0 msgr2=0x55fecb39bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:11.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.269+0000 7f3caf7fe640 1 --2- 172.21.15.79:0/2047123498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fecb38e1a0 0x55fecb39bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:11.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.269+0000 7f3caf7fe640 1 -- 172.21.15.79:0/2047123498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fecb39e540 msgr2=0x55fecb39bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:11.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.269+0000 7f3caf7fe640 1 --2- 172.21.15.79:0/2047123498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fecb39e540 0x55fecb39bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:11.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.269+0000 7f3caf7fe640 1 -- 172.21.15.79:0/2047123498 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fecb3aa650 con 0x55fecb38d880 2024-08-20T01:44:11.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.269+0000 7f3caf7fe640 1 --2- 172.21.15.79:0/2047123498 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fecb38d880 0x55fecb39b570 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f3ca00c7160 tx=0x7f3ca00caaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=617232c79b00705e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:11.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.269+0000 7f3c8effd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:44:11.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.269+0000 7f3c8effd640 1 -- 172.21.15.79:0/2047123498 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca0049070 con 0x55fecb38d880 2024-08-20T01:44:11.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.269+0000 7f3c8effd640 1 -- 172.21.15.79:0/2047123498 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f3ca00c76d0 con 0x55fecb38d880 2024-08-20T01:44:11.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.269+0000 7f3cb863f740 1 -- 172.21.15.79:0/2047123498 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fecb2a3150 con 0x55fecb38d880 2024-08-20T01:44:11.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.269+0000 7f3c8effd640 1 -- 172.21.15.79:0/2047123498 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f3ca00cb7e0 con 0x55fecb38d880 2024-08-20T01:44:11.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.269+0000 7f3cb863f740 10 client.17559 fetch_fsmap learned FSMap version 40 2024-08-20T01:44:11.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.269+0000 7f3cb863f740 1 -- 172.21.15.79:0/2047123498 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55fecb3acfe0 con 0x55fecb38d880 2024-08-20T01:44:11.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.270+0000 7f3c8effd640 1 -- 172.21.15.79:0/2047123498 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3ca00cb0e0 con 0x55fecb38d880 2024-08-20T01:44:11.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.270+0000 7f3c8effd640 1 -- 172.21.15.79:0/2047123498 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 40) ==== 8374+0+0 (secure 0 0 0) 0x7f3ca00cb340 con 0x55fecb38d880 2024-08-20T01:44:11.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.270+0000 7f3cb863f740 10 client.17559 fetch_fsmap finished waiting for FSMap version 40 2024-08-20T01:44:11.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.270+0000 7f3cb863f740 10 client.17559 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:44:11.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.270+0000 7f3cb863f740 20 client.17559 populate_metadata read hostname 'smithi079' 2024-08-20T01:44:11.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.270+0000 7f3cb863f740 1 --2- 172.21.15.79:0/2047123498 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55fecb3ae440 0x55fecb3b0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:11.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.270+0000 7f3cb863f740 4 client.17559 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:44:11.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.270+0000 7f3cb863f740 1 -- 172.21.15.79:0/2047123498 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fecb2a3150 con 0x55fecb3ae440 2024-08-20T01:44:11.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.270+0000 7f3caeffd640 1 --2- 172.21.15.79:0/2047123498 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55fecb3ae440 0x55fecb3b0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:11.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.271+0000 7f3c8effd640 10 client.17559 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:44:11.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.271+0000 7f3caeffd640 1 --2- 172.21.15.79:0/2047123498 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55fecb3ae440 0x55fecb3b0860 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=203a7459ba7012ba server_cookie=5b245ee4f5140148 in_seq=0 out_seq=0 2024-08-20T01:44:11.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.271+0000 7f3c8effd640 1 -- 172.21.15.79:0/2047123498 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fecb2a3150 con 0x55fecb3ae440 2024-08-20T01:44:11.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.271+0000 7f3c8effd640 10 client.17559 handle_command_reply: tid=0 2024-08-20T01:44:11.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.271+0000 7f3cb863f740 1 client.17559 shutdown 2024-08-20T01:44:11.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.272+0000 7f3cb863f740 1 -- 172.21.15.79:0/2047123498 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fecb38d880 msgr2=0x55fecb39b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:11.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.272+0000 7f3cb863f740 1 --2- 172.21.15.79:0/2047123498 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fecb38d880 0x55fecb39b570 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f3ca00c7160 tx=0x7f3ca00caaf0 comp rx=0 tx=0).stop 2024-08-20T01:44:11.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.272+0000 7f3cb863f740 1 -- 172.21.15.79:0/2047123498 shutdown_connections 2024-08-20T01:44:11.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.272+0000 7f3cb863f740 1 --2- 172.21.15.79:0/2047123498 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55fecb3ae440 0x55fecb3b0860 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:11.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.272+0000 7f3c8effd640 0 client.17559 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:44:11.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.272+0000 7f3cb863f740 1 --2- 172.21.15.79:0/2047123498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fecb39e540 0x55fecb39bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:11.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.272+0000 7f3cb863f740 1 --2- 172.21.15.79:0/2047123498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fecb38e1a0 0x55fecb39bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:11.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.272+0000 7f3cb863f740 1 --2- 172.21.15.79:0/2047123498 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fecb38d880 0x55fecb39b570 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:11.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.272+0000 7f3cb863f740 1 -- 172.21.15.79:0/2047123498 >> 172.21.15.79:0/2047123498 conn(0x55fecb38b6b0 msgr2=0x55fecb3911e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:11.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.272+0000 7f3cb863f740 1 -- 172.21.15.79:0/2047123498 shutdown_connections 2024-08-20T01:44:11.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.272+0000 7f3cb863f740 1 -- 172.21.15.79:0/2047123498 wait complete. 2024-08-20T01:44:11.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.272+0000 7f3cb863f740 20 client.17559 trim_cache size 0 max 16384 2024-08-20T01:44:11.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.289+0000 7f3cb863f740 1 Processor -- start 2024-08-20T01:44:11.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.289+0000 7f3cb863f740 1 -- start start 2024-08-20T01:44:11.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.289+0000 7f3cb863f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fecb38d880 0x55fecb398fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:11.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.289+0000 7f3cb863f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fecb38e1a0 0x55fecb38af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:11.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.289+0000 7f3cb863f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fecb39e540 0x55fecb38f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:11.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.289+0000 7f3cb863f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb01abe10 con 0x55fecb39e540 2024-08-20T01:44:11.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.289+0000 7f3cb863f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb01ad9e0 con 0x55fecb38d880 2024-08-20T01:44:11.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.289+0000 7f3cb863f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb01ac4e0 con 0x55fecb38e1a0 2024-08-20T01:44:11.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.289+0000 7f3caffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fecb39e540 0x55fecb38f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:11.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.289+0000 7f3caffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fecb39e540 0x55fecb38f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60768/0 (socket says 172.21.15.79:60768) 2024-08-20T01:44:11.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.289+0000 7f3caffff640 1 -- 172.21.15.79:0/3166234641 learned_addr learned my addr 172.21.15.79:0/3166234641 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:11.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.290+0000 7f3caf7fe640 1 --2- 172.21.15.79:0/3166234641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fecb38d880 0x55fecb398fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:11.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.290+0000 7f3caeffd640 1 --2- 172.21.15.79:0/3166234641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fecb38e1a0 0x55fecb38af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:11.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.290+0000 7f3caffff640 1 -- 172.21.15.79:0/3166234641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fecb38e1a0 msgr2=0x55fecb38af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:11.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.290+0000 7f3caffff640 1 --2- 172.21.15.79:0/3166234641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fecb38e1a0 0x55fecb38af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:11.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.290+0000 7f3caffff640 1 -- 172.21.15.79:0/3166234641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fecb38d880 msgr2=0x55fecb398fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:11.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.290+0000 7f3caffff640 1 --2- 172.21.15.79:0/3166234641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fecb38d880 0x55fecb398fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:11.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.290+0000 7f3caffff640 1 -- 172.21.15.79:0/3166234641 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fecb38dfd0 con 0x55fecb39e540 2024-08-20T01:44:11.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.290+0000 7f3caffff640 1 --2- 172.21.15.79:0/3166234641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fecb39e540 0x55fecb38f8e0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8009f80 tx=0x7f3ca8027000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dbf031497cb65b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:11.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.290+0000 7f3c957fa640 1 -- 172.21.15.79:0/3166234641 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8022040 con 0x55fecb39e540 2024-08-20T01:44:11.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.290+0000 7f3c957fa640 1 -- 172.21.15.79:0/3166234641 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3ca8015040 con 0x55fecb39e540 2024-08-20T01:44:11.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.290+0000 7f3c957fa640 1 -- 172.21.15.79:0/3166234641 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8010860 con 0x55fecb39e540 2024-08-20T01:44:11.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.291+0000 7f3cb863f740 1 -- 172.21.15.79:0/3166234641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fecb39e540 msgr2=0x55fecb38f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:11.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.291+0000 7f3cb863f740 1 --2- 172.21.15.79:0/3166234641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fecb39e540 0x55fecb38f8e0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8009f80 tx=0x7f3ca8027000 comp rx=0 tx=0).stop 2024-08-20T01:44:11.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.291+0000 7f3cb863f740 1 -- 172.21.15.79:0/3166234641 shutdown_connections 2024-08-20T01:44:11.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.291+0000 7f3cb863f740 1 --2- 172.21.15.79:0/3166234641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fecb39e540 0x55fecb38f8e0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:11.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.291+0000 7f3cb863f740 1 --2- 172.21.15.79:0/3166234641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fecb38e1a0 0x55fecb38af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:11.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.291+0000 7f3cb863f740 1 --2- 172.21.15.79:0/3166234641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fecb38d880 0x55fecb398fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:11.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.291+0000 7f3cb863f740 1 -- 172.21.15.79:0/3166234641 >> 172.21.15.79:0/3166234641 conn(0x55fecb38b6b0 msgr2=0x55fecb39d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:11.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.291+0000 7f3cb863f740 1 -- 172.21.15.79:0/3166234641 shutdown_connections 2024-08-20T01:44:11.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.291+0000 7f3cb863f740 1 -- 172.21.15.79:0/3166234641 wait complete. 2024-08-20T01:44:11.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.291+0000 7f3cb863f740 1 -- start start 2024-08-20T01:44:11.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.292+0000 7f3cb863f740 1 Processor -- start 2024-08-20T01:44:11.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.292+0000 7f3cb863f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fecb38d880 0x55fecb3a6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:11.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.292+0000 7f3cb863f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fecb38e1a0 0x55fecb3a69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:11.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.292+0000 7f3cb863f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fecb39e540 0x55fecb3b5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:11.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.292+0000 7f3cb863f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb01ad2e0 con 0x55fecb38e1a0 2024-08-20T01:44:11.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.292+0000 7f3cb863f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb01acbb0 con 0x55fecb38d880 2024-08-20T01:44:11.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.292+0000 7f3cb863f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb01a9df0 con 0x55fecb39e540 2024-08-20T01:44:11.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.292+0000 7f3cb863f740 10 client.0 _ll_register_callbacks cb 0x7f3ca003b460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:44:11.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.292+0000 7f3caeffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fecb38e1a0 0x55fecb3a69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:11.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.292+0000 7f3caeffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fecb38e1a0 0x55fecb3a69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60778/0 (socket says 172.21.15.79:60778) 2024-08-20T01:44:11.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.292+0000 7f3caeffd640 1 -- 172.21.15.79:0/184639938 learned_addr learned my addr 172.21.15.79:0/184639938 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:11.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.292+0000 7f3caffff640 1 --2- 172.21.15.79:0/184639938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fecb39e540 0x55fecb3b5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:11.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.292+0000 7f3caf7fe640 1 --2- 172.21.15.79:0/184639938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fecb38d880 0x55fecb3a6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:11.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.292+0000 7f3caeffd640 1 -- 172.21.15.79:0/184639938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fecb39e540 msgr2=0x55fecb3b5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:11.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.292+0000 7f3caeffd640 1 --2- 172.21.15.79:0/184639938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fecb39e540 0x55fecb3b5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:11.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.292+0000 7f3caeffd640 1 -- 172.21.15.79:0/184639938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fecb38d880 msgr2=0x55fecb3a6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:11.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.292+0000 7f3caeffd640 1 --2- 172.21.15.79:0/184639938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fecb38d880 0x55fecb3a6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:11.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.292+0000 7f3caeffd640 1 -- 172.21.15.79:0/184639938 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fecb3b6cc0 con 0x55fecb38e1a0 2024-08-20T01:44:11.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.293+0000 7f3caeffd640 1 --2- 172.21.15.79:0/184639938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fecb38e1a0 0x55fecb3a69c0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x55fecb38d830 tx=0x7f3ca4010c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bed7afa18941a36 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:11.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.293+0000 7f3c8effd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:44:11.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.293+0000 7f3c8effd640 1 -- 172.21.15.79:0/184639938 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca400fc80 con 0x55fecb38e1a0 2024-08-20T01:44:11.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.293+0000 7f3c8effd640 1 -- 172.21.15.79:0/184639938 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f3ca4004020 con 0x55fecb38e1a0 2024-08-20T01:44:11.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.293+0000 7f3cb863f740 1 -- 172.21.15.79:0/184639938 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fecb3a0cc0 con 0x55fecb38e1a0 2024-08-20T01:44:11.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.293+0000 7f3c8effd640 1 -- 172.21.15.79:0/184639938 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f3ca400fe20 con 0x55fecb38e1a0 2024-08-20T01:44:11.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.293+0000 7f3cb863f740 10 client.17565 fetch_fsmap learned FSMap version 40 2024-08-20T01:44:11.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.293+0000 7f3cb863f740 1 -- 172.21.15.79:0/184639938 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55fecb418700 con 0x55fecb38e1a0 2024-08-20T01:44:11.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.293+0000 7f3c8effd640 1 -- 172.21.15.79:0/184639938 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55fecb3a0cc0 con 0x55fecb38e1a0 2024-08-20T01:44:11.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.293+0000 7f3c8effd640 1 -- 172.21.15.79:0/184639938 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 40) ==== 8374+0+0 (secure 0 0 0) 0x7f3ca40035f0 con 0x55fecb38e1a0 2024-08-20T01:44:11.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.293+0000 7f3cb863f740 10 client.17565 fetch_fsmap finished waiting for FSMap version 40 2024-08-20T01:44:11.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.293+0000 7f3cb863f740 10 client.17565 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:44:11.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.293+0000 7f3cb863f740 20 client.17565 populate_metadata read hostname 'smithi079' 2024-08-20T01:44:11.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.293+0000 7f3cb863f740 1 --2- 172.21.15.79:0/184639938 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55fecb418ee0 0x55fecb41b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:11.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.293+0000 7f3cb863f740 4 client.17565 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:44:11.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.293+0000 7f3cb863f740 1 -- 172.21.15.79:0/184639938 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fecb306880 con 0x55fecb418ee0 2024-08-20T01:44:11.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.294+0000 7f3caf7fe640 1 --2- 172.21.15.79:0/184639938 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55fecb418ee0 0x55fecb41b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:11.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.294+0000 7f3caf7fe640 1 --2- 172.21.15.79:0/184639938 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55fecb418ee0 0x55fecb41b300 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2e0b4f43190f5cc server_cookie=ad96b60a4cbabdc9 in_seq=0 out_seq=0 2024-08-20T01:44:11.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.294+0000 7f3c8effd640 10 client.17565 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:44:11.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.294+0000 7f3c8effd640 1 -- 172.21.15.79:0/184639938 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fecb306880 con 0x55fecb418ee0 2024-08-20T01:44:11.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.294+0000 7f3c8effd640 10 client.17565 handle_command_reply: tid=0 2024-08-20T01:44:11.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.294+0000 7f3cb863f740 1 client.17565 shutdown 2024-08-20T01:44:11.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.294+0000 7f3cb863f740 1 -- 172.21.15.79:0/184639938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fecb38e1a0 msgr2=0x55fecb3a69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:11.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.294+0000 7f3cb863f740 1 --2- 172.21.15.79:0/184639938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fecb38e1a0 0x55fecb3a69c0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x55fecb38d830 tx=0x7f3ca4010c30 comp rx=0 tx=0).stop 2024-08-20T01:44:11.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.294+0000 7f3cb863f740 1 -- 172.21.15.79:0/184639938 shutdown_connections 2024-08-20T01:44:11.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.294+0000 7f3cb863f740 1 --2- 172.21.15.79:0/184639938 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55fecb418ee0 0x55fecb41b300 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:11.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.295+0000 7f3c8effd640 0 client.17565 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:44:11.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.295+0000 7f3cb863f740 1 --2- 172.21.15.79:0/184639938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fecb39e540 0x55fecb3b5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:11.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.295+0000 7f3cb863f740 1 --2- 172.21.15.79:0/184639938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fecb38e1a0 0x55fecb3a69c0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:11.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.295+0000 7f3cb863f740 1 --2- 172.21.15.79:0/184639938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fecb38d880 0x55fecb3a6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:11.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.295+0000 7f3cb863f740 1 -- 172.21.15.79:0/184639938 >> 172.21.15.79:0/184639938 conn(0x55fecb38b6b0 msgr2=0x55fecb38c390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:11.322 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:44:11.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.295+0000 7f3cb863f740 1 -- 172.21.15.79:0/184639938 shutdown_connections 2024-08-20T01:44:11.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.295+0000 7f3cb863f740 1 -- 172.21.15.79:0/184639938 wait complete. 2024-08-20T01:44:11.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.295+0000 7f3cb863f740 20 client.17565 trim_cache size 0 max 16384 2024-08-20T01:44:11.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.295+0000 7f3cb6246640 1 -- 172.21.15.79:0/2234301311 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3c980b3bd0 msgr2=0x7f3c980b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:11.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.295+0000 7f3cb6246640 1 --2- 172.21.15.79:0/2234301311 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3c980b3bd0 0x7f3c980b6090 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8009fd0 tx=0x7f3ca8020000 comp rx=0 tx=0).stop 2024-08-20T01:44:11.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.296+0000 7f3cb6246640 1 -- 172.21.15.79:0/2234301311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cb0101990 msgr2=0x7f3cb0198f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:11.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.296+0000 7f3cb6246640 1 --2- 172.21.15.79:0/2234301311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cb0101990 0x7f3cb0198f10 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0009230 tx=0x7f3ca0004270 comp rx=0 tx=0).stop 2024-08-20T01:44:11.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.296+0000 7f3cb6246640 1 -- 172.21.15.79:0/2234301311 shutdown_connections 2024-08-20T01:44:11.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.296+0000 7f3cb6246640 1 --2- 172.21.15.79:0/2234301311 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3c980b3bd0 0x7f3c980b6090 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:11.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.296+0000 7f3cb6246640 1 --2- 172.21.15.79:0/2234301311 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cb0107d20 0x7f3cb019e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:11.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.296+0000 7f3cb6246640 1 --2- 172.21.15.79:0/2234301311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cb01073a0 0x7f3cb0199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:11.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.296+0000 7f3cb6246640 1 --2- 172.21.15.79:0/2234301311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cb0101990 0x7f3cb0198f10 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:11.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.296+0000 7f3cb6246640 1 -- 172.21.15.79:0/2234301311 >> 172.21.15.79:0/2234301311 conn(0x7f3cb00fd400 msgr2=0x7f3cb006aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:11.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.296+0000 7f3cb6246640 1 -- 172.21.15.79:0/2234301311 shutdown_connections 2024-08-20T01:44:11.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:10.296+0000 7f3cb6246640 1 -- 172.21.15.79:0/2234301311 wait complete. 2024-08-20T01:44:11.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:11 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:44:11.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:11 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:44:11.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:11 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:44:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.604+0000 7f0b0b58f640 1 -- 172.21.15.79:0/3291222583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b04101560 msgr2=0x7f0b04101960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.604+0000 7f0b0b58f640 1 --2- 172.21.15.79:0/3291222583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b04101560 0x7f0b04101960 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f0b00009930 tx=0x7f0b0002a420 comp rx=0 tx=0).stop 2024-08-20T01:44:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.604+0000 7f0b0b58f640 1 -- 172.21.15.79:0/3291222583 shutdown_connections 2024-08-20T01:44:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.604+0000 7f0b0b58f640 1 --2- 172.21.15.79:0/3291222583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b04103070 0x7f0b041099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.604+0000 7f0b0b58f640 1 --2- 172.21.15.79:0/3291222583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b041026b0 0x7f0b04102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.604+0000 7f0b0b58f640 1 --2- 172.21.15.79:0/3291222583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b04101560 0x7f0b04101960 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.604+0000 7f0b0b58f640 1 -- 172.21.15.79:0/3291222583 >> 172.21.15.79:0/3291222583 conn(0x7f0b040fce40 msgr2=0x7f0b040ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.604+0000 7f0b0b58f640 1 -- 172.21.15.79:0/3291222583 shutdown_connections 2024-08-20T01:44:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.604+0000 7f0b0b58f640 1 -- 172.21.15.79:0/3291222583 wait complete. 2024-08-20T01:44:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.605+0000 7f0b0b58f640 1 Processor -- start 2024-08-20T01:44:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.605+0000 7f0b0b58f640 1 -- start start 2024-08-20T01:44:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.605+0000 7f0b0b58f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b04101560 0x7f0b041978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.605+0000 7f0b0b58f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b041026b0 0x7f0b04197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.605+0000 7f0b0b58f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b04103070 0x7f0b04198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.605+0000 7f0b0b58f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0b0410d060 con 0x7f0b04101560 2024-08-20T01:44:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.605+0000 7f0b0b58f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0b0410cee0 con 0x7f0b041026b0 2024-08-20T01:44:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.605+0000 7f0b0b58f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0b0410d1e0 con 0x7f0b04103070 2024-08-20T01:44:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.605+0000 7f0b0932b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b04101560 0x7f0b041978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:12.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.605+0000 7f0b0932b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b04101560 0x7f0b041978d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60796/0 (socket says 172.21.15.79:60796) 2024-08-20T01:44:12.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.605+0000 7f0b0932b640 1 -- 172.21.15.79:0/262819516 learned_addr learned my addr 172.21.15.79:0/262819516 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:12.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.605+0000 7f0b08b2a640 1 --2- 172.21.15.79:0/262819516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b041026b0 0x7f0b04197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:12.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.605+0000 7f0b09b2c640 1 --2- 172.21.15.79:0/262819516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b04103070 0x7f0b04198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:12.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.605+0000 7f0b0932b640 1 -- 172.21.15.79:0/262819516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b04103070 msgr2=0x7f0b04198b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:12.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.605+0000 7f0b0932b640 1 --2- 172.21.15.79:0/262819516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b04103070 0x7f0b04198b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:12.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.605+0000 7f0b0932b640 1 -- 172.21.15.79:0/262819516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b041026b0 msgr2=0x7f0b04197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:12.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.605+0000 7f0b0932b640 1 --2- 172.21.15.79:0/262819516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b041026b0 0x7f0b04197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:12.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.605+0000 7f0b0932b640 1 -- 172.21.15.79:0/262819516 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b04199410 con 0x7f0b04101560 2024-08-20T01:44:12.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.606+0000 7f0b0932b640 1 --2- 172.21.15.79:0/262819516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b04101560 0x7f0b041978d0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f0b00005ab0 tx=0x7f0b000042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:12.612 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.606+0000 7f0afa7fc640 1 -- 172.21.15.79:0/262819516 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b0003f030 con 0x7f0b04101560 2024-08-20T01:44:12.612 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.606+0000 7f0afa7fc640 1 -- 172.21.15.79:0/262819516 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0b00003c90 con 0x7f0b04101560 2024-08-20T01:44:12.612 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.606+0000 7f0b0b58f640 1 -- 172.21.15.79:0/262819516 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b041996a0 con 0x7f0b04101560 2024-08-20T01:44:12.612 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.606+0000 7f0afa7fc640 1 -- 172.21.15.79:0/262819516 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b00035070 con 0x7f0b04101560 2024-08-20T01:44:12.612 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.606+0000 7f0b0b58f640 1 -- 172.21.15.79:0/262819516 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b0419fdd0 con 0x7f0b04101560 2024-08-20T01:44:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.609+0000 7f0b0e456740 1 Processor -- start 2024-08-20T01:44:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.609+0000 7f0b0e456740 1 -- start start 2024-08-20T01:44:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.609+0000 7f0b0e456740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c5c05c8d0 0x557c5c05ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.609+0000 7f0b0e456740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c5c05d210 0x557c5c05d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.609+0000 7f0b0e456740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c5c05dbd0 0x557c5c05e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.609+0000 7f0b0e456740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557c5bfcf360 con 0x557c5c05c8d0 2024-08-20T01:44:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.609+0000 7f0b0e456740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557c5bfbe860 con 0x557c5c05d210 2024-08-20T01:44:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.609+0000 7f0b0e456740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557c5bfc28a0 con 0x557c5c05dbd0 2024-08-20T01:44:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.609+0000 7f0b09b2c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c5c05c8d0 0x557c5c05ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.609+0000 7f0afa7fc640 1 -- 172.21.15.79:0/262819516 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f0b00042030 con 0x7f0b04101560 2024-08-20T01:44:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.609+0000 7f0b09b2c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c5c05c8d0 0x557c5c05ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60800/0 (socket says 172.21.15.79:60800) 2024-08-20T01:44:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.609+0000 7f0b09b2c640 1 -- 172.21.15.79:0/343990289 learned_addr learned my addr 172.21.15.79:0/343990289 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.609+0000 7f0b08b2a640 1 --2- 172.21.15.79:0/343990289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c5c05dbd0 0x557c5c05e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.610+0000 7f0b09b2c640 1 -- 172.21.15.79:0/343990289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c5c05dbd0 msgr2=0x557c5c05e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.610+0000 7f0b09b2c640 1 --2- 172.21.15.79:0/343990289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c5c05dbd0 0x557c5c05e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.610+0000 7f0b09b2c640 1 -- 172.21.15.79:0/343990289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c5c05d210 msgr2=0x557c5c05d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.610+0000 7f0b0932b640 1 --2- 172.21.15.79:0/343990289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c5c05d210 0x557c5c05d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.610+0000 7f0b09b2c640 1 --2- 172.21.15.79:0/343990289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c5c05d210 0x557c5c05d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.610+0000 7f0b09b2c640 1 -- 172.21.15.79:0/343990289 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c5bf65e40 con 0x557c5c05c8d0 2024-08-20T01:44:12.621 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.610+0000 7f0b09b2c640 1 --2- 172.21.15.79:0/343990289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c5c05c8d0 0x557c5c05ccd0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f0afc009fc0 tx=0x7f0afc010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=821cf11a6bc198d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:12.621 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.610+0000 7f0aef7fe640 1 -- 172.21.15.79:0/343990289 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0afc016070 con 0x557c5c05c8d0 2024-08-20T01:44:12.621 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.610+0000 7f0aef7fe640 1 -- 172.21.15.79:0/343990289 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0afc004d20 con 0x557c5c05c8d0 2024-08-20T01:44:12.621 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.610+0000 7f0aef7fe640 1 -- 172.21.15.79:0/343990289 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0afc005280 con 0x557c5c05c8d0 2024-08-20T01:44:12.621 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.610+0000 7f0afa7fc640 1 --2- 172.21.15.79:0/262819516 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0af00b3bd0 0x7f0af00b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:12.621 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.610+0000 7f0b0932b640 1 --2- 172.21.15.79:0/262819516 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0af00b3bd0 0x7f0af00b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:12.621 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.610+0000 7f0afa7fc640 1 -- 172.21.15.79:0/262819516 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f0b00104530 con 0x7f0b04101560 2024-08-20T01:44:12.621 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.611+0000 7f0b0e456740 1 -- 172.21.15.79:0/343990289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c5c05c8d0 msgr2=0x557c5c05ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:12.621 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.611+0000 7f0b0e456740 1 --2- 172.21.15.79:0/343990289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c5c05c8d0 0x557c5c05ccd0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f0afc009fc0 tx=0x7f0afc010800 comp rx=0 tx=0).stop 2024-08-20T01:44:12.621 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.611+0000 7f0b0932b640 1 --2- 172.21.15.79:0/262819516 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0af00b3bd0 0x7f0af00b6090 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f0b00004650 tx=0x7f0b000ee040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:12.621 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.611+0000 7f0b0e456740 1 -- 172.21.15.79:0/343990289 shutdown_connections 2024-08-20T01:44:12.621 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.611+0000 7f0b0e456740 1 --2- 172.21.15.79:0/343990289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c5c05dbd0 0x557c5c05e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:12.622 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.611+0000 7f0b0e456740 1 --2- 172.21.15.79:0/343990289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c5c05d210 0x557c5c05d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:12.622 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.611+0000 7f0b0e456740 1 --2- 172.21.15.79:0/343990289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c5c05c8d0 0x557c5c05ccd0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:12.622 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.611+0000 7f0b0e456740 1 -- 172.21.15.79:0/343990289 >> 172.21.15.79:0/343990289 conn(0x557c5c057a20 msgr2=0x557c5c0587b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:12.622 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.611+0000 7f0b0e456740 1 -- 172.21.15.79:0/343990289 shutdown_connections 2024-08-20T01:44:12.622 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.611+0000 7f0b0e456740 1 -- 172.21.15.79:0/343990289 wait complete. 2024-08-20T01:44:12.622 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.611+0000 7f0b0e456740 1 -- start start 2024-08-20T01:44:12.622 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.611+0000 7f0b0e456740 1 Processor -- start 2024-08-20T01:44:12.622 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.612+0000 7f0b0e456740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c5c05c8d0 0x557c5c06a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:12.622 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.612+0000 7f0b0e456740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c5c05d210 0x557c5c06ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:12.622 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.612+0000 7f0b0e456740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c5c05dbd0 0x557c5c06b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:12.622 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.612+0000 7f0b0e456740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557c5bef7ab0 con 0x557c5c05dbd0 2024-08-20T01:44:12.622 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.612+0000 7f0b0e456740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557c5bf45780 con 0x557c5c05c8d0 2024-08-20T01:44:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.612+0000 7f0b0e456740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557c5c069070 con 0x557c5c05d210 2024-08-20T01:44:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.612+0000 7f0b09b2c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c5c05dbd0 0x557c5c06b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.612+0000 7f0b0e456740 10 client.0 _ll_register_callbacks cb 0x557c5bccda00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:44:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.612+0000 7f0b09b2c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c5c05dbd0 0x557c5c06b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60810/0 (socket says 172.21.15.79:60810) 2024-08-20T01:44:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.612+0000 7f0b09b2c640 1 -- 172.21.15.79:0/2902022856 learned_addr learned my addr 172.21.15.79:0/2902022856 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.612+0000 7f0b09b2c640 1 --2- 172.21.15.79:0/2902022856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c5c05c8d0 0x557c5c06a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.612+0000 7f0b08b2a640 1 --2- 172.21.15.79:0/2902022856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c5c05d210 0x557c5c06ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.612+0000 7f0b09b2c640 1 -- 172.21.15.79:0/2902022856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c5c05d210 msgr2=0x557c5c06ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.612+0000 7f0b09b2c640 1 --2- 172.21.15.79:0/2902022856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c5c05d210 0x557c5c06ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.612+0000 7f0b09b2c640 1 -- 172.21.15.79:0/2902022856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c5c05c8d0 msgr2=0x557c5c06a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.612+0000 7f0b09b2c640 1 --2- 172.21.15.79:0/2902022856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c5c05c8d0 0x557c5c06a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:12.624 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.612+0000 7f0b09b2c640 1 -- 172.21.15.79:0/2902022856 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c5bd21790 con 0x557c5c05dbd0 2024-08-20T01:44:12.624 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.612+0000 7f0b08b2a640 1 --2- 172.21.15.79:0/2902022856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c5c05d210 0x557c5c06ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:44:12.624 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.612+0000 7f0b09b2c640 1 --2- 172.21.15.79:0/2902022856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c5c05dbd0 0x557c5c06b7e0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f0afc0098b0 tx=0x7f0afc009ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e725a18b129eba5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:12.624 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.612+0000 7f0aecff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:44:12.624 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.613+0000 7f0aecff9640 1 -- 172.21.15.79:0/2902022856 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0afc01f070 con 0x557c5c05dbd0 2024-08-20T01:44:12.624 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.613+0000 7f0aecff9640 1 -- 172.21.15.79:0/2902022856 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f0afc012510 con 0x557c5c05dbd0 2024-08-20T01:44:12.624 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.613+0000 7f0b0e456740 1 -- 172.21.15.79:0/2902022856 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557c5bf6de00 con 0x557c5c05dbd0 2024-08-20T01:44:12.624 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.613+0000 7f0aecff9640 1 -- 172.21.15.79:0/2902022856 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f0afc016040 con 0x557c5c05dbd0 2024-08-20T01:44:12.624 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.613+0000 7f0b0e456740 10 client.17577 fetch_fsmap learned FSMap version 41 2024-08-20T01:44:12.624 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.613+0000 7f0b0e456740 1 -- 172.21.15.79:0/2902022856 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x557c5bd9a620 con 0x557c5c05dbd0 2024-08-20T01:44:12.624 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.613+0000 7f0aecff9640 1 -- 172.21.15.79:0/2902022856 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x557c5bf6de00 con 0x557c5c05dbd0 2024-08-20T01:44:12.624 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.613+0000 7f0aecff9640 1 -- 172.21.15.79:0/2902022856 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 41) ==== 8386+0+0 (secure 0 0 0) 0x7f0afc00f040 con 0x557c5c05dbd0 2024-08-20T01:44:12.625 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.613+0000 7f0b0e456740 10 client.17577 fetch_fsmap finished waiting for FSMap version 41 2024-08-20T01:44:12.625 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.613+0000 7f0b0e456740 10 client.17577 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:44:12.625 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.613+0000 7f0b0e456740 20 client.17577 populate_metadata read hostname 'smithi079' 2024-08-20T01:44:12.625 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.613+0000 7f0b0e456740 1 --2- 172.21.15.79:0/2902022856 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557c5c075b40 0x557c5c077f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:12.625 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.613+0000 7f0b0e456740 4 client.17577 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:44:12.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.613+0000 7f0b0e456740 1 -- 172.21.15.79:0/2902022856 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c5bfd12b0 con 0x557c5c075b40 2024-08-20T01:44:12.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.614+0000 7f0b08b2a640 1 --2- 172.21.15.79:0/2902022856 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557c5c075b40 0x557c5c077f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:12.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.614+0000 7f0b08b2a640 1 --2- 172.21.15.79:0/2902022856 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557c5c075b40 0x557c5c077f30 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1183ac0f715362b server_cookie=b1eece1fa284774f in_seq=0 out_seq=0 2024-08-20T01:44:12.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.614+0000 7f0aecff9640 10 client.17577 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:44:12.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.615+0000 7f0aecff9640 1 -- 172.21.15.79:0/2902022856 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557c5bfd12b0 con 0x557c5c075b40 2024-08-20T01:44:12.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.615+0000 7f0aecff9640 10 client.17577 handle_command_reply: tid=0 2024-08-20T01:44:12.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.615+0000 7f0b0e456740 1 client.17577 shutdown 2024-08-20T01:44:12.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.615+0000 7f0b0e456740 1 -- 172.21.15.79:0/2902022856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c5c05dbd0 msgr2=0x557c5c06b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:12.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.615+0000 7f0b0e456740 1 --2- 172.21.15.79:0/2902022856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c5c05dbd0 0x557c5c06b7e0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f0afc0098b0 tx=0x7f0afc009ab0 comp rx=0 tx=0).stop 2024-08-20T01:44:12.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.615+0000 7f0b0e456740 1 -- 172.21.15.79:0/2902022856 shutdown_connections 2024-08-20T01:44:12.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.615+0000 7f0b0e456740 1 --2- 172.21.15.79:0/2902022856 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557c5c075b40 0x557c5c077f30 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:12.626 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.615+0000 7f0b0e456740 1 --2- 172.21.15.79:0/2902022856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c5c05dbd0 0x557c5c06b7e0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:12.627 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.615+0000 7f0b0e456740 1 --2- 172.21.15.79:0/2902022856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c5c05d210 0x557c5c06ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:12.627 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.615+0000 7f0b0e456740 1 --2- 172.21.15.79:0/2902022856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c5c05c8d0 0x557c5c06a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:12.627 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.615+0000 7f0b0e456740 1 -- 172.21.15.79:0/2902022856 >> 172.21.15.79:0/2902022856 conn(0x557c5c057a20 msgr2=0x557c5c056ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:12.627 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.615+0000 7f0aecff9640 0 client.17577 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:44:12.627 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.615+0000 7f0b0e456740 1 -- 172.21.15.79:0/2902022856 shutdown_connections 2024-08-20T01:44:12.627 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.615+0000 7f0b0e456740 1 -- 172.21.15.79:0/2902022856 wait complete. 2024-08-20T01:44:12.627 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.615+0000 7f0b0e456740 20 client.17577 trim_cache size 0 max 16384 2024-08-20T01:44:12.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.633+0000 7f0b0e456740 1 Processor -- start 2024-08-20T01:44:12.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.633+0000 7f0b0e456740 1 -- start start 2024-08-20T01:44:12.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.633+0000 7f0b0e456740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c5c05c8d0 0x557c5c064e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:12.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.633+0000 7f0b0e456740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c5c05d210 0x557c5c0653a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:12.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.633+0000 7f0b0e456740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c5c05dbd0 0x557c5c0562c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:12.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.633+0000 7f0b0e456740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0b041a7900 con 0x557c5c05c8d0 2024-08-20T01:44:12.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.633+0000 7f0b0e456740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0b041a9560 con 0x557c5c05d210 2024-08-20T01:44:12.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.633+0000 7f0b0e456740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0b041a7fd0 con 0x557c5c05dbd0 2024-08-20T01:44:12.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.633+0000 7f0b09b2c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c5c05c8d0 0x557c5c064e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:12.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.633+0000 7f0b09b2c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c5c05c8d0 0x557c5c064e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60822/0 (socket says 172.21.15.79:60822) 2024-08-20T01:44:12.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.633+0000 7f0b09b2c640 1 -- 172.21.15.79:0/3894616153 learned_addr learned my addr 172.21.15.79:0/3894616153 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:12.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.634+0000 7f0b08b2a640 1 --2- 172.21.15.79:0/3894616153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c5c05d210 0x557c5c0653a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:12.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.634+0000 7f0b09b2c640 1 --2- 172.21.15.79:0/3894616153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c5c05dbd0 0x557c5c0562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:12.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.634+0000 7f0b09b2c640 1 -- 172.21.15.79:0/3894616153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c5c05dbd0 msgr2=0x557c5c0562c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:12.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.634+0000 7f0b09b2c640 1 --2- 172.21.15.79:0/3894616153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c5c05dbd0 0x557c5c0562c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:12.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.634+0000 7f0b09b2c640 1 -- 172.21.15.79:0/3894616153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c5c05d210 msgr2=0x557c5c0653a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:12.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.634+0000 7f0b09b2c640 1 --2- 172.21.15.79:0/3894616153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c5c05d210 0x557c5c0653a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:12.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.634+0000 7f0b09b2c640 1 -- 172.21.15.79:0/3894616153 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c5c06a070 con 0x557c5c05c8d0 2024-08-20T01:44:12.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.634+0000 7f0b08b2a640 1 --2- 172.21.15.79:0/3894616153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c5c05d210 0x557c5c0653a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:44:12.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.634+0000 7f0b09b2c640 1 --2- 172.21.15.79:0/3894616153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c5c05c8d0 0x557c5c064e60 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f0afc000f80 tx=0x7f0afc009a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ddd2cd98fe347c6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:12.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.634+0000 7f0aeeffd640 1 -- 172.21.15.79:0/3894616153 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0afc01f070 con 0x557c5c05c8d0 2024-08-20T01:44:12.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.634+0000 7f0aeeffd640 1 -- 172.21.15.79:0/3894616153 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0afc020040 con 0x557c5c05c8d0 2024-08-20T01:44:12.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.634+0000 7f0aeeffd640 1 -- 172.21.15.79:0/3894616153 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0afc012c00 con 0x557c5c05c8d0 2024-08-20T01:44:12.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.635+0000 7f0b0e456740 1 -- 172.21.15.79:0/3894616153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c5c05c8d0 msgr2=0x557c5c064e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:12.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.635+0000 7f0b0e456740 1 --2- 172.21.15.79:0/3894616153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c5c05c8d0 0x557c5c064e60 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f0afc000f80 tx=0x7f0afc009a00 comp rx=0 tx=0).stop 2024-08-20T01:44:12.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.635+0000 7f0b0e456740 1 -- 172.21.15.79:0/3894616153 shutdown_connections 2024-08-20T01:44:12.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.635+0000 7f0b0e456740 1 --2- 172.21.15.79:0/3894616153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c5c05dbd0 0x557c5c0562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:12.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.635+0000 7f0b0e456740 1 --2- 172.21.15.79:0/3894616153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c5c05d210 0x557c5c0653a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:12.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.635+0000 7f0b0e456740 1 --2- 172.21.15.79:0/3894616153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c5c05c8d0 0x557c5c064e60 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:12.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.635+0000 7f0b0e456740 1 -- 172.21.15.79:0/3894616153 >> 172.21.15.79:0/3894616153 conn(0x557c5c057a20 msgr2=0x557c5c0684d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:12.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.635+0000 7f0b0e456740 1 -- 172.21.15.79:0/3894616153 shutdown_connections 2024-08-20T01:44:12.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.635+0000 7f0b0e456740 1 -- 172.21.15.79:0/3894616153 wait complete. 2024-08-20T01:44:12.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.635+0000 7f0b0e456740 1 -- start start 2024-08-20T01:44:12.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.635+0000 7f0b0e456740 1 Processor -- start 2024-08-20T01:44:12.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.636+0000 7f0b0e456740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c5c05c8d0 0x557c5c06d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:12.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.636+0000 7f0b0e456740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c5c05d210 0x557c5c06d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:12.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.636+0000 7f0b0e456740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c5c05dbd0 0x557c5c06e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:12.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.636+0000 7f0b0e456740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0b041a8dd0 con 0x557c5c05dbd0 2024-08-20T01:44:12.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.636+0000 7f0b0e456740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0b041a86a0 con 0x557c5c05d210 2024-08-20T01:44:12.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.636+0000 7f0b0e456740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0b041a58e0 con 0x557c5c05c8d0 2024-08-20T01:44:12.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.636+0000 7f0b0e456740 10 client.0 _ll_register_callbacks cb 0x7f0af400b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:44:12.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.636+0000 7f0b09b2c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c5c05dbd0 0x557c5c06e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:12.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.636+0000 7f0b09b2c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c5c05dbd0 0x557c5c06e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60830/0 (socket says 172.21.15.79:60830) 2024-08-20T01:44:12.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.636+0000 7f0b09b2c640 1 -- 172.21.15.79:0/3965822182 learned_addr learned my addr 172.21.15.79:0/3965822182 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:12.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.636+0000 7f0b08b2a640 1 --2- 172.21.15.79:0/3965822182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c5c05d210 0x557c5c06d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:12.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.636+0000 7f0b09b2c640 1 --2- 172.21.15.79:0/3965822182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c5c05c8d0 0x557c5c06d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:12.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.636+0000 7f0b09b2c640 1 -- 172.21.15.79:0/3965822182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c5c05c8d0 msgr2=0x557c5c06d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:12.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.636+0000 7f0b09b2c640 1 --2- 172.21.15.79:0/3965822182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c5c05c8d0 0x557c5c06d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:12.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.636+0000 7f0b09b2c640 1 -- 172.21.15.79:0/3965822182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c5c05d210 msgr2=0x557c5c06d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:12.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.636+0000 7f0b09b2c640 1 --2- 172.21.15.79:0/3965822182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c5c05d210 0x557c5c06d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:12.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.636+0000 7f0b09b2c640 1 -- 172.21.15.79:0/3965822182 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c5bf45700 con 0x557c5c05dbd0 2024-08-20T01:44:12.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.636+0000 7f0b09b2c640 1 --2- 172.21.15.79:0/3965822182 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c5c05dbd0 0x557c5c06e2b0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f0afc009af0 tx=0x7f0afc01c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbab3afbdeb1d521 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:12.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.636+0000 7f0aecff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:44:12.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.636+0000 7f0aecff9640 1 -- 172.21.15.79:0/3965822182 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0afc01f050 con 0x557c5c05dbd0 2024-08-20T01:44:12.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.636+0000 7f0aecff9640 1 -- 172.21.15.79:0/3965822182 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f0afc037670 con 0x557c5c05dbd0 2024-08-20T01:44:12.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.636+0000 7f0b0e456740 1 -- 172.21.15.79:0/3965822182 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0afc020040 con 0x557c5c05dbd0 2024-08-20T01:44:12.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.637+0000 7f0aecff9640 1 -- 172.21.15.79:0/3965822182 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f0afc037870 con 0x557c5c05dbd0 2024-08-20T01:44:12.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.637+0000 7f0b0e456740 10 client.17583 fetch_fsmap learned FSMap version 41 2024-08-20T01:44:12.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.637+0000 7f0b0e456740 1 -- 172.21.15.79:0/3965822182 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x557c5c071ca0 con 0x557c5c05dbd0 2024-08-20T01:44:12.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.637+0000 7f0aecff9640 1 -- 172.21.15.79:0/3965822182 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0afc020040 con 0x557c5c05dbd0 2024-08-20T01:44:12.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.637+0000 7f0aecff9640 1 -- 172.21.15.79:0/3965822182 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 41) ==== 8386+0+0 (secure 0 0 0) 0x7f0afc046790 con 0x557c5c05dbd0 2024-08-20T01:44:12.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.637+0000 7f0b0e456740 10 client.17583 fetch_fsmap finished waiting for FSMap version 41 2024-08-20T01:44:12.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.637+0000 7f0b0e456740 10 client.17583 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:44:12.646 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.637+0000 7f0b0e456740 20 client.17583 populate_metadata read hostname 'smithi079' 2024-08-20T01:44:12.646 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.637+0000 7f0b0e456740 1 --2- 172.21.15.79:0/3965822182 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557c5c0e07c0 0x557c5c0e2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:12.646 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.637+0000 7f0b0e456740 4 client.17583 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:44:12.646 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.637+0000 7f0b0e456740 1 -- 172.21.15.79:0/3965822182 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557c5bfccd50 con 0x557c5c0e07c0 2024-08-20T01:44:12.646 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.637+0000 7f0b08b2a640 1 --2- 172.21.15.79:0/3965822182 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557c5c0e07c0 0x557c5c0e2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:12.646 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.638+0000 7f0b08b2a640 1 --2- 172.21.15.79:0/3965822182 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557c5c0e07c0 0x557c5c0e2bb0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6e7e1640761224e server_cookie=c2d7de644936cd41 in_seq=0 out_seq=0 2024-08-20T01:44:12.646 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.638+0000 7f0aecff9640 10 client.17583 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:44:12.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.642+0000 7f0aecff9640 1 -- 172.21.15.79:0/3965822182 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557c5bfccd50 con 0x557c5c0e07c0 2024-08-20T01:44:12.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.642+0000 7f0aecff9640 10 client.17583 handle_command_reply: tid=0 2024-08-20T01:44:12.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.642+0000 7f0b0e456740 1 client.17583 shutdown 2024-08-20T01:44:12.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.642+0000 7f0b0e456740 1 -- 172.21.15.79:0/3965822182 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c5c05dbd0 msgr2=0x557c5c06e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:12.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.642+0000 7f0b0e456740 1 --2- 172.21.15.79:0/3965822182 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c5c05dbd0 0x557c5c06e2b0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f0afc009af0 tx=0x7f0afc01c040 comp rx=0 tx=0).stop 2024-08-20T01:44:12.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.643+0000 7f0b0e456740 1 -- 172.21.15.79:0/3965822182 shutdown_connections 2024-08-20T01:44:12.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.643+0000 7f0b0e456740 1 --2- 172.21.15.79:0/3965822182 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557c5c0e07c0 0x557c5c0e2bb0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:12.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.643+0000 7f0b0e456740 1 --2- 172.21.15.79:0/3965822182 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c5c05dbd0 0x557c5c06e2b0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:12.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.643+0000 7f0aecff9640 0 client.17583 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:44:12.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.643+0000 7f0b0e456740 1 --2- 172.21.15.79:0/3965822182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c5c05d210 0x557c5c06d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:12.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.643+0000 7f0b0e456740 1 --2- 172.21.15.79:0/3965822182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c5c05c8d0 0x557c5c06d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:12.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.643+0000 7f0b0e456740 1 -- 172.21.15.79:0/3965822182 >> 172.21.15.79:0/3965822182 conn(0x557c5c057a20 msgr2=0x557c5c068340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:12.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.643+0000 7f0b0e456740 1 -- 172.21.15.79:0/3965822182 shutdown_connections 2024-08-20T01:44:12.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.643+0000 7f0b0e456740 1 -- 172.21.15.79:0/3965822182 wait complete. 2024-08-20T01:44:12.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.643+0000 7f0b0e456740 20 client.17583 trim_cache size 0 max 16384 2024-08-20T01:44:12.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:44:12.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:44:12.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:44:12.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:44:12.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.643+0000 7f0b0b58f640 1 -- 172.21.15.79:0/262819516 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0af00b3bd0 msgr2=0x7f0af00b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:12.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.643+0000 7f0b0b58f640 1 --2- 172.21.15.79:0/262819516 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0af00b3bd0 0x7f0af00b6090 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f0b00004650 tx=0x7f0b000ee040 comp rx=0 tx=0).stop 2024-08-20T01:44:12.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.643+0000 7f0b0b58f640 1 -- 172.21.15.79:0/262819516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b04101560 msgr2=0x7f0b041978d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:12.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.643+0000 7f0b0b58f640 1 --2- 172.21.15.79:0/262819516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b04101560 0x7f0b041978d0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f0b00005ab0 tx=0x7f0b000042f0 comp rx=0 tx=0).stop 2024-08-20T01:44:12.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.643+0000 7f0b0b58f640 1 -- 172.21.15.79:0/262819516 shutdown_connections 2024-08-20T01:44:12.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.643+0000 7f0b0b58f640 1 --2- 172.21.15.79:0/262819516 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0af00b3bd0 0x7f0af00b6090 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:12.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.643+0000 7f0b0b58f640 1 --2- 172.21.15.79:0/262819516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b04103070 0x7f0b04198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:12.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.643+0000 7f0b0b58f640 1 --2- 172.21.15.79:0/262819516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b041026b0 0x7f0b04197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:12.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.643+0000 7f0b0b58f640 1 --2- 172.21.15.79:0/262819516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b04101560 0x7f0b041978d0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:12.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.643+0000 7f0b0b58f640 1 -- 172.21.15.79:0/262819516 >> 172.21.15.79:0/262819516 conn(0x7f0b040fce40 msgr2=0x7f0b04105b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:12.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.643+0000 7f0b0b58f640 1 -- 172.21.15.79:0/262819516 shutdown_connections 2024-08-20T01:44:12.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:12.643+0000 7f0b0b58f640 1 -- 172.21.15.79:0/262819516 wait complete. 2024-08-20T01:44:12.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:12 smithi081 ceph-mon[22209]: pgmap v553: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 28 MiB/s wr, 25 op/s 2024-08-20T01:44:12.790 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:12 smithi175 ceph-mon[22392]: pgmap v553: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 28 MiB/s wr, 25 op/s 2024-08-20T01:44:12.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:12 smithi079 ceph-mon[18656]: pgmap v553: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 28 MiB/s wr, 25 op/s 2024-08-20T01:44:14.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:14 smithi081 ceph-mon[22209]: pgmap v554: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 28 MiB/s wr, 24 op/s 2024-08-20T01:44:14.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:14 smithi175 ceph-mon[22392]: pgmap v554: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 28 MiB/s wr, 24 op/s 2024-08-20T01:44:14.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:14 smithi079 ceph-mon[18656]: pgmap v554: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 28 MiB/s wr, 24 op/s 2024-08-20T01:44:16.758 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:16 smithi079 ceph-mon[18656]: pgmap v555: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 30 MiB/s wr, 27 op/s 2024-08-20T01:44:16.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:16 smithi081 ceph-mon[22209]: pgmap v555: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 30 MiB/s wr, 27 op/s 2024-08-20T01:44:16.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:16 smithi175 ceph-mon[22392]: pgmap v555: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 30 MiB/s wr, 27 op/s 2024-08-20T01:44:18.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:18 smithi079 ceph-mon[18656]: pgmap v556: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 30 MiB/s wr, 25 op/s 2024-08-20T01:44:18.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:18 smithi081 ceph-mon[22209]: pgmap v556: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 30 MiB/s wr, 25 op/s 2024-08-20T01:44:18.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:18 smithi175 ceph-mon[22392]: pgmap v556: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 30 MiB/s wr, 25 op/s 2024-08-20T01:44:19.351 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T01:44:19.351 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T01:44:20.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:20 smithi081 ceph-mon[22209]: pgmap v557: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 29 MiB/s wr, 25 op/s 2024-08-20T01:44:20.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:20 smithi175 ceph-mon[22392]: pgmap v557: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 29 MiB/s wr, 25 op/s 2024-08-20T01:44:20.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:20 smithi079 ceph-mon[18656]: pgmap v557: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 29 MiB/s wr, 25 op/s 2024-08-20T01:44:21.558 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:44:22.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.281+0000 7f3d802e5640 1 -- 172.21.15.79:0/1737997764 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d78102af0 msgr2=0x7f3d78102ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:22.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.281+0000 7f3d802e5640 1 --2- 172.21.15.79:0/1737997764 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d78102af0 0x7f3d78102ed0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f3d74009900 tx=0x7f3d7402a410 comp rx=0 tx=0).stop 2024-08-20T01:44:22.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.281+0000 7f3d802e5640 1 -- 172.21.15.79:0/1737997764 shutdown_connections 2024-08-20T01:44:22.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.281+0000 7f3d802e5640 1 --2- 172.21.15.79:0/1737997764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d78108e80 0x7f3d7810f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:22.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.281+0000 7f3d802e5640 1 --2- 172.21.15.79:0/1737997764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d78108500 0x7f3d78108940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:22.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.281+0000 7f3d802e5640 1 --2- 172.21.15.79:0/1737997764 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d78102af0 0x7f3d78102ed0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:22.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.281+0000 7f3d802e5640 1 -- 172.21.15.79:0/1737997764 >> 172.21.15.79:0/1737997764 conn(0x7f3d780fe540 msgr2=0x7f3d78100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:22.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.281+0000 7f3d802e5640 1 -- 172.21.15.79:0/1737997764 shutdown_connections 2024-08-20T01:44:22.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.281+0000 7f3d802e5640 1 -- 172.21.15.79:0/1737997764 wait complete. 2024-08-20T01:44:22.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.282+0000 7f3d802e5640 1 Processor -- start 2024-08-20T01:44:22.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.282+0000 7f3d802e5640 1 -- start start 2024-08-20T01:44:22.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.282+0000 7f3d802e5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d78102af0 0x7f3d7810e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:22.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.282+0000 7f3d802e5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d78108500 0x7f3d7810ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:22.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.283+0000 7f3d802e5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d78108e80 0x7f3d781a1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:22.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.283+0000 7f3d802e5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3d781129b0 con 0x7f3d78108500 2024-08-20T01:44:22.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.283+0000 7f3d802e5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3d78112830 con 0x7f3d78102af0 2024-08-20T01:44:22.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.283+0000 7f3d802e5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3d78112b30 con 0x7f3d78108e80 2024-08-20T01:44:22.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.283+0000 7f3d7d880640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d78108500 0x7f3d7810ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:22.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.283+0000 7f3d7d880640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d78108500 0x7f3d7810ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38838/0 (socket says 172.21.15.79:38838) 2024-08-20T01:44:22.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.283+0000 7f3d7d880640 1 -- 172.21.15.79:0/339740133 learned_addr learned my addr 172.21.15.79:0/339740133 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:22.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.283+0000 7f3d7e081640 1 --2- 172.21.15.79:0/339740133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d78102af0 0x7f3d7810e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:22.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.283+0000 7f3d7d880640 1 -- 172.21.15.79:0/339740133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d78108e80 msgr2=0x7f3d781a1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:22.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.283+0000 7f3d7d880640 1 --2- 172.21.15.79:0/339740133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d78108e80 0x7f3d781a1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:22.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.283+0000 7f3d7d880640 1 -- 172.21.15.79:0/339740133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d78102af0 msgr2=0x7f3d7810e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:22.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.283+0000 7f3d7d880640 1 --2- 172.21.15.79:0/339740133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d78102af0 0x7f3d7810e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:22.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.283+0000 7f3d7d880640 1 -- 172.21.15.79:0/339740133 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d781a22f0 con 0x7f3d78108500 2024-08-20T01:44:22.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.283+0000 7f3d7e081640 1 --2- 172.21.15.79:0/339740133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d78102af0 0x7f3d7810e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:44:22.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.283+0000 7f3d7d880640 1 --2- 172.21.15.79:0/339740133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d78108500 0x7f3d7810ef50 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f3d6800c920 tx=0x7f3d6800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:22.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.283+0000 7f3d6f7fe640 1 -- 172.21.15.79:0/339740133 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d68007c70 con 0x7f3d78108500 2024-08-20T01:44:22.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.283+0000 7f3d6f7fe640 1 -- 172.21.15.79:0/339740133 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3d68007e10 con 0x7f3d78108500 2024-08-20T01:44:22.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.283+0000 7f3d802e5640 1 -- 172.21.15.79:0/339740133 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d781a25e0 con 0x7f3d78108500 2024-08-20T01:44:22.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.283+0000 7f3d6f7fe640 1 -- 172.21.15.79:0/339740133 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d68018710 con 0x7f3d78108500 2024-08-20T01:44:22.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.284+0000 7f3d802e5640 1 -- 172.21.15.79:0/339740133 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d781ac090 con 0x7f3d78108500 2024-08-20T01:44:22.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.287+0000 7f3d826de740 1 Processor -- start 2024-08-20T01:44:22.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.287+0000 7f3d826de740 1 -- start start 2024-08-20T01:44:22.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.287+0000 7f3d826de740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d57c5d63b0 0x55d57c5d6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:22.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.287+0000 7f3d826de740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c5d6cd0 0x55d57c5e2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:22.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.287+0000 7f3d826de740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d57c5e2c60 0x55d57c5e5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:22.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.287+0000 7f3d826de740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d57c54c940 con 0x55d57c5e2c60 2024-08-20T01:44:22.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.287+0000 7f3d826de740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d57c53be40 con 0x55d57c5d63b0 2024-08-20T01:44:22.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.287+0000 7f3d826de740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d57c53fe80 con 0x55d57c5d6cd0 2024-08-20T01:44:22.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.287+0000 7f3d6f7fe640 1 -- 172.21.15.79:0/339740133 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3d6800f450 con 0x7f3d78108500 2024-08-20T01:44:22.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.287+0000 7f3d7d880640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d57c5e2c60 0x55d57c5e5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:22.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.287+0000 7f3d7e081640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c5d6cd0 0x55d57c5e2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:22.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.288+0000 7f3d7d880640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d57c5e2c60 0x55d57c5e5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38840/0 (socket says 172.21.15.79:38840) 2024-08-20T01:44:22.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.288+0000 7f3d7d880640 1 -- 172.21.15.79:0/481920998 learned_addr learned my addr 172.21.15.79:0/481920998 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:22.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.288+0000 7f3d7e882640 1 --2- 172.21.15.79:0/481920998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d57c5d63b0 0x55d57c5d6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:22.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.288+0000 7f3d7e081640 1 -- 172.21.15.79:0/481920998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d57c5d63b0 msgr2=0x55d57c5d6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:22.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.288+0000 7f3d7e081640 1 --2- 172.21.15.79:0/481920998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d57c5d63b0 0x55d57c5d6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:22.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.288+0000 7f3d7e081640 1 -- 172.21.15.79:0/481920998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d57c5e2c60 msgr2=0x55d57c5e5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:22.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.288+0000 7f3d7e081640 1 --2- 172.21.15.79:0/481920998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d57c5e2c60 0x55d57c5e5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:22.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.288+0000 7f3d7e081640 1 -- 172.21.15.79:0/481920998 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d57c4d8520 con 0x55d57c5d6cd0 2024-08-20T01:44:22.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.288+0000 7f3d7d880640 1 --2- 172.21.15.79:0/481920998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d57c5e2c60 0x55d57c5e5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:44:22.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.288+0000 7f3d7e081640 1 --2- 172.21.15.79:0/481920998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c5d6cd0 0x55d57c5e2720 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3d740057c0 tx=0x7f3d74032dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aae674d9546bcfdd server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:22.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.288+0000 7f3d6f7fe640 1 --2- 172.21.15.79:0/339740133 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3d640b3c50 0x7f3d640b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:22.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.288+0000 7f3d6cde6640 1 -- 172.21.15.79:0/481920998 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d74035030 con 0x55d57c5d6cd0 2024-08-20T01:44:22.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.289+0000 7f3d6cde6640 1 -- 172.21.15.79:0/481920998 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3d740044c0 con 0x55d57c5d6cd0 2024-08-20T01:44:22.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.289+0000 7f3d6cde6640 1 -- 172.21.15.79:0/481920998 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d74005570 con 0x55d57c5d6cd0 2024-08-20T01:44:22.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.289+0000 7f3d7e882640 1 --2- 172.21.15.79:0/339740133 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3d640b3c50 0x7f3d640b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:22.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.289+0000 7f3d6f7fe640 1 -- 172.21.15.79:0/339740133 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f3d680e3de0 con 0x7f3d78108500 2024-08-20T01:44:22.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.289+0000 7f3d826de740 1 -- 172.21.15.79:0/481920998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c5d6cd0 msgr2=0x55d57c5e2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:22.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.289+0000 7f3d7e882640 1 --2- 172.21.15.79:0/339740133 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3d640b3c50 0x7f3d640b6110 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3d70009270 tx=0x7f3d700095e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:22.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.289+0000 7f3d826de740 1 --2- 172.21.15.79:0/481920998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c5d6cd0 0x55d57c5e2720 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3d740057c0 tx=0x7f3d74032dd0 comp rx=0 tx=0).stop 2024-08-20T01:44:22.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.289+0000 7f3d826de740 1 -- 172.21.15.79:0/481920998 shutdown_connections 2024-08-20T01:44:22.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.289+0000 7f3d826de740 1 --2- 172.21.15.79:0/481920998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d57c5e2c60 0x55d57c5e5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:22.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.289+0000 7f3d826de740 1 --2- 172.21.15.79:0/481920998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c5d6cd0 0x55d57c5e2720 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:22.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.289+0000 7f3d826de740 1 --2- 172.21.15.79:0/481920998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d57c5d63b0 0x55d57c5d6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:22.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.289+0000 7f3d826de740 1 -- 172.21.15.79:0/481920998 >> 172.21.15.79:0/481920998 conn(0x55d57c5d41e0 msgr2=0x55d57c5d5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:22.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.290+0000 7f3d826de740 1 -- 172.21.15.79:0/481920998 shutdown_connections 2024-08-20T01:44:22.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.290+0000 7f3d826de740 1 -- 172.21.15.79:0/481920998 wait complete. 2024-08-20T01:44:22.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.290+0000 7f3d826de740 1 -- start start 2024-08-20T01:44:22.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.290+0000 7f3d826de740 1 Processor -- start 2024-08-20T01:44:22.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.290+0000 7f3d826de740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d57c5d63b0 0x55d57c5dfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:22.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.290+0000 7f3d826de740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d57c5d6cd0 0x55d57c5e00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:22.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.290+0000 7f3d826de740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c5e2c60 0x55d57c5e0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:22.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.290+0000 7f3d826de740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d57c39e890 con 0x55d57c5d6cd0 2024-08-20T01:44:22.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.290+0000 7f3d826de740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d57c4c2700 con 0x55d57c5d63b0 2024-08-20T01:44:22.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.290+0000 7f3d826de740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d57c5e5950 con 0x55d57c5e2c60 2024-08-20T01:44:22.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.290+0000 7f3d826de740 10 client.0 _ll_register_callbacks cb 0x55d57c5376f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:44:22.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.290+0000 7f3d7d880640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d57c5d6cd0 0x55d57c5e00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:22.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.290+0000 7f3d7e882640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c5e2c60 0x55d57c5e0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:22.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.290+0000 7f3d7d880640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d57c5d6cd0 0x55d57c5e00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38844/0 (socket says 172.21.15.79:38844) 2024-08-20T01:44:22.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.290+0000 7f3d7d880640 1 -- 172.21.15.79:0/356254798 learned_addr learned my addr 172.21.15.79:0/356254798 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:22.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.290+0000 7f3d7e081640 1 --2- 172.21.15.79:0/356254798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d57c5d63b0 0x55d57c5dfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:22.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.291+0000 7f3d7e882640 1 -- 172.21.15.79:0/356254798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d57c5d63b0 msgr2=0x55d57c5dfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:22.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.291+0000 7f3d7e882640 1 --2- 172.21.15.79:0/356254798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d57c5d63b0 0x55d57c5dfbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:22.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.291+0000 7f3d7e882640 1 -- 172.21.15.79:0/356254798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d57c5d6cd0 msgr2=0x55d57c5e00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:22.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.291+0000 7f3d7e882640 1 --2- 172.21.15.79:0/356254798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d57c5d6cd0 0x55d57c5e00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:22.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.291+0000 7f3d7e882640 1 -- 172.21.15.79:0/356254798 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d57c29b930 con 0x55d57c5e2c60 2024-08-20T01:44:22.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.291+0000 7f3d7d880640 1 --2- 172.21.15.79:0/356254798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d57c5d6cd0 0x55d57c5e00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:44:22.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.291+0000 7f3d7e882640 1 --2- 172.21.15.79:0/356254798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c5e2c60 0x55d57c5e0630 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3d70005fd0 tx=0x7f3d70004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e832f0bd3011b32 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:22.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.291+0000 7f3d61ffb640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:44:22.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.291+0000 7f3d61ffb640 1 -- 172.21.15.79:0/356254798 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d70003b70 con 0x55d57c5e2c60 2024-08-20T01:44:22.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.291+0000 7f3d61ffb640 1 -- 172.21.15.79:0/356254798 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f3d70003d10 con 0x55d57c5e2c60 2024-08-20T01:44:22.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.291+0000 7f3d826de740 1 -- 172.21.15.79:0/356254798 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d57c54e890 con 0x55d57c5e2c60 2024-08-20T01:44:22.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.291+0000 7f3d61ffb640 1 -- 172.21.15.79:0/356254798 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f3d7001d790 con 0x55d57c5e2c60 2024-08-20T01:44:22.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.291+0000 7f3d826de740 10 client.26629 fetch_fsmap learned FSMap version 41 2024-08-20T01:44:22.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.291+0000 7f3d826de740 1 -- 172.21.15.79:0/356254798 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55d57c5f1540 con 0x55d57c5e2c60 2024-08-20T01:44:22.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.292+0000 7f3d61ffb640 1 -- 172.21.15.79:0/356254798 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55d57c54e890 con 0x55d57c5e2c60 2024-08-20T01:44:22.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.292+0000 7f3d61ffb640 1 -- 172.21.15.79:0/356254798 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 41) ==== 8386+0+0 (secure 0 0 0) 0x7f3d7000f040 con 0x55d57c5e2c60 2024-08-20T01:44:22.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.292+0000 7f3d826de740 10 client.26629 fetch_fsmap finished waiting for FSMap version 41 2024-08-20T01:44:22.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.292+0000 7f3d826de740 10 client.26629 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:44:22.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.292+0000 7f3d826de740 20 client.26629 populate_metadata read hostname 'smithi079' 2024-08-20T01:44:22.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.292+0000 7f3d826de740 1 --2- 172.21.15.79:0/356254798 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d57c5f2aa0 0x55d57c5f4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:22.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.292+0000 7f3d826de740 4 client.26629 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:44:22.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.292+0000 7f3d826de740 1 -- 172.21.15.79:0/356254798 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d57c54a330 con 0x55d57c5f2aa0 2024-08-20T01:44:22.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.292+0000 7f3d7e081640 1 --2- 172.21.15.79:0/356254798 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d57c5f2aa0 0x55d57c5f4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:22.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.293+0000 7f3d7e081640 1 --2- 172.21.15.79:0/356254798 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d57c5f2aa0 0x55d57c5f4ec0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7547da46ab792e12 server_cookie=e2b2918668195d67 in_seq=0 out_seq=0 2024-08-20T01:44:22.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.293+0000 7f3d61ffb640 10 client.26629 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:44:22.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.293+0000 7f3d61ffb640 1 -- 172.21.15.79:0/356254798 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d57c54a330 con 0x55d57c5f2aa0 2024-08-20T01:44:22.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.293+0000 7f3d61ffb640 10 client.26629 handle_command_reply: tid=0 2024-08-20T01:44:22.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.293+0000 7f3d826de740 1 client.26629 shutdown 2024-08-20T01:44:22.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.294+0000 7f3d826de740 1 -- 172.21.15.79:0/356254798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c5e2c60 msgr2=0x55d57c5e0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:22.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.294+0000 7f3d826de740 1 --2- 172.21.15.79:0/356254798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c5e2c60 0x55d57c5e0630 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3d70005fd0 tx=0x7f3d70004a40 comp rx=0 tx=0).stop 2024-08-20T01:44:22.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.294+0000 7f3d826de740 1 -- 172.21.15.79:0/356254798 shutdown_connections 2024-08-20T01:44:22.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.294+0000 7f3d826de740 1 --2- 172.21.15.79:0/356254798 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d57c5f2aa0 0x55d57c5f4ec0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:22.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.294+0000 7f3d826de740 1 --2- 172.21.15.79:0/356254798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c5e2c60 0x55d57c5e0630 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:22.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.294+0000 7f3d826de740 1 --2- 172.21.15.79:0/356254798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d57c5d6cd0 0x55d57c5e00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:22.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.294+0000 7f3d61ffb640 0 client.26629 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:44:22.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.294+0000 7f3d826de740 1 --2- 172.21.15.79:0/356254798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d57c5d63b0 0x55d57c5dfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:22.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.294+0000 7f3d826de740 1 -- 172.21.15.79:0/356254798 >> 172.21.15.79:0/356254798 conn(0x55d57c5d41e0 msgr2=0x55d57c5d9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:22.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.294+0000 7f3d826de740 1 -- 172.21.15.79:0/356254798 shutdown_connections 2024-08-20T01:44:22.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.294+0000 7f3d826de740 1 -- 172.21.15.79:0/356254798 wait complete. 2024-08-20T01:44:22.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.294+0000 7f3d826de740 20 client.26629 trim_cache size 0 max 16384 2024-08-20T01:44:22.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.314+0000 7f3d826de740 1 Processor -- start 2024-08-20T01:44:22.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.314+0000 7f3d826de740 1 -- start start 2024-08-20T01:44:22.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.314+0000 7f3d826de740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c5d63b0 0x55d57c5da570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:22.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.314+0000 7f3d826de740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d57c5d6cd0 0x55d57c5fa7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:22.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.314+0000 7f3d826de740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d57c5e2c60 0x55d57c5fad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:22.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.314+0000 7f3d826de740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3d781b4460 con 0x55d57c5d6cd0 2024-08-20T01:44:22.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.314+0000 7f3d826de740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3d781b60c0 con 0x55d57c5e2c60 2024-08-20T01:44:22.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.314+0000 7f3d826de740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3d781b4b30 con 0x55d57c5d63b0 2024-08-20T01:44:22.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.314+0000 7f3d7d880640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d57c5d6cd0 0x55d57c5fa7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:22.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.314+0000 7f3d7d880640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d57c5d6cd0 0x55d57c5fa7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38860/0 (socket says 172.21.15.79:38860) 2024-08-20T01:44:22.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.314+0000 7f3d7d880640 1 -- 172.21.15.79:0/3491526201 learned_addr learned my addr 172.21.15.79:0/3491526201 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:22.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.315+0000 7f3d7e081640 1 --2- 172.21.15.79:0/3491526201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c5d63b0 0x55d57c5da570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:22.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.315+0000 7f3d7e882640 1 --2- 172.21.15.79:0/3491526201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d57c5e2c60 0x55d57c5fad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:22.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.315+0000 7f3d7d880640 1 -- 172.21.15.79:0/3491526201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c5d63b0 msgr2=0x55d57c5da570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:22.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.315+0000 7f3d7d880640 1 --2- 172.21.15.79:0/3491526201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c5d63b0 0x55d57c5da570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:22.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.315+0000 7f3d7d880640 1 -- 172.21.15.79:0/3491526201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d57c5e2c60 msgr2=0x55d57c5fad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:22.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.315+0000 7f3d7d880640 1 --2- 172.21.15.79:0/3491526201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d57c5e2c60 0x55d57c5fad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:22.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.315+0000 7f3d7d880640 1 -- 172.21.15.79:0/3491526201 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d57c5e2020 con 0x55d57c5d6cd0 2024-08-20T01:44:22.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.315+0000 7f3d7d880640 1 --2- 172.21.15.79:0/3491526201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d57c5d6cd0 0x55d57c5fa7d0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f3d680e1c60 tx=0x7f3d680e78c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e72d85a59e90119b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:22.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.315+0000 7f3d63fff640 1 -- 172.21.15.79:0/3491526201 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d680aa850 con 0x55d57c5d6cd0 2024-08-20T01:44:22.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.315+0000 7f3d63fff640 1 -- 172.21.15.79:0/3491526201 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3d680ab440 con 0x55d57c5d6cd0 2024-08-20T01:44:22.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.315+0000 7f3d63fff640 1 -- 172.21.15.79:0/3491526201 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d680a6fd0 con 0x55d57c5d6cd0 2024-08-20T01:44:22.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.316+0000 7f3d826de740 1 -- 172.21.15.79:0/3491526201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d57c5d6cd0 msgr2=0x55d57c5fa7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:22.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.316+0000 7f3d826de740 1 --2- 172.21.15.79:0/3491526201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d57c5d6cd0 0x55d57c5fa7d0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f3d680e1c60 tx=0x7f3d680e78c0 comp rx=0 tx=0).stop 2024-08-20T01:44:22.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.316+0000 7f3d826de740 1 -- 172.21.15.79:0/3491526201 shutdown_connections 2024-08-20T01:44:22.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.316+0000 7f3d826de740 1 --2- 172.21.15.79:0/3491526201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d57c5e2c60 0x55d57c5fad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:22.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.316+0000 7f3d826de740 1 --2- 172.21.15.79:0/3491526201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d57c5d6cd0 0x55d57c5fa7d0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:22.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.316+0000 7f3d826de740 1 --2- 172.21.15.79:0/3491526201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c5d63b0 0x55d57c5da570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:22.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.316+0000 7f3d826de740 1 -- 172.21.15.79:0/3491526201 >> 172.21.15.79:0/3491526201 conn(0x55d57c5d41e0 msgr2=0x55d57c5ee280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:22.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.316+0000 7f3d826de740 1 -- 172.21.15.79:0/3491526201 shutdown_connections 2024-08-20T01:44:22.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.316+0000 7f3d826de740 1 -- 172.21.15.79:0/3491526201 wait complete. 2024-08-20T01:44:22.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.317+0000 7f3d826de740 1 -- start start 2024-08-20T01:44:22.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.317+0000 7f3d826de740 1 Processor -- start 2024-08-20T01:44:22.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.317+0000 7f3d826de740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c5d63b0 0x55d57c5eb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:22.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.317+0000 7f3d826de740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d57c5d6cd0 0x55d57c5e6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:22.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.317+0000 7f3d826de740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d57c5e2c60 0x55d57c5e6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:22.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.317+0000 7f3d826de740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3d781b5930 con 0x55d57c5d6cd0 2024-08-20T01:44:22.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.317+0000 7f3d826de740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3d781b5200 con 0x55d57c5e2c60 2024-08-20T01:44:22.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.317+0000 7f3d826de740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3d781b2440 con 0x55d57c5d63b0 2024-08-20T01:44:22.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.317+0000 7f3d826de740 10 client.0 _ll_register_callbacks cb 0x7f3d70009b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:44:22.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.317+0000 7f3d7d880640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d57c5d6cd0 0x55d57c5e6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:22.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.317+0000 7f3d7d880640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d57c5d6cd0 0x55d57c5e6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38866/0 (socket says 172.21.15.79:38866) 2024-08-20T01:44:22.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.317+0000 7f3d7d880640 1 -- 172.21.15.79:0/1556765688 learned_addr learned my addr 172.21.15.79:0/1556765688 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:22.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.317+0000 7f3d7e081640 1 --2- 172.21.15.79:0/1556765688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c5d63b0 0x55d57c5eb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:22.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.317+0000 7f3d7e882640 1 --2- 172.21.15.79:0/1556765688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d57c5e2c60 0x55d57c5e6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:22.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.317+0000 7f3d7d880640 1 -- 172.21.15.79:0/1556765688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c5d63b0 msgr2=0x55d57c5eb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:22.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.317+0000 7f3d7d880640 1 --2- 172.21.15.79:0/1556765688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c5d63b0 0x55d57c5eb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:22.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.317+0000 7f3d7d880640 1 -- 172.21.15.79:0/1556765688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d57c5e2c60 msgr2=0x55d57c5e6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:22.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.317+0000 7f3d7d880640 1 --2- 172.21.15.79:0/1556765688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d57c5e2c60 0x55d57c5e6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:22.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.318+0000 7f3d7d880640 1 -- 172.21.15.79:0/1556765688 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d57c5e7500 con 0x55d57c5d6cd0 2024-08-20T01:44:22.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.318+0000 7f3d7e882640 1 --2- 172.21.15.79:0/1556765688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d57c5e2c60 0x55d57c5e6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:44:22.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.318+0000 7f3d7e081640 1 --2- 172.21.15.79:0/1556765688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c5d63b0 0x55d57c5eb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:44:22.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.318+0000 7f3d7d880640 1 --2- 172.21.15.79:0/1556765688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d57c5d6cd0 0x55d57c5e6770 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f3d6801f000 tx=0x7f3d680af270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75686cc9dfdc9111 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:22.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.318+0000 7f3d61ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:44:22.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.318+0000 7f3d61ffb640 1 -- 172.21.15.79:0/1556765688 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d680c5070 con 0x55d57c5d6cd0 2024-08-20T01:44:22.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.318+0000 7f3d61ffb640 1 -- 172.21.15.79:0/1556765688 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f3d680ab1b0 con 0x55d57c5d6cd0 2024-08-20T01:44:22.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.318+0000 7f3d826de740 1 -- 172.21.15.79:0/1556765688 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d680ab440 con 0x55d57c5d6cd0 2024-08-20T01:44:22.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.318+0000 7f3d61ffb640 1 -- 172.21.15.79:0/1556765688 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f3d680aa850 con 0x55d57c5d6cd0 2024-08-20T01:44:22.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.318+0000 7f3d826de740 10 client.17601 fetch_fsmap learned FSMap version 41 2024-08-20T01:44:22.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.318+0000 7f3d826de740 1 -- 172.21.15.79:0/1556765688 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55d57c65d870 con 0x55d57c5d6cd0 2024-08-20T01:44:22.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.318+0000 7f3d61ffb640 1 -- 172.21.15.79:0/1556765688 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3d680ab440 con 0x55d57c5d6cd0 2024-08-20T01:44:22.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.318+0000 7f3d61ffb640 1 -- 172.21.15.79:0/1556765688 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 41) ==== 8386+0+0 (secure 0 0 0) 0x7f3d680a66b0 con 0x55d57c5d6cd0 2024-08-20T01:44:22.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.319+0000 7f3d826de740 10 client.17601 fetch_fsmap finished waiting for FSMap version 41 2024-08-20T01:44:22.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.319+0000 7f3d826de740 10 client.17601 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:44:22.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.319+0000 7f3d826de740 20 client.17601 populate_metadata read hostname 'smithi079' 2024-08-20T01:44:22.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.319+0000 7f3d826de740 1 --2- 172.21.15.79:0/1556765688 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d57c65dfd0 0x55d57c6603f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:22.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.319+0000 7f3d826de740 4 client.17601 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T01:44:22.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.319+0000 7f3d826de740 1 -- 172.21.15.79:0/1556765688 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d57c5cf8a0 con 0x55d57c65dfd0 2024-08-20T01:44:22.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.319+0000 7f3d7e081640 1 --2- 172.21.15.79:0/1556765688 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d57c65dfd0 0x55d57c6603f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:22.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.319+0000 7f3d7e081640 1 --2- 172.21.15.79:0/1556765688 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d57c65dfd0 0x55d57c6603f0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d10755c32d1563d server_cookie=a92ad3d0d0c7a67b in_seq=0 out_seq=0 2024-08-20T01:44:22.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.319+0000 7f3d61ffb640 10 client.17601 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:44:22.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.320+0000 7f3d61ffb640 1 -- 172.21.15.79:0/1556765688 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d57c5cf8a0 con 0x55d57c65dfd0 2024-08-20T01:44:22.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.320+0000 7f3d61ffb640 10 client.17601 handle_command_reply: tid=0 2024-08-20T01:44:22.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.320+0000 7f3d826de740 1 client.17601 shutdown 2024-08-20T01:44:22.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.320+0000 7f3d826de740 1 -- 172.21.15.79:0/1556765688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d57c5d6cd0 msgr2=0x55d57c5e6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:22.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.320+0000 7f3d826de740 1 --2- 172.21.15.79:0/1556765688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d57c5d6cd0 0x55d57c5e6770 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f3d6801f000 tx=0x7f3d680af270 comp rx=0 tx=0).stop 2024-08-20T01:44:22.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.320+0000 7f3d826de740 1 -- 172.21.15.79:0/1556765688 shutdown_connections 2024-08-20T01:44:22.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.320+0000 7f3d826de740 1 --2- 172.21.15.79:0/1556765688 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d57c65dfd0 0x55d57c6603f0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:22.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.320+0000 7f3d826de740 1 --2- 172.21.15.79:0/1556765688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d57c5e2c60 0x55d57c5e6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:22.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.320+0000 7f3d826de740 1 --2- 172.21.15.79:0/1556765688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d57c5d6cd0 0x55d57c5e6770 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:22.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.320+0000 7f3d826de740 1 --2- 172.21.15.79:0/1556765688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d57c5d63b0 0x55d57c5eb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:22.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.320+0000 7f3d826de740 1 -- 172.21.15.79:0/1556765688 >> 172.21.15.79:0/1556765688 conn(0x55d57c5d41e0 msgr2=0x55d57c5df960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:22.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.321+0000 7f3d61ffb640 0 client.17601 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:44:22.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.321+0000 7f3d826de740 1 -- 172.21.15.79:0/1556765688 shutdown_connections 2024-08-20T01:44:22.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.321+0000 7f3d826de740 1 -- 172.21.15.79:0/1556765688 wait complete. 2024-08-20T01:44:22.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.321+0000 7f3d826de740 20 client.17601 trim_cache size 0 max 16384 2024-08-20T01:44:22.329 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:44:22.329 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-08-20T01:44:22.330 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "422d15ed-9efd-4589-bf6d-3a0d2234f8f3", 2024-08-20T01:44:22.330 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-08-20T01:44:22.330 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:44:22.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.321+0000 7f3d802e5640 1 -- 172.21.15.79:0/339740133 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3d640b3c50 msgr2=0x7f3d640b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:22.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.321+0000 7f3d802e5640 1 --2- 172.21.15.79:0/339740133 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3d640b3c50 0x7f3d640b6110 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3d70009270 tx=0x7f3d700095e0 comp rx=0 tx=0).stop 2024-08-20T01:44:22.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.321+0000 7f3d802e5640 1 -- 172.21.15.79:0/339740133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d78108500 msgr2=0x7f3d7810ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:22.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.321+0000 7f3d802e5640 1 --2- 172.21.15.79:0/339740133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d78108500 0x7f3d7810ef50 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f3d6800c920 tx=0x7f3d6800cde0 comp rx=0 tx=0).stop 2024-08-20T01:44:22.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.322+0000 7f3d802e5640 1 -- 172.21.15.79:0/339740133 shutdown_connections 2024-08-20T01:44:22.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.322+0000 7f3d802e5640 1 --2- 172.21.15.79:0/339740133 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3d640b3c50 0x7f3d640b6110 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:22.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.322+0000 7f3d802e5640 1 --2- 172.21.15.79:0/339740133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d78108e80 0x7f3d781a1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:22.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.322+0000 7f3d802e5640 1 --2- 172.21.15.79:0/339740133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d78108500 0x7f3d7810ef50 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:22.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.322+0000 7f3d802e5640 1 --2- 172.21.15.79:0/339740133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d78102af0 0x7f3d7810e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:22.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.322+0000 7f3d802e5640 1 -- 172.21.15.79:0/339740133 >> 172.21.15.79:0/339740133 conn(0x7f3d780fe540 msgr2=0x7f3d78104ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:22.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.322+0000 7f3d802e5640 1 -- 172.21.15.79:0/339740133 shutdown_connections 2024-08-20T01:44:22.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:22.322+0000 7f3d802e5640 1 -- 172.21.15.79:0/339740133 wait complete. 2024-08-20T01:44:22.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:22 smithi079 ceph-mon[18656]: pgmap v558: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 23 op/s 2024-08-20T01:44:22.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:22 smithi081 ceph-mon[22209]: pgmap v558: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 23 op/s 2024-08-20T01:44:22.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:22 smithi175 ceph-mon[22392]: pgmap v558: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 23 op/s 2024-08-20T01:44:23.211 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:44:23.484 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:44:23.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:23 smithi081 ceph-mon[22209]: scrub queued for path: / 2024-08-20T01:44:23.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:23 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:44:23.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:23 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:44:23.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:23 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:44:23.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:23 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:44:23.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:23 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:44:23.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:23 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:44:23.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:23 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:44:23.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:23 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:44:23.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:23 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:44:23.780 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:23 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:44:23.780 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:23 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:44:23.780 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:23 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:44:23.780 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:23 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:44:23.780 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:23 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:44:23.780 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:23 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:44:23.780 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:23 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:44:23.780 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:23 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:44:23.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:23 smithi175 ceph-mon[22392]: scrub queued for path: / 2024-08-20T01:44:23.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:23 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:44:23.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:23 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:44:23.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:23 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:44:23.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:23 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:44:23.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:23 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:44:23.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:23 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:44:23.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:23 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:44:23.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:23 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:44:23.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:23 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:44:23.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:23 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:44:23.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:23 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:44:23.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:23 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:44:23.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:23 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:44:23.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:23 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:44:23.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:23 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:44:23.891 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:23 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:44:23.891 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:23 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:44:23.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:23 smithi079 ceph-mon[18656]: scrub queued for path: / 2024-08-20T01:44:23.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:23 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:44:23.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:23 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:44:23.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:23 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:44:23.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:23 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:44:23.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:23 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:44:23.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:23 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:44:23.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:23 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:44:23.938 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:23 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:44:23.938 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:23 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:44:23.938 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:23 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:44:23.938 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:23 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:44:23.938 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:23 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:44:23.938 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:23 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:44:23.938 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:23 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:44:23.938 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:23 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:44:23.938 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:23 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:44:23.938 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:23 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:44:24.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:24 smithi079 ceph-mon[18656]: pgmap v559: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 MiB/s wr, 22 op/s 2024-08-20T01:44:24.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:24 smithi081 ceph-mon[22209]: pgmap v559: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 MiB/s wr, 22 op/s 2024-08-20T01:44:24.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.803+0000 7f0034a16640 1 -- 172.21.15.79:0/2482299806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0030101f00 msgr2=0x7f003010c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:24.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.803+0000 7f0034a16640 1 --2- 172.21.15.79:0/2482299806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0030101f00 0x7f003010c6b0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f0024009900 tx=0x7f002402a410 comp rx=0 tx=0).stop 2024-08-20T01:44:24.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.803+0000 7f0034a16640 1 -- 172.21.15.79:0/2482299806 shutdown_connections 2024-08-20T01:44:24.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.803+0000 7f0034a16640 1 --2- 172.21.15.79:0/2482299806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f003010cdc0 0x7f003010f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:24.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.803+0000 7f0034a16640 1 --2- 172.21.15.79:0/2482299806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0030101f00 0x7f003010c6b0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:24.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.803+0000 7f0034a16640 1 --2- 172.21.15.79:0/2482299806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0030101500 0x7f00301018e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:24.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.803+0000 7f0034a16640 1 -- 172.21.15.79:0/2482299806 >> 172.21.15.79:0/2482299806 conn(0x7f0030076bd0 msgr2=0x7f0030076fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:24.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.803+0000 7f0034a16640 1 -- 172.21.15.79:0/2482299806 shutdown_connections 2024-08-20T01:44:24.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.803+0000 7f0034a16640 1 -- 172.21.15.79:0/2482299806 wait complete. 2024-08-20T01:44:24.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.804+0000 7f0034a16640 1 Processor -- start 2024-08-20T01:44:24.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.804+0000 7f0034a16640 1 -- start start 2024-08-20T01:44:24.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.804+0000 7f0034a16640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0030101500 0x7f003019b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:24.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.804+0000 7f0034a16640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0030101f00 0x7f003019b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:24.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.804+0000 7f0034a16640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f003010cdc0 0x7f00301a0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:24.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.804+0000 7f0034a16640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f00301129e0 con 0x7f003010cdc0 2024-08-20T01:44:24.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.804+0000 7f0034a16640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0030112860 con 0x7f0030101f00 2024-08-20T01:44:24.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.804+0000 7f0034a16640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0030112b60 con 0x7f0030101500 2024-08-20T01:44:24.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.805+0000 7f002ed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f003010cdc0 0x7f00301a0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:24.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.805+0000 7f002ed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f003010cdc0 0x7f00301a0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38888/0 (socket says 172.21.15.79:38888) 2024-08-20T01:44:24.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.805+0000 7f002ed9d640 1 -- 172.21.15.79:0/924454160 learned_addr learned my addr 172.21.15.79:0/924454160 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:24.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.805+0000 7f002dd9b640 1 --2- 172.21.15.79:0/924454160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0030101f00 0x7f003019b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:24.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.805+0000 7f002e59c640 1 --2- 172.21.15.79:0/924454160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0030101500 0x7f003019b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:24.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.805+0000 7f002ed9d640 1 -- 172.21.15.79:0/924454160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0030101500 msgr2=0x7f003019b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:24.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.805+0000 7f002ed9d640 1 --2- 172.21.15.79:0/924454160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0030101500 0x7f003019b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:24.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.805+0000 7f002ed9d640 1 -- 172.21.15.79:0/924454160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0030101f00 msgr2=0x7f003019b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:24.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.805+0000 7f002ed9d640 1 --2- 172.21.15.79:0/924454160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0030101f00 0x7f003019b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:24.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.805+0000 7f002ed9d640 1 -- 172.21.15.79:0/924454160 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00301a1320 con 0x7f003010cdc0 2024-08-20T01:44:24.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.805+0000 7f002dd9b640 1 --2- 172.21.15.79:0/924454160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0030101f00 0x7f003019b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:44:24.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.805+0000 7f002ed9d640 1 --2- 172.21.15.79:0/924454160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f003010cdc0 0x7f00301a0b50 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f002800b970 tx=0x7f002800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:24.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.805+0000 7f001f7fe640 1 -- 172.21.15.79:0/924454160 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0028019070 con 0x7f003010cdc0 2024-08-20T01:44:24.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.805+0000 7f001f7fe640 1 -- 172.21.15.79:0/924454160 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0028014440 con 0x7f003010cdc0 2024-08-20T01:44:24.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.806+0000 7f0034a16640 1 -- 172.21.15.79:0/924454160 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00301a1610 con 0x7f003010cdc0 2024-08-20T01:44:24.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.806+0000 7f001f7fe640 1 -- 172.21.15.79:0/924454160 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00280075d0 con 0x7f003010cdc0 2024-08-20T01:44:24.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.806+0000 7f0034a16640 1 -- 172.21.15.79:0/924454160 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00301a7cd0 con 0x7f003010cdc0 2024-08-20T01:44:24.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.809+0000 7f0036e0f740 1 Processor -- start 2024-08-20T01:44:24.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.809+0000 7f001f7fe640 1 -- 172.21.15.79:0/924454160 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f002801c070 con 0x7f003010cdc0 2024-08-20T01:44:24.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.809+0000 7f0036e0f740 1 -- start start 2024-08-20T01:44:24.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.810+0000 7f0036e0f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559af8291830 0x559af8291c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:24.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.810+0000 7f0036e0f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af8292150 0x559af829dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:24.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.810+0000 7f0036e0f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559af829e0e0 0x559af82a04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:24.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.810+0000 7f0036e0f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559af82088e0 con 0x559af8292150 2024-08-20T01:44:24.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.810+0000 7f0036e0f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559af81f7de0 con 0x559af829e0e0 2024-08-20T01:44:24.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.810+0000 7f0036e0f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559af81fbe20 con 0x559af8291830 2024-08-20T01:44:24.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.810+0000 7f002e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af8292150 0x559af829dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:24.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.810+0000 7f002e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af8292150 0x559af829dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38902/0 (socket says 172.21.15.79:38902) 2024-08-20T01:44:24.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.810+0000 7f002e59c640 1 -- 172.21.15.79:0/3096783164 learned_addr learned my addr 172.21.15.79:0/3096783164 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:24.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.810+0000 7f002dd9b640 1 --2- 172.21.15.79:0/3096783164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559af829e0e0 0x559af82a04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:24.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.810+0000 7f002dd9b640 1 --2- 172.21.15.79:0/3096783164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559af8291830 0x559af8291c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:24.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.810+0000 7f001f7fe640 1 --2- 172.21.15.79:0/924454160 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f00180b3bd0 0x7f00180b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:24.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.810+0000 7f002e59c640 1 -- 172.21.15.79:0/3096783164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559af8291830 msgr2=0x559af8291c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:24.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.810+0000 7f002e59c640 1 --2- 172.21.15.79:0/3096783164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559af8291830 0x559af8291c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:24.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.810+0000 7f002e59c640 1 -- 172.21.15.79:0/3096783164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559af829e0e0 msgr2=0x559af82a04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:24.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.810+0000 7f002e59c640 1 --2- 172.21.15.79:0/3096783164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559af829e0e0 0x559af82a04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:24.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.810+0000 7f002e59c640 1 -- 172.21.15.79:0/3096783164 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559af7f57650 con 0x559af8292150 2024-08-20T01:44:24.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.810+0000 7f002dd9b640 1 --2- 172.21.15.79:0/3096783164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559af829e0e0 0x559af82a04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:44:24.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.811+0000 7f002ed9d640 1 --2- 172.21.15.79:0/924454160 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f00180b3bd0 0x7f00180b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:24.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.811+0000 7f001f7fe640 1 -- 172.21.15.79:0/924454160 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f00280e3180 con 0x7f003010cdc0 2024-08-20T01:44:24.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.811+0000 7f002e59c640 1 --2- 172.21.15.79:0/3096783164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af8292150 0x559af829dba0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f002000b850 tx=0x7f002000bd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c612cc225fe7c37d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:24.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.811+0000 7f001cff9640 1 -- 172.21.15.79:0/3096783164 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0020016df0 con 0x559af8292150 2024-08-20T01:44:24.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.811+0000 7f001cff9640 1 -- 172.21.15.79:0/3096783164 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f002000dbd0 con 0x559af8292150 2024-08-20T01:44:24.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.811+0000 7f002ed9d640 1 --2- 172.21.15.79:0/924454160 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f00180b3bd0 0x7f00180b6090 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f00280e1000 tx=0x7f002800f4f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:24.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.812+0000 7f001cff9640 1 -- 172.21.15.79:0/3096783164 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0020021ba0 con 0x559af8292150 2024-08-20T01:44:24.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.812+0000 7f0036e0f740 1 -- 172.21.15.79:0/3096783164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af8292150 msgr2=0x559af829dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:24.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.812+0000 7f0036e0f740 1 --2- 172.21.15.79:0/3096783164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af8292150 0x559af829dba0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f002000b850 tx=0x7f002000bd10 comp rx=0 tx=0).stop 2024-08-20T01:44:24.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.812+0000 7f0036e0f740 1 -- 172.21.15.79:0/3096783164 shutdown_connections 2024-08-20T01:44:24.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.812+0000 7f0036e0f740 1 --2- 172.21.15.79:0/3096783164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559af829e0e0 0x559af82a04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:24.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.812+0000 7f0036e0f740 1 --2- 172.21.15.79:0/3096783164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af8292150 0x559af829dba0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:24.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.812+0000 7f0036e0f740 1 --2- 172.21.15.79:0/3096783164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559af8291830 0x559af8291c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:24.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.812+0000 7f0036e0f740 1 -- 172.21.15.79:0/3096783164 >> 172.21.15.79:0/3096783164 conn(0x559af828f660 msgr2=0x559af8290800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:24.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.812+0000 7f0036e0f740 1 -- 172.21.15.79:0/3096783164 shutdown_connections 2024-08-20T01:44:24.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.812+0000 7f0036e0f740 1 -- 172.21.15.79:0/3096783164 wait complete. 2024-08-20T01:44:24.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.813+0000 7f0036e0f740 1 -- start start 2024-08-20T01:44:24.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.813+0000 7f0036e0f740 1 Processor -- start 2024-08-20T01:44:24.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.813+0000 7f0036e0f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559af8291830 0x559af829db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:24.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.813+0000 7f0036e0f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af8292150 0x559af829b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:24.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.813+0000 7f0036e0f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559af829e0e0 0x559af829b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:24.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.813+0000 7f0036e0f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559af805a700 con 0x559af8292150 2024-08-20T01:44:24.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.813+0000 7f0036e0f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559af817e7c0 con 0x559af8291830 2024-08-20T01:44:24.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.813+0000 7f0036e0f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559af82a0e30 con 0x559af829e0e0 2024-08-20T01:44:24.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.813+0000 7f0036e0f740 10 client.0 _ll_register_callbacks cb 0x559af81f16b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:44:24.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.813+0000 7f002e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af8292150 0x559af829b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:24.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.813+0000 7f002dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559af8291830 0x559af829db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:24.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.813+0000 7f002e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af8292150 0x559af829b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38912/0 (socket says 172.21.15.79:38912) 2024-08-20T01:44:24.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.813+0000 7f002e59c640 1 -- 172.21.15.79:0/1913759650 learned_addr learned my addr 172.21.15.79:0/1913759650 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:24.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.813+0000 7f002dd9b640 1 --2- 172.21.15.79:0/1913759650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559af829e0e0 0x559af829b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:24.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.814+0000 7f002dd9b640 1 -- 172.21.15.79:0/1913759650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559af829e0e0 msgr2=0x559af829b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:24.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.814+0000 7f002dd9b640 1 --2- 172.21.15.79:0/1913759650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559af829e0e0 0x559af829b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:24.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.814+0000 7f002dd9b640 1 -- 172.21.15.79:0/1913759650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af8292150 msgr2=0x559af829b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:24.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.814+0000 7f002dd9b640 1 --2- 172.21.15.79:0/1913759650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af8292150 0x559af829b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:24.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.814+0000 7f002dd9b640 1 -- 172.21.15.79:0/1913759650 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559af82aa160 con 0x559af8291830 2024-08-20T01:44:24.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.814+0000 7f002e59c640 1 --2- 172.21.15.79:0/1913759650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af8292150 0x559af829b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:44:24.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.814+0000 7f002dd9b640 1 --2- 172.21.15.79:0/1913759650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559af8291830 0x559af829db90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0024009230 tx=0x7f0024009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=520ba0b3aa99a924 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:24.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.814+0000 7f0015ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:44:24.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.814+0000 7f0015ffb640 1 -- 172.21.15.79:0/1913759650 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0024041020 con 0x559af8291830 2024-08-20T01:44:24.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.814+0000 7f0036e0f740 1 -- 172.21.15.79:0/1913759650 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559af81a7100 con 0x559af8291830 2024-08-20T01:44:24.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.814+0000 7f0015ffb640 1 -- 172.21.15.79:0/1913759650 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f00240036b0 con 0x559af8291830 2024-08-20T01:44:24.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.814+0000 7f0015ffb640 1 -- 172.21.15.79:0/1913759650 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f0024035040 con 0x559af8291830 2024-08-20T01:44:24.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.814+0000 7f0036e0f740 10 client.26651 fetch_fsmap learned FSMap version 41 2024-08-20T01:44:24.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.814+0000 7f0036e0f740 1 -- 172.21.15.79:0/1913759650 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x559af82acb10 con 0x559af8291830 2024-08-20T01:44:24.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.815+0000 7f0015ffb640 1 -- 172.21.15.79:0/1913759650 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x559af81a7100 con 0x559af8291830 2024-08-20T01:44:24.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.815+0000 7f0015ffb640 1 -- 172.21.15.79:0/1913759650 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 41) ==== 8386+0+0 (secure 0 0 0) 0x7f002403d6f0 con 0x559af8291830 2024-08-20T01:44:24.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.815+0000 7f0036e0f740 10 client.26651 fetch_fsmap finished waiting for FSMap version 41 2024-08-20T01:44:24.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.815+0000 7f0036e0f740 10 client.26651 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:44:24.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.815+0000 7f0036e0f740 20 client.26651 populate_metadata read hostname 'smithi079' 2024-08-20T01:44:24.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.815+0000 7f0036e0f740 1 --2- 172.21.15.79:0/1913759650 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x559af82adfe0 0x559af82b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:24.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.815+0000 7f0036e0f740 4 client.26651 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:44:24.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.815+0000 7f0036e0f740 1 -- 172.21.15.79:0/1913759650 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559af820a830 con 0x559af82adfe0 2024-08-20T01:44:24.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.815+0000 7f002e59c640 1 --2- 172.21.15.79:0/1913759650 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x559af82adfe0 0x559af82b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:24.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.816+0000 7f002e59c640 1 --2- 172.21.15.79:0/1913759650 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x559af82adfe0 0x559af82b03f0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8d16c8a97170a4d server_cookie=c85ab3a5d428fc57 in_seq=0 out_seq=0 2024-08-20T01:44:24.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.816+0000 7f0015ffb640 10 client.26651 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:44:24.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.816+0000 7f0015ffb640 1 -- 172.21.15.79:0/1913759650 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559af820a830 con 0x559af82adfe0 2024-08-20T01:44:24.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.816+0000 7f0015ffb640 10 client.26651 handle_command_reply: tid=0 2024-08-20T01:44:24.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.816+0000 7f0036e0f740 1 client.26651 shutdown 2024-08-20T01:44:24.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.816+0000 7f0036e0f740 1 -- 172.21.15.79:0/1913759650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559af8291830 msgr2=0x559af829db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:24.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.816+0000 7f0036e0f740 1 --2- 172.21.15.79:0/1913759650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559af8291830 0x559af829db90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0024009230 tx=0x7f0024009260 comp rx=0 tx=0).stop 2024-08-20T01:44:24.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.817+0000 7f0036e0f740 1 -- 172.21.15.79:0/1913759650 shutdown_connections 2024-08-20T01:44:24.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.817+0000 7f0036e0f740 1 --2- 172.21.15.79:0/1913759650 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x559af82adfe0 0x559af82b03f0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:24.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.817+0000 7f0036e0f740 1 --2- 172.21.15.79:0/1913759650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559af829e0e0 0x559af829b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:24.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.817+0000 7f0036e0f740 1 --2- 172.21.15.79:0/1913759650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af8292150 0x559af829b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:24.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.817+0000 7f0036e0f740 1 --2- 172.21.15.79:0/1913759650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559af8291830 0x559af829db90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:24.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.817+0000 7f0015ffb640 0 client.26651 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:44:24.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.817+0000 7f0036e0f740 1 -- 172.21.15.79:0/1913759650 >> 172.21.15.79:0/1913759650 conn(0x559af828f660 msgr2=0x559af8295200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:24.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.817+0000 7f0036e0f740 1 -- 172.21.15.79:0/1913759650 shutdown_connections 2024-08-20T01:44:24.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.817+0000 7f0036e0f740 1 -- 172.21.15.79:0/1913759650 wait complete. 2024-08-20T01:44:24.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.817+0000 7f0036e0f740 20 client.26651 trim_cache size 0 max 16384 2024-08-20T01:44:24.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.836+0000 7f0036e0f740 1 Processor -- start 2024-08-20T01:44:24.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.836+0000 7f0036e0f740 1 -- start start 2024-08-20T01:44:24.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.836+0000 7f0036e0f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559af8291830 0x559af829db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:24.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.836+0000 7f0036e0f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af8292150 0x559af829a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:24.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.836+0000 7f0036e0f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559af829e0e0 0x559af829cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:24.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.836+0000 7f0036e0f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f00301abf60 con 0x559af8292150 2024-08-20T01:44:24.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.836+0000 7f0036e0f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f00301adbc0 con 0x559af8291830 2024-08-20T01:44:24.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.836+0000 7f0036e0f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f00301ac630 con 0x559af829e0e0 2024-08-20T01:44:24.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.836+0000 7f002e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af8292150 0x559af829a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:24.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.836+0000 7f002e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af8292150 0x559af829a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38916/0 (socket says 172.21.15.79:38916) 2024-08-20T01:44:24.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.836+0000 7f002e59c640 1 -- 172.21.15.79:0/829037783 learned_addr learned my addr 172.21.15.79:0/829037783 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:24.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.837+0000 7f002dd9b640 1 --2- 172.21.15.79:0/829037783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559af8291830 0x559af829db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:24.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.837+0000 7f002dd9b640 1 --2- 172.21.15.79:0/829037783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559af829e0e0 0x559af829cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:24.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.837+0000 7f002e59c640 1 -- 172.21.15.79:0/829037783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559af829e0e0 msgr2=0x559af829cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:24.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.837+0000 7f002e59c640 1 --2- 172.21.15.79:0/829037783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559af829e0e0 0x559af829cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:24.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.837+0000 7f002e59c640 1 -- 172.21.15.79:0/829037783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559af8291830 msgr2=0x559af829db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:24.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.837+0000 7f002e59c640 1 --2- 172.21.15.79:0/829037783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559af8291830 0x559af829db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:24.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.837+0000 7f002e59c640 1 -- 172.21.15.79:0/829037783 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559af829bb20 con 0x559af8292150 2024-08-20T01:44:24.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.837+0000 7f002dd9b640 1 --2- 172.21.15.79:0/829037783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559af8291830 0x559af829db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:44:24.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.837+0000 7f002e59c640 1 --2- 172.21.15.79:0/829037783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af8292150 0x559af829a870 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f0020004810 tx=0x7f0020018040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43dcddc7a3567e60 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:24.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.837+0000 7f0017fff640 1 -- 172.21.15.79:0/829037783 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002000d740 con 0x559af8292150 2024-08-20T01:44:24.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.837+0000 7f0017fff640 1 -- 172.21.15.79:0/829037783 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0020027040 con 0x559af8292150 2024-08-20T01:44:24.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.837+0000 7f0017fff640 1 -- 172.21.15.79:0/829037783 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002000e030 con 0x559af8292150 2024-08-20T01:44:24.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.838+0000 7f0036e0f740 1 -- 172.21.15.79:0/829037783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af8292150 msgr2=0x559af829a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:24.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.838+0000 7f0036e0f740 1 --2- 172.21.15.79:0/829037783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af8292150 0x559af829a870 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f0020004810 tx=0x7f0020018040 comp rx=0 tx=0).stop 2024-08-20T01:44:24.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.838+0000 7f0036e0f740 1 -- 172.21.15.79:0/829037783 shutdown_connections 2024-08-20T01:44:24.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.838+0000 7f0036e0f740 1 --2- 172.21.15.79:0/829037783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559af829e0e0 0x559af829cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:24.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.838+0000 7f0036e0f740 1 --2- 172.21.15.79:0/829037783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af8292150 0x559af829a870 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:24.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.838+0000 7f0036e0f740 1 --2- 172.21.15.79:0/829037783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559af8291830 0x559af829db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:24.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.838+0000 7f0036e0f740 1 -- 172.21.15.79:0/829037783 >> 172.21.15.79:0/829037783 conn(0x559af828f660 msgr2=0x559af829c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:24.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.838+0000 7f0036e0f740 1 -- 172.21.15.79:0/829037783 shutdown_connections 2024-08-20T01:44:24.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.838+0000 7f0036e0f740 1 -- 172.21.15.79:0/829037783 wait complete. 2024-08-20T01:44:24.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.839+0000 7f0036e0f740 1 -- start start 2024-08-20T01:44:24.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.839+0000 7f0036e0f740 1 Processor -- start 2024-08-20T01:44:24.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.839+0000 7f0036e0f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559af8291830 0x559af8298a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:24.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.839+0000 7f0036e0f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559af8292150 0x559af82971e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:24.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.839+0000 7f0036e0f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af829e0e0 0x559af8297720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:24.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.839+0000 7f0036e0f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f00301ad430 con 0x559af829e0e0 2024-08-20T01:44:24.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.839+0000 7f0036e0f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f00301acd00 con 0x559af8292150 2024-08-20T01:44:24.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.839+0000 7f0036e0f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f00301a9f80 con 0x559af8291830 2024-08-20T01:44:24.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.839+0000 7f0036e0f740 10 client.0 _ll_register_callbacks cb 0x7f0024031400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:44:24.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.839+0000 7f002dd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af829e0e0 0x559af8297720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:24.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.839+0000 7f002dd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af829e0e0 0x559af8297720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38932/0 (socket says 172.21.15.79:38932) 2024-08-20T01:44:24.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.839+0000 7f002dd9b640 1 -- 172.21.15.79:0/1292654394 learned_addr learned my addr 172.21.15.79:0/1292654394 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:24.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.839+0000 7f002dd9b640 1 --2- 172.21.15.79:0/1292654394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559af8291830 0x559af8298a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:24.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.839+0000 7f002e59c640 1 --2- 172.21.15.79:0/1292654394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559af8292150 0x559af82971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:24.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.839+0000 7f002dd9b640 1 -- 172.21.15.79:0/1292654394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559af8291830 msgr2=0x559af8298a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:24.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.839+0000 7f002dd9b640 1 --2- 172.21.15.79:0/1292654394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559af8291830 0x559af8298a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:24.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.839+0000 7f002dd9b640 1 -- 172.21.15.79:0/1292654394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559af8292150 msgr2=0x559af82971e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:24.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.839+0000 7f002dd9b640 1 --2- 172.21.15.79:0/1292654394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559af8292150 0x559af82971e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:24.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.839+0000 7f002dd9b640 1 -- 172.21.15.79:0/1292654394 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559af8297f30 con 0x559af829e0e0 2024-08-20T01:44:24.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.839+0000 7f002e59c640 1 --2- 172.21.15.79:0/1292654394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559af8292150 0x559af82971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:44:24.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.840+0000 7f002dd9b640 1 --2- 172.21.15.79:0/1292654394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af829e0e0 0x559af8297720 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f0024001eb0 tx=0x7f0024031530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1890925894adf1ee server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:24.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.840+0000 7f0015ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:44:24.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.840+0000 7f0015ffb640 1 -- 172.21.15.79:0/1292654394 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0024041070 con 0x559af829e0e0 2024-08-20T01:44:24.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.840+0000 7f0015ffb640 1 -- 172.21.15.79:0/1292654394 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f0024046070 con 0x559af829e0e0 2024-08-20T01:44:24.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.840+0000 7f0036e0f740 1 -- 172.21.15.79:0/1292654394 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0020027040 con 0x559af829e0e0 2024-08-20T01:44:24.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.840+0000 7f0015ffb640 1 -- 172.21.15.79:0/1292654394 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f002403d920 con 0x559af829e0e0 2024-08-20T01:44:24.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.840+0000 7f0036e0f740 10 client.17619 fetch_fsmap learned FSMap version 41 2024-08-20T01:44:24.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.840+0000 7f0036e0f740 1 -- 172.21.15.79:0/1292654394 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x559af82a6110 con 0x559af829e0e0 2024-08-20T01:44:24.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.840+0000 7f0015ffb640 1 -- 172.21.15.79:0/1292654394 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0020027040 con 0x559af829e0e0 2024-08-20T01:44:24.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.841+0000 7f0015ffb640 1 -- 172.21.15.79:0/1292654394 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 41) ==== 8386+0+0 (secure 0 0 0) 0x7f00240647c0 con 0x559af829e0e0 2024-08-20T01:44:24.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.841+0000 7f0036e0f740 10 client.17619 fetch_fsmap finished waiting for FSMap version 41 2024-08-20T01:44:24.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.841+0000 7f0036e0f740 10 client.17619 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:44:24.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.841+0000 7f0036e0f740 20 client.17619 populate_metadata read hostname 'smithi079' 2024-08-20T01:44:24.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.841+0000 7f0036e0f740 1 --2- 172.21.15.79:0/1292654394 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x559af82a6980 0x559af831aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:24.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.841+0000 7f0036e0f740 4 client.17619 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:44:24.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.841+0000 7f0036e0f740 1 -- 172.21.15.79:0/1292654394 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559af82062d0 con 0x559af82a6980 2024-08-20T01:44:24.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.841+0000 7f002e59c640 1 --2- 172.21.15.79:0/1292654394 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x559af82a6980 0x559af831aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:24.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.841+0000 7f0015ffb640 10 client.17619 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:44:24.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.841+0000 7f002e59c640 1 --2- 172.21.15.79:0/1292654394 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x559af82a6980 0x559af831aca0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=766cdc7a704c2ca1 server_cookie=bbdde07c58056762 in_seq=0 out_seq=0 2024-08-20T01:44:24.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.841+0000 7f0015ffb640 1 -- 172.21.15.79:0/1292654394 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7f002003e110 con 0x559af82a6980 2024-08-20T01:44:24.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.841+0000 7f0015ffb640 10 client.17619 handle_command_reply: tid=0 2024-08-20T01:44:24.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.841+0000 7f0036e0f740 1 client.17619 shutdown 2024-08-20T01:44:24.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.842+0000 7f0036e0f740 1 -- 172.21.15.79:0/1292654394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af829e0e0 msgr2=0x559af8297720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:24.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.842+0000 7f0036e0f740 1 --2- 172.21.15.79:0/1292654394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af829e0e0 0x559af8297720 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f0024001eb0 tx=0x7f0024031530 comp rx=0 tx=0).stop 2024-08-20T01:44:24.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.842+0000 7f0036e0f740 1 -- 172.21.15.79:0/1292654394 shutdown_connections 2024-08-20T01:44:24.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.842+0000 7f0036e0f740 1 --2- 172.21.15.79:0/1292654394 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x559af82a6980 0x559af831aca0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:24.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.842+0000 7f0036e0f740 1 --2- 172.21.15.79:0/1292654394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af829e0e0 0x559af8297720 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:24.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.842+0000 7f0036e0f740 1 --2- 172.21.15.79:0/1292654394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559af8292150 0x559af82971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:24.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.842+0000 7f0015ffb640 0 client.17619 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:44:24.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.842+0000 7f0036e0f740 1 --2- 172.21.15.79:0/1292654394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559af8291830 0x559af8298a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:24.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.842+0000 7f0036e0f740 1 -- 172.21.15.79:0/1292654394 >> 172.21.15.79:0/1292654394 conn(0x559af828f660 msgr2=0x559af829ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:24.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.842+0000 7f0036e0f740 1 -- 172.21.15.79:0/1292654394 shutdown_connections 2024-08-20T01:44:24.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.842+0000 7f0036e0f740 1 -- 172.21.15.79:0/1292654394 wait complete. 2024-08-20T01:44:24.875 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:44:24.875 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-20T01:44:24.875 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": { 2024-08-20T01:44:24.875 INFO:teuthology.orchestra.run.smithi079.stdout: "422d15ed-9efd-4589-bf6d-3a0d2234f8f3": { 2024-08-20T01:44:24.875 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/", 2024-08-20T01:44:24.875 INFO:teuthology.orchestra.run.smithi079.stdout: "tag": "422d15ed-9efd-4589-bf6d-3a0d2234f8f3", 2024-08-20T01:44:24.875 INFO:teuthology.orchestra.run.smithi079.stdout: "options": "recursive,force" 2024-08-20T01:44:24.876 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:44:24.876 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:44:24.876 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:44:24.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.842+0000 7f0036e0f740 20 client.17619 trim_cache size 0 max 16384 2024-08-20T01:44:24.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.842+0000 7f0034a16640 1 -- 172.21.15.79:0/924454160 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f00180b3bd0 msgr2=0x7f00180b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:24.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.842+0000 7f0034a16640 1 --2- 172.21.15.79:0/924454160 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f00180b3bd0 0x7f00180b6090 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f00280e1000 tx=0x7f002800f4f0 comp rx=0 tx=0).stop 2024-08-20T01:44:24.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.842+0000 7f0034a16640 1 -- 172.21.15.79:0/924454160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f003010cdc0 msgr2=0x7f00301a0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:24.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.842+0000 7f0034a16640 1 --2- 172.21.15.79:0/924454160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f003010cdc0 0x7f00301a0b50 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f002800b970 tx=0x7f002800be30 comp rx=0 tx=0).stop 2024-08-20T01:44:24.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.843+0000 7f0034a16640 1 -- 172.21.15.79:0/924454160 shutdown_connections 2024-08-20T01:44:24.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.843+0000 7f0034a16640 1 --2- 172.21.15.79:0/924454160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f003010cdc0 0x7f00301a0b50 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:24.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.843+0000 7f0034a16640 1 --2- 172.21.15.79:0/924454160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0030101f00 0x7f003019b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:24.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.843+0000 7f0034a16640 1 --2- 172.21.15.79:0/924454160 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f00180b3bd0 0x7f00180b6090 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:24.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.843+0000 7f0034a16640 1 --2- 172.21.15.79:0/924454160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0030101500 0x7f003019b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:24.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.843+0000 7f0034a16640 1 -- 172.21.15.79:0/924454160 >> 172.21.15.79:0/924454160 conn(0x7f0030076bd0 msgr2=0x7f00301024a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:24.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.843+0000 7f0034a16640 1 -- 172.21.15.79:0/924454160 shutdown_connections 2024-08-20T01:44:24.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:24.843+0000 7f0034a16640 1 -- 172.21.15.79:0/924454160 wait complete. 2024-08-20T01:44:24.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:24 smithi175 ceph-mon[22392]: pgmap v559: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 MiB/s wr, 22 op/s 2024-08-20T01:44:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.949+0000 7fc11a64f640 1 -- 172.21.15.79:0/2534188826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc114101580 msgr2=0x7fc114101980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.949+0000 7fc11a64f640 1 --2- 172.21.15.79:0/2534188826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc114101580 0x7fc114101980 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fc104009930 tx=0x7fc10402a420 comp rx=0 tx=0).stop 2024-08-20T01:44:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.949+0000 7fc11a64f640 1 -- 172.21.15.79:0/2534188826 shutdown_connections 2024-08-20T01:44:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.949+0000 7fc11a64f640 1 --2- 172.21.15.79:0/2534188826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc114103090 0x7fc114109a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.949+0000 7fc11a64f640 1 --2- 172.21.15.79:0/2534188826 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1141026d0 0x7fc114102b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.949+0000 7fc11a64f640 1 --2- 172.21.15.79:0/2534188826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc114101580 0x7fc114101980 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.949+0000 7fc11a64f640 1 -- 172.21.15.79:0/2534188826 >> 172.21.15.79:0/2534188826 conn(0x7fc1140fce60 msgr2=0x7fc1140ff280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.949+0000 7fc11a64f640 1 -- 172.21.15.79:0/2534188826 shutdown_connections 2024-08-20T01:44:25.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.949+0000 7fc11a64f640 1 -- 172.21.15.79:0/2534188826 wait complete. 2024-08-20T01:44:25.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.950+0000 7fc11a64f640 1 Processor -- start 2024-08-20T01:44:25.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.950+0000 7fc11a64f640 1 -- start start 2024-08-20T01:44:25.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.950+0000 7fc11a64f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc114101580 0x7fc1141978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:25.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.950+0000 7fc11a64f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1141026d0 0x7fc114197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:25.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.950+0000 7fc11a64f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc114103090 0x7fc114198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:25.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.950+0000 7fc11a64f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc11410d150 con 0x7fc1141026d0 2024-08-20T01:44:25.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.950+0000 7fc11a64f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc11410cfd0 con 0x7fc114103090 2024-08-20T01:44:25.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.950+0000 7fc11a64f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc11410d2d0 con 0x7fc114101580 2024-08-20T01:44:25.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.950+0000 7fc1137fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1141026d0 0x7fc114197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:25.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.950+0000 7fc1137fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1141026d0 0x7fc114197f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38944/0 (socket says 172.21.15.79:38944) 2024-08-20T01:44:25.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.950+0000 7fc1137fe640 1 -- 172.21.15.79:0/3949546849 learned_addr learned my addr 172.21.15.79:0/3949546849 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:25.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.950+0000 7fc113fff640 1 --2- 172.21.15.79:0/3949546849 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc114101580 0x7fc1141978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:25.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.950+0000 7fc118bec640 1 --2- 172.21.15.79:0/3949546849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc114103090 0x7fc114198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:25.956 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.950+0000 7fc1137fe640 1 -- 172.21.15.79:0/3949546849 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc114101580 msgr2=0x7fc1141978d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:25.956 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.950+0000 7fc1137fe640 1 --2- 172.21.15.79:0/3949546849 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc114101580 0x7fc1141978d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:25.956 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.950+0000 7fc1137fe640 1 -- 172.21.15.79:0/3949546849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc114103090 msgr2=0x7fc114198b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:25.956 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.951+0000 7fc1137fe640 1 --2- 172.21.15.79:0/3949546849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc114103090 0x7fc114198b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:25.956 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.951+0000 7fc1137fe640 1 -- 172.21.15.79:0/3949546849 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc114199410 con 0x7fc1141026d0 2024-08-20T01:44:25.956 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.951+0000 7fc1137fe640 1 --2- 172.21.15.79:0/3949546849 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1141026d0 0x7fc114197f20 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fc10800b4a0 tx=0x7fc10800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:25.956 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.951+0000 7fc1117fa640 1 -- 172.21.15.79:0/3949546849 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc108014070 con 0x7fc1141026d0 2024-08-20T01:44:25.956 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.951+0000 7fc1117fa640 1 -- 172.21.15.79:0/3949546849 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc108010aa0 con 0x7fc1141026d0 2024-08-20T01:44:25.956 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.951+0000 7fc11a64f640 1 -- 172.21.15.79:0/3949546849 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc114199700 con 0x7fc1141026d0 2024-08-20T01:44:25.956 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.951+0000 7fc1117fa640 1 -- 172.21.15.79:0/3949546849 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc108017b70 con 0x7fc1141026d0 2024-08-20T01:44:25.956 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.951+0000 7fc11a64f640 1 -- 172.21.15.79:0/3949546849 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc11419fdd0 con 0x7fc1141026d0 2024-08-20T01:44:25.957 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.954+0000 7fc1117fa640 1 -- 172.21.15.79:0/3949546849 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc108017070 con 0x7fc1141026d0 2024-08-20T01:44:25.957 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.955+0000 7fc1117fa640 1 --2- 172.21.15.79:0/3949546849 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc0fc0b3bd0 0x7fc0fc0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:25.957 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.955+0000 7fc113fff640 1 --2- 172.21.15.79:0/3949546849 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc0fc0b3bd0 0x7fc0fc0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:25.957 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.955+0000 7fc1117fa640 1 -- 172.21.15.79:0/3949546849 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc1080e2fa0 con 0x7fc1141026d0 2024-08-20T01:44:25.958 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.955+0000 7fc113fff640 1 --2- 172.21.15.79:0/3949546849 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc0fc0b3bd0 0x7fc0fc0b6090 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc1040057c0 tx=0x7fc104031420 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.992+0000 7fc11d444740 1 Processor -- start 2024-08-20T01:44:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.993+0000 7fc11d444740 1 -- start start 2024-08-20T01:44:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.993+0000 7fc11d444740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55683102c8d0 0x55683102ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.993+0000 7fc11d444740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55683102f200 0x5568310315f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.993+0000 7fc11d444740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556831031c40 0x556831034100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.993+0000 7fc11d444740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556830f9f360 con 0x55683102f200 2024-08-20T01:44:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.993+0000 7fc11d444740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556830f8e860 con 0x55683102c8d0 2024-08-20T01:44:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.993+0000 7fc11d444740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556830f928a0 con 0x556831031c40 2024-08-20T01:44:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.993+0000 7fc1137fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55683102f200 0x5568310315f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.993+0000 7fc1137fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55683102f200 0x5568310315f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38960/0 (socket says 172.21.15.79:38960) 2024-08-20T01:44:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.993+0000 7fc1137fe640 1 -- 172.21.15.79:0/1933452300 learned_addr learned my addr 172.21.15.79:0/1933452300 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.993+0000 7fc113fff640 1 --2- 172.21.15.79:0/1933452300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55683102c8d0 0x55683102ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.993+0000 7fc118bec640 1 --2- 172.21.15.79:0/1933452300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556831031c40 0x556831034100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.993+0000 7fc1137fe640 1 -- 172.21.15.79:0/1933452300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556831031c40 msgr2=0x556831034100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.993+0000 7fc1137fe640 1 --2- 172.21.15.79:0/1933452300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556831031c40 0x556831034100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.993+0000 7fc1137fe640 1 -- 172.21.15.79:0/1933452300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55683102c8d0 msgr2=0x55683102ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.993+0000 7fc1137fe640 1 --2- 172.21.15.79:0/1933452300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55683102c8d0 0x55683102ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.993+0000 7fc1137fe640 1 -- 172.21.15.79:0/1933452300 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556830f35e40 con 0x55683102f200 2024-08-20T01:44:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.993+0000 7fc1137fe640 1 --2- 172.21.15.79:0/1933452300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55683102f200 0x5568310315f0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fc1080a7170 tx=0x7fc1080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a64033a4e924852 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.994+0000 7fc0fa7fc640 1 -- 172.21.15.79:0/1933452300 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc10801e070 con 0x55683102f200 2024-08-20T01:44:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.994+0000 7fc0fa7fc640 1 -- 172.21.15.79:0/1933452300 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc1080ae500 con 0x55683102f200 2024-08-20T01:44:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.994+0000 7fc0fa7fc640 1 -- 172.21.15.79:0/1933452300 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1080a6190 con 0x55683102f200 2024-08-20T01:44:26.002 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.994+0000 7fc11d444740 1 -- 172.21.15.79:0/1933452300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55683102f200 msgr2=0x5568310315f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:26.002 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.994+0000 7fc11d444740 1 --2- 172.21.15.79:0/1933452300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55683102f200 0x5568310315f0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fc1080a7170 tx=0x7fc1080046c0 comp rx=0 tx=0).stop 2024-08-20T01:44:26.003 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.994+0000 7fc11d444740 1 -- 172.21.15.79:0/1933452300 shutdown_connections 2024-08-20T01:44:26.003 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.994+0000 7fc11d444740 1 --2- 172.21.15.79:0/1933452300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556831031c40 0x556831034100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:26.003 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.994+0000 7fc11d444740 1 --2- 172.21.15.79:0/1933452300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55683102f200 0x5568310315f0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:26.003 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.994+0000 7fc11d444740 1 --2- 172.21.15.79:0/1933452300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55683102c8d0 0x55683102ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:26.003 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.994+0000 7fc11d444740 1 -- 172.21.15.79:0/1933452300 >> 172.21.15.79:0/1933452300 conn(0x556831027a20 msgr2=0x5568310287b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:26.003 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.994+0000 7fc11d444740 1 -- 172.21.15.79:0/1933452300 shutdown_connections 2024-08-20T01:44:26.003 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.994+0000 7fc11d444740 1 -- 172.21.15.79:0/1933452300 wait complete. 2024-08-20T01:44:26.003 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.995+0000 7fc11d444740 1 -- start start 2024-08-20T01:44:26.003 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.995+0000 7fc11d444740 1 Processor -- start 2024-08-20T01:44:26.003 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.995+0000 7fc11d444740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55683102c8d0 0x556831036160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:26.004 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.995+0000 7fc11d444740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55683102f200 0x556831036800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:26.004 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.995+0000 7fc11d444740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556831031c40 0x5568310373d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:26.004 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.995+0000 7fc11d444740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556830ec7ab0 con 0x55683102f200 2024-08-20T01:44:26.004 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.995+0000 7fc11d444740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556830f15780 con 0x55683102c8d0 2024-08-20T01:44:26.004 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.995+0000 7fc11d444740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556831034c20 con 0x556831031c40 2024-08-20T01:44:26.004 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.995+0000 7fc11d444740 10 client.0 _ll_register_callbacks cb 0x556830c9da00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:44:26.004 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.995+0000 7fc1137fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55683102f200 0x556831036800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:26.004 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.995+0000 7fc1137fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55683102f200 0x556831036800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38974/0 (socket says 172.21.15.79:38974) 2024-08-20T01:44:26.004 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.995+0000 7fc1137fe640 1 -- 172.21.15.79:0/1739105208 learned_addr learned my addr 172.21.15.79:0/1739105208 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:26.005 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.995+0000 7fc113fff640 1 --2- 172.21.15.79:0/1739105208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55683102c8d0 0x556831036160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:26.005 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.995+0000 7fc118bec640 1 --2- 172.21.15.79:0/1739105208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556831031c40 0x5568310373d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:26.005 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.996+0000 7fc1137fe640 1 -- 172.21.15.79:0/1739105208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556831031c40 msgr2=0x5568310373d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:26.005 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.996+0000 7fc1137fe640 1 --2- 172.21.15.79:0/1739105208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556831031c40 0x5568310373d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:26.005 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.996+0000 7fc1137fe640 1 -- 172.21.15.79:0/1739105208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55683102c8d0 msgr2=0x556831036160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:26.005 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.996+0000 7fc1137fe640 1 --2- 172.21.15.79:0/1739105208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55683102c8d0 0x556831036160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:26.005 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.996+0000 7fc1137fe640 1 -- 172.21.15.79:0/1739105208 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556830cf1790 con 0x55683102f200 2024-08-20T01:44:26.005 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.996+0000 7fc113fff640 1 --2- 172.21.15.79:0/1739105208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55683102c8d0 0x556831036160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:44:26.005 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.996+0000 7fc118bec640 1 --2- 172.21.15.79:0/1739105208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556831031c40 0x5568310373d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:44:26.006 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.996+0000 7fc1137fe640 1 --2- 172.21.15.79:0/1739105208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55683102f200 0x556831036800 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fc1080a9bb0 tx=0x7fc1080047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=462779b6fab32275 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:26.006 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.996+0000 7fc0f37fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:44:26.006 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.996+0000 7fc0f37fe640 1 -- 172.21.15.79:0/1739105208 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1080c8070 con 0x55683102f200 2024-08-20T01:44:26.006 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.996+0000 7fc0f37fe640 1 -- 172.21.15.79:0/1739105208 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc1080a6190 con 0x55683102f200 2024-08-20T01:44:26.006 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.996+0000 7fc11d444740 1 -- 172.21.15.79:0/1739105208 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556830f3de00 con 0x55683102f200 2024-08-20T01:44:26.006 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.996+0000 7fc0f37fe640 1 -- 172.21.15.79:0/1739105208 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fc10801e030 con 0x55683102f200 2024-08-20T01:44:26.006 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.996+0000 7fc11d444740 10 client.17631 fetch_fsmap learned FSMap version 41 2024-08-20T01:44:26.006 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.996+0000 7fc11d444740 1 -- 172.21.15.79:0/1739105208 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x556830d6a620 con 0x55683102f200 2024-08-20T01:44:26.006 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.996+0000 7fc0f37fe640 1 -- 172.21.15.79:0/1739105208 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x556830f3de00 con 0x55683102f200 2024-08-20T01:44:26.006 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.997+0000 7fc0f37fe640 1 -- 172.21.15.79:0/1739105208 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 41) ==== 8386+0+0 (secure 0 0 0) 0x7fc1080a5870 con 0x55683102f200 2024-08-20T01:44:26.006 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.997+0000 7fc11d444740 10 client.17631 fetch_fsmap finished waiting for FSMap version 41 2024-08-20T01:44:26.006 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.997+0000 7fc11d444740 10 client.17631 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:44:26.006 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.997+0000 7fc11d444740 20 client.17631 populate_metadata read hostname 'smithi079' 2024-08-20T01:44:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.997+0000 7fc11d444740 1 --2- 172.21.15.79:0/1739105208 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556831041650 0x556831043a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.997+0000 7fc11d444740 4 client.17631 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:44:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.997+0000 7fc11d444740 1 -- 172.21.15.79:0/1739105208 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556830fa12b0 con 0x556831041650 2024-08-20T01:44:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.997+0000 7fc113fff640 1 --2- 172.21.15.79:0/1739105208 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556831041650 0x556831043a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.997+0000 7fc113fff640 1 --2- 172.21.15.79:0/1739105208 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556831041650 0x556831043a40 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d8a8ae26f1e6ced server_cookie=cbb9202f1efebc0b in_seq=0 out_seq=0 2024-08-20T01:44:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.997+0000 7fc0f37fe640 10 client.17631 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:44:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.998+0000 7fc0f37fe640 1 -- 172.21.15.79:0/1739105208 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556830fa12b0 con 0x556831041650 2024-08-20T01:44:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.998+0000 7fc0f37fe640 10 client.17631 handle_command_reply: tid=0 2024-08-20T01:44:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.998+0000 7fc11d444740 1 client.17631 shutdown 2024-08-20T01:44:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.998+0000 7fc11d444740 1 -- 172.21.15.79:0/1739105208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55683102f200 msgr2=0x556831036800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.998+0000 7fc11d444740 1 --2- 172.21.15.79:0/1739105208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55683102f200 0x556831036800 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fc1080a9bb0 tx=0x7fc1080047d0 comp rx=0 tx=0).stop 2024-08-20T01:44:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.998+0000 7fc11d444740 1 -- 172.21.15.79:0/1739105208 shutdown_connections 2024-08-20T01:44:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.998+0000 7fc11d444740 1 --2- 172.21.15.79:0/1739105208 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556831041650 0x556831043a40 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.998+0000 7fc11d444740 1 --2- 172.21.15.79:0/1739105208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556831031c40 0x5568310373d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.998+0000 7fc0f37fe640 0 client.17631 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:44:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.998+0000 7fc11d444740 1 --2- 172.21.15.79:0/1739105208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55683102f200 0x556831036800 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.998+0000 7fc11d444740 1 --2- 172.21.15.79:0/1739105208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55683102c8d0 0x556831036160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.998+0000 7fc11d444740 1 -- 172.21.15.79:0/1739105208 >> 172.21.15.79:0/1739105208 conn(0x556831027a20 msgr2=0x556831026ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.998+0000 7fc11d444740 1 -- 172.21.15.79:0/1739105208 shutdown_connections 2024-08-20T01:44:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.998+0000 7fc11d444740 1 -- 172.21.15.79:0/1739105208 wait complete. 2024-08-20T01:44:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:25.998+0000 7fc11d444740 20 client.17631 trim_cache size 0 max 16384 2024-08-20T01:44:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.020+0000 7fc11d444740 1 Processor -- start 2024-08-20T01:44:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.020+0000 7fc11d444740 1 -- start start 2024-08-20T01:44:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.021+0000 7fc11d444740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55683102c8d0 0x5568310356d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.021+0000 7fc11d444740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55683102f200 0x556831032020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.021+0000 7fc11d444740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556831031c40 0x556831032560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.021+0000 7fc11d444740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc1141a7a00 con 0x55683102c8d0 2024-08-20T01:44:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.021+0000 7fc11d444740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc1141a9660 con 0x556831031c40 2024-08-20T01:44:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.021+0000 7fc11d444740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc1141a80d0 con 0x55683102f200 2024-08-20T01:44:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.021+0000 7fc113fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55683102c8d0 0x5568310356d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.021+0000 7fc113fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55683102c8d0 0x5568310356d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38980/0 (socket says 172.21.15.79:38980) 2024-08-20T01:44:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.021+0000 7fc113fff640 1 -- 172.21.15.79:0/1000398940 learned_addr learned my addr 172.21.15.79:0/1000398940 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.021+0000 7fc118bec640 1 --2- 172.21.15.79:0/1000398940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556831031c40 0x556831032560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.021+0000 7fc1137fe640 1 --2- 172.21.15.79:0/1000398940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55683102f200 0x556831032020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.021+0000 7fc113fff640 1 -- 172.21.15.79:0/1000398940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55683102f200 msgr2=0x556831032020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.021+0000 7fc113fff640 1 --2- 172.21.15.79:0/1000398940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55683102f200 0x556831032020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.021+0000 7fc113fff640 1 -- 172.21.15.79:0/1000398940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556831031c40 msgr2=0x556831032560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.021+0000 7fc113fff640 1 --2- 172.21.15.79:0/1000398940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556831031c40 0x556831032560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:26.026 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.021+0000 7fc113fff640 1 -- 172.21.15.79:0/1000398940 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55683102f030 con 0x55683102c8d0 2024-08-20T01:44:26.026 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.021+0000 7fc113fff640 1 --2- 172.21.15.79:0/1000398940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55683102c8d0 0x5568310356d0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fc104004650 tx=0x7fc10403e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4174b9b326c5907b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:26.026 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.022+0000 7fc0f9ffb640 1 -- 172.21.15.79:0/1000398940 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc104035050 con 0x55683102c8d0 2024-08-20T01:44:26.026 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.022+0000 7fc0f9ffb640 1 -- 172.21.15.79:0/1000398940 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc104031de0 con 0x55683102c8d0 2024-08-20T01:44:26.026 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.022+0000 7fc0f9ffb640 1 -- 172.21.15.79:0/1000398940 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc10404ca30 con 0x55683102c8d0 2024-08-20T01:44:26.029 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.022+0000 7fc11d444740 1 -- 172.21.15.79:0/1000398940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55683102c8d0 msgr2=0x5568310356d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:26.029 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.022+0000 7fc11d444740 1 --2- 172.21.15.79:0/1000398940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55683102c8d0 0x5568310356d0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fc104004650 tx=0x7fc10403e000 comp rx=0 tx=0).stop 2024-08-20T01:44:26.029 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.022+0000 7fc11d444740 1 -- 172.21.15.79:0/1000398940 shutdown_connections 2024-08-20T01:44:26.029 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.023+0000 7fc11d444740 1 --2- 172.21.15.79:0/1000398940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556831031c40 0x556831032560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:26.029 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.023+0000 7fc11d444740 1 --2- 172.21.15.79:0/1000398940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55683102f200 0x556831032020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:26.029 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.023+0000 7fc11d444740 1 --2- 172.21.15.79:0/1000398940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55683102c8d0 0x5568310356d0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:26.030 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.023+0000 7fc11d444740 1 -- 172.21.15.79:0/1000398940 >> 172.21.15.79:0/1000398940 conn(0x556831027a20 msgr2=0x556831034fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:26.030 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.023+0000 7fc11d444740 1 -- 172.21.15.79:0/1000398940 shutdown_connections 2024-08-20T01:44:26.030 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.023+0000 7fc11d444740 1 -- 172.21.15.79:0/1000398940 wait complete. 2024-08-20T01:44:26.030 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.023+0000 7fc11d444740 1 -- start start 2024-08-20T01:44:26.030 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.023+0000 7fc11d444740 1 Processor -- start 2024-08-20T01:44:26.030 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.023+0000 7fc11d444740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55683102c8d0 0x55683103db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:26.030 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.023+0000 7fc11d444740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55683102f200 0x55683103c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:26.030 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.023+0000 7fc11d444740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556831031c40 0x55683103cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:26.030 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.023+0000 7fc11d444740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc1141a8ed0 con 0x55683102f200 2024-08-20T01:44:26.030 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.023+0000 7fc11d444740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc1141a87a0 con 0x556831031c40 2024-08-20T01:44:26.030 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.023+0000 7fc11d444740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc1141a59e0 con 0x55683102c8d0 2024-08-20T01:44:26.030 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.023+0000 7fc11d444740 10 client.0 _ll_register_callbacks cb 0x7fc104005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:44:26.030 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.023+0000 7fc1137fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55683102f200 0x55683103c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:26.030 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.023+0000 7fc1137fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55683102f200 0x55683103c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38986/0 (socket says 172.21.15.79:38986) 2024-08-20T01:44:26.031 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.023+0000 7fc1137fe640 1 -- 172.21.15.79:0/3961015919 learned_addr learned my addr 172.21.15.79:0/3961015919 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:26.031 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.024+0000 7fc118bec640 1 --2- 172.21.15.79:0/3961015919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556831031c40 0x55683103cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:26.031 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.024+0000 7fc113fff640 1 --2- 172.21.15.79:0/3961015919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55683102c8d0 0x55683103db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:26.031 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.024+0000 7fc1137fe640 1 -- 172.21.15.79:0/3961015919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55683102c8d0 msgr2=0x55683103db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:26.031 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.024+0000 7fc1137fe640 1 --2- 172.21.15.79:0/3961015919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55683102c8d0 0x55683103db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:26.031 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.024+0000 7fc1137fe640 1 -- 172.21.15.79:0/3961015919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556831031c40 msgr2=0x55683103cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:26.031 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.024+0000 7fc1137fe640 1 --2- 172.21.15.79:0/3961015919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556831031c40 0x55683103cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:26.031 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.024+0000 7fc1137fe640 1 -- 172.21.15.79:0/3961015919 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55683103d5c0 con 0x55683102f200 2024-08-20T01:44:26.031 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.024+0000 7fc1137fe640 1 --2- 172.21.15.79:0/3961015919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55683102f200 0x55683103c850 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fc1080a5d10 tx=0x7fc1080ae380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d23106e458b653a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:26.031 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.024+0000 7fc0f37fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:44:26.031 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.024+0000 7fc0f37fe640 1 -- 172.21.15.79:0/3961015919 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1080c8070 con 0x55683102f200 2024-08-20T01:44:26.031 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.024+0000 7fc0f37fe640 1 -- 172.21.15.79:0/3961015919 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc1080a5870 con 0x55683102f200 2024-08-20T01:44:26.031 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.024+0000 7fc11d444740 1 -- 172.21.15.79:0/3961015919 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc104031de0 con 0x55683102f200 2024-08-20T01:44:26.032 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.024+0000 7fc0f37fe640 1 -- 172.21.15.79:0/3961015919 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fc1080be050 con 0x55683102f200 2024-08-20T01:44:26.032 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.024+0000 7fc11d444740 10 client.17637 fetch_fsmap learned FSMap version 41 2024-08-20T01:44:26.032 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.024+0000 7fc11d444740 1 -- 172.21.15.79:0/3961015919 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x5568310ac2d0 con 0x55683102f200 2024-08-20T01:44:26.032 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.024+0000 7fc0f37fe640 1 -- 172.21.15.79:0/3961015919 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc104031de0 con 0x55683102f200 2024-08-20T01:44:26.032 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.025+0000 7fc0f37fe640 1 -- 172.21.15.79:0/3961015919 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 41) ==== 8386+0+0 (secure 0 0 0) 0x7fc1080a9160 con 0x55683102f200 2024-08-20T01:44:26.032 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.025+0000 7fc11d444740 10 client.17637 fetch_fsmap finished waiting for FSMap version 41 2024-08-20T01:44:26.032 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.025+0000 7fc11d444740 10 client.17637 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:44:26.032 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.025+0000 7fc11d444740 20 client.17637 populate_metadata read hostname 'smithi079' 2024-08-20T01:44:26.032 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.025+0000 7fc11d444740 1 --2- 172.21.15.79:0/3961015919 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556831041650 0x5568310aec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:26.032 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.025+0000 7fc11d444740 4 client.17637 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:44:26.032 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.025+0000 7fc11d444740 1 -- 172.21.15.79:0/3961015919 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556830f9cd50 con 0x556831041650 2024-08-20T01:44:26.032 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.025+0000 7fc113fff640 1 --2- 172.21.15.79:0/3961015919 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556831041650 0x5568310aec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:26.032 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.025+0000 7fc113fff640 1 --2- 172.21.15.79:0/3961015919 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556831041650 0x5568310aec00 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fde84159be97c899 server_cookie=30aa6a00c581dc82 in_seq=0 out_seq=0 2024-08-20T01:44:26.033 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.025+0000 7fc0f37fe640 10 client.17637 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:44:26.035 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.032+0000 7fc0f37fe640 1 -- 172.21.15.79:0/3961015919 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556830f9cd50 con 0x556831041650 2024-08-20T01:44:26.035 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.032+0000 7fc0f37fe640 10 client.17637 handle_command_reply: tid=0 2024-08-20T01:44:26.035 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.032+0000 7fc11d444740 1 client.17637 shutdown 2024-08-20T01:44:26.035 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.032+0000 7fc11d444740 1 -- 172.21.15.79:0/3961015919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55683102f200 msgr2=0x55683103c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:26.035 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.032+0000 7fc11d444740 1 --2- 172.21.15.79:0/3961015919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55683102f200 0x55683103c850 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fc1080a5d10 tx=0x7fc1080ae380 comp rx=0 tx=0).stop 2024-08-20T01:44:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.032+0000 7fc11d444740 1 -- 172.21.15.79:0/3961015919 shutdown_connections 2024-08-20T01:44:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.032+0000 7fc11d444740 1 --2- 172.21.15.79:0/3961015919 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556831041650 0x5568310aec00 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.032+0000 7fc11d444740 1 --2- 172.21.15.79:0/3961015919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556831031c40 0x55683103cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.032+0000 7fc11d444740 1 --2- 172.21.15.79:0/3961015919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55683102f200 0x55683103c850 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.032+0000 7fc0f37fe640 0 client.17637 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:44:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.032+0000 7fc11d444740 1 --2- 172.21.15.79:0/3961015919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55683102c8d0 0x55683103db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.032+0000 7fc11d444740 1 -- 172.21.15.79:0/3961015919 >> 172.21.15.79:0/3961015919 conn(0x556831027a20 msgr2=0x5568310262c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.032+0000 7fc11d444740 1 -- 172.21.15.79:0/3961015919 shutdown_connections 2024-08-20T01:44:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.032+0000 7fc11d444740 1 -- 172.21.15.79:0/3961015919 wait complete. 2024-08-20T01:44:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.033+0000 7fc11d444740 20 client.17637 trim_cache size 0 max 16384 2024-08-20T01:44:26.037 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:44:26.037 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:44:26.037 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:44:26.037 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:44:26.038 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.033+0000 7fc11a64f640 1 -- 172.21.15.79:0/3949546849 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc0fc0b3bd0 msgr2=0x7fc0fc0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:26.038 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.033+0000 7fc11a64f640 1 --2- 172.21.15.79:0/3949546849 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc0fc0b3bd0 0x7fc0fc0b6090 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc1040057c0 tx=0x7fc104031420 comp rx=0 tx=0).stop 2024-08-20T01:44:26.038 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.033+0000 7fc11a64f640 1 -- 172.21.15.79:0/3949546849 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1141026d0 msgr2=0x7fc114197f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:26.038 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.033+0000 7fc11a64f640 1 --2- 172.21.15.79:0/3949546849 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1141026d0 0x7fc114197f20 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fc10800b4a0 tx=0x7fc10800b960 comp rx=0 tx=0).stop 2024-08-20T01:44:26.038 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.033+0000 7fc11a64f640 1 -- 172.21.15.79:0/3949546849 shutdown_connections 2024-08-20T01:44:26.038 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.033+0000 7fc11a64f640 1 --2- 172.21.15.79:0/3949546849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc114103090 0x7fc114198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:26.038 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.033+0000 7fc11a64f640 1 --2- 172.21.15.79:0/3949546849 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1141026d0 0x7fc114197f20 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:26.038 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.033+0000 7fc11a64f640 1 --2- 172.21.15.79:0/3949546849 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc0fc0b3bd0 0x7fc0fc0b6090 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:26.038 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.033+0000 7fc11a64f640 1 --2- 172.21.15.79:0/3949546849 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc114101580 0x7fc1141978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:26.038 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.033+0000 7fc11a64f640 1 -- 172.21.15.79:0/3949546849 >> 172.21.15.79:0/3949546849 conn(0x7fc1140fce60 msgr2=0x7fc114105ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:26.039 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.033+0000 7fc11a64f640 1 -- 172.21.15.79:0/3949546849 shutdown_connections 2024-08-20T01:44:26.039 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:26.033+0000 7fc11a64f640 1 -- 172.21.15.79:0/3949546849 wait complete. 2024-08-20T01:44:26.169 INFO:tasks.cephfs.filesystem:scrub status for tag:422d15ed-9efd-4589-bf6d-3a0d2234f8f3 - {'path': '/', 'tag': '422d15ed-9efd-4589-bf6d-3a0d2234f8f3', 'options': 'recursive,force'} 2024-08-20T01:44:26.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:26 smithi081 ceph-mon[22209]: pgmap v560: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 MiB/s wr, 38 op/s 2024-08-20T01:44:26.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:26 smithi175 ceph-mon[22392]: pgmap v560: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 MiB/s wr, 38 op/s 2024-08-20T01:44:26.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:26 smithi079 ceph-mon[18656]: pgmap v560: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 MiB/s wr, 38 op/s 2024-08-20T01:44:27.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:27 smithi081 ceph-mon[22209]: pgmap v561: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 25 MiB/s wr, 45 op/s 2024-08-20T01:44:27.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:27 smithi175 ceph-mon[22392]: pgmap v561: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 25 MiB/s wr, 45 op/s 2024-08-20T01:44:27.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:27 smithi079 ceph-mon[18656]: pgmap v561: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 25 MiB/s wr, 45 op/s 2024-08-20T01:44:29.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:29 smithi079 ceph-mon[18656]: pgmap v562: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 28 MiB/s wr, 49 op/s 2024-08-20T01:44:30.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:29 smithi081 ceph-mon[22209]: pgmap v562: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 28 MiB/s wr, 49 op/s 2024-08-20T01:44:30.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:29 smithi175 ceph-mon[22392]: pgmap v562: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 28 MiB/s wr, 49 op/s 2024-08-20T01:44:31.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:31 smithi079 ceph-mon[18656]: pgmap v563: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 29 MiB/s wr, 48 op/s 2024-08-20T01:44:32.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:31 smithi081 ceph-mon[22209]: pgmap v563: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 29 MiB/s wr, 48 op/s 2024-08-20T01:44:32.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:31 smithi175 ceph-mon[22392]: pgmap v563: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 29 MiB/s wr, 48 op/s 2024-08-20T01:44:33.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:33 smithi079 ceph-mon[18656]: pgmap v564: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 27 MiB/s wr, 47 op/s 2024-08-20T01:44:34.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:33 smithi081 ceph-mon[22209]: pgmap v564: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 27 MiB/s wr, 47 op/s 2024-08-20T01:44:34.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:33 smithi175 ceph-mon[22392]: pgmap v564: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 27 MiB/s wr, 47 op/s 2024-08-20T01:44:34.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:34 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:44:35.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:34 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:44:35.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:34 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:44:35.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:35 smithi079 ceph-mon[18656]: pgmap v565: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 32 MiB/s wr, 49 op/s 2024-08-20T01:44:35.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:35 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:44:35.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:35 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:44:35.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:35 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:44:35.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:35 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:44:36.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:35 smithi081 ceph-mon[22209]: pgmap v565: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 32 MiB/s wr, 49 op/s 2024-08-20T01:44:36.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:35 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:44:36.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:35 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:44:36.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:35 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:44:36.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:35 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:44:36.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:35 smithi175 ceph-mon[22392]: pgmap v565: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 32 MiB/s wr, 49 op/s 2024-08-20T01:44:36.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:35 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:44:36.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:35 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:44:36.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:35 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:44:36.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:35 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:44:37.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:37 smithi079 ceph-mon[18656]: pgmap v566: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 30 MiB/s wr, 34 op/s 2024-08-20T01:44:38.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:37 smithi081 ceph-mon[22209]: pgmap v566: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 30 MiB/s wr, 34 op/s 2024-08-20T01:44:38.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:37 smithi175 ceph-mon[22392]: pgmap v566: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 30 MiB/s wr, 34 op/s 2024-08-20T01:44:39.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.191+0000 7ffba2ccc640 1 -- 172.21.15.79:0/3985046423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb9c103070 msgr2=0x7ffb9c1099f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:39.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.191+0000 7ffba2ccc640 1 --2- 172.21.15.79:0/3985046423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb9c103070 0x7ffb9c1099f0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7ffb94009cd0 tx=0x7ffb9402a8e0 comp rx=0 tx=0).stop 2024-08-20T01:44:39.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.191+0000 7ffba2ccc640 1 -- 172.21.15.79:0/3985046423 shutdown_connections 2024-08-20T01:44:39.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.191+0000 7ffba2ccc640 1 --2- 172.21.15.79:0/3985046423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb9c103070 0x7ffb9c1099f0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:39.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.191+0000 7ffba2ccc640 1 --2- 172.21.15.79:0/3985046423 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb9c1026b0 0x7ffb9c102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:39.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.191+0000 7ffba2ccc640 1 --2- 172.21.15.79:0/3985046423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb9c101560 0x7ffb9c101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:39.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.191+0000 7ffba2ccc640 1 -- 172.21.15.79:0/3985046423 >> 172.21.15.79:0/3985046423 conn(0x7ffb9c0fce40 msgr2=0x7ffb9c0ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:39.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.191+0000 7ffba2ccc640 1 -- 172.21.15.79:0/3985046423 shutdown_connections 2024-08-20T01:44:39.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.191+0000 7ffba2ccc640 1 -- 172.21.15.79:0/3985046423 wait complete. 2024-08-20T01:44:39.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.192+0000 7ffba2ccc640 1 Processor -- start 2024-08-20T01:44:39.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.192+0000 7ffba2ccc640 1 -- start start 2024-08-20T01:44:39.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.192+0000 7ffba2ccc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb9c101560 0x7ffb9c198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:39.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.192+0000 7ffba2ccc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb9c1026b0 0x7ffb9c198fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:39.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.192+0000 7ffba2ccc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb9c103070 0x7ffb9c199bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:39.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.192+0000 7ffba2ccc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9c10d060 con 0x7ffb9c101560 2024-08-20T01:44:39.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.192+0000 7ffba2ccc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9c10cee0 con 0x7ffb9c1026b0 2024-08-20T01:44:39.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.192+0000 7ffba2ccc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9c10d1e0 con 0x7ffb9c103070 2024-08-20T01:44:39.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.192+0000 7ffba0a68640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb9c101560 0x7ffb9c198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:39.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.192+0000 7ffba0a68640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb9c101560 0x7ffb9c198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33512/0 (socket says 172.21.15.79:33512) 2024-08-20T01:44:39.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.192+0000 7ffba0a68640 1 -- 172.21.15.79:0/2986416147 learned_addr learned my addr 172.21.15.79:0/2986416147 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:39.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.193+0000 7ffba1269640 1 --2- 172.21.15.79:0/2986416147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb9c103070 0x7ffb9c199bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:39.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.193+0000 7ffb9bfff640 1 --2- 172.21.15.79:0/2986416147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb9c1026b0 0x7ffb9c198fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:39.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.193+0000 7ffba0a68640 1 -- 172.21.15.79:0/2986416147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb9c103070 msgr2=0x7ffb9c199bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:39.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.193+0000 7ffba0a68640 1 --2- 172.21.15.79:0/2986416147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb9c103070 0x7ffb9c199bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:39.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.193+0000 7ffba0a68640 1 -- 172.21.15.79:0/2986416147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb9c1026b0 msgr2=0x7ffb9c198fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:39.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.193+0000 7ffba0a68640 1 --2- 172.21.15.79:0/2986416147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb9c1026b0 0x7ffb9c198fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:39.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.193+0000 7ffba0a68640 1 -- 172.21.15.79:0/2986416147 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb9c19a490 con 0x7ffb9c101560 2024-08-20T01:44:39.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.193+0000 7ffba0a68640 1 --2- 172.21.15.79:0/2986416147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb9c101560 0x7ffb9c198950 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7ffb9000d950 tx=0x7ffb9000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:39.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.193+0000 7ffb99ffb640 1 -- 172.21.15.79:0/2986416147 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb90017070 con 0x7ffb9c101560 2024-08-20T01:44:39.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.193+0000 7ffb99ffb640 1 -- 172.21.15.79:0/2986416147 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffb90009c30 con 0x7ffb9c101560 2024-08-20T01:44:39.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.193+0000 7ffba2ccc640 1 -- 172.21.15.79:0/2986416147 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb9c19a780 con 0x7ffb9c101560 2024-08-20T01:44:39.198 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.193+0000 7ffb99ffb640 1 -- 172.21.15.79:0/2986416147 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb9000f620 con 0x7ffb9c101560 2024-08-20T01:44:39.198 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.193+0000 7ffba2ccc640 1 -- 172.21.15.79:0/2986416147 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb9c1a0e50 con 0x7ffb9c101560 2024-08-20T01:44:39.199 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.196+0000 7ffba5ac6740 1 Processor -- start 2024-08-20T01:44:39.200 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.196+0000 7ffba5ac6740 1 -- start start 2024-08-20T01:44:39.200 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.197+0000 7ffba5ac6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f83b4e2a40 0x55f83b4e4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:39.200 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.197+0000 7ffb99ffb640 1 -- 172.21.15.79:0/2986416147 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ffb90010460 con 0x7ffb9c101560 2024-08-20T01:44:39.200 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.197+0000 7ffba5ac6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f83b4e5370 0x55f83b4e7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:39.200 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.197+0000 7ffba5ac6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f83b4e7db0 0x55f83b4ea270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:39.200 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.197+0000 7ffba5ac6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f83b451360 con 0x55f83b4e7db0 2024-08-20T01:44:39.200 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.197+0000 7ffba5ac6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f83b440860 con 0x55f83b4e2a40 2024-08-20T01:44:39.200 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.197+0000 7ffba5ac6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f83b4448a0 con 0x55f83b4e5370 2024-08-20T01:44:39.200 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.197+0000 7ffb9bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f83b4e7db0 0x55f83b4ea270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:39.200 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.197+0000 7ffb9bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f83b4e7db0 0x55f83b4ea270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33518/0 (socket says 172.21.15.79:33518) 2024-08-20T01:44:39.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.197+0000 7ffb9bfff640 1 -- 172.21.15.79:0/3029874878 learned_addr learned my addr 172.21.15.79:0/3029874878 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:39.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.197+0000 7ffba1269640 1 --2- 172.21.15.79:0/3029874878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f83b4e2a40 0x55f83b4e4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:39.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.197+0000 7ffba0a68640 1 --2- 172.21.15.79:0/3029874878 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f83b4e5370 0x55f83b4e7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:39.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.197+0000 7ffb9bfff640 1 -- 172.21.15.79:0/3029874878 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f83b4e5370 msgr2=0x55f83b4e7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:39.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.197+0000 7ffb9bfff640 1 --2- 172.21.15.79:0/3029874878 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f83b4e5370 0x55f83b4e7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:39.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.197+0000 7ffb9bfff640 1 -- 172.21.15.79:0/3029874878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f83b4e2a40 msgr2=0x55f83b4e4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:39.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.197+0000 7ffb9bfff640 1 --2- 172.21.15.79:0/3029874878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f83b4e2a40 0x55f83b4e4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:39.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.197+0000 7ffb9bfff640 1 -- 172.21.15.79:0/3029874878 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f83b3e7e40 con 0x55f83b4e7db0 2024-08-20T01:44:39.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.197+0000 7ffba0a68640 1 --2- 172.21.15.79:0/3029874878 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f83b4e5370 0x55f83b4e7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:44:39.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.197+0000 7ffb9bfff640 1 --2- 172.21.15.79:0/3029874878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f83b4e7db0 0x55f83b4ea270 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7ffb8800cbf0 tx=0x7ffb8800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2066109a980080b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:39.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.198+0000 7ffb86ffd640 1 -- 172.21.15.79:0/3029874878 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb88010630 con 0x55f83b4e7db0 2024-08-20T01:44:39.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.198+0000 7ffb86ffd640 1 -- 172.21.15.79:0/3029874878 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffb88010c60 con 0x55f83b4e7db0 2024-08-20T01:44:39.202 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.198+0000 7ffb86ffd640 1 -- 172.21.15.79:0/3029874878 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb88019b00 con 0x55f83b4e7db0 2024-08-20T01:44:39.202 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.198+0000 7ffb99ffb640 1 --2- 172.21.15.79:0/2986416147 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ffb8c0b3bd0 0x7ffb8c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:39.202 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.198+0000 7ffba1269640 1 --2- 172.21.15.79:0/2986416147 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ffb8c0b3bd0 0x7ffb8c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:39.205 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.198+0000 7ffb99ffb640 1 -- 172.21.15.79:0/2986416147 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ffb900e3910 con 0x7ffb9c101560 2024-08-20T01:44:39.205 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.200+0000 7ffba5ac6740 1 -- 172.21.15.79:0/3029874878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f83b4e7db0 msgr2=0x55f83b4ea270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:39.206 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.200+0000 7ffba1269640 1 --2- 172.21.15.79:0/2986416147 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ffb8c0b3bd0 0x7ffb8c0b6090 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ffb94005cc0 tx=0x7ffb94031790 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:39.206 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.200+0000 7ffba5ac6740 1 --2- 172.21.15.79:0/3029874878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f83b4e7db0 0x55f83b4ea270 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7ffb8800cbf0 tx=0x7ffb8800e720 comp rx=0 tx=0).stop 2024-08-20T01:44:39.206 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.200+0000 7ffba5ac6740 1 -- 172.21.15.79:0/3029874878 shutdown_connections 2024-08-20T01:44:39.206 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.200+0000 7ffba5ac6740 1 --2- 172.21.15.79:0/3029874878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f83b4e7db0 0x55f83b4ea270 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:39.206 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.200+0000 7ffba5ac6740 1 --2- 172.21.15.79:0/3029874878 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f83b4e5370 0x55f83b4e7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:39.206 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.200+0000 7ffba5ac6740 1 --2- 172.21.15.79:0/3029874878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f83b4e2a40 0x55f83b4e4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:39.206 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.200+0000 7ffba5ac6740 1 -- 172.21.15.79:0/3029874878 >> 172.21.15.79:0/3029874878 conn(0x55f83b4d9730 msgr2=0x55f83b4da510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:39.206 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.200+0000 7ffba5ac6740 1 -- 172.21.15.79:0/3029874878 shutdown_connections 2024-08-20T01:44:39.206 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.200+0000 7ffba5ac6740 1 -- 172.21.15.79:0/3029874878 wait complete. 2024-08-20T01:44:39.206 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.200+0000 7ffba5ac6740 1 -- start start 2024-08-20T01:44:39.206 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.201+0000 7ffba5ac6740 1 Processor -- start 2024-08-20T01:44:39.206 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.201+0000 7ffba5ac6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f83b4e2a40 0x55f83b4ec2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:39.207 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.201+0000 7ffba5ac6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f83b4e5370 0x55f83b4ec960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:39.207 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.201+0000 7ffba5ac6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f83b4e7db0 0x55f83b4ed4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:39.207 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.201+0000 7ffba5ac6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f83b379ab0 con 0x55f83b4e5370 2024-08-20T01:44:39.207 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.201+0000 7ffba5ac6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f83b3c7780 con 0x55f83b4e2a40 2024-08-20T01:44:39.207 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.201+0000 7ffba5ac6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f83b4ead90 con 0x55f83b4e7db0 2024-08-20T01:44:39.207 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.201+0000 7ffba5ac6740 10 client.0 _ll_register_callbacks cb 0x55f83b14fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:44:39.207 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.201+0000 7ffb9bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f83b4e5370 0x55f83b4ec960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:39.207 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.201+0000 7ffb9bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f83b4e5370 0x55f83b4ec960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33522/0 (socket says 172.21.15.79:33522) 2024-08-20T01:44:39.207 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.201+0000 7ffb9bfff640 1 -- 172.21.15.79:0/1561698629 learned_addr learned my addr 172.21.15.79:0/1561698629 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:39.207 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.202+0000 7ffb9bfff640 1 -- 172.21.15.79:0/1561698629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f83b4e7db0 msgr2=0x55f83b4ed4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:39.207 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.202+0000 7ffb9bfff640 1 --2- 172.21.15.79:0/1561698629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f83b4e7db0 0x55f83b4ed4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:39.207 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.202+0000 7ffb9bfff640 1 -- 172.21.15.79:0/1561698629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f83b4e2a40 msgr2=0x55f83b4ec2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:39.207 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.202+0000 7ffba0a68640 1 --2- 172.21.15.79:0/1561698629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f83b4e2a40 0x55f83b4ec2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:39.208 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.202+0000 7ffb9bfff640 1 --2- 172.21.15.79:0/1561698629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f83b4e2a40 0x55f83b4ec2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:39.208 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.202+0000 7ffb9bfff640 1 -- 172.21.15.79:0/1561698629 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f83b1a3790 con 0x55f83b4e5370 2024-08-20T01:44:39.208 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.202+0000 7ffba0a68640 1 --2- 172.21.15.79:0/1561698629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f83b4e2a40 0x55f83b4ec2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:44:39.208 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.202+0000 7ffb9bfff640 1 --2- 172.21.15.79:0/1561698629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f83b4e5370 0x55f83b4ec960 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7ffb88019f80 tx=0x7ffb88019fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f1fe0b74f713ee server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:39.208 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.202+0000 7ffb7bfff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:44:39.208 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.202+0000 7ffb7bfff640 1 -- 172.21.15.79:0/1561698629 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb88005050 con 0x55f83b4e5370 2024-08-20T01:44:39.208 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.202+0000 7ffb7bfff640 1 -- 172.21.15.79:0/1561698629 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ffb880051f0 con 0x55f83b4e5370 2024-08-20T01:44:39.208 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.202+0000 7ffba5ac6740 1 -- 172.21.15.79:0/1561698629 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f83b3efe00 con 0x55f83b4e5370 2024-08-20T01:44:39.208 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.202+0000 7ffb7bfff640 1 -- 172.21.15.79:0/1561698629 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7ffb880053f0 con 0x55f83b4e5370 2024-08-20T01:44:39.208 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.202+0000 7ffba5ac6740 10 client.17649 fetch_fsmap learned FSMap version 41 2024-08-20T01:44:39.209 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.202+0000 7ffba5ac6740 1 -- 172.21.15.79:0/1561698629 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55f83b21c620 con 0x55f83b4e5370 2024-08-20T01:44:39.209 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.203+0000 7ffb7bfff640 1 -- 172.21.15.79:0/1561698629 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55f83b3efe00 con 0x55f83b4e5370 2024-08-20T01:44:39.209 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.203+0000 7ffb7bfff640 1 -- 172.21.15.79:0/1561698629 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 41) ==== 8386+0+0 (secure 0 0 0) 0x7ffb88010550 con 0x55f83b4e5370 2024-08-20T01:44:39.209 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.203+0000 7ffba5ac6740 10 client.17649 fetch_fsmap finished waiting for FSMap version 41 2024-08-20T01:44:39.209 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.203+0000 7ffba5ac6740 10 client.17649 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:44:39.209 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.203+0000 7ffba5ac6740 20 client.17649 populate_metadata read hostname 'smithi079' 2024-08-20T01:44:39.209 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.203+0000 7ffba5ac6740 1 --2- 172.21.15.79:0/1561698629 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f83b4f7720 0x55f83b4f9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:39.209 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.203+0000 7ffba5ac6740 4 client.17649 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:44:39.209 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.203+0000 7ffba5ac6740 1 -- 172.21.15.79:0/1561698629 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f83b4532b0 con 0x55f83b4f7720 2024-08-20T01:44:39.209 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.203+0000 7ffba0a68640 1 --2- 172.21.15.79:0/1561698629 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f83b4f7720 0x55f83b4f9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:39.210 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.205+0000 7ffb7bfff640 10 client.17649 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:44:39.210 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.205+0000 7ffba0a68640 1 --2- 172.21.15.79:0/1561698629 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f83b4f7720 0x55f83b4f9b10 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97a407e045748f7c server_cookie=ebe0d887bdcfb1c1 in_seq=0 out_seq=0 2024-08-20T01:44:39.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.206+0000 7ffb7bfff640 1 -- 172.21.15.79:0/1561698629 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f83b4532b0 con 0x55f83b4f7720 2024-08-20T01:44:39.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.206+0000 7ffb7bfff640 10 client.17649 handle_command_reply: tid=0 2024-08-20T01:44:39.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.206+0000 7ffba5ac6740 1 client.17649 shutdown 2024-08-20T01:44:39.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.206+0000 7ffba5ac6740 1 -- 172.21.15.79:0/1561698629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f83b4e5370 msgr2=0x55f83b4ec960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:39.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.206+0000 7ffba5ac6740 1 --2- 172.21.15.79:0/1561698629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f83b4e5370 0x55f83b4ec960 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7ffb88019f80 tx=0x7ffb88019fb0 comp rx=0 tx=0).stop 2024-08-20T01:44:39.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.206+0000 7ffba5ac6740 1 -- 172.21.15.79:0/1561698629 shutdown_connections 2024-08-20T01:44:39.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.206+0000 7ffba5ac6740 1 --2- 172.21.15.79:0/1561698629 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f83b4f7720 0x55f83b4f9b10 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:39.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.206+0000 7ffba5ac6740 1 --2- 172.21.15.79:0/1561698629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f83b4e7db0 0x55f83b4ed4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:39.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.206+0000 7ffb7bfff640 0 client.17649 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:44:39.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.206+0000 7ffba5ac6740 1 --2- 172.21.15.79:0/1561698629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f83b4e5370 0x55f83b4ec960 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:39.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.206+0000 7ffba5ac6740 1 --2- 172.21.15.79:0/1561698629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f83b4e2a40 0x55f83b4ec2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:39.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.206+0000 7ffba5ac6740 1 -- 172.21.15.79:0/1561698629 >> 172.21.15.79:0/1561698629 conn(0x55f83b4d9730 msgr2=0x55f83b4d8850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:39.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.206+0000 7ffba5ac6740 1 -- 172.21.15.79:0/1561698629 shutdown_connections 2024-08-20T01:44:39.212 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.206+0000 7ffba5ac6740 1 -- 172.21.15.79:0/1561698629 wait complete. 2024-08-20T01:44:39.212 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.206+0000 7ffba5ac6740 20 client.17649 trim_cache size 0 max 16384 2024-08-20T01:44:39.230 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.224+0000 7ffba5ac6740 1 Processor -- start 2024-08-20T01:44:39.230 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.224+0000 7ffba5ac6740 1 -- start start 2024-08-20T01:44:39.230 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.224+0000 7ffba5ac6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f83b4e2a40 0x55f83b4eb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:39.230 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.224+0000 7ffba5ac6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f83b4e5370 0x55f83b4eb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:39.230 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.224+0000 7ffba5ac6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f83b4e7db0 0x55f83b4e8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:39.230 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.224+0000 7ffba5ac6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9c1a7960 con 0x55f83b4e2a40 2024-08-20T01:44:39.230 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.224+0000 7ffba5ac6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9c1a95c0 con 0x55f83b4e7db0 2024-08-20T01:44:39.230 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.224+0000 7ffba5ac6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9c1a8030 con 0x55f83b4e5370 2024-08-20T01:44:39.231 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.225+0000 7ffba0a68640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f83b4e2a40 0x55f83b4eb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:39.231 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.225+0000 7ffba0a68640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f83b4e2a40 0x55f83b4eb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33528/0 (socket says 172.21.15.79:33528) 2024-08-20T01:44:39.231 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.225+0000 7ffba0a68640 1 -- 172.21.15.79:0/3109232938 learned_addr learned my addr 172.21.15.79:0/3109232938 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:39.231 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.225+0000 7ffb9bfff640 1 --2- 172.21.15.79:0/3109232938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f83b4e5370 0x55f83b4eb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:39.231 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.225+0000 7ffba1269640 1 --2- 172.21.15.79:0/3109232938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f83b4e7db0 0x55f83b4e8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:39.231 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.225+0000 7ffba0a68640 1 -- 172.21.15.79:0/3109232938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f83b4e5370 msgr2=0x55f83b4eb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:39.231 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.225+0000 7ffba0a68640 1 --2- 172.21.15.79:0/3109232938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f83b4e5370 0x55f83b4eb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:39.231 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.225+0000 7ffba0a68640 1 -- 172.21.15.79:0/3109232938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f83b4e7db0 msgr2=0x55f83b4e8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:39.231 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.225+0000 7ffba0a68640 1 --2- 172.21.15.79:0/3109232938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f83b4e7db0 0x55f83b4e8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:39.231 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.225+0000 7ffba0a68640 1 -- 172.21.15.79:0/3109232938 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f83b4e51a0 con 0x55f83b4e2a40 2024-08-20T01:44:39.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.225+0000 7ffba0a68640 1 --2- 172.21.15.79:0/3109232938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f83b4e2a40 0x55f83b4eb190 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7ffb900a6890 tx=0x7ffb900e1290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a76a52b5cd1181e1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:39.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.225+0000 7ffb867fc640 1 -- 172.21.15.79:0/3109232938 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb90020040 con 0x55f83b4e2a40 2024-08-20T01:44:39.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.225+0000 7ffb867fc640 1 -- 172.21.15.79:0/3109232938 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffb900aaf10 con 0x55f83b4e2a40 2024-08-20T01:44:39.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.225+0000 7ffb867fc640 1 -- 172.21.15.79:0/3109232938 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb900a6aa0 con 0x55f83b4e2a40 2024-08-20T01:44:39.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.226+0000 7ffba5ac6740 1 -- 172.21.15.79:0/3109232938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f83b4e2a40 msgr2=0x55f83b4eb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:39.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.226+0000 7ffba5ac6740 1 --2- 172.21.15.79:0/3109232938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f83b4e2a40 0x55f83b4eb190 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7ffb900a6890 tx=0x7ffb900e1290 comp rx=0 tx=0).stop 2024-08-20T01:44:39.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.226+0000 7ffba5ac6740 1 -- 172.21.15.79:0/3109232938 shutdown_connections 2024-08-20T01:44:39.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.226+0000 7ffba5ac6740 1 --2- 172.21.15.79:0/3109232938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f83b4e7db0 0x55f83b4e8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:39.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.226+0000 7ffba5ac6740 1 --2- 172.21.15.79:0/3109232938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f83b4e5370 0x55f83b4eb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:39.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.226+0000 7ffba5ac6740 1 --2- 172.21.15.79:0/3109232938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f83b4e2a40 0x55f83b4eb190 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:39.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.226+0000 7ffba5ac6740 1 -- 172.21.15.79:0/3109232938 >> 172.21.15.79:0/3109232938 conn(0x55f83b4d9730 msgr2=0x55f83b4ec2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:39.233 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.226+0000 7ffba5ac6740 1 -- 172.21.15.79:0/3109232938 shutdown_connections 2024-08-20T01:44:39.233 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.226+0000 7ffba5ac6740 1 -- 172.21.15.79:0/3109232938 wait complete. 2024-08-20T01:44:39.233 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.226+0000 7ffba5ac6740 1 -- start start 2024-08-20T01:44:39.233 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.226+0000 7ffba5ac6740 1 Processor -- start 2024-08-20T01:44:39.233 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.227+0000 7ffba5ac6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f83b4e2a40 0x55f83b4f1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:39.233 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.227+0000 7ffba5ac6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f83b4e5370 0x55f83b4f1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:39.233 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.227+0000 7ffba5ac6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f83b4e7db0 0x55f83b4f2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:39.233 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.227+0000 7ffba5ac6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9c1a8e30 con 0x55f83b4e7db0 2024-08-20T01:44:39.233 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.227+0000 7ffba5ac6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9c1a8700 con 0x55f83b4e5370 2024-08-20T01:44:39.233 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.227+0000 7ffba5ac6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9c1a5940 con 0x55f83b4e2a40 2024-08-20T01:44:39.233 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.227+0000 7ffba5ac6740 10 client.0 _ll_register_callbacks cb 0x7ffb88014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:44:39.234 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.227+0000 7ffba1269640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f83b4e7db0 0x55f83b4f2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:39.234 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.227+0000 7ffba1269640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f83b4e7db0 0x55f83b4f2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33544/0 (socket says 172.21.15.79:33544) 2024-08-20T01:44:39.234 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.227+0000 7ffba1269640 1 -- 172.21.15.79:0/3356130272 learned_addr learned my addr 172.21.15.79:0/3356130272 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:39.234 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.227+0000 7ffba0a68640 1 --2- 172.21.15.79:0/3356130272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f83b4e2a40 0x55f83b4f1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:39.234 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.227+0000 7ffb9bfff640 1 --2- 172.21.15.79:0/3356130272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f83b4e5370 0x55f83b4f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:39.234 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.227+0000 7ffba1269640 1 -- 172.21.15.79:0/3356130272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f83b4e2a40 msgr2=0x55f83b4f1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:39.234 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.227+0000 7ffba1269640 1 --2- 172.21.15.79:0/3356130272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f83b4e2a40 0x55f83b4f1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:39.234 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.227+0000 7ffba1269640 1 -- 172.21.15.79:0/3356130272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f83b4e5370 msgr2=0x55f83b4f1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:39.234 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.227+0000 7ffba1269640 1 --2- 172.21.15.79:0/3356130272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f83b4e5370 0x55f83b4f1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:39.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.227+0000 7ffba1269640 1 -- 172.21.15.79:0/3356130272 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f83b4f2b70 con 0x55f83b4e7db0 2024-08-20T01:44:39.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.227+0000 7ffba1269640 1 --2- 172.21.15.79:0/3356130272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f83b4e7db0 0x55f83b4f2340 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7ffb94009cd0 tx=0x7ffb94005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21a4d0581041e73f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:39.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.227+0000 7ffb7bfff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:44:39.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.228+0000 7ffb7bfff640 1 -- 172.21.15.79:0/3356130272 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb94004040 con 0x55f83b4e7db0 2024-08-20T01:44:39.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.228+0000 7ffb7bfff640 1 -- 172.21.15.79:0/3356130272 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ffb940041e0 con 0x55f83b4e7db0 2024-08-20T01:44:39.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.228+0000 7ffba5ac6740 1 -- 172.21.15.79:0/3356130272 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb900aaf10 con 0x55f83b4e7db0 2024-08-20T01:44:39.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.228+0000 7ffb7bfff640 1 -- 172.21.15.79:0/3356130272 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7ffb940043e0 con 0x55f83b4e7db0 2024-08-20T01:44:39.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.228+0000 7ffba5ac6740 10 client.17655 fetch_fsmap learned FSMap version 41 2024-08-20T01:44:39.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.228+0000 7ffba5ac6740 1 -- 172.21.15.79:0/3356130272 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55f83b4f3f80 con 0x55f83b4e7db0 2024-08-20T01:44:39.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.228+0000 7ffb7bfff640 1 -- 172.21.15.79:0/3356130272 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffb900aaf10 con 0x55f83b4e7db0 2024-08-20T01:44:39.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.228+0000 7ffb7bfff640 1 -- 172.21.15.79:0/3356130272 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 41) ==== 8386+0+0 (secure 0 0 0) 0x7ffb94030070 con 0x55f83b4e7db0 2024-08-20T01:44:39.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.228+0000 7ffba5ac6740 10 client.17655 fetch_fsmap finished waiting for FSMap version 41 2024-08-20T01:44:39.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.228+0000 7ffba5ac6740 10 client.17655 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:44:39.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.228+0000 7ffba5ac6740 20 client.17655 populate_metadata read hostname 'smithi079' 2024-08-20T01:44:39.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.228+0000 7ffba5ac6740 1 --2- 172.21.15.79:0/3356130272 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f83b562950 0x55f83b564d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:39.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.228+0000 7ffba5ac6740 4 client.17655 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:44:39.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.228+0000 7ffba5ac6740 1 -- 172.21.15.79:0/3356130272 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f83b44ed50 con 0x55f83b562950 2024-08-20T01:44:39.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.229+0000 7ffba0a68640 1 --2- 172.21.15.79:0/3356130272 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f83b562950 0x55f83b564d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:39.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.229+0000 7ffba0a68640 1 --2- 172.21.15.79:0/3356130272 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f83b562950 0x55f83b564d70 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a17268a636c6d23 server_cookie=d1aeb51c033115aa in_seq=0 out_seq=0 2024-08-20T01:44:39.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.229+0000 7ffb7bfff640 10 client.17655 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:44:39.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.235+0000 7ffb7bfff640 1 -- 172.21.15.79:0/3356130272 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f83b44ed50 con 0x55f83b562950 2024-08-20T01:44:39.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.235+0000 7ffb7bfff640 10 client.17655 handle_command_reply: tid=0 2024-08-20T01:44:39.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.235+0000 7ffba5ac6740 1 client.17655 shutdown 2024-08-20T01:44:39.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.236+0000 7ffba5ac6740 1 -- 172.21.15.79:0/3356130272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f83b4e7db0 msgr2=0x55f83b4f2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:39.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.236+0000 7ffba5ac6740 1 --2- 172.21.15.79:0/3356130272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f83b4e7db0 0x55f83b4f2340 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7ffb94009cd0 tx=0x7ffb94005dd0 comp rx=0 tx=0).stop 2024-08-20T01:44:39.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.236+0000 7ffba5ac6740 1 -- 172.21.15.79:0/3356130272 shutdown_connections 2024-08-20T01:44:39.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.236+0000 7ffba5ac6740 1 --2- 172.21.15.79:0/3356130272 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f83b562950 0x55f83b564d70 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:39.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.236+0000 7ffba5ac6740 1 --2- 172.21.15.79:0/3356130272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f83b4e7db0 0x55f83b4f2340 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:39.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.236+0000 7ffba5ac6740 1 --2- 172.21.15.79:0/3356130272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f83b4e5370 0x55f83b4f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:39.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.236+0000 7ffb7bfff640 0 client.17655 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:44:39.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.236+0000 7ffba5ac6740 1 --2- 172.21.15.79:0/3356130272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f83b4e2a40 0x55f83b4f1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:39.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.236+0000 7ffba5ac6740 1 -- 172.21.15.79:0/3356130272 >> 172.21.15.79:0/3356130272 conn(0x55f83b4d9730 msgr2=0x55f83b4ec2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:39.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.236+0000 7ffba5ac6740 1 -- 172.21.15.79:0/3356130272 shutdown_connections 2024-08-20T01:44:39.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.236+0000 7ffba5ac6740 1 -- 172.21.15.79:0/3356130272 wait complete. 2024-08-20T01:44:39.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.236+0000 7ffba5ac6740 20 client.17655 trim_cache size 0 max 16384 2024-08-20T01:44:39.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:44:39.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:44:39.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:44:39.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:44:39.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.236+0000 7ffba2ccc640 1 -- 172.21.15.79:0/2986416147 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ffb8c0b3bd0 msgr2=0x7ffb8c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:39.241 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.236+0000 7ffba2ccc640 1 --2- 172.21.15.79:0/2986416147 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ffb8c0b3bd0 0x7ffb8c0b6090 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ffb94005cc0 tx=0x7ffb94031790 comp rx=0 tx=0).stop 2024-08-20T01:44:39.241 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.236+0000 7ffba2ccc640 1 -- 172.21.15.79:0/2986416147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb9c101560 msgr2=0x7ffb9c198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:39.241 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.236+0000 7ffba2ccc640 1 --2- 172.21.15.79:0/2986416147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb9c101560 0x7ffb9c198950 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7ffb9000d950 tx=0x7ffb9000de10 comp rx=0 tx=0).stop 2024-08-20T01:44:39.241 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.237+0000 7ffba2ccc640 1 -- 172.21.15.79:0/2986416147 shutdown_connections 2024-08-20T01:44:39.241 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.237+0000 7ffba2ccc640 1 --2- 172.21.15.79:0/2986416147 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ffb8c0b3bd0 0x7ffb8c0b6090 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:39.242 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.237+0000 7ffba2ccc640 1 --2- 172.21.15.79:0/2986416147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb9c103070 0x7ffb9c199bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:39.242 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.237+0000 7ffba2ccc640 1 --2- 172.21.15.79:0/2986416147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb9c1026b0 0x7ffb9c198fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:39.242 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.237+0000 7ffba2ccc640 1 --2- 172.21.15.79:0/2986416147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb9c101560 0x7ffb9c198950 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:39.242 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.237+0000 7ffba2ccc640 1 -- 172.21.15.79:0/2986416147 >> 172.21.15.79:0/2986416147 conn(0x7ffb9c0fce40 msgr2=0x7ffb9c0fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:39.242 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.237+0000 7ffba2ccc640 1 -- 172.21.15.79:0/2986416147 shutdown_connections 2024-08-20T01:44:39.243 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:39.237+0000 7ffba2ccc640 1 -- 172.21.15.79:0/2986416147 wait complete. 2024-08-20T01:44:39.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:39 smithi079 ceph-mon[18656]: pgmap v567: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 29 MiB/s wr, 27 op/s 2024-08-20T01:44:40.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:39 smithi081 ceph-mon[22209]: pgmap v567: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 29 MiB/s wr, 27 op/s 2024-08-20T01:44:40.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:39 smithi175 ceph-mon[22392]: pgmap v567: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 29 MiB/s wr, 27 op/s 2024-08-20T01:44:41.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:41 smithi079 ceph-mon[18656]: pgmap v568: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-08-20T01:44:42.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:41 smithi081 ceph-mon[22209]: pgmap v568: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-08-20T01:44:42.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:41 smithi175 ceph-mon[22392]: pgmap v568: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-08-20T01:44:43.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:43 smithi079 ceph-mon[18656]: pgmap v569: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 27 MiB/s wr, 21 op/s 2024-08-20T01:44:43.941 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:43 smithi175 ceph-mon[22392]: pgmap v569: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 27 MiB/s wr, 21 op/s 2024-08-20T01:44:44.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:43 smithi081 ceph-mon[22209]: pgmap v569: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 27 MiB/s wr, 21 op/s 2024-08-20T01:44:45.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:45 smithi079 ceph-mon[18656]: pgmap v570: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 30 MiB/s wr, 26 op/s 2024-08-20T01:44:46.030 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:45 smithi081 ceph-mon[22209]: pgmap v570: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 30 MiB/s wr, 26 op/s 2024-08-20T01:44:46.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:45 smithi175 ceph-mon[22392]: pgmap v570: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 30 MiB/s wr, 26 op/s 2024-08-20T01:44:48.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:47 smithi081 ceph-mon[22209]: pgmap v571: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 27 MiB/s wr, 22 op/s 2024-08-20T01:44:48.114 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:47 smithi079 ceph-mon[18656]: pgmap v571: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 27 MiB/s wr, 22 op/s 2024-08-20T01:44:48.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:47 smithi175 ceph-mon[22392]: pgmap v571: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 27 MiB/s wr, 22 op/s 2024-08-20T01:44:50.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:49 smithi081 ceph-mon[22209]: pgmap v572: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 31 MiB/s wr, 26 op/s 2024-08-20T01:44:50.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:49 smithi175 ceph-mon[22392]: pgmap v572: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 31 MiB/s wr, 26 op/s 2024-08-20T01:44:50.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:49 smithi079 ceph-mon[18656]: pgmap v572: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 31 MiB/s wr, 26 op/s 2024-08-20T01:44:52.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:51 smithi081 ceph-mon[22209]: pgmap v573: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 31 MiB/s wr, 23 op/s 2024-08-20T01:44:52.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:51 smithi175 ceph-mon[22392]: pgmap v573: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 31 MiB/s wr, 23 op/s 2024-08-20T01:44:52.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:51 smithi079 ceph-mon[18656]: pgmap v573: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 31 MiB/s wr, 23 op/s 2024-08-20T01:44:52.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.334+0000 7f0598da1640 1 -- 172.21.15.79:0/3335998830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0594103070 msgr2=0x7f05941099f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:52.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.334+0000 7f0598da1640 1 --2- 172.21.15.79:0/3335998830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0594103070 0x7f05941099f0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f058c009cd0 tx=0x7f058c02a8e0 comp rx=0 tx=0).stop 2024-08-20T01:44:52.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.334+0000 7f0598da1640 1 -- 172.21.15.79:0/3335998830 shutdown_connections 2024-08-20T01:44:52.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.334+0000 7f0598da1640 1 --2- 172.21.15.79:0/3335998830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0594103070 0x7f05941099f0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:52.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.334+0000 7f0598da1640 1 --2- 172.21.15.79:0/3335998830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05941026b0 0x7f0594102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:52.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.334+0000 7f0598da1640 1 --2- 172.21.15.79:0/3335998830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0594101560 0x7f0594101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:52.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.334+0000 7f0598da1640 1 -- 172.21.15.79:0/3335998830 >> 172.21.15.79:0/3335998830 conn(0x7f05940fce40 msgr2=0x7f05940ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:52.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.334+0000 7f0598da1640 1 -- 172.21.15.79:0/3335998830 shutdown_connections 2024-08-20T01:44:52.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.334+0000 7f0598da1640 1 -- 172.21.15.79:0/3335998830 wait complete. 2024-08-20T01:44:52.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.335+0000 7f0598da1640 1 Processor -- start 2024-08-20T01:44:52.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.335+0000 7f0598da1640 1 -- start start 2024-08-20T01:44:52.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.335+0000 7f0598da1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0594101560 0x7f059406ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:52.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.335+0000 7f0598da1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05941026b0 0x7f059419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:52.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.335+0000 7f0598da1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0594103070 0x7f059419fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:52.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.335+0000 7f0598da1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f059410d0d0 con 0x7f0594101560 2024-08-20T01:44:52.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.335+0000 7f0598da1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f059410cf50 con 0x7f05941026b0 2024-08-20T01:44:52.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.335+0000 7f0598da1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f059410d250 con 0x7f0594103070 2024-08-20T01:44:52.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.336+0000 7f059259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0594101560 0x7f059406ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:52.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.336+0000 7f059259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0594101560 0x7f059406ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56778/0 (socket says 172.21.15.79:56778) 2024-08-20T01:44:52.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.336+0000 7f059259c640 1 -- 172.21.15.79:0/3884559847 learned_addr learned my addr 172.21.15.79:0/3884559847 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:52.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.336+0000 7f058bfff640 1 --2- 172.21.15.79:0/3884559847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05941026b0 0x7f059419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:52.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.336+0000 7f0592d9d640 1 --2- 172.21.15.79:0/3884559847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0594103070 0x7f059419fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:52.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.336+0000 7f059259c640 1 -- 172.21.15.79:0/3884559847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0594103070 msgr2=0x7f059419fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:52.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.336+0000 7f059259c640 1 --2- 172.21.15.79:0/3884559847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0594103070 0x7f059419fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:52.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.336+0000 7f059259c640 1 -- 172.21.15.79:0/3884559847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05941026b0 msgr2=0x7f059419d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:52.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.336+0000 7f059259c640 1 --2- 172.21.15.79:0/3884559847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05941026b0 0x7f059419d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:52.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.336+0000 7f059259c640 1 -- 172.21.15.79:0/3884559847 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05941a04f0 con 0x7f0594101560 2024-08-20T01:44:52.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.336+0000 7f059259c640 1 --2- 172.21.15.79:0/3884559847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0594101560 0x7f059406ae80 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f058400d950 tx=0x7f058400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:52.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.336+0000 7f058b7fe640 1 -- 172.21.15.79:0/3884559847 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0584017070 con 0x7f0594101560 2024-08-20T01:44:52.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.336+0000 7f058b7fe640 1 -- 172.21.15.79:0/3884559847 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0584009c30 con 0x7f0594101560 2024-08-20T01:44:52.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.336+0000 7f0598da1640 1 -- 172.21.15.79:0/3884559847 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05941a07e0 con 0x7f0594101560 2024-08-20T01:44:52.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.336+0000 7f058b7fe640 1 -- 172.21.15.79:0/3884559847 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f058400f620 con 0x7f0594101560 2024-08-20T01:44:52.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.336+0000 7f0598da1640 1 -- 172.21.15.79:0/3884559847 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05941a0d80 con 0x7f0594101560 2024-08-20T01:44:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.339+0000 7f059bc6a740 1 Processor -- start 2024-08-20T01:44:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.340+0000 7f059bc6a740 1 -- start start 2024-08-20T01:44:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.340+0000 7f058b7fe640 1 -- 172.21.15.79:0/3884559847 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f0584010460 con 0x7f0594101560 2024-08-20T01:44:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.340+0000 7f059bc6a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fd2a1bce0 0x560fd2a1e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.340+0000 7f059bc6a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560fd2a1e610 0x560fd2a20a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.340+0000 7f059bc6a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560fd2a21050 0x560fd2a23510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.340+0000 7f059bc6a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560fd298a360 con 0x560fd2a1e610 2024-08-20T01:44:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.340+0000 7f059bc6a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560fd2979860 con 0x560fd2a21050 2024-08-20T01:44:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.340+0000 7f059bc6a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560fd297d8a0 con 0x560fd2a1bce0 2024-08-20T01:44:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.340+0000 7f059259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560fd2a1e610 0x560fd2a20a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:52.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.340+0000 7f059259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560fd2a1e610 0x560fd2a20a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56794/0 (socket says 172.21.15.79:56794) 2024-08-20T01:44:52.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.340+0000 7f059259c640 1 -- 172.21.15.79:0/2009973008 learned_addr learned my addr 172.21.15.79:0/2009973008 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:52.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.340+0000 7f058bfff640 1 --2- 172.21.15.79:0/2009973008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560fd2a21050 0x560fd2a23510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:52.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.340+0000 7f0592d9d640 1 --2- 172.21.15.79:0/2009973008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fd2a1bce0 0x560fd2a1e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:52.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.341+0000 7f058bfff640 1 -- 172.21.15.79:0/2009973008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fd2a1bce0 msgr2=0x560fd2a1e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:52.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.341+0000 7f058bfff640 1 --2- 172.21.15.79:0/2009973008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fd2a1bce0 0x560fd2a1e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:52.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.341+0000 7f058bfff640 1 -- 172.21.15.79:0/2009973008 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560fd2a1e610 msgr2=0x560fd2a20a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:52.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.341+0000 7f058bfff640 1 --2- 172.21.15.79:0/2009973008 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560fd2a1e610 0x560fd2a20a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:52.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.341+0000 7f058bfff640 1 -- 172.21.15.79:0/2009973008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fd2920e40 con 0x560fd2a21050 2024-08-20T01:44:52.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.341+0000 7f059259c640 1 --2- 172.21.15.79:0/2009973008 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560fd2a1e610 0x560fd2a20a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:44:52.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.341+0000 7f058bfff640 1 --2- 172.21.15.79:0/2009973008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560fd2a21050 0x560fd2a23510 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f057c004630 tx=0x7f057c00bb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96120e279e78b365 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:52.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.341+0000 7f0588ff9640 1 -- 172.21.15.79:0/2009973008 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057c003bd0 con 0x560fd2a21050 2024-08-20T01:44:52.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.341+0000 7f058b7fe640 1 --2- 172.21.15.79:0/3884559847 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f05800b3c50 0x7f05800b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:52.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.341+0000 7f0588ff9640 1 -- 172.21.15.79:0/2009973008 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f057c015070 con 0x560fd2a21050 2024-08-20T01:44:52.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.341+0000 7f0588ff9640 1 -- 172.21.15.79:0/2009973008 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057c004bc0 con 0x560fd2a21050 2024-08-20T01:44:52.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.341+0000 7f0592d9d640 1 --2- 172.21.15.79:0/3884559847 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f05800b3c50 0x7f05800b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:52.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.341+0000 7f058b7fe640 1 -- 172.21.15.79:0/3884559847 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f05840e36d0 con 0x7f0594101560 2024-08-20T01:44:52.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.342+0000 7f059bc6a740 1 -- 172.21.15.79:0/2009973008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560fd2a21050 msgr2=0x560fd2a23510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:52.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.342+0000 7f059bc6a740 1 --2- 172.21.15.79:0/2009973008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560fd2a21050 0x560fd2a23510 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f057c004630 tx=0x7f057c00bb20 comp rx=0 tx=0).stop 2024-08-20T01:44:52.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.342+0000 7f0592d9d640 1 --2- 172.21.15.79:0/3884559847 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f05800b3c50 0x7f05800b6110 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f058c005e30 tx=0x7f058c031790 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:52.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.342+0000 7f059bc6a740 1 -- 172.21.15.79:0/2009973008 shutdown_connections 2024-08-20T01:44:52.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.342+0000 7f059bc6a740 1 --2- 172.21.15.79:0/2009973008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560fd2a21050 0x560fd2a23510 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:52.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.342+0000 7f059bc6a740 1 --2- 172.21.15.79:0/2009973008 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560fd2a1e610 0x560fd2a20a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:52.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.342+0000 7f059bc6a740 1 --2- 172.21.15.79:0/2009973008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fd2a1bce0 0x560fd2a1e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:52.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.342+0000 7f059bc6a740 1 -- 172.21.15.79:0/2009973008 >> 172.21.15.79:0/2009973008 conn(0x560fd2a12a20 msgr2=0x560fd2a137b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:52.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.342+0000 7f059bc6a740 1 -- 172.21.15.79:0/2009973008 shutdown_connections 2024-08-20T01:44:52.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.342+0000 7f059bc6a740 1 -- 172.21.15.79:0/2009973008 wait complete. 2024-08-20T01:44:52.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.342+0000 7f059bc6a740 1 -- start start 2024-08-20T01:44:52.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.343+0000 7f059bc6a740 1 Processor -- start 2024-08-20T01:44:52.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.343+0000 7f059bc6a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560fd2a1bce0 0x560fd2a25500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:52.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.343+0000 7f059bc6a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560fd2a1e610 0x560fd2a25ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:52.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.343+0000 7f059bc6a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fd2a21050 0x560fd2a26770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:52.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.343+0000 7f059bc6a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560fd28b2ab0 con 0x560fd2a1bce0 2024-08-20T01:44:52.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.343+0000 7f059bc6a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560fd2900780 con 0x560fd2a1e610 2024-08-20T01:44:52.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.343+0000 7f059bc6a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560fd2a24030 con 0x560fd2a21050 2024-08-20T01:44:52.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.343+0000 7f059bc6a740 10 client.0 _ll_register_callbacks cb 0x560fd2688a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:44:52.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.343+0000 7f059259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560fd2a1bce0 0x560fd2a25500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:52.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.343+0000 7f059259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560fd2a1bce0 0x560fd2a25500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56804/0 (socket says 172.21.15.79:56804) 2024-08-20T01:44:52.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.343+0000 7f059259c640 1 -- 172.21.15.79:0/4250042513 learned_addr learned my addr 172.21.15.79:0/4250042513 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:52.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.343+0000 7f058bfff640 1 --2- 172.21.15.79:0/4250042513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560fd2a1e610 0x560fd2a25ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:52.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.343+0000 7f0592d9d640 1 --2- 172.21.15.79:0/4250042513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fd2a21050 0x560fd2a26770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.343+0000 7f059259c640 1 -- 172.21.15.79:0/4250042513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fd2a21050 msgr2=0x560fd2a26770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.343+0000 7f059259c640 1 --2- 172.21.15.79:0/4250042513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fd2a21050 0x560fd2a26770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.343+0000 7f059259c640 1 -- 172.21.15.79:0/4250042513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560fd2a1e610 msgr2=0x560fd2a25ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.343+0000 7f059259c640 1 --2- 172.21.15.79:0/4250042513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560fd2a1e610 0x560fd2a25ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.343+0000 7f059259c640 1 -- 172.21.15.79:0/4250042513 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fd26dc790 con 0x560fd2a1bce0 2024-08-20T01:44:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.344+0000 7f059259c640 1 --2- 172.21.15.79:0/4250042513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560fd2a1bce0 0x560fd2a25500 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f05840058c0 tx=0x7f0584010f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fea8b5c171ca65c9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.344+0000 7f0579ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:44:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.344+0000 7f0579ffb640 1 -- 172.21.15.79:0/4250042513 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0584020030 con 0x560fd2a1bce0 2024-08-20T01:44:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.344+0000 7f0579ffb640 1 -- 172.21.15.79:0/4250042513 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f05840a6cd0 con 0x560fd2a1bce0 2024-08-20T01:44:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.344+0000 7f059bc6a740 1 -- 172.21.15.79:0/4250042513 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560fd2928e00 con 0x560fd2a1bce0 2024-08-20T01:44:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.344+0000 7f0579ffb640 1 -- 172.21.15.79:0/4250042513 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f05840a9e50 con 0x560fd2a1bce0 2024-08-20T01:44:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.344+0000 7f059bc6a740 10 client.17667 fetch_fsmap learned FSMap version 41 2024-08-20T01:44:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.344+0000 7f059bc6a740 1 -- 172.21.15.79:0/4250042513 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x560fd2755620 con 0x560fd2a1bce0 2024-08-20T01:44:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.344+0000 7f0579ffb640 1 -- 172.21.15.79:0/4250042513 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x560fd2928e00 con 0x560fd2a1bce0 2024-08-20T01:44:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.345+0000 7f0579ffb640 1 -- 172.21.15.79:0/4250042513 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 41) ==== 8386+0+0 (secure 0 0 0) 0x7f05840a6970 con 0x560fd2a1bce0 2024-08-20T01:44:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.345+0000 7f059bc6a740 10 client.17667 fetch_fsmap finished waiting for FSMap version 41 2024-08-20T01:44:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.345+0000 7f059bc6a740 10 client.17667 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:44:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.345+0000 7f059bc6a740 20 client.17667 populate_metadata read hostname 'smithi079' 2024-08-20T01:44:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.345+0000 7f059bc6a740 1 --2- 172.21.15.79:0/4250042513 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560fd2a30e70 0x560fd2a33310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.345+0000 7f059bc6a740 4 client.17667 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:44:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.345+0000 7f059bc6a740 1 -- 172.21.15.79:0/4250042513 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560fd298c2b0 con 0x560fd2a30e70 2024-08-20T01:44:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.345+0000 7f058bfff640 1 --2- 172.21.15.79:0/4250042513 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560fd2a30e70 0x560fd2a33310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.346+0000 7f058bfff640 1 --2- 172.21.15.79:0/4250042513 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560fd2a30e70 0x560fd2a33310 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88780444dce2a0d3 server_cookie=57d09fbd240d85f4 in_seq=0 out_seq=0 2024-08-20T01:44:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.346+0000 7f0579ffb640 10 client.17667 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:44:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.346+0000 7f0579ffb640 1 -- 172.21.15.79:0/4250042513 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560fd298c2b0 con 0x560fd2a30e70 2024-08-20T01:44:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.346+0000 7f0579ffb640 10 client.17667 handle_command_reply: tid=0 2024-08-20T01:44:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.346+0000 7f059bc6a740 1 client.17667 shutdown 2024-08-20T01:44:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.346+0000 7f059bc6a740 1 -- 172.21.15.79:0/4250042513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560fd2a1bce0 msgr2=0x560fd2a25500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.346+0000 7f059bc6a740 1 --2- 172.21.15.79:0/4250042513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560fd2a1bce0 0x560fd2a25500 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f05840058c0 tx=0x7f0584010f80 comp rx=0 tx=0).stop 2024-08-20T01:44:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.346+0000 7f059bc6a740 1 -- 172.21.15.79:0/4250042513 shutdown_connections 2024-08-20T01:44:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.346+0000 7f059bc6a740 1 --2- 172.21.15.79:0/4250042513 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560fd2a30e70 0x560fd2a33310 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.346+0000 7f0579ffb640 0 client.17667 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:44:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.346+0000 7f059bc6a740 1 --2- 172.21.15.79:0/4250042513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fd2a21050 0x560fd2a26770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.346+0000 7f059bc6a740 1 --2- 172.21.15.79:0/4250042513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560fd2a1e610 0x560fd2a25ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.346+0000 7f059bc6a740 1 --2- 172.21.15.79:0/4250042513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560fd2a1bce0 0x560fd2a25500 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.346+0000 7f059bc6a740 1 -- 172.21.15.79:0/4250042513 >> 172.21.15.79:0/4250042513 conn(0x560fd2a12a20 msgr2=0x560fd2a11ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.346+0000 7f059bc6a740 1 -- 172.21.15.79:0/4250042513 shutdown_connections 2024-08-20T01:44:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.347+0000 7f059bc6a740 1 -- 172.21.15.79:0/4250042513 wait complete. 2024-08-20T01:44:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.347+0000 7f059bc6a740 20 client.17667 trim_cache size 0 max 16384 2024-08-20T01:44:52.371 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.368+0000 7f059bc6a740 1 Processor -- start 2024-08-20T01:44:52.371 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.368+0000 7f059bc6a740 1 -- start start 2024-08-20T01:44:52.371 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.368+0000 7f059bc6a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560fd2a1bce0 0x560fd2a25270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:52.371 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.368+0000 7f059bc6a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560fd2a1e610 0x560fd2a229d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:52.371 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.368+0000 7f059bc6a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fd2a21050 0x560fd2a22f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:52.371 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.368+0000 7f059bc6a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f05941a7830 con 0x560fd2a1e610 2024-08-20T01:44:52.372 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.368+0000 7f059bc6a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f05941a9490 con 0x560fd2a1bce0 2024-08-20T01:44:52.372 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.368+0000 7f059bc6a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f05941a7f00 con 0x560fd2a21050 2024-08-20T01:44:52.372 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.368+0000 7f058bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560fd2a1e610 0x560fd2a229d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:52.372 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.368+0000 7f058bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560fd2a1e610 0x560fd2a229d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56810/0 (socket says 172.21.15.79:56810) 2024-08-20T01:44:52.372 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.368+0000 7f058bfff640 1 -- 172.21.15.79:0/2338000757 learned_addr learned my addr 172.21.15.79:0/2338000757 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:52.372 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.368+0000 7f059259c640 1 --2- 172.21.15.79:0/2338000757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560fd2a1bce0 0x560fd2a25270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:52.372 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.368+0000 7f0592d9d640 1 --2- 172.21.15.79:0/2338000757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fd2a21050 0x560fd2a22f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:52.372 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.368+0000 7f058bfff640 1 -- 172.21.15.79:0/2338000757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fd2a21050 msgr2=0x560fd2a22f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:52.372 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.368+0000 7f058bfff640 1 --2- 172.21.15.79:0/2338000757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fd2a21050 0x560fd2a22f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:52.372 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.368+0000 7f058bfff640 1 -- 172.21.15.79:0/2338000757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560fd2a1bce0 msgr2=0x560fd2a25270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:52.372 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.368+0000 7f058bfff640 1 --2- 172.21.15.79:0/2338000757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560fd2a1bce0 0x560fd2a25270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:52.372 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.368+0000 7f058bfff640 1 -- 172.21.15.79:0/2338000757 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fd2a20d70 con 0x560fd2a1e610 2024-08-20T01:44:52.373 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.368+0000 7f0592d9d640 1 --2- 172.21.15.79:0/2338000757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fd2a21050 0x560fd2a22f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:44:52.373 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.368+0000 7f058bfff640 1 --2- 172.21.15.79:0/2338000757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560fd2a1e610 0x560fd2a229d0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f057c005d00 tx=0x7f057c004560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68fa380e6305539e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:52.373 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.369+0000 7f057bfff640 1 -- 172.21.15.79:0/2338000757 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057c011440 con 0x560fd2a1e610 2024-08-20T01:44:52.373 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.369+0000 7f057bfff640 1 -- 172.21.15.79:0/2338000757 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f057c015040 con 0x560fd2a1e610 2024-08-20T01:44:52.373 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.369+0000 7f057bfff640 1 -- 172.21.15.79:0/2338000757 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057c019810 con 0x560fd2a1e610 2024-08-20T01:44:52.376 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.370+0000 7f059bc6a740 1 -- 172.21.15.79:0/2338000757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560fd2a1e610 msgr2=0x560fd2a229d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:52.376 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.370+0000 7f059bc6a740 1 --2- 172.21.15.79:0/2338000757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560fd2a1e610 0x560fd2a229d0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f057c005d00 tx=0x7f057c004560 comp rx=0 tx=0).stop 2024-08-20T01:44:52.376 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.370+0000 7f059bc6a740 1 -- 172.21.15.79:0/2338000757 shutdown_connections 2024-08-20T01:44:52.376 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.370+0000 7f059bc6a740 1 --2- 172.21.15.79:0/2338000757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fd2a21050 0x560fd2a22f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:52.376 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.370+0000 7f059bc6a740 1 --2- 172.21.15.79:0/2338000757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560fd2a1e610 0x560fd2a229d0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:52.376 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.370+0000 7f059bc6a740 1 --2- 172.21.15.79:0/2338000757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560fd2a1bce0 0x560fd2a25270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:52.377 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.370+0000 7f059bc6a740 1 -- 172.21.15.79:0/2338000757 >> 172.21.15.79:0/2338000757 conn(0x560fd2a12a20 msgr2=0x560fd2a16e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:52.377 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.370+0000 7f059bc6a740 1 -- 172.21.15.79:0/2338000757 shutdown_connections 2024-08-20T01:44:52.377 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.370+0000 7f059bc6a740 1 -- 172.21.15.79:0/2338000757 wait complete. 2024-08-20T01:44:52.377 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.370+0000 7f059bc6a740 1 -- start start 2024-08-20T01:44:52.377 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.370+0000 7f059bc6a740 1 Processor -- start 2024-08-20T01:44:52.377 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.370+0000 7f059bc6a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560fd2a1bce0 0x560fd2a29ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:52.377 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.370+0000 7f059bc6a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fd2a1e610 0x560fd2a2a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:52.377 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.370+0000 7f059bc6a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560fd2a21050 0x560fd2a2b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:52.377 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.370+0000 7f059bc6a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f05941a8d00 con 0x560fd2a21050 2024-08-20T01:44:52.377 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.370+0000 7f059bc6a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f05941a85d0 con 0x560fd2a1bce0 2024-08-20T01:44:52.377 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.370+0000 7f059bc6a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f05941a5810 con 0x560fd2a1e610 2024-08-20T01:44:52.378 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.370+0000 7f059bc6a740 10 client.0 _ll_register_callbacks cb 0x7f05840e9240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:44:52.378 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.370+0000 7f0592d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560fd2a21050 0x560fd2a2b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:52.378 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.371+0000 7f059259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560fd2a1bce0 0x560fd2a29ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:52.378 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.371+0000 7f0592d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560fd2a21050 0x560fd2a2b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56826/0 (socket says 172.21.15.79:56826) 2024-08-20T01:44:52.378 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.371+0000 7f0592d9d640 1 -- 172.21.15.79:0/4238183627 learned_addr learned my addr 172.21.15.79:0/4238183627 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:52.378 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.371+0000 7f058bfff640 1 --2- 172.21.15.79:0/4238183627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fd2a1e610 0x560fd2a2a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:52.378 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.371+0000 7f059259c640 1 -- 172.21.15.79:0/4238183627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fd2a1e610 msgr2=0x560fd2a2a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:52.378 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.371+0000 7f059259c640 1 --2- 172.21.15.79:0/4238183627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fd2a1e610 0x560fd2a2a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:52.378 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.371+0000 7f059259c640 1 -- 172.21.15.79:0/4238183627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560fd2a21050 msgr2=0x560fd2a2b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:52.378 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.371+0000 7f059259c640 1 --2- 172.21.15.79:0/4238183627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560fd2a21050 0x560fd2a2b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:52.378 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.371+0000 7f059259c640 1 -- 172.21.15.79:0/4238183627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fd2a2b8b0 con 0x560fd2a1bce0 2024-08-20T01:44:52.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.371+0000 7f059259c640 1 --2- 172.21.15.79:0/4238183627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560fd2a1bce0 0x560fd2a29ea0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f05840e1550 tx=0x7f05840cbd60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2be3aff5b2dc2dc8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:52.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.371+0000 7f0579ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:44:52.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.371+0000 7f0579ffb640 1 -- 172.21.15.79:0/4238183627 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0584020070 con 0x560fd2a1bce0 2024-08-20T01:44:52.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.371+0000 7f0579ffb640 1 -- 172.21.15.79:0/4238183627 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f05840a6cd0 con 0x560fd2a1bce0 2024-08-20T01:44:52.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.371+0000 7f059bc6a740 1 -- 172.21.15.79:0/4238183627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f057c015040 con 0x560fd2a1bce0 2024-08-20T01:44:52.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.371+0000 7f0579ffb640 1 -- 172.21.15.79:0/4238183627 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f05840c6070 con 0x560fd2a1bce0 2024-08-20T01:44:52.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.371+0000 7f059bc6a740 10 client.26702 fetch_fsmap learned FSMap version 41 2024-08-20T01:44:52.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.371+0000 7f059bc6a740 1 -- 172.21.15.79:0/4238183627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x560fd2a2cbe0 con 0x560fd2a1bce0 2024-08-20T01:44:52.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.372+0000 7f0579ffb640 1 -- 172.21.15.79:0/4238183627 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f057c015040 con 0x560fd2a1bce0 2024-08-20T01:44:52.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.372+0000 7f0579ffb640 1 -- 172.21.15.79:0/4238183627 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 41) ==== 8386+0+0 (secure 0 0 0) 0x7f05840a6050 con 0x560fd2a1bce0 2024-08-20T01:44:52.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.372+0000 7f059bc6a740 10 client.26702 fetch_fsmap finished waiting for FSMap version 41 2024-08-20T01:44:52.379 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.372+0000 7f059bc6a740 10 client.26702 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:44:52.380 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.372+0000 7f059bc6a740 20 client.26702 populate_metadata read hostname 'smithi079' 2024-08-20T01:44:52.380 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.372+0000 7f059bc6a740 1 --2- 172.21.15.79:0/4238183627 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560fd2a30e70 0x560fd2a9dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:52.380 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.372+0000 7f059bc6a740 4 client.26702 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:44:52.380 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.372+0000 7f059bc6a740 1 -- 172.21.15.79:0/4238183627 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560fd2987d50 con 0x560fd2a30e70 2024-08-20T01:44:52.380 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.372+0000 7f058bfff640 1 --2- 172.21.15.79:0/4238183627 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560fd2a30e70 0x560fd2a9dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:52.380 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.373+0000 7f0579ffb640 10 client.26702 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:44:52.380 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.373+0000 7f058bfff640 1 --2- 172.21.15.79:0/4238183627 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560fd2a30e70 0x560fd2a9dbc0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a9ca2afd8898103 server_cookie=da937458a32c9d6c in_seq=0 out_seq=0 2024-08-20T01:44:52.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.379+0000 7f0579ffb640 1 -- 172.21.15.79:0/4238183627 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560fd2987d50 con 0x560fd2a30e70 2024-08-20T01:44:52.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.379+0000 7f0579ffb640 10 client.26702 handle_command_reply: tid=0 2024-08-20T01:44:52.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.379+0000 7f059bc6a740 1 client.26702 shutdown 2024-08-20T01:44:52.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.380+0000 7f059bc6a740 1 -- 172.21.15.79:0/4238183627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560fd2a1bce0 msgr2=0x560fd2a29ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:52.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.380+0000 7f059bc6a740 1 --2- 172.21.15.79:0/4238183627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560fd2a1bce0 0x560fd2a29ea0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f05840e1550 tx=0x7f05840cbd60 comp rx=0 tx=0).stop 2024-08-20T01:44:52.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.380+0000 7f059bc6a740 1 -- 172.21.15.79:0/4238183627 shutdown_connections 2024-08-20T01:44:52.383 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.380+0000 7f059bc6a740 1 --2- 172.21.15.79:0/4238183627 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560fd2a30e70 0x560fd2a9dbc0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:52.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.380+0000 7f059bc6a740 1 --2- 172.21.15.79:0/4238183627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560fd2a21050 0x560fd2a2b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:52.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.380+0000 7f059bc6a740 1 --2- 172.21.15.79:0/4238183627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560fd2a1e610 0x560fd2a2a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:52.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.380+0000 7f0579ffb640 0 client.26702 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:44:52.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.380+0000 7f059bc6a740 1 --2- 172.21.15.79:0/4238183627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560fd2a1bce0 0x560fd2a29ea0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:52.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.380+0000 7f059bc6a740 1 -- 172.21.15.79:0/4238183627 >> 172.21.15.79:0/4238183627 conn(0x560fd2a12a20 msgr2=0x560fd2a16a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:52.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.380+0000 7f059bc6a740 1 -- 172.21.15.79:0/4238183627 shutdown_connections 2024-08-20T01:44:52.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.380+0000 7f059bc6a740 1 -- 172.21.15.79:0/4238183627 wait complete. 2024-08-20T01:44:52.384 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.380+0000 7f059bc6a740 20 client.26702 trim_cache size 0 max 16384 2024-08-20T01:44:52.385 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:44:52.385 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:44:52.385 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:44:52.385 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:44:52.386 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.380+0000 7f0598da1640 1 -- 172.21.15.79:0/3884559847 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f05800b3c50 msgr2=0x7f05800b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:52.387 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.381+0000 7f0598da1640 1 --2- 172.21.15.79:0/3884559847 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f05800b3c50 0x7f05800b6110 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f058c005e30 tx=0x7f058c031790 comp rx=0 tx=0).stop 2024-08-20T01:44:52.387 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.381+0000 7f0598da1640 1 -- 172.21.15.79:0/3884559847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0594101560 msgr2=0x7f059406ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:52.387 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.381+0000 7f0598da1640 1 --2- 172.21.15.79:0/3884559847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0594101560 0x7f059406ae80 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f058400d950 tx=0x7f058400de10 comp rx=0 tx=0).stop 2024-08-20T01:44:52.387 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.381+0000 7f0598da1640 1 -- 172.21.15.79:0/3884559847 shutdown_connections 2024-08-20T01:44:52.387 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.381+0000 7f0598da1640 1 --2- 172.21.15.79:0/3884559847 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f05800b3c50 0x7f05800b6110 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:52.387 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.381+0000 7f0598da1640 1 --2- 172.21.15.79:0/3884559847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0594103070 0x7f059419fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:52.387 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.381+0000 7f0598da1640 1 --2- 172.21.15.79:0/3884559847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05941026b0 0x7f059419d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:52.387 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.381+0000 7f0598da1640 1 --2- 172.21.15.79:0/3884559847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0594101560 0x7f059406ae80 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:52.387 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.381+0000 7f0598da1640 1 -- 172.21.15.79:0/3884559847 >> 172.21.15.79:0/3884559847 conn(0x7f05940fce40 msgr2=0x7f0594105a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:52.387 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.381+0000 7f0598da1640 1 -- 172.21.15.79:0/3884559847 shutdown_connections 2024-08-20T01:44:52.387 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:44:52.381+0000 7f0598da1640 1 -- 172.21.15.79:0/3884559847 wait complete. 2024-08-20T01:44:54.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:53 smithi081 ceph-mon[22209]: pgmap v574: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 22 op/s 2024-08-20T01:44:54.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:53 smithi175 ceph-mon[22392]: pgmap v574: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 22 op/s 2024-08-20T01:44:54.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:53 smithi079 ceph-mon[18656]: pgmap v574: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 22 op/s 2024-08-20T01:44:56.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:55 smithi081 ceph-mon[22209]: pgmap v575: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 33 MiB/s wr, 26 op/s 2024-08-20T01:44:56.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:55 smithi175 ceph-mon[22392]: pgmap v575: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 33 MiB/s wr, 26 op/s 2024-08-20T01:44:56.171 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:44:56.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:55 smithi079 ceph-mon[18656]: pgmap v575: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 33 MiB/s wr, 26 op/s 2024-08-20T01:44:56.590 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:44:57.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.497+0000 7fcd8aace640 1 -- 172.21.15.79:0/591699844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd841042c0 msgr2=0x7fcd8410c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:57.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.497+0000 7fcd8aace640 1 --2- 172.21.15.79:0/591699844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd841042c0 0x7fcd8410c7b0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fcd70009900 tx=0x7fcd7002a410 comp rx=0 tx=0).stop 2024-08-20T01:44:57.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.497+0000 7fcd8aace640 1 -- 172.21.15.79:0/591699844 shutdown_connections 2024-08-20T01:44:57.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.497+0000 7fcd8aace640 1 --2- 172.21.15.79:0/591699844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd8410ce00 0x7fcd8410f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:57.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.497+0000 7fcd8aace640 1 --2- 172.21.15.79:0/591699844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd841042c0 0x7fcd8410c7b0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:57.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.497+0000 7fcd8aace640 1 --2- 172.21.15.79:0/591699844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd841039a0 0x7fcd84103d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:57.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.497+0000 7fcd8aace640 1 -- 172.21.15.79:0/591699844 >> 172.21.15.79:0/591699844 conn(0x7fcd840fd400 msgr2=0x7fcd840ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:57.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.497+0000 7fcd8aace640 1 -- 172.21.15.79:0/591699844 shutdown_connections 2024-08-20T01:44:57.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.497+0000 7fcd8aace640 1 -- 172.21.15.79:0/591699844 wait complete. 2024-08-20T01:44:57.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.498+0000 7fcd8aace640 1 Processor -- start 2024-08-20T01:44:57.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.498+0000 7fcd8aace640 1 -- start start 2024-08-20T01:44:57.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.498+0000 7fcd8aace640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd841039a0 0x7fcd84198ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:57.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.498+0000 7fcd8aace640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd841042c0 0x7fcd84199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:57.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.498+0000 7fcd8aace640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd8410ce00 0x7fcd8419e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:57.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.498+0000 7fcd8aace640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcd84112960 con 0x7fcd841039a0 2024-08-20T01:44:57.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.498+0000 7fcd8aace640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcd841127e0 con 0x7fcd8410ce00 2024-08-20T01:44:57.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.498+0000 7fcd8aace640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcd84112ae0 con 0x7fcd841042c0 2024-08-20T01:44:57.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.498+0000 7fcd8886a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd841039a0 0x7fcd84198ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:57.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.498+0000 7fcd8906b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd8410ce00 0x7fcd8419e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:57.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.498+0000 7fcd8906b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd8410ce00 0x7fcd8419e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:42664/0 (socket says 172.21.15.79:42664) 2024-08-20T01:44:57.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.498+0000 7fcd8906b640 1 -- 172.21.15.79:0/3629024864 learned_addr learned my addr 172.21.15.79:0/3629024864 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:57.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.498+0000 7fcd8886a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd841039a0 0x7fcd84198ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56838/0 (socket says 172.21.15.79:56838) 2024-08-20T01:44:57.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.498+0000 7fcd83fff640 1 --2- 172.21.15.79:0/3629024864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd841042c0 0x7fcd84199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:57.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.499+0000 7fcd8886a640 1 -- 172.21.15.79:0/3629024864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd841042c0 msgr2=0x7fcd84199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:57.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.499+0000 7fcd8886a640 1 --2- 172.21.15.79:0/3629024864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd841042c0 0x7fcd84199430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:57.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.499+0000 7fcd8886a640 1 -- 172.21.15.79:0/3629024864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd8410ce00 msgr2=0x7fcd8419e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:57.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.499+0000 7fcd8886a640 1 --2- 172.21.15.79:0/3629024864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd8410ce00 0x7fcd8419e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:57.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.499+0000 7fcd8886a640 1 -- 172.21.15.79:0/3629024864 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd8419efa0 con 0x7fcd841039a0 2024-08-20T01:44:57.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.499+0000 7fcd8906b640 1 --2- 172.21.15.79:0/3629024864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd8410ce00 0x7fcd8419e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:44:57.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.499+0000 7fcd8886a640 1 --2- 172.21.15.79:0/3629024864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd841039a0 0x7fcd84198ef0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fcd7800b3f0 tx=0x7fcd7800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:57.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.499+0000 7fcd81ffb640 1 -- 172.21.15.79:0/3629024864 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd78015020 con 0x7fcd841039a0 2024-08-20T01:44:57.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.499+0000 7fcd81ffb640 1 -- 172.21.15.79:0/3629024864 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd78011cc0 con 0x7fcd841039a0 2024-08-20T01:44:57.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.499+0000 7fcd8aace640 1 -- 172.21.15.79:0/3629024864 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd8419f290 con 0x7fcd841039a0 2024-08-20T01:44:57.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.499+0000 7fcd81ffb640 1 -- 172.21.15.79:0/3629024864 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd78010cc0 con 0x7fcd841039a0 2024-08-20T01:44:57.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.500+0000 7fcd8aace640 1 -- 172.21.15.79:0/3629024864 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd841a59d0 con 0x7fcd841039a0 2024-08-20T01:44:57.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.502+0000 7fcd81ffb640 1 -- 172.21.15.79:0/3629024864 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fcd78018020 con 0x7fcd841039a0 2024-08-20T01:44:57.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.503+0000 7fcd81ffb640 1 --2- 172.21.15.79:0/3629024864 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fcd740b3c50 0x7fcd740b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:57.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.503+0000 7fcd83fff640 1 --2- 172.21.15.79:0/3629024864 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fcd740b3c50 0x7fcd740b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:57.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.503+0000 7fcd81ffb640 1 -- 172.21.15.79:0/3629024864 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fcd780e32f0 con 0x7fcd841039a0 2024-08-20T01:44:57.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.504+0000 7fcd83fff640 1 --2- 172.21.15.79:0/3629024864 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fcd740b3c50 0x7fcd740b6110 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fcd70005ec0 tx=0x7fcd700058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:57.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.536+0000 7fcd8cec7740 1 Processor -- start 2024-08-20T01:44:57.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.536+0000 7fcd8cec7740 1 -- start start 2024-08-20T01:44:57.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.536+0000 7fcd8cec7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555a1e7a46e0 0x555a1e7a4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:57.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.536+0000 7fcd8cec7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1e7a5000 0x555a1e7b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:57.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.536+0000 7fcd8cec7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1e7b53a0 0x555a1e7b7790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:57.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.536+0000 7fcd8cec7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555a1e71b8e0 con 0x555a1e7a5000 2024-08-20T01:44:57.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.536+0000 7fcd8cec7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555a1e70ade0 con 0x555a1e7b53a0 2024-08-20T01:44:57.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.536+0000 7fcd8cec7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555a1e70ee20 con 0x555a1e7a46e0 2024-08-20T01:44:57.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.537+0000 7fcd83fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1e7a5000 0x555a1e7b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:57.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.537+0000 7fcd83fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1e7a5000 0x555a1e7b4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56846/0 (socket says 172.21.15.79:56846) 2024-08-20T01:44:57.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.537+0000 7fcd83fff640 1 -- 172.21.15.79:0/4119884428 learned_addr learned my addr 172.21.15.79:0/4119884428 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:57.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.537+0000 7fcd8906b640 1 --2- 172.21.15.79:0/4119884428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1e7b53a0 0x555a1e7b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:57.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.537+0000 7fcd8886a640 1 --2- 172.21.15.79:0/4119884428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555a1e7a46e0 0x555a1e7a4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:57.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.537+0000 7fcd83fff640 1 -- 172.21.15.79:0/4119884428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555a1e7a46e0 msgr2=0x555a1e7a4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:57.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.537+0000 7fcd83fff640 1 --2- 172.21.15.79:0/4119884428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555a1e7a46e0 0x555a1e7a4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:57.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.537+0000 7fcd83fff640 1 -- 172.21.15.79:0/4119884428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1e7b53a0 msgr2=0x555a1e7b7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:57.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.537+0000 7fcd83fff640 1 --2- 172.21.15.79:0/4119884428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1e7b53a0 0x555a1e7b7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:57.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.537+0000 7fcd83fff640 1 -- 172.21.15.79:0/4119884428 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a1e46a650 con 0x555a1e7a5000 2024-08-20T01:44:57.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.537+0000 7fcd8886a640 1 --2- 172.21.15.79:0/4119884428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555a1e7a46e0 0x555a1e7a4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:44:57.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.537+0000 7fcd83fff640 1 --2- 172.21.15.79:0/4119884428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1e7a5000 0x555a1e7b4e60 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fcd8406b650 tx=0x7fcd7003e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cc0dbda00407a29 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:57.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.537+0000 7fcd6effd640 1 -- 172.21.15.79:0/4119884428 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7004d070 con 0x555a1e7a5000 2024-08-20T01:44:57.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.538+0000 7fcd6effd640 1 -- 172.21.15.79:0/4119884428 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd70004240 con 0x555a1e7a5000 2024-08-20T01:44:57.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.538+0000 7fcd6effd640 1 -- 172.21.15.79:0/4119884428 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd70035050 con 0x555a1e7a5000 2024-08-20T01:44:57.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.538+0000 7fcd8cec7740 1 -- 172.21.15.79:0/4119884428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1e7a5000 msgr2=0x555a1e7b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:57.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.538+0000 7fcd8cec7740 1 --2- 172.21.15.79:0/4119884428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1e7a5000 0x555a1e7b4e60 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fcd8406b650 tx=0x7fcd7003e000 comp rx=0 tx=0).stop 2024-08-20T01:44:57.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.538+0000 7fcd8cec7740 1 -- 172.21.15.79:0/4119884428 shutdown_connections 2024-08-20T01:44:57.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.538+0000 7fcd8cec7740 1 --2- 172.21.15.79:0/4119884428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1e7b53a0 0x555a1e7b7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:57.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.538+0000 7fcd8cec7740 1 --2- 172.21.15.79:0/4119884428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1e7a5000 0x555a1e7b4e60 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:57.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.538+0000 7fcd8cec7740 1 --2- 172.21.15.79:0/4119884428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555a1e7a46e0 0x555a1e7a4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:57.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.538+0000 7fcd8cec7740 1 -- 172.21.15.79:0/4119884428 >> 172.21.15.79:0/4119884428 conn(0x555a1e7a2510 msgr2=0x555a1e7a36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:57.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.538+0000 7fcd8cec7740 1 -- 172.21.15.79:0/4119884428 shutdown_connections 2024-08-20T01:44:57.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.538+0000 7fcd8cec7740 1 -- 172.21.15.79:0/4119884428 wait complete. 2024-08-20T01:44:57.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.539+0000 7fcd8cec7740 1 -- start start 2024-08-20T01:44:57.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.539+0000 7fcd8cec7740 1 Processor -- start 2024-08-20T01:44:57.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.539+0000 7fcd8cec7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1e7a46e0 0x555a1e7b2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:57.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.539+0000 7fcd8cec7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555a1e7a5000 0x555a1e7b2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:57.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.539+0000 7fcd8cec7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1e7b53a0 0x555a1e7b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:57.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.539+0000 7fcd8cec7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555a1e56d700 con 0x555a1e7a46e0 2024-08-20T01:44:57.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.539+0000 7fcd8cec7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555a1e6917c0 con 0x555a1e7b53a0 2024-08-20T01:44:57.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.539+0000 7fcd8cec7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555a1e7b8040 con 0x555a1e7a5000 2024-08-20T01:44:57.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.540+0000 7fcd8cec7740 10 client.0 _ll_register_callbacks cb 0x555a1e7046b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:44:57.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.540+0000 7fcd8886a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1e7a46e0 0x555a1e7b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:57.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.540+0000 7fcd8886a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1e7a46e0 0x555a1e7b2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56854/0 (socket says 172.21.15.79:56854) 2024-08-20T01:44:57.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.540+0000 7fcd8886a640 1 -- 172.21.15.79:0/2869044422 learned_addr learned my addr 172.21.15.79:0/2869044422 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:57.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.540+0000 7fcd8886a640 1 -- 172.21.15.79:0/2869044422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555a1e7a5000 msgr2=0x555a1e7b2840 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:44:57.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.540+0000 7fcd8886a640 1 --2- 172.21.15.79:0/2869044422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555a1e7a5000 0x555a1e7b2840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:57.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.540+0000 7fcd8886a640 1 -- 172.21.15.79:0/2869044422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1e7b53a0 msgr2=0x555a1e7b2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:57.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.540+0000 7fcd8886a640 1 --2- 172.21.15.79:0/2869044422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1e7b53a0 0x555a1e7b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:57.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.540+0000 7fcd8886a640 1 -- 172.21.15.79:0/2869044422 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a1e7c1420 con 0x555a1e7a46e0 2024-08-20T01:44:57.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.540+0000 7fcd8886a640 1 --2- 172.21.15.79:0/2869044422 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1e7a46e0 0x555a1e7b2300 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fcd780e0e00 tx=0x7fcd780a9ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd06b79a53e8d71 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:57.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.540+0000 7fcd63fff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:44:57.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.540+0000 7fcd63fff640 1 -- 172.21.15.79:0/2869044422 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd780c3020 con 0x555a1e7a46e0 2024-08-20T01:44:57.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.540+0000 7fcd63fff640 1 -- 172.21.15.79:0/2869044422 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fcd780a64e0 con 0x555a1e7a46e0 2024-08-20T01:44:57.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.541+0000 7fcd8cec7740 1 -- 172.21.15.79:0/2869044422 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555a1e6ba100 con 0x555a1e7a46e0 2024-08-20T01:44:57.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.541+0000 7fcd63fff640 1 -- 172.21.15.79:0/2869044422 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fcd780aa250 con 0x555a1e7a46e0 2024-08-20T01:44:57.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.541+0000 7fcd8cec7740 10 client.17685 fetch_fsmap learned FSMap version 42 2024-08-20T01:44:57.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.541+0000 7fcd8cec7740 1 -- 172.21.15.79:0/2869044422 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x555a1e7c3dd0 con 0x555a1e7a46e0 2024-08-20T01:44:57.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.541+0000 7fcd63fff640 1 -- 172.21.15.79:0/2869044422 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x555a1e6ba100 con 0x555a1e7a46e0 2024-08-20T01:44:57.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.541+0000 7fcd63fff640 1 -- 172.21.15.79:0/2869044422 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 42) ==== 8390+0+0 (secure 0 0 0) 0x7fcd780a94b0 con 0x555a1e7a46e0 2024-08-20T01:44:57.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.541+0000 7fcd8cec7740 10 client.17685 fetch_fsmap finished waiting for FSMap version 42 2024-08-20T01:44:57.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.541+0000 7fcd8cec7740 10 client.17685 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:44:57.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.541+0000 7fcd8cec7740 20 client.17685 populate_metadata read hostname 'smithi079' 2024-08-20T01:44:57.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.541+0000 7fcd8cec7740 1 --2- 172.21.15.79:0/2869044422 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x555a1e7c52e0 0x555a1e7c7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:57.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.541+0000 7fcd8cec7740 4 client.17685 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:44:57.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.541+0000 7fcd8cec7740 1 -- 172.21.15.79:0/2869044422 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555a1e71d830 con 0x555a1e7c52e0 2024-08-20T01:44:57.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.542+0000 7fcd83fff640 1 --2- 172.21.15.79:0/2869044422 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x555a1e7c52e0 0x555a1e7c7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:57.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.543+0000 7fcd63fff640 10 client.17685 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:44:57.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.543+0000 7fcd83fff640 1 --2- 172.21.15.79:0/2869044422 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x555a1e7c52e0 0x555a1e7c7750 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=253cf64cf5a942c1 server_cookie=ed8708e7c29acf32 in_seq=0 out_seq=0 2024-08-20T01:44:57.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.544+0000 7fcd63fff640 1 -- 172.21.15.79:0/2869044422 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555a1e71d830 con 0x555a1e7c52e0 2024-08-20T01:44:57.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.544+0000 7fcd63fff640 10 client.17685 handle_command_reply: tid=0 2024-08-20T01:44:57.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.544+0000 7fcd8cec7740 1 client.17685 shutdown 2024-08-20T01:44:57.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.544+0000 7fcd8cec7740 1 -- 172.21.15.79:0/2869044422 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1e7a46e0 msgr2=0x555a1e7b2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:57.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.544+0000 7fcd8cec7740 1 --2- 172.21.15.79:0/2869044422 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1e7a46e0 0x555a1e7b2300 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fcd780e0e00 tx=0x7fcd780a9ea0 comp rx=0 tx=0).stop 2024-08-20T01:44:57.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.544+0000 7fcd8cec7740 1 -- 172.21.15.79:0/2869044422 shutdown_connections 2024-08-20T01:44:57.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.544+0000 7fcd8cec7740 1 --2- 172.21.15.79:0/2869044422 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x555a1e7c52e0 0x555a1e7c7750 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:57.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.544+0000 7fcd8cec7740 1 --2- 172.21.15.79:0/2869044422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1e7b53a0 0x555a1e7b2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:57.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.544+0000 7fcd8cec7740 1 --2- 172.21.15.79:0/2869044422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555a1e7a5000 0x555a1e7b2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:57.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.544+0000 7fcd8cec7740 1 --2- 172.21.15.79:0/2869044422 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1e7a46e0 0x555a1e7b2300 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:57.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.544+0000 7fcd63fff640 0 client.17685 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:44:57.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.544+0000 7fcd8cec7740 1 -- 172.21.15.79:0/2869044422 >> 172.21.15.79:0/2869044422 conn(0x555a1e7a2510 msgr2=0x555a1e7a80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:57.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.544+0000 7fcd8cec7740 1 -- 172.21.15.79:0/2869044422 shutdown_connections 2024-08-20T01:44:57.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.544+0000 7fcd8cec7740 1 -- 172.21.15.79:0/2869044422 wait complete. 2024-08-20T01:44:57.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.544+0000 7fcd8cec7740 20 client.17685 trim_cache size 0 max 16384 2024-08-20T01:44:57.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.567+0000 7fcd8cec7740 1 Processor -- start 2024-08-20T01:44:57.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.567+0000 7fcd8cec7740 1 -- start start 2024-08-20T01:44:57.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.567+0000 7fcd8cec7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1e7a46e0 0x555a1e7afe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:57.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.567+0000 7fcd8cec7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555a1e7a5000 0x555a1e7c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:57.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.567+0000 7fcd8cec7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1e7b53a0 0x555a1e7b0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:57.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.567+0000 7fcd8cec7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcd841abda0 con 0x555a1e7b53a0 2024-08-20T01:44:57.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.567+0000 7fcd8cec7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcd841ada30 con 0x555a1e7a46e0 2024-08-20T01:44:57.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.567+0000 7fcd8cec7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcd841ac470 con 0x555a1e7a5000 2024-08-20T01:44:57.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.567+0000 7fcd8906b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1e7b53a0 0x555a1e7b0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:57.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.567+0000 7fcd8906b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1e7b53a0 0x555a1e7b0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56870/0 (socket says 172.21.15.79:56870) 2024-08-20T01:44:57.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.567+0000 7fcd8906b640 1 -- 172.21.15.79:0/3410065782 learned_addr learned my addr 172.21.15.79:0/3410065782 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:57.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.567+0000 7fcd83fff640 1 --2- 172.21.15.79:0/3410065782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555a1e7a5000 0x555a1e7c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:57.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.567+0000 7fcd8886a640 1 --2- 172.21.15.79:0/3410065782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1e7a46e0 0x555a1e7afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:57.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.567+0000 7fcd8906b640 1 -- 172.21.15.79:0/3410065782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555a1e7a5000 msgr2=0x555a1e7c72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:57.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.567+0000 7fcd8906b640 1 --2- 172.21.15.79:0/3410065782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555a1e7a5000 0x555a1e7c72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:57.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.567+0000 7fcd8906b640 1 -- 172.21.15.79:0/3410065782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1e7a46e0 msgr2=0x555a1e7afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:57.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.567+0000 7fcd8906b640 1 --2- 172.21.15.79:0/3410065782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1e7a46e0 0x555a1e7afe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:57.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.567+0000 7fcd8906b640 1 -- 172.21.15.79:0/3410065782 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a1e7c7ac0 con 0x555a1e7b53a0 2024-08-20T01:44:57.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.568+0000 7fcd8906b640 1 --2- 172.21.15.79:0/3410065782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1e7b53a0 0x555a1e7b0b80 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c0078b0 tx=0x7fcd7c010d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e7c3ca222f171de server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:57.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.568+0000 7fcd6e7fc640 1 -- 172.21.15.79:0/3410065782 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c00fb10 con 0x555a1e7b53a0 2024-08-20T01:44:57.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.568+0000 7fcd6e7fc640 1 -- 172.21.15.79:0/3410065782 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd7c00fcb0 con 0x555a1e7b53a0 2024-08-20T01:44:57.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.568+0000 7fcd6e7fc640 1 -- 172.21.15.79:0/3410065782 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c0185d0 con 0x555a1e7b53a0 2024-08-20T01:44:57.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.569+0000 7fcd8cec7740 1 -- 172.21.15.79:0/3410065782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1e7b53a0 msgr2=0x555a1e7b0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:57.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.569+0000 7fcd8cec7740 1 --2- 172.21.15.79:0/3410065782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1e7b53a0 0x555a1e7b0b80 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c0078b0 tx=0x7fcd7c010d90 comp rx=0 tx=0).stop 2024-08-20T01:44:57.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.569+0000 7fcd8cec7740 1 -- 172.21.15.79:0/3410065782 shutdown_connections 2024-08-20T01:44:57.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.569+0000 7fcd8cec7740 1 --2- 172.21.15.79:0/3410065782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1e7b53a0 0x555a1e7b0b80 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:57.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.569+0000 7fcd8cec7740 1 --2- 172.21.15.79:0/3410065782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555a1e7a5000 0x555a1e7c72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:57.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.569+0000 7fcd8cec7740 1 --2- 172.21.15.79:0/3410065782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1e7a46e0 0x555a1e7afe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:57.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.569+0000 7fcd8cec7740 1 -- 172.21.15.79:0/3410065782 >> 172.21.15.79:0/3410065782 conn(0x555a1e7a2510 msgr2=0x555a1e7b6420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:57.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.569+0000 7fcd8cec7740 1 -- 172.21.15.79:0/3410065782 shutdown_connections 2024-08-20T01:44:57.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.569+0000 7fcd8cec7740 1 -- 172.21.15.79:0/3410065782 wait complete. 2024-08-20T01:44:57.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.569+0000 7fcd8cec7740 1 -- start start 2024-08-20T01:44:57.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.569+0000 7fcd8cec7740 1 Processor -- start 2024-08-20T01:44:57.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.570+0000 7fcd8cec7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1e7a46e0 0x555a1e7cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:57.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.570+0000 7fcd8cec7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1e7a5000 0x555a1e7bd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:57.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.570+0000 7fcd8cec7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555a1e7b53a0 0x555a1e7bdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:57.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.570+0000 7fcd8cec7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcd841ad2a0 con 0x555a1e7a46e0 2024-08-20T01:44:57.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.570+0000 7fcd8cec7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcd841acb40 con 0x555a1e7a5000 2024-08-20T01:44:57.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.570+0000 7fcd8cec7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcd841a9da0 con 0x555a1e7b53a0 2024-08-20T01:44:57.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.570+0000 7fcd8886a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1e7a46e0 0x555a1e7cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:57.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.570+0000 7fcd8cec7740 10 client.0 _ll_register_callbacks cb 0x7fcd780a6110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:44:57.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.570+0000 7fcd8886a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1e7a46e0 0x555a1e7cd950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56878/0 (socket says 172.21.15.79:56878) 2024-08-20T01:44:57.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.570+0000 7fcd8886a640 1 -- 172.21.15.79:0/1012767852 learned_addr learned my addr 172.21.15.79:0/1012767852 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:44:57.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.570+0000 7fcd8906b640 1 --2- 172.21.15.79:0/1012767852 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555a1e7b53a0 0x555a1e7bdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:57.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.570+0000 7fcd83fff640 1 --2- 172.21.15.79:0/1012767852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1e7a5000 0x555a1e7bd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:57.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.570+0000 7fcd8886a640 1 -- 172.21.15.79:0/1012767852 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555a1e7b53a0 msgr2=0x555a1e7bdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:57.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.570+0000 7fcd8886a640 1 --2- 172.21.15.79:0/1012767852 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555a1e7b53a0 0x555a1e7bdae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:57.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.570+0000 7fcd8886a640 1 -- 172.21.15.79:0/1012767852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1e7a5000 msgr2=0x555a1e7bd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:44:57.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.570+0000 7fcd8886a640 1 --2- 172.21.15.79:0/1012767852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1e7a5000 0x555a1e7bd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:57.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.570+0000 7fcd8886a640 1 -- 172.21.15.79:0/1012767852 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a1e7cc200 con 0x555a1e7a46e0 2024-08-20T01:44:57.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.570+0000 7fcd83fff640 1 --2- 172.21.15.79:0/1012767852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1e7a5000 0x555a1e7bd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:44:57.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.571+0000 7fcd8886a640 1 --2- 172.21.15.79:0/1012767852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1e7a46e0 0x555a1e7cd950 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fcd780a74c0 tx=0x7fcd780a9760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c66fb31784f22754 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:44:57.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.571+0000 7fcd63fff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:44:57.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.571+0000 7fcd63fff640 1 -- 172.21.15.79:0/1012767852 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd780c3070 con 0x555a1e7a46e0 2024-08-20T01:44:57.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.571+0000 7fcd63fff640 1 -- 172.21.15.79:0/1012767852 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fcd780a6840 con 0x555a1e7a46e0 2024-08-20T01:44:57.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.571+0000 7fcd8cec7740 1 -- 172.21.15.79:0/1012767852 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd7c00fcb0 con 0x555a1e7a46e0 2024-08-20T01:44:57.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.571+0000 7fcd63fff640 1 -- 172.21.15.79:0/1012767852 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fcd780ae850 con 0x555a1e7a46e0 2024-08-20T01:44:57.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.571+0000 7fcd8cec7740 10 client.17691 fetch_fsmap learned FSMap version 42 2024-08-20T01:44:57.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.571+0000 7fcd8cec7740 1 -- 172.21.15.79:0/1012767852 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x555a1e82f4a0 con 0x555a1e7a46e0 2024-08-20T01:44:57.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.571+0000 7fcd63fff640 1 -- 172.21.15.79:0/1012767852 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd7c00fcb0 con 0x555a1e7a46e0 2024-08-20T01:44:57.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.571+0000 7fcd63fff640 1 -- 172.21.15.79:0/1012767852 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 42) ==== 8390+0+0 (secure 0 0 0) 0x7fcd780a8f20 con 0x555a1e7a46e0 2024-08-20T01:44:57.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.571+0000 7fcd8cec7740 10 client.17691 fetch_fsmap finished waiting for FSMap version 42 2024-08-20T01:44:57.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.571+0000 7fcd8cec7740 10 client.17691 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:44:57.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.571+0000 7fcd8cec7740 20 client.17691 populate_metadata read hostname 'smithi079' 2024-08-20T01:44:57.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.571+0000 7fcd8cec7740 1 --2- 172.21.15.79:0/1012767852 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x555a1e82fd60 0x555a1e832180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:44:57.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.571+0000 7fcd8cec7740 4 client.17691 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:44:57.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.571+0000 7fcd8cec7740 1 -- 172.21.15.79:0/1012767852 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555a1e7192d0 con 0x555a1e82fd60 2024-08-20T01:44:57.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.572+0000 7fcd83fff640 1 --2- 172.21.15.79:0/1012767852 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x555a1e82fd60 0x555a1e832180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:44:57.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.572+0000 7fcd63fff640 10 client.17691 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:44:57.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.572+0000 7fcd83fff640 1 --2- 172.21.15.79:0/1012767852 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x555a1e82fd60 0x555a1e832180 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d75a2d4be542695b server_cookie=465aeb64dcbdc750 in_seq=0 out_seq=0 2024-08-20T01:44:57.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.572+0000 7fcd63fff640 1 -- 172.21.15.79:0/1012767852 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x555a1e7192d0 con 0x555a1e82fd60 2024-08-20T01:44:57.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.572+0000 7fcd63fff640 10 client.17691 handle_command_reply: tid=0 2024-08-20T01:44:57.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.573+0000 7fcd8cec7740 1 client.17691 shutdown 2024-08-20T01:44:57.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.573+0000 7fcd8cec7740 1 -- 172.21.15.79:0/1012767852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1e7a46e0 msgr2=0x555a1e7cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:57.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.573+0000 7fcd8cec7740 1 --2- 172.21.15.79:0/1012767852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1e7a46e0 0x555a1e7cd950 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fcd780a74c0 tx=0x7fcd780a9760 comp rx=0 tx=0).stop 2024-08-20T01:44:57.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.573+0000 7fcd8cec7740 1 -- 172.21.15.79:0/1012767852 shutdown_connections 2024-08-20T01:44:57.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.573+0000 7fcd8cec7740 1 --2- 172.21.15.79:0/1012767852 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x555a1e82fd60 0x555a1e832180 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:57.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.573+0000 7fcd8cec7740 1 --2- 172.21.15.79:0/1012767852 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555a1e7b53a0 0x555a1e7bdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:57.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.573+0000 7fcd8cec7740 1 --2- 172.21.15.79:0/1012767852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1e7a5000 0x555a1e7bd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:57.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.573+0000 7fcd8cec7740 1 --2- 172.21.15.79:0/1012767852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1e7a46e0 0x555a1e7cd950 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:57.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.573+0000 7fcd8cec7740 1 -- 172.21.15.79:0/1012767852 >> 172.21.15.79:0/1012767852 conn(0x555a1e7a2510 msgr2=0x555a1e7b0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:57.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.573+0000 7fcd63fff640 0 client.17691 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:44:57.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.573+0000 7fcd8cec7740 1 -- 172.21.15.79:0/1012767852 shutdown_connections 2024-08-20T01:44:57.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.573+0000 7fcd8cec7740 1 -- 172.21.15.79:0/1012767852 wait complete. 2024-08-20T01:44:57.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.573+0000 7fcd8cec7740 20 client.17691 trim_cache size 0 max 16384 2024-08-20T01:44:57.581 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:44:57.581 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-08-20T01:44:57.581 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-08-20T01:44:57.581 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:44:57.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.574+0000 7fcd8aace640 1 -- 172.21.15.79:0/3629024864 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fcd740b3c50 msgr2=0x7fcd740b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:57.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.574+0000 7fcd8aace640 1 --2- 172.21.15.79:0/3629024864 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fcd740b3c50 0x7fcd740b6110 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fcd70005ec0 tx=0x7fcd700058d0 comp rx=0 tx=0).stop 2024-08-20T01:44:57.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.574+0000 7fcd8aace640 1 -- 172.21.15.79:0/3629024864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd841039a0 msgr2=0x7fcd84198ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:44:57.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.574+0000 7fcd8aace640 1 --2- 172.21.15.79:0/3629024864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd841039a0 0x7fcd84198ef0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fcd7800b3f0 tx=0x7fcd7800b8b0 comp rx=0 tx=0).stop 2024-08-20T01:44:57.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.574+0000 7fcd8aace640 1 -- 172.21.15.79:0/3629024864 shutdown_connections 2024-08-20T01:44:57.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.574+0000 7fcd8aace640 1 --2- 172.21.15.79:0/3629024864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd8410ce00 0x7fcd8419e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:57.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.574+0000 7fcd8aace640 1 --2- 172.21.15.79:0/3629024864 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fcd740b3c50 0x7fcd740b6110 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:57.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.574+0000 7fcd8aace640 1 --2- 172.21.15.79:0/3629024864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd841042c0 0x7fcd84199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:57.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.574+0000 7fcd8aace640 1 --2- 172.21.15.79:0/3629024864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd841039a0 0x7fcd84198ef0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:44:57.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.574+0000 7fcd8aace640 1 -- 172.21.15.79:0/3629024864 >> 172.21.15.79:0/3629024864 conn(0x7fcd840fd400 msgr2=0x7fcd840fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:44:57.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.574+0000 7fcd8aace640 1 -- 172.21.15.79:0/3629024864 shutdown_connections 2024-08-20T01:44:57.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:44:57.574+0000 7fcd8aace640 1 -- 172.21.15.79:0/3629024864 wait complete. 2024-08-20T01:44:57.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:57 smithi079 ceph-mon[18656]: pgmap v576: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 22 op/s 2024-08-20T01:44:57.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:57 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:44:58.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:57 smithi081 ceph-mon[22209]: pgmap v576: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 22 op/s 2024-08-20T01:44:58.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:57 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:44:58.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:57 smithi175 ceph-mon[22392]: pgmap v576: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 22 op/s 2024-08-20T01:44:58.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:57 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:44:58.471 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T01:44:58.471 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:44:58.794 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:44:59.966 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:44:59 smithi079 ceph-mon[18656]: pgmap v577: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 31 MiB/s wr, 25 op/s 2024-08-20T01:45:00.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:44:59 smithi081 ceph-mon[22209]: pgmap v577: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 31 MiB/s wr, 25 op/s 2024-08-20T01:45:00.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:44:59 smithi175 ceph-mon[22392]: pgmap v577: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 31 MiB/s wr, 25 op/s 2024-08-20T01:45:00.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:00.737+0000 7f8b567fc640 1 -- 172.21.15.79:0/2854123886 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b50031d80 con 0x7f8b5810cc70 2024-08-20T01:45:00.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:00.738+0000 7f8b5cfa1640 1 -- 172.21.15.79:0/2854123886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b5810cc70 msgr2=0x7f8b5810f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:00.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:00.738+0000 7f8b5cfa1640 1 --2- 172.21.15.79:0/2854123886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b5810cc70 0x7f8b5810f0c0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f8b50009ca0 tx=0x7f8b5002a8c0 comp rx=0 tx=0).stop 2024-08-20T01:45:00.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:00.738+0000 7f8b5cfa1640 1 -- 172.21.15.79:0/2854123886 shutdown_connections 2024-08-20T01:45:00.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:00.738+0000 7f8b5cfa1640 1 --2- 172.21.15.79:0/2854123886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b5810cc70 0x7f8b5810f0c0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:00.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:00.738+0000 7f8b5cfa1640 1 --2- 172.21.15.79:0/2854123886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b581040c0 0x7f8b5810c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:00.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:00.738+0000 7f8b5cfa1640 1 --2- 172.21.15.79:0/2854123886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b581036c0 0x7f8b58103aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:00.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:00.738+0000 7f8b5cfa1640 1 -- 172.21.15.79:0/2854123886 >> 172.21.15.79:0/2854123886 conn(0x7f8b580fd2d0 msgr2=0x7f8b580ff6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:00.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:00.738+0000 7f8b5cfa1640 1 -- 172.21.15.79:0/2854123886 shutdown_connections 2024-08-20T01:45:00.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:00.738+0000 7f8b5cfa1640 1 -- 172.21.15.79:0/2854123886 wait complete. 2024-08-20T01:45:00.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:00.739+0000 7f8b5cfa1640 1 Processor -- start 2024-08-20T01:45:00.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:00.739+0000 7f8b5cfa1640 1 -- start start 2024-08-20T01:45:00.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:00.739+0000 7f8b5cfa1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b581036c0 0x7f8b5819afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:00.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:00.739+0000 7f8b5cfa1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b581040c0 0x7f8b5819b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:00.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:00.739+0000 7f8b5cfa1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b5810cc70 0x7f8b581a06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:00.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:00.739+0000 7f8b5cfa1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8b58101f20 con 0x7f8b581036c0 2024-08-20T01:45:00.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:00.739+0000 7f8b5cfa1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8b58101da0 con 0x7f8b581040c0 2024-08-20T01:45:00.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:00.739+0000 7f8b5cfa1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8b581020a0 con 0x7f8b5810cc70 2024-08-20T01:45:00.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:00.739+0000 7f8b577fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b581036c0 0x7f8b5819afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:00.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:00.739+0000 7f8b577fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b581036c0 0x7f8b5819afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46630/0 (socket says 172.21.15.79:46630) 2024-08-20T01:45:00.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:00.739+0000 7f8b577fe640 1 -- 172.21.15.79:0/282373596 learned_addr learned my addr 172.21.15.79:0/282373596 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:00.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:00.739+0000 7f8b57fff640 1 --2- 172.21.15.79:0/282373596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b5810cc70 0x7f8b581a06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:00.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:00.739+0000 7f8b56ffd640 1 --2- 172.21.15.79:0/282373596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b581040c0 0x7f8b5819b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:00.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:00.740+0000 7f8b577fe640 1 -- 172.21.15.79:0/282373596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b5810cc70 msgr2=0x7f8b581a06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:00.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:00.740+0000 7f8b577fe640 1 --2- 172.21.15.79:0/282373596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b5810cc70 0x7f8b581a06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:00.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:00.740+0000 7f8b577fe640 1 -- 172.21.15.79:0/282373596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b581040c0 msgr2=0x7f8b5819b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:00.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:00.740+0000 7f8b577fe640 1 --2- 172.21.15.79:0/282373596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b581040c0 0x7f8b5819b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:00.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:00.740+0000 7f8b577fe640 1 -- 172.21.15.79:0/282373596 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b581a0ec0 con 0x7f8b581036c0 2024-08-20T01:45:00.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:00.740+0000 7f8b57fff640 1 --2- 172.21.15.79:0/282373596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b5810cc70 0x7f8b581a06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:45:00.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:00.740+0000 7f8b577fe640 1 --2- 172.21.15.79:0/282373596 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b581036c0 0x7f8b5819afc0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800e9f0 tx=0x7f8b4800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:00.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:00.740+0000 7f8b54ff9640 1 -- 172.21.15.79:0/282373596 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b4800cd80 con 0x7f8b581036c0 2024-08-20T01:45:00.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:00.740+0000 7f8b5cfa1640 1 -- 172.21.15.79:0/282373596 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b581a11b0 con 0x7f8b581036c0 2024-08-20T01:45:00.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:00.740+0000 7f8b54ff9640 1 -- 172.21.15.79:0/282373596 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8b480108c0 con 0x7f8b581036c0 2024-08-20T01:45:00.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:00.740+0000 7f8b54ff9640 1 -- 172.21.15.79:0/282373596 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b480187c0 con 0x7f8b581036c0 2024-08-20T01:45:00.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:00.740+0000 7f8b5cfa1640 1 -- 172.21.15.79:0/282373596 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b581a7a60 con 0x7f8b581036c0 2024-08-20T01:45:00.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:00.742+0000 7f8b5cfa1640 1 -- 172.21.15.79:0/282373596 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b58103aa0 con 0x7f8b581036c0 2024-08-20T01:45:00.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:00.744+0000 7f8b54ff9640 1 -- 172.21.15.79:0/282373596 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f8b48010430 con 0x7f8b581036c0 2024-08-20T01:45:00.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:00.745+0000 7f8b54ff9640 1 --2- 172.21.15.79:0/282373596 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f8b400b3cf0 0x7f8b400b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:00.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:00.745+0000 7f8b54ff9640 1 -- 172.21.15.79:0/282373596 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f8b480e4380 con 0x7f8b581036c0 2024-08-20T01:45:00.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:00.745+0000 7f8b56ffd640 1 --2- 172.21.15.79:0/282373596 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f8b400b3cf0 0x7f8b400b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:00.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:00.746+0000 7f8b56ffd640 1 --2- 172.21.15.79:0/282373596 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f8b400b3cf0 0x7f8b400b61b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8b5810d390 tx=0x7f8b4c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:00.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:00.748+0000 7f8b54ff9640 1 -- 172.21.15.79:0/282373596 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f8b480ab390 con 0x7f8b581036c0 2024-08-20T01:45:01.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:01.014+0000 7f8b5cfa1640 1 -- 172.21.15.79:0/282373596 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b5819bf40 con 0x7f8b581036c0 2024-08-20T01:45:01.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:01.014+0000 7f8b54ff9640 1 -- 172.21.15.79:0/282373596 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11985 (secure 0 0 0) 0x7f8b480af8e0 con 0x7f8b581036c0 2024-08-20T01:45:01.017 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:45:01.017 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":42,"btime":"2024-08-20T01:44:56:695614+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14670,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/735082912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":735082912},{"type":"v1","addr":"172.21.15.79:6835","nonce":735082912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2150339873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2150339873},{"type":"v1","addr":"172.21.15.79:6837","nonce":2150339873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":42,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:34:55.133562+0000","modified":"2024-08-20T01:44:55.897761+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24539,"mds_1":24538,"mds_2":24523,"mds_3":24514,"mds_4":24512},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14724":{"gid":14724,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/1071242274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1071242274},{"type":"v1","addr":"172.21.15.79:6839","nonce":1071242274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14730":{"gid":14730,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6841/2448977611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":2448977611},{"type":"v1","addr":"172.21.15.79:6841","nonce":2448977611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/1257507005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1257507005},{"type":"v1","addr":"172.21.15.81:6833","nonce":1257507005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1499936216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1499936216},{"type":"v1","addr":"172.21.15.81:6835","nonce":1499936216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/1107229215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1107229215},{"type":"v1","addr":"172.21.15.175:6833","nonce":1107229215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6837/2073598870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2073598870},{"type":"v1","addr":"172.21.15.81:6837","nonce":2073598870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/2552601173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2552601173},{"type":"v1","addr":"172.21.15.175:6835","nonce":2552601173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6837/1767284089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1767284089},{"type":"v1","addr":"172.21.15.175:6837","nonce":1767284089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/1331748742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1331748742},{"type":"v1","addr":"172.21.15.175:6839","nonce":1331748742}]},"join_fscid":-1,"export_targets":[2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/4098410583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":4098410583},{"type":"v1","addr":"172.21.15.81:6839","nonce":4098410583}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24539,"qdb_cluster":[24512,24538,24514,24523,24539]},"id":1}]} 2024-08-20T01:45:01.018 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 42 2024-08-20T01:45:01.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:01.017+0000 7f8b5cfa1640 1 -- 172.21.15.79:0/282373596 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f8b400b3cf0 msgr2=0x7f8b400b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:01.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:01.017+0000 7f8b5cfa1640 1 --2- 172.21.15.79:0/282373596 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f8b400b3cf0 0x7f8b400b61b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8b5810d390 tx=0x7f8b4c00b390 comp rx=0 tx=0).stop 2024-08-20T01:45:01.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:01.017+0000 7f8b5cfa1640 1 -- 172.21.15.79:0/282373596 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b581036c0 msgr2=0x7f8b5819afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:01.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:01.017+0000 7f8b5cfa1640 1 --2- 172.21.15.79:0/282373596 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b581036c0 0x7f8b5819afc0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800e9f0 tx=0x7f8b4800eeb0 comp rx=0 tx=0).stop 2024-08-20T01:45:01.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:01.017+0000 7f8b5cfa1640 1 -- 172.21.15.79:0/282373596 shutdown_connections 2024-08-20T01:45:01.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:01.017+0000 7f8b5cfa1640 1 --2- 172.21.15.79:0/282373596 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f8b400b3cf0 0x7f8b400b61b0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:01.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:01.017+0000 7f8b5cfa1640 1 --2- 172.21.15.79:0/282373596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b5810cc70 0x7f8b581a06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:01.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:01.017+0000 7f8b5cfa1640 1 --2- 172.21.15.79:0/282373596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b581040c0 0x7f8b5819b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:01.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:01.017+0000 7f8b5cfa1640 1 --2- 172.21.15.79:0/282373596 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b581036c0 0x7f8b5819afc0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:01.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:01.017+0000 7f8b5cfa1640 1 -- 172.21.15.79:0/282373596 >> 172.21.15.79:0/282373596 conn(0x7f8b580fd2d0 msgr2=0x7f8b5810dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:01.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:01.017+0000 7f8b5cfa1640 1 -- 172.21.15.79:0/282373596 shutdown_connections 2024-08-20T01:45:01.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:01.017+0000 7f8b5cfa1640 1 -- 172.21.15.79:0/282373596 wait complete. 2024-08-20T01:45:01.840 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-20T01:45:02.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:01 smithi081 ceph-mon[22209]: pgmap v578: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-08-20T01:45:02.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:01 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/282373596' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:45:02.118 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:45:02.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:01 smithi175 ceph-mon[22392]: pgmap v578: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-08-20T01:45:02.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:01 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/282373596' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:45:02.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:01 smithi079 ceph-mon[18656]: pgmap v578: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-08-20T01:45:02.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:01 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/282373596' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:45:02.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.635+0000 7fa8d9e5e640 1 -- 172.21.15.79:0/1234353454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8d4102ad0 msgr2=0x7fa8d4102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:02.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.635+0000 7fa8d9e5e640 1 --2- 172.21.15.79:0/1234353454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8d4102ad0 0x7fa8d4102eb0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4009900 tx=0x7fa8c402a410 comp rx=0 tx=0).stop 2024-08-20T01:45:02.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.635+0000 7fa8d9e5e640 1 -- 172.21.15.79:0/1234353454 shutdown_connections 2024-08-20T01:45:02.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.635+0000 7fa8d9e5e640 1 --2- 172.21.15.79:0/1234353454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8d4108e60 0x7fa8d410f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:02.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.635+0000 7fa8d9e5e640 1 --2- 172.21.15.79:0/1234353454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8d41084e0 0x7fa8d4108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:02.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.636+0000 7fa8d9e5e640 1 --2- 172.21.15.79:0/1234353454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8d4102ad0 0x7fa8d4102eb0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:02.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.636+0000 7fa8d9e5e640 1 -- 172.21.15.79:0/1234353454 >> 172.21.15.79:0/1234353454 conn(0x7fa8d40fe540 msgr2=0x7fa8d4100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:02.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.636+0000 7fa8d9e5e640 1 -- 172.21.15.79:0/1234353454 shutdown_connections 2024-08-20T01:45:02.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.636+0000 7fa8d9e5e640 1 -- 172.21.15.79:0/1234353454 wait complete. 2024-08-20T01:45:02.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.636+0000 7fa8d9e5e640 1 Processor -- start 2024-08-20T01:45:02.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.637+0000 7fa8d9e5e640 1 -- start start 2024-08-20T01:45:02.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.637+0000 7fa8d9e5e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8d4102ad0 0x7fa8d40751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:02.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.637+0000 7fa8d9e5e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8d41084e0 0x7fa8d4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:02.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.637+0000 7fa8d9e5e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8d4108e60 0x7fa8d4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:02.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.637+0000 7fa8d9e5e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d4112a30 con 0x7fa8d4102ad0 2024-08-20T01:45:02.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.637+0000 7fa8d9e5e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d41128b0 con 0x7fa8d4108e60 2024-08-20T01:45:02.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.637+0000 7fa8d9e5e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d4112bb0 con 0x7fa8d41084e0 2024-08-20T01:45:02.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.637+0000 7fa8d37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8d4102ad0 0x7fa8d40751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:02.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.637+0000 7fa8d37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8d4102ad0 0x7fa8d40751d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46650/0 (socket says 172.21.15.79:46650) 2024-08-20T01:45:02.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.637+0000 7fa8d37fe640 1 -- 172.21.15.79:0/2318095618 learned_addr learned my addr 172.21.15.79:0/2318095618 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:02.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.637+0000 7fa8d3fff640 1 --2- 172.21.15.79:0/2318095618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8d4108e60 0x7fa8d4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:02.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.637+0000 7fa8d2ffd640 1 --2- 172.21.15.79:0/2318095618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8d41084e0 0x7fa8d4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:02.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.638+0000 7fa8d3fff640 1 -- 172.21.15.79:0/2318095618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8d41084e0 msgr2=0x7fa8d4075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:02.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.638+0000 7fa8d3fff640 1 --2- 172.21.15.79:0/2318095618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8d41084e0 0x7fa8d4075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:02.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.638+0000 7fa8d3fff640 1 -- 172.21.15.79:0/2318095618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8d4102ad0 msgr2=0x7fa8d40751d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:02.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.638+0000 7fa8d3fff640 1 --2- 172.21.15.79:0/2318095618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8d4102ad0 0x7fa8d40751d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:02.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.638+0000 7fa8d3fff640 1 -- 172.21.15.79:0/2318095618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8d41a7480 con 0x7fa8d4108e60 2024-08-20T01:45:02.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.638+0000 7fa8d37fe640 1 --2- 172.21.15.79:0/2318095618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8d4102ad0 0x7fa8d40751d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:45:02.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.638+0000 7fa8d3fff640 1 --2- 172.21.15.79:0/2318095618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8d4108e60 0x7fa8d4075c50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc00be20 tx=0x7fa8cc00bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:02.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.638+0000 7fa8d0ff9640 1 -- 172.21.15.79:0/2318095618 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc019070 con 0x7fa8d4108e60 2024-08-20T01:45:02.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.638+0000 7fa8d9e5e640 1 -- 172.21.15.79:0/2318095618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8d41a7770 con 0x7fa8d4108e60 2024-08-20T01:45:02.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.638+0000 7fa8d0ff9640 1 -- 172.21.15.79:0/2318095618 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa8cc0148d0 con 0x7fa8d4108e60 2024-08-20T01:45:02.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.638+0000 7fa8d9e5e640 1 -- 172.21.15.79:0/2318095618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8d41a7d80 con 0x7fa8d4108e60 2024-08-20T01:45:02.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.638+0000 7fa8d0ff9640 1 -- 172.21.15.79:0/2318095618 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc0127a0 con 0x7fa8d4108e60 2024-08-20T01:45:02.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.641+0000 7fa8d0ff9640 1 -- 172.21.15.79:0/2318095618 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa8cc01c070 con 0x7fa8d4108e60 2024-08-20T01:45:02.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.642+0000 7fa8dc257740 1 Processor -- start 2024-08-20T01:45:02.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.642+0000 7fa8dc257740 1 -- start start 2024-08-20T01:45:02.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.642+0000 7fa8dc257740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e500154880 0x55e500154c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:02.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.642+0000 7fa8dc257740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e5001551a0 0x55e500160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:02.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.642+0000 7fa8dc257740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e500161130 0x55e500163520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:02.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.642+0000 7fa8dc257740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e5000cb930 con 0x55e500161130 2024-08-20T01:45:02.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.642+0000 7fa8dc257740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e5000bae30 con 0x55e5001551a0 2024-08-20T01:45:02.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.642+0000 7fa8dc257740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e5000bee70 con 0x55e500154880 2024-08-20T01:45:02.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.643+0000 7fa8d2ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e500154880 0x55e500154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:02.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.643+0000 7fa8d37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e5001551a0 0x55e500160bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:02.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.643+0000 7fa8d2ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e500154880 0x55e500154c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:40562/0 (socket says 172.21.15.79:40562) 2024-08-20T01:45:02.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.643+0000 7fa8d2ffd640 1 -- 172.21.15.79:0/208907960 learned_addr learned my addr 172.21.15.79:0/208907960 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:02.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.643+0000 7fa8d2ffd640 1 --2- 172.21.15.79:0/208907960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e500161130 0x55e500163520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:02.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.643+0000 7fa8d37fe640 1 -- 172.21.15.79:0/208907960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e500154880 msgr2=0x55e500154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:02.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.643+0000 7fa8d37fe640 1 --2- 172.21.15.79:0/208907960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e500154880 0x55e500154c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:02.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.643+0000 7fa8d37fe640 1 -- 172.21.15.79:0/208907960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e500161130 msgr2=0x55e500163520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:02.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.643+0000 7fa8d37fe640 1 --2- 172.21.15.79:0/208907960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e500161130 0x55e500163520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:02.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.643+0000 7fa8d37fe640 1 -- 172.21.15.79:0/208907960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4ffe1a650 con 0x55e5001551a0 2024-08-20T01:45:02.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.643+0000 7fa8d0ff9640 1 --2- 172.21.15.79:0/2318095618 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa8bc0b3bd0 0x7fa8bc0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:02.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.643+0000 7fa8d37fe640 1 --2- 172.21.15.79:0/208907960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e5001551a0 0x55e500160bf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa8c40057c0 tx=0x7fa8c4005c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f918f31fc5c5943 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:02.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.644+0000 7fa8d2ffd640 1 --2- 172.21.15.79:0/2318095618 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa8bc0b3bd0 0x7fa8bc0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:02.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.644+0000 7fa8b9ffb640 1 -- 172.21.15.79:0/208907960 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4035030 con 0x55e5001551a0 2024-08-20T01:45:02.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.644+0000 7fa8d0ff9640 1 -- 172.21.15.79:0/2318095618 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fa8cc0e3410 con 0x7fa8d4108e60 2024-08-20T01:45:02.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.644+0000 7fa8b9ffb640 1 -- 172.21.15.79:0/208907960 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa8c4040070 con 0x55e5001551a0 2024-08-20T01:45:02.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.644+0000 7fa8b9ffb640 1 -- 172.21.15.79:0/208907960 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4003900 con 0x55e5001551a0 2024-08-20T01:45:02.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.645+0000 7fa8dc257740 1 -- 172.21.15.79:0/208907960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e5001551a0 msgr2=0x55e500160bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:02.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.645+0000 7fa8dc257740 1 --2- 172.21.15.79:0/208907960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e5001551a0 0x55e500160bf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa8c40057c0 tx=0x7fa8c4005c00 comp rx=0 tx=0).stop 2024-08-20T01:45:02.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.645+0000 7fa8d2ffd640 1 --2- 172.21.15.79:0/2318095618 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa8bc0b3bd0 0x7fa8bc0b6090 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x55e500154830 tx=0x7fa8c8006da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:02.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.645+0000 7fa8dc257740 1 -- 172.21.15.79:0/208907960 shutdown_connections 2024-08-20T01:45:02.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.645+0000 7fa8dc257740 1 --2- 172.21.15.79:0/208907960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e500161130 0x55e500163520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:02.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.645+0000 7fa8dc257740 1 --2- 172.21.15.79:0/208907960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e5001551a0 0x55e500160bf0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:02.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.645+0000 7fa8dc257740 1 --2- 172.21.15.79:0/208907960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e500154880 0x55e500154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:02.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.645+0000 7fa8dc257740 1 -- 172.21.15.79:0/208907960 >> 172.21.15.79:0/208907960 conn(0x55e5001526b0 msgr2=0x55e500153850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:02.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.645+0000 7fa8dc257740 1 -- 172.21.15.79:0/208907960 shutdown_connections 2024-08-20T01:45:02.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.646+0000 7fa8dc257740 1 -- 172.21.15.79:0/208907960 wait complete. 2024-08-20T01:45:02.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.646+0000 7fa8dc257740 1 -- start start 2024-08-20T01:45:02.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.646+0000 7fa8dc257740 1 Processor -- start 2024-08-20T01:45:02.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.647+0000 7fa8dc257740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e500154880 0x55e50015e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:02.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.647+0000 7fa8dc257740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5001551a0 0x55e50015e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:02.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.647+0000 7fa8dc257740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e500161130 0x55e50015eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:02.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.647+0000 7fa8d37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e500154880 0x55e50015e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:02.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.647+0000 7fa8d37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e500154880 0x55e50015e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46666/0 (socket says 172.21.15.79:46666) 2024-08-20T01:45:02.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.647+0000 7fa8d2ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5001551a0 0x55e50015e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:02.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.647+0000 7fa8d2ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5001551a0 0x55e50015e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:40576/0 (socket says 172.21.15.79:40576) 2024-08-20T01:45:02.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.647+0000 7fa8d37fe640 1 -- 172.21.15.79:0/1817700180 learned_addr learned my addr 172.21.15.79:0/1817700180 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:02.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.647+0000 7fa8dc257740 1 -- 172.21.15.79:0/1817700180 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e4fff1d700 con 0x55e500154880 2024-08-20T01:45:02.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.647+0000 7fa8dc257740 1 -- 172.21.15.79:0/1817700180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e500041810 con 0x55e500161130 2024-08-20T01:45:02.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.648+0000 7fa8dc257740 1 -- 172.21.15.79:0/1817700180 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e500174d90 con 0x55e5001551a0 2024-08-20T01:45:02.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.648+0000 7fa8d3fff640 1 --2- 172.21.15.79:0/1817700180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e500161130 0x55e50015eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:02.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.648+0000 7fa8dc257740 10 client.0 _ll_register_callbacks cb 0x55e5000b4700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:45:02.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.648+0000 7fa8d37fe640 1 -- 172.21.15.79:0/1817700180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5001551a0 msgr2=0x55e50015e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:02.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.648+0000 7fa8d37fe640 1 --2- 172.21.15.79:0/1817700180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5001551a0 0x55e50015e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:02.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.648+0000 7fa8d37fe640 1 -- 172.21.15.79:0/1817700180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e500161130 msgr2=0x55e50015eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:02.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.648+0000 7fa8d37fe640 1 --2- 172.21.15.79:0/1817700180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e500161130 0x55e50015eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:02.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.648+0000 7fa8d37fe640 1 -- 172.21.15.79:0/1817700180 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e50017e0f0 con 0x55e500154880 2024-08-20T01:45:02.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.649+0000 7fa8d37fe640 1 --2- 172.21.15.79:0/1817700180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e500154880 0x55e50015e080 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fa8c402aa00 tx=0x7fa8c4031610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b25bf8519eaa4033 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:02.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.649+0000 7fa8b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:45:02.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.649+0000 7fa8b2ffd640 1 -- 172.21.15.79:0/1817700180 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4035040 con 0x55e500154880 2024-08-20T01:45:02.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.649+0000 7fa8dc257740 1 -- 172.21.15.79:0/1817700180 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e50006a150 con 0x55e500154880 2024-08-20T01:45:02.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.649+0000 7fa8b2ffd640 1 -- 172.21.15.79:0/1817700180 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fa8c4005450 con 0x55e500154880 2024-08-20T01:45:02.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.649+0000 7fa8b2ffd640 1 -- 172.21.15.79:0/1817700180 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fa8c40046c0 con 0x55e500154880 2024-08-20T01:45:02.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.649+0000 7fa8dc257740 10 client.17709 fetch_fsmap learned FSMap version 42 2024-08-20T01:45:02.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.649+0000 7fa8dc257740 1 -- 172.21.15.79:0/1817700180 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55e500180a80 con 0x55e500154880 2024-08-20T01:45:02.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.649+0000 7fa8b2ffd640 1 -- 172.21.15.79:0/1817700180 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55e50006a150 con 0x55e500154880 2024-08-20T01:45:02.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.650+0000 7fa8b2ffd640 1 -- 172.21.15.79:0/1817700180 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 42) ==== 8390+0+0 (secure 0 0 0) 0x7fa8c403c7e0 con 0x55e500154880 2024-08-20T01:45:02.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.650+0000 7fa8dc257740 10 client.17709 fetch_fsmap finished waiting for FSMap version 42 2024-08-20T01:45:02.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.650+0000 7fa8dc257740 10 client.17709 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:45:02.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.650+0000 7fa8dc257740 20 client.17709 populate_metadata read hostname 'smithi079' 2024-08-20T01:45:02.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.650+0000 7fa8dc257740 1 --2- 172.21.15.79:0/1817700180 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55e500181dd0 0x55e5001841c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:02.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.650+0000 7fa8dc257740 4 client.17709 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:45:02.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.650+0000 7fa8dc257740 1 -- 172.21.15.79:0/1817700180 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e5000cd880 con 0x55e500181dd0 2024-08-20T01:45:02.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.650+0000 7fa8d2ffd640 1 --2- 172.21.15.79:0/1817700180 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55e500181dd0 0x55e5001841c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:02.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.650+0000 7fa8b2ffd640 10 client.17709 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:45:02.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.650+0000 7fa8d2ffd640 1 --2- 172.21.15.79:0/1817700180 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55e500181dd0 0x55e5001841c0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=bbec1514a10aa506 server_cookie=ad84cb729c8125c6 in_seq=0 out_seq=0 2024-08-20T01:45:02.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.651+0000 7fa8b2ffd640 1 -- 172.21.15.79:0/1817700180 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e5000cd880 con 0x55e500181dd0 2024-08-20T01:45:02.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.651+0000 7fa8b2ffd640 10 client.17709 handle_command_reply: tid=0 2024-08-20T01:45:02.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.651+0000 7fa8dc257740 1 client.17709 shutdown 2024-08-20T01:45:02.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.651+0000 7fa8dc257740 1 -- 172.21.15.79:0/1817700180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e500154880 msgr2=0x55e50015e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:02.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.651+0000 7fa8dc257740 1 --2- 172.21.15.79:0/1817700180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e500154880 0x55e50015e080 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fa8c402aa00 tx=0x7fa8c4031610 comp rx=0 tx=0).stop 2024-08-20T01:45:02.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.652+0000 7fa8dc257740 1 -- 172.21.15.79:0/1817700180 shutdown_connections 2024-08-20T01:45:02.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.652+0000 7fa8dc257740 1 --2- 172.21.15.79:0/1817700180 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55e500181dd0 0x55e5001841c0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:02.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.652+0000 7fa8dc257740 1 --2- 172.21.15.79:0/1817700180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e500161130 0x55e50015eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:02.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.652+0000 7fa8dc257740 1 --2- 172.21.15.79:0/1817700180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5001551a0 0x55e50015e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:02.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.652+0000 7fa8dc257740 1 --2- 172.21.15.79:0/1817700180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e500154880 0x55e50015e080 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:02.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.652+0000 7fa8dc257740 1 -- 172.21.15.79:0/1817700180 >> 172.21.15.79:0/1817700180 conn(0x55e5001526b0 msgr2=0x55e500158250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:02.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.652+0000 7fa8b2ffd640 0 client.17709 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:45:02.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.652+0000 7fa8dc257740 1 -- 172.21.15.79:0/1817700180 shutdown_connections 2024-08-20T01:45:02.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.652+0000 7fa8dc257740 1 -- 172.21.15.79:0/1817700180 wait complete. 2024-08-20T01:45:02.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.652+0000 7fa8dc257740 20 client.17709 trim_cache size 0 max 16384 2024-08-20T01:45:02.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.668+0000 7fa8dc257740 1 Processor -- start 2024-08-20T01:45:02.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.668+0000 7fa8dc257740 1 -- start start 2024-08-20T01:45:02.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.668+0000 7fa8dc257740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e500154880 0x55e500158980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:02.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.669+0000 7fa8dc257740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e5001551a0 0x55e50015fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:02.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.669+0000 7fa8dc257740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e500161130 0x55e5001897c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:02.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.669+0000 7fa8dc257740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d4074ac0 con 0x55e500161130 2024-08-20T01:45:02.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.669+0000 7fa8dc257740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d41a9690 con 0x55e5001551a0 2024-08-20T01:45:02.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.669+0000 7fa8dc257740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d41a80d0 con 0x55e500154880 2024-08-20T01:45:02.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.669+0000 7fa8d3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e500161130 0x55e5001897c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:02.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.669+0000 7fa8d3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e500161130 0x55e5001897c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46668/0 (socket says 172.21.15.79:46668) 2024-08-20T01:45:02.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.669+0000 7fa8d3fff640 1 -- 172.21.15.79:0/1876111811 learned_addr learned my addr 172.21.15.79:0/1876111811 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:02.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.669+0000 7fa8d2ffd640 1 --2- 172.21.15.79:0/1876111811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e5001551a0 0x55e50015fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:02.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.669+0000 7fa8d37fe640 1 --2- 172.21.15.79:0/1876111811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e500154880 0x55e500158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:02.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.669+0000 7fa8d3fff640 1 -- 172.21.15.79:0/1876111811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e500154880 msgr2=0x55e500158980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:02.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.669+0000 7fa8d3fff640 1 --2- 172.21.15.79:0/1876111811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e500154880 0x55e500158980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:02.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.669+0000 7fa8d3fff640 1 -- 172.21.15.79:0/1876111811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e5001551a0 msgr2=0x55e50015fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:02.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.669+0000 7fa8d3fff640 1 --2- 172.21.15.79:0/1876111811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e5001551a0 0x55e50015fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:02.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.669+0000 7fa8d3fff640 1 -- 172.21.15.79:0/1876111811 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e500154fd0 con 0x55e500161130 2024-08-20T01:45:02.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.669+0000 7fa8d3fff640 1 --2- 172.21.15.79:0/1876111811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e500161130 0x55e5001897c0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc004b10 tx=0x7fa8cc0e0dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64984b4d028fdab0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:02.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.669+0000 7fa8b97fa640 1 -- 172.21.15.79:0/1876111811 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc014da0 con 0x55e500161130 2024-08-20T01:45:02.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.669+0000 7fa8b97fa640 1 -- 172.21.15.79:0/1876111811 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa8cc014a80 con 0x55e500161130 2024-08-20T01:45:02.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.669+0000 7fa8b97fa640 1 -- 172.21.15.79:0/1876111811 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc0a9660 con 0x55e500161130 2024-08-20T01:45:02.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.670+0000 7fa8dc257740 1 -- 172.21.15.79:0/1876111811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e500161130 msgr2=0x55e5001897c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:02.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.670+0000 7fa8dc257740 1 --2- 172.21.15.79:0/1876111811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e500161130 0x55e5001897c0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc004b10 tx=0x7fa8cc0e0dd0 comp rx=0 tx=0).stop 2024-08-20T01:45:02.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.670+0000 7fa8dc257740 1 -- 172.21.15.79:0/1876111811 shutdown_connections 2024-08-20T01:45:02.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.670+0000 7fa8dc257740 1 --2- 172.21.15.79:0/1876111811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e500161130 0x55e5001897c0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:02.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.670+0000 7fa8dc257740 1 --2- 172.21.15.79:0/1876111811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e5001551a0 0x55e50015fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:02.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.670+0000 7fa8dc257740 1 --2- 172.21.15.79:0/1876111811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e500154880 0x55e500158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:02.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.670+0000 7fa8dc257740 1 -- 172.21.15.79:0/1876111811 >> 172.21.15.79:0/1876111811 conn(0x55e5001526b0 msgr2=0x55e50015f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:02.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.670+0000 7fa8dc257740 1 -- 172.21.15.79:0/1876111811 shutdown_connections 2024-08-20T01:45:02.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.670+0000 7fa8dc257740 1 -- 172.21.15.79:0/1876111811 wait complete. 2024-08-20T01:45:02.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.671+0000 7fa8dc257740 1 -- start start 2024-08-20T01:45:02.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.671+0000 7fa8dc257740 1 Processor -- start 2024-08-20T01:45:02.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.671+0000 7fa8dc257740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e500154880 0x55e50017a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:02.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.671+0000 7fa8dc257740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5001551a0 0x55e500175ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:02.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.671+0000 7fa8dc257740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e500161130 0x55e500176010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:02.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.671+0000 7fa8dc257740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d41a8f00 con 0x55e500154880 2024-08-20T01:45:02.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.671+0000 7fa8dc257740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d41a87a0 con 0x55e500161130 2024-08-20T01:45:02.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.671+0000 7fa8dc257740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d4072aa0 con 0x55e5001551a0 2024-08-20T01:45:02.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.671+0000 7fa8dc257740 10 client.0 _ll_register_callbacks cb 0x7fa8c800a7c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:45:02.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.671+0000 7fa8d37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e500154880 0x55e50017a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:02.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.671+0000 7fa8d37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e500154880 0x55e50017a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46684/0 (socket says 172.21.15.79:46684) 2024-08-20T01:45:02.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.671+0000 7fa8d37fe640 1 -- 172.21.15.79:0/1865109012 learned_addr learned my addr 172.21.15.79:0/1865109012 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:02.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.672+0000 7fa8d2ffd640 1 --2- 172.21.15.79:0/1865109012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5001551a0 0x55e500175ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:02.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.672+0000 7fa8d3fff640 1 --2- 172.21.15.79:0/1865109012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e500161130 0x55e500176010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:02.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.672+0000 7fa8d37fe640 1 -- 172.21.15.79:0/1865109012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5001551a0 msgr2=0x55e500175ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:02.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.672+0000 7fa8d37fe640 1 --2- 172.21.15.79:0/1865109012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5001551a0 0x55e500175ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:02.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.672+0000 7fa8d37fe640 1 -- 172.21.15.79:0/1865109012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e500161130 msgr2=0x55e500176010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:02.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.672+0000 7fa8d37fe640 1 --2- 172.21.15.79:0/1865109012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e500161130 0x55e500176010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:02.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.672+0000 7fa8d37fe640 1 -- 172.21.15.79:0/1865109012 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e500176750 con 0x55e500154880 2024-08-20T01:45:02.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.672+0000 7fa8d3fff640 1 --2- 172.21.15.79:0/1865109012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e500161130 0x55e500176010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:45:02.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.672+0000 7fa8d37fe640 1 --2- 172.21.15.79:0/1865109012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e500154880 0x55e50017a5b0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fa8c40057c0 tx=0x7fa8c402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bfad82db322c81f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:02.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.672+0000 7fa8b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:45:02.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.672+0000 7fa8b2ffd640 1 -- 172.21.15.79:0/1865109012 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4035070 con 0x55e500154880 2024-08-20T01:45:02.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.672+0000 7fa8b2ffd640 1 -- 172.21.15.79:0/1865109012 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fa8c4004c70 con 0x55e500154880 2024-08-20T01:45:02.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.672+0000 7fa8dc257740 1 -- 172.21.15.79:0/1865109012 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8cc014a80 con 0x55e500154880 2024-08-20T01:45:02.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.672+0000 7fa8b2ffd640 1 -- 172.21.15.79:0/1865109012 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fa8c40443e0 con 0x55e500154880 2024-08-20T01:45:02.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.672+0000 7fa8dc257740 10 client.17715 fetch_fsmap learned FSMap version 42 2024-08-20T01:45:02.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.672+0000 7fa8dc257740 1 -- 172.21.15.79:0/1865109012 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55e5001ec6e0 con 0x55e500154880 2024-08-20T01:45:02.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.673+0000 7fa8b2ffd640 1 -- 172.21.15.79:0/1865109012 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa8cc014a80 con 0x55e500154880 2024-08-20T01:45:02.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.673+0000 7fa8b2ffd640 1 -- 172.21.15.79:0/1865109012 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 42) ==== 8390+0+0 (secure 0 0 0) 0x7fa8c403c6f0 con 0x55e500154880 2024-08-20T01:45:02.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.673+0000 7fa8dc257740 10 client.17715 fetch_fsmap finished waiting for FSMap version 42 2024-08-20T01:45:02.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.673+0000 7fa8dc257740 10 client.17715 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:45:02.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.673+0000 7fa8dc257740 20 client.17715 populate_metadata read hostname 'smithi079' 2024-08-20T01:45:02.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.673+0000 7fa8dc257740 1 --2- 172.21.15.79:0/1865109012 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55e5001ece90 0x55e5001ef2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:02.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.673+0000 7fa8dc257740 4 client.17715 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:45:02.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.673+0000 7fa8dc257740 1 -- 172.21.15.79:0/1865109012 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e5000c9320 con 0x55e5001ece90 2024-08-20T01:45:02.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.673+0000 7fa8d2ffd640 1 --2- 172.21.15.79:0/1865109012 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55e5001ece90 0x55e5001ef2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:02.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.674+0000 7fa8b2ffd640 10 client.17715 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:45:02.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.674+0000 7fa8d2ffd640 1 --2- 172.21.15.79:0/1865109012 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55e5001ece90 0x55e5001ef2b0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=330bc24a45d300b2 server_cookie=33162c369d0962f4 in_seq=0 out_seq=0 2024-08-20T01:45:02.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.674+0000 7fa8b2ffd640 1 -- 172.21.15.79:0/1865109012 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e5000c9320 con 0x55e5001ece90 2024-08-20T01:45:02.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.674+0000 7fa8b2ffd640 10 client.17715 handle_command_reply: tid=0 2024-08-20T01:45:02.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.674+0000 7fa8dc257740 1 client.17715 shutdown 2024-08-20T01:45:02.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.674+0000 7fa8dc257740 1 -- 172.21.15.79:0/1865109012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e500154880 msgr2=0x55e50017a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:02.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.674+0000 7fa8dc257740 1 --2- 172.21.15.79:0/1865109012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e500154880 0x55e50017a5b0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fa8c40057c0 tx=0x7fa8c402a410 comp rx=0 tx=0).stop 2024-08-20T01:45:02.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.674+0000 7fa8dc257740 1 -- 172.21.15.79:0/1865109012 shutdown_connections 2024-08-20T01:45:02.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.674+0000 7fa8dc257740 1 --2- 172.21.15.79:0/1865109012 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55e5001ece90 0x55e5001ef2b0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:02.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.674+0000 7fa8dc257740 1 --2- 172.21.15.79:0/1865109012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e500161130 0x55e500176010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:02.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.674+0000 7fa8dc257740 1 --2- 172.21.15.79:0/1865109012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5001551a0 0x55e500175ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:02.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.674+0000 7fa8dc257740 1 --2- 172.21.15.79:0/1865109012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e500154880 0x55e50017a5b0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:02.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.674+0000 7fa8dc257740 1 -- 172.21.15.79:0/1865109012 >> 172.21.15.79:0/1865109012 conn(0x55e5001526b0 msgr2=0x55e500151770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:02.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.674+0000 7fa8b2ffd640 0 client.17715 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:45:02.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.674+0000 7fa8dc257740 1 -- 172.21.15.79:0/1865109012 shutdown_connections 2024-08-20T01:45:02.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.674+0000 7fa8dc257740 1 -- 172.21.15.79:0/1865109012 wait complete. 2024-08-20T01:45:02.760 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:45:02.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.674+0000 7fa8dc257740 20 client.17715 trim_cache size 0 max 16384 2024-08-20T01:45:02.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.675+0000 7fa8d9e5e640 1 -- 172.21.15.79:0/2318095618 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa8bc0b3bd0 msgr2=0x7fa8bc0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:02.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.675+0000 7fa8d9e5e640 1 --2- 172.21.15.79:0/2318095618 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa8bc0b3bd0 0x7fa8bc0b6090 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x55e500154830 tx=0x7fa8c8006da0 comp rx=0 tx=0).stop 2024-08-20T01:45:02.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.675+0000 7fa8d9e5e640 1 -- 172.21.15.79:0/2318095618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8d4108e60 msgr2=0x7fa8d4075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:02.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.675+0000 7fa8d9e5e640 1 --2- 172.21.15.79:0/2318095618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8d4108e60 0x7fa8d4075c50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc00be20 tx=0x7fa8cc00bf10 comp rx=0 tx=0).stop 2024-08-20T01:45:02.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.675+0000 7fa8d9e5e640 1 -- 172.21.15.79:0/2318095618 shutdown_connections 2024-08-20T01:45:02.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.675+0000 7fa8d9e5e640 1 --2- 172.21.15.79:0/2318095618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8d4108e60 0x7fa8d4075c50 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:02.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.675+0000 7fa8d9e5e640 1 --2- 172.21.15.79:0/2318095618 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa8bc0b3bd0 0x7fa8bc0b6090 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:02.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.675+0000 7fa8d9e5e640 1 --2- 172.21.15.79:0/2318095618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8d41084e0 0x7fa8d4075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:02.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.675+0000 7fa8d9e5e640 1 --2- 172.21.15.79:0/2318095618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8d4102ad0 0x7fa8d40751d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:02.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.675+0000 7fa8d9e5e640 1 -- 172.21.15.79:0/2318095618 >> 172.21.15.79:0/2318095618 conn(0x7fa8d40fe540 msgr2=0x7fa8d4100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:02.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.675+0000 7fa8d9e5e640 1 -- 172.21.15.79:0/2318095618 shutdown_connections 2024-08-20T01:45:02.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:02.675+0000 7fa8d9e5e640 1 -- 172.21.15.79:0/2318095618 wait complete. 2024-08-20T01:45:03.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:03 smithi079 ceph-mon[18656]: pgmap v579: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-08-20T01:45:04.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:03 smithi081 ceph-mon[22209]: pgmap v579: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-08-20T01:45:04.124 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-20T01:45:04.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:03 smithi175 ceph-mon[22392]: pgmap v579: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-08-20T01:45:04.407 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:45:04.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.927+0000 7f1bf1446640 1 -- 172.21.15.79:0/2925064708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bec102ad0 msgr2=0x7f1bec102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:04.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.927+0000 7f1bf1446640 1 --2- 172.21.15.79:0/2925064708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bec102ad0 0x7f1bec102eb0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc009900 tx=0x7f1bdc02a3f0 comp rx=0 tx=0).stop 2024-08-20T01:45:04.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.928+0000 7f1bf1446640 1 -- 172.21.15.79:0/2925064708 shutdown_connections 2024-08-20T01:45:04.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.928+0000 7f1bf1446640 1 --2- 172.21.15.79:0/2925064708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bec108e60 0x7f1bec10f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:04.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.928+0000 7f1bf1446640 1 --2- 172.21.15.79:0/2925064708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bec1084e0 0x7f1bec108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:04.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.928+0000 7f1bf1446640 1 --2- 172.21.15.79:0/2925064708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bec102ad0 0x7f1bec102eb0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:04.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.928+0000 7f1bf1446640 1 -- 172.21.15.79:0/2925064708 >> 172.21.15.79:0/2925064708 conn(0x7f1bec0fe540 msgr2=0x7f1bec100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:04.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.928+0000 7f1bf1446640 1 -- 172.21.15.79:0/2925064708 shutdown_connections 2024-08-20T01:45:04.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.928+0000 7f1bf1446640 1 -- 172.21.15.79:0/2925064708 wait complete. 2024-08-20T01:45:04.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.928+0000 7f1bf1446640 1 Processor -- start 2024-08-20T01:45:04.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.929+0000 7f1bf1446640 1 -- start start 2024-08-20T01:45:04.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.929+0000 7f1bf1446640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bec102ad0 0x7f1bec198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:04.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.929+0000 7f1bf1446640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bec1084e0 0x7f1bec199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:04.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.929+0000 7f1bf1446640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bec108e60 0x7f1bec19e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:04.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.929+0000 7f1bf1446640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1bec1129d0 con 0x7f1bec108e60 2024-08-20T01:45:04.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.929+0000 7f1bf1446640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1bec112850 con 0x7f1bec102ad0 2024-08-20T01:45:04.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.929+0000 7f1bf1446640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1bec112b50 con 0x7f1bec1084e0 2024-08-20T01:45:04.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.929+0000 7f1beb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bec108e60 0x7f1bec19e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:04.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.929+0000 7f1beb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bec108e60 0x7f1bec19e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46716/0 (socket says 172.21.15.79:46716) 2024-08-20T01:45:04.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.929+0000 7f1beb7fe640 1 -- 172.21.15.79:0/3158638221 learned_addr learned my addr 172.21.15.79:0/3158638221 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:04.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.929+0000 7f1beaffd640 1 --2- 172.21.15.79:0/3158638221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bec102ad0 0x7f1bec198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:04.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.929+0000 7f1bea7fc640 1 --2- 172.21.15.79:0/3158638221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bec1084e0 0x7f1bec199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:04.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.929+0000 7f1beb7fe640 1 -- 172.21.15.79:0/3158638221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bec1084e0 msgr2=0x7f1bec199420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:04.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.929+0000 7f1beb7fe640 1 --2- 172.21.15.79:0/3158638221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bec1084e0 0x7f1bec199420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:04.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.929+0000 7f1beb7fe640 1 -- 172.21.15.79:0/3158638221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bec102ad0 msgr2=0x7f1bec198ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:04.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.929+0000 7f1beb7fe640 1 --2- 172.21.15.79:0/3158638221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bec102ad0 0x7f1bec198ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:04.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.929+0000 7f1beb7fe640 1 -- 172.21.15.79:0/3158638221 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bec19ef90 con 0x7f1bec108e60 2024-08-20T01:45:04.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.929+0000 7f1bea7fc640 1 --2- 172.21.15.79:0/3158638221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bec1084e0 0x7f1bec199420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:45:04.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.929+0000 7f1beb7fe640 1 --2- 172.21.15.79:0/3158638221 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bec108e60 0x7f1bec19e7c0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f1be400cce0 tx=0x7f1be400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:04.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.930+0000 7f1bd3fff640 1 -- 172.21.15.79:0/3158638221 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be400f450 con 0x7f1bec108e60 2024-08-20T01:45:04.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.930+0000 7f1bd3fff640 1 -- 172.21.15.79:0/3158638221 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1be400fa80 con 0x7f1bec108e60 2024-08-20T01:45:04.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.930+0000 7f1bf1446640 1 -- 172.21.15.79:0/3158638221 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bec19f280 con 0x7f1bec108e60 2024-08-20T01:45:04.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.930+0000 7f1bd3fff640 1 -- 172.21.15.79:0/3158638221 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be4018ad0 con 0x7f1bec108e60 2024-08-20T01:45:04.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.930+0000 7f1bf1446640 1 -- 172.21.15.79:0/3158638221 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bec1a5940 con 0x7f1bec108e60 2024-08-20T01:45:04.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.933+0000 7f1bf383f740 1 Processor -- start 2024-08-20T01:45:04.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.933+0000 7f1bd3fff640 1 -- 172.21.15.79:0/3158638221 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1be400f5f0 con 0x7f1bec108e60 2024-08-20T01:45:04.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.933+0000 7f1bf383f740 1 -- start start 2024-08-20T01:45:04.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.933+0000 7f1bf383f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616884ae880 0x5616884aec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:04.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.933+0000 7f1bf383f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616884af1a0 0x5616884babf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:04.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.933+0000 7f1bf383f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616884bb130 0x5616884bd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:04.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.933+0000 7f1bf383f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561688425930 con 0x5616884af1a0 2024-08-20T01:45:04.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.933+0000 7f1bf383f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561688414e30 con 0x5616884ae880 2024-08-20T01:45:04.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.933+0000 7f1bf383f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561688418e70 con 0x5616884bb130 2024-08-20T01:45:04.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.933+0000 7f1beaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616884af1a0 0x5616884babf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:04.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.933+0000 7f1beaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616884af1a0 0x5616884babf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46726/0 (socket says 172.21.15.79:46726) 2024-08-20T01:45:04.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.933+0000 7f1beaffd640 1 -- 172.21.15.79:0/4160307889 learned_addr learned my addr 172.21.15.79:0/4160307889 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:04.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.933+0000 7f1bea7fc640 1 --2- 172.21.15.79:0/4160307889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616884ae880 0x5616884aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:04.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.933+0000 7f1bea7fc640 1 --2- 172.21.15.79:0/4160307889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616884bb130 0x5616884bd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:04.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.933+0000 7f1beaffd640 1 -- 172.21.15.79:0/4160307889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616884bb130 msgr2=0x5616884bd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:04.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.933+0000 7f1beaffd640 1 --2- 172.21.15.79:0/4160307889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616884bb130 0x5616884bd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:04.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.933+0000 7f1beaffd640 1 -- 172.21.15.79:0/4160307889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616884ae880 msgr2=0x5616884aec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:04.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.933+0000 7f1beaffd640 1 --2- 172.21.15.79:0/4160307889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616884ae880 0x5616884aec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:04.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.933+0000 7f1beaffd640 1 -- 172.21.15.79:0/4160307889 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561688174650 con 0x5616884af1a0 2024-08-20T01:45:04.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.934+0000 7f1bd3fff640 1 --2- 172.21.15.79:0/3158638221 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1bd40b3bd0 0x7f1bd40b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:04.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.934+0000 7f1beaffd640 1 --2- 172.21.15.79:0/4160307889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616884af1a0 0x5616884babf0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc033000 tx=0x7f1bdc031db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65e0020593cb16d5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:04.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.934+0000 7f1bea7fc640 1 --2- 172.21.15.79:0/3158638221 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1bd40b3bd0 0x7f1bd40b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:04.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.934+0000 7f1bd3fff640 1 -- 172.21.15.79:0/3158638221 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f1be40e43f0 con 0x7f1bec108e60 2024-08-20T01:45:04.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.934+0000 7f1bd17fa640 1 -- 172.21.15.79:0/4160307889 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc035030 con 0x5616884af1a0 2024-08-20T01:45:04.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.934+0000 7f1bd17fa640 1 -- 172.21.15.79:0/4160307889 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1bdc0044c0 con 0x5616884af1a0 2024-08-20T01:45:04.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.934+0000 7f1bd17fa640 1 -- 172.21.15.79:0/4160307889 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc003a50 con 0x5616884af1a0 2024-08-20T01:45:04.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.935+0000 7f1bf383f740 1 -- 172.21.15.79:0/4160307889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616884af1a0 msgr2=0x5616884babf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:04.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.935+0000 7f1bea7fc640 1 --2- 172.21.15.79:0/3158638221 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1bd40b3bd0 0x7f1bd40b6090 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1be0005fd0 tx=0x7f1be000d3c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:04.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.935+0000 7f1bf383f740 1 --2- 172.21.15.79:0/4160307889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616884af1a0 0x5616884babf0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc033000 tx=0x7f1bdc031db0 comp rx=0 tx=0).stop 2024-08-20T01:45:04.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.935+0000 7f1bf383f740 1 -- 172.21.15.79:0/4160307889 shutdown_connections 2024-08-20T01:45:04.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.935+0000 7f1bf383f740 1 --2- 172.21.15.79:0/4160307889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616884bb130 0x5616884bd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:04.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.935+0000 7f1bf383f740 1 --2- 172.21.15.79:0/4160307889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616884af1a0 0x5616884babf0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:04.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.935+0000 7f1bf383f740 1 --2- 172.21.15.79:0/4160307889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616884ae880 0x5616884aec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:04.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.935+0000 7f1bf383f740 1 -- 172.21.15.79:0/4160307889 >> 172.21.15.79:0/4160307889 conn(0x5616884ac6b0 msgr2=0x5616884ad850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:04.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.935+0000 7f1bf383f740 1 -- 172.21.15.79:0/4160307889 shutdown_connections 2024-08-20T01:45:04.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.935+0000 7f1bf383f740 1 -- 172.21.15.79:0/4160307889 wait complete. 2024-08-20T01:45:04.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.935+0000 7f1bf383f740 1 -- start start 2024-08-20T01:45:04.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.935+0000 7f1bf383f740 1 Processor -- start 2024-08-20T01:45:04.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.936+0000 7f1bf383f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616884ae880 0x5616884b80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:04.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.936+0000 7f1bf383f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616884af1a0 0x5616884b8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:04.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.936+0000 7f1bf383f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616884bb130 0x5616884b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:04.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.936+0000 7f1bf383f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561688277700 con 0x5616884af1a0 2024-08-20T01:45:04.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.936+0000 7f1bf383f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56168839b810 con 0x5616884bb130 2024-08-20T01:45:04.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.936+0000 7f1bf383f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5616884bdd80 con 0x5616884ae880 2024-08-20T01:45:04.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.936+0000 7f1bea7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616884af1a0 0x5616884b8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:04.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.936+0000 7f1bea7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616884af1a0 0x5616884b8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46734/0 (socket says 172.21.15.79:46734) 2024-08-20T01:45:04.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.936+0000 7f1bea7fc640 1 -- 172.21.15.79:0/1211832968 learned_addr learned my addr 172.21.15.79:0/1211832968 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:04.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.936+0000 7f1beaffd640 1 --2- 172.21.15.79:0/1211832968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616884ae880 0x5616884b80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:04.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.936+0000 7f1bf383f740 10 client.0 _ll_register_callbacks cb 0x56168840e700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:45:04.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.936+0000 7f1beb7fe640 1 --2- 172.21.15.79:0/1211832968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616884bb130 0x5616884b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:04.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.936+0000 7f1bea7fc640 1 -- 172.21.15.79:0/1211832968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616884ae880 msgr2=0x5616884b80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:04.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.936+0000 7f1bea7fc640 1 --2- 172.21.15.79:0/1211832968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616884ae880 0x5616884b80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:04.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.936+0000 7f1bea7fc640 1 -- 172.21.15.79:0/1211832968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616884bb130 msgr2=0x5616884b8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:04.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.936+0000 7f1bea7fc640 1 --2- 172.21.15.79:0/1211832968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616884bb130 0x5616884b8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:04.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.936+0000 7f1bea7fc640 1 -- 172.21.15.79:0/1211832968 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616884c7190 con 0x5616884af1a0 2024-08-20T01:45:04.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.936+0000 7f1bea7fc640 1 --2- 172.21.15.79:0/1211832968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616884af1a0 0x5616884b8620 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f1be0011af0 tx=0x7f1be0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6c70518ed26b106 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:04.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.936+0000 7f1bceff5640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:45:04.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.937+0000 7f1bceff5640 1 -- 172.21.15.79:0/1211832968 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be0024070 con 0x5616884af1a0 2024-08-20T01:45:04.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.937+0000 7f1bceff5640 1 -- 172.21.15.79:0/1211832968 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f1be000fd90 con 0x5616884af1a0 2024-08-20T01:45:04.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.937+0000 7f1bf383f740 1 -- 172.21.15.79:0/1211832968 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5616883c4150 con 0x5616884af1a0 2024-08-20T01:45:04.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.937+0000 7f1bceff5640 1 -- 172.21.15.79:0/1211832968 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f1be002f050 con 0x5616884af1a0 2024-08-20T01:45:04.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.937+0000 7f1bf383f740 10 client.17727 fetch_fsmap learned FSMap version 42 2024-08-20T01:45:04.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.937+0000 7f1bf383f740 1 -- 172.21.15.79:0/1211832968 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5616884c9b80 con 0x5616884af1a0 2024-08-20T01:45:04.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.937+0000 7f1bceff5640 1 -- 172.21.15.79:0/1211832968 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5616883c4150 con 0x5616884af1a0 2024-08-20T01:45:04.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.937+0000 7f1bceff5640 1 -- 172.21.15.79:0/1211832968 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 42) ==== 8390+0+0 (secure 0 0 0) 0x7f1be0004bf0 con 0x5616884af1a0 2024-08-20T01:45:04.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.937+0000 7f1bf383f740 10 client.17727 fetch_fsmap finished waiting for FSMap version 42 2024-08-20T01:45:04.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.937+0000 7f1bf383f740 10 client.17727 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:45:04.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.937+0000 7f1bf383f740 20 client.17727 populate_metadata read hostname 'smithi079' 2024-08-20T01:45:04.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.937+0000 7f1bf383f740 1 --2- 172.21.15.79:0/1211832968 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5616884cb080 0x5616884cd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:04.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.937+0000 7f1bf383f740 4 client.17727 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:45:04.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.937+0000 7f1bf383f740 1 -- 172.21.15.79:0/1211832968 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561688427880 con 0x5616884cb080 2024-08-20T01:45:04.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.938+0000 7f1beaffd640 1 --2- 172.21.15.79:0/1211832968 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5616884cb080 0x5616884cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:04.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.938+0000 7f1beaffd640 1 --2- 172.21.15.79:0/1211832968 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5616884cb080 0x5616884cd490 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5b3adb4ffd3eb94d server_cookie=39475e8514001f7f in_seq=0 out_seq=0 2024-08-20T01:45:04.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.938+0000 7f1bceff5640 10 client.17727 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:45:04.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.939+0000 7f1bceff5640 1 -- 172.21.15.79:0/1211832968 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561688427880 con 0x5616884cb080 2024-08-20T01:45:04.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.939+0000 7f1bceff5640 10 client.17727 handle_command_reply: tid=0 2024-08-20T01:45:04.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.939+0000 7f1bf383f740 1 client.17727 shutdown 2024-08-20T01:45:04.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.939+0000 7f1bf383f740 1 -- 172.21.15.79:0/1211832968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616884af1a0 msgr2=0x5616884b8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:04.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.939+0000 7f1bf383f740 1 --2- 172.21.15.79:0/1211832968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616884af1a0 0x5616884b8620 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f1be0011af0 tx=0x7f1be0004730 comp rx=0 tx=0).stop 2024-08-20T01:45:04.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.939+0000 7f1bf383f740 1 -- 172.21.15.79:0/1211832968 shutdown_connections 2024-08-20T01:45:04.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.939+0000 7f1bf383f740 1 --2- 172.21.15.79:0/1211832968 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5616884cb080 0x5616884cd490 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:04.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.939+0000 7f1bf383f740 1 --2- 172.21.15.79:0/1211832968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616884bb130 0x5616884b8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:04.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.939+0000 7f1bf383f740 1 --2- 172.21.15.79:0/1211832968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616884af1a0 0x5616884b8620 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:04.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.939+0000 7f1bceff5640 0 client.17727 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:45:04.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.939+0000 7f1bf383f740 1 --2- 172.21.15.79:0/1211832968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616884ae880 0x5616884b80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:04.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.939+0000 7f1bf383f740 1 -- 172.21.15.79:0/1211832968 >> 172.21.15.79:0/1211832968 conn(0x5616884ac6b0 msgr2=0x5616884b2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:04.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.939+0000 7f1bf383f740 1 -- 172.21.15.79:0/1211832968 shutdown_connections 2024-08-20T01:45:04.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.939+0000 7f1bf383f740 1 -- 172.21.15.79:0/1211832968 wait complete. 2024-08-20T01:45:04.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.939+0000 7f1bf383f740 20 client.17727 trim_cache size 0 max 16384 2024-08-20T01:45:04.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.953+0000 7f1bf383f740 1 Processor -- start 2024-08-20T01:45:04.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.953+0000 7f1bf383f740 1 -- start start 2024-08-20T01:45:04.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.954+0000 7f1bf383f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616884ae880 0x5616884d2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:04.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.954+0000 7f1bf383f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616884af1a0 0x5616884d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:04.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.954+0000 7f1bf383f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616884bb130 0x5616884c3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:04.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.954+0000 7f1bf383f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1bec1adee0 con 0x5616884bb130 2024-08-20T01:45:04.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.954+0000 7f1bf383f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1bec1afb70 con 0x5616884af1a0 2024-08-20T01:45:04.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.954+0000 7f1bf383f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1bec1ae5b0 con 0x5616884ae880 2024-08-20T01:45:04.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.954+0000 7f1beb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616884bb130 0x5616884c3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:04.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.954+0000 7f1beb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616884bb130 0x5616884c3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46742/0 (socket says 172.21.15.79:46742) 2024-08-20T01:45:04.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.954+0000 7f1beb7fe640 1 -- 172.21.15.79:0/4220637356 learned_addr learned my addr 172.21.15.79:0/4220637356 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:04.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.954+0000 7f1beaffd640 1 --2- 172.21.15.79:0/4220637356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616884ae880 0x5616884d2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:04.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.954+0000 7f1bea7fc640 1 --2- 172.21.15.79:0/4220637356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616884af1a0 0x5616884d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:04.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.954+0000 7f1beb7fe640 1 -- 172.21.15.79:0/4220637356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616884ae880 msgr2=0x5616884d2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:04.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.954+0000 7f1beb7fe640 1 --2- 172.21.15.79:0/4220637356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616884ae880 0x5616884d2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:04.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.954+0000 7f1beb7fe640 1 -- 172.21.15.79:0/4220637356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616884af1a0 msgr2=0x5616884d32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:04.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.954+0000 7f1beb7fe640 1 --2- 172.21.15.79:0/4220637356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616884af1a0 0x5616884d32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:04.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.954+0000 7f1beb7fe640 1 -- 172.21.15.79:0/4220637356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616884ad130 con 0x5616884bb130 2024-08-20T01:45:04.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.954+0000 7f1bea7fc640 1 --2- 172.21.15.79:0/4220637356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616884af1a0 0x5616884d32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:45:04.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.954+0000 7f1beb7fe640 1 --2- 172.21.15.79:0/4220637356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616884bb130 0x5616884c3030 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f1be4005ba0 tx=0x7f1be400f8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d96d7183dac1696 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:04.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.954+0000 7f1bd0ff9640 1 -- 172.21.15.79:0/4220637356 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be40ab350 con 0x5616884bb130 2024-08-20T01:45:04.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.955+0000 7f1bd0ff9640 1 -- 172.21.15.79:0/4220637356 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1be40af950 con 0x5616884bb130 2024-08-20T01:45:04.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.955+0000 7f1bd0ff9640 1 -- 172.21.15.79:0/4220637356 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be40ab810 con 0x5616884bb130 2024-08-20T01:45:04.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.955+0000 7f1bf383f740 1 -- 172.21.15.79:0/4220637356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616884bb130 msgr2=0x5616884c3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:04.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.955+0000 7f1bf383f740 1 --2- 172.21.15.79:0/4220637356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616884bb130 0x5616884c3030 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f1be4005ba0 tx=0x7f1be400f8e0 comp rx=0 tx=0).stop 2024-08-20T01:45:04.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.955+0000 7f1bf383f740 1 -- 172.21.15.79:0/4220637356 shutdown_connections 2024-08-20T01:45:04.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.955+0000 7f1bf383f740 1 --2- 172.21.15.79:0/4220637356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616884bb130 0x5616884c3030 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:04.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.955+0000 7f1bf383f740 1 --2- 172.21.15.79:0/4220637356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616884af1a0 0x5616884d32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:04.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.955+0000 7f1bf383f740 1 --2- 172.21.15.79:0/4220637356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616884ae880 0x5616884d2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:04.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.955+0000 7f1bf383f740 1 -- 172.21.15.79:0/4220637356 >> 172.21.15.79:0/4220637356 conn(0x5616884ac6b0 msgr2=0x5616884b9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:04.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.956+0000 7f1bf383f740 1 -- 172.21.15.79:0/4220637356 shutdown_connections 2024-08-20T01:45:04.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.956+0000 7f1bf383f740 1 -- 172.21.15.79:0/4220637356 wait complete. 2024-08-20T01:45:04.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.956+0000 7f1bf383f740 1 -- start start 2024-08-20T01:45:04.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.956+0000 7f1bf383f740 1 Processor -- start 2024-08-20T01:45:04.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.956+0000 7f1bf383f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616884ae880 0x5616884c08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:04.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.956+0000 7f1bf383f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616884af1a0 0x5616884c0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:04.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.956+0000 7f1bf383f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616884bb130 0x5616885321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:04.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.956+0000 7f1bf383f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1bec1af3e0 con 0x5616884af1a0 2024-08-20T01:45:04.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.956+0000 7f1bf383f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1bec1aec80 con 0x5616884ae880 2024-08-20T01:45:04.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.956+0000 7f1bf383f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1bec1abec0 con 0x5616884bb130 2024-08-20T01:45:04.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.956+0000 7f1bf383f740 10 client.0 _ll_register_callbacks cb 0x7f1be000df00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:45:04.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.956+0000 7f1bea7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616884af1a0 0x5616884c0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:04.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.956+0000 7f1bea7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616884af1a0 0x5616884c0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46746/0 (socket says 172.21.15.79:46746) 2024-08-20T01:45:04.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.956+0000 7f1bea7fc640 1 -- 172.21.15.79:0/2108737018 learned_addr learned my addr 172.21.15.79:0/2108737018 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:04.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.956+0000 7f1beaffd640 1 --2- 172.21.15.79:0/2108737018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616884ae880 0x5616884c08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:04.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.956+0000 7f1beb7fe640 1 --2- 172.21.15.79:0/2108737018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616884bb130 0x5616885321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:04.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.957+0000 7f1bea7fc640 1 -- 172.21.15.79:0/2108737018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616884bb130 msgr2=0x5616885321f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:04.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.957+0000 7f1bea7fc640 1 --2- 172.21.15.79:0/2108737018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616884bb130 0x5616885321f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:04.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.957+0000 7f1bea7fc640 1 -- 172.21.15.79:0/2108737018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616884ae880 msgr2=0x5616884c08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:04.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.957+0000 7f1bea7fc640 1 --2- 172.21.15.79:0/2108737018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616884ae880 0x5616884c08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:04.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.957+0000 7f1bea7fc640 1 -- 172.21.15.79:0/2108737018 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561688532930 con 0x5616884af1a0 2024-08-20T01:45:04.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.957+0000 7f1beaffd640 1 --2- 172.21.15.79:0/2108737018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616884ae880 0x5616884c08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:45:04.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.957+0000 7f1bea7fc640 1 --2- 172.21.15.79:0/2108737018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616884af1a0 0x5616884c0e60 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x5616884ba9d0 tx=0x7f1be00117f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37e93efe04a8ec12 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:04.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.957+0000 7f1bceff5640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:45:04.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.957+0000 7f1bceff5640 1 -- 172.21.15.79:0/2108737018 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be0024040 con 0x5616884af1a0 2024-08-20T01:45:04.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.957+0000 7f1bceff5640 1 -- 172.21.15.79:0/2108737018 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f1be000fd90 con 0x5616884af1a0 2024-08-20T01:45:04.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.957+0000 7f1bf383f740 1 -- 172.21.15.79:0/2108737018 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1be40af950 con 0x5616884af1a0 2024-08-20T01:45:04.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.957+0000 7f1bceff5640 1 -- 172.21.15.79:0/2108737018 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f1be0044050 con 0x5616884af1a0 2024-08-20T01:45:04.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.957+0000 7f1bf383f740 10 client.17733 fetch_fsmap learned FSMap version 42 2024-08-20T01:45:04.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.957+0000 7f1bf383f740 1 -- 172.21.15.79:0/2108737018 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x561688539ce0 con 0x5616884af1a0 2024-08-20T01:45:04.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.958+0000 7f1bceff5640 1 -- 172.21.15.79:0/2108737018 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1be0020dd0 con 0x5616884af1a0 2024-08-20T01:45:04.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.958+0000 7f1bceff5640 1 -- 172.21.15.79:0/2108737018 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 42) ==== 8390+0+0 (secure 0 0 0) 0x7f1be0004fc0 con 0x5616884af1a0 2024-08-20T01:45:04.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.958+0000 7f1bf383f740 10 client.17733 fetch_fsmap finished waiting for FSMap version 42 2024-08-20T01:45:04.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.958+0000 7f1bf383f740 10 client.17733 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:45:04.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.958+0000 7f1bf383f740 20 client.17733 populate_metadata read hostname 'smithi079' 2024-08-20T01:45:04.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.958+0000 7f1bf383f740 1 --2- 172.21.15.79:0/2108737018 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x56168853a490 0x56168853c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:04.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.958+0000 7f1bf383f740 4 client.17733 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:45:04.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.958+0000 7f1bf383f740 1 -- 172.21.15.79:0/2108737018 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f1be40af950 con 0x56168853a490 2024-08-20T01:45:04.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.958+0000 7f1beaffd640 1 --2- 172.21.15.79:0/2108737018 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x56168853a490 0x56168853c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:04.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.959+0000 7f1bceff5640 10 client.17733 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:45:04.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.959+0000 7f1beaffd640 1 --2- 172.21.15.79:0/2108737018 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x56168853a490 0x56168853c8b0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=506447208d6389f4 server_cookie=3e12dfdb1a02caec in_seq=0 out_seq=0 2024-08-20T01:45:04.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.959+0000 7f1bceff5640 1 -- 172.21.15.79:0/2108737018 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f1be40af950 con 0x56168853a490 2024-08-20T01:45:04.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.959+0000 7f1bceff5640 10 client.17733 handle_command_reply: tid=0 2024-08-20T01:45:04.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.959+0000 7f1bf383f740 1 client.17733 shutdown 2024-08-20T01:45:04.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.959+0000 7f1bf383f740 1 -- 172.21.15.79:0/2108737018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616884af1a0 msgr2=0x5616884c0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:04.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.959+0000 7f1bf383f740 1 --2- 172.21.15.79:0/2108737018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616884af1a0 0x5616884c0e60 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x5616884ba9d0 tx=0x7f1be00117f0 comp rx=0 tx=0).stop 2024-08-20T01:45:04.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.959+0000 7f1bf383f740 1 -- 172.21.15.79:0/2108737018 shutdown_connections 2024-08-20T01:45:04.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.959+0000 7f1bf383f740 1 --2- 172.21.15.79:0/2108737018 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x56168853a490 0x56168853c8b0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:04.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.959+0000 7f1bf383f740 1 --2- 172.21.15.79:0/2108737018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5616884bb130 0x5616885321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:04.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.959+0000 7f1bf383f740 1 --2- 172.21.15.79:0/2108737018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5616884af1a0 0x5616884c0e60 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:04.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.959+0000 7f1bf383f740 1 --2- 172.21.15.79:0/2108737018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616884ae880 0x5616884c08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:04.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.959+0000 7f1bf383f740 1 -- 172.21.15.79:0/2108737018 >> 172.21.15.79:0/2108737018 conn(0x5616884ac6b0 msgr2=0x5616884b1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:04.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.959+0000 7f1bceff5640 0 client.17733 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:45:04.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.959+0000 7f1bf383f740 1 -- 172.21.15.79:0/2108737018 shutdown_connections 2024-08-20T01:45:04.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.959+0000 7f1bf383f740 1 -- 172.21.15.79:0/2108737018 wait complete. 2024-08-20T01:45:04.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.959+0000 7f1bf383f740 20 client.17733 trim_cache size 0 max 16384 2024-08-20T01:45:04.969 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:45:04.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.960+0000 7f1bf1446640 1 -- 172.21.15.79:0/3158638221 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1bd40b3bd0 msgr2=0x7f1bd40b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:04.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.960+0000 7f1bf1446640 1 --2- 172.21.15.79:0/3158638221 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1bd40b3bd0 0x7f1bd40b6090 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1be0005fd0 tx=0x7f1be000d3c0 comp rx=0 tx=0).stop 2024-08-20T01:45:04.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.960+0000 7f1bf1446640 1 -- 172.21.15.79:0/3158638221 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bec108e60 msgr2=0x7f1bec19e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:04.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.960+0000 7f1bf1446640 1 --2- 172.21.15.79:0/3158638221 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bec108e60 0x7f1bec19e7c0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f1be400cce0 tx=0x7f1be400a620 comp rx=0 tx=0).stop 2024-08-20T01:45:04.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.960+0000 7f1bf1446640 1 -- 172.21.15.79:0/3158638221 shutdown_connections 2024-08-20T01:45:04.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.960+0000 7f1bf1446640 1 --2- 172.21.15.79:0/3158638221 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bec108e60 0x7f1bec19e7c0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:04.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.960+0000 7f1bf1446640 1 --2- 172.21.15.79:0/3158638221 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1bd40b3bd0 0x7f1bd40b6090 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:04.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.960+0000 7f1bf1446640 1 --2- 172.21.15.79:0/3158638221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bec1084e0 0x7f1bec199420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:04.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.960+0000 7f1bf1446640 1 --2- 172.21.15.79:0/3158638221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bec102ad0 0x7f1bec198ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:04.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.960+0000 7f1bf1446640 1 -- 172.21.15.79:0/3158638221 >> 172.21.15.79:0/3158638221 conn(0x7f1bec0fe540 msgr2=0x7f1bec0ffdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:04.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.960+0000 7f1bf1446640 1 -- 172.21.15.79:0/3158638221 shutdown_connections 2024-08-20T01:45:04.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:04.960+0000 7f1bf1446640 1 -- 172.21.15.79:0/3158638221 wait complete. 2024-08-20T01:45:05.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.482+0000 7fc3a46c5640 1 -- 172.21.15.79:0/3965021794 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc39c101560 msgr2=0x7fc39c101960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:05.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.482+0000 7fc3a46c5640 1 --2- 172.21.15.79:0/3965021794 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc39c101560 0x7fc39c101960 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fc398009930 tx=0x7fc39802a420 comp rx=0 tx=0).stop 2024-08-20T01:45:05.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.482+0000 7fc3a46c5640 1 -- 172.21.15.79:0/3965021794 shutdown_connections 2024-08-20T01:45:05.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.482+0000 7fc3a46c5640 1 --2- 172.21.15.79:0/3965021794 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc39c103070 0x7fc39c1099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:05.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.482+0000 7fc3a46c5640 1 --2- 172.21.15.79:0/3965021794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc39c1026b0 0x7fc39c102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:05.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.482+0000 7fc3a46c5640 1 --2- 172.21.15.79:0/3965021794 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc39c101560 0x7fc39c101960 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:05.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.482+0000 7fc3a46c5640 1 -- 172.21.15.79:0/3965021794 >> 172.21.15.79:0/3965021794 conn(0x7fc39c0fce40 msgr2=0x7fc39c0ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:05.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.482+0000 7fc3a46c5640 1 -- 172.21.15.79:0/3965021794 shutdown_connections 2024-08-20T01:45:05.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.482+0000 7fc3a46c5640 1 -- 172.21.15.79:0/3965021794 wait complete. 2024-08-20T01:45:05.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.482+0000 7fc3a46c5640 1 Processor -- start 2024-08-20T01:45:05.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.483+0000 7fc3a46c5640 1 -- start start 2024-08-20T01:45:05.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.483+0000 7fc3a46c5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc39c101560 0x7fc39c105320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:05.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.483+0000 7fc3a46c5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc39c1026b0 0x7fc39c103b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:05.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.483+0000 7fc3a46c5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc39c103070 0x7fc39c1040c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:05.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.483+0000 7fc3a46c5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc39c10d090 con 0x7fc39c1026b0 2024-08-20T01:45:05.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.483+0000 7fc3a46c5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc39c10cf10 con 0x7fc39c103070 2024-08-20T01:45:05.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.483+0000 7fc3a46c5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc39c10d210 con 0x7fc39c101560 2024-08-20T01:45:05.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.483+0000 7fc3a1c60640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc39c1026b0 0x7fc39c103b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:05.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.483+0000 7fc3a1c60640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc39c1026b0 0x7fc39c103b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46758/0 (socket says 172.21.15.79:46758) 2024-08-20T01:45:05.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.483+0000 7fc3a1c60640 1 -- 172.21.15.79:0/1930335904 learned_addr learned my addr 172.21.15.79:0/1930335904 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:05.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.483+0000 7fc3a2461640 1 --2- 172.21.15.79:0/1930335904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc39c101560 0x7fc39c105320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:05.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.483+0000 7fc3a2c62640 1 --2- 172.21.15.79:0/1930335904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc39c103070 0x7fc39c1040c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:05.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.483+0000 7fc3a1c60640 1 -- 172.21.15.79:0/1930335904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc39c101560 msgr2=0x7fc39c105320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:05.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.483+0000 7fc3a1c60640 1 --2- 172.21.15.79:0/1930335904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc39c101560 0x7fc39c105320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:05.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.483+0000 7fc3a1c60640 1 -- 172.21.15.79:0/1930335904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc39c103070 msgr2=0x7fc39c1040c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:05.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.483+0000 7fc3a1c60640 1 --2- 172.21.15.79:0/1930335904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc39c103070 0x7fc39c1040c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:05.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.483+0000 7fc3a1c60640 1 -- 172.21.15.79:0/1930335904 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc39c104930 con 0x7fc39c1026b0 2024-08-20T01:45:05.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.483+0000 7fc3a1c60640 1 --2- 172.21.15.79:0/1930335904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc39c1026b0 0x7fc39c103b80 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fc38c00c920 tx=0x7fc38c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:05.489 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.483+0000 7fc3937fe640 1 -- 172.21.15.79:0/1930335904 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38c007c70 con 0x7fc39c1026b0 2024-08-20T01:45:05.489 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.484+0000 7fc3a46c5640 1 -- 172.21.15.79:0/1930335904 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc39c1a2a40 con 0x7fc39c1026b0 2024-08-20T01:45:05.489 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.484+0000 7fc3937fe640 1 -- 172.21.15.79:0/1930335904 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc38c007e10 con 0x7fc39c1026b0 2024-08-20T01:45:05.489 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.484+0000 7fc3937fe640 1 -- 172.21.15.79:0/1930335904 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38c0186f0 con 0x7fc39c1026b0 2024-08-20T01:45:05.489 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.484+0000 7fc3a46c5640 1 -- 172.21.15.79:0/1930335904 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc39c1a2fb0 con 0x7fc39c1026b0 2024-08-20T01:45:05.495 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.486+0000 7fc3937fe640 1 -- 172.21.15.79:0/1930335904 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc38c00f450 con 0x7fc39c1026b0 2024-08-20T01:45:05.495 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.486+0000 7fc3a74bc740 1 Processor -- start 2024-08-20T01:45:05.495 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.487+0000 7fc3a74bc740 1 -- start start 2024-08-20T01:45:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.487+0000 7fc3a74bc740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55964ce81630 0x55964ce83a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.487+0000 7fc3a74bc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55964ce83f60 0x55964ce86350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.487+0000 7fc3a74bc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55964ce869a0 0x55964ce88e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.487+0000 7fc3a74bc740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55964cdf4360 con 0x55964ce81630 2024-08-20T01:45:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.487+0000 7fc3a74bc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55964cde3860 con 0x55964ce83f60 2024-08-20T01:45:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.487+0000 7fc3a74bc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55964cde78a0 con 0x55964ce869a0 2024-08-20T01:45:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.487+0000 7fc3a2c62640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55964ce81630 0x55964ce83a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.487+0000 7fc3a2c62640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55964ce81630 0x55964ce83a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46770/0 (socket says 172.21.15.79:46770) 2024-08-20T01:45:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.487+0000 7fc3a2c62640 1 -- 172.21.15.79:0/680533188 learned_addr learned my addr 172.21.15.79:0/680533188 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.487+0000 7fc3a1c60640 1 --2- 172.21.15.79:0/680533188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55964ce869a0 0x55964ce88e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.487+0000 7fc3a2461640 1 --2- 172.21.15.79:0/680533188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55964ce83f60 0x55964ce86350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.487+0000 7fc3a2c62640 1 -- 172.21.15.79:0/680533188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55964ce869a0 msgr2=0x55964ce88e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.487+0000 7fc3a2c62640 1 --2- 172.21.15.79:0/680533188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55964ce869a0 0x55964ce88e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.487+0000 7fc3a2c62640 1 -- 172.21.15.79:0/680533188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55964ce83f60 msgr2=0x55964ce86350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.487+0000 7fc3937fe640 1 --2- 172.21.15.79:0/1930335904 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc3880b3bd0 0x7fc3880b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.487+0000 7fc3a2c62640 1 --2- 172.21.15.79:0/680533188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55964ce83f60 0x55964ce86350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.487+0000 7fc3a2c62640 1 -- 172.21.15.79:0/680533188 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55964cd8ae40 con 0x55964ce81630 2024-08-20T01:45:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.487+0000 7fc3a2461640 1 --2- 172.21.15.79:0/680533188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55964ce83f60 0x55964ce86350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:45:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.488+0000 7fc3a1c60640 1 --2- 172.21.15.79:0/1930335904 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc3880b3bd0 0x7fc3880b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.488+0000 7fc3a2c62640 1 --2- 172.21.15.79:0/680533188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55964ce81630 0x55964ce83a20 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fc394009fc0 tx=0x7fc394010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64c80216fae40f45 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.488+0000 7fc3937fe640 1 -- 172.21.15.79:0/1930335904 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc38c0e3d90 con 0x7fc39c1026b0 2024-08-20T01:45:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.488+0000 7fc390ff9640 1 -- 172.21.15.79:0/680533188 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc394003b70 con 0x55964ce81630 2024-08-20T01:45:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.488+0000 7fc390ff9640 1 -- 172.21.15.79:0/680533188 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc394003d10 con 0x55964ce81630 2024-08-20T01:45:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.488+0000 7fc390ff9640 1 -- 172.21.15.79:0/680533188 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc394011960 con 0x55964ce81630 2024-08-20T01:45:05.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.489+0000 7fc3a74bc740 1 -- 172.21.15.79:0/680533188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55964ce81630 msgr2=0x55964ce83a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:05.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.489+0000 7fc3a1c60640 1 --2- 172.21.15.79:0/1930335904 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc3880b3bd0 0x7fc3880b6090 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc38c0aac80 tx=0x7fc38c0e7870 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:05.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.489+0000 7fc3a74bc740 1 --2- 172.21.15.79:0/680533188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55964ce81630 0x55964ce83a20 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fc394009fc0 tx=0x7fc394010860 comp rx=0 tx=0).stop 2024-08-20T01:45:05.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.489+0000 7fc3a74bc740 1 -- 172.21.15.79:0/680533188 shutdown_connections 2024-08-20T01:45:05.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.489+0000 7fc3a74bc740 1 --2- 172.21.15.79:0/680533188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55964ce869a0 0x55964ce88e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:05.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.489+0000 7fc3a74bc740 1 --2- 172.21.15.79:0/680533188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55964ce83f60 0x55964ce86350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:05.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.489+0000 7fc3a74bc740 1 --2- 172.21.15.79:0/680533188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55964ce81630 0x55964ce83a20 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:05.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.489+0000 7fc3a74bc740 1 -- 172.21.15.79:0/680533188 >> 172.21.15.79:0/680533188 conn(0x55964ce7c730 msgr2=0x55964ce7d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:05.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.489+0000 7fc3a74bc740 1 -- 172.21.15.79:0/680533188 shutdown_connections 2024-08-20T01:45:05.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.489+0000 7fc3a74bc740 1 -- 172.21.15.79:0/680533188 wait complete. 2024-08-20T01:45:05.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.489+0000 7fc3a74bc740 1 -- start start 2024-08-20T01:45:05.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.489+0000 7fc3a74bc740 1 Processor -- start 2024-08-20T01:45:05.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.490+0000 7fc3a74bc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55964ce81630 0x55964ce8aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:05.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.490+0000 7fc3a74bc740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55964ce83f60 0x55964ce8b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:05.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.490+0000 7fc3a74bc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55964ce869a0 0x55964ce8c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:05.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.490+0000 7fc3a74bc740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55964cd1cab0 con 0x55964ce83f60 2024-08-20T01:45:05.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.490+0000 7fc3a74bc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55964cd6a780 con 0x55964ce81630 2024-08-20T01:45:05.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.490+0000 7fc3a74bc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55964ce89980 con 0x55964ce869a0 2024-08-20T01:45:05.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.490+0000 7fc3a74bc740 10 client.0 _ll_register_callbacks cb 0x55964caf2a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:45:05.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.490+0000 7fc3a2461640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55964ce83f60 0x55964ce8b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:05.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.490+0000 7fc3a2461640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55964ce83f60 0x55964ce8b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46784/0 (socket says 172.21.15.79:46784) 2024-08-20T01:45:05.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.490+0000 7fc3a2461640 1 -- 172.21.15.79:0/439543968 learned_addr learned my addr 172.21.15.79:0/439543968 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:05.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.490+0000 7fc3a2c62640 1 --2- 172.21.15.79:0/439543968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55964ce81630 0x55964ce8aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:05.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.490+0000 7fc3a2c62640 1 --2- 172.21.15.79:0/439543968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55964ce869a0 0x55964ce8c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:05.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.490+0000 7fc3a2461640 1 -- 172.21.15.79:0/439543968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55964ce869a0 msgr2=0x55964ce8c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:05.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.490+0000 7fc3a2461640 1 --2- 172.21.15.79:0/439543968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55964ce869a0 0x55964ce8c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:05.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.490+0000 7fc3a2461640 1 -- 172.21.15.79:0/439543968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55964ce81630 msgr2=0x55964ce8aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:05.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.490+0000 7fc3a2461640 1 --2- 172.21.15.79:0/439543968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55964ce81630 0x55964ce8aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:05.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.490+0000 7fc3a2461640 1 -- 172.21.15.79:0/439543968 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55964cb46790 con 0x55964ce83f60 2024-08-20T01:45:05.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.490+0000 7fc3a2c62640 1 --2- 172.21.15.79:0/439543968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55964ce869a0 0x55964ce8c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:45:05.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.490+0000 7fc3a2461640 1 --2- 172.21.15.79:0/439543968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55964ce83f60 0x55964ce8b580 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fc398009230 tx=0x7fc398031870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a50c242dec08b5c9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:05.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.490+0000 7fc385ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:45:05.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.490+0000 7fc385ffb640 1 -- 172.21.15.79:0/439543968 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc398035070 con 0x55964ce83f60 2024-08-20T01:45:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.490+0000 7fc385ffb640 1 -- 172.21.15.79:0/439543968 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc398004240 con 0x55964ce83f60 2024-08-20T01:45:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.490+0000 7fc3a74bc740 1 -- 172.21.15.79:0/439543968 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55964cd92e00 con 0x55964ce83f60 2024-08-20T01:45:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.491+0000 7fc385ffb640 1 -- 172.21.15.79:0/439543968 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fc398004440 con 0x55964ce83f60 2024-08-20T01:45:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.491+0000 7fc3a74bc740 10 client.17745 fetch_fsmap learned FSMap version 42 2024-08-20T01:45:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.491+0000 7fc3a74bc740 1 -- 172.21.15.79:0/439543968 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55964cbbf620 con 0x55964ce83f60 2024-08-20T01:45:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.491+0000 7fc385ffb640 1 -- 172.21.15.79:0/439543968 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55964cd92e00 con 0x55964ce83f60 2024-08-20T01:45:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.491+0000 7fc385ffb640 1 -- 172.21.15.79:0/439543968 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 42) ==== 8390+0+0 (secure 0 0 0) 0x7fc39803b630 con 0x55964ce83f60 2024-08-20T01:45:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.491+0000 7fc3a74bc740 10 client.17745 fetch_fsmap finished waiting for FSMap version 42 2024-08-20T01:45:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.491+0000 7fc3a74bc740 10 client.17745 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:45:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.491+0000 7fc3a74bc740 20 client.17745 populate_metadata read hostname 'smithi079' 2024-08-20T01:45:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.491+0000 7fc3a74bc740 1 --2- 172.21.15.79:0/439543968 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55964ce968f0 0x55964ce98d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.491+0000 7fc3a74bc740 4 client.17745 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:45:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.491+0000 7fc3a74bc740 1 -- 172.21.15.79:0/439543968 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55964cdf62b0 con 0x55964ce968f0 2024-08-20T01:45:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.491+0000 7fc3a2c62640 1 --2- 172.21.15.79:0/439543968 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55964ce968f0 0x55964ce98d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.492+0000 7fc385ffb640 10 client.17745 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:45:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.492+0000 7fc3a2c62640 1 --2- 172.21.15.79:0/439543968 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55964ce968f0 0x55964ce98d50 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b54093887044a2b server_cookie=64a90d6a9abd0fc8 in_seq=0 out_seq=0 2024-08-20T01:45:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.493+0000 7fc385ffb640 1 -- 172.21.15.79:0/439543968 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55964cdf62b0 con 0x55964ce968f0 2024-08-20T01:45:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.493+0000 7fc385ffb640 10 client.17745 handle_command_reply: tid=0 2024-08-20T01:45:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.493+0000 7fc3a74bc740 1 client.17745 shutdown 2024-08-20T01:45:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.493+0000 7fc3a74bc740 1 -- 172.21.15.79:0/439543968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55964ce83f60 msgr2=0x55964ce8b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.493+0000 7fc3a74bc740 1 --2- 172.21.15.79:0/439543968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55964ce83f60 0x55964ce8b580 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fc398009230 tx=0x7fc398031870 comp rx=0 tx=0).stop 2024-08-20T01:45:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.493+0000 7fc3a74bc740 1 -- 172.21.15.79:0/439543968 shutdown_connections 2024-08-20T01:45:05.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.493+0000 7fc3a74bc740 1 --2- 172.21.15.79:0/439543968 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55964ce968f0 0x55964ce98d50 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:05.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.493+0000 7fc3a74bc740 1 --2- 172.21.15.79:0/439543968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55964ce869a0 0x55964ce8c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:05.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.493+0000 7fc3a74bc740 1 --2- 172.21.15.79:0/439543968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55964ce83f60 0x55964ce8b580 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:05.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.493+0000 7fc385ffb640 0 client.17745 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:45:05.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.493+0000 7fc3a74bc740 1 --2- 172.21.15.79:0/439543968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55964ce81630 0x55964ce8aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:05.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.493+0000 7fc3a74bc740 1 -- 172.21.15.79:0/439543968 >> 172.21.15.79:0/439543968 conn(0x55964ce7c730 msgr2=0x55964ce7b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:05.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.493+0000 7fc3a74bc740 1 -- 172.21.15.79:0/439543968 shutdown_connections 2024-08-20T01:45:05.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.493+0000 7fc3a74bc740 1 -- 172.21.15.79:0/439543968 wait complete. 2024-08-20T01:45:05.505 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.493+0000 7fc3a74bc740 20 client.17745 trim_cache size 0 max 16384 2024-08-20T01:45:05.515 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.508+0000 7fc3a74bc740 1 Processor -- start 2024-08-20T01:45:05.515 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.508+0000 7fc3a74bc740 1 -- start start 2024-08-20T01:45:05.515 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.508+0000 7fc3a74bc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55964ce81630 0x55964ce8a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:05.515 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.508+0000 7fc3a74bc740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55964ce83f60 0x55964ce86dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:05.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.508+0000 7fc3a74bc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55964ce869a0 0x55964ce87310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:05.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.508+0000 7fc3a74bc740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc39c1abc50 con 0x55964ce83f60 2024-08-20T01:45:05.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.508+0000 7fc3a74bc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc39c1ad8e0 con 0x55964ce81630 2024-08-20T01:45:05.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.508+0000 7fc3a74bc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc39c1ac320 con 0x55964ce869a0 2024-08-20T01:45:05.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.508+0000 7fc3a2461640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55964ce83f60 0x55964ce86dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:05.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.508+0000 7fc3a2461640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55964ce83f60 0x55964ce86dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46786/0 (socket says 172.21.15.79:46786) 2024-08-20T01:45:05.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.508+0000 7fc3a2461640 1 -- 172.21.15.79:0/103750812 learned_addr learned my addr 172.21.15.79:0/103750812 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:05.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.509+0000 7fc3a2c62640 1 --2- 172.21.15.79:0/103750812 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55964ce869a0 0x55964ce87310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:05.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.509+0000 7fc3a2461640 1 -- 172.21.15.79:0/103750812 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55964ce869a0 msgr2=0x55964ce87310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:05.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.509+0000 7fc3a2461640 1 --2- 172.21.15.79:0/103750812 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55964ce869a0 0x55964ce87310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:05.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.509+0000 7fc3a2461640 1 -- 172.21.15.79:0/103750812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55964ce81630 msgr2=0x55964ce8a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:05.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.509+0000 7fc3a2461640 1 --2- 172.21.15.79:0/103750812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55964ce81630 0x55964ce8a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:05.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.509+0000 7fc3a2461640 1 -- 172.21.15.79:0/103750812 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55964ce7d9e0 con 0x55964ce83f60 2024-08-20T01:45:05.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.509+0000 7fc3a2c62640 1 --2- 172.21.15.79:0/103750812 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55964ce869a0 0x55964ce87310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:45:05.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.509+0000 7fc3a2461640 1 --2- 172.21.15.79:0/103750812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55964ce83f60 0x55964ce86dd0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fc39802a940 tx=0x7fc39802a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d9e59a5d7a69e7d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:05.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.509+0000 7fc387fff640 1 -- 172.21.15.79:0/103750812 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc398054070 con 0x55964ce83f60 2024-08-20T01:45:05.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.509+0000 7fc387fff640 1 -- 172.21.15.79:0/103750812 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc398005850 con 0x55964ce83f60 2024-08-20T01:45:05.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.509+0000 7fc387fff640 1 -- 172.21.15.79:0/103750812 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc398035070 con 0x55964ce83f60 2024-08-20T01:45:05.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.510+0000 7fc3a74bc740 1 -- 172.21.15.79:0/103750812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55964ce83f60 msgr2=0x55964ce86dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:05.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.510+0000 7fc3a74bc740 1 --2- 172.21.15.79:0/103750812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55964ce83f60 0x55964ce86dd0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fc39802a940 tx=0x7fc39802a420 comp rx=0 tx=0).stop 2024-08-20T01:45:05.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.510+0000 7fc3a74bc740 1 -- 172.21.15.79:0/103750812 shutdown_connections 2024-08-20T01:45:05.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.510+0000 7fc3a74bc740 1 --2- 172.21.15.79:0/103750812 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55964ce869a0 0x55964ce87310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:05.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.510+0000 7fc3a74bc740 1 --2- 172.21.15.79:0/103750812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55964ce83f60 0x55964ce86dd0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:05.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.510+0000 7fc3a74bc740 1 --2- 172.21.15.79:0/103750812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55964ce81630 0x55964ce8a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:05.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.510+0000 7fc3a74bc740 1 -- 172.21.15.79:0/103750812 >> 172.21.15.79:0/103750812 conn(0x55964ce7c730 msgr2=0x55964ce8aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:05.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.510+0000 7fc3a74bc740 1 -- 172.21.15.79:0/103750812 shutdown_connections 2024-08-20T01:45:05.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.510+0000 7fc3a74bc740 1 -- 172.21.15.79:0/103750812 wait complete. 2024-08-20T01:45:05.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.510+0000 7fc3a74bc740 1 -- start start 2024-08-20T01:45:05.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.510+0000 7fc3a74bc740 1 Processor -- start 2024-08-20T01:45:05.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.510+0000 7fc3a74bc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55964ce81630 0x55964ce92600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:05.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.510+0000 7fc3a74bc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55964ce83f60 0x55964ce92ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:05.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.510+0000 7fc3a74bc740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55964ce869a0 0x55964ce91490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:05.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.510+0000 7fc3a74bc740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc39c1ad150 con 0x55964ce869a0 2024-08-20T01:45:05.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.510+0000 7fc3a74bc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc39c1ac9f0 con 0x55964ce83f60 2024-08-20T01:45:05.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.510+0000 7fc3a74bc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc39c1a9c30 con 0x55964ce81630 2024-08-20T01:45:05.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.510+0000 7fc3a74bc740 10 client.0 _ll_register_callbacks cb 0x7fc398009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:45:05.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.511+0000 7fc3a2c62640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55964ce869a0 0x55964ce91490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:05.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.511+0000 7fc3a2c62640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55964ce869a0 0x55964ce91490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46792/0 (socket says 172.21.15.79:46792) 2024-08-20T01:45:05.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.511+0000 7fc3a2461640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55964ce83f60 0x55964ce92ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:05.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.511+0000 7fc3a2c62640 1 -- 172.21.15.79:0/323801471 learned_addr learned my addr 172.21.15.79:0/323801471 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:05.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.511+0000 7fc3a2c62640 1 --2- 172.21.15.79:0/323801471 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55964ce81630 0x55964ce92600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:05.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.511+0000 7fc3a2461640 1 -- 172.21.15.79:0/323801471 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55964ce81630 msgr2=0x55964ce92600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:05.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.511+0000 7fc3a2461640 1 --2- 172.21.15.79:0/323801471 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55964ce81630 0x55964ce92600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:05.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.511+0000 7fc3a2461640 1 -- 172.21.15.79:0/323801471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55964ce869a0 msgr2=0x55964ce91490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:05.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.511+0000 7fc3a2461640 1 --2- 172.21.15.79:0/323801471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55964ce869a0 0x55964ce91490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:05.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.511+0000 7fc3a2461640 1 -- 172.21.15.79:0/323801471 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55964ce8c4c0 con 0x55964ce83f60 2024-08-20T01:45:05.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.511+0000 7fc3a2c62640 1 --2- 172.21.15.79:0/323801471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55964ce869a0 0x55964ce91490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:45:05.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.511+0000 7fc3a2461640 1 --2- 172.21.15.79:0/323801471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55964ce83f60 0x55964ce92ca0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x55964ce80bc0 tx=0x7fc398031920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a77630cd6325fcde server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:05.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.511+0000 7fc385ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:45:05.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.511+0000 7fc385ffb640 1 -- 172.21.15.79:0/323801471 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc398035070 con 0x55964ce83f60 2024-08-20T01:45:05.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.511+0000 7fc385ffb640 1 -- 172.21.15.79:0/323801471 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc39803b630 con 0x55964ce83f60 2024-08-20T01:45:05.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.511+0000 7fc3a74bc740 1 -- 172.21.15.79:0/323801471 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc398005850 con 0x55964ce83f60 2024-08-20T01:45:05.521 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.512+0000 7fc385ffb640 1 -- 172.21.15.79:0/323801471 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fc398054040 con 0x55964ce83f60 2024-08-20T01:45:05.521 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.512+0000 7fc3a74bc740 10 client.26759 fetch_fsmap learned FSMap version 42 2024-08-20T01:45:05.521 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.512+0000 7fc3a74bc740 1 -- 172.21.15.79:0/323801471 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55964ce908b0 con 0x55964ce83f60 2024-08-20T01:45:05.521 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.512+0000 7fc385ffb640 1 -- 172.21.15.79:0/323801471 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc398005850 con 0x55964ce83f60 2024-08-20T01:45:05.521 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.512+0000 7fc385ffb640 1 -- 172.21.15.79:0/323801471 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 42) ==== 8390+0+0 (secure 0 0 0) 0x7fc3980596f0 con 0x55964ce83f60 2024-08-20T01:45:05.521 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.512+0000 7fc3a74bc740 10 client.26759 fetch_fsmap finished waiting for FSMap version 42 2024-08-20T01:45:05.521 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.512+0000 7fc3a74bc740 10 client.26759 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:45:05.521 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.512+0000 7fc3a74bc740 20 client.26759 populate_metadata read hostname 'smithi079' 2024-08-20T01:45:05.521 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.512+0000 7fc3a74bc740 1 --2- 172.21.15.79:0/323801471 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55964cf01a90 0x55964cf03eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:05.521 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.512+0000 7fc3a74bc740 4 client.26759 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:45:05.521 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.512+0000 7fc3a74bc740 1 -- 172.21.15.79:0/323801471 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55964cdf1d50 con 0x55964cf01a90 2024-08-20T01:45:05.522 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.512+0000 7fc3a2c62640 1 --2- 172.21.15.79:0/323801471 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55964cf01a90 0x55964cf03eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:05.522 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.513+0000 7fc3a2c62640 1 --2- 172.21.15.79:0/323801471 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55964cf01a90 0x55964cf03eb0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e9ba0f2fc5a46e2 server_cookie=ed4bd90ee80330e1 in_seq=0 out_seq=0 2024-08-20T01:45:05.522 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.513+0000 7fc385ffb640 10 client.26759 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:45:05.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.520+0000 7fc385ffb640 1 -- 172.21.15.79:0/323801471 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55964cdf1d50 con 0x55964cf01a90 2024-08-20T01:45:05.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.520+0000 7fc385ffb640 10 client.26759 handle_command_reply: tid=0 2024-08-20T01:45:05.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.520+0000 7fc3a74bc740 1 client.26759 shutdown 2024-08-20T01:45:05.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.520+0000 7fc3a74bc740 1 -- 172.21.15.79:0/323801471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55964ce83f60 msgr2=0x55964ce92ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:05.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.520+0000 7fc3a74bc740 1 --2- 172.21.15.79:0/323801471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55964ce83f60 0x55964ce92ca0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x55964ce80bc0 tx=0x7fc398031920 comp rx=0 tx=0).stop 2024-08-20T01:45:05.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.520+0000 7fc3a74bc740 1 -- 172.21.15.79:0/323801471 shutdown_connections 2024-08-20T01:45:05.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.520+0000 7fc3a74bc740 1 --2- 172.21.15.79:0/323801471 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55964cf01a90 0x55964cf03eb0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:05.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.520+0000 7fc3a74bc740 1 --2- 172.21.15.79:0/323801471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55964ce869a0 0x55964ce91490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:05.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.520+0000 7fc385ffb640 0 client.26759 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:45:05.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.520+0000 7fc3a74bc740 1 --2- 172.21.15.79:0/323801471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55964ce83f60 0x55964ce92ca0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:05.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.520+0000 7fc3a74bc740 1 --2- 172.21.15.79:0/323801471 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55964ce81630 0x55964ce92600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:05.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.520+0000 7fc3a74bc740 1 -- 172.21.15.79:0/323801471 >> 172.21.15.79:0/323801471 conn(0x55964ce7c730 msgr2=0x55964ce7b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:05.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.520+0000 7fc3a74bc740 1 -- 172.21.15.79:0/323801471 shutdown_connections 2024-08-20T01:45:05.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.520+0000 7fc3a74bc740 1 -- 172.21.15.79:0/323801471 wait complete. 2024-08-20T01:45:05.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.520+0000 7fc3a74bc740 20 client.26759 trim_cache size 0 max 16384 2024-08-20T01:45:05.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:45:05.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:45:05.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:45:05.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:45:05.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.521+0000 7fc3a46c5640 1 -- 172.21.15.79:0/1930335904 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc3880b3bd0 msgr2=0x7fc3880b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:05.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.521+0000 7fc3a46c5640 1 --2- 172.21.15.79:0/1930335904 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc3880b3bd0 0x7fc3880b6090 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc38c0aac80 tx=0x7fc38c0e7870 comp rx=0 tx=0).stop 2024-08-20T01:45:05.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.521+0000 7fc3a46c5640 1 -- 172.21.15.79:0/1930335904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc39c1026b0 msgr2=0x7fc39c103b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:05.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.521+0000 7fc3a46c5640 1 --2- 172.21.15.79:0/1930335904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc39c1026b0 0x7fc39c103b80 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fc38c00c920 tx=0x7fc38c00cde0 comp rx=0 tx=0).stop 2024-08-20T01:45:05.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.521+0000 7fc3a46c5640 1 -- 172.21.15.79:0/1930335904 shutdown_connections 2024-08-20T01:45:05.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.521+0000 7fc3a46c5640 1 --2- 172.21.15.79:0/1930335904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc39c103070 0x7fc39c1040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:05.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.521+0000 7fc3a46c5640 1 --2- 172.21.15.79:0/1930335904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc39c1026b0 0x7fc39c103b80 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:05.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.521+0000 7fc3a46c5640 1 --2- 172.21.15.79:0/1930335904 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc3880b3bd0 0x7fc3880b6090 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:05.527 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.521+0000 7fc3a46c5640 1 --2- 172.21.15.79:0/1930335904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc39c101560 0x7fc39c105320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:05.527 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.521+0000 7fc3a46c5640 1 -- 172.21.15.79:0/1930335904 >> 172.21.15.79:0/1930335904 conn(0x7fc39c0fce40 msgr2=0x7fc39c0fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:05.527 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.521+0000 7fc3a46c5640 1 -- 172.21.15.79:0/1930335904 shutdown_connections 2024-08-20T01:45:05.527 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:05.521+0000 7fc3a46c5640 1 -- 172.21.15.79:0/1930335904 wait complete. 2024-08-20T01:45:05.818 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T01:45:06.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:05 smithi081 ceph-mon[22209]: pgmap v580: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 29 MiB/s wr, 25 op/s 2024-08-20T01:45:06.101 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:45:06.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:05 smithi175 ceph-mon[22392]: pgmap v580: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 29 MiB/s wr, 25 op/s 2024-08-20T01:45:06.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:05 smithi079 ceph-mon[18656]: pgmap v580: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 29 MiB/s wr, 25 op/s 2024-08-20T01:45:06.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.631+0000 7f35ecb2e640 1 -- 172.21.15.79:0/3107359652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35e810a6d0 msgr2=0x7f35e810cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:06.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.631+0000 7f35ecb2e640 1 --2- 172.21.15.79:0/3107359652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35e810a6d0 0x7f35e810cac0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f35d0009900 tx=0x7f35d002a410 comp rx=0 tx=0).stop 2024-08-20T01:45:06.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.631+0000 7f35ecb2e640 1 -- 172.21.15.79:0/3107359652 shutdown_connections 2024-08-20T01:45:06.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.631+0000 7f35ecb2e640 1 --2- 172.21.15.79:0/3107359652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35e810d000 0x7f35e810f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:06.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.631+0000 7f35ecb2e640 1 --2- 172.21.15.79:0/3107359652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35e810a6d0 0x7f35e810cac0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:06.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.631+0000 7f35ecb2e640 1 --2- 172.21.15.79:0/3107359652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35e81015c0 0x7f35e81019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:06.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.631+0000 7f35ecb2e640 1 -- 172.21.15.79:0/3107359652 >> 172.21.15.79:0/3107359652 conn(0x7f35e8076ae0 msgr2=0x7f35e8076ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:06.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.631+0000 7f35ecb2e640 1 -- 172.21.15.79:0/3107359652 shutdown_connections 2024-08-20T01:45:06.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.631+0000 7f35ecb2e640 1 -- 172.21.15.79:0/3107359652 wait complete. 2024-08-20T01:45:06.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.632+0000 7f35ecb2e640 1 Processor -- start 2024-08-20T01:45:06.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.632+0000 7f35ecb2e640 1 -- start start 2024-08-20T01:45:06.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.632+0000 7f35ecb2e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35e81015c0 0x7f35e8198ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:06.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.632+0000 7f35ecb2e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35e810a6d0 0x7f35e8199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:06.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.632+0000 7f35ecb2e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35e810d000 0x7f35e819e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:06.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.632+0000 7f35ecb2e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f35e81129c0 con 0x7f35e81015c0 2024-08-20T01:45:06.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.632+0000 7f35ecb2e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f35e8112840 con 0x7f35e810a6d0 2024-08-20T01:45:06.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.632+0000 7f35ecb2e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f35e8112b40 con 0x7f35e810d000 2024-08-20T01:45:06.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.632+0000 7f35e659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35e81015c0 0x7f35e8198ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:06.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.632+0000 7f35e659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35e81015c0 0x7f35e8198ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46796/0 (socket says 172.21.15.79:46796) 2024-08-20T01:45:06.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.632+0000 7f35e659c640 1 -- 172.21.15.79:0/3631881239 learned_addr learned my addr 172.21.15.79:0/3631881239 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:06.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.633+0000 7f35dffff640 1 --2- 172.21.15.79:0/3631881239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35e810a6d0 0x7f35e8199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:06.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.633+0000 7f35e6d9d640 1 --2- 172.21.15.79:0/3631881239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35e810d000 0x7f35e819e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:06.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.633+0000 7f35e659c640 1 -- 172.21.15.79:0/3631881239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35e810d000 msgr2=0x7f35e819e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:06.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.633+0000 7f35e659c640 1 --2- 172.21.15.79:0/3631881239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35e810d000 0x7f35e819e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:06.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.633+0000 7f35e659c640 1 -- 172.21.15.79:0/3631881239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35e810a6d0 msgr2=0x7f35e8199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:06.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.633+0000 7f35e659c640 1 --2- 172.21.15.79:0/3631881239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35e810a6d0 0x7f35e8199430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:06.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.633+0000 7f35e659c640 1 -- 172.21.15.79:0/3631881239 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e819efa0 con 0x7f35e81015c0 2024-08-20T01:45:06.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.633+0000 7f35e659c640 1 --2- 172.21.15.79:0/3631881239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35e81015c0 0x7f35e8198ef0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f35d800c890 tx=0x7f35d800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:06.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.633+0000 7f35df7fe640 1 -- 172.21.15.79:0/3631881239 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d8004220 con 0x7f35e81015c0 2024-08-20T01:45:06.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.633+0000 7f35df7fe640 1 -- 172.21.15.79:0/3631881239 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f35d8007e40 con 0x7f35e81015c0 2024-08-20T01:45:06.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.633+0000 7f35ecb2e640 1 -- 172.21.15.79:0/3631881239 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35e819f290 con 0x7f35e81015c0 2024-08-20T01:45:06.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.633+0000 7f35df7fe640 1 -- 172.21.15.79:0/3631881239 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d8004a00 con 0x7f35e81015c0 2024-08-20T01:45:06.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.633+0000 7f35ecb2e640 1 -- 172.21.15.79:0/3631881239 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35e8102640 con 0x7f35e81015c0 2024-08-20T01:45:06.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.636+0000 7f35df7fe640 1 -- 172.21.15.79:0/3631881239 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f35d80079b0 con 0x7f35e81015c0 2024-08-20T01:45:06.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.636+0000 7f35eef27740 1 Processor -- start 2024-08-20T01:45:06.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.636+0000 7f35eef27740 1 -- start start 2024-08-20T01:45:06.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.637+0000 7f35eef27740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a27589730 0x561a27589b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:06.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.637+0000 7f35eef27740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a2758a050 0x561a27595aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:06.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.637+0000 7f35eef27740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a27595fe0 0x561a275983d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:06.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.637+0000 7f35eef27740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561a27500930 con 0x561a27595fe0 2024-08-20T01:45:06.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.637+0000 7f35eef27740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561a274efe30 con 0x561a2758a050 2024-08-20T01:45:06.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.637+0000 7f35eef27740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561a274f3e70 con 0x561a27589730 2024-08-20T01:45:06.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.637+0000 7f35dffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a27595fe0 0x561a275983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:06.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.637+0000 7f35dffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a27595fe0 0x561a275983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46798/0 (socket says 172.21.15.79:46798) 2024-08-20T01:45:06.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.637+0000 7f35dffff640 1 -- 172.21.15.79:0/2470464105 learned_addr learned my addr 172.21.15.79:0/2470464105 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:06.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.637+0000 7f35e6d9d640 1 --2- 172.21.15.79:0/2470464105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a27589730 0x561a27589b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:06.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.637+0000 7f35e659c640 1 --2- 172.21.15.79:0/2470464105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a2758a050 0x561a27595aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:06.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.637+0000 7f35dffff640 1 -- 172.21.15.79:0/2470464105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a27589730 msgr2=0x561a27589b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:06.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.637+0000 7f35dffff640 1 --2- 172.21.15.79:0/2470464105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a27589730 0x561a27589b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:06.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.637+0000 7f35dffff640 1 -- 172.21.15.79:0/2470464105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a2758a050 msgr2=0x561a27595aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:06.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.637+0000 7f35dffff640 1 --2- 172.21.15.79:0/2470464105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a2758a050 0x561a27595aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:06.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.637+0000 7f35dffff640 1 -- 172.21.15.79:0/2470464105 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a2724f650 con 0x561a27595fe0 2024-08-20T01:45:06.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.637+0000 7f35e659c640 1 --2- 172.21.15.79:0/2470464105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a2758a050 0x561a27595aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:45:06.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.637+0000 7f35df7fe640 1 --2- 172.21.15.79:0/3631881239 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f35d40b3c50 0x7f35d40b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:06.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.638+0000 7f35e6d9d640 1 --2- 172.21.15.79:0/3631881239 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f35d40b3c50 0x7f35d40b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:06.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.638+0000 7f35df7fe640 1 -- 172.21.15.79:0/3631881239 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f35d80e38b0 con 0x7f35e81015c0 2024-08-20T01:45:06.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.638+0000 7f35dffff640 1 --2- 172.21.15.79:0/2470464105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a27595fe0 0x561a275983d0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f35d0033000 tx=0x7f35d0004380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c57d71b34774d1ce server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:06.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.638+0000 7f35dcff9640 1 -- 172.21.15.79:0/2470464105 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d0040070 con 0x561a27595fe0 2024-08-20T01:45:06.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.638+0000 7f35dcff9640 1 -- 172.21.15.79:0/2470464105 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f35d0003c80 con 0x561a27595fe0 2024-08-20T01:45:06.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.638+0000 7f35dcff9640 1 -- 172.21.15.79:0/2470464105 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d0035070 con 0x561a27595fe0 2024-08-20T01:45:06.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.639+0000 7f35eef27740 1 -- 172.21.15.79:0/2470464105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a27595fe0 msgr2=0x561a275983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:06.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.639+0000 7f35e6d9d640 1 --2- 172.21.15.79:0/3631881239 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f35d40b3c50 0x7f35d40b6110 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f35e806c650 tx=0x7f35e0007520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:06.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.639+0000 7f35eef27740 1 --2- 172.21.15.79:0/2470464105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a27595fe0 0x561a275983d0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f35d0033000 tx=0x7f35d0004380 comp rx=0 tx=0).stop 2024-08-20T01:45:06.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.639+0000 7f35eef27740 1 -- 172.21.15.79:0/2470464105 shutdown_connections 2024-08-20T01:45:06.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.639+0000 7f35eef27740 1 --2- 172.21.15.79:0/2470464105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a27595fe0 0x561a275983d0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:06.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.639+0000 7f35eef27740 1 --2- 172.21.15.79:0/2470464105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a2758a050 0x561a27595aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:06.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.639+0000 7f35eef27740 1 --2- 172.21.15.79:0/2470464105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a27589730 0x561a27589b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:06.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.639+0000 7f35eef27740 1 -- 172.21.15.79:0/2470464105 >> 172.21.15.79:0/2470464105 conn(0x561a27587560 msgr2=0x561a27588700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:06.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.639+0000 7f35eef27740 1 -- 172.21.15.79:0/2470464105 shutdown_connections 2024-08-20T01:45:06.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.639+0000 7f35eef27740 1 -- 172.21.15.79:0/2470464105 wait complete. 2024-08-20T01:45:06.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.639+0000 7f35eef27740 1 -- start start 2024-08-20T01:45:06.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.640+0000 7f35eef27740 1 Processor -- start 2024-08-20T01:45:06.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.640+0000 7f35eef27740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a27589730 0x561a27593000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:06.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.640+0000 7f35eef27740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a2758a050 0x561a27593540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:06.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.640+0000 7f35eef27740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a27595fe0 0x561a27593a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:06.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.640+0000 7f35eef27740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561a27352700 con 0x561a27589730 2024-08-20T01:45:06.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.640+0000 7f35eef27740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561a27476810 con 0x561a2758a050 2024-08-20T01:45:06.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.640+0000 7f35eef27740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561a27598c30 con 0x561a27595fe0 2024-08-20T01:45:06.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.640+0000 7f35eef27740 10 client.0 _ll_register_callbacks cb 0x561a274e9700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:45:06.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.640+0000 7f35e659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a27589730 0x561a27593000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:06.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.640+0000 7f35e659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a27589730 0x561a27593000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46810/0 (socket says 172.21.15.79:46810) 2024-08-20T01:45:06.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.640+0000 7f35e659c640 1 -- 172.21.15.79:0/3261123052 learned_addr learned my addr 172.21.15.79:0/3261123052 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:06.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.640+0000 7f35dffff640 1 --2- 172.21.15.79:0/3261123052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a2758a050 0x561a27593540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:06.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.640+0000 7f35e659c640 1 -- 172.21.15.79:0/3261123052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a27595fe0 msgr2=0x561a27593a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:45:06.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.640+0000 7f35e659c640 1 --2- 172.21.15.79:0/3261123052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a27595fe0 0x561a27593a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:06.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.640+0000 7f35e659c640 1 -- 172.21.15.79:0/3261123052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a2758a050 msgr2=0x561a27593540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:06.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.640+0000 7f35e659c640 1 --2- 172.21.15.79:0/3261123052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a2758a050 0x561a27593540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:06.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.640+0000 7f35e659c640 1 -- 172.21.15.79:0/3261123052 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a275a2060 con 0x561a27589730 2024-08-20T01:45:06.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.640+0000 7f35dffff640 1 --2- 172.21.15.79:0/3261123052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a2758a050 0x561a27593540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:45:06.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.641+0000 7f35e659c640 1 --2- 172.21.15.79:0/3261123052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a27589730 0x561a27593000 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f35d8005fd0 tx=0x7f35d8007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86be8909f33610a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:06.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.641+0000 7f35cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:45:06.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.641+0000 7f35cdffb640 1 -- 172.21.15.79:0/3261123052 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d801d070 con 0x561a27589730 2024-08-20T01:45:06.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.641+0000 7f35cdffb640 1 -- 172.21.15.79:0/3261123052 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f35d80043c0 con 0x561a27589730 2024-08-20T01:45:06.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.641+0000 7f35eef27740 1 -- 172.21.15.79:0/3261123052 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561a2749f150 con 0x561a27589730 2024-08-20T01:45:06.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.641+0000 7f35cdffb640 1 -- 172.21.15.79:0/3261123052 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f35d80aa810 con 0x561a27589730 2024-08-20T01:45:06.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.641+0000 7f35eef27740 10 client.17763 fetch_fsmap learned FSMap version 42 2024-08-20T01:45:06.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.641+0000 7f35eef27740 1 -- 172.21.15.79:0/3261123052 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x561a275a4980 con 0x561a27589730 2024-08-20T01:45:06.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.641+0000 7f35cdffb640 1 -- 172.21.15.79:0/3261123052 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x561a2749f150 con 0x561a27589730 2024-08-20T01:45:06.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.641+0000 7f35cdffb640 1 -- 172.21.15.79:0/3261123052 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 42) ==== 8390+0+0 (secure 0 0 0) 0x7f35d80a6180 con 0x561a27589730 2024-08-20T01:45:06.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.642+0000 7f35eef27740 10 client.17763 fetch_fsmap finished waiting for FSMap version 42 2024-08-20T01:45:06.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.642+0000 7f35eef27740 10 client.17763 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:45:06.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.642+0000 7f35eef27740 20 client.17763 populate_metadata read hostname 'smithi079' 2024-08-20T01:45:06.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.642+0000 7f35eef27740 1 --2- 172.21.15.79:0/3261123052 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x561a275a5e90 0x561a275a82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:06.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.642+0000 7f35eef27740 4 client.17763 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:45:06.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.642+0000 7f35eef27740 1 -- 172.21.15.79:0/3261123052 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a27502880 con 0x561a275a5e90 2024-08-20T01:45:06.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.642+0000 7f35dffff640 1 --2- 172.21.15.79:0/3261123052 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x561a275a5e90 0x561a275a82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:06.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.643+0000 7f35cdffb640 10 client.17763 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:45:06.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.643+0000 7f35dffff640 1 --2- 172.21.15.79:0/3261123052 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x561a275a5e90 0x561a275a82e0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f7e7e4ab530f294 server_cookie=c60fbecacf3221af in_seq=0 out_seq=0 2024-08-20T01:45:06.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.643+0000 7f35cdffb640 1 -- 172.21.15.79:0/3261123052 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561a27502880 con 0x561a275a5e90 2024-08-20T01:45:06.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.643+0000 7f35cdffb640 10 client.17763 handle_command_reply: tid=0 2024-08-20T01:45:06.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.643+0000 7f35eef27740 1 client.17763 shutdown 2024-08-20T01:45:06.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.643+0000 7f35eef27740 1 -- 172.21.15.79:0/3261123052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a27589730 msgr2=0x561a27593000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:06.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.643+0000 7f35eef27740 1 --2- 172.21.15.79:0/3261123052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a27589730 0x561a27593000 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f35d8005fd0 tx=0x7f35d8007d60 comp rx=0 tx=0).stop 2024-08-20T01:45:06.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.643+0000 7f35eef27740 1 -- 172.21.15.79:0/3261123052 shutdown_connections 2024-08-20T01:45:06.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.643+0000 7f35eef27740 1 --2- 172.21.15.79:0/3261123052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a27595fe0 0x561a27593a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:06.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.643+0000 7f35eef27740 1 --2- 172.21.15.79:0/3261123052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a2758a050 0x561a27593540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:06.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.643+0000 7f35eef27740 1 --2- 172.21.15.79:0/3261123052 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x561a275a5e90 0x561a275a82e0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:06.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.643+0000 7f35eef27740 1 --2- 172.21.15.79:0/3261123052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a27589730 0x561a27593000 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:06.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.644+0000 7f35eef27740 1 -- 172.21.15.79:0/3261123052 >> 172.21.15.79:0/3261123052 conn(0x561a27587560 msgr2=0x561a2758d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:06.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.643+0000 7f35cdffb640 0 client.17763 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:45:06.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.644+0000 7f35eef27740 1 -- 172.21.15.79:0/3261123052 shutdown_connections 2024-08-20T01:45:06.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.644+0000 7f35eef27740 1 -- 172.21.15.79:0/3261123052 wait complete. 2024-08-20T01:45:06.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.644+0000 7f35eef27740 20 client.17763 trim_cache size 0 max 16384 2024-08-20T01:45:06.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.659+0000 7f35eef27740 1 Processor -- start 2024-08-20T01:45:06.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.659+0000 7f35eef27740 1 -- start start 2024-08-20T01:45:06.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.659+0000 7f35eef27740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a27589730 0x561a27594d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:06.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.659+0000 7f35eef27740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a2758a050 0x561a27592510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:06.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.659+0000 7f35eef27740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a27595fe0 0x561a275adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:06.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.659+0000 7f35eef27740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f35e81b0120 con 0x561a27595fe0 2024-08-20T01:45:06.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.659+0000 7f35eef27740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f35e81b1db0 con 0x561a2758a050 2024-08-20T01:45:06.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.659+0000 7f35eef27740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f35e81b07f0 con 0x561a27589730 2024-08-20T01:45:06.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.659+0000 7f35e6d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a27595fe0 0x561a275adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:06.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.659+0000 7f35e6d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a27595fe0 0x561a275adbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46812/0 (socket says 172.21.15.79:46812) 2024-08-20T01:45:06.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.659+0000 7f35e6d9d640 1 -- 172.21.15.79:0/3900776386 learned_addr learned my addr 172.21.15.79:0/3900776386 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:06.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.659+0000 7f35dffff640 1 --2- 172.21.15.79:0/3900776386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a2758a050 0x561a27592510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:06.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.659+0000 7f35e659c640 1 --2- 172.21.15.79:0/3900776386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a27589730 0x561a27594d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:06.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.660+0000 7f35e659c640 1 -- 172.21.15.79:0/3900776386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a2758a050 msgr2=0x561a27592510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:06.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.660+0000 7f35e659c640 1 --2- 172.21.15.79:0/3900776386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a2758a050 0x561a27592510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:06.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.660+0000 7f35e659c640 1 -- 172.21.15.79:0/3900776386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a27595fe0 msgr2=0x561a275adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:06.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.660+0000 7f35e659c640 1 --2- 172.21.15.79:0/3900776386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a27595fe0 0x561a275adbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:06.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.660+0000 7f35e659c640 1 -- 172.21.15.79:0/3900776386 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a27587de0 con 0x561a27589730 2024-08-20T01:45:06.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.660+0000 7f35e6d9d640 1 --2- 172.21.15.79:0/3900776386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a27595fe0 0x561a275adbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:45:06.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.660+0000 7f35e659c640 1 --2- 172.21.15.79:0/3900776386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a27589730 0x561a27594d40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f35d80a64f0 tx=0x7f35d8007dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8e9b23829c38ac3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:06.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.660+0000 7f35cffff640 1 -- 172.21.15.79:0/3900776386 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d801d070 con 0x561a27589730 2024-08-20T01:45:06.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.660+0000 7f35cffff640 1 -- 172.21.15.79:0/3900776386 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f35d80b38c0 con 0x561a27589730 2024-08-20T01:45:06.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.660+0000 7f35cffff640 1 -- 172.21.15.79:0/3900776386 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d80a6180 con 0x561a27589730 2024-08-20T01:45:06.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.661+0000 7f35eef27740 1 -- 172.21.15.79:0/3900776386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a27589730 msgr2=0x561a27594d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:06.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.661+0000 7f35eef27740 1 --2- 172.21.15.79:0/3900776386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a27589730 0x561a27594d40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f35d80a64f0 tx=0x7f35d8007dd0 comp rx=0 tx=0).stop 2024-08-20T01:45:06.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.661+0000 7f35eef27740 1 -- 172.21.15.79:0/3900776386 shutdown_connections 2024-08-20T01:45:06.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.661+0000 7f35eef27740 1 --2- 172.21.15.79:0/3900776386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a27595fe0 0x561a275adbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:06.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.661+0000 7f35eef27740 1 --2- 172.21.15.79:0/3900776386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a2758a050 0x561a27592510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:06.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.661+0000 7f35eef27740 1 --2- 172.21.15.79:0/3900776386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a27589730 0x561a27594d40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:06.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.661+0000 7f35eef27740 1 -- 172.21.15.79:0/3900776386 >> 172.21.15.79:0/3900776386 conn(0x561a27587560 msgr2=0x561a27594630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:06.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.661+0000 7f35eef27740 1 -- 172.21.15.79:0/3900776386 shutdown_connections 2024-08-20T01:45:06.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.661+0000 7f35eef27740 1 -- 172.21.15.79:0/3900776386 wait complete. 2024-08-20T01:45:06.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.661+0000 7f35eef27740 1 -- start start 2024-08-20T01:45:06.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.661+0000 7f35eef27740 1 Processor -- start 2024-08-20T01:45:06.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.662+0000 7f35eef27740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a27589730 0x561a2759e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:06.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.662+0000 7f35eef27740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a2758a050 0x561a2759d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:06.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.662+0000 7f35eef27740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a27595fe0 0x561a2759d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:06.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.662+0000 7f35eef27740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f35e81b1620 con 0x561a2758a050 2024-08-20T01:45:06.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.662+0000 7f35eef27740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f35e81b0ec0 con 0x561a27589730 2024-08-20T01:45:06.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.662+0000 7f35eef27740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f35e81ae0e0 con 0x561a27595fe0 2024-08-20T01:45:06.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.662+0000 7f35eef27740 10 client.0 _ll_register_callbacks cb 0x7f35d80a6050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:45:06.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.662+0000 7f35dffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a2758a050 0x561a2759d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:06.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.662+0000 7f35dffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a2758a050 0x561a2759d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46822/0 (socket says 172.21.15.79:46822) 2024-08-20T01:45:06.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.662+0000 7f35dffff640 1 -- 172.21.15.79:0/4004245574 learned_addr learned my addr 172.21.15.79:0/4004245574 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:06.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.662+0000 7f35e659c640 1 --2- 172.21.15.79:0/4004245574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a27589730 0x561a2759e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:06.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.662+0000 7f35dffff640 1 -- 172.21.15.79:0/4004245574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a27595fe0 msgr2=0x561a2759d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:06.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.662+0000 7f35dffff640 1 --2- 172.21.15.79:0/4004245574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a27595fe0 0x561a2759d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:06.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.662+0000 7f35dffff640 1 -- 172.21.15.79:0/4004245574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a27589730 msgr2=0x561a2759e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:06.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.662+0000 7f35dffff640 1 --2- 172.21.15.79:0/4004245574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a27589730 0x561a2759e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:06.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.662+0000 7f35dffff640 1 -- 172.21.15.79:0/4004245574 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a27587fe0 con 0x561a2758a050 2024-08-20T01:45:06.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.662+0000 7f35dffff640 1 --2- 172.21.15.79:0/4004245574 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a2758a050 0x561a2759d130 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f35d00092a0 tx=0x7f35d0009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25023f56d9103bc3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:06.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.662+0000 7f35cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:45:06.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.662+0000 7f35cdffb640 1 -- 172.21.15.79:0/4004245574 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d0040040 con 0x561a2758a050 2024-08-20T01:45:06.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.662+0000 7f35cdffb640 1 -- 172.21.15.79:0/4004245574 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f35d00052d0 con 0x561a2758a050 2024-08-20T01:45:06.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.663+0000 7f35eef27740 1 -- 172.21.15.79:0/4004245574 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35d80b38c0 con 0x561a2758a050 2024-08-20T01:45:06.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.663+0000 7f35cdffb640 1 -- 172.21.15.79:0/4004245574 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f35d0035040 con 0x561a2758a050 2024-08-20T01:45:06.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.663+0000 7f35eef27740 10 client.17769 fetch_fsmap learned FSMap version 42 2024-08-20T01:45:06.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.663+0000 7f35eef27740 1 -- 172.21.15.79:0/4004245574 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x561a2760fab0 con 0x561a2758a050 2024-08-20T01:45:06.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.663+0000 7f35cdffb640 1 -- 172.21.15.79:0/4004245574 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f35d80b38c0 con 0x561a2758a050 2024-08-20T01:45:06.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.663+0000 7f35cdffb640 1 -- 172.21.15.79:0/4004245574 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 42) ==== 8390+0+0 (secure 0 0 0) 0x7f35d003c710 con 0x561a2758a050 2024-08-20T01:45:06.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.663+0000 7f35eef27740 10 client.17769 fetch_fsmap finished waiting for FSMap version 42 2024-08-20T01:45:06.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.663+0000 7f35eef27740 10 client.17769 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:45:06.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.663+0000 7f35eef27740 20 client.17769 populate_metadata read hostname 'smithi079' 2024-08-20T01:45:06.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.663+0000 7f35eef27740 1 --2- 172.21.15.79:0/4004245574 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x561a2760fd90 0x561a27612180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:06.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.663+0000 7f35eef27740 4 client.17769 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:45:06.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.663+0000 7f35eef27740 1 -- 172.21.15.79:0/4004245574 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561a274fe320 con 0x561a2760fd90 2024-08-20T01:45:06.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.663+0000 7f35e659c640 1 --2- 172.21.15.79:0/4004245574 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x561a2760fd90 0x561a27612180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:06.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.664+0000 7f35cdffb640 10 client.17769 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:45:06.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.664+0000 7f35e659c640 1 --2- 172.21.15.79:0/4004245574 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x561a2760fd90 0x561a27612180 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=91cd4e273458ed5f server_cookie=4388acf57604eb56 in_seq=0 out_seq=0 2024-08-20T01:45:06.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.664+0000 7f35cdffb640 1 -- 172.21.15.79:0/4004245574 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561a274fe320 con 0x561a2760fd90 2024-08-20T01:45:06.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.664+0000 7f35cdffb640 10 client.17769 handle_command_reply: tid=0 2024-08-20T01:45:06.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.664+0000 7f35eef27740 1 client.17769 shutdown 2024-08-20T01:45:06.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.664+0000 7f35eef27740 1 -- 172.21.15.79:0/4004245574 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a2758a050 msgr2=0x561a2759d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:06.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.664+0000 7f35eef27740 1 --2- 172.21.15.79:0/4004245574 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a2758a050 0x561a2759d130 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f35d00092a0 tx=0x7f35d0009520 comp rx=0 tx=0).stop 2024-08-20T01:45:06.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.664+0000 7f35eef27740 1 -- 172.21.15.79:0/4004245574 shutdown_connections 2024-08-20T01:45:06.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.664+0000 7f35eef27740 1 --2- 172.21.15.79:0/4004245574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a27595fe0 0x561a2759d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:06.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.664+0000 7f35eef27740 1 --2- 172.21.15.79:0/4004245574 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x561a2760fd90 0x561a27612180 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:06.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.664+0000 7f35eef27740 1 --2- 172.21.15.79:0/4004245574 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a2758a050 0x561a2759d130 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:06.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.664+0000 7f35eef27740 1 --2- 172.21.15.79:0/4004245574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561a27589730 0x561a2759e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:06.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.664+0000 7f35eef27740 1 -- 172.21.15.79:0/4004245574 >> 172.21.15.79:0/4004245574 conn(0x561a27587560 msgr2=0x561a275864f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:06.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.665+0000 7f35cdffb640 0 client.17769 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:45:06.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.665+0000 7f35eef27740 1 -- 172.21.15.79:0/4004245574 shutdown_connections 2024-08-20T01:45:06.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.665+0000 7f35eef27740 1 -- 172.21.15.79:0/4004245574 wait complete. 2024-08-20T01:45:06.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.665+0000 7f35eef27740 20 client.17769 trim_cache size 0 max 16384 2024-08-20T01:45:06.673 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:45:06.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.665+0000 7f35ecb2e640 1 -- 172.21.15.79:0/3631881239 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f35d40b3c50 msgr2=0x7f35d40b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:06.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.665+0000 7f35ecb2e640 1 --2- 172.21.15.79:0/3631881239 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f35d40b3c50 0x7f35d40b6110 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f35e806c650 tx=0x7f35e0007520 comp rx=0 tx=0).stop 2024-08-20T01:45:06.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.665+0000 7f35ecb2e640 1 -- 172.21.15.79:0/3631881239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35e81015c0 msgr2=0x7f35e8198ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:06.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.665+0000 7f35ecb2e640 1 --2- 172.21.15.79:0/3631881239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35e81015c0 0x7f35e8198ef0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f35d800c890 tx=0x7f35d800cd50 comp rx=0 tx=0).stop 2024-08-20T01:45:06.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.665+0000 7f35ecb2e640 1 -- 172.21.15.79:0/3631881239 shutdown_connections 2024-08-20T01:45:06.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.665+0000 7f35ecb2e640 1 --2- 172.21.15.79:0/3631881239 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f35d40b3c50 0x7f35d40b6110 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:06.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.665+0000 7f35ecb2e640 1 --2- 172.21.15.79:0/3631881239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35e810d000 0x7f35e819e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:06.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.665+0000 7f35ecb2e640 1 --2- 172.21.15.79:0/3631881239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35e810a6d0 0x7f35e8199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:06.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.665+0000 7f35ecb2e640 1 --2- 172.21.15.79:0/3631881239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35e81015c0 0x7f35e8198ef0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:06.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.665+0000 7f35ecb2e640 1 -- 172.21.15.79:0/3631881239 >> 172.21.15.79:0/3631881239 conn(0x7f35e8076ae0 msgr2=0x7f35e8100350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:06.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.666+0000 7f35ecb2e640 1 -- 172.21.15.79:0/3631881239 shutdown_connections 2024-08-20T01:45:06.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:06.666+0000 7f35ecb2e640 1 -- 172.21.15.79:0/3631881239 wait complete. 2024-08-20T01:45:07.574 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T01:45:07.850 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:45:07.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:07 smithi079 ceph-mon[18656]: pgmap v581: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 MiB/s wr, 21 op/s 2024-08-20T01:45:08.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:07 smithi081 ceph-mon[22209]: pgmap v581: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 MiB/s wr, 21 op/s 2024-08-20T01:45:08.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:07 smithi175 ceph-mon[22392]: pgmap v581: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 MiB/s wr, 21 op/s 2024-08-20T01:45:09.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:08 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:45:09.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:08 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:45:09.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:08 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:45:09.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.753+0000 7f12f61ab640 1 -- 172.21.15.79:0/2663223074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12f0101990 msgr2=0x7f12f0101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:09.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.753+0000 7f12f61ab640 1 --2- 172.21.15.79:0/2663223074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12f0101990 0x7f12f0101d70 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f12e0009900 tx=0x7f12e002c600 comp rx=0 tx=0).stop 2024-08-20T01:45:09.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.753+0000 7f12f61ab640 1 -- 172.21.15.79:0/2663223074 shutdown_connections 2024-08-20T01:45:09.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.753+0000 7f12f61ab640 1 --2- 172.21.15.79:0/2663223074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12f0107d20 0x7f12f010e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:09.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.753+0000 7f12f61ab640 1 --2- 172.21.15.79:0/2663223074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12f01073a0 0x7f12f01077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:09.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.753+0000 7f12f61ab640 1 --2- 172.21.15.79:0/2663223074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12f0101990 0x7f12f0101d70 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:09.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.753+0000 7f12f61ab640 1 -- 172.21.15.79:0/2663223074 >> 172.21.15.79:0/2663223074 conn(0x7f12f00fd400 msgr2=0x7f12f00ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:09.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.753+0000 7f12f61ab640 1 -- 172.21.15.79:0/2663223074 shutdown_connections 2024-08-20T01:45:09.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.753+0000 7f12f61ab640 1 -- 172.21.15.79:0/2663223074 wait complete. 2024-08-20T01:45:09.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.753+0000 7f12f61ab640 1 Processor -- start 2024-08-20T01:45:09.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.754+0000 7f12f61ab640 1 -- start start 2024-08-20T01:45:09.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.754+0000 7f12f61ab640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12f0101990 0x7f12f019b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:09.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.754+0000 7f12f61ab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12f01073a0 0x7f12f019b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:09.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.754+0000 7f12f61ab640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12f0107d20 0x7f12f01a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:09.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.754+0000 7f12f61ab640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f12f0110790 con 0x7f12f0107d20 2024-08-20T01:45:09.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.754+0000 7f12f61ab640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f12f0110610 con 0x7f12f01073a0 2024-08-20T01:45:09.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.754+0000 7f12f61ab640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f12f0110910 con 0x7f12f0101990 2024-08-20T01:45:09.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.754+0000 7f12effff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12f0107d20 0x7f12f01a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:09.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.754+0000 7f12ef7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12f0101990 0x7f12f019b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:09.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.754+0000 7f12eeffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12f01073a0 0x7f12f019b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:09.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.754+0000 7f12effff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12f0107d20 0x7f12f01a0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46848/0 (socket says 172.21.15.79:46848) 2024-08-20T01:45:09.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.754+0000 7f12effff640 1 -- 172.21.15.79:0/3474155164 learned_addr learned my addr 172.21.15.79:0/3474155164 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:09.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.754+0000 7f12ef7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12f0101990 0x7f12f019b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:40758/0 (socket says 172.21.15.79:40758) 2024-08-20T01:45:09.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.755+0000 7f12eeffd640 1 -- 172.21.15.79:0/3474155164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12f0101990 msgr2=0x7f12f019b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:09.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.755+0000 7f12eeffd640 1 --2- 172.21.15.79:0/3474155164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12f0101990 0x7f12f019b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:09.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.755+0000 7f12eeffd640 1 -- 172.21.15.79:0/3474155164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12f0107d20 msgr2=0x7f12f01a0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:09.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.755+0000 7f12eeffd640 1 --2- 172.21.15.79:0/3474155164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12f0107d20 0x7f12f01a0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:09.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.755+0000 7f12eeffd640 1 -- 172.21.15.79:0/3474155164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12f01a1230 con 0x7f12f01073a0 2024-08-20T01:45:09.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.755+0000 7f12ef7fe640 1 --2- 172.21.15.79:0/3474155164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12f0101990 0x7f12f019b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:45:09.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.755+0000 7f12eeffd640 1 --2- 172.21.15.79:0/3474155164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12f01073a0 0x7f12f019b6c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f12e400e9f0 tx=0x7f12e400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:09.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.755+0000 7f12ecff9640 1 -- 172.21.15.79:0/3474155164 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e400ccc0 con 0x7f12f01073a0 2024-08-20T01:45:09.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.755+0000 7f12ecff9640 1 -- 172.21.15.79:0/3474155164 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f12e4005020 con 0x7f12f01073a0 2024-08-20T01:45:09.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.755+0000 7f12ecff9640 1 -- 172.21.15.79:0/3474155164 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e400ce60 con 0x7f12f01073a0 2024-08-20T01:45:09.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.755+0000 7f12f61ab640 1 -- 172.21.15.79:0/3474155164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12f01a1520 con 0x7f12f01073a0 2024-08-20T01:45:09.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.755+0000 7f12f61ab640 1 -- 172.21.15.79:0/3474155164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12f01a7be0 con 0x7f12f01073a0 2024-08-20T01:45:09.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.758+0000 7f12f85a4740 1 Processor -- start 2024-08-20T01:45:09.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.758+0000 7f12f85a4740 1 -- start start 2024-08-20T01:45:09.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.759+0000 7f12f85a4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cb53ce880 0x562cb53cec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:09.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.759+0000 7f12f85a4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb53cf1a0 0x562cb53dabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:09.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.759+0000 7f12ecff9640 1 -- 172.21.15.79:0/3474155164 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f12e4004a60 con 0x7f12f01073a0 2024-08-20T01:45:09.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.759+0000 7f12f85a4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562cb53db130 0x562cb53dd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:09.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.759+0000 7f12f85a4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562cb5345930 con 0x562cb53db130 2024-08-20T01:45:09.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.759+0000 7f12f85a4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562cb5334e30 con 0x562cb53cf1a0 2024-08-20T01:45:09.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.759+0000 7f12f85a4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562cb5338e70 con 0x562cb53ce880 2024-08-20T01:45:09.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.759+0000 7f12effff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cb53ce880 0x562cb53cec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:09.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.759+0000 7f12effff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cb53ce880 0x562cb53cec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:40772/0 (socket says 172.21.15.79:40772) 2024-08-20T01:45:09.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.759+0000 7f12effff640 1 -- 172.21.15.79:0/218978103 learned_addr learned my addr 172.21.15.79:0/218978103 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:09.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.759+0000 7f12ef7fe640 1 --2- 172.21.15.79:0/218978103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb53cf1a0 0x562cb53dabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:09.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.759+0000 7f12eeffd640 1 --2- 172.21.15.79:0/218978103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562cb53db130 0x562cb53dd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:09.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.759+0000 7f12effff640 1 -- 172.21.15.79:0/218978103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb53cf1a0 msgr2=0x562cb53dabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:09.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.759+0000 7f12effff640 1 --2- 172.21.15.79:0/218978103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb53cf1a0 0x562cb53dabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:09.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.759+0000 7f12effff640 1 -- 172.21.15.79:0/218978103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562cb53db130 msgr2=0x562cb53dd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:09.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.759+0000 7f12effff640 1 --2- 172.21.15.79:0/218978103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562cb53db130 0x562cb53dd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:09.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.759+0000 7f12effff640 1 -- 172.21.15.79:0/218978103 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cb5094650 con 0x562cb53ce880 2024-08-20T01:45:09.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.759+0000 7f12eeffd640 1 --2- 172.21.15.79:0/218978103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562cb53db130 0x562cb53dd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:45:09.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.760+0000 7f12effff640 1 --2- 172.21.15.79:0/218978103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cb53ce880 0x562cb53cec60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f12e80114a0 tx=0x7f12e8011960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bbc072f3c08c6ed server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:09.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.760+0000 7f12d5ffb640 1 -- 172.21.15.79:0/218978103 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e8004b20 con 0x562cb53ce880 2024-08-20T01:45:09.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.760+0000 7f12d5ffb640 1 -- 172.21.15.79:0/218978103 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f12e8004cc0 con 0x562cb53ce880 2024-08-20T01:45:09.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.760+0000 7f12d5ffb640 1 -- 172.21.15.79:0/218978103 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e8005280 con 0x562cb53ce880 2024-08-20T01:45:09.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.760+0000 7f12ecff9640 1 --2- 172.21.15.79:0/3474155164 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f12d80b3bd0 0x7f12d80b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:09.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.760+0000 7f12ef7fe640 1 --2- 172.21.15.79:0/3474155164 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f12d80b3bd0 0x7f12d80b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:09.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.760+0000 7f12ecff9640 1 -- 172.21.15.79:0/3474155164 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f12e40e3bd0 con 0x7f12f01073a0 2024-08-20T01:45:09.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.761+0000 7f12f85a4740 1 -- 172.21.15.79:0/218978103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cb53ce880 msgr2=0x562cb53cec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:09.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.761+0000 7f12f85a4740 1 --2- 172.21.15.79:0/218978103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cb53ce880 0x562cb53cec60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f12e80114a0 tx=0x7f12e8011960 comp rx=0 tx=0).stop 2024-08-20T01:45:09.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.761+0000 7f12ef7fe640 1 --2- 172.21.15.79:0/3474155164 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f12d80b3bd0 0x7f12d80b6090 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f12e00057c0 tx=0x7f12e00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:09.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.761+0000 7f12f85a4740 1 -- 172.21.15.79:0/218978103 shutdown_connections 2024-08-20T01:45:09.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.761+0000 7f12f85a4740 1 --2- 172.21.15.79:0/218978103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562cb53db130 0x562cb53dd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:09.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.761+0000 7f12f85a4740 1 --2- 172.21.15.79:0/218978103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb53cf1a0 0x562cb53dabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:09.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.761+0000 7f12f85a4740 1 --2- 172.21.15.79:0/218978103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cb53ce880 0x562cb53cec60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:09.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.761+0000 7f12f85a4740 1 -- 172.21.15.79:0/218978103 >> 172.21.15.79:0/218978103 conn(0x562cb53cc6b0 msgr2=0x562cb53cd850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:09.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.761+0000 7f12f85a4740 1 -- 172.21.15.79:0/218978103 shutdown_connections 2024-08-20T01:45:09.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.761+0000 7f12f85a4740 1 -- 172.21.15.79:0/218978103 wait complete. 2024-08-20T01:45:09.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.761+0000 7f12f85a4740 1 -- start start 2024-08-20T01:45:09.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.761+0000 7f12f85a4740 1 Processor -- start 2024-08-20T01:45:09.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.762+0000 7f12f85a4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cb53ce880 0x562cb53d80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:09.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.762+0000 7f12f85a4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb53cf1a0 0x562cb53d85f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:09.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.762+0000 7f12f85a4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562cb53db130 0x562cb53d8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:09.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.762+0000 7f12f85a4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562cb5197700 con 0x562cb53db130 2024-08-20T01:45:09.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.762+0000 7f12f85a4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562cb52bb810 con 0x562cb53cf1a0 2024-08-20T01:45:09.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.762+0000 7f12eeffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb53cf1a0 0x562cb53d85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:09.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.762+0000 7f12effff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562cb53db130 0x562cb53d8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:09.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.762+0000 7f12ef7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cb53ce880 0x562cb53d80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:09.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.762+0000 7f12f85a4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562cb53ddde0 con 0x562cb53ce880 2024-08-20T01:45:09.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.762+0000 7f12ef7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cb53ce880 0x562cb53d80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:40778/0 (socket says 172.21.15.79:40778) 2024-08-20T01:45:09.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.762+0000 7f12effff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562cb53db130 0x562cb53d8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46860/0 (socket says 172.21.15.79:46860) 2024-08-20T01:45:09.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.762+0000 7f12ef7fe640 1 -- 172.21.15.79:0/3567818762 learned_addr learned my addr 172.21.15.79:0/3567818762 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:09.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.762+0000 7f12f85a4740 10 client.0 _ll_register_callbacks cb 0x562cb532e700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:45:09.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.762+0000 7f12ef7fe640 1 -- 172.21.15.79:0/3567818762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb53cf1a0 msgr2=0x562cb53d85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:09.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.762+0000 7f12ef7fe640 1 --2- 172.21.15.79:0/3567818762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb53cf1a0 0x562cb53d85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:09.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.762+0000 7f12ef7fe640 1 -- 172.21.15.79:0/3567818762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562cb53db130 msgr2=0x562cb53d8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:09.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.762+0000 7f12ef7fe640 1 --2- 172.21.15.79:0/3567818762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562cb53db130 0x562cb53d8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:09.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.763+0000 7f12ef7fe640 1 -- 172.21.15.79:0/3567818762 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cb53e7190 con 0x562cb53ce880 2024-08-20T01:45:09.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.763+0000 7f12eeffd640 1 --2- 172.21.15.79:0/3567818762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb53cf1a0 0x562cb53d85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:45:09.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.763+0000 7f12ef7fe640 1 --2- 172.21.15.79:0/3567818762 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cb53ce880 0x562cb53d80b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f12e0006010 tx=0x7f12e0009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdc5554f75b5bb0a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:09.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.763+0000 7f12ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:45:09.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.763+0000 7f12ceffd640 1 -- 172.21.15.79:0/3567818762 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e004f070 con 0x562cb53ce880 2024-08-20T01:45:09.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.763+0000 7f12ceffd640 1 -- 172.21.15.79:0/3567818762 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f12e004b450 con 0x562cb53ce880 2024-08-20T01:45:09.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.763+0000 7f12f85a4740 1 -- 172.21.15.79:0/3567818762 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562cb52e4150 con 0x562cb53ce880 2024-08-20T01:45:09.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.763+0000 7f12ceffd640 1 -- 172.21.15.79:0/3567818762 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f12e005b050 con 0x562cb53ce880 2024-08-20T01:45:09.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.763+0000 7f12f85a4740 10 client.26764 fetch_fsmap learned FSMap version 42 2024-08-20T01:45:09.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.763+0000 7f12f85a4740 1 -- 172.21.15.79:0/3567818762 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x562cb53e9a70 con 0x562cb53ce880 2024-08-20T01:45:09.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.763+0000 7f12ceffd640 1 -- 172.21.15.79:0/3567818762 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x562cb52e4150 con 0x562cb53ce880 2024-08-20T01:45:09.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.764+0000 7f12ceffd640 1 -- 172.21.15.79:0/3567818762 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 42) ==== 8390+0+0 (secure 0 0 0) 0x7f12e003e440 con 0x562cb53ce880 2024-08-20T01:45:09.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.764+0000 7f12f85a4740 10 client.26764 fetch_fsmap finished waiting for FSMap version 42 2024-08-20T01:45:09.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.764+0000 7f12f85a4740 10 client.26764 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:45:09.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.764+0000 7f12f85a4740 20 client.26764 populate_metadata read hostname 'smithi079' 2024-08-20T01:45:09.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.764+0000 7f12f85a4740 1 --2- 172.21.15.79:0/3567818762 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x562cb53eaf20 0x562cb53ed3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:09.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.764+0000 7f12f85a4740 4 client.26764 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:45:09.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.764+0000 7f12f85a4740 1 -- 172.21.15.79:0/3567818762 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562cb5347880 con 0x562cb53eaf20 2024-08-20T01:45:09.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.764+0000 7f12eeffd640 1 --2- 172.21.15.79:0/3567818762 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x562cb53eaf20 0x562cb53ed3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:09.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.764+0000 7f12ceffd640 10 client.26764 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:45:09.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.764+0000 7f12eeffd640 1 --2- 172.21.15.79:0/3567818762 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x562cb53eaf20 0x562cb53ed3e0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3fa039eee1f6d0a6 server_cookie=7f5d3f6c886ae766 in_seq=0 out_seq=0 2024-08-20T01:45:09.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.765+0000 7f12ceffd640 1 -- 172.21.15.79:0/3567818762 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562cb5347880 con 0x562cb53eaf20 2024-08-20T01:45:09.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.765+0000 7f12ceffd640 10 client.26764 handle_command_reply: tid=0 2024-08-20T01:45:09.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.765+0000 7f12f85a4740 1 client.26764 shutdown 2024-08-20T01:45:09.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.765+0000 7f12f85a4740 1 -- 172.21.15.79:0/3567818762 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cb53ce880 msgr2=0x562cb53d80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:09.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.765+0000 7f12f85a4740 1 --2- 172.21.15.79:0/3567818762 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cb53ce880 0x562cb53d80b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f12e0006010 tx=0x7f12e0009260 comp rx=0 tx=0).stop 2024-08-20T01:45:09.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.765+0000 7f12f85a4740 1 -- 172.21.15.79:0/3567818762 shutdown_connections 2024-08-20T01:45:09.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.765+0000 7f12f85a4740 1 --2- 172.21.15.79:0/3567818762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562cb53db130 0x562cb53d8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:09.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.765+0000 7f12f85a4740 1 --2- 172.21.15.79:0/3567818762 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x562cb53eaf20 0x562cb53ed3e0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:09.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.765+0000 7f12f85a4740 1 --2- 172.21.15.79:0/3567818762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb53cf1a0 0x562cb53d85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:09.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.765+0000 7f12f85a4740 1 --2- 172.21.15.79:0/3567818762 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cb53ce880 0x562cb53d80b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:09.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.765+0000 7f12ceffd640 0 client.26764 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:45:09.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.765+0000 7f12f85a4740 1 -- 172.21.15.79:0/3567818762 >> 172.21.15.79:0/3567818762 conn(0x562cb53cc6b0 msgr2=0x562cb53d2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:09.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.766+0000 7f12f85a4740 1 -- 172.21.15.79:0/3567818762 shutdown_connections 2024-08-20T01:45:09.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.766+0000 7f12f85a4740 1 -- 172.21.15.79:0/3567818762 wait complete. 2024-08-20T01:45:09.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.766+0000 7f12f85a4740 20 client.26764 trim_cache size 0 max 16384 2024-08-20T01:45:09.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.782+0000 7f12f85a4740 1 Processor -- start 2024-08-20T01:45:09.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.782+0000 7f12f85a4740 1 -- start start 2024-08-20T01:45:09.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.782+0000 7f12f85a4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562cb53ce880 0x562cb53d7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:09.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.782+0000 7f12f85a4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb53cf1a0 0x562cb53f2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:09.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.782+0000 7f12f85a4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cb53db130 0x562cb53f31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:09.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.782+0000 7f12f85a4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f12f01b0260 con 0x562cb53ce880 2024-08-20T01:45:09.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.782+0000 7f12f85a4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f12f01b1ef0 con 0x562cb53cf1a0 2024-08-20T01:45:09.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.782+0000 7f12f85a4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f12f01b0930 con 0x562cb53db130 2024-08-20T01:45:09.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.782+0000 7f12ef7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562cb53ce880 0x562cb53d7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:09.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.782+0000 7f12ef7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562cb53ce880 0x562cb53d7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46876/0 (socket says 172.21.15.79:46876) 2024-08-20T01:45:09.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.782+0000 7f12ef7fe640 1 -- 172.21.15.79:0/225076516 learned_addr learned my addr 172.21.15.79:0/225076516 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:09.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.782+0000 7f12eeffd640 1 --2- 172.21.15.79:0/225076516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb53cf1a0 0x562cb53f2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:09.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.783+0000 7f12ef7fe640 1 -- 172.21.15.79:0/225076516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cb53db130 msgr2=0x562cb53f31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:09.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.783+0000 7f12ef7fe640 1 --2- 172.21.15.79:0/225076516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cb53db130 0x562cb53f31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:09.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.783+0000 7f12ef7fe640 1 -- 172.21.15.79:0/225076516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb53cf1a0 msgr2=0x562cb53f2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:09.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.783+0000 7f12ef7fe640 1 --2- 172.21.15.79:0/225076516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb53cf1a0 0x562cb53f2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:09.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.783+0000 7f12ef7fe640 1 -- 172.21.15.79:0/225076516 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cb53caaf0 con 0x562cb53ce880 2024-08-20T01:45:09.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.783+0000 7f12ef7fe640 1 --2- 172.21.15.79:0/225076516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562cb53ce880 0x562cb53d7940 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f12e0000c00 tx=0x7f12e00098c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37ddcea2a6dbe0b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:09.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.783+0000 7f12d57fa640 1 -- 172.21.15.79:0/225076516 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e004f040 con 0x562cb53ce880 2024-08-20T01:45:09.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.783+0000 7f12d57fa640 1 -- 172.21.15.79:0/225076516 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f12e0064070 con 0x562cb53ce880 2024-08-20T01:45:09.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.783+0000 7f12d57fa640 1 -- 172.21.15.79:0/225076516 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e0037040 con 0x562cb53ce880 2024-08-20T01:45:09.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.784+0000 7f12f85a4740 1 -- 172.21.15.79:0/225076516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562cb53ce880 msgr2=0x562cb53d7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:09.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.784+0000 7f12f85a4740 1 --2- 172.21.15.79:0/225076516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562cb53ce880 0x562cb53d7940 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f12e0000c00 tx=0x7f12e00098c0 comp rx=0 tx=0).stop 2024-08-20T01:45:09.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.784+0000 7f12f85a4740 1 -- 172.21.15.79:0/225076516 shutdown_connections 2024-08-20T01:45:09.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.784+0000 7f12f85a4740 1 --2- 172.21.15.79:0/225076516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cb53db130 0x562cb53f31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:09.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.784+0000 7f12f85a4740 1 --2- 172.21.15.79:0/225076516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb53cf1a0 0x562cb53f2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:09.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.784+0000 7f12f85a4740 1 --2- 172.21.15.79:0/225076516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562cb53ce880 0x562cb53d7940 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:09.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.784+0000 7f12f85a4740 1 -- 172.21.15.79:0/225076516 >> 172.21.15.79:0/225076516 conn(0x562cb53cc6b0 msgr2=0x562cb53d9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:09.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.784+0000 7f12f85a4740 1 -- 172.21.15.79:0/225076516 shutdown_connections 2024-08-20T01:45:09.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.784+0000 7f12f85a4740 1 -- 172.21.15.79:0/225076516 wait complete. 2024-08-20T01:45:09.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.784+0000 7f12f85a4740 1 -- start start 2024-08-20T01:45:09.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.784+0000 7f12f85a4740 1 Processor -- start 2024-08-20T01:45:09.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.785+0000 7f12f85a4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cb53ce880 0x562cb53d44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:09.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.785+0000 7f12f85a4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb53cf1a0 0x562cb53d4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:09.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.785+0000 7f12f85a4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562cb53db130 0x562cb53d4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:09.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.785+0000 7f12f85a4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f12f01b1760 con 0x562cb53db130 2024-08-20T01:45:09.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.785+0000 7f12f85a4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f12f01b1000 con 0x562cb53cf1a0 2024-08-20T01:45:09.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.785+0000 7f12f85a4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f12f01ae260 con 0x562cb53ce880 2024-08-20T01:45:09.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.785+0000 7f12effff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562cb53db130 0x562cb53d4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:09.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.785+0000 7f12f85a4740 10 client.0 _ll_register_callbacks cb 0x7f12e0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:45:09.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.785+0000 7f12eeffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb53cf1a0 0x562cb53d4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:09.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.785+0000 7f12eeffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb53cf1a0 0x562cb53d4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:38812/0 (socket says 172.21.15.79:38812) 2024-08-20T01:45:09.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.785+0000 7f12effff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562cb53db130 0x562cb53d4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46890/0 (socket says 172.21.15.79:46890) 2024-08-20T01:45:09.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.785+0000 7f12eeffd640 1 -- 172.21.15.79:0/3415073783 learned_addr learned my addr 172.21.15.79:0/3415073783 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:09.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.785+0000 7f12ef7fe640 1 --2- 172.21.15.79:0/3415073783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cb53ce880 0x562cb53d44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:09.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.785+0000 7f12effff640 1 -- 172.21.15.79:0/3415073783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cb53ce880 msgr2=0x562cb53d44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:09.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.785+0000 7f12effff640 1 --2- 172.21.15.79:0/3415073783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cb53ce880 0x562cb53d44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:09.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.785+0000 7f12effff640 1 -- 172.21.15.79:0/3415073783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb53cf1a0 msgr2=0x562cb53d4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:09.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.785+0000 7f12effff640 1 --2- 172.21.15.79:0/3415073783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb53cf1a0 0x562cb53d4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:09.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.785+0000 7f12effff640 1 -- 172.21.15.79:0/3415073783 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cb53cd130 con 0x562cb53db130 2024-08-20T01:45:09.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.785+0000 7f12eeffd640 1 --2- 172.21.15.79:0/3415073783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb53cf1a0 0x562cb53d4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:45:09.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.785+0000 7f12ef7fe640 1 --2- 172.21.15.79:0/3415073783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cb53ce880 0x562cb53d44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:45:09.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.786+0000 7f12effff640 1 --2- 172.21.15.79:0/3415073783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562cb53db130 0x562cb53d4f60 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f12e8000f80 tx=0x7f12e8004c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2e8043031392eb3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:09.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.786+0000 7f12ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:45:09.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.786+0000 7f12ceffd640 1 -- 172.21.15.79:0/3415073783 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e8027020 con 0x562cb53db130 2024-08-20T01:45:09.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.786+0000 7f12ceffd640 1 -- 172.21.15.79:0/3415073783 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f12e800f560 con 0x562cb53db130 2024-08-20T01:45:09.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.786+0000 7f12f85a4740 1 -- 172.21.15.79:0/3415073783 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12e0064070 con 0x562cb53db130 2024-08-20T01:45:09.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.786+0000 7f12ceffd640 1 -- 172.21.15.79:0/3415073783 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f12e800f780 con 0x562cb53db130 2024-08-20T01:45:09.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.786+0000 7f12f85a4740 10 client.17784 fetch_fsmap learned FSMap version 42 2024-08-20T01:45:09.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.786+0000 7f12f85a4740 1 -- 172.21.15.79:0/3415073783 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x562cb53cbfd0 con 0x562cb53db130 2024-08-20T01:45:09.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.786+0000 7f12ceffd640 1 -- 172.21.15.79:0/3415073783 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f12e0064070 con 0x562cb53db130 2024-08-20T01:45:09.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.786+0000 7f12ceffd640 1 -- 172.21.15.79:0/3415073783 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 42) ==== 8390+0+0 (secure 0 0 0) 0x7f12e8005540 con 0x562cb53db130 2024-08-20T01:45:09.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.787+0000 7f12f85a4740 10 client.17784 fetch_fsmap finished waiting for FSMap version 42 2024-08-20T01:45:09.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.787+0000 7f12f85a4740 10 client.17784 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:45:09.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.787+0000 7f12f85a4740 20 client.17784 populate_metadata read hostname 'smithi079' 2024-08-20T01:45:09.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.787+0000 7f12f85a4740 1 --2- 172.21.15.79:0/3415073783 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x562cb53e38a0 0x562cb5457c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:09.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.787+0000 7f12f85a4740 4 client.17784 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:45:09.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.787+0000 7f12f85a4740 1 -- 172.21.15.79:0/3415073783 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562cb5343320 con 0x562cb53e38a0 2024-08-20T01:45:09.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.787+0000 7f12ef7fe640 1 --2- 172.21.15.79:0/3415073783 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x562cb53e38a0 0x562cb5457c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:09.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.787+0000 7f12ceffd640 10 client.17784 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:45:09.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.787+0000 7f12ef7fe640 1 --2- 172.21.15.79:0/3415073783 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x562cb53e38a0 0x562cb5457c40 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=db549b2fb1e1dd58 server_cookie=659ae262a09f8870 in_seq=0 out_seq=0 2024-08-20T01:45:09.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.787+0000 7f12ceffd640 1 -- 172.21.15.79:0/3415073783 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562cb5343320 con 0x562cb53e38a0 2024-08-20T01:45:09.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.787+0000 7f12ceffd640 10 client.17784 handle_command_reply: tid=0 2024-08-20T01:45:09.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.788+0000 7f12f85a4740 1 client.17784 shutdown 2024-08-20T01:45:09.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.788+0000 7f12f85a4740 1 -- 172.21.15.79:0/3415073783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562cb53db130 msgr2=0x562cb53d4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:09.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.788+0000 7f12f85a4740 1 --2- 172.21.15.79:0/3415073783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562cb53db130 0x562cb53d4f60 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f12e8000f80 tx=0x7f12e8004c30 comp rx=0 tx=0).stop 2024-08-20T01:45:09.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.788+0000 7f12f85a4740 1 -- 172.21.15.79:0/3415073783 shutdown_connections 2024-08-20T01:45:09.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.788+0000 7f12f85a4740 1 --2- 172.21.15.79:0/3415073783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562cb53db130 0x562cb53d4f60 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:09.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.788+0000 7f12f85a4740 1 --2- 172.21.15.79:0/3415073783 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x562cb53e38a0 0x562cb5457c40 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:09.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.788+0000 7f12f85a4740 1 --2- 172.21.15.79:0/3415073783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb53cf1a0 0x562cb53d4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:09.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.788+0000 7f12ceffd640 0 client.17784 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:45:09.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.788+0000 7f12f85a4740 1 --2- 172.21.15.79:0/3415073783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cb53ce880 0x562cb53d44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:09.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.788+0000 7f12f85a4740 1 -- 172.21.15.79:0/3415073783 >> 172.21.15.79:0/3415073783 conn(0x562cb53cc6b0 msgr2=0x562cb53caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:09.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.788+0000 7f12f85a4740 1 -- 172.21.15.79:0/3415073783 shutdown_connections 2024-08-20T01:45:09.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.788+0000 7f12f85a4740 1 -- 172.21.15.79:0/3415073783 wait complete. 2024-08-20T01:45:09.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.788+0000 7f12f85a4740 20 client.17784 trim_cache size 0 max 16384 2024-08-20T01:45:09.501 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:45:09.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.789+0000 7f12f61ab640 1 -- 172.21.15.79:0/3474155164 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f12d80b3bd0 msgr2=0x7f12d80b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:09.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.789+0000 7f12f61ab640 1 --2- 172.21.15.79:0/3474155164 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f12d80b3bd0 0x7f12d80b6090 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f12e00057c0 tx=0x7f12e00058d0 comp rx=0 tx=0).stop 2024-08-20T01:45:09.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.789+0000 7f12f61ab640 1 -- 172.21.15.79:0/3474155164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12f01073a0 msgr2=0x7f12f019b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:09.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.789+0000 7f12f61ab640 1 --2- 172.21.15.79:0/3474155164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12f01073a0 0x7f12f019b6c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f12e400e9f0 tx=0x7f12e400eeb0 comp rx=0 tx=0).stop 2024-08-20T01:45:09.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.789+0000 7f12f61ab640 1 -- 172.21.15.79:0/3474155164 shutdown_connections 2024-08-20T01:45:09.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.789+0000 7f12f61ab640 1 --2- 172.21.15.79:0/3474155164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12f0107d20 0x7f12f01a0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:09.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.789+0000 7f12f61ab640 1 --2- 172.21.15.79:0/3474155164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12f01073a0 0x7f12f019b6c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:09.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.789+0000 7f12f61ab640 1 --2- 172.21.15.79:0/3474155164 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f12d80b3bd0 0x7f12d80b6090 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:09.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.789+0000 7f12f61ab640 1 --2- 172.21.15.79:0/3474155164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12f0101990 0x7f12f019b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:09.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.789+0000 7f12f61ab640 1 -- 172.21.15.79:0/3474155164 >> 172.21.15.79:0/3474155164 conn(0x7f12f00fd400 msgr2=0x7f12f01039b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:09.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.789+0000 7f12f61ab640 1 -- 172.21.15.79:0/3474155164 shutdown_connections 2024-08-20T01:45:09.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:08.789+0000 7f12f61ab640 1 -- 172.21.15.79:0/3474155164 wait complete. 2024-08-20T01:45:10.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:09 smithi079 ceph-mon[18656]: pgmap v582: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 29 MiB/s wr, 25 op/s 2024-08-20T01:45:10.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:09 smithi081 ceph-mon[22209]: pgmap v582: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 29 MiB/s wr, 25 op/s 2024-08-20T01:45:10.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:09 smithi175 ceph-mon[22392]: pgmap v582: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 29 MiB/s wr, 25 op/s 2024-08-20T01:45:11.877 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T01:45:12.153 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:45:12.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:11 smithi079 ceph-mon[18656]: pgmap v583: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 28 MiB/s wr, 24 op/s 2024-08-20T01:45:12.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:11 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:45:12.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:11 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:45:12.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:11 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:45:12.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:11 smithi081 ceph-mon[22209]: pgmap v583: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 28 MiB/s wr, 24 op/s 2024-08-20T01:45:12.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:11 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:45:12.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:11 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:45:12.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:11 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:45:12.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:11 smithi175 ceph-mon[22392]: pgmap v583: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 28 MiB/s wr, 24 op/s 2024-08-20T01:45:12.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:11 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:45:12.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:11 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:45:12.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:11 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:45:12.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.680+0000 7fab27633640 1 -- 172.21.15.79:0/2096734332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab201084b0 msgr2=0x7fab201088f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:12.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.680+0000 7fab27633640 1 --2- 172.21.15.79:0/2096734332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab201084b0 0x7fab201088f0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fab10009900 tx=0x7fab1002a410 comp rx=0 tx=0).stop 2024-08-20T01:45:12.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.681+0000 7fab27633640 1 -- 172.21.15.79:0/2096734332 shutdown_connections 2024-08-20T01:45:12.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.681+0000 7fab27633640 1 --2- 172.21.15.79:0/2096734332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab20108e30 0x7fab2010f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:12.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.681+0000 7fab27633640 1 --2- 172.21.15.79:0/2096734332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab201084b0 0x7fab201088f0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:12.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.681+0000 7fab27633640 1 --2- 172.21.15.79:0/2096734332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab20102aa0 0x7fab20102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:12.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.681+0000 7fab27633640 1 -- 172.21.15.79:0/2096734332 >> 172.21.15.79:0/2096734332 conn(0x7fab200fe550 msgr2=0x7fab20100970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:12.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.681+0000 7fab27633640 1 -- 172.21.15.79:0/2096734332 shutdown_connections 2024-08-20T01:45:12.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.681+0000 7fab27633640 1 -- 172.21.15.79:0/2096734332 wait complete. 2024-08-20T01:45:12.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.681+0000 7fab27633640 1 Processor -- start 2024-08-20T01:45:12.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.681+0000 7fab27633640 1 -- start start 2024-08-20T01:45:12.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.682+0000 7fab27633640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab20102aa0 0x7fab200751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:12.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.682+0000 7fab27633640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab201084b0 0x7fab20075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:12.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.682+0000 7fab27633640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab20108e30 0x7fab20075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:12.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.682+0000 7fab27633640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fab201129a0 con 0x7fab20108e30 2024-08-20T01:45:12.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.682+0000 7fab27633640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fab20112820 con 0x7fab201084b0 2024-08-20T01:45:12.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.682+0000 7fab27633640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fab20112b20 con 0x7fab20102aa0 2024-08-20T01:45:12.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.682+0000 7fab25bd0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab20108e30 0x7fab20075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:12.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.682+0000 7fab25bd0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab20108e30 0x7fab20075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54630/0 (socket says 172.21.15.79:54630) 2024-08-20T01:45:12.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.682+0000 7fab25bd0640 1 -- 172.21.15.79:0/2623004825 learned_addr learned my addr 172.21.15.79:0/2623004825 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:12.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.682+0000 7fab253cf640 1 --2- 172.21.15.79:0/2623004825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab20102aa0 0x7fab200751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:12.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.682+0000 7fab24bce640 1 --2- 172.21.15.79:0/2623004825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab201084b0 0x7fab20075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:12.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.682+0000 7fab25bd0640 1 -- 172.21.15.79:0/2623004825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab20102aa0 msgr2=0x7fab200751d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:12.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.682+0000 7fab25bd0640 1 --2- 172.21.15.79:0/2623004825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab20102aa0 0x7fab200751d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:12.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.682+0000 7fab25bd0640 1 -- 172.21.15.79:0/2623004825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab201084b0 msgr2=0x7fab20075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:12.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.682+0000 7fab25bd0640 1 --2- 172.21.15.79:0/2623004825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab201084b0 0x7fab20075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:12.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.682+0000 7fab25bd0640 1 -- 172.21.15.79:0/2623004825 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab201a7230 con 0x7fab20108e30 2024-08-20T01:45:12.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.682+0000 7fab25bd0640 1 --2- 172.21.15.79:0/2623004825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab20108e30 0x7fab20075c50 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fab1800cce0 tx=0x7fab1800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:12.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.683+0000 7fab167fc640 1 -- 172.21.15.79:0/2623004825 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab1800f450 con 0x7fab20108e30 2024-08-20T01:45:12.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.683+0000 7fab167fc640 1 -- 172.21.15.79:0/2623004825 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fab1800fa80 con 0x7fab20108e30 2024-08-20T01:45:12.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.683+0000 7fab167fc640 1 -- 172.21.15.79:0/2623004825 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab18018ad0 con 0x7fab20108e30 2024-08-20T01:45:12.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.683+0000 7fab27633640 1 -- 172.21.15.79:0/2623004825 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab201a7520 con 0x7fab20108e30 2024-08-20T01:45:12.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.683+0000 7fab27633640 1 -- 172.21.15.79:0/2623004825 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab201a79e0 con 0x7fab20108e30 2024-08-20T01:45:12.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.686+0000 7fab167fc640 1 -- 172.21.15.79:0/2623004825 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fab1800f5f0 con 0x7fab20108e30 2024-08-20T01:45:12.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.686+0000 7fab29a2c740 1 Processor -- start 2024-08-20T01:45:12.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.686+0000 7fab29a2c740 1 -- start start 2024-08-20T01:45:12.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.686+0000 7fab29a2c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b53bcba880 0x55b53bcbac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:12.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.686+0000 7fab29a2c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b53bcbb1a0 0x55b53bcc6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:12.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.686+0000 7fab29a2c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b53bcc7130 0x55b53bcc9520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:12.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.686+0000 7fab29a2c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b53bc31930 con 0x55b53bcba880 2024-08-20T01:45:12.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.686+0000 7fab29a2c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b53bc20e30 con 0x55b53bcc7130 2024-08-20T01:45:12.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.686+0000 7fab29a2c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b53bc24e70 con 0x55b53bcbb1a0 2024-08-20T01:45:12.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.686+0000 7fab24bce640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b53bcba880 0x55b53bcbac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:12.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.686+0000 7fab24bce640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b53bcba880 0x55b53bcbac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54644/0 (socket says 172.21.15.79:54644) 2024-08-20T01:45:12.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.686+0000 7fab24bce640 1 -- 172.21.15.79:0/2901379339 learned_addr learned my addr 172.21.15.79:0/2901379339 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:12.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.686+0000 7fab24bce640 1 --2- 172.21.15.79:0/2901379339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b53bcc7130 0x55b53bcc9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:12.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.687+0000 7fab253cf640 1 --2- 172.21.15.79:0/2901379339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b53bcbb1a0 0x55b53bcc6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:12.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.687+0000 7fab24bce640 1 -- 172.21.15.79:0/2901379339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b53bcbb1a0 msgr2=0x55b53bcc6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:12.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.687+0000 7fab24bce640 1 --2- 172.21.15.79:0/2901379339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b53bcbb1a0 0x55b53bcc6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:12.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.687+0000 7fab24bce640 1 -- 172.21.15.79:0/2901379339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b53bcc7130 msgr2=0x55b53bcc9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:12.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.687+0000 7fab24bce640 1 --2- 172.21.15.79:0/2901379339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b53bcc7130 0x55b53bcc9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:12.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.687+0000 7fab24bce640 1 -- 172.21.15.79:0/2901379339 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b53b980650 con 0x55b53bcba880 2024-08-20T01:45:12.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.687+0000 7fab253cf640 1 --2- 172.21.15.79:0/2901379339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b53bcbb1a0 0x55b53bcc6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:45:12.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.687+0000 7fab167fc640 1 --2- 172.21.15.79:0/2623004825 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fab0c0b3c50 0x7fab0c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:12.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.687+0000 7fab253cf640 1 --2- 172.21.15.79:0/2623004825 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fab0c0b3c50 0x7fab0c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:12.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.687+0000 7fab24bce640 1 --2- 172.21.15.79:0/2901379339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b53bcba880 0x55b53bcbac60 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fab10009900 tx=0x7fab10005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4345dc37b1e35a25 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:12.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.687+0000 7fab167fc640 1 -- 172.21.15.79:0/2623004825 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fab180e42c0 con 0x7fab20108e30 2024-08-20T01:45:12.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.687+0000 7fab0b7fe640 1 -- 172.21.15.79:0/2901379339 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab10035030 con 0x55b53bcba880 2024-08-20T01:45:12.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.687+0000 7fab0b7fe640 1 -- 172.21.15.79:0/2901379339 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fab10004030 con 0x55b53bcba880 2024-08-20T01:45:12.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.687+0000 7fab0b7fe640 1 -- 172.21.15.79:0/2901379339 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab10003950 con 0x55b53bcba880 2024-08-20T01:45:12.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.688+0000 7fab29a2c740 1 -- 172.21.15.79:0/2901379339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b53bcba880 msgr2=0x55b53bcbac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:12.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.688+0000 7fab29a2c740 1 --2- 172.21.15.79:0/2901379339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b53bcba880 0x55b53bcbac60 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fab10009900 tx=0x7fab10005fd0 comp rx=0 tx=0).stop 2024-08-20T01:45:12.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.688+0000 7fab253cf640 1 --2- 172.21.15.79:0/2623004825 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fab0c0b3c50 0x7fab0c0b6110 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x55b53bcbda00 tx=0x7fab1c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:12.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.688+0000 7fab29a2c740 1 -- 172.21.15.79:0/2901379339 shutdown_connections 2024-08-20T01:45:12.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.688+0000 7fab29a2c740 1 --2- 172.21.15.79:0/2901379339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b53bcc7130 0x55b53bcc9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:12.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.688+0000 7fab29a2c740 1 --2- 172.21.15.79:0/2901379339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b53bcbb1a0 0x55b53bcc6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:12.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.688+0000 7fab29a2c740 1 --2- 172.21.15.79:0/2901379339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b53bcba880 0x55b53bcbac60 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:12.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.688+0000 7fab29a2c740 1 -- 172.21.15.79:0/2901379339 >> 172.21.15.79:0/2901379339 conn(0x55b53bcb86b0 msgr2=0x55b53bcb9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:12.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.688+0000 7fab29a2c740 1 -- 172.21.15.79:0/2901379339 shutdown_connections 2024-08-20T01:45:12.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.688+0000 7fab29a2c740 1 -- 172.21.15.79:0/2901379339 wait complete. 2024-08-20T01:45:12.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.689+0000 7fab29a2c740 1 -- start start 2024-08-20T01:45:12.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.689+0000 7fab29a2c740 1 Processor -- start 2024-08-20T01:45:12.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.689+0000 7fab29a2c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b53bcba880 0x55b53bcc4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:12.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.689+0000 7fab29a2c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b53bcbb1a0 0x55b53bcc4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:12.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.689+0000 7fab29a2c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b53bcc7130 0x55b53bcc4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:12.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.689+0000 7fab29a2c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b53ba83700 con 0x55b53bcc7130 2024-08-20T01:45:12.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.689+0000 7fab29a2c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b53bba7810 con 0x55b53bcbb1a0 2024-08-20T01:45:12.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.689+0000 7fab29a2c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b53bcc9d80 con 0x55b53bcba880 2024-08-20T01:45:12.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.689+0000 7fab29a2c740 10 client.0 _ll_register_callbacks cb 0x55b53bc1a700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:45:12.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.690+0000 7fab25bd0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b53bcc7130 0x55b53bcc4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:12.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.690+0000 7fab24bce640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b53bcbb1a0 0x55b53bcc4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:12.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.690+0000 7fab24bce640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b53bcbb1a0 0x55b53bcc4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:56054/0 (socket says 172.21.15.79:56054) 2024-08-20T01:45:12.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.690+0000 7fab24bce640 1 -- 172.21.15.79:0/4125375583 learned_addr learned my addr 172.21.15.79:0/4125375583 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:12.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.690+0000 7fab25bd0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b53bcc7130 0x55b53bcc4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54648/0 (socket says 172.21.15.79:54648) 2024-08-20T01:45:12.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.690+0000 7fab253cf640 1 --2- 172.21.15.79:0/4125375583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b53bcba880 0x55b53bcc4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:12.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.690+0000 7fab25bd0640 1 -- 172.21.15.79:0/4125375583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b53bcba880 msgr2=0x55b53bcc4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:12.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.690+0000 7fab25bd0640 1 --2- 172.21.15.79:0/4125375583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b53bcba880 0x55b53bcc4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:12.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.690+0000 7fab25bd0640 1 -- 172.21.15.79:0/4125375583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b53bcbb1a0 msgr2=0x55b53bcc4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:12.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.690+0000 7fab25bd0640 1 --2- 172.21.15.79:0/4125375583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b53bcbb1a0 0x55b53bcc4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:12.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.690+0000 7fab25bd0640 1 -- 172.21.15.79:0/4125375583 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b53bcd31b0 con 0x55b53bcc7130 2024-08-20T01:45:12.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.690+0000 7fab25bd0640 1 --2- 172.21.15.79:0/4125375583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b53bcc7130 0x55b53bcc4bd0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fab180e1dd0 tx=0x7fab1800f8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da88da8bb368411f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:12.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.690+0000 7fab24bce640 1 --2- 172.21.15.79:0/4125375583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b53bcbb1a0 0x55b53bcc4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:45:12.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.690+0000 7fab08ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:45:12.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.690+0000 7fab08ff9640 1 -- 172.21.15.79:0/4125375583 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab180ab220 con 0x55b53bcc7130 2024-08-20T01:45:12.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.690+0000 7fab29a2c740 1 -- 172.21.15.79:0/4125375583 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b53bbd0150 con 0x55b53bcc7130 2024-08-20T01:45:12.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.690+0000 7fab08ff9640 1 -- 172.21.15.79:0/4125375583 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fab180a7810 con 0x55b53bcc7130 2024-08-20T01:45:12.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.690+0000 7fab08ff9640 1 -- 172.21.15.79:0/4125375583 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fab180af820 con 0x55b53bcc7130 2024-08-20T01:45:12.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.690+0000 7fab29a2c740 10 client.17796 fetch_fsmap learned FSMap version 42 2024-08-20T01:45:12.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.690+0000 7fab29a2c740 1 -- 172.21.15.79:0/4125375583 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55b53bcd5bb0 con 0x55b53bcc7130 2024-08-20T01:45:12.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.691+0000 7fab08ff9640 1 -- 172.21.15.79:0/4125375583 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55b53bbd0150 con 0x55b53bcc7130 2024-08-20T01:45:12.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.691+0000 7fab08ff9640 1 -- 172.21.15.79:0/4125375583 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 42) ==== 8390+0+0 (secure 0 0 0) 0x7fab180a6b90 con 0x55b53bcc7130 2024-08-20T01:45:12.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.691+0000 7fab29a2c740 10 client.17796 fetch_fsmap finished waiting for FSMap version 42 2024-08-20T01:45:12.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.691+0000 7fab29a2c740 10 client.17796 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:45:12.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.691+0000 7fab29a2c740 20 client.17796 populate_metadata read hostname 'smithi079' 2024-08-20T01:45:12.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.691+0000 7fab29a2c740 1 --2- 172.21.15.79:0/4125375583 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55b53bcd7580 0x55b53bcd99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:12.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.691+0000 7fab29a2c740 4 client.17796 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:45:12.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.691+0000 7fab29a2c740 1 -- 172.21.15.79:0/4125375583 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b53bc33880 con 0x55b53bcd7580 2024-08-20T01:45:12.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.691+0000 7fab253cf640 1 --2- 172.21.15.79:0/4125375583 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55b53bcd7580 0x55b53bcd99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:12.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.692+0000 7fab08ff9640 10 client.17796 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:45:12.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.692+0000 7fab253cf640 1 --2- 172.21.15.79:0/4125375583 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55b53bcd7580 0x55b53bcd99a0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fc4e2302ea9fed3 server_cookie=ec19ae0a637f72da in_seq=0 out_seq=0 2024-08-20T01:45:12.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.692+0000 7fab08ff9640 1 -- 172.21.15.79:0/4125375583 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b53bc33880 con 0x55b53bcd7580 2024-08-20T01:45:12.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.692+0000 7fab08ff9640 10 client.17796 handle_command_reply: tid=0 2024-08-20T01:45:12.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.692+0000 7fab29a2c740 1 client.17796 shutdown 2024-08-20T01:45:12.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.692+0000 7fab29a2c740 1 -- 172.21.15.79:0/4125375583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b53bcc7130 msgr2=0x55b53bcc4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:12.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.692+0000 7fab29a2c740 1 --2- 172.21.15.79:0/4125375583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b53bcc7130 0x55b53bcc4bd0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fab180e1dd0 tx=0x7fab1800f8e0 comp rx=0 tx=0).stop 2024-08-20T01:45:12.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.692+0000 7fab29a2c740 1 -- 172.21.15.79:0/4125375583 shutdown_connections 2024-08-20T01:45:12.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.692+0000 7fab29a2c740 1 --2- 172.21.15.79:0/4125375583 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55b53bcd7580 0x55b53bcd99a0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:12.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.692+0000 7fab29a2c740 1 --2- 172.21.15.79:0/4125375583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b53bcc7130 0x55b53bcc4bd0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:12.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.692+0000 7fab29a2c740 1 --2- 172.21.15.79:0/4125375583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b53bcbb1a0 0x55b53bcc4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:12.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.692+0000 7fab29a2c740 1 --2- 172.21.15.79:0/4125375583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b53bcba880 0x55b53bcc4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:12.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.692+0000 7fab29a2c740 1 -- 172.21.15.79:0/4125375583 >> 172.21.15.79:0/4125375583 conn(0x55b53bcb86b0 msgr2=0x55b53bcbe250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:12.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.692+0000 7fab08ff9640 0 client.17796 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:45:12.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.693+0000 7fab29a2c740 1 -- 172.21.15.79:0/4125375583 shutdown_connections 2024-08-20T01:45:12.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.693+0000 7fab29a2c740 1 -- 172.21.15.79:0/4125375583 wait complete. 2024-08-20T01:45:12.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.693+0000 7fab29a2c740 20 client.17796 trim_cache size 0 max 16384 2024-08-20T01:45:12.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.706+0000 7fab29a2c740 1 Processor -- start 2024-08-20T01:45:12.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.706+0000 7fab29a2c740 1 -- start start 2024-08-20T01:45:12.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.706+0000 7fab29a2c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b53bcba880 0x55b53bcb31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:12.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.706+0000 7fab29a2c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b53bcbb1a0 0x55b53bcbe140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:12.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.706+0000 7fab29a2c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b53bcc7130 0x55b53bcc4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:12.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.706+0000 7fab29a2c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fab201affd0 con 0x55b53bcbb1a0 2024-08-20T01:45:12.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.706+0000 7fab29a2c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fab201b1c60 con 0x55b53bcba880 2024-08-20T01:45:12.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.706+0000 7fab29a2c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fab201b06a0 con 0x55b53bcc7130 2024-08-20T01:45:12.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.706+0000 7fab24bce640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b53bcbb1a0 0x55b53bcbe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:12.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.706+0000 7fab24bce640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b53bcbb1a0 0x55b53bcbe140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54658/0 (socket says 172.21.15.79:54658) 2024-08-20T01:45:12.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.706+0000 7fab24bce640 1 -- 172.21.15.79:0/2173650357 learned_addr learned my addr 172.21.15.79:0/2173650357 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:12.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.706+0000 7fab25bd0640 1 --2- 172.21.15.79:0/2173650357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b53bcc7130 0x55b53bcc4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:12.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.706+0000 7fab253cf640 1 --2- 172.21.15.79:0/2173650357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b53bcba880 0x55b53bcb31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:12.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.707+0000 7fab24bce640 1 -- 172.21.15.79:0/2173650357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b53bcc7130 msgr2=0x55b53bcc4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:12.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.707+0000 7fab24bce640 1 --2- 172.21.15.79:0/2173650357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b53bcc7130 0x55b53bcc4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:12.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.707+0000 7fab24bce640 1 -- 172.21.15.79:0/2173650357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b53bcba880 msgr2=0x55b53bcb31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:12.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.707+0000 7fab24bce640 1 --2- 172.21.15.79:0/2173650357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b53bcba880 0x55b53bcb31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:12.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.707+0000 7fab24bce640 1 -- 172.21.15.79:0/2173650357 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b53bcc30b0 con 0x55b53bcbb1a0 2024-08-20T01:45:12.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.707+0000 7fab253cf640 1 --2- 172.21.15.79:0/2173650357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b53bcba880 0x55b53bcb31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:45:12.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.707+0000 7fab24bce640 1 --2- 172.21.15.79:0/2173650357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b53bcbb1a0 0x55b53bcbe140 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fab10000c00 tx=0x7fab100316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7fe70f2e35ccfc2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:12.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.707+0000 7fab0affd640 1 -- 172.21.15.79:0/2173650357 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab1004f020 con 0x55b53bcbb1a0 2024-08-20T01:45:12.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.707+0000 7fab0affd640 1 -- 172.21.15.79:0/2173650357 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fab1003b8f0 con 0x55b53bcbb1a0 2024-08-20T01:45:12.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.707+0000 7fab0affd640 1 -- 172.21.15.79:0/2173650357 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab10035040 con 0x55b53bcbb1a0 2024-08-20T01:45:12.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.708+0000 7fab29a2c740 1 -- 172.21.15.79:0/2173650357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b53bcbb1a0 msgr2=0x55b53bcbe140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:12.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.708+0000 7fab29a2c740 1 --2- 172.21.15.79:0/2173650357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b53bcbb1a0 0x55b53bcbe140 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fab10000c00 tx=0x7fab100316d0 comp rx=0 tx=0).stop 2024-08-20T01:45:12.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.708+0000 7fab29a2c740 1 -- 172.21.15.79:0/2173650357 shutdown_connections 2024-08-20T01:45:12.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.708+0000 7fab29a2c740 1 --2- 172.21.15.79:0/2173650357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b53bcc7130 0x55b53bcc4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:12.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.708+0000 7fab29a2c740 1 --2- 172.21.15.79:0/2173650357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b53bcbb1a0 0x55b53bcbe140 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:12.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.708+0000 7fab29a2c740 1 --2- 172.21.15.79:0/2173650357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b53bcba880 0x55b53bcb31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:12.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.708+0000 7fab29a2c740 1 -- 172.21.15.79:0/2173650357 >> 172.21.15.79:0/2173650357 conn(0x55b53bcb86b0 msgr2=0x55b53bcbda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:12.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.708+0000 7fab29a2c740 1 -- 172.21.15.79:0/2173650357 shutdown_connections 2024-08-20T01:45:12.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.708+0000 7fab29a2c740 1 -- 172.21.15.79:0/2173650357 wait complete. 2024-08-20T01:45:12.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.708+0000 7fab29a2c740 1 -- start start 2024-08-20T01:45:12.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.709+0000 7fab29a2c740 1 Processor -- start 2024-08-20T01:45:12.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.709+0000 7fab29a2c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b53bcba880 0x55b53bccf390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:12.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.709+0000 7fab29a2c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b53bcbb1a0 0x55b53bccf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:12.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.709+0000 7fab29a2c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b53bcc7130 0x55b53bcca220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:12.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.709+0000 7fab29a2c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fab201b14d0 con 0x55b53bcba880 2024-08-20T01:45:12.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.709+0000 7fab29a2c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fab201b0d70 con 0x55b53bcc7130 2024-08-20T01:45:12.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.709+0000 7fab29a2c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fab201adfb0 con 0x55b53bcbb1a0 2024-08-20T01:45:12.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.709+0000 7fab29a2c740 10 client.0 _ll_register_callbacks cb 0x7fab180077a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:45:12.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.709+0000 7fab253cf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b53bcba880 0x55b53bccf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:12.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.709+0000 7fab253cf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b53bcba880 0x55b53bccf390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54668/0 (socket says 172.21.15.79:54668) 2024-08-20T01:45:12.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.709+0000 7fab253cf640 1 -- 172.21.15.79:0/1636080800 learned_addr learned my addr 172.21.15.79:0/1636080800 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:12.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.709+0000 7fab24bce640 1 --2- 172.21.15.79:0/1636080800 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b53bcbb1a0 0x55b53bccf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:12.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.709+0000 7fab25bd0640 1 --2- 172.21.15.79:0/1636080800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b53bcc7130 0x55b53bcca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:12.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.710+0000 7fab253cf640 1 -- 172.21.15.79:0/1636080800 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b53bcbb1a0 msgr2=0x55b53bccf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:12.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.710+0000 7fab253cf640 1 --2- 172.21.15.79:0/1636080800 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b53bcbb1a0 0x55b53bccf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:12.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.710+0000 7fab253cf640 1 -- 172.21.15.79:0/1636080800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b53bcc7130 msgr2=0x55b53bcca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:12.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.710+0000 7fab253cf640 1 --2- 172.21.15.79:0/1636080800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b53bcc7130 0x55b53bcca220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:12.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.710+0000 7fab253cf640 1 -- 172.21.15.79:0/1636080800 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b53bcbafd0 con 0x55b53bcba880 2024-08-20T01:45:12.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.710+0000 7fab24bce640 1 --2- 172.21.15.79:0/1636080800 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b53bcbb1a0 0x55b53bccf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:45:12.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.710+0000 7fab253cf640 1 --2- 172.21.15.79:0/1636080800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b53bcba880 0x55b53bccf390 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fab1c009ef0 tx=0x7fab1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1a821c483e4a76f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:12.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.710+0000 7fab08ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:45:12.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.710+0000 7fab08ff9640 1 -- 172.21.15.79:0/1636080800 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab1c02e070 con 0x55b53bcba880 2024-08-20T01:45:12.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.710+0000 7fab08ff9640 1 -- 172.21.15.79:0/1636080800 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fab1c01dc40 con 0x55b53bcba880 2024-08-20T01:45:12.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.710+0000 7fab29a2c740 1 -- 172.21.15.79:0/1636080800 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab1003b8f0 con 0x55b53bcba880 2024-08-20T01:45:12.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.710+0000 7fab08ff9640 1 -- 172.21.15.79:0/1636080800 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fab1c01de40 con 0x55b53bcba880 2024-08-20T01:45:12.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.710+0000 7fab29a2c740 10 client.17802 fetch_fsmap learned FSMap version 42 2024-08-20T01:45:12.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.710+0000 7fab29a2c740 1 -- 172.21.15.79:0/1636080800 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55b53bd40e80 con 0x55b53bcba880 2024-08-20T01:45:12.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.710+0000 7fab08ff9640 1 -- 172.21.15.79:0/1636080800 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fab1003b8f0 con 0x55b53bcba880 2024-08-20T01:45:12.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.711+0000 7fab08ff9640 1 -- 172.21.15.79:0/1636080800 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 42) ==== 8390+0+0 (secure 0 0 0) 0x7fab1c00f4e0 con 0x55b53bcba880 2024-08-20T01:45:12.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.711+0000 7fab29a2c740 10 client.17802 fetch_fsmap finished waiting for FSMap version 42 2024-08-20T01:45:12.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.711+0000 7fab29a2c740 10 client.17802 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:45:12.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.711+0000 7fab29a2c740 20 client.17802 populate_metadata read hostname 'smithi079' 2024-08-20T01:45:12.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.711+0000 7fab29a2c740 1 --2- 172.21.15.79:0/1636080800 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55b53bd416d0 0x55b53bd43af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:12.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.711+0000 7fab29a2c740 4 client.17802 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:45:12.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.711+0000 7fab29a2c740 1 -- 172.21.15.79:0/1636080800 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b53bcb3880 con 0x55b53bd416d0 2024-08-20T01:45:12.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.711+0000 7fab24bce640 1 --2- 172.21.15.79:0/1636080800 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55b53bd416d0 0x55b53bd43af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:12.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.711+0000 7fab08ff9640 10 client.17802 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:45:12.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.711+0000 7fab24bce640 1 --2- 172.21.15.79:0/1636080800 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55b53bd416d0 0x55b53bd43af0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdaccd05c0e12c14 server_cookie=4f512ce7f7730b05 in_seq=0 out_seq=0 2024-08-20T01:45:12.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.712+0000 7fab08ff9640 1 -- 172.21.15.79:0/1636080800 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b53bcb3880 con 0x55b53bd416d0 2024-08-20T01:45:12.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.712+0000 7fab08ff9640 10 client.17802 handle_command_reply: tid=0 2024-08-20T01:45:12.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.712+0000 7fab29a2c740 1 client.17802 shutdown 2024-08-20T01:45:12.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.712+0000 7fab29a2c740 1 -- 172.21.15.79:0/1636080800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b53bcba880 msgr2=0x55b53bccf390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:12.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.712+0000 7fab29a2c740 1 --2- 172.21.15.79:0/1636080800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b53bcba880 0x55b53bccf390 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fab1c009ef0 tx=0x7fab1c0046c0 comp rx=0 tx=0).stop 2024-08-20T01:45:12.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.712+0000 7fab29a2c740 1 -- 172.21.15.79:0/1636080800 shutdown_connections 2024-08-20T01:45:12.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.712+0000 7fab29a2c740 1 --2- 172.21.15.79:0/1636080800 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55b53bd416d0 0x55b53bd43af0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:12.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.712+0000 7fab29a2c740 1 --2- 172.21.15.79:0/1636080800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b53bcc7130 0x55b53bcca220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:12.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.712+0000 7fab29a2c740 1 --2- 172.21.15.79:0/1636080800 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b53bcbb1a0 0x55b53bccf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:12.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.712+0000 7fab29a2c740 1 --2- 172.21.15.79:0/1636080800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b53bcba880 0x55b53bccf390 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:12.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.712+0000 7fab29a2c740 1 -- 172.21.15.79:0/1636080800 >> 172.21.15.79:0/1636080800 conn(0x55b53bcb86b0 msgr2=0x55b53bcc5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:12.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.712+0000 7fab08ff9640 0 client.17802 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:45:12.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.712+0000 7fab29a2c740 1 -- 172.21.15.79:0/1636080800 shutdown_connections 2024-08-20T01:45:12.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.712+0000 7fab29a2c740 1 -- 172.21.15.79:0/1636080800 wait complete. 2024-08-20T01:45:12.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.712+0000 7fab29a2c740 20 client.17802 trim_cache size 0 max 16384 2024-08-20T01:45:12.723 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:45:12.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.713+0000 7fab27633640 1 -- 172.21.15.79:0/2623004825 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fab0c0b3c50 msgr2=0x7fab0c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:12.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.713+0000 7fab27633640 1 --2- 172.21.15.79:0/2623004825 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fab0c0b3c50 0x7fab0c0b6110 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x55b53bcbda00 tx=0x7fab1c005f90 comp rx=0 tx=0).stop 2024-08-20T01:45:12.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.713+0000 7fab27633640 1 -- 172.21.15.79:0/2623004825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab20108e30 msgr2=0x7fab20075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:12.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.713+0000 7fab27633640 1 --2- 172.21.15.79:0/2623004825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab20108e30 0x7fab20075c50 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fab1800cce0 tx=0x7fab1800a620 comp rx=0 tx=0).stop 2024-08-20T01:45:12.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.713+0000 7fab27633640 1 -- 172.21.15.79:0/2623004825 shutdown_connections 2024-08-20T01:45:12.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.713+0000 7fab27633640 1 --2- 172.21.15.79:0/2623004825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab20108e30 0x7fab20075c50 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:12.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.713+0000 7fab27633640 1 --2- 172.21.15.79:0/2623004825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab201084b0 0x7fab20075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:12.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.713+0000 7fab27633640 1 --2- 172.21.15.79:0/2623004825 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fab0c0b3c50 0x7fab0c0b6110 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:12.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.713+0000 7fab27633640 1 --2- 172.21.15.79:0/2623004825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab20102aa0 0x7fab200751d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:12.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.713+0000 7fab27633640 1 -- 172.21.15.79:0/2623004825 >> 172.21.15.79:0/2623004825 conn(0x7fab200fe550 msgr2=0x7fab20100940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:12.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.713+0000 7fab27633640 1 -- 172.21.15.79:0/2623004825 shutdown_connections 2024-08-20T01:45:12.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:12.713+0000 7fab27633640 1 -- 172.21.15.79:0/2623004825 wait complete. 2024-08-20T01:45:14.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:13 smithi079 ceph-mon[18656]: pgmap v584: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 MiB/s wr, 23 op/s 2024-08-20T01:45:14.191 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:13 smithi175 ceph-mon[22392]: pgmap v584: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 MiB/s wr, 23 op/s 2024-08-20T01:45:14.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:13 smithi081 ceph-mon[22209]: pgmap v584: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 MiB/s wr, 23 op/s 2024-08-20T01:45:14.427 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T01:45:14.427 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T01:45:14.742 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:45:16.186 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:15 smithi079 ceph-mon[18656]: pgmap v585: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 29 MiB/s wr, 25 op/s 2024-08-20T01:45:16.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:15 smithi081 ceph-mon[22209]: pgmap v585: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 29 MiB/s wr, 25 op/s 2024-08-20T01:45:16.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:15 smithi175 ceph-mon[22392]: pgmap v585: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 29 MiB/s wr, 25 op/s 2024-08-20T01:45:16.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.586+0000 7f6012da1640 1 -- 172.21.15.79:0/880359045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f600c1073a0 msgr2=0x7f600c1077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:16.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.586+0000 7f6012da1640 1 --2- 172.21.15.79:0/880359045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f600c1073a0 0x7f600c1077e0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8009900 tx=0x7f5ff802a410 comp rx=0 tx=0).stop 2024-08-20T01:45:16.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.586+0000 7f6012da1640 1 -- 172.21.15.79:0/880359045 shutdown_connections 2024-08-20T01:45:16.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.586+0000 7f6012da1640 1 --2- 172.21.15.79:0/880359045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f600c107d20 0x7f600c10e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:16.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.586+0000 7f6012da1640 1 --2- 172.21.15.79:0/880359045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f600c1073a0 0x7f600c1077e0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:16.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.586+0000 7f6012da1640 1 --2- 172.21.15.79:0/880359045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f600c101990 0x7f600c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:16.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.586+0000 7f6012da1640 1 -- 172.21.15.79:0/880359045 >> 172.21.15.79:0/880359045 conn(0x7f600c0fd400 msgr2=0x7f600c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:16.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.586+0000 7f6012da1640 1 -- 172.21.15.79:0/880359045 shutdown_connections 2024-08-20T01:45:16.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.586+0000 7f6012da1640 1 -- 172.21.15.79:0/880359045 wait complete. 2024-08-20T01:45:16.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.587+0000 7f6012da1640 1 Processor -- start 2024-08-20T01:45:16.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.587+0000 7f6012da1640 1 -- start start 2024-08-20T01:45:16.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.587+0000 7f6012da1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f600c101990 0x7f600c10d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:16.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.587+0000 7f6012da1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f600c1073a0 0x7f600c10dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:16.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.587+0000 7f6012da1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f600c107d20 0x7f600c19f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:16.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.587+0000 7f6012da1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f600c1129e0 con 0x7f600c107d20 2024-08-20T01:45:16.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.587+0000 7f6012da1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f600c112860 con 0x7f600c1073a0 2024-08-20T01:45:16.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.587+0000 7f6012da1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f600c112b60 con 0x7f600c101990 2024-08-20T01:45:16.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.587+0000 7f601133e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f600c107d20 0x7f600c19f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:16.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.588+0000 7f601133e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f600c107d20 0x7f600c19f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54686/0 (socket says 172.21.15.79:54686) 2024-08-20T01:45:16.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.588+0000 7f601133e640 1 -- 172.21.15.79:0/3243681547 learned_addr learned my addr 172.21.15.79:0/3243681547 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:16.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.588+0000 7f6010b3d640 1 --2- 172.21.15.79:0/3243681547 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f600c101990 0x7f600c10d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:16.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.588+0000 7f600bfff640 1 --2- 172.21.15.79:0/3243681547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f600c1073a0 0x7f600c10dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:16.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.588+0000 7f601133e640 1 -- 172.21.15.79:0/3243681547 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f600c101990 msgr2=0x7f600c10d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:16.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.588+0000 7f601133e640 1 --2- 172.21.15.79:0/3243681547 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f600c101990 0x7f600c10d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:16.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.588+0000 7f601133e640 1 -- 172.21.15.79:0/3243681547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f600c1073a0 msgr2=0x7f600c10dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:16.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.588+0000 7f601133e640 1 --2- 172.21.15.79:0/3243681547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f600c1073a0 0x7f600c10dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:16.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.588+0000 7f601133e640 1 -- 172.21.15.79:0/3243681547 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f600c19fe90 con 0x7f600c107d20 2024-08-20T01:45:16.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.588+0000 7f601133e640 1 --2- 172.21.15.79:0/3243681547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f600c107d20 0x7f600c19f710 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f600400eb10 tx=0x7f600400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:16.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.588+0000 7f6009ffb640 1 -- 172.21.15.79:0/3243681547 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6004004b20 con 0x7f600c107d20 2024-08-20T01:45:16.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.588+0000 7f6009ffb640 1 -- 172.21.15.79:0/3243681547 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6004004cc0 con 0x7f600c107d20 2024-08-20T01:45:16.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.588+0000 7f6012da1640 1 -- 172.21.15.79:0/3243681547 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f600c1a0180 con 0x7f600c107d20 2024-08-20T01:45:16.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.588+0000 7f6009ffb640 1 -- 172.21.15.79:0/3243681547 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6004010690 con 0x7f600c107d20 2024-08-20T01:45:16.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.589+0000 7f6012da1640 1 -- 172.21.15.79:0/3243681547 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f600c19c760 con 0x7f600c107d20 2024-08-20T01:45:16.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.591+0000 7f6009ffb640 1 -- 172.21.15.79:0/3243681547 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f6004005020 con 0x7f600c107d20 2024-08-20T01:45:16.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.591+0000 7f601519a740 1 Processor -- start 2024-08-20T01:45:16.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.591+0000 7f601519a740 1 -- start start 2024-08-20T01:45:16.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.592+0000 7f601519a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cc91283b0 0x560cc9128790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:16.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.592+0000 7f601519a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cc9128cd0 0x560cc9134720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:16.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.592+0000 7f601519a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cc9134c60 0x560cc9137050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:16.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.592+0000 7f601519a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560cc909e940 con 0x560cc9134c60 2024-08-20T01:45:16.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.592+0000 7f601519a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560cc908de40 con 0x560cc91283b0 2024-08-20T01:45:16.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.592+0000 7f601519a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560cc9091e80 con 0x560cc9128cd0 2024-08-20T01:45:16.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.592+0000 7f600bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cc91283b0 0x560cc9128790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:16.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.593+0000 7f600bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cc91283b0 0x560cc9128790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:56108/0 (socket says 172.21.15.79:56108) 2024-08-20T01:45:16.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.593+0000 7f600bfff640 1 -- 172.21.15.79:0/909851575 learned_addr learned my addr 172.21.15.79:0/909851575 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:16.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.593+0000 7f600bfff640 1 --2- 172.21.15.79:0/909851575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cc9134c60 0x560cc9137050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:16.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.593+0000 7f6010b3d640 1 --2- 172.21.15.79:0/909851575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cc9128cd0 0x560cc9134720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:16.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.593+0000 7f600bfff640 1 -- 172.21.15.79:0/909851575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cc9128cd0 msgr2=0x560cc9134720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:16.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.593+0000 7f600bfff640 1 --2- 172.21.15.79:0/909851575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cc9128cd0 0x560cc9134720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:16.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.593+0000 7f600bfff640 1 -- 172.21.15.79:0/909851575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cc91283b0 msgr2=0x560cc9128790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:16.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.593+0000 7f600bfff640 1 --2- 172.21.15.79:0/909851575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cc91283b0 0x560cc9128790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:16.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.593+0000 7f600bfff640 1 -- 172.21.15.79:0/909851575 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cc902a520 con 0x560cc9134c60 2024-08-20T01:45:16.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.593+0000 7f6009ffb640 1 --2- 172.21.15.79:0/3243681547 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5ffc0b3c50 0x7f5ffc0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:16.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.593+0000 7f6010b3d640 1 --2- 172.21.15.79:0/3243681547 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5ffc0b3c50 0x7f5ffc0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:16.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.593+0000 7f600bfff640 1 --2- 172.21.15.79:0/909851575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cc9134c60 0x560cc9137050 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8033000 tx=0x7f5ff8005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f99e537a2c7fa318 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:16.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.594+0000 7f6009ffb640 1 -- 172.21.15.79:0/3243681547 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f60040e41c0 con 0x7f600c107d20 2024-08-20T01:45:16.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.594+0000 7f5ff6ffd640 1 -- 172.21.15.79:0/909851575 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff8035070 con 0x560cc9134c60 2024-08-20T01:45:16.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.594+0000 7f5ff6ffd640 1 -- 172.21.15.79:0/909851575 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ff80038c0 con 0x560cc9134c60 2024-08-20T01:45:16.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.594+0000 7f5ff6ffd640 1 -- 172.21.15.79:0/909851575 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff8004900 con 0x560cc9134c60 2024-08-20T01:45:16.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.595+0000 7f601519a740 1 -- 172.21.15.79:0/909851575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cc9134c60 msgr2=0x560cc9137050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:16.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.595+0000 7f6010b3d640 1 --2- 172.21.15.79:0/3243681547 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5ffc0b3c50 0x7f5ffc0b6110 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x560cc912b530 tx=0x7f600000b4d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:16.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.595+0000 7f601519a740 1 --2- 172.21.15.79:0/909851575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cc9134c60 0x560cc9137050 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8033000 tx=0x7f5ff8005e80 comp rx=0 tx=0).stop 2024-08-20T01:45:16.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.595+0000 7f601519a740 1 -- 172.21.15.79:0/909851575 shutdown_connections 2024-08-20T01:45:16.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.595+0000 7f601519a740 1 --2- 172.21.15.79:0/909851575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cc9134c60 0x560cc9137050 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:16.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.595+0000 7f601519a740 1 --2- 172.21.15.79:0/909851575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cc9128cd0 0x560cc9134720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:16.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.595+0000 7f601519a740 1 --2- 172.21.15.79:0/909851575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cc91283b0 0x560cc9128790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:16.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.595+0000 7f601519a740 1 -- 172.21.15.79:0/909851575 >> 172.21.15.79:0/909851575 conn(0x560cc91261e0 msgr2=0x560cc9127380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:16.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.595+0000 7f601519a740 1 -- 172.21.15.79:0/909851575 shutdown_connections 2024-08-20T01:45:16.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.595+0000 7f601519a740 1 -- 172.21.15.79:0/909851575 wait complete. 2024-08-20T01:45:16.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.595+0000 7f601519a740 1 -- start start 2024-08-20T01:45:16.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.595+0000 7f601519a740 1 Processor -- start 2024-08-20T01:45:16.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.596+0000 7f601519a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cc91283b0 0x560cc9131c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:16.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.596+0000 7f601519a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cc9128cd0 0x560cc9132190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:16.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.596+0000 7f601519a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cc9134c60 0x560cc91326d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:16.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.596+0000 7f601519a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560cc8ef0890 con 0x560cc9128cd0 2024-08-20T01:45:16.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.596+0000 7f601519a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560cc9014700 con 0x560cc91283b0 2024-08-20T01:45:16.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.596+0000 7f601519a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560cc91379a0 con 0x560cc9134c60 2024-08-20T01:45:16.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.596+0000 7f600bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cc9128cd0 0x560cc9132190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:16.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.596+0000 7f600bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cc9128cd0 0x560cc9132190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54700/0 (socket says 172.21.15.79:54700) 2024-08-20T01:45:16.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.596+0000 7f600bfff640 1 -- 172.21.15.79:0/4174496706 learned_addr learned my addr 172.21.15.79:0/4174496706 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:16.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.596+0000 7f601133e640 1 --2- 172.21.15.79:0/4174496706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cc9134c60 0x560cc91326d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:16.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.596+0000 7f6010b3d640 1 --2- 172.21.15.79:0/4174496706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cc91283b0 0x560cc9131c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:16.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.596+0000 7f601519a740 10 client.0 _ll_register_callbacks cb 0x560cc90896f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:45:16.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.597+0000 7f6010b3d640 1 -- 172.21.15.79:0/4174496706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cc9134c60 msgr2=0x560cc91326d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:16.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.597+0000 7f6010b3d640 1 --2- 172.21.15.79:0/4174496706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cc9134c60 0x560cc91326d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:16.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.597+0000 7f6010b3d640 1 -- 172.21.15.79:0/4174496706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cc9128cd0 msgr2=0x560cc9132190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:16.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.597+0000 7f6010b3d640 1 --2- 172.21.15.79:0/4174496706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cc9128cd0 0x560cc9132190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:16.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.597+0000 7f6010b3d640 1 -- 172.21.15.79:0/4174496706 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cc8ded930 con 0x560cc91283b0 2024-08-20T01:45:16.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.597+0000 7f601133e640 1 --2- 172.21.15.79:0/4174496706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cc9134c60 0x560cc91326d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:45:16.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.597+0000 7f6010b3d640 1 --2- 172.21.15.79:0/4174496706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cc91283b0 0x560cc9131c50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6000012cb0 tx=0x7f60000046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4976acbaf6b2f102 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:16.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.597+0000 7f5febfff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:45:16.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.597+0000 7f5febfff640 1 -- 172.21.15.79:0/4174496706 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600001e820 con 0x560cc91283b0 2024-08-20T01:45:16.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.597+0000 7f601519a740 1 -- 172.21.15.79:0/4174496706 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ff80038c0 con 0x560cc91283b0 2024-08-20T01:45:16.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.597+0000 7f5febfff640 1 -- 172.21.15.79:0/4174496706 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f600001e9c0 con 0x560cc91283b0 2024-08-20T01:45:16.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.597+0000 7f5febfff640 1 -- 172.21.15.79:0/4174496706 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f600001de30 con 0x560cc91283b0 2024-08-20T01:45:16.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.597+0000 7f601519a740 10 client.26819 fetch_fsmap learned FSMap version 42 2024-08-20T01:45:16.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.597+0000 7f601519a740 1 -- 172.21.15.79:0/4174496706 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x560cc9143610 con 0x560cc91283b0 2024-08-20T01:45:16.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.598+0000 7f5febfff640 1 -- 172.21.15.79:0/4174496706 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ff80038c0 con 0x560cc91283b0 2024-08-20T01:45:16.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.598+0000 7f5febfff640 1 -- 172.21.15.79:0/4174496706 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 42) ==== 8390+0+0 (secure 0 0 0) 0x7f60000343f0 con 0x560cc91283b0 2024-08-20T01:45:16.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.598+0000 7f601519a740 10 client.26819 fetch_fsmap finished waiting for FSMap version 42 2024-08-20T01:45:16.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.598+0000 7f601519a740 10 client.26819 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:45:16.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.598+0000 7f601519a740 20 client.26819 populate_metadata read hostname 'smithi079' 2024-08-20T01:45:16.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.598+0000 7f601519a740 1 --2- 172.21.15.79:0/4174496706 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560cc9144b40 0x560cc9146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:16.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.598+0000 7f601519a740 4 client.26819 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:45:16.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.598+0000 7f601519a740 1 -- 172.21.15.79:0/4174496706 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560cc90a0890 con 0x560cc9144b40 2024-08-20T01:45:16.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.598+0000 7f600bfff640 1 --2- 172.21.15.79:0/4174496706 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560cc9144b40 0x560cc9146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:16.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.599+0000 7f5febfff640 10 client.26819 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:45:16.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.599+0000 7f600bfff640 1 --2- 172.21.15.79:0/4174496706 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560cc9144b40 0x560cc9146fc0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2743c51b07a7c02 server_cookie=1d30fd3301baa956 in_seq=0 out_seq=0 2024-08-20T01:45:16.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.599+0000 7f5febfff640 1 -- 172.21.15.79:0/4174496706 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560cc90a0890 con 0x560cc9144b40 2024-08-20T01:45:16.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.599+0000 7f5febfff640 10 client.26819 handle_command_reply: tid=0 2024-08-20T01:45:16.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.599+0000 7f601519a740 1 client.26819 shutdown 2024-08-20T01:45:16.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.600+0000 7f601519a740 1 -- 172.21.15.79:0/4174496706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cc91283b0 msgr2=0x560cc9131c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:16.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.600+0000 7f601519a740 1 --2- 172.21.15.79:0/4174496706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cc91283b0 0x560cc9131c50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6000012cb0 tx=0x7f60000046c0 comp rx=0 tx=0).stop 2024-08-20T01:45:16.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.600+0000 7f601519a740 1 -- 172.21.15.79:0/4174496706 shutdown_connections 2024-08-20T01:45:16.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.600+0000 7f601519a740 1 --2- 172.21.15.79:0/4174496706 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560cc9144b40 0x560cc9146fc0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:16.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.600+0000 7f601519a740 1 --2- 172.21.15.79:0/4174496706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cc9134c60 0x560cc91326d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:16.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.600+0000 7f601519a740 1 --2- 172.21.15.79:0/4174496706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cc9128cd0 0x560cc9132190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:16.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.600+0000 7f601519a740 1 --2- 172.21.15.79:0/4174496706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cc91283b0 0x560cc9131c50 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:16.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.600+0000 7f601519a740 1 -- 172.21.15.79:0/4174496706 >> 172.21.15.79:0/4174496706 conn(0x560cc91261e0 msgr2=0x560cc912bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:16.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.600+0000 7f5febfff640 0 client.26819 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:45:16.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.600+0000 7f601519a740 1 -- 172.21.15.79:0/4174496706 shutdown_connections 2024-08-20T01:45:16.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.600+0000 7f601519a740 1 -- 172.21.15.79:0/4174496706 wait complete. 2024-08-20T01:45:16.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.600+0000 7f601519a740 20 client.26819 trim_cache size 0 max 16384 2024-08-20T01:45:16.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.626+0000 7f601519a740 1 Processor -- start 2024-08-20T01:45:16.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.626+0000 7f601519a740 1 -- start start 2024-08-20T01:45:16.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.626+0000 7f601519a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cc91283b0 0x560cc912c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:16.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.626+0000 7f601519a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cc9128cd0 0x560cc914c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:16.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.626+0000 7f601519a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cc9134c60 0x560cc914cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:16.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.626+0000 7f601519a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f600c1bcdb0 con 0x560cc9128cd0 2024-08-20T01:45:16.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.626+0000 7f601519a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f600c1bea40 con 0x560cc9134c60 2024-08-20T01:45:16.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.626+0000 7f601519a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f600c1bd480 con 0x560cc91283b0 2024-08-20T01:45:16.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.627+0000 7f600bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cc9128cd0 0x560cc914c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:16.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.627+0000 7f600bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cc9128cd0 0x560cc914c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54710/0 (socket says 172.21.15.79:54710) 2024-08-20T01:45:16.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.627+0000 7f600bfff640 1 -- 172.21.15.79:0/488716500 learned_addr learned my addr 172.21.15.79:0/488716500 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:16.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.627+0000 7f601133e640 1 --2- 172.21.15.79:0/488716500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cc9134c60 0x560cc914cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:16.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.627+0000 7f6010b3d640 1 --2- 172.21.15.79:0/488716500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cc91283b0 0x560cc912c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:16.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.627+0000 7f600bfff640 1 -- 172.21.15.79:0/488716500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cc91283b0 msgr2=0x560cc912c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:16.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.627+0000 7f600bfff640 1 --2- 172.21.15.79:0/488716500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cc91283b0 0x560cc912c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:16.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.627+0000 7f600bfff640 1 -- 172.21.15.79:0/488716500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cc9134c60 msgr2=0x560cc914cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:16.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.627+0000 7f600bfff640 1 --2- 172.21.15.79:0/488716500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cc9134c60 0x560cc914cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:16.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.627+0000 7f600bfff640 1 -- 172.21.15.79:0/488716500 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cc9126010 con 0x560cc9128cd0 2024-08-20T01:45:16.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.627+0000 7f600bfff640 1 --2- 172.21.15.79:0/488716500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cc9128cd0 0x560cc914c890 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f5ff802a9d0 tx=0x7f5ff8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30cba3964f94025b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:16.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.627+0000 7f5ff67fc640 1 -- 172.21.15.79:0/488716500 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff805b070 con 0x560cc9128cd0 2024-08-20T01:45:16.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.627+0000 7f5ff67fc640 1 -- 172.21.15.79:0/488716500 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ff8042070 con 0x560cc9128cd0 2024-08-20T01:45:16.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.627+0000 7f5ff67fc640 1 -- 172.21.15.79:0/488716500 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff8035040 con 0x560cc9128cd0 2024-08-20T01:45:16.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.628+0000 7f601519a740 1 -- 172.21.15.79:0/488716500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cc9128cd0 msgr2=0x560cc914c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:16.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.628+0000 7f601519a740 1 --2- 172.21.15.79:0/488716500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cc9128cd0 0x560cc914c890 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f5ff802a9d0 tx=0x7f5ff8000bc0 comp rx=0 tx=0).stop 2024-08-20T01:45:16.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.628+0000 7f601519a740 1 -- 172.21.15.79:0/488716500 shutdown_connections 2024-08-20T01:45:16.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.628+0000 7f601519a740 1 --2- 172.21.15.79:0/488716500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cc9134c60 0x560cc914cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:16.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.628+0000 7f601519a740 1 --2- 172.21.15.79:0/488716500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cc9128cd0 0x560cc914c890 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:16.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.628+0000 7f601519a740 1 --2- 172.21.15.79:0/488716500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cc91283b0 0x560cc912c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:16.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.628+0000 7f601519a740 1 -- 172.21.15.79:0/488716500 >> 172.21.15.79:0/488716500 conn(0x560cc91261e0 msgr2=0x560cc9125300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:16.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.628+0000 7f601519a740 1 -- 172.21.15.79:0/488716500 shutdown_connections 2024-08-20T01:45:16.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.628+0000 7f601519a740 1 -- 172.21.15.79:0/488716500 wait complete. 2024-08-20T01:45:16.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.629+0000 7f601519a740 1 -- start start 2024-08-20T01:45:16.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.629+0000 7f601519a740 1 Processor -- start 2024-08-20T01:45:16.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.629+0000 7f601519a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cc91283b0 0x560cc913d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:16.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.629+0000 7f601519a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cc9128cd0 0x560cc9138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:16.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.630+0000 7f601519a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cc9134c60 0x560cc9138b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:16.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.630+0000 7f601519a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f600c1be2b0 con 0x560cc9134c60 2024-08-20T01:45:16.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.630+0000 7f601519a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f600c1bdb50 con 0x560cc91283b0 2024-08-20T01:45:16.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.630+0000 7f601133e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cc9134c60 0x560cc9138b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:16.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.630+0000 7f601519a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f600c1bad90 con 0x560cc9128cd0 2024-08-20T01:45:16.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.630+0000 7f6010b3d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cc91283b0 0x560cc913d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:16.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.630+0000 7f6010b3d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cc91283b0 0x560cc913d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:56134/0 (socket says 172.21.15.79:56134) 2024-08-20T01:45:16.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.630+0000 7f6010b3d640 1 -- 172.21.15.79:0/3578786550 learned_addr learned my addr 172.21.15.79:0/3578786550 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:16.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.630+0000 7f600bfff640 1 --2- 172.21.15.79:0/3578786550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cc9128cd0 0x560cc9138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:16.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.630+0000 7f601519a740 10 client.0 _ll_register_callbacks cb 0x7f600000b6f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:45:16.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.630+0000 7f601133e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cc9134c60 0x560cc9138b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54726/0 (socket says 172.21.15.79:54726) 2024-08-20T01:45:16.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.630+0000 7f6010b3d640 1 -- 172.21.15.79:0/3578786550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cc9128cd0 msgr2=0x560cc9138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:16.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.630+0000 7f6010b3d640 1 --2- 172.21.15.79:0/3578786550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cc9128cd0 0x560cc9138650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:16.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.630+0000 7f6010b3d640 1 -- 172.21.15.79:0/3578786550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cc9134c60 msgr2=0x560cc9138b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:16.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.630+0000 7f6010b3d640 1 --2- 172.21.15.79:0/3578786550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cc9134c60 0x560cc9138b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:16.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.630+0000 7f6010b3d640 1 -- 172.21.15.79:0/3578786550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cc9126c60 con 0x560cc91283b0 2024-08-20T01:45:16.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.630+0000 7f601133e640 1 --2- 172.21.15.79:0/3578786550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cc9134c60 0x560cc9138b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:45:16.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.630+0000 7f6010b3d640 1 --2- 172.21.15.79:0/3578786550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cc91283b0 0x560cc913d180 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6000005c60 tx=0x7f6000034d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c53ca8ed0e1821c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:16.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.630+0000 7f5febfff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:45:16.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.631+0000 7f5febfff640 1 -- 172.21.15.79:0/3578786550 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6000005450 con 0x560cc91283b0 2024-08-20T01:45:16.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.631+0000 7f5febfff640 1 -- 172.21.15.79:0/3578786550 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f6000004730 con 0x560cc91283b0 2024-08-20T01:45:16.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.631+0000 7f601519a740 1 -- 172.21.15.79:0/3578786550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ff8042070 con 0x560cc91283b0 2024-08-20T01:45:16.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.631+0000 7f5febfff640 1 -- 172.21.15.79:0/3578786550 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f6000041050 con 0x560cc91283b0 2024-08-20T01:45:16.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.631+0000 7f601519a740 10 client.26825 fetch_fsmap learned FSMap version 42 2024-08-20T01:45:16.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.631+0000 7f601519a740 1 -- 172.21.15.79:0/3578786550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x560cc91af5d0 con 0x560cc91283b0 2024-08-20T01:45:16.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.631+0000 7f5febfff640 1 -- 172.21.15.79:0/3578786550 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f60000055f0 con 0x560cc91283b0 2024-08-20T01:45:16.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.631+0000 7f5febfff640 1 -- 172.21.15.79:0/3578786550 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 42) ==== 8390+0+0 (secure 0 0 0) 0x7f600001eae0 con 0x560cc91283b0 2024-08-20T01:45:16.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.631+0000 7f601519a740 10 client.26825 fetch_fsmap finished waiting for FSMap version 42 2024-08-20T01:45:16.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.631+0000 7f601519a740 10 client.26825 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:45:16.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.631+0000 7f601519a740 20 client.26825 populate_metadata read hostname 'smithi079' 2024-08-20T01:45:16.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.631+0000 7f601519a740 1 --2- 172.21.15.79:0/3578786550 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560cc91afd80 0x560cc91b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:16.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.631+0000 7f601519a740 4 client.26825 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T01:45:16.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.631+0000 7f601519a740 1 -- 172.21.15.79:0/3578786550 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f5ff8042070 con 0x560cc91afd80 2024-08-20T01:45:16.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.632+0000 7f600bfff640 1 --2- 172.21.15.79:0/3578786550 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560cc91afd80 0x560cc91b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:16.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.632+0000 7f5febfff640 10 client.26825 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:45:16.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.632+0000 7f600bfff640 1 --2- 172.21.15.79:0/3578786550 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560cc91afd80 0x560cc91b21a0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3aa2fa1659168d73 server_cookie=4c4941c289d4de92 in_seq=0 out_seq=0 2024-08-20T01:45:16.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.633+0000 7f5febfff640 1 -- 172.21.15.79:0/3578786550 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f5ff8042070 con 0x560cc91afd80 2024-08-20T01:45:16.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.633+0000 7f5febfff640 10 client.26825 handle_command_reply: tid=0 2024-08-20T01:45:16.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.633+0000 7f601519a740 1 client.26825 shutdown 2024-08-20T01:45:16.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.633+0000 7f601519a740 1 -- 172.21.15.79:0/3578786550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cc91283b0 msgr2=0x560cc913d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:16.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.633+0000 7f601519a740 1 --2- 172.21.15.79:0/3578786550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cc91283b0 0x560cc913d180 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6000005c60 tx=0x7f6000034d00 comp rx=0 tx=0).stop 2024-08-20T01:45:16.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.633+0000 7f601519a740 1 -- 172.21.15.79:0/3578786550 shutdown_connections 2024-08-20T01:45:16.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.633+0000 7f601519a740 1 --2- 172.21.15.79:0/3578786550 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560cc91afd80 0x560cc91b21a0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:16.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.633+0000 7f5febfff640 0 client.26825 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:45:16.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.633+0000 7f601519a740 1 --2- 172.21.15.79:0/3578786550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cc9134c60 0x560cc9138b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:16.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.633+0000 7f601519a740 1 --2- 172.21.15.79:0/3578786550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cc9128cd0 0x560cc9138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:16.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.633+0000 7f601519a740 1 --2- 172.21.15.79:0/3578786550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cc91283b0 0x560cc913d180 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:16.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.633+0000 7f601519a740 1 -- 172.21.15.79:0/3578786550 >> 172.21.15.79:0/3578786550 conn(0x560cc91261e0 msgr2=0x560cc9124ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:16.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.634+0000 7f601519a740 1 -- 172.21.15.79:0/3578786550 shutdown_connections 2024-08-20T01:45:16.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.634+0000 7f601519a740 1 -- 172.21.15.79:0/3578786550 wait complete. 2024-08-20T01:45:16.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.634+0000 7f601519a740 20 client.26825 trim_cache size 0 max 16384 2024-08-20T01:45:16.642 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:45:16.642 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-08-20T01:45:16.642 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "b0cfb414-2c96-44b2-ac3b-b4ff97b1e7a7", 2024-08-20T01:45:16.643 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-08-20T01:45:16.643 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:45:16.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.635+0000 7f6012da1640 1 -- 172.21.15.79:0/3243681547 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5ffc0b3c50 msgr2=0x7f5ffc0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:16.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.635+0000 7f6012da1640 1 --2- 172.21.15.79:0/3243681547 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5ffc0b3c50 0x7f5ffc0b6110 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x560cc912b530 tx=0x7f600000b4d0 comp rx=0 tx=0).stop 2024-08-20T01:45:16.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.635+0000 7f6012da1640 1 -- 172.21.15.79:0/3243681547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f600c107d20 msgr2=0x7f600c19f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:16.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.635+0000 7f6012da1640 1 --2- 172.21.15.79:0/3243681547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f600c107d20 0x7f600c19f710 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f600400eb10 tx=0x7f600400c2d0 comp rx=0 tx=0).stop 2024-08-20T01:45:16.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.635+0000 7f6012da1640 1 -- 172.21.15.79:0/3243681547 shutdown_connections 2024-08-20T01:45:16.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.635+0000 7f6012da1640 1 --2- 172.21.15.79:0/3243681547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f600c107d20 0x7f600c19f710 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:16.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.635+0000 7f6012da1640 1 --2- 172.21.15.79:0/3243681547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f600c1073a0 0x7f600c10dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:16.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.635+0000 7f6012da1640 1 --2- 172.21.15.79:0/3243681547 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5ffc0b3c50 0x7f5ffc0b6110 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:16.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.635+0000 7f6012da1640 1 --2- 172.21.15.79:0/3243681547 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f600c101990 0x7f600c10d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:16.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.635+0000 7f6012da1640 1 -- 172.21.15.79:0/3243681547 >> 172.21.15.79:0/3243681547 conn(0x7f600c0fd400 msgr2=0x7f600c10f730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:16.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.635+0000 7f6012da1640 1 -- 172.21.15.79:0/3243681547 shutdown_connections 2024-08-20T01:45:16.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:16.635+0000 7f6012da1640 1 -- 172.21.15.79:0/3243681547 wait complete. 2024-08-20T01:45:17.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:16 smithi079 ceph-mon[18656]: scrub queued for path: / 2024-08-20T01:45:17.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:16 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:45:17.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:16 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:45:17.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:16 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:45:17.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:16 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:45:17.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:16 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:45:17.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:16 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:45:17.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:16 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:45:17.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:16 smithi081 ceph-mon[22209]: scrub queued for path: / 2024-08-20T01:45:17.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:16 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:45:17.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:16 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:45:17.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:16 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:45:17.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:16 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:45:17.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:16 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:45:17.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:16 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:45:17.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:16 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:45:17.370 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:45:17.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:16 smithi175 ceph-mon[22392]: scrub queued for path: / 2024-08-20T01:45:17.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:16 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:45:17.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:16 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:45:17.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:16 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:45:17.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:16 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:45:17.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:16 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:45:17.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:16 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:45:17.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:16 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:45:17.644 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:45:18.070 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:17 smithi079 ceph-mon[18656]: pgmap v586: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 23 op/s 2024-08-20T01:45:18.070 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:17 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:45:18.070 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:17 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:45:18.071 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:17 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:45:18.071 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:17 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:45:18.071 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:17 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:45:18.071 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:17 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:45:18.071 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:17 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:45:18.071 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:17 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:45:18.071 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:17 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:45:18.071 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:17 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:45:18.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.156+0000 7f1bb8efb640 1 -- 172.21.15.79:0/2033593086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bb4101990 msgr2=0x7f1bb4101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:18.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.156+0000 7f1bb8efb640 1 --2- 172.21.15.79:0/2033593086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bb4101990 0x7f1bb4101d70 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f1ba4009900 tx=0x7f1ba402a410 comp rx=0 tx=0).stop 2024-08-20T01:45:18.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.156+0000 7f1bb8efb640 1 -- 172.21.15.79:0/2033593086 shutdown_connections 2024-08-20T01:45:18.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.156+0000 7f1bb8efb640 1 --2- 172.21.15.79:0/2033593086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bb4107d20 0x7f1bb410e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.156+0000 7f1bb8efb640 1 --2- 172.21.15.79:0/2033593086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bb41073a0 0x7f1bb41077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.156+0000 7f1bb8efb640 1 --2- 172.21.15.79:0/2033593086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bb4101990 0x7f1bb4101d70 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.156+0000 7f1bb8efb640 1 -- 172.21.15.79:0/2033593086 >> 172.21.15.79:0/2033593086 conn(0x7f1bb40fd400 msgr2=0x7f1bb40ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:18.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.156+0000 7f1bb8efb640 1 -- 172.21.15.79:0/2033593086 shutdown_connections 2024-08-20T01:45:18.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.156+0000 7f1bb8efb640 1 -- 172.21.15.79:0/2033593086 wait complete. 2024-08-20T01:45:18.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.157+0000 7f1bb8efb640 1 Processor -- start 2024-08-20T01:45:18.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.157+0000 7f1bb8efb640 1 -- start start 2024-08-20T01:45:18.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.157+0000 7f1bb8efb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bb4101990 0x7f1bb4198f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:18.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.157+0000 7f1bb8efb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bb41073a0 0x7f1bb41994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:18.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.157+0000 7f1bb8efb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bb4107d20 0x7f1bb419e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:18.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.157+0000 7f1bb8efb640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb4111890 con 0x7f1bb4107d20 2024-08-20T01:45:18.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.157+0000 7f1bb8efb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb4111710 con 0x7f1bb41073a0 2024-08-20T01:45:18.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.157+0000 7f1bb8efb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb4111a10 con 0x7f1bb4101990 2024-08-20T01:45:18.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.157+0000 7f1bb2d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bb4107d20 0x7f1bb419e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:18.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.157+0000 7f1bb2d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bb4107d20 0x7f1bb419e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54754/0 (socket says 172.21.15.79:54754) 2024-08-20T01:45:18.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.157+0000 7f1bb2d9d640 1 -- 172.21.15.79:0/822858592 learned_addr learned my addr 172.21.15.79:0/822858592 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:18.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.157+0000 7f1bb1d9b640 1 --2- 172.21.15.79:0/822858592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bb41073a0 0x7f1bb41994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:18.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.158+0000 7f1bb259c640 1 --2- 172.21.15.79:0/822858592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bb4101990 0x7f1bb4198f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:18.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.158+0000 7f1bb2d9d640 1 -- 172.21.15.79:0/822858592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bb4101990 msgr2=0x7f1bb4198f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:18.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.158+0000 7f1bb2d9d640 1 --2- 172.21.15.79:0/822858592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bb4101990 0x7f1bb4198f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.158+0000 7f1bb2d9d640 1 -- 172.21.15.79:0/822858592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bb41073a0 msgr2=0x7f1bb41994b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:18.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.158+0000 7f1bb2d9d640 1 --2- 172.21.15.79:0/822858592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bb41073a0 0x7f1bb41994b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.158+0000 7f1bb2d9d640 1 -- 172.21.15.79:0/822858592 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb419f020 con 0x7f1bb4107d20 2024-08-20T01:45:18.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.158+0000 7f1bb2d9d640 1 --2- 172.21.15.79:0/822858592 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bb4107d20 0x7f1bb419e850 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f1bac00cad0 tx=0x7f1bac00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:18.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.158+0000 7f1ba37fe640 1 -- 172.21.15.79:0/822858592 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bac00ae20 con 0x7f1bb4107d20 2024-08-20T01:45:18.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.158+0000 7f1ba37fe640 1 -- 172.21.15.79:0/822858592 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1bac005020 con 0x7f1bb4107d20 2024-08-20T01:45:18.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.158+0000 7f1ba37fe640 1 -- 172.21.15.79:0/822858592 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bac00f6b0 con 0x7f1bb4107d20 2024-08-20T01:45:18.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.158+0000 7f1bb8efb640 1 -- 172.21.15.79:0/822858592 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bb419f310 con 0x7f1bb4107d20 2024-08-20T01:45:18.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.158+0000 7f1bb8efb640 1 -- 172.21.15.79:0/822858592 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bb40fd7e0 con 0x7f1bb4107d20 2024-08-20T01:45:18.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.161+0000 7f1bbb2f4740 1 Processor -- start 2024-08-20T01:45:18.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.162+0000 7f1ba37fe640 1 -- 172.21.15.79:0/822858592 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1bac0051d0 con 0x7f1bb4107d20 2024-08-20T01:45:18.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.162+0000 7f1bbb2f4740 1 -- start start 2024-08-20T01:45:18.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.162+0000 7f1bbb2f4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628b8364830 0x5628b8364c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:18.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.162+0000 7f1bbb2f4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5628b8365150 0x5628b8370ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:18.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.162+0000 7f1bbb2f4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628b83710e0 0x5628b83734d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:18.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.162+0000 7f1bbb2f4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5628b82db8e0 con 0x5628b8365150 2024-08-20T01:45:18.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.162+0000 7f1bbb2f4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5628b82cade0 con 0x5628b8364830 2024-08-20T01:45:18.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.162+0000 7f1bbb2f4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5628b82cee20 con 0x5628b83710e0 2024-08-20T01:45:18.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.162+0000 7f1bb259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5628b8365150 0x5628b8370ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:18.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.162+0000 7f1bb259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5628b8365150 0x5628b8370ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54764/0 (socket says 172.21.15.79:54764) 2024-08-20T01:45:18.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.162+0000 7f1bb259c640 1 -- 172.21.15.79:0/860825228 learned_addr learned my addr 172.21.15.79:0/860825228 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:18.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.162+0000 7f1bb1d9b640 1 --2- 172.21.15.79:0/860825228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628b8364830 0x5628b8364c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:18.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.162+0000 7f1bb1d9b640 1 --2- 172.21.15.79:0/860825228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628b83710e0 0x5628b83734d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:18.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.163+0000 7f1bb259c640 1 -- 172.21.15.79:0/860825228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628b83710e0 msgr2=0x5628b83734d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:18.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.163+0000 7f1ba37fe640 1 --2- 172.21.15.79:0/822858592 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1b9c0b8060 0x7f1b9c0ba520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:18.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.163+0000 7f1bb259c640 1 --2- 172.21.15.79:0/860825228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628b83710e0 0x5628b83734d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.163+0000 7f1bb259c640 1 -- 172.21.15.79:0/860825228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628b8364830 msgr2=0x5628b8364c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:18.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.163+0000 7f1bb259c640 1 --2- 172.21.15.79:0/860825228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628b8364830 0x5628b8364c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.163+0000 7f1bb259c640 1 -- 172.21.15.79:0/860825228 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628b802a650 con 0x5628b8365150 2024-08-20T01:45:18.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.163+0000 7f1bb1d9b640 1 --2- 172.21.15.79:0/860825228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628b8364830 0x5628b8364c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:45:18.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.163+0000 7f1bb2d9d640 1 --2- 172.21.15.79:0/822858592 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1b9c0b8060 0x7f1b9c0ba520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:18.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.163+0000 7f1ba37fe640 1 -- 172.21.15.79:0/822858592 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f1bac0e3e90 con 0x7f1bb4107d20 2024-08-20T01:45:18.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.163+0000 7f1bb259c640 1 --2- 172.21.15.79:0/860825228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5628b8365150 0x5628b8370ba0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f1ba402a930 tx=0x7f1ba4031dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed3e53c378e4834 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:18.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.163+0000 7f1ba0ff9640 1 -- 172.21.15.79:0/860825228 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba4035030 con 0x5628b8365150 2024-08-20T01:45:18.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.163+0000 7f1ba0ff9640 1 -- 172.21.15.79:0/860825228 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1ba4040070 con 0x5628b8365150 2024-08-20T01:45:18.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.163+0000 7f1bb2d9d640 1 --2- 172.21.15.79:0/822858592 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1b9c0b8060 0x7f1b9c0ba520 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1bac0aaba0 tx=0x7f1bac06fdc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:18.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.163+0000 7f1ba0ff9640 1 -- 172.21.15.79:0/860825228 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba4003a10 con 0x5628b8365150 2024-08-20T01:45:18.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.164+0000 7f1bbb2f4740 1 -- 172.21.15.79:0/860825228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5628b8365150 msgr2=0x5628b8370ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:18.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.164+0000 7f1bbb2f4740 1 --2- 172.21.15.79:0/860825228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5628b8365150 0x5628b8370ba0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f1ba402a930 tx=0x7f1ba4031dc0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.164+0000 7f1bbb2f4740 1 -- 172.21.15.79:0/860825228 shutdown_connections 2024-08-20T01:45:18.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.164+0000 7f1bbb2f4740 1 --2- 172.21.15.79:0/860825228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628b83710e0 0x5628b83734d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.164+0000 7f1bbb2f4740 1 --2- 172.21.15.79:0/860825228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5628b8365150 0x5628b8370ba0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.164+0000 7f1bbb2f4740 1 --2- 172.21.15.79:0/860825228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628b8364830 0x5628b8364c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.164+0000 7f1bbb2f4740 1 -- 172.21.15.79:0/860825228 >> 172.21.15.79:0/860825228 conn(0x5628b8362660 msgr2=0x5628b8363800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:18.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.164+0000 7f1bbb2f4740 1 -- 172.21.15.79:0/860825228 shutdown_connections 2024-08-20T01:45:18.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.164+0000 7f1bbb2f4740 1 -- 172.21.15.79:0/860825228 wait complete. 2024-08-20T01:45:18.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.165+0000 7f1bbb2f4740 1 -- start start 2024-08-20T01:45:18.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.165+0000 7f1bbb2f4740 1 Processor -- start 2024-08-20T01:45:18.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.165+0000 7f1bbb2f4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628b8364830 0x5628b836e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:18.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.165+0000 7f1bbb2f4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628b8365150 0x5628b836e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:18.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.165+0000 7f1bbb2f4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5628b83710e0 0x5628b836eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:18.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.165+0000 7f1bbb2f4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5628b812d700 con 0x5628b83710e0 2024-08-20T01:45:18.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.165+0000 7f1bbb2f4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5628b82517c0 con 0x5628b8364830 2024-08-20T01:45:18.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.165+0000 7f1bbb2f4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5628b8373d30 con 0x5628b8365150 2024-08-20T01:45:18.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.165+0000 7f1bbb2f4740 10 client.0 _ll_register_callbacks cb 0x5628b82c46b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:45:18.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.165+0000 7f1bb259c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628b8365150 0x5628b836e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:18.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.165+0000 7f1bb1d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5628b83710e0 0x5628b836eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:18.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.165+0000 7f1bb259c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628b8365150 0x5628b836e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:35448/0 (socket says 172.21.15.79:35448) 2024-08-20T01:45:18.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.165+0000 7f1bb259c640 1 -- 172.21.15.79:0/2578053516 learned_addr learned my addr 172.21.15.79:0/2578053516 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:18.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.165+0000 7f1bb1d9b640 1 --2- 172.21.15.79:0/2578053516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628b8364830 0x5628b836e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:18.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.166+0000 7f1bb259c640 1 -- 172.21.15.79:0/2578053516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628b8364830 msgr2=0x5628b836e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:18.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.166+0000 7f1bb259c640 1 --2- 172.21.15.79:0/2578053516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628b8364830 0x5628b836e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.166+0000 7f1bb259c640 1 -- 172.21.15.79:0/2578053516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5628b83710e0 msgr2=0x5628b836eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:18.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.166+0000 7f1bb259c640 1 --2- 172.21.15.79:0/2578053516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5628b83710e0 0x5628b836eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.166+0000 7f1bb259c640 1 -- 172.21.15.79:0/2578053516 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628b837d190 con 0x5628b8365150 2024-08-20T01:45:18.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.166+0000 7f1bb259c640 1 --2- 172.21.15.79:0/2578053516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628b8365150 0x5628b836e640 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1ba4005ec0 tx=0x7f1ba4009680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d57bf8c5a626650f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:18.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.166+0000 7f1b99ffb640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:45:18.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.166+0000 7f1b99ffb640 1 -- 172.21.15.79:0/2578053516 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba404c060 con 0x5628b8365150 2024-08-20T01:45:18.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.166+0000 7f1bbb2f4740 1 -- 172.21.15.79:0/2578053516 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5628b827a100 con 0x5628b8365150 2024-08-20T01:45:18.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.166+0000 7f1b99ffb640 1 -- 172.21.15.79:0/2578053516 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f1ba403c850 con 0x5628b8365150 2024-08-20T01:45:18.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.166+0000 7f1b99ffb640 1 -- 172.21.15.79:0/2578053516 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f1ba4035070 con 0x5628b8365150 2024-08-20T01:45:18.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.166+0000 7f1bbb2f4740 10 client.26812 fetch_fsmap learned FSMap version 42 2024-08-20T01:45:18.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.166+0000 7f1bbb2f4740 1 -- 172.21.15.79:0/2578053516 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5628b837fab0 con 0x5628b8365150 2024-08-20T01:45:18.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.167+0000 7f1b99ffb640 1 -- 172.21.15.79:0/2578053516 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5628b827a100 con 0x5628b8365150 2024-08-20T01:45:18.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.167+0000 7f1b99ffb640 1 -- 172.21.15.79:0/2578053516 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 42) ==== 8390+0+0 (secure 0 0 0) 0x7f1ba4044980 con 0x5628b8365150 2024-08-20T01:45:18.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.167+0000 7f1bbb2f4740 10 client.26812 fetch_fsmap finished waiting for FSMap version 42 2024-08-20T01:45:18.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.167+0000 7f1bbb2f4740 10 client.26812 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:45:18.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.167+0000 7f1bbb2f4740 20 client.26812 populate_metadata read hostname 'smithi079' 2024-08-20T01:45:18.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.167+0000 7f1bbb2f4740 1 --2- 172.21.15.79:0/2578053516 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5628b8380e00 0x5628b83831f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:18.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.167+0000 7f1bbb2f4740 4 client.26812 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:45:18.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.167+0000 7f1bbb2f4740 1 -- 172.21.15.79:0/2578053516 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5628b82dd830 con 0x5628b8380e00 2024-08-20T01:45:18.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.167+0000 7f1bb1d9b640 1 --2- 172.21.15.79:0/2578053516 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5628b8380e00 0x5628b83831f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:18.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.168+0000 7f1b99ffb640 10 client.26812 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:45:18.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.168+0000 7f1bb1d9b640 1 --2- 172.21.15.79:0/2578053516 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5628b8380e00 0x5628b83831f0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f790dcacb0da216 server_cookie=8c77e99e7737fef2 in_seq=0 out_seq=0 2024-08-20T01:45:18.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.168+0000 7f1b99ffb640 1 -- 172.21.15.79:0/2578053516 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5628b82dd830 con 0x5628b8380e00 2024-08-20T01:45:18.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.168+0000 7f1b99ffb640 10 client.26812 handle_command_reply: tid=0 2024-08-20T01:45:18.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.168+0000 7f1bbb2f4740 1 client.26812 shutdown 2024-08-20T01:45:18.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.168+0000 7f1bbb2f4740 1 -- 172.21.15.79:0/2578053516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628b8365150 msgr2=0x5628b836e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:18.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.168+0000 7f1bbb2f4740 1 --2- 172.21.15.79:0/2578053516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628b8365150 0x5628b836e640 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1ba4005ec0 tx=0x7f1ba4009680 comp rx=0 tx=0).stop 2024-08-20T01:45:18.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.168+0000 7f1bbb2f4740 1 -- 172.21.15.79:0/2578053516 shutdown_connections 2024-08-20T01:45:18.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.168+0000 7f1bbb2f4740 1 --2- 172.21.15.79:0/2578053516 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5628b8380e00 0x5628b83831f0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.168+0000 7f1bbb2f4740 1 --2- 172.21.15.79:0/2578053516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5628b83710e0 0x5628b836eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.168+0000 7f1bbb2f4740 1 --2- 172.21.15.79:0/2578053516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628b8365150 0x5628b836e640 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.168+0000 7f1bbb2f4740 1 --2- 172.21.15.79:0/2578053516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628b8364830 0x5628b836e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.168+0000 7f1bbb2f4740 1 -- 172.21.15.79:0/2578053516 >> 172.21.15.79:0/2578053516 conn(0x5628b8362660 msgr2=0x5628b8368200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:18.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.168+0000 7f1b99ffb640 0 client.26812 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:45:18.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.169+0000 7f1bbb2f4740 1 -- 172.21.15.79:0/2578053516 shutdown_connections 2024-08-20T01:45:18.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.169+0000 7f1bbb2f4740 1 -- 172.21.15.79:0/2578053516 wait complete. 2024-08-20T01:45:18.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.169+0000 7f1bbb2f4740 20 client.26812 trim_cache size 0 max 16384 2024-08-20T01:45:18.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.189+0000 7f1bbb2f4740 1 Processor -- start 2024-08-20T01:45:18.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.189+0000 7f1bbb2f4740 1 -- start start 2024-08-20T01:45:18.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.189+0000 7f1bbb2f4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5628b8364830 0x5628b8367fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:18.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.189+0000 7f1bbb2f4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628b8365150 0x5628b83684e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:18.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.189+0000 7f1bbb2f4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628b83710e0 0x5628b83888b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:18.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.189+0000 7f1bbb2f4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb41abdf0 con 0x5628b8364830 2024-08-20T01:45:18.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.189+0000 7f1bbb2f4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb41ada80 con 0x5628b8365150 2024-08-20T01:45:18.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.189+0000 7f1bbb2f4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb41ac4c0 con 0x5628b83710e0 2024-08-20T01:45:18.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.189+0000 7f1bb1d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5628b8364830 0x5628b8367fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:18.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.189+0000 7f1bb1d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5628b8364830 0x5628b8367fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54780/0 (socket says 172.21.15.79:54780) 2024-08-20T01:45:18.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.189+0000 7f1bb1d9b640 1 -- 172.21.15.79:0/2800277870 learned_addr learned my addr 172.21.15.79:0/2800277870 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:18.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.189+0000 7f1bb259c640 1 --2- 172.21.15.79:0/2800277870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628b8365150 0x5628b83684e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:18.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.189+0000 7f1bb1d9b640 1 --2- 172.21.15.79:0/2800277870 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628b83710e0 0x5628b83888b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:18.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.190+0000 7f1bb1d9b640 1 -- 172.21.15.79:0/2800277870 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628b83710e0 msgr2=0x5628b83888b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:18.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.190+0000 7f1bb1d9b640 1 --2- 172.21.15.79:0/2800277870 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628b83710e0 0x5628b83888b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.190+0000 7f1bb1d9b640 1 -- 172.21.15.79:0/2800277870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628b8365150 msgr2=0x5628b83684e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:18.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.190+0000 7f1bb1d9b640 1 --2- 172.21.15.79:0/2800277870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628b8365150 0x5628b83684e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.190+0000 7f1bb1d9b640 1 -- 172.21.15.79:0/2800277870 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628b8362490 con 0x5628b8364830 2024-08-20T01:45:18.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.190+0000 7f1bb1d9b640 1 --2- 172.21.15.79:0/2800277870 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5628b8364830 0x5628b8367fa0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f1ba800b3f0 tx=0x7f1ba8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62ac5342b46e502 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:18.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.190+0000 7f1b9bfff640 1 -- 172.21.15.79:0/2800277870 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba8027030 con 0x5628b8364830 2024-08-20T01:45:18.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.190+0000 7f1b9bfff640 1 -- 172.21.15.79:0/2800277870 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1ba8011a80 con 0x5628b8364830 2024-08-20T01:45:18.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.190+0000 7f1b9bfff640 1 -- 172.21.15.79:0/2800277870 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba801b040 con 0x5628b8364830 2024-08-20T01:45:18.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.191+0000 7f1bbb2f4740 1 -- 172.21.15.79:0/2800277870 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5628b8364830 msgr2=0x5628b8367fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:18.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.191+0000 7f1bbb2f4740 1 --2- 172.21.15.79:0/2800277870 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5628b8364830 0x5628b8367fa0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f1ba800b3f0 tx=0x7f1ba8004730 comp rx=0 tx=0).stop 2024-08-20T01:45:18.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.191+0000 7f1bbb2f4740 1 -- 172.21.15.79:0/2800277870 shutdown_connections 2024-08-20T01:45:18.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.191+0000 7f1bbb2f4740 1 --2- 172.21.15.79:0/2800277870 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628b83710e0 0x5628b83888b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.191+0000 7f1bbb2f4740 1 --2- 172.21.15.79:0/2800277870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628b8365150 0x5628b83684e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.191+0000 7f1bbb2f4740 1 --2- 172.21.15.79:0/2800277870 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5628b8364830 0x5628b8367fa0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.191+0000 7f1bbb2f4740 1 -- 172.21.15.79:0/2800277870 >> 172.21.15.79:0/2800277870 conn(0x5628b8362660 msgr2=0x5628b8367890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:18.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.191+0000 7f1bbb2f4740 1 -- 172.21.15.79:0/2800277870 shutdown_connections 2024-08-20T01:45:18.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.191+0000 7f1bbb2f4740 1 -- 172.21.15.79:0/2800277870 wait complete. 2024-08-20T01:45:18.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.191+0000 7f1bbb2f4740 1 -- start start 2024-08-20T01:45:18.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.191+0000 7f1bbb2f4740 1 Processor -- start 2024-08-20T01:45:18.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.192+0000 7f1bbb2f4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5628b8364830 0x5628b83767f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:18.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.192+0000 7f1bbb2f4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628b8365150 0x5628b8376d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:18.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.192+0000 7f1bbb2f4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628b83710e0 0x5628b83e38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:18.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.192+0000 7f1bbb2f4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb41ad2f0 con 0x5628b8364830 2024-08-20T01:45:18.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.192+0000 7f1bbb2f4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb41acb90 con 0x5628b83710e0 2024-08-20T01:45:18.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.192+0000 7f1bbb2f4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb41a9dd0 con 0x5628b8365150 2024-08-20T01:45:18.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.192+0000 7f1bbb2f4740 10 client.0 _ll_register_callbacks cb 0x7f1ba4031c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:45:18.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.192+0000 7f1bb1d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5628b8364830 0x5628b83767f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:18.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.192+0000 7f1bb1d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5628b8364830 0x5628b83767f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54790/0 (socket says 172.21.15.79:54790) 2024-08-20T01:45:18.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.192+0000 7f1bb1d9b640 1 -- 172.21.15.79:0/3523844891 learned_addr learned my addr 172.21.15.79:0/3523844891 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:18.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.192+0000 7f1bb259c640 1 --2- 172.21.15.79:0/3523844891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628b8365150 0x5628b8376d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:18.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.192+0000 7f1bb1d9b640 1 --2- 172.21.15.79:0/3523844891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628b83710e0 0x5628b83e38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:18.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.192+0000 7f1bb1d9b640 1 -- 172.21.15.79:0/3523844891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628b8365150 msgr2=0x5628b8376d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:18.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.192+0000 7f1bb1d9b640 1 --2- 172.21.15.79:0/3523844891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628b8365150 0x5628b8376d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.192+0000 7f1bb1d9b640 1 -- 172.21.15.79:0/3523844891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628b83710e0 msgr2=0x5628b83e38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.192+0000 7f1bb1d9b640 1 --2- 172.21.15.79:0/3523844891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628b83710e0 0x5628b83e38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.192+0000 7f1bb1d9b640 1 -- 172.21.15.79:0/3523844891 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628b83738c0 con 0x5628b8364830 2024-08-20T01:45:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.192+0000 7f1bb1d9b640 1 --2- 172.21.15.79:0/3523844891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5628b8364830 0x5628b83767f0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8005fa0 tx=0x7f1ba800bac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf6c342f53fec97c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.192+0000 7f1b99ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:45:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.193+0000 7f1b99ffb640 1 -- 172.21.15.79:0/3523844891 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba8027040 con 0x5628b8364830 2024-08-20T01:45:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.193+0000 7f1b99ffb640 1 -- 172.21.15.79:0/3523844891 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f1ba8021590 con 0x5628b8364830 2024-08-20T01:45:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.193+0000 7f1bbb2f4740 1 -- 172.21.15.79:0/3523844891 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ba8011a80 con 0x5628b8364830 2024-08-20T01:45:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.193+0000 7f1b99ffb640 1 -- 172.21.15.79:0/3523844891 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f1ba8021790 con 0x5628b8364830 2024-08-20T01:45:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.193+0000 7f1bbb2f4740 10 client.17838 fetch_fsmap learned FSMap version 42 2024-08-20T01:45:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.193+0000 7f1bbb2f4740 1 -- 172.21.15.79:0/3523844891 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5628b8364210 con 0x5628b8364830 2024-08-20T01:45:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.193+0000 7f1b99ffb640 1 -- 172.21.15.79:0/3523844891 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1ba803a030 con 0x5628b8364830 2024-08-20T01:45:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.193+0000 7f1b99ffb640 1 -- 172.21.15.79:0/3523844891 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 42) ==== 8390+0+0 (secure 0 0 0) 0x7f1ba802b930 con 0x5628b8364830 2024-08-20T01:45:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.193+0000 7f1bbb2f4740 10 client.17838 fetch_fsmap finished waiting for FSMap version 42 2024-08-20T01:45:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.193+0000 7f1bbb2f4740 10 client.17838 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:45:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.193+0000 7f1bbb2f4740 20 client.17838 populate_metadata read hostname 'smithi079' 2024-08-20T01:45:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.193+0000 7f1bbb2f4740 1 --2- 172.21.15.79:0/3523844891 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5628b83eb6a0 0x5628b83edac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.193+0000 7f1bbb2f4740 4 client.17838 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:45:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.193+0000 7f1bbb2f4740 1 -- 172.21.15.79:0/3523844891 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f1ba8011a80 con 0x5628b83eb6a0 2024-08-20T01:45:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.194+0000 7f1bb259c640 1 --2- 172.21.15.79:0/3523844891 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5628b83eb6a0 0x5628b83edac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.194+0000 7f1b99ffb640 10 client.17838 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:45:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.194+0000 7f1bb259c640 1 --2- 172.21.15.79:0/3523844891 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5628b83eb6a0 0x5628b83edac0 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84345c50826233ec server_cookie=cf8f62a4def05817 in_seq=0 out_seq=0 2024-08-20T01:45:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.194+0000 7f1b99ffb640 1 -- 172.21.15.79:0/3523844891 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7f1ba8011a80 con 0x5628b83eb6a0 2024-08-20T01:45:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.194+0000 7f1b99ffb640 10 client.17838 handle_command_reply: tid=0 2024-08-20T01:45:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.194+0000 7f1bbb2f4740 1 client.17838 shutdown 2024-08-20T01:45:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.194+0000 7f1bbb2f4740 1 -- 172.21.15.79:0/3523844891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5628b8364830 msgr2=0x5628b83767f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.194+0000 7f1bbb2f4740 1 --2- 172.21.15.79:0/3523844891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5628b8364830 0x5628b83767f0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8005fa0 tx=0x7f1ba800bac0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.194+0000 7f1bbb2f4740 1 -- 172.21.15.79:0/3523844891 shutdown_connections 2024-08-20T01:45:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.194+0000 7f1bbb2f4740 1 --2- 172.21.15.79:0/3523844891 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5628b83eb6a0 0x5628b83edac0 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.194+0000 7f1bbb2f4740 1 --2- 172.21.15.79:0/3523844891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628b83710e0 0x5628b83e38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.194+0000 7f1bbb2f4740 1 --2- 172.21.15.79:0/3523844891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628b8365150 0x5628b8376d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.194+0000 7f1b99ffb640 0 client.17838 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:45:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.194+0000 7f1bbb2f4740 1 --2- 172.21.15.79:0/3523844891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5628b8364830 0x5628b83767f0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.194+0000 7f1bbb2f4740 1 -- 172.21.15.79:0/3523844891 >> 172.21.15.79:0/3523844891 conn(0x5628b8362660 msgr2=0x5628b83680b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.194+0000 7f1bbb2f4740 1 -- 172.21.15.79:0/3523844891 shutdown_connections 2024-08-20T01:45:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.195+0000 7f1bbb2f4740 1 -- 172.21.15.79:0/3523844891 wait complete. 2024-08-20T01:45:18.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.195+0000 7f1bbb2f4740 20 client.17838 trim_cache size 0 max 16384 2024-08-20T01:45:18.204 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:45:18.204 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-20T01:45:18.204 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": { 2024-08-20T01:45:18.204 INFO:teuthology.orchestra.run.smithi079.stdout: "b0cfb414-2c96-44b2-ac3b-b4ff97b1e7a7": { 2024-08-20T01:45:18.204 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/", 2024-08-20T01:45:18.204 INFO:teuthology.orchestra.run.smithi079.stdout: "tag": "b0cfb414-2c96-44b2-ac3b-b4ff97b1e7a7", 2024-08-20T01:45:18.204 INFO:teuthology.orchestra.run.smithi079.stdout: "options": "recursive,force" 2024-08-20T01:45:18.204 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:45:18.205 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:45:18.205 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:45:18.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.195+0000 7f1bb8efb640 1 -- 172.21.15.79:0/822858592 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1b9c0b8060 msgr2=0x7f1b9c0ba520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:18.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.195+0000 7f1bb8efb640 1 --2- 172.21.15.79:0/822858592 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1b9c0b8060 0x7f1b9c0ba520 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1bac0aaba0 tx=0x7f1bac06fdc0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.195+0000 7f1bb8efb640 1 -- 172.21.15.79:0/822858592 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bb4107d20 msgr2=0x7f1bb419e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.195+0000 7f1bb8efb640 1 --2- 172.21.15.79:0/822858592 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bb4107d20 0x7f1bb419e850 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f1bac00cad0 tx=0x7f1bac00cf90 comp rx=0 tx=0).stop 2024-08-20T01:45:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.195+0000 7f1bb8efb640 1 -- 172.21.15.79:0/822858592 shutdown_connections 2024-08-20T01:45:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.195+0000 7f1bb8efb640 1 --2- 172.21.15.79:0/822858592 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bb4107d20 0x7f1bb419e850 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.195+0000 7f1bb8efb640 1 --2- 172.21.15.79:0/822858592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bb41073a0 0x7f1bb41994b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.195+0000 7f1bb8efb640 1 --2- 172.21.15.79:0/822858592 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1b9c0b8060 0x7f1b9c0ba520 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.195+0000 7f1bb8efb640 1 --2- 172.21.15.79:0/822858592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bb4101990 0x7f1bb4198f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.195+0000 7f1bb8efb640 1 -- 172.21.15.79:0/822858592 >> 172.21.15.79:0/822858592 conn(0x7f1bb40fd400 msgr2=0x7f1bb406ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.196+0000 7f1bb8efb640 1 -- 172.21.15.79:0/822858592 shutdown_connections 2024-08-20T01:45:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:18.196+0000 7f1bb8efb640 1 -- 172.21.15.79:0/822858592 wait complete. 2024-08-20T01:45:18.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:17 smithi081 ceph-mon[22209]: pgmap v586: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 23 op/s 2024-08-20T01:45:18.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:17 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:45:18.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:17 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:45:18.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:17 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:45:18.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:17 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:45:18.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:17 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:45:18.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:17 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:45:18.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:17 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:45:18.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:17 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:45:18.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:17 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:45:18.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:17 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:45:18.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:17 smithi175 ceph-mon[22392]: pgmap v586: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 23 op/s 2024-08-20T01:45:18.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:17 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:45:18.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:17 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:45:18.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:17 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:45:18.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:17 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:45:18.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:17 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:45:18.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:17 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:45:18.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:17 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:45:18.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:17 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:45:18.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:17 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:45:18.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:17 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:45:18.628 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.626+0000 7f46d0b63640 1 -- 172.21.15.79:0/871401016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46cc1026b0 msgr2=0x7f46cc102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:18.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.626+0000 7f46d0b63640 1 --2- 172.21.15.79:0/871401016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46cc1026b0 0x7f46cc102b30 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f46c0009930 tx=0x7f46c002a420 comp rx=0 tx=0).stop 2024-08-20T01:45:18.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.626+0000 7f46d0b63640 1 -- 172.21.15.79:0/871401016 shutdown_connections 2024-08-20T01:45:18.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.626+0000 7f46d0b63640 1 --2- 172.21.15.79:0/871401016 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46cc103070 0x7f46cc1099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.626+0000 7f46d0b63640 1 --2- 172.21.15.79:0/871401016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46cc1026b0 0x7f46cc102b30 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.626+0000 7f46d0b63640 1 --2- 172.21.15.79:0/871401016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46cc101560 0x7f46cc101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.626+0000 7f46d0b63640 1 -- 172.21.15.79:0/871401016 >> 172.21.15.79:0/871401016 conn(0x7f46cc0fce20 msgr2=0x7f46cc0ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:18.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.626+0000 7f46d0b63640 1 -- 172.21.15.79:0/871401016 shutdown_connections 2024-08-20T01:45:18.629 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.626+0000 7f46d0b63640 1 -- 172.21.15.79:0/871401016 wait complete. 2024-08-20T01:45:18.631 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.627+0000 7f46d0b63640 1 Processor -- start 2024-08-20T01:45:18.632 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.627+0000 7f46d0b63640 1 -- start start 2024-08-20T01:45:18.632 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.627+0000 7f46d0b63640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46cc101560 0x7f46cc198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:18.632 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.627+0000 7f46d0b63640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46cc1026b0 0x7f46cc198f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:18.632 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.627+0000 7f46d0b63640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46cc103070 0x7f46cc199bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:18.632 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.627+0000 7f46d0b63640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f46cc10d060 con 0x7f46cc103070 2024-08-20T01:45:18.632 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.627+0000 7f46d0b63640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f46cc10cee0 con 0x7f46cc101560 2024-08-20T01:45:18.632 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.627+0000 7f46d0b63640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f46cc10d1e0 con 0x7f46cc1026b0 2024-08-20T01:45:18.632 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.627+0000 7f46cad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46cc103070 0x7f46cc199bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:18.632 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.627+0000 7f46cad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46cc103070 0x7f46cc199bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54804/0 (socket says 172.21.15.79:54804) 2024-08-20T01:45:18.632 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.627+0000 7f46cad9d640 1 -- 172.21.15.79:0/1359121184 learned_addr learned my addr 172.21.15.79:0/1359121184 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:18.632 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.627+0000 7f46c9d9b640 1 --2- 172.21.15.79:0/1359121184 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46cc1026b0 0x7f46cc198f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:18.633 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.627+0000 7f46ca59c640 1 --2- 172.21.15.79:0/1359121184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46cc101560 0x7f46cc198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:18.633 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.627+0000 7f46cad9d640 1 -- 172.21.15.79:0/1359121184 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46cc1026b0 msgr2=0x7f46cc198f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:18.633 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.627+0000 7f46cad9d640 1 --2- 172.21.15.79:0/1359121184 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46cc1026b0 0x7f46cc198f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.633 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.627+0000 7f46cad9d640 1 -- 172.21.15.79:0/1359121184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46cc101560 msgr2=0x7f46cc198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:18.633 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.627+0000 7f46cad9d640 1 --2- 172.21.15.79:0/1359121184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46cc101560 0x7f46cc198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.633 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.627+0000 7f46cad9d640 1 -- 172.21.15.79:0/1359121184 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46cc19a480 con 0x7f46cc103070 2024-08-20T01:45:18.633 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.627+0000 7f46ca59c640 1 --2- 172.21.15.79:0/1359121184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46cc101560 0x7f46cc198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:45:18.633 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.628+0000 7f46cad9d640 1 --2- 172.21.15.79:0/1359121184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46cc103070 0x7f46cc199bc0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f46c4009fd0 tx=0x7f46c400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:18.633 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.628+0000 7f46bb7fe640 1 -- 172.21.15.79:0/1359121184 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c4017070 con 0x7f46cc103070 2024-08-20T01:45:18.633 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.628+0000 7f46d0b63640 1 -- 172.21.15.79:0/1359121184 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46cc19a770 con 0x7f46cc103070 2024-08-20T01:45:18.633 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.628+0000 7f46bb7fe640 1 -- 172.21.15.79:0/1359121184 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f46c4003e00 con 0x7f46cc103070 2024-08-20T01:45:18.633 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.628+0000 7f46bb7fe640 1 -- 172.21.15.79:0/1359121184 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c4010460 con 0x7f46cc103070 2024-08-20T01:45:18.634 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.628+0000 7f46d0b63640 1 -- 172.21.15.79:0/1359121184 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46cc1a0e40 con 0x7f46cc103070 2024-08-20T01:45:18.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.630+0000 7f46bb7fe640 1 -- 172.21.15.79:0/1359121184 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f46c4003970 con 0x7f46cc103070 2024-08-20T01:45:18.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.631+0000 7f46d3a31740 1 Processor -- start 2024-08-20T01:45:18.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.631+0000 7f46d3a31740 1 -- start start 2024-08-20T01:45:18.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.631+0000 7f46d3a31740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09c68e630 0x55e09c690a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:18.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.631+0000 7f46d3a31740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e09c690f60 0x55e09c693350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:18.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.631+0000 7f46d3a31740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e09c6939a0 0x55e09c695e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:18.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.631+0000 7f46d3a31740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e09c601360 con 0x55e09c68e630 2024-08-20T01:45:18.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.631+0000 7f46d3a31740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e09c5f0860 con 0x55e09c690f60 2024-08-20T01:45:18.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.631+0000 7f46d3a31740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e09c5f48a0 con 0x55e09c6939a0 2024-08-20T01:45:18.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.631+0000 7f46c9d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09c68e630 0x55e09c690a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:18.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.631+0000 7f46c9d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09c68e630 0x55e09c690a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54812/0 (socket says 172.21.15.79:54812) 2024-08-20T01:45:18.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.631+0000 7f46c9d9b640 1 -- 172.21.15.79:0/3681574963 learned_addr learned my addr 172.21.15.79:0/3681574963 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:18.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.632+0000 7f46ca59c640 1 --2- 172.21.15.79:0/3681574963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e09c690f60 0x55e09c693350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:18.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.632+0000 7f46c9d9b640 1 --2- 172.21.15.79:0/3681574963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e09c6939a0 0x55e09c695e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:18.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.632+0000 7f46bb7fe640 1 --2- 172.21.15.79:0/1359121184 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f46b40b3bd0 0x7f46b40b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:18.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.632+0000 7f46c9d9b640 1 -- 172.21.15.79:0/3681574963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e09c6939a0 msgr2=0x55e09c695e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:18.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.632+0000 7f46c9d9b640 1 --2- 172.21.15.79:0/3681574963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e09c6939a0 0x55e09c695e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.632+0000 7f46c9d9b640 1 -- 172.21.15.79:0/3681574963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e09c690f60 msgr2=0x55e09c693350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:18.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.632+0000 7f46c9d9b640 1 --2- 172.21.15.79:0/3681574963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e09c690f60 0x55e09c693350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.632+0000 7f46c9d9b640 1 -- 172.21.15.79:0/3681574963 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e09c597e40 con 0x55e09c68e630 2024-08-20T01:45:18.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.632+0000 7f46cad9d640 1 --2- 172.21.15.79:0/1359121184 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f46b40b3bd0 0x7f46b40b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:18.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.632+0000 7f46bb7fe640 1 -- 172.21.15.79:0/1359121184 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f46c40e3d80 con 0x7f46cc103070 2024-08-20T01:45:18.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.632+0000 7f46c9d9b640 1 --2- 172.21.15.79:0/3681574963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09c68e630 0x55e09c690a20 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f46c0009230 tx=0x7f46c0005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f128e36ba250b7d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.632+0000 7f46b8ff9640 1 -- 172.21.15.79:0/3681574963 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c0035070 con 0x55e09c68e630 2024-08-20T01:45:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.632+0000 7f46b8ff9640 1 -- 172.21.15.79:0/3681574963 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f46c00044c0 con 0x55e09c68e630 2024-08-20T01:45:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.632+0000 7f46b8ff9640 1 -- 172.21.15.79:0/3681574963 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c0003de0 con 0x55e09c68e630 2024-08-20T01:45:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.633+0000 7f46d3a31740 1 -- 172.21.15.79:0/3681574963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09c68e630 msgr2=0x55e09c690a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.633+0000 7f46cad9d640 1 --2- 172.21.15.79:0/1359121184 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f46b40b3bd0 0x7f46b40b6090 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f46c40aac70 tx=0x7f46c406fc00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.633+0000 7f46d3a31740 1 --2- 172.21.15.79:0/3681574963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09c68e630 0x55e09c690a20 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f46c0009230 tx=0x7f46c0005fd0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.633+0000 7f46d3a31740 1 -- 172.21.15.79:0/3681574963 shutdown_connections 2024-08-20T01:45:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.633+0000 7f46d3a31740 1 --2- 172.21.15.79:0/3681574963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e09c6939a0 0x55e09c695e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.633+0000 7f46d3a31740 1 --2- 172.21.15.79:0/3681574963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e09c690f60 0x55e09c693350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.633+0000 7f46d3a31740 1 --2- 172.21.15.79:0/3681574963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09c68e630 0x55e09c690a20 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.633+0000 7f46d3a31740 1 -- 172.21.15.79:0/3681574963 >> 172.21.15.79:0/3681574963 conn(0x55e09c689730 msgr2=0x55e09c68a510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.633+0000 7f46d3a31740 1 -- 172.21.15.79:0/3681574963 shutdown_connections 2024-08-20T01:45:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.633+0000 7f46d3a31740 1 -- 172.21.15.79:0/3681574963 wait complete. 2024-08-20T01:45:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.634+0000 7f46d3a31740 1 -- start start 2024-08-20T01:45:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.634+0000 7f46d3a31740 1 Processor -- start 2024-08-20T01:45:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.634+0000 7f46d3a31740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09c68e630 0x55e09c697e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.634+0000 7f46d3a31740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e09c690f60 0x55e09c698500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.634+0000 7f46d3a31740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e09c6939a0 0x55e09c6990d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.634+0000 7f46d3a31740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e09c529ab0 con 0x55e09c68e630 2024-08-20T01:45:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.634+0000 7f46d3a31740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e09c577780 con 0x55e09c6939a0 2024-08-20T01:45:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.634+0000 7f46d3a31740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e09c696920 con 0x55e09c690f60 2024-08-20T01:45:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.634+0000 7f46d3a31740 10 client.0 _ll_register_callbacks cb 0x55e09c2ffa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:45:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.634+0000 7f46c9d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09c68e630 0x55e09c697e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.634+0000 7f46c9d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09c68e630 0x55e09c697e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54820/0 (socket says 172.21.15.79:54820) 2024-08-20T01:45:18.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.634+0000 7f46c9d9b640 1 -- 172.21.15.79:0/3894558839 learned_addr learned my addr 172.21.15.79:0/3894558839 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:18.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.634+0000 7f46ca59c640 1 --2- 172.21.15.79:0/3894558839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e09c690f60 0x55e09c698500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:18.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.634+0000 7f46c9d9b640 1 --2- 172.21.15.79:0/3894558839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e09c6939a0 0x55e09c6990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:18.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.634+0000 7f46c9d9b640 1 -- 172.21.15.79:0/3894558839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e09c690f60 msgr2=0x55e09c698500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:18.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.634+0000 7f46c9d9b640 1 --2- 172.21.15.79:0/3894558839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e09c690f60 0x55e09c698500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.634+0000 7f46c9d9b640 1 -- 172.21.15.79:0/3894558839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e09c6939a0 msgr2=0x55e09c6990d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:18.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.634+0000 7f46c9d9b640 1 --2- 172.21.15.79:0/3894558839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e09c6939a0 0x55e09c6990d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.634+0000 7f46c9d9b640 1 -- 172.21.15.79:0/3894558839 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e09c353790 con 0x55e09c68e630 2024-08-20T01:45:18.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.634+0000 7f46ca59c640 1 --2- 172.21.15.79:0/3894558839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e09c690f60 0x55e09c698500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:45:18.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.635+0000 7f46c9d9b640 1 --2- 172.21.15.79:0/3894558839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09c68e630 0x55e09c697e60 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f46c002a940 tx=0x7f46c0031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ec7f117162bcd0e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:18.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.635+0000 7f46b1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:45:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.635+0000 7f46b1ffb640 1 -- 172.21.15.79:0/3894558839 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c0035030 con 0x55e09c68e630 2024-08-20T01:45:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.635+0000 7f46d3a31740 1 -- 172.21.15.79:0/3894558839 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e09c59fe00 con 0x55e09c68e630 2024-08-20T01:45:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.635+0000 7f46b1ffb640 1 -- 172.21.15.79:0/3894558839 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f46c0003f70 con 0x55e09c68e630 2024-08-20T01:45:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.635+0000 7f46b1ffb640 1 -- 172.21.15.79:0/3894558839 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f46c0004170 con 0x55e09c68e630 2024-08-20T01:45:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.635+0000 7f46d3a31740 10 client.17850 fetch_fsmap learned FSMap version 42 2024-08-20T01:45:18.646 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.635+0000 7f46d3a31740 1 -- 172.21.15.79:0/3894558839 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55e09c3cc620 con 0x55e09c68e630 2024-08-20T01:45:18.646 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.635+0000 7f46b1ffb640 1 -- 172.21.15.79:0/3894558839 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55e09c59fe00 con 0x55e09c68e630 2024-08-20T01:45:18.646 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.635+0000 7f46b1ffb640 1 -- 172.21.15.79:0/3894558839 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 42) ==== 8390+0+0 (secure 0 0 0) 0x7f46c004b040 con 0x55e09c68e630 2024-08-20T01:45:18.646 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.635+0000 7f46d3a31740 10 client.17850 fetch_fsmap finished waiting for FSMap version 42 2024-08-20T01:45:18.646 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.635+0000 7f46d3a31740 10 client.17850 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:45:18.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.635+0000 7f46d3a31740 20 client.17850 populate_metadata read hostname 'smithi079' 2024-08-20T01:45:18.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.636+0000 7f46d3a31740 1 --2- 172.21.15.79:0/3894558839 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55e09c6a3300 0x55e09c6a56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:18.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.636+0000 7f46d3a31740 4 client.17850 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:45:18.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.636+0000 7f46d3a31740 1 -- 172.21.15.79:0/3894558839 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e09c6032b0 con 0x55e09c6a3300 2024-08-20T01:45:18.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.636+0000 7f46ca59c640 1 --2- 172.21.15.79:0/3894558839 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55e09c6a3300 0x55e09c6a56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:18.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.636+0000 7f46b1ffb640 10 client.17850 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:45:18.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.636+0000 7f46ca59c640 1 --2- 172.21.15.79:0/3894558839 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55e09c6a3300 0x55e09c6a56f0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=166b411add51fb74 server_cookie=6b303b5f2a547ca7 in_seq=0 out_seq=0 2024-08-20T01:45:18.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.637+0000 7f46b1ffb640 1 -- 172.21.15.79:0/3894558839 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e09c6032b0 con 0x55e09c6a3300 2024-08-20T01:45:18.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.637+0000 7f46b1ffb640 10 client.17850 handle_command_reply: tid=0 2024-08-20T01:45:18.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.637+0000 7f46d3a31740 1 client.17850 shutdown 2024-08-20T01:45:18.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.637+0000 7f46d3a31740 1 -- 172.21.15.79:0/3894558839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09c68e630 msgr2=0x55e09c697e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:18.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.637+0000 7f46d3a31740 1 --2- 172.21.15.79:0/3894558839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09c68e630 0x55e09c697e60 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f46c002a940 tx=0x7f46c0031400 comp rx=0 tx=0).stop 2024-08-20T01:45:18.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.637+0000 7f46d3a31740 1 -- 172.21.15.79:0/3894558839 shutdown_connections 2024-08-20T01:45:18.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.637+0000 7f46d3a31740 1 --2- 172.21.15.79:0/3894558839 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55e09c6a3300 0x55e09c6a56f0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.637+0000 7f46d3a31740 1 --2- 172.21.15.79:0/3894558839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e09c6939a0 0x55e09c6990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.637+0000 7f46b1ffb640 0 client.17850 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:45:18.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.637+0000 7f46d3a31740 1 --2- 172.21.15.79:0/3894558839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e09c690f60 0x55e09c698500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.637+0000 7f46d3a31740 1 --2- 172.21.15.79:0/3894558839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09c68e630 0x55e09c697e60 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.637+0000 7f46d3a31740 1 -- 172.21.15.79:0/3894558839 >> 172.21.15.79:0/3894558839 conn(0x55e09c689730 msgr2=0x55e09c688850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:18.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.637+0000 7f46d3a31740 1 -- 172.21.15.79:0/3894558839 shutdown_connections 2024-08-20T01:45:18.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.637+0000 7f46d3a31740 1 -- 172.21.15.79:0/3894558839 wait complete. 2024-08-20T01:45:18.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.637+0000 7f46d3a31740 20 client.17850 trim_cache size 0 max 16384 2024-08-20T01:45:18.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.654+0000 7f46d3a31740 1 Processor -- start 2024-08-20T01:45:18.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.654+0000 7f46d3a31740 1 -- start start 2024-08-20T01:45:18.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.654+0000 7f46d3a31740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09c68e630 0x55e09c6953f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:18.657 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.654+0000 7f46d3a31740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e09c690f60 0x55e09c695930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:18.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.654+0000 7f46d3a31740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e09c6939a0 0x55e09c688030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:18.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.654+0000 7f46d3a31740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f46cc1a9980 con 0x55e09c68e630 2024-08-20T01:45:18.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.654+0000 7f46d3a31740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f46cc1ab610 con 0x55e09c6939a0 2024-08-20T01:45:18.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.654+0000 7f46d3a31740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f46cc1aa050 con 0x55e09c690f60 2024-08-20T01:45:18.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.654+0000 7f46c9d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09c68e630 0x55e09c6953f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:18.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.654+0000 7f46c9d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09c68e630 0x55e09c6953f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54836/0 (socket says 172.21.15.79:54836) 2024-08-20T01:45:18.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.654+0000 7f46c9d9b640 1 -- 172.21.15.79:0/3804557251 learned_addr learned my addr 172.21.15.79:0/3804557251 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:18.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.654+0000 7f46ca59c640 1 --2- 172.21.15.79:0/3804557251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e09c690f60 0x55e09c695930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:18.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.654+0000 7f46c9d9b640 1 -- 172.21.15.79:0/3804557251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e09c690f60 msgr2=0x55e09c695930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:18.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.654+0000 7f46c9d9b640 1 --2- 172.21.15.79:0/3804557251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e09c690f60 0x55e09c695930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.658 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.654+0000 7f46c9d9b640 1 -- 172.21.15.79:0/3804557251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e09c6939a0 msgr2=0x55e09c688030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:18.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.654+0000 7f46c9d9b640 1 --2- 172.21.15.79:0/3804557251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e09c6939a0 0x55e09c688030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.654+0000 7f46c9d9b640 1 -- 172.21.15.79:0/3804557251 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e09c697960 con 0x55e09c68e630 2024-08-20T01:45:18.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.654+0000 7f46ca59c640 1 --2- 172.21.15.79:0/3804557251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e09c690f60 0x55e09c695930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:45:18.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.654+0000 7f46c9d9b640 1 --2- 172.21.15.79:0/3804557251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09c68e630 0x55e09c6953f0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f46c0005d00 tx=0x7f46c003b530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83599a4851dbc316 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:18.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.655+0000 7f46b3fff640 1 -- 172.21.15.79:0/3804557251 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c005f030 con 0x55e09c68e630 2024-08-20T01:45:18.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.655+0000 7f46b3fff640 1 -- 172.21.15.79:0/3804557251 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f46c003b6b0 con 0x55e09c68e630 2024-08-20T01:45:18.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.655+0000 7f46b3fff640 1 -- 172.21.15.79:0/3804557251 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c0035070 con 0x55e09c68e630 2024-08-20T01:45:18.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.655+0000 7f46d3a31740 1 -- 172.21.15.79:0/3804557251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09c68e630 msgr2=0x55e09c6953f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:18.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.655+0000 7f46d3a31740 1 --2- 172.21.15.79:0/3804557251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09c68e630 0x55e09c6953f0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f46c0005d00 tx=0x7f46c003b530 comp rx=0 tx=0).stop 2024-08-20T01:45:18.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.656+0000 7f46d3a31740 1 -- 172.21.15.79:0/3804557251 shutdown_connections 2024-08-20T01:45:18.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.656+0000 7f46d3a31740 1 --2- 172.21.15.79:0/3804557251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e09c6939a0 0x55e09c688030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.656+0000 7f46d3a31740 1 --2- 172.21.15.79:0/3804557251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e09c690f60 0x55e09c695930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.656+0000 7f46d3a31740 1 --2- 172.21.15.79:0/3804557251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09c68e630 0x55e09c6953f0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.656+0000 7f46d3a31740 1 -- 172.21.15.79:0/3804557251 >> 172.21.15.79:0/3804557251 conn(0x55e09c689730 msgr2=0x55e09c68dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.656+0000 7f46d3a31740 1 -- 172.21.15.79:0/3804557251 shutdown_connections 2024-08-20T01:45:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.656+0000 7f46d3a31740 1 -- 172.21.15.79:0/3804557251 wait complete. 2024-08-20T01:45:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.656+0000 7f46d3a31740 1 -- start start 2024-08-20T01:45:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.656+0000 7f46d3a31740 1 Processor -- start 2024-08-20T01:45:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.656+0000 7f46d3a31740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09c68e630 0x55e09c69ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.656+0000 7f46d3a31740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e09c690f60 0x55e09c69d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.656+0000 7f46d3a31740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e09c6939a0 0x55e09c69dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.656+0000 7f46d3a31740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f46cc1aae80 con 0x55e09c68e630 2024-08-20T01:45:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.656+0000 7f46d3a31740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f46cc1aa720 con 0x55e09c690f60 2024-08-20T01:45:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.656+0000 7f46d3a31740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f46cc1a7960 con 0x55e09c6939a0 2024-08-20T01:45:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.656+0000 7f46d3a31740 10 client.0 _ll_register_callbacks cb 0x7f46c003e070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:45:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.656+0000 7f46c9d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09c68e630 0x55e09c69ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.656+0000 7f46c9d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09c68e630 0x55e09c69ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54846/0 (socket says 172.21.15.79:54846) 2024-08-20T01:45:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.656+0000 7f46c9d9b640 1 -- 172.21.15.79:0/3068504198 learned_addr learned my addr 172.21.15.79:0/3068504198 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.657+0000 7f46ca59c640 1 --2- 172.21.15.79:0/3068504198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e09c690f60 0x55e09c69d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.657+0000 7f46c9d9b640 1 --2- 172.21.15.79:0/3068504198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e09c6939a0 0x55e09c69dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.657+0000 7f46c9d9b640 1 -- 172.21.15.79:0/3068504198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e09c6939a0 msgr2=0x55e09c69dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.657+0000 7f46c9d9b640 1 --2- 172.21.15.79:0/3068504198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e09c6939a0 0x55e09c69dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.657+0000 7f46c9d9b640 1 -- 172.21.15.79:0/3068504198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e09c690f60 msgr2=0x55e09c69d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.657+0000 7f46c9d9b640 1 --2- 172.21.15.79:0/3068504198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e09c690f60 0x55e09c69d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.657+0000 7f46c9d9b640 1 -- 172.21.15.79:0/3068504198 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e09c689560 con 0x55e09c68e630 2024-08-20T01:45:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.657+0000 7f46c9d9b640 1 --2- 172.21.15.79:0/3068504198 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09c68e630 0x55e09c69ca90 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f46c0052040 tx=0x7f46c003b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75087aa02b35128a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.657+0000 7f46b1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:45:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.657+0000 7f46b1ffb640 1 -- 172.21.15.79:0/3068504198 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c0035030 con 0x55e09c68e630 2024-08-20T01:45:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.657+0000 7f46b1ffb640 1 -- 172.21.15.79:0/3068504198 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f46c0003d70 con 0x55e09c68e630 2024-08-20T01:45:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.657+0000 7f46d3a31740 1 -- 172.21.15.79:0/3068504198 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46c003b6b0 con 0x55e09c68e630 2024-08-20T01:45:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.657+0000 7f46b1ffb640 1 -- 172.21.15.79:0/3068504198 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f46c005f040 con 0x55e09c68e630 2024-08-20T01:45:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.657+0000 7f46d3a31740 10 client.17856 fetch_fsmap learned FSMap version 42 2024-08-20T01:45:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.657+0000 7f46d3a31740 1 -- 172.21.15.79:0/3068504198 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55e09c69f690 con 0x55e09c68e630 2024-08-20T01:45:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.657+0000 7f46b1ffb640 1 -- 172.21.15.79:0/3068504198 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f46c003b6b0 con 0x55e09c68e630 2024-08-20T01:45:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.658+0000 7f46b1ffb640 1 -- 172.21.15.79:0/3068504198 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 42) ==== 8390+0+0 (secure 0 0 0) 0x7f46c006e020 con 0x55e09c68e630 2024-08-20T01:45:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.658+0000 7f46d3a31740 10 client.17856 fetch_fsmap finished waiting for FSMap version 42 2024-08-20T01:45:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.658+0000 7f46d3a31740 10 client.17856 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:45:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.658+0000 7f46d3a31740 20 client.17856 populate_metadata read hostname 'smithi079' 2024-08-20T01:45:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.658+0000 7f46d3a31740 1 --2- 172.21.15.79:0/3068504198 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55e09c6a3300 0x55e09c70feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.658+0000 7f46d3a31740 4 client.17856 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:45:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.658+0000 7f46d3a31740 1 -- 172.21.15.79:0/3068504198 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e09c5fed50 con 0x55e09c6a3300 2024-08-20T01:45:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.658+0000 7f46ca59c640 1 --2- 172.21.15.79:0/3068504198 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55e09c6a3300 0x55e09c70feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:18.666 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.658+0000 7f46ca59c640 1 --2- 172.21.15.79:0/3068504198 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55e09c6a3300 0x55e09c70feb0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c41c6bd93b874a0 server_cookie=977853dddbb53f16 in_seq=0 out_seq=0 2024-08-20T01:45:18.666 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.658+0000 7f46b1ffb640 10 client.17856 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:45:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.664+0000 7f46b1ffb640 1 -- 172.21.15.79:0/3068504198 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e09c5fed50 con 0x55e09c6a3300 2024-08-20T01:45:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.664+0000 7f46b1ffb640 10 client.17856 handle_command_reply: tid=0 2024-08-20T01:45:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.664+0000 7f46d3a31740 1 client.17856 shutdown 2024-08-20T01:45:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.665+0000 7f46d3a31740 1 -- 172.21.15.79:0/3068504198 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09c68e630 msgr2=0x55e09c69ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.665+0000 7f46d3a31740 1 --2- 172.21.15.79:0/3068504198 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09c68e630 0x55e09c69ca90 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f46c0052040 tx=0x7f46c003b9d0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.665+0000 7f46d3a31740 1 -- 172.21.15.79:0/3068504198 shutdown_connections 2024-08-20T01:45:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.665+0000 7f46d3a31740 1 --2- 172.21.15.79:0/3068504198 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55e09c6a3300 0x55e09c70feb0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.665+0000 7f46d3a31740 1 --2- 172.21.15.79:0/3068504198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e09c6939a0 0x55e09c69dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.665+0000 7f46b1ffb640 0 client.17856 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:45:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.665+0000 7f46d3a31740 1 --2- 172.21.15.79:0/3068504198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e09c690f60 0x55e09c69d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.665+0000 7f46d3a31740 1 --2- 172.21.15.79:0/3068504198 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e09c68e630 0x55e09c69ca90 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.665+0000 7f46d3a31740 1 -- 172.21.15.79:0/3068504198 >> 172.21.15.79:0/3068504198 conn(0x55e09c689730 msgr2=0x55e09c6953f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.665+0000 7f46d3a31740 1 -- 172.21.15.79:0/3068504198 shutdown_connections 2024-08-20T01:45:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.665+0000 7f46d3a31740 1 -- 172.21.15.79:0/3068504198 wait complete. 2024-08-20T01:45:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.665+0000 7f46d3a31740 20 client.17856 trim_cache size 0 max 16384 2024-08-20T01:45:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:45:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:45:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:45:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:45:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.666+0000 7f46d0b63640 1 -- 172.21.15.79:0/1359121184 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f46b40b3bd0 msgr2=0x7f46b40b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:18.671 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.666+0000 7f46d0b63640 1 --2- 172.21.15.79:0/1359121184 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f46b40b3bd0 0x7f46b40b6090 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f46c40aac70 tx=0x7f46c406fc00 comp rx=0 tx=0).stop 2024-08-20T01:45:18.671 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.666+0000 7f46d0b63640 1 -- 172.21.15.79:0/1359121184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46cc103070 msgr2=0x7f46cc199bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:18.671 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.666+0000 7f46d0b63640 1 --2- 172.21.15.79:0/1359121184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46cc103070 0x7f46cc199bc0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f46c4009fd0 tx=0x7f46c400b260 comp rx=0 tx=0).stop 2024-08-20T01:45:18.671 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.666+0000 7f46d0b63640 1 -- 172.21.15.79:0/1359121184 shutdown_connections 2024-08-20T01:45:18.671 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.666+0000 7f46d0b63640 1 --2- 172.21.15.79:0/1359121184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46cc103070 0x7f46cc199bc0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.671 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.666+0000 7f46d0b63640 1 --2- 172.21.15.79:0/1359121184 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f46b40b3bd0 0x7f46b40b6090 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.671 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.666+0000 7f46d0b63640 1 --2- 172.21.15.79:0/1359121184 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46cc1026b0 0x7f46cc198f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.671 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.666+0000 7f46d0b63640 1 --2- 172.21.15.79:0/1359121184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46cc101560 0x7f46cc198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:18.671 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.666+0000 7f46d0b63640 1 -- 172.21.15.79:0/1359121184 >> 172.21.15.79:0/1359121184 conn(0x7f46cc0fce20 msgr2=0x7f46cc0fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:18.671 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.666+0000 7f46d0b63640 1 -- 172.21.15.79:0/1359121184 shutdown_connections 2024-08-20T01:45:18.671 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:18.666+0000 7f46d0b63640 1 -- 172.21.15.79:0/1359121184 wait complete. 2024-08-20T01:45:18.989 INFO:tasks.cephfs.filesystem:scrub status for tag:b0cfb414-2c96-44b2-ac3b-b4ff97b1e7a7 - {'path': '/', 'tag': 'b0cfb414-2c96-44b2-ac3b-b4ff97b1e7a7', 'options': 'recursive,force'} 2024-08-20T01:45:20.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:19 smithi079 ceph-mon[18656]: pgmap v587: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 32 MiB/s wr, 38 op/s 2024-08-20T01:45:20.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:19 smithi081 ceph-mon[22209]: pgmap v587: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 32 MiB/s wr, 38 op/s 2024-08-20T01:45:20.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:19 smithi175 ceph-mon[22392]: pgmap v587: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 32 MiB/s wr, 38 op/s 2024-08-20T01:45:22.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:21 smithi079 ceph-mon[18656]: pgmap v588: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 28 MiB/s wr, 45 op/s 2024-08-20T01:45:22.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:21 smithi081 ceph-mon[22209]: pgmap v588: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 28 MiB/s wr, 45 op/s 2024-08-20T01:45:22.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:21 smithi175 ceph-mon[22392]: pgmap v588: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 28 MiB/s wr, 45 op/s 2024-08-20T01:45:23.912 INFO:tasks.workunit.client.0.smithi079.stdout:fs setup took 438 secs 2024-08-20T01:45:24.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:23 smithi081 ceph-mon[22209]: pgmap v589: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 27 MiB/s wr, 47 op/s 2024-08-20T01:45:24.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:23 smithi175 ceph-mon[22392]: pgmap v589: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 27 MiB/s wr, 47 op/s 2024-08-20T01:45:24.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:23 smithi079 ceph-mon[18656]: pgmap v589: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 27 MiB/s wr, 47 op/s 2024-08-20T01:45:24.715 INFO:tasks.workunit.client.0.smithi079.stdout:Syncing()...0 sec 2024-08-20T01:45:24.716 INFO:tasks.workunit.client.0.smithi079.stdout:Starting Actual Benchmark At: Tue Aug 20 01:45:24 2024 2024-08-20T01:45:24.716 INFO:tasks.workunit.client.0.smithi079.stdout: 2024-08-20T01:45:26.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:25 smithi081 ceph-mon[22209]: pgmap v590: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 31 MiB/s wr, 50 op/s 2024-08-20T01:45:26.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:25 smithi175 ceph-mon[22392]: pgmap v590: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 31 MiB/s wr, 50 op/s 2024-08-20T01:45:26.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:25 smithi079 ceph-mon[18656]: pgmap v590: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 31 MiB/s wr, 50 op/s 2024-08-20T01:45:28.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:27 smithi081 ceph-mon[22209]: pgmap v591: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 27 MiB/s wr, 156 op/s 2024-08-20T01:45:28.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:27 smithi175 ceph-mon[22392]: pgmap v591: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 27 MiB/s wr, 156 op/s 2024-08-20T01:45:28.436 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:27 smithi079 ceph-mon[18656]: pgmap v591: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 27 MiB/s wr, 156 op/s 2024-08-20T01:45:30.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:29 smithi079 ceph-mon[18656]: pgmap v592: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 28 MiB/s wr, 1.00k op/s 2024-08-20T01:45:30.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:29 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:45:30.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:29 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:45:30.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:29 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:45:30.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:29 smithi081 ceph-mon[22209]: pgmap v592: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 28 MiB/s wr, 1.00k op/s 2024-08-20T01:45:30.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:29 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:45:30.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:29 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:45:30.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:29 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:45:30.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:29 smithi175 ceph-mon[22392]: pgmap v592: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 28 MiB/s wr, 1.00k op/s 2024-08-20T01:45:30.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:29 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:45:30.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:29 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:45:30.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:29 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:45:31.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:30 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:45:31.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:30 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:45:31.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:30 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:45:31.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:30 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:45:31.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:30 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:45:31.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:30 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:45:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.806+0000 7f3cfe48b640 1 -- 172.21.15.79:0/2367223362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cf8101e30 msgr2=0x7f3cf81022b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.806+0000 7f3cfe48b640 1 --2- 172.21.15.79:0/2367223362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cf8101e30 0x7f3cf81022b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3cec009900 tx=0x7f3cec02a3f0 comp rx=0 tx=0).stop 2024-08-20T01:45:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.806+0000 7f3cfe48b640 1 -- 172.21.15.79:0/2367223362 shutdown_connections 2024-08-20T01:45:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.806+0000 7f3cfe48b640 1 --2- 172.21.15.79:0/2367223362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cf81027f0 0x7f3cf8109170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.806+0000 7f3cfe48b640 1 --2- 172.21.15.79:0/2367223362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cf8101e30 0x7f3cf81022b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.806+0000 7f3cfe48b640 1 --2- 172.21.15.79:0/2367223362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cf8100ce0 0x7f3cf81010e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.806+0000 7f3cfe48b640 1 -- 172.21.15.79:0/2367223362 >> 172.21.15.79:0/2367223362 conn(0x7f3cf80fc580 msgr2=0x7f3cf80fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.806+0000 7f3cfe48b640 1 -- 172.21.15.79:0/2367223362 shutdown_connections 2024-08-20T01:45:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.806+0000 7f3cfe48b640 1 -- 172.21.15.79:0/2367223362 wait complete. 2024-08-20T01:45:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.807+0000 7f3cfe48b640 1 Processor -- start 2024-08-20T01:45:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.807+0000 7f3cfe48b640 1 -- start start 2024-08-20T01:45:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.808+0000 7f3cfe48b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cf8100ce0 0x7f3cf819ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.808+0000 7f3cfe48b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cf8101e30 0x7f3cf819b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.808+0000 7f3cfe48b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cf81027f0 0x7f3cf819be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.808+0000 7f3cfe48b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf810bbc0 con 0x7f3cf81027f0 2024-08-20T01:45:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.808+0000 7f3cfe48b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf810ba40 con 0x7f3cf8101e30 2024-08-20T01:45:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.808+0000 7f3cfe48b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf810bd40 con 0x7f3cf8100ce0 2024-08-20T01:45:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.808+0000 7f3cf7fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cf8100ce0 0x7f3cf819ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.808+0000 7f3cf77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cf8101e30 0x7f3cf819b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.808+0000 7f3cf7fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cf8100ce0 0x7f3cf819ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:38526/0 (socket says 172.21.15.79:38526) 2024-08-20T01:45:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.808+0000 7f3cf7fff640 1 -- 172.21.15.79:0/1673358897 learned_addr learned my addr 172.21.15.79:0/1673358897 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.809+0000 7f3cf77fe640 1 -- 172.21.15.79:0/1673358897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cf8100ce0 msgr2=0x7f3cf819ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.809+0000 7f3cf77fe640 1 --2- 172.21.15.79:0/1673358897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cf8100ce0 0x7f3cf819ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.809+0000 7f3cf77fe640 1 -- 172.21.15.79:0/1673358897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cf81027f0 msgr2=0x7f3cf819be10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-20T01:45:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.809+0000 7f3cfca28640 1 --2- 172.21.15.79:0/1673358897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cf81027f0 0x7f3cf819be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.809+0000 7f3cf77fe640 1 --2- 172.21.15.79:0/1673358897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cf81027f0 0x7f3cf819be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.809+0000 7f3cf77fe640 1 -- 172.21.15.79:0/1673358897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cf819c6d0 con 0x7f3cf8101e30 2024-08-20T01:45:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.809+0000 7f3cfca28640 1 --2- 172.21.15.79:0/1673358897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cf81027f0 0x7f3cf819be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:45:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.810+0000 7f3cf77fe640 1 --2- 172.21.15.79:0/1673358897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cf8101e30 0x7f3cf819b1e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3cec009850 tx=0x7f3cec003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.810+0000 7f3cf57fa640 1 -- 172.21.15.79:0/1673358897 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cec03f070 con 0x7f3cf8101e30 2024-08-20T01:45:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.810+0000 7f3cf57fa640 1 -- 172.21.15.79:0/1673358897 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3cec031b90 con 0x7f3cf8101e30 2024-08-20T01:45:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.810+0000 7f3cfe48b640 1 -- 172.21.15.79:0/1673358897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cf819c960 con 0x7f3cf8101e30 2024-08-20T01:45:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.810+0000 7f3cf57fa640 1 -- 172.21.15.79:0/1673358897 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cec03f070 con 0x7f3cf8101e30 2024-08-20T01:45:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.810+0000 7f3cfe48b640 1 -- 172.21.15.79:0/1673358897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cf806c8a0 con 0x7f3cf8101e30 2024-08-20T01:45:31.818 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.814+0000 7f3d01286740 1 Processor -- start 2024-08-20T01:45:31.818 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.814+0000 7f3d01286740 1 -- start start 2024-08-20T01:45:31.818 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.814+0000 7f3cf57fa640 1 -- 172.21.15.79:0/1673358897 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3cec042070 con 0x7f3cf8101e30 2024-08-20T01:45:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.814+0000 7f3d01286740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564374cd60e0 0x564374cd84d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.814+0000 7f3d01286740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564374cd8a10 0x564374cdae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.814+0000 7f3d01286740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564374cdb450 0x564374cdd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.814+0000 7f3d01286740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564374c40360 con 0x564374cdb450 2024-08-20T01:45:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.814+0000 7f3d01286740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564374c2f860 con 0x564374cd8a10 2024-08-20T01:45:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.814+0000 7f3d01286740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564374c338a0 con 0x564374cd60e0 2024-08-20T01:45:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.815+0000 7f3cfca28640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564374cd60e0 0x564374cd84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.815+0000 7f3cfca28640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564374cd60e0 0x564374cd84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:38542/0 (socket says 172.21.15.79:38542) 2024-08-20T01:45:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.815+0000 7f3cfca28640 1 -- 172.21.15.79:0/3169995232 learned_addr learned my addr 172.21.15.79:0/3169995232 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.815+0000 7f3cf77fe640 1 --2- 172.21.15.79:0/3169995232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564374cdb450 0x564374cdd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.815+0000 7f3cf7fff640 1 --2- 172.21.15.79:0/3169995232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564374cd8a10 0x564374cdae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.816+0000 7f3cfca28640 1 -- 172.21.15.79:0/3169995232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564374cd8a10 msgr2=0x564374cdae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:31.820 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.816+0000 7f3cfca28640 1 --2- 172.21.15.79:0/3169995232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564374cd8a10 0x564374cdae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:31.820 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.816+0000 7f3cfca28640 1 -- 172.21.15.79:0/3169995232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564374cdb450 msgr2=0x564374cdd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:31.820 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.816+0000 7f3cfca28640 1 --2- 172.21.15.79:0/3169995232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564374cdb450 0x564374cdd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:31.820 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.816+0000 7f3cfca28640 1 -- 172.21.15.79:0/3169995232 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564374bd6e40 con 0x564374cd60e0 2024-08-20T01:45:31.821 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.816+0000 7f3cf57fa640 1 --2- 172.21.15.79:0/1673358897 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3ce00b3ea0 0x7f3ce00b6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:31.821 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.817+0000 7f3cfca28640 1 --2- 172.21.15.79:0/3169995232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564374cd60e0 0x564374cd84d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3ce800ba90 tx=0x7f3ce800bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0cd3fcca2fddfc0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:31.821 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.817+0000 7f3cf7fff640 1 --2- 172.21.15.79:0/1673358897 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3ce00b3ea0 0x7f3ce00b6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:31.821 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.817+0000 7f3cf57fa640 1 -- 172.21.15.79:0/1673358897 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f3cec104150 con 0x7f3cf8101e30 2024-08-20T01:45:31.821 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.817+0000 7f3cde7fc640 1 -- 172.21.15.79:0/3169995232 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce8017420 con 0x564374cd60e0 2024-08-20T01:45:31.821 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.817+0000 7f3cde7fc640 1 -- 172.21.15.79:0/3169995232 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3ce8017a50 con 0x564374cd60e0 2024-08-20T01:45:31.821 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.819+0000 7f3d01286740 1 -- 172.21.15.79:0/3169995232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564374cd60e0 msgr2=0x564374cd84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:31.822 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.819+0000 7f3d01286740 1 --2- 172.21.15.79:0/3169995232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564374cd60e0 0x564374cd84d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3ce800ba90 tx=0x7f3ce800bf50 comp rx=0 tx=0).stop 2024-08-20T01:45:31.822 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.819+0000 7f3cde7fc640 1 -- 172.21.15.79:0/3169995232 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce800f990 con 0x564374cd60e0 2024-08-20T01:45:31.822 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.819+0000 7f3cf7fff640 1 --2- 172.21.15.79:0/1673358897 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3ce00b3ea0 0x7f3ce00b6360 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3cf00216e0 tx=0x7f3cf0023040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:31.822 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.819+0000 7f3d01286740 1 -- 172.21.15.79:0/3169995232 shutdown_connections 2024-08-20T01:45:31.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.819+0000 7f3d01286740 1 --2- 172.21.15.79:0/3169995232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564374cdb450 0x564374cdd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:31.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.819+0000 7f3d01286740 1 --2- 172.21.15.79:0/3169995232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564374cd8a10 0x564374cdae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:31.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.819+0000 7f3d01286740 1 --2- 172.21.15.79:0/3169995232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564374cd60e0 0x564374cd84d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:31.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.819+0000 7f3d01286740 1 -- 172.21.15.79:0/3169995232 >> 172.21.15.79:0/3169995232 conn(0x564374cc8a20 msgr2=0x564374cc97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:31.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.819+0000 7f3d01286740 1 -- 172.21.15.79:0/3169995232 shutdown_connections 2024-08-20T01:45:31.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.819+0000 7f3d01286740 1 -- 172.21.15.79:0/3169995232 wait complete. 2024-08-20T01:45:31.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.820+0000 7f3d01286740 1 -- start start 2024-08-20T01:45:31.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.820+0000 7f3d01286740 1 Processor -- start 2024-08-20T01:45:31.825 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.821+0000 7f3d01286740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564374cd60e0 0x564374cdf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:31.825 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.821+0000 7f3d01286740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564374cd8a10 0x564374ce0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:31.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.821+0000 7f3d01286740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564374cdb450 0x564374ce0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:31.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.821+0000 7f3d01286740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564374b68ab0 con 0x564374cd8a10 2024-08-20T01:45:31.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.821+0000 7f3d01286740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564374bb6780 con 0x564374cd60e0 2024-08-20T01:45:31.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.821+0000 7f3d01286740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564374cde4d0 con 0x564374cdb450 2024-08-20T01:45:31.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.821+0000 7f3d01286740 10 client.0 _ll_register_callbacks cb 0x56437493ea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:45:31.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.821+0000 7f3cf7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564374cd60e0 0x564374cdf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:31.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.821+0000 7f3cf77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564374cd8a10 0x564374ce0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:31.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.821+0000 7f3cf7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564374cd60e0 0x564374cdf9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:33786/0 (socket says 172.21.15.79:33786) 2024-08-20T01:45:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.821+0000 7f3cf7fff640 1 -- 172.21.15.79:0/2835581564 learned_addr learned my addr 172.21.15.79:0/2835581564 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.821+0000 7f3cfca28640 1 --2- 172.21.15.79:0/2835581564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564374cdb450 0x564374ce0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.821+0000 7f3cf77fe640 1 -- 172.21.15.79:0/2835581564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564374cdb450 msgr2=0x564374ce0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.821+0000 7f3cf77fe640 1 --2- 172.21.15.79:0/2835581564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564374cdb450 0x564374ce0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.821+0000 7f3cf77fe640 1 -- 172.21.15.79:0/2835581564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564374cd60e0 msgr2=0x564374cdf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.821+0000 7f3cf77fe640 1 --2- 172.21.15.79:0/2835581564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564374cd60e0 0x564374cdf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.821+0000 7f3cf77fe640 1 -- 172.21.15.79:0/2835581564 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564374992790 con 0x564374cd8a10 2024-08-20T01:45:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.822+0000 7f3cf77fe640 1 --2- 172.21.15.79:0/2835581564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564374cd8a10 0x564374ce0040 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f3cec000c00 tx=0x7f3cec0c6e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f076e9d2dc0a58c9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.822+0000 7f3cd77fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:45:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.822+0000 7f3cd77fe640 1 -- 172.21.15.79:0/2835581564 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cec049070 con 0x564374cd8a10 2024-08-20T01:45:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.822+0000 7f3d01286740 1 -- 172.21.15.79:0/2835581564 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564374bdee00 con 0x564374cd8a10 2024-08-20T01:45:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.822+0000 7f3cd77fe640 1 -- 172.21.15.79:0/2835581564 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f3cec0c7250 con 0x564374cd8a10 2024-08-20T01:45:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.822+0000 7f3cd77fe640 1 -- 172.21.15.79:0/2835581564 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f3cec0ca9a0 con 0x564374cd8a10 2024-08-20T01:45:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.823+0000 7f3d01286740 10 client.17865 fetch_fsmap learned FSMap version 42 2024-08-20T01:45:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.823+0000 7f3d01286740 1 -- 172.21.15.79:0/2835581564 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x564374a0b620 con 0x564374cd8a10 2024-08-20T01:45:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.823+0000 7f3cd77fe640 1 -- 172.21.15.79:0/2835581564 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x564374bdee00 con 0x564374cd8a10 2024-08-20T01:45:31.830 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.824+0000 7f3cd77fe640 1 -- 172.21.15.79:0/2835581564 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 42) ==== 8390+0+0 (secure 0 0 0) 0x7f3cec107c80 con 0x564374cd8a10 2024-08-20T01:45:31.830 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.824+0000 7f3d01286740 10 client.17865 fetch_fsmap finished waiting for FSMap version 42 2024-08-20T01:45:31.830 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.824+0000 7f3d01286740 10 client.17865 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:45:31.830 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.824+0000 7f3d01286740 20 client.17865 populate_metadata read hostname 'smithi079' 2024-08-20T01:45:31.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.824+0000 7f3d01286740 1 --2- 172.21.15.79:0/2835581564 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564374ceb560 0x564374ced9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:31.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.824+0000 7f3d01286740 4 client.17865 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:45:31.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.824+0000 7f3d01286740 1 -- 172.21.15.79:0/2835581564 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564374c422b0 con 0x564374ceb560 2024-08-20T01:45:31.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.824+0000 7f3cf7fff640 1 --2- 172.21.15.79:0/2835581564 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564374ceb560 0x564374ced9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:31.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.825+0000 7f3cf7fff640 1 --2- 172.21.15.79:0/2835581564 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564374ceb560 0x564374ced9a0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eee166ba64bce8a server_cookie=b600b59c79265c9e in_seq=0 out_seq=0 2024-08-20T01:45:31.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.825+0000 7f3cd77fe640 10 client.17865 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:45:31.831 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.826+0000 7f3cd77fe640 1 -- 172.21.15.79:0/2835581564 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564374c422b0 con 0x564374ceb560 2024-08-20T01:45:31.832 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.826+0000 7f3cd77fe640 10 client.17865 handle_command_reply: tid=0 2024-08-20T01:45:31.832 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.826+0000 7f3d01286740 1 client.17865 shutdown 2024-08-20T01:45:31.832 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.826+0000 7f3d01286740 1 -- 172.21.15.79:0/2835581564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564374cd8a10 msgr2=0x564374ce0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:31.832 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.826+0000 7f3d01286740 1 --2- 172.21.15.79:0/2835581564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564374cd8a10 0x564374ce0040 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f3cec000c00 tx=0x7f3cec0c6e80 comp rx=0 tx=0).stop 2024-08-20T01:45:31.832 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.827+0000 7f3d01286740 1 -- 172.21.15.79:0/2835581564 shutdown_connections 2024-08-20T01:45:31.832 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.827+0000 7f3d01286740 1 --2- 172.21.15.79:0/2835581564 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564374ceb560 0x564374ced9a0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.827+0000 7f3d01286740 1 --2- 172.21.15.79:0/2835581564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564374cdb450 0x564374ce0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.827+0000 7f3d01286740 1 --2- 172.21.15.79:0/2835581564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564374cd8a10 0x564374ce0040 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.827+0000 7f3d01286740 1 --2- 172.21.15.79:0/2835581564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564374cd60e0 0x564374cdf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.827+0000 7f3d01286740 1 -- 172.21.15.79:0/2835581564 >> 172.21.15.79:0/2835581564 conn(0x564374cc8a20 msgr2=0x564374cc7ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.827+0000 7f3cd77fe640 0 client.17865 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:45:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.828+0000 7f3d01286740 1 -- 172.21.15.79:0/2835581564 shutdown_connections 2024-08-20T01:45:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.828+0000 7f3d01286740 1 -- 172.21.15.79:0/2835581564 wait complete. 2024-08-20T01:45:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.828+0000 7f3d01286740 20 client.17865 trim_cache size 0 max 16384 2024-08-20T01:45:31.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.859+0000 7f3d01286740 1 Processor -- start 2024-08-20T01:45:31.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.859+0000 7f3d01286740 1 -- start start 2024-08-20T01:45:31.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.860+0000 7f3d01286740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564374cd60e0 0x564374ced570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:31.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.860+0000 7f3d01286740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564374cd8a10 0x564374cc92a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:31.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.860+0000 7f3d01286740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564374cdb450 0x564374cc97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:31.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.860+0000 7f3d01286740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf8071290 con 0x564374cdb450 2024-08-20T01:45:31.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.860+0000 7f3d01286740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf8072f20 con 0x564374cd8a10 2024-08-20T01:45:31.869 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.860+0000 7f3d01286740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf8071960 con 0x564374cd60e0 2024-08-20T01:45:31.869 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.860+0000 7f3cf7fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564374cd60e0 0x564374ced570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:31.869 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.860+0000 7f3cf7fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564374cd60e0 0x564374ced570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:38562/0 (socket says 172.21.15.79:38562) 2024-08-20T01:45:31.869 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.860+0000 7f3cf7fff640 1 -- 172.21.15.79:0/545664739 learned_addr learned my addr 172.21.15.79:0/545664739 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:31.869 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.860+0000 7f3cf77fe640 1 --2- 172.21.15.79:0/545664739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564374cd8a10 0x564374cc92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:31.869 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.861+0000 7f3cf77fe640 1 -- 172.21.15.79:0/545664739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564374cd60e0 msgr2=0x564374ced570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:31.869 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.861+0000 7f3cf77fe640 1 --2- 172.21.15.79:0/545664739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564374cd60e0 0x564374ced570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:31.869 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.861+0000 7f3cfca28640 1 --2- 172.21.15.79:0/545664739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564374cdb450 0x564374cc97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:31.869 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.861+0000 7f3cf77fe640 1 -- 172.21.15.79:0/545664739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564374cdb450 msgr2=0x564374cc97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:31.869 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.861+0000 7f3cf77fe640 1 --2- 172.21.15.79:0/545664739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564374cdb450 0x564374cc97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:31.869 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.861+0000 7f3cf77fe640 1 -- 172.21.15.79:0/545664739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564374cde540 con 0x564374cd8a10 2024-08-20T01:45:31.870 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.861+0000 7f3cfca28640 1 --2- 172.21.15.79:0/545664739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564374cdb450 0x564374cc97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:45:31.870 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.861+0000 7f3cf77fe640 1 --2- 172.21.15.79:0/545664739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564374cd8a10 0x564374cc92a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3cec004650 tx=0x7f3cec03b690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=111d4df0f15b2ddf server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:31.870 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.861+0000 7f3cddffb640 1 -- 172.21.15.79:0/545664739 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cec049070 con 0x564374cd8a10 2024-08-20T01:45:31.870 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.862+0000 7f3cddffb640 1 -- 172.21.15.79:0/545664739 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3cec0cb750 con 0x564374cd8a10 2024-08-20T01:45:31.870 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.862+0000 7f3cddffb640 1 -- 172.21.15.79:0/545664739 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cec0ca7c0 con 0x564374cd8a10 2024-08-20T01:45:31.870 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.862+0000 7f3d01286740 1 -- 172.21.15.79:0/545664739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564374cd8a10 msgr2=0x564374cc92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:31.870 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.862+0000 7f3d01286740 1 --2- 172.21.15.79:0/545664739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564374cd8a10 0x564374cc92a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3cec004650 tx=0x7f3cec03b690 comp rx=0 tx=0).stop 2024-08-20T01:45:31.870 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.863+0000 7f3d01286740 1 -- 172.21.15.79:0/545664739 shutdown_connections 2024-08-20T01:45:31.870 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.863+0000 7f3d01286740 1 --2- 172.21.15.79:0/545664739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564374cdb450 0x564374cc97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:31.871 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.863+0000 7f3d01286740 1 --2- 172.21.15.79:0/545664739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564374cd8a10 0x564374cc92a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:31.871 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.863+0000 7f3d01286740 1 --2- 172.21.15.79:0/545664739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564374cd60e0 0x564374ced570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:31.871 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.863+0000 7f3d01286740 1 -- 172.21.15.79:0/545664739 >> 172.21.15.79:0/545664739 conn(0x564374cc8a20 msgr2=0x564374cdcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:31.871 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.863+0000 7f3d01286740 1 -- 172.21.15.79:0/545664739 shutdown_connections 2024-08-20T01:45:31.871 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.863+0000 7f3d01286740 1 -- 172.21.15.79:0/545664739 wait complete. 2024-08-20T01:45:31.871 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.863+0000 7f3d01286740 1 -- start start 2024-08-20T01:45:31.871 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.863+0000 7f3d01286740 1 Processor -- start 2024-08-20T01:45:31.871 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.864+0000 7f3d01286740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564374cd60e0 0x564374ce43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:31.871 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.864+0000 7f3d01286740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564374cd8a10 0x564374ce4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:31.871 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.864+0000 7f3d01286740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564374cdb450 0x564374ce55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:31.872 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.864+0000 7f3d01286740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf8072790 con 0x564374cdb450 2024-08-20T01:45:31.872 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.864+0000 7f3d01286740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf8072030 con 0x564374cd60e0 2024-08-20T01:45:31.872 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.864+0000 7f3d01286740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf806f270 con 0x564374cd8a10 2024-08-20T01:45:31.872 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.864+0000 7f3d01286740 10 client.0 _ll_register_callbacks cb 0x7f3cec009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:45:31.872 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.864+0000 7f3cf77fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564374cd8a10 0x564374ce4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:31.872 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.864+0000 7f3cf77fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564374cd8a10 0x564374ce4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:38568/0 (socket says 172.21.15.79:38568) 2024-08-20T01:45:31.872 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.864+0000 7f3cf7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564374cd60e0 0x564374ce43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:31.872 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.864+0000 7f3cf77fe640 1 -- 172.21.15.79:0/2132042509 learned_addr learned my addr 172.21.15.79:0/2132042509 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:31.872 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.864+0000 7f3cf7fff640 1 -- 172.21.15.79:0/2132042509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564374cd8a10 msgr2=0x564374ce4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:31.872 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.864+0000 7f3cfca28640 1 --2- 172.21.15.79:0/2132042509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564374cdb450 0x564374ce55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:31.872 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.864+0000 7f3cf7fff640 1 --2- 172.21.15.79:0/2132042509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564374cd8a10 0x564374ce4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:31.873 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.865+0000 7f3cf7fff640 1 -- 172.21.15.79:0/2132042509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564374cdb450 msgr2=0x564374ce55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:31.873 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.865+0000 7f3cf7fff640 1 --2- 172.21.15.79:0/2132042509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564374cdb450 0x564374ce55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:31.873 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.865+0000 7f3cf7fff640 1 -- 172.21.15.79:0/2132042509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564374ce5de0 con 0x564374cd60e0 2024-08-20T01:45:31.873 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.865+0000 7f3cf77fe640 1 --2- 172.21.15.79:0/2132042509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564374cd8a10 0x564374ce4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:45:31.873 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.865+0000 7f3cfca28640 1 --2- 172.21.15.79:0/2132042509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564374cdb450 0x564374ce55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:45:31.873 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.865+0000 7f3cf7fff640 1 --2- 172.21.15.79:0/2132042509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564374cd60e0 0x564374ce43a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3cf00203f0 tx=0x7f3cf0004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=388b7348344e29c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:31.873 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.865+0000 7f3cd77fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:45:31.873 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.865+0000 7f3cd77fe640 1 -- 172.21.15.79:0/2132042509 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf0004b20 con 0x564374cd60e0 2024-08-20T01:45:31.873 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.865+0000 7f3d01286740 1 -- 172.21.15.79:0/2132042509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cec0cb750 con 0x564374cd60e0 2024-08-20T01:45:31.873 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.865+0000 7f3cd77fe640 1 -- 172.21.15.79:0/2132042509 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f3cf0004cc0 con 0x564374cd60e0 2024-08-20T01:45:31.873 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.865+0000 7f3cd77fe640 1 -- 172.21.15.79:0/2132042509 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f3cf0005020 con 0x564374cd60e0 2024-08-20T01:45:31.873 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.865+0000 7f3d01286740 10 client.26864 fetch_fsmap learned FSMap version 42 2024-08-20T01:45:31.873 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.865+0000 7f3d01286740 1 -- 172.21.15.79:0/2132042509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x564374ce7110 con 0x564374cd60e0 2024-08-20T01:45:31.874 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.866+0000 7f3cd77fe640 1 -- 172.21.15.79:0/2132042509 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3cec0cb750 con 0x564374cd60e0 2024-08-20T01:45:31.874 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.866+0000 7f3cd77fe640 1 -- 172.21.15.79:0/2132042509 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 42) ==== 8390+0+0 (secure 0 0 0) 0x7f3cf004c540 con 0x564374cd60e0 2024-08-20T01:45:31.875 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.866+0000 7f3d01286740 10 client.26864 fetch_fsmap finished waiting for FSMap version 42 2024-08-20T01:45:31.875 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.866+0000 7f3d01286740 10 client.26864 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:45:31.875 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.866+0000 7f3d01286740 20 client.26864 populate_metadata read hostname 'smithi079' 2024-08-20T01:45:31.875 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.866+0000 7f3d01286740 1 --2- 172.21.15.79:0/2132042509 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564374d56280 0x564374d58670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:31.875 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.866+0000 7f3d01286740 4 client.26864 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:45:31.875 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.866+0000 7f3d01286740 1 -- 172.21.15.79:0/2132042509 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564374c3dd50 con 0x564374d56280 2024-08-20T01:45:31.875 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.867+0000 7f3cf77fe640 1 --2- 172.21.15.79:0/2132042509 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564374d56280 0x564374d58670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:31.875 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.867+0000 7f3cd77fe640 10 client.26864 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:45:31.875 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:31.867+0000 7f3cf77fe640 1 --2- 172.21.15.79:0/2132042509 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564374d56280 0x564374d58670 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a876a33967d4551d server_cookie=d0ab6124044263b in_seq=0 out_seq=0 2024-08-20T01:45:32.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:31 smithi081 ceph-mon[22209]: pgmap v593: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 MiB/s wr, 2.08k op/s 2024-08-20T01:45:32.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:31 smithi175 ceph-mon[22392]: pgmap v593: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 MiB/s wr, 2.08k op/s 2024-08-20T01:45:32.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:31 smithi079 ceph-mon[18656]: pgmap v593: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 MiB/s wr, 2.08k op/s 2024-08-20T01:45:32.605 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:32.602+0000 7f3cd77fe640 1 -- 172.21.15.79:0/2132042509 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564374c3dd50 con 0x564374d56280 2024-08-20T01:45:32.605 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:32.602+0000 7f3cd77fe640 10 client.26864 handle_command_reply: tid=0 2024-08-20T01:45:32.605 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:32.602+0000 7f3d01286740 1 client.26864 shutdown 2024-08-20T01:45:32.605 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:32.603+0000 7f3d01286740 1 -- 172.21.15.79:0/2132042509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564374cd60e0 msgr2=0x564374ce43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:32.605 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:32.603+0000 7f3d01286740 1 --2- 172.21.15.79:0/2132042509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564374cd60e0 0x564374ce43a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3cf00203f0 tx=0x7f3cf0004ab0 comp rx=0 tx=0).stop 2024-08-20T01:45:32.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:32.603+0000 7f3d01286740 1 -- 172.21.15.79:0/2132042509 shutdown_connections 2024-08-20T01:45:32.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:32.603+0000 7f3d01286740 1 --2- 172.21.15.79:0/2132042509 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564374d56280 0x564374d58670 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:32.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:32.603+0000 7f3d01286740 1 --2- 172.21.15.79:0/2132042509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564374cdb450 0x564374ce55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:32.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:32.603+0000 7f3d01286740 1 --2- 172.21.15.79:0/2132042509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564374cd8a10 0x564374ce4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:32.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:32.603+0000 7f3d01286740 1 --2- 172.21.15.79:0/2132042509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564374cd60e0 0x564374ce43a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:32.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:32.603+0000 7f3d01286740 1 -- 172.21.15.79:0/2132042509 >> 172.21.15.79:0/2132042509 conn(0x564374cc8a20 msgr2=0x564374cc9280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:32.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:32.603+0000 7f3cd77fe640 0 client.26864 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:45:32.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:32.603+0000 7f3d01286740 1 -- 172.21.15.79:0/2132042509 shutdown_connections 2024-08-20T01:45:32.607 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:32.603+0000 7f3d01286740 1 -- 172.21.15.79:0/2132042509 wait complete. 2024-08-20T01:45:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:32.603+0000 7f3d01286740 20 client.26864 trim_cache size 0 max 16384 2024-08-20T01:45:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:45:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:45:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:45:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:45:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:32.604+0000 7f3cfe48b640 1 -- 172.21.15.79:0/1673358897 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3ce00b3ea0 msgr2=0x7f3ce00b6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:32.604+0000 7f3cfe48b640 1 --2- 172.21.15.79:0/1673358897 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3ce00b3ea0 0x7f3ce00b6360 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3cf00216e0 tx=0x7f3cf0023040 comp rx=0 tx=0).stop 2024-08-20T01:45:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:32.604+0000 7f3cfe48b640 1 -- 172.21.15.79:0/1673358897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cf8101e30 msgr2=0x7f3cf819b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:32.604+0000 7f3cfe48b640 1 --2- 172.21.15.79:0/1673358897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cf8101e30 0x7f3cf819b1e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3cec009850 tx=0x7f3cec003b90 comp rx=0 tx=0).stop 2024-08-20T01:45:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:32.604+0000 7f3cfe48b640 1 -- 172.21.15.79:0/1673358897 shutdown_connections 2024-08-20T01:45:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:32.604+0000 7f3cfe48b640 1 --2- 172.21.15.79:0/1673358897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cf81027f0 0x7f3cf819be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:32.604+0000 7f3cfe48b640 1 --2- 172.21.15.79:0/1673358897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cf8101e30 0x7f3cf819b1e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:32.604+0000 7f3cfe48b640 1 --2- 172.21.15.79:0/1673358897 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3ce00b3ea0 0x7f3ce00b6360 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:32.604+0000 7f3cfe48b640 1 --2- 172.21.15.79:0/1673358897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cf8100ce0 0x7f3cf819ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:32.604+0000 7f3cfe48b640 1 -- 172.21.15.79:0/1673358897 >> 172.21.15.79:0/1673358897 conn(0x7f3cf80fc580 msgr2=0x7f3cf80fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:32.604+0000 7f3cfe48b640 1 -- 172.21.15.79:0/1673358897 shutdown_connections 2024-08-20T01:45:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:32.604+0000 7f3cfe48b640 1 -- 172.21.15.79:0/1673358897 wait complete. 2024-08-20T01:45:34.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:33 smithi081 ceph-mon[22209]: pgmap v594: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 25 MiB/s wr, 3.00k op/s 2024-08-20T01:45:34.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:33 smithi175 ceph-mon[22392]: pgmap v594: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 25 MiB/s wr, 3.00k op/s 2024-08-20T01:45:34.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:33 smithi079 ceph-mon[18656]: pgmap v594: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 25 MiB/s wr, 3.00k op/s 2024-08-20T01:45:36.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:35 smithi081 ceph-mon[22209]: pgmap v595: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 28 MiB/s wr, 4.52k op/s 2024-08-20T01:45:36.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:35 smithi175 ceph-mon[22392]: pgmap v595: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 28 MiB/s wr, 4.52k op/s 2024-08-20T01:45:36.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:35 smithi079 ceph-mon[18656]: pgmap v595: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 28 MiB/s wr, 4.52k op/s 2024-08-20T01:45:37.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:36 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:45:37.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:36 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:45:37.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:36 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:45:38.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:37 smithi081 ceph-mon[22209]: pgmap v596: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 26 MiB/s wr, 5.54k op/s 2024-08-20T01:45:38.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:37 smithi175 ceph-mon[22392]: pgmap v596: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 26 MiB/s wr, 5.54k op/s 2024-08-20T01:45:38.438 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:37 smithi079 ceph-mon[18656]: pgmap v596: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 26 MiB/s wr, 5.54k op/s 2024-08-20T01:45:40.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:39 smithi081 ceph-mon[22209]: pgmap v597: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 29 MiB/s wr, 6.96k op/s 2024-08-20T01:45:40.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:39 smithi175 ceph-mon[22392]: pgmap v597: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 29 MiB/s wr, 6.96k op/s 2024-08-20T01:45:40.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:39 smithi079 ceph-mon[18656]: pgmap v597: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 29 MiB/s wr, 6.96k op/s 2024-08-20T01:45:42.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:41 smithi081 ceph-mon[22209]: pgmap v598: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 29 MiB/s wr, 7.32k op/s 2024-08-20T01:45:42.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:41 smithi175 ceph-mon[22392]: pgmap v598: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 29 MiB/s wr, 7.32k op/s 2024-08-20T01:45:42.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:41 smithi079 ceph-mon[18656]: pgmap v598: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 29 MiB/s wr, 7.32k op/s 2024-08-20T01:45:44.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:44 smithi081 ceph-mon[22209]: pgmap v599: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 28 MiB/s wr, 7.05k op/s 2024-08-20T01:45:44.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:44 smithi175 ceph-mon[22392]: pgmap v599: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 28 MiB/s wr, 7.05k op/s 2024-08-20T01:45:44.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:44 smithi079 ceph-mon[18656]: pgmap v599: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 28 MiB/s wr, 7.05k op/s 2024-08-20T01:45:45.749 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.746+0000 7fa0d3840640 1 -- 172.21.15.79:0/4063424883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0cc101580 msgr2=0x7fa0cc101980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:45.749 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.746+0000 7fa0d3840640 1 --2- 172.21.15.79:0/4063424883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0cc101580 0x7fa0cc101980 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa0c8009900 tx=0x7fa0c802a410 comp rx=0 tx=0).stop 2024-08-20T01:45:45.749 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.746+0000 7fa0d3840640 1 -- 172.21.15.79:0/4063424883 shutdown_connections 2024-08-20T01:45:45.750 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.746+0000 7fa0d3840640 1 --2- 172.21.15.79:0/4063424883 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0cc103090 0x7fa0cc109a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:45.750 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.746+0000 7fa0d3840640 1 --2- 172.21.15.79:0/4063424883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0cc1026d0 0x7fa0cc102b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:45.750 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.746+0000 7fa0d3840640 1 --2- 172.21.15.79:0/4063424883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0cc101580 0x7fa0cc101980 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:45.750 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.746+0000 7fa0d3840640 1 -- 172.21.15.79:0/4063424883 >> 172.21.15.79:0/4063424883 conn(0x7fa0cc0fce20 msgr2=0x7fa0cc0ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:45.750 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.746+0000 7fa0d3840640 1 -- 172.21.15.79:0/4063424883 shutdown_connections 2024-08-20T01:45:45.750 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.747+0000 7fa0d3840640 1 -- 172.21.15.79:0/4063424883 wait complete. 2024-08-20T01:45:45.752 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.747+0000 7fa0d3840640 1 Processor -- start 2024-08-20T01:45:45.752 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.747+0000 7fa0d3840640 1 -- start start 2024-08-20T01:45:45.752 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.748+0000 7fa0d3840640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0cc101580 0x7fa0cc197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:45.752 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.748+0000 7fa0d3840640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0cc1026d0 0x7fa0cc197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:45.752 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.748+0000 7fa0d3840640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0cc103090 0x7fa0cc198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:45.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.748+0000 7fa0d3840640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa0cc10d0d0 con 0x7fa0cc101580 2024-08-20T01:45:45.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.748+0000 7fa0d3840640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa0cc10cf50 con 0x7fa0cc103090 2024-08-20T01:45:45.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.748+0000 7fa0d3840640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa0cc10d250 con 0x7fa0cc1026d0 2024-08-20T01:45:45.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.748+0000 7fa0d15dc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0cc101580 0x7fa0cc197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:45.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.748+0000 7fa0d15dc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0cc101580 0x7fa0cc197890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45672/0 (socket says 172.21.15.79:45672) 2024-08-20T01:45:45.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.748+0000 7fa0d15dc640 1 -- 172.21.15.79:0/3756969441 learned_addr learned my addr 172.21.15.79:0/3756969441 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:45.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.748+0000 7fa0d1ddd640 1 --2- 172.21.15.79:0/3756969441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0cc103090 0x7fa0cc198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:45.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.749+0000 7fa0d1ddd640 1 -- 172.21.15.79:0/3756969441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0cc1026d0 msgr2=0x7fa0cc197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:45.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.749+0000 7fa0d0ddb640 1 --2- 172.21.15.79:0/3756969441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0cc1026d0 0x7fa0cc197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:45.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.749+0000 7fa0d1ddd640 1 --2- 172.21.15.79:0/3756969441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0cc1026d0 0x7fa0cc197ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:45.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.749+0000 7fa0d1ddd640 1 -- 172.21.15.79:0/3756969441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0cc101580 msgr2=0x7fa0cc197890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:45.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.749+0000 7fa0d1ddd640 1 --2- 172.21.15.79:0/3756969441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0cc101580 0x7fa0cc197890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:45.754 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.749+0000 7fa0d1ddd640 1 -- 172.21.15.79:0/3756969441 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0cc1993d0 con 0x7fa0cc103090 2024-08-20T01:45:45.754 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.749+0000 7fa0d15dc640 1 --2- 172.21.15.79:0/3756969441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0cc101580 0x7fa0cc197890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:45:45.754 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.749+0000 7fa0d1ddd640 1 --2- 172.21.15.79:0/3756969441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0cc103090 0x7fa0cc198b10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa0c400ede0 tx=0x7fa0c400b690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:45.754 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.750+0000 7fa0c27fc640 1 -- 172.21.15.79:0/3756969441 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c4003970 con 0x7fa0cc103090 2024-08-20T01:45:45.754 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.750+0000 7fa0c27fc640 1 -- 172.21.15.79:0/3756969441 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0c4004020 con 0x7fa0cc103090 2024-08-20T01:45:45.754 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.750+0000 7fa0d3840640 1 -- 172.21.15.79:0/3756969441 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0cc1996c0 con 0x7fa0cc103090 2024-08-20T01:45:45.754 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.750+0000 7fa0c27fc640 1 -- 172.21.15.79:0/3756969441 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c4017630 con 0x7fa0cc103090 2024-08-20T01:45:45.754 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.750+0000 7fa0d3840640 1 -- 172.21.15.79:0/3756969441 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0cc06b1d0 con 0x7fa0cc103090 2024-08-20T01:45:45.756 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.753+0000 7fa0d662f740 1 Processor -- start 2024-08-20T01:45:45.756 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.754+0000 7fa0c27fc640 1 -- 172.21.15.79:0/3756969441 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa0c4003b10 con 0x7fa0cc103090 2024-08-20T01:45:45.756 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.754+0000 7fa0d662f740 1 -- start start 2024-08-20T01:45:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.754+0000 7fa0d662f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fe41ad8d0 0x561fe41afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.754+0000 7fa0d662f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fe41b0200 0x561fe41b25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.754+0000 7fa0d662f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fe41b2c40 0x561fe41b5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.754+0000 7fa0d662f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561fe4120360 con 0x561fe41ad8d0 2024-08-20T01:45:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.754+0000 7fa0d662f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561fe410f860 con 0x561fe41b0200 2024-08-20T01:45:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.754+0000 7fa0d662f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561fe41138a0 con 0x561fe41b2c40 2024-08-20T01:45:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.755+0000 7fa0d0ddb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fe41b2c40 0x561fe41b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.755+0000 7fa0d0ddb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fe41b2c40 0x561fe41b5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:48318/0 (socket says 172.21.15.79:48318) 2024-08-20T01:45:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.755+0000 7fa0d0ddb640 1 -- 172.21.15.79:0/3223599588 learned_addr learned my addr 172.21.15.79:0/3223599588 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.755+0000 7fa0d15dc640 1 --2- 172.21.15.79:0/3223599588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fe41b0200 0x561fe41b25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:45.760 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.755+0000 7fa0d0ddb640 1 --2- 172.21.15.79:0/3223599588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fe41ad8d0 0x561fe41afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:45.760 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.755+0000 7fa0c27fc640 1 --2- 172.21.15.79:0/3756969441 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa0b80b3c50 0x7fa0b80b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:45.760 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.756+0000 7fa0d15dc640 1 -- 172.21.15.79:0/3223599588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fe41b2c40 msgr2=0x561fe41b5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:45.760 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.756+0000 7fa0d15dc640 1 --2- 172.21.15.79:0/3223599588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fe41b2c40 0x561fe41b5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:45.760 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.756+0000 7fa0d15dc640 1 -- 172.21.15.79:0/3223599588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fe41ad8d0 msgr2=0x561fe41afcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:45.760 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.756+0000 7fa0d15dc640 1 --2- 172.21.15.79:0/3223599588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fe41ad8d0 0x561fe41afcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:45.760 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.756+0000 7fa0d15dc640 1 -- 172.21.15.79:0/3223599588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fe40b6e40 con 0x561fe41b0200 2024-08-20T01:45:45.760 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.756+0000 7fa0d0ddb640 1 --2- 172.21.15.79:0/3223599588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fe41ad8d0 0x561fe41afcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:45:45.760 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.756+0000 7fa0c27fc640 1 -- 172.21.15.79:0/3756969441 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fa0c40e56f0 con 0x7fa0cc103090 2024-08-20T01:45:45.760 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.756+0000 7fa0d1ddd640 1 --2- 172.21.15.79:0/3756969441 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa0b80b3c50 0x7fa0b80b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:45.760 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.756+0000 7fa0d15dc640 1 --2- 172.21.15.79:0/3223599588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fe41b0200 0x561fe41b25f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa0c8004770 tx=0x7fa0c8004520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8cb3b456a19d2d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:45.760 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.756+0000 7fa0b77fe640 1 -- 172.21.15.79:0/3223599588 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c8035030 con 0x561fe41b0200 2024-08-20T01:45:45.761 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.756+0000 7fa0b77fe640 1 -- 172.21.15.79:0/3223599588 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0c8040070 con 0x561fe41b0200 2024-08-20T01:45:45.761 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.756+0000 7fa0b77fe640 1 -- 172.21.15.79:0/3223599588 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c8031c20 con 0x561fe41b0200 2024-08-20T01:45:45.762 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.757+0000 7fa0d662f740 1 -- 172.21.15.79:0/3223599588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fe41b0200 msgr2=0x561fe41b25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:45.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.757+0000 7fa0d662f740 1 --2- 172.21.15.79:0/3223599588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fe41b0200 0x561fe41b25f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa0c8004770 tx=0x7fa0c8004520 comp rx=0 tx=0).stop 2024-08-20T01:45:45.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.757+0000 7fa0d1ddd640 1 --2- 172.21.15.79:0/3756969441 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa0b80b3c50 0x7fa0b80b6110 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fa0c40a86d0 tx=0x7fa0c4004730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:45.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.758+0000 7fa0d662f740 1 -- 172.21.15.79:0/3223599588 shutdown_connections 2024-08-20T01:45:45.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.758+0000 7fa0d662f740 1 --2- 172.21.15.79:0/3223599588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fe41b2c40 0x561fe41b5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:45.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.758+0000 7fa0d662f740 1 --2- 172.21.15.79:0/3223599588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fe41b0200 0x561fe41b25f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:45.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.758+0000 7fa0d662f740 1 --2- 172.21.15.79:0/3223599588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fe41ad8d0 0x561fe41afcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:45.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.758+0000 7fa0d662f740 1 -- 172.21.15.79:0/3223599588 >> 172.21.15.79:0/3223599588 conn(0x561fe41a8a20 msgr2=0x561fe41a97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:45.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.758+0000 7fa0d662f740 1 -- 172.21.15.79:0/3223599588 shutdown_connections 2024-08-20T01:45:45.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.758+0000 7fa0d662f740 1 -- 172.21.15.79:0/3223599588 wait complete. 2024-08-20T01:45:45.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.758+0000 7fa0d662f740 1 -- start start 2024-08-20T01:45:45.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.758+0000 7fa0d662f740 1 Processor -- start 2024-08-20T01:45:45.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.759+0000 7fa0d662f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fe41ad8d0 0x561fe41b7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:45.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.759+0000 7fa0d662f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fe41b0200 0x561fe41b7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:45.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.759+0000 7fa0d662f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fe41b2c40 0x561fe41b82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:45.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.759+0000 7fa0d662f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561fe4048ab0 con 0x561fe41b0200 2024-08-20T01:45:45.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.759+0000 7fa0d662f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561fe4096780 con 0x561fe41ad8d0 2024-08-20T01:45:45.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.759+0000 7fa0d662f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561fe41b5bc0 con 0x561fe41b2c40 2024-08-20T01:45:45.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.759+0000 7fa0d662f740 10 client.0 _ll_register_callbacks cb 0x561fe3e1ea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:45:45.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.759+0000 7fa0d0ddb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fe41ad8d0 0x561fe41b7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:45.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.759+0000 7fa0d0ddb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fe41ad8d0 0x561fe41b7060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:48046/0 (socket says 172.21.15.79:48046) 2024-08-20T01:45:45.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.759+0000 7fa0d0ddb640 1 -- 172.21.15.79:0/3778774477 learned_addr learned my addr 172.21.15.79:0/3778774477 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:45.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.759+0000 7fa0d0ddb640 1 --2- 172.21.15.79:0/3778774477 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fe41b2c40 0x561fe41b82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:45.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.759+0000 7fa0d15dc640 1 --2- 172.21.15.79:0/3778774477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fe41b0200 0x561fe41b7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:45.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.759+0000 7fa0d0ddb640 1 -- 172.21.15.79:0/3778774477 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fe41b2c40 msgr2=0x561fe41b82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:45.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.759+0000 7fa0d0ddb640 1 --2- 172.21.15.79:0/3778774477 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fe41b2c40 0x561fe41b82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:45.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.759+0000 7fa0d0ddb640 1 -- 172.21.15.79:0/3778774477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fe41b0200 msgr2=0x561fe41b7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:45.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.759+0000 7fa0d0ddb640 1 --2- 172.21.15.79:0/3778774477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fe41b0200 0x561fe41b7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:45.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.759+0000 7fa0d0ddb640 1 -- 172.21.15.79:0/3778774477 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fe3e72790 con 0x561fe41ad8d0 2024-08-20T01:45:45.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.760+0000 7fa0d0ddb640 1 --2- 172.21.15.79:0/3778774477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fe41ad8d0 0x561fe41b7060 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc013e50 tx=0x7fa0bc004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1bea7a050e70df1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:45.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.760+0000 7fa0b4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:45:45.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.761+0000 7fa0b4ff9640 1 -- 172.21.15.79:0/3778774477 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc013050 con 0x561fe41ad8d0 2024-08-20T01:45:45.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.761+0000 7fa0b4ff9640 1 -- 172.21.15.79:0/3778774477 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fa0bc0131f0 con 0x561fe41ad8d0 2024-08-20T01:45:45.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.761+0000 7fa0d662f740 1 -- 172.21.15.79:0/3778774477 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561fe40bee00 con 0x561fe41ad8d0 2024-08-20T01:45:45.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.762+0000 7fa0b4ff9640 1 -- 172.21.15.79:0/3778774477 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fa0bc012450 con 0x561fe41ad8d0 2024-08-20T01:45:45.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.762+0000 7fa0d662f740 10 client.26876 fetch_fsmap learned FSMap version 43 2024-08-20T01:45:45.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.762+0000 7fa0d662f740 1 -- 172.21.15.79:0/3778774477 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x561fe3eeb620 con 0x561fe41ad8d0 2024-08-20T01:45:45.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.762+0000 7fa0b4ff9640 1 -- 172.21.15.79:0/3778774477 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x561fe40bee00 con 0x561fe41ad8d0 2024-08-20T01:45:45.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.762+0000 7fa0b4ff9640 1 -- 172.21.15.79:0/3778774477 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 43) ==== 8394+0+0 (secure 0 0 0) 0x7fa0bc01e020 con 0x561fe41ad8d0 2024-08-20T01:45:45.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.762+0000 7fa0d662f740 10 client.26876 fetch_fsmap finished waiting for FSMap version 43 2024-08-20T01:45:45.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.762+0000 7fa0d662f740 10 client.26876 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:45:45.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.763+0000 7fa0d662f740 20 client.26876 populate_metadata read hostname 'smithi079' 2024-08-20T01:45:45.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.763+0000 7fa0d662f740 1 --2- 172.21.15.79:0/3778774477 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x561fe41c2e60 0x561fe41c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:45.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.763+0000 7fa0d662f740 4 client.26876 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:45:45.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.763+0000 7fa0d662f740 1 -- 172.21.15.79:0/3778774477 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561fe41222b0 con 0x561fe41c2e60 2024-08-20T01:45:45.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.763+0000 7fa0d15dc640 1 --2- 172.21.15.79:0/3778774477 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x561fe41c2e60 0x561fe41c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:45.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.763+0000 7fa0b4ff9640 10 client.26876 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:45:45.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.764+0000 7fa0d15dc640 1 --2- 172.21.15.79:0/3778774477 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x561fe41c2e60 0x561fe41c52c0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=321f09f4df11f688 server_cookie=617d032626c1073a in_seq=0 out_seq=0 2024-08-20T01:45:45.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.764+0000 7fa0b4ff9640 1 -- 172.21.15.79:0/3778774477 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561fe41222b0 con 0x561fe41c2e60 2024-08-20T01:45:45.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.765+0000 7fa0b4ff9640 10 client.26876 handle_command_reply: tid=0 2024-08-20T01:45:45.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.765+0000 7fa0d662f740 1 client.26876 shutdown 2024-08-20T01:45:45.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.765+0000 7fa0d662f740 1 -- 172.21.15.79:0/3778774477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fe41ad8d0 msgr2=0x561fe41b7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:45.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.765+0000 7fa0d662f740 1 --2- 172.21.15.79:0/3778774477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fe41ad8d0 0x561fe41b7060 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc013e50 tx=0x7fa0bc004730 comp rx=0 tx=0).stop 2024-08-20T01:45:45.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.765+0000 7fa0d662f740 1 -- 172.21.15.79:0/3778774477 shutdown_connections 2024-08-20T01:45:45.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.765+0000 7fa0d662f740 1 --2- 172.21.15.79:0/3778774477 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x561fe41c2e60 0x561fe41c52c0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:45.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.765+0000 7fa0d662f740 1 --2- 172.21.15.79:0/3778774477 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fe41b2c40 0x561fe41b82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:45.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.765+0000 7fa0d662f740 1 --2- 172.21.15.79:0/3778774477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fe41b0200 0x561fe41b7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:45.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.765+0000 7fa0d662f740 1 --2- 172.21.15.79:0/3778774477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fe41ad8d0 0x561fe41b7060 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:45.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.765+0000 7fa0d662f740 1 -- 172.21.15.79:0/3778774477 >> 172.21.15.79:0/3778774477 conn(0x561fe41a8a20 msgr2=0x561fe41a7ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:45.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.765+0000 7fa0b4ff9640 0 client.26876 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:45:45.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.765+0000 7fa0d662f740 1 -- 172.21.15.79:0/3778774477 shutdown_connections 2024-08-20T01:45:45.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.765+0000 7fa0d662f740 1 -- 172.21.15.79:0/3778774477 wait complete. 2024-08-20T01:45:45.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.766+0000 7fa0d662f740 20 client.26876 trim_cache size 0 max 16384 2024-08-20T01:45:45.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.792+0000 7fa0d662f740 1 Processor -- start 2024-08-20T01:45:45.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.792+0000 7fa0d662f740 1 -- start start 2024-08-20T01:45:45.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.792+0000 7fa0d662f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fe41ad8d0 0x561fe41c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:45.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.793+0000 7fa0d662f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fe41b0200 0x561fe41a9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:45.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.793+0000 7fa0d662f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fe41b2c40 0x561fe41a97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.793+0000 7fa0d0ddb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fe41ad8d0 0x561fe41c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.793+0000 7fa0d0ddb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fe41ad8d0 0x561fe41c4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:48062/0 (socket says 172.21.15.79:48062) 2024-08-20T01:45:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.793+0000 7fa0d0ddb640 1 -- 172.21.15.79:0/2520140545 learned_addr learned my addr 172.21.15.79:0/2520140545 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.793+0000 7fa0d662f740 1 -- 172.21.15.79:0/2520140545 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa0cc1a7920 con 0x561fe41b2c40 2024-08-20T01:45:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.793+0000 7fa0d662f740 1 -- 172.21.15.79:0/2520140545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa0cc1a95e0 con 0x561fe41ad8d0 2024-08-20T01:45:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.793+0000 7fa0d662f740 1 -- 172.21.15.79:0/2520140545 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa0cc1a7ff0 con 0x561fe41b0200 2024-08-20T01:45:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.793+0000 7fa0d0ddb640 1 --2- 172.21.15.79:0/2520140545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fe41b2c40 0x561fe41a97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.793+0000 7fa0d15dc640 1 --2- 172.21.15.79:0/2520140545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fe41b0200 0x561fe41a9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.793+0000 7fa0d0ddb640 1 -- 172.21.15.79:0/2520140545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fe41b0200 msgr2=0x561fe41a9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.793+0000 7fa0d0ddb640 1 --2- 172.21.15.79:0/2520140545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fe41b0200 0x561fe41a9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.793+0000 7fa0d0ddb640 1 -- 172.21.15.79:0/2520140545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fe41b2c40 msgr2=0x561fe41a97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.793+0000 7fa0d0ddb640 1 --2- 172.21.15.79:0/2520140545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fe41b2c40 0x561fe41a97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:45.798 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.793+0000 7fa0d0ddb640 1 -- 172.21.15.79:0/2520140545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fe41b8640 con 0x561fe41ad8d0 2024-08-20T01:45:45.798 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.793+0000 7fa0d15dc640 1 --2- 172.21.15.79:0/2520140545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fe41b0200 0x561fe41a9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:45:45.798 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.794+0000 7fa0d0ddb640 1 --2- 172.21.15.79:0/2520140545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fe41ad8d0 0x561fe41c4e70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc004700 tx=0x7fa0bc00e930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f104b3ba93582cc5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:45.798 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.794+0000 7fa0b6ffd640 1 -- 172.21.15.79:0/2520140545 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc0207b0 con 0x561fe41ad8d0 2024-08-20T01:45:45.799 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.794+0000 7fa0b6ffd640 1 -- 172.21.15.79:0/2520140545 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0bc030040 con 0x561fe41ad8d0 2024-08-20T01:45:45.799 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.795+0000 7fa0d662f740 1 -- 172.21.15.79:0/2520140545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fe41ad8d0 msgr2=0x561fe41c4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.795+0000 7fa0d662f740 1 --2- 172.21.15.79:0/2520140545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fe41ad8d0 0x561fe41c4e70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc004700 tx=0x7fa0bc00e930 comp rx=0 tx=0).stop 2024-08-20T01:45:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.796+0000 7fa0d662f740 1 -- 172.21.15.79:0/2520140545 shutdown_connections 2024-08-20T01:45:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.796+0000 7fa0d662f740 1 --2- 172.21.15.79:0/2520140545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fe41b2c40 0x561fe41a97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.796+0000 7fa0d662f740 1 --2- 172.21.15.79:0/2520140545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fe41b0200 0x561fe41a9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.796+0000 7fa0d662f740 1 --2- 172.21.15.79:0/2520140545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fe41ad8d0 0x561fe41c4e70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.796+0000 7fa0d662f740 1 -- 172.21.15.79:0/2520140545 >> 172.21.15.79:0/2520140545 conn(0x561fe41a8a20 msgr2=0x561fe41b45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.796+0000 7fa0d662f740 1 -- 172.21.15.79:0/2520140545 shutdown_connections 2024-08-20T01:45:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.796+0000 7fa0d662f740 1 -- 172.21.15.79:0/2520140545 wait complete. 2024-08-20T01:45:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.796+0000 7fa0d662f740 1 -- start start 2024-08-20T01:45:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.797+0000 7fa0d662f740 1 Processor -- start 2024-08-20T01:45:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.797+0000 7fa0d662f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fe41ad8d0 0x561fe41bbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.797+0000 7fa0d662f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fe41b0200 0x561fe41bc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.797+0000 7fa0d662f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fe41b2c40 0x561fe41bcf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.797+0000 7fa0d662f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa0cc1a8e50 con 0x561fe41ad8d0 2024-08-20T01:45:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.797+0000 7fa0d662f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa0cc1a86c0 con 0x561fe41b0200 2024-08-20T01:45:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.797+0000 7fa0d662f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa0cc1a5900 con 0x561fe41b2c40 2024-08-20T01:45:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.797+0000 7fa0d662f740 10 client.0 _ll_register_callbacks cb 0x7fa0bc00edb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:45:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.798+0000 7fa0d15dc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fe41b0200 0x561fe41bc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:45.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.798+0000 7fa0d0ddb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fe41ad8d0 0x561fe41bbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:45.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.798+0000 7fa0d15dc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fe41b0200 0x561fe41bc330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:48076/0 (socket says 172.21.15.79:48076) 2024-08-20T01:45:45.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.798+0000 7fa0d15dc640 1 -- 172.21.15.79:0/4134847509 learned_addr learned my addr 172.21.15.79:0/4134847509 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:45.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.798+0000 7fa0d0ddb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fe41ad8d0 0x561fe41bbc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45710/0 (socket says 172.21.15.79:45710) 2024-08-20T01:45:45.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.798+0000 7fa0d0ddb640 1 --2- 172.21.15.79:0/4134847509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fe41b2c40 0x561fe41bcf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:45.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.798+0000 7fa0d15dc640 1 -- 172.21.15.79:0/4134847509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fe41b2c40 msgr2=0x561fe41bcf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:45.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.798+0000 7fa0d15dc640 1 --2- 172.21.15.79:0/4134847509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fe41b2c40 0x561fe41bcf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:45.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.798+0000 7fa0d15dc640 1 -- 172.21.15.79:0/4134847509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fe41ad8d0 msgr2=0x561fe41bbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:45.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.798+0000 7fa0d15dc640 1 --2- 172.21.15.79:0/4134847509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fe41ad8d0 0x561fe41bbc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:45.802 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.798+0000 7fa0d15dc640 1 -- 172.21.15.79:0/4134847509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fe41b0030 con 0x561fe41b0200 2024-08-20T01:45:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.799+0000 7fa0d15dc640 1 --2- 172.21.15.79:0/4134847509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fe41b0200 0x561fe41bc330 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa0c8005c40 tx=0x7fa0c8009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39eeebb381adbb1c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.799+0000 7fa0b4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:45:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.799+0000 7fa0b4ff9640 1 -- 172.21.15.79:0/4134847509 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c8035040 con 0x561fe41b0200 2024-08-20T01:45:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.799+0000 7fa0b4ff9640 1 -- 172.21.15.79:0/4134847509 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fa0c8031950 con 0x561fe41b0200 2024-08-20T01:45:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.799+0000 7fa0d662f740 1 -- 172.21.15.79:0/4134847509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0bc030040 con 0x561fe41b0200 2024-08-20T01:45:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.800+0000 7fa0b4ff9640 1 -- 172.21.15.79:0/4134847509 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fa0c8031b50 con 0x561fe41b0200 2024-08-20T01:45:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.800+0000 7fa0d662f740 10 client.26882 fetch_fsmap learned FSMap version 43 2024-08-20T01:45:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.800+0000 7fa0d662f740 1 -- 172.21.15.79:0/4134847509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x561fe41be990 con 0x561fe41b0200 2024-08-20T01:45:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.800+0000 7fa0b4ff9640 1 -- 172.21.15.79:0/4134847509 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0bc030040 con 0x561fe41b0200 2024-08-20T01:45:45.805 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.800+0000 7fa0b4ff9640 1 -- 172.21.15.79:0/4134847509 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 43) ==== 8394+0+0 (secure 0 0 0) 0x7fa0c8051430 con 0x561fe41b0200 2024-08-20T01:45:45.805 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.800+0000 7fa0d662f740 10 client.26882 fetch_fsmap finished waiting for FSMap version 43 2024-08-20T01:45:45.805 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.800+0000 7fa0d662f740 10 client.26882 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:45:45.805 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.800+0000 7fa0d662f740 20 client.26882 populate_metadata read hostname 'smithi079' 2024-08-20T01:45:45.805 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.800+0000 7fa0d662f740 1 --2- 172.21.15.79:0/4134847509 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x561fe41befc0 0x561fe4244fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:45.805 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.800+0000 7fa0d662f740 4 client.26882 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:45:45.805 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.800+0000 7fa0d662f740 1 -- 172.21.15.79:0/4134847509 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561fe411dd50 con 0x561fe41befc0 2024-08-20T01:45:45.805 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.801+0000 7fa0d0ddb640 1 --2- 172.21.15.79:0/4134847509 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x561fe41befc0 0x561fe4244fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:45.805 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.801+0000 7fa0d0ddb640 1 --2- 172.21.15.79:0/4134847509 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x561fe41befc0 0x561fe4244fd0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f803dd77ab763d3a server_cookie=5cb40a106d32bff5 in_seq=0 out_seq=0 2024-08-20T01:45:45.805 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:45.801+0000 7fa0b4ff9640 10 client.26882 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:45:46.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:46 smithi081 ceph-mon[22209]: pgmap v600: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 30 MiB/s wr, 7.51k op/s 2024-08-20T01:45:46.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:46 smithi175 ceph-mon[22392]: pgmap v600: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 30 MiB/s wr, 7.51k op/s 2024-08-20T01:45:46.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:46 smithi079 ceph-mon[18656]: pgmap v600: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 30 MiB/s wr, 7.51k op/s 2024-08-20T01:45:48.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:48 smithi081 ceph-mon[22209]: pgmap v601: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 28 MiB/s wr, 7.02k op/s 2024-08-20T01:45:48.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:48 smithi175 ceph-mon[22392]: pgmap v601: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 28 MiB/s wr, 7.02k op/s 2024-08-20T01:45:48.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:48 smithi079 ceph-mon[18656]: pgmap v601: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 28 MiB/s wr, 7.02k op/s 2024-08-20T01:45:48.989 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:45:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:49.327+0000 7fa0b4ff9640 1 -- 172.21.15.79:0/4134847509 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561fe411dd50 con 0x561fe41befc0 2024-08-20T01:45:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:49.327+0000 7fa0b4ff9640 10 client.26882 handle_command_reply: tid=0 2024-08-20T01:45:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:49.327+0000 7fa0d662f740 1 client.26882 shutdown 2024-08-20T01:45:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:49.327+0000 7fa0d662f740 1 -- 172.21.15.79:0/4134847509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fe41b0200 msgr2=0x561fe41bc330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:49.327+0000 7fa0d662f740 1 --2- 172.21.15.79:0/4134847509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fe41b0200 0x561fe41bc330 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa0c8005c40 tx=0x7fa0c8009260 comp rx=0 tx=0).stop 2024-08-20T01:45:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:49.328+0000 7fa0d662f740 1 -- 172.21.15.79:0/4134847509 shutdown_connections 2024-08-20T01:45:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:49.328+0000 7fa0d662f740 1 --2- 172.21.15.79:0/4134847509 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x561fe41befc0 0x561fe4244fd0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:49.328+0000 7fa0d662f740 1 --2- 172.21.15.79:0/4134847509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561fe41b2c40 0x561fe41bcf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:49.328+0000 7fa0d662f740 1 --2- 172.21.15.79:0/4134847509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fe41b0200 0x561fe41bc330 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:49.328+0000 7fa0d662f740 1 --2- 172.21.15.79:0/4134847509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561fe41ad8d0 0x561fe41bbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:49.328+0000 7fa0d662f740 1 -- 172.21.15.79:0/4134847509 >> 172.21.15.79:0/4134847509 conn(0x561fe41a8a20 msgr2=0x561fe41aca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:49.328+0000 7fa0b4ff9640 0 client.26882 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:45:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:49.328+0000 7fa0d662f740 1 -- 172.21.15.79:0/4134847509 shutdown_connections 2024-08-20T01:45:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:49.328+0000 7fa0d662f740 1 -- 172.21.15.79:0/4134847509 wait complete. 2024-08-20T01:45:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:49.328+0000 7fa0d662f740 20 client.26882 trim_cache size 0 max 16384 2024-08-20T01:45:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:45:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:45:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:45:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:45:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:49.329+0000 7fa0d3840640 1 -- 172.21.15.79:0/3756969441 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa0b80b3c50 msgr2=0x7fa0b80b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:49.329+0000 7fa0d3840640 1 --2- 172.21.15.79:0/3756969441 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa0b80b3c50 0x7fa0b80b6110 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fa0c40a86d0 tx=0x7fa0c4004730 comp rx=0 tx=0).stop 2024-08-20T01:45:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:49.329+0000 7fa0d3840640 1 -- 172.21.15.79:0/3756969441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0cc103090 msgr2=0x7fa0cc198b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:49.335 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:49.329+0000 7fa0d3840640 1 --2- 172.21.15.79:0/3756969441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0cc103090 0x7fa0cc198b10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa0c400ede0 tx=0x7fa0c400b690 comp rx=0 tx=0).stop 2024-08-20T01:45:49.335 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:49.330+0000 7fa0d3840640 1 -- 172.21.15.79:0/3756969441 shutdown_connections 2024-08-20T01:45:49.335 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:49.330+0000 7fa0d3840640 1 --2- 172.21.15.79:0/3756969441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0cc103090 0x7fa0cc198b10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:49.335 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:49.330+0000 7fa0d3840640 1 --2- 172.21.15.79:0/3756969441 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa0b80b3c50 0x7fa0b80b6110 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:49.335 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:49.330+0000 7fa0d3840640 1 --2- 172.21.15.79:0/3756969441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0cc1026d0 0x7fa0cc197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:49.335 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:49.330+0000 7fa0d3840640 1 --2- 172.21.15.79:0/3756969441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0cc101580 0x7fa0cc197890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:49.335 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:49.330+0000 7fa0d3840640 1 -- 172.21.15.79:0/3756969441 >> 172.21.15.79:0/3756969441 conn(0x7fa0cc0fce20 msgr2=0x7fa0cc105b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:49.335 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:49.330+0000 7fa0d3840640 1 -- 172.21.15.79:0/3756969441 shutdown_connections 2024-08-20T01:45:49.335 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:45:49.331+0000 7fa0d3840640 1 -- 172.21.15.79:0/3756969441 wait complete. 2024-08-20T01:45:49.411 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:45:50.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.013+0000 7f35ab5f5640 1 -- 172.21.15.79:0/2455502105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35a4101590 msgr2=0x7f35a4101970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:50.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.013+0000 7f35ab5f5640 1 --2- 172.21.15.79:0/2455502105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35a4101590 0x7f35a4101970 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f35a0009900 tx=0x7f35a002b510 comp rx=0 tx=0).stop 2024-08-20T01:45:50.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.013+0000 7f35ab5f5640 1 -- 172.21.15.79:0/2455502105 shutdown_connections 2024-08-20T01:45:50.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.013+0000 7f35ab5f5640 1 --2- 172.21.15.79:0/2455502105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35a4104290 0x7f35a410dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:50.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.013+0000 7f35ab5f5640 1 --2- 172.21.15.79:0/2455502105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35a41038f0 0x7f35a4103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:50.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.013+0000 7f35ab5f5640 1 --2- 172.21.15.79:0/2455502105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35a4101590 0x7f35a4101970 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:50.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.013+0000 7f35ab5f5640 1 -- 172.21.15.79:0/2455502105 >> 172.21.15.79:0/2455502105 conn(0x7f35a4076bd0 msgr2=0x7f35a4076fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:50.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.014+0000 7f35ab5f5640 1 -- 172.21.15.79:0/2455502105 shutdown_connections 2024-08-20T01:45:50.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.014+0000 7f35ab5f5640 1 -- 172.21.15.79:0/2455502105 wait complete. 2024-08-20T01:45:50.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.015+0000 7f35ab5f5640 1 Processor -- start 2024-08-20T01:45:50.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.015+0000 7f35ab5f5640 1 -- start start 2024-08-20T01:45:50.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.015+0000 7f35ab5f5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35a4101590 0x7f35a419b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:50.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.015+0000 7f35ab5f5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35a41038f0 0x7f35a419b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:50.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.015+0000 7f35ab5f5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35a4104290 0x7f35a41a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:50.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.015+0000 7f35ab5f5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f35a4110460 con 0x7f35a4104290 2024-08-20T01:45:50.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.015+0000 7f35ab5f5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f35a41102e0 con 0x7f35a4101590 2024-08-20T01:45:50.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.015+0000 7f35ab5f5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f35a41105e0 con 0x7f35a41038f0 2024-08-20T01:45:50.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.015+0000 7f35a9391640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35a4101590 0x7f35a419b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:50.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.015+0000 7f35a9b92640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35a4104290 0x7f35a41a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:50.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.015+0000 7f35a9b92640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35a4104290 0x7f35a41a0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45722/0 (socket says 172.21.15.79:45722) 2024-08-20T01:45:50.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.015+0000 7f35a9b92640 1 -- 172.21.15.79:0/2382465950 learned_addr learned my addr 172.21.15.79:0/2382465950 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:50.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.015+0000 7f35a8b90640 1 --2- 172.21.15.79:0/2382465950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35a41038f0 0x7f35a419b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:50.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.016+0000 7f35a9391640 1 -- 172.21.15.79:0/2382465950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35a41038f0 msgr2=0x7f35a419b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:50.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.016+0000 7f35a9391640 1 --2- 172.21.15.79:0/2382465950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35a41038f0 0x7f35a419b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:50.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.016+0000 7f35a9391640 1 -- 172.21.15.79:0/2382465950 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35a4104290 msgr2=0x7f35a41a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:50.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.016+0000 7f35a9391640 1 --2- 172.21.15.79:0/2382465950 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35a4104290 0x7f35a41a0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:50.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.016+0000 7f35a9391640 1 -- 172.21.15.79:0/2382465950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35a41a1240 con 0x7f35a4101590 2024-08-20T01:45:50.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.017+0000 7f35a9391640 1 --2- 172.21.15.79:0/2382465950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35a4101590 0x7f35a419b190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f35a002ba30 tx=0x7f35a00050f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:50.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.022+0000 7f359a7fc640 1 -- 172.21.15.79:0/2382465950 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a003f070 con 0x7f35a4101590 2024-08-20T01:45:50.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.022+0000 7f359a7fc640 1 -- 172.21.15.79:0/2382465950 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f35a00044d0 con 0x7f35a4101590 2024-08-20T01:45:50.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.022+0000 7f359a7fc640 1 -- 172.21.15.79:0/2382465950 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a0036040 con 0x7f35a4101590 2024-08-20T01:45:50.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.023+0000 7f35ab5f5640 1 -- 172.21.15.79:0/2382465950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35a41a14d0 con 0x7f35a4101590 2024-08-20T01:45:50.026 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.023+0000 7f35ab5f5640 1 -- 172.21.15.79:0/2382465950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35a41a7bf0 con 0x7f35a4101590 2024-08-20T01:45:50.030 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.028+0000 7f359a7fc640 1 -- 172.21.15.79:0/2382465950 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f35a0003cc0 con 0x7f35a4101590 2024-08-20T01:45:50.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.028+0000 7f35ad9ee740 1 Processor -- start 2024-08-20T01:45:50.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.028+0000 7f35ad9ee740 1 -- start start 2024-08-20T01:45:50.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.029+0000 7f35ad9ee740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603277d3830 0x5603277d3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:50.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.029+0000 7f35ad9ee740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603277d4150 0x5603277e83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:50.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.029+0000 7f35ad9ee740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603277e88f0 0x5603277eace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:50.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.029+0000 7f35ad9ee740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56032774a8e0 con 0x5603277d4150 2024-08-20T01:45:50.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.029+0000 7f35ad9ee740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560327739de0 con 0x5603277e88f0 2024-08-20T01:45:50.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.029+0000 7f35ad9ee740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56032773de20 con 0x5603277d3830 2024-08-20T01:45:50.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.029+0000 7f35a8b90640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603277e88f0 0x5603277eace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:50.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.029+0000 7f35a9391640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603277d4150 0x5603277e83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:50.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.029+0000 7f35a8b90640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603277e88f0 0x5603277eace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:48108/0 (socket says 172.21.15.79:48108) 2024-08-20T01:45:50.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.029+0000 7f35a8b90640 1 -- 172.21.15.79:0/321594054 learned_addr learned my addr 172.21.15.79:0/321594054 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:50.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.029+0000 7f35a9b92640 1 --2- 172.21.15.79:0/321594054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603277d3830 0x5603277d3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:50.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.029+0000 7f35a8b90640 1 -- 172.21.15.79:0/321594054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603277d3830 msgr2=0x5603277d3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:50.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.029+0000 7f35a8b90640 1 --2- 172.21.15.79:0/321594054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603277d3830 0x5603277d3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:50.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.029+0000 7f35a8b90640 1 -- 172.21.15.79:0/321594054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603277d4150 msgr2=0x5603277e83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:50.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.029+0000 7f35a8b90640 1 --2- 172.21.15.79:0/321594054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603277d4150 0x5603277e83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:50.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.029+0000 7f35a8b90640 1 -- 172.21.15.79:0/321594054 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560327499650 con 0x5603277e88f0 2024-08-20T01:45:50.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.029+0000 7f35a9b92640 1 --2- 172.21.15.79:0/321594054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603277d3830 0x5603277d3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:45:50.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.030+0000 7f35a9391640 1 --2- 172.21.15.79:0/321594054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603277d4150 0x5603277e83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:45:50.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.030+0000 7f35a8b90640 1 --2- 172.21.15.79:0/321594054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603277e88f0 0x5603277eace0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f359400b7f0 tx=0x7f359400bcb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6800af786a33e8e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:50.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.030+0000 7f358f7fe640 1 -- 172.21.15.79:0/321594054 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f359400d950 con 0x5603277e88f0 2024-08-20T01:45:50.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.030+0000 7f358f7fe640 1 -- 172.21.15.79:0/321594054 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3594018070 con 0x5603277e88f0 2024-08-20T01:45:50.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.030+0000 7f359a7fc640 1 --2- 172.21.15.79:0/2382465950 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f35900b3da0 0x7f35900b6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:50.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.030+0000 7f358f7fe640 1 -- 172.21.15.79:0/321594054 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3594013e60 con 0x5603277e88f0 2024-08-20T01:45:50.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.031+0000 7f359a7fc640 1 -- 172.21.15.79:0/2382465950 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f35a0103880 con 0x7f35a4101590 2024-08-20T01:45:50.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.031+0000 7f35ad9ee740 1 -- 172.21.15.79:0/321594054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603277e88f0 msgr2=0x5603277eace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:50.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.031+0000 7f35ad9ee740 1 --2- 172.21.15.79:0/321594054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603277e88f0 0x5603277eace0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f359400b7f0 tx=0x7f359400bcb0 comp rx=0 tx=0).stop 2024-08-20T01:45:50.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.031+0000 7f35a9b92640 1 --2- 172.21.15.79:0/2382465950 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f35900b3da0 0x7f35900b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:50.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.031+0000 7f35ad9ee740 1 -- 172.21.15.79:0/321594054 shutdown_connections 2024-08-20T01:45:50.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.031+0000 7f35ad9ee740 1 --2- 172.21.15.79:0/321594054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603277e88f0 0x5603277eace0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:50.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.031+0000 7f35ad9ee740 1 --2- 172.21.15.79:0/321594054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603277d4150 0x5603277e83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:50.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.031+0000 7f35ad9ee740 1 --2- 172.21.15.79:0/321594054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603277d3830 0x5603277d3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:50.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.031+0000 7f35ad9ee740 1 -- 172.21.15.79:0/321594054 >> 172.21.15.79:0/321594054 conn(0x5603277d1660 msgr2=0x5603277d2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:50.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.031+0000 7f35ad9ee740 1 -- 172.21.15.79:0/321594054 shutdown_connections 2024-08-20T01:45:50.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.031+0000 7f35ad9ee740 1 -- 172.21.15.79:0/321594054 wait complete. 2024-08-20T01:45:50.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.032+0000 7f35ad9ee740 1 -- start start 2024-08-20T01:45:50.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.032+0000 7f35ad9ee740 1 Processor -- start 2024-08-20T01:45:50.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.033+0000 7f35ad9ee740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603277d3830 0x5603277e8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:50.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.033+0000 7f35ad9ee740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603277d4150 0x5603277e5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:50.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.033+0000 7f35ad9ee740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603277e88f0 0x5603277e5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:50.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.033+0000 7f35ad9ee740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56032759c700 con 0x5603277d4150 2024-08-20T01:45:50.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.033+0000 7f35ad9ee740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5603276c07c0 con 0x5603277d3830 2024-08-20T01:45:50.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.033+0000 7f35ad9ee740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5603277eb640 con 0x5603277e88f0 2024-08-20T01:45:50.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.033+0000 7f35ad9ee740 10 client.0 _ll_register_callbacks cb 0x5603277336b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:45:50.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.033+0000 7f35a9b92640 1 --2- 172.21.15.79:0/2382465950 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f35900b3da0 0x7f35900b6260 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f359c009270 tx=0x7f359c009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:50.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.033+0000 7f35a9391640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603277d3830 0x5603277e8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:50.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.033+0000 7f35a9391640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603277d3830 0x5603277e8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:48124/0 (socket says 172.21.15.79:48124) 2024-08-20T01:45:50.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.033+0000 7f35a9391640 1 -- 172.21.15.79:0/556238309 learned_addr learned my addr 172.21.15.79:0/556238309 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:50.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.033+0000 7f35a8b90640 1 --2- 172.21.15.79:0/556238309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603277d4150 0x5603277e5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:50.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.033+0000 7f35a9b92640 1 --2- 172.21.15.79:0/556238309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603277e88f0 0x5603277e5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:50.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.034+0000 7f35a9391640 1 -- 172.21.15.79:0/556238309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603277e88f0 msgr2=0x5603277e5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:50.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.034+0000 7f35a9391640 1 --2- 172.21.15.79:0/556238309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603277e88f0 0x5603277e5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:50.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.034+0000 7f35a9391640 1 -- 172.21.15.79:0/556238309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603277d4150 msgr2=0x5603277e5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:50.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.034+0000 7f35a9391640 1 --2- 172.21.15.79:0/556238309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603277d4150 0x5603277e5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:50.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.034+0000 7f35a9391640 1 -- 172.21.15.79:0/556238309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603277f4a20 con 0x5603277d3830 2024-08-20T01:45:50.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.035+0000 7f35a9391640 1 --2- 172.21.15.79:0/556238309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603277d3830 0x5603277e8220 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f35a00c6800 tx=0x7f35a00ca190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4841cd2f0f05ad4d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:50.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.035+0000 7f358cff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:45:50.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.035+0000 7f358cff9640 1 -- 172.21.15.79:0/556238309 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a0048070 con 0x5603277d3830 2024-08-20T01:45:50.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.035+0000 7f358cff9640 1 -- 172.21.15.79:0/556238309 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f35a00ed2c0 con 0x5603277d3830 2024-08-20T01:45:50.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.036+0000 7f35ad9ee740 1 -- 172.21.15.79:0/556238309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5603276e9100 con 0x5603277d3830 2024-08-20T01:45:50.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.036+0000 7f358cff9640 1 -- 172.21.15.79:0/556238309 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f35a00ca290 con 0x5603277d3830 2024-08-20T01:45:50.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.036+0000 7f35ad9ee740 10 client.26894 fetch_fsmap learned FSMap version 43 2024-08-20T01:45:50.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.036+0000 7f35ad9ee740 1 -- 172.21.15.79:0/556238309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x5603277f71a0 con 0x5603277d3830 2024-08-20T01:45:50.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.036+0000 7f358cff9640 1 -- 172.21.15.79:0/556238309 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5603276e9100 con 0x5603277d3830 2024-08-20T01:45:50.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.036+0000 7f358cff9640 1 -- 172.21.15.79:0/556238309 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 43) ==== 8394+0+0 (secure 0 0 0) 0x7f35a004b060 con 0x5603277d3830 2024-08-20T01:45:50.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.037+0000 7f35ad9ee740 10 client.26894 fetch_fsmap finished waiting for FSMap version 43 2024-08-20T01:45:50.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.037+0000 7f35ad9ee740 10 client.26894 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:45:50.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.037+0000 7f35ad9ee740 20 client.26894 populate_metadata read hostname 'smithi079' 2024-08-20T01:45:50.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.037+0000 7f35ad9ee740 1 --2- 172.21.15.79:0/556238309 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5603277f88a0 0x5603277face0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:50.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.037+0000 7f35ad9ee740 4 client.26894 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:45:50.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.037+0000 7f35ad9ee740 1 -- 172.21.15.79:0/556238309 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56032774c830 con 0x5603277f88a0 2024-08-20T01:45:50.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.039+0000 7f35a8b90640 1 --2- 172.21.15.79:0/556238309 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5603277f88a0 0x5603277face0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:50.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.039+0000 7f358cff9640 10 client.26894 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:45:50.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.040+0000 7f35a8b90640 1 --2- 172.21.15.79:0/556238309 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5603277f88a0 0x5603277face0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c46194a2b35e4b2 server_cookie=f4a685caee9d5ac4 in_seq=0 out_seq=0 2024-08-20T01:45:50.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.041+0000 7f358cff9640 1 -- 172.21.15.79:0/556238309 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56032774c830 con 0x5603277f88a0 2024-08-20T01:45:50.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.041+0000 7f358cff9640 10 client.26894 handle_command_reply: tid=0 2024-08-20T01:45:50.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.041+0000 7f35ad9ee740 1 client.26894 shutdown 2024-08-20T01:45:50.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.041+0000 7f35ad9ee740 1 -- 172.21.15.79:0/556238309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603277d3830 msgr2=0x5603277e8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:50.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.041+0000 7f35ad9ee740 1 --2- 172.21.15.79:0/556238309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603277d3830 0x5603277e8220 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f35a00c6800 tx=0x7f35a00ca190 comp rx=0 tx=0).stop 2024-08-20T01:45:50.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.041+0000 7f35ad9ee740 1 -- 172.21.15.79:0/556238309 shutdown_connections 2024-08-20T01:45:50.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.041+0000 7f35ad9ee740 1 --2- 172.21.15.79:0/556238309 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5603277f88a0 0x5603277face0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:50.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.041+0000 7f35ad9ee740 1 --2- 172.21.15.79:0/556238309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603277e88f0 0x5603277e5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:50.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.041+0000 7f35ad9ee740 1 --2- 172.21.15.79:0/556238309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603277d4150 0x5603277e5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:50.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.041+0000 7f35ad9ee740 1 --2- 172.21.15.79:0/556238309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603277d3830 0x5603277e8220 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:50.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.041+0000 7f35ad9ee740 1 -- 172.21.15.79:0/556238309 >> 172.21.15.79:0/556238309 conn(0x5603277d1660 msgr2=0x5603277d7190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:50.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.041+0000 7f358cff9640 0 client.26894 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:45:50.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.042+0000 7f35ad9ee740 1 -- 172.21.15.79:0/556238309 shutdown_connections 2024-08-20T01:45:50.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.042+0000 7f35ad9ee740 1 -- 172.21.15.79:0/556238309 wait complete. 2024-08-20T01:45:50.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.042+0000 7f35ad9ee740 20 client.26894 trim_cache size 0 max 16384 2024-08-20T01:45:50.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.075+0000 7f35ad9ee740 1 Processor -- start 2024-08-20T01:45:50.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.075+0000 7f35ad9ee740 1 -- start start 2024-08-20T01:45:50.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.075+0000 7f35ad9ee740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603277d3830 0x5603277e3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:50.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.075+0000 7f35ad9ee740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603277d4150 0x5603277e4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:50.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.076+0000 7f35ad9ee740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603277e88f0 0x5603277d2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:50.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.076+0000 7f35ad9ee740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f35a41abe10 con 0x5603277e88f0 2024-08-20T01:45:50.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.076+0000 7f35ad9ee740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f35a41adad0 con 0x5603277d4150 2024-08-20T01:45:50.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.076+0000 7f35ad9ee740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f35a41ac4e0 con 0x5603277d3830 2024-08-20T01:45:50.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.076+0000 7f35a8b90640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603277d4150 0x5603277e4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:50.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.076+0000 7f35a8b90640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603277d4150 0x5603277e4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:48128/0 (socket says 172.21.15.79:48128) 2024-08-20T01:45:50.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.076+0000 7f35a8b90640 1 -- 172.21.15.79:0/1956655760 learned_addr learned my addr 172.21.15.79:0/1956655760 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:50.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.076+0000 7f35a9391640 1 --2- 172.21.15.79:0/1956655760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603277d3830 0x5603277e3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:50.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.076+0000 7f35a9b92640 1 --2- 172.21.15.79:0/1956655760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603277e88f0 0x5603277d2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:50.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.076+0000 7f35a8b90640 1 -- 172.21.15.79:0/1956655760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603277d3830 msgr2=0x5603277e3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:50.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.076+0000 7f35a8b90640 1 --2- 172.21.15.79:0/1956655760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603277d3830 0x5603277e3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:50.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.076+0000 7f35a8b90640 1 -- 172.21.15.79:0/1956655760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603277e88f0 msgr2=0x5603277d2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:50.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.076+0000 7f35a8b90640 1 --2- 172.21.15.79:0/1956655760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603277e88f0 0x5603277d2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:50.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.076+0000 7f35a8b90640 1 -- 172.21.15.79:0/1956655760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603277e6060 con 0x5603277d4150 2024-08-20T01:45:50.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.076+0000 7f35a9391640 1 --2- 172.21.15.79:0/1956655760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603277d3830 0x5603277e3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:45:50.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.076+0000 7f35a8b90640 1 --2- 172.21.15.79:0/1956655760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603277d4150 0x5603277e4450 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f359400f010 tx=0x7f359400f040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2602143e0cf6c19 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:50.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.077+0000 7f358effd640 1 -- 172.21.15.79:0/1956655760 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3594013480 con 0x5603277d4150 2024-08-20T01:45:50.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.077+0000 7f358effd640 1 -- 172.21.15.79:0/1956655760 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3594018040 con 0x5603277d4150 2024-08-20T01:45:50.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.077+0000 7f358effd640 1 -- 172.21.15.79:0/1956655760 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3594027410 con 0x5603277d4150 2024-08-20T01:45:50.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.078+0000 7f35ad9ee740 1 -- 172.21.15.79:0/1956655760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603277d4150 msgr2=0x5603277e4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:50.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.078+0000 7f35ad9ee740 1 --2- 172.21.15.79:0/1956655760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603277d4150 0x5603277e4450 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f359400f010 tx=0x7f359400f040 comp rx=0 tx=0).stop 2024-08-20T01:45:50.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.078+0000 7f35ad9ee740 1 -- 172.21.15.79:0/1956655760 shutdown_connections 2024-08-20T01:45:50.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.078+0000 7f35ad9ee740 1 --2- 172.21.15.79:0/1956655760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603277e88f0 0x5603277d2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:50.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.078+0000 7f35ad9ee740 1 --2- 172.21.15.79:0/1956655760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603277d4150 0x5603277e4450 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:50.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.078+0000 7f35ad9ee740 1 --2- 172.21.15.79:0/1956655760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603277d3830 0x5603277e3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:50.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.078+0000 7f35ad9ee740 1 -- 172.21.15.79:0/1956655760 >> 172.21.15.79:0/1956655760 conn(0x5603277d1660 msgr2=0x5603277e9780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:50.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.078+0000 7f35ad9ee740 1 -- 172.21.15.79:0/1956655760 shutdown_connections 2024-08-20T01:45:50.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.078+0000 7f35ad9ee740 1 -- 172.21.15.79:0/1956655760 wait complete. 2024-08-20T01:45:50.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.079+0000 7f35ad9ee740 1 -- start start 2024-08-20T01:45:50.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.079+0000 7f35ad9ee740 1 Processor -- start 2024-08-20T01:45:50.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.080+0000 7f35ad9ee740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603277d3830 0x5603277f0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:50.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.080+0000 7f35ad9ee740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603277d4150 0x5603277f0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:50.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.080+0000 7f35a9391640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603277d3830 0x5603277f0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:50.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.080+0000 7f35a9391640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603277d3830 0x5603277f0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45764/0 (socket says 172.21.15.79:45764) 2024-08-20T01:45:50.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.080+0000 7f35a9391640 1 -- 172.21.15.79:0/3110322904 learned_addr learned my addr 172.21.15.79:0/3110322904 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:50.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.080+0000 7f35ad9ee740 1 --2- 172.21.15.79:0/3110322904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603277e88f0 0x5603277ff5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:50.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.080+0000 7f35a8b90640 1 --2- 172.21.15.79:0/3110322904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603277d4150 0x5603277f0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:50.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.080+0000 7f35ad9ee740 1 -- 172.21.15.79:0/3110322904 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f35a41ad340 con 0x5603277d3830 2024-08-20T01:45:50.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.080+0000 7f35ad9ee740 1 -- 172.21.15.79:0/3110322904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f35a41acbb0 con 0x5603277e88f0 2024-08-20T01:45:50.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.080+0000 7f35a9b92640 1 --2- 172.21.15.79:0/3110322904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603277e88f0 0x5603277ff5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:50.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.081+0000 7f35ad9ee740 1 -- 172.21.15.79:0/3110322904 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f35a41a9e10 con 0x5603277d4150 2024-08-20T01:45:50.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.081+0000 7f35ad9ee740 10 client.0 _ll_register_callbacks cb 0x7f35a0005670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:45:50.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.081+0000 7f35a8b90640 1 -- 172.21.15.79:0/3110322904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603277e88f0 msgr2=0x5603277ff5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:50.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.081+0000 7f35a8b90640 1 --2- 172.21.15.79:0/3110322904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603277e88f0 0x5603277ff5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:50.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.081+0000 7f35a8b90640 1 -- 172.21.15.79:0/3110322904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603277d3830 msgr2=0x5603277f0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:50.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.081+0000 7f35a8b90640 1 --2- 172.21.15.79:0/3110322904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603277d3830 0x5603277f0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:50.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.081+0000 7f35a8b90640 1 -- 172.21.15.79:0/3110322904 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560327801140 con 0x5603277d4150 2024-08-20T01:45:50.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.082+0000 7f35a8b90640 1 --2- 172.21.15.79:0/3110322904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603277d4150 0x5603277f0ec0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x5603276e9280 tx=0x7f35940136b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af8b0cf265d496da server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:50.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.082+0000 7f358cff9640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:45:50.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.082+0000 7f358cff9640 1 -- 172.21.15.79:0/3110322904 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3594036060 con 0x5603277d4150 2024-08-20T01:45:50.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.082+0000 7f358cff9640 1 -- 172.21.15.79:0/3110322904 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f359400d950 con 0x5603277d4150 2024-08-20T01:45:50.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.082+0000 7f35ad9ee740 1 -- 172.21.15.79:0/3110322904 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3594018040 con 0x5603277d4150 2024-08-20T01:45:50.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.083+0000 7f358cff9640 1 -- 172.21.15.79:0/3110322904 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f359400dbd0 con 0x5603277d4150 2024-08-20T01:45:50.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.083+0000 7f35ad9ee740 10 client.26878 fetch_fsmap learned FSMap version 43 2024-08-20T01:45:50.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.083+0000 7f35ad9ee740 1 -- 172.21.15.79:0/3110322904 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x560327862ae0 con 0x5603277d4150 2024-08-20T01:45:50.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.083+0000 7f358cff9640 1 -- 172.21.15.79:0/3110322904 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f359400dd70 con 0x5603277d4150 2024-08-20T01:45:50.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.083+0000 7f358cff9640 1 -- 172.21.15.79:0/3110322904 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 43) ==== 8394+0+0 (secure 0 0 0) 0x7f3594031460 con 0x5603277d4150 2024-08-20T01:45:50.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.083+0000 7f35ad9ee740 10 client.26878 fetch_fsmap finished waiting for FSMap version 43 2024-08-20T01:45:50.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.083+0000 7f35ad9ee740 10 client.26878 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:45:50.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.083+0000 7f35ad9ee740 20 client.26878 populate_metadata read hostname 'smithi079' 2024-08-20T01:45:50.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.083+0000 7f35ad9ee740 1 --2- 172.21.15.79:0/3110322904 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560327862f60 0x560327865380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:50.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.083+0000 7f35ad9ee740 4 client.26878 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:45:50.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.083+0000 7f35ad9ee740 1 -- 172.21.15.79:0/3110322904 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f3594018040 con 0x560327862f60 2024-08-20T01:45:50.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.084+0000 7f35a9391640 1 --2- 172.21.15.79:0/3110322904 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560327862f60 0x560327865380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:50.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.084+0000 7f358cff9640 10 client.26878 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:45:50.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.084+0000 7f35a9391640 1 --2- 172.21.15.79:0/3110322904 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560327862f60 0x560327865380 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17d2df174b1ddd62 server_cookie=53f6f889a69390f8 in_seq=0 out_seq=0 2024-08-20T01:45:50.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.085+0000 7f358cff9640 1 -- 172.21.15.79:0/3110322904 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f3594018040 con 0x560327862f60 2024-08-20T01:45:50.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.085+0000 7f358cff9640 10 client.26878 handle_command_reply: tid=0 2024-08-20T01:45:50.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.085+0000 7f35ad9ee740 1 client.26878 shutdown 2024-08-20T01:45:50.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.085+0000 7f35ad9ee740 1 -- 172.21.15.79:0/3110322904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603277d4150 msgr2=0x5603277f0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:50.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.086+0000 7f35ad9ee740 1 --2- 172.21.15.79:0/3110322904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603277d4150 0x5603277f0ec0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x5603276e9280 tx=0x7f35940136b0 comp rx=0 tx=0).stop 2024-08-20T01:45:50.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.086+0000 7f35ad9ee740 1 -- 172.21.15.79:0/3110322904 shutdown_connections 2024-08-20T01:45:50.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.086+0000 7f35ad9ee740 1 --2- 172.21.15.79:0/3110322904 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560327862f60 0x560327865380 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:50.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.086+0000 7f35ad9ee740 1 --2- 172.21.15.79:0/3110322904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5603277e88f0 0x5603277ff5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:50.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.086+0000 7f358cff9640 0 client.26878 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:45:50.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.086+0000 7f35ad9ee740 1 --2- 172.21.15.79:0/3110322904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5603277d4150 0x5603277f0ec0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:50.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.086+0000 7f35ad9ee740 1 --2- 172.21.15.79:0/3110322904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603277d3830 0x5603277f0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:50.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.086+0000 7f35ad9ee740 1 -- 172.21.15.79:0/3110322904 >> 172.21.15.79:0/3110322904 conn(0x5603277d1660 msgr2=0x5603277e3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:50.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.087+0000 7f35ad9ee740 1 -- 172.21.15.79:0/3110322904 shutdown_connections 2024-08-20T01:45:50.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.087+0000 7f35ad9ee740 1 -- 172.21.15.79:0/3110322904 wait complete. 2024-08-20T01:45:50.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.087+0000 7f35ad9ee740 20 client.26878 trim_cache size 0 max 16384 2024-08-20T01:45:50.091 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:45:50.091 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-08-20T01:45:50.091 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-08-20T01:45:50.091 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:45:50.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.088+0000 7f35ab5f5640 1 -- 172.21.15.79:0/2382465950 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f35900b3da0 msgr2=0x7f35900b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:50.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.088+0000 7f35ab5f5640 1 --2- 172.21.15.79:0/2382465950 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f35900b3da0 0x7f35900b6260 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f359c009270 tx=0x7f359c009680 comp rx=0 tx=0).stop 2024-08-20T01:45:50.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.088+0000 7f35ab5f5640 1 -- 172.21.15.79:0/2382465950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35a4101590 msgr2=0x7f35a419b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:50.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.088+0000 7f35ab5f5640 1 --2- 172.21.15.79:0/2382465950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35a4101590 0x7f35a419b190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f35a002ba30 tx=0x7f35a00050f0 comp rx=0 tx=0).stop 2024-08-20T01:45:50.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.088+0000 7f35ab5f5640 1 -- 172.21.15.79:0/2382465950 shutdown_connections 2024-08-20T01:45:50.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.088+0000 7f35ab5f5640 1 --2- 172.21.15.79:0/2382465950 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35a4104290 0x7f35a41a0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:50.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.088+0000 7f35ab5f5640 1 --2- 172.21.15.79:0/2382465950 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f35900b3da0 0x7f35900b6260 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:50.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.088+0000 7f35ab5f5640 1 --2- 172.21.15.79:0/2382465950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35a41038f0 0x7f35a419b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:50.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.088+0000 7f35ab5f5640 1 --2- 172.21.15.79:0/2382465950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35a4101590 0x7f35a419b190 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:50.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.088+0000 7f35ab5f5640 1 -- 172.21.15.79:0/2382465950 >> 172.21.15.79:0/2382465950 conn(0x7f35a4076bd0 msgr2=0x7f35a4106d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:50.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.089+0000 7f35ab5f5640 1 -- 172.21.15.79:0/2382465950 shutdown_connections 2024-08-20T01:45:50.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:50.089+0000 7f35ab5f5640 1 -- 172.21.15.79:0/2382465950 wait complete. 2024-08-20T01:45:50.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:50 smithi079 ceph-mon[18656]: pgmap v602: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 29 MiB/s wr, 7.47k op/s 2024-08-20T01:45:50.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:50 smithi081 ceph-mon[22209]: pgmap v602: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 29 MiB/s wr, 7.47k op/s 2024-08-20T01:45:50.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:50 smithi175 ceph-mon[22392]: pgmap v602: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 29 MiB/s wr, 7.47k op/s 2024-08-20T01:45:51.136 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T01:45:51.136 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:45:51.584 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:45:52.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:52 smithi081 ceph-mon[22209]: pgmap v603: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 28 MiB/s wr, 7.13k op/s 2024-08-20T01:45:52.285 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:52 smithi079 ceph-mon[18656]: pgmap v603: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 28 MiB/s wr, 7.13k op/s 2024-08-20T01:45:52.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:52 smithi175 ceph-mon[22392]: pgmap v603: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 28 MiB/s wr, 7.13k op/s 2024-08-20T01:45:52.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:52.595+0000 7fac560af640 1 -- 172.21.15.79:0/3806724285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac5010a490 msgr2=0x7fac5010c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:52.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:52.595+0000 7fac560af640 1 --2- 172.21.15.79:0/3806724285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac5010a490 0x7fac5010c880 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fac40009900 tx=0x7fac4002a400 comp rx=0 tx=0).stop 2024-08-20T01:45:52.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:52.596+0000 7fac560af640 1 -- 172.21.15.79:0/3806724285 shutdown_connections 2024-08-20T01:45:52.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:52.596+0000 7fac560af640 1 --2- 172.21.15.79:0/3806724285 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac5010cdc0 0x7fac5010f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:52.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:52.596+0000 7fac560af640 1 --2- 172.21.15.79:0/3806724285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac5010a490 0x7fac5010c880 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:52.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:52.596+0000 7fac560af640 1 --2- 172.21.15.79:0/3806724285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac50101380 0x7fac50101760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:52.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:52.596+0000 7fac560af640 1 -- 172.21.15.79:0/3806724285 >> 172.21.15.79:0/3806724285 conn(0x7fac50078d70 msgr2=0x7fac50079180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:52.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:52.596+0000 7fac560af640 1 -- 172.21.15.79:0/3806724285 shutdown_connections 2024-08-20T01:45:52.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:52.596+0000 7fac560af640 1 -- 172.21.15.79:0/3806724285 wait complete. 2024-08-20T01:45:52.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:52.597+0000 7fac560af640 1 Processor -- start 2024-08-20T01:45:52.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:52.597+0000 7fac560af640 1 -- start start 2024-08-20T01:45:52.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:52.597+0000 7fac560af640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac50101380 0x7fac50104560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:52.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:52.597+0000 7fac560af640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac5010a490 0x7fac50104aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:52.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:52.597+0000 7fac560af640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac5010cdc0 0x7fac50104fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:52.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:52.597+0000 7fac560af640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fac501127c0 con 0x7fac50101380 2024-08-20T01:45:52.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:52.597+0000 7fac560af640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fac50112640 con 0x7fac5010cdc0 2024-08-20T01:45:52.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:52.597+0000 7fac560af640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fac50112940 con 0x7fac5010a490 2024-08-20T01:45:52.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:52.598+0000 7fac548ac640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac5010a490 0x7fac50104aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:52.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:52.598+0000 7fac550ad640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac50101380 0x7fac50104560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:52.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:52.598+0000 7fac548ac640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac5010a490 0x7fac50104aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:59950/0 (socket says 172.21.15.79:59950) 2024-08-20T01:45:52.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:52.598+0000 7fac548ac640 1 -- 172.21.15.79:0/3930410298 learned_addr learned my addr 172.21.15.79:0/3930410298 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:52.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:52.598+0000 7fac558ae640 1 --2- 172.21.15.79:0/3930410298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac5010cdc0 0x7fac50104fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:52.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:52.598+0000 7fac548ac640 1 -- 172.21.15.79:0/3930410298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac5010cdc0 msgr2=0x7fac50104fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:52.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:52.598+0000 7fac548ac640 1 --2- 172.21.15.79:0/3930410298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac5010cdc0 0x7fac50104fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:52.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:52.598+0000 7fac548ac640 1 -- 172.21.15.79:0/3930410298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac50101380 msgr2=0x7fac50104560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:52.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:52.598+0000 7fac548ac640 1 --2- 172.21.15.79:0/3930410298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac50101380 0x7fac50104560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:52.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:52.598+0000 7fac548ac640 1 -- 172.21.15.79:0/3930410298 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac501ab430 con 0x7fac5010a490 2024-08-20T01:45:52.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:52.598+0000 7fac548ac640 1 --2- 172.21.15.79:0/3930410298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac5010a490 0x7fac50104aa0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fac4002a920 tx=0x7fac40003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:52.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:52.598+0000 7fac467fc640 1 -- 172.21.15.79:0/3930410298 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4003f070 con 0x7fac5010a490 2024-08-20T01:45:52.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:52.599+0000 7fac467fc640 1 -- 172.21.15.79:0/3930410298 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fac4003baf0 con 0x7fac5010a490 2024-08-20T01:45:52.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:52.599+0000 7fac467fc640 1 -- 172.21.15.79:0/3930410298 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac40035030 con 0x7fac5010a490 2024-08-20T01:45:52.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:52.599+0000 7fac560af640 1 -- 172.21.15.79:0/3930410298 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac501ab6c0 con 0x7fac5010a490 2024-08-20T01:45:52.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:52.599+0000 7fac560af640 1 -- 172.21.15.79:0/3930410298 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac501abb50 con 0x7fac5010a490 2024-08-20T01:45:52.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:52.600+0000 7fac560af640 1 -- 172.21.15.79:0/3930410298 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac5006a950 con 0x7fac5010a490 2024-08-20T01:45:52.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:52.603+0000 7fac467fc640 1 -- 172.21.15.79:0/3930410298 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fac40042070 con 0x7fac5010a490 2024-08-20T01:45:52.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:52.604+0000 7fac467fc640 1 --2- 172.21.15.79:0/3930410298 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fac3c0b3cf0 0x7fac3c0b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:52.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:52.604+0000 7fac550ad640 1 --2- 172.21.15.79:0/3930410298 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fac3c0b3cf0 0x7fac3c0b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:52.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:52.605+0000 7fac467fc640 1 -- 172.21.15.79:0/3930410298 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fac40104540 con 0x7fac5010a490 2024-08-20T01:45:52.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:52.605+0000 7fac550ad640 1 --2- 172.21.15.79:0/3930410298 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fac3c0b3cf0 0x7fac3c0b61b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fac4c009bd0 tx=0x7fac4c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:52.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:52.607+0000 7fac467fc640 1 -- 172.21.15.79:0/3930410298 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fac400cb550 con 0x7fac5010a490 2024-08-20T01:45:53.027 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:53.024+0000 7fac560af640 1 -- 172.21.15.79:0/3930410298 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fac50105860 con 0x7fac5010a490 2024-08-20T01:45:53.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:53.026+0000 7fac467fc640 1 -- 172.21.15.79:0/3930410298 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+11987 (secure 0 0 0) 0x7fac400d2e20 con 0x7fac5010a490 2024-08-20T01:45:53.030 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:45:53.030 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":43,"btime":"2024-08-20T01:45:35:966440+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14670,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/735082912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":735082912},{"type":"v1","addr":"172.21.15.79:6835","nonce":735082912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2150339873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2150339873},{"type":"v1","addr":"172.21.15.79:6837","nonce":2150339873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":43,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:34:55.133562+0000","modified":"2024-08-20T01:45:35.898679+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24539,"mds_1":24538,"mds_2":24523,"mds_3":24514,"mds_4":24512},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14724":{"gid":14724,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/1071242274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1071242274},{"type":"v1","addr":"172.21.15.79:6839","nonce":1071242274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14730":{"gid":14730,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6841/2448977611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":2448977611},{"type":"v1","addr":"172.21.15.79:6841","nonce":2448977611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/1257507005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1257507005},{"type":"v1","addr":"172.21.15.81:6833","nonce":1257507005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1499936216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1499936216},{"type":"v1","addr":"172.21.15.81:6835","nonce":1499936216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/1107229215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1107229215},{"type":"v1","addr":"172.21.15.175:6833","nonce":1107229215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6837/2073598870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2073598870},{"type":"v1","addr":"172.21.15.81:6837","nonce":2073598870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/2552601173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2552601173},{"type":"v1","addr":"172.21.15.175:6835","nonce":2552601173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6837/1767284089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1767284089},{"type":"v1","addr":"172.21.15.175:6837","nonce":1767284089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/1331748742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1331748742},{"type":"v1","addr":"172.21.15.175:6839","nonce":1331748742}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/4098410583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":4098410583},{"type":"v1","addr":"172.21.15.81:6839","nonce":4098410583}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24539,"qdb_cluster":[24539,24523,24514,24538,24512]},"id":1}]} 2024-08-20T01:45:53.031 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 43 2024-08-20T01:45:53.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:53.031+0000 7fac560af640 1 -- 172.21.15.79:0/3930410298 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fac3c0b3cf0 msgr2=0x7fac3c0b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:53.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:53.031+0000 7fac560af640 1 --2- 172.21.15.79:0/3930410298 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fac3c0b3cf0 0x7fac3c0b61b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fac4c009bd0 tx=0x7fac4c005f90 comp rx=0 tx=0).stop 2024-08-20T01:45:53.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:53.031+0000 7fac560af640 1 -- 172.21.15.79:0/3930410298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac5010a490 msgr2=0x7fac50104aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:53.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:53.031+0000 7fac560af640 1 --2- 172.21.15.79:0/3930410298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac5010a490 0x7fac50104aa0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fac4002a920 tx=0x7fac40003b90 comp rx=0 tx=0).stop 2024-08-20T01:45:53.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:53.031+0000 7fac560af640 1 -- 172.21.15.79:0/3930410298 shutdown_connections 2024-08-20T01:45:53.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:53.031+0000 7fac560af640 1 --2- 172.21.15.79:0/3930410298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac5010cdc0 0x7fac50104fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:53.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:53.031+0000 7fac560af640 1 --2- 172.21.15.79:0/3930410298 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fac3c0b3cf0 0x7fac3c0b61b0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:53.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:53.031+0000 7fac560af640 1 --2- 172.21.15.79:0/3930410298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac5010a490 0x7fac50104aa0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:53.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:53.031+0000 7fac560af640 1 --2- 172.21.15.79:0/3930410298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac50101380 0x7fac50104560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:53.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:53.031+0000 7fac560af640 1 -- 172.21.15.79:0/3930410298 >> 172.21.15.79:0/3930410298 conn(0x7fac50078d70 msgr2=0x7fac50108850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:53.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:53.032+0000 7fac560af640 1 -- 172.21.15.79:0/3930410298 shutdown_connections 2024-08-20T01:45:53.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:53.032+0000 7fac560af640 1 -- 172.21.15.79:0/3930410298 wait complete. 2024-08-20T01:45:53.814 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-20T01:45:54.027 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:54 smithi079 ceph-mon[18656]: pgmap v604: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 27 MiB/s wr, 6.79k op/s 2024-08-20T01:45:54.252 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:45:54.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:54 smithi081 ceph-mon[22209]: pgmap v604: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 27 MiB/s wr, 6.79k op/s 2024-08-20T01:45:54.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:54 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/3930410298' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:45:54.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:54 smithi175 ceph-mon[22392]: pgmap v604: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 27 MiB/s wr, 6.79k op/s 2024-08-20T01:45:54.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:54 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/3930410298' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:45:54.391 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:54 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/3930410298' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:45:54.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.873+0000 7fcf78b0b640 1 -- 172.21.15.79:0/42373753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf74107d60 msgr2=0x7fcf7410e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:54.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.874+0000 7fcf78b0b640 1 --2- 172.21.15.79:0/42373753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf74107d60 0x7fcf7410e560 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c009ca0 tx=0x7fcf6c02a8c0 comp rx=0 tx=0).stop 2024-08-20T01:45:54.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.874+0000 7fcf78b0b640 1 -- 172.21.15.79:0/42373753 shutdown_connections 2024-08-20T01:45:54.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.874+0000 7fcf78b0b640 1 --2- 172.21.15.79:0/42373753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf74107d60 0x7fcf7410e560 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:54.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.874+0000 7fcf78b0b640 1 --2- 172.21.15.79:0/42373753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf741073e0 0x7fcf74107820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:54.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.874+0000 7fcf78b0b640 1 --2- 172.21.15.79:0/42373753 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf741019d0 0x7fcf74101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:54.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.874+0000 7fcf78b0b640 1 -- 172.21.15.79:0/42373753 >> 172.21.15.79:0/42373753 conn(0x7fcf740fd460 msgr2=0x7fcf740ff880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:54.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.874+0000 7fcf78b0b640 1 -- 172.21.15.79:0/42373753 shutdown_connections 2024-08-20T01:45:54.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.874+0000 7fcf78b0b640 1 -- 172.21.15.79:0/42373753 wait complete. 2024-08-20T01:45:54.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.875+0000 7fcf78b0b640 1 Processor -- start 2024-08-20T01:45:54.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.875+0000 7fcf78b0b640 1 -- start start 2024-08-20T01:45:54.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.876+0000 7fcf78b0b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf741019d0 0x7fcf74197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:54.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.876+0000 7fcf78b0b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf741073e0 0x7fcf74198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:54.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.876+0000 7fcf78b0b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf74107d60 0x7fcf7419d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:54.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.876+0000 7fcf78b0b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcf741118e0 con 0x7fcf74107d60 2024-08-20T01:45:54.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.876+0000 7fcf78b0b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcf74111760 con 0x7fcf741019d0 2024-08-20T01:45:54.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.876+0000 7fcf78b0b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcf74111a60 con 0x7fcf741073e0 2024-08-20T01:45:54.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.876+0000 7fcf7259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf741019d0 0x7fcf74197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:54.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.876+0000 7fcf7259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf741019d0 0x7fcf74197d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:51230/0 (socket says 172.21.15.79:51230) 2024-08-20T01:45:54.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.876+0000 7fcf7259c640 1 -- 172.21.15.79:0/556329573 learned_addr learned my addr 172.21.15.79:0/556329573 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:54.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.876+0000 7fcf6bfff640 1 --2- 172.21.15.79:0/556329573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf741073e0 0x7fcf74198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:54.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.876+0000 7fcf72d9d640 1 --2- 172.21.15.79:0/556329573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf74107d60 0x7fcf7419d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:54.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.876+0000 7fcf6bfff640 1 -- 172.21.15.79:0/556329573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf741019d0 msgr2=0x7fcf74197d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:54.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.876+0000 7fcf6bfff640 1 --2- 172.21.15.79:0/556329573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf741019d0 0x7fcf74197d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:54.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.876+0000 7fcf6bfff640 1 -- 172.21.15.79:0/556329573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf74107d60 msgr2=0x7fcf7419d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:54.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.876+0000 7fcf6bfff640 1 --2- 172.21.15.79:0/556329573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf74107d60 0x7fcf7419d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:54.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.876+0000 7fcf6bfff640 1 -- 172.21.15.79:0/556329573 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf7419dde0 con 0x7fcf741073e0 2024-08-20T01:45:54.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.877+0000 7fcf6bfff640 1 --2- 172.21.15.79:0/556329573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf741073e0 0x7fcf74198270 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c00d6d0 tx=0x7fcf5c00db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:54.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.877+0000 7fcf6b7fe640 1 -- 172.21.15.79:0/556329573 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c017070 con 0x7fcf741073e0 2024-08-20T01:45:54.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.877+0000 7fcf6b7fe640 1 -- 172.21.15.79:0/556329573 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf5c009820 con 0x7fcf741073e0 2024-08-20T01:45:54.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.877+0000 7fcf78b0b640 1 -- 172.21.15.79:0/556329573 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf7419e0d0 con 0x7fcf741073e0 2024-08-20T01:45:54.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.877+0000 7fcf6b7fe640 1 -- 172.21.15.79:0/556329573 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c004bc0 con 0x7fcf741073e0 2024-08-20T01:45:54.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.877+0000 7fcf78b0b640 1 -- 172.21.15.79:0/556329573 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf7406b1a0 con 0x7fcf741073e0 2024-08-20T01:45:54.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.881+0000 7fcf6b7fe640 1 -- 172.21.15.79:0/556329573 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fcf5c005220 con 0x7fcf741073e0 2024-08-20T01:45:54.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.881+0000 7fcf7af04740 1 Processor -- start 2024-08-20T01:45:54.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.881+0000 7fcf7af04740 1 -- start start 2024-08-20T01:45:54.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.882+0000 7fcf7af04740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f295988730 0x55f295988b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:54.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.882+0000 7fcf7af04740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f295989050 0x55f295994aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:54.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.883+0000 7fcf7259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f295989050 0x55f295994aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:54.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.883+0000 7fcf6b7fe640 1 --2- 172.21.15.79:0/556329573 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fcf600b3c50 0x7fcf600b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:54.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.883+0000 7fcf7259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f295989050 0x55f295994aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53308/0 (socket says 172.21.15.79:53308) 2024-08-20T01:45:54.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.883+0000 7fcf6b7fe640 1 -- 172.21.15.79:0/556329573 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fcf5c0e3610 con 0x7fcf741073e0 2024-08-20T01:45:54.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.883+0000 7fcf72d9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f295988730 0x55f295988b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:54.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.883+0000 7fcf72d9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f295988730 0x55f295988b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:59962/0 (socket says 172.21.15.79:59962) 2024-08-20T01:45:54.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.883+0000 7fcf72d9d640 1 -- 172.21.15.79:0/645682740 learned_addr learned my addr 172.21.15.79:0/645682740 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:54.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.883+0000 7fcf7af04740 1 --2- 172.21.15.79:0/645682740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f295994fe0 0x55f2959973d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:54.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.883+0000 7fcf7af04740 1 -- 172.21.15.79:0/645682740 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f2958ff930 con 0x55f295989050 2024-08-20T01:45:54.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.883+0000 7fcf7af04740 1 -- 172.21.15.79:0/645682740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f2958eee30 con 0x55f295994fe0 2024-08-20T01:45:54.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.883+0000 7fcf7af04740 1 -- 172.21.15.79:0/645682740 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f2958f2e70 con 0x55f295988730 2024-08-20T01:45:54.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.884+0000 7fcf72d9d640 1 --2- 172.21.15.79:0/645682740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f295994fe0 0x55f2959973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:54.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.884+0000 7fcf7259c640 1 -- 172.21.15.79:0/645682740 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f295988730 msgr2=0x55f295988b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:54.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.884+0000 7fcf6bfff640 1 --2- 172.21.15.79:0/556329573 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fcf600b3c50 0x7fcf600b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:54.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.884+0000 7fcf7259c640 1 --2- 172.21.15.79:0/645682740 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f295988730 0x55f295988b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:54.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.884+0000 7fcf7259c640 1 -- 172.21.15.79:0/645682740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f295994fe0 msgr2=0x55f2959973d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:54.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.884+0000 7fcf7259c640 1 --2- 172.21.15.79:0/645682740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f295994fe0 0x55f2959973d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:54.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.884+0000 7fcf7259c640 1 -- 172.21.15.79:0/645682740 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f29564e650 con 0x55f295989050 2024-08-20T01:45:54.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.884+0000 7fcf72d9d640 1 --2- 172.21.15.79:0/645682740 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f295988730 0x55f295988b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:45:54.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.885+0000 7fcf6bfff640 1 --2- 172.21.15.79:0/556329573 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fcf600b3c50 0x7fcf600b6110 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c004770 tx=0x7fcf5c0046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:54.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.885+0000 7fcf7259c640 1 --2- 172.21.15.79:0/645682740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f295989050 0x55f295994aa0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fcf64009d50 tx=0x7fcf64011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfcdedf6924fa475 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:54.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.885+0000 7fcf68ff9640 1 -- 172.21.15.79:0/645682740 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf64005020 con 0x55f295989050 2024-08-20T01:45:54.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.885+0000 7fcf68ff9640 1 -- 172.21.15.79:0/645682740 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf640047a0 con 0x55f295989050 2024-08-20T01:45:54.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.885+0000 7fcf68ff9640 1 -- 172.21.15.79:0/645682740 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf64005650 con 0x55f295989050 2024-08-20T01:45:54.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.886+0000 7fcf7af04740 1 -- 172.21.15.79:0/645682740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f295989050 msgr2=0x55f295994aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:54.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.886+0000 7fcf7af04740 1 --2- 172.21.15.79:0/645682740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f295989050 0x55f295994aa0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fcf64009d50 tx=0x7fcf64011810 comp rx=0 tx=0).stop 2024-08-20T01:45:54.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.886+0000 7fcf7af04740 1 -- 172.21.15.79:0/645682740 shutdown_connections 2024-08-20T01:45:54.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.886+0000 7fcf7af04740 1 --2- 172.21.15.79:0/645682740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f295994fe0 0x55f2959973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:54.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.886+0000 7fcf7af04740 1 --2- 172.21.15.79:0/645682740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f295989050 0x55f295994aa0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:54.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.886+0000 7fcf7af04740 1 --2- 172.21.15.79:0/645682740 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f295988730 0x55f295988b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:54.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.886+0000 7fcf7af04740 1 -- 172.21.15.79:0/645682740 >> 172.21.15.79:0/645682740 conn(0x55f295986560 msgr2=0x55f295987700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:54.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.887+0000 7fcf7af04740 1 -- 172.21.15.79:0/645682740 shutdown_connections 2024-08-20T01:45:54.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.887+0000 7fcf7af04740 1 -- 172.21.15.79:0/645682740 wait complete. 2024-08-20T01:45:54.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.887+0000 7fcf7af04740 1 -- start start 2024-08-20T01:45:54.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.888+0000 7fcf7af04740 1 Processor -- start 2024-08-20T01:45:54.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.888+0000 7fcf7af04740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f295988730 0x55f295992030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:54.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.888+0000 7fcf7af04740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f295989050 0x55f295992570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:54.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.889+0000 7fcf7af04740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f295994fe0 0x55f295992ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:54.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.889+0000 7fcf7259c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f295989050 0x55f295992570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:54.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.889+0000 7fcf72d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f295988730 0x55f295992030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:54.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.889+0000 7fcf72d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f295988730 0x55f295992030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53322/0 (socket says 172.21.15.79:53322) 2024-08-20T01:45:54.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.889+0000 7fcf7259c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f295989050 0x55f295992570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:59966/0 (socket says 172.21.15.79:59966) 2024-08-20T01:45:54.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.889+0000 7fcf72d9d640 1 -- 172.21.15.79:0/606151377 learned_addr learned my addr 172.21.15.79:0/606151377 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:54.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.889+0000 7fcf7af04740 1 -- 172.21.15.79:0/606151377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f295751700 con 0x55f295988730 2024-08-20T01:45:54.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.889+0000 7fcf7af04740 1 -- 172.21.15.79:0/606151377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f295875810 con 0x55f295994fe0 2024-08-20T01:45:54.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.889+0000 7fcf7af04740 1 -- 172.21.15.79:0/606151377 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f295997c90 con 0x55f295989050 2024-08-20T01:45:54.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.889+0000 7fcf72d9d640 1 --2- 172.21.15.79:0/606151377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f295994fe0 0x55f295992ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:54.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.890+0000 7fcf72d9d640 1 -- 172.21.15.79:0/606151377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f295989050 msgr2=0x55f295992570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:54.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.890+0000 7fcf72d9d640 1 --2- 172.21.15.79:0/606151377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f295989050 0x55f295992570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:54.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.890+0000 7fcf72d9d640 1 -- 172.21.15.79:0/606151377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f295994fe0 msgr2=0x55f295992ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:54.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.890+0000 7fcf72d9d640 1 --2- 172.21.15.79:0/606151377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f295994fe0 0x55f295992ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:54.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.890+0000 7fcf72d9d640 1 -- 172.21.15.79:0/606151377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2959a10f0 con 0x55f295988730 2024-08-20T01:45:54.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.890+0000 7fcf7af04740 10 client.0 _ll_register_callbacks cb 0x55f2958e8700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:45:54.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.890+0000 7fcf7af04740 1 -- 172.21.15.79:0/606151377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f29589e150 con 0x55f295988730 2024-08-20T01:45:54.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.890+0000 7fcf7259c640 1 --2- 172.21.15.79:0/606151377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f295989050 0x55f295992570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:45:54.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.890+0000 7fcf72d9d640 1 --2- 172.21.15.79:0/606151377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f295988730 0x55f295992030 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c02ade0 tx=0x7fcf6c0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b837f415e2169a83 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:54.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.890+0000 7fcf59ffb640 10 client.17913 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:45:54.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.890+0000 7fcf59ffb640 1 -- 172.21.15.79:0/606151377 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c045040 con 0x55f295988730 2024-08-20T01:45:54.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.891+0000 7fcf59ffb640 1 -- 172.21.15.79:0/606151377 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fcf6c0309d0 con 0x55f295988730 2024-08-20T01:45:54.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.891+0000 7fcf59ffb640 1 -- 172.21.15.79:0/606151377 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fcf6c030bd0 con 0x55f295988730 2024-08-20T01:45:54.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.891+0000 7fcf7af04740 10 client.17913 fetch_fsmap learned FSMap version 43 2024-08-20T01:45:54.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.891+0000 7fcf7af04740 1 -- 172.21.15.79:0/606151377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({fsmap=43}) -- 0x55f2959a7d80 con 0x55f295988730 2024-08-20T01:45:54.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.891+0000 7fcf59ffb640 1 -- 172.21.15.79:0/606151377 <== mon.0 v2:172.21.15.79:3300/0 4 ==== fsmap(e 43) ==== 8394+0+0 (secure 0 0 0) 0x7fcf6c04b030 con 0x55f295988730 2024-08-20T01:45:54.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.892+0000 7fcf7af04740 10 client.17913 fetch_fsmap finished waiting for FSMap version 43 2024-08-20T01:45:54.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.892+0000 7fcf7af04740 10 client.17913 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:45:54.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.892+0000 7fcf7af04740 20 client.17913 populate_metadata read hostname 'smithi079' 2024-08-20T01:45:54.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.892+0000 7fcf7af04740 1 --2- 172.21.15.79:0/606151377 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55f2959a9130 0x55f2959ab580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:54.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.892+0000 7fcf7af04740 4 client.17913 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:45:54.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.892+0000 7fcf7af04740 1 -- 172.21.15.79:0/606151377 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f295901880 con 0x55f2959a9130 2024-08-20T01:45:54.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.892+0000 7fcf7259c640 1 --2- 172.21.15.79:0/606151377 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55f2959a9130 0x55f2959ab580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:54.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.893+0000 7fcf59ffb640 10 client.17913 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:45:54.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.893+0000 7fcf7259c640 1 --2- 172.21.15.79:0/606151377 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55f2959a9130 0x55f2959ab580 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d9b3a3b5dab6e468 server_cookie=45c734e29ba67f25 in_seq=0 out_seq=0 2024-08-20T01:45:54.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.893+0000 7fcf59ffb640 1 -- 172.21.15.79:0/606151377 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f295901880 con 0x55f2959a9130 2024-08-20T01:45:54.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.893+0000 7fcf59ffb640 10 client.17913 handle_command_reply: tid=0 2024-08-20T01:45:54.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.894+0000 7fcf7af04740 1 client.17913 shutdown 2024-08-20T01:45:54.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.894+0000 7fcf7af04740 1 -- 172.21.15.79:0/606151377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f295988730 msgr2=0x55f295992030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:54.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.894+0000 7fcf7af04740 1 --2- 172.21.15.79:0/606151377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f295988730 0x55f295992030 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c02ade0 tx=0x7fcf6c0095c0 comp rx=0 tx=0).stop 2024-08-20T01:45:54.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.894+0000 7fcf7af04740 1 -- 172.21.15.79:0/606151377 shutdown_connections 2024-08-20T01:45:54.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.894+0000 7fcf7af04740 1 --2- 172.21.15.79:0/606151377 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55f2959a9130 0x55f2959ab580 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:54.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.894+0000 7fcf7af04740 1 --2- 172.21.15.79:0/606151377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f295994fe0 0x55f295992ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:54.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.894+0000 7fcf59ffb640 0 client.17913 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:45:54.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.894+0000 7fcf7af04740 1 --2- 172.21.15.79:0/606151377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f295989050 0x55f295992570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:54.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.894+0000 7fcf7af04740 1 --2- 172.21.15.79:0/606151377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f295988730 0x55f295992030 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:54.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.894+0000 7fcf7af04740 1 -- 172.21.15.79:0/606151377 >> 172.21.15.79:0/606151377 conn(0x55f295986560 msgr2=0x55f29598c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:54.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.894+0000 7fcf7af04740 1 -- 172.21.15.79:0/606151377 shutdown_connections 2024-08-20T01:45:54.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.895+0000 7fcf7af04740 1 -- 172.21.15.79:0/606151377 wait complete. 2024-08-20T01:45:54.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.895+0000 7fcf7af04740 20 client.17913 trim_cache size 0 max 16384 2024-08-20T01:45:54.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.919+0000 7fcf7af04740 1 Processor -- start 2024-08-20T01:45:54.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.920+0000 7fcf7af04740 1 -- start start 2024-08-20T01:45:54.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.920+0000 7fcf7af04740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f295988730 0x55f2959857a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:54.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.920+0000 7fcf7af04740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f295989050 0x55f29598c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:54.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.920+0000 7fcf7af04740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f295994fe0 0x55f2959918c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:54.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.920+0000 7fcf7af04740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcf741abd70 con 0x55f295989050 2024-08-20T01:45:54.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.920+0000 7fcf7af04740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcf741ada30 con 0x55f295988730 2024-08-20T01:45:54.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.920+0000 7fcf7af04740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcf741ac440 con 0x55f295994fe0 2024-08-20T01:45:54.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.921+0000 7fcf72d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f295988730 0x55f2959857a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:54.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.921+0000 7fcf72d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f295988730 0x55f2959857a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:51262/0 (socket says 172.21.15.79:51262) 2024-08-20T01:45:54.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.921+0000 7fcf72d9d640 1 -- 172.21.15.79:0/4163054992 learned_addr learned my addr 172.21.15.79:0/4163054992 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:54.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.921+0000 7fcf72d9d640 1 --2- 172.21.15.79:0/4163054992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f295994fe0 0x55f2959918c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:54.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.921+0000 7fcf7259c640 1 --2- 172.21.15.79:0/4163054992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f295989050 0x55f29598c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:54.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.921+0000 7fcf72d9d640 1 -- 172.21.15.79:0/4163054992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f295994fe0 msgr2=0x55f2959918c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:54.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.921+0000 7fcf72d9d640 1 --2- 172.21.15.79:0/4163054992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f295994fe0 0x55f2959918c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:54.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.921+0000 7fcf72d9d640 1 -- 172.21.15.79:0/4163054992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f295989050 msgr2=0x55f29598c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:54.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.921+0000 7fcf72d9d640 1 --2- 172.21.15.79:0/4163054992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f295989050 0x55f29598c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:54.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.921+0000 7fcf72d9d640 1 -- 172.21.15.79:0/4163054992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f295986fe0 con 0x55f295988730 2024-08-20T01:45:54.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.921+0000 7fcf72d9d640 1 --2- 172.21.15.79:0/4163054992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f295988730 0x55f2959857a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c002230 tx=0x7fcf6c03e070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a473f0baddcd115 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:54.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.922+0000 7fcf5bfff640 1 -- 172.21.15.79:0/4163054992 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c05e040 con 0x55f295988730 2024-08-20T01:45:54.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.922+0000 7fcf5bfff640 1 -- 172.21.15.79:0/4163054992 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55f29589e150 con 0x55f295988730 2024-08-20T01:45:54.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.922+0000 7fcf5bfff640 1 -- 172.21.15.79:0/4163054992 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c047320 con 0x55f295988730 2024-08-20T01:45:54.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.923+0000 7fcf7af04740 1 -- 172.21.15.79:0/4163054992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f295988730 msgr2=0x55f2959857a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:54.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.923+0000 7fcf7af04740 1 --2- 172.21.15.79:0/4163054992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f295988730 0x55f2959857a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c002230 tx=0x7fcf6c03e070 comp rx=0 tx=0).stop 2024-08-20T01:45:54.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.923+0000 7fcf7af04740 1 -- 172.21.15.79:0/4163054992 shutdown_connections 2024-08-20T01:45:54.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.923+0000 7fcf7af04740 1 --2- 172.21.15.79:0/4163054992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f295994fe0 0x55f2959918c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:54.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.923+0000 7fcf7af04740 1 --2- 172.21.15.79:0/4163054992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f295989050 0x55f29598c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:54.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.923+0000 7fcf7af04740 1 --2- 172.21.15.79:0/4163054992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f295988730 0x55f2959857a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:54.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.923+0000 7fcf7af04740 1 -- 172.21.15.79:0/4163054992 >> 172.21.15.79:0/4163054992 conn(0x55f295986560 msgr2=0x55f295993e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:54.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.924+0000 7fcf7af04740 1 -- 172.21.15.79:0/4163054992 shutdown_connections 2024-08-20T01:45:54.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.924+0000 7fcf7af04740 1 -- 172.21.15.79:0/4163054992 wait complete. 2024-08-20T01:45:54.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.925+0000 7fcf7af04740 1 -- start start 2024-08-20T01:45:54.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.925+0000 7fcf7af04740 1 Processor -- start 2024-08-20T01:45:54.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.925+0000 7fcf7af04740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f295988730 0x55f29599d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:54.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.925+0000 7fcf7af04740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f295989050 0x55f295998840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:54.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.925+0000 7fcf7af04740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f295994fe0 0x55f295998d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:54.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.925+0000 7fcf7af04740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcf741ad2a0 con 0x55f295994fe0 2024-08-20T01:45:54.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.925+0000 7fcf7af04740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcf741acb10 con 0x55f295988730 2024-08-20T01:45:54.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.925+0000 7fcf7af04740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcf741a9d50 con 0x55f295989050 2024-08-20T01:45:54.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.926+0000 7fcf7af04740 10 client.0 _ll_register_callbacks cb 0x7fcf6c003970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:45:54.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.926+0000 7fcf7259c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f295989050 0x55f295998840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:54.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.926+0000 7fcf7259c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f295989050 0x55f295998840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:59972/0 (socket says 172.21.15.79:59972) 2024-08-20T01:45:54.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.926+0000 7fcf7259c640 1 -- 172.21.15.79:0/502818114 learned_addr learned my addr 172.21.15.79:0/502818114 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:54.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.926+0000 7fcf72d9d640 1 --2- 172.21.15.79:0/502818114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f295988730 0x55f29599d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:54.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.926+0000 7fcf72d9d640 1 --2- 172.21.15.79:0/502818114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f295994fe0 0x55f295998d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:54.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.926+0000 7fcf7259c640 1 -- 172.21.15.79:0/502818114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f295988730 msgr2=0x55f29599d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:54.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.926+0000 7fcf7259c640 1 --2- 172.21.15.79:0/502818114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f295988730 0x55f29599d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:54.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.926+0000 7fcf7259c640 1 -- 172.21.15.79:0/502818114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f295994fe0 msgr2=0x55f295998d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:54.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.926+0000 7fcf7259c640 1 --2- 172.21.15.79:0/502818114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f295994fe0 0x55f295998d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:54.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.926+0000 7fcf7259c640 1 -- 172.21.15.79:0/502818114 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f295999370 con 0x55f295989050 2024-08-20T01:45:54.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.926+0000 7fcf7259c640 1 --2- 172.21.15.79:0/502818114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f295989050 0x55f295998840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x55f29598b8b0 tx=0x7fcf64009950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5767c5835e45479 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:54.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.926+0000 7fcf59ffb640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:45:54.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.927+0000 7fcf59ffb640 1 -- 172.21.15.79:0/502818114 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf64033060 con 0x55f295989050 2024-08-20T01:45:54.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.927+0000 7fcf59ffb640 1 -- 172.21.15.79:0/502818114 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fcf64016040 con 0x55f295989050 2024-08-20T01:45:54.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.927+0000 7fcf7af04740 1 -- 172.21.15.79:0/502818114 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f29589e150 con 0x55f295989050 2024-08-20T01:45:54.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.927+0000 7fcf59ffb640 1 -- 172.21.15.79:0/502818114 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fcf64009470 con 0x55f295989050 2024-08-20T01:45:54.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.927+0000 7fcf7af04740 10 client.26902 fetch_fsmap learned FSMap version 43 2024-08-20T01:45:54.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.927+0000 7fcf7af04740 1 -- 172.21.15.79:0/502818114 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55f2959a21d0 con 0x55f295989050 2024-08-20T01:45:54.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.928+0000 7fcf59ffb640 1 -- 172.21.15.79:0/502818114 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55f29589e150 con 0x55f295989050 2024-08-20T01:45:54.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.928+0000 7fcf59ffb640 1 -- 172.21.15.79:0/502818114 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 43) ==== 8394+0+0 (secure 0 0 0) 0x7fcf6402d070 con 0x55f295989050 2024-08-20T01:45:54.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.928+0000 7fcf7af04740 10 client.26902 fetch_fsmap finished waiting for FSMap version 43 2024-08-20T01:45:54.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.929+0000 7fcf7af04740 10 client.26902 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:45:54.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.929+0000 7fcf7af04740 20 client.26902 populate_metadata read hostname 'smithi079' 2024-08-20T01:45:54.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.929+0000 7fcf7af04740 1 --2- 172.21.15.79:0/502818114 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55f2959a26e0 0x55f2959a4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:54.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.929+0000 7fcf7af04740 4 client.26902 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:45:54.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.929+0000 7fcf7af04740 1 -- 172.21.15.79:0/502818114 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f2958fd320 con 0x55f2959a26e0 2024-08-20T01:45:54.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.930+0000 7fcf72d9d640 1 --2- 172.21.15.79:0/502818114 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55f2959a26e0 0x55f2959a4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:54.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.930+0000 7fcf59ffb640 10 client.26902 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:45:54.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.930+0000 7fcf72d9d640 1 --2- 172.21.15.79:0/502818114 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55f2959a26e0 0x55f2959a4b00 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ccf475b2d6e80177 server_cookie=b176645e6198220a in_seq=0 out_seq=0 2024-08-20T01:45:54.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.930+0000 7fcf59ffb640 1 -- 172.21.15.79:0/502818114 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f2958fd320 con 0x55f2959a26e0 2024-08-20T01:45:54.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.930+0000 7fcf59ffb640 10 client.26902 handle_command_reply: tid=0 2024-08-20T01:45:54.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.930+0000 7fcf7af04740 1 client.26902 shutdown 2024-08-20T01:45:54.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.931+0000 7fcf7af04740 1 -- 172.21.15.79:0/502818114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f295989050 msgr2=0x55f295998840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:54.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.931+0000 7fcf7af04740 1 --2- 172.21.15.79:0/502818114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f295989050 0x55f295998840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x55f29598b8b0 tx=0x7fcf64009950 comp rx=0 tx=0).stop 2024-08-20T01:45:54.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.931+0000 7fcf7af04740 1 -- 172.21.15.79:0/502818114 shutdown_connections 2024-08-20T01:45:54.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.931+0000 7fcf7af04740 1 --2- 172.21.15.79:0/502818114 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55f2959a26e0 0x55f2959a4b00 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:54.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.931+0000 7fcf7af04740 1 --2- 172.21.15.79:0/502818114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f295994fe0 0x55f295998d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:54.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.931+0000 7fcf59ffb640 0 client.26902 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:45:54.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.931+0000 7fcf7af04740 1 --2- 172.21.15.79:0/502818114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f295989050 0x55f295998840 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:54.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.931+0000 7fcf7af04740 1 --2- 172.21.15.79:0/502818114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f295988730 0x55f29599d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:54.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.931+0000 7fcf7af04740 1 -- 172.21.15.79:0/502818114 >> 172.21.15.79:0/502818114 conn(0x55f295986560 msgr2=0x55f295991f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:54.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.931+0000 7fcf7af04740 1 -- 172.21.15.79:0/502818114 shutdown_connections 2024-08-20T01:45:54.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.931+0000 7fcf7af04740 1 -- 172.21.15.79:0/502818114 wait complete. 2024-08-20T01:45:54.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.931+0000 7fcf7af04740 20 client.26902 trim_cache size 0 max 16384 2024-08-20T01:45:54.936 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:45:54.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.932+0000 7fcf78b0b640 1 -- 172.21.15.79:0/556329573 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fcf600b3c50 msgr2=0x7fcf600b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:54.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.932+0000 7fcf78b0b640 1 --2- 172.21.15.79:0/556329573 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fcf600b3c50 0x7fcf600b6110 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c004770 tx=0x7fcf5c0046c0 comp rx=0 tx=0).stop 2024-08-20T01:45:54.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.932+0000 7fcf78b0b640 1 -- 172.21.15.79:0/556329573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf741073e0 msgr2=0x7fcf74198270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:54.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.932+0000 7fcf78b0b640 1 --2- 172.21.15.79:0/556329573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf741073e0 0x7fcf74198270 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c00d6d0 tx=0x7fcf5c00db90 comp rx=0 tx=0).stop 2024-08-20T01:45:54.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.932+0000 7fcf78b0b640 1 -- 172.21.15.79:0/556329573 shutdown_connections 2024-08-20T01:45:54.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.932+0000 7fcf78b0b640 1 --2- 172.21.15.79:0/556329573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf74107d60 0x7fcf7419d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:54.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.932+0000 7fcf78b0b640 1 --2- 172.21.15.79:0/556329573 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fcf600b3c50 0x7fcf600b6110 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:54.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.932+0000 7fcf78b0b640 1 --2- 172.21.15.79:0/556329573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf741073e0 0x7fcf74198270 secure :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c00d6d0 tx=0x7fcf5c00db90 comp rx=0 tx=0).stop 2024-08-20T01:45:54.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.932+0000 7fcf78b0b640 1 --2- 172.21.15.79:0/556329573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf741019d0 0x7fcf74197d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:54.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.932+0000 7fcf78b0b640 1 -- 172.21.15.79:0/556329573 >> 172.21.15.79:0/556329573 conn(0x7fcf740fd460 msgr2=0x7fcf740fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:54.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.932+0000 7fcf78b0b640 1 -- 172.21.15.79:0/556329573 shutdown_connections 2024-08-20T01:45:54.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:54.932+0000 7fcf78b0b640 1 -- 172.21.15.79:0/556329573 wait complete. 2024-08-20T01:45:55.717 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-20T01:45:56.032 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:56 smithi079 ceph-mon[18656]: pgmap v605: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 29 MiB/s wr, 7.50k op/s 2024-08-20T01:45:56.131 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:45:56.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:56 smithi175 ceph-mon[22392]: pgmap v605: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 29 MiB/s wr, 7.50k op/s 2024-08-20T01:45:56.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:56 smithi081 ceph-mon[22209]: pgmap v605: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 29 MiB/s wr, 7.50k op/s 2024-08-20T01:45:56.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.686+0000 7f715ebe9640 1 -- 172.21.15.79:0/3341722833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7158108e40 msgr2=0x7f715810f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:56.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.686+0000 7f715ebe9640 1 --2- 172.21.15.79:0/3341722833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7158108e40 0x7f715810f640 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f7150009be0 tx=0x7f715002a6c0 comp rx=0 tx=0).stop 2024-08-20T01:45:56.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.686+0000 7f715ebe9640 1 -- 172.21.15.79:0/3341722833 shutdown_connections 2024-08-20T01:45:56.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.686+0000 7f715ebe9640 1 --2- 172.21.15.79:0/3341722833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7158108e40 0x7f715810f640 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:56.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.686+0000 7f715ebe9640 1 --2- 172.21.15.79:0/3341722833 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71581084c0 0x7f7158108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:56.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.686+0000 7f715ebe9640 1 --2- 172.21.15.79:0/3341722833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7158102ab0 0x7f7158102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:56.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.686+0000 7f715ebe9640 1 -- 172.21.15.79:0/3341722833 >> 172.21.15.79:0/3341722833 conn(0x7f71580fe580 msgr2=0x7f71581009a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:56.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.687+0000 7f715ebe9640 1 -- 172.21.15.79:0/3341722833 shutdown_connections 2024-08-20T01:45:56.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.688+0000 7f715ebe9640 1 -- 172.21.15.79:0/3341722833 wait complete. 2024-08-20T01:45:56.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.689+0000 7f715ebe9640 1 Processor -- start 2024-08-20T01:45:56.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.689+0000 7f715ebe9640 1 -- start start 2024-08-20T01:45:56.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.689+0000 7f715ebe9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7158102ab0 0x7f715819b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:56.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.689+0000 7f715ebe9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71581084c0 0x7f715819b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:56.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.689+0000 7f715ebe9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7158108e40 0x7f715819d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:56.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.689+0000 7f715ebe9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7158075bb0 con 0x7f7158108e40 2024-08-20T01:45:56.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.689+0000 7f715ebe9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7158075a30 con 0x7f71581084c0 2024-08-20T01:45:56.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.689+0000 7f715ebe9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7158075d30 con 0x7f7158102ab0 2024-08-20T01:45:56.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.689+0000 7f715d186640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7158108e40 0x7f715819d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:56.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.689+0000 7f715d186640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7158108e40 0x7f715819d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53350/0 (socket says 172.21.15.79:53350) 2024-08-20T01:45:56.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.689+0000 7f715d186640 1 -- 172.21.15.79:0/3492295808 learned_addr learned my addr 172.21.15.79:0/3492295808 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:56.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.689+0000 7f715c985640 1 --2- 172.21.15.79:0/3492295808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7158102ab0 0x7f715819b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:56.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.690+0000 7f7157fff640 1 --2- 172.21.15.79:0/3492295808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71581084c0 0x7f715819b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:56.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.690+0000 7f7157fff640 1 -- 172.21.15.79:0/3492295808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7158102ab0 msgr2=0x7f715819b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:56.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.690+0000 7f7157fff640 1 --2- 172.21.15.79:0/3492295808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7158102ab0 0x7f715819b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:56.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.690+0000 7f7157fff640 1 -- 172.21.15.79:0/3492295808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7158108e40 msgr2=0x7f715819d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:56.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.690+0000 7f7157fff640 1 --2- 172.21.15.79:0/3492295808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7158108e40 0x7f715819d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:56.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.690+0000 7f7157fff640 1 -- 172.21.15.79:0/3492295808 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f715819def0 con 0x7f71581084c0 2024-08-20T01:45:56.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.690+0000 7f715d186640 1 --2- 172.21.15.79:0/3492295808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7158108e40 0x7f715819d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:45:56.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.690+0000 7f7157fff640 1 --2- 172.21.15.79:0/3492295808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71581084c0 0x7f715819b6a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f714400c970 tx=0x7f714400cd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:56.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.690+0000 7f7155ffb640 1 -- 172.21.15.79:0/3492295808 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714400ae60 con 0x7f71581084c0 2024-08-20T01:45:56.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.690+0000 7f715ebe9640 1 -- 172.21.15.79:0/3492295808 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f715819e1e0 con 0x7f71581084c0 2024-08-20T01:45:56.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.690+0000 7f7155ffb640 1 -- 172.21.15.79:0/3492295808 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f71440054b0 con 0x7f71581084c0 2024-08-20T01:45:56.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.691+0000 7f7155ffb640 1 -- 172.21.15.79:0/3492295808 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7144004c10 con 0x7f71581084c0 2024-08-20T01:45:56.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.691+0000 7f715ebe9640 1 -- 172.21.15.79:0/3492295808 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71581a7cb0 con 0x7f71581084c0 2024-08-20T01:45:56.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.695+0000 7f7160fe2740 1 Processor -- start 2024-08-20T01:45:56.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.695+0000 7f7160fe2740 1 -- start start 2024-08-20T01:45:56.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.695+0000 7f7160fe2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56419c2ad880 0x56419c2adc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:56.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.695+0000 7f7160fe2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419c2ae1a0 0x56419c2b9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:56.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.695+0000 7f7160fe2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56419c2ba130 0x56419c2bc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:56.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.695+0000 7f7160fe2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56419c224930 con 0x56419c2ba130 2024-08-20T01:45:56.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.695+0000 7f7160fe2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56419c213e30 con 0x56419c2ae1a0 2024-08-20T01:45:56.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.695+0000 7f7160fe2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56419c217e70 con 0x56419c2ad880 2024-08-20T01:45:56.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.696+0000 7f715d186640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56419c2ad880 0x56419c2adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:56.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.696+0000 7f715d186640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56419c2ad880 0x56419c2adc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:60012/0 (socket says 172.21.15.79:60012) 2024-08-20T01:45:56.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.696+0000 7f715d186640 1 -- 172.21.15.79:0/649714592 learned_addr learned my addr 172.21.15.79:0/649714592 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:56.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.696+0000 7f715c985640 1 --2- 172.21.15.79:0/649714592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419c2ae1a0 0x56419c2b9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:56.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.696+0000 7f715d186640 1 -- 172.21.15.79:0/649714592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419c2ae1a0 msgr2=0x56419c2b9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:56.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.696+0000 7f715d186640 1 --2- 172.21.15.79:0/649714592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419c2ae1a0 0x56419c2b9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:56.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.696+0000 7f715d186640 1 -- 172.21.15.79:0/649714592 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56419c2ba130 msgr2=0x56419c2bc520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:45:56.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.696+0000 7f715d186640 1 --2- 172.21.15.79:0/649714592 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56419c2ba130 0x56419c2bc520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:56.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.696+0000 7f715d186640 1 -- 172.21.15.79:0/649714592 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56419bf73650 con 0x56419c2ad880 2024-08-20T01:45:56.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.696+0000 7f715d186640 1 --2- 172.21.15.79:0/649714592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56419c2ad880 0x56419c2adc60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7150030910 tx=0x7f7150030940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60ba0a1aa8f4269f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:56.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.697+0000 7f7155ffb640 1 -- 172.21.15.79:0/3492295808 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f7144007bb0 con 0x7f71581084c0 2024-08-20T01:45:56.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.697+0000 7f7142ffd640 1 -- 172.21.15.79:0/649714592 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7150041070 con 0x56419c2ad880 2024-08-20T01:45:56.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.697+0000 7f7142ffd640 1 -- 172.21.15.79:0/649714592 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7150037040 con 0x56419c2ad880 2024-08-20T01:45:56.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.697+0000 7f7142ffd640 1 -- 172.21.15.79:0/649714592 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7150036040 con 0x56419c2ad880 2024-08-20T01:45:56.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.698+0000 7f7160fe2740 1 -- 172.21.15.79:0/649714592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56419c2ad880 msgr2=0x56419c2adc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:56.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.698+0000 7f7160fe2740 1 --2- 172.21.15.79:0/649714592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56419c2ad880 0x56419c2adc60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7150030910 tx=0x7f7150030940 comp rx=0 tx=0).stop 2024-08-20T01:45:56.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.699+0000 7f7160fe2740 1 -- 172.21.15.79:0/649714592 shutdown_connections 2024-08-20T01:45:56.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.699+0000 7f7160fe2740 1 --2- 172.21.15.79:0/649714592 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56419c2ba130 0x56419c2bc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:56.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.699+0000 7f7160fe2740 1 --2- 172.21.15.79:0/649714592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419c2ae1a0 0x56419c2b9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:56.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.699+0000 7f7160fe2740 1 --2- 172.21.15.79:0/649714592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56419c2ad880 0x56419c2adc60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:56.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.699+0000 7f7160fe2740 1 -- 172.21.15.79:0/649714592 >> 172.21.15.79:0/649714592 conn(0x56419c2ab6b0 msgr2=0x56419c2ac850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:56.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.699+0000 7f7160fe2740 1 -- 172.21.15.79:0/649714592 shutdown_connections 2024-08-20T01:45:56.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.699+0000 7f7160fe2740 1 -- 172.21.15.79:0/649714592 wait complete. 2024-08-20T01:45:56.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.699+0000 7f7155ffb640 1 --2- 172.21.15.79:0/3492295808 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f71480b3b60 0x7f71480b6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:56.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.700+0000 7f7160fe2740 1 -- start start 2024-08-20T01:45:56.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.700+0000 7f7160fe2740 1 Processor -- start 2024-08-20T01:45:56.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.700+0000 7f715d186640 1 --2- 172.21.15.79:0/3492295808 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f71480b3b60 0x7f71480b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:56.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.701+0000 7f7155ffb640 1 -- 172.21.15.79:0/3492295808 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f71440e3690 con 0x7f71581084c0 2024-08-20T01:45:56.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.702+0000 7f715d186640 1 --2- 172.21.15.79:0/3492295808 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f71480b3b60 0x7f71480b6020 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f71500044d0 tx=0x7f7150005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:56.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.702+0000 7f7160fe2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56419c2ad880 0x56419c2b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:56.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.702+0000 7f7160fe2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419c2ae1a0 0x56419c2b7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:56.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.703+0000 7f7160fe2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56419c2ba130 0x56419c2b7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:56.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.703+0000 7f715d186640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56419c2ba130 0x56419c2b7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:56.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.703+0000 7f715d186640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56419c2ba130 0x56419c2b7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53360/0 (socket says 172.21.15.79:53360) 2024-08-20T01:45:56.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.704+0000 7f715d186640 1 -- 172.21.15.79:0/4010144912 learned_addr learned my addr 172.21.15.79:0/4010144912 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:56.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.704+0000 7f7160fe2740 1 -- 172.21.15.79:0/4010144912 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56419c076700 con 0x56419c2ba130 2024-08-20T01:45:56.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.705+0000 7f7160fe2740 1 -- 172.21.15.79:0/4010144912 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56419c19a810 con 0x56419c2ae1a0 2024-08-20T01:45:56.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.705+0000 7f7160fe2740 1 -- 172.21.15.79:0/4010144912 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56419c2c5590 con 0x56419c2ad880 2024-08-20T01:45:56.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.705+0000 7f7160fe2740 10 client.0 _ll_register_callbacks cb 0x56419c20d700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:45:56.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.706+0000 7f715c985640 1 --2- 172.21.15.79:0/4010144912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56419c2ad880 0x56419c2b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:56.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.706+0000 7f7157fff640 1 --2- 172.21.15.79:0/4010144912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419c2ae1a0 0x56419c2b7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:56.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.706+0000 7f7157fff640 1 -- 172.21.15.79:0/4010144912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56419c2ad880 msgr2=0x56419c2b70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:56.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.706+0000 7f7157fff640 1 --2- 172.21.15.79:0/4010144912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56419c2ad880 0x56419c2b70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:56.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.706+0000 7f7157fff640 1 -- 172.21.15.79:0/4010144912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56419c2ba130 msgr2=0x56419c2b7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:56.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.706+0000 7f7157fff640 1 --2- 172.21.15.79:0/4010144912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56419c2ba130 0x56419c2b7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:56.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.706+0000 7f7157fff640 1 -- 172.21.15.79:0/4010144912 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56419c2ce970 con 0x56419c2ae1a0 2024-08-20T01:45:56.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.706+0000 7f7157fff640 1 --2- 172.21.15.79:0/4010144912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419c2ae1a0 0x56419c2b7610 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x56419c2ad830 tx=0x7f71440a9d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a857db8e1ec1daea server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:56.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.706+0000 7f7137fff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:45:56.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.706+0000 7f715d186640 1 --2- 172.21.15.79:0/4010144912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56419c2ba130 0x56419c2b7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:45:56.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.706+0000 7f715c985640 1 --2- 172.21.15.79:0/4010144912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56419c2ad880 0x56419c2b70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:45:56.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.706+0000 7f7137fff640 1 -- 172.21.15.79:0/4010144912 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714401d030 con 0x56419c2ae1a0 2024-08-20T01:45:56.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.707+0000 7f7160fe2740 1 -- 172.21.15.79:0/4010144912 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56419c1c3150 con 0x56419c2ae1a0 2024-08-20T01:45:56.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.707+0000 7f7137fff640 1 -- 172.21.15.79:0/4010144912 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f71440a9850 con 0x56419c2ae1a0 2024-08-20T01:45:56.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.707+0000 7f7137fff640 1 -- 172.21.15.79:0/4010144912 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f71440aa5f0 con 0x56419c2ae1a0 2024-08-20T01:45:56.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.707+0000 7f7160fe2740 10 client.26933 fetch_fsmap learned FSMap version 43 2024-08-20T01:45:56.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.707+0000 7f7160fe2740 1 -- 172.21.15.79:0/4010144912 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x56419c2d1380 con 0x56419c2ae1a0 2024-08-20T01:45:56.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.707+0000 7f7137fff640 1 -- 172.21.15.79:0/4010144912 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56419c1c3150 con 0x56419c2ae1a0 2024-08-20T01:45:56.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.707+0000 7f7137fff640 1 -- 172.21.15.79:0/4010144912 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 43) ==== 8394+0+0 (secure 0 0 0) 0x7f71440a60f0 con 0x56419c2ae1a0 2024-08-20T01:45:56.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.708+0000 7f7160fe2740 10 client.26933 fetch_fsmap finished waiting for FSMap version 43 2024-08-20T01:45:56.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.708+0000 7f7160fe2740 10 client.26933 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:45:56.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.708+0000 7f7160fe2740 20 client.26933 populate_metadata read hostname 'smithi079' 2024-08-20T01:45:56.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.708+0000 7f7160fe2740 1 --2- 172.21.15.79:0/4010144912 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x56419c2d2840 0x56419c2d4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:56.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.708+0000 7f7160fe2740 4 client.26933 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:45:56.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.708+0000 7f7160fe2740 1 -- 172.21.15.79:0/4010144912 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56419c226880 con 0x56419c2d2840 2024-08-20T01:45:56.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.708+0000 7f715c985640 1 --2- 172.21.15.79:0/4010144912 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x56419c2d2840 0x56419c2d4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:56.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.708+0000 7f715c985640 1 --2- 172.21.15.79:0/4010144912 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x56419c2d2840 0x56419c2d4c30 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1d164c7051900982 server_cookie=f1eea2958c314a03 in_seq=0 out_seq=0 2024-08-20T01:45:56.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.708+0000 7f7137fff640 10 client.26933 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:45:56.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.710+0000 7f7137fff640 1 -- 172.21.15.79:0/4010144912 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56419c226880 con 0x56419c2d2840 2024-08-20T01:45:56.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.710+0000 7f7137fff640 10 client.26933 handle_command_reply: tid=0 2024-08-20T01:45:56.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.710+0000 7f7160fe2740 1 client.26933 shutdown 2024-08-20T01:45:56.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.710+0000 7f7160fe2740 1 -- 172.21.15.79:0/4010144912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419c2ae1a0 msgr2=0x56419c2b7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:56.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.710+0000 7f7160fe2740 1 --2- 172.21.15.79:0/4010144912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419c2ae1a0 0x56419c2b7610 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x56419c2ad830 tx=0x7f71440a9d60 comp rx=0 tx=0).stop 2024-08-20T01:45:56.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.711+0000 7f7160fe2740 1 -- 172.21.15.79:0/4010144912 shutdown_connections 2024-08-20T01:45:56.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.711+0000 7f7160fe2740 1 --2- 172.21.15.79:0/4010144912 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x56419c2d2840 0x56419c2d4c30 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:56.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.711+0000 7f7137fff640 0 client.26933 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:45:56.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.711+0000 7f7160fe2740 1 --2- 172.21.15.79:0/4010144912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56419c2ba130 0x56419c2b7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:56.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.711+0000 7f7160fe2740 1 --2- 172.21.15.79:0/4010144912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419c2ae1a0 0x56419c2b7610 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:56.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.711+0000 7f7160fe2740 1 --2- 172.21.15.79:0/4010144912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56419c2ad880 0x56419c2b70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:56.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.711+0000 7f7160fe2740 1 -- 172.21.15.79:0/4010144912 >> 172.21.15.79:0/4010144912 conn(0x56419c2ab6b0 msgr2=0x56419c2b1250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:56.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.711+0000 7f7160fe2740 1 -- 172.21.15.79:0/4010144912 shutdown_connections 2024-08-20T01:45:56.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.711+0000 7f7160fe2740 1 -- 172.21.15.79:0/4010144912 wait complete. 2024-08-20T01:45:56.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.712+0000 7f7160fe2740 20 client.26933 trim_cache size 0 max 16384 2024-08-20T01:45:56.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.736+0000 7f7160fe2740 1 Processor -- start 2024-08-20T01:45:56.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.736+0000 7f7160fe2740 1 -- start start 2024-08-20T01:45:56.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.736+0000 7f7160fe2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419c2ad880 0x56419c2b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:56.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.736+0000 7f7160fe2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56419c2ae1a0 0x56419c2b69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:56.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.736+0000 7f7160fe2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56419c2ba130 0x56419c2da4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:56.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.737+0000 7f7160fe2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f71581abd60 con 0x56419c2ba130 2024-08-20T01:45:56.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.737+0000 7f7160fe2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f71581ada20 con 0x56419c2ad880 2024-08-20T01:45:56.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.737+0000 7f7160fe2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f71581ac430 con 0x56419c2ae1a0 2024-08-20T01:45:56.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.737+0000 7f715c985640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419c2ad880 0x56419c2b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:56.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.737+0000 7f715c985640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419c2ad880 0x56419c2b1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:51316/0 (socket says 172.21.15.79:51316) 2024-08-20T01:45:56.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.737+0000 7f715c985640 1 -- 172.21.15.79:0/2557326639 learned_addr learned my addr 172.21.15.79:0/2557326639 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:56.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.737+0000 7f7157fff640 1 --2- 172.21.15.79:0/2557326639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56419c2ae1a0 0x56419c2b69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:56.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.737+0000 7f715d186640 1 --2- 172.21.15.79:0/2557326639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56419c2ba130 0x56419c2da4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:56.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.737+0000 7f715c985640 1 -- 172.21.15.79:0/2557326639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56419c2ae1a0 msgr2=0x56419c2b69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:56.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.737+0000 7f715c985640 1 --2- 172.21.15.79:0/2557326639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56419c2ae1a0 0x56419c2b69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:56.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.737+0000 7f715c985640 1 -- 172.21.15.79:0/2557326639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56419c2ba130 msgr2=0x56419c2da4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:56.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.737+0000 7f715c985640 1 --2- 172.21.15.79:0/2557326639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56419c2ba130 0x56419c2da4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:56.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.737+0000 7f715c985640 1 -- 172.21.15.79:0/2557326639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56419c2adfd0 con 0x56419c2ad880 2024-08-20T01:45:56.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.738+0000 7f715c985640 1 --2- 172.21.15.79:0/2557326639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419c2ad880 0x56419c2b1a40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f714c004360 tx=0x7f714c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e38861bc8f737184 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:56.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.738+0000 7f71427fc640 1 -- 172.21.15.79:0/2557326639 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c005020 con 0x56419c2ad880 2024-08-20T01:45:56.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.738+0000 7f71427fc640 1 -- 172.21.15.79:0/2557326639 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f714c0047a0 con 0x56419c2ad880 2024-08-20T01:45:56.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.738+0000 7f71427fc640 1 -- 172.21.15.79:0/2557326639 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c005020 con 0x56419c2ad880 2024-08-20T01:45:56.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.739+0000 7f7160fe2740 1 -- 172.21.15.79:0/2557326639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419c2ad880 msgr2=0x56419c2b1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:56.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.739+0000 7f7160fe2740 1 --2- 172.21.15.79:0/2557326639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419c2ad880 0x56419c2b1a40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f714c004360 tx=0x7f714c0046c0 comp rx=0 tx=0).stop 2024-08-20T01:45:56.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.739+0000 7f7160fe2740 1 -- 172.21.15.79:0/2557326639 shutdown_connections 2024-08-20T01:45:56.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.739+0000 7f7160fe2740 1 --2- 172.21.15.79:0/2557326639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56419c2ba130 0x56419c2da4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:56.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.739+0000 7f7160fe2740 1 --2- 172.21.15.79:0/2557326639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56419c2ae1a0 0x56419c2b69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:56.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.740+0000 7f7160fe2740 1 --2- 172.21.15.79:0/2557326639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419c2ad880 0x56419c2b1a40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:56.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.740+0000 7f7160fe2740 1 -- 172.21.15.79:0/2557326639 >> 172.21.15.79:0/2557326639 conn(0x56419c2ab6b0 msgr2=0x56419c2b8f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:56.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.740+0000 7f7160fe2740 1 -- 172.21.15.79:0/2557326639 shutdown_connections 2024-08-20T01:45:56.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.740+0000 7f7160fe2740 1 -- 172.21.15.79:0/2557326639 wait complete. 2024-08-20T01:45:56.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.740+0000 7f7160fe2740 1 -- start start 2024-08-20T01:45:56.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.741+0000 7f7160fe2740 1 Processor -- start 2024-08-20T01:45:56.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.741+0000 7f7160fe2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56419c2ad880 0x56419c2cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:56.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.742+0000 7f7160fe2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419c2ae1a0 0x56419c2c8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:56.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.742+0000 7f7160fe2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56419c2ba130 0x56419c2c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:56.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.742+0000 7f7160fe2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f71581ad290 con 0x56419c2ba130 2024-08-20T01:45:56.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.742+0000 7f7160fe2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f71581acb00 con 0x56419c2ae1a0 2024-08-20T01:45:56.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.742+0000 7f7160fe2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f71581a9d40 con 0x56419c2ad880 2024-08-20T01:45:56.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.742+0000 7f7160fe2740 10 client.0 _ll_register_callbacks cb 0x7f714400a470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:45:56.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.742+0000 7f7157fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419c2ae1a0 0x56419c2c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:56.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.742+0000 7f7157fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419c2ae1a0 0x56419c2c8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:51328/0 (socket says 172.21.15.79:51328) 2024-08-20T01:45:56.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.742+0000 7f7157fff640 1 -- 172.21.15.79:0/1043471957 learned_addr learned my addr 172.21.15.79:0/1043471957 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:56.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.742+0000 7f715d186640 1 --2- 172.21.15.79:0/1043471957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56419c2ba130 0x56419c2c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:56.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.742+0000 7f715c985640 1 --2- 172.21.15.79:0/1043471957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56419c2ad880 0x56419c2cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:56.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.743+0000 7f715d186640 1 -- 172.21.15.79:0/1043471957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56419c2ad880 msgr2=0x56419c2cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:56.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.743+0000 7f715d186640 1 --2- 172.21.15.79:0/1043471957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56419c2ad880 0x56419c2cadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:56.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.743+0000 7f715d186640 1 -- 172.21.15.79:0/1043471957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419c2ae1a0 msgr2=0x56419c2c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:56.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.743+0000 7f715d186640 1 --2- 172.21.15.79:0/1043471957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419c2ae1a0 0x56419c2c8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:56.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.743+0000 7f715d186640 1 -- 172.21.15.79:0/1043471957 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56419c2c94b0 con 0x56419c2ba130 2024-08-20T01:45:56.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.743+0000 7f715c985640 1 --2- 172.21.15.79:0/1043471957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56419c2ad880 0x56419c2cadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:45:56.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.743+0000 7f715d186640 1 --2- 172.21.15.79:0/1043471957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56419c2ba130 0x56419c2c8dc0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x56419c2ae660 tx=0x7f7150009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51c7bc465915da5d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:56.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.743+0000 7f7137fff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:45:56.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.743+0000 7f7137fff640 1 -- 172.21.15.79:0/1043471957 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7150061060 con 0x56419c2ba130 2024-08-20T01:45:56.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.743+0000 7f7137fff640 1 -- 172.21.15.79:0/1043471957 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f7150046820 con 0x56419c2ba130 2024-08-20T01:45:56.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.744+0000 7f7160fe2740 1 -- 172.21.15.79:0/1043471957 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f714c0047a0 con 0x56419c2ba130 2024-08-20T01:45:56.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.744+0000 7f7137fff640 1 -- 172.21.15.79:0/1043471957 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f715004c070 con 0x56419c2ba130 2024-08-20T01:45:56.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.744+0000 7f7160fe2740 10 client.17934 fetch_fsmap learned FSMap version 43 2024-08-20T01:45:56.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.744+0000 7f7160fe2740 1 -- 172.21.15.79:0/1043471957 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x56419c33c390 con 0x56419c2ba130 2024-08-20T01:45:56.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.745+0000 7f7137fff640 1 -- 172.21.15.79:0/1043471957 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f714c0047a0 con 0x56419c2ba130 2024-08-20T01:45:56.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.745+0000 7f7137fff640 1 -- 172.21.15.79:0/1043471957 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 43) ==== 8394+0+0 (secure 0 0 0) 0x7f715003c040 con 0x56419c2ba130 2024-08-20T01:45:56.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.745+0000 7f7160fe2740 10 client.17934 fetch_fsmap finished waiting for FSMap version 43 2024-08-20T01:45:56.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.745+0000 7f7160fe2740 10 client.17934 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:45:56.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.745+0000 7f7160fe2740 20 client.17934 populate_metadata read hostname 'smithi079' 2024-08-20T01:45:56.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.745+0000 7f7160fe2740 1 --2- 172.21.15.79:0/1043471957 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x56419c2d2840 0x56419c33e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:56.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.745+0000 7f7160fe2740 4 client.17934 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:45:56.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.745+0000 7f7160fe2740 1 -- 172.21.15.79:0/1043471957 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56419c222320 con 0x56419c2d2840 2024-08-20T01:45:56.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.745+0000 7f715c985640 1 --2- 172.21.15.79:0/1043471957 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x56419c2d2840 0x56419c33e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:56.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.746+0000 7f715c985640 1 --2- 172.21.15.79:0/1043471957 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x56419c2d2840 0x56419c33e630 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1a29983e58ee5a0e server_cookie=7c231d345a1a1641 in_seq=0 out_seq=0 2024-08-20T01:45:56.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.746+0000 7f7137fff640 10 client.17934 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:45:56.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.747+0000 7f7137fff640 1 -- 172.21.15.79:0/1043471957 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56419c222320 con 0x56419c2d2840 2024-08-20T01:45:56.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.747+0000 7f7137fff640 10 client.17934 handle_command_reply: tid=0 2024-08-20T01:45:56.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.747+0000 7f7160fe2740 1 client.17934 shutdown 2024-08-20T01:45:56.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.747+0000 7f7160fe2740 1 -- 172.21.15.79:0/1043471957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56419c2ba130 msgr2=0x56419c2c8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:56.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.747+0000 7f7160fe2740 1 --2- 172.21.15.79:0/1043471957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56419c2ba130 0x56419c2c8dc0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x56419c2ae660 tx=0x7f7150009500 comp rx=0 tx=0).stop 2024-08-20T01:45:56.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.747+0000 7f7160fe2740 1 -- 172.21.15.79:0/1043471957 shutdown_connections 2024-08-20T01:45:56.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.747+0000 7f7160fe2740 1 --2- 172.21.15.79:0/1043471957 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x56419c2d2840 0x56419c33e630 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:56.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.747+0000 7f7160fe2740 1 --2- 172.21.15.79:0/1043471957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56419c2ba130 0x56419c2c8dc0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:56.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.747+0000 7f7137fff640 0 client.17934 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:45:56.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.747+0000 7f7160fe2740 1 --2- 172.21.15.79:0/1043471957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419c2ae1a0 0x56419c2c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:56.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.747+0000 7f7160fe2740 1 --2- 172.21.15.79:0/1043471957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56419c2ad880 0x56419c2cadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:56.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.747+0000 7f7160fe2740 1 -- 172.21.15.79:0/1043471957 >> 172.21.15.79:0/1043471957 conn(0x56419c2ab6b0 msgr2=0x56419c2a9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:56.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.748+0000 7f7160fe2740 1 -- 172.21.15.79:0/1043471957 shutdown_connections 2024-08-20T01:45:56.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.748+0000 7f7160fe2740 1 -- 172.21.15.79:0/1043471957 wait complete. 2024-08-20T01:45:56.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.748+0000 7f7160fe2740 20 client.17934 trim_cache size 0 max 16384 2024-08-20T01:45:56.752 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:45:56.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.749+0000 7f715ebe9640 1 -- 172.21.15.79:0/3492295808 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f71480b3b60 msgr2=0x7f71480b6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:56.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.749+0000 7f715ebe9640 1 --2- 172.21.15.79:0/3492295808 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f71480b3b60 0x7f71480b6020 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f71500044d0 tx=0x7f7150005fd0 comp rx=0 tx=0).stop 2024-08-20T01:45:56.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.749+0000 7f715ebe9640 1 -- 172.21.15.79:0/3492295808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71581084c0 msgr2=0x7f715819b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:56.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.749+0000 7f715ebe9640 1 --2- 172.21.15.79:0/3492295808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71581084c0 0x7f715819b6a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f714400c970 tx=0x7f714400cd70 comp rx=0 tx=0).stop 2024-08-20T01:45:56.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.750+0000 7f715ebe9640 1 -- 172.21.15.79:0/3492295808 shutdown_connections 2024-08-20T01:45:56.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.750+0000 7f715ebe9640 1 --2- 172.21.15.79:0/3492295808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7158108e40 0x7f715819d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:56.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.750+0000 7f715ebe9640 1 --2- 172.21.15.79:0/3492295808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71581084c0 0x7f715819b6a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:56.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.750+0000 7f715ebe9640 1 --2- 172.21.15.79:0/3492295808 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f71480b3b60 0x7f71480b6020 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:56.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.750+0000 7f715ebe9640 1 --2- 172.21.15.79:0/3492295808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7158102ab0 0x7f715819b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:56.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.750+0000 7f715ebe9640 1 -- 172.21.15.79:0/3492295808 >> 172.21.15.79:0/3492295808 conn(0x7f71580fe580 msgr2=0x7f7158107290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:56.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.750+0000 7f715ebe9640 1 -- 172.21.15.79:0/3492295808 shutdown_connections 2024-08-20T01:45:56.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:56.750+0000 7f715ebe9640 1 -- 172.21.15.79:0/3492295808 wait complete. 2024-08-20T01:45:57.522 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T01:45:57.935 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:45:58.370 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:45:58 smithi079 ceph-mon[18656]: pgmap v606: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 27 MiB/s wr, 6.98k op/s 2024-08-20T01:45:58.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:45:58 smithi175 ceph-mon[22392]: pgmap v606: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 27 MiB/s wr, 6.98k op/s 2024-08-20T01:45:58.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.500+0000 7fb01b41b640 1 -- 172.21.15.79:0/2114115309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb014102a90 msgr2=0x7fb014102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:58.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.500+0000 7fb01b41b640 1 --2- 172.21.15.79:0/2114115309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb014102a90 0x7fb014102e70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb010009860 tx=0x7fb01002a340 comp rx=0 tx=0).stop 2024-08-20T01:45:58.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.500+0000 7fb01b41b640 1 -- 172.21.15.79:0/2114115309 shutdown_connections 2024-08-20T01:45:58.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.500+0000 7fb01b41b640 1 --2- 172.21.15.79:0/2114115309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb014108e20 0x7fb01410f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:58.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.500+0000 7fb01b41b640 1 --2- 172.21.15.79:0/2114115309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0141084a0 0x7fb0141088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:58.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.500+0000 7fb01b41b640 1 --2- 172.21.15.79:0/2114115309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb014102a90 0x7fb014102e70 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:58.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.500+0000 7fb01b41b640 1 -- 172.21.15.79:0/2114115309 >> 172.21.15.79:0/2114115309 conn(0x7fb0140fe540 msgr2=0x7fb014100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:58.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.501+0000 7fb01b41b640 1 -- 172.21.15.79:0/2114115309 shutdown_connections 2024-08-20T01:45:58.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.501+0000 7fb01b41b640 1 -- 172.21.15.79:0/2114115309 wait complete. 2024-08-20T01:45:58.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.502+0000 7fb01b41b640 1 Processor -- start 2024-08-20T01:45:58.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.503+0000 7fb01b41b640 1 -- start start 2024-08-20T01:45:58.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.503+0000 7fb01b41b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb014102a90 0x7fb014198f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:58.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.503+0000 7fb01b41b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0141084a0 0x7fb014199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:58.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.503+0000 7fb0191b7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb014102a90 0x7fb014198f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:58.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.503+0000 7fb0191b7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb014102a90 0x7fb014198f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:60068/0 (socket says 172.21.15.79:60068) 2024-08-20T01:45:58.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.503+0000 7fb0191b7640 1 -- 172.21.15.79:0/1461932344 learned_addr learned my addr 172.21.15.79:0/1461932344 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:58.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.503+0000 7fb01b41b640 1 --2- 172.21.15.79:0/1461932344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb014108e20 0x7fb01419e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:58.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.503+0000 7fb01b41b640 1 -- 172.21.15.79:0/1461932344 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb0141129e0 con 0x7fb0141084a0 2024-08-20T01:45:58.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.503+0000 7fb01b41b640 1 -- 172.21.15.79:0/1461932344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb014112860 con 0x7fb014108e20 2024-08-20T01:45:58.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.503+0000 7fb01b41b640 1 -- 172.21.15.79:0/1461932344 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb014112b60 con 0x7fb014102a90 2024-08-20T01:45:58.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.504+0000 7fb0199b8640 1 --2- 172.21.15.79:0/1461932344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb014108e20 0x7fb01419e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:58.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.504+0000 7fb0189b6640 1 --2- 172.21.15.79:0/1461932344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0141084a0 0x7fb014199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:58.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.504+0000 7fb0191b7640 1 -- 172.21.15.79:0/1461932344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb014108e20 msgr2=0x7fb01419e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:58.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.504+0000 7fb0191b7640 1 --2- 172.21.15.79:0/1461932344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb014108e20 0x7fb01419e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:58.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.504+0000 7fb0191b7640 1 -- 172.21.15.79:0/1461932344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0141084a0 msgr2=0x7fb014199470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:58.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.504+0000 7fb0191b7640 1 --2- 172.21.15.79:0/1461932344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0141084a0 0x7fb014199470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:58.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.504+0000 7fb0191b7640 1 -- 172.21.15.79:0/1461932344 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb01419efe0 con 0x7fb014102a90 2024-08-20T01:45:58.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.504+0000 7fb0189b6640 1 --2- 172.21.15.79:0/1461932344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0141084a0 0x7fb014199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:45:58.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.504+0000 7fb0191b7640 1 --2- 172.21.15.79:0/1461932344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb014102a90 0x7fb014198f30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb010000c00 tx=0x7fb01002ae50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:58.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.505+0000 7fb00a7fc640 1 -- 172.21.15.79:0/1461932344 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb010037040 con 0x7fb014102a90 2024-08-20T01:45:58.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.505+0000 7fb00a7fc640 1 -- 172.21.15.79:0/1461932344 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb010041030 con 0x7fb014102a90 2024-08-20T01:45:58.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.505+0000 7fb01b41b640 1 -- 172.21.15.79:0/1461932344 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb01419f270 con 0x7fb014102a90 2024-08-20T01:45:58.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.505+0000 7fb01b41b640 1 -- 172.21.15.79:0/1461932344 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0140750b0 con 0x7fb014102a90 2024-08-20T01:45:58.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.506+0000 7fb00a7fc640 1 -- 172.21.15.79:0/1461932344 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb01003d670 con 0x7fb014102a90 2024-08-20T01:45:58.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.509+0000 7fb00a7fc640 1 -- 172.21.15.79:0/1461932344 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb01003d810 con 0x7fb014102a90 2024-08-20T01:45:58.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.509+0000 7fb01d814740 1 Processor -- start 2024-08-20T01:45:58.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.510+0000 7fb01d814740 1 -- start start 2024-08-20T01:45:58.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.510+0000 7fb01d814740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56287b10a880 0x56287b10ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:58.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.510+0000 7fb01d814740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56287b10b1a0 0x56287b116bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:58.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.510+0000 7fb01d814740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56287b117130 0x56287b119520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:58.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.510+0000 7fb01d814740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56287b081930 con 0x56287b117130 2024-08-20T01:45:58.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.510+0000 7fb01d814740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56287b070e30 con 0x56287b10a880 2024-08-20T01:45:58.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.510+0000 7fb01d814740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56287b074e70 con 0x56287b10b1a0 2024-08-20T01:45:58.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.510+0000 7fb0199b8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56287b10a880 0x56287b10ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:58.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.511+0000 7fb0199b8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56287b10a880 0x56287b10ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:51370/0 (socket says 172.21.15.79:51370) 2024-08-20T01:45:58.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.511+0000 7fb0199b8640 1 -- 172.21.15.79:0/3411531053 learned_addr learned my addr 172.21.15.79:0/3411531053 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:58.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.511+0000 7fb0199b8640 1 -- 172.21.15.79:0/3411531053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56287b10b1a0 msgr2=0x56287b116bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:45:58.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.511+0000 7fb0199b8640 1 --2- 172.21.15.79:0/3411531053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56287b10b1a0 0x56287b116bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:58.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.511+0000 7fb0199b8640 1 -- 172.21.15.79:0/3411531053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56287b117130 msgr2=0x56287b119520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:58.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.511+0000 7fb0199b8640 1 --2- 172.21.15.79:0/3411531053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56287b117130 0x56287b119520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:58.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.511+0000 7fb0199b8640 1 -- 172.21.15.79:0/3411531053 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56287add0650 con 0x56287b10a880 2024-08-20T01:45:58.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.511+0000 7fb00a7fc640 1 --2- 172.21.15.79:0/1461932344 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb0000b3de0 0x7fb0000b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:58.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.511+0000 7fb0199b8640 1 --2- 172.21.15.79:0/3411531053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56287b10a880 0x56287b10ac60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb00c011440 tx=0x7fb00c011900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6ade73dcb9c5a7f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:58.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.512+0000 7fb0191b7640 1 --2- 172.21.15.79:0/1461932344 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb0000b3de0 0x7fb0000b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:58.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.512+0000 7fafff7fe640 1 -- 172.21.15.79:0/3411531053 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00c003c30 con 0x56287b10a880 2024-08-20T01:45:58.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.512+0000 7fafff7fe640 1 -- 172.21.15.79:0/3411531053 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb00c003dd0 con 0x56287b10a880 2024-08-20T01:45:58.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.512+0000 7fafff7fe640 1 -- 172.21.15.79:0/3411531053 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00c00fa00 con 0x56287b10a880 2024-08-20T01:45:58.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.512+0000 7fb00a7fc640 1 -- 172.21.15.79:0/1461932344 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fb010107440 con 0x7fb014102a90 2024-08-20T01:45:58.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.513+0000 7fb01d814740 1 -- 172.21.15.79:0/3411531053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56287b10a880 msgr2=0x56287b10ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:58.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.513+0000 7fb01d814740 1 --2- 172.21.15.79:0/3411531053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56287b10a880 0x56287b10ac60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb00c011440 tx=0x7fb00c011900 comp rx=0 tx=0).stop 2024-08-20T01:45:58.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.513+0000 7fb0191b7640 1 --2- 172.21.15.79:0/1461932344 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb0000b3de0 0x7fb0000b62a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb0100ca450 tx=0x7fb010098870 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:58.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.513+0000 7fb01d814740 1 -- 172.21.15.79:0/3411531053 shutdown_connections 2024-08-20T01:45:58.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.513+0000 7fb01d814740 1 --2- 172.21.15.79:0/3411531053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56287b117130 0x56287b119520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:58.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.513+0000 7fb01d814740 1 --2- 172.21.15.79:0/3411531053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56287b10b1a0 0x56287b116bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:58.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.513+0000 7fb01d814740 1 --2- 172.21.15.79:0/3411531053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56287b10a880 0x56287b10ac60 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:58.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.513+0000 7fb01d814740 1 -- 172.21.15.79:0/3411531053 >> 172.21.15.79:0/3411531053 conn(0x56287b1086b0 msgr2=0x56287b109850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:58.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.513+0000 7fb01d814740 1 -- 172.21.15.79:0/3411531053 shutdown_connections 2024-08-20T01:45:58.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.513+0000 7fb01d814740 1 -- 172.21.15.79:0/3411531053 wait complete. 2024-08-20T01:45:58.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.513+0000 7fb01d814740 1 -- start start 2024-08-20T01:45:58.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.514+0000 7fb01d814740 1 Processor -- start 2024-08-20T01:45:58.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.514+0000 7fb01d814740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56287b10a880 0x56287b1140c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:58.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.514+0000 7fb01d814740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56287b10b1a0 0x56287b114600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:58.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.514+0000 7fb01d814740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56287b117130 0x56287b114b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:58.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.514+0000 7fb01d814740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56287aed3700 con 0x56287b10b1a0 2024-08-20T01:45:58.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.514+0000 7fb01d814740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56287aff7810 con 0x56287b10a880 2024-08-20T01:45:58.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.514+0000 7fb01d814740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56287b12adf0 con 0x56287b117130 2024-08-20T01:45:58.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.514+0000 7fb01d814740 10 client.0 _ll_register_callbacks cb 0x56287b06a700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:45:58.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.515+0000 7fb0199b8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56287b10a880 0x56287b1140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:58.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.515+0000 7fb0199b8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56287b10a880 0x56287b1140c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:51374/0 (socket says 172.21.15.79:51374) 2024-08-20T01:45:58.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.515+0000 7fb0199b8640 1 -- 172.21.15.79:0/887258881 learned_addr learned my addr 172.21.15.79:0/887258881 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:58.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.515+0000 7fb0189b6640 1 --2- 172.21.15.79:0/887258881 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56287b10b1a0 0x56287b114600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:58.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.515+0000 7fb0199b8640 1 --2- 172.21.15.79:0/887258881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56287b117130 0x56287b114b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:58.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.515+0000 7fb0199b8640 1 -- 172.21.15.79:0/887258881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56287b117130 msgr2=0x56287b114b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:58.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.515+0000 7fb0199b8640 1 --2- 172.21.15.79:0/887258881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56287b117130 0x56287b114b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:58.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.515+0000 7fb0199b8640 1 -- 172.21.15.79:0/887258881 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56287b10b1a0 msgr2=0x56287b114600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:58.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.515+0000 7fb0199b8640 1 --2- 172.21.15.79:0/887258881 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56287b10b1a0 0x56287b114600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:58.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.515+0000 7fb0199b8640 1 -- 172.21.15.79:0/887258881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56287b134230 con 0x56287b10a880 2024-08-20T01:45:58.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.515+0000 7fb0199b8640 1 --2- 172.21.15.79:0/887258881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56287b10a880 0x56287b1140c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb00c00f6e0 tx=0x7fb00c00f5e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8b68d3aaf0c7ca8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:58.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.515+0000 7faffcff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:45:58.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.516+0000 7faffcff9640 1 -- 172.21.15.79:0/887258881 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00c02c020 con 0x56287b10a880 2024-08-20T01:45:58.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.516+0000 7faffcff9640 1 -- 172.21.15.79:0/887258881 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fb00c00f980 con 0x56287b10a880 2024-08-20T01:45:58.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.516+0000 7fb01d814740 1 -- 172.21.15.79:0/887258881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56287b020150 con 0x56287b10a880 2024-08-20T01:45:58.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.516+0000 7faffcff9640 1 -- 172.21.15.79:0/887258881 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fb00c00fb80 con 0x56287b10a880 2024-08-20T01:45:58.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.516+0000 7fb01d814740 10 client.26951 fetch_fsmap learned FSMap version 43 2024-08-20T01:45:58.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.516+0000 7fb01d814740 1 -- 172.21.15.79:0/887258881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x56287b136c10 con 0x56287b10a880 2024-08-20T01:45:58.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.516+0000 7faffcff9640 1 -- 172.21.15.79:0/887258881 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56287b020150 con 0x56287b10a880 2024-08-20T01:45:58.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.517+0000 7faffcff9640 1 -- 172.21.15.79:0/887258881 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 43) ==== 8394+0+0 (secure 0 0 0) 0x7fb00c028970 con 0x56287b10a880 2024-08-20T01:45:58.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.517+0000 7fb01d814740 10 client.26951 fetch_fsmap finished waiting for FSMap version 43 2024-08-20T01:45:58.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.517+0000 7fb01d814740 10 client.26951 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:45:58.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.517+0000 7fb01d814740 20 client.26951 populate_metadata read hostname 'smithi079' 2024-08-20T01:45:58.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.517+0000 7fb01d814740 1 --2- 172.21.15.79:0/887258881 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x56287b138020 0x56287b13a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:58.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.517+0000 7fb01d814740 4 client.26951 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:45:58.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.517+0000 7fb01d814740 1 -- 172.21.15.79:0/887258881 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56287b083880 con 0x56287b138020 2024-08-20T01:45:58.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.517+0000 7fb0189b6640 1 --2- 172.21.15.79:0/887258881 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x56287b138020 0x56287b13a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:58.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.518+0000 7faffcff9640 10 client.26951 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:45:58.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.518+0000 7fb0189b6640 1 --2- 172.21.15.79:0/887258881 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x56287b138020 0x56287b13a410 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1c2fb0528d038de9 server_cookie=bb04d21986ea94e5 in_seq=0 out_seq=0 2024-08-20T01:45:58.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.518+0000 7faffcff9640 1 -- 172.21.15.79:0/887258881 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56287b083880 con 0x56287b138020 2024-08-20T01:45:58.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.518+0000 7faffcff9640 10 client.26951 handle_command_reply: tid=0 2024-08-20T01:45:58.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.518+0000 7fb01d814740 1 client.26951 shutdown 2024-08-20T01:45:58.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.519+0000 7fb01d814740 1 -- 172.21.15.79:0/887258881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56287b10a880 msgr2=0x56287b1140c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:58.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.519+0000 7fb01d814740 1 --2- 172.21.15.79:0/887258881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56287b10a880 0x56287b1140c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb00c00f6e0 tx=0x7fb00c00f5e0 comp rx=0 tx=0).stop 2024-08-20T01:45:58.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.519+0000 7fb01d814740 1 -- 172.21.15.79:0/887258881 shutdown_connections 2024-08-20T01:45:58.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.519+0000 7fb01d814740 1 --2- 172.21.15.79:0/887258881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56287b117130 0x56287b114b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:58.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.519+0000 7fb01d814740 1 --2- 172.21.15.79:0/887258881 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x56287b138020 0x56287b13a410 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:58.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.519+0000 7fb01d814740 1 --2- 172.21.15.79:0/887258881 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56287b10b1a0 0x56287b114600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:58.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.519+0000 7fb01d814740 1 --2- 172.21.15.79:0/887258881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56287b10a880 0x56287b1140c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:58.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.519+0000 7fb01d814740 1 -- 172.21.15.79:0/887258881 >> 172.21.15.79:0/887258881 conn(0x56287b1086b0 msgr2=0x56287b10e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:58.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.519+0000 7faffcff9640 0 client.26951 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:45:58.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.519+0000 7fb01d814740 1 -- 172.21.15.79:0/887258881 shutdown_connections 2024-08-20T01:45:58.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.519+0000 7fb01d814740 1 -- 172.21.15.79:0/887258881 wait complete. 2024-08-20T01:45:58.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.519+0000 7fb01d814740 20 client.26951 trim_cache size 0 max 16384 2024-08-20T01:45:58.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:45:58 smithi081 ceph-mon[22209]: pgmap v606: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 27 MiB/s wr, 6.98k op/s 2024-08-20T01:45:58.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.542+0000 7fb01d814740 1 Processor -- start 2024-08-20T01:45:58.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.542+0000 7fb01d814740 1 -- start start 2024-08-20T01:45:58.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.543+0000 7fb01d814740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56287b10a880 0x56287b115e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:58.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.543+0000 7fb0199b8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56287b10a880 0x56287b115e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:58.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.543+0000 7fb0199b8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56287b10a880 0x56287b115e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53440/0 (socket says 172.21.15.79:53440) 2024-08-20T01:45:58.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.543+0000 7fb0199b8640 1 -- 172.21.15.79:0/1869133334 learned_addr learned my addr 172.21.15.79:0/1869133334 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:58.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.543+0000 7fb01d814740 1 --2- 172.21.15.79:0/1869133334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56287b10b1a0 0x56287b1145c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:58.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.543+0000 7fb01d814740 1 --2- 172.21.15.79:0/1869133334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56287b117130 0x56287b114b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:58.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.543+0000 7fb01d814740 1 -- 172.21.15.79:0/1869133334 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7faff800e420 con 0x56287b10a880 2024-08-20T01:45:58.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.544+0000 7fb01d814740 1 -- 172.21.15.79:0/1869133334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faff80100e0 con 0x56287b117130 2024-08-20T01:45:58.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.544+0000 7fb01d814740 1 -- 172.21.15.79:0/1869133334 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faff800eaf0 con 0x56287b10b1a0 2024-08-20T01:45:58.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.544+0000 7fb0189b6640 1 --2- 172.21.15.79:0/1869133334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56287b10b1a0 0x56287b1145c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:58.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.544+0000 7fb0199b8640 1 --2- 172.21.15.79:0/1869133334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56287b117130 0x56287b114b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:58.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.544+0000 7fb0189b6640 1 -- 172.21.15.79:0/1869133334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56287b117130 msgr2=0x56287b114b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:58.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.544+0000 7fb0189b6640 1 --2- 172.21.15.79:0/1869133334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56287b117130 0x56287b114b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:58.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.544+0000 7fb0189b6640 1 -- 172.21.15.79:0/1869133334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56287b10a880 msgr2=0x56287b115e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:58.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.544+0000 7fb0189b6640 1 --2- 172.21.15.79:0/1869133334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56287b10a880 0x56287b115e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:58.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.544+0000 7fb0189b6640 1 -- 172.21.15.79:0/1869133334 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56287b109130 con 0x56287b10b1a0 2024-08-20T01:45:58.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.544+0000 7fb0199b8640 1 --2- 172.21.15.79:0/1869133334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56287b117130 0x56287b114b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:45:58.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.545+0000 7fb0189b6640 1 --2- 172.21.15.79:0/1869133334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56287b10b1a0 0x56287b1145c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x56287b13aac0 tx=0x7fb0040092d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d865fd2cbe10bee server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:58.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.545+0000 7faffeffd640 1 -- 172.21.15.79:0/1869133334 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb004005220 con 0x56287b10b1a0 2024-08-20T01:45:58.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.545+0000 7faffeffd640 1 -- 172.21.15.79:0/1869133334 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb004004c30 con 0x56287b10b1a0 2024-08-20T01:45:58.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.545+0000 7faffeffd640 1 -- 172.21.15.79:0/1869133334 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00401b7e0 con 0x56287b10b1a0 2024-08-20T01:45:58.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.546+0000 7fb01d814740 1 -- 172.21.15.79:0/1869133334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56287b10b1a0 msgr2=0x56287b1145c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:58.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.546+0000 7fb01d814740 1 --2- 172.21.15.79:0/1869133334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56287b10b1a0 0x56287b1145c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x56287b13aac0 tx=0x7fb0040092d0 comp rx=0 tx=0).stop 2024-08-20T01:45:58.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.546+0000 7fb01d814740 1 -- 172.21.15.79:0/1869133334 shutdown_connections 2024-08-20T01:45:58.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.546+0000 7fb01d814740 1 --2- 172.21.15.79:0/1869133334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56287b117130 0x56287b114b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:58.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.546+0000 7fb01d814740 1 --2- 172.21.15.79:0/1869133334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56287b10b1a0 0x56287b1145c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:58.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.546+0000 7fb01d814740 1 --2- 172.21.15.79:0/1869133334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56287b10a880 0x56287b115e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:58.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.546+0000 7fb01d814740 1 -- 172.21.15.79:0/1869133334 >> 172.21.15.79:0/1869133334 conn(0x56287b1086b0 msgr2=0x56287b1156f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:58.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.547+0000 7fb01d814740 1 -- 172.21.15.79:0/1869133334 shutdown_connections 2024-08-20T01:45:58.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.547+0000 7fb01d814740 1 -- 172.21.15.79:0/1869133334 wait complete. 2024-08-20T01:45:58.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.547+0000 7fb01d814740 1 -- start start 2024-08-20T01:45:58.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.548+0000 7fb01d814740 1 Processor -- start 2024-08-20T01:45:58.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.548+0000 7fb01d814740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56287b10a880 0x56287b130380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:58.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.549+0000 7fb01d814740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56287b10b1a0 0x56287b130900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:58.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.549+0000 7fb01d814740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56287b117130 0x56287b110bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:58.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.549+0000 7fb01d814740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7faff800f950 con 0x56287b10b1a0 2024-08-20T01:45:58.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.549+0000 7fb01d814740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faff800f1c0 con 0x56287b117130 2024-08-20T01:45:58.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.549+0000 7fb01d814740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faff800c400 con 0x56287b10a880 2024-08-20T01:45:58.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.549+0000 7fb01d814740 10 client.0 _ll_register_callbacks cb 0x7fb00c009eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:45:58.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.549+0000 7fb0199b8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56287b10a880 0x56287b130380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:58.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.549+0000 7fb0199b8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56287b10a880 0x56287b130380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:60102/0 (socket says 172.21.15.79:60102) 2024-08-20T01:45:58.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.549+0000 7fb0199b8640 1 -- 172.21.15.79:0/1183985067 learned_addr learned my addr 172.21.15.79:0/1183985067 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:45:58.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.549+0000 7fb0199b8640 1 --2- 172.21.15.79:0/1183985067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56287b117130 0x56287b110bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:58.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.549+0000 7fb0199b8640 1 -- 172.21.15.79:0/1183985067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56287b117130 msgr2=0x56287b110bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:45:58.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.549+0000 7fb0199b8640 1 --2- 172.21.15.79:0/1183985067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56287b117130 0x56287b110bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:58.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.549+0000 7fb0199b8640 1 -- 172.21.15.79:0/1183985067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56287b10b1a0 msgr2=0x56287b130900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:45:58.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.549+0000 7fb0199b8640 1 --2- 172.21.15.79:0/1183985067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56287b10b1a0 0x56287b130900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:58.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.549+0000 7fb0199b8640 1 -- 172.21.15.79:0/1183985067 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56287b1113b0 con 0x56287b10a880 2024-08-20T01:45:58.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.549+0000 7fb0199b8640 1 --2- 172.21.15.79:0/1183985067 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56287b10a880 0x56287b130380 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb00c000f80 tx=0x7fb00c00f650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afa42098422236f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:45:58.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.550+0000 7faffcff9640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:45:58.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.550+0000 7faffcff9640 1 -- 172.21.15.79:0/1183985067 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00c02c070 con 0x56287b10a880 2024-08-20T01:45:58.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.550+0000 7faffcff9640 1 -- 172.21.15.79:0/1183985067 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fb00c00f8c0 con 0x56287b10a880 2024-08-20T01:45:58.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.550+0000 7fb01d814740 1 -- 172.21.15.79:0/1183985067 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb004004c30 con 0x56287b10a880 2024-08-20T01:45:58.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.550+0000 7faffcff9640 1 -- 172.21.15.79:0/1183985067 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fb00c009820 con 0x56287b10a880 2024-08-20T01:45:58.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.550+0000 7fb01d814740 10 client.26932 fetch_fsmap learned FSMap version 43 2024-08-20T01:45:58.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.550+0000 7fb01d814740 1 -- 172.21.15.79:0/1183985067 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x56287b1a26d0 con 0x56287b10a880 2024-08-20T01:45:58.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.550+0000 7faffcff9640 1 -- 172.21.15.79:0/1183985067 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb004004c30 con 0x56287b10a880 2024-08-20T01:45:58.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.551+0000 7faffcff9640 1 -- 172.21.15.79:0/1183985067 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 43) ==== 8394+0+0 (secure 0 0 0) 0x7fb00c004910 con 0x56287b10a880 2024-08-20T01:45:58.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.551+0000 7fb01d814740 10 client.26932 fetch_fsmap finished waiting for FSMap version 43 2024-08-20T01:45:58.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.551+0000 7fb01d814740 10 client.26932 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:45:58.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.551+0000 7fb01d814740 20 client.26932 populate_metadata read hostname 'smithi079' 2024-08-20T01:45:58.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.551+0000 7fb01d814740 1 --2- 172.21.15.79:0/1183985067 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x56287b1a2dd0 0x56287b1a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:45:58.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.551+0000 7fb01d814740 4 client.26932 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:45:58.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.551+0000 7fb01d814740 1 -- 172.21.15.79:0/1183985067 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56287b07f320 con 0x56287b1a2dd0 2024-08-20T01:45:58.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.551+0000 7fb0189b6640 1 --2- 172.21.15.79:0/1183985067 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x56287b1a2dd0 0x56287b1a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:45:58.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.553+0000 7faffcff9640 10 client.26932 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:45:58.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.553+0000 7fb0189b6640 1 --2- 172.21.15.79:0/1183985067 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x56287b1a2dd0 0x56287b1a51f0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=75c8fa1e6417a961 server_cookie=cfd7ea1f913cfce in_seq=0 out_seq=0 2024-08-20T01:45:58.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.554+0000 7faffcff9640 1 -- 172.21.15.79:0/1183985067 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56287b07f320 con 0x56287b1a2dd0 2024-08-20T01:45:58.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.554+0000 7faffcff9640 10 client.26932 handle_command_reply: tid=0 2024-08-20T01:45:58.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.554+0000 7fb01d814740 1 client.26932 shutdown 2024-08-20T01:45:58.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.554+0000 7fb01d814740 1 -- 172.21.15.79:0/1183985067 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56287b10a880 msgr2=0x56287b130380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:58.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.554+0000 7fb01d814740 1 --2- 172.21.15.79:0/1183985067 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56287b10a880 0x56287b130380 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb00c000f80 tx=0x7fb00c00f650 comp rx=0 tx=0).stop 2024-08-20T01:45:58.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.554+0000 7fb01d814740 1 -- 172.21.15.79:0/1183985067 shutdown_connections 2024-08-20T01:45:58.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.554+0000 7fb01d814740 1 --2- 172.21.15.79:0/1183985067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56287b117130 0x56287b110bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:58.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.554+0000 7fb01d814740 1 --2- 172.21.15.79:0/1183985067 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x56287b1a2dd0 0x56287b1a51f0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:58.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.554+0000 7fb01d814740 1 --2- 172.21.15.79:0/1183985067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56287b10b1a0 0x56287b130900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:58.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.554+0000 7fb01d814740 1 --2- 172.21.15.79:0/1183985067 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56287b10a880 0x56287b130380 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:58.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.554+0000 7fb01d814740 1 -- 172.21.15.79:0/1183985067 >> 172.21.15.79:0/1183985067 conn(0x56287b1086b0 msgr2=0x56287b107770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:58.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.554+0000 7faffcff9640 0 client.26932 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:45:58.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.554+0000 7fb01d814740 1 -- 172.21.15.79:0/1183985067 shutdown_connections 2024-08-20T01:45:58.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.554+0000 7fb01d814740 1 -- 172.21.15.79:0/1183985067 wait complete. 2024-08-20T01:45:58.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.555+0000 7fb01d814740 20 client.26932 trim_cache size 0 max 16384 2024-08-20T01:45:58.558 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:45:58.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.556+0000 7fb01b41b640 1 -- 172.21.15.79:0/1461932344 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb0000b3de0 msgr2=0x7fb0000b62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:58.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.556+0000 7fb01b41b640 1 --2- 172.21.15.79:0/1461932344 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb0000b3de0 0x7fb0000b62a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb0100ca450 tx=0x7fb010098870 comp rx=0 tx=0).stop 2024-08-20T01:45:58.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.556+0000 7fb01b41b640 1 -- 172.21.15.79:0/1461932344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb014102a90 msgr2=0x7fb014198f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:45:58.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.556+0000 7fb01b41b640 1 --2- 172.21.15.79:0/1461932344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb014102a90 0x7fb014198f30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb010000c00 tx=0x7fb01002ae50 comp rx=0 tx=0).stop 2024-08-20T01:45:58.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.556+0000 7fb01b41b640 1 -- 172.21.15.79:0/1461932344 shutdown_connections 2024-08-20T01:45:58.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.556+0000 7fb01b41b640 1 --2- 172.21.15.79:0/1461932344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb014108e20 0x7fb01419e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:58.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.556+0000 7fb01b41b640 1 --2- 172.21.15.79:0/1461932344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0141084a0 0x7fb014199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:58.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.556+0000 7fb01b41b640 1 --2- 172.21.15.79:0/1461932344 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb0000b3de0 0x7fb0000b62a0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:58.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.556+0000 7fb01b41b640 1 --2- 172.21.15.79:0/1461932344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb014102a90 0x7fb014198f30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:45:58.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.556+0000 7fb01b41b640 1 -- 172.21.15.79:0/1461932344 >> 172.21.15.79:0/1461932344 conn(0x7fb0140fe540 msgr2=0x7fb014100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:45:58.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.556+0000 7fb01b41b640 1 -- 172.21.15.79:0/1461932344 shutdown_connections 2024-08-20T01:45:58.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:45:58.556+0000 7fb01b41b640 1 -- 172.21.15.79:0/1461932344 wait complete. 2024-08-20T01:45:59.545 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T01:45:59.959 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:46:00.306 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:00 smithi079 ceph-mon[18656]: pgmap v607: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 29 MiB/s wr, 7.44k op/s 2024-08-20T01:46:00.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:00 smithi175 ceph-mon[22392]: pgmap v607: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 29 MiB/s wr, 7.44k op/s 2024-08-20T01:46:00.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:00 smithi081 ceph-mon[22209]: pgmap v607: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 29 MiB/s wr, 7.44k op/s 2024-08-20T01:46:00.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.563+0000 7f6ad3bef640 1 -- 172.21.15.79:0/601563018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6acc075270 msgr2=0x7f6acc075650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:00.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.563+0000 7f6ad3bef640 1 --2- 172.21.15.79:0/601563018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6acc075270 0x7f6acc075650 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8009900 tx=0x7f6ac802a410 comp rx=0 tx=0).stop 2024-08-20T01:46:00.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.563+0000 7f6ad3bef640 1 -- 172.21.15.79:0/601563018 shutdown_connections 2024-08-20T01:46:00.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.563+0000 7f6ad3bef640 1 --2- 172.21.15.79:0/601563018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6acc10f0d0 0x7f6acc1114c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:00.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.563+0000 7f6ad3bef640 1 --2- 172.21.15.79:0/601563018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6acc075c70 0x7f6acc10eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:00.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.563+0000 7f6ad3bef640 1 --2- 172.21.15.79:0/601563018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6acc075270 0x7f6acc075650 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:00.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.563+0000 7f6ad3bef640 1 -- 172.21.15.79:0/601563018 >> 172.21.15.79:0/601563018 conn(0x7f6acc0fe520 msgr2=0x7f6acc100940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:00.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.563+0000 7f6ad3bef640 1 -- 172.21.15.79:0/601563018 shutdown_connections 2024-08-20T01:46:00.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.563+0000 7f6ad3bef640 1 -- 172.21.15.79:0/601563018 wait complete. 2024-08-20T01:46:00.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.564+0000 7f6ad3bef640 1 Processor -- start 2024-08-20T01:46:00.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.564+0000 7f6ad3bef640 1 -- start start 2024-08-20T01:46:00.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.565+0000 7f6ad3bef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6acc075270 0x7f6acc10e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:00.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.565+0000 7f6ad3bef640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6acc075c70 0x7f6acc10b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:00.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.565+0000 7f6ad3bef640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6acc10f0d0 0x7f6acc10be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:00.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.565+0000 7f6ad3bef640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6acc114b80 con 0x7f6acc10f0d0 2024-08-20T01:46:00.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.565+0000 7f6ad3bef640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6acc114a00 con 0x7f6acc075270 2024-08-20T01:46:00.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.565+0000 7f6ad3bef640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6acc114d00 con 0x7f6acc075c70 2024-08-20T01:46:00.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.565+0000 7f6ad218c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6acc10f0d0 0x7f6acc10be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:00.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.565+0000 7f6ad218c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6acc10f0d0 0x7f6acc10be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51306/0 (socket says 172.21.15.79:51306) 2024-08-20T01:46:00.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.565+0000 7f6ad218c640 1 -- 172.21.15.79:0/3179249377 learned_addr learned my addr 172.21.15.79:0/3179249377 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:00.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.565+0000 7f6ad198b640 1 --2- 172.21.15.79:0/3179249377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6acc075270 0x7f6acc10e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:00.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.566+0000 7f6ad218c640 1 -- 172.21.15.79:0/3179249377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6acc075c70 msgr2=0x7f6acc10b920 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-20T01:46:00.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.566+0000 7f6ad118a640 1 --2- 172.21.15.79:0/3179249377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6acc075c70 0x7f6acc10b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:00.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.566+0000 7f6ad218c640 1 --2- 172.21.15.79:0/3179249377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6acc075c70 0x7f6acc10b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:00.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.566+0000 7f6ad218c640 1 -- 172.21.15.79:0/3179249377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6acc075270 msgr2=0x7f6acc10e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:00.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.566+0000 7f6ad218c640 1 --2- 172.21.15.79:0/3179249377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6acc075270 0x7f6acc10e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:00.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.566+0000 7f6ad218c640 1 -- 172.21.15.79:0/3179249377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6acc10c590 con 0x7f6acc10f0d0 2024-08-20T01:46:00.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.566+0000 7f6ad198b640 1 --2- 172.21.15.79:0/3179249377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6acc075270 0x7f6acc10e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:46:00.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.566+0000 7f6ad218c640 1 --2- 172.21.15.79:0/3179249377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6acc10f0d0 0x7f6acc10be60 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f6ac400eb40 tx=0x7f6ac400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:00.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.566+0000 7f6ac2ffd640 1 -- 172.21.15.79:0/3179249377 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac4004b20 con 0x7f6acc10f0d0 2024-08-20T01:46:00.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.566+0000 7f6ac2ffd640 1 -- 172.21.15.79:0/3179249377 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6ac4004cc0 con 0x7f6acc10f0d0 2024-08-20T01:46:00.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.566+0000 7f6ad3bef640 1 -- 172.21.15.79:0/3179249377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6acc1ab8c0 con 0x7f6acc10f0d0 2024-08-20T01:46:00.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.566+0000 7f6ac2ffd640 1 -- 172.21.15.79:0/3179249377 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac4010690 con 0x7f6acc10f0d0 2024-08-20T01:46:00.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.567+0000 7f6ad3bef640 1 -- 172.21.15.79:0/3179249377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6acc1abd40 con 0x7f6acc10f0d0 2024-08-20T01:46:00.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.570+0000 7f6ac2ffd640 1 -- 172.21.15.79:0/3179249377 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f6ac4005540 con 0x7f6acc10f0d0 2024-08-20T01:46:00.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.573+0000 7f6ad5fe8740 1 Processor -- start 2024-08-20T01:46:00.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.574+0000 7f6ac2ffd640 1 --2- 172.21.15.79:0/3179249377 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6ab80b3c90 0x7f6ab80b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:00.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.574+0000 7f6ac2ffd640 1 -- 172.21.15.79:0/3179249377 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f6ac40e43a0 con 0x7f6acc10f0d0 2024-08-20T01:46:00.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.574+0000 7f6ad118a640 1 --2- 172.21.15.79:0/3179249377 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6ab80b3c90 0x7f6ab80b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:00.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.575+0000 7f6ad5fe8740 1 -- start start 2024-08-20T01:46:00.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.575+0000 7f6ad5fe8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e520c77880 0x55e520c77c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:00.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.575+0000 7f6ad5fe8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e520c781a0 0x55e520c83bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:00.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.575+0000 7f6ad5fe8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e520c84130 0x55e520c86520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:00.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.575+0000 7f6ad5fe8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e520bee930 con 0x55e520c77880 2024-08-20T01:46:00.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.575+0000 7f6ad5fe8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e520bdde30 con 0x55e520c84130 2024-08-20T01:46:00.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.575+0000 7f6ad5fe8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e520be1e70 con 0x55e520c781a0 2024-08-20T01:46:00.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.575+0000 7f6ad198b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e520c77880 0x55e520c77c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:00.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.576+0000 7f6ad198b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e520c77880 0x55e520c77c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51318/0 (socket says 172.21.15.79:51318) 2024-08-20T01:46:00.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.576+0000 7f6ad198b640 1 -- 172.21.15.79:0/775059689 learned_addr learned my addr 172.21.15.79:0/775059689 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:00.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.576+0000 7f6ad198b640 1 -- 172.21.15.79:0/775059689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e520c781a0 msgr2=0x55e520c83bf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:46:00.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.576+0000 7f6ad198b640 1 --2- 172.21.15.79:0/775059689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e520c781a0 0x55e520c83bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:00.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.576+0000 7f6ad198b640 1 -- 172.21.15.79:0/775059689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e520c84130 msgr2=0x55e520c86520 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:46:00.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.577+0000 7f6ad198b640 1 --2- 172.21.15.79:0/775059689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e520c84130 0x55e520c86520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:00.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.577+0000 7f6ad198b640 1 -- 172.21.15.79:0/775059689 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e52093d650 con 0x55e520c77880 2024-08-20T01:46:00.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.577+0000 7f6ad198b640 1 --2- 172.21.15.79:0/775059689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e520c77880 0x55e520c77c60 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8005c20 tx=0x7f6ac8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7282f17d1b6e82d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:00.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.577+0000 7f6ab7fff640 1 -- 172.21.15.79:0/775059689 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac8035070 con 0x55e520c77880 2024-08-20T01:46:00.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.577+0000 7f6ab7fff640 1 -- 172.21.15.79:0/775059689 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6ac8005500 con 0x55e520c77880 2024-08-20T01:46:00.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.577+0000 7f6ab7fff640 1 -- 172.21.15.79:0/775059689 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac80035f0 con 0x55e520c77880 2024-08-20T01:46:00.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.578+0000 7f6ad5fe8740 1 -- 172.21.15.79:0/775059689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e520c77880 msgr2=0x55e520c77c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:00.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.578+0000 7f6ad5fe8740 1 --2- 172.21.15.79:0/775059689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e520c77880 0x55e520c77c60 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8005c20 tx=0x7f6ac8000bc0 comp rx=0 tx=0).stop 2024-08-20T01:46:00.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.579+0000 7f6ad5fe8740 1 -- 172.21.15.79:0/775059689 shutdown_connections 2024-08-20T01:46:00.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.579+0000 7f6ad5fe8740 1 --2- 172.21.15.79:0/775059689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e520c84130 0x55e520c86520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:00.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.579+0000 7f6ad5fe8740 1 --2- 172.21.15.79:0/775059689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e520c781a0 0x55e520c83bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:00.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.579+0000 7f6ad5fe8740 1 --2- 172.21.15.79:0/775059689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e520c77880 0x55e520c77c60 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:00.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.579+0000 7f6ad5fe8740 1 -- 172.21.15.79:0/775059689 >> 172.21.15.79:0/775059689 conn(0x55e520c756b0 msgr2=0x55e520c76850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:00.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.579+0000 7f6ad5fe8740 1 -- 172.21.15.79:0/775059689 shutdown_connections 2024-08-20T01:46:00.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.579+0000 7f6ad5fe8740 1 -- 172.21.15.79:0/775059689 wait complete. 2024-08-20T01:46:00.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.579+0000 7f6ad118a640 1 --2- 172.21.15.79:0/3179249377 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6ab80b3c90 0x7f6ab80b6150 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6acc10e420 tx=0x7f6abc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:00.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.580+0000 7f6ad5fe8740 1 -- start start 2024-08-20T01:46:00.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.580+0000 7f6ad5fe8740 1 Processor -- start 2024-08-20T01:46:00.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.581+0000 7f6ad5fe8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e520c77880 0x55e520c81140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:00.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.581+0000 7f6ad5fe8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e520c781a0 0x55e520c81680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:00.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.581+0000 7f6ad5fe8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e520c84130 0x55e520c81bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:00.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.581+0000 7f6ad5fe8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e520a40700 con 0x55e520c84130 2024-08-20T01:46:00.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.581+0000 7f6ad5fe8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e520b64810 con 0x55e520c77880 2024-08-20T01:46:00.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.581+0000 7f6ad5fe8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e520c86d80 con 0x55e520c781a0 2024-08-20T01:46:00.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.581+0000 7f6ad5fe8740 10 client.0 _ll_register_callbacks cb 0x55e520bd7700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:46:00.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.581+0000 7f6ad118a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e520c781a0 0x55e520c81680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:00.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.581+0000 7f6ad218c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e520c84130 0x55e520c81bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:00.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.581+0000 7f6ad198b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e520c77880 0x55e520c81140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:00.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.581+0000 7f6ad218c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e520c84130 0x55e520c81bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51322/0 (socket says 172.21.15.79:51322) 2024-08-20T01:46:00.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.581+0000 7f6ad218c640 1 -- 172.21.15.79:0/2586339249 learned_addr learned my addr 172.21.15.79:0/2586339249 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:00.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.581+0000 7f6ad218c640 1 -- 172.21.15.79:0/2586339249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e520c781a0 msgr2=0x55e520c81680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:00.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.581+0000 7f6ad218c640 1 --2- 172.21.15.79:0/2586339249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e520c781a0 0x55e520c81680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:00.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.581+0000 7f6ad218c640 1 -- 172.21.15.79:0/2586339249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e520c77880 msgr2=0x55e520c81140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:00.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.581+0000 7f6ad218c640 1 --2- 172.21.15.79:0/2586339249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e520c77880 0x55e520c81140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:00.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.581+0000 7f6ad218c640 1 -- 172.21.15.79:0/2586339249 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e520c90220 con 0x55e520c84130 2024-08-20T01:46:00.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.581+0000 7f6ad118a640 1 --2- 172.21.15.79:0/2586339249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e520c781a0 0x55e520c81680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:46:00.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.582+0000 7f6ad218c640 1 --2- 172.21.15.79:0/2586339249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e520c84130 0x55e520c81bc0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f6ac40ab290 tx=0x7f6ac40aaf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ebb8a88ba1e0e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:00.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.582+0000 7f6ab57fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:46:00.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.582+0000 7f6ab57fa640 1 -- 172.21.15.79:0/2586339249 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac40c4020 con 0x55e520c84130 2024-08-20T01:46:00.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.582+0000 7f6ad5fe8740 1 -- 172.21.15.79:0/2586339249 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e520b8d150 con 0x55e520c84130 2024-08-20T01:46:00.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.582+0000 7f6ab57fa640 1 -- 172.21.15.79:0/2586339249 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f6ac40b4130 con 0x55e520c84130 2024-08-20T01:46:00.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.583+0000 7f6ab57fa640 1 -- 172.21.15.79:0/2586339249 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f6ac40b43b0 con 0x55e520c84130 2024-08-20T01:46:00.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.583+0000 7f6ad5fe8740 10 client.17955 fetch_fsmap learned FSMap version 44 2024-08-20T01:46:00.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.583+0000 7f6ad5fe8740 1 -- 172.21.15.79:0/2586339249 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55e520c92bd0 con 0x55e520c84130 2024-08-20T01:46:00.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.583+0000 7f6ab57fa640 1 -- 172.21.15.79:0/2586339249 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55e520b8d150 con 0x55e520c84130 2024-08-20T01:46:00.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.583+0000 7f6ab57fa640 1 -- 172.21.15.79:0/2586339249 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 44) ==== 8382+0+0 (secure 0 0 0) 0x7f6ac4005200 con 0x55e520c84130 2024-08-20T01:46:00.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.583+0000 7f6ad5fe8740 10 client.17955 fetch_fsmap finished waiting for FSMap version 44 2024-08-20T01:46:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.583+0000 7f6ad5fe8740 10 client.17955 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:46:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.583+0000 7f6ad5fe8740 20 client.17955 populate_metadata read hostname 'smithi079' 2024-08-20T01:46:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.583+0000 7f6ad5fe8740 1 --2- 172.21.15.79:0/2586339249 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55e520c945b0 0x55e520c969f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.583+0000 7f6ad5fe8740 4 client.17955 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:46:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.583+0000 7f6ad5fe8740 1 -- 172.21.15.79:0/2586339249 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e520bf0880 con 0x55e520c945b0 2024-08-20T01:46:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.584+0000 7f6ad198b640 1 --2- 172.21.15.79:0/2586339249 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55e520c945b0 0x55e520c969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.584+0000 7f6ad198b640 1 --2- 172.21.15.79:0/2586339249 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55e520c945b0 0x55e520c969f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6c03054a44961c6d server_cookie=b35eba07d296a37e in_seq=0 out_seq=0 2024-08-20T01:46:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.584+0000 7f6ab57fa640 10 client.17955 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:46:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.585+0000 7f6ab57fa640 1 -- 172.21.15.79:0/2586339249 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e520bf0880 con 0x55e520c945b0 2024-08-20T01:46:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.585+0000 7f6ab57fa640 10 client.17955 handle_command_reply: tid=0 2024-08-20T01:46:00.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.585+0000 7f6ad5fe8740 1 client.17955 shutdown 2024-08-20T01:46:00.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.585+0000 7f6ad5fe8740 1 -- 172.21.15.79:0/2586339249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e520c84130 msgr2=0x55e520c81bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:00.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.585+0000 7f6ad5fe8740 1 --2- 172.21.15.79:0/2586339249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e520c84130 0x55e520c81bc0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f6ac40ab290 tx=0x7f6ac40aaf50 comp rx=0 tx=0).stop 2024-08-20T01:46:00.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.585+0000 7f6ad5fe8740 1 -- 172.21.15.79:0/2586339249 shutdown_connections 2024-08-20T01:46:00.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.585+0000 7f6ad5fe8740 1 --2- 172.21.15.79:0/2586339249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e520c84130 0x55e520c81bc0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:00.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.585+0000 7f6ad5fe8740 1 --2- 172.21.15.79:0/2586339249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e520c781a0 0x55e520c81680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:00.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.585+0000 7f6ad5fe8740 1 --2- 172.21.15.79:0/2586339249 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55e520c945b0 0x55e520c969f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:00.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.585+0000 7f6ad5fe8740 1 --2- 172.21.15.79:0/2586339249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e520c77880 0x55e520c81140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:00.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.585+0000 7f6ab57fa640 0 client.17955 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:46:00.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.585+0000 7f6ad5fe8740 1 -- 172.21.15.79:0/2586339249 >> 172.21.15.79:0/2586339249 conn(0x55e520c756b0 msgr2=0x55e520c7b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:00.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.585+0000 7f6ad5fe8740 1 -- 172.21.15.79:0/2586339249 shutdown_connections 2024-08-20T01:46:00.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.585+0000 7f6ad5fe8740 1 -- 172.21.15.79:0/2586339249 wait complete. 2024-08-20T01:46:00.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.585+0000 7f6ad5fe8740 20 client.17955 trim_cache size 0 max 16384 2024-08-20T01:46:00.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.608+0000 7f6ad5fe8740 1 Processor -- start 2024-08-20T01:46:00.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.608+0000 7f6ad5fe8740 1 -- start start 2024-08-20T01:46:00.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.609+0000 7f6ad5fe8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e520c77880 0x55e520c7ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:00.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.609+0000 7f6ad5fe8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e520c781a0 0x55e520c9c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:00.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.609+0000 7f6ad118a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e520c781a0 0x55e520c9c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:00.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.609+0000 7f6ad5fe8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e520c84130 0x55e520c9c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:00.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.609+0000 7f6ad5fe8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6acc1b46b0 con 0x55e520c781a0 2024-08-20T01:46:00.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.609+0000 7f6ad5fe8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6acc1b62e0 con 0x55e520c84130 2024-08-20T01:46:00.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.609+0000 7f6ad5fe8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6acc1b4d80 con 0x55e520c77880 2024-08-20T01:46:00.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.609+0000 7f6ad198b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e520c77880 0x55e520c7ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:00.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.609+0000 7f6ad118a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e520c781a0 0x55e520c9c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51326/0 (socket says 172.21.15.79:51326) 2024-08-20T01:46:00.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.609+0000 7f6ad118a640 1 -- 172.21.15.79:0/27215782 learned_addr learned my addr 172.21.15.79:0/27215782 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:00.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.609+0000 7f6ad218c640 1 --2- 172.21.15.79:0/27215782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e520c84130 0x55e520c9c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:00.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.609+0000 7f6ad118a640 1 -- 172.21.15.79:0/27215782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e520c77880 msgr2=0x55e520c7ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:00.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.609+0000 7f6ad118a640 1 --2- 172.21.15.79:0/27215782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e520c77880 0x55e520c7ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:00.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.609+0000 7f6ad118a640 1 -- 172.21.15.79:0/27215782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e520c84130 msgr2=0x55e520c9c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:00.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.609+0000 7f6ad118a640 1 --2- 172.21.15.79:0/27215782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e520c84130 0x55e520c9c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:00.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.609+0000 7f6ad118a640 1 -- 172.21.15.79:0/27215782 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e520c76130 con 0x55e520c781a0 2024-08-20T01:46:00.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.609+0000 7f6ad198b640 1 --2- 172.21.15.79:0/27215782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e520c77880 0x55e520c7ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:46:00.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.610+0000 7f6ad118a640 1 --2- 172.21.15.79:0/27215782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e520c781a0 0x55e520c9c2c0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f6abc010e00 tx=0x7f6abc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbe1851e565277f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:00.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.610+0000 7f6ab77fe640 1 -- 172.21.15.79:0/27215782 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6abc0096f0 con 0x55e520c781a0 2024-08-20T01:46:00.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.610+0000 7f6ab77fe640 1 -- 172.21.15.79:0/27215782 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6abc024070 con 0x55e520c781a0 2024-08-20T01:46:00.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.610+0000 7f6ab77fe640 1 -- 172.21.15.79:0/27215782 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6abc020430 con 0x55e520c781a0 2024-08-20T01:46:00.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.611+0000 7f6ad5fe8740 1 -- 172.21.15.79:0/27215782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e520c781a0 msgr2=0x55e520c9c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:00.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.611+0000 7f6ad5fe8740 1 --2- 172.21.15.79:0/27215782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e520c781a0 0x55e520c9c2c0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f6abc010e00 tx=0x7f6abc013000 comp rx=0 tx=0).stop 2024-08-20T01:46:00.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.611+0000 7f6ad5fe8740 1 -- 172.21.15.79:0/27215782 shutdown_connections 2024-08-20T01:46:00.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.611+0000 7f6ad5fe8740 1 --2- 172.21.15.79:0/27215782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e520c84130 0x55e520c9c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:00.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.611+0000 7f6ad5fe8740 1 --2- 172.21.15.79:0/27215782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e520c781a0 0x55e520c9c2c0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:00.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.611+0000 7f6ad5fe8740 1 --2- 172.21.15.79:0/27215782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e520c77880 0x55e520c7ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:00.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.611+0000 7f6ad5fe8740 1 -- 172.21.15.79:0/27215782 >> 172.21.15.79:0/27215782 conn(0x55e520c756b0 msgr2=0x55e520c82f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:00.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.611+0000 7f6ad5fe8740 1 -- 172.21.15.79:0/27215782 shutdown_connections 2024-08-20T01:46:00.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.611+0000 7f6ad5fe8740 1 -- 172.21.15.79:0/27215782 wait complete. 2024-08-20T01:46:00.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.612+0000 7f6ad5fe8740 1 -- start start 2024-08-20T01:46:00.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.612+0000 7f6ad5fe8740 1 Processor -- start 2024-08-20T01:46:00.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.613+0000 7f6ad5fe8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e520c77880 0x55e520c8c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:00.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.613+0000 7f6ad5fe8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e520c781a0 0x55e520c88d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:00.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.613+0000 7f6ad5fe8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e520c84130 0x55e520c89450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:00.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.613+0000 7f6ad5fe8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6acc1b5be0 con 0x55e520c781a0 2024-08-20T01:46:00.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.613+0000 7f6ad5fe8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6acc1b5450 con 0x55e520c77880 2024-08-20T01:46:00.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.613+0000 7f6ad5fe8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6acc1b2690 con 0x55e520c84130 2024-08-20T01:46:00.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.613+0000 7f6ad5fe8740 10 client.0 _ll_register_callbacks cb 0x7f6ac400ced0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:46:00.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.613+0000 7f6ad198b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e520c77880 0x55e520c8c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:00.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.613+0000 7f6ad198b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e520c77880 0x55e520c8c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:58252/0 (socket says 172.21.15.79:58252) 2024-08-20T01:46:00.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.613+0000 7f6ad198b640 1 -- 172.21.15.79:0/2610672554 learned_addr learned my addr 172.21.15.79:0/2610672554 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:00.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.613+0000 7f6ad218c640 1 --2- 172.21.15.79:0/2610672554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e520c84130 0x55e520c89450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:00.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.614+0000 7f6ad198b640 1 -- 172.21.15.79:0/2610672554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e520c84130 msgr2=0x55e520c89450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:00.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.614+0000 7f6ad198b640 1 --2- 172.21.15.79:0/2610672554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e520c84130 0x55e520c89450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:00.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.614+0000 7f6ad198b640 1 -- 172.21.15.79:0/2610672554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e520c781a0 msgr2=0x55e520c88d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:00.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.614+0000 7f6ad198b640 1 --2- 172.21.15.79:0/2610672554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e520c781a0 0x55e520c88d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:00.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.614+0000 7f6ad198b640 1 -- 172.21.15.79:0/2610672554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e520d0e2a0 con 0x55e520c77880 2024-08-20T01:46:00.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.614+0000 7f6ad198b640 1 --2- 172.21.15.79:0/2610672554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e520c77880 0x55e520c8c8a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8004c00 tx=0x7f6ac8005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af6fcab6eb0eff0b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:00.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.614+0000 7f6ab57fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:46:00.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.614+0000 7f6ab57fa640 1 -- 172.21.15.79:0/2610672554 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac8035040 con 0x55e520c77880 2024-08-20T01:46:00.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.614+0000 7f6ab57fa640 1 -- 172.21.15.79:0/2610672554 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f6ac80048c0 con 0x55e520c77880 2024-08-20T01:46:00.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.614+0000 7f6ad5fe8740 1 -- 172.21.15.79:0/2610672554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6abc024070 con 0x55e520c77880 2024-08-20T01:46:00.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.615+0000 7f6ab57fa640 1 -- 172.21.15.79:0/2610672554 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f6ac8060050 con 0x55e520c77880 2024-08-20T01:46:00.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.615+0000 7f6ad5fe8740 10 client.26966 fetch_fsmap learned FSMap version 44 2024-08-20T01:46:00.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.615+0000 7f6ad5fe8740 1 -- 172.21.15.79:0/2610672554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55e520d0f4a0 con 0x55e520c77880 2024-08-20T01:46:00.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.615+0000 7f6ab57fa640 1 -- 172.21.15.79:0/2610672554 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6abc024070 con 0x55e520c77880 2024-08-20T01:46:00.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.615+0000 7f6ab57fa640 1 -- 172.21.15.79:0/2610672554 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 44) ==== 8382+0+0 (secure 0 0 0) 0x7f6ac8003a40 con 0x55e520c77880 2024-08-20T01:46:00.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.615+0000 7f6ad5fe8740 10 client.26966 fetch_fsmap finished waiting for FSMap version 44 2024-08-20T01:46:00.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.615+0000 7f6ad5fe8740 10 client.26966 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:46:00.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.615+0000 7f6ad5fe8740 20 client.26966 populate_metadata read hostname 'smithi079' 2024-08-20T01:46:00.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.615+0000 7f6ad5fe8740 1 --2- 172.21.15.79:0/2610672554 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55e520d0f8a0 0x55e520d11c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:00.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.615+0000 7f6ad5fe8740 4 client.26966 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:46:00.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.615+0000 7f6ad5fe8740 1 -- 172.21.15.79:0/2610672554 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e520bec320 con 0x55e520d0f8a0 2024-08-20T01:46:00.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.616+0000 7f6ad118a640 1 --2- 172.21.15.79:0/2610672554 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55e520d0f8a0 0x55e520d11c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:00.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.616+0000 7f6ab57fa640 10 client.26966 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:46:00.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.616+0000 7f6ad118a640 1 --2- 172.21.15.79:0/2610672554 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55e520d0f8a0 0x55e520d11c90 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ae0be8aae7838226 server_cookie=f66833540c66a12b in_seq=0 out_seq=0 2024-08-20T01:46:00.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.616+0000 7f6ab57fa640 1 -- 172.21.15.79:0/2610672554 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e520bec320 con 0x55e520d0f8a0 2024-08-20T01:46:00.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.616+0000 7f6ab57fa640 10 client.26966 handle_command_reply: tid=0 2024-08-20T01:46:00.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.616+0000 7f6ad5fe8740 1 client.26966 shutdown 2024-08-20T01:46:00.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.617+0000 7f6ad5fe8740 1 -- 172.21.15.79:0/2610672554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e520c77880 msgr2=0x55e520c8c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:00.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.617+0000 7f6ad5fe8740 1 --2- 172.21.15.79:0/2610672554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e520c77880 0x55e520c8c8a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8004c00 tx=0x7f6ac8005fd0 comp rx=0 tx=0).stop 2024-08-20T01:46:00.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.617+0000 7f6ad5fe8740 1 -- 172.21.15.79:0/2610672554 shutdown_connections 2024-08-20T01:46:00.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.617+0000 7f6ad5fe8740 1 --2- 172.21.15.79:0/2610672554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e520c84130 0x55e520c89450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:00.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.617+0000 7f6ad5fe8740 1 --2- 172.21.15.79:0/2610672554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e520c781a0 0x55e520c88d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:00.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.617+0000 7f6ad5fe8740 1 --2- 172.21.15.79:0/2610672554 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55e520d0f8a0 0x55e520d11c90 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:00.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.617+0000 7f6ad5fe8740 1 --2- 172.21.15.79:0/2610672554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e520c77880 0x55e520c8c8a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:00.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.617+0000 7f6ad5fe8740 1 -- 172.21.15.79:0/2610672554 >> 172.21.15.79:0/2610672554 conn(0x55e520c756b0 msgr2=0x55e520c73f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:00.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.617+0000 7f6ab57fa640 0 client.26966 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:46:00.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.617+0000 7f6ad5fe8740 1 -- 172.21.15.79:0/2610672554 shutdown_connections 2024-08-20T01:46:00.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.617+0000 7f6ad5fe8740 1 -- 172.21.15.79:0/2610672554 wait complete. 2024-08-20T01:46:00.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.617+0000 7f6ad5fe8740 20 client.26966 trim_cache size 0 max 16384 2024-08-20T01:46:00.623 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:46:00.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.618+0000 7f6ad3bef640 1 -- 172.21.15.79:0/3179249377 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6ab80b3c90 msgr2=0x7f6ab80b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:00.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.618+0000 7f6ad3bef640 1 --2- 172.21.15.79:0/3179249377 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6ab80b3c90 0x7f6ab80b6150 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6acc10e420 tx=0x7f6abc005f90 comp rx=0 tx=0).stop 2024-08-20T01:46:00.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.618+0000 7f6ad3bef640 1 -- 172.21.15.79:0/3179249377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6acc10f0d0 msgr2=0x7f6acc10be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:00.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.618+0000 7f6ad3bef640 1 --2- 172.21.15.79:0/3179249377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6acc10f0d0 0x7f6acc10be60 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f6ac400eb40 tx=0x7f6ac400c2d0 comp rx=0 tx=0).stop 2024-08-20T01:46:00.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.618+0000 7f6ad3bef640 1 -- 172.21.15.79:0/3179249377 shutdown_connections 2024-08-20T01:46:00.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.618+0000 7f6ad3bef640 1 --2- 172.21.15.79:0/3179249377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6acc10f0d0 0x7f6acc10be60 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:00.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.618+0000 7f6ad3bef640 1 --2- 172.21.15.79:0/3179249377 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6ab80b3c90 0x7f6ab80b6150 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:00.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.618+0000 7f6ad3bef640 1 --2- 172.21.15.79:0/3179249377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6acc075c70 0x7f6acc10b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:00.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.619+0000 7f6ad3bef640 1 --2- 172.21.15.79:0/3179249377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6acc075270 0x7f6acc10e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:00.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.619+0000 7f6ad3bef640 1 -- 172.21.15.79:0/3179249377 >> 172.21.15.79:0/3179249377 conn(0x7f6acc0fe520 msgr2=0x7f6acc102690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:00.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.619+0000 7f6ad3bef640 1 -- 172.21.15.79:0/3179249377 shutdown_connections 2024-08-20T01:46:00.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:00.619+0000 7f6ad3bef640 1 -- 172.21.15.79:0/3179249377 wait complete. 2024-08-20T01:46:01.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:01 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:46:01.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:01 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:46:01.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:01 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:46:01.679 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T01:46:02.065 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:46:02.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:02 smithi175 ceph-mon[22392]: pgmap v608: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 28 MiB/s wr, 7.06k op/s 2024-08-20T01:46:02.394 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:02 smithi079 ceph-mon[18656]: pgmap v608: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 28 MiB/s wr, 7.06k op/s 2024-08-20T01:46:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.443+0000 7f2d07f31640 1 -- 172.21.15.79:0/3543442574 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d001041b0 msgr2=0x7f2d0010ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.443+0000 7f2d07f31640 1 --2- 172.21.15.79:0/3543442574 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d001041b0 0x7f2d0010ab30 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8009cd0 tx=0x7f2cf802a8e0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.443+0000 7f2d07f31640 1 -- 172.21.15.79:0/3543442574 shutdown_connections 2024-08-20T01:46:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.443+0000 7f2d07f31640 1 --2- 172.21.15.79:0/3543442574 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d001041b0 0x7f2d0010ab30 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.443+0000 7f2d07f31640 1 --2- 172.21.15.79:0/3543442574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d001037f0 0x7f2d00103c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.443+0000 7f2d07f31640 1 --2- 172.21.15.79:0/3543442574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d001026a0 0x7f2d00102aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.443+0000 7f2d07f31640 1 -- 172.21.15.79:0/3543442574 >> 172.21.15.79:0/3543442574 conn(0x7f2d000fdf40 msgr2=0x7f2d00100380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.443+0000 7f2d07f31640 1 -- 172.21.15.79:0/3543442574 shutdown_connections 2024-08-20T01:46:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.443+0000 7f2d07f31640 1 -- 172.21.15.79:0/3543442574 wait complete. 2024-08-20T01:46:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.443+0000 7f2d07f31640 1 Processor -- start 2024-08-20T01:46:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.444+0000 7f2d07f31640 1 -- start start 2024-08-20T01:46:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.444+0000 7f2d07f31640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d001026a0 0x7f2d00198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.444+0000 7f2d07f31640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d001037f0 0x7f2d00198f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.444+0000 7f2d07f31640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d001041b0 0x7f2d00199ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.444+0000 7f2d07f31640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0010e1a0 con 0x7f2d001037f0 2024-08-20T01:46:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.444+0000 7f2d07f31640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0010e020 con 0x7f2d001041b0 2024-08-20T01:46:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.444+0000 7f2d07f31640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0010e320 con 0x7f2d001026a0 2024-08-20T01:46:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.444+0000 7f2d054cc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d001037f0 0x7f2d00198f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:02.449 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.444+0000 7f2d054cc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d001037f0 0x7f2d00198f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51364/0 (socket says 172.21.15.79:51364) 2024-08-20T01:46:02.449 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.444+0000 7f2d054cc640 1 -- 172.21.15.79:0/1015304581 learned_addr learned my addr 172.21.15.79:0/1015304581 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:02.449 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.444+0000 7f2d05ccd640 1 --2- 172.21.15.79:0/1015304581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d001026a0 0x7f2d00198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:02.449 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.444+0000 7f2d054cc640 1 -- 172.21.15.79:0/1015304581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d001026a0 msgr2=0x7f2d00198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:02.449 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.444+0000 7f2d054cc640 1 --2- 172.21.15.79:0/1015304581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d001026a0 0x7f2d00198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.449 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.444+0000 7f2d054cc640 1 -- 172.21.15.79:0/1015304581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d001041b0 msgr2=0x7f2d00199ba0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-20T01:46:02.449 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.444+0000 7f2d054cc640 1 --2- 172.21.15.79:0/1015304581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d001041b0 0x7f2d00199ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.449 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.444+0000 7f2d054cc640 1 -- 172.21.15.79:0/1015304581 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d0019a460 con 0x7f2d001037f0 2024-08-20T01:46:02.450 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.444+0000 7f2d054cc640 1 --2- 172.21.15.79:0/1015304581 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d001037f0 0x7f2d00198f70 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f2cf000ea60 tx=0x7f2cf000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:02.450 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.445+0000 7f2cf6ffd640 1 -- 172.21.15.79:0/1015304581 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf000cde0 con 0x7f2d001037f0 2024-08-20T01:46:02.450 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.445+0000 7f2d07f31640 1 -- 172.21.15.79:0/1015304581 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d0019a750 con 0x7f2d001037f0 2024-08-20T01:46:02.451 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.445+0000 7f2cf6ffd640 1 -- 172.21.15.79:0/1015304581 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2cf00035f0 con 0x7f2d001037f0 2024-08-20T01:46:02.451 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.445+0000 7f2cf6ffd640 1 -- 172.21.15.79:0/1015304581 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf0010690 con 0x7f2d001037f0 2024-08-20T01:46:02.451 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.445+0000 7f2d07f31640 1 -- 172.21.15.79:0/1015304581 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d001a0e20 con 0x7f2d001037f0 2024-08-20T01:46:02.451 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.448+0000 7f2d0adfe740 1 Processor -- start 2024-08-20T01:46:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.448+0000 7f2d0adfe740 1 -- start start 2024-08-20T01:46:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.448+0000 7f2d0adfe740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56481e44c8d0 0x56481e44ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.448+0000 7f2d0adfe740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56481e44f200 0x56481e4515f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.448+0000 7f2d0adfe740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56481e451c40 0x56481e454100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.448+0000 7f2d0adfe740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56481e3bf360 con 0x56481e44c8d0 2024-08-20T01:46:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.448+0000 7f2d0adfe740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56481e3ae860 con 0x56481e451c40 2024-08-20T01:46:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.448+0000 7f2d0adfe740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56481e3b28a0 con 0x56481e44f200 2024-08-20T01:46:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.448+0000 7f2cf6ffd640 1 -- 172.21.15.79:0/1015304581 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2cf0004000 con 0x7f2d001037f0 2024-08-20T01:46:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.448+0000 7f2d05ccd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56481e44f200 0x56481e4515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.448+0000 7f2d064ce640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56481e44c8d0 0x56481e44ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.448+0000 7f2d05ccd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56481e44f200 0x56481e4515f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:46700/0 (socket says 172.21.15.79:46700) 2024-08-20T01:46:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.448+0000 7f2d05ccd640 1 -- 172.21.15.79:0/25370426 learned_addr learned my addr 172.21.15.79:0/25370426 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.448+0000 7f2d054cc640 1 --2- 172.21.15.79:0/25370426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56481e451c40 0x56481e454100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.449+0000 7f2d064ce640 1 -- 172.21.15.79:0/25370426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56481e44f200 msgr2=0x56481e4515f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.449+0000 7f2d064ce640 1 --2- 172.21.15.79:0/25370426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56481e44f200 0x56481e4515f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.449+0000 7f2d064ce640 1 -- 172.21.15.79:0/25370426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56481e451c40 msgr2=0x56481e454100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.449+0000 7f2d064ce640 1 --2- 172.21.15.79:0/25370426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56481e451c40 0x56481e454100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.449+0000 7f2d064ce640 1 -- 172.21.15.79:0/25370426 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56481e355e40 con 0x56481e44c8d0 2024-08-20T01:46:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.449+0000 7f2d064ce640 1 --2- 172.21.15.79:0/25370426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56481e44c8d0 0x56481e44ecc0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f2d001996a0 tx=0x7f2cf8009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d30564cac24c60a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.449+0000 7f2cebfff640 1 -- 172.21.15.79:0/25370426 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf803f070 con 0x56481e44c8d0 2024-08-20T01:46:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.449+0000 7f2cf6ffd640 1 --2- 172.21.15.79:0/1015304581 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2cec0b3bd0 0x7f2cec0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.449+0000 7f2cebfff640 1 -- 172.21.15.79:0/25370426 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2cf8036040 con 0x56481e44c8d0 2024-08-20T01:46:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.449+0000 7f2cebfff640 1 -- 172.21.15.79:0/25370426 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf8004240 con 0x56481e44c8d0 2024-08-20T01:46:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.449+0000 7f2d05ccd640 1 --2- 172.21.15.79:0/1015304581 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2cec0b3bd0 0x7f2cec0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.449+0000 7f2cf6ffd640 1 -- 172.21.15.79:0/1015304581 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f2cf00e3f70 con 0x7f2d001037f0 2024-08-20T01:46:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.450+0000 7f2d0adfe740 1 -- 172.21.15.79:0/25370426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56481e44c8d0 msgr2=0x56481e44ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.450+0000 7f2d0adfe740 1 --2- 172.21.15.79:0/25370426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56481e44c8d0 0x56481e44ecc0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f2d001996a0 tx=0x7f2cf8009360 comp rx=0 tx=0).stop 2024-08-20T01:46:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.450+0000 7f2d05ccd640 1 --2- 172.21.15.79:0/1015304581 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2cec0b3bd0 0x7f2cec0b6090 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc005bc0 tx=0x7f2cfc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.450+0000 7f2d0adfe740 1 -- 172.21.15.79:0/25370426 shutdown_connections 2024-08-20T01:46:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.450+0000 7f2d0adfe740 1 --2- 172.21.15.79:0/25370426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56481e451c40 0x56481e454100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.450+0000 7f2d0adfe740 1 --2- 172.21.15.79:0/25370426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56481e44f200 0x56481e4515f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.450+0000 7f2d0adfe740 1 --2- 172.21.15.79:0/25370426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56481e44c8d0 0x56481e44ecc0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.450+0000 7f2d0adfe740 1 -- 172.21.15.79:0/25370426 >> 172.21.15.79:0/25370426 conn(0x56481e447a20 msgr2=0x56481e4487b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.450+0000 7f2d0adfe740 1 -- 172.21.15.79:0/25370426 shutdown_connections 2024-08-20T01:46:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.450+0000 7f2d0adfe740 1 -- 172.21.15.79:0/25370426 wait complete. 2024-08-20T01:46:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.450+0000 7f2d0adfe740 1 -- start start 2024-08-20T01:46:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.450+0000 7f2d0adfe740 1 Processor -- start 2024-08-20T01:46:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.451+0000 7f2d0adfe740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56481e44c8d0 0x56481e456070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.451+0000 7f2d0adfe740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56481e44f200 0x56481e456710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.451+0000 7f2d0adfe740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56481e451c40 0x56481e457270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.451+0000 7f2d0adfe740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56481e2e7ab0 con 0x56481e44c8d0 2024-08-20T01:46:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.451+0000 7f2d0adfe740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56481e335780 con 0x56481e44f200 2024-08-20T01:46:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.451+0000 7f2d0adfe740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56481e454bc0 con 0x56481e451c40 2024-08-20T01:46:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.451+0000 7f2d05ccd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56481e44c8d0 0x56481e456070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.451+0000 7f2d0adfe740 10 client.0 _ll_register_callbacks cb 0x56481e0bda00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:46:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.451+0000 7f2d05ccd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56481e44c8d0 0x56481e456070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51384/0 (socket says 172.21.15.79:51384) 2024-08-20T01:46:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.451+0000 7f2d05ccd640 1 -- 172.21.15.79:0/860592493 learned_addr learned my addr 172.21.15.79:0/860592493 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.451+0000 7f2d054cc640 1 --2- 172.21.15.79:0/860592493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56481e44f200 0x56481e456710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.451+0000 7f2d064ce640 1 --2- 172.21.15.79:0/860592493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56481e451c40 0x56481e457270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.452+0000 7f2d054cc640 1 -- 172.21.15.79:0/860592493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56481e451c40 msgr2=0x56481e457270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.452+0000 7f2d054cc640 1 --2- 172.21.15.79:0/860592493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56481e451c40 0x56481e457270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.452+0000 7f2d054cc640 1 -- 172.21.15.79:0/860592493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56481e44c8d0 msgr2=0x56481e456070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.452+0000 7f2d054cc640 1 --2- 172.21.15.79:0/860592493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56481e44c8d0 0x56481e456070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.452+0000 7f2d054cc640 1 -- 172.21.15.79:0/860592493 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56481e111790 con 0x56481e44f200 2024-08-20T01:46:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.452+0000 7f2d05ccd640 1 --2- 172.21.15.79:0/860592493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56481e44c8d0 0x56481e456070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:46:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.452+0000 7f2d054cc640 1 --2- 172.21.15.79:0/860592493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56481e44f200 0x56481e456710 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2cf00e1ad0 tx=0x7f2cf00e7640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d47bffa8dfd0a5f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.452+0000 7f2ce97fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:46:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.452+0000 7f2ce97fa640 1 -- 172.21.15.79:0/860592493 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf00042f0 con 0x56481e44f200 2024-08-20T01:46:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.452+0000 7f2ce97fa640 1 -- 172.21.15.79:0/860592493 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f2cf0003ac0 con 0x56481e44f200 2024-08-20T01:46:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.452+0000 7f2d0adfe740 1 -- 172.21.15.79:0/860592493 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56481e35de00 con 0x56481e44f200 2024-08-20T01:46:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.452+0000 7f2ce97fa640 1 -- 172.21.15.79:0/860592493 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f2cf00af2c0 con 0x56481e44f200 2024-08-20T01:46:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.452+0000 7f2d0adfe740 10 client.26975 fetch_fsmap learned FSMap version 44 2024-08-20T01:46:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.452+0000 7f2d0adfe740 1 -- 172.21.15.79:0/860592493 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x56481e18a620 con 0x56481e44f200 2024-08-20T01:46:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.453+0000 7f2ce97fa640 1 -- 172.21.15.79:0/860592493 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56481e35de00 con 0x56481e44f200 2024-08-20T01:46:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.453+0000 7f2ce97fa640 1 -- 172.21.15.79:0/860592493 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 44) ==== 8382+0+0 (secure 0 0 0) 0x7f2cf00a7160 con 0x56481e44f200 2024-08-20T01:46:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.453+0000 7f2d0adfe740 10 client.26975 fetch_fsmap finished waiting for FSMap version 44 2024-08-20T01:46:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.453+0000 7f2d0adfe740 10 client.26975 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:46:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.453+0000 7f2d0adfe740 20 client.26975 populate_metadata read hostname 'smithi079' 2024-08-20T01:46:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.453+0000 7f2d0adfe740 1 --2- 172.21.15.79:0/860592493 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56481e459600 0x56481e459a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.453+0000 7f2d0adfe740 4 client.26975 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:46:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.453+0000 7f2d0adfe740 1 -- 172.21.15.79:0/860592493 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56481e3c12b0 con 0x56481e459600 2024-08-20T01:46:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.453+0000 7f2d05ccd640 1 --2- 172.21.15.79:0/860592493 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56481e459600 0x56481e459a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.454+0000 7f2d05ccd640 1 --2- 172.21.15.79:0/860592493 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56481e459600 0x56481e459a30 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1676a2e233a555ab server_cookie=16809f21529c7ceb in_seq=0 out_seq=0 2024-08-20T01:46:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.454+0000 7f2ce97fa640 10 client.26975 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:46:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.454+0000 7f2ce97fa640 1 -- 172.21.15.79:0/860592493 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56481e3c12b0 con 0x56481e459600 2024-08-20T01:46:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.454+0000 7f2ce97fa640 10 client.26975 handle_command_reply: tid=0 2024-08-20T01:46:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.454+0000 7f2d0adfe740 1 client.26975 shutdown 2024-08-20T01:46:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.454+0000 7f2d0adfe740 1 -- 172.21.15.79:0/860592493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56481e44f200 msgr2=0x56481e456710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.454+0000 7f2d0adfe740 1 --2- 172.21.15.79:0/860592493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56481e44f200 0x56481e456710 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2cf00e1ad0 tx=0x7f2cf00e7640 comp rx=0 tx=0).stop 2024-08-20T01:46:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.454+0000 7f2d0adfe740 1 -- 172.21.15.79:0/860592493 shutdown_connections 2024-08-20T01:46:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.454+0000 7f2d0adfe740 1 --2- 172.21.15.79:0/860592493 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56481e459600 0x56481e459a30 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.454+0000 7f2d0adfe740 1 --2- 172.21.15.79:0/860592493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56481e451c40 0x56481e457270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.454+0000 7f2d0adfe740 1 --2- 172.21.15.79:0/860592493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56481e44f200 0x56481e456710 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.464 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.454+0000 7f2d0adfe740 1 --2- 172.21.15.79:0/860592493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56481e44c8d0 0x56481e456070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.464 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.454+0000 7f2ce97fa640 0 client.26975 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:46:02.464 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.454+0000 7f2d0adfe740 1 -- 172.21.15.79:0/860592493 >> 172.21.15.79:0/860592493 conn(0x56481e447a20 msgr2=0x56481e446ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:02.464 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.454+0000 7f2d0adfe740 1 -- 172.21.15.79:0/860592493 shutdown_connections 2024-08-20T01:46:02.464 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.454+0000 7f2d0adfe740 1 -- 172.21.15.79:0/860592493 wait complete. 2024-08-20T01:46:02.464 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.455+0000 7f2d0adfe740 20 client.26975 trim_cache size 0 max 16384 2024-08-20T01:46:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.475+0000 7f2d0adfe740 1 Processor -- start 2024-08-20T01:46:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.475+0000 7f2d0adfe740 1 -- start start 2024-08-20T01:46:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.475+0000 7f2d0adfe740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56481e44c8d0 0x56481e44bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.476+0000 7f2d0adfe740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56481e44f200 0x56481e4462c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.476+0000 7f2d0adfe740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56481e451c40 0x56481e446800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.476+0000 7f2d0adfe740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2d001a7920 con 0x56481e44f200 2024-08-20T01:46:02.480 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.476+0000 7f2d0adfe740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2d001a9550 con 0x56481e451c40 2024-08-20T01:46:02.480 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.476+0000 7f2d0adfe740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2d001a7ff0 con 0x56481e44c8d0 2024-08-20T01:46:02.480 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.476+0000 7f2d05ccd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56481e44c8d0 0x56481e44bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:02.480 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.476+0000 7f2d05ccd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56481e44c8d0 0x56481e44bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:46728/0 (socket says 172.21.15.79:46728) 2024-08-20T01:46:02.480 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.476+0000 7f2d05ccd640 1 -- 172.21.15.79:0/850057050 learned_addr learned my addr 172.21.15.79:0/850057050 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:02.480 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.476+0000 7f2d064ce640 1 --2- 172.21.15.79:0/850057050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56481e451c40 0x56481e446800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:02.480 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.476+0000 7f2d054cc640 1 --2- 172.21.15.79:0/850057050 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56481e44f200 0x56481e4462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:02.480 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.476+0000 7f2d05ccd640 1 -- 172.21.15.79:0/850057050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56481e451c40 msgr2=0x56481e446800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:02.480 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.476+0000 7f2d05ccd640 1 --2- 172.21.15.79:0/850057050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56481e451c40 0x56481e446800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.480 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.476+0000 7f2d05ccd640 1 -- 172.21.15.79:0/850057050 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56481e44f200 msgr2=0x56481e4462c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:02.480 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.476+0000 7f2d05ccd640 1 --2- 172.21.15.79:0/850057050 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56481e44f200 0x56481e4462c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.480 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.476+0000 7f2d05ccd640 1 -- 172.21.15.79:0/850057050 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56481e44f030 con 0x56481e44c8d0 2024-08-20T01:46:02.481 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.476+0000 7f2d05ccd640 1 --2- 172.21.15.79:0/850057050 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56481e44c8d0 0x56481e44bea0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x56481e46ce50 tx=0x7f2cfc01b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bbe7fa940656414 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:02.481 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.477+0000 7f2ceb7fe640 1 -- 172.21.15.79:0/850057050 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc039070 con 0x56481e44c8d0 2024-08-20T01:46:02.481 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.477+0000 7f2ceb7fe640 1 -- 172.21.15.79:0/850057050 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2cfc00fc20 con 0x56481e44c8d0 2024-08-20T01:46:02.481 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.477+0000 7f2ceb7fe640 1 -- 172.21.15.79:0/850057050 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc034b90 con 0x56481e44c8d0 2024-08-20T01:46:02.484 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.477+0000 7f2d0adfe740 1 -- 172.21.15.79:0/850057050 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56481e44c8d0 msgr2=0x56481e44bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:02.484 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.477+0000 7f2d0adfe740 1 --2- 172.21.15.79:0/850057050 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56481e44c8d0 0x56481e44bea0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x56481e46ce50 tx=0x7f2cfc01b000 comp rx=0 tx=0).stop 2024-08-20T01:46:02.485 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.477+0000 7f2d0adfe740 1 -- 172.21.15.79:0/850057050 shutdown_connections 2024-08-20T01:46:02.485 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.477+0000 7f2d0adfe740 1 --2- 172.21.15.79:0/850057050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56481e451c40 0x56481e446800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.485 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.477+0000 7f2d0adfe740 1 --2- 172.21.15.79:0/850057050 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56481e44f200 0x56481e4462c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.485 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.477+0000 7f2d0adfe740 1 --2- 172.21.15.79:0/850057050 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56481e44c8d0 0x56481e44bea0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.485 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.477+0000 7f2d0adfe740 1 -- 172.21.15.79:0/850057050 >> 172.21.15.79:0/850057050 conn(0x56481e447a20 msgr2=0x56481e454fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:02.485 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.477+0000 7f2d0adfe740 1 -- 172.21.15.79:0/850057050 shutdown_connections 2024-08-20T01:46:02.485 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.477+0000 7f2d0adfe740 1 -- 172.21.15.79:0/850057050 wait complete. 2024-08-20T01:46:02.485 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.478+0000 7f2d0adfe740 1 -- start start 2024-08-20T01:46:02.485 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.478+0000 7f2d0adfe740 1 Processor -- start 2024-08-20T01:46:02.485 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.478+0000 7f2d0adfe740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56481e44c8d0 0x56481e468020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:02.485 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.478+0000 7f2d0adfe740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56481e44f200 0x56481e466d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:02.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.478+0000 7f2d0adfe740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56481e451c40 0x56481e467260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:02.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.478+0000 7f2d0adfe740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2d001a8e50 con 0x56481e451c40 2024-08-20T01:46:02.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.478+0000 7f2d0adfe740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2d001a86c0 con 0x56481e44c8d0 2024-08-20T01:46:02.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.478+0000 7f2d0adfe740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2d001a5900 con 0x56481e44f200 2024-08-20T01:46:02.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.478+0000 7f2d0adfe740 10 client.0 _ll_register_callbacks cb 0x7f2cf000e9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:46:02.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.478+0000 7f2d05ccd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56481e44c8d0 0x56481e468020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:02.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.478+0000 7f2d05ccd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56481e44c8d0 0x56481e468020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:58292/0 (socket says 172.21.15.79:58292) 2024-08-20T01:46:02.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.478+0000 7f2d05ccd640 1 -- 172.21.15.79:0/2896553574 learned_addr learned my addr 172.21.15.79:0/2896553574 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:02.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.478+0000 7f2d054cc640 1 --2- 172.21.15.79:0/2896553574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56481e44f200 0x56481e466d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:02.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.478+0000 7f2d064ce640 1 --2- 172.21.15.79:0/2896553574 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56481e451c40 0x56481e467260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:02.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.479+0000 7f2d05ccd640 1 -- 172.21.15.79:0/2896553574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56481e44f200 msgr2=0x56481e466d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:02.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.479+0000 7f2d05ccd640 1 --2- 172.21.15.79:0/2896553574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56481e44f200 0x56481e466d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.479+0000 7f2d05ccd640 1 -- 172.21.15.79:0/2896553574 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56481e451c40 msgr2=0x56481e467260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:02.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.479+0000 7f2d05ccd640 1 --2- 172.21.15.79:0/2896553574 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56481e451c40 0x56481e467260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.479+0000 7f2d05ccd640 1 -- 172.21.15.79:0/2896553574 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56481e467a90 con 0x56481e44c8d0 2024-08-20T01:46:02.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.479+0000 7f2d05ccd640 1 --2- 172.21.15.79:0/2896553574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56481e44c8d0 0x56481e468020 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc01e840 tx=0x7f2cfc00fdd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=969ecd284ce56d40 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:02.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.479+0000 7f2ce97fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:46:02.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.479+0000 7f2ce97fa640 1 -- 172.21.15.79:0/2896553574 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc039070 con 0x56481e44c8d0 2024-08-20T01:46:02.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.479+0000 7f2ce97fa640 1 -- 172.21.15.79:0/2896553574 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f2cfc00f790 con 0x56481e44c8d0 2024-08-20T01:46:02.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.479+0000 7f2d0adfe740 1 -- 172.21.15.79:0/2896553574 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2cfc00fc20 con 0x56481e44c8d0 2024-08-20T01:46:02.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.479+0000 7f2ce97fa640 1 -- 172.21.15.79:0/2896553574 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f2cfc00f990 con 0x56481e44c8d0 2024-08-20T01:46:02.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.479+0000 7f2d0adfe740 10 client.26981 fetch_fsmap learned FSMap version 44 2024-08-20T01:46:02.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.479+0000 7f2d0adfe740 1 -- 172.21.15.79:0/2896553574 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x56481e4d4e80 con 0x56481e44c8d0 2024-08-20T01:46:02.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.480+0000 7f2ce97fa640 1 -- 172.21.15.79:0/2896553574 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2cfc00fc20 con 0x56481e44c8d0 2024-08-20T01:46:02.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.480+0000 7f2ce97fa640 1 -- 172.21.15.79:0/2896553574 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 44) ==== 8382+0+0 (secure 0 0 0) 0x7f2cfc005490 con 0x56481e44c8d0 2024-08-20T01:46:02.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.480+0000 7f2d0adfe740 10 client.26981 fetch_fsmap finished waiting for FSMap version 44 2024-08-20T01:46:02.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.480+0000 7f2d0adfe740 10 client.26981 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:46:02.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.480+0000 7f2d0adfe740 20 client.26981 populate_metadata read hostname 'smithi079' 2024-08-20T01:46:02.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.480+0000 7f2d0adfe740 1 --2- 172.21.15.79:0/2896553574 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56481e4d58b0 0x56481e4d7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:02.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.480+0000 7f2d0adfe740 4 client.26981 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:46:02.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.480+0000 7f2d0adfe740 1 -- 172.21.15.79:0/2896553574 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56481e3bcd50 con 0x56481e4d58b0 2024-08-20T01:46:02.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.480+0000 7f2d054cc640 1 --2- 172.21.15.79:0/2896553574 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56481e4d58b0 0x56481e4d7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:02.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.480+0000 7f2ce97fa640 10 client.26981 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:46:02.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:02.480+0000 7f2d054cc640 1 --2- 172.21.15.79:0/2896553574 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56481e4d58b0 0x56481e4d7cd0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=981980d5844ee5c6 server_cookie=7d842244e5bcfff0 in_seq=0 out_seq=0 2024-08-20T01:46:02.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:02 smithi081 ceph-mon[22209]: pgmap v608: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 28 MiB/s wr, 7.06k op/s 2024-08-20T01:46:02.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.643+0000 7fc470d3f640 1 -- 172.21.15.79:0/2585888462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc46c104290 msgr2=0x7fc46c10c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:02.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.643+0000 7fc470d3f640 1 --2- 172.21.15.79:0/2585888462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc46c104290 0x7fc46c10c870 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fc460009900 tx=0x7fc46002a410 comp rx=0 tx=0).stop 2024-08-20T01:46:02.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.643+0000 7fc470d3f640 1 -- 172.21.15.79:0/2585888462 shutdown_connections 2024-08-20T01:46:02.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.643+0000 7fc470d3f640 1 --2- 172.21.15.79:0/2585888462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc46c10ce40 0x7fc46c10f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.643+0000 7fc470d3f640 1 --2- 172.21.15.79:0/2585888462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc46c104290 0x7fc46c10c870 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.643+0000 7fc470d3f640 1 --2- 172.21.15.79:0/2585888462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc46c103890 0x7fc46c103c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.643+0000 7fc470d3f640 1 -- 172.21.15.79:0/2585888462 >> 172.21.15.79:0/2585888462 conn(0x7fc46c0fd400 msgr2=0x7fc46c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:02.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.643+0000 7fc470d3f640 1 -- 172.21.15.79:0/2585888462 shutdown_connections 2024-08-20T01:46:02.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.643+0000 7fc470d3f640 1 -- 172.21.15.79:0/2585888462 wait complete. 2024-08-20T01:46:02.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.644+0000 7fc470d3f640 1 Processor -- start 2024-08-20T01:46:02.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.644+0000 7fc470d3f640 1 -- start start 2024-08-20T01:46:02.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.645+0000 7fc470d3f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc46c103890 0x7fc46c198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:02.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.645+0000 7fc470d3f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc46c104290 0x7fc46c1993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:02.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.645+0000 7fc470d3f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc46c10ce40 0x7fc46c19e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:02.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.645+0000 7fc470d3f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc46c112960 con 0x7fc46c10ce40 2024-08-20T01:46:02.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.645+0000 7fc470d3f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc46c1127e0 con 0x7fc46c103890 2024-08-20T01:46:02.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.645+0000 7fc470d3f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc46c112ae0 con 0x7fc46c104290 2024-08-20T01:46:02.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.645+0000 7fc46a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc46c103890 0x7fc46c198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:02.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.645+0000 7fc46a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc46c103890 0x7fc46c198eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:58306/0 (socket says 172.21.15.79:58306) 2024-08-20T01:46:02.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.645+0000 7fc469d9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc46c104290 0x7fc46c1993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:02.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.645+0000 7fc46a59c640 1 -- 172.21.15.79:0/4104817130 learned_addr learned my addr 172.21.15.79:0/4104817130 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:02.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.645+0000 7fc46ad9d640 1 --2- 172.21.15.79:0/4104817130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc46c10ce40 0x7fc46c19e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:02.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.645+0000 7fc46a59c640 1 -- 172.21.15.79:0/4104817130 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc46c104290 msgr2=0x7fc46c1993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:02.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.645+0000 7fc46a59c640 1 --2- 172.21.15.79:0/4104817130 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc46c104290 0x7fc46c1993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.645+0000 7fc46a59c640 1 -- 172.21.15.79:0/4104817130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc46c10ce40 msgr2=0x7fc46c19e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:02.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.645+0000 7fc46a59c640 1 --2- 172.21.15.79:0/4104817130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc46c10ce40 0x7fc46c19e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.645+0000 7fc46a59c640 1 -- 172.21.15.79:0/4104817130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc46c19ef60 con 0x7fc46c103890 2024-08-20T01:46:02.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.645+0000 7fc469d9b640 1 --2- 172.21.15.79:0/4104817130 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc46c104290 0x7fc46c1993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:46:02.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.645+0000 7fc46a59c640 1 --2- 172.21.15.79:0/4104817130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc46c103890 0x7fc46c198eb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc45c00e9f0 tx=0x7fc45c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:02.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.646+0000 7fc45b7fe640 1 -- 172.21.15.79:0/4104817130 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc45c00cd80 con 0x7fc46c103890 2024-08-20T01:46:02.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.646+0000 7fc45b7fe640 1 -- 172.21.15.79:0/4104817130 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc45c0108c0 con 0x7fc46c103890 2024-08-20T01:46:02.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.646+0000 7fc470d3f640 1 -- 172.21.15.79:0/4104817130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc46c19f250 con 0x7fc46c103890 2024-08-20T01:46:02.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.646+0000 7fc45b7fe640 1 -- 172.21.15.79:0/4104817130 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc45c0187c0 con 0x7fc46c103890 2024-08-20T01:46:02.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.646+0000 7fc470d3f640 1 -- 172.21.15.79:0/4104817130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc46c1015f0 con 0x7fc46c103890 2024-08-20T01:46:02.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.648+0000 7fc473138740 1 Processor -- start 2024-08-20T01:46:02.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.648+0000 7fc473138740 1 -- start start 2024-08-20T01:46:02.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.648+0000 7fc473138740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584b63bd880 0x5584b63bdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:02.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.648+0000 7fc473138740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584b63be1a0 0x5584b63c9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:02.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.649+0000 7fc473138740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584b63ca130 0x5584b63cc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:02.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.649+0000 7fc473138740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5584b6334930 con 0x5584b63bd880 2024-08-20T01:46:02.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.649+0000 7fc473138740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5584b6323e30 con 0x5584b63be1a0 2024-08-20T01:46:02.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.649+0000 7fc473138740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5584b6327e70 con 0x5584b63ca130 2024-08-20T01:46:02.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.649+0000 7fc46ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584b63bd880 0x5584b63bdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:02.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.649+0000 7fc46ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584b63bd880 0x5584b63bdc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51426/0 (socket says 172.21.15.79:51426) 2024-08-20T01:46:02.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.649+0000 7fc46ad9d640 1 -- 172.21.15.79:0/2880901450 learned_addr learned my addr 172.21.15.79:0/2880901450 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:02.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.649+0000 7fc469d9b640 1 --2- 172.21.15.79:0/2880901450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584b63ca130 0x5584b63cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:02.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.649+0000 7fc46ad9d640 1 -- 172.21.15.79:0/2880901450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584b63ca130 msgr2=0x5584b63cc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:02.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.649+0000 7fc46ad9d640 1 --2- 172.21.15.79:0/2880901450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584b63ca130 0x5584b63cc520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.649+0000 7fc46ad9d640 1 -- 172.21.15.79:0/2880901450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584b63be1a0 msgr2=0x5584b63c9bf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:46:02.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.649+0000 7fc46ad9d640 1 --2- 172.21.15.79:0/2880901450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584b63be1a0 0x5584b63c9bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.649+0000 7fc46ad9d640 1 -- 172.21.15.79:0/2880901450 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584b6083650 con 0x5584b63bd880 2024-08-20T01:46:02.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.649+0000 7fc45b7fe640 1 -- 172.21.15.79:0/4104817130 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc45c010430 con 0x7fc46c103890 2024-08-20T01:46:02.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.649+0000 7fc46ad9d640 1 --2- 172.21.15.79:0/2880901450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584b63bd880 0x5584b63bdc60 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fc4640103a0 tx=0x7fc464010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33ac025d74ef3fd4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:02.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.649+0000 7fc458ff9640 1 -- 172.21.15.79:0/2880901450 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc464016070 con 0x5584b63bd880 2024-08-20T01:46:02.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.650+0000 7fc458ff9640 1 -- 172.21.15.79:0/2880901450 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc464004d20 con 0x5584b63bd880 2024-08-20T01:46:02.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.650+0000 7fc458ff9640 1 -- 172.21.15.79:0/2880901450 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc464005350 con 0x5584b63bd880 2024-08-20T01:46:02.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.650+0000 7fc473138740 1 -- 172.21.15.79:0/2880901450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584b63bd880 msgr2=0x5584b63bdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:02.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.650+0000 7fc473138740 1 --2- 172.21.15.79:0/2880901450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584b63bd880 0x5584b63bdc60 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fc4640103a0 tx=0x7fc464010860 comp rx=0 tx=0).stop 2024-08-20T01:46:02.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.651+0000 7fc473138740 1 -- 172.21.15.79:0/2880901450 shutdown_connections 2024-08-20T01:46:02.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.651+0000 7fc473138740 1 --2- 172.21.15.79:0/2880901450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584b63ca130 0x5584b63cc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.651+0000 7fc473138740 1 --2- 172.21.15.79:0/2880901450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584b63be1a0 0x5584b63c9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.651+0000 7fc473138740 1 --2- 172.21.15.79:0/2880901450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584b63bd880 0x5584b63bdc60 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.651+0000 7fc473138740 1 -- 172.21.15.79:0/2880901450 >> 172.21.15.79:0/2880901450 conn(0x5584b63bb6b0 msgr2=0x5584b63bc850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:02.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.651+0000 7fc45b7fe640 1 --2- 172.21.15.79:0/4104817130 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc4540b3c50 0x7fc4540b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:02.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.651+0000 7fc473138740 1 -- 172.21.15.79:0/2880901450 shutdown_connections 2024-08-20T01:46:02.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.651+0000 7fc45b7fe640 1 -- 172.21.15.79:0/4104817130 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc45c0e3fc0 con 0x7fc46c103890 2024-08-20T01:46:02.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.651+0000 7fc469d9b640 1 --2- 172.21.15.79:0/4104817130 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc4540b3c50 0x7fc4540b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:02.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.651+0000 7fc473138740 1 -- 172.21.15.79:0/2880901450 wait complete. 2024-08-20T01:46:02.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.651+0000 7fc473138740 1 -- start start 2024-08-20T01:46:02.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.652+0000 7fc473138740 1 Processor -- start 2024-08-20T01:46:02.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.652+0000 7fc469d9b640 1 --2- 172.21.15.79:0/4104817130 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc4540b3c50 0x7fc4540b6110 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc460006010 tx=0x7fc460000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:02.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.652+0000 7fc473138740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584b63bd880 0x5584b63c7160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:02.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.652+0000 7fc473138740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584b63be1a0 0x5584b63c76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:02.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.652+0000 7fc473138740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584b63ca130 0x5584b63c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:02.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.652+0000 7fc469d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584b63be1a0 0x5584b63c76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:02.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.652+0000 7fc469d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584b63be1a0 0x5584b63c76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51434/0 (socket says 172.21.15.79:51434) 2024-08-20T01:46:02.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.652+0000 7fc469d9b640 1 -- 172.21.15.79:0/584383002 learned_addr learned my addr 172.21.15.79:0/584383002 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:02.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.652+0000 7fc473138740 1 -- 172.21.15.79:0/584383002 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5584b6186700 con 0x5584b63be1a0 2024-08-20T01:46:02.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.652+0000 7fc473138740 1 -- 172.21.15.79:0/584383002 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5584b62aa810 con 0x5584b63bd880 2024-08-20T01:46:02.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.652+0000 7fc473138740 1 -- 172.21.15.79:0/584383002 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5584b63ccde0 con 0x5584b63ca130 2024-08-20T01:46:02.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.652+0000 7fc473138740 10 client.0 _ll_register_callbacks cb 0x5584b631d700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:46:02.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.652+0000 7fc46ad9d640 1 --2- 172.21.15.79:0/584383002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584b63ca130 0x5584b63c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:02.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.652+0000 7fc46a59c640 1 --2- 172.21.15.79:0/584383002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584b63bd880 0x5584b63c7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:02.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.653+0000 7fc469d9b640 1 -- 172.21.15.79:0/584383002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584b63ca130 msgr2=0x5584b63c7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:02.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.653+0000 7fc469d9b640 1 --2- 172.21.15.79:0/584383002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584b63ca130 0x5584b63c7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.653+0000 7fc469d9b640 1 -- 172.21.15.79:0/584383002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584b63bd880 msgr2=0x5584b63c7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:02.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.653+0000 7fc469d9b640 1 --2- 172.21.15.79:0/584383002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584b63bd880 0x5584b63c7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.653+0000 7fc469d9b640 1 -- 172.21.15.79:0/584383002 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584b63dea50 con 0x5584b63be1a0 2024-08-20T01:46:02.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.653+0000 7fc469d9b640 1 --2- 172.21.15.79:0/584383002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584b63be1a0 0x5584b63c76a0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fc460009900 tx=0x7fc46002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f88d705839856dd server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:02.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.653+0000 7fc451ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:46:02.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.653+0000 7fc451ffb640 1 -- 172.21.15.79:0/584383002 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc460035040 con 0x5584b63be1a0 2024-08-20T01:46:02.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.653+0000 7fc451ffb640 1 -- 172.21.15.79:0/584383002 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc460003df0 con 0x5584b63be1a0 2024-08-20T01:46:02.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.653+0000 7fc473138740 1 -- 172.21.15.79:0/584383002 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5584b62d3150 con 0x5584b63be1a0 2024-08-20T01:46:02.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.653+0000 7fc451ffb640 1 -- 172.21.15.79:0/584383002 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fc46003d460 con 0x5584b63be1a0 2024-08-20T01:46:02.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.653+0000 7fc473138740 10 client.17988 fetch_fsmap learned FSMap version 44 2024-08-20T01:46:02.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.653+0000 7fc473138740 1 -- 172.21.15.79:0/584383002 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5584b63e13e0 con 0x5584b63be1a0 2024-08-20T01:46:02.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.654+0000 7fc451ffb640 1 -- 172.21.15.79:0/584383002 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5584b62d3150 con 0x5584b63be1a0 2024-08-20T01:46:02.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.654+0000 7fc451ffb640 1 -- 172.21.15.79:0/584383002 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 44) ==== 8382+0+0 (secure 0 0 0) 0x7fc46003b650 con 0x5584b63be1a0 2024-08-20T01:46:02.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.654+0000 7fc473138740 10 client.17988 fetch_fsmap finished waiting for FSMap version 44 2024-08-20T01:46:02.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.654+0000 7fc473138740 10 client.17988 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:46:02.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.654+0000 7fc473138740 20 client.17988 populate_metadata read hostname 'smithi079' 2024-08-20T01:46:02.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.654+0000 7fc473138740 1 --2- 172.21.15.79:0/584383002 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5584b63e2b50 0x5584b63e4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:02.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.654+0000 7fc473138740 4 client.17988 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:46:02.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.654+0000 7fc473138740 1 -- 172.21.15.79:0/584383002 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5584b6336880 con 0x5584b63e2b50 2024-08-20T01:46:02.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.654+0000 7fc46a59c640 1 --2- 172.21.15.79:0/584383002 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5584b63e2b50 0x5584b63e4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:02.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.655+0000 7fc46a59c640 1 --2- 172.21.15.79:0/584383002 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5584b63e2b50 0x5584b63e4f40 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7290f5064b4ae524 server_cookie=36f4b3af1aaf395 in_seq=0 out_seq=0 2024-08-20T01:46:02.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.655+0000 7fc451ffb640 10 client.17988 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:46:02.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.655+0000 7fc451ffb640 1 -- 172.21.15.79:0/584383002 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5584b6336880 con 0x5584b63e2b50 2024-08-20T01:46:02.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.655+0000 7fc451ffb640 10 client.17988 handle_command_reply: tid=0 2024-08-20T01:46:02.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.655+0000 7fc473138740 1 client.17988 shutdown 2024-08-20T01:46:02.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.655+0000 7fc473138740 1 -- 172.21.15.79:0/584383002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584b63be1a0 msgr2=0x5584b63c76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:02.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.655+0000 7fc473138740 1 --2- 172.21.15.79:0/584383002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584b63be1a0 0x5584b63c76a0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fc460009900 tx=0x7fc46002a410 comp rx=0 tx=0).stop 2024-08-20T01:46:02.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.656+0000 7fc473138740 1 -- 172.21.15.79:0/584383002 shutdown_connections 2024-08-20T01:46:02.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.656+0000 7fc473138740 1 --2- 172.21.15.79:0/584383002 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5584b63e2b50 0x5584b63e4f40 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.656+0000 7fc473138740 1 --2- 172.21.15.79:0/584383002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584b63ca130 0x5584b63c7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.656+0000 7fc473138740 1 --2- 172.21.15.79:0/584383002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584b63be1a0 0x5584b63c76a0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.656+0000 7fc473138740 1 --2- 172.21.15.79:0/584383002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584b63bd880 0x5584b63c7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.656+0000 7fc473138740 1 -- 172.21.15.79:0/584383002 >> 172.21.15.79:0/584383002 conn(0x5584b63bb6b0 msgr2=0x5584b63c1250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:02.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.656+0000 7fc451ffb640 0 client.17988 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:46:02.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.656+0000 7fc473138740 1 -- 172.21.15.79:0/584383002 shutdown_connections 2024-08-20T01:46:02.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.656+0000 7fc473138740 1 -- 172.21.15.79:0/584383002 wait complete. 2024-08-20T01:46:02.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.656+0000 7fc473138740 20 client.17988 trim_cache size 0 max 16384 2024-08-20T01:46:02.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.670+0000 7fc473138740 1 Processor -- start 2024-08-20T01:46:02.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.670+0000 7fc473138740 1 -- start start 2024-08-20T01:46:02.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.671+0000 7fc473138740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584b63bd880 0x5584b63c1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:02.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.671+0000 7fc473138740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584b63be1a0 0x5584b63c8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:02.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.671+0000 7fc473138740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584b63ca130 0x5584b63ea5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:02.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.671+0000 7fc473138740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc46c1abd50 con 0x5584b63ca130 2024-08-20T01:46:02.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.671+0000 7fc473138740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc46c1ad980 con 0x5584b63be1a0 2024-08-20T01:46:02.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.671+0000 7fc473138740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc46c1ac420 con 0x5584b63bd880 2024-08-20T01:46:02.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.671+0000 7fc469d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584b63be1a0 0x5584b63c8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:02.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.671+0000 7fc46ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584b63ca130 0x5584b63ea5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:02.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.671+0000 7fc469d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584b63be1a0 0x5584b63c8ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:58322/0 (socket says 172.21.15.79:58322) 2024-08-20T01:46:02.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.671+0000 7fc469d9b640 1 -- 172.21.15.79:0/3770778196 learned_addr learned my addr 172.21.15.79:0/3770778196 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:02.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.671+0000 7fc46a59c640 1 --2- 172.21.15.79:0/3770778196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584b63bd880 0x5584b63c1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:02.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.671+0000 7fc469d9b640 1 -- 172.21.15.79:0/3770778196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584b63bd880 msgr2=0x5584b63c1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:02.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.671+0000 7fc469d9b640 1 --2- 172.21.15.79:0/3770778196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584b63bd880 0x5584b63c1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.671+0000 7fc469d9b640 1 -- 172.21.15.79:0/3770778196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584b63ca130 msgr2=0x5584b63ea5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:02.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.671+0000 7fc469d9b640 1 --2- 172.21.15.79:0/3770778196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584b63ca130 0x5584b63ea5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.671+0000 7fc469d9b640 1 -- 172.21.15.79:0/3770778196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584b63bdfd0 con 0x5584b63be1a0 2024-08-20T01:46:02.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.671+0000 7fc46ad9d640 1 --2- 172.21.15.79:0/3770778196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584b63ca130 0x5584b63ea5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:46:02.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.671+0000 7fc46a59c640 1 --2- 172.21.15.79:0/3770778196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584b63bd880 0x5584b63c1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:46:02.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.671+0000 7fc469d9b640 1 --2- 172.21.15.79:0/3770778196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584b63be1a0 0x5584b63c8ea0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc46002a930 tx=0x7fc4600044b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fa947cf26af0725 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:02.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.672+0000 7fc453fff640 1 -- 172.21.15.79:0/3770778196 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc46003b450 con 0x5584b63be1a0 2024-08-20T01:46:02.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.672+0000 7fc453fff640 1 -- 172.21.15.79:0/3770778196 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc46003b5f0 con 0x5584b63be1a0 2024-08-20T01:46:02.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.672+0000 7fc453fff640 1 -- 172.21.15.79:0/3770778196 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4600494d0 con 0x5584b63be1a0 2024-08-20T01:46:02.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.672+0000 7fc473138740 1 -- 172.21.15.79:0/3770778196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584b63be1a0 msgr2=0x5584b63c8ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:02.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.672+0000 7fc473138740 1 --2- 172.21.15.79:0/3770778196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584b63be1a0 0x5584b63c8ea0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc46002a930 tx=0x7fc4600044b0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.672+0000 7fc473138740 1 -- 172.21.15.79:0/3770778196 shutdown_connections 2024-08-20T01:46:02.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.672+0000 7fc473138740 1 --2- 172.21.15.79:0/3770778196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584b63ca130 0x5584b63ea5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.672+0000 7fc473138740 1 --2- 172.21.15.79:0/3770778196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584b63be1a0 0x5584b63c8ea0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.672+0000 7fc473138740 1 --2- 172.21.15.79:0/3770778196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584b63bd880 0x5584b63c1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.672+0000 7fc473138740 1 -- 172.21.15.79:0/3770778196 >> 172.21.15.79:0/3770778196 conn(0x5584b63bb6b0 msgr2=0x5584b63c8790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:02.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.672+0000 7fc473138740 1 -- 172.21.15.79:0/3770778196 shutdown_connections 2024-08-20T01:46:02.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.672+0000 7fc473138740 1 -- 172.21.15.79:0/3770778196 wait complete. 2024-08-20T01:46:02.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.673+0000 7fc473138740 1 -- start start 2024-08-20T01:46:02.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.673+0000 7fc473138740 1 Processor -- start 2024-08-20T01:46:02.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.673+0000 7fc473138740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584b63bd880 0x5584b63d5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:02.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.673+0000 7fc473138740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584b63be1a0 0x5584b63d6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:02.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.673+0000 7fc473138740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584b63ca130 0x5584b644b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:02.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.673+0000 7fc473138740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc46c1ad280 con 0x5584b63bd880 2024-08-20T01:46:02.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.673+0000 7fc473138740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc46c1acaf0 con 0x5584b63be1a0 2024-08-20T01:46:02.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.673+0000 7fc473138740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc46c1a9d30 con 0x5584b63ca130 2024-08-20T01:46:02.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.673+0000 7fc473138740 10 client.0 _ll_register_callbacks cb 0x7fc460009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:46:02.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.673+0000 7fc46a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584b63bd880 0x5584b63d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:02.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.673+0000 7fc469d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584b63be1a0 0x5584b63d6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:02.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.673+0000 7fc46a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584b63bd880 0x5584b63d5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51454/0 (socket says 172.21.15.79:51454) 2024-08-20T01:46:02.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.673+0000 7fc46a59c640 1 -- 172.21.15.79:0/3012764100 learned_addr learned my addr 172.21.15.79:0/3012764100 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:02.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.673+0000 7fc46a59c640 1 -- 172.21.15.79:0/3012764100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584b63ca130 msgr2=0x5584b644b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:02.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.673+0000 7fc46ad9d640 1 --2- 172.21.15.79:0/3012764100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584b63ca130 0x5584b644b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:02.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.673+0000 7fc46a59c640 1 --2- 172.21.15.79:0/3012764100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584b63ca130 0x5584b644b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.673+0000 7fc46a59c640 1 -- 172.21.15.79:0/3012764100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584b63be1a0 msgr2=0x5584b63d6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:02.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.673+0000 7fc46a59c640 1 --2- 172.21.15.79:0/3012764100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584b63be1a0 0x5584b63d6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.673+0000 7fc46a59c640 1 -- 172.21.15.79:0/3012764100 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584b644baa0 con 0x5584b63bd880 2024-08-20T01:46:02.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.673+0000 7fc469d9b640 1 --2- 172.21.15.79:0/3012764100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584b63be1a0 0x5584b63d6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:46:02.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.674+0000 7fc46a59c640 1 --2- 172.21.15.79:0/3012764100 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584b63bd880 0x5584b63d5cf0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fc45c00cfd0 tx=0x7fc45c0a6eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44ad67b89637841 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:02.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.674+0000 7fc451ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:46:02.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.674+0000 7fc451ffb640 1 -- 172.21.15.79:0/3012764100 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc45c0e1b80 con 0x5584b63bd880 2024-08-20T01:46:02.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.674+0000 7fc451ffb640 1 -- 172.21.15.79:0/3012764100 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc45c0a7200 con 0x5584b63bd880 2024-08-20T01:46:02.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.674+0000 7fc473138740 1 -- 172.21.15.79:0/3012764100 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc46003b5f0 con 0x5584b63bd880 2024-08-20T01:46:02.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.674+0000 7fc451ffb640 1 -- 172.21.15.79:0/3012764100 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fc45c0aa1d0 con 0x5584b63bd880 2024-08-20T01:46:02.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.674+0000 7fc473138740 10 client.17994 fetch_fsmap learned FSMap version 44 2024-08-20T01:46:02.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.674+0000 7fc473138740 1 -- 172.21.15.79:0/3012764100 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5584b644cdd0 con 0x5584b63bd880 2024-08-20T01:46:02.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.674+0000 7fc451ffb640 1 -- 172.21.15.79:0/3012764100 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc46003b5f0 con 0x5584b63bd880 2024-08-20T01:46:02.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.674+0000 7fc451ffb640 1 -- 172.21.15.79:0/3012764100 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 44) ==== 8382+0+0 (secure 0 0 0) 0x7fc45c0a9c40 con 0x5584b63bd880 2024-08-20T01:46:02.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.674+0000 7fc473138740 10 client.17994 fetch_fsmap finished waiting for FSMap version 44 2024-08-20T01:46:02.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.674+0000 7fc473138740 10 client.17994 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:46:02.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.675+0000 7fc473138740 20 client.17994 populate_metadata read hostname 'smithi079' 2024-08-20T01:46:02.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.675+0000 7fc473138740 1 --2- 172.21.15.79:0/3012764100 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5584b644d530 0x5584b644f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:02.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.675+0000 7fc473138740 4 client.17994 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:46:02.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.675+0000 7fc473138740 1 -- 172.21.15.79:0/3012764100 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5584b6332320 con 0x5584b644d530 2024-08-20T01:46:02.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.675+0000 7fc469d9b640 1 --2- 172.21.15.79:0/3012764100 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5584b644d530 0x5584b644f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:02.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.675+0000 7fc451ffb640 10 client.17994 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:46:02.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.675+0000 7fc469d9b640 1 --2- 172.21.15.79:0/3012764100 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5584b644d530 0x5584b644f950 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e784e1a9ebe6f8c2 server_cookie=19a7cf2f49878e33 in_seq=0 out_seq=0 2024-08-20T01:46:02.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.675+0000 7fc451ffb640 1 -- 172.21.15.79:0/3012764100 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5584b6332320 con 0x5584b644d530 2024-08-20T01:46:02.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.675+0000 7fc451ffb640 10 client.17994 handle_command_reply: tid=0 2024-08-20T01:46:02.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.675+0000 7fc473138740 1 client.17994 shutdown 2024-08-20T01:46:02.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.675+0000 7fc473138740 1 -- 172.21.15.79:0/3012764100 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584b63bd880 msgr2=0x5584b63d5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:02.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.675+0000 7fc473138740 1 --2- 172.21.15.79:0/3012764100 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584b63bd880 0x5584b63d5cf0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fc45c00cfd0 tx=0x7fc45c0a6eb0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.675+0000 7fc473138740 1 -- 172.21.15.79:0/3012764100 shutdown_connections 2024-08-20T01:46:02.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.675+0000 7fc473138740 1 --2- 172.21.15.79:0/3012764100 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5584b644d530 0x5584b644f950 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.675+0000 7fc473138740 1 --2- 172.21.15.79:0/3012764100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584b63ca130 0x5584b644b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.675+0000 7fc473138740 1 --2- 172.21.15.79:0/3012764100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5584b63be1a0 0x5584b63d6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.675+0000 7fc451ffb640 0 client.17994 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:46:02.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.675+0000 7fc473138740 1 --2- 172.21.15.79:0/3012764100 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5584b63bd880 0x5584b63d5cf0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.675+0000 7fc473138740 1 -- 172.21.15.79:0/3012764100 >> 172.21.15.79:0/3012764100 conn(0x5584b63bb6b0 msgr2=0x5584b63c8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:02.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.675+0000 7fc473138740 1 -- 172.21.15.79:0/3012764100 shutdown_connections 2024-08-20T01:46:02.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.676+0000 7fc473138740 1 -- 172.21.15.79:0/3012764100 wait complete. 2024-08-20T01:46:02.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.676+0000 7fc473138740 20 client.17994 trim_cache size 0 max 16384 2024-08-20T01:46:02.685 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:46:02.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.676+0000 7fc470d3f640 1 -- 172.21.15.79:0/4104817130 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc4540b3c50 msgr2=0x7fc4540b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:02.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.676+0000 7fc470d3f640 1 --2- 172.21.15.79:0/4104817130 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc4540b3c50 0x7fc4540b6110 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc460006010 tx=0x7fc460000bc0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.676+0000 7fc470d3f640 1 -- 172.21.15.79:0/4104817130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc46c103890 msgr2=0x7fc46c198eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:02.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.676+0000 7fc470d3f640 1 --2- 172.21.15.79:0/4104817130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc46c103890 0x7fc46c198eb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc45c00e9f0 tx=0x7fc45c00eeb0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.676+0000 7fc470d3f640 1 -- 172.21.15.79:0/4104817130 shutdown_connections 2024-08-20T01:46:02.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.676+0000 7fc470d3f640 1 --2- 172.21.15.79:0/4104817130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc46c10ce40 0x7fc46c19e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.676+0000 7fc470d3f640 1 --2- 172.21.15.79:0/4104817130 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc4540b3c50 0x7fc4540b6110 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.676+0000 7fc470d3f640 1 --2- 172.21.15.79:0/4104817130 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc46c104290 0x7fc46c1993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.676+0000 7fc470d3f640 1 --2- 172.21.15.79:0/4104817130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc46c103890 0x7fc46c198eb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:02.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.676+0000 7fc470d3f640 1 -- 172.21.15.79:0/4104817130 >> 172.21.15.79:0/4104817130 conn(0x7fc46c0fd400 msgr2=0x7fc46c0fe140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:02.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.676+0000 7fc470d3f640 1 -- 172.21.15.79:0/4104817130 shutdown_connections 2024-08-20T01:46:02.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:02.676+0000 7fc470d3f640 1 -- 172.21.15.79:0/4104817130 wait complete. 2024-08-20T01:46:04.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:04 smithi175 ceph-mon[22392]: pgmap v609: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 6.79k op/s 2024-08-20T01:46:04.431 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T01:46:04.432 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T01:46:04.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:04 smithi079 ceph-mon[18656]: pgmap v609: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 6.79k op/s 2024-08-20T01:46:04.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:04 smithi081 ceph-mon[22209]: pgmap v609: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 6.79k op/s 2024-08-20T01:46:04.845 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:46:05.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.482+0000 7f2c68799640 1 -- 172.21.15.79:0/2293487561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c60107d20 msgr2=0x7f2c6010e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:05.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.482+0000 7f2c68799640 1 --2- 172.21.15.79:0/2293487561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c60107d20 0x7f2c6010e520 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f2c58009ca0 tx=0x7f2c5802a8c0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.483+0000 7f2c68799640 1 -- 172.21.15.79:0/2293487561 shutdown_connections 2024-08-20T01:46:05.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.483+0000 7f2c68799640 1 --2- 172.21.15.79:0/2293487561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c60107d20 0x7f2c6010e520 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.483+0000 7f2c68799640 1 --2- 172.21.15.79:0/2293487561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c601073a0 0x7f2c601077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.483+0000 7f2c68799640 1 --2- 172.21.15.79:0/2293487561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c60101990 0x7f2c60101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.483+0000 7f2c68799640 1 -- 172.21.15.79:0/2293487561 >> 172.21.15.79:0/2293487561 conn(0x7f2c600fd400 msgr2=0x7f2c600ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:05.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.484+0000 7f2c68799640 1 -- 172.21.15.79:0/2293487561 shutdown_connections 2024-08-20T01:46:05.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.484+0000 7f2c68799640 1 -- 172.21.15.79:0/2293487561 wait complete. 2024-08-20T01:46:05.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.484+0000 7f2c68799640 1 Processor -- start 2024-08-20T01:46:05.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.485+0000 7f2c68799640 1 -- start start 2024-08-20T01:46:05.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.485+0000 7f2c68799640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c60101990 0x7f2c6010f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:05.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.485+0000 7f2c68799640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c601073a0 0x7f2c6010f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:05.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.485+0000 7f2c66535640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c60101990 0x7f2c6010f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:05.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.485+0000 7f2c66535640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c60101990 0x7f2c6010f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:46820/0 (socket says 172.21.15.79:46820) 2024-08-20T01:46:05.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.485+0000 7f2c65d34640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c601073a0 0x7f2c6010f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:05.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.485+0000 7f2c68799640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c60107d20 0x7f2c6010fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:05.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.485+0000 7f2c65d34640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c601073a0 0x7f2c6010f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:58354/0 (socket says 172.21.15.79:58354) 2024-08-20T01:46:05.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.486+0000 7f2c66535640 1 -- 172.21.15.79:0/2823602191 learned_addr learned my addr 172.21.15.79:0/2823602191 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:05.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.486+0000 7f2c68799640 1 -- 172.21.15.79:0/2823602191 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2c60114be0 con 0x7f2c60107d20 2024-08-20T01:46:05.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.486+0000 7f2c68799640 1 -- 172.21.15.79:0/2823602191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2c60114a60 con 0x7f2c601073a0 2024-08-20T01:46:05.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.486+0000 7f2c68799640 1 -- 172.21.15.79:0/2823602191 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2c60114d60 con 0x7f2c60101990 2024-08-20T01:46:05.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.486+0000 7f2c66d36640 1 --2- 172.21.15.79:0/2823602191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c60107d20 0x7f2c6010fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:05.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.487+0000 7f2c66d36640 1 -- 172.21.15.79:0/2823602191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c60101990 msgr2=0x7f2c6010f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:05.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.487+0000 7f2c66d36640 1 --2- 172.21.15.79:0/2823602191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c60101990 0x7f2c6010f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.487+0000 7f2c66d36640 1 -- 172.21.15.79:0/2823602191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c601073a0 msgr2=0x7f2c6010f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:05.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.487+0000 7f2c66d36640 1 --2- 172.21.15.79:0/2823602191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c601073a0 0x7f2c6010f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.487+0000 7f2c66d36640 1 -- 172.21.15.79:0/2823602191 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c60073670 con 0x7f2c60107d20 2024-08-20T01:46:05.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.487+0000 7f2c66d36640 1 --2- 172.21.15.79:0/2823602191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c60107d20 0x7f2c6010fd40 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f2c58031040 tx=0x7f2c58030790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:05.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.488+0000 7f2c577fe640 1 -- 172.21.15.79:0/2823602191 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c58031d90 con 0x7f2c60107d20 2024-08-20T01:46:05.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.488+0000 7f2c577fe640 1 -- 172.21.15.79:0/2823602191 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2c58040070 con 0x7f2c60107d20 2024-08-20T01:46:05.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.488+0000 7f2c68799640 1 -- 172.21.15.79:0/2823602191 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c60073900 con 0x7f2c60107d20 2024-08-20T01:46:05.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.488+0000 7f2c577fe640 1 -- 172.21.15.79:0/2823602191 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c580047b0 con 0x7f2c60107d20 2024-08-20T01:46:05.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.488+0000 7f2c68799640 1 -- 172.21.15.79:0/2823602191 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c60073e40 con 0x7f2c60107d20 2024-08-20T01:46:05.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.492+0000 7f2c6ab92740 1 Processor -- start 2024-08-20T01:46:05.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.492+0000 7f2c577fe640 1 -- 172.21.15.79:0/2823602191 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2c58004040 con 0x7f2c60107d20 2024-08-20T01:46:05.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.492+0000 7f2c6ab92740 1 -- start start 2024-08-20T01:46:05.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.493+0000 7f2c6ab92740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55675f0ae3b0 0x55675f0ae790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:05.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.493+0000 7f2c6ab92740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55675f0aecd0 0x55675f0ba720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:05.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.493+0000 7f2c6ab92740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55675f0bac60 0x55675f0bd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:05.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.493+0000 7f2c6ab92740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55675f024940 con 0x55675f0bac60 2024-08-20T01:46:05.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.493+0000 7f2c6ab92740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55675f013e40 con 0x55675f0ae3b0 2024-08-20T01:46:05.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.493+0000 7f2c6ab92740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55675f017e80 con 0x55675f0aecd0 2024-08-20T01:46:05.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.493+0000 7f2c65d34640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55675f0ae3b0 0x55675f0ae790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:05.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.493+0000 7f2c65d34640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55675f0ae3b0 0x55675f0ae790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:58370/0 (socket says 172.21.15.79:58370) 2024-08-20T01:46:05.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.493+0000 7f2c65d34640 1 -- 172.21.15.79:0/3763225234 learned_addr learned my addr 172.21.15.79:0/3763225234 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:05.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.493+0000 7f2c66535640 1 --2- 172.21.15.79:0/3763225234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55675f0aecd0 0x55675f0ba720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:05.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.494+0000 7f2c577fe640 1 --2- 172.21.15.79:0/2823602191 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2c4c0b3d20 0x7f2c4c0b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:05.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.494+0000 7f2c65d34640 1 --2- 172.21.15.79:0/3763225234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55675f0bac60 0x55675f0bd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:05.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.494+0000 7f2c65d34640 1 -- 172.21.15.79:0/3763225234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55675f0aecd0 msgr2=0x55675f0ba720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:05.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.494+0000 7f2c65d34640 1 --2- 172.21.15.79:0/3763225234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55675f0aecd0 0x55675f0ba720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.494+0000 7f2c65d34640 1 -- 172.21.15.79:0/3763225234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55675f0bac60 msgr2=0x55675f0bd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:05.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.494+0000 7f2c65d34640 1 --2- 172.21.15.79:0/3763225234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55675f0bac60 0x55675f0bd050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.494+0000 7f2c65d34640 1 -- 172.21.15.79:0/3763225234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55675efb0520 con 0x55675f0ae3b0 2024-08-20T01:46:05.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.494+0000 7f2c577fe640 1 -- 172.21.15.79:0/2823602191 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f2c58104f40 con 0x7f2c60107d20 2024-08-20T01:46:05.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.494+0000 7f2c66d36640 1 --2- 172.21.15.79:0/2823602191 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2c4c0b3d20 0x7f2c4c0b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:05.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.494+0000 7f2c65d34640 1 --2- 172.21.15.79:0/3763225234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55675f0ae3b0 0x55675f0ae790 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2c5000a360 tx=0x7f2c5000b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=379cf27a63738341 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:05.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.495+0000 7f2c54ff9640 1 -- 172.21.15.79:0/3763225234 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5000aea0 con 0x55675f0ae3b0 2024-08-20T01:46:05.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.495+0000 7f2c54ff9640 1 -- 172.21.15.79:0/3763225234 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2c5001a860 con 0x55675f0ae3b0 2024-08-20T01:46:05.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.495+0000 7f2c54ff9640 1 -- 172.21.15.79:0/3763225234 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c50019850 con 0x55675f0ae3b0 2024-08-20T01:46:05.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.496+0000 7f2c6ab92740 1 -- 172.21.15.79:0/3763225234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55675f0ae3b0 msgr2=0x55675f0ae790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:05.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.496+0000 7f2c66d36640 1 --2- 172.21.15.79:0/2823602191 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2c4c0b3d20 0x7f2c4c0b61e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2c580049d0 tx=0x7f2c5802a8c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:05.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.496+0000 7f2c6ab92740 1 --2- 172.21.15.79:0/3763225234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55675f0ae3b0 0x55675f0ae790 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2c5000a360 tx=0x7f2c5000b8d0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.496+0000 7f2c6ab92740 1 -- 172.21.15.79:0/3763225234 shutdown_connections 2024-08-20T01:46:05.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.496+0000 7f2c6ab92740 1 --2- 172.21.15.79:0/3763225234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55675f0bac60 0x55675f0bd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.496+0000 7f2c6ab92740 1 --2- 172.21.15.79:0/3763225234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55675f0aecd0 0x55675f0ba720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.496+0000 7f2c6ab92740 1 --2- 172.21.15.79:0/3763225234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55675f0ae3b0 0x55675f0ae790 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.496+0000 7f2c6ab92740 1 -- 172.21.15.79:0/3763225234 >> 172.21.15.79:0/3763225234 conn(0x55675f0ac1e0 msgr2=0x55675f0ad380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:05.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.497+0000 7f2c6ab92740 1 -- 172.21.15.79:0/3763225234 shutdown_connections 2024-08-20T01:46:05.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.497+0000 7f2c6ab92740 1 -- 172.21.15.79:0/3763225234 wait complete. 2024-08-20T01:46:05.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.497+0000 7f2c6ab92740 1 -- start start 2024-08-20T01:46:05.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.497+0000 7f2c6ab92740 1 Processor -- start 2024-08-20T01:46:05.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.498+0000 7f2c6ab92740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55675f0ae3b0 0x55675f0b7c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:05.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.498+0000 7f2c6ab92740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55675f0aecd0 0x55675f0b81b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:05.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.498+0000 7f2c6ab92740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55675f0bac60 0x55675f0b86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:05.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.498+0000 7f2c6ab92740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55675ee76890 con 0x55675f0ae3b0 2024-08-20T01:46:05.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.498+0000 7f2c6ab92740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55675ef9a700 con 0x55675f0aecd0 2024-08-20T01:46:05.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.498+0000 7f2c6ab92740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55675f0bd9b0 con 0x55675f0bac60 2024-08-20T01:46:05.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.498+0000 7f2c6ab92740 10 client.0 _ll_register_callbacks cb 0x55675f00f6f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:46:05.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.498+0000 7f2c65d34640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55675f0ae3b0 0x55675f0b7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:05.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.498+0000 7f2c66535640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55675f0aecd0 0x55675f0b81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:05.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.498+0000 7f2c65d34640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55675f0ae3b0 0x55675f0b7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51496/0 (socket says 172.21.15.79:51496) 2024-08-20T01:46:05.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.498+0000 7f2c65d34640 1 -- 172.21.15.79:0/4022228478 learned_addr learned my addr 172.21.15.79:0/4022228478 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:05.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.498+0000 7f2c65d34640 1 --2- 172.21.15.79:0/4022228478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55675f0bac60 0x55675f0b86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:05.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.498+0000 7f2c66535640 1 -- 172.21.15.79:0/4022228478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55675f0bac60 msgr2=0x55675f0b86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:05.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.498+0000 7f2c66535640 1 --2- 172.21.15.79:0/4022228478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55675f0bac60 0x55675f0b86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.498+0000 7f2c66535640 1 -- 172.21.15.79:0/4022228478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55675f0ae3b0 msgr2=0x55675f0b7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:05.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.498+0000 7f2c66535640 1 --2- 172.21.15.79:0/4022228478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55675f0ae3b0 0x55675f0b7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.498+0000 7f2c66535640 1 -- 172.21.15.79:0/4022228478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55675ed73930 con 0x55675f0aecd0 2024-08-20T01:46:05.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.498+0000 7f2c66535640 1 --2- 172.21.15.79:0/4022228478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55675f0aecd0 0x55675f0b81b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c0058c0 tx=0x7f2c5c0039c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41c70e5bdfe58b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:05.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.498+0000 7f2c49ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:46:05.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.499+0000 7f2c49ffb640 1 -- 172.21.15.79:0/4022228478 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c01b470 con 0x55675f0aecd0 2024-08-20T01:46:05.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.499+0000 7f2c49ffb640 1 -- 172.21.15.79:0/4022228478 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f2c5c011440 con 0x55675f0aecd0 2024-08-20T01:46:05.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.499+0000 7f2c6ab92740 1 -- 172.21.15.79:0/4022228478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c5001a860 con 0x55675f0aecd0 2024-08-20T01:46:05.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.499+0000 7f2c49ffb640 1 -- 172.21.15.79:0/4022228478 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f2c5c011640 con 0x55675f0aecd0 2024-08-20T01:46:05.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.499+0000 7f2c6ab92740 10 client.27008 fetch_fsmap learned FSMap version 44 2024-08-20T01:46:05.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.499+0000 7f2c6ab92740 1 -- 172.21.15.79:0/4022228478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55675f0c9620 con 0x55675f0aecd0 2024-08-20T01:46:05.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.499+0000 7f2c49ffb640 1 -- 172.21.15.79:0/4022228478 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2c5001a860 con 0x55675f0aecd0 2024-08-20T01:46:05.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.499+0000 7f2c49ffb640 1 -- 172.21.15.79:0/4022228478 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 44) ==== 8382+0+0 (secure 0 0 0) 0x7f2c5c01bab0 con 0x55675f0aecd0 2024-08-20T01:46:05.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.499+0000 7f2c6ab92740 10 client.27008 fetch_fsmap finished waiting for FSMap version 44 2024-08-20T01:46:05.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.499+0000 7f2c6ab92740 10 client.27008 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:46:05.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.499+0000 7f2c6ab92740 20 client.27008 populate_metadata read hostname 'smithi079' 2024-08-20T01:46:05.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.499+0000 7f2c6ab92740 1 --2- 172.21.15.79:0/4022228478 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55675f0caae0 0x55675f0ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:05.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.499+0000 7f2c6ab92740 4 client.27008 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:46:05.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.499+0000 7f2c6ab92740 1 -- 172.21.15.79:0/4022228478 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55675f026890 con 0x55675f0caae0 2024-08-20T01:46:05.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.500+0000 7f2c65d34640 1 --2- 172.21.15.79:0/4022228478 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55675f0caae0 0x55675f0ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:05.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.501+0000 7f2c49ffb640 10 client.27008 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:46:05.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.501+0000 7f2c65d34640 1 --2- 172.21.15.79:0/4022228478 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55675f0caae0 0x55675f0ccf40 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=162ceaefe53511c6 server_cookie=ad258b9e434ef477 in_seq=0 out_seq=0 2024-08-20T01:46:05.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.502+0000 7f2c49ffb640 1 -- 172.21.15.79:0/4022228478 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55675f026890 con 0x55675f0caae0 2024-08-20T01:46:05.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.502+0000 7f2c49ffb640 10 client.27008 handle_command_reply: tid=0 2024-08-20T01:46:05.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.502+0000 7f2c6ab92740 1 client.27008 shutdown 2024-08-20T01:46:05.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.503+0000 7f2c6ab92740 1 -- 172.21.15.79:0/4022228478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55675f0aecd0 msgr2=0x55675f0b81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:05.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.503+0000 7f2c6ab92740 1 --2- 172.21.15.79:0/4022228478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55675f0aecd0 0x55675f0b81b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c0058c0 tx=0x7f2c5c0039c0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.503+0000 7f2c6ab92740 1 -- 172.21.15.79:0/4022228478 shutdown_connections 2024-08-20T01:46:05.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.503+0000 7f2c6ab92740 1 --2- 172.21.15.79:0/4022228478 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55675f0caae0 0x55675f0ccf40 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.503+0000 7f2c6ab92740 1 --2- 172.21.15.79:0/4022228478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55675f0bac60 0x55675f0b86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.503+0000 7f2c6ab92740 1 --2- 172.21.15.79:0/4022228478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55675f0aecd0 0x55675f0b81b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.503+0000 7f2c6ab92740 1 --2- 172.21.15.79:0/4022228478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55675f0ae3b0 0x55675f0b7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.503+0000 7f2c6ab92740 1 -- 172.21.15.79:0/4022228478 >> 172.21.15.79:0/4022228478 conn(0x55675f0ac1e0 msgr2=0x55675f0b1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:05.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.503+0000 7f2c49ffb640 0 client.27008 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:46:05.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.503+0000 7f2c6ab92740 1 -- 172.21.15.79:0/4022228478 shutdown_connections 2024-08-20T01:46:05.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.503+0000 7f2c6ab92740 1 -- 172.21.15.79:0/4022228478 wait complete. 2024-08-20T01:46:05.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.503+0000 7f2c6ab92740 20 client.27008 trim_cache size 0 max 16384 2024-08-20T01:46:05.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.536+0000 7f2c6ab92740 1 Processor -- start 2024-08-20T01:46:05.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.536+0000 7f2c6ab92740 1 -- start start 2024-08-20T01:46:05.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.536+0000 7f2c6ab92740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55675f0ae3b0 0x55675f0b9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:05.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.536+0000 7f2c6ab92740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55675f0aecd0 0x55675f0ab1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:05.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.537+0000 7f2c6ab92740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55675f0bac60 0x55675f0d2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:05.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.537+0000 7f2c6ab92740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2c601bcca0 con 0x55675f0aecd0 2024-08-20T01:46:05.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.537+0000 7f2c6ab92740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2c601be8d0 con 0x55675f0bac60 2024-08-20T01:46:05.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.537+0000 7f2c6ab92740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2c601bd370 con 0x55675f0ae3b0 2024-08-20T01:46:05.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.537+0000 7f2c65d34640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55675f0ae3b0 0x55675f0b9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:05.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.537+0000 7f2c65d34640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55675f0ae3b0 0x55675f0b9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:46842/0 (socket says 172.21.15.79:46842) 2024-08-20T01:46:05.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.537+0000 7f2c65d34640 1 -- 172.21.15.79:0/434814252 learned_addr learned my addr 172.21.15.79:0/434814252 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:05.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.537+0000 7f2c66535640 1 --2- 172.21.15.79:0/434814252 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55675f0aecd0 0x55675f0ab1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:05.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.537+0000 7f2c65d34640 1 --2- 172.21.15.79:0/434814252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55675f0bac60 0x55675f0d2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:05.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.537+0000 7f2c66535640 1 -- 172.21.15.79:0/434814252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55675f0ae3b0 msgr2=0x55675f0b9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:05.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.537+0000 7f2c66535640 1 --2- 172.21.15.79:0/434814252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55675f0ae3b0 0x55675f0b9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.537+0000 7f2c66535640 1 -- 172.21.15.79:0/434814252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55675f0bac60 msgr2=0x55675f0d2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:05.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.537+0000 7f2c66535640 1 --2- 172.21.15.79:0/434814252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55675f0bac60 0x55675f0d2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.537+0000 7f2c66535640 1 -- 172.21.15.79:0/434814252 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55675f0acc60 con 0x55675f0aecd0 2024-08-20T01:46:05.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.538+0000 7f2c66535640 1 --2- 172.21.15.79:0/434814252 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55675f0aecd0 0x55675f0ab1f0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c0104c0 tx=0x7f2c5c005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bca680b8bc02af2d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:05.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.538+0000 7f2c4bfff640 1 -- 172.21.15.79:0/434814252 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c011440 con 0x55675f0aecd0 2024-08-20T01:46:05.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.538+0000 7f2c4bfff640 1 -- 172.21.15.79:0/434814252 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2c5c010d50 con 0x55675f0aecd0 2024-08-20T01:46:05.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.538+0000 7f2c4bfff640 1 -- 172.21.15.79:0/434814252 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c011c20 con 0x55675f0aecd0 2024-08-20T01:46:05.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.539+0000 7f2c6ab92740 1 -- 172.21.15.79:0/434814252 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55675f0aecd0 msgr2=0x55675f0ab1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:05.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.539+0000 7f2c6ab92740 1 --2- 172.21.15.79:0/434814252 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55675f0aecd0 0x55675f0ab1f0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c0104c0 tx=0x7f2c5c005f30 comp rx=0 tx=0).stop 2024-08-20T01:46:05.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.539+0000 7f2c6ab92740 1 -- 172.21.15.79:0/434814252 shutdown_connections 2024-08-20T01:46:05.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.539+0000 7f2c6ab92740 1 --2- 172.21.15.79:0/434814252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55675f0bac60 0x55675f0d2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.539+0000 7f2c6ab92740 1 --2- 172.21.15.79:0/434814252 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55675f0aecd0 0x55675f0ab1f0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.539+0000 7f2c6ab92740 1 --2- 172.21.15.79:0/434814252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55675f0ae3b0 0x55675f0b9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.539+0000 7f2c6ab92740 1 -- 172.21.15.79:0/434814252 >> 172.21.15.79:0/434814252 conn(0x55675f0ac1e0 msgr2=0x55675f0aaae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:05.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.539+0000 7f2c6ab92740 1 -- 172.21.15.79:0/434814252 shutdown_connections 2024-08-20T01:46:05.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.539+0000 7f2c6ab92740 1 -- 172.21.15.79:0/434814252 wait complete. 2024-08-20T01:46:05.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.540+0000 7f2c6ab92740 1 -- start start 2024-08-20T01:46:05.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.540+0000 7f2c6ab92740 1 Processor -- start 2024-08-20T01:46:05.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.540+0000 7f2c6ab92740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55675f0ae3b0 0x55675f0beec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:05.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.540+0000 7f2c6ab92740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55675f0aecd0 0x55675f0bf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:05.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.540+0000 7f2c6ab92740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55675f0bac60 0x55675f134820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:05.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.540+0000 7f2c6ab92740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2c601be1d0 con 0x55675f0aecd0 2024-08-20T01:46:05.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.540+0000 7f2c6ab92740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2c601bda40 con 0x55675f0bac60 2024-08-20T01:46:05.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.540+0000 7f2c6ab92740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2c601bac80 con 0x55675f0ae3b0 2024-08-20T01:46:05.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.540+0000 7f2c6ab92740 10 client.0 _ll_register_callbacks cb 0x7f2c5c004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:46:05.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.541+0000 7f2c65d34640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55675f0ae3b0 0x55675f0beec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:05.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.541+0000 7f2c65d34640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55675f0ae3b0 0x55675f0beec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:46846/0 (socket says 172.21.15.79:46846) 2024-08-20T01:46:05.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.541+0000 7f2c65d34640 1 -- 172.21.15.79:0/3148730134 learned_addr learned my addr 172.21.15.79:0/3148730134 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:05.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.541+0000 7f2c65d34640 1 --2- 172.21.15.79:0/3148730134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55675f0bac60 0x55675f134820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:05.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.541+0000 7f2c66535640 1 --2- 172.21.15.79:0/3148730134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55675f0aecd0 0x55675f0bf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:05.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.541+0000 7f2c65d34640 1 -- 172.21.15.79:0/3148730134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55675f0bac60 msgr2=0x55675f134820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:05.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.541+0000 7f2c65d34640 1 --2- 172.21.15.79:0/3148730134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55675f0bac60 0x55675f134820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.541+0000 7f2c65d34640 1 -- 172.21.15.79:0/3148730134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55675f0aecd0 msgr2=0x55675f0bf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:05.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.541+0000 7f2c65d34640 1 --2- 172.21.15.79:0/3148730134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55675f0aecd0 0x55675f0bf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.541+0000 7f2c65d34640 1 -- 172.21.15.79:0/3148730134 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55675f134d60 con 0x55675f0ae3b0 2024-08-20T01:46:05.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.541+0000 7f2c65d34640 1 --2- 172.21.15.79:0/3148730134 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55675f0ae3b0 0x55675f0beec0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2c5000bea0 tx=0x7f2c5001d040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20dd6925cccf3a59 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:05.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.541+0000 7f2c49ffb640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:46:05.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.542+0000 7f2c49ffb640 1 -- 172.21.15.79:0/3148730134 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5001ab60 con 0x55675f0ae3b0 2024-08-20T01:46:05.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.542+0000 7f2c49ffb640 1 -- 172.21.15.79:0/3148730134 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f2c5001ad00 con 0x55675f0ae3b0 2024-08-20T01:46:05.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.542+0000 7f2c6ab92740 1 -- 172.21.15.79:0/3148730134 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c5c010d50 con 0x55675f0ae3b0 2024-08-20T01:46:05.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.542+0000 7f2c49ffb640 1 -- 172.21.15.79:0/3148730134 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f2c50005020 con 0x55675f0ae3b0 2024-08-20T01:46:05.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.542+0000 7f2c6ab92740 10 client.26995 fetch_fsmap learned FSMap version 44 2024-08-20T01:46:05.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.542+0000 7f2c6ab92740 1 -- 172.21.15.79:0/3148730134 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55675f135fa0 con 0x55675f0ae3b0 2024-08-20T01:46:05.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.542+0000 7f2c49ffb640 1 -- 172.21.15.79:0/3148730134 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2c5c010d50 con 0x55675f0ae3b0 2024-08-20T01:46:05.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.542+0000 7f2c49ffb640 1 -- 172.21.15.79:0/3148730134 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 44) ==== 8382+0+0 (secure 0 0 0) 0x7f2c50026040 con 0x55675f0ae3b0 2024-08-20T01:46:05.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.542+0000 7f2c6ab92740 10 client.26995 fetch_fsmap finished waiting for FSMap version 44 2024-08-20T01:46:05.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.542+0000 7f2c6ab92740 10 client.26995 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:46:05.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.542+0000 7f2c6ab92740 20 client.26995 populate_metadata read hostname 'smithi079' 2024-08-20T01:46:05.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.542+0000 7f2c6ab92740 1 --2- 172.21.15.79:0/3148730134 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55675f1365b0 0x55675f1389d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:05.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.542+0000 7f2c6ab92740 4 client.26995 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T01:46:05.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.542+0000 7f2c6ab92740 1 -- 172.21.15.79:0/3148730134 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55675f022330 con 0x55675f1365b0 2024-08-20T01:46:05.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.543+0000 7f2c66535640 1 --2- 172.21.15.79:0/3148730134 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55675f1365b0 0x55675f1389d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:05.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.543+0000 7f2c49ffb640 10 client.26995 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:46:05.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.543+0000 7f2c66535640 1 --2- 172.21.15.79:0/3148730134 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55675f1365b0 0x55675f1389d0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45720c0f6f24b8d0 server_cookie=d246d28386358cb1 in_seq=0 out_seq=0 2024-08-20T01:46:05.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.545+0000 7f2c49ffb640 1 -- 172.21.15.79:0/3148730134 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55675f022330 con 0x55675f1365b0 2024-08-20T01:46:05.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.545+0000 7f2c49ffb640 10 client.26995 handle_command_reply: tid=0 2024-08-20T01:46:05.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.545+0000 7f2c6ab92740 1 client.26995 shutdown 2024-08-20T01:46:05.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.545+0000 7f2c6ab92740 1 -- 172.21.15.79:0/3148730134 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55675f0ae3b0 msgr2=0x55675f0beec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:05.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.545+0000 7f2c6ab92740 1 --2- 172.21.15.79:0/3148730134 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55675f0ae3b0 0x55675f0beec0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2c5000bea0 tx=0x7f2c5001d040 comp rx=0 tx=0).stop 2024-08-20T01:46:05.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.545+0000 7f2c6ab92740 1 -- 172.21.15.79:0/3148730134 shutdown_connections 2024-08-20T01:46:05.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.545+0000 7f2c6ab92740 1 --2- 172.21.15.79:0/3148730134 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55675f1365b0 0x55675f1389d0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.545+0000 7f2c6ab92740 1 --2- 172.21.15.79:0/3148730134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55675f0bac60 0x55675f134820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.545+0000 7f2c6ab92740 1 --2- 172.21.15.79:0/3148730134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55675f0aecd0 0x55675f0bf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.545+0000 7f2c6ab92740 1 --2- 172.21.15.79:0/3148730134 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55675f0ae3b0 0x55675f0beec0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.545+0000 7f2c49ffb640 0 client.26995 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:46:05.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.545+0000 7f2c6ab92740 1 -- 172.21.15.79:0/3148730134 >> 172.21.15.79:0/3148730134 conn(0x55675f0ac1e0 msgr2=0x55675f0ab300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:05.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.545+0000 7f2c6ab92740 1 -- 172.21.15.79:0/3148730134 shutdown_connections 2024-08-20T01:46:05.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.545+0000 7f2c6ab92740 1 -- 172.21.15.79:0/3148730134 wait complete. 2024-08-20T01:46:05.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.545+0000 7f2c6ab92740 20 client.26995 trim_cache size 0 max 16384 2024-08-20T01:46:05.550 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:46:05.550 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-08-20T01:46:05.551 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "6ba0d26f-8a93-4475-9c61-e8f9b3c883b3", 2024-08-20T01:46:05.551 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-08-20T01:46:05.551 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:46:05.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.546+0000 7f2c68799640 1 -- 172.21.15.79:0/2823602191 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2c4c0b3d20 msgr2=0x7f2c4c0b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:05.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.546+0000 7f2c68799640 1 --2- 172.21.15.79:0/2823602191 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2c4c0b3d20 0x7f2c4c0b61e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2c580049d0 tx=0x7f2c5802a8c0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.546+0000 7f2c68799640 1 -- 172.21.15.79:0/2823602191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c60107d20 msgr2=0x7f2c6010fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:05.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.546+0000 7f2c68799640 1 --2- 172.21.15.79:0/2823602191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c60107d20 0x7f2c6010fd40 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f2c58031040 tx=0x7f2c58030790 comp rx=0 tx=0).stop 2024-08-20T01:46:05.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.546+0000 7f2c68799640 1 -- 172.21.15.79:0/2823602191 shutdown_connections 2024-08-20T01:46:05.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.546+0000 7f2c68799640 1 --2- 172.21.15.79:0/2823602191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c60107d20 0x7f2c6010fd40 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.546+0000 7f2c68799640 1 --2- 172.21.15.79:0/2823602191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c601073a0 0x7f2c6010f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.546+0000 7f2c68799640 1 --2- 172.21.15.79:0/2823602191 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2c4c0b3d20 0x7f2c4c0b61e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.546+0000 7f2c68799640 1 --2- 172.21.15.79:0/2823602191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c60101990 0x7f2c6010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.546+0000 7f2c68799640 1 -- 172.21.15.79:0/2823602191 >> 172.21.15.79:0/2823602191 conn(0x7f2c600fd400 msgr2=0x7f2c600ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:05.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.546+0000 7f2c68799640 1 -- 172.21.15.79:0/2823602191 shutdown_connections 2024-08-20T01:46:05.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:05.546+0000 7f2c68799640 1 -- 172.21.15.79:0/2823602191 wait complete. 2024-08-20T01:46:05.707 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:05.704+0000 7f2ce97fa640 1 -- 172.21.15.79:0/2896553574 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56481e3bcd50 con 0x56481e4d58b0 2024-08-20T01:46:05.707 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:05.704+0000 7f2ce97fa640 10 client.26981 handle_command_reply: tid=0 2024-08-20T01:46:05.707 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:05.704+0000 7f2d0adfe740 1 client.26981 shutdown 2024-08-20T01:46:05.707 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:05.704+0000 7f2d0adfe740 1 -- 172.21.15.79:0/2896553574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56481e44c8d0 msgr2=0x56481e468020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:05.707 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:05.704+0000 7f2d0adfe740 1 --2- 172.21.15.79:0/2896553574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56481e44c8d0 0x56481e468020 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc01e840 tx=0x7f2cfc00fdd0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.707 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:05.705+0000 7f2d0adfe740 1 -- 172.21.15.79:0/2896553574 shutdown_connections 2024-08-20T01:46:05.708 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:05.705+0000 7f2d0adfe740 1 --2- 172.21.15.79:0/2896553574 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56481e4d58b0 0x56481e4d7cd0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.708 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:05.705+0000 7f2d0adfe740 1 --2- 172.21.15.79:0/2896553574 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56481e451c40 0x56481e467260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.708 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:05.705+0000 7f2d0adfe740 1 --2- 172.21.15.79:0/2896553574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56481e44f200 0x56481e466d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.708 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:05.705+0000 7f2d0adfe740 1 --2- 172.21.15.79:0/2896553574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56481e44c8d0 0x56481e468020 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.708 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:05.705+0000 7f2d0adfe740 1 -- 172.21.15.79:0/2896553574 >> 172.21.15.79:0/2896553574 conn(0x56481e447a20 msgr2=0x56481e4462c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:05.708 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:05.705+0000 7f2ce97fa640 0 client.26981 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:46:05.709 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:05.705+0000 7f2d0adfe740 1 -- 172.21.15.79:0/2896553574 shutdown_connections 2024-08-20T01:46:05.709 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:05.705+0000 7f2d0adfe740 1 -- 172.21.15.79:0/2896553574 wait complete. 2024-08-20T01:46:05.709 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:05.705+0000 7f2d0adfe740 20 client.26981 trim_cache size 0 max 16384 2024-08-20T01:46:05.709 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:46:05.709 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:46:05.710 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:46:05.710 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:46:05.711 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:05.707+0000 7f2d07f31640 1 -- 172.21.15.79:0/1015304581 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2cec0b3bd0 msgr2=0x7f2cec0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:05.711 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:05.707+0000 7f2d07f31640 1 --2- 172.21.15.79:0/1015304581 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2cec0b3bd0 0x7f2cec0b6090 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc005bc0 tx=0x7f2cfc005f90 comp rx=0 tx=0).stop 2024-08-20T01:46:05.711 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:05.707+0000 7f2d07f31640 1 -- 172.21.15.79:0/1015304581 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d001037f0 msgr2=0x7f2d00198f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:05.711 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:05.707+0000 7f2d07f31640 1 --2- 172.21.15.79:0/1015304581 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d001037f0 0x7f2d00198f70 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f2cf000ea60 tx=0x7f2cf000ef20 comp rx=0 tx=0).stop 2024-08-20T01:46:05.711 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:05.707+0000 7f2d07f31640 1 -- 172.21.15.79:0/1015304581 shutdown_connections 2024-08-20T01:46:05.711 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:05.707+0000 7f2d07f31640 1 --2- 172.21.15.79:0/1015304581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d001041b0 0x7f2d00199ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.711 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:05.707+0000 7f2d07f31640 1 --2- 172.21.15.79:0/1015304581 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d001037f0 0x7f2d00198f70 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.711 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:05.707+0000 7f2d07f31640 1 --2- 172.21.15.79:0/1015304581 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2cec0b3bd0 0x7f2cec0b6090 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.711 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:05.707+0000 7f2d07f31640 1 --2- 172.21.15.79:0/1015304581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d001026a0 0x7f2d00198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:05.712 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:05.707+0000 7f2d07f31640 1 -- 172.21.15.79:0/1015304581 >> 172.21.15.79:0/1015304581 conn(0x7f2d000fdf40 msgr2=0x7f2d00106be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:05.712 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:05.707+0000 7f2d07f31640 1 -- 172.21.15.79:0/1015304581 shutdown_connections 2024-08-20T01:46:05.712 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:05.707+0000 7f2d07f31640 1 -- 172.21.15.79:0/1015304581 wait complete. 2024-08-20T01:46:06.379 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:06 smithi079 ceph-mon[18656]: pgmap v610: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 28 MiB/s wr, 7.22k op/s 2024-08-20T01:46:06.380 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:06 smithi079 ceph-mon[18656]: scrub queued for path: / 2024-08-20T01:46:06.380 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:06 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:46:06.380 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:06 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:46:06.380 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:06 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:46:06.380 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:06 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:46:06.380 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:06 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:46:06.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:06 smithi175 ceph-mon[22392]: pgmap v610: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 28 MiB/s wr, 7.22k op/s 2024-08-20T01:46:06.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:06 smithi175 ceph-mon[22392]: scrub queued for path: / 2024-08-20T01:46:06.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:06 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:46:06.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:06 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:46:06.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:06 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:46:06.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:06 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:46:06.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:06 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:46:06.427 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:46:06.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:06 smithi081 ceph-mon[22209]: pgmap v610: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 28 MiB/s wr, 7.22k op/s 2024-08-20T01:46:06.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:06 smithi081 ceph-mon[22209]: scrub queued for path: / 2024-08-20T01:46:06.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:06 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:46:06.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:06 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:46:06.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:06 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:46:06.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:06 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:46:06.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:06 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:46:06.896 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:46:07.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:07 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:46:07.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:07 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:46:07.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:07 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:46:07.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:07 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:46:07.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:07 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:46:07.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:07 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:46:07.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:07 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:46:07.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:07 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:46:07.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:07 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:46:07.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:07 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:46:07.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:07 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:46:07.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:07 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:46:07.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:07 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:46:07.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:07 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:46:07.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:07 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:46:08.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:08 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:46:08.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:08 smithi175 ceph-mon[22392]: pgmap v611: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 25 MiB/s wr, 6.45k op/s 2024-08-20T01:46:08.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:08 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:46:08.390 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:08 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:46:08.390 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:08 smithi079 ceph-mon[18656]: pgmap v611: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 25 MiB/s wr, 6.45k op/s 2024-08-20T01:46:08.390 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:08 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:46:08.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:08 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:46:08.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:08 smithi081 ceph-mon[22209]: pgmap v611: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 25 MiB/s wr, 6.45k op/s 2024-08-20T01:46:08.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:08 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:46:09.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.109+0000 7f1cafb3e640 1 -- 172.21.15.79:0/923018124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ca810f460 msgr2=0x7f1ca8115c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:09.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.109+0000 7f1cafb3e640 1 --2- 172.21.15.79:0/923018124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ca810f460 0x7f1ca8115c60 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0009ca0 tx=0x7f1ca002a8e0 comp rx=0 tx=0).stop 2024-08-20T01:46:09.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.109+0000 7f1cafb3e640 1 -- 172.21.15.79:0/923018124 shutdown_connections 2024-08-20T01:46:09.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.109+0000 7f1cafb3e640 1 --2- 172.21.15.79:0/923018124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ca810f460 0x7f1ca8115c60 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:09.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.109+0000 7f1cafb3e640 1 --2- 172.21.15.79:0/923018124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca810eae0 0x7f1ca810ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:09.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.109+0000 7f1cafb3e640 1 --2- 172.21.15.79:0/923018124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ca81090d0 0x7f1ca81094b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:09.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.109+0000 7f1cafb3e640 1 -- 172.21.15.79:0/923018124 >> 172.21.15.79:0/923018124 conn(0x7f1ca8078800 msgr2=0x7f1ca807ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:09.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.109+0000 7f1cafb3e640 1 -- 172.21.15.79:0/923018124 shutdown_connections 2024-08-20T01:46:09.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.109+0000 7f1cafb3e640 1 -- 172.21.15.79:0/923018124 wait complete. 2024-08-20T01:46:09.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.110+0000 7f1cafb3e640 1 Processor -- start 2024-08-20T01:46:09.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.110+0000 7f1cafb3e640 1 -- start start 2024-08-20T01:46:09.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.111+0000 7f1cafb3e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ca81090d0 0x7f1ca819f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:09.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.111+0000 7f1cafb3e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca810eae0 0x7f1ca819fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:09.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.111+0000 7f1cafb3e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ca810f460 0x7f1ca81a4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:09.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.111+0000 7f1cafb3e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca8118fc0 con 0x7f1ca810f460 2024-08-20T01:46:09.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.111+0000 7f1cafb3e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca8118e40 con 0x7f1ca810eae0 2024-08-20T01:46:09.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.111+0000 7f1cafb3e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca8119140 con 0x7f1ca81090d0 2024-08-20T01:46:09.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.111+0000 7f1cad8da640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ca81090d0 0x7f1ca819f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:09.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.111+0000 7f1cae0db640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ca810f460 0x7f1ca81a4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:09.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.111+0000 7f1cad8da640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ca81090d0 0x7f1ca819f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:46864/0 (socket says 172.21.15.79:46864) 2024-08-20T01:46:09.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.111+0000 7f1cae0db640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ca810f460 0x7f1ca81a4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51536/0 (socket says 172.21.15.79:51536) 2024-08-20T01:46:09.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.111+0000 7f1cae0db640 1 -- 172.21.15.79:0/951857530 learned_addr learned my addr 172.21.15.79:0/951857530 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:09.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.112+0000 7f1cae0db640 1 -- 172.21.15.79:0/951857530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ca81090d0 msgr2=0x7f1ca819f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:09.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.112+0000 7f1cae0db640 1 --2- 172.21.15.79:0/951857530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ca81090d0 0x7f1ca819f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:09.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.112+0000 7f1cae0db640 1 -- 172.21.15.79:0/951857530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca810eae0 msgr2=0x7f1ca819fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:09.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.112+0000 7f1cae0db640 1 --2- 172.21.15.79:0/951857530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca810eae0 0x7f1ca819fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:09.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.112+0000 7f1cae0db640 1 -- 172.21.15.79:0/951857530 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ca81a55c0 con 0x7f1ca810f460 2024-08-20T01:46:09.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.112+0000 7f1cae0db640 1 --2- 172.21.15.79:0/951857530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ca810f460 0x7f1ca81a4df0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0033040 tx=0x7f1ca0003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:09.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.112+0000 7f1c9effd640 1 -- 172.21.15.79:0/951857530 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca0003c90 con 0x7f1ca810f460 2024-08-20T01:46:09.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.113+0000 7f1cafb3e640 1 -- 172.21.15.79:0/951857530 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ca81a5850 con 0x7f1ca810f460 2024-08-20T01:46:09.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.113+0000 7f1c9effd640 1 -- 172.21.15.79:0/951857530 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1ca0003e30 con 0x7f1ca810f460 2024-08-20T01:46:09.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.113+0000 7f1c9effd640 1 -- 172.21.15.79:0/951857530 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca0030b70 con 0x7f1ca810f460 2024-08-20T01:46:09.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.113+0000 7f1cafb3e640 1 -- 172.21.15.79:0/951857530 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ca81abf70 con 0x7f1ca810f460 2024-08-20T01:46:09.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.117+0000 7f1c9effd640 1 -- 172.21.15.79:0/951857530 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1ca0030d10 con 0x7f1ca810f460 2024-08-20T01:46:09.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.118+0000 7f1c9effd640 1 --2- 172.21.15.79:0/951857530 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1c940b3d10 0x7f1c940b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:09.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.118+0000 7f1cb1f37740 1 Processor -- start 2024-08-20T01:46:09.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.118+0000 7f1c9effd640 1 -- 172.21.15.79:0/951857530 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f1ca0104ef0 con 0x7f1ca810f460 2024-08-20T01:46:09.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.118+0000 7f1cb1f37740 1 -- start start 2024-08-20T01:46:09.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.118+0000 7f1cad8da640 1 --2- 172.21.15.79:0/951857530 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1c940b3d10 0x7f1c940b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:09.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.118+0000 7f1cb1f37740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2b9cf4830 0x55b2b9cf4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:09.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.119+0000 7f1cb1f37740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2b9cf5150 0x55b2b9d00ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:09.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.119+0000 7f1cb1f37740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b2b9d010e0 0x55b2b9d034d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:09.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.119+0000 7f1cb1f37740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b2b9c6b8e0 con 0x55b2b9d010e0 2024-08-20T01:46:09.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.119+0000 7f1cb1f37740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b2b9c5ade0 con 0x55b2b9cf4830 2024-08-20T01:46:09.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.119+0000 7f1cb1f37740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b2b9c5ee20 con 0x55b2b9cf5150 2024-08-20T01:46:09.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.119+0000 7f1cad0d9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2b9cf5150 0x55b2b9d00ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:09.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.119+0000 7f1cad0d9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2b9cf5150 0x55b2b9d00ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:46872/0 (socket says 172.21.15.79:46872) 2024-08-20T01:46:09.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.119+0000 7f1cad0d9640 1 -- 172.21.15.79:0/238918191 learned_addr learned my addr 172.21.15.79:0/238918191 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:09.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.119+0000 7f1cae0db640 1 --2- 172.21.15.79:0/238918191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b2b9d010e0 0x55b2b9d034d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:09.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.119+0000 7f1cad8da640 1 --2- 172.21.15.79:0/238918191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2b9cf4830 0x55b2b9cf4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:09.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.119+0000 7f1cad0d9640 1 -- 172.21.15.79:0/238918191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2b9cf4830 msgr2=0x55b2b9cf4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:09.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.119+0000 7f1cad0d9640 1 --2- 172.21.15.79:0/238918191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2b9cf4830 0x55b2b9cf4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:09.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.119+0000 7f1cad0d9640 1 -- 172.21.15.79:0/238918191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b2b9d010e0 msgr2=0x55b2b9d034d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:09.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.119+0000 7f1cad0d9640 1 --2- 172.21.15.79:0/238918191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b2b9d010e0 0x55b2b9d034d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:09.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.119+0000 7f1cad0d9640 1 -- 172.21.15.79:0/238918191 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2b99ba650 con 0x55b2b9cf5150 2024-08-20T01:46:09.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.119+0000 7f1cad8da640 1 --2- 172.21.15.79:0/951857530 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1c940b3d10 0x7f1c940b61d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4006fd0 tx=0x7f1ca4009de0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:09.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.119+0000 7f1cad0d9640 1 --2- 172.21.15.79:0/238918191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2b9cf5150 0x55b2b9d00ba0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1c98009c10 tx=0x7f1c9800e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd46227799ed349f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:09.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.120+0000 7f1c93fff640 1 -- 172.21.15.79:0/238918191 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c98005020 con 0x55b2b9cf5150 2024-08-20T01:46:09.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.120+0000 7f1c93fff640 1 -- 172.21.15.79:0/238918191 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1c980047a0 con 0x55b2b9cf5150 2024-08-20T01:46:09.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.120+0000 7f1c93fff640 1 -- 172.21.15.79:0/238918191 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c98005650 con 0x55b2b9cf5150 2024-08-20T01:46:09.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.121+0000 7f1cb1f37740 1 -- 172.21.15.79:0/238918191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2b9cf5150 msgr2=0x55b2b9d00ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:09.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.121+0000 7f1cb1f37740 1 --2- 172.21.15.79:0/238918191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2b9cf5150 0x55b2b9d00ba0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1c98009c10 tx=0x7f1c9800e720 comp rx=0 tx=0).stop 2024-08-20T01:46:09.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.121+0000 7f1cb1f37740 1 -- 172.21.15.79:0/238918191 shutdown_connections 2024-08-20T01:46:09.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.121+0000 7f1cb1f37740 1 --2- 172.21.15.79:0/238918191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b2b9d010e0 0x55b2b9d034d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:09.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.121+0000 7f1cb1f37740 1 --2- 172.21.15.79:0/238918191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2b9cf5150 0x55b2b9d00ba0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:09.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.121+0000 7f1cb1f37740 1 --2- 172.21.15.79:0/238918191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2b9cf4830 0x55b2b9cf4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:09.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.121+0000 7f1cb1f37740 1 -- 172.21.15.79:0/238918191 >> 172.21.15.79:0/238918191 conn(0x55b2b9cf2660 msgr2=0x55b2b9cf3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:09.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.122+0000 7f1cb1f37740 1 -- 172.21.15.79:0/238918191 shutdown_connections 2024-08-20T01:46:09.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.123+0000 7f1cb1f37740 1 -- 172.21.15.79:0/238918191 wait complete. 2024-08-20T01:46:09.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.123+0000 7f1cb1f37740 1 -- start start 2024-08-20T01:46:09.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.123+0000 7f1cb1f37740 1 Processor -- start 2024-08-20T01:46:09.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.124+0000 7f1cb1f37740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2b9cf4830 0x55b2b9cfe050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:09.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.124+0000 7f1cb1f37740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2b9cf5150 0x55b2b9cfe590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:09.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.124+0000 7f1cb1f37740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b2b9d010e0 0x55b2b9cfead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:09.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.124+0000 7f1cb1f37740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b2b9abd700 con 0x55b2b9d010e0 2024-08-20T01:46:09.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.124+0000 7f1cb1f37740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b2b9be17c0 con 0x55b2b9cf5150 2024-08-20T01:46:09.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.124+0000 7f1cb1f37740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b2b9d03de0 con 0x55b2b9cf4830 2024-08-20T01:46:09.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.124+0000 7f1cad0d9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2b9cf5150 0x55b2b9cfe590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:09.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.125+0000 7f1cad0d9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2b9cf5150 0x55b2b9cfe590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:58440/0 (socket says 172.21.15.79:58440) 2024-08-20T01:46:09.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.125+0000 7f1cad0d9640 1 -- 172.21.15.79:0/772034956 learned_addr learned my addr 172.21.15.79:0/772034956 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:09.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.124+0000 7f1cb1f37740 10 client.0 _ll_register_callbacks cb 0x55b2b9c546b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:46:09.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.125+0000 7f1cad8da640 1 --2- 172.21.15.79:0/772034956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2b9cf4830 0x55b2b9cfe050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:09.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.125+0000 7f1cae0db640 1 --2- 172.21.15.79:0/772034956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b2b9d010e0 0x55b2b9cfead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:09.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.125+0000 7f1cad0d9640 1 -- 172.21.15.79:0/772034956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2b9cf4830 msgr2=0x55b2b9cfe050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:09.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.125+0000 7f1cad0d9640 1 --2- 172.21.15.79:0/772034956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2b9cf4830 0x55b2b9cfe050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:09.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.125+0000 7f1cad0d9640 1 -- 172.21.15.79:0/772034956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b2b9d010e0 msgr2=0x55b2b9cfead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:09.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.125+0000 7f1cad0d9640 1 --2- 172.21.15.79:0/772034956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b2b9d010e0 0x55b2b9cfead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:09.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.125+0000 7f1cad0d9640 1 -- 172.21.15.79:0/772034956 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2b9d0d160 con 0x55b2b9cf5150 2024-08-20T01:46:09.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.125+0000 7f1cae0db640 1 --2- 172.21.15.79:0/772034956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b2b9d010e0 0x55b2b9cfead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:46:09.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.126+0000 7f1cad0d9640 1 --2- 172.21.15.79:0/772034956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2b9cf5150 0x55b2b9cfe590 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1c98006010 tx=0x7f1c980047a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32007470afb7f09b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:09.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.126+0000 7f1c917fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:46:09.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.126+0000 7f1c917fa640 1 -- 172.21.15.79:0/772034956 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c98026020 con 0x55b2b9cf5150 2024-08-20T01:46:09.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.126+0000 7f1c917fa640 1 -- 172.21.15.79:0/772034956 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f1c98004b90 con 0x55b2b9cf5150 2024-08-20T01:46:09.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.127+0000 7f1cb1f37740 1 -- 172.21.15.79:0/772034956 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b2b9c0a100 con 0x55b2b9cf5150 2024-08-20T01:46:09.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.127+0000 7f1c917fa640 1 -- 172.21.15.79:0/772034956 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f1c9801d040 con 0x55b2b9cf5150 2024-08-20T01:46:09.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.127+0000 7f1cb1f37740 10 client.27023 fetch_fsmap learned FSMap version 44 2024-08-20T01:46:09.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.127+0000 7f1cb1f37740 1 -- 172.21.15.79:0/772034956 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55b2b9d0faf0 con 0x55b2b9cf5150 2024-08-20T01:46:09.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.127+0000 7f1c917fa640 1 -- 172.21.15.79:0/772034956 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55b2b9c0a100 con 0x55b2b9cf5150 2024-08-20T01:46:09.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.128+0000 7f1c917fa640 1 -- 172.21.15.79:0/772034956 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 44) ==== 8382+0+0 (secure 0 0 0) 0x7f1c980188c0 con 0x55b2b9cf5150 2024-08-20T01:46:09.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.128+0000 7f1cb1f37740 10 client.27023 fetch_fsmap finished waiting for FSMap version 44 2024-08-20T01:46:09.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.128+0000 7f1cb1f37740 10 client.27023 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:46:09.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.128+0000 7f1cb1f37740 20 client.27023 populate_metadata read hostname 'smithi079' 2024-08-20T01:46:09.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.128+0000 7f1cb1f37740 1 --2- 172.21.15.79:0/772034956 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55b2b9d10ea0 0x55b2b9d13290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:09.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.128+0000 7f1cb1f37740 4 client.27023 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:46:09.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.128+0000 7f1cb1f37740 1 -- 172.21.15.79:0/772034956 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b2b9c6d830 con 0x55b2b9d10ea0 2024-08-20T01:46:09.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.128+0000 7f1cad8da640 1 --2- 172.21.15.79:0/772034956 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55b2b9d10ea0 0x55b2b9d13290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:09.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.129+0000 7f1cad8da640 1 --2- 172.21.15.79:0/772034956 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55b2b9d10ea0 0x55b2b9d13290 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5fb3371a5f3c1c2 server_cookie=1bfcceb874dc8931 in_seq=0 out_seq=0 2024-08-20T01:46:09.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.129+0000 7f1c917fa640 10 client.27023 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:46:09.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.130+0000 7f1c917fa640 1 -- 172.21.15.79:0/772034956 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b2b9c6d830 con 0x55b2b9d10ea0 2024-08-20T01:46:09.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.130+0000 7f1c917fa640 10 client.27023 handle_command_reply: tid=0 2024-08-20T01:46:09.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.130+0000 7f1cb1f37740 1 client.27023 shutdown 2024-08-20T01:46:09.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.130+0000 7f1cb1f37740 1 -- 172.21.15.79:0/772034956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2b9cf5150 msgr2=0x55b2b9cfe590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:09.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.130+0000 7f1cb1f37740 1 --2- 172.21.15.79:0/772034956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2b9cf5150 0x55b2b9cfe590 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1c98006010 tx=0x7f1c980047a0 comp rx=0 tx=0).stop 2024-08-20T01:46:09.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.131+0000 7f1cb1f37740 1 -- 172.21.15.79:0/772034956 shutdown_connections 2024-08-20T01:46:09.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.131+0000 7f1cb1f37740 1 --2- 172.21.15.79:0/772034956 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55b2b9d10ea0 0x55b2b9d13290 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:09.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.132+0000 7f1cb1f37740 1 --2- 172.21.15.79:0/772034956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b2b9d010e0 0x55b2b9cfead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:09.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.132+0000 7f1c917fa640 0 client.27023 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:46:09.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.132+0000 7f1cb1f37740 1 --2- 172.21.15.79:0/772034956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2b9cf5150 0x55b2b9cfe590 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:09.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.132+0000 7f1cb1f37740 1 --2- 172.21.15.79:0/772034956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2b9cf4830 0x55b2b9cfe050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:09.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.132+0000 7f1cb1f37740 1 -- 172.21.15.79:0/772034956 >> 172.21.15.79:0/772034956 conn(0x55b2b9cf2660 msgr2=0x55b2b9cf8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:09.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.132+0000 7f1cb1f37740 1 -- 172.21.15.79:0/772034956 shutdown_connections 2024-08-20T01:46:09.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.132+0000 7f1cb1f37740 1 -- 172.21.15.79:0/772034956 wait complete. 2024-08-20T01:46:09.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.133+0000 7f1cb1f37740 20 client.27023 trim_cache size 0 max 16384 2024-08-20T01:46:09.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.165+0000 7f1cb1f37740 1 Processor -- start 2024-08-20T01:46:09.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.165+0000 7f1cb1f37740 1 -- start start 2024-08-20T01:46:09.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.166+0000 7f1cb1f37740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2b9cf4830 0x55b2b9d188c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:09.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.166+0000 7f1cb1f37740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b2b9cf5150 0x55b2b9d18e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:09.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.166+0000 7f1cad8da640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2b9cf4830 0x55b2b9d188c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:09.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.166+0000 7f1cad8da640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2b9cf4830 0x55b2b9d188c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:46892/0 (socket says 172.21.15.79:46892) 2024-08-20T01:46:09.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.167+0000 7f1cad8da640 1 -- 172.21.15.79:0/4023869828 learned_addr learned my addr 172.21.15.79:0/4023869828 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:09.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.167+0000 7f1cb1f37740 1 --2- 172.21.15.79:0/4023869828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2b9d010e0 0x55b2b9d09060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:09.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.167+0000 7f1cb1f37740 1 -- 172.21.15.79:0/4023869828 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca81b46e0 con 0x55b2b9cf5150 2024-08-20T01:46:09.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.167+0000 7f1cb1f37740 1 -- 172.21.15.79:0/4023869828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca81b6310 con 0x55b2b9d010e0 2024-08-20T01:46:09.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.167+0000 7f1cb1f37740 1 -- 172.21.15.79:0/4023869828 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca81b4db0 con 0x55b2b9cf4830 2024-08-20T01:46:09.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.167+0000 7f1cad0d9640 1 --2- 172.21.15.79:0/4023869828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b2b9cf5150 0x55b2b9d18e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:09.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.167+0000 7f1cae0db640 1 --2- 172.21.15.79:0/4023869828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2b9d010e0 0x55b2b9d09060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:09.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.168+0000 7f1cad0d9640 1 -- 172.21.15.79:0/4023869828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2b9cf4830 msgr2=0x55b2b9d188c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:09.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.168+0000 7f1cad0d9640 1 --2- 172.21.15.79:0/4023869828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2b9cf4830 0x55b2b9d188c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:09.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.168+0000 7f1cad0d9640 1 -- 172.21.15.79:0/4023869828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2b9d010e0 msgr2=0x55b2b9d09060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:09.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.168+0000 7f1cad0d9640 1 --2- 172.21.15.79:0/4023869828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2b9d010e0 0x55b2b9d09060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:09.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.168+0000 7f1cad0d9640 1 -- 172.21.15.79:0/4023869828 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2b9cf2490 con 0x55b2b9cf5150 2024-08-20T01:46:09.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.168+0000 7f1cad0d9640 1 --2- 172.21.15.79:0/4023869828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b2b9cf5150 0x55b2b9d18e00 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f1c9802d040 tx=0x7f1c98005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=231f66a038983193 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:09.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.168+0000 7f1c937fe640 1 -- 172.21.15.79:0/4023869828 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c98037020 con 0x55b2b9cf5150 2024-08-20T01:46:09.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.168+0000 7f1c937fe640 1 -- 172.21.15.79:0/4023869828 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1c98018ad0 con 0x55b2b9cf5150 2024-08-20T01:46:09.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.168+0000 7f1c937fe640 1 -- 172.21.15.79:0/4023869828 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c98026040 con 0x55b2b9cf5150 2024-08-20T01:46:09.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.169+0000 7f1cb1f37740 1 -- 172.21.15.79:0/4023869828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b2b9cf5150 msgr2=0x55b2b9d18e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:09.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.169+0000 7f1cb1f37740 1 --2- 172.21.15.79:0/4023869828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b2b9cf5150 0x55b2b9d18e00 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f1c9802d040 tx=0x7f1c98005900 comp rx=0 tx=0).stop 2024-08-20T01:46:09.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.170+0000 7f1cb1f37740 1 -- 172.21.15.79:0/4023869828 shutdown_connections 2024-08-20T01:46:09.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.170+0000 7f1cb1f37740 1 --2- 172.21.15.79:0/4023869828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2b9d010e0 0x55b2b9d09060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:09.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.170+0000 7f1cb1f37740 1 --2- 172.21.15.79:0/4023869828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b2b9cf5150 0x55b2b9d18e00 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:09.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.170+0000 7f1cb1f37740 1 --2- 172.21.15.79:0/4023869828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2b9cf4830 0x55b2b9d188c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:09.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.170+0000 7f1cb1f37740 1 -- 172.21.15.79:0/4023869828 >> 172.21.15.79:0/4023869828 conn(0x55b2b9cf2660 msgr2=0x55b2b9cffea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:09.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.170+0000 7f1cb1f37740 1 -- 172.21.15.79:0/4023869828 shutdown_connections 2024-08-20T01:46:09.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.170+0000 7f1cb1f37740 1 -- 172.21.15.79:0/4023869828 wait complete. 2024-08-20T01:46:09.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.170+0000 7f1cb1f37740 1 -- start start 2024-08-20T01:46:09.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.171+0000 7f1cb1f37740 1 Processor -- start 2024-08-20T01:46:09.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.171+0000 7f1cb1f37740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2b9cf4830 0x55b2b9d094d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:09.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.172+0000 7f1cb1f37740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2b9cf5150 0x55b2b9d06a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:09.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.172+0000 7f1cad8da640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2b9cf4830 0x55b2b9d094d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:09.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.172+0000 7f1cad8da640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2b9cf4830 0x55b2b9d094d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:46896/0 (socket says 172.21.15.79:46896) 2024-08-20T01:46:09.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.172+0000 7f1cad8da640 1 -- 172.21.15.79:0/3891176725 learned_addr learned my addr 172.21.15.79:0/3891176725 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:09.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.172+0000 7f1cb1f37740 1 --2- 172.21.15.79:0/3891176725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b2b9d010e0 0x55b2b9d06f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:09.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.172+0000 7f1cb1f37740 1 -- 172.21.15.79:0/3891176725 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca81b5c10 con 0x55b2b9d010e0 2024-08-20T01:46:09.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.172+0000 7f1cad0d9640 1 --2- 172.21.15.79:0/3891176725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2b9cf5150 0x55b2b9d06a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:09.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.172+0000 7f1cb1f37740 1 -- 172.21.15.79:0/3891176725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca81b5480 con 0x55b2b9cf5150 2024-08-20T01:46:09.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.172+0000 7f1cb1f37740 1 -- 172.21.15.79:0/3891176725 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca81b26c0 con 0x55b2b9cf4830 2024-08-20T01:46:09.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.172+0000 7f1cb1f37740 10 client.0 _ll_register_callbacks cb 0x7f1ca00c6380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:46:09.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.172+0000 7f1cae0db640 1 --2- 172.21.15.79:0/3891176725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b2b9d010e0 0x55b2b9d06f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:09.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.173+0000 7f1cad0d9640 1 -- 172.21.15.79:0/3891176725 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2b9cf4830 msgr2=0x55b2b9d094d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:09.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.173+0000 7f1cad0d9640 1 --2- 172.21.15.79:0/3891176725 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2b9cf4830 0x55b2b9d094d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:09.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.173+0000 7f1cad0d9640 1 -- 172.21.15.79:0/3891176725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b2b9d010e0 msgr2=0x55b2b9d06f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:09.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.173+0000 7f1cad0d9640 1 --2- 172.21.15.79:0/3891176725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b2b9d010e0 0x55b2b9d06f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:09.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.173+0000 7f1cad0d9640 1 -- 172.21.15.79:0/3891176725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2b9d07540 con 0x55b2b9cf5150 2024-08-20T01:46:09.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.173+0000 7f1cad0d9640 1 --2- 172.21.15.79:0/3891176725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2b9cf5150 0x55b2b9d06a10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55b2b9cfc730 tx=0x7f1c98010930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=396407bac6dfab39 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:09.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.173+0000 7f1c917fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:46:09.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.173+0000 7f1c917fa640 1 -- 172.21.15.79:0/3891176725 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c98046060 con 0x55b2b9cf5150 2024-08-20T01:46:09.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.173+0000 7f1c917fa640 1 -- 172.21.15.79:0/3891176725 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f1c9803e440 con 0x55b2b9cf5150 2024-08-20T01:46:09.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.174+0000 7f1cb1f37740 1 -- 172.21.15.79:0/3891176725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c98018ad0 con 0x55b2b9cf5150 2024-08-20T01:46:09.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.174+0000 7f1c917fa640 1 -- 172.21.15.79:0/3891176725 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f1c98037030 con 0x55b2b9cf5150 2024-08-20T01:46:09.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.174+0000 7f1cb1f37740 10 client.27026 fetch_fsmap learned FSMap version 44 2024-08-20T01:46:09.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.174+0000 7f1cb1f37740 1 -- 172.21.15.79:0/3891176725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55b2b9d7b6d0 con 0x55b2b9cf5150 2024-08-20T01:46:09.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.174+0000 7f1c917fa640 1 -- 172.21.15.79:0/3891176725 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1c9803ead0 con 0x55b2b9cf5150 2024-08-20T01:46:09.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.174+0000 7f1c917fa640 1 -- 172.21.15.79:0/3891176725 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 44) ==== 8382+0+0 (secure 0 0 0) 0x7f1c98023750 con 0x55b2b9cf5150 2024-08-20T01:46:09.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.174+0000 7f1cb1f37740 10 client.27026 fetch_fsmap finished waiting for FSMap version 44 2024-08-20T01:46:09.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.174+0000 7f1cb1f37740 10 client.27026 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:46:09.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.174+0000 7f1cb1f37740 20 client.27026 populate_metadata read hostname 'smithi079' 2024-08-20T01:46:09.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.174+0000 7f1cb1f37740 1 --2- 172.21.15.79:0/3891176725 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55b2b9d10ea0 0x55b2b9d7ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:09.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.174+0000 7f1cb1f37740 4 client.27026 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:46:09.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.174+0000 7f1cb1f37740 1 -- 172.21.15.79:0/3891176725 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f1c98018ad0 con 0x55b2b9d10ea0 2024-08-20T01:46:09.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.175+0000 7f1cad8da640 1 --2- 172.21.15.79:0/3891176725 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55b2b9d10ea0 0x55b2b9d7ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:09.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.175+0000 7f1c917fa640 10 client.27026 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:46:09.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.175+0000 7f1cad8da640 1 --2- 172.21.15.79:0/3891176725 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55b2b9d10ea0 0x55b2b9d7ddb0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27e0405747bfca59 server_cookie=f944b15e34a47fe in_seq=0 out_seq=0 2024-08-20T01:46:09.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.175+0000 7f1c917fa640 1 -- 172.21.15.79:0/3891176725 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7f1c98018ad0 con 0x55b2b9d10ea0 2024-08-20T01:46:09.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.175+0000 7f1c917fa640 10 client.27026 handle_command_reply: tid=0 2024-08-20T01:46:09.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.175+0000 7f1cb1f37740 1 client.27026 shutdown 2024-08-20T01:46:09.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.176+0000 7f1cb1f37740 1 -- 172.21.15.79:0/3891176725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2b9cf5150 msgr2=0x55b2b9d06a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:09.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.176+0000 7f1cb1f37740 1 --2- 172.21.15.79:0/3891176725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2b9cf5150 0x55b2b9d06a10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55b2b9cfc730 tx=0x7f1c98010930 comp rx=0 tx=0).stop 2024-08-20T01:46:09.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.176+0000 7f1cb1f37740 1 -- 172.21.15.79:0/3891176725 shutdown_connections 2024-08-20T01:46:09.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.176+0000 7f1cb1f37740 1 --2- 172.21.15.79:0/3891176725 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55b2b9d10ea0 0x55b2b9d7ddb0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:09.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.176+0000 7f1cb1f37740 1 --2- 172.21.15.79:0/3891176725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b2b9d010e0 0x55b2b9d06f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:09.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.176+0000 7f1cb1f37740 1 --2- 172.21.15.79:0/3891176725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2b9cf5150 0x55b2b9d06a10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:09.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.176+0000 7f1cb1f37740 1 --2- 172.21.15.79:0/3891176725 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2b9cf4830 0x55b2b9d094d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:09.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.176+0000 7f1cb1f37740 1 -- 172.21.15.79:0/3891176725 >> 172.21.15.79:0/3891176725 conn(0x55b2b9cf2660 msgr2=0x55b2b9d0bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:09.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.176+0000 7f1c917fa640 0 client.27026 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:46:09.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.176+0000 7f1cb1f37740 1 -- 172.21.15.79:0/3891176725 shutdown_connections 2024-08-20T01:46:09.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.176+0000 7f1cb1f37740 1 -- 172.21.15.79:0/3891176725 wait complete. 2024-08-20T01:46:09.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.176+0000 7f1cb1f37740 20 client.27026 trim_cache size 0 max 16384 2024-08-20T01:46:09.180 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:46:09.180 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-20T01:46:09.180 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": { 2024-08-20T01:46:09.180 INFO:teuthology.orchestra.run.smithi079.stdout: "6ba0d26f-8a93-4475-9c61-e8f9b3c883b3": { 2024-08-20T01:46:09.181 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/", 2024-08-20T01:46:09.181 INFO:teuthology.orchestra.run.smithi079.stdout: "tag": "6ba0d26f-8a93-4475-9c61-e8f9b3c883b3", 2024-08-20T01:46:09.181 INFO:teuthology.orchestra.run.smithi079.stdout: "options": "recursive,force" 2024-08-20T01:46:09.181 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:46:09.181 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:46:09.181 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:46:09.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.177+0000 7f1cafb3e640 1 -- 172.21.15.79:0/951857530 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1c940b3d10 msgr2=0x7f1c940b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:09.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.177+0000 7f1cafb3e640 1 --2- 172.21.15.79:0/951857530 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1c940b3d10 0x7f1c940b61d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4006fd0 tx=0x7f1ca4009de0 comp rx=0 tx=0).stop 2024-08-20T01:46:09.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.177+0000 7f1cafb3e640 1 -- 172.21.15.79:0/951857530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ca810f460 msgr2=0x7f1ca81a4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:09.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.177+0000 7f1cafb3e640 1 --2- 172.21.15.79:0/951857530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ca810f460 0x7f1ca81a4df0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0033040 tx=0x7f1ca0003970 comp rx=0 tx=0).stop 2024-08-20T01:46:09.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.177+0000 7f1cafb3e640 1 -- 172.21.15.79:0/951857530 shutdown_connections 2024-08-20T01:46:09.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.177+0000 7f1cafb3e640 1 --2- 172.21.15.79:0/951857530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ca810f460 0x7f1ca81a4df0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:09.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.177+0000 7f1cafb3e640 1 --2- 172.21.15.79:0/951857530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca810eae0 0x7f1ca819fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:09.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.177+0000 7f1cafb3e640 1 --2- 172.21.15.79:0/951857530 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1c940b3d10 0x7f1c940b61d0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:09.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.177+0000 7f1cafb3e640 1 --2- 172.21.15.79:0/951857530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ca81090d0 0x7f1ca819f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:09.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.177+0000 7f1cafb3e640 1 -- 172.21.15.79:0/951857530 >> 172.21.15.79:0/951857530 conn(0x7f1ca8078800 msgr2=0x7f1ca807abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:09.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.177+0000 7f1cafb3e640 1 -- 172.21.15.79:0/951857530 shutdown_connections 2024-08-20T01:46:09.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:09.178+0000 7f1cafb3e640 1 -- 172.21.15.79:0/951857530 wait complete. 2024-08-20T01:46:09.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:09 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:46:09.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:09 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:46:09.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:09 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:46:10.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:10 smithi175 ceph-mon[22392]: pgmap v612: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 27 MiB/s wr, 6.80k op/s 2024-08-20T01:46:10.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:10 smithi079 ceph-mon[18656]: pgmap v612: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 27 MiB/s wr, 6.80k op/s 2024-08-20T01:46:10.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:10 smithi081 ceph-mon[22209]: pgmap v612: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 27 MiB/s wr, 6.80k op/s 2024-08-20T01:46:10.629 INFO:tasks.cephfs.filesystem:scrub status for tag:6ba0d26f-8a93-4475-9c61-e8f9b3c883b3 - {'path': '/', 'tag': '6ba0d26f-8a93-4475-9c61-e8f9b3c883b3', 'options': 'recursive,force'} 2024-08-20T01:46:12.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:12 smithi175 ceph-mon[22392]: pgmap v613: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 25 MiB/s wr, 6.36k op/s 2024-08-20T01:46:12.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:12 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:46:12.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:12 smithi079 ceph-mon[18656]: pgmap v613: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 25 MiB/s wr, 6.36k op/s 2024-08-20T01:46:12.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:12 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:46:12.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:12 smithi081 ceph-mon[22209]: pgmap v613: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 25 MiB/s wr, 6.36k op/s 2024-08-20T01:46:12.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:12 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:46:13.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:13 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:46:13.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:13 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:46:13.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:13 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:46:13.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:13 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:46:13.438 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:13 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:46:13.438 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:13 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:46:13.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:13 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:46:13.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:13 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:46:13.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:13 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:46:14.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:14 smithi079 ceph-mon[18656]: pgmap v614: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 24 MiB/s wr, 6.11k op/s 2024-08-20T01:46:14.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:14 smithi081 ceph-mon[22209]: pgmap v614: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 24 MiB/s wr, 6.11k op/s 2024-08-20T01:46:14.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:14 smithi175 ceph-mon[22392]: pgmap v614: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 24 MiB/s wr, 6.11k op/s 2024-08-20T01:46:16.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:16 smithi079 ceph-mon[18656]: pgmap v615: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 26 MiB/s wr, 6.70k op/s 2024-08-20T01:46:16.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:16 smithi081 ceph-mon[22209]: pgmap v615: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 26 MiB/s wr, 6.70k op/s 2024-08-20T01:46:16.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:16 smithi175 ceph-mon[22392]: pgmap v615: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 26 MiB/s wr, 6.70k op/s 2024-08-20T01:46:18.689 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:18 smithi079 ceph-mon[18656]: pgmap v616: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 25 MiB/s wr, 6.39k op/s 2024-08-20T01:46:18.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:18 smithi081 ceph-mon[22209]: pgmap v616: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 25 MiB/s wr, 6.39k op/s 2024-08-20T01:46:18.847 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.844+0000 7f836f97b640 1 -- 172.21.15.79:0/1376039082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8368101250 msgr2=0x7f8368101e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:18.847 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.845+0000 7f836f97b640 1 --2- 172.21.15.79:0/1376039082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8368101250 0x7f8368101e60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8358009900 tx=0x7f835802a3f0 comp rx=0 tx=0).stop 2024-08-20T01:46:18.848 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.845+0000 7f836f97b640 1 -- 172.21.15.79:0/1376039082 shutdown_connections 2024-08-20T01:46:18.848 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.845+0000 7f836f97b640 1 --2- 172.21.15.79:0/1376039082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83681023a0 0x7f8368102850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:18.848 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.845+0000 7f836f97b640 1 --2- 172.21.15.79:0/1376039082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8368101250 0x7f8368101e60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:18.848 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.845+0000 7f836f97b640 1 --2- 172.21.15.79:0/1376039082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f836806a7e0 0x7f8368100d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:18.848 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.845+0000 7f836f97b640 1 -- 172.21.15.79:0/1376039082 >> 172.21.15.79:0/1376039082 conn(0x7f83680fc5b0 msgr2=0x7f83680fe9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:18.848 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.845+0000 7f836f97b640 1 -- 172.21.15.79:0/1376039082 shutdown_connections 2024-08-20T01:46:18.848 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.845+0000 7f836f97b640 1 -- 172.21.15.79:0/1376039082 wait complete. 2024-08-20T01:46:18.850 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.846+0000 7f836f97b640 1 Processor -- start 2024-08-20T01:46:18.850 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.846+0000 7f836f97b640 1 -- start start 2024-08-20T01:46:18.850 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.846+0000 7f836f97b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f836806a7e0 0x7f8368103b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:18.850 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.847+0000 7f836f97b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8368101250 0x7f836819d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:18.850 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.847+0000 7f836f97b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83681023a0 0x7f836819fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:18.850 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.847+0000 7f836f97b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f836810d0d0 con 0x7f836806a7e0 2024-08-20T01:46:18.850 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.847+0000 7f836f97b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f836810cf50 con 0x7f83681023a0 2024-08-20T01:46:18.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.847+0000 7f836f97b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f836810d250 con 0x7f8368101250 2024-08-20T01:46:18.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.847+0000 7f836cf16640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8368101250 0x7f836819d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:18.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.847+0000 7f836d717640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f836806a7e0 0x7f8368103b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:18.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.847+0000 7f836cf16640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8368101250 0x7f836819d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:34308/0 (socket says 172.21.15.79:34308) 2024-08-20T01:46:18.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.847+0000 7f836cf16640 1 -- 172.21.15.79:0/2425671124 learned_addr learned my addr 172.21.15.79:0/2425671124 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:18.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.847+0000 7f836df18640 1 --2- 172.21.15.79:0/2425671124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83681023a0 0x7f836819fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:18.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.847+0000 7f836d717640 1 -- 172.21.15.79:0/2425671124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8368101250 msgr2=0x7f836819d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:18.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.847+0000 7f836d717640 1 --2- 172.21.15.79:0/2425671124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8368101250 0x7f836819d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:18.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.847+0000 7f836d717640 1 -- 172.21.15.79:0/2425671124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83681023a0 msgr2=0x7f836819fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:18.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.847+0000 7f836d717640 1 --2- 172.21.15.79:0/2425671124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83681023a0 0x7f836819fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:18.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.847+0000 7f836d717640 1 -- 172.21.15.79:0/2425671124 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8368197410 con 0x7f836806a7e0 2024-08-20T01:46:18.851 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.847+0000 7f836df18640 1 --2- 172.21.15.79:0/2425671124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83681023a0 0x7f836819fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:46:18.852 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.848+0000 7f836d717640 1 --2- 172.21.15.79:0/2425671124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f836806a7e0 0x7f8368103b20 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f836000eb00 tx=0x7f836000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:18.852 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.848+0000 7f835e7fc640 1 -- 172.21.15.79:0/2425671124 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8360010430 con 0x7f836806a7e0 2024-08-20T01:46:18.852 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.848+0000 7f835e7fc640 1 -- 172.21.15.79:0/2425671124 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8360010a60 con 0x7f836806a7e0 2024-08-20T01:46:18.852 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.848+0000 7f835e7fc640 1 -- 172.21.15.79:0/2425671124 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83600179c0 con 0x7f836806a7e0 2024-08-20T01:46:18.852 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.848+0000 7f836f97b640 1 -- 172.21.15.79:0/2425671124 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8368197700 con 0x7f836806a7e0 2024-08-20T01:46:18.853 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.848+0000 7f836f97b640 1 -- 172.21.15.79:0/2425671124 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8368197c00 con 0x7f836806a7e0 2024-08-20T01:46:18.854 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.852+0000 7f8372847740 1 Processor -- start 2024-08-20T01:46:18.855 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.853+0000 7f8372847740 1 -- start start 2024-08-20T01:46:18.855 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.853+0000 7f8372847740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e152173630 0x55e152175a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:18.855 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.853+0000 7f8372847740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e152175f60 0x55e152178350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:18.855 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.853+0000 7f8372847740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e1521789a0 0x55e15217ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:18.855 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.853+0000 7f8372847740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e1520e6360 con 0x55e1521789a0 2024-08-20T01:46:18.855 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.853+0000 7f8372847740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e1520d5860 con 0x55e152175f60 2024-08-20T01:46:18.856 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.853+0000 7f8372847740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e1520d98a0 con 0x55e152173630 2024-08-20T01:46:18.856 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.853+0000 7f836df18640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e152173630 0x55e152175a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:18.857 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.853+0000 7f836df18640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e152173630 0x55e152175a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:34316/0 (socket says 172.21.15.79:34316) 2024-08-20T01:46:18.857 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.853+0000 7f836df18640 1 -- 172.21.15.79:0/306817376 learned_addr learned my addr 172.21.15.79:0/306817376 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:18.857 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.853+0000 7f836cf16640 1 --2- 172.21.15.79:0/306817376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e1521789a0 0x55e15217ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:18.857 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.854+0000 7f836df18640 1 -- 172.21.15.79:0/306817376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e152175f60 msgr2=0x55e152178350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:46:18.857 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.854+0000 7f836df18640 1 --2- 172.21.15.79:0/306817376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e152175f60 0x55e152178350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:18.857 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.854+0000 7f836df18640 1 -- 172.21.15.79:0/306817376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e1521789a0 msgr2=0x55e15217ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:18.857 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.854+0000 7f836df18640 1 --2- 172.21.15.79:0/306817376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e1521789a0 0x55e15217ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:18.858 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.854+0000 7f836df18640 1 -- 172.21.15.79:0/306817376 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e15207ce40 con 0x55e152173630 2024-08-20T01:46:18.858 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.854+0000 7f835e7fc640 1 -- 172.21.15.79:0/2425671124 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f8360017b80 con 0x7f836806a7e0 2024-08-20T01:46:18.858 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.854+0000 7f836df18640 1 --2- 172.21.15.79:0/306817376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e152173630 0x55e152175a20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8364009cc0 tx=0x7f83640117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8324e69e4aafd5bc server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:18.859 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.854+0000 7f83537fe640 1 -- 172.21.15.79:0/306817376 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8364012450 con 0x55e152173630 2024-08-20T01:46:18.860 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.855+0000 7f83537fe640 1 -- 172.21.15.79:0/306817376 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8364012a80 con 0x55e152173630 2024-08-20T01:46:18.860 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.855+0000 7f83537fe640 1 -- 172.21.15.79:0/306817376 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f836400fae0 con 0x55e152173630 2024-08-20T01:46:18.860 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.855+0000 7f835e7fc640 1 --2- 172.21.15.79:0/2425671124 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f83540b3c50 0x7f83540b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:18.860 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.855+0000 7f8372847740 1 -- 172.21.15.79:0/306817376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e152173630 msgr2=0x55e152175a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:18.860 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.855+0000 7f8372847740 1 --2- 172.21.15.79:0/306817376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e152173630 0x55e152175a20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8364009cc0 tx=0x7f83640117b0 comp rx=0 tx=0).stop 2024-08-20T01:46:18.861 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.855+0000 7f835e7fc640 1 -- 172.21.15.79:0/2425671124 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f83600e4610 con 0x7f836806a7e0 2024-08-20T01:46:18.861 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.855+0000 7f836d717640 1 --2- 172.21.15.79:0/2425671124 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f83540b3c50 0x7f83540b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:18.861 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.856+0000 7f8372847740 1 -- 172.21.15.79:0/306817376 shutdown_connections 2024-08-20T01:46:18.861 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.856+0000 7f8372847740 1 --2- 172.21.15.79:0/306817376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e1521789a0 0x55e15217ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:18.862 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.856+0000 7f8372847740 1 --2- 172.21.15.79:0/306817376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e152175f60 0x55e152178350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:18.862 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.856+0000 7f8372847740 1 --2- 172.21.15.79:0/306817376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e152173630 0x55e152175a20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:18.862 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.856+0000 7f8372847740 1 -- 172.21.15.79:0/306817376 >> 172.21.15.79:0/306817376 conn(0x55e15216e730 msgr2=0x55e15216f510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:18.862 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.856+0000 7f8372847740 1 -- 172.21.15.79:0/306817376 shutdown_connections 2024-08-20T01:46:18.862 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.856+0000 7f8372847740 1 -- 172.21.15.79:0/306817376 wait complete. 2024-08-20T01:46:18.862 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.857+0000 7f8372847740 1 -- start start 2024-08-20T01:46:18.862 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.857+0000 7f836d717640 1 --2- 172.21.15.79:0/2425671124 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f83540b3c50 0x7f83540b6110 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f83600e4970 tx=0x7f83600a7430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:18.862 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.857+0000 7f8372847740 1 Processor -- start 2024-08-20T01:46:18.866 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.857+0000 7f8372847740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e152173630 0x55e15217cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:18.866 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.857+0000 7f8372847740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e152175f60 0x55e15217d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:18.866 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.858+0000 7f8372847740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e1521789a0 0x55e15217e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:18.866 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.858+0000 7f8372847740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e15200eab0 con 0x55e1521789a0 2024-08-20T01:46:18.866 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.858+0000 7f836df18640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e152173630 0x55e15217cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:18.867 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.858+0000 7f836df18640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e1521789a0 0x55e15217e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:18.867 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.858+0000 7f8372847740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e15205c780 con 0x55e152173630 2024-08-20T01:46:18.867 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.858+0000 7f8372847740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e15217b980 con 0x55e152175f60 2024-08-20T01:46:18.867 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.858+0000 7f836df18640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e1521789a0 0x55e15217e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52086/0 (socket says 172.21.15.79:52086) 2024-08-20T01:46:18.867 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.858+0000 7f836cf16640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e152175f60 0x55e15217d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:18.867 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.858+0000 7f836df18640 1 -- 172.21.15.79:0/3149569551 learned_addr learned my addr 172.21.15.79:0/3149569551 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:18.867 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.858+0000 7f8372847740 10 client.0 _ll_register_callbacks cb 0x55e151de4a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:46:18.867 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.858+0000 7f836df18640 1 -- 172.21.15.79:0/3149569551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e152175f60 msgr2=0x55e15217d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:18.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.858+0000 7f836df18640 1 --2- 172.21.15.79:0/3149569551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e152175f60 0x55e15217d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:18.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.858+0000 7f836df18640 1 -- 172.21.15.79:0/3149569551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e152173630 msgr2=0x55e15217cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:18.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.858+0000 7f836df18640 1 --2- 172.21.15.79:0/3149569551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e152173630 0x55e15217cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:18.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.858+0000 7f836df18640 1 -- 172.21.15.79:0/3149569551 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e151e38790 con 0x55e1521789a0 2024-08-20T01:46:18.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.858+0000 7f836df18640 1 --2- 172.21.15.79:0/3149569551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e1521789a0 0x55e15217e130 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f8364009530 tx=0x7f836400f440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e627630aaf2a494 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:18.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.858+0000 7f8350ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:46:18.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.859+0000 7f8350ff9640 1 -- 172.21.15.79:0/3149569551 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83640129d0 con 0x55e1521789a0 2024-08-20T01:46:18.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.859+0000 7f8372847740 1 -- 172.21.15.79:0/3149569551 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e152084e00 con 0x55e1521789a0 2024-08-20T01:46:18.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.859+0000 7f8350ff9640 1 -- 172.21.15.79:0/3149569551 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f8364012b70 con 0x55e1521789a0 2024-08-20T01:46:18.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.859+0000 7f8350ff9640 1 -- 172.21.15.79:0/3149569551 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f8364012d70 con 0x55e1521789a0 2024-08-20T01:46:18.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.859+0000 7f8372847740 10 client.18042 fetch_fsmap learned FSMap version 44 2024-08-20T01:46:18.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.859+0000 7f8372847740 1 -- 172.21.15.79:0/3149569551 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55e151eb1620 con 0x55e1521789a0 2024-08-20T01:46:18.869 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.859+0000 7f8350ff9640 1 -- 172.21.15.79:0/3149569551 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55e152084e00 con 0x55e1521789a0 2024-08-20T01:46:18.869 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.859+0000 7f8350ff9640 1 -- 172.21.15.79:0/3149569551 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 44) ==== 8382+0+0 (secure 0 0 0) 0x7f8364026040 con 0x55e1521789a0 2024-08-20T01:46:18.869 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.860+0000 7f8372847740 10 client.18042 fetch_fsmap finished waiting for FSMap version 44 2024-08-20T01:46:18.869 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.860+0000 7f8372847740 10 client.18042 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:46:18.869 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.860+0000 7f8372847740 20 client.18042 populate_metadata read hostname 'smithi079' 2024-08-20T01:46:18.869 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.860+0000 7f8372847740 1 --2- 172.21.15.79:0/3149569551 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55e152188ab0 0x55e15218af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:18.869 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.860+0000 7f8372847740 4 client.18042 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:46:18.869 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.860+0000 7f8372847740 1 -- 172.21.15.79:0/3149569551 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e1520e82b0 con 0x55e152188ab0 2024-08-20T01:46:18.869 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.860+0000 7f836cf16640 1 --2- 172.21.15.79:0/3149569551 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55e152188ab0 0x55e15218af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:18.869 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.861+0000 7f836cf16640 1 --2- 172.21.15.79:0/3149569551 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55e152188ab0 0x55e15218af10 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84cc16a9d2999d41 server_cookie=c001d76a71c6d814 in_seq=0 out_seq=0 2024-08-20T01:46:18.869 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.862+0000 7f8350ff9640 10 client.18042 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:46:18.869 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.862+0000 7f8350ff9640 1 -- 172.21.15.79:0/3149569551 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e1520e82b0 con 0x55e152188ab0 2024-08-20T01:46:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.862+0000 7f8350ff9640 10 client.18042 handle_command_reply: tid=0 2024-08-20T01:46:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.863+0000 7f8372847740 1 client.18042 shutdown 2024-08-20T01:46:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.863+0000 7f8372847740 1 -- 172.21.15.79:0/3149569551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e1521789a0 msgr2=0x55e15217e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.863+0000 7f8372847740 1 --2- 172.21.15.79:0/3149569551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e1521789a0 0x55e15217e130 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f8364009530 tx=0x7f836400f440 comp rx=0 tx=0).stop 2024-08-20T01:46:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.863+0000 7f8372847740 1 -- 172.21.15.79:0/3149569551 shutdown_connections 2024-08-20T01:46:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.863+0000 7f8372847740 1 --2- 172.21.15.79:0/3149569551 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55e152188ab0 0x55e15218af10 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.863+0000 7f8372847740 1 --2- 172.21.15.79:0/3149569551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e1521789a0 0x55e15217e130 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.863+0000 7f8372847740 1 --2- 172.21.15.79:0/3149569551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e152175f60 0x55e15217d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.863+0000 7f8372847740 1 --2- 172.21.15.79:0/3149569551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e152173630 0x55e15217cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.863+0000 7f8372847740 1 -- 172.21.15.79:0/3149569551 >> 172.21.15.79:0/3149569551 conn(0x55e15216e730 msgr2=0x55e15216d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.863+0000 7f8350ff9640 0 client.18042 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:46:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.864+0000 7f8372847740 1 -- 172.21.15.79:0/3149569551 shutdown_connections 2024-08-20T01:46:18.871 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.864+0000 7f8372847740 1 -- 172.21.15.79:0/3149569551 wait complete. 2024-08-20T01:46:18.871 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.864+0000 7f8372847740 20 client.18042 trim_cache size 0 max 16384 2024-08-20T01:46:18.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:18 smithi175 ceph-mon[22392]: pgmap v616: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 25 MiB/s wr, 6.39k op/s 2024-08-20T01:46:18.893 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.887+0000 7f8372847740 1 Processor -- start 2024-08-20T01:46:18.894 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.887+0000 7f8372847740 1 -- start start 2024-08-20T01:46:18.894 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.887+0000 7f8372847740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e152173630 0x55e15217a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:18.894 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.887+0000 7f8372847740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e152175f60 0x55e15217a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:18.894 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.887+0000 7f836df18640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e152173630 0x55e15217a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:18.895 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.887+0000 7f836df18640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e152173630 0x55e15217a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:35558/0 (socket says 172.21.15.79:35558) 2024-08-20T01:46:18.895 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.887+0000 7f8372847740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e1521789a0 0x55e15216d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:18.895 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.888+0000 7f8372847740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f83681a79c0 con 0x55e152175f60 2024-08-20T01:46:18.895 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.888+0000 7f836df18640 1 -- 172.21.15.79:0/53561049 learned_addr learned my addr 172.21.15.79:0/53561049 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:18.895 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.888+0000 7f8372847740 1 -- 172.21.15.79:0/53561049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f83681a95f0 con 0x55e152173630 2024-08-20T01:46:18.895 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.888+0000 7f8372847740 1 -- 172.21.15.79:0/53561049 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f83681a8090 con 0x55e1521789a0 2024-08-20T01:46:18.896 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.888+0000 7f836cf16640 1 --2- 172.21.15.79:0/53561049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e152175f60 0x55e15217a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:18.896 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.888+0000 7f836df18640 1 --2- 172.21.15.79:0/53561049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e1521789a0 0x55e15216d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:18.896 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.888+0000 7f836cf16640 1 -- 172.21.15.79:0/53561049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e1521789a0 msgr2=0x55e15216d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:18.896 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.888+0000 7f836cf16640 1 --2- 172.21.15.79:0/53561049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e1521789a0 0x55e15216d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:18.896 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.888+0000 7f836cf16640 1 -- 172.21.15.79:0/53561049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e152173630 msgr2=0x55e15217a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:18.896 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.888+0000 7f836cf16640 1 --2- 172.21.15.79:0/53561049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e152173630 0x55e15217a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:18.897 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.888+0000 7f836cf16640 1 -- 172.21.15.79:0/53561049 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e15217d230 con 0x55e152175f60 2024-08-20T01:46:18.897 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.888+0000 7f836df18640 1 --2- 172.21.15.79:0/53561049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e1521789a0 0x55e15216d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:46:18.897 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.888+0000 7f836cf16640 1 --2- 172.21.15.79:0/53561049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e152175f60 0x55e15217a9f0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f8358004770 tx=0x7f8358005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9be2caa51d43afc9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:18.897 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.888+0000 7f8352ffd640 1 -- 172.21.15.79:0/53561049 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8358035040 con 0x55e152175f60 2024-08-20T01:46:18.897 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.888+0000 7f8352ffd640 1 -- 172.21.15.79:0/53561049 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8358004300 con 0x55e152175f60 2024-08-20T01:46:18.898 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.888+0000 7f8352ffd640 1 -- 172.21.15.79:0/53561049 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f835804e720 con 0x55e152175f60 2024-08-20T01:46:18.901 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.889+0000 7f8372847740 1 -- 172.21.15.79:0/53561049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e152175f60 msgr2=0x55e15217a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:18.901 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.889+0000 7f8372847740 1 --2- 172.21.15.79:0/53561049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e152175f60 0x55e15217a9f0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f8358004770 tx=0x7f8358005a20 comp rx=0 tx=0).stop 2024-08-20T01:46:18.901 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.889+0000 7f8372847740 1 -- 172.21.15.79:0/53561049 shutdown_connections 2024-08-20T01:46:18.901 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.889+0000 7f8372847740 1 --2- 172.21.15.79:0/53561049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e1521789a0 0x55e15216d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:18.901 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.889+0000 7f8372847740 1 --2- 172.21.15.79:0/53561049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e152175f60 0x55e15217a9f0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:18.901 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.889+0000 7f8372847740 1 --2- 172.21.15.79:0/53561049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e152173630 0x55e15217a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:18.901 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.889+0000 7f8372847740 1 -- 172.21.15.79:0/53561049 >> 172.21.15.79:0/53561049 conn(0x55e15216e730 msgr2=0x55e15216f070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:18.901 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.889+0000 7f8372847740 1 -- 172.21.15.79:0/53561049 shutdown_connections 2024-08-20T01:46:18.902 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.890+0000 7f8372847740 1 -- 172.21.15.79:0/53561049 wait complete. 2024-08-20T01:46:18.902 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.890+0000 7f8372847740 1 -- start start 2024-08-20T01:46:18.902 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.890+0000 7f8372847740 1 Processor -- start 2024-08-20T01:46:18.902 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.891+0000 7f8372847740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e152173630 0x55e1521813e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:18.902 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.891+0000 7f8372847740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e152175f60 0x55e152181a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:18.902 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.891+0000 7f8372847740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e1521789a0 0x55e152182510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:18.902 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.891+0000 7f8372847740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f83681a8ef0 con 0x55e152173630 2024-08-20T01:46:18.902 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.891+0000 7f8372847740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f83681a8760 con 0x55e152175f60 2024-08-20T01:46:18.902 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.891+0000 7f8372847740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f83681a59a0 con 0x55e1521789a0 2024-08-20T01:46:18.902 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.891+0000 7f8372847740 10 client.0 _ll_register_callbacks cb 0x7f83600093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:46:18.902 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.891+0000 7f836df18640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e152173630 0x55e1521813e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.891+0000 7f836df18640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e152173630 0x55e1521813e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52096/0 (socket says 172.21.15.79:52096) 2024-08-20T01:46:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.891+0000 7f836df18640 1 -- 172.21.15.79:0/673714353 learned_addr learned my addr 172.21.15.79:0/673714353 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.891+0000 7f836df18640 1 --2- 172.21.15.79:0/673714353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e1521789a0 0x55e152182510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.891+0000 7f836cf16640 1 --2- 172.21.15.79:0/673714353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e152175f60 0x55e152181a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.891+0000 7f836df18640 1 -- 172.21.15.79:0/673714353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e1521789a0 msgr2=0x55e152182510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.891+0000 7f836df18640 1 --2- 172.21.15.79:0/673714353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e1521789a0 0x55e152182510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.891+0000 7f836df18640 1 -- 172.21.15.79:0/673714353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e152175f60 msgr2=0x55e152181a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.891+0000 7f836df18640 1 --2- 172.21.15.79:0/673714353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e152175f60 0x55e152181a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.891+0000 7f836df18640 1 -- 172.21.15.79:0/673714353 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e152175d90 con 0x55e152173630 2024-08-20T01:46:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.892+0000 7f836df18640 1 --2- 172.21.15.79:0/673714353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e152173630 0x55e1521813e0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f83640095f0 tx=0x7f8364005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6899977cd4ecb66 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.892+0000 7f8350ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:46:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.892+0000 7f8350ff9640 1 -- 172.21.15.79:0/673714353 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8364005030 con 0x55e152173630 2024-08-20T01:46:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.892+0000 7f8350ff9640 1 -- 172.21.15.79:0/673714353 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f83640051d0 con 0x55e152173630 2024-08-20T01:46:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.893+0000 7f8372847740 1 -- 172.21.15.79:0/673714353 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8358004300 con 0x55e152173630 2024-08-20T01:46:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.894+0000 7f8350ff9640 1 -- 172.21.15.79:0/673714353 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f83640053d0 con 0x55e152173630 2024-08-20T01:46:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.894+0000 7f8372847740 10 client.18048 fetch_fsmap learned FSMap version 44 2024-08-20T01:46:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.894+0000 7f8372847740 1 -- 172.21.15.79:0/673714353 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55e152183f40 con 0x55e152173630 2024-08-20T01:46:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.895+0000 7f8350ff9640 1 -- 172.21.15.79:0/673714353 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f836402e070 con 0x55e152173630 2024-08-20T01:46:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.895+0000 7f8350ff9640 1 -- 172.21.15.79:0/673714353 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 44) ==== 8382+0+0 (secure 0 0 0) 0x7f8364004660 con 0x55e152173630 2024-08-20T01:46:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.895+0000 7f8372847740 10 client.18048 fetch_fsmap finished waiting for FSMap version 44 2024-08-20T01:46:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.895+0000 7f8372847740 10 client.18048 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:46:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.895+0000 7f8372847740 20 client.18048 populate_metadata read hostname 'smithi079' 2024-08-20T01:46:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.895+0000 7f8372847740 1 --2- 172.21.15.79:0/673714353 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55e1521848b0 0x55e152184cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.896+0000 7f8372847740 4 client.18048 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:46:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.896+0000 7f8372847740 1 -- 172.21.15.79:0/673714353 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f8358004300 con 0x55e1521848b0 2024-08-20T01:46:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.896+0000 7f836cf16640 1 --2- 172.21.15.79:0/673714353 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55e1521848b0 0x55e152184cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.896+0000 7f836cf16640 1 --2- 172.21.15.79:0/673714353 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55e1521848b0 0x55e152184cc0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7da336fed657815 server_cookie=2fbc18940cf38b0b in_seq=0 out_seq=0 2024-08-20T01:46:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:18.896+0000 7f8350ff9640 10 client.18048 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:46:20.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:20 smithi079 ceph-mon[18656]: pgmap v617: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 27 MiB/s wr, 7.03k op/s 2024-08-20T01:46:20.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:20 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:46:20.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:20 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:46:20.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:20 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:46:20.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:20 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:46:20.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:20 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:46:20.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:20 smithi081 ceph-mon[22209]: pgmap v617: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 27 MiB/s wr, 7.03k op/s 2024-08-20T01:46:20.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:20 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:46:20.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:20 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:46:20.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:20 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:46:20.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:20 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:46:20.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:20 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:46:20.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:20 smithi175 ceph-mon[22392]: pgmap v617: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 27 MiB/s wr, 7.03k op/s 2024-08-20T01:46:20.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:20 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:46:20.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:20 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:46:20.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:20 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:46:20.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:20 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:46:20.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:20 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:46:21.024 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:21.020+0000 7f8350ff9640 1 -- 172.21.15.79:0/673714353 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f8358004300 con 0x55e1521848b0 2024-08-20T01:46:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:21.020+0000 7f8350ff9640 10 client.18048 handle_command_reply: tid=0 2024-08-20T01:46:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:21.021+0000 7f8372847740 1 client.18048 shutdown 2024-08-20T01:46:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:21.021+0000 7f8372847740 1 -- 172.21.15.79:0/673714353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e152173630 msgr2=0x55e1521813e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:21.021+0000 7f8372847740 1 --2- 172.21.15.79:0/673714353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e152173630 0x55e1521813e0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f83640095f0 tx=0x7f8364005f90 comp rx=0 tx=0).stop 2024-08-20T01:46:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:21.021+0000 7f8372847740 1 -- 172.21.15.79:0/673714353 shutdown_connections 2024-08-20T01:46:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:21.021+0000 7f8372847740 1 --2- 172.21.15.79:0/673714353 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55e1521848b0 0x55e152184cc0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:21.027 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:21.021+0000 7f8372847740 1 --2- 172.21.15.79:0/673714353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e1521789a0 0x55e152182510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:21.027 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:21.021+0000 7f8372847740 1 --2- 172.21.15.79:0/673714353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e152175f60 0x55e152181a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:21.027 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:21.021+0000 7f8372847740 1 --2- 172.21.15.79:0/673714353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e152173630 0x55e1521813e0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:21.027 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:21.021+0000 7f8372847740 1 -- 172.21.15.79:0/673714353 >> 172.21.15.79:0/673714353 conn(0x55e15216e730 msgr2=0x55e15216ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:21.027 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:21.021+0000 7f8350ff9640 0 client.18048 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:46:21.028 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:21.021+0000 7f8372847740 1 -- 172.21.15.79:0/673714353 shutdown_connections 2024-08-20T01:46:21.028 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:21.021+0000 7f8372847740 1 -- 172.21.15.79:0/673714353 wait complete. 2024-08-20T01:46:21.028 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:21.021+0000 7f8372847740 20 client.18048 trim_cache size 0 max 16384 2024-08-20T01:46:21.028 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:46:21.029 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:46:21.029 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:46:21.029 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:46:21.030 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:21.022+0000 7f836f97b640 1 -- 172.21.15.79:0/2425671124 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f83540b3c50 msgr2=0x7f83540b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:21.030 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:21.023+0000 7f836f97b640 1 --2- 172.21.15.79:0/2425671124 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f83540b3c50 0x7f83540b6110 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f83600e4970 tx=0x7f83600a7430 comp rx=0 tx=0).stop 2024-08-20T01:46:21.030 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:21.023+0000 7f836f97b640 1 -- 172.21.15.79:0/2425671124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f836806a7e0 msgr2=0x7f8368103b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:21.030 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:21.023+0000 7f836f97b640 1 --2- 172.21.15.79:0/2425671124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f836806a7e0 0x7f8368103b20 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f836000eb00 tx=0x7f836000c2d0 comp rx=0 tx=0).stop 2024-08-20T01:46:21.030 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:21.024+0000 7f836f97b640 1 -- 172.21.15.79:0/2425671124 shutdown_connections 2024-08-20T01:46:21.030 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:21.024+0000 7f836f97b640 1 --2- 172.21.15.79:0/2425671124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83681023a0 0x7f836819fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:21.030 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:21.024+0000 7f836f97b640 1 --2- 172.21.15.79:0/2425671124 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f83540b3c50 0x7f83540b6110 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:21.030 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:21.024+0000 7f836f97b640 1 --2- 172.21.15.79:0/2425671124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8368101250 0x7f836819d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:21.024+0000 7f836f97b640 1 --2- 172.21.15.79:0/2425671124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f836806a7e0 0x7f8368103b20 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:21.024+0000 7f836f97b640 1 -- 172.21.15.79:0/2425671124 >> 172.21.15.79:0/2425671124 conn(0x7f83680fc5b0 msgr2=0x7f83680fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:21.024+0000 7f836f97b640 1 -- 172.21.15.79:0/2425671124 shutdown_connections 2024-08-20T01:46:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:21.024+0000 7f836f97b640 1 -- 172.21.15.79:0/2425671124 wait complete. 2024-08-20T01:46:22.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:22 smithi079 ceph-mon[18656]: pgmap v618: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 MiB/s wr, 7.10k op/s 2024-08-20T01:46:22.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:22 smithi081 ceph-mon[22209]: pgmap v618: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 MiB/s wr, 7.10k op/s 2024-08-20T01:46:22.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:22 smithi175 ceph-mon[22392]: pgmap v618: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 MiB/s wr, 7.10k op/s 2024-08-20T01:46:24.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:24 smithi079 ceph-mon[18656]: pgmap v619: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 6.93k op/s 2024-08-20T01:46:24.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:24 smithi081 ceph-mon[22209]: pgmap v619: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 6.93k op/s 2024-08-20T01:46:24.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:24 smithi175 ceph-mon[22392]: pgmap v619: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 6.93k op/s 2024-08-20T01:46:26.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:26 smithi081 ceph-mon[22209]: pgmap v620: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 30 MiB/s wr, 7.58k op/s 2024-08-20T01:46:26.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:26 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:46:26.878 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:26 smithi079 ceph-mon[18656]: pgmap v620: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 30 MiB/s wr, 7.58k op/s 2024-08-20T01:46:26.878 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:26 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:46:26.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:26 smithi175 ceph-mon[22392]: pgmap v620: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 30 MiB/s wr, 7.58k op/s 2024-08-20T01:46:26.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:26 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:46:28.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:28 smithi079 ceph-mon[18656]: pgmap v621: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 28 MiB/s wr, 7.04k op/s 2024-08-20T01:46:28.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:28 smithi081 ceph-mon[22209]: pgmap v621: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 28 MiB/s wr, 7.04k op/s 2024-08-20T01:46:28.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:28 smithi175 ceph-mon[22392]: pgmap v621: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 28 MiB/s wr, 7.04k op/s 2024-08-20T01:46:30.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:30 smithi081 ceph-mon[22209]: pgmap v622: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 29 MiB/s wr, 7.46k op/s 2024-08-20T01:46:30.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:30 smithi175 ceph-mon[22392]: pgmap v622: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 29 MiB/s wr, 7.46k op/s 2024-08-20T01:46:30.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:30 smithi079 ceph-mon[18656]: pgmap v622: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 29 MiB/s wr, 7.46k op/s 2024-08-20T01:46:32.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:32 smithi081 ceph-mon[22209]: pgmap v623: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 29 MiB/s wr, 7.27k op/s 2024-08-20T01:46:32.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:32 smithi175 ceph-mon[22392]: pgmap v623: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 29 MiB/s wr, 7.27k op/s 2024-08-20T01:46:32.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:32 smithi079 ceph-mon[18656]: pgmap v623: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 29 MiB/s wr, 7.27k op/s 2024-08-20T01:46:34.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.179+0000 7f1b9a6dc640 1 -- 172.21.15.79:0/1705318684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b94108f90 msgr2=0x7f1b94109390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:34.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.179+0000 7f1b9a6dc640 1 --2- 172.21.15.79:0/1705318684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b94108f90 0x7f1b94109390 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f1b84009900 tx=0x7f1b8402a400 comp rx=0 tx=0).stop 2024-08-20T01:46:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.180+0000 7f1b9a6dc640 1 -- 172.21.15.79:0/1705318684 shutdown_connections 2024-08-20T01:46:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.180+0000 7f1b9a6dc640 1 --2- 172.21.15.79:0/1705318684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b9410a780 0x7f1b94111100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.180+0000 7f1b9a6dc640 1 --2- 172.21.15.79:0/1705318684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b94109dc0 0x7f1b9410a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.180+0000 7f1b9a6dc640 1 --2- 172.21.15.79:0/1705318684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b94108f90 0x7f1b94109390 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.180+0000 7f1b9a6dc640 1 -- 172.21.15.79:0/1705318684 >> 172.21.15.79:0/1705318684 conn(0x7f1b94078100 msgr2=0x7f1b9407a520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.180+0000 7f1b9a6dc640 1 -- 172.21.15.79:0/1705318684 shutdown_connections 2024-08-20T01:46:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.180+0000 7f1b9a6dc640 1 -- 172.21.15.79:0/1705318684 wait complete. 2024-08-20T01:46:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.181+0000 7f1b9a6dc640 1 Processor -- start 2024-08-20T01:46:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.181+0000 7f1b9a6dc640 1 -- start start 2024-08-20T01:46:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.182+0000 7f1b9a6dc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b94108f90 0x7f1b9419edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.182+0000 7f1b9a6dc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b94109dc0 0x7f1b9419f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.182+0000 7f1b9a6dc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b9410a780 0x7f1b941a0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.182+0000 7f1b937fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b94109dc0 0x7f1b9419f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.182+0000 7f1b937fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b94109dc0 0x7f1b9419f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:45906/0 (socket says 172.21.15.79:45906) 2024-08-20T01:46:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.182+0000 7f1b937fe640 1 -- 172.21.15.79:0/2341950208 learned_addr learned my addr 172.21.15.79:0/2341950208 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.182+0000 7f1b93fff640 1 --2- 172.21.15.79:0/2341950208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b94108f90 0x7f1b9419edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.182+0000 7f1b9a6dc640 1 -- 172.21.15.79:0/2341950208 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1b941147f0 con 0x7f1b9410a780 2024-08-20T01:46:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.182+0000 7f1b9a6dc640 1 -- 172.21.15.79:0/2341950208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1b94114670 con 0x7f1b94109dc0 2024-08-20T01:46:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.182+0000 7f1b9a6dc640 1 -- 172.21.15.79:0/2341950208 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1b94114970 con 0x7f1b94108f90 2024-08-20T01:46:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.182+0000 7f1b98c79640 1 --2- 172.21.15.79:0/2341950208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b9410a780 0x7f1b941a0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.183+0000 7f1b937fe640 1 -- 172.21.15.79:0/2341950208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b94108f90 msgr2=0x7f1b9419edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.183+0000 7f1b937fe640 1 --2- 172.21.15.79:0/2341950208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b94108f90 0x7f1b9419edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.183+0000 7f1b937fe640 1 -- 172.21.15.79:0/2341950208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b9410a780 msgr2=0x7f1b941a0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.183+0000 7f1b937fe640 1 --2- 172.21.15.79:0/2341950208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b9410a780 0x7f1b941a0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.183+0000 7f1b937fe640 1 -- 172.21.15.79:0/2341950208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b941a0900 con 0x7f1b94109dc0 2024-08-20T01:46:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.183+0000 7f1b937fe640 1 --2- 172.21.15.79:0/2341950208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b94109dc0 0x7f1b9419f410 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c00e9f0 tx=0x7f1b7c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.184+0000 7f1b917fa640 1 -- 172.21.15.79:0/2341950208 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c00cd80 con 0x7f1b94109dc0 2024-08-20T01:46:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.184+0000 7f1b917fa640 1 -- 172.21.15.79:0/2341950208 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b7c0108c0 con 0x7f1b94109dc0 2024-08-20T01:46:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.184+0000 7f1b917fa640 1 -- 172.21.15.79:0/2341950208 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c0187c0 con 0x7f1b94109dc0 2024-08-20T01:46:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.184+0000 7f1b9a6dc640 1 -- 172.21.15.79:0/2341950208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b941a0bf0 con 0x7f1b94109dc0 2024-08-20T01:46:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.184+0000 7f1b9a6dc640 1 -- 172.21.15.79:0/2341950208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b941a72c0 con 0x7f1b94109dc0 2024-08-20T01:46:34.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.189+0000 7f1b9d4cb740 1 Processor -- start 2024-08-20T01:46:34.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.189+0000 7f1b9d4cb740 1 -- start start 2024-08-20T01:46:34.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.189+0000 7f1b917fa640 1 -- 172.21.15.79:0/2341950208 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1b7c010430 con 0x7f1b94109dc0 2024-08-20T01:46:34.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.189+0000 7f1b9d4cb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5606d5b2e8d0 0x5606d5b30cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:34.193 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.189+0000 7f1b9d4cb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606d5b31200 0x5606d5b335f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:34.193 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.189+0000 7f1b9d4cb740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606d5b33c40 0x5606d5b36100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:34.193 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.189+0000 7f1b9d4cb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5606d5aa1360 con 0x5606d5b2e8d0 2024-08-20T01:46:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.189+0000 7f1b9d4cb740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5606d5a90860 con 0x5606d5b33c40 2024-08-20T01:46:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.189+0000 7f1b9d4cb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5606d5a948a0 con 0x5606d5b31200 2024-08-20T01:46:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.190+0000 7f1b98c79640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5606d5b2e8d0 0x5606d5b30cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.190+0000 7f1b98c79640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5606d5b2e8d0 0x5606d5b30cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54280/0 (socket says 172.21.15.79:54280) 2024-08-20T01:46:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.190+0000 7f1b98c79640 1 -- 172.21.15.79:0/2365061869 learned_addr learned my addr 172.21.15.79:0/2365061869 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.190+0000 7f1b93fff640 1 --2- 172.21.15.79:0/2365061869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606d5b31200 0x5606d5b335f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.190+0000 7f1b937fe640 1 --2- 172.21.15.79:0/2365061869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606d5b33c40 0x5606d5b36100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.190+0000 7f1b98c79640 1 -- 172.21.15.79:0/2365061869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606d5b31200 msgr2=0x5606d5b335f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.190+0000 7f1b98c79640 1 --2- 172.21.15.79:0/2365061869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606d5b31200 0x5606d5b335f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.190+0000 7f1b98c79640 1 -- 172.21.15.79:0/2365061869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606d5b33c40 msgr2=0x5606d5b36100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.190+0000 7f1b98c79640 1 --2- 172.21.15.79:0/2365061869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606d5b33c40 0x5606d5b36100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:34.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.190+0000 7f1b98c79640 1 -- 172.21.15.79:0/2365061869 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606d5a37e40 con 0x5606d5b2e8d0 2024-08-20T01:46:34.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.190+0000 7f1b93fff640 1 --2- 172.21.15.79:0/2365061869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606d5b31200 0x5606d5b335f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:46:34.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.190+0000 7f1b98c79640 1 --2- 172.21.15.79:0/2365061869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5606d5b2e8d0 0x5606d5b30cc0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c009fc0 tx=0x7f1b8c010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c34fef655c9f3b06 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:34.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.191+0000 7f1b917fa640 1 --2- 172.21.15.79:0/2341950208 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1b800b3da0 0x7f1b800b6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:34.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.191+0000 7f1b8a7fc640 1 -- 172.21.15.79:0/2365061869 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c016070 con 0x5606d5b2e8d0 2024-08-20T01:46:34.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.191+0000 7f1b8a7fc640 1 -- 172.21.15.79:0/2365061869 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b8c004d20 con 0x5606d5b2e8d0 2024-08-20T01:46:34.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.191+0000 7f1b8a7fc640 1 -- 172.21.15.79:0/2365061869 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c005280 con 0x5606d5b2e8d0 2024-08-20T01:46:34.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.191+0000 7f1b93fff640 1 --2- 172.21.15.79:0/2341950208 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1b800b3da0 0x7f1b800b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:34.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.191+0000 7f1b917fa640 1 -- 172.21.15.79:0/2341950208 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f1b7c0e3f00 con 0x7f1b94109dc0 2024-08-20T01:46:34.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.192+0000 7f1b9d4cb740 1 -- 172.21.15.79:0/2365061869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5606d5b2e8d0 msgr2=0x5606d5b30cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.192+0000 7f1b93fff640 1 --2- 172.21.15.79:0/2341950208 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1b800b3da0 0x7f1b800b6260 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1b84009230 tx=0x7f1b84000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.192+0000 7f1b9d4cb740 1 --2- 172.21.15.79:0/2365061869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5606d5b2e8d0 0x5606d5b30cc0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c009fc0 tx=0x7f1b8c010800 comp rx=0 tx=0).stop 2024-08-20T01:46:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.192+0000 7f1b9d4cb740 1 -- 172.21.15.79:0/2365061869 shutdown_connections 2024-08-20T01:46:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.192+0000 7f1b9d4cb740 1 --2- 172.21.15.79:0/2365061869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606d5b33c40 0x5606d5b36100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.192+0000 7f1b9d4cb740 1 --2- 172.21.15.79:0/2365061869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606d5b31200 0x5606d5b335f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.192+0000 7f1b9d4cb740 1 --2- 172.21.15.79:0/2365061869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5606d5b2e8d0 0x5606d5b30cc0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.192+0000 7f1b9d4cb740 1 -- 172.21.15.79:0/2365061869 >> 172.21.15.79:0/2365061869 conn(0x5606d5b29a20 msgr2=0x5606d5b2a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.192+0000 7f1b9d4cb740 1 -- 172.21.15.79:0/2365061869 shutdown_connections 2024-08-20T01:46:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.192+0000 7f1b9d4cb740 1 -- 172.21.15.79:0/2365061869 wait complete. 2024-08-20T01:46:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.192+0000 7f1b9d4cb740 1 -- start start 2024-08-20T01:46:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.193+0000 7f1b9d4cb740 1 Processor -- start 2024-08-20T01:46:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.193+0000 7f1b9d4cb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5606d5b2e8d0 0x5606d5b38120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.193+0000 7f1b9d4cb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606d5b31200 0x5606d5b387c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.193+0000 7f1b9d4cb740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606d5b33c40 0x5606d5b39390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.193+0000 7f1b9d4cb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5606d59c9ab0 con 0x5606d5b2e8d0 2024-08-20T01:46:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.193+0000 7f1b9d4cb740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5606d5a17780 con 0x5606d5b33c40 2024-08-20T01:46:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.193+0000 7f1b9d4cb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5606d5b36c20 con 0x5606d5b31200 2024-08-20T01:46:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.193+0000 7f1b9d4cb740 10 client.0 _ll_register_callbacks cb 0x5606d579fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:46:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.194+0000 7f1b937fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606d5b31200 0x5606d5b387c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.194+0000 7f1b98c79640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606d5b33c40 0x5606d5b39390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.194+0000 7f1b937fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606d5b31200 0x5606d5b387c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:33446/0 (socket says 172.21.15.79:33446) 2024-08-20T01:46:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.194+0000 7f1b937fe640 1 -- 172.21.15.79:0/55237203 learned_addr learned my addr 172.21.15.79:0/55237203 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.194+0000 7f1b93fff640 1 --2- 172.21.15.79:0/55237203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5606d5b2e8d0 0x5606d5b38120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.194+0000 7f1b937fe640 1 -- 172.21.15.79:0/55237203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606d5b33c40 msgr2=0x5606d5b39390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.194+0000 7f1b937fe640 1 --2- 172.21.15.79:0/55237203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606d5b33c40 0x5606d5b39390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.194+0000 7f1b937fe640 1 -- 172.21.15.79:0/55237203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5606d5b2e8d0 msgr2=0x5606d5b38120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.194+0000 7f1b937fe640 1 --2- 172.21.15.79:0/55237203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5606d5b2e8d0 0x5606d5b38120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.194+0000 7f1b937fe640 1 -- 172.21.15.79:0/55237203 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606d57f3790 con 0x5606d5b31200 2024-08-20T01:46:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.195+0000 7f1b98c79640 1 --2- 172.21.15.79:0/55237203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606d5b33c40 0x5606d5b39390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:46:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.195+0000 7f1b937fe640 1 --2- 172.21.15.79:0/55237203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606d5b31200 0x5606d5b387c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c0a6f30 tx=0x7f1b7c0aa8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a2e60e6cd00a178 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.195+0000 7f1b737fe640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:46:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.196+0000 7f1b737fe640 1 -- 172.21.15.79:0/55237203 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c0aaeb0 con 0x5606d5b31200 2024-08-20T01:46:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.196+0000 7f1b737fe640 1 -- 172.21.15.79:0/55237203 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f1b7c010d50 con 0x5606d5b31200 2024-08-20T01:46:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.196+0000 7f1b9d4cb740 1 -- 172.21.15.79:0/55237203 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5606d5a3fe00 con 0x5606d5b31200 2024-08-20T01:46:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.196+0000 7f1b737fe640 1 -- 172.21.15.79:0/55237203 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f1b7c0c5050 con 0x5606d5b31200 2024-08-20T01:46:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.196+0000 7f1b9d4cb740 10 client.27037 fetch_fsmap learned FSMap version 45 2024-08-20T01:46:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.196+0000 7f1b9d4cb740 1 -- 172.21.15.79:0/55237203 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x5606d586c620 con 0x5606d5b31200 2024-08-20T01:46:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.197+0000 7f1b737fe640 1 -- 172.21.15.79:0/55237203 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5606d5a3fe00 con 0x5606d5b31200 2024-08-20T01:46:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.197+0000 7f1b737fe640 1 -- 172.21.15.79:0/55237203 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 45) ==== 8378+0+0 (secure 0 0 0) 0x7f1b7c0a9b80 con 0x5606d5b31200 2024-08-20T01:46:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.197+0000 7f1b9d4cb740 10 client.27037 fetch_fsmap finished waiting for FSMap version 45 2024-08-20T01:46:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.197+0000 7f1b9d4cb740 10 client.27037 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:46:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.197+0000 7f1b9d4cb740 20 client.27037 populate_metadata read hostname 'smithi079' 2024-08-20T01:46:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.198+0000 7f1b9d4cb740 1 --2- 172.21.15.79:0/55237203 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5606d5b43de0 0x5606d5b46240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.198+0000 7f1b9d4cb740 4 client.27037 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:46:34.202 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.198+0000 7f1b9d4cb740 1 -- 172.21.15.79:0/55237203 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5606d5aa32b0 con 0x5606d5b43de0 2024-08-20T01:46:34.202 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.198+0000 7f1b93fff640 1 --2- 172.21.15.79:0/55237203 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5606d5b43de0 0x5606d5b46240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.199+0000 7f1b737fe640 10 client.27037 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:46:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.199+0000 7f1b93fff640 1 --2- 172.21.15.79:0/55237203 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5606d5b43de0 0x5606d5b46240 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8191e2341aee4f7b server_cookie=ed898416885b77cb in_seq=0 out_seq=0 2024-08-20T01:46:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.199+0000 7f1b737fe640 1 -- 172.21.15.79:0/55237203 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5606d5aa32b0 con 0x5606d5b43de0 2024-08-20T01:46:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.199+0000 7f1b737fe640 10 client.27037 handle_command_reply: tid=0 2024-08-20T01:46:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.199+0000 7f1b9d4cb740 1 client.27037 shutdown 2024-08-20T01:46:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.200+0000 7f1b9d4cb740 1 -- 172.21.15.79:0/55237203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606d5b31200 msgr2=0x5606d5b387c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.200+0000 7f1b9d4cb740 1 --2- 172.21.15.79:0/55237203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606d5b31200 0x5606d5b387c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c0a6f30 tx=0x7f1b7c0aa8c0 comp rx=0 tx=0).stop 2024-08-20T01:46:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.200+0000 7f1b9d4cb740 1 -- 172.21.15.79:0/55237203 shutdown_connections 2024-08-20T01:46:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.200+0000 7f1b9d4cb740 1 --2- 172.21.15.79:0/55237203 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5606d5b43de0 0x5606d5b46240 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.200+0000 7f1b9d4cb740 1 --2- 172.21.15.79:0/55237203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606d5b33c40 0x5606d5b39390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.200+0000 7f1b9d4cb740 1 --2- 172.21.15.79:0/55237203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606d5b31200 0x5606d5b387c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.200+0000 7f1b9d4cb740 1 --2- 172.21.15.79:0/55237203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5606d5b2e8d0 0x5606d5b38120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.200+0000 7f1b9d4cb740 1 -- 172.21.15.79:0/55237203 >> 172.21.15.79:0/55237203 conn(0x5606d5b29a20 msgr2=0x5606d5b28ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.200+0000 7f1b737fe640 0 client.27037 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:46:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.200+0000 7f1b9d4cb740 1 -- 172.21.15.79:0/55237203 shutdown_connections 2024-08-20T01:46:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.200+0000 7f1b9d4cb740 1 -- 172.21.15.79:0/55237203 wait complete. 2024-08-20T01:46:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.200+0000 7f1b9d4cb740 20 client.27037 trim_cache size 0 max 16384 2024-08-20T01:46:34.231 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.226+0000 7f1b9d4cb740 1 Processor -- start 2024-08-20T01:46:34.231 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.226+0000 7f1b9d4cb740 1 -- start start 2024-08-20T01:46:34.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.227+0000 7f1b9d4cb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606d5b2e8d0 0x5606d5b2a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:34.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.227+0000 7f1b9d4cb740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606d5b31200 0x5606d5b2a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:34.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.227+0000 7f1b9d4cb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5606d5b33c40 0x5606d5b34020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:34.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.227+0000 7f1b93fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606d5b2e8d0 0x5606d5b2a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:34.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.227+0000 7f1b93fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606d5b2e8d0 0x5606d5b2a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:33452/0 (socket says 172.21.15.79:33452) 2024-08-20T01:46:34.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.227+0000 7f1b937fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606d5b31200 0x5606d5b2a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:34.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.227+0000 7f1b937fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606d5b31200 0x5606d5b2a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:45924/0 (socket says 172.21.15.79:45924) 2024-08-20T01:46:34.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.227+0000 7f1b93fff640 1 -- 172.21.15.79:0/29880591 learned_addr learned my addr 172.21.15.79:0/29880591 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:34.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.227+0000 7f1b9d4cb740 1 -- 172.21.15.79:0/29880591 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1b941b0030 con 0x5606d5b33c40 2024-08-20T01:46:34.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.227+0000 7f1b9d4cb740 1 -- 172.21.15.79:0/29880591 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1b941b1c30 con 0x5606d5b31200 2024-08-20T01:46:34.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.227+0000 7f1b9d4cb740 1 -- 172.21.15.79:0/29880591 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1b941b0700 con 0x5606d5b2e8d0 2024-08-20T01:46:34.232 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.228+0000 7f1b98c79640 1 --2- 172.21.15.79:0/29880591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5606d5b33c40 0x5606d5b34020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:34.233 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.228+0000 7f1b93fff640 1 -- 172.21.15.79:0/29880591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606d5b31200 msgr2=0x5606d5b2a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:34.233 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.228+0000 7f1b93fff640 1 --2- 172.21.15.79:0/29880591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606d5b31200 0x5606d5b2a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:34.233 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.228+0000 7f1b93fff640 1 -- 172.21.15.79:0/29880591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5606d5b33c40 msgr2=0x5606d5b34020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:34.233 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.228+0000 7f1b93fff640 1 --2- 172.21.15.79:0/29880591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5606d5b33c40 0x5606d5b34020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:34.233 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.228+0000 7f1b93fff640 1 -- 172.21.15.79:0/29880591 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606d5b31030 con 0x5606d5b2e8d0 2024-08-20T01:46:34.233 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.228+0000 7f1b937fe640 1 --2- 172.21.15.79:0/29880591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606d5b31200 0x5606d5b2a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:46:34.233 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.228+0000 7f1b98c79640 1 --2- 172.21.15.79:0/29880591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5606d5b33c40 0x5606d5b34020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:46:34.233 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.228+0000 7f1b93fff640 1 --2- 172.21.15.79:0/29880591 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606d5b2e8d0 0x5606d5b2a280 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1b8402a9f0 tx=0x7f1b84040000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b047d820b85fdce7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:34.233 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.229+0000 7f1b89ffb640 1 -- 172.21.15.79:0/29880591 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b84052460 con 0x5606d5b2e8d0 2024-08-20T01:46:34.233 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.229+0000 7f1b89ffb640 1 -- 172.21.15.79:0/29880591 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b84058030 con 0x5606d5b2e8d0 2024-08-20T01:46:34.233 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.229+0000 7f1b89ffb640 1 -- 172.21.15.79:0/29880591 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b8403d740 con 0x5606d5b2e8d0 2024-08-20T01:46:34.235 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.229+0000 7f1b9d4cb740 1 -- 172.21.15.79:0/29880591 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606d5b2e8d0 msgr2=0x5606d5b2a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:34.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.229+0000 7f1b9d4cb740 1 --2- 172.21.15.79:0/29880591 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606d5b2e8d0 0x5606d5b2a280 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1b8402a9f0 tx=0x7f1b84040000 comp rx=0 tx=0).stop 2024-08-20T01:46:34.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.230+0000 7f1b9d4cb740 1 -- 172.21.15.79:0/29880591 shutdown_connections 2024-08-20T01:46:34.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.230+0000 7f1b9d4cb740 1 --2- 172.21.15.79:0/29880591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5606d5b33c40 0x5606d5b34020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:34.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.230+0000 7f1b9d4cb740 1 --2- 172.21.15.79:0/29880591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606d5b31200 0x5606d5b2a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:34.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.230+0000 7f1b9d4cb740 1 --2- 172.21.15.79:0/29880591 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606d5b2e8d0 0x5606d5b2a280 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:34.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.230+0000 7f1b9d4cb740 1 -- 172.21.15.79:0/29880591 >> 172.21.15.79:0/29880591 conn(0x5606d5b29a20 msgr2=0x5606d5b37020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:34.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.230+0000 7f1b9d4cb740 1 -- 172.21.15.79:0/29880591 shutdown_connections 2024-08-20T01:46:34.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.230+0000 7f1b9d4cb740 1 -- 172.21.15.79:0/29880591 wait complete. 2024-08-20T01:46:34.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.230+0000 7f1b9d4cb740 1 -- start start 2024-08-20T01:46:34.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.230+0000 7f1b9d4cb740 1 Processor -- start 2024-08-20T01:46:34.236 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.231+0000 7f1b9d4cb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606d5b2e8d0 0x5606d5b3c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:34.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.231+0000 7f1b9d4cb740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606d5b31200 0x5606d5b3cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:34.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.231+0000 7f1b9d4cb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5606d5b33c40 0x5606d5b3d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:34.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.231+0000 7f1b9d4cb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1b941b1560 con 0x5606d5b33c40 2024-08-20T01:46:34.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.231+0000 7f1b9d4cb740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1b941b0dd0 con 0x5606d5b31200 2024-08-20T01:46:34.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.231+0000 7f1b9d4cb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1b941ae010 con 0x5606d5b2e8d0 2024-08-20T01:46:34.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.231+0000 7f1b937fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606d5b31200 0x5606d5b3cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:34.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.231+0000 7f1b93fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606d5b2e8d0 0x5606d5b3c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:34.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.231+0000 7f1b937fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606d5b31200 0x5606d5b3cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:45926/0 (socket says 172.21.15.79:45926) 2024-08-20T01:46:34.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.231+0000 7f1b93fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606d5b2e8d0 0x5606d5b3c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:33460/0 (socket says 172.21.15.79:33460) 2024-08-20T01:46:34.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.231+0000 7f1b937fe640 1 -- 172.21.15.79:0/733629211 learned_addr learned my addr 172.21.15.79:0/733629211 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:34.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.231+0000 7f1b98c79640 1 --2- 172.21.15.79:0/733629211 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5606d5b33c40 0x5606d5b3d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:34.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.231+0000 7f1b9d4cb740 10 client.0 _ll_register_callbacks cb 0x7f1b7c0a6e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:46:34.237 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.231+0000 7f1b937fe640 1 -- 172.21.15.79:0/733629211 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606d5b2e8d0 msgr2=0x5606d5b3c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:34.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.231+0000 7f1b937fe640 1 --2- 172.21.15.79:0/733629211 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606d5b2e8d0 0x5606d5b3c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:34.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.231+0000 7f1b937fe640 1 -- 172.21.15.79:0/733629211 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5606d5b33c40 msgr2=0x5606d5b3d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:34.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.231+0000 7f1b937fe640 1 --2- 172.21.15.79:0/733629211 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5606d5b33c40 0x5606d5b3d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:34.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.231+0000 7f1b937fe640 1 -- 172.21.15.79:0/733629211 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606d5b3dee0 con 0x5606d5b31200 2024-08-20T01:46:34.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.232+0000 7f1b937fe640 1 --2- 172.21.15.79:0/733629211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606d5b31200 0x5606d5b3cd30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c0aae40 tx=0x7f1b7c009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6dcc01c721e666e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:34.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.232+0000 7f1b737fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:46:34.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.232+0000 7f1b737fe640 1 -- 172.21.15.79:0/733629211 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c0ca080 con 0x5606d5b31200 2024-08-20T01:46:34.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.232+0000 7f1b737fe640 1 -- 172.21.15.79:0/733629211 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f1b7c0b08e0 con 0x5606d5b31200 2024-08-20T01:46:34.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.232+0000 7f1b9d4cb740 1 -- 172.21.15.79:0/733629211 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b84058030 con 0x5606d5b31200 2024-08-20T01:46:34.238 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.233+0000 7f1b737fe640 1 -- 172.21.15.79:0/733629211 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f1b7c010720 con 0x5606d5b31200 2024-08-20T01:46:34.239 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.234+0000 7f1b9d4cb740 10 client.27059 fetch_fsmap learned FSMap version 45 2024-08-20T01:46:34.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.234+0000 7f1b9d4cb740 1 -- 172.21.15.79:0/733629211 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x5606d5b3f2a0 con 0x5606d5b31200 2024-08-20T01:46:34.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.234+0000 7f1b737fe640 1 -- 172.21.15.79:0/733629211 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b7c0aaeb0 con 0x5606d5b31200 2024-08-20T01:46:34.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.235+0000 7f1b737fe640 1 -- 172.21.15.79:0/733629211 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 45) ==== 8378+0+0 (secure 0 0 0) 0x7f1b7c018960 con 0x5606d5b31200 2024-08-20T01:46:34.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.235+0000 7f1b9d4cb740 10 client.27059 fetch_fsmap finished waiting for FSMap version 45 2024-08-20T01:46:34.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.235+0000 7f1b9d4cb740 10 client.27059 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:46:34.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.235+0000 7f1b9d4cb740 20 client.27059 populate_metadata read hostname 'smithi079' 2024-08-20T01:46:34.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.236+0000 7f1b9d4cb740 1 --2- 172.21.15.79:0/733629211 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5606d5b3fc50 0x5606d5bb0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:34.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.236+0000 7f1b9d4cb740 4 client.27059 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:46:34.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.236+0000 7f1b9d4cb740 1 -- 172.21.15.79:0/733629211 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f1b84058030 con 0x5606d5b3fc50 2024-08-20T01:46:34.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.236+0000 7f1b93fff640 1 --2- 172.21.15.79:0/733629211 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5606d5b3fc50 0x5606d5bb0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:34.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.236+0000 7f1b93fff640 1 --2- 172.21.15.79:0/733629211 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5606d5b3fc50 0x5606d5bb0b30 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=296913ce3d82d152 server_cookie=61d3ca2da7af663e in_seq=0 out_seq=0 2024-08-20T01:46:34.240 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:34.236+0000 7f1b737fe640 10 client.27059 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:46:34.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:34 smithi081 ceph-mon[22209]: pgmap v624: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 6.90k op/s 2024-08-20T01:46:34.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:34 smithi175 ceph-mon[22392]: pgmap v624: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 6.90k op/s 2024-08-20T01:46:34.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:34 smithi079 ceph-mon[18656]: pgmap v624: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 6.90k op/s 2024-08-20T01:46:36.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:36 smithi081 ceph-mon[22209]: pgmap v625: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 30 MiB/s wr, 7.54k op/s 2024-08-20T01:46:36.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:36 smithi175 ceph-mon[22392]: pgmap v625: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 30 MiB/s wr, 7.54k op/s 2024-08-20T01:46:36.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:36 smithi079 ceph-mon[18656]: pgmap v625: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 30 MiB/s wr, 7.54k op/s 2024-08-20T01:46:38.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:38 smithi081 ceph-mon[22209]: pgmap v626: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 28 MiB/s wr, 7.10k op/s 2024-08-20T01:46:38.864 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:38.861+0000 7f1b737fe640 1 -- 172.21.15.79:0/733629211 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f1b84058030 con 0x5606d5b3fc50 2024-08-20T01:46:38.865 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:38.861+0000 7f1b737fe640 10 client.27059 handle_command_reply: tid=0 2024-08-20T01:46:38.865 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:38.861+0000 7f1b9d4cb740 1 client.27059 shutdown 2024-08-20T01:46:38.865 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:38.861+0000 7f1b9d4cb740 1 -- 172.21.15.79:0/733629211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606d5b31200 msgr2=0x5606d5b3cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:38.865 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:38.861+0000 7f1b9d4cb740 1 --2- 172.21.15.79:0/733629211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606d5b31200 0x5606d5b3cd30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c0aae40 tx=0x7f1b7c009310 comp rx=0 tx=0).stop 2024-08-20T01:46:38.865 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:38.862+0000 7f1b9d4cb740 1 -- 172.21.15.79:0/733629211 shutdown_connections 2024-08-20T01:46:38.865 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:38.862+0000 7f1b9d4cb740 1 --2- 172.21.15.79:0/733629211 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5606d5b3fc50 0x5606d5bb0b30 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:38.865 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:38.862+0000 7f1b9d4cb740 1 --2- 172.21.15.79:0/733629211 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5606d5b33c40 0x5606d5b3d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:38.865 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:38.862+0000 7f1b9d4cb740 1 --2- 172.21.15.79:0/733629211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606d5b31200 0x5606d5b3cd30 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:38.865 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:38.862+0000 7f1b737fe640 0 client.27059 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:46:38.865 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:38.862+0000 7f1b9d4cb740 1 --2- 172.21.15.79:0/733629211 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606d5b2e8d0 0x5606d5b3c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:38.866 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:38.862+0000 7f1b9d4cb740 1 -- 172.21.15.79:0/733629211 >> 172.21.15.79:0/733629211 conn(0x5606d5b29a20 msgr2=0x5606d5b2a280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:38.866 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:38.862+0000 7f1b9d4cb740 1 -- 172.21.15.79:0/733629211 shutdown_connections 2024-08-20T01:46:38.866 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:38.862+0000 7f1b9d4cb740 1 -- 172.21.15.79:0/733629211 wait complete. 2024-08-20T01:46:38.866 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:38.862+0000 7f1b9d4cb740 20 client.27059 trim_cache size 0 max 16384 2024-08-20T01:46:38.866 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:46:38.866 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:46:38.866 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:46:38.866 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:46:38.867 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:38.863+0000 7f1b9a6dc640 1 -- 172.21.15.79:0/2341950208 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1b800b3da0 msgr2=0x7f1b800b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:38.867 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:38.863+0000 7f1b9a6dc640 1 --2- 172.21.15.79:0/2341950208 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1b800b3da0 0x7f1b800b6260 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1b84009230 tx=0x7f1b84000bc0 comp rx=0 tx=0).stop 2024-08-20T01:46:38.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:38.863+0000 7f1b9a6dc640 1 -- 172.21.15.79:0/2341950208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b94109dc0 msgr2=0x7f1b9419f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:38.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:38.863+0000 7f1b9a6dc640 1 --2- 172.21.15.79:0/2341950208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b94109dc0 0x7f1b9419f410 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c00e9f0 tx=0x7f1b7c00eeb0 comp rx=0 tx=0).stop 2024-08-20T01:46:38.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:38.863+0000 7f1b9a6dc640 1 -- 172.21.15.79:0/2341950208 shutdown_connections 2024-08-20T01:46:38.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:38.863+0000 7f1b9a6dc640 1 --2- 172.21.15.79:0/2341950208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b9410a780 0x7f1b941a0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:38.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:38.863+0000 7f1b9a6dc640 1 --2- 172.21.15.79:0/2341950208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b94109dc0 0x7f1b9419f410 secure :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c00e9f0 tx=0x7f1b7c00eeb0 comp rx=0 tx=0).stop 2024-08-20T01:46:38.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:38.863+0000 7f1b9a6dc640 1 --2- 172.21.15.79:0/2341950208 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1b800b3da0 0x7f1b800b6260 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:38.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:38.863+0000 7f1b9a6dc640 1 --2- 172.21.15.79:0/2341950208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b94108f90 0x7f1b9419edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:38.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:38.863+0000 7f1b9a6dc640 1 -- 172.21.15.79:0/2341950208 >> 172.21.15.79:0/2341950208 conn(0x7f1b94078100 msgr2=0x7f1b9410d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:38.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:38.865+0000 7f1b9a6dc640 1 -- 172.21.15.79:0/2341950208 shutdown_connections 2024-08-20T01:46:38.868 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:38.865+0000 7f1b9a6dc640 1 -- 172.21.15.79:0/2341950208 wait complete. 2024-08-20T01:46:38.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:38 smithi175 ceph-mon[22392]: pgmap v626: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 28 MiB/s wr, 7.10k op/s 2024-08-20T01:46:38.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:38 smithi079 ceph-mon[18656]: pgmap v626: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 28 MiB/s wr, 7.10k op/s 2024-08-20T01:46:40.630 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:46:40.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:40 smithi081 ceph-mon[22209]: pgmap v627: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 30 MiB/s wr, 7.63k op/s 2024-08-20T01:46:40.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:40 smithi175 ceph-mon[22392]: pgmap v627: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 30 MiB/s wr, 7.63k op/s 2024-08-20T01:46:40.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:40 smithi079 ceph-mon[18656]: pgmap v627: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 30 MiB/s wr, 7.63k op/s 2024-08-20T01:46:41.041 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:46:41.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.604+0000 7fc0610e5640 1 -- 172.21.15.79:0/661115481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc05c1039d0 msgr2=0x7fc05c103db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:41.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.604+0000 7fc0610e5640 1 --2- 172.21.15.79:0/661115481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc05c1039d0 0x7fc05c103db0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc054009ca0 tx=0x7fc05402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:46:41.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.605+0000 7fc0610e5640 1 -- 172.21.15.79:0/661115481 shutdown_connections 2024-08-20T01:46:41.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.605+0000 7fc0610e5640 1 --2- 172.21.15.79:0/661115481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc05c10ce30 0x7fc05c10f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:41.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.605+0000 7fc0610e5640 1 --2- 172.21.15.79:0/661115481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc05c1042f0 0x7fc05c10c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:41.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.605+0000 7fc0610e5640 1 --2- 172.21.15.79:0/661115481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc05c1039d0 0x7fc05c103db0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:41.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.605+0000 7fc0610e5640 1 -- 172.21.15.79:0/661115481 >> 172.21.15.79:0/661115481 conn(0x7fc05c0fd410 msgr2=0x7fc05c0ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:41.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.605+0000 7fc0610e5640 1 -- 172.21.15.79:0/661115481 shutdown_connections 2024-08-20T01:46:41.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.605+0000 7fc0610e5640 1 -- 172.21.15.79:0/661115481 wait complete. 2024-08-20T01:46:41.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.606+0000 7fc0610e5640 1 Processor -- start 2024-08-20T01:46:41.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.606+0000 7fc0610e5640 1 -- start start 2024-08-20T01:46:41.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.606+0000 7fc0610e5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc05c1039d0 0x7fc05c19b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:41.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.606+0000 7fc0610e5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc05c1042f0 0x7fc05c19b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:41.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.606+0000 7fc0610e5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc05c10ce30 0x7fc05c1a0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:41.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.606+0000 7fc0610e5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc05c102060 con 0x7fc05c10ce30 2024-08-20T01:46:41.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.606+0000 7fc0610e5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc05c101ee0 con 0x7fc05c1042f0 2024-08-20T01:46:41.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.606+0000 7fc0610e5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc05c1021e0 con 0x7fc05c1039d0 2024-08-20T01:46:41.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.607+0000 7fc05b59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc05c10ce30 0x7fc05c1a0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:41.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.607+0000 7fc05ad9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc05c1039d0 0x7fc05c19b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:41.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.607+0000 7fc05b59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc05c10ce30 0x7fc05c1a0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43778/0 (socket says 172.21.15.79:43778) 2024-08-20T01:46:41.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.607+0000 7fc05b59e640 1 -- 172.21.15.79:0/1588906226 learned_addr learned my addr 172.21.15.79:0/1588906226 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:41.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.607+0000 7fc05a59c640 1 --2- 172.21.15.79:0/1588906226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc05c1042f0 0x7fc05c19b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:41.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.607+0000 7fc05b59e640 1 -- 172.21.15.79:0/1588906226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc05c1039d0 msgr2=0x7fc05c19b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:41.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.607+0000 7fc05b59e640 1 --2- 172.21.15.79:0/1588906226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc05c1039d0 0x7fc05c19b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:41.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.607+0000 7fc05b59e640 1 -- 172.21.15.79:0/1588906226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc05c1042f0 msgr2=0x7fc05c19b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:41.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.607+0000 7fc05b59e640 1 --2- 172.21.15.79:0/1588906226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc05c1042f0 0x7fc05c19b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:41.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.607+0000 7fc05b59e640 1 -- 172.21.15.79:0/1588906226 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc05c1a11e0 con 0x7fc05c10ce30 2024-08-20T01:46:41.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.607+0000 7fc05ad9d640 1 --2- 172.21.15.79:0/1588906226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc05c1039d0 0x7fc05c19b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:46:41.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.608+0000 7fc05b59e640 1 --2- 172.21.15.79:0/1588906226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc05c10ce30 0x7fc05c1a0a10 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fc04c00d750 tx=0x7fc04c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:41.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.608+0000 7fc043fff640 1 -- 172.21.15.79:0/1588906226 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc04c017070 con 0x7fc05c10ce30 2024-08-20T01:46:41.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.608+0000 7fc043fff640 1 -- 172.21.15.79:0/1588906226 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc04c0054b0 con 0x7fc05c10ce30 2024-08-20T01:46:41.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.608+0000 7fc043fff640 1 -- 172.21.15.79:0/1588906226 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc04c004b90 con 0x7fc05c10ce30 2024-08-20T01:46:41.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.608+0000 7fc0610e5640 1 -- 172.21.15.79:0/1588906226 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc05c1a14d0 con 0x7fc05c10ce30 2024-08-20T01:46:41.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.609+0000 7fc0610e5640 1 -- 172.21.15.79:0/1588906226 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc05c1a7b90 con 0x7fc05c10ce30 2024-08-20T01:46:41.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.613+0000 7fc0634de740 1 Processor -- start 2024-08-20T01:46:41.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.614+0000 7fc043fff640 1 -- 172.21.15.79:0/1588906226 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc04c004d30 con 0x7fc05c10ce30 2024-08-20T01:46:41.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.614+0000 7fc0634de740 1 -- start start 2024-08-20T01:46:41.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.614+0000 7fc0634de740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e20d92830 0x563e20d92c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:41.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.614+0000 7fc0634de740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e20d93150 0x563e20d9eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:41.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.614+0000 7fc0634de740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e20d9f0e0 0x563e20da14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:41.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.614+0000 7fc0634de740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563e20d098e0 con 0x563e20d93150 2024-08-20T01:46:41.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.614+0000 7fc0634de740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563e20cf8de0 con 0x563e20d92830 2024-08-20T01:46:41.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.614+0000 7fc0634de740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563e20cfce20 con 0x563e20d9f0e0 2024-08-20T01:46:41.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.615+0000 7fc05a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e20d92830 0x563e20d92c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:41.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.615+0000 7fc05ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e20d93150 0x563e20d9eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:41.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.615+0000 7fc05ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e20d93150 0x563e20d9eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43788/0 (socket says 172.21.15.79:43788) 2024-08-20T01:46:41.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.615+0000 7fc05ad9d640 1 -- 172.21.15.79:0/1885956346 learned_addr learned my addr 172.21.15.79:0/1885956346 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:41.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.615+0000 7fc05a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e20d92830 0x563e20d92c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:49120/0 (socket says 172.21.15.79:49120) 2024-08-20T01:46:41.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.615+0000 7fc05a59c640 1 --2- 172.21.15.79:0/1885956346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e20d9f0e0 0x563e20da14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:41.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.615+0000 7fc043fff640 1 --2- 172.21.15.79:0/1588906226 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc0440b3d20 0x7fc0440b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:41.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.615+0000 7fc05a59c640 1 -- 172.21.15.79:0/1885956346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e20d9f0e0 msgr2=0x563e20da14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:41.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.615+0000 7fc05a59c640 1 --2- 172.21.15.79:0/1885956346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e20d9f0e0 0x563e20da14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:41.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.615+0000 7fc05a59c640 1 -- 172.21.15.79:0/1885956346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e20d93150 msgr2=0x563e20d9eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:41.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.615+0000 7fc05a59c640 1 --2- 172.21.15.79:0/1885956346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e20d93150 0x563e20d9eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:41.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.616+0000 7fc05a59c640 1 -- 172.21.15.79:0/1885956346 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e20a58650 con 0x563e20d92830 2024-08-20T01:46:41.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.616+0000 7fc043fff640 1 -- 172.21.15.79:0/1588906226 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc04c0e33d0 con 0x7fc05c10ce30 2024-08-20T01:46:41.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.616+0000 7fc05a59c640 1 --2- 172.21.15.79:0/1885956346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e20d92830 0x563e20d92c10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc05c06c0b0 tx=0x7fc050005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=342e9650ec639f3d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:41.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.616+0000 7fc0417fa640 1 -- 172.21.15.79:0/1885956346 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc05000f480 con 0x563e20d92830 2024-08-20T01:46:41.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.616+0000 7fc0417fa640 1 -- 172.21.15.79:0/1885956346 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc05000fab0 con 0x563e20d92830 2024-08-20T01:46:41.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.616+0000 7fc0417fa640 1 -- 172.21.15.79:0/1885956346 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc050010980 con 0x563e20d92830 2024-08-20T01:46:41.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.617+0000 7fc05b59e640 1 --2- 172.21.15.79:0/1588906226 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc0440b3d20 0x7fc0440b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:41.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.617+0000 7fc0634de740 1 -- 172.21.15.79:0/1885956346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e20d92830 msgr2=0x563e20d92c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:41.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.617+0000 7fc0634de740 1 --2- 172.21.15.79:0/1885956346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e20d92830 0x563e20d92c10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc05c06c0b0 tx=0x7fc050005f90 comp rx=0 tx=0).stop 2024-08-20T01:46:41.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.617+0000 7fc0634de740 1 -- 172.21.15.79:0/1885956346 shutdown_connections 2024-08-20T01:46:41.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.617+0000 7fc0634de740 1 --2- 172.21.15.79:0/1885956346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e20d9f0e0 0x563e20da14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:41.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.617+0000 7fc0634de740 1 --2- 172.21.15.79:0/1885956346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e20d93150 0x563e20d9eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:41.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.617+0000 7fc0634de740 1 --2- 172.21.15.79:0/1885956346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e20d92830 0x563e20d92c10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:41.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.617+0000 7fc0634de740 1 -- 172.21.15.79:0/1885956346 >> 172.21.15.79:0/1885956346 conn(0x563e20d90660 msgr2=0x563e20d91800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:41.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.618+0000 7fc0634de740 1 -- 172.21.15.79:0/1885956346 shutdown_connections 2024-08-20T01:46:41.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.618+0000 7fc0634de740 1 -- 172.21.15.79:0/1885956346 wait complete. 2024-08-20T01:46:41.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.618+0000 7fc05b59e640 1 --2- 172.21.15.79:0/1588906226 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc0440b3d20 0x7fc0440b61e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc04c0aa370 tx=0x7fc04c005bb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:41.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.618+0000 7fc0634de740 1 -- start start 2024-08-20T01:46:41.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.618+0000 7fc0634de740 1 Processor -- start 2024-08-20T01:46:41.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.619+0000 7fc0634de740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e20d92830 0x563e20d9c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:41.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.619+0000 7fc0634de740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e20d93150 0x563e20d9c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:41.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.619+0000 7fc0634de740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e20d9f0e0 0x563e20d9cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:41.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.619+0000 7fc05ad9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e20d93150 0x563e20d9c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:41.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.619+0000 7fc05ad9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e20d93150 0x563e20d9c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:36510/0 (socket says 172.21.15.79:36510) 2024-08-20T01:46:41.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.619+0000 7fc05ad9d640 1 -- 172.21.15.79:0/2000307218 learned_addr learned my addr 172.21.15.79:0/2000307218 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:41.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.619+0000 7fc0634de740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563e20b5b700 con 0x563e20d92830 2024-08-20T01:46:41.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.619+0000 7fc0634de740 1 -- 172.21.15.79:0/2000307218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563e20c7f7c0 con 0x563e20d9f0e0 2024-08-20T01:46:41.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.619+0000 7fc0634de740 1 -- 172.21.15.79:0/2000307218 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563e20da1d90 con 0x563e20d93150 2024-08-20T01:46:41.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.619+0000 7fc05a59c640 1 --2- 172.21.15.79:0/2000307218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e20d9f0e0 0x563e20d9cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:41.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.620+0000 7fc05a59c640 1 --2- 172.21.15.79:0/2000307218 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e20d92830 0x563e20d9c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:41.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.620+0000 7fc0634de740 10 client.0 _ll_register_callbacks cb 0x563e20cf26b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:46:41.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.620+0000 7fc05ad9d640 1 -- 172.21.15.79:0/2000307218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e20d9f0e0 msgr2=0x563e20d9cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:41.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.620+0000 7fc05ad9d640 1 --2- 172.21.15.79:0/2000307218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e20d9f0e0 0x563e20d9cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:41.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.620+0000 7fc05ad9d640 1 -- 172.21.15.79:0/2000307218 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e20d92830 msgr2=0x563e20d9c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:41.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.620+0000 7fc05ad9d640 1 --2- 172.21.15.79:0/2000307218 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e20d92830 0x563e20d9c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:41.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.620+0000 7fc05ad9d640 1 -- 172.21.15.79:0/2000307218 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e20dab110 con 0x563e20d93150 2024-08-20T01:46:41.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.620+0000 7fc05a59c640 1 --2- 172.21.15.79:0/2000307218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e20d9f0e0 0x563e20d9cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:46:41.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.620+0000 7fc05ad9d640 1 --2- 172.21.15.79:0/2000307218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e20d93150 0x563e20d9c580 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc054009a30 tx=0x7fc054009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79f7d2b81278d68a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:41.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.620+0000 7fc03eff5640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:46:41.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.621+0000 7fc03eff5640 1 -- 172.21.15.79:0/2000307218 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc054003b80 con 0x563e20d93150 2024-08-20T01:46:41.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.621+0000 7fc03eff5640 1 -- 172.21.15.79:0/2000307218 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc054003d20 con 0x563e20d93150 2024-08-20T01:46:41.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.621+0000 7fc0634de740 1 -- 172.21.15.79:0/2000307218 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563e20ca8100 con 0x563e20d93150 2024-08-20T01:46:41.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.621+0000 7fc03eff5640 1 -- 172.21.15.79:0/2000307218 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fc054004b40 con 0x563e20d93150 2024-08-20T01:46:41.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.621+0000 7fc0634de740 10 client.27055 fetch_fsmap learned FSMap version 45 2024-08-20T01:46:41.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.621+0000 7fc0634de740 1 -- 172.21.15.79:0/2000307218 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x563e20dadad0 con 0x563e20d93150 2024-08-20T01:46:41.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.622+0000 7fc03eff5640 1 -- 172.21.15.79:0/2000307218 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x563e20ca8100 con 0x563e20d93150 2024-08-20T01:46:41.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.622+0000 7fc03eff5640 1 -- 172.21.15.79:0/2000307218 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 45) ==== 8378+0+0 (secure 0 0 0) 0x7fc0540305c0 con 0x563e20d93150 2024-08-20T01:46:41.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.622+0000 7fc0634de740 10 client.27055 fetch_fsmap finished waiting for FSMap version 45 2024-08-20T01:46:41.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.622+0000 7fc0634de740 10 client.27055 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:46:41.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.622+0000 7fc0634de740 20 client.27055 populate_metadata read hostname 'smithi079' 2024-08-20T01:46:41.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.622+0000 7fc0634de740 1 --2- 172.21.15.79:0/2000307218 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x563e20daeee0 0x563e20db1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:41.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.622+0000 7fc0634de740 4 client.27055 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:46:41.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.622+0000 7fc0634de740 1 -- 172.21.15.79:0/2000307218 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563e20d0b830 con 0x563e20daeee0 2024-08-20T01:46:41.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.624+0000 7fc05a59c640 1 --2- 172.21.15.79:0/2000307218 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x563e20daeee0 0x563e20db1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:41.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.624+0000 7fc03eff5640 10 client.27055 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:46:41.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.624+0000 7fc05a59c640 1 --2- 172.21.15.79:0/2000307218 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x563e20daeee0 0x563e20db1350 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f69bf81d9910a01f server_cookie=8a99db35cba817ad in_seq=0 out_seq=0 2024-08-20T01:46:41.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.625+0000 7fc03eff5640 1 -- 172.21.15.79:0/2000307218 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563e20d0b830 con 0x563e20daeee0 2024-08-20T01:46:41.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.625+0000 7fc03eff5640 10 client.27055 handle_command_reply: tid=0 2024-08-20T01:46:41.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.625+0000 7fc0634de740 1 client.27055 shutdown 2024-08-20T01:46:41.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.625+0000 7fc0634de740 1 -- 172.21.15.79:0/2000307218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e20d93150 msgr2=0x563e20d9c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:41.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.625+0000 7fc0634de740 1 --2- 172.21.15.79:0/2000307218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e20d93150 0x563e20d9c580 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc054009a30 tx=0x7fc054009c20 comp rx=0 tx=0).stop 2024-08-20T01:46:41.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.625+0000 7fc0634de740 1 -- 172.21.15.79:0/2000307218 shutdown_connections 2024-08-20T01:46:41.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.625+0000 7fc0634de740 1 --2- 172.21.15.79:0/2000307218 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x563e20daeee0 0x563e20db1350 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:41.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.625+0000 7fc0634de740 1 --2- 172.21.15.79:0/2000307218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e20d9f0e0 0x563e20d9cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:41.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.625+0000 7fc0634de740 1 --2- 172.21.15.79:0/2000307218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e20d93150 0x563e20d9c580 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:41.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.625+0000 7fc0634de740 1 --2- 172.21.15.79:0/2000307218 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e20d92830 0x563e20d9c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:41.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.625+0000 7fc0634de740 1 -- 172.21.15.79:0/2000307218 >> 172.21.15.79:0/2000307218 conn(0x563e20d90660 msgr2=0x563e20d96200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:41.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.625+0000 7fc03eff5640 0 client.27055 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:46:41.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.625+0000 7fc0634de740 1 -- 172.21.15.79:0/2000307218 shutdown_connections 2024-08-20T01:46:41.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.625+0000 7fc0634de740 1 -- 172.21.15.79:0/2000307218 wait complete. 2024-08-20T01:46:41.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.626+0000 7fc0634de740 20 client.27055 trim_cache size 0 max 16384 2024-08-20T01:46:41.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.656+0000 7fc0634de740 1 Processor -- start 2024-08-20T01:46:41.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.656+0000 7fc0634de740 1 -- start start 2024-08-20T01:46:41.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.656+0000 7fc0634de740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e20d92830 0x563e20d9e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:41.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.656+0000 7fc0634de740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e20d93150 0x563e20d968a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:41.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.656+0000 7fc0634de740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e20d9f0e0 0x563e20d9b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:41.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.656+0000 7fc0634de740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc05c1b0320 con 0x563e20d93150 2024-08-20T01:46:41.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.656+0000 7fc0634de740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc05c1b1f20 con 0x563e20d92830 2024-08-20T01:46:41.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.656+0000 7fc0634de740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc05c1b09f0 con 0x563e20d9f0e0 2024-08-20T01:46:41.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.656+0000 7fc05a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e20d92830 0x563e20d9e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:41.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.656+0000 7fc05a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e20d92830 0x563e20d9e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:49140/0 (socket says 172.21.15.79:49140) 2024-08-20T01:46:41.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.656+0000 7fc05a59c640 1 -- 172.21.15.79:0/1410259639 learned_addr learned my addr 172.21.15.79:0/1410259639 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:41.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.656+0000 7fc05ad9d640 1 --2- 172.21.15.79:0/1410259639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e20d93150 0x563e20d968a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:41.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.656+0000 7fc05a59c640 1 --2- 172.21.15.79:0/1410259639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e20d9f0e0 0x563e20d9b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:41.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.657+0000 7fc05a59c640 1 -- 172.21.15.79:0/1410259639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e20d9f0e0 msgr2=0x563e20d9b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:41.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.657+0000 7fc05a59c640 1 --2- 172.21.15.79:0/1410259639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e20d9f0e0 0x563e20d9b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:41.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.657+0000 7fc05a59c640 1 -- 172.21.15.79:0/1410259639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e20d93150 msgr2=0x563e20d968a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:41.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.657+0000 7fc05a59c640 1 --2- 172.21.15.79:0/1410259639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e20d93150 0x563e20d968a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:41.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.657+0000 7fc05a59c640 1 -- 172.21.15.79:0/1410259639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e20d92f80 con 0x563e20d92830 2024-08-20T01:46:41.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.657+0000 7fc05ad9d640 1 --2- 172.21.15.79:0/1410259639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e20d93150 0x563e20d968a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:46:41.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.657+0000 7fc05a59c640 1 --2- 172.21.15.79:0/1410259639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e20d92830 0x563e20d9e140 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc0500058c0 tx=0x7fc050005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c461a3aa3afca711 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:41.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.657+0000 7fc040ff9640 1 -- 172.21.15.79:0/1410259639 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc050032070 con 0x563e20d92830 2024-08-20T01:46:41.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.657+0000 7fc040ff9640 1 -- 172.21.15.79:0/1410259639 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc050010690 con 0x563e20d92830 2024-08-20T01:46:41.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.657+0000 7fc040ff9640 1 -- 172.21.15.79:0/1410259639 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0500048e0 con 0x563e20d92830 2024-08-20T01:46:41.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.658+0000 7fc0634de740 1 -- 172.21.15.79:0/1410259639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e20d92830 msgr2=0x563e20d9e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:41.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.658+0000 7fc0634de740 1 --2- 172.21.15.79:0/1410259639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e20d92830 0x563e20d9e140 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc0500058c0 tx=0x7fc050005850 comp rx=0 tx=0).stop 2024-08-20T01:46:41.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.658+0000 7fc0634de740 1 -- 172.21.15.79:0/1410259639 shutdown_connections 2024-08-20T01:46:41.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.658+0000 7fc0634de740 1 --2- 172.21.15.79:0/1410259639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e20d9f0e0 0x563e20d9b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:41.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.658+0000 7fc0634de740 1 --2- 172.21.15.79:0/1410259639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e20d93150 0x563e20d968a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:41.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.658+0000 7fc0634de740 1 --2- 172.21.15.79:0/1410259639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e20d92830 0x563e20d9e140 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:41.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.658+0000 7fc0634de740 1 -- 172.21.15.79:0/1410259639 >> 172.21.15.79:0/1410259639 conn(0x563e20d90660 msgr2=0x563e20d9c830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:41.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.658+0000 7fc0634de740 1 -- 172.21.15.79:0/1410259639 shutdown_connections 2024-08-20T01:46:41.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.658+0000 7fc0634de740 1 -- 172.21.15.79:0/1410259639 wait complete. 2024-08-20T01:46:41.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.659+0000 7fc0634de740 1 -- start start 2024-08-20T01:46:41.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.659+0000 7fc0634de740 1 Processor -- start 2024-08-20T01:46:41.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.659+0000 7fc0634de740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e20d92830 0x563e20da20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:41.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.659+0000 7fc0634de740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e20d93150 0x563e20da2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:41.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.659+0000 7fc0634de740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e20d9f0e0 0x563e20da2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:41.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.659+0000 7fc0634de740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc05c1b1850 con 0x563e20d92830 2024-08-20T01:46:41.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.659+0000 7fc0634de740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc05c1b10c0 con 0x563e20d9f0e0 2024-08-20T01:46:41.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.660+0000 7fc05ad9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e20d93150 0x563e20da2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:41.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.660+0000 7fc05ad9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e20d93150 0x563e20da2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:36518/0 (socket says 172.21.15.79:36518) 2024-08-20T01:46:41.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.660+0000 7fc05ad9d640 1 -- 172.21.15.79:0/3103482679 learned_addr learned my addr 172.21.15.79:0/3103482679 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:41.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.660+0000 7fc05a59c640 1 --2- 172.21.15.79:0/3103482679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e20d9f0e0 0x563e20da2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:41.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.659+0000 7fc0634de740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc05c1ae300 con 0x563e20d93150 2024-08-20T01:46:41.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.660+0000 7fc0634de740 10 client.0 _ll_register_callbacks cb 0x7fc054031e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:46:41.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.660+0000 7fc05a59c640 1 -- 172.21.15.79:0/3103482679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e20d93150 msgr2=0x563e20da2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:41.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.660+0000 7fc05a59c640 1 --2- 172.21.15.79:0/3103482679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e20d93150 0x563e20da2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:41.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.660+0000 7fc05a59c640 1 -- 172.21.15.79:0/3103482679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e20d92830 msgr2=0x563e20da20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:41.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.660+0000 7fc05a59c640 1 --2- 172.21.15.79:0/3103482679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e20d92830 0x563e20da20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:41.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.660+0000 7fc05a59c640 1 -- 172.21.15.79:0/3103482679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e20e17eb0 con 0x563e20d9f0e0 2024-08-20T01:46:41.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.661+0000 7fc05a59c640 1 --2- 172.21.15.79:0/3103482679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e20d9f0e0 0x563e20da2b70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc0500058c0 tx=0x7fc050009e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c27d8e9978471cdc server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:41.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.661+0000 7fc03eff5640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:46:41.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.661+0000 7fc03eff5640 1 -- 172.21.15.79:0/3103482679 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc050032040 con 0x563e20d9f0e0 2024-08-20T01:46:41.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.661+0000 7fc03eff5640 1 -- 172.21.15.79:0/3103482679 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc050005480 con 0x563e20d9f0e0 2024-08-20T01:46:41.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.662+0000 7fc0634de740 1 -- 172.21.15.79:0/3103482679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc050010690 con 0x563e20d9f0e0 2024-08-20T01:46:41.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.662+0000 7fc03eff5640 1 -- 172.21.15.79:0/3103482679 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fc05003e050 con 0x563e20d9f0e0 2024-08-20T01:46:41.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.662+0000 7fc0634de740 10 client.27077 fetch_fsmap learned FSMap version 45 2024-08-20T01:46:41.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.662+0000 7fc0634de740 1 -- 172.21.15.79:0/3103482679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x563e20e2a190 con 0x563e20d9f0e0 2024-08-20T01:46:41.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.662+0000 7fc03eff5640 1 -- 172.21.15.79:0/3103482679 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc050010690 con 0x563e20d9f0e0 2024-08-20T01:46:41.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.662+0000 7fc03eff5640 1 -- 172.21.15.79:0/3103482679 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 45) ==== 8378+0+0 (secure 0 0 0) 0x7fc050003960 con 0x563e20d9f0e0 2024-08-20T01:46:41.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.663+0000 7fc0634de740 10 client.27077 fetch_fsmap finished waiting for FSMap version 45 2024-08-20T01:46:41.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.663+0000 7fc0634de740 10 client.27077 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:46:41.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.663+0000 7fc0634de740 20 client.27077 populate_metadata read hostname 'smithi079' 2024-08-20T01:46:41.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.663+0000 7fc0634de740 1 --2- 172.21.15.79:0/3103482679 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x563e20e2a640 0x563e20e2ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:41.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.663+0000 7fc0634de740 4 client.27077 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:46:41.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.663+0000 7fc0634de740 1 -- 172.21.15.79:0/3103482679 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563e20d072d0 con 0x563e20e2a640 2024-08-20T01:46:41.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.663+0000 7fc05ad9d640 1 --2- 172.21.15.79:0/3103482679 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x563e20e2a640 0x563e20e2ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:41.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.663+0000 7fc05ad9d640 1 --2- 172.21.15.79:0/3103482679 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x563e20e2a640 0x563e20e2ca60 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd914160c074aabe server_cookie=8197a3ff0ec3352f in_seq=0 out_seq=0 2024-08-20T01:46:41.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.663+0000 7fc03eff5640 10 client.27077 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:46:41.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.664+0000 7fc03eff5640 1 -- 172.21.15.79:0/3103482679 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x563e20d072d0 con 0x563e20e2a640 2024-08-20T01:46:41.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.664+0000 7fc03eff5640 10 client.27077 handle_command_reply: tid=0 2024-08-20T01:46:41.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.664+0000 7fc0634de740 1 client.27077 shutdown 2024-08-20T01:46:41.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.664+0000 7fc0634de740 1 -- 172.21.15.79:0/3103482679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e20d9f0e0 msgr2=0x563e20da2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:41.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.664+0000 7fc0634de740 1 --2- 172.21.15.79:0/3103482679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e20d9f0e0 0x563e20da2b70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc0500058c0 tx=0x7fc050009e90 comp rx=0 tx=0).stop 2024-08-20T01:46:41.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.664+0000 7fc0634de740 1 -- 172.21.15.79:0/3103482679 shutdown_connections 2024-08-20T01:46:41.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.664+0000 7fc0634de740 1 --2- 172.21.15.79:0/3103482679 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x563e20e2a640 0x563e20e2ca60 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:41.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.664+0000 7fc0634de740 1 --2- 172.21.15.79:0/3103482679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e20d9f0e0 0x563e20da2b70 secure :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc0500058c0 tx=0x7fc050009e90 comp rx=0 tx=0).stop 2024-08-20T01:46:41.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.664+0000 7fc0634de740 1 --2- 172.21.15.79:0/3103482679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e20d93150 0x563e20da2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:41.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.664+0000 7fc0634de740 1 --2- 172.21.15.79:0/3103482679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e20d92830 0x563e20da20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:41.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.664+0000 7fc0634de740 1 -- 172.21.15.79:0/3103482679 >> 172.21.15.79:0/3103482679 conn(0x563e20d90660 msgr2=0x563e20d8ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:41.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.664+0000 7fc03eff5640 0 client.27077 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:46:41.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.664+0000 7fc0634de740 1 -- 172.21.15.79:0/3103482679 shutdown_connections 2024-08-20T01:46:41.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.664+0000 7fc0634de740 1 -- 172.21.15.79:0/3103482679 wait complete. 2024-08-20T01:46:41.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.665+0000 7fc0634de740 20 client.27077 trim_cache size 0 max 16384 2024-08-20T01:46:41.670 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:46:41.671 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-08-20T01:46:41.671 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-08-20T01:46:41.671 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:46:41.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.665+0000 7fc0610e5640 1 -- 172.21.15.79:0/1588906226 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc0440b3d20 msgr2=0x7fc0440b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:41.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.665+0000 7fc0610e5640 1 --2- 172.21.15.79:0/1588906226 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc0440b3d20 0x7fc0440b61e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc04c0aa370 tx=0x7fc04c005bb0 comp rx=0 tx=0).stop 2024-08-20T01:46:41.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.665+0000 7fc0610e5640 1 -- 172.21.15.79:0/1588906226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc05c10ce30 msgr2=0x7fc05c1a0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:41.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.665+0000 7fc0610e5640 1 --2- 172.21.15.79:0/1588906226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc05c10ce30 0x7fc05c1a0a10 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fc04c00d750 tx=0x7fc04c00dc10 comp rx=0 tx=0).stop 2024-08-20T01:46:41.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.666+0000 7fc0610e5640 1 -- 172.21.15.79:0/1588906226 shutdown_connections 2024-08-20T01:46:41.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.666+0000 7fc0610e5640 1 --2- 172.21.15.79:0/1588906226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc05c10ce30 0x7fc05c1a0a10 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:41.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.666+0000 7fc0610e5640 1 --2- 172.21.15.79:0/1588906226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc05c1042f0 0x7fc05c19b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:41.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.666+0000 7fc0610e5640 1 --2- 172.21.15.79:0/1588906226 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc0440b3d20 0x7fc0440b61e0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:41.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.666+0000 7fc0610e5640 1 --2- 172.21.15.79:0/1588906226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc05c1039d0 0x7fc05c19b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:41.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.666+0000 7fc0610e5640 1 -- 172.21.15.79:0/1588906226 >> 172.21.15.79:0/1588906226 conn(0x7fc05c0fd410 msgr2=0x7fc05c0ff800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:41.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.666+0000 7fc0610e5640 1 -- 172.21.15.79:0/1588906226 shutdown_connections 2024-08-20T01:46:41.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:41.666+0000 7fc0610e5640 1 -- 172.21.15.79:0/1588906226 wait complete. 2024-08-20T01:46:42.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:42 smithi079 ceph-mon[18656]: pgmap v628: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 29 MiB/s wr, 7.42k op/s 2024-08-20T01:46:42.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:42 smithi081 ceph-mon[22209]: pgmap v628: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 29 MiB/s wr, 7.42k op/s 2024-08-20T01:46:42.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:42 smithi175 ceph-mon[22392]: pgmap v628: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 29 MiB/s wr, 7.42k op/s 2024-08-20T01:46:44.729 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T01:46:44.730 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:46:44.765 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:44 smithi079 ceph-mon[18656]: pgmap v629: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 28 MiB/s wr, 7.05k op/s 2024-08-20T01:46:44.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:44 smithi081 ceph-mon[22209]: pgmap v629: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 28 MiB/s wr, 7.05k op/s 2024-08-20T01:46:44.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:44 smithi175 ceph-mon[22392]: pgmap v629: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 28 MiB/s wr, 7.05k op/s 2024-08-20T01:46:45.145 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:46:46.562 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:46 smithi079 ceph-mon[18656]: pgmap v630: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 30 MiB/s wr, 7.59k op/s 2024-08-20T01:46:46.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:46.685+0000 7f51464e4640 1 -- 172.21.15.79:0/2312018483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f513809bdb0 msgr2=0x7f51380a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:46.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:46.685+0000 7f51464e4640 1 --2- 172.21.15.79:0/2312018483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f513809bdb0 0x7f51380a2490 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f5140068900 tx=0x7f5140097b40 comp rx=0 tx=0).stop 2024-08-20T01:46:46.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:46.685+0000 7f51464e4640 1 -- 172.21.15.79:0/2312018483 shutdown_connections 2024-08-20T01:46:46.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:46.685+0000 7f51464e4640 1 --2- 172.21.15.79:0/2312018483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f513809bdb0 0x7f51380a2490 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:46.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:46.685+0000 7f51464e4640 1 --2- 172.21.15.79:0/2312018483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f513809b430 0x7f513809b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:46.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:46.685+0000 7f51464e4640 1 --2- 172.21.15.79:0/2312018483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5138094330 0x7f5138094710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:46.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:46.685+0000 7f51464e4640 1 -- 172.21.15.79:0/2312018483 >> 172.21.15.79:0/2312018483 conn(0x7f5138009980 msgr2=0x7f513800c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:46.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:46.685+0000 7f51464e4640 1 -- 172.21.15.79:0/2312018483 shutdown_connections 2024-08-20T01:46:46.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:46.685+0000 7f51464e4640 1 -- 172.21.15.79:0/2312018483 wait complete. 2024-08-20T01:46:46.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:46.686+0000 7f51464e4640 1 Processor -- start 2024-08-20T01:46:46.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:46.686+0000 7f51464e4640 1 -- start start 2024-08-20T01:46:46.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:46.686+0000 7f51464e4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5138094330 0x7f5138096db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:46.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:46.686+0000 7f51464e4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f513809b430 0x7f5138095300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:46.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:46.686+0000 7f51454e2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5138094330 0x7f5138096db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:46.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:46.687+0000 7f51454e2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5138094330 0x7f5138096db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:36532/0 (socket says 172.21.15.79:36532) 2024-08-20T01:46:46.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:46.687+0000 7f51454e2640 1 -- 172.21.15.79:0/551637679 learned_addr learned my addr 172.21.15.79:0/551637679 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:46.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:46.687+0000 7f5144ce1640 1 --2- 172.21.15.79:0/551637679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f513809b430 0x7f5138095300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:46.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:46.687+0000 7f51464e4640 1 --2- 172.21.15.79:0/551637679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f513809bdb0 0x7f5138095930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:46.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:46.687+0000 7f51464e4640 1 -- 172.21.15.79:0/551637679 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f51380a5690 con 0x7f513809b430 2024-08-20T01:46:46.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:46.687+0000 7f51464e4640 1 -- 172.21.15.79:0/551637679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f51380a5510 con 0x7f513809bdb0 2024-08-20T01:46:46.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:46.687+0000 7f51464e4640 1 -- 172.21.15.79:0/551637679 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f51380a5810 con 0x7f5138094330 2024-08-20T01:46:46.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:46.687+0000 7f5145ce3640 1 --2- 172.21.15.79:0/551637679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f513809bdb0 0x7f5138095930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:46.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:46.687+0000 7f51454e2640 1 -- 172.21.15.79:0/551637679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f513809bdb0 msgr2=0x7f5138095930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:46.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:46.687+0000 7f51454e2640 1 --2- 172.21.15.79:0/551637679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f513809bdb0 0x7f5138095930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:46.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:46.687+0000 7f51454e2640 1 -- 172.21.15.79:0/551637679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f513809b430 msgr2=0x7f5138095300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:46.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:46.687+0000 7f51454e2640 1 --2- 172.21.15.79:0/551637679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f513809b430 0x7f5138095300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:46.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:46.687+0000 7f51454e2640 1 -- 172.21.15.79:0/551637679 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f513813e5a0 con 0x7f5138094330 2024-08-20T01:46:46.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:46.688+0000 7f51454e2640 1 --2- 172.21.15.79:0/551637679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5138094330 0x7f5138096db0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f513c009fd0 tx=0x7f513c00edd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:46.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:46.688+0000 7f51367fc640 1 -- 172.21.15.79:0/551637679 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513c00cd80 con 0x7f5138094330 2024-08-20T01:46:46.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:46.688+0000 7f51464e4640 1 -- 172.21.15.79:0/551637679 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f513812fd20 con 0x7f5138094330 2024-08-20T01:46:46.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:46.688+0000 7f51464e4640 1 -- 172.21.15.79:0/551637679 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51381302b0 con 0x7f5138094330 2024-08-20T01:46:46.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:46.689+0000 7f51367fc640 1 -- 172.21.15.79:0/551637679 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f513c0218d0 con 0x7f5138094330 2024-08-20T01:46:46.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:46.689+0000 7f51367fc640 1 -- 172.21.15.79:0/551637679 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513c0297a0 con 0x7f5138094330 2024-08-20T01:46:46.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:46.690+0000 7f51464e4640 1 -- 172.21.15.79:0/551637679 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51240052c0 con 0x7f5138094330 2024-08-20T01:46:46.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:46.692+0000 7f51367fc640 1 -- 172.21.15.79:0/551637679 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f513c021440 con 0x7f5138094330 2024-08-20T01:46:46.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:46.693+0000 7f51367fc640 1 --2- 172.21.15.79:0/551637679 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f512c0b3cd0 0x7f512c0b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:46.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:46.693+0000 7f51367fc640 1 -- 172.21.15.79:0/551637679 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f513c0f5220 con 0x7f5138094330 2024-08-20T01:46:46.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:46.694+0000 7f5144ce1640 1 --2- 172.21.15.79:0/551637679 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f512c0b3cd0 0x7f512c0b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:46.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:46.695+0000 7f5144ce1640 1 --2- 172.21.15.79:0/551637679 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f512c0b3cd0 0x7f512c0b6190 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f513812fb10 tx=0x7f5130005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:46.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:46.696+0000 7f51367fc640 1 -- 172.21.15.79:0/551637679 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f513c0bc1d0 con 0x7f5138094330 2024-08-20T01:46:46.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:46 smithi081 ceph-mon[22209]: pgmap v630: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 30 MiB/s wr, 7.59k op/s 2024-08-20T01:46:46.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:46 smithi175 ceph-mon[22392]: pgmap v630: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 30 MiB/s wr, 7.59k op/s 2024-08-20T01:46:47.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:47.085+0000 7f51464e4640 1 -- 172.21.15.79:0/551637679 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f51240055b0 con 0x7f5138094330 2024-08-20T01:46:47.089 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:46:47.089 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":45,"btime":"2024-08-20T01:46:25:434796+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14670,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/735082912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":735082912},{"type":"v1","addr":"172.21.15.79:6835","nonce":735082912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2150339873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2150339873},{"type":"v1","addr":"172.21.15.79:6837","nonce":2150339873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":45,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:34:55.133562+0000","modified":"2024-08-20T01:46:24.612293+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24539,"mds_1":24538,"mds_2":24523,"mds_3":24514,"mds_4":24512},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14724":{"gid":14724,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/1071242274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1071242274},{"type":"v1","addr":"172.21.15.79:6839","nonce":1071242274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14730":{"gid":14730,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6841/2448977611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":2448977611},{"type":"v1","addr":"172.21.15.79:6841","nonce":2448977611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/1257507005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1257507005},{"type":"v1","addr":"172.21.15.81:6833","nonce":1257507005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1499936216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1499936216},{"type":"v1","addr":"172.21.15.81:6835","nonce":1499936216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/1107229215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1107229215},{"type":"v1","addr":"172.21.15.175:6833","nonce":1107229215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6837/2073598870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2073598870},{"type":"v1","addr":"172.21.15.81:6837","nonce":2073598870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/2552601173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2552601173},{"type":"v1","addr":"172.21.15.175:6835","nonce":2552601173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6837/1767284089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1767284089},{"type":"v1","addr":"172.21.15.175:6837","nonce":1767284089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/1331748742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1331748742},{"type":"v1","addr":"172.21.15.175:6839","nonce":1331748742}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/4098410583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":4098410583},{"type":"v1","addr":"172.21.15.81:6839","nonce":4098410583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24539,"qdb_cluster":[24539,24523,24514,24538,24512]},"id":1}]} 2024-08-20T01:46:47.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:47.086+0000 7f51367fc640 1 -- 172.21.15.79:0/551637679 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+11980 (secure 0 0 0) 0x7f513c0c0720 con 0x7f5138094330 2024-08-20T01:46:47.090 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 45 2024-08-20T01:46:47.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:47.089+0000 7f51464e4640 1 -- 172.21.15.79:0/551637679 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f512c0b3cd0 msgr2=0x7f512c0b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:47.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:47.089+0000 7f51464e4640 1 --2- 172.21.15.79:0/551637679 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f512c0b3cd0 0x7f512c0b6190 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f513812fb10 tx=0x7f5130005f90 comp rx=0 tx=0).stop 2024-08-20T01:46:47.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:47.089+0000 7f51464e4640 1 -- 172.21.15.79:0/551637679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5138094330 msgr2=0x7f5138096db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:47.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:47.089+0000 7f51464e4640 1 --2- 172.21.15.79:0/551637679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5138094330 0x7f5138096db0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f513c009fd0 tx=0x7f513c00edd0 comp rx=0 tx=0).stop 2024-08-20T01:46:47.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:47.089+0000 7f51464e4640 1 -- 172.21.15.79:0/551637679 shutdown_connections 2024-08-20T01:46:47.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:47.089+0000 7f51464e4640 1 --2- 172.21.15.79:0/551637679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f513809bdb0 0x7f5138095930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:47.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:47.089+0000 7f51464e4640 1 --2- 172.21.15.79:0/551637679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f513809b430 0x7f5138095300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:47.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:47.089+0000 7f51464e4640 1 --2- 172.21.15.79:0/551637679 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f512c0b3cd0 0x7f512c0b6190 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:47.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:47.090+0000 7f51464e4640 1 --2- 172.21.15.79:0/551637679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5138094330 0x7f5138096db0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:47.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:47.090+0000 7f51464e4640 1 -- 172.21.15.79:0/551637679 >> 172.21.15.79:0/551637679 conn(0x7f5138009980 msgr2=0x7f5138092e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:47.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:47.090+0000 7f51464e4640 1 -- 172.21.15.79:0/551637679 shutdown_connections 2024-08-20T01:46:47.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:47.090+0000 7f51464e4640 1 -- 172.21.15.79:0/551637679 wait complete. 2024-08-20T01:46:47.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:47 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/551637679' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:46:47.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:47 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/551637679' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:46:47.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:47 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/551637679' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:46:48.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:48 smithi081 ceph-mon[22209]: pgmap v631: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 27 MiB/s wr, 7.00k op/s 2024-08-20T01:46:48.838 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:48 smithi079 ceph-mon[18656]: pgmap v631: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 27 MiB/s wr, 7.00k op/s 2024-08-20T01:46:48.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:48 smithi175 ceph-mon[22392]: pgmap v631: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 27 MiB/s wr, 7.00k op/s 2024-08-20T01:46:49.071 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-20T01:46:49.566 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:46:50.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.175+0000 7f4673fff640 1 -- 172.21.15.79:0/1824616201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f467410a520 msgr2=0x7f467410a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:50.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.176+0000 7f4673fff640 1 --2- 172.21.15.79:0/1824616201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f467410a520 0x7f467410a960 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f465c009900 tx=0x7f465c02a410 comp rx=0 tx=0).stop 2024-08-20T01:46:50.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.176+0000 7f4673fff640 1 -- 172.21.15.79:0/1824616201 shutdown_connections 2024-08-20T01:46:50.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.176+0000 7f4673fff640 1 --2- 172.21.15.79:0/1824616201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f467410aea0 0x7f46741116a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:50.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.176+0000 7f4673fff640 1 --2- 172.21.15.79:0/1824616201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f467410a520 0x7f467410a960 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:50.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.176+0000 7f4673fff640 1 --2- 172.21.15.79:0/1824616201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4674104b10 0x7f4674104ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:50.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.176+0000 7f4673fff640 1 -- 172.21.15.79:0/1824616201 >> 172.21.15.79:0/1824616201 conn(0x7f4674100540 msgr2=0x7f4674102960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:50.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.176+0000 7f4673fff640 1 -- 172.21.15.79:0/1824616201 shutdown_connections 2024-08-20T01:46:50.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.176+0000 7f4673fff640 1 -- 172.21.15.79:0/1824616201 wait complete. 2024-08-20T01:46:50.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.177+0000 7f4673fff640 1 Processor -- start 2024-08-20T01:46:50.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.177+0000 7f4673fff640 1 -- start start 2024-08-20T01:46:50.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.177+0000 7f4673fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4674104b10 0x7f46740773e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:50.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.177+0000 7f4673fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f467410a520 0x7f4674077920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:50.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.177+0000 7f4673fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f467410aea0 0x7f4674077e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:50.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.177+0000 7f4673fff640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4674114a10 con 0x7f4674104b10 2024-08-20T01:46:50.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.177+0000 7f4673fff640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4674114890 con 0x7f467410a520 2024-08-20T01:46:50.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.177+0000 7f4673fff640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4674114b90 con 0x7f467410aea0 2024-08-20T01:46:50.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.178+0000 7f4672ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4674104b10 0x7f46740773e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:50.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.178+0000 7f46737fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f467410aea0 0x7f4674077e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:50.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.178+0000 7f466bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f467410a520 0x7f4674077920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:50.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.178+0000 7f46737fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f467410aea0 0x7f4674077e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:36544/0 (socket says 172.21.15.79:36544) 2024-08-20T01:46:50.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.178+0000 7f4672ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4674104b10 0x7f46740773e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43850/0 (socket says 172.21.15.79:43850) 2024-08-20T01:46:50.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.178+0000 7f46737fe640 1 -- 172.21.15.79:0/225062045 learned_addr learned my addr 172.21.15.79:0/225062045 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:50.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.178+0000 7f46737fe640 1 -- 172.21.15.79:0/225062045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f467410a520 msgr2=0x7f4674077920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:50.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.178+0000 7f46737fe640 1 --2- 172.21.15.79:0/225062045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f467410a520 0x7f4674077920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:50.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.178+0000 7f46737fe640 1 -- 172.21.15.79:0/225062045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4674104b10 msgr2=0x7f46740773e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:50.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.178+0000 7f46737fe640 1 --2- 172.21.15.79:0/225062045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4674104b10 0x7f46740773e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:50.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.178+0000 7f46737fe640 1 -- 172.21.15.79:0/225062045 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46741ab4b0 con 0x7f467410aea0 2024-08-20T01:46:50.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.178+0000 7f466bfff640 1 --2- 172.21.15.79:0/225062045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f467410a520 0x7f4674077920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:46:50.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.179+0000 7f46737fe640 1 --2- 172.21.15.79:0/225062045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f467410aea0 0x7f4674077e60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f466c00b990 tx=0x7f466c00be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:50.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.179+0000 7f4670ff9640 1 -- 172.21.15.79:0/225062045 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466c019070 con 0x7f467410aea0 2024-08-20T01:46:50.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.179+0000 7f4673fff640 1 -- 172.21.15.79:0/225062045 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46741ab7a0 con 0x7f467410aea0 2024-08-20T01:46:50.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.179+0000 7f4670ff9640 1 -- 172.21.15.79:0/225062045 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f466c00cba0 con 0x7f467410aea0 2024-08-20T01:46:50.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.179+0000 7f4670ff9640 1 -- 172.21.15.79:0/225062045 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466c0075d0 con 0x7f467410aea0 2024-08-20T01:46:50.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.179+0000 7f4673fff640 1 -- 172.21.15.79:0/225062045 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46741abd30 con 0x7f467410aea0 2024-08-20T01:46:50.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.183+0000 7f467bbeb740 1 Processor -- start 2024-08-20T01:46:50.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.184+0000 7f4670ff9640 1 -- 172.21.15.79:0/225062045 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f466c01c070 con 0x7f467410aea0 2024-08-20T01:46:50.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.184+0000 7f467bbeb740 1 -- start start 2024-08-20T01:46:50.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.185+0000 7f467bbeb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620248cea30 0x5620248cee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:50.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.185+0000 7f467bbeb740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620248cf350 0x5620248dada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:50.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.185+0000 7f467bbeb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620248db2e0 0x5620248dd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:50.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.185+0000 7f467bbeb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562024845930 con 0x5620248db2e0 2024-08-20T01:46:50.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.185+0000 7f467bbeb740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562024834e30 con 0x5620248cf350 2024-08-20T01:46:50.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.185+0000 7f467bbeb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562024838e70 con 0x5620248cea30 2024-08-20T01:46:50.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.185+0000 7f4672ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620248cf350 0x5620248dada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:50.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.185+0000 7f4672ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620248cf350 0x5620248dada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:49162/0 (socket says 172.21.15.79:49162) 2024-08-20T01:46:50.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.185+0000 7f4672ffd640 1 -- 172.21.15.79:0/361512675 learned_addr learned my addr 172.21.15.79:0/361512675 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:50.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.186+0000 7f4670ff9640 1 --2- 172.21.15.79:0/225062045 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f46600b3c70 0x7f46600b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:50.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.186+0000 7f4670ff9640 1 -- 172.21.15.79:0/225062045 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f466c0e3350 con 0x7f467410aea0 2024-08-20T01:46:50.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.186+0000 7f466bfff640 1 --2- 172.21.15.79:0/361512675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620248cea30 0x5620248cee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:50.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.187+0000 7f466bfff640 1 -- 172.21.15.79:0/361512675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620248cf350 msgr2=0x5620248dada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:50.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.187+0000 7f466bfff640 1 --2- 172.21.15.79:0/361512675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620248cf350 0x5620248dada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:50.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.187+0000 7f466bfff640 1 -- 172.21.15.79:0/361512675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620248db2e0 msgr2=0x5620248dd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:50.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.187+0000 7f466bfff640 1 --2- 172.21.15.79:0/361512675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620248db2e0 0x5620248dd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:50.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.187+0000 7f466bfff640 1 -- 172.21.15.79:0/361512675 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562024594650 con 0x5620248cea30 2024-08-20T01:46:50.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.187+0000 7f466bfff640 1 --2- 172.21.15.79:0/361512675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620248cea30 0x5620248cee10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f465c0057c0 tx=0x7f465c032e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92e1ec2311268d53 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:50.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.188+0000 7f46697fa640 1 -- 172.21.15.79:0/361512675 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c035030 con 0x5620248cea30 2024-08-20T01:46:50.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.188+0000 7f46697fa640 1 -- 172.21.15.79:0/361512675 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f465c041070 con 0x5620248cea30 2024-08-20T01:46:50.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.188+0000 7f46737fe640 1 --2- 172.21.15.79:0/225062045 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f46600b3c70 0x7f46600b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:50.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.188+0000 7f46697fa640 1 -- 172.21.15.79:0/361512675 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c031800 con 0x5620248cea30 2024-08-20T01:46:50.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.189+0000 7f46737fe640 1 --2- 172.21.15.79:0/225062045 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f46600b3c70 0x7f46600b6130 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f466c00bfd0 tx=0x7f466c00c610 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:50.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.189+0000 7f467bbeb740 1 -- 172.21.15.79:0/361512675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620248cea30 msgr2=0x5620248cee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:50.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.189+0000 7f467bbeb740 1 --2- 172.21.15.79:0/361512675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620248cea30 0x5620248cee10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f465c0057c0 tx=0x7f465c032e30 comp rx=0 tx=0).stop 2024-08-20T01:46:50.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.189+0000 7f467bbeb740 1 -- 172.21.15.79:0/361512675 shutdown_connections 2024-08-20T01:46:50.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.189+0000 7f467bbeb740 1 --2- 172.21.15.79:0/361512675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620248db2e0 0x5620248dd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:50.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.189+0000 7f467bbeb740 1 --2- 172.21.15.79:0/361512675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620248cf350 0x5620248dada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:50.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.189+0000 7f467bbeb740 1 --2- 172.21.15.79:0/361512675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620248cea30 0x5620248cee10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:50.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.189+0000 7f467bbeb740 1 -- 172.21.15.79:0/361512675 >> 172.21.15.79:0/361512675 conn(0x5620248cc860 msgr2=0x5620248cda00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:50.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.190+0000 7f467bbeb740 1 -- 172.21.15.79:0/361512675 shutdown_connections 2024-08-20T01:46:50.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.190+0000 7f467bbeb740 1 -- 172.21.15.79:0/361512675 wait complete. 2024-08-20T01:46:50.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.191+0000 7f467bbeb740 1 -- start start 2024-08-20T01:46:50.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.191+0000 7f467bbeb740 1 Processor -- start 2024-08-20T01:46:50.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.191+0000 7f467bbeb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620248cea30 0x5620248d8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:50.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.191+0000 7f467bbeb740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620248cf350 0x5620248d87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:50.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.191+0000 7f466bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620248cea30 0x5620248d8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:50.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.191+0000 7f466bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620248cea30 0x5620248d8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43876/0 (socket says 172.21.15.79:43876) 2024-08-20T01:46:50.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.191+0000 7f466bfff640 1 -- 172.21.15.79:0/1583407131 learned_addr learned my addr 172.21.15.79:0/1583407131 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:50.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.191+0000 7f467bbeb740 1 --2- 172.21.15.79:0/1583407131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620248db2e0 0x5620248d8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:50.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.191+0000 7f467bbeb740 1 -- 172.21.15.79:0/1583407131 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562024697700 con 0x5620248cea30 2024-08-20T01:46:50.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.191+0000 7f467bbeb740 1 -- 172.21.15.79:0/1583407131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5620247bb810 con 0x5620248cf350 2024-08-20T01:46:50.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.192+0000 7f4672ffd640 1 --2- 172.21.15.79:0/1583407131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620248cf350 0x5620248d87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:50.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.192+0000 7f467bbeb740 1 -- 172.21.15.79:0/1583407131 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5620248ddf30 con 0x5620248db2e0 2024-08-20T01:46:50.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.192+0000 7f467bbeb740 10 client.0 _ll_register_callbacks cb 0x56202482e700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:46:50.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.192+0000 7f466bfff640 1 --2- 172.21.15.79:0/1583407131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620248db2e0 0x5620248d8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:50.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.193+0000 7f4672ffd640 1 -- 172.21.15.79:0/1583407131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620248db2e0 msgr2=0x5620248d8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:50.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.193+0000 7f4672ffd640 1 --2- 172.21.15.79:0/1583407131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620248db2e0 0x5620248d8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:50.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.193+0000 7f4672ffd640 1 -- 172.21.15.79:0/1583407131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620248cea30 msgr2=0x5620248d8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:50.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.193+0000 7f4672ffd640 1 --2- 172.21.15.79:0/1583407131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620248cea30 0x5620248d8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:50.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.193+0000 7f4672ffd640 1 -- 172.21.15.79:0/1583407131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620248e72e0 con 0x5620248cf350 2024-08-20T01:46:50.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.193+0000 7f4672ffd640 1 --2- 172.21.15.79:0/1583407131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620248cf350 0x5620248d87b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f46640126d0 tx=0x7f4664012ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=930d0cddaf5d72e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:50.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.193+0000 7f465a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:46:50.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.196+0000 7f465a7fc640 1 -- 172.21.15.79:0/1583407131 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4664004320 con 0x5620248cf350 2024-08-20T01:46:50.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.196+0000 7f465a7fc640 1 -- 172.21.15.79:0/1583407131 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f46640116c0 con 0x5620248cf350 2024-08-20T01:46:50.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.196+0000 7f467bbeb740 1 -- 172.21.15.79:0/1583407131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5620247e4150 con 0x5620248cf350 2024-08-20T01:46:50.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.197+0000 7f465a7fc640 1 -- 172.21.15.79:0/1583407131 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f46640044c0 con 0x5620248cf350 2024-08-20T01:46:50.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.197+0000 7f467bbeb740 10 client.27095 fetch_fsmap learned FSMap version 45 2024-08-20T01:46:50.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.197+0000 7f467bbeb740 1 -- 172.21.15.79:0/1583407131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x5620248e9cf0 con 0x5620248cf350 2024-08-20T01:46:50.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.198+0000 7f465a7fc640 1 -- 172.21.15.79:0/1583407131 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5620247e4150 con 0x5620248cf350 2024-08-20T01:46:50.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.199+0000 7f465a7fc640 1 -- 172.21.15.79:0/1583407131 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 45) ==== 8378+0+0 (secure 0 0 0) 0x7f4664003ba0 con 0x5620248cf350 2024-08-20T01:46:50.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.199+0000 7f467bbeb740 10 client.27095 fetch_fsmap finished waiting for FSMap version 45 2024-08-20T01:46:50.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.199+0000 7f467bbeb740 10 client.27095 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:46:50.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.199+0000 7f467bbeb740 20 client.27095 populate_metadata read hostname 'smithi079' 2024-08-20T01:46:50.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.199+0000 7f467bbeb740 1 --2- 172.21.15.79:0/1583407131 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x5620248eb540 0x5620248ed9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:50.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.199+0000 7f467bbeb740 4 client.27095 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:46:50.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.199+0000 7f467bbeb740 1 -- 172.21.15.79:0/1583407131 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562024847880 con 0x5620248eb540 2024-08-20T01:46:50.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.199+0000 7f466bfff640 1 --2- 172.21.15.79:0/1583407131 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x5620248eb540 0x5620248ed9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:50.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.202+0000 7f466bfff640 1 --2- 172.21.15.79:0/1583407131 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x5620248eb540 0x5620248ed9c0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=42a9905f89e5e515 server_cookie=714e37ad471b9d1f in_seq=0 out_seq=0 2024-08-20T01:46:50.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.202+0000 7f465a7fc640 10 client.27095 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:46:50.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.203+0000 7f465a7fc640 1 -- 172.21.15.79:0/1583407131 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562024847880 con 0x5620248eb540 2024-08-20T01:46:50.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.203+0000 7f465a7fc640 10 client.27095 handle_command_reply: tid=0 2024-08-20T01:46:50.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.203+0000 7f467bbeb740 1 client.27095 shutdown 2024-08-20T01:46:50.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.203+0000 7f467bbeb740 1 -- 172.21.15.79:0/1583407131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620248cf350 msgr2=0x5620248d87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:50.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.204+0000 7f467bbeb740 1 --2- 172.21.15.79:0/1583407131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620248cf350 0x5620248d87b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f46640126d0 tx=0x7f4664012ad0 comp rx=0 tx=0).stop 2024-08-20T01:46:50.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.204+0000 7f467bbeb740 1 -- 172.21.15.79:0/1583407131 shutdown_connections 2024-08-20T01:46:50.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.204+0000 7f467bbeb740 1 --2- 172.21.15.79:0/1583407131 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x5620248eb540 0x5620248ed9c0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:50.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.204+0000 7f467bbeb740 1 --2- 172.21.15.79:0/1583407131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620248db2e0 0x5620248d8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:50.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.204+0000 7f467bbeb740 1 --2- 172.21.15.79:0/1583407131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620248cf350 0x5620248d87b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:50.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.204+0000 7f467bbeb740 1 --2- 172.21.15.79:0/1583407131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620248cea30 0x5620248d8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:50.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.204+0000 7f465a7fc640 0 client.27095 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:46:50.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.204+0000 7f467bbeb740 1 -- 172.21.15.79:0/1583407131 >> 172.21.15.79:0/1583407131 conn(0x5620248cc860 msgr2=0x5620248d2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:50.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.204+0000 7f467bbeb740 1 -- 172.21.15.79:0/1583407131 shutdown_connections 2024-08-20T01:46:50.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.204+0000 7f467bbeb740 1 -- 172.21.15.79:0/1583407131 wait complete. 2024-08-20T01:46:50.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.204+0000 7f467bbeb740 20 client.27095 trim_cache size 0 max 16384 2024-08-20T01:46:50.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.228+0000 7f467bbeb740 1 Processor -- start 2024-08-20T01:46:50.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.228+0000 7f467bbeb740 1 -- start start 2024-08-20T01:46:50.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.228+0000 7f467bbeb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620248cea30 0x5620248d9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:50.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.228+0000 7f467bbeb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620248cf350 0x5620248f32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:50.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.229+0000 7f467bbeb740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620248db2e0 0x5620248f3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:50.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.229+0000 7f4672ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620248cf350 0x5620248f32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:50.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.229+0000 7f4672ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620248cf350 0x5620248f32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:36562/0 (socket says 172.21.15.79:36562) 2024-08-20T01:46:50.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.229+0000 7f466bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620248cea30 0x5620248d9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:50.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.229+0000 7f4672ffd640 1 -- 172.21.15.79:0/1828660177 learned_addr learned my addr 172.21.15.79:0/1828660177 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:50.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.229+0000 7f467bbeb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f46741b4250 con 0x5620248cea30 2024-08-20T01:46:50.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.229+0000 7f467bbeb740 1 -- 172.21.15.79:0/1828660177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f46741b5e50 con 0x5620248db2e0 2024-08-20T01:46:50.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.229+0000 7f467bbeb740 1 -- 172.21.15.79:0/1828660177 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f46741b4920 con 0x5620248cf350 2024-08-20T01:46:50.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.229+0000 7f4672ffd640 1 -- 172.21.15.79:0/1828660177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620248db2e0 msgr2=0x5620248f3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:50.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.229+0000 7f4672ffd640 1 --2- 172.21.15.79:0/1828660177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620248db2e0 0x5620248f3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:50.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.229+0000 7f4672ffd640 1 -- 172.21.15.79:0/1828660177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620248cea30 msgr2=0x5620248d9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:50.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.229+0000 7f4672ffd640 1 --2- 172.21.15.79:0/1828660177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620248cea30 0x5620248d9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:50.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.229+0000 7f4672ffd640 1 -- 172.21.15.79:0/1828660177 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620248ee040 con 0x5620248cf350 2024-08-20T01:46:50.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.230+0000 7f466bfff640 1 --2- 172.21.15.79:0/1828660177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620248cea30 0x5620248d9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:46:50.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.230+0000 7f4672ffd640 1 --2- 172.21.15.79:0/1828660177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620248cf350 0x5620248f32d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f46640268a0 tx=0x7f4664011440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a2648d9865c3e9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:50.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.230+0000 7f4668ff9640 1 -- 172.21.15.79:0/1828660177 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4664004320 con 0x5620248cf350 2024-08-20T01:46:50.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.230+0000 7f4668ff9640 1 -- 172.21.15.79:0/1828660177 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f466402d040 con 0x5620248cf350 2024-08-20T01:46:50.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.230+0000 7f4668ff9640 1 -- 172.21.15.79:0/1828660177 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46640053a0 con 0x5620248cf350 2024-08-20T01:46:50.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.231+0000 7f467bbeb740 1 -- 172.21.15.79:0/1828660177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620248cf350 msgr2=0x5620248f32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:50.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.231+0000 7f467bbeb740 1 --2- 172.21.15.79:0/1828660177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620248cf350 0x5620248f32d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f46640268a0 tx=0x7f4664011440 comp rx=0 tx=0).stop 2024-08-20T01:46:50.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.231+0000 7f467bbeb740 1 -- 172.21.15.79:0/1828660177 shutdown_connections 2024-08-20T01:46:50.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.231+0000 7f467bbeb740 1 --2- 172.21.15.79:0/1828660177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620248db2e0 0x5620248f3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:50.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.231+0000 7f467bbeb740 1 --2- 172.21.15.79:0/1828660177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620248cf350 0x5620248f32d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:50.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.231+0000 7f467bbeb740 1 --2- 172.21.15.79:0/1828660177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620248cea30 0x5620248d9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:50.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.231+0000 7f467bbeb740 1 -- 172.21.15.79:0/1828660177 >> 172.21.15.79:0/1828660177 conn(0x5620248cc860 msgr2=0x5620248d98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:50.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.232+0000 7f467bbeb740 1 -- 172.21.15.79:0/1828660177 shutdown_connections 2024-08-20T01:46:50.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.232+0000 7f467bbeb740 1 -- 172.21.15.79:0/1828660177 wait complete. 2024-08-20T01:46:50.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.232+0000 7f467bbeb740 1 -- start start 2024-08-20T01:46:50.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.232+0000 7f467bbeb740 1 Processor -- start 2024-08-20T01:46:50.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.233+0000 7f467bbeb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620248cea30 0x5620248e36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:50.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.233+0000 7f467bbeb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620248cf350 0x5620248deb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:50.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.233+0000 7f467bbeb740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620248db2e0 0x5620248df0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:50.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.233+0000 7f467bbeb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f46741b5780 con 0x5620248cf350 2024-08-20T01:46:50.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.233+0000 7f467bbeb740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f46741b4ff0 con 0x5620248db2e0 2024-08-20T01:46:50.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.233+0000 7f467bbeb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f46741b22e0 con 0x5620248cea30 2024-08-20T01:46:50.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.233+0000 7f467bbeb740 10 client.0 _ll_register_callbacks cb 0x7f46640097d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:46:50.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.233+0000 7f4672ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620248cf350 0x5620248deb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:50.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.233+0000 7f466bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620248db2e0 0x5620248df0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:50.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.233+0000 7f4672ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620248cf350 0x5620248deb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43898/0 (socket says 172.21.15.79:43898) 2024-08-20T01:46:50.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.233+0000 7f466bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620248db2e0 0x5620248df0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:49202/0 (socket says 172.21.15.79:49202) 2024-08-20T01:46:50.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.233+0000 7f4672ffd640 1 -- 172.21.15.79:0/1537814865 learned_addr learned my addr 172.21.15.79:0/1537814865 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:50.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.233+0000 7f466bfff640 1 --2- 172.21.15.79:0/1537814865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620248cea30 0x5620248e36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:50.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.233+0000 7f4672ffd640 1 -- 172.21.15.79:0/1537814865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620248cea30 msgr2=0x5620248e36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:50.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.233+0000 7f4672ffd640 1 --2- 172.21.15.79:0/1537814865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620248cea30 0x5620248e36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:50.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.233+0000 7f4672ffd640 1 -- 172.21.15.79:0/1537814865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620248db2e0 msgr2=0x5620248df0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:50.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.233+0000 7f4672ffd640 1 --2- 172.21.15.79:0/1537814865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620248db2e0 0x5620248df0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:50.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.233+0000 7f4672ffd640 1 -- 172.21.15.79:0/1537814865 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620248cd2e0 con 0x5620248cf350 2024-08-20T01:46:50.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.233+0000 7f466bfff640 1 --2- 172.21.15.79:0/1537814865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620248db2e0 0x5620248df0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:46:50.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.233+0000 7f4672ffd640 1 --2- 172.21.15.79:0/1537814865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620248cf350 0x5620248deb90 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f4664012b10 tx=0x7f46640052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f38b51a0b10e85d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:50.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.234+0000 7f465a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:46:50.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.234+0000 7f465a7fc640 1 -- 172.21.15.79:0/1537814865 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4664004320 con 0x5620248cf350 2024-08-20T01:46:50.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.234+0000 7f465a7fc640 1 -- 172.21.15.79:0/1537814865 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f46640035f0 con 0x5620248cf350 2024-08-20T01:46:50.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.234+0000 7f467bbeb740 1 -- 172.21.15.79:0/1537814865 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f466402d040 con 0x5620248cf350 2024-08-20T01:46:50.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.235+0000 7f465a7fc640 1 -- 172.21.15.79:0/1537814865 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f46640037f0 con 0x5620248cf350 2024-08-20T01:46:50.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.235+0000 7f467bbeb740 10 client.18099 fetch_fsmap learned FSMap version 45 2024-08-20T01:46:50.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.235+0000 7f467bbeb740 1 -- 172.21.15.79:0/1537814865 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x562024955f10 con 0x5620248cf350 2024-08-20T01:46:50.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.235+0000 7f465a7fc640 1 -- 172.21.15.79:0/1537814865 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f466402d040 con 0x5620248cf350 2024-08-20T01:46:50.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.235+0000 7f465a7fc640 1 -- 172.21.15.79:0/1537814865 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 45) ==== 8378+0+0 (secure 0 0 0) 0x7f4664011940 con 0x5620248cf350 2024-08-20T01:46:50.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.235+0000 7f467bbeb740 10 client.18099 fetch_fsmap finished waiting for FSMap version 45 2024-08-20T01:46:50.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.235+0000 7f467bbeb740 10 client.18099 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:46:50.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.235+0000 7f467bbeb740 20 client.18099 populate_metadata read hostname 'smithi079' 2024-08-20T01:46:50.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.235+0000 7f467bbeb740 1 --2- 172.21.15.79:0/1537814865 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x5620249565b0 0x5620249589d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:50.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.235+0000 7f467bbeb740 4 client.18099 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:46:50.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.235+0000 7f467bbeb740 1 -- 172.21.15.79:0/1537814865 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562024843320 con 0x5620249565b0 2024-08-20T01:46:50.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.236+0000 7f466bfff640 1 --2- 172.21.15.79:0/1537814865 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x5620249565b0 0x5620249589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:50.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.238+0000 7f466bfff640 1 --2- 172.21.15.79:0/1537814865 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x5620249565b0 0x5620249589d0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2dd94bc57296a9eb server_cookie=38a7329aef3aaf37 in_seq=0 out_seq=0 2024-08-20T01:46:50.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.239+0000 7f465a7fc640 10 client.18099 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:46:50.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.239+0000 7f465a7fc640 1 -- 172.21.15.79:0/1537814865 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562024843320 con 0x5620249565b0 2024-08-20T01:46:50.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.239+0000 7f465a7fc640 10 client.18099 handle_command_reply: tid=0 2024-08-20T01:46:50.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.239+0000 7f467bbeb740 1 client.18099 shutdown 2024-08-20T01:46:50.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.240+0000 7f467bbeb740 1 -- 172.21.15.79:0/1537814865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620248cf350 msgr2=0x5620248deb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:50.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.240+0000 7f467bbeb740 1 --2- 172.21.15.79:0/1537814865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620248cf350 0x5620248deb90 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f4664012b10 tx=0x7f46640052f0 comp rx=0 tx=0).stop 2024-08-20T01:46:50.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.240+0000 7f467bbeb740 1 -- 172.21.15.79:0/1537814865 shutdown_connections 2024-08-20T01:46:50.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.240+0000 7f467bbeb740 1 --2- 172.21.15.79:0/1537814865 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x5620249565b0 0x5620249589d0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:50.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.240+0000 7f467bbeb740 1 --2- 172.21.15.79:0/1537814865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620248db2e0 0x5620248df0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:50.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.240+0000 7f467bbeb740 1 --2- 172.21.15.79:0/1537814865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620248cf350 0x5620248deb90 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:50.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.240+0000 7f465a7fc640 0 client.18099 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:46:50.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.240+0000 7f467bbeb740 1 --2- 172.21.15.79:0/1537814865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620248cea30 0x5620248e36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:50.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.240+0000 7f467bbeb740 1 -- 172.21.15.79:0/1537814865 >> 172.21.15.79:0/1537814865 conn(0x5620248cc860 msgr2=0x5620248da0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:50.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.240+0000 7f467bbeb740 1 -- 172.21.15.79:0/1537814865 shutdown_connections 2024-08-20T01:46:50.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.240+0000 7f467bbeb740 1 -- 172.21.15.79:0/1537814865 wait complete. 2024-08-20T01:46:50.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.240+0000 7f467bbeb740 20 client.18099 trim_cache size 0 max 16384 2024-08-20T01:46:50.246 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:46:50.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.241+0000 7f4673fff640 1 -- 172.21.15.79:0/225062045 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f46600b3c70 msgr2=0x7f46600b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:50.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.241+0000 7f4673fff640 1 --2- 172.21.15.79:0/225062045 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f46600b3c70 0x7f46600b6130 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f466c00bfd0 tx=0x7f466c00c610 comp rx=0 tx=0).stop 2024-08-20T01:46:50.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.241+0000 7f4673fff640 1 -- 172.21.15.79:0/225062045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f467410aea0 msgr2=0x7f4674077e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:50.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.241+0000 7f4673fff640 1 --2- 172.21.15.79:0/225062045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f467410aea0 0x7f4674077e60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f466c00b990 tx=0x7f466c00be50 comp rx=0 tx=0).stop 2024-08-20T01:46:50.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.242+0000 7f4673fff640 1 -- 172.21.15.79:0/225062045 shutdown_connections 2024-08-20T01:46:50.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.242+0000 7f4673fff640 1 --2- 172.21.15.79:0/225062045 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f46600b3c70 0x7f46600b6130 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:50.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.242+0000 7f4673fff640 1 --2- 172.21.15.79:0/225062045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f467410aea0 0x7f4674077e60 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:50.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.242+0000 7f4673fff640 1 --2- 172.21.15.79:0/225062045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f467410a520 0x7f4674077920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:50.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.242+0000 7f4673fff640 1 --2- 172.21.15.79:0/225062045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4674104b10 0x7f46740773e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:50.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.242+0000 7f4673fff640 1 -- 172.21.15.79:0/225062045 >> 172.21.15.79:0/225062045 conn(0x7f4674100540 msgr2=0x7f4674100de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:50.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.242+0000 7f4673fff640 1 -- 172.21.15.79:0/225062045 shutdown_connections 2024-08-20T01:46:50.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:50.242+0000 7f4673fff640 1 -- 172.21.15.79:0/225062045 wait complete. 2024-08-20T01:46:50.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:50 smithi081 ceph-mon[22209]: pgmap v632: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 28 MiB/s wr, 7.19k op/s 2024-08-20T01:46:50.797 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:50 smithi079 ceph-mon[18656]: pgmap v632: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 28 MiB/s wr, 7.19k op/s 2024-08-20T01:46:50.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:50 smithi175 ceph-mon[22392]: pgmap v632: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 28 MiB/s wr, 7.19k op/s 2024-08-20T01:46:51.396 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-20T01:46:51.860 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:46:52.016 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.013+0000 7f44a7afd640 1 -- 172.21.15.79:0/3020731718 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44a010a7c0 msgr2=0x7f44a0111140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:52.017 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.013+0000 7f44a7afd640 1 --2- 172.21.15.79:0/3020731718 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44a010a7c0 0x7f44a0111140 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f4498009cd0 tx=0x7f449802a8e0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.017 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.014+0000 7f44a7afd640 1 -- 172.21.15.79:0/3020731718 shutdown_connections 2024-08-20T01:46:52.017 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.014+0000 7f44a7afd640 1 --2- 172.21.15.79:0/3020731718 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44a010a7c0 0x7f44a0111140 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.017 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.014+0000 7f44a7afd640 1 --2- 172.21.15.79:0/3020731718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44a0109e00 0x7f44a010a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.017 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.014+0000 7f44a7afd640 1 --2- 172.21.15.79:0/3020731718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44a0108f60 0x7f44a0109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.017 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.014+0000 7f44a7afd640 1 -- 172.21.15.79:0/3020731718 >> 172.21.15.79:0/3020731718 conn(0x7f44a00780d0 msgr2=0x7f44a007a510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:52.017 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.014+0000 7f44a7afd640 1 -- 172.21.15.79:0/3020731718 shutdown_connections 2024-08-20T01:46:52.017 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.014+0000 7f44a7afd640 1 -- 172.21.15.79:0/3020731718 wait complete. 2024-08-20T01:46:52.019 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.015+0000 7f44a7afd640 1 Processor -- start 2024-08-20T01:46:52.019 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.015+0000 7f44a7afd640 1 -- start start 2024-08-20T01:46:52.020 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.015+0000 7f44a7afd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44a0108f60 0x7f44a019ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:52.020 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.015+0000 7f44a7afd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44a0109e00 0x7f44a019f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:52.020 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.015+0000 7f44a7afd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44a010a7c0 0x7f44a019fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:52.020 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.015+0000 7f44a7afd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f44a01147d0 con 0x7f44a0109e00 2024-08-20T01:46:52.020 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.015+0000 7f44a7afd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f44a0114650 con 0x7f44a0108f60 2024-08-20T01:46:52.020 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.015+0000 7f44a7afd640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f44a0114950 con 0x7f44a010a7c0 2024-08-20T01:46:52.020 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.015+0000 7f44a5098640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44a0109e00 0x7f44a019f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:52.020 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.015+0000 7f44a5899640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44a0108f60 0x7f44a019ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:52.020 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.015+0000 7f44a5098640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44a0109e00 0x7f44a019f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55362/0 (socket says 172.21.15.79:55362) 2024-08-20T01:46:52.020 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.015+0000 7f44a5098640 1 -- 172.21.15.79:0/2049689610 learned_addr learned my addr 172.21.15.79:0/2049689610 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:52.020 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.015+0000 7f44a609a640 1 --2- 172.21.15.79:0/2049689610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44a010a7c0 0x7f44a019fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:52.021 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.016+0000 7f44a5899640 1 -- 172.21.15.79:0/2049689610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44a010a7c0 msgr2=0x7f44a019fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:52.021 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.016+0000 7f44a5899640 1 --2- 172.21.15.79:0/2049689610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44a010a7c0 0x7f44a019fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.021 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.016+0000 7f44a5899640 1 -- 172.21.15.79:0/2049689610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44a0109e00 msgr2=0x7f44a019f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:52.021 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.016+0000 7f44a5899640 1 --2- 172.21.15.79:0/2049689610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44a0109e00 0x7f44a019f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.021 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.016+0000 7f44a5899640 1 -- 172.21.15.79:0/2049689610 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44a01a08b0 con 0x7f44a0108f60 2024-08-20T01:46:52.021 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.016+0000 7f44a5098640 1 --2- 172.21.15.79:0/2049689610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44a0109e00 0x7f44a019f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:46:52.021 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.016+0000 7f44a5899640 1 --2- 172.21.15.79:0/2049689610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44a0108f60 0x7f44a019ed70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f449c00e9f0 tx=0x7f449c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:52.021 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.017+0000 7f4496ffd640 1 -- 172.21.15.79:0/2049689610 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f449c00cc40 con 0x7f44a0108f60 2024-08-20T01:46:52.021 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.017+0000 7f4496ffd640 1 -- 172.21.15.79:0/2049689610 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f449c00cde0 con 0x7f44a0108f60 2024-08-20T01:46:52.021 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.017+0000 7f4496ffd640 1 -- 172.21.15.79:0/2049689610 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f449c004a00 con 0x7f44a0108f60 2024-08-20T01:46:52.022 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.017+0000 7f44a7afd640 1 -- 172.21.15.79:0/2049689610 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44a01a0ba0 con 0x7f44a0108f60 2024-08-20T01:46:52.022 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.017+0000 7f44a7afd640 1 -- 172.21.15.79:0/2049689610 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44a01a7270 con 0x7f44a0108f60 2024-08-20T01:46:52.023 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.020+0000 7f4496ffd640 1 -- 172.21.15.79:0/2049689610 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f449c004ba0 con 0x7f44a0108f60 2024-08-20T01:46:52.023 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.021+0000 7f44aa9ca740 1 Processor -- start 2024-08-20T01:46:52.025 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.021+0000 7f44aa9ca740 1 -- start start 2024-08-20T01:46:52.025 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.022+0000 7f44aa9ca740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564afc5448d0 0x564afc546cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:52.025 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.022+0000 7f44aa9ca740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564afc547200 0x564afc5495f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:52.025 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.022+0000 7f44aa9ca740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564afc549c40 0x564afc54c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:52.025 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.022+0000 7f44a5899640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564afc547200 0x564afc5495f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:52.025 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.022+0000 7f44a5899640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564afc547200 0x564afc5495f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:42012/0 (socket says 172.21.15.79:42012) 2024-08-20T01:46:52.026 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.022+0000 7f4496ffd640 1 --2- 172.21.15.79:0/2049689610 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f448c0b3d60 0x7f448c0b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:52.026 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.023+0000 7f44a5098640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564afc549c40 0x564afc54c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:52.026 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.023+0000 7f44a5098640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564afc549c40 0x564afc54c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:45482/0 (socket says 172.21.15.79:45482) 2024-08-20T01:46:52.026 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.023+0000 7f4496ffd640 1 -- 172.21.15.79:0/2049689610 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f449c0e3a70 con 0x7f44a0108f60 2024-08-20T01:46:52.026 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.023+0000 7f44a609a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564afc5448d0 0x564afc546cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:52.026 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.023+0000 7f44a609a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564afc5448d0 0x564afc546cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55378/0 (socket says 172.21.15.79:55378) 2024-08-20T01:46:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.023+0000 7f44aa9ca740 1 -- 172.21.15.79:0/3313166191 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564afc4b7360 con 0x564afc5448d0 2024-08-20T01:46:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.023+0000 7f44a5899640 1 -- 172.21.15.79:0/3313166191 learned_addr learned my addr 172.21.15.79:0/3313166191 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.023+0000 7f44aa9ca740 1 -- 172.21.15.79:0/3313166191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564afc4a6860 con 0x564afc547200 2024-08-20T01:46:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.023+0000 7f44aa9ca740 1 -- 172.21.15.79:0/3313166191 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564afc4aa8a0 con 0x564afc549c40 2024-08-20T01:46:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.024+0000 7f44a609a640 1 --2- 172.21.15.79:0/2049689610 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f448c0b3d60 0x7f448c0b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.024+0000 7f44a609a640 1 -- 172.21.15.79:0/3313166191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564afc549c40 msgr2=0x564afc54c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.024+0000 7f44a609a640 1 --2- 172.21.15.79:0/3313166191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564afc549c40 0x564afc54c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.024+0000 7f44a609a640 1 -- 172.21.15.79:0/3313166191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564afc547200 msgr2=0x564afc5495f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.024+0000 7f44a609a640 1 --2- 172.21.15.79:0/3313166191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564afc547200 0x564afc5495f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.024+0000 7f44a609a640 1 -- 172.21.15.79:0/3313166191 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564afc44de40 con 0x564afc5448d0 2024-08-20T01:46:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.024+0000 7f44a5098640 1 --2- 172.21.15.79:0/3313166191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564afc549c40 0x564afc54c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:46:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.024+0000 7f44a5899640 1 --2- 172.21.15.79:0/3313166191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564afc547200 0x564afc5495f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:46:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.024+0000 7f44a609a640 1 --2- 172.21.15.79:0/3313166191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564afc5448d0 0x564afc546cc0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f4498009bf0 tx=0x7f4498009980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57297e53eda4e049 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.025+0000 7f44a609a640 1 --2- 172.21.15.79:0/2049689610 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f448c0b3d60 0x7f448c0b6220 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4498005e30 tx=0x7f449804b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.025+0000 7f448bfff640 1 -- 172.21.15.79:0/3313166191 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4498031ad0 con 0x564afc5448d0 2024-08-20T01:46:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.025+0000 7f448bfff640 1 -- 172.21.15.79:0/3313166191 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f449804e070 con 0x564afc5448d0 2024-08-20T01:46:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.025+0000 7f448bfff640 1 -- 172.21.15.79:0/3313166191 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4498030b00 con 0x564afc5448d0 2024-08-20T01:46:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.026+0000 7f44aa9ca740 1 -- 172.21.15.79:0/3313166191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564afc5448d0 msgr2=0x564afc546cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.026+0000 7f44aa9ca740 1 --2- 172.21.15.79:0/3313166191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564afc5448d0 0x564afc546cc0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f4498009bf0 tx=0x7f4498009980 comp rx=0 tx=0).stop 2024-08-20T01:46:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.026+0000 7f44aa9ca740 1 -- 172.21.15.79:0/3313166191 shutdown_connections 2024-08-20T01:46:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.026+0000 7f44aa9ca740 1 --2- 172.21.15.79:0/3313166191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564afc549c40 0x564afc54c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.026+0000 7f44aa9ca740 1 --2- 172.21.15.79:0/3313166191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564afc547200 0x564afc5495f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.026+0000 7f44aa9ca740 1 --2- 172.21.15.79:0/3313166191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564afc5448d0 0x564afc546cc0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.036 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.026+0000 7f44aa9ca740 1 -- 172.21.15.79:0/3313166191 >> 172.21.15.79:0/3313166191 conn(0x564afc53fa20 msgr2=0x564afc5407b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:52.036 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.026+0000 7f44aa9ca740 1 -- 172.21.15.79:0/3313166191 shutdown_connections 2024-08-20T01:46:52.036 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.026+0000 7f44aa9ca740 1 -- 172.21.15.79:0/3313166191 wait complete. 2024-08-20T01:46:52.036 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.027+0000 7f44aa9ca740 1 -- start start 2024-08-20T01:46:52.036 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.027+0000 7f44aa9ca740 1 Processor -- start 2024-08-20T01:46:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.027+0000 7f44aa9ca740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564afc5448d0 0x564afc54e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.027+0000 7f44aa9ca740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564afc547200 0x564afc54e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.027+0000 7f44aa9ca740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564afc549c40 0x564afc54f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.027+0000 7f44aa9ca740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564afc3dfab0 con 0x564afc547200 2024-08-20T01:46:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.027+0000 7f44aa9ca740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564afc42d780 con 0x564afc549c40 2024-08-20T01:46:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.027+0000 7f44aa9ca740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564afc54cc20 con 0x564afc5448d0 2024-08-20T01:46:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.027+0000 7f44aa9ca740 10 client.0 _ll_register_callbacks cb 0x564afc1b5a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:46:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.027+0000 7f44a5098640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564afc547200 0x564afc54e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.027+0000 7f44a5899640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564afc5448d0 0x564afc54e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.027+0000 7f44a5899640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564afc5448d0 0x564afc54e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:45484/0 (socket says 172.21.15.79:45484) 2024-08-20T01:46:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.027+0000 7f44a5899640 1 -- 172.21.15.79:0/2033685791 learned_addr learned my addr 172.21.15.79:0/2033685791 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.028+0000 7f44a609a640 1 --2- 172.21.15.79:0/2033685791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564afc549c40 0x564afc54f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.028+0000 7f44a5899640 1 -- 172.21.15.79:0/2033685791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564afc549c40 msgr2=0x564afc54f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.028+0000 7f44a5899640 1 --2- 172.21.15.79:0/2033685791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564afc549c40 0x564afc54f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.028+0000 7f44a5899640 1 -- 172.21.15.79:0/2033685791 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564afc547200 msgr2=0x564afc54e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.028+0000 7f44a5899640 1 --2- 172.21.15.79:0/2033685791 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564afc547200 0x564afc54e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.028+0000 7f44a5899640 1 -- 172.21.15.79:0/2033685791 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564afc209790 con 0x564afc5448d0 2024-08-20T01:46:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.028+0000 7f44a5899640 1 --2- 172.21.15.79:0/2033685791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564afc5448d0 0x564afc54e120 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f449c0aa670 tx=0x7f449c0aa7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f18f666834f77be server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:52.039 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.028+0000 7f44897fa640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:46:52.039 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.029+0000 7f44897fa640 1 -- 172.21.15.79:0/2033685791 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f449c0e3e60 con 0x564afc5448d0 2024-08-20T01:46:52.039 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.029+0000 7f44897fa640 1 -- 172.21.15.79:0/2033685791 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f449c0b3590 con 0x564afc5448d0 2024-08-20T01:46:52.039 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.029+0000 7f44aa9ca740 1 -- 172.21.15.79:0/2033685791 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564afc455e00 con 0x564afc5448d0 2024-08-20T01:46:52.039 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.030+0000 7f44897fa640 1 -- 172.21.15.79:0/2033685791 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f449c01c040 con 0x564afc5448d0 2024-08-20T01:46:52.039 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.030+0000 7f44aa9ca740 10 client.27094 fetch_fsmap learned FSMap version 45 2024-08-20T01:46:52.039 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.030+0000 7f44aa9ca740 1 -- 172.21.15.79:0/2033685791 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x564afc282620 con 0x564afc5448d0 2024-08-20T01:46:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.031+0000 7f44897fa640 1 -- 172.21.15.79:0/2033685791 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f449c0b3360 con 0x564afc5448d0 2024-08-20T01:46:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.031+0000 7f44897fa640 1 -- 172.21.15.79:0/2033685791 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 45) ==== 8378+0+0 (secure 0 0 0) 0x7f449c0b3040 con 0x564afc5448d0 2024-08-20T01:46:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.031+0000 7f44aa9ca740 10 client.27094 fetch_fsmap finished waiting for FSMap version 45 2024-08-20T01:46:52.042 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.031+0000 7f44aa9ca740 10 client.27094 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:46:52.042 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.031+0000 7f44aa9ca740 20 client.27094 populate_metadata read hostname 'smithi079' 2024-08-20T01:46:52.042 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.031+0000 7f44aa9ca740 1 --2- 172.21.15.79:0/2033685791 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564afc5599b0 0x564afc55bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:52.042 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.031+0000 7f44aa9ca740 4 client.27094 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:46:52.042 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.031+0000 7f44aa9ca740 1 -- 172.21.15.79:0/2033685791 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564afc455e00 con 0x564afc5599b0 2024-08-20T01:46:52.042 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.032+0000 7f44a5098640 1 --2- 172.21.15.79:0/2033685791 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564afc5599b0 0x564afc55bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:52.042 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.034+0000 7f44a5098640 1 --2- 172.21.15.79:0/2033685791 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564afc5599b0 0x564afc55bde0 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1f1bad8628033ec server_cookie=cb70e4e693c77f4c in_seq=0 out_seq=0 2024-08-20T01:46:52.042 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.035+0000 7f44897fa640 10 client.27094 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:46:52.042 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.035+0000 7f44897fa640 1 -- 172.21.15.79:0/2033685791 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564afc455e00 con 0x564afc5599b0 2024-08-20T01:46:52.042 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.035+0000 7f44897fa640 10 client.27094 handle_command_reply: tid=0 2024-08-20T01:46:52.042 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.035+0000 7f44aa9ca740 1 client.27094 shutdown 2024-08-20T01:46:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.035+0000 7f44aa9ca740 1 -- 172.21.15.79:0/2033685791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564afc5448d0 msgr2=0x564afc54e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.035+0000 7f44aa9ca740 1 --2- 172.21.15.79:0/2033685791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564afc5448d0 0x564afc54e120 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f449c0aa670 tx=0x7f449c0aa7c0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.035+0000 7f44aa9ca740 1 -- 172.21.15.79:0/2033685791 shutdown_connections 2024-08-20T01:46:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.035+0000 7f44aa9ca740 1 --2- 172.21.15.79:0/2033685791 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564afc5599b0 0x564afc55bde0 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.035+0000 7f44aa9ca740 1 --2- 172.21.15.79:0/2033685791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564afc549c40 0x564afc54f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.035+0000 7f44aa9ca740 1 --2- 172.21.15.79:0/2033685791 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564afc547200 0x564afc54e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.036+0000 7f44aa9ca740 1 --2- 172.21.15.79:0/2033685791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564afc5448d0 0x564afc54e120 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.036+0000 7f44aa9ca740 1 -- 172.21.15.79:0/2033685791 >> 172.21.15.79:0/2033685791 conn(0x564afc53fa20 msgr2=0x564afc53eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.036+0000 7f44897fa640 0 client.27094 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:46:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.036+0000 7f44aa9ca740 1 -- 172.21.15.79:0/2033685791 shutdown_connections 2024-08-20T01:46:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.037+0000 7f44aa9ca740 1 -- 172.21.15.79:0/2033685791 wait complete. 2024-08-20T01:46:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.037+0000 7f44aa9ca740 20 client.27094 trim_cache size 0 max 16384 2024-08-20T01:46:52.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.069+0000 7f44aa9ca740 1 Processor -- start 2024-08-20T01:46:52.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.069+0000 7f44aa9ca740 1 -- start start 2024-08-20T01:46:52.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.070+0000 7f44aa9ca740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564afc5448d0 0x564afc540440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:52.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.070+0000 7f44aa9ca740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564afc547200 0x564afc54a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:52.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.070+0000 7f44aa9ca740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564afc549c40 0x564afc54a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:52.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.070+0000 7f44a5098640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564afc547200 0x564afc54a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:52.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.070+0000 7f44a5098640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564afc547200 0x564afc54a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:42038/0 (socket says 172.21.15.79:42038) 2024-08-20T01:46:52.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.070+0000 7f44a5899640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564afc5448d0 0x564afc540440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:52.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.070+0000 7f44a5899640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564afc5448d0 0x564afc540440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:45492/0 (socket says 172.21.15.79:45492) 2024-08-20T01:46:52.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.070+0000 7f44a5098640 1 -- 172.21.15.79:0/1757466418 learned_addr learned my addr 172.21.15.79:0/1757466418 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:52.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.070+0000 7f44aa9ca740 1 -- 172.21.15.79:0/1757466418 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f44a01b00b0 con 0x564afc549c40 2024-08-20T01:46:52.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.070+0000 7f44aa9ca740 1 -- 172.21.15.79:0/1757466418 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f44a01b1cb0 con 0x564afc547200 2024-08-20T01:46:52.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.070+0000 7f44aa9ca740 1 -- 172.21.15.79:0/1757466418 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f44a01b0780 con 0x564afc5448d0 2024-08-20T01:46:52.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.070+0000 7f44a609a640 1 --2- 172.21.15.79:0/1757466418 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564afc549c40 0x564afc54a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:52.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.070+0000 7f44a5098640 1 -- 172.21.15.79:0/1757466418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564afc5448d0 msgr2=0x564afc540440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:52.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.070+0000 7f44a5098640 1 --2- 172.21.15.79:0/1757466418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564afc5448d0 0x564afc540440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.070+0000 7f44a5098640 1 -- 172.21.15.79:0/1757466418 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564afc549c40 msgr2=0x564afc54a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:52.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.070+0000 7f44a5098640 1 --2- 172.21.15.79:0/1757466418 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564afc549c40 0x564afc54a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.071+0000 7f44a5098640 1 -- 172.21.15.79:0/1757466418 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564afc547030 con 0x564afc547200 2024-08-20T01:46:52.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.071+0000 7f44a609a640 1 --2- 172.21.15.79:0/1757466418 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564afc549c40 0x564afc54a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:46:52.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.071+0000 7f44a5098640 1 --2- 172.21.15.79:0/1757466418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564afc547200 0x564afc54a020 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4490012730 tx=0x7f4490005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad12c5a9a2959e37 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:52.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.071+0000 7f448b7fe640 1 -- 172.21.15.79:0/1757466418 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f449000f890 con 0x564afc547200 2024-08-20T01:46:52.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.071+0000 7f448b7fe640 1 -- 172.21.15.79:0/1757466418 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4490005020 con 0x564afc547200 2024-08-20T01:46:52.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.071+0000 7f448b7fe640 1 -- 172.21.15.79:0/1757466418 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4490004a00 con 0x564afc547200 2024-08-20T01:46:52.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.072+0000 7f44aa9ca740 1 -- 172.21.15.79:0/1757466418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564afc547200 msgr2=0x564afc54a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:52.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.072+0000 7f44aa9ca740 1 --2- 172.21.15.79:0/1757466418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564afc547200 0x564afc54a020 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4490012730 tx=0x7f4490005f90 comp rx=0 tx=0).stop 2024-08-20T01:46:52.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.072+0000 7f44aa9ca740 1 -- 172.21.15.79:0/1757466418 shutdown_connections 2024-08-20T01:46:52.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.073+0000 7f44aa9ca740 1 --2- 172.21.15.79:0/1757466418 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564afc549c40 0x564afc54a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.073+0000 7f44aa9ca740 1 --2- 172.21.15.79:0/1757466418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564afc547200 0x564afc54a020 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.073+0000 7f44aa9ca740 1 --2- 172.21.15.79:0/1757466418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564afc5448d0 0x564afc540440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.073+0000 7f44aa9ca740 1 -- 172.21.15.79:0/1757466418 >> 172.21.15.79:0/1757466418 conn(0x564afc53fa20 msgr2=0x564afc54b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:52.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.073+0000 7f44aa9ca740 1 -- 172.21.15.79:0/1757466418 shutdown_connections 2024-08-20T01:46:52.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.073+0000 7f44aa9ca740 1 -- 172.21.15.79:0/1757466418 wait complete. 2024-08-20T01:46:52.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.074+0000 7f44aa9ca740 1 -- start start 2024-08-20T01:46:52.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.074+0000 7f44aa9ca740 1 Processor -- start 2024-08-20T01:46:52.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.075+0000 7f44aa9ca740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564afc5448d0 0x564afc5559a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:52.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.075+0000 7f44aa9ca740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564afc547200 0x564afc5546a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:52.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.075+0000 7f44aa9ca740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564afc549c40 0x564afc554be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:52.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.075+0000 7f44aa9ca740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f44a01b15e0 con 0x564afc549c40 2024-08-20T01:46:52.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.075+0000 7f44aa9ca740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f44a01b0e50 con 0x564afc5448d0 2024-08-20T01:46:52.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.075+0000 7f44aa9ca740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f44a01ae090 con 0x564afc547200 2024-08-20T01:46:52.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.075+0000 7f44aa9ca740 10 client.0 _ll_register_callbacks cb 0x7f449c0a6830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:46:52.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.075+0000 7f44a5098640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564afc547200 0x564afc5546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:52.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.075+0000 7f44a5899640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564afc5448d0 0x564afc5559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:52.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.075+0000 7f44a5098640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564afc547200 0x564afc5546a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:45504/0 (socket says 172.21.15.79:45504) 2024-08-20T01:46:52.080 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.075+0000 7f44a5098640 1 -- 172.21.15.79:0/1359679212 learned_addr learned my addr 172.21.15.79:0/1359679212 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:52.080 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.075+0000 7f44a609a640 1 --2- 172.21.15.79:0/1359679212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564afc549c40 0x564afc554be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:52.080 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.075+0000 7f44a5098640 1 -- 172.21.15.79:0/1359679212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564afc5448d0 msgr2=0x564afc5559a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:52.080 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.075+0000 7f44a5098640 1 --2- 172.21.15.79:0/1359679212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564afc5448d0 0x564afc5559a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.080 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.075+0000 7f44a5098640 1 -- 172.21.15.79:0/1359679212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564afc549c40 msgr2=0x564afc554be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:52.080 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.075+0000 7f44a5098640 1 --2- 172.21.15.79:0/1359679212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564afc549c40 0x564afc554be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.080 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.075+0000 7f44a5098640 1 -- 172.21.15.79:0/1359679212 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564afc5551a0 con 0x564afc547200 2024-08-20T01:46:52.080 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.075+0000 7f44a609a640 1 --2- 172.21.15.79:0/1359679212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564afc549c40 0x564afc554be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:46:52.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.076+0000 7f44a5098640 1 --2- 172.21.15.79:0/1359679212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564afc547200 0x564afc5546a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4490005400 tx=0x7f4490005430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74f68e7a7a2f9f21 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:52.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.076+0000 7f44897fa640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:46:52.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.076+0000 7f44897fa640 1 -- 172.21.15.79:0/1359679212 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f449000f890 con 0x564afc547200 2024-08-20T01:46:52.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.076+0000 7f44897fa640 1 -- 172.21.15.79:0/1359679212 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f449000fa30 con 0x564afc547200 2024-08-20T01:46:52.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.076+0000 7f44aa9ca740 1 -- 172.21.15.79:0/1359679212 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4490005020 con 0x564afc547200 2024-08-20T01:46:52.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.076+0000 7f44897fa640 1 -- 172.21.15.79:0/1359679212 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f449000fc70 con 0x564afc547200 2024-08-20T01:46:52.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.076+0000 7f44aa9ca740 10 client.27100 fetch_fsmap learned FSMap version 45 2024-08-20T01:46:52.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.077+0000 7f44aa9ca740 1 -- 172.21.15.79:0/1359679212 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x564afc553ff0 con 0x564afc547200 2024-08-20T01:46:52.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.077+0000 7f44897fa640 1 -- 172.21.15.79:0/1359679212 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4490005020 con 0x564afc547200 2024-08-20T01:46:52.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.077+0000 7f44897fa640 1 -- 172.21.15.79:0/1359679212 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 45) ==== 8378+0+0 (secure 0 0 0) 0x7f4490010540 con 0x564afc547200 2024-08-20T01:46:52.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.077+0000 7f44aa9ca740 10 client.27100 fetch_fsmap finished waiting for FSMap version 45 2024-08-20T01:46:52.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.077+0000 7f44aa9ca740 10 client.27100 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:46:52.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.077+0000 7f44aa9ca740 20 client.27100 populate_metadata read hostname 'smithi079' 2024-08-20T01:46:52.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.077+0000 7f44aa9ca740 1 --2- 172.21.15.79:0/1359679212 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564afc5c4e30 0x564afc5c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:52.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.078+0000 7f44aa9ca740 4 client.27100 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:46:52.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.078+0000 7f44aa9ca740 1 -- 172.21.15.79:0/1359679212 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564afc4b92b0 con 0x564afc5c4e30 2024-08-20T01:46:52.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.078+0000 7f44a5899640 1 --2- 172.21.15.79:0/1359679212 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564afc5c4e30 0x564afc5c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:52.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.079+0000 7f44a5899640 1 --2- 172.21.15.79:0/1359679212 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564afc5c4e30 0x564afc5c7250 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f97dba1174928f9c server_cookie=1a915f7091dc84ec in_seq=0 out_seq=0 2024-08-20T01:46:52.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:52.079+0000 7f44897fa640 10 client.27100 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:46:52.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.488+0000 7fdc93514640 1 -- 172.21.15.79:0/1493938645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc8c101990 msgr2=0x7fdc8c101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:52.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.489+0000 7fdc93514640 1 --2- 172.21.15.79:0/1493938645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc8c101990 0x7fdc8c101d70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdc88009ca0 tx=0x7fdc8802a8b0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.489+0000 7fdc93514640 1 -- 172.21.15.79:0/1493938645 shutdown_connections 2024-08-20T01:46:52.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.489+0000 7fdc93514640 1 --2- 172.21.15.79:0/1493938645 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc8c107d20 0x7fdc8c10e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.489+0000 7fdc93514640 1 --2- 172.21.15.79:0/1493938645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc8c1073a0 0x7fdc8c1077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.489+0000 7fdc93514640 1 --2- 172.21.15.79:0/1493938645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc8c101990 0x7fdc8c101d70 secure :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdc88009ca0 tx=0x7fdc8802a8b0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.489+0000 7fdc93514640 1 -- 172.21.15.79:0/1493938645 >> 172.21.15.79:0/1493938645 conn(0x7fdc8c0fd400 msgr2=0x7fdc8c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:52.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.490+0000 7fdc93514640 1 -- 172.21.15.79:0/1493938645 shutdown_connections 2024-08-20T01:46:52.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.490+0000 7fdc93514640 1 -- 172.21.15.79:0/1493938645 wait complete. 2024-08-20T01:46:52.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.491+0000 7fdc93514640 1 Processor -- start 2024-08-20T01:46:52.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.491+0000 7fdc93514640 1 -- start start 2024-08-20T01:46:52.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.491+0000 7fdc93514640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc8c1073a0 0x7fdc8c19dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:52.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.491+0000 7fdc93514640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc8c107d20 0x7fdc8c196d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:52.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.491+0000 7fdc93514640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc8c197240 0x7fdc8c1976f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:52.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.491+0000 7fdc93514640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdc8c1107d0 con 0x7fdc8c1073a0 2024-08-20T01:46:52.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.491+0000 7fdc93514640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdc8c110650 con 0x7fdc8c197240 2024-08-20T01:46:52.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.491+0000 7fdc93514640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdc8c110950 con 0x7fdc8c107d20 2024-08-20T01:46:52.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.491+0000 7fdc912b0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc8c1073a0 0x7fdc8c19dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:52.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.491+0000 7fdc90aaf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc8c107d20 0x7fdc8c196d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:52.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.491+0000 7fdc912b0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc8c1073a0 0x7fdc8c19dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55414/0 (socket says 172.21.15.79:55414) 2024-08-20T01:46:52.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.491+0000 7fdc912b0640 1 -- 172.21.15.79:0/1323627005 learned_addr learned my addr 172.21.15.79:0/1323627005 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:52.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.491+0000 7fdc91ab1640 1 --2- 172.21.15.79:0/1323627005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc8c197240 0x7fdc8c1976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:52.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.493+0000 7fdc91ab1640 1 -- 172.21.15.79:0/1323627005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc8c107d20 msgr2=0x7fdc8c196d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:52.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.493+0000 7fdc91ab1640 1 --2- 172.21.15.79:0/1323627005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc8c107d20 0x7fdc8c196d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.493+0000 7fdc91ab1640 1 -- 172.21.15.79:0/1323627005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc8c1073a0 msgr2=0x7fdc8c19dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:52.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.493+0000 7fdc91ab1640 1 --2- 172.21.15.79:0/1323627005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc8c1073a0 0x7fdc8c19dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.493+0000 7fdc91ab1640 1 -- 172.21.15.79:0/1323627005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc8c19c7c0 con 0x7fdc8c197240 2024-08-20T01:46:52.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.493+0000 7fdc91ab1640 1 --2- 172.21.15.79:0/1323627005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc8c197240 0x7fdc8c1976f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdc8400d680 tx=0x7fdc8400db40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:52.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.493+0000 7fdc827fc640 1 -- 172.21.15.79:0/1323627005 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc84017070 con 0x7fdc8c197240 2024-08-20T01:46:52.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.493+0000 7fdc93514640 1 -- 172.21.15.79:0/1323627005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc8c19cab0 con 0x7fdc8c197240 2024-08-20T01:46:52.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.493+0000 7fdc827fc640 1 -- 172.21.15.79:0/1323627005 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdc84009820 con 0x7fdc8c197240 2024-08-20T01:46:52.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.493+0000 7fdc93514640 1 -- 172.21.15.79:0/1323627005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc8c19d040 con 0x7fdc8c197240 2024-08-20T01:46:52.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.493+0000 7fdc827fc640 1 -- 172.21.15.79:0/1323627005 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc84017070 con 0x7fdc8c197240 2024-08-20T01:46:52.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.496+0000 7fdc9590d740 1 Processor -- start 2024-08-20T01:46:52.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.497+0000 7fdc9590d740 1 -- start start 2024-08-20T01:46:52.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.497+0000 7fdc827fc640 1 -- 172.21.15.79:0/1323627005 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fdc84005220 con 0x7fdc8c197240 2024-08-20T01:46:52.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.498+0000 7fdc9590d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56317c7e0730 0x56317c7e0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:52.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.498+0000 7fdc9590d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56317c7e1050 0x56317c7ecaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:52.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.498+0000 7fdc9590d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56317c7ecfe0 0x56317c7ef3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:52.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.498+0000 7fdc9590d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56317c757930 con 0x56317c7e1050 2024-08-20T01:46:52.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.498+0000 7fdc9590d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56317c746e30 con 0x56317c7e0730 2024-08-20T01:46:52.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.498+0000 7fdc9590d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56317c74ae70 con 0x56317c7ecfe0 2024-08-20T01:46:52.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.498+0000 7fdc912b0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56317c7e1050 0x56317c7ecaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:52.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.498+0000 7fdc912b0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56317c7e1050 0x56317c7ecaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55430/0 (socket says 172.21.15.79:55430) 2024-08-20T01:46:52.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.498+0000 7fdc912b0640 1 -- 172.21.15.79:0/2530100190 learned_addr learned my addr 172.21.15.79:0/2530100190 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:52.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.498+0000 7fdc90aaf640 1 --2- 172.21.15.79:0/2530100190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56317c7ecfe0 0x56317c7ef3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:52.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.498+0000 7fdc90aaf640 1 --2- 172.21.15.79:0/2530100190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56317c7e0730 0x56317c7e0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:52.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.498+0000 7fdc912b0640 1 -- 172.21.15.79:0/2530100190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56317c7ecfe0 msgr2=0x56317c7ef3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:52.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.498+0000 7fdc912b0640 1 --2- 172.21.15.79:0/2530100190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56317c7ecfe0 0x56317c7ef3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.498+0000 7fdc912b0640 1 -- 172.21.15.79:0/2530100190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56317c7e0730 msgr2=0x56317c7e0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:52.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.498+0000 7fdc912b0640 1 --2- 172.21.15.79:0/2530100190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56317c7e0730 0x56317c7e0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.498+0000 7fdc912b0640 1 -- 172.21.15.79:0/2530100190 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56317c4a6650 con 0x56317c7e1050 2024-08-20T01:46:52.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.498+0000 7fdc90aaf640 1 --2- 172.21.15.79:0/2530100190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56317c7e0730 0x56317c7e0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:46:52.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.499+0000 7fdc827fc640 1 --2- 172.21.15.79:0/1323627005 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fdc780b4040 0x7fdc780b6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:52.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.499+0000 7fdc827fc640 1 -- 172.21.15.79:0/1323627005 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fdc84005020 con 0x7fdc8c197240 2024-08-20T01:46:52.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.499+0000 7fdc90aaf640 1 --2- 172.21.15.79:0/1323627005 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fdc780b4040 0x7fdc780b6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:52.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.500+0000 7fdc912b0640 1 --2- 172.21.15.79:0/2530100190 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56317c7e1050 0x56317c7ecaa0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fdc88031040 tx=0x7fdc880099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b538d7ec78f51ce server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:52.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.500+0000 7fdc90aaf640 1 --2- 172.21.15.79:0/1323627005 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fdc780b4040 0x7fdc780b6500 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x56317c7e06e0 tx=0x7fdc7c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:52.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.500+0000 7fdc777fe640 1 -- 172.21.15.79:0/2530100190 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc880304a0 con 0x56317c7e1050 2024-08-20T01:46:52.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.500+0000 7fdc777fe640 1 -- 172.21.15.79:0/2530100190 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdc88036040 con 0x56317c7e1050 2024-08-20T01:46:52.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.500+0000 7fdc777fe640 1 -- 172.21.15.79:0/2530100190 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc88004290 con 0x56317c7e1050 2024-08-20T01:46:52.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.501+0000 7fdc9590d740 1 -- 172.21.15.79:0/2530100190 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56317c7e1050 msgr2=0x56317c7ecaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:52.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.501+0000 7fdc9590d740 1 --2- 172.21.15.79:0/2530100190 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56317c7e1050 0x56317c7ecaa0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fdc88031040 tx=0x7fdc880099b0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.501+0000 7fdc9590d740 1 -- 172.21.15.79:0/2530100190 shutdown_connections 2024-08-20T01:46:52.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.501+0000 7fdc9590d740 1 --2- 172.21.15.79:0/2530100190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56317c7ecfe0 0x56317c7ef3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.501+0000 7fdc9590d740 1 --2- 172.21.15.79:0/2530100190 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56317c7e1050 0x56317c7ecaa0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.501+0000 7fdc9590d740 1 --2- 172.21.15.79:0/2530100190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56317c7e0730 0x56317c7e0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.501+0000 7fdc9590d740 1 -- 172.21.15.79:0/2530100190 >> 172.21.15.79:0/2530100190 conn(0x56317c7de560 msgr2=0x56317c7df700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:52.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.502+0000 7fdc9590d740 1 -- 172.21.15.79:0/2530100190 shutdown_connections 2024-08-20T01:46:52.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.502+0000 7fdc9590d740 1 -- 172.21.15.79:0/2530100190 wait complete. 2024-08-20T01:46:52.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.502+0000 7fdc9590d740 1 -- start start 2024-08-20T01:46:52.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.502+0000 7fdc9590d740 1 Processor -- start 2024-08-20T01:46:52.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.504+0000 7fdc9590d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56317c7e0730 0x56317c7e9f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:52.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.504+0000 7fdc9590d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56317c7e1050 0x56317c7ea460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:52.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.504+0000 7fdc9590d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56317c7ecfe0 0x56317c7ea9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:52.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.504+0000 7fdc9590d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56317c5a9700 con 0x56317c7e0730 2024-08-20T01:46:52.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.504+0000 7fdc9590d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56317c6cd810 con 0x56317c7ecfe0 2024-08-20T01:46:52.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.504+0000 7fdc9590d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56317c7efbd0 con 0x56317c7e1050 2024-08-20T01:46:52.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.504+0000 7fdc912b0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56317c7e0730 0x56317c7e9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:52.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.504+0000 7fdc912b0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56317c7e0730 0x56317c7e9f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55436/0 (socket says 172.21.15.79:55436) 2024-08-20T01:46:52.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.504+0000 7fdc912b0640 1 -- 172.21.15.79:0/3591001276 learned_addr learned my addr 172.21.15.79:0/3591001276 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:52.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.504+0000 7fdc90aaf640 1 --2- 172.21.15.79:0/3591001276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56317c7e1050 0x56317c7ea460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:52.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.504+0000 7fdc91ab1640 1 --2- 172.21.15.79:0/3591001276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56317c7ecfe0 0x56317c7ea9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:52.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.504+0000 7fdc9590d740 10 client.0 _ll_register_callbacks cb 0x56317c740700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:46:52.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.504+0000 7fdc912b0640 1 -- 172.21.15.79:0/3591001276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56317c7e1050 msgr2=0x56317c7ea460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:52.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.504+0000 7fdc912b0640 1 --2- 172.21.15.79:0/3591001276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56317c7e1050 0x56317c7ea460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.504+0000 7fdc912b0640 1 -- 172.21.15.79:0/3591001276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56317c7ecfe0 msgr2=0x56317c7ea9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:52.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.504+0000 7fdc912b0640 1 --2- 172.21.15.79:0/3591001276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56317c7ecfe0 0x56317c7ea9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.504+0000 7fdc912b0640 1 -- 172.21.15.79:0/3591001276 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56317c7f8fc0 con 0x56317c7e0730 2024-08-20T01:46:52.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.505+0000 7fdc912b0640 1 --2- 172.21.15.79:0/3591001276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56317c7e0730 0x56317c7e9f20 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fdc88002230 tx=0x7fdc88005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f25709e8973ea16c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:52.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.505+0000 7fdc74ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:46:52.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.505+0000 7fdc74ff9640 1 -- 172.21.15.79:0/3591001276 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc88051060 con 0x56317c7e0730 2024-08-20T01:46:52.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.505+0000 7fdc74ff9640 1 -- 172.21.15.79:0/3591001276 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fdc880304a0 con 0x56317c7e0730 2024-08-20T01:46:52.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.505+0000 7fdc9590d740 1 -- 172.21.15.79:0/3591001276 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56317c6f6150 con 0x56317c7e0730 2024-08-20T01:46:52.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.505+0000 7fdc74ff9640 1 -- 172.21.15.79:0/3591001276 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fdc88003f10 con 0x56317c7e0730 2024-08-20T01:46:52.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.506+0000 7fdc9590d740 10 client.18129 fetch_fsmap learned FSMap version 45 2024-08-20T01:46:52.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.506+0000 7fdc9590d740 1 -- 172.21.15.79:0/3591001276 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x56317c7fb950 con 0x56317c7e0730 2024-08-20T01:46:52.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.506+0000 7fdc74ff9640 1 -- 172.21.15.79:0/3591001276 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdc88036040 con 0x56317c7e0730 2024-08-20T01:46:52.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.506+0000 7fdc74ff9640 1 -- 172.21.15.79:0/3591001276 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 45) ==== 8378+0+0 (secure 0 0 0) 0x7fdc880316d0 con 0x56317c7e0730 2024-08-20T01:46:52.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.507+0000 7fdc9590d740 10 client.18129 fetch_fsmap finished waiting for FSMap version 45 2024-08-20T01:46:52.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.507+0000 7fdc9590d740 10 client.18129 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:46:52.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.507+0000 7fdc9590d740 20 client.18129 populate_metadata read hostname 'smithi079' 2024-08-20T01:46:52.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.507+0000 7fdc9590d740 1 --2- 172.21.15.79:0/3591001276 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x56317c7fce30 0x56317c7ff290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:52.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.507+0000 7fdc9590d740 4 client.18129 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:46:52.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.507+0000 7fdc9590d740 1 -- 172.21.15.79:0/3591001276 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56317c6f6150 con 0x56317c7fce30 2024-08-20T01:46:52.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.507+0000 7fdc90aaf640 1 --2- 172.21.15.79:0/3591001276 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x56317c7fce30 0x56317c7ff290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:52.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.508+0000 7fdc90aaf640 1 --2- 172.21.15.79:0/3591001276 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x56317c7fce30 0x56317c7ff290 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=afc9e4e520801ab3 server_cookie=996105d87c0be2f4 in_seq=0 out_seq=0 2024-08-20T01:46:52.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.509+0000 7fdc74ff9640 10 client.18129 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:46:52.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.510+0000 7fdc74ff9640 1 -- 172.21.15.79:0/3591001276 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56317c6f6150 con 0x56317c7fce30 2024-08-20T01:46:52.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.510+0000 7fdc74ff9640 10 client.18129 handle_command_reply: tid=0 2024-08-20T01:46:52.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.510+0000 7fdc9590d740 1 client.18129 shutdown 2024-08-20T01:46:52.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.510+0000 7fdc9590d740 1 -- 172.21.15.79:0/3591001276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56317c7e0730 msgr2=0x56317c7e9f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:52.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.510+0000 7fdc9590d740 1 --2- 172.21.15.79:0/3591001276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56317c7e0730 0x56317c7e9f20 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fdc88002230 tx=0x7fdc88005ef0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.510+0000 7fdc9590d740 1 -- 172.21.15.79:0/3591001276 shutdown_connections 2024-08-20T01:46:52.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.510+0000 7fdc9590d740 1 --2- 172.21.15.79:0/3591001276 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x56317c7fce30 0x56317c7ff290 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.510+0000 7fdc9590d740 1 --2- 172.21.15.79:0/3591001276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56317c7ecfe0 0x56317c7ea9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.510+0000 7fdc9590d740 1 --2- 172.21.15.79:0/3591001276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56317c7e1050 0x56317c7ea460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.510+0000 7fdc9590d740 1 --2- 172.21.15.79:0/3591001276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56317c7e0730 0x56317c7e9f20 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.510+0000 7fdc9590d740 1 -- 172.21.15.79:0/3591001276 >> 172.21.15.79:0/3591001276 conn(0x56317c7de560 msgr2=0x56317c7e4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:52.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.510+0000 7fdc74ff9640 0 client.18129 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:46:52.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.510+0000 7fdc9590d740 1 -- 172.21.15.79:0/3591001276 shutdown_connections 2024-08-20T01:46:52.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.510+0000 7fdc9590d740 1 -- 172.21.15.79:0/3591001276 wait complete. 2024-08-20T01:46:52.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.511+0000 7fdc9590d740 20 client.18129 trim_cache size 0 max 16384 2024-08-20T01:46:52.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.533+0000 7fdc9590d740 1 Processor -- start 2024-08-20T01:46:52.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.534+0000 7fdc9590d740 1 -- start start 2024-08-20T01:46:52.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.534+0000 7fdc9590d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56317c7e0730 0x56317c804b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:52.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.534+0000 7fdc9590d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56317c7e1050 0x56317c8050a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:52.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.534+0000 7fdc9590d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56317c7ecfe0 0x56317c7e7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:52.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.534+0000 7fdc912b0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56317c7e0730 0x56317c804b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:52.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.534+0000 7fdc912b0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56317c7e0730 0x56317c804b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:42076/0 (socket says 172.21.15.79:42076) 2024-08-20T01:46:52.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.534+0000 7fdc912b0640 1 -- 172.21.15.79:0/4006169801 learned_addr learned my addr 172.21.15.79:0/4006169801 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:52.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.534+0000 7fdc9590d740 1 -- 172.21.15.79:0/4006169801 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7000e420 con 0x56317c7e1050 2024-08-20T01:46:52.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.534+0000 7fdc9590d740 1 -- 172.21.15.79:0/4006169801 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdc70010020 con 0x56317c7e0730 2024-08-20T01:46:52.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.534+0000 7fdc9590d740 1 -- 172.21.15.79:0/4006169801 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7000eaf0 con 0x56317c7ecfe0 2024-08-20T01:46:52.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.534+0000 7fdc91ab1640 1 --2- 172.21.15.79:0/4006169801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56317c7ecfe0 0x56317c7e7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:52.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.535+0000 7fdc90aaf640 1 --2- 172.21.15.79:0/4006169801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56317c7e1050 0x56317c8050a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:52.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.535+0000 7fdc90aaf640 1 -- 172.21.15.79:0/4006169801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56317c7ecfe0 msgr2=0x56317c7e7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:52.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.535+0000 7fdc90aaf640 1 --2- 172.21.15.79:0/4006169801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56317c7ecfe0 0x56317c7e7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.535+0000 7fdc90aaf640 1 -- 172.21.15.79:0/4006169801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56317c7e0730 msgr2=0x56317c804b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:52.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.536+0000 7fdc90aaf640 1 --2- 172.21.15.79:0/4006169801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56317c7e0730 0x56317c804b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.536+0000 7fdc90aaf640 1 -- 172.21.15.79:0/4006169801 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56317c7defe0 con 0x56317c7e1050 2024-08-20T01:46:52.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.536+0000 7fdc90aaf640 1 --2- 172.21.15.79:0/4006169801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56317c7e1050 0x56317c8050a0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x56317c7ffb00 tx=0x7fdc7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52082e79e629454 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:52.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.537+0000 7fdc76ffd640 1 -- 172.21.15.79:0/4006169801 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c004220 con 0x56317c7e1050 2024-08-20T01:46:52.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.537+0000 7fdc76ffd640 1 -- 172.21.15.79:0/4006169801 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdc7c0043c0 con 0x56317c7e1050 2024-08-20T01:46:52.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.537+0000 7fdc76ffd640 1 -- 172.21.15.79:0/4006169801 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c003b40 con 0x56317c7e1050 2024-08-20T01:46:52.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.538+0000 7fdc9590d740 1 -- 172.21.15.79:0/4006169801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56317c7e1050 msgr2=0x56317c8050a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:52.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.538+0000 7fdc9590d740 1 --2- 172.21.15.79:0/4006169801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56317c7e1050 0x56317c8050a0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x56317c7ffb00 tx=0x7fdc7c0046c0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.538+0000 7fdc9590d740 1 -- 172.21.15.79:0/4006169801 shutdown_connections 2024-08-20T01:46:52.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.538+0000 7fdc9590d740 1 --2- 172.21.15.79:0/4006169801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56317c7ecfe0 0x56317c7e7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.538+0000 7fdc9590d740 1 --2- 172.21.15.79:0/4006169801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56317c7e1050 0x56317c8050a0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.538+0000 7fdc9590d740 1 --2- 172.21.15.79:0/4006169801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56317c7e0730 0x56317c804b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.538+0000 7fdc9590d740 1 -- 172.21.15.79:0/4006169801 >> 172.21.15.79:0/4006169801 conn(0x56317c7de560 msgr2=0x56317c7e51e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:52.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.538+0000 7fdc9590d740 1 -- 172.21.15.79:0/4006169801 shutdown_connections 2024-08-20T01:46:52.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.538+0000 7fdc9590d740 1 -- 172.21.15.79:0/4006169801 wait complete. 2024-08-20T01:46:52.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.539+0000 7fdc9590d740 1 -- start start 2024-08-20T01:46:52.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.539+0000 7fdc9590d740 1 Processor -- start 2024-08-20T01:46:52.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.540+0000 7fdc9590d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56317c7e0730 0x56317c7f4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:52.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.540+0000 7fdc9590d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56317c7e1050 0x56317c7f5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:52.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.540+0000 7fdc912b0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56317c7e0730 0x56317c7f4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:52.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.540+0000 7fdc912b0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56317c7e0730 0x56317c7f4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:45546/0 (socket says 172.21.15.79:45546) 2024-08-20T01:46:52.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.540+0000 7fdc912b0640 1 -- 172.21.15.79:0/4216326225 learned_addr learned my addr 172.21.15.79:0/4216326225 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:52.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.540+0000 7fdc9590d740 1 --2- 172.21.15.79:0/4216326225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56317c7ecfe0 0x56317c7f1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:52.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.540+0000 7fdc9590d740 1 -- 172.21.15.79:0/4216326225 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7000f950 con 0x56317c7e1050 2024-08-20T01:46:52.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.540+0000 7fdc91ab1640 1 --2- 172.21.15.79:0/4216326225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56317c7ecfe0 0x56317c7f1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:52.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.540+0000 7fdc9590d740 1 -- 172.21.15.79:0/4216326225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7000f1c0 con 0x56317c7ecfe0 2024-08-20T01:46:52.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.541+0000 7fdc9590d740 1 -- 172.21.15.79:0/4216326225 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7000c400 con 0x56317c7e0730 2024-08-20T01:46:52.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.541+0000 7fdc90aaf640 1 --2- 172.21.15.79:0/4216326225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56317c7e1050 0x56317c7f5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:52.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.541+0000 7fdc9590d740 10 client.0 _ll_register_callbacks cb 0x7fdc7c00bae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:46:52.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.541+0000 7fdc91ab1640 1 -- 172.21.15.79:0/4216326225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56317c7e0730 msgr2=0x56317c7f4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:52.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.541+0000 7fdc91ab1640 1 --2- 172.21.15.79:0/4216326225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56317c7e0730 0x56317c7f4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.541+0000 7fdc91ab1640 1 -- 172.21.15.79:0/4216326225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56317c7e1050 msgr2=0x56317c7f5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:52.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.541+0000 7fdc91ab1640 1 --2- 172.21.15.79:0/4216326225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56317c7e1050 0x56317c7f5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.541+0000 7fdc91ab1640 1 -- 172.21.15.79:0/4216326225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56317c7f2480 con 0x56317c7ecfe0 2024-08-20T01:46:52.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.541+0000 7fdc9590d740 1 -- 172.21.15.79:0/4216326225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc7c0043c0 con 0x56317c7ecfe0 2024-08-20T01:46:52.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.541+0000 7fdc91ab1640 1 --2- 172.21.15.79:0/4216326225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56317c7ecfe0 0x56317c7f1ec0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdc840e05f0 tx=0x7fdc840a5370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bacb5cca0f46fd2f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:52.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.542+0000 7fdc74ff9640 10 client.27134 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:46:52.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.542+0000 7fdc74ff9640 1 -- 172.21.15.79:0/4216326225 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc84020050 con 0x56317c7ecfe0 2024-08-20T01:46:52.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.542+0000 7fdc74ff9640 1 -- 172.21.15.79:0/4216326225 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fdc840a60e0 con 0x56317c7ecfe0 2024-08-20T01:46:52.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.542+0000 7fdc74ff9640 1 -- 172.21.15.79:0/4216326225 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fdc84017040 con 0x56317c7ecfe0 2024-08-20T01:46:52.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.542+0000 7fdc9590d740 10 client.27134 fetch_fsmap learned FSMap version 45 2024-08-20T01:46:52.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.542+0000 7fdc9590d740 1 -- 172.21.15.79:0/4216326225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({fsmap=45}) -- 0x56317c8772f0 con 0x56317c7ecfe0 2024-08-20T01:46:52.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.543+0000 7fdc74ff9640 1 -- 172.21.15.79:0/4216326225 <== mon.2 v2:172.21.15.81:3300/0 4 ==== fsmap(e 45) ==== 8378+0+0 (secure 0 0 0) 0x7fdc840910b0 con 0x56317c7ecfe0 2024-08-20T01:46:52.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.543+0000 7fdc9590d740 10 client.27134 fetch_fsmap finished waiting for FSMap version 45 2024-08-20T01:46:52.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.543+0000 7fdc9590d740 10 client.27134 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:46:52.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.543+0000 7fdc9590d740 20 client.27134 populate_metadata read hostname 'smithi079' 2024-08-20T01:46:52.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.543+0000 7fdc9590d740 1 --2- 172.21.15.79:0/4216326225 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x56317c877960 0x56317c879d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:52.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.543+0000 7fdc9590d740 4 client.27134 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:46:52.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.543+0000 7fdc9590d740 1 -- 172.21.15.79:0/4216326225 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fdc7c0043c0 con 0x56317c877960 2024-08-20T01:46:52.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.543+0000 7fdc912b0640 1 --2- 172.21.15.79:0/4216326225 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x56317c877960 0x56317c879d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:52.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.544+0000 7fdc74ff9640 10 client.27134 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:46:52.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.544+0000 7fdc912b0640 1 --2- 172.21.15.79:0/4216326225 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x56317c877960 0x56317c879d80 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=eb187260779c34ae server_cookie=9756a3b214d1ce3b in_seq=0 out_seq=0 2024-08-20T01:46:52.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.544+0000 7fdc74ff9640 1 -- 172.21.15.79:0/4216326225 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fdc7c0043c0 con 0x56317c877960 2024-08-20T01:46:52.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.544+0000 7fdc74ff9640 10 client.27134 handle_command_reply: tid=0 2024-08-20T01:46:52.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.544+0000 7fdc9590d740 1 client.27134 shutdown 2024-08-20T01:46:52.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.545+0000 7fdc9590d740 1 -- 172.21.15.79:0/4216326225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56317c7ecfe0 msgr2=0x56317c7f1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:52.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.545+0000 7fdc9590d740 1 --2- 172.21.15.79:0/4216326225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56317c7ecfe0 0x56317c7f1ec0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdc840e05f0 tx=0x7fdc840a5370 comp rx=0 tx=0).stop 2024-08-20T01:46:52.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.545+0000 7fdc9590d740 1 -- 172.21.15.79:0/4216326225 shutdown_connections 2024-08-20T01:46:52.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.545+0000 7fdc9590d740 1 --2- 172.21.15.79:0/4216326225 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x56317c877960 0x56317c879d80 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.545+0000 7fdc9590d740 1 --2- 172.21.15.79:0/4216326225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56317c7ecfe0 0x56317c7f1ec0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.545+0000 7fdc9590d740 1 --2- 172.21.15.79:0/4216326225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56317c7e1050 0x56317c7f5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.545+0000 7fdc9590d740 1 --2- 172.21.15.79:0/4216326225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56317c7e0730 0x56317c7f4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.545+0000 7fdc9590d740 1 -- 172.21.15.79:0/4216326225 >> 172.21.15.79:0/4216326225 conn(0x56317c7de560 msgr2=0x56317c7dccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:52.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.545+0000 7fdc74ff9640 0 client.27134 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:46:52.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.545+0000 7fdc9590d740 1 -- 172.21.15.79:0/4216326225 shutdown_connections 2024-08-20T01:46:52.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.545+0000 7fdc9590d740 1 -- 172.21.15.79:0/4216326225 wait complete. 2024-08-20T01:46:52.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.546+0000 7fdc9590d740 20 client.27134 trim_cache size 0 max 16384 2024-08-20T01:46:52.550 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:46:52.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.547+0000 7fdc93514640 1 -- 172.21.15.79:0/1323627005 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fdc780b4040 msgr2=0x7fdc780b6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:52.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.547+0000 7fdc93514640 1 --2- 172.21.15.79:0/1323627005 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fdc780b4040 0x7fdc780b6500 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x56317c7e06e0 tx=0x7fdc7c00b410 comp rx=0 tx=0).stop 2024-08-20T01:46:52.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.547+0000 7fdc93514640 1 -- 172.21.15.79:0/1323627005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc8c197240 msgr2=0x7fdc8c1976f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:52.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.547+0000 7fdc93514640 1 --2- 172.21.15.79:0/1323627005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc8c197240 0x7fdc8c1976f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdc8400d680 tx=0x7fdc8400db40 comp rx=0 tx=0).stop 2024-08-20T01:46:52.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.547+0000 7fdc93514640 1 -- 172.21.15.79:0/1323627005 shutdown_connections 2024-08-20T01:46:52.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.547+0000 7fdc93514640 1 --2- 172.21.15.79:0/1323627005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc8c197240 0x7fdc8c1976f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.547+0000 7fdc93514640 1 --2- 172.21.15.79:0/1323627005 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fdc780b4040 0x7fdc780b6500 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.547+0000 7fdc93514640 1 --2- 172.21.15.79:0/1323627005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc8c107d20 0x7fdc8c196d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.547+0000 7fdc93514640 1 --2- 172.21.15.79:0/1323627005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc8c1073a0 0x7fdc8c19dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:52.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.547+0000 7fdc93514640 1 -- 172.21.15.79:0/1323627005 >> 172.21.15.79:0/1323627005 conn(0x7fdc8c0fd400 msgr2=0x7fdc8c0ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:52.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.547+0000 7fdc93514640 1 -- 172.21.15.79:0/1323627005 shutdown_connections 2024-08-20T01:46:52.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:52.547+0000 7fdc93514640 1 -- 172.21.15.79:0/1323627005 wait complete. 2024-08-20T01:46:52.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:52 smithi079 ceph-mon[18656]: pgmap v633: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 27 MiB/s wr, 6.79k op/s 2024-08-20T01:46:52.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:52 smithi175 ceph-mon[22392]: pgmap v633: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 27 MiB/s wr, 6.79k op/s 2024-08-20T01:46:53.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:52 smithi081 ceph-mon[22209]: pgmap v633: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 27 MiB/s wr, 6.79k op/s 2024-08-20T01:46:53.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:53 smithi175 ceph-mon[22392]: pgmap v634: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 6.30k op/s 2024-08-20T01:46:53.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:53 smithi079 ceph-mon[18656]: pgmap v634: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 6.30k op/s 2024-08-20T01:46:54.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:53 smithi081 ceph-mon[22209]: pgmap v634: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 6.30k op/s 2024-08-20T01:46:54.149 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:54.147+0000 7f44897fa640 1 -- 172.21.15.79:0/1359679212 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564afc4b92b0 con 0x564afc5c4e30 2024-08-20T01:46:54.150 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:54.147+0000 7f44897fa640 10 client.27100 handle_command_reply: tid=0 2024-08-20T01:46:54.150 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:54.147+0000 7f44aa9ca740 1 client.27100 shutdown 2024-08-20T01:46:54.150 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:54.147+0000 7f44aa9ca740 1 -- 172.21.15.79:0/1359679212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564afc547200 msgr2=0x564afc5546a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:54.150 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:54.147+0000 7f44aa9ca740 1 --2- 172.21.15.79:0/1359679212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564afc547200 0x564afc5546a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4490005400 tx=0x7f4490005430 comp rx=0 tx=0).stop 2024-08-20T01:46:54.150 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:54.147+0000 7f44aa9ca740 1 -- 172.21.15.79:0/1359679212 shutdown_connections 2024-08-20T01:46:54.150 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:54.147+0000 7f44aa9ca740 1 --2- 172.21.15.79:0/1359679212 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564afc5c4e30 0x564afc5c7250 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:54.150 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:54.147+0000 7f44aa9ca740 1 --2- 172.21.15.79:0/1359679212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564afc549c40 0x564afc554be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:54.150 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:54.147+0000 7f44aa9ca740 1 --2- 172.21.15.79:0/1359679212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564afc547200 0x564afc5546a0 secure :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4490005400 tx=0x7f4490005430 comp rx=0 tx=0).stop 2024-08-20T01:46:54.150 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:54.147+0000 7f44aa9ca740 1 --2- 172.21.15.79:0/1359679212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564afc5448d0 0x564afc5559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:54.151 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:54.147+0000 7f44aa9ca740 1 -- 172.21.15.79:0/1359679212 >> 172.21.15.79:0/1359679212 conn(0x564afc53fa20 msgr2=0x564afc54b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:54.151 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:54.148+0000 7f44897fa640 0 client.27100 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:46:54.151 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:54.148+0000 7f44aa9ca740 1 -- 172.21.15.79:0/1359679212 shutdown_connections 2024-08-20T01:46:54.151 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:54.148+0000 7f44aa9ca740 1 -- 172.21.15.79:0/1359679212 wait complete. 2024-08-20T01:46:54.151 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:54.148+0000 7f44aa9ca740 20 client.27100 trim_cache size 0 max 16384 2024-08-20T01:46:54.151 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:46:54.151 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:46:54.151 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:46:54.151 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:46:54.152 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:54.149+0000 7f44a7afd640 1 -- 172.21.15.79:0/2049689610 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f448c0b3d60 msgr2=0x7f448c0b6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:54.152 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:54.149+0000 7f44a7afd640 1 --2- 172.21.15.79:0/2049689610 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f448c0b3d60 0x7f448c0b6220 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4498005e30 tx=0x7f449804b000 comp rx=0 tx=0).stop 2024-08-20T01:46:54.152 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:54.149+0000 7f44a7afd640 1 -- 172.21.15.79:0/2049689610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44a0108f60 msgr2=0x7f44a019ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:54.152 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:54.149+0000 7f44a7afd640 1 --2- 172.21.15.79:0/2049689610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44a0108f60 0x7f44a019ed70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f449c00e9f0 tx=0x7f449c00eeb0 comp rx=0 tx=0).stop 2024-08-20T01:46:54.152 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:54.149+0000 7f44a7afd640 1 -- 172.21.15.79:0/2049689610 shutdown_connections 2024-08-20T01:46:54.152 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:54.149+0000 7f44a7afd640 1 --2- 172.21.15.79:0/2049689610 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f448c0b3d60 0x7f448c0b6220 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:54.152 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:54.149+0000 7f44a7afd640 1 --2- 172.21.15.79:0/2049689610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44a010a7c0 0x7f44a019fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:54.152 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:54.149+0000 7f44a7afd640 1 --2- 172.21.15.79:0/2049689610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44a0109e00 0x7f44a019f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:54.153 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:54.149+0000 7f44a7afd640 1 --2- 172.21.15.79:0/2049689610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44a0108f60 0x7f44a019ed70 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:54.153 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:54.149+0000 7f44a7afd640 1 -- 172.21.15.79:0/2049689610 >> 172.21.15.79:0/2049689610 conn(0x7f44a00780d0 msgr2=0x7f44a010d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:54.153 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:54.149+0000 7f44a7afd640 1 -- 172.21.15.79:0/2049689610 shutdown_connections 2024-08-20T01:46:54.153 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:46:54.149+0000 7f44a7afd640 1 -- 172.21.15.79:0/2049689610 wait complete. 2024-08-20T01:46:55.189 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T01:46:55.605 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:46:56.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:55 smithi081 ceph-mon[22209]: pgmap v635: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 28 MiB/s wr, 7.04k op/s 2024-08-20T01:46:56.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:55 smithi175 ceph-mon[22392]: pgmap v635: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 28 MiB/s wr, 7.04k op/s 2024-08-20T01:46:56.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:55 smithi079 ceph-mon[18656]: pgmap v635: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 28 MiB/s wr, 7.04k op/s 2024-08-20T01:46:57.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.238+0000 7fb69b0a5640 1 -- 172.21.15.79:0/3860332193 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6941084c0 msgr2=0x7fb694108900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:57.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.238+0000 7fb69b0a5640 1 --2- 172.21.15.79:0/3860332193 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6941084c0 0x7fb694108900 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb680009900 tx=0x7fb68002a3f0 comp rx=0 tx=0).stop 2024-08-20T01:46:57.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.238+0000 7fb69b0a5640 1 -- 172.21.15.79:0/3860332193 shutdown_connections 2024-08-20T01:46:57.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.238+0000 7fb69b0a5640 1 --2- 172.21.15.79:0/3860332193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb694108e40 0x7fb69410f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:57.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.238+0000 7fb69b0a5640 1 --2- 172.21.15.79:0/3860332193 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6941084c0 0x7fb694108900 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:57.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.238+0000 7fb69b0a5640 1 --2- 172.21.15.79:0/3860332193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb694102ab0 0x7fb694102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:57.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.238+0000 7fb69b0a5640 1 -- 172.21.15.79:0/3860332193 >> 172.21.15.79:0/3860332193 conn(0x7fb6940fe580 msgr2=0x7fb6941009a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:57.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.238+0000 7fb69b0a5640 1 -- 172.21.15.79:0/3860332193 shutdown_connections 2024-08-20T01:46:57.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.239+0000 7fb69b0a5640 1 -- 172.21.15.79:0/3860332193 wait complete. 2024-08-20T01:46:57.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.240+0000 7fb69b0a5640 1 Processor -- start 2024-08-20T01:46:57.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.240+0000 7fb69b0a5640 1 -- start start 2024-08-20T01:46:57.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.240+0000 7fb69b0a5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb694102ab0 0x7fb69419b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:57.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.240+0000 7fb69b0a5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6941084c0 0x7fb69419b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:57.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.240+0000 7fb69b0a5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb694108e40 0x7fb6941a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:57.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.241+0000 7fb69b0a5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb694075970 con 0x7fb694108e40 2024-08-20T01:46:57.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.241+0000 7fb69b0a5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb6940757f0 con 0x7fb6941084c0 2024-08-20T01:46:57.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.241+0000 7fb69b0a5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb694075af0 con 0x7fb694102ab0 2024-08-20T01:46:57.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.241+0000 7fb699642640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb694108e40 0x7fb6941a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:57.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.241+0000 7fb699642640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb694108e40 0x7fb6941a0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55470/0 (socket says 172.21.15.79:55470) 2024-08-20T01:46:57.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.241+0000 7fb699642640 1 -- 172.21.15.79:0/1212606719 learned_addr learned my addr 172.21.15.79:0/1212606719 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:57.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.241+0000 7fb693fff640 1 --2- 172.21.15.79:0/1212606719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6941084c0 0x7fb69419b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:57.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.241+0000 7fb699642640 1 -- 172.21.15.79:0/1212606719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb694102ab0 msgr2=0x7fb69419b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:57.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.241+0000 7fb699642640 1 --2- 172.21.15.79:0/1212606719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb694102ab0 0x7fb69419b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:57.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.241+0000 7fb699642640 1 -- 172.21.15.79:0/1212606719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6941084c0 msgr2=0x7fb69419b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:57.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.241+0000 7fb699642640 1 --2- 172.21.15.79:0/1212606719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6941084c0 0x7fb69419b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:57.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.241+0000 7fb699642640 1 -- 172.21.15.79:0/1212606719 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6941a1280 con 0x7fb694108e40 2024-08-20T01:46:57.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.242+0000 7fb699642640 1 --2- 172.21.15.79:0/1212606719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb694108e40 0x7fb6941a0ab0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fb68c00eb10 tx=0x7fb68c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:57.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.243+0000 7fb691ffb640 1 -- 172.21.15.79:0/1212606719 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c004b20 con 0x7fb694108e40 2024-08-20T01:46:57.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.243+0000 7fb691ffb640 1 -- 172.21.15.79:0/1212606719 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb68c004cc0 con 0x7fb694108e40 2024-08-20T01:46:57.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.243+0000 7fb691ffb640 1 -- 172.21.15.79:0/1212606719 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c010690 con 0x7fb694108e40 2024-08-20T01:46:57.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.243+0000 7fb69b0a5640 1 -- 172.21.15.79:0/1212606719 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6941a1570 con 0x7fb694108e40 2024-08-20T01:46:57.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.243+0000 7fb69b0a5640 1 -- 172.21.15.79:0/1212606719 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6941a7c30 con 0x7fb694108e40 2024-08-20T01:46:57.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.247+0000 7fb69d49e740 1 Processor -- start 2024-08-20T01:46:57.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.248+0000 7fb691ffb640 1 -- 172.21.15.79:0/1212606719 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb68c005020 con 0x7fb694108e40 2024-08-20T01:46:57.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.249+0000 7fb69d49e740 1 -- start start 2024-08-20T01:46:57.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.249+0000 7fb69d49e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af4b22f090 0x55af4b22f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:57.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.249+0000 7fb69d49e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af4b22f9b0 0x55af4b23b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:57.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.249+0000 7fb69d49e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af4b23b940 0x55af4b23dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:57.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.249+0000 7fb69d49e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55af4b19d930 con 0x55af4b23b940 2024-08-20T01:46:57.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.249+0000 7fb69d49e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55af4b18ce30 con 0x55af4b22f9b0 2024-08-20T01:46:57.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.249+0000 7fb69d49e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55af4b190e70 con 0x55af4b22f090 2024-08-20T01:46:57.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.249+0000 7fb693fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af4b22f090 0x55af4b22f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:57.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.249+0000 7fb691ffb640 1 --2- 172.21.15.79:0/1212606719 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb6840b3da0 0x7fb6840b6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:57.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.249+0000 7fb693fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af4b22f090 0x55af4b22f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:45578/0 (socket says 172.21.15.79:45578) 2024-08-20T01:46:57.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.249+0000 7fb693fff640 1 -- 172.21.15.79:0/1752629399 learned_addr learned my addr 172.21.15.79:0/1752629399 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:57.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.249+0000 7fb698e41640 1 --2- 172.21.15.79:0/1752629399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af4b22f9b0 0x55af4b23b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:57.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.250+0000 7fb691ffb640 1 -- 172.21.15.79:0/1212606719 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fb68c0e4000 con 0x7fb694108e40 2024-08-20T01:46:57.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.250+0000 7fb693fff640 1 --2- 172.21.15.79:0/1752629399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af4b23b940 0x55af4b23dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:57.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.250+0000 7fb698e41640 1 -- 172.21.15.79:0/1752629399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af4b22f090 msgr2=0x55af4b22f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:57.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.250+0000 7fb698e41640 1 --2- 172.21.15.79:0/1752629399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af4b22f090 0x55af4b22f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:57.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.250+0000 7fb698e41640 1 -- 172.21.15.79:0/1752629399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af4b23b940 msgr2=0x55af4b23dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:57.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.250+0000 7fb698e41640 1 --2- 172.21.15.79:0/1752629399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af4b23b940 0x55af4b23dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:57.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.250+0000 7fb698e41640 1 -- 172.21.15.79:0/1752629399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af4aeec650 con 0x55af4b22f9b0 2024-08-20T01:46:57.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.250+0000 7fb699642640 1 --2- 172.21.15.79:0/1212606719 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb6840b3da0 0x7fb6840b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:57.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.250+0000 7fb698e41640 1 --2- 172.21.15.79:0/1752629399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af4b22f9b0 0x55af4b23b400 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb68801a7f0 tx=0x7fb68801acb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f0530d8bf7f9b9c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:57.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.250+0000 7fb67effd640 1 -- 172.21.15.79:0/1752629399 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb688026020 con 0x55af4b22f9b0 2024-08-20T01:46:57.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.251+0000 7fb67effd640 1 -- 172.21.15.79:0/1752629399 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb68801cd70 con 0x55af4b22f9b0 2024-08-20T01:46:57.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.251+0000 7fb67effd640 1 -- 172.21.15.79:0/1752629399 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb688022d60 con 0x55af4b22f9b0 2024-08-20T01:46:57.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.251+0000 7fb69d49e740 1 -- 172.21.15.79:0/1752629399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af4b22f9b0 msgr2=0x55af4b23b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:57.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.251+0000 7fb69d49e740 1 --2- 172.21.15.79:0/1752629399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af4b22f9b0 0x55af4b23b400 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb68801a7f0 tx=0x7fb68801acb0 comp rx=0 tx=0).stop 2024-08-20T01:46:57.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.252+0000 7fb699642640 1 --2- 172.21.15.79:0/1212606719 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb6840b3da0 0x7fb6840b6260 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb68c0e1ab0 tx=0x7fb68c000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:57.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.252+0000 7fb69d49e740 1 -- 172.21.15.79:0/1752629399 shutdown_connections 2024-08-20T01:46:57.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.252+0000 7fb69d49e740 1 --2- 172.21.15.79:0/1752629399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af4b23b940 0x55af4b23dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:57.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.252+0000 7fb69d49e740 1 --2- 172.21.15.79:0/1752629399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af4b22f9b0 0x55af4b23b400 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:57.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.252+0000 7fb69d49e740 1 --2- 172.21.15.79:0/1752629399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af4b22f090 0x55af4b22f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:57.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.252+0000 7fb69d49e740 1 -- 172.21.15.79:0/1752629399 >> 172.21.15.79:0/1752629399 conn(0x55af4b22cec0 msgr2=0x55af4b22e060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:57.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.253+0000 7fb69d49e740 1 -- 172.21.15.79:0/1752629399 shutdown_connections 2024-08-20T01:46:57.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.253+0000 7fb69d49e740 1 -- 172.21.15.79:0/1752629399 wait complete. 2024-08-20T01:46:57.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.254+0000 7fb69d49e740 1 -- start start 2024-08-20T01:46:57.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.254+0000 7fb69d49e740 1 Processor -- start 2024-08-20T01:46:57.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.254+0000 7fb69d49e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af4b22f090 0x55af4b23b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:57.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.255+0000 7fb69d49e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af4b22f9b0 0x55af4b2387c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:57.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.255+0000 7fb69d49e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af4b23b940 0x55af4b238f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:57.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.255+0000 7fb69d49e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55af4afef700 con 0x55af4b22f090 2024-08-20T01:46:57.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.255+0000 7fb69d49e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55af4b113810 con 0x55af4b23b940 2024-08-20T01:46:57.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.255+0000 7fb698e41640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af4b22f9b0 0x55af4b2387c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:57.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.255+0000 7fb698e41640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af4b22f9b0 0x55af4b2387c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:45584/0 (socket says 172.21.15.79:45584) 2024-08-20T01:46:57.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.255+0000 7fb698e41640 1 -- 172.21.15.79:0/828504804 learned_addr learned my addr 172.21.15.79:0/828504804 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:57.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.255+0000 7fb69d49e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55af4b23e660 con 0x55af4b22f9b0 2024-08-20T01:46:57.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.255+0000 7fb693fff640 1 --2- 172.21.15.79:0/828504804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af4b23b940 0x55af4b238f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:57.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.255+0000 7fb69d49e740 10 client.0 _ll_register_callbacks cb 0x55af4b186700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:46:57.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.255+0000 7fb698e41640 1 -- 172.21.15.79:0/828504804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af4b23b940 msgr2=0x55af4b238f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:57.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.255+0000 7fb698e41640 1 --2- 172.21.15.79:0/828504804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af4b23b940 0x55af4b238f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:57.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.255+0000 7fb698e41640 1 -- 172.21.15.79:0/828504804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af4b22f090 msgr2=0x55af4b23b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:57.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.255+0000 7fb698e41640 1 --2- 172.21.15.79:0/828504804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af4b22f090 0x55af4b23b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:57.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.255+0000 7fb698e41640 1 -- 172.21.15.79:0/828504804 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af4b247a20 con 0x55af4b22f9b0 2024-08-20T01:46:57.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.256+0000 7fb698e41640 1 --2- 172.21.15.79:0/828504804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af4b22f9b0 0x55af4b2387c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb688000c00 tx=0x7fb68801a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=610c083535af2a1c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:57.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.256+0000 7fb673fff640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:46:57.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.256+0000 7fb673fff640 1 -- 172.21.15.79:0/828504804 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb688006bd0 con 0x55af4b22f9b0 2024-08-20T01:46:57.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.256+0000 7fb673fff640 1 -- 172.21.15.79:0/828504804 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fb68801c8e0 con 0x55af4b22f9b0 2024-08-20T01:46:57.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.256+0000 7fb69d49e740 1 -- 172.21.15.79:0/828504804 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55af4b13c150 con 0x55af4b22f9b0 2024-08-20T01:46:57.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.256+0000 7fb673fff640 1 -- 172.21.15.79:0/828504804 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fb68801cae0 con 0x55af4b22f9b0 2024-08-20T01:46:57.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.256+0000 7fb69d49e740 10 client.27127 fetch_fsmap learned FSMap version 45 2024-08-20T01:46:57.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.256+0000 7fb69d49e740 1 -- 172.21.15.79:0/828504804 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55af4b24a310 con 0x55af4b22f9b0 2024-08-20T01:46:57.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.257+0000 7fb673fff640 1 -- 172.21.15.79:0/828504804 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb68803b030 con 0x55af4b22f9b0 2024-08-20T01:46:57.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.257+0000 7fb673fff640 1 -- 172.21.15.79:0/828504804 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 45) ==== 8378+0+0 (secure 0 0 0) 0x7fb688021070 con 0x55af4b22f9b0 2024-08-20T01:46:57.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.257+0000 7fb69d49e740 10 client.27127 fetch_fsmap finished waiting for FSMap version 45 2024-08-20T01:46:57.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.257+0000 7fb69d49e740 10 client.27127 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:46:57.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.257+0000 7fb69d49e740 20 client.27127 populate_metadata read hostname 'smithi079' 2024-08-20T01:46:57.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.257+0000 7fb69d49e740 1 --2- 172.21.15.79:0/828504804 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55af4b24b660 0x55af4b24da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:57.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.257+0000 7fb69d49e740 4 client.27127 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:46:57.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.257+0000 7fb69d49e740 1 -- 172.21.15.79:0/828504804 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55af4b13c150 con 0x55af4b24b660 2024-08-20T01:46:57.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.257+0000 7fb693fff640 1 --2- 172.21.15.79:0/828504804 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55af4b24b660 0x55af4b24da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:57.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.258+0000 7fb673fff640 10 client.27127 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:46:57.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.258+0000 7fb693fff640 1 --2- 172.21.15.79:0/828504804 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55af4b24b660 0x55af4b24da50 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1fd3472ed08002e2 server_cookie=d3efc8a7770120cd in_seq=0 out_seq=0 2024-08-20T01:46:57.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.259+0000 7fb673fff640 1 -- 172.21.15.79:0/828504804 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55af4b13c150 con 0x55af4b24b660 2024-08-20T01:46:57.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.259+0000 7fb673fff640 10 client.27127 handle_command_reply: tid=0 2024-08-20T01:46:57.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.259+0000 7fb69d49e740 1 client.27127 shutdown 2024-08-20T01:46:57.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.260+0000 7fb69d49e740 1 -- 172.21.15.79:0/828504804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af4b22f9b0 msgr2=0x55af4b2387c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:57.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.260+0000 7fb69d49e740 1 --2- 172.21.15.79:0/828504804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af4b22f9b0 0x55af4b2387c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb688000c00 tx=0x7fb68801a300 comp rx=0 tx=0).stop 2024-08-20T01:46:57.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.261+0000 7fb69d49e740 1 -- 172.21.15.79:0/828504804 shutdown_connections 2024-08-20T01:46:57.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.261+0000 7fb69d49e740 1 --2- 172.21.15.79:0/828504804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af4b23b940 0x55af4b238f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:57.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.261+0000 7fb69d49e740 1 --2- 172.21.15.79:0/828504804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af4b22f9b0 0x55af4b2387c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:57.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.261+0000 7fb69d49e740 1 --2- 172.21.15.79:0/828504804 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55af4b24b660 0x55af4b24da50 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:57.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.261+0000 7fb69d49e740 1 --2- 172.21.15.79:0/828504804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af4b22f090 0x55af4b23b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:57.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.261+0000 7fb69d49e740 1 -- 172.21.15.79:0/828504804 >> 172.21.15.79:0/828504804 conn(0x55af4b22cec0 msgr2=0x55af4b232a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:57.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.262+0000 7fb673fff640 0 client.27127 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:46:57.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.262+0000 7fb69d49e740 1 -- 172.21.15.79:0/828504804 shutdown_connections 2024-08-20T01:46:57.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.262+0000 7fb69d49e740 1 -- 172.21.15.79:0/828504804 wait complete. 2024-08-20T01:46:57.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.262+0000 7fb69d49e740 20 client.27127 trim_cache size 0 max 16384 2024-08-20T01:46:57.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.286+0000 7fb69d49e740 1 Processor -- start 2024-08-20T01:46:57.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.286+0000 7fb69d49e740 1 -- start start 2024-08-20T01:46:57.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.286+0000 7fb69d49e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af4b22f090 0x55af4b233190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:57.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.286+0000 7fb69d49e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af4b22f9b0 0x55af4b21f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:57.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.287+0000 7fb693fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af4b22f090 0x55af4b233190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:57.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.287+0000 7fb693fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af4b22f090 0x55af4b233190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:42138/0 (socket says 172.21.15.79:42138) 2024-08-20T01:46:57.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.287+0000 7fb698e41640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af4b22f9b0 0x55af4b21f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:57.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.287+0000 7fb698e41640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af4b22f9b0 0x55af4b21f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:45586/0 (socket says 172.21.15.79:45586) 2024-08-20T01:46:57.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.287+0000 7fb69d49e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af4b23b940 0x55af4b22df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:57.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.287+0000 7fb693fff640 1 -- 172.21.15.79:0/3984317057 learned_addr learned my addr 172.21.15.79:0/3984317057 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:57.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.287+0000 7fb69d49e740 1 -- 172.21.15.79:0/3984317057 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb67800e400 con 0x55af4b23b940 2024-08-20T01:46:57.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.287+0000 7fb69d49e740 1 -- 172.21.15.79:0/3984317057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb678010000 con 0x55af4b22f090 2024-08-20T01:46:57.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.287+0000 7fb69d49e740 1 -- 172.21.15.79:0/3984317057 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb67800ead0 con 0x55af4b22f9b0 2024-08-20T01:46:57.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.287+0000 7fb693fff640 1 --2- 172.21.15.79:0/3984317057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af4b23b940 0x55af4b22df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:57.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.288+0000 7fb693fff640 1 -- 172.21.15.79:0/3984317057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af4b22f9b0 msgr2=0x55af4b21f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:57.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.288+0000 7fb693fff640 1 --2- 172.21.15.79:0/3984317057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af4b22f9b0 0x55af4b21f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:57.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.288+0000 7fb693fff640 1 -- 172.21.15.79:0/3984317057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af4b23b940 msgr2=0x55af4b22df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:57.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.288+0000 7fb693fff640 1 --2- 172.21.15.79:0/3984317057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af4b23b940 0x55af4b22df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:57.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.288+0000 7fb693fff640 1 -- 172.21.15.79:0/3984317057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af4b22f7e0 con 0x55af4b22f090 2024-08-20T01:46:57.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.288+0000 7fb693fff640 1 --2- 172.21.15.79:0/3984317057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af4b22f090 0x55af4b233190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb680000c00 tx=0x7fb68002a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bc2fbf9ed4e7474 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:57.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.288+0000 7fb67e7fc640 1 -- 172.21.15.79:0/3984317057 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb680047040 con 0x55af4b22f090 2024-08-20T01:46:57.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.288+0000 7fb67e7fc640 1 -- 172.21.15.79:0/3984317057 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb68003d450 con 0x55af4b22f090 2024-08-20T01:46:57.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.288+0000 7fb67e7fc640 1 -- 172.21.15.79:0/3984317057 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb680000e60 con 0x55af4b22f090 2024-08-20T01:46:57.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.289+0000 7fb69d49e740 1 -- 172.21.15.79:0/3984317057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af4b22f090 msgr2=0x55af4b233190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:57.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.289+0000 7fb69d49e740 1 --2- 172.21.15.79:0/3984317057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af4b22f090 0x55af4b233190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb680000c00 tx=0x7fb68002a3f0 comp rx=0 tx=0).stop 2024-08-20T01:46:57.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.290+0000 7fb69d49e740 1 -- 172.21.15.79:0/3984317057 shutdown_connections 2024-08-20T01:46:57.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.290+0000 7fb69d49e740 1 --2- 172.21.15.79:0/3984317057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af4b23b940 0x55af4b22df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:57.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.290+0000 7fb69d49e740 1 --2- 172.21.15.79:0/3984317057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af4b22f9b0 0x55af4b21f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:57.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.290+0000 7fb69d49e740 1 --2- 172.21.15.79:0/3984317057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af4b22f090 0x55af4b233190 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:57.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.290+0000 7fb69d49e740 1 -- 172.21.15.79:0/3984317057 >> 172.21.15.79:0/3984317057 conn(0x55af4b22cec0 msgr2=0x55af4b237040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:57.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.290+0000 7fb69d49e740 1 -- 172.21.15.79:0/3984317057 shutdown_connections 2024-08-20T01:46:57.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.290+0000 7fb69d49e740 1 -- 172.21.15.79:0/3984317057 wait complete. 2024-08-20T01:46:57.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.291+0000 7fb69d49e740 1 -- start start 2024-08-20T01:46:57.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.291+0000 7fb69d49e740 1 Processor -- start 2024-08-20T01:46:57.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.292+0000 7fb69d49e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af4b22f090 0x55af4b243980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:57.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.292+0000 7fb69d49e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af4b22f9b0 0x55af4b243ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:57.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.292+0000 7fb69d49e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af4b23b940 0x55af4b2359f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:57.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.292+0000 7fb698e41640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af4b22f9b0 0x55af4b243ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:57.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.292+0000 7fb698e41640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af4b22f9b0 0x55af4b243ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:45590/0 (socket says 172.21.15.79:45590) 2024-08-20T01:46:57.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.292+0000 7fb698e41640 1 -- 172.21.15.79:0/676104307 learned_addr learned my addr 172.21.15.79:0/676104307 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:57.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.292+0000 7fb693fff640 1 --2- 172.21.15.79:0/676104307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af4b23b940 0x55af4b2359f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:57.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.292+0000 7fb69d49e740 1 -- 172.21.15.79:0/676104307 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb67800f930 con 0x55af4b22f090 2024-08-20T01:46:57.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.293+0000 7fb69d49e740 1 -- 172.21.15.79:0/676104307 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb67800f1a0 con 0x55af4b23b940 2024-08-20T01:46:57.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.293+0000 7fb69d49e740 1 -- 172.21.15.79:0/676104307 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb67800c3e0 con 0x55af4b22f9b0 2024-08-20T01:46:57.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.293+0000 7fb69d49e740 10 client.0 _ll_register_callbacks cb 0x7fb680009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:46:57.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.293+0000 7fb698e41640 1 -- 172.21.15.79:0/676104307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af4b23b940 msgr2=0x55af4b2359f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:57.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.293+0000 7fb698e41640 1 --2- 172.21.15.79:0/676104307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af4b23b940 0x55af4b2359f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:57.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.293+0000 7fb698e41640 1 -- 172.21.15.79:0/676104307 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af4b22f090 msgr2=0x55af4b243980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:57.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.293+0000 7fb698e41640 1 --2- 172.21.15.79:0/676104307 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af4b22f090 0x55af4b243980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:57.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.293+0000 7fb698e41640 1 -- 172.21.15.79:0/676104307 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af4b235f30 con 0x55af4b22f9b0 2024-08-20T01:46:57.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.294+0000 7fb69d49e740 1 -- 172.21.15.79:0/676104307 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb68003d450 con 0x55af4b22f9b0 2024-08-20T01:46:57.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.294+0000 7fb673fff640 10 client.27133 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:46:57.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.294+0000 7fb698e41640 1 --2- 172.21.15.79:0/676104307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af4b22f9b0 0x55af4b243ec0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb688035450 tx=0x7fb68801c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d8291da9861fcb3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:57.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.294+0000 7fb673fff640 1 -- 172.21.15.79:0/676104307 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb688044030 con 0x55af4b22f9b0 2024-08-20T01:46:57.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.294+0000 7fb673fff640 1 -- 172.21.15.79:0/676104307 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fb68801f040 con 0x55af4b22f9b0 2024-08-20T01:46:57.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.294+0000 7fb673fff640 1 -- 172.21.15.79:0/676104307 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fb688026040 con 0x55af4b22f9b0 2024-08-20T01:46:57.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.294+0000 7fb69d49e740 10 client.27133 fetch_fsmap learned FSMap version 45 2024-08-20T01:46:57.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.294+0000 7fb69d49e740 1 -- 172.21.15.79:0/676104307 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({fsmap=45}) -- 0x55af4b23c440 con 0x55af4b22f9b0 2024-08-20T01:46:57.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.296+0000 7fb673fff640 1 -- 172.21.15.79:0/676104307 <== mon.1 v2:172.21.15.175:3300/0 4 ==== fsmap(e 45) ==== 8378+0+0 (secure 0 0 0) 0x7fb688021070 con 0x55af4b22f9b0 2024-08-20T01:46:57.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.296+0000 7fb69d49e740 10 client.27133 fetch_fsmap finished waiting for FSMap version 45 2024-08-20T01:46:57.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.296+0000 7fb69d49e740 10 client.27133 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:46:57.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.296+0000 7fb69d49e740 20 client.27133 populate_metadata read hostname 'smithi079' 2024-08-20T01:46:57.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.296+0000 7fb69d49e740 1 --2- 172.21.15.79:0/676104307 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55af4b23caa0 0x55af4b2b8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:57.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.296+0000 7fb69d49e740 4 client.27133 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:46:57.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.296+0000 7fb69d49e740 1 -- 172.21.15.79:0/676104307 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fb68003d450 con 0x55af4b23caa0 2024-08-20T01:46:57.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.297+0000 7fb693fff640 1 --2- 172.21.15.79:0/676104307 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55af4b23caa0 0x55af4b2b8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:57.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.297+0000 7fb693fff640 1 --2- 172.21.15.79:0/676104307 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55af4b23caa0 0x55af4b2b8250 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9d8e25934853c44b server_cookie=b4256b52b8bf44f8 in_seq=0 out_seq=0 2024-08-20T01:46:57.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.298+0000 7fb673fff640 10 client.27133 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:46:57.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.298+0000 7fb673fff640 1 -- 172.21.15.79:0/676104307 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fb68003d450 con 0x55af4b23caa0 2024-08-20T01:46:57.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.298+0000 7fb673fff640 10 client.27133 handle_command_reply: tid=0 2024-08-20T01:46:57.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.298+0000 7fb69d49e740 1 client.27133 shutdown 2024-08-20T01:46:57.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.298+0000 7fb69d49e740 1 -- 172.21.15.79:0/676104307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af4b22f9b0 msgr2=0x55af4b243ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:57.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.298+0000 7fb69d49e740 1 --2- 172.21.15.79:0/676104307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af4b22f9b0 0x55af4b243ec0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb688035450 tx=0x7fb68801c8e0 comp rx=0 tx=0).stop 2024-08-20T01:46:57.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.298+0000 7fb69d49e740 1 -- 172.21.15.79:0/676104307 shutdown_connections 2024-08-20T01:46:57.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.298+0000 7fb69d49e740 1 --2- 172.21.15.79:0/676104307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af4b23b940 0x55af4b2359f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:57.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.298+0000 7fb69d49e740 1 --2- 172.21.15.79:0/676104307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55af4b22f9b0 0x55af4b243ec0 secure :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb688035450 tx=0x7fb68801c8e0 comp rx=0 tx=0).stop 2024-08-20T01:46:57.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.298+0000 7fb69d49e740 1 --2- 172.21.15.79:0/676104307 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55af4b23caa0 0x55af4b2b8250 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:57.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.298+0000 7fb69d49e740 1 --2- 172.21.15.79:0/676104307 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55af4b22f090 0x55af4b243980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:57.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.298+0000 7fb673fff640 0 client.27133 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:46:57.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.298+0000 7fb69d49e740 1 -- 172.21.15.79:0/676104307 >> 172.21.15.79:0/676104307 conn(0x55af4b22cec0 msgr2=0x55af4b22ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:57.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.299+0000 7fb69d49e740 1 -- 172.21.15.79:0/676104307 shutdown_connections 2024-08-20T01:46:57.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.299+0000 7fb69d49e740 1 -- 172.21.15.79:0/676104307 wait complete. 2024-08-20T01:46:57.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.299+0000 7fb69d49e740 20 client.27133 trim_cache size 0 max 16384 2024-08-20T01:46:57.303 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:46:57.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.300+0000 7fb69b0a5640 1 -- 172.21.15.79:0/1212606719 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb6840b3da0 msgr2=0x7fb6840b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:57.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.300+0000 7fb69b0a5640 1 --2- 172.21.15.79:0/1212606719 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb6840b3da0 0x7fb6840b6260 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb68c0e1ab0 tx=0x7fb68c000f40 comp rx=0 tx=0).stop 2024-08-20T01:46:57.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.300+0000 7fb69b0a5640 1 -- 172.21.15.79:0/1212606719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb694108e40 msgr2=0x7fb6941a0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:57.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.300+0000 7fb69b0a5640 1 --2- 172.21.15.79:0/1212606719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb694108e40 0x7fb6941a0ab0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fb68c00eb10 tx=0x7fb68c00c2d0 comp rx=0 tx=0).stop 2024-08-20T01:46:57.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.300+0000 7fb69b0a5640 1 -- 172.21.15.79:0/1212606719 shutdown_connections 2024-08-20T01:46:57.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.300+0000 7fb69b0a5640 1 --2- 172.21.15.79:0/1212606719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb694108e40 0x7fb6941a0ab0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:57.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.300+0000 7fb69b0a5640 1 --2- 172.21.15.79:0/1212606719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6941084c0 0x7fb69419b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:57.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.300+0000 7fb69b0a5640 1 --2- 172.21.15.79:0/1212606719 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb6840b3da0 0x7fb6840b6260 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:57.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.300+0000 7fb69b0a5640 1 --2- 172.21.15.79:0/1212606719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb694102ab0 0x7fb69419b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:57.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.300+0000 7fb69b0a5640 1 -- 172.21.15.79:0/1212606719 >> 172.21.15.79:0/1212606719 conn(0x7fb6940fe580 msgr2=0x7fb694100970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:57.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.300+0000 7fb69b0a5640 1 -- 172.21.15.79:0/1212606719 shutdown_connections 2024-08-20T01:46:57.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:57.301+0000 7fb69b0a5640 1 -- 172.21.15.79:0/1212606719 wait complete. 2024-08-20T01:46:57.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:57 smithi079 ceph-mon[18656]: pgmap v636: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 25 MiB/s wr, 6.45k op/s 2024-08-20T01:46:58.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:57 smithi081 ceph-mon[22209]: pgmap v636: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 25 MiB/s wr, 6.45k op/s 2024-08-20T01:46:58.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:57 smithi175 ceph-mon[22392]: pgmap v636: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 25 MiB/s wr, 6.45k op/s 2024-08-20T01:46:58.251 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T01:46:58.681 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:46:59.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.272+0000 7f536dfa9640 1 -- 172.21.15.79:0/1175595774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5368109e80 msgr2=0x7f536810a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:59.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.272+0000 7f536dfa9640 1 --2- 172.21.15.79:0/1175595774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5368109e80 0x7f536810a260 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5358009900 tx=0x7f535802a490 comp rx=0 tx=0).stop 2024-08-20T01:46:59.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.272+0000 7f536dfa9640 1 -- 172.21.15.79:0/1175595774 shutdown_connections 2024-08-20T01:46:59.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.272+0000 7f536dfa9640 1 --2- 172.21.15.79:0/1175595774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5368115740 0x7f5368117b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:59.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.272+0000 7f536dfa9640 1 --2- 172.21.15.79:0/1175595774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f536810a7a0 0x7f5368115200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:59.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.272+0000 7f536dfa9640 1 --2- 172.21.15.79:0/1175595774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5368109e80 0x7f536810a260 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:59.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.272+0000 7f536dfa9640 1 -- 172.21.15.79:0/1175595774 >> 172.21.15.79:0/1175595774 conn(0x7f536806dcc0 msgr2=0x7f536806e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:59.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.272+0000 7f536dfa9640 1 -- 172.21.15.79:0/1175595774 shutdown_connections 2024-08-20T01:46:59.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.272+0000 7f536dfa9640 1 -- 172.21.15.79:0/1175595774 wait complete. 2024-08-20T01:46:59.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.273+0000 7f536dfa9640 1 Processor -- start 2024-08-20T01:46:59.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.274+0000 7f536dfa9640 1 -- start start 2024-08-20T01:46:59.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.274+0000 7f536dfa9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5368109e80 0x7f536810cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:59.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.274+0000 7f536dfa9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f536810a7a0 0x7f536810b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:59.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.274+0000 7f536dfa9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5368115740 0x7f536810b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:59.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.274+0000 7f536dfa9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f536811b140 con 0x7f5368109e80 2024-08-20T01:46:59.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.274+0000 7f536dfa9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f536811afc0 con 0x7f5368115740 2024-08-20T01:46:59.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.275+0000 7f536dfa9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f536811b2c0 con 0x7f536810a7a0 2024-08-20T01:46:59.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.275+0000 7f53677fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5368109e80 0x7f536810cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:59.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.275+0000 7f53677fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5368109e80 0x7f536810cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55534/0 (socket says 172.21.15.79:55534) 2024-08-20T01:46:59.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.275+0000 7f5367fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5368115740 0x7f536810b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:59.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.275+0000 7f53677fe640 1 -- 172.21.15.79:0/2160185931 learned_addr learned my addr 172.21.15.79:0/2160185931 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:59.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.275+0000 7f5366ffd640 1 --2- 172.21.15.79:0/2160185931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f536810a7a0 0x7f536810b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:59.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.275+0000 7f5366ffd640 1 -- 172.21.15.79:0/2160185931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5368115740 msgr2=0x7f536810b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:59.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.275+0000 7f5366ffd640 1 --2- 172.21.15.79:0/2160185931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5368115740 0x7f536810b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:59.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.275+0000 7f5366ffd640 1 -- 172.21.15.79:0/2160185931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5368109e80 msgr2=0x7f536810cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:59.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.275+0000 7f5366ffd640 1 --2- 172.21.15.79:0/2160185931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5368109e80 0x7f536810cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:59.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.275+0000 7f5366ffd640 1 -- 172.21.15.79:0/2160185931 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53681b3e30 con 0x7f536810a7a0 2024-08-20T01:46:59.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.276+0000 7f5366ffd640 1 --2- 172.21.15.79:0/2160185931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f536810a7a0 0x7f536810b0b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f535c00e9f0 tx=0x7f535c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:59.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.276+0000 7f53677fe640 1 --2- 172.21.15.79:0/2160185931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5368109e80 0x7f536810cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:46:59.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.276+0000 7f5364ff9640 1 -- 172.21.15.79:0/2160185931 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f535c00ccc0 con 0x7f536810a7a0 2024-08-20T01:46:59.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.276+0000 7f5364ff9640 1 -- 172.21.15.79:0/2160185931 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f535c0108c0 con 0x7f536810a7a0 2024-08-20T01:46:59.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.276+0000 7f5364ff9640 1 -- 172.21.15.79:0/2160185931 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f535c018710 con 0x7f536810a7a0 2024-08-20T01:46:59.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.277+0000 7f536dfa9640 1 -- 172.21.15.79:0/2160185931 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53681b4000 con 0x7f536810a7a0 2024-08-20T01:46:59.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.277+0000 7f536dfa9640 1 -- 172.21.15.79:0/2160185931 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53681b44c0 con 0x7f536810a7a0 2024-08-20T01:46:59.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.282+0000 7f53703a2740 1 Processor -- start 2024-08-20T01:46:59.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.282+0000 7f53703a2740 1 -- start start 2024-08-20T01:46:59.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.282+0000 7f53703a2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596518c8880 0x5596518c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:59.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.282+0000 7f53703a2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596518c91a0 0x5596518d4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:59.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.282+0000 7f53703a2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596518d5130 0x5596518d7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:59.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.282+0000 7f53703a2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55965183f930 con 0x5596518d5130 2024-08-20T01:46:59.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.282+0000 7f53703a2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55965182ee30 con 0x5596518c8880 2024-08-20T01:46:59.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.282+0000 7f53703a2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559651832e70 con 0x5596518c91a0 2024-08-20T01:46:59.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.283+0000 7f5367fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596518c8880 0x5596518c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:59.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.283+0000 7f5367fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596518c8880 0x5596518c8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:42174/0 (socket says 172.21.15.79:42174) 2024-08-20T01:46:59.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.283+0000 7f5367fff640 1 -- 172.21.15.79:0/904532514 learned_addr learned my addr 172.21.15.79:0/904532514 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:59.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.283+0000 7f53677fe640 1 --2- 172.21.15.79:0/904532514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596518c91a0 0x5596518d4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:59.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.283+0000 7f5367fff640 1 -- 172.21.15.79:0/904532514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596518c91a0 msgr2=0x5596518d4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:59.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.283+0000 7f5367fff640 1 --2- 172.21.15.79:0/904532514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596518c91a0 0x5596518d4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:59.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.283+0000 7f5367fff640 1 -- 172.21.15.79:0/904532514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596518d5130 msgr2=0x5596518d7520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:46:59.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.283+0000 7f5367fff640 1 --2- 172.21.15.79:0/904532514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596518d5130 0x5596518d7520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:59.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.283+0000 7f5367fff640 1 -- 172.21.15.79:0/904532514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55965158e650 con 0x5596518c8880 2024-08-20T01:46:59.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.283+0000 7f5364ff9640 1 -- 172.21.15.79:0/2160185931 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f535c010430 con 0x7f536810a7a0 2024-08-20T01:46:59.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.284+0000 7f5367fff640 1 --2- 172.21.15.79:0/904532514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596518c8880 0x5596518c8c60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5360009fc0 tx=0x7f5360010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad3e521d780b93ec server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:59.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.284+0000 7f534dffb640 1 -- 172.21.15.79:0/904532514 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5360016070 con 0x5596518c8880 2024-08-20T01:46:59.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.284+0000 7f534dffb640 1 -- 172.21.15.79:0/904532514 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5360004d20 con 0x5596518c8880 2024-08-20T01:46:59.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.285+0000 7f5364ff9640 1 --2- 172.21.15.79:0/2160185931 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f53500b3d60 0x7f53500b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:59.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.285+0000 7f53677fe640 1 --2- 172.21.15.79:0/2160185931 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f53500b3d60 0x7f53500b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:59.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.285+0000 7f5364ff9640 1 -- 172.21.15.79:0/2160185931 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f535c0e3ff0 con 0x7f536810a7a0 2024-08-20T01:46:59.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.285+0000 7f534dffb640 1 -- 172.21.15.79:0/904532514 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5360005280 con 0x5596518c8880 2024-08-20T01:46:59.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.286+0000 7f53703a2740 1 -- 172.21.15.79:0/904532514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596518c8880 msgr2=0x5596518c8c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:59.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.286+0000 7f53703a2740 1 --2- 172.21.15.79:0/904532514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596518c8880 0x5596518c8c60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5360009fc0 tx=0x7f5360010800 comp rx=0 tx=0).stop 2024-08-20T01:46:59.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.286+0000 7f53677fe640 1 --2- 172.21.15.79:0/2160185931 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f53500b3d60 0x7f53500b6220 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f535800b230 tx=0x7f535800b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:59.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.286+0000 7f53703a2740 1 -- 172.21.15.79:0/904532514 shutdown_connections 2024-08-20T01:46:59.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.286+0000 7f53703a2740 1 --2- 172.21.15.79:0/904532514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596518d5130 0x5596518d7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:59.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.286+0000 7f53703a2740 1 --2- 172.21.15.79:0/904532514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596518c91a0 0x5596518d4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:59.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.286+0000 7f53703a2740 1 --2- 172.21.15.79:0/904532514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596518c8880 0x5596518c8c60 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:59.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.286+0000 7f53703a2740 1 -- 172.21.15.79:0/904532514 >> 172.21.15.79:0/904532514 conn(0x5596518c66b0 msgr2=0x5596518c7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:59.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.286+0000 7f53703a2740 1 -- 172.21.15.79:0/904532514 shutdown_connections 2024-08-20T01:46:59.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.286+0000 7f53703a2740 1 -- 172.21.15.79:0/904532514 wait complete. 2024-08-20T01:46:59.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.287+0000 7f53703a2740 1 -- start start 2024-08-20T01:46:59.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.287+0000 7f53703a2740 1 Processor -- start 2024-08-20T01:46:59.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.288+0000 7f53703a2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596518c8880 0x5596518d4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:59.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.288+0000 7f53703a2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596518c91a0 0x5596518d1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:59.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.288+0000 7f53703a2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596518d5130 0x5596518d2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:59.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.288+0000 7f53703a2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559651691700 con 0x5596518c8880 2024-08-20T01:46:59.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.288+0000 7f53703a2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5596517b5810 con 0x5596518d5130 2024-08-20T01:46:59.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.289+0000 7f53703a2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5596518d7e80 con 0x5596518c91a0 2024-08-20T01:46:59.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.289+0000 7f53703a2740 10 client.0 _ll_register_callbacks cb 0x559651828700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:46:59.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.289+0000 7f53677fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596518c8880 0x5596518d4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:59.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.289+0000 7f53677fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596518c8880 0x5596518d4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55538/0 (socket says 172.21.15.79:55538) 2024-08-20T01:46:59.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.289+0000 7f53677fe640 1 -- 172.21.15.79:0/4029550142 learned_addr learned my addr 172.21.15.79:0/4029550142 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:59.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.290+0000 7f5366ffd640 1 --2- 172.21.15.79:0/4029550142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596518c91a0 0x5596518d1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:59.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.290+0000 7f5367fff640 1 --2- 172.21.15.79:0/4029550142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596518d5130 0x5596518d2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:59.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.290+0000 7f53677fe640 1 -- 172.21.15.79:0/4029550142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596518c91a0 msgr2=0x5596518d1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:59.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.290+0000 7f53677fe640 1 --2- 172.21.15.79:0/4029550142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596518c91a0 0x5596518d1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:59.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.290+0000 7f53677fe640 1 -- 172.21.15.79:0/4029550142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596518d5130 msgr2=0x5596518d2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:59.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.290+0000 7f53677fe640 1 --2- 172.21.15.79:0/4029550142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596518d5130 0x5596518d2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:59.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.290+0000 7f53677fe640 1 -- 172.21.15.79:0/4029550142 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596518e1230 con 0x5596518c8880 2024-08-20T01:46:59.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.290+0000 7f53677fe640 1 --2- 172.21.15.79:0/4029550142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596518c8880 0x5596518d4b80 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f535800b200 tx=0x7f535802a490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fd768cdcee70e0b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:59.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.291+0000 7f5346ffd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:46:59.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.291+0000 7f5346ffd640 1 -- 172.21.15.79:0/4029550142 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5358035040 con 0x5596518c8880 2024-08-20T01:46:59.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.291+0000 7f5346ffd640 1 -- 172.21.15.79:0/4029550142 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f5358004c90 con 0x5596518c8880 2024-08-20T01:46:59.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.291+0000 7f53703a2740 1 -- 172.21.15.79:0/4029550142 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5596517de150 con 0x5596518c8880 2024-08-20T01:46:59.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.291+0000 7f5346ffd640 1 -- 172.21.15.79:0/4029550142 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f5358004e90 con 0x5596518c8880 2024-08-20T01:46:59.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.291+0000 7f53703a2740 10 client.18153 fetch_fsmap learned FSMap version 45 2024-08-20T01:46:59.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.291+0000 7f53703a2740 1 -- 172.21.15.79:0/4029550142 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x5596518e3b60 con 0x5596518c8880 2024-08-20T01:46:59.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.292+0000 7f5346ffd640 1 -- 172.21.15.79:0/4029550142 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5596517de150 con 0x5596518c8880 2024-08-20T01:46:59.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.292+0000 7f5346ffd640 1 -- 172.21.15.79:0/4029550142 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 45) ==== 8378+0+0 (secure 0 0 0) 0x7f535804a440 con 0x5596518c8880 2024-08-20T01:46:59.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.292+0000 7f53703a2740 10 client.18153 fetch_fsmap finished waiting for FSMap version 45 2024-08-20T01:46:59.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.292+0000 7f53703a2740 10 client.18153 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:46:59.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.292+0000 7f53703a2740 20 client.18153 populate_metadata read hostname 'smithi079' 2024-08-20T01:46:59.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.292+0000 7f53703a2740 1 --2- 172.21.15.79:0/4029550142 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x5596518e5020 0x5596518e7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:59.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.292+0000 7f53703a2740 4 client.18153 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:46:59.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.292+0000 7f53703a2740 1 -- 172.21.15.79:0/4029550142 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559651841880 con 0x5596518e5020 2024-08-20T01:46:59.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.292+0000 7f5366ffd640 1 --2- 172.21.15.79:0/4029550142 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x5596518e5020 0x5596518e7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:59.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.293+0000 7f5366ffd640 1 --2- 172.21.15.79:0/4029550142 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x5596518e5020 0x5596518e7430 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a6a1118e968db6cd server_cookie=7b079e5ef6402ae7 in_seq=0 out_seq=0 2024-08-20T01:46:59.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.293+0000 7f5346ffd640 10 client.18153 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:46:59.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.293+0000 7f5346ffd640 1 -- 172.21.15.79:0/4029550142 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559651841880 con 0x5596518e5020 2024-08-20T01:46:59.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.294+0000 7f5346ffd640 10 client.18153 handle_command_reply: tid=0 2024-08-20T01:46:59.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.294+0000 7f53703a2740 1 client.18153 shutdown 2024-08-20T01:46:59.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.294+0000 7f53703a2740 1 -- 172.21.15.79:0/4029550142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596518c8880 msgr2=0x5596518d4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:59.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.294+0000 7f53703a2740 1 --2- 172.21.15.79:0/4029550142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596518c8880 0x5596518d4b80 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f535800b200 tx=0x7f535802a490 comp rx=0 tx=0).stop 2024-08-20T01:46:59.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.294+0000 7f53703a2740 1 -- 172.21.15.79:0/4029550142 shutdown_connections 2024-08-20T01:46:59.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.294+0000 7f53703a2740 1 --2- 172.21.15.79:0/4029550142 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x5596518e5020 0x5596518e7430 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:59.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.294+0000 7f53703a2740 1 --2- 172.21.15.79:0/4029550142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596518d5130 0x5596518d2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:59.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.294+0000 7f53703a2740 1 --2- 172.21.15.79:0/4029550142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596518c91a0 0x5596518d1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:59.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.294+0000 7f53703a2740 1 --2- 172.21.15.79:0/4029550142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596518c8880 0x5596518d4b80 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:59.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.294+0000 7f53703a2740 1 -- 172.21.15.79:0/4029550142 >> 172.21.15.79:0/4029550142 conn(0x5596518c66b0 msgr2=0x5596518cc250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:59.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.295+0000 7f5346ffd640 0 client.18153 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:46:59.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.295+0000 7f53703a2740 1 -- 172.21.15.79:0/4029550142 shutdown_connections 2024-08-20T01:46:59.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.295+0000 7f53703a2740 1 -- 172.21.15.79:0/4029550142 wait complete. 2024-08-20T01:46:59.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.295+0000 7f53703a2740 20 client.18153 trim_cache size 0 max 16384 2024-08-20T01:46:59.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.318+0000 7f53703a2740 1 Processor -- start 2024-08-20T01:46:59.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.318+0000 7f53703a2740 1 -- start start 2024-08-20T01:46:59.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.319+0000 7f53703a2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596518c8880 0x5596518e14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:59.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.319+0000 7f53703a2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596518c91a0 0x5596518d0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:59.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.319+0000 7f53703a2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596518d5130 0x5596518d0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:59.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.319+0000 7f53677fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596518c8880 0x5596518e14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:59.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.319+0000 7f53703a2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f53681bcea0 con 0x5596518c91a0 2024-08-20T01:46:59.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.319+0000 7f53703a2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f53681beaa0 con 0x5596518d5130 2024-08-20T01:46:59.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.319+0000 7f53703a2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f53681bd570 con 0x5596518c8880 2024-08-20T01:46:59.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.319+0000 7f53677fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596518c8880 0x5596518e14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:45616/0 (socket says 172.21.15.79:45616) 2024-08-20T01:46:59.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.319+0000 7f53677fe640 1 -- 172.21.15.79:0/2796258475 learned_addr learned my addr 172.21.15.79:0/2796258475 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:59.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.319+0000 7f5366ffd640 1 --2- 172.21.15.79:0/2796258475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596518c91a0 0x5596518d0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:59.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.319+0000 7f5367fff640 1 --2- 172.21.15.79:0/2796258475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596518d5130 0x5596518d0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:59.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.320+0000 7f53677fe640 1 -- 172.21.15.79:0/2796258475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596518d5130 msgr2=0x5596518d0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:59.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.320+0000 7f53677fe640 1 --2- 172.21.15.79:0/2796258475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596518d5130 0x5596518d0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:59.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.320+0000 7f53677fe640 1 -- 172.21.15.79:0/2796258475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596518c91a0 msgr2=0x5596518d0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:59.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.320+0000 7f53677fe640 1 --2- 172.21.15.79:0/2796258475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596518c91a0 0x5596518d0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:59.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.320+0000 7f53677fe640 1 -- 172.21.15.79:0/2796258475 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596518d4ef0 con 0x5596518c8880 2024-08-20T01:46:59.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.322+0000 7f53677fe640 1 --2- 172.21.15.79:0/2796258475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596518c8880 0x5596518e14a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5358009850 tx=0x7f5358005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15e667fd3bd11fe5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:59.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.322+0000 7f534d7fa640 1 -- 172.21.15.79:0/2796258475 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f535804aa50 con 0x5596518c8880 2024-08-20T01:46:59.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.323+0000 7f534d7fa640 1 -- 172.21.15.79:0/2796258475 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f535804abf0 con 0x5596518c8880 2024-08-20T01:46:59.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.323+0000 7f534d7fa640 1 -- 172.21.15.79:0/2796258475 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f535803dd70 con 0x5596518c8880 2024-08-20T01:46:59.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.324+0000 7f53703a2740 1 -- 172.21.15.79:0/2796258475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596518c8880 msgr2=0x5596518e14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:59.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.324+0000 7f53703a2740 1 --2- 172.21.15.79:0/2796258475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596518c8880 0x5596518e14a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5358009850 tx=0x7f5358005fd0 comp rx=0 tx=0).stop 2024-08-20T01:46:59.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.324+0000 7f53703a2740 1 -- 172.21.15.79:0/2796258475 shutdown_connections 2024-08-20T01:46:59.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.324+0000 7f53703a2740 1 --2- 172.21.15.79:0/2796258475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596518d5130 0x5596518d0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:59.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.324+0000 7f53703a2740 1 --2- 172.21.15.79:0/2796258475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596518c91a0 0x5596518d0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:59.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.324+0000 7f53703a2740 1 --2- 172.21.15.79:0/2796258475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596518c8880 0x5596518e14a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:59.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.324+0000 7f53703a2740 1 -- 172.21.15.79:0/2796258475 >> 172.21.15.79:0/2796258475 conn(0x5596518c66b0 msgr2=0x5596518cd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:59.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.324+0000 7f53703a2740 1 -- 172.21.15.79:0/2796258475 shutdown_connections 2024-08-20T01:46:59.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.324+0000 7f53703a2740 1 -- 172.21.15.79:0/2796258475 wait complete. 2024-08-20T01:46:59.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.325+0000 7f53703a2740 1 -- start start 2024-08-20T01:46:59.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.325+0000 7f53703a2740 1 Processor -- start 2024-08-20T01:46:59.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.326+0000 7f53703a2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596518c8880 0x5596518dd190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:59.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.326+0000 7f53703a2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596518d5130 0x5596518dd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:59.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.326+0000 7f53703a2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596518ddc10 0x5596518ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:59.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.326+0000 7f53677fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596518c8880 0x5596518dd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:59.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.326+0000 7f53703a2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f53681be3d0 con 0x5596518ddc10 2024-08-20T01:46:59.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.326+0000 7f53703a2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f53681bdc40 con 0x5596518c8880 2024-08-20T01:46:59.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.326+0000 7f53703a2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f53681bae80 con 0x5596518d5130 2024-08-20T01:46:59.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.326+0000 7f53703a2740 10 client.0 _ll_register_callbacks cb 0x7f5358009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:46:59.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.326+0000 7f5366ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596518d5130 0x5596518dd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:59.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.326+0000 7f5366ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596518d5130 0x5596518dd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:45618/0 (socket says 172.21.15.79:45618) 2024-08-20T01:46:59.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.326+0000 7f5366ffd640 1 -- 172.21.15.79:0/2334765715 learned_addr learned my addr 172.21.15.79:0/2334765715 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:46:59.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.326+0000 7f5366ffd640 1 -- 172.21.15.79:0/2334765715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596518c8880 msgr2=0x5596518dd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:59.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.326+0000 7f5366ffd640 1 --2- 172.21.15.79:0/2334765715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596518c8880 0x5596518dd190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:59.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.326+0000 7f5366ffd640 1 -- 172.21.15.79:0/2334765715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596518ddc10 msgr2=0x5596518ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:46:59.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.326+0000 7f5366ffd640 1 --2- 172.21.15.79:0/2334765715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596518ddc10 0x5596518ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:59.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.327+0000 7f5366ffd640 1 -- 172.21.15.79:0/2334765715 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596518ceb70 con 0x5596518d5130 2024-08-20T01:46:59.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.327+0000 7f5366ffd640 1 --2- 172.21.15.79:0/2334765715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596518d5130 0x5596518dd6d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f535c0aabf0 tx=0x7f535c0e1f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aab7a3a2d1d430c6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:46:59.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.327+0000 7f5346ffd640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:46:59.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.327+0000 7f5346ffd640 1 -- 172.21.15.79:0/2334765715 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f535c0b3fa0 con 0x5596518d5130 2024-08-20T01:46:59.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.327+0000 7f53703a2740 1 -- 172.21.15.79:0/2334765715 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f535804abf0 con 0x5596518d5130 2024-08-20T01:46:59.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.327+0000 7f5346ffd640 1 -- 172.21.15.79:0/2334765715 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f535c0e1bb0 con 0x5596518d5130 2024-08-20T01:46:59.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.327+0000 7f5346ffd640 1 -- 172.21.15.79:0/2334765715 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f535c0c0260 con 0x5596518d5130 2024-08-20T01:46:59.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.328+0000 7f53703a2740 10 client.27151 fetch_fsmap learned FSMap version 45 2024-08-20T01:46:59.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.328+0000 7f53703a2740 1 -- 172.21.15.79:0/2334765715 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55965194f770 con 0x5596518d5130 2024-08-20T01:46:59.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.328+0000 7f5346ffd640 1 -- 172.21.15.79:0/2334765715 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f535c0be030 con 0x5596518d5130 2024-08-20T01:46:59.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.329+0000 7f5346ffd640 1 -- 172.21.15.79:0/2334765715 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 45) ==== 8378+0+0 (secure 0 0 0) 0x7f535c0a69f0 con 0x5596518d5130 2024-08-20T01:46:59.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.329+0000 7f53703a2740 10 client.27151 fetch_fsmap finished waiting for FSMap version 45 2024-08-20T01:46:59.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.329+0000 7f53703a2740 10 client.27151 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:46:59.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.329+0000 7f53703a2740 20 client.27151 populate_metadata read hostname 'smithi079' 2024-08-20T01:46:59.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.329+0000 7f53703a2740 1 --2- 172.21.15.79:0/2334765715 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x559651950080 0x5596519524a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:46:59.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.329+0000 7f53703a2740 4 client.27151 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:46:59.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.329+0000 7f53703a2740 1 -- 172.21.15.79:0/2334765715 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55965183d320 con 0x559651950080 2024-08-20T01:46:59.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.329+0000 7f53677fe640 1 --2- 172.21.15.79:0/2334765715 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x559651950080 0x5596519524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:46:59.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.330+0000 7f53677fe640 1 --2- 172.21.15.79:0/2334765715 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x559651950080 0x5596519524a0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=854b09436d708c48 server_cookie=8c878471f7f4faa5 in_seq=0 out_seq=0 2024-08-20T01:46:59.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.330+0000 7f5346ffd640 10 client.27151 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:46:59.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.330+0000 7f5346ffd640 1 -- 172.21.15.79:0/2334765715 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55965183d320 con 0x559651950080 2024-08-20T01:46:59.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.330+0000 7f5346ffd640 10 client.27151 handle_command_reply: tid=0 2024-08-20T01:46:59.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.330+0000 7f53703a2740 1 client.27151 shutdown 2024-08-20T01:46:59.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.330+0000 7f53703a2740 1 -- 172.21.15.79:0/2334765715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596518d5130 msgr2=0x5596518dd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:59.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.330+0000 7f53703a2740 1 --2- 172.21.15.79:0/2334765715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596518d5130 0x5596518dd6d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f535c0aabf0 tx=0x7f535c0e1f60 comp rx=0 tx=0).stop 2024-08-20T01:46:59.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.331+0000 7f53703a2740 1 -- 172.21.15.79:0/2334765715 shutdown_connections 2024-08-20T01:46:59.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.331+0000 7f53703a2740 1 --2- 172.21.15.79:0/2334765715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596518ddc10 0x5596518ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:59.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.331+0000 7f53703a2740 1 --2- 172.21.15.79:0/2334765715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596518d5130 0x5596518dd6d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:59.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.331+0000 7f53703a2740 1 --2- 172.21.15.79:0/2334765715 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x559651950080 0x5596519524a0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:59.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.331+0000 7f53703a2740 1 --2- 172.21.15.79:0/2334765715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596518c8880 0x5596518dd190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:59.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.331+0000 7f53703a2740 1 -- 172.21.15.79:0/2334765715 >> 172.21.15.79:0/2334765715 conn(0x5596518c66b0 msgr2=0x5596518cd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:59.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.331+0000 7f5346ffd640 0 client.27151 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:46:59.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.333+0000 7f53703a2740 1 -- 172.21.15.79:0/2334765715 shutdown_connections 2024-08-20T01:46:59.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.333+0000 7f53703a2740 1 -- 172.21.15.79:0/2334765715 wait complete. 2024-08-20T01:46:59.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.334+0000 7f53703a2740 20 client.27151 trim_cache size 0 max 16384 2024-08-20T01:46:59.337 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:46:59.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.335+0000 7f536dfa9640 1 -- 172.21.15.79:0/2160185931 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f53500b3d60 msgr2=0x7f53500b6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:59.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.335+0000 7f536dfa9640 1 --2- 172.21.15.79:0/2160185931 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f53500b3d60 0x7f53500b6220 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f535800b230 tx=0x7f535800b040 comp rx=0 tx=0).stop 2024-08-20T01:46:59.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.335+0000 7f536dfa9640 1 -- 172.21.15.79:0/2160185931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f536810a7a0 msgr2=0x7f536810b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:46:59.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.335+0000 7f536dfa9640 1 --2- 172.21.15.79:0/2160185931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f536810a7a0 0x7f536810b0b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f535c00e9f0 tx=0x7f535c00eeb0 comp rx=0 tx=0).stop 2024-08-20T01:46:59.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.335+0000 7f536dfa9640 1 -- 172.21.15.79:0/2160185931 shutdown_connections 2024-08-20T01:46:59.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.335+0000 7f536dfa9640 1 --2- 172.21.15.79:0/2160185931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5368115740 0x7f536810b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:59.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.335+0000 7f536dfa9640 1 --2- 172.21.15.79:0/2160185931 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f53500b3d60 0x7f53500b6220 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:59.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.335+0000 7f536dfa9640 1 --2- 172.21.15.79:0/2160185931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f536810a7a0 0x7f536810b0b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:59.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.335+0000 7f536dfa9640 1 --2- 172.21.15.79:0/2160185931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5368109e80 0x7f536810cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:46:59.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.335+0000 7f536dfa9640 1 -- 172.21.15.79:0/2160185931 >> 172.21.15.79:0/2160185931 conn(0x7f536806dcc0 msgr2=0x7f53680713d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:46:59.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.336+0000 7f536dfa9640 1 -- 172.21.15.79:0/2160185931 shutdown_connections 2024-08-20T01:46:59.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:46:59.336+0000 7f536dfa9640 1 -- 172.21.15.79:0/2160185931 wait complete. 2024-08-20T01:47:00.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:46:59 smithi081 ceph-mon[22209]: pgmap v637: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 MiB/s wr, 6.72k op/s 2024-08-20T01:47:00.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:46:59 smithi175 ceph-mon[22392]: pgmap v637: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 MiB/s wr, 6.72k op/s 2024-08-20T01:47:00.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:46:59 smithi079 ceph-mon[18656]: pgmap v637: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 MiB/s wr, 6.72k op/s 2024-08-20T01:47:01.477 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T01:47:01.910 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:47:02.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:01 smithi081 ceph-mon[22209]: pgmap v638: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 26 MiB/s wr, 6.58k op/s 2024-08-20T01:47:02.044 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:01 smithi079 ceph-mon[18656]: pgmap v638: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 26 MiB/s wr, 6.58k op/s 2024-08-20T01:47:02.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:01 smithi175 ceph-mon[22392]: pgmap v638: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 26 MiB/s wr, 6.58k op/s 2024-08-20T01:47:02.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.538+0000 7f11e4e8b640 1 -- 172.21.15.79:0/3879270979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11e0104cc0 msgr2=0x7f11e01050a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:02.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.538+0000 7f11e4e8b640 1 --2- 172.21.15.79:0/3879270979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11e0104cc0 0x7f11e01050a0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f11d0009900 tx=0x7f11d002a410 comp rx=0 tx=0).stop 2024-08-20T01:47:02.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.538+0000 7f11e4e8b640 1 -- 172.21.15.79:0/3879270979 shutdown_connections 2024-08-20T01:47:02.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.538+0000 7f11e4e8b640 1 --2- 172.21.15.79:0/3879270979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11e010b050 0x7f11e0111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:02.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.538+0000 7f11e4e8b640 1 --2- 172.21.15.79:0/3879270979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11e010a6d0 0x7f11e010ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:02.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.538+0000 7f11e4e8b640 1 --2- 172.21.15.79:0/3879270979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11e0104cc0 0x7f11e01050a0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:02.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.538+0000 7f11e4e8b640 1 -- 172.21.15.79:0/3879270979 >> 172.21.15.79:0/3879270979 conn(0x7f11e01006f0 msgr2=0x7f11e0102b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:02.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.538+0000 7f11e4e8b640 1 -- 172.21.15.79:0/3879270979 shutdown_connections 2024-08-20T01:47:02.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.538+0000 7f11e4e8b640 1 -- 172.21.15.79:0/3879270979 wait complete. 2024-08-20T01:47:02.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.539+0000 7f11e4e8b640 1 Processor -- start 2024-08-20T01:47:02.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.539+0000 7f11e4e8b640 1 -- start start 2024-08-20T01:47:02.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.539+0000 7f11e4e8b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11e0104cc0 0x7f11e0111400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:02.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.540+0000 7f11e4e8b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11e010a6d0 0x7f11e010e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:02.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.540+0000 7f11e4e8b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11e010b050 0x7f11e010eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:02.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.540+0000 7f11e4e8b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f11e0114bd0 con 0x7f11e010b050 2024-08-20T01:47:02.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.540+0000 7f11e4e8b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f11e0114a50 con 0x7f11e0104cc0 2024-08-20T01:47:02.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.540+0000 7f11de59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11e0104cc0 0x7f11e0111400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:02.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.540+0000 7f11e4e8b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f11e0114d50 con 0x7f11e010a6d0 2024-08-20T01:47:02.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.540+0000 7f11de59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11e0104cc0 0x7f11e0111400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:48684/0 (socket says 172.21.15.79:48684) 2024-08-20T01:47:02.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.540+0000 7f11de59c640 1 -- 172.21.15.79:0/121825487 learned_addr learned my addr 172.21.15.79:0/121825487 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:02.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.540+0000 7f11d7fff640 1 --2- 172.21.15.79:0/121825487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11e010a6d0 0x7f11e010e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:02.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.540+0000 7f11ded9d640 1 --2- 172.21.15.79:0/121825487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11e010b050 0x7f11e010eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:02.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.541+0000 7f11d7fff640 1 -- 172.21.15.79:0/121825487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11e0104cc0 msgr2=0x7f11e0111400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:02.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.541+0000 7f11d7fff640 1 --2- 172.21.15.79:0/121825487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11e0104cc0 0x7f11e0111400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:02.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.541+0000 7f11d7fff640 1 -- 172.21.15.79:0/121825487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11e010b050 msgr2=0x7f11e010eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:02.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.541+0000 7f11d7fff640 1 --2- 172.21.15.79:0/121825487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11e010b050 0x7f11e010eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:02.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.541+0000 7f11d7fff640 1 -- 172.21.15.79:0/121825487 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11e010f2c0 con 0x7f11e010a6d0 2024-08-20T01:47:02.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.541+0000 7f11de59c640 1 --2- 172.21.15.79:0/121825487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11e0104cc0 0x7f11e0111400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:47:02.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.541+0000 7f11d7fff640 1 --2- 172.21.15.79:0/121825487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11e010a6d0 0x7f11e010e650 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f11c8005fd0 tx=0x7f11c800dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:02.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.541+0000 7f11d77fe640 1 -- 172.21.15.79:0/121825487 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c8009c30 con 0x7f11e010a6d0 2024-08-20T01:47:02.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.542+0000 7f11d77fe640 1 -- 172.21.15.79:0/121825487 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11c80044c0 con 0x7f11e010a6d0 2024-08-20T01:47:02.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.542+0000 7f11d77fe640 1 -- 172.21.15.79:0/121825487 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c8003e20 con 0x7f11e010a6d0 2024-08-20T01:47:02.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.542+0000 7f11e4e8b640 1 -- 172.21.15.79:0/121825487 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11e01a1090 con 0x7f11e010a6d0 2024-08-20T01:47:02.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.542+0000 7f11e4e8b640 1 -- 172.21.15.79:0/121825487 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11e01a1580 con 0x7f11e010a6d0 2024-08-20T01:47:02.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.545+0000 7f11d77fe640 1 -- 172.21.15.79:0/121825487 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f11c80035f0 con 0x7f11e010a6d0 2024-08-20T01:47:02.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.547+0000 7f11d77fe640 1 --2- 172.21.15.79:0/121825487 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f11cc0b3d60 0x7f11cc0b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:02.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.547+0000 7f11d77fe640 1 -- 172.21.15.79:0/121825487 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f11c80e32d0 con 0x7f11e010a6d0 2024-08-20T01:47:02.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.547+0000 7f11de59c640 1 --2- 172.21.15.79:0/121825487 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f11cc0b3d60 0x7f11cc0b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:02.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.547+0000 7f11e7284740 1 Processor -- start 2024-08-20T01:47:02.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.548+0000 7f11e7284740 1 -- start start 2024-08-20T01:47:02.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.548+0000 7f11e7284740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c51b23880 0x563c51b23c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:02.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.548+0000 7f11e7284740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c51b241a0 0x563c51b2fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:02.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.548+0000 7f11e7284740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c51b30130 0x563c51b32520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:02.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.548+0000 7f11d7fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c51b241a0 0x563c51b2fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:02.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.549+0000 7f11d7fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c51b241a0 0x563c51b2fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:59212/0 (socket says 172.21.15.79:59212) 2024-08-20T01:47:02.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.549+0000 7f11d7fff640 1 -- 172.21.15.79:0/4046766063 learned_addr learned my addr 172.21.15.79:0/4046766063 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:02.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.549+0000 7f11e7284740 1 -- 172.21.15.79:0/4046766063 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563c51a9a930 con 0x563c51b30130 2024-08-20T01:47:02.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.549+0000 7f11e7284740 1 -- 172.21.15.79:0/4046766063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563c51a89e30 con 0x563c51b23880 2024-08-20T01:47:02.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.549+0000 7f11e7284740 1 -- 172.21.15.79:0/4046766063 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563c51a8de70 con 0x563c51b241a0 2024-08-20T01:47:02.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.549+0000 7f11ded9d640 1 --2- 172.21.15.79:0/4046766063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c51b30130 0x563c51b32520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:02.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.549+0000 7f11d7fff640 1 -- 172.21.15.79:0/4046766063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c51b23880 msgr2=0x563c51b23c60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:47:02.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.549+0000 7f11d7fff640 1 --2- 172.21.15.79:0/4046766063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c51b23880 0x563c51b23c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:02.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.549+0000 7f11d7fff640 1 -- 172.21.15.79:0/4046766063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c51b30130 msgr2=0x563c51b32520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:02.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.549+0000 7f11d7fff640 1 --2- 172.21.15.79:0/4046766063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c51b30130 0x563c51b32520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:02.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.549+0000 7f11d7fff640 1 -- 172.21.15.79:0/4046766063 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c517e9650 con 0x563c51b241a0 2024-08-20T01:47:02.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.550+0000 7f11d7fff640 1 --2- 172.21.15.79:0/4046766063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c51b241a0 0x563c51b2fbf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f11c80a9f30 tx=0x7f11c80a9e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8913b48ab554f35 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:02.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.550+0000 7f11de59c640 1 --2- 172.21.15.79:0/121825487 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f11cc0b3d60 0x7f11cc0b6220 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f11d00096c0 tx=0x7f11d000b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:02.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.550+0000 7f11d4ff9640 1 -- 172.21.15.79:0/4046766063 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c8020040 con 0x563c51b241a0 2024-08-20T01:47:02.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.550+0000 7f11d4ff9640 1 -- 172.21.15.79:0/4046766063 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11c80b32e0 con 0x563c51b241a0 2024-08-20T01:47:02.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.550+0000 7f11d4ff9640 1 -- 172.21.15.79:0/4046766063 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c8004220 con 0x563c51b241a0 2024-08-20T01:47:02.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.551+0000 7f11e7284740 1 -- 172.21.15.79:0/4046766063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c51b241a0 msgr2=0x563c51b2fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:02.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.551+0000 7f11e7284740 1 --2- 172.21.15.79:0/4046766063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c51b241a0 0x563c51b2fbf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f11c80a9f30 tx=0x7f11c80a9e80 comp rx=0 tx=0).stop 2024-08-20T01:47:02.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.555+0000 7f11e7284740 1 -- 172.21.15.79:0/4046766063 shutdown_connections 2024-08-20T01:47:02.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.555+0000 7f11e7284740 1 --2- 172.21.15.79:0/4046766063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c51b30130 0x563c51b32520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:02.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.555+0000 7f11e7284740 1 --2- 172.21.15.79:0/4046766063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c51b241a0 0x563c51b2fbf0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:02.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.555+0000 7f11e7284740 1 --2- 172.21.15.79:0/4046766063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c51b23880 0x563c51b23c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:02.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.555+0000 7f11e7284740 1 -- 172.21.15.79:0/4046766063 >> 172.21.15.79:0/4046766063 conn(0x563c51b216b0 msgr2=0x563c51b22850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:02.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.556+0000 7f11e7284740 1 -- 172.21.15.79:0/4046766063 shutdown_connections 2024-08-20T01:47:02.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.556+0000 7f11e7284740 1 -- 172.21.15.79:0/4046766063 wait complete. 2024-08-20T01:47:02.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.557+0000 7f11e7284740 1 -- start start 2024-08-20T01:47:02.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.557+0000 7f11e7284740 1 Processor -- start 2024-08-20T01:47:02.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.558+0000 7f11e7284740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c51b23880 0x563c51b2d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:02.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.558+0000 7f11e7284740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c51b241a0 0x563c51b2d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:02.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.558+0000 7f11e7284740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c51b30130 0x563c51b2dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:02.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.558+0000 7f11e7284740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563c518ec700 con 0x563c51b241a0 2024-08-20T01:47:02.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.558+0000 7f11e7284740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563c51a10810 con 0x563c51b30130 2024-08-20T01:47:02.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.558+0000 7f11e7284740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563c51b32d80 con 0x563c51b23880 2024-08-20T01:47:02.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.558+0000 7f11e7284740 10 client.0 _ll_register_callbacks cb 0x563c51a83700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:47:02.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.558+0000 7f11d7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c51b241a0 0x563c51b2d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:02.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.559+0000 7f11d7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c51b241a0 0x563c51b2d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60286/0 (socket says 172.21.15.79:60286) 2024-08-20T01:47:02.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.559+0000 7f11d7fff640 1 -- 172.21.15.79:0/1843872073 learned_addr learned my addr 172.21.15.79:0/1843872073 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:02.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.559+0000 7f11ded9d640 1 --2- 172.21.15.79:0/1843872073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c51b30130 0x563c51b2dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:02.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.559+0000 7f11de59c640 1 --2- 172.21.15.79:0/1843872073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c51b23880 0x563c51b2d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:02.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.559+0000 7f11d7fff640 1 -- 172.21.15.79:0/1843872073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c51b23880 msgr2=0x563c51b2d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:02.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.559+0000 7f11d7fff640 1 --2- 172.21.15.79:0/1843872073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c51b23880 0x563c51b2d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:02.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.559+0000 7f11d7fff640 1 -- 172.21.15.79:0/1843872073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c51b30130 msgr2=0x563c51b2dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:02.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.559+0000 7f11d7fff640 1 --2- 172.21.15.79:0/1843872073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c51b30130 0x563c51b2dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:02.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.559+0000 7f11d7fff640 1 -- 172.21.15.79:0/1843872073 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c51b3c260 con 0x563c51b241a0 2024-08-20T01:47:02.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.559+0000 7f11d7fff640 1 --2- 172.21.15.79:0/1843872073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c51b241a0 0x563c51b2d720 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f11c8000c00 tx=0x7f11c80b1de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3b42f77066524b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:02.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.559+0000 7f11c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:47:02.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.559+0000 7f11c5ffb640 1 -- 172.21.15.79:0/1843872073 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c80c8020 con 0x563c51b241a0 2024-08-20T01:47:02.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.560+0000 7f11c5ffb640 1 -- 172.21.15.79:0/1843872073 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f11c80a96a0 con 0x563c51b241a0 2024-08-20T01:47:02.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.560+0000 7f11e7284740 1 -- 172.21.15.79:0/1843872073 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563c51a39150 con 0x563c51b241a0 2024-08-20T01:47:02.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.560+0000 7f11c5ffb640 1 -- 172.21.15.79:0/1843872073 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f11c8020070 con 0x563c51b241a0 2024-08-20T01:47:02.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.560+0000 7f11e7284740 10 client.18168 fetch_fsmap learned FSMap version 45 2024-08-20T01:47:02.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.560+0000 7f11e7284740 1 -- 172.21.15.79:0/1843872073 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x563c51b3ebf0 con 0x563c51b241a0 2024-08-20T01:47:02.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.561+0000 7f11c5ffb640 1 -- 172.21.15.79:0/1843872073 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11c80b32e0 con 0x563c51b241a0 2024-08-20T01:47:02.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.561+0000 7f11c5ffb640 1 -- 172.21.15.79:0/1843872073 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 45) ==== 8378+0+0 (secure 0 0 0) 0x7f11c8023060 con 0x563c51b241a0 2024-08-20T01:47:02.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.561+0000 7f11e7284740 10 client.18168 fetch_fsmap finished waiting for FSMap version 45 2024-08-20T01:47:02.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.561+0000 7f11e7284740 10 client.18168 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:47:02.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.561+0000 7f11e7284740 20 client.18168 populate_metadata read hostname 'smithi079' 2024-08-20T01:47:02.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.561+0000 7f11e7284740 1 --2- 172.21.15.79:0/1843872073 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x563c51b3ff40 0x563c51b42330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:02.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.561+0000 7f11e7284740 4 client.18168 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:47:02.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.562+0000 7f11e7284740 1 -- 172.21.15.79:0/1843872073 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c51a39150 con 0x563c51b3ff40 2024-08-20T01:47:02.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.562+0000 7f11de59c640 1 --2- 172.21.15.79:0/1843872073 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x563c51b3ff40 0x563c51b42330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:02.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.562+0000 7f11de59c640 1 --2- 172.21.15.79:0/1843872073 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x563c51b3ff40 0x563c51b42330 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eab52f2c0f86e99b server_cookie=5f33fa119dfee775 in_seq=0 out_seq=0 2024-08-20T01:47:02.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.562+0000 7f11c5ffb640 10 client.18168 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:47:02.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.563+0000 7f11c5ffb640 1 -- 172.21.15.79:0/1843872073 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563c51a39150 con 0x563c51b3ff40 2024-08-20T01:47:02.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.563+0000 7f11c5ffb640 10 client.18168 handle_command_reply: tid=0 2024-08-20T01:47:02.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.563+0000 7f11e7284740 1 client.18168 shutdown 2024-08-20T01:47:02.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.563+0000 7f11e7284740 1 -- 172.21.15.79:0/1843872073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c51b241a0 msgr2=0x563c51b2d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:02.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.563+0000 7f11e7284740 1 --2- 172.21.15.79:0/1843872073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c51b241a0 0x563c51b2d720 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f11c8000c00 tx=0x7f11c80b1de0 comp rx=0 tx=0).stop 2024-08-20T01:47:02.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.563+0000 7f11e7284740 1 -- 172.21.15.79:0/1843872073 shutdown_connections 2024-08-20T01:47:02.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.563+0000 7f11e7284740 1 --2- 172.21.15.79:0/1843872073 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x563c51b3ff40 0x563c51b42330 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:02.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.563+0000 7f11e7284740 1 --2- 172.21.15.79:0/1843872073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c51b30130 0x563c51b2dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:02.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.563+0000 7f11e7284740 1 --2- 172.21.15.79:0/1843872073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c51b241a0 0x563c51b2d720 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:02.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.563+0000 7f11e7284740 1 --2- 172.21.15.79:0/1843872073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c51b23880 0x563c51b2d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:02.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.563+0000 7f11e7284740 1 -- 172.21.15.79:0/1843872073 >> 172.21.15.79:0/1843872073 conn(0x563c51b216b0 msgr2=0x563c51b27250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:02.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.563+0000 7f11c5ffb640 0 client.18168 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:47:02.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.563+0000 7f11e7284740 1 -- 172.21.15.79:0/1843872073 shutdown_connections 2024-08-20T01:47:02.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.564+0000 7f11e7284740 1 -- 172.21.15.79:0/1843872073 wait complete. 2024-08-20T01:47:02.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.564+0000 7f11e7284740 20 client.18168 trim_cache size 0 max 16384 2024-08-20T01:47:02.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.594+0000 7f11e7284740 1 Processor -- start 2024-08-20T01:47:02.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.594+0000 7f11e7284740 1 -- start start 2024-08-20T01:47:02.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.594+0000 7f11e7284740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c51b23880 0x563c51b27980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:02.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.594+0000 7f11e7284740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c51b241a0 0x563c51b2a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:02.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.594+0000 7f11e7284740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c51b30130 0x563c51b2a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:02.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.594+0000 7f11e7284740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f11e01bcee0 con 0x563c51b241a0 2024-08-20T01:47:02.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.595+0000 7f11de59c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c51b23880 0x563c51b27980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:02.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.595+0000 7f11d7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c51b241a0 0x563c51b2a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:02.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.595+0000 7f11d7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c51b241a0 0x563c51b2a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60302/0 (socket says 172.21.15.79:60302) 2024-08-20T01:47:02.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.595+0000 7f11d7fff640 1 -- 172.21.15.79:0/1157005913 learned_addr learned my addr 172.21.15.79:0/1157005913 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:02.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.595+0000 7f11e7284740 1 -- 172.21.15.79:0/1157005913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f11e01beae0 con 0x563c51b30130 2024-08-20T01:47:02.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.595+0000 7f11e7284740 1 -- 172.21.15.79:0/1157005913 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f11e01bd5b0 con 0x563c51b23880 2024-08-20T01:47:02.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.595+0000 7f11d7fff640 1 -- 172.21.15.79:0/1157005913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c51b23880 msgr2=0x563c51b27980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:02.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.595+0000 7f11d7fff640 1 --2- 172.21.15.79:0/1157005913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c51b23880 0x563c51b27980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:02.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.595+0000 7f11d7fff640 1 -- 172.21.15.79:0/1157005913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c51b30130 msgr2=0x563c51b2a930 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:47:02.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.595+0000 7f11d7fff640 1 --2- 172.21.15.79:0/1157005913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c51b30130 0x563c51b2a930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:02.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.595+0000 7f11d7fff640 1 -- 172.21.15.79:0/1157005913 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c51b22130 con 0x563c51b241a0 2024-08-20T01:47:02.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.596+0000 7f11d7fff640 1 --2- 172.21.15.79:0/1157005913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c51b241a0 0x563c51b2a3f0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f11c80a62b0 tx=0x7f11c8009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a413b7dd84dff30 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:02.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.596+0000 7f11c7fff640 1 -- 172.21.15.79:0/1157005913 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c80c8050 con 0x563c51b241a0 2024-08-20T01:47:02.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.596+0000 7f11c7fff640 1 -- 172.21.15.79:0/1157005913 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11c80b32e0 con 0x563c51b241a0 2024-08-20T01:47:02.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.596+0000 7f11c7fff640 1 -- 172.21.15.79:0/1157005913 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c80a90c0 con 0x563c51b241a0 2024-08-20T01:47:02.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.597+0000 7f11e7284740 1 -- 172.21.15.79:0/1157005913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c51b241a0 msgr2=0x563c51b2a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:02.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.597+0000 7f11e7284740 1 --2- 172.21.15.79:0/1157005913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c51b241a0 0x563c51b2a3f0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f11c80a62b0 tx=0x7f11c8009740 comp rx=0 tx=0).stop 2024-08-20T01:47:02.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.597+0000 7f11e7284740 1 -- 172.21.15.79:0/1157005913 shutdown_connections 2024-08-20T01:47:02.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.598+0000 7f11e7284740 1 --2- 172.21.15.79:0/1157005913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c51b30130 0x563c51b2a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:02.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.598+0000 7f11e7284740 1 --2- 172.21.15.79:0/1157005913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c51b241a0 0x563c51b2a3f0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:02.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.598+0000 7f11e7284740 1 --2- 172.21.15.79:0/1157005913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c51b23880 0x563c51b27980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:02.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.598+0000 7f11e7284740 1 -- 172.21.15.79:0/1157005913 >> 172.21.15.79:0/1157005913 conn(0x563c51b216b0 msgr2=0x563c51b2f030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:02.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.598+0000 7f11e7284740 1 -- 172.21.15.79:0/1157005913 shutdown_connections 2024-08-20T01:47:02.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.598+0000 7f11e7284740 1 -- 172.21.15.79:0/1157005913 wait complete. 2024-08-20T01:47:02.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.598+0000 7f11e7284740 1 -- start start 2024-08-20T01:47:02.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.599+0000 7f11e7284740 1 Processor -- start 2024-08-20T01:47:02.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.599+0000 7f11e7284740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c51b23880 0x563c51b447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:02.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.599+0000 7f11e7284740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c51b241a0 0x563c51b44d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:02.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.600+0000 7f11e7284740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c51b30130 0x563c51bb38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:02.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.600+0000 7f11e7284740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f11e01be410 con 0x563c51b241a0 2024-08-20T01:47:02.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.600+0000 7f11e7284740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f11e01bdc80 con 0x563c51b30130 2024-08-20T01:47:02.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.600+0000 7f11e7284740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f11e01baec0 con 0x563c51b23880 2024-08-20T01:47:02.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.600+0000 7f11e7284740 10 client.0 _ll_register_callbacks cb 0x7f11d8009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:47:02.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.600+0000 7f11de59c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c51b23880 0x563c51b447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:02.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.600+0000 7f11de59c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c51b23880 0x563c51b447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:59232/0 (socket says 172.21.15.79:59232) 2024-08-20T01:47:02.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.600+0000 7f11de59c640 1 -- 172.21.15.79:0/301274025 learned_addr learned my addr 172.21.15.79:0/301274025 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:02.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.600+0000 7f11d7fff640 1 --2- 172.21.15.79:0/301274025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c51b241a0 0x563c51b44d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:02.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.600+0000 7f11ded9d640 1 --2- 172.21.15.79:0/301274025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c51b30130 0x563c51bb38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:02.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.600+0000 7f11de59c640 1 -- 172.21.15.79:0/301274025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c51b30130 msgr2=0x563c51bb38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:02.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.600+0000 7f11de59c640 1 --2- 172.21.15.79:0/301274025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c51b30130 0x563c51bb38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:02.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.600+0000 7f11de59c640 1 -- 172.21.15.79:0/301274025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c51b241a0 msgr2=0x563c51b44d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:02.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.600+0000 7f11de59c640 1 --2- 172.21.15.79:0/301274025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c51b241a0 0x563c51b44d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:02.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.600+0000 7f11de59c640 1 -- 172.21.15.79:0/301274025 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c51bb3fe0 con 0x563c51b23880 2024-08-20T01:47:02.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.601+0000 7f11de59c640 1 --2- 172.21.15.79:0/301274025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c51b23880 0x563c51b447a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f11d0009850 tx=0x7f11d0005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a04a39a3d0f6055e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:02.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.601+0000 7f11c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:47:02.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.601+0000 7f11c5ffb640 1 -- 172.21.15.79:0/301274025 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d0035050 con 0x563c51b23880 2024-08-20T01:47:02.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.601+0000 7f11c5ffb640 1 -- 172.21.15.79:0/301274025 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f11d0049630 con 0x563c51b23880 2024-08-20T01:47:02.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.601+0000 7f11e7284740 1 -- 172.21.15.79:0/301274025 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11c80b32e0 con 0x563c51b23880 2024-08-20T01:47:02.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.604+0000 7f11c5ffb640 1 -- 172.21.15.79:0/301274025 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f11d0049830 con 0x563c51b23880 2024-08-20T01:47:02.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.605+0000 7f11e7284740 10 client.27169 fetch_fsmap learned FSMap version 45 2024-08-20T01:47:02.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.605+0000 7f11e7284740 1 -- 172.21.15.79:0/301274025 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x563c51bbb400 con 0x563c51b23880 2024-08-20T01:47:02.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.606+0000 7f11c5ffb640 1 -- 172.21.15.79:0/301274025 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11d0059430 con 0x563c51b23880 2024-08-20T01:47:02.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.606+0000 7f11c5ffb640 1 -- 172.21.15.79:0/301274025 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 45) ==== 8378+0+0 (secure 0 0 0) 0x7f11d003b430 con 0x563c51b23880 2024-08-20T01:47:02.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.607+0000 7f11e7284740 10 client.27169 fetch_fsmap finished waiting for FSMap version 45 2024-08-20T01:47:02.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.607+0000 7f11e7284740 10 client.27169 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:47:02.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.607+0000 7f11e7284740 20 client.27169 populate_metadata read hostname 'smithi079' 2024-08-20T01:47:02.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.607+0000 7f11e7284740 1 --2- 172.21.15.79:0/301274025 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x563c51bbba90 0x563c51bbdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:02.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.607+0000 7f11e7284740 4 client.27169 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:47:02.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.607+0000 7f11e7284740 1 -- 172.21.15.79:0/301274025 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f11c80b32e0 con 0x563c51bbba90 2024-08-20T01:47:02.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.607+0000 7f11d7fff640 1 --2- 172.21.15.79:0/301274025 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x563c51bbba90 0x563c51bbdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:02.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.608+0000 7f11d7fff640 1 --2- 172.21.15.79:0/301274025 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x563c51bbba90 0x563c51bbdeb0 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23b93b799cfb0590 server_cookie=60b5e16286ea396b in_seq=0 out_seq=0 2024-08-20T01:47:02.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.608+0000 7f11c5ffb640 10 client.27169 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:47:02.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.608+0000 7f11c5ffb640 1 -- 172.21.15.79:0/301274025 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f11c80b32e0 con 0x563c51bbba90 2024-08-20T01:47:02.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.608+0000 7f11c5ffb640 10 client.27169 handle_command_reply: tid=0 2024-08-20T01:47:02.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.608+0000 7f11e7284740 1 client.27169 shutdown 2024-08-20T01:47:02.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.610+0000 7f11e7284740 1 -- 172.21.15.79:0/301274025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c51b23880 msgr2=0x563c51b447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:02.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.610+0000 7f11e7284740 1 --2- 172.21.15.79:0/301274025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c51b23880 0x563c51b447a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f11d0009850 tx=0x7f11d0005fd0 comp rx=0 tx=0).stop 2024-08-20T01:47:02.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.611+0000 7f11e7284740 1 -- 172.21.15.79:0/301274025 shutdown_connections 2024-08-20T01:47:02.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.611+0000 7f11e7284740 1 --2- 172.21.15.79:0/301274025 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x563c51bbba90 0x563c51bbdeb0 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:02.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.611+0000 7f11c5ffb640 0 client.27169 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:47:02.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.611+0000 7f11e7284740 1 --2- 172.21.15.79:0/301274025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c51b30130 0x563c51bb38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:02.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.611+0000 7f11e7284740 1 --2- 172.21.15.79:0/301274025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c51b241a0 0x563c51b44d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:02.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.611+0000 7f11e7284740 1 --2- 172.21.15.79:0/301274025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c51b23880 0x563c51b447a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:02.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.611+0000 7f11e7284740 1 -- 172.21.15.79:0/301274025 >> 172.21.15.79:0/301274025 conn(0x563c51b216b0 msgr2=0x563c51b3b010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:02.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.611+0000 7f11e7284740 1 -- 172.21.15.79:0/301274025 shutdown_connections 2024-08-20T01:47:02.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.612+0000 7f11e7284740 1 -- 172.21.15.79:0/301274025 wait complete. 2024-08-20T01:47:02.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.612+0000 7f11e7284740 20 client.27169 trim_cache size 0 max 16384 2024-08-20T01:47:02.617 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:47:02.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.613+0000 7f11e4e8b640 1 -- 172.21.15.79:0/121825487 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f11cc0b3d60 msgr2=0x7f11cc0b6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:02.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.613+0000 7f11e4e8b640 1 --2- 172.21.15.79:0/121825487 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f11cc0b3d60 0x7f11cc0b6220 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f11d00096c0 tx=0x7f11d000b040 comp rx=0 tx=0).stop 2024-08-20T01:47:02.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.613+0000 7f11e4e8b640 1 -- 172.21.15.79:0/121825487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11e010a6d0 msgr2=0x7f11e010e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:02.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.613+0000 7f11e4e8b640 1 --2- 172.21.15.79:0/121825487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11e010a6d0 0x7f11e010e650 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f11c8005fd0 tx=0x7f11c800dde0 comp rx=0 tx=0).stop 2024-08-20T01:47:02.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.613+0000 7f11e4e8b640 1 -- 172.21.15.79:0/121825487 shutdown_connections 2024-08-20T01:47:02.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.613+0000 7f11e4e8b640 1 --2- 172.21.15.79:0/121825487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11e010b050 0x7f11e010eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:02.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.613+0000 7f11e4e8b640 1 --2- 172.21.15.79:0/121825487 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f11cc0b3d60 0x7f11cc0b6220 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:02.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.613+0000 7f11e4e8b640 1 --2- 172.21.15.79:0/121825487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11e010a6d0 0x7f11e010e650 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:02.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.613+0000 7f11e4e8b640 1 --2- 172.21.15.79:0/121825487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11e0104cc0 0x7f11e0111400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:02.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.613+0000 7f11e4e8b640 1 -- 172.21.15.79:0/121825487 >> 172.21.15.79:0/121825487 conn(0x7f11e01006f0 msgr2=0x7f11e0108d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:02.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.614+0000 7f11e4e8b640 1 -- 172.21.15.79:0/121825487 shutdown_connections 2024-08-20T01:47:02.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:02.614+0000 7f11e4e8b640 1 -- 172.21.15.79:0/121825487 wait complete. 2024-08-20T01:47:04.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:03 smithi081 ceph-mon[22209]: pgmap v639: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 6.13k op/s 2024-08-20T01:47:04.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:03 smithi175 ceph-mon[22392]: pgmap v639: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 6.13k op/s 2024-08-20T01:47:04.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:03 smithi079 ceph-mon[18656]: pgmap v639: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 6.13k op/s 2024-08-20T01:47:04.495 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T01:47:04.496 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T01:47:04.932 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:47:05.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.500+0000 7f4c19d66640 1 -- 172.21.15.79:0/767378330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c14107d20 msgr2=0x7f4c1410e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:05.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.500+0000 7f4c19d66640 1 --2- 172.21.15.79:0/767378330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c14107d20 0x7f4c1410e520 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c009be0 tx=0x7f4c0c02a6c0 comp rx=0 tx=0).stop 2024-08-20T01:47:05.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.500+0000 7f4c19d66640 1 -- 172.21.15.79:0/767378330 shutdown_connections 2024-08-20T01:47:05.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.500+0000 7f4c19d66640 1 --2- 172.21.15.79:0/767378330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c14107d20 0x7f4c1410e520 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:05.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.501+0000 7f4c19d66640 1 --2- 172.21.15.79:0/767378330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c141073a0 0x7f4c141077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:05.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.501+0000 7f4c19d66640 1 --2- 172.21.15.79:0/767378330 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c14101990 0x7f4c14101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:05.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.501+0000 7f4c19d66640 1 -- 172.21.15.79:0/767378330 >> 172.21.15.79:0/767378330 conn(0x7f4c140fd400 msgr2=0x7f4c140ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:05.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.501+0000 7f4c19d66640 1 -- 172.21.15.79:0/767378330 shutdown_connections 2024-08-20T01:47:05.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.501+0000 7f4c19d66640 1 -- 172.21.15.79:0/767378330 wait complete. 2024-08-20T01:47:05.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.502+0000 7f4c19d66640 1 Processor -- start 2024-08-20T01:47:05.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.502+0000 7f4c19d66640 1 -- start start 2024-08-20T01:47:05.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.503+0000 7f4c19d66640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c14101990 0x7f4c14197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:05.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.503+0000 7f4c19d66640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c141073a0 0x7f4c141982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:05.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.503+0000 7f4c137fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c14101990 0x7f4c14197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:05.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.503+0000 7f4c137fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c14101990 0x7f4c14197d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:59246/0 (socket says 172.21.15.79:59246) 2024-08-20T01:47:05.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.503+0000 7f4c12ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c141073a0 0x7f4c141982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:05.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.503+0000 7f4c12ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c141073a0 0x7f4c141982a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:48754/0 (socket says 172.21.15.79:48754) 2024-08-20T01:47:05.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.503+0000 7f4c12ffd640 1 -- 172.21.15.79:0/3665028793 learned_addr learned my addr 172.21.15.79:0/3665028793 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:05.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.503+0000 7f4c19d66640 1 --2- 172.21.15.79:0/3665028793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c14107d20 0x7f4c1419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:05.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.503+0000 7f4c19d66640 1 -- 172.21.15.79:0/3665028793 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4c14111890 con 0x7f4c14107d20 2024-08-20T01:47:05.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.504+0000 7f4c19d66640 1 -- 172.21.15.79:0/3665028793 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4c14111710 con 0x7f4c141073a0 2024-08-20T01:47:05.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.504+0000 7f4c19d66640 1 -- 172.21.15.79:0/3665028793 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4c14111a10 con 0x7f4c14101990 2024-08-20T01:47:05.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.504+0000 7f4c13fff640 1 --2- 172.21.15.79:0/3665028793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c14107d20 0x7f4c1419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:05.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.504+0000 7f4c12ffd640 1 -- 172.21.15.79:0/3665028793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c14101990 msgr2=0x7f4c14197d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:05.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.504+0000 7f4c12ffd640 1 --2- 172.21.15.79:0/3665028793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c14101990 0x7f4c14197d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:05.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.504+0000 7f4c12ffd640 1 -- 172.21.15.79:0/3665028793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c14107d20 msgr2=0x7f4c1419d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:05.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.504+0000 7f4c12ffd640 1 --2- 172.21.15.79:0/3665028793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c14107d20 0x7f4c1419d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:05.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.505+0000 7f4c12ffd640 1 -- 172.21.15.79:0/3665028793 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c1419de10 con 0x7f4c141073a0 2024-08-20T01:47:05.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.505+0000 7f4c13fff640 1 --2- 172.21.15.79:0/3665028793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c14107d20 0x7f4c1419d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:47:05.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.505+0000 7f4c137fe640 1 --2- 172.21.15.79:0/3665028793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c14101990 0x7f4c14197d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:47:05.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.505+0000 7f4c12ffd640 1 --2- 172.21.15.79:0/3665028793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c141073a0 0x7f4c141982a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4c0800e9c0 tx=0x7f4c0800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:05.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.505+0000 7f4c10ff9640 1 -- 172.21.15.79:0/3665028793 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0800cde0 con 0x7f4c141073a0 2024-08-20T01:47:05.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.505+0000 7f4c19d66640 1 -- 172.21.15.79:0/3665028793 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c1419e100 con 0x7f4c141073a0 2024-08-20T01:47:05.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.505+0000 7f4c10ff9640 1 -- 172.21.15.79:0/3665028793 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c080035f0 con 0x7f4c141073a0 2024-08-20T01:47:05.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.505+0000 7f4c10ff9640 1 -- 172.21.15.79:0/3665028793 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0800cde0 con 0x7f4c141073a0 2024-08-20T01:47:05.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.506+0000 7f4c19d66640 1 -- 172.21.15.79:0/3665028793 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c1406a980 con 0x7f4c141073a0 2024-08-20T01:47:05.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.509+0000 7f4c10ff9640 1 -- 172.21.15.79:0/3665028793 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f4c080037a0 con 0x7f4c141073a0 2024-08-20T01:47:05.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.511+0000 7f4c10ff9640 1 --2- 172.21.15.79:0/3665028793 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4bfc0b61d0 0x7f4bfc0b8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:05.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.511+0000 7f4c137fe640 1 --2- 172.21.15.79:0/3665028793 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4bfc0b61d0 0x7f4bfc0b8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:05.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.511+0000 7f4c1c15f740 1 Processor -- start 2024-08-20T01:47:05.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.511+0000 7f4c1c15f740 1 -- start start 2024-08-20T01:47:05.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.511+0000 7f4c1c15f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4cbca3b0 0x55be4cbca790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:05.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.511+0000 7f4c1c15f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4cbd4710 0x55be4cbcacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:05.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.511+0000 7f4c1c15f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4cbdf310 0x55be4cbe1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:05.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.511+0000 7f4c1c15f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55be4cb40940 con 0x55be4cbd4710 2024-08-20T01:47:05.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.511+0000 7f4c1c15f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55be4cb2fe40 con 0x55be4cbdf310 2024-08-20T01:47:05.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.511+0000 7f4c1c15f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55be4cb33e80 con 0x55be4cbca3b0 2024-08-20T01:47:05.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.512+0000 7f4c13fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4cbdf310 0x55be4cbe1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:05.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.512+0000 7f4c13fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4cbdf310 0x55be4cbe1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:48756/0 (socket says 172.21.15.79:48756) 2024-08-20T01:47:05.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.512+0000 7f4c13fff640 1 -- 172.21.15.79:0/673616868 learned_addr learned my addr 172.21.15.79:0/673616868 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:05.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.513+0000 7f4c137fe640 1 --2- 172.21.15.79:0/673616868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4cbca3b0 0x55be4cbca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:05.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.513+0000 7f4c13fff640 1 -- 172.21.15.79:0/673616868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4cbca3b0 msgr2=0x55be4cbca790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:05.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.513+0000 7f4c13fff640 1 --2- 172.21.15.79:0/673616868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4cbca3b0 0x55be4cbca790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:05.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.513+0000 7f4c13fff640 1 -- 172.21.15.79:0/673616868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4cbd4710 msgr2=0x55be4cbcacd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:47:05.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.513+0000 7f4c13fff640 1 --2- 172.21.15.79:0/673616868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4cbd4710 0x55be4cbcacd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:05.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.513+0000 7f4c13fff640 1 -- 172.21.15.79:0/673616868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be4cacc520 con 0x55be4cbdf310 2024-08-20T01:47:05.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.513+0000 7f4c137fe640 1 --2- 172.21.15.79:0/673616868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4cbca3b0 0x55be4cbca790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:47:05.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.513+0000 7f4c13fff640 1 --2- 172.21.15.79:0/673616868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4cbdf310 0x55be4cbe1700 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c02acb0 tx=0x7f4c0c030f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e26ebfa8202bcac server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:05.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.514+0000 7f4c10ff9640 1 -- 172.21.15.79:0/3665028793 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f4c0800cbe0 con 0x7f4c141073a0 2024-08-20T01:47:05.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.514+0000 7f4c137fe640 1 --2- 172.21.15.79:0/3665028793 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4bfc0b61d0 0x7f4bfc0b8690 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4c04009710 tx=0x7f4c040096a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:05.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.517+0000 7f4bf9ffb640 1 -- 172.21.15.79:0/673616868 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c041030 con 0x55be4cbdf310 2024-08-20T01:47:05.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.517+0000 7f4bf9ffb640 1 -- 172.21.15.79:0/673616868 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c0c037040 con 0x55be4cbdf310 2024-08-20T01:47:05.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.518+0000 7f4c1c15f740 1 -- 172.21.15.79:0/673616868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4cbdf310 msgr2=0x55be4cbe1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:05.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.518+0000 7f4c1c15f740 1 --2- 172.21.15.79:0/673616868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4cbdf310 0x55be4cbe1700 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c02acb0 tx=0x7f4c0c030f60 comp rx=0 tx=0).stop 2024-08-20T01:47:05.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.520+0000 7f4c1c15f740 1 -- 172.21.15.79:0/673616868 shutdown_connections 2024-08-20T01:47:05.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.520+0000 7f4c1c15f740 1 --2- 172.21.15.79:0/673616868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4cbdf310 0x55be4cbe1700 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:05.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.520+0000 7f4c1c15f740 1 --2- 172.21.15.79:0/673616868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4cbd4710 0x55be4cbcacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:05.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.520+0000 7f4c1c15f740 1 --2- 172.21.15.79:0/673616868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4cbca3b0 0x55be4cbca790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:05.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.520+0000 7f4c1c15f740 1 -- 172.21.15.79:0/673616868 >> 172.21.15.79:0/673616868 conn(0x55be4cbc81e0 msgr2=0x55be4cbc9380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:05.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.521+0000 7f4c1c15f740 1 -- 172.21.15.79:0/673616868 shutdown_connections 2024-08-20T01:47:05.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.521+0000 7f4c1c15f740 1 -- 172.21.15.79:0/673616868 wait complete. 2024-08-20T01:47:05.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.521+0000 7f4c1c15f740 1 -- start start 2024-08-20T01:47:05.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.522+0000 7f4c1c15f740 1 Processor -- start 2024-08-20T01:47:05.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.522+0000 7f4c1c15f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4cbca3b0 0x55be4cbd37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:05.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.522+0000 7f4c1c15f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4cbd4710 0x55be4cbdebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:05.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.522+0000 7f4c1c15f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4cbdf310 0x55be4cbd3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:05.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.522+0000 7f4c1c15f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55be4c992890 con 0x55be4cbd4710 2024-08-20T01:47:05.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.522+0000 7f4c1c15f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55be4cab6700 con 0x55be4cbca3b0 2024-08-20T01:47:05.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.522+0000 7f4c1c15f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55be4cbd4f80 con 0x55be4cbdf310 2024-08-20T01:47:05.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.523+0000 7f4c1c15f740 10 client.0 _ll_register_callbacks cb 0x55be4cb2b6f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:47:05.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.523+0000 7f4c13fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4cbdf310 0x55be4cbd3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:05.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.523+0000 7f4c13fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4cbdf310 0x55be4cbd3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:59266/0 (socket says 172.21.15.79:59266) 2024-08-20T01:47:05.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.523+0000 7f4c13fff640 1 -- 172.21.15.79:0/1378672556 learned_addr learned my addr 172.21.15.79:0/1378672556 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:05.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.523+0000 7f4c13fff640 1 -- 172.21.15.79:0/1378672556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4cbca3b0 msgr2=0x55be4cbd37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:05.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.523+0000 7f4c13fff640 1 --2- 172.21.15.79:0/1378672556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4cbca3b0 0x55be4cbd37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:05.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.523+0000 7f4c13fff640 1 -- 172.21.15.79:0/1378672556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4cbd4710 msgr2=0x55be4cbdebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:05.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.523+0000 7f4c13fff640 1 --2- 172.21.15.79:0/1378672556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4cbd4710 0x55be4cbdebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:05.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.523+0000 7f4c13fff640 1 -- 172.21.15.79:0/1378672556 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be4c88f930 con 0x55be4cbdf310 2024-08-20T01:47:05.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.524+0000 7f4c13fff640 1 --2- 172.21.15.79:0/1378672556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4cbdf310 0x55be4cbd3d90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c009b30 tx=0x7f4c0c003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49d6834e9d347287 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:05.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.524+0000 7f4bf2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:47:05.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.524+0000 7f4bf2ffd640 1 -- 172.21.15.79:0/1378672556 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c04a070 con 0x55be4cbdf310 2024-08-20T01:47:05.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.524+0000 7f4c1c15f740 1 -- 172.21.15.79:0/1378672556 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c0c037040 con 0x55be4cbdf310 2024-08-20T01:47:05.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.524+0000 7f4bf2ffd640 1 -- 172.21.15.79:0/1378672556 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f4c0c004340 con 0x55be4cbdf310 2024-08-20T01:47:05.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.524+0000 7f4bf2ffd640 1 -- 172.21.15.79:0/1378672556 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f4c0c056050 con 0x55be4cbdf310 2024-08-20T01:47:05.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.525+0000 7f4c1c15f740 10 client.27181 fetch_fsmap learned FSMap version 45 2024-08-20T01:47:05.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.525+0000 7f4c1c15f740 1 -- 172.21.15.79:0/1378672556 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55be4cbf64b0 con 0x55be4cbdf310 2024-08-20T01:47:05.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.525+0000 7f4bf2ffd640 1 -- 172.21.15.79:0/1378672556 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c0c037040 con 0x55be4cbdf310 2024-08-20T01:47:05.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.525+0000 7f4bf2ffd640 1 -- 172.21.15.79:0/1378672556 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 45) ==== 8378+0+0 (secure 0 0 0) 0x7f4c0c03c040 con 0x55be4cbdf310 2024-08-20T01:47:05.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.525+0000 7f4c1c15f740 10 client.27181 fetch_fsmap finished waiting for FSMap version 45 2024-08-20T01:47:05.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.525+0000 7f4c1c15f740 10 client.27181 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:47:05.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.525+0000 7f4c1c15f740 20 client.27181 populate_metadata read hostname 'smithi079' 2024-08-20T01:47:05.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.525+0000 7f4c1c15f740 1 --2- 172.21.15.79:0/1378672556 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55be4cbf7a60 0x55be4cbf9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:05.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.525+0000 7f4c1c15f740 4 client.27181 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:47:05.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.525+0000 7f4c1c15f740 1 -- 172.21.15.79:0/1378672556 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55be4cb42890 con 0x55be4cbf7a60 2024-08-20T01:47:05.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.525+0000 7f4c137fe640 1 --2- 172.21.15.79:0/1378672556 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55be4cbf7a60 0x55be4cbf9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:05.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.526+0000 7f4c137fe640 1 --2- 172.21.15.79:0/1378672556 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55be4cbf7a60 0x55be4cbf9ee0 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f24a5ae81606c9ba server_cookie=35e21a4846cf6d07 in_seq=0 out_seq=0 2024-08-20T01:47:05.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.526+0000 7f4bf2ffd640 10 client.27181 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:47:05.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.526+0000 7f4bf2ffd640 1 -- 172.21.15.79:0/1378672556 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55be4cb42890 con 0x55be4cbf7a60 2024-08-20T01:47:05.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.526+0000 7f4bf2ffd640 10 client.27181 handle_command_reply: tid=0 2024-08-20T01:47:05.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.526+0000 7f4c1c15f740 1 client.27181 shutdown 2024-08-20T01:47:05.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.527+0000 7f4c1c15f740 1 -- 172.21.15.79:0/1378672556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4cbdf310 msgr2=0x55be4cbd3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:05.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.527+0000 7f4c1c15f740 1 --2- 172.21.15.79:0/1378672556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4cbdf310 0x55be4cbd3d90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c009b30 tx=0x7f4c0c003ba0 comp rx=0 tx=0).stop 2024-08-20T01:47:05.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.527+0000 7f4c1c15f740 1 -- 172.21.15.79:0/1378672556 shutdown_connections 2024-08-20T01:47:05.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.527+0000 7f4c1c15f740 1 --2- 172.21.15.79:0/1378672556 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55be4cbf7a60 0x55be4cbf9ee0 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:05.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.527+0000 7f4c1c15f740 1 --2- 172.21.15.79:0/1378672556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4cbdf310 0x55be4cbd3d90 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:05.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.527+0000 7f4c1c15f740 1 --2- 172.21.15.79:0/1378672556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4cbd4710 0x55be4cbdebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:05.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.527+0000 7f4c1c15f740 1 --2- 172.21.15.79:0/1378672556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4cbca3b0 0x55be4cbd37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:05.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.527+0000 7f4c1c15f740 1 -- 172.21.15.79:0/1378672556 >> 172.21.15.79:0/1378672556 conn(0x55be4cbc81e0 msgr2=0x55be4cbcd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:05.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.527+0000 7f4bf2ffd640 0 client.27181 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:47:05.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.527+0000 7f4c1c15f740 1 -- 172.21.15.79:0/1378672556 shutdown_connections 2024-08-20T01:47:05.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.527+0000 7f4c1c15f740 1 -- 172.21.15.79:0/1378672556 wait complete. 2024-08-20T01:47:05.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.527+0000 7f4c1c15f740 20 client.27181 trim_cache size 0 max 16384 2024-08-20T01:47:05.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.559+0000 7f4c1c15f740 1 Processor -- start 2024-08-20T01:47:05.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.559+0000 7f4c1c15f740 1 -- start start 2024-08-20T01:47:05.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.560+0000 7f4c1c15f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4cbc81e0 0x55be4cbff7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:05.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.560+0000 7f4c1c15f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4cbca3b0 0x55be4cbffcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:05.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.560+0000 7f4c1c15f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4cbd4710 0x55be4cbd0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:05.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.560+0000 7f4c1c15f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4c141abcc0 con 0x55be4cbc81e0 2024-08-20T01:47:05.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.560+0000 7f4c1c15f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4c141ad8c0 con 0x55be4cbd4710 2024-08-20T01:47:05.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.560+0000 7f4c13fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4cbd4710 0x55be4cbd0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:05.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.560+0000 7f4c1c15f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4c141ac390 con 0x55be4cbca3b0 2024-08-20T01:47:05.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.560+0000 7f4c13fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4cbd4710 0x55be4cbd0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:48784/0 (socket says 172.21.15.79:48784) 2024-08-20T01:47:05.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.560+0000 7f4c13fff640 1 -- 172.21.15.79:0/2790344647 learned_addr learned my addr 172.21.15.79:0/2790344647 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:05.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.560+0000 7f4c137fe640 1 --2- 172.21.15.79:0/2790344647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4cbc81e0 0x55be4cbff7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:05.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.560+0000 7f4c12ffd640 1 --2- 172.21.15.79:0/2790344647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4cbca3b0 0x55be4cbffcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:05.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.561+0000 7f4c13fff640 1 -- 172.21.15.79:0/2790344647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4cbca3b0 msgr2=0x55be4cbffcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:05.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.561+0000 7f4c13fff640 1 --2- 172.21.15.79:0/2790344647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4cbca3b0 0x55be4cbffcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:05.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.561+0000 7f4c13fff640 1 -- 172.21.15.79:0/2790344647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4cbc81e0 msgr2=0x55be4cbff7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:05.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.561+0000 7f4c13fff640 1 --2- 172.21.15.79:0/2790344647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4cbc81e0 0x55be4cbff7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:05.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.561+0000 7f4c13fff640 1 -- 172.21.15.79:0/2790344647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be4cbe1a70 con 0x55be4cbd4710 2024-08-20T01:47:05.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.561+0000 7f4c13fff640 1 --2- 172.21.15.79:0/2790344647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4cbd4710 0x55be4cbd0800 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c02abe0 tx=0x7f4c0c046410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=196de23a948a40b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:05.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.561+0000 7f4bf97fa640 1 -- 172.21.15.79:0/2790344647 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c04a070 con 0x55be4cbd4710 2024-08-20T01:47:05.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.561+0000 7f4bf97fa640 1 -- 172.21.15.79:0/2790344647 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c0c003e10 con 0x55be4cbd4710 2024-08-20T01:47:05.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.561+0000 7f4bf97fa640 1 -- 172.21.15.79:0/2790344647 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c041040 con 0x55be4cbd4710 2024-08-20T01:47:05.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.562+0000 7f4c1c15f740 1 -- 172.21.15.79:0/2790344647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4cbd4710 msgr2=0x55be4cbd0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:05.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.562+0000 7f4c1c15f740 1 --2- 172.21.15.79:0/2790344647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4cbd4710 0x55be4cbd0800 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c02abe0 tx=0x7f4c0c046410 comp rx=0 tx=0).stop 2024-08-20T01:47:05.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.562+0000 7f4c1c15f740 1 -- 172.21.15.79:0/2790344647 shutdown_connections 2024-08-20T01:47:05.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.562+0000 7f4c1c15f740 1 --2- 172.21.15.79:0/2790344647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4cbd4710 0x55be4cbd0800 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:05.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.562+0000 7f4c1c15f740 1 --2- 172.21.15.79:0/2790344647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4cbca3b0 0x55be4cbffcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:05.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.563+0000 7f4c1c15f740 1 --2- 172.21.15.79:0/2790344647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4cbc81e0 0x55be4cbff7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:05.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.563+0000 7f4c1c15f740 1 -- 172.21.15.79:0/2790344647 >> 172.21.15.79:0/2790344647 conn(0x55be4cbc36e0 msgr2=0x55be4cbc96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:05.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.563+0000 7f4c1c15f740 1 -- 172.21.15.79:0/2790344647 shutdown_connections 2024-08-20T01:47:05.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.563+0000 7f4c1c15f740 1 -- 172.21.15.79:0/2790344647 wait complete. 2024-08-20T01:47:05.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.564+0000 7f4c1c15f740 1 -- start start 2024-08-20T01:47:05.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.564+0000 7f4c1c15f740 1 Processor -- start 2024-08-20T01:47:05.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.565+0000 7f4c1c15f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4cbc81e0 0x55be4cc075e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:05.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.565+0000 7f4c1c15f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4cbca3b0 0x55be4cc07b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:05.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.565+0000 7f4c137fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4cbc81e0 0x55be4cc075e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:05.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.565+0000 7f4c137fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4cbc81e0 0x55be4cc075e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:59284/0 (socket says 172.21.15.79:59284) 2024-08-20T01:47:05.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.565+0000 7f4c137fe640 1 -- 172.21.15.79:0/4035026362 learned_addr learned my addr 172.21.15.79:0/4035026362 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:05.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.565+0000 7f4c1c15f740 1 --2- 172.21.15.79:0/4035026362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4cbd4710 0x55be4cc08060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:05.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.565+0000 7f4c1c15f740 1 -- 172.21.15.79:0/4035026362 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4c141ad1f0 con 0x55be4cbca3b0 2024-08-20T01:47:05.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.565+0000 7f4c1c15f740 1 -- 172.21.15.79:0/4035026362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4c141aca60 con 0x55be4cbd4710 2024-08-20T01:47:05.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.566+0000 7f4c13fff640 1 --2- 172.21.15.79:0/4035026362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4cbd4710 0x55be4cc08060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:05.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.566+0000 7f4c12ffd640 1 --2- 172.21.15.79:0/4035026362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4cbca3b0 0x55be4cc07b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:05.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.566+0000 7f4c1c15f740 1 -- 172.21.15.79:0/4035026362 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4c141a9ca0 con 0x55be4cbc81e0 2024-08-20T01:47:05.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.566+0000 7f4c137fe640 1 -- 172.21.15.79:0/4035026362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4cbd4710 msgr2=0x55be4cc08060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:05.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.566+0000 7f4c137fe640 1 --2- 172.21.15.79:0/4035026362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4cbd4710 0x55be4cc08060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:05.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.566+0000 7f4c137fe640 1 -- 172.21.15.79:0/4035026362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4cbca3b0 msgr2=0x55be4cc07b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:05.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.566+0000 7f4c137fe640 1 --2- 172.21.15.79:0/4035026362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4cbca3b0 0x55be4cc07b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:05.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.566+0000 7f4c137fe640 1 -- 172.21.15.79:0/4035026362 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be4cc618a0 con 0x55be4cbc81e0 2024-08-20T01:47:05.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.567+0000 7f4c137fe640 1 --2- 172.21.15.79:0/4035026362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4cbc81e0 0x55be4cc075e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55be4cbfa6f0 tx=0x7f4c040046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2e2e5f71149547 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:05.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.567+0000 7f4bf2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:47:05.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.567+0000 7f4c1c15f740 10 client.0 _ll_register_callbacks cb 0x7f4c04005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:47:05.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.567+0000 7f4bf2ffd640 1 -- 172.21.15.79:0/4035026362 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c04011e40 con 0x55be4cbc81e0 2024-08-20T01:47:05.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.567+0000 7f4bf2ffd640 1 -- 172.21.15.79:0/4035026362 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f4c040208c0 con 0x55be4cbc81e0 2024-08-20T01:47:05.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.567+0000 7f4c1c15f740 1 -- 172.21.15.79:0/4035026362 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c0c003e10 con 0x55be4cbc81e0 2024-08-20T01:47:05.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.567+0000 7f4bf2ffd640 1 -- 172.21.15.79:0/4035026362 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f4c04020ac0 con 0x55be4cbc81e0 2024-08-20T01:47:05.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.567+0000 7f4c1c15f740 10 client.27187 fetch_fsmap learned FSMap version 45 2024-08-20T01:47:05.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.567+0000 7f4c1c15f740 1 -- 172.21.15.79:0/4035026362 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({fsmap=45}) -- 0x55be4cc62ae0 con 0x55be4cbc81e0 2024-08-20T01:47:05.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.568+0000 7f4bf2ffd640 1 -- 172.21.15.79:0/4035026362 <== mon.1 v2:172.21.15.175:3300/0 4 ==== fsmap(e 45) ==== 8378+0+0 (secure 0 0 0) 0x7f4c0401d040 con 0x55be4cbc81e0 2024-08-20T01:47:05.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.568+0000 7f4c1c15f740 10 client.27187 fetch_fsmap finished waiting for FSMap version 45 2024-08-20T01:47:05.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.568+0000 7f4c1c15f740 10 client.27187 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:47:05.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.568+0000 7f4c1c15f740 20 client.27187 populate_metadata read hostname 'smithi079' 2024-08-20T01:47:05.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.568+0000 7f4c1c15f740 1 --2- 172.21.15.79:0/4035026362 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55be4cbdf310 0x55be4cc650d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:05.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.568+0000 7f4c1c15f740 4 client.27187 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T01:47:05.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.568+0000 7f4c1c15f740 1 -- 172.21.15.79:0/4035026362 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f4c0c003e10 con 0x55be4cbdf310 2024-08-20T01:47:05.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.568+0000 7f4c12ffd640 1 --2- 172.21.15.79:0/4035026362 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55be4cbdf310 0x55be4cc650d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:05.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.569+0000 7f4c12ffd640 1 --2- 172.21.15.79:0/4035026362 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55be4cbdf310 0x55be4cc650d0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46a7a556b6125d93 server_cookie=19931008a5b7997d in_seq=0 out_seq=0 2024-08-20T01:47:05.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.569+0000 7f4bf2ffd640 10 client.27187 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:47:05.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.571+0000 7f4bf2ffd640 1 -- 172.21.15.79:0/4035026362 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f4c0c003e10 con 0x55be4cbdf310 2024-08-20T01:47:05.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.571+0000 7f4bf2ffd640 10 client.27187 handle_command_reply: tid=0 2024-08-20T01:47:05.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.571+0000 7f4c1c15f740 1 client.27187 shutdown 2024-08-20T01:47:05.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.572+0000 7f4c1c15f740 1 -- 172.21.15.79:0/4035026362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4cbc81e0 msgr2=0x55be4cc075e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:05.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.572+0000 7f4c1c15f740 1 --2- 172.21.15.79:0/4035026362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4cbc81e0 0x55be4cc075e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55be4cbfa6f0 tx=0x7f4c040046c0 comp rx=0 tx=0).stop 2024-08-20T01:47:05.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.572+0000 7f4c1c15f740 1 -- 172.21.15.79:0/4035026362 shutdown_connections 2024-08-20T01:47:05.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.572+0000 7f4c1c15f740 1 --2- 172.21.15.79:0/4035026362 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55be4cbdf310 0x55be4cc650d0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:05.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.572+0000 7f4c1c15f740 1 --2- 172.21.15.79:0/4035026362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4cbd4710 0x55be4cc08060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:05.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.572+0000 7f4c1c15f740 1 --2- 172.21.15.79:0/4035026362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4cbca3b0 0x55be4cc07b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:05.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.572+0000 7f4c1c15f740 1 --2- 172.21.15.79:0/4035026362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4cbc81e0 0x55be4cc075e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:05.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.572+0000 7f4c1c15f740 1 -- 172.21.15.79:0/4035026362 >> 172.21.15.79:0/4035026362 conn(0x55be4cbc36e0 msgr2=0x55be4cbd8880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:05.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.572+0000 7f4bf2ffd640 0 client.27187 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:47:05.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.572+0000 7f4c1c15f740 1 -- 172.21.15.79:0/4035026362 shutdown_connections 2024-08-20T01:47:05.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.572+0000 7f4c1c15f740 1 -- 172.21.15.79:0/4035026362 wait complete. 2024-08-20T01:47:05.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.573+0000 7f4c1c15f740 20 client.27187 trim_cache size 0 max 16384 2024-08-20T01:47:05.576 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:47:05.576 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-08-20T01:47:05.576 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "924b951b-4aa0-428e-823a-582e5ed24852", 2024-08-20T01:47:05.577 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-08-20T01:47:05.577 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:47:05.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.574+0000 7f4c19d66640 1 -- 172.21.15.79:0/3665028793 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4bfc0b61d0 msgr2=0x7f4bfc0b8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:05.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.574+0000 7f4c19d66640 1 --2- 172.21.15.79:0/3665028793 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4bfc0b61d0 0x7f4bfc0b8690 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4c04009710 tx=0x7f4c040096a0 comp rx=0 tx=0).stop 2024-08-20T01:47:05.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.574+0000 7f4c19d66640 1 -- 172.21.15.79:0/3665028793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c141073a0 msgr2=0x7f4c141982a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:05.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.574+0000 7f4c19d66640 1 --2- 172.21.15.79:0/3665028793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c141073a0 0x7f4c141982a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4c0800e9c0 tx=0x7f4c0800ee80 comp rx=0 tx=0).stop 2024-08-20T01:47:05.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.574+0000 7f4c19d66640 1 -- 172.21.15.79:0/3665028793 shutdown_connections 2024-08-20T01:47:05.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.574+0000 7f4c19d66640 1 --2- 172.21.15.79:0/3665028793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c14107d20 0x7f4c1419d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:05.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.574+0000 7f4c19d66640 1 --2- 172.21.15.79:0/3665028793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c141073a0 0x7f4c141982a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:05.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.574+0000 7f4c19d66640 1 --2- 172.21.15.79:0/3665028793 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4bfc0b61d0 0x7f4bfc0b8690 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:05.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.574+0000 7f4c19d66640 1 --2- 172.21.15.79:0/3665028793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c14101990 0x7f4c14197d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:05.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.574+0000 7f4c19d66640 1 -- 172.21.15.79:0/3665028793 >> 172.21.15.79:0/3665028793 conn(0x7f4c140fd400 msgr2=0x7f4c140ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:05.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.575+0000 7f4c19d66640 1 -- 172.21.15.79:0/3665028793 shutdown_connections 2024-08-20T01:47:05.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:05.575+0000 7f4c19d66640 1 -- 172.21.15.79:0/3665028793 wait complete. 2024-08-20T01:47:06.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:05 smithi081 ceph-mon[22209]: pgmap v640: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 27 MiB/s wr, 6.95k op/s 2024-08-20T01:47:06.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:05 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:47:06.102 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:05 smithi079 ceph-mon[18656]: pgmap v640: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 27 MiB/s wr, 6.95k op/s 2024-08-20T01:47:06.103 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:05 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:47:06.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:05 smithi175 ceph-mon[22392]: pgmap v640: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 27 MiB/s wr, 6.95k op/s 2024-08-20T01:47:06.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:05 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:47:06.455 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:47:06.876 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:47:07.006 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:06 smithi079 ceph-mon[18656]: scrub queued for path: / 2024-08-20T01:47:07.006 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:06 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:47:07.006 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:06 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:47:07.006 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:06 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:47:07.006 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:06 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:47:07.006 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:06 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:47:07.006 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:06 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:47:07.007 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:06 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:47:07.007 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:06 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:47:07.007 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:06 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:47:07.007 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:06 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:47:07.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:06 smithi081 ceph-mon[22209]: scrub queued for path: / 2024-08-20T01:47:07.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:06 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:47:07.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:06 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:47:07.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:06 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:47:07.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:06 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:47:07.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:06 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:47:07.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:06 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:47:07.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:06 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:47:07.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:06 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:47:07.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:06 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:47:07.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:06 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:47:07.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:06 smithi175 ceph-mon[22392]: scrub queued for path: / 2024-08-20T01:47:07.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:06 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:47:07.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:06 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:47:07.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:06 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:47:07.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:06 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:47:07.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:06 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:47:07.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:06 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:47:07.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:06 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:47:07.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:06 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:47:07.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:06 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:47:07.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:06 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:47:07.288 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.285+0000 7fef42ee1640 1 -- 172.21.15.79:0/4017160008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef34095f30 msgr2=0x7fef34006500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:07.289 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.285+0000 7fef42ee1640 1 --2- 172.21.15.79:0/4017160008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef34095f30 0x7fef34006500 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fef3c065ff0 tx=0x7fef3c0979f0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.289 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.286+0000 7fef42ee1640 1 -- 172.21.15.79:0/4017160008 shutdown_connections 2024-08-20T01:47:07.289 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.286+0000 7fef42ee1640 1 --2- 172.21.15.79:0/4017160008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef34095f30 0x7fef34006500 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.289 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.286+0000 7fef42ee1640 1 --2- 172.21.15.79:0/4017160008 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef34095570 0x7fef340959f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.289 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.286+0000 7fef42ee1640 1 --2- 172.21.15.79:0/4017160008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef34094420 0x7fef34094820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.289 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.286+0000 7fef42ee1640 1 -- 172.21.15.79:0/4017160008 >> 172.21.15.79:0/4017160008 conn(0x7fef3408fcc0 msgr2=0x7fef34092100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:07.289 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.286+0000 7fef42ee1640 1 -- 172.21.15.79:0/4017160008 shutdown_connections 2024-08-20T01:47:07.289 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.286+0000 7fef42ee1640 1 -- 172.21.15.79:0/4017160008 wait complete. 2024-08-20T01:47:07.291 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.287+0000 7fef42ee1640 1 Processor -- start 2024-08-20T01:47:07.291 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.287+0000 7fef42ee1640 1 -- start start 2024-08-20T01:47:07.291 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.287+0000 7fef42ee1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef34094420 0x7fef34131d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:07.291 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.287+0000 7fef42ee1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef34095570 0x7fef341323e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.288+0000 7fef42ee1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef34095f30 0x7fef34133010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.288+0000 7fef42ee1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fef340a3200 con 0x7fef34094420 2024-08-20T01:47:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.288+0000 7fef42ee1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fef340a3080 con 0x7fef34095f30 2024-08-20T01:47:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.288+0000 7fef42ee1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fef340a3380 con 0x7fef34095570 2024-08-20T01:47:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.288+0000 7fef41edf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef34094420 0x7fef34131d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.288+0000 7fef416de640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef34095570 0x7fef341323e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.288+0000 7fef41edf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef34094420 0x7fef34131d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60372/0 (socket says 172.21.15.79:60372) 2024-08-20T01:47:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.288+0000 7fef41edf640 1 -- 172.21.15.79:0/1760426413 learned_addr learned my addr 172.21.15.79:0/1760426413 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.288+0000 7fef426e0640 1 --2- 172.21.15.79:0/1760426413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef34095f30 0x7fef34133010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.288+0000 7fef416de640 1 -- 172.21.15.79:0/1760426413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef34095f30 msgr2=0x7fef34133010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.288+0000 7fef416de640 1 --2- 172.21.15.79:0/1760426413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef34095f30 0x7fef34133010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.288+0000 7fef416de640 1 -- 172.21.15.79:0/1760426413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef34094420 msgr2=0x7fef34131d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:07.293 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.288+0000 7fef416de640 1 --2- 172.21.15.79:0/1760426413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef34094420 0x7fef34131d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.293 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.288+0000 7fef416de640 1 -- 172.21.15.79:0/1760426413 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef341338d0 con 0x7fef34095570 2024-08-20T01:47:07.293 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.288+0000 7fef41edf640 1 --2- 172.21.15.79:0/1760426413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef34094420 0x7fef34131d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:47:07.293 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.288+0000 7fef416de640 1 --2- 172.21.15.79:0/1760426413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef34095570 0x7fef341323e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fef2c00e9f0 tx=0x7fef2c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:07.293 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.289+0000 7fef32ffd640 1 -- 172.21.15.79:0/1760426413 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2c00ccc0 con 0x7fef34095570 2024-08-20T01:47:07.293 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.289+0000 7fef32ffd640 1 -- 172.21.15.79:0/1760426413 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fef2c005020 con 0x7fef34095570 2024-08-20T01:47:07.293 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.289+0000 7fef42ee1640 1 -- 172.21.15.79:0/1760426413 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef34133bc0 con 0x7fef34095570 2024-08-20T01:47:07.293 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.289+0000 7fef32ffd640 1 -- 172.21.15.79:0/1760426413 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2c00ce60 con 0x7fef34095570 2024-08-20T01:47:07.293 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.289+0000 7fef42ee1640 1 -- 172.21.15.79:0/1760426413 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef3413a290 con 0x7fef34095570 2024-08-20T01:47:07.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.292+0000 7fef47010740 1 Processor -- start 2024-08-20T01:47:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.292+0000 7fef47010740 1 -- start start 2024-08-20T01:47:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.293+0000 7fef47010740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e22b1fa20 0x560e22b21e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.293+0000 7fef47010740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e22b22350 0x560e22b24740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.293+0000 7fef47010740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e22b24d90 0x560e22b27250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.293+0000 7fef47010740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560e22a92360 con 0x560e22b24d90 2024-08-20T01:47:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.293+0000 7fef47010740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560e22a81860 con 0x560e22b1fa20 2024-08-20T01:47:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.293+0000 7fef47010740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560e22a858a0 con 0x560e22b22350 2024-08-20T01:47:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.293+0000 7fef426e0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e22b1fa20 0x560e22b21e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.293+0000 7fef426e0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e22b1fa20 0x560e22b21e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:48812/0 (socket says 172.21.15.79:48812) 2024-08-20T01:47:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.293+0000 7fef426e0640 1 -- 172.21.15.79:0/1194567248 learned_addr learned my addr 172.21.15.79:0/1194567248 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.293+0000 7fef41edf640 1 --2- 172.21.15.79:0/1194567248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e22b22350 0x560e22b24740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.293+0000 7fef426e0640 1 -- 172.21.15.79:0/1194567248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e22b22350 msgr2=0x560e22b24740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.293+0000 7fef426e0640 1 --2- 172.21.15.79:0/1194567248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e22b22350 0x560e22b24740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.293+0000 7fef426e0640 1 -- 172.21.15.79:0/1194567248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e22b24d90 msgr2=0x560e22b27250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:47:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.293+0000 7fef426e0640 1 --2- 172.21.15.79:0/1194567248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e22b24d90 0x560e22b27250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.293+0000 7fef426e0640 1 -- 172.21.15.79:0/1194567248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e22a28e40 con 0x560e22b1fa20 2024-08-20T01:47:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.294+0000 7fef426e0640 1 --2- 172.21.15.79:0/1194567248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e22b1fa20 0x560e22b21e10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fef3c000b60 tx=0x7fef3c064330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45fbdbe99c575c61 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.294+0000 7fef27fff640 1 -- 172.21.15.79:0/1194567248 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef3c0aa070 con 0x560e22b1fa20 2024-08-20T01:47:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.294+0000 7fef27fff640 1 -- 172.21.15.79:0/1194567248 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fef3c06c640 con 0x560e22b1fa20 2024-08-20T01:47:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.294+0000 7fef27fff640 1 -- 172.21.15.79:0/1194567248 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef3c0a0070 con 0x560e22b1fa20 2024-08-20T01:47:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.295+0000 7fef47010740 1 -- 172.21.15.79:0/1194567248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e22b1fa20 msgr2=0x560e22b21e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.295+0000 7fef47010740 1 --2- 172.21.15.79:0/1194567248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e22b1fa20 0x560e22b21e10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fef3c000b60 tx=0x7fef3c064330 comp rx=0 tx=0).stop 2024-08-20T01:47:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.295+0000 7fef47010740 1 -- 172.21.15.79:0/1194567248 shutdown_connections 2024-08-20T01:47:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.295+0000 7fef47010740 1 --2- 172.21.15.79:0/1194567248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e22b24d90 0x560e22b27250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.295+0000 7fef47010740 1 --2- 172.21.15.79:0/1194567248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e22b22350 0x560e22b24740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.300 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.295+0000 7fef47010740 1 --2- 172.21.15.79:0/1194567248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e22b1fa20 0x560e22b21e10 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.300 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.295+0000 7fef47010740 1 -- 172.21.15.79:0/1194567248 >> 172.21.15.79:0/1194567248 conn(0x560e22b1ab70 msgr2=0x560e22b1b900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:07.300 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.295+0000 7fef32ffd640 1 -- 172.21.15.79:0/1760426413 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fef2c004a60 con 0x7fef34095570 2024-08-20T01:47:07.300 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.295+0000 7fef47010740 1 -- 172.21.15.79:0/1194567248 shutdown_connections 2024-08-20T01:47:07.300 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.295+0000 7fef47010740 1 -- 172.21.15.79:0/1194567248 wait complete. 2024-08-20T01:47:07.300 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.296+0000 7fef47010740 1 -- start start 2024-08-20T01:47:07.300 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.296+0000 7fef47010740 1 Processor -- start 2024-08-20T01:47:07.300 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.297+0000 7fef32ffd640 1 --2- 172.21.15.79:0/1760426413 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fef280b3b60 0x7fef280b6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:07.303 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.297+0000 7fef32ffd640 1 -- 172.21.15.79:0/1760426413 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fef2c0e3b30 con 0x7fef34095570 2024-08-20T01:47:07.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.297+0000 7fef47010740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e22b1fa20 0x560e22b293f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:07.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.297+0000 7fef47010740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e22b22350 0x560e22b29a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:07.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.297+0000 7fef47010740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e22b2a640 0x560e22b2aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:07.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.297+0000 7fef47010740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560e229baab0 con 0x560e22b2a640 2024-08-20T01:47:07.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.298+0000 7fef416de640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e22b22350 0x560e22b29a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:07.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.298+0000 7fef416de640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e22b22350 0x560e22b29a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:48822/0 (socket says 172.21.15.79:48822) 2024-08-20T01:47:07.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.298+0000 7fef416de640 1 -- 172.21.15.79:0/2092925397 learned_addr learned my addr 172.21.15.79:0/2092925397 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:07.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.298+0000 7fef47010740 1 -- 172.21.15.79:0/2092925397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560e22a08780 con 0x560e22b22350 2024-08-20T01:47:07.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.298+0000 7fef426e0640 1 --2- 172.21.15.79:0/2092925397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e22b2a640 0x560e22b2aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:07.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.298+0000 7fef47010740 1 -- 172.21.15.79:0/2092925397 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560e22b27d10 con 0x560e22b1fa20 2024-08-20T01:47:07.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.298+0000 7fef41edf640 1 --2- 172.21.15.79:0/2092925397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e22b1fa20 0x560e22b293f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:07.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.298+0000 7fef426e0640 1 --2- 172.21.15.79:0/1760426413 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fef280b3b60 0x7fef280b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:07.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.298+0000 7fef416de640 1 -- 172.21.15.79:0/2092925397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e22b1fa20 msgr2=0x560e22b293f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:07.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.298+0000 7fef416de640 1 --2- 172.21.15.79:0/2092925397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e22b1fa20 0x560e22b293f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.298+0000 7fef416de640 1 -- 172.21.15.79:0/2092925397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e22b2a640 msgr2=0x560e22b2aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:07.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.298+0000 7fef416de640 1 --2- 172.21.15.79:0/2092925397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e22b2a640 0x560e22b2aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.298+0000 7fef416de640 1 -- 172.21.15.79:0/2092925397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e227e4790 con 0x560e22b22350 2024-08-20T01:47:07.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.299+0000 7fef47010740 10 client.0 _ll_register_callbacks cb 0x560e22790a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:47:07.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.299+0000 7fef426e0640 1 --2- 172.21.15.79:0/1760426413 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fef280b3b60 0x7fef280b6020 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fef3c064440 tx=0x7fef3c0979f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:07.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.299+0000 7fef257fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:47:07.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.299+0000 7fef416de640 1 --2- 172.21.15.79:0/2092925397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e22b22350 0x560e22b29a90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fef2c0aaa20 tx=0x7fef2c0aa5a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bee9b932c97dea1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:07.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.299+0000 7fef47010740 1 -- 172.21.15.79:0/2092925397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560e22a30e00 con 0x560e22b22350 2024-08-20T01:47:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.299+0000 7fef257fa640 1 -- 172.21.15.79:0/2092925397 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2c01c070 con 0x560e22b22350 2024-08-20T01:47:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.299+0000 7fef257fa640 1 -- 172.21.15.79:0/2092925397 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fef2c0a7080 con 0x560e22b22350 2024-08-20T01:47:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.299+0000 7fef257fa640 1 -- 172.21.15.79:0/2092925397 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fef2c0af090 con 0x560e22b22350 2024-08-20T01:47:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.299+0000 7fef47010740 10 client.27206 fetch_fsmap learned FSMap version 45 2024-08-20T01:47:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.299+0000 7fef47010740 1 -- 172.21.15.79:0/2092925397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({fsmap=45}) -- 0x560e2285d620 con 0x560e22b22350 2024-08-20T01:47:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.300+0000 7fef257fa640 1 -- 172.21.15.79:0/2092925397 <== mon.2 v2:172.21.15.81:3300/0 4 ==== fsmap(e 45) ==== 8378+0+0 (secure 0 0 0) 0x7fef2c0b36b0 con 0x560e22b22350 2024-08-20T01:47:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.300+0000 7fef47010740 10 client.27206 fetch_fsmap finished waiting for FSMap version 45 2024-08-20T01:47:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.300+0000 7fef47010740 10 client.27206 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:47:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.300+0000 7fef47010740 20 client.27206 populate_metadata read hostname 'smithi079' 2024-08-20T01:47:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.300+0000 7fef47010740 1 --2- 172.21.15.79:0/2092925397 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560e22b35300 0x560e22b377c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.300+0000 7fef47010740 4 client.27206 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:47:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.300+0000 7fef47010740 1 -- 172.21.15.79:0/2092925397 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e22a942b0 con 0x560e22b35300 2024-08-20T01:47:07.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.301+0000 7fef41edf640 1 --2- 172.21.15.79:0/2092925397 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560e22b35300 0x560e22b377c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:07.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.301+0000 7fef41edf640 1 --2- 172.21.15.79:0/2092925397 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560e22b35300 0x560e22b377c0 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=825cac019ad0ce32 server_cookie=d68c78d7e674e300 in_seq=0 out_seq=0 2024-08-20T01:47:07.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.301+0000 7fef257fa640 10 client.27206 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:47:07.308 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.302+0000 7fef257fa640 1 -- 172.21.15.79:0/2092925397 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560e22a942b0 con 0x560e22b35300 2024-08-20T01:47:07.308 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.302+0000 7fef257fa640 10 client.27206 handle_command_reply: tid=0 2024-08-20T01:47:07.308 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.302+0000 7fef47010740 1 client.27206 shutdown 2024-08-20T01:47:07.309 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.303+0000 7fef47010740 1 -- 172.21.15.79:0/2092925397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e22b22350 msgr2=0x560e22b29a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:07.309 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.303+0000 7fef47010740 1 --2- 172.21.15.79:0/2092925397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e22b22350 0x560e22b29a90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fef2c0aaa20 tx=0x7fef2c0aa5a0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.309 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.303+0000 7fef47010740 1 -- 172.21.15.79:0/2092925397 shutdown_connections 2024-08-20T01:47:07.309 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.303+0000 7fef47010740 1 --2- 172.21.15.79:0/2092925397 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560e22b35300 0x560e22b377c0 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.309 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.303+0000 7fef47010740 1 --2- 172.21.15.79:0/2092925397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e22b2a640 0x560e22b2aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.309 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.303+0000 7fef257fa640 0 client.27206 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:47:07.309 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.303+0000 7fef47010740 1 --2- 172.21.15.79:0/2092925397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e22b22350 0x560e22b29a90 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.309 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.303+0000 7fef47010740 1 --2- 172.21.15.79:0/2092925397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e22b1fa20 0x560e22b293f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.309 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.303+0000 7fef47010740 1 -- 172.21.15.79:0/2092925397 >> 172.21.15.79:0/2092925397 conn(0x560e22b1ab70 msgr2=0x560e22b19c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:07.309 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.304+0000 7fef47010740 1 -- 172.21.15.79:0/2092925397 shutdown_connections 2024-08-20T01:47:07.309 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.304+0000 7fef47010740 1 -- 172.21.15.79:0/2092925397 wait complete. 2024-08-20T01:47:07.309 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.304+0000 7fef47010740 20 client.27206 trim_cache size 0 max 16384 2024-08-20T01:47:07.333 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.329+0000 7fef47010740 1 Processor -- start 2024-08-20T01:47:07.333 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.329+0000 7fef47010740 1 -- start start 2024-08-20T01:47:07.333 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.330+0000 7fef47010740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e22b1fa20 0x560e22b28820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:07.333 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.330+0000 7fef47010740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e22b22350 0x560e22b25200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:07.333 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.330+0000 7fef47010740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e22b2a640 0x560e22b25740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:07.334 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.330+0000 7fef47010740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fef34142c90 con 0x560e22b1fa20 2024-08-20T01:47:07.334 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.330+0000 7fef47010740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fef34144890 con 0x560e22b2a640 2024-08-20T01:47:07.334 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.330+0000 7fef47010740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fef34143360 con 0x560e22b22350 2024-08-20T01:47:07.334 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.330+0000 7fef41edf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e22b1fa20 0x560e22b28820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:07.334 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.330+0000 7fef41edf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e22b1fa20 0x560e22b28820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60380/0 (socket says 172.21.15.79:60380) 2024-08-20T01:47:07.334 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.330+0000 7fef41edf640 1 -- 172.21.15.79:0/755652934 learned_addr learned my addr 172.21.15.79:0/755652934 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:07.334 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.330+0000 7fef416de640 1 --2- 172.21.15.79:0/755652934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e22b22350 0x560e22b25200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:07.334 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.330+0000 7fef426e0640 1 --2- 172.21.15.79:0/755652934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e22b2a640 0x560e22b25740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:07.334 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.330+0000 7fef416de640 1 -- 172.21.15.79:0/755652934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e22b2a640 msgr2=0x560e22b25740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:07.334 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.330+0000 7fef416de640 1 --2- 172.21.15.79:0/755652934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e22b2a640 0x560e22b25740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.334 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.330+0000 7fef416de640 1 -- 172.21.15.79:0/755652934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e22b1fa20 msgr2=0x560e22b28820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:07.335 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.330+0000 7fef416de640 1 --2- 172.21.15.79:0/755652934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e22b1fa20 0x560e22b28820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.335 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.330+0000 7fef416de640 1 -- 172.21.15.79:0/755652934 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e22b24ab0 con 0x560e22b22350 2024-08-20T01:47:07.335 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.331+0000 7fef416de640 1 --2- 172.21.15.79:0/755652934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e22b22350 0x560e22b25200 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fef2c0a7030 tx=0x7fef2c0cbf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c250469b3f5f393 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:07.336 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.331+0000 7fef277fe640 1 -- 172.21.15.79:0/755652934 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2c08a070 con 0x560e22b22350 2024-08-20T01:47:07.336 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.331+0000 7fef277fe640 1 -- 172.21.15.79:0/755652934 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x560e22a30e00 con 0x560e22b22350 2024-08-20T01:47:07.336 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.331+0000 7fef277fe640 1 -- 172.21.15.79:0/755652934 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2c0b36b0 con 0x560e22b22350 2024-08-20T01:47:07.336 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.333+0000 7fef47010740 1 -- 172.21.15.79:0/755652934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e22b22350 msgr2=0x560e22b25200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:07.336 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.333+0000 7fef47010740 1 --2- 172.21.15.79:0/755652934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e22b22350 0x560e22b25200 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fef2c0a7030 tx=0x7fef2c0cbf90 comp rx=0 tx=0).stop 2024-08-20T01:47:07.336 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.333+0000 7fef47010740 1 -- 172.21.15.79:0/755652934 shutdown_connections 2024-08-20T01:47:07.336 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.333+0000 7fef47010740 1 --2- 172.21.15.79:0/755652934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e22b2a640 0x560e22b25740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.333+0000 7fef47010740 1 --2- 172.21.15.79:0/755652934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e22b22350 0x560e22b25200 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.333+0000 7fef47010740 1 --2- 172.21.15.79:0/755652934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e22b1fa20 0x560e22b28820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.333+0000 7fef47010740 1 -- 172.21.15.79:0/755652934 >> 172.21.15.79:0/755652934 conn(0x560e22b1ab70 msgr2=0x560e22b28110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:07.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.333+0000 7fef47010740 1 -- 172.21.15.79:0/755652934 shutdown_connections 2024-08-20T01:47:07.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.333+0000 7fef47010740 1 -- 172.21.15.79:0/755652934 wait complete. 2024-08-20T01:47:07.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.334+0000 7fef47010740 1 -- start start 2024-08-20T01:47:07.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.334+0000 7fef47010740 1 Processor -- start 2024-08-20T01:47:07.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.334+0000 7fef47010740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e22b1fa20 0x560e22b2df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:07.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.334+0000 7fef47010740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e22b22350 0x560e22b2e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:07.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.335+0000 7fef41edf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e22b1fa20 0x560e22b2df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:07.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.335+0000 7fef41edf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e22b1fa20 0x560e22b2df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:48828/0 (socket says 172.21.15.79:48828) 2024-08-20T01:47:07.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.335+0000 7fef416de640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e22b22350 0x560e22b2e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:07.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.335+0000 7fef416de640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e22b22350 0x560e22b2e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:59348/0 (socket says 172.21.15.79:59348) 2024-08-20T01:47:07.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.335+0000 7fef47010740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e22b2a640 0x560e22b2f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:07.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.335+0000 7fef47010740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fef341441c0 con 0x560e22b2a640 2024-08-20T01:47:07.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.335+0000 7fef41edf640 1 -- 172.21.15.79:0/1947954205 learned_addr learned my addr 172.21.15.79:0/1947954205 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.335+0000 7fef426e0640 1 --2- 172.21.15.79:0/1947954205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e22b2a640 0x560e22b2f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.335+0000 7fef47010740 1 -- 172.21.15.79:0/1947954205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fef34143a30 con 0x560e22b1fa20 2024-08-20T01:47:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.335+0000 7fef47010740 1 -- 172.21.15.79:0/1947954205 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fef34140c70 con 0x560e22b22350 2024-08-20T01:47:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.336+0000 7fef416de640 1 -- 172.21.15.79:0/1947954205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e22b1fa20 msgr2=0x560e22b2df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.336+0000 7fef416de640 1 --2- 172.21.15.79:0/1947954205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e22b1fa20 0x560e22b2df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.336+0000 7fef416de640 1 -- 172.21.15.79:0/1947954205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e22b2a640 msgr2=0x560e22b2f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.336+0000 7fef416de640 1 --2- 172.21.15.79:0/1947954205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e22b2a640 0x560e22b2f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.336+0000 7fef416de640 1 -- 172.21.15.79:0/1947954205 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e22b2f990 con 0x560e22b22350 2024-08-20T01:47:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.336+0000 7fef426e0640 1 --2- 172.21.15.79:0/1947954205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e22b2a640 0x560e22b2f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:47:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.336+0000 7fef416de640 1 --2- 172.21.15.79:0/1947954205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e22b22350 0x560e22b2e610 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fef2c0aa790 tx=0x7fef2c0e1600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cd79a570a4f7e29 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.336+0000 7fef47010740 10 client.0 _ll_register_callbacks cb 0x7fef2c0aa2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:47:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.336+0000 7fef257fa640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:47:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.336+0000 7fef47010740 1 -- 172.21.15.79:0/1947954205 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560e22a30e00 con 0x560e22b22350 2024-08-20T01:47:07.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.337+0000 7fef257fa640 1 -- 172.21.15.79:0/1947954205 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2c0b9050 con 0x560e22b22350 2024-08-20T01:47:07.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.337+0000 7fef257fa640 1 -- 172.21.15.79:0/1947954205 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fef2c090b80 con 0x560e22b22350 2024-08-20T01:47:07.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.337+0000 7fef257fa640 1 -- 172.21.15.79:0/1947954205 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fef2c08a070 con 0x560e22b22350 2024-08-20T01:47:07.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.337+0000 7fef47010740 10 client.27205 fetch_fsmap learned FSMap version 45 2024-08-20T01:47:07.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.337+0000 7fef47010740 1 -- 172.21.15.79:0/1947954205 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({fsmap=45}) -- 0x560e22b30ab0 con 0x560e22b22350 2024-08-20T01:47:07.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.337+0000 7fef257fa640 1 -- 172.21.15.79:0/1947954205 <== mon.1 v2:172.21.15.175:3300/0 4 ==== fsmap(e 45) ==== 8378+0+0 (secure 0 0 0) 0x7fef2c0c4050 con 0x560e22b22350 2024-08-20T01:47:07.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.337+0000 7fef47010740 10 client.27205 fetch_fsmap finished waiting for FSMap version 45 2024-08-20T01:47:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.338+0000 7fef47010740 10 client.27205 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:47:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.338+0000 7fef47010740 20 client.27205 populate_metadata read hostname 'smithi079' 2024-08-20T01:47:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.338+0000 7fef47010740 1 --2- 172.21.15.79:0/1947954205 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560e22b35300 0x560e22b30fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.338+0000 7fef47010740 4 client.27205 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:47:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.338+0000 7fef47010740 1 -- 172.21.15.79:0/1947954205 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560e22a8fd50 con 0x560e22b35300 2024-08-20T01:47:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.338+0000 7fef41edf640 1 --2- 172.21.15.79:0/1947954205 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560e22b35300 0x560e22b30fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.339+0000 7fef41edf640 1 --2- 172.21.15.79:0/1947954205 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560e22b35300 0x560e22b30fc0 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be34bdc3785cb54e server_cookie=265f2888493ff9f8 in_seq=0 out_seq=0 2024-08-20T01:47:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:07.339+0000 7fef257fa640 10 client.27205 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:47:07.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.475+0000 7f51ada7f640 1 -- 172.21.15.79:0/940237279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51a8108e60 msgr2=0x7f51a810f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:07.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.475+0000 7f51ada7f640 1 --2- 172.21.15.79:0/940237279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51a8108e60 0x7f51a810f660 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f51a0009be0 tx=0x7f51a002a6d0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.476+0000 7f51ada7f640 1 -- 172.21.15.79:0/940237279 shutdown_connections 2024-08-20T01:47:07.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.476+0000 7f51ada7f640 1 --2- 172.21.15.79:0/940237279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51a8108e60 0x7f51a810f660 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.476+0000 7f51ada7f640 1 --2- 172.21.15.79:0/940237279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51a81084e0 0x7f51a8108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.476+0000 7f51ada7f640 1 --2- 172.21.15.79:0/940237279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51a8102ad0 0x7f51a8102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.476+0000 7f51ada7f640 1 -- 172.21.15.79:0/940237279 >> 172.21.15.79:0/940237279 conn(0x7f51a80fe580 msgr2=0x7f51a81009a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:07.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.476+0000 7f51ada7f640 1 -- 172.21.15.79:0/940237279 shutdown_connections 2024-08-20T01:47:07.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.476+0000 7f51ada7f640 1 -- 172.21.15.79:0/940237279 wait complete. 2024-08-20T01:47:07.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.477+0000 7f51ada7f640 1 Processor -- start 2024-08-20T01:47:07.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.477+0000 7f51ada7f640 1 -- start start 2024-08-20T01:47:07.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.477+0000 7f51ada7f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51a8102ad0 0x7f51a810f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:07.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.477+0000 7f51ada7f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51a81084e0 0x7f51a810c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:07.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.478+0000 7f51ada7f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51a8108e60 0x7f51a810c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:07.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.478+0000 7f51ada7f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f51a80769b0 con 0x7f51a81084e0 2024-08-20T01:47:07.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.478+0000 7f51ada7f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f51a8076830 con 0x7f51a8108e60 2024-08-20T01:47:07.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.478+0000 7f51ada7f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f51a8076b30 con 0x7f51a8102ad0 2024-08-20T01:47:07.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.478+0000 7f51a6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51a81084e0 0x7f51a810c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:07.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.478+0000 7f51a6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51a81084e0 0x7f51a810c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60398/0 (socket says 172.21.15.79:60398) 2024-08-20T01:47:07.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.478+0000 7f51a6ffd640 1 -- 172.21.15.79:0/3494741249 learned_addr learned my addr 172.21.15.79:0/3494741249 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:07.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.478+0000 7f51a7fff640 1 --2- 172.21.15.79:0/3494741249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51a8108e60 0x7f51a810c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:07.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.478+0000 7f51a77fe640 1 --2- 172.21.15.79:0/3494741249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51a8102ad0 0x7f51a810f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:07.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.478+0000 7f51a7fff640 1 -- 172.21.15.79:0/3494741249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51a8102ad0 msgr2=0x7f51a810f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:07.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.478+0000 7f51a7fff640 1 --2- 172.21.15.79:0/3494741249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51a8102ad0 0x7f51a810f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.478+0000 7f51a7fff640 1 -- 172.21.15.79:0/3494741249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51a81084e0 msgr2=0x7f51a810c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:07.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.478+0000 7f51a7fff640 1 --2- 172.21.15.79:0/3494741249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51a81084e0 0x7f51a810c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.478+0000 7f51a7fff640 1 -- 172.21.15.79:0/3494741249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51a810d110 con 0x7f51a8108e60 2024-08-20T01:47:07.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.478+0000 7f51a6ffd640 1 --2- 172.21.15.79:0/3494741249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51a81084e0 0x7f51a810c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:47:07.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.478+0000 7f51a7fff640 1 --2- 172.21.15.79:0/3494741249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51a8108e60 0x7f51a810c9e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f51a002abf0 tx=0x7f51a0030c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:07.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.479+0000 7f51a4ff9640 1 -- 172.21.15.79:0/3494741249 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a0041020 con 0x7f51a8108e60 2024-08-20T01:47:07.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.479+0000 7f51a4ff9640 1 -- 172.21.15.79:0/3494741249 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f51a0037040 con 0x7f51a8108e60 2024-08-20T01:47:07.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.479+0000 7f51a4ff9640 1 -- 172.21.15.79:0/3494741249 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a0036070 con 0x7f51a8108e60 2024-08-20T01:47:07.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.479+0000 7f51ada7f640 1 -- 172.21.15.79:0/3494741249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51a81aba60 con 0x7f51a8108e60 2024-08-20T01:47:07.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.479+0000 7f51ada7f640 1 -- 172.21.15.79:0/3494741249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51a81abe00 con 0x7f51a8108e60 2024-08-20T01:47:07.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.483+0000 7f51afe78740 1 Processor -- start 2024-08-20T01:47:07.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.483+0000 7f51a4ff9640 1 -- 172.21.15.79:0/3494741249 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f51a0044020 con 0x7f51a8108e60 2024-08-20T01:47:07.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.484+0000 7f51afe78740 1 -- start start 2024-08-20T01:47:07.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.484+0000 7f51afe78740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a873a89830 0x55a873a89c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:07.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.484+0000 7f51afe78740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a873a8a150 0x55a873a95ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:07.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.484+0000 7f51afe78740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a873a960e0 0x55a873a984d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:07.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.484+0000 7f51afe78740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a873a008e0 con 0x55a873a8a150 2024-08-20T01:47:07.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.484+0000 7f51afe78740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a8739efde0 con 0x55a873a89830 2024-08-20T01:47:07.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.484+0000 7f51afe78740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a8739f3e20 con 0x55a873a960e0 2024-08-20T01:47:07.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.484+0000 7f51a6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a873a89830 0x55a873a89c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:07.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.484+0000 7f51a6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a873a89830 0x55a873a89c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:48854/0 (socket says 172.21.15.79:48854) 2024-08-20T01:47:07.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.484+0000 7f51a6ffd640 1 -- 172.21.15.79:0/2734576007 learned_addr learned my addr 172.21.15.79:0/2734576007 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:07.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.485+0000 7f51a6ffd640 1 --2- 172.21.15.79:0/2734576007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a873a960e0 0x55a873a984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:07.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.485+0000 7f51a6ffd640 1 -- 172.21.15.79:0/2734576007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a873a960e0 msgr2=0x55a873a984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:07.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.485+0000 7f51a6ffd640 1 --2- 172.21.15.79:0/2734576007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a873a960e0 0x55a873a984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.485+0000 7f51a6ffd640 1 -- 172.21.15.79:0/2734576007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a873a8a150 msgr2=0x55a873a95ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:07.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.485+0000 7f51a6ffd640 1 --2- 172.21.15.79:0/2734576007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a873a8a150 0x55a873a95ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.485+0000 7f51a6ffd640 1 -- 172.21.15.79:0/2734576007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a87374f650 con 0x55a873a89830 2024-08-20T01:47:07.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.485+0000 7f51a4ff9640 1 --2- 172.21.15.79:0/3494741249 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f51900b3d20 0x7f51900b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:07.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.485+0000 7f51a6ffd640 1 --2- 172.21.15.79:0/2734576007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a873a89830 0x55a873a89c10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f519c011ca0 tx=0x7f519c009c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fd10d480c3c0de0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:07.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.486+0000 7f51a4ff9640 1 -- 172.21.15.79:0/3494741249 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f51a0104740 con 0x7f51a8108e60 2024-08-20T01:47:07.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.486+0000 7f518dffb640 1 -- 172.21.15.79:0/2734576007 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519c00fc50 con 0x55a873a89830 2024-08-20T01:47:07.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.486+0000 7f518dffb640 1 -- 172.21.15.79:0/2734576007 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f519c00fdf0 con 0x55a873a89830 2024-08-20T01:47:07.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.486+0000 7f51a77fe640 1 --2- 172.21.15.79:0/3494741249 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f51900b3d20 0x7f51900b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:07.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.486+0000 7f518dffb640 1 -- 172.21.15.79:0/2734576007 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519c004e40 con 0x55a873a89830 2024-08-20T01:47:07.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.487+0000 7f51afe78740 1 -- 172.21.15.79:0/2734576007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a873a89830 msgr2=0x55a873a89c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:07.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.487+0000 7f51afe78740 1 --2- 172.21.15.79:0/2734576007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a873a89830 0x55a873a89c10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f519c011ca0 tx=0x7f519c009c10 comp rx=0 tx=0).stop 2024-08-20T01:47:07.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.487+0000 7f51a77fe640 1 --2- 172.21.15.79:0/3494741249 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f51900b3d20 0x7f51900b61e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5198006aa0 tx=0x7f5198006a30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:07.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.488+0000 7f51afe78740 1 -- 172.21.15.79:0/2734576007 shutdown_connections 2024-08-20T01:47:07.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.488+0000 7f51afe78740 1 --2- 172.21.15.79:0/2734576007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a873a960e0 0x55a873a984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.488+0000 7f51afe78740 1 --2- 172.21.15.79:0/2734576007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a873a8a150 0x55a873a95ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.488+0000 7f51afe78740 1 --2- 172.21.15.79:0/2734576007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a873a89830 0x55a873a89c10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.488+0000 7f51afe78740 1 -- 172.21.15.79:0/2734576007 >> 172.21.15.79:0/2734576007 conn(0x55a873a87660 msgr2=0x55a873a88800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:07.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.488+0000 7f51afe78740 1 -- 172.21.15.79:0/2734576007 shutdown_connections 2024-08-20T01:47:07.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.488+0000 7f51afe78740 1 -- 172.21.15.79:0/2734576007 wait complete. 2024-08-20T01:47:07.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.488+0000 7f51afe78740 1 -- start start 2024-08-20T01:47:07.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.488+0000 7f51afe78740 1 Processor -- start 2024-08-20T01:47:07.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.489+0000 7f51afe78740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a873a89830 0x55a873a93040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:07.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.489+0000 7f51afe78740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a873a8a150 0x55a873a93580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:07.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.489+0000 7f51afe78740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a873a960e0 0x55a873a93ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:07.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.489+0000 7f51afe78740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a873852700 con 0x55a873a8a150 2024-08-20T01:47:07.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.489+0000 7f51afe78740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a8739767c0 con 0x55a873a89830 2024-08-20T01:47:07.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.489+0000 7f51afe78740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a873a98de0 con 0x55a873a960e0 2024-08-20T01:47:07.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.489+0000 7f51afe78740 10 client.0 _ll_register_callbacks cb 0x55a8739e96b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:47:07.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.489+0000 7f51a6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a873a8a150 0x55a873a93580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:07.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.489+0000 7f51a77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a873a89830 0x55a873a93040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:07.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.489+0000 7f51a6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a873a8a150 0x55a873a93580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60408/0 (socket says 172.21.15.79:60408) 2024-08-20T01:47:07.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.489+0000 7f51a6ffd640 1 -- 172.21.15.79:0/601272276 learned_addr learned my addr 172.21.15.79:0/601272276 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:07.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.489+0000 7f51a7fff640 1 --2- 172.21.15.79:0/601272276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a873a960e0 0x55a873a93ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:07.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.490+0000 7f51a77fe640 1 -- 172.21.15.79:0/601272276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a873a960e0 msgr2=0x55a873a93ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:07.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.490+0000 7f51a77fe640 1 --2- 172.21.15.79:0/601272276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a873a960e0 0x55a873a93ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.490+0000 7f51a77fe640 1 -- 172.21.15.79:0/601272276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a873a8a150 msgr2=0x55a873a93580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:07.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.490+0000 7f51a77fe640 1 --2- 172.21.15.79:0/601272276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a873a8a150 0x55a873a93580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.490+0000 7f51a77fe640 1 -- 172.21.15.79:0/601272276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a873aa2190 con 0x55a873a89830 2024-08-20T01:47:07.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.490+0000 7f51a6ffd640 1 --2- 172.21.15.79:0/601272276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a873a8a150 0x55a873a93580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:47:07.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.490+0000 7f51a77fe640 1 --2- 172.21.15.79:0/601272276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a873a89830 0x55a873a93040 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5198015700 tx=0x7f51980046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=938d4822f2c32603 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:07.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.490+0000 7f5186ffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:47:07.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.491+0000 7f5186ffd640 1 -- 172.21.15.79:0/601272276 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5198023020 con 0x55a873a89830 2024-08-20T01:47:07.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.491+0000 7f51afe78740 1 -- 172.21.15.79:0/601272276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a87399f100 con 0x55a873a89830 2024-08-20T01:47:07.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.491+0000 7f5186ffd640 1 -- 172.21.15.79:0/601272276 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f51980135d0 con 0x55a873a89830 2024-08-20T01:47:07.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.491+0000 7f5186ffd640 1 -- 172.21.15.79:0/601272276 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f519801b040 con 0x55a873a89830 2024-08-20T01:47:07.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.491+0000 7f51afe78740 10 client.27224 fetch_fsmap learned FSMap version 45 2024-08-20T01:47:07.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.491+0000 7f51afe78740 1 -- 172.21.15.79:0/601272276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55a873aa4bf0 con 0x55a873a89830 2024-08-20T01:47:07.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.491+0000 7f5186ffd640 1 -- 172.21.15.79:0/601272276 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55a87399f100 con 0x55a873a89830 2024-08-20T01:47:07.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.491+0000 7f5186ffd640 1 -- 172.21.15.79:0/601272276 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 45) ==== 8378+0+0 (secure 0 0 0) 0x7f519801e030 con 0x55a873a89830 2024-08-20T01:47:07.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.492+0000 7f51afe78740 10 client.27224 fetch_fsmap finished waiting for FSMap version 45 2024-08-20T01:47:07.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.492+0000 7f51afe78740 10 client.27224 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:47:07.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.492+0000 7f51afe78740 20 client.27224 populate_metadata read hostname 'smithi079' 2024-08-20T01:47:07.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.492+0000 7f51afe78740 1 --2- 172.21.15.79:0/601272276 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55a873aa63f0 0x55a873aa8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:07.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.492+0000 7f51afe78740 4 client.27224 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:47:07.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.492+0000 7f51afe78740 1 -- 172.21.15.79:0/601272276 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a873a02830 con 0x55a873aa63f0 2024-08-20T01:47:07.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.492+0000 7f51a6ffd640 1 --2- 172.21.15.79:0/601272276 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55a873aa63f0 0x55a873aa8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:07.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.493+0000 7f5186ffd640 10 client.27224 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:47:07.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.493+0000 7f51a6ffd640 1 --2- 172.21.15.79:0/601272276 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55a873aa63f0 0x55a873aa8890 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dac6a807e56c1b36 server_cookie=a1f286cbeb17cca1 in_seq=0 out_seq=0 2024-08-20T01:47:07.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.494+0000 7f5186ffd640 1 -- 172.21.15.79:0/601272276 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a873a02830 con 0x55a873aa63f0 2024-08-20T01:47:07.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.494+0000 7f5186ffd640 10 client.27224 handle_command_reply: tid=0 2024-08-20T01:47:07.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.494+0000 7f51afe78740 1 client.27224 shutdown 2024-08-20T01:47:07.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.494+0000 7f51afe78740 1 -- 172.21.15.79:0/601272276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a873a89830 msgr2=0x55a873a93040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:07.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.494+0000 7f51afe78740 1 --2- 172.21.15.79:0/601272276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a873a89830 0x55a873a93040 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5198015700 tx=0x7f51980046c0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.495+0000 7f51afe78740 1 -- 172.21.15.79:0/601272276 shutdown_connections 2024-08-20T01:47:07.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.495+0000 7f51afe78740 1 --2- 172.21.15.79:0/601272276 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55a873aa63f0 0x55a873aa8890 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.495+0000 7f51afe78740 1 --2- 172.21.15.79:0/601272276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a873a960e0 0x55a873a93ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.495+0000 7f51afe78740 1 --2- 172.21.15.79:0/601272276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a873a8a150 0x55a873a93580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.495+0000 7f51afe78740 1 --2- 172.21.15.79:0/601272276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a873a89830 0x55a873a93040 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.495+0000 7f51afe78740 1 -- 172.21.15.79:0/601272276 >> 172.21.15.79:0/601272276 conn(0x55a873a87660 msgr2=0x55a873a8d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:07.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.495+0000 7f5186ffd640 0 client.27224 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:47:07.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.495+0000 7f51afe78740 1 -- 172.21.15.79:0/601272276 shutdown_connections 2024-08-20T01:47:07.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.495+0000 7f51afe78740 1 -- 172.21.15.79:0/601272276 wait complete. 2024-08-20T01:47:07.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.495+0000 7f51afe78740 20 client.27224 trim_cache size 0 max 16384 2024-08-20T01:47:07.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.527+0000 7f51afe78740 1 Processor -- start 2024-08-20T01:47:07.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.527+0000 7f51afe78740 1 -- start start 2024-08-20T01:47:07.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.527+0000 7f51afe78740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a873a89830 0x55a873a8d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:07.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.528+0000 7f51afe78740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a873a8a150 0x55a873a82150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:07.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.528+0000 7f51afe78740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a873a960e0 0x55a873aae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:07.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.528+0000 7f51a77fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a873a89830 0x55a873a8d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:07.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.528+0000 7f51a77fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a873a89830 0x55a873a8d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:59372/0 (socket says 172.21.15.79:59372) 2024-08-20T01:47:07.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.528+0000 7f51a6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a873a8a150 0x55a873a82150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:07.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.528+0000 7f51a6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a873a8a150 0x55a873a82150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:48874/0 (socket says 172.21.15.79:48874) 2024-08-20T01:47:07.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.528+0000 7f51a77fe640 1 -- 172.21.15.79:0/2696050689 learned_addr learned my addr 172.21.15.79:0/2696050689 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:07.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.528+0000 7f51afe78740 1 -- 172.21.15.79:0/2696050689 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f51a81b44e0 con 0x55a873a960e0 2024-08-20T01:47:07.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.528+0000 7f51a7fff640 1 --2- 172.21.15.79:0/2696050689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a873a960e0 0x55a873aae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:07.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.528+0000 7f51afe78740 1 -- 172.21.15.79:0/2696050689 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f51a81b60e0 con 0x55a873a8a150 2024-08-20T01:47:07.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.528+0000 7f51afe78740 1 -- 172.21.15.79:0/2696050689 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f51a81b4bb0 con 0x55a873a89830 2024-08-20T01:47:07.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.529+0000 7f51a7fff640 1 -- 172.21.15.79:0/2696050689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a873a89830 msgr2=0x55a873a8d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:07.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.529+0000 7f51a7fff640 1 --2- 172.21.15.79:0/2696050689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a873a89830 0x55a873a8d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.529+0000 7f51a7fff640 1 -- 172.21.15.79:0/2696050689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a873a8a150 msgr2=0x55a873a82150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:07.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.529+0000 7f51a7fff640 1 --2- 172.21.15.79:0/2696050689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a873a8a150 0x55a873a82150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.529+0000 7f51a7fff640 1 -- 172.21.15.79:0/2696050689 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a873a880e0 con 0x55a873a960e0 2024-08-20T01:47:07.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.529+0000 7f51a7fff640 1 --2- 172.21.15.79:0/2696050689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a873a960e0 0x55a873aae1a0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f51a01022a0 tx=0x7f51a00cb0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e694d0434d9a3b05 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:07.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.529+0000 7f518d7fa640 1 -- 172.21.15.79:0/2696050689 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a00d40a0 con 0x55a873a960e0 2024-08-20T01:47:07.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.529+0000 7f518d7fa640 1 -- 172.21.15.79:0/2696050689 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f51a00cbda0 con 0x55a873a960e0 2024-08-20T01:47:07.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.529+0000 7f518d7fa640 1 -- 172.21.15.79:0/2696050689 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a00c7930 con 0x55a873a960e0 2024-08-20T01:47:07.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.530+0000 7f51afe78740 1 -- 172.21.15.79:0/2696050689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a873a960e0 msgr2=0x55a873aae1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:07.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.530+0000 7f51afe78740 1 --2- 172.21.15.79:0/2696050689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a873a960e0 0x55a873aae1a0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f51a01022a0 tx=0x7f51a00cb0b0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.530+0000 7f51afe78740 1 -- 172.21.15.79:0/2696050689 shutdown_connections 2024-08-20T01:47:07.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.530+0000 7f51afe78740 1 --2- 172.21.15.79:0/2696050689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a873a960e0 0x55a873aae1a0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.530+0000 7f51afe78740 1 --2- 172.21.15.79:0/2696050689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a873a8a150 0x55a873a82150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.530+0000 7f51afe78740 1 --2- 172.21.15.79:0/2696050689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a873a89830 0x55a873a8d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.530+0000 7f51afe78740 1 -- 172.21.15.79:0/2696050689 >> 172.21.15.79:0/2696050689 conn(0x55a873a87660 msgr2=0x55a873a918c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:07.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.530+0000 7f51afe78740 1 -- 172.21.15.79:0/2696050689 shutdown_connections 2024-08-20T01:47:07.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.530+0000 7f51afe78740 1 -- 172.21.15.79:0/2696050689 wait complete. 2024-08-20T01:47:07.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.531+0000 7f51afe78740 1 -- start start 2024-08-20T01:47:07.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.531+0000 7f51afe78740 1 Processor -- start 2024-08-20T01:47:07.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.531+0000 7f51afe78740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a873a89830 0x55a873a9e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:07.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.532+0000 7f51afe78740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a873a8a150 0x55a873a99060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:07.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.532+0000 7f51afe78740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a873a960e0 0x55a873a99730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:07.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.532+0000 7f51afe78740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f51a81b5a10 con 0x55a873a89830 2024-08-20T01:47:07.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.532+0000 7f51afe78740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f51a81b5280 con 0x55a873a8a150 2024-08-20T01:47:07.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.532+0000 7f51afe78740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f51a81b24c0 con 0x55a873a960e0 2024-08-20T01:47:07.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.532+0000 7f51afe78740 10 client.0 _ll_register_callbacks cb 0x7f519800ee40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:47:07.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.532+0000 7f51a77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a873a89830 0x55a873a9e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:07.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.532+0000 7f51a7fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a873a960e0 0x55a873a99730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:07.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.532+0000 7f51a77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a873a89830 0x55a873a9e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60438/0 (socket says 172.21.15.79:60438) 2024-08-20T01:47:07.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.532+0000 7f51a6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a873a8a150 0x55a873a99060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:07.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.532+0000 7f51a77fe640 1 -- 172.21.15.79:0/2682572918 learned_addr learned my addr 172.21.15.79:0/2682572918 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:07.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.532+0000 7f51a77fe640 1 -- 172.21.15.79:0/2682572918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a873a960e0 msgr2=0x55a873a99730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:07.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.532+0000 7f51a77fe640 1 --2- 172.21.15.79:0/2682572918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a873a960e0 0x55a873a99730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.532+0000 7f51a77fe640 1 -- 172.21.15.79:0/2682572918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a873a8a150 msgr2=0x55a873a99060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:07.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.532+0000 7f51a77fe640 1 --2- 172.21.15.79:0/2682572918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a873a8a150 0x55a873a99060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.532+0000 7f51a77fe640 1 -- 172.21.15.79:0/2682572918 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a873b0f160 con 0x55a873a89830 2024-08-20T01:47:07.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.533+0000 7f51a77fe640 1 --2- 172.21.15.79:0/2682572918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a873a89830 0x55a873a9e8b0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f519801fb60 tx=0x7f519801f620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beb3b89d176ec6d5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:07.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.533+0000 7f5186ffd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:47:07.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.533+0000 7f5186ffd640 1 -- 172.21.15.79:0/2682572918 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5198037060 con 0x55a873a89830 2024-08-20T01:47:07.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.533+0000 7f5186ffd640 1 -- 172.21.15.79:0/2682572918 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f51980139e0 con 0x55a873a89830 2024-08-20T01:47:07.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.533+0000 7f51afe78740 1 -- 172.21.15.79:0/2682572918 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51a00cbda0 con 0x55a873a89830 2024-08-20T01:47:07.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.534+0000 7f5186ffd640 1 -- 172.21.15.79:0/2682572918 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f5198023070 con 0x55a873a89830 2024-08-20T01:47:07.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.534+0000 7f51afe78740 10 client.18213 fetch_fsmap learned FSMap version 45 2024-08-20T01:47:07.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.534+0000 7f51afe78740 1 -- 172.21.15.79:0/2682572918 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55a873b10370 con 0x55a873a89830 2024-08-20T01:47:07.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.534+0000 7f5186ffd640 1 -- 172.21.15.79:0/2682572918 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f51a00cbda0 con 0x55a873a89830 2024-08-20T01:47:07.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.534+0000 7f5186ffd640 1 -- 172.21.15.79:0/2682572918 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 45) ==== 8378+0+0 (secure 0 0 0) 0x7f5198031030 con 0x55a873a89830 2024-08-20T01:47:07.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.534+0000 7f51afe78740 10 client.18213 fetch_fsmap finished waiting for FSMap version 45 2024-08-20T01:47:07.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.534+0000 7f51afe78740 10 client.18213 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:47:07.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.534+0000 7f51afe78740 20 client.18213 populate_metadata read hostname 'smithi079' 2024-08-20T01:47:07.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.535+0000 7f51afe78740 1 --2- 172.21.15.79:0/2682572918 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55a873b10b20 0x55a873b12f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:07.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.535+0000 7f51afe78740 4 client.18213 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:47:07.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.535+0000 7f51afe78740 1 -- 172.21.15.79:0/2682572918 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a873a82830 con 0x55a873b10b20 2024-08-20T01:47:07.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.535+0000 7f51a6ffd640 1 --2- 172.21.15.79:0/2682572918 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55a873b10b20 0x55a873b12f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:07.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.536+0000 7f5186ffd640 10 client.18213 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:47:07.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.536+0000 7f51a6ffd640 1 --2- 172.21.15.79:0/2682572918 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55a873b10b20 0x55a873b12f40 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91e71c7d7064d5fb server_cookie=e1da786614c6b94a in_seq=0 out_seq=0 2024-08-20T01:47:07.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.536+0000 7f5186ffd640 1 -- 172.21.15.79:0/2682572918 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55a873a82830 con 0x55a873b10b20 2024-08-20T01:47:07.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.536+0000 7f5186ffd640 10 client.18213 handle_command_reply: tid=0 2024-08-20T01:47:07.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.536+0000 7f51afe78740 1 client.18213 shutdown 2024-08-20T01:47:07.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.537+0000 7f51afe78740 1 -- 172.21.15.79:0/2682572918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a873a89830 msgr2=0x55a873a9e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:07.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.537+0000 7f51afe78740 1 --2- 172.21.15.79:0/2682572918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a873a89830 0x55a873a9e8b0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f519801fb60 tx=0x7f519801f620 comp rx=0 tx=0).stop 2024-08-20T01:47:07.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.537+0000 7f51afe78740 1 -- 172.21.15.79:0/2682572918 shutdown_connections 2024-08-20T01:47:07.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.537+0000 7f51afe78740 1 --2- 172.21.15.79:0/2682572918 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55a873b10b20 0x55a873b12f40 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.537+0000 7f51afe78740 1 --2- 172.21.15.79:0/2682572918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a873a960e0 0x55a873a99730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.537+0000 7f51afe78740 1 --2- 172.21.15.79:0/2682572918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a873a8a150 0x55a873a99060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.537+0000 7f51afe78740 1 --2- 172.21.15.79:0/2682572918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a873a89830 0x55a873a9e8b0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.537+0000 7f5186ffd640 0 client.18213 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:47:07.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.537+0000 7f51afe78740 1 -- 172.21.15.79:0/2682572918 >> 172.21.15.79:0/2682572918 conn(0x55a873a87660 msgr2=0x55a873a94e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:07.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.537+0000 7f51afe78740 1 -- 172.21.15.79:0/2682572918 shutdown_connections 2024-08-20T01:47:07.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.537+0000 7f51afe78740 1 -- 172.21.15.79:0/2682572918 wait complete. 2024-08-20T01:47:07.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.538+0000 7f51afe78740 20 client.18213 trim_cache size 0 max 16384 2024-08-20T01:47:07.543 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:47:07.543 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-20T01:47:07.543 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": { 2024-08-20T01:47:07.543 INFO:teuthology.orchestra.run.smithi079.stdout: "924b951b-4aa0-428e-823a-582e5ed24852": { 2024-08-20T01:47:07.543 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/", 2024-08-20T01:47:07.543 INFO:teuthology.orchestra.run.smithi079.stdout: "tag": "924b951b-4aa0-428e-823a-582e5ed24852", 2024-08-20T01:47:07.543 INFO:teuthology.orchestra.run.smithi079.stdout: "options": "recursive,force" 2024-08-20T01:47:07.543 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:47:07.544 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:47:07.544 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:47:07.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.538+0000 7f51ada7f640 1 -- 172.21.15.79:0/3494741249 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f51900b3d20 msgr2=0x7f51900b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:07.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.538+0000 7f51ada7f640 1 --2- 172.21.15.79:0/3494741249 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f51900b3d20 0x7f51900b61e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5198006aa0 tx=0x7f5198006a30 comp rx=0 tx=0).stop 2024-08-20T01:47:07.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.538+0000 7f51ada7f640 1 -- 172.21.15.79:0/3494741249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51a8108e60 msgr2=0x7f51a810c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:07.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.538+0000 7f51ada7f640 1 --2- 172.21.15.79:0/3494741249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51a8108e60 0x7f51a810c9e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f51a002abf0 tx=0x7f51a0030c50 comp rx=0 tx=0).stop 2024-08-20T01:47:07.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.539+0000 7f51ada7f640 1 -- 172.21.15.79:0/3494741249 shutdown_connections 2024-08-20T01:47:07.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.539+0000 7f51ada7f640 1 --2- 172.21.15.79:0/3494741249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51a8108e60 0x7f51a810c9e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.539+0000 7f51ada7f640 1 --2- 172.21.15.79:0/3494741249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51a81084e0 0x7f51a810c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.539+0000 7f51ada7f640 1 --2- 172.21.15.79:0/3494741249 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f51900b3d20 0x7f51900b61e0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.539+0000 7f51ada7f640 1 --2- 172.21.15.79:0/3494741249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51a8102ad0 0x7f51a810f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:07.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.539+0000 7f51ada7f640 1 -- 172.21.15.79:0/3494741249 >> 172.21.15.79:0/3494741249 conn(0x7f51a80fe580 msgr2=0x7f51a8100970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:07.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.539+0000 7f51ada7f640 1 -- 172.21.15.79:0/3494741249 shutdown_connections 2024-08-20T01:47:07.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:07.539+0000 7f51ada7f640 1 -- 172.21.15.79:0/3494741249 wait complete. 2024-08-20T01:47:08.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:07 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:47:08.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:07 smithi081 ceph-mon[22209]: pgmap v641: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 MiB/s wr, 6.28k op/s 2024-08-20T01:47:08.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:07 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:47:08.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:07 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:47:08.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:07 smithi175 ceph-mon[22392]: pgmap v641: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 MiB/s wr, 6.28k op/s 2024-08-20T01:47:08.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:07 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:47:08.190 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:07 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:47:08.190 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:07 smithi079 ceph-mon[18656]: pgmap v641: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 MiB/s wr, 6.28k op/s 2024-08-20T01:47:08.190 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:07 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:47:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:08.188+0000 7fef257fa640 1 -- 172.21.15.79:0/1947954205 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560e22a8fd50 con 0x560e22b35300 2024-08-20T01:47:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:08.188+0000 7fef257fa640 10 client.27205 handle_command_reply: tid=0 2024-08-20T01:47:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:08.188+0000 7fef47010740 1 client.27205 shutdown 2024-08-20T01:47:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:08.189+0000 7fef47010740 1 -- 172.21.15.79:0/1947954205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e22b22350 msgr2=0x560e22b2e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:08.189+0000 7fef47010740 1 --2- 172.21.15.79:0/1947954205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e22b22350 0x560e22b2e610 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fef2c0aa790 tx=0x7fef2c0e1600 comp rx=0 tx=0).stop 2024-08-20T01:47:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:08.189+0000 7fef47010740 1 -- 172.21.15.79:0/1947954205 shutdown_connections 2024-08-20T01:47:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:08.189+0000 7fef47010740 1 --2- 172.21.15.79:0/1947954205 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560e22b35300 0x560e22b30fc0 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:08.189+0000 7fef47010740 1 --2- 172.21.15.79:0/1947954205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e22b2a640 0x560e22b2f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:08.189+0000 7fef47010740 1 --2- 172.21.15.79:0/1947954205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e22b22350 0x560e22b2e610 secure :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fef2c0aa790 tx=0x7fef2c0e1600 comp rx=0 tx=0).stop 2024-08-20T01:47:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:08.189+0000 7fef47010740 1 --2- 172.21.15.79:0/1947954205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560e22b1fa20 0x560e22b2df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:08.193 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:08.189+0000 7fef47010740 1 -- 172.21.15.79:0/1947954205 >> 172.21.15.79:0/1947954205 conn(0x560e22b1ab70 msgr2=0x560e22b19410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:08.193 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:08.189+0000 7fef257fa640 0 client.27205 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:47:08.193 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:08.189+0000 7fef47010740 1 -- 172.21.15.79:0/1947954205 shutdown_connections 2024-08-20T01:47:08.193 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:08.189+0000 7fef47010740 1 -- 172.21.15.79:0/1947954205 wait complete. 2024-08-20T01:47:08.193 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:08.189+0000 7fef47010740 20 client.27205 trim_cache size 0 max 16384 2024-08-20T01:47:08.193 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:47:08.193 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:47:08.193 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:47:08.194 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:47:08.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:08.190+0000 7fef42ee1640 1 -- 172.21.15.79:0/1760426413 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fef280b3b60 msgr2=0x7fef280b6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:08.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:08.190+0000 7fef42ee1640 1 --2- 172.21.15.79:0/1760426413 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fef280b3b60 0x7fef280b6020 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fef3c064440 tx=0x7fef3c0979f0 comp rx=0 tx=0).stop 2024-08-20T01:47:08.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:08.190+0000 7fef42ee1640 1 -- 172.21.15.79:0/1760426413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef34095570 msgr2=0x7fef341323e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:08.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:08.190+0000 7fef42ee1640 1 --2- 172.21.15.79:0/1760426413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef34095570 0x7fef341323e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fef2c00e9f0 tx=0x7fef2c00eeb0 comp rx=0 tx=0).stop 2024-08-20T01:47:08.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:08.191+0000 7fef42ee1640 1 -- 172.21.15.79:0/1760426413 shutdown_connections 2024-08-20T01:47:08.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:08.191+0000 7fef42ee1640 1 --2- 172.21.15.79:0/1760426413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef34095f30 0x7fef34133010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:08.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:08.191+0000 7fef42ee1640 1 --2- 172.21.15.79:0/1760426413 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fef280b3b60 0x7fef280b6020 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:08.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:08.191+0000 7fef42ee1640 1 --2- 172.21.15.79:0/1760426413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef34095570 0x7fef341323e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:08.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:08.191+0000 7fef42ee1640 1 --2- 172.21.15.79:0/1760426413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef34094420 0x7fef34131d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:08.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:08.191+0000 7fef42ee1640 1 -- 172.21.15.79:0/1760426413 >> 172.21.15.79:0/1760426413 conn(0x7fef3408fcc0 msgr2=0x7fef34090340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:08.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:08.191+0000 7fef42ee1640 1 -- 172.21.15.79:0/1760426413 shutdown_connections 2024-08-20T01:47:08.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:08.191+0000 7fef42ee1640 1 -- 172.21.15.79:0/1760426413 wait complete. 2024-08-20T01:47:08.433 INFO:tasks.cephfs.filesystem:scrub status for tag:924b951b-4aa0-428e-823a-582e5ed24852 - {'path': '/', 'tag': '924b951b-4aa0-428e-823a-582e5ed24852', 'options': 'recursive,force'} 2024-08-20T01:47:10.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:09 smithi081 ceph-mon[22209]: pgmap v642: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 27 MiB/s wr, 6.79k op/s 2024-08-20T01:47:10.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:09 smithi175 ceph-mon[22392]: pgmap v642: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 27 MiB/s wr, 6.79k op/s 2024-08-20T01:47:10.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:09 smithi079 ceph-mon[18656]: pgmap v642: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 27 MiB/s wr, 6.79k op/s 2024-08-20T01:47:12.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:11 smithi081 ceph-mon[22209]: pgmap v643: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 26 MiB/s wr, 6.67k op/s 2024-08-20T01:47:12.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:11 smithi175 ceph-mon[22392]: pgmap v643: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 26 MiB/s wr, 6.67k op/s 2024-08-20T01:47:12.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:11 smithi079 ceph-mon[18656]: pgmap v643: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 26 MiB/s wr, 6.67k op/s 2024-08-20T01:47:13.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:12 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:47:13.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:12 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:47:13.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:12 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:47:14.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:13 smithi081 ceph-mon[22209]: pgmap v644: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 26 MiB/s wr, 6.64k op/s 2024-08-20T01:47:14.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:13 smithi175 ceph-mon[22392]: pgmap v644: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 26 MiB/s wr, 6.64k op/s 2024-08-20T01:47:14.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:13 smithi079 ceph-mon[18656]: pgmap v644: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 26 MiB/s wr, 6.64k op/s 2024-08-20T01:47:15.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:15 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:47:15.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:15 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:47:15.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:15 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:47:15.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:15 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:47:15.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:15 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:47:15.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:15 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:47:15.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:15 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:47:15.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:15 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:47:15.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:15 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:47:15.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:15 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:47:15.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:15 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:47:15.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:15 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:47:15.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:15 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:47:15.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:15 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:47:15.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:15 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:47:15.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:15 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:47:15.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:15 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:47:15.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:15 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:47:16.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:16 smithi175 ceph-mon[22392]: pgmap v645: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 29 MiB/s wr, 7.43k op/s 2024-08-20T01:47:16.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:16 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:47:16.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:16 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:47:16.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:16 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:47:16.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:16 smithi079 ceph-mon[18656]: pgmap v645: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 29 MiB/s wr, 7.43k op/s 2024-08-20T01:47:16.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:16 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:47:16.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:16 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:47:16.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:16 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:47:16.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:16 smithi081 ceph-mon[22209]: pgmap v645: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 29 MiB/s wr, 7.43k op/s 2024-08-20T01:47:16.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:16 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:47:16.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:16 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:47:16.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:16 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:47:18.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:18 smithi175 ceph-mon[22392]: pgmap v646: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 27 MiB/s wr, 6.80k op/s 2024-08-20T01:47:18.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:18 smithi079 ceph-mon[18656]: pgmap v646: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 27 MiB/s wr, 6.80k op/s 2024-08-20T01:47:18.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:18 smithi081 ceph-mon[22209]: pgmap v646: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 27 MiB/s wr, 6.80k op/s 2024-08-20T01:47:20.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:20 smithi175 ceph-mon[22392]: pgmap v647: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 28 MiB/s wr, 7.28k op/s 2024-08-20T01:47:20.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:20 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:47:20.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:20 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:47:20.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:20 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:47:20.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:20 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:47:20.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:20 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:47:20.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:20 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:47:20.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:20 smithi079 ceph-mon[18656]: pgmap v647: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 28 MiB/s wr, 7.28k op/s 2024-08-20T01:47:20.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:20 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:47:20.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:20 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:47:20.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:20 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:47:20.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:20 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:47:20.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:20 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:47:20.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:20 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:47:20.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:20 smithi081 ceph-mon[22209]: pgmap v647: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 28 MiB/s wr, 7.28k op/s 2024-08-20T01:47:20.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:20 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:47:20.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:20 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:47:20.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:20 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:47:20.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:20 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:47:20.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:20 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:47:20.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:20 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:47:21.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.339+0000 7f5aedf7c640 1 -- 172.21.15.79:0/2155502543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ae8100b10 msgr2=0x7f5ae8100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:21.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.339+0000 7f5aedf7c640 1 --2- 172.21.15.79:0/2155502543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ae8100b10 0x7f5ae8100f10 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f5adc00aa40 tx=0x7f5adc02a660 comp rx=0 tx=0).stop 2024-08-20T01:47:21.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.340+0000 7f5aedf7c640 1 -- 172.21.15.79:0/2155502543 shutdown_connections 2024-08-20T01:47:21.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.340+0000 7f5aedf7c640 1 --2- 172.21.15.79:0/2155502543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ae8102620 0x7f5ae8108fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:21.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.340+0000 7f5aedf7c640 1 --2- 172.21.15.79:0/2155502543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ae8101c60 0x7f5ae81020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:21.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.340+0000 7f5aedf7c640 1 --2- 172.21.15.79:0/2155502543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ae8100b10 0x7f5ae8100f10 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:21.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.340+0000 7f5aedf7c640 1 -- 172.21.15.79:0/2155502543 >> 172.21.15.79:0/2155502543 conn(0x7f5ae80fc3d0 msgr2=0x7f5ae80fe7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:21.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.340+0000 7f5aedf7c640 1 -- 172.21.15.79:0/2155502543 shutdown_connections 2024-08-20T01:47:21.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.340+0000 7f5aedf7c640 1 -- 172.21.15.79:0/2155502543 wait complete. 2024-08-20T01:47:21.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.341+0000 7f5aedf7c640 1 Processor -- start 2024-08-20T01:47:21.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.341+0000 7f5aedf7c640 1 -- start start 2024-08-20T01:47:21.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.341+0000 7f5aedf7c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ae8100b10 0x7f5ae8071a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:21.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.341+0000 7f5aedf7c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ae8101c60 0x7f5ae8072070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:21.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.342+0000 7f5aecf7a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ae8100b10 0x7f5ae8071a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:21.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.342+0000 7f5aecf7a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ae8100b10 0x7f5ae8071a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:49698/0 (socket says 172.21.15.79:49698) 2024-08-20T01:47:21.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.342+0000 7f5aecf7a640 1 -- 172.21.15.79:0/1969787869 learned_addr learned my addr 172.21.15.79:0/1969787869 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:21.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.342+0000 7f5aedf7c640 1 --2- 172.21.15.79:0/1969787869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ae8102620 0x7f5ae8072c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:21.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.342+0000 7f5ae7fff640 1 --2- 172.21.15.79:0/1969787869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ae8101c60 0x7f5ae8072070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:21.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.342+0000 7f5aedf7c640 1 -- 172.21.15.79:0/1969787869 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae810bdc0 con 0x7f5ae8102620 2024-08-20T01:47:21.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.342+0000 7f5aedf7c640 1 -- 172.21.15.79:0/1969787869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae810bc40 con 0x7f5ae8100b10 2024-08-20T01:47:21.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.342+0000 7f5aedf7c640 1 -- 172.21.15.79:0/1969787869 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae810bf40 con 0x7f5ae8101c60 2024-08-20T01:47:21.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.342+0000 7f5aed77b640 1 --2- 172.21.15.79:0/1969787869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ae8102620 0x7f5ae8072c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:21.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.343+0000 7f5ae7fff640 1 -- 172.21.15.79:0/1969787869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ae8100b10 msgr2=0x7f5ae8071a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:21.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.343+0000 7f5ae7fff640 1 --2- 172.21.15.79:0/1969787869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ae8100b10 0x7f5ae8071a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:21.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.343+0000 7f5ae7fff640 1 -- 172.21.15.79:0/1969787869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ae8102620 msgr2=0x7f5ae8072c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:21.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.343+0000 7f5ae7fff640 1 --2- 172.21.15.79:0/1969787869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ae8102620 0x7f5ae8072c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:21.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.343+0000 7f5ae7fff640 1 -- 172.21.15.79:0/1969787869 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ae80734f0 con 0x7f5ae8101c60 2024-08-20T01:47:21.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.343+0000 7f5ae7fff640 1 --2- 172.21.15.79:0/1969787869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ae8101c60 0x7f5ae8072070 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4010ad0 tx=0x7f5ad4010f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:21.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.344+0000 7f5ae5ffb640 1 -- 172.21.15.79:0/1969787869 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad401a020 con 0x7f5ae8101c60 2024-08-20T01:47:21.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.344+0000 7f5ae5ffb640 1 -- 172.21.15.79:0/1969787869 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ad4016480 con 0x7f5ae8101c60 2024-08-20T01:47:21.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.344+0000 7f5aedf7c640 1 -- 172.21.15.79:0/1969787869 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ae80737e0 con 0x7f5ae8101c60 2024-08-20T01:47:21.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.345+0000 7f5ae5ffb640 1 -- 172.21.15.79:0/1969787869 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad4015640 con 0x7f5ae8101c60 2024-08-20T01:47:21.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.345+0000 7f5aedf7c640 1 -- 172.21.15.79:0/1969787869 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ae8073e80 con 0x7f5ae8101c60 2024-08-20T01:47:21.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.348+0000 7f5af1fd0740 1 Processor -- start 2024-08-20T01:47:21.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.349+0000 7f5af1fd0740 1 -- start start 2024-08-20T01:47:21.351 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.349+0000 7f5af1fd0740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8476fb780 0x55b8476fbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:21.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.349+0000 7f5af1fd0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8476fc0c0 0x55b84770aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:21.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.349+0000 7f5af1fd0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b84770b420 0x55b84770d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:21.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.349+0000 7f5af1fd0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b847670360 con 0x55b84770b420 2024-08-20T01:47:21.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.349+0000 7f5af1fd0740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b84765f860 con 0x55b8476fb780 2024-08-20T01:47:21.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.349+0000 7f5af1fd0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b8476638a0 con 0x55b8476fc0c0 2024-08-20T01:47:21.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.349+0000 7f5aed77b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8476fb780 0x55b8476fbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:21.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.349+0000 7f5aecf7a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8476fc0c0 0x55b84770aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:21.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.349+0000 7f5aed77b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8476fb780 0x55b8476fbb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:49712/0 (socket says 172.21.15.79:49712) 2024-08-20T01:47:21.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.349+0000 7f5aed77b640 1 -- 172.21.15.79:0/698217328 learned_addr learned my addr 172.21.15.79:0/698217328 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:21.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.350+0000 7f5aecf7a640 1 -- 172.21.15.79:0/698217328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8476fb780 msgr2=0x55b8476fbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:21.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.350+0000 7f5aecf7a640 1 --2- 172.21.15.79:0/698217328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8476fb780 0x55b8476fbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:21.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.350+0000 7f5aecf7a640 1 -- 172.21.15.79:0/698217328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b84770b420 msgr2=0x55b84770d850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:47:21.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.350+0000 7f5aecf7a640 1 --2- 172.21.15.79:0/698217328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b84770b420 0x55b84770d850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:21.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.350+0000 7f5aecf7a640 1 -- 172.21.15.79:0/698217328 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b847606e40 con 0x55b8476fc0c0 2024-08-20T01:47:21.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.350+0000 7f5aecf7a640 1 --2- 172.21.15.79:0/698217328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8476fc0c0 0x55b84770aee0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5adc00aa10 tx=0x7f5adc005be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=516e5245fdfef45c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:21.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.350+0000 7f5ad2ffd640 1 -- 172.21.15.79:0/698217328 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5adc035020 con 0x55b8476fc0c0 2024-08-20T01:47:21.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.351+0000 7f5ad2ffd640 1 -- 172.21.15.79:0/698217328 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5adc041070 con 0x55b8476fc0c0 2024-08-20T01:47:21.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.351+0000 7f5ad2ffd640 1 -- 172.21.15.79:0/698217328 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5adc004de0 con 0x55b8476fc0c0 2024-08-20T01:47:21.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.351+0000 7f5ae5ffb640 1 -- 172.21.15.79:0/1969787869 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5ad401d020 con 0x7f5ae8101c60 2024-08-20T01:47:21.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.352+0000 7f5af1fd0740 1 -- 172.21.15.79:0/698217328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8476fc0c0 msgr2=0x55b84770aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:21.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.352+0000 7f5af1fd0740 1 --2- 172.21.15.79:0/698217328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8476fc0c0 0x55b84770aee0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5adc00aa10 tx=0x7f5adc005be0 comp rx=0 tx=0).stop 2024-08-20T01:47:21.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.352+0000 7f5ae5ffb640 1 --2- 172.21.15.79:0/1969787869 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5ad80b3da0 0x7f5ad80b6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:21.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.352+0000 7f5af1fd0740 1 -- 172.21.15.79:0/698217328 shutdown_connections 2024-08-20T01:47:21.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.352+0000 7f5af1fd0740 1 --2- 172.21.15.79:0/698217328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b84770b420 0x55b84770d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:21.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.352+0000 7f5ae5ffb640 1 -- 172.21.15.79:0/1969787869 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f5ad40e3db0 con 0x7f5ae8101c60 2024-08-20T01:47:21.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.352+0000 7f5af1fd0740 1 --2- 172.21.15.79:0/698217328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8476fc0c0 0x55b84770aee0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:21.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.352+0000 7f5af1fd0740 1 --2- 172.21.15.79:0/698217328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8476fb780 0x55b8476fbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:21.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.353+0000 7f5af1fd0740 1 -- 172.21.15.79:0/698217328 >> 172.21.15.79:0/698217328 conn(0x55b8476f88e0 msgr2=0x55b8476f9670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:21.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.354+0000 7f5aed77b640 1 --2- 172.21.15.79:0/1969787869 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5ad80b3da0 0x7f5ad80b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:21.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.354+0000 7f5af1fd0740 1 -- 172.21.15.79:0/698217328 shutdown_connections 2024-08-20T01:47:21.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.356+0000 7f5af1fd0740 1 -- 172.21.15.79:0/698217328 wait complete. 2024-08-20T01:47:21.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.357+0000 7f5af1fd0740 1 -- start start 2024-08-20T01:47:21.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.357+0000 7f5af1fd0740 1 Processor -- start 2024-08-20T01:47:21.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.357+0000 7f5aed77b640 1 --2- 172.21.15.79:0/1969787869 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5ad80b3da0 0x7f5ad80b6260 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0005fd0 tx=0x7f5ae0009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:21.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.358+0000 7f5af1fd0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8476fb780 0x55b84770f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:21.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.358+0000 7f5af1fd0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8476fc0c0 0x55b84770fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:21.361 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.358+0000 7f5aecf7a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8476fb780 0x55b84770f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:21.361 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.358+0000 7f5aecf7a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8476fb780 0x55b84770f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:36168/0 (socket says 172.21.15.79:36168) 2024-08-20T01:47:21.361 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.359+0000 7f5aecf7a640 1 -- 172.21.15.79:0/2759832807 learned_addr learned my addr 172.21.15.79:0/2759832807 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:21.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.359+0000 7f5af1fd0740 1 --2- 172.21.15.79:0/2759832807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b84770b420 0x55b847710a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:21.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.359+0000 7f5af1fd0740 1 -- 172.21.15.79:0/2759832807 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b847598ab0 con 0x55b8476fc0c0 2024-08-20T01:47:21.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.359+0000 7f5af1fd0740 1 -- 172.21.15.79:0/2759832807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b8475e6780 con 0x55b84770b420 2024-08-20T01:47:21.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.359+0000 7f5af1fd0740 1 -- 172.21.15.79:0/2759832807 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b84770e310 con 0x55b8476fb780 2024-08-20T01:47:21.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.359+0000 7f5af1fd0740 10 client.0 _ll_register_callbacks cb 0x55b84736ea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:47:21.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.359+0000 7f5aed77b640 1 --2- 172.21.15.79:0/2759832807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b84770b420 0x55b847710a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:21.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.359+0000 7f5ae7fff640 1 --2- 172.21.15.79:0/2759832807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8476fc0c0 0x55b84770fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:21.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.359+0000 7f5aecf7a640 1 -- 172.21.15.79:0/2759832807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b84770b420 msgr2=0x55b847710a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:21.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.359+0000 7f5aecf7a640 1 --2- 172.21.15.79:0/2759832807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b84770b420 0x55b847710a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:21.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.359+0000 7f5aecf7a640 1 -- 172.21.15.79:0/2759832807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8476fc0c0 msgr2=0x55b84770fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:21.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.359+0000 7f5aecf7a640 1 --2- 172.21.15.79:0/2759832807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8476fc0c0 0x55b84770fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:21.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.359+0000 7f5aecf7a640 1 -- 172.21.15.79:0/2759832807 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8473c2790 con 0x55b8476fb780 2024-08-20T01:47:21.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.360+0000 7f5aecf7a640 1 --2- 172.21.15.79:0/2759832807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8476fb780 0x55b84770f7e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5adc0057c0 tx=0x7f5adc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71b4c839e0b94ba5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:21.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.360+0000 7f5ac7fff640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:47:21.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.360+0000 7f5ac7fff640 1 -- 172.21.15.79:0/2759832807 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5adc035070 con 0x55b8476fb780 2024-08-20T01:47:21.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.360+0000 7f5ac7fff640 1 -- 172.21.15.79:0/2759832807 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f5adc004250 con 0x55b8476fb780 2024-08-20T01:47:21.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.360+0000 7f5af1fd0740 1 -- 172.21.15.79:0/2759832807 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b84760ee00 con 0x55b8476fb780 2024-08-20T01:47:21.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.361+0000 7f5ac7fff640 1 -- 172.21.15.79:0/2759832807 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f5adc004450 con 0x55b8476fb780 2024-08-20T01:47:21.364 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.361+0000 7f5af1fd0740 10 client.27235 fetch_fsmap learned FSMap version 46 2024-08-20T01:47:21.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.361+0000 7f5af1fd0740 1 -- 172.21.15.79:0/2759832807 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55b84743b620 con 0x55b8476fb780 2024-08-20T01:47:21.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.361+0000 7f5ac7fff640 1 -- 172.21.15.79:0/2759832807 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5adc055030 con 0x55b8476fb780 2024-08-20T01:47:21.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.361+0000 7f5ac7fff640 1 -- 172.21.15.79:0/2759832807 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 46) ==== 8382+0+0 (secure 0 0 0) 0x7f5adc03a040 con 0x55b8476fb780 2024-08-20T01:47:21.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.361+0000 7f5af1fd0740 10 client.27235 fetch_fsmap finished waiting for FSMap version 46 2024-08-20T01:47:21.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.361+0000 7f5af1fd0740 10 client.27235 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:47:21.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.361+0000 7f5af1fd0740 20 client.27235 populate_metadata read hostname 'smithi079' 2024-08-20T01:47:21.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.361+0000 7f5af1fd0740 1 --2- 172.21.15.79:0/2759832807 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55b84771b1e0 0x55b84771d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:21.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.361+0000 7f5af1fd0740 4 client.27235 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:47:21.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.361+0000 7f5af1fd0740 1 -- 172.21.15.79:0/2759832807 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b84760ee00 con 0x55b84771b1e0 2024-08-20T01:47:21.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.361+0000 7f5ae7fff640 1 --2- 172.21.15.79:0/2759832807 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55b84771b1e0 0x55b84771d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:21.366 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.362+0000 7f5ae7fff640 1 --2- 172.21.15.79:0/2759832807 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55b84771b1e0 0x55b84771d600 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a373118f214aad4 server_cookie=acd2d65f58a79492 in_seq=0 out_seq=0 2024-08-20T01:47:21.366 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.362+0000 7f5ac7fff640 10 client.27235 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:47:21.366 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.363+0000 7f5ac7fff640 1 -- 172.21.15.79:0/2759832807 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b84760ee00 con 0x55b84771b1e0 2024-08-20T01:47:21.367 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.363+0000 7f5ac7fff640 10 client.27235 handle_command_reply: tid=0 2024-08-20T01:47:21.367 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.363+0000 7f5af1fd0740 1 client.27235 shutdown 2024-08-20T01:47:21.367 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.364+0000 7f5af1fd0740 1 -- 172.21.15.79:0/2759832807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8476fb780 msgr2=0x55b84770f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:21.367 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.364+0000 7f5af1fd0740 1 --2- 172.21.15.79:0/2759832807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8476fb780 0x55b84770f7e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5adc0057c0 tx=0x7f5adc0046c0 comp rx=0 tx=0).stop 2024-08-20T01:47:21.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.364+0000 7f5af1fd0740 1 -- 172.21.15.79:0/2759832807 shutdown_connections 2024-08-20T01:47:21.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.364+0000 7f5af1fd0740 1 --2- 172.21.15.79:0/2759832807 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55b84771b1e0 0x55b84771d600 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:21.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.365+0000 7f5af1fd0740 1 --2- 172.21.15.79:0/2759832807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b84770b420 0x55b847710a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:21.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.365+0000 7f5ac7fff640 0 client.27235 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:47:21.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.365+0000 7f5af1fd0740 1 --2- 172.21.15.79:0/2759832807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8476fc0c0 0x55b84770fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:21.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.365+0000 7f5af1fd0740 1 --2- 172.21.15.79:0/2759832807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8476fb780 0x55b84770f7e0 secure :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5adc0057c0 tx=0x7f5adc0046c0 comp rx=0 tx=0).stop 2024-08-20T01:47:21.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.365+0000 7f5af1fd0740 1 -- 172.21.15.79:0/2759832807 >> 172.21.15.79:0/2759832807 conn(0x55b8476f88e0 msgr2=0x55b8476faf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:21.369 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.365+0000 7f5af1fd0740 1 -- 172.21.15.79:0/2759832807 shutdown_connections 2024-08-20T01:47:21.369 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.365+0000 7f5af1fd0740 1 -- 172.21.15.79:0/2759832807 wait complete. 2024-08-20T01:47:21.369 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.367+0000 7f5af1fd0740 20 client.27235 trim_cache size 0 max 16384 2024-08-20T01:47:21.397 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.395+0000 7f5af1fd0740 1 Processor -- start 2024-08-20T01:47:21.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.395+0000 7f5af1fd0740 1 -- start start 2024-08-20T01:47:21.399 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.396+0000 7f5af1fd0740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8476fc0c0 0x55b8476f9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:21.399 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.396+0000 7f5af1fd0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b84770b420 0x55b8476f9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:21.399 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.396+0000 7f5aecf7a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8476fc0c0 0x55b8476f9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:21.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.396+0000 7f5aecf7a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8476fc0c0 0x55b8476f9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:49744/0 (socket says 172.21.15.79:49744) 2024-08-20T01:47:21.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.396+0000 7f5aecf7a640 1 -- 172.21.15.79:0/103982658 learned_addr learned my addr 172.21.15.79:0/103982658 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:21.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.396+0000 7f5af1fd0740 1 --2- 172.21.15.79:0/103982658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b847707a80 0x55b8476fa710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:21.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.396+0000 7f5af1fd0740 1 -- 172.21.15.79:0/103982658 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae81aff40 con 0x55b84770b420 2024-08-20T01:47:21.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.396+0000 7f5af1fd0740 1 -- 172.21.15.79:0/103982658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae81b1b70 con 0x55b8476fc0c0 2024-08-20T01:47:21.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.396+0000 7f5af1fd0740 1 -- 172.21.15.79:0/103982658 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae81b0640 con 0x55b847707a80 2024-08-20T01:47:21.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.396+0000 7f5aed77b640 1 --2- 172.21.15.79:0/103982658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b847707a80 0x55b8476fa710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:21.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.397+0000 7f5ae7fff640 1 --2- 172.21.15.79:0/103982658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b84770b420 0x55b8476f9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:21.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.397+0000 7f5aed77b640 1 -- 172.21.15.79:0/103982658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8476fc0c0 msgr2=0x55b8476f9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:21.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.397+0000 7f5aed77b640 1 --2- 172.21.15.79:0/103982658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8476fc0c0 0x55b8476f9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:21.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.397+0000 7f5aed77b640 1 -- 172.21.15.79:0/103982658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b84770b420 msgr2=0x55b8476f9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:21.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.397+0000 7f5aed77b640 1 --2- 172.21.15.79:0/103982658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b84770b420 0x55b8476f9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:21.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.397+0000 7f5aed77b640 1 -- 172.21.15.79:0/103982658 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b84770b220 con 0x55b847707a80 2024-08-20T01:47:21.402 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.397+0000 7f5aed77b640 1 --2- 172.21.15.79:0/103982658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b847707a80 0x55b8476fa710 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0009ee0 tx=0x7f5ae0016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdccd75eaf713ee server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:21.402 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.398+0000 7f5ad27fc640 1 -- 172.21.15.79:0/103982658 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0004b20 con 0x55b847707a80 2024-08-20T01:47:21.402 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.398+0000 7f5ad27fc640 1 -- 172.21.15.79:0/103982658 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ae0004cc0 con 0x55b847707a80 2024-08-20T01:47:21.402 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.398+0000 7f5ad27fc640 1 -- 172.21.15.79:0/103982658 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae002a6d0 con 0x55b847707a80 2024-08-20T01:47:21.402 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.399+0000 7f5af1fd0740 1 -- 172.21.15.79:0/103982658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b847707a80 msgr2=0x55b8476fa710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.399+0000 7f5af1fd0740 1 --2- 172.21.15.79:0/103982658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b847707a80 0x55b8476fa710 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0009ee0 tx=0x7f5ae0016000 comp rx=0 tx=0).stop 2024-08-20T01:47:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.399+0000 7f5af1fd0740 1 -- 172.21.15.79:0/103982658 shutdown_connections 2024-08-20T01:47:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.399+0000 7f5af1fd0740 1 --2- 172.21.15.79:0/103982658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b847707a80 0x55b8476fa710 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.399+0000 7f5af1fd0740 1 --2- 172.21.15.79:0/103982658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b84770b420 0x55b8476f9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.399+0000 7f5af1fd0740 1 --2- 172.21.15.79:0/103982658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8476fc0c0 0x55b8476f9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.399+0000 7f5af1fd0740 1 -- 172.21.15.79:0/103982658 >> 172.21.15.79:0/103982658 conn(0x55b8476f88e0 msgr2=0x55b847707370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.399+0000 7f5af1fd0740 1 -- 172.21.15.79:0/103982658 shutdown_connections 2024-08-20T01:47:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.399+0000 7f5af1fd0740 1 -- 172.21.15.79:0/103982658 wait complete. 2024-08-20T01:47:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.399+0000 7f5af1fd0740 1 -- start start 2024-08-20T01:47:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.400+0000 7f5af1fd0740 1 Processor -- start 2024-08-20T01:47:21.406 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.400+0000 7f5af1fd0740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8476fc0c0 0x55b8477144f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:21.406 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.400+0000 7f5af1fd0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b847707a80 0x55b847714b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:21.406 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.400+0000 7f5af1fd0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b84770b420 0x55b847715760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:21.406 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.400+0000 7f5af1fd0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae81b14a0 con 0x55b847707a80 2024-08-20T01:47:21.406 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.400+0000 7f5af1fd0740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae81b0d10 con 0x55b8476fc0c0 2024-08-20T01:47:21.406 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.400+0000 7f5af1fd0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae81adf20 con 0x55b84770b420 2024-08-20T01:47:21.406 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.400+0000 7f5af1fd0740 10 client.0 _ll_register_callbacks cb 0x7f5ae0009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:47:21.406 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.400+0000 7f5aed77b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b84770b420 0x55b847715760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:21.406 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.400+0000 7f5aed77b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b84770b420 0x55b847715760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:36186/0 (socket says 172.21.15.79:36186) 2024-08-20T01:47:21.406 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.400+0000 7f5aed77b640 1 -- 172.21.15.79:0/2954722590 learned_addr learned my addr 172.21.15.79:0/2954722590 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:21.407 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.401+0000 7f5aecf7a640 1 --2- 172.21.15.79:0/2954722590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8476fc0c0 0x55b8477144f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:21.407 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.401+0000 7f5aed77b640 1 -- 172.21.15.79:0/2954722590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8476fc0c0 msgr2=0x55b8477144f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:21.407 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.401+0000 7f5aed77b640 1 --2- 172.21.15.79:0/2954722590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8476fc0c0 0x55b8477144f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:21.407 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.401+0000 7f5aed77b640 1 -- 172.21.15.79:0/2954722590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b847707a80 msgr2=0x55b847714b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:21.407 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.401+0000 7f5aed77b640 1 --2- 172.21.15.79:0/2954722590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b847707a80 0x55b847714b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:21.407 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.401+0000 7f5aed77b640 1 -- 172.21.15.79:0/2954722590 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b847715f90 con 0x55b84770b420 2024-08-20T01:47:21.407 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.401+0000 7f5aed77b640 1 --2- 172.21.15.79:0/2954722590 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b84770b420 0x55b847715760 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0004f10 tx=0x7f5ae0004f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4d75d1f3aeb746b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:21.407 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.401+0000 7f5ac7fff640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:47:21.407 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.402+0000 7f5ac7fff640 1 -- 172.21.15.79:0/2954722590 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0038060 con 0x55b84770b420 2024-08-20T01:47:21.407 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.402+0000 7f5ac7fff640 1 -- 172.21.15.79:0/2954722590 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f5ae002a470 con 0x55b84770b420 2024-08-20T01:47:21.407 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.402+0000 7f5af1fd0740 1 -- 172.21.15.79:0/2954722590 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ae0004cc0 con 0x55b84770b420 2024-08-20T01:47:21.407 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.402+0000 7f5ac7fff640 1 -- 172.21.15.79:0/2954722590 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f5ae0005990 con 0x55b84770b420 2024-08-20T01:47:21.408 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.402+0000 7f5af1fd0740 10 client.27241 fetch_fsmap learned FSMap version 46 2024-08-20T01:47:21.408 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.402+0000 7f5af1fd0740 1 -- 172.21.15.79:0/2954722590 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55b847717330 con 0x55b84770b420 2024-08-20T01:47:21.408 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.403+0000 7f5ac7fff640 1 -- 172.21.15.79:0/2954722590 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ae0004cc0 con 0x55b84770b420 2024-08-20T01:47:21.409 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.403+0000 7f5ac7fff640 1 -- 172.21.15.79:0/2954722590 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 46) ==== 8382+0+0 (secure 0 0 0) 0x7f5ae0032030 con 0x55b84770b420 2024-08-20T01:47:21.409 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.404+0000 7f5af1fd0740 10 client.27241 fetch_fsmap finished waiting for FSMap version 46 2024-08-20T01:47:21.409 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.404+0000 7f5af1fd0740 10 client.27241 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:47:21.409 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.404+0000 7f5af1fd0740 20 client.27241 populate_metadata read hostname 'smithi079' 2024-08-20T01:47:21.409 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.404+0000 7f5af1fd0740 1 --2- 172.21.15.79:0/2954722590 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55b847785f60 0x55b847788380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:21.409 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.404+0000 7f5af1fd0740 4 client.27241 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:47:21.409 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.404+0000 7f5af1fd0740 1 -- 172.21.15.79:0/2954722590 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b8476722b0 con 0x55b847785f60 2024-08-20T01:47:21.409 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.404+0000 7f5aecf7a640 1 --2- 172.21.15.79:0/2954722590 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55b847785f60 0x55b847788380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:21.410 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.405+0000 7f5aecf7a640 1 --2- 172.21.15.79:0/2954722590 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55b847785f60 0x55b847788380 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ab8395b9e9c1ca9 server_cookie=cd70a1610526ac42 in_seq=0 out_seq=0 2024-08-20T01:47:21.410 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:21.405+0000 7f5ac7fff640 10 client.27241 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:47:22.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:22.349+0000 7f5ac7fff640 1 -- 172.21.15.79:0/2954722590 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b8476722b0 con 0x55b847785f60 2024-08-20T01:47:22.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:22.349+0000 7f5ac7fff640 10 client.27241 handle_command_reply: tid=0 2024-08-20T01:47:22.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:22.350+0000 7f5af1fd0740 1 client.27241 shutdown 2024-08-20T01:47:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:22.350+0000 7f5af1fd0740 1 -- 172.21.15.79:0/2954722590 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b84770b420 msgr2=0x55b847715760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:22.350+0000 7f5af1fd0740 1 --2- 172.21.15.79:0/2954722590 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b84770b420 0x55b847715760 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0004f10 tx=0x7f5ae0004f40 comp rx=0 tx=0).stop 2024-08-20T01:47:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:22.350+0000 7f5af1fd0740 1 -- 172.21.15.79:0/2954722590 shutdown_connections 2024-08-20T01:47:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:22.351+0000 7f5af1fd0740 1 --2- 172.21.15.79:0/2954722590 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55b847785f60 0x55b847788380 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:22.351+0000 7f5af1fd0740 1 --2- 172.21.15.79:0/2954722590 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b84770b420 0x55b847715760 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:22.351+0000 7f5af1fd0740 1 --2- 172.21.15.79:0/2954722590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b847707a80 0x55b847714b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:22.351+0000 7f5af1fd0740 1 --2- 172.21.15.79:0/2954722590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8476fc0c0 0x55b8477144f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:22.351+0000 7f5af1fd0740 1 -- 172.21.15.79:0/2954722590 >> 172.21.15.79:0/2954722590 conn(0x55b8476f88e0 msgr2=0x55b84770a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:22.351+0000 7f5ac7fff640 0 client.27241 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:47:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:22.351+0000 7f5af1fd0740 1 -- 172.21.15.79:0/2954722590 shutdown_connections 2024-08-20T01:47:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:22.351+0000 7f5af1fd0740 1 -- 172.21.15.79:0/2954722590 wait complete. 2024-08-20T01:47:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:22.351+0000 7f5af1fd0740 20 client.27241 trim_cache size 0 max 16384 2024-08-20T01:47:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:47:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:47:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:47:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:47:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:22.352+0000 7f5aedf7c640 1 -- 172.21.15.79:0/1969787869 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5ad80b3da0 msgr2=0x7f5ad80b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:22.352+0000 7f5aedf7c640 1 --2- 172.21.15.79:0/1969787869 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5ad80b3da0 0x7f5ad80b6260 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0005fd0 tx=0x7f5ae0009600 comp rx=0 tx=0).stop 2024-08-20T01:47:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:22.352+0000 7f5aedf7c640 1 -- 172.21.15.79:0/1969787869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ae8101c60 msgr2=0x7f5ae8072070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:22.352+0000 7f5aedf7c640 1 --2- 172.21.15.79:0/1969787869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ae8101c60 0x7f5ae8072070 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4010ad0 tx=0x7f5ad4010f90 comp rx=0 tx=0).stop 2024-08-20T01:47:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:22.352+0000 7f5aedf7c640 1 -- 172.21.15.79:0/1969787869 shutdown_connections 2024-08-20T01:47:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:22.352+0000 7f5aedf7c640 1 --2- 172.21.15.79:0/1969787869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ae8102620 0x7f5ae8072c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:22.352+0000 7f5aedf7c640 1 --2- 172.21.15.79:0/1969787869 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5ad80b3da0 0x7f5ad80b6260 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:22.352+0000 7f5aedf7c640 1 --2- 172.21.15.79:0/1969787869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ae8101c60 0x7f5ae8072070 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:22.352+0000 7f5aedf7c640 1 --2- 172.21.15.79:0/1969787869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ae8100b10 0x7f5ae8071a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:22.352+0000 7f5aedf7c640 1 -- 172.21.15.79:0/1969787869 >> 172.21.15.79:0/1969787869 conn(0x7f5ae80fc3d0 msgr2=0x7f5ae8105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:22.352+0000 7f5aedf7c640 1 -- 172.21.15.79:0/1969787869 shutdown_connections 2024-08-20T01:47:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:22.353+0000 7f5aedf7c640 1 -- 172.21.15.79:0/1969787869 wait complete. 2024-08-20T01:47:22.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:22 smithi175 ceph-mon[22392]: pgmap v648: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 MiB/s wr, 6.94k op/s 2024-08-20T01:47:22.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:22 smithi079 ceph-mon[18656]: pgmap v648: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 MiB/s wr, 6.94k op/s 2024-08-20T01:47:22.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:22 smithi081 ceph-mon[22209]: pgmap v648: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 MiB/s wr, 6.94k op/s 2024-08-20T01:47:24.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:24 smithi175 ceph-mon[22392]: pgmap v649: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 27 MiB/s wr, 6.84k op/s 2024-08-20T01:47:24.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:24 smithi079 ceph-mon[18656]: pgmap v649: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 27 MiB/s wr, 6.84k op/s 2024-08-20T01:47:24.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:24 smithi081 ceph-mon[22209]: pgmap v649: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 27 MiB/s wr, 6.84k op/s 2024-08-20T01:47:25.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:25 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:47:25.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:25 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:47:25.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:25 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:47:26.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:26 smithi079 ceph-mon[18656]: pgmap v650: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 MiB/s wr, 7.11k op/s 2024-08-20T01:47:26.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:26 smithi081 ceph-mon[22209]: pgmap v650: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 MiB/s wr, 7.11k op/s 2024-08-20T01:47:26.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:26 smithi175 ceph-mon[22392]: pgmap v650: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 MiB/s wr, 7.11k op/s 2024-08-20T01:47:28.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:28 smithi079 ceph-mon[18656]: pgmap v651: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 26 MiB/s wr, 6.62k op/s 2024-08-20T01:47:28.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:28 smithi081 ceph-mon[22209]: pgmap v651: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 26 MiB/s wr, 6.62k op/s 2024-08-20T01:47:28.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:28 smithi175 ceph-mon[22392]: pgmap v651: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 26 MiB/s wr, 6.62k op/s 2024-08-20T01:47:30.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:30 smithi079 ceph-mon[18656]: pgmap v652: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 28 MiB/s wr, 7.13k op/s 2024-08-20T01:47:30.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:30 smithi081 ceph-mon[22209]: pgmap v652: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 28 MiB/s wr, 7.13k op/s 2024-08-20T01:47:30.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:30 smithi175 ceph-mon[22392]: pgmap v652: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 28 MiB/s wr, 7.13k op/s 2024-08-20T01:47:32.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:32 smithi079 ceph-mon[18656]: pgmap v653: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 MiB/s wr, 6.71k op/s 2024-08-20T01:47:32.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:32 smithi081 ceph-mon[22209]: pgmap v653: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 MiB/s wr, 6.71k op/s 2024-08-20T01:47:32.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:32 smithi175 ceph-mon[22392]: pgmap v653: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 MiB/s wr, 6.71k op/s 2024-08-20T01:47:34.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:34 smithi079 ceph-mon[18656]: pgmap v654: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 MiB/s wr, 6.60k op/s 2024-08-20T01:47:34.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:34 smithi081 ceph-mon[22209]: pgmap v654: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 MiB/s wr, 6.60k op/s 2024-08-20T01:47:34.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:34 smithi175 ceph-mon[22392]: pgmap v654: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 MiB/s wr, 6.60k op/s 2024-08-20T01:47:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.500+0000 7fbd2759e640 1 -- 172.21.15.79:0/2887539994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd2009cc80 msgr2=0x7fbd2009d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.500+0000 7fbd2759e640 1 --2- 172.21.15.79:0/2887539994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd2009cc80 0x7fbd2009d100 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fbd14009930 tx=0x7fbd1402a440 comp rx=0 tx=0).stop 2024-08-20T01:47:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.500+0000 7fbd2759e640 1 -- 172.21.15.79:0/2887539994 shutdown_connections 2024-08-20T01:47:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.500+0000 7fbd2759e640 1 --2- 172.21.15.79:0/2887539994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd2009d640 0x7fbd200a3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.500+0000 7fbd2759e640 1 --2- 172.21.15.79:0/2887539994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd2009cc80 0x7fbd2009d100 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.500+0000 7fbd2759e640 1 --2- 172.21.15.79:0/2887539994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd2009bb30 0x7fbd2009bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.500+0000 7fbd2759e640 1 -- 172.21.15.79:0/2887539994 >> 172.21.15.79:0/2887539994 conn(0x7fbd2000af40 msgr2=0x7fbd2000b370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.500+0000 7fbd2759e640 1 -- 172.21.15.79:0/2887539994 shutdown_connections 2024-08-20T01:47:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.500+0000 7fbd2759e640 1 -- 172.21.15.79:0/2887539994 wait complete. 2024-08-20T01:47:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.501+0000 7fbd2759e640 1 Processor -- start 2024-08-20T01:47:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.501+0000 7fbd2759e640 1 -- start start 2024-08-20T01:47:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.501+0000 7fbd2759e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd2009bb30 0x7fbd20131fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.501+0000 7fbd2759e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd2009cc80 0x7fbd201325f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.501+0000 7fbd2759e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd2009d640 0x7fbd20133220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.501+0000 7fbd2759e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbd200a77a0 con 0x7fbd2009cc80 2024-08-20T01:47:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.501+0000 7fbd2759e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbd200a7620 con 0x7fbd2009d640 2024-08-20T01:47:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.501+0000 7fbd2759e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbd200a7920 con 0x7fbd2009bb30 2024-08-20T01:47:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.502+0000 7fbd25d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd2009cc80 0x7fbd201325f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:35.506 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.502+0000 7fbd2659c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd2009bb30 0x7fbd20131fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:35.506 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.502+0000 7fbd2659c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd2009bb30 0x7fbd20131fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:50684/0 (socket says 172.21.15.79:50684) 2024-08-20T01:47:35.506 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.502+0000 7fbd2659c640 1 -- 172.21.15.79:0/1417536943 learned_addr learned my addr 172.21.15.79:0/1417536943 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:35.506 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.502+0000 7fbd26d9d640 1 --2- 172.21.15.79:0/1417536943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd2009d640 0x7fbd20133220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:35.506 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.502+0000 7fbd2659c640 1 -- 172.21.15.79:0/1417536943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd2009d640 msgr2=0x7fbd20133220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:35.506 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.502+0000 7fbd2659c640 1 --2- 172.21.15.79:0/1417536943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd2009d640 0x7fbd20133220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:35.506 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.502+0000 7fbd2659c640 1 -- 172.21.15.79:0/1417536943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd2009cc80 msgr2=0x7fbd201325f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:35.506 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.502+0000 7fbd2659c640 1 --2- 172.21.15.79:0/1417536943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd2009cc80 0x7fbd201325f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:35.506 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.502+0000 7fbd2659c640 1 -- 172.21.15.79:0/1417536943 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd20133ae0 con 0x7fbd2009bb30 2024-08-20T01:47:35.506 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.502+0000 7fbd26d9d640 1 --2- 172.21.15.79:0/1417536943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd2009d640 0x7fbd20133220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:47:35.506 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.503+0000 7fbd2659c640 1 --2- 172.21.15.79:0/1417536943 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd2009bb30 0x7fbd20131fa0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbd1800b450 tx=0x7fbd1800b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.503+0000 7fbd1f7fe640 1 -- 172.21.15.79:0/1417536943 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd18015020 con 0x7fbd2009bb30 2024-08-20T01:47:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.503+0000 7fbd1f7fe640 1 -- 172.21.15.79:0/1417536943 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbd18011d20 con 0x7fbd2009bb30 2024-08-20T01:47:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.503+0000 7fbd1f7fe640 1 -- 172.21.15.79:0/1417536943 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd18010e30 con 0x7fbd2009bb30 2024-08-20T01:47:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.503+0000 7fbd2759e640 1 -- 172.21.15.79:0/1417536943 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd20133dd0 con 0x7fbd2009bb30 2024-08-20T01:47:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.503+0000 7fbd2759e640 1 -- 172.21.15.79:0/1417536943 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd2013a4a0 con 0x7fbd2009bb30 2024-08-20T01:47:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.508+0000 7fbd1f7fe640 1 -- 172.21.15.79:0/1417536943 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fbd18018020 con 0x7fbd2009bb30 2024-08-20T01:47:35.511 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.509+0000 7fbd1f7fe640 1 --2- 172.21.15.79:0/1417536943 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbd0c0b3d10 0x7fbd0c0b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:35.511 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.509+0000 7fbd1f7fe640 1 -- 172.21.15.79:0/1417536943 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fbd180e44e0 con 0x7fbd2009bb30 2024-08-20T01:47:35.511 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.509+0000 7fbd25d9b640 1 --2- 172.21.15.79:0/1417536943 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbd0c0b3d10 0x7fbd0c0b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:35.512 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.509+0000 7fbd2f7f1740 1 Processor -- start 2024-08-20T01:47:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.510+0000 7fbd2f7f1740 1 -- start start 2024-08-20T01:47:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.510+0000 7fbd2f7f1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56083827fa20 0x560838281e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.510+0000 7fbd2f7f1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560838282350 0x560838284740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.510+0000 7fbd2f7f1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560838284d90 0x560838287250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.510+0000 7fbd2f7f1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5608381f2360 con 0x560838282350 2024-08-20T01:47:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.510+0000 7fbd2f7f1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5608381e1860 con 0x56083827fa20 2024-08-20T01:47:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.510+0000 7fbd2f7f1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5608381e58a0 con 0x560838284d90 2024-08-20T01:47:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.510+0000 7fbd26d9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560838284d90 0x560838287250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.510+0000 7fbd2659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56083827fa20 0x560838281e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.510+0000 7fbd26d9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560838284d90 0x560838287250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:50690/0 (socket says 172.21.15.79:50690) 2024-08-20T01:47:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.510+0000 7fbd2659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56083827fa20 0x560838281e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:49816/0 (socket says 172.21.15.79:49816) 2024-08-20T01:47:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.510+0000 7fbd26d9d640 1 -- 172.21.15.79:0/1046160605 learned_addr learned my addr 172.21.15.79:0/1046160605 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.510+0000 7fbd25d9b640 1 --2- 172.21.15.79:0/1046160605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560838282350 0x560838284740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.511+0000 7fbd26d9d640 1 -- 172.21.15.79:0/1046160605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56083827fa20 msgr2=0x560838281e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.511+0000 7fbd26d9d640 1 --2- 172.21.15.79:0/1046160605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56083827fa20 0x560838281e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.511+0000 7fbd26d9d640 1 -- 172.21.15.79:0/1046160605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560838282350 msgr2=0x560838284740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.511+0000 7fbd26d9d640 1 --2- 172.21.15.79:0/1046160605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560838282350 0x560838284740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.511+0000 7fbd26d9d640 1 -- 172.21.15.79:0/1046160605 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560838188e40 con 0x560838284d90 2024-08-20T01:47:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.511+0000 7fbd25d9b640 1 --2- 172.21.15.79:0/1046160605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560838282350 0x560838284740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:47:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.511+0000 7fbd25d9b640 1 --2- 172.21.15.79:0/1417536943 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbd0c0b3d10 0x7fbd0c0b61d0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fbd140057c0 tx=0x7fbd14031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.511+0000 7fbd26d9d640 1 --2- 172.21.15.79:0/1046160605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560838284d90 0x560838287250 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbd28068760 tx=0x7fbd2807e880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4047d01d544247ea server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.512+0000 7fbd1cff9640 1 -- 172.21.15.79:0/1046160605 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd28085070 con 0x560838284d90 2024-08-20T01:47:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.512+0000 7fbd1cff9640 1 -- 172.21.15.79:0/1046160605 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbd28080bc0 con 0x560838284d90 2024-08-20T01:47:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.512+0000 7fbd1cff9640 1 -- 172.21.15.79:0/1046160605 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd28081be0 con 0x560838284d90 2024-08-20T01:47:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.513+0000 7fbd2f7f1740 1 -- 172.21.15.79:0/1046160605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560838284d90 msgr2=0x560838287250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.514+0000 7fbd2f7f1740 1 --2- 172.21.15.79:0/1046160605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560838284d90 0x560838287250 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbd28068760 tx=0x7fbd2807e880 comp rx=0 tx=0).stop 2024-08-20T01:47:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.514+0000 7fbd2f7f1740 1 -- 172.21.15.79:0/1046160605 shutdown_connections 2024-08-20T01:47:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.514+0000 7fbd2f7f1740 1 --2- 172.21.15.79:0/1046160605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560838284d90 0x560838287250 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.514+0000 7fbd2f7f1740 1 --2- 172.21.15.79:0/1046160605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560838282350 0x560838284740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.514+0000 7fbd2f7f1740 1 --2- 172.21.15.79:0/1046160605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56083827fa20 0x560838281e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.514+0000 7fbd2f7f1740 1 -- 172.21.15.79:0/1046160605 >> 172.21.15.79:0/1046160605 conn(0x56083827ab70 msgr2=0x56083827b900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.514+0000 7fbd2f7f1740 1 -- 172.21.15.79:0/1046160605 shutdown_connections 2024-08-20T01:47:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.515+0000 7fbd2f7f1740 1 -- 172.21.15.79:0/1046160605 wait complete. 2024-08-20T01:47:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.515+0000 7fbd2f7f1740 1 -- start start 2024-08-20T01:47:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.515+0000 7fbd2f7f1740 1 Processor -- start 2024-08-20T01:47:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.516+0000 7fbd2f7f1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56083827fa20 0x560838289240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.516+0000 7fbd2f7f1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560838282350 0x5608382898e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.516+0000 7fbd2f7f1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560838284d90 0x56083828a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.516+0000 7fbd2f7f1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56083811aab0 con 0x560838284d90 2024-08-20T01:47:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.516+0000 7fbd2f7f1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560838168780 con 0x560838282350 2024-08-20T01:47:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.516+0000 7fbd2f7f1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560838287d70 con 0x56083827fa20 2024-08-20T01:47:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.516+0000 7fbd2659c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56083827fa20 0x560838289240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.516+0000 7fbd25d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560838282350 0x5608382898e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.516+0000 7fbd2659c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56083827fa20 0x560838289240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:50696/0 (socket says 172.21.15.79:50696) 2024-08-20T01:47:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.516+0000 7fbd26d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560838284d90 0x56083828a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.516+0000 7fbd25d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560838282350 0x5608382898e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:49832/0 (socket says 172.21.15.79:49832) 2024-08-20T01:47:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.516+0000 7fbd2f7f1740 10 client.0 _ll_register_callbacks cb 0x560837ef0a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:47:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.516+0000 7fbd2659c640 1 -- 172.21.15.79:0/3596382406 learned_addr learned my addr 172.21.15.79:0/3596382406 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.516+0000 7fbd25d9b640 1 -- 172.21.15.79:0/3596382406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56083827fa20 msgr2=0x560838289240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.516+0000 7fbd25d9b640 1 --2- 172.21.15.79:0/3596382406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56083827fa20 0x560838289240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.516+0000 7fbd25d9b640 1 -- 172.21.15.79:0/3596382406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560838284d90 msgr2=0x56083828a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.517+0000 7fbd25d9b640 1 --2- 172.21.15.79:0/3596382406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560838284d90 0x56083828a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.517+0000 7fbd25d9b640 1 -- 172.21.15.79:0/3596382406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560837f44790 con 0x560838282350 2024-08-20T01:47:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.517+0000 7fbd2659c640 1 --2- 172.21.15.79:0/3596382406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56083827fa20 0x560838289240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:47:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.517+0000 7fbd26d9d640 1 --2- 172.21.15.79:0/3596382406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560838284d90 0x56083828a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:47:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.517+0000 7fbd25d9b640 1 --2- 172.21.15.79:0/3596382406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560838282350 0x5608382898e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbd14009850 tx=0x7fbd1402a440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=351c696b6429355a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.517+0000 7fbd09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:47:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.517+0000 7fbd09ffb640 1 -- 172.21.15.79:0/3596382406 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd14035050 con 0x560838282350 2024-08-20T01:47:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.517+0000 7fbd09ffb640 1 -- 172.21.15.79:0/3596382406 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fbd140319d0 con 0x560838282350 2024-08-20T01:47:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.517+0000 7fbd2f7f1740 1 -- 172.21.15.79:0/3596382406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560838190e00 con 0x560838282350 2024-08-20T01:47:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.517+0000 7fbd09ffb640 1 -- 172.21.15.79:0/3596382406 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fbd14031bd0 con 0x560838282350 2024-08-20T01:47:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.517+0000 7fbd2f7f1740 10 client.27257 fetch_fsmap learned FSMap version 47 2024-08-20T01:47:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.518+0000 7fbd2f7f1740 1 -- 172.21.15.79:0/3596382406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x560837fbd620 con 0x560838282350 2024-08-20T01:47:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.518+0000 7fbd09ffb640 1 -- 172.21.15.79:0/3596382406 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x560838190e00 con 0x560838282350 2024-08-20T01:47:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.518+0000 7fbd09ffb640 1 -- 172.21.15.79:0/3596382406 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 47) ==== 8394+0+0 (secure 0 0 0) 0x7fbd1405b420 con 0x560838282350 2024-08-20T01:47:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.518+0000 7fbd2f7f1740 10 client.27257 fetch_fsmap finished waiting for FSMap version 47 2024-08-20T01:47:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.518+0000 7fbd2f7f1740 10 client.27257 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:47:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.518+0000 7fbd2f7f1740 20 client.27257 populate_metadata read hostname 'smithi079' 2024-08-20T01:47:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.518+0000 7fbd2f7f1740 1 --2- 172.21.15.79:0/3596382406 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560838294f10 0x560838297370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.518+0000 7fbd2f7f1740 4 client.27257 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:47:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.518+0000 7fbd2f7f1740 1 -- 172.21.15.79:0/3596382406 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5608381f42b0 con 0x560838294f10 2024-08-20T01:47:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.518+0000 7fbd2659c640 1 --2- 172.21.15.79:0/3596382406 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560838294f10 0x560838297370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.519+0000 7fbd09ffb640 10 client.27257 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:47:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.519+0000 7fbd2659c640 1 --2- 172.21.15.79:0/3596382406 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560838294f10 0x560838297370 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=576fb20cee677f0b server_cookie=4c0e9cf3768b4d80 in_seq=0 out_seq=0 2024-08-20T01:47:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.520+0000 7fbd09ffb640 1 -- 172.21.15.79:0/3596382406 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5608381f42b0 con 0x560838294f10 2024-08-20T01:47:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.520+0000 7fbd09ffb640 10 client.27257 handle_command_reply: tid=0 2024-08-20T01:47:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.520+0000 7fbd2f7f1740 1 client.27257 shutdown 2024-08-20T01:47:35.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.520+0000 7fbd2f7f1740 1 -- 172.21.15.79:0/3596382406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560838282350 msgr2=0x5608382898e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:35.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.520+0000 7fbd2f7f1740 1 --2- 172.21.15.79:0/3596382406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560838282350 0x5608382898e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbd14009850 tx=0x7fbd1402a440 comp rx=0 tx=0).stop 2024-08-20T01:47:35.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.520+0000 7fbd2f7f1740 1 -- 172.21.15.79:0/3596382406 shutdown_connections 2024-08-20T01:47:35.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.520+0000 7fbd2f7f1740 1 --2- 172.21.15.79:0/3596382406 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560838294f10 0x560838297370 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:35.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.520+0000 7fbd2f7f1740 1 --2- 172.21.15.79:0/3596382406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560838284d90 0x56083828a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:35.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.520+0000 7fbd2f7f1740 1 --2- 172.21.15.79:0/3596382406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560838282350 0x5608382898e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:35.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.520+0000 7fbd2f7f1740 1 --2- 172.21.15.79:0/3596382406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56083827fa20 0x560838289240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:35.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.520+0000 7fbd2f7f1740 1 -- 172.21.15.79:0/3596382406 >> 172.21.15.79:0/3596382406 conn(0x56083827ab70 msgr2=0x560838279c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:35.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.520+0000 7fbd09ffb640 0 client.27257 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:47:35.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.521+0000 7fbd2f7f1740 1 -- 172.21.15.79:0/3596382406 shutdown_connections 2024-08-20T01:47:35.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.521+0000 7fbd2f7f1740 1 -- 172.21.15.79:0/3596382406 wait complete. 2024-08-20T01:47:35.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.521+0000 7fbd2f7f1740 20 client.27257 trim_cache size 0 max 16384 2024-08-20T01:47:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.551+0000 7fbd2f7f1740 1 Processor -- start 2024-08-20T01:47:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.551+0000 7fbd2f7f1740 1 -- start start 2024-08-20T01:47:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.551+0000 7fbd2f7f1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56083827fa20 0x560838286770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.551+0000 7fbd2f7f1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560838282350 0x560838286cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.552+0000 7fbd2f7f1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560838284d90 0x560838279410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.552+0000 7fbd2f7f1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbd201431a0 con 0x560838284d90 2024-08-20T01:47:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.552+0000 7fbd2f7f1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbd20144e60 con 0x560838282350 2024-08-20T01:47:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.552+0000 7fbd2f7f1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbd20143930 con 0x56083827fa20 2024-08-20T01:47:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.552+0000 7fbd2659c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56083827fa20 0x560838286770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.552+0000 7fbd26d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560838284d90 0x560838279410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.552+0000 7fbd2659c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56083827fa20 0x560838286770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:50702/0 (socket says 172.21.15.79:50702) 2024-08-20T01:47:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.552+0000 7fbd2659c640 1 -- 172.21.15.79:0/3713307406 learned_addr learned my addr 172.21.15.79:0/3713307406 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.552+0000 7fbd25d9b640 1 --2- 172.21.15.79:0/3713307406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560838282350 0x560838286cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:35.556 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.552+0000 7fbd26d9d640 1 -- 172.21.15.79:0/3713307406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56083827fa20 msgr2=0x560838286770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:35.556 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.552+0000 7fbd26d9d640 1 --2- 172.21.15.79:0/3713307406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56083827fa20 0x560838286770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:35.556 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.552+0000 7fbd26d9d640 1 -- 172.21.15.79:0/3713307406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560838282350 msgr2=0x560838286cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:35.556 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.552+0000 7fbd26d9d640 1 --2- 172.21.15.79:0/3713307406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560838282350 0x560838286cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:35.556 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.552+0000 7fbd26d9d640 1 -- 172.21.15.79:0/3713307406 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56083828a820 con 0x560838284d90 2024-08-20T01:47:35.556 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.553+0000 7fbd26d9d640 1 --2- 172.21.15.79:0/3713307406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560838284d90 0x560838279410 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fbd280689b0 tx=0x7fbd28051310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f886d105d3f24ecc server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.553+0000 7fbd0bfff640 1 -- 172.21.15.79:0/3713307406 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd2809a070 con 0x560838284d90 2024-08-20T01:47:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.553+0000 7fbd0bfff640 1 -- 172.21.15.79:0/3713307406 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbd28081ce0 con 0x560838284d90 2024-08-20T01:47:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.553+0000 7fbd0bfff640 1 -- 172.21.15.79:0/3713307406 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd28085040 con 0x560838284d90 2024-08-20T01:47:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.554+0000 7fbd2f7f1740 1 -- 172.21.15.79:0/3713307406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560838284d90 msgr2=0x560838279410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.554+0000 7fbd2f7f1740 1 --2- 172.21.15.79:0/3713307406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560838284d90 0x560838279410 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fbd280689b0 tx=0x7fbd28051310 comp rx=0 tx=0).stop 2024-08-20T01:47:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.554+0000 7fbd2f7f1740 1 -- 172.21.15.79:0/3713307406 shutdown_connections 2024-08-20T01:47:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.554+0000 7fbd2f7f1740 1 --2- 172.21.15.79:0/3713307406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560838284d90 0x560838279410 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:35.559 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.554+0000 7fbd2f7f1740 1 --2- 172.21.15.79:0/3713307406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560838282350 0x560838286cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:35.559 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.554+0000 7fbd2f7f1740 1 --2- 172.21.15.79:0/3713307406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56083827fa20 0x560838286770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:35.559 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.554+0000 7fbd2f7f1740 1 -- 172.21.15.79:0/3713307406 >> 172.21.15.79:0/3713307406 conn(0x56083827ab70 msgr2=0x5608382883e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:35.559 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.554+0000 7fbd2f7f1740 1 -- 172.21.15.79:0/3713307406 shutdown_connections 2024-08-20T01:47:35.559 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.555+0000 7fbd2f7f1740 1 -- 172.21.15.79:0/3713307406 wait complete. 2024-08-20T01:47:35.559 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.555+0000 7fbd2f7f1740 1 -- start start 2024-08-20T01:47:35.559 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.555+0000 7fbd2f7f1740 1 Processor -- start 2024-08-20T01:47:35.559 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.556+0000 7fbd2f7f1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56083827fa20 0x56083828d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:35.559 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.556+0000 7fbd2f7f1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560838282350 0x56083828de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:35.559 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.556+0000 7fbd2f7f1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560838284d90 0x56083828ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:35.559 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.556+0000 7fbd2f7f1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbd20144790 con 0x560838284d90 2024-08-20T01:47:35.559 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.556+0000 7fbd2f7f1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbd20144000 con 0x560838282350 2024-08-20T01:47:35.560 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.556+0000 7fbd2f7f1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbd20141180 con 0x56083827fa20 2024-08-20T01:47:35.560 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.556+0000 7fbd2f7f1740 10 client.0 _ll_register_callbacks cb 0x7fbd140035f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:47:35.561 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.556+0000 7fbd2659c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56083827fa20 0x56083828d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:35.562 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.556+0000 7fbd2659c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56083827fa20 0x56083828d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:50704/0 (socket says 172.21.15.79:50704) 2024-08-20T01:47:35.562 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.556+0000 7fbd2659c640 1 -- 172.21.15.79:0/1402343537 learned_addr learned my addr 172.21.15.79:0/1402343537 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:35.562 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.556+0000 7fbd25d9b640 1 --2- 172.21.15.79:0/1402343537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560838282350 0x56083828de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:35.562 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.556+0000 7fbd26d9d640 1 --2- 172.21.15.79:0/1402343537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560838284d90 0x56083828ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:35.562 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.556+0000 7fbd2659c640 1 -- 172.21.15.79:0/1402343537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560838282350 msgr2=0x56083828de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:35.562 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.556+0000 7fbd2659c640 1 --2- 172.21.15.79:0/1402343537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560838282350 0x56083828de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:35.562 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.556+0000 7fbd2659c640 1 -- 172.21.15.79:0/1402343537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560838284d90 msgr2=0x56083828ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:35.562 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.556+0000 7fbd2659c640 1 --2- 172.21.15.79:0/1402343537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560838284d90 0x56083828ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:35.562 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.556+0000 7fbd2659c640 1 -- 172.21.15.79:0/1402343537 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560838284ab0 con 0x56083827fa20 2024-08-20T01:47:35.562 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.556+0000 7fbd26d9d640 1 --2- 172.21.15.79:0/1402343537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560838284d90 0x56083828ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:47:35.562 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.557+0000 7fbd2659c640 1 --2- 172.21.15.79:0/1402343537 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56083827fa20 0x56083828d7d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbd180a8650 tx=0x7fbd180ab4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9dcd27a598ce676 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:35.563 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.557+0000 7fbd09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:47:35.563 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.557+0000 7fbd09ffb640 1 -- 172.21.15.79:0/1402343537 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd180c4070 con 0x56083827fa20 2024-08-20T01:47:35.563 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.557+0000 7fbd09ffb640 1 -- 172.21.15.79:0/1402343537 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fbd180b4000 con 0x56083827fa20 2024-08-20T01:47:35.563 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.557+0000 7fbd2f7f1740 1 -- 172.21.15.79:0/1402343537 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd28081ce0 con 0x56083827fa20 2024-08-20T01:47:35.563 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.558+0000 7fbd09ffb640 1 -- 172.21.15.79:0/1402343537 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fbd180b4200 con 0x56083827fa20 2024-08-20T01:47:35.563 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.558+0000 7fbd2f7f1740 10 client.27256 fetch_fsmap learned FSMap version 47 2024-08-20T01:47:35.563 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.558+0000 7fbd2f7f1740 1 -- 172.21.15.79:0/1402343537 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x5608382904d0 con 0x56083827fa20 2024-08-20T01:47:35.563 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.558+0000 7fbd09ffb640 1 -- 172.21.15.79:0/1402343537 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbd180aa640 con 0x56083827fa20 2024-08-20T01:47:35.563 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.558+0000 7fbd09ffb640 1 -- 172.21.15.79:0/1402343537 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 47) ==== 8394+0+0 (secure 0 0 0) 0x7fbd180a6d50 con 0x56083827fa20 2024-08-20T01:47:35.563 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.558+0000 7fbd2f7f1740 10 client.27256 fetch_fsmap finished waiting for FSMap version 47 2024-08-20T01:47:35.563 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.558+0000 7fbd2f7f1740 10 client.27256 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:47:35.563 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.558+0000 7fbd2f7f1740 20 client.27256 populate_metadata read hostname 'smithi079' 2024-08-20T01:47:35.563 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.559+0000 7fbd2f7f1740 1 --2- 172.21.15.79:0/1402343537 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560838290de0 0x560838301c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:35.564 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.559+0000 7fbd2f7f1740 4 client.27256 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:47:35.564 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.559+0000 7fbd2f7f1740 1 -- 172.21.15.79:0/1402343537 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fbd28081ce0 con 0x560838290de0 2024-08-20T01:47:35.564 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.560+0000 7fbd25d9b640 1 --2- 172.21.15.79:0/1402343537 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560838290de0 0x560838301c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:35.564 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.561+0000 7fbd09ffb640 10 client.27256 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:47:35.564 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:35.561+0000 7fbd25d9b640 1 --2- 172.21.15.79:0/1402343537 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560838290de0 0x560838301c60 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46dc0144903fba95 server_cookie=6ce976aaf338ceb in_seq=0 out_seq=0 2024-08-20T01:47:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:36.673+0000 7fbd09ffb640 1 -- 172.21.15.79:0/1402343537 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fbd28081ce0 con 0x560838290de0 2024-08-20T01:47:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:36.673+0000 7fbd09ffb640 10 client.27256 handle_command_reply: tid=0 2024-08-20T01:47:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:36.673+0000 7fbd2f7f1740 1 client.27256 shutdown 2024-08-20T01:47:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:36.673+0000 7fbd2f7f1740 1 -- 172.21.15.79:0/1402343537 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56083827fa20 msgr2=0x56083828d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:36.673+0000 7fbd2f7f1740 1 --2- 172.21.15.79:0/1402343537 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56083827fa20 0x56083828d7d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbd180a8650 tx=0x7fbd180ab4a0 comp rx=0 tx=0).stop 2024-08-20T01:47:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:36.673+0000 7fbd2f7f1740 1 -- 172.21.15.79:0/1402343537 shutdown_connections 2024-08-20T01:47:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:36.673+0000 7fbd2f7f1740 1 --2- 172.21.15.79:0/1402343537 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560838290de0 0x560838301c60 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:36.677 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:36.673+0000 7fbd2f7f1740 1 --2- 172.21.15.79:0/1402343537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560838284d90 0x56083828ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:36.677 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:36.673+0000 7fbd2f7f1740 1 --2- 172.21.15.79:0/1402343537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560838282350 0x56083828de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:36.677 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:36.673+0000 7fbd2f7f1740 1 --2- 172.21.15.79:0/1402343537 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56083827fa20 0x56083828d7d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:36.677 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:36.673+0000 7fbd2f7f1740 1 -- 172.21.15.79:0/1402343537 >> 172.21.15.79:0/1402343537 conn(0x56083827ab70 msgr2=0x56083827eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:36.677 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:36.673+0000 7fbd09ffb640 0 client.27256 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:47:36.677 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:36.673+0000 7fbd2f7f1740 1 -- 172.21.15.79:0/1402343537 shutdown_connections 2024-08-20T01:47:36.677 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:36.673+0000 7fbd2f7f1740 1 -- 172.21.15.79:0/1402343537 wait complete. 2024-08-20T01:47:36.677 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:36.673+0000 7fbd2f7f1740 20 client.27256 trim_cache size 0 max 16384 2024-08-20T01:47:36.677 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:47:36.677 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:47:36.678 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:47:36.678 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:47:36.678 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:36.674+0000 7fbd2759e640 1 -- 172.21.15.79:0/1417536943 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbd0c0b3d10 msgr2=0x7fbd0c0b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:36.678 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:36.674+0000 7fbd2759e640 1 --2- 172.21.15.79:0/1417536943 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbd0c0b3d10 0x7fbd0c0b61d0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fbd140057c0 tx=0x7fbd14031400 comp rx=0 tx=0).stop 2024-08-20T01:47:36.679 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:36.674+0000 7fbd2759e640 1 -- 172.21.15.79:0/1417536943 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd2009bb30 msgr2=0x7fbd20131fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:36.679 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:36.674+0000 7fbd2759e640 1 --2- 172.21.15.79:0/1417536943 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd2009bb30 0x7fbd20131fa0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbd1800b450 tx=0x7fbd1800b910 comp rx=0 tx=0).stop 2024-08-20T01:47:36.679 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:36.674+0000 7fbd2759e640 1 -- 172.21.15.79:0/1417536943 shutdown_connections 2024-08-20T01:47:36.679 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:36.674+0000 7fbd2759e640 1 --2- 172.21.15.79:0/1417536943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd2009d640 0x7fbd20133220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:36.679 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:36.674+0000 7fbd2759e640 1 --2- 172.21.15.79:0/1417536943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd2009cc80 0x7fbd201325f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:36.679 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:36.674+0000 7fbd2759e640 1 --2- 172.21.15.79:0/1417536943 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbd0c0b3d10 0x7fbd0c0b61d0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:36.679 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:36.674+0000 7fbd2759e640 1 --2- 172.21.15.79:0/1417536943 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd2009bb30 0x7fbd20131fa0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:36.679 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:36.674+0000 7fbd2759e640 1 -- 172.21.15.79:0/1417536943 >> 172.21.15.79:0/1417536943 conn(0x7fbd2000af40 msgr2=0x7fbd200a00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:36.679 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:36.674+0000 7fbd2759e640 1 -- 172.21.15.79:0/1417536943 shutdown_connections 2024-08-20T01:47:36.679 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:36.674+0000 7fbd2759e640 1 -- 172.21.15.79:0/1417536943 wait complete. 2024-08-20T01:47:36.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:36 smithi079 ceph-mon[18656]: pgmap v655: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 MiB/s wr, 6.99k op/s 2024-08-20T01:47:36.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:36 smithi081 ceph-mon[22209]: pgmap v655: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 MiB/s wr, 6.99k op/s 2024-08-20T01:47:36.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:36 smithi175 ceph-mon[22392]: pgmap v655: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 MiB/s wr, 6.99k op/s 2024-08-20T01:47:38.426 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:38 smithi079 ceph-mon[18656]: pgmap v656: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 6.67k op/s 2024-08-20T01:47:38.434 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:47:38.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:38 smithi081 ceph-mon[22209]: pgmap v656: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 6.67k op/s 2024-08-20T01:47:38.889 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:47:38.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:38 smithi175 ceph-mon[22392]: pgmap v656: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 6.67k op/s 2024-08-20T01:47:39.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.472+0000 7fa9fa769640 1 -- 172.21.15.79:0/183688181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9f4109e80 msgr2=0x7fa9f4110ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:39.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.472+0000 7fa9fa769640 1 --2- 172.21.15.79:0/183688181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9f4109e80 0x7fa9f4110ee0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0009930 tx=0x7fa9f002a440 comp rx=0 tx=0).stop 2024-08-20T01:47:39.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.472+0000 7fa9fa769640 1 -- 172.21.15.79:0/183688181 shutdown_connections 2024-08-20T01:47:39.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.472+0000 7fa9fa769640 1 --2- 172.21.15.79:0/183688181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9f411bdd0 0x7fa9f411e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:39.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.472+0000 7fa9fa769640 1 --2- 172.21.15.79:0/183688181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9f410a260 0x7fa9f410a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:39.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.472+0000 7fa9fa769640 1 --2- 172.21.15.79:0/183688181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9f4109e80 0x7fa9f4110ee0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:39.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.472+0000 7fa9fa769640 1 -- 172.21.15.79:0/183688181 >> 172.21.15.79:0/183688181 conn(0x7fa9f406c830 msgr2=0x7fa9f406cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:39.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.472+0000 7fa9fa769640 1 -- 172.21.15.79:0/183688181 shutdown_connections 2024-08-20T01:47:39.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.472+0000 7fa9fa769640 1 -- 172.21.15.79:0/183688181 wait complete. 2024-08-20T01:47:39.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.473+0000 7fa9fa769640 1 Processor -- start 2024-08-20T01:47:39.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.473+0000 7fa9fa769640 1 -- start start 2024-08-20T01:47:39.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.473+0000 7fa9fa769640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9f4109e80 0x7fa9f41a7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:39.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.473+0000 7fa9fa769640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9f410a260 0x7fa9f41a80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:39.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.473+0000 7fa9fa769640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9f411bdd0 0x7fa9f41ad440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:39.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.473+0000 7fa9fa769640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f4121630 con 0x7fa9f411bdd0 2024-08-20T01:47:39.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.473+0000 7fa9fa769640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f41214b0 con 0x7fa9f4109e80 2024-08-20T01:47:39.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.473+0000 7fa9fa769640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f41217b0 con 0x7fa9f410a260 2024-08-20T01:47:39.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.473+0000 7fa9f9767640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9f4109e80 0x7fa9f41a7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:39.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.473+0000 7fa9f9767640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9f4109e80 0x7fa9f41a7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:49884/0 (socket says 172.21.15.79:49884) 2024-08-20T01:47:39.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.473+0000 7fa9f9767640 1 -- 172.21.15.79:0/1356933421 learned_addr learned my addr 172.21.15.79:0/1356933421 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:39.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.473+0000 7fa9f9f68640 1 --2- 172.21.15.79:0/1356933421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9f411bdd0 0x7fa9f41ad440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:39.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.473+0000 7fa9f8f66640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9f410a260 0x7fa9f41a80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:39.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.474+0000 7fa9f9767640 1 -- 172.21.15.79:0/1356933421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9f410a260 msgr2=0x7fa9f41a80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:39.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.474+0000 7fa9f9767640 1 --2- 172.21.15.79:0/1356933421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9f410a260 0x7fa9f41a80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:39.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.474+0000 7fa9f9767640 1 -- 172.21.15.79:0/1356933421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9f411bdd0 msgr2=0x7fa9f41ad440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:39.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.474+0000 7fa9f9767640 1 --2- 172.21.15.79:0/1356933421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9f411bdd0 0x7fa9f41ad440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:39.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.474+0000 7fa9f9767640 1 -- 172.21.15.79:0/1356933421 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9f41adc10 con 0x7fa9f4109e80 2024-08-20T01:47:39.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.474+0000 7fa9f9f68640 1 --2- 172.21.15.79:0/1356933421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9f411bdd0 0x7fa9f41ad440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:47:39.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.474+0000 7fa9f9767640 1 --2- 172.21.15.79:0/1356933421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9f4109e80 0x7fa9f41a7b60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa9f002a960 tx=0x7fa9f0003c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:39.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.475+0000 7fa9ea7fc640 1 -- 172.21.15.79:0/1356933421 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f003f070 con 0x7fa9f4109e80 2024-08-20T01:47:39.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.475+0000 7fa9ea7fc640 1 -- 172.21.15.79:0/1356933421 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa9f0003e10 con 0x7fa9f4109e80 2024-08-20T01:47:39.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.475+0000 7fa9ea7fc640 1 -- 172.21.15.79:0/1356933421 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f0035030 con 0x7fa9f4109e80 2024-08-20T01:47:39.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.475+0000 7fa9fa769640 1 -- 172.21.15.79:0/1356933421 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9f41adea0 con 0x7fa9f4109e80 2024-08-20T01:47:39.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.475+0000 7fa9fa769640 1 -- 172.21.15.79:0/1356933421 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9f41b45c0 con 0x7fa9f4109e80 2024-08-20T01:47:39.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.479+0000 7fa9fddc4740 1 Processor -- start 2024-08-20T01:47:39.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.479+0000 7fa9fddc4740 1 -- start start 2024-08-20T01:47:39.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.479+0000 7fa9fddc4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c1f3aaa10 0x562c1f3aadf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:39.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.479+0000 7fa9fddc4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c1f3ab330 0x562c1f3b6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:39.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.479+0000 7fa9fddc4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c1f3b72c0 0x562c1f3b96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:39.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.479+0000 7fa9fddc4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562c1f3218e0 con 0x562c1f3ab330 2024-08-20T01:47:39.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.479+0000 7fa9fddc4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562c1f310de0 con 0x562c1f3b72c0 2024-08-20T01:47:39.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.479+0000 7fa9fddc4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562c1f314e20 con 0x562c1f3aaa10 2024-08-20T01:47:39.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.479+0000 7fa9f9f68640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c1f3aaa10 0x562c1f3aadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:39.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.479+0000 7fa9f8f66640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c1f3b72c0 0x562c1f3b96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:39.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.480+0000 7fa9f8f66640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c1f3b72c0 0x562c1f3b96b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:49894/0 (socket says 172.21.15.79:49894) 2024-08-20T01:47:39.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.480+0000 7fa9f8f66640 1 -- 172.21.15.79:0/2510772667 learned_addr learned my addr 172.21.15.79:0/2510772667 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:39.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.480+0000 7fa9f8f66640 1 -- 172.21.15.79:0/2510772667 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c1f3aaa10 msgr2=0x562c1f3aadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:39.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.480+0000 7fa9f8f66640 1 --2- 172.21.15.79:0/2510772667 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c1f3aaa10 0x562c1f3aadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:39.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.480+0000 7fa9f8f66640 1 -- 172.21.15.79:0/2510772667 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c1f3ab330 msgr2=0x562c1f3b6d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:47:39.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.480+0000 7fa9f8f66640 1 --2- 172.21.15.79:0/2510772667 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c1f3ab330 0x562c1f3b6d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:39.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.480+0000 7fa9f8f66640 1 -- 172.21.15.79:0/2510772667 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c1f070650 con 0x562c1f3b72c0 2024-08-20T01:47:39.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.480+0000 7fa9f8f66640 1 --2- 172.21.15.79:0/2510772667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c1f3b72c0 0x562c1f3b96b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa9e40103a0 tx=0x7fa9e4010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66b81d9de861d9b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:39.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.481+0000 7fa9df7fe640 1 -- 172.21.15.79:0/2510772667 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e4016070 con 0x562c1f3b72c0 2024-08-20T01:47:39.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.481+0000 7fa9df7fe640 1 -- 172.21.15.79:0/2510772667 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa9e4012ba0 con 0x562c1f3b72c0 2024-08-20T01:47:39.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.481+0000 7fa9df7fe640 1 -- 172.21.15.79:0/2510772667 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e401bc80 con 0x562c1f3b72c0 2024-08-20T01:47:39.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.481+0000 7fa9ea7fc640 1 -- 172.21.15.79:0/1356933421 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa9f0042070 con 0x7fa9f4109e80 2024-08-20T01:47:39.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.482+0000 7fa9fddc4740 1 -- 172.21.15.79:0/2510772667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c1f3b72c0 msgr2=0x562c1f3b96b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:39.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.482+0000 7fa9fddc4740 1 --2- 172.21.15.79:0/2510772667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c1f3b72c0 0x562c1f3b96b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa9e40103a0 tx=0x7fa9e4010860 comp rx=0 tx=0).stop 2024-08-20T01:47:39.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.482+0000 7fa9fddc4740 1 -- 172.21.15.79:0/2510772667 shutdown_connections 2024-08-20T01:47:39.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.482+0000 7fa9fddc4740 1 --2- 172.21.15.79:0/2510772667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c1f3b72c0 0x562c1f3b96b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:39.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.482+0000 7fa9fddc4740 1 --2- 172.21.15.79:0/2510772667 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c1f3ab330 0x562c1f3b6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:39.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.482+0000 7fa9fddc4740 1 --2- 172.21.15.79:0/2510772667 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c1f3aaa10 0x562c1f3aadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:39.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.482+0000 7fa9fddc4740 1 -- 172.21.15.79:0/2510772667 >> 172.21.15.79:0/2510772667 conn(0x562c1f3a8840 msgr2=0x562c1f3a99e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:39.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.482+0000 7fa9fddc4740 1 -- 172.21.15.79:0/2510772667 shutdown_connections 2024-08-20T01:47:39.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.482+0000 7fa9fddc4740 1 -- 172.21.15.79:0/2510772667 wait complete. 2024-08-20T01:47:39.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.483+0000 7fa9fddc4740 1 -- start start 2024-08-20T01:47:39.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.483+0000 7fa9fddc4740 1 Processor -- start 2024-08-20T01:47:39.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.483+0000 7fa9ea7fc640 1 --2- 172.21.15.79:0/1356933421 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa9e00b3c80 0x7fa9e00b6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:39.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.483+0000 7fa9fddc4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c1f3aaa10 0x562c1f3b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:39.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.483+0000 7fa9fddc4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c1f3ab330 0x562c1f3b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:39.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.483+0000 7fa9fddc4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c1f3b72c0 0x562c1f3b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:39.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.483+0000 7fa9fddc4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562c1f173700 con 0x562c1f3b72c0 2024-08-20T01:47:39.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.483+0000 7fa9fddc4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562c1f2977c0 con 0x562c1f3ab330 2024-08-20T01:47:39.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.483+0000 7fa9fddc4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562c1f3b9f70 con 0x562c1f3aaa10 2024-08-20T01:47:39.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.484+0000 7fa9fddc4740 10 client.0 _ll_register_callbacks cb 0x562c1f30a6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:47:39.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.484+0000 7fa9f8f66640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c1f3ab330 0x562c1f3b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:39.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.484+0000 7fa9f8f66640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c1f3ab330 0x562c1f3b4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:49898/0 (socket says 172.21.15.79:49898) 2024-08-20T01:47:39.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.484+0000 7fa9f8f66640 1 -- 172.21.15.79:0/1016588572 learned_addr learned my addr 172.21.15.79:0/1016588572 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:39.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.484+0000 7fa9f9f68640 1 --2- 172.21.15.79:0/1356933421 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa9e00b3c80 0x7fa9e00b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:39.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.485+0000 7fa9f9f68640 1 --2- 172.21.15.79:0/1016588572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c1f3b72c0 0x562c1f3b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:39.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.485+0000 7fa9ea7fc640 1 -- 172.21.15.79:0/1356933421 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fa9f0104380 con 0x7fa9f4109e80 2024-08-20T01:47:39.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.485+0000 7fa9f9f68640 1 --2- 172.21.15.79:0/1356933421 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa9e00b3c80 0x7fa9e00b6140 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00bca0 tx=0x7fa9ec00b4d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:39.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.486+0000 7fa9f8f66640 1 -- 172.21.15.79:0/1016588572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c1f3aaa10 msgr2=0x562c1f3b42c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:47:39.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.486+0000 7fa9f8f66640 1 --2- 172.21.15.79:0/1016588572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c1f3aaa10 0x562c1f3b42c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:39.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.486+0000 7fa9f8f66640 1 -- 172.21.15.79:0/1016588572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c1f3b72c0 msgr2=0x562c1f3b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:39.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.486+0000 7fa9f8f66640 1 --2- 172.21.15.79:0/1016588572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c1f3b72c0 0x562c1f3b4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:39.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.486+0000 7fa9f8f66640 1 -- 172.21.15.79:0/1016588572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c1f3d43e0 con 0x562c1f3ab330 2024-08-20T01:47:39.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.486+0000 7fa9f8f66640 1 --2- 172.21.15.79:0/1016588572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c1f3ab330 0x562c1f3b4800 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa9e401b8a0 tx=0x7fa9e4009c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b514f2b59043cfe6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:39.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.486+0000 7fa9dcff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:47:39.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.487+0000 7fa9dcff9640 1 -- 172.21.15.79:0/1016588572 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e4029060 con 0x562c1f3ab330 2024-08-20T01:47:39.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.487+0000 7fa9dcff9640 1 -- 172.21.15.79:0/1016588572 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fa9e401ba00 con 0x562c1f3ab330 2024-08-20T01:47:39.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.487+0000 7fa9fddc4740 1 -- 172.21.15.79:0/1016588572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562c1f2c0100 con 0x562c1f3ab330 2024-08-20T01:47:39.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.487+0000 7fa9dcff9640 1 -- 172.21.15.79:0/1016588572 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fa9e4016040 con 0x562c1f3ab330 2024-08-20T01:47:39.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.487+0000 7fa9fddc4740 10 client.27275 fetch_fsmap learned FSMap version 47 2024-08-20T01:47:39.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.487+0000 7fa9fddc4740 1 -- 172.21.15.79:0/1016588572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x562c1f3bd2a0 con 0x562c1f3ab330 2024-08-20T01:47:39.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.488+0000 7fa9dcff9640 1 -- 172.21.15.79:0/1016588572 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa9e401bc00 con 0x562c1f3ab330 2024-08-20T01:47:39.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.488+0000 7fa9dcff9640 1 -- 172.21.15.79:0/1016588572 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 47) ==== 8394+0+0 (secure 0 0 0) 0x7fa9e4023030 con 0x562c1f3ab330 2024-08-20T01:47:39.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.489+0000 7fa9fddc4740 10 client.27275 fetch_fsmap finished waiting for FSMap version 47 2024-08-20T01:47:39.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.489+0000 7fa9fddc4740 10 client.27275 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:47:39.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.489+0000 7fa9fddc4740 20 client.27275 populate_metadata read hostname 'smithi079' 2024-08-20T01:47:39.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.489+0000 7fa9fddc4740 1 --2- 172.21.15.79:0/1016588572 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x562c1f3be650 0x562c1f3c0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:39.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.489+0000 7fa9fddc4740 4 client.27275 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:47:39.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.489+0000 7fa9fddc4740 1 -- 172.21.15.79:0/1016588572 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c1f2c0100 con 0x562c1f3be650 2024-08-20T01:47:39.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.490+0000 7fa9f9767640 1 --2- 172.21.15.79:0/1016588572 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x562c1f3be650 0x562c1f3c0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:39.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.491+0000 7fa9f9767640 1 --2- 172.21.15.79:0/1016588572 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x562c1f3be650 0x562c1f3c0a80 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adf11532258b7610 server_cookie=8e41c69a47a6d5a0 in_seq=0 out_seq=0 2024-08-20T01:47:39.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.491+0000 7fa9dcff9640 10 client.27275 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:47:39.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.491+0000 7fa9dcff9640 1 -- 172.21.15.79:0/1016588572 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562c1f2c0100 con 0x562c1f3be650 2024-08-20T01:47:39.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.491+0000 7fa9dcff9640 10 client.27275 handle_command_reply: tid=0 2024-08-20T01:47:39.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.492+0000 7fa9fddc4740 1 client.27275 shutdown 2024-08-20T01:47:39.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.493+0000 7fa9fddc4740 1 -- 172.21.15.79:0/1016588572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c1f3ab330 msgr2=0x562c1f3b4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:39.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.493+0000 7fa9fddc4740 1 --2- 172.21.15.79:0/1016588572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c1f3ab330 0x562c1f3b4800 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa9e401b8a0 tx=0x7fa9e4009c80 comp rx=0 tx=0).stop 2024-08-20T01:47:39.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.493+0000 7fa9fddc4740 1 -- 172.21.15.79:0/1016588572 shutdown_connections 2024-08-20T01:47:39.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.493+0000 7fa9fddc4740 1 --2- 172.21.15.79:0/1016588572 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x562c1f3be650 0x562c1f3c0a80 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:39.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.493+0000 7fa9dcff9640 0 client.27275 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:47:39.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.493+0000 7fa9fddc4740 1 --2- 172.21.15.79:0/1016588572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c1f3b72c0 0x562c1f3b4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:39.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.493+0000 7fa9fddc4740 1 --2- 172.21.15.79:0/1016588572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c1f3ab330 0x562c1f3b4800 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:39.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.493+0000 7fa9fddc4740 1 --2- 172.21.15.79:0/1016588572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c1f3aaa10 0x562c1f3b42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:39.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.493+0000 7fa9fddc4740 1 -- 172.21.15.79:0/1016588572 >> 172.21.15.79:0/1016588572 conn(0x562c1f3a8840 msgr2=0x562c1f3ae3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:39.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.493+0000 7fa9fddc4740 1 -- 172.21.15.79:0/1016588572 shutdown_connections 2024-08-20T01:47:39.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.493+0000 7fa9fddc4740 1 -- 172.21.15.79:0/1016588572 wait complete. 2024-08-20T01:47:39.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.493+0000 7fa9fddc4740 20 client.27275 trim_cache size 0 max 16384 2024-08-20T01:47:39.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.528+0000 7fa9fddc4740 1 Processor -- start 2024-08-20T01:47:39.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.528+0000 7fa9fddc4740 1 -- start start 2024-08-20T01:47:39.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.528+0000 7fa9fddc4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c1f3aaa10 0x562c1f3aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:39.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.528+0000 7fa9fddc4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c1f3ab330 0x562c1f3d3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:39.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.528+0000 7fa9f9767640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c1f3aaa10 0x562c1f3aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:39.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.528+0000 7fa9f9767640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c1f3aaa10 0x562c1f3aebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35448/0 (socket says 172.21.15.79:35448) 2024-08-20T01:47:39.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.528+0000 7fa9f9767640 1 -- 172.21.15.79:0/1948571321 learned_addr learned my addr 172.21.15.79:0/1948571321 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:39.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.529+0000 7fa9fddc4740 1 --2- 172.21.15.79:0/1948571321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c1f3b72c0 0x562c1f3b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:39.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.529+0000 7fa9f8f66640 1 --2- 172.21.15.79:0/1948571321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c1f3ab330 0x562c1f3d3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:39.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.529+0000 7fa9fddc4740 1 -- 172.21.15.79:0/1948571321 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f4119a20 con 0x562c1f3aaa10 2024-08-20T01:47:39.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.529+0000 7fa9fddc4740 1 -- 172.21.15.79:0/1948571321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f41b6110 con 0x562c1f3ab330 2024-08-20T01:47:39.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.529+0000 7fa9fddc4740 1 -- 172.21.15.79:0/1948571321 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f41b4be0 con 0x562c1f3b72c0 2024-08-20T01:47:39.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.529+0000 7fa9f9f68640 1 --2- 172.21.15.79:0/1948571321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c1f3b72c0 0x562c1f3b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:39.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.529+0000 7fa9f9f68640 1 -- 172.21.15.79:0/1948571321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c1f3ab330 msgr2=0x562c1f3d3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:39.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.529+0000 7fa9f9f68640 1 --2- 172.21.15.79:0/1948571321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c1f3ab330 0x562c1f3d3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:39.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.529+0000 7fa9f9f68640 1 -- 172.21.15.79:0/1948571321 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c1f3aaa10 msgr2=0x562c1f3aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:39.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.529+0000 7fa9f9f68640 1 --2- 172.21.15.79:0/1948571321 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c1f3aaa10 0x562c1f3aebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:39.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.529+0000 7fa9f9f68640 1 -- 172.21.15.79:0/1948571321 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c1f3ab120 con 0x562c1f3b72c0 2024-08-20T01:47:39.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.530+0000 7fa9f9f68640 1 --2- 172.21.15.79:0/1948571321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c1f3b72c0 0x562c1f3b47c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec038000 tx=0x7fa9ec037000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2560f1ebe9d21a36 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:39.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.530+0000 7fa9deffd640 1 -- 172.21.15.79:0/1948571321 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec0409e0 con 0x562c1f3b72c0 2024-08-20T01:47:39.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.530+0000 7fa9deffd640 1 -- 172.21.15.79:0/1948571321 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa9ec040b80 con 0x562c1f3b72c0 2024-08-20T01:47:39.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.530+0000 7fa9deffd640 1 -- 172.21.15.79:0/1948571321 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec0493c0 con 0x562c1f3b72c0 2024-08-20T01:47:39.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.531+0000 7fa9fddc4740 1 -- 172.21.15.79:0/1948571321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c1f3b72c0 msgr2=0x562c1f3b47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:39.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.531+0000 7fa9fddc4740 1 --2- 172.21.15.79:0/1948571321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c1f3b72c0 0x562c1f3b47c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec038000 tx=0x7fa9ec037000 comp rx=0 tx=0).stop 2024-08-20T01:47:39.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.532+0000 7fa9fddc4740 1 -- 172.21.15.79:0/1948571321 shutdown_connections 2024-08-20T01:47:39.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.532+0000 7fa9fddc4740 1 --2- 172.21.15.79:0/1948571321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c1f3b72c0 0x562c1f3b47c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:39.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.532+0000 7fa9fddc4740 1 --2- 172.21.15.79:0/1948571321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c1f3ab330 0x562c1f3d3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:39.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.532+0000 7fa9fddc4740 1 --2- 172.21.15.79:0/1948571321 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c1f3aaa10 0x562c1f3aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:39.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.532+0000 7fa9fddc4740 1 -- 172.21.15.79:0/1948571321 >> 172.21.15.79:0/1948571321 conn(0x562c1f3a8840 msgr2=0x562c1f3b6110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:39.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.532+0000 7fa9fddc4740 1 -- 172.21.15.79:0/1948571321 shutdown_connections 2024-08-20T01:47:39.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.532+0000 7fa9fddc4740 1 -- 172.21.15.79:0/1948571321 wait complete. 2024-08-20T01:47:39.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.533+0000 7fa9fddc4740 1 -- start start 2024-08-20T01:47:39.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.533+0000 7fa9fddc4740 1 Processor -- start 2024-08-20T01:47:39.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.534+0000 7fa9fddc4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c1f3aaa10 0x562c1f3cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:39.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.534+0000 7fa9fddc4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c1f3ab330 0x562c1f3cfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:39.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.534+0000 7fa9fddc4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c1f3b72c0 0x562c1f42ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:39.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.534+0000 7fa9fddc4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f41b5a40 con 0x562c1f3b72c0 2024-08-20T01:47:39.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.534+0000 7fa9fddc4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f41b52b0 con 0x562c1f3aaa10 2024-08-20T01:47:39.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.534+0000 7fa9fddc4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f410a6a0 con 0x562c1f3ab330 2024-08-20T01:47:39.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.535+0000 7fa9fddc4740 10 client.0 _ll_register_callbacks cb 0x7fa9ec00b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:47:39.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.535+0000 7fa9f9f68640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c1f3b72c0 0x562c1f42ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:39.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.535+0000 7fa9f9f68640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c1f3b72c0 0x562c1f42ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35462/0 (socket says 172.21.15.79:35462) 2024-08-20T01:47:39.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.535+0000 7fa9f9f68640 1 -- 172.21.15.79:0/1052539038 learned_addr learned my addr 172.21.15.79:0/1052539038 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:39.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.535+0000 7fa9f9767640 1 --2- 172.21.15.79:0/1052539038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c1f3aaa10 0x562c1f3cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:39.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.535+0000 7fa9f8f66640 1 --2- 172.21.15.79:0/1052539038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c1f3ab330 0x562c1f3cfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:39.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.535+0000 7fa9f9f68640 1 -- 172.21.15.79:0/1052539038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c1f3ab330 msgr2=0x562c1f3cfb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:39.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.535+0000 7fa9f9f68640 1 --2- 172.21.15.79:0/1052539038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c1f3ab330 0x562c1f3cfb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:39.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.535+0000 7fa9f9f68640 1 -- 172.21.15.79:0/1052539038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c1f3aaa10 msgr2=0x562c1f3cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:39.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.535+0000 7fa9f9f68640 1 --2- 172.21.15.79:0/1052539038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c1f3aaa10 0x562c1f3cf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:39.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.536+0000 7fa9f9f68640 1 -- 172.21.15.79:0/1052539038 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c1f430490 con 0x562c1f3b72c0 2024-08-20T01:47:39.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.536+0000 7fa9f8f66640 1 --2- 172.21.15.79:0/1052539038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c1f3ab330 0x562c1f3cfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:47:39.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.536+0000 7fa9f9f68640 1 --2- 172.21.15.79:0/1052539038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c1f3b72c0 0x562c1f42ff50 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec005d80 tx=0x7fa9ec040f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=739fde0a3ad74d62 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:39.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.536+0000 7fa9dcff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:47:39.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.536+0000 7fa9dcff9640 1 -- 172.21.15.79:0/1052539038 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec03f410 con 0x562c1f3b72c0 2024-08-20T01:47:39.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.536+0000 7fa9fddc4740 1 -- 172.21.15.79:0/1052539038 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9ec040b80 con 0x562c1f3b72c0 2024-08-20T01:47:39.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.536+0000 7fa9dcff9640 1 -- 172.21.15.79:0/1052539038 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fa9ec03f5b0 con 0x562c1f3b72c0 2024-08-20T01:47:39.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.537+0000 7fa9dcff9640 1 -- 172.21.15.79:0/1052539038 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fa9ec005040 con 0x562c1f3b72c0 2024-08-20T01:47:39.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.537+0000 7fa9fddc4740 10 client.18258 fetch_fsmap learned FSMap version 47 2024-08-20T01:47:39.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.537+0000 7fa9fddc4740 1 -- 172.21.15.79:0/1052539038 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x562c1f431660 con 0x562c1f3b72c0 2024-08-20T01:47:39.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.537+0000 7fa9dcff9640 1 -- 172.21.15.79:0/1052539038 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa9ec040b80 con 0x562c1f3b72c0 2024-08-20T01:47:39.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.538+0000 7fa9dcff9640 1 -- 172.21.15.79:0/1052539038 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 47) ==== 8394+0+0 (secure 0 0 0) 0x7fa9ec05b020 con 0x562c1f3b72c0 2024-08-20T01:47:39.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.538+0000 7fa9fddc4740 10 client.18258 fetch_fsmap finished waiting for FSMap version 47 2024-08-20T01:47:39.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.538+0000 7fa9fddc4740 10 client.18258 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:47:39.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.538+0000 7fa9fddc4740 20 client.18258 populate_metadata read hostname 'smithi079' 2024-08-20T01:47:39.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.538+0000 7fa9fddc4740 1 --2- 172.21.15.79:0/1052539038 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x562c1f3be650 0x562c1f433e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:39.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.538+0000 7fa9fddc4740 4 client.18258 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:47:39.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.538+0000 7fa9fddc4740 1 -- 172.21.15.79:0/1052539038 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562c1f323830 con 0x562c1f3be650 2024-08-20T01:47:39.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.539+0000 7fa9f9767640 1 --2- 172.21.15.79:0/1052539038 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x562c1f3be650 0x562c1f433e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:39.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.539+0000 7fa9dcff9640 10 client.18258 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:47:39.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.539+0000 7fa9f9767640 1 --2- 172.21.15.79:0/1052539038 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x562c1f3be650 0x562c1f433e00 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8567e946bc6ad643 server_cookie=6da2fb05979218cb in_seq=0 out_seq=0 2024-08-20T01:47:39.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.540+0000 7fa9dcff9640 1 -- 172.21.15.79:0/1052539038 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x562c1f323830 con 0x562c1f3be650 2024-08-20T01:47:39.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.540+0000 7fa9dcff9640 10 client.18258 handle_command_reply: tid=0 2024-08-20T01:47:39.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.540+0000 7fa9fddc4740 1 client.18258 shutdown 2024-08-20T01:47:39.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.540+0000 7fa9fddc4740 1 -- 172.21.15.79:0/1052539038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c1f3b72c0 msgr2=0x562c1f42ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:39.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.540+0000 7fa9fddc4740 1 --2- 172.21.15.79:0/1052539038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c1f3b72c0 0x562c1f42ff50 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec005d80 tx=0x7fa9ec040f60 comp rx=0 tx=0).stop 2024-08-20T01:47:39.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.540+0000 7fa9fddc4740 1 -- 172.21.15.79:0/1052539038 shutdown_connections 2024-08-20T01:47:39.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.540+0000 7fa9fddc4740 1 --2- 172.21.15.79:0/1052539038 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x562c1f3be650 0x562c1f433e00 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:39.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.540+0000 7fa9dcff9640 0 client.18258 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:47:39.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.540+0000 7fa9fddc4740 1 --2- 172.21.15.79:0/1052539038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562c1f3b72c0 0x562c1f42ff50 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:39.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.540+0000 7fa9fddc4740 1 --2- 172.21.15.79:0/1052539038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562c1f3ab330 0x562c1f3cfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:39.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.540+0000 7fa9fddc4740 1 --2- 172.21.15.79:0/1052539038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c1f3aaa10 0x562c1f3cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:39.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.540+0000 7fa9fddc4740 1 -- 172.21.15.79:0/1052539038 >> 172.21.15.79:0/1052539038 conn(0x562c1f3a8840 msgr2=0x562c1f3bc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:39.545 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:47:39.546 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-08-20T01:47:39.546 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-08-20T01:47:39.546 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:47:39.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.540+0000 7fa9fddc4740 1 -- 172.21.15.79:0/1052539038 shutdown_connections 2024-08-20T01:47:39.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.540+0000 7fa9fddc4740 1 -- 172.21.15.79:0/1052539038 wait complete. 2024-08-20T01:47:39.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.540+0000 7fa9fddc4740 20 client.18258 trim_cache size 0 max 16384 2024-08-20T01:47:39.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.541+0000 7fa9fa769640 1 -- 172.21.15.79:0/1356933421 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa9e00b3c80 msgr2=0x7fa9e00b6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:39.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.541+0000 7fa9fa769640 1 --2- 172.21.15.79:0/1356933421 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa9e00b3c80 0x7fa9e00b6140 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00bca0 tx=0x7fa9ec00b4d0 comp rx=0 tx=0).stop 2024-08-20T01:47:39.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.541+0000 7fa9fa769640 1 -- 172.21.15.79:0/1356933421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9f4109e80 msgr2=0x7fa9f41a7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:39.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.541+0000 7fa9fa769640 1 --2- 172.21.15.79:0/1356933421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9f4109e80 0x7fa9f41a7b60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa9f002a960 tx=0x7fa9f0003c20 comp rx=0 tx=0).stop 2024-08-20T01:47:39.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.541+0000 7fa9fa769640 1 -- 172.21.15.79:0/1356933421 shutdown_connections 2024-08-20T01:47:39.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.541+0000 7fa9fa769640 1 --2- 172.21.15.79:0/1356933421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9f411bdd0 0x7fa9f41ad440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:39.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.542+0000 7fa9fa769640 1 --2- 172.21.15.79:0/1356933421 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa9e00b3c80 0x7fa9e00b6140 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:39.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.542+0000 7fa9fa769640 1 --2- 172.21.15.79:0/1356933421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9f410a260 0x7fa9f41a80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:39.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.542+0000 7fa9fa769640 1 --2- 172.21.15.79:0/1356933421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9f4109e80 0x7fa9f41a7b60 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:39.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.542+0000 7fa9fa769640 1 -- 172.21.15.79:0/1356933421 >> 172.21.15.79:0/1356933421 conn(0x7fa9f406c830 msgr2=0x7fa9f411c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:39.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.542+0000 7fa9fa769640 1 -- 172.21.15.79:0/1356933421 shutdown_connections 2024-08-20T01:47:39.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:39.542+0000 7fa9fa769640 1 -- 172.21.15.79:0/1356933421 wait complete. 2024-08-20T01:47:40.545 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T01:47:40.546 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:47:40.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:40 smithi079 ceph-mon[18656]: pgmap v657: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 28 MiB/s wr, 7.12k op/s 2024-08-20T01:47:40.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:40 smithi081 ceph-mon[22209]: pgmap v657: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 28 MiB/s wr, 7.12k op/s 2024-08-20T01:47:40.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:40 smithi175 ceph-mon[22392]: pgmap v657: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 28 MiB/s wr, 7.12k op/s 2024-08-20T01:47:40.963 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:47:41.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:41.566+0000 7f946b59e640 1 -- 172.21.15.79:0/2308941666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9464008c30 msgr2=0x7f9464009010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:41.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:41.566+0000 7f946b59e640 1 --2- 172.21.15.79:0/2308941666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9464008c30 0x7f9464009010 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f945c009900 tx=0x7f945c02a3f0 comp rx=0 tx=0).stop 2024-08-20T01:47:41.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:41.566+0000 7f946b59e640 1 -- 172.21.15.79:0/2308941666 shutdown_connections 2024-08-20T01:47:41.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:41.566+0000 7f946b59e640 1 --2- 172.21.15.79:0/2308941666 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94640a6420 0x7f94640a8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:41.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:41.566+0000 7f946b59e640 1 --2- 172.21.15.79:0/2308941666 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9464009550 0x7f94640a5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:41.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:41.566+0000 7f946b59e640 1 --2- 172.21.15.79:0/2308941666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9464008c30 0x7f9464009010 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:41.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:41.566+0000 7f946b59e640 1 -- 172.21.15.79:0/2308941666 >> 172.21.15.79:0/2308941666 conn(0x7f9464093440 msgr2=0x7f9464095860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:41.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:41.567+0000 7f946b59e640 1 -- 172.21.15.79:0/2308941666 shutdown_connections 2024-08-20T01:47:41.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:41.567+0000 7f946b59e640 1 -- 172.21.15.79:0/2308941666 wait complete. 2024-08-20T01:47:41.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:41.568+0000 7f946b59e640 1 Processor -- start 2024-08-20T01:47:41.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:41.568+0000 7f946b59e640 1 -- start start 2024-08-20T01:47:41.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:41.568+0000 7f946b59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9464008c30 0x7f9464132260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:41.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:41.568+0000 7f946b59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9464009550 0x7f94641327a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:41.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:41.569+0000 7f946b59e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94640a6420 0x7f9464137b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:41.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:41.569+0000 7f946b59e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f94640abcb0 con 0x7f9464009550 2024-08-20T01:47:41.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:41.569+0000 7f946b59e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f94640abb30 con 0x7f9464008c30 2024-08-20T01:47:41.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:41.569+0000 7f946b59e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f94640abe30 con 0x7f94640a6420 2024-08-20T01:47:41.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:41.569+0000 7f9469d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9464009550 0x7f94641327a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:41.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:41.569+0000 7f9469d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9464009550 0x7f94641327a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40136/0 (socket says 172.21.15.79:40136) 2024-08-20T01:47:41.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:41.569+0000 7f9469d9b640 1 -- 172.21.15.79:0/4104729402 learned_addr learned my addr 172.21.15.79:0/4104729402 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:41.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:41.569+0000 7f946a59c640 1 --2- 172.21.15.79:0/4104729402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9464008c30 0x7f9464132260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:41.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:41.569+0000 7f946ad9d640 1 --2- 172.21.15.79:0/4104729402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94640a6420 0x7f9464137b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:41.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:41.569+0000 7f946ad9d640 1 -- 172.21.15.79:0/4104729402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9464008c30 msgr2=0x7f9464132260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:41.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:41.569+0000 7f946ad9d640 1 --2- 172.21.15.79:0/4104729402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9464008c30 0x7f9464132260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:41.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:41.569+0000 7f946ad9d640 1 -- 172.21.15.79:0/4104729402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9464009550 msgr2=0x7f94641327a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:41.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:41.570+0000 7f946ad9d640 1 --2- 172.21.15.79:0/4104729402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9464009550 0x7f94641327a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:41.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:41.570+0000 7f946ad9d640 1 -- 172.21.15.79:0/4104729402 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9464138310 con 0x7f94640a6420 2024-08-20T01:47:41.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:41.570+0000 7f946a59c640 1 --2- 172.21.15.79:0/4104729402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9464008c30 0x7f9464132260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:47:41.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:41.570+0000 7f9469d9b640 1 --2- 172.21.15.79:0/4104729402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9464009550 0x7f94641327a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:47:41.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:41.570+0000 7f946ad9d640 1 --2- 172.21.15.79:0/4104729402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94640a6420 0x7f9464137b40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f946c02e8d0 tx=0x7f946c06c660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:41.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:41.571+0000 7f945b7fe640 1 -- 172.21.15.79:0/4104729402 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f946c07dea0 con 0x7f94640a6420 2024-08-20T01:47:41.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:41.571+0000 7f945b7fe640 1 -- 172.21.15.79:0/4104729402 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f946c082030 con 0x7f94640a6420 2024-08-20T01:47:41.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:41.571+0000 7f946b59e640 1 -- 172.21.15.79:0/4104729402 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9464138600 con 0x7f94640a6420 2024-08-20T01:47:41.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:41.571+0000 7f945b7fe640 1 -- 172.21.15.79:0/4104729402 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f946c079610 con 0x7f94640a6420 2024-08-20T01:47:41.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:41.572+0000 7f946b59e640 1 -- 172.21.15.79:0/4104729402 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f946413ecc0 con 0x7f94640a6420 2024-08-20T01:47:41.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:41.573+0000 7f946b59e640 1 -- 172.21.15.79:0/4104729402 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9464009010 con 0x7f94640a6420 2024-08-20T01:47:41.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:41.574+0000 7f945b7fe640 1 -- 172.21.15.79:0/4104729402 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f946c07a040 con 0x7f94640a6420 2024-08-20T01:47:41.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:41.575+0000 7f945b7fe640 1 --2- 172.21.15.79:0/4104729402 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f94540b3da0 0x7f94540b6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:41.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:41.575+0000 7f946a59c640 1 --2- 172.21.15.79:0/4104729402 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f94540b3da0 0x7f94540b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:41.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:41.575+0000 7f945b7fe640 1 -- 172.21.15.79:0/4104729402 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f946c1504e0 con 0x7f94640a6420 2024-08-20T01:47:41.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:41.576+0000 7f946a59c640 1 --2- 172.21.15.79:0/4104729402 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f94540b3da0 0x7f94540b6260 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f945c0057c0 tx=0x7f945c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:41.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:41.581+0000 7f945b7fe640 1 -- 172.21.15.79:0/4104729402 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f946c117490 con 0x7f94640a6420 2024-08-20T01:47:42.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:42.010+0000 7f946b59e640 1 -- 172.21.15.79:0/4104729402 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f946413ee90 con 0x7f94640a6420 2024-08-20T01:47:42.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:42.011+0000 7f945b7fe640 1 -- 172.21.15.79:0/4104729402 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+11987 (secure 0 0 0) 0x7f946c11b9e0 con 0x7f94640a6420 2024-08-20T01:47:42.013 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:47:42.013 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":47,"btime":"2024-08-20T01:47:24:362902+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14670,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/735082912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":735082912},{"type":"v1","addr":"172.21.15.79:6835","nonce":735082912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2150339873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2150339873},{"type":"v1","addr":"172.21.15.79:6837","nonce":2150339873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":47,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:34:55.133562+0000","modified":"2024-08-20T01:47:23.567806+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24539,"mds_1":24538,"mds_2":24523,"mds_3":24514,"mds_4":24512},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14724":{"gid":14724,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/1071242274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1071242274},{"type":"v1","addr":"172.21.15.79:6839","nonce":1071242274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14730":{"gid":14730,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6841/2448977611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":2448977611},{"type":"v1","addr":"172.21.15.79:6841","nonce":2448977611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/1257507005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1257507005},{"type":"v1","addr":"172.21.15.81:6833","nonce":1257507005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1499936216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1499936216},{"type":"v1","addr":"172.21.15.81:6835","nonce":1499936216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/1107229215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1107229215},{"type":"v1","addr":"172.21.15.175:6833","nonce":1107229215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6837/2073598870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2073598870},{"type":"v1","addr":"172.21.15.81:6837","nonce":2073598870}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/2552601173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2552601173},{"type":"v1","addr":"172.21.15.175:6835","nonce":2552601173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6837/1767284089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1767284089},{"type":"v1","addr":"172.21.15.175:6837","nonce":1767284089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/1331748742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1331748742},{"type":"v1","addr":"172.21.15.175:6839","nonce":1331748742}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/4098410583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":4098410583},{"type":"v1","addr":"172.21.15.81:6839","nonce":4098410583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24539,"qdb_cluster":[24539,24523,24514,24538,24512]},"id":1}]} 2024-08-20T01:47:42.013 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 47 2024-08-20T01:47:42.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:42.016+0000 7f946b59e640 1 -- 172.21.15.79:0/4104729402 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f94540b3da0 msgr2=0x7f94540b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:42.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:42.016+0000 7f946b59e640 1 --2- 172.21.15.79:0/4104729402 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f94540b3da0 0x7f94540b6260 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f945c0057c0 tx=0x7f945c0058d0 comp rx=0 tx=0).stop 2024-08-20T01:47:42.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:42.016+0000 7f946b59e640 1 -- 172.21.15.79:0/4104729402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94640a6420 msgr2=0x7f9464137b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:42.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:42.016+0000 7f946b59e640 1 --2- 172.21.15.79:0/4104729402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94640a6420 0x7f9464137b40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f946c02e8d0 tx=0x7f946c06c660 comp rx=0 tx=0).stop 2024-08-20T01:47:42.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:42.016+0000 7f946b59e640 1 -- 172.21.15.79:0/4104729402 shutdown_connections 2024-08-20T01:47:42.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:42.016+0000 7f946b59e640 1 --2- 172.21.15.79:0/4104729402 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f94540b3da0 0x7f94540b6260 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:42.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:42.016+0000 7f946b59e640 1 --2- 172.21.15.79:0/4104729402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94640a6420 0x7f9464137b40 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:42.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:42.016+0000 7f946b59e640 1 --2- 172.21.15.79:0/4104729402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9464009550 0x7f94641327a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:42.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:42.016+0000 7f946b59e640 1 --2- 172.21.15.79:0/4104729402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9464008c30 0x7f9464132260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:42.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:42.016+0000 7f946b59e640 1 -- 172.21.15.79:0/4104729402 >> 172.21.15.79:0/4104729402 conn(0x7f9464093440 msgr2=0x7f9464095830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:42.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:42.016+0000 7f946b59e640 1 -- 172.21.15.79:0/4104729402 shutdown_connections 2024-08-20T01:47:42.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:42.016+0000 7f946b59e640 1 -- 172.21.15.79:0/4104729402 wait complete. 2024-08-20T01:47:42.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:42 smithi079 ceph-mon[18656]: pgmap v658: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 27 MiB/s wr, 6.88k op/s 2024-08-20T01:47:42.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:42 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/4104729402' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:47:42.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:42 smithi081 ceph-mon[22209]: pgmap v658: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 27 MiB/s wr, 6.88k op/s 2024-08-20T01:47:42.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:42 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/4104729402' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:47:42.886 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-20T01:47:42.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:42 smithi175 ceph-mon[22392]: pgmap v658: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 27 MiB/s wr, 6.88k op/s 2024-08-20T01:47:42.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:42 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/4104729402' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:47:43.318 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:47:44.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.178+0000 7ff40e5bf640 1 -- 172.21.15.79:0/2793903243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff40811bdd0 msgr2=0x7ff40811e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:44.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.178+0000 7ff40e5bf640 1 --2- 172.21.15.79:0/2793903243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff40811bdd0 0x7ff40811e1c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc009900 tx=0x7ff3fc02a4b0 comp rx=0 tx=0).stop 2024-08-20T01:47:44.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.179+0000 7ff40e5bf640 1 -- 172.21.15.79:0/2793903243 shutdown_connections 2024-08-20T01:47:44.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.179+0000 7ff40e5bf640 1 --2- 172.21.15.79:0/2793903243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff40811bdd0 0x7ff40811e1c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:44.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.179+0000 7ff40e5bf640 1 --2- 172.21.15.79:0/2793903243 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff40810a260 0x7ff40810a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:44.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.179+0000 7ff40e5bf640 1 --2- 172.21.15.79:0/2793903243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff408109e80 0x7ff408110ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:44.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.179+0000 7ff40e5bf640 1 -- 172.21.15.79:0/2793903243 >> 172.21.15.79:0/2793903243 conn(0x7ff40806dcc0 msgr2=0x7ff40806e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:44.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.180+0000 7ff40e5bf640 1 -- 172.21.15.79:0/2793903243 shutdown_connections 2024-08-20T01:47:44.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.180+0000 7ff40e5bf640 1 -- 172.21.15.79:0/2793903243 wait complete. 2024-08-20T01:47:44.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.181+0000 7ff40e5bf640 1 Processor -- start 2024-08-20T01:47:44.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.181+0000 7ff40e5bf640 1 -- start start 2024-08-20T01:47:44.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.182+0000 7ff40e5bf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff408109e80 0x7ff4081a7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:44.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.182+0000 7ff40e5bf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff40810a260 0x7ff4081a8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:44.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.182+0000 7ff407fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff408109e80 0x7ff4081a7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:44.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.182+0000 7ff407fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff408109e80 0x7ff4081a7e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40154/0 (socket says 172.21.15.79:40154) 2024-08-20T01:47:44.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.182+0000 7ff40e5bf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff40811bdd0 0x7ff4081ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:44.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.182+0000 7ff407fff640 1 -- 172.21.15.79:0/2284752178 learned_addr learned my addr 172.21.15.79:0/2284752178 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:44.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.182+0000 7ff40e5bf640 1 -- 172.21.15.79:0/2284752178 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff408121840 con 0x7ff408109e80 2024-08-20T01:47:44.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.182+0000 7ff40e5bf640 1 -- 172.21.15.79:0/2284752178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff4081216c0 con 0x7ff40811bdd0 2024-08-20T01:47:44.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.182+0000 7ff40e5bf640 1 -- 172.21.15.79:0/2284752178 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff4081219c0 con 0x7ff40810a260 2024-08-20T01:47:44.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.183+0000 7ff4077fe640 1 --2- 172.21.15.79:0/2284752178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff40810a260 0x7ff4081a8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:44.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.183+0000 7ff407fff640 1 -- 172.21.15.79:0/2284752178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff40810a260 msgr2=0x7ff4081a8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:44.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.183+0000 7ff407fff640 1 --2- 172.21.15.79:0/2284752178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff40810a260 0x7ff4081a8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:44.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.183+0000 7ff407fff640 1 -- 172.21.15.79:0/2284752178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff40811bdd0 msgr2=0x7ff4081ad6f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-20T01:47:44.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.183+0000 7ff407fff640 1 --2- 172.21.15.79:0/2284752178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff40811bdd0 0x7ff4081ad6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:44.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.183+0000 7ff407fff640 1 -- 172.21.15.79:0/2284752178 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4081adec0 con 0x7ff408109e80 2024-08-20T01:47:44.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.183+0000 7ff407fff640 1 --2- 172.21.15.79:0/2284752178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff408109e80 0x7ff4081a7e10 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7ff40000ba50 tx=0x7ff40000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:44.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.184+0000 7ff4057fa640 1 -- 172.21.15.79:0/2284752178 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff400019070 con 0x7ff408109e80 2024-08-20T01:47:44.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.184+0000 7ff40e5bf640 1 -- 172.21.15.79:0/2284752178 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4081ae1b0 con 0x7ff408109e80 2024-08-20T01:47:44.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.184+0000 7ff40e5bf640 1 -- 172.21.15.79:0/2284752178 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4081b4a40 con 0x7ff408109e80 2024-08-20T01:47:44.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.184+0000 7ff4057fa640 1 -- 172.21.15.79:0/2284752178 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff40000cc10 con 0x7ff408109e80 2024-08-20T01:47:44.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.184+0000 7ff4057fa640 1 -- 172.21.15.79:0/2284752178 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4000075d0 con 0x7ff408109e80 2024-08-20T01:47:44.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.187+0000 7ff4109b8740 1 Processor -- start 2024-08-20T01:47:44.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.188+0000 7ff4109b8740 1 -- start start 2024-08-20T01:47:44.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.188+0000 7ff4057fa640 1 -- 172.21.15.79:0/2284752178 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff40001c070 con 0x7ff408109e80 2024-08-20T01:47:44.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.188+0000 7ff4109b8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e623a17880 0x55e623a17c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:44.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.188+0000 7ff4109b8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e623a181a0 0x55e623a23bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:44.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.189+0000 7ff4109b8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e623a24130 0x55e623a26520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:44.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.189+0000 7ff4109b8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e62398e930 con 0x55e623a24130 2024-08-20T01:47:44.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.189+0000 7ff4109b8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e62397de30 con 0x55e623a181a0 2024-08-20T01:47:44.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.189+0000 7ff4109b8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e623981e70 con 0x55e623a17880 2024-08-20T01:47:44.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.189+0000 7ff407fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e623a181a0 0x55e623a23bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:44.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.189+0000 7ff40cb5c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e623a17880 0x55e623a17c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:44.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.189+0000 7ff40cb5c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e623a17880 0x55e623a17c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:40666/0 (socket says 172.21.15.79:40666) 2024-08-20T01:47:44.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.189+0000 7ff40cb5c640 1 -- 172.21.15.79:0/226896172 learned_addr learned my addr 172.21.15.79:0/226896172 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:44.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.189+0000 7ff4077fe640 1 --2- 172.21.15.79:0/226896172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e623a24130 0x55e623a26520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:44.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.190+0000 7ff4057fa640 1 --2- 172.21.15.79:0/2284752178 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff3f00b3cd0 0x7ff3f00b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:44.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.190+0000 7ff4057fa640 1 -- 172.21.15.79:0/2284752178 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff4000e3240 con 0x7ff408109e80 2024-08-20T01:47:44.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.191+0000 7ff40cb5c640 1 -- 172.21.15.79:0/226896172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e623a181a0 msgr2=0x55e623a23bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:44.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.191+0000 7ff40cb5c640 1 --2- 172.21.15.79:0/226896172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e623a181a0 0x55e623a23bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:44.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.191+0000 7ff40cb5c640 1 -- 172.21.15.79:0/226896172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e623a24130 msgr2=0x55e623a26520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:44.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.191+0000 7ff40cb5c640 1 --2- 172.21.15.79:0/226896172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e623a24130 0x55e623a26520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:44.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.191+0000 7ff40cb5c640 1 -- 172.21.15.79:0/226896172 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6236dd650 con 0x55e623a17880 2024-08-20T01:47:44.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.192+0000 7ff40cb5c640 1 --2- 172.21.15.79:0/2284752178 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff3f00b3cd0 0x7ff3f00b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:44.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.192+0000 7ff40cb5c640 1 --2- 172.21.15.79:0/226896172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e623a17880 0x55e623a17c60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc02a9d0 tx=0x7ff3fc004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63f0ed202cfd9a02 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:44.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.192+0000 7ff3ee7fc640 1 -- 172.21.15.79:0/226896172 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc035040 con 0x55e623a17880 2024-08-20T01:47:44.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.193+0000 7ff3ee7fc640 1 -- 172.21.15.79:0/226896172 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff3fc005350 con 0x55e623a17880 2024-08-20T01:47:44.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.193+0000 7ff3ee7fc640 1 -- 172.21.15.79:0/226896172 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc003a70 con 0x55e623a17880 2024-08-20T01:47:44.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.194+0000 7ff4109b8740 1 -- 172.21.15.79:0/226896172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e623a17880 msgr2=0x55e623a17c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:44.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.194+0000 7ff4109b8740 1 --2- 172.21.15.79:0/226896172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e623a17880 0x55e623a17c60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc02a9d0 tx=0x7ff3fc004270 comp rx=0 tx=0).stop 2024-08-20T01:47:44.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.194+0000 7ff40cb5c640 1 --2- 172.21.15.79:0/2284752178 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff3f00b3cd0 0x7ff3f00b6190 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc048000 tx=0x7ff3fc003d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:44.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.194+0000 7ff4109b8740 1 -- 172.21.15.79:0/226896172 shutdown_connections 2024-08-20T01:47:44.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.194+0000 7ff4109b8740 1 --2- 172.21.15.79:0/226896172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e623a24130 0x55e623a26520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:44.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.194+0000 7ff4109b8740 1 --2- 172.21.15.79:0/226896172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e623a181a0 0x55e623a23bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:44.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.194+0000 7ff4109b8740 1 --2- 172.21.15.79:0/226896172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e623a17880 0x55e623a17c60 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:44.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.194+0000 7ff4109b8740 1 -- 172.21.15.79:0/226896172 >> 172.21.15.79:0/226896172 conn(0x55e623a156b0 msgr2=0x55e623a16850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:44.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.194+0000 7ff4109b8740 1 -- 172.21.15.79:0/226896172 shutdown_connections 2024-08-20T01:47:44.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.194+0000 7ff4109b8740 1 -- 172.21.15.79:0/226896172 wait complete. 2024-08-20T01:47:44.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.194+0000 7ff4109b8740 1 -- start start 2024-08-20T01:47:44.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.195+0000 7ff4109b8740 1 Processor -- start 2024-08-20T01:47:44.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.195+0000 7ff4109b8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e623a17880 0x55e623a210a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:44.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.195+0000 7ff4109b8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e623a181a0 0x55e623a215e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:44.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.195+0000 7ff4109b8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e623a24130 0x55e623a21b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:44.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.195+0000 7ff4109b8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e6237e0700 con 0x55e623a181a0 2024-08-20T01:47:44.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.195+0000 7ff4109b8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e623904810 con 0x55e623a17880 2024-08-20T01:47:44.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.195+0000 7ff4109b8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e623a26de0 con 0x55e623a24130 2024-08-20T01:47:44.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.195+0000 7ff4109b8740 10 client.0 _ll_register_callbacks cb 0x55e623977700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:47:44.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.196+0000 7ff40cb5c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e623a24130 0x55e623a21b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:44.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.196+0000 7ff40cb5c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e623a24130 0x55e623a21b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:40674/0 (socket says 172.21.15.79:40674) 2024-08-20T01:47:44.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.196+0000 7ff40cb5c640 1 -- 172.21.15.79:0/844550255 learned_addr learned my addr 172.21.15.79:0/844550255 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:44.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.196+0000 7ff4077fe640 1 --2- 172.21.15.79:0/844550255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e623a181a0 0x55e623a215e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:44.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.196+0000 7ff407fff640 1 --2- 172.21.15.79:0/844550255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e623a17880 0x55e623a210a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:44.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.196+0000 7ff40cb5c640 1 -- 172.21.15.79:0/844550255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e623a17880 msgr2=0x55e623a210a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:44.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.196+0000 7ff40cb5c640 1 --2- 172.21.15.79:0/844550255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e623a17880 0x55e623a210a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:44.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.196+0000 7ff40cb5c640 1 -- 172.21.15.79:0/844550255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e623a181a0 msgr2=0x55e623a215e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:44.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.196+0000 7ff40cb5c640 1 --2- 172.21.15.79:0/844550255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e623a181a0 0x55e623a215e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:44.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.196+0000 7ff40cb5c640 1 -- 172.21.15.79:0/844550255 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e623a301f0 con 0x55e623a24130 2024-08-20T01:47:44.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.197+0000 7ff40cb5c640 1 --2- 172.21.15.79:0/844550255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e623a24130 0x55e623a21b20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc009900 tx=0x7ff3fc032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc16b2dd3c1a7ec6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:44.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.197+0000 7ff3e77fe640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:47:44.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.197+0000 7ff3e77fe640 1 -- 172.21.15.79:0/844550255 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc003b80 con 0x55e623a24130 2024-08-20T01:47:44.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.197+0000 7ff3e77fe640 1 -- 172.21.15.79:0/844550255 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff3fc048980 con 0x55e623a24130 2024-08-20T01:47:44.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.198+0000 7ff4109b8740 1 -- 172.21.15.79:0/844550255 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e62392d150 con 0x55e623a24130 2024-08-20T01:47:44.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.198+0000 7ff3e77fe640 1 -- 172.21.15.79:0/844550255 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7ff3fc048b80 con 0x55e623a24130 2024-08-20T01:47:44.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.198+0000 7ff4109b8740 10 client.27286 fetch_fsmap learned FSMap version 47 2024-08-20T01:47:44.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.198+0000 7ff4109b8740 1 -- 172.21.15.79:0/844550255 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55e623a32ba0 con 0x55e623a24130 2024-08-20T01:47:44.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.199+0000 7ff3e77fe640 1 -- 172.21.15.79:0/844550255 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff3fc055070 con 0x55e623a24130 2024-08-20T01:47:44.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.199+0000 7ff3e77fe640 1 -- 172.21.15.79:0/844550255 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 47) ==== 8394+0+0 (secure 0 0 0) 0x7ff3fc005000 con 0x55e623a24130 2024-08-20T01:47:44.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.199+0000 7ff4109b8740 10 client.27286 fetch_fsmap finished waiting for FSMap version 47 2024-08-20T01:47:44.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.199+0000 7ff4109b8740 10 client.27286 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:47:44.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.199+0000 7ff4109b8740 20 client.27286 populate_metadata read hostname 'smithi079' 2024-08-20T01:47:44.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.199+0000 7ff4109b8740 1 --2- 172.21.15.79:0/844550255 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55e623a33ef0 0x55e623a362e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:44.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.199+0000 7ff4109b8740 4 client.27286 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:47:44.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.199+0000 7ff4109b8740 1 -- 172.21.15.79:0/844550255 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e62392d150 con 0x55e623a33ef0 2024-08-20T01:47:44.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.199+0000 7ff407fff640 1 --2- 172.21.15.79:0/844550255 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55e623a33ef0 0x55e623a362e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:44.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.200+0000 7ff407fff640 1 --2- 172.21.15.79:0/844550255 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55e623a33ef0 0x55e623a362e0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4353dcebe04baa3b server_cookie=340d67bae7f565bf in_seq=0 out_seq=0 2024-08-20T01:47:44.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.200+0000 7ff3e77fe640 10 client.27286 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:47:44.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.201+0000 7ff3e77fe640 1 -- 172.21.15.79:0/844550255 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e62392d150 con 0x55e623a33ef0 2024-08-20T01:47:44.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.201+0000 7ff3e77fe640 10 client.27286 handle_command_reply: tid=0 2024-08-20T01:47:44.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.201+0000 7ff4109b8740 1 client.27286 shutdown 2024-08-20T01:47:44.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.201+0000 7ff4109b8740 1 -- 172.21.15.79:0/844550255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e623a24130 msgr2=0x55e623a21b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:44.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.201+0000 7ff4109b8740 1 --2- 172.21.15.79:0/844550255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e623a24130 0x55e623a21b20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc009900 tx=0x7ff3fc032000 comp rx=0 tx=0).stop 2024-08-20T01:47:44.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.202+0000 7ff4109b8740 1 -- 172.21.15.79:0/844550255 shutdown_connections 2024-08-20T01:47:44.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.202+0000 7ff4109b8740 1 --2- 172.21.15.79:0/844550255 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55e623a33ef0 0x55e623a362e0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:44.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.202+0000 7ff4109b8740 1 --2- 172.21.15.79:0/844550255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e623a24130 0x55e623a21b20 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:44.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.202+0000 7ff4109b8740 1 --2- 172.21.15.79:0/844550255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e623a181a0 0x55e623a215e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:44.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.202+0000 7ff4109b8740 1 --2- 172.21.15.79:0/844550255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e623a17880 0x55e623a210a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:44.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.202+0000 7ff4109b8740 1 -- 172.21.15.79:0/844550255 >> 172.21.15.79:0/844550255 conn(0x55e623a156b0 msgr2=0x55e623a1b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:44.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.202+0000 7ff3e77fe640 0 client.27286 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:47:44.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.202+0000 7ff4109b8740 1 -- 172.21.15.79:0/844550255 shutdown_connections 2024-08-20T01:47:44.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.202+0000 7ff4109b8740 1 -- 172.21.15.79:0/844550255 wait complete. 2024-08-20T01:47:44.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.203+0000 7ff4109b8740 20 client.27286 trim_cache size 0 max 16384 2024-08-20T01:47:44.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.226+0000 7ff4109b8740 1 Processor -- start 2024-08-20T01:47:44.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.226+0000 7ff4109b8740 1 -- start start 2024-08-20T01:47:44.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.227+0000 7ff4109b8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e623a17880 0x55e623a3b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:44.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.227+0000 7ff4109b8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e623a181a0 0x55e623a3bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:44.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.227+0000 7ff4109b8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e623a24130 0x55e623a1e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:44.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.227+0000 7ff4109b8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f400e510 con 0x55e623a181a0 2024-08-20T01:47:44.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.227+0000 7ff4109b8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f40101d0 con 0x55e623a24130 2024-08-20T01:47:44.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.227+0000 7ff4109b8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f400eca0 con 0x55e623a17880 2024-08-20T01:47:44.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.227+0000 7ff407fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e623a17880 0x55e623a3b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:44.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.227+0000 7ff407fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e623a17880 0x55e623a3b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:40682/0 (socket says 172.21.15.79:40682) 2024-08-20T01:47:44.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.227+0000 7ff407fff640 1 -- 172.21.15.79:0/2111232514 learned_addr learned my addr 172.21.15.79:0/2111232514 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:44.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.227+0000 7ff40cb5c640 1 --2- 172.21.15.79:0/2111232514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e623a24130 0x55e623a1e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:44.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.227+0000 7ff4077fe640 1 --2- 172.21.15.79:0/2111232514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e623a181a0 0x55e623a3bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:44.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.227+0000 7ff407fff640 1 -- 172.21.15.79:0/2111232514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e623a24130 msgr2=0x55e623a1e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:44.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.227+0000 7ff407fff640 1 --2- 172.21.15.79:0/2111232514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e623a24130 0x55e623a1e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:44.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.227+0000 7ff407fff640 1 -- 172.21.15.79:0/2111232514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e623a181a0 msgr2=0x55e623a3bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:44.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.227+0000 7ff407fff640 1 --2- 172.21.15.79:0/2111232514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e623a181a0 0x55e623a3bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:44.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.227+0000 7ff407fff640 1 -- 172.21.15.79:0/2111232514 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e623a17fd0 con 0x55e623a17880 2024-08-20T01:47:44.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.228+0000 7ff407fff640 1 --2- 172.21.15.79:0/2111232514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e623a17880 0x55e623a3b9d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff40000ba20 tx=0x7ff4000e3490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9f5cbdb0861d0d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:44.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.228+0000 7ff3edffb640 1 -- 172.21.15.79:0/2111232514 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4000aa140 con 0x55e623a17880 2024-08-20T01:47:44.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.228+0000 7ff3edffb640 1 -- 172.21.15.79:0/2111232514 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff4000ae740 con 0x55e623a17880 2024-08-20T01:47:44.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.228+0000 7ff3edffb640 1 -- 172.21.15.79:0/2111232514 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4000b2e50 con 0x55e623a17880 2024-08-20T01:47:44.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.229+0000 7ff4109b8740 1 -- 172.21.15.79:0/2111232514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e623a17880 msgr2=0x55e623a3b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:44.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.229+0000 7ff4109b8740 1 --2- 172.21.15.79:0/2111232514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e623a17880 0x55e623a3b9d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff40000ba20 tx=0x7ff4000e3490 comp rx=0 tx=0).stop 2024-08-20T01:47:44.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.229+0000 7ff4109b8740 1 -- 172.21.15.79:0/2111232514 shutdown_connections 2024-08-20T01:47:44.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.230+0000 7ff4109b8740 1 --2- 172.21.15.79:0/2111232514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e623a24130 0x55e623a1e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:44.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.230+0000 7ff4109b8740 1 --2- 172.21.15.79:0/2111232514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e623a181a0 0x55e623a3bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:44.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.230+0000 7ff4109b8740 1 --2- 172.21.15.79:0/2111232514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e623a17880 0x55e623a3b9d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:44.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.230+0000 7ff4109b8740 1 -- 172.21.15.79:0/2111232514 >> 172.21.15.79:0/2111232514 conn(0x55e623a156b0 msgr2=0x55e623a215b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:44.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.230+0000 7ff4109b8740 1 -- 172.21.15.79:0/2111232514 shutdown_connections 2024-08-20T01:47:44.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.230+0000 7ff4109b8740 1 -- 172.21.15.79:0/2111232514 wait complete. 2024-08-20T01:47:44.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.230+0000 7ff4109b8740 1 -- start start 2024-08-20T01:47:44.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.231+0000 7ff4109b8740 1 Processor -- start 2024-08-20T01:47:44.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.232+0000 7ff4109b8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e623a17880 0x55e623a28fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:44.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.232+0000 7ff4109b8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e623a181a0 0x55e623a29510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:44.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.232+0000 7ff407fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e623a17880 0x55e623a28fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:44.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.232+0000 7ff407fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e623a17880 0x55e623a28fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:40688/0 (socket says 172.21.15.79:40688) 2024-08-20T01:47:44.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.232+0000 7ff407fff640 1 -- 172.21.15.79:0/3131867303 learned_addr learned my addr 172.21.15.79:0/3131867303 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:44.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.232+0000 7ff4109b8740 1 --2- 172.21.15.79:0/3131867303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e623a24130 0x55e623a29a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:44.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.232+0000 7ff4077fe640 1 --2- 172.21.15.79:0/3131867303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e623a181a0 0x55e623a29510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:44.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.232+0000 7ff4109b8740 1 -- 172.21.15.79:0/3131867303 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f400fb00 con 0x55e623a181a0 2024-08-20T01:47:44.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.232+0000 7ff4109b8740 1 -- 172.21.15.79:0/3131867303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f400f370 con 0x55e623a24130 2024-08-20T01:47:44.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.232+0000 7ff4109b8740 1 -- 172.21.15.79:0/3131867303 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f400c4f0 con 0x55e623a17880 2024-08-20T01:47:44.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.232+0000 7ff40cb5c640 1 --2- 172.21.15.79:0/3131867303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e623a24130 0x55e623a29a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:44.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.233+0000 7ff4109b8740 10 client.0 _ll_register_callbacks cb 0x7ff3fc0041a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:47:44.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.233+0000 7ff407fff640 1 -- 172.21.15.79:0/3131867303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e623a24130 msgr2=0x55e623a29a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:44.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.233+0000 7ff407fff640 1 --2- 172.21.15.79:0/3131867303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e623a24130 0x55e623a29a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:44.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.233+0000 7ff407fff640 1 -- 172.21.15.79:0/3131867303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e623a181a0 msgr2=0x55e623a29510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:44.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.233+0000 7ff407fff640 1 --2- 172.21.15.79:0/3131867303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e623a181a0 0x55e623a29510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:44.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.233+0000 7ff407fff640 1 -- 172.21.15.79:0/3131867303 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e623a9ca50 con 0x55e623a17880 2024-08-20T01:47:44.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.233+0000 7ff4077fe640 1 --2- 172.21.15.79:0/3131867303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e623a181a0 0x55e623a29510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:47:44.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.233+0000 7ff4109b8740 1 -- 172.21.15.79:0/3131867303 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4000ae740 con 0x55e623a17880 2024-08-20T01:47:44.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.233+0000 7ff407fff640 1 --2- 172.21.15.79:0/3131867303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e623a17880 0x55e623a28fd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff4000a9df0 tx=0x7ff4000a6600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63a29bbd02b46a14 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:44.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.233+0000 7ff3e77fe640 10 client.27292 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:47:44.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.233+0000 7ff3e77fe640 1 -- 172.21.15.79:0/3131867303 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4000c4060 con 0x55e623a17880 2024-08-20T01:47:44.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.233+0000 7ff3e77fe640 1 -- 172.21.15.79:0/3131867303 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff4000a6730 con 0x55e623a17880 2024-08-20T01:47:44.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.233+0000 7ff3e77fe640 1 -- 172.21.15.79:0/3131867303 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7ff4000b31f0 con 0x55e623a17880 2024-08-20T01:47:44.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.233+0000 7ff4109b8740 10 client.27292 fetch_fsmap learned FSMap version 47 2024-08-20T01:47:44.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.233+0000 7ff4109b8740 1 -- 172.21.15.79:0/3131867303 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({fsmap=47}) -- 0x55e623a9dbc0 con 0x55e623a17880 2024-08-20T01:47:44.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.234+0000 7ff3e77fe640 1 -- 172.21.15.79:0/3131867303 <== mon.1 v2:172.21.15.175:3300/0 4 ==== fsmap(e 47) ==== 8394+0+0 (secure 0 0 0) 0x7ff4000a93a0 con 0x55e623a17880 2024-08-20T01:47:44.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.234+0000 7ff4109b8740 10 client.27292 fetch_fsmap finished waiting for FSMap version 47 2024-08-20T01:47:44.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.234+0000 7ff4109b8740 10 client.27292 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:47:44.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.234+0000 7ff4109b8740 20 client.27292 populate_metadata read hostname 'smithi079' 2024-08-20T01:47:44.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.234+0000 7ff4109b8740 1 --2- 172.21.15.79:0/3131867303 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55e623a9e1f0 0x55e623aa0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:44.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.234+0000 7ff4109b8740 4 client.27292 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:47:44.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.234+0000 7ff4109b8740 1 -- 172.21.15.79:0/3131867303 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e623990880 con 0x55e623a9e1f0 2024-08-20T01:47:44.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.237+0000 7ff4077fe640 1 --2- 172.21.15.79:0/3131867303 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55e623a9e1f0 0x55e623aa0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:44.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.238+0000 7ff3e77fe640 10 client.27292 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:47:44.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.238+0000 7ff4077fe640 1 --2- 172.21.15.79:0/3131867303 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55e623a9e1f0 0x55e623aa0610 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a6260704fc984e10 server_cookie=2fc7fd9ca697190c in_seq=0 out_seq=0 2024-08-20T01:47:44.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.238+0000 7ff3e77fe640 1 -- 172.21.15.79:0/3131867303 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e623990880 con 0x55e623a9e1f0 2024-08-20T01:47:44.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.238+0000 7ff3e77fe640 10 client.27292 handle_command_reply: tid=0 2024-08-20T01:47:44.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.238+0000 7ff4109b8740 1 client.27292 shutdown 2024-08-20T01:47:44.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.239+0000 7ff4109b8740 1 -- 172.21.15.79:0/3131867303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e623a17880 msgr2=0x55e623a28fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:44.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.239+0000 7ff4109b8740 1 --2- 172.21.15.79:0/3131867303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e623a17880 0x55e623a28fd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff4000a9df0 tx=0x7ff4000a6600 comp rx=0 tx=0).stop 2024-08-20T01:47:44.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.239+0000 7ff4109b8740 1 -- 172.21.15.79:0/3131867303 shutdown_connections 2024-08-20T01:47:44.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.239+0000 7ff4109b8740 1 --2- 172.21.15.79:0/3131867303 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55e623a9e1f0 0x55e623aa0610 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:44.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.239+0000 7ff4109b8740 1 --2- 172.21.15.79:0/3131867303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e623a24130 0x55e623a29a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:44.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.239+0000 7ff4109b8740 1 --2- 172.21.15.79:0/3131867303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e623a181a0 0x55e623a29510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:44.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.239+0000 7ff4109b8740 1 --2- 172.21.15.79:0/3131867303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e623a17880 0x55e623a28fd0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:44.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.239+0000 7ff4109b8740 1 -- 172.21.15.79:0/3131867303 >> 172.21.15.79:0/3131867303 conn(0x55e623a156b0 msgr2=0x55e623a13f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:44.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.239+0000 7ff3e77fe640 0 client.27292 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:47:44.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.240+0000 7ff4109b8740 1 -- 172.21.15.79:0/3131867303 shutdown_connections 2024-08-20T01:47:44.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.240+0000 7ff4109b8740 1 -- 172.21.15.79:0/3131867303 wait complete. 2024-08-20T01:47:44.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.240+0000 7ff4109b8740 20 client.27292 trim_cache size 0 max 16384 2024-08-20T01:47:44.244 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:47:44.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.241+0000 7ff40e5bf640 1 -- 172.21.15.79:0/2284752178 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff3f00b3cd0 msgr2=0x7ff3f00b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:44.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.241+0000 7ff40e5bf640 1 --2- 172.21.15.79:0/2284752178 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff3f00b3cd0 0x7ff3f00b6190 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc048000 tx=0x7ff3fc003d50 comp rx=0 tx=0).stop 2024-08-20T01:47:44.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.241+0000 7ff40e5bf640 1 -- 172.21.15.79:0/2284752178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff408109e80 msgr2=0x7ff4081a7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:44.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.241+0000 7ff40e5bf640 1 --2- 172.21.15.79:0/2284752178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff408109e80 0x7ff4081a7e10 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7ff40000ba50 tx=0x7ff40000bf10 comp rx=0 tx=0).stop 2024-08-20T01:47:44.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.241+0000 7ff40e5bf640 1 -- 172.21.15.79:0/2284752178 shutdown_connections 2024-08-20T01:47:44.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.241+0000 7ff40e5bf640 1 --2- 172.21.15.79:0/2284752178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff40811bdd0 0x7ff4081ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:44.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.241+0000 7ff40e5bf640 1 --2- 172.21.15.79:0/2284752178 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff3f00b3cd0 0x7ff3f00b6190 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:44.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.241+0000 7ff40e5bf640 1 --2- 172.21.15.79:0/2284752178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff40810a260 0x7ff4081a8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:44.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.241+0000 7ff40e5bf640 1 --2- 172.21.15.79:0/2284752178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff408109e80 0x7ff4081a7e10 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:44.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.241+0000 7ff40e5bf640 1 -- 172.21.15.79:0/2284752178 >> 172.21.15.79:0/2284752178 conn(0x7ff40806dcc0 msgr2=0x7ff40811c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:44.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.241+0000 7ff40e5bf640 1 -- 172.21.15.79:0/2284752178 shutdown_connections 2024-08-20T01:47:44.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:44.241+0000 7ff40e5bf640 1 -- 172.21.15.79:0/2284752178 wait complete. 2024-08-20T01:47:44.691 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:44 smithi175 ceph-mon[22392]: pgmap v659: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 27 MiB/s wr, 6.86k op/s 2024-08-20T01:47:44.751 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:44 smithi079 ceph-mon[18656]: pgmap v659: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 27 MiB/s wr, 6.86k op/s 2024-08-20T01:47:44.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:44 smithi081 ceph-mon[22209]: pgmap v659: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 27 MiB/s wr, 6.86k op/s 2024-08-20T01:47:45.048 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-20T01:47:45.463 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:47:46.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:46 smithi081 ceph-mon[22209]: pgmap v660: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 28 MiB/s wr, 7.17k op/s 2024-08-20T01:47:46.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:46 smithi175 ceph-mon[22392]: pgmap v660: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 28 MiB/s wr, 7.17k op/s 2024-08-20T01:47:46.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:46 smithi079 ceph-mon[18656]: pgmap v660: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 28 MiB/s wr, 7.17k op/s 2024-08-20T01:47:47.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.055+0000 7f900c383640 1 -- 172.21.15.79:0/1938406250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90041042c0 msgr2=0x7f900410c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:47.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.055+0000 7f900c383640 1 --2- 172.21.15.79:0/1938406250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90041042c0 0x7f900410c7b0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4009900 tx=0x7f8ff402a410 comp rx=0 tx=0).stop 2024-08-20T01:47:47.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.056+0000 7f900c383640 1 -- 172.21.15.79:0/1938406250 shutdown_connections 2024-08-20T01:47:47.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.056+0000 7f900c383640 1 --2- 172.21.15.79:0/1938406250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f900410ce00 0x7f900410f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:47.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.056+0000 7f900c383640 1 --2- 172.21.15.79:0/1938406250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90041042c0 0x7f900410c7b0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:47.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.056+0000 7f900c383640 1 --2- 172.21.15.79:0/1938406250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90041039a0 0x7f9004103d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:47.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.056+0000 7f900c383640 1 -- 172.21.15.79:0/1938406250 >> 172.21.15.79:0/1938406250 conn(0x7f90040fd400 msgr2=0x7f90040ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:47.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.056+0000 7f900c383640 1 -- 172.21.15.79:0/1938406250 shutdown_connections 2024-08-20T01:47:47.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.056+0000 7f900c383640 1 -- 172.21.15.79:0/1938406250 wait complete. 2024-08-20T01:47:47.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.057+0000 7f900c383640 1 Processor -- start 2024-08-20T01:47:47.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.057+0000 7f900c383640 1 -- start start 2024-08-20T01:47:47.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.057+0000 7f900c383640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90041039a0 0x7f900419f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:47.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.057+0000 7f900c383640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90041042c0 0x7f900419fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:47.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.057+0000 7f900c383640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f900410ce00 0x7f90041a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:47.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.057+0000 7f900c383640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9004110790 con 0x7f900410ce00 2024-08-20T01:47:47.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.057+0000 7f900c383640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9004110610 con 0x7f90041042c0 2024-08-20T01:47:47.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.057+0000 7f900c383640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9004110910 con 0x7f90041039a0 2024-08-20T01:47:47.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.057+0000 7f900a11f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90041039a0 0x7f900419f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:47.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.058+0000 7f900a920640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f900410ce00 0x7f90041a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:47.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.058+0000 7f900a11f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90041039a0 0x7f900419f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:40712/0 (socket says 172.21.15.79:40712) 2024-08-20T01:47:47.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.058+0000 7f900a11f640 1 -- 172.21.15.79:0/3360608940 learned_addr learned my addr 172.21.15.79:0/3360608940 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:47.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.058+0000 7f900991e640 1 --2- 172.21.15.79:0/3360608940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90041042c0 0x7f900419fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:47.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.058+0000 7f900a11f640 1 -- 172.21.15.79:0/3360608940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90041042c0 msgr2=0x7f900419fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:47.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.058+0000 7f900a11f640 1 --2- 172.21.15.79:0/3360608940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90041042c0 0x7f900419fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:47.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.058+0000 7f900a11f640 1 -- 172.21.15.79:0/3360608940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f900410ce00 msgr2=0x7f90041a4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:47.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.058+0000 7f900a11f640 1 --2- 172.21.15.79:0/3360608940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f900410ce00 0x7f90041a4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:47.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.058+0000 7f900a11f640 1 -- 172.21.15.79:0/3360608940 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90041a55b0 con 0x7f90041039a0 2024-08-20T01:47:47.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.058+0000 7f900a920640 1 --2- 172.21.15.79:0/3360608940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f900410ce00 0x7f90041a4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:47:47.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.058+0000 7f900a11f640 1 --2- 172.21.15.79:0/3360608940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90041039a0 0x7f900419f500 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f900000e9f0 tx=0x7f900000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:47.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.058+0000 7f8ffb7fe640 1 -- 172.21.15.79:0/3360608940 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f900000cd80 con 0x7f90041039a0 2024-08-20T01:47:47.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.059+0000 7f8ffb7fe640 1 -- 172.21.15.79:0/3360608940 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f90000054b0 con 0x7f90041039a0 2024-08-20T01:47:47.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.059+0000 7f8ffb7fe640 1 -- 172.21.15.79:0/3360608940 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9000010430 con 0x7f90041039a0 2024-08-20T01:47:47.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.060+0000 7f900c383640 1 -- 172.21.15.79:0/3360608940 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90041a58a0 con 0x7f90041039a0 2024-08-20T01:47:47.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.060+0000 7f900c383640 1 -- 172.21.15.79:0/3360608940 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90041abf60 con 0x7f90041039a0 2024-08-20T01:47:47.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.065+0000 7f8ffb7fe640 1 -- 172.21.15.79:0/3360608940 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f90000046c0 con 0x7f90041039a0 2024-08-20T01:47:47.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.066+0000 7f900e77c740 1 Processor -- start 2024-08-20T01:47:47.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.067+0000 7f900e77c740 1 -- start start 2024-08-20T01:47:47.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.067+0000 7f900e77c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598df234880 0x5598df234c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:47.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.067+0000 7f8ffb7fe640 1 --2- 172.21.15.79:0/3360608940 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f8ff00b3d10 0x7f8ff00b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:47.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.067+0000 7f900e77c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598df2351a0 0x5598df240bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:47.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.067+0000 7f900e77c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5598df241130 0x5598df243520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:47.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.067+0000 7f900e77c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5598df1ab930 con 0x5598df2351a0 2024-08-20T01:47:47.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.067+0000 7f900e77c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5598df19ae30 con 0x5598df234880 2024-08-20T01:47:47.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.067+0000 7f900e77c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5598df19ee70 con 0x5598df241130 2024-08-20T01:47:47.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.067+0000 7f900a920640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598df234880 0x5598df234c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:47.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.067+0000 7f900a920640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598df234880 0x5598df234c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:48382/0 (socket says 172.21.15.79:48382) 2024-08-20T01:47:47.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.068+0000 7f900a920640 1 -- 172.21.15.79:0/954195691 learned_addr learned my addr 172.21.15.79:0/954195691 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:47.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.068+0000 7f900a920640 1 --2- 172.21.15.79:0/954195691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5598df241130 0x5598df243520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:47.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.068+0000 7f8ffb7fe640 1 -- 172.21.15.79:0/3360608940 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f90000e3ff0 con 0x7f90041039a0 2024-08-20T01:47:47.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.068+0000 7f900991e640 1 --2- 172.21.15.79:0/954195691 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598df2351a0 0x5598df240bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:47.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.068+0000 7f900a920640 1 -- 172.21.15.79:0/954195691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5598df241130 msgr2=0x5598df243520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:47.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.068+0000 7f900a920640 1 --2- 172.21.15.79:0/954195691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5598df241130 0x5598df243520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:47.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.068+0000 7f900a920640 1 -- 172.21.15.79:0/954195691 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598df2351a0 msgr2=0x5598df240bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:47.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.068+0000 7f900a920640 1 --2- 172.21.15.79:0/954195691 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598df2351a0 0x5598df240bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:47.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.068+0000 7f900a920640 1 -- 172.21.15.79:0/954195691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598deefa650 con 0x5598df234880 2024-08-20T01:47:47.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.068+0000 7f900a920640 1 --2- 172.21.15.79:0/954195691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598df234880 0x5598df234c60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc012d30 tx=0x7f8ffc009e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92940a94a0376e52 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:47.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.069+0000 7f900991e640 1 --2- 172.21.15.79:0/954195691 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598df2351a0 0x5598df240bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:47:47.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.069+0000 7f900a11f640 1 --2- 172.21.15.79:0/3360608940 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f8ff00b3d10 0x7f8ff00b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:47.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.070+0000 7f8ff8de6640 1 -- 172.21.15.79:0/954195691 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc00ece0 con 0x5598df234880 2024-08-20T01:47:47.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.070+0000 7f8ff8de6640 1 -- 172.21.15.79:0/954195691 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8ffc00ee80 con 0x5598df234880 2024-08-20T01:47:47.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.070+0000 7f8ff8de6640 1 -- 172.21.15.79:0/954195691 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc00f620 con 0x5598df234880 2024-08-20T01:47:47.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.071+0000 7f900e77c740 1 -- 172.21.15.79:0/954195691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598df234880 msgr2=0x5598df234c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:47.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.071+0000 7f900e77c740 1 --2- 172.21.15.79:0/954195691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598df234880 0x5598df234c60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc012d30 tx=0x7f8ffc009e90 comp rx=0 tx=0).stop 2024-08-20T01:47:47.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.071+0000 7f900a11f640 1 --2- 172.21.15.79:0/3360608940 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f8ff00b3d10 0x7f8ff00b61d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f90000a8160 tx=0x7f9000004a00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:47.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.071+0000 7f900e77c740 1 -- 172.21.15.79:0/954195691 shutdown_connections 2024-08-20T01:47:47.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.071+0000 7f900e77c740 1 --2- 172.21.15.79:0/954195691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5598df241130 0x5598df243520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:47.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.071+0000 7f900e77c740 1 --2- 172.21.15.79:0/954195691 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598df2351a0 0x5598df240bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:47.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.071+0000 7f900e77c740 1 --2- 172.21.15.79:0/954195691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598df234880 0x5598df234c60 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:47.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.071+0000 7f900e77c740 1 -- 172.21.15.79:0/954195691 >> 172.21.15.79:0/954195691 conn(0x5598df2326b0 msgr2=0x5598df233850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:47.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.072+0000 7f900e77c740 1 -- 172.21.15.79:0/954195691 shutdown_connections 2024-08-20T01:47:47.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.074+0000 7f900e77c740 1 -- 172.21.15.79:0/954195691 wait complete. 2024-08-20T01:47:47.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.074+0000 7f900e77c740 1 -- start start 2024-08-20T01:47:47.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.074+0000 7f900e77c740 1 Processor -- start 2024-08-20T01:47:47.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.075+0000 7f900e77c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598df234880 0x5598df23e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:47.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.075+0000 7f900e77c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598df2351a0 0x5598df23e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:47.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.075+0000 7f900e77c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5598df241130 0x5598df23eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:47.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.075+0000 7f900a920640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598df234880 0x5598df23e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:47.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.075+0000 7f900a920640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598df234880 0x5598df23e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40246/0 (socket says 172.21.15.79:40246) 2024-08-20T01:47:47.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.075+0000 7f900a920640 1 -- 172.21.15.79:0/1529648701 learned_addr learned my addr 172.21.15.79:0/1529648701 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:47.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.075+0000 7f900e77c740 1 -- 172.21.15.79:0/1529648701 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5598deffd700 con 0x5598df234880 2024-08-20T01:47:47.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.075+0000 7f900e77c740 1 -- 172.21.15.79:0/1529648701 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5598df121810 con 0x5598df2351a0 2024-08-20T01:47:47.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.075+0000 7f900e77c740 1 -- 172.21.15.79:0/1529648701 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5598df243d80 con 0x5598df241130 2024-08-20T01:47:47.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.075+0000 7f900991e640 1 --2- 172.21.15.79:0/1529648701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598df2351a0 0x5598df23e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:47.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.075+0000 7f900e77c740 10 client.0 _ll_register_callbacks cb 0x5598df194700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:47:47.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.075+0000 7f900a920640 1 --2- 172.21.15.79:0/1529648701 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5598df241130 0x5598df23eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:47.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.076+0000 7f900a920640 1 -- 172.21.15.79:0/1529648701 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5598df241130 msgr2=0x5598df23eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:47.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.076+0000 7f900a920640 1 --2- 172.21.15.79:0/1529648701 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5598df241130 0x5598df23eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:47.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.076+0000 7f900a920640 1 -- 172.21.15.79:0/1529648701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598df2351a0 msgr2=0x5598df23e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:47.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.076+0000 7f900a920640 1 --2- 172.21.15.79:0/1529648701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598df2351a0 0x5598df23e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:47.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.076+0000 7f900a920640 1 -- 172.21.15.79:0/1529648701 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598df24d130 con 0x5598df234880 2024-08-20T01:47:47.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.076+0000 7f8fedffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:47:47.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.076+0000 7f900a920640 1 --2- 172.21.15.79:0/1529648701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598df234880 0x5598df23e0c0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc005ba0 tx=0x7f8ffc015050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a777167958ef22f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:47.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.077+0000 7f8fedffb640 1 -- 172.21.15.79:0/1529648701 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc02f440 con 0x5598df234880 2024-08-20T01:47:47.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.077+0000 7f8fedffb640 1 -- 172.21.15.79:0/1529648701 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f8ffc0108f0 con 0x5598df234880 2024-08-20T01:47:47.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.077+0000 7f900e77c740 1 -- 172.21.15.79:0/1529648701 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5598df14a150 con 0x5598df234880 2024-08-20T01:47:47.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.077+0000 7f8fedffb640 1 -- 172.21.15.79:0/1529648701 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f8ffc02f440 con 0x5598df234880 2024-08-20T01:47:47.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.078+0000 7f900e77c740 10 client.18288 fetch_fsmap learned FSMap version 47 2024-08-20T01:47:47.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.078+0000 7f900e77c740 1 -- 172.21.15.79:0/1529648701 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x5598df24fa30 con 0x5598df234880 2024-08-20T01:47:47.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.078+0000 7f8fedffb640 1 -- 172.21.15.79:0/1529648701 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5598df14a150 con 0x5598df234880 2024-08-20T01:47:47.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.079+0000 7f8fedffb640 1 -- 172.21.15.79:0/1529648701 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 47) ==== 8394+0+0 (secure 0 0 0) 0x7f8ffc031430 con 0x5598df234880 2024-08-20T01:47:47.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.079+0000 7f900e77c740 10 client.18288 fetch_fsmap finished waiting for FSMap version 47 2024-08-20T01:47:47.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.079+0000 7f900e77c740 10 client.18288 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:47:47.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.079+0000 7f900e77c740 20 client.18288 populate_metadata read hostname 'smithi079' 2024-08-20T01:47:47.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.079+0000 7f900e77c740 1 --2- 172.21.15.79:0/1529648701 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5598df250de0 0x5598df2531d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:47.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.079+0000 7f900e77c740 4 client.18288 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:47:47.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.079+0000 7f900e77c740 1 -- 172.21.15.79:0/1529648701 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5598df1ad880 con 0x5598df250de0 2024-08-20T01:47:47.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.080+0000 7f900991e640 1 --2- 172.21.15.79:0/1529648701 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5598df250de0 0x5598df2531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:47.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.083+0000 7f8fedffb640 10 client.18288 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:47:47.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.083+0000 7f900991e640 1 --2- 172.21.15.79:0/1529648701 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5598df250de0 0x5598df2531d0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=82fdd36f40933cfe server_cookie=87875bd8f122ee4a in_seq=0 out_seq=0 2024-08-20T01:47:47.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.084+0000 7f8fedffb640 1 -- 172.21.15.79:0/1529648701 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5598df1ad880 con 0x5598df250de0 2024-08-20T01:47:47.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.084+0000 7f8fedffb640 10 client.18288 handle_command_reply: tid=0 2024-08-20T01:47:47.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.084+0000 7f900e77c740 1 client.18288 shutdown 2024-08-20T01:47:47.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.084+0000 7f900e77c740 1 -- 172.21.15.79:0/1529648701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598df234880 msgr2=0x5598df23e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:47.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.084+0000 7f900e77c740 1 --2- 172.21.15.79:0/1529648701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598df234880 0x5598df23e0c0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc005ba0 tx=0x7f8ffc015050 comp rx=0 tx=0).stop 2024-08-20T01:47:47.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.084+0000 7f900e77c740 1 -- 172.21.15.79:0/1529648701 shutdown_connections 2024-08-20T01:47:47.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.084+0000 7f900e77c740 1 --2- 172.21.15.79:0/1529648701 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5598df250de0 0x5598df2531d0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:47.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.084+0000 7f8fedffb640 0 client.18288 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:47:47.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.084+0000 7f900e77c740 1 --2- 172.21.15.79:0/1529648701 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5598df241130 0x5598df23eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:47.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.084+0000 7f900e77c740 1 --2- 172.21.15.79:0/1529648701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598df2351a0 0x5598df23e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:47.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.084+0000 7f900e77c740 1 --2- 172.21.15.79:0/1529648701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598df234880 0x5598df23e0c0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:47.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.084+0000 7f900e77c740 1 -- 172.21.15.79:0/1529648701 >> 172.21.15.79:0/1529648701 conn(0x5598df2326b0 msgr2=0x5598df238220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:47.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.084+0000 7f900e77c740 1 -- 172.21.15.79:0/1529648701 shutdown_connections 2024-08-20T01:47:47.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.084+0000 7f900e77c740 1 -- 172.21.15.79:0/1529648701 wait complete. 2024-08-20T01:47:47.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.084+0000 7f900e77c740 20 client.18288 trim_cache size 0 max 16384 2024-08-20T01:47:47.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.107+0000 7f900e77c740 1 Processor -- start 2024-08-20T01:47:47.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.107+0000 7f900e77c740 1 -- start start 2024-08-20T01:47:47.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.108+0000 7f900e77c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598df234880 0x5598df258890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:47.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.108+0000 7f900e77c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598df2351a0 0x5598df258dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:47.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.108+0000 7f900e77c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5598df241130 0x5598df249000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:47.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.108+0000 7f900e77c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f90041ac130 con 0x5598df2351a0 2024-08-20T01:47:47.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.108+0000 7f900e77c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f90041add20 con 0x5598df234880 2024-08-20T01:47:47.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.108+0000 7f900e77c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f90041ac7f0 con 0x5598df241130 2024-08-20T01:47:47.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.108+0000 7f900991e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598df2351a0 0x5598df258dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:47.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.108+0000 7f900991e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598df2351a0 0x5598df258dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40258/0 (socket says 172.21.15.79:40258) 2024-08-20T01:47:47.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.108+0000 7f900991e640 1 -- 172.21.15.79:0/542584307 learned_addr learned my addr 172.21.15.79:0/542584307 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:47.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.109+0000 7f900991e640 1 -- 172.21.15.79:0/542584307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5598df241130 msgr2=0x5598df249000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:47:47.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.109+0000 7f900991e640 1 --2- 172.21.15.79:0/542584307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5598df241130 0x5598df249000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:47.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.109+0000 7f900991e640 1 -- 172.21.15.79:0/542584307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598df234880 msgr2=0x5598df258890 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:47:47.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.109+0000 7f900991e640 1 --2- 172.21.15.79:0/542584307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598df234880 0x5598df258890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:47.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.109+0000 7f900991e640 1 -- 172.21.15.79:0/542584307 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598df23c5c0 con 0x5598df2351a0 2024-08-20T01:47:47.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.109+0000 7f900991e640 1 --2- 172.21.15.79:0/542584307 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598df2351a0 0x5598df258dd0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4005c40 tx=0x7f8ff402a910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93ba3c7b80cb1146 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:47.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.110+0000 7f8feffff640 1 -- 172.21.15.79:0/542584307 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4049070 con 0x5598df2351a0 2024-08-20T01:47:47.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.110+0000 7f8feffff640 1 -- 172.21.15.79:0/542584307 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8ff4003c80 con 0x5598df2351a0 2024-08-20T01:47:47.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.110+0000 7f8feffff640 1 -- 172.21.15.79:0/542584307 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4035050 con 0x5598df2351a0 2024-08-20T01:47:47.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.111+0000 7f900e77c740 1 -- 172.21.15.79:0/542584307 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598df2351a0 msgr2=0x5598df258dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:47.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.111+0000 7f900e77c740 1 --2- 172.21.15.79:0/542584307 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598df2351a0 0x5598df258dd0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4005c40 tx=0x7f8ff402a910 comp rx=0 tx=0).stop 2024-08-20T01:47:47.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.111+0000 7f900e77c740 1 -- 172.21.15.79:0/542584307 shutdown_connections 2024-08-20T01:47:47.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.111+0000 7f900e77c740 1 --2- 172.21.15.79:0/542584307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5598df241130 0x5598df249000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:47.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.111+0000 7f900e77c740 1 --2- 172.21.15.79:0/542584307 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598df2351a0 0x5598df258dd0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:47.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.111+0000 7f900e77c740 1 --2- 172.21.15.79:0/542584307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598df234880 0x5598df258890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:47.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.111+0000 7f900e77c740 1 -- 172.21.15.79:0/542584307 >> 172.21.15.79:0/542584307 conn(0x5598df2326b0 msgr2=0x5598df23ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:47.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.111+0000 7f900e77c740 1 -- 172.21.15.79:0/542584307 shutdown_connections 2024-08-20T01:47:47.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.111+0000 7f900e77c740 1 -- 172.21.15.79:0/542584307 wait complete. 2024-08-20T01:47:47.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.111+0000 7f900e77c740 1 -- start start 2024-08-20T01:47:47.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.112+0000 7f900e77c740 1 Processor -- start 2024-08-20T01:47:47.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.112+0000 7f900e77c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5598df234880 0x5598df246350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:47.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.112+0000 7f900e77c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598df2351a0 0x5598df2468d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:47.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.112+0000 7f900e77c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598df241130 0x5598df2b9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:47.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.112+0000 7f900e77c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f90041ad650 con 0x5598df2351a0 2024-08-20T01:47:47.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.112+0000 7f900e77c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f90041acec0 con 0x5598df241130 2024-08-20T01:47:47.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.112+0000 7f900e77c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f90040730a0 con 0x5598df234880 2024-08-20T01:47:47.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.112+0000 7f900e77c740 10 client.0 _ll_register_callbacks cb 0x7f8ffc012be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:47:47.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.112+0000 7f900991e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598df2351a0 0x5598df2468d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:47.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.112+0000 7f900991e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598df2351a0 0x5598df2468d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40266/0 (socket says 172.21.15.79:40266) 2024-08-20T01:47:47.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.112+0000 7f900991e640 1 -- 172.21.15.79:0/1138658790 learned_addr learned my addr 172.21.15.79:0/1138658790 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:47.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.113+0000 7f900991e640 1 -- 172.21.15.79:0/1138658790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5598df234880 msgr2=0x5598df246350 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:47:47.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.113+0000 7f900991e640 1 --2- 172.21.15.79:0/1138658790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5598df234880 0x5598df246350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:47.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.113+0000 7f900991e640 1 -- 172.21.15.79:0/1138658790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598df241130 msgr2=0x5598df2b9860 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:47:47.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.113+0000 7f900991e640 1 --2- 172.21.15.79:0/1138658790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598df241130 0x5598df2b9860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:47.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.113+0000 7f900991e640 1 -- 172.21.15.79:0/1138658790 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598df2cadb0 con 0x5598df2351a0 2024-08-20T01:47:47.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.113+0000 7f900991e640 1 --2- 172.21.15.79:0/1138658790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598df2351a0 0x5598df2468d0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4005ec0 tx=0x7f8ff4003f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30560fad82e70588 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:47.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.113+0000 7f8fedffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:47:47.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.114+0000 7f8fedffb640 1 -- 172.21.15.79:0/1138658790 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4049040 con 0x5598df2351a0 2024-08-20T01:47:47.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.114+0000 7f8fedffb640 1 -- 172.21.15.79:0/1138658790 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f8ff403d450 con 0x5598df2351a0 2024-08-20T01:47:47.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.114+0000 7f900e77c740 1 -- 172.21.15.79:0/1138658790 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ff4003c80 con 0x5598df2351a0 2024-08-20T01:47:47.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.114+0000 7f8fedffb640 1 -- 172.21.15.79:0/1138658790 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f8ff4035030 con 0x5598df2351a0 2024-08-20T01:47:47.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.114+0000 7f900e77c740 10 client.18294 fetch_fsmap learned FSMap version 47 2024-08-20T01:47:47.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.114+0000 7f900e77c740 1 -- 172.21.15.79:0/1138658790 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x5598df2cc0b0 con 0x5598df2351a0 2024-08-20T01:47:47.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.115+0000 7f8fedffb640 1 -- 172.21.15.79:0/1138658790 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8ff4003c80 con 0x5598df2351a0 2024-08-20T01:47:47.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.115+0000 7f8fedffb640 1 -- 172.21.15.79:0/1138658790 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 47) ==== 8394+0+0 (secure 0 0 0) 0x7f8ff404e5e0 con 0x5598df2351a0 2024-08-20T01:47:47.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.115+0000 7f900e77c740 10 client.18294 fetch_fsmap finished waiting for FSMap version 47 2024-08-20T01:47:47.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.115+0000 7f900e77c740 10 client.18294 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:47:47.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.115+0000 7f900e77c740 20 client.18294 populate_metadata read hostname 'smithi079' 2024-08-20T01:47:47.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.115+0000 7f900e77c740 1 --2- 172.21.15.79:0/1138658790 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5598df250de0 0x5598df2ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:47.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.115+0000 7f900e77c740 4 client.18294 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:47:47.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.115+0000 7f900e77c740 1 -- 172.21.15.79:0/1138658790 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5598df1a9320 con 0x5598df250de0 2024-08-20T01:47:47.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.116+0000 7f900a920640 1 --2- 172.21.15.79:0/1138658790 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5598df250de0 0x5598df2ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:47.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.116+0000 7f8fedffb640 10 client.18294 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:47:47.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.116+0000 7f900a920640 1 --2- 172.21.15.79:0/1138658790 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5598df250de0 0x5598df2ce7b0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=68f2ab3683c41526 server_cookie=947c83532333d2d8 in_seq=0 out_seq=0 2024-08-20T01:47:47.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.116+0000 7f8fedffb640 1 -- 172.21.15.79:0/1138658790 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5598df1a9320 con 0x5598df250de0 2024-08-20T01:47:47.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.116+0000 7f8fedffb640 10 client.18294 handle_command_reply: tid=0 2024-08-20T01:47:47.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.116+0000 7f900e77c740 1 client.18294 shutdown 2024-08-20T01:47:47.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.117+0000 7f900e77c740 1 -- 172.21.15.79:0/1138658790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598df2351a0 msgr2=0x5598df2468d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:47.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.117+0000 7f900e77c740 1 --2- 172.21.15.79:0/1138658790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598df2351a0 0x5598df2468d0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4005ec0 tx=0x7f8ff4003f20 comp rx=0 tx=0).stop 2024-08-20T01:47:47.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.117+0000 7f900e77c740 1 -- 172.21.15.79:0/1138658790 shutdown_connections 2024-08-20T01:47:47.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.117+0000 7f900e77c740 1 --2- 172.21.15.79:0/1138658790 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5598df250de0 0x5598df2ce7b0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:47.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.117+0000 7f900e77c740 1 --2- 172.21.15.79:0/1138658790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598df241130 0x5598df2b9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:47.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.117+0000 7f900e77c740 1 --2- 172.21.15.79:0/1138658790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598df2351a0 0x5598df2468d0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:47.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.117+0000 7f900e77c740 1 --2- 172.21.15.79:0/1138658790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5598df234880 0x5598df246350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:47.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.117+0000 7f900e77c740 1 -- 172.21.15.79:0/1138658790 >> 172.21.15.79:0/1138658790 conn(0x5598df2326b0 msgr2=0x5598df230f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:47.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.117+0000 7f8fedffb640 0 client.18294 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:47:47.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.118+0000 7f900e77c740 1 -- 172.21.15.79:0/1138658790 shutdown_connections 2024-08-20T01:47:47.148 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:47:47.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.118+0000 7f900e77c740 1 -- 172.21.15.79:0/1138658790 wait complete. 2024-08-20T01:47:47.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.118+0000 7f900e77c740 20 client.18294 trim_cache size 0 max 16384 2024-08-20T01:47:47.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.120+0000 7f900c383640 1 -- 172.21.15.79:0/3360608940 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f8ff00b3d10 msgr2=0x7f8ff00b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:47.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.120+0000 7f900c383640 1 --2- 172.21.15.79:0/3360608940 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f8ff00b3d10 0x7f8ff00b61d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f90000a8160 tx=0x7f9000004a00 comp rx=0 tx=0).stop 2024-08-20T01:47:47.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.120+0000 7f900c383640 1 -- 172.21.15.79:0/3360608940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90041039a0 msgr2=0x7f900419f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:47.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.120+0000 7f900c383640 1 --2- 172.21.15.79:0/3360608940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90041039a0 0x7f900419f500 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f900000e9f0 tx=0x7f900000edf0 comp rx=0 tx=0).stop 2024-08-20T01:47:47.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.120+0000 7f900c383640 1 -- 172.21.15.79:0/3360608940 shutdown_connections 2024-08-20T01:47:47.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.120+0000 7f900c383640 1 --2- 172.21.15.79:0/3360608940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f900410ce00 0x7f90041a4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:47.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.120+0000 7f900c383640 1 --2- 172.21.15.79:0/3360608940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90041042c0 0x7f900419fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:47.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.120+0000 7f900c383640 1 --2- 172.21.15.79:0/3360608940 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f8ff00b3d10 0x7f8ff00b61d0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:47.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.120+0000 7f900c383640 1 --2- 172.21.15.79:0/3360608940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90041039a0 0x7f900419f500 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:47.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.120+0000 7f900c383640 1 -- 172.21.15.79:0/3360608940 >> 172.21.15.79:0/3360608940 conn(0x7f90040fd400 msgr2=0x7f90040fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:47.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.120+0000 7f900c383640 1 -- 172.21.15.79:0/3360608940 shutdown_connections 2024-08-20T01:47:47.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:46.120+0000 7f900c383640 1 -- 172.21.15.79:0/3360608940 wait complete. 2024-08-20T01:47:48.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:48 smithi081 ceph-mon[22209]: pgmap v661: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 26 MiB/s wr, 6.75k op/s 2024-08-20T01:47:48.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:48 smithi175 ceph-mon[22392]: pgmap v661: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 26 MiB/s wr, 6.75k op/s 2024-08-20T01:47:48.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:48 smithi079 ceph-mon[18656]: pgmap v661: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 26 MiB/s wr, 6.75k op/s 2024-08-20T01:47:49.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.823+0000 7fed97ff9640 1 -- 172.21.15.79:0/1651831386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed880948f0 msgr2=0x7fed88094d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:49.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.823+0000 7fed97ff9640 1 --2- 172.21.15.79:0/1651831386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed880948f0 0x7fed88094d70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fed80009860 tx=0x7fed8002a340 comp rx=0 tx=0).stop 2024-08-20T01:47:49.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.823+0000 7fed97ff9640 1 -- 172.21.15.79:0/1651831386 shutdown_connections 2024-08-20T01:47:49.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.823+0000 7fed97ff9640 1 --2- 172.21.15.79:0/1651831386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed880952b0 0x7fed8809bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:49.826 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.823+0000 7fed97ff9640 1 --2- 172.21.15.79:0/1651831386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed880948f0 0x7fed88094d70 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:49.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.823+0000 7fed97ff9640 1 --2- 172.21.15.79:0/1651831386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed880937a0 0x7fed88093ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:49.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.823+0000 7fed97ff9640 1 -- 172.21.15.79:0/1651831386 >> 172.21.15.79:0/1651831386 conn(0x7fed8808f040 msgr2=0x7fed88091480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:49.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.823+0000 7fed97ff9640 1 -- 172.21.15.79:0/1651831386 shutdown_connections 2024-08-20T01:47:49.827 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.823+0000 7fed97ff9640 1 -- 172.21.15.79:0/1651831386 wait complete. 2024-08-20T01:47:49.828 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.824+0000 7fed97ff9640 1 Processor -- start 2024-08-20T01:47:49.828 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.824+0000 7fed97ff9640 1 -- start start 2024-08-20T01:47:49.828 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.824+0000 7fed97ff9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed880937a0 0x7fed88131c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:49.828 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.824+0000 7fed97ff9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed880948f0 0x7fed881322e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:49.828 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.824+0000 7fed97ff9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed880952b0 0x7fed88132f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:49.828 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.824+0000 7fed97ff9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fed8809eed0 con 0x7fed880952b0 2024-08-20T01:47:49.828 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.824+0000 7fed97ff9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fed8809ed50 con 0x7fed880937a0 2024-08-20T01:47:49.829 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.824+0000 7fed97ff9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fed8809f050 con 0x7fed880948f0 2024-08-20T01:47:49.829 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.825+0000 7fed95d95640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed880937a0 0x7fed88131c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:49.829 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.825+0000 7fed95594640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed880948f0 0x7fed881322e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:49.829 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.825+0000 7fed95594640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed880948f0 0x7fed881322e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:40760/0 (socket says 172.21.15.79:40760) 2024-08-20T01:47:49.829 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.825+0000 7fed95594640 1 -- 172.21.15.79:0/2403437195 learned_addr learned my addr 172.21.15.79:0/2403437195 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:49.829 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.825+0000 7fed96596640 1 --2- 172.21.15.79:0/2403437195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed880952b0 0x7fed88132f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:49.829 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.825+0000 7fed95d95640 1 -- 172.21.15.79:0/2403437195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed880948f0 msgr2=0x7fed881322e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:49.829 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.825+0000 7fed95d95640 1 --2- 172.21.15.79:0/2403437195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed880948f0 0x7fed881322e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:49.829 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.825+0000 7fed95d95640 1 -- 172.21.15.79:0/2403437195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed880952b0 msgr2=0x7fed88132f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:49.829 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.825+0000 7fed95d95640 1 --2- 172.21.15.79:0/2403437195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed880952b0 0x7fed88132f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:49.829 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.825+0000 7fed95d95640 1 -- 172.21.15.79:0/2403437195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed881337d0 con 0x7fed880937a0 2024-08-20T01:47:49.830 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.827+0000 7fed95d95640 1 --2- 172.21.15.79:0/2403437195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed880937a0 0x7fed88131c90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fed90065ff0 tx=0x7fed9006c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:49.830 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.828+0000 7fed86ffd640 1 -- 172.21.15.79:0/2403437195 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed9007db90 con 0x7fed880937a0 2024-08-20T01:47:49.832 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.828+0000 7fed97ff9640 1 -- 172.21.15.79:0/2403437195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed88133ac0 con 0x7fed880937a0 2024-08-20T01:47:49.832 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.828+0000 7fed97ff9640 1 -- 172.21.15.79:0/2403437195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed8813a190 con 0x7fed880937a0 2024-08-20T01:47:49.832 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.828+0000 7fed86ffd640 1 -- 172.21.15.79:0/2403437195 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fed9007dd30 con 0x7fed880937a0 2024-08-20T01:47:49.832 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.828+0000 7fed86ffd640 1 -- 172.21.15.79:0/2403437195 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed9007a5e0 con 0x7fed880937a0 2024-08-20T01:47:49.834 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.831+0000 7fed9ade4740 1 Processor -- start 2024-08-20T01:47:49.835 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.833+0000 7fed9ade4740 1 -- start start 2024-08-20T01:47:49.836 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.833+0000 7fed9ade4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55950b4d5810 0x55950b4d7c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:49.836 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.833+0000 7fed9ade4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55950b4d8140 0x55950b4da530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:49.836 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.833+0000 7fed9ade4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55950b4dab80 0x55950b4dd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:49.836 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.833+0000 7fed9ade4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55950b448360 con 0x55950b4dab80 2024-08-20T01:47:49.836 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.833+0000 7fed9ade4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55950b437860 con 0x55950b4d8140 2024-08-20T01:47:49.836 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.833+0000 7fed9ade4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55950b43b8a0 con 0x55950b4d5810 2024-08-20T01:47:49.836 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.833+0000 7fed96596640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55950b4d5810 0x55950b4d7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:49.837 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.833+0000 7fed96596640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55950b4d5810 0x55950b4d7c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:40772/0 (socket says 172.21.15.79:40772) 2024-08-20T01:47:49.837 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.833+0000 7fed96596640 1 -- 172.21.15.79:0/2775838005 learned_addr learned my addr 172.21.15.79:0/2775838005 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:49.837 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.834+0000 7fed96596640 1 -- 172.21.15.79:0/2775838005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55950b4d8140 msgr2=0x55950b4da530 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:47:49.837 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.834+0000 7fed96596640 1 --2- 172.21.15.79:0/2775838005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55950b4d8140 0x55950b4da530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:49.837 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.834+0000 7fed96596640 1 -- 172.21.15.79:0/2775838005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55950b4dab80 msgr2=0x55950b4dd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:49.837 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.834+0000 7fed96596640 1 --2- 172.21.15.79:0/2775838005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55950b4dab80 0x55950b4dd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:49.837 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.834+0000 7fed96596640 1 -- 172.21.15.79:0/2775838005 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55950b3dee40 con 0x55950b4d5810 2024-08-20T01:47:49.838 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.835+0000 7fed96596640 1 --2- 172.21.15.79:0/2775838005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55950b4d5810 0x55950b4d7c00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fed8c009bb0 tx=0x7fed8c0117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8f188170e77e68b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:49.839 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.835+0000 7fed7bfff640 1 -- 172.21.15.79:0/2775838005 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8c012450 con 0x55950b4d5810 2024-08-20T01:47:49.839 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.835+0000 7fed7bfff640 1 -- 172.21.15.79:0/2775838005 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fed8c012a80 con 0x55950b4d5810 2024-08-20T01:47:49.839 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.835+0000 7fed7bfff640 1 -- 172.21.15.79:0/2775838005 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8c00f9b0 con 0x55950b4d5810 2024-08-20T01:47:49.840 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.837+0000 7fed86ffd640 1 -- 172.21.15.79:0/2403437195 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fed90064050 con 0x7fed880937a0 2024-08-20T01:47:49.840 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.837+0000 7fed9ade4740 1 -- 172.21.15.79:0/2775838005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55950b4d5810 msgr2=0x55950b4d7c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:49.840 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.837+0000 7fed9ade4740 1 --2- 172.21.15.79:0/2775838005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55950b4d5810 0x55950b4d7c00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fed8c009bb0 tx=0x7fed8c0117b0 comp rx=0 tx=0).stop 2024-08-20T01:47:49.840 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.837+0000 7fed9ade4740 1 -- 172.21.15.79:0/2775838005 shutdown_connections 2024-08-20T01:47:49.840 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.837+0000 7fed9ade4740 1 --2- 172.21.15.79:0/2775838005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55950b4dab80 0x55950b4dd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:49.840 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.837+0000 7fed9ade4740 1 --2- 172.21.15.79:0/2775838005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55950b4d8140 0x55950b4da530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:49.840 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.837+0000 7fed9ade4740 1 --2- 172.21.15.79:0/2775838005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55950b4d5810 0x55950b4d7c00 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:49.840 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.837+0000 7fed9ade4740 1 -- 172.21.15.79:0/2775838005 >> 172.21.15.79:0/2775838005 conn(0x55950b4d0960 msgr2=0x55950b4d16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:49.841 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.838+0000 7fed9ade4740 1 -- 172.21.15.79:0/2775838005 shutdown_connections 2024-08-20T01:47:49.841 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.838+0000 7fed9ade4740 1 -- 172.21.15.79:0/2775838005 wait complete. 2024-08-20T01:47:49.841 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.838+0000 7fed86ffd640 1 --2- 172.21.15.79:0/2403437195 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fed7c0b3c20 0x7fed7c0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:49.841 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.838+0000 7fed86ffd640 1 -- 172.21.15.79:0/2403437195 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fed90150980 con 0x7fed880937a0 2024-08-20T01:47:49.841 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.838+0000 7fed95594640 1 --2- 172.21.15.79:0/2403437195 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fed7c0b3c20 0x7fed7c0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:49.842 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.838+0000 7fed9ade4740 1 -- start start 2024-08-20T01:47:49.842 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.839+0000 7fed9ade4740 1 Processor -- start 2024-08-20T01:47:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.839+0000 7fed95594640 1 --2- 172.21.15.79:0/2403437195 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fed7c0b3c20 0x7fed7c0b60e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fed800095f0 tx=0x7fed8000b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.839+0000 7fed9ade4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55950b4d5810 0x55950b4df0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.839+0000 7fed9ade4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55950b4d8140 0x55950b4df770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.839+0000 7fed9ade4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55950b4dab80 0x55950b4e0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.839+0000 7fed9ade4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55950b370ab0 con 0x55950b4d5810 2024-08-20T01:47:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.839+0000 7fed9ade4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55950b3be780 con 0x55950b4dab80 2024-08-20T01:47:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.839+0000 7fed9ade4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55950b4ddb60 con 0x55950b4d8140 2024-08-20T01:47:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.840+0000 7fed9ade4740 10 client.0 _ll_register_callbacks cb 0x55950b146a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:47:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.840+0000 7fed95594640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55950b4d8140 0x55950b4df770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.840+0000 7fed95594640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55950b4d8140 0x55950b4df770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:40774/0 (socket says 172.21.15.79:40774) 2024-08-20T01:47:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.840+0000 7fed95594640 1 -- 172.21.15.79:0/1780812548 learned_addr learned my addr 172.21.15.79:0/1780812548 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:49.844 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.840+0000 7fed95d95640 1 --2- 172.21.15.79:0/1780812548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55950b4d5810 0x55950b4df0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:49.844 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.840+0000 7fed96596640 1 --2- 172.21.15.79:0/1780812548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55950b4dab80 0x55950b4e0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:49.845 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.840+0000 7fed95594640 1 -- 172.21.15.79:0/1780812548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55950b4dab80 msgr2=0x55950b4e0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:49.845 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.840+0000 7fed95594640 1 --2- 172.21.15.79:0/1780812548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55950b4dab80 0x55950b4e0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:49.845 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.840+0000 7fed95594640 1 -- 172.21.15.79:0/1780812548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55950b4d5810 msgr2=0x55950b4df0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:49.845 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.840+0000 7fed95594640 1 --2- 172.21.15.79:0/1780812548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55950b4d5810 0x55950b4df0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:49.845 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.840+0000 7fed95594640 1 -- 172.21.15.79:0/1780812548 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55950b19a790 con 0x55950b4d8140 2024-08-20T01:47:49.845 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.841+0000 7fed95594640 1 --2- 172.21.15.79:0/1780812548 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55950b4d8140 0x55950b4df770 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fed80030fc0 tx=0x7fed8002a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c22401c28b52615a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:49.845 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.841+0000 7fed797fa640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:47:49.845 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.842+0000 7fed797fa640 1 -- 172.21.15.79:0/1780812548 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8004e020 con 0x55950b4d8140 2024-08-20T01:47:49.846 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.842+0000 7fed9ade4740 1 -- 172.21.15.79:0/1780812548 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55950b3e6e00 con 0x55950b4d8140 2024-08-20T01:47:49.846 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.842+0000 7fed797fa640 1 -- 172.21.15.79:0/1780812548 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fed800035f0 con 0x55950b4d8140 2024-08-20T01:47:49.846 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.842+0000 7fed797fa640 1 -- 172.21.15.79:0/1780812548 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fed80037040 con 0x55950b4d8140 2024-08-20T01:47:49.846 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.842+0000 7fed9ade4740 10 client.27316 fetch_fsmap learned FSMap version 47 2024-08-20T01:47:49.846 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.842+0000 7fed9ade4740 1 -- 172.21.15.79:0/1780812548 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55950b213620 con 0x55950b4d8140 2024-08-20T01:47:49.847 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.843+0000 7fed797fa640 1 -- 172.21.15.79:0/1780812548 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55950b3e6e00 con 0x55950b4d8140 2024-08-20T01:47:49.847 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.843+0000 7fed797fa640 1 -- 172.21.15.79:0/1780812548 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 47) ==== 8394+0+0 (secure 0 0 0) 0x7fed800329a0 con 0x55950b4d8140 2024-08-20T01:47:49.847 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.843+0000 7fed9ade4740 10 client.27316 fetch_fsmap finished waiting for FSMap version 47 2024-08-20T01:47:49.847 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.843+0000 7fed9ade4740 10 client.27316 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:47:49.847 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.843+0000 7fed9ade4740 20 client.27316 populate_metadata read hostname 'smithi079' 2024-08-20T01:47:49.847 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.843+0000 7fed9ade4740 1 --2- 172.21.15.79:0/1780812548 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55950b4eaa00 0x55950b4ece50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:49.847 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.843+0000 7fed9ade4740 4 client.27316 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:47:49.847 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.843+0000 7fed9ade4740 1 -- 172.21.15.79:0/1780812548 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55950b44a2b0 con 0x55950b4eaa00 2024-08-20T01:47:49.848 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.844+0000 7fed95d95640 1 --2- 172.21.15.79:0/1780812548 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55950b4eaa00 0x55950b4ece50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:49.848 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.844+0000 7fed95d95640 1 --2- 172.21.15.79:0/1780812548 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55950b4eaa00 0x55950b4ece50 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46e00ee1a46300fb server_cookie=355fb91ce966136e in_seq=0 out_seq=0 2024-08-20T01:47:49.848 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.844+0000 7fed797fa640 10 client.27316 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:47:49.849 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.845+0000 7fed797fa640 1 -- 172.21.15.79:0/1780812548 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55950b44a2b0 con 0x55950b4eaa00 2024-08-20T01:47:49.849 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.845+0000 7fed797fa640 10 client.27316 handle_command_reply: tid=0 2024-08-20T01:47:49.849 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.845+0000 7fed9ade4740 1 client.27316 shutdown 2024-08-20T01:47:49.849 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.845+0000 7fed9ade4740 1 -- 172.21.15.79:0/1780812548 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55950b4d8140 msgr2=0x55950b4df770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:49.849 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.845+0000 7fed9ade4740 1 --2- 172.21.15.79:0/1780812548 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55950b4d8140 0x55950b4df770 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fed80030fc0 tx=0x7fed8002a340 comp rx=0 tx=0).stop 2024-08-20T01:47:49.849 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.845+0000 7fed9ade4740 1 -- 172.21.15.79:0/1780812548 shutdown_connections 2024-08-20T01:47:49.849 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.845+0000 7fed9ade4740 1 --2- 172.21.15.79:0/1780812548 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55950b4eaa00 0x55950b4ece50 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:49.849 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.845+0000 7fed9ade4740 1 --2- 172.21.15.79:0/1780812548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55950b4dab80 0x55950b4e0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:49.849 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.845+0000 7fed9ade4740 1 --2- 172.21.15.79:0/1780812548 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55950b4d8140 0x55950b4df770 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:49.849 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.845+0000 7fed9ade4740 1 --2- 172.21.15.79:0/1780812548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55950b4d5810 0x55950b4df0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:49.850 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.846+0000 7fed9ade4740 1 -- 172.21.15.79:0/1780812548 >> 172.21.15.79:0/1780812548 conn(0x55950b4d0960 msgr2=0x55950b4cfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:49.850 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.846+0000 7fed797fa640 0 client.27316 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:47:49.850 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.846+0000 7fed9ade4740 1 -- 172.21.15.79:0/1780812548 shutdown_connections 2024-08-20T01:47:49.850 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.846+0000 7fed9ade4740 1 -- 172.21.15.79:0/1780812548 wait complete. 2024-08-20T01:47:49.850 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.846+0000 7fed9ade4740 20 client.27316 trim_cache size 0 max 16384 2024-08-20T01:47:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.877+0000 7fed9ade4740 1 Processor -- start 2024-08-20T01:47:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.878+0000 7fed9ade4740 1 -- start start 2024-08-20T01:47:49.881 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.878+0000 7fed9ade4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55950b4d5810 0x55950b4de290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:49.881 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.878+0000 7fed95d95640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55950b4d5810 0x55950b4de290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:49.881 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.878+0000 7fed95d95640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55950b4d5810 0x55950b4de290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:48450/0 (socket says 172.21.15.79:48450) 2024-08-20T01:47:49.881 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.879+0000 7fed95d95640 1 -- 172.21.15.79:0/1614866604 learned_addr learned my addr 172.21.15.79:0/1614866604 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.880+0000 7fed9ade4740 1 --2- 172.21.15.79:0/1614866604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55950b4d8140 0x55950b4e73a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:49.883 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.880+0000 7fed9ade4740 1 --2- 172.21.15.79:0/1614866604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55950b4dab80 0x55950b4dc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:49.883 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.880+0000 7fed9ade4740 1 -- 172.21.15.79:0/1614866604 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fed7400e500 con 0x55950b4dab80 2024-08-20T01:47:49.883 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.880+0000 7fed9ade4740 1 -- 172.21.15.79:0/1614866604 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fed740101c0 con 0x55950b4d5810 2024-08-20T01:47:49.883 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.880+0000 7fed9ade4740 1 -- 172.21.15.79:0/1614866604 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fed7400ec90 con 0x55950b4d8140 2024-08-20T01:47:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.880+0000 7fed96596640 1 --2- 172.21.15.79:0/1614866604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55950b4dab80 0x55950b4dc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.880+0000 7fed95594640 1 --2- 172.21.15.79:0/1614866604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55950b4d8140 0x55950b4e73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.880+0000 7fed95d95640 1 -- 172.21.15.79:0/1614866604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55950b4d8140 msgr2=0x55950b4e73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.880+0000 7fed95d95640 1 --2- 172.21.15.79:0/1614866604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55950b4d8140 0x55950b4e73a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.880+0000 7fed95d95640 1 -- 172.21.15.79:0/1614866604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55950b4dab80 msgr2=0x55950b4dc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.880+0000 7fed95d95640 1 --2- 172.21.15.79:0/1614866604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55950b4dab80 0x55950b4dc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.880+0000 7fed95d95640 1 -- 172.21.15.79:0/1614866604 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55950b4d7f70 con 0x55950b4d5810 2024-08-20T01:47:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.880+0000 7fed96596640 1 --2- 172.21.15.79:0/1614866604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55950b4dab80 0x55950b4dc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:47:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.881+0000 7fed95d95640 1 --2- 172.21.15.79:0/1614866604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55950b4d5810 0x55950b4de290 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fed90000b60 tx=0x7fed90088040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76932b9f95defc7a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.881+0000 7fed7b7fe640 1 -- 172.21.15.79:0/1614866604 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed9008b040 con 0x55950b4d5810 2024-08-20T01:47:49.885 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.881+0000 7fed7b7fe640 1 -- 172.21.15.79:0/1614866604 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fed90117390 con 0x55950b4d5810 2024-08-20T01:47:49.885 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.881+0000 7fed7b7fe640 1 -- 172.21.15.79:0/1614866604 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed90113b10 con 0x55950b4d5810 2024-08-20T01:47:49.886 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.882+0000 7fed9ade4740 1 -- 172.21.15.79:0/1614866604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55950b4d5810 msgr2=0x55950b4de290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:49.886 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.882+0000 7fed9ade4740 1 --2- 172.21.15.79:0/1614866604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55950b4d5810 0x55950b4de290 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fed90000b60 tx=0x7fed90088040 comp rx=0 tx=0).stop 2024-08-20T01:47:49.886 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.883+0000 7fed9ade4740 1 -- 172.21.15.79:0/1614866604 shutdown_connections 2024-08-20T01:47:49.886 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.883+0000 7fed9ade4740 1 --2- 172.21.15.79:0/1614866604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55950b4dab80 0x55950b4dc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:49.886 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.883+0000 7fed9ade4740 1 --2- 172.21.15.79:0/1614866604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55950b4d8140 0x55950b4e73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:49.886 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.883+0000 7fed9ade4740 1 --2- 172.21.15.79:0/1614866604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55950b4d5810 0x55950b4de290 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:49.886 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.883+0000 7fed9ade4740 1 -- 172.21.15.79:0/1614866604 >> 172.21.15.79:0/1614866604 conn(0x55950b4d0960 msgr2=0x55950b4d4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:49.886 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.883+0000 7fed9ade4740 1 -- 172.21.15.79:0/1614866604 shutdown_connections 2024-08-20T01:47:49.886 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.883+0000 7fed9ade4740 1 -- 172.21.15.79:0/1614866604 wait complete. 2024-08-20T01:47:49.889 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.883+0000 7fed9ade4740 1 -- start start 2024-08-20T01:47:49.889 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.884+0000 7fed9ade4740 1 Processor -- start 2024-08-20T01:47:49.889 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.884+0000 7fed9ade4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55950b4d5810 0x55950b4e3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:49.889 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.884+0000 7fed9ade4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55950b4d8140 0x55950b4e45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:49.889 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.884+0000 7fed9ade4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55950b4dab80 0x55950b4e51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:49.889 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.884+0000 7fed9ade4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fed7400faf0 con 0x55950b4dab80 2024-08-20T01:47:49.889 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.884+0000 7fed95d95640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55950b4d5810 0x55950b4e3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:49.889 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.884+0000 7fed9ade4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fed7400f360 con 0x55950b4d5810 2024-08-20T01:47:49.889 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.884+0000 7fed9ade4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fed7400c4e0 con 0x55950b4d8140 2024-08-20T01:47:49.889 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.884+0000 7fed95d95640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55950b4d5810 0x55950b4e3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:48456/0 (socket says 172.21.15.79:48456) 2024-08-20T01:47:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.884+0000 7fed95d95640 1 -- 172.21.15.79:0/179931651 learned_addr learned my addr 172.21.15.79:0/179931651 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.884+0000 7fed95594640 1 --2- 172.21.15.79:0/179931651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55950b4d8140 0x55950b4e45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.884+0000 7fed9ade4740 10 client.0 _ll_register_callbacks cb 0x7fed8c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:47:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.885+0000 7fed96596640 1 --2- 172.21.15.79:0/179931651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55950b4dab80 0x55950b4e51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.885+0000 7fed95594640 1 -- 172.21.15.79:0/179931651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55950b4d5810 msgr2=0x55950b4e3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.885+0000 7fed95594640 1 --2- 172.21.15.79:0/179931651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55950b4d5810 0x55950b4e3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.885+0000 7fed95594640 1 -- 172.21.15.79:0/179931651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55950b4dab80 msgr2=0x55950b4e51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.885+0000 7fed95594640 1 --2- 172.21.15.79:0/179931651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55950b4dab80 0x55950b4e51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.885+0000 7fed95594640 1 -- 172.21.15.79:0/179931651 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55950b4e59e0 con 0x55950b4d8140 2024-08-20T01:47:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.885+0000 7fed96596640 1 --2- 172.21.15.79:0/179931651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55950b4dab80 0x55950b4e51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:47:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.885+0000 7fed95594640 1 --2- 172.21.15.79:0/179931651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55950b4d8140 0x55950b4e45e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fed800057c0 tx=0x7fed80005b00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40adc36b9d3d10d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.885+0000 7fed797fa640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:47:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.885+0000 7fed797fa640 1 -- 172.21.15.79:0/179931651 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8004e040 con 0x55950b4d8140 2024-08-20T01:47:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.885+0000 7fed9ade4740 1 -- 172.21.15.79:0/179931651 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed90117390 con 0x55950b4d8140 2024-08-20T01:47:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.885+0000 7fed797fa640 1 -- 172.21.15.79:0/179931651 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fed80005450 con 0x55950b4d8140 2024-08-20T01:47:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.886+0000 7fed797fa640 1 -- 172.21.15.79:0/179931651 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fed80053810 con 0x55950b4d8140 2024-08-20T01:47:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.886+0000 7fed9ade4740 10 client.27319 fetch_fsmap learned FSMap version 47 2024-08-20T01:47:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.886+0000 7fed9ade4740 1 -- 172.21.15.79:0/179931651 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55950b4e6da0 con 0x55950b4d8140 2024-08-20T01:47:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.886+0000 7fed797fa640 1 -- 172.21.15.79:0/179931651 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fed90117390 con 0x55950b4d8140 2024-08-20T01:47:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.886+0000 7fed797fa640 1 -- 172.21.15.79:0/179931651 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 47) ==== 8394+0+0 (secure 0 0 0) 0x7fed80066030 con 0x55950b4d8140 2024-08-20T01:47:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.889+0000 7fed9ade4740 10 client.27319 fetch_fsmap finished waiting for FSMap version 47 2024-08-20T01:47:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.889+0000 7fed9ade4740 10 client.27319 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:47:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.889+0000 7fed9ade4740 20 client.27319 populate_metadata read hostname 'smithi079' 2024-08-20T01:47:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.889+0000 7fed9ade4740 1 --2- 172.21.15.79:0/179931651 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55950b5556f0 0x55950b557ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.889+0000 7fed9ade4740 4 client.27319 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:47:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.889+0000 7fed9ade4740 1 -- 172.21.15.79:0/179931651 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55950b445d50 con 0x55950b5556f0 2024-08-20T01:47:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.890+0000 7fed95d95640 1 --2- 172.21.15.79:0/179931651 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55950b5556f0 0x55950b557ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.890+0000 7fed797fa640 10 client.27319 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:47:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.890+0000 7fed95d95640 1 --2- 172.21.15.79:0/179931651 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55950b5556f0 0x55950b557ae0 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de495acfcab1ae9 server_cookie=4b4a742fdcfb79b4 in_seq=0 out_seq=0 2024-08-20T01:47:49.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.914+0000 7fed797fa640 1 -- 172.21.15.79:0/179931651 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55950b445d50 con 0x55950b5556f0 2024-08-20T01:47:49.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.914+0000 7fed797fa640 10 client.27319 handle_command_reply: tid=0 2024-08-20T01:47:49.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.914+0000 7fed9ade4740 1 client.27319 shutdown 2024-08-20T01:47:49.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.914+0000 7fed9ade4740 1 -- 172.21.15.79:0/179931651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55950b4d8140 msgr2=0x55950b4e45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:49.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.914+0000 7fed9ade4740 1 --2- 172.21.15.79:0/179931651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55950b4d8140 0x55950b4e45e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fed800057c0 tx=0x7fed80005b00 comp rx=0 tx=0).stop 2024-08-20T01:47:49.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.915+0000 7fed9ade4740 1 -- 172.21.15.79:0/179931651 shutdown_connections 2024-08-20T01:47:49.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.915+0000 7fed9ade4740 1 --2- 172.21.15.79:0/179931651 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55950b5556f0 0x55950b557ae0 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:49.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.915+0000 7fed9ade4740 1 --2- 172.21.15.79:0/179931651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55950b4dab80 0x55950b4e51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:49.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.915+0000 7fed797fa640 0 client.27319 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:47:49.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.915+0000 7fed9ade4740 1 --2- 172.21.15.79:0/179931651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55950b4d8140 0x55950b4e45e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:49.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.915+0000 7fed9ade4740 1 --2- 172.21.15.79:0/179931651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55950b4d5810 0x55950b4e3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:49.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.915+0000 7fed9ade4740 1 -- 172.21.15.79:0/179931651 >> 172.21.15.79:0/179931651 conn(0x55950b4d0960 msgr2=0x55950b4dc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:49.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.915+0000 7fed9ade4740 1 -- 172.21.15.79:0/179931651 shutdown_connections 2024-08-20T01:47:49.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.915+0000 7fed9ade4740 1 -- 172.21.15.79:0/179931651 wait complete. 2024-08-20T01:47:49.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.915+0000 7fed9ade4740 20 client.27319 trim_cache size 0 max 16384 2024-08-20T01:47:49.920 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:47:49.920 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:47:49.920 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:47:49.920 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:47:49.922 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.919+0000 7fed97ff9640 1 -- 172.21.15.79:0/2403437195 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fed7c0b3c20 msgr2=0x7fed7c0b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:49.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.919+0000 7fed97ff9640 1 --2- 172.21.15.79:0/2403437195 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fed7c0b3c20 0x7fed7c0b60e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fed800095f0 tx=0x7fed8000b040 comp rx=0 tx=0).stop 2024-08-20T01:47:49.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.919+0000 7fed97ff9640 1 -- 172.21.15.79:0/2403437195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed880937a0 msgr2=0x7fed88131c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:49.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.919+0000 7fed97ff9640 1 --2- 172.21.15.79:0/2403437195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed880937a0 0x7fed88131c90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fed90065ff0 tx=0x7fed9006c350 comp rx=0 tx=0).stop 2024-08-20T01:47:49.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.919+0000 7fed97ff9640 1 -- 172.21.15.79:0/2403437195 shutdown_connections 2024-08-20T01:47:49.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.919+0000 7fed97ff9640 1 --2- 172.21.15.79:0/2403437195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed880952b0 0x7fed88132f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:49.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.920+0000 7fed97ff9640 1 --2- 172.21.15.79:0/2403437195 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fed7c0b3c20 0x7fed7c0b60e0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:49.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.920+0000 7fed97ff9640 1 --2- 172.21.15.79:0/2403437195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed880948f0 0x7fed881322e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:49.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.920+0000 7fed97ff9640 1 --2- 172.21.15.79:0/2403437195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed880937a0 0x7fed88131c90 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:49.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.920+0000 7fed97ff9640 1 -- 172.21.15.79:0/2403437195 >> 172.21.15.79:0/2403437195 conn(0x7fed8808f040 msgr2=0x7fed880a1870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:49.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.920+0000 7fed97ff9640 1 -- 172.21.15.79:0/2403437195 shutdown_connections 2024-08-20T01:47:49.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:47:49.920+0000 7fed97ff9640 1 -- 172.21.15.79:0/2403437195 wait complete. 2024-08-20T01:47:49.925 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T01:47:50.424 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:47:50.731 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:50 smithi079 ceph-mon[18656]: pgmap v662: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 27 MiB/s wr, 6.99k op/s 2024-08-20T01:47:50.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:50 smithi081 ceph-mon[22209]: pgmap v662: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 27 MiB/s wr, 6.99k op/s 2024-08-20T01:47:50.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:50 smithi175 ceph-mon[22392]: pgmap v662: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 27 MiB/s wr, 6.99k op/s 2024-08-20T01:47:51.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.051+0000 7ff109e48640 1 -- 172.21.15.79:0/2468051837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1040756f0 msgr2=0x7ff10407be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:51.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.051+0000 7ff109e48640 1 --2- 172.21.15.79:0/2468051837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1040756f0 0x7ff10407be40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc00afd0 tx=0x7ff0fc02b400 comp rx=0 tx=0).stop 2024-08-20T01:47:51.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.052+0000 7ff109e48640 1 -- 172.21.15.79:0/2468051837 shutdown_connections 2024-08-20T01:47:51.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.052+0000 7ff109e48640 1 --2- 172.21.15.79:0/2468051837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1040756f0 0x7ff10407be40 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:51.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.052+0000 7ff109e48640 1 --2- 172.21.15.79:0/2468051837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff104074d70 0x7ff1040751b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:51.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.052+0000 7ff109e48640 1 --2- 172.21.15.79:0/2468051837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff10410a0e0 0x7ff10410a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:51.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.052+0000 7ff109e48640 1 -- 172.21.15.79:0/2468051837 >> 172.21.15.79:0/2468051837 conn(0x7ff10406dcc0 msgr2=0x7ff10406e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:51.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.052+0000 7ff109e48640 1 -- 172.21.15.79:0/2468051837 shutdown_connections 2024-08-20T01:47:51.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.052+0000 7ff109e48640 1 -- 172.21.15.79:0/2468051837 wait complete. 2024-08-20T01:47:51.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.053+0000 7ff109e48640 1 Processor -- start 2024-08-20T01:47:51.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.053+0000 7ff109e48640 1 -- start start 2024-08-20T01:47:51.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.054+0000 7ff109e48640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff104074d70 0x7ff10407b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:51.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.054+0000 7ff109e48640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1040756f0 0x7ff104076be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:51.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.054+0000 7ff109e48640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff10410a0e0 0x7ff104077120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:51.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.054+0000 7ff109e48640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff1040835c0 con 0x7ff1040756f0 2024-08-20T01:47:51.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.054+0000 7ff109e48640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff104083440 con 0x7ff104074d70 2024-08-20T01:47:51.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.054+0000 7ff109e48640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff104083740 con 0x7ff10410a0e0 2024-08-20T01:47:51.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.054+0000 7ff1037fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff104074d70 0x7ff10407b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:51.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.054+0000 7ff1037fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff104074d70 0x7ff10407b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:36430/0 (socket says 172.21.15.79:36430) 2024-08-20T01:47:51.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.054+0000 7ff1037fe640 1 -- 172.21.15.79:0/383905842 learned_addr learned my addr 172.21.15.79:0/383905842 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:51.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.054+0000 7ff1037fe640 1 -- 172.21.15.79:0/383905842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff10410a0e0 msgr2=0x7ff104077120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:51.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.054+0000 7ff1037fe640 1 --2- 172.21.15.79:0/383905842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff10410a0e0 0x7ff104077120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:51.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.054+0000 7ff1037fe640 1 -- 172.21.15.79:0/383905842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1040756f0 msgr2=0x7ff104076be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:51.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.054+0000 7ff1037fe640 1 --2- 172.21.15.79:0/383905842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1040756f0 0x7ff104076be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:51.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.054+0000 7ff1037fe640 1 -- 172.21.15.79:0/383905842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff104077790 con 0x7ff104074d70 2024-08-20T01:47:51.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.055+0000 7ff1037fe640 1 --2- 172.21.15.79:0/383905842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff104074d70 0x7ff10407b960 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff0f400b4a0 tx=0x7ff0f400b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:51.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.055+0000 7ff100ff9640 1 -- 172.21.15.79:0/383905842 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f4014070 con 0x7ff104074d70 2024-08-20T01:47:51.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.055+0000 7ff100ff9640 1 -- 172.21.15.79:0/383905842 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff0f4010aa0 con 0x7ff104074d70 2024-08-20T01:47:51.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.056+0000 7ff100ff9640 1 -- 172.21.15.79:0/383905842 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f4017b80 con 0x7ff104074d70 2024-08-20T01:47:51.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.056+0000 7ff109e48640 1 -- 172.21.15.79:0/383905842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1041c5440 con 0x7ff104074d70 2024-08-20T01:47:51.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.057+0000 7ff109e48640 1 -- 172.21.15.79:0/383905842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1041c5860 con 0x7ff104074d70 2024-08-20T01:47:51.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.062+0000 7ff100ff9640 1 -- 172.21.15.79:0/383905842 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff0f4017070 con 0x7ff104074d70 2024-08-20T01:47:51.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.062+0000 7ff10c241740 1 Processor -- start 2024-08-20T01:47:51.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.062+0000 7ff10c241740 1 -- start start 2024-08-20T01:47:51.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.063+0000 7ff10c241740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e3d53d880 0x563e3d53dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:51.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.063+0000 7ff10c241740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e3d53e1a0 0x563e3d549bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:51.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.063+0000 7ff10c241740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e3d54a130 0x563e3d54c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:51.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.063+0000 7ff103fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e3d53d880 0x563e3d53dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:51.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.063+0000 7ff103fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e3d53d880 0x563e3d53dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:46072/0 (socket says 172.21.15.79:46072) 2024-08-20T01:47:51.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.063+0000 7ff103fff640 1 -- 172.21.15.79:0/4035058711 learned_addr learned my addr 172.21.15.79:0/4035058711 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:51.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.063+0000 7ff102ffd640 1 --2- 172.21.15.79:0/4035058711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e3d54a130 0x563e3d54c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:51.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.063+0000 7ff10c241740 1 -- 172.21.15.79:0/4035058711 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563e3d4b4930 con 0x563e3d53e1a0 2024-08-20T01:47:51.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.063+0000 7ff10c241740 1 -- 172.21.15.79:0/4035058711 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563e3d4a3e30 con 0x563e3d54a130 2024-08-20T01:47:51.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.063+0000 7ff10c241740 1 -- 172.21.15.79:0/4035058711 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563e3d4a7e70 con 0x563e3d53d880 2024-08-20T01:47:51.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.063+0000 7ff100ff9640 1 --2- 172.21.15.79:0/383905842 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff0ec0b3db0 0x7ff0ec0b6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:51.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.064+0000 7ff100ff9640 1 -- 172.21.15.79:0/383905842 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff0f40e2f90 con 0x7ff104074d70 2024-08-20T01:47:51.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.064+0000 7ff103fff640 1 --2- 172.21.15.79:0/383905842 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff0ec0b3db0 0x7ff0ec0b6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:51.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.064+0000 7ff103fff640 1 -- 172.21.15.79:0/4035058711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e3d54a130 msgr2=0x563e3d54c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:51.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.064+0000 7ff103fff640 1 --2- 172.21.15.79:0/4035058711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e3d54a130 0x563e3d54c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:51.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.065+0000 7ff103fff640 1 -- 172.21.15.79:0/4035058711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e3d53e1a0 msgr2=0x563e3d549bf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:47:51.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.065+0000 7ff103fff640 1 --2- 172.21.15.79:0/4035058711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e3d53e1a0 0x563e3d549bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:51.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.065+0000 7ff103fff640 1 -- 172.21.15.79:0/4035058711 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e3d203650 con 0x563e3d53d880 2024-08-20T01:47:51.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.065+0000 7ff102ffd640 1 --2- 172.21.15.79:0/4035058711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e3d54a130 0x563e3d54c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:47:51.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.065+0000 7ff103fff640 1 --2- 172.21.15.79:0/4035058711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e3d53d880 0x563e3d53dc60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc032760 tx=0x7ff0fc032790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b9aa1259b2b7224 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:51.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.065+0000 7ff103fff640 1 --2- 172.21.15.79:0/383905842 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff0ec0b3db0 0x7ff0ec0b6270 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc041000 tx=0x7ff0fc044000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:51.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.065+0000 7ff0e9ffb640 1 -- 172.21.15.79:0/4035058711 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc037050 con 0x563e3d53d880 2024-08-20T01:47:51.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.066+0000 7ff0e9ffb640 1 -- 172.21.15.79:0/4035058711 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff0fc038040 con 0x563e3d53d880 2024-08-20T01:47:51.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.066+0000 7ff0e9ffb640 1 -- 172.21.15.79:0/4035058711 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc037050 con 0x563e3d53d880 2024-08-20T01:47:51.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.066+0000 7ff10c241740 1 -- 172.21.15.79:0/4035058711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e3d53d880 msgr2=0x563e3d53dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:51.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.066+0000 7ff10c241740 1 --2- 172.21.15.79:0/4035058711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e3d53d880 0x563e3d53dc60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc032760 tx=0x7ff0fc032790 comp rx=0 tx=0).stop 2024-08-20T01:47:51.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.067+0000 7ff10c241740 1 -- 172.21.15.79:0/4035058711 shutdown_connections 2024-08-20T01:47:51.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.067+0000 7ff10c241740 1 --2- 172.21.15.79:0/4035058711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e3d54a130 0x563e3d54c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:51.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.067+0000 7ff10c241740 1 --2- 172.21.15.79:0/4035058711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e3d53e1a0 0x563e3d549bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:51.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.067+0000 7ff10c241740 1 --2- 172.21.15.79:0/4035058711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e3d53d880 0x563e3d53dc60 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:51.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.067+0000 7ff10c241740 1 -- 172.21.15.79:0/4035058711 >> 172.21.15.79:0/4035058711 conn(0x563e3d53b6b0 msgr2=0x563e3d53c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:51.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.068+0000 7ff10c241740 1 -- 172.21.15.79:0/4035058711 shutdown_connections 2024-08-20T01:47:51.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.068+0000 7ff10c241740 1 -- 172.21.15.79:0/4035058711 wait complete. 2024-08-20T01:47:51.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.068+0000 7ff10c241740 1 -- start start 2024-08-20T01:47:51.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.068+0000 7ff10c241740 1 Processor -- start 2024-08-20T01:47:51.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.069+0000 7ff10c241740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e3d53d880 0x563e3d547110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:51.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.069+0000 7ff10c241740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e3d53e1a0 0x563e3d547650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:51.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.069+0000 7ff10c241740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e3d54a130 0x563e3d547b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:51.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.069+0000 7ff10c241740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563e3d306700 con 0x563e3d53e1a0 2024-08-20T01:47:51.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.069+0000 7ff10c241740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563e3d42a810 con 0x563e3d54a130 2024-08-20T01:47:51.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.069+0000 7ff1037fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e3d53d880 0x563e3d547110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:51.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.069+0000 7ff1037fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e3d53d880 0x563e3d547110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:46086/0 (socket says 172.21.15.79:46086) 2024-08-20T01:47:51.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.069+0000 7ff1037fe640 1 -- 172.21.15.79:0/143775399 learned_addr learned my addr 172.21.15.79:0/143775399 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:51.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.069+0000 7ff10c241740 1 -- 172.21.15.79:0/143775399 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563e3d54cd80 con 0x563e3d53d880 2024-08-20T01:47:51.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.069+0000 7ff10c241740 10 client.0 _ll_register_callbacks cb 0x563e3d49d700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:47:51.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.069+0000 7ff102ffd640 1 --2- 172.21.15.79:0/143775399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e3d53e1a0 0x563e3d547650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:51.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.069+0000 7ff1037fe640 1 -- 172.21.15.79:0/143775399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e3d54a130 msgr2=0x563e3d547b90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:47:51.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.069+0000 7ff1037fe640 1 --2- 172.21.15.79:0/143775399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e3d54a130 0x563e3d547b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:51.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.069+0000 7ff1037fe640 1 -- 172.21.15.79:0/143775399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e3d53e1a0 msgr2=0x563e3d547650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:51.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.069+0000 7ff1037fe640 1 --2- 172.21.15.79:0/143775399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e3d53e1a0 0x563e3d547650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:51.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.069+0000 7ff1037fe640 1 -- 172.21.15.79:0/143775399 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e3d5561e0 con 0x563e3d53d880 2024-08-20T01:47:51.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.069+0000 7ff10c241740 1 -- 172.21.15.79:0/143775399 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563e3d453150 con 0x563e3d53d880 2024-08-20T01:47:51.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.069+0000 7ff102ffd640 1 --2- 172.21.15.79:0/143775399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e3d53e1a0 0x563e3d547650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:47:51.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.070+0000 7ff1037fe640 1 --2- 172.21.15.79:0/143775399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e3d53d880 0x563e3d547110 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff0f40a9e20 tx=0x7ff0f40a9af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5dbd5df37fd229a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:51.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.070+0000 7ff0e77f6640 10 client.27325 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:47:51.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.070+0000 7ff0e77f6640 1 -- 172.21.15.79:0/143775399 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f40b2f40 con 0x563e3d53d880 2024-08-20T01:47:51.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.070+0000 7ff0e77f6640 1 -- 172.21.15.79:0/143775399 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff0f4010c50 con 0x563e3d53d880 2024-08-20T01:47:51.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.070+0000 7ff0e77f6640 1 -- 172.21.15.79:0/143775399 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7ff0f4017d20 con 0x563e3d53d880 2024-08-20T01:47:51.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.070+0000 7ff10c241740 10 client.27325 fetch_fsmap learned FSMap version 47 2024-08-20T01:47:51.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.070+0000 7ff10c241740 1 -- 172.21.15.79:0/143775399 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({fsmap=47}) -- 0x563e3d558b40 con 0x563e3d53d880 2024-08-20T01:47:51.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.071+0000 7ff0e77f6640 1 -- 172.21.15.79:0/143775399 <== mon.1 v2:172.21.15.175:3300/0 4 ==== fsmap(e 47) ==== 8394+0+0 (secure 0 0 0) 0x7ff0f40a6120 con 0x563e3d53d880 2024-08-20T01:47:51.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.071+0000 7ff10c241740 10 client.27325 fetch_fsmap finished waiting for FSMap version 47 2024-08-20T01:47:51.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.071+0000 7ff10c241740 10 client.27325 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:47:51.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.071+0000 7ff10c241740 20 client.27325 populate_metadata read hostname 'smithi079' 2024-08-20T01:47:51.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.071+0000 7ff10c241740 1 --2- 172.21.15.79:0/143775399 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x563e3d559ef0 0x563e3d55c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:51.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.071+0000 7ff10c241740 4 client.27325 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:47:51.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.071+0000 7ff10c241740 1 -- 172.21.15.79:0/143775399 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563e3d4b6880 con 0x563e3d559ef0 2024-08-20T01:47:51.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.071+0000 7ff102ffd640 1 --2- 172.21.15.79:0/143775399 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x563e3d559ef0 0x563e3d55c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:51.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.072+0000 7ff0e77f6640 10 client.27325 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:47:51.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.072+0000 7ff102ffd640 1 --2- 172.21.15.79:0/143775399 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x563e3d559ef0 0x563e3d55c2e0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fcbc1b8f507e3b5c server_cookie=7b2602010c04ddda in_seq=0 out_seq=0 2024-08-20T01:47:51.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.072+0000 7ff0e77f6640 1 -- 172.21.15.79:0/143775399 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563e3d4b6880 con 0x563e3d559ef0 2024-08-20T01:47:51.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.072+0000 7ff0e77f6640 10 client.27325 handle_command_reply: tid=0 2024-08-20T01:47:51.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.072+0000 7ff10c241740 1 client.27325 shutdown 2024-08-20T01:47:51.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.073+0000 7ff10c241740 1 -- 172.21.15.79:0/143775399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e3d53d880 msgr2=0x563e3d547110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:51.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.073+0000 7ff10c241740 1 --2- 172.21.15.79:0/143775399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e3d53d880 0x563e3d547110 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff0f40a9e20 tx=0x7ff0f40a9af0 comp rx=0 tx=0).stop 2024-08-20T01:47:51.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.073+0000 7ff10c241740 1 -- 172.21.15.79:0/143775399 shutdown_connections 2024-08-20T01:47:51.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.073+0000 7ff10c241740 1 --2- 172.21.15.79:0/143775399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e3d54a130 0x563e3d547b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:51.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.073+0000 7ff10c241740 1 --2- 172.21.15.79:0/143775399 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x563e3d559ef0 0x563e3d55c2e0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:51.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.073+0000 7ff10c241740 1 --2- 172.21.15.79:0/143775399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e3d53e1a0 0x563e3d547650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:51.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.073+0000 7ff10c241740 1 --2- 172.21.15.79:0/143775399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e3d53d880 0x563e3d547110 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:51.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.073+0000 7ff10c241740 1 -- 172.21.15.79:0/143775399 >> 172.21.15.79:0/143775399 conn(0x563e3d53b6b0 msgr2=0x563e3d541250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:51.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.073+0000 7ff0e77f6640 0 client.27325 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:47:51.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.074+0000 7ff10c241740 1 -- 172.21.15.79:0/143775399 shutdown_connections 2024-08-20T01:47:51.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.074+0000 7ff10c241740 1 -- 172.21.15.79:0/143775399 wait complete. 2024-08-20T01:47:51.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.074+0000 7ff10c241740 20 client.27325 trim_cache size 0 max 16384 2024-08-20T01:47:51.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.105+0000 7ff10c241740 1 Processor -- start 2024-08-20T01:47:51.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.105+0000 7ff10c241740 1 -- start start 2024-08-20T01:47:51.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.105+0000 7ff10c241740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e3d53d880 0x563e3d546870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:51.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.105+0000 7ff10c241740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e3d53e1a0 0x563e3d561b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:51.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.105+0000 7ff10c241740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e3d54a130 0x563e3d5620b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:51.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.105+0000 7ff10c241740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff1041cdf90 con 0x563e3d53d880 2024-08-20T01:47:51.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.105+0000 7ff10c241740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff1041cfc50 con 0x563e3d53e1a0 2024-08-20T01:47:51.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.105+0000 7ff10c241740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff1041ce720 con 0x563e3d54a130 2024-08-20T01:47:51.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.106+0000 7ff102ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e3d53e1a0 0x563e3d561b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:51.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.106+0000 7ff102ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e3d53e1a0 0x563e3d561b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:36464/0 (socket says 172.21.15.79:36464) 2024-08-20T01:47:51.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.106+0000 7ff102ffd640 1 -- 172.21.15.79:0/3999141271 learned_addr learned my addr 172.21.15.79:0/3999141271 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:51.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.106+0000 7ff103fff640 1 --2- 172.21.15.79:0/3999141271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e3d54a130 0x563e3d5620b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:51.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.108+0000 7ff102ffd640 1 -- 172.21.15.79:0/3999141271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e3d54a130 msgr2=0x563e3d5620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:51.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.108+0000 7ff102ffd640 1 --2- 172.21.15.79:0/3999141271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e3d54a130 0x563e3d5620b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:51.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.108+0000 7ff102ffd640 1 -- 172.21.15.79:0/3999141271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e3d53d880 msgr2=0x563e3d546870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:51.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.108+0000 7ff102ffd640 1 --2- 172.21.15.79:0/3999141271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e3d53d880 0x563e3d546870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:51.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.108+0000 7ff102ffd640 1 -- 172.21.15.79:0/3999141271 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e3d55c650 con 0x563e3d53e1a0 2024-08-20T01:47:51.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.111+0000 7ff102ffd640 1 --2- 172.21.15.79:0/3999141271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e3d53e1a0 0x563e3d561b70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff0f80099e0 tx=0x7ff0f80090e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb471d372684f7e6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:51.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.112+0000 7ff0e97fa640 1 -- 172.21.15.79:0/3999141271 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f8021070 con 0x563e3d53e1a0 2024-08-20T01:47:51.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.112+0000 7ff0e97fa640 1 -- 172.21.15.79:0/3999141271 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff0f8015ba0 con 0x563e3d53e1a0 2024-08-20T01:47:51.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.112+0000 7ff0e97fa640 1 -- 172.21.15.79:0/3999141271 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f80133a0 con 0x563e3d53e1a0 2024-08-20T01:47:51.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.113+0000 7ff10c241740 1 -- 172.21.15.79:0/3999141271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e3d53e1a0 msgr2=0x563e3d561b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:51.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.113+0000 7ff10c241740 1 --2- 172.21.15.79:0/3999141271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e3d53e1a0 0x563e3d561b70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff0f80099e0 tx=0x7ff0f80090e0 comp rx=0 tx=0).stop 2024-08-20T01:47:51.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.113+0000 7ff10c241740 1 -- 172.21.15.79:0/3999141271 shutdown_connections 2024-08-20T01:47:51.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.113+0000 7ff10c241740 1 --2- 172.21.15.79:0/3999141271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e3d54a130 0x563e3d5620b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:51.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.113+0000 7ff10c241740 1 --2- 172.21.15.79:0/3999141271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e3d53e1a0 0x563e3d561b70 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:51.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.113+0000 7ff10c241740 1 --2- 172.21.15.79:0/3999141271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e3d53d880 0x563e3d546870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:51.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.113+0000 7ff10c241740 1 -- 172.21.15.79:0/3999141271 >> 172.21.15.79:0/3999141271 conn(0x563e3d53b6b0 msgr2=0x563e3d548f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:51.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.114+0000 7ff10c241740 1 -- 172.21.15.79:0/3999141271 shutdown_connections 2024-08-20T01:47:51.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.114+0000 7ff10c241740 1 -- 172.21.15.79:0/3999141271 wait complete. 2024-08-20T01:47:51.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.115+0000 7ff10c241740 1 -- start start 2024-08-20T01:47:51.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.115+0000 7ff10c241740 1 Processor -- start 2024-08-20T01:47:51.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.116+0000 7ff10c241740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e3d53d880 0x563e3d54d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:51.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.116+0000 7ff10c241740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e3d53e1a0 0x563e3d54dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:51.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.116+0000 7ff10c241740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e3d54a130 0x563e3d5c2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:51.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.116+0000 7ff10c241740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff1041cf580 con 0x563e3d53e1a0 2024-08-20T01:47:51.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.116+0000 7ff10c241740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff1041cedf0 con 0x563e3d54a130 2024-08-20T01:47:51.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.116+0000 7ff10c241740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff1041cbf70 con 0x563e3d53d880 2024-08-20T01:47:51.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.116+0000 7ff10c241740 10 client.0 _ll_register_callbacks cb 0x7ff0f40a5dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:47:51.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.118+0000 7ff1037fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e3d53d880 0x563e3d54d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:51.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.118+0000 7ff103fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e3d54a130 0x563e3d5c2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:51.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.119+0000 7ff102ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e3d53e1a0 0x563e3d54dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:51.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.119+0000 7ff103fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e3d54a130 0x563e3d5c2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:36466/0 (socket says 172.21.15.79:36466) 2024-08-20T01:47:51.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.119+0000 7ff103fff640 1 -- 172.21.15.79:0/1143679172 learned_addr learned my addr 172.21.15.79:0/1143679172 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:51.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.119+0000 7ff103fff640 1 -- 172.21.15.79:0/1143679172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e3d53d880 msgr2=0x563e3d54d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:51.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.119+0000 7ff103fff640 1 --2- 172.21.15.79:0/1143679172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e3d53d880 0x563e3d54d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:51.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.119+0000 7ff103fff640 1 -- 172.21.15.79:0/1143679172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e3d53e1a0 msgr2=0x563e3d54dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:51.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.119+0000 7ff103fff640 1 --2- 172.21.15.79:0/1143679172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e3d53e1a0 0x563e3d54dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:51.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.119+0000 7ff103fff640 1 -- 172.21.15.79:0/1143679172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e3d5c3220 con 0x563e3d54a130 2024-08-20T01:47:51.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.120+0000 7ff103fff640 1 --2- 172.21.15.79:0/1143679172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e3d54a130 0x563e3d5c2b30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc030040 tx=0x7ff0fc0073d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d28e44a3aa42ea3a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:51.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.120+0000 7ff0e77f6640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:47:51.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.120+0000 7ff0e77f6640 1 -- 172.21.15.79:0/1143679172 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc037040 con 0x563e3d54a130 2024-08-20T01:47:51.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.120+0000 7ff0e77f6640 1 -- 172.21.15.79:0/1143679172 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff0fc051680 con 0x563e3d54a130 2024-08-20T01:47:51.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.120+0000 7ff10c241740 1 -- 172.21.15.79:0/1143679172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0f8015ba0 con 0x563e3d54a130 2024-08-20T01:47:51.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.121+0000 7ff0e77f6640 1 -- 172.21.15.79:0/1143679172 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7ff0fc032400 con 0x563e3d54a130 2024-08-20T01:47:51.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.121+0000 7ff10c241740 10 client.27344 fetch_fsmap learned FSMap version 47 2024-08-20T01:47:51.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.121+0000 7ff10c241740 1 -- 172.21.15.79:0/1143679172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x563e3d5c4500 con 0x563e3d54a130 2024-08-20T01:47:51.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.125+0000 7ff0e77f6640 1 -- 172.21.15.79:0/1143679172 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff0fc051d10 con 0x563e3d54a130 2024-08-20T01:47:51.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.126+0000 7ff0e77f6640 1 -- 172.21.15.79:0/1143679172 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 47) ==== 8394+0+0 (secure 0 0 0) 0x7ff0fc05ca60 con 0x563e3d54a130 2024-08-20T01:47:51.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.126+0000 7ff10c241740 10 client.27344 fetch_fsmap finished waiting for FSMap version 47 2024-08-20T01:47:51.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.126+0000 7ff10c241740 10 client.27344 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:47:51.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.127+0000 7ff10c241740 20 client.27344 populate_metadata read hostname 'smithi079' 2024-08-20T01:47:51.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.127+0000 7ff10c241740 1 --2- 172.21.15.79:0/1143679172 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x563e3d5c48b0 0x563e3d5c6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:51.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.127+0000 7ff10c241740 4 client.27344 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:47:51.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.127+0000 7ff10c241740 1 -- 172.21.15.79:0/1143679172 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7ff0f8015ba0 con 0x563e3d5c48b0 2024-08-20T01:47:51.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.128+0000 7ff1037fe640 1 --2- 172.21.15.79:0/1143679172 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x563e3d5c48b0 0x563e3d5c6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:51.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.129+0000 7ff1037fe640 1 --2- 172.21.15.79:0/1143679172 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x563e3d5c48b0 0x563e3d5c6cd0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=71f8a0e0ac331f8b server_cookie=a1fc71d3013b16b in_seq=0 out_seq=0 2024-08-20T01:47:51.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.131+0000 7ff0e77f6640 10 client.27344 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:47:51.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.131+0000 7ff0e77f6640 1 -- 172.21.15.79:0/1143679172 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7ff0f8015ba0 con 0x563e3d5c48b0 2024-08-20T01:47:51.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.131+0000 7ff0e77f6640 10 client.27344 handle_command_reply: tid=0 2024-08-20T01:47:51.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.131+0000 7ff10c241740 1 client.27344 shutdown 2024-08-20T01:47:51.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.131+0000 7ff10c241740 1 -- 172.21.15.79:0/1143679172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e3d54a130 msgr2=0x563e3d5c2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:51.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.131+0000 7ff10c241740 1 --2- 172.21.15.79:0/1143679172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e3d54a130 0x563e3d5c2b30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc030040 tx=0x7ff0fc0073d0 comp rx=0 tx=0).stop 2024-08-20T01:47:51.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.135+0000 7ff10c241740 1 -- 172.21.15.79:0/1143679172 shutdown_connections 2024-08-20T01:47:51.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.135+0000 7ff10c241740 1 --2- 172.21.15.79:0/1143679172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e3d54a130 0x563e3d5c2b30 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:51.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.135+0000 7ff10c241740 1 --2- 172.21.15.79:0/1143679172 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x563e3d5c48b0 0x563e3d5c6cd0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:51.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.135+0000 7ff10c241740 1 --2- 172.21.15.79:0/1143679172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e3d53e1a0 0x563e3d54dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:51.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.135+0000 7ff0e77f6640 0 client.27344 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:47:51.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.135+0000 7ff10c241740 1 --2- 172.21.15.79:0/1143679172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e3d53d880 0x563e3d54d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:51.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.135+0000 7ff10c241740 1 -- 172.21.15.79:0/1143679172 >> 172.21.15.79:0/1143679172 conn(0x563e3d53b6b0 msgr2=0x563e3d540970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:51.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.136+0000 7ff10c241740 1 -- 172.21.15.79:0/1143679172 shutdown_connections 2024-08-20T01:47:51.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.136+0000 7ff10c241740 1 -- 172.21.15.79:0/1143679172 wait complete. 2024-08-20T01:47:51.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.136+0000 7ff10c241740 20 client.27344 trim_cache size 0 max 16384 2024-08-20T01:47:51.139 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:47:51.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.137+0000 7ff109e48640 1 -- 172.21.15.79:0/383905842 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff0ec0b3db0 msgr2=0x7ff0ec0b6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:51.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.137+0000 7ff109e48640 1 --2- 172.21.15.79:0/383905842 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff0ec0b3db0 0x7ff0ec0b6270 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc041000 tx=0x7ff0fc044000 comp rx=0 tx=0).stop 2024-08-20T01:47:51.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.137+0000 7ff109e48640 1 -- 172.21.15.79:0/383905842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff104074d70 msgr2=0x7ff10407b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:51.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.137+0000 7ff109e48640 1 --2- 172.21.15.79:0/383905842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff104074d70 0x7ff10407b960 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff0f400b4a0 tx=0x7ff0f400b960 comp rx=0 tx=0).stop 2024-08-20T01:47:51.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.137+0000 7ff109e48640 1 -- 172.21.15.79:0/383905842 shutdown_connections 2024-08-20T01:47:51.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.137+0000 7ff109e48640 1 --2- 172.21.15.79:0/383905842 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff0ec0b3db0 0x7ff0ec0b6270 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:51.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.137+0000 7ff109e48640 1 --2- 172.21.15.79:0/383905842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff10410a0e0 0x7ff104077120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:51.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.137+0000 7ff109e48640 1 --2- 172.21.15.79:0/383905842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1040756f0 0x7ff104076be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:51.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.137+0000 7ff109e48640 1 --2- 172.21.15.79:0/383905842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff104074d70 0x7ff10407b960 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:51.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.137+0000 7ff109e48640 1 -- 172.21.15.79:0/383905842 >> 172.21.15.79:0/383905842 conn(0x7ff10406dcc0 msgr2=0x7ff10410cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:51.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.138+0000 7ff109e48640 1 -- 172.21.15.79:0/383905842 shutdown_connections 2024-08-20T01:47:51.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:51.138+0000 7ff109e48640 1 -- 172.21.15.79:0/383905842 wait complete. 2024-08-20T01:47:52.015 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T01:47:52.442 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:47:52.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:52 smithi081 ceph-mon[22209]: pgmap v663: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 6.48k op/s 2024-08-20T01:47:52.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:52 smithi175 ceph-mon[22392]: pgmap v663: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 6.48k op/s 2024-08-20T01:47:52.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:52 smithi079 ceph-mon[18656]: pgmap v663: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 6.48k op/s 2024-08-20T01:47:54.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:54 smithi081 ceph-mon[22209]: pgmap v664: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 24 MiB/s wr, 6.10k op/s 2024-08-20T01:47:54.801 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:54 smithi079 ceph-mon[18656]: pgmap v664: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 24 MiB/s wr, 6.10k op/s 2024-08-20T01:47:54.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:54 smithi175 ceph-mon[22392]: pgmap v664: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 24 MiB/s wr, 6.10k op/s 2024-08-20T01:47:55.864 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:47:55.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.927+0000 7f4639d2c640 1 -- 172.21.15.79:0/1610913808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4634106380 msgr2=0x7f46341067c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:55.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.927+0000 7f4639d2c640 1 --2- 172.21.15.79:0/1610913808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4634106380 0x7f46341067c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4624009900 tx=0x7f462402a400 comp rx=0 tx=0).stop 2024-08-20T01:47:55.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.928+0000 7f4639d2c640 1 -- 172.21.15.79:0/1610913808 shutdown_connections 2024-08-20T01:47:55.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.928+0000 7f4639d2c640 1 --2- 172.21.15.79:0/1610913808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4634106d00 0x7f4634107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:55.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.928+0000 7f4639d2c640 1 --2- 172.21.15.79:0/1610913808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4634106380 0x7f46341067c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:55.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.928+0000 7f4639d2c640 1 --2- 172.21.15.79:0/1610913808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4634101590 0x7f4634101970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:55.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.928+0000 7f4639d2c640 1 -- 172.21.15.79:0/1610913808 >> 172.21.15.79:0/1610913808 conn(0x7f4634076bd0 msgr2=0x7f4634076fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:55.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.928+0000 7f4639d2c640 1 -- 172.21.15.79:0/1610913808 shutdown_connections 2024-08-20T01:47:55.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.928+0000 7f4639d2c640 1 -- 172.21.15.79:0/1610913808 wait complete. 2024-08-20T01:47:55.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.928+0000 7f4639d2c640 1 Processor -- start 2024-08-20T01:47:55.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.929+0000 7f4639d2c640 1 -- start start 2024-08-20T01:47:55.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.929+0000 7f4639d2c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4634101590 0x7f463419f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:55.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.929+0000 7f4639d2c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4634106380 0x7f463419fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:55.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.929+0000 7f4639d2c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4634106d00 0x7f46341a4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:55.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.929+0000 7f4639d2c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4634118fb0 con 0x7f4634106380 2024-08-20T01:47:55.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.929+0000 7f4639d2c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4634118e30 con 0x7f4634106d00 2024-08-20T01:47:55.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.929+0000 7f4639d2c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4634119130 con 0x7f4634101590 2024-08-20T01:47:55.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.929+0000 7f4633fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4634106d00 0x7f46341a4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:55.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.929+0000 7f4633fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4634106d00 0x7f46341a4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:36480/0 (socket says 172.21.15.79:36480) 2024-08-20T01:47:55.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.929+0000 7f4633fff640 1 -- 172.21.15.79:0/882738734 learned_addr learned my addr 172.21.15.79:0/882738734 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:55.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.929+0000 7f46337fe640 1 --2- 172.21.15.79:0/882738734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4634101590 0x7f463419f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:55.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.930+0000 7f46337fe640 1 -- 172.21.15.79:0/882738734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4634106d00 msgr2=0x7f46341a4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:55.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.930+0000 7f46337fe640 1 --2- 172.21.15.79:0/882738734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4634106d00 0x7f46341a4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:55.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.930+0000 7f46337fe640 1 -- 172.21.15.79:0/882738734 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4634106380 msgr2=0x7f463419fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:55.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.930+0000 7f46337fe640 1 --2- 172.21.15.79:0/882738734 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4634106380 0x7f463419fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:55.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.930+0000 7f46337fe640 1 -- 172.21.15.79:0/882738734 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46341a56f0 con 0x7f4634101590 2024-08-20T01:47:55.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.930+0000 7f4633fff640 1 --2- 172.21.15.79:0/882738734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4634106d00 0x7f46341a4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:47:55.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.930+0000 7f46337fe640 1 --2- 172.21.15.79:0/882738734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4634101590 0x7f463419f640 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f462800e9f0 tx=0x7f462800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:55.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.931+0000 7f4630ff9640 1 -- 172.21.15.79:0/882738734 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f462800ccc0 con 0x7f4634101590 2024-08-20T01:47:55.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.931+0000 7f4639d2c640 1 -- 172.21.15.79:0/882738734 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46341a59e0 con 0x7f4634101590 2024-08-20T01:47:55.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.931+0000 7f4630ff9640 1 -- 172.21.15.79:0/882738734 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f46280108c0 con 0x7f4634101590 2024-08-20T01:47:55.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.931+0000 7f4630ff9640 1 -- 172.21.15.79:0/882738734 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46280187c0 con 0x7f4634101590 2024-08-20T01:47:55.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.931+0000 7f4639d2c640 1 -- 172.21.15.79:0/882738734 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46341ac270 con 0x7f4634101590 2024-08-20T01:47:55.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.934+0000 7f463c125740 1 Processor -- start 2024-08-20T01:47:55.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.935+0000 7f4630ff9640 1 -- 172.21.15.79:0/882738734 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f4628010430 con 0x7f4634101590 2024-08-20T01:47:55.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.935+0000 7f463c125740 1 -- start start 2024-08-20T01:47:55.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.935+0000 7f463c125740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ddf9df880 0x558ddf9dfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:55.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.935+0000 7f463c125740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ddf9e01a0 0x558ddf9ebbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:55.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.935+0000 7f463c125740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ddf9ec130 0x558ddf9ee520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:55.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.935+0000 7f463c125740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558ddf956930 con 0x558ddf9e01a0 2024-08-20T01:47:55.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.935+0000 7f463c125740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558ddf945e30 con 0x558ddf9ec130 2024-08-20T01:47:55.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.935+0000 7f463c125740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558ddf949e70 con 0x558ddf9df880 2024-08-20T01:47:55.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.936+0000 7f4633fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ddf9df880 0x558ddf9dfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:55.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.936+0000 7f4633fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ddf9df880 0x558ddf9dfc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:46126/0 (socket says 172.21.15.79:46126) 2024-08-20T01:47:55.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.936+0000 7f4633fff640 1 -- 172.21.15.79:0/2599676929 learned_addr learned my addr 172.21.15.79:0/2599676929 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:55.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.936+0000 7f46337fe640 1 --2- 172.21.15.79:0/2599676929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ddf9e01a0 0x558ddf9ebbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:55.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.936+0000 7f4632ffd640 1 --2- 172.21.15.79:0/2599676929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ddf9ec130 0x558ddf9ee520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:55.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.936+0000 7f4632ffd640 1 -- 172.21.15.79:0/2599676929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ddf9df880 msgr2=0x558ddf9dfc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:55.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.936+0000 7f4632ffd640 1 --2- 172.21.15.79:0/2599676929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ddf9df880 0x558ddf9dfc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:55.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.936+0000 7f4632ffd640 1 -- 172.21.15.79:0/2599676929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ddf9e01a0 msgr2=0x558ddf9ebbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:55.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.936+0000 7f4632ffd640 1 --2- 172.21.15.79:0/2599676929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ddf9e01a0 0x558ddf9ebbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:55.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.936+0000 7f4632ffd640 1 -- 172.21.15.79:0/2599676929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ddf6a5650 con 0x558ddf9ec130 2024-08-20T01:47:55.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.936+0000 7f4633fff640 1 --2- 172.21.15.79:0/2599676929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ddf9df880 0x558ddf9dfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:47:55.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.937+0000 7f4630ff9640 1 --2- 172.21.15.79:0/882738734 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f461c0b3cd0 0x7f461c0b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:55.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.937+0000 7f4632ffd640 1 --2- 172.21.15.79:0/2599676929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ddf9ec130 0x558ddf9ee520 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f462402a920 tx=0x7f4624004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20e8ce99a504e9ed server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:55.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.937+0000 7f4630ff9640 1 -- 172.21.15.79:0/882738734 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f46280e3f40 con 0x7f4634101590 2024-08-20T01:47:55.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.937+0000 7f4633fff640 1 --2- 172.21.15.79:0/882738734 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f461c0b3cd0 0x7f461c0b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:55.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.938+0000 7f4619ffb640 1 -- 172.21.15.79:0/2599676929 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f462403e030 con 0x558ddf9ec130 2024-08-20T01:47:55.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.938+0000 7f4619ffb640 1 -- 172.21.15.79:0/2599676929 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f46240054b0 con 0x558ddf9ec130 2024-08-20T01:47:55.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.938+0000 7f4619ffb640 1 -- 172.21.15.79:0/2599676929 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4624035040 con 0x558ddf9ec130 2024-08-20T01:47:55.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.938+0000 7f463c125740 1 -- 172.21.15.79:0/2599676929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ddf9ec130 msgr2=0x558ddf9ee520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:55.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.938+0000 7f4633fff640 1 --2- 172.21.15.79:0/882738734 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f461c0b3cd0 0x7f461c0b6190 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f462c009500 tx=0x7f462c00b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:55.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.938+0000 7f463c125740 1 --2- 172.21.15.79:0/2599676929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ddf9ec130 0x558ddf9ee520 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f462402a920 tx=0x7f4624004040 comp rx=0 tx=0).stop 2024-08-20T01:47:55.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.939+0000 7f463c125740 1 -- 172.21.15.79:0/2599676929 shutdown_connections 2024-08-20T01:47:55.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.939+0000 7f463c125740 1 --2- 172.21.15.79:0/2599676929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ddf9ec130 0x558ddf9ee520 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:55.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.939+0000 7f463c125740 1 --2- 172.21.15.79:0/2599676929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ddf9e01a0 0x558ddf9ebbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:55.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.939+0000 7f463c125740 1 --2- 172.21.15.79:0/2599676929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ddf9df880 0x558ddf9dfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:55.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.939+0000 7f463c125740 1 -- 172.21.15.79:0/2599676929 >> 172.21.15.79:0/2599676929 conn(0x558ddf9dd6b0 msgr2=0x558ddf9de850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:55.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.939+0000 7f463c125740 1 -- 172.21.15.79:0/2599676929 shutdown_connections 2024-08-20T01:47:55.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.939+0000 7f463c125740 1 -- 172.21.15.79:0/2599676929 wait complete. 2024-08-20T01:47:55.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.940+0000 7f463c125740 1 -- start start 2024-08-20T01:47:55.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.940+0000 7f463c125740 1 Processor -- start 2024-08-20T01:47:55.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.941+0000 7f463c125740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ddf9df880 0x558ddf9e90e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:55.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.941+0000 7f463c125740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ddf9e01a0 0x558ddf9e9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:55.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.941+0000 7f463c125740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ddf9ec130 0x558ddf9e9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:55.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.941+0000 7f463c125740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558ddf7a8700 con 0x558ddf9e01a0 2024-08-20T01:47:55.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.941+0000 7f463c125740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558ddf8cc810 con 0x558ddf9ec130 2024-08-20T01:47:55.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.941+0000 7f463c125740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558ddf9eed80 con 0x558ddf9df880 2024-08-20T01:47:55.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.941+0000 7f463c125740 10 client.0 _ll_register_callbacks cb 0x558ddf93f700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:47:55.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.941+0000 7f46337fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ddf9df880 0x558ddf9e90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:55.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.941+0000 7f4633fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ddf9ec130 0x558ddf9e9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:55.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.941+0000 7f46337fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ddf9df880 0x558ddf9e90e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:46142/0 (socket says 172.21.15.79:46142) 2024-08-20T01:47:55.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.941+0000 7f46337fe640 1 -- 172.21.15.79:0/538593769 learned_addr learned my addr 172.21.15.79:0/538593769 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:55.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.941+0000 7f4632ffd640 1 --2- 172.21.15.79:0/538593769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ddf9e01a0 0x558ddf9e9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:55.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.941+0000 7f4633fff640 1 -- 172.21.15.79:0/538593769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ddf9df880 msgr2=0x558ddf9e90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:55.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.941+0000 7f4633fff640 1 --2- 172.21.15.79:0/538593769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ddf9df880 0x558ddf9e90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:55.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.941+0000 7f4633fff640 1 -- 172.21.15.79:0/538593769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ddf9e01a0 msgr2=0x558ddf9e9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:55.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.941+0000 7f4633fff640 1 --2- 172.21.15.79:0/538593769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ddf9e01a0 0x558ddf9e9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:55.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.941+0000 7f4633fff640 1 -- 172.21.15.79:0/538593769 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ddf9f8160 con 0x558ddf9ec130 2024-08-20T01:47:55.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.942+0000 7f4632ffd640 1 --2- 172.21.15.79:0/538593769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ddf9e01a0 0x558ddf9e9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:47:55.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.942+0000 7f4633fff640 1 --2- 172.21.15.79:0/538593769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ddf9ec130 0x558ddf9e9b60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f462c007740 tx=0x7f462c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=286593b0a7f0af41 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:55.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.942+0000 7f4612ffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:47:55.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.942+0000 7f4612ffd640 1 -- 172.21.15.79:0/538593769 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f462c01b070 con 0x558ddf9ec130 2024-08-20T01:47:55.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.942+0000 7f4612ffd640 1 -- 172.21.15.79:0/538593769 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f462c015820 con 0x558ddf9ec130 2024-08-20T01:47:55.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.942+0000 7f463c125740 1 -- 172.21.15.79:0/538593769 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558ddf8f5150 con 0x558ddf9ec130 2024-08-20T01:47:55.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.943+0000 7f4612ffd640 1 -- 172.21.15.79:0/538593769 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f462c015a20 con 0x558ddf9ec130 2024-08-20T01:47:55.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.943+0000 7f463c125740 10 client.27356 fetch_fsmap learned FSMap version 47 2024-08-20T01:47:55.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.943+0000 7f463c125740 1 -- 172.21.15.79:0/538593769 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x558ddf9fab50 con 0x558ddf9ec130 2024-08-20T01:47:55.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.943+0000 7f4612ffd640 1 -- 172.21.15.79:0/538593769 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x558ddf8f5150 con 0x558ddf9ec130 2024-08-20T01:47:55.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.943+0000 7f4612ffd640 1 -- 172.21.15.79:0/538593769 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 47) ==== 8394+0+0 (secure 0 0 0) 0x7f462c02b400 con 0x558ddf9ec130 2024-08-20T01:47:55.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.943+0000 7f463c125740 10 client.27356 fetch_fsmap finished waiting for FSMap version 47 2024-08-20T01:47:55.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.943+0000 7f463c125740 10 client.27356 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:47:55.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.943+0000 7f463c125740 20 client.27356 populate_metadata read hostname 'smithi079' 2024-08-20T01:47:55.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.943+0000 7f463c125740 1 --2- 172.21.15.79:0/538593769 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x558ddf9fc0e0 0x558ddf9fe560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:55.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.943+0000 7f463c125740 4 client.27356 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:47:55.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.943+0000 7f463c125740 1 -- 172.21.15.79:0/538593769 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ddf958880 con 0x558ddf9fc0e0 2024-08-20T01:47:55.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.944+0000 7f46337fe640 1 --2- 172.21.15.79:0/538593769 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x558ddf9fc0e0 0x558ddf9fe560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:55.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.944+0000 7f4612ffd640 10 client.27356 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:47:55.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.944+0000 7f46337fe640 1 --2- 172.21.15.79:0/538593769 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x558ddf9fc0e0 0x558ddf9fe560 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a720a033016b205d server_cookie=960c047185c1c2c3 in_seq=0 out_seq=0 2024-08-20T01:47:55.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.945+0000 7f4612ffd640 1 -- 172.21.15.79:0/538593769 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558ddf958880 con 0x558ddf9fc0e0 2024-08-20T01:47:55.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.945+0000 7f4612ffd640 10 client.27356 handle_command_reply: tid=0 2024-08-20T01:47:55.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.945+0000 7f463c125740 1 client.27356 shutdown 2024-08-20T01:47:55.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.945+0000 7f463c125740 1 -- 172.21.15.79:0/538593769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ddf9ec130 msgr2=0x558ddf9e9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:55.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.945+0000 7f463c125740 1 --2- 172.21.15.79:0/538593769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ddf9ec130 0x558ddf9e9b60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f462c007740 tx=0x7f462c004a40 comp rx=0 tx=0).stop 2024-08-20T01:47:55.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.946+0000 7f463c125740 1 -- 172.21.15.79:0/538593769 shutdown_connections 2024-08-20T01:47:55.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.946+0000 7f463c125740 1 --2- 172.21.15.79:0/538593769 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x558ddf9fc0e0 0x558ddf9fe560 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:55.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.946+0000 7f463c125740 1 --2- 172.21.15.79:0/538593769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ddf9ec130 0x558ddf9e9b60 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:55.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.946+0000 7f463c125740 1 --2- 172.21.15.79:0/538593769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ddf9e01a0 0x558ddf9e9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:55.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.946+0000 7f4612ffd640 0 client.27356 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:47:55.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.946+0000 7f463c125740 1 --2- 172.21.15.79:0/538593769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ddf9df880 0x558ddf9e90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:55.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.946+0000 7f463c125740 1 -- 172.21.15.79:0/538593769 >> 172.21.15.79:0/538593769 conn(0x558ddf9dd6b0 msgr2=0x558ddf9e3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:55.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.946+0000 7f463c125740 1 -- 172.21.15.79:0/538593769 shutdown_connections 2024-08-20T01:47:55.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.946+0000 7f463c125740 1 -- 172.21.15.79:0/538593769 wait complete. 2024-08-20T01:47:55.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.946+0000 7f463c125740 20 client.27356 trim_cache size 0 max 16384 2024-08-20T01:47:55.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.971+0000 7f463c125740 1 Processor -- start 2024-08-20T01:47:55.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.971+0000 7f463c125740 1 -- start start 2024-08-20T01:47:55.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.972+0000 7f463c125740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ddf9df880 0x558ddf9e38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:55.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.972+0000 7f463c125740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ddf9e01a0 0x558ddf9eae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:55.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.972+0000 7f463c125740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ddf9ec130 0x558ddfa03e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:55.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.972+0000 7f463c125740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f46341b4850 con 0x558ddf9e01a0 2024-08-20T01:47:55.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.972+0000 7f463c125740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f46341b6510 con 0x558ddf9ec130 2024-08-20T01:47:55.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.972+0000 7f463c125740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f46341b4fe0 con 0x558ddf9df880 2024-08-20T01:47:55.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.972+0000 7f46337fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ddf9df880 0x558ddf9e38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:55.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.972+0000 7f46337fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ddf9df880 0x558ddf9e38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:46156/0 (socket says 172.21.15.79:46156) 2024-08-20T01:47:55.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.972+0000 7f46337fe640 1 -- 172.21.15.79:0/3343705912 learned_addr learned my addr 172.21.15.79:0/3343705912 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:55.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.972+0000 7f4632ffd640 1 --2- 172.21.15.79:0/3343705912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ddf9e01a0 0x558ddf9eae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:55.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.972+0000 7f4633fff640 1 --2- 172.21.15.79:0/3343705912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ddf9ec130 0x558ddfa03e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:55.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.972+0000 7f46337fe640 1 -- 172.21.15.79:0/3343705912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ddf9ec130 msgr2=0x558ddfa03e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:55.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.972+0000 7f46337fe640 1 --2- 172.21.15.79:0/3343705912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ddf9ec130 0x558ddfa03e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:55.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.972+0000 7f46337fe640 1 -- 172.21.15.79:0/3343705912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ddf9e01a0 msgr2=0x558ddf9eae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:55.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.972+0000 7f46337fe640 1 --2- 172.21.15.79:0/3343705912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ddf9e01a0 0x558ddf9eae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:55.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.972+0000 7f46337fe640 1 -- 172.21.15.79:0/3343705912 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ddf9de130 con 0x558ddf9df880 2024-08-20T01:47:55.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.973+0000 7f46337fe640 1 --2- 172.21.15.79:0/3343705912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ddf9df880 0x558ddf9e38f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f46280aadd0 tx=0x7f462800ce60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43ce17320f72969a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:55.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.974+0000 7f46197fa640 1 -- 172.21.15.79:0/3343705912 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46280ad020 con 0x558ddf9df880 2024-08-20T01:47:55.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.974+0000 7f46197fa640 1 -- 172.21.15.79:0/3343705912 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f46280aa950 con 0x558ddf9df880 2024-08-20T01:47:55.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.974+0000 7f46197fa640 1 -- 172.21.15.79:0/3343705912 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4628010a70 con 0x558ddf9df880 2024-08-20T01:47:55.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.975+0000 7f463c125740 1 -- 172.21.15.79:0/3343705912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ddf9df880 msgr2=0x558ddf9e38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:55.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.975+0000 7f463c125740 1 --2- 172.21.15.79:0/3343705912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ddf9df880 0x558ddf9e38f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f46280aadd0 tx=0x7f462800ce60 comp rx=0 tx=0).stop 2024-08-20T01:47:55.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.975+0000 7f463c125740 1 -- 172.21.15.79:0/3343705912 shutdown_connections 2024-08-20T01:47:55.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.975+0000 7f463c125740 1 --2- 172.21.15.79:0/3343705912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ddf9ec130 0x558ddfa03e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:55.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.975+0000 7f463c125740 1 --2- 172.21.15.79:0/3343705912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ddf9e01a0 0x558ddf9eae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:55.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.975+0000 7f463c125740 1 --2- 172.21.15.79:0/3343705912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ddf9df880 0x558ddf9e38f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:55.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.975+0000 7f463c125740 1 -- 172.21.15.79:0/3343705912 >> 172.21.15.79:0/3343705912 conn(0x558ddf9dd6b0 msgr2=0x558ddf9ea710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:55.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.976+0000 7f463c125740 1 -- 172.21.15.79:0/3343705912 shutdown_connections 2024-08-20T01:47:55.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.976+0000 7f463c125740 1 -- 172.21.15.79:0/3343705912 wait complete. 2024-08-20T01:47:55.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.976+0000 7f463c125740 1 -- start start 2024-08-20T01:47:55.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.976+0000 7f463c125740 1 Processor -- start 2024-08-20T01:47:55.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.979+0000 7f463c125740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ddf9df880 0x558ddf9ef7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:55.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.979+0000 7f463c125740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ddf9e01a0 0x558ddf9efce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:55.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.979+0000 7f463c125740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ddf9ec130 0x558ddfa64df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:55.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.979+0000 7f463c125740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f46341b5e40 con 0x558ddf9e01a0 2024-08-20T01:47:55.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.979+0000 7f463c125740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f46341b56b0 con 0x558ddf9df880 2024-08-20T01:47:55.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.979+0000 7f463c125740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f46341b2830 con 0x558ddf9ec130 2024-08-20T01:47:55.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.979+0000 7f4633fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ddf9ec130 0x558ddfa64df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:55.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.979+0000 7f4633fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ddf9ec130 0x558ddfa64df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:46164/0 (socket says 172.21.15.79:46164) 2024-08-20T01:47:55.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.979+0000 7f4633fff640 1 -- 172.21.15.79:0/3115970386 learned_addr learned my addr 172.21.15.79:0/3115970386 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:47:55.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.979+0000 7f463c125740 10 client.0 _ll_register_callbacks cb 0x7f462c00e260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:47:55.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.979+0000 7f46337fe640 1 --2- 172.21.15.79:0/3115970386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ddf9df880 0x558ddf9ef7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:55.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.980+0000 7f4633fff640 1 -- 172.21.15.79:0/3115970386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ddf9df880 msgr2=0x558ddf9ef7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:55.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.980+0000 7f4633fff640 1 --2- 172.21.15.79:0/3115970386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ddf9df880 0x558ddf9ef7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:55.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.980+0000 7f4632ffd640 1 --2- 172.21.15.79:0/3115970386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ddf9e01a0 0x558ddf9efce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:55.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.980+0000 7f4633fff640 1 -- 172.21.15.79:0/3115970386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ddf9e01a0 msgr2=0x558ddf9efce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:47:55.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.980+0000 7f4633fff640 1 --2- 172.21.15.79:0/3115970386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ddf9e01a0 0x558ddf9efce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:55.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.980+0000 7f4633fff640 1 -- 172.21.15.79:0/3115970386 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ddfa65400 con 0x558ddf9ec130 2024-08-20T01:47:55.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.980+0000 7f4632ffd640 1 --2- 172.21.15.79:0/3115970386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ddf9e01a0 0x558ddf9efce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:47:55.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.980+0000 7f4633fff640 1 --2- 172.21.15.79:0/3115970386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ddf9ec130 0x558ddfa64df0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f462c02b7a0 tx=0x7f462c0077c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b821ebc495767e5d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:47:55.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.980+0000 7f4612ffd640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:47:55.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.981+0000 7f4612ffd640 1 -- 172.21.15.79:0/3115970386 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f462c03d060 con 0x558ddf9ec130 2024-08-20T01:47:55.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.981+0000 7f4612ffd640 1 -- 172.21.15.79:0/3115970386 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f462c015820 con 0x558ddf9ec130 2024-08-20T01:47:55.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.981+0000 7f463c125740 1 -- 172.21.15.79:0/3115970386 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46280aa950 con 0x558ddf9ec130 2024-08-20T01:47:55.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.981+0000 7f4612ffd640 1 -- 172.21.15.79:0/3115970386 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f462c01b040 con 0x558ddf9ec130 2024-08-20T01:47:55.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.981+0000 7f463c125740 10 client.27346 fetch_fsmap learned FSMap version 47 2024-08-20T01:47:55.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.981+0000 7f463c125740 1 -- 172.21.15.79:0/3115970386 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x558ddfa66700 con 0x558ddf9ec130 2024-08-20T01:47:55.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.982+0000 7f4612ffd640 1 -- 172.21.15.79:0/3115970386 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f46280aa950 con 0x558ddf9ec130 2024-08-20T01:47:55.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.982+0000 7f4612ffd640 1 -- 172.21.15.79:0/3115970386 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 47) ==== 8394+0+0 (secure 0 0 0) 0x7f462c02e910 con 0x558ddf9ec130 2024-08-20T01:47:55.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.982+0000 7f463c125740 10 client.27346 fetch_fsmap finished waiting for FSMap version 47 2024-08-20T01:47:55.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.982+0000 7f463c125740 10 client.27346 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:47:55.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.982+0000 7f463c125740 20 client.27346 populate_metadata read hostname 'smithi079' 2024-08-20T01:47:55.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.982+0000 7f463c125740 1 --2- 172.21.15.79:0/3115970386 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x558ddfa66f10 0x558ddfa69330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:47:55.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.982+0000 7f463c125740 4 client.27346 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:47:55.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.982+0000 7f463c125740 1 -- 172.21.15.79:0/3115970386 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558ddf954320 con 0x558ddfa66f10 2024-08-20T01:47:55.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.983+0000 7f46337fe640 1 --2- 172.21.15.79:0/3115970386 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x558ddfa66f10 0x558ddfa69330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:47:55.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.983+0000 7f4612ffd640 10 client.27346 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:47:55.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.983+0000 7f46337fe640 1 --2- 172.21.15.79:0/3115970386 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x558ddfa66f10 0x558ddfa69330 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6651c6d2ec632331 server_cookie=4431b65026aaefac in_seq=0 out_seq=0 2024-08-20T01:47:55.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.984+0000 7f4612ffd640 1 -- 172.21.15.79:0/3115970386 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558ddf954320 con 0x558ddfa66f10 2024-08-20T01:47:55.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.984+0000 7f4612ffd640 10 client.27346 handle_command_reply: tid=0 2024-08-20T01:47:55.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.984+0000 7f463c125740 1 client.27346 shutdown 2024-08-20T01:47:55.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.986+0000 7f463c125740 1 -- 172.21.15.79:0/3115970386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ddf9ec130 msgr2=0x558ddfa64df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:55.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.986+0000 7f463c125740 1 --2- 172.21.15.79:0/3115970386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ddf9ec130 0x558ddfa64df0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f462c02b7a0 tx=0x7f462c0077c0 comp rx=0 tx=0).stop 2024-08-20T01:47:55.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.986+0000 7f463c125740 1 -- 172.21.15.79:0/3115970386 shutdown_connections 2024-08-20T01:47:55.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.986+0000 7f463c125740 1 --2- 172.21.15.79:0/3115970386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ddf9ec130 0x558ddfa64df0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:55.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.986+0000 7f463c125740 1 --2- 172.21.15.79:0/3115970386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ddf9e01a0 0x558ddf9efce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:55.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.986+0000 7f463c125740 1 --2- 172.21.15.79:0/3115970386 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x558ddfa66f10 0x558ddfa69330 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:55.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.986+0000 7f463c125740 1 --2- 172.21.15.79:0/3115970386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ddf9df880 0x558ddf9ef7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:55.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.986+0000 7f463c125740 1 -- 172.21.15.79:0/3115970386 >> 172.21.15.79:0/3115970386 conn(0x558ddf9dd6b0 msgr2=0x558ddf9e7520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:55.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.986+0000 7f4612ffd640 0 client.27346 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:47:55.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.987+0000 7f463c125740 1 -- 172.21.15.79:0/3115970386 shutdown_connections 2024-08-20T01:47:55.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.987+0000 7f463c125740 1 -- 172.21.15.79:0/3115970386 wait complete. 2024-08-20T01:47:55.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.987+0000 7f463c125740 20 client.27346 trim_cache size 0 max 16384 2024-08-20T01:47:55.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.989+0000 7f4639d2c640 1 -- 172.21.15.79:0/882738734 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f461c0b3cd0 msgr2=0x7f461c0b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:55.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.989+0000 7f4639d2c640 1 --2- 172.21.15.79:0/882738734 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f461c0b3cd0 0x7f461c0b6190 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f462c009500 tx=0x7f462c00b040 comp rx=0 tx=0).stop 2024-08-20T01:47:55.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.989+0000 7f4639d2c640 1 -- 172.21.15.79:0/882738734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4634101590 msgr2=0x7f463419f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:47:55.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.989+0000 7f4639d2c640 1 --2- 172.21.15.79:0/882738734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4634101590 0x7f463419f640 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f462800e9f0 tx=0x7f462800eeb0 comp rx=0 tx=0).stop 2024-08-20T01:47:55.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.990+0000 7f4639d2c640 1 -- 172.21.15.79:0/882738734 shutdown_connections 2024-08-20T01:47:55.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.990+0000 7f4639d2c640 1 --2- 172.21.15.79:0/882738734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4634106d00 0x7f46341a4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:55.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.990+0000 7f4639d2c640 1 --2- 172.21.15.79:0/882738734 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4634106380 0x7f463419fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:55.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.990+0000 7f4639d2c640 1 --2- 172.21.15.79:0/882738734 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f461c0b3cd0 0x7f461c0b6190 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:55.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.990+0000 7f4639d2c640 1 --2- 172.21.15.79:0/882738734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4634101590 0x7f463419f640 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:47:55.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.990+0000 7f4639d2c640 1 -- 172.21.15.79:0/882738734 >> 172.21.15.79:0/882738734 conn(0x7f4634076bd0 msgr2=0x7f46341042d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:47:55.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.990+0000 7f4639d2c640 1 -- 172.21.15.79:0/882738734 shutdown_connections 2024-08-20T01:47:55.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:47:54.990+0000 7f4639d2c640 1 -- 172.21.15.79:0/882738734 wait complete. 2024-08-20T01:47:56.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:56 smithi081 ceph-mon[22209]: pgmap v665: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 6.29k op/s 2024-08-20T01:47:56.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:56 smithi175 ceph-mon[22392]: pgmap v665: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 6.29k op/s 2024-08-20T01:47:56.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:56 smithi079 ceph-mon[18656]: pgmap v665: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 6.29k op/s 2024-08-20T01:47:58.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:47:58 smithi081 ceph-mon[22209]: pgmap v666: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 MiB/s wr, 5.81k op/s 2024-08-20T01:47:58.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:47:58 smithi175 ceph-mon[22392]: pgmap v666: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 MiB/s wr, 5.81k op/s 2024-08-20T01:47:58.929 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:47:58 smithi079 ceph-mon[18656]: pgmap v666: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 MiB/s wr, 5.81k op/s 2024-08-20T01:47:59.507 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T01:47:59.938 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:48:00.675 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:00 smithi079 ceph-mon[18656]: pgmap v667: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 6.09k op/s 2024-08-20T01:48:00.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.681+0000 7fc2cfbe5640 1 -- 172.21.15.79:0/1359564042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2c81090b0 msgr2=0x7fc2c8109490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:00.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.681+0000 7fc2cfbe5640 1 --2- 172.21.15.79:0/1359564042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2c81090b0 0x7fc2c8109490 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8009860 tx=0x7fc2b802a340 comp rx=0 tx=0).stop 2024-08-20T01:48:00.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.681+0000 7fc2cfbe5640 1 -- 172.21.15.79:0/1359564042 shutdown_connections 2024-08-20T01:48:00.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.681+0000 7fc2cfbe5640 1 --2- 172.21.15.79:0/1359564042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2c810f440 0x7fc2c8115c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:00.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.681+0000 7fc2cfbe5640 1 --2- 172.21.15.79:0/1359564042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2c810eac0 0x7fc2c810ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:00.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.681+0000 7fc2cfbe5640 1 --2- 172.21.15.79:0/1359564042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2c81090b0 0x7fc2c8109490 secure :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8009860 tx=0x7fc2b802a340 comp rx=0 tx=0).stop 2024-08-20T01:48:00.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.681+0000 7fc2cfbe5640 1 -- 172.21.15.79:0/1359564042 >> 172.21.15.79:0/1359564042 conn(0x7fc2c80787b0 msgr2=0x7fc2c807abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:00.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.682+0000 7fc2cfbe5640 1 -- 172.21.15.79:0/1359564042 shutdown_connections 2024-08-20T01:48:00.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.682+0000 7fc2cfbe5640 1 -- 172.21.15.79:0/1359564042 wait complete. 2024-08-20T01:48:00.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.683+0000 7fc2cfbe5640 1 Processor -- start 2024-08-20T01:48:00.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.683+0000 7fc2cfbe5640 1 -- start start 2024-08-20T01:48:00.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.683+0000 7fc2cfbe5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2c810eac0 0x7fc2c8074780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:00.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.683+0000 7fc2cfbe5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2c810f440 0x7fc2c806d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:00.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.684+0000 7fc2cfbe5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2c806def0 0x7fc2c806e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:00.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.684+0000 7fc2cfbe5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c8118f70 con 0x7fc2c810eac0 2024-08-20T01:48:00.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.684+0000 7fc2cfbe5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c8118df0 con 0x7fc2c810f440 2024-08-20T01:48:00.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.684+0000 7fc2cfbe5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c81190f0 con 0x7fc2c806def0 2024-08-20T01:48:00.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.684+0000 7fc2cd180640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2c810f440 0x7fc2c806d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:00.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.684+0000 7fc2cd180640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2c810f440 0x7fc2c806d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:33272/0 (socket says 172.21.15.79:33272) 2024-08-20T01:48:00.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.684+0000 7fc2cd180640 1 -- 172.21.15.79:0/3197562453 learned_addr learned my addr 172.21.15.79:0/3197562453 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:00.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.684+0000 7fc2ce182640 1 --2- 172.21.15.79:0/3197562453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2c806def0 0x7fc2c806e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:00.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.684+0000 7fc2cd981640 1 --2- 172.21.15.79:0/3197562453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2c810eac0 0x7fc2c8074780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:00.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.684+0000 7fc2cd180640 1 -- 172.21.15.79:0/3197562453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2c806def0 msgr2=0x7fc2c806e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:00.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.684+0000 7fc2cd180640 1 --2- 172.21.15.79:0/3197562453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2c806def0 0x7fc2c806e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:00.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.684+0000 7fc2cd180640 1 -- 172.21.15.79:0/3197562453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2c810eac0 msgr2=0x7fc2c8074780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:00.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.685+0000 7fc2cd180640 1 --2- 172.21.15.79:0/3197562453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2c810eac0 0x7fc2c8074780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:00.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.685+0000 7fc2cd180640 1 -- 172.21.15.79:0/3197562453 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2c80734a0 con 0x7fc2c810f440 2024-08-20T01:48:00.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.685+0000 7fc2cd981640 1 --2- 172.21.15.79:0/3197562453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2c810eac0 0x7fc2c8074780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:48:00.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.685+0000 7fc2cd180640 1 --2- 172.21.15.79:0/3197562453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2c810f440 0x7fc2c806d9b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc2c000ba50 tx=0x7fc2c000bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:00.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.685+0000 7fc2beffd640 1 -- 172.21.15.79:0/3197562453 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c0019070 con 0x7fc2c810f440 2024-08-20T01:48:00.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.685+0000 7fc2beffd640 1 -- 172.21.15.79:0/3197562453 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2c000cbe0 con 0x7fc2c810f440 2024-08-20T01:48:00.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.685+0000 7fc2beffd640 1 -- 172.21.15.79:0/3197562453 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c00075d0 con 0x7fc2c810f440 2024-08-20T01:48:00.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.685+0000 7fc2cfbe5640 1 -- 172.21.15.79:0/3197562453 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2c8073790 con 0x7fc2c810f440 2024-08-20T01:48:00.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.686+0000 7fc2cfbe5640 1 -- 172.21.15.79:0/3197562453 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2c8073c20 con 0x7fc2c810f440 2024-08-20T01:48:00.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.689+0000 7fc2beffd640 1 -- 172.21.15.79:0/3197562453 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc2c001c070 con 0x7fc2c810f440 2024-08-20T01:48:00.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.691+0000 7fc2beffd640 1 --2- 172.21.15.79:0/3197562453 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc2b40b3cd0 0x7fc2b40b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:00.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.691+0000 7fc2beffd640 1 -- 172.21.15.79:0/3197562453 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc2c00e3260 con 0x7fc2c810f440 2024-08-20T01:48:00.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.691+0000 7fc2cd981640 1 --2- 172.21.15.79:0/3197562453 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc2b40b3cd0 0x7fc2b40b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:00.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.692+0000 7fc2d1fde740 1 Processor -- start 2024-08-20T01:48:00.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.692+0000 7fc2d1fde740 1 -- start start 2024-08-20T01:48:00.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.693+0000 7fc2d1fde740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565616e5880 0x5565616e5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:00.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.693+0000 7fc2d1fde740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565616e61a0 0x5565616f1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:00.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.693+0000 7fc2d1fde740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5565616f2130 0x5565616f4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:00.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.693+0000 7fc2cd981640 1 --2- 172.21.15.79:0/3197562453 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc2b40b3cd0 0x7fc2b40b6190 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8009830 tx=0x7fc2b8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:00.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.693+0000 7fc2ce182640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5565616f2130 0x5565616f4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:00.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.693+0000 7fc2cd981640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565616e5880 0x5565616e5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:00.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.693+0000 7fc2cd981640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565616e5880 0x5565616e5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:36718/0 (socket says 172.21.15.79:36718) 2024-08-20T01:48:00.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.693+0000 7fc2cd981640 1 -- 172.21.15.79:0/1917610346 learned_addr learned my addr 172.21.15.79:0/1917610346 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:00.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.693+0000 7fc2cd180640 1 --2- 172.21.15.79:0/1917610346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565616e61a0 0x5565616f1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:00.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.693+0000 7fc2d1fde740 1 -- 172.21.15.79:0/1917610346 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55656165c930 con 0x5565616f2130 2024-08-20T01:48:00.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.693+0000 7fc2d1fde740 1 -- 172.21.15.79:0/1917610346 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55656164be30 con 0x5565616e61a0 2024-08-20T01:48:00.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.693+0000 7fc2d1fde740 1 -- 172.21.15.79:0/1917610346 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55656164fe70 con 0x5565616e5880 2024-08-20T01:48:00.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.694+0000 7fc2cd981640 1 -- 172.21.15.79:0/1917610346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565616e61a0 msgr2=0x5565616f1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:00.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.694+0000 7fc2cd981640 1 --2- 172.21.15.79:0/1917610346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565616e61a0 0x5565616f1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:00.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.694+0000 7fc2cd981640 1 -- 172.21.15.79:0/1917610346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5565616f2130 msgr2=0x5565616f4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:00.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.694+0000 7fc2cd981640 1 --2- 172.21.15.79:0/1917610346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5565616f2130 0x5565616f4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:00.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.694+0000 7fc2cd981640 1 -- 172.21.15.79:0/1917610346 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565613ab650 con 0x5565616e5880 2024-08-20T01:48:00.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.694+0000 7fc2cd981640 1 --2- 172.21.15.79:0/1917610346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565616e5880 0x5565616e5c60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8005d00 tx=0x7fc2b803c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b36142359f014927 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:00.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.694+0000 7fc2b3fff640 1 -- 172.21.15.79:0/1917610346 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b8045050 con 0x5565616e5880 2024-08-20T01:48:00.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.695+0000 7fc2b3fff640 1 -- 172.21.15.79:0/1917610346 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2b804f070 con 0x5565616e5880 2024-08-20T01:48:00.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.695+0000 7fc2b3fff640 1 -- 172.21.15.79:0/1917610346 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b8037050 con 0x5565616e5880 2024-08-20T01:48:00.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.697+0000 7fc2d1fde740 1 -- 172.21.15.79:0/1917610346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565616e5880 msgr2=0x5565616e5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:00.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.697+0000 7fc2d1fde740 1 --2- 172.21.15.79:0/1917610346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565616e5880 0x5565616e5c60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8005d00 tx=0x7fc2b803c000 comp rx=0 tx=0).stop 2024-08-20T01:48:00.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.698+0000 7fc2d1fde740 1 -- 172.21.15.79:0/1917610346 shutdown_connections 2024-08-20T01:48:00.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.698+0000 7fc2d1fde740 1 --2- 172.21.15.79:0/1917610346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5565616f2130 0x5565616f4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:00.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.698+0000 7fc2d1fde740 1 --2- 172.21.15.79:0/1917610346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565616e61a0 0x5565616f1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:00.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.698+0000 7fc2d1fde740 1 --2- 172.21.15.79:0/1917610346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565616e5880 0x5565616e5c60 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:00.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.698+0000 7fc2d1fde740 1 -- 172.21.15.79:0/1917610346 >> 172.21.15.79:0/1917610346 conn(0x5565616e36b0 msgr2=0x5565616e4850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:00.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.698+0000 7fc2d1fde740 1 -- 172.21.15.79:0/1917610346 shutdown_connections 2024-08-20T01:48:00.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.699+0000 7fc2d1fde740 1 -- 172.21.15.79:0/1917610346 wait complete. 2024-08-20T01:48:00.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.699+0000 7fc2d1fde740 1 -- start start 2024-08-20T01:48:00.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.699+0000 7fc2d1fde740 1 Processor -- start 2024-08-20T01:48:00.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.700+0000 7fc2d1fde740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565616e5880 0x5565616ef0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:00.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.700+0000 7fc2d1fde740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5565616e61a0 0x5565616ef610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:00.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.700+0000 7fc2d1fde740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565616f2130 0x5565616efb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:00.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.700+0000 7fc2cd180640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5565616e61a0 0x5565616ef610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:00.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.700+0000 7fc2cd180640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5565616e61a0 0x5565616ef610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59756/0 (socket says 172.21.15.79:59756) 2024-08-20T01:48:00.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.700+0000 7fc2cd981640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565616e5880 0x5565616ef0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:00.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.700+0000 7fc2cd981640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565616e5880 0x5565616ef0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:36732/0 (socket says 172.21.15.79:36732) 2024-08-20T01:48:00.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.700+0000 7fc2cd180640 1 -- 172.21.15.79:0/2243308438 learned_addr learned my addr 172.21.15.79:0/2243308438 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:00.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.701+0000 7fc2d1fde740 1 -- 172.21.15.79:0/2243308438 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5565614ae700 con 0x5565616e61a0 2024-08-20T01:48:00.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.701+0000 7fc2d1fde740 1 -- 172.21.15.79:0/2243308438 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5565615d2810 con 0x5565616f2130 2024-08-20T01:48:00.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.701+0000 7fc2d1fde740 1 -- 172.21.15.79:0/2243308438 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5565616f4d80 con 0x5565616e5880 2024-08-20T01:48:00.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.701+0000 7fc2ce182640 1 --2- 172.21.15.79:0/2243308438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565616f2130 0x5565616efb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:00.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.701+0000 7fc2d1fde740 10 client.0 _ll_register_callbacks cb 0x556561645700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:48:00.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.701+0000 7fc2ce182640 1 -- 172.21.15.79:0/2243308438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565616e5880 msgr2=0x5565616ef0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:00.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.701+0000 7fc2ce182640 1 --2- 172.21.15.79:0/2243308438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565616e5880 0x5565616ef0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:00.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.701+0000 7fc2ce182640 1 -- 172.21.15.79:0/2243308438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5565616e61a0 msgr2=0x5565616ef610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:00.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.701+0000 7fc2ce182640 1 --2- 172.21.15.79:0/2243308438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5565616e61a0 0x5565616ef610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:00.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.701+0000 7fc2ce182640 1 -- 172.21.15.79:0/2243308438 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565616fe130 con 0x5565616f2130 2024-08-20T01:48:00.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.701+0000 7fc2cd180640 1 --2- 172.21.15.79:0/2243308438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5565616e61a0 0x5565616ef610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:48:00.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.701+0000 7fc2ce182640 1 --2- 172.21.15.79:0/2243308438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565616f2130 0x5565616efb50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x5565616e5830 tx=0x7fc2c4012820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9896f378da3bb40a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:00.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.701+0000 7fc2b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:48:00.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.702+0000 7fc2b17fa640 1 -- 172.21.15.79:0/2243308438 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c40107e0 con 0x5565616f2130 2024-08-20T01:48:00.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.702+0000 7fc2b17fa640 1 -- 172.21.15.79:0/2243308438 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc2c4010980 con 0x5565616f2130 2024-08-20T01:48:00.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.702+0000 7fc2d1fde740 1 -- 172.21.15.79:0/2243308438 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5565615fb150 con 0x5565616f2130 2024-08-20T01:48:00.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.702+0000 7fc2b17fa640 1 -- 172.21.15.79:0/2243308438 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fc2c400de50 con 0x5565616f2130 2024-08-20T01:48:00.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.702+0000 7fc2d1fde740 10 client.27374 fetch_fsmap learned FSMap version 47 2024-08-20T01:48:00.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.702+0000 7fc2d1fde740 1 -- 172.21.15.79:0/2243308438 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x556561700b00 con 0x5565616f2130 2024-08-20T01:48:00.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.702+0000 7fc2b17fa640 1 -- 172.21.15.79:0/2243308438 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2c40273a0 con 0x5565616f2130 2024-08-20T01:48:00.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.703+0000 7fc2b17fa640 1 -- 172.21.15.79:0/2243308438 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 47) ==== 8394+0+0 (secure 0 0 0) 0x7fc2c400f3c0 con 0x5565616f2130 2024-08-20T01:48:00.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.703+0000 7fc2d1fde740 10 client.27374 fetch_fsmap finished waiting for FSMap version 47 2024-08-20T01:48:00.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.703+0000 7fc2d1fde740 10 client.27374 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:48:00.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.703+0000 7fc2d1fde740 20 client.27374 populate_metadata read hostname 'smithi079' 2024-08-20T01:48:00.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.703+0000 7fc2d1fde740 1 --2- 172.21.15.79:0/2243308438 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556561701fc0 0x556561704410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:00.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.703+0000 7fc2d1fde740 4 client.27374 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:48:00.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.703+0000 7fc2d1fde740 1 -- 172.21.15.79:0/2243308438 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5565615fb150 con 0x556561701fc0 2024-08-20T01:48:00.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.703+0000 7fc2cd981640 1 --2- 172.21.15.79:0/2243308438 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556561701fc0 0x556561704410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:00.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.704+0000 7fc2b17fa640 10 client.27374 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:00.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.704+0000 7fc2cd981640 1 --2- 172.21.15.79:0/2243308438 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556561701fc0 0x556561704410 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abf93f84c18fe764 server_cookie=20cff7a4e7d76801 in_seq=0 out_seq=0 2024-08-20T01:48:00.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.705+0000 7fc2b17fa640 1 -- 172.21.15.79:0/2243308438 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5565615fb150 con 0x556561701fc0 2024-08-20T01:48:00.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.705+0000 7fc2b17fa640 10 client.27374 handle_command_reply: tid=0 2024-08-20T01:48:00.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.705+0000 7fc2d1fde740 1 client.27374 shutdown 2024-08-20T01:48:00.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.705+0000 7fc2d1fde740 1 -- 172.21.15.79:0/2243308438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565616f2130 msgr2=0x5565616efb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:00.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.705+0000 7fc2d1fde740 1 --2- 172.21.15.79:0/2243308438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565616f2130 0x5565616efb50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x5565616e5830 tx=0x7fc2c4012820 comp rx=0 tx=0).stop 2024-08-20T01:48:00.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.706+0000 7fc2d1fde740 1 -- 172.21.15.79:0/2243308438 shutdown_connections 2024-08-20T01:48:00.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.706+0000 7fc2d1fde740 1 --2- 172.21.15.79:0/2243308438 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556561701fc0 0x556561704410 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:00.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.706+0000 7fc2d1fde740 1 --2- 172.21.15.79:0/2243308438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565616f2130 0x5565616efb50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:00.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.706+0000 7fc2d1fde740 1 --2- 172.21.15.79:0/2243308438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5565616e61a0 0x5565616ef610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:00.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.706+0000 7fc2d1fde740 1 --2- 172.21.15.79:0/2243308438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565616e5880 0x5565616ef0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:00.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.706+0000 7fc2d1fde740 1 -- 172.21.15.79:0/2243308438 >> 172.21.15.79:0/2243308438 conn(0x5565616e36b0 msgr2=0x5565616e9220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:00.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.706+0000 7fc2b17fa640 0 client.27374 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:00.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.706+0000 7fc2d1fde740 1 -- 172.21.15.79:0/2243308438 shutdown_connections 2024-08-20T01:48:00.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.706+0000 7fc2d1fde740 1 -- 172.21.15.79:0/2243308438 wait complete. 2024-08-20T01:48:00.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.706+0000 7fc2d1fde740 20 client.27374 trim_cache size 0 max 16384 2024-08-20T01:48:00.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.732+0000 7fc2d1fde740 1 Processor -- start 2024-08-20T01:48:00.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.732+0000 7fc2d1fde740 1 -- start start 2024-08-20T01:48:00.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.733+0000 7fc2d1fde740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565616e5880 0x5565616f11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:00.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.733+0000 7fc2d1fde740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5565616e61a0 0x5565616ee960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:00.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.733+0000 7fc2d1fde740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565616f2130 0x5565616e9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:00.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.733+0000 7fc2cd180640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5565616e61a0 0x5565616ee960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:00.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.733+0000 7fc2cd981640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565616e5880 0x5565616f11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:00.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.733+0000 7fc2cd981640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565616e5880 0x5565616f11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:36734/0 (socket says 172.21.15.79:36734) 2024-08-20T01:48:00.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.733+0000 7fc2cd180640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5565616e61a0 0x5565616ee960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59772/0 (socket says 172.21.15.79:59772) 2024-08-20T01:48:00.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.733+0000 7fc2cd981640 1 -- 172.21.15.79:0/3267983709 learned_addr learned my addr 172.21.15.79:0/3267983709 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:00.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.733+0000 7fc2d1fde740 1 -- 172.21.15.79:0/3267983709 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c81bd400 con 0x5565616e61a0 2024-08-20T01:48:00.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.733+0000 7fc2d1fde740 1 -- 172.21.15.79:0/3267983709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c81bf0c0 con 0x5565616f2130 2024-08-20T01:48:00.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.733+0000 7fc2d1fde740 1 -- 172.21.15.79:0/3267983709 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c81bdb90 con 0x5565616e5880 2024-08-20T01:48:00.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.733+0000 7fc2ce182640 1 --2- 172.21.15.79:0/3267983709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565616f2130 0x5565616e9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:00.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.734+0000 7fc2cd981640 1 -- 172.21.15.79:0/3267983709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565616f2130 msgr2=0x5565616e9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:00.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.734+0000 7fc2cd981640 1 --2- 172.21.15.79:0/3267983709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565616f2130 0x5565616e9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:00.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.734+0000 7fc2cd981640 1 -- 172.21.15.79:0/3267983709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5565616e61a0 msgr2=0x5565616ee960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:00.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.734+0000 7fc2cd981640 1 --2- 172.21.15.79:0/3267983709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5565616e61a0 0x5565616ee960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:00.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.734+0000 7fc2cd981640 1 -- 172.21.15.79:0/3267983709 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565616e4130 con 0x5565616e5880 2024-08-20T01:48:00.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.734+0000 7fc2cd981640 1 --2- 172.21.15.79:0/3267983709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565616e5880 0x5565616f11d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8004e90 tx=0x7fc2b802a9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bae9b28f9df84f5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:00.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.734+0000 7fc2b37fe640 1 -- 172.21.15.79:0/3267983709 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b805b070 con 0x5565616e5880 2024-08-20T01:48:00.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.735+0000 7fc2b37fe640 1 -- 172.21.15.79:0/3267983709 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2b804f040 con 0x5565616e5880 2024-08-20T01:48:00.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.735+0000 7fc2b37fe640 1 -- 172.21.15.79:0/3267983709 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b8045070 con 0x5565616e5880 2024-08-20T01:48:00.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.736+0000 7fc2d1fde740 1 -- 172.21.15.79:0/3267983709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565616e5880 msgr2=0x5565616f11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:00.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.736+0000 7fc2d1fde740 1 --2- 172.21.15.79:0/3267983709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565616e5880 0x5565616f11d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8004e90 tx=0x7fc2b802a9c0 comp rx=0 tx=0).stop 2024-08-20T01:48:00.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.737+0000 7fc2d1fde740 1 -- 172.21.15.79:0/3267983709 shutdown_connections 2024-08-20T01:48:00.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.737+0000 7fc2d1fde740 1 --2- 172.21.15.79:0/3267983709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565616f2130 0x5565616e9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:00.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.737+0000 7fc2d1fde740 1 --2- 172.21.15.79:0/3267983709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5565616e61a0 0x5565616ee960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:00.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.737+0000 7fc2d1fde740 1 --2- 172.21.15.79:0/3267983709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565616e5880 0x5565616f11d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:00.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.737+0000 7fc2d1fde740 1 -- 172.21.15.79:0/3267983709 >> 172.21.15.79:0/3267983709 conn(0x5565616e36b0 msgr2=0x5565616ef860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:00.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.737+0000 7fc2d1fde740 1 -- 172.21.15.79:0/3267983709 shutdown_connections 2024-08-20T01:48:00.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.737+0000 7fc2d1fde740 1 -- 172.21.15.79:0/3267983709 wait complete. 2024-08-20T01:48:00.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.738+0000 7fc2d1fde740 1 -- start start 2024-08-20T01:48:00.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.738+0000 7fc2d1fde740 1 Processor -- start 2024-08-20T01:48:00.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.739+0000 7fc2d1fde740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565616e5880 0x5565616f5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:00.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.739+0000 7fc2d1fde740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5565616e61a0 0x5565616f5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:00.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.739+0000 7fc2d1fde740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565616f2130 0x556561764d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:00.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.739+0000 7fc2cd981640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565616e5880 0x5565616f5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:00.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.739+0000 7fc2cd981640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565616e5880 0x5565616f5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:33304/0 (socket says 172.21.15.79:33304) 2024-08-20T01:48:00.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.739+0000 7fc2cd981640 1 -- 172.21.15.79:0/2314616839 learned_addr learned my addr 172.21.15.79:0/2314616839 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:00.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.739+0000 7fc2d1fde740 1 -- 172.21.15.79:0/2314616839 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c81be9f0 con 0x5565616e61a0 2024-08-20T01:48:00.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.739+0000 7fc2d1fde740 1 -- 172.21.15.79:0/2314616839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c81be260 con 0x5565616e5880 2024-08-20T01:48:00.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.739+0000 7fc2d1fde740 1 -- 172.21.15.79:0/2314616839 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c81bb3e0 con 0x5565616f2130 2024-08-20T01:48:00.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.739+0000 7fc2d1fde740 10 client.0 _ll_register_callbacks cb 0x7fc2c4005b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:48:00.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.739+0000 7fc2cd180640 1 --2- 172.21.15.79:0/2314616839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5565616e61a0 0x5565616f5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:00.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.740+0000 7fc2ce182640 1 --2- 172.21.15.79:0/2314616839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565616f2130 0x556561764d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:00.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.740+0000 7fc2cd981640 1 -- 172.21.15.79:0/2314616839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565616f2130 msgr2=0x556561764d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:00.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.740+0000 7fc2cd981640 1 --2- 172.21.15.79:0/2314616839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565616f2130 0x556561764d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:00.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.740+0000 7fc2cd981640 1 -- 172.21.15.79:0/2314616839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5565616e61a0 msgr2=0x5565616f5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:00.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.740+0000 7fc2cd981640 1 --2- 172.21.15.79:0/2314616839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5565616e61a0 0x5565616f5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:00.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.740+0000 7fc2cd981640 1 -- 172.21.15.79:0/2314616839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565616eff70 con 0x5565616e5880 2024-08-20T01:48:00.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.740+0000 7fc2cd981640 1 --2- 172.21.15.79:0/2314616839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565616e5880 0x5565616f5940 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc2b80054d0 tx=0x7fc2b8005500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5178593a22a8234 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:00.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.742+0000 7fc2b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:48:00.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.742+0000 7fc2b17fa640 1 -- 172.21.15.79:0/2314616839 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b805b020 con 0x5565616e5880 2024-08-20T01:48:00.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.742+0000 7fc2b17fa640 1 -- 172.21.15.79:0/2314616839 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc2b8004ad0 con 0x5565616e5880 2024-08-20T01:48:00.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.743+0000 7fc2d1fde740 1 -- 172.21.15.79:0/2314616839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2b804f040 con 0x5565616e5880 2024-08-20T01:48:00.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.743+0000 7fc2b17fa640 1 -- 172.21.15.79:0/2314616839 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fc2b8045070 con 0x5565616e5880 2024-08-20T01:48:00.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.743+0000 7fc2d1fde740 10 client.27380 fetch_fsmap learned FSMap version 47 2024-08-20T01:48:00.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.743+0000 7fc2d1fde740 1 -- 172.21.15.79:0/2314616839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55656176c710 con 0x5565616e5880 2024-08-20T01:48:00.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.744+0000 7fc2b17fa640 1 -- 172.21.15.79:0/2314616839 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2b8046040 con 0x5565616e5880 2024-08-20T01:48:00.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.744+0000 7fc2b17fa640 1 -- 172.21.15.79:0/2314616839 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 47) ==== 8394+0+0 (secure 0 0 0) 0x7fc2b80324e0 con 0x5565616e5880 2024-08-20T01:48:00.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.745+0000 7fc2d1fde740 10 client.27380 fetch_fsmap finished waiting for FSMap version 47 2024-08-20T01:48:00.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.745+0000 7fc2d1fde740 10 client.27380 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:48:00.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.745+0000 7fc2d1fde740 20 client.27380 populate_metadata read hostname 'smithi079' 2024-08-20T01:48:00.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.745+0000 7fc2d1fde740 1 --2- 172.21.15.79:0/2314616839 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55656176c9c0 0x55656176edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:00.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.745+0000 7fc2d1fde740 4 client.27380 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:48:00.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.745+0000 7fc2d1fde740 1 -- 172.21.15.79:0/2314616839 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fc2b804f040 con 0x55656176c9c0 2024-08-20T01:48:00.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.746+0000 7fc2cd180640 1 --2- 172.21.15.79:0/2314616839 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55656176c9c0 0x55656176edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:00.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.747+0000 7fc2cd180640 1 --2- 172.21.15.79:0/2314616839 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55656176c9c0 0x55656176edb0 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba5465200c276791 server_cookie=bac5aca3247e5e89 in_seq=0 out_seq=0 2024-08-20T01:48:00.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.747+0000 7fc2b17fa640 10 client.27380 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:00.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.748+0000 7fc2b17fa640 1 -- 172.21.15.79:0/2314616839 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fc2b804f040 con 0x55656176c9c0 2024-08-20T01:48:00.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.748+0000 7fc2b17fa640 10 client.27380 handle_command_reply: tid=0 2024-08-20T01:48:00.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.748+0000 7fc2d1fde740 1 client.27380 shutdown 2024-08-20T01:48:00.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.748+0000 7fc2d1fde740 1 -- 172.21.15.79:0/2314616839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565616e5880 msgr2=0x5565616f5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:00.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.748+0000 7fc2d1fde740 1 --2- 172.21.15.79:0/2314616839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565616e5880 0x5565616f5940 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc2b80054d0 tx=0x7fc2b8005500 comp rx=0 tx=0).stop 2024-08-20T01:48:00.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.748+0000 7fc2d1fde740 1 -- 172.21.15.79:0/2314616839 shutdown_connections 2024-08-20T01:48:00.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.748+0000 7fc2d1fde740 1 --2- 172.21.15.79:0/2314616839 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55656176c9c0 0x55656176edb0 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:00.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.748+0000 7fc2d1fde740 1 --2- 172.21.15.79:0/2314616839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565616f2130 0x556561764d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:00.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.748+0000 7fc2d1fde740 1 --2- 172.21.15.79:0/2314616839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5565616e61a0 0x5565616f5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:00.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.748+0000 7fc2d1fde740 1 --2- 172.21.15.79:0/2314616839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565616e5880 0x5565616f5940 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:00.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.748+0000 7fc2d1fde740 1 -- 172.21.15.79:0/2314616839 >> 172.21.15.79:0/2314616839 conn(0x5565616e36b0 msgr2=0x5565616fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:00.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.749+0000 7fc2b17fa640 0 client.27380 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:00.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.749+0000 7fc2d1fde740 1 -- 172.21.15.79:0/2314616839 shutdown_connections 2024-08-20T01:48:00.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.749+0000 7fc2d1fde740 1 -- 172.21.15.79:0/2314616839 wait complete. 2024-08-20T01:48:00.753 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:48:00.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.749+0000 7fc2d1fde740 20 client.27380 trim_cache size 0 max 16384 2024-08-20T01:48:00.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.750+0000 7fc2cfbe5640 1 -- 172.21.15.79:0/3197562453 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc2b40b3cd0 msgr2=0x7fc2b40b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:00.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.750+0000 7fc2cfbe5640 1 --2- 172.21.15.79:0/3197562453 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc2b40b3cd0 0x7fc2b40b6190 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8009830 tx=0x7fc2b8000bc0 comp rx=0 tx=0).stop 2024-08-20T01:48:00.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.750+0000 7fc2cfbe5640 1 -- 172.21.15.79:0/3197562453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2c810f440 msgr2=0x7fc2c806d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:00.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.750+0000 7fc2cfbe5640 1 --2- 172.21.15.79:0/3197562453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2c810f440 0x7fc2c806d9b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc2c000ba50 tx=0x7fc2c000bf10 comp rx=0 tx=0).stop 2024-08-20T01:48:00.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.750+0000 7fc2cfbe5640 1 -- 172.21.15.79:0/3197562453 shutdown_connections 2024-08-20T01:48:00.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.750+0000 7fc2cfbe5640 1 --2- 172.21.15.79:0/3197562453 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc2b40b3cd0 0x7fc2b40b6190 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:00.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.750+0000 7fc2cfbe5640 1 --2- 172.21.15.79:0/3197562453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2c806def0 0x7fc2c806e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:00.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.750+0000 7fc2cfbe5640 1 --2- 172.21.15.79:0/3197562453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2c810f440 0x7fc2c806d9b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:00.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.750+0000 7fc2cfbe5640 1 --2- 172.21.15.79:0/3197562453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2c810eac0 0x7fc2c8074780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:00.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.750+0000 7fc2cfbe5640 1 -- 172.21.15.79:0/3197562453 >> 172.21.15.79:0/3197562453 conn(0x7fc2c80787b0 msgr2=0x7fc2c807aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:00.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.751+0000 7fc2cfbe5640 1 -- 172.21.15.79:0/3197562453 shutdown_connections 2024-08-20T01:48:00.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:00.751+0000 7fc2cfbe5640 1 -- 172.21.15.79:0/3197562453 wait complete. 2024-08-20T01:48:00.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:00 smithi081 ceph-mon[22209]: pgmap v667: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 6.09k op/s 2024-08-20T01:48:00.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:00 smithi175 ceph-mon[22392]: pgmap v667: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 6.09k op/s 2024-08-20T01:48:02.536 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T01:48:02.537 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T01:48:02.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:02 smithi081 ceph-mon[22209]: pgmap v668: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 MiB/s wr, 5.79k op/s 2024-08-20T01:48:02.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:02 smithi175 ceph-mon[22392]: pgmap v668: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 MiB/s wr, 5.79k op/s 2024-08-20T01:48:02.939 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:02 smithi079 ceph-mon[18656]: pgmap v668: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 MiB/s wr, 5.79k op/s 2024-08-20T01:48:02.975 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:48:03.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.081+0000 7f444244f640 1 -- 172.21.15.79:0/3513861595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f443c10d150 msgr2=0x7f443c10d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:03.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.081+0000 7f444244f640 1 --2- 172.21.15.79:0/3513861595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f443c10d150 0x7f443c10d550 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f4434009cd0 tx=0x7f443402a930 comp rx=0 tx=0).stop 2024-08-20T01:48:03.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.083+0000 7f444244f640 1 -- 172.21.15.79:0/3513861595 shutdown_connections 2024-08-20T01:48:03.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.083+0000 7f444244f640 1 --2- 172.21.15.79:0/3513861595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f443c10eb70 0x7f443c1154f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.083+0000 7f444244f640 1 --2- 172.21.15.79:0/3513861595 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f443c10e1b0 0x7f443c10e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.083+0000 7f444244f640 1 --2- 172.21.15.79:0/3513861595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f443c10d150 0x7f443c10d550 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.083+0000 7f444244f640 1 -- 172.21.15.79:0/3513861595 >> 172.21.15.79:0/3513861595 conn(0x7f443c06ce10 msgr2=0x7f443c06d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:03.090 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.087+0000 7f444244f640 1 -- 172.21.15.79:0/3513861595 shutdown_connections 2024-08-20T01:48:03.090 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.087+0000 7f444244f640 1 -- 172.21.15.79:0/3513861595 wait complete. 2024-08-20T01:48:03.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.088+0000 7f444244f640 1 Processor -- start 2024-08-20T01:48:03.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.088+0000 7f444244f640 1 -- start start 2024-08-20T01:48:03.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.089+0000 7f444244f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f443c10d150 0x7f443c19f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:03.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.089+0000 7f444244f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f443c10e1b0 0x7f443c19f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:03.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.089+0000 7f444244f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f443c10eb70 0x7f443c1a02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:03.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.089+0000 7f444244f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f443c118cd0 con 0x7f443c10d150 2024-08-20T01:48:03.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.089+0000 7f444244f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f443c118b50 con 0x7f443c10eb70 2024-08-20T01:48:03.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.089+0000 7f444244f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f443c118e50 con 0x7f443c10e1b0 2024-08-20T01:48:03.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.089+0000 7f44409ec640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f443c10eb70 0x7f443c1a02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:03.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.089+0000 7f44409ec640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f443c10eb70 0x7f443c1a02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:33324/0 (socket says 172.21.15.79:33324) 2024-08-20T01:48:03.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.089+0000 7f44409ec640 1 -- 172.21.15.79:0/750526439 learned_addr learned my addr 172.21.15.79:0/750526439 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:03.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.089+0000 7f443bfff640 1 --2- 172.21.15.79:0/750526439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f443c10d150 0x7f443c19f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:03.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.089+0000 7f44409ec640 1 -- 172.21.15.79:0/750526439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f443c10e1b0 msgr2=0x7f443c19f690 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-20T01:48:03.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.089+0000 7f44409ec640 1 --2- 172.21.15.79:0/750526439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f443c10e1b0 0x7f443c19f690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.089+0000 7f44409ec640 1 -- 172.21.15.79:0/750526439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f443c10d150 msgr2=0x7f443c19f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:03.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.089+0000 7f44409ec640 1 --2- 172.21.15.79:0/750526439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f443c10d150 0x7f443c19f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.089+0000 7f44409ec640 1 -- 172.21.15.79:0/750526439 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f443c1a0b80 con 0x7f443c10eb70 2024-08-20T01:48:03.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.090+0000 7f44409ec640 1 --2- 172.21.15.79:0/750526439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f443c10eb70 0x7f443c1a02c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f442c009fd0 tx=0x7f442c00b8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:03.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.090+0000 7f44397fa640 1 -- 172.21.15.79:0/750526439 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442c011830 con 0x7f443c10eb70 2024-08-20T01:48:03.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.090+0000 7f44397fa640 1 -- 172.21.15.79:0/750526439 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f442c016070 con 0x7f443c10eb70 2024-08-20T01:48:03.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.090+0000 7f44397fa640 1 -- 172.21.15.79:0/750526439 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442c010d80 con 0x7f443c10eb70 2024-08-20T01:48:03.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.090+0000 7f444244f640 1 -- 172.21.15.79:0/750526439 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f443c1a0e70 con 0x7f443c10eb70 2024-08-20T01:48:03.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.090+0000 7f444244f640 1 -- 172.21.15.79:0/750526439 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f443c1a55b0 con 0x7f443c10eb70 2024-08-20T01:48:03.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.094+0000 7f44397fa640 1 -- 172.21.15.79:0/750526439 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f442c0104a0 con 0x7f443c10eb70 2024-08-20T01:48:03.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.094+0000 7f4445245740 1 Processor -- start 2024-08-20T01:48:03.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.094+0000 7f4445245740 1 -- start start 2024-08-20T01:48:03.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.094+0000 7f4445245740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6e6d098d0 0x55c6e6d0bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:03.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.094+0000 7f4445245740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6e6d0c200 0x55c6e6d0e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:03.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.094+0000 7f4445245740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c6e6d0ec40 0x55c6e6d11100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:03.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.094+0000 7f4445245740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c6e6c7c360 con 0x55c6e6d0ec40 2024-08-20T01:48:03.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.094+0000 7f4445245740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c6e6c6b860 con 0x55c6e6d0c200 2024-08-20T01:48:03.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.094+0000 7f4445245740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c6e6c6f8a0 con 0x55c6e6d098d0 2024-08-20T01:48:03.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.094+0000 7f443bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6e6d0c200 0x55c6e6d0e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:03.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.094+0000 7f443bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6e6d0c200 0x55c6e6d0e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:33340/0 (socket says 172.21.15.79:33340) 2024-08-20T01:48:03.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.094+0000 7f443bfff640 1 -- 172.21.15.79:0/3575064670 learned_addr learned my addr 172.21.15.79:0/3575064670 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:03.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.094+0000 7f443b7fe640 1 --2- 172.21.15.79:0/3575064670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c6e6d0ec40 0x55c6e6d11100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:03.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.094+0000 7f443b7fe640 1 --2- 172.21.15.79:0/3575064670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6e6d098d0 0x55c6e6d0bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:03.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.094+0000 7f443bfff640 1 -- 172.21.15.79:0/3575064670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6e6d098d0 msgr2=0x55c6e6d0bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:03.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.094+0000 7f443bfff640 1 --2- 172.21.15.79:0/3575064670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6e6d098d0 0x55c6e6d0bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.094+0000 7f443bfff640 1 -- 172.21.15.79:0/3575064670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c6e6d0ec40 msgr2=0x55c6e6d11100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:03.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.094+0000 7f443bfff640 1 --2- 172.21.15.79:0/3575064670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c6e6d0ec40 0x55c6e6d11100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.094+0000 7f443bfff640 1 -- 172.21.15.79:0/3575064670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6e6c12e40 con 0x55c6e6d0c200 2024-08-20T01:48:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.095+0000 7f44397fa640 1 --2- 172.21.15.79:0/750526439 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f44240b3c80 0x7f44240b6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.095+0000 7f443bfff640 1 --2- 172.21.15.79:0/3575064670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6e6d0c200 0x55c6e6d0e5f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4434035000 tx=0x7f443402f470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=140fc01d5bdcf742 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.095+0000 7f443b7fe640 1 --2- 172.21.15.79:0/750526439 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f44240b3c80 0x7f44240b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.095+0000 7f44397fa640 1 -- 172.21.15.79:0/750526439 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f442c0e3310 con 0x7f443c10eb70 2024-08-20T01:48:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.095+0000 7f44227fc640 1 -- 172.21.15.79:0/3575064670 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4434031480 con 0x55c6e6d0c200 2024-08-20T01:48:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.095+0000 7f44227fc640 1 -- 172.21.15.79:0/3575064670 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4434036040 con 0x55c6e6d0c200 2024-08-20T01:48:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.095+0000 7f44227fc640 1 -- 172.21.15.79:0/3575064670 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44340044d0 con 0x55c6e6d0c200 2024-08-20T01:48:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.096+0000 7f443b7fe640 1 --2- 172.21.15.79:0/750526439 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f44240b3c80 0x7f44240b6140 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f443000da60 tx=0x7f4430006f30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.096+0000 7f4445245740 1 -- 172.21.15.79:0/3575064670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6e6d0c200 msgr2=0x55c6e6d0e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.096+0000 7f4445245740 1 --2- 172.21.15.79:0/3575064670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6e6d0c200 0x55c6e6d0e5f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4434035000 tx=0x7f443402f470 comp rx=0 tx=0).stop 2024-08-20T01:48:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.096+0000 7f4445245740 1 -- 172.21.15.79:0/3575064670 shutdown_connections 2024-08-20T01:48:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.096+0000 7f4445245740 1 --2- 172.21.15.79:0/3575064670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c6e6d0ec40 0x55c6e6d11100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.096+0000 7f4445245740 1 --2- 172.21.15.79:0/3575064670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6e6d0c200 0x55c6e6d0e5f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.096+0000 7f4445245740 1 --2- 172.21.15.79:0/3575064670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6e6d098d0 0x55c6e6d0bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.096+0000 7f4445245740 1 -- 172.21.15.79:0/3575064670 >> 172.21.15.79:0/3575064670 conn(0x55c6e6d04a20 msgr2=0x55c6e6d057b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.096+0000 7f4445245740 1 -- 172.21.15.79:0/3575064670 shutdown_connections 2024-08-20T01:48:03.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.097+0000 7f4445245740 1 -- 172.21.15.79:0/3575064670 wait complete. 2024-08-20T01:48:03.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.097+0000 7f4445245740 1 -- start start 2024-08-20T01:48:03.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.097+0000 7f4445245740 1 Processor -- start 2024-08-20T01:48:03.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.098+0000 7f4445245740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6e6d098d0 0x55c6e6d13060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:03.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.098+0000 7f4445245740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6e6d0c200 0x55c6e6d13700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:03.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.098+0000 7f4445245740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c6e6d0ec40 0x55c6e6d142d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:03.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.098+0000 7f4445245740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c6e6ba4ab0 con 0x55c6e6d0ec40 2024-08-20T01:48:03.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.098+0000 7f4445245740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c6e6bf2780 con 0x55c6e6d0c200 2024-08-20T01:48:03.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.098+0000 7f4445245740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c6e6d11bc0 con 0x55c6e6d098d0 2024-08-20T01:48:03.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.098+0000 7f44409ec640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c6e6d0ec40 0x55c6e6d142d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:03.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.098+0000 7f44409ec640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c6e6d0ec40 0x55c6e6d142d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59812/0 (socket says 172.21.15.79:59812) 2024-08-20T01:48:03.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.098+0000 7f44409ec640 1 -- 172.21.15.79:0/713435948 learned_addr learned my addr 172.21.15.79:0/713435948 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:03.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.098+0000 7f4445245740 10 client.0 _ll_register_callbacks cb 0x55c6e697aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:48:03.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.098+0000 7f44409ec640 1 -- 172.21.15.79:0/713435948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6e6d098d0 msgr2=0x55c6e6d13060 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:48:03.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.098+0000 7f44409ec640 1 --2- 172.21.15.79:0/713435948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6e6d098d0 0x55c6e6d13060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.098+0000 7f44409ec640 1 -- 172.21.15.79:0/713435948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6e6d0c200 msgr2=0x55c6e6d13700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:03.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.098+0000 7f44409ec640 1 --2- 172.21.15.79:0/713435948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6e6d0c200 0x55c6e6d13700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.098+0000 7f44409ec640 1 -- 172.21.15.79:0/713435948 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6e69ce790 con 0x55c6e6d0ec40 2024-08-20T01:48:03.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.099+0000 7f44409ec640 1 --2- 172.21.15.79:0/713435948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c6e6d0ec40 0x55c6e6d142d0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f442c0a7480 tx=0x7f442c0a9d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7af3abcc3b981d5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:03.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.099+0000 7f441b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:48:03.106 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.099+0000 7f441b7fe640 1 -- 172.21.15.79:0/713435948 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442c0ae810 con 0x55c6e6d0ec40 2024-08-20T01:48:03.106 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.099+0000 7f4445245740 1 -- 172.21.15.79:0/713435948 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c6e6c1ae00 con 0x55c6e6d0ec40 2024-08-20T01:48:03.106 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.099+0000 7f441b7fe640 1 -- 172.21.15.79:0/713435948 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f442c0b1da0 con 0x55c6e6d0ec40 2024-08-20T01:48:03.106 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.100+0000 7f441b7fe640 1 -- 172.21.15.79:0/713435948 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f442c0b32c0 con 0x55c6e6d0ec40 2024-08-20T01:48:03.106 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.100+0000 7f4445245740 10 client.18345 fetch_fsmap learned FSMap version 47 2024-08-20T01:48:03.106 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.100+0000 7f4445245740 1 -- 172.21.15.79:0/713435948 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55c6e6a47620 con 0x55c6e6d0ec40 2024-08-20T01:48:03.106 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.100+0000 7f441b7fe640 1 -- 172.21.15.79:0/713435948 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55c6e6c1ae00 con 0x55c6e6d0ec40 2024-08-20T01:48:03.106 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.100+0000 7f441b7fe640 1 -- 172.21.15.79:0/713435948 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 47) ==== 8394+0+0 (secure 0 0 0) 0x7f442c0a9110 con 0x55c6e6d0ec40 2024-08-20T01:48:03.106 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.100+0000 7f4445245740 10 client.18345 fetch_fsmap finished waiting for FSMap version 47 2024-08-20T01:48:03.106 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.100+0000 7f4445245740 10 client.18345 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:48:03.106 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.100+0000 7f4445245740 20 client.18345 populate_metadata read hostname 'smithi079' 2024-08-20T01:48:03.106 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.100+0000 7f4445245740 1 --2- 172.21.15.79:0/713435948 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55c6e6d1edb0 0x55c6e6d21270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:03.107 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.100+0000 7f4445245740 4 client.18345 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:48:03.107 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.100+0000 7f4445245740 1 -- 172.21.15.79:0/713435948 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c6e6c7e2b0 con 0x55c6e6d1edb0 2024-08-20T01:48:03.107 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.101+0000 7f443bfff640 1 --2- 172.21.15.79:0/713435948 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55c6e6d1edb0 0x55c6e6d21270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:03.108 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.101+0000 7f443bfff640 1 --2- 172.21.15.79:0/713435948 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55c6e6d1edb0 0x55c6e6d21270 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb089b18f7de73dc server_cookie=2a6ca84bdd8838c9 in_seq=0 out_seq=0 2024-08-20T01:48:03.108 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.101+0000 7f441b7fe640 10 client.18345 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:03.108 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.102+0000 7f441b7fe640 1 -- 172.21.15.79:0/713435948 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c6e6c7e2b0 con 0x55c6e6d1edb0 2024-08-20T01:48:03.108 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.102+0000 7f441b7fe640 10 client.18345 handle_command_reply: tid=0 2024-08-20T01:48:03.108 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.103+0000 7f4445245740 1 client.18345 shutdown 2024-08-20T01:48:03.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.104+0000 7f4445245740 1 -- 172.21.15.79:0/713435948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c6e6d0ec40 msgr2=0x55c6e6d142d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:03.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.104+0000 7f4445245740 1 --2- 172.21.15.79:0/713435948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c6e6d0ec40 0x55c6e6d142d0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f442c0a7480 tx=0x7f442c0a9d20 comp rx=0 tx=0).stop 2024-08-20T01:48:03.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.104+0000 7f4445245740 1 -- 172.21.15.79:0/713435948 shutdown_connections 2024-08-20T01:48:03.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.104+0000 7f4445245740 1 --2- 172.21.15.79:0/713435948 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55c6e6d1edb0 0x55c6e6d21270 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.104+0000 7f4445245740 1 --2- 172.21.15.79:0/713435948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c6e6d0ec40 0x55c6e6d142d0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.104+0000 7f4445245740 1 --2- 172.21.15.79:0/713435948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6e6d0c200 0x55c6e6d13700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.104+0000 7f4445245740 1 --2- 172.21.15.79:0/713435948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6e6d098d0 0x55c6e6d13060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.104+0000 7f4445245740 1 -- 172.21.15.79:0/713435948 >> 172.21.15.79:0/713435948 conn(0x55c6e6d04a20 msgr2=0x55c6e6d03ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:03.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.104+0000 7f441b7fe640 0 client.18345 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:03.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.105+0000 7f4445245740 1 -- 172.21.15.79:0/713435948 shutdown_connections 2024-08-20T01:48:03.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.105+0000 7f4445245740 1 -- 172.21.15.79:0/713435948 wait complete. 2024-08-20T01:48:03.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.105+0000 7f4445245740 20 client.18345 trim_cache size 0 max 16384 2024-08-20T01:48:03.137 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.135+0000 7f4445245740 1 Processor -- start 2024-08-20T01:48:03.138 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.135+0000 7f4445245740 1 -- start start 2024-08-20T01:48:03.139 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.135+0000 7f4445245740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6e6d098d0 0x55c6e6cff780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:03.139 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.136+0000 7f4445245740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c6e6d0c200 0x55c6e6d05280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:03.139 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.136+0000 7f443bfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6e6d098d0 0x55c6e6cff780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:03.139 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.136+0000 7f443bfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6e6d098d0 0x55c6e6cff780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:36796/0 (socket says 172.21.15.79:36796) 2024-08-20T01:48:03.139 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.136+0000 7f443b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c6e6d0c200 0x55c6e6d05280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:03.139 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.136+0000 7f443b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c6e6d0c200 0x55c6e6d05280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59822/0 (socket says 172.21.15.79:59822) 2024-08-20T01:48:03.139 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.136+0000 7f4445245740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6e6d0ec40 0x55c6e6d057c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:03.139 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.136+0000 7f443bfff640 1 -- 172.21.15.79:0/3813038597 learned_addr learned my addr 172.21.15.79:0/3813038597 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:03.139 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.136+0000 7f4445245740 1 -- 172.21.15.79:0/3813038597 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f443c1c1160 con 0x55c6e6d0c200 2024-08-20T01:48:03.140 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.137+0000 7f4445245740 1 -- 172.21.15.79:0/3813038597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f443c1c2e20 con 0x55c6e6d0ec40 2024-08-20T01:48:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.137+0000 7f4445245740 1 -- 172.21.15.79:0/3813038597 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f443c1c18f0 con 0x55c6e6d098d0 2024-08-20T01:48:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.137+0000 7f44409ec640 1 --2- 172.21.15.79:0/3813038597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6e6d0ec40 0x55c6e6d057c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.137+0000 7f44409ec640 1 -- 172.21.15.79:0/3813038597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6e6d098d0 msgr2=0x55c6e6cff780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.137+0000 7f44409ec640 1 --2- 172.21.15.79:0/3813038597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6e6d098d0 0x55c6e6cff780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.137+0000 7f44409ec640 1 -- 172.21.15.79:0/3813038597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c6e6d0c200 msgr2=0x55c6e6d05280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.137+0000 7f44409ec640 1 --2- 172.21.15.79:0/3813038597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c6e6d0c200 0x55c6e6d05280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.137+0000 7f44409ec640 1 -- 172.21.15.79:0/3813038597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6e6d13a70 con 0x55c6e6d0ec40 2024-08-20T01:48:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.138+0000 7f443bfff640 1 --2- 172.21.15.79:0/3813038597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6e6d098d0 0x55c6e6cff780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:48:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.138+0000 7f44409ec640 1 --2- 172.21.15.79:0/3813038597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6e6d0ec40 0x55c6e6d057c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f442c004700 tx=0x7f442c00bf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f80e91c428d180e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.138+0000 7f443b7fe640 1 --2- 172.21.15.79:0/3813038597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c6e6d0c200 0x55c6e6d05280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:48:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.138+0000 7f4421ffb640 1 -- 172.21.15.79:0/3813038597 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442c0a9b60 con 0x55c6e6d0ec40 2024-08-20T01:48:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.138+0000 7f4421ffb640 1 -- 172.21.15.79:0/3813038597 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f442c0c9020 con 0x55c6e6d0ec40 2024-08-20T01:48:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.138+0000 7f4421ffb640 1 -- 172.21.15.79:0/3813038597 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442c0a60d0 con 0x55c6e6d0ec40 2024-08-20T01:48:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.139+0000 7f4445245740 1 -- 172.21.15.79:0/3813038597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6e6d0ec40 msgr2=0x55c6e6d057c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.139+0000 7f4445245740 1 --2- 172.21.15.79:0/3813038597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6e6d0ec40 0x55c6e6d057c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f442c004700 tx=0x7f442c00bf90 comp rx=0 tx=0).stop 2024-08-20T01:48:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.139+0000 7f4445245740 1 -- 172.21.15.79:0/3813038597 shutdown_connections 2024-08-20T01:48:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.139+0000 7f4445245740 1 --2- 172.21.15.79:0/3813038597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6e6d0ec40 0x55c6e6d057c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.139+0000 7f4445245740 1 --2- 172.21.15.79:0/3813038597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c6e6d0c200 0x55c6e6d05280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.139+0000 7f4445245740 1 --2- 172.21.15.79:0/3813038597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6e6d098d0 0x55c6e6cff780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.139+0000 7f4445245740 1 -- 172.21.15.79:0/3813038597 >> 172.21.15.79:0/3813038597 conn(0x55c6e6d04a20 msgr2=0x55c6e6d105b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:03.144 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.139+0000 7f4445245740 1 -- 172.21.15.79:0/3813038597 shutdown_connections 2024-08-20T01:48:03.144 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.139+0000 7f4445245740 1 -- 172.21.15.79:0/3813038597 wait complete. 2024-08-20T01:48:03.144 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.140+0000 7f4445245740 1 -- start start 2024-08-20T01:48:03.144 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.140+0000 7f4445245740 1 Processor -- start 2024-08-20T01:48:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.141+0000 7f4445245740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6e6d098d0 0x55c6e6d17bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.141+0000 7f4445245740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c6e6d0c200 0x55c6e6d18250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.141+0000 7f4445245740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6e6d0ec40 0x55c6e6d18dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.141+0000 7f4445245740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f443c1c2750 con 0x55c6e6d0c200 2024-08-20T01:48:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.141+0000 7f4445245740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f443c1c1fc0 con 0x55c6e6d098d0 2024-08-20T01:48:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.141+0000 7f4445245740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f443c1bf140 con 0x55c6e6d0ec40 2024-08-20T01:48:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.141+0000 7f4445245740 10 client.0 _ll_register_callbacks cb 0x7f442c010380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:48:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.141+0000 7f443bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6e6d098d0 0x55c6e6d17bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:03.148 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.141+0000 7f443bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6e6d098d0 0x55c6e6d17bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:33370/0 (socket says 172.21.15.79:33370) 2024-08-20T01:48:03.148 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.141+0000 7f443bfff640 1 -- 172.21.15.79:0/1301076964 learned_addr learned my addr 172.21.15.79:0/1301076964 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:03.148 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.141+0000 7f443b7fe640 1 --2- 172.21.15.79:0/1301076964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c6e6d0c200 0x55c6e6d18250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:03.148 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.141+0000 7f44409ec640 1 --2- 172.21.15.79:0/1301076964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6e6d0ec40 0x55c6e6d18dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:03.148 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.141+0000 7f443bfff640 1 -- 172.21.15.79:0/1301076964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6e6d0ec40 msgr2=0x55c6e6d18dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:03.148 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.141+0000 7f443bfff640 1 --2- 172.21.15.79:0/1301076964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6e6d0ec40 0x55c6e6d18dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.148 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.141+0000 7f443bfff640 1 -- 172.21.15.79:0/1301076964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c6e6d0c200 msgr2=0x55c6e6d18250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:03.148 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.141+0000 7f443bfff640 1 --2- 172.21.15.79:0/1301076964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c6e6d0c200 0x55c6e6d18250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.148 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.142+0000 7f443bfff640 1 -- 172.21.15.79:0/1301076964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6e6d0c030 con 0x55c6e6d098d0 2024-08-20T01:48:03.148 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.142+0000 7f44409ec640 1 --2- 172.21.15.79:0/1301076964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6e6d0ec40 0x55c6e6d18dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:48:03.148 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.142+0000 7f443bfff640 1 --2- 172.21.15.79:0/1301076964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6e6d098d0 0x55c6e6d17bb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f44340093d0 tx=0x7f4434005bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bb173f6afa50396 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:03.149 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.142+0000 7f441b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:48:03.149 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.142+0000 7f441b7fe640 1 -- 172.21.15.79:0/1301076964 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4434031500 con 0x55c6e6d098d0 2024-08-20T01:48:03.149 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.142+0000 7f441b7fe640 1 -- 172.21.15.79:0/1301076964 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f44340316a0 con 0x55c6e6d098d0 2024-08-20T01:48:03.149 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.142+0000 7f4445245740 1 -- 172.21.15.79:0/1301076964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f442c0c9020 con 0x55c6e6d098d0 2024-08-20T01:48:03.149 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.142+0000 7f441b7fe640 1 -- 172.21.15.79:0/1301076964 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f443405f050 con 0x55c6e6d098d0 2024-08-20T01:48:03.149 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.142+0000 7f4445245740 10 client.27392 fetch_fsmap learned FSMap version 47 2024-08-20T01:48:03.149 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.142+0000 7f4445245740 1 -- 172.21.15.79:0/1301076964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55c6e6d1a7d0 con 0x55c6e6d098d0 2024-08-20T01:48:03.149 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.143+0000 7f441b7fe640 1 -- 172.21.15.79:0/1301076964 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f442c0c9020 con 0x55c6e6d098d0 2024-08-20T01:48:03.149 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.143+0000 7f441b7fe640 1 -- 172.21.15.79:0/1301076964 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 47) ==== 8394+0+0 (secure 0 0 0) 0x7f443404d070 con 0x55c6e6d098d0 2024-08-20T01:48:03.149 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.143+0000 7f4445245740 10 client.27392 fetch_fsmap finished waiting for FSMap version 47 2024-08-20T01:48:03.149 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.143+0000 7f4445245740 10 client.27392 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:48:03.149 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.143+0000 7f4445245740 20 client.27392 populate_metadata read hostname 'smithi079' 2024-08-20T01:48:03.149 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.143+0000 7f4445245740 1 --2- 172.21.15.79:0/1301076964 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55c6e6d1ad50 0x55c6e6d8bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:03.150 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.143+0000 7f4445245740 4 client.27392 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:48:03.150 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.143+0000 7f4445245740 1 -- 172.21.15.79:0/1301076964 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c6e6c79d50 con 0x55c6e6d1ad50 2024-08-20T01:48:03.150 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.143+0000 7f443b7fe640 1 --2- 172.21.15.79:0/1301076964 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55c6e6d1ad50 0x55c6e6d8bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:03.150 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.144+0000 7f441b7fe640 10 client.27392 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:03.150 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.144+0000 7f443b7fe640 1 --2- 172.21.15.79:0/1301076964 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55c6e6d1ad50 0x55c6e6d8bb60 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17f167f773fc0e41 server_cookie=4647c41f0a1bdca6 in_seq=0 out_seq=0 2024-08-20T01:48:03.183 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.181+0000 7f441b7fe640 1 -- 172.21.15.79:0/1301076964 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c6e6c79d50 con 0x55c6e6d1ad50 2024-08-20T01:48:03.183 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.181+0000 7f441b7fe640 10 client.27392 handle_command_reply: tid=0 2024-08-20T01:48:03.184 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.181+0000 7f4445245740 1 client.27392 shutdown 2024-08-20T01:48:03.184 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.182+0000 7f4445245740 1 -- 172.21.15.79:0/1301076964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6e6d098d0 msgr2=0x55c6e6d17bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:03.184 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.182+0000 7f4445245740 1 --2- 172.21.15.79:0/1301076964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6e6d098d0 0x55c6e6d17bb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f44340093d0 tx=0x7f4434005bf0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.182+0000 7f4445245740 1 -- 172.21.15.79:0/1301076964 shutdown_connections 2024-08-20T01:48:03.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.182+0000 7f4445245740 1 --2- 172.21.15.79:0/1301076964 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55c6e6d1ad50 0x55c6e6d8bb60 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.182+0000 7f4445245740 1 --2- 172.21.15.79:0/1301076964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6e6d0ec40 0x55c6e6d18dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.182+0000 7f4445245740 1 --2- 172.21.15.79:0/1301076964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c6e6d0c200 0x55c6e6d18250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.182+0000 7f4445245740 1 --2- 172.21.15.79:0/1301076964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6e6d098d0 0x55c6e6d17bb0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.182+0000 7f4445245740 1 -- 172.21.15.79:0/1301076964 >> 172.21.15.79:0/1301076964 conn(0x55c6e6d04a20 msgr2=0x55c6e6d105b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:03.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.182+0000 7f441b7fe640 0 client.27392 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:03.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.183+0000 7f4445245740 1 -- 172.21.15.79:0/1301076964 shutdown_connections 2024-08-20T01:48:03.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.183+0000 7f4445245740 1 -- 172.21.15.79:0/1301076964 wait complete. 2024-08-20T01:48:03.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.183+0000 7f4445245740 20 client.27392 trim_cache size 0 max 16384 2024-08-20T01:48:03.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:48:03.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:48:03.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:48:03.187 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:48:03.189 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.186+0000 7f444244f640 1 -- 172.21.15.79:0/750526439 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f44240b3c80 msgr2=0x7f44240b6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:03.189 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.186+0000 7f444244f640 1 --2- 172.21.15.79:0/750526439 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f44240b3c80 0x7f44240b6140 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f443000da60 tx=0x7f4430006f30 comp rx=0 tx=0).stop 2024-08-20T01:48:03.189 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.187+0000 7f444244f640 1 -- 172.21.15.79:0/750526439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f443c10eb70 msgr2=0x7f443c1a02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:03.189 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.187+0000 7f444244f640 1 --2- 172.21.15.79:0/750526439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f443c10eb70 0x7f443c1a02c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f442c009fd0 tx=0x7f442c00b8e0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.190 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.187+0000 7f444244f640 1 -- 172.21.15.79:0/750526439 shutdown_connections 2024-08-20T01:48:03.190 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.187+0000 7f444244f640 1 --2- 172.21.15.79:0/750526439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f443c10eb70 0x7f443c1a02c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.187+0000 7f444244f640 1 --2- 172.21.15.79:0/750526439 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f44240b3c80 0x7f44240b6140 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.187+0000 7f444244f640 1 --2- 172.21.15.79:0/750526439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f443c10e1b0 0x7f443c19f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.187+0000 7f444244f640 1 --2- 172.21.15.79:0/750526439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f443c10d150 0x7f443c19f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.187+0000 7f444244f640 1 -- 172.21.15.79:0/750526439 >> 172.21.15.79:0/750526439 conn(0x7f443c06ce10 msgr2=0x7f443c070410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:03.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.187+0000 7f444244f640 1 -- 172.21.15.79:0/750526439 shutdown_connections 2024-08-20T01:48:03.191 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:03.188+0000 7f444244f640 1 -- 172.21.15.79:0/750526439 wait complete. 2024-08-20T01:48:03.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.624+0000 7f1d4d747640 1 -- 172.21.15.79:0/1779776638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d48109e80 msgr2=0x7f1d48110ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:03.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.624+0000 7f1d4d747640 1 --2- 172.21.15.79:0/1779776638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d48109e80 0x7f1d48110ee0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009930 tx=0x7f1d3c02a420 comp rx=0 tx=0).stop 2024-08-20T01:48:03.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.624+0000 7f1d4d747640 1 -- 172.21.15.79:0/1779776638 shutdown_connections 2024-08-20T01:48:03.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.624+0000 7f1d4d747640 1 --2- 172.21.15.79:0/1779776638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d4811bdd0 0x7f1d4811e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.624+0000 7f1d4d747640 1 --2- 172.21.15.79:0/1779776638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d4810a260 0x7f1d4810a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.624+0000 7f1d4d747640 1 --2- 172.21.15.79:0/1779776638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d48109e80 0x7f1d48110ee0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.625+0000 7f1d4d747640 1 -- 172.21.15.79:0/1779776638 >> 172.21.15.79:0/1779776638 conn(0x7f1d4806c830 msgr2=0x7f1d4806cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:03.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.625+0000 7f1d4d747640 1 -- 172.21.15.79:0/1779776638 shutdown_connections 2024-08-20T01:48:03.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.625+0000 7f1d4d747640 1 -- 172.21.15.79:0/1779776638 wait complete. 2024-08-20T01:48:03.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.626+0000 7f1d4d747640 1 Processor -- start 2024-08-20T01:48:03.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.626+0000 7f1d4d747640 1 -- start start 2024-08-20T01:48:03.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.626+0000 7f1d4d747640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d48109e80 0x7f1d4811b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:03.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.626+0000 7f1d4d747640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d4810a260 0x7f1d4811b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:03.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.626+0000 7f1d4d747640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d4811bdd0 0x7f1d481152b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:03.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.626+0000 7f1d4d747640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1d48111d10 con 0x7f1d4811bdd0 2024-08-20T01:48:03.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.626+0000 7f1d4d747640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1d48111b90 con 0x7f1d48109e80 2024-08-20T01:48:03.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.626+0000 7f1d4d747640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1d48111e90 con 0x7f1d4810a260 2024-08-20T01:48:03.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.627+0000 7f1d4cf46640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d4811bdd0 0x7f1d481152b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:03.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.627+0000 7f1d4cf46640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d4811bdd0 0x7f1d481152b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59856/0 (socket says 172.21.15.79:59856) 2024-08-20T01:48:03.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.627+0000 7f1d4cf46640 1 -- 172.21.15.79:0/3654900703 learned_addr learned my addr 172.21.15.79:0/3654900703 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:03.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.627+0000 7f1d477fe640 1 --2- 172.21.15.79:0/3654900703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d4810a260 0x7f1d4811b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:03.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.628+0000 7f1d47fff640 1 --2- 172.21.15.79:0/3654900703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d48109e80 0x7f1d4811b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:03.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.628+0000 7f1d4cf46640 1 -- 172.21.15.79:0/3654900703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d4810a260 msgr2=0x7f1d4811b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:03.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.628+0000 7f1d4cf46640 1 --2- 172.21.15.79:0/3654900703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d4810a260 0x7f1d4811b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.628+0000 7f1d4cf46640 1 -- 172.21.15.79:0/3654900703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d48109e80 msgr2=0x7f1d4811b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:03.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.628+0000 7f1d4cf46640 1 --2- 172.21.15.79:0/3654900703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d48109e80 0x7f1d4811b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.628+0000 7f1d4cf46640 1 -- 172.21.15.79:0/3654900703 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d48115b70 con 0x7f1d4811bdd0 2024-08-20T01:48:03.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.628+0000 7f1d4cf46640 1 --2- 172.21.15.79:0/3654900703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d4811bdd0 0x7f1d481152b0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f1d4000eb10 tx=0x7f1d4000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:03.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.628+0000 7f1d457fa640 1 -- 172.21.15.79:0/3654900703 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d40004b20 con 0x7f1d4811bdd0 2024-08-20T01:48:03.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.628+0000 7f1d457fa640 1 -- 172.21.15.79:0/3654900703 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d40004cc0 con 0x7f1d4811bdd0 2024-08-20T01:48:03.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.628+0000 7f1d457fa640 1 -- 172.21.15.79:0/3654900703 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d40010690 con 0x7f1d4811bdd0 2024-08-20T01:48:03.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.628+0000 7f1d4d747640 1 -- 172.21.15.79:0/3654900703 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d48115e60 con 0x7f1d4811bdd0 2024-08-20T01:48:03.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.628+0000 7f1d4d747640 1 -- 172.21.15.79:0/3654900703 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d481bce10 con 0x7f1d4811bdd0 2024-08-20T01:48:03.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.632+0000 7f1d50da2740 1 Processor -- start 2024-08-20T01:48:03.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.633+0000 7f1d50da2740 1 -- start start 2024-08-20T01:48:03.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.633+0000 7f1d50da2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614135e6530 0x5614135e6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:03.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.633+0000 7f1d50da2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614135e6e50 0x5614135f28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:03.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.633+0000 7f1d50da2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614135f2de0 0x5614135f51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:03.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.633+0000 7f1d50da2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56141355c940 con 0x5614135e6530 2024-08-20T01:48:03.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.633+0000 7f1d50da2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56141354be40 con 0x5614135e6e50 2024-08-20T01:48:03.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.633+0000 7f1d50da2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56141354fe80 con 0x5614135f2de0 2024-08-20T01:48:03.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.633+0000 7f1d477fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614135e6530 0x5614135e6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:03.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.633+0000 7f1d477fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614135e6530 0x5614135e6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59870/0 (socket says 172.21.15.79:59870) 2024-08-20T01:48:03.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.633+0000 7f1d477fe640 1 -- 172.21.15.79:0/3337988600 learned_addr learned my addr 172.21.15.79:0/3337988600 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:03.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.633+0000 7f1d47fff640 1 --2- 172.21.15.79:0/3337988600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614135e6e50 0x5614135f28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:03.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.633+0000 7f1d477fe640 1 --2- 172.21.15.79:0/3337988600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614135f2de0 0x5614135f51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:03.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.634+0000 7f1d477fe640 1 -- 172.21.15.79:0/3337988600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614135f2de0 msgr2=0x5614135f51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:03.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.634+0000 7f1d477fe640 1 --2- 172.21.15.79:0/3337988600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614135f2de0 0x5614135f51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.634+0000 7f1d477fe640 1 -- 172.21.15.79:0/3337988600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614135e6e50 msgr2=0x5614135f28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:03.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.634+0000 7f1d477fe640 1 --2- 172.21.15.79:0/3337988600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614135e6e50 0x5614135f28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.634+0000 7f1d477fe640 1 -- 172.21.15.79:0/3337988600 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614134e8520 con 0x5614135e6530 2024-08-20T01:48:03.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.634+0000 7f1d47fff640 1 --2- 172.21.15.79:0/3337988600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614135e6e50 0x5614135f28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:48:03.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.634+0000 7f1d477fe640 1 --2- 172.21.15.79:0/3337988600 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614135e6530 0x5614135e6910 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f1d38009f90 tx=0x7f1d38009770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc7c269ea3a9a78e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:03.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.635+0000 7f1d2e7fc640 1 -- 172.21.15.79:0/3337988600 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d38004050 con 0x5614135e6530 2024-08-20T01:48:03.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.635+0000 7f1d2e7fc640 1 -- 172.21.15.79:0/3337988600 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d380035f0 con 0x5614135e6530 2024-08-20T01:48:03.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.635+0000 7f1d2e7fc640 1 -- 172.21.15.79:0/3337988600 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d38032700 con 0x5614135e6530 2024-08-20T01:48:03.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.636+0000 7f1d50da2740 1 -- 172.21.15.79:0/3337988600 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614135e6530 msgr2=0x5614135e6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:03.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.636+0000 7f1d50da2740 1 --2- 172.21.15.79:0/3337988600 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614135e6530 0x5614135e6910 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f1d38009f90 tx=0x7f1d38009770 comp rx=0 tx=0).stop 2024-08-20T01:48:03.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.640+0000 7f1d50da2740 1 -- 172.21.15.79:0/3337988600 shutdown_connections 2024-08-20T01:48:03.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.640+0000 7f1d457fa640 1 -- 172.21.15.79:0/3654900703 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1d40005020 con 0x7f1d4811bdd0 2024-08-20T01:48:03.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.640+0000 7f1d50da2740 1 --2- 172.21.15.79:0/3337988600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614135f2de0 0x5614135f51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.640+0000 7f1d50da2740 1 --2- 172.21.15.79:0/3337988600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614135e6e50 0x5614135f28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.640+0000 7f1d50da2740 1 --2- 172.21.15.79:0/3337988600 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614135e6530 0x5614135e6910 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.640+0000 7f1d50da2740 1 -- 172.21.15.79:0/3337988600 >> 172.21.15.79:0/3337988600 conn(0x5614135e4360 msgr2=0x5614135e5500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:03.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.640+0000 7f1d50da2740 1 -- 172.21.15.79:0/3337988600 shutdown_connections 2024-08-20T01:48:03.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.640+0000 7f1d50da2740 1 -- 172.21.15.79:0/3337988600 wait complete. 2024-08-20T01:48:03.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.641+0000 7f1d50da2740 1 -- start start 2024-08-20T01:48:03.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.641+0000 7f1d50da2740 1 Processor -- start 2024-08-20T01:48:03.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.642+0000 7f1d50da2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614135e6530 0x5614135efe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:03.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.642+0000 7f1d50da2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614135e6e50 0x5614135f0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:03.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.642+0000 7f1d50da2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614135f2de0 0x5614135f0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:03.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.642+0000 7f1d50da2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5614133ae890 con 0x5614135e6530 2024-08-20T01:48:03.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.642+0000 7f1d50da2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5614134d2700 con 0x5614135f2de0 2024-08-20T01:48:03.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.642+0000 7f1d50da2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5614135f5b30 con 0x5614135e6e50 2024-08-20T01:48:03.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.642+0000 7f1d50da2740 10 client.0 _ll_register_callbacks cb 0x5614135476f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:48:03.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.642+0000 7f1d477fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614135e6530 0x5614135efe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:03.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.643+0000 7f1d47fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614135e6e50 0x5614135f0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:03.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.643+0000 7f1d47fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614135e6e50 0x5614135f0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:36844/0 (socket says 172.21.15.79:36844) 2024-08-20T01:48:03.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.643+0000 7f1d47fff640 1 -- 172.21.15.79:0/2871212807 learned_addr learned my addr 172.21.15.79:0/2871212807 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:03.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.643+0000 7f1d457fa640 1 --2- 172.21.15.79:0/3654900703 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1d300b3cd0 0x7f1d300b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:03.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.643+0000 7f1d457fa640 1 -- 172.21.15.79:0/3654900703 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f1d400e42b0 con 0x7f1d4811bdd0 2024-08-20T01:48:03.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.644+0000 7f1d477fe640 1 --2- 172.21.15.79:0/2871212807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614135f2de0 0x5614135f0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:03.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.644+0000 7f1d4cf46640 1 --2- 172.21.15.79:0/3654900703 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1d300b3cd0 0x7f1d300b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:03.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.644+0000 7f1d477fe640 1 -- 172.21.15.79:0/2871212807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614135e6e50 msgr2=0x5614135f0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:03.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.644+0000 7f1d477fe640 1 --2- 172.21.15.79:0/2871212807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614135e6e50 0x5614135f0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.644+0000 7f1d477fe640 1 -- 172.21.15.79:0/2871212807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614135f2de0 msgr2=0x5614135f0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:03.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.644+0000 7f1d477fe640 1 --2- 172.21.15.79:0/2871212807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614135f2de0 0x5614135f0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.644+0000 7f1d477fe640 1 -- 172.21.15.79:0/2871212807 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614132ab930 con 0x5614135e6530 2024-08-20T01:48:03.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.644+0000 7f1d4cf46640 1 --2- 172.21.15.79:0/3654900703 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1d300b3cd0 0x7f1d300b6190 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1d400ab140 tx=0x7f1d4000cee0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:03.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.645+0000 7f1d477fe640 1 --2- 172.21.15.79:0/2871212807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614135e6530 0x5614135efe10 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f1d38009f60 tx=0x7f1d38005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b08a7211e1144c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:03.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.645+0000 7f1d277fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:48:03.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.646+0000 7f1d277fe640 1 -- 172.21.15.79:0/2871212807 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d38003be0 con 0x5614135e6530 2024-08-20T01:48:03.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.646+0000 7f1d50da2740 1 -- 172.21.15.79:0/2871212807 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d380035f0 con 0x5614135e6530 2024-08-20T01:48:03.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.646+0000 7f1d277fe640 1 -- 172.21.15.79:0/2871212807 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f1d38033480 con 0x5614135e6530 2024-08-20T01:48:03.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.646+0000 7f1d277fe640 1 -- 172.21.15.79:0/2871212807 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f1d38033680 con 0x5614135e6530 2024-08-20T01:48:03.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.646+0000 7f1d50da2740 10 client.18360 fetch_fsmap learned FSMap version 47 2024-08-20T01:48:03.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.646+0000 7f1d50da2740 1 -- 172.21.15.79:0/2871212807 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x561413601720 con 0x5614135e6530 2024-08-20T01:48:03.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.646+0000 7f1d277fe640 1 -- 172.21.15.79:0/2871212807 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d380035f0 con 0x5614135e6530 2024-08-20T01:48:03.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.646+0000 7f1d277fe640 1 -- 172.21.15.79:0/2871212807 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 47) ==== 8394+0+0 (secure 0 0 0) 0x7f1d38050450 con 0x5614135e6530 2024-08-20T01:48:03.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.647+0000 7f1d50da2740 10 client.18360 fetch_fsmap finished waiting for FSMap version 47 2024-08-20T01:48:03.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.647+0000 7f1d50da2740 10 client.18360 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:48:03.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.647+0000 7f1d50da2740 20 client.18360 populate_metadata read hostname 'smithi079' 2024-08-20T01:48:03.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.647+0000 7f1d50da2740 1 --2- 172.21.15.79:0/2871212807 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x561413602d50 0x561413605190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:03.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.647+0000 7f1d50da2740 4 client.18360 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:48:03.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.647+0000 7f1d50da2740 1 -- 172.21.15.79:0/2871212807 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56141355e890 con 0x561413602d50 2024-08-20T01:48:03.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.647+0000 7f1d47fff640 1 --2- 172.21.15.79:0/2871212807 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x561413602d50 0x561413605190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:03.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.648+0000 7f1d47fff640 1 --2- 172.21.15.79:0/2871212807 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x561413602d50 0x561413605190 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9521ac7757395a2 server_cookie=f1679c274cdf23ad in_seq=0 out_seq=0 2024-08-20T01:48:03.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.648+0000 7f1d277fe640 10 client.18360 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:03.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.649+0000 7f1d277fe640 1 -- 172.21.15.79:0/2871212807 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56141355e890 con 0x561413602d50 2024-08-20T01:48:03.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.649+0000 7f1d277fe640 10 client.18360 handle_command_reply: tid=0 2024-08-20T01:48:03.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.649+0000 7f1d50da2740 1 client.18360 shutdown 2024-08-20T01:48:03.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.649+0000 7f1d50da2740 1 -- 172.21.15.79:0/2871212807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614135e6530 msgr2=0x5614135efe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:03.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.649+0000 7f1d50da2740 1 --2- 172.21.15.79:0/2871212807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614135e6530 0x5614135efe10 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f1d38009f60 tx=0x7f1d38005f90 comp rx=0 tx=0).stop 2024-08-20T01:48:03.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.649+0000 7f1d50da2740 1 -- 172.21.15.79:0/2871212807 shutdown_connections 2024-08-20T01:48:03.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.649+0000 7f1d50da2740 1 --2- 172.21.15.79:0/2871212807 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x561413602d50 0x561413605190 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.649+0000 7f1d50da2740 1 --2- 172.21.15.79:0/2871212807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614135f2de0 0x5614135f0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.649+0000 7f1d50da2740 1 --2- 172.21.15.79:0/2871212807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614135e6e50 0x5614135f0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.649+0000 7f1d50da2740 1 --2- 172.21.15.79:0/2871212807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614135e6530 0x5614135efe10 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.649+0000 7f1d50da2740 1 -- 172.21.15.79:0/2871212807 >> 172.21.15.79:0/2871212807 conn(0x5614135e4360 msgr2=0x5614135e9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:03.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.649+0000 7f1d277fe640 0 client.18360 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:03.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.649+0000 7f1d50da2740 1 -- 172.21.15.79:0/2871212807 shutdown_connections 2024-08-20T01:48:03.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.650+0000 7f1d50da2740 1 -- 172.21.15.79:0/2871212807 wait complete. 2024-08-20T01:48:03.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.650+0000 7f1d50da2740 20 client.18360 trim_cache size 0 max 16384 2024-08-20T01:48:03.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.680+0000 7f1d50da2740 1 Processor -- start 2024-08-20T01:48:03.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.681+0000 7f1d50da2740 1 -- start start 2024-08-20T01:48:03.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.681+0000 7f1d50da2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614135e6530 0x5614135f0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:03.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.681+0000 7f1d50da2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614135e6e50 0x56141360aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:03.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.681+0000 7f1d50da2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614135f2de0 0x56141360afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:03.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.681+0000 7f1d50da2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4807d490 con 0x5614135e6e50 2024-08-20T01:48:03.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.681+0000 7f1d50da2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4807f150 con 0x5614135f2de0 2024-08-20T01:48:03.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.681+0000 7f1d50da2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4807dc20 con 0x5614135e6530 2024-08-20T01:48:03.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.682+0000 7f1d477fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614135e6530 0x5614135f0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:03.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.682+0000 7f1d47fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614135e6e50 0x56141360aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:03.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.682+0000 7f1d477fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614135e6530 0x5614135f0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:36858/0 (socket says 172.21.15.79:36858) 2024-08-20T01:48:03.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.682+0000 7f1d47fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614135e6e50 0x56141360aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59884/0 (socket says 172.21.15.79:59884) 2024-08-20T01:48:03.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.682+0000 7f1d477fe640 1 -- 172.21.15.79:0/1743933280 learned_addr learned my addr 172.21.15.79:0/1743933280 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:03.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.682+0000 7f1d477fe640 1 --2- 172.21.15.79:0/1743933280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614135f2de0 0x56141360afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:03.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.682+0000 7f1d47fff640 1 -- 172.21.15.79:0/1743933280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614135e6530 msgr2=0x5614135f0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:03.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.682+0000 7f1d47fff640 1 --2- 172.21.15.79:0/1743933280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614135e6530 0x5614135f0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.682+0000 7f1d47fff640 1 -- 172.21.15.79:0/1743933280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614135f2de0 msgr2=0x56141360afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:03.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.682+0000 7f1d47fff640 1 --2- 172.21.15.79:0/1743933280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614135f2de0 0x56141360afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.682+0000 7f1d47fff640 1 -- 172.21.15.79:0/1743933280 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614135e4190 con 0x5614135e6e50 2024-08-20T01:48:03.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.682+0000 7f1d47fff640 1 --2- 172.21.15.79:0/1743933280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614135e6e50 0x56141360aaa0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009850 tx=0x7f1d3c005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=182d7582c0465b52 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:03.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.683+0000 7f1d2dffb640 1 -- 172.21.15.79:0/1743933280 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c035040 con 0x5614135e6e50 2024-08-20T01:48:03.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.683+0000 7f1d2dffb640 1 -- 172.21.15.79:0/1743933280 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56141355e890 con 0x5614135e6e50 2024-08-20T01:48:03.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.683+0000 7f1d2dffb640 1 -- 172.21.15.79:0/1743933280 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c004b20 con 0x5614135e6e50 2024-08-20T01:48:03.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.684+0000 7f1d50da2740 1 -- 172.21.15.79:0/1743933280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614135e6e50 msgr2=0x56141360aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:03.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.684+0000 7f1d50da2740 1 --2- 172.21.15.79:0/1743933280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614135e6e50 0x56141360aaa0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009850 tx=0x7f1d3c005a20 comp rx=0 tx=0).stop 2024-08-20T01:48:03.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.684+0000 7f1d50da2740 1 -- 172.21.15.79:0/1743933280 shutdown_connections 2024-08-20T01:48:03.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.684+0000 7f1d50da2740 1 --2- 172.21.15.79:0/1743933280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614135f2de0 0x56141360afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.684+0000 7f1d50da2740 1 --2- 172.21.15.79:0/1743933280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614135e6e50 0x56141360aaa0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.684+0000 7f1d50da2740 1 --2- 172.21.15.79:0/1743933280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614135e6530 0x5614135f0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.684+0000 7f1d50da2740 1 -- 172.21.15.79:0/1743933280 >> 172.21.15.79:0/1743933280 conn(0x5614135e4360 msgr2=0x5614135efd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:03.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.684+0000 7f1d50da2740 1 -- 172.21.15.79:0/1743933280 shutdown_connections 2024-08-20T01:48:03.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.684+0000 7f1d50da2740 1 -- 172.21.15.79:0/1743933280 wait complete. 2024-08-20T01:48:03.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.684+0000 7f1d50da2740 1 -- start start 2024-08-20T01:48:03.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.684+0000 7f1d50da2740 1 Processor -- start 2024-08-20T01:48:03.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.685+0000 7f1d50da2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614135e6530 0x5614135fb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:03.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.685+0000 7f1d50da2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614135e6e50 0x5614135f6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:03.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.685+0000 7f1d477fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614135e6530 0x5614135fb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:03.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.685+0000 7f1d477fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614135e6530 0x5614135fb3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:36864/0 (socket says 172.21.15.79:36864) 2024-08-20T01:48:03.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.685+0000 7f1d47fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614135e6e50 0x5614135f6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:03.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.685+0000 7f1d47fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614135e6e50 0x5614135f6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59896/0 (socket says 172.21.15.79:59896) 2024-08-20T01:48:03.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.685+0000 7f1d50da2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614135f2de0 0x5614135f6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:03.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.685+0000 7f1d477fe640 1 -- 172.21.15.79:0/1260489720 learned_addr learned my addr 172.21.15.79:0/1260489720 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:03.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.685+0000 7f1d50da2740 1 -- 172.21.15.79:0/1260489720 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4807ea80 con 0x5614135e6e50 2024-08-20T01:48:03.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.685+0000 7f1d50da2740 1 -- 172.21.15.79:0/1260489720 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4807e2f0 con 0x5614135f2de0 2024-08-20T01:48:03.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.685+0000 7f1d50da2740 1 -- 172.21.15.79:0/1260489720 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1d481165b0 con 0x5614135e6530 2024-08-20T01:48:03.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.685+0000 7f1d477fe640 1 --2- 172.21.15.79:0/1260489720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614135f2de0 0x5614135f6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:03.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.685+0000 7f1d477fe640 1 -- 172.21.15.79:0/1260489720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614135f2de0 msgr2=0x5614135f6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:03.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.685+0000 7f1d477fe640 1 --2- 172.21.15.79:0/1260489720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614135f2de0 0x5614135f6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.685+0000 7f1d477fe640 1 -- 172.21.15.79:0/1260489720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614135e6e50 msgr2=0x5614135f6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:03.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.685+0000 7f1d477fe640 1 --2- 172.21.15.79:0/1260489720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614135e6e50 0x5614135f6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.686+0000 7f1d477fe640 1 -- 172.21.15.79:0/1260489720 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614135e4de0 con 0x5614135e6530 2024-08-20T01:48:03.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.686+0000 7f1d50da2740 10 client.0 _ll_register_callbacks cb 0x7f1d38035410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:48:03.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.686+0000 7f1d50da2740 1 -- 172.21.15.79:0/1260489720 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56141355e890 con 0x5614135e6530 2024-08-20T01:48:03.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.686+0000 7f1d477fe640 1 --2- 172.21.15.79:0/1260489720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614135e6530 0x5614135fb3c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1d38050a10 tx=0x7f1d38005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a49310b4d411e7ad server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:03.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.686+0000 7f1d277fe640 10 client.27388 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:48:03.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.686+0000 7f1d277fe640 1 -- 172.21.15.79:0/1260489720 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d38033480 con 0x5614135e6530 2024-08-20T01:48:03.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.686+0000 7f1d277fe640 1 -- 172.21.15.79:0/1260489720 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f1d38003be0 con 0x5614135e6530 2024-08-20T01:48:03.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.686+0000 7f1d277fe640 1 -- 172.21.15.79:0/1260489720 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f1d38005310 con 0x5614135e6530 2024-08-20T01:48:03.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.687+0000 7f1d50da2740 10 client.27388 fetch_fsmap learned FSMap version 47 2024-08-20T01:48:03.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.687+0000 7f1d50da2740 1 -- 172.21.15.79:0/1260489720 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({fsmap=47}) -- 0x56141366d5a0 con 0x5614135e6530 2024-08-20T01:48:03.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.688+0000 7f1d277fe640 1 -- 172.21.15.79:0/1260489720 <== mon.1 v2:172.21.15.175:3300/0 4 ==== fsmap(e 47) ==== 8394+0+0 (secure 0 0 0) 0x7f1d38050a90 con 0x5614135e6530 2024-08-20T01:48:03.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.688+0000 7f1d50da2740 10 client.27388 fetch_fsmap finished waiting for FSMap version 47 2024-08-20T01:48:03.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.688+0000 7f1d50da2740 10 client.27388 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:48:03.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.688+0000 7f1d50da2740 20 client.27388 populate_metadata read hostname 'smithi079' 2024-08-20T01:48:03.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.688+0000 7f1d50da2740 1 --2- 172.21.15.79:0/1260489720 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56141366dc20 0x5614136700e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:03.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.688+0000 7f1d50da2740 4 client.27388 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T01:48:03.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.688+0000 7f1d50da2740 1 -- 172.21.15.79:0/1260489720 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56141355a330 con 0x56141366dc20 2024-08-20T01:48:03.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.690+0000 7f1d47fff640 1 --2- 172.21.15.79:0/1260489720 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56141366dc20 0x5614136700e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:03.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.690+0000 7f1d277fe640 10 client.27388 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:03.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.690+0000 7f1d47fff640 1 --2- 172.21.15.79:0/1260489720 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56141366dc20 0x5614136700e0 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cde3beaa0e697ed2 server_cookie=7b4893b9c6b748 in_seq=0 out_seq=0 2024-08-20T01:48:03.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.691+0000 7f1d277fe640 1 -- 172.21.15.79:0/1260489720 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56141355a330 con 0x56141366dc20 2024-08-20T01:48:03.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.691+0000 7f1d277fe640 10 client.27388 handle_command_reply: tid=0 2024-08-20T01:48:03.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.691+0000 7f1d50da2740 1 client.27388 shutdown 2024-08-20T01:48:03.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.691+0000 7f1d50da2740 1 -- 172.21.15.79:0/1260489720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614135e6530 msgr2=0x5614135fb3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:03.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.691+0000 7f1d50da2740 1 --2- 172.21.15.79:0/1260489720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614135e6530 0x5614135fb3c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1d38050a10 tx=0x7f1d38005f90 comp rx=0 tx=0).stop 2024-08-20T01:48:03.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.692+0000 7f1d50da2740 1 -- 172.21.15.79:0/1260489720 shutdown_connections 2024-08-20T01:48:03.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.692+0000 7f1d50da2740 1 --2- 172.21.15.79:0/1260489720 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56141366dc20 0x5614136700e0 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.692+0000 7f1d277fe640 0 client.27388 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:03.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.692+0000 7f1d50da2740 1 --2- 172.21.15.79:0/1260489720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614135f2de0 0x5614135f6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.692+0000 7f1d50da2740 1 --2- 172.21.15.79:0/1260489720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614135e6e50 0x5614135f6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.692+0000 7f1d50da2740 1 --2- 172.21.15.79:0/1260489720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614135e6530 0x5614135fb3c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.692+0000 7f1d50da2740 1 -- 172.21.15.79:0/1260489720 >> 172.21.15.79:0/1260489720 conn(0x5614135e4360 msgr2=0x5614135e96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:03.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.692+0000 7f1d50da2740 1 -- 172.21.15.79:0/1260489720 shutdown_connections 2024-08-20T01:48:03.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.692+0000 7f1d50da2740 1 -- 172.21.15.79:0/1260489720 wait complete. 2024-08-20T01:48:03.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.692+0000 7f1d50da2740 20 client.27388 trim_cache size 0 max 16384 2024-08-20T01:48:03.696 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:48:03.696 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-08-20T01:48:03.697 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "46fe1e5e-4722-4336-9357-f6a26f327771", 2024-08-20T01:48:03.697 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-08-20T01:48:03.697 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:48:03.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.693+0000 7f1d4d747640 1 -- 172.21.15.79:0/3654900703 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1d300b3cd0 msgr2=0x7f1d300b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:03.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.693+0000 7f1d4d747640 1 --2- 172.21.15.79:0/3654900703 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1d300b3cd0 0x7f1d300b6190 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1d400ab140 tx=0x7f1d4000cee0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.693+0000 7f1d4d747640 1 -- 172.21.15.79:0/3654900703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d4811bdd0 msgr2=0x7f1d481152b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:03.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.693+0000 7f1d4d747640 1 --2- 172.21.15.79:0/3654900703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d4811bdd0 0x7f1d481152b0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f1d4000eb10 tx=0x7f1d4000c2d0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.694+0000 7f1d4d747640 1 -- 172.21.15.79:0/3654900703 shutdown_connections 2024-08-20T01:48:03.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.694+0000 7f1d4d747640 1 --2- 172.21.15.79:0/3654900703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d4811bdd0 0x7f1d481152b0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.694+0000 7f1d4d747640 1 --2- 172.21.15.79:0/3654900703 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1d300b3cd0 0x7f1d300b6190 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.694+0000 7f1d4d747640 1 --2- 172.21.15.79:0/3654900703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d4810a260 0x7f1d4811b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.694+0000 7f1d4d747640 1 --2- 172.21.15.79:0/3654900703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d48109e80 0x7f1d4811b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:03.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.694+0000 7f1d4d747640 1 -- 172.21.15.79:0/3654900703 >> 172.21.15.79:0/3654900703 conn(0x7f1d4806c830 msgr2=0x7f1d48072490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:03.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.696+0000 7f1d4d747640 1 -- 172.21.15.79:0/3654900703 shutdown_connections 2024-08-20T01:48:03.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:03.696+0000 7f1d4d747640 1 -- 172.21.15.79:0/3654900703 wait complete. 2024-08-20T01:48:04.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:04 smithi081 ceph-mon[22209]: pgmap v669: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 22 MiB/s wr, 5.72k op/s 2024-08-20T01:48:04.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:04 smithi081 ceph-mon[22209]: scrub queued for path: / 2024-08-20T01:48:04.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:04 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:48:04.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:04 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:48:04.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:04 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:48:04.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:04 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:48:04.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:04 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:48:04.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:04 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:48:04.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:04 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:48:04.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:04 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:48:04.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:04 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:48:04.780 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:04 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:48:04.871 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:04 smithi079 ceph-mon[18656]: pgmap v669: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 22 MiB/s wr, 5.72k op/s 2024-08-20T01:48:04.871 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:04 smithi079 ceph-mon[18656]: scrub queued for path: / 2024-08-20T01:48:04.871 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:04 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:48:04.871 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:04 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:48:04.871 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:04 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:48:04.871 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:04 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:48:04.871 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:04 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:48:04.871 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:04 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:48:04.871 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:04 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:48:04.872 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:04 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:48:04.872 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:04 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:48:04.872 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:04 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:48:04.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:04 smithi175 ceph-mon[22392]: pgmap v669: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 22 MiB/s wr, 5.72k op/s 2024-08-20T01:48:04.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:04 smithi175 ceph-mon[22392]: scrub queued for path: / 2024-08-20T01:48:04.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:04 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:48:04.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:04 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:48:04.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:04 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:48:04.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:04 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:48:04.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:04 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:48:04.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:04 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:48:04.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:04 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:48:04.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:04 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:48:04.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:04 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:48:04.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:04 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:48:04.920 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:48:05.358 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:48:05.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:05 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:48:05.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:05 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:48:05.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:05 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:48:05.805 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:05 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:48:05.805 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:05 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:48:05.805 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:05 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:48:05.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:05 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:48:05.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:05 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:48:05.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:05 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:48:06.039 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:48:06.039 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-20T01:48:06.039 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": { 2024-08-20T01:48:06.039 INFO:teuthology.orchestra.run.smithi079.stdout: "46fe1e5e-4722-4336-9357-f6a26f327771": { 2024-08-20T01:48:06.039 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/", 2024-08-20T01:48:06.040 INFO:teuthology.orchestra.run.smithi079.stdout: "tag": "46fe1e5e-4722-4336-9357-f6a26f327771", 2024-08-20T01:48:06.040 INFO:teuthology.orchestra.run.smithi079.stdout: "options": "recursive,force" 2024-08-20T01:48:06.040 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:48:06.040 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:48:06.040 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:48:06.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.941+0000 7f15ebd3e640 1 -- 172.21.15.79:0/947019750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15e410a260 msgr2=0x7f15e410a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:06.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.941+0000 7f15ebd3e640 1 --2- 172.21.15.79:0/947019750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15e410a260 0x7f15e410a6a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f15d4009860 tx=0x7f15d402a3d0 comp rx=0 tx=0).stop 2024-08-20T01:48:06.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.941+0000 7f15ebd3e640 1 -- 172.21.15.79:0/947019750 shutdown_connections 2024-08-20T01:48:06.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.941+0000 7f15ebd3e640 1 --2- 172.21.15.79:0/947019750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15e411bdd0 0x7f15e411e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:06.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.941+0000 7f15ebd3e640 1 --2- 172.21.15.79:0/947019750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15e410a260 0x7f15e410a6a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:06.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.941+0000 7f15ebd3e640 1 --2- 172.21.15.79:0/947019750 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15e4109e80 0x7f15e4110ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:06.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.941+0000 7f15ebd3e640 1 -- 172.21.15.79:0/947019750 >> 172.21.15.79:0/947019750 conn(0x7f15e406dcc0 msgr2=0x7f15e406e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:06.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.941+0000 7f15ebd3e640 1 -- 172.21.15.79:0/947019750 shutdown_connections 2024-08-20T01:48:06.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.941+0000 7f15ebd3e640 1 -- 172.21.15.79:0/947019750 wait complete. 2024-08-20T01:48:06.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.942+0000 7f15ebd3e640 1 Processor -- start 2024-08-20T01:48:06.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.942+0000 7f15ebd3e640 1 -- start start 2024-08-20T01:48:06.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.942+0000 7f15ebd3e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15e4109e80 0x7f15e41a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:06.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.942+0000 7f15ebd3e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15e411bdd0 0x7f15e41a8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:06.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.942+0000 7f15ebd3e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15e41ad7d0 0x7f15e41adc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:06.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.942+0000 7f15ebd3e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f15e4121760 con 0x7f15e4109e80 2024-08-20T01:48:06.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.942+0000 7f15ebd3e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f15e41215e0 con 0x7f15e41ad7d0 2024-08-20T01:48:06.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.942+0000 7f15ebd3e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f15e41218e0 con 0x7f15e411bdd0 2024-08-20T01:48:06.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.942+0000 7f15ea2db640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15e41ad7d0 0x7f15e41adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:06.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.942+0000 7f15e92d9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15e411bdd0 0x7f15e41a8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:06.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.942+0000 7f15ea2db640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15e41ad7d0 0x7f15e41adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:33440/0 (socket says 172.21.15.79:33440) 2024-08-20T01:48:06.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.942+0000 7f15ea2db640 1 -- 172.21.15.79:0/2221727670 learned_addr learned my addr 172.21.15.79:0/2221727670 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:06.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.942+0000 7f15e9ada640 1 --2- 172.21.15.79:0/2221727670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15e4109e80 0x7f15e41a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:06.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.943+0000 7f15ea2db640 1 -- 172.21.15.79:0/2221727670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15e411bdd0 msgr2=0x7f15e41a8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:06.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.943+0000 7f15ea2db640 1 --2- 172.21.15.79:0/2221727670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15e411bdd0 0x7f15e41a8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:06.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.943+0000 7f15ea2db640 1 -- 172.21.15.79:0/2221727670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15e4109e80 msgr2=0x7f15e41a7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:06.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.943+0000 7f15ea2db640 1 --2- 172.21.15.79:0/2221727670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15e4109e80 0x7f15e41a7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:06.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.943+0000 7f15ea2db640 1 -- 172.21.15.79:0/2221727670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15e41ae360 con 0x7f15e41ad7d0 2024-08-20T01:48:06.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.943+0000 7f15ea2db640 1 --2- 172.21.15.79:0/2221727670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15e41ad7d0 0x7f15e41adc80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f15dc00eb10 tx=0x7f15dc00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:06.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.943+0000 7f15daffd640 1 -- 172.21.15.79:0/2221727670 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15dc00ce20 con 0x7f15e41ad7d0 2024-08-20T01:48:06.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.943+0000 7f15daffd640 1 -- 172.21.15.79:0/2221727670 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15dc005020 con 0x7f15e41ad7d0 2024-08-20T01:48:06.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.943+0000 7f15daffd640 1 -- 172.21.15.79:0/2221727670 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15dc010690 con 0x7f15e41ad7d0 2024-08-20T01:48:06.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.943+0000 7f15ebd3e640 1 -- 172.21.15.79:0/2221727670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15e41115b0 con 0x7f15e41ad7d0 2024-08-20T01:48:06.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.944+0000 7f15ebd3e640 1 -- 172.21.15.79:0/2221727670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15e4111a70 con 0x7f15e41ad7d0 2024-08-20T01:48:06.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.947+0000 7f15ee137740 1 Processor -- start 2024-08-20T01:48:06.043 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.948+0000 7f15daffd640 1 -- 172.21.15.79:0/2221727670 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f15dc004a40 con 0x7f15e41ad7d0 2024-08-20T01:48:06.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.949+0000 7f15daffd640 1 --2- 172.21.15.79:0/2221727670 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f15d00c4ca0 0x7f15d00c7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:06.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.949+0000 7f15daffd640 1 -- 172.21.15.79:0/2221727670 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f15dc0e4370 con 0x7f15e41ad7d0 2024-08-20T01:48:06.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.949+0000 7f15ee137740 1 -- start start 2024-08-20T01:48:06.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.950+0000 7f15ee137740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca4f0f8830 0x55ca4f0f8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:06.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.950+0000 7f15ee137740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca4f0f9150 0x55ca4f104ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:06.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.950+0000 7f15ee137740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca4f1050e0 0x55ca4f1074d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:06.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.950+0000 7f15ee137740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ca4f06f8e0 con 0x55ca4f0f8830 2024-08-20T01:48:06.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.950+0000 7f15ee137740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ca4f05ede0 con 0x55ca4f1050e0 2024-08-20T01:48:06.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.950+0000 7f15ee137740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ca4f062e20 con 0x55ca4f0f9150 2024-08-20T01:48:06.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.950+0000 7f15ea2db640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca4f1050e0 0x55ca4f1074d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:06.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.950+0000 7f15ea2db640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca4f1050e0 0x55ca4f1074d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:33442/0 (socket says 172.21.15.79:33442) 2024-08-20T01:48:06.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.950+0000 7f15ea2db640 1 -- 172.21.15.79:0/3949588462 learned_addr learned my addr 172.21.15.79:0/3949588462 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:06.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.950+0000 7f15e9ada640 1 --2- 172.21.15.79:0/3949588462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca4f0f8830 0x55ca4f0f8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:06.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.950+0000 7f15ea2db640 1 -- 172.21.15.79:0/3949588462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca4f0f9150 msgr2=0x55ca4f104ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:48:06.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.951+0000 7f15ea2db640 1 --2- 172.21.15.79:0/3949588462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca4f0f9150 0x55ca4f104ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:06.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.951+0000 7f15ea2db640 1 -- 172.21.15.79:0/3949588462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca4f0f8830 msgr2=0x55ca4f0f8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:06.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.951+0000 7f15ea2db640 1 --2- 172.21.15.79:0/3949588462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca4f0f8830 0x55ca4f0f8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:06.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.951+0000 7f15ea2db640 1 -- 172.21.15.79:0/3949588462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca4edbe650 con 0x55ca4f1050e0 2024-08-20T01:48:06.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.951+0000 7f15ea2db640 1 --2- 172.21.15.79:0/3949588462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca4f1050e0 0x55ca4f1074d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f15dc005850 tx=0x7f15dc0aad80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc1f914c087db8b8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:06.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.951+0000 7f15e92d9640 1 --2- 172.21.15.79:0/2221727670 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f15d00c4ca0 0x7f15d00c7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:06.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.952+0000 7f15e92d9640 1 --2- 172.21.15.79:0/2221727670 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f15d00c4ca0 0x7f15d00c7160 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f15d4009780 tx=0x7f15d4005c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:06.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.956+0000 7f15cffff640 1 -- 172.21.15.79:0/3949588462 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15dc0c5070 con 0x55ca4f1050e0 2024-08-20T01:48:06.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.956+0000 7f15cffff640 1 -- 172.21.15.79:0/3949588462 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15dc0ab270 con 0x55ca4f1050e0 2024-08-20T01:48:06.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.956+0000 7f15cffff640 1 -- 172.21.15.79:0/3949588462 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15dc0a7500 con 0x55ca4f1050e0 2024-08-20T01:48:06.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.957+0000 7f15ee137740 1 -- 172.21.15.79:0/3949588462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca4f1050e0 msgr2=0x55ca4f1074d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:06.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.957+0000 7f15ee137740 1 --2- 172.21.15.79:0/3949588462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca4f1050e0 0x55ca4f1074d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f15dc005850 tx=0x7f15dc0aad80 comp rx=0 tx=0).stop 2024-08-20T01:48:06.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.957+0000 7f15ee137740 1 -- 172.21.15.79:0/3949588462 shutdown_connections 2024-08-20T01:48:06.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.957+0000 7f15ee137740 1 --2- 172.21.15.79:0/3949588462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca4f1050e0 0x55ca4f1074d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:06.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.957+0000 7f15ee137740 1 --2- 172.21.15.79:0/3949588462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca4f0f9150 0x55ca4f104ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:06.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.957+0000 7f15ee137740 1 --2- 172.21.15.79:0/3949588462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca4f0f8830 0x55ca4f0f8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:06.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.957+0000 7f15ee137740 1 -- 172.21.15.79:0/3949588462 >> 172.21.15.79:0/3949588462 conn(0x55ca4f0f6660 msgr2=0x55ca4f0f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:06.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.958+0000 7f15ee137740 1 -- 172.21.15.79:0/3949588462 shutdown_connections 2024-08-20T01:48:06.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.958+0000 7f15ee137740 1 -- 172.21.15.79:0/3949588462 wait complete. 2024-08-20T01:48:06.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.958+0000 7f15ee137740 1 -- start start 2024-08-20T01:48:06.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.958+0000 7f15ee137740 1 Processor -- start 2024-08-20T01:48:06.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.959+0000 7f15ee137740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca4f0f8830 0x55ca4f102100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:06.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.959+0000 7f15ee137740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca4f0f9150 0x55ca4f102640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:06.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.959+0000 7f15ee137740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca4f1050e0 0x55ca4f102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:06.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.959+0000 7f15ee137740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ca4eec1700 con 0x55ca4f1050e0 2024-08-20T01:48:06.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.959+0000 7f15ee137740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ca4efe57c0 con 0x55ca4f0f8830 2024-08-20T01:48:06.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.959+0000 7f15ee137740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ca4f129da0 con 0x55ca4f0f9150 2024-08-20T01:48:06.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.959+0000 7f15ee137740 10 client.0 _ll_register_callbacks cb 0x55ca4f0586b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:48:06.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.960+0000 7f15e92d9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca4f0f9150 0x55ca4f102640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:06.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.960+0000 7f15e92d9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca4f0f9150 0x55ca4f102640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:36894/0 (socket says 172.21.15.79:36894) 2024-08-20T01:48:06.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.960+0000 7f15e92d9640 1 -- 172.21.15.79:0/3334141010 learned_addr learned my addr 172.21.15.79:0/3334141010 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:06.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.960+0000 7f15ea2db640 1 --2- 172.21.15.79:0/3334141010 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca4f1050e0 0x55ca4f102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:06.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.960+0000 7f15e92d9640 1 -- 172.21.15.79:0/3334141010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca4f0f8830 msgr2=0x55ca4f102100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:06.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.960+0000 7f15e92d9640 1 --2- 172.21.15.79:0/3334141010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca4f0f8830 0x55ca4f102100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:06.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.960+0000 7f15e92d9640 1 -- 172.21.15.79:0/3334141010 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca4f1050e0 msgr2=0x55ca4f102b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:06.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.960+0000 7f15e92d9640 1 --2- 172.21.15.79:0/3334141010 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca4f1050e0 0x55ca4f102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:06.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.960+0000 7f15e92d9640 1 -- 172.21.15.79:0/3334141010 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca4f1331d0 con 0x55ca4f0f9150 2024-08-20T01:48:06.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.961+0000 7f15e92d9640 1 --2- 172.21.15.79:0/3334141010 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca4f0f9150 0x55ca4f102640 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f15d4034000 tx=0x7f15d4005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afb50a00ee7628b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:06.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.961+0000 7f15cd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:48:06.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.961+0000 7f15cd7fa640 1 -- 172.21.15.79:0/3334141010 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d404e070 con 0x55ca4f0f9150 2024-08-20T01:48:06.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.961+0000 7f15cd7fa640 1 -- 172.21.15.79:0/3334141010 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f15d4032610 con 0x55ca4f0f9150 2024-08-20T01:48:06.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.962+0000 7f15ee137740 1 -- 172.21.15.79:0/3334141010 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ca4f00e100 con 0x55ca4f0f9150 2024-08-20T01:48:06.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.962+0000 7f15cd7fa640 1 -- 172.21.15.79:0/3334141010 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f15d4058050 con 0x55ca4f0f9150 2024-08-20T01:48:06.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.962+0000 7f15ee137740 10 client.27397 fetch_fsmap learned FSMap version 47 2024-08-20T01:48:06.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.962+0000 7f15ee137740 1 -- 172.21.15.79:0/3334141010 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55ca4f135b80 con 0x55ca4f0f9150 2024-08-20T01:48:06.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.962+0000 7f15cd7fa640 1 -- 172.21.15.79:0/3334141010 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55ca4f00e100 con 0x55ca4f0f9150 2024-08-20T01:48:06.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.962+0000 7f15cd7fa640 1 -- 172.21.15.79:0/3334141010 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 47) ==== 8394+0+0 (secure 0 0 0) 0x7f15d404aa10 con 0x55ca4f0f9150 2024-08-20T01:48:06.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.962+0000 7f15ee137740 10 client.27397 fetch_fsmap finished waiting for FSMap version 47 2024-08-20T01:48:06.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.962+0000 7f15ee137740 10 client.27397 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:48:06.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.963+0000 7f15ee137740 20 client.27397 populate_metadata read hostname 'smithi079' 2024-08-20T01:48:06.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.963+0000 7f15ee137740 1 --2- 172.21.15.79:0/3334141010 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55ca4f1374d0 0x55ca4f139990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:06.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.963+0000 7f15ee137740 4 client.27397 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:48:06.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.963+0000 7f15ee137740 1 -- 172.21.15.79:0/3334141010 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca4f071830 con 0x55ca4f1374d0 2024-08-20T01:48:06.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.963+0000 7f15e9ada640 1 --2- 172.21.15.79:0/3334141010 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55ca4f1374d0 0x55ca4f139990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:06.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.964+0000 7f15cd7fa640 10 client.27397 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:06.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.964+0000 7f15e9ada640 1 --2- 172.21.15.79:0/3334141010 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55ca4f1374d0 0x55ca4f139990 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b8e6a9c97b9e8c6 server_cookie=5f6d1cc86b4653f0 in_seq=0 out_seq=0 2024-08-20T01:48:06.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.964+0000 7f15cd7fa640 1 -- 172.21.15.79:0/3334141010 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ca4f071830 con 0x55ca4f1374d0 2024-08-20T01:48:06.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.964+0000 7f15cd7fa640 10 client.27397 handle_command_reply: tid=0 2024-08-20T01:48:06.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.964+0000 7f15ee137740 1 client.27397 shutdown 2024-08-20T01:48:06.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.965+0000 7f15ee137740 1 -- 172.21.15.79:0/3334141010 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca4f0f9150 msgr2=0x55ca4f102640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:06.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.965+0000 7f15ee137740 1 --2- 172.21.15.79:0/3334141010 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca4f0f9150 0x55ca4f102640 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f15d4034000 tx=0x7f15d4005f90 comp rx=0 tx=0).stop 2024-08-20T01:48:06.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.965+0000 7f15ee137740 1 -- 172.21.15.79:0/3334141010 shutdown_connections 2024-08-20T01:48:06.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.965+0000 7f15ee137740 1 --2- 172.21.15.79:0/3334141010 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55ca4f1374d0 0x55ca4f139990 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:06.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.965+0000 7f15ee137740 1 --2- 172.21.15.79:0/3334141010 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca4f1050e0 0x55ca4f102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:06.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.965+0000 7f15ee137740 1 --2- 172.21.15.79:0/3334141010 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca4f0f9150 0x55ca4f102640 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:06.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.965+0000 7f15ee137740 1 --2- 172.21.15.79:0/3334141010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca4f0f8830 0x55ca4f102100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:06.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.965+0000 7f15ee137740 1 -- 172.21.15.79:0/3334141010 >> 172.21.15.79:0/3334141010 conn(0x55ca4f0f6660 msgr2=0x55ca4f0fc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:06.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.966+0000 7f15cd7fa640 0 client.27397 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:06.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.966+0000 7f15ee137740 1 -- 172.21.15.79:0/3334141010 shutdown_connections 2024-08-20T01:48:06.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.966+0000 7f15ee137740 1 -- 172.21.15.79:0/3334141010 wait complete. 2024-08-20T01:48:06.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.966+0000 7f15ee137740 20 client.27397 trim_cache size 0 max 16384 2024-08-20T01:48:06.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.998+0000 7f15ee137740 1 Processor -- start 2024-08-20T01:48:06.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.998+0000 7f15ee137740 1 -- start start 2024-08-20T01:48:06.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.998+0000 7f15ee137740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca4f0f8830 0x55ca4f1015f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:06.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.998+0000 7f15ee137740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca4f0f9150 0x55ca4f0fc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:06.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.998+0000 7f15ee137740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca4f1050e0 0x55ca4f103e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:06.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.998+0000 7f15ee137740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f15e41b4c00 con 0x55ca4f1050e0 2024-08-20T01:48:06.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.998+0000 7f15ee137740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f15e41b68c0 con 0x55ca4f0f9150 2024-08-20T01:48:06.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.998+0000 7f15ee137740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f15e41b5390 con 0x55ca4f0f8830 2024-08-20T01:48:06.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.998+0000 7f15e9ada640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca4f0f8830 0x55ca4f1015f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:06.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.998+0000 7f15e92d9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca4f0f9150 0x55ca4f0fc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:06.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.998+0000 7f15e92d9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca4f0f9150 0x55ca4f0fc8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:33464/0 (socket says 172.21.15.79:33464) 2024-08-20T01:48:06.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.998+0000 7f15e92d9640 1 -- 172.21.15.79:0/3373893453 learned_addr learned my addr 172.21.15.79:0/3373893453 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:06.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.999+0000 7f15ea2db640 1 --2- 172.21.15.79:0/3373893453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca4f1050e0 0x55ca4f103e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:06.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.999+0000 7f15ea2db640 1 -- 172.21.15.79:0/3373893453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca4f0f8830 msgr2=0x55ca4f1015f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:06.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.999+0000 7f15ea2db640 1 --2- 172.21.15.79:0/3373893453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca4f0f8830 0x55ca4f1015f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:06.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.999+0000 7f15ea2db640 1 -- 172.21.15.79:0/3373893453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca4f0f9150 msgr2=0x55ca4f0fc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:06.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.999+0000 7f15ea2db640 1 --2- 172.21.15.79:0/3373893453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca4f0f9150 0x55ca4f0fc8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:06.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.999+0000 7f15ea2db640 1 -- 172.21.15.79:0/3373893453 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca4f101060 con 0x55ca4f1050e0 2024-08-20T01:48:06.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:05.999+0000 7f15ea2db640 1 --2- 172.21.15.79:0/3373893453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca4f1050e0 0x55ca4f103e40 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x55ca4f0f87e0 tx=0x7f15dc009a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7de628d32bd258 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:06.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.000+0000 7f15cf7fe640 1 -- 172.21.15.79:0/3373893453 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15dc0c5040 con 0x55ca4f1050e0 2024-08-20T01:48:06.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.000+0000 7f15cf7fe640 1 -- 172.21.15.79:0/3373893453 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15dc0b4320 con 0x55ca4f1050e0 2024-08-20T01:48:06.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.000+0000 7f15cf7fe640 1 -- 172.21.15.79:0/3373893453 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15dc0a7500 con 0x55ca4f1050e0 2024-08-20T01:48:06.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.000+0000 7f15ee137740 1 -- 172.21.15.79:0/3373893453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca4f1050e0 msgr2=0x55ca4f103e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:06.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.000+0000 7f15ee137740 1 --2- 172.21.15.79:0/3373893453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca4f1050e0 0x55ca4f103e40 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x55ca4f0f87e0 tx=0x7f15dc009a70 comp rx=0 tx=0).stop 2024-08-20T01:48:06.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.001+0000 7f15ee137740 1 -- 172.21.15.79:0/3373893453 shutdown_connections 2024-08-20T01:48:06.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.001+0000 7f15ee137740 1 --2- 172.21.15.79:0/3373893453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca4f1050e0 0x55ca4f103e40 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:06.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.001+0000 7f15ee137740 1 --2- 172.21.15.79:0/3373893453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca4f0f9150 0x55ca4f0fc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:06.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.001+0000 7f15ee137740 1 --2- 172.21.15.79:0/3373893453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca4f0f8830 0x55ca4f1015f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:06.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.001+0000 7f15ee137740 1 -- 172.21.15.79:0/3373893453 >> 172.21.15.79:0/3373893453 conn(0x55ca4f0f6660 msgr2=0x55ca4f103730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:06.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.001+0000 7f15ee137740 1 -- 172.21.15.79:0/3373893453 shutdown_connections 2024-08-20T01:48:06.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.001+0000 7f15ee137740 1 -- 172.21.15.79:0/3373893453 wait complete. 2024-08-20T01:48:06.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.002+0000 7f15ee137740 1 -- start start 2024-08-20T01:48:06.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.002+0000 7f15ee137740 1 Processor -- start 2024-08-20T01:48:06.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.003+0000 7f15ee137740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca4f0f8830 0x55ca4f12f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:06.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.003+0000 7f15ee137740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca4f1050e0 0x55ca4f12f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:06.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.003+0000 7f15ee137740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca4f0fe750 0x55ca4f0febb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:06.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.003+0000 7f15ee137740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f15e41b61f0 con 0x55ca4f1050e0 2024-08-20T01:48:06.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.003+0000 7f15ee137740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f15e41b5a60 con 0x55ca4f0fe750 2024-08-20T01:48:06.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.003+0000 7f15ee137740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f15e4118050 con 0x55ca4f0f8830 2024-08-20T01:48:06.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.003+0000 7f15ea2db640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca4f0fe750 0x55ca4f0febb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:06.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.003+0000 7f15ea2db640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca4f0fe750 0x55ca4f0febb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:33468/0 (socket says 172.21.15.79:33468) 2024-08-20T01:48:06.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.003+0000 7f15ea2db640 1 -- 172.21.15.79:0/2875399500 learned_addr learned my addr 172.21.15.79:0/2875399500 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:06.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.003+0000 7f15ee137740 10 client.0 _ll_register_callbacks cb 0x7f15dc0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:48:06.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.003+0000 7f15e92d9640 1 --2- 172.21.15.79:0/2875399500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca4f1050e0 0x55ca4f12f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:06.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.005+0000 7f15ea2db640 1 -- 172.21.15.79:0/2875399500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca4f0f8830 msgr2=0x55ca4f12f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:06.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.005+0000 7f15ea2db640 1 --2- 172.21.15.79:0/2875399500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca4f0f8830 0x55ca4f12f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:06.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.005+0000 7f15ea2db640 1 -- 172.21.15.79:0/2875399500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca4f1050e0 msgr2=0x55ca4f12f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:06.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.005+0000 7f15ea2db640 1 --2- 172.21.15.79:0/2875399500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca4f1050e0 0x55ca4f12f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:06.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.005+0000 7f15ea2db640 1 -- 172.21.15.79:0/2875399500 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca4f0ff0f0 con 0x55ca4f0fe750 2024-08-20T01:48:06.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.005+0000 7f15ea2db640 1 --2- 172.21.15.79:0/2875399500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca4f0fe750 0x55ca4f0febb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f15dc0ab1b0 tx=0x7f15dc005400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed4a0d94fc5ef19b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:06.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.006+0000 7f15cd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:48:06.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.006+0000 7f15cd7fa640 1 -- 172.21.15.79:0/2875399500 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15dc0c5040 con 0x55ca4f0fe750 2024-08-20T01:48:06.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.006+0000 7f15cd7fa640 1 -- 172.21.15.79:0/2875399500 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f15dc0a7500 con 0x55ca4f0fe750 2024-08-20T01:48:06.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.006+0000 7f15ee137740 1 -- 172.21.15.79:0/2875399500 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ca4f06d2d0 con 0x55ca4f0fe750 2024-08-20T01:48:06.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.006+0000 7f15cd7fa640 1 -- 172.21.15.79:0/2875399500 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f15dc0cc290 con 0x55ca4f0fe750 2024-08-20T01:48:06.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.006+0000 7f15ee137740 10 client.27419 fetch_fsmap learned FSMap version 47 2024-08-20T01:48:06.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.006+0000 7f15ee137740 1 -- 172.21.15.79:0/2875399500 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55ca4f1a1f10 con 0x55ca4f0fe750 2024-08-20T01:48:06.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.006+0000 7f15cd7fa640 1 -- 172.21.15.79:0/2875399500 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15dc0cc430 con 0x55ca4f0fe750 2024-08-20T01:48:06.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.006+0000 7f15cd7fa640 1 -- 172.21.15.79:0/2875399500 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 47) ==== 8394+0+0 (secure 0 0 0) 0x7f15dc0a6be0 con 0x55ca4f0fe750 2024-08-20T01:48:06.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.007+0000 7f15ee137740 10 client.27419 fetch_fsmap finished waiting for FSMap version 47 2024-08-20T01:48:06.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.007+0000 7f15ee137740 10 client.27419 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:48:06.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.007+0000 7f15ee137740 20 client.27419 populate_metadata read hostname 'smithi079' 2024-08-20T01:48:06.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.007+0000 7f15ee137740 1 --2- 172.21.15.79:0/2875399500 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55ca4f1a2140 0x55ca4f1a4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:06.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.007+0000 7f15ee137740 4 client.27419 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:48:06.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.007+0000 7f15ee137740 1 -- 172.21.15.79:0/2875399500 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ca4f06d2d0 con 0x55ca4f1a2140 2024-08-20T01:48:06.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.007+0000 7f15e9ada640 1 --2- 172.21.15.79:0/2875399500 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55ca4f1a2140 0x55ca4f1a4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:06.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.008+0000 7f15e9ada640 1 --2- 172.21.15.79:0/2875399500 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55ca4f1a2140 0x55ca4f1a4530 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22cc2f3a0b30fbc2 server_cookie=7fb1ba16db9b5ae0 in_seq=0 out_seq=0 2024-08-20T01:48:06.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.008+0000 7f15cd7fa640 10 client.27419 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:06.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.008+0000 7f15cd7fa640 1 -- 172.21.15.79:0/2875399500 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55ca4f06d2d0 con 0x55ca4f1a2140 2024-08-20T01:48:06.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.008+0000 7f15cd7fa640 10 client.27419 handle_command_reply: tid=0 2024-08-20T01:48:06.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.008+0000 7f15ee137740 1 client.27419 shutdown 2024-08-20T01:48:06.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.008+0000 7f15ee137740 1 -- 172.21.15.79:0/2875399500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca4f0fe750 msgr2=0x55ca4f0febb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:06.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.008+0000 7f15ee137740 1 --2- 172.21.15.79:0/2875399500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca4f0fe750 0x55ca4f0febb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f15dc0ab1b0 tx=0x7f15dc005400 comp rx=0 tx=0).stop 2024-08-20T01:48:06.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.009+0000 7f15ee137740 1 -- 172.21.15.79:0/2875399500 shutdown_connections 2024-08-20T01:48:06.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.009+0000 7f15ee137740 1 --2- 172.21.15.79:0/2875399500 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55ca4f1a2140 0x55ca4f1a4530 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:06.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.009+0000 7f15ee137740 1 --2- 172.21.15.79:0/2875399500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca4f0fe750 0x55ca4f0febb0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:06.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.009+0000 7f15ee137740 1 --2- 172.21.15.79:0/2875399500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca4f1050e0 0x55ca4f12f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:06.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.009+0000 7f15ee137740 1 --2- 172.21.15.79:0/2875399500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca4f0f8830 0x55ca4f12f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:06.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.009+0000 7f15ee137740 1 -- 172.21.15.79:0/2875399500 >> 172.21.15.79:0/2875399500 conn(0x55ca4f0f6660 msgr2=0x55ca4f102890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:06.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.009+0000 7f15cd7fa640 0 client.27419 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:06.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.009+0000 7f15ee137740 1 -- 172.21.15.79:0/2875399500 shutdown_connections 2024-08-20T01:48:06.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.009+0000 7f15ee137740 1 -- 172.21.15.79:0/2875399500 wait complete. 2024-08-20T01:48:06.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.009+0000 7f15ee137740 20 client.27419 trim_cache size 0 max 16384 2024-08-20T01:48:06.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.012+0000 7f15ebd3e640 1 -- 172.21.15.79:0/2221727670 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f15d00c4ca0 msgr2=0x7f15d00c7160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:06.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.012+0000 7f15ebd3e640 1 --2- 172.21.15.79:0/2221727670 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f15d00c4ca0 0x7f15d00c7160 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f15d4009780 tx=0x7f15d4005c90 comp rx=0 tx=0).stop 2024-08-20T01:48:06.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.012+0000 7f15ebd3e640 1 -- 172.21.15.79:0/2221727670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15e41ad7d0 msgr2=0x7f15e41adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:06.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.012+0000 7f15ebd3e640 1 --2- 172.21.15.79:0/2221727670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15e41ad7d0 0x7f15e41adc80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f15dc00eb10 tx=0x7f15dc00ef10 comp rx=0 tx=0).stop 2024-08-20T01:48:06.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.012+0000 7f15ebd3e640 1 -- 172.21.15.79:0/2221727670 shutdown_connections 2024-08-20T01:48:06.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.012+0000 7f15ebd3e640 1 --2- 172.21.15.79:0/2221727670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15e41ad7d0 0x7f15e41adc80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:06.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.012+0000 7f15ebd3e640 1 --2- 172.21.15.79:0/2221727670 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f15d00c4ca0 0x7f15d00c7160 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:06.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.012+0000 7f15ebd3e640 1 --2- 172.21.15.79:0/2221727670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15e411bdd0 0x7f15e41a8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:06.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.012+0000 7f15ebd3e640 1 --2- 172.21.15.79:0/2221727670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15e4109e80 0x7f15e41a7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:06.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.012+0000 7f15ebd3e640 1 -- 172.21.15.79:0/2221727670 >> 172.21.15.79:0/2221727670 conn(0x7f15e406dcc0 msgr2=0x7f15e411c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:06.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.012+0000 7f15ebd3e640 1 -- 172.21.15.79:0/2221727670 shutdown_connections 2024-08-20T01:48:06.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:06.012+0000 7f15ebd3e640 1 -- 172.21.15.79:0/2221727670 wait complete. 2024-08-20T01:48:06.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:06 smithi175 ceph-mon[22392]: pgmap v670: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 24 MiB/s wr, 6.18k op/s 2024-08-20T01:48:06.902 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:06 smithi079 ceph-mon[18656]: pgmap v670: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 24 MiB/s wr, 6.18k op/s 2024-08-20T01:48:07.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:06 smithi081 ceph-mon[22209]: pgmap v670: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 24 MiB/s wr, 6.18k op/s 2024-08-20T01:48:07.277 INFO:tasks.cephfs.filesystem:scrub status for tag:46fe1e5e-4722-4336-9357-f6a26f327771 - {'path': '/', 'tag': '46fe1e5e-4722-4336-9357-f6a26f327771', 'options': 'recursive,force'} 2024-08-20T01:48:08.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:08 smithi175 ceph-mon[22392]: pgmap v671: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 23 MiB/s wr, 5.93k op/s 2024-08-20T01:48:08.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:08 smithi079 ceph-mon[18656]: pgmap v671: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 23 MiB/s wr, 5.93k op/s 2024-08-20T01:48:09.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:08 smithi081 ceph-mon[22209]: pgmap v671: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 23 MiB/s wr, 5.93k op/s 2024-08-20T01:48:10.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:10 smithi175 ceph-mon[22392]: pgmap v672: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 25 MiB/s wr, 6.48k op/s 2024-08-20T01:48:10.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:10 smithi079 ceph-mon[18656]: pgmap v672: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 25 MiB/s wr, 6.48k op/s 2024-08-20T01:48:11.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:10 smithi081 ceph-mon[22209]: pgmap v672: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 25 MiB/s wr, 6.48k op/s 2024-08-20T01:48:12.830 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:12 smithi081 ceph-mon[22209]: pgmap v673: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 25 MiB/s wr, 6.35k op/s 2024-08-20T01:48:12.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:12 smithi175 ceph-mon[22392]: pgmap v673: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 25 MiB/s wr, 6.35k op/s 2024-08-20T01:48:12.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:12 smithi079 ceph-mon[18656]: pgmap v673: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 25 MiB/s wr, 6.35k op/s 2024-08-20T01:48:14.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:14 smithi175 ceph-mon[22392]: pgmap v674: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 24 MiB/s wr, 6.25k op/s 2024-08-20T01:48:14.938 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:14 smithi079 ceph-mon[18656]: pgmap v674: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 24 MiB/s wr, 6.25k op/s 2024-08-20T01:48:15.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:14 smithi081 ceph-mon[22209]: pgmap v674: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 24 MiB/s wr, 6.25k op/s 2024-08-20T01:48:15.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:15 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:48:15.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:15 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:48:15.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:15 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:48:15.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:15 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:48:15.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:15 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:48:15.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:15 smithi175 ceph-mon[22392]: pgmap v675: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 26 MiB/s wr, 6.76k op/s 2024-08-20T01:48:15.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:15 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:48:15.938 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:15 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:48:15.938 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:15 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:48:15.938 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:15 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:48:15.938 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:15 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:48:15.938 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:15 smithi079 ceph-mon[18656]: pgmap v675: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 26 MiB/s wr, 6.76k op/s 2024-08-20T01:48:16.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:15 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:48:16.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:15 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:48:16.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:15 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:48:16.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:15 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:48:16.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:15 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:48:16.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:15 smithi081 ceph-mon[22209]: pgmap v675: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 26 MiB/s wr, 6.76k op/s 2024-08-20T01:48:16.336 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.332+0000 7f2ea22da640 1 -- 172.21.15.79:0/2598821556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e940986f0 msgr2=0x7f2e9409ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:16.336 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.332+0000 7f2ea22da640 1 --2- 172.21.15.79:0/2598821556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e940986f0 0x7f2e9409ab20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c009900 tx=0x7f2e8c02a400 comp rx=0 tx=0).stop 2024-08-20T01:48:16.336 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.333+0000 7f2ea22da640 1 -- 172.21.15.79:0/2598821556 shutdown_connections 2024-08-20T01:48:16.336 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.333+0000 7f2ea22da640 1 --2- 172.21.15.79:0/2598821556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e9409b260 0x7f2e9409d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:16.336 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.333+0000 7f2ea22da640 1 --2- 172.21.15.79:0/2598821556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e940986f0 0x7f2e9409ab20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:16.336 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.333+0000 7f2ea22da640 1 --2- 172.21.15.79:0/2598821556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e94005850 0x7f2e940981b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:16.336 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.333+0000 7f2ea22da640 1 -- 172.21.15.79:0/2598821556 >> 172.21.15.79:0/2598821556 conn(0x7f2e9408fce0 msgr2=0x7f2e94092120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:16.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.333+0000 7f2ea22da640 1 -- 172.21.15.79:0/2598821556 shutdown_connections 2024-08-20T01:48:16.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.333+0000 7f2ea22da640 1 -- 172.21.15.79:0/2598821556 wait complete. 2024-08-20T01:48:16.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.334+0000 7f2ea22da640 1 Processor -- start 2024-08-20T01:48:16.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.334+0000 7f2ea22da640 1 -- start start 2024-08-20T01:48:16.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.334+0000 7f2ea22da640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e94005850 0x7f2e9413c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:16.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.334+0000 7f2ea22da640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e940986f0 0x7f2e9413cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:16.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.335+0000 7f2ea22da640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e9409b260 0x7f2e9413dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:16.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.335+0000 7f2ea22da640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2e940b20a0 con 0x7f2e9409b260 2024-08-20T01:48:16.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.335+0000 7f2ea22da640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2e940b1f20 con 0x7f2e94005850 2024-08-20T01:48:16.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.335+0000 7f2ea22da640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2e940b2220 con 0x7f2e940986f0 2024-08-20T01:48:16.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.335+0000 7f2ea0ad7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e940986f0 0x7f2e9413cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:16.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.335+0000 7f2ea0ad7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e940986f0 0x7f2e9413cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:41424/0 (socket says 172.21.15.79:41424) 2024-08-20T01:48:16.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.335+0000 7f2ea0ad7640 1 -- 172.21.15.79:0/3372200183 learned_addr learned my addr 172.21.15.79:0/3372200183 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:16.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.335+0000 7f2ea12d8640 1 --2- 172.21.15.79:0/3372200183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e94005850 0x7f2e9413c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:16.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.335+0000 7f2ea0ad7640 1 -- 172.21.15.79:0/3372200183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e94005850 msgr2=0x7f2e9413c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:16.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.335+0000 7f2ea0ad7640 1 --2- 172.21.15.79:0/3372200183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e94005850 0x7f2e9413c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:16.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.335+0000 7f2ea0ad7640 1 -- 172.21.15.79:0/3372200183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e9409b260 msgr2=0x7f2e9413dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:16.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.335+0000 7f2ea0ad7640 1 --2- 172.21.15.79:0/3372200183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e9409b260 0x7f2e9413dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:16.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.335+0000 7f2ea0ad7640 1 -- 172.21.15.79:0/3372200183 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e9413e390 con 0x7f2e940986f0 2024-08-20T01:48:16.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.336+0000 7f2ea0ad7640 1 --2- 172.21.15.79:0/3372200183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e940986f0 0x7f2e9413cea0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c009850 tx=0x7f2e8c003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:16.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.336+0000 7f2e927fc640 1 -- 172.21.15.79:0/3372200183 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c03f070 con 0x7f2e940986f0 2024-08-20T01:48:16.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.336+0000 7f2e927fc640 1 -- 172.21.15.79:0/3372200183 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e8c031b90 con 0x7f2e940986f0 2024-08-20T01:48:16.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.336+0000 7f2ea22da640 1 -- 172.21.15.79:0/3372200183 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e9413e620 con 0x7f2e940986f0 2024-08-20T01:48:16.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.336+0000 7f2e927fc640 1 -- 172.21.15.79:0/3372200183 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c035030 con 0x7f2e940986f0 2024-08-20T01:48:16.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.336+0000 7f2ea22da640 1 -- 172.21.15.79:0/3372200183 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e94093f90 con 0x7f2e940986f0 2024-08-20T01:48:16.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.340+0000 7f2ea6403740 1 Processor -- start 2024-08-20T01:48:16.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.340+0000 7f2e927fc640 1 -- 172.21.15.79:0/3372200183 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2e8c042070 con 0x7f2e940986f0 2024-08-20T01:48:16.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.341+0000 7f2e927fc640 1 --2- 172.21.15.79:0/3372200183 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2e880b3d10 0x7f2e880b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:16.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.341+0000 7f2ea6403740 1 -- start start 2024-08-20T01:48:16.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.341+0000 7f2e927fc640 1 -- 172.21.15.79:0/3372200183 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f2e8c104500 con 0x7f2e940986f0 2024-08-20T01:48:16.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.341+0000 7f2ea6403740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8f58ba20 0x55ea8f58de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:16.344 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.341+0000 7f2ea6403740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8f58e350 0x55ea8f590740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:16.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.341+0000 7f2ea6403740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8f590d90 0x55ea8f593250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:16.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.341+0000 7f2ea6403740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ea8f4fe360 con 0x55ea8f58ba20 2024-08-20T01:48:16.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.341+0000 7f2ea6403740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ea8f4ed860 con 0x55ea8f590d90 2024-08-20T01:48:16.345 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.342+0000 7f2ea6403740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ea8f4f18a0 con 0x55ea8f58e350 2024-08-20T01:48:16.346 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.342+0000 7f2ea0ad7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8f58e350 0x55ea8f590740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.342+0000 7f2ea0ad7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8f58e350 0x55ea8f590740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:41436/0 (socket says 172.21.15.79:41436) 2024-08-20T01:48:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.342+0000 7f2ea0ad7640 1 -- 172.21.15.79:0/2266045894 learned_addr learned my addr 172.21.15.79:0/2266045894 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.342+0000 7f2ea1ad9640 1 --2- 172.21.15.79:0/3372200183 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2e880b3d10 0x7f2e880b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.342+0000 7f2ea1ad9640 1 --2- 172.21.15.79:0/2266045894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8f590d90 0x55ea8f593250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.342+0000 7f2ea12d8640 1 --2- 172.21.15.79:0/2266045894 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8f58ba20 0x55ea8f58de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.343+0000 7f2ea0ad7640 1 -- 172.21.15.79:0/2266045894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8f590d90 msgr2=0x55ea8f593250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.343+0000 7f2ea0ad7640 1 --2- 172.21.15.79:0/2266045894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8f590d90 0x55ea8f593250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.343+0000 7f2ea0ad7640 1 -- 172.21.15.79:0/2266045894 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8f58ba20 msgr2=0x55ea8f58de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.343+0000 7f2ea0ad7640 1 --2- 172.21.15.79:0/2266045894 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8f58ba20 0x55ea8f58de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.343+0000 7f2ea0ad7640 1 -- 172.21.15.79:0/2266045894 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea8f494e40 con 0x55ea8f58e350 2024-08-20T01:48:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.343+0000 7f2ea12d8640 1 --2- 172.21.15.79:0/2266045894 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8f58ba20 0x55ea8f58de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:48:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.343+0000 7f2ea1ad9640 1 --2- 172.21.15.79:0/2266045894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8f590d90 0x55ea8f593250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:48:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.343+0000 7f2ea0ad7640 1 --2- 172.21.15.79:0/2266045894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8f58e350 0x55ea8f590740 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c0c85e0 tx=0x7f2e8c02a400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3418e25ecb08c533 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.343+0000 7f2ea1ad9640 1 --2- 172.21.15.79:0/3372200183 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2e880b3d10 0x7f2e880b61d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c068b40 tx=0x7f2e9c0694d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.343+0000 7f2e877fe640 1 -- 172.21.15.79:0/2266045894 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c049040 con 0x55ea8f58e350 2024-08-20T01:48:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.343+0000 7f2e877fe640 1 -- 172.21.15.79:0/2266045894 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e8c0cbb00 con 0x55ea8f58e350 2024-08-20T01:48:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.344+0000 7f2e877fe640 1 -- 172.21.15.79:0/2266045894 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c104110 con 0x55ea8f58e350 2024-08-20T01:48:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.344+0000 7f2ea6403740 1 -- 172.21.15.79:0/2266045894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8f58e350 msgr2=0x55ea8f590740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.344+0000 7f2ea6403740 1 --2- 172.21.15.79:0/2266045894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8f58e350 0x55ea8f590740 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c0c85e0 tx=0x7f2e8c02a400 comp rx=0 tx=0).stop 2024-08-20T01:48:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.344+0000 7f2ea6403740 1 -- 172.21.15.79:0/2266045894 shutdown_connections 2024-08-20T01:48:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.344+0000 7f2ea6403740 1 --2- 172.21.15.79:0/2266045894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8f590d90 0x55ea8f593250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.344+0000 7f2ea6403740 1 --2- 172.21.15.79:0/2266045894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8f58e350 0x55ea8f590740 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.344+0000 7f2ea6403740 1 --2- 172.21.15.79:0/2266045894 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8f58ba20 0x55ea8f58de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.344+0000 7f2ea6403740 1 -- 172.21.15.79:0/2266045894 >> 172.21.15.79:0/2266045894 conn(0x55ea8f586b70 msgr2=0x55ea8f587900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.345+0000 7f2ea6403740 1 -- 172.21.15.79:0/2266045894 shutdown_connections 2024-08-20T01:48:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.345+0000 7f2ea6403740 1 -- 172.21.15.79:0/2266045894 wait complete. 2024-08-20T01:48:16.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.345+0000 7f2ea6403740 1 -- start start 2024-08-20T01:48:16.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.345+0000 7f2ea6403740 1 Processor -- start 2024-08-20T01:48:16.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.346+0000 7f2ea6403740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8f58ba20 0x55ea8f59d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:16.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.346+0000 7f2ea6403740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8f58e350 0x55ea8f59ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:16.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.346+0000 7f2ea6403740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8f590d90 0x55ea8f59e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:16.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.346+0000 7f2ea6403740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ea8f426ab0 con 0x55ea8f58e350 2024-08-20T01:48:16.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.346+0000 7f2ea6403740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ea8f474780 con 0x55ea8f58ba20 2024-08-20T01:48:16.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.346+0000 7f2ea6403740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ea8f593b30 con 0x55ea8f590d90 2024-08-20T01:48:16.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.346+0000 7f2ea6403740 10 client.0 _ll_register_callbacks cb 0x55ea8f1fca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:48:16.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.347+0000 7f2ea1ad9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8f590d90 0x55ea8f59e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:16.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.347+0000 7f2ea1ad9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8f590d90 0x55ea8f59e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:41448/0 (socket says 172.21.15.79:41448) 2024-08-20T01:48:16.350 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.347+0000 7f2ea1ad9640 1 -- 172.21.15.79:0/2718988325 learned_addr learned my addr 172.21.15.79:0/2718988325 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:16.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.347+0000 7f2ea1ad9640 1 -- 172.21.15.79:0/2718988325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8f58ba20 msgr2=0x55ea8f59d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:16.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.347+0000 7f2ea1ad9640 1 --2- 172.21.15.79:0/2718988325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8f58ba20 0x55ea8f59d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:16.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.347+0000 7f2ea1ad9640 1 -- 172.21.15.79:0/2718988325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8f58e350 msgr2=0x55ea8f59ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:16.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.347+0000 7f2ea1ad9640 1 --2- 172.21.15.79:0/2718988325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8f58e350 0x55ea8f59ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:16.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.347+0000 7f2ea1ad9640 1 -- 172.21.15.79:0/2718988325 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea8f250790 con 0x55ea8f590d90 2024-08-20T01:48:16.352 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.347+0000 7f2ea1ad9640 1 --2- 172.21.15.79:0/2718988325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8f590d90 0x55ea8f59e980 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c0525c0 tx=0x7f2e9c07f040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99e83fcdd5cb44f6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:16.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.348+0000 7f2e84ff9640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:48:16.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.348+0000 7f2e84ff9640 1 -- 172.21.15.79:0/2718988325 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c074040 con 0x55ea8f590d90 2024-08-20T01:48:16.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.348+0000 7f2ea6403740 1 -- 172.21.15.79:0/2718988325 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ea8f49ce00 con 0x55ea8f590d90 2024-08-20T01:48:16.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.348+0000 7f2e84ff9640 1 -- 172.21.15.79:0/2718988325 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f2e9c083040 con 0x55ea8f590d90 2024-08-20T01:48:16.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.348+0000 7f2e84ff9640 1 -- 172.21.15.79:0/2718988325 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f2e9c086420 con 0x55ea8f590d90 2024-08-20T01:48:16.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.348+0000 7f2ea6403740 10 client.27412 fetch_fsmap learned FSMap version 47 2024-08-20T01:48:16.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.348+0000 7f2ea6403740 1 -- 172.21.15.79:0/2718988325 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55ea8f2c9620 con 0x55ea8f590d90 2024-08-20T01:48:16.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.349+0000 7f2e84ff9640 1 -- 172.21.15.79:0/2718988325 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55ea8f49ce00 con 0x55ea8f590d90 2024-08-20T01:48:16.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.349+0000 7f2e84ff9640 1 -- 172.21.15.79:0/2718988325 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 47) ==== 8394+0+0 (secure 0 0 0) 0x7f2e9c08f070 con 0x55ea8f590d90 2024-08-20T01:48:16.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.349+0000 7f2ea6403740 10 client.27412 fetch_fsmap finished waiting for FSMap version 47 2024-08-20T01:48:16.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.349+0000 7f2ea6403740 10 client.27412 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:48:16.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.349+0000 7f2ea6403740 20 client.27412 populate_metadata read hostname 'smithi079' 2024-08-20T01:48:16.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.349+0000 7f2ea6403740 1 --2- 172.21.15.79:0/2718988325 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55ea8f598580 0x55ea8f59aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:16.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.349+0000 7f2ea6403740 4 client.27412 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:48:16.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.349+0000 7f2ea6403740 1 -- 172.21.15.79:0/2718988325 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea8f5002b0 con 0x55ea8f598580 2024-08-20T01:48:16.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.349+0000 7f2ea12d8640 1 --2- 172.21.15.79:0/2718988325 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55ea8f598580 0x55ea8f59aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:16.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.350+0000 7f2ea12d8640 1 --2- 172.21.15.79:0/2718988325 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55ea8f598580 0x55ea8f59aa40 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cf394a9e37e5344 server_cookie=8d323f6786faa6cb in_seq=0 out_seq=0 2024-08-20T01:48:16.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.350+0000 7f2e84ff9640 10 client.27412 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:16.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.353+0000 7f2e84ff9640 1 -- 172.21.15.79:0/2718988325 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ea8f5002b0 con 0x55ea8f598580 2024-08-20T01:48:16.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.353+0000 7f2e84ff9640 10 client.27412 handle_command_reply: tid=0 2024-08-20T01:48:16.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.353+0000 7f2ea6403740 1 client.27412 shutdown 2024-08-20T01:48:16.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.354+0000 7f2ea6403740 1 -- 172.21.15.79:0/2718988325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8f590d90 msgr2=0x55ea8f59e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:16.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.354+0000 7f2ea6403740 1 --2- 172.21.15.79:0/2718988325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8f590d90 0x55ea8f59e980 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c0525c0 tx=0x7f2e9c07f040 comp rx=0 tx=0).stop 2024-08-20T01:48:16.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.354+0000 7f2ea6403740 1 -- 172.21.15.79:0/2718988325 shutdown_connections 2024-08-20T01:48:16.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.354+0000 7f2ea6403740 1 --2- 172.21.15.79:0/2718988325 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55ea8f598580 0x55ea8f59aa40 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:16.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.354+0000 7f2ea6403740 1 --2- 172.21.15.79:0/2718988325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8f590d90 0x55ea8f59e980 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:16.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.354+0000 7f2ea6403740 1 --2- 172.21.15.79:0/2718988325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8f58e350 0x55ea8f59ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:16.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.354+0000 7f2ea6403740 1 --2- 172.21.15.79:0/2718988325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8f58ba20 0x55ea8f59d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:16.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.354+0000 7f2ea6403740 1 -- 172.21.15.79:0/2718988325 >> 172.21.15.79:0/2718988325 conn(0x55ea8f586b70 msgr2=0x55ea8f585c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:16.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.354+0000 7f2e84ff9640 0 client.27412 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:16.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.354+0000 7f2ea6403740 1 -- 172.21.15.79:0/2718988325 shutdown_connections 2024-08-20T01:48:16.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.354+0000 7f2ea6403740 1 -- 172.21.15.79:0/2718988325 wait complete. 2024-08-20T01:48:16.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.354+0000 7f2ea6403740 20 client.27412 trim_cache size 0 max 16384 2024-08-20T01:48:16.387 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.383+0000 7f2ea6403740 1 Processor -- start 2024-08-20T01:48:16.387 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.384+0000 7f2ea6403740 1 -- start start 2024-08-20T01:48:16.387 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.385+0000 7f2ea6403740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8f58ba20 0x55ea8f59a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:16.387 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.385+0000 7f2ea6403740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8f58e350 0x55ea8f591170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:16.388 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.385+0000 7f2ea6403740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8f590d90 0x55ea8f5916b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:16.388 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.385+0000 7f2ea6403740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2e9414b840 con 0x55ea8f590d90 2024-08-20T01:48:16.388 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.385+0000 7f2ea6403740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2e9414d500 con 0x55ea8f58e350 2024-08-20T01:48:16.388 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.385+0000 7f2ea6403740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2e9414bfd0 con 0x55ea8f58ba20 2024-08-20T01:48:16.389 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.385+0000 7f2ea0ad7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8f58e350 0x55ea8f591170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:16.389 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.385+0000 7f2ea0ad7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8f58e350 0x55ea8f591170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:54730/0 (socket says 172.21.15.79:54730) 2024-08-20T01:48:16.389 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.385+0000 7f2ea0ad7640 1 -- 172.21.15.79:0/143712760 learned_addr learned my addr 172.21.15.79:0/143712760 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:16.389 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.385+0000 7f2ea1ad9640 1 --2- 172.21.15.79:0/143712760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8f590d90 0x55ea8f5916b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:16.389 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.385+0000 7f2ea12d8640 1 --2- 172.21.15.79:0/143712760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8f58ba20 0x55ea8f59a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:16.389 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.385+0000 7f2ea0ad7640 1 -- 172.21.15.79:0/143712760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8f58ba20 msgr2=0x55ea8f59a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:16.389 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.385+0000 7f2ea0ad7640 1 --2- 172.21.15.79:0/143712760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8f58ba20 0x55ea8f59a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:16.389 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.385+0000 7f2ea0ad7640 1 -- 172.21.15.79:0/143712760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8f590d90 msgr2=0x55ea8f5916b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:16.389 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.385+0000 7f2ea0ad7640 1 --2- 172.21.15.79:0/143712760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8f590d90 0x55ea8f5916b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:16.389 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.385+0000 7f2ea0ad7640 1 -- 172.21.15.79:0/143712760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea8f590ab0 con 0x55ea8f58e350 2024-08-20T01:48:16.389 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.386+0000 7f2ea0ad7640 1 --2- 172.21.15.79:0/143712760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8f58e350 0x55ea8f591170 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c0cb100 tx=0x7f2e8c0cb030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdded6b3ea4c0293 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:16.389 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.386+0000 7f2e86ffd640 1 -- 172.21.15.79:0/143712760 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c049030 con 0x55ea8f58e350 2024-08-20T01:48:16.390 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.386+0000 7f2e86ffd640 1 -- 172.21.15.79:0/143712760 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e8c0ea070 con 0x55ea8f58e350 2024-08-20T01:48:16.390 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.386+0000 7f2e86ffd640 1 -- 172.21.15.79:0/143712760 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c102190 con 0x55ea8f58e350 2024-08-20T01:48:16.391 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.387+0000 7f2ea6403740 1 -- 172.21.15.79:0/143712760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8f58e350 msgr2=0x55ea8f591170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:16.391 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.387+0000 7f2ea6403740 1 --2- 172.21.15.79:0/143712760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8f58e350 0x55ea8f591170 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c0cb100 tx=0x7f2e8c0cb030 comp rx=0 tx=0).stop 2024-08-20T01:48:16.391 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.387+0000 7f2ea6403740 1 -- 172.21.15.79:0/143712760 shutdown_connections 2024-08-20T01:48:16.391 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.387+0000 7f2ea6403740 1 --2- 172.21.15.79:0/143712760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8f590d90 0x55ea8f5916b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:16.391 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.387+0000 7f2ea6403740 1 --2- 172.21.15.79:0/143712760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8f58e350 0x55ea8f591170 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:16.391 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.387+0000 7f2ea6403740 1 --2- 172.21.15.79:0/143712760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8f58ba20 0x55ea8f59a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:16.391 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.387+0000 7f2ea6403740 1 -- 172.21.15.79:0/143712760 >> 172.21.15.79:0/143712760 conn(0x55ea8f586b70 msgr2=0x55ea8f5926a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:16.391 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.387+0000 7f2ea6403740 1 -- 172.21.15.79:0/143712760 shutdown_connections 2024-08-20T01:48:16.391 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.387+0000 7f2ea6403740 1 -- 172.21.15.79:0/143712760 wait complete. 2024-08-20T01:48:16.391 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.388+0000 7f2ea6403740 1 -- start start 2024-08-20T01:48:16.391 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.388+0000 7f2ea6403740 1 Processor -- start 2024-08-20T01:48:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.389+0000 7f2ea6403740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8f58ba20 0x55ea8f5a5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.389+0000 7f2ea6403740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8f58e350 0x55ea8f5a3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.389+0000 7f2ea6403740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8f590d90 0x55ea8f5a4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.389+0000 7f2ea0ad7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8f58e350 0x55ea8f5a3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.389+0000 7f2ea0ad7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8f58e350 0x55ea8f5a3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:54744/0 (socket says 172.21.15.79:54744) 2024-08-20T01:48:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.389+0000 7f2ea0ad7640 1 -- 172.21.15.79:0/1599581064 learned_addr learned my addr 172.21.15.79:0/1599581064 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.389+0000 7f2ea6403740 1 -- 172.21.15.79:0/1599581064 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2e9414ce30 con 0x55ea8f590d90 2024-08-20T01:48:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.389+0000 7f2ea6403740 1 -- 172.21.15.79:0/1599581064 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2e9414c6a0 con 0x55ea8f58e350 2024-08-20T01:48:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.389+0000 7f2ea6403740 1 -- 172.21.15.79:0/1599581064 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2e94149820 con 0x55ea8f58ba20 2024-08-20T01:48:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.390+0000 7f2ea6403740 10 client.0 _ll_register_callbacks cb 0x7f2e9c064350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:48:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.390+0000 7f2ea12d8640 1 --2- 172.21.15.79:0/1599581064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8f58ba20 0x55ea8f5a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:16.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.390+0000 7f2ea0ad7640 1 -- 172.21.15.79:0/1599581064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8f58ba20 msgr2=0x55ea8f5a5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:16.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.390+0000 7f2ea0ad7640 1 --2- 172.21.15.79:0/1599581064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8f58ba20 0x55ea8f5a5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:16.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.390+0000 7f2ea0ad7640 1 -- 172.21.15.79:0/1599581064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8f590d90 msgr2=0x55ea8f5a4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:16.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.390+0000 7f2ea0ad7640 1 --2- 172.21.15.79:0/1599581064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8f590d90 0x55ea8f5a4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:16.395 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.390+0000 7f2ea0ad7640 1 -- 172.21.15.79:0/1599581064 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea8f59e120 con 0x55ea8f58e350 2024-08-20T01:48:16.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.391+0000 7f2ea0ad7640 1 --2- 172.21.15.79:0/1599581064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8f58e350 0x55ea8f5a3e00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c0cb0b0 tx=0x7f2e8c005bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89ed0e4c2cd95efd server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:16.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.391+0000 7f2e84ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:48:16.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.391+0000 7f2e84ff9640 1 -- 172.21.15.79:0/1599581064 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c049070 con 0x55ea8f58e350 2024-08-20T01:48:16.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.391+0000 7f2e84ff9640 1 -- 172.21.15.79:0/1599581064 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f2e8c104110 con 0x55ea8f58e350 2024-08-20T01:48:16.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.391+0000 7f2ea6403740 1 -- 172.21.15.79:0/1599581064 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e8c0ea070 con 0x55ea8f58e350 2024-08-20T01:48:16.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.392+0000 7f2e84ff9640 1 -- 172.21.15.79:0/1599581064 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f2e8c0cfa00 con 0x55ea8f58e350 2024-08-20T01:48:16.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.392+0000 7f2ea6403740 10 client.27434 fetch_fsmap learned FSMap version 47 2024-08-20T01:48:16.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.392+0000 7f2ea6403740 1 -- 172.21.15.79:0/1599581064 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55ea8f5a3700 con 0x55ea8f58e350 2024-08-20T01:48:16.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.392+0000 7f2e84ff9640 1 -- 172.21.15.79:0/1599581064 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e8c0ac070 con 0x55ea8f58e350 2024-08-20T01:48:16.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.392+0000 7f2e84ff9640 1 -- 172.21.15.79:0/1599581064 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 47) ==== 8394+0+0 (secure 0 0 0) 0x7f2e8c0c9350 con 0x55ea8f58e350 2024-08-20T01:48:16.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.392+0000 7f2ea6403740 10 client.27434 fetch_fsmap finished waiting for FSMap version 47 2024-08-20T01:48:16.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.392+0000 7f2ea6403740 10 client.27434 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:48:16.396 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.392+0000 7f2ea6403740 20 client.27434 populate_metadata read hostname 'smithi079' 2024-08-20T01:48:16.397 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.393+0000 7f2ea6403740 1 --2- 172.21.15.79:0/1599581064 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55ea8f61cd70 0x55ea8f61f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:16.397 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.393+0000 7f2ea6403740 4 client.27434 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:48:16.397 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.393+0000 7f2ea6403740 1 -- 172.21.15.79:0/1599581064 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f2e8c0ea070 con 0x55ea8f61cd70 2024-08-20T01:48:16.397 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.393+0000 7f2ea12d8640 1 --2- 172.21.15.79:0/1599581064 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55ea8f61cd70 0x55ea8f61f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:16.397 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.394+0000 7f2ea12d8640 1 --2- 172.21.15.79:0/1599581064 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55ea8f61cd70 0x55ea8f61f190 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fd5bb6712ae84ba server_cookie=5260f1c2ebbe0677 in_seq=0 out_seq=0 2024-08-20T01:48:16.397 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.394+0000 7f2e84ff9640 10 client.27434 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:16.427 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.425+0000 7f2e84ff9640 1 -- 172.21.15.79:0/1599581064 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f2e8c0ea070 con 0x55ea8f61cd70 2024-08-20T01:48:16.427 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.425+0000 7f2e84ff9640 10 client.27434 handle_command_reply: tid=0 2024-08-20T01:48:16.428 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.426+0000 7f2ea6403740 1 client.27434 shutdown 2024-08-20T01:48:16.429 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.426+0000 7f2ea6403740 1 -- 172.21.15.79:0/1599581064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8f58e350 msgr2=0x55ea8f5a3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:16.429 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.426+0000 7f2ea6403740 1 --2- 172.21.15.79:0/1599581064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8f58e350 0x55ea8f5a3e00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c0cb0b0 tx=0x7f2e8c005bf0 comp rx=0 tx=0).stop 2024-08-20T01:48:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.426+0000 7f2ea6403740 1 -- 172.21.15.79:0/1599581064 shutdown_connections 2024-08-20T01:48:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.426+0000 7f2ea6403740 1 --2- 172.21.15.79:0/1599581064 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55ea8f61cd70 0x55ea8f61f190 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.426+0000 7f2e84ff9640 0 client.27434 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.426+0000 7f2ea6403740 1 --2- 172.21.15.79:0/1599581064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8f590d90 0x55ea8f5a4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.426+0000 7f2ea6403740 1 --2- 172.21.15.79:0/1599581064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8f58e350 0x55ea8f5a3e00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.426+0000 7f2ea6403740 1 --2- 172.21.15.79:0/1599581064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8f58ba20 0x55ea8f5a5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.426+0000 7f2ea6403740 1 -- 172.21.15.79:0/1599581064 >> 172.21.15.79:0/1599581064 conn(0x55ea8f586b70 msgr2=0x55ea8f58b300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.427+0000 7f2ea6403740 1 -- 172.21.15.79:0/1599581064 shutdown_connections 2024-08-20T01:48:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.427+0000 7f2ea6403740 1 -- 172.21.15.79:0/1599581064 wait complete. 2024-08-20T01:48:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.427+0000 7f2ea6403740 20 client.27434 trim_cache size 0 max 16384 2024-08-20T01:48:16.431 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:48:16.431 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:48:16.431 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:48:16.431 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:48:16.431 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.428+0000 7f2ea22da640 1 -- 172.21.15.79:0/3372200183 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2e880b3d10 msgr2=0x7f2e880b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:16.432 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.428+0000 7f2ea22da640 1 --2- 172.21.15.79:0/3372200183 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2e880b3d10 0x7f2e880b61d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c068b40 tx=0x7f2e9c0694d0 comp rx=0 tx=0).stop 2024-08-20T01:48:16.432 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.428+0000 7f2ea22da640 1 -- 172.21.15.79:0/3372200183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e940986f0 msgr2=0x7f2e9413cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:16.432 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.428+0000 7f2ea22da640 1 --2- 172.21.15.79:0/3372200183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e940986f0 0x7f2e9413cea0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c009850 tx=0x7f2e8c003b90 comp rx=0 tx=0).stop 2024-08-20T01:48:16.432 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.428+0000 7f2ea22da640 1 -- 172.21.15.79:0/3372200183 shutdown_connections 2024-08-20T01:48:16.432 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.428+0000 7f2ea22da640 1 --2- 172.21.15.79:0/3372200183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e9409b260 0x7f2e9413dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:16.432 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.428+0000 7f2ea22da640 1 --2- 172.21.15.79:0/3372200183 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2e880b3d10 0x7f2e880b61d0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:16.432 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.428+0000 7f2ea22da640 1 --2- 172.21.15.79:0/3372200183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e940986f0 0x7f2e9413cea0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:16.432 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.428+0000 7f2ea22da640 1 --2- 172.21.15.79:0/3372200183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e94005850 0x7f2e9413c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:16.432 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.428+0000 7f2ea22da640 1 -- 172.21.15.79:0/3372200183 >> 172.21.15.79:0/3372200183 conn(0x7f2e9408fce0 msgr2=0x7f2e94096a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:16.432 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.428+0000 7f2ea22da640 1 -- 172.21.15.79:0/3372200183 shutdown_connections 2024-08-20T01:48:16.432 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:16.428+0000 7f2ea22da640 1 -- 172.21.15.79:0/3372200183 wait complete. 2024-08-20T01:48:16.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:16 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:48:16.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:16 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:48:16.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:16 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:48:16.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:16 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:48:16.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:16 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:48:16.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:16 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:48:17.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:16 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:48:17.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:16 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:48:17.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:16 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:48:17.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:17 smithi175 ceph-mon[22392]: pgmap v676: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 25 MiB/s wr, 6.39k op/s 2024-08-20T01:48:17.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:17 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:48:17.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:17 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:48:17.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:17 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:48:17.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:17 smithi079 ceph-mon[18656]: pgmap v676: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 25 MiB/s wr, 6.39k op/s 2024-08-20T01:48:17.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:17 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:48:17.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:17 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:48:17.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:17 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:48:18.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:17 smithi081 ceph-mon[22209]: pgmap v676: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 25 MiB/s wr, 6.39k op/s 2024-08-20T01:48:18.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:17 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:48:18.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:17 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:48:18.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:17 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:48:20.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:19 smithi081 ceph-mon[22209]: pgmap v677: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 26 MiB/s wr, 6.76k op/s 2024-08-20T01:48:20.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:19 smithi175 ceph-mon[22392]: pgmap v677: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 26 MiB/s wr, 6.76k op/s 2024-08-20T01:48:20.188 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:19 smithi079 ceph-mon[18656]: pgmap v677: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 26 MiB/s wr, 6.76k op/s 2024-08-20T01:48:22.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:21 smithi081 ceph-mon[22209]: pgmap v678: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 6.54k op/s 2024-08-20T01:48:22.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:21 smithi175 ceph-mon[22392]: pgmap v678: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 6.54k op/s 2024-08-20T01:48:22.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:21 smithi079 ceph-mon[18656]: pgmap v678: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 6.54k op/s 2024-08-20T01:48:24.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:23 smithi081 ceph-mon[22209]: pgmap v679: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 6.29k op/s 2024-08-20T01:48:24.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:23 smithi175 ceph-mon[22392]: pgmap v679: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 6.29k op/s 2024-08-20T01:48:24.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:23 smithi079 ceph-mon[18656]: pgmap v679: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 6.29k op/s 2024-08-20T01:48:26.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:25 smithi081 ceph-mon[22209]: pgmap v680: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 27 MiB/s wr, 6.76k op/s 2024-08-20T01:48:26.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:25 smithi175 ceph-mon[22392]: pgmap v680: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 27 MiB/s wr, 6.76k op/s 2024-08-20T01:48:26.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:25 smithi079 ceph-mon[18656]: pgmap v680: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 27 MiB/s wr, 6.76k op/s 2024-08-20T01:48:28.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:27 smithi081 ceph-mon[22209]: pgmap v681: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 6.35k op/s 2024-08-20T01:48:28.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:27 smithi175 ceph-mon[22392]: pgmap v681: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 6.35k op/s 2024-08-20T01:48:28.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:27 smithi079 ceph-mon[18656]: pgmap v681: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 6.35k op/s 2024-08-20T01:48:29.586 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.582+0000 7f93e248d640 1 -- 172.21.15.79:0/4023218970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93dc109e80 msgr2=0x7f93dc10a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:29.586 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.582+0000 7f93e248d640 1 --2- 172.21.15.79:0/4023218970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93dc109e80 0x7f93dc10a300 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f93d4009be0 tx=0x7f93d402a6d0 comp rx=0 tx=0).stop 2024-08-20T01:48:29.586 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.583+0000 7f93e248d640 1 -- 172.21.15.79:0/4023218970 shutdown_connections 2024-08-20T01:48:29.586 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.583+0000 7f93e248d640 1 --2- 172.21.15.79:0/4023218970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93dc10a840 0x7f93dc119dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:29.586 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.583+0000 7f93e248d640 1 --2- 172.21.15.79:0/4023218970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93dc109e80 0x7f93dc10a300 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:29.586 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.583+0000 7f93e248d640 1 --2- 172.21.15.79:0/4023218970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93dc073fb0 0x7f93dc0743b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:29.586 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.583+0000 7f93e248d640 1 -- 172.21.15.79:0/4023218970 >> 172.21.15.79:0/4023218970 conn(0x7f93dc06f740 msgr2=0x7f93dc071b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:29.589 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.583+0000 7f93e248d640 1 -- 172.21.15.79:0/4023218970 shutdown_connections 2024-08-20T01:48:29.589 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.583+0000 7f93e248d640 1 -- 172.21.15.79:0/4023218970 wait complete. 2024-08-20T01:48:29.589 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.584+0000 7f93e248d640 1 Processor -- start 2024-08-20T01:48:29.589 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.584+0000 7f93e248d640 1 -- start start 2024-08-20T01:48:29.589 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.584+0000 7f93e248d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93dc073fb0 0x7f93dc1c35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:29.589 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.584+0000 7f93e248d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93dc109e80 0x7f93dc1c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:29.589 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.584+0000 7f93e248d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93dc10a840 0x7f93dc1c82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:29.589 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.584+0000 7f93e248d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc113ee0 con 0x7f93dc073fb0 2024-08-20T01:48:29.589 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.584+0000 7f93e248d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc113d60 con 0x7f93dc109e80 2024-08-20T01:48:29.589 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.584+0000 7f93e248d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc114060 con 0x7f93dc10a840 2024-08-20T01:48:29.589 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.585+0000 7f93db7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93dc109e80 0x7f93dc1c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.585+0000 7f93db7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93dc109e80 0x7f93dc1c5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:56652/0 (socket says 172.21.15.79:56652) 2024-08-20T01:48:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.585+0000 7f93db7fe640 1 -- 172.21.15.79:0/3766557230 learned_addr learned my addr 172.21.15.79:0/3766557230 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.585+0000 7f93e0a2a640 1 --2- 172.21.15.79:0/3766557230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93dc10a840 0x7f93dc1c82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.585+0000 7f93db7fe640 1 -- 172.21.15.79:0/3766557230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93dc10a840 msgr2=0x7f93dc1c82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.585+0000 7f93db7fe640 1 --2- 172.21.15.79:0/3766557230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93dc10a840 0x7f93dc1c82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.585+0000 7f93db7fe640 1 -- 172.21.15.79:0/3766557230 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93dc073fb0 msgr2=0x7f93dc1c35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.585+0000 7f93db7fe640 1 --2- 172.21.15.79:0/3766557230 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93dc073fb0 0x7f93dc1c35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.585+0000 7f93db7fe640 1 -- 172.21.15.79:0/3766557230 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93dc1c8b70 con 0x7f93dc109e80 2024-08-20T01:48:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.586+0000 7f93db7fe640 1 --2- 172.21.15.79:0/3766557230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93dc109e80 0x7f93dc1c5b50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f93d4009d00 tx=0x7f93d4003ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.586+0000 7f93d97fa640 1 -- 172.21.15.79:0/3766557230 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d4041020 con 0x7f93dc109e80 2024-08-20T01:48:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.586+0000 7f93d97fa640 1 -- 172.21.15.79:0/3766557230 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f93d4037040 con 0x7f93dc109e80 2024-08-20T01:48:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.586+0000 7f93d97fa640 1 -- 172.21.15.79:0/3766557230 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d4036070 con 0x7f93dc109e80 2024-08-20T01:48:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.586+0000 7f93e248d640 1 -- 172.21.15.79:0/3766557230 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93dc1c8e00 con 0x7f93dc109e80 2024-08-20T01:48:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.586+0000 7f93e248d640 1 -- 172.21.15.79:0/3766557230 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93dc1c9210 con 0x7f93dc109e80 2024-08-20T01:48:29.592 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.590+0000 7f93e5277740 1 Processor -- start 2024-08-20T01:48:29.594 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.591+0000 7f93e5277740 1 -- start start 2024-08-20T01:48:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.591+0000 7f93e5277740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556473fae8d0 0x556473fb0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.591+0000 7f93e5277740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556473fb1200 0x556473fb35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.591+0000 7f93e5277740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556473fb3c40 0x556473fb6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.591+0000 7f93e5277740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556473f21360 con 0x556473fb1200 2024-08-20T01:48:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.591+0000 7f93e5277740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556473f10860 con 0x556473fb3c40 2024-08-20T01:48:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.591+0000 7f93e5277740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556473f148a0 con 0x556473fae8d0 2024-08-20T01:48:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.591+0000 7f93d97fa640 1 -- 172.21.15.79:0/3766557230 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f93d4044020 con 0x7f93dc109e80 2024-08-20T01:48:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.591+0000 7f93db7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556473fb3c40 0x556473fb6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.591+0000 7f93db7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556473fb3c40 0x556473fb6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:56654/0 (socket says 172.21.15.79:56654) 2024-08-20T01:48:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.591+0000 7f93db7fe640 1 -- 172.21.15.79:0/988562288 learned_addr learned my addr 172.21.15.79:0/988562288 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.592+0000 7f93db7fe640 1 -- 172.21.15.79:0/988562288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556473fae8d0 msgr2=0x556473fb0cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:48:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.592+0000 7f93db7fe640 1 --2- 172.21.15.79:0/988562288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556473fae8d0 0x556473fb0cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.592+0000 7f93db7fe640 1 -- 172.21.15.79:0/988562288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556473fb1200 msgr2=0x556473fb35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.592+0000 7f93db7fe640 1 --2- 172.21.15.79:0/988562288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556473fb1200 0x556473fb35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.592+0000 7f93db7fe640 1 -- 172.21.15.79:0/988562288 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556473eb7e40 con 0x556473fb3c40 2024-08-20T01:48:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.592+0000 7f93d97fa640 1 --2- 172.21.15.79:0/3766557230 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f93c40b3de0 0x7f93c40b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.592+0000 7f93db7fe640 1 --2- 172.21.15.79:0/988562288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556473fb3c40 0x556473fb6100 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f93d410ad00 tx=0x7f93d410adf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5346260cf7c102c6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.593+0000 7f93c27fc640 1 -- 172.21.15.79:0/988562288 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d40c7530 con 0x556473fb3c40 2024-08-20T01:48:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.593+0000 7f93c27fc640 1 -- 172.21.15.79:0/988562288 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f93d4004040 con 0x556473fb3c40 2024-08-20T01:48:29.601 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.593+0000 7f93c27fc640 1 -- 172.21.15.79:0/988562288 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d40cade0 con 0x556473fb3c40 2024-08-20T01:48:29.601 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.594+0000 7f93d97fa640 1 -- 172.21.15.79:0/3766557230 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f93d41046f0 con 0x7f93dc109e80 2024-08-20T01:48:29.601 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.594+0000 7f93e5277740 1 -- 172.21.15.79:0/988562288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556473fb3c40 msgr2=0x556473fb6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:29.601 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.594+0000 7f93e5277740 1 --2- 172.21.15.79:0/988562288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556473fb3c40 0x556473fb6100 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f93d410ad00 tx=0x7f93d410adf0 comp rx=0 tx=0).stop 2024-08-20T01:48:29.601 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.594+0000 7f93e5277740 1 -- 172.21.15.79:0/988562288 shutdown_connections 2024-08-20T01:48:29.601 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.594+0000 7f93e5277740 1 --2- 172.21.15.79:0/988562288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556473fb3c40 0x556473fb6100 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:29.601 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.594+0000 7f93e5277740 1 --2- 172.21.15.79:0/988562288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556473fb1200 0x556473fb35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:29.601 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.594+0000 7f93e5277740 1 --2- 172.21.15.79:0/988562288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556473fae8d0 0x556473fb0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:29.601 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.594+0000 7f93e5277740 1 -- 172.21.15.79:0/988562288 >> 172.21.15.79:0/988562288 conn(0x556473fa9a20 msgr2=0x556473faa7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:29.601 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.594+0000 7f93e5277740 1 -- 172.21.15.79:0/988562288 shutdown_connections 2024-08-20T01:48:29.601 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.594+0000 7f93e5277740 1 -- 172.21.15.79:0/988562288 wait complete. 2024-08-20T01:48:29.601 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.594+0000 7f93e0a2a640 1 --2- 172.21.15.79:0/3766557230 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f93c40b3de0 0x7f93c40b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:29.601 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.595+0000 7f93e5277740 1 -- start start 2024-08-20T01:48:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.595+0000 7f93e0a2a640 1 --2- 172.21.15.79:0/3766557230 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f93c40b3de0 0x7f93c40b62a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f93d000b910 tx=0x7f93d0005be0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.595+0000 7f93e5277740 1 Processor -- start 2024-08-20T01:48:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.595+0000 7f93e5277740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556473fae8d0 0x556473fb7d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.595+0000 7f93e5277740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556473fb1200 0x556473fb8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.595+0000 7f93e5277740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556473fb3c40 0x556473fb8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.595+0000 7f93e5277740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556473e49ab0 con 0x556473fb3c40 2024-08-20T01:48:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.595+0000 7f93e5277740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556473e97780 con 0x556473fae8d0 2024-08-20T01:48:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.595+0000 7f93e5277740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556473f10860 con 0x556473fb1200 2024-08-20T01:48:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.596+0000 7f93e5277740 10 client.0 _ll_register_callbacks cb 0x556473c1fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:48:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.596+0000 7f93dbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556473fae8d0 0x556473fb7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.596+0000 7f93dbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556473fae8d0 0x556473fb7d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:56660/0 (socket says 172.21.15.79:56660) 2024-08-20T01:48:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.596+0000 7f93dbfff640 1 -- 172.21.15.79:0/1766177937 learned_addr learned my addr 172.21.15.79:0/1766177937 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.596+0000 7f93db7fe640 1 --2- 172.21.15.79:0/1766177937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556473fb1200 0x556473fb8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.596+0000 7f93dbfff640 1 -- 172.21.15.79:0/1766177937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556473fb1200 msgr2=0x556473fb8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.596+0000 7f93dbfff640 1 --2- 172.21.15.79:0/1766177937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556473fb1200 0x556473fb8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.596+0000 7f93dbfff640 1 -- 172.21.15.79:0/1766177937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556473fb3c40 msgr2=0x556473fb8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.596+0000 7f93dbfff640 1 --2- 172.21.15.79:0/1766177937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556473fb3c40 0x556473fb8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.596+0000 7f93dbfff640 1 -- 172.21.15.79:0/1766177937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556473c73790 con 0x556473fae8d0 2024-08-20T01:48:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.597+0000 7f93dbfff640 1 --2- 172.21.15.79:0/1766177937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556473fae8d0 0x556473fb7d60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f93cc00c600 tx=0x7f93cc00cac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bee02913e1d3ecc3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.597+0000 7f93bb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:48:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.597+0000 7f93bb7fe640 1 -- 172.21.15.79:0/1766177937 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93cc00e8b0 con 0x556473fae8d0 2024-08-20T01:48:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.597+0000 7f93bb7fe640 1 -- 172.21.15.79:0/1766177937 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f93cc00ea50 con 0x556473fae8d0 2024-08-20T01:48:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.597+0000 7f93e5277740 1 -- 172.21.15.79:0/1766177937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556473ebfe00 con 0x556473fae8d0 2024-08-20T01:48:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.597+0000 7f93bb7fe640 1 -- 172.21.15.79:0/1766177937 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f93cc00ec50 con 0x556473fae8d0 2024-08-20T01:48:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.597+0000 7f93e5277740 10 client.27446 fetch_fsmap learned FSMap version 47 2024-08-20T01:48:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.597+0000 7f93e5277740 1 -- 172.21.15.79:0/1766177937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x556473cec620 con 0x556473fae8d0 2024-08-20T01:48:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.598+0000 7f93bb7fe640 1 -- 172.21.15.79:0/1766177937 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x556473ebfe00 con 0x556473fae8d0 2024-08-20T01:48:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.598+0000 7f93bb7fe640 1 -- 172.21.15.79:0/1766177937 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 47) ==== 8394+0+0 (secure 0 0 0) 0x7f93cc01e3f0 con 0x556473fae8d0 2024-08-20T01:48:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.598+0000 7f93e5277740 10 client.27446 fetch_fsmap finished waiting for FSMap version 47 2024-08-20T01:48:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.598+0000 7f93e5277740 10 client.27446 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:48:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.598+0000 7f93e5277740 20 client.27446 populate_metadata read hostname 'smithi079' 2024-08-20T01:48:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.598+0000 7f93e5277740 1 --2- 172.21.15.79:0/1766177937 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556473fc3590 0x556473fc5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.598+0000 7f93e5277740 4 client.27446 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:48:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.598+0000 7f93e5277740 1 -- 172.21.15.79:0/1766177937 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556473f232b0 con 0x556473fc3590 2024-08-20T01:48:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.600+0000 7f93db7fe640 1 --2- 172.21.15.79:0/1766177937 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556473fc3590 0x556473fc5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:29.609 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.607+0000 7f93db7fe640 1 --2- 172.21.15.79:0/1766177937 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556473fc3590 0x556473fc5a20 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bad71fe217941a5 server_cookie=28a718b0c1f02184 in_seq=0 out_seq=0 2024-08-20T01:48:29.609 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.607+0000 7f93bb7fe640 10 client.27446 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:29.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.607+0000 7f93bb7fe640 1 -- 172.21.15.79:0/1766177937 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556473f232b0 con 0x556473fc3590 2024-08-20T01:48:29.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.607+0000 7f93bb7fe640 10 client.27446 handle_command_reply: tid=0 2024-08-20T01:48:29.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.607+0000 7f93e5277740 1 client.27446 shutdown 2024-08-20T01:48:29.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.608+0000 7f93e5277740 1 -- 172.21.15.79:0/1766177937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556473fae8d0 msgr2=0x556473fb7d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:29.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.608+0000 7f93e5277740 1 --2- 172.21.15.79:0/1766177937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556473fae8d0 0x556473fb7d60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f93cc00c600 tx=0x7f93cc00cac0 comp rx=0 tx=0).stop 2024-08-20T01:48:29.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.608+0000 7f93e5277740 1 -- 172.21.15.79:0/1766177937 shutdown_connections 2024-08-20T01:48:29.611 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.608+0000 7f93e5277740 1 --2- 172.21.15.79:0/1766177937 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556473fc3590 0x556473fc5a20 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:29.612 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.608+0000 7f93bb7fe640 0 client.27446 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:29.612 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.608+0000 7f93e5277740 1 --2- 172.21.15.79:0/1766177937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556473fb3c40 0x556473fb8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:29.612 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.608+0000 7f93e5277740 1 --2- 172.21.15.79:0/1766177937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556473fb1200 0x556473fb8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:29.612 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.608+0000 7f93e5277740 1 --2- 172.21.15.79:0/1766177937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556473fae8d0 0x556473fb7d60 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:29.612 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.608+0000 7f93e5277740 1 -- 172.21.15.79:0/1766177937 >> 172.21.15.79:0/1766177937 conn(0x556473fa9a20 msgr2=0x556473fa8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:29.612 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.608+0000 7f93e5277740 1 -- 172.21.15.79:0/1766177937 shutdown_connections 2024-08-20T01:48:29.612 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.608+0000 7f93e5277740 1 -- 172.21.15.79:0/1766177937 wait complete. 2024-08-20T01:48:29.612 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.608+0000 7f93e5277740 20 client.27446 trim_cache size 0 max 16384 2024-08-20T01:48:29.636 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.634+0000 7f93e5277740 1 Processor -- start 2024-08-20T01:48:29.637 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.634+0000 7f93e5277740 1 -- start start 2024-08-20T01:48:29.638 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.635+0000 7f93e5277740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556473fae8d0 0x556473fb7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:29.638 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.635+0000 7f93e5277740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556473fb1200 0x556473faa280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:29.638 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.635+0000 7f93e5277740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556473fb3c40 0x556473faa7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:29.638 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.635+0000 7f93dbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556473fae8d0 0x556473fb7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:29.638 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.635+0000 7f93dbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556473fae8d0 0x556473fb7ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:56674/0 (socket says 172.21.15.79:56674) 2024-08-20T01:48:29.639 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.635+0000 7f93db7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556473fb1200 0x556473faa280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:29.639 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.635+0000 7f93db7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556473fb1200 0x556473faa280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:40058/0 (socket says 172.21.15.79:40058) 2024-08-20T01:48:29.639 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.635+0000 7f93dbfff640 1 -- 172.21.15.79:0/3879567220 learned_addr learned my addr 172.21.15.79:0/3879567220 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:29.639 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.635+0000 7f93e5277740 1 -- 172.21.15.79:0/3879567220 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc1d2190 con 0x556473fb3c40 2024-08-20T01:48:29.639 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.635+0000 7f93e5277740 1 -- 172.21.15.79:0/3879567220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc1d3e50 con 0x556473fae8d0 2024-08-20T01:48:29.639 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.635+0000 7f93e5277740 1 -- 172.21.15.79:0/3879567220 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc1d2920 con 0x556473fb1200 2024-08-20T01:48:29.639 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.636+0000 7f93e0a2a640 1 --2- 172.21.15.79:0/3879567220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556473fb3c40 0x556473faa7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:29.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.636+0000 7f93e0a2a640 1 -- 172.21.15.79:0/3879567220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556473fb1200 msgr2=0x556473faa280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:29.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.636+0000 7f93e0a2a640 1 --2- 172.21.15.79:0/3879567220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556473fb1200 0x556473faa280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:29.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.636+0000 7f93e0a2a640 1 -- 172.21.15.79:0/3879567220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556473fae8d0 msgr2=0x556473fb7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:29.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.636+0000 7f93e0a2a640 1 --2- 172.21.15.79:0/3879567220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556473fae8d0 0x556473fb7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:29.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.636+0000 7f93e0a2a640 1 -- 172.21.15.79:0/3879567220 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556473fb6460 con 0x556473fb3c40 2024-08-20T01:48:29.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.636+0000 7f93e0a2a640 1 --2- 172.21.15.79:0/3879567220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556473fb3c40 0x556473faa7c0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x556473fb8ab0 tx=0x7f93d0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9b0e19330927acd server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:29.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.636+0000 7f93c1ffb640 1 -- 172.21.15.79:0/3879567220 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d001f070 con 0x556473fb3c40 2024-08-20T01:48:29.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.637+0000 7f93c1ffb640 1 -- 172.21.15.79:0/3879567220 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f93d00054b0 con 0x556473fb3c40 2024-08-20T01:48:29.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.637+0000 7f93c1ffb640 1 -- 172.21.15.79:0/3879567220 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d001b420 con 0x556473fb3c40 2024-08-20T01:48:29.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.638+0000 7f93e5277740 1 -- 172.21.15.79:0/3879567220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556473fb3c40 msgr2=0x556473faa7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:29.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.638+0000 7f93e5277740 1 --2- 172.21.15.79:0/3879567220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556473fb3c40 0x556473faa7c0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x556473fb8ab0 tx=0x7f93d0004730 comp rx=0 tx=0).stop 2024-08-20T01:48:29.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.638+0000 7f93e5277740 1 -- 172.21.15.79:0/3879567220 shutdown_connections 2024-08-20T01:48:29.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.638+0000 7f93e5277740 1 --2- 172.21.15.79:0/3879567220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556473fb3c40 0x556473faa7c0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:29.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.638+0000 7f93e5277740 1 --2- 172.21.15.79:0/3879567220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556473fb1200 0x556473faa280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:29.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.638+0000 7f93e5277740 1 --2- 172.21.15.79:0/3879567220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556473fae8d0 0x556473fb7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:29.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.638+0000 7f93e5277740 1 -- 172.21.15.79:0/3879567220 >> 172.21.15.79:0/3879567220 conn(0x556473fa9a20 msgr2=0x556473fb6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:29.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.638+0000 7f93e5277740 1 -- 172.21.15.79:0/3879567220 shutdown_connections 2024-08-20T01:48:29.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.638+0000 7f93e5277740 1 -- 172.21.15.79:0/3879567220 wait complete. 2024-08-20T01:48:29.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.638+0000 7f93e5277740 1 -- start start 2024-08-20T01:48:29.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.639+0000 7f93e5277740 1 Processor -- start 2024-08-20T01:48:29.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.639+0000 7f93e5277740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556473fae8d0 0x556473fbc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:29.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.639+0000 7f93e5277740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556473fb1200 0x556473fbd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:29.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.639+0000 7f93e5277740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556473fb3c40 0x556473fbdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:29.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.639+0000 7f93e5277740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc1d3780 con 0x556473fb3c40 2024-08-20T01:48:29.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.639+0000 7f93e5277740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc1d2ff0 con 0x556473fb1200 2024-08-20T01:48:29.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.639+0000 7f93e5277740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc1d0170 con 0x556473fae8d0 2024-08-20T01:48:29.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.639+0000 7f93dbfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556473fae8d0 0x556473fbc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:29.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.639+0000 7f93db7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556473fb1200 0x556473fbd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:29.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.639+0000 7f93db7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556473fb1200 0x556473fbd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:56680/0 (socket says 172.21.15.79:56680) 2024-08-20T01:48:29.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.639+0000 7f93db7fe640 1 -- 172.21.15.79:0/3675971086 learned_addr learned my addr 172.21.15.79:0/3675971086 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:29.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.640+0000 7f93e5277740 10 client.0 _ll_register_callbacks cb 0x7f93cc00a270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:48:29.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.640+0000 7f93e0a2a640 1 --2- 172.21.15.79:0/3675971086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556473fb3c40 0x556473fbdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:29.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.640+0000 7f93dbfff640 1 -- 172.21.15.79:0/3675971086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556473fb1200 msgr2=0x556473fbd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:29.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.640+0000 7f93dbfff640 1 --2- 172.21.15.79:0/3675971086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556473fb1200 0x556473fbd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:29.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.640+0000 7f93dbfff640 1 -- 172.21.15.79:0/3675971086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556473fb3c40 msgr2=0x556473fbdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:29.646 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.640+0000 7f93dbfff640 1 --2- 172.21.15.79:0/3675971086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556473fb3c40 0x556473fbdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:29.646 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.640+0000 7f93dbfff640 1 -- 172.21.15.79:0/3675971086 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556473fbe490 con 0x556473fae8d0 2024-08-20T01:48:29.646 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.640+0000 7f93db7fe640 1 --2- 172.21.15.79:0/3675971086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556473fb1200 0x556473fbd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:48:29.646 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.640+0000 7f93dbfff640 1 --2- 172.21.15.79:0/3675971086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556473fae8d0 0x556473fbc9f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f93cc00aa30 tx=0x7f93cc01ed90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fa768e9f115cc6a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:29.646 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.640+0000 7f93bb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:48:29.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.641+0000 7f93bb7fe640 1 -- 172.21.15.79:0/3675971086 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93cc02d020 con 0x556473fae8d0 2024-08-20T01:48:29.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.641+0000 7f93bb7fe640 1 -- 172.21.15.79:0/3675971086 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f93cc00e8b0 con 0x556473fae8d0 2024-08-20T01:48:29.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.643+0000 7f93e5277740 1 -- 172.21.15.79:0/3675971086 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93d00054b0 con 0x556473fae8d0 2024-08-20T01:48:29.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.643+0000 7f93bb7fe640 1 -- 172.21.15.79:0/3675971086 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f93cc024080 con 0x556473fae8d0 2024-08-20T01:48:29.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.643+0000 7f93e5277740 10 client.27424 fetch_fsmap learned FSMap version 47 2024-08-20T01:48:29.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.643+0000 7f93e5277740 1 -- 172.21.15.79:0/3675971086 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x556473fbf830 con 0x556473fae8d0 2024-08-20T01:48:29.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.644+0000 7f93bb7fe640 1 -- 172.21.15.79:0/3675971086 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f93cc0044d0 con 0x556473fae8d0 2024-08-20T01:48:29.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.644+0000 7f93bb7fe640 1 -- 172.21.15.79:0/3675971086 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 47) ==== 8394+0+0 (secure 0 0 0) 0x7f93cc003a50 con 0x556473fae8d0 2024-08-20T01:48:29.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.644+0000 7f93e5277740 10 client.27424 fetch_fsmap finished waiting for FSMap version 47 2024-08-20T01:48:29.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.644+0000 7f93e5277740 10 client.27424 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:48:29.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.644+0000 7f93e5277740 20 client.27424 populate_metadata read hostname 'smithi079' 2024-08-20T01:48:29.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.644+0000 7f93e5277740 1 --2- 172.21.15.79:0/3675971086 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556473fc3590 0x556474030400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:29.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.644+0000 7f93e5277740 4 client.27424 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:48:29.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.644+0000 7f93e5277740 1 -- 172.21.15.79:0/3675971086 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f93d00054b0 con 0x556473fc3590 2024-08-20T01:48:29.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.644+0000 7f93db7fe640 1 --2- 172.21.15.79:0/3675971086 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556473fc3590 0x556474030400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:29.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.645+0000 7f93bb7fe640 10 client.27424 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:29.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:29.646+0000 7f93db7fe640 1 --2- 172.21.15.79:0/3675971086 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556473fc3590 0x556474030400 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f270e665daafb83 server_cookie=8fd558c14018c9de in_seq=0 out_seq=0 2024-08-20T01:48:30.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:29 smithi081 ceph-mon[22209]: pgmap v682: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 27 MiB/s wr, 6.84k op/s 2024-08-20T01:48:30.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:29 smithi175 ceph-mon[22392]: pgmap v682: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 27 MiB/s wr, 6.84k op/s 2024-08-20T01:48:30.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:29 smithi079 ceph-mon[18656]: pgmap v682: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 27 MiB/s wr, 6.84k op/s 2024-08-20T01:48:30.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:30.483+0000 7f93bb7fe640 1 -- 172.21.15.79:0/3675971086 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f93d00054b0 con 0x556473fc3590 2024-08-20T01:48:30.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:30.483+0000 7f93bb7fe640 10 client.27424 handle_command_reply: tid=0 2024-08-20T01:48:30.488 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:30.483+0000 7f93e5277740 1 client.27424 shutdown 2024-08-20T01:48:30.489 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:30.485+0000 7f93e5277740 1 -- 172.21.15.79:0/3675971086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556473fae8d0 msgr2=0x556473fbc9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:30.489 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:30.485+0000 7f93e5277740 1 --2- 172.21.15.79:0/3675971086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556473fae8d0 0x556473fbc9f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f93cc00aa30 tx=0x7f93cc01ed90 comp rx=0 tx=0).stop 2024-08-20T01:48:30.489 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:30.485+0000 7f93e5277740 1 -- 172.21.15.79:0/3675971086 shutdown_connections 2024-08-20T01:48:30.489 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:30.485+0000 7f93e5277740 1 --2- 172.21.15.79:0/3675971086 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556473fc3590 0x556474030400 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:30.489 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:30.485+0000 7f93e5277740 1 --2- 172.21.15.79:0/3675971086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556473fb3c40 0x556473fbdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:30.489 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:30.485+0000 7f93e5277740 1 --2- 172.21.15.79:0/3675971086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556473fb1200 0x556473fbd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:30.490 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:30.485+0000 7f93e5277740 1 --2- 172.21.15.79:0/3675971086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556473fae8d0 0x556473fbc9f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:30.490 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:30.485+0000 7f93e5277740 1 -- 172.21.15.79:0/3675971086 >> 172.21.15.79:0/3675971086 conn(0x556473fa9a20 msgr2=0x556473faa280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:30.490 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:30.485+0000 7f93bb7fe640 0 client.27424 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:30.490 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:30.486+0000 7f93e5277740 1 -- 172.21.15.79:0/3675971086 shutdown_connections 2024-08-20T01:48:30.490 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:30.487+0000 7f93e5277740 1 -- 172.21.15.79:0/3675971086 wait complete. 2024-08-20T01:48:30.491 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:30.487+0000 7f93e5277740 20 client.27424 trim_cache size 0 max 16384 2024-08-20T01:48:30.491 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:48:30.491 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:48:30.491 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:48:30.491 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:48:30.492 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:30.488+0000 7f93e248d640 1 -- 172.21.15.79:0/3766557230 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f93c40b3de0 msgr2=0x7f93c40b62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:30.492 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:30.488+0000 7f93e248d640 1 --2- 172.21.15.79:0/3766557230 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f93c40b3de0 0x7f93c40b62a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f93d000b910 tx=0x7f93d0005be0 comp rx=0 tx=0).stop 2024-08-20T01:48:30.492 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:30.488+0000 7f93e248d640 1 -- 172.21.15.79:0/3766557230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93dc109e80 msgr2=0x7f93dc1c5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:30.492 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:30.488+0000 7f93e248d640 1 --2- 172.21.15.79:0/3766557230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93dc109e80 0x7f93dc1c5b50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f93d4009d00 tx=0x7f93d4003ba0 comp rx=0 tx=0).stop 2024-08-20T01:48:30.492 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:30.489+0000 7f93e248d640 1 -- 172.21.15.79:0/3766557230 shutdown_connections 2024-08-20T01:48:30.492 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:30.489+0000 7f93e248d640 1 --2- 172.21.15.79:0/3766557230 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f93c40b3de0 0x7f93c40b62a0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:30.492 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:30.489+0000 7f93e248d640 1 --2- 172.21.15.79:0/3766557230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93dc10a840 0x7f93dc1c82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:30.492 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:30.489+0000 7f93e248d640 1 --2- 172.21.15.79:0/3766557230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93dc109e80 0x7f93dc1c5b50 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:30.493 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:30.489+0000 7f93e248d640 1 --2- 172.21.15.79:0/3766557230 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93dc073fb0 0x7f93dc1c35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:30.493 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:30.489+0000 7f93e248d640 1 -- 172.21.15.79:0/3766557230 >> 172.21.15.79:0/3766557230 conn(0x7f93dc06f740 msgr2=0x7f93dc1148e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:30.493 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:30.489+0000 7f93e248d640 1 -- 172.21.15.79:0/3766557230 shutdown_connections 2024-08-20T01:48:30.493 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:30.489+0000 7f93e248d640 1 -- 172.21.15.79:0/3766557230 wait complete. 2024-08-20T01:48:32.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:31 smithi081 ceph-mon[22209]: pgmap v683: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 26 MiB/s wr, 6.69k op/s 2024-08-20T01:48:32.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:31 smithi175 ceph-mon[22392]: pgmap v683: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 26 MiB/s wr, 6.69k op/s 2024-08-20T01:48:32.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:31 smithi079 ceph-mon[18656]: pgmap v683: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 26 MiB/s wr, 6.69k op/s 2024-08-20T01:48:34.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:33 smithi081 ceph-mon[22209]: pgmap v684: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 6.50k op/s 2024-08-20T01:48:34.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:33 smithi175 ceph-mon[22392]: pgmap v684: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 6.50k op/s 2024-08-20T01:48:34.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:33 smithi079 ceph-mon[18656]: pgmap v684: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 6.50k op/s 2024-08-20T01:48:36.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:35 smithi175 ceph-mon[22392]: pgmap v685: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 27 MiB/s wr, 6.93k op/s 2024-08-20T01:48:36.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:35 smithi079 ceph-mon[18656]: pgmap v685: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 27 MiB/s wr, 6.93k op/s 2024-08-20T01:48:36.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:35 smithi081 ceph-mon[22209]: pgmap v685: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 27 MiB/s wr, 6.93k op/s 2024-08-20T01:48:37.278 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:48:37.728 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:48:38.054 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:37 smithi079 ceph-mon[18656]: pgmap v686: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 6.49k op/s 2024-08-20T01:48:38.055 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:37 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:48:38.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:37 smithi175 ceph-mon[22392]: pgmap v686: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 6.49k op/s 2024-08-20T01:48:38.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:37 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:48:38.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:37 smithi081 ceph-mon[22209]: pgmap v686: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 6.49k op/s 2024-08-20T01:48:38.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:37 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:48:38.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.346+0000 7f073c3ed640 1 -- 172.21.15.79:0/2396994721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0734101f80 msgr2=0x7f073410ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:38.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.346+0000 7f073c3ed640 1 --2- 172.21.15.79:0/2396994721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0734101f80 0x7f073410ec50 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f0730009900 tx=0x7f073002a420 comp rx=0 tx=0).stop 2024-08-20T01:48:38.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.347+0000 7f073c3ed640 1 -- 172.21.15.79:0/2396994721 shutdown_connections 2024-08-20T01:48:38.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.347+0000 7f073c3ed640 1 --2- 172.21.15.79:0/2396994721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f073410f190 0x7f0734111580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:38.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.348+0000 7f073c3ed640 1 --2- 172.21.15.79:0/2396994721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0734101f80 0x7f073410ec50 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:38.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.348+0000 7f073c3ed640 1 --2- 172.21.15.79:0/2396994721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0734101660 0x7f0734101a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:38.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.348+0000 7f073c3ed640 1 -- 172.21.15.79:0/2396994721 >> 172.21.15.79:0/2396994721 conn(0x7f07340fd400 msgr2=0x7f07340ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:38.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.348+0000 7f073c3ed640 1 -- 172.21.15.79:0/2396994721 shutdown_connections 2024-08-20T01:48:38.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.348+0000 7f073c3ed640 1 -- 172.21.15.79:0/2396994721 wait complete. 2024-08-20T01:48:38.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.349+0000 7f073c3ed640 1 Processor -- start 2024-08-20T01:48:38.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.349+0000 7f073c3ed640 1 -- start start 2024-08-20T01:48:38.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.350+0000 7f073c3ed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0734101660 0x7f073419b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:38.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.350+0000 7f073c3ed640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0734101f80 0x7f073419b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:38.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.350+0000 7f073c3ed640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f073410f190 0x7f07341a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:38.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.350+0000 7f073c3ed640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0734114b50 con 0x7f073410f190 2024-08-20T01:48:38.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.350+0000 7f073c3ed640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f07341149d0 con 0x7f0734101660 2024-08-20T01:48:38.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.350+0000 7f073c3ed640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0734114cd0 con 0x7f0734101f80 2024-08-20T01:48:38.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.350+0000 7f073a189640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0734101660 0x7f073419b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:38.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.350+0000 7f073a189640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0734101660 0x7f073419b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:32916/0 (socket says 172.21.15.79:32916) 2024-08-20T01:48:38.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.350+0000 7f073a189640 1 -- 172.21.15.79:0/2468189368 learned_addr learned my addr 172.21.15.79:0/2468189368 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:38.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.350+0000 7f073a189640 1 -- 172.21.15.79:0/2468189368 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0734101f80 msgr2=0x7f073419b600 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-20T01:48:38.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.350+0000 7f073a189640 1 --2- 172.21.15.79:0/2468189368 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0734101f80 0x7f073419b600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:38.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.350+0000 7f073a189640 1 -- 172.21.15.79:0/2468189368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f073410f190 msgr2=0x7f07341a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:38.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.350+0000 7f073a189640 1 --2- 172.21.15.79:0/2468189368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f073410f190 0x7f07341a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:38.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.350+0000 7f073a189640 1 -- 172.21.15.79:0/2468189368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07341a1170 con 0x7f0734101660 2024-08-20T01:48:38.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.351+0000 7f073a189640 1 --2- 172.21.15.79:0/2468189368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0734101660 0x7f073419b0c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f072800d950 tx=0x7f072800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:38.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.351+0000 7f07277fe640 1 -- 172.21.15.79:0/2468189368 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0728017070 con 0x7f0734101660 2024-08-20T01:48:38.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.351+0000 7f07277fe640 1 -- 172.21.15.79:0/2468189368 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0728009c30 con 0x7f0734101660 2024-08-20T01:48:38.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.351+0000 7f073c3ed640 1 -- 172.21.15.79:0/2468189368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07341a1460 con 0x7f0734101660 2024-08-20T01:48:38.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.351+0000 7f073c3ed640 1 -- 172.21.15.79:0/2468189368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f073406c8a0 con 0x7f0734101660 2024-08-20T01:48:38.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.351+0000 7f07277fe640 1 -- 172.21.15.79:0/2468189368 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072800f620 con 0x7f0734101660 2024-08-20T01:48:38.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.355+0000 7f073e7e6740 1 Processor -- start 2024-08-20T01:48:38.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.355+0000 7f073e7e6740 1 -- start start 2024-08-20T01:48:38.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.355+0000 7f073e7e6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a30bd830 0x5625a30bdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:38.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.355+0000 7f073e7e6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625a30be150 0x5625a30c9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:38.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.355+0000 7f073e7e6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625a30ca0e0 0x5625a30cc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:38.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.356+0000 7f07277fe640 1 -- 172.21.15.79:0/2468189368 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f0728010460 con 0x7f0734101660 2024-08-20T01:48:38.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.356+0000 7f073a98a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a30bd830 0x5625a30bdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:38.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.356+0000 7f073a98a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a30bd830 0x5625a30bdc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:38506/0 (socket says 172.21.15.79:38506) 2024-08-20T01:48:38.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.356+0000 7f0739988640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625a30ca0e0 0x5625a30cc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:38.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.356+0000 7f073a98a640 1 -- 172.21.15.79:0/1383735968 learned_addr learned my addr 172.21.15.79:0/1383735968 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:38.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.356+0000 7f073e7e6740 1 -- 172.21.15.79:0/1383735968 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5625a30348e0 con 0x5625a30ca0e0 2024-08-20T01:48:38.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.356+0000 7f073e7e6740 1 -- 172.21.15.79:0/1383735968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5625a3023de0 con 0x5625a30be150 2024-08-20T01:48:38.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.356+0000 7f073e7e6740 1 -- 172.21.15.79:0/1383735968 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5625a3027e20 con 0x5625a30bd830 2024-08-20T01:48:38.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.356+0000 7f073a189640 1 --2- 172.21.15.79:0/1383735968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625a30be150 0x5625a30c9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:38.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.356+0000 7f073a98a640 1 -- 172.21.15.79:0/1383735968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625a30be150 msgr2=0x5625a30c9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:38.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.356+0000 7f073a98a640 1 --2- 172.21.15.79:0/1383735968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625a30be150 0x5625a30c9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:38.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.356+0000 7f073a98a640 1 -- 172.21.15.79:0/1383735968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625a30ca0e0 msgr2=0x5625a30cc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:38.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.356+0000 7f073a98a640 1 --2- 172.21.15.79:0/1383735968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625a30ca0e0 0x5625a30cc4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:38.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.356+0000 7f073a98a640 1 -- 172.21.15.79:0/1383735968 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625a2d83650 con 0x5625a30bd830 2024-08-20T01:48:38.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.357+0000 7f073a189640 1 --2- 172.21.15.79:0/1383735968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625a30be150 0x5625a30c9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:48:38.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.357+0000 7f07277fe640 1 --2- 172.21.15.79:0/2468189368 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f07200b3c50 0x7f07200b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:38.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.357+0000 7f073a98a640 1 --2- 172.21.15.79:0/1383735968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a30bd830 0x5625a30bdc10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f072c009ea0 tx=0x7f072c009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcbba56453e3af75 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:38.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.357+0000 7f07277fe640 1 -- 172.21.15.79:0/2468189368 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f07280e37f0 con 0x7f0734101660 2024-08-20T01:48:38.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.358+0000 7f0724de6640 1 -- 172.21.15.79:0/1383735968 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072c004d20 con 0x5625a30bd830 2024-08-20T01:48:38.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.358+0000 7f0724de6640 1 -- 172.21.15.79:0/1383735968 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f072c00ee60 con 0x5625a30bd830 2024-08-20T01:48:38.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.358+0000 7f0724de6640 1 -- 172.21.15.79:0/1383735968 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072c005020 con 0x5625a30bd830 2024-08-20T01:48:38.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.358+0000 7f073a189640 1 --2- 172.21.15.79:0/2468189368 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f07200b3c50 0x7f07200b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:38.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.359+0000 7f073e7e6740 1 -- 172.21.15.79:0/1383735968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a30bd830 msgr2=0x5625a30bdc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:38.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.359+0000 7f073e7e6740 1 --2- 172.21.15.79:0/1383735968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a30bd830 0x5625a30bdc10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f072c009ea0 tx=0x7f072c009f90 comp rx=0 tx=0).stop 2024-08-20T01:48:38.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.359+0000 7f073a189640 1 --2- 172.21.15.79:0/2468189368 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f07200b3c50 0x7f07200b6110 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f07280aa680 tx=0x7f0728005880 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:38.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.359+0000 7f073e7e6740 1 -- 172.21.15.79:0/1383735968 shutdown_connections 2024-08-20T01:48:38.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.359+0000 7f073e7e6740 1 --2- 172.21.15.79:0/1383735968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625a30ca0e0 0x5625a30cc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:38.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.359+0000 7f073e7e6740 1 --2- 172.21.15.79:0/1383735968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625a30be150 0x5625a30c9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:38.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.359+0000 7f073e7e6740 1 --2- 172.21.15.79:0/1383735968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a30bd830 0x5625a30bdc10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:38.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.359+0000 7f073e7e6740 1 -- 172.21.15.79:0/1383735968 >> 172.21.15.79:0/1383735968 conn(0x5625a30bb660 msgr2=0x5625a30bc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:38.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.359+0000 7f073e7e6740 1 -- 172.21.15.79:0/1383735968 shutdown_connections 2024-08-20T01:48:38.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.359+0000 7f073e7e6740 1 -- 172.21.15.79:0/1383735968 wait complete. 2024-08-20T01:48:38.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.360+0000 7f073e7e6740 1 -- start start 2024-08-20T01:48:38.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.360+0000 7f073e7e6740 1 Processor -- start 2024-08-20T01:48:38.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.360+0000 7f073e7e6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a30bd830 0x5625a30c7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:38.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.360+0000 7f073e7e6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625a30be150 0x5625a30c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:38.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.360+0000 7f073e7e6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625a30ca0e0 0x5625a30c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:38.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.361+0000 7f073e7e6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5625a2e86700 con 0x5625a30ca0e0 2024-08-20T01:48:38.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.361+0000 7f073e7e6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5625a2faa7c0 con 0x5625a30be150 2024-08-20T01:48:38.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.361+0000 7f073e7e6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5625a30ccd90 con 0x5625a30bd830 2024-08-20T01:48:38.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.361+0000 7f073a98a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625a30ca0e0 0x5625a30c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:38.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.361+0000 7f073a98a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625a30ca0e0 0x5625a30c7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33230/0 (socket says 172.21.15.79:33230) 2024-08-20T01:48:38.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.361+0000 7f073a98a640 1 -- 172.21.15.79:0/2481352027 learned_addr learned my addr 172.21.15.79:0/2481352027 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:38.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.361+0000 7f073e7e6740 10 client.0 _ll_register_callbacks cb 0x5625a301d6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:48:38.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.361+0000 7f0739988640 1 --2- 172.21.15.79:0/2481352027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625a30be150 0x5625a30c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:38.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.361+0000 7f073a98a640 1 --2- 172.21.15.79:0/2481352027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a30bd830 0x5625a30c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:38.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.361+0000 7f073a98a640 1 -- 172.21.15.79:0/2481352027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a30bd830 msgr2=0x5625a30c7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:38.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.361+0000 7f073a98a640 1 --2- 172.21.15.79:0/2481352027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a30bd830 0x5625a30c7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:38.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.361+0000 7f073a98a640 1 -- 172.21.15.79:0/2481352027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625a30be150 msgr2=0x5625a30c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:38.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.361+0000 7f073a98a640 1 --2- 172.21.15.79:0/2481352027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625a30be150 0x5625a30c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:38.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.361+0000 7f073a98a640 1 -- 172.21.15.79:0/2481352027 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625a30d61a0 con 0x5625a30ca0e0 2024-08-20T01:48:38.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.361+0000 7f0739988640 1 --2- 172.21.15.79:0/2481352027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625a30be150 0x5625a30c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:48:38.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.362+0000 7f073a98a640 1 --2- 172.21.15.79:0/2481352027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625a30ca0e0 0x5625a30c7af0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f072c0049d0 tx=0x7f072c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9842efaac4003028 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:38.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.362+0000 7f071dffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:48:38.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.362+0000 7f071dffb640 1 -- 172.21.15.79:0/2481352027 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072c01c070 con 0x5625a30ca0e0 2024-08-20T01:48:38.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.362+0000 7f071dffb640 1 -- 172.21.15.79:0/2481352027 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f072c003970 con 0x5625a30ca0e0 2024-08-20T01:48:38.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.362+0000 7f073e7e6740 1 -- 172.21.15.79:0/2481352027 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5625a2fd3100 con 0x5625a30ca0e0 2024-08-20T01:48:38.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.362+0000 7f071dffb640 1 -- 172.21.15.79:0/2481352027 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f072c003b70 con 0x5625a30ca0e0 2024-08-20T01:48:38.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.362+0000 7f073e7e6740 10 client.18408 fetch_fsmap learned FSMap version 48 2024-08-20T01:48:38.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.362+0000 7f073e7e6740 1 -- 172.21.15.79:0/2481352027 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x5625a30d8ac0 con 0x5625a30ca0e0 2024-08-20T01:48:38.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.363+0000 7f071dffb640 1 -- 172.21.15.79:0/2481352027 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5625a2fd3100 con 0x5625a30ca0e0 2024-08-20T01:48:38.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.363+0000 7f071dffb640 1 -- 172.21.15.79:0/2481352027 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 48) ==== 8382+0+0 (secure 0 0 0) 0x7f072c018470 con 0x5625a30ca0e0 2024-08-20T01:48:38.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.363+0000 7f073e7e6740 10 client.18408 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T01:48:38.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.363+0000 7f073e7e6740 10 client.18408 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:48:38.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.363+0000 7f073e7e6740 20 client.18408 populate_metadata read hostname 'smithi079' 2024-08-20T01:48:38.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.363+0000 7f073e7e6740 1 --2- 172.21.15.79:0/2481352027 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5625a30d9f20 0x5625a30dc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:38.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.363+0000 7f073e7e6740 4 client.18408 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:48:38.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.363+0000 7f073e7e6740 1 -- 172.21.15.79:0/2481352027 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5625a3036830 con 0x5625a30d9f20 2024-08-20T01:48:38.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.363+0000 7f0739988640 1 --2- 172.21.15.79:0/2481352027 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5625a30d9f20 0x5625a30dc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:38.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.364+0000 7f0739988640 1 --2- 172.21.15.79:0/2481352027 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5625a30d9f20 0x5625a30dc310 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=172fc99ba7fb7488 server_cookie=54a22c6173981618 in_seq=0 out_seq=0 2024-08-20T01:48:38.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.364+0000 7f071dffb640 10 client.18408 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:38.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.365+0000 7f071dffb640 1 -- 172.21.15.79:0/2481352027 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5625a3036830 con 0x5625a30d9f20 2024-08-20T01:48:38.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.365+0000 7f071dffb640 10 client.18408 handle_command_reply: tid=0 2024-08-20T01:48:38.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.365+0000 7f073e7e6740 1 client.18408 shutdown 2024-08-20T01:48:38.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.365+0000 7f073e7e6740 1 -- 172.21.15.79:0/2481352027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625a30ca0e0 msgr2=0x5625a30c7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:38.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.365+0000 7f073e7e6740 1 --2- 172.21.15.79:0/2481352027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625a30ca0e0 0x5625a30c7af0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f072c0049d0 tx=0x7f072c004a40 comp rx=0 tx=0).stop 2024-08-20T01:48:38.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.365+0000 7f073e7e6740 1 -- 172.21.15.79:0/2481352027 shutdown_connections 2024-08-20T01:48:38.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.365+0000 7f073e7e6740 1 --2- 172.21.15.79:0/2481352027 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5625a30d9f20 0x5625a30dc310 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:38.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.365+0000 7f071dffb640 0 client.18408 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:38.371 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.365+0000 7f073e7e6740 1 --2- 172.21.15.79:0/2481352027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625a30ca0e0 0x5625a30c7af0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:38.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.365+0000 7f073e7e6740 1 --2- 172.21.15.79:0/2481352027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625a30be150 0x5625a30c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:38.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.365+0000 7f073e7e6740 1 --2- 172.21.15.79:0/2481352027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a30bd830 0x5625a30c7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:38.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.365+0000 7f073e7e6740 1 -- 172.21.15.79:0/2481352027 >> 172.21.15.79:0/2481352027 conn(0x5625a30bb660 msgr2=0x5625a30c1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:38.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.366+0000 7f073e7e6740 1 -- 172.21.15.79:0/2481352027 shutdown_connections 2024-08-20T01:48:38.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.366+0000 7f073e7e6740 1 -- 172.21.15.79:0/2481352027 wait complete. 2024-08-20T01:48:38.372 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.366+0000 7f073e7e6740 20 client.18408 trim_cache size 0 max 16384 2024-08-20T01:48:38.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.396+0000 7f073e7e6740 1 Processor -- start 2024-08-20T01:48:38.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.397+0000 7f073e7e6740 1 -- start start 2024-08-20T01:48:38.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.397+0000 7f073e7e6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625a30bd830 0x5625a30c9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:38.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.397+0000 7f073e7e6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625a30be150 0x5625a30c6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:38.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.397+0000 7f073e7e6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a30ca0e0 0x5625a30c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:38.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.397+0000 7f073e7e6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f071800e550 con 0x5625a30bd830 2024-08-20T01:48:38.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.397+0000 7f073e7e6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0718010180 con 0x5625a30be150 2024-08-20T01:48:38.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.397+0000 7f073e7e6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f071800ece0 con 0x5625a30ca0e0 2024-08-20T01:48:38.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.398+0000 7f0739988640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625a30be150 0x5625a30c6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:38.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.398+0000 7f0739988640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625a30be150 0x5625a30c6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:32956/0 (socket says 172.21.15.79:32956) 2024-08-20T01:48:38.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.398+0000 7f0739988640 1 -- 172.21.15.79:0/3331598698 learned_addr learned my addr 172.21.15.79:0/3331598698 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:38.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.398+0000 7f0739988640 1 -- 172.21.15.79:0/3331598698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a30ca0e0 msgr2=0x5625a30c6ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:48:38.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.398+0000 7f0739988640 1 --2- 172.21.15.79:0/3331598698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a30ca0e0 0x5625a30c6ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:38.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.398+0000 7f0739988640 1 -- 172.21.15.79:0/3331598698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625a30bd830 msgr2=0x5625a30c9170 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:48:38.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.398+0000 7f0739988640 1 --2- 172.21.15.79:0/3331598698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625a30bd830 0x5625a30c9170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:38.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.398+0000 7f0739988640 1 -- 172.21.15.79:0/3331598698 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625a30bb490 con 0x5625a30be150 2024-08-20T01:48:38.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.399+0000 7f0739988640 1 --2- 172.21.15.79:0/3331598698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625a30be150 0x5625a30c6580 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0734111a40 tx=0x7f0730005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb3ca28306b3c64c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:38.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.399+0000 7f071ffff640 1 -- 172.21.15.79:0/3331598698 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0730035020 con 0x5625a30be150 2024-08-20T01:48:38.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.399+0000 7f071ffff640 1 -- 172.21.15.79:0/3331598698 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0730054070 con 0x5625a30be150 2024-08-20T01:48:38.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.400+0000 7f071ffff640 1 -- 172.21.15.79:0/3331598698 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073004fc90 con 0x5625a30be150 2024-08-20T01:48:38.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.400+0000 7f073e7e6740 1 -- 172.21.15.79:0/3331598698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625a30be150 msgr2=0x5625a30c6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:38.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.400+0000 7f073e7e6740 1 --2- 172.21.15.79:0/3331598698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625a30be150 0x5625a30c6580 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0734111a40 tx=0x7f0730005fd0 comp rx=0 tx=0).stop 2024-08-20T01:48:38.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.400+0000 7f073e7e6740 1 -- 172.21.15.79:0/3331598698 shutdown_connections 2024-08-20T01:48:38.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.400+0000 7f073e7e6740 1 --2- 172.21.15.79:0/3331598698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a30ca0e0 0x5625a30c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:38.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.400+0000 7f073e7e6740 1 --2- 172.21.15.79:0/3331598698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625a30be150 0x5625a30c6580 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:38.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.400+0000 7f073e7e6740 1 --2- 172.21.15.79:0/3331598698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625a30bd830 0x5625a30c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:38.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.400+0000 7f073e7e6740 1 -- 172.21.15.79:0/3331598698 >> 172.21.15.79:0/3331598698 conn(0x5625a30bb660 msgr2=0x5625a30ba720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:38.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.400+0000 7f073e7e6740 1 -- 172.21.15.79:0/3331598698 shutdown_connections 2024-08-20T01:48:38.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.400+0000 7f073e7e6740 1 -- 172.21.15.79:0/3331598698 wait complete. 2024-08-20T01:48:38.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.401+0000 7f073e7e6740 1 -- start start 2024-08-20T01:48:38.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.401+0000 7f073e7e6740 1 Processor -- start 2024-08-20T01:48:38.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.401+0000 7f073e7e6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625a30bd830 0x5625a30ce7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:38.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.401+0000 7f073e7e6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a30be150 0x5625a30ced10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:38.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.401+0000 7f073e7e6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625a30ca0e0 0x5625a3142ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:38.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.401+0000 7f073e7e6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f071800fab0 con 0x5625a30bd830 2024-08-20T01:48:38.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.401+0000 7f073e7e6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f071800f3b0 con 0x5625a30ca0e0 2024-08-20T01:48:38.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.401+0000 7f073e7e6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f071800c530 con 0x5625a30be150 2024-08-20T01:48:38.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.401+0000 7f073e7e6740 10 client.0 _ll_register_callbacks cb 0x7f072c0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:48:38.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.402+0000 7f0739988640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a30be150 0x5625a30ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:38.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.402+0000 7f0739988640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a30be150 0x5625a30ced10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:38524/0 (socket says 172.21.15.79:38524) 2024-08-20T01:48:38.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.402+0000 7f0739988640 1 -- 172.21.15.79:0/628704549 learned_addr learned my addr 172.21.15.79:0/628704549 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:38.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.402+0000 7f073a98a640 1 --2- 172.21.15.79:0/628704549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625a30ca0e0 0x5625a3142ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:38.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.402+0000 7f073a98a640 1 --2- 172.21.15.79:0/628704549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625a30bd830 0x5625a30ce7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:38.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.402+0000 7f0739988640 1 -- 172.21.15.79:0/628704549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625a30ca0e0 msgr2=0x5625a3142ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:38.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.402+0000 7f0739988640 1 --2- 172.21.15.79:0/628704549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625a30ca0e0 0x5625a3142ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:38.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.402+0000 7f0739988640 1 -- 172.21.15.79:0/628704549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625a30bd830 msgr2=0x5625a30ce7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:38.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.402+0000 7f0739988640 1 --2- 172.21.15.79:0/628704549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625a30bd830 0x5625a30ce7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:38.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.402+0000 7f0739988640 1 -- 172.21.15.79:0/628704549 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625a3143020 con 0x5625a30be150 2024-08-20T01:48:38.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.402+0000 7f0739988640 1 --2- 172.21.15.79:0/628704549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a30be150 0x5625a30ced10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0730009230 tx=0x7f0730005650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26ac39facf749ce0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:38.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.402+0000 7f071dffb640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:48:38.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.403+0000 7f071dffb640 1 -- 172.21.15.79:0/628704549 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073005c070 con 0x5625a30be150 2024-08-20T01:48:38.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.403+0000 7f073e7e6740 1 -- 172.21.15.79:0/628704549 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0730054070 con 0x5625a30be150 2024-08-20T01:48:38.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.403+0000 7f071dffb640 1 -- 172.21.15.79:0/628704549 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f0730004450 con 0x5625a30be150 2024-08-20T01:48:38.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.403+0000 7f071dffb640 1 -- 172.21.15.79:0/628704549 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f0730035070 con 0x5625a30be150 2024-08-20T01:48:38.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.403+0000 7f073e7e6740 10 client.27436 fetch_fsmap learned FSMap version 48 2024-08-20T01:48:38.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.403+0000 7f073e7e6740 1 -- 172.21.15.79:0/628704549 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x5625a31441b0 con 0x5625a30be150 2024-08-20T01:48:38.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.403+0000 7f071dffb640 1 -- 172.21.15.79:0/628704549 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0730054070 con 0x5625a30be150 2024-08-20T01:48:38.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.403+0000 7f071dffb640 1 -- 172.21.15.79:0/628704549 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 48) ==== 8382+0+0 (secure 0 0 0) 0x7f073003a040 con 0x5625a30be150 2024-08-20T01:48:38.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.404+0000 7f073e7e6740 10 client.27436 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T01:48:38.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.404+0000 7f073e7e6740 10 client.27436 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:48:38.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.404+0000 7f073e7e6740 20 client.27436 populate_metadata read hostname 'smithi079' 2024-08-20T01:48:38.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.404+0000 7f073e7e6740 1 --2- 172.21.15.79:0/628704549 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5625a3144940 0x5625a3146d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:38.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.404+0000 7f073e7e6740 4 client.27436 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:48:38.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.404+0000 7f073e7e6740 1 -- 172.21.15.79:0/628704549 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5625a30322d0 con 0x5625a3144940 2024-08-20T01:48:38.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.404+0000 7f073a98a640 1 --2- 172.21.15.79:0/628704549 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5625a3144940 0x5625a3146d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:38.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.404+0000 7f071dffb640 10 client.27436 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:38.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.404+0000 7f073a98a640 1 --2- 172.21.15.79:0/628704549 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5625a3144940 0x5625a3146d60 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ff16c5fc63fdcc3 server_cookie=3e5e0dc5a83d1082 in_seq=0 out_seq=0 2024-08-20T01:48:38.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.405+0000 7f071dffb640 1 -- 172.21.15.79:0/628704549 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5625a30322d0 con 0x5625a3144940 2024-08-20T01:48:38.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.405+0000 7f071dffb640 10 client.27436 handle_command_reply: tid=0 2024-08-20T01:48:38.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.405+0000 7f073e7e6740 1 client.27436 shutdown 2024-08-20T01:48:38.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.405+0000 7f073e7e6740 1 -- 172.21.15.79:0/628704549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a30be150 msgr2=0x5625a30ced10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:38.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.405+0000 7f073e7e6740 1 --2- 172.21.15.79:0/628704549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a30be150 0x5625a30ced10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0730009230 tx=0x7f0730005650 comp rx=0 tx=0).stop 2024-08-20T01:48:38.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.405+0000 7f073e7e6740 1 -- 172.21.15.79:0/628704549 shutdown_connections 2024-08-20T01:48:38.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.405+0000 7f073e7e6740 1 --2- 172.21.15.79:0/628704549 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5625a3144940 0x5625a3146d60 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:38.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.405+0000 7f073e7e6740 1 --2- 172.21.15.79:0/628704549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625a30ca0e0 0x5625a3142ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:38.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.405+0000 7f073e7e6740 1 --2- 172.21.15.79:0/628704549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625a30be150 0x5625a30ced10 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:38.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.405+0000 7f071dffb640 0 client.27436 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:38.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.405+0000 7f073e7e6740 1 --2- 172.21.15.79:0/628704549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5625a30bd830 0x5625a30ce7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:38.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.405+0000 7f073e7e6740 1 -- 172.21.15.79:0/628704549 >> 172.21.15.79:0/628704549 conn(0x5625a30bb660 msgr2=0x5625a30c09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:38.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.405+0000 7f073e7e6740 1 -- 172.21.15.79:0/628704549 shutdown_connections 2024-08-20T01:48:38.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.405+0000 7f073e7e6740 1 -- 172.21.15.79:0/628704549 wait complete. 2024-08-20T01:48:38.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.405+0000 7f073e7e6740 20 client.27436 trim_cache size 0 max 16384 2024-08-20T01:48:38.412 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:48:38.412 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-08-20T01:48:38.412 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-08-20T01:48:38.412 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:48:38.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.406+0000 7f073c3ed640 1 -- 172.21.15.79:0/2468189368 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f07200b3c50 msgr2=0x7f07200b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:38.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.406+0000 7f073c3ed640 1 --2- 172.21.15.79:0/2468189368 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f07200b3c50 0x7f07200b6110 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f07280aa680 tx=0x7f0728005880 comp rx=0 tx=0).stop 2024-08-20T01:48:38.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.406+0000 7f073c3ed640 1 -- 172.21.15.79:0/2468189368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0734101660 msgr2=0x7f073419b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:38.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.406+0000 7f073c3ed640 1 --2- 172.21.15.79:0/2468189368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0734101660 0x7f073419b0c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f072800d950 tx=0x7f072800de10 comp rx=0 tx=0).stop 2024-08-20T01:48:38.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.406+0000 7f073c3ed640 1 -- 172.21.15.79:0/2468189368 shutdown_connections 2024-08-20T01:48:38.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.406+0000 7f073c3ed640 1 --2- 172.21.15.79:0/2468189368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f073410f190 0x7f07341a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:38.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.406+0000 7f073c3ed640 1 --2- 172.21.15.79:0/2468189368 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f07200b3c50 0x7f07200b6110 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:38.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.406+0000 7f073c3ed640 1 --2- 172.21.15.79:0/2468189368 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0734101f80 0x7f073419b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:38.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.406+0000 7f073c3ed640 1 --2- 172.21.15.79:0/2468189368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0734101660 0x7f073419b0c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:38.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.406+0000 7f073c3ed640 1 -- 172.21.15.79:0/2468189368 >> 172.21.15.79:0/2468189368 conn(0x7f07340fd400 msgr2=0x7f07340ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:38.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.407+0000 7f073c3ed640 1 -- 172.21.15.79:0/2468189368 shutdown_connections 2024-08-20T01:48:38.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:38.407+0000 7f073c3ed640 1 -- 172.21.15.79:0/2468189368 wait complete. 2024-08-20T01:48:39.342 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T01:48:39.342 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:48:39.757 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:48:40.067 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:39 smithi079 ceph-mon[18656]: pgmap v687: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 27 MiB/s wr, 7.00k op/s 2024-08-20T01:48:40.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:39 smithi175 ceph-mon[22392]: pgmap v687: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 27 MiB/s wr, 7.00k op/s 2024-08-20T01:48:40.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:39 smithi081 ceph-mon[22209]: pgmap v687: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 27 MiB/s wr, 7.00k op/s 2024-08-20T01:48:40.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.326+0000 7fc72eb0f640 1 -- 172.21.15.79:0/653161548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc728101790 msgr2=0x7fc728101b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:40.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.326+0000 7fc72eb0f640 1 --2- 172.21.15.79:0/653161548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc728101790 0x7fc728101b70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc720009ca0 tx=0x7fc72002a8f0 comp rx=0 tx=0).stop 2024-08-20T01:48:40.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.326+0000 7fc72eb0f640 1 -- 172.21.15.79:0/653161548 shutdown_connections 2024-08-20T01:48:40.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.326+0000 7fc72eb0f640 1 --2- 172.21.15.79:0/653161548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc728106bd0 0x7fc728107020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:40.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.326+0000 7fc72eb0f640 1 --2- 172.21.15.79:0/653161548 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7281020b0 0x7fc728106580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:40.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.326+0000 7fc72eb0f640 1 --2- 172.21.15.79:0/653161548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc728101790 0x7fc728101b70 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:40.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.326+0000 7fc72eb0f640 1 -- 172.21.15.79:0/653161548 >> 172.21.15.79:0/653161548 conn(0x7fc7280fd400 msgr2=0x7fc7280ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:40.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.326+0000 7fc72eb0f640 1 -- 172.21.15.79:0/653161548 shutdown_connections 2024-08-20T01:48:40.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.326+0000 7fc72eb0f640 1 -- 172.21.15.79:0/653161548 wait complete. 2024-08-20T01:48:40.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.327+0000 7fc72eb0f640 1 Processor -- start 2024-08-20T01:48:40.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.327+0000 7fc72eb0f640 1 -- start start 2024-08-20T01:48:40.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.328+0000 7fc72eb0f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc728101790 0x7fc728074500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:40.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.328+0000 7fc72eb0f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7281020b0 0x7fc728074a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:40.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.328+0000 7fc72eb0f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc728106bd0 0x7fc72806d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:40.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.328+0000 7fc72eb0f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc728118f40 con 0x7fc728101790 2024-08-20T01:48:40.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.328+0000 7fc72eb0f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc728118dc0 con 0x7fc728106bd0 2024-08-20T01:48:40.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.328+0000 7fc72eb0f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc7281190c0 con 0x7fc7281020b0 2024-08-20T01:48:40.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.328+0000 7fc72d0ac640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc728106bd0 0x7fc72806d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:40.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.328+0000 7fc72d0ac640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc728106bd0 0x7fc72806d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:40602/0 (socket says 172.21.15.79:40602) 2024-08-20T01:48:40.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.328+0000 7fc72d0ac640 1 -- 172.21.15.79:0/833899532 learned_addr learned my addr 172.21.15.79:0/833899532 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:40.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.328+0000 7fc72c8ab640 1 --2- 172.21.15.79:0/833899532 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc728101790 0x7fc728074500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:40.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.328+0000 7fc72d0ac640 1 -- 172.21.15.79:0/833899532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7281020b0 msgr2=0x7fc728074a40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-20T01:48:40.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.328+0000 7fc72d0ac640 1 --2- 172.21.15.79:0/833899532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7281020b0 0x7fc728074a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:40.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.328+0000 7fc72d0ac640 1 -- 172.21.15.79:0/833899532 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc728101790 msgr2=0x7fc728074500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:40.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.328+0000 7fc72d0ac640 1 --2- 172.21.15.79:0/833899532 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc728101790 0x7fc728074500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:40.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.328+0000 7fc72d0ac640 1 -- 172.21.15.79:0/833899532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc72806e1c0 con 0x7fc728106bd0 2024-08-20T01:48:40.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.329+0000 7fc72d0ac640 1 --2- 172.21.15.79:0/833899532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc728106bd0 0x7fc72806d900 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc71800d750 tx=0x7fc71800dc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:40.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.329+0000 7fc725ffb640 1 -- 172.21.15.79:0/833899532 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc718017070 con 0x7fc728106bd0 2024-08-20T01:48:40.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.329+0000 7fc725ffb640 1 -- 172.21.15.79:0/833899532 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc7180054b0 con 0x7fc728106bd0 2024-08-20T01:48:40.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.329+0000 7fc725ffb640 1 -- 172.21.15.79:0/833899532 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc718004b90 con 0x7fc728106bd0 2024-08-20T01:48:40.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.330+0000 7fc72eb0f640 1 -- 172.21.15.79:0/833899532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc72806e4b0 con 0x7fc728106bd0 2024-08-20T01:48:40.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.330+0000 7fc72eb0f640 1 -- 172.21.15.79:0/833899532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7280733a0 con 0x7fc728106bd0 2024-08-20T01:48:40.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.332+0000 7fc72eb0f640 1 -- 172.21.15.79:0/833899532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc728106580 con 0x7fc728106bd0 2024-08-20T01:48:40.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.337+0000 7fc725ffb640 1 -- 172.21.15.79:0/833899532 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc718004d30 con 0x7fc728106bd0 2024-08-20T01:48:40.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.338+0000 7fc725ffb640 1 --2- 172.21.15.79:0/833899532 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc7100b3cd0 0x7fc7100b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:40.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.338+0000 7fc725ffb640 1 -- 172.21.15.79:0/833899532 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc7180e3670 con 0x7fc728106bd0 2024-08-20T01:48:40.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.339+0000 7fc72c8ab640 1 --2- 172.21.15.79:0/833899532 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc7100b3cd0 0x7fc7100b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:40.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.339+0000 7fc72c8ab640 1 --2- 172.21.15.79:0/833899532 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc7100b3cd0 0x7fc7100b6190 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc720005e30 tx=0x7fc720000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:40.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.343+0000 7fc725ffb640 1 -- 172.21.15.79:0/833899532 <== mon.2 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fc7180aac70 con 0x7fc728106bd0 2024-08-20T01:48:40.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.769+0000 7fc72eb0f640 1 -- 172.21.15.79:0/833899532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7280736b0 con 0x7fc728106bd0 2024-08-20T01:48:40.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.770+0000 7fc725ffb640 1 -- 172.21.15.79:0/833899532 <== mon.2 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+11981 (secure 0 0 0) 0x7fc7180aa570 con 0x7fc728106bd0 2024-08-20T01:48:40.773 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:48:40.774 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":48,"btime":"2024-08-20T01:48:36:777892+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14670,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/735082912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":735082912},{"type":"v1","addr":"172.21.15.79:6835","nonce":735082912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2150339873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2150339873},{"type":"v1","addr":"172.21.15.79:6837","nonce":2150339873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":48,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:34:55.133562+0000","modified":"2024-08-20T01:48:35.901049+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24539,"mds_1":24538,"mds_2":24523,"mds_3":24514,"mds_4":24512},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14724":{"gid":14724,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/1071242274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1071242274},{"type":"v1","addr":"172.21.15.79:6839","nonce":1071242274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14730":{"gid":14730,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6841/2448977611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":2448977611},{"type":"v1","addr":"172.21.15.79:6841","nonce":2448977611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/1257507005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1257507005},{"type":"v1","addr":"172.21.15.81:6833","nonce":1257507005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1499936216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1499936216},{"type":"v1","addr":"172.21.15.81:6835","nonce":1499936216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/1107229215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1107229215},{"type":"v1","addr":"172.21.15.175:6833","nonce":1107229215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6837/2073598870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2073598870},{"type":"v1","addr":"172.21.15.81:6837","nonce":2073598870}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/2552601173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2552601173},{"type":"v1","addr":"172.21.15.175:6835","nonce":2552601173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6837/1767284089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1767284089},{"type":"v1","addr":"172.21.15.175:6837","nonce":1767284089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/1331748742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1331748742},{"type":"v1","addr":"172.21.15.175:6839","nonce":1331748742}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/4098410583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":4098410583},{"type":"v1","addr":"172.21.15.81:6839","nonce":4098410583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24539,"qdb_cluster":[24512,24538,24514,24523,24539]},"id":1}]} 2024-08-20T01:48:40.774 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 48 2024-08-20T01:48:40.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.774+0000 7fc72eb0f640 1 -- 172.21.15.79:0/833899532 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc7100b3cd0 msgr2=0x7fc7100b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:40.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.774+0000 7fc72eb0f640 1 --2- 172.21.15.79:0/833899532 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc7100b3cd0 0x7fc7100b6190 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc720005e30 tx=0x7fc720000f40 comp rx=0 tx=0).stop 2024-08-20T01:48:40.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.774+0000 7fc72eb0f640 1 -- 172.21.15.79:0/833899532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc728106bd0 msgr2=0x7fc72806d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:40.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.774+0000 7fc72eb0f640 1 --2- 172.21.15.79:0/833899532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc728106bd0 0x7fc72806d900 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc71800d750 tx=0x7fc71800dc10 comp rx=0 tx=0).stop 2024-08-20T01:48:40.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.774+0000 7fc72eb0f640 1 -- 172.21.15.79:0/833899532 shutdown_connections 2024-08-20T01:48:40.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.774+0000 7fc72eb0f640 1 --2- 172.21.15.79:0/833899532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc728106bd0 0x7fc72806d900 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:40.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.774+0000 7fc72eb0f640 1 --2- 172.21.15.79:0/833899532 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc7100b3cd0 0x7fc7100b6190 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:40.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.774+0000 7fc72eb0f640 1 --2- 172.21.15.79:0/833899532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7281020b0 0x7fc728074a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:40.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.774+0000 7fc72eb0f640 1 --2- 172.21.15.79:0/833899532 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc728101790 0x7fc728074500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:40.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.774+0000 7fc72eb0f640 1 -- 172.21.15.79:0/833899532 >> 172.21.15.79:0/833899532 conn(0x7fc7280fd400 msgr2=0x7fc728104550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:40.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.776+0000 7fc72eb0f640 1 -- 172.21.15.79:0/833899532 shutdown_connections 2024-08-20T01:48:40.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:40.776+0000 7fc72eb0f640 1 -- 172.21.15.79:0/833899532 wait complete. 2024-08-20T01:48:41.056 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:40 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/833899532' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:48:41.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:40 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/833899532' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:48:41.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:40 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/833899532' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:48:41.512 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-20T01:48:41.819 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:41 smithi079 ceph-mon[18656]: pgmap v688: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 26 MiB/s wr, 6.70k op/s 2024-08-20T01:48:41.937 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:48:42.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:41 smithi175 ceph-mon[22392]: pgmap v688: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 26 MiB/s wr, 6.70k op/s 2024-08-20T01:48:42.179 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:41 smithi081 ceph-mon[22209]: pgmap v688: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 26 MiB/s wr, 6.70k op/s 2024-08-20T01:48:43.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.641+0000 7fc83de07640 1 -- 172.21.15.79:0/3707970981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc830099030 msgr2=0x7fc8300994e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:43.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.641+0000 7fc83de07640 1 --2- 172.21.15.79:0/3707970981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc830099030 0x7fc8300994e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc838065ff0 tx=0x7fc8380979f0 comp rx=0 tx=0).stop 2024-08-20T01:48:43.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.642+0000 7fc83de07640 1 -- 172.21.15.79:0/3707970981 shutdown_connections 2024-08-20T01:48:43.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.642+0000 7fc83de07640 1 --2- 172.21.15.79:0/3707970981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc830099030 0x7fc8300994e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:43.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.642+0000 7fc83de07640 1 --2- 172.21.15.79:0/3707970981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc830096480 0x7fc8300988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:43.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.642+0000 7fc83de07640 1 --2- 172.21.15.79:0/3707970981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc830005380 0x7fc830095ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:43.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.642+0000 7fc83de07640 1 -- 172.21.15.79:0/3707970981 >> 172.21.15.79:0/3707970981 conn(0x7fc83008fcd0 msgr2=0x7fc830092110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:43.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.642+0000 7fc83de07640 1 -- 172.21.15.79:0/3707970981 shutdown_connections 2024-08-20T01:48:43.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.642+0000 7fc83de07640 1 -- 172.21.15.79:0/3707970981 wait complete. 2024-08-20T01:48:43.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.643+0000 7fc83de07640 1 Processor -- start 2024-08-20T01:48:43.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.643+0000 7fc83de07640 1 -- start start 2024-08-20T01:48:43.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.643+0000 7fc83de07640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc830005380 0x7fc830142d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:43.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.643+0000 7fc83de07640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc830096480 0x7fc830143370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:43.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.643+0000 7fc83de07640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc830099030 0x7fc830143fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:43.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.643+0000 7fc83de07640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc8300a7550 con 0x7fc830099030 2024-08-20T01:48:43.647 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.643+0000 7fc83de07640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc8300a73d0 con 0x7fc830096480 2024-08-20T01:48:43.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.643+0000 7fc83de07640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc8300a76d0 con 0x7fc830005380 2024-08-20T01:48:43.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.643+0000 7fc83ce05640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc830005380 0x7fc830142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:43.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.643+0000 7fc83ce05640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc830005380 0x7fc830142d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:37280/0 (socket says 172.21.15.79:37280) 2024-08-20T01:48:43.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.643+0000 7fc83ce05640 1 -- 172.21.15.79:0/3267444616 learned_addr learned my addr 172.21.15.79:0/3267444616 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:43.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.643+0000 7fc837fff640 1 --2- 172.21.15.79:0/3267444616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc830096480 0x7fc830143370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:43.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.643+0000 7fc83d606640 1 --2- 172.21.15.79:0/3267444616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc830099030 0x7fc830143fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:43.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.644+0000 7fc83ce05640 1 -- 172.21.15.79:0/3267444616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc830096480 msgr2=0x7fc830143370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:43.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.644+0000 7fc83ce05640 1 --2- 172.21.15.79:0/3267444616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc830096480 0x7fc830143370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:43.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.644+0000 7fc83ce05640 1 -- 172.21.15.79:0/3267444616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc830099030 msgr2=0x7fc830143fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:43.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.644+0000 7fc83ce05640 1 --2- 172.21.15.79:0/3267444616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc830099030 0x7fc830143fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:43.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.644+0000 7fc83ce05640 1 -- 172.21.15.79:0/3267444616 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc830144860 con 0x7fc830005380 2024-08-20T01:48:43.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.644+0000 7fc83ce05640 1 --2- 172.21.15.79:0/3267444616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc830005380 0x7fc830142d20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00d950 tx=0x7fc82c00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:43.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.644+0000 7fc835ffb640 1 -- 172.21.15.79:0/3267444616 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c017070 con 0x7fc830005380 2024-08-20T01:48:43.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.644+0000 7fc83de07640 1 -- 172.21.15.79:0/3267444616 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc830144b50 con 0x7fc830005380 2024-08-20T01:48:43.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.645+0000 7fc835ffb640 1 -- 172.21.15.79:0/3267444616 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc82c009c30 con 0x7fc830005380 2024-08-20T01:48:43.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.645+0000 7fc83de07640 1 -- 172.21.15.79:0/3267444616 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc83014b220 con 0x7fc830005380 2024-08-20T01:48:43.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.645+0000 7fc835ffb640 1 -- 172.21.15.79:0/3267444616 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c00f3c0 con 0x7fc830005380 2024-08-20T01:48:43.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.648+0000 7fc841e5d740 1 Processor -- start 2024-08-20T01:48:43.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.648+0000 7fc841e5d740 1 -- start start 2024-08-20T01:48:43.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.648+0000 7fc841e5d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564278b94810 0x564278b96c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:43.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.648+0000 7fc841e5d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564278b97140 0x564278b99530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:43.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.648+0000 7fc841e5d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564278b99b80 0x564278b9c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:43.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.649+0000 7fc841e5d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564278b07360 con 0x564278b97140 2024-08-20T01:48:43.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.649+0000 7fc841e5d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564278af6860 con 0x564278b99b80 2024-08-20T01:48:43.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.649+0000 7fc841e5d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564278afa8a0 con 0x564278b94810 2024-08-20T01:48:43.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.649+0000 7fc837fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564278b99b80 0x564278b9c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:43.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.649+0000 7fc837fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564278b99b80 0x564278b9c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:40628/0 (socket says 172.21.15.79:40628) 2024-08-20T01:48:43.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.649+0000 7fc837fff640 1 -- 172.21.15.79:0/2570151840 learned_addr learned my addr 172.21.15.79:0/2570151840 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:43.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.649+0000 7fc83d606640 1 --2- 172.21.15.79:0/2570151840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564278b94810 0x564278b96c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:43.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.649+0000 7fc837fff640 1 -- 172.21.15.79:0/2570151840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564278b94810 msgr2=0x564278b96c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:43.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.649+0000 7fc837fff640 1 --2- 172.21.15.79:0/2570151840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564278b94810 0x564278b96c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:43.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.649+0000 7fc837fff640 1 -- 172.21.15.79:0/2570151840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564278b97140 msgr2=0x564278b99530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:48:43.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.649+0000 7fc835ffb640 1 -- 172.21.15.79:0/3267444616 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc82c01a070 con 0x7fc830005380 2024-08-20T01:48:43.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.649+0000 7fc837fff640 1 --2- 172.21.15.79:0/2570151840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564278b97140 0x564278b99530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:43.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.649+0000 7fc837fff640 1 -- 172.21.15.79:0/2570151840 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564278a9de40 con 0x564278b99b80 2024-08-20T01:48:43.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.650+0000 7fc837fff640 1 --2- 172.21.15.79:0/2570151840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564278b99b80 0x564278b9c040 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc824009c80 tx=0x7fc8240117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2a889c7433b5c8f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:43.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.650+0000 7fc822ffd640 1 -- 172.21.15.79:0/2570151840 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc824012450 con 0x564278b99b80 2024-08-20T01:48:43.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.650+0000 7fc822ffd640 1 -- 172.21.15.79:0/2570151840 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc824012a80 con 0x564278b99b80 2024-08-20T01:48:43.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.650+0000 7fc822ffd640 1 -- 172.21.15.79:0/2570151840 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82400fac0 con 0x564278b99b80 2024-08-20T01:48:43.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.651+0000 7fc835ffb640 1 --2- 172.21.15.79:0/3267444616 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc8280b3cd0 0x7fc8280b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:43.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.651+0000 7fc835ffb640 1 -- 172.21.15.79:0/3267444616 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc82c0e3600 con 0x7fc830005380 2024-08-20T01:48:43.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.651+0000 7fc83d606640 1 --2- 172.21.15.79:0/3267444616 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc8280b3cd0 0x7fc8280b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:43.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.651+0000 7fc841e5d740 1 -- 172.21.15.79:0/2570151840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564278b99b80 msgr2=0x564278b9c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:43.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.651+0000 7fc841e5d740 1 --2- 172.21.15.79:0/2570151840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564278b99b80 0x564278b9c040 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc824009c80 tx=0x7fc8240117b0 comp rx=0 tx=0).stop 2024-08-20T01:48:43.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.651+0000 7fc841e5d740 1 -- 172.21.15.79:0/2570151840 shutdown_connections 2024-08-20T01:48:43.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.651+0000 7fc841e5d740 1 --2- 172.21.15.79:0/2570151840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564278b99b80 0x564278b9c040 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:43.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.651+0000 7fc841e5d740 1 --2- 172.21.15.79:0/2570151840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564278b97140 0x564278b99530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:43.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.651+0000 7fc841e5d740 1 --2- 172.21.15.79:0/2570151840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564278b94810 0x564278b96c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:43.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.651+0000 7fc841e5d740 1 -- 172.21.15.79:0/2570151840 >> 172.21.15.79:0/2570151840 conn(0x564278b8f960 msgr2=0x564278b906f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:43.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.652+0000 7fc841e5d740 1 -- 172.21.15.79:0/2570151840 shutdown_connections 2024-08-20T01:48:43.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.653+0000 7fc841e5d740 1 -- 172.21.15.79:0/2570151840 wait complete. 2024-08-20T01:48:43.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.653+0000 7fc83d606640 1 --2- 172.21.15.79:0/3267444616 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc8280b3cd0 0x7fc8280b6190 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc838052510 tx=0x7fc838068b00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:43.656 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.654+0000 7fc841e5d740 1 -- start start 2024-08-20T01:48:43.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.654+0000 7fc841e5d740 1 Processor -- start 2024-08-20T01:48:43.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.655+0000 7fc841e5d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564278b94810 0x564278b9e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:43.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.655+0000 7fc841e5d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564278b97140 0x564278b9e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:43.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.655+0000 7fc841e5d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564278b99b80 0x564278b9f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:43.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.655+0000 7fc841e5d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564278a2fab0 con 0x564278b97140 2024-08-20T01:48:43.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.655+0000 7fc841e5d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564278a7d780 con 0x564278b99b80 2024-08-20T01:48:43.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.655+0000 7fc841e5d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564278b9cb60 con 0x564278b94810 2024-08-20T01:48:43.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.655+0000 7fc841e5d740 10 client.0 _ll_register_callbacks cb 0x564278805a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:48:43.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.655+0000 7fc83ce05640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564278b94810 0x564278b9e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:43.659 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.655+0000 7fc83ce05640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564278b94810 0x564278b9e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:37288/0 (socket says 172.21.15.79:37288) 2024-08-20T01:48:43.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.655+0000 7fc83ce05640 1 -- 172.21.15.79:0/1282701157 learned_addr learned my addr 172.21.15.79:0/1282701157 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:43.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.655+0000 7fc837fff640 1 --2- 172.21.15.79:0/1282701157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564278b97140 0x564278b9e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:43.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.655+0000 7fc83ce05640 1 -- 172.21.15.79:0/1282701157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564278b99b80 msgr2=0x564278b9f330 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:48:43.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.655+0000 7fc83ce05640 1 --2- 172.21.15.79:0/1282701157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564278b99b80 0x564278b9f330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:43.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.655+0000 7fc83ce05640 1 -- 172.21.15.79:0/1282701157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564278b97140 msgr2=0x564278b9e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:43.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.655+0000 7fc83ce05640 1 --2- 172.21.15.79:0/1282701157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564278b97140 0x564278b9e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:43.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.655+0000 7fc83ce05640 1 -- 172.21.15.79:0/1282701157 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564278859790 con 0x564278b94810 2024-08-20T01:48:43.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.656+0000 7fc83ce05640 1 --2- 172.21.15.79:0/1282701157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564278b94810 0x564278b9e0c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc82c0aa200 tx=0x7fc82c0aa0d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f13362ca846bf795 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:43.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.656+0000 7fc817fff640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:48:43.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.656+0000 7fc817fff640 1 -- 172.21.15.79:0/1282701157 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c021050 con 0x564278b94810 2024-08-20T01:48:43.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.656+0000 7fc817fff640 1 -- 172.21.15.79:0/1282701157 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc82c0a6790 con 0x564278b94810 2024-08-20T01:48:43.660 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.656+0000 7fc841e5d740 1 -- 172.21.15.79:0/1282701157 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564278aa5e00 con 0x564278b94810 2024-08-20T01:48:43.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.656+0000 7fc817fff640 1 -- 172.21.15.79:0/1282701157 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fc82c0aa500 con 0x564278b94810 2024-08-20T01:48:43.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.656+0000 7fc841e5d740 10 client.27448 fetch_fsmap learned FSMap version 48 2024-08-20T01:48:43.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.656+0000 7fc841e5d740 1 -- 172.21.15.79:0/1282701157 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x5642788d2620 con 0x564278b94810 2024-08-20T01:48:43.661 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.656+0000 7fc817fff640 1 -- 172.21.15.79:0/1282701157 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x564278aa5e00 con 0x564278b94810 2024-08-20T01:48:43.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.656+0000 7fc817fff640 1 -- 172.21.15.79:0/1282701157 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 48) ==== 8382+0+0 (secure 0 0 0) 0x7fc82c0a9760 con 0x564278b94810 2024-08-20T01:48:43.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.657+0000 7fc841e5d740 10 client.27448 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T01:48:43.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.657+0000 7fc841e5d740 10 client.27448 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:48:43.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.657+0000 7fc841e5d740 20 client.27448 populate_metadata read hostname 'smithi079' 2024-08-20T01:48:43.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.657+0000 7fc841e5d740 1 --2- 172.21.15.79:0/1282701157 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564278ba99d0 0x564278babe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:43.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.657+0000 7fc841e5d740 4 client.27448 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:48:43.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.657+0000 7fc841e5d740 1 -- 172.21.15.79:0/1282701157 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564278b092b0 con 0x564278ba99d0 2024-08-20T01:48:43.662 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.657+0000 7fc837fff640 1 --2- 172.21.15.79:0/1282701157 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564278ba99d0 0x564278babe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:43.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.658+0000 7fc817fff640 10 client.27448 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:43.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.658+0000 7fc837fff640 1 --2- 172.21.15.79:0/1282701157 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564278ba99d0 0x564278babe30 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38760105b4a31af3 server_cookie=375c6ab2cb512cd4 in_seq=0 out_seq=0 2024-08-20T01:48:43.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.659+0000 7fc817fff640 1 -- 172.21.15.79:0/1282701157 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564278b092b0 con 0x564278ba99d0 2024-08-20T01:48:43.663 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.659+0000 7fc817fff640 10 client.27448 handle_command_reply: tid=0 2024-08-20T01:48:43.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.660+0000 7fc841e5d740 1 client.27448 shutdown 2024-08-20T01:48:43.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.660+0000 7fc841e5d740 1 -- 172.21.15.79:0/1282701157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564278b94810 msgr2=0x564278b9e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:43.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.660+0000 7fc841e5d740 1 --2- 172.21.15.79:0/1282701157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564278b94810 0x564278b9e0c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc82c0aa200 tx=0x7fc82c0aa0d0 comp rx=0 tx=0).stop 2024-08-20T01:48:43.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.660+0000 7fc841e5d740 1 -- 172.21.15.79:0/1282701157 shutdown_connections 2024-08-20T01:48:43.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.660+0000 7fc841e5d740 1 --2- 172.21.15.79:0/1282701157 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564278ba99d0 0x564278babe30 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:43.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.660+0000 7fc841e5d740 1 --2- 172.21.15.79:0/1282701157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564278b99b80 0x564278b9f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:43.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.660+0000 7fc841e5d740 1 --2- 172.21.15.79:0/1282701157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564278b97140 0x564278b9e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:43.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.660+0000 7fc817fff640 0 client.27448 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:43.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.660+0000 7fc841e5d740 1 --2- 172.21.15.79:0/1282701157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564278b94810 0x564278b9e0c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:43.664 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.660+0000 7fc841e5d740 1 -- 172.21.15.79:0/1282701157 >> 172.21.15.79:0/1282701157 conn(0x564278b8f960 msgr2=0x564278b8ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:43.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.660+0000 7fc841e5d740 1 -- 172.21.15.79:0/1282701157 shutdown_connections 2024-08-20T01:48:43.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.660+0000 7fc841e5d740 1 -- 172.21.15.79:0/1282701157 wait complete. 2024-08-20T01:48:43.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.661+0000 7fc841e5d740 20 client.27448 trim_cache size 0 max 16384 2024-08-20T01:48:43.691 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.688+0000 7fc841e5d740 1 Processor -- start 2024-08-20T01:48:43.691 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.688+0000 7fc841e5d740 1 -- start start 2024-08-20T01:48:43.692 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.689+0000 7fc841e5d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564278b94810 0x564278b9de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:43.692 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.689+0000 7fc841e5d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564278b97140 0x564278b9cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:43.692 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.689+0000 7fc841e5d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564278b99b80 0x564278b9d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:43.693 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.689+0000 7fc841e5d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc81c00e3e0 con 0x564278b94810 2024-08-20T01:48:43.693 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.689+0000 7fc837fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564278b97140 0x564278b9cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:43.693 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.689+0000 7fc83ce05640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564278b94810 0x564278b9de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:43.693 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.690+0000 7fc837fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564278b97140 0x564278b9cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:37302/0 (socket says 172.21.15.79:37302) 2024-08-20T01:48:43.693 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.690+0000 7fc83ce05640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564278b94810 0x564278b9de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38218/0 (socket says 172.21.15.79:38218) 2024-08-20T01:48:43.693 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.690+0000 7fc837fff640 1 -- 172.21.15.79:0/2966838480 learned_addr learned my addr 172.21.15.79:0/2966838480 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:43.693 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.690+0000 7fc83d606640 1 --2- 172.21.15.79:0/2966838480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564278b99b80 0x564278b9d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:43.693 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.690+0000 7fc841e5d740 1 -- 172.21.15.79:0/2966838480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc81c010010 con 0x564278b99b80 2024-08-20T01:48:43.693 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.690+0000 7fc841e5d740 1 -- 172.21.15.79:0/2966838480 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc81c00eb70 con 0x564278b97140 2024-08-20T01:48:43.694 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.690+0000 7fc837fff640 1 -- 172.21.15.79:0/2966838480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564278b99b80 msgr2=0x564278b9d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:43.694 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.690+0000 7fc837fff640 1 --2- 172.21.15.79:0/2966838480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564278b99b80 0x564278b9d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:43.694 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.690+0000 7fc837fff640 1 -- 172.21.15.79:0/2966838480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564278b94810 msgr2=0x564278b9de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:43.694 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.690+0000 7fc837fff640 1 --2- 172.21.15.79:0/2966838480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564278b94810 0x564278b9de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:43.694 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.690+0000 7fc837fff640 1 -- 172.21.15.79:0/2966838480 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564278b9dbc0 con 0x564278b97140 2024-08-20T01:48:43.694 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.691+0000 7fc837fff640 1 --2- 172.21.15.79:0/2966838480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564278b97140 0x564278b9cf90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc824009ba0 tx=0x7fc82400f440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1c4791f6cc9ebbc server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:43.695 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.692+0000 7fc8227fc640 1 -- 172.21.15.79:0/2966838480 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc824033070 con 0x564278b97140 2024-08-20T01:48:43.695 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.692+0000 7fc8227fc640 1 -- 172.21.15.79:0/2966838480 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc824009d70 con 0x564278b97140 2024-08-20T01:48:43.695 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.692+0000 7fc8227fc640 1 -- 172.21.15.79:0/2966838480 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc824003d10 con 0x564278b97140 2024-08-20T01:48:43.696 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.693+0000 7fc841e5d740 1 -- 172.21.15.79:0/2966838480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564278b97140 msgr2=0x564278b9cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:43.696 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.693+0000 7fc841e5d740 1 --2- 172.21.15.79:0/2966838480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564278b97140 0x564278b9cf90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc824009ba0 tx=0x7fc82400f440 comp rx=0 tx=0).stop 2024-08-20T01:48:43.696 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.693+0000 7fc841e5d740 1 -- 172.21.15.79:0/2966838480 shutdown_connections 2024-08-20T01:48:43.696 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.693+0000 7fc841e5d740 1 --2- 172.21.15.79:0/2966838480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564278b99b80 0x564278b9d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:43.696 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.693+0000 7fc841e5d740 1 --2- 172.21.15.79:0/2966838480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564278b97140 0x564278b9cf90 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:43.696 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.693+0000 7fc841e5d740 1 --2- 172.21.15.79:0/2966838480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564278b94810 0x564278b9de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:43.696 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.693+0000 7fc841e5d740 1 -- 172.21.15.79:0/2966838480 >> 172.21.15.79:0/2966838480 conn(0x564278b8f960 msgr2=0x564278b901c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:43.697 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.694+0000 7fc841e5d740 1 -- 172.21.15.79:0/2966838480 shutdown_connections 2024-08-20T01:48:43.697 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.694+0000 7fc841e5d740 1 -- 172.21.15.79:0/2966838480 wait complete. 2024-08-20T01:48:43.697 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.694+0000 7fc841e5d740 1 -- start start 2024-08-20T01:48:43.697 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.694+0000 7fc841e5d740 1 Processor -- start 2024-08-20T01:48:43.698 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.695+0000 7fc841e5d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564278b94810 0x564278ba2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:43.698 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.695+0000 7fc841e5d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564278b97140 0x564278ba32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:43.698 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.695+0000 7fc841e5d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564278b99b80 0x564278ba3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:43.698 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.695+0000 7fc841e5d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc81c00f940 con 0x564278b99b80 2024-08-20T01:48:43.698 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.695+0000 7fc841e5d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc81c00f240 con 0x564278b97140 2024-08-20T01:48:43.698 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.695+0000 7fc841e5d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc81c00c3c0 con 0x564278b94810 2024-08-20T01:48:43.698 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.695+0000 7fc841e5d740 10 client.0 _ll_register_callbacks cb 0x7fc82c00bf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:48:43.698 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.695+0000 7fc837fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564278b97140 0x564278ba32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:43.698 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.695+0000 7fc837fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564278b97140 0x564278ba32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:40654/0 (socket says 172.21.15.79:40654) 2024-08-20T01:48:43.698 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.695+0000 7fc837fff640 1 -- 172.21.15.79:0/3628167461 learned_addr learned my addr 172.21.15.79:0/3628167461 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:43.699 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.695+0000 7fc83d606640 1 --2- 172.21.15.79:0/3628167461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564278b99b80 0x564278ba3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:43.699 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.695+0000 7fc83ce05640 1 --2- 172.21.15.79:0/3628167461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564278b94810 0x564278ba2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:43.699 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.696+0000 7fc83ce05640 1 -- 172.21.15.79:0/3628167461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564278b97140 msgr2=0x564278ba32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:43.700 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.696+0000 7fc83ce05640 1 --2- 172.21.15.79:0/3628167461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564278b97140 0x564278ba32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:43.700 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.696+0000 7fc83ce05640 1 -- 172.21.15.79:0/3628167461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564278b99b80 msgr2=0x564278ba3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:43.700 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.696+0000 7fc83ce05640 1 --2- 172.21.15.79:0/3628167461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564278b99b80 0x564278ba3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:43.700 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.696+0000 7fc83ce05640 1 -- 172.21.15.79:0/3628167461 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564278ba4590 con 0x564278b94810 2024-08-20T01:48:43.700 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.696+0000 7fc817fff640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:48:43.700 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.696+0000 7fc83ce05640 1 --2- 172.21.15.79:0/3628167461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564278b94810 0x564278ba2c40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc82c0e3930 tx=0x7fc82c0a6300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7fa7ac55b3d577f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:43.700 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.697+0000 7fc817fff640 1 -- 172.21.15.79:0/3628167461 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c021070 con 0x564278b94810 2024-08-20T01:48:43.700 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.697+0000 7fc841e5d740 1 -- 172.21.15.79:0/3628167461 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564278b04d50 con 0x564278b94810 2024-08-20T01:48:43.700 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.697+0000 7fc817fff640 1 -- 172.21.15.79:0/3628167461 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fc82c0a6af0 con 0x564278b94810 2024-08-20T01:48:43.701 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.697+0000 7fc817fff640 1 -- 172.21.15.79:0/3628167461 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fc82c021070 con 0x564278b94810 2024-08-20T01:48:43.701 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.697+0000 7fc841e5d740 10 client.27454 fetch_fsmap learned FSMap version 48 2024-08-20T01:48:43.701 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.697+0000 7fc841e5d740 1 -- 172.21.15.79:0/3628167461 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x564278ba5900 con 0x564278b94810 2024-08-20T01:48:43.701 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.698+0000 7fc817fff640 1 -- 172.21.15.79:0/3628167461 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x564278b04d50 con 0x564278b94810 2024-08-20T01:48:43.701 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.698+0000 7fc817fff640 1 -- 172.21.15.79:0/3628167461 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 48) ==== 8382+0+0 (secure 0 0 0) 0x7fc82c0a91d0 con 0x564278b94810 2024-08-20T01:48:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.698+0000 7fc841e5d740 10 client.27454 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T01:48:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.698+0000 7fc841e5d740 10 client.27454 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:48:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.698+0000 7fc841e5d740 20 client.27454 populate_metadata read hostname 'smithi079' 2024-08-20T01:48:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.698+0000 7fc841e5d740 1 --2- 172.21.15.79:0/3628167461 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564278c146d0 0x564278c16ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.698+0000 7fc841e5d740 4 client.27454 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:48:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.698+0000 7fc841e5d740 1 -- 172.21.15.79:0/3628167461 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564278b02490 con 0x564278c146d0 2024-08-20T01:48:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.699+0000 7fc837fff640 1 --2- 172.21.15.79:0/3628167461 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564278c146d0 0x564278c16ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.699+0000 7fc817fff640 10 client.27454 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.699+0000 7fc837fff640 1 --2- 172.21.15.79:0/3628167461 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564278c146d0 0x564278c16ac0 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=396c1d7aec5734c1 server_cookie=3588237ca383b1b2 in_seq=0 out_seq=0 2024-08-20T01:48:43.751 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.747+0000 7fc817fff640 1 -- 172.21.15.79:0/3628167461 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564278b02490 con 0x564278c146d0 2024-08-20T01:48:43.751 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.747+0000 7fc817fff640 10 client.27454 handle_command_reply: tid=0 2024-08-20T01:48:43.751 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.747+0000 7fc841e5d740 1 client.27454 shutdown 2024-08-20T01:48:43.751 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.747+0000 7fc841e5d740 1 -- 172.21.15.79:0/3628167461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564278b94810 msgr2=0x564278ba2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:43.751 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.747+0000 7fc841e5d740 1 --2- 172.21.15.79:0/3628167461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564278b94810 0x564278ba2c40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc82c0e3930 tx=0x7fc82c0a6300 comp rx=0 tx=0).stop 2024-08-20T01:48:43.751 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.747+0000 7fc841e5d740 1 -- 172.21.15.79:0/3628167461 shutdown_connections 2024-08-20T01:48:43.751 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.747+0000 7fc841e5d740 1 --2- 172.21.15.79:0/3628167461 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564278c146d0 0x564278c16ac0 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:43.751 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.747+0000 7fc841e5d740 1 --2- 172.21.15.79:0/3628167461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564278b99b80 0x564278ba3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:43.751 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.747+0000 7fc841e5d740 1 --2- 172.21.15.79:0/3628167461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564278b97140 0x564278ba32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.747+0000 7fc841e5d740 1 --2- 172.21.15.79:0/3628167461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564278b94810 0x564278ba2c40 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.747+0000 7fc841e5d740 1 -- 172.21.15.79:0/3628167461 >> 172.21.15.79:0/3628167461 conn(0x564278b8f960 msgr2=0x564278b901c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.747+0000 7fc817fff640 0 client.27454 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.748+0000 7fc841e5d740 1 -- 172.21.15.79:0/3628167461 shutdown_connections 2024-08-20T01:48:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.748+0000 7fc841e5d740 1 -- 172.21.15.79:0/3628167461 wait complete. 2024-08-20T01:48:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.748+0000 7fc841e5d740 20 client.27454 trim_cache size 0 max 16384 2024-08-20T01:48:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:48:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:48:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:48:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:48:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.749+0000 7fc83de07640 1 -- 172.21.15.79:0/3267444616 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc8280b3cd0 msgr2=0x7fc8280b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.749+0000 7fc83de07640 1 --2- 172.21.15.79:0/3267444616 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc8280b3cd0 0x7fc8280b6190 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc838052510 tx=0x7fc838068b00 comp rx=0 tx=0).stop 2024-08-20T01:48:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.749+0000 7fc83de07640 1 -- 172.21.15.79:0/3267444616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc830005380 msgr2=0x7fc830142d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.749+0000 7fc83de07640 1 --2- 172.21.15.79:0/3267444616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc830005380 0x7fc830142d20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00d950 tx=0x7fc82c00de10 comp rx=0 tx=0).stop 2024-08-20T01:48:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.749+0000 7fc83de07640 1 -- 172.21.15.79:0/3267444616 shutdown_connections 2024-08-20T01:48:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.749+0000 7fc83de07640 1 --2- 172.21.15.79:0/3267444616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc830099030 0x7fc830143fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.749+0000 7fc83de07640 1 --2- 172.21.15.79:0/3267444616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc830096480 0x7fc830143370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.749+0000 7fc83de07640 1 --2- 172.21.15.79:0/3267444616 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fc8280b3cd0 0x7fc8280b6190 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.749+0000 7fc83de07640 1 --2- 172.21.15.79:0/3267444616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc830005380 0x7fc830142d20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:43.754 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.749+0000 7fc83de07640 1 -- 172.21.15.79:0/3267444616 >> 172.21.15.79:0/3267444616 conn(0x7fc83008fcd0 msgr2=0x7fc830094700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:43.754 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.749+0000 7fc83de07640 1 -- 172.21.15.79:0/3267444616 shutdown_connections 2024-08-20T01:48:43.754 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:43.749+0000 7fc83de07640 1 -- 172.21.15.79:0/3267444616 wait complete. 2024-08-20T01:48:44.089 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:43 smithi079 ceph-mon[18656]: pgmap v689: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 6.54k op/s 2024-08-20T01:48:44.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:43 smithi175 ceph-mon[22392]: pgmap v689: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 6.54k op/s 2024-08-20T01:48:44.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:43 smithi081 ceph-mon[22209]: pgmap v689: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 6.54k op/s 2024-08-20T01:48:44.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.398+0000 7fb6191c6640 1 -- 172.21.15.79:0/1816562122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb61410b040 msgr2=0x7fb614111840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:44.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.398+0000 7fb6191c6640 1 --2- 172.21.15.79:0/1816562122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb61410b040 0x7fb614111840 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb60c009be0 tx=0x7fb60c02a6c0 comp rx=0 tx=0).stop 2024-08-20T01:48:44.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.398+0000 7fb6191c6640 1 -- 172.21.15.79:0/1816562122 shutdown_connections 2024-08-20T01:48:44.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.398+0000 7fb6191c6640 1 --2- 172.21.15.79:0/1816562122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb61410b040 0x7fb614111840 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:44.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.398+0000 7fb6191c6640 1 --2- 172.21.15.79:0/1816562122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb61410a6c0 0x7fb61410ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:44.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.398+0000 7fb6191c6640 1 --2- 172.21.15.79:0/1816562122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb614104cb0 0x7fb614105090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:44.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.398+0000 7fb6191c6640 1 -- 172.21.15.79:0/1816562122 >> 172.21.15.79:0/1816562122 conn(0x7fb614100720 msgr2=0x7fb614102b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:44.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.398+0000 7fb6191c6640 1 -- 172.21.15.79:0/1816562122 shutdown_connections 2024-08-20T01:48:44.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.399+0000 7fb6191c6640 1 -- 172.21.15.79:0/1816562122 wait complete. 2024-08-20T01:48:44.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.400+0000 7fb6191c6640 1 Processor -- start 2024-08-20T01:48:44.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.403+0000 7fb6191c6640 1 -- start start 2024-08-20T01:48:44.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.403+0000 7fb6191c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb614104cb0 0x7fb6140744e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:44.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.403+0000 7fb6191c6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb61410a6c0 0x7fb614074a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:44.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.403+0000 7fb6191c6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb61410b040 0x7fb61406d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:44.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.404+0000 7fb6191c6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb614114bb0 con 0x7fb61410b040 2024-08-20T01:48:44.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.404+0000 7fb6191c6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb614114a30 con 0x7fb614104cb0 2024-08-20T01:48:44.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.404+0000 7fb6191c6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb614114d30 con 0x7fb61410a6c0 2024-08-20T01:48:44.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.404+0000 7fb61359e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb61410b040 0x7fb61406d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:44.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.404+0000 7fb61359e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb61410b040 0x7fb61406d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38254/0 (socket says 172.21.15.79:38254) 2024-08-20T01:48:44.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.404+0000 7fb61359e640 1 -- 172.21.15.79:0/4085864131 learned_addr learned my addr 172.21.15.79:0/4085864131 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:44.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.404+0000 7fb61359e640 1 -- 172.21.15.79:0/4085864131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb61410a6c0 msgr2=0x7fb614074a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:44.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.404+0000 7fb61359e640 1 --2- 172.21.15.79:0/4085864131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb61410a6c0 0x7fb614074a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:44.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.404+0000 7fb61359e640 1 -- 172.21.15.79:0/4085864131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb614104cb0 msgr2=0x7fb6140744e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-20T01:48:44.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.404+0000 7fb61359e640 1 --2- 172.21.15.79:0/4085864131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb614104cb0 0x7fb6140744e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:44.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.404+0000 7fb61359e640 1 -- 172.21.15.79:0/4085864131 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb61406e170 con 0x7fb61410b040 2024-08-20T01:48:44.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.405+0000 7fb61359e640 1 --2- 172.21.15.79:0/4085864131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb61410b040 0x7fb61406d8b0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fb60c030e00 tx=0x7fb60c030e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:44.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.406+0000 7fb5fbfff640 1 -- 172.21.15.79:0/4085864131 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb60c041020 con 0x7fb61410b040 2024-08-20T01:48:44.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.406+0000 7fb5fbfff640 1 -- 172.21.15.79:0/4085864131 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb60c037040 con 0x7fb61410b040 2024-08-20T01:48:44.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.406+0000 7fb6191c6640 1 -- 172.21.15.79:0/4085864131 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb61406e400 con 0x7fb61410b040 2024-08-20T01:48:44.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.406+0000 7fb6191c6640 1 -- 172.21.15.79:0/4085864131 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb614073320 con 0x7fb61410b040 2024-08-20T01:48:44.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.407+0000 7fb5fbfff640 1 -- 172.21.15.79:0/4085864131 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb60c036070 con 0x7fb61410b040 2024-08-20T01:48:44.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.410+0000 7fb61b5bf740 1 Processor -- start 2024-08-20T01:48:44.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.411+0000 7fb5fbfff640 1 -- 172.21.15.79:0/4085864131 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb60c044020 con 0x7fb61410b040 2024-08-20T01:48:44.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.411+0000 7fb61b5bf740 1 -- start start 2024-08-20T01:48:44.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.411+0000 7fb61b5bf740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582b16eb730 0x5582b16ebb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:44.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.411+0000 7fb61b5bf740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582b16ec050 0x5582b17002b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:44.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.411+0000 7fb61b5bf740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582b17007f0 0x5582b1702be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:44.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.411+0000 7fb61b5bf740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5582b1662930 con 0x5582b16ec050 2024-08-20T01:48:44.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.411+0000 7fb61b5bf740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5582b1651e30 con 0x5582b17007f0 2024-08-20T01:48:44.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.411+0000 7fb61b5bf740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5582b1655e70 con 0x5582b16eb730 2024-08-20T01:48:44.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.411+0000 7fb61259c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582b16eb730 0x5582b16ebb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:44.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.411+0000 7fb61259c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582b16eb730 0x5582b16ebb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:37352/0 (socket says 172.21.15.79:37352) 2024-08-20T01:48:44.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.412+0000 7fb61259c640 1 -- 172.21.15.79:0/2149385194 learned_addr learned my addr 172.21.15.79:0/2149385194 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:44.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.412+0000 7fb61259c640 1 --2- 172.21.15.79:0/2149385194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582b17007f0 0x5582b1702be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:44.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.412+0000 7fb5fbfff640 1 --2- 172.21.15.79:0/4085864131 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb5fc0b3de0 0x7fb5fc0b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:44.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.412+0000 7fb61259c640 1 -- 172.21.15.79:0/2149385194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582b17007f0 msgr2=0x5582b1702be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:44.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.412+0000 7fb61259c640 1 --2- 172.21.15.79:0/2149385194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582b17007f0 0x5582b1702be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:44.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.412+0000 7fb61259c640 1 -- 172.21.15.79:0/2149385194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582b16ec050 msgr2=0x5582b17002b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:48:44.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.412+0000 7fb61259c640 1 --2- 172.21.15.79:0/2149385194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582b16ec050 0x5582b17002b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:44.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.412+0000 7fb61259c640 1 -- 172.21.15.79:0/2149385194 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582b13b1650 con 0x5582b16eb730 2024-08-20T01:48:44.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.412+0000 7fb61359e640 1 --2- 172.21.15.79:0/4085864131 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb5fc0b3de0 0x7fb5fc0b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:44.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.412+0000 7fb5fbfff640 1 -- 172.21.15.79:0/4085864131 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fb60c1047d0 con 0x7fb61410b040 2024-08-20T01:48:44.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.412+0000 7fb61259c640 1 --2- 172.21.15.79:0/2149385194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582b16eb730 0x5582b16ebb10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb608013780 tx=0x7fb608009640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a345011b81865ad server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:44.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.413+0000 7fb61359e640 1 --2- 172.21.15.79:0/4085864131 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb5fc0b3de0 0x7fb5fc0b62a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb60c034040 tx=0x7fb60c04bdc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:44.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.413+0000 7fb5f97fa640 1 -- 172.21.15.79:0/2149385194 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb608013dc0 con 0x5582b16eb730 2024-08-20T01:48:44.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.413+0000 7fb5f97fa640 1 -- 172.21.15.79:0/2149385194 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb60800e6f0 con 0x5582b16eb730 2024-08-20T01:48:44.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.413+0000 7fb5f97fa640 1 -- 172.21.15.79:0/2149385194 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6080044e0 con 0x5582b16eb730 2024-08-20T01:48:44.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.414+0000 7fb61b5bf740 1 -- 172.21.15.79:0/2149385194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582b16eb730 msgr2=0x5582b16ebb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:44.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.414+0000 7fb61b5bf740 1 --2- 172.21.15.79:0/2149385194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582b16eb730 0x5582b16ebb10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb608013780 tx=0x7fb608009640 comp rx=0 tx=0).stop 2024-08-20T01:48:44.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.414+0000 7fb61b5bf740 1 -- 172.21.15.79:0/2149385194 shutdown_connections 2024-08-20T01:48:44.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.414+0000 7fb61b5bf740 1 --2- 172.21.15.79:0/2149385194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582b17007f0 0x5582b1702be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:44.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.414+0000 7fb61b5bf740 1 --2- 172.21.15.79:0/2149385194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582b16ec050 0x5582b17002b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:44.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.414+0000 7fb61b5bf740 1 --2- 172.21.15.79:0/2149385194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582b16eb730 0x5582b16ebb10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:44.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.414+0000 7fb61b5bf740 1 -- 172.21.15.79:0/2149385194 >> 172.21.15.79:0/2149385194 conn(0x5582b16e9560 msgr2=0x5582b16ea700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:44.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.414+0000 7fb61b5bf740 1 -- 172.21.15.79:0/2149385194 shutdown_connections 2024-08-20T01:48:44.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.414+0000 7fb61b5bf740 1 -- 172.21.15.79:0/2149385194 wait complete. 2024-08-20T01:48:44.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.415+0000 7fb61b5bf740 1 -- start start 2024-08-20T01:48:44.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.415+0000 7fb61b5bf740 1 Processor -- start 2024-08-20T01:48:44.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.415+0000 7fb61b5bf740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582b16eb730 0x5582b16f5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:44.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.415+0000 7fb61b5bf740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582b16ec050 0x5582b16f56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:44.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.415+0000 7fb61b5bf740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582b17007f0 0x5582b16ff9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:44.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.415+0000 7fb61b5bf740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5582b14b4700 con 0x5582b16ec050 2024-08-20T01:48:44.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.415+0000 7fb61b5bf740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5582b15d8810 con 0x5582b17007f0 2024-08-20T01:48:44.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.415+0000 7fb61b5bf740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5582b1703410 con 0x5582b16eb730 2024-08-20T01:48:44.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.415+0000 7fb61b5bf740 10 client.0 _ll_register_callbacks cb 0x5582b164b700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:48:44.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.415+0000 7fb612d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582b16ec050 0x5582b16f56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:44.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.416+0000 7fb612d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582b16ec050 0x5582b16f56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38258/0 (socket says 172.21.15.79:38258) 2024-08-20T01:48:44.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.416+0000 7fb612d9d640 1 -- 172.21.15.79:0/3221165485 learned_addr learned my addr 172.21.15.79:0/3221165485 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:44.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.416+0000 7fb61259c640 1 --2- 172.21.15.79:0/3221165485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582b16eb730 0x5582b16f5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:44.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.416+0000 7fb61259c640 1 --2- 172.21.15.79:0/3221165485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582b17007f0 0x5582b16ff9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:44.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.416+0000 7fb61259c640 1 -- 172.21.15.79:0/3221165485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582b17007f0 msgr2=0x5582b16ff9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:44.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.416+0000 7fb61259c640 1 --2- 172.21.15.79:0/3221165485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582b17007f0 0x5582b16ff9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:44.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.416+0000 7fb61259c640 1 -- 172.21.15.79:0/3221165485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582b16ec050 msgr2=0x5582b16f56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:44.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.416+0000 7fb61259c640 1 --2- 172.21.15.79:0/3221165485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582b16ec050 0x5582b16f56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:44.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.416+0000 7fb61259c640 1 -- 172.21.15.79:0/3221165485 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582b17000b0 con 0x5582b16eb730 2024-08-20T01:48:44.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.416+0000 7fb612d9d640 1 --2- 172.21.15.79:0/3221165485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582b16ec050 0x5582b16f56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:48:44.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.416+0000 7fb61259c640 1 --2- 172.21.15.79:0/3221165485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582b16eb730 0x5582b16f5150 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb608005dc0 tx=0x7fb6080046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76100e7b580f238c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:44.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.418+0000 7fb5f6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:48:44.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.418+0000 7fb5f6ff5640 1 -- 172.21.15.79:0/3221165485 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb608027040 con 0x5582b16eb730 2024-08-20T01:48:44.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.418+0000 7fb5f6ff5640 1 -- 172.21.15.79:0/3221165485 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fb608004230 con 0x5582b16eb730 2024-08-20T01:48:44.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.419+0000 7fb61b5bf740 1 -- 172.21.15.79:0/3221165485 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5582b1601150 con 0x5582b16eb730 2024-08-20T01:48:44.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.421+0000 7fb5f6ff5640 1 -- 172.21.15.79:0/3221165485 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fb60800eca0 con 0x5582b16eb730 2024-08-20T01:48:44.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.423+0000 7fb61b5bf740 10 client.27463 fetch_fsmap learned FSMap version 48 2024-08-20T01:48:44.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.423+0000 7fb61b5bf740 1 -- 172.21.15.79:0/3221165485 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x5582b1706960 con 0x5582b16eb730 2024-08-20T01:48:44.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.424+0000 7fb5f6ff5640 1 -- 172.21.15.79:0/3221165485 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5582b1601150 con 0x5582b16eb730 2024-08-20T01:48:44.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.424+0000 7fb5f6ff5640 1 -- 172.21.15.79:0/3221165485 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 48) ==== 8382+0+0 (secure 0 0 0) 0x7fb60800f040 con 0x5582b16eb730 2024-08-20T01:48:44.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.424+0000 7fb61b5bf740 10 client.27463 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T01:48:44.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.424+0000 7fb61b5bf740 10 client.27463 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:48:44.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.425+0000 7fb61b5bf740 20 client.27463 populate_metadata read hostname 'smithi079' 2024-08-20T01:48:44.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.425+0000 7fb61b5bf740 1 --2- 172.21.15.79:0/3221165485 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x5582b1707cb0 0x5582b170a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:44.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.425+0000 7fb61b5bf740 4 client.27463 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:48:44.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.425+0000 7fb61b5bf740 1 -- 172.21.15.79:0/3221165485 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5582b1664880 con 0x5582b1707cb0 2024-08-20T01:48:44.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.425+0000 7fb612d9d640 1 --2- 172.21.15.79:0/3221165485 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x5582b1707cb0 0x5582b170a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:44.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.426+0000 7fb612d9d640 1 --2- 172.21.15.79:0/3221165485 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x5582b1707cb0 0x5582b170a0a0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6ea098bc2c4ed server_cookie=de9cdb231d7df799 in_seq=0 out_seq=0 2024-08-20T01:48:44.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.426+0000 7fb5f6ff5640 10 client.27463 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:48:44.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.427+0000 7fb5f6ff5640 1 -- 172.21.15.79:0/3221165485 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5582b1664880 con 0x5582b1707cb0 2024-08-20T01:48:44.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.427+0000 7fb5f6ff5640 10 client.27463 handle_command_reply: tid=0 2024-08-20T01:48:44.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.427+0000 7fb61b5bf740 1 client.27463 shutdown 2024-08-20T01:48:44.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.427+0000 7fb61b5bf740 1 -- 172.21.15.79:0/3221165485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582b16eb730 msgr2=0x5582b16f5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:44.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.427+0000 7fb61b5bf740 1 --2- 172.21.15.79:0/3221165485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582b16eb730 0x5582b16f5150 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb608005dc0 tx=0x7fb6080046c0 comp rx=0 tx=0).stop 2024-08-20T01:48:44.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.427+0000 7fb61b5bf740 1 -- 172.21.15.79:0/3221165485 shutdown_connections 2024-08-20T01:48:44.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.428+0000 7fb61b5bf740 1 --2- 172.21.15.79:0/3221165485 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x5582b1707cb0 0x5582b170a0a0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:44.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.428+0000 7fb61b5bf740 1 --2- 172.21.15.79:0/3221165485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582b17007f0 0x5582b16ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:44.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.428+0000 7fb5f6ff5640 0 client.27463 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:48:44.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.428+0000 7fb61b5bf740 1 --2- 172.21.15.79:0/3221165485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582b16ec050 0x5582b16f56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:44.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.428+0000 7fb61b5bf740 1 --2- 172.21.15.79:0/3221165485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582b16eb730 0x5582b16f5150 secure :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb608005dc0 tx=0x7fb6080046c0 comp rx=0 tx=0).stop 2024-08-20T01:48:44.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.428+0000 7fb61b5bf740 1 -- 172.21.15.79:0/3221165485 >> 172.21.15.79:0/3221165485 conn(0x5582b16e9560 msgr2=0x5582b16ef100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:44.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.429+0000 7fb61b5bf740 1 -- 172.21.15.79:0/3221165485 shutdown_connections 2024-08-20T01:48:44.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.429+0000 7fb61b5bf740 1 -- 172.21.15.79:0/3221165485 wait complete. 2024-08-20T01:48:44.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.429+0000 7fb61b5bf740 20 client.27463 trim_cache size 0 max 16384 2024-08-20T01:48:44.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.453+0000 7fb61b5bf740 1 Processor -- start 2024-08-20T01:48:44.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.453+0000 7fb61b5bf740 1 -- start start 2024-08-20T01:48:44.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.454+0000 7fb61b5bf740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582b16ec050 0x5582b170f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:44.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.454+0000 7fb61b5bf740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582b17007f0 0x5582b170fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:44.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.454+0000 7fb61b5bf740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582b1707cb0 0x5582b16f75d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:44.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.455+0000 7fb612d9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582b17007f0 0x5582b170fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:44.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.455+0000 7fb61259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582b16ec050 0x5582b170f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:44.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.455+0000 7fb61259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582b16ec050 0x5582b170f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38268/0 (socket says 172.21.15.79:38268) 2024-08-20T01:48:44.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.455+0000 7fb61b5bf740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb6141b4640 con 0x5582b16ec050 2024-08-20T01:48:44.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.455+0000 7fb61b5bf740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb6141b6270 con 0x5582b1707cb0 2024-08-20T01:48:44.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.455+0000 7fb61b5bf740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb6141b4dd0 con 0x5582b17007f0 2024-08-20T01:48:44.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.455+0000 7fb612d9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582b17007f0 0x5582b170fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:37384/0 (socket says 172.21.15.79:37384) 2024-08-20T01:48:44.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.455+0000 7fb612d9d640 1 -- 172.21.15.79:0/1868588890 learned_addr learned my addr 172.21.15.79:0/1868588890 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:44.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.455+0000 7fb612d9d640 1 -- 172.21.15.79:0/1868588890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582b1707cb0 msgr2=0x5582b16f75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:44.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.455+0000 7fb612d9d640 1 --2- 172.21.15.79:0/1868588890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582b1707cb0 0x5582b16f75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:44.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.455+0000 7fb612d9d640 1 -- 172.21.15.79:0/1868588890 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582b16ec050 msgr2=0x5582b170f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:44.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.455+0000 7fb612d9d640 1 --2- 172.21.15.79:0/1868588890 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582b16ec050 0x5582b170f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:44.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.455+0000 7fb612d9d640 1 -- 172.21.15.79:0/1868588890 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582b16ebe40 con 0x5582b17007f0 2024-08-20T01:48:44.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.456+0000 7fb612d9d640 1 --2- 172.21.15.79:0/1868588890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582b17007f0 0x5582b170fd20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb60400b9f0 tx=0x7fb60400b360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcf0df595fef31f6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:44.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.456+0000 7fb5f8ff9640 1 -- 172.21.15.79:0/1868588890 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb604004030 con 0x5582b17007f0 2024-08-20T01:48:44.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.457+0000 7fb5f8ff9640 1 -- 172.21.15.79:0/1868588890 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb604062020 con 0x5582b17007f0 2024-08-20T01:48:44.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.457+0000 7fb5f8ff9640 1 -- 172.21.15.79:0/1868588890 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb60405e470 con 0x5582b17007f0 2024-08-20T01:48:44.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.457+0000 7fb61b5bf740 1 -- 172.21.15.79:0/1868588890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582b17007f0 msgr2=0x5582b170fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:44.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.457+0000 7fb61b5bf740 1 --2- 172.21.15.79:0/1868588890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582b17007f0 0x5582b170fd20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb60400b9f0 tx=0x7fb60400b360 comp rx=0 tx=0).stop 2024-08-20T01:48:44.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.457+0000 7fb61b5bf740 1 -- 172.21.15.79:0/1868588890 shutdown_connections 2024-08-20T01:48:44.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.458+0000 7fb61b5bf740 1 --2- 172.21.15.79:0/1868588890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582b1707cb0 0x5582b16f75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:44.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.458+0000 7fb61b5bf740 1 --2- 172.21.15.79:0/1868588890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582b17007f0 0x5582b170fd20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:44.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.458+0000 7fb61b5bf740 1 --2- 172.21.15.79:0/1868588890 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582b16ec050 0x5582b170f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:44.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.458+0000 7fb61b5bf740 1 -- 172.21.15.79:0/1868588890 >> 172.21.15.79:0/1868588890 conn(0x5582b16e9560 msgr2=0x5582b16f6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:44.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.458+0000 7fb61b5bf740 1 -- 172.21.15.79:0/1868588890 shutdown_connections 2024-08-20T01:48:44.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.458+0000 7fb61b5bf740 1 -- 172.21.15.79:0/1868588890 wait complete. 2024-08-20T01:48:44.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.458+0000 7fb61b5bf740 1 -- start start 2024-08-20T01:48:44.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.459+0000 7fb61b5bf740 1 Processor -- start 2024-08-20T01:48:44.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.459+0000 7fb61b5bf740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582b16ec050 0x5582b17164d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:44.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.459+0000 7fb61b5bf740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582b17007f0 0x5582b1716a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:44.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.459+0000 7fb61b5bf740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582b1707cb0 0x5582b1716f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:44.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.459+0000 7fb61b5bf740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb6141b5ba0 con 0x5582b16ec050 2024-08-20T01:48:44.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.459+0000 7fb61b5bf740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb6141b54a0 con 0x5582b1707cb0 2024-08-20T01:48:44.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.459+0000 7fb61b5bf740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb6141b2620 con 0x5582b17007f0 2024-08-20T01:48:44.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.459+0000 7fb61b5bf740 10 client.0 _ll_register_callbacks cb 0x7fb608009d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:48:44.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.460+0000 7fb61259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582b1707cb0 0x5582b1716f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:44.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.460+0000 7fb61259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582b16ec050 0x5582b17164d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:44.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.460+0000 7fb61259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582b1707cb0 0x5582b1716f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:40730/0 (socket says 172.21.15.79:40730) 2024-08-20T01:48:44.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.460+0000 7fb61259c640 1 -- 172.21.15.79:0/4223780283 learned_addr learned my addr 172.21.15.79:0/4223780283 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:44.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.460+0000 7fb61259c640 1 -- 172.21.15.79:0/4223780283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582b17007f0 msgr2=0x5582b1716a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:48:44.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.460+0000 7fb61259c640 1 --2- 172.21.15.79:0/4223780283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582b17007f0 0x5582b1716a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:44.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.460+0000 7fb61259c640 1 -- 172.21.15.79:0/4223780283 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582b16ec050 msgr2=0x5582b17164d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:44.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.460+0000 7fb61259c640 1 --2- 172.21.15.79:0/4223780283 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582b16ec050 0x5582b17164d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:44.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.460+0000 7fb61259c640 1 -- 172.21.15.79:0/4223780283 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582b17707a0 con 0x5582b1707cb0 2024-08-20T01:48:44.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.460+0000 7fb61259c640 1 --2- 172.21.15.79:0/4223780283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582b1707cb0 0x5582b1716f50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb608005ab0 tx=0x7fb608000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7eaa04c69d9900b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:44.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.461+0000 7fb5f6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:48:44.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.461+0000 7fb5f6ff5640 1 -- 172.21.15.79:0/4223780283 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb608003fe0 con 0x5582b1707cb0 2024-08-20T01:48:44.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.461+0000 7fb5f6ff5640 1 -- 172.21.15.79:0/4223780283 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fb608004180 con 0x5582b1707cb0 2024-08-20T01:48:44.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.461+0000 7fb61b5bf740 1 -- 172.21.15.79:0/4223780283 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb604062020 con 0x5582b1707cb0 2024-08-20T01:48:44.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.461+0000 7fb5f6ff5640 1 -- 172.21.15.79:0/4223780283 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fb608040050 con 0x5582b1707cb0 2024-08-20T01:48:44.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.461+0000 7fb61b5bf740 10 client.27500 fetch_fsmap learned FSMap version 48 2024-08-20T01:48:44.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.461+0000 7fb61b5bf740 1 -- 172.21.15.79:0/4223780283 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x5582b1771aa0 con 0x5582b1707cb0 2024-08-20T01:48:44.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.462+0000 7fb5f6ff5640 1 -- 172.21.15.79:0/4223780283 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb60802ed90 con 0x5582b1707cb0 2024-08-20T01:48:44.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.462+0000 7fb5f6ff5640 1 -- 172.21.15.79:0/4223780283 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 48) ==== 8382+0+0 (secure 0 0 0) 0x7fb608043080 con 0x5582b1707cb0 2024-08-20T01:48:44.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.462+0000 7fb61b5bf740 10 client.27500 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T01:48:44.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.462+0000 7fb61b5bf740 10 client.27500 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:48:44.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.462+0000 7fb61b5bf740 20 client.27500 populate_metadata read hostname 'smithi079' 2024-08-20T01:48:44.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.462+0000 7fb61b5bf740 1 --2- 172.21.15.79:0/4223780283 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x5582b1772260 0x5582b17746a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:44.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.462+0000 7fb61b5bf740 4 client.27500 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:48:44.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.462+0000 7fb61b5bf740 1 -- 172.21.15.79:0/4223780283 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fb604062020 con 0x5582b1772260 2024-08-20T01:48:44.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.463+0000 7fb612d9d640 1 --2- 172.21.15.79:0/4223780283 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x5582b1772260 0x5582b17746a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:44.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.463+0000 7fb612d9d640 1 --2- 172.21.15.79:0/4223780283 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x5582b1772260 0x5582b17746a0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e5ef8cb90c451678 server_cookie=d7ab89ab1f0bba24 in_seq=0 out_seq=0 2024-08-20T01:48:44.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.463+0000 7fb5f6ff5640 10 client.27500 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:48:44.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.463+0000 7fb5f6ff5640 1 -- 172.21.15.79:0/4223780283 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fb604062020 con 0x5582b1772260 2024-08-20T01:48:44.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.463+0000 7fb5f6ff5640 10 client.27500 handle_command_reply: tid=0 2024-08-20T01:48:44.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.463+0000 7fb61b5bf740 1 client.27500 shutdown 2024-08-20T01:48:44.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.464+0000 7fb61b5bf740 1 -- 172.21.15.79:0/4223780283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582b1707cb0 msgr2=0x5582b1716f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:44.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.464+0000 7fb61b5bf740 1 --2- 172.21.15.79:0/4223780283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582b1707cb0 0x5582b1716f50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb608005ab0 tx=0x7fb608000bc0 comp rx=0 tx=0).stop 2024-08-20T01:48:44.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.464+0000 7fb61b5bf740 1 -- 172.21.15.79:0/4223780283 shutdown_connections 2024-08-20T01:48:44.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.464+0000 7fb61b5bf740 1 --2- 172.21.15.79:0/4223780283 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x5582b1772260 0x5582b17746a0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:44.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.464+0000 7fb61b5bf740 1 --2- 172.21.15.79:0/4223780283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582b1707cb0 0x5582b1716f50 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:44.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.464+0000 7fb5f6ff5640 0 client.27500 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:48:44.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.464+0000 7fb61b5bf740 1 --2- 172.21.15.79:0/4223780283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5582b17007f0 0x5582b1716a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:44.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.464+0000 7fb61b5bf740 1 --2- 172.21.15.79:0/4223780283 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582b16ec050 0x5582b17164d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:44.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.464+0000 7fb61b5bf740 1 -- 172.21.15.79:0/4223780283 >> 172.21.15.79:0/4223780283 conn(0x5582b16e9560 msgr2=0x5582b16e7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:44.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.464+0000 7fb61b5bf740 1 -- 172.21.15.79:0/4223780283 shutdown_connections 2024-08-20T01:48:44.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.464+0000 7fb61b5bf740 1 -- 172.21.15.79:0/4223780283 wait complete. 2024-08-20T01:48:44.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.464+0000 7fb61b5bf740 20 client.27500 trim_cache size 0 max 16384 2024-08-20T01:48:44.470 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:48:44.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.465+0000 7fb6191c6640 1 -- 172.21.15.79:0/4085864131 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb5fc0b3de0 msgr2=0x7fb5fc0b62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:44.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.465+0000 7fb6191c6640 1 --2- 172.21.15.79:0/4085864131 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb5fc0b3de0 0x7fb5fc0b62a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb60c034040 tx=0x7fb60c04bdc0 comp rx=0 tx=0).stop 2024-08-20T01:48:44.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.465+0000 7fb6191c6640 1 -- 172.21.15.79:0/4085864131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb61410b040 msgr2=0x7fb61406d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:44.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.465+0000 7fb6191c6640 1 --2- 172.21.15.79:0/4085864131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb61410b040 0x7fb61406d8b0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fb60c030e00 tx=0x7fb60c030e30 comp rx=0 tx=0).stop 2024-08-20T01:48:44.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.465+0000 7fb6191c6640 1 -- 172.21.15.79:0/4085864131 shutdown_connections 2024-08-20T01:48:44.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.465+0000 7fb6191c6640 1 --2- 172.21.15.79:0/4085864131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb61410b040 0x7fb61406d8b0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:44.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.465+0000 7fb6191c6640 1 --2- 172.21.15.79:0/4085864131 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb5fc0b3de0 0x7fb5fc0b62a0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:44.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.465+0000 7fb6191c6640 1 --2- 172.21.15.79:0/4085864131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb61410a6c0 0x7fb614074a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:44.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.465+0000 7fb6191c6640 1 --2- 172.21.15.79:0/4085864131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb614104cb0 0x7fb6140744e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:44.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.465+0000 7fb6191c6640 1 -- 172.21.15.79:0/4085864131 >> 172.21.15.79:0/4085864131 conn(0x7fb614100720 msgr2=0x7fb614102b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:44.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.466+0000 7fb6191c6640 1 -- 172.21.15.79:0/4085864131 shutdown_connections 2024-08-20T01:48:44.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:44.466+0000 7fb6191c6640 1 -- 172.21.15.79:0/4085864131 wait complete. 2024-08-20T01:48:45.233 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-20T01:48:45.663 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:48:46.138 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:45 smithi079 ceph-mon[18656]: pgmap v690: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 MiB/s wr, 6.72k op/s 2024-08-20T01:48:46.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:45 smithi175 ceph-mon[22392]: pgmap v690: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 MiB/s wr, 6.72k op/s 2024-08-20T01:48:46.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:45 smithi081 ceph-mon[22209]: pgmap v690: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 MiB/s wr, 6.72k op/s 2024-08-20T01:48:46.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.278+0000 7feb40a78640 1 -- 172.21.15.79:0/1950992749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb3c109f20 msgr2=0x7feb3c10a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:46.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.278+0000 7feb40a78640 1 --2- 172.21.15.79:0/1950992749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb3c109f20 0x7feb3c10a300 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7feb2c009900 tx=0x7feb2c02a400 comp rx=0 tx=0).stop 2024-08-20T01:48:46.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.278+0000 7feb40a78640 1 -- 172.21.15.79:0/1950992749 shutdown_connections 2024-08-20T01:48:46.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.279+0000 7feb40a78640 1 --2- 172.21.15.79:0/1950992749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb3c113440 0x7feb3c1158d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:46.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.279+0000 7feb40a78640 1 --2- 172.21.15.79:0/1950992749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb3c10a840 0x7feb3c112d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:46.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.279+0000 7feb40a78640 1 --2- 172.21.15.79:0/1950992749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb3c109f20 0x7feb3c10a300 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:46.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.279+0000 7feb40a78640 1 -- 172.21.15.79:0/1950992749 >> 172.21.15.79:0/1950992749 conn(0x7feb3c0785d0 msgr2=0x7feb3c07a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:46.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.279+0000 7feb40a78640 1 -- 172.21.15.79:0/1950992749 shutdown_connections 2024-08-20T01:48:46.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.279+0000 7feb40a78640 1 -- 172.21.15.79:0/1950992749 wait complete. 2024-08-20T01:48:46.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.281+0000 7feb40a78640 1 Processor -- start 2024-08-20T01:48:46.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.281+0000 7feb40a78640 1 -- start start 2024-08-20T01:48:46.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.284+0000 7feb40a78640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb3c109f20 0x7feb3c19f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:46.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.284+0000 7feb40a78640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb3c10a840 0x7feb3c19f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:46.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.284+0000 7feb40a78640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb3c113440 0x7feb3c1a4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:46.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.284+0000 7feb40a78640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7feb3c119040 con 0x7feb3c10a840 2024-08-20T01:48:46.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.284+0000 7feb40a78640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7feb3c118ec0 con 0x7feb3c109f20 2024-08-20T01:48:46.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.284+0000 7feb40a78640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7feb3c1191c0 con 0x7feb3c113440 2024-08-20T01:48:46.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.291+0000 7feb3a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb3c109f20 0x7feb3c19f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:46.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.291+0000 7feb3a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb3c109f20 0x7feb3c19f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:40754/0 (socket says 172.21.15.79:40754) 2024-08-20T01:48:46.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.291+0000 7feb3a59c640 1 -- 172.21.15.79:0/326987390 learned_addr learned my addr 172.21.15.79:0/326987390 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:46.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.291+0000 7feb3ad9d640 1 --2- 172.21.15.79:0/326987390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb3c113440 0x7feb3c1a4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:46.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.291+0000 7feb3ad9d640 1 -- 172.21.15.79:0/326987390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb3c109f20 msgr2=0x7feb3c19f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:46.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.291+0000 7feb3ad9d640 1 --2- 172.21.15.79:0/326987390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb3c109f20 0x7feb3c19f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:46.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.291+0000 7feb3ad9d640 1 -- 172.21.15.79:0/326987390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb3c10a840 msgr2=0x7feb3c19f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:46.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.291+0000 7feb3ad9d640 1 --2- 172.21.15.79:0/326987390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb3c10a840 0x7feb3c19f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:46.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.291+0000 7feb3ad9d640 1 -- 172.21.15.79:0/326987390 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb3c1a5400 con 0x7feb3c113440 2024-08-20T01:48:46.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.292+0000 7feb3ad9d640 1 --2- 172.21.15.79:0/326987390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb3c113440 0x7feb3c1a4c30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7feb34005fd0 tx=0x7feb3400ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:46.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.292+0000 7feb2b7fe640 1 -- 172.21.15.79:0/326987390 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb3400cd80 con 0x7feb3c113440 2024-08-20T01:48:46.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.292+0000 7feb2b7fe640 1 -- 172.21.15.79:0/326987390 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feb34005020 con 0x7feb3c113440 2024-08-20T01:48:46.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.292+0000 7feb2b7fe640 1 -- 172.21.15.79:0/326987390 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb34010690 con 0x7feb3c113440 2024-08-20T01:48:46.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.292+0000 7feb40a78640 1 -- 172.21.15.79:0/326987390 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb3c1a56f0 con 0x7feb3c113440 2024-08-20T01:48:46.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.293+0000 7feb40a78640 1 -- 172.21.15.79:0/326987390 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb3c1abdb0 con 0x7feb3c113440 2024-08-20T01:48:46.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.296+0000 7feb2b7fe640 1 -- 172.21.15.79:0/326987390 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7feb34004a40 con 0x7feb3c113440 2024-08-20T01:48:46.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.297+0000 7feb2b7fe640 1 --2- 172.21.15.79:0/326987390 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7feb240b3c90 0x7feb240b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:46.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.297+0000 7feb2b7fe640 1 -- 172.21.15.79:0/326987390 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7feb340e4290 con 0x7feb3c113440 2024-08-20T01:48:46.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.298+0000 7feb3a59c640 1 --2- 172.21.15.79:0/326987390 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7feb240b3c90 0x7feb240b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:46.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.298+0000 7feb3a59c640 1 --2- 172.21.15.79:0/326987390 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7feb240b3c90 0x7feb240b6150 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7feb2c0096c0 tx=0x7feb2c00b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:46.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.300+0000 7feb42e71740 1 Processor -- start 2024-08-20T01:48:46.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.300+0000 7feb42e71740 1 -- start start 2024-08-20T01:48:46.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.301+0000 7feb42e71740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587841e3880 0x5587841e3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:46.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.301+0000 7feb42e71740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587841e41a0 0x5587841efbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:46.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.301+0000 7feb42e71740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587841f0130 0x5587841f2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:46.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.301+0000 7feb3a59c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587841e3880 0x5587841e3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:46.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.301+0000 7feb3a59c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587841e3880 0x5587841e3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:37414/0 (socket says 172.21.15.79:37414) 2024-08-20T01:48:46.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.301+0000 7feb39d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587841e41a0 0x5587841efbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:46.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.301+0000 7feb39d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587841e41a0 0x5587841efbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:40756/0 (socket says 172.21.15.79:40756) 2024-08-20T01:48:46.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.302+0000 7feb3a59c640 1 -- 172.21.15.79:0/3413063030 learned_addr learned my addr 172.21.15.79:0/3413063030 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:46.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.302+0000 7feb42e71740 1 -- 172.21.15.79:0/3413063030 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55878415a930 con 0x5587841f0130 2024-08-20T01:48:46.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.302+0000 7feb42e71740 1 -- 172.21.15.79:0/3413063030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558784149e30 con 0x5587841e41a0 2024-08-20T01:48:46.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.302+0000 7feb42e71740 1 -- 172.21.15.79:0/3413063030 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55878414de70 con 0x5587841e3880 2024-08-20T01:48:46.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.302+0000 7feb3a59c640 1 -- 172.21.15.79:0/3413063030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587841e41a0 msgr2=0x5587841efbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:46.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.302+0000 7feb3a59c640 1 --2- 172.21.15.79:0/3413063030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587841e41a0 0x5587841efbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:46.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.302+0000 7feb3a59c640 1 -- 172.21.15.79:0/3413063030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587841f0130 msgr2=0x5587841f2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:46.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.302+0000 7feb3a59c640 1 --2- 172.21.15.79:0/3413063030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587841f0130 0x5587841f2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:46.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.302+0000 7feb3a59c640 1 -- 172.21.15.79:0/3413063030 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558783ea9650 con 0x5587841e3880 2024-08-20T01:48:46.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.303+0000 7feb3a59c640 1 --2- 172.21.15.79:0/3413063030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587841e3880 0x5587841e3c60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7feb2c0052d0 tx=0x7feb2c03d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20e2b60c04b16880 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:46.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.303+0000 7feb28ff9640 1 -- 172.21.15.79:0/3413063030 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2c035040 con 0x5587841e3880 2024-08-20T01:48:46.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.303+0000 7feb28ff9640 1 -- 172.21.15.79:0/3413063030 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feb2c04f070 con 0x5587841e3880 2024-08-20T01:48:46.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.303+0000 7feb28ff9640 1 -- 172.21.15.79:0/3413063030 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2c04a850 con 0x5587841e3880 2024-08-20T01:48:46.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.304+0000 7feb42e71740 1 -- 172.21.15.79:0/3413063030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587841e3880 msgr2=0x5587841e3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:46.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.304+0000 7feb42e71740 1 --2- 172.21.15.79:0/3413063030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587841e3880 0x5587841e3c60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7feb2c0052d0 tx=0x7feb2c03d000 comp rx=0 tx=0).stop 2024-08-20T01:48:46.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.304+0000 7feb42e71740 1 -- 172.21.15.79:0/3413063030 shutdown_connections 2024-08-20T01:48:46.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.304+0000 7feb42e71740 1 --2- 172.21.15.79:0/3413063030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587841f0130 0x5587841f2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:46.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.304+0000 7feb42e71740 1 --2- 172.21.15.79:0/3413063030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587841e41a0 0x5587841efbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:46.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.305+0000 7feb42e71740 1 --2- 172.21.15.79:0/3413063030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587841e3880 0x5587841e3c60 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:46.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.305+0000 7feb42e71740 1 -- 172.21.15.79:0/3413063030 >> 172.21.15.79:0/3413063030 conn(0x5587841e16b0 msgr2=0x5587841e2850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:46.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.305+0000 7feb42e71740 1 -- 172.21.15.79:0/3413063030 shutdown_connections 2024-08-20T01:48:46.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.305+0000 7feb42e71740 1 -- 172.21.15.79:0/3413063030 wait complete. 2024-08-20T01:48:46.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.305+0000 7feb42e71740 1 -- start start 2024-08-20T01:48:46.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.306+0000 7feb42e71740 1 Processor -- start 2024-08-20T01:48:46.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.306+0000 7feb42e71740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587841e3880 0x5587841ed160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:46.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.306+0000 7feb42e71740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587841e41a0 0x5587841ed6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:46.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.306+0000 7feb42e71740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587841f0130 0x5587841edbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:46.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.306+0000 7feb42e71740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558783fac700 con 0x5587841f0130 2024-08-20T01:48:46.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.306+0000 7feb42e71740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5587840d0810 con 0x5587841e41a0 2024-08-20T01:48:46.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.306+0000 7feb42e71740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5587841f2d80 con 0x5587841e3880 2024-08-20T01:48:46.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.306+0000 7feb39d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587841e41a0 0x5587841ed6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:46.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.306+0000 7feb42e71740 10 client.0 _ll_register_callbacks cb 0x558784143700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:48:46.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.306+0000 7feb39d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587841e41a0 0x5587841ed6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:40770/0 (socket says 172.21.15.79:40770) 2024-08-20T01:48:46.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.306+0000 7feb39d9b640 1 -- 172.21.15.79:0/2455535486 learned_addr learned my addr 172.21.15.79:0/2455535486 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:46.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.306+0000 7feb3a59c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587841e3880 0x5587841ed160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:46.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.307+0000 7feb39d9b640 1 -- 172.21.15.79:0/2455535486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587841e3880 msgr2=0x5587841ed160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:46.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.307+0000 7feb39d9b640 1 --2- 172.21.15.79:0/2455535486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587841e3880 0x5587841ed160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:46.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.307+0000 7feb39d9b640 1 -- 172.21.15.79:0/2455535486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587841f0130 msgr2=0x5587841edbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:46.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.307+0000 7feb39d9b640 1 --2- 172.21.15.79:0/2455535486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587841f0130 0x5587841edbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:46.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.307+0000 7feb39d9b640 1 -- 172.21.15.79:0/2455535486 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587841fc240 con 0x5587841e41a0 2024-08-20T01:48:46.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.308+0000 7feb39d9b640 1 --2- 172.21.15.79:0/2455535486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587841e41a0 0x5587841ed6a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7feb3000e450 tx=0x7feb3000e910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71ae42768863969b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:46.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.309+0000 7feb21ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:48:46.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.309+0000 7feb21ffb640 1 -- 172.21.15.79:0/2455535486 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb30017070 con 0x5587841e41a0 2024-08-20T01:48:46.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.309+0000 7feb21ffb640 1 -- 172.21.15.79:0/2455535486 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7feb30013680 con 0x5587841e41a0 2024-08-20T01:48:46.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.309+0000 7feb42e71740 1 -- 172.21.15.79:0/2455535486 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5587840f9150 con 0x5587841e41a0 2024-08-20T01:48:46.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.309+0000 7feb21ffb640 1 -- 172.21.15.79:0/2455535486 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7feb30021050 con 0x5587841e41a0 2024-08-20T01:48:46.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.309+0000 7feb42e71740 10 client.27512 fetch_fsmap learned FSMap version 48 2024-08-20T01:48:46.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.309+0000 7feb42e71740 1 -- 172.21.15.79:0/2455535486 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x5587841fec30 con 0x5587841e41a0 2024-08-20T01:48:46.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.310+0000 7feb21ffb640 1 -- 172.21.15.79:0/2455535486 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feb30013d10 con 0x5587841e41a0 2024-08-20T01:48:46.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.310+0000 7feb21ffb640 1 -- 172.21.15.79:0/2455535486 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 48) ==== 8382+0+0 (secure 0 0 0) 0x7feb3001cb10 con 0x5587841e41a0 2024-08-20T01:48:46.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.310+0000 7feb42e71740 10 client.27512 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T01:48:46.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.310+0000 7feb42e71740 10 client.27512 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:48:46.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.310+0000 7feb42e71740 20 client.27512 populate_metadata read hostname 'smithi079' 2024-08-20T01:48:46.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.310+0000 7feb42e71740 1 --2- 172.21.15.79:0/2455535486 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x558784200140 0x558784202560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:46.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.310+0000 7feb42e71740 4 client.27512 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:48:46.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.310+0000 7feb42e71740 1 -- 172.21.15.79:0/2455535486 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5587840f9150 con 0x558784200140 2024-08-20T01:48:46.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.310+0000 7feb3a59c640 1 --2- 172.21.15.79:0/2455535486 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x558784200140 0x558784202560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:46.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.311+0000 7feb21ffb640 10 client.27512 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:48:46.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.311+0000 7feb3a59c640 1 --2- 172.21.15.79:0/2455535486 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x558784200140 0x558784202560 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b7a6a6cb5d8922e5 server_cookie=8d1675ab46b7a5b in_seq=0 out_seq=0 2024-08-20T01:48:46.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.312+0000 7feb21ffb640 1 -- 172.21.15.79:0/2455535486 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5587840f9150 con 0x558784200140 2024-08-20T01:48:46.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.312+0000 7feb21ffb640 10 client.27512 handle_command_reply: tid=0 2024-08-20T01:48:46.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.312+0000 7feb42e71740 1 client.27512 shutdown 2024-08-20T01:48:46.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.312+0000 7feb42e71740 1 -- 172.21.15.79:0/2455535486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587841e41a0 msgr2=0x5587841ed6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:46.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.312+0000 7feb42e71740 1 --2- 172.21.15.79:0/2455535486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587841e41a0 0x5587841ed6a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7feb3000e450 tx=0x7feb3000e910 comp rx=0 tx=0).stop 2024-08-20T01:48:46.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.312+0000 7feb42e71740 1 -- 172.21.15.79:0/2455535486 shutdown_connections 2024-08-20T01:48:46.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.312+0000 7feb42e71740 1 --2- 172.21.15.79:0/2455535486 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x558784200140 0x558784202560 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:46.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.312+0000 7feb42e71740 1 --2- 172.21.15.79:0/2455535486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587841f0130 0x5587841edbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:46.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.312+0000 7feb21ffb640 0 client.27512 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:48:46.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.312+0000 7feb42e71740 1 --2- 172.21.15.79:0/2455535486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587841e41a0 0x5587841ed6a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:46.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.312+0000 7feb42e71740 1 --2- 172.21.15.79:0/2455535486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587841e3880 0x5587841ed160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:46.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.312+0000 7feb42e71740 1 -- 172.21.15.79:0/2455535486 >> 172.21.15.79:0/2455535486 conn(0x5587841e16b0 msgr2=0x5587841e7250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:46.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.312+0000 7feb42e71740 1 -- 172.21.15.79:0/2455535486 shutdown_connections 2024-08-20T01:48:46.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.312+0000 7feb42e71740 1 -- 172.21.15.79:0/2455535486 wait complete. 2024-08-20T01:48:46.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.312+0000 7feb42e71740 20 client.27512 trim_cache size 0 max 16384 2024-08-20T01:48:46.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.335+0000 7feb42e71740 1 Processor -- start 2024-08-20T01:48:46.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.335+0000 7feb42e71740 1 -- start start 2024-08-20T01:48:46.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.336+0000 7feb42e71740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587841e3880 0x5587841ed660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:46.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.336+0000 7feb42e71740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587841e41a0 0x5587841edba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:46.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.336+0000 7feb42e71740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587841f0130 0x558784207df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:46.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.336+0000 7feb42e71740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7feb3c1b4720 con 0x5587841e3880 2024-08-20T01:48:46.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.336+0000 7feb42e71740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7feb3c1b6350 con 0x5587841e41a0 2024-08-20T01:48:46.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.336+0000 7feb42e71740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7feb3c1b4eb0 con 0x5587841f0130 2024-08-20T01:48:46.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.336+0000 7feb3a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587841e3880 0x5587841ed660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:46.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.336+0000 7feb3a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587841e3880 0x5587841ed660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38312/0 (socket says 172.21.15.79:38312) 2024-08-20T01:48:46.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.336+0000 7feb3a59c640 1 -- 172.21.15.79:0/3278639680 learned_addr learned my addr 172.21.15.79:0/3278639680 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:46.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.336+0000 7feb3ad9d640 1 --2- 172.21.15.79:0/3278639680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587841f0130 0x558784207df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:46.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.336+0000 7feb39d9b640 1 --2- 172.21.15.79:0/3278639680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587841e41a0 0x5587841edba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:46.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.336+0000 7feb3a59c640 1 -- 172.21.15.79:0/3278639680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587841f0130 msgr2=0x558784207df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:46.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.337+0000 7feb3a59c640 1 --2- 172.21.15.79:0/3278639680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587841f0130 0x558784207df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:46.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.337+0000 7feb3a59c640 1 -- 172.21.15.79:0/3278639680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587841e41a0 msgr2=0x5587841edba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:46.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.337+0000 7feb3a59c640 1 --2- 172.21.15.79:0/3278639680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587841e41a0 0x5587841edba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:46.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.337+0000 7feb3a59c640 1 -- 172.21.15.79:0/3278639680 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587842028d0 con 0x5587841e3880 2024-08-20T01:48:46.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.337+0000 7feb3ad9d640 1 --2- 172.21.15.79:0/3278639680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587841f0130 0x558784207df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:48:46.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.337+0000 7feb39d9b640 1 --2- 172.21.15.79:0/3278639680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587841e41a0 0x5587841edba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:48:46.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.337+0000 7feb3a59c640 1 --2- 172.21.15.79:0/3278639680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587841e3880 0x5587841ed660 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7feb2c00b230 tx=0x7feb2c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67524f4cfc61057c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:46.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.337+0000 7feb23fff640 1 -- 172.21.15.79:0/3278639680 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2c063070 con 0x5587841e3880 2024-08-20T01:48:46.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.337+0000 7feb23fff640 1 -- 172.21.15.79:0/3278639680 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feb2c04f040 con 0x5587841e3880 2024-08-20T01:48:46.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.337+0000 7feb23fff640 1 -- 172.21.15.79:0/3278639680 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2c035040 con 0x5587841e3880 2024-08-20T01:48:46.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.338+0000 7feb42e71740 1 -- 172.21.15.79:0/3278639680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587841e3880 msgr2=0x5587841ed660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:46.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.338+0000 7feb42e71740 1 --2- 172.21.15.79:0/3278639680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587841e3880 0x5587841ed660 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7feb2c00b230 tx=0x7feb2c000bc0 comp rx=0 tx=0).stop 2024-08-20T01:48:46.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.339+0000 7feb42e71740 1 -- 172.21.15.79:0/3278639680 shutdown_connections 2024-08-20T01:48:46.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.339+0000 7feb42e71740 1 --2- 172.21.15.79:0/3278639680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587841f0130 0x558784207df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:46.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.339+0000 7feb42e71740 1 --2- 172.21.15.79:0/3278639680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587841e41a0 0x5587841edba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:46.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.339+0000 7feb42e71740 1 --2- 172.21.15.79:0/3278639680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587841e3880 0x5587841ed660 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:46.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.339+0000 7feb42e71740 1 -- 172.21.15.79:0/3278639680 >> 172.21.15.79:0/3278639680 conn(0x5587841e16b0 msgr2=0x5587841e2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:46.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.339+0000 7feb42e71740 1 -- 172.21.15.79:0/3278639680 shutdown_connections 2024-08-20T01:48:46.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.339+0000 7feb42e71740 1 -- 172.21.15.79:0/3278639680 wait complete. 2024-08-20T01:48:46.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.340+0000 7feb42e71740 1 -- start start 2024-08-20T01:48:46.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.340+0000 7feb42e71740 1 Processor -- start 2024-08-20T01:48:46.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.341+0000 7feb42e71740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587841e3880 0x5587841f8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:46.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.341+0000 7feb42e71740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587841e41a0 0x5587841f3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:46.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.341+0000 7feb42e71740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587841f0130 0x5587841f45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:46.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.341+0000 7feb42e71740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7feb3c1b5c80 con 0x5587841e3880 2024-08-20T01:48:46.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.341+0000 7feb42e71740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7feb3c1b5580 con 0x5587841f0130 2024-08-20T01:48:46.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.341+0000 7feb42e71740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7feb3c1b2700 con 0x5587841e41a0 2024-08-20T01:48:46.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.341+0000 7feb42e71740 10 client.0 _ll_register_callbacks cb 0x7feb300093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:48:46.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.341+0000 7feb39d9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587841e41a0 0x5587841f3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:46.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.341+0000 7feb39d9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587841e41a0 0x5587841f3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:37444/0 (socket says 172.21.15.79:37444) 2024-08-20T01:48:46.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.341+0000 7feb39d9b640 1 -- 172.21.15.79:0/1504434212 learned_addr learned my addr 172.21.15.79:0/1504434212 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:46.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.341+0000 7feb3a59c640 1 --2- 172.21.15.79:0/1504434212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587841e3880 0x5587841f8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:46.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.342+0000 7feb3ad9d640 1 --2- 172.21.15.79:0/1504434212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587841f0130 0x5587841f45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:46.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.342+0000 7feb3ad9d640 1 -- 172.21.15.79:0/1504434212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587841e41a0 msgr2=0x5587841f3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:46.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.342+0000 7feb3ad9d640 1 --2- 172.21.15.79:0/1504434212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587841e41a0 0x5587841f3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:46.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.342+0000 7feb3ad9d640 1 -- 172.21.15.79:0/1504434212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587841e3880 msgr2=0x5587841f8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:46.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.342+0000 7feb3ad9d640 1 --2- 172.21.15.79:0/1504434212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587841e3880 0x5587841f8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:46.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.342+0000 7feb3ad9d640 1 -- 172.21.15.79:0/1504434212 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558784269dc0 con 0x5587841f0130 2024-08-20T01:48:46.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.342+0000 7feb3ad9d640 1 --2- 172.21.15.79:0/1504434212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587841f0130 0x5587841f45b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x5587841e3830 tx=0x7feb340ab8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d190d47fb0b7760 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:46.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.342+0000 7feb21ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:48:46.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.343+0000 7feb21ffb640 1 -- 172.21.15.79:0/1504434212 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb340b42a0 con 0x5587841f0130 2024-08-20T01:48:46.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.343+0000 7feb21ffb640 1 -- 172.21.15.79:0/1504434212 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7feb34004d30 con 0x5587841f0130 2024-08-20T01:48:46.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.343+0000 7feb42e71740 1 -- 172.21.15.79:0/1504434212 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb2c04f040 con 0x5587841f0130 2024-08-20T01:48:46.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.343+0000 7feb21ffb640 1 -- 172.21.15.79:0/1504434212 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7feb340a7480 con 0x5587841f0130 2024-08-20T01:48:46.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.343+0000 7feb42e71740 10 client.27515 fetch_fsmap learned FSMap version 48 2024-08-20T01:48:46.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.343+0000 7feb42e71740 1 -- 172.21.15.79:0/1504434212 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55878426b040 con 0x5587841f0130 2024-08-20T01:48:46.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.344+0000 7feb21ffb640 1 -- 172.21.15.79:0/1504434212 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feb2c04f040 con 0x5587841f0130 2024-08-20T01:48:46.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.344+0000 7feb21ffb640 1 -- 172.21.15.79:0/1504434212 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 48) ==== 8382+0+0 (secure 0 0 0) 0x7feb340b3e10 con 0x5587841f0130 2024-08-20T01:48:46.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.344+0000 7feb42e71740 10 client.27515 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T01:48:46.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.344+0000 7feb42e71740 10 client.27515 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:48:46.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.344+0000 7feb42e71740 20 client.27515 populate_metadata read hostname 'smithi079' 2024-08-20T01:48:46.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.344+0000 7feb42e71740 1 --2- 172.21.15.79:0/1504434212 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x558784200140 0x55878426d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:46.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.344+0000 7feb42e71740 4 client.27515 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:48:46.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.344+0000 7feb42e71740 1 -- 172.21.15.79:0/1504434212 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55878415c880 con 0x558784200140 2024-08-20T01:48:46.350 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.344+0000 7feb3a59c640 1 --2- 172.21.15.79:0/1504434212 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x558784200140 0x55878426d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:46.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.345+0000 7feb3a59c640 1 --2- 172.21.15.79:0/1504434212 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x558784200140 0x55878426d7b0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=15b62afcfea83c0e server_cookie=73a874ee228955ad in_seq=0 out_seq=0 2024-08-20T01:48:46.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.345+0000 7feb21ffb640 10 client.27515 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:48:46.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.345+0000 7feb21ffb640 1 -- 172.21.15.79:0/1504434212 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55878415c880 con 0x558784200140 2024-08-20T01:48:46.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.345+0000 7feb21ffb640 10 client.27515 handle_command_reply: tid=0 2024-08-20T01:48:46.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.346+0000 7feb42e71740 1 client.27515 shutdown 2024-08-20T01:48:46.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.346+0000 7feb42e71740 1 -- 172.21.15.79:0/1504434212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587841f0130 msgr2=0x5587841f45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:46.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.346+0000 7feb42e71740 1 --2- 172.21.15.79:0/1504434212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587841f0130 0x5587841f45b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x5587841e3830 tx=0x7feb340ab8f0 comp rx=0 tx=0).stop 2024-08-20T01:48:46.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.346+0000 7feb42e71740 1 -- 172.21.15.79:0/1504434212 shutdown_connections 2024-08-20T01:48:46.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.346+0000 7feb42e71740 1 --2- 172.21.15.79:0/1504434212 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x558784200140 0x55878426d7b0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:46.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.346+0000 7feb21ffb640 0 client.27515 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:48:46.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.346+0000 7feb42e71740 1 --2- 172.21.15.79:0/1504434212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587841f0130 0x5587841f45b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:46.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.346+0000 7feb42e71740 1 --2- 172.21.15.79:0/1504434212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5587841e41a0 0x5587841f3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:46.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.346+0000 7feb42e71740 1 --2- 172.21.15.79:0/1504434212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587841e3880 0x5587841f8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:46.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.346+0000 7feb42e71740 1 -- 172.21.15.79:0/1504434212 >> 172.21.15.79:0/1504434212 conn(0x5587841e16b0 msgr2=0x5587841e6910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:46.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.346+0000 7feb42e71740 1 -- 172.21.15.79:0/1504434212 shutdown_connections 2024-08-20T01:48:46.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.346+0000 7feb42e71740 1 -- 172.21.15.79:0/1504434212 wait complete. 2024-08-20T01:48:46.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.346+0000 7feb42e71740 20 client.27515 trim_cache size 0 max 16384 2024-08-20T01:48:46.352 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:48:46.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.347+0000 7feb40a78640 1 -- 172.21.15.79:0/326987390 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7feb240b3c90 msgr2=0x7feb240b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:46.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.347+0000 7feb40a78640 1 --2- 172.21.15.79:0/326987390 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7feb240b3c90 0x7feb240b6150 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7feb2c0096c0 tx=0x7feb2c00b040 comp rx=0 tx=0).stop 2024-08-20T01:48:46.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.347+0000 7feb40a78640 1 -- 172.21.15.79:0/326987390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb3c113440 msgr2=0x7feb3c1a4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:46.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.347+0000 7feb40a78640 1 --2- 172.21.15.79:0/326987390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb3c113440 0x7feb3c1a4c30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7feb34005fd0 tx=0x7feb3400ee60 comp rx=0 tx=0).stop 2024-08-20T01:48:46.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.347+0000 7feb40a78640 1 -- 172.21.15.79:0/326987390 shutdown_connections 2024-08-20T01:48:46.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.347+0000 7feb40a78640 1 --2- 172.21.15.79:0/326987390 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7feb240b3c90 0x7feb240b6150 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:46.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.348+0000 7feb40a78640 1 --2- 172.21.15.79:0/326987390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb3c113440 0x7feb3c1a4c30 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:46.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.348+0000 7feb40a78640 1 --2- 172.21.15.79:0/326987390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb3c10a840 0x7feb3c19f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:46.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.348+0000 7feb40a78640 1 --2- 172.21.15.79:0/326987390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb3c109f20 0x7feb3c19f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:46.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.348+0000 7feb40a78640 1 -- 172.21.15.79:0/326987390 >> 172.21.15.79:0/326987390 conn(0x7feb3c0785d0 msgr2=0x7feb3c07a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:46.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.348+0000 7feb40a78640 1 -- 172.21.15.79:0/326987390 shutdown_connections 2024-08-20T01:48:46.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:46.348+0000 7feb40a78640 1 -- 172.21.15.79:0/326987390 wait complete. 2024-08-20T01:48:48.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:47 smithi175 ceph-mon[22392]: pgmap v691: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 6.29k op/s 2024-08-20T01:48:48.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:47 smithi079 ceph-mon[18656]: pgmap v691: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 6.29k op/s 2024-08-20T01:48:48.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:47 smithi081 ceph-mon[22209]: pgmap v691: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 6.29k op/s 2024-08-20T01:48:49.849 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:49 smithi079 ceph-mon[18656]: pgmap v692: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 6.54k op/s 2024-08-20T01:48:50.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:49 smithi175 ceph-mon[22392]: pgmap v692: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 6.54k op/s 2024-08-20T01:48:50.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:49 smithi081 ceph-mon[22209]: pgmap v692: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 6.54k op/s 2024-08-20T01:48:50.730 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T01:48:51.192 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:48:51.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.861+0000 7f93c4e21640 1 -- 172.21.15.79:0/103302943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93b8095220 msgr2=0x7f93b80a1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:51.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.861+0000 7f93c4e21640 1 --2- 172.21.15.79:0/103302943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93b8095220 0x7f93b80a1260 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f93b4009890 tx=0x7f93b402a3f0 comp rx=0 tx=0).stop 2024-08-20T01:48:51.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.861+0000 7f93c4e21640 1 -- 172.21.15.79:0/103302943 shutdown_connections 2024-08-20T01:48:51.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.861+0000 7f93c4e21640 1 --2- 172.21.15.79:0/103302943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93b8095220 0x7f93b80a1260 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:51.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.861+0000 7f93c4e21640 1 --2- 172.21.15.79:0/103302943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93b80948a0 0x7f93b8094ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:51.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.861+0000 7f93c4e21640 1 --2- 172.21.15.79:0/103302943 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93b8097270 0x7f93b8097650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:51.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.861+0000 7f93c4e21640 1 -- 172.21.15.79:0/103302943 >> 172.21.15.79:0/103302943 conn(0x7f93b800a150 msgr2=0x7f93b800c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:51.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.861+0000 7f93c4e21640 1 -- 172.21.15.79:0/103302943 shutdown_connections 2024-08-20T01:48:51.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.861+0000 7f93c4e21640 1 -- 172.21.15.79:0/103302943 wait complete. 2024-08-20T01:48:51.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.862+0000 7f93c4e21640 1 Processor -- start 2024-08-20T01:48:51.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.863+0000 7f93c4e21640 1 -- start start 2024-08-20T01:48:51.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.863+0000 7f93c4e21640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93b80948a0 0x7f93b80a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:51.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.863+0000 7f93c4e21640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93b8095220 0x7f93b80a1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:51.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.863+0000 7f93c4e21640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93b8097270 0x7f93b80a21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:51.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.863+0000 7f93c4e21640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f93b80a56d0 con 0x7f93b8097270 2024-08-20T01:48:51.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.863+0000 7f93c4e21640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f93b80a5550 con 0x7f93b8095220 2024-08-20T01:48:51.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.863+0000 7f93c4e21640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f93b80a5850 con 0x7f93b80948a0 2024-08-20T01:48:51.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.863+0000 7f93be59c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93b80948a0 0x7f93b80a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:51.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.863+0000 7f93bed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93b8097270 0x7f93b80a21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:51.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.863+0000 7f93be59c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93b80948a0 0x7f93b80a3670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:53766/0 (socket says 172.21.15.79:53766) 2024-08-20T01:48:51.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.863+0000 7f93be59c640 1 -- 172.21.15.79:0/2186137299 learned_addr learned my addr 172.21.15.79:0/2186137299 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:51.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.863+0000 7f93bdd9b640 1 --2- 172.21.15.79:0/2186137299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93b8095220 0x7f93b80a1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:51.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.863+0000 7f93bed9d640 1 -- 172.21.15.79:0/2186137299 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93b80948a0 msgr2=0x7f93b80a3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:51.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.863+0000 7f93bed9d640 1 --2- 172.21.15.79:0/2186137299 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93b80948a0 0x7f93b80a3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:51.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.863+0000 7f93bed9d640 1 -- 172.21.15.79:0/2186137299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93b8095220 msgr2=0x7f93b80a1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:51.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.863+0000 7f93bed9d640 1 --2- 172.21.15.79:0/2186137299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93b8095220 0x7f93b80a1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:51.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.863+0000 7f93bed9d640 1 -- 172.21.15.79:0/2186137299 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93b8140d50 con 0x7f93b8097270 2024-08-20T01:48:51.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.864+0000 7f93bed9d640 1 --2- 172.21.15.79:0/2186137299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93b8097270 0x7f93b80a21f0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f93b402a910 tx=0x7f93b4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:51.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.866+0000 7f93af7fe640 1 -- 172.21.15.79:0/2186137299 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b403f020 con 0x7f93b8097270 2024-08-20T01:48:51.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.866+0000 7f93af7fe640 1 -- 172.21.15.79:0/2186137299 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f93b40043b0 con 0x7f93b8097270 2024-08-20T01:48:51.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.866+0000 7f93af7fe640 1 -- 172.21.15.79:0/2186137299 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b4037040 con 0x7f93b8097270 2024-08-20T01:48:51.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.867+0000 7f93c4e21640 1 -- 172.21.15.79:0/2186137299 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93b8140fe0 con 0x7f93b8097270 2024-08-20T01:48:51.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.867+0000 7f93c4e21640 1 -- 172.21.15.79:0/2186137299 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93b8141440 con 0x7f93b8097270 2024-08-20T01:48:51.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.871+0000 7f93af7fe640 1 -- 172.21.15.79:0/2186137299 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f93b4042020 con 0x7f93b8097270 2024-08-20T01:48:51.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.872+0000 7f93c721a740 1 Processor -- start 2024-08-20T01:48:51.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.872+0000 7f93c721a740 1 -- start start 2024-08-20T01:48:51.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.872+0000 7f93c721a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d155e82a30 0x55d155e82e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:51.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.872+0000 7f93c721a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d155e83350 0x55d155e8eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:51.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.873+0000 7f93c721a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d155e8f2e0 0x55d155e916d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:51.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.873+0000 7f93c721a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d155df9930 con 0x55d155e82a30 2024-08-20T01:48:51.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.873+0000 7f93c721a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d155de8e30 con 0x55d155e8f2e0 2024-08-20T01:48:51.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.873+0000 7f93c721a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d155dece70 con 0x55d155e83350 2024-08-20T01:48:51.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.873+0000 7f93be59c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d155e83350 0x55d155e8eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:51.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.873+0000 7f93be59c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d155e83350 0x55d155e8eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:53778/0 (socket says 172.21.15.79:53778) 2024-08-20T01:48:51.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.873+0000 7f93be59c640 1 -- 172.21.15.79:0/734946286 learned_addr learned my addr 172.21.15.79:0/734946286 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:51.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.873+0000 7f93bdd9b640 1 --2- 172.21.15.79:0/734946286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d155e8f2e0 0x55d155e916d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:51.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.874+0000 7f93bdd9b640 1 --2- 172.21.15.79:0/734946286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d155e82a30 0x55d155e82e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:51.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.874+0000 7f93bdd9b640 1 -- 172.21.15.79:0/734946286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d155e83350 msgr2=0x55d155e8eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:51.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.874+0000 7f93bdd9b640 1 --2- 172.21.15.79:0/734946286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d155e83350 0x55d155e8eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:51.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.874+0000 7f93bdd9b640 1 -- 172.21.15.79:0/734946286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d155e82a30 msgr2=0x55d155e82e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:51.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.874+0000 7f93bdd9b640 1 --2- 172.21.15.79:0/734946286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d155e82a30 0x55d155e82e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:51.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.874+0000 7f93bdd9b640 1 -- 172.21.15.79:0/734946286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d155b48650 con 0x55d155e8f2e0 2024-08-20T01:48:51.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.874+0000 7f93bdd9b640 1 --2- 172.21.15.79:0/734946286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d155e8f2e0 0x55d155e916d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f93c00697d0 tx=0x7f93c00686b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4ec646e43bc5a37 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:51.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.875+0000 7f93acff9640 1 -- 172.21.15.79:0/734946286 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c0069d30 con 0x55d155e8f2e0 2024-08-20T01:48:51.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.875+0000 7f93acff9640 1 -- 172.21.15.79:0/734946286 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f93c007cc10 con 0x55d155e8f2e0 2024-08-20T01:48:51.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.875+0000 7f93af7fe640 1 --2- 172.21.15.79:0/2186137299 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f93a80b3c50 0x7f93a80b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:51.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.876+0000 7f93be59c640 1 --2- 172.21.15.79:0/2186137299 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f93a80b3c50 0x7f93a80b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:51.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.876+0000 7f93c721a740 1 -- 172.21.15.79:0/734946286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d155e8f2e0 msgr2=0x55d155e916d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:51.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.876+0000 7f93c721a740 1 --2- 172.21.15.79:0/734946286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d155e8f2e0 0x55d155e916d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f93c00697d0 tx=0x7f93c00686b0 comp rx=0 tx=0).stop 2024-08-20T01:48:51.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.876+0000 7f93c721a740 1 -- 172.21.15.79:0/734946286 shutdown_connections 2024-08-20T01:48:51.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.876+0000 7f93c721a740 1 --2- 172.21.15.79:0/734946286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d155e8f2e0 0x55d155e916d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:51.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.876+0000 7f93c721a740 1 --2- 172.21.15.79:0/734946286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d155e83350 0x55d155e8eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:51.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.876+0000 7f93c721a740 1 --2- 172.21.15.79:0/734946286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d155e82a30 0x55d155e82e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:51.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.876+0000 7f93af7fe640 1 -- 172.21.15.79:0/2186137299 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f93b41035a0 con 0x7f93b8097270 2024-08-20T01:48:51.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.876+0000 7f93c721a740 1 -- 172.21.15.79:0/734946286 >> 172.21.15.79:0/734946286 conn(0x55d155e80860 msgr2=0x55d155e81a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:51.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.876+0000 7f93be59c640 1 --2- 172.21.15.79:0/2186137299 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f93a80b3c50 0x7f93a80b6110 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x55d155e85bb0 tx=0x7f93b0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:51.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.877+0000 7f93c721a740 1 -- 172.21.15.79:0/734946286 shutdown_connections 2024-08-20T01:48:51.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.877+0000 7f93c721a740 1 -- 172.21.15.79:0/734946286 wait complete. 2024-08-20T01:48:51.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.878+0000 7f93c721a740 1 -- start start 2024-08-20T01:48:51.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.878+0000 7f93c721a740 1 Processor -- start 2024-08-20T01:48:51.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.879+0000 7f93c721a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d155e82a30 0x55d155e8c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.879+0000 7f93c721a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d155e83350 0x55d155e8c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.879+0000 7f93be59c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d155e82a30 0x55d155e8c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.879+0000 7f93be59c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d155e82a30 0x55d155e8c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:53784/0 (socket says 172.21.15.79:53784) 2024-08-20T01:48:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.880+0000 7f93bdd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d155e83350 0x55d155e8c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.880+0000 7f93bdd9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d155e83350 0x55d155e8c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48946/0 (socket says 172.21.15.79:48946) 2024-08-20T01:48:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.880+0000 7f93be59c640 1 -- 172.21.15.79:0/3689081402 learned_addr learned my addr 172.21.15.79:0/3689081402 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.880+0000 7f93c721a740 1 --2- 172.21.15.79:0/3689081402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d155e8f2e0 0x55d155e8cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.880+0000 7f93c721a740 1 -- 172.21.15.79:0/3689081402 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d155c4b700 con 0x55d155e83350 2024-08-20T01:48:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.881+0000 7f93bed9d640 1 --2- 172.21.15.79:0/3689081402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d155e8f2e0 0x55d155e8cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.881+0000 7f93c721a740 1 -- 172.21.15.79:0/3689081402 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d155d6f810 con 0x55d155e8f2e0 2024-08-20T01:48:51.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.881+0000 7f93c721a740 1 -- 172.21.15.79:0/3689081402 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d155e91f90 con 0x55d155e82a30 2024-08-20T01:48:51.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.882+0000 7f93be59c640 1 -- 172.21.15.79:0/3689081402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d155e8f2e0 msgr2=0x55d155e8cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:51.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.882+0000 7f93be59c640 1 --2- 172.21.15.79:0/3689081402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d155e8f2e0 0x55d155e8cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:51.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.882+0000 7f93be59c640 1 -- 172.21.15.79:0/3689081402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d155e83350 msgr2=0x55d155e8c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:51.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.882+0000 7f93be59c640 1 --2- 172.21.15.79:0/3689081402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d155e83350 0x55d155e8c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:51.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.882+0000 7f93be59c640 1 -- 172.21.15.79:0/3689081402 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d155e9b3c0 con 0x55d155e82a30 2024-08-20T01:48:51.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.883+0000 7f93be59c640 1 --2- 172.21.15.79:0/3689081402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d155e82a30 0x55d155e8c260 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f93b0004600 tx=0x7f93b0004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27c2a12616b9b311 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:51.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.883+0000 7f93c721a740 10 client.0 _ll_register_callbacks cb 0x55d155de2700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:48:51.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.883+0000 7f93c721a740 1 -- 172.21.15.79:0/3689081402 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d155d98150 con 0x55d155e82a30 2024-08-20T01:48:51.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.883+0000 7f93a5ffb640 10 client.27496 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:48:51.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.884+0000 7f93a5ffb640 1 -- 172.21.15.79:0/3689081402 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b002d060 con 0x55d155e82a30 2024-08-20T01:48:51.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.884+0000 7f93a5ffb640 1 -- 172.21.15.79:0/3689081402 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f93b0018030 con 0x55d155e82a30 2024-08-20T01:48:51.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.884+0000 7f93a5ffb640 1 -- 172.21.15.79:0/3689081402 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f93b0011b20 con 0x55d155e82a30 2024-08-20T01:48:51.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.884+0000 7f93c721a740 10 client.27496 fetch_fsmap learned FSMap version 49 2024-08-20T01:48:51.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.884+0000 7f93c721a740 1 -- 172.21.15.79:0/3689081402 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({fsmap=49}) -- 0x55d155e9dd30 con 0x55d155e82a30 2024-08-20T01:48:51.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.888+0000 7f93a5ffb640 1 -- 172.21.15.79:0/3689081402 <== mon.1 v2:172.21.15.175:3300/0 4 ==== fsmap(e 49) ==== 8378+0+0 (secure 0 0 0) 0x7f93b0011cc0 con 0x55d155e82a30 2024-08-20T01:48:51.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.889+0000 7f93c721a740 10 client.27496 fetch_fsmap finished waiting for FSMap version 49 2024-08-20T01:48:51.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.889+0000 7f93c721a740 10 client.27496 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:48:51.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.889+0000 7f93c721a740 20 client.27496 populate_metadata read hostname 'smithi079' 2024-08-20T01:48:51.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.889+0000 7f93c721a740 1 --2- 172.21.15.79:0/3689081402 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55d155e9f650 0x55d155ea1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:51.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.889+0000 7f93c721a740 4 client.27496 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:48:51.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.889+0000 7f93c721a740 1 -- 172.21.15.79:0/3689081402 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d155d98150 con 0x55d155e9f650 2024-08-20T01:48:51.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.889+0000 7f93bdd9b640 1 --2- 172.21.15.79:0/3689081402 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55d155e9f650 0x55d155ea1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:51.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.890+0000 7f93bdd9b640 1 --2- 172.21.15.79:0/3689081402 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55d155e9f650 0x55d155ea1af0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ae8460ba2fc5e3f7 server_cookie=1c7476715246b026 in_seq=0 out_seq=0 2024-08-20T01:48:51.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.890+0000 7f93a5ffb640 10 client.27496 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:48:51.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.890+0000 7f93a5ffb640 1 -- 172.21.15.79:0/3689081402 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d155d98150 con 0x55d155e9f650 2024-08-20T01:48:51.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.890+0000 7f93a5ffb640 10 client.27496 handle_command_reply: tid=0 2024-08-20T01:48:51.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.891+0000 7f93c721a740 1 client.27496 shutdown 2024-08-20T01:48:51.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.891+0000 7f93c721a740 1 -- 172.21.15.79:0/3689081402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d155e82a30 msgr2=0x55d155e8c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:51.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.891+0000 7f93c721a740 1 --2- 172.21.15.79:0/3689081402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d155e82a30 0x55d155e8c260 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f93b0004600 tx=0x7f93b0004730 comp rx=0 tx=0).stop 2024-08-20T01:48:51.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.891+0000 7f93c721a740 1 -- 172.21.15.79:0/3689081402 shutdown_connections 2024-08-20T01:48:51.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.891+0000 7f93c721a740 1 --2- 172.21.15.79:0/3689081402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d155e8f2e0 0x55d155e8cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:51.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.891+0000 7f93c721a740 1 --2- 172.21.15.79:0/3689081402 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55d155e9f650 0x55d155ea1af0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:51.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.891+0000 7f93c721a740 1 --2- 172.21.15.79:0/3689081402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d155e83350 0x55d155e8c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:51.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.891+0000 7f93c721a740 1 --2- 172.21.15.79:0/3689081402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d155e82a30 0x55d155e8c260 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:51.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.891+0000 7f93c721a740 1 -- 172.21.15.79:0/3689081402 >> 172.21.15.79:0/3689081402 conn(0x55d155e80860 msgr2=0x55d155e86400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:51.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.891+0000 7f93a5ffb640 0 client.27496 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:48:51.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.891+0000 7f93c721a740 1 -- 172.21.15.79:0/3689081402 shutdown_connections 2024-08-20T01:48:51.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.892+0000 7f93c721a740 1 -- 172.21.15.79:0/3689081402 wait complete. 2024-08-20T01:48:51.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.892+0000 7f93c721a740 20 client.27496 trim_cache size 0 max 16384 2024-08-20T01:48:51.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.917+0000 7f93c721a740 1 Processor -- start 2024-08-20T01:48:51.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.922+0000 7f93c721a740 1 -- start start 2024-08-20T01:48:51.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.922+0000 7f93c721a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d155e82a30 0x55d155e86bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:51.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.922+0000 7f93c721a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d155e83350 0x55d155e8dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:51.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.923+0000 7f93c721a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d155e8f2e0 0x55d155ea7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:51.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.923+0000 7f93bdd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d155e83350 0x55d155e8dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:51.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.923+0000 7f93bdd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d155e83350 0x55d155e8dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:38546/0 (socket says 172.21.15.79:38546) 2024-08-20T01:48:51.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.923+0000 7f93bdd9b640 1 -- 172.21.15.79:0/2876540621 learned_addr learned my addr 172.21.15.79:0/2876540621 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:51.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.923+0000 7f93bed9d640 1 --2- 172.21.15.79:0/2876540621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d155e8f2e0 0x55d155ea7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:51.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.923+0000 7f93c721a740 1 -- 172.21.15.79:0/2876540621 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f93b8160b00 con 0x55d155e82a30 2024-08-20T01:48:51.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.923+0000 7f93c721a740 1 -- 172.21.15.79:0/2876540621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f93b8162700 con 0x55d155e83350 2024-08-20T01:48:51.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.923+0000 7f93c721a740 1 -- 172.21.15.79:0/2876540621 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f93b8161290 con 0x55d155e8f2e0 2024-08-20T01:48:51.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.924+0000 7f93bdd9b640 1 -- 172.21.15.79:0/2876540621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d155e8f2e0 msgr2=0x55d155ea7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:51.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.924+0000 7f93bdd9b640 1 --2- 172.21.15.79:0/2876540621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d155e8f2e0 0x55d155ea7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:51.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.924+0000 7f93bdd9b640 1 -- 172.21.15.79:0/2876540621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d155e82a30 msgr2=0x55d155e86bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:51.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.924+0000 7f93bdd9b640 1 --2- 172.21.15.79:0/2876540621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d155e82a30 0x55d155e86bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:51.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.924+0000 7f93bdd9b640 1 -- 172.21.15.79:0/2876540621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d155e812e0 con 0x55d155e83350 2024-08-20T01:48:51.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.924+0000 7f93bdd9b640 1 --2- 172.21.15.79:0/2876540621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d155e83350 0x55d155e8dfa0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f93c0068660 tx=0x7f93c0080040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8477ae1408aee134 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:51.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.925+0000 7f93a7fff640 1 -- 172.21.15.79:0/2876540621 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c00691a0 con 0x55d155e83350 2024-08-20T01:48:51.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.925+0000 7f93a7fff640 1 -- 172.21.15.79:0/2876540621 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f93c007cc10 con 0x55d155e83350 2024-08-20T01:48:51.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.925+0000 7f93a7fff640 1 -- 172.21.15.79:0/2876540621 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c0075510 con 0x55d155e83350 2024-08-20T01:48:51.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.926+0000 7f93c721a740 1 -- 172.21.15.79:0/2876540621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d155e83350 msgr2=0x55d155e8dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:51.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.926+0000 7f93c721a740 1 --2- 172.21.15.79:0/2876540621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d155e83350 0x55d155e8dfa0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f93c0068660 tx=0x7f93c0080040 comp rx=0 tx=0).stop 2024-08-20T01:48:51.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.926+0000 7f93c721a740 1 -- 172.21.15.79:0/2876540621 shutdown_connections 2024-08-20T01:48:51.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.926+0000 7f93c721a740 1 --2- 172.21.15.79:0/2876540621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d155e8f2e0 0x55d155ea7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:51.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.926+0000 7f93c721a740 1 --2- 172.21.15.79:0/2876540621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d155e83350 0x55d155e8dfa0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:51.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.926+0000 7f93c721a740 1 --2- 172.21.15.79:0/2876540621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d155e82a30 0x55d155e86bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:51.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.926+0000 7f93c721a740 1 -- 172.21.15.79:0/2876540621 >> 172.21.15.79:0/2876540621 conn(0x55d155e80860 msgr2=0x55d155e8d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:51.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.926+0000 7f93c721a740 1 -- 172.21.15.79:0/2876540621 shutdown_connections 2024-08-20T01:48:51.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.926+0000 7f93c721a740 1 -- 172.21.15.79:0/2876540621 wait complete. 2024-08-20T01:48:51.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.927+0000 7f93c721a740 1 -- start start 2024-08-20T01:48:51.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.927+0000 7f93c721a740 1 Processor -- start 2024-08-20T01:48:51.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.928+0000 7f93c721a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d155e82a30 0x55d155e975a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:51.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.928+0000 7f93c721a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d155e83350 0x55d155e97b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:51.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.928+0000 7f93c721a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d155e8f2e0 0x55d155e92c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:51.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.928+0000 7f93c721a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f93b8162030 con 0x55d155e82a30 2024-08-20T01:48:51.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.928+0000 7f93c721a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f93b8161960 con 0x55d155e8f2e0 2024-08-20T01:48:51.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.928+0000 7f93c721a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f93b80a2ec0 con 0x55d155e83350 2024-08-20T01:48:51.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.928+0000 7f93bed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d155e8f2e0 0x55d155e92c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:51.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.928+0000 7f93bed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d155e8f2e0 0x55d155e92c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:38550/0 (socket says 172.21.15.79:38550) 2024-08-20T01:48:51.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.928+0000 7f93bed9d640 1 -- 172.21.15.79:0/438460390 learned_addr learned my addr 172.21.15.79:0/438460390 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:51.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.928+0000 7f93c721a740 10 client.0 _ll_register_callbacks cb 0x7f93b0009b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:48:51.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.928+0000 7f93bed9d640 1 -- 172.21.15.79:0/438460390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d155e83350 msgr2=0x55d155e97b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:48:51.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.928+0000 7f93bed9d640 1 --2- 172.21.15.79:0/438460390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d155e83350 0x55d155e97b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:51.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.928+0000 7f93bed9d640 1 -- 172.21.15.79:0/438460390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d155e82a30 msgr2=0x55d155e975a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:48:51.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.929+0000 7f93bed9d640 1 --2- 172.21.15.79:0/438460390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d155e82a30 0x55d155e975a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:51.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.929+0000 7f93bed9d640 1 -- 172.21.15.79:0/438460390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d155e810e0 con 0x55d155e8f2e0 2024-08-20T01:48:51.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.929+0000 7f93bed9d640 1 --2- 172.21.15.79:0/438460390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d155e8f2e0 0x55d155e92c70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f93b4101420 tx=0x7f93b40caaa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78c84ab0e81fee4d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:51.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.929+0000 7f93a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:48:51.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.929+0000 7f93a5ffb640 1 -- 172.21.15.79:0/438460390 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b40ca010 con 0x55d155e8f2e0 2024-08-20T01:48:51.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.930+0000 7f93a5ffb640 1 -- 172.21.15.79:0/438460390 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f93b4039db0 con 0x55d155e8f2e0 2024-08-20T01:48:51.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.930+0000 7f93c721a740 1 -- 172.21.15.79:0/438460390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93c007cc10 con 0x55d155e8f2e0 2024-08-20T01:48:51.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.930+0000 7f93a5ffb640 1 -- 172.21.15.79:0/438460390 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f93b40cac00 con 0x55d155e8f2e0 2024-08-20T01:48:51.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.930+0000 7f93c721a740 10 client.27533 fetch_fsmap learned FSMap version 49 2024-08-20T01:48:51.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.930+0000 7f93c721a740 1 -- 172.21.15.79:0/438460390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55d155f09f00 con 0x55d155e8f2e0 2024-08-20T01:48:51.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.930+0000 7f93a5ffb640 1 -- 172.21.15.79:0/438460390 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f93c007cc10 con 0x55d155e8f2e0 2024-08-20T01:48:51.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.931+0000 7f93a5ffb640 1 -- 172.21.15.79:0/438460390 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 49) ==== 8378+0+0 (secure 0 0 0) 0x7f93b403a030 con 0x55d155e8f2e0 2024-08-20T01:48:51.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.931+0000 7f93c721a740 10 client.27533 fetch_fsmap finished waiting for FSMap version 49 2024-08-20T01:48:51.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.931+0000 7f93c721a740 10 client.27533 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:48:51.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.931+0000 7f93c721a740 20 client.27533 populate_metadata read hostname 'smithi079' 2024-08-20T01:48:51.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.931+0000 7f93c721a740 1 --2- 172.21.15.79:0/438460390 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55d155f0a680 0x55d155f0cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:51.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.931+0000 7f93c721a740 4 client.27533 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:48:51.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.931+0000 7f93c721a740 1 -- 172.21.15.79:0/438460390 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d155dfb880 con 0x55d155f0a680 2024-08-20T01:48:51.935 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.932+0000 7f93be59c640 1 --2- 172.21.15.79:0/438460390 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55d155f0a680 0x55d155f0cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:51.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.933+0000 7f93be59c640 1 --2- 172.21.15.79:0/438460390 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55d155f0a680 0x55d155f0cae0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e92cd4d8d7e41165 server_cookie=5f4b2c628372e5f7 in_seq=0 out_seq=0 2024-08-20T01:48:51.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.933+0000 7f93a5ffb640 10 client.27533 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:48:51.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.933+0000 7f93a5ffb640 1 -- 172.21.15.79:0/438460390 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d155dfb880 con 0x55d155f0a680 2024-08-20T01:48:51.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.933+0000 7f93a5ffb640 10 client.27533 handle_command_reply: tid=0 2024-08-20T01:48:51.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.933+0000 7f93c721a740 1 client.27533 shutdown 2024-08-20T01:48:51.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.933+0000 7f93c721a740 1 -- 172.21.15.79:0/438460390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d155e8f2e0 msgr2=0x55d155e92c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:51.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.933+0000 7f93c721a740 1 --2- 172.21.15.79:0/438460390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d155e8f2e0 0x55d155e92c70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f93b4101420 tx=0x7f93b40caaa0 comp rx=0 tx=0).stop 2024-08-20T01:48:51.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.934+0000 7f93c721a740 1 -- 172.21.15.79:0/438460390 shutdown_connections 2024-08-20T01:48:51.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.934+0000 7f93c721a740 1 --2- 172.21.15.79:0/438460390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d155e8f2e0 0x55d155e92c70 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:51.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.934+0000 7f93c721a740 1 --2- 172.21.15.79:0/438460390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d155e83350 0x55d155e97b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:51.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.934+0000 7f93c721a740 1 --2- 172.21.15.79:0/438460390 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55d155f0a680 0x55d155f0cae0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:51.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.934+0000 7f93c721a740 1 --2- 172.21.15.79:0/438460390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d155e82a30 0x55d155e975a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:51.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.934+0000 7f93a5ffb640 0 client.27533 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:48:51.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.934+0000 7f93c721a740 1 -- 172.21.15.79:0/438460390 >> 172.21.15.79:0/438460390 conn(0x55d155e80860 msgr2=0x55d155e8c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:51.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.934+0000 7f93c721a740 1 -- 172.21.15.79:0/438460390 shutdown_connections 2024-08-20T01:48:51.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.934+0000 7f93c721a740 1 -- 172.21.15.79:0/438460390 wait complete. 2024-08-20T01:48:51.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.935+0000 7f93c721a740 20 client.27533 trim_cache size 0 max 16384 2024-08-20T01:48:51.939 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:48:51.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.936+0000 7f93c4e21640 1 -- 172.21.15.79:0/2186137299 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f93a80b3c50 msgr2=0x7f93a80b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:51.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.936+0000 7f93c4e21640 1 --2- 172.21.15.79:0/2186137299 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f93a80b3c50 0x7f93a80b6110 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x55d155e85bb0 tx=0x7f93b0009260 comp rx=0 tx=0).stop 2024-08-20T01:48:51.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.936+0000 7f93c4e21640 1 -- 172.21.15.79:0/2186137299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93b8097270 msgr2=0x7f93b80a21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:51.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.936+0000 7f93c4e21640 1 --2- 172.21.15.79:0/2186137299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93b8097270 0x7f93b80a21f0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f93b402a910 tx=0x7f93b4004040 comp rx=0 tx=0).stop 2024-08-20T01:48:51.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.937+0000 7f93c4e21640 1 -- 172.21.15.79:0/2186137299 shutdown_connections 2024-08-20T01:48:51.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.937+0000 7f93c4e21640 1 --2- 172.21.15.79:0/2186137299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93b8097270 0x7f93b80a21f0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:51.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.937+0000 7f93c4e21640 1 --2- 172.21.15.79:0/2186137299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93b8095220 0x7f93b80a1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:51.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.937+0000 7f93c4e21640 1 --2- 172.21.15.79:0/2186137299 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f93a80b3c50 0x7f93a80b6110 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:51.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.937+0000 7f93c4e21640 1 --2- 172.21.15.79:0/2186137299 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93b80948a0 0x7f93b80a3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:51.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.937+0000 7f93c4e21640 1 -- 172.21.15.79:0/2186137299 >> 172.21.15.79:0/2186137299 conn(0x7f93b800a150 msgr2=0x7f93b80980a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:51.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.937+0000 7f93c4e21640 1 -- 172.21.15.79:0/2186137299 shutdown_connections 2024-08-20T01:48:51.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:51.938+0000 7f93c4e21640 1 -- 172.21.15.79:0/2186137299 wait complete. 2024-08-20T01:48:52.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:51 smithi175 ceph-mon[22392]: pgmap v693: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 6.08k op/s 2024-08-20T01:48:52.195 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:51 smithi079 ceph-mon[18656]: pgmap v693: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 6.08k op/s 2024-08-20T01:48:52.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:51 smithi081 ceph-mon[22209]: pgmap v693: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 6.08k op/s 2024-08-20T01:48:52.751 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T01:48:53.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:52 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:48:53.188 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:52 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:48:53.207 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:48:53.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:52 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:48:53.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.807+0000 7ff5a5d9b640 1 -- 172.21.15.79:0/1003765909 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff59c031800 con 0x7ff5a00a21a0 2024-08-20T01:48:53.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.807+0000 7ff5ad0ba640 1 -- 172.21.15.79:0/1003765909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5a00a21a0 msgr2=0x7ff5a00a89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:53.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.807+0000 7ff5ad0ba640 1 --2- 172.21.15.79:0/1003765909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5a00a21a0 0x7ff5a00a89a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff59c009900 tx=0x7ff59c02a410 comp rx=0 tx=0).stop 2024-08-20T01:48:53.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.807+0000 7ff5ad0ba640 1 -- 172.21.15.79:0/1003765909 shutdown_connections 2024-08-20T01:48:53.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.807+0000 7ff5ad0ba640 1 --2- 172.21.15.79:0/1003765909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5a00a21a0 0x7ff5a00a89a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:53.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.807+0000 7ff5ad0ba640 1 --2- 172.21.15.79:0/1003765909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5a00a1820 0x7ff5a00a1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:53.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.807+0000 7ff5ad0ba640 1 --2- 172.21.15.79:0/1003765909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5a009c020 0x7ff5a009c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:53.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.807+0000 7ff5ad0ba640 1 -- 172.21.15.79:0/1003765909 >> 172.21.15.79:0/1003765909 conn(0x7ff5a000a770 msgr2=0x7ff5a000ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:53.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.808+0000 7ff5ad0ba640 1 -- 172.21.15.79:0/1003765909 shutdown_connections 2024-08-20T01:48:53.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.808+0000 7ff5ad0ba640 1 -- 172.21.15.79:0/1003765909 wait complete. 2024-08-20T01:48:53.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.809+0000 7ff5ad0ba640 1 Processor -- start 2024-08-20T01:48:53.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.809+0000 7ff5ad0ba640 1 -- start start 2024-08-20T01:48:53.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.809+0000 7ff5ad0ba640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5a009c020 0x7ff5a00154c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:53.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.809+0000 7ff5ad0ba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5a00a1820 0x7ff5a0015a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:53.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.809+0000 7ff5ad0ba640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5a00a21a0 0x7ff5a000e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:53.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.809+0000 7ff5ad0ba640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a00abd70 con 0x7ff5a00a21a0 2024-08-20T01:48:53.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.809+0000 7ff5ad0ba640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a00abbf0 con 0x7ff5a00a1820 2024-08-20T01:48:53.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.809+0000 7ff5ad0ba640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a00abef0 con 0x7ff5a009c020 2024-08-20T01:48:53.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.810+0000 7ff5a759e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5a00a21a0 0x7ff5a000e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:53.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.810+0000 7ff5a759e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5a00a21a0 0x7ff5a000e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48976/0 (socket says 172.21.15.79:48976) 2024-08-20T01:48:53.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.810+0000 7ff5a759e640 1 -- 172.21.15.79:0/2744242523 learned_addr learned my addr 172.21.15.79:0/2744242523 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:53.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.810+0000 7ff5a6d9d640 1 --2- 172.21.15.79:0/2744242523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5a009c020 0x7ff5a00154c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:53.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.810+0000 7ff5a759e640 1 -- 172.21.15.79:0/2744242523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5a009c020 msgr2=0x7ff5a00154c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:53.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.811+0000 7ff5a659c640 1 --2- 172.21.15.79:0/2744242523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5a00a1820 0x7ff5a0015a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:53.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.811+0000 7ff5a759e640 1 --2- 172.21.15.79:0/2744242523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5a009c020 0x7ff5a00154c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:53.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.811+0000 7ff5a759e640 1 -- 172.21.15.79:0/2744242523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5a00a1820 msgr2=0x7ff5a0015a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:53.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.811+0000 7ff5a759e640 1 --2- 172.21.15.79:0/2744242523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5a00a1820 0x7ff5a0015a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:53.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.811+0000 7ff5a759e640 1 -- 172.21.15.79:0/2744242523 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5a000f210 con 0x7ff5a00a21a0 2024-08-20T01:48:53.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.811+0000 7ff5a659c640 1 --2- 172.21.15.79:0/2744242523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5a00a1820 0x7ff5a0015a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:48:53.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.811+0000 7ff5a6d9d640 1 --2- 172.21.15.79:0/2744242523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5a009c020 0x7ff5a00154c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:48:53.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.812+0000 7ff5a759e640 1 --2- 172.21.15.79:0/2744242523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5a00a21a0 0x7ff5a000e950 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7ff59c004770 tx=0x7ff59c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:53.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.813+0000 7ff58ffff640 1 -- 172.21.15.79:0/2744242523 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff59c03f070 con 0x7ff5a00a21a0 2024-08-20T01:48:53.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.813+0000 7ff58ffff640 1 -- 172.21.15.79:0/2744242523 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff59c004ee0 con 0x7ff5a00a21a0 2024-08-20T01:48:53.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.813+0000 7ff58ffff640 1 -- 172.21.15.79:0/2744242523 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff59c035030 con 0x7ff5a00a21a0 2024-08-20T01:48:53.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.814+0000 7ff5ad0ba640 1 -- 172.21.15.79:0/2744242523 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5a000f4a0 con 0x7ff5a00a21a0 2024-08-20T01:48:53.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.814+0000 7ff5ad0ba640 1 -- 172.21.15.79:0/2744242523 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5a0014360 con 0x7ff5a00a21a0 2024-08-20T01:48:53.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.818+0000 7ff58ffff640 1 -- 172.21.15.79:0/2744242523 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff59c042070 con 0x7ff5a00a21a0 2024-08-20T01:48:53.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.820+0000 7ff58ffff640 1 --2- 172.21.15.79:0/2744242523 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff5900b3c50 0x7ff5900b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:53.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.820+0000 7ff5af4b3740 1 Processor -- start 2024-08-20T01:48:53.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.821+0000 7ff5af4b3740 1 -- start start 2024-08-20T01:48:53.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.821+0000 7ff5af4b3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d240795a30 0x55d240795e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:53.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.821+0000 7ff5af4b3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d240796350 0x55d2407a1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:53.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.821+0000 7ff5af4b3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2407a22e0 0x55d2407a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:53.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.821+0000 7ff5af4b3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d24070c930 con 0x55d2407a22e0 2024-08-20T01:48:53.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.821+0000 7ff5af4b3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d2406fbe30 con 0x55d240795a30 2024-08-20T01:48:53.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.821+0000 7ff5af4b3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d2406ffe70 con 0x55d240796350 2024-08-20T01:48:53.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.821+0000 7ff58ffff640 1 -- 172.21.15.79:0/2744242523 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff59c103ff0 con 0x7ff5a00a21a0 2024-08-20T01:48:53.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.821+0000 7ff5a6d9d640 1 --2- 172.21.15.79:0/2744242523 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff5900b3c50 0x7ff5900b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:53.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.821+0000 7ff5a659c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d240796350 0x55d2407a1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:53.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.821+0000 7ff5a659c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d240796350 0x55d2407a1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:53816/0 (socket says 172.21.15.79:53816) 2024-08-20T01:48:53.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.821+0000 7ff5a659c640 1 -- 172.21.15.79:0/313287945 learned_addr learned my addr 172.21.15.79:0/313287945 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:53.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.821+0000 7ff5a6d9d640 1 --2- 172.21.15.79:0/313287945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d240795a30 0x55d240795e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:53.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.821+0000 7ff5a759e640 1 --2- 172.21.15.79:0/313287945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2407a22e0 0x55d2407a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:53.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.822+0000 7ff5a6d9d640 1 --2- 172.21.15.79:0/2744242523 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff5900b3c50 0x7ff5900b6110 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff598014410 tx=0x7ff598014810 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:53.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.822+0000 7ff5a6d9d640 1 -- 172.21.15.79:0/313287945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d240796350 msgr2=0x55d2407a1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:53.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.822+0000 7ff5a6d9d640 1 --2- 172.21.15.79:0/313287945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d240796350 0x55d2407a1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:53.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.822+0000 7ff5a6d9d640 1 -- 172.21.15.79:0/313287945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2407a22e0 msgr2=0x55d2407a46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:53.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.822+0000 7ff5a6d9d640 1 --2- 172.21.15.79:0/313287945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2407a22e0 0x55d2407a46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:53.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.822+0000 7ff5a6d9d640 1 -- 172.21.15.79:0/313287945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d24045b650 con 0x55d240795a30 2024-08-20T01:48:53.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.822+0000 7ff5a659c640 1 --2- 172.21.15.79:0/313287945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d240796350 0x55d2407a1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:48:53.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.822+0000 7ff5a6d9d640 1 --2- 172.21.15.79:0/313287945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d240795a30 0x55d240795e10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff598010790 tx=0x7ff59801e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7077dc31d88e27b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:53.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.822+0000 7ff58d7fa640 1 -- 172.21.15.79:0/313287945 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff598014030 con 0x55d240795a30 2024-08-20T01:48:53.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.822+0000 7ff58d7fa640 1 -- 172.21.15.79:0/313287945 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff5980044b0 con 0x55d240795a30 2024-08-20T01:48:53.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.822+0000 7ff58d7fa640 1 -- 172.21.15.79:0/313287945 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff59800ede0 con 0x55d240795a30 2024-08-20T01:48:53.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.823+0000 7ff5af4b3740 1 -- 172.21.15.79:0/313287945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d240795a30 msgr2=0x55d240795e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:53.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.823+0000 7ff5af4b3740 1 --2- 172.21.15.79:0/313287945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d240795a30 0x55d240795e10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff598010790 tx=0x7ff59801e000 comp rx=0 tx=0).stop 2024-08-20T01:48:53.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.823+0000 7ff5af4b3740 1 -- 172.21.15.79:0/313287945 shutdown_connections 2024-08-20T01:48:53.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.823+0000 7ff5af4b3740 1 --2- 172.21.15.79:0/313287945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2407a22e0 0x55d2407a46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:53.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.823+0000 7ff5af4b3740 1 --2- 172.21.15.79:0/313287945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d240796350 0x55d2407a1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:53.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.823+0000 7ff5af4b3740 1 --2- 172.21.15.79:0/313287945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d240795a30 0x55d240795e10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:53.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.823+0000 7ff5af4b3740 1 -- 172.21.15.79:0/313287945 >> 172.21.15.79:0/313287945 conn(0x55d240793860 msgr2=0x55d240794a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:53.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.824+0000 7ff5af4b3740 1 -- 172.21.15.79:0/313287945 shutdown_connections 2024-08-20T01:48:53.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.824+0000 7ff5af4b3740 1 -- 172.21.15.79:0/313287945 wait complete. 2024-08-20T01:48:53.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.824+0000 7ff5af4b3740 1 -- start start 2024-08-20T01:48:53.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.824+0000 7ff5af4b3740 1 Processor -- start 2024-08-20T01:48:53.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.824+0000 7ff5af4b3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d240795a30 0x55d24079f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:53.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.825+0000 7ff5af4b3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d240796350 0x55d24079f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:53.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.825+0000 7ff5af4b3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2407a22e0 0x55d24079fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:53.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.825+0000 7ff5af4b3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d24055e700 con 0x55d2407a22e0 2024-08-20T01:48:53.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.825+0000 7ff5af4b3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d240682810 con 0x55d240795a30 2024-08-20T01:48:53.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.825+0000 7ff5af4b3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d2407a4ed0 con 0x55d240796350 2024-08-20T01:48:53.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.825+0000 7ff5af4b3740 10 client.0 _ll_register_callbacks cb 0x55d2406f5700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:48:53.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.825+0000 7ff5a6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d240795a30 0x55d24079f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:53.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.825+0000 7ff5a6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d240795a30 0x55d24079f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:38588/0 (socket says 172.21.15.79:38588) 2024-08-20T01:48:53.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.825+0000 7ff5a6d9d640 1 -- 172.21.15.79:0/3910775933 learned_addr learned my addr 172.21.15.79:0/3910775933 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:53.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.825+0000 7ff5a759e640 1 --2- 172.21.15.79:0/3910775933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2407a22e0 0x55d24079fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:53.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.825+0000 7ff5a6d9d640 1 -- 172.21.15.79:0/3910775933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d240796350 msgr2=0x55d24079f760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:48:53.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.825+0000 7ff5a6d9d640 1 --2- 172.21.15.79:0/3910775933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d240796350 0x55d24079f760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:53.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.825+0000 7ff5a6d9d640 1 -- 172.21.15.79:0/3910775933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2407a22e0 msgr2=0x55d24079fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:53.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.825+0000 7ff5a6d9d640 1 --2- 172.21.15.79:0/3910775933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2407a22e0 0x55d24079fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:53.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.825+0000 7ff5a6d9d640 1 -- 172.21.15.79:0/3910775933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2407ae260 con 0x55d240795a30 2024-08-20T01:48:53.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.826+0000 7ff5a6d9d640 1 --2- 172.21.15.79:0/3910775933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d240795a30 0x55d24079f220 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff598014d10 tx=0x7ff598009d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=390bc761846f447f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:53.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.826+0000 7ff58aff5640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:48:53.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.827+0000 7ff58aff5640 1 -- 172.21.15.79:0/3910775933 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff59800e860 con 0x55d240795a30 2024-08-20T01:48:53.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.827+0000 7ff58aff5640 1 -- 172.21.15.79:0/3910775933 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff5980140e0 con 0x55d240795a30 2024-08-20T01:48:53.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.827+0000 7ff5af4b3740 1 -- 172.21.15.79:0/3910775933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d2406ab150 con 0x55d240795a30 2024-08-20T01:48:53.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.827+0000 7ff58aff5640 1 -- 172.21.15.79:0/3910775933 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7ff59800eb60 con 0x55d240795a30 2024-08-20T01:48:53.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.828+0000 7ff5af4b3740 10 client.27542 fetch_fsmap learned FSMap version 49 2024-08-20T01:48:53.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.828+0000 7ff5af4b3740 1 -- 172.21.15.79:0/3910775933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55d2407b0c10 con 0x55d240795a30 2024-08-20T01:48:53.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.828+0000 7ff58aff5640 1 -- 172.21.15.79:0/3910775933 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55d2406ab150 con 0x55d240795a30 2024-08-20T01:48:53.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.828+0000 7ff58aff5640 1 -- 172.21.15.79:0/3910775933 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 49) ==== 8378+0+0 (secure 0 0 0) 0x7ff59800f040 con 0x55d240795a30 2024-08-20T01:48:53.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.828+0000 7ff5af4b3740 10 client.27542 fetch_fsmap finished waiting for FSMap version 49 2024-08-20T01:48:53.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.828+0000 7ff5af4b3740 10 client.27542 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:48:53.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.829+0000 7ff5af4b3740 20 client.27542 populate_metadata read hostname 'smithi079' 2024-08-20T01:48:53.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.829+0000 7ff5af4b3740 1 --2- 172.21.15.79:0/3910775933 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55d2407b2070 0x55d2407b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:53.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.829+0000 7ff5af4b3740 4 client.27542 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:48:53.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.829+0000 7ff5af4b3740 1 -- 172.21.15.79:0/3910775933 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d24070e880 con 0x55d2407b2070 2024-08-20T01:48:53.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.829+0000 7ff5a659c640 1 --2- 172.21.15.79:0/3910775933 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55d2407b2070 0x55d2407b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:53.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.830+0000 7ff5a659c640 1 --2- 172.21.15.79:0/3910775933 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55d2407b2070 0x55d2407b4460 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=905c40a46fc13cac server_cookie=3cc7c7674cca5c10 in_seq=0 out_seq=0 2024-08-20T01:48:53.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.830+0000 7ff58aff5640 10 client.27542 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:48:53.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.831+0000 7ff58aff5640 1 -- 172.21.15.79:0/3910775933 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d24070e880 con 0x55d2407b2070 2024-08-20T01:48:53.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.831+0000 7ff58aff5640 10 client.27542 handle_command_reply: tid=0 2024-08-20T01:48:53.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.831+0000 7ff5af4b3740 1 client.27542 shutdown 2024-08-20T01:48:53.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.831+0000 7ff5af4b3740 1 -- 172.21.15.79:0/3910775933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d240795a30 msgr2=0x55d24079f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:53.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.831+0000 7ff5af4b3740 1 --2- 172.21.15.79:0/3910775933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d240795a30 0x55d24079f220 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff598014d10 tx=0x7ff598009d30 comp rx=0 tx=0).stop 2024-08-20T01:48:53.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.831+0000 7ff5af4b3740 1 -- 172.21.15.79:0/3910775933 shutdown_connections 2024-08-20T01:48:53.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.831+0000 7ff5af4b3740 1 --2- 172.21.15.79:0/3910775933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2407a22e0 0x55d24079fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:53.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.831+0000 7ff5af4b3740 1 --2- 172.21.15.79:0/3910775933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d240796350 0x55d24079f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:53.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.831+0000 7ff5af4b3740 1 --2- 172.21.15.79:0/3910775933 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55d2407b2070 0x55d2407b4460 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:53.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.831+0000 7ff5af4b3740 1 --2- 172.21.15.79:0/3910775933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d240795a30 0x55d24079f220 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:53.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.831+0000 7ff5af4b3740 1 -- 172.21.15.79:0/3910775933 >> 172.21.15.79:0/3910775933 conn(0x55d240793860 msgr2=0x55d2407993d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:53.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.831+0000 7ff58aff5640 0 client.27542 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:48:53.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.831+0000 7ff5af4b3740 1 -- 172.21.15.79:0/3910775933 shutdown_connections 2024-08-20T01:48:53.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.831+0000 7ff5af4b3740 1 -- 172.21.15.79:0/3910775933 wait complete. 2024-08-20T01:48:53.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.832+0000 7ff5af4b3740 20 client.27542 trim_cache size 0 max 16384 2024-08-20T01:48:53.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.857+0000 7ff5af4b3740 1 Processor -- start 2024-08-20T01:48:53.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.857+0000 7ff5af4b3740 1 -- start start 2024-08-20T01:48:53.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.858+0000 7ff5af4b3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d240795a30 0x55d240794e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:53.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.858+0000 7ff5af4b3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d240796350 0x55d2407b9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:53.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.858+0000 7ff5a6d9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d240795a30 0x55d240794e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:53.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.858+0000 7ff5a6d9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d240795a30 0x55d240794e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:53840/0 (socket says 172.21.15.79:53840) 2024-08-20T01:48:53.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.858+0000 7ff5af4b3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2407a22e0 0x55d2407ba060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:53.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.858+0000 7ff5af4b3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a014fc40 con 0x55d2407a22e0 2024-08-20T01:48:53.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.858+0000 7ff5af4b3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a0151840 con 0x55d240796350 2024-08-20T01:48:53.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.858+0000 7ff5af4b3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a01503d0 con 0x55d240795a30 2024-08-20T01:48:53.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.859+0000 7ff5a6d9d640 1 -- 172.21.15.79:0/1187487264 learned_addr learned my addr 172.21.15.79:0/1187487264 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:53.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.859+0000 7ff5a659c640 1 --2- 172.21.15.79:0/1187487264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d240796350 0x55d2407b9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:53.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.859+0000 7ff5a759e640 1 --2- 172.21.15.79:0/1187487264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2407a22e0 0x55d2407ba060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:53.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.859+0000 7ff5a6d9d640 1 -- 172.21.15.79:0/1187487264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d240796350 msgr2=0x55d2407b9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:53.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.859+0000 7ff5a6d9d640 1 --2- 172.21.15.79:0/1187487264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d240796350 0x55d2407b9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:53.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.859+0000 7ff5a6d9d640 1 -- 172.21.15.79:0/1187487264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2407a22e0 msgr2=0x55d2407ba060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:53.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.859+0000 7ff5a6d9d640 1 --2- 172.21.15.79:0/1187487264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2407a22e0 0x55d2407ba060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:53.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.859+0000 7ff5a6d9d640 1 -- 172.21.15.79:0/1187487264 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2407940e0 con 0x55d240795a30 2024-08-20T01:48:53.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.860+0000 7ff5a6d9d640 1 --2- 172.21.15.79:0/1187487264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d240795a30 0x55d240794e80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff5980054a0 tx=0x7ff5980054d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c88c7b33dbd007f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:53.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.860+0000 7ff58cff9640 1 -- 172.21.15.79:0/1187487264 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff598009a60 con 0x55d240795a30 2024-08-20T01:48:53.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.860+0000 7ff58cff9640 1 -- 172.21.15.79:0/1187487264 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff59802d070 con 0x55d240795a30 2024-08-20T01:48:53.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.860+0000 7ff58cff9640 1 -- 172.21.15.79:0/1187487264 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff59800f040 con 0x55d240795a30 2024-08-20T01:48:53.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.861+0000 7ff5af4b3740 1 -- 172.21.15.79:0/1187487264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d240795a30 msgr2=0x55d240794e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:53.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.861+0000 7ff5af4b3740 1 --2- 172.21.15.79:0/1187487264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d240795a30 0x55d240794e80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff5980054a0 tx=0x7ff5980054d0 comp rx=0 tx=0).stop 2024-08-20T01:48:53.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.861+0000 7ff5af4b3740 1 -- 172.21.15.79:0/1187487264 shutdown_connections 2024-08-20T01:48:53.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.862+0000 7ff5af4b3740 1 --2- 172.21.15.79:0/1187487264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2407a22e0 0x55d2407ba060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:53.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.862+0000 7ff5af4b3740 1 --2- 172.21.15.79:0/1187487264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d240796350 0x55d2407b9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:53.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.862+0000 7ff5af4b3740 1 --2- 172.21.15.79:0/1187487264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d240795a30 0x55d240794e80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:53.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.862+0000 7ff5af4b3740 1 -- 172.21.15.79:0/1187487264 >> 172.21.15.79:0/1187487264 conn(0x55d240793860 msgr2=0x55d240794770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:53.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.862+0000 7ff5af4b3740 1 -- 172.21.15.79:0/1187487264 shutdown_connections 2024-08-20T01:48:53.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.862+0000 7ff5af4b3740 1 -- 172.21.15.79:0/1187487264 wait complete. 2024-08-20T01:48:53.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.863+0000 7ff5af4b3740 1 -- start start 2024-08-20T01:48:53.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.863+0000 7ff5af4b3740 1 Processor -- start 2024-08-20T01:48:53.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.864+0000 7ff5af4b3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d240795a30 0x55d2407a5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:53.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.864+0000 7ff5af4b3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d240796350 0x55d2407a5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:53.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.864+0000 7ff5a6d9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d240795a30 0x55d2407a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:53.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.864+0000 7ff5a6d9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d240795a30 0x55d2407a5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:53848/0 (socket says 172.21.15.79:53848) 2024-08-20T01:48:53.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.865+0000 7ff5af4b3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2407a22e0 0x55d24081aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:53.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.865+0000 7ff5af4b3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a0151170 con 0x55d240796350 2024-08-20T01:48:53.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.865+0000 7ff5af4b3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a0150aa0 con 0x55d2407a22e0 2024-08-20T01:48:53.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.865+0000 7ff5af4b3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a014dc20 con 0x55d240795a30 2024-08-20T01:48:53.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.865+0000 7ff5af4b3740 10 client.0 _ll_register_callbacks cb 0x7ff59c005090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:48:53.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.865+0000 7ff5a6d9d640 1 -- 172.21.15.79:0/1968749838 learned_addr learned my addr 172.21.15.79:0/1968749838 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:53.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.865+0000 7ff5a759e640 1 --2- 172.21.15.79:0/1968749838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2407a22e0 0x55d24081aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:53.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.865+0000 7ff5a659c640 1 --2- 172.21.15.79:0/1968749838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d240796350 0x55d2407a5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:53.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.865+0000 7ff5a6d9d640 1 -- 172.21.15.79:0/1968749838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2407a22e0 msgr2=0x55d24081aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:53.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.865+0000 7ff5a6d9d640 1 --2- 172.21.15.79:0/1968749838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2407a22e0 0x55d24081aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:53.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.865+0000 7ff5a6d9d640 1 -- 172.21.15.79:0/1968749838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d240796350 msgr2=0x55d2407a5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:53.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.865+0000 7ff5a6d9d640 1 --2- 172.21.15.79:0/1968749838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d240796350 0x55d2407a5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:53.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.865+0000 7ff5a6d9d640 1 -- 172.21.15.79:0/1968749838 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2407942e0 con 0x55d240795a30 2024-08-20T01:48:53.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.867+0000 7ff5a6d9d640 1 --2- 172.21.15.79:0/1968749838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d240795a30 0x55d2407a5910 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff598009db0 tx=0x7ff598009890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d97e2a986e47c92a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:53.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.867+0000 7ff58aff5640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:48:53.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.867+0000 7ff58aff5640 1 -- 172.21.15.79:0/1968749838 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff598044060 con 0x55d240795a30 2024-08-20T01:48:53.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.867+0000 7ff58aff5640 1 -- 172.21.15.79:0/1968749838 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff598014190 con 0x55d240795a30 2024-08-20T01:48:53.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.868+0000 7ff5af4b3740 1 -- 172.21.15.79:0/1968749838 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff59802d070 con 0x55d240795a30 2024-08-20T01:48:53.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.868+0000 7ff58aff5640 1 -- 172.21.15.79:0/1968749838 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7ff59800e730 con 0x55d240795a30 2024-08-20T01:48:53.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.870+0000 7ff5af4b3740 10 client.27511 fetch_fsmap learned FSMap version 49 2024-08-20T01:48:53.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.870+0000 7ff5af4b3740 1 -- 172.21.15.79:0/1968749838 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55d24081c200 con 0x55d240795a30 2024-08-20T01:48:53.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.870+0000 7ff58aff5640 1 -- 172.21.15.79:0/1968749838 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff59800e8d0 con 0x55d240795a30 2024-08-20T01:48:53.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.871+0000 7ff58aff5640 1 -- 172.21.15.79:0/1968749838 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 49) ==== 8378+0+0 (secure 0 0 0) 0x7ff598003910 con 0x55d240795a30 2024-08-20T01:48:53.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.871+0000 7ff5af4b3740 10 client.27511 fetch_fsmap finished waiting for FSMap version 49 2024-08-20T01:48:53.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.871+0000 7ff5af4b3740 10 client.27511 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:48:53.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.871+0000 7ff5af4b3740 20 client.27511 populate_metadata read hostname 'smithi079' 2024-08-20T01:48:53.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.871+0000 7ff5af4b3740 1 --2- 172.21.15.79:0/1968749838 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55d24081c840 0x55d24081ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:53.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.871+0000 7ff5af4b3740 4 client.27511 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:48:53.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.872+0000 7ff5af4b3740 1 -- 172.21.15.79:0/1968749838 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7ff59802d070 con 0x55d24081c840 2024-08-20T01:48:53.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.872+0000 7ff5a659c640 1 --2- 172.21.15.79:0/1968749838 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55d24081c840 0x55d24081ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:53.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.872+0000 7ff5a659c640 1 --2- 172.21.15.79:0/1968749838 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55d24081c840 0x55d24081ec60 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a98c03d4a8719407 server_cookie=ba6134189dc4a699 in_seq=0 out_seq=0 2024-08-20T01:48:53.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.872+0000 7ff58aff5640 10 client.27511 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:48:53.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.873+0000 7ff58aff5640 1 -- 172.21.15.79:0/1968749838 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7ff59802d070 con 0x55d24081c840 2024-08-20T01:48:53.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.873+0000 7ff58aff5640 10 client.27511 handle_command_reply: tid=0 2024-08-20T01:48:53.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.873+0000 7ff5af4b3740 1 client.27511 shutdown 2024-08-20T01:48:53.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.873+0000 7ff5af4b3740 1 -- 172.21.15.79:0/1968749838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d240795a30 msgr2=0x55d2407a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:53.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.874+0000 7ff5af4b3740 1 --2- 172.21.15.79:0/1968749838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d240795a30 0x55d2407a5910 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff598009db0 tx=0x7ff598009890 comp rx=0 tx=0).stop 2024-08-20T01:48:53.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.874+0000 7ff5af4b3740 1 -- 172.21.15.79:0/1968749838 shutdown_connections 2024-08-20T01:48:53.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.874+0000 7ff5af4b3740 1 --2- 172.21.15.79:0/1968749838 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55d24081c840 0x55d24081ec60 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:53.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.875+0000 7ff5af4b3740 1 --2- 172.21.15.79:0/1968749838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2407a22e0 0x55d24081aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:53.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.875+0000 7ff5af4b3740 1 --2- 172.21.15.79:0/1968749838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d240796350 0x55d2407a5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:53.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.875+0000 7ff5af4b3740 1 --2- 172.21.15.79:0/1968749838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d240795a30 0x55d2407a5910 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:53.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.875+0000 7ff5af4b3740 1 -- 172.21.15.79:0/1968749838 >> 172.21.15.79:0/1968749838 conn(0x55d240793860 msgr2=0x55d240794e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:53.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.875+0000 7ff58aff5640 0 client.27511 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:48:53.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.875+0000 7ff5af4b3740 1 -- 172.21.15.79:0/1968749838 shutdown_connections 2024-08-20T01:48:53.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.875+0000 7ff5af4b3740 1 -- 172.21.15.79:0/1968749838 wait complete. 2024-08-20T01:48:53.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.875+0000 7ff5af4b3740 20 client.27511 trim_cache size 0 max 16384 2024-08-20T01:48:53.880 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:48:53.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.876+0000 7ff5ad0ba640 1 -- 172.21.15.79:0/2744242523 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff5900b3c50 msgr2=0x7ff5900b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:53.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.876+0000 7ff5ad0ba640 1 --2- 172.21.15.79:0/2744242523 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff5900b3c50 0x7ff5900b6110 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff598014410 tx=0x7ff598014810 comp rx=0 tx=0).stop 2024-08-20T01:48:53.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.876+0000 7ff5ad0ba640 1 -- 172.21.15.79:0/2744242523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5a00a21a0 msgr2=0x7ff5a000e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:53.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.876+0000 7ff5ad0ba640 1 --2- 172.21.15.79:0/2744242523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5a00a21a0 0x7ff5a000e950 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7ff59c004770 tx=0x7ff59c0045e0 comp rx=0 tx=0).stop 2024-08-20T01:48:53.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.876+0000 7ff5ad0ba640 1 -- 172.21.15.79:0/2744242523 shutdown_connections 2024-08-20T01:48:53.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.876+0000 7ff5ad0ba640 1 --2- 172.21.15.79:0/2744242523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5a00a21a0 0x7ff5a000e950 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:53.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.876+0000 7ff5ad0ba640 1 --2- 172.21.15.79:0/2744242523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5a00a1820 0x7ff5a0015a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:53.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.876+0000 7ff5ad0ba640 1 --2- 172.21.15.79:0/2744242523 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff5900b3c50 0x7ff5900b6110 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:53.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.876+0000 7ff5ad0ba640 1 --2- 172.21.15.79:0/2744242523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5a009c020 0x7ff5a00154c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:53.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.876+0000 7ff5ad0ba640 1 -- 172.21.15.79:0/2744242523 >> 172.21.15.79:0/2744242523 conn(0x7ff5a000a770 msgr2=0x7ff5a009a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:53.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.877+0000 7ff5ad0ba640 1 -- 172.21.15.79:0/2744242523 shutdown_connections 2024-08-20T01:48:53.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:53.877+0000 7ff5ad0ba640 1 -- 172.21.15.79:0/2744242523 wait complete. 2024-08-20T01:48:53.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:53 smithi079 ceph-mon[18656]: pgmap v694: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 23 MiB/s wr, 5.84k op/s 2024-08-20T01:48:54.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:53 smithi175 ceph-mon[22392]: pgmap v694: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 23 MiB/s wr, 5.84k op/s 2024-08-20T01:48:54.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:53 smithi081 ceph-mon[22209]: pgmap v694: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 23 MiB/s wr, 5.84k op/s 2024-08-20T01:48:54.713 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T01:48:55.158 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:48:55.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.787+0000 7f9e4559a640 1 -- 172.21.15.79:0/2085345652 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e4002fc50 con 0x7f9e48109e80 2024-08-20T01:48:55.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.788+0000 7f9e4ca45640 1 -- 172.21.15.79:0/2085345652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e48109e80 msgr2=0x7f9e48110ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:55.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.788+0000 7f9e4ca45640 1 --2- 172.21.15.79:0/2085345652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e48109e80 0x7f9e48110ee0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9e40009ca0 tx=0x7f9e4002a940 comp rx=0 tx=0).stop 2024-08-20T01:48:55.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.788+0000 7f9e4ca45640 1 -- 172.21.15.79:0/2085345652 shutdown_connections 2024-08-20T01:48:55.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.788+0000 7f9e4ca45640 1 --2- 172.21.15.79:0/2085345652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e4811bdd0 0x7f9e4811e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:55.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.788+0000 7f9e4ca45640 1 --2- 172.21.15.79:0/2085345652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e4810a260 0x7f9e4810a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:55.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.788+0000 7f9e4ca45640 1 --2- 172.21.15.79:0/2085345652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e48109e80 0x7f9e48110ee0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:55.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.788+0000 7f9e4ca45640 1 -- 172.21.15.79:0/2085345652 >> 172.21.15.79:0/2085345652 conn(0x7f9e4806dcc0 msgr2=0x7f9e4806e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:55.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.789+0000 7f9e4ca45640 1 -- 172.21.15.79:0/2085345652 shutdown_connections 2024-08-20T01:48:55.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.789+0000 7f9e4ca45640 1 -- 172.21.15.79:0/2085345652 wait complete. 2024-08-20T01:48:55.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.790+0000 7f9e4ca45640 1 Processor -- start 2024-08-20T01:48:55.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.790+0000 7f9e4ca45640 1 -- start start 2024-08-20T01:48:55.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.791+0000 7f9e4ca45640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e48109e80 0x7f9e481a7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:55.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.791+0000 7f9e4ca45640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e4810a260 0x7f9e481a8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:55.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.791+0000 7f9e4ca45640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e4811bdd0 0x7f9e481ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:55.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.791+0000 7f9e4ca45640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9e48121720 con 0x7f9e4811bdd0 2024-08-20T01:48:55.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.791+0000 7f9e4ca45640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9e481215a0 con 0x7f9e48109e80 2024-08-20T01:48:55.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.791+0000 7f9e4ca45640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9e481218a0 con 0x7f9e4810a260 2024-08-20T01:48:55.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.791+0000 7f9e4659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e48109e80 0x7f9e481a7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:55.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.791+0000 7f9e4659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e48109e80 0x7f9e481a7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:38626/0 (socket says 172.21.15.79:38626) 2024-08-20T01:48:55.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.791+0000 7f9e4659c640 1 -- 172.21.15.79:0/4200076640 learned_addr learned my addr 172.21.15.79:0/4200076640 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:55.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.791+0000 7f9e45d9b640 1 --2- 172.21.15.79:0/4200076640 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e4810a260 0x7f9e481a8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:55.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.791+0000 7f9e46d9d640 1 --2- 172.21.15.79:0/4200076640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e4811bdd0 0x7f9e481ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:55.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.791+0000 7f9e45d9b640 1 -- 172.21.15.79:0/4200076640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e48109e80 msgr2=0x7f9e481a7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:55.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.791+0000 7f9e45d9b640 1 --2- 172.21.15.79:0/4200076640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e48109e80 0x7f9e481a7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:55.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.791+0000 7f9e45d9b640 1 -- 172.21.15.79:0/4200076640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e4811bdd0 msgr2=0x7f9e481ad5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:55.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.791+0000 7f9e45d9b640 1 --2- 172.21.15.79:0/4200076640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e4811bdd0 0x7f9e481ad5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:55.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.791+0000 7f9e45d9b640 1 -- 172.21.15.79:0/4200076640 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e481addc0 con 0x7f9e4810a260 2024-08-20T01:48:55.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.792+0000 7f9e45d9b640 1 --2- 172.21.15.79:0/4200076640 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e4810a260 0x7f9e481a8250 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9e3800e9f0 tx=0x7f9e3800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:55.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.793+0000 7f9e377fe640 1 -- 172.21.15.79:0/4200076640 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3800ccc0 con 0x7f9e4810a260 2024-08-20T01:48:55.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.793+0000 7f9e4ca45640 1 -- 172.21.15.79:0/4200076640 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e481ae0b0 con 0x7f9e4810a260 2024-08-20T01:48:55.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.793+0000 7f9e4ca45640 1 -- 172.21.15.79:0/4200076640 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e481b4770 con 0x7f9e4810a260 2024-08-20T01:48:55.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.793+0000 7f9e377fe640 1 -- 172.21.15.79:0/4200076640 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9e380108c0 con 0x7f9e4810a260 2024-08-20T01:48:55.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.793+0000 7f9e377fe640 1 -- 172.21.15.79:0/4200076640 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e380187e0 con 0x7f9e4810a260 2024-08-20T01:48:55.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.796+0000 7f9e4ee3e740 1 Processor -- start 2024-08-20T01:48:55.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.797+0000 7f9e4ee3e740 1 -- start start 2024-08-20T01:48:55.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.797+0000 7f9e4ee3e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ac776a880 0x556ac776ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:55.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.797+0000 7f9e4ee3e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ac776b1a0 0x556ac7776bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:55.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.797+0000 7f9e4ee3e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac7777130 0x556ac7779520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:55.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.797+0000 7f9e4ee3e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556ac76e1930 con 0x556ac776b1a0 2024-08-20T01:48:55.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.797+0000 7f9e4ee3e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556ac76d0e30 con 0x556ac7777130 2024-08-20T01:48:55.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.797+0000 7f9e4ee3e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556ac76d4e70 con 0x556ac776a880 2024-08-20T01:48:55.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.798+0000 7f9e4659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ac776b1a0 0x556ac7776bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:55.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.798+0000 7f9e4659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ac776b1a0 0x556ac7776bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49068/0 (socket says 172.21.15.79:49068) 2024-08-20T01:48:55.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.798+0000 7f9e4659c640 1 -- 172.21.15.79:0/681833192 learned_addr learned my addr 172.21.15.79:0/681833192 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:55.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.798+0000 7f9e46d9d640 1 --2- 172.21.15.79:0/681833192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ac776a880 0x556ac776ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:55.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.799+0000 7f9e46d9d640 1 -- 172.21.15.79:0/681833192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac7777130 msgr2=0x556ac7779520 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:48:55.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.799+0000 7f9e46d9d640 1 --2- 172.21.15.79:0/681833192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac7777130 0x556ac7779520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:55.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.799+0000 7f9e46d9d640 1 -- 172.21.15.79:0/681833192 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ac776b1a0 msgr2=0x556ac7776bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:55.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.799+0000 7f9e46d9d640 1 --2- 172.21.15.79:0/681833192 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ac776b1a0 0x556ac7776bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:55.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.799+0000 7f9e46d9d640 1 -- 172.21.15.79:0/681833192 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ac7430650 con 0x556ac776a880 2024-08-20T01:48:55.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.799+0000 7f9e377fe640 1 -- 172.21.15.79:0/4200076640 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f9e38010430 con 0x7f9e4810a260 2024-08-20T01:48:55.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.799+0000 7f9e46d9d640 1 --2- 172.21.15.79:0/681833192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ac776a880 0x556ac776ac60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c00b630 tx=0x7f9e3c00baf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10d55d3f0c648421 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:55.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.800+0000 7f9e34ff9640 1 -- 172.21.15.79:0/681833192 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c003be0 con 0x556ac776a880 2024-08-20T01:48:55.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.800+0000 7f9e34ff9640 1 -- 172.21.15.79:0/681833192 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9e3c015030 con 0x556ac776a880 2024-08-20T01:48:55.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.800+0000 7f9e34ff9640 1 -- 172.21.15.79:0/681833192 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c010480 con 0x556ac776a880 2024-08-20T01:48:55.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.801+0000 7f9e377fe640 1 --2- 172.21.15.79:0/4200076640 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9e300b3da0 0x7f9e300b6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:55.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.801+0000 7f9e4ee3e740 1 -- 172.21.15.79:0/681833192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ac776a880 msgr2=0x556ac776ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:55.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.801+0000 7f9e4ee3e740 1 --2- 172.21.15.79:0/681833192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ac776a880 0x556ac776ac60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c00b630 tx=0x7f9e3c00baf0 comp rx=0 tx=0).stop 2024-08-20T01:48:55.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.801+0000 7f9e4ee3e740 1 -- 172.21.15.79:0/681833192 shutdown_connections 2024-08-20T01:48:55.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.801+0000 7f9e4ee3e740 1 --2- 172.21.15.79:0/681833192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac7777130 0x556ac7779520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:55.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.801+0000 7f9e4ee3e740 1 --2- 172.21.15.79:0/681833192 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ac776b1a0 0x556ac7776bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:55.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.801+0000 7f9e4ee3e740 1 --2- 172.21.15.79:0/681833192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ac776a880 0x556ac776ac60 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:55.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.801+0000 7f9e4ee3e740 1 -- 172.21.15.79:0/681833192 >> 172.21.15.79:0/681833192 conn(0x556ac77686b0 msgr2=0x556ac7769850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:55.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.801+0000 7f9e377fe640 1 -- 172.21.15.79:0/4200076640 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9e380e3c20 con 0x7f9e4810a260 2024-08-20T01:48:55.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.801+0000 7f9e4659c640 1 --2- 172.21.15.79:0/4200076640 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9e300b3da0 0x7f9e300b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:55.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.802+0000 7f9e4ee3e740 1 -- 172.21.15.79:0/681833192 shutdown_connections 2024-08-20T01:48:55.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.802+0000 7f9e4ee3e740 1 -- 172.21.15.79:0/681833192 wait complete. 2024-08-20T01:48:55.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.802+0000 7f9e4659c640 1 --2- 172.21.15.79:0/4200076640 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9e300b3da0 0x7f9e300b6260 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f9e40009a60 tx=0x7f9e40005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:55.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.802+0000 7f9e4ee3e740 1 -- start start 2024-08-20T01:48:55.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.803+0000 7f9e4ee3e740 1 Processor -- start 2024-08-20T01:48:55.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.803+0000 7f9e4ee3e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ac776a880 0x556ac7774110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:55.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.803+0000 7f9e4ee3e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ac776b1a0 0x556ac7774650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:55.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.803+0000 7f9e4ee3e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac7777130 0x556ac7774b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:55.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.803+0000 7f9e4ee3e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556ac7533700 con 0x556ac776b1a0 2024-08-20T01:48:55.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.803+0000 7f9e4ee3e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556ac7657810 con 0x556ac7777130 2024-08-20T01:48:55.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.803+0000 7f9e4ee3e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556ac778adf0 con 0x556ac776a880 2024-08-20T01:48:55.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.803+0000 7f9e4ee3e740 10 client.0 _ll_register_callbacks cb 0x556ac76ca700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:48:55.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.804+0000 7f9e46d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac7777130 0x556ac7774b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:55.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.804+0000 7f9e46d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac7777130 0x556ac7774b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:38642/0 (socket says 172.21.15.79:38642) 2024-08-20T01:48:55.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.804+0000 7f9e46d9d640 1 -- 172.21.15.79:0/2605364331 learned_addr learned my addr 172.21.15.79:0/2605364331 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:55.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.804+0000 7f9e46d9d640 1 -- 172.21.15.79:0/2605364331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ac776a880 msgr2=0x556ac7774110 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:48:55.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.804+0000 7f9e46d9d640 1 --2- 172.21.15.79:0/2605364331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ac776a880 0x556ac7774110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:55.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.804+0000 7f9e46d9d640 1 -- 172.21.15.79:0/2605364331 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ac776b1a0 msgr2=0x556ac7774650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:55.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.804+0000 7f9e46d9d640 1 --2- 172.21.15.79:0/2605364331 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ac776b1a0 0x556ac7774650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:55.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.804+0000 7f9e46d9d640 1 -- 172.21.15.79:0/2605364331 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ac7794280 con 0x556ac7777130 2024-08-20T01:48:55.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.804+0000 7f9e46d9d640 1 --2- 172.21.15.79:0/2605364331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac7777130 0x556ac7774b90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c011d70 tx=0x7f9e3c011da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d457fc4467a450b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:55.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.804+0000 7f9e2dffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:48:55.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.805+0000 7f9e2dffb640 1 -- 172.21.15.79:0/2605364331 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c028060 con 0x556ac7777130 2024-08-20T01:48:55.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.805+0000 7f9e4ee3e740 1 -- 172.21.15.79:0/2605364331 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556ac7680150 con 0x556ac7777130 2024-08-20T01:48:55.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.805+0000 7f9e2dffb640 1 -- 172.21.15.79:0/2605364331 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9e3c011650 con 0x556ac7777130 2024-08-20T01:48:55.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.805+0000 7f9e2dffb640 1 -- 172.21.15.79:0/2605364331 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f9e3c011e10 con 0x556ac7777130 2024-08-20T01:48:55.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.805+0000 7f9e4ee3e740 10 client.27554 fetch_fsmap learned FSMap version 49 2024-08-20T01:48:55.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.805+0000 7f9e4ee3e740 1 -- 172.21.15.79:0/2605364331 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x556ac7796cb0 con 0x556ac7777130 2024-08-20T01:48:55.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.805+0000 7f9e2dffb640 1 -- 172.21.15.79:0/2605364331 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x556ac7680150 con 0x556ac7777130 2024-08-20T01:48:55.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.806+0000 7f9e2dffb640 1 -- 172.21.15.79:0/2605364331 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 49) ==== 8378+0+0 (secure 0 0 0) 0x7f9e3c01abb0 con 0x556ac7777130 2024-08-20T01:48:55.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.806+0000 7f9e4ee3e740 10 client.27554 fetch_fsmap finished waiting for FSMap version 49 2024-08-20T01:48:55.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.806+0000 7f9e4ee3e740 10 client.27554 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:48:55.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.806+0000 7f9e4ee3e740 20 client.27554 populate_metadata read hostname 'smithi079' 2024-08-20T01:48:55.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.806+0000 7f9e4ee3e740 1 --2- 172.21.15.79:0/2605364331 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556ac77984b0 0x556ac779a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:55.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.806+0000 7f9e4ee3e740 4 client.27554 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:48:55.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.806+0000 7f9e4ee3e740 1 -- 172.21.15.79:0/2605364331 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ac76e3880 con 0x556ac77984b0 2024-08-20T01:48:55.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.807+0000 7f9e4659c640 1 --2- 172.21.15.79:0/2605364331 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556ac77984b0 0x556ac779a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:55.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.807+0000 7f9e4659c640 1 --2- 172.21.15.79:0/2605364331 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556ac77984b0 0x556ac779a930 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d746fe298eae714 server_cookie=2f67d2ead4f1ecdb in_seq=0 out_seq=0 2024-08-20T01:48:55.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.807+0000 7f9e2dffb640 10 client.27554 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:55.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.808+0000 7f9e2dffb640 1 -- 172.21.15.79:0/2605364331 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556ac76e3880 con 0x556ac77984b0 2024-08-20T01:48:55.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.808+0000 7f9e2dffb640 10 client.27554 handle_command_reply: tid=0 2024-08-20T01:48:55.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.808+0000 7f9e4ee3e740 1 client.27554 shutdown 2024-08-20T01:48:55.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.808+0000 7f9e4ee3e740 1 -- 172.21.15.79:0/2605364331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac7777130 msgr2=0x556ac7774b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:55.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.808+0000 7f9e4ee3e740 1 --2- 172.21.15.79:0/2605364331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac7777130 0x556ac7774b90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c011d70 tx=0x7f9e3c011da0 comp rx=0 tx=0).stop 2024-08-20T01:48:55.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.809+0000 7f9e4ee3e740 1 -- 172.21.15.79:0/2605364331 shutdown_connections 2024-08-20T01:48:55.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.809+0000 7f9e4ee3e740 1 --2- 172.21.15.79:0/2605364331 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556ac77984b0 0x556ac779a930 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:55.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.809+0000 7f9e4ee3e740 1 --2- 172.21.15.79:0/2605364331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac7777130 0x556ac7774b90 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:55.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.809+0000 7f9e4ee3e740 1 --2- 172.21.15.79:0/2605364331 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ac776b1a0 0x556ac7774650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:55.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.809+0000 7f9e4ee3e740 1 --2- 172.21.15.79:0/2605364331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ac776a880 0x556ac7774110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:55.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.809+0000 7f9e4ee3e740 1 -- 172.21.15.79:0/2605364331 >> 172.21.15.79:0/2605364331 conn(0x556ac77686b0 msgr2=0x556ac776e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:55.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.809+0000 7f9e2dffb640 0 client.27554 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:55.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.809+0000 7f9e4ee3e740 1 -- 172.21.15.79:0/2605364331 shutdown_connections 2024-08-20T01:48:55.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.809+0000 7f9e4ee3e740 1 -- 172.21.15.79:0/2605364331 wait complete. 2024-08-20T01:48:55.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.810+0000 7f9e4ee3e740 20 client.27554 trim_cache size 0 max 16384 2024-08-20T01:48:55.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.835+0000 7f9e4ee3e740 1 Processor -- start 2024-08-20T01:48:55.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.837+0000 7f9e4ee3e740 1 -- start start 2024-08-20T01:48:55.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.837+0000 7f9e4ee3e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac776a880 0x556ac77a0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:55.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.837+0000 7f9e4ee3e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ac776b1a0 0x556ac77a0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:55.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.837+0000 7f9e4ee3e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ac7777130 0x556ac7775740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:55.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.837+0000 7f9e4659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac776a880 0x556ac77a0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:55.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.837+0000 7f9e4ee3e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2800e270 con 0x556ac776b1a0 2024-08-20T01:48:55.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.837+0000 7f9e4ee3e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2800fe70 con 0x556ac776a880 2024-08-20T01:48:55.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.837+0000 7f9e4ee3e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2800ea00 con 0x556ac7777130 2024-08-20T01:48:55.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.837+0000 7f9e4659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac776a880 0x556ac77a0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:38656/0 (socket says 172.21.15.79:38656) 2024-08-20T01:48:55.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.837+0000 7f9e4659c640 1 -- 172.21.15.79:0/3208096250 learned_addr learned my addr 172.21.15.79:0/3208096250 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:55.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.837+0000 7f9e46d9d640 1 --2- 172.21.15.79:0/3208096250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ac7777130 0x556ac7775740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:55.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.838+0000 7f9e4659c640 1 -- 172.21.15.79:0/3208096250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ac7777130 msgr2=0x556ac7775740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:55.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.838+0000 7f9e4659c640 1 --2- 172.21.15.79:0/3208096250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ac7777130 0x556ac7775740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:55.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.838+0000 7f9e4659c640 1 -- 172.21.15.79:0/3208096250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ac776b1a0 msgr2=0x556ac77a0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:55.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.838+0000 7f9e4659c640 1 --2- 172.21.15.79:0/3208096250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ac776b1a0 0x556ac77a0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:55.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.838+0000 7f9e4659c640 1 -- 172.21.15.79:0/3208096250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ac776afd0 con 0x556ac776a880 2024-08-20T01:48:55.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.838+0000 7f9e4659c640 1 --2- 172.21.15.79:0/3208096250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac776a880 0x556ac77a0200 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9e40009dc0 tx=0x7f9e40044000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa14e68e5c084c58 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:55.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.839+0000 7f9e2ffff640 1 -- 172.21.15.79:0/3208096250 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e40057070 con 0x556ac776a880 2024-08-20T01:48:55.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.839+0000 7f9e2ffff640 1 -- 172.21.15.79:0/3208096250 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9e4002f640 con 0x556ac776a880 2024-08-20T01:48:55.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.839+0000 7f9e2ffff640 1 -- 172.21.15.79:0/3208096250 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e40034040 con 0x556ac776a880 2024-08-20T01:48:55.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.840+0000 7f9e4ee3e740 1 -- 172.21.15.79:0/3208096250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac776a880 msgr2=0x556ac77a0200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:55.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.840+0000 7f9e4ee3e740 1 --2- 172.21.15.79:0/3208096250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac776a880 0x556ac77a0200 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9e40009dc0 tx=0x7f9e40044000 comp rx=0 tx=0).stop 2024-08-20T01:48:55.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.840+0000 7f9e4ee3e740 1 -- 172.21.15.79:0/3208096250 shutdown_connections 2024-08-20T01:48:55.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.840+0000 7f9e4ee3e740 1 --2- 172.21.15.79:0/3208096250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ac7777130 0x556ac7775740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:55.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.840+0000 7f9e4ee3e740 1 --2- 172.21.15.79:0/3208096250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ac776b1a0 0x556ac77a0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:55.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.840+0000 7f9e4ee3e740 1 --2- 172.21.15.79:0/3208096250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac776a880 0x556ac77a0200 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:55.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.840+0000 7f9e4ee3e740 1 -- 172.21.15.79:0/3208096250 >> 172.21.15.79:0/3208096250 conn(0x556ac77686b0 msgr2=0x556ac7769bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:55.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.840+0000 7f9e4ee3e740 1 -- 172.21.15.79:0/3208096250 shutdown_connections 2024-08-20T01:48:55.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.841+0000 7f9e4ee3e740 1 -- 172.21.15.79:0/3208096250 wait complete. 2024-08-20T01:48:55.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.841+0000 7f9e4ee3e740 1 -- start start 2024-08-20T01:48:55.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.841+0000 7f9e4ee3e740 1 Processor -- start 2024-08-20T01:48:55.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.842+0000 7f9e4ee3e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ac776a880 0x556ac778b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:55.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.842+0000 7f9e4ee3e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac776b1a0 0x556ac778b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:55.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.842+0000 7f9e4ee3e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ac7777130 0x556ac78011c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:55.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.842+0000 7f9e4ee3e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2800f7a0 con 0x556ac776a880 2024-08-20T01:48:55.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.842+0000 7f9e45d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac776b1a0 0x556ac778b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:55.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.842+0000 7f9e45d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac776b1a0 0x556ac778b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:38664/0 (socket says 172.21.15.79:38664) 2024-08-20T01:48:55.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.842+0000 7f9e45d9b640 1 -- 172.21.15.79:0/1860876346 learned_addr learned my addr 172.21.15.79:0/1860876346 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:55.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.842+0000 7f9e4ee3e740 1 -- 172.21.15.79:0/1860876346 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2800f0d0 con 0x556ac776b1a0 2024-08-20T01:48:55.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.842+0000 7f9e4ee3e740 1 -- 172.21.15.79:0/1860876346 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2800c300 con 0x556ac7777130 2024-08-20T01:48:55.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.843+0000 7f9e4ee3e740 10 client.0 _ll_register_callbacks cb 0x7f9e3c004490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:48:55.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.843+0000 7f9e45d9b640 1 -- 172.21.15.79:0/1860876346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ac7777130 msgr2=0x556ac78011c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:48:55.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.843+0000 7f9e45d9b640 1 --2- 172.21.15.79:0/1860876346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ac7777130 0x556ac78011c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:55.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.843+0000 7f9e45d9b640 1 -- 172.21.15.79:0/1860876346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ac776a880 msgr2=0x556ac778b200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:48:55.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.843+0000 7f9e45d9b640 1 --2- 172.21.15.79:0/1860876346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ac776a880 0x556ac778b200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:55.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.843+0000 7f9e45d9b640 1 -- 172.21.15.79:0/1860876346 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ac778bfd0 con 0x556ac776b1a0 2024-08-20T01:48:55.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.844+0000 7f9e45d9b640 1 --2- 172.21.15.79:0/1860876346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac776b1a0 0x556ac778b740 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9e3800c6a0 tx=0x7f9e380aa430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29893faebd4361d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:55.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.845+0000 7f9e2dffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:48:55.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.845+0000 7f9e2dffb640 1 -- 172.21.15.79:0/1860876346 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e380aabd0 con 0x556ac776b1a0 2024-08-20T01:48:55.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.845+0000 7f9e2dffb640 1 -- 172.21.15.79:0/1860876346 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9e380e1da0 con 0x556ac776b1a0 2024-08-20T01:48:55.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.845+0000 7f9e4ee3e740 1 -- 172.21.15.79:0/1860876346 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e4002f640 con 0x556ac776b1a0 2024-08-20T01:48:55.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.845+0000 7f9e2dffb640 1 -- 172.21.15.79:0/1860876346 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f9e380ca050 con 0x556ac776b1a0 2024-08-20T01:48:55.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.845+0000 7f9e4ee3e740 10 client.27560 fetch_fsmap learned FSMap version 49 2024-08-20T01:48:55.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.846+0000 7f9e4ee3e740 1 -- 172.21.15.79:0/1860876346 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x556ac78027b0 con 0x556ac776b1a0 2024-08-20T01:48:55.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.846+0000 7f9e2dffb640 1 -- 172.21.15.79:0/1860876346 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9e4002f640 con 0x556ac776b1a0 2024-08-20T01:48:55.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.847+0000 7f9e2dffb640 1 -- 172.21.15.79:0/1860876346 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 49) ==== 8378+0+0 (secure 0 0 0) 0x7f9e380a6050 con 0x556ac776b1a0 2024-08-20T01:48:55.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.847+0000 7f9e4ee3e740 10 client.27560 fetch_fsmap finished waiting for FSMap version 49 2024-08-20T01:48:55.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.847+0000 7f9e4ee3e740 10 client.27560 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:48:55.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.847+0000 7f9e4ee3e740 20 client.27560 populate_metadata read hostname 'smithi079' 2024-08-20T01:48:55.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.847+0000 7f9e4ee3e740 1 --2- 172.21.15.79:0/1860876346 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556ac7803050 0x556ac7805470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:55.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.847+0000 7f9e4ee3e740 4 client.27560 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:48:55.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.847+0000 7f9e4ee3e740 1 -- 172.21.15.79:0/1860876346 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556ac76df320 con 0x556ac7803050 2024-08-20T01:48:55.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.849+0000 7f9e4659c640 1 --2- 172.21.15.79:0/1860876346 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556ac7803050 0x556ac7805470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:55.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.850+0000 7f9e4659c640 1 --2- 172.21.15.79:0/1860876346 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556ac7803050 0x556ac7805470 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79df1ca7e62a05d1 server_cookie=72ed6197b1907a6c in_seq=0 out_seq=0 2024-08-20T01:48:55.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.850+0000 7f9e2dffb640 10 client.27560 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:55.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.851+0000 7f9e2dffb640 1 -- 172.21.15.79:0/1860876346 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556ac76df320 con 0x556ac7803050 2024-08-20T01:48:55.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.851+0000 7f9e2dffb640 10 client.27560 handle_command_reply: tid=0 2024-08-20T01:48:55.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.851+0000 7f9e4ee3e740 1 client.27560 shutdown 2024-08-20T01:48:55.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.851+0000 7f9e4ee3e740 1 -- 172.21.15.79:0/1860876346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac776b1a0 msgr2=0x556ac778b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:55.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.851+0000 7f9e4ee3e740 1 --2- 172.21.15.79:0/1860876346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac776b1a0 0x556ac778b740 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9e3800c6a0 tx=0x7f9e380aa430 comp rx=0 tx=0).stop 2024-08-20T01:48:55.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.854+0000 7f9e4ee3e740 1 -- 172.21.15.79:0/1860876346 shutdown_connections 2024-08-20T01:48:55.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.854+0000 7f9e4ee3e740 1 --2- 172.21.15.79:0/1860876346 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556ac7803050 0x556ac7805470 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:55.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.854+0000 7f9e4ee3e740 1 --2- 172.21.15.79:0/1860876346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ac7777130 0x556ac78011c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:55.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.854+0000 7f9e4ee3e740 1 --2- 172.21.15.79:0/1860876346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac776b1a0 0x556ac778b740 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:55.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.854+0000 7f9e4ee3e740 1 --2- 172.21.15.79:0/1860876346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ac776a880 0x556ac778b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:55.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.854+0000 7f9e4ee3e740 1 -- 172.21.15.79:0/1860876346 >> 172.21.15.79:0/1860876346 conn(0x556ac77686b0 msgr2=0x556ac7769390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:55.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.854+0000 7f9e2dffb640 0 client.27560 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:55.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.854+0000 7f9e4ee3e740 1 -- 172.21.15.79:0/1860876346 shutdown_connections 2024-08-20T01:48:55.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.854+0000 7f9e4ee3e740 1 -- 172.21.15.79:0/1860876346 wait complete. 2024-08-20T01:48:55.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.855+0000 7f9e4ee3e740 20 client.27560 trim_cache size 0 max 16384 2024-08-20T01:48:55.858 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:48:55.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.857+0000 7f9e4ca45640 1 -- 172.21.15.79:0/4200076640 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9e300b3da0 msgr2=0x7f9e300b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:55.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.857+0000 7f9e4ca45640 1 --2- 172.21.15.79:0/4200076640 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9e300b3da0 0x7f9e300b6260 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f9e40009a60 tx=0x7f9e40005da0 comp rx=0 tx=0).stop 2024-08-20T01:48:55.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.857+0000 7f9e4ca45640 1 -- 172.21.15.79:0/4200076640 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e4810a260 msgr2=0x7f9e481a8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:55.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.857+0000 7f9e4ca45640 1 --2- 172.21.15.79:0/4200076640 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e4810a260 0x7f9e481a8250 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9e3800e9f0 tx=0x7f9e3800eeb0 comp rx=0 tx=0).stop 2024-08-20T01:48:55.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.857+0000 7f9e4ca45640 1 -- 172.21.15.79:0/4200076640 shutdown_connections 2024-08-20T01:48:55.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.857+0000 7f9e4ca45640 1 --2- 172.21.15.79:0/4200076640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e4811bdd0 0x7f9e481ad5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:55.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.857+0000 7f9e4ca45640 1 --2- 172.21.15.79:0/4200076640 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9e300b3da0 0x7f9e300b6260 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:55.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.857+0000 7f9e4ca45640 1 --2- 172.21.15.79:0/4200076640 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e4810a260 0x7f9e481a8250 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:55.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.857+0000 7f9e4ca45640 1 --2- 172.21.15.79:0/4200076640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e48109e80 0x7f9e481a7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:55.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.857+0000 7f9e4ca45640 1 -- 172.21.15.79:0/4200076640 >> 172.21.15.79:0/4200076640 conn(0x7f9e4806dcc0 msgr2=0x7f9e4811c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:55.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.858+0000 7f9e4ca45640 1 -- 172.21.15.79:0/4200076640 shutdown_connections 2024-08-20T01:48:55.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:55.858+0000 7f9e4ca45640 1 -- 172.21.15.79:0/4200076640 wait complete. 2024-08-20T01:48:55.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:55 smithi079 ceph-mon[18656]: pgmap v695: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 MiB/s wr, 5.73k op/s 2024-08-20T01:48:56.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:55 smithi081 ceph-mon[22209]: pgmap v695: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 MiB/s wr, 5.73k op/s 2024-08-20T01:48:56.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:55 smithi175 ceph-mon[22392]: pgmap v695: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 MiB/s wr, 5.73k op/s 2024-08-20T01:48:56.902 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.899+0000 7fb6ba4cf640 1 -- 172.21.15.79:0/2670797593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6b41035e0 msgr2=0x7fb6b4103a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:56.902 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.899+0000 7fb6ba4cf640 1 --2- 172.21.15.79:0/2670797593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6b41035e0 0x7fb6b4103a60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb6b0009be0 tx=0x7fb6b002a6f0 comp rx=0 tx=0).stop 2024-08-20T01:48:56.902 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.899+0000 7fb6ba4cf640 1 -- 172.21.15.79:0/2670797593 shutdown_connections 2024-08-20T01:48:56.902 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.899+0000 7fb6ba4cf640 1 --2- 172.21.15.79:0/2670797593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6b4103fa0 0x7fb6b410a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:56.902 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.899+0000 7fb6ba4cf640 1 --2- 172.21.15.79:0/2670797593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6b41035e0 0x7fb6b4103a60 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:56.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.899+0000 7fb6ba4cf640 1 --2- 172.21.15.79:0/2670797593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6b4102490 0x7fb6b4102890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:56.903 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.899+0000 7fb6ba4cf640 1 -- 172.21.15.79:0/2670797593 >> 172.21.15.79:0/2670797593 conn(0x7fb6b40fdd30 msgr2=0x7fb6b4100170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:56.904 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.901+0000 7fb6ba4cf640 1 -- 172.21.15.79:0/2670797593 shutdown_connections 2024-08-20T01:48:56.904 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.901+0000 7fb6ba4cf640 1 -- 172.21.15.79:0/2670797593 wait complete. 2024-08-20T01:48:56.906 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.902+0000 7fb6ba4cf640 1 Processor -- start 2024-08-20T01:48:56.906 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.902+0000 7fb6ba4cf640 1 -- start start 2024-08-20T01:48:56.906 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.903+0000 7fb6ba4cf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6b4102490 0x7fb6b41a75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:56.906 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.903+0000 7fb6ba4cf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6b41035e0 0x7fb6b41a7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:56.906 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.903+0000 7fb6ba4cf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6b4103fa0 0x7fb6b41a8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:56.906 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.903+0000 7fb6b94cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6b4102490 0x7fb6b41a75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:56.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.903+0000 7fb6b94cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6b4102490 0x7fb6b41a75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:38678/0 (socket says 172.21.15.79:38678) 2024-08-20T01:48:56.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.903+0000 7fb6b94cd640 1 -- 172.21.15.79:0/3145689195 learned_addr learned my addr 172.21.15.79:0/3145689195 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:56.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.903+0000 7fb6ba4cf640 1 -- 172.21.15.79:0/3145689195 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b410bdc0 con 0x7fb6b4103fa0 2024-08-20T01:48:56.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.903+0000 7fb6ba4cf640 1 -- 172.21.15.79:0/3145689195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b410bc40 con 0x7fb6b4102490 2024-08-20T01:48:56.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.903+0000 7fb6ba4cf640 1 -- 172.21.15.79:0/3145689195 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b410bf40 con 0x7fb6b41035e0 2024-08-20T01:48:56.907 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.903+0000 7fb6b8ccc640 1 --2- 172.21.15.79:0/3145689195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6b41035e0 0x7fb6b41a7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:56.908 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.904+0000 7fb6b94cd640 1 -- 172.21.15.79:0/3145689195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6b41035e0 msgr2=0x7fb6b41a7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:56.908 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.904+0000 7fb6b94cd640 1 --2- 172.21.15.79:0/3145689195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6b41035e0 0x7fb6b41a7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:56.908 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.904+0000 7fb6b94cd640 1 -- 172.21.15.79:0/3145689195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6b4103fa0 msgr2=0x7fb6b41a8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:56.908 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.904+0000 7fb6b94cd640 1 --2- 172.21.15.79:0/3145689195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6b4103fa0 0x7fb6b41a8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:56.909 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.904+0000 7fb6b94cd640 1 -- 172.21.15.79:0/3145689195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6b41a9110 con 0x7fb6b4102490 2024-08-20T01:48:56.909 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.904+0000 7fb6b94cd640 1 --2- 172.21.15.79:0/3145689195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6b4102490 0x7fb6b41a75d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb6a400daf0 tx=0x7fb6a400af60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:56.909 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.905+0000 7fb6aa7fc640 1 -- 172.21.15.79:0/3145689195 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a401a070 con 0x7fb6b4102490 2024-08-20T01:48:56.909 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.905+0000 7fb6aa7fc640 1 -- 172.21.15.79:0/3145689195 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb6a400cc70 con 0x7fb6b4102490 2024-08-20T01:48:56.909 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.905+0000 7fb6aa7fc640 1 -- 172.21.15.79:0/3145689195 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a4014610 con 0x7fb6b4102490 2024-08-20T01:48:56.909 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.905+0000 7fb6ba4cf640 1 -- 172.21.15.79:0/3145689195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6b41a9400 con 0x7fb6b4102490 2024-08-20T01:48:56.909 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.905+0000 7fb6ba4cf640 1 -- 172.21.15.79:0/3145689195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6b41afad0 con 0x7fb6b4102490 2024-08-20T01:48:56.911 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.909+0000 7fb6be5fa740 1 Processor -- start 2024-08-20T01:48:56.911 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.909+0000 7fb6be5fa740 1 -- start start 2024-08-20T01:48:56.912 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.909+0000 7fb6be5fa740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bab0199a20 0x55bab019be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:56.912 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.909+0000 7fb6be5fa740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bab019c350 0x55bab019e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:56.912 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.909+0000 7fb6be5fa740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bab019ed90 0x55bab01a1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:56.913 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.909+0000 7fb6be5fa740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bab010c360 con 0x55bab019c350 2024-08-20T01:48:56.913 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.909+0000 7fb6be5fa740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bab00fb860 con 0x55bab019ed90 2024-08-20T01:48:56.914 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.909+0000 7fb6be5fa740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55bab00ff8a0 con 0x55bab0199a20 2024-08-20T01:48:56.914 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.910+0000 7fb6b8ccc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bab019ed90 0x55bab01a1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:56.914 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.910+0000 7fb6b8ccc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bab019ed90 0x55bab01a1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:38680/0 (socket says 172.21.15.79:38680) 2024-08-20T01:48:56.914 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.910+0000 7fb6b8ccc640 1 -- 172.21.15.79:0/1941231990 learned_addr learned my addr 172.21.15.79:0/1941231990 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:56.914 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.910+0000 7fb6b9cce640 1 --2- 172.21.15.79:0/1941231990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bab0199a20 0x55bab019be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:56.914 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.910+0000 7fb6aa7fc640 1 -- 172.21.15.79:0/3145689195 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb6a401d070 con 0x7fb6b4102490 2024-08-20T01:48:56.915 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.910+0000 7fb6b9cce640 1 -- 172.21.15.79:0/1941231990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bab019ed90 msgr2=0x55bab01a1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:56.915 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.910+0000 7fb6b9cce640 1 --2- 172.21.15.79:0/1941231990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bab019ed90 0x55bab01a1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:56.915 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.910+0000 7fb6b9cce640 1 -- 172.21.15.79:0/1941231990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bab019c350 msgr2=0x55bab019e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:56.915 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.911+0000 7fb6b94cd640 1 --2- 172.21.15.79:0/1941231990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bab019c350 0x55bab019e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:56.915 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.911+0000 7fb6b9cce640 1 --2- 172.21.15.79:0/1941231990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bab019c350 0x55bab019e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:56.915 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.911+0000 7fb6b9cce640 1 -- 172.21.15.79:0/1941231990 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bab00a2e40 con 0x55bab0199a20 2024-08-20T01:48:56.915 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.911+0000 7fb6b9cce640 1 --2- 172.21.15.79:0/1941231990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bab0199a20 0x55bab019be10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac00b580 tx=0x7fb6ac011f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb31691845136c52 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:56.915 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.912+0000 7fb6aa7fc640 1 --2- 172.21.15.79:0/3145689195 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb6a00b3d20 0x7fb6a00b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:56.915 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.912+0000 7fb6aa7fc640 1 -- 172.21.15.79:0/3145689195 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fb6a40e3000 con 0x7fb6b4102490 2024-08-20T01:48:56.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.912+0000 7fb69f7fe640 1 -- 172.21.15.79:0/1941231990 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac004230 con 0x55bab0199a20 2024-08-20T01:48:56.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.913+0000 7fb69f7fe640 1 -- 172.21.15.79:0/1941231990 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb6ac0043d0 con 0x55bab0199a20 2024-08-20T01:48:56.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.913+0000 7fb69f7fe640 1 -- 172.21.15.79:0/1941231990 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac0110d0 con 0x55bab0199a20 2024-08-20T01:48:56.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.913+0000 7fb6b94cd640 1 --2- 172.21.15.79:0/3145689195 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb6a00b3d20 0x7fb6a00b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:56.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.914+0000 7fb6be5fa740 1 -- 172.21.15.79:0/1941231990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bab0199a20 msgr2=0x55bab019be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:56.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.914+0000 7fb6be5fa740 1 --2- 172.21.15.79:0/1941231990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bab0199a20 0x55bab019be10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac00b580 tx=0x7fb6ac011f90 comp rx=0 tx=0).stop 2024-08-20T01:48:56.917 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.914+0000 7fb6b94cd640 1 --2- 172.21.15.79:0/3145689195 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb6a00b3d20 0x7fb6a00b61e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb6a400dfd0 tx=0x7fb6a4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:56.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.915+0000 7fb6be5fa740 1 -- 172.21.15.79:0/1941231990 shutdown_connections 2024-08-20T01:48:56.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.915+0000 7fb6be5fa740 1 --2- 172.21.15.79:0/1941231990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bab019ed90 0x55bab01a1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:56.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.915+0000 7fb6be5fa740 1 --2- 172.21.15.79:0/1941231990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bab019c350 0x55bab019e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:56.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.915+0000 7fb6be5fa740 1 --2- 172.21.15.79:0/1941231990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bab0199a20 0x55bab019be10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:56.918 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.915+0000 7fb6be5fa740 1 -- 172.21.15.79:0/1941231990 >> 172.21.15.79:0/1941231990 conn(0x55bab0194b70 msgr2=0x55bab0195900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:56.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.916+0000 7fb6be5fa740 1 -- 172.21.15.79:0/1941231990 shutdown_connections 2024-08-20T01:48:56.919 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.917+0000 7fb6be5fa740 1 -- 172.21.15.79:0/1941231990 wait complete. 2024-08-20T01:48:56.920 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.918+0000 7fb6be5fa740 1 -- start start 2024-08-20T01:48:56.921 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.918+0000 7fb6be5fa740 1 Processor -- start 2024-08-20T01:48:56.922 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.919+0000 7fb6be5fa740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bab0199a20 0x55bab01a32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:56.922 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.919+0000 7fb6be5fa740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bab019c350 0x55bab01a3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:56.922 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.919+0000 7fb6be5fa740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bab019ed90 0x55bab01a4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:56.922 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.919+0000 7fb6be5fa740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bab0034ab0 con 0x55bab0199a20 2024-08-20T01:48:56.922 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.919+0000 7fb6be5fa740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bab0082780 con 0x55bab019ed90 2024-08-20T01:48:56.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.919+0000 7fb6be5fa740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55bab01a1d70 con 0x55bab019c350 2024-08-20T01:48:56.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.919+0000 7fb6b9cce640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bab0199a20 0x55bab01a32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:56.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.919+0000 7fb6be5fa740 10 client.0 _ll_register_callbacks cb 0x55baafe0aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:48:56.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.919+0000 7fb6b9cce640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bab0199a20 0x55bab01a32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49118/0 (socket says 172.21.15.79:49118) 2024-08-20T01:48:56.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.919+0000 7fb6b9cce640 1 -- 172.21.15.79:0/3486484494 learned_addr learned my addr 172.21.15.79:0/3486484494 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:56.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.920+0000 7fb6b8ccc640 1 --2- 172.21.15.79:0/3486484494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bab019c350 0x55bab01a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:56.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.920+0000 7fb6b9cce640 1 --2- 172.21.15.79:0/3486484494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bab019ed90 0x55bab01a4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:56.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.920+0000 7fb6b8ccc640 1 -- 172.21.15.79:0/3486484494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bab019ed90 msgr2=0x55bab01a4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:56.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.920+0000 7fb6b8ccc640 1 --2- 172.21.15.79:0/3486484494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bab019ed90 0x55bab01a4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:56.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.920+0000 7fb6b8ccc640 1 -- 172.21.15.79:0/3486484494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bab0199a20 msgr2=0x55bab01a32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:56.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.920+0000 7fb6b8ccc640 1 --2- 172.21.15.79:0/3486484494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bab0199a20 0x55bab01a32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:56.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.921+0000 7fb6b8ccc640 1 -- 172.21.15.79:0/3486484494 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55baafe5e790 con 0x55bab019c350 2024-08-20T01:48:56.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.921+0000 7fb6b8ccc640 1 --2- 172.21.15.79:0/3486484494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bab019c350 0x55bab01a3940 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb6b00308f0 tx=0x7fb6b00305b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d121d92cc5f7706 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:56.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.921+0000 7fb69cff9640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:48:56.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.922+0000 7fb69cff9640 1 -- 172.21.15.79:0/3486484494 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b0042070 con 0x55bab019c350 2024-08-20T01:48:56.926 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.922+0000 7fb6be5fa740 1 -- 172.21.15.79:0/3486484494 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bab00aae00 con 0x55bab019c350 2024-08-20T01:48:56.926 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.922+0000 7fb69cff9640 1 -- 172.21.15.79:0/3486484494 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fb6b0003970 con 0x55bab019c350 2024-08-20T01:48:56.926 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.923+0000 7fb69cff9640 1 -- 172.21.15.79:0/3486484494 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fb6b0036070 con 0x55bab019c350 2024-08-20T01:48:56.926 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.923+0000 7fb6be5fa740 10 client.27532 fetch_fsmap learned FSMap version 49 2024-08-20T01:48:56.926 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.923+0000 7fb6be5fa740 1 -- 172.21.15.79:0/3486484494 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55baafed7620 con 0x55bab019c350 2024-08-20T01:48:56.926 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.924+0000 7fb69cff9640 1 -- 172.21.15.79:0/3486484494 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb6b0037040 con 0x55bab019c350 2024-08-20T01:48:56.928 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.925+0000 7fb69cff9640 1 -- 172.21.15.79:0/3486484494 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 49) ==== 8378+0+0 (secure 0 0 0) 0x7fb6b0031440 con 0x55bab019c350 2024-08-20T01:48:56.928 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.925+0000 7fb6be5fa740 10 client.27532 fetch_fsmap finished waiting for FSMap version 49 2024-08-20T01:48:56.928 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.925+0000 7fb6be5fa740 10 client.27532 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:48:56.928 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.925+0000 7fb6be5fa740 20 client.27532 populate_metadata read hostname 'smithi079' 2024-08-20T01:48:56.929 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.925+0000 7fb6be5fa740 1 --2- 172.21.15.79:0/3486484494 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55bab01aef90 0x55bab01b13d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:56.929 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.926+0000 7fb6be5fa740 4 client.27532 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:48:56.929 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.926+0000 7fb6be5fa740 1 -- 172.21.15.79:0/3486484494 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bab00aae00 con 0x55bab01aef90 2024-08-20T01:48:56.929 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.926+0000 7fb6b9cce640 1 --2- 172.21.15.79:0/3486484494 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55bab01aef90 0x55bab01b13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:56.930 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.927+0000 7fb6b9cce640 1 --2- 172.21.15.79:0/3486484494 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55bab01aef90 0x55bab01b13d0 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efff7677197aebb6 server_cookie=610565aece995bb4 in_seq=0 out_seq=0 2024-08-20T01:48:56.930 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.927+0000 7fb69cff9640 10 client.27532 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:56.930 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.928+0000 7fb69cff9640 1 -- 172.21.15.79:0/3486484494 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bab00aae00 con 0x55bab01aef90 2024-08-20T01:48:56.931 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.928+0000 7fb69cff9640 10 client.27532 handle_command_reply: tid=0 2024-08-20T01:48:56.931 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.928+0000 7fb6be5fa740 1 client.27532 shutdown 2024-08-20T01:48:56.931 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.928+0000 7fb6be5fa740 1 -- 172.21.15.79:0/3486484494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bab019c350 msgr2=0x55bab01a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:56.931 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.928+0000 7fb6be5fa740 1 --2- 172.21.15.79:0/3486484494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bab019c350 0x55bab01a3940 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb6b00308f0 tx=0x7fb6b00305b0 comp rx=0 tx=0).stop 2024-08-20T01:48:56.931 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.929+0000 7fb6be5fa740 1 -- 172.21.15.79:0/3486484494 shutdown_connections 2024-08-20T01:48:56.931 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.929+0000 7fb6be5fa740 1 --2- 172.21.15.79:0/3486484494 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55bab01aef90 0x55bab01b13d0 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:56.932 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.929+0000 7fb6be5fa740 1 --2- 172.21.15.79:0/3486484494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bab019ed90 0x55bab01a4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:56.932 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.929+0000 7fb6be5fa740 1 --2- 172.21.15.79:0/3486484494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bab019c350 0x55bab01a3940 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:56.932 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.929+0000 7fb6be5fa740 1 --2- 172.21.15.79:0/3486484494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bab0199a20 0x55bab01a32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:56.932 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.929+0000 7fb6be5fa740 1 -- 172.21.15.79:0/3486484494 >> 172.21.15.79:0/3486484494 conn(0x55bab0194b70 msgr2=0x55bab0193c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.929+0000 7fb69cff9640 0 client.27532 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.930+0000 7fb6be5fa740 1 -- 172.21.15.79:0/3486484494 shutdown_connections 2024-08-20T01:48:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.930+0000 7fb6be5fa740 1 -- 172.21.15.79:0/3486484494 wait complete. 2024-08-20T01:48:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.931+0000 7fb6be5fa740 20 client.27532 trim_cache size 0 max 16384 2024-08-20T01:48:56.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.964+0000 7fb6be5fa740 1 Processor -- start 2024-08-20T01:48:56.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.964+0000 7fb6be5fa740 1 -- start start 2024-08-20T01:48:56.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.964+0000 7fb6be5fa740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bab0199a20 0x55bab01953d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:56.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.964+0000 7fb6be5fa740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bab019c350 0x55bab0195910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:56.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.964+0000 7fb6be5fa740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bab019ed90 0x55bab019f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:56.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.964+0000 7fb6be5fa740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b41b8620 con 0x55bab0199a20 2024-08-20T01:48:56.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.964+0000 7fb6be5fa740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b41ba220 con 0x55bab019c350 2024-08-20T01:48:56.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.964+0000 7fb6be5fa740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b41b8db0 con 0x55bab019ed90 2024-08-20T01:48:56.968 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.965+0000 7fb6b8ccc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bab019c350 0x55bab0195910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:56.969 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.965+0000 7fb6b8ccc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bab019c350 0x55bab0195910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:38696/0 (socket says 172.21.15.79:38696) 2024-08-20T01:48:56.969 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.965+0000 7fb6b8ccc640 1 -- 172.21.15.79:0/4044195885 learned_addr learned my addr 172.21.15.79:0/4044195885 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:56.969 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.965+0000 7fb6b9cce640 1 --2- 172.21.15.79:0/4044195885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bab019ed90 0x55bab019f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:56.969 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.965+0000 7fb6b8ccc640 1 -- 172.21.15.79:0/4044195885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bab019ed90 msgr2=0x55bab019f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:56.969 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.965+0000 7fb6b9cce640 1 --2- 172.21.15.79:0/4044195885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bab0199a20 0x55bab01953d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:56.969 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.965+0000 7fb6b8ccc640 1 --2- 172.21.15.79:0/4044195885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bab019ed90 0x55bab019f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:56.969 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.965+0000 7fb6b8ccc640 1 -- 172.21.15.79:0/4044195885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bab0199a20 msgr2=0x55bab01953d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:56.969 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.965+0000 7fb6b8ccc640 1 --2- 172.21.15.79:0/4044195885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bab0199a20 0x55bab01953d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:56.969 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.965+0000 7fb6b8ccc640 1 -- 172.21.15.79:0/4044195885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bab019eab0 con 0x55bab019c350 2024-08-20T01:48:56.969 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.965+0000 7fb6b9cce640 1 --2- 172.21.15.79:0/4044195885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bab0199a20 0x55bab01953d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:48:56.969 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.966+0000 7fb6b8ccc640 1 --2- 172.21.15.79:0/4044195885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bab019c350 0x55bab0195910 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb6b002ac10 tx=0x7fb6b0000f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cead83f488b1a6aa server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:56.969 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.966+0000 7fb69effd640 1 -- 172.21.15.79:0/4044195885 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b0055020 con 0x55bab019c350 2024-08-20T01:48:56.970 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.966+0000 7fb69effd640 1 -- 172.21.15.79:0/4044195885 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb6b0031cd0 con 0x55bab019c350 2024-08-20T01:48:56.970 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.967+0000 7fb6be5fa740 1 -- 172.21.15.79:0/4044195885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bab019c350 msgr2=0x55bab0195910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:56.970 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.967+0000 7fb6be5fa740 1 --2- 172.21.15.79:0/4044195885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bab019c350 0x55bab0195910 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb6b002ac10 tx=0x7fb6b0000f40 comp rx=0 tx=0).stop 2024-08-20T01:48:56.970 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.967+0000 7fb6be5fa740 1 -- 172.21.15.79:0/4044195885 shutdown_connections 2024-08-20T01:48:56.970 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.967+0000 7fb6be5fa740 1 --2- 172.21.15.79:0/4044195885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bab019ed90 0x55bab019f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:56.971 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.967+0000 7fb6be5fa740 1 --2- 172.21.15.79:0/4044195885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bab019c350 0x55bab0195910 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:56.971 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.967+0000 7fb6be5fa740 1 --2- 172.21.15.79:0/4044195885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bab0199a20 0x55bab01953d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:56.971 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.967+0000 7fb6be5fa740 1 -- 172.21.15.79:0/4044195885 >> 172.21.15.79:0/4044195885 conn(0x55bab0194b70 msgr2=0x55bab01a2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:56.971 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.968+0000 7fb6be5fa740 1 -- 172.21.15.79:0/4044195885 shutdown_connections 2024-08-20T01:48:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.968+0000 7fb6be5fa740 1 -- 172.21.15.79:0/4044195885 wait complete. 2024-08-20T01:48:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.969+0000 7fb6be5fa740 1 -- start start 2024-08-20T01:48:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.969+0000 7fb6be5fa740 1 Processor -- start 2024-08-20T01:48:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.969+0000 7fb6be5fa740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bab0199a20 0x55bab01a7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.969+0000 7fb6be5fa740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bab019ed90 0x55bab01a8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.969+0000 7fb6be5fa740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bab01a8de0 0x55bab01a9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.969+0000 7fb6be5fa740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b41b9b50 con 0x55bab01a8de0 2024-08-20T01:48:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.969+0000 7fb6be5fa740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b41b9480 con 0x55bab019ed90 2024-08-20T01:48:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.969+0000 7fb6be5fa740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b41b66b0 con 0x55bab0199a20 2024-08-20T01:48:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.969+0000 7fb6be5fa740 10 client.0 _ll_register_callbacks cb 0x7fb6ac005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:48:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.970+0000 7fb6b9cce640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bab01a8de0 0x55bab01a9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.970+0000 7fb6b9cce640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bab01a8de0 0x55bab01a9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49138/0 (socket says 172.21.15.79:49138) 2024-08-20T01:48:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.970+0000 7fb6b8ccc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bab019ed90 0x55bab01a8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.970+0000 7fb6b9cce640 1 -- 172.21.15.79:0/1370070268 learned_addr learned my addr 172.21.15.79:0/1370070268 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.970+0000 7fb6b9cce640 1 --2- 172.21.15.79:0/1370070268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bab0199a20 0x55bab01a7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:56.975 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.970+0000 7fb6b8ccc640 1 -- 172.21.15.79:0/1370070268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bab0199a20 msgr2=0x55bab01a7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:56.975 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.970+0000 7fb6b8ccc640 1 --2- 172.21.15.79:0/1370070268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bab0199a20 0x55bab01a7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:56.975 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.970+0000 7fb6b8ccc640 1 -- 172.21.15.79:0/1370070268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bab01a8de0 msgr2=0x55bab01a9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:56.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.970+0000 7fb6b8ccc640 1 --2- 172.21.15.79:0/1370070268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bab01a8de0 0x55bab01a9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:56.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.970+0000 7fb6b8ccc640 1 -- 172.21.15.79:0/1370070268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bab01a9a90 con 0x55bab019ed90 2024-08-20T01:48:56.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.971+0000 7fb6b8ccc640 1 --2- 172.21.15.79:0/1370070268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bab019ed90 0x55bab01a8320 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb6b0031a50 tx=0x7fb6b0051660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=554a9e475691b541 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:56.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.971+0000 7fb69cff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:48:56.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.971+0000 7fb69cff9640 1 -- 172.21.15.79:0/1370070268 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b005f060 con 0x55bab019ed90 2024-08-20T01:48:56.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.971+0000 7fb69cff9640 1 -- 172.21.15.79:0/1370070268 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fb6b0051c60 con 0x55bab019ed90 2024-08-20T01:48:56.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.971+0000 7fb6be5fa740 1 -- 172.21.15.79:0/1370070268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bab010e2b0 con 0x55bab019ed90 2024-08-20T01:48:56.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.971+0000 7fb69cff9640 1 -- 172.21.15.79:0/1370070268 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fb6b0055030 con 0x55bab019ed90 2024-08-20T01:48:56.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.971+0000 7fb6be5fa740 10 client.27578 fetch_fsmap learned FSMap version 49 2024-08-20T01:48:56.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.971+0000 7fb6be5fa740 1 -- 172.21.15.79:0/1370070268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55bab01aad70 con 0x55bab019ed90 2024-08-20T01:48:56.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.972+0000 7fb69cff9640 1 -- 172.21.15.79:0/1370070268 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55bab010e2b0 con 0x55bab019ed90 2024-08-20T01:48:56.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.972+0000 7fb69cff9640 1 -- 172.21.15.79:0/1370070268 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 49) ==== 8378+0+0 (secure 0 0 0) 0x7fb6b005a8e0 con 0x55bab019ed90 2024-08-20T01:48:56.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.972+0000 7fb6be5fa740 10 client.27578 fetch_fsmap finished waiting for FSMap version 49 2024-08-20T01:48:56.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.972+0000 7fb6be5fa740 10 client.27578 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:48:56.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.972+0000 7fb6be5fa740 20 client.27578 populate_metadata read hostname 'smithi079' 2024-08-20T01:48:56.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.972+0000 7fb6be5fa740 1 --2- 172.21.15.79:0/1370070268 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55bab0219e50 0x55bab021c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:56.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.972+0000 7fb6be5fa740 4 client.27578 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:48:56.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.972+0000 7fb6be5fa740 1 -- 172.21.15.79:0/1370070268 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bab0109d50 con 0x55bab0219e50 2024-08-20T01:48:56.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.972+0000 7fb6b9cce640 1 --2- 172.21.15.79:0/1370070268 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55bab0219e50 0x55bab021c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:56.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.973+0000 7fb69cff9640 10 client.27578 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:56.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:56.973+0000 7fb6b9cce640 1 --2- 172.21.15.79:0/1370070268 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55bab0219e50 0x55bab021c270 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15b21d986aa1ef7d server_cookie=f8bc6401cda5bfdb in_seq=0 out_seq=0 2024-08-20T01:48:57.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:57.095+0000 7fb69cff9640 1 -- 172.21.15.79:0/1370070268 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bab0109d50 con 0x55bab0219e50 2024-08-20T01:48:57.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:57.095+0000 7fb69cff9640 10 client.27578 handle_command_reply: tid=0 2024-08-20T01:48:57.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:57.095+0000 7fb6be5fa740 1 client.27578 shutdown 2024-08-20T01:48:57.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:57.095+0000 7fb6be5fa740 1 -- 172.21.15.79:0/1370070268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bab019ed90 msgr2=0x55bab01a8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:57.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:57.095+0000 7fb6be5fa740 1 --2- 172.21.15.79:0/1370070268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bab019ed90 0x55bab01a8320 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb6b0031a50 tx=0x7fb6b0051660 comp rx=0 tx=0).stop 2024-08-20T01:48:57.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:57.095+0000 7fb6be5fa740 1 -- 172.21.15.79:0/1370070268 shutdown_connections 2024-08-20T01:48:57.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:57.095+0000 7fb6be5fa740 1 --2- 172.21.15.79:0/1370070268 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55bab0219e50 0x55bab021c270 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:57.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:57.095+0000 7fb6be5fa740 1 --2- 172.21.15.79:0/1370070268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bab01a8de0 0x55bab01a9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:57.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:57.095+0000 7fb6be5fa740 1 --2- 172.21.15.79:0/1370070268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bab019ed90 0x55bab01a8320 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:57.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:57.095+0000 7fb6be5fa740 1 --2- 172.21.15.79:0/1370070268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bab0199a20 0x55bab01a7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:57.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:57.095+0000 7fb6be5fa740 1 -- 172.21.15.79:0/1370070268 >> 172.21.15.79:0/1370070268 conn(0x55bab0194b70 msgr2=0x55bab01953d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:57.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:57.095+0000 7fb69cff9640 0 client.27578 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:57.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:57.098+0000 7fb6be5fa740 1 -- 172.21.15.79:0/1370070268 shutdown_connections 2024-08-20T01:48:57.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:57.098+0000 7fb6be5fa740 1 -- 172.21.15.79:0/1370070268 wait complete. 2024-08-20T01:48:57.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:57.098+0000 7fb6be5fa740 20 client.27578 trim_cache size 0 max 16384 2024-08-20T01:48:57.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:48:57.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:48:57.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:48:57.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:48:57.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:57.101+0000 7fb6ba4cf640 1 -- 172.21.15.79:0/3145689195 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb6a00b3d20 msgr2=0x7fb6a00b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:57.103 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:57.101+0000 7fb6ba4cf640 1 --2- 172.21.15.79:0/3145689195 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb6a00b3d20 0x7fb6a00b61e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb6a400dfd0 tx=0x7fb6a4000bc0 comp rx=0 tx=0).stop 2024-08-20T01:48:57.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:57.101+0000 7fb6ba4cf640 1 -- 172.21.15.79:0/3145689195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6b4102490 msgr2=0x7fb6b41a75d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:57.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:57.101+0000 7fb6ba4cf640 1 --2- 172.21.15.79:0/3145689195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6b4102490 0x7fb6b41a75d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb6a400daf0 tx=0x7fb6a400af60 comp rx=0 tx=0).stop 2024-08-20T01:48:57.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:57.102+0000 7fb6ba4cf640 1 -- 172.21.15.79:0/3145689195 shutdown_connections 2024-08-20T01:48:57.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:57.102+0000 7fb6ba4cf640 1 --2- 172.21.15.79:0/3145689195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6b4103fa0 0x7fb6b41a8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:57.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:57.102+0000 7fb6ba4cf640 1 --2- 172.21.15.79:0/3145689195 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb6a00b3d20 0x7fb6a00b61e0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:57.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:57.102+0000 7fb6ba4cf640 1 --2- 172.21.15.79:0/3145689195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6b41035e0 0x7fb6b41a7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:57.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:57.102+0000 7fb6ba4cf640 1 --2- 172.21.15.79:0/3145689195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6b4102490 0x7fb6b41a75d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:57.106 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:57.102+0000 7fb6ba4cf640 1 -- 172.21.15.79:0/3145689195 >> 172.21.15.79:0/3145689195 conn(0x7fb6b40fdd30 msgr2=0x7fb6b4106a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:57.106 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:57.102+0000 7fb6ba4cf640 1 -- 172.21.15.79:0/3145689195 shutdown_connections 2024-08-20T01:48:57.106 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:48:57.103+0000 7fb6ba4cf640 1 -- 172.21.15.79:0/3145689195 wait complete. 2024-08-20T01:48:57.744 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T01:48:57.744 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T01:48:58.186 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:48:58.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:57 smithi079 ceph-mon[18656]: pgmap v696: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 22 MiB/s wr, 5.69k op/s 2024-08-20T01:48:58.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:57 smithi081 ceph-mon[22209]: pgmap v696: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 22 MiB/s wr, 5.69k op/s 2024-08-20T01:48:58.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:57 smithi175 ceph-mon[22392]: pgmap v696: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 22 MiB/s wr, 5.69k op/s 2024-08-20T01:48:58.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.821+0000 7fe800985640 1 -- 172.21.15.79:0/3521824176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7f409bbb0 msgr2=0x7fe7f40a23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:58.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.821+0000 7fe800985640 1 --2- 172.21.15.79:0/3521824176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7f409bbb0 0x7fe7f40a23d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc068900 tx=0x7fe7fc097b40 comp rx=0 tx=0).stop 2024-08-20T01:48:58.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.821+0000 7fe800985640 1 -- 172.21.15.79:0/3521824176 shutdown_connections 2024-08-20T01:48:58.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.821+0000 7fe800985640 1 --2- 172.21.15.79:0/3521824176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7f409bbb0 0x7fe7f40a23d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:58.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.821+0000 7fe800985640 1 --2- 172.21.15.79:0/3521824176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7f409b250 0x7fe7f409b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:58.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.821+0000 7fe800985640 1 --2- 172.21.15.79:0/3521824176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7f4004f50 0x7fe7f4005330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:58.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.821+0000 7fe800985640 1 -- 172.21.15.79:0/3521824176 >> 172.21.15.79:0/3521824176 conn(0x7fe7f400a150 msgr2=0x7fe7f400c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:58.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.821+0000 7fe800985640 1 -- 172.21.15.79:0/3521824176 shutdown_connections 2024-08-20T01:48:58.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.821+0000 7fe800985640 1 -- 172.21.15.79:0/3521824176 wait complete. 2024-08-20T01:48:58.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.822+0000 7fe800985640 1 Processor -- start 2024-08-20T01:48:58.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.822+0000 7fe800985640 1 -- start start 2024-08-20T01:48:58.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.823+0000 7fe800985640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7f4004f50 0x7fe7f40a17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:58.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.823+0000 7fe800985640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7f409b250 0x7fe7f40a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:58.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.823+0000 7fe800985640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7f409bbb0 0x7fe7f41379a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:58.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.823+0000 7fe800985640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f40a5640 con 0x7fe7f4004f50 2024-08-20T01:48:58.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.823+0000 7fe800985640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f40a54c0 con 0x7fe7f409bbb0 2024-08-20T01:48:58.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.823+0000 7fe800985640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f40a57c0 con 0x7fe7f409b250 2024-08-20T01:48:58.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.823+0000 7fe7fbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7f409bbb0 0x7fe7f41379a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:58.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.823+0000 7fe7fb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7f4004f50 0x7fe7f40a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:58.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.823+0000 7fe7fbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7f409bbb0 0x7fe7f41379a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:38732/0 (socket says 172.21.15.79:38732) 2024-08-20T01:48:58.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.823+0000 7fe7fbfff640 1 -- 172.21.15.79:0/4196014343 learned_addr learned my addr 172.21.15.79:0/4196014343 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:58.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.824+0000 7fe7faffd640 1 --2- 172.21.15.79:0/4196014343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7f409b250 0x7fe7f40a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:58.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.824+0000 7fe7fbfff640 1 -- 172.21.15.79:0/4196014343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7f409b250 msgr2=0x7fe7f40a1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:58.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.824+0000 7fe7fbfff640 1 --2- 172.21.15.79:0/4196014343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7f409b250 0x7fe7f40a1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:58.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.824+0000 7fe7fbfff640 1 -- 172.21.15.79:0/4196014343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7f4004f50 msgr2=0x7fe7f40a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:58.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.824+0000 7fe7fbfff640 1 --2- 172.21.15.79:0/4196014343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7f4004f50 0x7fe7f40a17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:58.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.824+0000 7fe7fbfff640 1 -- 172.21.15.79:0/4196014343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7f41381c0 con 0x7fe7f409bbb0 2024-08-20T01:48:58.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.824+0000 7fe7fb7fe640 1 --2- 172.21.15.79:0/4196014343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7f4004f50 0x7fe7f40a17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:48:58.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.824+0000 7fe7fbfff640 1 --2- 172.21.15.79:0/4196014343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7f409bbb0 0x7fe7f41379a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc0525c0 tx=0x7fe7fc0a4990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:58.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.824+0000 7fe7f8ff9640 1 -- 172.21.15.79:0/4196014343 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc0b2070 con 0x7fe7f409bbb0 2024-08-20T01:48:58.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.824+0000 7fe7f8ff9640 1 -- 172.21.15.79:0/4196014343 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe7fc0a4cd0 con 0x7fe7f409bbb0 2024-08-20T01:48:58.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.824+0000 7fe800985640 1 -- 172.21.15.79:0/4196014343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7f4138450 con 0x7fe7f409bbb0 2024-08-20T01:48:58.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.825+0000 7fe800985640 1 -- 172.21.15.79:0/4196014343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7f413eb20 con 0x7fe7f409bbb0 2024-08-20T01:48:58.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.825+0000 7fe7f8ff9640 1 -- 172.21.15.79:0/4196014343 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc09e040 con 0x7fe7f409bbb0 2024-08-20T01:48:58.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.828+0000 7fe803fe0740 1 Processor -- start 2024-08-20T01:48:58.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.829+0000 7fe7f8ff9640 1 -- 172.21.15.79:0/4196014343 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fe7fc0b5070 con 0x7fe7f409bbb0 2024-08-20T01:48:58.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.829+0000 7fe803fe0740 1 -- start start 2024-08-20T01:48:58.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.829+0000 7fe803fe0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559acd302530 0x559acd302910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:58.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.829+0000 7fe803fe0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559acd302e50 0x559acd31f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:58.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.829+0000 7fe803fe0740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acd31fdf0 0x559acd3221e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:58.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.829+0000 7fe803fe0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559acd278940 con 0x559acd302530 2024-08-20T01:48:58.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.829+0000 7fe803fe0740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559acd267e40 con 0x559acd31fdf0 2024-08-20T01:48:58.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.829+0000 7fe803fe0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559acd26be80 con 0x559acd302e50 2024-08-20T01:48:58.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.830+0000 7fe7faffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acd31fdf0 0x559acd3221e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:58.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.830+0000 7fe7faffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acd31fdf0 0x559acd3221e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:38736/0 (socket says 172.21.15.79:38736) 2024-08-20T01:48:58.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.830+0000 7fe7faffd640 1 -- 172.21.15.79:0/728029946 learned_addr learned my addr 172.21.15.79:0/728029946 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:58.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.830+0000 7fe7faffd640 1 --2- 172.21.15.79:0/728029946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559acd302530 0x559acd302910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:58.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.830+0000 7fe7faffd640 1 -- 172.21.15.79:0/728029946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559acd302e50 msgr2=0x559acd31f8b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:48:58.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.830+0000 7fe7faffd640 1 --2- 172.21.15.79:0/728029946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559acd302e50 0x559acd31f8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:58.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.830+0000 7fe7faffd640 1 -- 172.21.15.79:0/728029946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559acd302530 msgr2=0x559acd302910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:58.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.830+0000 7fe7faffd640 1 --2- 172.21.15.79:0/728029946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559acd302530 0x559acd302910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:58.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.830+0000 7fe7faffd640 1 -- 172.21.15.79:0/728029946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559acd204520 con 0x559acd31fdf0 2024-08-20T01:48:58.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.831+0000 7fe7faffd640 1 --2- 172.21.15.79:0/728029946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acd31fdf0 0x559acd3221e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8035860 tx=0x7fe7e80303e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13c22e1713b76d91 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:58.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.831+0000 7fe7f8ff9640 1 --2- 172.21.15.79:0/4196014343 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe7ec0b3d10 0x7fe7ec0b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:58.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.831+0000 7fe7e5ffb640 1 -- 172.21.15.79:0/728029946 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e800b660 con 0x559acd31fdf0 2024-08-20T01:48:58.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.831+0000 7fe7e5ffb640 1 -- 172.21.15.79:0/728029946 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe7e800bc90 con 0x559acd31fdf0 2024-08-20T01:48:58.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.831+0000 7fe7e5ffb640 1 -- 172.21.15.79:0/728029946 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e8033880 con 0x559acd31fdf0 2024-08-20T01:48:58.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.831+0000 7fe7f8ff9640 1 -- 172.21.15.79:0/4196014343 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fe7fc1715d0 con 0x7fe7f409bbb0 2024-08-20T01:48:58.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.832+0000 7fe803fe0740 1 -- 172.21.15.79:0/728029946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acd31fdf0 msgr2=0x559acd3221e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:58.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.832+0000 7fe803fe0740 1 --2- 172.21.15.79:0/728029946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acd31fdf0 0x559acd3221e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8035860 tx=0x7fe7e80303e0 comp rx=0 tx=0).stop 2024-08-20T01:48:58.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.833+0000 7fe803fe0740 1 -- 172.21.15.79:0/728029946 shutdown_connections 2024-08-20T01:48:58.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.833+0000 7fe803fe0740 1 --2- 172.21.15.79:0/728029946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acd31fdf0 0x559acd3221e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:58.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.833+0000 7fe803fe0740 1 --2- 172.21.15.79:0/728029946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559acd302e50 0x559acd31f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:58.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.833+0000 7fe803fe0740 1 --2- 172.21.15.79:0/728029946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559acd302530 0x559acd302910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:58.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.833+0000 7fe803fe0740 1 -- 172.21.15.79:0/728029946 >> 172.21.15.79:0/728029946 conn(0x559acd300360 msgr2=0x559acd301500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:58.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.834+0000 7fe803fe0740 1 -- 172.21.15.79:0/728029946 shutdown_connections 2024-08-20T01:48:58.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.834+0000 7fe803fe0740 1 -- 172.21.15.79:0/728029946 wait complete. 2024-08-20T01:48:58.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.835+0000 7fe803fe0740 1 -- start start 2024-08-20T01:48:58.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.835+0000 7fe7fb7fe640 1 --2- 172.21.15.79:0/4196014343 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe7ec0b3d10 0x7fe7ec0b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:58.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.835+0000 7fe803fe0740 1 Processor -- start 2024-08-20T01:48:58.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.836+0000 7fe803fe0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559acd302530 0x559acd30c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:58.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.836+0000 7fe803fe0740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acd302e50 0x559acd30caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:58.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.836+0000 7fe7fb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559acd302530 0x559acd30c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:58.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.836+0000 7fe7fb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559acd302530 0x559acd30c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49170/0 (socket says 172.21.15.79:49170) 2024-08-20T01:48:58.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.836+0000 7fe7fb7fe640 1 -- 172.21.15.79:0/867050814 learned_addr learned my addr 172.21.15.79:0/867050814 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:58.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.836+0000 7fe803fe0740 1 --2- 172.21.15.79:0/867050814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559acd31fdf0 0x559acd311c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:58.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.836+0000 7fe7faffd640 1 --2- 172.21.15.79:0/867050814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acd302e50 0x559acd30caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:58.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.836+0000 7fe803fe0740 1 -- 172.21.15.79:0/867050814 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559acd0ca890 con 0x559acd302530 2024-08-20T01:48:58.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.836+0000 7fe803fe0740 1 -- 172.21.15.79:0/867050814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559acd1ee700 con 0x559acd302e50 2024-08-20T01:48:58.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.836+0000 7fe803fe0740 1 -- 172.21.15.79:0/867050814 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559acd308ae0 con 0x559acd31fdf0 2024-08-20T01:48:58.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.836+0000 7fe803fe0740 10 client.0 _ll_register_callbacks cb 0x559acd2636f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:48:58.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.836+0000 7fe7fbfff640 1 --2- 172.21.15.79:0/867050814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559acd31fdf0 0x559acd311c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:58.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.837+0000 7fe7faffd640 1 -- 172.21.15.79:0/867050814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559acd31fdf0 msgr2=0x559acd311c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:58.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.837+0000 7fe7fb7fe640 1 --2- 172.21.15.79:0/4196014343 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe7ec0b3d10 0x7fe7ec0b61d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x559acd301240 tx=0x7fe7f0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:58.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.837+0000 7fe7faffd640 1 --2- 172.21.15.79:0/867050814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559acd31fdf0 0x559acd311c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:58.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.837+0000 7fe7faffd640 1 -- 172.21.15.79:0/867050814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559acd302530 msgr2=0x559acd30c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:58.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.837+0000 7fe7faffd640 1 --2- 172.21.15.79:0/867050814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559acd302530 0x559acd30c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:58.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.837+0000 7fe7faffd640 1 -- 172.21.15.79:0/867050814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559accfc7930 con 0x559acd302e50 2024-08-20T01:48:58.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.837+0000 7fe7fbfff640 1 --2- 172.21.15.79:0/867050814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559acd31fdf0 0x559acd311c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:48:58.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.837+0000 7fe7faffd640 1 --2- 172.21.15.79:0/867050814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acd302e50 0x559acd30caa0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8035860 tx=0x7fe7e8030d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5d48e4954448c0b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:58.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.837+0000 7fe7daffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:48:58.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.837+0000 7fe7daffd640 1 -- 172.21.15.79:0/867050814 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e800b860 con 0x559acd302e50 2024-08-20T01:48:58.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.837+0000 7fe7daffd640 1 -- 172.21.15.79:0/867050814 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fe7e800ba00 con 0x559acd302e50 2024-08-20T01:48:58.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.837+0000 7fe803fe0740 1 -- 172.21.15.79:0/867050814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7e800bc90 con 0x559acd302e50 2024-08-20T01:48:58.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.838+0000 7fe7daffd640 1 -- 172.21.15.79:0/867050814 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fe7e8005750 con 0x559acd302e50 2024-08-20T01:48:58.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.838+0000 7fe803fe0740 10 client.27590 fetch_fsmap learned FSMap version 49 2024-08-20T01:48:58.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.838+0000 7fe803fe0740 1 -- 172.21.15.79:0/867050814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x559acd31ac30 con 0x559acd302e50 2024-08-20T01:48:58.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.838+0000 7fe7daffd640 1 -- 172.21.15.79:0/867050814 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe7e800bc90 con 0x559acd302e50 2024-08-20T01:48:58.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.838+0000 7fe7daffd640 1 -- 172.21.15.79:0/867050814 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 49) ==== 8378+0+0 (secure 0 0 0) 0x7fe7e803f070 con 0x559acd302e50 2024-08-20T01:48:58.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.838+0000 7fe803fe0740 10 client.27590 fetch_fsmap finished waiting for FSMap version 49 2024-08-20T01:48:58.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.838+0000 7fe803fe0740 10 client.27590 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:48:58.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.838+0000 7fe803fe0740 20 client.27590 populate_metadata read hostname 'smithi079' 2024-08-20T01:48:58.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.839+0000 7fe803fe0740 1 --2- 172.21.15.79:0/867050814 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x559acd31bfe0 0x559acd31e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:58.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.839+0000 7fe803fe0740 4 client.27590 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:48:58.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.839+0000 7fe803fe0740 1 -- 172.21.15.79:0/867050814 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559acd27a890 con 0x559acd31bfe0 2024-08-20T01:48:58.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.839+0000 7fe7fb7fe640 1 --2- 172.21.15.79:0/867050814 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x559acd31bfe0 0x559acd31e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:58.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.840+0000 7fe7fb7fe640 1 --2- 172.21.15.79:0/867050814 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x559acd31bfe0 0x559acd31e3d0 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22cc5eb5a38ae7f5 server_cookie=78348c98a324b2c6 in_seq=0 out_seq=0 2024-08-20T01:48:58.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.840+0000 7fe7daffd640 10 client.27590 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:58.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.841+0000 7fe7daffd640 1 -- 172.21.15.79:0/867050814 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559acd27a890 con 0x559acd31bfe0 2024-08-20T01:48:58.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.841+0000 7fe7daffd640 10 client.27590 handle_command_reply: tid=0 2024-08-20T01:48:58.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.841+0000 7fe803fe0740 1 client.27590 shutdown 2024-08-20T01:48:58.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.841+0000 7fe803fe0740 1 -- 172.21.15.79:0/867050814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acd302e50 msgr2=0x559acd30caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:58.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.841+0000 7fe803fe0740 1 --2- 172.21.15.79:0/867050814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acd302e50 0x559acd30caa0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8035860 tx=0x7fe7e8030d00 comp rx=0 tx=0).stop 2024-08-20T01:48:58.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.841+0000 7fe803fe0740 1 -- 172.21.15.79:0/867050814 shutdown_connections 2024-08-20T01:48:58.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.841+0000 7fe803fe0740 1 --2- 172.21.15.79:0/867050814 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x559acd31bfe0 0x559acd31e3d0 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:58.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.842+0000 7fe7daffd640 0 client.27590 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:58.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.842+0000 7fe803fe0740 1 --2- 172.21.15.79:0/867050814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559acd31fdf0 0x559acd311c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:58.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.842+0000 7fe803fe0740 1 --2- 172.21.15.79:0/867050814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acd302e50 0x559acd30caa0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:58.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.842+0000 7fe803fe0740 1 --2- 172.21.15.79:0/867050814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559acd302530 0x559acd30c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:58.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.842+0000 7fe803fe0740 1 -- 172.21.15.79:0/867050814 >> 172.21.15.79:0/867050814 conn(0x559acd300360 msgr2=0x559acd2ff460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:58.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.842+0000 7fe803fe0740 1 -- 172.21.15.79:0/867050814 shutdown_connections 2024-08-20T01:48:58.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.842+0000 7fe803fe0740 1 -- 172.21.15.79:0/867050814 wait complete. 2024-08-20T01:48:58.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.842+0000 7fe803fe0740 20 client.27590 trim_cache size 0 max 16384 2024-08-20T01:48:58.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.871+0000 7fe803fe0740 1 Processor -- start 2024-08-20T01:48:58.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.871+0000 7fe803fe0740 1 -- start start 2024-08-20T01:48:58.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.871+0000 7fe803fe0740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acd302530 0x559acd309dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:58.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.872+0000 7fe803fe0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559acd302e50 0x559acd3211e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:58.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.872+0000 7fe7fb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acd302530 0x559acd309dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:58.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.872+0000 7fe7fb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acd302530 0x559acd309dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:38760/0 (socket says 172.21.15.79:38760) 2024-08-20T01:48:58.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.872+0000 7fe7faffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559acd302e50 0x559acd3211e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:58.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.872+0000 7fe7faffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559acd302e50 0x559acd3211e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:53990/0 (socket says 172.21.15.79:53990) 2024-08-20T01:48:58.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.872+0000 7fe7fb7fe640 1 -- 172.21.15.79:0/345154706 learned_addr learned my addr 172.21.15.79:0/345154706 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:58.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.872+0000 7fe803fe0740 1 --2- 172.21.15.79:0/345154706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559acd31bfe0 0x559acd2ff350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:58.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.873+0000 7fe803fe0740 1 -- 172.21.15.79:0/345154706 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e000e420 con 0x559acd31bfe0 2024-08-20T01:48:58.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.873+0000 7fe803fe0740 1 -- 172.21.15.79:0/345154706 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e0010020 con 0x559acd302530 2024-08-20T01:48:58.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.873+0000 7fe7fbfff640 1 --2- 172.21.15.79:0/345154706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559acd31bfe0 0x559acd2ff350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:58.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.873+0000 7fe803fe0740 1 -- 172.21.15.79:0/345154706 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e000ebb0 con 0x559acd302e50 2024-08-20T01:48:58.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.873+0000 7fe7fb7fe640 1 -- 172.21.15.79:0/345154706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559acd302e50 msgr2=0x559acd3211e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:58.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.873+0000 7fe7fb7fe640 1 --2- 172.21.15.79:0/345154706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559acd302e50 0x559acd3211e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:58.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.873+0000 7fe7fb7fe640 1 -- 172.21.15.79:0/345154706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559acd31bfe0 msgr2=0x559acd2ff350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:58.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.873+0000 7fe7fb7fe640 1 --2- 172.21.15.79:0/345154706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559acd31bfe0 0x559acd2ff350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:58.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.873+0000 7fe7fb7fe640 1 -- 172.21.15.79:0/345154706 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559acd30b300 con 0x559acd302530 2024-08-20T01:48:58.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.874+0000 7fe7fb7fe640 1 --2- 172.21.15.79:0/345154706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acd302530 0x559acd309dd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0004650 tx=0x7fe7f0014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee36f9537d7d931f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:58.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.874+0000 7fe7e57fa640 1 -- 172.21.15.79:0/345154706 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f0003b70 con 0x559acd302530 2024-08-20T01:48:58.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.874+0000 7fe7e57fa640 1 -- 172.21.15.79:0/345154706 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe7f0003d10 con 0x559acd302530 2024-08-20T01:48:58.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.874+0000 7fe7e57fa640 1 -- 172.21.15.79:0/345154706 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f001d630 con 0x559acd302530 2024-08-20T01:48:58.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.875+0000 7fe803fe0740 1 -- 172.21.15.79:0/345154706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acd302530 msgr2=0x559acd309dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:58.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.875+0000 7fe803fe0740 1 --2- 172.21.15.79:0/345154706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acd302530 0x559acd309dd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0004650 tx=0x7fe7f0014000 comp rx=0 tx=0).stop 2024-08-20T01:48:58.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.876+0000 7fe803fe0740 1 -- 172.21.15.79:0/345154706 shutdown_connections 2024-08-20T01:48:58.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.876+0000 7fe803fe0740 1 --2- 172.21.15.79:0/345154706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559acd31bfe0 0x559acd2ff350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:58.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.876+0000 7fe803fe0740 1 --2- 172.21.15.79:0/345154706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559acd302e50 0x559acd3211e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:58.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.876+0000 7fe803fe0740 1 --2- 172.21.15.79:0/345154706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acd302530 0x559acd309dd0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:58.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.876+0000 7fe803fe0740 1 -- 172.21.15.79:0/345154706 >> 172.21.15.79:0/345154706 conn(0x559acd300360 msgr2=0x559acd2fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:58.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.879+0000 7fe803fe0740 1 -- 172.21.15.79:0/345154706 shutdown_connections 2024-08-20T01:48:58.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.879+0000 7fe803fe0740 1 -- 172.21.15.79:0/345154706 wait complete. 2024-08-20T01:48:58.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.880+0000 7fe803fe0740 1 -- start start 2024-08-20T01:48:58.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.880+0000 7fe803fe0740 1 Processor -- start 2024-08-20T01:48:58.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.881+0000 7fe803fe0740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acd302530 0x559acd304d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:58.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.881+0000 7fe803fe0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559acd302e50 0x559acd327840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:58.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.881+0000 7fe7fb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acd302530 0x559acd304d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:58.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.881+0000 7fe7fb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acd302530 0x559acd304d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:38762/0 (socket says 172.21.15.79:38762) 2024-08-20T01:48:58.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.881+0000 7fe803fe0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559acd31bfe0 0x559acd327e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:58.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.881+0000 7fe803fe0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e000f950 con 0x559acd31bfe0 2024-08-20T01:48:58.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.881+0000 7fe803fe0740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e000f280 con 0x559acd302530 2024-08-20T01:48:58.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.881+0000 7fe803fe0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e000c400 con 0x559acd302e50 2024-08-20T01:48:58.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.881+0000 7fe803fe0740 10 client.0 _ll_register_callbacks cb 0x7fe7e8030e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:48:58.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.881+0000 7fe7fb7fe640 1 -- 172.21.15.79:0/645598094 learned_addr learned my addr 172.21.15.79:0/645598094 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:48:58.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.882+0000 7fe7faffd640 1 --2- 172.21.15.79:0/645598094 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559acd302e50 0x559acd327840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:58.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.882+0000 7fe7faffd640 1 -- 172.21.15.79:0/645598094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acd302530 msgr2=0x559acd304d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:58.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.882+0000 7fe7faffd640 1 --2- 172.21.15.79:0/645598094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acd302530 0x559acd304d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:58.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.882+0000 7fe7faffd640 1 -- 172.21.15.79:0/645598094 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559acd31bfe0 msgr2=0x559acd327e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:48:58.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.882+0000 7fe7faffd640 1 --2- 172.21.15.79:0/645598094 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559acd31bfe0 0x559acd327e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:58.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.882+0000 7fe7faffd640 1 -- 172.21.15.79:0/645598094 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559acd303520 con 0x559acd302e50 2024-08-20T01:48:58.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.883+0000 7fe7faffd640 1 --2- 172.21.15.79:0/645598094 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559acd302e50 0x559acd327840 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x559acd3089c0 tx=0x7fe7e80055e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2bc9b910e22df08 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:48:58.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.884+0000 7fe7daffd640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:48:58.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.884+0000 7fe7daffd640 1 -- 172.21.15.79:0/645598094 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e8059030 con 0x559acd302e50 2024-08-20T01:48:58.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.884+0000 7fe7daffd640 1 -- 172.21.15.79:0/645598094 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fe7e800b840 con 0x559acd302e50 2024-08-20T01:48:58.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.884+0000 7fe803fe0740 1 -- 172.21.15.79:0/645598094 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7f0003d10 con 0x559acd302e50 2024-08-20T01:48:58.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.885+0000 7fe7daffd640 1 -- 172.21.15.79:0/645598094 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fe7e800ba40 con 0x559acd302e50 2024-08-20T01:48:58.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.890+0000 7fe803fe0740 10 client.27547 fetch_fsmap learned FSMap version 49 2024-08-20T01:48:58.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.890+0000 7fe803fe0740 1 -- 172.21.15.79:0/645598094 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x559acd389b50 con 0x559acd302e50 2024-08-20T01:48:58.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.891+0000 7fe7daffd640 1 -- 172.21.15.79:0/645598094 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe7e8045070 con 0x559acd302e50 2024-08-20T01:48:58.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.892+0000 7fe7daffd640 1 -- 172.21.15.79:0/645598094 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 49) ==== 8378+0+0 (secure 0 0 0) 0x7fe7e803f040 con 0x559acd302e50 2024-08-20T01:48:58.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.892+0000 7fe803fe0740 10 client.27547 fetch_fsmap finished waiting for FSMap version 49 2024-08-20T01:48:58.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.892+0000 7fe803fe0740 10 client.27547 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:48:58.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.892+0000 7fe803fe0740 20 client.27547 populate_metadata read hostname 'smithi079' 2024-08-20T01:48:58.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.892+0000 7fe803fe0740 1 --2- 172.21.15.79:0/645598094 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x559acd31fdf0 0x559acd38c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:48:58.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.892+0000 7fe803fe0740 4 client.27547 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T01:48:58.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.892+0000 7fe803fe0740 1 -- 172.21.15.79:0/645598094 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7fe7f0003d10 con 0x559acd31fdf0 2024-08-20T01:48:58.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.896+0000 7fe7fb7fe640 1 --2- 172.21.15.79:0/645598094 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x559acd31fdf0 0x559acd38c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:48:58.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.897+0000 7fe7fb7fe640 1 --2- 172.21.15.79:0/645598094 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x559acd31fdf0 0x559acd38c1f0 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3875fcc2b29da4f server_cookie=a10010b312931f14 in_seq=0 out_seq=0 2024-08-20T01:48:58.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.897+0000 7fe7daffd640 10 client.27547 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:58.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.898+0000 7fe7daffd640 1 -- 172.21.15.79:0/645598094 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7fe7f0003d10 con 0x559acd31fdf0 2024-08-20T01:48:58.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.899+0000 7fe7daffd640 10 client.27547 handle_command_reply: tid=0 2024-08-20T01:48:58.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.899+0000 7fe803fe0740 1 client.27547 shutdown 2024-08-20T01:48:58.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.899+0000 7fe803fe0740 1 -- 172.21.15.79:0/645598094 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559acd302e50 msgr2=0x559acd327840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:58.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.899+0000 7fe803fe0740 1 --2- 172.21.15.79:0/645598094 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559acd302e50 0x559acd327840 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x559acd3089c0 tx=0x7fe7e80055e0 comp rx=0 tx=0).stop 2024-08-20T01:48:58.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.899+0000 7fe803fe0740 1 -- 172.21.15.79:0/645598094 shutdown_connections 2024-08-20T01:48:58.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.899+0000 7fe803fe0740 1 --2- 172.21.15.79:0/645598094 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x559acd31fdf0 0x559acd38c1f0 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:58.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.899+0000 7fe803fe0740 1 --2- 172.21.15.79:0/645598094 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559acd31bfe0 0x559acd327e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:58.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.899+0000 7fe803fe0740 1 --2- 172.21.15.79:0/645598094 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559acd302e50 0x559acd327840 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:58.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.899+0000 7fe803fe0740 1 --2- 172.21.15.79:0/645598094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acd302530 0x559acd304d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:58.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.899+0000 7fe803fe0740 1 -- 172.21.15.79:0/645598094 >> 172.21.15.79:0/645598094 conn(0x559acd300360 msgr2=0x559acd2ff460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:58.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.899+0000 7fe7daffd640 0 client.27547 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:48:58.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.899+0000 7fe803fe0740 1 -- 172.21.15.79:0/645598094 shutdown_connections 2024-08-20T01:48:58.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.900+0000 7fe803fe0740 1 -- 172.21.15.79:0/645598094 wait complete. 2024-08-20T01:48:58.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.900+0000 7fe803fe0740 20 client.27547 trim_cache size 0 max 16384 2024-08-20T01:48:58.904 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:48:58.904 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-08-20T01:48:58.904 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "b18f68c8-fe7d-4fd5-bff7-64fa7bbd4daa", 2024-08-20T01:48:58.904 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-08-20T01:48:58.904 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:48:58.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.901+0000 7fe800985640 1 -- 172.21.15.79:0/4196014343 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe7ec0b3d10 msgr2=0x7fe7ec0b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:58.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.901+0000 7fe800985640 1 --2- 172.21.15.79:0/4196014343 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe7ec0b3d10 0x7fe7ec0b61d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x559acd301240 tx=0x7fe7f0005f90 comp rx=0 tx=0).stop 2024-08-20T01:48:58.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.901+0000 7fe800985640 1 -- 172.21.15.79:0/4196014343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7f409bbb0 msgr2=0x7fe7f41379a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:48:58.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.901+0000 7fe800985640 1 --2- 172.21.15.79:0/4196014343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7f409bbb0 0x7fe7f41379a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc0525c0 tx=0x7fe7fc0a4990 comp rx=0 tx=0).stop 2024-08-20T01:48:58.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.901+0000 7fe800985640 1 -- 172.21.15.79:0/4196014343 shutdown_connections 2024-08-20T01:48:58.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.901+0000 7fe800985640 1 --2- 172.21.15.79:0/4196014343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7f409bbb0 0x7fe7f41379a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:58.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.901+0000 7fe800985640 1 --2- 172.21.15.79:0/4196014343 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe7ec0b3d10 0x7fe7ec0b61d0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:58.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.901+0000 7fe800985640 1 --2- 172.21.15.79:0/4196014343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7f409b250 0x7fe7f40a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:58.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.901+0000 7fe800985640 1 --2- 172.21.15.79:0/4196014343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7f4004f50 0x7fe7f40a17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:48:58.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.901+0000 7fe800985640 1 -- 172.21.15.79:0/4196014343 >> 172.21.15.79:0/4196014343 conn(0x7fe7f400a150 msgr2=0x7fe7f4096fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:48:58.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.901+0000 7fe800985640 1 -- 172.21.15.79:0/4196014343 shutdown_connections 2024-08-20T01:48:58.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:48:58.901+0000 7fe800985640 1 -- 172.21.15.79:0/4196014343 wait complete. 2024-08-20T01:48:59.914 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:49:00.188 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:59 smithi079 ceph-mon[18656]: pgmap v697: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 MiB/s wr, 6.17k op/s 2024-08-20T01:49:00.188 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:59 smithi079 ceph-mon[18656]: scrub queued for path: / 2024-08-20T01:49:00.188 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:59 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:49:00.188 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:59 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:49:00.188 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:59 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:49:00.188 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:59 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:49:00.188 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:59 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:49:00.189 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:59 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:49:00.189 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:59 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:49:00.189 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:59 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:49:00.189 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:59 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:49:00.189 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:59 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:49:00.189 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:59 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:49:00.189 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:59 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:49:00.189 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:59 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:49:00.189 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:59 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:49:00.189 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:48:59 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:49:00.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:59 smithi081 ceph-mon[22209]: pgmap v697: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 MiB/s wr, 6.17k op/s 2024-08-20T01:49:00.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:59 smithi081 ceph-mon[22209]: scrub queued for path: / 2024-08-20T01:49:00.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:59 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:49:00.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:59 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:49:00.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:59 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:49:00.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:59 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:49:00.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:59 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:49:00.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:59 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:49:00.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:59 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:49:00.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:59 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:49:00.280 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:59 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:49:00.280 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:59 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:49:00.280 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:59 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:49:00.280 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:59 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:49:00.280 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:59 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:49:00.280 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:59 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:49:00.280 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:48:59 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:49:00.374 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:49:00.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:59 smithi175 ceph-mon[22392]: pgmap v697: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 MiB/s wr, 6.17k op/s 2024-08-20T01:49:00.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:59 smithi175 ceph-mon[22392]: scrub queued for path: / 2024-08-20T01:49:00.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:59 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:49:00.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:59 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:49:00.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:59 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:49:00.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:59 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:49:00.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:59 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:49:00.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:59 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:49:00.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:59 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:49:00.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:59 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:49:00.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:59 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:49:00.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:59 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:49:00.391 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:59 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:49:00.391 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:59 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:49:00.391 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:59 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:49:00.391 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:59 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:49:00.391 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:48:59 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:49:00.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.949+0000 7fb4c8690640 1 -- 172.21.15.79:0/3277727186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4c0106280 msgr2=0x7fb4c01066c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:00.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.949+0000 7fb4c8690640 1 --2- 172.21.15.79:0/3277727186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4c0106280 0x7fb4c01066c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb4b001a910 tx=0x7fb4b003b450 comp rx=0 tx=0).stop 2024-08-20T01:49:00.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.949+0000 7fb4c8690640 1 -- 172.21.15.79:0/3277727186 shutdown_connections 2024-08-20T01:49:00.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.949+0000 7fb4c8690640 1 --2- 172.21.15.79:0/3277727186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c0106c00 0x7fb4c01073f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:00.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.949+0000 7fb4c8690640 1 --2- 172.21.15.79:0/3277727186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4c0106280 0x7fb4c01066c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:00.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.949+0000 7fb4c8690640 1 --2- 172.21.15.79:0/3277727186 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4c01009e0 0x7fb4c0100dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:00.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.949+0000 7fb4c8690640 1 -- 172.21.15.79:0/3277727186 >> 172.21.15.79:0/3277727186 conn(0x7fb4c00fc730 msgr2=0x7fb4c00feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:00.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.950+0000 7fb4c8690640 1 -- 172.21.15.79:0/3277727186 shutdown_connections 2024-08-20T01:49:00.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.950+0000 7fb4c8690640 1 -- 172.21.15.79:0/3277727186 wait complete. 2024-08-20T01:49:00.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.951+0000 7fb4c8690640 1 Processor -- start 2024-08-20T01:49:00.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.951+0000 7fb4c8690640 1 -- start start 2024-08-20T01:49:00.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.952+0000 7fb4c8690640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c0106280 0x7fb4c0196eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:00.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.952+0000 7fb4c8690640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4c0106c00 0x7fb4c01973f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:00.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.952+0000 7fb4c642c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c0106280 0x7fb4c0196eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:00.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.952+0000 7fb4c642c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c0106280 0x7fb4c0196eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:52824/0 (socket says 172.21.15.79:52824) 2024-08-20T01:49:00.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.952+0000 7fb4c642c640 1 -- 172.21.15.79:0/2530022722 learned_addr learned my addr 172.21.15.79:0/2530022722 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:00.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.952+0000 7fb4c8690640 1 --2- 172.21.15.79:0/2530022722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4c019c790 0x7fb4c019cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:00.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.952+0000 7fb4c8690640 1 -- 172.21.15.79:0/2530022722 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb4c010a880 con 0x7fb4c019c790 2024-08-20T01:49:00.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.952+0000 7fb4c8690640 1 -- 172.21.15.79:0/2530022722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb4c010a700 con 0x7fb4c0106280 2024-08-20T01:49:00.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.952+0000 7fb4c8690640 1 -- 172.21.15.79:0/2530022722 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb4c010aa00 con 0x7fb4c0106c00 2024-08-20T01:49:00.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.953+0000 7fb4c642c640 1 -- 172.21.15.79:0/2530022722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4c0106c00 msgr2=0x7fb4c01973f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-20T01:49:00.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.953+0000 7fb4c642c640 1 --2- 172.21.15.79:0/2530022722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4c0106c00 0x7fb4c01973f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:00.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.953+0000 7fb4c642c640 1 -- 172.21.15.79:0/2530022722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4c019c790 msgr2=0x7fb4c019cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:00.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.953+0000 7fb4c642c640 1 --2- 172.21.15.79:0/2530022722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4c019c790 0x7fb4c019cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:00.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.953+0000 7fb4c642c640 1 -- 172.21.15.79:0/2530022722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4c019d320 con 0x7fb4c0106280 2024-08-20T01:49:00.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.958+0000 7fb4c642c640 1 --2- 172.21.15.79:0/2530022722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c0106280 0x7fb4c0196eb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc006fd0 tx=0x7fb4bc00b890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:00.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.958+0000 7fb4b77fe640 1 -- 172.21.15.79:0/2530022722 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc015020 con 0x7fb4c0106280 2024-08-20T01:49:00.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.959+0000 7fb4b77fe640 1 -- 172.21.15.79:0/2530022722 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb4bc011cc0 con 0x7fb4c0106280 2024-08-20T01:49:00.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.959+0000 7fb4c8690640 1 -- 172.21.15.79:0/2530022722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4c01a3910 con 0x7fb4c0106280 2024-08-20T01:49:00.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.959+0000 7fb4b77fe640 1 -- 172.21.15.79:0/2530022722 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc010d40 con 0x7fb4c0106280 2024-08-20T01:49:00.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.959+0000 7fb4c8690640 1 -- 172.21.15.79:0/2530022722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4c01a3d80 con 0x7fb4c0106280 2024-08-20T01:49:00.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.964+0000 7fb4b77fe640 1 -- 172.21.15.79:0/2530022722 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb4bc018020 con 0x7fb4c0106280 2024-08-20T01:49:00.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.965+0000 7fb4b77fe640 1 --2- 172.21.15.79:0/2530022722 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb4ac0b3d60 0x7fb4ac0b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:00.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.965+0000 7fb4c5c2b640 1 --2- 172.21.15.79:0/2530022722 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb4ac0b3d60 0x7fb4ac0b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:00.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.966+0000 7fb4b77fe640 1 -- 172.21.15.79:0/2530022722 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fb4bc0a7850 con 0x7fb4c0106280 2024-08-20T01:49:00.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.968+0000 7fb4caa89740 1 Processor -- start 2024-08-20T01:49:00.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.969+0000 7fb4c5c2b640 1 --2- 172.21.15.79:0/2530022722 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb4ac0b3d60 0x7fb4ac0b6220 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb4b001a6d0 tx=0x7fb4b0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:00.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.969+0000 7fb4caa89740 1 -- start start 2024-08-20T01:49:00.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.969+0000 7fb4caa89740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55899a8a7830 0x55899a8a7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:00.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.969+0000 7fb4caa89740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55899a8a8150 0x55899a8b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:00.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.969+0000 7fb4caa89740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899a8b40e0 0x55899a8b64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:00.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.969+0000 7fb4caa89740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55899a81e8e0 con 0x55899a8a7830 2024-08-20T01:49:00.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.969+0000 7fb4caa89740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55899a80dde0 con 0x55899a8a8150 2024-08-20T01:49:00.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.969+0000 7fb4caa89740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55899a811e20 con 0x55899a8b40e0 2024-08-20T01:49:00.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.969+0000 7fb4c642c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55899a8a7830 0x55899a8a7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:00.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.969+0000 7fb4c642c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55899a8a7830 0x55899a8a7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41476/0 (socket says 172.21.15.79:41476) 2024-08-20T01:49:00.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.970+0000 7fb4c642c640 1 -- 172.21.15.79:0/3005801954 learned_addr learned my addr 172.21.15.79:0/3005801954 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:00.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.970+0000 7fb4c642c640 1 -- 172.21.15.79:0/3005801954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899a8b40e0 msgr2=0x55899a8b64d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:49:00.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.970+0000 7fb4c642c640 1 --2- 172.21.15.79:0/3005801954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899a8b40e0 0x55899a8b64d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:00.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.970+0000 7fb4c642c640 1 -- 172.21.15.79:0/3005801954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55899a8a8150 msgr2=0x55899a8b3ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:49:00.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.970+0000 7fb4c642c640 1 --2- 172.21.15.79:0/3005801954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55899a8a8150 0x55899a8b3ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:00.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.970+0000 7fb4c642c640 1 -- 172.21.15.79:0/3005801954 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55899a56d650 con 0x55899a8a7830 2024-08-20T01:49:00.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.970+0000 7fb4c642c640 1 --2- 172.21.15.79:0/3005801954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55899a8a7830 0x55899a8a7c10 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc0a8100 tx=0x7fb4bc0b2b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=686ca5fdc85a6722 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:00.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.971+0000 7fb4b4ff9640 1 -- 172.21.15.79:0/3005801954 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc0a7a50 con 0x55899a8a7830 2024-08-20T01:49:00.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.971+0000 7fb4b4ff9640 1 -- 172.21.15.79:0/3005801954 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb4bc0ab960 con 0x55899a8a7830 2024-08-20T01:49:00.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.971+0000 7fb4b4ff9640 1 -- 172.21.15.79:0/3005801954 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc0a7bf0 con 0x55899a8a7830 2024-08-20T01:49:00.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.973+0000 7fb4caa89740 1 -- 172.21.15.79:0/3005801954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55899a8a7830 msgr2=0x55899a8a7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:00.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.973+0000 7fb4caa89740 1 --2- 172.21.15.79:0/3005801954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55899a8a7830 0x55899a8a7c10 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc0a8100 tx=0x7fb4bc0b2b70 comp rx=0 tx=0).stop 2024-08-20T01:49:00.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.974+0000 7fb4caa89740 1 -- 172.21.15.79:0/3005801954 shutdown_connections 2024-08-20T01:49:00.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.974+0000 7fb4caa89740 1 --2- 172.21.15.79:0/3005801954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899a8b40e0 0x55899a8b64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:00.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.974+0000 7fb4caa89740 1 --2- 172.21.15.79:0/3005801954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55899a8a8150 0x55899a8b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:00.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.974+0000 7fb4caa89740 1 --2- 172.21.15.79:0/3005801954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55899a8a7830 0x55899a8a7c10 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:00.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.974+0000 7fb4caa89740 1 -- 172.21.15.79:0/3005801954 >> 172.21.15.79:0/3005801954 conn(0x55899a8a5660 msgr2=0x55899a8a6800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:00.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.974+0000 7fb4caa89740 1 -- 172.21.15.79:0/3005801954 shutdown_connections 2024-08-20T01:49:00.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.975+0000 7fb4caa89740 1 -- 172.21.15.79:0/3005801954 wait complete. 2024-08-20T01:49:00.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.975+0000 7fb4caa89740 1 -- start start 2024-08-20T01:49:00.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.975+0000 7fb4caa89740 1 Processor -- start 2024-08-20T01:49:00.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.976+0000 7fb4caa89740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55899a8a7830 0x55899a8b1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:00.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.976+0000 7fb4caa89740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55899a8b40e0 0x55899a8b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:00.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.976+0000 7fb4caa89740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899a8b1ba0 0x55899a8d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:00.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.976+0000 7fb4caa89740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55899a670700 con 0x55899a8b40e0 2024-08-20T01:49:00.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.976+0000 7fb4caa89740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55899a7947c0 con 0x55899a8a7830 2024-08-20T01:49:00.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.976+0000 7fb4c6c2d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899a8b1ba0 0x55899a8d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:00.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.976+0000 7fb4c6c2d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899a8b1ba0 0x55899a8d1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:57838/0 (socket says 172.21.15.79:57838) 2024-08-20T01:49:00.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.976+0000 7fb4c6c2d640 1 -- 172.21.15.79:0/4108152920 learned_addr learned my addr 172.21.15.79:0/4108152920 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:00.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.976+0000 7fb4caa89740 1 -- 172.21.15.79:0/4108152920 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55899a8c7d40 con 0x55899a8b1ba0 2024-08-20T01:49:00.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.976+0000 7fb4c642c640 1 --2- 172.21.15.79:0/4108152920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55899a8a7830 0x55899a8b1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:00.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.976+0000 7fb4caa89740 10 client.0 _ll_register_callbacks cb 0x55899a8076b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:49:00.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.977+0000 7fb4c6c2d640 1 -- 172.21.15.79:0/4108152920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55899a8a7830 msgr2=0x55899a8b1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:00.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.977+0000 7fb4c6c2d640 1 --2- 172.21.15.79:0/4108152920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55899a8a7830 0x55899a8b1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:00.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.977+0000 7fb4c6c2d640 1 -- 172.21.15.79:0/4108152920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55899a8b40e0 msgr2=0x55899a8b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:00.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.977+0000 7fb4c6c2d640 1 --2- 172.21.15.79:0/4108152920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55899a8b40e0 0x55899a8b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:00.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.977+0000 7fb4c6c2d640 1 -- 172.21.15.79:0/4108152920 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55899a8d1650 con 0x55899a8b1ba0 2024-08-20T01:49:00.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.977+0000 7fb4c6c2d640 1 --2- 172.21.15.79:0/4108152920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899a8b1ba0 0x55899a8d1110 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb4b800e7a0 tx=0x7fb4b800ec60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c36647e2d25d07e4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:00.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.977+0000 7fb4a9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:49:00.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.977+0000 7fb4a9ffb640 1 -- 172.21.15.79:0/4108152920 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b800cc40 con 0x55899a8b1ba0 2024-08-20T01:49:00.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.978+0000 7fb4caa89740 1 -- 172.21.15.79:0/4108152920 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55899a7bd100 con 0x55899a8b1ba0 2024-08-20T01:49:00.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.978+0000 7fb4a9ffb640 1 -- 172.21.15.79:0/4108152920 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fb4b800cde0 con 0x55899a8b1ba0 2024-08-20T01:49:00.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.978+0000 7fb4a9ffb640 1 -- 172.21.15.79:0/4108152920 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fb4b8003970 con 0x55899a8b1ba0 2024-08-20T01:49:00.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.978+0000 7fb4caa89740 10 client.27553 fetch_fsmap learned FSMap version 49 2024-08-20T01:49:00.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.978+0000 7fb4caa89740 1 -- 172.21.15.79:0/4108152920 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55899a8d4000 con 0x55899a8b1ba0 2024-08-20T01:49:00.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.978+0000 7fb4a9ffb640 1 -- 172.21.15.79:0/4108152920 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb4b8004020 con 0x55899a8b1ba0 2024-08-20T01:49:00.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.980+0000 7fb4a9ffb640 1 -- 172.21.15.79:0/4108152920 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 49) ==== 8378+0+0 (secure 0 0 0) 0x7fb4b8018470 con 0x55899a8b1ba0 2024-08-20T01:49:00.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.980+0000 7fb4caa89740 10 client.27553 fetch_fsmap finished waiting for FSMap version 49 2024-08-20T01:49:00.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.980+0000 7fb4caa89740 10 client.27553 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:49:00.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.980+0000 7fb4caa89740 20 client.27553 populate_metadata read hostname 'smithi079' 2024-08-20T01:49:00.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.980+0000 7fb4caa89740 1 --2- 172.21.15.79:0/4108152920 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55899a8d5910 0x55899a8d7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:00.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.980+0000 7fb4caa89740 4 client.27553 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:49:00.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.980+0000 7fb4caa89740 1 -- 172.21.15.79:0/4108152920 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55899a7bd100 con 0x55899a8d5910 2024-08-20T01:49:00.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.980+0000 7fb4c642c640 1 --2- 172.21.15.79:0/4108152920 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55899a8d5910 0x55899a8d7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:00.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.981+0000 7fb4c642c640 1 --2- 172.21.15.79:0/4108152920 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55899a8d5910 0x55899a8d7d90 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f78937bec53c9d6 server_cookie=50c13327b5075959 in_seq=0 out_seq=0 2024-08-20T01:49:00.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.981+0000 7fb4a9ffb640 10 client.27553 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:49:00.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.981+0000 7fb4a9ffb640 1 -- 172.21.15.79:0/4108152920 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55899a7bd100 con 0x55899a8d5910 2024-08-20T01:49:00.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.981+0000 7fb4a9ffb640 10 client.27553 handle_command_reply: tid=0 2024-08-20T01:49:00.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.982+0000 7fb4caa89740 1 client.27553 shutdown 2024-08-20T01:49:00.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.982+0000 7fb4caa89740 1 -- 172.21.15.79:0/4108152920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899a8b1ba0 msgr2=0x55899a8d1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:00.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.982+0000 7fb4caa89740 1 --2- 172.21.15.79:0/4108152920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899a8b1ba0 0x55899a8d1110 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb4b800e7a0 tx=0x7fb4b800ec60 comp rx=0 tx=0).stop 2024-08-20T01:49:00.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.983+0000 7fb4caa89740 1 -- 172.21.15.79:0/4108152920 shutdown_connections 2024-08-20T01:49:00.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.983+0000 7fb4caa89740 1 --2- 172.21.15.79:0/4108152920 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55899a8d5910 0x55899a8d7d90 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:00.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.983+0000 7fb4caa89740 1 --2- 172.21.15.79:0/4108152920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899a8b1ba0 0x55899a8d1110 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:00.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.983+0000 7fb4caa89740 1 --2- 172.21.15.79:0/4108152920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55899a8b40e0 0x55899a8b1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:00.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.983+0000 7fb4caa89740 1 --2- 172.21.15.79:0/4108152920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55899a8a7830 0x55899a8b1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:00.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.983+0000 7fb4caa89740 1 -- 172.21.15.79:0/4108152920 >> 172.21.15.79:0/4108152920 conn(0x55899a8a5660 msgr2=0x55899a8ab200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:00.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.983+0000 7fb4a9ffb640 0 client.27553 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:49:00.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.983+0000 7fb4caa89740 1 -- 172.21.15.79:0/4108152920 shutdown_connections 2024-08-20T01:49:00.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.983+0000 7fb4caa89740 1 -- 172.21.15.79:0/4108152920 wait complete. 2024-08-20T01:49:00.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:00.983+0000 7fb4caa89740 20 client.27553 trim_cache size 0 max 16384 2024-08-20T01:49:01.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.015+0000 7fb4caa89740 1 Processor -- start 2024-08-20T01:49:01.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.016+0000 7fb4caa89740 1 -- start start 2024-08-20T01:49:01.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.016+0000 7fb4caa89740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899a8a7830 0x55899a8d0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:01.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.016+0000 7fb4caa89740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55899a8b1ba0 0x55899a8a4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:01.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.016+0000 7fb4c642c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899a8a7830 0x55899a8d0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:01.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.016+0000 7fb4c642c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899a8a7830 0x55899a8d0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:57846/0 (socket says 172.21.15.79:57846) 2024-08-20T01:49:01.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.016+0000 7fb4c642c640 1 -- 172.21.15.79:0/1451275251 learned_addr learned my addr 172.21.15.79:0/1451275251 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:01.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.017+0000 7fb4c5c2b640 1 --2- 172.21.15.79:0/1451275251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55899a8b1ba0 0x55899a8a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:01.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.017+0000 7fb4caa89740 1 --2- 172.21.15.79:0/1451275251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55899a8b40e0 0x55899a8dd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:01.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.017+0000 7fb4caa89740 1 -- 172.21.15.79:0/1451275251 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a400e370 con 0x55899a8b40e0 2024-08-20T01:49:01.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.017+0000 7fb4caa89740 1 -- 172.21.15.79:0/1451275251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a400ff70 con 0x55899a8b1ba0 2024-08-20T01:49:01.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.017+0000 7fb4caa89740 1 -- 172.21.15.79:0/1451275251 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a400eb00 con 0x55899a8a7830 2024-08-20T01:49:01.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.017+0000 7fb4c6c2d640 1 --2- 172.21.15.79:0/1451275251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55899a8b40e0 0x55899a8dd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:01.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.018+0000 7fb4c642c640 1 -- 172.21.15.79:0/1451275251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55899a8b1ba0 msgr2=0x55899a8a4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:01.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.018+0000 7fb4c642c640 1 --2- 172.21.15.79:0/1451275251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55899a8b1ba0 0x55899a8a4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:01.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.018+0000 7fb4c642c640 1 -- 172.21.15.79:0/1451275251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55899a8b40e0 msgr2=0x55899a8dd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:01.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.018+0000 7fb4c642c640 1 --2- 172.21.15.79:0/1451275251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55899a8b40e0 0x55899a8dd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:01.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.018+0000 7fb4c642c640 1 -- 172.21.15.79:0/1451275251 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55899a8a60e0 con 0x55899a8a7830 2024-08-20T01:49:01.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.018+0000 7fb4c642c640 1 --2- 172.21.15.79:0/1451275251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899a8a7830 0x55899a8d0f00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc009fd0 tx=0x7fb4bc00be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f1e96b245f6a153 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:01.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.018+0000 7fb4abfff640 1 -- 172.21.15.79:0/1451275251 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc0c9070 con 0x55899a8a7830 2024-08-20T01:49:01.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.018+0000 7fb4abfff640 1 -- 172.21.15.79:0/1451275251 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb4bc0b2be0 con 0x55899a8a7830 2024-08-20T01:49:01.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.018+0000 7fb4abfff640 1 -- 172.21.15.79:0/1451275251 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc0a7dc0 con 0x55899a8a7830 2024-08-20T01:49:01.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.019+0000 7fb4caa89740 1 -- 172.21.15.79:0/1451275251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899a8a7830 msgr2=0x55899a8d0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:01.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.019+0000 7fb4caa89740 1 --2- 172.21.15.79:0/1451275251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899a8a7830 0x55899a8d0f00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc009fd0 tx=0x7fb4bc00be10 comp rx=0 tx=0).stop 2024-08-20T01:49:01.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.020+0000 7fb4caa89740 1 -- 172.21.15.79:0/1451275251 shutdown_connections 2024-08-20T01:49:01.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.020+0000 7fb4caa89740 1 --2- 172.21.15.79:0/1451275251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55899a8b40e0 0x55899a8dd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:01.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.020+0000 7fb4caa89740 1 --2- 172.21.15.79:0/1451275251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55899a8b1ba0 0x55899a8a4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:01.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.020+0000 7fb4caa89740 1 --2- 172.21.15.79:0/1451275251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899a8a7830 0x55899a8d0f00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:01.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.020+0000 7fb4caa89740 1 -- 172.21.15.79:0/1451275251 >> 172.21.15.79:0/1451275251 conn(0x55899a8a5660 msgr2=0x55899a8a3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:01.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.020+0000 7fb4caa89740 1 -- 172.21.15.79:0/1451275251 shutdown_connections 2024-08-20T01:49:01.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.020+0000 7fb4caa89740 1 -- 172.21.15.79:0/1451275251 wait complete. 2024-08-20T01:49:01.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.020+0000 7fb4caa89740 1 -- start start 2024-08-20T01:49:01.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.021+0000 7fb4caa89740 1 Processor -- start 2024-08-20T01:49:01.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.021+0000 7fb4caa89740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55899a8a7830 0x55899a8c8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:01.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.021+0000 7fb4caa89740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55899a8b1ba0 0x55899a8c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:01.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.021+0000 7fb4caa89740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899a8b40e0 0x55899a93e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:01.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.021+0000 7fb4caa89740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a400f8a0 con 0x55899a8b1ba0 2024-08-20T01:49:01.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.021+0000 7fb4caa89740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a400f1d0 con 0x55899a8a7830 2024-08-20T01:49:01.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.021+0000 7fb4caa89740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a400c400 con 0x55899a8b40e0 2024-08-20T01:49:01.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.021+0000 7fb4caa89740 10 client.0 _ll_register_callbacks cb 0x7fb4b8009820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:49:01.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.021+0000 7fb4c6c2d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899a8b40e0 0x55899a93e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:01.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.022+0000 7fb4c6c2d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899a8b40e0 0x55899a93e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:57850/0 (socket says 172.21.15.79:57850) 2024-08-20T01:49:01.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.022+0000 7fb4c6c2d640 1 -- 172.21.15.79:0/1591674418 learned_addr learned my addr 172.21.15.79:0/1591674418 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:01.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.022+0000 7fb4c642c640 1 --2- 172.21.15.79:0/1591674418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55899a8a7830 0x55899a8c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:01.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.022+0000 7fb4c5c2b640 1 --2- 172.21.15.79:0/1591674418 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55899a8b1ba0 0x55899a8c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:01.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.022+0000 7fb4c642c640 1 -- 172.21.15.79:0/1591674418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899a8b40e0 msgr2=0x55899a93e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:01.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.022+0000 7fb4c642c640 1 --2- 172.21.15.79:0/1591674418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899a8b40e0 0x55899a93e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:01.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.022+0000 7fb4c642c640 1 -- 172.21.15.79:0/1591674418 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55899a8b1ba0 msgr2=0x55899a8c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:01.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.022+0000 7fb4c642c640 1 --2- 172.21.15.79:0/1591674418 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55899a8b1ba0 0x55899a8c89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:01.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.022+0000 7fb4c642c640 1 -- 172.21.15.79:0/1591674418 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55899a93eb60 con 0x55899a8a7830 2024-08-20T01:49:01.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.023+0000 7fb4c642c640 1 --2- 172.21.15.79:0/1591674418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55899a8a7830 0x55899a8c8460 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc009fd0 tx=0x7fb4bc0103f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8ce83b6391b9313 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:01.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.023+0000 7fb4a9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:49:01.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.023+0000 7fb4a9ffb640 1 -- 172.21.15.79:0/1591674418 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc0c9040 con 0x55899a8a7830 2024-08-20T01:49:01.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.024+0000 7fb4a9ffb640 1 -- 172.21.15.79:0/1591674418 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fb4bc0aa6c0 con 0x55899a8a7830 2024-08-20T01:49:01.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.024+0000 7fb4caa89740 1 -- 172.21.15.79:0/1591674418 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb4bc0b2be0 con 0x55899a8a7830 2024-08-20T01:49:01.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.024+0000 7fb4a9ffb640 1 -- 172.21.15.79:0/1591674418 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fb4bc0a7f60 con 0x55899a8a7830 2024-08-20T01:49:01.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.024+0000 7fb4caa89740 10 client.27611 fetch_fsmap learned FSMap version 49 2024-08-20T01:49:01.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.024+0000 7fb4caa89740 1 -- 172.21.15.79:0/1591674418 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55899a93fe20 con 0x55899a8a7830 2024-08-20T01:49:01.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.024+0000 7fb4a9ffb640 1 -- 172.21.15.79:0/1591674418 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb4bc0059c0 con 0x55899a8a7830 2024-08-20T01:49:01.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.025+0000 7fb4a9ffb640 1 -- 172.21.15.79:0/1591674418 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 49) ==== 8378+0+0 (secure 0 0 0) 0x7fb4bc0c0520 con 0x55899a8a7830 2024-08-20T01:49:01.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.025+0000 7fb4caa89740 10 client.27611 fetch_fsmap finished waiting for FSMap version 49 2024-08-20T01:49:01.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.025+0000 7fb4caa89740 10 client.27611 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:49:01.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.025+0000 7fb4caa89740 20 client.27611 populate_metadata read hostname 'smithi079' 2024-08-20T01:49:01.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.025+0000 7fb4caa89740 1 --2- 172.21.15.79:0/1591674418 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55899a93fff0 0x55899a9423e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:01.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.025+0000 7fb4caa89740 4 client.27611 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:49:01.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.025+0000 7fb4caa89740 1 -- 172.21.15.79:0/1591674418 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fb4bc0b2be0 con 0x55899a93fff0 2024-08-20T01:49:01.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.025+0000 7fb4c5c2b640 1 --2- 172.21.15.79:0/1591674418 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55899a93fff0 0x55899a9423e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:01.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.025+0000 7fb4a9ffb640 10 client.27611 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:49:01.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.026+0000 7fb4c5c2b640 1 --2- 172.21.15.79:0/1591674418 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55899a93fff0 0x55899a9423e0 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d5fd92029d1dbaf server_cookie=e1d387c985a51686 in_seq=0 out_seq=0 2024-08-20T01:49:01.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.027+0000 7fb4a9ffb640 1 -- 172.21.15.79:0/1591674418 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7fb4bc0b2be0 con 0x55899a93fff0 2024-08-20T01:49:01.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.027+0000 7fb4a9ffb640 10 client.27611 handle_command_reply: tid=0 2024-08-20T01:49:01.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.027+0000 7fb4caa89740 1 client.27611 shutdown 2024-08-20T01:49:01.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.027+0000 7fb4caa89740 1 -- 172.21.15.79:0/1591674418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55899a8a7830 msgr2=0x55899a8c8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:01.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.027+0000 7fb4caa89740 1 --2- 172.21.15.79:0/1591674418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55899a8a7830 0x55899a8c8460 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc009fd0 tx=0x7fb4bc0103f0 comp rx=0 tx=0).stop 2024-08-20T01:49:01.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.027+0000 7fb4caa89740 1 -- 172.21.15.79:0/1591674418 shutdown_connections 2024-08-20T01:49:01.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.027+0000 7fb4caa89740 1 --2- 172.21.15.79:0/1591674418 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55899a93fff0 0x55899a9423e0 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:01.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.028+0000 7fb4caa89740 1 --2- 172.21.15.79:0/1591674418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899a8b40e0 0x55899a93e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:01.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.028+0000 7fb4a9ffb640 0 client.27611 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:49:01.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.028+0000 7fb4caa89740 1 --2- 172.21.15.79:0/1591674418 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55899a8b1ba0 0x55899a8c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:01.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.028+0000 7fb4caa89740 1 --2- 172.21.15.79:0/1591674418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55899a8a7830 0x55899a8c8460 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:01.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.028+0000 7fb4caa89740 1 -- 172.21.15.79:0/1591674418 >> 172.21.15.79:0/1591674418 conn(0x55899a8a5660 msgr2=0x55899a8b2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:01.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.029+0000 7fb4caa89740 1 -- 172.21.15.79:0/1591674418 shutdown_connections 2024-08-20T01:49:01.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.030+0000 7fb4caa89740 1 -- 172.21.15.79:0/1591674418 wait complete. 2024-08-20T01:49:01.164 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:49:01.164 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-20T01:49:01.165 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": { 2024-08-20T01:49:01.165 INFO:teuthology.orchestra.run.smithi079.stdout: "b18f68c8-fe7d-4fd5-bff7-64fa7bbd4daa": { 2024-08-20T01:49:01.165 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/", 2024-08-20T01:49:01.165 INFO:teuthology.orchestra.run.smithi079.stdout: "tag": "b18f68c8-fe7d-4fd5-bff7-64fa7bbd4daa", 2024-08-20T01:49:01.165 INFO:teuthology.orchestra.run.smithi079.stdout: "options": "recursive,force" 2024-08-20T01:49:01.165 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:49:01.165 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:49:01.165 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:49:01.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.031+0000 7fb4caa89740 20 client.27611 trim_cache size 0 max 16384 2024-08-20T01:49:01.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.031+0000 7fb4c8690640 1 -- 172.21.15.79:0/2530022722 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb4ac0b3d60 msgr2=0x7fb4ac0b6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:01.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.031+0000 7fb4c8690640 1 --2- 172.21.15.79:0/2530022722 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb4ac0b3d60 0x7fb4ac0b6220 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb4b001a6d0 tx=0x7fb4b0000bc0 comp rx=0 tx=0).stop 2024-08-20T01:49:01.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.031+0000 7fb4c8690640 1 -- 172.21.15.79:0/2530022722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c0106280 msgr2=0x7fb4c0196eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:01.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.032+0000 7fb4c8690640 1 --2- 172.21.15.79:0/2530022722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c0106280 0x7fb4c0196eb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc006fd0 tx=0x7fb4bc00b890 comp rx=0 tx=0).stop 2024-08-20T01:49:01.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.032+0000 7fb4c8690640 1 -- 172.21.15.79:0/2530022722 shutdown_connections 2024-08-20T01:49:01.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.032+0000 7fb4c8690640 1 --2- 172.21.15.79:0/2530022722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4c019c790 0x7fb4c019cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:01.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.032+0000 7fb4c8690640 1 --2- 172.21.15.79:0/2530022722 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb4ac0b3d60 0x7fb4ac0b6220 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:01.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.032+0000 7fb4c8690640 1 --2- 172.21.15.79:0/2530022722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4c0106c00 0x7fb4c01973f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:01.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.032+0000 7fb4c8690640 1 --2- 172.21.15.79:0/2530022722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c0106280 0x7fb4c0196eb0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:01.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.032+0000 7fb4c8690640 1 -- 172.21.15.79:0/2530022722 >> 172.21.15.79:0/2530022722 conn(0x7fb4c00fc730 msgr2=0x7fb4c0104090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:01.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.032+0000 7fb4c8690640 1 -- 172.21.15.79:0/2530022722 shutdown_connections 2024-08-20T01:49:01.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:01.032+0000 7fb4c8690640 1 -- 172.21.15.79:0/2530022722 wait complete. 2024-08-20T01:49:01.897 INFO:tasks.cephfs.filesystem:scrub status for tag:b18f68c8-fe7d-4fd5-bff7-64fa7bbd4daa - {'path': '/', 'tag': 'b18f68c8-fe7d-4fd5-bff7-64fa7bbd4daa', 'options': 'recursive,force'} 2024-08-20T01:49:02.188 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:01 smithi079 ceph-mon[18656]: pgmap v698: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 24 MiB/s wr, 6.08k op/s 2024-08-20T01:49:02.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:01 smithi081 ceph-mon[22209]: pgmap v698: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 24 MiB/s wr, 6.08k op/s 2024-08-20T01:49:02.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:01 smithi175 ceph-mon[22392]: pgmap v698: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 24 MiB/s wr, 6.08k op/s 2024-08-20T01:49:04.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:03 smithi079 ceph-mon[18656]: pgmap v699: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 23 MiB/s wr, 5.93k op/s 2024-08-20T01:49:04.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:03 smithi081 ceph-mon[22209]: pgmap v699: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 23 MiB/s wr, 5.93k op/s 2024-08-20T01:49:04.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:03 smithi175 ceph-mon[22392]: pgmap v699: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 23 MiB/s wr, 5.93k op/s 2024-08-20T01:49:06.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:05 smithi079 ceph-mon[18656]: pgmap v700: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 23 MiB/s wr, 5.99k op/s 2024-08-20T01:49:06.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:05 smithi081 ceph-mon[22209]: pgmap v700: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 23 MiB/s wr, 5.99k op/s 2024-08-20T01:49:06.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:05 smithi175 ceph-mon[22392]: pgmap v700: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 23 MiB/s wr, 5.99k op/s 2024-08-20T01:49:08.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:07 smithi079 ceph-mon[18656]: pgmap v701: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 25 MiB/s wr, 6.44k op/s 2024-08-20T01:49:08.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:07 smithi081 ceph-mon[22209]: pgmap v701: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 25 MiB/s wr, 6.44k op/s 2024-08-20T01:49:08.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:07 smithi175 ceph-mon[22392]: pgmap v701: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 25 MiB/s wr, 6.44k op/s 2024-08-20T01:49:10.247 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.244+0000 7f0464f5f640 1 -- 172.21.15.79:0/2790275064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04580a4080 msgr2=0x7f04580a4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:10.247 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.244+0000 7f0464f5f640 1 --2- 172.21.15.79:0/2790275064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04580a4080 0x7f04580a4500 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0460068760 tx=0x7f046008f180 comp rx=0 tx=0).stop 2024-08-20T01:49:10.247 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.244+0000 7f045e7fc640 1 -- 172.21.15.79:0/2790275064 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f046006b680 con 0x7f04580a4080 2024-08-20T01:49:10.247 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.244+0000 7f0464f5f640 1 -- 172.21.15.79:0/2790275064 shutdown_connections 2024-08-20T01:49:10.247 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.244+0000 7f0464f5f640 1 --2- 172.21.15.79:0/2790275064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04580a4a40 0x7f045800b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:10.247 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.244+0000 7f0464f5f640 1 --2- 172.21.15.79:0/2790275064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04580a4080 0x7f04580a4500 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:10.247 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.244+0000 7f0464f5f640 1 --2- 172.21.15.79:0/2790275064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04580a5730 0x7f04580a5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:10.247 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.244+0000 7f0464f5f640 1 -- 172.21.15.79:0/2790275064 >> 172.21.15.79:0/2790275064 conn(0x7f045809fbd0 msgr2=0x7f04580a2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:10.247 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.244+0000 7f0464f5f640 1 -- 172.21.15.79:0/2790275064 shutdown_connections 2024-08-20T01:49:10.248 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.244+0000 7f0464f5f640 1 -- 172.21.15.79:0/2790275064 wait complete. 2024-08-20T01:49:10.248 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.245+0000 7f0464f5f640 1 Processor -- start 2024-08-20T01:49:10.248 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.245+0000 7f0464f5f640 1 -- start start 2024-08-20T01:49:10.249 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.245+0000 7f0464f5f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04580a4080 0x7f045800b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:10.249 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.245+0000 7f0464f5f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04580a4a40 0x7f0458009c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:10.249 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.245+0000 7f0464f5f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04580a5730 0x7f045800a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:10.249 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.245+0000 7f0464f5f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f045800de10 con 0x7f04580a4080 2024-08-20T01:49:10.249 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.245+0000 7f0464f5f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f045800dc90 con 0x7f04580a4a40 2024-08-20T01:49:10.249 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.245+0000 7f0464f5f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f045800df90 con 0x7f04580a5730 2024-08-20T01:49:10.250 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.246+0000 7f045effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04580a4a40 0x7f0458009c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:10.250 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.246+0000 7f045effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04580a4a40 0x7f0458009c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:52872/0 (socket says 172.21.15.79:52872) 2024-08-20T01:49:10.250 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.246+0000 7f045effd640 1 -- 172.21.15.79:0/3129419915 learned_addr learned my addr 172.21.15.79:0/3129419915 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:10.250 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.246+0000 7f045f7fe640 1 --2- 172.21.15.79:0/3129419915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04580a4080 0x7f045800b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:10.250 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.246+0000 7f045ffff640 1 --2- 172.21.15.79:0/3129419915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04580a5730 0x7f045800a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:10.250 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.246+0000 7f045effd640 1 -- 172.21.15.79:0/3129419915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04580a5730 msgr2=0x7f045800a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:10.250 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.246+0000 7f045effd640 1 --2- 172.21.15.79:0/3129419915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04580a5730 0x7f045800a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:10.250 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.246+0000 7f045effd640 1 -- 172.21.15.79:0/3129419915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04580a4080 msgr2=0x7f045800b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:10.250 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.246+0000 7f045effd640 1 --2- 172.21.15.79:0/3129419915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04580a4080 0x7f045800b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:10.250 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.246+0000 7f045effd640 1 -- 172.21.15.79:0/3129419915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f045800a930 con 0x7f04580a4a40 2024-08-20T01:49:10.250 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.246+0000 7f045effd640 1 --2- 172.21.15.79:0/3129419915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04580a4a40 0x7f0458009c20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f04600525c0 tx=0x7f0460069a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:10.250 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.247+0000 7f045cff9640 1 -- 172.21.15.79:0/3129419915 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04600a6070 con 0x7f04580a4a40 2024-08-20T01:49:10.251 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.247+0000 7f045cff9640 1 -- 172.21.15.79:0/3129419915 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0460069e30 con 0x7f04580a4a40 2024-08-20T01:49:10.251 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.247+0000 7f045cff9640 1 -- 172.21.15.79:0/3129419915 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04600a1700 con 0x7f04580a4a40 2024-08-20T01:49:10.251 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.247+0000 7f0464f5f640 1 -- 172.21.15.79:0/3129419915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04580ce7d0 con 0x7f04580a4a40 2024-08-20T01:49:10.251 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.247+0000 7f0464f5f640 1 -- 172.21.15.79:0/3129419915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04580cec40 con 0x7f04580a4a40 2024-08-20T01:49:10.252 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.250+0000 7f0468bfd740 1 Processor -- start 2024-08-20T01:49:10.252 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.250+0000 7f0468bfd740 1 -- start start 2024-08-20T01:49:10.252 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.251+0000 7f0468bfd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559effa2ea20 0x559effa30e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:10.253 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.251+0000 7f0468bfd740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559effa31350 0x559effa33740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:10.253 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.251+0000 7f0468bfd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559effa33d90 0x559effa36250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:10.253 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.251+0000 7f0468bfd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559eff9a1360 con 0x559effa33d90 2024-08-20T01:49:10.253 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.251+0000 7f0468bfd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559eff990860 con 0x559effa2ea20 2024-08-20T01:49:10.253 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.251+0000 7f0468bfd740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559eff9948a0 con 0x559effa31350 2024-08-20T01:49:10.253 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.251+0000 7f045cff9640 1 -- 172.21.15.79:0/3129419915 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f0460064030 con 0x7f04580a4a40 2024-08-20T01:49:10.254 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.251+0000 7f045ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559effa2ea20 0x559effa30e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:10.254 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.251+0000 7f045ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559effa2ea20 0x559effa30e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:52886/0 (socket says 172.21.15.79:52886) 2024-08-20T01:49:10.254 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.251+0000 7f045ffff640 1 -- 172.21.15.79:0/1595962386 learned_addr learned my addr 172.21.15.79:0/1595962386 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:10.254 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.252+0000 7f045f7fe640 1 --2- 172.21.15.79:0/1595962386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559effa31350 0x559effa33740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:10.254 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.252+0000 7f045effd640 1 --2- 172.21.15.79:0/1595962386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559effa33d90 0x559effa36250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:10.255 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.252+0000 7f045f7fe640 1 -- 172.21.15.79:0/1595962386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559effa2ea20 msgr2=0x559effa30e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:10.255 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.252+0000 7f045f7fe640 1 --2- 172.21.15.79:0/1595962386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559effa2ea20 0x559effa30e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:10.255 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.252+0000 7f045cff9640 1 --2- 172.21.15.79:0/3129419915 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f04500b3dd0 0x7f04500b6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:10.255 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.252+0000 7f045f7fe640 1 -- 172.21.15.79:0/1595962386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559effa33d90 msgr2=0x559effa36250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:10.255 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.252+0000 7f045f7fe640 1 --2- 172.21.15.79:0/1595962386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559effa33d90 0x559effa36250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:10.255 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.252+0000 7f045f7fe640 1 -- 172.21.15.79:0/1595962386 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559eff937e40 con 0x559effa31350 2024-08-20T01:49:10.255 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.253+0000 7f045cff9640 1 -- 172.21.15.79:0/3129419915 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f0460167f50 con 0x7f04580a4a40 2024-08-20T01:49:10.256 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.253+0000 7f045f7fe640 1 --2- 172.21.15.79:0/1595962386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559effa31350 0x559effa33740 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0454009980 tx=0x7f0454009e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70820ecb132be354 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:10.256 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.253+0000 7f045ffff640 1 --2- 172.21.15.79:0/3129419915 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f04500b3dd0 0x7f04500b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:10.256 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.253+0000 7f0449ffb640 1 -- 172.21.15.79:0/1595962386 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045400ea80 con 0x559effa31350 2024-08-20T01:49:10.256 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.253+0000 7f0449ffb640 1 -- 172.21.15.79:0/1595962386 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f045400ec20 con 0x559effa31350 2024-08-20T01:49:10.256 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.253+0000 7f0449ffb640 1 -- 172.21.15.79:0/1595962386 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0454006820 con 0x559effa31350 2024-08-20T01:49:10.257 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.254+0000 7f0468bfd740 1 -- 172.21.15.79:0/1595962386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559effa31350 msgr2=0x559effa33740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:10.257 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.254+0000 7f0468bfd740 1 --2- 172.21.15.79:0/1595962386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559effa31350 0x559effa33740 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0454009980 tx=0x7f0454009e40 comp rx=0 tx=0).stop 2024-08-20T01:49:10.257 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.254+0000 7f045ffff640 1 --2- 172.21.15.79:0/3129419915 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f04500b3dd0 0x7f04500b6290 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f044c005fd0 tx=0x7f044c00b4e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:10.257 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.255+0000 7f0468bfd740 1 -- 172.21.15.79:0/1595962386 shutdown_connections 2024-08-20T01:49:10.257 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.255+0000 7f0468bfd740 1 --2- 172.21.15.79:0/1595962386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559effa33d90 0x559effa36250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:10.257 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.255+0000 7f0468bfd740 1 --2- 172.21.15.79:0/1595962386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559effa31350 0x559effa33740 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:10.257 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.255+0000 7f0468bfd740 1 --2- 172.21.15.79:0/1595962386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559effa2ea20 0x559effa30e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:10.257 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.255+0000 7f0468bfd740 1 -- 172.21.15.79:0/1595962386 >> 172.21.15.79:0/1595962386 conn(0x559effa29b70 msgr2=0x559effa2a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:10.258 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.255+0000 7f0468bfd740 1 -- 172.21.15.79:0/1595962386 shutdown_connections 2024-08-20T01:49:10.258 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.255+0000 7f0468bfd740 1 -- 172.21.15.79:0/1595962386 wait complete. 2024-08-20T01:49:10.258 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.255+0000 7f0468bfd740 1 -- start start 2024-08-20T01:49:10.260 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.256+0000 7f0468bfd740 1 Processor -- start 2024-08-20T01:49:10.260 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.256+0000 7f0468bfd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559effa2ea20 0x559effa381f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:10.260 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.256+0000 7f0468bfd740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559effa31350 0x559effa38890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:10.260 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.256+0000 7f0468bfd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559effa33d90 0x559effa39460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:10.260 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.256+0000 7f0468bfd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559eff8c9ab0 con 0x559effa2ea20 2024-08-20T01:49:10.260 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.256+0000 7f0468bfd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559eff917780 con 0x559effa33d90 2024-08-20T01:49:10.260 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.256+0000 7f0468bfd740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559effa36d70 con 0x559effa31350 2024-08-20T01:49:10.260 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.256+0000 7f0468bfd740 10 client.0 _ll_register_callbacks cb 0x559eff69fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:49:10.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.256+0000 7f045f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559effa2ea20 0x559effa381f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:10.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.256+0000 7f045effd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559effa31350 0x559effa38890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:10.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.256+0000 7f045f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559effa2ea20 0x559effa381f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41528/0 (socket says 172.21.15.79:41528) 2024-08-20T01:49:10.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.257+0000 7f045f7fe640 1 -- 172.21.15.79:0/1230562773 learned_addr learned my addr 172.21.15.79:0/1230562773 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:10.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.257+0000 7f045ffff640 1 --2- 172.21.15.79:0/1230562773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559effa33d90 0x559effa39460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:10.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.257+0000 7f045f7fe640 1 -- 172.21.15.79:0/1230562773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559effa31350 msgr2=0x559effa38890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:10.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.257+0000 7f045f7fe640 1 --2- 172.21.15.79:0/1230562773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559effa31350 0x559effa38890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:10.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.257+0000 7f045f7fe640 1 -- 172.21.15.79:0/1230562773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559effa33d90 msgr2=0x559effa39460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:10.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.257+0000 7f045f7fe640 1 --2- 172.21.15.79:0/1230562773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559effa33d90 0x559effa39460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:10.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.257+0000 7f045f7fe640 1 -- 172.21.15.79:0/1230562773 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559eff6f3790 con 0x559effa2ea20 2024-08-20T01:49:10.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.257+0000 7f045effd640 1 --2- 172.21.15.79:0/1230562773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559effa31350 0x559effa38890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:49:10.261 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.257+0000 7f045f7fe640 1 --2- 172.21.15.79:0/1230562773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559effa2ea20 0x559effa381f0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f0454004860 tx=0x7f045400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11aa092e9dd9c6b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:10.262 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.257+0000 7f043effd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:49:10.262 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.258+0000 7f043effd640 1 -- 172.21.15.79:0/1230562773 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0454005e20 con 0x559effa2ea20 2024-08-20T01:49:10.262 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.258+0000 7f0468bfd740 1 -- 172.21.15.79:0/1230562773 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559eff93fe00 con 0x559effa2ea20 2024-08-20T01:49:10.262 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.258+0000 7f043effd640 1 -- 172.21.15.79:0/1230562773 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f0454005fc0 con 0x559effa2ea20 2024-08-20T01:49:10.262 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.258+0000 7f043effd640 1 -- 172.21.15.79:0/1230562773 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f04540061c0 con 0x559effa2ea20 2024-08-20T01:49:10.262 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.258+0000 7f0468bfd740 10 client.18534 fetch_fsmap learned FSMap version 49 2024-08-20T01:49:10.262 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.258+0000 7f0468bfd740 1 -- 172.21.15.79:0/1230562773 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x559eff76c620 con 0x559effa2ea20 2024-08-20T01:49:10.264 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.259+0000 7f043effd640 1 -- 172.21.15.79:0/1230562773 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f045402a030 con 0x559effa2ea20 2024-08-20T01:49:10.264 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.259+0000 7f043effd640 1 -- 172.21.15.79:0/1230562773 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 49) ==== 8378+0+0 (secure 0 0 0) 0x7f0454022070 con 0x559effa2ea20 2024-08-20T01:49:10.264 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.259+0000 7f0468bfd740 10 client.18534 fetch_fsmap finished waiting for FSMap version 49 2024-08-20T01:49:10.264 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.260+0000 7f0468bfd740 10 client.18534 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:49:10.265 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.260+0000 7f0468bfd740 20 client.18534 populate_metadata read hostname 'smithi079' 2024-08-20T01:49:10.265 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.260+0000 7f0468bfd740 1 --2- 172.21.15.79:0/1230562773 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x559effa43d60 0x559effa46180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:10.265 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.260+0000 7f0468bfd740 4 client.18534 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:49:10.265 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.260+0000 7f0468bfd740 1 -- 172.21.15.79:0/1230562773 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559eff93fe00 con 0x559effa43d60 2024-08-20T01:49:10.265 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.260+0000 7f045effd640 1 --2- 172.21.15.79:0/1230562773 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x559effa43d60 0x559effa46180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:10.265 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.261+0000 7f043effd640 10 client.18534 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:49:10.265 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.261+0000 7f045effd640 1 --2- 172.21.15.79:0/1230562773 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x559effa43d60 0x559effa46180 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc7778831d36ef06 server_cookie=ab28e5ad675ce969 in_seq=0 out_seq=0 2024-08-20T01:49:10.265 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.262+0000 7f043effd640 1 -- 172.21.15.79:0/1230562773 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559eff93fe00 con 0x559effa43d60 2024-08-20T01:49:10.265 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.262+0000 7f043effd640 10 client.18534 handle_command_reply: tid=0 2024-08-20T01:49:10.265 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.262+0000 7f0468bfd740 1 client.18534 shutdown 2024-08-20T01:49:10.265 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.262+0000 7f0468bfd740 1 -- 172.21.15.79:0/1230562773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559effa2ea20 msgr2=0x559effa381f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:10.265 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.262+0000 7f0468bfd740 1 --2- 172.21.15.79:0/1230562773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559effa2ea20 0x559effa381f0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f0454004860 tx=0x7f045400ed30 comp rx=0 tx=0).stop 2024-08-20T01:49:10.266 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.262+0000 7f0468bfd740 1 -- 172.21.15.79:0/1230562773 shutdown_connections 2024-08-20T01:49:10.266 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.262+0000 7f0468bfd740 1 --2- 172.21.15.79:0/1230562773 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x559effa43d60 0x559effa46180 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:10.266 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.262+0000 7f0468bfd740 1 --2- 172.21.15.79:0/1230562773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559effa33d90 0x559effa39460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:10.266 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.262+0000 7f0468bfd740 1 --2- 172.21.15.79:0/1230562773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559effa31350 0x559effa38890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:10.266 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.262+0000 7f0468bfd740 1 --2- 172.21.15.79:0/1230562773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559effa2ea20 0x559effa381f0 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:10.266 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.262+0000 7f0468bfd740 1 -- 172.21.15.79:0/1230562773 >> 172.21.15.79:0/1230562773 conn(0x559effa29b70 msgr2=0x559effa28c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:10.266 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.262+0000 7f043effd640 0 client.18534 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:49:10.266 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.262+0000 7f0468bfd740 1 -- 172.21.15.79:0/1230562773 shutdown_connections 2024-08-20T01:49:10.266 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.262+0000 7f0468bfd740 1 -- 172.21.15.79:0/1230562773 wait complete. 2024-08-20T01:49:10.266 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.263+0000 7f0468bfd740 20 client.18534 trim_cache size 0 max 16384 2024-08-20T01:49:10.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:09 smithi081 ceph-mon[22209]: pgmap v702: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 26 MiB/s wr, 6.66k op/s 2024-08-20T01:49:10.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:09 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:49:10.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:09 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:49:10.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:09 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:49:10.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.292+0000 7f0468bfd740 1 Processor -- start 2024-08-20T01:49:10.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.292+0000 7f0468bfd740 1 -- start start 2024-08-20T01:49:10.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.292+0000 7f0468bfd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559effa2ea20 0x559effa356a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:10.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.292+0000 7f0468bfd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559effa31350 0x559effa35be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:10.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.292+0000 7f0468bfd740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559effa33d90 0x559effa34170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:10.295 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.292+0000 7f0468bfd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f044400e4a0 con 0x559effa2ea20 2024-08-20T01:49:10.295 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.292+0000 7f0468bfd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f04440100a0 con 0x559effa31350 2024-08-20T01:49:10.295 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.292+0000 7f0468bfd740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f044400ec30 con 0x559effa33d90 2024-08-20T01:49:10.295 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.293+0000 7f045f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559effa2ea20 0x559effa356a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:10.295 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.293+0000 7f045f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559effa2ea20 0x559effa356a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35412/0 (socket says 172.21.15.79:35412) 2024-08-20T01:49:10.295 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.293+0000 7f045f7fe640 1 -- 172.21.15.79:0/2233912572 learned_addr learned my addr 172.21.15.79:0/2233912572 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:10.295 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.293+0000 7f045effd640 1 --2- 172.21.15.79:0/2233912572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559effa31350 0x559effa35be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:10.295 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.293+0000 7f045ffff640 1 --2- 172.21.15.79:0/2233912572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559effa33d90 0x559effa34170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:10.296 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.293+0000 7f045effd640 1 -- 172.21.15.79:0/2233912572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559effa33d90 msgr2=0x559effa34170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:10.296 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.293+0000 7f045effd640 1 --2- 172.21.15.79:0/2233912572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559effa33d90 0x559effa34170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:10.296 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.293+0000 7f045effd640 1 -- 172.21.15.79:0/2233912572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559effa2ea20 msgr2=0x559effa356a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:10.296 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.293+0000 7f045effd640 1 --2- 172.21.15.79:0/2233912572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559effa2ea20 0x559effa356a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:10.296 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.293+0000 7f045effd640 1 -- 172.21.15.79:0/2233912572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559effa251a0 con 0x559effa31350 2024-08-20T01:49:10.296 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.293+0000 7f045effd640 1 --2- 172.21.15.79:0/2233912572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559effa31350 0x559effa35be0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f046012c030 tx=0x7f04600691a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=486ac6f312ad2c1f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:10.296 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.294+0000 7f04497fa640 1 -- 172.21.15.79:0/2233912572 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f046012e5c0 con 0x559effa31350 2024-08-20T01:49:10.296 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.294+0000 7f04497fa640 1 -- 172.21.15.79:0/2233912572 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0460131020 con 0x559effa31350 2024-08-20T01:49:10.297 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.294+0000 7f04497fa640 1 -- 172.21.15.79:0/2233912572 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f046012ee50 con 0x559effa31350 2024-08-20T01:49:10.297 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.295+0000 7f0468bfd740 1 -- 172.21.15.79:0/2233912572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559effa31350 msgr2=0x559effa35be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:10.298 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.295+0000 7f0468bfd740 1 --2- 172.21.15.79:0/2233912572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559effa31350 0x559effa35be0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f046012c030 tx=0x7f04600691a0 comp rx=0 tx=0).stop 2024-08-20T01:49:10.298 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.295+0000 7f0468bfd740 1 -- 172.21.15.79:0/2233912572 shutdown_connections 2024-08-20T01:49:10.298 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.295+0000 7f0468bfd740 1 --2- 172.21.15.79:0/2233912572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559effa33d90 0x559effa34170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:10.298 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.295+0000 7f0468bfd740 1 --2- 172.21.15.79:0/2233912572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559effa31350 0x559effa35be0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:10.298 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.295+0000 7f0468bfd740 1 --2- 172.21.15.79:0/2233912572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559effa2ea20 0x559effa356a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:10.298 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.295+0000 7f0468bfd740 1 -- 172.21.15.79:0/2233912572 >> 172.21.15.79:0/2233912572 conn(0x559effa29b70 msgr2=0x559effa2a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:10.298 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.297+0000 7f0468bfd740 1 -- 172.21.15.79:0/2233912572 shutdown_connections 2024-08-20T01:49:10.299 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.297+0000 7f0468bfd740 1 -- 172.21.15.79:0/2233912572 wait complete. 2024-08-20T01:49:10.299 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.298+0000 7f0468bfd740 1 -- start start 2024-08-20T01:49:10.299 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.298+0000 7f0468bfd740 1 Processor -- start 2024-08-20T01:49:10.301 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.299+0000 7f0468bfd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559effa2ea20 0x559effa4ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:10.301 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.299+0000 7f045f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559effa2ea20 0x559effa4ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:10.301 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.300+0000 7f045f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559effa2ea20 0x559effa4ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:39204/0 (socket says 172.21.15.79:39204) 2024-08-20T01:49:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.300+0000 7f045f7fe640 1 -- 172.21.15.79:0/2551132049 learned_addr learned my addr 172.21.15.79:0/2551132049 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.300+0000 7f0468bfd740 1 --2- 172.21.15.79:0/2551132049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559effa31350 0x559effa4b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.300+0000 7f0468bfd740 1 --2- 172.21.15.79:0/2551132049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559effa33d90 0x559effa4b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.300+0000 7f045effd640 1 --2- 172.21.15.79:0/2551132049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559effa31350 0x559effa4b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:10.303 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.301+0000 7f0468bfd740 1 -- 172.21.15.79:0/2551132049 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f044400f9d0 con 0x559effa33d90 2024-08-20T01:49:10.303 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.301+0000 7f0468bfd740 1 -- 172.21.15.79:0/2551132049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f044400f300 con 0x559effa2ea20 2024-08-20T01:49:10.303 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.301+0000 7f0468bfd740 1 -- 172.21.15.79:0/2551132049 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f044400c480 con 0x559effa31350 2024-08-20T01:49:10.303 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.301+0000 7f045ffff640 1 --2- 172.21.15.79:0/2551132049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559effa33d90 0x559effa4b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:10.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.301+0000 7f045f7fe640 1 -- 172.21.15.79:0/2551132049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559effa31350 msgr2=0x559effa4b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:10.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.301+0000 7f045f7fe640 1 --2- 172.21.15.79:0/2551132049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559effa31350 0x559effa4b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:10.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.301+0000 7f045f7fe640 1 -- 172.21.15.79:0/2551132049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559effa33d90 msgr2=0x559effa4b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:10.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.301+0000 7f045f7fe640 1 --2- 172.21.15.79:0/2551132049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559effa33d90 0x559effa4b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:10.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.301+0000 7f0468bfd740 10 client.0 _ll_register_callbacks cb 0x7f046016b7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:49:10.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.302+0000 7f045f7fe640 1 -- 172.21.15.79:0/2551132049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559effa33ab0 con 0x559effa2ea20 2024-08-20T01:49:10.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.302+0000 7f0468bfd740 1 -- 172.21.15.79:0/2551132049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0460131020 con 0x559effa2ea20 2024-08-20T01:49:10.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.302+0000 7f045f7fe640 1 --2- 172.21.15.79:0/2551132049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559effa2ea20 0x559effa4ad90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0454009150 tx=0x7f0454006980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64ccd5c8749d1519 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:10.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.302+0000 7f043effd640 10 client.27629 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:49:10.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.302+0000 7f043effd640 1 -- 172.21.15.79:0/2551132049 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0454033060 con 0x559effa2ea20 2024-08-20T01:49:10.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.303+0000 7f043effd640 1 -- 172.21.15.79:0/2551132049 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f0454024ca0 con 0x559effa2ea20 2024-08-20T01:49:10.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.303+0000 7f043effd640 1 -- 172.21.15.79:0/2551132049 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f0454009570 con 0x559effa2ea20 2024-08-20T01:49:10.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.303+0000 7f0468bfd740 10 client.27629 fetch_fsmap learned FSMap version 49 2024-08-20T01:49:10.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.303+0000 7f0468bfd740 1 -- 172.21.15.79:0/2551132049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({fsmap=49}) -- 0x559effa31180 con 0x559effa2ea20 2024-08-20T01:49:10.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.304+0000 7f043effd640 1 -- 172.21.15.79:0/2551132049 <== mon.2 v2:172.21.15.81:3300/0 4 ==== fsmap(e 49) ==== 8378+0+0 (secure 0 0 0) 0x7f0454022040 con 0x559effa2ea20 2024-08-20T01:49:10.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.304+0000 7f0468bfd740 10 client.27629 fetch_fsmap finished waiting for FSMap version 49 2024-08-20T01:49:10.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.304+0000 7f0468bfd740 10 client.27629 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:49:10.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.304+0000 7f0468bfd740 20 client.27629 populate_metadata read hostname 'smithi079' 2024-08-20T01:49:10.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.304+0000 7f0468bfd740 1 --2- 172.21.15.79:0/2551132049 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x559effaae260 0x559effab0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:10.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.305+0000 7f0468bfd740 4 client.27629 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:49:10.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.305+0000 7f0468bfd740 1 -- 172.21.15.79:0/2551132049 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f0460131020 con 0x559effaae260 2024-08-20T01:49:10.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.305+0000 7f045effd640 1 --2- 172.21.15.79:0/2551132049 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x559effaae260 0x559effab0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:10.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.305+0000 7f045effd640 1 --2- 172.21.15.79:0/2551132049 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x559effaae260 0x559effab0680 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6714dafd7849f45 server_cookie=5334bd528a214d4b in_seq=0 out_seq=0 2024-08-20T01:49:10.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.305+0000 7f043effd640 10 client.27629 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:49:10.333 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.331+0000 7f043effd640 1 -- 172.21.15.79:0/2551132049 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f0460131020 con 0x559effaae260 2024-08-20T01:49:10.334 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.331+0000 7f043effd640 10 client.27629 handle_command_reply: tid=0 2024-08-20T01:49:10.334 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.331+0000 7f0468bfd740 1 client.27629 shutdown 2024-08-20T01:49:10.334 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.331+0000 7f0468bfd740 1 -- 172.21.15.79:0/2551132049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559effa2ea20 msgr2=0x559effa4ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:10.334 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.331+0000 7f0468bfd740 1 --2- 172.21.15.79:0/2551132049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559effa2ea20 0x559effa4ad90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0454009150 tx=0x7f0454006980 comp rx=0 tx=0).stop 2024-08-20T01:49:10.334 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.331+0000 7f0468bfd740 1 -- 172.21.15.79:0/2551132049 shutdown_connections 2024-08-20T01:49:10.334 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.331+0000 7f0468bfd740 1 --2- 172.21.15.79:0/2551132049 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x559effaae260 0x559effab0680 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:10.334 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.331+0000 7f043effd640 0 client.27629 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:49:10.334 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.331+0000 7f0468bfd740 1 --2- 172.21.15.79:0/2551132049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559effa33d90 0x559effa4b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:10.334 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.331+0000 7f0468bfd740 1 --2- 172.21.15.79:0/2551132049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559effa31350 0x559effa4b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:10.334 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.332+0000 7f0468bfd740 1 --2- 172.21.15.79:0/2551132049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559effa2ea20 0x559effa4ad90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:10.334 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.332+0000 7f0468bfd740 1 -- 172.21.15.79:0/2551132049 >> 172.21.15.79:0/2551132049 conn(0x559effa29b70 msgr2=0x559effa356a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:10.335 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.332+0000 7f0468bfd740 1 -- 172.21.15.79:0/2551132049 shutdown_connections 2024-08-20T01:49:10.335 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.332+0000 7f0468bfd740 1 -- 172.21.15.79:0/2551132049 wait complete. 2024-08-20T01:49:10.335 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.332+0000 7f0468bfd740 20 client.27629 trim_cache size 0 max 16384 2024-08-20T01:49:10.335 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:49:10.335 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:49:10.335 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:49:10.335 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:49:10.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.333+0000 7f0464f5f640 1 -- 172.21.15.79:0/3129419915 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f04500b3dd0 msgr2=0x7f04500b6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:10.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.333+0000 7f0464f5f640 1 --2- 172.21.15.79:0/3129419915 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f04500b3dd0 0x7f04500b6290 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f044c005fd0 tx=0x7f044c00b4e0 comp rx=0 tx=0).stop 2024-08-20T01:49:10.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.333+0000 7f0464f5f640 1 -- 172.21.15.79:0/3129419915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04580a4a40 msgr2=0x7f0458009c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:10.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.333+0000 7f0464f5f640 1 --2- 172.21.15.79:0/3129419915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04580a4a40 0x7f0458009c20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f04600525c0 tx=0x7f0460069a30 comp rx=0 tx=0).stop 2024-08-20T01:49:10.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.333+0000 7f0464f5f640 1 -- 172.21.15.79:0/3129419915 shutdown_connections 2024-08-20T01:49:10.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.333+0000 7f0464f5f640 1 --2- 172.21.15.79:0/3129419915 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f04500b3dd0 0x7f04500b6290 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:10.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.333+0000 7f0464f5f640 1 --2- 172.21.15.79:0/3129419915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04580a5730 0x7f045800a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:10.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.333+0000 7f0464f5f640 1 --2- 172.21.15.79:0/3129419915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04580a4a40 0x7f0458009c20 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:10.337 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.333+0000 7f0464f5f640 1 --2- 172.21.15.79:0/3129419915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04580a4080 0x7f045800b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:10.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.334+0000 7f0464f5f640 1 -- 172.21.15.79:0/3129419915 >> 172.21.15.79:0/3129419915 conn(0x7f045809fbd0 msgr2=0x7f04580a1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:10.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.334+0000 7f0464f5f640 1 -- 172.21.15.79:0/3129419915 shutdown_connections 2024-08-20T01:49:10.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:10.334+0000 7f0464f5f640 1 -- 172.21.15.79:0/3129419915 wait complete. 2024-08-20T01:49:10.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:09 smithi175 ceph-mon[22392]: pgmap v702: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 26 MiB/s wr, 6.66k op/s 2024-08-20T01:49:10.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:09 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:49:10.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:09 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:49:10.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:09 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:49:10.438 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:09 smithi079 ceph-mon[18656]: pgmap v702: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 26 MiB/s wr, 6.66k op/s 2024-08-20T01:49:10.438 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:09 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:49:10.438 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:09 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:49:10.438 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:09 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:49:11.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:10 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:49:11.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:10 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:49:11.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:10 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:49:11.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:10 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:49:11.438 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:10 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:49:11.438 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:10 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:49:12.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:11 smithi081 ceph-mon[22209]: pgmap v703: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 25 MiB/s wr, 6.40k op/s 2024-08-20T01:49:12.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:11 smithi175 ceph-mon[22392]: pgmap v703: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 25 MiB/s wr, 6.40k op/s 2024-08-20T01:49:12.438 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:11 smithi079 ceph-mon[18656]: pgmap v703: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 25 MiB/s wr, 6.40k op/s 2024-08-20T01:49:14.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:13 smithi081 ceph-mon[22209]: pgmap v704: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 25 MiB/s wr, 6.27k op/s 2024-08-20T01:49:14.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:13 smithi175 ceph-mon[22392]: pgmap v704: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 25 MiB/s wr, 6.27k op/s 2024-08-20T01:49:14.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:13 smithi079 ceph-mon[18656]: pgmap v704: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 25 MiB/s wr, 6.27k op/s 2024-08-20T01:49:15.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:15 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:49:15.290 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:15 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:49:15.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:15 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:49:16.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:16 smithi081 ceph-mon[22209]: pgmap v705: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 25 MiB/s wr, 6.43k op/s 2024-08-20T01:49:16.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:16 smithi175 ceph-mon[22392]: pgmap v705: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 25 MiB/s wr, 6.43k op/s 2024-08-20T01:49:16.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:16 smithi079 ceph-mon[18656]: pgmap v705: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 25 MiB/s wr, 6.43k op/s 2024-08-20T01:49:18.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:18 smithi081 ceph-mon[22209]: pgmap v706: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 26 MiB/s wr, 6.72k op/s 2024-08-20T01:49:18.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:18 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:49:18.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:18 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:49:18.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:18 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:49:18.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:18 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:49:18.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:18 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:49:18.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:18 smithi175 ceph-mon[22392]: pgmap v706: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 26 MiB/s wr, 6.72k op/s 2024-08-20T01:49:18.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:18 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:49:18.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:18 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:49:18.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:18 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:49:18.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:18 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:49:18.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:18 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:49:18.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:18 smithi079 ceph-mon[18656]: pgmap v706: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 26 MiB/s wr, 6.72k op/s 2024-08-20T01:49:18.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:18 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:49:18.438 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:18 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:49:18.438 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:18 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:49:18.438 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:18 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:49:18.438 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:18 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:49:19.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:19 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:49:19.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:19 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:49:19.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:19 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:49:19.338 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:19 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:49:19.338 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:19 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:49:19.339 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:19 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:49:19.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:19 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:49:19.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:19 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:49:19.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:19 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:49:20.348 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:20 smithi079 ceph-mon[18656]: pgmap v707: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 27 MiB/s wr, 6.75k op/s 2024-08-20T01:49:20.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:20 smithi175 ceph-mon[22392]: pgmap v707: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 27 MiB/s wr, 6.75k op/s 2024-08-20T01:49:20.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:20 smithi081 ceph-mon[22209]: pgmap v707: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 27 MiB/s wr, 6.75k op/s 2024-08-20T01:49:22.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:22 smithi175 ceph-mon[22392]: pgmap v708: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 MiB/s wr, 6.44k op/s 2024-08-20T01:49:22.440 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:22 smithi079 ceph-mon[18656]: pgmap v708: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 MiB/s wr, 6.44k op/s 2024-08-20T01:49:22.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:22 smithi081 ceph-mon[22209]: pgmap v708: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 MiB/s wr, 6.44k op/s 2024-08-20T01:49:23.482 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.479+0000 7fab51e38640 1 -- 172.21.15.79:0/927745454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab4c073fc0 msgr2=0x7fab4c0743c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:23.482 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.479+0000 7fab51e38640 1 --2- 172.21.15.79:0/927745454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab4c073fc0 0x7fab4c0743c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fab3c009900 tx=0x7fab3c02a400 comp rx=0 tx=0).stop 2024-08-20T01:49:23.483 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.480+0000 7fab51e38640 1 -- 172.21.15.79:0/927745454 shutdown_connections 2024-08-20T01:49:23.483 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.480+0000 7fab51e38640 1 --2- 172.21.15.79:0/927745454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab4c10b950 0x7fab4c112200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:23.483 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.480+0000 7fab51e38640 1 --2- 172.21.15.79:0/927745454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab4c10af90 0x7fab4c10b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:23.483 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.480+0000 7fab51e38640 1 --2- 172.21.15.79:0/927745454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab4c073fc0 0x7fab4c0743c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:23.483 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.480+0000 7fab51e38640 1 -- 172.21.15.79:0/927745454 >> 172.21.15.79:0/927745454 conn(0x7fab4c06fb80 msgr2=0x7fab4c071fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:23.483 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.480+0000 7fab51e38640 1 -- 172.21.15.79:0/927745454 shutdown_connections 2024-08-20T01:49:23.483 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.480+0000 7fab51e38640 1 -- 172.21.15.79:0/927745454 wait complete. 2024-08-20T01:49:23.484 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.481+0000 7fab51e38640 1 Processor -- start 2024-08-20T01:49:23.484 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.481+0000 7fab51e38640 1 -- start start 2024-08-20T01:49:23.484 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.481+0000 7fab51e38640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab4c073fc0 0x7fab4c11a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:23.484 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.481+0000 7fab51e38640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab4c10af90 0x7fab4c11a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:23.485 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.481+0000 7fab51e38640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab4c10b950 0x7fab4c118ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:23.485 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.481+0000 7fab51e38640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fab4c113640 con 0x7fab4c10b950 2024-08-20T01:49:23.485 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.481+0000 7fab51e38640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fab4c1134c0 con 0x7fab4c073fc0 2024-08-20T01:49:23.485 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.481+0000 7fab51e38640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fab4c1137c0 con 0x7fab4c10af90 2024-08-20T01:49:23.485 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.481+0000 7fab4bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab4c10b950 0x7fab4c118ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:23.485 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.481+0000 7fab4affd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab4c10af90 0x7fab4c11a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:23.485 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.481+0000 7fab4affd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab4c10af90 0x7fab4c11a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:54828/0 (socket says 172.21.15.79:54828) 2024-08-20T01:49:23.485 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.481+0000 7fab4affd640 1 -- 172.21.15.79:0/372452554 learned_addr learned my addr 172.21.15.79:0/372452554 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:23.485 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.481+0000 7fab4bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab4c10b950 0x7fab4c118ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57480/0 (socket says 172.21.15.79:57480) 2024-08-20T01:49:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.482+0000 7fab4b7fe640 1 --2- 172.21.15.79:0/372452554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab4c073fc0 0x7fab4c11a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.482+0000 7fab4affd640 1 -- 172.21.15.79:0/372452554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab4c073fc0 msgr2=0x7fab4c11a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.482+0000 7fab4affd640 1 --2- 172.21.15.79:0/372452554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab4c073fc0 0x7fab4c11a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.482+0000 7fab4affd640 1 -- 172.21.15.79:0/372452554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab4c10b950 msgr2=0x7fab4c118ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.482+0000 7fab4affd640 1 --2- 172.21.15.79:0/372452554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab4c10b950 0x7fab4c118ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.482+0000 7fab4affd640 1 -- 172.21.15.79:0/372452554 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab4c119220 con 0x7fab4c10af90 2024-08-20T01:49:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.482+0000 7fab4affd640 1 --2- 172.21.15.79:0/372452554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab4c10af90 0x7fab4c11a700 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fab3400e9f0 tx=0x7fab3400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.482+0000 7fab48ff9640 1 -- 172.21.15.79:0/372452554 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3400cd80 con 0x7fab4c10af90 2024-08-20T01:49:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.482+0000 7fab51e38640 1 -- 172.21.15.79:0/372452554 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab4c119510 con 0x7fab4c10af90 2024-08-20T01:49:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.483+0000 7fab48ff9640 1 -- 172.21.15.79:0/372452554 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fab340108c0 con 0x7fab4c10af90 2024-08-20T01:49:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.483+0000 7fab48ff9640 1 -- 172.21.15.79:0/372452554 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab34018840 con 0x7fab4c10af90 2024-08-20T01:49:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.483+0000 7fab51e38640 1 -- 172.21.15.79:0/372452554 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab4c1199f0 con 0x7fab4c10af90 2024-08-20T01:49:23.489 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.486+0000 7fab54c27740 1 Processor -- start 2024-08-20T01:49:23.489 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.487+0000 7fab54c27740 1 -- start start 2024-08-20T01:49:23.490 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.487+0000 7fab54c27740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ac625a630 0x556ac625ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:23.490 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.487+0000 7fab54c27740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ac625cf60 0x556ac625f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:23.490 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.487+0000 7fab54c27740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac625f9a0 0x556ac6261e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:23.490 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.487+0000 7fab54c27740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556ac61cd360 con 0x556ac625a630 2024-08-20T01:49:23.490 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.487+0000 7fab54c27740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556ac61bc860 con 0x556ac625f9a0 2024-08-20T01:49:23.490 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.487+0000 7fab54c27740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556ac61c08a0 con 0x556ac625cf60 2024-08-20T01:49:23.490 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.487+0000 7fab48ff9640 1 -- 172.21.15.79:0/372452554 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fab340189e0 con 0x7fab4c10af90 2024-08-20T01:49:23.490 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.487+0000 7fab4affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac625f9a0 0x556ac6261e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:23.491 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.487+0000 7fab4affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac625f9a0 0x556ac6261e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:33518/0 (socket says 172.21.15.79:33518) 2024-08-20T01:49:23.492 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.487+0000 7fab4affd640 1 -- 172.21.15.79:0/732055174 learned_addr learned my addr 172.21.15.79:0/732055174 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:23.492 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.488+0000 7fab4b7fe640 1 --2- 172.21.15.79:0/732055174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ac625cf60 0x556ac625f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:23.492 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.488+0000 7fab4bfff640 1 --2- 172.21.15.79:0/732055174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ac625a630 0x556ac625ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:23.492 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.488+0000 7fab4affd640 1 -- 172.21.15.79:0/732055174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ac625cf60 msgr2=0x556ac625f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:23.492 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.488+0000 7fab4affd640 1 --2- 172.21.15.79:0/732055174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ac625cf60 0x556ac625f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:23.492 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.488+0000 7fab4affd640 1 -- 172.21.15.79:0/732055174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ac625a630 msgr2=0x556ac625ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:23.492 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.488+0000 7fab4affd640 1 --2- 172.21.15.79:0/732055174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ac625a630 0x556ac625ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:23.492 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.488+0000 7fab4affd640 1 -- 172.21.15.79:0/732055174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ac6163e40 con 0x556ac625f9a0 2024-08-20T01:49:23.492 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.488+0000 7fab4affd640 1 --2- 172.21.15.79:0/732055174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac625f9a0 0x556ac6261e60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fab340ec1b0 tx=0x7fab340ec670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c574257082bebf0c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:23.492 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.489+0000 7fab41ffb640 1 -- 172.21.15.79:0/732055174 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab340f7070 con 0x556ac625f9a0 2024-08-20T01:49:23.492 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.489+0000 7fab41ffb640 1 -- 172.21.15.79:0/732055174 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fab340e4ab0 con 0x556ac625f9a0 2024-08-20T01:49:23.493 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.489+0000 7fab41ffb640 1 -- 172.21.15.79:0/732055174 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab340f28a0 con 0x556ac625f9a0 2024-08-20T01:49:23.493 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.489+0000 7fab48ff9640 1 --2- 172.21.15.79:0/372452554 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fab380b3c50 0x7fab380b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:23.494 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.489+0000 7fab48ff9640 1 -- 172.21.15.79:0/372452554 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fab340e3ff0 con 0x7fab4c10af90 2024-08-20T01:49:23.494 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.490+0000 7fab54c27740 1 -- 172.21.15.79:0/732055174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac625f9a0 msgr2=0x556ac6261e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:23.494 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.490+0000 7fab54c27740 1 --2- 172.21.15.79:0/732055174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac625f9a0 0x556ac6261e60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fab340ec1b0 tx=0x7fab340ec670 comp rx=0 tx=0).stop 2024-08-20T01:49:23.494 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.490+0000 7fab54c27740 1 -- 172.21.15.79:0/732055174 shutdown_connections 2024-08-20T01:49:23.494 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.490+0000 7fab54c27740 1 --2- 172.21.15.79:0/732055174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac625f9a0 0x556ac6261e60 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:23.494 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.490+0000 7fab54c27740 1 --2- 172.21.15.79:0/732055174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ac625cf60 0x556ac625f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:23.494 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.490+0000 7fab54c27740 1 --2- 172.21.15.79:0/732055174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ac625a630 0x556ac625ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:23.495 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.490+0000 7fab54c27740 1 -- 172.21.15.79:0/732055174 >> 172.21.15.79:0/732055174 conn(0x556ac6255730 msgr2=0x556ac6256510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:23.495 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.490+0000 7fab54c27740 1 -- 172.21.15.79:0/732055174 shutdown_connections 2024-08-20T01:49:23.495 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.490+0000 7fab54c27740 1 -- 172.21.15.79:0/732055174 wait complete. 2024-08-20T01:49:23.495 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.491+0000 7fab54c27740 1 -- start start 2024-08-20T01:49:23.495 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.491+0000 7fab4bfff640 1 --2- 172.21.15.79:0/372452554 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fab380b3c50 0x7fab380b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:23.495 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.491+0000 7fab54c27740 1 Processor -- start 2024-08-20T01:49:23.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.492+0000 7fab54c27740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac625a630 0x556ac6263ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:23.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.492+0000 7fab54c27740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ac625cf60 0x556ac6264580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:23.497 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.493+0000 7fab4bfff640 1 --2- 172.21.15.79:0/372452554 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fab380b3c50 0x7fab380b6110 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fab44005fd0 tx=0x7fab44009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:23.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.493+0000 7fab4b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac625a630 0x556ac6263ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:23.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.493+0000 7fab4b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac625a630 0x556ac6263ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:33532/0 (socket says 172.21.15.79:33532) 2024-08-20T01:49:23.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.493+0000 7fab54c27740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ac625f9a0 0x556ac6265150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:23.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.493+0000 7fab54c27740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556ac60f5ab0 con 0x556ac625f9a0 2024-08-20T01:49:23.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.493+0000 7fab54c27740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556ac6143780 con 0x556ac625a630 2024-08-20T01:49:23.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.493+0000 7fab54c27740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556ac6262980 con 0x556ac625cf60 2024-08-20T01:49:23.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.493+0000 7fab54c27740 10 client.0 _ll_register_callbacks cb 0x556ac5ecba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:49:23.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.493+0000 7fab4b7fe640 1 -- 172.21.15.79:0/3992614044 learned_addr learned my addr 172.21.15.79:0/3992614044 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:23.498 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.493+0000 7fab4affd640 1 --2- 172.21.15.79:0/3992614044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ac625cf60 0x556ac6264580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:23.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.493+0000 7fab4bfff640 1 --2- 172.21.15.79:0/3992614044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ac625f9a0 0x556ac6265150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:23.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.493+0000 7fab4affd640 1 -- 172.21.15.79:0/3992614044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac625a630 msgr2=0x556ac6263ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:23.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.493+0000 7fab4affd640 1 --2- 172.21.15.79:0/3992614044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac625a630 0x556ac6263ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:23.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.493+0000 7fab4affd640 1 -- 172.21.15.79:0/3992614044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ac625f9a0 msgr2=0x556ac6265150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:23.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.493+0000 7fab4affd640 1 --2- 172.21.15.79:0/3992614044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ac625f9a0 0x556ac6265150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:23.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.493+0000 7fab4affd640 1 -- 172.21.15.79:0/3992614044 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ac5f1f790 con 0x556ac625cf60 2024-08-20T01:49:23.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.493+0000 7fab4b7fe640 1 --2- 172.21.15.79:0/3992614044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac625a630 0x556ac6263ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:49:23.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.494+0000 7fab4affd640 1 --2- 172.21.15.79:0/3992614044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ac625cf60 0x556ac6264580 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fab340ab0d0 tx=0x7fab340e42e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fb526741d0b7fd3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:23.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.494+0000 7fab2affd640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:49:23.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.494+0000 7fab2affd640 1 -- 172.21.15.79:0/3992614044 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab340a7290 con 0x556ac625cf60 2024-08-20T01:49:23.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.494+0000 7fab2affd640 1 -- 172.21.15.79:0/3992614044 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fab34010430 con 0x556ac625cf60 2024-08-20T01:49:23.499 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.494+0000 7fab54c27740 1 -- 172.21.15.79:0/3992614044 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556ac616be00 con 0x556ac625cf60 2024-08-20T01:49:23.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.494+0000 7fab2affd640 1 -- 172.21.15.79:0/3992614044 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fab340aab40 con 0x556ac625cf60 2024-08-20T01:49:23.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.494+0000 7fab54c27740 10 client.27589 fetch_fsmap learned FSMap version 50 2024-08-20T01:49:23.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.495+0000 7fab54c27740 1 -- 172.21.15.79:0/3992614044 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x556ac5f98620 con 0x556ac625cf60 2024-08-20T01:49:23.500 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.495+0000 7fab2affd640 1 -- 172.21.15.79:0/3992614044 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fab340aaee0 con 0x556ac625cf60 2024-08-20T01:49:23.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.496+0000 7fab2affd640 1 -- 172.21.15.79:0/3992614044 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 50) ==== 8366+0+0 (secure 0 0 0) 0x7fab340ab630 con 0x556ac625cf60 2024-08-20T01:49:23.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.496+0000 7fab54c27740 10 client.27589 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T01:49:23.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.496+0000 7fab54c27740 10 client.27589 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:49:23.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.496+0000 7fab54c27740 20 client.27589 populate_metadata read hostname 'smithi079' 2024-08-20T01:49:23.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.496+0000 7fab54c27740 1 --2- 172.21.15.79:0/3992614044 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556ac626f380 0x556ac6271770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:23.501 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.496+0000 7fab54c27740 4 client.27589 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:49:23.502 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.496+0000 7fab54c27740 1 -- 172.21.15.79:0/3992614044 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ac616be00 con 0x556ac626f380 2024-08-20T01:49:23.502 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.497+0000 7fab4b7fe640 1 --2- 172.21.15.79:0/3992614044 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556ac626f380 0x556ac6271770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:23.503 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.499+0000 7fab4b7fe640 1 --2- 172.21.15.79:0/3992614044 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556ac626f380 0x556ac6271770 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0918749824e7a0d server_cookie=bd2fb65d1a1f5ec7 in_seq=0 out_seq=0 2024-08-20T01:49:23.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.499+0000 7fab2affd640 10 client.27589 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:49:23.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.500+0000 7fab2affd640 1 -- 172.21.15.79:0/3992614044 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556ac616be00 con 0x556ac626f380 2024-08-20T01:49:23.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.500+0000 7fab2affd640 10 client.27589 handle_command_reply: tid=0 2024-08-20T01:49:23.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.500+0000 7fab54c27740 1 client.27589 shutdown 2024-08-20T01:49:23.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.500+0000 7fab54c27740 1 -- 172.21.15.79:0/3992614044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ac625cf60 msgr2=0x556ac6264580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:23.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.500+0000 7fab54c27740 1 --2- 172.21.15.79:0/3992614044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ac625cf60 0x556ac6264580 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fab340ab0d0 tx=0x7fab340e42e0 comp rx=0 tx=0).stop 2024-08-20T01:49:23.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.500+0000 7fab54c27740 1 -- 172.21.15.79:0/3992614044 shutdown_connections 2024-08-20T01:49:23.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.500+0000 7fab54c27740 1 --2- 172.21.15.79:0/3992614044 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556ac626f380 0x556ac6271770 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:23.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.500+0000 7fab54c27740 1 --2- 172.21.15.79:0/3992614044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ac625f9a0 0x556ac6265150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:23.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.501+0000 7fab54c27740 1 --2- 172.21.15.79:0/3992614044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ac625cf60 0x556ac6264580 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:23.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.501+0000 7fab54c27740 1 --2- 172.21.15.79:0/3992614044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac625a630 0x556ac6263ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:23.504 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.501+0000 7fab54c27740 1 -- 172.21.15.79:0/3992614044 >> 172.21.15.79:0/3992614044 conn(0x556ac6255730 msgr2=0x556ac6254850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:23.505 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.501+0000 7fab2affd640 0 client.27589 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:49:23.505 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.501+0000 7fab54c27740 1 -- 172.21.15.79:0/3992614044 shutdown_connections 2024-08-20T01:49:23.505 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.501+0000 7fab54c27740 1 -- 172.21.15.79:0/3992614044 wait complete. 2024-08-20T01:49:23.505 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.501+0000 7fab54c27740 20 client.27589 trim_cache size 0 max 16384 2024-08-20T01:49:23.538 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.535+0000 7fab54c27740 1 Processor -- start 2024-08-20T01:49:23.539 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.535+0000 7fab54c27740 1 -- start start 2024-08-20T01:49:23.539 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.535+0000 7fab54c27740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ac625a630 0x556ac6263080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:23.539 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.535+0000 7fab54c27740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ac625cf60 0x556ac62613a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:23.539 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.535+0000 7fab54c27740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac625f9a0 0x556ac62618e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:23.539 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.535+0000 7fab54c27740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fab2c00e430 con 0x556ac625a630 2024-08-20T01:49:23.539 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.536+0000 7fab54c27740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fab2c00ffa0 con 0x556ac625f9a0 2024-08-20T01:49:23.539 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.536+0000 7fab54c27740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fab2c00eb30 con 0x556ac625cf60 2024-08-20T01:49:23.539 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.536+0000 7fab4bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac625f9a0 0x556ac62618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:23.539 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.536+0000 7fab4bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac625f9a0 0x556ac62618e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:33536/0 (socket says 172.21.15.79:33536) 2024-08-20T01:49:23.540 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.536+0000 7fab4bfff640 1 -- 172.21.15.79:0/2206216083 learned_addr learned my addr 172.21.15.79:0/2206216083 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:23.540 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.536+0000 7fab4bfff640 1 -- 172.21.15.79:0/2206216083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ac625cf60 msgr2=0x556ac62613a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:49:23.540 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.536+0000 7fab4bfff640 1 --2- 172.21.15.79:0/2206216083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ac625cf60 0x556ac62613a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:23.541 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.536+0000 7fab4bfff640 1 -- 172.21.15.79:0/2206216083 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ac625a630 msgr2=0x556ac6263080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:23.541 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.536+0000 7fab4b7fe640 1 --2- 172.21.15.79:0/2206216083 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ac625a630 0x556ac6263080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:23.541 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.536+0000 7fab4bfff640 1 --2- 172.21.15.79:0/2206216083 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ac625a630 0x556ac6263080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:23.541 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.536+0000 7fab4bfff640 1 -- 172.21.15.79:0/2206216083 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ac62639e0 con 0x556ac625f9a0 2024-08-20T01:49:23.541 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.536+0000 7fab4b7fe640 1 --2- 172.21.15.79:0/2206216083 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ac625a630 0x556ac6263080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:49:23.541 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.537+0000 7fab4bfff640 1 --2- 172.21.15.79:0/2206216083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac625f9a0 0x556ac62618e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fab44004990 tx=0x7fab44015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e7c18935075033f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:23.541 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.537+0000 7fab417fa640 1 -- 172.21.15.79:0/2206216083 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab4401b430 con 0x556ac625f9a0 2024-08-20T01:49:23.541 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.537+0000 7fab417fa640 1 -- 172.21.15.79:0/2206216083 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fab4401ba60 con 0x556ac625f9a0 2024-08-20T01:49:23.541 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.537+0000 7fab417fa640 1 -- 172.21.15.79:0/2206216083 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab44010920 con 0x556ac625f9a0 2024-08-20T01:49:23.542 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.538+0000 7fab54c27740 1 -- 172.21.15.79:0/2206216083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac625f9a0 msgr2=0x556ac62618e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:23.542 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.538+0000 7fab54c27740 1 --2- 172.21.15.79:0/2206216083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac625f9a0 0x556ac62618e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fab44004990 tx=0x7fab44015000 comp rx=0 tx=0).stop 2024-08-20T01:49:23.542 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.538+0000 7fab54c27740 1 -- 172.21.15.79:0/2206216083 shutdown_connections 2024-08-20T01:49:23.542 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.538+0000 7fab54c27740 1 --2- 172.21.15.79:0/2206216083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac625f9a0 0x556ac62618e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:23.542 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.538+0000 7fab54c27740 1 --2- 172.21.15.79:0/2206216083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ac625cf60 0x556ac62613a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:23.542 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.538+0000 7fab54c27740 1 --2- 172.21.15.79:0/2206216083 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ac625a630 0x556ac6263080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.538+0000 7fab54c27740 1 -- 172.21.15.79:0/2206216083 >> 172.21.15.79:0/2206216083 conn(0x556ac6255730 msgr2=0x556ac6259c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.538+0000 7fab54c27740 1 -- 172.21.15.79:0/2206216083 shutdown_connections 2024-08-20T01:49:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.539+0000 7fab54c27740 1 -- 172.21.15.79:0/2206216083 wait complete. 2024-08-20T01:49:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.539+0000 7fab54c27740 1 -- start start 2024-08-20T01:49:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.539+0000 7fab54c27740 1 Processor -- start 2024-08-20T01:49:23.544 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.539+0000 7fab54c27740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ac625a630 0x556ac626b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:23.544 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.539+0000 7fab54c27740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ac625cf60 0x556ac626a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:23.544 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.539+0000 7fab54c27740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac625f9a0 0x556ac626a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:23.544 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.540+0000 7fab54c27740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fab2c00f8d0 con 0x556ac625a630 2024-08-20T01:49:23.544 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.540+0000 7fab54c27740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fab2c00f200 con 0x556ac625f9a0 2024-08-20T01:49:23.544 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.540+0000 7fab54c27740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fab2c00c410 con 0x556ac625cf60 2024-08-20T01:49:23.545 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.540+0000 7fab54c27740 10 client.0 _ll_register_callbacks cb 0x7fab340f5070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:49:23.545 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.540+0000 7fab4affd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ac625cf60 0x556ac626a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:23.545 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.540+0000 7fab4bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac625f9a0 0x556ac626a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:23.545 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.540+0000 7fab4bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac625f9a0 0x556ac626a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:33550/0 (socket says 172.21.15.79:33550) 2024-08-20T01:49:23.545 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.540+0000 7fab4bfff640 1 -- 172.21.15.79:0/4065185132 learned_addr learned my addr 172.21.15.79:0/4065185132 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:23.545 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.540+0000 7fab4bfff640 1 -- 172.21.15.79:0/4065185132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ac625cf60 msgr2=0x556ac626a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:23.545 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.540+0000 7fab4bfff640 1 --2- 172.21.15.79:0/4065185132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ac625cf60 0x556ac626a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:23.545 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.540+0000 7fab4bfff640 1 -- 172.21.15.79:0/4065185132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ac625a630 msgr2=0x556ac626b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:23.546 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.540+0000 7fab4b7fe640 1 --2- 172.21.15.79:0/4065185132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ac625a630 0x556ac626b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:23.546 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.540+0000 7fab4bfff640 1 --2- 172.21.15.79:0/4065185132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ac625a630 0x556ac626b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:23.546 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.540+0000 7fab4bfff640 1 -- 172.21.15.79:0/4065185132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ac6255560 con 0x556ac625f9a0 2024-08-20T01:49:23.546 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.540+0000 7fab4b7fe640 1 --2- 172.21.15.79:0/4065185132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ac625a630 0x556ac626b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:49:23.546 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.541+0000 7fab4bfff640 1 --2- 172.21.15.79:0/4065185132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac625f9a0 0x556ac626a960 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fab440104a0 tx=0x7fab4401b660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78216e09d4fab05c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:23.546 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.541+0000 7fab2affd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:49:23.546 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.541+0000 7fab2affd640 1 -- 172.21.15.79:0/4065185132 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab440045e0 con 0x556ac625f9a0 2024-08-20T01:49:23.546 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.541+0000 7fab2affd640 1 -- 172.21.15.79:0/4065185132 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fab440106a0 con 0x556ac625f9a0 2024-08-20T01:49:23.546 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.541+0000 7fab54c27740 1 -- 172.21.15.79:0/4065185132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab4401ba60 con 0x556ac625f9a0 2024-08-20T01:49:23.547 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.542+0000 7fab2affd640 1 -- 172.21.15.79:0/4065185132 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fab440108a0 con 0x556ac625f9a0 2024-08-20T01:49:23.547 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.542+0000 7fab54c27740 10 client.27644 fetch_fsmap learned FSMap version 50 2024-08-20T01:49:23.547 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.542+0000 7fab54c27740 1 -- 172.21.15.79:0/4065185132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x556ac6269b60 con 0x556ac625f9a0 2024-08-20T01:49:23.547 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.543+0000 7fab2affd640 1 -- 172.21.15.79:0/4065185132 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fab4401ba60 con 0x556ac625f9a0 2024-08-20T01:49:23.547 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.543+0000 7fab2affd640 1 -- 172.21.15.79:0/4065185132 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 50) ==== 8366+0+0 (secure 0 0 0) 0x7fab44019040 con 0x556ac625f9a0 2024-08-20T01:49:23.547 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.543+0000 7fab54c27740 10 client.27644 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T01:49:23.547 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.543+0000 7fab54c27740 10 client.27644 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:49:23.547 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.543+0000 7fab54c27740 20 client.27644 populate_metadata read hostname 'smithi079' 2024-08-20T01:49:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.543+0000 7fab54c27740 1 --2- 172.21.15.79:0/4065185132 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556ac62da3e0 0x556ac62dc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.543+0000 7fab54c27740 4 client.27644 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:49:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.543+0000 7fab54c27740 1 -- 172.21.15.79:0/4065185132 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556ac61cf2b0 con 0x556ac62da3e0 2024-08-20T01:49:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.543+0000 7fab4b7fe640 1 --2- 172.21.15.79:0/4065185132 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556ac62da3e0 0x556ac62dc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.544+0000 7fab4b7fe640 1 --2- 172.21.15.79:0/4065185132 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556ac62da3e0 0x556ac62dc800 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b868093a8adf934 server_cookie=6aa0dd1c23a6f3b6 in_seq=0 out_seq=0 2024-08-20T01:49:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.545+0000 7fab2affd640 10 client.27644 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:49:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.602+0000 7fab2affd640 1 -- 172.21.15.79:0/4065185132 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556ac61cf2b0 con 0x556ac62da3e0 2024-08-20T01:49:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.602+0000 7fab2affd640 10 client.27644 handle_command_reply: tid=0 2024-08-20T01:49:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.602+0000 7fab54c27740 1 client.27644 shutdown 2024-08-20T01:49:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.602+0000 7fab54c27740 1 -- 172.21.15.79:0/4065185132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac625f9a0 msgr2=0x556ac626a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.602+0000 7fab54c27740 1 --2- 172.21.15.79:0/4065185132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac625f9a0 0x556ac626a960 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fab440104a0 tx=0x7fab4401b660 comp rx=0 tx=0).stop 2024-08-20T01:49:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.602+0000 7fab54c27740 1 -- 172.21.15.79:0/4065185132 shutdown_connections 2024-08-20T01:49:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.602+0000 7fab54c27740 1 --2- 172.21.15.79:0/4065185132 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x556ac62da3e0 0x556ac62dc800 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.602+0000 7fab54c27740 1 --2- 172.21.15.79:0/4065185132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ac625f9a0 0x556ac626a960 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.602+0000 7fab54c27740 1 --2- 172.21.15.79:0/4065185132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ac625cf60 0x556ac626a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.602+0000 7fab54c27740 1 --2- 172.21.15.79:0/4065185132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556ac625a630 0x556ac626b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.602+0000 7fab54c27740 1 -- 172.21.15.79:0/4065185132 >> 172.21.15.79:0/4065185132 conn(0x556ac6255730 msgr2=0x556ac62613a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.602+0000 7fab2affd640 0 client.27644 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:49:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.603+0000 7fab54c27740 1 -- 172.21.15.79:0/4065185132 shutdown_connections 2024-08-20T01:49:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.603+0000 7fab54c27740 1 -- 172.21.15.79:0/4065185132 wait complete. 2024-08-20T01:49:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.603+0000 7fab54c27740 20 client.27644 trim_cache size 0 max 16384 2024-08-20T01:49:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:49:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:49:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:49:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:49:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.605+0000 7fab51e38640 1 -- 172.21.15.79:0/372452554 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fab380b3c50 msgr2=0x7fab380b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.605+0000 7fab51e38640 1 --2- 172.21.15.79:0/372452554 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fab380b3c50 0x7fab380b6110 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fab44005fd0 tx=0x7fab44009500 comp rx=0 tx=0).stop 2024-08-20T01:49:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.605+0000 7fab51e38640 1 -- 172.21.15.79:0/372452554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab4c10af90 msgr2=0x7fab4c11a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.605+0000 7fab51e38640 1 --2- 172.21.15.79:0/372452554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab4c10af90 0x7fab4c11a700 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fab3400e9f0 tx=0x7fab3400eeb0 comp rx=0 tx=0).stop 2024-08-20T01:49:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.606+0000 7fab51e38640 1 -- 172.21.15.79:0/372452554 shutdown_connections 2024-08-20T01:49:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.606+0000 7fab51e38640 1 --2- 172.21.15.79:0/372452554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab4c10b950 0x7fab4c118ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.606+0000 7fab51e38640 1 --2- 172.21.15.79:0/372452554 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fab380b3c50 0x7fab380b6110 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.606+0000 7fab51e38640 1 --2- 172.21.15.79:0/372452554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab4c10af90 0x7fab4c11a700 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:23.610 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.606+0000 7fab51e38640 1 --2- 172.21.15.79:0/372452554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab4c073fc0 0x7fab4c11a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:23.610 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.606+0000 7fab51e38640 1 -- 172.21.15.79:0/372452554 >> 172.21.15.79:0/372452554 conn(0x7fab4c06fb80 msgr2=0x7fab4c10e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:23.610 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.607+0000 7fab51e38640 1 -- 172.21.15.79:0/372452554 shutdown_connections 2024-08-20T01:49:23.610 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:23.607+0000 7fab51e38640 1 -- 172.21.15.79:0/372452554 wait complete. 2024-08-20T01:49:24.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:24 smithi175 ceph-mon[22392]: pgmap v709: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 6.29k op/s 2024-08-20T01:49:24.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:24 smithi079 ceph-mon[18656]: pgmap v709: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 6.29k op/s 2024-08-20T01:49:24.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:24 smithi081 ceph-mon[22209]: pgmap v709: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 6.29k op/s 2024-08-20T01:49:26.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:26 smithi175 ceph-mon[22392]: pgmap v710: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 MiB/s wr, 6.31k op/s 2024-08-20T01:49:26.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:26 smithi079 ceph-mon[18656]: pgmap v710: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 MiB/s wr, 6.31k op/s 2024-08-20T01:49:26.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:26 smithi081 ceph-mon[22209]: pgmap v710: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 MiB/s wr, 6.31k op/s 2024-08-20T01:49:28.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:28 smithi175 ceph-mon[22392]: pgmap v711: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 6.54k op/s 2024-08-20T01:49:28.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:28 smithi079 ceph-mon[18656]: pgmap v711: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 6.54k op/s 2024-08-20T01:49:28.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:28 smithi081 ceph-mon[22209]: pgmap v711: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 6.54k op/s 2024-08-20T01:49:30.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:30 smithi175 ceph-mon[22392]: pgmap v712: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 6.63k op/s 2024-08-20T01:49:30.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:30 smithi079 ceph-mon[18656]: pgmap v712: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 6.63k op/s 2024-08-20T01:49:30.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:30 smithi081 ceph-mon[22209]: pgmap v712: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 6.63k op/s 2024-08-20T01:49:31.899 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:49:32.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:32 smithi079 ceph-mon[18656]: pgmap v713: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 6.44k op/s 2024-08-20T01:49:32.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:32 smithi081 ceph-mon[22209]: pgmap v713: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 6.44k op/s 2024-08-20T01:49:32.538 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:49:32.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:32 smithi175 ceph-mon[22392]: pgmap v713: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 6.44k op/s 2024-08-20T01:49:34.440 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:34 smithi079 ceph-mon[18656]: pgmap v714: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 6.32k op/s 2024-08-20T01:49:34.530 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:34 smithi081 ceph-mon[22209]: pgmap v714: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 6.32k op/s 2024-08-20T01:49:34.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:34 smithi175 ceph-mon[22392]: pgmap v714: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 6.32k op/s 2024-08-20T01:49:36.438 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:36 smithi079 ceph-mon[18656]: pgmap v715: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 MiB/s wr, 6.29k op/s 2024-08-20T01:49:36.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:36 smithi081 ceph-mon[22209]: pgmap v715: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 MiB/s wr, 6.29k op/s 2024-08-20T01:49:36.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:36 smithi175 ceph-mon[22392]: pgmap v715: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 MiB/s wr, 6.29k op/s 2024-08-20T01:49:36.784 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.781+0000 7f6e707d9640 1 -- 172.21.15.79:0/4230739702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e68102ea0 msgr2=0x7f6e68109820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:36.784 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.781+0000 7f6e707d9640 1 --2- 172.21.15.79:0/4230739702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e68102ea0 0x7f6e68109820 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6e58009860 tx=0x7f6e5802a360 comp rx=0 tx=0).stop 2024-08-20T01:49:36.784 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.781+0000 7f6e707d9640 1 -- 172.21.15.79:0/4230739702 shutdown_connections 2024-08-20T01:49:36.784 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.781+0000 7f6e707d9640 1 --2- 172.21.15.79:0/4230739702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e68102ea0 0x7f6e68109820 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:36.785 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.781+0000 7f6e707d9640 1 --2- 172.21.15.79:0/4230739702 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e681024e0 0x7f6e68102960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:36.785 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.782+0000 7f6e707d9640 1 --2- 172.21.15.79:0/4230739702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e68101390 0x7f6e68101790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:36.785 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.782+0000 7f6e707d9640 1 -- 172.21.15.79:0/4230739702 >> 172.21.15.79:0/4230739702 conn(0x7f6e680fcc50 msgr2=0x7f6e680ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:36.785 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.782+0000 7f6e707d9640 1 -- 172.21.15.79:0/4230739702 shutdown_connections 2024-08-20T01:49:36.785 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.782+0000 7f6e707d9640 1 -- 172.21.15.79:0/4230739702 wait complete. 2024-08-20T01:49:36.785 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.782+0000 7f6e707d9640 1 Processor -- start 2024-08-20T01:49:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.783+0000 7f6e707d9640 1 -- start start 2024-08-20T01:49:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.783+0000 7f6e707d9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e68101390 0x7f6e68071220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.783+0000 7f6e707d9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e681024e0 0x7f6e68071870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.783+0000 7f6e707d9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e68102ea0 0x7f6e680724a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.783+0000 7f6e707d9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6810b0b0 con 0x7f6e681024e0 2024-08-20T01:49:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.783+0000 7f6e707d9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6810af30 con 0x7f6e68101390 2024-08-20T01:49:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.783+0000 7f6e707d9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6810b230 con 0x7f6e68102ea0 2024-08-20T01:49:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.783+0000 7f6e6ed76640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e68102ea0 0x7f6e680724a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:36.787 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.783+0000 7f6e6dd74640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e681024e0 0x7f6e68071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:36.787 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.783+0000 7f6e6ed76640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e68102ea0 0x7f6e680724a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:55400/0 (socket says 172.21.15.79:55400) 2024-08-20T01:49:36.787 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.783+0000 7f6e6ed76640 1 -- 172.21.15.79:0/2109658225 learned_addr learned my addr 172.21.15.79:0/2109658225 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:36.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.784+0000 7f6e6ed76640 1 -- 172.21.15.79:0/2109658225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e68101390 msgr2=0x7f6e68071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:36.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.784+0000 7f6e6ed76640 1 --2- 172.21.15.79:0/2109658225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e68101390 0x7f6e68071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:36.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.784+0000 7f6e6ed76640 1 -- 172.21.15.79:0/2109658225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e681024e0 msgr2=0x7f6e68071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:36.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.784+0000 7f6e6ed76640 1 --2- 172.21.15.79:0/2109658225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e681024e0 0x7f6e68071870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:36.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.784+0000 7f6e6ed76640 1 -- 172.21.15.79:0/2109658225 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e680729e0 con 0x7f6e68102ea0 2024-08-20T01:49:36.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.785+0000 7f6e6ed76640 1 --2- 172.21.15.79:0/2109658225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e68102ea0 0x7f6e680724a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6e5802a880 tx=0x7f6e580042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:36.788 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.785+0000 7f6e5f7fe640 1 -- 172.21.15.79:0/2109658225 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e5803f070 con 0x7f6e68102ea0 2024-08-20T01:49:36.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.785+0000 7f6e707d9640 1 -- 172.21.15.79:0/2109658225 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e68072c70 con 0x7f6e68102ea0 2024-08-20T01:49:36.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.786+0000 7f6e707d9640 1 -- 172.21.15.79:0/2109658225 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e680731b0 con 0x7f6e68102ea0 2024-08-20T01:49:36.790 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.788+0000 7f6e5f7fe640 1 -- 172.21.15.79:0/2109658225 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6e58033e00 con 0x7f6e68102ea0 2024-08-20T01:49:36.791 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.788+0000 7f6e5f7fe640 1 -- 172.21.15.79:0/2109658225 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e5803f070 con 0x7f6e68102ea0 2024-08-20T01:49:36.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.790+0000 7f6e735c9740 1 Processor -- start 2024-08-20T01:49:36.795 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.793+0000 7f6e735c9740 1 -- start start 2024-08-20T01:49:36.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.793+0000 7f6e5f7fe640 1 -- 172.21.15.79:0/2109658225 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f6e58042070 con 0x7f6e68102ea0 2024-08-20T01:49:36.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.793+0000 7f6e735c9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555aded96a20 0x555aded98e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:36.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.793+0000 7f6e735c9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aded99350 0x555aded9b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:36.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.793+0000 7f6e735c9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555aded9bd90 0x555aded9e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:36.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.793+0000 7f6e735c9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555aded09360 con 0x555aded99350 2024-08-20T01:49:36.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.793+0000 7f6e735c9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555adecf8860 con 0x555aded9bd90 2024-08-20T01:49:36.796 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.793+0000 7f6e735c9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555adecfc8a0 con 0x555aded96a20 2024-08-20T01:49:36.797 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.795+0000 7f6e5f7fe640 1 --2- 172.21.15.79:0/2109658225 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6e540b3ed0 0x7f6e540b6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:36.798 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.795+0000 7f6e5f7fe640 1 -- 172.21.15.79:0/2109658225 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f6e58103be0 con 0x7f6e68102ea0 2024-08-20T01:49:36.799 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.796+0000 7f6e6dd74640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555aded96a20 0x555aded98e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:36.799 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.796+0000 7f6e6dd74640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555aded96a20 0x555aded98e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:55402/0 (socket says 172.21.15.79:55402) 2024-08-20T01:49:36.799 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.796+0000 7f6e6dd74640 1 -- 172.21.15.79:0/2653097145 learned_addr learned my addr 172.21.15.79:0/2653097145 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:36.799 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.796+0000 7f6e6dd74640 1 --2- 172.21.15.79:0/2653097145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555aded9bd90 0x555aded9e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:36.799 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.796+0000 7f6e6dd74640 1 -- 172.21.15.79:0/2653097145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555aded9bd90 msgr2=0x555aded9e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:36.799 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.796+0000 7f6e6dd74640 1 --2- 172.21.15.79:0/2653097145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555aded9bd90 0x555aded9e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:36.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.796+0000 7f6e6dd74640 1 -- 172.21.15.79:0/2653097145 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aded99350 msgr2=0x555aded9b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:36.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.796+0000 7f6e6dd74640 1 --2- 172.21.15.79:0/2653097145 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aded99350 0x555aded9b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:36.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.796+0000 7f6e6dd74640 1 -- 172.21.15.79:0/2653097145 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555adec9fe40 con 0x555aded96a20 2024-08-20T01:49:36.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.796+0000 7f6e6ed76640 1 --2- 172.21.15.79:0/2109658225 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6e540b3ed0 0x7f6e540b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:36.800 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.797+0000 7f6e6dd74640 1 --2- 172.21.15.79:0/2653097145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555aded96a20 0x555aded98e10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6e64013840 tx=0x7f6e64005850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79ecd1da6dd93df8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:36.806 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.797+0000 7f6e5cff9640 1 -- 172.21.15.79:0/2653097145 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e64013120 con 0x555aded96a20 2024-08-20T01:49:36.806 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.797+0000 7f6e5cff9640 1 -- 172.21.15.79:0/2653097145 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6e6400f7c0 con 0x555aded96a20 2024-08-20T01:49:36.806 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.798+0000 7f6e5cff9640 1 -- 172.21.15.79:0/2653097145 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e640132c0 con 0x555aded96a20 2024-08-20T01:49:36.806 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.798+0000 7f6e735c9740 1 -- 172.21.15.79:0/2653097145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555aded96a20 msgr2=0x555aded98e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:36.807 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.798+0000 7f6e735c9740 1 --2- 172.21.15.79:0/2653097145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555aded96a20 0x555aded98e10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6e64013840 tx=0x7f6e64005850 comp rx=0 tx=0).stop 2024-08-20T01:49:36.807 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.804+0000 7f6e735c9740 1 -- 172.21.15.79:0/2653097145 shutdown_connections 2024-08-20T01:49:36.807 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.804+0000 7f6e735c9740 1 --2- 172.21.15.79:0/2653097145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555aded9bd90 0x555aded9e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:36.807 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.804+0000 7f6e735c9740 1 --2- 172.21.15.79:0/2653097145 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aded99350 0x555aded9b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:36.807 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.804+0000 7f6e735c9740 1 --2- 172.21.15.79:0/2653097145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555aded96a20 0x555aded98e10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:36.807 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.804+0000 7f6e735c9740 1 -- 172.21.15.79:0/2653097145 >> 172.21.15.79:0/2653097145 conn(0x555aded91b70 msgr2=0x555aded92900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:36.809 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.807+0000 7f6e735c9740 1 -- 172.21.15.79:0/2653097145 shutdown_connections 2024-08-20T01:49:36.810 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.807+0000 7f6e735c9740 1 -- 172.21.15.79:0/2653097145 wait complete. 2024-08-20T01:49:36.810 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.807+0000 7f6e735c9740 1 -- start start 2024-08-20T01:49:36.810 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.807+0000 7f6e735c9740 1 Processor -- start 2024-08-20T01:49:36.810 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.808+0000 7f6e735c9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555aded96a20 0x555adeda02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:36.811 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.808+0000 7f6e735c9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aded99350 0x555adeda0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:36.811 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.808+0000 7f6e735c9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555aded9bd90 0x555adeda1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:36.811 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.808+0000 7f6e735c9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555adec31ab0 con 0x555aded99350 2024-08-20T01:49:36.811 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.808+0000 7f6e735c9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555adec7f780 con 0x555aded96a20 2024-08-20T01:49:36.811 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.808+0000 7f6e735c9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555aded9ed60 con 0x555aded9bd90 2024-08-20T01:49:36.811 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.808+0000 7f6e735c9740 10 client.0 _ll_register_callbacks cb 0x555adea07a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:49:36.812 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.808+0000 7f6e6dd74640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555aded96a20 0x555adeda02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:36.812 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.808+0000 7f6e6dd74640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555aded96a20 0x555adeda02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:34554/0 (socket says 172.21.15.79:34554) 2024-08-20T01:49:36.812 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.808+0000 7f6e6dd74640 1 -- 172.21.15.79:0/1660456989 learned_addr learned my addr 172.21.15.79:0/1660456989 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:36.812 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.809+0000 7f6e6dd74640 1 --2- 172.21.15.79:0/1660456989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555aded9bd90 0x555adeda1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:36.812 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.809+0000 7f6e6dd74640 1 -- 172.21.15.79:0/1660456989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555aded9bd90 msgr2=0x555adeda1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:36.812 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.809+0000 7f6e6dd74640 1 --2- 172.21.15.79:0/1660456989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555aded9bd90 0x555adeda1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:36.812 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.809+0000 7f6e6dd74640 1 -- 172.21.15.79:0/1660456989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aded99350 msgr2=0x555adeda0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:36.812 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.809+0000 7f6e6dd74640 1 --2- 172.21.15.79:0/1660456989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aded99350 0x555adeda0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:36.812 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.809+0000 7f6e6dd74640 1 -- 172.21.15.79:0/1660456989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555adea5b790 con 0x555aded96a20 2024-08-20T01:49:36.812 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.809+0000 7f6e6dd74640 1 --2- 172.21.15.79:0/1660456989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555aded96a20 0x555adeda02f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6e640097c0 tx=0x7f6e64018040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8de145d94a08658 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:36.813 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.809+0000 7f6e51ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:49:36.813 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.810+0000 7f6e51ffb640 1 -- 172.21.15.79:0/1660456989 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e640044c0 con 0x555aded96a20 2024-08-20T01:49:36.813 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.810+0000 7f6e735c9740 1 -- 172.21.15.79:0/1660456989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555adeca7e00 con 0x555aded96a20 2024-08-20T01:49:36.813 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.810+0000 7f6e51ffb640 1 -- 172.21.15.79:0/1660456989 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f6e64022890 con 0x555aded96a20 2024-08-20T01:49:36.813 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.810+0000 7f6e51ffb640 1 -- 172.21.15.79:0/1660456989 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f6e6400fd50 con 0x555aded96a20 2024-08-20T01:49:36.815 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.813+0000 7f6e735c9740 10 client.27653 fetch_fsmap learned FSMap version 50 2024-08-20T01:49:36.816 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.813+0000 7f6e735c9740 1 -- 172.21.15.79:0/1660456989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x555adead4620 con 0x555aded96a20 2024-08-20T01:49:36.816 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.813+0000 7f6e6ed76640 1 --2- 172.21.15.79:0/2109658225 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6e540b3ed0 0x7f6e540b6390 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f6e580ca7e0 tx=0x7f6e5802a360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:36.816 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.813+0000 7f6e51ffb640 1 -- 172.21.15.79:0/1660456989 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x555adeca7e00 con 0x555aded96a20 2024-08-20T01:49:36.817 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.814+0000 7f6e51ffb640 1 -- 172.21.15.79:0/1660456989 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 50) ==== 8366+0+0 (secure 0 0 0) 0x7f6e64010920 con 0x555aded96a20 2024-08-20T01:49:36.818 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.815+0000 7f6e735c9740 10 client.27653 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T01:49:36.818 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.815+0000 7f6e735c9740 10 client.27653 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:49:36.818 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.815+0000 7f6e735c9740 20 client.27653 populate_metadata read hostname 'smithi079' 2024-08-20T01:49:36.818 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.815+0000 7f6e735c9740 1 --2- 172.21.15.79:0/1660456989 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x555adedabda0 0x555adedae1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:36.818 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.815+0000 7f6e735c9740 4 client.27653 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:49:36.818 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.815+0000 7f6e735c9740 1 -- 172.21.15.79:0/1660456989 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555aded0b2b0 con 0x555adedabda0 2024-08-20T01:49:36.818 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.815+0000 7f6e6e575640 1 --2- 172.21.15.79:0/1660456989 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x555adedabda0 0x555adedae1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:36.819 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.816+0000 7f6e6e575640 1 --2- 172.21.15.79:0/1660456989 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x555adedabda0 0x555adedae1e0 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=355f6c3ac1f8341a server_cookie=884b14a6d14782f9 in_seq=0 out_seq=0 2024-08-20T01:49:36.819 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.816+0000 7f6e51ffb640 10 client.27653 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:49:36.821 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.817+0000 7f6e51ffb640 1 -- 172.21.15.79:0/1660456989 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555aded0b2b0 con 0x555adedabda0 2024-08-20T01:49:36.821 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.817+0000 7f6e51ffb640 10 client.27653 handle_command_reply: tid=0 2024-08-20T01:49:36.821 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.818+0000 7f6e735c9740 1 client.27653 shutdown 2024-08-20T01:49:36.821 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.818+0000 7f6e735c9740 1 -- 172.21.15.79:0/1660456989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555aded96a20 msgr2=0x555adeda02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:36.821 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.818+0000 7f6e735c9740 1 --2- 172.21.15.79:0/1660456989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555aded96a20 0x555adeda02f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6e640097c0 tx=0x7f6e64018040 comp rx=0 tx=0).stop 2024-08-20T01:49:36.821 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.818+0000 7f6e735c9740 1 -- 172.21.15.79:0/1660456989 shutdown_connections 2024-08-20T01:49:36.821 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.818+0000 7f6e735c9740 1 --2- 172.21.15.79:0/1660456989 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x555adedabda0 0x555adedae1e0 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:36.822 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.818+0000 7f6e735c9740 1 --2- 172.21.15.79:0/1660456989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555aded9bd90 0x555adeda1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:36.822 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.818+0000 7f6e735c9740 1 --2- 172.21.15.79:0/1660456989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aded99350 0x555adeda0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:36.822 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.818+0000 7f6e735c9740 1 --2- 172.21.15.79:0/1660456989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555aded96a20 0x555adeda02f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:36.822 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.818+0000 7f6e735c9740 1 -- 172.21.15.79:0/1660456989 >> 172.21.15.79:0/1660456989 conn(0x555aded91b70 msgr2=0x555aded90c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:36.822 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.818+0000 7f6e51ffb640 0 client.27653 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:49:36.822 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.818+0000 7f6e735c9740 1 -- 172.21.15.79:0/1660456989 shutdown_connections 2024-08-20T01:49:36.822 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.818+0000 7f6e735c9740 1 -- 172.21.15.79:0/1660456989 wait complete. 2024-08-20T01:49:36.822 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.819+0000 7f6e735c9740 20 client.27653 trim_cache size 0 max 16384 2024-08-20T01:49:36.878 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.875+0000 7f6e735c9740 1 Processor -- start 2024-08-20T01:49:36.878 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.876+0000 7f6e735c9740 1 -- start start 2024-08-20T01:49:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.877+0000 7f6e735c9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555aded96a20 0x555aded923d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.877+0000 7f6e735c9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aded99350 0x555aded92910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.877+0000 7f6e735c9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555aded9bd90 0x555aded90410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.877+0000 7f6e735c9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6e4c00e370 con 0x555aded99350 2024-08-20T01:49:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.877+0000 7f6e735c9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6e4c00fee0 con 0x555aded96a20 2024-08-20T01:49:36.881 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.877+0000 7f6e735c9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6e4c00ea70 con 0x555aded9bd90 2024-08-20T01:49:36.881 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.877+0000 7f6e6dd74640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555aded96a20 0x555aded923d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:36.881 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.877+0000 7f6e6dd74640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555aded96a20 0x555aded923d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:34562/0 (socket says 172.21.15.79:34562) 2024-08-20T01:49:36.881 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.877+0000 7f6e6dd74640 1 -- 172.21.15.79:0/3405619657 learned_addr learned my addr 172.21.15.79:0/3405619657 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:36.881 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.877+0000 7f6e6dd74640 1 --2- 172.21.15.79:0/3405619657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555aded9bd90 0x555aded90410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:36.881 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.878+0000 7f6e6dd74640 1 -- 172.21.15.79:0/3405619657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555aded9bd90 msgr2=0x555aded90410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:36.881 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.878+0000 7f6e6dd74640 1 --2- 172.21.15.79:0/3405619657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555aded9bd90 0x555aded90410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:36.882 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.878+0000 7f6e6dd74640 1 -- 172.21.15.79:0/3405619657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aded99350 msgr2=0x555aded92910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:36.882 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.878+0000 7f6e6dd74640 1 --2- 172.21.15.79:0/3405619657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aded99350 0x555aded92910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:36.882 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.878+0000 7f6e6dd74640 1 -- 172.21.15.79:0/3405619657 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555aded99180 con 0x555aded96a20 2024-08-20T01:49:36.882 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.878+0000 7f6e6dd74640 1 --2- 172.21.15.79:0/3405619657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555aded96a20 0x555aded923d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6e64009b90 tx=0x7f6e64024040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90bca43bde948d5a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:36.884 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.882+0000 7f6e53fff640 1 -- 172.21.15.79:0/3405619657 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e6402f470 con 0x555aded96a20 2024-08-20T01:49:36.884 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.882+0000 7f6e53fff640 1 -- 172.21.15.79:0/3405619657 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6e64026070 con 0x555aded96a20 2024-08-20T01:49:36.885 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.882+0000 7f6e53fff640 1 -- 172.21.15.79:0/3405619657 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e64022af0 con 0x555aded96a20 2024-08-20T01:49:36.887 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.884+0000 7f6e735c9740 1 -- 172.21.15.79:0/3405619657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555aded96a20 msgr2=0x555aded923d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:36.887 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.884+0000 7f6e735c9740 1 --2- 172.21.15.79:0/3405619657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555aded96a20 0x555aded923d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6e64009b90 tx=0x7f6e64024040 comp rx=0 tx=0).stop 2024-08-20T01:49:36.887 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.884+0000 7f6e735c9740 1 -- 172.21.15.79:0/3405619657 shutdown_connections 2024-08-20T01:49:36.887 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.884+0000 7f6e735c9740 1 --2- 172.21.15.79:0/3405619657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555aded9bd90 0x555aded90410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:36.887 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.884+0000 7f6e735c9740 1 --2- 172.21.15.79:0/3405619657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aded99350 0x555aded92910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:36.887 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.884+0000 7f6e735c9740 1 --2- 172.21.15.79:0/3405619657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555aded96a20 0x555aded923d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:36.888 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.885+0000 7f6e735c9740 1 -- 172.21.15.79:0/3405619657 >> 172.21.15.79:0/3405619657 conn(0x555aded91b70 msgr2=0x555aded95fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:36.889 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.886+0000 7f6e735c9740 1 -- 172.21.15.79:0/3405619657 shutdown_connections 2024-08-20T01:49:36.889 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.886+0000 7f6e735c9740 1 -- 172.21.15.79:0/3405619657 wait complete. 2024-08-20T01:49:36.889 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.887+0000 7f6e735c9740 1 -- start start 2024-08-20T01:49:36.890 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.888+0000 7f6e735c9740 1 Processor -- start 2024-08-20T01:49:36.890 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.888+0000 7f6e735c9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555aded96a20 0x555adeda47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:36.891 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.888+0000 7f6e735c9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555aded99350 0x555adeda4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:36.892 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.889+0000 7f6e6dd74640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555aded96a20 0x555adeda47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:36.892 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.889+0000 7f6e6dd74640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555aded96a20 0x555adeda47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:55444/0 (socket says 172.21.15.79:55444) 2024-08-20T01:49:36.892 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.889+0000 7f6e735c9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aded9bd90 0x555adeda5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:36.892 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.889+0000 7f6e735c9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6e4c00f810 con 0x555aded9bd90 2024-08-20T01:49:36.892 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.889+0000 7f6e735c9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6e4c00f140 con 0x555aded99350 2024-08-20T01:49:36.892 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.889+0000 7f6e735c9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6e4c00c400 con 0x555aded96a20 2024-08-20T01:49:36.892 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.889+0000 7f6e735c9740 10 client.0 _ll_register_callbacks cb 0x7f6e64009ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:49:36.893 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.889+0000 7f6e6dd74640 1 -- 172.21.15.79:0/383974938 learned_addr learned my addr 172.21.15.79:0/383974938 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:36.893 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.889+0000 7f6e6e575640 1 --2- 172.21.15.79:0/383974938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555aded99350 0x555adeda4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:36.893 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.890+0000 7f6e6dd74640 1 -- 172.21.15.79:0/383974938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555aded99350 msgr2=0x555adeda4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:36.893 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.890+0000 7f6e6dd74640 1 --2- 172.21.15.79:0/383974938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555aded99350 0x555adeda4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:36.893 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.890+0000 7f6e6dd74640 1 -- 172.21.15.79:0/383974938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aded9bd90 msgr2=0x555adeda5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:36.893 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.890+0000 7f6e6dd74640 1 --2- 172.21.15.79:0/383974938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aded9bd90 0x555adeda5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:36.894 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.890+0000 7f6e6dd74640 1 -- 172.21.15.79:0/383974938 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555adeda6250 con 0x555aded96a20 2024-08-20T01:49:36.894 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.890+0000 7f6e6dd74640 1 --2- 172.21.15.79:0/383974938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555aded96a20 0x555adeda47b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6e640097c0 tx=0x7f6e64009f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfc53c575ce709b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:36.894 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.891+0000 7f6e51ffb640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:49:36.894 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.891+0000 7f6e51ffb640 1 -- 172.21.15.79:0/383974938 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e6403f070 con 0x555aded96a20 2024-08-20T01:49:36.894 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.891+0000 7f6e51ffb640 1 -- 172.21.15.79:0/383974938 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f6e64022cd0 con 0x555aded96a20 2024-08-20T01:49:36.894 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.891+0000 7f6e735c9740 1 -- 172.21.15.79:0/383974938 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e64026070 con 0x555aded96a20 2024-08-20T01:49:36.895 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.892+0000 7f6e51ffb640 1 -- 172.21.15.79:0/383974938 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f6e64013320 con 0x555aded96a20 2024-08-20T01:49:36.895 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.892+0000 7f6e735c9740 10 client.27610 fetch_fsmap learned FSMap version 50 2024-08-20T01:49:36.895 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.892+0000 7f6e735c9740 1 -- 172.21.15.79:0/383974938 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x555adeda75c0 con 0x555aded96a20 2024-08-20T01:49:36.895 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.892+0000 7f6e51ffb640 1 -- 172.21.15.79:0/383974938 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6e640108c0 con 0x555aded96a20 2024-08-20T01:49:36.895 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.893+0000 7f6e51ffb640 1 -- 172.21.15.79:0/383974938 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 50) ==== 8366+0+0 (secure 0 0 0) 0x7f6e64042020 con 0x555aded96a20 2024-08-20T01:49:36.895 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.893+0000 7f6e735c9740 10 client.27610 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T01:49:36.896 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.893+0000 7f6e735c9740 10 client.27610 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:49:36.896 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.893+0000 7f6e735c9740 20 client.27610 populate_metadata read hostname 'smithi079' 2024-08-20T01:49:36.896 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.894+0000 7f6e735c9740 1 --2- 172.21.15.79:0/383974938 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x555adeda7e90 0x555adee18a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:36.896 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.894+0000 7f6e735c9740 4 client.27610 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:49:36.896 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.894+0000 7f6e735c9740 1 -- 172.21.15.79:0/383974938 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f6e64026070 con 0x555adeda7e90 2024-08-20T01:49:36.897 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.894+0000 7f6e6e575640 1 --2- 172.21.15.79:0/383974938 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x555adeda7e90 0x555adee18a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:36.898 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.896+0000 7f6e6e575640 1 --2- 172.21.15.79:0/383974938 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x555adeda7e90 0x555adee18a90 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1d33683dbf5bfb1 server_cookie=26089efce7d9d4cc in_seq=0 out_seq=0 2024-08-20T01:49:36.900 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.898+0000 7f6e51ffb640 10 client.27610 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:49:36.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.920+0000 7f6e51ffb640 1 -- 172.21.15.79:0/383974938 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f6e64026070 con 0x555adeda7e90 2024-08-20T01:49:36.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.920+0000 7f6e51ffb640 10 client.27610 handle_command_reply: tid=0 2024-08-20T01:49:36.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.920+0000 7f6e735c9740 1 client.27610 shutdown 2024-08-20T01:49:36.929 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.925+0000 7f6e735c9740 1 -- 172.21.15.79:0/383974938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555aded96a20 msgr2=0x555adeda47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:36.929 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.925+0000 7f6e735c9740 1 --2- 172.21.15.79:0/383974938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555aded96a20 0x555adeda47b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6e640097c0 tx=0x7f6e64009f80 comp rx=0 tx=0).stop 2024-08-20T01:49:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.929+0000 7f6e735c9740 1 -- 172.21.15.79:0/383974938 shutdown_connections 2024-08-20T01:49:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.929+0000 7f6e735c9740 1 --2- 172.21.15.79:0/383974938 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x555adeda7e90 0x555adee18a90 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.929+0000 7f6e735c9740 1 --2- 172.21.15.79:0/383974938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aded9bd90 0x555adeda5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.929+0000 7f6e51ffb640 0 client.27610 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:49:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.929+0000 7f6e735c9740 1 --2- 172.21.15.79:0/383974938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555aded99350 0x555adeda4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.929+0000 7f6e735c9740 1 --2- 172.21.15.79:0/383974938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555aded96a20 0x555adeda47b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.930+0000 7f6e735c9740 1 -- 172.21.15.79:0/383974938 >> 172.21.15.79:0/383974938 conn(0x555aded91b70 msgr2=0x555aded95bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.930+0000 7f6e735c9740 1 -- 172.21.15.79:0/383974938 shutdown_connections 2024-08-20T01:49:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.931+0000 7f6e735c9740 1 -- 172.21.15.79:0/383974938 wait complete. 2024-08-20T01:49:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.932+0000 7f6e735c9740 20 client.27610 trim_cache size 0 max 16384 2024-08-20T01:49:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:49:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:49:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:49:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:49:36.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.935+0000 7f6e707d9640 1 -- 172.21.15.79:0/2109658225 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6e540b3ed0 msgr2=0x7f6e540b6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:36.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.935+0000 7f6e707d9640 1 --2- 172.21.15.79:0/2109658225 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6e540b3ed0 0x7f6e540b6390 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f6e580ca7e0 tx=0x7f6e5802a360 comp rx=0 tx=0).stop 2024-08-20T01:49:36.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.935+0000 7f6e707d9640 1 -- 172.21.15.79:0/2109658225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e68102ea0 msgr2=0x7f6e680724a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:36.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.935+0000 7f6e707d9640 1 --2- 172.21.15.79:0/2109658225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e68102ea0 0x7f6e680724a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6e5802a880 tx=0x7f6e580042f0 comp rx=0 tx=0).stop 2024-08-20T01:49:36.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.936+0000 7f6e707d9640 1 -- 172.21.15.79:0/2109658225 shutdown_connections 2024-08-20T01:49:36.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.936+0000 7f6e707d9640 1 --2- 172.21.15.79:0/2109658225 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6e540b3ed0 0x7f6e540b6390 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:36.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.936+0000 7f6e707d9640 1 --2- 172.21.15.79:0/2109658225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e68102ea0 0x7f6e680724a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:36.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.936+0000 7f6e707d9640 1 --2- 172.21.15.79:0/2109658225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e681024e0 0x7f6e68071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:36.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.936+0000 7f6e707d9640 1 --2- 172.21.15.79:0/2109658225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e68101390 0x7f6e68071220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:36.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.936+0000 7f6e707d9640 1 -- 172.21.15.79:0/2109658225 >> 172.21.15.79:0/2109658225 conn(0x7f6e680fcc50 msgr2=0x7f6e680fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:36.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.936+0000 7f6e707d9640 1 -- 172.21.15.79:0/2109658225 shutdown_connections 2024-08-20T01:49:36.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:36.936+0000 7f6e707d9640 1 -- 172.21.15.79:0/2109658225 wait complete. 2024-08-20T01:49:37.424 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:49:37.424 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-08-20T01:49:37.425 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-08-20T01:49:37.425 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:49:37.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.911+0000 7eff56400640 1 -- 172.21.15.79:0/2091190284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff5010a260 msgr2=0x7eff5010a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:37.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.911+0000 7eff56400640 1 --2- 172.21.15.79:0/2091190284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff5010a260 0x7eff5010a6a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7eff4001a910 tx=0x7eff4003b4c0 comp rx=0 tx=0).stop 2024-08-20T01:49:37.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.912+0000 7eff56400640 1 -- 172.21.15.79:0/2091190284 shutdown_connections 2024-08-20T01:49:37.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.912+0000 7eff56400640 1 --2- 172.21.15.79:0/2091190284 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff5011bdd0 0x7eff5011e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:37.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.912+0000 7eff56400640 1 --2- 172.21.15.79:0/2091190284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff5010a260 0x7eff5010a6a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:37.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.912+0000 7eff56400640 1 --2- 172.21.15.79:0/2091190284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff50109e80 0x7eff50110ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:37.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.912+0000 7eff56400640 1 -- 172.21.15.79:0/2091190284 >> 172.21.15.79:0/2091190284 conn(0x7eff5006dcc0 msgr2=0x7eff5006e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:37.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.912+0000 7eff56400640 1 -- 172.21.15.79:0/2091190284 shutdown_connections 2024-08-20T01:49:37.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.912+0000 7eff56400640 1 -- 172.21.15.79:0/2091190284 wait complete. 2024-08-20T01:49:37.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.913+0000 7eff56400640 1 Processor -- start 2024-08-20T01:49:37.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.913+0000 7eff56400640 1 -- start start 2024-08-20T01:49:37.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.914+0000 7eff56400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff50109e80 0x7eff501172d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:37.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.914+0000 7eff56400640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff5010a260 0x7eff50117810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:37.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.914+0000 7eff4ffff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff50109e80 0x7eff501172d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:37.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.914+0000 7eff4ffff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff50109e80 0x7eff501172d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:55466/0 (socket says 172.21.15.79:55466) 2024-08-20T01:49:37.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.915+0000 7eff4ffff640 1 -- 172.21.15.79:0/4249576388 learned_addr learned my addr 172.21.15.79:0/4249576388 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:37.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.915+0000 7eff56400640 1 --2- 172.21.15.79:0/4249576388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff5011bdd0 0x7eff501aad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:37.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.915+0000 7eff56400640 1 -- 172.21.15.79:0/4249576388 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7eff50113cf0 con 0x7eff5010a260 2024-08-20T01:49:37.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.915+0000 7eff56400640 1 -- 172.21.15.79:0/4249576388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7eff50113b70 con 0x7eff5011bdd0 2024-08-20T01:49:37.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.915+0000 7eff5499d640 1 --2- 172.21.15.79:0/4249576388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff5011bdd0 0x7eff501aad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:37.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.915+0000 7eff56400640 1 -- 172.21.15.79:0/4249576388 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7eff50113e70 con 0x7eff50109e80 2024-08-20T01:49:37.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.915+0000 7eff4f7fe640 1 --2- 172.21.15.79:0/4249576388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff5010a260 0x7eff50117810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:37.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.916+0000 7eff4ffff640 1 -- 172.21.15.79:0/4249576388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff5011bdd0 msgr2=0x7eff501aad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:37.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.916+0000 7eff4ffff640 1 --2- 172.21.15.79:0/4249576388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff5011bdd0 0x7eff501aad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:37.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.916+0000 7eff4ffff640 1 -- 172.21.15.79:0/4249576388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff5010a260 msgr2=0x7eff50117810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:37.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.916+0000 7eff4ffff640 1 --2- 172.21.15.79:0/4249576388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff5010a260 0x7eff50117810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:37.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.916+0000 7eff4ffff640 1 -- 172.21.15.79:0/4249576388 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff501ab440 con 0x7eff50109e80 2024-08-20T01:49:37.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.916+0000 7eff4ffff640 1 --2- 172.21.15.79:0/4249576388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff50109e80 0x7eff501172d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7eff3800c8c0 tx=0x7eff3800cd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:37.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.916+0000 7eff4d7fa640 1 -- 172.21.15.79:0/4249576388 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff38004220 con 0x7eff50109e80 2024-08-20T01:49:37.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.917+0000 7eff4d7fa640 1 -- 172.21.15.79:0/4249576388 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff38007e40 con 0x7eff50109e80 2024-08-20T01:49:37.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.917+0000 7eff56400640 1 -- 172.21.15.79:0/4249576388 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff501ab730 con 0x7eff50109e80 2024-08-20T01:49:37.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.917+0000 7eff4d7fa640 1 -- 172.21.15.79:0/4249576388 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff38004a00 con 0x7eff50109e80 2024-08-20T01:49:37.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.917+0000 7eff56400640 1 -- 172.21.15.79:0/4249576388 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff501abc10 con 0x7eff50109e80 2024-08-20T01:49:37.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.921+0000 7eff4d7fa640 1 -- 172.21.15.79:0/4249576388 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7eff38005020 con 0x7eff50109e80 2024-08-20T01:49:37.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.921+0000 7eff587f9740 1 Processor -- start 2024-08-20T01:49:37.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.921+0000 7eff587f9740 1 -- start start 2024-08-20T01:49:37.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.921+0000 7eff587f9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cffcab5830 0x55cffcab5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:37.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.921+0000 7eff587f9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cffcab6150 0x55cffcac1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:37.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.921+0000 7eff587f9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cffcac20e0 0x55cffcac44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:37.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.921+0000 7eff587f9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55cffca2c8e0 con 0x55cffcac20e0 2024-08-20T01:49:37.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.921+0000 7eff587f9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55cffca1bde0 con 0x55cffcab5830 2024-08-20T01:49:37.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.921+0000 7eff587f9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55cffca1fe20 con 0x55cffcab6150 2024-08-20T01:49:37.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.922+0000 7eff4f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cffcac20e0 0x55cffcac44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:37.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.922+0000 7eff4f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cffcac20e0 0x55cffcac44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51120/0 (socket says 172.21.15.79:51120) 2024-08-20T01:49:37.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.922+0000 7eff4f7fe640 1 -- 172.21.15.79:0/3490498177 learned_addr learned my addr 172.21.15.79:0/3490498177 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:37.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.922+0000 7eff4ffff640 1 --2- 172.21.15.79:0/3490498177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cffcab6150 0x55cffcac1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:37.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.923+0000 7eff4d7fa640 1 --2- 172.21.15.79:0/4249576388 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7eff3c0b3d20 0x7eff3c0b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:37.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.923+0000 7eff4d7fa640 1 -- 172.21.15.79:0/4249576388 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7eff380e3870 con 0x7eff50109e80 2024-08-20T01:49:37.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.923+0000 7eff4f7fe640 1 -- 172.21.15.79:0/3490498177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cffcab6150 msgr2=0x55cffcac1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:37.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.923+0000 7eff4f7fe640 1 --2- 172.21.15.79:0/3490498177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cffcab6150 0x55cffcac1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:37.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.923+0000 7eff4f7fe640 1 -- 172.21.15.79:0/3490498177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cffcab5830 msgr2=0x55cffcab5c10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:49:37.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.923+0000 7eff4f7fe640 1 --2- 172.21.15.79:0/3490498177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cffcab5830 0x55cffcab5c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:37.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.923+0000 7eff4f7fe640 1 -- 172.21.15.79:0/3490498177 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cffc77b650 con 0x55cffcac20e0 2024-08-20T01:49:37.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.924+0000 7eff4f7fe640 1 --2- 172.21.15.79:0/3490498177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cffcac20e0 0x55cffcac44d0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7eff4001a910 tx=0x7eff400047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=514eeeee65167671 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:37.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.924+0000 7eff467fc640 1 -- 172.21.15.79:0/3490498177 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff40046030 con 0x55cffcac20e0 2024-08-20T01:49:37.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.924+0000 7eff467fc640 1 -- 172.21.15.79:0/3490498177 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff40004aa0 con 0x55cffcac20e0 2024-08-20T01:49:37.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.924+0000 7eff467fc640 1 -- 172.21.15.79:0/3490498177 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff40040a20 con 0x55cffcac20e0 2024-08-20T01:49:37.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.925+0000 7eff587f9740 1 -- 172.21.15.79:0/3490498177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cffcac20e0 msgr2=0x55cffcac44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:37.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.925+0000 7eff587f9740 1 --2- 172.21.15.79:0/3490498177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cffcac20e0 0x55cffcac44d0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7eff4001a910 tx=0x7eff400047f0 comp rx=0 tx=0).stop 2024-08-20T01:49:37.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.925+0000 7eff5499d640 1 --2- 172.21.15.79:0/4249576388 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7eff3c0b3d20 0x7eff3c0b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:37.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.926+0000 7eff5499d640 1 --2- 172.21.15.79:0/4249576388 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7eff3c0b3d20 0x7eff3c0b61e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7eff48007dd0 tx=0x7eff48007520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:37.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.927+0000 7eff587f9740 1 -- 172.21.15.79:0/3490498177 shutdown_connections 2024-08-20T01:49:37.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.927+0000 7eff587f9740 1 --2- 172.21.15.79:0/3490498177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cffcac20e0 0x55cffcac44d0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:37.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.927+0000 7eff587f9740 1 --2- 172.21.15.79:0/3490498177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cffcab6150 0x55cffcac1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:37.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.927+0000 7eff587f9740 1 --2- 172.21.15.79:0/3490498177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cffcab5830 0x55cffcab5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:37.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.927+0000 7eff587f9740 1 -- 172.21.15.79:0/3490498177 >> 172.21.15.79:0/3490498177 conn(0x55cffcab3660 msgr2=0x55cffcab4800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:37.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.927+0000 7eff587f9740 1 -- 172.21.15.79:0/3490498177 shutdown_connections 2024-08-20T01:49:37.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.927+0000 7eff587f9740 1 -- 172.21.15.79:0/3490498177 wait complete. 2024-08-20T01:49:37.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.928+0000 7eff587f9740 1 -- start start 2024-08-20T01:49:37.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.928+0000 7eff587f9740 1 Processor -- start 2024-08-20T01:49:37.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.929+0000 7eff587f9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cffcab5830 0x55cffcabf080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:37.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.929+0000 7eff587f9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cffcab6150 0x55cffcabf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:37.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.929+0000 7eff4ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cffcab5830 0x55cffcabf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:37.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.929+0000 7eff587f9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cffcac20e0 0x55cffcabfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:37.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.929+0000 7eff587f9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55cffc87e700 con 0x55cffcab6150 2024-08-20T01:49:37.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.929+0000 7eff587f9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55cffc9a27c0 con 0x55cffcab5830 2024-08-20T01:49:37.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.929+0000 7eff587f9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55cffcac4d30 con 0x55cffcac20e0 2024-08-20T01:49:37.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.929+0000 7eff4ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cffcab5830 0x55cffcabf080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:34608/0 (socket says 172.21.15.79:34608) 2024-08-20T01:49:37.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.929+0000 7eff4ffff640 1 -- 172.21.15.79:0/829884650 learned_addr learned my addr 172.21.15.79:0/829884650 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:37.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.929+0000 7eff587f9740 10 client.0 _ll_register_callbacks cb 0x55cffca156b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:49:37.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.930+0000 7eff4f7fe640 1 --2- 172.21.15.79:0/829884650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cffcab6150 0x55cffcabf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:37.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.930+0000 7eff5499d640 1 --2- 172.21.15.79:0/829884650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cffcac20e0 0x55cffcabfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:37.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.930+0000 7eff4ffff640 1 -- 172.21.15.79:0/829884650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cffcac20e0 msgr2=0x55cffcabfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:37.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.930+0000 7eff4ffff640 1 --2- 172.21.15.79:0/829884650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cffcac20e0 0x55cffcabfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:37.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.930+0000 7eff4ffff640 1 -- 172.21.15.79:0/829884650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cffcab6150 msgr2=0x55cffcabf5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:37.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.930+0000 7eff4ffff640 1 --2- 172.21.15.79:0/829884650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cffcab6150 0x55cffcabf5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:37.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.930+0000 7eff4ffff640 1 -- 172.21.15.79:0/829884650 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cffcace0e0 con 0x55cffcab5830 2024-08-20T01:49:37.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.930+0000 7eff5499d640 1 --2- 172.21.15.79:0/829884650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cffcac20e0 0x55cffcabfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:49:37.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.930+0000 7eff4ffff640 1 --2- 172.21.15.79:0/829884650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cffcab5830 0x55cffcabf080 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7eff380a6850 tx=0x7eff380aada0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=572f893686f5ed48 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:37.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.930+0000 7eff2f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:49:37.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.930+0000 7eff2f7fe640 1 -- 172.21.15.79:0/829884650 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff3801d070 con 0x55cffcab5830 2024-08-20T01:49:37.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.930+0000 7eff2f7fe640 1 -- 172.21.15.79:0/829884650 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7eff380cd0f0 con 0x55cffcab5830 2024-08-20T01:49:37.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.931+0000 7eff587f9740 1 -- 172.21.15.79:0/829884650 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cffc9cb100 con 0x55cffcab5830 2024-08-20T01:49:37.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.931+0000 7eff2f7fe640 1 -- 172.21.15.79:0/829884650 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7eff380e6e60 con 0x55cffcab5830 2024-08-20T01:49:37.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.931+0000 7eff587f9740 10 client.27668 fetch_fsmap learned FSMap version 50 2024-08-20T01:49:37.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.931+0000 7eff587f9740 1 -- 172.21.15.79:0/829884650 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55cffcad0a90 con 0x55cffcab5830 2024-08-20T01:49:37.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.932+0000 7eff2f7fe640 1 -- 172.21.15.79:0/829884650 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff380043c0 con 0x55cffcab5830 2024-08-20T01:49:37.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.932+0000 7eff2f7fe640 1 -- 172.21.15.79:0/829884650 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 50) ==== 8366+0+0 (secure 0 0 0) 0x7eff380a9a30 con 0x55cffcab5830 2024-08-20T01:49:37.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.934+0000 7eff587f9740 10 client.27668 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T01:49:37.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.934+0000 7eff587f9740 10 client.27668 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:49:37.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.934+0000 7eff587f9740 20 client.27668 populate_metadata read hostname 'smithi079' 2024-08-20T01:49:37.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.934+0000 7eff587f9740 1 --2- 172.21.15.79:0/829884650 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55cffcad1f50 0x55cffcad4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:37.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.934+0000 7eff587f9740 4 client.27668 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:49:37.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.934+0000 7eff587f9740 1 -- 172.21.15.79:0/829884650 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cffc9cb100 con 0x55cffcad1f50 2024-08-20T01:49:37.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.934+0000 7eff4f7fe640 1 --2- 172.21.15.79:0/829884650 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55cffcad1f50 0x55cffcad4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:37.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.935+0000 7eff4f7fe640 1 --2- 172.21.15.79:0/829884650 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55cffcad1f50 0x55cffcad4380 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=803d4555ec331a4c server_cookie=1c14a1ce2cc3cfa6 in_seq=0 out_seq=0 2024-08-20T01:49:37.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.935+0000 7eff2f7fe640 10 client.27668 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:49:37.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.935+0000 7eff2f7fe640 1 -- 172.21.15.79:0/829884650 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cffc9cb100 con 0x55cffcad1f50 2024-08-20T01:49:37.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.935+0000 7eff2f7fe640 10 client.27668 handle_command_reply: tid=0 2024-08-20T01:49:37.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.935+0000 7eff587f9740 1 client.27668 shutdown 2024-08-20T01:49:37.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.936+0000 7eff587f9740 1 -- 172.21.15.79:0/829884650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cffcab5830 msgr2=0x55cffcabf080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:37.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.936+0000 7eff587f9740 1 --2- 172.21.15.79:0/829884650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cffcab5830 0x55cffcabf080 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7eff380a6850 tx=0x7eff380aada0 comp rx=0 tx=0).stop 2024-08-20T01:49:37.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.936+0000 7eff587f9740 1 -- 172.21.15.79:0/829884650 shutdown_connections 2024-08-20T01:49:37.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.936+0000 7eff587f9740 1 --2- 172.21.15.79:0/829884650 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55cffcad1f50 0x55cffcad4380 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:37.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.937+0000 7eff2f7fe640 0 client.27668 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:49:37.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.937+0000 7eff587f9740 1 --2- 172.21.15.79:0/829884650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cffcac20e0 0x55cffcabfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:37.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.937+0000 7eff587f9740 1 --2- 172.21.15.79:0/829884650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cffcab6150 0x55cffcabf5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:37.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.937+0000 7eff587f9740 1 --2- 172.21.15.79:0/829884650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cffcab5830 0x55cffcabf080 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:37.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.937+0000 7eff587f9740 1 -- 172.21.15.79:0/829884650 >> 172.21.15.79:0/829884650 conn(0x55cffcab3660 msgr2=0x55cffcab91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:37.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.938+0000 7eff587f9740 1 -- 172.21.15.79:0/829884650 shutdown_connections 2024-08-20T01:49:37.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.938+0000 7eff587f9740 1 -- 172.21.15.79:0/829884650 wait complete. 2024-08-20T01:49:37.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.939+0000 7eff587f9740 20 client.27668 trim_cache size 0 max 16384 2024-08-20T01:49:37.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.972+0000 7eff587f9740 1 Processor -- start 2024-08-20T01:49:37.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.972+0000 7eff587f9740 1 -- start start 2024-08-20T01:49:37.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.973+0000 7eff587f9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cffcab5830 0x55cffcac1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:37.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.973+0000 7eff587f9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cffcab6150 0x55cffcab98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:37.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.974+0000 7eff4ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cffcab5830 0x55cffcac1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:37.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.974+0000 7eff4ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cffcab5830 0x55cffcac1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51138/0 (socket says 172.21.15.79:51138) 2024-08-20T01:49:37.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.974+0000 7eff4ffff640 1 -- 172.21.15.79:0/126111255 learned_addr learned my addr 172.21.15.79:0/126111255 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:37.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.974+0000 7eff4f7fe640 1 --2- 172.21.15.79:0/126111255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cffcab6150 0x55cffcab98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:37.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.975+0000 7eff587f9740 1 --2- 172.21.15.79:0/126111255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cffcac20e0 0x55cffcabe7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:37.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.975+0000 7eff587f9740 1 -- 172.21.15.79:0/126111255 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7eff501b4210 con 0x55cffcab5830 2024-08-20T01:49:37.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.975+0000 7eff587f9740 1 -- 172.21.15.79:0/126111255 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7eff501b5d80 con 0x55cffcab6150 2024-08-20T01:49:37.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.975+0000 7eff5499d640 1 --2- 172.21.15.79:0/126111255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cffcac20e0 0x55cffcabe7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:37.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.976+0000 7eff587f9740 1 -- 172.21.15.79:0/126111255 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7eff501b4910 con 0x55cffcac20e0 2024-08-20T01:49:37.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.976+0000 7eff5499d640 1 -- 172.21.15.79:0/126111255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cffcab6150 msgr2=0x55cffcab98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:37.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.976+0000 7eff5499d640 1 --2- 172.21.15.79:0/126111255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cffcab6150 0x55cffcab98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:37.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.976+0000 7eff5499d640 1 -- 172.21.15.79:0/126111255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cffcab5830 msgr2=0x55cffcac1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:37.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.976+0000 7eff5499d640 1 --2- 172.21.15.79:0/126111255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cffcab5830 0x55cffcac1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:37.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.977+0000 7eff5499d640 1 -- 172.21.15.79:0/126111255 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cffcab5210 con 0x55cffcac20e0 2024-08-20T01:49:37.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.977+0000 7eff5499d640 1 --2- 172.21.15.79:0/126111255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cffcac20e0 0x55cffcabe7e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7eff4800fc20 tx=0x7eff48012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f08ea31186b0e072 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:37.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.977+0000 7eff45ffb640 1 -- 172.21.15.79:0/126111255 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff48003b70 con 0x55cffcac20e0 2024-08-20T01:49:37.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.977+0000 7eff45ffb640 1 -- 172.21.15.79:0/126111255 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff48003d10 con 0x55cffcac20e0 2024-08-20T01:49:37.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.977+0000 7eff45ffb640 1 -- 172.21.15.79:0/126111255 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff48004490 con 0x55cffcac20e0 2024-08-20T01:49:37.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.979+0000 7eff587f9740 1 -- 172.21.15.79:0/126111255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cffcac20e0 msgr2=0x55cffcabe7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:37.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.979+0000 7eff587f9740 1 --2- 172.21.15.79:0/126111255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cffcac20e0 0x55cffcabe7e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7eff4800fc20 tx=0x7eff48012000 comp rx=0 tx=0).stop 2024-08-20T01:49:37.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.979+0000 7eff587f9740 1 -- 172.21.15.79:0/126111255 shutdown_connections 2024-08-20T01:49:37.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.980+0000 7eff587f9740 1 --2- 172.21.15.79:0/126111255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cffcac20e0 0x55cffcabe7e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:37.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.980+0000 7eff587f9740 1 --2- 172.21.15.79:0/126111255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cffcab6150 0x55cffcab98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:37.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.980+0000 7eff587f9740 1 --2- 172.21.15.79:0/126111255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cffcab5830 0x55cffcac1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:37.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.980+0000 7eff587f9740 1 -- 172.21.15.79:0/126111255 >> 172.21.15.79:0/126111255 conn(0x55cffcab3660 msgr2=0x55cffcabf810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:37.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.981+0000 7eff587f9740 1 -- 172.21.15.79:0/126111255 shutdown_connections 2024-08-20T01:49:37.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.981+0000 7eff587f9740 1 -- 172.21.15.79:0/126111255 wait complete. 2024-08-20T01:49:37.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.982+0000 7eff587f9740 1 -- start start 2024-08-20T01:49:37.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.982+0000 7eff587f9740 1 Processor -- start 2024-08-20T01:49:37.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.983+0000 7eff587f9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cffcab5830 0x55cffcb34d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:37.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.983+0000 7eff587f9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cffcab6150 0x55cffcb35330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:37.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.984+0000 7eff4ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cffcab5830 0x55cffcb34d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:37.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.984+0000 7eff4ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cffcab5830 0x55cffcb34d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:34620/0 (socket says 172.21.15.79:34620) 2024-08-20T01:49:37.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.984+0000 7eff4ffff640 1 -- 172.21.15.79:0/381087596 learned_addr learned my addr 172.21.15.79:0/381087596 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:37.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.984+0000 7eff4f7fe640 1 --2- 172.21.15.79:0/381087596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cffcab6150 0x55cffcb35330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:37.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.984+0000 7eff587f9740 1 --2- 172.21.15.79:0/381087596 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cffcac20e0 0x55cffcac9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:37.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.984+0000 7eff587f9740 1 -- 172.21.15.79:0/381087596 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7eff501b56b0 con 0x55cffcac20e0 2024-08-20T01:49:37.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.985+0000 7eff5499d640 1 --2- 172.21.15.79:0/381087596 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cffcac20e0 0x55cffcac9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:37.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.985+0000 7eff587f9740 1 -- 172.21.15.79:0/381087596 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7eff501b4fe0 con 0x55cffcab5830 2024-08-20T01:49:37.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.985+0000 7eff587f9740 1 -- 172.21.15.79:0/381087596 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7eff501b21f0 con 0x55cffcab6150 2024-08-20T01:49:37.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.986+0000 7eff4ffff640 1 -- 172.21.15.79:0/381087596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cffcab6150 msgr2=0x55cffcb35330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:37.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.986+0000 7eff4ffff640 1 --2- 172.21.15.79:0/381087596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cffcab6150 0x55cffcb35330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:37.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.986+0000 7eff4ffff640 1 -- 172.21.15.79:0/381087596 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cffcac20e0 msgr2=0x55cffcac9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:37.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.986+0000 7eff4ffff640 1 --2- 172.21.15.79:0/381087596 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cffcac20e0 0x55cffcac9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:37.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.986+0000 7eff4ffff640 1 -- 172.21.15.79:0/381087596 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cffcabff20 con 0x55cffcab5830 2024-08-20T01:49:37.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.986+0000 7eff587f9740 10 client.0 _ll_register_callbacks cb 0x7eff380aa5a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:49:37.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.986+0000 7eff587f9740 1 -- 172.21.15.79:0/381087596 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff48003d10 con 0x55cffcab5830 2024-08-20T01:49:37.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.987+0000 7eff5499d640 1 --2- 172.21.15.79:0/381087596 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cffcac20e0 0x55cffcac9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:49:37.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.987+0000 7eff4ffff640 1 --2- 172.21.15.79:0/381087596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cffcab5830 0x55cffcb34d90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7eff380aa760 tx=0x7eff380aac60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9e46b4a3ef1c45 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:37.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.987+0000 7eff2f7fe640 10 client.27674 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:49:37.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.987+0000 7eff2f7fe640 1 -- 172.21.15.79:0/381087596 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff3801d070 con 0x55cffcab5830 2024-08-20T01:49:37.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.988+0000 7eff2f7fe640 1 -- 172.21.15.79:0/381087596 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7eff380cd070 con 0x55cffcab5830 2024-08-20T01:49:37.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.988+0000 7eff2f7fe640 1 -- 172.21.15.79:0/381087596 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7eff380a6690 con 0x55cffcab5830 2024-08-20T01:49:37.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.988+0000 7eff587f9740 10 client.27674 fetch_fsmap learned FSMap version 50 2024-08-20T01:49:37.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.988+0000 7eff587f9740 1 -- 172.21.15.79:0/381087596 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({fsmap=50}) -- 0x55cffcb3c2d0 con 0x55cffcab5830 2024-08-20T01:49:37.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.989+0000 7eff2f7fe640 1 -- 172.21.15.79:0/381087596 <== mon.2 v2:172.21.15.81:3300/0 4 ==== fsmap(e 50) ==== 8366+0+0 (secure 0 0 0) 0x7eff380079b0 con 0x55cffcab5830 2024-08-20T01:49:37.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.989+0000 7eff587f9740 10 client.27674 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T01:49:37.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.989+0000 7eff587f9740 10 client.27674 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:49:37.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.989+0000 7eff587f9740 20 client.27674 populate_metadata read hostname 'smithi079' 2024-08-20T01:49:37.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.989+0000 7eff587f9740 1 --2- 172.21.15.79:0/381087596 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55cffcad1f50 0x55cffcb3e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:37.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.989+0000 7eff587f9740 4 client.27674 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:49:37.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.989+0000 7eff587f9740 1 -- 172.21.15.79:0/381087596 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cffca2e830 con 0x55cffcad1f50 2024-08-20T01:49:37.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.989+0000 7eff4f7fe640 1 --2- 172.21.15.79:0/381087596 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55cffcad1f50 0x55cffcb3e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:37.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.992+0000 7eff4f7fe640 1 --2- 172.21.15.79:0/381087596 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55cffcad1f50 0x55cffcb3e990 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35621ccc23197106 server_cookie=4a65013ab0d49d51 in_seq=0 out_seq=0 2024-08-20T01:49:37.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.992+0000 7eff2f7fe640 10 client.27674 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:49:37.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.993+0000 7eff2f7fe640 1 -- 172.21.15.79:0/381087596 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55cffca2e830 con 0x55cffcad1f50 2024-08-20T01:49:37.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.993+0000 7eff2f7fe640 10 client.27674 handle_command_reply: tid=0 2024-08-20T01:49:37.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.993+0000 7eff587f9740 1 client.27674 shutdown 2024-08-20T01:49:37.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.994+0000 7eff587f9740 1 -- 172.21.15.79:0/381087596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cffcab5830 msgr2=0x55cffcb34d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:37.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.994+0000 7eff587f9740 1 --2- 172.21.15.79:0/381087596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cffcab5830 0x55cffcb34d90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7eff380aa760 tx=0x7eff380aac60 comp rx=0 tx=0).stop 2024-08-20T01:49:37.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.994+0000 7eff587f9740 1 -- 172.21.15.79:0/381087596 shutdown_connections 2024-08-20T01:49:37.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.994+0000 7eff587f9740 1 --2- 172.21.15.79:0/381087596 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55cffcad1f50 0x55cffcb3e990 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:37.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.994+0000 7eff587f9740 1 --2- 172.21.15.79:0/381087596 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cffcac20e0 0x55cffcac9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:37.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.994+0000 7eff587f9740 1 --2- 172.21.15.79:0/381087596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cffcab6150 0x55cffcb35330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:37.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.994+0000 7eff2f7fe640 0 client.27674 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:49:37.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.994+0000 7eff587f9740 1 --2- 172.21.15.79:0/381087596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cffcab5830 0x55cffcb34d90 secure :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7eff380aa760 tx=0x7eff380aac60 comp rx=0 tx=0).stop 2024-08-20T01:49:37.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.994+0000 7eff587f9740 1 -- 172.21.15.79:0/381087596 >> 172.21.15.79:0/381087596 conn(0x55cffcab3660 msgr2=0x55cffcacce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:37.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.994+0000 7eff587f9740 1 -- 172.21.15.79:0/381087596 shutdown_connections 2024-08-20T01:49:37.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.994+0000 7eff587f9740 1 -- 172.21.15.79:0/381087596 wait complete. 2024-08-20T01:49:37.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.994+0000 7eff587f9740 20 client.27674 trim_cache size 0 max 16384 2024-08-20T01:49:37.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.995+0000 7eff56400640 1 -- 172.21.15.79:0/4249576388 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7eff3c0b3d20 msgr2=0x7eff3c0b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:37.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.995+0000 7eff56400640 1 --2- 172.21.15.79:0/4249576388 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7eff3c0b3d20 0x7eff3c0b61e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7eff48007dd0 tx=0x7eff48007520 comp rx=0 tx=0).stop 2024-08-20T01:49:37.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.995+0000 7eff56400640 1 -- 172.21.15.79:0/4249576388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff50109e80 msgr2=0x7eff501172d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:37.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.995+0000 7eff56400640 1 --2- 172.21.15.79:0/4249576388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff50109e80 0x7eff501172d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7eff3800c8c0 tx=0x7eff3800cd80 comp rx=0 tx=0).stop 2024-08-20T01:49:37.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.995+0000 7eff56400640 1 -- 172.21.15.79:0/4249576388 shutdown_connections 2024-08-20T01:49:37.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.995+0000 7eff56400640 1 --2- 172.21.15.79:0/4249576388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff5011bdd0 0x7eff501aad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:37.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.995+0000 7eff56400640 1 --2- 172.21.15.79:0/4249576388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff5010a260 0x7eff50117810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:37.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.995+0000 7eff56400640 1 --2- 172.21.15.79:0/4249576388 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7eff3c0b3d20 0x7eff3c0b61e0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:37.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.995+0000 7eff56400640 1 --2- 172.21.15.79:0/4249576388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff50109e80 0x7eff501172d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:37.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.995+0000 7eff56400640 1 -- 172.21.15.79:0/4249576388 >> 172.21.15.79:0/4249576388 conn(0x7eff5006dcc0 msgr2=0x7eff500713d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:37.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.996+0000 7eff56400640 1 -- 172.21.15.79:0/4249576388 shutdown_connections 2024-08-20T01:49:37.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:36.996+0000 7eff56400640 1 -- 172.21.15.79:0/4249576388 wait complete. 2024-08-20T01:49:38.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:38 smithi079 ceph-mon[18656]: pgmap v716: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 6.60k op/s 2024-08-20T01:49:38.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:38 smithi081 ceph-mon[22209]: pgmap v716: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 6.60k op/s 2024-08-20T01:49:38.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:38 smithi175 ceph-mon[22392]: pgmap v716: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 6.60k op/s 2024-08-20T01:49:40.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:40 smithi081 ceph-mon[22209]: pgmap v717: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 6.42k op/s 2024-08-20T01:49:40.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:40 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:49:40.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:40 smithi175 ceph-mon[22392]: pgmap v717: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 6.42k op/s 2024-08-20T01:49:40.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:40 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:49:40.692 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:40 smithi079 ceph-mon[18656]: pgmap v717: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 6.42k op/s 2024-08-20T01:49:40.692 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:40 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:49:41.210 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T01:49:41.211 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:49:41.699 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:49:42.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.296+0000 7f8346a07640 1 -- 172.21.15.79:0/685031230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83380a5100 msgr2=0x7f833800b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:42.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.296+0000 7f8346a07640 1 --2- 172.21.15.79:0/685031230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83380a5100 0x7f833800b7b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f834002e8d0 tx=0x7f83400974c0 comp rx=0 tx=0).stop 2024-08-20T01:49:42.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.296+0000 7f8346a07640 1 -- 172.21.15.79:0/685031230 shutdown_connections 2024-08-20T01:49:42.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.296+0000 7f8346a07640 1 --2- 172.21.15.79:0/685031230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83380a5100 0x7f833800b7b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:42.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.296+0000 7f8346a07640 1 --2- 172.21.15.79:0/685031230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83380a47a0 0x7f83380a4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:42.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.296+0000 7f8346a07640 1 --2- 172.21.15.79:0/685031230 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83380a7170 0x7f83380a7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:42.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.296+0000 7f8346a07640 1 -- 172.21.15.79:0/685031230 >> 172.21.15.79:0/685031230 conn(0x7f833801a050 msgr2=0x7f833801c870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:42.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.296+0000 7f8346a07640 1 -- 172.21.15.79:0/685031230 shutdown_connections 2024-08-20T01:49:42.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.297+0000 7f8346a07640 1 -- 172.21.15.79:0/685031230 wait complete. 2024-08-20T01:49:42.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.297+0000 7f8346a07640 1 Processor -- start 2024-08-20T01:49:42.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.297+0000 7f8346a07640 1 -- start start 2024-08-20T01:49:42.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.297+0000 7f8346a07640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83380a47a0 0x7f8338015fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:42.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.298+0000 7f8346a07640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83380a5100 0x7f8338010200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:42.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.298+0000 7f8346a07640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83380a7170 0x7f8338010740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:42.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.298+0000 7f8346a07640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f833800eaf0 con 0x7f83380a5100 2024-08-20T01:49:42.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.298+0000 7f8346a07640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f833800e970 con 0x7f83380a47a0 2024-08-20T01:49:42.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.298+0000 7f8346a07640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f833800ec70 con 0x7f83380a7170 2024-08-20T01:49:42.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.298+0000 7f8345a05640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83380a47a0 0x7f8338015fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:42.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.298+0000 7f8345a05640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83380a47a0 0x7f8338015fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:34844/0 (socket says 172.21.15.79:34844) 2024-08-20T01:49:42.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.298+0000 7f8345a05640 1 -- 172.21.15.79:0/3177810442 learned_addr learned my addr 172.21.15.79:0/3177810442 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:42.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.298+0000 7f8346206640 1 --2- 172.21.15.79:0/3177810442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83380a7170 0x7f8338010740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:42.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.298+0000 7f8345204640 1 --2- 172.21.15.79:0/3177810442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83380a5100 0x7f8338010200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:42.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.298+0000 7f8345a05640 1 -- 172.21.15.79:0/3177810442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83380a7170 msgr2=0x7f8338010740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:42.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.298+0000 7f8345a05640 1 --2- 172.21.15.79:0/3177810442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83380a7170 0x7f8338010740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:42.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.298+0000 7f8345a05640 1 -- 172.21.15.79:0/3177810442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83380a5100 msgr2=0x7f8338010200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:42.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.298+0000 7f8345a05640 1 --2- 172.21.15.79:0/3177810442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83380a5100 0x7f8338010200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:42.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.298+0000 7f8345a05640 1 -- 172.21.15.79:0/3177810442 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8338010f10 con 0x7f83380a47a0 2024-08-20T01:49:42.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.299+0000 7f8345a05640 1 --2- 172.21.15.79:0/3177810442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83380a47a0 0x7f8338015fe0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f833c00c890 tx=0x7f833c00cd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:42.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.299+0000 7f8336ffd640 1 -- 172.21.15.79:0/3177810442 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c004220 con 0x7f83380a47a0 2024-08-20T01:49:42.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.299+0000 7f8336ffd640 1 -- 172.21.15.79:0/3177810442 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f833c007e40 con 0x7f83380a47a0 2024-08-20T01:49:42.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.299+0000 7f8346a07640 1 -- 172.21.15.79:0/3177810442 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8338157ea0 con 0x7f83380a47a0 2024-08-20T01:49:42.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.299+0000 7f8336ffd640 1 -- 172.21.15.79:0/3177810442 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c004a00 con 0x7f83380a47a0 2024-08-20T01:49:42.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.299+0000 7f8346a07640 1 -- 172.21.15.79:0/3177810442 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83381583a0 con 0x7f83380a47a0 2024-08-20T01:49:42.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.303+0000 7f8346a07640 1 -- 172.21.15.79:0/3177810442 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83380a4bc0 con 0x7f83380a47a0 2024-08-20T01:49:42.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.303+0000 7f8336ffd640 1 -- 172.21.15.79:0/3177810442 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f833c0079b0 con 0x7f83380a47a0 2024-08-20T01:49:42.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.304+0000 7f8336ffd640 1 --2- 172.21.15.79:0/3177810442 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f832c0b3c90 0x7f832c0b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:42.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.305+0000 7f8336ffd640 1 -- 172.21.15.79:0/3177810442 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f833c0e3900 con 0x7f83380a47a0 2024-08-20T01:49:42.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.305+0000 7f8345204640 1 --2- 172.21.15.79:0/3177810442 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f832c0b3c90 0x7f832c0b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:42.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.306+0000 7f8345204640 1 --2- 172.21.15.79:0/3177810442 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f832c0b3c90 0x7f832c0b6150 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8338015d30 tx=0x7f833000f040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:42.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.310+0000 7f8336ffd640 1 -- 172.21.15.79:0/3177810442 <== mon.2 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f833c014030 con 0x7f83380a47a0 2024-08-20T01:49:42.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:42 smithi079 ceph-mon[18656]: pgmap v718: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 MiB/s wr, 6.02k op/s 2024-08-20T01:49:42.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:42 smithi081 ceph-mon[22209]: pgmap v718: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 MiB/s wr, 6.02k op/s 2024-08-20T01:49:42.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:42 smithi175 ceph-mon[22392]: pgmap v718: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 MiB/s wr, 6.02k op/s 2024-08-20T01:49:42.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.724+0000 7f8346a07640 1 -- 172.21.15.79:0/3177810442 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8338158830 con 0x7f83380a47a0 2024-08-20T01:49:42.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.725+0000 7f8336ffd640 1 -- 172.21.15.79:0/3177810442 <== mon.2 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+11973 (secure 0 0 0) 0x7f833c0aaf00 con 0x7f83380a47a0 2024-08-20T01:49:42.728 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:49:42.729 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":51,"btime":"2024-08-20T01:49:39:180084+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14670,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/735082912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":735082912},{"type":"v1","addr":"172.21.15.79:6835","nonce":735082912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2150339873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2150339873},{"type":"v1","addr":"172.21.15.79:6837","nonce":2150339873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":51,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:34:55.133562+0000","modified":"2024-08-20T01:49:38.572328+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24539,"mds_1":24538,"mds_2":24523,"mds_3":24514,"mds_4":24512},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14724":{"gid":14724,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/1071242274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1071242274},{"type":"v1","addr":"172.21.15.79:6839","nonce":1071242274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14730":{"gid":14730,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6841/2448977611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":2448977611},{"type":"v1","addr":"172.21.15.79:6841","nonce":2448977611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/1257507005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1257507005},{"type":"v1","addr":"172.21.15.81:6833","nonce":1257507005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1499936216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1499936216},{"type":"v1","addr":"172.21.15.81:6835","nonce":1499936216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/1107229215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1107229215},{"type":"v1","addr":"172.21.15.175:6833","nonce":1107229215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6837/2073598870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2073598870},{"type":"v1","addr":"172.21.15.81:6837","nonce":2073598870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/2552601173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2552601173},{"type":"v1","addr":"172.21.15.175:6835","nonce":2552601173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6837/1767284089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1767284089},{"type":"v1","addr":"172.21.15.175:6837","nonce":1767284089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/1331748742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1331748742},{"type":"v1","addr":"172.21.15.175:6839","nonce":1331748742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/4098410583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":4098410583},{"type":"v1","addr":"172.21.15.81:6839","nonce":4098410583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24539,"qdb_cluster":[24539,24523,24514,24538,24512]},"id":1}]} 2024-08-20T01:49:42.729 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 51 2024-08-20T01:49:42.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.729+0000 7f8346a07640 1 -- 172.21.15.79:0/3177810442 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f832c0b3c90 msgr2=0x7f832c0b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:42.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.729+0000 7f8346a07640 1 --2- 172.21.15.79:0/3177810442 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f832c0b3c90 0x7f832c0b6150 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8338015d30 tx=0x7f833000f040 comp rx=0 tx=0).stop 2024-08-20T01:49:42.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.729+0000 7f8346a07640 1 -- 172.21.15.79:0/3177810442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83380a47a0 msgr2=0x7f8338015fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:42.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.729+0000 7f8346a07640 1 --2- 172.21.15.79:0/3177810442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83380a47a0 0x7f8338015fe0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f833c00c890 tx=0x7f833c00cd50 comp rx=0 tx=0).stop 2024-08-20T01:49:42.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.729+0000 7f8346a07640 1 -- 172.21.15.79:0/3177810442 shutdown_connections 2024-08-20T01:49:42.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.729+0000 7f8346a07640 1 --2- 172.21.15.79:0/3177810442 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f832c0b3c90 0x7f832c0b6150 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:42.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.729+0000 7f8346a07640 1 --2- 172.21.15.79:0/3177810442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83380a7170 0x7f8338010740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:42.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.729+0000 7f8346a07640 1 --2- 172.21.15.79:0/3177810442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83380a5100 0x7f8338010200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:42.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.729+0000 7f8346a07640 1 --2- 172.21.15.79:0/3177810442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83380a47a0 0x7f8338015fe0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:42.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.729+0000 7f8346a07640 1 -- 172.21.15.79:0/3177810442 >> 172.21.15.79:0/3177810442 conn(0x7f833801a050 msgr2=0x7f83380a90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:42.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.729+0000 7f8346a07640 1 -- 172.21.15.79:0/3177810442 shutdown_connections 2024-08-20T01:49:42.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:42.729+0000 7f8346a07640 1 -- 172.21.15.79:0/3177810442 wait complete. 2024-08-20T01:49:43.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:43 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/3177810442' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:49:43.530 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:43 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/3177810442' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:49:43.531 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-20T01:49:43.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:43 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/3177810442' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:49:43.973 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:49:44.438 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:44 smithi079 ceph-mon[18656]: pgmap v719: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 MiB/s wr, 5.46k op/s 2024-08-20T01:49:44.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:44 smithi081 ceph-mon[22209]: pgmap v719: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 MiB/s wr, 5.46k op/s 2024-08-20T01:49:44.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.600+0000 7fb156130640 1 -- 172.21.15.79:0/4032842155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb150104cb0 msgr2=0x7fb150105090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:44.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.600+0000 7fb156130640 1 --2- 172.21.15.79:0/4032842155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb150104cb0 0x7fb150105090 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb140009860 tx=0x7fb14002a360 comp rx=0 tx=0).stop 2024-08-20T01:49:44.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.601+0000 7fb156130640 1 -- 172.21.15.79:0/4032842155 shutdown_connections 2024-08-20T01:49:44.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.601+0000 7fb156130640 1 --2- 172.21.15.79:0/4032842155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb15010b040 0x7fb150111840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:44.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.601+0000 7fb156130640 1 --2- 172.21.15.79:0/4032842155 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb15010a6c0 0x7fb15010ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:44.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.601+0000 7fb156130640 1 --2- 172.21.15.79:0/4032842155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb150104cb0 0x7fb150105090 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:44.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.601+0000 7fb156130640 1 -- 172.21.15.79:0/4032842155 >> 172.21.15.79:0/4032842155 conn(0x7fb1501006c0 msgr2=0x7fb150102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:44.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.601+0000 7fb156130640 1 -- 172.21.15.79:0/4032842155 shutdown_connections 2024-08-20T01:49:44.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.601+0000 7fb156130640 1 -- 172.21.15.79:0/4032842155 wait complete. 2024-08-20T01:49:44.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.602+0000 7fb156130640 1 Processor -- start 2024-08-20T01:49:44.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.602+0000 7fb156130640 1 -- start start 2024-08-20T01:49:44.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.603+0000 7fb156130640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb150104cb0 0x7fb15019b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:44.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.603+0000 7fb156130640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb15010a6c0 0x7fb15019b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:44.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.603+0000 7fb156130640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb15010b040 0x7fb1501a0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:44.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.603+0000 7fb156130640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb150114bb0 con 0x7fb15010b040 2024-08-20T01:49:44.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.603+0000 7fb156130640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb150114a30 con 0x7fb15010a6c0 2024-08-20T01:49:44.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.603+0000 7fb156130640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb150114d30 con 0x7fb150104cb0 2024-08-20T01:49:44.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.603+0000 7fb14ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb15010b040 0x7fb1501a0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:44.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.603+0000 7fb14ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb15010b040 0x7fb1501a0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46704/0 (socket says 172.21.15.79:46704) 2024-08-20T01:49:44.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.603+0000 7fb14ffff640 1 -- 172.21.15.79:0/3867192808 learned_addr learned my addr 172.21.15.79:0/3867192808 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:44.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.604+0000 7fb14effd640 1 --2- 172.21.15.79:0/3867192808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb15010a6c0 0x7fb15019b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:44.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.605+0000 7fb14ffff640 1 -- 172.21.15.79:0/3867192808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb150104cb0 msgr2=0x7fb15019b140 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-20T01:49:44.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.605+0000 7fb14ffff640 1 --2- 172.21.15.79:0/3867192808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb150104cb0 0x7fb15019b140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:44.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.605+0000 7fb14ffff640 1 -- 172.21.15.79:0/3867192808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb15010a6c0 msgr2=0x7fb15019b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:44.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.605+0000 7fb14ffff640 1 --2- 172.21.15.79:0/3867192808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb15010a6c0 0x7fb15019b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:44.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.605+0000 7fb14ffff640 1 -- 172.21.15.79:0/3867192808 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1501a11f0 con 0x7fb15010b040 2024-08-20T01:49:44.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.605+0000 7fb14ffff640 1 --2- 172.21.15.79:0/3867192808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb15010b040 0x7fb1501a0a20 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fb14800efc0 tx=0x7fb14800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:44.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.606+0000 7fb14cff9640 1 -- 172.21.15.79:0/3867192808 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb148003970 con 0x7fb15010b040 2024-08-20T01:49:44.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.606+0000 7fb156130640 1 -- 172.21.15.79:0/3867192808 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1501a14e0 con 0x7fb15010b040 2024-08-20T01:49:44.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.606+0000 7fb156130640 1 -- 172.21.15.79:0/3867192808 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1501a7ba0 con 0x7fb15010b040 2024-08-20T01:49:44.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.606+0000 7fb14cff9640 1 -- 172.21.15.79:0/3867192808 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb148004020 con 0x7fb15010b040 2024-08-20T01:49:44.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.607+0000 7fb14cff9640 1 -- 172.21.15.79:0/3867192808 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb148004d40 con 0x7fb15010b040 2024-08-20T01:49:44.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.611+0000 7fb158529740 1 Processor -- start 2024-08-20T01:49:44.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.611+0000 7fb14cff9640 1 -- 172.21.15.79:0/3867192808 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb14801d020 con 0x7fb15010b040 2024-08-20T01:49:44.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.613+0000 7fb14cff9640 1 --2- 172.21.15.79:0/3867192808 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb1380b3bd0 0x7fb1380b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:44.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.613+0000 7fb14cff9640 1 -- 172.21.15.79:0/3867192808 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fb1480e3b70 con 0x7fb15010b040 2024-08-20T01:49:44.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.613+0000 7fb158529740 1 -- start start 2024-08-20T01:49:44.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.614+0000 7fb158529740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560513d83090 0x560513d83470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:44.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.614+0000 7fb158529740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560513d839b0 0x560513d8f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:44.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.614+0000 7fb158529740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560513d8f940 0x560513d91d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:44.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.614+0000 7fb158529740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560513cf1930 con 0x560513d8f940 2024-08-20T01:49:44.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.614+0000 7fb158529740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560513ce0e30 con 0x560513d839b0 2024-08-20T01:49:44.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.614+0000 7fb158529740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560513ce4e70 con 0x560513d83090 2024-08-20T01:49:44.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.614+0000 7fb14ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560513d8f940 0x560513d91d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:44.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.614+0000 7fb14ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560513d8f940 0x560513d91d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46718/0 (socket says 172.21.15.79:46718) 2024-08-20T01:49:44.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.614+0000 7fb14ffff640 1 -- 172.21.15.79:0/1992452636 learned_addr learned my addr 172.21.15.79:0/1992452636 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:44.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.615+0000 7fb14effd640 1 --2- 172.21.15.79:0/1992452636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560513d839b0 0x560513d8f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:44.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.615+0000 7fb14effd640 1 --2- 172.21.15.79:0/3867192808 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb1380b3bd0 0x7fb1380b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:44.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.615+0000 7fb14ffff640 1 -- 172.21.15.79:0/1992452636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560513d83090 msgr2=0x560513d83470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:44.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.615+0000 7fb14ffff640 1 --2- 172.21.15.79:0/1992452636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560513d83090 0x560513d83470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:44.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.615+0000 7fb14ffff640 1 -- 172.21.15.79:0/1992452636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560513d839b0 msgr2=0x560513d8f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:44.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.615+0000 7fb14ffff640 1 --2- 172.21.15.79:0/1992452636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560513d839b0 0x560513d8f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:44.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.615+0000 7fb14ffff640 1 -- 172.21.15.79:0/1992452636 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560513a40650 con 0x560513d8f940 2024-08-20T01:49:44.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.615+0000 7fb14ffff640 1 --2- 172.21.15.79:0/1992452636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560513d8f940 0x560513d91d30 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fb148009250 tx=0x7fb1480ab170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbb4c309e211e055 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:44.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.616+0000 7fb135ffb640 1 -- 172.21.15.79:0/1992452636 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1480b3b20 con 0x560513d8f940 2024-08-20T01:49:44.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.616+0000 7fb135ffb640 1 -- 172.21.15.79:0/1992452636 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb1480041d0 con 0x560513d8f940 2024-08-20T01:49:44.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.616+0000 7fb135ffb640 1 -- 172.21.15.79:0/1992452636 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1480b3690 con 0x560513d8f940 2024-08-20T01:49:44.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.618+0000 7fb158529740 1 -- 172.21.15.79:0/1992452636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560513d8f940 msgr2=0x560513d91d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:44.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.618+0000 7fb158529740 1 --2- 172.21.15.79:0/1992452636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560513d8f940 0x560513d91d30 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fb148009250 tx=0x7fb1480ab170 comp rx=0 tx=0).stop 2024-08-20T01:49:44.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.618+0000 7fb14effd640 1 --2- 172.21.15.79:0/3867192808 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb1380b3bd0 0x7fb1380b6090 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb144006a50 tx=0x7fb1440069e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:44.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.618+0000 7fb158529740 1 -- 172.21.15.79:0/1992452636 shutdown_connections 2024-08-20T01:49:44.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.618+0000 7fb158529740 1 --2- 172.21.15.79:0/1992452636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560513d8f940 0x560513d91d30 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:44.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.618+0000 7fb158529740 1 --2- 172.21.15.79:0/1992452636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560513d839b0 0x560513d8f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:44.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.618+0000 7fb158529740 1 --2- 172.21.15.79:0/1992452636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560513d83090 0x560513d83470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:44.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.618+0000 7fb158529740 1 -- 172.21.15.79:0/1992452636 >> 172.21.15.79:0/1992452636 conn(0x560513d80ec0 msgr2=0x560513d82060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:44.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.618+0000 7fb158529740 1 -- 172.21.15.79:0/1992452636 shutdown_connections 2024-08-20T01:49:44.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.618+0000 7fb158529740 1 -- 172.21.15.79:0/1992452636 wait complete. 2024-08-20T01:49:44.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.619+0000 7fb158529740 1 -- start start 2024-08-20T01:49:44.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.619+0000 7fb158529740 1 Processor -- start 2024-08-20T01:49:44.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.620+0000 7fb158529740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560513d83090 0x560513d8c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:44.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.620+0000 7fb158529740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560513d839b0 0x560513d8ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:44.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.620+0000 7fb14f7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560513d83090 0x560513d8c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:44.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.620+0000 7fb14f7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560513d83090 0x560513d8c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:50284/0 (socket says 172.21.15.79:50284) 2024-08-20T01:49:44.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.620+0000 7fb14f7fe640 1 -- 172.21.15.79:0/1393810151 learned_addr learned my addr 172.21.15.79:0/1393810151 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:44.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.620+0000 7fb158529740 1 --2- 172.21.15.79:0/1393810151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560513d8f940 0x560513d8d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:44.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.620+0000 7fb14effd640 1 --2- 172.21.15.79:0/1393810151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560513d839b0 0x560513d8ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:44.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.620+0000 7fb158529740 1 -- 172.21.15.79:0/1393810151 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560513b43700 con 0x560513d8f940 2024-08-20T01:49:44.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.621+0000 7fb158529740 1 -- 172.21.15.79:0/1393810151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560513c67810 con 0x560513d839b0 2024-08-20T01:49:44.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.621+0000 7fb158529740 1 -- 172.21.15.79:0/1393810151 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560513d92560 con 0x560513d83090 2024-08-20T01:49:44.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.621+0000 7fb158529740 10 client.0 _ll_register_callbacks cb 0x560513cda700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:49:44.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.623+0000 7fb14ffff640 1 --2- 172.21.15.79:0/1393810151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560513d8f940 0x560513d8d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:44.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.623+0000 7fb14ffff640 1 -- 172.21.15.79:0/1393810151 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560513d83090 msgr2=0x560513d8c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:44.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.623+0000 7fb14ffff640 1 --2- 172.21.15.79:0/1393810151 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560513d83090 0x560513d8c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:44.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.624+0000 7fb14ffff640 1 -- 172.21.15.79:0/1393810151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560513d839b0 msgr2=0x560513d8ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:44.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.624+0000 7fb14ffff640 1 --2- 172.21.15.79:0/1393810151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560513d839b0 0x560513d8ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:44.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.624+0000 7fb14ffff640 1 -- 172.21.15.79:0/1393810151 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560513d9b940 con 0x560513d8f940 2024-08-20T01:49:44.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.624+0000 7fb14f7fe640 1 --2- 172.21.15.79:0/1393810151 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560513d83090 0x560513d8c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:49:44.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.624+0000 7fb14effd640 1 --2- 172.21.15.79:0/1393810151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560513d839b0 0x560513d8ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:49:44.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.624+0000 7fb14ffff640 1 --2- 172.21.15.79:0/1393810151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560513d8f940 0x560513d8d380 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fb148009fd0 tx=0x7fb1480a69a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6479d03560ffc45 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:44.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.630+0000 7fb12effd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:49:44.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.630+0000 7fb12effd640 1 -- 172.21.15.79:0/1393810151 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1480c5390 con 0x560513d8f940 2024-08-20T01:49:44.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.630+0000 7fb12effd640 1 -- 172.21.15.79:0/1393810151 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fb1480a6d00 con 0x560513d8f940 2024-08-20T01:49:44.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.631+0000 7fb158529740 1 -- 172.21.15.79:0/1393810151 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560513c90150 con 0x560513d8f940 2024-08-20T01:49:44.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.632+0000 7fb12effd640 1 -- 172.21.15.79:0/1393810151 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fb1480b3690 con 0x560513d8f940 2024-08-20T01:49:44.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.632+0000 7fb158529740 10 client.18582 fetch_fsmap learned FSMap version 51 2024-08-20T01:49:44.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.632+0000 7fb158529740 1 -- 172.21.15.79:0/1393810151 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x560513d9e2f0 con 0x560513d8f940 2024-08-20T01:49:44.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.633+0000 7fb12effd640 1 -- 172.21.15.79:0/1393810151 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x560513c90150 con 0x560513d8f940 2024-08-20T01:49:44.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.633+0000 7fb12effd640 1 -- 172.21.15.79:0/1393810151 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7fb14800b040 con 0x560513d8f940 2024-08-20T01:49:44.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.633+0000 7fb158529740 10 client.18582 fetch_fsmap finished waiting for FSMap version 51 2024-08-20T01:49:44.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.633+0000 7fb158529740 10 client.18582 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:49:44.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.633+0000 7fb158529740 20 client.18582 populate_metadata read hostname 'smithi079' 2024-08-20T01:49:44.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.634+0000 7fb158529740 1 --2- 172.21.15.79:0/1393810151 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x560513d9f640 0x560513da1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:44.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.634+0000 7fb158529740 4 client.18582 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:49:44.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.634+0000 7fb158529740 1 -- 172.21.15.79:0/1393810151 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560513cf3880 con 0x560513d9f640 2024-08-20T01:49:44.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.634+0000 7fb14f7fe640 1 --2- 172.21.15.79:0/1393810151 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x560513d9f640 0x560513da1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:44.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.635+0000 7fb12effd640 10 client.18582 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:49:44.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.635+0000 7fb14f7fe640 1 --2- 172.21.15.79:0/1393810151 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x560513d9f640 0x560513da1a30 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=fa7af01e506cd762 server_cookie=a0b017eb0f26dcf2 in_seq=0 out_seq=0 2024-08-20T01:49:44.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.636+0000 7fb12effd640 1 -- 172.21.15.79:0/1393810151 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560513cf3880 con 0x560513d9f640 2024-08-20T01:49:44.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.636+0000 7fb12effd640 10 client.18582 handle_command_reply: tid=0 2024-08-20T01:49:44.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.636+0000 7fb158529740 1 client.18582 shutdown 2024-08-20T01:49:44.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:44 smithi175 ceph-mon[22392]: pgmap v719: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 MiB/s wr, 5.46k op/s 2024-08-20T01:49:44.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.636+0000 7fb158529740 1 -- 172.21.15.79:0/1393810151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560513d8f940 msgr2=0x560513d8d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:44.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.636+0000 7fb158529740 1 --2- 172.21.15.79:0/1393810151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560513d8f940 0x560513d8d380 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fb148009fd0 tx=0x7fb1480a69a0 comp rx=0 tx=0).stop 2024-08-20T01:49:44.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.637+0000 7fb158529740 1 -- 172.21.15.79:0/1393810151 shutdown_connections 2024-08-20T01:49:44.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.637+0000 7fb158529740 1 --2- 172.21.15.79:0/1393810151 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x560513d9f640 0x560513da1a30 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:44.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.637+0000 7fb158529740 1 --2- 172.21.15.79:0/1393810151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560513d8f940 0x560513d8d380 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:44.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.637+0000 7fb12effd640 0 client.18582 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:49:44.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.637+0000 7fb158529740 1 --2- 172.21.15.79:0/1393810151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560513d839b0 0x560513d8ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:44.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.637+0000 7fb158529740 1 --2- 172.21.15.79:0/1393810151 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560513d83090 0x560513d8c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:44.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.637+0000 7fb158529740 1 -- 172.21.15.79:0/1393810151 >> 172.21.15.79:0/1393810151 conn(0x560513d80ec0 msgr2=0x560513d86a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:44.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.637+0000 7fb158529740 1 -- 172.21.15.79:0/1393810151 shutdown_connections 2024-08-20T01:49:44.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.637+0000 7fb158529740 1 -- 172.21.15.79:0/1393810151 wait complete. 2024-08-20T01:49:44.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.637+0000 7fb158529740 20 client.18582 trim_cache size 0 max 16384 2024-08-20T01:49:44.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.662+0000 7fb158529740 1 Processor -- start 2024-08-20T01:49:44.665 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.662+0000 7fb158529740 1 -- start start 2024-08-20T01:49:44.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.662+0000 7fb158529740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560513d83090 0x560513d87190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:44.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.663+0000 7fb158529740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560513d839b0 0x560513d77660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:44.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.663+0000 7fb158529740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560513d8f940 0x560513d89b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:44.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.663+0000 7fb158529740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb1501abf70 con 0x560513d8f940 2024-08-20T01:49:44.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.663+0000 7fb158529740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb1501adab0 con 0x560513d83090 2024-08-20T01:49:44.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.663+0000 7fb158529740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb1501ac640 con 0x560513d839b0 2024-08-20T01:49:44.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.663+0000 7fb14effd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560513d839b0 0x560513d77660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:44.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.663+0000 7fb14f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560513d83090 0x560513d87190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:44.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.663+0000 7fb14effd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560513d839b0 0x560513d77660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:50294/0 (socket says 172.21.15.79:50294) 2024-08-20T01:49:44.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.663+0000 7fb14effd640 1 -- 172.21.15.79:0/3068120644 learned_addr learned my addr 172.21.15.79:0/3068120644 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:44.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.663+0000 7fb14f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560513d83090 0x560513d87190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:34890/0 (socket says 172.21.15.79:34890) 2024-08-20T01:49:44.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.663+0000 7fb14ffff640 1 --2- 172.21.15.79:0/3068120644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560513d8f940 0x560513d89b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:44.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.663+0000 7fb14effd640 1 -- 172.21.15.79:0/3068120644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560513d83090 msgr2=0x560513d87190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:44.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.663+0000 7fb14effd640 1 --2- 172.21.15.79:0/3068120644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560513d83090 0x560513d87190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:44.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.663+0000 7fb14effd640 1 -- 172.21.15.79:0/3068120644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560513d8f940 msgr2=0x560513d89b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:44.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.663+0000 7fb14effd640 1 --2- 172.21.15.79:0/3068120644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560513d8f940 0x560513d89b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:44.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.663+0000 7fb14effd640 1 -- 172.21.15.79:0/3068120644 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560513d77ba0 con 0x560513d839b0 2024-08-20T01:49:44.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.664+0000 7fb14effd640 1 --2- 172.21.15.79:0/3068120644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560513d839b0 0x560513d77660 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb14400ac80 tx=0x7fb14400d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bebdfea05c43867 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:44.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.664+0000 7fb1357fa640 1 -- 172.21.15.79:0/3068120644 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb144016e10 con 0x560513d839b0 2024-08-20T01:49:44.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.664+0000 7fb1357fa640 1 -- 172.21.15.79:0/3068120644 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb144026070 con 0x560513d839b0 2024-08-20T01:49:44.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.664+0000 7fb1357fa640 1 -- 172.21.15.79:0/3068120644 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb144015360 con 0x560513d839b0 2024-08-20T01:49:44.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.665+0000 7fb158529740 1 -- 172.21.15.79:0/3068120644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560513d839b0 msgr2=0x560513d77660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:44.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.665+0000 7fb158529740 1 --2- 172.21.15.79:0/3068120644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560513d839b0 0x560513d77660 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb14400ac80 tx=0x7fb14400d000 comp rx=0 tx=0).stop 2024-08-20T01:49:44.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.665+0000 7fb158529740 1 -- 172.21.15.79:0/3068120644 shutdown_connections 2024-08-20T01:49:44.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.665+0000 7fb158529740 1 --2- 172.21.15.79:0/3068120644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560513d8f940 0x560513d89b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:44.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.665+0000 7fb158529740 1 --2- 172.21.15.79:0/3068120644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560513d839b0 0x560513d77660 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:44.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.665+0000 7fb158529740 1 --2- 172.21.15.79:0/3068120644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560513d83090 0x560513d87190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:44.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.665+0000 7fb158529740 1 -- 172.21.15.79:0/3068120644 >> 172.21.15.79:0/3068120644 conn(0x560513d80ec0 msgr2=0x560513d76f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:44.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.667+0000 7fb158529740 1 -- 172.21.15.79:0/3068120644 shutdown_connections 2024-08-20T01:49:44.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.667+0000 7fb158529740 1 -- 172.21.15.79:0/3068120644 wait complete. 2024-08-20T01:49:44.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.668+0000 7fb158529740 1 -- start start 2024-08-20T01:49:44.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.668+0000 7fb158529740 1 Processor -- start 2024-08-20T01:49:44.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.669+0000 7fb158529740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560513d83090 0x560513da4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:44.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.669+0000 7fb158529740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560513d839b0 0x560513da4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:44.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.669+0000 7fb158529740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560513d8f940 0x560513e07f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:44.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.669+0000 7fb14effd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560513d839b0 0x560513da4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:44.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.669+0000 7fb14effd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560513d839b0 0x560513da4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:50298/0 (socket says 172.21.15.79:50298) 2024-08-20T01:49:44.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.669+0000 7fb14effd640 1 -- 172.21.15.79:0/974132057 learned_addr learned my addr 172.21.15.79:0/974132057 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:44.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.669+0000 7fb158529740 1 -- 172.21.15.79:0/974132057 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb1501ad3e0 con 0x560513d8f940 2024-08-20T01:49:44.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.670+0000 7fb158529740 1 -- 172.21.15.79:0/974132057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb1501acd10 con 0x560513d83090 2024-08-20T01:49:44.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.670+0000 7fb158529740 1 -- 172.21.15.79:0/974132057 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb1501a9f50 con 0x560513d839b0 2024-08-20T01:49:44.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.670+0000 7fb158529740 10 client.0 _ll_register_callbacks cb 0x7fb1480ae070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:49:44.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.670+0000 7fb14ffff640 1 --2- 172.21.15.79:0/974132057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560513d8f940 0x560513e07f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:44.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.669+0000 7fb14f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560513d83090 0x560513da4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:44.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.670+0000 7fb14ffff640 1 -- 172.21.15.79:0/974132057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560513d839b0 msgr2=0x560513da4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:44.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.670+0000 7fb14ffff640 1 --2- 172.21.15.79:0/974132057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560513d839b0 0x560513da4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:44.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.670+0000 7fb14ffff640 1 -- 172.21.15.79:0/974132057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560513d83090 msgr2=0x560513da4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:44.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.670+0000 7fb14ffff640 1 --2- 172.21.15.79:0/974132057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560513d83090 0x560513da4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:44.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.670+0000 7fb14ffff640 1 -- 172.21.15.79:0/974132057 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560513e08540 con 0x560513d8f940 2024-08-20T01:49:44.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.671+0000 7fb14ffff640 1 --2- 172.21.15.79:0/974132057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560513d8f940 0x560513e07f80 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fb1480aaa00 tx=0x7fb1480ab170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95fb795a09cc8767 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:44.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.671+0000 7fb12effd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:49:44.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.672+0000 7fb12effd640 1 -- 172.21.15.79:0/974132057 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1480aa840 con 0x560513d8f940 2024-08-20T01:49:44.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.672+0000 7fb12effd640 1 -- 172.21.15.79:0/974132057 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fb14800e0b0 con 0x560513d8f940 2024-08-20T01:49:44.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.672+0000 7fb158529740 1 -- 172.21.15.79:0/974132057 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb144026070 con 0x560513d8f940 2024-08-20T01:49:44.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.672+0000 7fb12effd640 1 -- 172.21.15.79:0/974132057 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fb1480c5390 con 0x560513d8f940 2024-08-20T01:49:44.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.672+0000 7fb158529740 10 client.18588 fetch_fsmap learned FSMap version 51 2024-08-20T01:49:44.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.673+0000 7fb158529740 1 -- 172.21.15.79:0/974132057 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x560513e09820 con 0x560513d8f940 2024-08-20T01:49:44.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.673+0000 7fb12effd640 1 -- 172.21.15.79:0/974132057 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb144026070 con 0x560513d8f940 2024-08-20T01:49:44.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.673+0000 7fb12effd640 1 -- 172.21.15.79:0/974132057 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7fb1480a9cd0 con 0x560513d8f940 2024-08-20T01:49:44.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.674+0000 7fb158529740 10 client.18588 fetch_fsmap finished waiting for FSMap version 51 2024-08-20T01:49:44.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.674+0000 7fb158529740 10 client.18588 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:49:44.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.674+0000 7fb158529740 20 client.18588 populate_metadata read hostname 'smithi079' 2024-08-20T01:49:44.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.674+0000 7fb158529740 1 --2- 172.21.15.79:0/974132057 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x560513d9f640 0x560513e0bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:44.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.674+0000 7fb158529740 4 client.18588 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:49:44.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.674+0000 7fb158529740 1 -- 172.21.15.79:0/974132057 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560513cef320 con 0x560513d9f640 2024-08-20T01:49:44.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.675+0000 7fb14f7fe640 1 --2- 172.21.15.79:0/974132057 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x560513d9f640 0x560513e0bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:44.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.675+0000 7fb14f7fe640 1 --2- 172.21.15.79:0/974132057 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x560513d9f640 0x560513e0bd00 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d495f09f2d7c5582 server_cookie=fa9c844308f05791 in_seq=0 out_seq=0 2024-08-20T01:49:44.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.675+0000 7fb12effd640 10 client.18588 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:49:44.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.676+0000 7fb12effd640 1 -- 172.21.15.79:0/974132057 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560513cef320 con 0x560513d9f640 2024-08-20T01:49:44.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.676+0000 7fb12effd640 10 client.18588 handle_command_reply: tid=0 2024-08-20T01:49:44.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.676+0000 7fb158529740 1 client.18588 shutdown 2024-08-20T01:49:44.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.676+0000 7fb158529740 1 -- 172.21.15.79:0/974132057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560513d8f940 msgr2=0x560513e07f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:44.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.676+0000 7fb158529740 1 --2- 172.21.15.79:0/974132057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560513d8f940 0x560513e07f80 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fb1480aaa00 tx=0x7fb1480ab170 comp rx=0 tx=0).stop 2024-08-20T01:49:44.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.676+0000 7fb158529740 1 -- 172.21.15.79:0/974132057 shutdown_connections 2024-08-20T01:49:44.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.676+0000 7fb158529740 1 --2- 172.21.15.79:0/974132057 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x560513d9f640 0x560513e0bd00 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:44.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.676+0000 7fb158529740 1 --2- 172.21.15.79:0/974132057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560513d8f940 0x560513e07f80 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:44.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.676+0000 7fb12effd640 0 client.18588 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:49:44.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.676+0000 7fb158529740 1 --2- 172.21.15.79:0/974132057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560513d839b0 0x560513da4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:44.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.676+0000 7fb158529740 1 --2- 172.21.15.79:0/974132057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560513d83090 0x560513da4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:44.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.677+0000 7fb158529740 1 -- 172.21.15.79:0/974132057 >> 172.21.15.79:0/974132057 conn(0x560513d80ec0 msgr2=0x560513d9a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:44.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.677+0000 7fb158529740 1 -- 172.21.15.79:0/974132057 shutdown_connections 2024-08-20T01:49:44.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.677+0000 7fb158529740 1 -- 172.21.15.79:0/974132057 wait complete. 2024-08-20T01:49:44.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.678+0000 7fb158529740 20 client.18588 trim_cache size 0 max 16384 2024-08-20T01:49:44.681 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:49:44.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.679+0000 7fb156130640 1 -- 172.21.15.79:0/3867192808 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb1380b3bd0 msgr2=0x7fb1380b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:44.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.679+0000 7fb156130640 1 --2- 172.21.15.79:0/3867192808 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb1380b3bd0 0x7fb1380b6090 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb144006a50 tx=0x7fb1440069e0 comp rx=0 tx=0).stop 2024-08-20T01:49:44.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.679+0000 7fb156130640 1 -- 172.21.15.79:0/3867192808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb15010b040 msgr2=0x7fb1501a0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:44.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.679+0000 7fb156130640 1 --2- 172.21.15.79:0/3867192808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb15010b040 0x7fb1501a0a20 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fb14800efc0 tx=0x7fb14800c800 comp rx=0 tx=0).stop 2024-08-20T01:49:44.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.679+0000 7fb156130640 1 -- 172.21.15.79:0/3867192808 shutdown_connections 2024-08-20T01:49:44.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.679+0000 7fb156130640 1 --2- 172.21.15.79:0/3867192808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb15010b040 0x7fb1501a0a20 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:44.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.679+0000 7fb156130640 1 --2- 172.21.15.79:0/3867192808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb15010a6c0 0x7fb15019b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:44.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.679+0000 7fb156130640 1 --2- 172.21.15.79:0/3867192808 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb1380b3bd0 0x7fb1380b6090 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:44.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.679+0000 7fb156130640 1 --2- 172.21.15.79:0/3867192808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb150104cb0 0x7fb15019b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:44.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.679+0000 7fb156130640 1 -- 172.21.15.79:0/3867192808 >> 172.21.15.79:0/3867192808 conn(0x7fb1501006c0 msgr2=0x7fb150102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:44.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.680+0000 7fb156130640 1 -- 172.21.15.79:0/3867192808 shutdown_connections 2024-08-20T01:49:44.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:44.680+0000 7fb156130640 1 -- 172.21.15.79:0/3867192808 wait complete. 2024-08-20T01:49:45.522 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-20T01:49:45.956 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:49:46.391 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:46 smithi079 ceph-mon[18656]: pgmap v720: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 MiB/s wr, 5.64k op/s 2024-08-20T01:49:46.530 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:46 smithi081 ceph-mon[22209]: pgmap v720: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 MiB/s wr, 5.64k op/s 2024-08-20T01:49:46.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.532+0000 7fdf2e3fd640 1 -- 172.21.15.79:0/1746611056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf28101990 msgr2=0x7fdf28101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:46.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.532+0000 7fdf2e3fd640 1 --2- 172.21.15.79:0/1746611056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf28101990 0x7fdf28101d70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdf1800ba90 tx=0x7fdf1802c160 comp rx=0 tx=0).stop 2024-08-20T01:49:46.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.533+0000 7fdf2e3fd640 1 -- 172.21.15.79:0/1746611056 shutdown_connections 2024-08-20T01:49:46.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.533+0000 7fdf2e3fd640 1 --2- 172.21.15.79:0/1746611056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf28107d20 0x7fdf2810e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:46.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.533+0000 7fdf2e3fd640 1 --2- 172.21.15.79:0/1746611056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf281073a0 0x7fdf281077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:46.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.533+0000 7fdf2e3fd640 1 --2- 172.21.15.79:0/1746611056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf28101990 0x7fdf28101d70 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:46.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.533+0000 7fdf2e3fd640 1 -- 172.21.15.79:0/1746611056 >> 172.21.15.79:0/1746611056 conn(0x7fdf280fd400 msgr2=0x7fdf280ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:46.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.533+0000 7fdf2e3fd640 1 -- 172.21.15.79:0/1746611056 shutdown_connections 2024-08-20T01:49:46.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.533+0000 7fdf2e3fd640 1 -- 172.21.15.79:0/1746611056 wait complete. 2024-08-20T01:49:46.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.534+0000 7fdf2e3fd640 1 Processor -- start 2024-08-20T01:49:46.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.534+0000 7fdf2e3fd640 1 -- start start 2024-08-20T01:49:46.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.534+0000 7fdf2e3fd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf28101990 0x7fdf28074310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:46.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.534+0000 7fdf2e3fd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf281073a0 0x7fdf28074850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:46.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.535+0000 7fdf2e3fd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf28107d20 0x7fdf2806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:46.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.535+0000 7fdf2e3fd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdf281107d0 con 0x7fdf28101990 2024-08-20T01:49:46.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.535+0000 7fdf2e3fd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdf28110650 con 0x7fdf28107d20 2024-08-20T01:49:46.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.535+0000 7fdf2e3fd640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdf28110950 con 0x7fdf281073a0 2024-08-20T01:49:46.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.535+0000 7fdf2c99a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf28107d20 0x7fdf2806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:46.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.535+0000 7fdf277fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf281073a0 0x7fdf28074850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:46.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.535+0000 7fdf2c99a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf28107d20 0x7fdf2806d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:34922/0 (socket says 172.21.15.79:34922) 2024-08-20T01:49:46.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.535+0000 7fdf277fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf281073a0 0x7fdf28074850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:50304/0 (socket says 172.21.15.79:50304) 2024-08-20T01:49:46.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.535+0000 7fdf2c99a640 1 -- 172.21.15.79:0/4070379244 learned_addr learned my addr 172.21.15.79:0/4070379244 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:46.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.535+0000 7fdf27fff640 1 --2- 172.21.15.79:0/4070379244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf28101990 0x7fdf28074310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:46.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.535+0000 7fdf2c99a640 1 -- 172.21.15.79:0/4070379244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf281073a0 msgr2=0x7fdf28074850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:46.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.535+0000 7fdf2c99a640 1 --2- 172.21.15.79:0/4070379244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf281073a0 0x7fdf28074850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:46.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.535+0000 7fdf2c99a640 1 -- 172.21.15.79:0/4070379244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf28101990 msgr2=0x7fdf28074310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:46.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.535+0000 7fdf2c99a640 1 --2- 172.21.15.79:0/4070379244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf28101990 0x7fdf28074310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:46.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.535+0000 7fdf2c99a640 1 -- 172.21.15.79:0/4070379244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf2806de00 con 0x7fdf28107d20 2024-08-20T01:49:46.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.536+0000 7fdf2c99a640 1 --2- 172.21.15.79:0/4070379244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf28107d20 0x7fdf2806d540 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdf2000eaa0 tx=0x7fdf2000ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:46.540 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.537+0000 7fdf257fa640 1 -- 172.21.15.79:0/4070379244 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2000cdb0 con 0x7fdf28107d20 2024-08-20T01:49:46.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.537+0000 7fdf257fa640 1 -- 172.21.15.79:0/4070379244 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdf20005020 con 0x7fdf28107d20 2024-08-20T01:49:46.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.538+0000 7fdf257fa640 1 -- 172.21.15.79:0/4070379244 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf200116d0 con 0x7fdf28107d20 2024-08-20T01:49:46.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.538+0000 7fdf2e3fd640 1 -- 172.21.15.79:0/4070379244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf2806e0f0 con 0x7fdf28107d20 2024-08-20T01:49:46.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.538+0000 7fdf2e3fd640 1 -- 172.21.15.79:0/4070379244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf28072f80 con 0x7fdf28107d20 2024-08-20T01:49:46.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.542+0000 7fdf257fa640 1 -- 172.21.15.79:0/4070379244 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fdf200051d0 con 0x7fdf28107d20 2024-08-20T01:49:46.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.543+0000 7fdf257fa640 1 --2- 172.21.15.79:0/4070379244 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fdf100b8000 0x7fdf100ba4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:46.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.544+0000 7fdf257fa640 1 -- 172.21.15.79:0/4070379244 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fdf200e3f10 con 0x7fdf28107d20 2024-08-20T01:49:46.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.544+0000 7fdf27fff640 1 --2- 172.21.15.79:0/4070379244 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fdf100b8000 0x7fdf100ba4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:46.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.544+0000 7fdf307f6740 1 Processor -- start 2024-08-20T01:49:46.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.544+0000 7fdf307f6740 1 -- start start 2024-08-20T01:49:46.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.544+0000 7fdf27fff640 1 --2- 172.21.15.79:0/4070379244 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fdf100b8000 0x7fdf100ba4c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fdf1802c680 tx=0x7fdf1800b470 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:46.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.544+0000 7fdf307f6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560117c22f40 0x560117c23320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:46.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.544+0000 7fdf307f6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560117c23860 0x560117c1def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:46.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.544+0000 7fdf307f6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560117c1e430 0x560117c1e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:46.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.544+0000 7fdf307f6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560117b91930 con 0x560117c22f40 2024-08-20T01:49:46.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.544+0000 7fdf307f6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560117b80e30 con 0x560117c1e430 2024-08-20T01:49:46.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.544+0000 7fdf307f6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560117b84e70 con 0x560117c23860 2024-08-20T01:49:46.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.544+0000 7fdf27fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560117c22f40 0x560117c23320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:46.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.545+0000 7fdf27fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560117c22f40 0x560117c23320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46776/0 (socket says 172.21.15.79:46776) 2024-08-20T01:49:46.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.545+0000 7fdf27fff640 1 -- 172.21.15.79:0/3346190093 learned_addr learned my addr 172.21.15.79:0/3346190093 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:46.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.545+0000 7fdf277fe640 1 --2- 172.21.15.79:0/3346190093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560117c23860 0x560117c1def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:46.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.545+0000 7fdf27fff640 1 -- 172.21.15.79:0/3346190093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560117c23860 msgr2=0x560117c1def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:46.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.545+0000 7fdf27fff640 1 --2- 172.21.15.79:0/3346190093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560117c23860 0x560117c1def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:46.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.545+0000 7fdf27fff640 1 -- 172.21.15.79:0/3346190093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560117c1e430 msgr2=0x560117c1e8e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:49:46.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.545+0000 7fdf27fff640 1 --2- 172.21.15.79:0/3346190093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560117c1e430 0x560117c1e8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:46.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.545+0000 7fdf27fff640 1 -- 172.21.15.79:0/3346190093 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601178e0650 con 0x560117c22f40 2024-08-20T01:49:46.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.545+0000 7fdf27fff640 1 --2- 172.21.15.79:0/3346190093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560117c22f40 0x560117c23320 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fdf18005c10 tx=0x7fdf1803b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d41ae57b9337f241 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:46.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.546+0000 7fdf0e7fc640 1 -- 172.21.15.79:0/3346190093 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf18045040 con 0x560117c22f40 2024-08-20T01:49:46.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.546+0000 7fdf0e7fc640 1 -- 172.21.15.79:0/3346190093 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdf180044d0 con 0x560117c22f40 2024-08-20T01:49:46.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.546+0000 7fdf0e7fc640 1 -- 172.21.15.79:0/3346190093 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf18005330 con 0x560117c22f40 2024-08-20T01:49:46.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.547+0000 7fdf307f6740 1 -- 172.21.15.79:0/3346190093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560117c22f40 msgr2=0x560117c23320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:46.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.547+0000 7fdf307f6740 1 --2- 172.21.15.79:0/3346190093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560117c22f40 0x560117c23320 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fdf18005c10 tx=0x7fdf1803b000 comp rx=0 tx=0).stop 2024-08-20T01:49:46.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.548+0000 7fdf307f6740 1 -- 172.21.15.79:0/3346190093 shutdown_connections 2024-08-20T01:49:46.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.548+0000 7fdf307f6740 1 --2- 172.21.15.79:0/3346190093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560117c1e430 0x560117c1e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:46.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.548+0000 7fdf307f6740 1 --2- 172.21.15.79:0/3346190093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560117c23860 0x560117c1def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:46.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.548+0000 7fdf307f6740 1 --2- 172.21.15.79:0/3346190093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560117c22f40 0x560117c23320 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:46.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.548+0000 7fdf307f6740 1 -- 172.21.15.79:0/3346190093 >> 172.21.15.79:0/3346190093 conn(0x560117c20d70 msgr2=0x560117c21f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:46.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.548+0000 7fdf307f6740 1 -- 172.21.15.79:0/3346190093 shutdown_connections 2024-08-20T01:49:46.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.548+0000 7fdf307f6740 1 -- 172.21.15.79:0/3346190093 wait complete. 2024-08-20T01:49:46.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.549+0000 7fdf307f6740 1 -- start start 2024-08-20T01:49:46.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.549+0000 7fdf307f6740 1 Processor -- start 2024-08-20T01:49:46.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.549+0000 7fdf307f6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560117c1e430 0x560117c1dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:46.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.550+0000 7fdf307f6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560117c22f40 0x560117c1c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:46.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.550+0000 7fdf307f6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560117c23860 0x560117c1c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:46.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.550+0000 7fdf307f6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5601179e3700 con 0x560117c1e430 2024-08-20T01:49:46.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.550+0000 7fdf307f6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560117b07810 con 0x560117c23860 2024-08-20T01:49:46.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.550+0000 7fdf307f6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560117c1f0c0 con 0x560117c22f40 2024-08-20T01:49:46.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.550+0000 7fdf307f6740 10 client.0 _ll_register_callbacks cb 0x560117b7a700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:49:46.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.550+0000 7fdf27fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560117c1e430 0x560117c1dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:46.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.550+0000 7fdf27fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560117c1e430 0x560117c1dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46786/0 (socket says 172.21.15.79:46786) 2024-08-20T01:49:46.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.550+0000 7fdf27fff640 1 -- 172.21.15.79:0/2319877697 learned_addr learned my addr 172.21.15.79:0/2319877697 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:46.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.550+0000 7fdf2c99a640 1 --2- 172.21.15.79:0/2319877697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560117c23860 0x560117c1c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:46.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.551+0000 7fdf27fff640 1 -- 172.21.15.79:0/2319877697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560117c22f40 msgr2=0x560117c1c1a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:49:46.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.551+0000 7fdf27fff640 1 --2- 172.21.15.79:0/2319877697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560117c22f40 0x560117c1c1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:46.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.551+0000 7fdf27fff640 1 -- 172.21.15.79:0/2319877697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560117c23860 msgr2=0x560117c1c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:46.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.551+0000 7fdf27fff640 1 --2- 172.21.15.79:0/2319877697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560117c23860 0x560117c1c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:46.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.551+0000 7fdf27fff640 1 -- 172.21.15.79:0/2319877697 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560117c442f0 con 0x560117c1e430 2024-08-20T01:49:46.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.552+0000 7fdf27fff640 1 --2- 172.21.15.79:0/2319877697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560117c1e430 0x560117c1dd40 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fdf18034e10 tx=0x7fdf18034e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9e6f75ced5bea5b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:46.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.552+0000 7fdf077fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:49:46.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.552+0000 7fdf077fe640 1 -- 172.21.15.79:0/2319877697 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf18004310 con 0x560117c1e430 2024-08-20T01:49:46.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.552+0000 7fdf307f6740 1 -- 172.21.15.79:0/2319877697 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560117b30150 con 0x560117c1e430 2024-08-20T01:49:46.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.552+0000 7fdf077fe640 1 -- 172.21.15.79:0/2319877697 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fdf180050b0 con 0x560117c1e430 2024-08-20T01:49:46.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.553+0000 7fdf077fe640 1 -- 172.21.15.79:0/2319877697 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fdf180044b0 con 0x560117c1e430 2024-08-20T01:49:46.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.553+0000 7fdf307f6740 10 client.18597 fetch_fsmap learned FSMap version 51 2024-08-20T01:49:46.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.553+0000 7fdf307f6740 1 -- 172.21.15.79:0/2319877697 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x560117c46af0 con 0x560117c1e430 2024-08-20T01:49:46.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.553+0000 7fdf077fe640 1 -- 172.21.15.79:0/2319877697 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdf180046c0 con 0x560117c1e430 2024-08-20T01:49:46.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.554+0000 7fdf077fe640 1 -- 172.21.15.79:0/2319877697 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7fdf18048030 con 0x560117c1e430 2024-08-20T01:49:46.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.555+0000 7fdf307f6740 10 client.18597 fetch_fsmap finished waiting for FSMap version 51 2024-08-20T01:49:46.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.555+0000 7fdf307f6740 10 client.18597 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:49:46.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.555+0000 7fdf307f6740 20 client.18597 populate_metadata read hostname 'smithi079' 2024-08-20T01:49:46.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.555+0000 7fdf307f6740 1 --2- 172.21.15.79:0/2319877697 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x560117c48020 0x560117c4a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:46.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.555+0000 7fdf307f6740 4 client.18597 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:49:46.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.555+0000 7fdf307f6740 1 -- 172.21.15.79:0/2319877697 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560117b30150 con 0x560117c48020 2024-08-20T01:49:46.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.555+0000 7fdf277fe640 1 --2- 172.21.15.79:0/2319877697 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x560117c48020 0x560117c4a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:46.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.556+0000 7fdf277fe640 1 --2- 172.21.15.79:0/2319877697 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x560117c48020 0x560117c4a4c0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8cf2a72fe9b43fff server_cookie=97ac84929fb7b0f8 in_seq=0 out_seq=0 2024-08-20T01:49:46.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.556+0000 7fdf077fe640 10 client.18597 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:49:46.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.557+0000 7fdf077fe640 1 -- 172.21.15.79:0/2319877697 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560117b30150 con 0x560117c48020 2024-08-20T01:49:46.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.557+0000 7fdf077fe640 10 client.18597 handle_command_reply: tid=0 2024-08-20T01:49:46.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.557+0000 7fdf307f6740 1 client.18597 shutdown 2024-08-20T01:49:46.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.557+0000 7fdf307f6740 1 -- 172.21.15.79:0/2319877697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560117c1e430 msgr2=0x560117c1dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:46.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.557+0000 7fdf307f6740 1 --2- 172.21.15.79:0/2319877697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560117c1e430 0x560117c1dd40 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fdf18034e10 tx=0x7fdf18034e40 comp rx=0 tx=0).stop 2024-08-20T01:49:46.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.557+0000 7fdf307f6740 1 -- 172.21.15.79:0/2319877697 shutdown_connections 2024-08-20T01:49:46.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.557+0000 7fdf307f6740 1 --2- 172.21.15.79:0/2319877697 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x560117c48020 0x560117c4a4c0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:46.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.558+0000 7fdf307f6740 1 --2- 172.21.15.79:0/2319877697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560117c23860 0x560117c1c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:46.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.558+0000 7fdf307f6740 1 --2- 172.21.15.79:0/2319877697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560117c22f40 0x560117c1c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:46.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.558+0000 7fdf307f6740 1 --2- 172.21.15.79:0/2319877697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560117c1e430 0x560117c1dd40 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:46.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.558+0000 7fdf307f6740 1 -- 172.21.15.79:0/2319877697 >> 172.21.15.79:0/2319877697 conn(0x560117c20d70 msgr2=0x560117c26910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:46.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.558+0000 7fdf077fe640 0 client.18597 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:49:46.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.558+0000 7fdf307f6740 1 -- 172.21.15.79:0/2319877697 shutdown_connections 2024-08-20T01:49:46.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.558+0000 7fdf307f6740 1 -- 172.21.15.79:0/2319877697 wait complete. 2024-08-20T01:49:46.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.558+0000 7fdf307f6740 20 client.18597 trim_cache size 0 max 16384 2024-08-20T01:49:46.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.582+0000 7fdf307f6740 1 Processor -- start 2024-08-20T01:49:46.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.582+0000 7fdf307f6740 1 -- start start 2024-08-20T01:49:46.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.582+0000 7fdf307f6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560117c1e430 0x560117c24fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:46.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.582+0000 7fdf307f6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560117c22f40 0x560117c254e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:46.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.582+0000 7fdf307f6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560117c23860 0x560117c4fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:46.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.582+0000 7fdf307f6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdf281b3fb0 con 0x560117c23860 2024-08-20T01:49:46.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.582+0000 7fdf307f6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdf281b5af0 con 0x560117c1e430 2024-08-20T01:49:46.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.582+0000 7fdf307f6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdf281b4680 con 0x560117c22f40 2024-08-20T01:49:46.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.582+0000 7fdf2c99a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560117c23860 0x560117c4fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:46.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.582+0000 7fdf2c99a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560117c23860 0x560117c4fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46794/0 (socket says 172.21.15.79:46794) 2024-08-20T01:49:46.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.582+0000 7fdf2c99a640 1 -- 172.21.15.79:0/870846313 learned_addr learned my addr 172.21.15.79:0/870846313 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:46.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.583+0000 7fdf2c99a640 1 -- 172.21.15.79:0/870846313 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560117c22f40 msgr2=0x560117c254e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:46.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.583+0000 7fdf2c99a640 1 --2- 172.21.15.79:0/870846313 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560117c22f40 0x560117c254e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:46.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.583+0000 7fdf2c99a640 1 -- 172.21.15.79:0/870846313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560117c1e430 msgr2=0x560117c24fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:46.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.583+0000 7fdf2c99a640 1 --2- 172.21.15.79:0/870846313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560117c1e430 0x560117c24fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:46.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.583+0000 7fdf2c99a640 1 -- 172.21.15.79:0/870846313 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560117c1a6a0 con 0x560117c23860 2024-08-20T01:49:46.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.583+0000 7fdf2c99a640 1 --2- 172.21.15.79:0/870846313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560117c23860 0x560117c4fdd0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fdf2000efd0 tx=0x7fdf200aaef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f82205a7a2be6b39 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:46.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.583+0000 7fdf0dffb640 1 -- 172.21.15.79:0/870846313 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf200ca070 con 0x560117c23860 2024-08-20T01:49:46.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.584+0000 7fdf0dffb640 1 -- 172.21.15.79:0/870846313 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdf200b3fa0 con 0x560117c23860 2024-08-20T01:49:46.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.584+0000 7fdf0dffb640 1 -- 172.21.15.79:0/870846313 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf200c4070 con 0x560117c23860 2024-08-20T01:49:46.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.584+0000 7fdf307f6740 1 -- 172.21.15.79:0/870846313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560117c23860 msgr2=0x560117c4fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:46.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.584+0000 7fdf307f6740 1 --2- 172.21.15.79:0/870846313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560117c23860 0x560117c4fdd0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fdf2000efd0 tx=0x7fdf200aaef0 comp rx=0 tx=0).stop 2024-08-20T01:49:46.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.584+0000 7fdf307f6740 1 -- 172.21.15.79:0/870846313 shutdown_connections 2024-08-20T01:49:46.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.584+0000 7fdf307f6740 1 --2- 172.21.15.79:0/870846313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560117c23860 0x560117c4fdd0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:46.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.584+0000 7fdf307f6740 1 --2- 172.21.15.79:0/870846313 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560117c22f40 0x560117c254e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:46.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.584+0000 7fdf307f6740 1 --2- 172.21.15.79:0/870846313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560117c1e430 0x560117c24fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:46.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.585+0000 7fdf307f6740 1 -- 172.21.15.79:0/870846313 >> 172.21.15.79:0/870846313 conn(0x560117c20d70 msgr2=0x560117c1aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:46.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.585+0000 7fdf307f6740 1 -- 172.21.15.79:0/870846313 shutdown_connections 2024-08-20T01:49:46.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.585+0000 7fdf307f6740 1 -- 172.21.15.79:0/870846313 wait complete. 2024-08-20T01:49:46.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.585+0000 7fdf307f6740 1 -- start start 2024-08-20T01:49:46.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.586+0000 7fdf307f6740 1 Processor -- start 2024-08-20T01:49:46.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.586+0000 7fdf307f6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560117c1e430 0x560117c3fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:46.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.586+0000 7fdf307f6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560117c22f40 0x560117c3a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:46.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.586+0000 7fdf307f6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560117c23860 0x560117c3aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:46.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.586+0000 7fdf307f6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdf281b5420 con 0x560117c1e430 2024-08-20T01:49:46.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.586+0000 7fdf307f6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdf281b4d50 con 0x560117c22f40 2024-08-20T01:49:46.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.586+0000 7fdf307f6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdf281b2040 con 0x560117c23860 2024-08-20T01:49:46.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.586+0000 7fdf307f6740 10 client.0 _ll_register_callbacks cb 0x7fdf1c0097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:49:46.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.587+0000 7fdf2c99a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560117c23860 0x560117c3aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:46.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.587+0000 7fdf2c99a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560117c23860 0x560117c3aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:50346/0 (socket says 172.21.15.79:50346) 2024-08-20T01:49:46.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.587+0000 7fdf2c99a640 1 -- 172.21.15.79:0/822679129 learned_addr learned my addr 172.21.15.79:0/822679129 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:46.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.587+0000 7fdf27fff640 1 --2- 172.21.15.79:0/822679129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560117c1e430 0x560117c3fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:46.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.587+0000 7fdf277fe640 1 --2- 172.21.15.79:0/822679129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560117c22f40 0x560117c3a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:46.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.587+0000 7fdf2c99a640 1 -- 172.21.15.79:0/822679129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560117c22f40 msgr2=0x560117c3a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:46.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.587+0000 7fdf2c99a640 1 --2- 172.21.15.79:0/822679129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560117c22f40 0x560117c3a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:46.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.587+0000 7fdf2c99a640 1 -- 172.21.15.79:0/822679129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560117c1e430 msgr2=0x560117c3fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:46.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.587+0000 7fdf2c99a640 1 --2- 172.21.15.79:0/822679129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560117c1e430 0x560117c3fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:46.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.587+0000 7fdf2c99a640 1 -- 172.21.15.79:0/822679129 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560117cb0d90 con 0x560117c23860 2024-08-20T01:49:46.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.587+0000 7fdf277fe640 1 --2- 172.21.15.79:0/822679129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560117c22f40 0x560117c3a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:49:46.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.587+0000 7fdf2c99a640 1 --2- 172.21.15.79:0/822679129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560117c23860 0x560117c3aa50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdf200aabf0 tx=0x7fdf200aa380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25cfe97f529625cb server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:46.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.587+0000 7fdf077fe640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:49:46.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.587+0000 7fdf077fe640 1 -- 172.21.15.79:0/822679129 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf200ca070 con 0x560117c23860 2024-08-20T01:49:46.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.588+0000 7fdf077fe640 1 -- 172.21.15.79:0/822679129 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fdf200a6a70 con 0x560117c23860 2024-08-20T01:49:46.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.588+0000 7fdf307f6740 1 -- 172.21.15.79:0/822679129 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560117c1ec70 con 0x560117c23860 2024-08-20T01:49:46.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.588+0000 7fdf077fe640 1 -- 172.21.15.79:0/822679129 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fdf200be050 con 0x560117c23860 2024-08-20T01:49:46.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.588+0000 7fdf307f6740 10 client.27646 fetch_fsmap learned FSMap version 51 2024-08-20T01:49:46.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.588+0000 7fdf307f6740 1 -- 172.21.15.79:0/822679129 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x560117cb2090 con 0x560117c23860 2024-08-20T01:49:46.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.588+0000 7fdf077fe640 1 -- 172.21.15.79:0/822679129 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x560117c1ec70 con 0x560117c23860 2024-08-20T01:49:46.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.588+0000 7fdf077fe640 1 -- 172.21.15.79:0/822679129 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7fdf20088080 con 0x560117c23860 2024-08-20T01:49:46.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.589+0000 7fdf307f6740 10 client.27646 fetch_fsmap finished waiting for FSMap version 51 2024-08-20T01:49:46.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.589+0000 7fdf307f6740 10 client.27646 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:49:46.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.589+0000 7fdf307f6740 20 client.27646 populate_metadata read hostname 'smithi079' 2024-08-20T01:49:46.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.589+0000 7fdf307f6740 1 --2- 172.21.15.79:0/822679129 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x560117cb2700 0x560117cb4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:46.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.589+0000 7fdf307f6740 4 client.27646 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:49:46.594 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.589+0000 7fdf307f6740 1 -- 172.21.15.79:0/822679129 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560117b93880 con 0x560117cb2700 2024-08-20T01:49:46.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.589+0000 7fdf27fff640 1 --2- 172.21.15.79:0/822679129 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x560117cb2700 0x560117cb4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:46.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.590+0000 7fdf27fff640 1 --2- 172.21.15.79:0/822679129 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x560117cb2700 0x560117cb4b20 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c73b33af6292da6f server_cookie=f42634069fae29f3 in_seq=0 out_seq=0 2024-08-20T01:49:46.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.590+0000 7fdf077fe640 10 client.27646 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:49:46.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.590+0000 7fdf077fe640 1 -- 172.21.15.79:0/822679129 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560117b93880 con 0x560117cb2700 2024-08-20T01:49:46.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.590+0000 7fdf077fe640 10 client.27646 handle_command_reply: tid=0 2024-08-20T01:49:46.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.590+0000 7fdf307f6740 1 client.27646 shutdown 2024-08-20T01:49:46.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.591+0000 7fdf307f6740 1 -- 172.21.15.79:0/822679129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560117c23860 msgr2=0x560117c3aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:46.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.591+0000 7fdf307f6740 1 --2- 172.21.15.79:0/822679129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560117c23860 0x560117c3aa50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdf200aabf0 tx=0x7fdf200aa380 comp rx=0 tx=0).stop 2024-08-20T01:49:46.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.591+0000 7fdf307f6740 1 -- 172.21.15.79:0/822679129 shutdown_connections 2024-08-20T01:49:46.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.591+0000 7fdf307f6740 1 --2- 172.21.15.79:0/822679129 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x560117cb2700 0x560117cb4b20 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:46.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.591+0000 7fdf307f6740 1 --2- 172.21.15.79:0/822679129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560117c23860 0x560117c3aa50 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:46.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.591+0000 7fdf307f6740 1 --2- 172.21.15.79:0/822679129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560117c22f40 0x560117c3a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:46.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.591+0000 7fdf077fe640 0 client.27646 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:49:46.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.591+0000 7fdf307f6740 1 --2- 172.21.15.79:0/822679129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560117c1e430 0x560117c3fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:46.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.591+0000 7fdf307f6740 1 -- 172.21.15.79:0/822679129 >> 172.21.15.79:0/822679129 conn(0x560117c20d70 msgr2=0x560117c260f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:46.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.591+0000 7fdf307f6740 1 -- 172.21.15.79:0/822679129 shutdown_connections 2024-08-20T01:49:46.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.591+0000 7fdf307f6740 1 -- 172.21.15.79:0/822679129 wait complete. 2024-08-20T01:49:46.596 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:49:46.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.591+0000 7fdf307f6740 20 client.27646 trim_cache size 0 max 16384 2024-08-20T01:49:46.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.594+0000 7fdf2e3fd640 1 -- 172.21.15.79:0/4070379244 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fdf100b8000 msgr2=0x7fdf100ba4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:46.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.594+0000 7fdf2e3fd640 1 --2- 172.21.15.79:0/4070379244 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fdf100b8000 0x7fdf100ba4c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fdf1802c680 tx=0x7fdf1800b470 comp rx=0 tx=0).stop 2024-08-20T01:49:46.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.594+0000 7fdf2e3fd640 1 -- 172.21.15.79:0/4070379244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf28107d20 msgr2=0x7fdf2806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:46.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.594+0000 7fdf2e3fd640 1 --2- 172.21.15.79:0/4070379244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf28107d20 0x7fdf2806d540 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdf2000eaa0 tx=0x7fdf2000ef60 comp rx=0 tx=0).stop 2024-08-20T01:49:46.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.595+0000 7fdf2e3fd640 1 -- 172.21.15.79:0/4070379244 shutdown_connections 2024-08-20T01:49:46.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.595+0000 7fdf2e3fd640 1 --2- 172.21.15.79:0/4070379244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf28107d20 0x7fdf2806d540 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:46.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.595+0000 7fdf2e3fd640 1 --2- 172.21.15.79:0/4070379244 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fdf100b8000 0x7fdf100ba4c0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:46.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.595+0000 7fdf2e3fd640 1 --2- 172.21.15.79:0/4070379244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf281073a0 0x7fdf28074850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:46.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.596+0000 7fdf2e3fd640 1 --2- 172.21.15.79:0/4070379244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf28101990 0x7fdf28074310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:46.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.596+0000 7fdf2e3fd640 1 -- 172.21.15.79:0/4070379244 >> 172.21.15.79:0/4070379244 conn(0x7fdf280fd400 msgr2=0x7fdf28105a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:46.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.600+0000 7fdf2e3fd640 1 -- 172.21.15.79:0/4070379244 shutdown_connections 2024-08-20T01:49:46.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:46.600+0000 7fdf2e3fd640 1 -- 172.21.15.79:0/4070379244 wait complete. 2024-08-20T01:49:46.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:46 smithi175 ceph-mon[22392]: pgmap v720: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 MiB/s wr, 5.64k op/s 2024-08-20T01:49:48.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:48 smithi081 ceph-mon[22209]: pgmap v721: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 MiB/s wr, 5.88k op/s 2024-08-20T01:49:48.642 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:48 smithi175 ceph-mon[22392]: pgmap v721: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 MiB/s wr, 5.88k op/s 2024-08-20T01:49:48.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:48 smithi079 ceph-mon[18656]: pgmap v721: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 MiB/s wr, 5.88k op/s 2024-08-20T01:49:48.791 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T01:49:49.214 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:49:49.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.817+0000 7f5b32ffd640 1 -- 172.21.15.79:0/2647127015 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b24030910 con 0x7f5b341038f0 2024-08-20T01:49:49.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.817+0000 7f5b3a2dc640 1 -- 172.21.15.79:0/2647127015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b341038f0 msgr2=0x7f5b34103d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:49.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.817+0000 7f5b3a2dc640 1 --2- 172.21.15.79:0/2647127015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b341038f0 0x7f5b34103d50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5b2400aa10 tx=0x7f5b2402b720 comp rx=0 tx=0).stop 2024-08-20T01:49:49.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.818+0000 7f5b3a2dc640 1 -- 172.21.15.79:0/2647127015 shutdown_connections 2024-08-20T01:49:49.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.818+0000 7f5b3a2dc640 1 --2- 172.21.15.79:0/2647127015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b34104290 0x7f5b3410dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:49.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.818+0000 7f5b3a2dc640 1 --2- 172.21.15.79:0/2647127015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b341038f0 0x7f5b34103d50 secure :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5b2400aa10 tx=0x7f5b2402b720 comp rx=0 tx=0).stop 2024-08-20T01:49:49.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.818+0000 7f5b3a2dc640 1 --2- 172.21.15.79:0/2647127015 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b34101590 0x7f5b34101970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:49.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.818+0000 7f5b3a2dc640 1 -- 172.21.15.79:0/2647127015 >> 172.21.15.79:0/2647127015 conn(0x7f5b34076bd0 msgr2=0x7f5b34076fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:49.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.818+0000 7f5b3a2dc640 1 -- 172.21.15.79:0/2647127015 shutdown_connections 2024-08-20T01:49:49.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.818+0000 7f5b3a2dc640 1 -- 172.21.15.79:0/2647127015 wait complete. 2024-08-20T01:49:49.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.819+0000 7f5b3a2dc640 1 Processor -- start 2024-08-20T01:49:49.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.819+0000 7f5b3a2dc640 1 -- start start 2024-08-20T01:49:49.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.819+0000 7f5b3a2dc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b34101590 0x7f5b3410dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:49.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.820+0000 7f5b3a2dc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b34104290 0x7f5b34109ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:49.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.820+0000 7f5b3a2dc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b3410a5f0 0x7f5b341abab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:49.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.820+0000 7f5b3a2dc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5b34110310 con 0x7f5b3410a5f0 2024-08-20T01:49:49.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.820+0000 7f5b33fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b34101590 0x7f5b3410dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:49.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.820+0000 7f5b3a2dc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5b34110190 con 0x7f5b34101590 2024-08-20T01:49:49.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.820+0000 7f5b3a2dc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5b34110490 con 0x7f5b34104290 2024-08-20T01:49:49.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.820+0000 7f5b33fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b34101590 0x7f5b3410dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:34972/0 (socket says 172.21.15.79:34972) 2024-08-20T01:49:49.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.820+0000 7f5b33fff640 1 -- 172.21.15.79:0/281967129 learned_addr learned my addr 172.21.15.79:0/281967129 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:49.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.820+0000 7f5b337fe640 1 --2- 172.21.15.79:0/281967129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b34104290 0x7f5b34109ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:49.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.820+0000 7f5b38879640 1 --2- 172.21.15.79:0/281967129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b3410a5f0 0x7f5b341abab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:49.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.820+0000 7f5b33fff640 1 -- 172.21.15.79:0/281967129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b34104290 msgr2=0x7f5b34109ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:49.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.820+0000 7f5b33fff640 1 --2- 172.21.15.79:0/281967129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b34104290 0x7f5b34109ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:49.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.820+0000 7f5b33fff640 1 -- 172.21.15.79:0/281967129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b3410a5f0 msgr2=0x7f5b341abab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:49.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.820+0000 7f5b33fff640 1 --2- 172.21.15.79:0/281967129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b3410a5f0 0x7f5b341abab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:49.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.820+0000 7f5b33fff640 1 -- 172.21.15.79:0/281967129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b341abff0 con 0x7f5b34101590 2024-08-20T01:49:49.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.821+0000 7f5b33fff640 1 --2- 172.21.15.79:0/281967129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b34101590 0x7f5b3410dc90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5b2800b4a0 tx=0x7f5b2800b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:49.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.821+0000 7f5b38879640 1 --2- 172.21.15.79:0/281967129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b3410a5f0 0x7f5b341abab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:49:49.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.821+0000 7f5b317fa640 1 -- 172.21.15.79:0/281967129 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b28014070 con 0x7f5b34101590 2024-08-20T01:49:49.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.821+0000 7f5b317fa640 1 -- 172.21.15.79:0/281967129 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b28010aa0 con 0x7f5b34101590 2024-08-20T01:49:49.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.821+0000 7f5b3a2dc640 1 -- 172.21.15.79:0/281967129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b341ac1c0 con 0x7f5b34101590 2024-08-20T01:49:49.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.821+0000 7f5b3a2dc640 1 -- 172.21.15.79:0/281967129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b341ac6d0 con 0x7f5b34101590 2024-08-20T01:49:49.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.821+0000 7f5b317fa640 1 -- 172.21.15.79:0/281967129 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b28014070 con 0x7f5b34101590 2024-08-20T01:49:49.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.826+0000 7f5b3c6d5740 1 Processor -- start 2024-08-20T01:49:49.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.826+0000 7f5b3c6d5740 1 -- start start 2024-08-20T01:49:49.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.826+0000 7f5b317fa640 1 -- 172.21.15.79:0/281967129 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5b28017070 con 0x7f5b34101590 2024-08-20T01:49:49.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.827+0000 7f5b317fa640 1 --2- 172.21.15.79:0/281967129 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5b1c0b4010 0x7f5b1c0b64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:49.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.827+0000 7f5b317fa640 1 -- 172.21.15.79:0/281967129 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f5b2800d040 con 0x7f5b34101590 2024-08-20T01:49:49.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.828+0000 7f5b3c6d5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e5876b880 0x555e5876bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:49.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.829+0000 7f5b3c6d5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e5876c1a0 0x555e58777bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:49.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.829+0000 7f5b3c6d5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e58778130 0x555e5877a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:49.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.829+0000 7f5b33fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e5876b880 0x555e5876bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:49.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.829+0000 7f5b38879640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e58778130 0x555e5877a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:49.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.829+0000 7f5b38879640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e58778130 0x555e5877a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:50382/0 (socket says 172.21.15.79:50382) 2024-08-20T01:49:49.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.829+0000 7f5b38879640 1 -- 172.21.15.79:0/2183094457 learned_addr learned my addr 172.21.15.79:0/2183094457 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:49.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.829+0000 7f5b3c6d5740 1 -- 172.21.15.79:0/2183094457 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555e586e2930 con 0x555e5876c1a0 2024-08-20T01:49:49.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.829+0000 7f5b337fe640 1 --2- 172.21.15.79:0/2183094457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e5876c1a0 0x555e58777bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:49.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.829+0000 7f5b3c6d5740 1 -- 172.21.15.79:0/2183094457 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555e586d1e30 con 0x555e5876b880 2024-08-20T01:49:49.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.829+0000 7f5b3c6d5740 1 -- 172.21.15.79:0/2183094457 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555e586d5e70 con 0x555e58778130 2024-08-20T01:49:49.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.829+0000 7f5b33fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e5876b880 0x555e5876bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:34986/0 (socket says 172.21.15.79:34986) 2024-08-20T01:49:49.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.830+0000 7f5b38879640 1 -- 172.21.15.79:0/2183094457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e5876b880 msgr2=0x555e5876bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:49.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.830+0000 7f5b38879640 1 --2- 172.21.15.79:0/2183094457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e5876b880 0x555e5876bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:49.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.830+0000 7f5b38879640 1 -- 172.21.15.79:0/2183094457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e5876c1a0 msgr2=0x555e58777bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:49.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.830+0000 7f5b38879640 1 --2- 172.21.15.79:0/2183094457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e5876c1a0 0x555e58777bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:49.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.830+0000 7f5b38879640 1 -- 172.21.15.79:0/2183094457 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e58431650 con 0x555e58778130 2024-08-20T01:49:49.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.830+0000 7f5b38879640 1 --2- 172.21.15.79:0/281967129 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5b1c0b4010 0x7f5b1c0b64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:49.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.830+0000 7f5b38879640 1 --2- 172.21.15.79:0/2183094457 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e58778130 0x555e5877a520 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c00a4e0 tx=0x7f5b2c00a9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1ee7e23f980acb4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:49.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.831+0000 7f5b1a7fc640 1 -- 172.21.15.79:0/2183094457 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c00f660 con 0x555e58778130 2024-08-20T01:49:49.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.831+0000 7f5b38879640 1 --2- 172.21.15.79:0/281967129 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5b1c0b4010 0x7f5b1c0b64d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c01f000 tx=0x7f5b2c01c000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:49.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.831+0000 7f5b1a7fc640 1 -- 172.21.15.79:0/2183094457 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b2c00fc90 con 0x555e58778130 2024-08-20T01:49:49.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.832+0000 7f5b3c6d5740 1 -- 172.21.15.79:0/2183094457 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e58778130 msgr2=0x555e5877a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:49.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.832+0000 7f5b3c6d5740 1 --2- 172.21.15.79:0/2183094457 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e58778130 0x555e5877a520 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c00a4e0 tx=0x7f5b2c00a9a0 comp rx=0 tx=0).stop 2024-08-20T01:49:49.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.833+0000 7f5b3c6d5740 1 -- 172.21.15.79:0/2183094457 shutdown_connections 2024-08-20T01:49:49.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.833+0000 7f5b3c6d5740 1 --2- 172.21.15.79:0/2183094457 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e58778130 0x555e5877a520 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:49.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.833+0000 7f5b3c6d5740 1 --2- 172.21.15.79:0/2183094457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e5876c1a0 0x555e58777bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:49.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.833+0000 7f5b3c6d5740 1 --2- 172.21.15.79:0/2183094457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e5876b880 0x555e5876bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:49.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.833+0000 7f5b3c6d5740 1 -- 172.21.15.79:0/2183094457 >> 172.21.15.79:0/2183094457 conn(0x555e587696b0 msgr2=0x555e5876a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:49.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.833+0000 7f5b3c6d5740 1 -- 172.21.15.79:0/2183094457 shutdown_connections 2024-08-20T01:49:49.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.833+0000 7f5b3c6d5740 1 -- 172.21.15.79:0/2183094457 wait complete. 2024-08-20T01:49:49.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.834+0000 7f5b3c6d5740 1 -- start start 2024-08-20T01:49:49.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.835+0000 7f5b3c6d5740 1 Processor -- start 2024-08-20T01:49:49.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.835+0000 7f5b3c6d5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e5876b880 0x555e58777b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:49.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.836+0000 7f5b3c6d5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e5876c1a0 0x555e58774fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:49.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.836+0000 7f5b3c6d5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e58778130 0x555e58775760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:49.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.836+0000 7f5b3c6d5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555e58534700 con 0x555e58778130 2024-08-20T01:49:49.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.836+0000 7f5b3c6d5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555e58658810 con 0x555e5876b880 2024-08-20T01:49:49.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.836+0000 7f5b3c6d5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555e5877ae80 con 0x555e5876c1a0 2024-08-20T01:49:49.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.836+0000 7f5b3c6d5740 10 client.0 _ll_register_callbacks cb 0x555e586cb700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:49:49.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.836+0000 7f5b33fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e5876b880 0x555e58777b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:49.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.836+0000 7f5b33fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e5876b880 0x555e58777b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:34992/0 (socket says 172.21.15.79:34992) 2024-08-20T01:49:49.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.836+0000 7f5b33fff640 1 -- 172.21.15.79:0/2640537911 learned_addr learned my addr 172.21.15.79:0/2640537911 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:49.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.836+0000 7f5b337fe640 1 --2- 172.21.15.79:0/2640537911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e5876c1a0 0x555e58774fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:49.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.836+0000 7f5b38879640 1 --2- 172.21.15.79:0/2640537911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e58778130 0x555e58775760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:49.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.837+0000 7f5b38879640 1 -- 172.21.15.79:0/2640537911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e5876c1a0 msgr2=0x555e58774fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:49.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.837+0000 7f5b38879640 1 --2- 172.21.15.79:0/2640537911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e5876c1a0 0x555e58774fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:49.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.837+0000 7f5b38879640 1 -- 172.21.15.79:0/2640537911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e5876b880 msgr2=0x555e58777b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:49.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.837+0000 7f5b38879640 1 --2- 172.21.15.79:0/2640537911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e5876b880 0x555e58777b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:49.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.837+0000 7f5b38879640 1 -- 172.21.15.79:0/2640537911 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e58784200 con 0x555e58778130 2024-08-20T01:49:49.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.837+0000 7f5b38879640 1 --2- 172.21.15.79:0/2640537911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e58778130 0x555e58775760 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c019010 tx=0x7f5b2c0096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd6d46fbececec76 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:49.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.837+0000 7f5b137fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:49:49.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.837+0000 7f5b137fe640 1 -- 172.21.15.79:0/2640537911 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c031070 con 0x555e58778130 2024-08-20T01:49:49.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.838+0000 7f5b3c6d5740 1 -- 172.21.15.79:0/2640537911 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555e58681150 con 0x555e58778130 2024-08-20T01:49:49.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.838+0000 7f5b137fe640 1 -- 172.21.15.79:0/2640537911 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f5b2c02c850 con 0x555e58778130 2024-08-20T01:49:49.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.838+0000 7f5b337fe640 1 --2- 172.21.15.79:0/2640537911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e5876c1a0 0x555e58774fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:49:49.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.838+0000 7f5b137fe640 1 -- 172.21.15.79:0/2640537911 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f5b2c03d050 con 0x555e58778130 2024-08-20T01:49:49.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.838+0000 7f5b3c6d5740 10 client.18612 fetch_fsmap learned FSMap version 51 2024-08-20T01:49:49.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.838+0000 7f5b3c6d5740 1 -- 172.21.15.79:0/2640537911 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x555e58786b30 con 0x555e58778130 2024-08-20T01:49:49.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.838+0000 7f5b137fe640 1 -- 172.21.15.79:0/2640537911 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b2c009c70 con 0x555e58778130 2024-08-20T01:49:49.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.838+0000 7f5b137fe640 1 -- 172.21.15.79:0/2640537911 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7f5b2c016030 con 0x555e58778130 2024-08-20T01:49:49.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.839+0000 7f5b3c6d5740 10 client.18612 fetch_fsmap finished waiting for FSMap version 51 2024-08-20T01:49:49.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.839+0000 7f5b3c6d5740 10 client.18612 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:49:49.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.839+0000 7f5b3c6d5740 20 client.18612 populate_metadata read hostname 'smithi079' 2024-08-20T01:49:49.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.839+0000 7f5b3c6d5740 1 --2- 172.21.15.79:0/2640537911 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x555e58788170 0x555e5878a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:49.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.839+0000 7f5b3c6d5740 4 client.18612 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:49:49.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.839+0000 7f5b3c6d5740 1 -- 172.21.15.79:0/2640537911 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555e58681150 con 0x555e58788170 2024-08-20T01:49:49.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.840+0000 7f5b33fff640 1 --2- 172.21.15.79:0/2640537911 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x555e58788170 0x555e5878a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:49.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.840+0000 7f5b137fe640 10 client.18612 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:49:49.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.840+0000 7f5b33fff640 1 --2- 172.21.15.79:0/2640537911 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x555e58788170 0x555e5878a600 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f0d9f02f24eb43c6 server_cookie=6702b142277db4fc in_seq=0 out_seq=0 2024-08-20T01:49:49.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.841+0000 7f5b137fe640 1 -- 172.21.15.79:0/2640537911 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555e58681150 con 0x555e58788170 2024-08-20T01:49:49.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.841+0000 7f5b137fe640 10 client.18612 handle_command_reply: tid=0 2024-08-20T01:49:49.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.841+0000 7f5b3c6d5740 1 client.18612 shutdown 2024-08-20T01:49:49.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.842+0000 7f5b3c6d5740 1 -- 172.21.15.79:0/2640537911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e58778130 msgr2=0x555e58775760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:49.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.842+0000 7f5b3c6d5740 1 --2- 172.21.15.79:0/2640537911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e58778130 0x555e58775760 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c019010 tx=0x7f5b2c0096c0 comp rx=0 tx=0).stop 2024-08-20T01:49:49.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.842+0000 7f5b3c6d5740 1 -- 172.21.15.79:0/2640537911 shutdown_connections 2024-08-20T01:49:49.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.842+0000 7f5b3c6d5740 1 --2- 172.21.15.79:0/2640537911 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x555e58788170 0x555e5878a600 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:49.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.842+0000 7f5b3c6d5740 1 --2- 172.21.15.79:0/2640537911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e58778130 0x555e58775760 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:49.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.842+0000 7f5b3c6d5740 1 --2- 172.21.15.79:0/2640537911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e5876c1a0 0x555e58774fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:49.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.842+0000 7f5b3c6d5740 1 --2- 172.21.15.79:0/2640537911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e5876b880 0x555e58777b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:49.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.842+0000 7f5b137fe640 0 client.18612 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:49:49.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.842+0000 7f5b3c6d5740 1 -- 172.21.15.79:0/2640537911 >> 172.21.15.79:0/2640537911 conn(0x555e587696b0 msgr2=0x555e5876f220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:49.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.842+0000 7f5b3c6d5740 1 -- 172.21.15.79:0/2640537911 shutdown_connections 2024-08-20T01:49:49.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.843+0000 7f5b3c6d5740 1 -- 172.21.15.79:0/2640537911 wait complete. 2024-08-20T01:49:49.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.843+0000 7f5b3c6d5740 20 client.18612 trim_cache size 0 max 16384 2024-08-20T01:49:49.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.867+0000 7f5b3c6d5740 1 Processor -- start 2024-08-20T01:49:49.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.867+0000 7f5b3c6d5740 1 -- start start 2024-08-20T01:49:49.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.867+0000 7f5b3c6d5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e5876b880 0x555e5878fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:49.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.868+0000 7f5b3c6d5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e5876c1a0 0x555e58790420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:49.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.868+0000 7f5b33fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e5876b880 0x555e5878fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:49.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.868+0000 7f5b33fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e5876b880 0x555e5878fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46850/0 (socket says 172.21.15.79:46850) 2024-08-20T01:49:49.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.868+0000 7f5b33fff640 1 -- 172.21.15.79:0/2373624725 learned_addr learned my addr 172.21.15.79:0/2373624725 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:49.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.868+0000 7f5b3c6d5740 1 --2- 172.21.15.79:0/2373624725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e58778130 0x555e58776600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:49.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.868+0000 7f5b3c6d5740 1 -- 172.21.15.79:0/2373624725 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5b341b4ec0 con 0x555e5876b880 2024-08-20T01:49:49.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.868+0000 7f5b3c6d5740 1 -- 172.21.15.79:0/2373624725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5b341b6a00 con 0x555e58778130 2024-08-20T01:49:49.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.868+0000 7f5b3c6d5740 1 -- 172.21.15.79:0/2373624725 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5b341b5590 con 0x555e5876c1a0 2024-08-20T01:49:49.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.868+0000 7f5b38879640 1 --2- 172.21.15.79:0/2373624725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e58778130 0x555e58776600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:49.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.868+0000 7f5b33fff640 1 -- 172.21.15.79:0/2373624725 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e5876c1a0 msgr2=0x555e58790420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:49:49.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.868+0000 7f5b33fff640 1 --2- 172.21.15.79:0/2373624725 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e5876c1a0 0x555e58790420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:49.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.868+0000 7f5b33fff640 1 -- 172.21.15.79:0/2373624725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e58778130 msgr2=0x555e58776600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:49.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.869+0000 7f5b33fff640 1 --2- 172.21.15.79:0/2373624725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e58778130 0x555e58776600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:49.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.869+0000 7f5b33fff640 1 -- 172.21.15.79:0/2373624725 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e58777ef0 con 0x555e5876b880 2024-08-20T01:49:49.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.869+0000 7f5b38879640 1 --2- 172.21.15.79:0/2373624725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e58778130 0x555e58776600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:49:49.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.869+0000 7f5b33fff640 1 --2- 172.21.15.79:0/2373624725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e5876b880 0x555e5878fee0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f5b280e0530 tx=0x7f5b280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14c7f071d1d62dec server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:49.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.869+0000 7f5b19ffb640 1 -- 172.21.15.79:0/2373624725 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b2801e040 con 0x555e5876b880 2024-08-20T01:49:49.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.869+0000 7f5b19ffb640 1 -- 172.21.15.79:0/2373624725 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b280a9930 con 0x555e5876b880 2024-08-20T01:49:49.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.869+0000 7f5b19ffb640 1 -- 172.21.15.79:0/2373624725 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b280a5bc0 con 0x555e5876b880 2024-08-20T01:49:49.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.870+0000 7f5b3c6d5740 1 -- 172.21.15.79:0/2373624725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e5876b880 msgr2=0x555e5878fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:49.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.870+0000 7f5b3c6d5740 1 --2- 172.21.15.79:0/2373624725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e5876b880 0x555e5878fee0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f5b280e0530 tx=0x7f5b280046c0 comp rx=0 tx=0).stop 2024-08-20T01:49:49.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.872+0000 7f5b3c6d5740 1 -- 172.21.15.79:0/2373624725 shutdown_connections 2024-08-20T01:49:49.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.872+0000 7f5b3c6d5740 1 --2- 172.21.15.79:0/2373624725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e58778130 0x555e58776600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:49.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.872+0000 7f5b3c6d5740 1 --2- 172.21.15.79:0/2373624725 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e5876c1a0 0x555e58790420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:49.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.872+0000 7f5b3c6d5740 1 --2- 172.21.15.79:0/2373624725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e5876b880 0x555e5878fee0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:49.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.872+0000 7f5b3c6d5740 1 -- 172.21.15.79:0/2373624725 >> 172.21.15.79:0/2373624725 conn(0x555e587696b0 msgr2=0x555e58773850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:49.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.872+0000 7f5b3c6d5740 1 -- 172.21.15.79:0/2373624725 shutdown_connections 2024-08-20T01:49:49.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.872+0000 7f5b3c6d5740 1 -- 172.21.15.79:0/2373624725 wait complete. 2024-08-20T01:49:49.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.872+0000 7f5b3c6d5740 1 -- start start 2024-08-20T01:49:49.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.873+0000 7f5b3c6d5740 1 Processor -- start 2024-08-20T01:49:49.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.873+0000 7f5b3c6d5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e5876b880 0x555e587713b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:49.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.874+0000 7f5b3c6d5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e5876c1a0 0x555e58771910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:49.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.874+0000 7f5b3c6d5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e58778130 0x555e58780160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:49.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.874+0000 7f5b337fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e5876c1a0 0x555e58771910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:49.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.874+0000 7f5b337fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e5876c1a0 0x555e58771910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:50388/0 (socket says 172.21.15.79:50388) 2024-08-20T01:49:49.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.874+0000 7f5b337fe640 1 -- 172.21.15.79:0/3419892402 learned_addr learned my addr 172.21.15.79:0/3419892402 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:49.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.874+0000 7f5b38879640 1 --2- 172.21.15.79:0/3419892402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e58778130 0x555e58780160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:49.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.874+0000 7f5b3c6d5740 1 -- 172.21.15.79:0/3419892402 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5b341b6330 con 0x555e58778130 2024-08-20T01:49:49.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.874+0000 7f5b3c6d5740 1 -- 172.21.15.79:0/3419892402 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5b341b5c60 con 0x555e5876b880 2024-08-20T01:49:49.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.874+0000 7f5b3c6d5740 1 -- 172.21.15.79:0/3419892402 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5b341b2ea0 con 0x555e5876c1a0 2024-08-20T01:49:49.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.875+0000 7f5b3c6d5740 10 client.0 _ll_register_callbacks cb 0x7f5b2400a670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:49:49.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.875+0000 7f5b337fe640 1 -- 172.21.15.79:0/3419892402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e5876b880 msgr2=0x555e587713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:49.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.875+0000 7f5b337fe640 1 --2- 172.21.15.79:0/3419892402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e5876b880 0x555e587713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:49.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.875+0000 7f5b337fe640 1 -- 172.21.15.79:0/3419892402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e58778130 msgr2=0x555e58780160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:49.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.875+0000 7f5b337fe640 1 --2- 172.21.15.79:0/3419892402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e58778130 0x555e58780160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:49.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.875+0000 7f5b337fe640 1 -- 172.21.15.79:0/3419892402 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e5876bfd0 con 0x555e5876c1a0 2024-08-20T01:49:49.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.876+0000 7f5b337fe640 1 --2- 172.21.15.79:0/3419892402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e5876c1a0 0x555e58771910 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5b2402bc90 tx=0x7f5b24003a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96b28f01eecdc2b3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:49.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.876+0000 7f5b137fe640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:49:49.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.876+0000 7f5b137fe640 1 -- 172.21.15.79:0/3419892402 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b24036040 con 0x555e5876c1a0 2024-08-20T01:49:49.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.876+0000 7f5b137fe640 1 -- 172.21.15.79:0/3419892402 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f5b24030510 con 0x555e5876c1a0 2024-08-20T01:49:49.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.876+0000 7f5b3c6d5740 1 -- 172.21.15.79:0/3419892402 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b280a9930 con 0x555e5876c1a0 2024-08-20T01:49:49.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.876+0000 7f5b137fe640 1 -- 172.21.15.79:0/3419892402 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f5b24030710 con 0x555e5876c1a0 2024-08-20T01:49:49.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.877+0000 7f5b3c6d5740 10 client.27658 fetch_fsmap learned FSMap version 51 2024-08-20T01:49:49.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.877+0000 7f5b3c6d5740 1 -- 172.21.15.79:0/3419892402 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x555e587f1830 con 0x555e5876c1a0 2024-08-20T01:49:49.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.877+0000 7f5b137fe640 1 -- 172.21.15.79:0/3419892402 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b24030d40 con 0x555e5876c1a0 2024-08-20T01:49:49.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.878+0000 7f5b137fe640 1 -- 172.21.15.79:0/3419892402 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7f5b24046020 con 0x555e5876c1a0 2024-08-20T01:49:49.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.879+0000 7f5b3c6d5740 10 client.27658 fetch_fsmap finished waiting for FSMap version 51 2024-08-20T01:49:49.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.879+0000 7f5b3c6d5740 10 client.27658 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:49:49.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.879+0000 7f5b3c6d5740 20 client.27658 populate_metadata read hostname 'smithi079' 2024-08-20T01:49:49.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.879+0000 7f5b3c6d5740 1 --2- 172.21.15.79:0/3419892402 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x555e587f1fb0 0x555e587f43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:49.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.879+0000 7f5b3c6d5740 4 client.27658 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:49:49.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.879+0000 7f5b3c6d5740 1 -- 172.21.15.79:0/3419892402 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f5b280a9930 con 0x555e587f1fb0 2024-08-20T01:49:49.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.879+0000 7f5b33fff640 1 --2- 172.21.15.79:0/3419892402 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x555e587f1fb0 0x555e587f43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:49.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.881+0000 7f5b33fff640 1 --2- 172.21.15.79:0/3419892402 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x555e587f1fb0 0x555e587f43d0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1495054d34ca87ab server_cookie=962f9ef3481cf27c in_seq=0 out_seq=0 2024-08-20T01:49:49.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.881+0000 7f5b137fe640 10 client.27658 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:49:49.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.881+0000 7f5b137fe640 1 -- 172.21.15.79:0/3419892402 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f5b280a9930 con 0x555e587f1fb0 2024-08-20T01:49:49.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.881+0000 7f5b137fe640 10 client.27658 handle_command_reply: tid=0 2024-08-20T01:49:49.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.881+0000 7f5b3c6d5740 1 client.27658 shutdown 2024-08-20T01:49:49.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.881+0000 7f5b3c6d5740 1 -- 172.21.15.79:0/3419892402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e5876c1a0 msgr2=0x555e58771910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:49.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.882+0000 7f5b3c6d5740 1 --2- 172.21.15.79:0/3419892402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e5876c1a0 0x555e58771910 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5b2402bc90 tx=0x7f5b24003a30 comp rx=0 tx=0).stop 2024-08-20T01:49:49.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.882+0000 7f5b3c6d5740 1 -- 172.21.15.79:0/3419892402 shutdown_connections 2024-08-20T01:49:49.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.882+0000 7f5b3c6d5740 1 --2- 172.21.15.79:0/3419892402 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x555e587f1fb0 0x555e587f43d0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:49.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.882+0000 7f5b3c6d5740 1 --2- 172.21.15.79:0/3419892402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e58778130 0x555e58780160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:49.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.882+0000 7f5b3c6d5740 1 --2- 172.21.15.79:0/3419892402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555e5876c1a0 0x555e58771910 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:49.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.882+0000 7f5b3c6d5740 1 --2- 172.21.15.79:0/3419892402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e5876b880 0x555e587713b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:49.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.882+0000 7f5b3c6d5740 1 -- 172.21.15.79:0/3419892402 >> 172.21.15.79:0/3419892402 conn(0x555e587696b0 msgr2=0x555e58776600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:49.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.882+0000 7f5b137fe640 0 client.27658 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:49:49.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.882+0000 7f5b3c6d5740 1 -- 172.21.15.79:0/3419892402 shutdown_connections 2024-08-20T01:49:49.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.882+0000 7f5b3c6d5740 1 -- 172.21.15.79:0/3419892402 wait complete. 2024-08-20T01:49:49.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.882+0000 7f5b3c6d5740 20 client.27658 trim_cache size 0 max 16384 2024-08-20T01:49:49.886 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:49:49.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.884+0000 7f5b3a2dc640 1 -- 172.21.15.79:0/281967129 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5b1c0b4010 msgr2=0x7f5b1c0b64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:49.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.884+0000 7f5b3a2dc640 1 --2- 172.21.15.79:0/281967129 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5b1c0b4010 0x7f5b1c0b64d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c01f000 tx=0x7f5b2c01c000 comp rx=0 tx=0).stop 2024-08-20T01:49:49.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.884+0000 7f5b3a2dc640 1 -- 172.21.15.79:0/281967129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b34101590 msgr2=0x7f5b3410dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:49.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.884+0000 7f5b3a2dc640 1 --2- 172.21.15.79:0/281967129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b34101590 0x7f5b3410dc90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5b2800b4a0 tx=0x7f5b2800b960 comp rx=0 tx=0).stop 2024-08-20T01:49:49.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.885+0000 7f5b3a2dc640 1 -- 172.21.15.79:0/281967129 shutdown_connections 2024-08-20T01:49:49.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.885+0000 7f5b3a2dc640 1 --2- 172.21.15.79:0/281967129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b3410a5f0 0x7f5b341abab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:49.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.885+0000 7f5b3a2dc640 1 --2- 172.21.15.79:0/281967129 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5b1c0b4010 0x7f5b1c0b64d0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:49.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.885+0000 7f5b3a2dc640 1 --2- 172.21.15.79:0/281967129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b34104290 0x7f5b34109ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:49.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.885+0000 7f5b3a2dc640 1 --2- 172.21.15.79:0/281967129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b34101590 0x7f5b3410dc90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:49.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.885+0000 7f5b3a2dc640 1 -- 172.21.15.79:0/281967129 >> 172.21.15.79:0/281967129 conn(0x7f5b34076bd0 msgr2=0x7f5b34106da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:49.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.885+0000 7f5b3a2dc640 1 -- 172.21.15.79:0/281967129 shutdown_connections 2024-08-20T01:49:49.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:49.885+0000 7f5b3a2dc640 1 -- 172.21.15.79:0/281967129 wait complete. 2024-08-20T01:49:50.104 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.101+0000 7f6c203b3640 1 -- 172.21.15.79:0/1007092218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c1810a840 msgr2=0x7f6c18119dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.101+0000 7f6c203b3640 1 --2- 172.21.15.79:0/1007092218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c1810a840 0x7f6c18119dc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6c14009900 tx=0x7f6c1402a3f0 comp rx=0 tx=0).stop 2024-08-20T01:49:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.101+0000 7f6c203b3640 1 -- 172.21.15.79:0/1007092218 shutdown_connections 2024-08-20T01:49:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.101+0000 7f6c203b3640 1 --2- 172.21.15.79:0/1007092218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c1810a840 0x7f6c18119dc0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.101+0000 7f6c203b3640 1 --2- 172.21.15.79:0/1007092218 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c18109e80 0x7f6c1810a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.101+0000 7f6c203b3640 1 --2- 172.21.15.79:0/1007092218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c18073fb0 0x7f6c180743b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.101+0000 7f6c203b3640 1 -- 172.21.15.79:0/1007092218 >> 172.21.15.79:0/1007092218 conn(0x7f6c1806f740 msgr2=0x7f6c18071b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.102+0000 7f6c203b3640 1 -- 172.21.15.79:0/1007092218 shutdown_connections 2024-08-20T01:49:50.108 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.102+0000 7f6c203b3640 1 -- 172.21.15.79:0/1007092218 wait complete. 2024-08-20T01:49:50.108 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.102+0000 7f6c203b3640 1 Processor -- start 2024-08-20T01:49:50.108 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.103+0000 7f6c203b3640 1 -- start start 2024-08-20T01:49:50.108 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.103+0000 7f6c203b3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c18073fb0 0x7f6c18116ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:50.108 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.103+0000 7f6c203b3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c18109e80 0x7f6c181171f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:50.108 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.103+0000 7f6c203b3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c1810a840 0x7f6c18117e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:50.108 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.103+0000 7f6c203b3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1811cfb0 con 0x7f6c18073fb0 2024-08-20T01:49:50.108 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.103+0000 7f6c203b3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1811ce30 con 0x7f6c18109e80 2024-08-20T01:49:50.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.103+0000 7f6c203b3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1811d130 con 0x7f6c1810a840 2024-08-20T01:49:50.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.103+0000 7f6c1e950640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c1810a840 0x7f6c18117e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:50.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.103+0000 7f6c1e950640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c1810a840 0x7f6c18117e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:50408/0 (socket says 172.21.15.79:50408) 2024-08-20T01:49:50.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.103+0000 7f6c1e950640 1 -- 172.21.15.79:0/3377483659 learned_addr learned my addr 172.21.15.79:0/3377483659 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:50.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.103+0000 7f6c1d94e640 1 --2- 172.21.15.79:0/3377483659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c18109e80 0x7f6c181171f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:50.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.103+0000 7f6c1e14f640 1 --2- 172.21.15.79:0/3377483659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c18073fb0 0x7f6c18116ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:50.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.104+0000 7f6c1d94e640 1 -- 172.21.15.79:0/3377483659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c1810a840 msgr2=0x7f6c18117e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:50.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.104+0000 7f6c1d94e640 1 --2- 172.21.15.79:0/3377483659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c1810a840 0x7f6c18117e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:50.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.104+0000 7f6c1d94e640 1 -- 172.21.15.79:0/3377483659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c18073fb0 msgr2=0x7f6c18116ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:50.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.104+0000 7f6c1d94e640 1 --2- 172.21.15.79:0/3377483659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c18073fb0 0x7f6c18116ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:50.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.104+0000 7f6c1d94e640 1 -- 172.21.15.79:0/3377483659 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c181186e0 con 0x7f6c18109e80 2024-08-20T01:49:50.109 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.104+0000 7f6c1d94e640 1 --2- 172.21.15.79:0/3377483659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c18109e80 0x7f6c181171f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6c1000e9f0 tx=0x7f6c1000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:50.110 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.104+0000 7f6c0f7fe640 1 -- 172.21.15.79:0/3377483659 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c1000cd80 con 0x7f6c18109e80 2024-08-20T01:49:50.110 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.104+0000 7f6c0f7fe640 1 -- 172.21.15.79:0/3377483659 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6c10011900 con 0x7f6c18109e80 2024-08-20T01:49:50.110 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.104+0000 7f6c203b3640 1 -- 172.21.15.79:0/3377483659 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c181189d0 con 0x7f6c18109e80 2024-08-20T01:49:50.110 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.104+0000 7f6c0f7fe640 1 -- 172.21.15.79:0/3377483659 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c1001a8c0 con 0x7f6c18109e80 2024-08-20T01:49:50.110 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.105+0000 7f6c203b3640 1 -- 172.21.15.79:0/3377483659 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c18119070 con 0x7f6c18109e80 2024-08-20T01:49:50.113 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.108+0000 7f6c23282740 1 Processor -- start 2024-08-20T01:49:50.113 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.108+0000 7f6c23282740 1 -- start start 2024-08-20T01:49:50.113 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.108+0000 7f6c23282740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d439483630 0x55d439485a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:50.113 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.108+0000 7f6c23282740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d439485f60 0x55d439488350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:50.113 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.109+0000 7f6c23282740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4394889a0 0x55d43948ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:50.113 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.109+0000 7f6c23282740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d4393f6360 con 0x55d4394889a0 2024-08-20T01:49:50.114 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.109+0000 7f6c23282740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d4393e5860 con 0x55d439483630 2024-08-20T01:49:50.114 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.109+0000 7f6c23282740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d4393e98a0 con 0x55d439485f60 2024-08-20T01:49:50.114 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.109+0000 7f6c1e14f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d439485f60 0x55d439488350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:50.114 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.109+0000 7f6c1e14f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d439485f60 0x55d439488350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:50424/0 (socket says 172.21.15.79:50424) 2024-08-20T01:49:50.114 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.109+0000 7f6c1e14f640 1 -- 172.21.15.79:0/3301659909 learned_addr learned my addr 172.21.15.79:0/3301659909 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:50.114 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.109+0000 7f6c1e14f640 1 -- 172.21.15.79:0/3301659909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d439483630 msgr2=0x55d439485a20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:49:50.114 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.109+0000 7f6c1e14f640 1 --2- 172.21.15.79:0/3301659909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d439483630 0x55d439485a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:50.114 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.109+0000 7f6c1e14f640 1 -- 172.21.15.79:0/3301659909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4394889a0 msgr2=0x55d43948ae60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:49:50.114 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.109+0000 7f6c1e14f640 1 --2- 172.21.15.79:0/3301659909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4394889a0 0x55d43948ae60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:50.114 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.109+0000 7f6c1e14f640 1 -- 172.21.15.79:0/3301659909 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d43938ce40 con 0x55d439485f60 2024-08-20T01:49:50.114 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.109+0000 7f6c1e14f640 1 --2- 172.21.15.79:0/3301659909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d439485f60 0x55d439488350 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6c08009cf0 tx=0x7f6c08011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d795afac6a2d7afd server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:50.114 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.110+0000 7f6c0cbfe640 1 -- 172.21.15.79:0/3301659909 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0801e070 con 0x55d439485f60 2024-08-20T01:49:50.115 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.110+0000 7f6c0cbfe640 1 -- 172.21.15.79:0/3301659909 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6c08019ac0 con 0x55d439485f60 2024-08-20T01:49:50.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.111+0000 7f6c23282740 1 -- 172.21.15.79:0/3301659909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d439485f60 msgr2=0x55d439488350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:50.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.111+0000 7f6c23282740 1 --2- 172.21.15.79:0/3301659909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d439485f60 0x55d439488350 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6c08009cf0 tx=0x7f6c08011810 comp rx=0 tx=0).stop 2024-08-20T01:49:50.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.111+0000 7f6c23282740 1 -- 172.21.15.79:0/3301659909 shutdown_connections 2024-08-20T01:49:50.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.111+0000 7f6c23282740 1 --2- 172.21.15.79:0/3301659909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4394889a0 0x55d43948ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:50.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.111+0000 7f6c23282740 1 --2- 172.21.15.79:0/3301659909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d439485f60 0x55d439488350 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:50.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.111+0000 7f6c23282740 1 --2- 172.21.15.79:0/3301659909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d439483630 0x55d439485a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:50.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.111+0000 7f6c23282740 1 -- 172.21.15.79:0/3301659909 >> 172.21.15.79:0/3301659909 conn(0x55d43947e730 msgr2=0x55d43947f510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.113+0000 7f6c0f7fe640 1 -- 172.21.15.79:0/3377483659 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f6c10011ab0 con 0x7f6c18109e80 2024-08-20T01:49:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.114+0000 7f6c23282740 1 -- 172.21.15.79:0/3301659909 shutdown_connections 2024-08-20T01:49:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.114+0000 7f6c23282740 1 -- 172.21.15.79:0/3301659909 wait complete. 2024-08-20T01:49:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.114+0000 7f6c23282740 1 -- start start 2024-08-20T01:49:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.114+0000 7f6c23282740 1 Processor -- start 2024-08-20T01:49:50.118 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.115+0000 7f6c0f7fe640 1 --2- 172.21.15.79:0/3377483659 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6c040b3c60 0x7f6c040b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:50.118 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.115+0000 7f6c0f7fe640 1 -- 172.21.15.79:0/3377483659 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f6c100e3d80 con 0x7f6c18109e80 2024-08-20T01:49:50.120 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.117+0000 7f6c23282740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d439483630 0x55d43948ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:50.120 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.117+0000 7f6c23282740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d4394889a0 0x55d43948d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:50.120 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.117+0000 7f6c23282740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d43948e120 0x55d43948e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:50.121 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.117+0000 7f6c23282740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d43931eab0 con 0x55d43948e120 2024-08-20T01:49:50.121 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.117+0000 7f6c23282740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d43936c780 con 0x55d439483630 2024-08-20T01:49:50.121 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.117+0000 7f6c23282740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d43948b9d0 con 0x55d4394889a0 2024-08-20T01:49:50.121 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.117+0000 7f6c23282740 10 client.0 _ll_register_callbacks cb 0x55d4390f4a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:49:50.121 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.118+0000 7f6c1e14f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d439483630 0x55d43948ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:50.121 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.118+0000 7f6c1e14f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d439483630 0x55d43948ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:35050/0 (socket says 172.21.15.79:35050) 2024-08-20T01:49:50.121 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.118+0000 7f6c1e14f640 1 -- 172.21.15.79:0/587393705 learned_addr learned my addr 172.21.15.79:0/587393705 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:50.122 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.118+0000 7f6c1d94e640 1 --2- 172.21.15.79:0/587393705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d4394889a0 0x55d43948d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:50.122 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.118+0000 7f6c1e14f640 1 -- 172.21.15.79:0/587393705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d4394889a0 msgr2=0x55d43948d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:50.122 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.118+0000 7f6c1e14f640 1 --2- 172.21.15.79:0/587393705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d4394889a0 0x55d43948d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:50.122 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.118+0000 7f6c1e14f640 1 -- 172.21.15.79:0/587393705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d43948e120 msgr2=0x55d43948e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:50.122 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.118+0000 7f6c1e14f640 1 --2- 172.21.15.79:0/587393705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d43948e120 0x55d43948e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:50.122 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.118+0000 7f6c1e14f640 1 -- 172.21.15.79:0/587393705 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d439148790 con 0x55d439483630 2024-08-20T01:49:50.122 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.118+0000 7f6c1e950640 1 --2- 172.21.15.79:0/3377483659 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6c040b3c60 0x7f6c040b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:50.123 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.119+0000 7f6c1e14f640 1 --2- 172.21.15.79:0/587393705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d439483630 0x55d43948ced0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6c08005e00 tx=0x7f6c0800eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46d36447a56ce26a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:50.123 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.119+0000 7f6c01ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:49:50.123 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.119+0000 7f6c01ffb640 1 -- 172.21.15.79:0/587393705 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0801e070 con 0x55d439483630 2024-08-20T01:49:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.119+0000 7f6c23282740 1 -- 172.21.15.79:0/587393705 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d439394e00 con 0x55d439483630 2024-08-20T01:49:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.120+0000 7f6c01ffb640 1 -- 172.21.15.79:0/587393705 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f6c08005240 con 0x55d439483630 2024-08-20T01:49:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.120+0000 7f6c01ffb640 1 -- 172.21.15.79:0/587393705 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f6c08005440 con 0x55d439483630 2024-08-20T01:49:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.120+0000 7f6c23282740 10 client.27731 fetch_fsmap learned FSMap version 51 2024-08-20T01:49:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.120+0000 7f6c23282740 1 -- 172.21.15.79:0/587393705 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55d4391c1620 con 0x55d439483630 2024-08-20T01:49:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.120+0000 7f6c1e950640 1 --2- 172.21.15.79:0/3377483659 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6c040b3c60 0x7f6c040b6120 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f6c14005ec0 tx=0x7f6c14005dd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:50.128 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.124+0000 7f6c01ffb640 1 -- 172.21.15.79:0/587393705 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55d439394e00 con 0x55d439483630 2024-08-20T01:49:50.128 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.124+0000 7f6c01ffb640 1 -- 172.21.15.79:0/587393705 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7f6c08023530 con 0x55d439483630 2024-08-20T01:49:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.126+0000 7f6c23282740 10 client.27731 fetch_fsmap finished waiting for FSMap version 51 2024-08-20T01:49:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.126+0000 7f6c23282740 10 client.27731 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:49:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.126+0000 7f6c23282740 20 client.27731 populate_metadata read hostname 'smithi079' 2024-08-20T01:49:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.126+0000 7f6c23282740 1 --2- 172.21.15.79:0/587393705 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d439498920 0x55d43949ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.126+0000 7f6c23282740 4 client.27731 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:49:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.126+0000 7f6c23282740 1 -- 172.21.15.79:0/587393705 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d4393f82b0 con 0x55d439498920 2024-08-20T01:49:50.130 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.128+0000 7f6c1d94e640 1 --2- 172.21.15.79:0/587393705 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d439498920 0x55d43949ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:50.134 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.131+0000 7f6c1d94e640 1 --2- 172.21.15.79:0/587393705 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d439498920 0x55d43949ad10 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c2668a6eaa865dc server_cookie=36e8b412736a4078 in_seq=0 out_seq=0 2024-08-20T01:49:50.134 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.131+0000 7f6c01ffb640 10 client.27731 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:49:50.135 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.132+0000 7f6c01ffb640 1 -- 172.21.15.79:0/587393705 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d4393f82b0 con 0x55d439498920 2024-08-20T01:49:50.135 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.132+0000 7f6c01ffb640 10 client.27731 handle_command_reply: tid=0 2024-08-20T01:49:50.135 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.132+0000 7f6c23282740 1 client.27731 shutdown 2024-08-20T01:49:50.136 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.133+0000 7f6c23282740 1 -- 172.21.15.79:0/587393705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d439483630 msgr2=0x55d43948ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:50.136 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.133+0000 7f6c23282740 1 --2- 172.21.15.79:0/587393705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d439483630 0x55d43948ced0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6c08005e00 tx=0x7f6c0800eb80 comp rx=0 tx=0).stop 2024-08-20T01:49:50.136 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.133+0000 7f6c23282740 1 -- 172.21.15.79:0/587393705 shutdown_connections 2024-08-20T01:49:50.137 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.133+0000 7f6c23282740 1 --2- 172.21.15.79:0/587393705 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d439498920 0x55d43949ad10 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:50.137 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.133+0000 7f6c23282740 1 --2- 172.21.15.79:0/587393705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d43948e120 0x55d43948e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:50.137 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.133+0000 7f6c23282740 1 --2- 172.21.15.79:0/587393705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d4394889a0 0x55d43948d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:50.137 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.133+0000 7f6c23282740 1 --2- 172.21.15.79:0/587393705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d439483630 0x55d43948ced0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:50.137 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.133+0000 7f6c23282740 1 -- 172.21.15.79:0/587393705 >> 172.21.15.79:0/587393705 conn(0x55d43947e730 msgr2=0x55d43947d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:50.137 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.133+0000 7f6c01ffb640 0 client.27731 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:49:50.137 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.133+0000 7f6c23282740 1 -- 172.21.15.79:0/587393705 shutdown_connections 2024-08-20T01:49:50.137 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.133+0000 7f6c23282740 1 -- 172.21.15.79:0/587393705 wait complete. 2024-08-20T01:49:50.137 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.134+0000 7f6c23282740 20 client.27731 trim_cache size 0 max 16384 2024-08-20T01:49:50.171 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.168+0000 7f6c23282740 1 Processor -- start 2024-08-20T01:49:50.171 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.168+0000 7f6c23282740 1 -- start start 2024-08-20T01:49:50.172 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.168+0000 7f6c23282740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4394889a0 0x55d43947d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:50.172 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.169+0000 7f6c23282740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d43948e120 0x55d43947d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:50.172 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.169+0000 7f6c1e14f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4394889a0 0x55d43947d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:50.172 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.169+0000 7f6c1e14f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4394889a0 0x55d43947d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:35060/0 (socket says 172.21.15.79:35060) 2024-08-20T01:49:50.172 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.169+0000 7f6c1e14f640 1 -- 172.21.15.79:0/3124681775 learned_addr learned my addr 172.21.15.79:0/3124681775 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:50.172 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.169+0000 7f6c23282740 1 --2- 172.21.15.79:0/3124681775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d43947f8e0 0x55d43947dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:50.172 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.169+0000 7f6c23282740 1 -- 172.21.15.79:0/3124681775 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6c181c11b0 con 0x55d43948e120 2024-08-20T01:49:50.173 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.169+0000 7f6c23282740 1 -- 172.21.15.79:0/3124681775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6c181c2cf0 con 0x55d4394889a0 2024-08-20T01:49:50.173 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.169+0000 7f6c1e950640 1 --2- 172.21.15.79:0/3124681775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d43947f8e0 0x55d43947dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:50.173 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.169+0000 7f6c23282740 1 -- 172.21.15.79:0/3124681775 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6c181c1880 con 0x55d43947f8e0 2024-08-20T01:49:50.173 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.170+0000 7f6c1e14f640 1 -- 172.21.15.79:0/3124681775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d43947f8e0 msgr2=0x55d43947dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:50.174 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.170+0000 7f6c1e14f640 1 --2- 172.21.15.79:0/3124681775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d43947f8e0 0x55d43947dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:50.174 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.170+0000 7f6c1e14f640 1 -- 172.21.15.79:0/3124681775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d43948e120 msgr2=0x55d43947d570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:49:50.174 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.170+0000 7f6c1e14f640 1 --2- 172.21.15.79:0/3124681775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d43948e120 0x55d43947d570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:50.174 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.170+0000 7f6c1e14f640 1 -- 172.21.15.79:0/3124681775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4394951c0 con 0x55d4394889a0 2024-08-20T01:49:50.174 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.170+0000 7f6c1e14f640 1 --2- 172.21.15.79:0/3124681775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4394889a0 0x55d43947d030 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6c08001eb0 tx=0x7f6c0800ef70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbc7f94d3c63d8c6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:50.174 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.171+0000 7f6c03fff640 1 -- 172.21.15.79:0/3124681775 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0801e050 con 0x55d4394889a0 2024-08-20T01:49:50.174 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.171+0000 7f6c03fff640 1 -- 172.21.15.79:0/3124681775 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6c08015030 con 0x55d4394889a0 2024-08-20T01:49:50.175 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.172+0000 7f6c23282740 1 -- 172.21.15.79:0/3124681775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4394889a0 msgr2=0x55d43947d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:50.175 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.172+0000 7f6c23282740 1 --2- 172.21.15.79:0/3124681775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4394889a0 0x55d43947d030 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6c08001eb0 tx=0x7f6c0800ef70 comp rx=0 tx=0).stop 2024-08-20T01:49:50.175 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.172+0000 7f6c23282740 1 -- 172.21.15.79:0/3124681775 shutdown_connections 2024-08-20T01:49:50.175 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.172+0000 7f6c23282740 1 --2- 172.21.15.79:0/3124681775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d43947f8e0 0x55d43947dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:50.175 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.172+0000 7f6c23282740 1 --2- 172.21.15.79:0/3124681775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d43948e120 0x55d43947d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:50.175 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.172+0000 7f6c23282740 1 --2- 172.21.15.79:0/3124681775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4394889a0 0x55d43947d030 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:50.175 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.172+0000 7f6c23282740 1 -- 172.21.15.79:0/3124681775 >> 172.21.15.79:0/3124681775 conn(0x55d43947e730 msgr2=0x55d43947f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:50.176 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.173+0000 7f6c23282740 1 -- 172.21.15.79:0/3124681775 shutdown_connections 2024-08-20T01:49:50.176 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.173+0000 7f6c23282740 1 -- 172.21.15.79:0/3124681775 wait complete. 2024-08-20T01:49:50.176 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.173+0000 7f6c23282740 1 -- start start 2024-08-20T01:49:50.176 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.173+0000 7f6c23282740 1 Processor -- start 2024-08-20T01:49:50.176 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.174+0000 7f6c23282740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d43947f8e0 0x55d439491940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:50.176 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.174+0000 7f6c23282740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d43948e120 0x55d439491fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:50.177 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.174+0000 7f6c23282740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d439492b90 0x55d439493010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:50.177 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.174+0000 7f6c23282740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6c181c2620 con 0x55d43948e120 2024-08-20T01:49:50.177 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.174+0000 7f6c23282740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6c181c1f50 con 0x55d439492b90 2024-08-20T01:49:50.177 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.174+0000 7f6c23282740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6c181bf190 con 0x55d43947f8e0 2024-08-20T01:49:50.177 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.174+0000 7f6c23282740 10 client.0 _ll_register_callbacks cb 0x7f6c0801c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:49:50.177 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.174+0000 7f6c1e950640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d439492b90 0x55d439493010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:50.177 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.174+0000 7f6c1e950640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d439492b90 0x55d439493010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:35076/0 (socket says 172.21.15.79:35076) 2024-08-20T01:49:50.177 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.174+0000 7f6c1e950640 1 -- 172.21.15.79:0/2242326784 learned_addr learned my addr 172.21.15.79:0/2242326784 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:50.178 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.174+0000 7f6c1e14f640 1 --2- 172.21.15.79:0/2242326784 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d43947f8e0 0x55d439491940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:50.178 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.175+0000 7f6c1e950640 1 -- 172.21.15.79:0/2242326784 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d43947f8e0 msgr2=0x55d439491940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:50.178 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.175+0000 7f6c1e950640 1 --2- 172.21.15.79:0/2242326784 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d43947f8e0 0x55d439491940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:50.178 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.175+0000 7f6c1e950640 1 -- 172.21.15.79:0/2242326784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d43948e120 msgr2=0x55d439491fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:50.178 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.175+0000 7f6c1e950640 1 --2- 172.21.15.79:0/2242326784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d43948e120 0x55d439491fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:50.178 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.175+0000 7f6c1e950640 1 -- 172.21.15.79:0/2242326784 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d439493840 con 0x55d439492b90 2024-08-20T01:49:50.178 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.175+0000 7f6c1e950640 1 --2- 172.21.15.79:0/2242326784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d439492b90 0x55d439493010 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6c1402a910 tx=0x7f6c14031420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47ef870a5d587746 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:50.179 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.176+0000 7f6c01ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:49:50.179 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.176+0000 7f6c01ffb640 1 -- 172.21.15.79:0/2242326784 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c14035040 con 0x55d439492b90 2024-08-20T01:49:50.179 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.176+0000 7f6c23282740 1 -- 172.21.15.79:0/2242326784 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d4393f3d50 con 0x55d439492b90 2024-08-20T01:49:50.180 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.176+0000 7f6c01ffb640 1 -- 172.21.15.79:0/2242326784 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f6c14031500 con 0x55d439492b90 2024-08-20T01:49:50.180 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.177+0000 7f6c01ffb640 1 -- 172.21.15.79:0/2242326784 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f6c14031700 con 0x55d439492b90 2024-08-20T01:49:50.180 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.178+0000 7f6c23282740 10 client.27737 fetch_fsmap learned FSMap version 51 2024-08-20T01:49:50.180 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.178+0000 7f6c23282740 1 -- 172.21.15.79:0/2242326784 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55d439494c50 con 0x55d439492b90 2024-08-20T01:49:50.181 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.178+0000 7f6c01ffb640 1 -- 172.21.15.79:0/2242326784 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55d4393f3d50 con 0x55d439492b90 2024-08-20T01:49:50.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.179+0000 7f6c01ffb640 1 -- 172.21.15.79:0/2242326784 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7f6c14050020 con 0x55d439492b90 2024-08-20T01:49:50.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.179+0000 7f6c23282740 10 client.27737 fetch_fsmap finished waiting for FSMap version 51 2024-08-20T01:49:50.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.179+0000 7f6c23282740 10 client.27737 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:49:50.182 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.179+0000 7f6c23282740 20 client.27737 populate_metadata read hostname 'smithi079' 2024-08-20T01:49:50.183 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.180+0000 7f6c23282740 1 --2- 172.21.15.79:0/2242326784 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d439503a90 0x55d439505eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:50.183 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.180+0000 7f6c23282740 4 client.27737 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:49:50.183 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.180+0000 7f6c23282740 1 -- 172.21.15.79:0/2242326784 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d4393f1490 con 0x55d439503a90 2024-08-20T01:49:50.183 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.180+0000 7f6c1e14f640 1 --2- 172.21.15.79:0/2242326784 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d439503a90 0x55d439505eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:50.183 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.181+0000 7f6c1e14f640 1 --2- 172.21.15.79:0/2242326784 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d439503a90 0x55d439505eb0 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb1544437617131a server_cookie=d7ab9066a27fe07d in_seq=0 out_seq=0 2024-08-20T01:49:50.183 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.181+0000 7f6c01ffb640 10 client.27737 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:49:50.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.198+0000 7f6c01ffb640 1 -- 172.21.15.79:0/2242326784 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d4393f1490 con 0x55d439503a90 2024-08-20T01:49:50.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.198+0000 7f6c01ffb640 10 client.27737 handle_command_reply: tid=0 2024-08-20T01:49:50.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.198+0000 7f6c23282740 1 client.27737 shutdown 2024-08-20T01:49:50.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.198+0000 7f6c23282740 1 -- 172.21.15.79:0/2242326784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d439492b90 msgr2=0x55d439493010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:50.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.198+0000 7f6c23282740 1 --2- 172.21.15.79:0/2242326784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d439492b90 0x55d439493010 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6c1402a910 tx=0x7f6c14031420 comp rx=0 tx=0).stop 2024-08-20T01:49:50.202 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.198+0000 7f6c23282740 1 -- 172.21.15.79:0/2242326784 shutdown_connections 2024-08-20T01:49:50.202 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.198+0000 7f6c23282740 1 --2- 172.21.15.79:0/2242326784 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d439503a90 0x55d439505eb0 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:50.202 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.198+0000 7f6c23282740 1 --2- 172.21.15.79:0/2242326784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d439492b90 0x55d439493010 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:50.202 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.198+0000 7f6c01ffb640 0 client.27737 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:49:50.202 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.198+0000 7f6c23282740 1 --2- 172.21.15.79:0/2242326784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d43948e120 0x55d439491fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:50.202 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.198+0000 7f6c23282740 1 --2- 172.21.15.79:0/2242326784 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d43947f8e0 0x55d439491940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:50.202 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.198+0000 7f6c23282740 1 -- 172.21.15.79:0/2242326784 >> 172.21.15.79:0/2242326784 conn(0x55d43947e730 msgr2=0x55d4394825c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:50.202 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.199+0000 7f6c23282740 1 -- 172.21.15.79:0/2242326784 shutdown_connections 2024-08-20T01:49:50.202 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.199+0000 7f6c23282740 1 -- 172.21.15.79:0/2242326784 wait complete. 2024-08-20T01:49:50.203 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.199+0000 7f6c23282740 20 client.27737 trim_cache size 0 max 16384 2024-08-20T01:49:50.203 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:49:50.203 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:49:50.203 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:49:50.203 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:49:50.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.200+0000 7f6c203b3640 1 -- 172.21.15.79:0/3377483659 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6c040b3c60 msgr2=0x7f6c040b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:50.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.200+0000 7f6c203b3640 1 --2- 172.21.15.79:0/3377483659 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6c040b3c60 0x7f6c040b6120 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f6c14005ec0 tx=0x7f6c14005dd0 comp rx=0 tx=0).stop 2024-08-20T01:49:50.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.200+0000 7f6c203b3640 1 -- 172.21.15.79:0/3377483659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c18109e80 msgr2=0x7f6c181171f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:50.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.200+0000 7f6c203b3640 1 --2- 172.21.15.79:0/3377483659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c18109e80 0x7f6c181171f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6c1000e9f0 tx=0x7f6c1000eeb0 comp rx=0 tx=0).stop 2024-08-20T01:49:50.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.200+0000 7f6c203b3640 1 -- 172.21.15.79:0/3377483659 shutdown_connections 2024-08-20T01:49:50.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.200+0000 7f6c203b3640 1 --2- 172.21.15.79:0/3377483659 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6c040b3c60 0x7f6c040b6120 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:50.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.200+0000 7f6c203b3640 1 --2- 172.21.15.79:0/3377483659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c1810a840 0x7f6c18117e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:50.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.200+0000 7f6c203b3640 1 --2- 172.21.15.79:0/3377483659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c18109e80 0x7f6c181171f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:50.205 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.200+0000 7f6c203b3640 1 --2- 172.21.15.79:0/3377483659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c18073fb0 0x7f6c18116ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:50.205 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.200+0000 7f6c203b3640 1 -- 172.21.15.79:0/3377483659 >> 172.21.15.79:0/3377483659 conn(0x7f6c1806f740 msgr2=0x7f6c1810d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:50.205 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.200+0000 7f6c203b3640 1 -- 172.21.15.79:0/3377483659 shutdown_connections 2024-08-20T01:49:50.205 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:49:50.200+0000 7f6c203b3640 1 -- 172.21.15.79:0/3377483659 wait complete. 2024-08-20T01:49:50.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:50 smithi081 ceph-mon[22209]: pgmap v722: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 MiB/s wr, 5.83k op/s 2024-08-20T01:49:50.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:50 smithi175 ceph-mon[22392]: pgmap v722: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 MiB/s wr, 5.83k op/s 2024-08-20T01:49:50.668 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:50 smithi079 ceph-mon[18656]: pgmap v722: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 MiB/s wr, 5.83k op/s 2024-08-20T01:49:50.721 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T01:49:51.166 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:49:51.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.802+0000 7f9b43fff640 1 -- 172.21.15.79:0/2091427632 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b440307c0 con 0x7f9b4c107d50 2024-08-20T01:49:51.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.803+0000 7f9b532ff640 1 -- 172.21.15.79:0/2091427632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b4c107d50 msgr2=0x7f9b4c10e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:51.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.803+0000 7f9b532ff640 1 --2- 172.21.15.79:0/2091427632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b4c107d50 0x7f9b4c10e550 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9b44009ca0 tx=0x7f9b4402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:49:51.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.803+0000 7f9b532ff640 1 -- 172.21.15.79:0/2091427632 shutdown_connections 2024-08-20T01:49:51.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.803+0000 7f9b532ff640 1 --2- 172.21.15.79:0/2091427632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b4c107d50 0x7f9b4c10e550 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:51.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.803+0000 7f9b532ff640 1 --2- 172.21.15.79:0/2091427632 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b4c1073d0 0x7f9b4c107810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:51.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.803+0000 7f9b532ff640 1 --2- 172.21.15.79:0/2091427632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b4c1019c0 0x7f9b4c101da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:51.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.803+0000 7f9b532ff640 1 -- 172.21.15.79:0/2091427632 >> 172.21.15.79:0/2091427632 conn(0x7f9b4c0fd450 msgr2=0x7f9b4c0ff870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:51.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.804+0000 7f9b532ff640 1 -- 172.21.15.79:0/2091427632 shutdown_connections 2024-08-20T01:49:51.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.804+0000 7f9b532ff640 1 -- 172.21.15.79:0/2091427632 wait complete. 2024-08-20T01:49:51.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.805+0000 7f9b532ff640 1 Processor -- start 2024-08-20T01:49:51.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.806+0000 7f9b532ff640 1 -- start start 2024-08-20T01:49:51.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.806+0000 7f9b532ff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b4c1019c0 0x7f9b4c197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:51.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.806+0000 7f9b532ff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b4c1073d0 0x7f9b4c1982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:51.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.806+0000 7f9b532ff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b4c107d50 0x7f9b4c19d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:51.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.806+0000 7f9b5089a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b4c1073d0 0x7f9b4c1982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:51.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.807+0000 7f9b5089a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b4c1073d0 0x7f9b4c1982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:48270/0 (socket says 172.21.15.79:48270) 2024-08-20T01:49:51.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.807+0000 7f9b5109b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b4c1019c0 0x7f9b4c197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:51.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.807+0000 7f9b5109b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b4c1019c0 0x7f9b4c197db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:48134/0 (socket says 172.21.15.79:48134) 2024-08-20T01:49:51.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.807+0000 7f9b5089a640 1 -- 172.21.15.79:0/935697558 learned_addr learned my addr 172.21.15.79:0/935697558 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:51.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.807+0000 7f9b532ff640 1 -- 172.21.15.79:0/935697558 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c111910 con 0x7f9b4c107d50 2024-08-20T01:49:51.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.807+0000 7f9b532ff640 1 -- 172.21.15.79:0/935697558 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c111790 con 0x7f9b4c1073d0 2024-08-20T01:49:51.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.807+0000 7f9b532ff640 1 -- 172.21.15.79:0/935697558 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c111a90 con 0x7f9b4c1019c0 2024-08-20T01:49:51.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.807+0000 7f9b5189c640 1 --2- 172.21.15.79:0/935697558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b4c107d50 0x7f9b4c19d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:51.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.807+0000 7f9b5089a640 1 -- 172.21.15.79:0/935697558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b4c1019c0 msgr2=0x7f9b4c197db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:51.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.808+0000 7f9b5089a640 1 --2- 172.21.15.79:0/935697558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b4c1019c0 0x7f9b4c197db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:51.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.808+0000 7f9b5089a640 1 -- 172.21.15.79:0/935697558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b4c107d50 msgr2=0x7f9b4c19d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:51.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.808+0000 7f9b5089a640 1 --2- 172.21.15.79:0/935697558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b4c107d50 0x7f9b4c19d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:51.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.808+0000 7f9b5089a640 1 -- 172.21.15.79:0/935697558 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b4c19de60 con 0x7f9b4c1073d0 2024-08-20T01:49:51.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.808+0000 7f9b5089a640 1 --2- 172.21.15.79:0/935697558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b4c1073d0 0x7f9b4c1982f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c00b4a0 tx=0x7f9b3c00b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:51.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.809+0000 7f9b427fc640 1 -- 172.21.15.79:0/935697558 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c012b80 con 0x7f9b4c1073d0 2024-08-20T01:49:51.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.810+0000 7f9b427fc640 1 -- 172.21.15.79:0/935697558 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9b3c012d20 con 0x7f9b4c1073d0 2024-08-20T01:49:51.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.810+0000 7f9b427fc640 1 -- 172.21.15.79:0/935697558 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c00d5c0 con 0x7f9b4c1073d0 2024-08-20T01:49:51.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.810+0000 7f9b532ff640 1 -- 172.21.15.79:0/935697558 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b4c19e150 con 0x7f9b4c1073d0 2024-08-20T01:49:51.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.810+0000 7f9b532ff640 1 -- 172.21.15.79:0/935697558 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b4c06b130 con 0x7f9b4c1073d0 2024-08-20T01:49:51.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.817+0000 7f9b556f8740 1 Processor -- start 2024-08-20T01:49:51.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.817+0000 7f9b556f8740 1 -- start start 2024-08-20T01:49:51.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.817+0000 7f9b556f8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b4de621880 0x55b4de621c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:51.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.817+0000 7f9b556f8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4de6221a0 0x55b4de62dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:51.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.817+0000 7f9b556f8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4de62e130 0x55b4de630520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:51.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.817+0000 7f9b556f8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b4de598930 con 0x55b4de62e130 2024-08-20T01:49:51.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.818+0000 7f9b556f8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b4de587e30 con 0x55b4de621880 2024-08-20T01:49:51.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.818+0000 7f9b556f8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b4de58be70 con 0x55b4de6221a0 2024-08-20T01:49:51.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.818+0000 7f9b427fc640 1 -- 172.21.15.79:0/935697558 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f9b3c01b400 con 0x7f9b4c1073d0 2024-08-20T01:49:51.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.818+0000 7f9b5189c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b4de621880 0x55b4de621c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:51.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.818+0000 7f9b5189c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b4de621880 0x55b4de621c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:48280/0 (socket says 172.21.15.79:48280) 2024-08-20T01:49:51.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.818+0000 7f9b5189c640 1 -- 172.21.15.79:0/2418590973 learned_addr learned my addr 172.21.15.79:0/2418590973 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:51.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.818+0000 7f9b5189c640 1 -- 172.21.15.79:0/2418590973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4de6221a0 msgr2=0x55b4de62dbf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:49:51.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.818+0000 7f9b5189c640 1 --2- 172.21.15.79:0/2418590973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4de6221a0 0x55b4de62dbf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:51.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.818+0000 7f9b5189c640 1 -- 172.21.15.79:0/2418590973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4de62e130 msgr2=0x55b4de630520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:51.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.818+0000 7f9b5189c640 1 --2- 172.21.15.79:0/2418590973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4de62e130 0x55b4de630520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:51.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.818+0000 7f9b5189c640 1 -- 172.21.15.79:0/2418590973 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4de2e7650 con 0x55b4de621880 2024-08-20T01:49:51.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.819+0000 7f9b5189c640 1 --2- 172.21.15.79:0/2418590973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b4de621880 0x55b4de621c60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9b44035000 tx=0x7f9b44003a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3854360160365ad server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:51.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.820+0000 7f9b427fc640 1 --2- 172.21.15.79:0/935697558 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9b380b3da0 0x7f9b380b6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:51.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.820+0000 7f9b427fc640 1 -- 172.21.15.79:0/935697558 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9b3c0e30f0 con 0x7f9b4c1073d0 2024-08-20T01:49:51.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.821+0000 7f9b377fe640 1 -- 172.21.15.79:0/2418590973 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b44031450 con 0x55b4de621880 2024-08-20T01:49:51.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.821+0000 7f9b377fe640 1 -- 172.21.15.79:0/2418590973 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9b44036030 con 0x55b4de621880 2024-08-20T01:49:51.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.822+0000 7f9b556f8740 1 -- 172.21.15.79:0/2418590973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b4de621880 msgr2=0x55b4de621c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:51.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.822+0000 7f9b556f8740 1 --2- 172.21.15.79:0/2418590973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b4de621880 0x55b4de621c60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9b44035000 tx=0x7f9b44003a20 comp rx=0 tx=0).stop 2024-08-20T01:49:51.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.822+0000 7f9b556f8740 1 -- 172.21.15.79:0/2418590973 shutdown_connections 2024-08-20T01:49:51.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.822+0000 7f9b556f8740 1 --2- 172.21.15.79:0/2418590973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4de62e130 0x55b4de630520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:51.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.822+0000 7f9b556f8740 1 --2- 172.21.15.79:0/2418590973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4de6221a0 0x55b4de62dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:51.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.822+0000 7f9b556f8740 1 --2- 172.21.15.79:0/2418590973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b4de621880 0x55b4de621c60 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:51.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.822+0000 7f9b556f8740 1 -- 172.21.15.79:0/2418590973 >> 172.21.15.79:0/2418590973 conn(0x55b4de61f6b0 msgr2=0x55b4de620850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:51.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.823+0000 7f9b556f8740 1 -- 172.21.15.79:0/2418590973 shutdown_connections 2024-08-20T01:49:51.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.823+0000 7f9b556f8740 1 -- 172.21.15.79:0/2418590973 wait complete. 2024-08-20T01:49:51.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.824+0000 7f9b556f8740 1 -- start start 2024-08-20T01:49:51.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.824+0000 7f9b556f8740 1 Processor -- start 2024-08-20T01:49:51.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.825+0000 7f9b556f8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b4de62e130 0x55b4de62db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:51.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.825+0000 7f9b556f8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4de62afe0 0x55b4de62b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:51.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.825+0000 7f9b556f8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4de62bb30 0x55b4de64b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:51.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.825+0000 7f9b556f8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b4de3ea700 con 0x55b4de62afe0 2024-08-20T01:49:51.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.825+0000 7f9b556f8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b4de50e810 con 0x55b4de62e130 2024-08-20T01:49:51.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.825+0000 7f9b556f8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b4de641c10 con 0x55b4de62bb30 2024-08-20T01:49:51.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.826+0000 7f9b556f8740 10 client.0 _ll_register_callbacks cb 0x55b4de581700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:49:51.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.826+0000 7f9b5109b640 1 --2- 172.21.15.79:0/935697558 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9b380b3da0 0x7f9b380b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:51.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.826+0000 7f9b5109b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b4de62e130 0x55b4de62db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:51.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.826+0000 7f9b5109b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b4de62e130 0x55b4de62db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:48294/0 (socket says 172.21.15.79:48294) 2024-08-20T01:49:51.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.826+0000 7f9b5109b640 1 -- 172.21.15.79:0/3984893612 learned_addr learned my addr 172.21.15.79:0/3984893612 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:51.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.827+0000 7f9b5189c640 1 --2- 172.21.15.79:0/3984893612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4de62bb30 0x55b4de64b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:51.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.827+0000 7f9b5089a640 1 --2- 172.21.15.79:0/3984893612 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4de62afe0 0x55b4de62b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:51.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.827+0000 7f9b5109b640 1 -- 172.21.15.79:0/3984893612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4de62bb30 msgr2=0x55b4de64b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:51.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.827+0000 7f9b5109b640 1 --2- 172.21.15.79:0/3984893612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4de62bb30 0x55b4de64b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:51.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.827+0000 7f9b5109b640 1 -- 172.21.15.79:0/3984893612 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4de62afe0 msgr2=0x55b4de62b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:51.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.827+0000 7f9b5109b640 1 --2- 172.21.15.79:0/3984893612 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4de62afe0 0x55b4de62b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:51.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.827+0000 7f9b5109b640 1 -- 172.21.15.79:0/3984893612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4de64b7e0 con 0x55b4de62e130 2024-08-20T01:49:51.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.827+0000 7f9b5089a640 1 --2- 172.21.15.79:0/3984893612 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4de62afe0 0x55b4de62b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:49:51.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.828+0000 7f9b5109b640 1 --2- 172.21.15.79:0/3984893612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b4de62e130 0x55b4de62db90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9b48011ac0 tx=0x7f9b480046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5af6857971912586 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:51.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.828+0000 7f9b34ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:49:51.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.828+0000 7f9b34ff9640 1 -- 172.21.15.79:0/3984893612 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b48005220 con 0x55b4de62e130 2024-08-20T01:49:51.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.828+0000 7f9b34ff9640 1 -- 172.21.15.79:0/3984893612 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9b480053c0 con 0x55b4de62e130 2024-08-20T01:49:51.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.828+0000 7f9b556f8740 1 -- 172.21.15.79:0/3984893612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b4de537150 con 0x55b4de62e130 2024-08-20T01:49:51.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.828+0000 7f9b34ff9640 1 -- 172.21.15.79:0/3984893612 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f9b480055c0 con 0x55b4de62e130 2024-08-20T01:49:51.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.829+0000 7f9b556f8740 10 client.27746 fetch_fsmap learned FSMap version 51 2024-08-20T01:49:51.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.829+0000 7f9b556f8740 1 -- 172.21.15.79:0/3984893612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55b4de64e250 con 0x55b4de62e130 2024-08-20T01:49:51.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.829+0000 7f9b34ff9640 1 -- 172.21.15.79:0/3984893612 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55b4de537150 con 0x55b4de62e130 2024-08-20T01:49:51.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.829+0000 7f9b34ff9640 1 -- 172.21.15.79:0/3984893612 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7f9b48004a10 con 0x55b4de62e130 2024-08-20T01:49:51.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.829+0000 7f9b556f8740 10 client.27746 fetch_fsmap finished waiting for FSMap version 51 2024-08-20T01:49:51.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.829+0000 7f9b556f8740 10 client.27746 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:49:51.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.829+0000 7f9b556f8740 20 client.27746 populate_metadata read hostname 'smithi079' 2024-08-20T01:49:51.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.829+0000 7f9b556f8740 1 --2- 172.21.15.79:0/3984893612 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55b4de64f7b0 0x55b4de651bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:51.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.830+0000 7f9b556f8740 4 client.27746 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:49:51.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.830+0000 7f9b556f8740 1 -- 172.21.15.79:0/3984893612 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b4de59a880 con 0x55b4de64f7b0 2024-08-20T01:49:51.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.830+0000 7f9b5189c640 1 --2- 172.21.15.79:0/3984893612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4de62bb30 0x55b4de64b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:49:51.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.830+0000 7f9b5089a640 1 --2- 172.21.15.79:0/3984893612 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55b4de64f7b0 0x55b4de651bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:51.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.830+0000 7f9b5109b640 1 --2- 172.21.15.79:0/935697558 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9b380b3da0 0x7f9b380b6260 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f9b4800af10 tx=0x7f9b4800a680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:51.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.831+0000 7f9b34ff9640 10 client.27746 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:49:51.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.831+0000 7f9b5089a640 1 --2- 172.21.15.79:0/3984893612 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55b4de64f7b0 0x55b4de651bf0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c14286b4e82ca466 server_cookie=b27639cf15c46715 in_seq=0 out_seq=0 2024-08-20T01:49:51.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.831+0000 7f9b34ff9640 1 -- 172.21.15.79:0/3984893612 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b4de59a880 con 0x55b4de64f7b0 2024-08-20T01:49:51.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.831+0000 7f9b34ff9640 10 client.27746 handle_command_reply: tid=0 2024-08-20T01:49:51.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.832+0000 7f9b556f8740 1 client.27746 shutdown 2024-08-20T01:49:51.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.832+0000 7f9b556f8740 1 -- 172.21.15.79:0/3984893612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b4de62e130 msgr2=0x55b4de62db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:51.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.832+0000 7f9b556f8740 1 --2- 172.21.15.79:0/3984893612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b4de62e130 0x55b4de62db90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9b48011ac0 tx=0x7f9b480046c0 comp rx=0 tx=0).stop 2024-08-20T01:49:51.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.836+0000 7f9b556f8740 1 -- 172.21.15.79:0/3984893612 shutdown_connections 2024-08-20T01:49:51.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.836+0000 7f9b556f8740 1 --2- 172.21.15.79:0/3984893612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4de62bb30 0x55b4de64b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:51.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.836+0000 7f9b556f8740 1 --2- 172.21.15.79:0/3984893612 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4de62afe0 0x55b4de62b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:51.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.836+0000 7f9b556f8740 1 --2- 172.21.15.79:0/3984893612 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55b4de64f7b0 0x55b4de651bf0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:51.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.836+0000 7f9b556f8740 1 --2- 172.21.15.79:0/3984893612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b4de62e130 0x55b4de62db90 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:51.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.836+0000 7f9b556f8740 1 -- 172.21.15.79:0/3984893612 >> 172.21.15.79:0/3984893612 conn(0x55b4de61f6b0 msgr2=0x55b4de6228d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:51.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.836+0000 7f9b34ff9640 0 client.27746 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:49:51.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.837+0000 7f9b556f8740 1 -- 172.21.15.79:0/3984893612 shutdown_connections 2024-08-20T01:49:51.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.837+0000 7f9b556f8740 1 -- 172.21.15.79:0/3984893612 wait complete. 2024-08-20T01:49:51.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.839+0000 7f9b556f8740 20 client.27746 trim_cache size 0 max 16384 2024-08-20T01:49:51.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.861+0000 7f9b556f8740 1 Processor -- start 2024-08-20T01:49:51.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.861+0000 7f9b556f8740 1 -- start start 2024-08-20T01:49:51.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.861+0000 7f9b556f8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4de62afe0 0x55b4de64ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:51.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.861+0000 7f9b556f8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b4de62bb30 0x55b4de62a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:51.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.861+0000 7f9b556f8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4de62e130 0x55b4de6517c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:51.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.862+0000 7f9b556f8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c073d60 con 0x55b4de62afe0 2024-08-20T01:49:51.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.862+0000 7f9b556f8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c1ad810 con 0x55b4de62bb30 2024-08-20T01:49:51.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.862+0000 7f9b556f8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c074430 con 0x55b4de62e130 2024-08-20T01:49:51.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.862+0000 7f9b5109b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4de62afe0 0x55b4de64ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:51.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.862+0000 7f9b5109b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4de62afe0 0x55b4de64ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39408/0 (socket says 172.21.15.79:39408) 2024-08-20T01:49:51.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.862+0000 7f9b5109b640 1 -- 172.21.15.79:0/2828815534 learned_addr learned my addr 172.21.15.79:0/2828815534 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:51.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.862+0000 7f9b5189c640 1 --2- 172.21.15.79:0/2828815534 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4de62e130 0x55b4de6517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:51.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.862+0000 7f9b5089a640 1 --2- 172.21.15.79:0/2828815534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b4de62bb30 0x55b4de62a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:51.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.863+0000 7f9b5109b640 1 -- 172.21.15.79:0/2828815534 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4de62e130 msgr2=0x55b4de6517c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:51.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.863+0000 7f9b5109b640 1 --2- 172.21.15.79:0/2828815534 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4de62e130 0x55b4de6517c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:51.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.863+0000 7f9b5109b640 1 -- 172.21.15.79:0/2828815534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b4de62bb30 msgr2=0x55b4de62a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:51.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.863+0000 7f9b5109b640 1 --2- 172.21.15.79:0/2828815534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b4de62bb30 0x55b4de62a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:51.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.863+0000 7f9b5109b640 1 -- 172.21.15.79:0/2828815534 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4de620130 con 0x55b4de62afe0 2024-08-20T01:49:51.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.863+0000 7f9b5109b640 1 --2- 172.21.15.79:0/2828815534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4de62afe0 0x55b4de64ae40 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f9b48000c00 tx=0x7f9b4802b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d83addc4a0866c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:51.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.863+0000 7f9b36ffd640 1 -- 172.21.15.79:0/2828815534 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b48037070 con 0x55b4de62afe0 2024-08-20T01:49:51.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.864+0000 7f9b36ffd640 1 -- 172.21.15.79:0/2828815534 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9b48013c00 con 0x55b4de62afe0 2024-08-20T01:49:51.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.864+0000 7f9b36ffd640 1 -- 172.21.15.79:0/2828815534 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b4802e040 con 0x55b4de62afe0 2024-08-20T01:49:51.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.865+0000 7f9b556f8740 1 -- 172.21.15.79:0/2828815534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4de62afe0 msgr2=0x55b4de64ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:51.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.865+0000 7f9b556f8740 1 --2- 172.21.15.79:0/2828815534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4de62afe0 0x55b4de64ae40 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f9b48000c00 tx=0x7f9b4802b000 comp rx=0 tx=0).stop 2024-08-20T01:49:51.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.865+0000 7f9b556f8740 1 -- 172.21.15.79:0/2828815534 shutdown_connections 2024-08-20T01:49:51.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.865+0000 7f9b556f8740 1 --2- 172.21.15.79:0/2828815534 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4de62e130 0x55b4de6517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:51.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.865+0000 7f9b556f8740 1 --2- 172.21.15.79:0/2828815534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b4de62bb30 0x55b4de62a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:51.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.865+0000 7f9b556f8740 1 --2- 172.21.15.79:0/2828815534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4de62afe0 0x55b4de64ae40 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:51.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.865+0000 7f9b556f8740 1 -- 172.21.15.79:0/2828815534 >> 172.21.15.79:0/2828815534 conn(0x55b4de61f6b0 msgr2=0x55b4de624a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:51.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.865+0000 7f9b556f8740 1 -- 172.21.15.79:0/2828815534 shutdown_connections 2024-08-20T01:49:51.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.865+0000 7f9b556f8740 1 -- 172.21.15.79:0/2828815534 wait complete. 2024-08-20T01:49:51.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.866+0000 7f9b556f8740 1 -- start start 2024-08-20T01:49:51.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.866+0000 7f9b556f8740 1 Processor -- start 2024-08-20T01:49:51.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.867+0000 7f9b556f8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b4de62afe0 0x55b4de628a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:51.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.867+0000 7f9b556f8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4de62bb30 0x55b4de6272f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:51.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.867+0000 7f9b556f8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4de62e130 0x55b4de627830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:51.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.867+0000 7f9b556f8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c1ad140 con 0x55b4de62bb30 2024-08-20T01:49:51.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.867+0000 7f9b556f8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c074b00 con 0x55b4de62afe0 2024-08-20T01:49:51.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.867+0000 7f9b556f8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c071d40 con 0x55b4de62e130 2024-08-20T01:49:51.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.867+0000 7f9b556f8740 10 client.0 _ll_register_callbacks cb 0x7f9b4800a9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:49:51.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.868+0000 7f9b5089a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4de62bb30 0x55b4de6272f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:51.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.868+0000 7f9b5089a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4de62bb30 0x55b4de6272f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39424/0 (socket says 172.21.15.79:39424) 2024-08-20T01:49:51.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.868+0000 7f9b5089a640 1 -- 172.21.15.79:0/4098901652 learned_addr learned my addr 172.21.15.79:0/4098901652 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:51.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.868+0000 7f9b5089a640 1 -- 172.21.15.79:0/4098901652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4de62e130 msgr2=0x55b4de627830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:49:51.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.868+0000 7f9b5089a640 1 --2- 172.21.15.79:0/4098901652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4de62e130 0x55b4de627830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:51.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.868+0000 7f9b5089a640 1 -- 172.21.15.79:0/4098901652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b4de62afe0 msgr2=0x55b4de628a30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:49:51.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.868+0000 7f9b5089a640 1 --2- 172.21.15.79:0/4098901652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b4de62afe0 0x55b4de628a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:51.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.868+0000 7f9b5089a640 1 -- 172.21.15.79:0/4098901652 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4de61f4e0 con 0x55b4de62bb30 2024-08-20T01:49:51.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.869+0000 7f9b5089a640 1 --2- 172.21.15.79:0/4098901652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4de62bb30 0x55b4de6272f0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c01bfd0 tx=0x7f9b3c0047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c181af334c2714b8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:51.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.871+0000 7f9b34ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:49:51.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.871+0000 7f9b34ff9640 1 -- 172.21.15.79:0/4098901652 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c0ae3b0 con 0x55b4de62bb30 2024-08-20T01:49:51.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.871+0000 7f9b34ff9640 1 -- 172.21.15.79:0/4098901652 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9b3c01b920 con 0x55b4de62bb30 2024-08-20T01:49:51.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.871+0000 7f9b556f8740 1 -- 172.21.15.79:0/4098901652 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b48013c00 con 0x55b4de62bb30 2024-08-20T01:49:51.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.872+0000 7f9b34ff9640 1 -- 172.21.15.79:0/4098901652 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f9b3c0ae5f0 con 0x55b4de62bb30 2024-08-20T01:49:51.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.872+0000 7f9b556f8740 10 client.18633 fetch_fsmap learned FSMap version 51 2024-08-20T01:49:51.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.872+0000 7f9b556f8740 1 -- 172.21.15.79:0/4098901652 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55b4de646ea0 con 0x55b4de62bb30 2024-08-20T01:49:51.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.874+0000 7f9b34ff9640 1 -- 172.21.15.79:0/4098901652 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9b3c0b30a0 con 0x55b4de62bb30 2024-08-20T01:49:51.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.875+0000 7f9b34ff9640 1 -- 172.21.15.79:0/4098901652 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7f9b3c0be070 con 0x55b4de62bb30 2024-08-20T01:49:51.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.876+0000 7f9b556f8740 10 client.18633 fetch_fsmap finished waiting for FSMap version 51 2024-08-20T01:49:51.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.876+0000 7f9b556f8740 10 client.18633 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:49:51.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.876+0000 7f9b556f8740 20 client.18633 populate_metadata read hostname 'smithi079' 2024-08-20T01:49:51.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.876+0000 7f9b556f8740 1 --2- 172.21.15.79:0/4098901652 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55b4de647580 0x55b4de6bc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:51.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.876+0000 7f9b556f8740 4 client.18633 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:49:51.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.876+0000 7f9b556f8740 1 -- 172.21.15.79:0/4098901652 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f9b48013c00 con 0x55b4de647580 2024-08-20T01:49:51.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.876+0000 7f9b5109b640 1 --2- 172.21.15.79:0/4098901652 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55b4de647580 0x55b4de6bc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:51.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.880+0000 7f9b5109b640 1 --2- 172.21.15.79:0/4098901652 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55b4de647580 0x55b4de6bc4a0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c0a77959e3853679 server_cookie=f1be8936e14e9901 in_seq=0 out_seq=0 2024-08-20T01:49:51.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.880+0000 7f9b34ff9640 10 client.18633 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:49:51.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.880+0000 7f9b34ff9640 1 -- 172.21.15.79:0/4098901652 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f9b48013c00 con 0x55b4de647580 2024-08-20T01:49:51.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.880+0000 7f9b34ff9640 10 client.18633 handle_command_reply: tid=0 2024-08-20T01:49:51.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.880+0000 7f9b556f8740 1 client.18633 shutdown 2024-08-20T01:49:51.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.881+0000 7f9b556f8740 1 -- 172.21.15.79:0/4098901652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4de62bb30 msgr2=0x55b4de6272f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:51.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.881+0000 7f9b556f8740 1 --2- 172.21.15.79:0/4098901652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4de62bb30 0x55b4de6272f0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c01bfd0 tx=0x7f9b3c0047d0 comp rx=0 tx=0).stop 2024-08-20T01:49:51.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.881+0000 7f9b556f8740 1 -- 172.21.15.79:0/4098901652 shutdown_connections 2024-08-20T01:49:51.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.882+0000 7f9b556f8740 1 --2- 172.21.15.79:0/4098901652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4de62e130 0x55b4de627830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:51.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.882+0000 7f9b556f8740 1 --2- 172.21.15.79:0/4098901652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4de62bb30 0x55b4de6272f0 secure :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c01bfd0 tx=0x7f9b3c0047d0 comp rx=0 tx=0).stop 2024-08-20T01:49:51.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.882+0000 7f9b556f8740 1 --2- 172.21.15.79:0/4098901652 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55b4de647580 0x55b4de6bc4a0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:51.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.882+0000 7f9b556f8740 1 --2- 172.21.15.79:0/4098901652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b4de62afe0 0x55b4de628a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:51.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.882+0000 7f9b34ff9640 0 client.18633 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:49:51.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.882+0000 7f9b556f8740 1 -- 172.21.15.79:0/4098901652 >> 172.21.15.79:0/4098901652 conn(0x55b4de61f6b0 msgr2=0x55b4de6227c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:51.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.882+0000 7f9b556f8740 1 -- 172.21.15.79:0/4098901652 shutdown_connections 2024-08-20T01:49:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.882+0000 7f9b556f8740 1 -- 172.21.15.79:0/4098901652 wait complete. 2024-08-20T01:49:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.883+0000 7f9b556f8740 20 client.18633 trim_cache size 0 max 16384 2024-08-20T01:49:51.886 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:49:51.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.883+0000 7f9b532ff640 1 -- 172.21.15.79:0/935697558 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9b380b3da0 msgr2=0x7f9b380b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:51.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.883+0000 7f9b532ff640 1 --2- 172.21.15.79:0/935697558 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9b380b3da0 0x7f9b380b6260 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f9b4800af10 tx=0x7f9b4800a680 comp rx=0 tx=0).stop 2024-08-20T01:49:51.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.883+0000 7f9b532ff640 1 -- 172.21.15.79:0/935697558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b4c1073d0 msgr2=0x7f9b4c1982f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:51.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.883+0000 7f9b532ff640 1 --2- 172.21.15.79:0/935697558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b4c1073d0 0x7f9b4c1982f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c00b4a0 tx=0x7f9b3c00b960 comp rx=0 tx=0).stop 2024-08-20T01:49:51.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.883+0000 7f9b532ff640 1 -- 172.21.15.79:0/935697558 shutdown_connections 2024-08-20T01:49:51.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.884+0000 7f9b532ff640 1 --2- 172.21.15.79:0/935697558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b4c107d50 0x7f9b4c19d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:51.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.884+0000 7f9b532ff640 1 --2- 172.21.15.79:0/935697558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b4c1073d0 0x7f9b4c1982f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:51.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.884+0000 7f9b532ff640 1 --2- 172.21.15.79:0/935697558 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9b380b3da0 0x7f9b380b6260 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:51.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.884+0000 7f9b532ff640 1 --2- 172.21.15.79:0/935697558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b4c1019c0 0x7f9b4c197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:51.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.884+0000 7f9b532ff640 1 -- 172.21.15.79:0/935697558 >> 172.21.15.79:0/935697558 conn(0x7f9b4c0fd450 msgr2=0x7f9b4c0ff840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:51.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.884+0000 7f9b532ff640 1 -- 172.21.15.79:0/935697558 shutdown_connections 2024-08-20T01:49:51.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:51.884+0000 7f9b532ff640 1 -- 172.21.15.79:0/935697558 wait complete. 2024-08-20T01:49:52.513 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:52 smithi079 ceph-mon[18656]: pgmap v723: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 MiB/s wr, 5.78k op/s 2024-08-20T01:49:52.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:52 smithi081 ceph-mon[22209]: pgmap v723: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 MiB/s wr, 5.78k op/s 2024-08-20T01:49:52.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:52 smithi175 ceph-mon[22392]: pgmap v723: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 MiB/s wr, 5.78k op/s 2024-08-20T01:49:52.793 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T01:49:53.244 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:49:54.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:54 smithi081 ceph-mon[22209]: pgmap v724: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 22 MiB/s wr, 5.48k op/s 2024-08-20T01:49:54.550 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:54 smithi079 ceph-mon[18656]: pgmap v724: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 22 MiB/s wr, 5.48k op/s 2024-08-20T01:49:54.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:54 smithi175 ceph-mon[22392]: pgmap v724: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 22 MiB/s wr, 5.48k op/s 2024-08-20T01:49:56.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:56 smithi081 ceph-mon[22209]: pgmap v725: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 6.03k op/s 2024-08-20T01:49:56.620 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:56 smithi079 ceph-mon[18656]: pgmap v725: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 6.03k op/s 2024-08-20T01:49:56.620 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:49:56.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.769+0000 7ff699ffb640 1 -- 172.21.15.79:0/1201175073 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69c099630 con 0x7ff6940a47d0 2024-08-20T01:49:56.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.769+0000 7ff6a1387640 1 -- 172.21.15.79:0/1201175073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6940a47d0 msgr2=0x7ff6940a4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:56.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.769+0000 7ff6a1387640 1 --2- 172.21.15.79:0/1201175073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6940a47d0 0x7ff6940a4bf0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff69c068900 tx=0x7ff69c091430 comp rx=0 tx=0).stop 2024-08-20T01:49:56.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.769+0000 7ff6a1387640 1 -- 172.21.15.79:0/1201175073 shutdown_connections 2024-08-20T01:49:56.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.769+0000 7ff6a1387640 1 --2- 172.21.15.79:0/1201175073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6940a5130 0x7ff69400b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:56.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.769+0000 7ff6a1387640 1 --2- 172.21.15.79:0/1201175073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6940a47d0 0x7ff6940a4bf0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:56.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.769+0000 7ff6a1387640 1 --2- 172.21.15.79:0/1201175073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6940a71a0 0x7ff6940a7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:56.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.769+0000 7ff6a1387640 1 -- 172.21.15.79:0/1201175073 >> 172.21.15.79:0/1201175073 conn(0x7ff69401a080 msgr2=0x7ff69401c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:56.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.769+0000 7ff6a1387640 1 -- 172.21.15.79:0/1201175073 shutdown_connections 2024-08-20T01:49:56.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.769+0000 7ff6a1387640 1 -- 172.21.15.79:0/1201175073 wait complete. 2024-08-20T01:49:56.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.770+0000 7ff6a1387640 1 Processor -- start 2024-08-20T01:49:56.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.770+0000 7ff6a1387640 1 -- start start 2024-08-20T01:49:56.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.771+0000 7ff6a1387640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6940a47d0 0x7ff694016060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:56.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.771+0000 7ff6a1387640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6940a5130 0x7ff694010280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:56.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.771+0000 7ff6a1387640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6940a71a0 0x7ff6940107c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:56.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.771+0000 7ff6a1387640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff69400eac0 con 0x7ff6940a47d0 2024-08-20T01:49:56.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.771+0000 7ff6a1387640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff69400e940 con 0x7ff6940a71a0 2024-08-20T01:49:56.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.771+0000 7ff6a1387640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff69400ec40 con 0x7ff6940a5130 2024-08-20T01:49:56.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.771+0000 7ff69a7fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6940a5130 0x7ff694010280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:56.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.771+0000 7ff69b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6940a71a0 0x7ff6940107c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:56.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.771+0000 7ff69a7fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6940a5130 0x7ff694010280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:48176/0 (socket says 172.21.15.79:48176) 2024-08-20T01:49:56.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.771+0000 7ff69a7fc640 1 -- 172.21.15.79:0/1005737568 learned_addr learned my addr 172.21.15.79:0/1005737568 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:56.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.771+0000 7ff69b7fe640 1 -- 172.21.15.79:0/1005737568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6940a5130 msgr2=0x7ff694010280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:56.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.771+0000 7ff69b7fe640 1 --2- 172.21.15.79:0/1005737568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6940a5130 0x7ff694010280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:56.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.772+0000 7ff69b7fe640 1 -- 172.21.15.79:0/1005737568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6940a47d0 msgr2=0x7ff694016060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:56.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.772+0000 7ff69b7fe640 1 --2- 172.21.15.79:0/1005737568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6940a47d0 0x7ff694016060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:56.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.772+0000 7ff69b7fe640 1 -- 172.21.15.79:0/1005737568 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff694010fc0 con 0x7ff6940a71a0 2024-08-20T01:49:56.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.772+0000 7ff69b7fe640 1 --2- 172.21.15.79:0/1005737568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6940a71a0 0x7ff6940107c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff69000a9b0 tx=0x7ff69000ae70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:56.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.772+0000 7ff683fff640 1 -- 172.21.15.79:0/1005737568 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6900079f0 con 0x7ff6940a71a0 2024-08-20T01:49:56.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.772+0000 7ff683fff640 1 -- 172.21.15.79:0/1005737568 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff6900054b0 con 0x7ff6940a71a0 2024-08-20T01:49:56.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.772+0000 7ff683fff640 1 -- 172.21.15.79:0/1005737568 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff690004d60 con 0x7ff6940a71a0 2024-08-20T01:49:56.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.772+0000 7ff6a1387640 1 -- 172.21.15.79:0/1005737568 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff694157f30 con 0x7ff6940a71a0 2024-08-20T01:49:56.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.772+0000 7ff6a1387640 1 -- 172.21.15.79:0/1005737568 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff694158390 con 0x7ff6940a71a0 2024-08-20T01:49:56.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.786+0000 7ff6a3780740 1 Processor -- start 2024-08-20T01:49:56.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.787+0000 7ff6a3780740 1 -- start start 2024-08-20T01:49:56.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.787+0000 7ff6a3780740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7b2c02a30 0x55b7b2c02e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:56.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.787+0000 7ff6a3780740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7b2c03350 0x55b7b2c0eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:56.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.787+0000 7ff6a3780740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7b2c0f2e0 0x55b7b2c116d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:56.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.787+0000 7ff6a3780740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b7b2b79930 con 0x55b7b2c02a30 2024-08-20T01:49:56.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.787+0000 7ff6a3780740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b7b2b68e30 con 0x55b7b2c0f2e0 2024-08-20T01:49:56.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.787+0000 7ff6a3780740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b7b2b6ce70 con 0x55b7b2c03350 2024-08-20T01:49:56.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.789+0000 7ff683fff640 1 -- 172.21.15.79:0/1005737568 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff690017070 con 0x7ff6940a71a0 2024-08-20T01:49:56.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.790+0000 7ff683fff640 1 --2- 172.21.15.79:0/1005737568 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff6840c4c60 0x7ff6840c7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:56.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.790+0000 7ff683fff640 1 -- 172.21.15.79:0/1005737568 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff6900e2ef0 con 0x7ff6940a71a0 2024-08-20T01:49:56.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.791+0000 7ff69b7fe640 1 --2- 172.21.15.79:0/1005737568 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff6840c4c60 0x7ff6840c7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:56.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.791+0000 7ff69b7fe640 1 --2- 172.21.15.79:0/1005737568 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff6840c4c60 0x7ff6840c7120 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff6900a5e20 tx=0x7ff690005660 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:56.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.793+0000 7ff69a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7b2c0f2e0 0x55b7b2c116d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:56.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.793+0000 7ff69a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7b2c0f2e0 0x55b7b2c116d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:48342/0 (socket says 172.21.15.79:48342) 2024-08-20T01:49:56.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.793+0000 7ff69a7fc640 1 -- 172.21.15.79:0/768042643 learned_addr learned my addr 172.21.15.79:0/768042643 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:56.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.793+0000 7ff69a7fc640 1 -- 172.21.15.79:0/768042643 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7b2c03350 msgr2=0x55b7b2c0eda0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:49:56.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.793+0000 7ff69a7fc640 1 --2- 172.21.15.79:0/768042643 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7b2c03350 0x55b7b2c0eda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:56.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.793+0000 7ff69a7fc640 1 -- 172.21.15.79:0/768042643 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7b2c02a30 msgr2=0x55b7b2c02e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:56.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.793+0000 7ff69a7fc640 1 --2- 172.21.15.79:0/768042643 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7b2c02a30 0x55b7b2c02e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:56.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.793+0000 7ff69a7fc640 1 -- 172.21.15.79:0/768042643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7b28c8650 con 0x55b7b2c0f2e0 2024-08-20T01:49:56.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.794+0000 7ff69a7fc640 1 --2- 172.21.15.79:0/768042643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7b2c0f2e0 0x55b7b2c116d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff69c051e80 tx=0x7ff69c051530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7bac86bb0910377 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:56.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.794+0000 7ff6817fa640 1 -- 172.21.15.79:0/768042643 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69c09e040 con 0x55b7b2c0f2e0 2024-08-20T01:49:56.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.794+0000 7ff6817fa640 1 -- 172.21.15.79:0/768042643 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff69c09f040 con 0x55b7b2c0f2e0 2024-08-20T01:49:56.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.795+0000 7ff6817fa640 1 -- 172.21.15.79:0/768042643 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69c099a90 con 0x55b7b2c0f2e0 2024-08-20T01:49:56.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.795+0000 7ff6a3780740 1 -- 172.21.15.79:0/768042643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7b2c0f2e0 msgr2=0x55b7b2c116d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:56.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.795+0000 7ff6a3780740 1 --2- 172.21.15.79:0/768042643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7b2c0f2e0 0x55b7b2c116d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff69c051e80 tx=0x7ff69c051530 comp rx=0 tx=0).stop 2024-08-20T01:49:56.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.796+0000 7ff6a3780740 1 -- 172.21.15.79:0/768042643 shutdown_connections 2024-08-20T01:49:56.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.796+0000 7ff6a3780740 1 --2- 172.21.15.79:0/768042643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7b2c0f2e0 0x55b7b2c116d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:56.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.796+0000 7ff6a3780740 1 --2- 172.21.15.79:0/768042643 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7b2c03350 0x55b7b2c0eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:56.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.796+0000 7ff6a3780740 1 --2- 172.21.15.79:0/768042643 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7b2c02a30 0x55b7b2c02e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:56.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.796+0000 7ff6a3780740 1 -- 172.21.15.79:0/768042643 >> 172.21.15.79:0/768042643 conn(0x55b7b2c00860 msgr2=0x55b7b2c01a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:56.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.797+0000 7ff6a3780740 1 -- 172.21.15.79:0/768042643 shutdown_connections 2024-08-20T01:49:56.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.797+0000 7ff6a3780740 1 -- 172.21.15.79:0/768042643 wait complete. 2024-08-20T01:49:56.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.797+0000 7ff6a3780740 1 -- start start 2024-08-20T01:49:56.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.798+0000 7ff6a3780740 1 Processor -- start 2024-08-20T01:49:56.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.798+0000 7ff6a3780740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7b2c02a30 0x55b7b2c0c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:56.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.798+0000 7ff6a3780740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7b2c03350 0x55b7b2c0c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:56.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.798+0000 7ff6a3780740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7b2c0f2e0 0x55b7b2c0cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:56.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.798+0000 7ff6a3780740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b7b29cb700 con 0x55b7b2c0f2e0 2024-08-20T01:49:56.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.798+0000 7ff6a3780740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b7b2aef810 con 0x55b7b2c03350 2024-08-20T01:49:56.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.798+0000 7ff6a3780740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b7b2c11f80 con 0x55b7b2c02a30 2024-08-20T01:49:56.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.798+0000 7ff6a3780740 10 client.0 _ll_register_callbacks cb 0x55b7b2b62700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:49:56.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.799+0000 7ff69affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7b2c03350 0x55b7b2c0c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:56.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.799+0000 7ff69affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7b2c03350 0x55b7b2c0c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:48354/0 (socket says 172.21.15.79:48354) 2024-08-20T01:49:56.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.799+0000 7ff69affd640 1 -- 172.21.15.79:0/2459009164 learned_addr learned my addr 172.21.15.79:0/2459009164 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:56.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.799+0000 7ff69a7fc640 1 --2- 172.21.15.79:0/2459009164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7b2c0f2e0 0x55b7b2c0cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:56.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.799+0000 7ff69a7fc640 1 --2- 172.21.15.79:0/2459009164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7b2c02a30 0x55b7b2c0c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:56.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.799+0000 7ff69affd640 1 -- 172.21.15.79:0/2459009164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7b2c02a30 msgr2=0x55b7b2c0c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:56.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.799+0000 7ff69affd640 1 --2- 172.21.15.79:0/2459009164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7b2c02a30 0x55b7b2c0c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:56.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.799+0000 7ff69affd640 1 -- 172.21.15.79:0/2459009164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7b2c0f2e0 msgr2=0x55b7b2c0cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:56.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.799+0000 7ff69affd640 1 --2- 172.21.15.79:0/2459009164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7b2c0f2e0 0x55b7b2c0cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:56.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.799+0000 7ff69affd640 1 -- 172.21.15.79:0/2459009164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7b2c1b360 con 0x55b7b2c03350 2024-08-20T01:49:56.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.804+0000 7ff69affd640 1 --2- 172.21.15.79:0/2459009164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7b2c03350 0x55b7b2c0c740 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff68c00bb60 tx=0x7ff68c00d6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ed585bf6d2a6b9b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:56.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.804+0000 7ff67eff5640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:49:56.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.804+0000 7ff67eff5640 1 -- 172.21.15.79:0/2459009164 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68c016070 con 0x55b7b2c03350 2024-08-20T01:49:56.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.804+0000 7ff67eff5640 1 -- 172.21.15.79:0/2459009164 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff68c010660 con 0x55b7b2c03350 2024-08-20T01:49:56.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.805+0000 7ff6a3780740 1 -- 172.21.15.79:0/2459009164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b7b2b18150 con 0x55b7b2c03350 2024-08-20T01:49:56.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.807+0000 7ff67eff5640 1 -- 172.21.15.79:0/2459009164 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7ff68c020050 con 0x55b7b2c03350 2024-08-20T01:49:56.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.809+0000 7ff6a3780740 10 client.27761 fetch_fsmap learned FSMap version 51 2024-08-20T01:49:56.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.809+0000 7ff6a3780740 1 -- 172.21.15.79:0/2459009164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55b7b2c1dd70 con 0x55b7b2c03350 2024-08-20T01:49:56.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.812+0000 7ff67eff5640 1 -- 172.21.15.79:0/2459009164 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55b7b2b18150 con 0x55b7b2c03350 2024-08-20T01:49:56.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.812+0000 7ff67eff5640 1 -- 172.21.15.79:0/2459009164 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7ff68c01b720 con 0x55b7b2c03350 2024-08-20T01:49:56.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.812+0000 7ff6a3780740 10 client.27761 fetch_fsmap finished waiting for FSMap version 51 2024-08-20T01:49:56.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.812+0000 7ff6a3780740 10 client.27761 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:49:56.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.812+0000 7ff6a3780740 20 client.27761 populate_metadata read hostname 'smithi079' 2024-08-20T01:49:56.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.812+0000 7ff6a3780740 1 --2- 172.21.15.79:0/2459009164 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55b7b2c1f2f0 0x55b7b2c21710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:56.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.812+0000 7ff6a3780740 4 client.27761 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:49:56.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.812+0000 7ff6a3780740 1 -- 172.21.15.79:0/2459009164 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b7b2b7b880 con 0x55b7b2c1f2f0 2024-08-20T01:49:56.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.812+0000 7ff69a7fc640 1 --2- 172.21.15.79:0/2459009164 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55b7b2c1f2f0 0x55b7b2c21710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:56.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.813+0000 7ff69a7fc640 1 --2- 172.21.15.79:0/2459009164 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55b7b2c1f2f0 0x55b7b2c21710 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab845faed13cb110 server_cookie=b0ef746cadcdef8b in_seq=0 out_seq=0 2024-08-20T01:49:56.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.813+0000 7ff67eff5640 10 client.27761 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:49:56.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.814+0000 7ff67eff5640 1 -- 172.21.15.79:0/2459009164 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b7b2b7b880 con 0x55b7b2c1f2f0 2024-08-20T01:49:56.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.814+0000 7ff67eff5640 10 client.27761 handle_command_reply: tid=0 2024-08-20T01:49:56.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.814+0000 7ff6a3780740 1 client.27761 shutdown 2024-08-20T01:49:56.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.821+0000 7ff6a3780740 1 -- 172.21.15.79:0/2459009164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7b2c03350 msgr2=0x55b7b2c0c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:56.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.821+0000 7ff6a3780740 1 --2- 172.21.15.79:0/2459009164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7b2c03350 0x55b7b2c0c740 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff68c00bb60 tx=0x7ff68c00d6b0 comp rx=0 tx=0).stop 2024-08-20T01:49:56.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.822+0000 7ff6a3780740 1 -- 172.21.15.79:0/2459009164 shutdown_connections 2024-08-20T01:49:56.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.822+0000 7ff6a3780740 1 --2- 172.21.15.79:0/2459009164 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55b7b2c1f2f0 0x55b7b2c21710 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:56.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.822+0000 7ff6a3780740 1 --2- 172.21.15.79:0/2459009164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7b2c0f2e0 0x55b7b2c0cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:56.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.822+0000 7ff6a3780740 1 --2- 172.21.15.79:0/2459009164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7b2c03350 0x55b7b2c0c740 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:56.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.822+0000 7ff6a3780740 1 --2- 172.21.15.79:0/2459009164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7b2c02a30 0x55b7b2c0c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:56.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.822+0000 7ff6a3780740 1 -- 172.21.15.79:0/2459009164 >> 172.21.15.79:0/2459009164 conn(0x55b7b2c00860 msgr2=0x55b7b2c06400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:56.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.822+0000 7ff67eff5640 0 client.27761 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:49:56.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.822+0000 7ff6a3780740 1 -- 172.21.15.79:0/2459009164 shutdown_connections 2024-08-20T01:49:56.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.822+0000 7ff6a3780740 1 -- 172.21.15.79:0/2459009164 wait complete. 2024-08-20T01:49:56.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.823+0000 7ff6a3780740 20 client.27761 trim_cache size 0 max 16384 2024-08-20T01:49:56.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.849+0000 7ff6a3780740 1 Processor -- start 2024-08-20T01:49:56.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.849+0000 7ff6a3780740 1 -- start start 2024-08-20T01:49:56.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.849+0000 7ff6a3780740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7b2c02a30 0x55b7b2c26fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:56.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.850+0000 7ff6a3780740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7b2c03350 0x55b7b2c27520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:56.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.850+0000 7ff69a7fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7b2c02a30 0x55b7b2c26fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:56.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.850+0000 7ff69a7fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7b2c02a30 0x55b7b2c26fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:48200/0 (socket says 172.21.15.79:48200) 2024-08-20T01:49:56.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.850+0000 7ff69a7fc640 1 -- 172.21.15.79:0/1887389736 learned_addr learned my addr 172.21.15.79:0/1887389736 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:56.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.850+0000 7ff69affd640 1 --2- 172.21.15.79:0/1887389736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7b2c03350 0x55b7b2c27520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:56.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.850+0000 7ff6a3780740 1 --2- 172.21.15.79:0/1887389736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7b2c0f2e0 0x55b7b2c172b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:56.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.851+0000 7ff6a3780740 1 -- 172.21.15.79:0/1887389736 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff694160b10 con 0x55b7b2c0f2e0 2024-08-20T01:49:56.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.851+0000 7ff6a3780740 1 -- 172.21.15.79:0/1887389736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff694162650 con 0x55b7b2c03350 2024-08-20T01:49:56.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.851+0000 7ff6a3780740 1 -- 172.21.15.79:0/1887389736 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff6941611e0 con 0x55b7b2c02a30 2024-08-20T01:49:56.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.851+0000 7ff69affd640 1 -- 172.21.15.79:0/1887389736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7b2c02a30 msgr2=0x55b7b2c26fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:56.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.851+0000 7ff69affd640 1 --2- 172.21.15.79:0/1887389736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7b2c02a30 0x55b7b2c26fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:56.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.851+0000 7ff69affd640 1 -- 172.21.15.79:0/1887389736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7b2c0f2e0 msgr2=0x55b7b2c172b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:56.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.851+0000 7ff69a7fc640 1 --2- 172.21.15.79:0/1887389736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7b2c0f2e0 0x55b7b2c172b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:56.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.851+0000 7ff69affd640 1 --2- 172.21.15.79:0/1887389736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7b2c0f2e0 0x55b7b2c172b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:56.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.851+0000 7ff69affd640 1 -- 172.21.15.79:0/1887389736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7b2c012e0 con 0x55b7b2c03350 2024-08-20T01:49:56.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.852+0000 7ff69affd640 1 --2- 172.21.15.79:0/1887389736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7b2c03350 0x55b7b2c27520 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff68c00dbb0 tx=0x7ff68c00df20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8fb7e070a33c424 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:56.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.852+0000 7ff69a7fc640 1 --2- 172.21.15.79:0/1887389736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7b2c0f2e0 0x55b7b2c172b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:49:56.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.852+0000 7ff680ff9640 1 -- 172.21.15.79:0/1887389736 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68c016040 con 0x55b7b2c03350 2024-08-20T01:49:56.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.852+0000 7ff680ff9640 1 -- 172.21.15.79:0/1887389736 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff68c0044d0 con 0x55b7b2c03350 2024-08-20T01:49:56.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.852+0000 7ff680ff9640 1 -- 172.21.15.79:0/1887389736 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68c003850 con 0x55b7b2c03350 2024-08-20T01:49:56.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.853+0000 7ff6a3780740 1 -- 172.21.15.79:0/1887389736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7b2c03350 msgr2=0x55b7b2c27520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:56.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.853+0000 7ff6a3780740 1 --2- 172.21.15.79:0/1887389736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7b2c03350 0x55b7b2c27520 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff68c00dbb0 tx=0x7ff68c00df20 comp rx=0 tx=0).stop 2024-08-20T01:49:56.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.853+0000 7ff6a3780740 1 -- 172.21.15.79:0/1887389736 shutdown_connections 2024-08-20T01:49:56.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.853+0000 7ff6a3780740 1 --2- 172.21.15.79:0/1887389736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7b2c0f2e0 0x55b7b2c172b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:56.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.853+0000 7ff6a3780740 1 --2- 172.21.15.79:0/1887389736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7b2c03350 0x55b7b2c27520 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:56.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.853+0000 7ff6a3780740 1 --2- 172.21.15.79:0/1887389736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7b2c02a30 0x55b7b2c26fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:56.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.853+0000 7ff6a3780740 1 -- 172.21.15.79:0/1887389736 >> 172.21.15.79:0/1887389736 conn(0x55b7b2c00860 msgr2=0x55b7b2c0e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:56.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.853+0000 7ff6a3780740 1 -- 172.21.15.79:0/1887389736 shutdown_connections 2024-08-20T01:49:56.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.853+0000 7ff6a3780740 1 -- 172.21.15.79:0/1887389736 wait complete. 2024-08-20T01:49:56.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.854+0000 7ff6a3780740 1 -- start start 2024-08-20T01:49:56.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.854+0000 7ff6a3780740 1 Processor -- start 2024-08-20T01:49:56.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.855+0000 7ff6a3780740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7b2c02a30 0x55b7b2c17b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:56.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.855+0000 7ff6a3780740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7b2c03350 0x55b7b2c13fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:56.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.855+0000 7ff6a3780740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7b2c0f2e0 0x55b7b2c146d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:56.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.855+0000 7ff6a3780740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff694161f80 con 0x55b7b2c03350 2024-08-20T01:49:56.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.855+0000 7ff6a3780740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff6941618b0 con 0x55b7b2c02a30 2024-08-20T01:49:56.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.855+0000 7ff6a3780740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff69415eaf0 con 0x55b7b2c0f2e0 2024-08-20T01:49:56.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.855+0000 7ff6a3780740 10 client.0 _ll_register_callbacks cb 0x7ff68c005f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:49:56.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.855+0000 7ff69affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7b2c03350 0x55b7b2c13fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:56.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.855+0000 7ff69affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7b2c03350 0x55b7b2c13fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39472/0 (socket says 172.21.15.79:39472) 2024-08-20T01:49:56.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.855+0000 7ff69affd640 1 -- 172.21.15.79:0/3913302298 learned_addr learned my addr 172.21.15.79:0/3913302298 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:49:56.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.856+0000 7ff69a7fc640 1 --2- 172.21.15.79:0/3913302298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7b2c0f2e0 0x55b7b2c146d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:56.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.856+0000 7ff69a7fc640 1 --2- 172.21.15.79:0/3913302298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7b2c02a30 0x55b7b2c17b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:56.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.856+0000 7ff69a7fc640 1 -- 172.21.15.79:0/3913302298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7b2c02a30 msgr2=0x55b7b2c17b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:56.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.856+0000 7ff69a7fc640 1 --2- 172.21.15.79:0/3913302298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7b2c02a30 0x55b7b2c17b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:56.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.856+0000 7ff69a7fc640 1 -- 172.21.15.79:0/3913302298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7b2c03350 msgr2=0x55b7b2c13fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:49:56.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.856+0000 7ff69a7fc640 1 --2- 172.21.15.79:0/3913302298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7b2c03350 0x55b7b2c13fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:56.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.856+0000 7ff69a7fc640 1 -- 172.21.15.79:0/3913302298 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7b2c01750 con 0x55b7b2c0f2e0 2024-08-20T01:49:56.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.857+0000 7ff69a7fc640 1 --2- 172.21.15.79:0/3913302298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7b2c0f2e0 0x55b7b2c146d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff69c068970 tx=0x7ff68c00b690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71ee56ae6542170d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:49:56.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.858+0000 7ff67eff5640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:49:56.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.858+0000 7ff67eff5640 1 -- 172.21.15.79:0/3913302298 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69c099a70 con 0x55b7b2c0f2e0 2024-08-20T01:49:56.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.858+0000 7ff67eff5640 1 -- 172.21.15.79:0/3913302298 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff69c0976f0 con 0x55b7b2c0f2e0 2024-08-20T01:49:56.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.858+0000 7ff6a3780740 1 -- 172.21.15.79:0/3913302298 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff68c0044d0 con 0x55b7b2c0f2e0 2024-08-20T01:49:56.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.859+0000 7ff67eff5640 1 -- 172.21.15.79:0/3913302298 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7ff69c0978f0 con 0x55b7b2c0f2e0 2024-08-20T01:49:56.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.859+0000 7ff6a3780740 10 client.27700 fetch_fsmap learned FSMap version 51 2024-08-20T01:49:56.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.859+0000 7ff6a3780740 1 -- 172.21.15.79:0/3913302298 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55b7b2c88fc0 con 0x55b7b2c0f2e0 2024-08-20T01:49:56.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.859+0000 7ff67eff5640 1 -- 172.21.15.79:0/3913302298 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff68c0044d0 con 0x55b7b2c0f2e0 2024-08-20T01:49:56.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.859+0000 7ff67eff5640 1 -- 172.21.15.79:0/3913302298 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7ff69c0b4980 con 0x55b7b2c0f2e0 2024-08-20T01:49:56.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.859+0000 7ff6a3780740 10 client.27700 fetch_fsmap finished waiting for FSMap version 51 2024-08-20T01:49:56.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.859+0000 7ff6a3780740 10 client.27700 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:49:56.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.859+0000 7ff6a3780740 20 client.27700 populate_metadata read hostname 'smithi079' 2024-08-20T01:49:56.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.859+0000 7ff6a3780740 1 --2- 172.21.15.79:0/3913302298 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55b7b2c89300 0x55b7b2c8b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:49:56.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.860+0000 7ff6a3780740 4 client.27700 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:49:56.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.860+0000 7ff6a3780740 1 -- 172.21.15.79:0/3913302298 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b7b2b77320 con 0x55b7b2c89300 2024-08-20T01:49:56.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.860+0000 7ff69affd640 1 --2- 172.21.15.79:0/3913302298 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55b7b2c89300 0x55b7b2c8b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:49:56.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.860+0000 7ff69affd640 1 --2- 172.21.15.79:0/3913302298 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55b7b2c89300 0x55b7b2c8b6f0 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=331f9c57f424f12d server_cookie=f5245f787963169 in_seq=0 out_seq=0 2024-08-20T01:49:56.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.860+0000 7ff67eff5640 10 client.27700 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:49:56.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.860+0000 7ff67eff5640 1 -- 172.21.15.79:0/3913302298 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b7b2b77320 con 0x55b7b2c89300 2024-08-20T01:49:56.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.861+0000 7ff67eff5640 10 client.27700 handle_command_reply: tid=0 2024-08-20T01:49:56.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.861+0000 7ff6a3780740 1 client.27700 shutdown 2024-08-20T01:49:56.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.861+0000 7ff6a3780740 1 -- 172.21.15.79:0/3913302298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7b2c0f2e0 msgr2=0x55b7b2c146d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:56.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.861+0000 7ff6a3780740 1 --2- 172.21.15.79:0/3913302298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7b2c0f2e0 0x55b7b2c146d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff69c068970 tx=0x7ff68c00b690 comp rx=0 tx=0).stop 2024-08-20T01:49:56.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.861+0000 7ff6a3780740 1 -- 172.21.15.79:0/3913302298 shutdown_connections 2024-08-20T01:49:56.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.861+0000 7ff6a3780740 1 --2- 172.21.15.79:0/3913302298 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55b7b2c89300 0x55b7b2c8b6f0 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:56.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.861+0000 7ff6a3780740 1 --2- 172.21.15.79:0/3913302298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b7b2c0f2e0 0x55b7b2c146d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:56.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.861+0000 7ff6a3780740 1 --2- 172.21.15.79:0/3913302298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7b2c03350 0x55b7b2c13fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:56.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.861+0000 7ff6a3780740 1 --2- 172.21.15.79:0/3913302298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7b2c02a30 0x55b7b2c17b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:56.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.861+0000 7ff6a3780740 1 -- 172.21.15.79:0/3913302298 >> 172.21.15.79:0/3913302298 conn(0x55b7b2c00860 msgr2=0x55b7b2bfefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:56.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.861+0000 7ff67eff5640 0 client.27700 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:49:56.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.861+0000 7ff6a3780740 1 -- 172.21.15.79:0/3913302298 shutdown_connections 2024-08-20T01:49:56.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.861+0000 7ff6a3780740 1 -- 172.21.15.79:0/3913302298 wait complete. 2024-08-20T01:49:56.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.861+0000 7ff6a3780740 20 client.27700 trim_cache size 0 max 16384 2024-08-20T01:49:56.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.862+0000 7ff6a1387640 1 -- 172.21.15.79:0/1005737568 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff6840c4c60 msgr2=0x7ff6840c7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:56.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.862+0000 7ff6a1387640 1 --2- 172.21.15.79:0/1005737568 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff6840c4c60 0x7ff6840c7120 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff6900a5e20 tx=0x7ff690005660 comp rx=0 tx=0).stop 2024-08-20T01:49:56.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.862+0000 7ff6a1387640 1 -- 172.21.15.79:0/1005737568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6940a71a0 msgr2=0x7ff6940107c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:49:56.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.862+0000 7ff6a1387640 1 --2- 172.21.15.79:0/1005737568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6940a71a0 0x7ff6940107c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff69000a9b0 tx=0x7ff69000ae70 comp rx=0 tx=0).stop 2024-08-20T01:49:56.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.863+0000 7ff6a1387640 1 -- 172.21.15.79:0/1005737568 shutdown_connections 2024-08-20T01:49:56.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.863+0000 7ff6a1387640 1 --2- 172.21.15.79:0/1005737568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6940a71a0 0x7ff6940107c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:56.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.863+0000 7ff6a1387640 1 --2- 172.21.15.79:0/1005737568 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff6840c4c60 0x7ff6840c7120 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:56.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.863+0000 7ff6a1387640 1 --2- 172.21.15.79:0/1005737568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6940a5130 0x7ff694010280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:56.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.863+0000 7ff6a1387640 1 --2- 172.21.15.79:0/1005737568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6940a47d0 0x7ff694016060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:49:56.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.863+0000 7ff6a1387640 1 -- 172.21.15.79:0/1005737568 >> 172.21.15.79:0/1005737568 conn(0x7ff69401a080 msgr2=0x7ff6940a9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:49:56.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.863+0000 7ff6a1387640 1 -- 172.21.15.79:0/1005737568 shutdown_connections 2024-08-20T01:49:56.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:49:55.863+0000 7ff6a1387640 1 -- 172.21.15.79:0/1005737568 wait complete. 2024-08-20T01:49:56.641 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:56 smithi175 ceph-mon[22392]: pgmap v725: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 6.03k op/s 2024-08-20T01:49:58.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:49:58 smithi081 ceph-mon[22209]: pgmap v726: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 6.03k op/s 2024-08-20T01:49:58.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:49:58 smithi175 ceph-mon[22392]: pgmap v726: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 6.03k op/s 2024-08-20T01:49:58.689 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:49:58 smithi079 ceph-mon[18656]: pgmap v726: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 6.03k op/s 2024-08-20T01:49:59.332 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T01:49:59.333 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T01:49:59.817 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:50:00.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.427+0000 7facd0327640 1 -- 172.21.15.79:0/2100663411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facc0097a20 msgr2=0x7facc0097e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:00.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.427+0000 7facd0327640 1 --2- 172.21.15.79:0/2100663411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facc0097a20 0x7facc0097e00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7facc4009980 tx=0x7facc403b450 comp rx=0 tx=0).stop 2024-08-20T01:50:00.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.427+0000 7facd0327640 1 -- 172.21.15.79:0/2100663411 shutdown_connections 2024-08-20T01:50:00.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.427+0000 7facd0327640 1 --2- 172.21.15.79:0/2100663411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facc009ddb0 0x7facc00a45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:00.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.427+0000 7facd0327640 1 --2- 172.21.15.79:0/2100663411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facc009d430 0x7facc009d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:00.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.427+0000 7facd0327640 1 --2- 172.21.15.79:0/2100663411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facc0097a20 0x7facc0097e00 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:00.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.427+0000 7facd0327640 1 -- 172.21.15.79:0/2100663411 >> 172.21.15.79:0/2100663411 conn(0x7facc0093430 msgr2=0x7facc0095850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:00.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.430+0000 7facd0327640 1 -- 172.21.15.79:0/2100663411 shutdown_connections 2024-08-20T01:50:00.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.430+0000 7facd0327640 1 -- 172.21.15.79:0/2100663411 wait complete. 2024-08-20T01:50:00.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.430+0000 7facd0327640 1 Processor -- start 2024-08-20T01:50:00.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.431+0000 7facd0327640 1 -- start start 2024-08-20T01:50:00.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.431+0000 7facd0327640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facc0097a20 0x7facc00a4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:00.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.431+0000 7facd0327640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facc009d430 0x7facc00a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:00.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.431+0000 7facce0c3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facc0097a20 0x7facc00a4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:00.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.431+0000 7facce0c3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facc0097a20 0x7facc00a4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:60382/0 (socket says 172.21.15.79:60382) 2024-08-20T01:50:00.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.431+0000 7facce0c3640 1 -- 172.21.15.79:0/4253653722 learned_addr learned my addr 172.21.15.79:0/4253653722 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:00.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.431+0000 7facd0327640 1 --2- 172.21.15.79:0/4253653722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facc009ddb0 0x7facc00a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:00.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.432+0000 7facd0327640 1 -- 172.21.15.79:0/4253653722 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7facc00a7970 con 0x7facc009d430 2024-08-20T01:50:00.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.432+0000 7facd0327640 1 -- 172.21.15.79:0/4253653722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7facc00a77f0 con 0x7facc009ddb0 2024-08-20T01:50:00.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.432+0000 7facd0327640 1 -- 172.21.15.79:0/4253653722 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7facc00a7af0 con 0x7facc0097a20 2024-08-20T01:50:00.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.432+0000 7faccd8c2640 1 --2- 172.21.15.79:0/4253653722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facc009d430 0x7facc00a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:00.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.432+0000 7facce8c4640 1 --2- 172.21.15.79:0/4253653722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facc009ddb0 0x7facc00a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:00.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.432+0000 7facce0c3640 1 -- 172.21.15.79:0/4253653722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facc009ddb0 msgr2=0x7facc00a1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:00.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.432+0000 7facce0c3640 1 --2- 172.21.15.79:0/4253653722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facc009ddb0 0x7facc00a1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:00.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.432+0000 7facce0c3640 1 -- 172.21.15.79:0/4253653722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facc009d430 msgr2=0x7facc00a1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:00.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.432+0000 7facce0c3640 1 --2- 172.21.15.79:0/4253653722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facc009d430 0x7facc00a1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:00.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.432+0000 7facce0c3640 1 -- 172.21.15.79:0/4253653722 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc00a23b0 con 0x7facc0097a20 2024-08-20T01:50:00.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.432+0000 7facce8c4640 1 --2- 172.21.15.79:0/4253653722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facc009ddb0 0x7facc00a1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:50:00.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.433+0000 7facce0c3640 1 --2- 172.21.15.79:0/4253653722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facc0097a20 0x7facc00a4340 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7facc403ba40 tx=0x7facc40052b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:00.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.433+0000 7facbf7fe640 1 -- 172.21.15.79:0/4253653722 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc4050070 con 0x7facc0097a20 2024-08-20T01:50:00.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.433+0000 7facbf7fe640 1 -- 172.21.15.79:0/4253653722 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7facc4003c80 con 0x7facc0097a20 2024-08-20T01:50:00.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.433+0000 7facd0327640 1 -- 172.21.15.79:0/4253653722 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facc013e730 con 0x7facc0097a20 2024-08-20T01:50:00.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.433+0000 7facbf7fe640 1 -- 172.21.15.79:0/4253653722 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc4046030 con 0x7facc0097a20 2024-08-20T01:50:00.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.434+0000 7facd0327640 1 -- 172.21.15.79:0/4253653722 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facc013ebe0 con 0x7facc0097a20 2024-08-20T01:50:00.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.439+0000 7facd2720740 1 Processor -- start 2024-08-20T01:50:00.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.440+0000 7facd2720740 1 -- start start 2024-08-20T01:50:00.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.441+0000 7facd2720740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbf8e96530 0x55bbf8e96910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:00.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.441+0000 7facd2720740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bbf8e96e50 0x55bbf8ea28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:00.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.441+0000 7facd2720740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf8ea2de0 0x55bbf8ea51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:00.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.441+0000 7facd2720740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bbf8e0c940 con 0x55bbf8e96e50 2024-08-20T01:50:00.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.441+0000 7facd2720740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bbf8dfbe40 con 0x55bbf8ea2de0 2024-08-20T01:50:00.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.441+0000 7facd2720740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55bbf8dffe80 con 0x55bbf8e96530 2024-08-20T01:50:00.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.441+0000 7facce8c4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbf8e96530 0x55bbf8e96910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:00.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.441+0000 7facce8c4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbf8e96530 0x55bbf8e96910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:60384/0 (socket says 172.21.15.79:60384) 2024-08-20T01:50:00.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.441+0000 7facce8c4640 1 -- 172.21.15.79:0/2930556943 learned_addr learned my addr 172.21.15.79:0/2930556943 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:00.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.441+0000 7faccd8c2640 1 --2- 172.21.15.79:0/2930556943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf8ea2de0 0x55bbf8ea51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:00.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.441+0000 7facce8c4640 1 -- 172.21.15.79:0/2930556943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf8ea2de0 msgr2=0x55bbf8ea51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:00.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.441+0000 7facce8c4640 1 --2- 172.21.15.79:0/2930556943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf8ea2de0 0x55bbf8ea51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:00.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.441+0000 7facce8c4640 1 -- 172.21.15.79:0/2930556943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bbf8e96e50 msgr2=0x55bbf8ea28a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:50:00.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.441+0000 7facce8c4640 1 --2- 172.21.15.79:0/2930556943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bbf8e96e50 0x55bbf8ea28a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:00.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.441+0000 7facce8c4640 1 -- 172.21.15.79:0/2930556943 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbf8d98520 con 0x55bbf8e96530 2024-08-20T01:50:00.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.442+0000 7facce8c4640 1 --2- 172.21.15.79:0/2930556943 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbf8e96530 0x55bbf8e96910 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7facc8052510 tx=0x7facc8069c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=761dd25b6746690 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:00.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.442+0000 7facbcde6640 1 -- 172.21.15.79:0/2930556943 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc807c020 con 0x55bbf8e96530 2024-08-20T01:50:00.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.443+0000 7facbf7fe640 1 -- 172.21.15.79:0/4253653722 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7facc4053070 con 0x7facc0097a20 2024-08-20T01:50:00.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.443+0000 7facbcde6640 1 -- 172.21.15.79:0/2930556943 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7facc8078470 con 0x55bbf8e96530 2024-08-20T01:50:00.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.444+0000 7facbcde6640 1 -- 172.21.15.79:0/2930556943 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc8074ea0 con 0x55bbf8e96530 2024-08-20T01:50:00.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.444+0000 7facbf7fe640 1 --2- 172.21.15.79:0/4253653722 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7facb40b3d20 0x7facb40b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:00.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.444+0000 7facd2720740 1 -- 172.21.15.79:0/2930556943 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbf8e96530 msgr2=0x55bbf8e96910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:00.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.444+0000 7facd2720740 1 --2- 172.21.15.79:0/2930556943 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbf8e96530 0x55bbf8e96910 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7facc8052510 tx=0x7facc8069c70 comp rx=0 tx=0).stop 2024-08-20T01:50:00.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.444+0000 7facd2720740 1 -- 172.21.15.79:0/2930556943 shutdown_connections 2024-08-20T01:50:00.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.444+0000 7facd2720740 1 --2- 172.21.15.79:0/2930556943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf8ea2de0 0x55bbf8ea51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:00.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.444+0000 7facd2720740 1 --2- 172.21.15.79:0/2930556943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bbf8e96e50 0x55bbf8ea28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:00.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.444+0000 7facd2720740 1 --2- 172.21.15.79:0/2930556943 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbf8e96530 0x55bbf8e96910 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:00.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.444+0000 7facd2720740 1 -- 172.21.15.79:0/2930556943 >> 172.21.15.79:0/2930556943 conn(0x55bbf8e94360 msgr2=0x55bbf8e95500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:00.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.445+0000 7facbf7fe640 1 -- 172.21.15.79:0/4253653722 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7facc41157c0 con 0x7facc0097a20 2024-08-20T01:50:00.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.445+0000 7facd2720740 1 -- 172.21.15.79:0/2930556943 shutdown_connections 2024-08-20T01:50:00.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.445+0000 7facce0c3640 1 --2- 172.21.15.79:0/4253653722 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7facb40b3d20 0x7facb40b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:00.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.445+0000 7facd2720740 1 -- 172.21.15.79:0/2930556943 wait complete. 2024-08-20T01:50:00.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.446+0000 7facce0c3640 1 --2- 172.21.15.79:0/4253653722 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7facb40b3d20 0x7facb40b61e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7facc40dc420 tx=0x7facc40049e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:00.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.446+0000 7facd2720740 1 -- start start 2024-08-20T01:50:00.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.446+0000 7facd2720740 1 Processor -- start 2024-08-20T01:50:00.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.446+0000 7facd2720740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bbf8e96530 0x55bbf8ea2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:00.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.446+0000 7facd2720740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbf8e96e50 0x55bbf8e9fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:00.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.446+0000 7facd2720740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf8ea2de0 0x55bbf8ea03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:00.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.446+0000 7facd2720740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bbf8c5e890 con 0x55bbf8e96530 2024-08-20T01:50:00.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.446+0000 7facd2720740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bbf8d82700 con 0x55bbf8ea2de0 2024-08-20T01:50:00.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.446+0000 7facd2720740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55bbf8eb6b40 con 0x55bbf8e96e50 2024-08-20T01:50:00.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.446+0000 7facd2720740 10 client.0 _ll_register_callbacks cb 0x55bbf8df76f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:50:00.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.447+0000 7facce8c4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bbf8e96530 0x55bbf8ea2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:00.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.447+0000 7facce8c4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bbf8e96530 0x55bbf8ea2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56640/0 (socket says 172.21.15.79:56640) 2024-08-20T01:50:00.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.447+0000 7facce8c4640 1 -- 172.21.15.79:0/850113621 learned_addr learned my addr 172.21.15.79:0/850113621 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:00.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.447+0000 7facce8c4640 1 --2- 172.21.15.79:0/850113621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf8ea2de0 0x55bbf8ea03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:00.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.447+0000 7facce8c4640 1 -- 172.21.15.79:0/850113621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbf8e96e50 msgr2=0x55bbf8e9fc60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:50:00.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.447+0000 7facce8c4640 1 --2- 172.21.15.79:0/850113621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbf8e96e50 0x55bbf8e9fc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:00.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.447+0000 7facce8c4640 1 -- 172.21.15.79:0/850113621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bbf8e96530 msgr2=0x55bbf8ea2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:00.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.447+0000 7facce8c4640 1 --2- 172.21.15.79:0/850113621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bbf8e96530 0x55bbf8ea2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:00.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.447+0000 7facce8c4640 1 -- 172.21.15.79:0/850113621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbf8b5b930 con 0x55bbf8ea2de0 2024-08-20T01:50:00.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.448+0000 7facce8c4640 1 --2- 172.21.15.79:0/850113621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf8ea2de0 0x55bbf8ea03a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7facc80519c0 tx=0x7facc8069e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a4ca20651129332 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:00.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.448+0000 7facb1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:50:00.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.448+0000 7facb1ffb640 1 -- 172.21.15.79:0/850113621 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc807c050 con 0x55bbf8ea2de0 2024-08-20T01:50:00.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.448+0000 7facb1ffb640 1 -- 172.21.15.79:0/850113621 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7facc8081420 con 0x55bbf8ea2de0 2024-08-20T01:50:00.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.448+0000 7facd2720740 1 -- 172.21.15.79:0/850113621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facc8078470 con 0x55bbf8ea2de0 2024-08-20T01:50:00.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.448+0000 7facb1ffb640 1 -- 172.21.15.79:0/850113621 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7facc8081620 con 0x55bbf8ea2de0 2024-08-20T01:50:00.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.448+0000 7facd2720740 10 client.27779 fetch_fsmap learned FSMap version 51 2024-08-20T01:50:00.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.448+0000 7facd2720740 1 -- 172.21.15.79:0/850113621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55bbf8ec2640 con 0x55bbf8ea2de0 2024-08-20T01:50:00.460 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:00 smithi079 ceph-mon[18656]: pgmap v727: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 6.08k op/s 2024-08-20T01:50:00.460 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:00 smithi079 ceph-mon[18656]: overall HEALTH_OK 2024-08-20T01:50:00.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.448+0000 7facb1ffb640 1 -- 172.21.15.79:0/850113621 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7facc8078470 con 0x55bbf8ea2de0 2024-08-20T01:50:00.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.449+0000 7facb1ffb640 1 -- 172.21.15.79:0/850113621 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7facc80805b0 con 0x55bbf8ea2de0 2024-08-20T01:50:00.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.449+0000 7facd2720740 10 client.27779 fetch_fsmap finished waiting for FSMap version 51 2024-08-20T01:50:00.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.449+0000 7facd2720740 10 client.27779 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:50:00.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.449+0000 7facd2720740 20 client.27779 populate_metadata read hostname 'smithi079' 2024-08-20T01:50:00.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.449+0000 7facd2720740 1 --2- 172.21.15.79:0/850113621 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55bbf8ec3cb0 0x55bbf8ec60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:00.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.449+0000 7facd2720740 4 client.27779 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:50:00.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.449+0000 7facd2720740 1 -- 172.21.15.79:0/850113621 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bbf8e0e890 con 0x55bbf8ec3cb0 2024-08-20T01:50:00.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.449+0000 7faccd8c2640 1 --2- 172.21.15.79:0/850113621 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55bbf8ec3cb0 0x55bbf8ec60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:00.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.453+0000 7facb1ffb640 10 client.27779 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:00.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.453+0000 7faccd8c2640 1 --2- 172.21.15.79:0/850113621 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55bbf8ec3cb0 0x55bbf8ec60f0 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a01d15da2a999071 server_cookie=539b9fffcddd9c5c in_seq=0 out_seq=0 2024-08-20T01:50:00.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.458+0000 7facb1ffb640 1 -- 172.21.15.79:0/850113621 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bbf8e0e890 con 0x55bbf8ec3cb0 2024-08-20T01:50:00.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.458+0000 7facb1ffb640 10 client.27779 handle_command_reply: tid=0 2024-08-20T01:50:00.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.458+0000 7facd2720740 1 client.27779 shutdown 2024-08-20T01:50:00.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.459+0000 7facd2720740 1 -- 172.21.15.79:0/850113621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf8ea2de0 msgr2=0x55bbf8ea03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:00.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.459+0000 7facd2720740 1 --2- 172.21.15.79:0/850113621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf8ea2de0 0x55bbf8ea03a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7facc80519c0 tx=0x7facc8069e60 comp rx=0 tx=0).stop 2024-08-20T01:50:00.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.459+0000 7facd2720740 1 -- 172.21.15.79:0/850113621 shutdown_connections 2024-08-20T01:50:00.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.459+0000 7facd2720740 1 --2- 172.21.15.79:0/850113621 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55bbf8ec3cb0 0x55bbf8ec60f0 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:00.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.459+0000 7facd2720740 1 --2- 172.21.15.79:0/850113621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf8ea2de0 0x55bbf8ea03a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:00.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.459+0000 7facd2720740 1 --2- 172.21.15.79:0/850113621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbf8e96e50 0x55bbf8e9fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:00.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.459+0000 7facd2720740 1 --2- 172.21.15.79:0/850113621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bbf8e96530 0x55bbf8ea2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:00.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.459+0000 7facd2720740 1 -- 172.21.15.79:0/850113621 >> 172.21.15.79:0/850113621 conn(0x55bbf8e94360 msgr2=0x55bbf8e99f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:00.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.459+0000 7facb1ffb640 0 client.27779 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:00.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.459+0000 7facd2720740 1 -- 172.21.15.79:0/850113621 shutdown_connections 2024-08-20T01:50:00.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.459+0000 7facd2720740 1 -- 172.21.15.79:0/850113621 wait complete. 2024-08-20T01:50:00.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.460+0000 7facd2720740 20 client.27779 trim_cache size 0 max 16384 2024-08-20T01:50:00.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.492+0000 7facd2720740 1 Processor -- start 2024-08-20T01:50:00.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.492+0000 7facd2720740 1 -- start start 2024-08-20T01:50:00.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.493+0000 7facd2720740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bbf8e96530 0x55bbf8e95870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:00.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.493+0000 7facd2720740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbf8e96e50 0x55bbf8ebfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:00.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.493+0000 7facd2720740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf8ea2de0 0x55bbf8ea19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:00.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.493+0000 7facce8c4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bbf8e96530 0x55bbf8e95870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:00.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.493+0000 7facce8c4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bbf8e96530 0x55bbf8e95870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56654/0 (socket says 172.21.15.79:56654) 2024-08-20T01:50:00.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.493+0000 7facce8c4640 1 -- 172.21.15.79:0/352212093 learned_addr learned my addr 172.21.15.79:0/352212093 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:00.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.493+0000 7facd2720740 1 -- 172.21.15.79:0/352212093 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7facac00e420 con 0x55bbf8e96530 2024-08-20T01:50:00.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.493+0000 7facd2720740 1 -- 172.21.15.79:0/352212093 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7facac00ff60 con 0x55bbf8ea2de0 2024-08-20T01:50:00.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.493+0000 7facd2720740 1 -- 172.21.15.79:0/352212093 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7facac00eaf0 con 0x55bbf8e96e50 2024-08-20T01:50:00.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.493+0000 7facce8c4640 1 --2- 172.21.15.79:0/352212093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf8ea2de0 0x55bbf8ea19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:00.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.493+0000 7faccd8c2640 1 --2- 172.21.15.79:0/352212093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbf8e96e50 0x55bbf8ebfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:00.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.494+0000 7facce8c4640 1 -- 172.21.15.79:0/352212093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbf8e96e50 msgr2=0x55bbf8ebfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:00.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.494+0000 7facce8c4640 1 --2- 172.21.15.79:0/352212093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbf8e96e50 0x55bbf8ebfcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:00.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.494+0000 7facce8c4640 1 -- 172.21.15.79:0/352212093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bbf8e96530 msgr2=0x55bbf8e95870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:00.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.494+0000 7facce8c4640 1 --2- 172.21.15.79:0/352212093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bbf8e96530 0x55bbf8e95870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:00.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.494+0000 7facce8c4640 1 -- 172.21.15.79:0/352212093 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbf8e96c80 con 0x55bbf8ea2de0 2024-08-20T01:50:00.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.494+0000 7facce8c4640 1 --2- 172.21.15.79:0/352212093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf8ea2de0 0x55bbf8ea19a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7facc80666d0 tx=0x7facc80685f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81ce1f19ff82e48 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:00.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.494+0000 7facb3fff640 1 -- 172.21.15.79:0/352212093 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc807c070 con 0x55bbf8ea2de0 2024-08-20T01:50:00.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.495+0000 7facb3fff640 1 -- 172.21.15.79:0/352212093 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7facc8081420 con 0x55bbf8ea2de0 2024-08-20T01:50:00.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.495+0000 7facb3fff640 1 -- 172.21.15.79:0/352212093 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc8079280 con 0x55bbf8ea2de0 2024-08-20T01:50:00.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.495+0000 7facd2720740 1 -- 172.21.15.79:0/352212093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf8ea2de0 msgr2=0x55bbf8ea19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:00.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.495+0000 7facd2720740 1 --2- 172.21.15.79:0/352212093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf8ea2de0 0x55bbf8ea19a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7facc80666d0 tx=0x7facc80685f0 comp rx=0 tx=0).stop 2024-08-20T01:50:00.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.496+0000 7facd2720740 1 -- 172.21.15.79:0/352212093 shutdown_connections 2024-08-20T01:50:00.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.496+0000 7facd2720740 1 --2- 172.21.15.79:0/352212093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf8ea2de0 0x55bbf8ea19a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:00.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.496+0000 7facd2720740 1 --2- 172.21.15.79:0/352212093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbf8e96e50 0x55bbf8ebfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:00.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.496+0000 7facd2720740 1 --2- 172.21.15.79:0/352212093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bbf8e96530 0x55bbf8e95870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:00.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.496+0000 7facd2720740 1 -- 172.21.15.79:0/352212093 >> 172.21.15.79:0/352212093 conn(0x55bbf8e94360 msgr2=0x55bbf8ea1290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:00.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.496+0000 7facd2720740 1 -- 172.21.15.79:0/352212093 shutdown_connections 2024-08-20T01:50:00.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.496+0000 7facd2720740 1 -- 172.21.15.79:0/352212093 wait complete. 2024-08-20T01:50:00.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.497+0000 7facd2720740 1 -- start start 2024-08-20T01:50:00.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.497+0000 7facd2720740 1 Processor -- start 2024-08-20T01:50:00.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.498+0000 7facd2720740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bbf8e96530 0x55bbf8e9d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:00.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.498+0000 7facd2720740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf8e96e50 0x55bbf8ebbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:00.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.498+0000 7facd2720740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbf8ea2de0 0x55bbf8ebc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:00.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.498+0000 7facd2720740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7facac00f890 con 0x55bbf8e96530 2024-08-20T01:50:00.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.498+0000 7facd2720740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7facac00f1c0 con 0x55bbf8e96e50 2024-08-20T01:50:00.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.498+0000 7facd2720740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7facac00c400 con 0x55bbf8ea2de0 2024-08-20T01:50:00.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.498+0000 7facd2720740 10 client.0 _ll_register_callbacks cb 0x7facc8079b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:50:00.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.498+0000 7faccd8c2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf8e96e50 0x55bbf8ebbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:00.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.498+0000 7faccd8c2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf8e96e50 0x55bbf8ebbe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:57750/0 (socket says 172.21.15.79:57750) 2024-08-20T01:50:00.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.498+0000 7faccd8c2640 1 -- 172.21.15.79:0/951540679 learned_addr learned my addr 172.21.15.79:0/951540679 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:00.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.498+0000 7facce8c4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bbf8e96530 0x55bbf8e9d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:00.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.499+0000 7facce8c4640 1 --2- 172.21.15.79:0/951540679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbf8ea2de0 0x55bbf8ebc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:00.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.499+0000 7faccd8c2640 1 -- 172.21.15.79:0/951540679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbf8ea2de0 msgr2=0x55bbf8ebc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:00.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.499+0000 7faccd8c2640 1 --2- 172.21.15.79:0/951540679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbf8ea2de0 0x55bbf8ebc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:00.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.499+0000 7faccd8c2640 1 -- 172.21.15.79:0/951540679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bbf8e96530 msgr2=0x55bbf8e9d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:00.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.499+0000 7faccd8c2640 1 --2- 172.21.15.79:0/951540679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bbf8e96530 0x55bbf8e9d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:00.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.499+0000 7faccd8c2640 1 -- 172.21.15.79:0/951540679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbf8ebca90 con 0x55bbf8e96e50 2024-08-20T01:50:00.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.499+0000 7facce8c4640 1 --2- 172.21.15.79:0/951540679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bbf8e96530 0x55bbf8e9d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:50:00.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.499+0000 7faccd8c2640 1 --2- 172.21.15.79:0/951540679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf8e96e50 0x55bbf8ebbe60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x55bbf8e964e0 tx=0x7facb8013830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=499b113f20a78b4f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:00.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.499+0000 7facb1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:50:00.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.500+0000 7facb1ffb640 1 -- 172.21.15.79:0/951540679 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb801a5a0 con 0x55bbf8e96e50 2024-08-20T01:50:00.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.500+0000 7facb1ffb640 1 -- 172.21.15.79:0/951540679 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7facb801a740 con 0x55bbf8e96e50 2024-08-20T01:50:00.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.500+0000 7facd2720740 1 -- 172.21.15.79:0/951540679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facc8081420 con 0x55bbf8e96e50 2024-08-20T01:50:00.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.501+0000 7facb1ffb640 1 -- 172.21.15.79:0/951540679 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7facb802a050 con 0x55bbf8e96e50 2024-08-20T01:50:00.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.501+0000 7facd2720740 10 client.27785 fetch_fsmap learned FSMap version 51 2024-08-20T01:50:00.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.501+0000 7facd2720740 1 -- 172.21.15.79:0/951540679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55bbf8f2eb50 con 0x55bbf8e96e50 2024-08-20T01:50:00.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.501+0000 7facb1ffb640 1 -- 172.21.15.79:0/951540679 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7facb8011440 con 0x55bbf8e96e50 2024-08-20T01:50:00.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.502+0000 7facb1ffb640 1 -- 172.21.15.79:0/951540679 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7facb8010430 con 0x55bbf8e96e50 2024-08-20T01:50:00.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.502+0000 7facd2720740 10 client.27785 fetch_fsmap finished waiting for FSMap version 51 2024-08-20T01:50:00.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.502+0000 7facd2720740 10 client.27785 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:50:00.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.502+0000 7facd2720740 20 client.27785 populate_metadata read hostname 'smithi079' 2024-08-20T01:50:00.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.502+0000 7facd2720740 1 --2- 172.21.15.79:0/951540679 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55bbf8f2f2b0 0x55bbf8f316d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:00.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.502+0000 7facd2720740 4 client.27785 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T01:50:00.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.502+0000 7facd2720740 1 -- 172.21.15.79:0/951540679 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7facc8081420 con 0x55bbf8f2f2b0 2024-08-20T01:50:00.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.502+0000 7facce8c4640 1 --2- 172.21.15.79:0/951540679 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55bbf8f2f2b0 0x55bbf8f316d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:00.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.503+0000 7facce8c4640 1 --2- 172.21.15.79:0/951540679 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55bbf8f2f2b0 0x55bbf8f316d0 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=746b59b215efc31d server_cookie=8f06ab15417b9152 in_seq=0 out_seq=0 2024-08-20T01:50:00.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.503+0000 7facb1ffb640 10 client.27785 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:00.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.504+0000 7facb1ffb640 1 -- 172.21.15.79:0/951540679 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7facc8081420 con 0x55bbf8f2f2b0 2024-08-20T01:50:00.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.504+0000 7facb1ffb640 10 client.27785 handle_command_reply: tid=0 2024-08-20T01:50:00.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.504+0000 7facd2720740 1 client.27785 shutdown 2024-08-20T01:50:00.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.504+0000 7facd2720740 1 -- 172.21.15.79:0/951540679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf8e96e50 msgr2=0x55bbf8ebbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:00.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.505+0000 7facd2720740 1 --2- 172.21.15.79:0/951540679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf8e96e50 0x55bbf8ebbe60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x55bbf8e964e0 tx=0x7facb8013830 comp rx=0 tx=0).stop 2024-08-20T01:50:00.509 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:50:00.509 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-08-20T01:50:00.509 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "790dda44-e989-43f4-909b-47386fb06708", 2024-08-20T01:50:00.510 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-08-20T01:50:00.510 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:50:00.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.505+0000 7facd2720740 1 -- 172.21.15.79:0/951540679 shutdown_connections 2024-08-20T01:50:00.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.505+0000 7facd2720740 1 --2- 172.21.15.79:0/951540679 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55bbf8f2f2b0 0x55bbf8f316d0 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:00.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.505+0000 7facd2720740 1 --2- 172.21.15.79:0/951540679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbf8ea2de0 0x55bbf8ebc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:00.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.505+0000 7facd2720740 1 --2- 172.21.15.79:0/951540679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf8e96e50 0x55bbf8ebbe60 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:00.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.505+0000 7facd2720740 1 --2- 172.21.15.79:0/951540679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bbf8e96530 0x55bbf8e9d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:00.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.505+0000 7facd2720740 1 -- 172.21.15.79:0/951540679 >> 172.21.15.79:0/951540679 conn(0x55bbf8e94360 msgr2=0x55bbf8e9e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:00.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.505+0000 7facb1ffb640 0 client.27785 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:00.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.505+0000 7facd2720740 1 -- 172.21.15.79:0/951540679 shutdown_connections 2024-08-20T01:50:00.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.505+0000 7facd2720740 1 -- 172.21.15.79:0/951540679 wait complete. 2024-08-20T01:50:00.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.505+0000 7facd2720740 20 client.27785 trim_cache size 0 max 16384 2024-08-20T01:50:00.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.506+0000 7facd0327640 1 -- 172.21.15.79:0/4253653722 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7facb40b3d20 msgr2=0x7facb40b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:00.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.506+0000 7facd0327640 1 --2- 172.21.15.79:0/4253653722 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7facb40b3d20 0x7facb40b61e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7facc40dc420 tx=0x7facc40049e0 comp rx=0 tx=0).stop 2024-08-20T01:50:00.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.506+0000 7facd0327640 1 -- 172.21.15.79:0/4253653722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facc0097a20 msgr2=0x7facc00a4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:00.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.506+0000 7facd0327640 1 --2- 172.21.15.79:0/4253653722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facc0097a20 0x7facc00a4340 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7facc403ba40 tx=0x7facc40052b0 comp rx=0 tx=0).stop 2024-08-20T01:50:00.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.506+0000 7facd0327640 1 -- 172.21.15.79:0/4253653722 shutdown_connections 2024-08-20T01:50:00.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.506+0000 7facd0327640 1 --2- 172.21.15.79:0/4253653722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facc009ddb0 0x7facc00a1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:00.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.506+0000 7facd0327640 1 --2- 172.21.15.79:0/4253653722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facc009d430 0x7facc00a1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:00.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.506+0000 7facd0327640 1 --2- 172.21.15.79:0/4253653722 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7facb40b3d20 0x7facb40b61e0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:00.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.506+0000 7facd0327640 1 --2- 172.21.15.79:0/4253653722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facc0097a20 0x7facc00a4340 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:00.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.506+0000 7facd0327640 1 -- 172.21.15.79:0/4253653722 >> 172.21.15.79:0/4253653722 conn(0x7facc0093430 msgr2=0x7facc0095820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:00.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.506+0000 7facd0327640 1 -- 172.21.15.79:0/4253653722 shutdown_connections 2024-08-20T01:50:00.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:00.506+0000 7facd0327640 1 -- 172.21.15.79:0/4253653722 wait complete. 2024-08-20T01:50:00.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:00 smithi081 ceph-mon[22209]: pgmap v727: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 6.08k op/s 2024-08-20T01:50:00.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:00 smithi081 ceph-mon[22209]: overall HEALTH_OK 2024-08-20T01:50:00.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:00 smithi175 ceph-mon[22392]: pgmap v727: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 6.08k op/s 2024-08-20T01:50:00.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:00 smithi175 ceph-mon[22392]: overall HEALTH_OK 2024-08-20T01:50:01.291 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:50:01.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:01 smithi175 ceph-mon[22392]: scrub queued for path: / 2024-08-20T01:50:01.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:01 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:01.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:01 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:50:01.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:01 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:50:01.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:01 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:01.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:01 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:50:01.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:01 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:50:01.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:01 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:50:01.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:01 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:50:01.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:01 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:01.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:01 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:01.641 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:01 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:01.641 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:01 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:01.641 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:01 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:50:01.641 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:01 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:01.641 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:01 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:01.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:01 smithi079 ceph-mon[18656]: scrub queued for path: / 2024-08-20T01:50:01.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:01 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:01.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:01 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:50:01.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:01 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:50:01.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:01 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:01.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:01 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:50:01.689 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:01 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:50:01.689 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:01 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:50:01.689 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:01 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:50:01.689 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:01 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:01.689 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:01 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:01.689 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:01 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:01.689 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:01 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:01.689 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:01 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:50:01.689 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:01 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:01.689 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:01 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:01.768 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:50:01.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:01 smithi081 ceph-mon[22209]: scrub queued for path: / 2024-08-20T01:50:01.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:01 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:01.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:01 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:50:01.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:01 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:50:01.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:01 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:01.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:01 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:50:01.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:01 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:50:01.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:01 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:50:01.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:01 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:50:01.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:01 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:01.780 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:01 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:01.780 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:01 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:01.780 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:01 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:01.780 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:01 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:50:01.780 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:01 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:01.780 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:01 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:02.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.397+0000 7faa12f53640 1 -- 172.21.15.79:0/544921833 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa0c1073a0 msgr2=0x7faa0c1077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:02.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.397+0000 7faa12f53640 1 --2- 172.21.15.79:0/544921833 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa0c1073a0 0x7faa0c1077e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa9f800fb10 tx=0x7fa9f8032990 comp rx=0 tx=0).stop 2024-08-20T01:50:02.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.399+0000 7faa12f53640 1 -- 172.21.15.79:0/544921833 shutdown_connections 2024-08-20T01:50:02.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.399+0000 7faa12f53640 1 --2- 172.21.15.79:0/544921833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa0c107d20 0x7faa0c10e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:02.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.399+0000 7faa12f53640 1 --2- 172.21.15.79:0/544921833 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa0c1073a0 0x7faa0c1077e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:02.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.399+0000 7faa12f53640 1 --2- 172.21.15.79:0/544921833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa0c101990 0x7faa0c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:02.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.399+0000 7faa12f53640 1 -- 172.21.15.79:0/544921833 >> 172.21.15.79:0/544921833 conn(0x7faa0c0fd400 msgr2=0x7faa0c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:02.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.400+0000 7faa12f53640 1 -- 172.21.15.79:0/544921833 shutdown_connections 2024-08-20T01:50:02.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.400+0000 7faa12f53640 1 -- 172.21.15.79:0/544921833 wait complete. 2024-08-20T01:50:02.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.400+0000 7faa12f53640 1 Processor -- start 2024-08-20T01:50:02.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.401+0000 7faa12f53640 1 -- start start 2024-08-20T01:50:02.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.401+0000 7faa12f53640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa0c101990 0x7faa0c1a7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:02.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.401+0000 7faa12f53640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa0c1073a0 0x7faa0c1a81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:02.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.401+0000 7faa12f53640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa0c107d20 0x7faa0c1ad590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:02.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.401+0000 7faa12f53640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c1217e0 con 0x7faa0c1073a0 2024-08-20T01:50:02.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.401+0000 7faa12f53640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c121660 con 0x7faa0c107d20 2024-08-20T01:50:02.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.401+0000 7faa12f53640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c121960 con 0x7faa0c101990 2024-08-20T01:50:02.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.401+0000 7faa10cef640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa0c101990 0x7faa0c1a7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:02.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.401+0000 7faa114f0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa0c107d20 0x7faa0c1ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:02.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.402+0000 7faa114f0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa0c107d20 0x7faa0c1ad590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:57766/0 (socket says 172.21.15.79:57766) 2024-08-20T01:50:02.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.402+0000 7faa114f0640 1 -- 172.21.15.79:0/2946785442 learned_addr learned my addr 172.21.15.79:0/2946785442 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:02.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.402+0000 7faa0bfff640 1 --2- 172.21.15.79:0/2946785442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa0c1073a0 0x7faa0c1a81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:02.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.402+0000 7faa0bfff640 1 -- 172.21.15.79:0/2946785442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa0c101990 msgr2=0x7faa0c1a7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:02.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.402+0000 7faa0bfff640 1 --2- 172.21.15.79:0/2946785442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa0c101990 0x7faa0c1a7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:02.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.402+0000 7faa0bfff640 1 -- 172.21.15.79:0/2946785442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa0c107d20 msgr2=0x7faa0c1ad590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:02.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.402+0000 7faa0bfff640 1 --2- 172.21.15.79:0/2946785442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa0c107d20 0x7faa0c1ad590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:02.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.402+0000 7faa0bfff640 1 -- 172.21.15.79:0/2946785442 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa0c1add60 con 0x7faa0c1073a0 2024-08-20T01:50:02.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.403+0000 7faa0bfff640 1 --2- 172.21.15.79:0/2946785442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa0c1073a0 0x7faa0c1a81f0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8009230 tx=0x7fa9f800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:02.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.403+0000 7faa09ffb640 1 -- 172.21.15.79:0/2946785442 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f8016070 con 0x7faa0c1073a0 2024-08-20T01:50:02.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.403+0000 7faa12f53640 1 -- 172.21.15.79:0/2946785442 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa0c1adff0 con 0x7faa0c1073a0 2024-08-20T01:50:02.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.404+0000 7faa12f53640 1 -- 172.21.15.79:0/2946785442 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa0c1b4710 con 0x7faa0c1073a0 2024-08-20T01:50:02.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.404+0000 7faa09ffb640 1 -- 172.21.15.79:0/2946785442 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa9f80044c0 con 0x7faa0c1073a0 2024-08-20T01:50:02.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.405+0000 7faa09ffb640 1 -- 172.21.15.79:0/2946785442 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f80035f0 con 0x7faa0c1073a0 2024-08-20T01:50:02.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.407+0000 7faa1534c740 1 Processor -- start 2024-08-20T01:50:02.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.407+0000 7faa1534c740 1 -- start start 2024-08-20T01:50:02.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.407+0000 7faa1534c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e88bbea830 0x55e88bbeac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:02.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.407+0000 7faa1534c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e88bbeb150 0x55e88bbf6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:02.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.407+0000 7faa1534c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e88bbf70e0 0x55e88bbf94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:02.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.407+0000 7faa1534c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e88bb618e0 con 0x55e88bbea830 2024-08-20T01:50:02.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.407+0000 7faa1534c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e88bb50de0 con 0x55e88bbf70e0 2024-08-20T01:50:02.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.407+0000 7faa1534c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e88bb54e20 con 0x55e88bbeb150 2024-08-20T01:50:02.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.408+0000 7faa10cef640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e88bbeb150 0x55e88bbf6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:02.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.408+0000 7faa10cef640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e88bbeb150 0x55e88bbf6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:60442/0 (socket says 172.21.15.79:60442) 2024-08-20T01:50:02.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.409+0000 7faa10cef640 1 -- 172.21.15.79:0/709736898 learned_addr learned my addr 172.21.15.79:0/709736898 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:02.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.409+0000 7faa114f0640 1 --2- 172.21.15.79:0/709736898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e88bbea830 0x55e88bbeac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:02.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.409+0000 7faa10cef640 1 -- 172.21.15.79:0/709736898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e88bbf70e0 msgr2=0x55e88bbf94d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:50:02.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.409+0000 7faa10cef640 1 --2- 172.21.15.79:0/709736898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e88bbf70e0 0x55e88bbf94d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:02.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.409+0000 7faa10cef640 1 -- 172.21.15.79:0/709736898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e88bbea830 msgr2=0x55e88bbeac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:02.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.409+0000 7faa10cef640 1 --2- 172.21.15.79:0/709736898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e88bbea830 0x55e88bbeac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:02.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.409+0000 7faa10cef640 1 -- 172.21.15.79:0/709736898 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e88b8b0650 con 0x55e88bbeb150 2024-08-20T01:50:02.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.410+0000 7faa10cef640 1 --2- 172.21.15.79:0/709736898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e88bbeb150 0x55e88bbf6ba0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7faa0000bc60 tx=0x7faa00005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd40d35b60e8c0dc server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:02.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.410+0000 7faa09ffb640 1 -- 172.21.15.79:0/2946785442 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa9f803e070 con 0x7faa0c1073a0 2024-08-20T01:50:02.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.411+0000 7fa9f6ffd640 1 -- 172.21.15.79:0/709736898 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa00012ea0 con 0x55e88bbeb150 2024-08-20T01:50:02.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.411+0000 7fa9f6ffd640 1 -- 172.21.15.79:0/709736898 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa00016ab0 con 0x55e88bbeb150 2024-08-20T01:50:02.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.411+0000 7fa9f6ffd640 1 -- 172.21.15.79:0/709736898 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0001ea30 con 0x55e88bbeb150 2024-08-20T01:50:02.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.412+0000 7faa1534c740 1 -- 172.21.15.79:0/709736898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e88bbeb150 msgr2=0x55e88bbf6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:02.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.412+0000 7faa1534c740 1 --2- 172.21.15.79:0/709736898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e88bbeb150 0x55e88bbf6ba0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7faa0000bc60 tx=0x7faa00005f90 comp rx=0 tx=0).stop 2024-08-20T01:50:02.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.412+0000 7faa1534c740 1 -- 172.21.15.79:0/709736898 shutdown_connections 2024-08-20T01:50:02.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.412+0000 7faa1534c740 1 --2- 172.21.15.79:0/709736898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e88bbf70e0 0x55e88bbf94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:02.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.412+0000 7faa1534c740 1 --2- 172.21.15.79:0/709736898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e88bbeb150 0x55e88bbf6ba0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:02.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.412+0000 7faa1534c740 1 --2- 172.21.15.79:0/709736898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e88bbea830 0x55e88bbeac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:02.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.412+0000 7faa1534c740 1 -- 172.21.15.79:0/709736898 >> 172.21.15.79:0/709736898 conn(0x55e88bbe8660 msgr2=0x55e88bbe9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:02.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.413+0000 7faa1534c740 1 -- 172.21.15.79:0/709736898 shutdown_connections 2024-08-20T01:50:02.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.413+0000 7faa1534c740 1 -- 172.21.15.79:0/709736898 wait complete. 2024-08-20T01:50:02.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.413+0000 7faa09ffb640 1 --2- 172.21.15.79:0/2946785442 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa9fc0b3ce0 0x7fa9fc0b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:02.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.413+0000 7faa1534c740 1 -- start start 2024-08-20T01:50:02.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.413+0000 7faa1534c740 1 Processor -- start 2024-08-20T01:50:02.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.414+0000 7faa09ffb640 1 -- 172.21.15.79:0/2946785442 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fa9f8102d60 con 0x7faa0c1073a0 2024-08-20T01:50:02.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.414+0000 7faa114f0640 1 --2- 172.21.15.79:0/2946785442 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa9fc0b3ce0 0x7fa9fc0b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:02.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.414+0000 7faa1534c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e88bbea830 0x55e88bbf4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:02.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.414+0000 7faa1534c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e88bbeb150 0x55e88bbf45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:02.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.414+0000 7faa1534c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e88bbf70e0 0x55e88bbf4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:02.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.414+0000 7faa1534c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e88b9b3700 con 0x55e88bbf70e0 2024-08-20T01:50:02.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.414+0000 7faa1534c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e88bad77c0 con 0x55e88bbeb150 2024-08-20T01:50:02.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.414+0000 7faa1534c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e88bbf9d90 con 0x55e88bbea830 2024-08-20T01:50:02.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.414+0000 7faa1534c740 10 client.0 _ll_register_callbacks cb 0x55e88bb4a6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:50:02.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.415+0000 7faa114f0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e88bbf70e0 0x55e88bbf4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:02.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.415+0000 7faa114f0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e88bbf70e0 0x55e88bbf4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56688/0 (socket says 172.21.15.79:56688) 2024-08-20T01:50:02.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.415+0000 7faa114f0640 1 -- 172.21.15.79:0/1426195970 learned_addr learned my addr 172.21.15.79:0/1426195970 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:02.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.416+0000 7faa114f0640 1 --2- 172.21.15.79:0/2946785442 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa9fc0b3ce0 0x7fa9fc0b61a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7faa040113d0 tx=0x7faa04009710 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:02.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.416+0000 7faa114f0640 1 -- 172.21.15.79:0/1426195970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e88bbea830 msgr2=0x55e88bbf4080 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:50:02.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.416+0000 7faa114f0640 1 --2- 172.21.15.79:0/1426195970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e88bbea830 0x55e88bbf4080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:02.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.416+0000 7faa114f0640 1 -- 172.21.15.79:0/1426195970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e88bbeb150 msgr2=0x55e88bbf45c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:50:02.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.416+0000 7faa114f0640 1 --2- 172.21.15.79:0/1426195970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e88bbeb150 0x55e88bbf45c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:02.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.416+0000 7faa114f0640 1 -- 172.21.15.79:0/1426195970 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e88bc031d0 con 0x55e88bbf70e0 2024-08-20T01:50:02.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.416+0000 7fa9ebfff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:50:02.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.416+0000 7faa114f0640 1 --2- 172.21.15.79:0/1426195970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e88bbf70e0 0x55e88bbf4b00 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7faa04019ed0 tx=0x7faa04004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d883790c5cf5d1b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:02.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.418+0000 7fa9ebfff640 1 -- 172.21.15.79:0/1426195970 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa04025020 con 0x55e88bbf70e0 2024-08-20T01:50:02.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.418+0000 7fa9ebfff640 1 -- 172.21.15.79:0/1426195970 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7faa04021840 con 0x55e88bbf70e0 2024-08-20T01:50:02.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.418+0000 7faa1534c740 1 -- 172.21.15.79:0/1426195970 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e88bb00100 con 0x55e88bbf70e0 2024-08-20T01:50:02.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.418+0000 7fa9ebfff640 1 -- 172.21.15.79:0/1426195970 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7faa0401d070 con 0x55e88bbf70e0 2024-08-20T01:50:02.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.418+0000 7faa1534c740 10 client.18666 fetch_fsmap learned FSMap version 51 2024-08-20T01:50:02.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.418+0000 7faa1534c740 1 -- 172.21.15.79:0/1426195970 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55e88bc05bf0 con 0x55e88bbf70e0 2024-08-20T01:50:02.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.419+0000 7fa9ebfff640 1 -- 172.21.15.79:0/1426195970 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55e88bb00100 con 0x55e88bbf70e0 2024-08-20T01:50:02.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.420+0000 7fa9ebfff640 1 -- 172.21.15.79:0/1426195970 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7faa04020070 con 0x55e88bbf70e0 2024-08-20T01:50:02.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.420+0000 7faa1534c740 10 client.18666 fetch_fsmap finished waiting for FSMap version 51 2024-08-20T01:50:02.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.420+0000 7faa1534c740 10 client.18666 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:50:02.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.420+0000 7faa1534c740 20 client.18666 populate_metadata read hostname 'smithi079' 2024-08-20T01:50:02.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.420+0000 7faa1534c740 1 --2- 172.21.15.79:0/1426195970 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55e88bc074c0 0x55e88bc09980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:02.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.420+0000 7faa1534c740 4 client.18666 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:50:02.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.420+0000 7faa1534c740 1 -- 172.21.15.79:0/1426195970 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e88bb63830 con 0x55e88bc074c0 2024-08-20T01:50:02.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.420+0000 7faa10cef640 1 --2- 172.21.15.79:0/1426195970 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55e88bc074c0 0x55e88bc09980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:02.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.421+0000 7fa9ebfff640 10 client.18666 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:02.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.421+0000 7faa10cef640 1 --2- 172.21.15.79:0/1426195970 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55e88bc074c0 0x55e88bc09980 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56c130e56fdef26d server_cookie=22313ac2934d2a18 in_seq=0 out_seq=0 2024-08-20T01:50:02.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.422+0000 7fa9ebfff640 1 -- 172.21.15.79:0/1426195970 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e88bb63830 con 0x55e88bc074c0 2024-08-20T01:50:02.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.422+0000 7fa9ebfff640 10 client.18666 handle_command_reply: tid=0 2024-08-20T01:50:02.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.422+0000 7faa1534c740 1 client.18666 shutdown 2024-08-20T01:50:02.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.423+0000 7faa1534c740 1 -- 172.21.15.79:0/1426195970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e88bbf70e0 msgr2=0x55e88bbf4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:02.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.423+0000 7faa1534c740 1 --2- 172.21.15.79:0/1426195970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e88bbf70e0 0x55e88bbf4b00 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7faa04019ed0 tx=0x7faa04004b50 comp rx=0 tx=0).stop 2024-08-20T01:50:02.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.423+0000 7faa1534c740 1 -- 172.21.15.79:0/1426195970 shutdown_connections 2024-08-20T01:50:02.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.423+0000 7faa1534c740 1 --2- 172.21.15.79:0/1426195970 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55e88bc074c0 0x55e88bc09980 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:02.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.423+0000 7faa1534c740 1 --2- 172.21.15.79:0/1426195970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e88bbf70e0 0x55e88bbf4b00 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:02.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.423+0000 7faa1534c740 1 --2- 172.21.15.79:0/1426195970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e88bbeb150 0x55e88bbf45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:02.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.423+0000 7faa1534c740 1 --2- 172.21.15.79:0/1426195970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e88bbea830 0x55e88bbf4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:02.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.423+0000 7faa1534c740 1 -- 172.21.15.79:0/1426195970 >> 172.21.15.79:0/1426195970 conn(0x55e88bbe8660 msgr2=0x55e88bbee200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:02.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.423+0000 7fa9ebfff640 0 client.18666 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:02.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.423+0000 7faa1534c740 1 -- 172.21.15.79:0/1426195970 shutdown_connections 2024-08-20T01:50:02.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.423+0000 7faa1534c740 1 -- 172.21.15.79:0/1426195970 wait complete. 2024-08-20T01:50:02.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.423+0000 7faa1534c740 20 client.18666 trim_cache size 0 max 16384 2024-08-20T01:50:02.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.456+0000 7faa1534c740 1 Processor -- start 2024-08-20T01:50:02.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.457+0000 7faa1534c740 1 -- start start 2024-08-20T01:50:02.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.457+0000 7faa1534c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e88bbea830 0x55e88bbee0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:02.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.457+0000 7faa1534c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e88bbeb150 0x55e88bbf4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:02.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.457+0000 7faa1534c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e88bbf70e0 0x55e88bbf4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:02.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.457+0000 7faa1534c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f000e500 con 0x55e88bbeb150 2024-08-20T01:50:02.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.457+0000 7faa10cef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e88bbea830 0x55e88bbee0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:02.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.457+0000 7faa1534c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f0010040 con 0x55e88bbea830 2024-08-20T01:50:02.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.457+0000 7faa1534c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f000ebd0 con 0x55e88bbf70e0 2024-08-20T01:50:02.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.457+0000 7faa10cef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e88bbea830 0x55e88bbee0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:57772/0 (socket says 172.21.15.79:57772) 2024-08-20T01:50:02.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.457+0000 7faa10cef640 1 -- 172.21.15.79:0/1818131460 learned_addr learned my addr 172.21.15.79:0/1818131460 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:02.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.457+0000 7faa114f0640 1 --2- 172.21.15.79:0/1818131460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e88bbf70e0 0x55e88bbf4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:02.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.458+0000 7faa0bfff640 1 --2- 172.21.15.79:0/1818131460 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e88bbeb150 0x55e88bbf4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:02.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.458+0000 7faa10cef640 1 -- 172.21.15.79:0/1818131460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e88bbf70e0 msgr2=0x55e88bbf4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:02.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.458+0000 7faa10cef640 1 --2- 172.21.15.79:0/1818131460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e88bbf70e0 0x55e88bbf4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:02.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.458+0000 7faa10cef640 1 -- 172.21.15.79:0/1818131460 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e88bbeb150 msgr2=0x55e88bbf4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:02.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.458+0000 7faa10cef640 1 --2- 172.21.15.79:0/1818131460 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e88bbeb150 0x55e88bbf4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:02.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.458+0000 7faa10cef640 1 -- 172.21.15.79:0/1818131460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e88bbeaf80 con 0x55e88bbea830 2024-08-20T01:50:02.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.459+0000 7faa10cef640 1 --2- 172.21.15.79:0/1818131460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e88bbea830 0x55e88bbee0f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7faa00000c00 tx=0x7faa0001e610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4ff3fdeaf7afe6f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:02.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.459+0000 7fa9f67fc640 1 -- 172.21.15.79:0/1818131460 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0000b850 con 0x55e88bbea830 2024-08-20T01:50:02.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.459+0000 7fa9f67fc640 1 -- 172.21.15.79:0/1818131460 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa0002c070 con 0x55e88bbea830 2024-08-20T01:50:02.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.459+0000 7fa9f67fc640 1 -- 172.21.15.79:0/1818131460 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0001ee10 con 0x55e88bbea830 2024-08-20T01:50:02.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.460+0000 7faa1534c740 1 -- 172.21.15.79:0/1818131460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e88bbea830 msgr2=0x55e88bbee0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:02.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.460+0000 7faa1534c740 1 --2- 172.21.15.79:0/1818131460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e88bbea830 0x55e88bbee0f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7faa00000c00 tx=0x7faa0001e610 comp rx=0 tx=0).stop 2024-08-20T01:50:02.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.460+0000 7faa1534c740 1 -- 172.21.15.79:0/1818131460 shutdown_connections 2024-08-20T01:50:02.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.460+0000 7faa1534c740 1 --2- 172.21.15.79:0/1818131460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e88bbf70e0 0x55e88bbf4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:02.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.460+0000 7faa1534c740 1 --2- 172.21.15.79:0/1818131460 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e88bbeb150 0x55e88bbf4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:02.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.460+0000 7faa1534c740 1 --2- 172.21.15.79:0/1818131460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e88bbea830 0x55e88bbee0f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:02.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.460+0000 7faa1534c740 1 -- 172.21.15.79:0/1818131460 >> 172.21.15.79:0/1818131460 conn(0x55e88bbe8660 msgr2=0x55e88bbed9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:02.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.460+0000 7faa1534c740 1 -- 172.21.15.79:0/1818131460 shutdown_connections 2024-08-20T01:50:02.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.460+0000 7faa1534c740 1 -- 172.21.15.79:0/1818131460 wait complete. 2024-08-20T01:50:02.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.461+0000 7faa1534c740 1 -- start start 2024-08-20T01:50:02.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.461+0000 7faa1534c740 1 Processor -- start 2024-08-20T01:50:02.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.461+0000 7faa1534c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e88bbea830 0x55e88bbff0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:02.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.461+0000 7faa1534c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e88bbeb150 0x55e88bbff5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:02.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.461+0000 7faa1534c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e88bbf70e0 0x55e88bbf0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:02.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.461+0000 7faa1534c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f000f970 con 0x55e88bbf70e0 2024-08-20T01:50:02.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.461+0000 7faa1534c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f000f2a0 con 0x55e88bbeb150 2024-08-20T01:50:02.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.461+0000 7faa1534c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f000c4a0 con 0x55e88bbea830 2024-08-20T01:50:02.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.461+0000 7faa1534c740 10 client.0 _ll_register_callbacks cb 0x7faa04011f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:50:02.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.462+0000 7faa0bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e88bbeb150 0x55e88bbff5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:02.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.462+0000 7faa0bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e88bbeb150 0x55e88bbff5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:57774/0 (socket says 172.21.15.79:57774) 2024-08-20T01:50:02.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.462+0000 7faa114f0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e88bbf70e0 0x55e88bbf0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:02.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.462+0000 7faa10cef640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e88bbea830 0x55e88bbff0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:02.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.462+0000 7faa0bfff640 1 -- 172.21.15.79:0/2298178903 learned_addr learned my addr 172.21.15.79:0/2298178903 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:02.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.462+0000 7faa0bfff640 1 -- 172.21.15.79:0/2298178903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e88bbea830 msgr2=0x55e88bbff0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:02.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.462+0000 7faa0bfff640 1 --2- 172.21.15.79:0/2298178903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e88bbea830 0x55e88bbff0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:02.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.462+0000 7faa0bfff640 1 -- 172.21.15.79:0/2298178903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e88bbf70e0 msgr2=0x55e88bbf0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:02.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.462+0000 7faa0bfff640 1 --2- 172.21.15.79:0/2298178903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e88bbf70e0 0x55e88bbf0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:02.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.462+0000 7faa0bfff640 1 -- 172.21.15.79:0/2298178903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e88bbf0c00 con 0x55e88bbeb150 2024-08-20T01:50:02.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.462+0000 7faa10cef640 1 --2- 172.21.15.79:0/2298178903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e88bbea830 0x55e88bbff0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:50:02.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.462+0000 7faa0bfff640 1 --2- 172.21.15.79:0/2298178903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e88bbeb150 0x55e88bbff5f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8005c20 tx=0x7fa9f80c9ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6fdf4b8d9a6315f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:02.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.462+0000 7fa9ebfff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:50:02.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.463+0000 7fa9ebfff640 1 -- 172.21.15.79:0/2298178903 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f803b030 con 0x55e88bbeb150 2024-08-20T01:50:02.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.463+0000 7faa1534c740 1 -- 172.21.15.79:0/2298178903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa0002c070 con 0x55e88bbeb150 2024-08-20T01:50:02.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.463+0000 7fa9ebfff640 1 -- 172.21.15.79:0/2298178903 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fa9f80048d0 con 0x55e88bbeb150 2024-08-20T01:50:02.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.463+0000 7fa9ebfff640 1 -- 172.21.15.79:0/2298178903 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fa9f80c9820 con 0x55e88bbeb150 2024-08-20T01:50:02.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.463+0000 7faa1534c740 10 client.27794 fetch_fsmap learned FSMap version 51 2024-08-20T01:50:02.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.463+0000 7faa1534c740 1 -- 172.21.15.79:0/2298178903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55e88bc71ae0 con 0x55e88bbeb150 2024-08-20T01:50:02.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.464+0000 7fa9ebfff640 1 -- 172.21.15.79:0/2298178903 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa0002c070 con 0x55e88bbeb150 2024-08-20T01:50:02.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.465+0000 7fa9ebfff640 1 -- 172.21.15.79:0/2298178903 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7fa9f80d2880 con 0x55e88bbeb150 2024-08-20T01:50:02.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.465+0000 7faa1534c740 10 client.27794 fetch_fsmap finished waiting for FSMap version 51 2024-08-20T01:50:02.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.465+0000 7faa1534c740 10 client.27794 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:50:02.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.465+0000 7faa1534c740 20 client.27794 populate_metadata read hostname 'smithi079' 2024-08-20T01:50:02.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.465+0000 7faa1534c740 1 --2- 172.21.15.79:0/2298178903 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55e88bc72300 0x55e88bc74720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:02.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.465+0000 7faa1534c740 4 client.27794 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:50:02.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.465+0000 7faa1534c740 1 -- 172.21.15.79:0/2298178903 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e88bb5f2d0 con 0x55e88bc72300 2024-08-20T01:50:02.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.465+0000 7faa10cef640 1 --2- 172.21.15.79:0/2298178903 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55e88bc72300 0x55e88bc74720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:02.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.468+0000 7faa10cef640 1 --2- 172.21.15.79:0/2298178903 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55e88bc72300 0x55e88bc74720 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1cd501bd559ed9b server_cookie=4da486da2291df41 in_seq=0 out_seq=0 2024-08-20T01:50:02.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.468+0000 7fa9ebfff640 10 client.27794 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:02.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.468+0000 7fa9ebfff640 1 -- 172.21.15.79:0/2298178903 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55e88bb5f2d0 con 0x55e88bc72300 2024-08-20T01:50:02.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.468+0000 7fa9ebfff640 10 client.27794 handle_command_reply: tid=0 2024-08-20T01:50:02.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.468+0000 7faa1534c740 1 client.27794 shutdown 2024-08-20T01:50:02.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.468+0000 7faa1534c740 1 -- 172.21.15.79:0/2298178903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e88bbeb150 msgr2=0x55e88bbff5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:02.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.468+0000 7faa1534c740 1 --2- 172.21.15.79:0/2298178903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e88bbeb150 0x55e88bbff5f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8005c20 tx=0x7fa9f80c9ba0 comp rx=0 tx=0).stop 2024-08-20T01:50:02.626 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:50:02.626 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-20T01:50:02.626 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": { 2024-08-20T01:50:02.626 INFO:teuthology.orchestra.run.smithi079.stdout: "790dda44-e989-43f4-909b-47386fb06708": { 2024-08-20T01:50:02.626 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/", 2024-08-20T01:50:02.627 INFO:teuthology.orchestra.run.smithi079.stdout: "tag": "790dda44-e989-43f4-909b-47386fb06708", 2024-08-20T01:50:02.627 INFO:teuthology.orchestra.run.smithi079.stdout: "options": "recursive,force" 2024-08-20T01:50:02.627 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:50:02.627 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:50:02.627 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:50:02.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.468+0000 7faa1534c740 1 -- 172.21.15.79:0/2298178903 shutdown_connections 2024-08-20T01:50:02.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.468+0000 7faa1534c740 1 --2- 172.21.15.79:0/2298178903 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55e88bc72300 0x55e88bc74720 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:02.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.468+0000 7faa1534c740 1 --2- 172.21.15.79:0/2298178903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e88bbf70e0 0x55e88bbf0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:02.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.468+0000 7faa1534c740 1 --2- 172.21.15.79:0/2298178903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e88bbeb150 0x55e88bbff5f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:02.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.468+0000 7faa1534c740 1 --2- 172.21.15.79:0/2298178903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e88bbea830 0x55e88bbff0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:02.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.468+0000 7faa1534c740 1 -- 172.21.15.79:0/2298178903 >> 172.21.15.79:0/2298178903 conn(0x55e88bbe8660 msgr2=0x55e88bbf5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:02.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.469+0000 7fa9ebfff640 0 client.27794 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:02.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.469+0000 7faa1534c740 1 -- 172.21.15.79:0/2298178903 shutdown_connections 2024-08-20T01:50:02.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.469+0000 7faa1534c740 1 -- 172.21.15.79:0/2298178903 wait complete. 2024-08-20T01:50:02.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.469+0000 7faa1534c740 20 client.27794 trim_cache size 0 max 16384 2024-08-20T01:50:02.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.470+0000 7faa12f53640 1 -- 172.21.15.79:0/2946785442 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa9fc0b3ce0 msgr2=0x7fa9fc0b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:02.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.470+0000 7faa12f53640 1 --2- 172.21.15.79:0/2946785442 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa9fc0b3ce0 0x7fa9fc0b61a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7faa040113d0 tx=0x7faa04009710 comp rx=0 tx=0).stop 2024-08-20T01:50:02.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.470+0000 7faa12f53640 1 -- 172.21.15.79:0/2946785442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa0c1073a0 msgr2=0x7faa0c1a81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:02.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.470+0000 7faa12f53640 1 --2- 172.21.15.79:0/2946785442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa0c1073a0 0x7faa0c1a81f0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8009230 tx=0x7fa9f800ec80 comp rx=0 tx=0).stop 2024-08-20T01:50:02.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.470+0000 7faa12f53640 1 -- 172.21.15.79:0/2946785442 shutdown_connections 2024-08-20T01:50:02.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.470+0000 7faa12f53640 1 --2- 172.21.15.79:0/2946785442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa0c107d20 0x7faa0c1ad590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:02.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.470+0000 7faa12f53640 1 --2- 172.21.15.79:0/2946785442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa0c1073a0 0x7faa0c1a81f0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:02.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.470+0000 7faa12f53640 1 --2- 172.21.15.79:0/2946785442 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa9fc0b3ce0 0x7fa9fc0b61a0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:02.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.470+0000 7faa12f53640 1 --2- 172.21.15.79:0/2946785442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa0c101990 0x7faa0c1a7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:02.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.470+0000 7faa12f53640 1 -- 172.21.15.79:0/2946785442 >> 172.21.15.79:0/2946785442 conn(0x7faa0c0fd400 msgr2=0x7faa0c0ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:02.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.471+0000 7faa12f53640 1 -- 172.21.15.79:0/2946785442 shutdown_connections 2024-08-20T01:50:02.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:02.471+0000 7faa12f53640 1 -- 172.21.15.79:0/2946785442 wait complete. 2024-08-20T01:50:02.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:02 smithi175 ceph-mon[22392]: pgmap v728: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 MiB/s wr, 5.89k op/s 2024-08-20T01:50:02.689 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:02 smithi079 ceph-mon[18656]: pgmap v728: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 MiB/s wr, 5.89k op/s 2024-08-20T01:50:02.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:02 smithi081 ceph-mon[22209]: pgmap v728: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 MiB/s wr, 5.89k op/s 2024-08-20T01:50:03.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.348+0000 7f4845f3d640 1 -- 172.21.15.79:0/213607740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f483800aa80 msgr2=0x7f483800b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:03.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.348+0000 7f4845f3d640 1 --2- 172.21.15.79:0/213607740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f483800aa80 0x7f483800b3d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f484002e8d0 tx=0x7f4840097990 comp rx=0 tx=0).stop 2024-08-20T01:50:03.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.348+0000 7f4845f3d640 1 -- 172.21.15.79:0/213607740 shutdown_connections 2024-08-20T01:50:03.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.348+0000 7f4845f3d640 1 --2- 172.21.15.79:0/213607740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f483800aa80 0x7f483800b3d0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:03.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.348+0000 7f4845f3d640 1 --2- 172.21.15.79:0/213607740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f483800a0c0 0x7f483800a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:03.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.348+0000 7f4845f3d640 1 --2- 172.21.15.79:0/213607740 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4838008f70 0x7f4838009370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:03.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.348+0000 7f4845f3d640 1 -- 172.21.15.79:0/213607740 >> 172.21.15.79:0/213607740 conn(0x7f4838092ff0 msgr2=0x7f4838095410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:03.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.348+0000 7f4845f3d640 1 -- 172.21.15.79:0/213607740 shutdown_connections 2024-08-20T01:50:03.353 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.348+0000 7f4845f3d640 1 -- 172.21.15.79:0/213607740 wait complete. 2024-08-20T01:50:03.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.349+0000 7f4845f3d640 1 Processor -- start 2024-08-20T01:50:03.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.349+0000 7f4845f3d640 1 -- start start 2024-08-20T01:50:03.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.349+0000 7f4845f3d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4838008f70 0x7f4838131ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:03.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.349+0000 7f4845f3d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f483800a0c0 0x7f4838132110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:03.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.349+0000 7f4845f3d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f483800aa80 0x7f4838132d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:03.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.350+0000 7f4845f3d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f48380a74d0 con 0x7f483800aa80 2024-08-20T01:50:03.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.350+0000 7f4845f3d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f48380a7350 con 0x7f4838008f70 2024-08-20T01:50:03.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.350+0000 7f4845f3d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f48380a7650 con 0x7f483800a0c0 2024-08-20T01:50:03.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.350+0000 7f4844f3b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4838008f70 0x7f4838131ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:03.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.350+0000 7f4844f3b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4838008f70 0x7f4838131ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:57800/0 (socket says 172.21.15.79:57800) 2024-08-20T01:50:03.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.350+0000 7f4844f3b640 1 -- 172.21.15.79:0/3114812440 learned_addr learned my addr 172.21.15.79:0/3114812440 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:03.354 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.350+0000 7f483ffff640 1 --2- 172.21.15.79:0/3114812440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f483800a0c0 0x7f4838132110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:03.355 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.350+0000 7f484573c640 1 --2- 172.21.15.79:0/3114812440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f483800aa80 0x7f4838132d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:03.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.350+0000 7f4844f3b640 1 -- 172.21.15.79:0/3114812440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f483800a0c0 msgr2=0x7f4838132110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:03.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.350+0000 7f4844f3b640 1 --2- 172.21.15.79:0/3114812440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f483800a0c0 0x7f4838132110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:03.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.350+0000 7f4844f3b640 1 -- 172.21.15.79:0/3114812440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f483800aa80 msgr2=0x7f4838132d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:03.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.350+0000 7f4844f3b640 1 --2- 172.21.15.79:0/3114812440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f483800aa80 0x7f4838132d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:03.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.350+0000 7f4844f3b640 1 -- 172.21.15.79:0/3114812440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4838133600 con 0x7f4838008f70 2024-08-20T01:50:03.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.351+0000 7f4844f3b640 1 --2- 172.21.15.79:0/3114812440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4838008f70 0x7f4838131ac0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f483400e9c0 tx=0x7f483400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:03.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.351+0000 7f483dffb640 1 -- 172.21.15.79:0/3114812440 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f483400ccc0 con 0x7f4838008f70 2024-08-20T01:50:03.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.351+0000 7f483dffb640 1 -- 172.21.15.79:0/3114812440 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f48340054b0 con 0x7f4838008f70 2024-08-20T01:50:03.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.351+0000 7f483dffb640 1 -- 172.21.15.79:0/3114812440 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f483400ccc0 con 0x7f4838008f70 2024-08-20T01:50:03.356 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.351+0000 7f4845f3d640 1 -- 172.21.15.79:0/3114812440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48381338f0 con 0x7f4838008f70 2024-08-20T01:50:03.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.351+0000 7f4845f3d640 1 -- 172.21.15.79:0/3114812440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4838139fc0 con 0x7f4838008f70 2024-08-20T01:50:03.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.354+0000 7f483dffb640 1 -- 172.21.15.79:0/3114812440 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f48340046c0 con 0x7f4838008f70 2024-08-20T01:50:03.357 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.355+0000 7f484a071740 1 Processor -- start 2024-08-20T01:50:03.358 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.355+0000 7f484a071740 1 -- start start 2024-08-20T01:50:03.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.356+0000 7f484a071740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56166efe4a20 0x56166efe6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:03.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.356+0000 7f484a071740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56166efe7350 0x56166efe9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:03.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.356+0000 7f484a071740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56166efe9d90 0x56166efec250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:03.359 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.356+0000 7f484a071740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56166ef57360 con 0x56166efe4a20 2024-08-20T01:50:03.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.356+0000 7f484a071740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56166ef46860 con 0x56166efe7350 2024-08-20T01:50:03.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.356+0000 7f484a071740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56166ef4a8a0 con 0x56166efe9d90 2024-08-20T01:50:03.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.356+0000 7f483dffb640 1 --2- 172.21.15.79:0/3114812440 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f48300b3e20 0x7f48300b62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:03.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.356+0000 7f4844f3b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56166efe7350 0x56166efe9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:03.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.356+0000 7f4844f3b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56166efe7350 0x56166efe9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:57804/0 (socket says 172.21.15.79:57804) 2024-08-20T01:50:03.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.356+0000 7f4844f3b640 1 -- 172.21.15.79:0/4145890586 learned_addr learned my addr 172.21.15.79:0/4145890586 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:03.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.356+0000 7f483ffff640 1 --2- 172.21.15.79:0/4145890586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56166efe9d90 0x56166efec250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:03.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.356+0000 7f484573c640 1 --2- 172.21.15.79:0/4145890586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56166efe4a20 0x56166efe6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:03.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.356+0000 7f4844f3b640 1 -- 172.21.15.79:0/4145890586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56166efe9d90 msgr2=0x56166efec250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:03.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.357+0000 7f4844f3b640 1 --2- 172.21.15.79:0/4145890586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56166efe9d90 0x56166efec250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:03.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.357+0000 7f4844f3b640 1 -- 172.21.15.79:0/4145890586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56166efe4a20 msgr2=0x56166efe6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:03.360 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.357+0000 7f4844f3b640 1 --2- 172.21.15.79:0/4145890586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56166efe4a20 0x56166efe6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:03.361 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.357+0000 7f4844f3b640 1 -- 172.21.15.79:0/4145890586 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56166eeede40 con 0x56166efe7350 2024-08-20T01:50:03.361 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.357+0000 7f484573c640 1 --2- 172.21.15.79:0/4145890586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56166efe4a20 0x56166efe6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:50:03.361 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.357+0000 7f484573c640 1 --2- 172.21.15.79:0/3114812440 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f48300b3e20 0x7f48300b62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:03.361 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.357+0000 7f483dffb640 1 -- 172.21.15.79:0/3114812440 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f48340e3ae0 con 0x7f4838008f70 2024-08-20T01:50:03.361 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.357+0000 7f4844f3b640 1 --2- 172.21.15.79:0/4145890586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56166efe7350 0x56166efe9740 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f48340cd700 tx=0x7f4834021000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=517aa6e750de0f98 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:03.361 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.357+0000 7f482affd640 1 -- 172.21.15.79:0/4145890586 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f483401b3c0 con 0x56166efe7350 2024-08-20T01:50:03.361 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.357+0000 7f482affd640 1 -- 172.21.15.79:0/4145890586 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4834007e40 con 0x56166efe7350 2024-08-20T01:50:03.361 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.357+0000 7f484573c640 1 --2- 172.21.15.79:0/3114812440 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f48300b3e20 0x7f48300b62e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f48400687d0 tx=0x7f4840068f70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:03.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.357+0000 7f482affd640 1 -- 172.21.15.79:0/4145890586 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f483400ce60 con 0x56166efe7350 2024-08-20T01:50:03.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.358+0000 7f484a071740 1 -- 172.21.15.79:0/4145890586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56166efe7350 msgr2=0x56166efe9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:03.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.358+0000 7f484a071740 1 --2- 172.21.15.79:0/4145890586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56166efe7350 0x56166efe9740 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f48340cd700 tx=0x7f4834021000 comp rx=0 tx=0).stop 2024-08-20T01:50:03.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.358+0000 7f484a071740 1 -- 172.21.15.79:0/4145890586 shutdown_connections 2024-08-20T01:50:03.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.358+0000 7f484a071740 1 --2- 172.21.15.79:0/4145890586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56166efe9d90 0x56166efec250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:03.362 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.358+0000 7f484a071740 1 --2- 172.21.15.79:0/4145890586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56166efe7350 0x56166efe9740 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:03.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.358+0000 7f484a071740 1 --2- 172.21.15.79:0/4145890586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56166efe4a20 0x56166efe6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:03.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.358+0000 7f484a071740 1 -- 172.21.15.79:0/4145890586 >> 172.21.15.79:0/4145890586 conn(0x56166efdfb70 msgr2=0x56166efe0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:03.363 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.360+0000 7f484a071740 1 -- 172.21.15.79:0/4145890586 shutdown_connections 2024-08-20T01:50:03.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.360+0000 7f484a071740 1 -- 172.21.15.79:0/4145890586 wait complete. 2024-08-20T01:50:03.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.360+0000 7f484a071740 1 -- start start 2024-08-20T01:50:03.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.360+0000 7f484a071740 1 Processor -- start 2024-08-20T01:50:03.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.361+0000 7f484a071740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56166efe4a20 0x56166efee130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:03.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.361+0000 7f484a071740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56166efe7350 0x56166efee7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:03.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.361+0000 7f4844f3b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56166efe4a20 0x56166efee130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:03.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.361+0000 7f4844f3b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56166efe4a20 0x56166efee130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:57810/0 (socket says 172.21.15.79:57810) 2024-08-20T01:50:03.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.361+0000 7f4844f3b640 1 -- 172.21.15.79:0/3620239281 learned_addr learned my addr 172.21.15.79:0/3620239281 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:03.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.361+0000 7f484a071740 1 --2- 172.21.15.79:0/3620239281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56166efe9d90 0x56166efef3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:03.365 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.361+0000 7f483ffff640 1 --2- 172.21.15.79:0/3620239281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56166efe7350 0x56166efee7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:03.366 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.361+0000 7f484a071740 1 -- 172.21.15.79:0/3620239281 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56166ee7fab0 con 0x56166efe7350 2024-08-20T01:50:03.366 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.361+0000 7f484a071740 1 -- 172.21.15.79:0/3620239281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56166eecd780 con 0x56166efe4a20 2024-08-20T01:50:03.366 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.361+0000 7f484a071740 1 -- 172.21.15.79:0/3620239281 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56166efeccb0 con 0x56166efe9d90 2024-08-20T01:50:03.366 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.361+0000 7f484573c640 1 --2- 172.21.15.79:0/3620239281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56166efe9d90 0x56166efef3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:03.366 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.361+0000 7f484a071740 10 client.0 _ll_register_callbacks cb 0x56166ec55a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:50:03.366 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.362+0000 7f4844f3b640 1 -- 172.21.15.79:0/3620239281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56166efe9d90 msgr2=0x56166efef3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:03.366 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.362+0000 7f4844f3b640 1 --2- 172.21.15.79:0/3620239281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56166efe9d90 0x56166efef3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:03.366 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.362+0000 7f4844f3b640 1 -- 172.21.15.79:0/3620239281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56166efe7350 msgr2=0x56166efee7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:03.366 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.362+0000 7f4844f3b640 1 --2- 172.21.15.79:0/3620239281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56166efe7350 0x56166efee7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:03.366 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.362+0000 7f4844f3b640 1 -- 172.21.15.79:0/3620239281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56166eca9790 con 0x56166efe4a20 2024-08-20T01:50:03.366 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.362+0000 7f4844f3b640 1 --2- 172.21.15.79:0/3620239281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56166efe4a20 0x56166efee130 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4834018000 tx=0x7f4834005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df456eec11d88b60 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:03.366 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.362+0000 7f481ffff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:50:03.367 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.362+0000 7f481ffff640 1 -- 172.21.15.79:0/3620239281 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f483401ccb0 con 0x56166efe4a20 2024-08-20T01:50:03.367 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.362+0000 7f481ffff640 1 -- 172.21.15.79:0/3620239281 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f48340b3800 con 0x56166efe4a20 2024-08-20T01:50:03.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.363+0000 7f484a071740 1 -- 172.21.15.79:0/3620239281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56166eef5e00 con 0x56166efe4a20 2024-08-20T01:50:03.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.363+0000 7f481ffff640 1 -- 172.21.15.79:0/3620239281 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f48340071c0 con 0x56166efe4a20 2024-08-20T01:50:03.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.363+0000 7f484a071740 10 client.27806 fetch_fsmap learned FSMap version 51 2024-08-20T01:50:03.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.363+0000 7f484a071740 1 -- 172.21.15.79:0/3620239281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x56166ed22620 con 0x56166efe4a20 2024-08-20T01:50:03.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.363+0000 7f481ffff640 1 -- 172.21.15.79:0/3620239281 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56166eef5e00 con 0x56166efe4a20 2024-08-20T01:50:03.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.364+0000 7f481ffff640 1 -- 172.21.15.79:0/3620239281 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7f48340a6350 con 0x56166efe4a20 2024-08-20T01:50:03.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.364+0000 7f484a071740 10 client.27806 fetch_fsmap finished waiting for FSMap version 51 2024-08-20T01:50:03.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.364+0000 7f484a071740 10 client.27806 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:50:03.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.364+0000 7f484a071740 20 client.27806 populate_metadata read hostname 'smithi079' 2024-08-20T01:50:03.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.364+0000 7f484a071740 1 --2- 172.21.15.79:0/3620239281 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56166eff9590 0x56166effba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:03.368 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.364+0000 7f484a071740 4 client.27806 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:50:03.369 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.364+0000 7f484a071740 1 -- 172.21.15.79:0/3620239281 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56166ef592b0 con 0x56166eff9590 2024-08-20T01:50:03.369 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.364+0000 7f483ffff640 1 --2- 172.21.15.79:0/3620239281 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56166eff9590 0x56166effba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:03.369 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.365+0000 7f483ffff640 1 --2- 172.21.15.79:0/3620239281 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56166eff9590 0x56166effba00 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e18c474f7b0e04f9 server_cookie=bd00efad1ceddfb7 in_seq=0 out_seq=0 2024-08-20T01:50:03.370 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.366+0000 7f481ffff640 10 client.27806 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:03.370 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.366+0000 7f481ffff640 1 -- 172.21.15.79:0/3620239281 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56166ef592b0 con 0x56166eff9590 2024-08-20T01:50:03.370 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.366+0000 7f481ffff640 10 client.27806 handle_command_reply: tid=0 2024-08-20T01:50:03.370 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.368+0000 7f484a071740 1 client.27806 shutdown 2024-08-20T01:50:03.371 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.368+0000 7f484a071740 1 -- 172.21.15.79:0/3620239281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56166efe4a20 msgr2=0x56166efee130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:03.371 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.368+0000 7f484a071740 1 --2- 172.21.15.79:0/3620239281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56166efe4a20 0x56166efee130 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4834018000 tx=0x7f4834005880 comp rx=0 tx=0).stop 2024-08-20T01:50:03.371 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.369+0000 7f484a071740 1 -- 172.21.15.79:0/3620239281 shutdown_connections 2024-08-20T01:50:03.372 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.369+0000 7f484a071740 1 --2- 172.21.15.79:0/3620239281 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56166eff9590 0x56166effba00 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:03.373 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.369+0000 7f481ffff640 0 client.27806 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:03.373 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.369+0000 7f484a071740 1 --2- 172.21.15.79:0/3620239281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56166efe9d90 0x56166efef3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:03.373 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.369+0000 7f484a071740 1 --2- 172.21.15.79:0/3620239281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56166efe7350 0x56166efee7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:03.373 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.369+0000 7f484a071740 1 --2- 172.21.15.79:0/3620239281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56166efe4a20 0x56166efee130 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:03.373 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.369+0000 7f484a071740 1 -- 172.21.15.79:0/3620239281 >> 172.21.15.79:0/3620239281 conn(0x56166efdfb70 msgr2=0x56166efdec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:03.373 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.370+0000 7f484a071740 1 -- 172.21.15.79:0/3620239281 shutdown_connections 2024-08-20T01:50:03.373 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.370+0000 7f484a071740 1 -- 172.21.15.79:0/3620239281 wait complete. 2024-08-20T01:50:03.373 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.370+0000 7f484a071740 20 client.27806 trim_cache size 0 max 16384 2024-08-20T01:50:03.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.389+0000 7f484a071740 1 Processor -- start 2024-08-20T01:50:03.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.389+0000 7f484a071740 1 -- start start 2024-08-20T01:50:03.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.389+0000 7f484a071740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56166efe4a20 0x56166efedea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:03.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.389+0000 7f484a071740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56166efe7350 0x56166efeb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:03.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.389+0000 7f484a071740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56166efe9d90 0x56166efebd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:03.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.389+0000 7f484a071740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4838142eb0 con 0x56166efe9d90 2024-08-20T01:50:03.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.389+0000 7f484a071740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f48381449f0 con 0x56166efe7350 2024-08-20T01:50:03.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.389+0000 7f484a071740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4838143580 con 0x56166efe4a20 2024-08-20T01:50:03.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.389+0000 7f484573c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56166efe9d90 0x56166efebd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:03.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.389+0000 7f484573c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56166efe9d90 0x56166efebd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56770/0 (socket says 172.21.15.79:56770) 2024-08-20T01:50:03.393 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.389+0000 7f484573c640 1 -- 172.21.15.79:0/2280115292 learned_addr learned my addr 172.21.15.79:0/2280115292 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:03.394 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.389+0000 7f483ffff640 1 --2- 172.21.15.79:0/2280115292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56166efe7350 0x56166efeb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:03.394 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.389+0000 7f4844f3b640 1 --2- 172.21.15.79:0/2280115292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56166efe4a20 0x56166efedea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:03.394 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.390+0000 7f483ffff640 1 -- 172.21.15.79:0/2280115292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56166efe4a20 msgr2=0x56166efedea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:03.394 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.390+0000 7f483ffff640 1 --2- 172.21.15.79:0/2280115292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56166efe4a20 0x56166efedea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:03.394 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.390+0000 7f483ffff640 1 -- 172.21.15.79:0/2280115292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56166efe9d90 msgr2=0x56166efebd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:03.394 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.390+0000 7f483ffff640 1 --2- 172.21.15.79:0/2280115292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56166efe9d90 0x56166efebd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:03.394 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.390+0000 7f483ffff640 1 -- 172.21.15.79:0/2280115292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56166efef710 con 0x56166efe7350 2024-08-20T01:50:03.394 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.390+0000 7f484573c640 1 --2- 172.21.15.79:0/2280115292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56166efe9d90 0x56166efebd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:50:03.394 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.390+0000 7f483ffff640 1 --2- 172.21.15.79:0/2280115292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56166efe7350 0x56166efeb7c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x56166efda190 tx=0x7f482c005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13b6e018c789e81a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:03.394 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.390+0000 7f482a7fc640 1 -- 172.21.15.79:0/2280115292 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f482c022070 con 0x56166efe7350 2024-08-20T01:50:03.394 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.390+0000 7f482a7fc640 1 -- 172.21.15.79:0/2280115292 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f482c00fca0 con 0x56166efe7350 2024-08-20T01:50:03.394 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.390+0000 7f482a7fc640 1 -- 172.21.15.79:0/2280115292 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f482c01fb10 con 0x56166efe7350 2024-08-20T01:50:03.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.391+0000 7f484a071740 1 -- 172.21.15.79:0/2280115292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56166efe7350 msgr2=0x56166efeb7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:03.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.391+0000 7f484a071740 1 --2- 172.21.15.79:0/2280115292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56166efe7350 0x56166efeb7c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x56166efda190 tx=0x7f482c005f90 comp rx=0 tx=0).stop 2024-08-20T01:50:03.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.391+0000 7f484a071740 1 -- 172.21.15.79:0/2280115292 shutdown_connections 2024-08-20T01:50:03.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.391+0000 7f484a071740 1 --2- 172.21.15.79:0/2280115292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56166efe9d90 0x56166efebd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:03.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.391+0000 7f484a071740 1 --2- 172.21.15.79:0/2280115292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56166efe7350 0x56166efeb7c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:03.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.391+0000 7f484a071740 1 --2- 172.21.15.79:0/2280115292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56166efe4a20 0x56166efedea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:03.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.391+0000 7f484a071740 1 -- 172.21.15.79:0/2280115292 >> 172.21.15.79:0/2280115292 conn(0x56166efdfb70 msgr2=0x56166efe3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:03.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.391+0000 7f484a071740 1 -- 172.21.15.79:0/2280115292 shutdown_connections 2024-08-20T01:50:03.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.391+0000 7f484a071740 1 -- 172.21.15.79:0/2280115292 wait complete. 2024-08-20T01:50:03.398 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.391+0000 7f484a071740 1 -- start start 2024-08-20T01:50:03.399 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.391+0000 7f484a071740 1 Processor -- start 2024-08-20T01:50:03.399 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.392+0000 7f484a071740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56166efe4a20 0x56166eff2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:03.399 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.392+0000 7f484a071740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56166efe7350 0x56166eff33e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:03.399 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.392+0000 7f4844f3b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56166efe4a20 0x56166eff2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:03.399 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.392+0000 7f4844f3b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56166efe4a20 0x56166eff2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56776/0 (socket says 172.21.15.79:56776) 2024-08-20T01:50:03.399 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.392+0000 7f484a071740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56166efe9d90 0x56166eff3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:03.399 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.392+0000 7f4844f3b640 1 -- 172.21.15.79:0/2738058319 learned_addr learned my addr 172.21.15.79:0/2738058319 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:03.399 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.392+0000 7f484a071740 1 -- 172.21.15.79:0/2738058319 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4838144320 con 0x56166efe4a20 2024-08-20T01:50:03.399 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.392+0000 7f484a071740 1 -- 172.21.15.79:0/2738058319 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4838143c50 con 0x56166efe7350 2024-08-20T01:50:03.399 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.392+0000 7f484a071740 1 -- 172.21.15.79:0/2738058319 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4838140e90 con 0x56166efe9d90 2024-08-20T01:50:03.399 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.392+0000 7f484a071740 10 client.0 _ll_register_callbacks cb 0x7f482c0097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:50:03.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.392+0000 7f4844f3b640 1 -- 172.21.15.79:0/2738058319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56166efe9d90 msgr2=0x56166eff3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:03.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.392+0000 7f4844f3b640 1 --2- 172.21.15.79:0/2738058319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56166efe9d90 0x56166eff3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:03.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.392+0000 7f4844f3b640 1 -- 172.21.15.79:0/2738058319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56166efe7350 msgr2=0x56166eff33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:03.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.392+0000 7f4844f3b640 1 --2- 172.21.15.79:0/2738058319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56166efe7350 0x56166eff33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:03.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.392+0000 7f4844f3b640 1 -- 172.21.15.79:0/2738058319 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56166eff47e0 con 0x56166efe4a20 2024-08-20T01:50:03.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.392+0000 7f4844f3b640 1 --2- 172.21.15.79:0/2738058319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56166efe4a20 0x56166eff2d40 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f48340a6720 tx=0x7f48340a9e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f671b6796d42ba8c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:03.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.392+0000 7f481ffff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:50:03.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.392+0000 7f481ffff640 1 -- 172.21.15.79:0/2738058319 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48340ca080 con 0x56166efe4a20 2024-08-20T01:50:03.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.392+0000 7f481ffff640 1 -- 172.21.15.79:0/2738058319 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f4834090ce0 con 0x56166efe4a20 2024-08-20T01:50:03.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.392+0000 7f484a071740 1 -- 172.21.15.79:0/2738058319 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f482c00fca0 con 0x56166efe4a20 2024-08-20T01:50:03.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.392+0000 7f481ffff640 1 -- 172.21.15.79:0/2738058319 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f483400ce60 con 0x56166efe4a20 2024-08-20T01:50:03.400 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.392+0000 7f484a071740 10 client.18690 fetch_fsmap learned FSMap version 51 2024-08-20T01:50:03.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.392+0000 7f484a071740 1 -- 172.21.15.79:0/2738058319 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x56166eff5b30 con 0x56166efe4a20 2024-08-20T01:50:03.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.393+0000 7f481ffff640 1 -- 172.21.15.79:0/2738058319 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f48340aa4f0 con 0x56166efe4a20 2024-08-20T01:50:03.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.393+0000 7f481ffff640 1 -- 172.21.15.79:0/2738058319 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 51) ==== 8362+0+0 (secure 0 0 0) 0x7f48340b0170 con 0x56166efe4a20 2024-08-20T01:50:03.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.393+0000 7f484a071740 10 client.18690 fetch_fsmap finished waiting for FSMap version 51 2024-08-20T01:50:03.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.393+0000 7f484a071740 10 client.18690 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:50:03.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.393+0000 7f484a071740 20 client.18690 populate_metadata read hostname 'smithi079' 2024-08-20T01:50:03.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.393+0000 7f484a071740 1 --2- 172.21.15.79:0/2738058319 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56166eff9590 0x56166eff63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:03.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.393+0000 7f484a071740 4 client.18690 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:50:03.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.393+0000 7f484a071740 1 -- 172.21.15.79:0/2738058319 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f482c00fca0 con 0x56166eff9590 2024-08-20T01:50:03.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.393+0000 7f483ffff640 1 --2- 172.21.15.79:0/2738058319 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56166eff9590 0x56166eff63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:03.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.394+0000 7f481ffff640 10 client.18690 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:03.401 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.394+0000 7f483ffff640 1 --2- 172.21.15.79:0/2738058319 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56166eff9590 0x56166eff63d0 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5b509bd0a544564 server_cookie=517d034a86d36d38 in_seq=0 out_seq=0 2024-08-20T01:50:03.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.513+0000 7f481ffff640 1 -- 172.21.15.79:0/2738058319 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f482c00fca0 con 0x56166eff9590 2024-08-20T01:50:03.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.513+0000 7f481ffff640 10 client.18690 handle_command_reply: tid=0 2024-08-20T01:50:03.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.513+0000 7f484a071740 1 client.18690 shutdown 2024-08-20T01:50:03.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.514+0000 7f484a071740 1 -- 172.21.15.79:0/2738058319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56166efe4a20 msgr2=0x56166eff2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:03.517 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.514+0000 7f484a071740 1 --2- 172.21.15.79:0/2738058319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56166efe4a20 0x56166eff2d40 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f48340a6720 tx=0x7f48340a9e70 comp rx=0 tx=0).stop 2024-08-20T01:50:03.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.514+0000 7f484a071740 1 -- 172.21.15.79:0/2738058319 shutdown_connections 2024-08-20T01:50:03.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.514+0000 7f484a071740 1 --2- 172.21.15.79:0/2738058319 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56166eff9590 0x56166eff63d0 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:03.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.514+0000 7f481ffff640 0 client.18690 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:03.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.514+0000 7f484a071740 1 --2- 172.21.15.79:0/2738058319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56166efe9d90 0x56166eff3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:03.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.514+0000 7f484a071740 1 --2- 172.21.15.79:0/2738058319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56166efe7350 0x56166eff33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:03.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.514+0000 7f484a071740 1 --2- 172.21.15.79:0/2738058319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56166efe4a20 0x56166eff2d40 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:03.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.514+0000 7f484a071740 1 -- 172.21.15.79:0/2738058319 >> 172.21.15.79:0/2738058319 conn(0x56166efdfb70 msgr2=0x56166efeb7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:03.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.514+0000 7f484a071740 1 -- 172.21.15.79:0/2738058319 shutdown_connections 2024-08-20T01:50:03.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.514+0000 7f484a071740 1 -- 172.21.15.79:0/2738058319 wait complete. 2024-08-20T01:50:03.518 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.515+0000 7f484a071740 20 client.18690 trim_cache size 0 max 16384 2024-08-20T01:50:03.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:50:03.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:50:03.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:50:03.519 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:50:03.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.516+0000 7f4845f3d640 1 -- 172.21.15.79:0/3114812440 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f48300b3e20 msgr2=0x7f48300b62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:03.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.516+0000 7f4845f3d640 1 --2- 172.21.15.79:0/3114812440 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f48300b3e20 0x7f48300b62e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f48400687d0 tx=0x7f4840068f70 comp rx=0 tx=0).stop 2024-08-20T01:50:03.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.516+0000 7f4845f3d640 1 -- 172.21.15.79:0/3114812440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4838008f70 msgr2=0x7f4838131ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:03.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.516+0000 7f4845f3d640 1 --2- 172.21.15.79:0/3114812440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4838008f70 0x7f4838131ac0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f483400e9c0 tx=0x7f483400ee80 comp rx=0 tx=0).stop 2024-08-20T01:50:03.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.517+0000 7f4845f3d640 1 -- 172.21.15.79:0/3114812440 shutdown_connections 2024-08-20T01:50:03.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.517+0000 7f4845f3d640 1 --2- 172.21.15.79:0/3114812440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f483800aa80 0x7f4838132d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:03.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.517+0000 7f4845f3d640 1 --2- 172.21.15.79:0/3114812440 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f48300b3e20 0x7f48300b62e0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:03.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.517+0000 7f4845f3d640 1 --2- 172.21.15.79:0/3114812440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f483800a0c0 0x7f4838132110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:03.520 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.517+0000 7f4845f3d640 1 --2- 172.21.15.79:0/3114812440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4838008f70 0x7f4838131ac0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:03.521 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.517+0000 7f4845f3d640 1 -- 172.21.15.79:0/3114812440 >> 172.21.15.79:0/3114812440 conn(0x7f4838092ff0 msgr2=0x7f4838094a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:03.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.522+0000 7f4845f3d640 1 -- 172.21.15.79:0/3114812440 shutdown_connections 2024-08-20T01:50:03.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:03.522+0000 7f4845f3d640 1 -- 172.21.15.79:0/3114812440 wait complete. 2024-08-20T01:50:03.915 INFO:tasks.cephfs.filesystem:scrub status for tag:790dda44-e989-43f4-909b-47386fb06708 - {'path': '/', 'tag': '790dda44-e989-43f4-909b-47386fb06708', 'options': 'recursive,force'} 2024-08-20T01:50:04.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:04 smithi175 ceph-mon[22392]: pgmap v729: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 MiB/s wr, 5.52k op/s 2024-08-20T01:50:04.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:04 smithi079 ceph-mon[18656]: pgmap v729: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 MiB/s wr, 5.52k op/s 2024-08-20T01:50:04.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:04 smithi081 ceph-mon[22209]: pgmap v729: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 MiB/s wr, 5.52k op/s 2024-08-20T01:50:05.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:05 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:50:05.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:05 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:50:05.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:05 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:50:06.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:06 smithi175 ceph-mon[22392]: pgmap v730: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 24 MiB/s wr, 6.02k op/s 2024-08-20T01:50:06.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:06 smithi079 ceph-mon[18656]: pgmap v730: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 24 MiB/s wr, 6.02k op/s 2024-08-20T01:50:06.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:06 smithi081 ceph-mon[22209]: pgmap v730: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 24 MiB/s wr, 6.02k op/s 2024-08-20T01:50:08.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:08 smithi175 ceph-mon[22392]: pgmap v731: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 24 MiB/s wr, 6.11k op/s 2024-08-20T01:50:08.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:08 smithi079 ceph-mon[18656]: pgmap v731: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 24 MiB/s wr, 6.11k op/s 2024-08-20T01:50:08.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:08 smithi081 ceph-mon[22209]: pgmap v731: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 24 MiB/s wr, 6.11k op/s 2024-08-20T01:50:10.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:10 smithi175 ceph-mon[22392]: pgmap v732: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 24 MiB/s wr, 6.23k op/s 2024-08-20T01:50:10.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:10 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:50:10.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:10 smithi079 ceph-mon[18656]: pgmap v732: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 24 MiB/s wr, 6.23k op/s 2024-08-20T01:50:10.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:10 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:50:10.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:10 smithi081 ceph-mon[22209]: pgmap v732: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 24 MiB/s wr, 6.23k op/s 2024-08-20T01:50:10.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:10 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:50:12.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:12 smithi175 ceph-mon[22392]: pgmap v733: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 24 MiB/s wr, 6.15k op/s 2024-08-20T01:50:12.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:12 smithi079 ceph-mon[18656]: pgmap v733: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 24 MiB/s wr, 6.15k op/s 2024-08-20T01:50:12.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:12 smithi081 ceph-mon[22209]: pgmap v733: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 24 MiB/s wr, 6.15k op/s 2024-08-20T01:50:14.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:14 smithi175 ceph-mon[22392]: pgmap v734: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 22 MiB/s wr, 5.74k op/s 2024-08-20T01:50:14.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:14 smithi079 ceph-mon[18656]: pgmap v734: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 22 MiB/s wr, 5.74k op/s 2024-08-20T01:50:14.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:14 smithi081 ceph-mon[22209]: pgmap v734: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 22 MiB/s wr, 5.74k op/s 2024-08-20T01:50:15.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:15 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:50:15.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:15 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:50:15.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:15 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:50:15.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:15 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:50:15.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:15 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:50:15.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:15 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:50:15.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:15 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:50:15.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:15 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:50:15.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:15 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:50:15.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:15 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:50:15.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:15 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:50:15.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:15 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:50:15.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:15 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:50:15.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:15 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:50:15.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:15 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:50:16.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:16 smithi175 ceph-mon[22392]: pgmap v735: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 25 MiB/s wr, 6.27k op/s 2024-08-20T01:50:16.690 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:16 smithi079 ceph-mon[18656]: pgmap v735: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 25 MiB/s wr, 6.27k op/s 2024-08-20T01:50:16.692 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.689+0000 7f18d4658640 1 -- 172.21.15.79:0/1685662991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18cc100570 msgr2=0x7f18cc100970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:16.692 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.689+0000 7f18d4658640 1 --2- 172.21.15.79:0/1685662991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18cc100570 0x7f18cc100970 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f18c8009900 tx=0x7f18c802a410 comp rx=0 tx=0).stop 2024-08-20T01:50:16.692 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.689+0000 7f18d4658640 1 -- 172.21.15.79:0/1685662991 shutdown_connections 2024-08-20T01:50:16.692 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.689+0000 7f18d4658640 1 --2- 172.21.15.79:0/1685662991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18cc101f70 0x7f18cc1068e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:16.692 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.689+0000 7f18d4658640 1 --2- 172.21.15.79:0/1685662991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18cc1015b0 0x7f18cc101a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:16.692 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.689+0000 7f18d4658640 1 --2- 172.21.15.79:0/1685662991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18cc100570 0x7f18cc100970 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:16.692 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.689+0000 7f18d4658640 1 -- 172.21.15.79:0/1685662991 >> 172.21.15.79:0/1685662991 conn(0x7f18cc0fc170 msgr2=0x7f18cc0fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:16.692 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.689+0000 7f18d4658640 1 -- 172.21.15.79:0/1685662991 shutdown_connections 2024-08-20T01:50:16.693 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.689+0000 7f18d4658640 1 -- 172.21.15.79:0/1685662991 wait complete. 2024-08-20T01:50:16.693 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.690+0000 7f18d4658640 1 Processor -- start 2024-08-20T01:50:16.693 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.690+0000 7f18d4658640 1 -- start start 2024-08-20T01:50:16.693 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.691+0000 7f18d4658640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18cc100570 0x7f18cc10d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:16.693 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.691+0000 7f18d4658640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18cc1015b0 0x7f18cc10dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.691+0000 7f18d4658640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18cc101f70 0x7f18cc10e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.691+0000 7f18d4658640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f18cc114830 con 0x7f18cc100570 2024-08-20T01:50:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.691+0000 7f18d4658640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f18cc1146b0 con 0x7f18cc101f70 2024-08-20T01:50:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.691+0000 7f18d4658640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f18cc1149b0 con 0x7f18cc1015b0 2024-08-20T01:50:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.691+0000 7f18d2bf5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18cc101f70 0x7f18cc10e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.691+0000 7f18d2bf5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18cc101f70 0x7f18cc10e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:33218/0 (socket says 172.21.15.79:33218) 2024-08-20T01:50:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.691+0000 7f18d1bf3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18cc1015b0 0x7f18cc10dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.691+0000 7f18d1bf3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18cc1015b0 0x7f18cc10dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:50550/0 (socket says 172.21.15.79:50550) 2024-08-20T01:50:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.691+0000 7f18d2bf5640 1 -- 172.21.15.79:0/4017394670 learned_addr learned my addr 172.21.15.79:0/4017394670 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.694+0000 7f18d2bf5640 1 -- 172.21.15.79:0/4017394670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18cc1015b0 msgr2=0x7f18cc10dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.694+0000 7f18d23f4640 1 --2- 172.21.15.79:0/4017394670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18cc100570 0x7f18cc10d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.694+0000 7f18d2bf5640 1 --2- 172.21.15.79:0/4017394670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18cc1015b0 0x7f18cc10dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.694+0000 7f18d2bf5640 1 -- 172.21.15.79:0/4017394670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18cc100570 msgr2=0x7f18cc10d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.694+0000 7f18d2bf5640 1 --2- 172.21.15.79:0/4017394670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18cc100570 0x7f18cc10d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.694+0000 7f18d2bf5640 1 -- 172.21.15.79:0/4017394670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18cc10efd0 con 0x7f18cc101f70 2024-08-20T01:50:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.694+0000 7f18d1bf3640 1 --2- 172.21.15.79:0/4017394670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18cc1015b0 0x7f18cc10dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:50:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.695+0000 7f18d2bf5640 1 --2- 172.21.15.79:0/4017394670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18cc101f70 0x7f18cc10e710 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f18c400cce0 tx=0x7f18c400a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.695+0000 7f18d23f4640 1 --2- 172.21.15.79:0/4017394670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18cc100570 0x7f18cc10d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:50:16.700 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.697+0000 7f18c37fe640 1 -- 172.21.15.79:0/4017394670 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c400f450 con 0x7f18cc101f70 2024-08-20T01:50:16.700 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.697+0000 7f18c37fe640 1 -- 172.21.15.79:0/4017394670 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f18c400fa80 con 0x7f18cc101f70 2024-08-20T01:50:16.700 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.697+0000 7f18d4658640 1 -- 172.21.15.79:0/4017394670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18cc10f2c0 con 0x7f18cc101f70 2024-08-20T01:50:16.700 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.698+0000 7f18d4658640 1 -- 172.21.15.79:0/4017394670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18cc10f960 con 0x7f18cc101f70 2024-08-20T01:50:16.702 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.699+0000 7f18c37fe640 1 -- 172.21.15.79:0/4017394670 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c4018b10 con 0x7f18cc101f70 2024-08-20T01:50:16.705 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.702+0000 7f18d7449740 1 Processor -- start 2024-08-20T01:50:16.707 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.704+0000 7f18c37fe640 1 -- 172.21.15.79:0/4017394670 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f18c4018cb0 con 0x7f18cc101f70 2024-08-20T01:50:16.707 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.704+0000 7f18d7449740 1 -- start start 2024-08-20T01:50:16.707 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.704+0000 7f18d7449740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596d52088d0 0x5596d520acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:16.707 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.704+0000 7f18d7449740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596d520b200 0x5596d520d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:16.707 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.704+0000 7f18d7449740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596d520dc40 0x5596d5210100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:16.707 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.704+0000 7f18d7449740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5596d517b360 con 0x5596d52088d0 2024-08-20T01:50:16.707 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.704+0000 7f18d7449740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5596d516a860 con 0x5596d520b200 2024-08-20T01:50:16.707 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.704+0000 7f18d7449740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5596d516e8a0 con 0x5596d520dc40 2024-08-20T01:50:16.708 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.705+0000 7f18d23f4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596d520b200 0x5596d520d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:16.708 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.705+0000 7f18d23f4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596d520b200 0x5596d520d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:33222/0 (socket says 172.21.15.79:33222) 2024-08-20T01:50:16.708 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.705+0000 7f18d23f4640 1 -- 172.21.15.79:0/2275382378 learned_addr learned my addr 172.21.15.79:0/2275382378 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:16.709 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.705+0000 7f18d1bf3640 1 --2- 172.21.15.79:0/2275382378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596d520dc40 0x5596d5210100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:16.709 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.705+0000 7f18d1bf3640 1 --2- 172.21.15.79:0/2275382378 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596d52088d0 0x5596d520acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:16.709 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.705+0000 7f18d23f4640 1 -- 172.21.15.79:0/2275382378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596d520dc40 msgr2=0x5596d5210100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:16.709 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.705+0000 7f18d23f4640 1 --2- 172.21.15.79:0/2275382378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596d520dc40 0x5596d5210100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:16.709 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.705+0000 7f18d23f4640 1 -- 172.21.15.79:0/2275382378 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596d52088d0 msgr2=0x5596d520acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:16.709 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.705+0000 7f18d23f4640 1 --2- 172.21.15.79:0/2275382378 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596d52088d0 0x5596d520acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:16.709 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.705+0000 7f18d23f4640 1 -- 172.21.15.79:0/2275382378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596d5111e40 con 0x5596d520b200 2024-08-20T01:50:16.709 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.705+0000 7f18c37fe640 1 --2- 172.21.15.79:0/4017394670 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f18b80b3d50 0x7f18b80b6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:16.709 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.706+0000 7f18c37fe640 1 -- 172.21.15.79:0/4017394670 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f18c40e3ed0 con 0x7f18cc101f70 2024-08-20T01:50:16.710 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.706+0000 7f18d23f4640 1 --2- 172.21.15.79:0/2275382378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596d520b200 0x5596d520d5f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f18c8000c00 tx=0x7f18c8031560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab1c84860e119d71 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:16.710 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.706+0000 7f18d1bf3640 1 --2- 172.21.15.79:0/4017394670 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f18b80b3d50 0x7f18b80b6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:16.710 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.707+0000 7f18c0bfe640 1 -- 172.21.15.79:0/2275382378 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c8035070 con 0x5596d520b200 2024-08-20T01:50:16.710 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.707+0000 7f18c0bfe640 1 -- 172.21.15.79:0/2275382378 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f18c8004250 con 0x5596d520b200 2024-08-20T01:50:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.707+0000 7f18c0bfe640 1 -- 172.21.15.79:0/2275382378 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c80055d0 con 0x5596d520b200 2024-08-20T01:50:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.708+0000 7f18d7449740 1 -- 172.21.15.79:0/2275382378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596d520b200 msgr2=0x5596d520d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.708+0000 7f18d7449740 1 --2- 172.21.15.79:0/2275382378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596d520b200 0x5596d520d5f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f18c8000c00 tx=0x7f18c8031560 comp rx=0 tx=0).stop 2024-08-20T01:50:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.709+0000 7f18d7449740 1 -- 172.21.15.79:0/2275382378 shutdown_connections 2024-08-20T01:50:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.709+0000 7f18d7449740 1 --2- 172.21.15.79:0/2275382378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596d520dc40 0x5596d5210100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:16.712 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.709+0000 7f18d7449740 1 --2- 172.21.15.79:0/2275382378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596d520b200 0x5596d520d5f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:16.712 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.709+0000 7f18d7449740 1 --2- 172.21.15.79:0/2275382378 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596d52088d0 0x5596d520acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:16.712 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.709+0000 7f18d7449740 1 -- 172.21.15.79:0/2275382378 >> 172.21.15.79:0/2275382378 conn(0x5596d5203a20 msgr2=0x5596d52047b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:16.712 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.710+0000 7f18d1bf3640 1 --2- 172.21.15.79:0/4017394670 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f18b80b3d50 0x7f18b80b6210 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f18bc009fd0 tx=0x7f18bc009190 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.713+0000 7f18d7449740 1 -- 172.21.15.79:0/2275382378 shutdown_connections 2024-08-20T01:50:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.713+0000 7f18d7449740 1 -- 172.21.15.79:0/2275382378 wait complete. 2024-08-20T01:50:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.714+0000 7f18d7449740 1 -- start start 2024-08-20T01:50:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.714+0000 7f18d7449740 1 Processor -- start 2024-08-20T01:50:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.714+0000 7f18d7449740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596d52088d0 0x5596d5212080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.714+0000 7f18d7449740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596d520b200 0x5596d5212720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.714+0000 7f18d7449740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596d520dc40 0x5596d52132f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.714+0000 7f18d7449740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5596d50a3ab0 con 0x5596d520b200 2024-08-20T01:50:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.714+0000 7f18d7449740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5596d50f1780 con 0x5596d520dc40 2024-08-20T01:50:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.714+0000 7f18d7449740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5596d5210c10 con 0x5596d52088d0 2024-08-20T01:50:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.714+0000 7f18d7449740 10 client.0 _ll_register_callbacks cb 0x5596d4e79a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:50:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.715+0000 7f18d23f4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596d52088d0 0x5596d5212080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.715+0000 7f18d23f4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596d52088d0 0x5596d5212080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:50562/0 (socket says 172.21.15.79:50562) 2024-08-20T01:50:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.715+0000 7f18d23f4640 1 -- 172.21.15.79:0/1242909684 learned_addr learned my addr 172.21.15.79:0/1242909684 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.715+0000 7f18d2bf5640 1 --2- 172.21.15.79:0/1242909684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596d520dc40 0x5596d52132f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.715+0000 7f18d1bf3640 1 --2- 172.21.15.79:0/1242909684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596d520b200 0x5596d5212720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.715+0000 7f18d23f4640 1 -- 172.21.15.79:0/1242909684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596d520dc40 msgr2=0x5596d52132f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.715+0000 7f18d23f4640 1 --2- 172.21.15.79:0/1242909684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596d520dc40 0x5596d52132f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.715+0000 7f18d23f4640 1 -- 172.21.15.79:0/1242909684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596d520b200 msgr2=0x5596d5212720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.715+0000 7f18d23f4640 1 --2- 172.21.15.79:0/1242909684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596d520b200 0x5596d5212720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.715+0000 7f18d23f4640 1 -- 172.21.15.79:0/1242909684 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596d4ecd790 con 0x5596d52088d0 2024-08-20T01:50:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.715+0000 7f18d23f4640 1 --2- 172.21.15.79:0/1242909684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596d52088d0 0x5596d5212080 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f18c8009900 tx=0x7f18c8005580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfd87695d9446f0c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.715+0000 7f18b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:50:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.715+0000 7f18b5ffb640 1 -- 172.21.15.79:0/1242909684 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c8035070 con 0x5596d52088d0 2024-08-20T01:50:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.716+0000 7f18b5ffb640 1 -- 172.21.15.79:0/1242909684 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f18c8004250 con 0x5596d52088d0 2024-08-20T01:50:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.716+0000 7f18d7449740 1 -- 172.21.15.79:0/1242909684 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5596d5119e00 con 0x5596d52088d0 2024-08-20T01:50:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.716+0000 7f18b5ffb640 1 -- 172.21.15.79:0/1242909684 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f18c8004450 con 0x5596d52088d0 2024-08-20T01:50:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.716+0000 7f18d7449740 10 client.27748 fetch_fsmap learned FSMap version 53 2024-08-20T01:50:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.716+0000 7f18d7449740 1 -- 172.21.15.79:0/1242909684 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x5596d4f46620 con 0x5596d52088d0 2024-08-20T01:50:16.721 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.716+0000 7f18b5ffb640 1 -- 172.21.15.79:0/1242909684 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5596d5119e00 con 0x5596d52088d0 2024-08-20T01:50:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.717+0000 7f18b5ffb640 1 -- 172.21.15.79:0/1242909684 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 53) ==== 8378+0+0 (secure 0 0 0) 0x7f18c803a040 con 0x5596d52088d0 2024-08-20T01:50:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.717+0000 7f18d7449740 10 client.27748 fetch_fsmap finished waiting for FSMap version 53 2024-08-20T01:50:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.717+0000 7f18d7449740 10 client.27748 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:50:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.717+0000 7f18d7449740 20 client.27748 populate_metadata read hostname 'smithi079' 2024-08-20T01:50:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.717+0000 7f18d7449740 1 --2- 172.21.15.79:0/1242909684 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5596d521d520 0x5596d521f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.717+0000 7f18d7449740 4 client.27748 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:50:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.717+0000 7f18d7449740 1 -- 172.21.15.79:0/1242909684 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5596d517d2b0 con 0x5596d521d520 2024-08-20T01:50:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.717+0000 7f18d1bf3640 1 --2- 172.21.15.79:0/1242909684 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5596d521d520 0x5596d521f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.718+0000 7f18d1bf3640 1 --2- 172.21.15.79:0/1242909684 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5596d521d520 0x5596d521f910 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=780d74dc96b260a0 server_cookie=9a7163122a7b84d0 in_seq=0 out_seq=0 2024-08-20T01:50:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.718+0000 7f18b5ffb640 10 client.27748 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.719+0000 7f18b5ffb640 1 -- 172.21.15.79:0/1242909684 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5596d517d2b0 con 0x5596d521d520 2024-08-20T01:50:16.723 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.719+0000 7f18b5ffb640 10 client.27748 handle_command_reply: tid=0 2024-08-20T01:50:16.723 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.719+0000 7f18d7449740 1 client.27748 shutdown 2024-08-20T01:50:16.723 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.719+0000 7f18d7449740 1 -- 172.21.15.79:0/1242909684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596d52088d0 msgr2=0x5596d5212080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:16.723 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.719+0000 7f18d7449740 1 --2- 172.21.15.79:0/1242909684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596d52088d0 0x5596d5212080 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f18c8009900 tx=0x7f18c8005580 comp rx=0 tx=0).stop 2024-08-20T01:50:16.723 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.719+0000 7f18d7449740 1 -- 172.21.15.79:0/1242909684 shutdown_connections 2024-08-20T01:50:16.723 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.719+0000 7f18d7449740 1 --2- 172.21.15.79:0/1242909684 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5596d521d520 0x5596d521f910 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:16.723 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.719+0000 7f18d7449740 1 --2- 172.21.15.79:0/1242909684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596d520dc40 0x5596d52132f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:16.723 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.719+0000 7f18d7449740 1 --2- 172.21.15.79:0/1242909684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596d520b200 0x5596d5212720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:16.723 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.719+0000 7f18d7449740 1 --2- 172.21.15.79:0/1242909684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596d52088d0 0x5596d5212080 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:16.723 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.719+0000 7f18d7449740 1 -- 172.21.15.79:0/1242909684 >> 172.21.15.79:0/1242909684 conn(0x5596d5203a20 msgr2=0x5596d5202ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:16.723 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.719+0000 7f18b5ffb640 0 client.27748 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:16.724 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.719+0000 7f18d7449740 1 -- 172.21.15.79:0/1242909684 shutdown_connections 2024-08-20T01:50:16.724 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.719+0000 7f18d7449740 1 -- 172.21.15.79:0/1242909684 wait complete. 2024-08-20T01:50:16.724 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.720+0000 7f18d7449740 20 client.27748 trim_cache size 0 max 16384 2024-08-20T01:50:16.758 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.756+0000 7f18d7449740 1 Processor -- start 2024-08-20T01:50:16.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.756+0000 7f18d7449740 1 -- start start 2024-08-20T01:50:16.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.756+0000 7f18d7449740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596d52088d0 0x5596d5204280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:16.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.756+0000 7f18d7449740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596d520b200 0x5596d52047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:16.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.756+0000 7f18d7449740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596d520dc40 0x5596d520e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:16.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.756+0000 7f18d7449740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f18b000e420 con 0x5596d520b200 2024-08-20T01:50:16.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.756+0000 7f18d7449740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f18b0010020 con 0x5596d52088d0 2024-08-20T01:50:16.759 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.756+0000 7f18d7449740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f18b000ebb0 con 0x5596d520dc40 2024-08-20T01:50:16.760 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.757+0000 7f18d2bf5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596d520dc40 0x5596d520e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:16.760 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.757+0000 7f18d2bf5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596d520dc40 0x5596d520e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:50568/0 (socket says 172.21.15.79:50568) 2024-08-20T01:50:16.760 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.757+0000 7f18d2bf5640 1 -- 172.21.15.79:0/3039285828 learned_addr learned my addr 172.21.15.79:0/3039285828 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:16.760 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.757+0000 7f18d23f4640 1 --2- 172.21.15.79:0/3039285828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596d52088d0 0x5596d5204280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:16.760 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.758+0000 7f18d1bf3640 1 --2- 172.21.15.79:0/3039285828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596d520b200 0x5596d52047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:16.761 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.758+0000 7f18d2bf5640 1 -- 172.21.15.79:0/3039285828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596d52088d0 msgr2=0x5596d5204280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:16.761 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.758+0000 7f18d2bf5640 1 --2- 172.21.15.79:0/3039285828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596d52088d0 0x5596d5204280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:16.761 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.758+0000 7f18d2bf5640 1 -- 172.21.15.79:0/3039285828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596d520b200 msgr2=0x5596d52047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:16.761 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.758+0000 7f18d2bf5640 1 --2- 172.21.15.79:0/3039285828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596d520b200 0x5596d52047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:16.761 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.758+0000 7f18d2bf5640 1 -- 172.21.15.79:0/3039285828 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596d520b030 con 0x5596d520dc40 2024-08-20T01:50:16.761 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.758+0000 7f18d2bf5640 1 --2- 172.21.15.79:0/3039285828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596d520dc40 0x5596d520e020 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f18c40073d0 tx=0x7f18c40ab670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64d3abf0762d74b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:16.762 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.759+0000 7f18b7fff640 1 -- 172.21.15.79:0/3039285828 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c40c4030 con 0x5596d520dc40 2024-08-20T01:50:16.762 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.759+0000 7f18b7fff640 1 -- 172.21.15.79:0/3039285828 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f18c40a7490 con 0x5596d520dc40 2024-08-20T01:50:16.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.760+0000 7f18b7fff640 1 -- 172.21.15.79:0/3039285828 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c40a6a70 con 0x5596d520dc40 2024-08-20T01:50:16.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.760+0000 7f18d7449740 1 -- 172.21.15.79:0/3039285828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596d520dc40 msgr2=0x5596d520e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:16.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.760+0000 7f18d7449740 1 --2- 172.21.15.79:0/3039285828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596d520dc40 0x5596d520e020 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f18c40073d0 tx=0x7f18c40ab670 comp rx=0 tx=0).stop 2024-08-20T01:50:16.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.760+0000 7f18d7449740 1 -- 172.21.15.79:0/3039285828 shutdown_connections 2024-08-20T01:50:16.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.760+0000 7f18d7449740 1 --2- 172.21.15.79:0/3039285828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596d520dc40 0x5596d520e020 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:16.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.760+0000 7f18d7449740 1 --2- 172.21.15.79:0/3039285828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596d520b200 0x5596d52047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:16.763 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.760+0000 7f18d7449740 1 --2- 172.21.15.79:0/3039285828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596d52088d0 0x5596d5204280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:16.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.760+0000 7f18d7449740 1 -- 172.21.15.79:0/3039285828 >> 172.21.15.79:0/3039285828 conn(0x5596d5203a20 msgr2=0x5596d520f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:16.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.760+0000 7f18d7449740 1 -- 172.21.15.79:0/3039285828 shutdown_connections 2024-08-20T01:50:16.764 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.760+0000 7f18d7449740 1 -- 172.21.15.79:0/3039285828 wait complete. 2024-08-20T01:50:16.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.761+0000 7f18d7449740 1 -- start start 2024-08-20T01:50:16.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.761+0000 7f18d7449740 1 Processor -- start 2024-08-20T01:50:16.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.761+0000 7f18d7449740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596d52088d0 0x5596d52170f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:16.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.761+0000 7f18d7449740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596d520b200 0x5596d5217790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:16.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.761+0000 7f18d7449740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596d520dc40 0x5596d52182f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:16.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.761+0000 7f18d7449740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f18b000f950 con 0x5596d520dc40 2024-08-20T01:50:16.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.761+0000 7f18d7449740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f18b000f280 con 0x5596d520b200 2024-08-20T01:50:16.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.761+0000 7f18d7449740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f18b000c400 con 0x5596d52088d0 2024-08-20T01:50:16.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.761+0000 7f18d7449740 10 client.0 _ll_register_callbacks cb 0x7f18bc009be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:50:16.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.762+0000 7f18d23f4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596d52088d0 0x5596d52170f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:16.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.762+0000 7f18d1bf3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596d520b200 0x5596d5217790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:16.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.762+0000 7f18d1bf3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596d520b200 0x5596d5217790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:33246/0 (socket says 172.21.15.79:33246) 2024-08-20T01:50:16.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.762+0000 7f18d1bf3640 1 -- 172.21.15.79:0/4072295705 learned_addr learned my addr 172.21.15.79:0/4072295705 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:16.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.762+0000 7f18d1bf3640 1 -- 172.21.15.79:0/4072295705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596d52088d0 msgr2=0x5596d52170f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:16.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.762+0000 7f18d1bf3640 1 --2- 172.21.15.79:0/4072295705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596d52088d0 0x5596d52170f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:16.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.762+0000 7f18d1bf3640 1 -- 172.21.15.79:0/4072295705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596d520dc40 msgr2=0x5596d52182f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:16.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.762+0000 7f18d1bf3640 1 --2- 172.21.15.79:0/4072295705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596d520dc40 0x5596d52182f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:16.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.762+0000 7f18d1bf3640 1 -- 172.21.15.79:0/4072295705 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596d5218b20 con 0x5596d520b200 2024-08-20T01:50:16.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.763+0000 7f18d1bf3640 1 --2- 172.21.15.79:0/4072295705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596d520b200 0x5596d5217790 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f18bc009880 tx=0x7f18bc009d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb8c9395262bfde1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:16.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.763+0000 7f18b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:50:16.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.763+0000 7f18b5ffb640 1 -- 172.21.15.79:0/4072295705 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18bc017c40 con 0x5596d520b200 2024-08-20T01:50:16.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.763+0000 7f18b5ffb640 1 -- 172.21.15.79:0/4072295705 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f18bc017de0 con 0x5596d520b200 2024-08-20T01:50:16.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.763+0000 7f18d7449740 1 -- 172.21.15.79:0/4072295705 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18c40a7490 con 0x5596d520b200 2024-08-20T01:50:16.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.763+0000 7f18b5ffb640 1 -- 172.21.15.79:0/4072295705 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f18bc0064c0 con 0x5596d520b200 2024-08-20T01:50:16.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.764+0000 7f18d7449740 10 client.27821 fetch_fsmap learned FSMap version 53 2024-08-20T01:50:16.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.764+0000 7f18d7449740 1 -- 172.21.15.79:0/4072295705 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x5596d5219f60 con 0x5596d520b200 2024-08-20T01:50:16.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.764+0000 7f18b5ffb640 1 -- 172.21.15.79:0/4072295705 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f18c40a7490 con 0x5596d520b200 2024-08-20T01:50:16.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.764+0000 7f18b5ffb640 1 -- 172.21.15.79:0/4072295705 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 53) ==== 8378+0+0 (secure 0 0 0) 0x7f18bc011aa0 con 0x5596d520b200 2024-08-20T01:50:16.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.764+0000 7f18d7449740 10 client.27821 fetch_fsmap finished waiting for FSMap version 53 2024-08-20T01:50:16.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.764+0000 7f18d7449740 10 client.27821 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:50:16.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.764+0000 7f18d7449740 20 client.27821 populate_metadata read hostname 'smithi079' 2024-08-20T01:50:16.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.764+0000 7f18d7449740 1 --2- 172.21.15.79:0/4072295705 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5596d5288770 0x5596d528ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:16.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.764+0000 7f18d7449740 4 client.27821 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:50:16.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.764+0000 7f18d7449740 1 -- 172.21.15.79:0/4072295705 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5596d5178d50 con 0x5596d5288770 2024-08-20T01:50:16.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.767+0000 7f18d23f4640 1 --2- 172.21.15.79:0/4072295705 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5596d5288770 0x5596d528ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:16.773 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.770+0000 7f18d23f4640 1 --2- 172.21.15.79:0/4072295705 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5596d5288770 0x5596d528ab90 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f41226e5d73e7bf server_cookie=a21c6e9c68d48091 in_seq=0 out_seq=0 2024-08-20T01:50:16.774 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.771+0000 7f18b5ffb640 10 client.27821 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:16.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:16 smithi081 ceph-mon[22209]: pgmap v735: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 25 MiB/s wr, 6.27k op/s 2024-08-20T01:50:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.817+0000 7f18b5ffb640 1 -- 172.21.15.79:0/4072295705 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5596d5178d50 con 0x5596d5288770 2024-08-20T01:50:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.817+0000 7f18b5ffb640 10 client.27821 handle_command_reply: tid=0 2024-08-20T01:50:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.817+0000 7f18d7449740 1 client.27821 shutdown 2024-08-20T01:50:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.817+0000 7f18d7449740 1 -- 172.21.15.79:0/4072295705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596d520b200 msgr2=0x5596d5217790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.817+0000 7f18d7449740 1 --2- 172.21.15.79:0/4072295705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596d520b200 0x5596d5217790 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f18bc009880 tx=0x7f18bc009d10 comp rx=0 tx=0).stop 2024-08-20T01:50:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.817+0000 7f18d7449740 1 -- 172.21.15.79:0/4072295705 shutdown_connections 2024-08-20T01:50:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.817+0000 7f18d7449740 1 --2- 172.21.15.79:0/4072295705 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5596d5288770 0x5596d528ab90 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.817+0000 7f18d7449740 1 --2- 172.21.15.79:0/4072295705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596d520dc40 0x5596d52182f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:16.822 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.817+0000 7f18d7449740 1 --2- 172.21.15.79:0/4072295705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596d520b200 0x5596d5217790 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:16.822 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.817+0000 7f18d7449740 1 --2- 172.21.15.79:0/4072295705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596d52088d0 0x5596d52170f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:16.822 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.817+0000 7f18d7449740 1 -- 172.21.15.79:0/4072295705 >> 172.21.15.79:0/4072295705 conn(0x5596d5203a20 msgr2=0x5596d5207c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:16.822 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.817+0000 7f18b5ffb640 0 client.27821 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:16.822 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.818+0000 7f18d7449740 1 -- 172.21.15.79:0/4072295705 shutdown_connections 2024-08-20T01:50:16.822 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.818+0000 7f18d7449740 1 -- 172.21.15.79:0/4072295705 wait complete. 2024-08-20T01:50:16.822 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.818+0000 7f18d7449740 20 client.27821 trim_cache size 0 max 16384 2024-08-20T01:50:16.822 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:50:16.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:50:16.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:50:16.823 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:50:16.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.818+0000 7f18d4658640 1 -- 172.21.15.79:0/4017394670 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f18b80b3d50 msgr2=0x7f18b80b6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:16.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.818+0000 7f18d4658640 1 --2- 172.21.15.79:0/4017394670 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f18b80b3d50 0x7f18b80b6210 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f18bc009fd0 tx=0x7f18bc009190 comp rx=0 tx=0).stop 2024-08-20T01:50:16.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.818+0000 7f18d4658640 1 -- 172.21.15.79:0/4017394670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18cc101f70 msgr2=0x7f18cc10e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:16.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.818+0000 7f18d4658640 1 --2- 172.21.15.79:0/4017394670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18cc101f70 0x7f18cc10e710 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f18c400cce0 tx=0x7f18c400a620 comp rx=0 tx=0).stop 2024-08-20T01:50:16.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.819+0000 7f18d4658640 1 -- 172.21.15.79:0/4017394670 shutdown_connections 2024-08-20T01:50:16.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.819+0000 7f18d4658640 1 --2- 172.21.15.79:0/4017394670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18cc101f70 0x7f18cc10e710 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:16.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.819+0000 7f18d4658640 1 --2- 172.21.15.79:0/4017394670 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f18b80b3d50 0x7f18b80b6210 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:16.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.819+0000 7f18d4658640 1 --2- 172.21.15.79:0/4017394670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18cc1015b0 0x7f18cc10dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:16.824 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.819+0000 7f18d4658640 1 --2- 172.21.15.79:0/4017394670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18cc100570 0x7f18cc10d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:16.825 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.819+0000 7f18d4658640 1 -- 172.21.15.79:0/4017394670 >> 172.21.15.79:0/4017394670 conn(0x7f18cc0fc170 msgr2=0x7f18cc0fcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:16.825 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.819+0000 7f18d4658640 1 -- 172.21.15.79:0/4017394670 shutdown_connections 2024-08-20T01:50:16.825 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:16.819+0000 7f18d4658640 1 -- 172.21.15.79:0/4017394670 wait complete. 2024-08-20T01:50:18.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:18 smithi175 ceph-mon[22392]: pgmap v736: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 25 MiB/s wr, 6.33k op/s 2024-08-20T01:50:18.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:18 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:50:18.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:18 smithi079 ceph-mon[18656]: pgmap v736: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 25 MiB/s wr, 6.33k op/s 2024-08-20T01:50:18.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:18 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:50:18.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:18 smithi081 ceph-mon[22209]: pgmap v736: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 25 MiB/s wr, 6.33k op/s 2024-08-20T01:50:18.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:18 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:50:19.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:19 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:50:19.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:19 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:50:19.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:19 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:50:19.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:19 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:50:19.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:19 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:50:19.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:19 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:50:19.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:19 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:50:19.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:19 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:50:19.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:19 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:50:20.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:20 smithi079 ceph-mon[18656]: pgmap v737: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 6.31k op/s 2024-08-20T01:50:20.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:20 smithi175 ceph-mon[22392]: pgmap v737: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 6.31k op/s 2024-08-20T01:50:20.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:20 smithi081 ceph-mon[22209]: pgmap v737: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 6.31k op/s 2024-08-20T01:50:22.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:22 smithi079 ceph-mon[18656]: pgmap v738: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 6.21k op/s 2024-08-20T01:50:22.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:22 smithi081 ceph-mon[22209]: pgmap v738: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 6.21k op/s 2024-08-20T01:50:22.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:22 smithi175 ceph-mon[22392]: pgmap v738: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 6.21k op/s 2024-08-20T01:50:24.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:24 smithi079 ceph-mon[18656]: pgmap v739: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 22 MiB/s wr, 5.71k op/s 2024-08-20T01:50:24.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:24 smithi081 ceph-mon[22209]: pgmap v739: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 22 MiB/s wr, 5.71k op/s 2024-08-20T01:50:24.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:24 smithi175 ceph-mon[22392]: pgmap v739: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 22 MiB/s wr, 5.71k op/s 2024-08-20T01:50:26.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:26 smithi079 ceph-mon[18656]: pgmap v740: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 MiB/s wr, 6.18k op/s 2024-08-20T01:50:26.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:26 smithi081 ceph-mon[22209]: pgmap v740: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 MiB/s wr, 6.18k op/s 2024-08-20T01:50:26.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:26 smithi175 ceph-mon[22392]: pgmap v740: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 MiB/s wr, 6.18k op/s 2024-08-20T01:50:28.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:28 smithi079 ceph-mon[18656]: pgmap v741: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 6.23k op/s 2024-08-20T01:50:28.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:28 smithi081 ceph-mon[22209]: pgmap v741: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 6.23k op/s 2024-08-20T01:50:28.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:28 smithi175 ceph-mon[22392]: pgmap v741: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 6.23k op/s 2024-08-20T01:50:29.922 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.917+0000 7fe0f808d640 1 -- 172.21.15.79:0/3974970395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0f01026b0 msgr2=0x7fe0f0102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:29.922 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.917+0000 7fe0f808d640 1 --2- 172.21.15.79:0/3974970395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0f01026b0 0x7fe0f0102b30 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0009930 tx=0x7fe0e002a420 comp rx=0 tx=0).stop 2024-08-20T01:50:29.922 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.917+0000 7fe0f808d640 1 -- 172.21.15.79:0/3974970395 shutdown_connections 2024-08-20T01:50:29.922 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.917+0000 7fe0f808d640 1 --2- 172.21.15.79:0/3974970395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0f0103070 0x7fe0f01099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:29.922 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.917+0000 7fe0f808d640 1 --2- 172.21.15.79:0/3974970395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0f01026b0 0x7fe0f0102b30 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:29.922 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.917+0000 7fe0f808d640 1 --2- 172.21.15.79:0/3974970395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0f0101560 0x7fe0f0101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:29.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.917+0000 7fe0f808d640 1 -- 172.21.15.79:0/3974970395 >> 172.21.15.79:0/3974970395 conn(0x7fe0f00fce20 msgr2=0x7fe0f00ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:29.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.917+0000 7fe0f808d640 1 -- 172.21.15.79:0/3974970395 shutdown_connections 2024-08-20T01:50:29.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.917+0000 7fe0f808d640 1 -- 172.21.15.79:0/3974970395 wait complete. 2024-08-20T01:50:29.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.917+0000 7fe0f808d640 1 Processor -- start 2024-08-20T01:50:29.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.917+0000 7fe0f808d640 1 -- start start 2024-08-20T01:50:29.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.918+0000 7fe0f808d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0f0101560 0x7fe0f01978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:29.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.918+0000 7fe0f808d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0f01026b0 0x7fe0f0197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:29.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.918+0000 7fe0f808d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0f0103070 0x7fe0f0198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:29.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.918+0000 7fe0f808d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f010d080 con 0x7fe0f0103070 2024-08-20T01:50:29.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.918+0000 7fe0f808d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f010cf00 con 0x7fe0f01026b0 2024-08-20T01:50:29.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.918+0000 7fe0f808d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f010d200 con 0x7fe0f0101560 2024-08-20T01:50:29.923 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.918+0000 7fe0f662a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0f0103070 0x7fe0f0198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:29.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.918+0000 7fe0f662a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0f0103070 0x7fe0f0198b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47614/0 (socket says 172.21.15.79:47614) 2024-08-20T01:50:29.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.918+0000 7fe0f662a640 1 -- 172.21.15.79:0/1493818968 learned_addr learned my addr 172.21.15.79:0/1493818968 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:29.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.918+0000 7fe0f5e29640 1 --2- 172.21.15.79:0/1493818968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0f0101560 0x7fe0f01978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:29.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.918+0000 7fe0f5628640 1 --2- 172.21.15.79:0/1493818968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0f01026b0 0x7fe0f0197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:29.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.918+0000 7fe0f5e29640 1 -- 172.21.15.79:0/1493818968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0f01026b0 msgr2=0x7fe0f0197ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:29.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.918+0000 7fe0f5e29640 1 --2- 172.21.15.79:0/1493818968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0f01026b0 0x7fe0f0197ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:29.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.918+0000 7fe0f5e29640 1 -- 172.21.15.79:0/1493818968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0f0103070 msgr2=0x7fe0f0198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:29.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.918+0000 7fe0f5e29640 1 --2- 172.21.15.79:0/1493818968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0f0103070 0x7fe0f0198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:29.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.918+0000 7fe0f5e29640 1 -- 172.21.15.79:0/1493818968 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0f01993e0 con 0x7fe0f0101560 2024-08-20T01:50:29.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.918+0000 7fe0f662a640 1 --2- 172.21.15.79:0/1493818968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0f0103070 0x7fe0f0198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:50:29.924 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.918+0000 7fe0f5628640 1 --2- 172.21.15.79:0/1493818968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0f01026b0 0x7fe0f0197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:50:29.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.918+0000 7fe0f5e29640 1 --2- 172.21.15.79:0/1493818968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0f0101560 0x7fe0f01978a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec00e9f0 tx=0x7fe0ec00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:29.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.919+0000 7fe0e6ffd640 1 -- 172.21.15.79:0/1493818968 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec00ccc0 con 0x7fe0f0101560 2024-08-20T01:50:29.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.919+0000 7fe0f808d640 1 -- 172.21.15.79:0/1493818968 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0f01996d0 con 0x7fe0f0101560 2024-08-20T01:50:29.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.919+0000 7fe0e6ffd640 1 -- 172.21.15.79:0/1493818968 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0ec0108c0 con 0x7fe0f0101560 2024-08-20T01:50:29.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.919+0000 7fe0e6ffd640 1 -- 172.21.15.79:0/1493818968 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec0187c0 con 0x7fe0f0101560 2024-08-20T01:50:29.925 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.919+0000 7fe0f808d640 1 -- 172.21.15.79:0/1493818968 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0f019fda0 con 0x7fe0f0101560 2024-08-20T01:50:29.931 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.921+0000 7fe0fae7f740 1 Processor -- start 2024-08-20T01:50:29.931 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.921+0000 7fe0fae7f740 1 -- start start 2024-08-20T01:50:29.932 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.921+0000 7fe0fae7f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be54329840 0x55be5432bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:29.932 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.921+0000 7fe0fae7f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be5432c170 0x55be5432e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:29.932 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.922+0000 7fe0fae7f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be5432ebb0 0x55be54331070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:29.932 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.922+0000 7fe0fae7f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55be5429a360 con 0x55be54329840 2024-08-20T01:50:29.932 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.922+0000 7fe0fae7f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55be54289860 con 0x55be5432ebb0 2024-08-20T01:50:29.932 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.922+0000 7fe0fae7f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55be5428d8a0 con 0x55be5432c170 2024-08-20T01:50:29.932 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.922+0000 7fe0f662a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be54329840 0x55be5432bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:29.932 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.922+0000 7fe0f662a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be54329840 0x55be5432bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47622/0 (socket says 172.21.15.79:47622) 2024-08-20T01:50:29.932 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.922+0000 7fe0f662a640 1 -- 172.21.15.79:0/2754785902 learned_addr learned my addr 172.21.15.79:0/2754785902 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:29.932 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.922+0000 7fe0f5628640 1 --2- 172.21.15.79:0/2754785902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be5432ebb0 0x55be54331070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:29.932 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.922+0000 7fe0f662a640 1 -- 172.21.15.79:0/2754785902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be5432c170 msgr2=0x55be5432e560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:50:29.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.922+0000 7fe0f662a640 1 --2- 172.21.15.79:0/2754785902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be5432c170 0x55be5432e560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:29.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.922+0000 7fe0f662a640 1 -- 172.21.15.79:0/2754785902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be5432ebb0 msgr2=0x55be54331070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:29.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.922+0000 7fe0f662a640 1 --2- 172.21.15.79:0/2754785902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be5432ebb0 0x55be54331070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:29.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.922+0000 7fe0f662a640 1 -- 172.21.15.79:0/2754785902 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be54230e40 con 0x55be54329840 2024-08-20T01:50:29.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.922+0000 7fe0e6ffd640 1 -- 172.21.15.79:0/1493818968 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fe0ec010430 con 0x7fe0f0101560 2024-08-20T01:50:29.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.922+0000 7fe0f662a640 1 --2- 172.21.15.79:0/2754785902 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be54329840 0x55be5432bc30 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fe0e8011890 tx=0x7fe0e8011d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96bfbecbb211f125 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:29.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.922+0000 7fe0dbfff640 1 -- 172.21.15.79:0/2754785902 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e8011310 con 0x55be54329840 2024-08-20T01:50:29.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.922+0000 7fe0dbfff640 1 -- 172.21.15.79:0/2754785902 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0e800f9a0 con 0x55be54329840 2024-08-20T01:50:29.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.922+0000 7fe0dbfff640 1 -- 172.21.15.79:0/2754785902 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e8005580 con 0x55be54329840 2024-08-20T01:50:29.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.923+0000 7fe0e6ffd640 1 --2- 172.21.15.79:0/1493818968 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe0dc0b3bd0 0x7fe0dc0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:29.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.923+0000 7fe0f5e29640 1 --2- 172.21.15.79:0/1493818968 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe0dc0b3bd0 0x7fe0dc0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:29.933 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.923+0000 7fe0e6ffd640 1 -- 172.21.15.79:0/1493818968 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fe0ec0e3e90 con 0x7fe0f0101560 2024-08-20T01:50:29.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.923+0000 7fe0fae7f740 1 -- 172.21.15.79:0/2754785902 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be54329840 msgr2=0x55be5432bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:29.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.923+0000 7fe0fae7f740 1 --2- 172.21.15.79:0/2754785902 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be54329840 0x55be5432bc30 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fe0e8011890 tx=0x7fe0e8011d50 comp rx=0 tx=0).stop 2024-08-20T01:50:29.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.923+0000 7fe0f5e29640 1 --2- 172.21.15.79:0/1493818968 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe0dc0b3bd0 0x7fe0dc0b6090 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec0e19a0 tx=0x7fe0ec078640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:29.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.923+0000 7fe0fae7f740 1 -- 172.21.15.79:0/2754785902 shutdown_connections 2024-08-20T01:50:29.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.923+0000 7fe0fae7f740 1 --2- 172.21.15.79:0/2754785902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be5432ebb0 0x55be54331070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:29.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.923+0000 7fe0fae7f740 1 --2- 172.21.15.79:0/2754785902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be5432c170 0x55be5432e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:29.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.923+0000 7fe0fae7f740 1 --2- 172.21.15.79:0/2754785902 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be54329840 0x55be5432bc30 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:29.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.923+0000 7fe0fae7f740 1 -- 172.21.15.79:0/2754785902 >> 172.21.15.79:0/2754785902 conn(0x55be54322730 msgr2=0x55be54323510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:29.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.923+0000 7fe0fae7f740 1 -- 172.21.15.79:0/2754785902 shutdown_connections 2024-08-20T01:50:29.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.923+0000 7fe0fae7f740 1 -- 172.21.15.79:0/2754785902 wait complete. 2024-08-20T01:50:29.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.924+0000 7fe0fae7f740 1 -- start start 2024-08-20T01:50:29.934 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.924+0000 7fe0fae7f740 1 Processor -- start 2024-08-20T01:50:29.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.924+0000 7fe0fae7f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be54329840 0x55be54332f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:29.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.924+0000 7fe0fae7f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be5432c170 0x55be54333620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:29.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.924+0000 7fe0fae7f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be5432ebb0 0x55be543341f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:29.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.924+0000 7fe0fae7f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55be541c2ab0 con 0x55be5432ebb0 2024-08-20T01:50:29.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.924+0000 7fe0fae7f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55be54210780 con 0x55be5432c170 2024-08-20T01:50:29.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.924+0000 7fe0fae7f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55be54331b90 con 0x55be54329840 2024-08-20T01:50:29.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.924+0000 7fe0fae7f740 10 client.0 _ll_register_callbacks cb 0x55be53f98a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:50:29.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.924+0000 7fe0f5628640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be5432c170 0x55be54333620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:29.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.924+0000 7fe0f662a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be5432ebb0 0x55be543341f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:29.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.924+0000 7fe0f5628640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be5432c170 0x55be54333620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:45232/0 (socket says 172.21.15.79:45232) 2024-08-20T01:50:29.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.924+0000 7fe0f5628640 1 -- 172.21.15.79:0/1653150049 learned_addr learned my addr 172.21.15.79:0/1653150049 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:29.935 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.924+0000 7fe0f662a640 1 --2- 172.21.15.79:0/1653150049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be54329840 0x55be54332f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:29.936 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.925+0000 7fe0f5628640 1 -- 172.21.15.79:0/1653150049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be54329840 msgr2=0x55be54332f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:29.936 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.925+0000 7fe0f5628640 1 --2- 172.21.15.79:0/1653150049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be54329840 0x55be54332f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:29.936 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.925+0000 7fe0f5628640 1 -- 172.21.15.79:0/1653150049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be5432ebb0 msgr2=0x55be543341f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:29.936 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.925+0000 7fe0f5628640 1 --2- 172.21.15.79:0/1653150049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be5432ebb0 0x55be543341f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:29.936 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.925+0000 7fe0f5628640 1 -- 172.21.15.79:0/1653150049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be53fec790 con 0x55be5432c170 2024-08-20T01:50:29.936 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.925+0000 7fe0f5628640 1 --2- 172.21.15.79:0/1653150049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be5432c170 0x55be54333620 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0009930 tx=0x7fe0e0031ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b2c060441cf1cdc server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:29.936 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.925+0000 7fe0d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:50:29.936 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.925+0000 7fe0d97fa640 1 -- 172.21.15.79:0/1653150049 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0035040 con 0x55be5432c170 2024-08-20T01:50:29.936 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.925+0000 7fe0d97fa640 1 -- 172.21.15.79:0/1653150049 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fe0e0004450 con 0x55be5432c170 2024-08-20T01:50:29.936 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.925+0000 7fe0fae7f740 1 -- 172.21.15.79:0/1653150049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55be54238e00 con 0x55be5432c170 2024-08-20T01:50:29.936 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.925+0000 7fe0d97fa640 1 -- 172.21.15.79:0/1653150049 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fe0e00035f0 con 0x55be5432c170 2024-08-20T01:50:29.937 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.925+0000 7fe0fae7f740 10 client.27833 fetch_fsmap learned FSMap version 53 2024-08-20T01:50:29.937 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.925+0000 7fe0fae7f740 1 -- 172.21.15.79:0/1653150049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x55be54065620 con 0x55be5432c170 2024-08-20T01:50:29.937 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.925+0000 7fe0d97fa640 1 -- 172.21.15.79:0/1653150049 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55be54238e00 con 0x55be5432c170 2024-08-20T01:50:29.937 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.926+0000 7fe0d97fa640 1 -- 172.21.15.79:0/1653150049 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 53) ==== 8378+0+0 (secure 0 0 0) 0x7fe0e003c7b0 con 0x55be5432c170 2024-08-20T01:50:29.937 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.926+0000 7fe0fae7f740 10 client.27833 fetch_fsmap finished waiting for FSMap version 53 2024-08-20T01:50:29.937 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.926+0000 7fe0fae7f740 10 client.27833 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:50:29.937 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.926+0000 7fe0fae7f740 20 client.27833 populate_metadata read hostname 'smithi079' 2024-08-20T01:50:29.937 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.926+0000 7fe0fae7f740 1 --2- 172.21.15.79:0/1653150049 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55be5433e8a0 0x55be54340c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:29.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.926+0000 7fe0fae7f740 4 client.27833 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:50:29.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.926+0000 7fe0fae7f740 1 -- 172.21.15.79:0/1653150049 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55be5429c2b0 con 0x55be5433e8a0 2024-08-20T01:50:29.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.926+0000 7fe0f662a640 1 --2- 172.21.15.79:0/1653150049 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55be5433e8a0 0x55be54340c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:29.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.926+0000 7fe0d97fa640 10 client.27833 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:29.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.926+0000 7fe0f662a640 1 --2- 172.21.15.79:0/1653150049 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55be5433e8a0 0x55be54340c90 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a294c4ab1fa70e63 server_cookie=934b3823917ac764 in_seq=0 out_seq=0 2024-08-20T01:50:29.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.927+0000 7fe0d97fa640 1 -- 172.21.15.79:0/1653150049 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55be5429c2b0 con 0x55be5433e8a0 2024-08-20T01:50:29.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.927+0000 7fe0d97fa640 10 client.27833 handle_command_reply: tid=0 2024-08-20T01:50:29.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.927+0000 7fe0fae7f740 1 client.27833 shutdown 2024-08-20T01:50:29.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.927+0000 7fe0fae7f740 1 -- 172.21.15.79:0/1653150049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be5432c170 msgr2=0x55be54333620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:29.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.927+0000 7fe0fae7f740 1 --2- 172.21.15.79:0/1653150049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be5432c170 0x55be54333620 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0009930 tx=0x7fe0e0031ca0 comp rx=0 tx=0).stop 2024-08-20T01:50:29.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.927+0000 7fe0fae7f740 1 -- 172.21.15.79:0/1653150049 shutdown_connections 2024-08-20T01:50:29.938 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.927+0000 7fe0fae7f740 1 --2- 172.21.15.79:0/1653150049 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55be5433e8a0 0x55be54340c90 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:29.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.927+0000 7fe0fae7f740 1 --2- 172.21.15.79:0/1653150049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be5432ebb0 0x55be543341f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:29.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.927+0000 7fe0d97fa640 0 client.27833 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:29.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.927+0000 7fe0fae7f740 1 --2- 172.21.15.79:0/1653150049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be5432c170 0x55be54333620 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:29.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.927+0000 7fe0fae7f740 1 --2- 172.21.15.79:0/1653150049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be54329840 0x55be54332f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:29.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.927+0000 7fe0fae7f740 1 -- 172.21.15.79:0/1653150049 >> 172.21.15.79:0/1653150049 conn(0x55be54322730 msgr2=0x55be54321850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:29.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.927+0000 7fe0fae7f740 1 -- 172.21.15.79:0/1653150049 shutdown_connections 2024-08-20T01:50:29.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.927+0000 7fe0fae7f740 1 -- 172.21.15.79:0/1653150049 wait complete. 2024-08-20T01:50:29.939 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.927+0000 7fe0fae7f740 20 client.27833 trim_cache size 0 max 16384 2024-08-20T01:50:29.946 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.942+0000 7fe0fae7f740 1 Processor -- start 2024-08-20T01:50:29.946 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.942+0000 7fe0fae7f740 1 -- start start 2024-08-20T01:50:29.946 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.942+0000 7fe0fae7f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be54329840 0x55be54321740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:29.946 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.942+0000 7fe0fae7f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be5432c170 0x55be543245b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:29.946 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.942+0000 7fe0fae7f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be5432ebb0 0x55be54324af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:29.947 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.942+0000 7fe0fae7f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f01a7880 con 0x55be5432ebb0 2024-08-20T01:50:29.947 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.942+0000 7fe0fae7f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f01a9480 con 0x55be54329840 2024-08-20T01:50:29.947 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.942+0000 7fe0fae7f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f01a8010 con 0x55be5432c170 2024-08-20T01:50:29.947 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.942+0000 7fe0f662a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be5432ebb0 0x55be54324af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:29.947 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.942+0000 7fe0f5628640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be5432c170 0x55be543245b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:29.947 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.943+0000 7fe0f5628640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be5432c170 0x55be543245b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:42912/0 (socket says 172.21.15.79:42912) 2024-08-20T01:50:29.947 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.943+0000 7fe0f662a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be5432ebb0 0x55be54324af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47642/0 (socket says 172.21.15.79:47642) 2024-08-20T01:50:29.947 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.943+0000 7fe0f5628640 1 -- 172.21.15.79:0/166000785 learned_addr learned my addr 172.21.15.79:0/166000785 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:29.947 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.943+0000 7fe0f662a640 1 --2- 172.21.15.79:0/166000785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be54329840 0x55be54321740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:29.947 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.943+0000 7fe0f662a640 1 -- 172.21.15.79:0/166000785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be5432c170 msgr2=0x55be543245b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:29.947 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.943+0000 7fe0f662a640 1 --2- 172.21.15.79:0/166000785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be5432c170 0x55be543245b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:29.947 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.943+0000 7fe0f662a640 1 -- 172.21.15.79:0/166000785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be54329840 msgr2=0x55be54321740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:29.948 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.943+0000 7fe0f662a640 1 --2- 172.21.15.79:0/166000785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be54329840 0x55be54321740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:29.948 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.943+0000 7fe0f662a640 1 -- 172.21.15.79:0/166000785 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be54341000 con 0x55be5432ebb0 2024-08-20T01:50:29.948 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.943+0000 7fe0f5628640 1 --2- 172.21.15.79:0/166000785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be5432c170 0x55be543245b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:50:29.948 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.943+0000 7fe0f662a640 1 --2- 172.21.15.79:0/166000785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be5432ebb0 0x55be54324af0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fe0e80049d0 tx=0x7fe0e8004c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c18056909b684e3e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:29.948 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.943+0000 7fe0db7fe640 1 -- 172.21.15.79:0/166000785 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e800f9a0 con 0x55be5432ebb0 2024-08-20T01:50:29.948 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.943+0000 7fe0db7fe640 1 -- 172.21.15.79:0/166000785 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0e8005170 con 0x55be5432ebb0 2024-08-20T01:50:29.948 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.943+0000 7fe0db7fe640 1 -- 172.21.15.79:0/166000785 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e80273f0 con 0x55be5432ebb0 2024-08-20T01:50:29.951 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.944+0000 7fe0fae7f740 1 -- 172.21.15.79:0/166000785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be5432ebb0 msgr2=0x55be54324af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:29.952 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.944+0000 7fe0fae7f740 1 --2- 172.21.15.79:0/166000785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be5432ebb0 0x55be54324af0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fe0e80049d0 tx=0x7fe0e8004c60 comp rx=0 tx=0).stop 2024-08-20T01:50:29.952 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.944+0000 7fe0fae7f740 1 -- 172.21.15.79:0/166000785 shutdown_connections 2024-08-20T01:50:29.952 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.944+0000 7fe0fae7f740 1 --2- 172.21.15.79:0/166000785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be5432ebb0 0x55be54324af0 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:29.952 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.944+0000 7fe0fae7f740 1 --2- 172.21.15.79:0/166000785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be5432c170 0x55be543245b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:29.952 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.944+0000 7fe0fae7f740 1 --2- 172.21.15.79:0/166000785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be54329840 0x55be54321740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:29.952 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.944+0000 7fe0fae7f740 1 -- 172.21.15.79:0/166000785 >> 172.21.15.79:0/166000785 conn(0x55be54322730 msgr2=0x55be54321030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:29.952 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.944+0000 7fe0fae7f740 1 -- 172.21.15.79:0/166000785 shutdown_connections 2024-08-20T01:50:29.952 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.944+0000 7fe0fae7f740 1 -- 172.21.15.79:0/166000785 wait complete. 2024-08-20T01:50:29.952 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.944+0000 7fe0fae7f740 1 -- start start 2024-08-20T01:50:29.952 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.945+0000 7fe0fae7f740 1 Processor -- start 2024-08-20T01:50:29.952 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.945+0000 7fe0fae7f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be54329840 0x55be5433a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:29.952 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.945+0000 7fe0fae7f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be5432c170 0x55be543394a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:29.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.945+0000 7fe0fae7f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be5432ebb0 0x55be543399e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:29.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.945+0000 7fe0fae7f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f01a8db0 con 0x55be5432ebb0 2024-08-20T01:50:29.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.945+0000 7fe0fae7f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f01a86e0 con 0x55be5432c170 2024-08-20T01:50:29.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.945+0000 7fe0fae7f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f01a5840 con 0x55be54329840 2024-08-20T01:50:29.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.945+0000 7fe0fae7f740 10 client.0 _ll_register_callbacks cb 0x7fe0e00095d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:50:29.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.945+0000 7fe0f662a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be5432ebb0 0x55be543399e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:29.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.945+0000 7fe0f662a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be5432ebb0 0x55be543399e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47652/0 (socket says 172.21.15.79:47652) 2024-08-20T01:50:29.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.945+0000 7fe0f662a640 1 -- 172.21.15.79:0/693411511 learned_addr learned my addr 172.21.15.79:0/693411511 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:29.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.945+0000 7fe0f662a640 1 --2- 172.21.15.79:0/693411511 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be54329840 0x55be5433a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:29.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.945+0000 7fe0f5628640 1 --2- 172.21.15.79:0/693411511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be5432c170 0x55be543394a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:29.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.945+0000 7fe0f662a640 1 -- 172.21.15.79:0/693411511 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be54329840 msgr2=0x55be5433a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:29.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.945+0000 7fe0f662a640 1 --2- 172.21.15.79:0/693411511 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be54329840 0x55be5433a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:29.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.945+0000 7fe0f662a640 1 -- 172.21.15.79:0/693411511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be5432c170 msgr2=0x55be543394a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:29.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.945+0000 7fe0f662a640 1 --2- 172.21.15.79:0/693411511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be5432c170 0x55be543394a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:29.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.945+0000 7fe0f662a640 1 -- 172.21.15.79:0/693411511 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be5432e8d0 con 0x55be5432ebb0 2024-08-20T01:50:29.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.946+0000 7fe0f662a640 1 --2- 172.21.15.79:0/693411511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be5432ebb0 0x55be543399e0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fe0e80053d0 tx=0x7fe0e8011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d676ddbcd56d4a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:29.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.946+0000 7fe0d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:50:29.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.946+0000 7fe0d97fa640 1 -- 172.21.15.79:0/693411511 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e803a060 con 0x55be5432ebb0 2024-08-20T01:50:29.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.946+0000 7fe0d97fa640 1 -- 172.21.15.79:0/693411511 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fe0e80054f0 con 0x55be5432ebb0 2024-08-20T01:50:29.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.946+0000 7fe0fae7f740 1 -- 172.21.15.79:0/693411511 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0e8005170 con 0x55be5432ebb0 2024-08-20T01:50:29.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.946+0000 7fe0d97fa640 1 -- 172.21.15.79:0/693411511 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fe0e80056f0 con 0x55be5432ebb0 2024-08-20T01:50:29.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.946+0000 7fe0fae7f740 10 client.18720 fetch_fsmap learned FSMap version 53 2024-08-20T01:50:29.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.946+0000 7fe0fae7f740 1 -- 172.21.15.79:0/693411511 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x55be54338c70 con 0x55be5432ebb0 2024-08-20T01:50:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.946+0000 7fe0d97fa640 1 -- 172.21.15.79:0/693411511 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0e8005170 con 0x55be5432ebb0 2024-08-20T01:50:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.946+0000 7fe0d97fa640 1 -- 172.21.15.79:0/693411511 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 53) ==== 8378+0+0 (secure 0 0 0) 0x7fe0e8024040 con 0x55be5432ebb0 2024-08-20T01:50:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.946+0000 7fe0fae7f740 10 client.18720 fetch_fsmap finished waiting for FSMap version 53 2024-08-20T01:50:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.946+0000 7fe0fae7f740 10 client.18720 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:50:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.946+0000 7fe0fae7f740 20 client.18720 populate_metadata read hostname 'smithi079' 2024-08-20T01:50:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.946+0000 7fe0fae7f740 1 --2- 172.21.15.79:0/693411511 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55be5433e8a0 0x55be543aba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.946+0000 7fe0fae7f740 4 client.18720 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:50:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.946+0000 7fe0fae7f740 1 -- 172.21.15.79:0/693411511 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55be54297d50 con 0x55be5433e8a0 2024-08-20T01:50:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.947+0000 7fe0f5628640 1 --2- 172.21.15.79:0/693411511 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55be5433e8a0 0x55be543aba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.947+0000 7fe0d97fa640 10 client.18720 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.947+0000 7fe0f5628640 1 --2- 172.21.15.79:0/693411511 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55be5433e8a0 0x55be543aba70 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=141f788d6bc997b2 server_cookie=d7a993979d8e9dff in_seq=0 out_seq=0 2024-08-20T01:50:29.957 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.954+0000 7fe0d97fa640 1 -- 172.21.15.79:0/693411511 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55be54297d50 con 0x55be5433e8a0 2024-08-20T01:50:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.954+0000 7fe0d97fa640 10 client.18720 handle_command_reply: tid=0 2024-08-20T01:50:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.954+0000 7fe0fae7f740 1 client.18720 shutdown 2024-08-20T01:50:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.954+0000 7fe0fae7f740 1 -- 172.21.15.79:0/693411511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be5432ebb0 msgr2=0x55be543399e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.954+0000 7fe0fae7f740 1 --2- 172.21.15.79:0/693411511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be5432ebb0 0x55be543399e0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fe0e80053d0 tx=0x7fe0e8011660 comp rx=0 tx=0).stop 2024-08-20T01:50:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.954+0000 7fe0fae7f740 1 -- 172.21.15.79:0/693411511 shutdown_connections 2024-08-20T01:50:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.954+0000 7fe0fae7f740 1 --2- 172.21.15.79:0/693411511 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55be5433e8a0 0x55be543aba70 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.954+0000 7fe0fae7f740 1 --2- 172.21.15.79:0/693411511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be5432ebb0 0x55be543399e0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.954+0000 7fe0d97fa640 0 client.18720 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.954+0000 7fe0fae7f740 1 --2- 172.21.15.79:0/693411511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be5432c170 0x55be543394a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.954+0000 7fe0fae7f740 1 --2- 172.21.15.79:0/693411511 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be54329840 0x55be5433a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.954+0000 7fe0fae7f740 1 -- 172.21.15.79:0/693411511 >> 172.21.15.79:0/693411511 conn(0x55be54322730 msgr2=0x55be54321850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:29.959 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.955+0000 7fe0fae7f740 1 -- 172.21.15.79:0/693411511 shutdown_connections 2024-08-20T01:50:29.959 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.955+0000 7fe0fae7f740 1 -- 172.21.15.79:0/693411511 wait complete. 2024-08-20T01:50:29.959 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.955+0000 7fe0fae7f740 20 client.18720 trim_cache size 0 max 16384 2024-08-20T01:50:29.959 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:50:29.959 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:50:29.959 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:50:29.959 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:50:29.960 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.955+0000 7fe0f808d640 1 -- 172.21.15.79:0/1493818968 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe0dc0b3bd0 msgr2=0x7fe0dc0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:29.960 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.955+0000 7fe0f808d640 1 --2- 172.21.15.79:0/1493818968 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe0dc0b3bd0 0x7fe0dc0b6090 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec0e19a0 tx=0x7fe0ec078640 comp rx=0 tx=0).stop 2024-08-20T01:50:29.960 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.955+0000 7fe0f808d640 1 -- 172.21.15.79:0/1493818968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0f0101560 msgr2=0x7fe0f01978a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:29.960 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.955+0000 7fe0f808d640 1 --2- 172.21.15.79:0/1493818968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0f0101560 0x7fe0f01978a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec00e9f0 tx=0x7fe0ec00eeb0 comp rx=0 tx=0).stop 2024-08-20T01:50:29.960 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.955+0000 7fe0f808d640 1 -- 172.21.15.79:0/1493818968 shutdown_connections 2024-08-20T01:50:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.955+0000 7fe0f808d640 1 --2- 172.21.15.79:0/1493818968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0f0103070 0x7fe0f0198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.955+0000 7fe0f808d640 1 --2- 172.21.15.79:0/1493818968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0f01026b0 0x7fe0f0197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.955+0000 7fe0f808d640 1 --2- 172.21.15.79:0/1493818968 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe0dc0b3bd0 0x7fe0dc0b6090 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.955+0000 7fe0f808d640 1 --2- 172.21.15.79:0/1493818968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0f0101560 0x7fe0f01978a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.955+0000 7fe0f808d640 1 -- 172.21.15.79:0/1493818968 >> 172.21.15.79:0/1493818968 conn(0x7fe0f00fce20 msgr2=0x7fe0f0105af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.955+0000 7fe0f808d640 1 -- 172.21.15.79:0/1493818968 shutdown_connections 2024-08-20T01:50:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:29.955+0000 7fe0f808d640 1 -- 172.21.15.79:0/1493818968 wait complete. 2024-08-20T01:50:30.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:30 smithi079 ceph-mon[18656]: pgmap v742: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 6.26k op/s 2024-08-20T01:50:30.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:30 smithi081 ceph-mon[22209]: pgmap v742: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 6.26k op/s 2024-08-20T01:50:30.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:30 smithi175 ceph-mon[22392]: pgmap v742: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 6.26k op/s 2024-08-20T01:50:32.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:32 smithi079 ceph-mon[18656]: pgmap v743: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 22 MiB/s wr, 5.66k op/s 2024-08-20T01:50:32.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:32 smithi081 ceph-mon[22209]: pgmap v743: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 22 MiB/s wr, 5.66k op/s 2024-08-20T01:50:32.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:32 smithi175 ceph-mon[22392]: pgmap v743: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 22 MiB/s wr, 5.66k op/s 2024-08-20T01:50:33.916 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:50:34.184 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:50:34.592 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:34 smithi079 ceph-mon[18656]: pgmap v744: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 19 MiB/s wr, 4.75k op/s 2024-08-20T01:50:34.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.680+0000 7fe92c0a2640 1 -- 172.21.15.79:0/3128734384 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9241073a0 msgr2=0x7fe9241077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:34.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.680+0000 7fe92c0a2640 1 --2- 172.21.15.79:0/3128734384 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9241073a0 0x7fe9241077e0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fe914009900 tx=0x7fe91402a410 comp rx=0 tx=0).stop 2024-08-20T01:50:34.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.680+0000 7fe92c0a2640 1 -- 172.21.15.79:0/3128734384 shutdown_connections 2024-08-20T01:50:34.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.680+0000 7fe92c0a2640 1 --2- 172.21.15.79:0/3128734384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe924107d20 0x7fe92410e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:34.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.680+0000 7fe92c0a2640 1 --2- 172.21.15.79:0/3128734384 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9241073a0 0x7fe9241077e0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:34.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.680+0000 7fe92c0a2640 1 --2- 172.21.15.79:0/3128734384 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe924101990 0x7fe924101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:34.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.680+0000 7fe92c0a2640 1 -- 172.21.15.79:0/3128734384 >> 172.21.15.79:0/3128734384 conn(0x7fe9240fd400 msgr2=0x7fe9240ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:34.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.680+0000 7fe92c0a2640 1 -- 172.21.15.79:0/3128734384 shutdown_connections 2024-08-20T01:50:34.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.680+0000 7fe92c0a2640 1 -- 172.21.15.79:0/3128734384 wait complete. 2024-08-20T01:50:34.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.680+0000 7fe92c0a2640 1 Processor -- start 2024-08-20T01:50:34.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.680+0000 7fe92c0a2640 1 -- start start 2024-08-20T01:50:34.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.681+0000 7fe92c0a2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe924101990 0x7fe924199c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:34.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.681+0000 7fe92c0a2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9241073a0 0x7fe92419a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:34.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.681+0000 7fe92c0a2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe924107d20 0x7fe9241a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:34.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.681+0000 7fe92c0a2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe9241118e0 con 0x7fe9241073a0 2024-08-20T01:50:34.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.681+0000 7fe92c0a2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe924111760 con 0x7fe924101990 2024-08-20T01:50:34.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.681+0000 7fe92c0a2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe924111a60 con 0x7fe924107d20 2024-08-20T01:50:34.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.681+0000 7fe929e3e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe924101990 0x7fe924199c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:34.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.681+0000 7fe92963d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9241073a0 0x7fe92419a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:34.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.681+0000 7fe929e3e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe924101990 0x7fe924199c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:45142/0 (socket says 172.21.15.79:45142) 2024-08-20T01:50:34.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.681+0000 7fe929e3e640 1 -- 172.21.15.79:0/515731600 learned_addr learned my addr 172.21.15.79:0/515731600 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:34.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.681+0000 7fe92a63f640 1 --2- 172.21.15.79:0/515731600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe924107d20 0x7fe9241a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:34.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.681+0000 7fe929e3e640 1 -- 172.21.15.79:0/515731600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe924107d20 msgr2=0x7fe9241a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:34.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.681+0000 7fe929e3e640 1 --2- 172.21.15.79:0/515731600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe924107d20 0x7fe9241a4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:34.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.681+0000 7fe929e3e640 1 -- 172.21.15.79:0/515731600 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9241073a0 msgr2=0x7fe92419a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:34.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.681+0000 7fe929e3e640 1 --2- 172.21.15.79:0/515731600 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9241073a0 0x7fe92419a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:34.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.681+0000 7fe929e3e640 1 -- 172.21.15.79:0/515731600 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9241a5250 con 0x7fe924101990 2024-08-20T01:50:34.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.681+0000 7fe929e3e640 1 --2- 172.21.15.79:0/515731600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe924101990 0x7fe924199c90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe92000e9f0 tx=0x7fe92000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:34.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.681+0000 7fe91affd640 1 -- 172.21.15.79:0/515731600 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe92000cd80 con 0x7fe924101990 2024-08-20T01:50:34.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.682+0000 7fe91affd640 1 -- 172.21.15.79:0/515731600 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe9200108c0 con 0x7fe924101990 2024-08-20T01:50:34.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.682+0000 7fe91affd640 1 -- 172.21.15.79:0/515731600 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9200187c0 con 0x7fe924101990 2024-08-20T01:50:34.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.682+0000 7fe92c0a2640 1 -- 172.21.15.79:0/515731600 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9241a5420 con 0x7fe924101990 2024-08-20T01:50:34.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.682+0000 7fe92c0a2640 1 -- 172.21.15.79:0/515731600 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9241a5920 con 0x7fe924101990 2024-08-20T01:50:34.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.684+0000 7fe91affd640 1 -- 172.21.15.79:0/515731600 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fe920010430 con 0x7fe924101990 2024-08-20T01:50:34.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.684+0000 7fe92e49b740 1 Processor -- start 2024-08-20T01:50:34.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.685+0000 7fe92e49b740 1 -- start start 2024-08-20T01:50:34.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.685+0000 7fe92e49b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56010fd55830 0x56010fd55c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:34.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.685+0000 7fe92e49b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56010fd56150 0x56010fd61ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:34.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.685+0000 7fe92e49b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56010fd620e0 0x56010fd644d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:34.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.685+0000 7fe92e49b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56010fccc8e0 con 0x56010fd56150 2024-08-20T01:50:34.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.685+0000 7fe92e49b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56010fcbbde0 con 0x56010fd620e0 2024-08-20T01:50:34.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.685+0000 7fe92e49b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56010fcbfe20 con 0x56010fd55830 2024-08-20T01:50:34.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.685+0000 7fe92a63f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56010fd55830 0x56010fd55c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:34.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.685+0000 7fe929e3e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56010fd56150 0x56010fd61ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:34.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.685+0000 7fe92a63f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56010fd55830 0x56010fd55c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:33436/0 (socket says 172.21.15.79:33436) 2024-08-20T01:50:34.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.685+0000 7fe92a63f640 1 -- 172.21.15.79:0/941715837 learned_addr learned my addr 172.21.15.79:0/941715837 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:34.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.685+0000 7fe92963d640 1 --2- 172.21.15.79:0/941715837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56010fd620e0 0x56010fd644d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:34.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.685+0000 7fe91affd640 1 --2- 172.21.15.79:0/515731600 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe9100b3c50 0x7fe9100b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:34.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.685+0000 7fe92a63f640 1 -- 172.21.15.79:0/941715837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56010fd620e0 msgr2=0x56010fd644d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:34.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.685+0000 7fe92a63f640 1 --2- 172.21.15.79:0/941715837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56010fd620e0 0x56010fd644d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:34.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.685+0000 7fe92a63f640 1 -- 172.21.15.79:0/941715837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56010fd56150 msgr2=0x56010fd61ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:34.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.685+0000 7fe92a63f640 1 --2- 172.21.15.79:0/941715837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56010fd56150 0x56010fd61ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:34.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.685+0000 7fe92a63f640 1 -- 172.21.15.79:0/941715837 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56010fa1b650 con 0x56010fd55830 2024-08-20T01:50:34.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.686+0000 7fe91affd640 1 -- 172.21.15.79:0/515731600 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fe9200e3f20 con 0x7fe924101990 2024-08-20T01:50:34.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.686+0000 7fe92a63f640 1 --2- 172.21.15.79:0/515731600 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe9100b3c50 0x7fe9100b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:34.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.686+0000 7fe92a63f640 1 --2- 172.21.15.79:0/941715837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56010fd55830 0x56010fd55c10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe91c011440 tx=0x7fe91c011900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d07a2538c46aa2f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:34.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.686+0000 7fe90ffff640 1 -- 172.21.15.79:0/941715837 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c003c90 con 0x56010fd55830 2024-08-20T01:50:34.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.686+0000 7fe90ffff640 1 -- 172.21.15.79:0/941715837 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe91c00fbd0 con 0x56010fd55830 2024-08-20T01:50:34.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.686+0000 7fe90ffff640 1 -- 172.21.15.79:0/941715837 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c01ba10 con 0x56010fd55830 2024-08-20T01:50:34.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.687+0000 7fe92e49b740 1 -- 172.21.15.79:0/941715837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56010fd55830 msgr2=0x56010fd55c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:34.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.687+0000 7fe92a63f640 1 --2- 172.21.15.79:0/515731600 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe9100b3c50 0x7fe9100b6110 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fe91c020000 tx=0x7fe91c021000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:34.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.687+0000 7fe92e49b740 1 --2- 172.21.15.79:0/941715837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56010fd55830 0x56010fd55c10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe91c011440 tx=0x7fe91c011900 comp rx=0 tx=0).stop 2024-08-20T01:50:34.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.687+0000 7fe92e49b740 1 -- 172.21.15.79:0/941715837 shutdown_connections 2024-08-20T01:50:34.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.687+0000 7fe92e49b740 1 --2- 172.21.15.79:0/941715837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56010fd620e0 0x56010fd644d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:34.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.687+0000 7fe92e49b740 1 --2- 172.21.15.79:0/941715837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56010fd56150 0x56010fd61ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:34.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.687+0000 7fe92e49b740 1 --2- 172.21.15.79:0/941715837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56010fd55830 0x56010fd55c10 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:34.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.687+0000 7fe92e49b740 1 -- 172.21.15.79:0/941715837 >> 172.21.15.79:0/941715837 conn(0x56010fd53660 msgr2=0x56010fd54800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:34.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.687+0000 7fe92e49b740 1 -- 172.21.15.79:0/941715837 shutdown_connections 2024-08-20T01:50:34.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.687+0000 7fe92e49b740 1 -- 172.21.15.79:0/941715837 wait complete. 2024-08-20T01:50:34.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.687+0000 7fe92e49b740 1 -- start start 2024-08-20T01:50:34.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.687+0000 7fe92e49b740 1 Processor -- start 2024-08-20T01:50:34.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.688+0000 7fe92e49b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56010fd55830 0x56010fd5f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:34.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.688+0000 7fe92e49b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56010fd56150 0x56010fd5f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:34.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.688+0000 7fe92e49b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56010fd620e0 0x56010fd5fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:34.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.688+0000 7fe92e49b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56010fb1e700 con 0x56010fd56150 2024-08-20T01:50:34.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.688+0000 7fe92e49b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56010fc427c0 con 0x56010fd620e0 2024-08-20T01:50:34.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.688+0000 7fe92e49b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56010fd64d90 con 0x56010fd55830 2024-08-20T01:50:34.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.688+0000 7fe92e49b740 10 client.0 _ll_register_callbacks cb 0x56010fcb56b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:50:34.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.688+0000 7fe92963d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56010fd56150 0x56010fd5f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:34.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.688+0000 7fe929e3e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56010fd55830 0x56010fd5f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:34.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.688+0000 7fe92a63f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56010fd620e0 0x56010fd5fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:34.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.688+0000 7fe929e3e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56010fd55830 0x56010fd5f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:33446/0 (socket says 172.21.15.79:33446) 2024-08-20T01:50:34.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.688+0000 7fe929e3e640 1 -- 172.21.15.79:0/1453728478 learned_addr learned my addr 172.21.15.79:0/1453728478 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:34.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.688+0000 7fe92963d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56010fd56150 0x56010fd5f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58438/0 (socket says 172.21.15.79:58438) 2024-08-20T01:50:34.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.688+0000 7fe92a63f640 1 -- 172.21.15.79:0/1453728478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56010fd55830 msgr2=0x56010fd5f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:34.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.688+0000 7fe92a63f640 1 --2- 172.21.15.79:0/1453728478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56010fd55830 0x56010fd5f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:34.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.688+0000 7fe92a63f640 1 -- 172.21.15.79:0/1453728478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56010fd56150 msgr2=0x56010fd5f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:34.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.688+0000 7fe92a63f640 1 --2- 172.21.15.79:0/1453728478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56010fd56150 0x56010fd5f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:34.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.688+0000 7fe92a63f640 1 -- 172.21.15.79:0/1453728478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56010fd6e110 con 0x56010fd620e0 2024-08-20T01:50:34.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.688+0000 7fe929e3e640 1 --2- 172.21.15.79:0/1453728478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56010fd55830 0x56010fd5f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:50:34.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.688+0000 7fe92a63f640 1 --2- 172.21.15.79:0/1453728478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56010fd620e0 0x56010fd5fac0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe91c011e00 tx=0x7fe91c003ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffbf62cbdce4cb70 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:34.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.688+0000 7fe90d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:50:34.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.689+0000 7fe90d7fa640 1 -- 172.21.15.79:0/1453728478 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c033020 con 0x56010fd620e0 2024-08-20T01:50:34.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.689+0000 7fe90d7fa640 1 -- 172.21.15.79:0/1453728478 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fe91c00f540 con 0x56010fd620e0 2024-08-20T01:50:34.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.689+0000 7fe92e49b740 1 -- 172.21.15.79:0/1453728478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56010fc6b100 con 0x56010fd620e0 2024-08-20T01:50:34.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.689+0000 7fe90d7fa640 1 -- 172.21.15.79:0/1453728478 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fe91c029030 con 0x56010fd620e0 2024-08-20T01:50:34.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.689+0000 7fe92e49b740 10 client.27851 fetch_fsmap learned FSMap version 53 2024-08-20T01:50:34.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.689+0000 7fe92e49b740 1 -- 172.21.15.79:0/1453728478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x56010fd70ac0 con 0x56010fd620e0 2024-08-20T01:50:34.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.689+0000 7fe90d7fa640 1 -- 172.21.15.79:0/1453728478 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56010fc6b100 con 0x56010fd620e0 2024-08-20T01:50:34.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.689+0000 7fe90d7fa640 1 -- 172.21.15.79:0/1453728478 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 53) ==== 8378+0+0 (secure 0 0 0) 0x7fe91c0254e0 con 0x56010fd620e0 2024-08-20T01:50:34.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.689+0000 7fe92e49b740 10 client.27851 fetch_fsmap finished waiting for FSMap version 53 2024-08-20T01:50:34.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.689+0000 7fe92e49b740 10 client.27851 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:50:34.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.689+0000 7fe92e49b740 20 client.27851 populate_metadata read hostname 'smithi079' 2024-08-20T01:50:34.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.689+0000 7fe92e49b740 1 --2- 172.21.15.79:0/1453728478 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56010fd71e70 0x56010fd74260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:34.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.689+0000 7fe92e49b740 4 client.27851 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:50:34.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.689+0000 7fe92e49b740 1 -- 172.21.15.79:0/1453728478 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56010fcce830 con 0x56010fd71e70 2024-08-20T01:50:34.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.689+0000 7fe929e3e640 1 --2- 172.21.15.79:0/1453728478 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56010fd71e70 0x56010fd74260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:34.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.690+0000 7fe90d7fa640 10 client.27851 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:34.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.690+0000 7fe929e3e640 1 --2- 172.21.15.79:0/1453728478 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56010fd71e70 0x56010fd74260 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9895a082ac65d6ed server_cookie=27c2f7ec433ba44 in_seq=0 out_seq=0 2024-08-20T01:50:34.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.691+0000 7fe90d7fa640 1 -- 172.21.15.79:0/1453728478 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56010fcce830 con 0x56010fd71e70 2024-08-20T01:50:34.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.691+0000 7fe90d7fa640 10 client.27851 handle_command_reply: tid=0 2024-08-20T01:50:34.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.691+0000 7fe92e49b740 1 client.27851 shutdown 2024-08-20T01:50:34.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.691+0000 7fe92e49b740 1 -- 172.21.15.79:0/1453728478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56010fd620e0 msgr2=0x56010fd5fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:34.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.691+0000 7fe92e49b740 1 --2- 172.21.15.79:0/1453728478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56010fd620e0 0x56010fd5fac0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe91c011e00 tx=0x7fe91c003ef0 comp rx=0 tx=0).stop 2024-08-20T01:50:34.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.691+0000 7fe92e49b740 1 -- 172.21.15.79:0/1453728478 shutdown_connections 2024-08-20T01:50:34.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.691+0000 7fe92e49b740 1 --2- 172.21.15.79:0/1453728478 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56010fd71e70 0x56010fd74260 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:34.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.691+0000 7fe92e49b740 1 --2- 172.21.15.79:0/1453728478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56010fd620e0 0x56010fd5fac0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:34.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.691+0000 7fe90d7fa640 0 client.27851 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:34.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.691+0000 7fe92e49b740 1 --2- 172.21.15.79:0/1453728478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56010fd56150 0x56010fd5f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:34.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.691+0000 7fe92e49b740 1 --2- 172.21.15.79:0/1453728478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56010fd55830 0x56010fd5f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:34.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.691+0000 7fe92e49b740 1 -- 172.21.15.79:0/1453728478 >> 172.21.15.79:0/1453728478 conn(0x56010fd53660 msgr2=0x56010fd59200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:34.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.691+0000 7fe92e49b740 1 -- 172.21.15.79:0/1453728478 shutdown_connections 2024-08-20T01:50:34.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.691+0000 7fe92e49b740 1 -- 172.21.15.79:0/1453728478 wait complete. 2024-08-20T01:50:34.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.691+0000 7fe92e49b740 20 client.27851 trim_cache size 0 max 16384 2024-08-20T01:50:34.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.709+0000 7fe92e49b740 1 Processor -- start 2024-08-20T01:50:34.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.709+0000 7fe92e49b740 1 -- start start 2024-08-20T01:50:34.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.709+0000 7fe92e49b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56010fd55830 0x56010fd60670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:34.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.709+0000 7fe92e49b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56010fd56150 0x56010fd59910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:34.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.709+0000 7fe92e49b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56010fd620e0 0x56010fd5e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:34.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.709+0000 7fe92e49b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe9241ae0b0 con 0x56010fd56150 2024-08-20T01:50:34.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.709+0000 7fe92e49b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe9241afcb0 con 0x56010fd55830 2024-08-20T01:50:34.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.709+0000 7fe92e49b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe9241ae840 con 0x56010fd620e0 2024-08-20T01:50:34.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.710+0000 7fe92963d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56010fd56150 0x56010fd59910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:34.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.710+0000 7fe929e3e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56010fd55830 0x56010fd60670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:34.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.710+0000 7fe92a63f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56010fd620e0 0x56010fd5e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:34.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.710+0000 7fe92963d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56010fd56150 0x56010fd59910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58448/0 (socket says 172.21.15.79:58448) 2024-08-20T01:50:34.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.710+0000 7fe92963d640 1 -- 172.21.15.79:0/435589946 learned_addr learned my addr 172.21.15.79:0/435589946 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:34.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.710+0000 7fe929e3e640 1 -- 172.21.15.79:0/435589946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56010fd620e0 msgr2=0x56010fd5e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:34.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.710+0000 7fe929e3e640 1 --2- 172.21.15.79:0/435589946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56010fd620e0 0x56010fd5e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:34.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.710+0000 7fe929e3e640 1 -- 172.21.15.79:0/435589946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56010fd56150 msgr2=0x56010fd59910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:34.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.710+0000 7fe929e3e640 1 --2- 172.21.15.79:0/435589946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56010fd56150 0x56010fd59910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:34.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.710+0000 7fe929e3e640 1 -- 172.21.15.79:0/435589946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56010fd51aa0 con 0x56010fd55830 2024-08-20T01:50:34.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.710+0000 7fe92a63f640 1 --2- 172.21.15.79:0/435589946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56010fd620e0 0x56010fd5e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:50:34.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.710+0000 7fe929e3e640 1 --2- 172.21.15.79:0/435589946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56010fd55830 0x56010fd60670 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe9200a8140 tx=0x7fe9200e78e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56000f65e3e7044c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:34.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.710+0000 7fe90f7fe640 1 -- 172.21.15.79:0/435589946 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe920010720 con 0x56010fd55830 2024-08-20T01:50:34.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.710+0000 7fe90f7fe640 1 -- 172.21.15.79:0/435589946 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe9200aa9e0 con 0x56010fd55830 2024-08-20T01:50:34.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.710+0000 7fe90f7fe640 1 -- 172.21.15.79:0/435589946 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9200e1ae0 con 0x56010fd55830 2024-08-20T01:50:34.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.711+0000 7fe92e49b740 1 -- 172.21.15.79:0/435589946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56010fd55830 msgr2=0x56010fd60670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:34.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.711+0000 7fe92e49b740 1 --2- 172.21.15.79:0/435589946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56010fd55830 0x56010fd60670 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe9200a8140 tx=0x7fe9200e78e0 comp rx=0 tx=0).stop 2024-08-20T01:50:34.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.711+0000 7fe92e49b740 1 -- 172.21.15.79:0/435589946 shutdown_connections 2024-08-20T01:50:34.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.711+0000 7fe92e49b740 1 --2- 172.21.15.79:0/435589946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56010fd620e0 0x56010fd5e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:34.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.711+0000 7fe92e49b740 1 --2- 172.21.15.79:0/435589946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56010fd56150 0x56010fd59910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:34.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.711+0000 7fe92e49b740 1 --2- 172.21.15.79:0/435589946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56010fd55830 0x56010fd60670 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:34.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.711+0000 7fe92e49b740 1 -- 172.21.15.79:0/435589946 >> 172.21.15.79:0/435589946 conn(0x56010fd53660 msgr2=0x56010fd5f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:34.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.711+0000 7fe92e49b740 1 -- 172.21.15.79:0/435589946 shutdown_connections 2024-08-20T01:50:34.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.711+0000 7fe92e49b740 1 -- 172.21.15.79:0/435589946 wait complete. 2024-08-20T01:50:34.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.712+0000 7fe92e49b740 1 -- start start 2024-08-20T01:50:34.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.712+0000 7fe92e49b740 1 Processor -- start 2024-08-20T01:50:34.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.712+0000 7fe92e49b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56010fd55830 0x56010fd6a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:34.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.712+0000 7fe92e49b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56010fd56150 0x56010fd6a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:34.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.712+0000 7fe92e49b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56010fd620e0 0x56010fd5b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:34.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.712+0000 7fe92e49b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe9241af5e0 con 0x56010fd56150 2024-08-20T01:50:34.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.712+0000 7fe92e49b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe9241aef10 con 0x56010fd55830 2024-08-20T01:50:34.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.712+0000 7fe92e49b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe9241ac090 con 0x56010fd620e0 2024-08-20T01:50:34.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.713+0000 7fe92e49b740 10 client.0 _ll_register_callbacks cb 0x7fe9200e7830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:50:34.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.713+0000 7fe929e3e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56010fd55830 0x56010fd6a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:34.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.713+0000 7fe92963d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56010fd56150 0x56010fd6a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:34.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.713+0000 7fe929e3e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56010fd55830 0x56010fd6a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:45182/0 (socket says 172.21.15.79:45182) 2024-08-20T01:50:34.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.713+0000 7fe929e3e640 1 -- 172.21.15.79:0/1533776876 learned_addr learned my addr 172.21.15.79:0/1533776876 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:34.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.713+0000 7fe92a63f640 1 --2- 172.21.15.79:0/1533776876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56010fd620e0 0x56010fd5b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:34.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.713+0000 7fe92963d640 1 -- 172.21.15.79:0/1533776876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56010fd620e0 msgr2=0x56010fd5b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:34.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.713+0000 7fe92963d640 1 --2- 172.21.15.79:0/1533776876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56010fd620e0 0x56010fd5b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:34.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.713+0000 7fe92963d640 1 -- 172.21.15.79:0/1533776876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56010fd55830 msgr2=0x56010fd6a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:34.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.713+0000 7fe92963d640 1 --2- 172.21.15.79:0/1533776876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56010fd55830 0x56010fd6a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:34.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.713+0000 7fe92963d640 1 -- 172.21.15.79:0/1533776876 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56010fd5fee0 con 0x56010fd56150 2024-08-20T01:50:34.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.713+0000 7fe929e3e640 1 --2- 172.21.15.79:0/1533776876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56010fd55830 0x56010fd6a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:50:34.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.713+0000 7fe92963d640 1 --2- 172.21.15.79:0/1533776876 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56010fd56150 0x56010fd6a740 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fe914009230 tx=0x7fe9140045b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a279a4873676797 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:34.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.713+0000 7fe90d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:50:34.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.713+0000 7fe90d7fa640 1 -- 172.21.15.79:0/1533776876 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe914035040 con 0x56010fd56150 2024-08-20T01:50:34.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.713+0000 7fe90d7fa640 1 -- 172.21.15.79:0/1533776876 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fe914003940 con 0x56010fd56150 2024-08-20T01:50:34.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.713+0000 7fe92e49b740 1 -- 172.21.15.79:0/1533776876 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9200aa9e0 con 0x56010fd56150 2024-08-20T01:50:34.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.714+0000 7fe90d7fa640 1 -- 172.21.15.79:0/1533776876 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fe914003b40 con 0x56010fd56150 2024-08-20T01:50:34.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.714+0000 7fe92e49b740 10 client.18738 fetch_fsmap learned FSMap version 53 2024-08-20T01:50:34.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.714+0000 7fe92e49b740 1 -- 172.21.15.79:0/1533776876 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x56010fd540e0 con 0x56010fd56150 2024-08-20T01:50:34.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.714+0000 7fe90d7fa640 1 -- 172.21.15.79:0/1533776876 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe9200aa9e0 con 0x56010fd56150 2024-08-20T01:50:34.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.714+0000 7fe90d7fa640 1 -- 172.21.15.79:0/1533776876 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 53) ==== 8378+0+0 (secure 0 0 0) 0x7fe914045410 con 0x56010fd56150 2024-08-20T01:50:34.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.714+0000 7fe92e49b740 10 client.18738 fetch_fsmap finished waiting for FSMap version 53 2024-08-20T01:50:34.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.714+0000 7fe92e49b740 10 client.18738 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:50:34.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.714+0000 7fe92e49b740 20 client.18738 populate_metadata read hostname 'smithi079' 2024-08-20T01:50:34.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.714+0000 7fe92e49b740 1 --2- 172.21.15.79:0/1533776876 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56010fde0d70 0x56010fde3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:34.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.714+0000 7fe92e49b740 4 client.18738 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:50:34.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.714+0000 7fe92e49b740 1 -- 172.21.15.79:0/1533776876 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56010fcca2d0 con 0x56010fde0d70 2024-08-20T01:50:34.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.715+0000 7fe929e3e640 1 --2- 172.21.15.79:0/1533776876 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56010fde0d70 0x56010fde3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:34.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.715+0000 7fe90d7fa640 10 client.18738 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:34.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.715+0000 7fe929e3e640 1 --2- 172.21.15.79:0/1533776876 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56010fde0d70 0x56010fde3190 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8703de5801e7a379 server_cookie=a0d74b2829b3e3bc in_seq=0 out_seq=0 2024-08-20T01:50:34.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.715+0000 7fe90d7fa640 1 -- 172.21.15.79:0/1533776876 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56010fcca2d0 con 0x56010fde0d70 2024-08-20T01:50:34.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.715+0000 7fe90d7fa640 10 client.18738 handle_command_reply: tid=0 2024-08-20T01:50:34.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.715+0000 7fe92e49b740 1 client.18738 shutdown 2024-08-20T01:50:34.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.715+0000 7fe92e49b740 1 -- 172.21.15.79:0/1533776876 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56010fd56150 msgr2=0x56010fd6a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:34.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.715+0000 7fe92e49b740 1 --2- 172.21.15.79:0/1533776876 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56010fd56150 0x56010fd6a740 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fe914009230 tx=0x7fe9140045b0 comp rx=0 tx=0).stop 2024-08-20T01:50:34.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.716+0000 7fe92e49b740 1 -- 172.21.15.79:0/1533776876 shutdown_connections 2024-08-20T01:50:34.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.716+0000 7fe92e49b740 1 --2- 172.21.15.79:0/1533776876 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56010fde0d70 0x56010fde3190 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:34.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.716+0000 7fe92e49b740 1 --2- 172.21.15.79:0/1533776876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56010fd620e0 0x56010fd5b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:34.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.716+0000 7fe92e49b740 1 --2- 172.21.15.79:0/1533776876 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56010fd56150 0x56010fd6a740 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:34.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.716+0000 7fe92e49b740 1 --2- 172.21.15.79:0/1533776876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56010fd55830 0x56010fd6a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:34.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.716+0000 7fe92e49b740 1 -- 172.21.15.79:0/1533776876 >> 172.21.15.79:0/1533776876 conn(0x56010fd53660 msgr2=0x56010fd6cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:34.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.716+0000 7fe90d7fa640 0 client.18738 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:34.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.716+0000 7fe92e49b740 1 -- 172.21.15.79:0/1533776876 shutdown_connections 2024-08-20T01:50:34.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.716+0000 7fe92e49b740 1 -- 172.21.15.79:0/1533776876 wait complete. 2024-08-20T01:50:34.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.716+0000 7fe92e49b740 20 client.18738 trim_cache size 0 max 16384 2024-08-20T01:50:34.733 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:50:34.734 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-08-20T01:50:34.734 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-08-20T01:50:34.734 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:50:34.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.716+0000 7fe92c0a2640 1 -- 172.21.15.79:0/515731600 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe9100b3c50 msgr2=0x7fe9100b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:34.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.716+0000 7fe92c0a2640 1 --2- 172.21.15.79:0/515731600 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe9100b3c50 0x7fe9100b6110 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fe91c020000 tx=0x7fe91c021000 comp rx=0 tx=0).stop 2024-08-20T01:50:34.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.716+0000 7fe92c0a2640 1 -- 172.21.15.79:0/515731600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe924101990 msgr2=0x7fe924199c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:34.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.716+0000 7fe92c0a2640 1 --2- 172.21.15.79:0/515731600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe924101990 0x7fe924199c90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe92000e9f0 tx=0x7fe92000eeb0 comp rx=0 tx=0).stop 2024-08-20T01:50:34.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.717+0000 7fe92c0a2640 1 -- 172.21.15.79:0/515731600 shutdown_connections 2024-08-20T01:50:34.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.717+0000 7fe92c0a2640 1 --2- 172.21.15.79:0/515731600 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe9100b3c50 0x7fe9100b6110 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:34.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.717+0000 7fe92c0a2640 1 --2- 172.21.15.79:0/515731600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe924107d20 0x7fe9241a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:34.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.717+0000 7fe92c0a2640 1 --2- 172.21.15.79:0/515731600 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9241073a0 0x7fe92419a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:34.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.717+0000 7fe92c0a2640 1 --2- 172.21.15.79:0/515731600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe924101990 0x7fe924199c90 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:34.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.717+0000 7fe92c0a2640 1 -- 172.21.15.79:0/515731600 >> 172.21.15.79:0/515731600 conn(0x7fe9240fd400 msgr2=0x7fe9240ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:34.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.717+0000 7fe92c0a2640 1 -- 172.21.15.79:0/515731600 shutdown_connections 2024-08-20T01:50:34.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:34.717+0000 7fe92c0a2640 1 -- 172.21.15.79:0/515731600 wait complete. 2024-08-20T01:50:34.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:34 smithi081 ceph-mon[22209]: pgmap v744: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 19 MiB/s wr, 4.75k op/s 2024-08-20T01:50:34.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:34 smithi175 ceph-mon[22392]: pgmap v744: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 19 MiB/s wr, 4.75k op/s 2024-08-20T01:50:35.709 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T01:50:35.709 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:50:35.985 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:50:36.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.512+0000 7f8fd67fa640 1 -- 172.21.15.79:0/3254364532 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fd0101990 msgr2=0x7f8fd0101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:36.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.512+0000 7f8fd67fa640 1 --2- 172.21.15.79:0/3254364532 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fd0101990 0x7f8fd0101d70 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0009900 tx=0x7f8fc002a410 comp rx=0 tx=0).stop 2024-08-20T01:50:36.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.512+0000 7f8fd67fa640 1 -- 172.21.15.79:0/3254364532 shutdown_connections 2024-08-20T01:50:36.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.512+0000 7f8fd67fa640 1 --2- 172.21.15.79:0/3254364532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fd0107d20 0x7f8fd010e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:36.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.512+0000 7f8fd67fa640 1 --2- 172.21.15.79:0/3254364532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fd01073a0 0x7f8fd01077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:36.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.512+0000 7f8fd67fa640 1 --2- 172.21.15.79:0/3254364532 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fd0101990 0x7f8fd0101d70 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:36.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.512+0000 7f8fd67fa640 1 -- 172.21.15.79:0/3254364532 >> 172.21.15.79:0/3254364532 conn(0x7f8fd00fd400 msgr2=0x7f8fd00ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:36.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.512+0000 7f8fd67fa640 1 -- 172.21.15.79:0/3254364532 shutdown_connections 2024-08-20T01:50:36.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.512+0000 7f8fd67fa640 1 -- 172.21.15.79:0/3254364532 wait complete. 2024-08-20T01:50:36.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.512+0000 7f8fd67fa640 1 Processor -- start 2024-08-20T01:50:36.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.512+0000 7f8fd67fa640 1 -- start start 2024-08-20T01:50:36.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.513+0000 7f8fd67fa640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fd0101990 0x7f8fd0197ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:36.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.513+0000 7f8fd67fa640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fd01073a0 0x7f8fd0198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:36.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.513+0000 7f8fd67fa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fd0107d20 0x7f8fd0198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:36.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.513+0000 7f8fd67fa640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd01118e0 con 0x7f8fd0101990 2024-08-20T01:50:36.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.513+0000 7f8fd67fa640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd0111760 con 0x7f8fd0107d20 2024-08-20T01:50:36.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.513+0000 7f8fcffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fd0101990 0x7f8fd0197ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:36.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.513+0000 7f8fd67fa640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd0111a60 con 0x7f8fd01073a0 2024-08-20T01:50:36.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.513+0000 7f8fcffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fd0101990 0x7f8fd0197ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58470/0 (socket says 172.21.15.79:58470) 2024-08-20T01:50:36.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.513+0000 7f8fcffff640 1 -- 172.21.15.79:0/924040692 learned_addr learned my addr 172.21.15.79:0/924040692 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:36.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.513+0000 7f8fcf7fe640 1 --2- 172.21.15.79:0/924040692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fd01073a0 0x7f8fd0198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:36.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.513+0000 7f8fd4d97640 1 --2- 172.21.15.79:0/924040692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fd0107d20 0x7f8fd0198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:36.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.513+0000 7f8fcffff640 1 -- 172.21.15.79:0/924040692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fd01073a0 msgr2=0x7f8fd0198020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:36.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.513+0000 7f8fcffff640 1 --2- 172.21.15.79:0/924040692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fd01073a0 0x7f8fd0198020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:36.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.513+0000 7f8fcffff640 1 -- 172.21.15.79:0/924040692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fd0107d20 msgr2=0x7f8fd0198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:36.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.513+0000 7f8fcffff640 1 --2- 172.21.15.79:0/924040692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fd0107d20 0x7f8fd0198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:36.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.513+0000 7f8fcffff640 1 -- 172.21.15.79:0/924040692 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fd01a72c0 con 0x7f8fd0101990 2024-08-20T01:50:36.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.513+0000 7f8fcffff640 1 --2- 172.21.15.79:0/924040692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fd0101990 0x7f8fd0197ae0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f8fc002a930 tx=0x7f8fc0003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:36.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.514+0000 7f8fcd7fa640 1 -- 172.21.15.79:0/924040692 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc003f070 con 0x7f8fd0101990 2024-08-20T01:50:36.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.514+0000 7f8fcd7fa640 1 -- 172.21.15.79:0/924040692 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8fc003baf0 con 0x7f8fd0101990 2024-08-20T01:50:36.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.514+0000 7f8fd67fa640 1 -- 172.21.15.79:0/924040692 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fd01a7550 con 0x7f8fd0101990 2024-08-20T01:50:36.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.514+0000 7f8fcd7fa640 1 -- 172.21.15.79:0/924040692 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc0035030 con 0x7f8fd0101990 2024-08-20T01:50:36.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.514+0000 7f8fd67fa640 1 -- 172.21.15.79:0/924040692 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fd01a7a80 con 0x7f8fd0101990 2024-08-20T01:50:36.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.515+0000 7f8fd67fa640 1 -- 172.21.15.79:0/924040692 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fd0101d70 con 0x7f8fd0101990 2024-08-20T01:50:36.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.516+0000 7f8fcd7fa640 1 -- 172.21.15.79:0/924040692 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f8fc0042070 con 0x7f8fd0101990 2024-08-20T01:50:36.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.517+0000 7f8fcd7fa640 1 --2- 172.21.15.79:0/924040692 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f8fb80b3c50 0x7f8fb80b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:36.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.517+0000 7f8fcf7fe640 1 --2- 172.21.15.79:0/924040692 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f8fb80b3c50 0x7f8fb80b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:36.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.517+0000 7f8fcd7fa640 1 -- 172.21.15.79:0/924040692 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f8fc0104510 con 0x7f8fd0101990 2024-08-20T01:50:36.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.518+0000 7f8fcf7fe640 1 --2- 172.21.15.79:0/924040692 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f8fb80b3c50 0x7f8fb80b6110 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0106f60 tx=0x7f8fc4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:36.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.520+0000 7f8fcd7fa640 1 -- 172.21.15.79:0/924040692 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f8fc00cb520 con 0x7f8fd0101990 2024-08-20T01:50:36.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:36 smithi079 ceph-mon[18656]: pgmap v745: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 MiB/s wr, 4.23k op/s 2024-08-20T01:50:36.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.754+0000 7f8fd67fa640 1 -- 172.21.15.79:0/924040692 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8fd006abc0 con 0x7f8fd0101990 2024-08-20T01:50:36.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.754+0000 7f8fcd7fa640 1 -- 172.21.15.79:0/924040692 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+11980 (secure 0 0 0) 0x7f8fd006abc0 con 0x7f8fd0101990 2024-08-20T01:50:36.757 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:50:36.758 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":53,"btime":"2024-08-20T01:50:09:318861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14670,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/735082912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":735082912},{"type":"v1","addr":"172.21.15.79:6835","nonce":735082912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2150339873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2150339873},{"type":"v1","addr":"172.21.15.79:6837","nonce":2150339873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":53,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:34:55.133562+0000","modified":"2024-08-20T01:50:08.573360+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24539,"mds_1":24538,"mds_2":24523,"mds_3":24514,"mds_4":24512},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14724":{"gid":14724,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/1071242274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1071242274},{"type":"v1","addr":"172.21.15.79:6839","nonce":1071242274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14730":{"gid":14730,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6841/2448977611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":2448977611},{"type":"v1","addr":"172.21.15.79:6841","nonce":2448977611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/1257507005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1257507005},{"type":"v1","addr":"172.21.15.81:6833","nonce":1257507005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1499936216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1499936216},{"type":"v1","addr":"172.21.15.81:6835","nonce":1499936216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/1107229215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1107229215},{"type":"v1","addr":"172.21.15.175:6833","nonce":1107229215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6837/2073598870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2073598870},{"type":"v1","addr":"172.21.15.81:6837","nonce":2073598870}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/2552601173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2552601173},{"type":"v1","addr":"172.21.15.175:6835","nonce":2552601173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6837/1767284089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1767284089},{"type":"v1","addr":"172.21.15.175:6837","nonce":1767284089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/1331748742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1331748742},{"type":"v1","addr":"172.21.15.175:6839","nonce":1331748742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/4098410583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":4098410583},{"type":"v1","addr":"172.21.15.81:6839","nonce":4098410583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24539,"qdb_cluster":[24539,24523,24514,24538,24512]},"id":1}]} 2024-08-20T01:50:36.758 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 53 2024-08-20T01:50:36.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.757+0000 7f8fd67fa640 1 -- 172.21.15.79:0/924040692 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f8fb80b3c50 msgr2=0x7f8fb80b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:36.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.757+0000 7f8fd67fa640 1 --2- 172.21.15.79:0/924040692 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f8fb80b3c50 0x7f8fb80b6110 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0106f60 tx=0x7f8fc4005f90 comp rx=0 tx=0).stop 2024-08-20T01:50:36.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.757+0000 7f8fd67fa640 1 -- 172.21.15.79:0/924040692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fd0101990 msgr2=0x7f8fd0197ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:36.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.757+0000 7f8fd67fa640 1 --2- 172.21.15.79:0/924040692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fd0101990 0x7f8fd0197ae0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f8fc002a930 tx=0x7f8fc0003b90 comp rx=0 tx=0).stop 2024-08-20T01:50:36.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.757+0000 7f8fd67fa640 1 -- 172.21.15.79:0/924040692 shutdown_connections 2024-08-20T01:50:36.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.757+0000 7f8fd67fa640 1 --2- 172.21.15.79:0/924040692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fd0107d20 0x7f8fd0198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:36.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.757+0000 7f8fd67fa640 1 --2- 172.21.15.79:0/924040692 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f8fb80b3c50 0x7f8fb80b6110 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:36.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.757+0000 7f8fd67fa640 1 --2- 172.21.15.79:0/924040692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fd01073a0 0x7f8fd0198020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:36.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.757+0000 7f8fd67fa640 1 --2- 172.21.15.79:0/924040692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8fd0101990 0x7f8fd0197ae0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:36.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.757+0000 7f8fd67fa640 1 -- 172.21.15.79:0/924040692 >> 172.21.15.79:0/924040692 conn(0x7f8fd00fd400 msgr2=0x7f8fd00ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:36.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.757+0000 7f8fd67fa640 1 -- 172.21.15.79:0/924040692 shutdown_connections 2024-08-20T01:50:36.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:36.757+0000 7f8fd67fa640 1 -- 172.21.15.79:0/924040692 wait complete. 2024-08-20T01:50:36.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:36 smithi081 ceph-mon[22209]: pgmap v745: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 MiB/s wr, 4.23k op/s 2024-08-20T01:50:36.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:36 smithi175 ceph-mon[22392]: pgmap v745: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 MiB/s wr, 4.23k op/s 2024-08-20T01:50:37.552 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-20T01:50:37.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:37 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/924040692' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:50:37.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:37 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/924040692' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:50:37.823 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:50:37.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:37 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/924040692' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:50:38.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.336+0000 7f5c1b3dc640 1 -- 172.21.15.79:0/4286900882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c141073a0 msgr2=0x7f5c141077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:38.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.336+0000 7f5c1b3dc640 1 --2- 172.21.15.79:0/4286900882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c141073a0 0x7f5c141077e0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f5c04009900 tx=0x7f5c0402a410 comp rx=0 tx=0).stop 2024-08-20T01:50:38.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.336+0000 7f5c1b3dc640 1 -- 172.21.15.79:0/4286900882 shutdown_connections 2024-08-20T01:50:38.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.336+0000 7f5c1b3dc640 1 --2- 172.21.15.79:0/4286900882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c14107d20 0x7f5c1410e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:38.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.336+0000 7f5c1b3dc640 1 --2- 172.21.15.79:0/4286900882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c141073a0 0x7f5c141077e0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:38.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.336+0000 7f5c1b3dc640 1 --2- 172.21.15.79:0/4286900882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c14101990 0x7f5c14101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:38.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.336+0000 7f5c1b3dc640 1 -- 172.21.15.79:0/4286900882 >> 172.21.15.79:0/4286900882 conn(0x7f5c140fd400 msgr2=0x7f5c140ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:38.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.336+0000 7f5c1b3dc640 1 -- 172.21.15.79:0/4286900882 shutdown_connections 2024-08-20T01:50:38.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.337+0000 7f5c1b3dc640 1 -- 172.21.15.79:0/4286900882 wait complete. 2024-08-20T01:50:38.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.337+0000 7f5c1b3dc640 1 Processor -- start 2024-08-20T01:50:38.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.337+0000 7f5c1b3dc640 1 -- start start 2024-08-20T01:50:38.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.337+0000 7f5c1b3dc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c14101990 0x7f5c1419b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:38.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.337+0000 7f5c1b3dc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c141073a0 0x7f5c1419b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:38.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.337+0000 7f5c1b3dc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c14107d20 0x7f5c141a09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:38.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.337+0000 7f5c1b3dc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5c14111820 con 0x7f5c141073a0 2024-08-20T01:50:38.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.337+0000 7f5c1b3dc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5c141116a0 con 0x7f5c14101990 2024-08-20T01:50:38.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.337+0000 7f5c1b3dc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5c141119a0 con 0x7f5c14107d20 2024-08-20T01:50:38.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.337+0000 7f5c18977640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c141073a0 0x7f5c1419b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:38.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.337+0000 7f5c19178640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c14101990 0x7f5c1419b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:38.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.337+0000 7f5c18977640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c141073a0 0x7f5c1419b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58492/0 (socket says 172.21.15.79:58492) 2024-08-20T01:50:38.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.338+0000 7f5c18977640 1 -- 172.21.15.79:0/787858381 learned_addr learned my addr 172.21.15.79:0/787858381 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:38.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.338+0000 7f5c19178640 1 --2- 172.21.15.79:0/787858381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c14101990 0x7f5c1419b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:45210/0 (socket says 172.21.15.79:45210) 2024-08-20T01:50:38.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.338+0000 7f5c19979640 1 --2- 172.21.15.79:0/787858381 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c14107d20 0x7f5c141a09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:38.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.338+0000 7f5c19178640 1 -- 172.21.15.79:0/787858381 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c14107d20 msgr2=0x7f5c141a09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:38.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.338+0000 7f5c19178640 1 --2- 172.21.15.79:0/787858381 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c14107d20 0x7f5c141a09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:38.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.338+0000 7f5c19178640 1 -- 172.21.15.79:0/787858381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c141073a0 msgr2=0x7f5c1419b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:38.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.338+0000 7f5c19178640 1 --2- 172.21.15.79:0/787858381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c141073a0 0x7f5c1419b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:38.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.338+0000 7f5c19178640 1 -- 172.21.15.79:0/787858381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c141a1180 con 0x7f5c14101990 2024-08-20T01:50:38.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.338+0000 7f5c18977640 1 --2- 172.21.15.79:0/787858381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c141073a0 0x7f5c1419b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:50:38.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.338+0000 7f5c19178640 1 --2- 172.21.15.79:0/787858381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c14101990 0x7f5c1419b0d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5c1000d6d0 tx=0x7f5c1000db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:38.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.338+0000 7f5c0a7fc640 1 -- 172.21.15.79:0/787858381 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c10017070 con 0x7f5c14101990 2024-08-20T01:50:38.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.338+0000 7f5c0a7fc640 1 -- 172.21.15.79:0/787858381 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5c10009820 con 0x7f5c14101990 2024-08-20T01:50:38.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.338+0000 7f5c1b3dc640 1 -- 172.21.15.79:0/787858381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c141a1470 con 0x7f5c14101990 2024-08-20T01:50:38.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.338+0000 7f5c0a7fc640 1 -- 172.21.15.79:0/787858381 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c10004bc0 con 0x7f5c14101990 2024-08-20T01:50:38.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.338+0000 7f5c1b3dc640 1 -- 172.21.15.79:0/787858381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c141a7b30 con 0x7f5c14101990 2024-08-20T01:50:38.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.341+0000 7f5c1d7d5740 1 Processor -- start 2024-08-20T01:50:38.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.341+0000 7f5c1d7d5740 1 -- start start 2024-08-20T01:50:38.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.342+0000 7f5c1d7d5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55697192e880 0x55697192ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:38.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.342+0000 7f5c1d7d5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55697192f1a0 0x55697193abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:38.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.342+0000 7f5c1d7d5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55697193b130 0x55697193d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:38.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.342+0000 7f5c1d7d5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5569718a5930 con 0x55697192e880 2024-08-20T01:50:38.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.342+0000 7f5c1d7d5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556971894e30 con 0x55697192f1a0 2024-08-20T01:50:38.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.342+0000 7f5c1d7d5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556971898e70 con 0x55697193b130 2024-08-20T01:50:38.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.342+0000 7f5c0a7fc640 1 -- 172.21.15.79:0/787858381 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5c10005220 con 0x7f5c14101990 2024-08-20T01:50:38.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.342+0000 7f5c19979640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55697192e880 0x55697192ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:38.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.342+0000 7f5c19979640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55697192e880 0x55697192ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58496/0 (socket says 172.21.15.79:58496) 2024-08-20T01:50:38.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.342+0000 7f5c19979640 1 -- 172.21.15.79:0/879266896 learned_addr learned my addr 172.21.15.79:0/879266896 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:38.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.342+0000 7f5c19178640 1 --2- 172.21.15.79:0/879266896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55697192f1a0 0x55697193abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:38.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.342+0000 7f5c18977640 1 --2- 172.21.15.79:0/879266896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55697193b130 0x55697193d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:38.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.342+0000 7f5c19979640 1 -- 172.21.15.79:0/879266896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55697193b130 msgr2=0x55697193d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:38.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.342+0000 7f5c19979640 1 --2- 172.21.15.79:0/879266896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55697193b130 0x55697193d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:38.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.342+0000 7f5c19979640 1 -- 172.21.15.79:0/879266896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55697192f1a0 msgr2=0x55697193abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:38.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.342+0000 7f5c19979640 1 --2- 172.21.15.79:0/879266896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55697192f1a0 0x55697193abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:38.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.342+0000 7f5c19979640 1 -- 172.21.15.79:0/879266896 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569715f4650 con 0x55697192e880 2024-08-20T01:50:38.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.342+0000 7f5c18977640 1 --2- 172.21.15.79:0/879266896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55697193b130 0x55697193d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:50:38.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.342+0000 7f5c19979640 1 --2- 172.21.15.79:0/879266896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55697192e880 0x55697192ec60 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c0103a0 tx=0x7f5c0c010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5be007a232abc150 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:38.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.343+0000 7f5bff7fe640 1 -- 172.21.15.79:0/879266896 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c016070 con 0x55697192e880 2024-08-20T01:50:38.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.343+0000 7f5bff7fe640 1 -- 172.21.15.79:0/879266896 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5c0c004d20 con 0x55697192e880 2024-08-20T01:50:38.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.343+0000 7f5bff7fe640 1 -- 172.21.15.79:0/879266896 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c005280 con 0x55697192e880 2024-08-20T01:50:38.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.343+0000 7f5c0a7fc640 1 --2- 172.21.15.79:0/787858381 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5c000b3bd0 0x7f5c000b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:38.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.343+0000 7f5c19178640 1 --2- 172.21.15.79:0/787858381 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5c000b3bd0 0x7f5c000b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:38.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.343+0000 7f5c0a7fc640 1 -- 172.21.15.79:0/787858381 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f5c100e36f0 con 0x7f5c14101990 2024-08-20T01:50:38.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.344+0000 7f5c1d7d5740 1 -- 172.21.15.79:0/879266896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55697192e880 msgr2=0x55697192ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:38.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.344+0000 7f5c1d7d5740 1 --2- 172.21.15.79:0/879266896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55697192e880 0x55697192ec60 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c0103a0 tx=0x7f5c0c010860 comp rx=0 tx=0).stop 2024-08-20T01:50:38.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.344+0000 7f5c19178640 1 --2- 172.21.15.79:0/787858381 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5c000b3bd0 0x7f5c000b6090 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f5c10000c00 tx=0x7f5c100b3040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:38.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.344+0000 7f5c1d7d5740 1 -- 172.21.15.79:0/879266896 shutdown_connections 2024-08-20T01:50:38.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.344+0000 7f5c1d7d5740 1 --2- 172.21.15.79:0/879266896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55697193b130 0x55697193d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:38.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.344+0000 7f5c1d7d5740 1 --2- 172.21.15.79:0/879266896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55697192f1a0 0x55697193abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:38.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.344+0000 7f5c1d7d5740 1 --2- 172.21.15.79:0/879266896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55697192e880 0x55697192ec60 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:38.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.344+0000 7f5c1d7d5740 1 -- 172.21.15.79:0/879266896 >> 172.21.15.79:0/879266896 conn(0x55697192c6b0 msgr2=0x55697192d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:38.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.344+0000 7f5c1d7d5740 1 -- 172.21.15.79:0/879266896 shutdown_connections 2024-08-20T01:50:38.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.344+0000 7f5c1d7d5740 1 -- 172.21.15.79:0/879266896 wait complete. 2024-08-20T01:50:38.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.344+0000 7f5c1d7d5740 1 -- start start 2024-08-20T01:50:38.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.344+0000 7f5c1d7d5740 1 Processor -- start 2024-08-20T01:50:38.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.345+0000 7f5c1d7d5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55697192e880 0x556971938150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:38.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.345+0000 7f5c1d7d5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55697192f1a0 0x556971938690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:38.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.345+0000 7f5c1d7d5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55697193b130 0x556971938bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:38.366 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.345+0000 7f5c1d7d5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5569716f7700 con 0x55697192f1a0 2024-08-20T01:50:38.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.345+0000 7f5c1d7d5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55697181b810 con 0x55697193b130 2024-08-20T01:50:38.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.345+0000 7f5c1d7d5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55697193dde0 con 0x55697192e880 2024-08-20T01:50:38.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.345+0000 7f5c1d7d5740 10 client.0 _ll_register_callbacks cb 0x55697188e700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:50:38.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.345+0000 7f5c18977640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55697192f1a0 0x556971938690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:38.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.345+0000 7f5c19979640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55697193b130 0x556971938bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:38.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.345+0000 7f5c18977640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55697192f1a0 0x556971938690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58506/0 (socket says 172.21.15.79:58506) 2024-08-20T01:50:38.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.345+0000 7f5c18977640 1 -- 172.21.15.79:0/433740866 learned_addr learned my addr 172.21.15.79:0/433740866 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:38.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.345+0000 7f5c19979640 1 --2- 172.21.15.79:0/433740866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55697192e880 0x556971938150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:38.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.345+0000 7f5c19979640 1 -- 172.21.15.79:0/433740866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55697192e880 msgr2=0x556971938150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:38.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.345+0000 7f5c19979640 1 --2- 172.21.15.79:0/433740866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55697192e880 0x556971938150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:38.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.345+0000 7f5c19979640 1 -- 172.21.15.79:0/433740866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55697192f1a0 msgr2=0x556971938690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:38.367 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.345+0000 7f5c19979640 1 --2- 172.21.15.79:0/433740866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55697192f1a0 0x556971938690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:38.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.345+0000 7f5c19979640 1 -- 172.21.15.79:0/433740866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55697194fa20 con 0x55697193b130 2024-08-20T01:50:38.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.345+0000 7f5c19979640 1 --2- 172.21.15.79:0/433740866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55697193b130 0x556971938bd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c0103a0 tx=0x7f5c0c013fc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=596d309eb972cd4a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:38.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.345+0000 7f5bfcff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:50:38.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.346+0000 7f5bfcff9640 1 -- 172.21.15.79:0/433740866 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c016070 con 0x55697193b130 2024-08-20T01:50:38.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.346+0000 7f5bfcff9640 1 -- 172.21.15.79:0/433740866 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f5c0c003970 con 0x55697193b130 2024-08-20T01:50:38.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.346+0000 7f5c1d7d5740 1 -- 172.21.15.79:0/433740866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556971844150 con 0x55697193b130 2024-08-20T01:50:38.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.346+0000 7f5bfcff9640 1 -- 172.21.15.79:0/433740866 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f5c0c023040 con 0x55697193b130 2024-08-20T01:50:38.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.346+0000 7f5c1d7d5740 10 client.27875 fetch_fsmap learned FSMap version 53 2024-08-20T01:50:38.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.346+0000 7f5c1d7d5740 1 -- 172.21.15.79:0/433740866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x5569719523d0 con 0x55697193b130 2024-08-20T01:50:38.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.346+0000 7f5bfcff9640 1 -- 172.21.15.79:0/433740866 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5c0c012510 con 0x55697193b130 2024-08-20T01:50:38.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.346+0000 7f5bfcff9640 1 -- 172.21.15.79:0/433740866 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 53) ==== 8378+0+0 (secure 0 0 0) 0x7f5c0c00f040 con 0x55697193b130 2024-08-20T01:50:38.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.346+0000 7f5c1d7d5740 10 client.27875 fetch_fsmap finished waiting for FSMap version 53 2024-08-20T01:50:38.368 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.346+0000 7f5c1d7d5740 10 client.27875 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:50:38.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.346+0000 7f5c1d7d5740 20 client.27875 populate_metadata read hostname 'smithi079' 2024-08-20T01:50:38.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.346+0000 7f5c1d7d5740 1 --2- 172.21.15.79:0/433740866 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x556971953780 0x556971955b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:38.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.346+0000 7f5c1d7d5740 4 client.27875 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:50:38.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.346+0000 7f5c1d7d5740 1 -- 172.21.15.79:0/433740866 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556971844150 con 0x556971953780 2024-08-20T01:50:38.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.347+0000 7f5c18977640 1 --2- 172.21.15.79:0/433740866 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x556971953780 0x556971955b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:38.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.347+0000 7f5bfcff9640 10 client.27875 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:50:38.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.347+0000 7f5c18977640 1 --2- 172.21.15.79:0/433740866 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x556971953780 0x556971955b70 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=967c0b4af9a50a95 server_cookie=94bd58d7e3349a8d in_seq=0 out_seq=0 2024-08-20T01:50:38.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.348+0000 7f5bfcff9640 1 -- 172.21.15.79:0/433740866 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556971844150 con 0x556971953780 2024-08-20T01:50:38.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.348+0000 7f5bfcff9640 10 client.27875 handle_command_reply: tid=0 2024-08-20T01:50:38.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.348+0000 7f5c1d7d5740 1 client.27875 shutdown 2024-08-20T01:50:38.369 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.348+0000 7f5c1d7d5740 1 -- 172.21.15.79:0/433740866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55697193b130 msgr2=0x556971938bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:38.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.348+0000 7f5c1d7d5740 1 --2- 172.21.15.79:0/433740866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55697193b130 0x556971938bd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c0103a0 tx=0x7f5c0c013fc0 comp rx=0 tx=0).stop 2024-08-20T01:50:38.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.348+0000 7f5c1d7d5740 1 -- 172.21.15.79:0/433740866 shutdown_connections 2024-08-20T01:50:38.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.348+0000 7f5c1d7d5740 1 --2- 172.21.15.79:0/433740866 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x556971953780 0x556971955b70 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:38.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.348+0000 7f5c1d7d5740 1 --2- 172.21.15.79:0/433740866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55697193b130 0x556971938bd0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:38.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.348+0000 7f5c1d7d5740 1 --2- 172.21.15.79:0/433740866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55697192f1a0 0x556971938690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:38.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.348+0000 7f5c1d7d5740 1 --2- 172.21.15.79:0/433740866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55697192e880 0x556971938150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:38.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.348+0000 7f5c1d7d5740 1 -- 172.21.15.79:0/433740866 >> 172.21.15.79:0/433740866 conn(0x55697192c6b0 msgr2=0x556971932250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:38.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.348+0000 7f5bfcff9640 0 client.27875 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:50:38.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.348+0000 7f5c1d7d5740 1 -- 172.21.15.79:0/433740866 shutdown_connections 2024-08-20T01:50:38.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.348+0000 7f5c1d7d5740 1 -- 172.21.15.79:0/433740866 wait complete. 2024-08-20T01:50:38.370 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.348+0000 7f5c1d7d5740 20 client.27875 trim_cache size 0 max 16384 2024-08-20T01:50:38.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.364+0000 7f5c1d7d5740 1 Processor -- start 2024-08-20T01:50:38.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.364+0000 7f5c1d7d5740 1 -- start start 2024-08-20T01:50:38.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.364+0000 7f5c1d7d5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55697192e880 0x556971932a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:38.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.364+0000 7f5c1d7d5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55697192f1a0 0x5569719378b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:38.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.364+0000 7f5c1d7d5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55697193b130 0x55697195b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:38.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.364+0000 7f5c1d7d5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5c141abe90 con 0x55697192e880 2024-08-20T01:50:38.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.364+0000 7f5c1d7d5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5c141ada90 con 0x55697192f1a0 2024-08-20T01:50:38.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.364+0000 7f5c1d7d5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5c141ac620 con 0x55697193b130 2024-08-20T01:50:38.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.364+0000 7f5c19979640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55697192e880 0x556971932a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:38.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.364+0000 7f5c19979640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55697192e880 0x556971932a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58508/0 (socket says 172.21.15.79:58508) 2024-08-20T01:50:38.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.365+0000 7f5c19979640 1 -- 172.21.15.79:0/2104992567 learned_addr learned my addr 172.21.15.79:0/2104992567 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:38.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.365+0000 7f5c18977640 1 --2- 172.21.15.79:0/2104992567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55697192f1a0 0x5569719378b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:38.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.365+0000 7f5c19979640 1 --2- 172.21.15.79:0/2104992567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55697193b130 0x55697195b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:38.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.365+0000 7f5c18977640 1 -- 172.21.15.79:0/2104992567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55697193b130 msgr2=0x55697195b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:38.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.365+0000 7f5c18977640 1 --2- 172.21.15.79:0/2104992567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55697193b130 0x55697195b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:38.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.365+0000 7f5c18977640 1 -- 172.21.15.79:0/2104992567 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55697192e880 msgr2=0x556971932a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:38.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.365+0000 7f5c18977640 1 --2- 172.21.15.79:0/2104992567 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55697192e880 0x556971932a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:38.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.365+0000 7f5c18977640 1 -- 172.21.15.79:0/2104992567 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55697192e260 con 0x55697192f1a0 2024-08-20T01:50:38.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.365+0000 7f5c18977640 1 --2- 172.21.15.79:0/2104992567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55697192f1a0 0x5569719378b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5c04032fd0 tx=0x7f5c04004360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8dda17a39b25dccf server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:38.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.365+0000 7f5bfeffd640 1 -- 172.21.15.79:0/2104992567 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c04035040 con 0x55697192f1a0 2024-08-20T01:50:38.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.365+0000 7f5bfeffd640 1 -- 172.21.15.79:0/2104992567 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5c04031ad0 con 0x55697192f1a0 2024-08-20T01:50:38.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.365+0000 7f5bfeffd640 1 -- 172.21.15.79:0/2104992567 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c04003a60 con 0x55697192f1a0 2024-08-20T01:50:38.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.366+0000 7f5c1d7d5740 1 -- 172.21.15.79:0/2104992567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55697192f1a0 msgr2=0x5569719378b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:38.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.366+0000 7f5c1d7d5740 1 --2- 172.21.15.79:0/2104992567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55697192f1a0 0x5569719378b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5c04032fd0 tx=0x7f5c04004360 comp rx=0 tx=0).stop 2024-08-20T01:50:38.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.366+0000 7f5c1d7d5740 1 -- 172.21.15.79:0/2104992567 shutdown_connections 2024-08-20T01:50:38.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.366+0000 7f5c1d7d5740 1 --2- 172.21.15.79:0/2104992567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55697193b130 0x55697195b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:38.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.366+0000 7f5c1d7d5740 1 --2- 172.21.15.79:0/2104992567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55697192f1a0 0x5569719378b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:38.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.366+0000 7f5c1d7d5740 1 --2- 172.21.15.79:0/2104992567 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55697192e880 0x556971932a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:38.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.366+0000 7f5c1d7d5740 1 -- 172.21.15.79:0/2104992567 >> 172.21.15.79:0/2104992567 conn(0x55697192c6b0 msgr2=0x556971939fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:38.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.366+0000 7f5c1d7d5740 1 -- 172.21.15.79:0/2104992567 shutdown_connections 2024-08-20T01:50:38.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.366+0000 7f5c1d7d5740 1 -- 172.21.15.79:0/2104992567 wait complete. 2024-08-20T01:50:38.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.366+0000 7f5c1d7d5740 1 -- start start 2024-08-20T01:50:38.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.367+0000 7f5c1d7d5740 1 Processor -- start 2024-08-20T01:50:38.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.367+0000 7f5c1d7d5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55697192e880 0x55697194bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:38.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.367+0000 7f5c1d7d5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55697192f1a0 0x5569719468c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:38.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.367+0000 7f5c1d7d5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55697193b130 0x556971946e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:38.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.367+0000 7f5c1d7d5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5c141ad3c0 con 0x55697192e880 2024-08-20T01:50:38.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.367+0000 7f5c1d7d5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5c141accf0 con 0x55697192f1a0 2024-08-20T01:50:38.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.367+0000 7f5c1d7d5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5c141a9eb0 con 0x55697193b130 2024-08-20T01:50:38.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.367+0000 7f5c1d7d5740 10 client.0 _ll_register_callbacks cb 0x7f5c100e9400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:50:38.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.367+0000 7f5c19979640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55697192e880 0x55697194bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:38.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.367+0000 7f5c19979640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55697192e880 0x55697194bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58512/0 (socket says 172.21.15.79:58512) 2024-08-20T01:50:38.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.367+0000 7f5c19979640 1 -- 172.21.15.79:0/537154054 learned_addr learned my addr 172.21.15.79:0/537154054 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:38.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.367+0000 7f5c19979640 1 --2- 172.21.15.79:0/537154054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55697193b130 0x556971946e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:38.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.367+0000 7f5c18977640 1 --2- 172.21.15.79:0/537154054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55697192f1a0 0x5569719468c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:38.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.368+0000 7f5c19979640 1 -- 172.21.15.79:0/537154054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55697193b130 msgr2=0x556971946e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:38.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.368+0000 7f5c19979640 1 --2- 172.21.15.79:0/537154054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55697193b130 0x556971946e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:38.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.368+0000 7f5c19979640 1 -- 172.21.15.79:0/537154054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55697192f1a0 msgr2=0x5569719468c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:38.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.368+0000 7f5c19979640 1 --2- 172.21.15.79:0/537154054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55697192f1a0 0x5569719468c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:38.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.368+0000 7f5c19979640 1 -- 172.21.15.79:0/537154054 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569719473f0 con 0x55697192e880 2024-08-20T01:50:38.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.368+0000 7f5c19979640 1 --2- 172.21.15.79:0/537154054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55697192e880 0x55697194bd50 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c006010 tx=0x7f5c0c0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46069a979f0584b8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:38.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.368+0000 7f5bfcff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:50:38.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.368+0000 7f5bfcff9640 1 -- 172.21.15.79:0/537154054 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c03b030 con 0x55697192e880 2024-08-20T01:50:38.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.368+0000 7f5bfcff9640 1 -- 172.21.15.79:0/537154054 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f5c0c012710 con 0x55697192e880 2024-08-20T01:50:38.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.368+0000 7f5c1d7d5740 1 -- 172.21.15.79:0/537154054 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c04031ad0 con 0x55697192e880 2024-08-20T01:50:38.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.368+0000 7f5bfcff9640 1 -- 172.21.15.79:0/537154054 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f5c0c04a050 con 0x55697192e880 2024-08-20T01:50:38.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.368+0000 7f5c1d7d5740 10 client.18762 fetch_fsmap learned FSMap version 53 2024-08-20T01:50:38.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.368+0000 7f5c1d7d5740 1 -- 172.21.15.79:0/537154054 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x5569719bd140 con 0x55697192e880 2024-08-20T01:50:38.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.368+0000 7f5bfcff9640 1 -- 172.21.15.79:0/537154054 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5c04031ad0 con 0x55697192e880 2024-08-20T01:50:38.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.369+0000 7f5bfcff9640 1 -- 172.21.15.79:0/537154054 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 53) ==== 8378+0+0 (secure 0 0 0) 0x7f5c0c003e00 con 0x55697192e880 2024-08-20T01:50:38.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.369+0000 7f5c1d7d5740 10 client.18762 fetch_fsmap finished waiting for FSMap version 53 2024-08-20T01:50:38.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.369+0000 7f5c1d7d5740 10 client.18762 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:50:38.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.369+0000 7f5c1d7d5740 20 client.18762 populate_metadata read hostname 'smithi079' 2024-08-20T01:50:38.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.369+0000 7f5c1d7d5740 1 --2- 172.21.15.79:0/537154054 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x5569719bd940 0x5569719bfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:38.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.369+0000 7f5c1d7d5740 4 client.18762 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:50:38.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.369+0000 7f5c1d7d5740 1 -- 172.21.15.79:0/537154054 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5569718a7880 con 0x5569719bd940 2024-08-20T01:50:38.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.369+0000 7f5c18977640 1 --2- 172.21.15.79:0/537154054 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x5569719bd940 0x5569719bfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:38.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.370+0000 7f5bfcff9640 10 client.18762 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:50:38.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.370+0000 7f5c18977640 1 --2- 172.21.15.79:0/537154054 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x5569719bd940 0x5569719bfd60 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4be7b1d580fafcac server_cookie=81ede4e1cae5de80 in_seq=0 out_seq=0 2024-08-20T01:50:38.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.370+0000 7f5bfcff9640 1 -- 172.21.15.79:0/537154054 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5569718a7880 con 0x5569719bd940 2024-08-20T01:50:38.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.370+0000 7f5bfcff9640 10 client.18762 handle_command_reply: tid=0 2024-08-20T01:50:38.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.370+0000 7f5c1d7d5740 1 client.18762 shutdown 2024-08-20T01:50:38.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.370+0000 7f5c1d7d5740 1 -- 172.21.15.79:0/537154054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55697192e880 msgr2=0x55697194bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:38.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.370+0000 7f5c1d7d5740 1 --2- 172.21.15.79:0/537154054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55697192e880 0x55697194bd50 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c006010 tx=0x7f5c0c0021d0 comp rx=0 tx=0).stop 2024-08-20T01:50:38.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.370+0000 7f5c1d7d5740 1 -- 172.21.15.79:0/537154054 shutdown_connections 2024-08-20T01:50:38.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.370+0000 7f5c1d7d5740 1 --2- 172.21.15.79:0/537154054 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x5569719bd940 0x5569719bfd60 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:38.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.370+0000 7f5c1d7d5740 1 --2- 172.21.15.79:0/537154054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55697193b130 0x556971946e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:38.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.370+0000 7f5c1d7d5740 1 --2- 172.21.15.79:0/537154054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55697192f1a0 0x5569719468c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:38.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.370+0000 7f5c1d7d5740 1 --2- 172.21.15.79:0/537154054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55697192e880 0x55697194bd50 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:38.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.370+0000 7f5c1d7d5740 1 -- 172.21.15.79:0/537154054 >> 172.21.15.79:0/537154054 conn(0x55697192c6b0 msgr2=0x556971938120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:38.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.370+0000 7f5bfcff9640 0 client.18762 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:50:38.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.370+0000 7f5c1d7d5740 1 -- 172.21.15.79:0/537154054 shutdown_connections 2024-08-20T01:50:38.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.370+0000 7f5c1d7d5740 1 -- 172.21.15.79:0/537154054 wait complete. 2024-08-20T01:50:38.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.370+0000 7f5c1d7d5740 20 client.18762 trim_cache size 0 max 16384 2024-08-20T01:50:38.383 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:50:38.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.371+0000 7f5c1b3dc640 1 -- 172.21.15.79:0/787858381 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5c000b3bd0 msgr2=0x7f5c000b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:38.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.371+0000 7f5c1b3dc640 1 --2- 172.21.15.79:0/787858381 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5c000b3bd0 0x7f5c000b6090 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f5c10000c00 tx=0x7f5c100b3040 comp rx=0 tx=0).stop 2024-08-20T01:50:38.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.371+0000 7f5c1b3dc640 1 -- 172.21.15.79:0/787858381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c14101990 msgr2=0x7f5c1419b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:38.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.371+0000 7f5c1b3dc640 1 --2- 172.21.15.79:0/787858381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c14101990 0x7f5c1419b0d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5c1000d6d0 tx=0x7f5c1000db90 comp rx=0 tx=0).stop 2024-08-20T01:50:38.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.371+0000 7f5c1b3dc640 1 -- 172.21.15.79:0/787858381 shutdown_connections 2024-08-20T01:50:38.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.371+0000 7f5c1b3dc640 1 --2- 172.21.15.79:0/787858381 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5c000b3bd0 0x7f5c000b6090 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:38.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.371+0000 7f5c1b3dc640 1 --2- 172.21.15.79:0/787858381 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c14107d20 0x7f5c141a09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:38.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.371+0000 7f5c1b3dc640 1 --2- 172.21.15.79:0/787858381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c141073a0 0x7f5c1419b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:38.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.371+0000 7f5c1b3dc640 1 --2- 172.21.15.79:0/787858381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c14101990 0x7f5c1419b0d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:38.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.371+0000 7f5c1b3dc640 1 -- 172.21.15.79:0/787858381 >> 172.21.15.79:0/787858381 conn(0x7f5c140fd400 msgr2=0x7f5c1406a950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:38.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.371+0000 7f5c1b3dc640 1 -- 172.21.15.79:0/787858381 shutdown_connections 2024-08-20T01:50:38.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:38.371+0000 7f5c1b3dc640 1 -- 172.21.15.79:0/787858381 wait complete. 2024-08-20T01:50:38.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:38 smithi079 ceph-mon[18656]: pgmap v746: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 3.20k op/s 2024-08-20T01:50:38.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:38 smithi081 ceph-mon[22209]: pgmap v746: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 3.20k op/s 2024-08-20T01:50:38.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:38 smithi175 ceph-mon[22392]: pgmap v746: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 3.20k op/s 2024-08-20T01:50:39.288 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-20T01:50:39.559 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:50:40.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.074+0000 7f5d4ffa4640 1 -- 172.21.15.79:0/3460348695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d48101990 msgr2=0x7f5d48101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:40.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.074+0000 7f5d4ffa4640 1 --2- 172.21.15.79:0/3460348695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d48101990 0x7f5d48101d70 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f5d44009900 tx=0x7f5d4402a410 comp rx=0 tx=0).stop 2024-08-20T01:50:40.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.074+0000 7f5d4ffa4640 1 -- 172.21.15.79:0/3460348695 shutdown_connections 2024-08-20T01:50:40.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.074+0000 7f5d4ffa4640 1 --2- 172.21.15.79:0/3460348695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d48107d20 0x7f5d4810e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:40.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.074+0000 7f5d4ffa4640 1 --2- 172.21.15.79:0/3460348695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d481073a0 0x7f5d481077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:40.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.074+0000 7f5d4ffa4640 1 --2- 172.21.15.79:0/3460348695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d48101990 0x7f5d48101d70 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:40.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.074+0000 7f5d4ffa4640 1 -- 172.21.15.79:0/3460348695 >> 172.21.15.79:0/3460348695 conn(0x7f5d480fd400 msgr2=0x7f5d480ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:40.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.075+0000 7f5d4ffa4640 1 -- 172.21.15.79:0/3460348695 shutdown_connections 2024-08-20T01:50:40.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.075+0000 7f5d4ffa4640 1 -- 172.21.15.79:0/3460348695 wait complete. 2024-08-20T01:50:40.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.075+0000 7f5d4ffa4640 1 Processor -- start 2024-08-20T01:50:40.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.075+0000 7f5d4ffa4640 1 -- start start 2024-08-20T01:50:40.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.075+0000 7f5d4ffa4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d48101990 0x7f5d48198f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:40.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.075+0000 7f5d4ffa4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d481073a0 0x7f5d48199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:40.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.076+0000 7f5d4ffa4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d48107d20 0x7f5d4819e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:40.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.076+0000 7f5d4ffa4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5d481129b0 con 0x7f5d481073a0 2024-08-20T01:50:40.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.076+0000 7f5d4ffa4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5d48112830 con 0x7f5d48101990 2024-08-20T01:50:40.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.076+0000 7f5d4ffa4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5d48112b30 con 0x7f5d48107d20 2024-08-20T01:50:40.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.076+0000 7f5d4d53f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d481073a0 0x7f5d48199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:40.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.076+0000 7f5d4dd40640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d48101990 0x7f5d48198f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:40.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.076+0000 7f5d4dd40640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d48101990 0x7f5d48198f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:45266/0 (socket says 172.21.15.79:45266) 2024-08-20T01:50:40.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.076+0000 7f5d4d53f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d481073a0 0x7f5d48199460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58528/0 (socket says 172.21.15.79:58528) 2024-08-20T01:50:40.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.076+0000 7f5d4dd40640 1 -- 172.21.15.79:0/2322347064 learned_addr learned my addr 172.21.15.79:0/2322347064 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:40.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.076+0000 7f5d4e541640 1 --2- 172.21.15.79:0/2322347064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d48107d20 0x7f5d4819e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:40.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.076+0000 7f5d4d53f640 1 -- 172.21.15.79:0/2322347064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d48107d20 msgr2=0x7f5d4819e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:40.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.076+0000 7f5d4d53f640 1 --2- 172.21.15.79:0/2322347064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d48107d20 0x7f5d4819e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:40.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.076+0000 7f5d4d53f640 1 -- 172.21.15.79:0/2322347064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d48101990 msgr2=0x7f5d48198f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:40.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.076+0000 7f5d4d53f640 1 --2- 172.21.15.79:0/2322347064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d48101990 0x7f5d48198f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:40.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.076+0000 7f5d4d53f640 1 -- 172.21.15.79:0/2322347064 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d4819efd0 con 0x7f5d481073a0 2024-08-20T01:50:40.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.076+0000 7f5d4dd40640 1 --2- 172.21.15.79:0/2322347064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d48101990 0x7f5d48198f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:50:40.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.076+0000 7f5d4d53f640 1 --2- 172.21.15.79:0/2322347064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d481073a0 0x7f5d48199460 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f5d3800e9f0 tx=0x7f5d3800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:40.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.076+0000 7f5d3effd640 1 -- 172.21.15.79:0/2322347064 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3800ccc0 con 0x7f5d481073a0 2024-08-20T01:50:40.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.076+0000 7f5d4ffa4640 1 -- 172.21.15.79:0/2322347064 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d4819f2c0 con 0x7f5d481073a0 2024-08-20T01:50:40.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.076+0000 7f5d3effd640 1 -- 172.21.15.79:0/2322347064 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5d38005020 con 0x7f5d481073a0 2024-08-20T01:50:40.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.076+0000 7f5d3effd640 1 -- 172.21.15.79:0/2322347064 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3800ce60 con 0x7f5d481073a0 2024-08-20T01:50:40.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.076+0000 7f5d4ffa4640 1 -- 172.21.15.79:0/2322347064 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d481a5980 con 0x7f5d481073a0 2024-08-20T01:50:40.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.079+0000 7f5d5239d740 1 Processor -- start 2024-08-20T01:50:40.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.079+0000 7f5d5239d740 1 -- start start 2024-08-20T01:50:40.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.079+0000 7f5d3effd640 1 -- 172.21.15.79:0/2322347064 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5d38004ac0 con 0x7f5d481073a0 2024-08-20T01:50:40.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.079+0000 7f5d5239d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca682ee730 0x55ca682eeb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:40.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.079+0000 7f5d5239d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca682ef050 0x55ca682faaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:40.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.079+0000 7f5d5239d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca682fafe0 0x55ca682fd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:40.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.079+0000 7f5d5239d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ca68265930 con 0x55ca682ef050 2024-08-20T01:50:40.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.079+0000 7f5d5239d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ca68254e30 con 0x55ca682ee730 2024-08-20T01:50:40.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.080+0000 7f5d5239d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ca68258e70 con 0x55ca682fafe0 2024-08-20T01:50:40.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.080+0000 7f5d4dd40640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca682ef050 0x55ca682faaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:40.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.080+0000 7f5d4dd40640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca682ef050 0x55ca682faaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58544/0 (socket says 172.21.15.79:58544) 2024-08-20T01:50:40.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.080+0000 7f5d4dd40640 1 -- 172.21.15.79:0/1388323691 learned_addr learned my addr 172.21.15.79:0/1388323691 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:40.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.080+0000 7f5d4e541640 1 --2- 172.21.15.79:0/1388323691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca682ee730 0x55ca682eeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:40.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.080+0000 7f5d4d53f640 1 --2- 172.21.15.79:0/1388323691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca682fafe0 0x55ca682fd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:40.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.080+0000 7f5d4e541640 1 -- 172.21.15.79:0/1388323691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca682fafe0 msgr2=0x55ca682fd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:40.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.080+0000 7f5d4e541640 1 --2- 172.21.15.79:0/1388323691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca682fafe0 0x55ca682fd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:40.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.080+0000 7f5d4e541640 1 -- 172.21.15.79:0/1388323691 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca682ef050 msgr2=0x55ca682faaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:40.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.080+0000 7f5d4e541640 1 --2- 172.21.15.79:0/1388323691 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca682ef050 0x55ca682faaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:40.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.080+0000 7f5d4e541640 1 -- 172.21.15.79:0/1388323691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca67fb4650 con 0x55ca682ee730 2024-08-20T01:50:40.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.080+0000 7f5d4dd40640 1 --2- 172.21.15.79:0/1388323691 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca682ef050 0x55ca682faaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:50:40.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.080+0000 7f5d4e541640 1 --2- 172.21.15.79:0/1388323691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca682ee730 0x55ca682eeb10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5d40009f50 tx=0x7f5d40003e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6776534574fe708 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:40.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.080+0000 7f5d3effd640 1 --2- 172.21.15.79:0/2322347064 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5d340b3bd0 0x7f5d340b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:40.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.080+0000 7f5d33fff640 1 -- 172.21.15.79:0/1388323691 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d40011440 con 0x55ca682ee730 2024-08-20T01:50:40.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.080+0000 7f5d33fff640 1 -- 172.21.15.79:0/1388323691 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5d40015030 con 0x55ca682ee730 2024-08-20T01:50:40.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.080+0000 7f5d33fff640 1 -- 172.21.15.79:0/1388323691 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d40010820 con 0x55ca682ee730 2024-08-20T01:50:40.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.081+0000 7f5d4dd40640 1 --2- 172.21.15.79:0/2322347064 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5d340b3bd0 0x7f5d340b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:40.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.081+0000 7f5d3effd640 1 -- 172.21.15.79:0/2322347064 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f5d380e3ba0 con 0x7f5d481073a0 2024-08-20T01:50:40.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.081+0000 7f5d5239d740 1 -- 172.21.15.79:0/1388323691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca682ee730 msgr2=0x55ca682eeb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:40.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.081+0000 7f5d4dd40640 1 --2- 172.21.15.79:0/2322347064 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5d340b3bd0 0x7f5d340b6090 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x55ca682f18b0 tx=0x7f5d44005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:40.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.081+0000 7f5d5239d740 1 --2- 172.21.15.79:0/1388323691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca682ee730 0x55ca682eeb10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5d40009f50 tx=0x7f5d40003e00 comp rx=0 tx=0).stop 2024-08-20T01:50:40.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.081+0000 7f5d5239d740 1 -- 172.21.15.79:0/1388323691 shutdown_connections 2024-08-20T01:50:40.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.081+0000 7f5d5239d740 1 --2- 172.21.15.79:0/1388323691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca682fafe0 0x55ca682fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:40.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.081+0000 7f5d5239d740 1 --2- 172.21.15.79:0/1388323691 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca682ef050 0x55ca682faaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:40.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.081+0000 7f5d5239d740 1 --2- 172.21.15.79:0/1388323691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca682ee730 0x55ca682eeb10 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:40.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.081+0000 7f5d5239d740 1 -- 172.21.15.79:0/1388323691 >> 172.21.15.79:0/1388323691 conn(0x55ca682ec560 msgr2=0x55ca682ed700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:40.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.081+0000 7f5d5239d740 1 -- 172.21.15.79:0/1388323691 shutdown_connections 2024-08-20T01:50:40.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.081+0000 7f5d5239d740 1 -- 172.21.15.79:0/1388323691 wait complete. 2024-08-20T01:50:40.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.082+0000 7f5d5239d740 1 -- start start 2024-08-20T01:50:40.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.082+0000 7f5d5239d740 1 Processor -- start 2024-08-20T01:50:40.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.082+0000 7f5d5239d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca682ee730 0x55ca682f7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:40.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.082+0000 7f5d5239d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca682ef050 0x55ca682f84e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:40.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.082+0000 7f5d5239d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca682fafe0 0x55ca682f8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:40.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.082+0000 7f5d5239d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ca680b7700 con 0x55ca682ee730 2024-08-20T01:50:40.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.082+0000 7f5d5239d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ca681db810 con 0x55ca682ef050 2024-08-20T01:50:40.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.082+0000 7f5d5239d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ca683020a0 con 0x55ca682fafe0 2024-08-20T01:50:40.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.082+0000 7f5d5239d740 10 client.0 _ll_register_callbacks cb 0x55ca6824e700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:50:40.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.082+0000 7f5d4dd40640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca682ee730 0x55ca682f7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:40.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.082+0000 7f5d4dd40640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca682ee730 0x55ca682f7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58554/0 (socket says 172.21.15.79:58554) 2024-08-20T01:50:40.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.082+0000 7f5d4dd40640 1 -- 172.21.15.79:0/2872994063 learned_addr learned my addr 172.21.15.79:0/2872994063 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:40.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.082+0000 7f5d4d53f640 1 --2- 172.21.15.79:0/2872994063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca682ef050 0x55ca682f84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:40.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.083+0000 7f5d4e541640 1 --2- 172.21.15.79:0/2872994063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca682fafe0 0x55ca682f8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:40.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.083+0000 7f5d4dd40640 1 -- 172.21.15.79:0/2872994063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca682fafe0 msgr2=0x55ca682f8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:40.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.083+0000 7f5d4dd40640 1 --2- 172.21.15.79:0/2872994063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca682fafe0 0x55ca682f8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:40.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.083+0000 7f5d4dd40640 1 -- 172.21.15.79:0/2872994063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca682ef050 msgr2=0x55ca682f84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:40.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.083+0000 7f5d4dd40640 1 --2- 172.21.15.79:0/2872994063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca682ef050 0x55ca682f84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:40.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.083+0000 7f5d4dd40640 1 -- 172.21.15.79:0/2872994063 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca6830b4b0 con 0x55ca682ee730 2024-08-20T01:50:40.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.083+0000 7f5d4d53f640 1 --2- 172.21.15.79:0/2872994063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca682ef050 0x55ca682f84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:50:40.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.083+0000 7f5d4e541640 1 --2- 172.21.15.79:0/2872994063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca682fafe0 0x55ca682f8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:50:40.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.083+0000 7f5d4dd40640 1 --2- 172.21.15.79:0/2872994063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca682ee730 0x55ca682f7fa0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f5d440057c0 tx=0x7f5d44009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c92d10363655b074 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:40.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.083+0000 7f5d317fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:50:40.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.083+0000 7f5d317fa640 1 -- 172.21.15.79:0/2872994063 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d44035040 con 0x55ca682ee730 2024-08-20T01:50:40.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.083+0000 7f5d317fa640 1 -- 172.21.15.79:0/2872994063 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f5d440037f0 con 0x55ca682ee730 2024-08-20T01:50:40.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.083+0000 7f5d5239d740 1 -- 172.21.15.79:0/2872994063 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ca68204150 con 0x55ca682ee730 2024-08-20T01:50:40.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.083+0000 7f5d317fa640 1 -- 172.21.15.79:0/2872994063 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f5d440039f0 con 0x55ca682ee730 2024-08-20T01:50:40.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.083+0000 7f5d5239d740 10 client.18774 fetch_fsmap learned FSMap version 53 2024-08-20T01:50:40.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.083+0000 7f5d5239d740 1 -- 172.21.15.79:0/2872994063 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x55ca6830de60 con 0x55ca682ee730 2024-08-20T01:50:40.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.084+0000 7f5d317fa640 1 -- 172.21.15.79:0/2872994063 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55ca68204150 con 0x55ca682ee730 2024-08-20T01:50:40.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.084+0000 7f5d317fa640 1 -- 172.21.15.79:0/2872994063 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 53) ==== 8378+0+0 (secure 0 0 0) 0x7f5d44059020 con 0x55ca682ee730 2024-08-20T01:50:40.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.084+0000 7f5d5239d740 10 client.18774 fetch_fsmap finished waiting for FSMap version 53 2024-08-20T01:50:40.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.084+0000 7f5d5239d740 10 client.18774 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:50:40.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.084+0000 7f5d5239d740 20 client.18774 populate_metadata read hostname 'smithi079' 2024-08-20T01:50:40.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.084+0000 7f5d5239d740 1 --2- 172.21.15.79:0/2872994063 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x55ca6830f3c0 0x55ca683117f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:40.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.084+0000 7f5d5239d740 4 client.18774 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:50:40.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.084+0000 7f5d5239d740 1 -- 172.21.15.79:0/2872994063 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca68267880 con 0x55ca6830f3c0 2024-08-20T01:50:40.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.084+0000 7f5d4d53f640 1 --2- 172.21.15.79:0/2872994063 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x55ca6830f3c0 0x55ca683117f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:40.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.084+0000 7f5d317fa640 10 client.18774 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:50:40.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.084+0000 7f5d4d53f640 1 --2- 172.21.15.79:0/2872994063 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x55ca6830f3c0 0x55ca683117f0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2b914801efd88691 server_cookie=8c692d8168b2c781 in_seq=0 out_seq=0 2024-08-20T01:50:40.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.085+0000 7f5d317fa640 1 -- 172.21.15.79:0/2872994063 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ca68267880 con 0x55ca6830f3c0 2024-08-20T01:50:40.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.085+0000 7f5d317fa640 10 client.18774 handle_command_reply: tid=0 2024-08-20T01:50:40.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.085+0000 7f5d5239d740 1 client.18774 shutdown 2024-08-20T01:50:40.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.085+0000 7f5d5239d740 1 -- 172.21.15.79:0/2872994063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca682ee730 msgr2=0x55ca682f7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:40.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.085+0000 7f5d5239d740 1 --2- 172.21.15.79:0/2872994063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca682ee730 0x55ca682f7fa0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f5d440057c0 tx=0x7f5d44009260 comp rx=0 tx=0).stop 2024-08-20T01:50:40.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.086+0000 7f5d5239d740 1 -- 172.21.15.79:0/2872994063 shutdown_connections 2024-08-20T01:50:40.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.086+0000 7f5d5239d740 1 --2- 172.21.15.79:0/2872994063 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x55ca6830f3c0 0x55ca683117f0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:40.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.086+0000 7f5d5239d740 1 --2- 172.21.15.79:0/2872994063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca682fafe0 0x55ca682f8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:40.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.086+0000 7f5d5239d740 1 --2- 172.21.15.79:0/2872994063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca682ef050 0x55ca682f84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:40.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.086+0000 7f5d317fa640 0 client.18774 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:50:40.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.086+0000 7f5d5239d740 1 --2- 172.21.15.79:0/2872994063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca682ee730 0x55ca682f7fa0 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:40.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.086+0000 7f5d5239d740 1 -- 172.21.15.79:0/2872994063 >> 172.21.15.79:0/2872994063 conn(0x55ca682ec560 msgr2=0x55ca682f2100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:40.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.086+0000 7f5d5239d740 1 -- 172.21.15.79:0/2872994063 shutdown_connections 2024-08-20T01:50:40.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.086+0000 7f5d5239d740 1 -- 172.21.15.79:0/2872994063 wait complete. 2024-08-20T01:50:40.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.086+0000 7f5d5239d740 20 client.18774 trim_cache size 0 max 16384 2024-08-20T01:50:40.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.100+0000 7f5d5239d740 1 Processor -- start 2024-08-20T01:50:40.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.100+0000 7f5d5239d740 1 -- start start 2024-08-20T01:50:40.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.100+0000 7f5d5239d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca682ee730 0x55ca682eb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:40.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.100+0000 7f5d5239d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca682ef050 0x55ca682f7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:40.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.100+0000 7f5d5239d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca682fafe0 0x55ca683170c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:40.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.100+0000 7f5d5239d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5d481abd60 con 0x55ca682ef050 2024-08-20T01:50:40.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.100+0000 7f5d5239d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5d481ad960 con 0x55ca682fafe0 2024-08-20T01:50:40.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.100+0000 7f5d5239d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5d481ac4f0 con 0x55ca682ee730 2024-08-20T01:50:40.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.101+0000 7f5d4d53f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca682ef050 0x55ca682f7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:40.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.101+0000 7f5d4dd40640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca682ee730 0x55ca682eb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:40.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.101+0000 7f5d4d53f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca682ef050 0x55ca682f7830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58566/0 (socket says 172.21.15.79:58566) 2024-08-20T01:50:40.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.101+0000 7f5d4dd40640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca682ee730 0x55ca682eb7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:33578/0 (socket says 172.21.15.79:33578) 2024-08-20T01:50:40.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.101+0000 7f5d4d53f640 1 -- 172.21.15.79:0/2799143495 learned_addr learned my addr 172.21.15.79:0/2799143495 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:40.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.101+0000 7f5d4e541640 1 --2- 172.21.15.79:0/2799143495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca682fafe0 0x55ca683170c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:40.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.101+0000 7f5d4d53f640 1 -- 172.21.15.79:0/2799143495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca682ee730 msgr2=0x55ca682eb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:40.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.101+0000 7f5d4d53f640 1 --2- 172.21.15.79:0/2799143495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca682ee730 0x55ca682eb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:40.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.101+0000 7f5d4d53f640 1 -- 172.21.15.79:0/2799143495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca682fafe0 msgr2=0x55ca683170c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:40.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.101+0000 7f5d4d53f640 1 --2- 172.21.15.79:0/2799143495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca682fafe0 0x55ca683170c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:40.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.101+0000 7f5d4d53f640 1 -- 172.21.15.79:0/2799143495 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca682ecfe0 con 0x55ca682ef050 2024-08-20T01:50:40.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.101+0000 7f5d4d53f640 1 --2- 172.21.15.79:0/2799143495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca682ef050 0x55ca682f7830 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f5d3800c6a0 tx=0x7f5d380e1580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e6eed5aef888af3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:40.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.102+0000 7f5d337fe640 1 -- 172.21.15.79:0/2799143495 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3801c040 con 0x55ca682ef050 2024-08-20T01:50:40.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.102+0000 7f5d337fe640 1 -- 172.21.15.79:0/2799143495 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5d380aab00 con 0x55ca682ef050 2024-08-20T01:50:40.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.102+0000 7f5d337fe640 1 -- 172.21.15.79:0/2799143495 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d38004e40 con 0x55ca682ef050 2024-08-20T01:50:40.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.103+0000 7f5d5239d740 1 -- 172.21.15.79:0/2799143495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca682ef050 msgr2=0x55ca682f7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:40.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.103+0000 7f5d5239d740 1 --2- 172.21.15.79:0/2799143495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca682ef050 0x55ca682f7830 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f5d3800c6a0 tx=0x7f5d380e1580 comp rx=0 tx=0).stop 2024-08-20T01:50:40.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.103+0000 7f5d5239d740 1 -- 172.21.15.79:0/2799143495 shutdown_connections 2024-08-20T01:50:40.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.103+0000 7f5d5239d740 1 --2- 172.21.15.79:0/2799143495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca682fafe0 0x55ca683170c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:40.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.103+0000 7f5d5239d740 1 --2- 172.21.15.79:0/2799143495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca682ef050 0x55ca682f7830 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:40.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.103+0000 7f5d5239d740 1 --2- 172.21.15.79:0/2799143495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca682ee730 0x55ca682eb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:40.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.103+0000 7f5d5239d740 1 -- 172.21.15.79:0/2799143495 >> 172.21.15.79:0/2799143495 conn(0x55ca682ec560 msgr2=0x55ca682f9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:40.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.103+0000 7f5d5239d740 1 -- 172.21.15.79:0/2799143495 shutdown_connections 2024-08-20T01:50:40.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.103+0000 7f5d5239d740 1 -- 172.21.15.79:0/2799143495 wait complete. 2024-08-20T01:50:40.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.103+0000 7f5d5239d740 1 -- start start 2024-08-20T01:50:40.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.103+0000 7f5d5239d740 1 Processor -- start 2024-08-20T01:50:40.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.104+0000 7f5d5239d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca682ee730 0x55ca68302ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:40.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.104+0000 7f5d5239d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca682ef050 0x55ca68303070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:40.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.104+0000 7f5d5239d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca682fafe0 0x55ca68378080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:40.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.104+0000 7f5d5239d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5d481ad290 con 0x55ca682ef050 2024-08-20T01:50:40.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.104+0000 7f5d5239d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5d481acbc0 con 0x55ca682fafe0 2024-08-20T01:50:40.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.104+0000 7f5d5239d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5d481a9d40 con 0x55ca682ee730 2024-08-20T01:50:40.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.104+0000 7f5d5239d740 10 client.0 _ll_register_callbacks cb 0x7f5d44031830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:50:40.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.104+0000 7f5d4dd40640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca682ee730 0x55ca68302ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:40.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.104+0000 7f5d4dd40640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca682ee730 0x55ca68302ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:33580/0 (socket says 172.21.15.79:33580) 2024-08-20T01:50:40.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.104+0000 7f5d4dd40640 1 -- 172.21.15.79:0/2061338529 learned_addr learned my addr 172.21.15.79:0/2061338529 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:40.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.104+0000 7f5d4d53f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca682ef050 0x55ca68303070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:40.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.104+0000 7f5d4e541640 1 --2- 172.21.15.79:0/2061338529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca682fafe0 0x55ca68378080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:40.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.104+0000 7f5d4dd40640 1 -- 172.21.15.79:0/2061338529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca682fafe0 msgr2=0x55ca68378080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:40.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.104+0000 7f5d4dd40640 1 --2- 172.21.15.79:0/2061338529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca682fafe0 0x55ca68378080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:40.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.104+0000 7f5d4dd40640 1 -- 172.21.15.79:0/2061338529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca682ef050 msgr2=0x55ca68303070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:40.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.104+0000 7f5d4dd40640 1 --2- 172.21.15.79:0/2061338529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca682ef050 0x55ca68303070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:40.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.104+0000 7f5d4dd40640 1 -- 172.21.15.79:0/2061338529 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca683787c0 con 0x55ca682ee730 2024-08-20T01:50:40.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.104+0000 7f5d4dd40640 1 --2- 172.21.15.79:0/2061338529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca682ee730 0x55ca68302ad0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5d44009a20 tx=0x7f5d44003820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a639f973b781c05 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:40.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.104+0000 7f5d317fa640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:50:40.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.105+0000 7f5d317fa640 1 -- 172.21.15.79:0/2061338529 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d44060020 con 0x55ca682ee730 2024-08-20T01:50:40.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.105+0000 7f5d317fa640 1 -- 172.21.15.79:0/2061338529 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f5d44005030 con 0x55ca682ee730 2024-08-20T01:50:40.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.105+0000 7f5d5239d740 1 -- 172.21.15.79:0/2061338529 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d380aab00 con 0x55ca682ee730 2024-08-20T01:50:40.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.105+0000 7f5d317fa640 1 -- 172.21.15.79:0/2061338529 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f5d44035040 con 0x55ca682ee730 2024-08-20T01:50:40.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.105+0000 7f5d5239d740 10 client.27826 fetch_fsmap learned FSMap version 53 2024-08-20T01:50:40.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.105+0000 7f5d5239d740 1 -- 172.21.15.79:0/2061338529 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x55ca682fd940 con 0x55ca682ee730 2024-08-20T01:50:40.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.105+0000 7f5d317fa640 1 -- 172.21.15.79:0/2061338529 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5d380aab00 con 0x55ca682ee730 2024-08-20T01:50:40.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.105+0000 7f5d317fa640 1 -- 172.21.15.79:0/2061338529 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 53) ==== 8378+0+0 (secure 0 0 0) 0x7f5d44059040 con 0x55ca682ee730 2024-08-20T01:50:40.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.105+0000 7f5d5239d740 10 client.27826 fetch_fsmap finished waiting for FSMap version 53 2024-08-20T01:50:40.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.105+0000 7f5d5239d740 10 client.27826 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:50:40.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.105+0000 7f5d5239d740 20 client.27826 populate_metadata read hostname 'smithi079' 2024-08-20T01:50:40.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.105+0000 7f5d5239d740 1 --2- 172.21.15.79:0/2061338529 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x55ca682fe0f0 0x55ca68300510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:40.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.105+0000 7f5d5239d740 4 client.27826 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:50:40.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.105+0000 7f5d5239d740 1 -- 172.21.15.79:0/2061338529 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ca68263320 con 0x55ca682fe0f0 2024-08-20T01:50:40.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.105+0000 7f5d4d53f640 1 --2- 172.21.15.79:0/2061338529 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x55ca682fe0f0 0x55ca68300510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:40.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.106+0000 7f5d317fa640 10 client.27826 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:50:40.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.106+0000 7f5d4d53f640 1 --2- 172.21.15.79:0/2061338529 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x55ca682fe0f0 0x55ca68300510 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6da1bb4ef39b4a89 server_cookie=c3e84fd58204ada8 in_seq=0 out_seq=0 2024-08-20T01:50:40.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.106+0000 7f5d317fa640 1 -- 172.21.15.79:0/2061338529 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ca68263320 con 0x55ca682fe0f0 2024-08-20T01:50:40.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.106+0000 7f5d317fa640 10 client.27826 handle_command_reply: tid=0 2024-08-20T01:50:40.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.106+0000 7f5d5239d740 1 client.27826 shutdown 2024-08-20T01:50:40.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.106+0000 7f5d5239d740 1 -- 172.21.15.79:0/2061338529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca682ee730 msgr2=0x55ca68302ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:40.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.106+0000 7f5d5239d740 1 --2- 172.21.15.79:0/2061338529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca682ee730 0x55ca68302ad0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5d44009a20 tx=0x7f5d44003820 comp rx=0 tx=0).stop 2024-08-20T01:50:40.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.106+0000 7f5d5239d740 1 -- 172.21.15.79:0/2061338529 shutdown_connections 2024-08-20T01:50:40.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.106+0000 7f5d5239d740 1 --2- 172.21.15.79:0/2061338529 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x55ca682fe0f0 0x55ca68300510 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:40.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.106+0000 7f5d5239d740 1 --2- 172.21.15.79:0/2061338529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca682fafe0 0x55ca68378080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:40.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.106+0000 7f5d317fa640 0 client.27826 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:50:40.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.106+0000 7f5d5239d740 1 --2- 172.21.15.79:0/2061338529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ca682ef050 0x55ca68303070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:40.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.106+0000 7f5d5239d740 1 --2- 172.21.15.79:0/2061338529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca682ee730 0x55ca68302ad0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:40.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.106+0000 7f5d5239d740 1 -- 172.21.15.79:0/2061338529 >> 172.21.15.79:0/2061338529 conn(0x55ca682ec560 msgr2=0x55ca682f18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:40.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.107+0000 7f5d5239d740 1 -- 172.21.15.79:0/2061338529 shutdown_connections 2024-08-20T01:50:40.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.107+0000 7f5d5239d740 1 -- 172.21.15.79:0/2061338529 wait complete. 2024-08-20T01:50:40.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.107+0000 7f5d5239d740 20 client.27826 trim_cache size 0 max 16384 2024-08-20T01:50:40.122 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:50:40.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.107+0000 7f5d4ffa4640 1 -- 172.21.15.79:0/2322347064 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5d340b3bd0 msgr2=0x7f5d340b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:40.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.107+0000 7f5d4ffa4640 1 --2- 172.21.15.79:0/2322347064 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5d340b3bd0 0x7f5d340b6090 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x55ca682f18b0 tx=0x7f5d44005d50 comp rx=0 tx=0).stop 2024-08-20T01:50:40.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.107+0000 7f5d4ffa4640 1 -- 172.21.15.79:0/2322347064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d481073a0 msgr2=0x7f5d48199460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:40.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.107+0000 7f5d4ffa4640 1 --2- 172.21.15.79:0/2322347064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d481073a0 0x7f5d48199460 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f5d3800e9f0 tx=0x7f5d3800eeb0 comp rx=0 tx=0).stop 2024-08-20T01:50:40.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.107+0000 7f5d4ffa4640 1 -- 172.21.15.79:0/2322347064 shutdown_connections 2024-08-20T01:50:40.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.107+0000 7f5d4ffa4640 1 --2- 172.21.15.79:0/2322347064 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f5d340b3bd0 0x7f5d340b6090 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:40.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.107+0000 7f5d4ffa4640 1 --2- 172.21.15.79:0/2322347064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d48107d20 0x7f5d4819e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:40.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.107+0000 7f5d4ffa4640 1 --2- 172.21.15.79:0/2322347064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d481073a0 0x7f5d48199460 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:40.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.107+0000 7f5d4ffa4640 1 --2- 172.21.15.79:0/2322347064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d48101990 0x7f5d48198f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:40.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.107+0000 7f5d4ffa4640 1 -- 172.21.15.79:0/2322347064 >> 172.21.15.79:0/2322347064 conn(0x7f5d480fd400 msgr2=0x7f5d480ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:40.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.107+0000 7f5d4ffa4640 1 -- 172.21.15.79:0/2322347064 shutdown_connections 2024-08-20T01:50:40.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:40.107+0000 7f5d4ffa4640 1 -- 172.21.15.79:0/2322347064 wait complete. 2024-08-20T01:50:40.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:40 smithi079 ceph-mon[18656]: pgmap v747: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.2 MiB/s wr, 2.09k op/s 2024-08-20T01:50:40.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:40 smithi081 ceph-mon[22209]: pgmap v747: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.2 MiB/s wr, 2.09k op/s 2024-08-20T01:50:40.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:40 smithi175 ceph-mon[22392]: pgmap v747: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.2 MiB/s wr, 2.09k op/s 2024-08-20T01:50:40.910 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T01:50:41.172 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:50:41.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.696+0000 7fb2c169c640 1 -- 172.21.15.79:0/3819929360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2bc101990 msgr2=0x7fb2bc101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:41.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.696+0000 7fb2c169c640 1 --2- 172.21.15.79:0/3819929360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2bc101990 0x7fb2bc101d70 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac009900 tx=0x7fb2ac02a410 comp rx=0 tx=0).stop 2024-08-20T01:50:41.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.696+0000 7fb2c169c640 1 -- 172.21.15.79:0/3819929360 shutdown_connections 2024-08-20T01:50:41.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.696+0000 7fb2c169c640 1 --2- 172.21.15.79:0/3819929360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2bc107d20 0x7fb2bc10e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:41.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.696+0000 7fb2c169c640 1 --2- 172.21.15.79:0/3819929360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2bc1073a0 0x7fb2bc1077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:41.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.696+0000 7fb2c169c640 1 --2- 172.21.15.79:0/3819929360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2bc101990 0x7fb2bc101d70 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:41.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.696+0000 7fb2c169c640 1 -- 172.21.15.79:0/3819929360 >> 172.21.15.79:0/3819929360 conn(0x7fb2bc0fd400 msgr2=0x7fb2bc0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:41.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.696+0000 7fb2c169c640 1 -- 172.21.15.79:0/3819929360 shutdown_connections 2024-08-20T01:50:41.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.696+0000 7fb2c169c640 1 -- 172.21.15.79:0/3819929360 wait complete. 2024-08-20T01:50:41.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.696+0000 7fb2c169c640 1 Processor -- start 2024-08-20T01:50:41.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.696+0000 7fb2c169c640 1 -- start start 2024-08-20T01:50:41.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.697+0000 7fb2c169c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2bc101990 0x7fb2bc1035d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:41.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.697+0000 7fb2c169c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2bc1073a0 0x7fb2bc103b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:41.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.697+0000 7fb2c169c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2bc107d20 0x7fb2bc104050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:41.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.697+0000 7fb2c169c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb2bc111890 con 0x7fb2bc101990 2024-08-20T01:50:41.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.697+0000 7fb2c169c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb2bc111710 con 0x7fb2bc107d20 2024-08-20T01:50:41.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.697+0000 7fb2c169c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb2bc111a10 con 0x7fb2bc1073a0 2024-08-20T01:50:41.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.697+0000 7fb2baffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2bc101990 0x7fb2bc1035d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:41.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.697+0000 7fb2baffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2bc101990 0x7fb2bc1035d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41344/0 (socket says 172.21.15.79:41344) 2024-08-20T01:50:41.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.697+0000 7fb2baffd640 1 -- 172.21.15.79:0/3871152349 learned_addr learned my addr 172.21.15.79:0/3871152349 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:41.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.697+0000 7fb2b3fff640 1 --2- 172.21.15.79:0/3871152349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2bc1073a0 0x7fb2bc103b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:41.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.697+0000 7fb2bb7fe640 1 --2- 172.21.15.79:0/3871152349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2bc107d20 0x7fb2bc104050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:41.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.697+0000 7fb2baffd640 1 -- 172.21.15.79:0/3871152349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2bc1073a0 msgr2=0x7fb2bc103b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:41.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.697+0000 7fb2baffd640 1 --2- 172.21.15.79:0/3871152349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2bc1073a0 0x7fb2bc103b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:41.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.697+0000 7fb2baffd640 1 -- 172.21.15.79:0/3871152349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2bc107d20 msgr2=0x7fb2bc104050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:41.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.697+0000 7fb2baffd640 1 --2- 172.21.15.79:0/3871152349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2bc107d20 0x7fb2bc104050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:41.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.697+0000 7fb2baffd640 1 -- 172.21.15.79:0/3871152349 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2bc1a72f0 con 0x7fb2bc101990 2024-08-20T01:50:41.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.697+0000 7fb2baffd640 1 --2- 172.21.15.79:0/3871152349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2bc101990 0x7fb2bc1035d0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac009230 tx=0x7fb2ac0319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:41.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.697+0000 7fb2b8ff9640 1 -- 172.21.15.79:0/3871152349 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac03f030 con 0x7fb2bc101990 2024-08-20T01:50:41.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.697+0000 7fb2b8ff9640 1 -- 172.21.15.79:0/3871152349 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb2ac0043d0 con 0x7fb2bc101990 2024-08-20T01:50:41.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.697+0000 7fb2c169c640 1 -- 172.21.15.79:0/3871152349 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2bc1a7580 con 0x7fb2bc101990 2024-08-20T01:50:41.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.697+0000 7fb2b8ff9640 1 -- 172.21.15.79:0/3871152349 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac035070 con 0x7fb2bc101990 2024-08-20T01:50:41.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.698+0000 7fb2c169c640 1 -- 172.21.15.79:0/3871152349 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2bc1a7a60 con 0x7fb2bc101990 2024-08-20T01:50:41.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.700+0000 7fb2c3a95740 1 Processor -- start 2024-08-20T01:50:41.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.700+0000 7fb2c3a95740 1 -- start start 2024-08-20T01:50:41.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.700+0000 7fb2c3a95740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ded6f16880 0x55ded6f16c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:41.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.700+0000 7fb2c3a95740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ded6f171a0 0x55ded6f22bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:41.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.700+0000 7fb2c3a95740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded6f23130 0x55ded6f25520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:41.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.700+0000 7fb2c3a95740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ded6e8d930 con 0x55ded6f171a0 2024-08-20T01:50:41.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.700+0000 7fb2c3a95740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ded6e7ce30 con 0x55ded6f16880 2024-08-20T01:50:41.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.700+0000 7fb2c3a95740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ded6e80e70 con 0x55ded6f23130 2024-08-20T01:50:41.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.701+0000 7fb2b8ff9640 1 -- 172.21.15.79:0/3871152349 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb2ac042030 con 0x7fb2bc101990 2024-08-20T01:50:41.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.701+0000 7fb2b3fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded6f23130 0x55ded6f25520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:41.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.701+0000 7fb2bb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ded6f16880 0x55ded6f16c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:41.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.701+0000 7fb2b3fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded6f23130 0x55ded6f25520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:53142/0 (socket says 172.21.15.79:53142) 2024-08-20T01:50:41.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.701+0000 7fb2b3fff640 1 -- 172.21.15.79:0/835780498 learned_addr learned my addr 172.21.15.79:0/835780498 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:41.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.701+0000 7fb2baffd640 1 --2- 172.21.15.79:0/835780498 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ded6f171a0 0x55ded6f22bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:41.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.701+0000 7fb2b3fff640 1 -- 172.21.15.79:0/835780498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ded6f16880 msgr2=0x55ded6f16c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:41.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.701+0000 7fb2b3fff640 1 --2- 172.21.15.79:0/835780498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ded6f16880 0x55ded6f16c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:41.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.701+0000 7fb2b3fff640 1 -- 172.21.15.79:0/835780498 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ded6f171a0 msgr2=0x55ded6f22bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:41.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.701+0000 7fb2b3fff640 1 --2- 172.21.15.79:0/835780498 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ded6f171a0 0x55ded6f22bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:41.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.701+0000 7fb2b3fff640 1 -- 172.21.15.79:0/835780498 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ded6bdc650 con 0x55ded6f23130 2024-08-20T01:50:41.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.701+0000 7fb2b3fff640 1 --2- 172.21.15.79:0/835780498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded6f23130 0x55ded6f25520 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4009cc0 tx=0x7fb2a4011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c354b7c1508839a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:41.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.701+0000 7fb2b17fa640 1 -- 172.21.15.79:0/835780498 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a401e070 con 0x55ded6f23130 2024-08-20T01:50:41.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.701+0000 7fb2b17fa640 1 -- 172.21.15.79:0/835780498 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb2a4019ac0 con 0x55ded6f23130 2024-08-20T01:50:41.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.701+0000 7fb2b17fa640 1 -- 172.21.15.79:0/835780498 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a400e910 con 0x55ded6f23130 2024-08-20T01:50:41.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.702+0000 7fb2b8ff9640 1 --2- 172.21.15.79:0/3871152349 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb2a80b3bd0 0x7fb2a80b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:41.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.702+0000 7fb2bb7fe640 1 --2- 172.21.15.79:0/3871152349 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb2a80b3bd0 0x7fb2a80b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:41.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.702+0000 7fb2b8ff9640 1 -- 172.21.15.79:0/3871152349 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fb2ac103f70 con 0x7fb2bc101990 2024-08-20T01:50:41.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.702+0000 7fb2c3a95740 1 -- 172.21.15.79:0/835780498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded6f23130 msgr2=0x55ded6f25520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:41.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.702+0000 7fb2c3a95740 1 --2- 172.21.15.79:0/835780498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded6f23130 0x55ded6f25520 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4009cc0 tx=0x7fb2a4011810 comp rx=0 tx=0).stop 2024-08-20T01:50:41.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.702+0000 7fb2c3a95740 1 -- 172.21.15.79:0/835780498 shutdown_connections 2024-08-20T01:50:41.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.702+0000 7fb2c3a95740 1 --2- 172.21.15.79:0/835780498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded6f23130 0x55ded6f25520 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:41.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.702+0000 7fb2c3a95740 1 --2- 172.21.15.79:0/835780498 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ded6f171a0 0x55ded6f22bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:41.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.702+0000 7fb2c3a95740 1 --2- 172.21.15.79:0/835780498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ded6f16880 0x55ded6f16c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:41.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.702+0000 7fb2c3a95740 1 -- 172.21.15.79:0/835780498 >> 172.21.15.79:0/835780498 conn(0x55ded6f146b0 msgr2=0x55ded6f15850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:41.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.702+0000 7fb2bb7fe640 1 --2- 172.21.15.79:0/3871152349 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb2a80b3bd0 0x7fb2a80b6090 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc105690 tx=0x7fb2b4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:41.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.702+0000 7fb2c3a95740 1 -- 172.21.15.79:0/835780498 shutdown_connections 2024-08-20T01:50:41.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.702+0000 7fb2c3a95740 1 -- 172.21.15.79:0/835780498 wait complete. 2024-08-20T01:50:41.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.703+0000 7fb2c3a95740 1 -- start start 2024-08-20T01:50:41.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.703+0000 7fb2c3a95740 1 Processor -- start 2024-08-20T01:50:41.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.703+0000 7fb2c3a95740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded6f16880 0x55ded6f200f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:41.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.703+0000 7fb2c3a95740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ded6f171a0 0x55ded6f20630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:41.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.703+0000 7fb2c3a95740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ded6f23130 0x55ded6f20b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:41.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.703+0000 7fb2c3a95740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ded6cdf700 con 0x55ded6f171a0 2024-08-20T01:50:41.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.703+0000 7fb2c3a95740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ded6e03810 con 0x55ded6f23130 2024-08-20T01:50:41.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.703+0000 7fb2c3a95740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ded6f25de0 con 0x55ded6f16880 2024-08-20T01:50:41.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.703+0000 7fb2c3a95740 10 client.0 _ll_register_callbacks cb 0x55ded6e76700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:50:41.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.703+0000 7fb2b3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ded6f171a0 0x55ded6f20630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:41.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.703+0000 7fb2b3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ded6f171a0 0x55ded6f20630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41356/0 (socket says 172.21.15.79:41356) 2024-08-20T01:50:41.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.703+0000 7fb2b3fff640 1 -- 172.21.15.79:0/4074078887 learned_addr learned my addr 172.21.15.79:0/4074078887 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:41.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.703+0000 7fb2baffd640 1 --2- 172.21.15.79:0/4074078887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded6f16880 0x55ded6f200f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:41.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.703+0000 7fb2bb7fe640 1 --2- 172.21.15.79:0/4074078887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ded6f23130 0x55ded6f20b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:41.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.703+0000 7fb2b3fff640 1 -- 172.21.15.79:0/4074078887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded6f16880 msgr2=0x55ded6f200f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:41.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.703+0000 7fb2b3fff640 1 --2- 172.21.15.79:0/4074078887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded6f16880 0x55ded6f200f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:41.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.703+0000 7fb2b3fff640 1 -- 172.21.15.79:0/4074078887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ded6f23130 msgr2=0x55ded6f20b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:41.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.703+0000 7fb2b3fff640 1 --2- 172.21.15.79:0/4074078887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ded6f23130 0x55ded6f20b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:41.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.703+0000 7fb2b3fff640 1 -- 172.21.15.79:0/4074078887 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ded6f2f1f0 con 0x55ded6f171a0 2024-08-20T01:50:41.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.703+0000 7fb2baffd640 1 --2- 172.21.15.79:0/4074078887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded6f16880 0x55ded6f200f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:50:41.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.704+0000 7fb2b3fff640 1 --2- 172.21.15.79:0/4074078887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ded6f171a0 0x55ded6f20630 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fb2a401c040 tx=0x7fb2a40056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0172cb2a295fb18 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:41.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.704+0000 7fb2a27fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:50:41.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.704+0000 7fb2a27fc640 1 -- 172.21.15.79:0/4074078887 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4027030 con 0x55ded6f171a0 2024-08-20T01:50:41.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.704+0000 7fb2c3a95740 1 -- 172.21.15.79:0/4074078887 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ded6e2c150 con 0x55ded6f171a0 2024-08-20T01:50:41.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.704+0000 7fb2a27fc640 1 -- 172.21.15.79:0/4074078887 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fb2a4004020 con 0x55ded6f171a0 2024-08-20T01:50:41.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.704+0000 7fb2a27fc640 1 -- 172.21.15.79:0/4074078887 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fb2a401e070 con 0x55ded6f171a0 2024-08-20T01:50:41.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.704+0000 7fb2c3a95740 10 client.18792 fetch_fsmap learned FSMap version 53 2024-08-20T01:50:41.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.704+0000 7fb2c3a95740 1 -- 172.21.15.79:0/4074078887 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x55ded6f31ba0 con 0x55ded6f171a0 2024-08-20T01:50:41.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.704+0000 7fb2a27fc640 1 -- 172.21.15.79:0/4074078887 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55ded6e2c150 con 0x55ded6f171a0 2024-08-20T01:50:41.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.704+0000 7fb2a27fc640 1 -- 172.21.15.79:0/4074078887 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 53) ==== 8378+0+0 (secure 0 0 0) 0x7fb2a400e650 con 0x55ded6f171a0 2024-08-20T01:50:41.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.704+0000 7fb2c3a95740 10 client.18792 fetch_fsmap finished waiting for FSMap version 53 2024-08-20T01:50:41.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.704+0000 7fb2c3a95740 10 client.18792 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:50:41.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.704+0000 7fb2c3a95740 20 client.18792 populate_metadata read hostname 'smithi079' 2024-08-20T01:50:41.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.704+0000 7fb2c3a95740 1 --2- 172.21.15.79:0/4074078887 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55ded6f32ef0 0x55ded6f352e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:41.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.704+0000 7fb2c3a95740 4 client.18792 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:50:41.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.704+0000 7fb2c3a95740 1 -- 172.21.15.79:0/4074078887 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ded6e8f880 con 0x55ded6f32ef0 2024-08-20T01:50:41.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.705+0000 7fb2baffd640 1 --2- 172.21.15.79:0/4074078887 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55ded6f32ef0 0x55ded6f352e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:41.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.705+0000 7fb2a27fc640 10 client.18792 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:50:41.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.705+0000 7fb2baffd640 1 --2- 172.21.15.79:0/4074078887 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55ded6f32ef0 0x55ded6f352e0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bddcfda877b15c26 server_cookie=4137ed7af8b19e67 in_seq=0 out_seq=0 2024-08-20T01:50:41.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.706+0000 7fb2a27fc640 1 -- 172.21.15.79:0/4074078887 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ded6e8f880 con 0x55ded6f32ef0 2024-08-20T01:50:41.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.706+0000 7fb2a27fc640 10 client.18792 handle_command_reply: tid=0 2024-08-20T01:50:41.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.706+0000 7fb2c3a95740 1 client.18792 shutdown 2024-08-20T01:50:41.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.706+0000 7fb2c3a95740 1 -- 172.21.15.79:0/4074078887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ded6f171a0 msgr2=0x55ded6f20630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:41.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.706+0000 7fb2c3a95740 1 --2- 172.21.15.79:0/4074078887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ded6f171a0 0x55ded6f20630 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fb2a401c040 tx=0x7fb2a40056a0 comp rx=0 tx=0).stop 2024-08-20T01:50:41.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.706+0000 7fb2c3a95740 1 -- 172.21.15.79:0/4074078887 shutdown_connections 2024-08-20T01:50:41.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.706+0000 7fb2c3a95740 1 --2- 172.21.15.79:0/4074078887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ded6f23130 0x55ded6f20b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:41.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.706+0000 7fb2c3a95740 1 --2- 172.21.15.79:0/4074078887 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55ded6f32ef0 0x55ded6f352e0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:41.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.706+0000 7fb2c3a95740 1 --2- 172.21.15.79:0/4074078887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ded6f171a0 0x55ded6f20630 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:41.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.706+0000 7fb2c3a95740 1 --2- 172.21.15.79:0/4074078887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded6f16880 0x55ded6f200f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:41.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.706+0000 7fb2c3a95740 1 -- 172.21.15.79:0/4074078887 >> 172.21.15.79:0/4074078887 conn(0x55ded6f146b0 msgr2=0x55ded6f1a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:41.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.706+0000 7fb2a27fc640 0 client.18792 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:50:41.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.706+0000 7fb2c3a95740 1 -- 172.21.15.79:0/4074078887 shutdown_connections 2024-08-20T01:50:41.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.706+0000 7fb2c3a95740 1 -- 172.21.15.79:0/4074078887 wait complete. 2024-08-20T01:50:41.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.706+0000 7fb2c3a95740 20 client.18792 trim_cache size 0 max 16384 2024-08-20T01:50:41.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.720+0000 7fb2c3a95740 1 Processor -- start 2024-08-20T01:50:41.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.720+0000 7fb2c3a95740 1 -- start start 2024-08-20T01:50:41.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.720+0000 7fb2c3a95740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ded6f16880 0x55ded6f15700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:41.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.720+0000 7fb2c3a95740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded6f171a0 0x55ded6f15c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:41.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.720+0000 7fb2c3a95740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ded6f23130 0x55ded6f3aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:41.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.720+0000 7fb2c3a95740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb2bc1b01b0 con 0x55ded6f16880 2024-08-20T01:50:41.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.720+0000 7fb2c3a95740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb2bc1b1db0 con 0x55ded6f23130 2024-08-20T01:50:41.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.720+0000 7fb2c3a95740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb2bc1b0940 con 0x55ded6f171a0 2024-08-20T01:50:41.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.720+0000 7fb2baffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ded6f16880 0x55ded6f15700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:41.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.720+0000 7fb2bb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ded6f23130 0x55ded6f3aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:41.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.720+0000 7fb2baffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ded6f16880 0x55ded6f15700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41372/0 (socket says 172.21.15.79:41372) 2024-08-20T01:50:41.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.720+0000 7fb2b3fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded6f171a0 0x55ded6f15c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:41.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.720+0000 7fb2baffd640 1 -- 172.21.15.79:0/1558079993 learned_addr learned my addr 172.21.15.79:0/1558079993 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:41.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.721+0000 7fb2bb7fe640 1 -- 172.21.15.79:0/1558079993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded6f171a0 msgr2=0x55ded6f15c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:41.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.721+0000 7fb2bb7fe640 1 --2- 172.21.15.79:0/1558079993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded6f171a0 0x55ded6f15c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:41.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.721+0000 7fb2bb7fe640 1 -- 172.21.15.79:0/1558079993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ded6f16880 msgr2=0x55ded6f15700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:41.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.721+0000 7fb2bb7fe640 1 --2- 172.21.15.79:0/1558079993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ded6f16880 0x55ded6f15700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:41.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.721+0000 7fb2bb7fe640 1 -- 172.21.15.79:0/1558079993 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ded6f1e5f0 con 0x55ded6f23130 2024-08-20T01:50:41.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.721+0000 7fb2baffd640 1 --2- 172.21.15.79:0/1558079993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ded6f16880 0x55ded6f15700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:50:41.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.721+0000 7fb2bb7fe640 1 --2- 172.21.15.79:0/1558079993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ded6f23130 0x55ded6f3aaa0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4009f50 tx=0x7fb2b401a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4ad6b931830abb9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:41.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.721+0000 7fb2b0ff9640 1 -- 172.21.15.79:0/1558079993 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b4004b20 con 0x55ded6f23130 2024-08-20T01:50:41.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.721+0000 7fb2b0ff9640 1 -- 172.21.15.79:0/1558079993 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb2b4004cc0 con 0x55ded6f23130 2024-08-20T01:50:41.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.721+0000 7fb2b0ff9640 1 -- 172.21.15.79:0/1558079993 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b4005310 con 0x55ded6f23130 2024-08-20T01:50:41.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.722+0000 7fb2c3a95740 1 -- 172.21.15.79:0/1558079993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ded6f23130 msgr2=0x55ded6f3aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:41.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.722+0000 7fb2c3a95740 1 --2- 172.21.15.79:0/1558079993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ded6f23130 0x55ded6f3aaa0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4009f50 tx=0x7fb2b401a000 comp rx=0 tx=0).stop 2024-08-20T01:50:41.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.722+0000 7fb2c3a95740 1 -- 172.21.15.79:0/1558079993 shutdown_connections 2024-08-20T01:50:41.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.722+0000 7fb2c3a95740 1 --2- 172.21.15.79:0/1558079993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ded6f23130 0x55ded6f3aaa0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:41.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.722+0000 7fb2c3a95740 1 --2- 172.21.15.79:0/1558079993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded6f171a0 0x55ded6f15c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:41.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.722+0000 7fb2c3a95740 1 --2- 172.21.15.79:0/1558079993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ded6f16880 0x55ded6f15700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:41.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.722+0000 7fb2c3a95740 1 -- 172.21.15.79:0/1558079993 >> 172.21.15.79:0/1558079993 conn(0x55ded6f146b0 msgr2=0x55ded6f1e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:41.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.722+0000 7fb2c3a95740 1 -- 172.21.15.79:0/1558079993 shutdown_connections 2024-08-20T01:50:41.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.722+0000 7fb2c3a95740 1 -- 172.21.15.79:0/1558079993 wait complete. 2024-08-20T01:50:41.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.722+0000 7fb2c3a95740 1 -- start start 2024-08-20T01:50:41.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.722+0000 7fb2c3a95740 1 Processor -- start 2024-08-20T01:50:41.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.722+0000 7fb2c3a95740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ded6f16880 0x55ded6f2b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:41.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.722+0000 7fb2c3a95740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded6f171a0 0x55ded6f2b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:41.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.722+0000 7fb2c3a95740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ded6f23130 0x55ded6f26060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:41.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.722+0000 7fb2c3a95740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb2bc1b16e0 con 0x55ded6f23130 2024-08-20T01:50:41.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.722+0000 7fb2c3a95740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb2bc1b1010 con 0x55ded6f16880 2024-08-20T01:50:41.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.723+0000 7fb2c3a95740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb2bc1ae190 con 0x55ded6f171a0 2024-08-20T01:50:41.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.723+0000 7fb2c3a95740 10 client.0 _ll_register_callbacks cb 0x7fb2a401c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:50:41.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.723+0000 7fb2baffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ded6f16880 0x55ded6f2b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:41.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.723+0000 7fb2bb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ded6f23130 0x55ded6f26060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:41.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.723+0000 7fb2bb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ded6f23130 0x55ded6f26060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41388/0 (socket says 172.21.15.79:41388) 2024-08-20T01:50:41.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.723+0000 7fb2baffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ded6f16880 0x55ded6f2b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:39178/0 (socket says 172.21.15.79:39178) 2024-08-20T01:50:41.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.723+0000 7fb2bb7fe640 1 -- 172.21.15.79:0/3971951715 learned_addr learned my addr 172.21.15.79:0/3971951715 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:41.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.723+0000 7fb2b3fff640 1 --2- 172.21.15.79:0/3971951715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded6f171a0 0x55ded6f2b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:41.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.723+0000 7fb2baffd640 1 -- 172.21.15.79:0/3971951715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded6f171a0 msgr2=0x55ded6f2b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:41.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.723+0000 7fb2baffd640 1 --2- 172.21.15.79:0/3971951715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded6f171a0 0x55ded6f2b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:41.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.723+0000 7fb2baffd640 1 -- 172.21.15.79:0/3971951715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ded6f23130 msgr2=0x55ded6f26060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:41.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.723+0000 7fb2baffd640 1 --2- 172.21.15.79:0/3971951715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ded6f23130 0x55ded6f26060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:41.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.723+0000 7fb2baffd640 1 -- 172.21.15.79:0/3971951715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ded6f267a0 con 0x55ded6f16880 2024-08-20T01:50:41.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.723+0000 7fb2bb7fe640 1 --2- 172.21.15.79:0/3971951715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ded6f23130 0x55ded6f26060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:50:41.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.723+0000 7fb2baffd640 1 --2- 172.21.15.79:0/3971951715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ded6f16880 0x55ded6f2b290 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac0c6fa0 tx=0x7fb2ac009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbf827d5722125ed server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:41.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.723+0000 7fb2a27fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:50:41.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.723+0000 7fb2a27fc640 1 -- 172.21.15.79:0/3971951715 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac049040 con 0x55ded6f16880 2024-08-20T01:50:41.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.723+0000 7fb2a27fc640 1 -- 172.21.15.79:0/3971951715 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fb2ac003bf0 con 0x55ded6f16880 2024-08-20T01:50:41.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.723+0000 7fb2c3a95740 1 -- 172.21.15.79:0/3971951715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2b4004cc0 con 0x55ded6f16880 2024-08-20T01:50:41.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.724+0000 7fb2a27fc640 1 -- 172.21.15.79:0/3971951715 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fb2ac0cf250 con 0x55ded6f16880 2024-08-20T01:50:41.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.724+0000 7fb2c3a95740 10 client.27917 fetch_fsmap learned FSMap version 53 2024-08-20T01:50:41.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.724+0000 7fb2c3a95740 1 -- 172.21.15.79:0/3971951715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x55ded6f9c500 con 0x55ded6f16880 2024-08-20T01:50:41.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.724+0000 7fb2a27fc640 1 -- 172.21.15.79:0/3971951715 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb2ac0d3f20 con 0x55ded6f16880 2024-08-20T01:50:41.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.724+0000 7fb2a27fc640 1 -- 172.21.15.79:0/3971951715 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 53) ==== 8378+0+0 (secure 0 0 0) 0x7fb2ac0d3a90 con 0x55ded6f16880 2024-08-20T01:50:41.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.724+0000 7fb2c3a95740 10 client.27917 fetch_fsmap finished waiting for FSMap version 53 2024-08-20T01:50:41.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.724+0000 7fb2c3a95740 10 client.27917 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:50:41.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.724+0000 7fb2c3a95740 20 client.27917 populate_metadata read hostname 'smithi079' 2024-08-20T01:50:41.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.724+0000 7fb2c3a95740 1 --2- 172.21.15.79:0/3971951715 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55ded6f9cac0 0x55ded6f9eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:41.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.724+0000 7fb2c3a95740 4 client.27917 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:50:41.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.724+0000 7fb2c3a95740 1 -- 172.21.15.79:0/3971951715 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fb2b4004cc0 con 0x55ded6f9cac0 2024-08-20T01:50:41.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.724+0000 7fb2b3fff640 1 --2- 172.21.15.79:0/3971951715 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55ded6f9cac0 0x55ded6f9eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:41.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.725+0000 7fb2b3fff640 1 --2- 172.21.15.79:0/3971951715 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55ded6f9cac0 0x55ded6f9eee0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=36103b7eef23ea77 server_cookie=c13efca71781d3fc in_seq=0 out_seq=0 2024-08-20T01:50:41.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.725+0000 7fb2a27fc640 10 client.27917 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:50:41.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.725+0000 7fb2a27fc640 1 -- 172.21.15.79:0/3971951715 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fb2b4004cc0 con 0x55ded6f9cac0 2024-08-20T01:50:41.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.725+0000 7fb2a27fc640 10 client.27917 handle_command_reply: tid=0 2024-08-20T01:50:41.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.725+0000 7fb2c3a95740 1 client.27917 shutdown 2024-08-20T01:50:41.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.725+0000 7fb2c3a95740 1 -- 172.21.15.79:0/3971951715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ded6f16880 msgr2=0x55ded6f2b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:41.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.725+0000 7fb2c3a95740 1 --2- 172.21.15.79:0/3971951715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ded6f16880 0x55ded6f2b290 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac0c6fa0 tx=0x7fb2ac009260 comp rx=0 tx=0).stop 2024-08-20T01:50:41.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.725+0000 7fb2c3a95740 1 -- 172.21.15.79:0/3971951715 shutdown_connections 2024-08-20T01:50:41.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.725+0000 7fb2c3a95740 1 --2- 172.21.15.79:0/3971951715 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x55ded6f9cac0 0x55ded6f9eee0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:41.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.725+0000 7fb2c3a95740 1 --2- 172.21.15.79:0/3971951715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ded6f23130 0x55ded6f26060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:41.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.725+0000 7fb2a27fc640 0 client.27917 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:50:41.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.725+0000 7fb2c3a95740 1 --2- 172.21.15.79:0/3971951715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ded6f171a0 0x55ded6f2b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:41.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.725+0000 7fb2c3a95740 1 --2- 172.21.15.79:0/3971951715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ded6f16880 0x55ded6f2b290 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:41.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.725+0000 7fb2c3a95740 1 -- 172.21.15.79:0/3971951715 >> 172.21.15.79:0/3971951715 conn(0x55ded6f146b0 msgr2=0x55ded6f15700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:41.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.725+0000 7fb2c3a95740 1 -- 172.21.15.79:0/3971951715 shutdown_connections 2024-08-20T01:50:41.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.725+0000 7fb2c3a95740 1 -- 172.21.15.79:0/3971951715 wait complete. 2024-08-20T01:50:41.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.725+0000 7fb2c3a95740 20 client.27917 trim_cache size 0 max 16384 2024-08-20T01:50:41.734 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:50:41.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.726+0000 7fb2c169c640 1 -- 172.21.15.79:0/3871152349 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb2a80b3bd0 msgr2=0x7fb2a80b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:41.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.726+0000 7fb2c169c640 1 --2- 172.21.15.79:0/3871152349 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb2a80b3bd0 0x7fb2a80b6090 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc105690 tx=0x7fb2b4009500 comp rx=0 tx=0).stop 2024-08-20T01:50:41.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.726+0000 7fb2c169c640 1 -- 172.21.15.79:0/3871152349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2bc101990 msgr2=0x7fb2bc1035d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:41.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.726+0000 7fb2c169c640 1 --2- 172.21.15.79:0/3871152349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2bc101990 0x7fb2bc1035d0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac009230 tx=0x7fb2ac0319a0 comp rx=0 tx=0).stop 2024-08-20T01:50:41.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.726+0000 7fb2c169c640 1 -- 172.21.15.79:0/3871152349 shutdown_connections 2024-08-20T01:50:41.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.726+0000 7fb2c169c640 1 --2- 172.21.15.79:0/3871152349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2bc107d20 0x7fb2bc104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:41.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.726+0000 7fb2c169c640 1 --2- 172.21.15.79:0/3871152349 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb2a80b3bd0 0x7fb2a80b6090 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:41.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.726+0000 7fb2c169c640 1 --2- 172.21.15.79:0/3871152349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2bc1073a0 0x7fb2bc103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:41.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.726+0000 7fb2c169c640 1 --2- 172.21.15.79:0/3871152349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2bc101990 0x7fb2bc1035d0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:41.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.726+0000 7fb2c169c640 1 -- 172.21.15.79:0/3871152349 >> 172.21.15.79:0/3871152349 conn(0x7fb2bc0fd400 msgr2=0x7fb2bc105800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:41.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.726+0000 7fb2c169c640 1 -- 172.21.15.79:0/3871152349 shutdown_connections 2024-08-20T01:50:41.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:41.726+0000 7fb2c169c640 1 -- 172.21.15.79:0/3871152349 wait complete. 2024-08-20T01:50:42.455 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T01:50:42.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:42 smithi079 ceph-mon[18656]: pgmap v748: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.7 MiB/s wr, 948 op/s 2024-08-20T01:50:42.718 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:50:42.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:42 smithi081 ceph-mon[22209]: pgmap v748: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.7 MiB/s wr, 948 op/s 2024-08-20T01:50:42.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:42 smithi175 ceph-mon[22392]: pgmap v748: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.7 MiB/s wr, 948 op/s 2024-08-20T01:50:43.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.049+0000 7faee58a1640 1 -- 172.21.15.79:0/2740844287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee01045e0 msgr2=0x7faee0100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:43.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.049+0000 7faee58a1640 1 --2- 172.21.15.79:0/2740844287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee01045e0 0x7faee0100710 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7faed4009930 tx=0x7faed402a420 comp rx=0 tx=0).stop 2024-08-20T01:50:43.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.049+0000 7faee58a1640 1 -- 172.21.15.79:0/2740844287 shutdown_connections 2024-08-20T01:50:43.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.049+0000 7faee58a1640 1 --2- 172.21.15.79:0/2740844287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faee0100e30 0x7faee010ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.049+0000 7faee58a1640 1 --2- 172.21.15.79:0/2740844287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee01045e0 0x7faee0100710 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.051 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.049+0000 7faee58a1640 1 --2- 172.21.15.79:0/2740844287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faee0103ca0 0x7faee01040a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.052 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.049+0000 7faee58a1640 1 -- 172.21.15.79:0/2740844287 >> 172.21.15.79:0/2740844287 conn(0x7faee00fc580 msgr2=0x7faee00fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:43.052 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.049+0000 7faee58a1640 1 -- 172.21.15.79:0/2740844287 shutdown_connections 2024-08-20T01:50:43.052 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.049+0000 7faee58a1640 1 -- 172.21.15.79:0/2740844287 wait complete. 2024-08-20T01:50:43.052 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.049+0000 7faee58a1640 1 Processor -- start 2024-08-20T01:50:43.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.050+0000 7faee58a1640 1 -- start start 2024-08-20T01:50:43.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.050+0000 7faee58a1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee0100e30 0x7faee01989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:43.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.050+0000 7faee58a1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faee0103ca0 0x7faee0199020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:43.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.050+0000 7faee58a1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faee01045e0 0x7faee0199c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:43.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.050+0000 7faee58a1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7faee010e190 con 0x7faee0100e30 2024-08-20T01:50:43.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.050+0000 7faee58a1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faee010e010 con 0x7faee0103ca0 2024-08-20T01:50:43.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.050+0000 7faee58a1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faee010e310 con 0x7faee01045e0 2024-08-20T01:50:43.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.050+0000 7faedeffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee0100e30 0x7faee01989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:43.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.050+0000 7faedeffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee0100e30 0x7faee01989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41408/0 (socket says 172.21.15.79:41408) 2024-08-20T01:50:43.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.050+0000 7faedeffd640 1 -- 172.21.15.79:0/2787938767 learned_addr learned my addr 172.21.15.79:0/2787938767 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:43.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.050+0000 7faede7fc640 1 --2- 172.21.15.79:0/2787938767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faee0103ca0 0x7faee0199020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:43.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.050+0000 7faedf7fe640 1 --2- 172.21.15.79:0/2787938767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faee01045e0 0x7faee0199c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:43.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.050+0000 7faedeffd640 1 -- 172.21.15.79:0/2787938767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faee01045e0 msgr2=0x7faee0199c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:43.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.050+0000 7faedeffd640 1 --2- 172.21.15.79:0/2787938767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faee01045e0 0x7faee0199c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.050+0000 7faedeffd640 1 -- 172.21.15.79:0/2787938767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faee0103ca0 msgr2=0x7faee0199020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:43.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.050+0000 7faedeffd640 1 --2- 172.21.15.79:0/2787938767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faee0103ca0 0x7faee0199020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.050+0000 7faedeffd640 1 -- 172.21.15.79:0/2787938767 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee019a510 con 0x7faee0100e30 2024-08-20T01:50:43.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.051+0000 7faedeffd640 1 --2- 172.21.15.79:0/2787938767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee0100e30 0x7faee01989d0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7faed000d770 tx=0x7faed000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:43.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.051+0000 7faee489f640 1 -- 172.21.15.79:0/2787938767 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed0017070 con 0x7faee0100e30 2024-08-20T01:50:43.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.051+0000 7faee489f640 1 -- 172.21.15.79:0/2787938767 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faed00054b0 con 0x7faee0100e30 2024-08-20T01:50:43.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.051+0000 7faee489f640 1 -- 172.21.15.79:0/2787938767 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed0004c60 con 0x7faee0100e30 2024-08-20T01:50:43.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.051+0000 7faee58a1640 1 -- 172.21.15.79:0/2787938767 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faee019a800 con 0x7faee0100e30 2024-08-20T01:50:43.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.051+0000 7faee58a1640 1 -- 172.21.15.79:0/2787938767 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faee01a0ed0 con 0x7faee0100e30 2024-08-20T01:50:43.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.054+0000 7faee868e740 1 Processor -- start 2024-08-20T01:50:43.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.054+0000 7faee868e740 1 -- start start 2024-08-20T01:50:43.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.054+0000 7faee868e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56009f244630 0x56009f246a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:43.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.054+0000 7faee868e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56009f246f60 0x56009f249350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:43.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.054+0000 7faee868e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56009f2499a0 0x56009f24be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:43.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.054+0000 7faee868e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56009f1b7360 con 0x56009f246f60 2024-08-20T01:50:43.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.054+0000 7faee868e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56009f1a6860 con 0x56009f244630 2024-08-20T01:50:43.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.054+0000 7faee868e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56009f1aa8a0 con 0x56009f2499a0 2024-08-20T01:50:43.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.054+0000 7faee489f640 1 -- 172.21.15.79:0/2787938767 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7faed0004e00 con 0x7faee0100e30 2024-08-20T01:50:43.062 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.054+0000 7faedf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56009f244630 0x56009f246a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:43.063 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.054+0000 7faedf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56009f244630 0x56009f246a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:39200/0 (socket says 172.21.15.79:39200) 2024-08-20T01:50:43.063 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.054+0000 7faedf7fe640 1 -- 172.21.15.79:0/4256847235 learned_addr learned my addr 172.21.15.79:0/4256847235 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:43.063 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.054+0000 7faede7fc640 1 --2- 172.21.15.79:0/4256847235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56009f2499a0 0x56009f24be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:43.063 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.054+0000 7faedeffd640 1 --2- 172.21.15.79:0/4256847235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56009f246f60 0x56009f249350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:43.063 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.055+0000 7faedf7fe640 1 -- 172.21.15.79:0/4256847235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56009f2499a0 msgr2=0x56009f24be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:43.063 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.055+0000 7faedf7fe640 1 --2- 172.21.15.79:0/4256847235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56009f2499a0 0x56009f24be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.063 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.055+0000 7faedf7fe640 1 -- 172.21.15.79:0/4256847235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56009f246f60 msgr2=0x56009f249350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:43.063 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.055+0000 7faedf7fe640 1 --2- 172.21.15.79:0/4256847235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56009f246f60 0x56009f249350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.063 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.055+0000 7faedf7fe640 1 -- 172.21.15.79:0/4256847235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56009f14de40 con 0x56009f244630 2024-08-20T01:50:43.063 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.055+0000 7faedf7fe640 1 --2- 172.21.15.79:0/4256847235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56009f244630 0x56009f246a20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7faed8009f80 tx=0x7faed8010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=240b16db97e79638 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:43.063 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.055+0000 7faec5ffb640 1 -- 172.21.15.79:0/4256847235 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed8003b70 con 0x56009f244630 2024-08-20T01:50:43.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.055+0000 7faee489f640 1 --2- 172.21.15.79:0/2787938767 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7faec80b3c50 0x7faec80b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:43.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.055+0000 7faec5ffb640 1 -- 172.21.15.79:0/4256847235 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faed8003d10 con 0x56009f244630 2024-08-20T01:50:43.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.055+0000 7faec5ffb640 1 -- 172.21.15.79:0/4256847235 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed8011980 con 0x56009f244630 2024-08-20T01:50:43.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.055+0000 7faedeffd640 1 --2- 172.21.15.79:0/2787938767 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7faec80b3c50 0x7faec80b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:43.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.055+0000 7faee489f640 1 -- 172.21.15.79:0/2787938767 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7faed00e35d0 con 0x7faee0100e30 2024-08-20T01:50:43.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.056+0000 7faee868e740 1 -- 172.21.15.79:0/4256847235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56009f244630 msgr2=0x56009f246a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:43.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.056+0000 7faedeffd640 1 --2- 172.21.15.79:0/2787938767 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7faec80b3c50 0x7faec80b6110 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7faed00aa4c0 tx=0x7faed00b3040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:43.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.056+0000 7faee868e740 1 --2- 172.21.15.79:0/4256847235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56009f244630 0x56009f246a20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7faed8009f80 tx=0x7faed8010860 comp rx=0 tx=0).stop 2024-08-20T01:50:43.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.056+0000 7faee868e740 1 -- 172.21.15.79:0/4256847235 shutdown_connections 2024-08-20T01:50:43.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.056+0000 7faee868e740 1 --2- 172.21.15.79:0/4256847235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56009f2499a0 0x56009f24be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.056+0000 7faee868e740 1 --2- 172.21.15.79:0/4256847235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56009f246f60 0x56009f249350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.064 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.056+0000 7faee868e740 1 --2- 172.21.15.79:0/4256847235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56009f244630 0x56009f246a20 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.065 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.056+0000 7faee868e740 1 -- 172.21.15.79:0/4256847235 >> 172.21.15.79:0/4256847235 conn(0x56009f23f730 msgr2=0x56009f240510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:43.065 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.056+0000 7faee868e740 1 -- 172.21.15.79:0/4256847235 shutdown_connections 2024-08-20T01:50:43.065 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.056+0000 7faee868e740 1 -- 172.21.15.79:0/4256847235 wait complete. 2024-08-20T01:50:43.065 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.056+0000 7faee868e740 1 -- start start 2024-08-20T01:50:43.065 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.057+0000 7faee868e740 1 Processor -- start 2024-08-20T01:50:43.065 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.057+0000 7faee868e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56009f244630 0x56009f24de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:43.065 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.057+0000 7faee868e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56009f246f60 0x56009f24e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:43.065 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.057+0000 7faee868e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56009f2499a0 0x56009f24f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:43.065 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.057+0000 7faee868e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56009f0dfab0 con 0x56009f2499a0 2024-08-20T01:50:43.065 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.057+0000 7faee868e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56009f12d780 con 0x56009f244630 2024-08-20T01:50:43.065 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.057+0000 7faee868e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56009f24c980 con 0x56009f246f60 2024-08-20T01:50:43.065 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.057+0000 7faee868e740 10 client.0 _ll_register_callbacks cb 0x56009eeb5a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:50:43.066 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.057+0000 7faedf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56009f244630 0x56009f24de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:43.066 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.057+0000 7faedf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56009f244630 0x56009f24de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:39214/0 (socket says 172.21.15.79:39214) 2024-08-20T01:50:43.066 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.057+0000 7faedf7fe640 1 -- 172.21.15.79:0/2631854555 learned_addr learned my addr 172.21.15.79:0/2631854555 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:43.066 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.057+0000 7faedf7fe640 1 --2- 172.21.15.79:0/2631854555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56009f2499a0 0x56009f24f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:43.066 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.057+0000 7faede7fc640 1 --2- 172.21.15.79:0/2631854555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56009f246f60 0x56009f24e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:43.066 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.057+0000 7faedf7fe640 1 -- 172.21.15.79:0/2631854555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56009f246f60 msgr2=0x56009f24e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:43.066 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.057+0000 7faedf7fe640 1 --2- 172.21.15.79:0/2631854555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56009f246f60 0x56009f24e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.066 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.057+0000 7faedf7fe640 1 -- 172.21.15.79:0/2631854555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56009f2499a0 msgr2=0x56009f24f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:43.066 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.057+0000 7faedf7fe640 1 --2- 172.21.15.79:0/2631854555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56009f2499a0 0x56009f24f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.066 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.057+0000 7faedf7fe640 1 -- 172.21.15.79:0/2631854555 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56009ef09790 con 0x56009f244630 2024-08-20T01:50:43.067 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.058+0000 7faedf7fe640 1 --2- 172.21.15.79:0/2631854555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56009f244630 0x56009f24de30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7faed80099f0 tx=0x7faed8000f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16e2e4ed38bc0e48 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:43.067 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.058+0000 7faebeffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:50:43.067 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.058+0000 7faebeffd640 1 -- 172.21.15.79:0/2631854555 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed8025040 con 0x56009f244630 2024-08-20T01:50:43.067 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.058+0000 7faebeffd640 1 -- 172.21.15.79:0/2631854555 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7faed80045c0 con 0x56009f244630 2024-08-20T01:50:43.067 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.058+0000 7faee868e740 1 -- 172.21.15.79:0/2631854555 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56009f155e00 con 0x56009f244630 2024-08-20T01:50:43.067 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.058+0000 7faebeffd640 1 -- 172.21.15.79:0/2631854555 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7faed8033050 con 0x56009f244630 2024-08-20T01:50:43.067 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.058+0000 7faee868e740 10 client.27929 fetch_fsmap learned FSMap version 53 2024-08-20T01:50:43.067 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.058+0000 7faee868e740 1 -- 172.21.15.79:0/2631854555 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x56009ef82620 con 0x56009f244630 2024-08-20T01:50:43.067 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.058+0000 7faebeffd640 1 -- 172.21.15.79:0/2631854555 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56009f155e00 con 0x56009f244630 2024-08-20T01:50:43.067 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.058+0000 7faebeffd640 1 -- 172.21.15.79:0/2631854555 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 53) ==== 8378+0+0 (secure 0 0 0) 0x7faed802c580 con 0x56009f244630 2024-08-20T01:50:43.067 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.058+0000 7faee868e740 10 client.27929 fetch_fsmap finished waiting for FSMap version 53 2024-08-20T01:50:43.067 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.058+0000 7faee868e740 10 client.27929 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:50:43.067 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.058+0000 7faee868e740 20 client.27929 populate_metadata read hostname 'smithi079' 2024-08-20T01:50:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.058+0000 7faee868e740 1 --2- 172.21.15.79:0/2631854555 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56009f259460 0x56009f25b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.058+0000 7faee868e740 4 client.27929 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:50:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.058+0000 7faee868e740 1 -- 172.21.15.79:0/2631854555 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56009f1b92b0 con 0x56009f259460 2024-08-20T01:50:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.059+0000 7faede7fc640 1 --2- 172.21.15.79:0/2631854555 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56009f259460 0x56009f25b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.059+0000 7faebeffd640 10 client.27929 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.059+0000 7faede7fc640 1 --2- 172.21.15.79:0/2631854555 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56009f259460 0x56009f25b850 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e321a8a6e10baebe server_cookie=b2fc8da7f980af59 in_seq=0 out_seq=0 2024-08-20T01:50:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.060+0000 7faebeffd640 1 -- 172.21.15.79:0/2631854555 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56009f1b92b0 con 0x56009f259460 2024-08-20T01:50:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.060+0000 7faebeffd640 10 client.27929 handle_command_reply: tid=0 2024-08-20T01:50:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.060+0000 7faee868e740 1 client.27929 shutdown 2024-08-20T01:50:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.060+0000 7faee868e740 1 -- 172.21.15.79:0/2631854555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56009f244630 msgr2=0x56009f24de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.060+0000 7faee868e740 1 --2- 172.21.15.79:0/2631854555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56009f244630 0x56009f24de30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7faed80099f0 tx=0x7faed8000f40 comp rx=0 tx=0).stop 2024-08-20T01:50:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.060+0000 7faee868e740 1 -- 172.21.15.79:0/2631854555 shutdown_connections 2024-08-20T01:50:43.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.060+0000 7faee868e740 1 --2- 172.21.15.79:0/2631854555 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56009f259460 0x56009f25b850 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.060+0000 7faee868e740 1 --2- 172.21.15.79:0/2631854555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56009f2499a0 0x56009f24f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.060+0000 7faee868e740 1 --2- 172.21.15.79:0/2631854555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56009f246f60 0x56009f24e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.060+0000 7faebeffd640 0 client.27929 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:43.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.060+0000 7faee868e740 1 --2- 172.21.15.79:0/2631854555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56009f244630 0x56009f24de30 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.060+0000 7faee868e740 1 -- 172.21.15.79:0/2631854555 >> 172.21.15.79:0/2631854555 conn(0x56009f23f730 msgr2=0x56009f23e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:43.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.060+0000 7faee868e740 1 -- 172.21.15.79:0/2631854555 shutdown_connections 2024-08-20T01:50:43.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.060+0000 7faee868e740 1 -- 172.21.15.79:0/2631854555 wait complete. 2024-08-20T01:50:43.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.060+0000 7faee868e740 20 client.27929 trim_cache size 0 max 16384 2024-08-20T01:50:43.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.075+0000 7faee868e740 1 Processor -- start 2024-08-20T01:50:43.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.075+0000 7faee868e740 1 -- start start 2024-08-20T01:50:43.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.075+0000 7faee868e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56009f244630 0x56009f23e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:43.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.075+0000 7faee868e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56009f246f60 0x56009f260150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:43.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.075+0000 7faee868e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56009f2499a0 0x56009f260690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:43.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.075+0000 7faee868e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7faee01a9b10 con 0x56009f2499a0 2024-08-20T01:50:43.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.075+0000 7faee868e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faee01ab710 con 0x56009f246f60 2024-08-20T01:50:43.078 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.075+0000 7faee868e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faee01aa2a0 con 0x56009f244630 2024-08-20T01:50:43.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.075+0000 7faedf7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56009f2499a0 0x56009f260690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:43.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.075+0000 7faedf7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56009f2499a0 0x56009f260690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41436/0 (socket says 172.21.15.79:41436) 2024-08-20T01:50:43.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.075+0000 7faedf7fe640 1 -- 172.21.15.79:0/3199815403 learned_addr learned my addr 172.21.15.79:0/3199815403 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:43.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.075+0000 7faedf7fe640 1 --2- 172.21.15.79:0/3199815403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56009f244630 0x56009f23e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:43.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.075+0000 7faede7fc640 1 --2- 172.21.15.79:0/3199815403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56009f246f60 0x56009f260150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:43.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.076+0000 7faedf7fe640 1 -- 172.21.15.79:0/3199815403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56009f244630 msgr2=0x56009f23e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:43.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.076+0000 7faedf7fe640 1 --2- 172.21.15.79:0/3199815403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56009f244630 0x56009f23e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.076+0000 7faedf7fe640 1 -- 172.21.15.79:0/3199815403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56009f246f60 msgr2=0x56009f260150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:43.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.076+0000 7faedf7fe640 1 --2- 172.21.15.79:0/3199815403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56009f246f60 0x56009f260150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.076+0000 7faedf7fe640 1 -- 172.21.15.79:0/3199815403 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56009f25bbc0 con 0x56009f2499a0 2024-08-20T01:50:43.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.076+0000 7faedf7fe640 1 --2- 172.21.15.79:0/3199815403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56009f2499a0 0x56009f260690 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7faed8003ea0 tx=0x7faed8010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf566443844a991d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:43.079 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.076+0000 7faec57fa640 1 -- 172.21.15.79:0/3199815403 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed8009c00 con 0x56009f2499a0 2024-08-20T01:50:43.080 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.076+0000 7faec57fa640 1 -- 172.21.15.79:0/3199815403 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faed8005430 con 0x56009f2499a0 2024-08-20T01:50:43.080 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.076+0000 7faec57fa640 1 -- 172.21.15.79:0/3199815403 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed80119d0 con 0x56009f2499a0 2024-08-20T01:50:43.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.077+0000 7faee868e740 1 -- 172.21.15.79:0/3199815403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56009f2499a0 msgr2=0x56009f260690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:43.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.077+0000 7faee868e740 1 --2- 172.21.15.79:0/3199815403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56009f2499a0 0x56009f260690 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7faed8003ea0 tx=0x7faed8010860 comp rx=0 tx=0).stop 2024-08-20T01:50:43.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.077+0000 7faee868e740 1 -- 172.21.15.79:0/3199815403 shutdown_connections 2024-08-20T01:50:43.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.077+0000 7faee868e740 1 --2- 172.21.15.79:0/3199815403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56009f2499a0 0x56009f260690 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.077+0000 7faee868e740 1 --2- 172.21.15.79:0/3199815403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56009f246f60 0x56009f260150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.077+0000 7faee868e740 1 --2- 172.21.15.79:0/3199815403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56009f244630 0x56009f23e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.077+0000 7faee868e740 1 -- 172.21.15.79:0/3199815403 >> 172.21.15.79:0/3199815403 conn(0x56009f23f730 msgr2=0x56009f23e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:43.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.077+0000 7faee868e740 1 -- 172.21.15.79:0/3199815403 shutdown_connections 2024-08-20T01:50:43.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.077+0000 7faee868e740 1 -- 172.21.15.79:0/3199815403 wait complete. 2024-08-20T01:50:43.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.077+0000 7faee868e740 1 -- start start 2024-08-20T01:50:43.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.077+0000 7faee868e740 1 Processor -- start 2024-08-20T01:50:43.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.078+0000 7faee868e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56009f244630 0x56009f252da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:43.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.078+0000 7faee868e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56009f246f60 0x56009f253440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:43.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.078+0000 7faee868e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56009f2499a0 0x56009f254010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:43.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.078+0000 7faee868e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7faee01ab040 con 0x56009f2499a0 2024-08-20T01:50:43.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.078+0000 7faee868e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faee01aa970 con 0x56009f244630 2024-08-20T01:50:43.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.078+0000 7faee868e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faee01a7af0 con 0x56009f246f60 2024-08-20T01:50:43.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.078+0000 7faee868e740 10 client.0 _ll_register_callbacks cb 0x7faed4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:50:43.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.078+0000 7faedf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56009f244630 0x56009f252da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:43.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.078+0000 7faede7fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56009f246f60 0x56009f253440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:43.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.078+0000 7faedf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56009f244630 0x56009f252da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:39238/0 (socket says 172.21.15.79:39238) 2024-08-20T01:50:43.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.078+0000 7faedf7fe640 1 -- 172.21.15.79:0/3132663122 learned_addr learned my addr 172.21.15.79:0/3132663122 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:43.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.078+0000 7faedf7fe640 1 --2- 172.21.15.79:0/3132663122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56009f2499a0 0x56009f254010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:43.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.078+0000 7faede7fc640 1 -- 172.21.15.79:0/3132663122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56009f244630 msgr2=0x56009f252da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:43.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.078+0000 7faede7fc640 1 --2- 172.21.15.79:0/3132663122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56009f244630 0x56009f252da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.078+0000 7faede7fc640 1 -- 172.21.15.79:0/3132663122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56009f2499a0 msgr2=0x56009f254010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:43.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.078+0000 7faede7fc640 1 --2- 172.21.15.79:0/3132663122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56009f2499a0 0x56009f254010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.078+0000 7faede7fc640 1 -- 172.21.15.79:0/3132663122 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56009f24f410 con 0x56009f246f60 2024-08-20T01:50:43.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.079+0000 7faede7fc640 1 --2- 172.21.15.79:0/3132663122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56009f246f60 0x56009f253440 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7faed402a940 tx=0x7faed4004340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51b1c50f953b3f60 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:43.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.079+0000 7faebeffd640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:50:43.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.079+0000 7faebeffd640 1 -- 172.21.15.79:0/3132663122 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed4035040 con 0x56009f246f60 2024-08-20T01:50:43.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.079+0000 7faebeffd640 1 -- 172.21.15.79:0/3132663122 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7faed4031980 con 0x56009f246f60 2024-08-20T01:50:43.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.079+0000 7faee868e740 1 -- 172.21.15.79:0/3132663122 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faed8005430 con 0x56009f246f60 2024-08-20T01:50:43.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.079+0000 7faebeffd640 1 -- 172.21.15.79:0/3132663122 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7faed4055050 con 0x56009f246f60 2024-08-20T01:50:43.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.079+0000 7faee868e740 10 client.27862 fetch_fsmap learned FSMap version 53 2024-08-20T01:50:43.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.079+0000 7faee868e740 1 -- 172.21.15.79:0/3132663122 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x56009f255b00 con 0x56009f246f60 2024-08-20T01:50:43.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.079+0000 7faebeffd640 1 -- 172.21.15.79:0/3132663122 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faed4031b80 con 0x56009f246f60 2024-08-20T01:50:43.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.080+0000 7faebeffd640 1 -- 172.21.15.79:0/3132663122 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 53) ==== 8378+0+0 (secure 0 0 0) 0x7faed4051500 con 0x56009f246f60 2024-08-20T01:50:43.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.080+0000 7faee868e740 10 client.27862 fetch_fsmap finished waiting for FSMap version 53 2024-08-20T01:50:43.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.080+0000 7faee868e740 10 client.27862 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:50:43.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.080+0000 7faee868e740 20 client.27862 populate_metadata read hostname 'smithi079' 2024-08-20T01:50:43.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.080+0000 7faee868e740 1 --2- 172.21.15.79:0/3132663122 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56009f2c4470 0x56009f2c6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:43.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.080+0000 7faee868e740 4 client.27862 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:50:43.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.080+0000 7faee868e740 1 -- 172.21.15.79:0/3132663122 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7faed8005430 con 0x56009f2c4470 2024-08-20T01:50:43.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.080+0000 7faedf7fe640 1 --2- 172.21.15.79:0/3132663122 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56009f2c4470 0x56009f2c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:43.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.081+0000 7faedf7fe640 1 --2- 172.21.15.79:0/3132663122 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56009f2c4470 0x56009f2c6890 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=125706e0d5ad7481 server_cookie=dacd95de73219ebe in_seq=0 out_seq=0 2024-08-20T01:50:43.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.081+0000 7faebeffd640 10 client.27862 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:43.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.088+0000 7faebeffd640 1 -- 172.21.15.79:0/3132663122 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7faed8005430 con 0x56009f2c4470 2024-08-20T01:50:43.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.088+0000 7faebeffd640 10 client.27862 handle_command_reply: tid=0 2024-08-20T01:50:43.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.088+0000 7faee868e740 1 client.27862 shutdown 2024-08-20T01:50:43.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.089+0000 7faee868e740 1 -- 172.21.15.79:0/3132663122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56009f246f60 msgr2=0x56009f253440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:43.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.089+0000 7faee868e740 1 --2- 172.21.15.79:0/3132663122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56009f246f60 0x56009f253440 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7faed402a940 tx=0x7faed4004340 comp rx=0 tx=0).stop 2024-08-20T01:50:43.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.089+0000 7faee868e740 1 -- 172.21.15.79:0/3132663122 shutdown_connections 2024-08-20T01:50:43.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.089+0000 7faee868e740 1 --2- 172.21.15.79:0/3132663122 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56009f2c4470 0x56009f2c6890 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.089+0000 7faee868e740 1 --2- 172.21.15.79:0/3132663122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56009f2499a0 0x56009f254010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.091 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.089+0000 7faebeffd640 0 client.27862 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:43.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.089+0000 7faee868e740 1 --2- 172.21.15.79:0/3132663122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56009f246f60 0x56009f253440 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.089+0000 7faee868e740 1 --2- 172.21.15.79:0/3132663122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56009f244630 0x56009f252da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.089+0000 7faee868e740 1 -- 172.21.15.79:0/3132663122 >> 172.21.15.79:0/3132663122 conn(0x56009f23f730 msgr2=0x56009f23e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:43.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.089+0000 7faee868e740 1 -- 172.21.15.79:0/3132663122 shutdown_connections 2024-08-20T01:50:43.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.089+0000 7faee868e740 1 -- 172.21.15.79:0/3132663122 wait complete. 2024-08-20T01:50:43.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.089+0000 7faee868e740 20 client.27862 trim_cache size 0 max 16384 2024-08-20T01:50:43.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:50:43.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:50:43.092 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:50:43.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:50:43.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.089+0000 7faee58a1640 1 -- 172.21.15.79:0/2787938767 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7faec80b3c50 msgr2=0x7faec80b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:43.093 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.089+0000 7faee58a1640 1 --2- 172.21.15.79:0/2787938767 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7faec80b3c50 0x7faec80b6110 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7faed00aa4c0 tx=0x7faed00b3040 comp rx=0 tx=0).stop 2024-08-20T01:50:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.089+0000 7faee58a1640 1 -- 172.21.15.79:0/2787938767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee0100e30 msgr2=0x7faee01989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.089+0000 7faee58a1640 1 --2- 172.21.15.79:0/2787938767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee0100e30 0x7faee01989d0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7faed000d770 tx=0x7faed000dc30 comp rx=0 tx=0).stop 2024-08-20T01:50:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.090+0000 7faee58a1640 1 -- 172.21.15.79:0/2787938767 shutdown_connections 2024-08-20T01:50:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.090+0000 7faee58a1640 1 --2- 172.21.15.79:0/2787938767 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7faec80b3c50 0x7faec80b6110 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.090+0000 7faee58a1640 1 --2- 172.21.15.79:0/2787938767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faee01045e0 0x7faee0199c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.090+0000 7faee58a1640 1 --2- 172.21.15.79:0/2787938767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faee0103ca0 0x7faee0199020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.090+0000 7faee58a1640 1 --2- 172.21.15.79:0/2787938767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee0100e30 0x7faee01989d0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.090+0000 7faee58a1640 1 -- 172.21.15.79:0/2787938767 >> 172.21.15.79:0/2787938767 conn(0x7faee00fc580 msgr2=0x7faee0106db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.090+0000 7faee58a1640 1 -- 172.21.15.79:0/2787938767 shutdown_connections 2024-08-20T01:50:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:43.090+0000 7faee58a1640 1 -- 172.21.15.79:0/2787938767 wait complete. 2024-08-20T01:50:43.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.229+0000 7f9245a5d640 1 -- 172.21.15.79:0/530079026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92401084e0 msgr2=0x7f9240108920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:43.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.229+0000 7f9245a5d640 1 --2- 172.21.15.79:0/530079026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92401084e0 0x7f9240108920 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f9234009900 tx=0x7f923402a410 comp rx=0 tx=0).stop 2024-08-20T01:50:43.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.229+0000 7f9245a5d640 1 -- 172.21.15.79:0/530079026 shutdown_connections 2024-08-20T01:50:43.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.229+0000 7f9245a5d640 1 --2- 172.21.15.79:0/530079026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9240108e60 0x7f924010f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.229+0000 7f9245a5d640 1 --2- 172.21.15.79:0/530079026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92401084e0 0x7f9240108920 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.229+0000 7f9245a5d640 1 --2- 172.21.15.79:0/530079026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9240102ad0 0x7f9240102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.229+0000 7f9245a5d640 1 -- 172.21.15.79:0/530079026 >> 172.21.15.79:0/530079026 conn(0x7f92400fe540 msgr2=0x7f9240100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:43.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.229+0000 7f9245a5d640 1 -- 172.21.15.79:0/530079026 shutdown_connections 2024-08-20T01:50:43.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.229+0000 7f9245a5d640 1 -- 172.21.15.79:0/530079026 wait complete. 2024-08-20T01:50:43.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.229+0000 7f9245a5d640 1 Processor -- start 2024-08-20T01:50:43.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.230+0000 7f9245a5d640 1 -- start start 2024-08-20T01:50:43.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.230+0000 7f9245a5d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9240102ad0 0x7f9240198f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:43.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.230+0000 7f9245a5d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92401084e0 0x7f9240199490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:43.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.230+0000 7f9245a5d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9240108e60 0x7f924019e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:43.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.230+0000 7f9245a5d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9240112960 con 0x7f9240102ad0 2024-08-20T01:50:43.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.230+0000 7f9245a5d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f92401127e0 con 0x7f92401084e0 2024-08-20T01:50:43.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.230+0000 7f9245a5d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9240112ae0 con 0x7f9240108e60 2024-08-20T01:50:43.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.230+0000 7f923effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9240102ad0 0x7f9240198f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:43.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.230+0000 7f923f7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9240108e60 0x7f924019e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:43.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.230+0000 7f923f7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9240108e60 0x7f924019e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:53266/0 (socket says 172.21.15.79:53266) 2024-08-20T01:50:43.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.230+0000 7f923effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9240102ad0 0x7f9240198f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41474/0 (socket says 172.21.15.79:41474) 2024-08-20T01:50:43.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.230+0000 7f923f7fe640 1 -- 172.21.15.79:0/3593827143 learned_addr learned my addr 172.21.15.79:0/3593827143 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:43.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.230+0000 7f923e7fc640 1 --2- 172.21.15.79:0/3593827143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92401084e0 0x7f9240199490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:43.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.230+0000 7f923f7fe640 1 -- 172.21.15.79:0/3593827143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92401084e0 msgr2=0x7f9240199490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:43.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.230+0000 7f923f7fe640 1 --2- 172.21.15.79:0/3593827143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92401084e0 0x7f9240199490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.230+0000 7f923f7fe640 1 -- 172.21.15.79:0/3593827143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9240102ad0 msgr2=0x7f9240198f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:43.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.230+0000 7f923f7fe640 1 --2- 172.21.15.79:0/3593827143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9240102ad0 0x7f9240198f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.230+0000 7f923f7fe640 1 -- 172.21.15.79:0/3593827143 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f924019f000 con 0x7f9240108e60 2024-08-20T01:50:43.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.230+0000 7f923effd640 1 --2- 172.21.15.79:0/3593827143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9240102ad0 0x7f9240198f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:50:43.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.230+0000 7f923e7fc640 1 --2- 172.21.15.79:0/3593827143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92401084e0 0x7f9240199490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:50:43.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.231+0000 7f923f7fe640 1 --2- 172.21.15.79:0/3593827143 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9240108e60 0x7f924019e830 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f923800eaa0 tx=0x7f923800ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:43.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.231+0000 7f9244a5b640 1 -- 172.21.15.79:0/3593827143 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f923800cdb0 con 0x7f9240108e60 2024-08-20T01:50:43.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.231+0000 7f9244a5b640 1 -- 172.21.15.79:0/3593827143 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9238005020 con 0x7f9240108e60 2024-08-20T01:50:43.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.231+0000 7f9245a5d640 1 -- 172.21.15.79:0/3593827143 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f924019f2f0 con 0x7f9240108e60 2024-08-20T01:50:43.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.231+0000 7f9244a5b640 1 -- 172.21.15.79:0/3593827143 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92380116d0 con 0x7f9240108e60 2024-08-20T01:50:43.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.231+0000 7f9245a5d640 1 -- 172.21.15.79:0/3593827143 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92401a59b0 con 0x7f9240108e60 2024-08-20T01:50:43.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.233+0000 7f9247e56740 1 Processor -- start 2024-08-20T01:50:43.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.234+0000 7f9244a5b640 1 -- 172.21.15.79:0/3593827143 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f92380051d0 con 0x7f9240108e60 2024-08-20T01:50:43.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.234+0000 7f9247e56740 1 -- start start 2024-08-20T01:50:43.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.234+0000 7f9247e56740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a707c36880 0x55a707c36c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:43.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.234+0000 7f9247e56740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a707c371a0 0x55a707c42bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:43.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.234+0000 7f9247e56740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a707c43130 0x55a707c45520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:43.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.234+0000 7f9247e56740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a707bad930 con 0x55a707c43130 2024-08-20T01:50:43.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.234+0000 7f9247e56740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a707b9ce30 con 0x55a707c371a0 2024-08-20T01:50:43.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.234+0000 7f9247e56740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a707ba0e70 con 0x55a707c36880 2024-08-20T01:50:43.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.234+0000 7f923e7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a707c43130 0x55a707c45520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:43.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.234+0000 7f923e7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a707c43130 0x55a707c45520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41488/0 (socket says 172.21.15.79:41488) 2024-08-20T01:50:43.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.234+0000 7f923e7fc640 1 -- 172.21.15.79:0/1101469737 learned_addr learned my addr 172.21.15.79:0/1101469737 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:43.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.234+0000 7f923e7fc640 1 --2- 172.21.15.79:0/1101469737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a707c36880 0x55a707c36c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:43.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.234+0000 7f923effd640 1 --2- 172.21.15.79:0/1101469737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a707c371a0 0x55a707c42bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:43.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.235+0000 7f923e7fc640 1 -- 172.21.15.79:0/1101469737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a707c36880 msgr2=0x55a707c36c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:43.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.235+0000 7f923e7fc640 1 --2- 172.21.15.79:0/1101469737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a707c36880 0x55a707c36c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.235+0000 7f923e7fc640 1 -- 172.21.15.79:0/1101469737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a707c371a0 msgr2=0x55a707c42bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:43.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.235+0000 7f923e7fc640 1 --2- 172.21.15.79:0/1101469737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a707c371a0 0x55a707c42bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.235+0000 7f923e7fc640 1 -- 172.21.15.79:0/1101469737 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7078fc650 con 0x55a707c43130 2024-08-20T01:50:43.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.235+0000 7f9244a5b640 1 --2- 172.21.15.79:0/3593827143 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f92280b3bd0 0x7f92280b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:43.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.235+0000 7f923e7fc640 1 --2- 172.21.15.79:0/1101469737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a707c43130 0x55a707c45520 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f9234000c00 tx=0x7f9234005e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98eb52c49f632459 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:43.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.235+0000 7f923effd640 1 --2- 172.21.15.79:0/3593827143 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f92280b3bd0 0x7f92280b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:43.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.235+0000 7f9244a5b640 1 -- 172.21.15.79:0/3593827143 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f92380e3cf0 con 0x7f9240108e60 2024-08-20T01:50:43.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.235+0000 7f9225ffb640 1 -- 172.21.15.79:0/1101469737 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9234035040 con 0x55a707c43130 2024-08-20T01:50:43.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.235+0000 7f9225ffb640 1 -- 172.21.15.79:0/1101469737 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f92340044c0 con 0x55a707c43130 2024-08-20T01:50:43.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.235+0000 7f9225ffb640 1 -- 172.21.15.79:0/1101469737 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9234003d50 con 0x55a707c43130 2024-08-20T01:50:43.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.236+0000 7f9247e56740 1 -- 172.21.15.79:0/1101469737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a707c43130 msgr2=0x55a707c45520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:43.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.236+0000 7f923effd640 1 --2- 172.21.15.79:0/3593827143 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f92280b3bd0 0x7f92280b6090 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x55a707c39a00 tx=0x7f9230005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:43.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.236+0000 7f9247e56740 1 --2- 172.21.15.79:0/1101469737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a707c43130 0x55a707c45520 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f9234000c00 tx=0x7f9234005e10 comp rx=0 tx=0).stop 2024-08-20T01:50:43.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.236+0000 7f9247e56740 1 -- 172.21.15.79:0/1101469737 shutdown_connections 2024-08-20T01:50:43.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.236+0000 7f9247e56740 1 --2- 172.21.15.79:0/1101469737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a707c43130 0x55a707c45520 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.236+0000 7f9247e56740 1 --2- 172.21.15.79:0/1101469737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a707c371a0 0x55a707c42bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.236+0000 7f9247e56740 1 --2- 172.21.15.79:0/1101469737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a707c36880 0x55a707c36c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.236+0000 7f9247e56740 1 -- 172.21.15.79:0/1101469737 >> 172.21.15.79:0/1101469737 conn(0x55a707c346b0 msgr2=0x55a707c35850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:43.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.236+0000 7f9247e56740 1 -- 172.21.15.79:0/1101469737 shutdown_connections 2024-08-20T01:50:43.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.236+0000 7f9247e56740 1 -- 172.21.15.79:0/1101469737 wait complete. 2024-08-20T01:50:43.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.236+0000 7f9247e56740 1 -- start start 2024-08-20T01:50:43.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.237+0000 7f9247e56740 1 Processor -- start 2024-08-20T01:50:43.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.237+0000 7f9247e56740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a707c36880 0x55a707c400b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:43.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.237+0000 7f9247e56740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a707c371a0 0x55a707c405f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:43.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.237+0000 7f9247e56740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a707c43130 0x55a707c40b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:43.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.237+0000 7f9247e56740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a7079ff700 con 0x55a707c36880 2024-08-20T01:50:43.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.237+0000 7f9247e56740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a707b23810 con 0x55a707c43130 2024-08-20T01:50:43.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.237+0000 7f9247e56740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a707c45d80 con 0x55a707c371a0 2024-08-20T01:50:43.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.237+0000 7f9247e56740 10 client.0 _ll_register_callbacks cb 0x55a707b96700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:50:43.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.237+0000 7f923effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a707c36880 0x55a707c400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:43.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.237+0000 7f923effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a707c36880 0x55a707c400b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41500/0 (socket says 172.21.15.79:41500) 2024-08-20T01:50:43.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.237+0000 7f923effd640 1 -- 172.21.15.79:0/2008947333 learned_addr learned my addr 172.21.15.79:0/2008947333 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:43.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.237+0000 7f923e7fc640 1 --2- 172.21.15.79:0/2008947333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a707c371a0 0x55a707c405f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:43.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.237+0000 7f923f7fe640 1 --2- 172.21.15.79:0/2008947333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a707c43130 0x55a707c40b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:43.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.237+0000 7f923effd640 1 -- 172.21.15.79:0/2008947333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a707c371a0 msgr2=0x55a707c405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:43.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.237+0000 7f923effd640 1 --2- 172.21.15.79:0/2008947333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a707c371a0 0x55a707c405f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.237+0000 7f923effd640 1 -- 172.21.15.79:0/2008947333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a707c43130 msgr2=0x55a707c40b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:43.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.237+0000 7f923effd640 1 --2- 172.21.15.79:0/2008947333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a707c43130 0x55a707c40b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.237+0000 7f923effd640 1 -- 172.21.15.79:0/2008947333 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a707c4f130 con 0x55a707c36880 2024-08-20T01:50:43.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.237+0000 7f923f7fe640 1 --2- 172.21.15.79:0/2008947333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a707c43130 0x55a707c40b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:50:43.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.238+0000 7f923effd640 1 --2- 172.21.15.79:0/2008947333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a707c36880 0x55a707c400b0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f9230009560 tx=0x7f9230004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd1b42195cb79b29 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:43.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.238+0000 7f921effd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:50:43.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.238+0000 7f921effd640 1 -- 172.21.15.79:0/2008947333 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f923002e060 con 0x55a707c36880 2024-08-20T01:50:43.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.238+0000 7f921effd640 1 -- 172.21.15.79:0/2008947333 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9230018030 con 0x55a707c36880 2024-08-20T01:50:43.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.238+0000 7f9247e56740 1 -- 172.21.15.79:0/2008947333 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a707b4c150 con 0x55a707c36880 2024-08-20T01:50:43.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.238+0000 7f921effd640 1 -- 172.21.15.79:0/2008947333 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f923000fd20 con 0x55a707c36880 2024-08-20T01:50:43.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.238+0000 7f9247e56740 10 client.18828 fetch_fsmap learned FSMap version 53 2024-08-20T01:50:43.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.238+0000 7f9247e56740 1 -- 172.21.15.79:0/2008947333 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x55a707c51b20 con 0x55a707c36880 2024-08-20T01:50:43.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.238+0000 7f921effd640 1 -- 172.21.15.79:0/2008947333 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55a707b4c150 con 0x55a707c36880 2024-08-20T01:50:43.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.238+0000 7f921effd640 1 -- 172.21.15.79:0/2008947333 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 53) ==== 8378+0+0 (secure 0 0 0) 0x7f92300299d0 con 0x55a707c36880 2024-08-20T01:50:43.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.239+0000 7f9247e56740 10 client.18828 fetch_fsmap finished waiting for FSMap version 53 2024-08-20T01:50:43.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.239+0000 7f9247e56740 10 client.18828 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:50:43.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.239+0000 7f9247e56740 20 client.18828 populate_metadata read hostname 'smithi079' 2024-08-20T01:50:43.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.239+0000 7f9247e56740 1 --2- 172.21.15.79:0/2008947333 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55a707c53030 0x55a707c55470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:43.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.239+0000 7f9247e56740 4 client.18828 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:50:43.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.239+0000 7f9247e56740 1 -- 172.21.15.79:0/2008947333 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a707baf880 con 0x55a707c53030 2024-08-20T01:50:43.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.239+0000 7f923e7fc640 1 --2- 172.21.15.79:0/2008947333 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55a707c53030 0x55a707c55470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:43.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.239+0000 7f921effd640 10 client.18828 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:50:43.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.239+0000 7f923e7fc640 1 --2- 172.21.15.79:0/2008947333 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55a707c53030 0x55a707c55470 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1c861426db12272f server_cookie=afa0460bc82f24cf in_seq=0 out_seq=0 2024-08-20T01:50:43.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.240+0000 7f921effd640 1 -- 172.21.15.79:0/2008947333 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a707baf880 con 0x55a707c53030 2024-08-20T01:50:43.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.240+0000 7f921effd640 10 client.18828 handle_command_reply: tid=0 2024-08-20T01:50:43.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.240+0000 7f9247e56740 1 client.18828 shutdown 2024-08-20T01:50:43.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.240+0000 7f9247e56740 1 -- 172.21.15.79:0/2008947333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a707c36880 msgr2=0x55a707c400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:43.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.240+0000 7f9247e56740 1 --2- 172.21.15.79:0/2008947333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a707c36880 0x55a707c400b0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f9230009560 tx=0x7f9230004730 comp rx=0 tx=0).stop 2024-08-20T01:50:43.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.240+0000 7f9247e56740 1 -- 172.21.15.79:0/2008947333 shutdown_connections 2024-08-20T01:50:43.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.240+0000 7f9247e56740 1 --2- 172.21.15.79:0/2008947333 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55a707c53030 0x55a707c55470 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.240+0000 7f9247e56740 1 --2- 172.21.15.79:0/2008947333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a707c43130 0x55a707c40b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.240+0000 7f921effd640 0 client.18828 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:50:43.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.240+0000 7f9247e56740 1 --2- 172.21.15.79:0/2008947333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a707c371a0 0x55a707c405f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.240+0000 7f9247e56740 1 --2- 172.21.15.79:0/2008947333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a707c36880 0x55a707c400b0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.240+0000 7f9247e56740 1 -- 172.21.15.79:0/2008947333 >> 172.21.15.79:0/2008947333 conn(0x55a707c346b0 msgr2=0x55a707c3a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:43.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.240+0000 7f9247e56740 1 -- 172.21.15.79:0/2008947333 shutdown_connections 2024-08-20T01:50:43.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.240+0000 7f9247e56740 1 -- 172.21.15.79:0/2008947333 wait complete. 2024-08-20T01:50:43.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.241+0000 7f9247e56740 20 client.18828 trim_cache size 0 max 16384 2024-08-20T01:50:43.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.255+0000 7f9247e56740 1 Processor -- start 2024-08-20T01:50:43.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.255+0000 7f9247e56740 1 -- start start 2024-08-20T01:50:43.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.255+0000 7f9247e56740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a707c371a0 0x55a707c3aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:43.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.255+0000 7f9247e56740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a707c43130 0x55a707c5ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:43.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.255+0000 7f9247e56740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a707c5b280 0x55a707c32f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:43.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.255+0000 7f9247e56740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f92401ae090 con 0x55a707c5b280 2024-08-20T01:50:43.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.255+0000 7f9247e56740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f92401afc90 con 0x55a707c371a0 2024-08-20T01:50:43.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.255+0000 7f9247e56740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f92401ae820 con 0x55a707c43130 2024-08-20T01:50:43.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.255+0000 7f923f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a707c5b280 0x55a707c32f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:43.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.255+0000 7f923f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a707c5b280 0x55a707c32f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41508/0 (socket says 172.21.15.79:41508) 2024-08-20T01:50:43.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.255+0000 7f923f7fe640 1 -- 172.21.15.79:0/2819875955 learned_addr learned my addr 172.21.15.79:0/2819875955 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:43.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.255+0000 7f923e7fc640 1 --2- 172.21.15.79:0/2819875955 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a707c43130 0x55a707c5ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:43.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.255+0000 7f923effd640 1 --2- 172.21.15.79:0/2819875955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a707c371a0 0x55a707c3aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:43.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.255+0000 7f923f7fe640 1 -- 172.21.15.79:0/2819875955 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a707c43130 msgr2=0x55a707c5ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:43.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.255+0000 7f923f7fe640 1 --2- 172.21.15.79:0/2819875955 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a707c43130 0x55a707c5ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.255+0000 7f923f7fe640 1 -- 172.21.15.79:0/2819875955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a707c371a0 msgr2=0x55a707c3aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:43.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.255+0000 7f923f7fe640 1 --2- 172.21.15.79:0/2819875955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a707c371a0 0x55a707c3aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.255+0000 7f923f7fe640 1 -- 172.21.15.79:0/2819875955 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a707c35130 con 0x55a707c5b280 2024-08-20T01:50:43.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.256+0000 7f923f7fe640 1 --2- 172.21.15.79:0/2819875955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a707c5b280 0x55a707c32f50 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f92380aac30 tx=0x7f92380aab30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a37bbb4f92a0885d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:43.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.256+0000 7f92257fa640 1 -- 172.21.15.79:0/2819875955 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f923801f040 con 0x55a707c5b280 2024-08-20T01:50:43.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.256+0000 7f92257fa640 1 -- 172.21.15.79:0/2819875955 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f92380af1f0 con 0x55a707c5b280 2024-08-20T01:50:43.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.256+0000 7f92257fa640 1 -- 172.21.15.79:0/2819875955 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9238092320 con 0x55a707c5b280 2024-08-20T01:50:43.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.257+0000 7f9247e56740 1 -- 172.21.15.79:0/2819875955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a707c5b280 msgr2=0x55a707c32f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:43.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.257+0000 7f9247e56740 1 --2- 172.21.15.79:0/2819875955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a707c5b280 0x55a707c32f50 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f92380aac30 tx=0x7f92380aab30 comp rx=0 tx=0).stop 2024-08-20T01:50:43.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.257+0000 7f9247e56740 1 -- 172.21.15.79:0/2819875955 shutdown_connections 2024-08-20T01:50:43.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.257+0000 7f9247e56740 1 --2- 172.21.15.79:0/2819875955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a707c5b280 0x55a707c32f50 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.257+0000 7f9247e56740 1 --2- 172.21.15.79:0/2819875955 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a707c43130 0x55a707c5ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.257+0000 7f9247e56740 1 --2- 172.21.15.79:0/2819875955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a707c371a0 0x55a707c3aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.257+0000 7f9247e56740 1 -- 172.21.15.79:0/2819875955 >> 172.21.15.79:0/2819875955 conn(0x55a707c346b0 msgr2=0x55a707c3e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:43.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.257+0000 7f9247e56740 1 -- 172.21.15.79:0/2819875955 shutdown_connections 2024-08-20T01:50:43.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.257+0000 7f9247e56740 1 -- 172.21.15.79:0/2819875955 wait complete. 2024-08-20T01:50:43.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.257+0000 7f9247e56740 1 -- start start 2024-08-20T01:50:43.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.257+0000 7f9247e56740 1 Processor -- start 2024-08-20T01:50:43.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.258+0000 7f9247e56740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a707c371a0 0x55a707c4b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:43.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.258+0000 7f9247e56740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a707c43130 0x55a707c46db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:43.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.258+0000 7f9247e56740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a707c5b280 0x55a707c47540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:43.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.258+0000 7f9247e56740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f92401af5c0 con 0x55a707c5b280 2024-08-20T01:50:43.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.258+0000 7f9247e56740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f92401aeef0 con 0x55a707c371a0 2024-08-20T01:50:43.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.258+0000 7f9247e56740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f92401ac070 con 0x55a707c43130 2024-08-20T01:50:43.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.258+0000 7f9247e56740 10 client.0 _ll_register_callbacks cb 0x7f9230009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:50:43.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.258+0000 7f923f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a707c5b280 0x55a707c47540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:43.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.258+0000 7f923f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a707c5b280 0x55a707c47540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41524/0 (socket says 172.21.15.79:41524) 2024-08-20T01:50:43.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.258+0000 7f923f7fe640 1 -- 172.21.15.79:0/2086814651 learned_addr learned my addr 172.21.15.79:0/2086814651 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:43.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.258+0000 7f923e7fc640 1 --2- 172.21.15.79:0/2086814651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a707c43130 0x55a707c46db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:43.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.258+0000 7f923effd640 1 --2- 172.21.15.79:0/2086814651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a707c371a0 0x55a707c4b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:43.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.258+0000 7f923f7fe640 1 -- 172.21.15.79:0/2086814651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a707c43130 msgr2=0x55a707c46db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:43.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.258+0000 7f923f7fe640 1 --2- 172.21.15.79:0/2086814651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a707c43130 0x55a707c46db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.258+0000 7f923f7fe640 1 -- 172.21.15.79:0/2086814651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a707c371a0 msgr2=0x55a707c4b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:43.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.258+0000 7f923f7fe640 1 --2- 172.21.15.79:0/2086814651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a707c371a0 0x55a707c4b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.258+0000 7f923f7fe640 1 -- 172.21.15.79:0/2086814651 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a707cbcd10 con 0x55a707c5b280 2024-08-20T01:50:43.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.258+0000 7f923f7fe640 1 --2- 172.21.15.79:0/2086814651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a707c5b280 0x55a707c47540 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f9238005f00 tx=0x7f9238009270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ff0466def807146 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:43.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.258+0000 7f921effd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:50:43.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.258+0000 7f921effd640 1 -- 172.21.15.79:0/2086814651 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92380c9020 con 0x55a707c5b280 2024-08-20T01:50:43.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.258+0000 7f9247e56740 1 -- 172.21.15.79:0/2086814651 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92380af1f0 con 0x55a707c5b280 2024-08-20T01:50:43.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.258+0000 7f921effd640 1 -- 172.21.15.79:0/2086814651 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f92380a6610 con 0x55a707c5b280 2024-08-20T01:50:43.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.259+0000 7f921effd640 1 -- 172.21.15.79:0/2086814651 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f923801f040 con 0x55a707c5b280 2024-08-20T01:50:43.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.259+0000 7f9247e56740 10 client.18834 fetch_fsmap learned FSMap version 53 2024-08-20T01:50:43.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.259+0000 7f9247e56740 1 -- 172.21.15.79:0/2086814651 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x55a707cbdf50 con 0x55a707c5b280 2024-08-20T01:50:43.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.259+0000 7f921effd640 1 -- 172.21.15.79:0/2086814651 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f92380af1f0 con 0x55a707c5b280 2024-08-20T01:50:43.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.259+0000 7f921effd640 1 -- 172.21.15.79:0/2086814651 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 53) ==== 8378+0+0 (secure 0 0 0) 0x7f923808d020 con 0x55a707c5b280 2024-08-20T01:50:43.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.259+0000 7f9247e56740 10 client.18834 fetch_fsmap finished waiting for FSMap version 53 2024-08-20T01:50:43.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.259+0000 7f9247e56740 10 client.18834 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:50:43.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.259+0000 7f9247e56740 20 client.18834 populate_metadata read hostname 'smithi079' 2024-08-20T01:50:43.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.259+0000 7f9247e56740 1 --2- 172.21.15.79:0/2086814651 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55a707cbe6a0 0x55a707cc0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:43.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.259+0000 7f9247e56740 4 client.18834 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:50:43.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.259+0000 7f9247e56740 1 -- 172.21.15.79:0/2086814651 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a707bab320 con 0x55a707cbe6a0 2024-08-20T01:50:43.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.259+0000 7f923effd640 1 --2- 172.21.15.79:0/2086814651 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55a707cbe6a0 0x55a707cc0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:43.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.260+0000 7f921effd640 10 client.18834 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:50:43.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.260+0000 7f923effd640 1 --2- 172.21.15.79:0/2086814651 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55a707cbe6a0 0x55a707cc0ac0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f7401798c49decfb server_cookie=68125c66fa991dc5 in_seq=0 out_seq=0 2024-08-20T01:50:43.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.260+0000 7f921effd640 1 -- 172.21.15.79:0/2086814651 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a707bab320 con 0x55a707cbe6a0 2024-08-20T01:50:43.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.260+0000 7f921effd640 10 client.18834 handle_command_reply: tid=0 2024-08-20T01:50:43.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.260+0000 7f9247e56740 1 client.18834 shutdown 2024-08-20T01:50:43.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.260+0000 7f9247e56740 1 -- 172.21.15.79:0/2086814651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a707c5b280 msgr2=0x55a707c47540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:43.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.260+0000 7f9247e56740 1 --2- 172.21.15.79:0/2086814651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a707c5b280 0x55a707c47540 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f9238005f00 tx=0x7f9238009270 comp rx=0 tx=0).stop 2024-08-20T01:50:43.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.260+0000 7f9247e56740 1 -- 172.21.15.79:0/2086814651 shutdown_connections 2024-08-20T01:50:43.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.260+0000 7f9247e56740 1 --2- 172.21.15.79:0/2086814651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a707c5b280 0x55a707c47540 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.260+0000 7f9247e56740 1 --2- 172.21.15.79:0/2086814651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a707c43130 0x55a707c46db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.260+0000 7f9247e56740 1 --2- 172.21.15.79:0/2086814651 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55a707cbe6a0 0x55a707cc0ac0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.260+0000 7f9247e56740 1 --2- 172.21.15.79:0/2086814651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a707c371a0 0x55a707c4b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.260+0000 7f921effd640 0 client.18834 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:50:43.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.260+0000 7f9247e56740 1 -- 172.21.15.79:0/2086814651 >> 172.21.15.79:0/2086814651 conn(0x55a707c346b0 msgr2=0x55a707c40020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:43.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.260+0000 7f9247e56740 1 -- 172.21.15.79:0/2086814651 shutdown_connections 2024-08-20T01:50:43.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.260+0000 7f9247e56740 1 -- 172.21.15.79:0/2086814651 wait complete. 2024-08-20T01:50:43.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.260+0000 7f9247e56740 20 client.18834 trim_cache size 0 max 16384 2024-08-20T01:50:43.270 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:50:43.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.261+0000 7f9245a5d640 1 -- 172.21.15.79:0/3593827143 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f92280b3bd0 msgr2=0x7f92280b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:43.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.261+0000 7f9245a5d640 1 --2- 172.21.15.79:0/3593827143 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f92280b3bd0 0x7f92280b6090 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x55a707c39a00 tx=0x7f9230005f90 comp rx=0 tx=0).stop 2024-08-20T01:50:43.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.261+0000 7f9245a5d640 1 -- 172.21.15.79:0/3593827143 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9240108e60 msgr2=0x7f924019e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:43.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.261+0000 7f9245a5d640 1 --2- 172.21.15.79:0/3593827143 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9240108e60 0x7f924019e830 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f923800eaa0 tx=0x7f923800ef60 comp rx=0 tx=0).stop 2024-08-20T01:50:43.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.261+0000 7f9245a5d640 1 -- 172.21.15.79:0/3593827143 shutdown_connections 2024-08-20T01:50:43.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.261+0000 7f9245a5d640 1 --2- 172.21.15.79:0/3593827143 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f92280b3bd0 0x7f92280b6090 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.261+0000 7f9245a5d640 1 --2- 172.21.15.79:0/3593827143 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9240108e60 0x7f924019e830 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.261+0000 7f9245a5d640 1 --2- 172.21.15.79:0/3593827143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92401084e0 0x7f9240199490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.261+0000 7f9245a5d640 1 --2- 172.21.15.79:0/3593827143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9240102ad0 0x7f9240198f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:43.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.261+0000 7f9245a5d640 1 -- 172.21.15.79:0/3593827143 >> 172.21.15.79:0/3593827143 conn(0x7f92400fe540 msgr2=0x7f9240100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:43.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.261+0000 7f9245a5d640 1 -- 172.21.15.79:0/3593827143 shutdown_connections 2024-08-20T01:50:43.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:43.261+0000 7f9245a5d640 1 -- 172.21.15.79:0/3593827143 wait complete. 2024-08-20T01:50:44.369 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T01:50:44.637 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:50:44.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:44 smithi079 ceph-mon[18656]: pgmap v749: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.5 MiB/s wr, 395 op/s 2024-08-20T01:50:44.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:44 smithi081 ceph-mon[22209]: pgmap v749: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.5 MiB/s wr, 395 op/s 2024-08-20T01:50:44.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:44 smithi175 ceph-mon[22392]: pgmap v749: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.5 MiB/s wr, 395 op/s 2024-08-20T01:50:45.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.156+0000 7fcb93cab640 1 -- 172.21.15.79:0/239254549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb8c10ce20 msgr2=0x7fcb8c10f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:45.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.156+0000 7fcb93cab640 1 --2- 172.21.15.79:0/239254549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb8c10ce20 0x7fcb8c10f280 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fcb84009ca0 tx=0x7fcb8402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:50:45.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.156+0000 7fcb93cab640 1 -- 172.21.15.79:0/239254549 shutdown_connections 2024-08-20T01:50:45.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.156+0000 7fcb93cab640 1 --2- 172.21.15.79:0/239254549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb8c10ce20 0x7fcb8c10f280 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:45.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.156+0000 7fcb93cab640 1 --2- 172.21.15.79:0/239254549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb8c1042e0 0x7fcb8c10c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:45.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.156+0000 7fcb93cab640 1 --2- 172.21.15.79:0/239254549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb8c1039c0 0x7fcb8c103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:45.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.156+0000 7fcb93cab640 1 -- 172.21.15.79:0/239254549 >> 172.21.15.79:0/239254549 conn(0x7fcb8c0fd400 msgr2=0x7fcb8c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:45.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.156+0000 7fcb93cab640 1 -- 172.21.15.79:0/239254549 shutdown_connections 2024-08-20T01:50:45.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.156+0000 7fcb93cab640 1 -- 172.21.15.79:0/239254549 wait complete. 2024-08-20T01:50:45.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.157+0000 7fcb93cab640 1 Processor -- start 2024-08-20T01:50:45.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.157+0000 7fcb93cab640 1 -- start start 2024-08-20T01:50:45.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.157+0000 7fcb93cab640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb8c1039c0 0x7fcb8c198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:45.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.157+0000 7fcb93cab640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb8c1042e0 0x7fcb8c1993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:45.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.157+0000 7fcb93cab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb8c10ce20 0x7fcb8c19e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:45.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.157+0000 7fcb93cab640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8c112990 con 0x7fcb8c1042e0 2024-08-20T01:50:45.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.157+0000 7fcb93cab640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8c112810 con 0x7fcb8c10ce20 2024-08-20T01:50:45.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.157+0000 7fcb93cab640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8c112b10 con 0x7fcb8c1039c0 2024-08-20T01:50:45.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.157+0000 7fcb91246640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb8c1042e0 0x7fcb8c1993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:45.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.157+0000 7fcb91a47640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb8c1039c0 0x7fcb8c198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:45.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.157+0000 7fcb91246640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb8c1042e0 0x7fcb8c1993e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41542/0 (socket says 172.21.15.79:41542) 2024-08-20T01:50:45.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.157+0000 7fcb91a47640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb8c1039c0 0x7fcb8c198ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:53312/0 (socket says 172.21.15.79:53312) 2024-08-20T01:50:45.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.157+0000 7fcb91246640 1 -- 172.21.15.79:0/59526416 learned_addr learned my addr 172.21.15.79:0/59526416 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:45.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.157+0000 7fcb92248640 1 --2- 172.21.15.79:0/59526416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb8c10ce20 0x7fcb8c19e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:45.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.158+0000 7fcb91246640 1 -- 172.21.15.79:0/59526416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb8c1039c0 msgr2=0x7fcb8c198ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:45.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.158+0000 7fcb91246640 1 --2- 172.21.15.79:0/59526416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb8c1039c0 0x7fcb8c198ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:45.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.158+0000 7fcb91246640 1 -- 172.21.15.79:0/59526416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb8c10ce20 msgr2=0x7fcb8c19e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:45.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.158+0000 7fcb91246640 1 --2- 172.21.15.79:0/59526416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb8c10ce20 0x7fcb8c19e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:45.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.158+0000 7fcb91246640 1 -- 172.21.15.79:0/59526416 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb8c19ef50 con 0x7fcb8c1042e0 2024-08-20T01:50:45.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.158+0000 7fcb91a47640 1 --2- 172.21.15.79:0/59526416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb8c1039c0 0x7fcb8c198ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:50:45.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.158+0000 7fcb91246640 1 --2- 172.21.15.79:0/59526416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb8c1042e0 0x7fcb8c1993e0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c00e9c0 tx=0x7fcb7c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:45.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.158+0000 7fcb82ffd640 1 -- 172.21.15.79:0/59526416 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c00ccc0 con 0x7fcb8c1042e0 2024-08-20T01:50:45.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.158+0000 7fcb82ffd640 1 -- 172.21.15.79:0/59526416 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcb7c0035f0 con 0x7fcb8c1042e0 2024-08-20T01:50:45.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.158+0000 7fcb93cab640 1 -- 172.21.15.79:0/59526416 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb8c19f240 con 0x7fcb8c1042e0 2024-08-20T01:50:45.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.158+0000 7fcb82ffd640 1 -- 172.21.15.79:0/59526416 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c00ce60 con 0x7fcb8c1042e0 2024-08-20T01:50:45.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.158+0000 7fcb93cab640 1 -- 172.21.15.79:0/59526416 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb8c1a5900 con 0x7fcb8c1042e0 2024-08-20T01:50:45.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.161+0000 7fcb960a4740 1 Processor -- start 2024-08-20T01:50:45.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.161+0000 7fcb960a4740 1 -- start start 2024-08-20T01:50:45.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.161+0000 7fcb82ffd640 1 -- 172.21.15.79:0/59526416 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fcb7c004000 con 0x7fcb8c1042e0 2024-08-20T01:50:45.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.161+0000 7fcb960a4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ed932d880 0x558ed932dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:45.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.161+0000 7fcb960a4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ed932e1a0 0x558ed9339bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:45.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.161+0000 7fcb960a4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ed933a130 0x558ed933c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:45.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.161+0000 7fcb960a4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558ed92a4930 con 0x558ed932d880 2024-08-20T01:50:45.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.161+0000 7fcb960a4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558ed9293e30 con 0x558ed932e1a0 2024-08-20T01:50:45.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.161+0000 7fcb960a4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558ed9297e70 con 0x558ed933a130 2024-08-20T01:50:45.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.161+0000 7fcb92248640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ed932d880 0x558ed932dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:45.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.161+0000 7fcb92248640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ed932d880 0x558ed932dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41546/0 (socket says 172.21.15.79:41546) 2024-08-20T01:50:45.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.161+0000 7fcb92248640 1 -- 172.21.15.79:0/2470637626 learned_addr learned my addr 172.21.15.79:0/2470637626 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:45.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.161+0000 7fcb91a47640 1 --2- 172.21.15.79:0/2470637626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ed932e1a0 0x558ed9339bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:45.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.161+0000 7fcb91246640 1 --2- 172.21.15.79:0/2470637626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ed933a130 0x558ed933c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:45.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.162+0000 7fcb92248640 1 -- 172.21.15.79:0/2470637626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ed933a130 msgr2=0x558ed933c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:45.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.162+0000 7fcb92248640 1 --2- 172.21.15.79:0/2470637626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ed933a130 0x558ed933c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:45.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.162+0000 7fcb92248640 1 -- 172.21.15.79:0/2470637626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ed932e1a0 msgr2=0x558ed9339bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:45.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.162+0000 7fcb92248640 1 --2- 172.21.15.79:0/2470637626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ed932e1a0 0x558ed9339bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:45.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.162+0000 7fcb92248640 1 -- 172.21.15.79:0/2470637626 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ed8ff3650 con 0x558ed932d880 2024-08-20T01:50:45.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.162+0000 7fcb91a47640 1 --2- 172.21.15.79:0/2470637626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ed932e1a0 0x558ed9339bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:50:45.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.162+0000 7fcb92248640 1 --2- 172.21.15.79:0/2470637626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ed932d880 0x558ed932dc60 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fcb84035000 tx=0x7fcb840093f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=636da33dd83b5682 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:45.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.162+0000 7fcb82ffd640 1 --2- 172.21.15.79:0/59526416 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fcb780b3bd0 0x7fcb780b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:45.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.162+0000 7fcb77fff640 1 -- 172.21.15.79:0/2470637626 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb84031790 con 0x558ed932d880 2024-08-20T01:50:45.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.162+0000 7fcb91a47640 1 --2- 172.21.15.79:0/59526416 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fcb780b3bd0 0x7fcb780b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:45.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.162+0000 7fcb77fff640 1 -- 172.21.15.79:0/2470637626 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcb84036070 con 0x558ed932d880 2024-08-20T01:50:45.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.162+0000 7fcb82ffd640 1 -- 172.21.15.79:0/59526416 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fcb7c0e3f00 con 0x7fcb8c1042e0 2024-08-20T01:50:45.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.162+0000 7fcb77fff640 1 -- 172.21.15.79:0/2470637626 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb84004330 con 0x558ed932d880 2024-08-20T01:50:45.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.163+0000 7fcb960a4740 1 -- 172.21.15.79:0/2470637626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ed932d880 msgr2=0x558ed932dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:45.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.163+0000 7fcb960a4740 1 --2- 172.21.15.79:0/2470637626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ed932d880 0x558ed932dc60 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fcb84035000 tx=0x7fcb840093f0 comp rx=0 tx=0).stop 2024-08-20T01:50:45.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.163+0000 7fcb91a47640 1 --2- 172.21.15.79:0/59526416 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fcb780b3bd0 0x7fcb780b6090 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fcb88009fd0 tx=0x7fcb88005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:45.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.163+0000 7fcb960a4740 1 -- 172.21.15.79:0/2470637626 shutdown_connections 2024-08-20T01:50:45.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.163+0000 7fcb960a4740 1 --2- 172.21.15.79:0/2470637626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ed933a130 0x558ed933c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:45.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.163+0000 7fcb960a4740 1 --2- 172.21.15.79:0/2470637626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ed932e1a0 0x558ed9339bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:45.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.163+0000 7fcb960a4740 1 --2- 172.21.15.79:0/2470637626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ed932d880 0x558ed932dc60 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:45.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.163+0000 7fcb960a4740 1 -- 172.21.15.79:0/2470637626 >> 172.21.15.79:0/2470637626 conn(0x558ed932b6b0 msgr2=0x558ed932c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:45.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.163+0000 7fcb960a4740 1 -- 172.21.15.79:0/2470637626 shutdown_connections 2024-08-20T01:50:45.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.163+0000 7fcb960a4740 1 -- 172.21.15.79:0/2470637626 wait complete. 2024-08-20T01:50:45.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.164+0000 7fcb960a4740 1 -- start start 2024-08-20T01:50:45.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.164+0000 7fcb960a4740 1 Processor -- start 2024-08-20T01:50:45.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.164+0000 7fcb960a4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ed932d880 0x558ed9337120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:45.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.164+0000 7fcb960a4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ed932e1a0 0x558ed9337660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:45.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.164+0000 7fcb960a4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ed933a130 0x558ed9337ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:45.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.164+0000 7fcb960a4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558ed90f6700 con 0x558ed932d880 2024-08-20T01:50:45.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.164+0000 7fcb960a4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558ed921a810 con 0x558ed932e1a0 2024-08-20T01:50:45.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.164+0000 7fcb960a4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558ed933cc00 con 0x558ed933a130 2024-08-20T01:50:45.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.164+0000 7fcb960a4740 10 client.0 _ll_register_callbacks cb 0x558ed928d700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:50:45.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.164+0000 7fcb91a47640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ed932d880 0x558ed9337120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:45.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.164+0000 7fcb91a47640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ed932d880 0x558ed9337120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41560/0 (socket says 172.21.15.79:41560) 2024-08-20T01:50:45.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.164+0000 7fcb91246640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ed932e1a0 0x558ed9337660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:45.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.164+0000 7fcb91a47640 1 -- 172.21.15.79:0/1415345454 learned_addr learned my addr 172.21.15.79:0/1415345454 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:45.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.164+0000 7fcb92248640 1 --2- 172.21.15.79:0/1415345454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ed933a130 0x558ed9337ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:45.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.165+0000 7fcb91246640 1 -- 172.21.15.79:0/1415345454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ed933a130 msgr2=0x558ed9337ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:45.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.165+0000 7fcb91246640 1 --2- 172.21.15.79:0/1415345454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ed933a130 0x558ed9337ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:45.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.165+0000 7fcb91246640 1 -- 172.21.15.79:0/1415345454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ed932d880 msgr2=0x558ed9337120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:45.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.165+0000 7fcb91246640 1 --2- 172.21.15.79:0/1415345454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ed932d880 0x558ed9337120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:45.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.165+0000 7fcb91246640 1 -- 172.21.15.79:0/1415345454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ed9346060 con 0x558ed932e1a0 2024-08-20T01:50:45.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.165+0000 7fcb91246640 1 --2- 172.21.15.79:0/1415345454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ed932e1a0 0x558ed9337660 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c0e1a60 tx=0x7fcb7c0aa870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c97ad9581abe3a98 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:45.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.165+0000 7fcb757fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:50:45.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.165+0000 7fcb757fa640 1 -- 172.21.15.79:0/1415345454 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c0aae60 con 0x558ed932e1a0 2024-08-20T01:50:45.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.165+0000 7fcb757fa640 1 -- 172.21.15.79:0/1415345454 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fcb7c0037a0 con 0x558ed932e1a0 2024-08-20T01:50:45.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.165+0000 7fcb960a4740 1 -- 172.21.15.79:0/1415345454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558ed9243150 con 0x558ed932e1a0 2024-08-20T01:50:45.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.165+0000 7fcb757fa640 1 -- 172.21.15.79:0/1415345454 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fcb7c0af460 con 0x558ed932e1a0 2024-08-20T01:50:45.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.165+0000 7fcb960a4740 10 client.27965 fetch_fsmap learned FSMap version 53 2024-08-20T01:50:45.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.165+0000 7fcb960a4740 1 -- 172.21.15.79:0/1415345454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x558ed9348a70 con 0x558ed932e1a0 2024-08-20T01:50:45.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.165+0000 7fcb757fa640 1 -- 172.21.15.79:0/1415345454 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x558ed9243150 con 0x558ed932e1a0 2024-08-20T01:50:45.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.165+0000 7fcb757fa640 1 -- 172.21.15.79:0/1415345454 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 53) ==== 8378+0+0 (secure 0 0 0) 0x7fcb7c0b3a80 con 0x558ed932e1a0 2024-08-20T01:50:45.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.166+0000 7fcb960a4740 10 client.27965 fetch_fsmap finished waiting for FSMap version 53 2024-08-20T01:50:45.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.166+0000 7fcb960a4740 10 client.27965 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:50:45.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.166+0000 7fcb960a4740 20 client.27965 populate_metadata read hostname 'smithi079' 2024-08-20T01:50:45.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.166+0000 7fcb960a4740 1 --2- 172.21.15.79:0/1415345454 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558ed9349f30 0x558ed934c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:45.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.166+0000 7fcb960a4740 4 client.27965 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:50:45.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.166+0000 7fcb960a4740 1 -- 172.21.15.79:0/1415345454 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ed92a6880 con 0x558ed9349f30 2024-08-20T01:50:45.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.166+0000 7fcb91a47640 1 --2- 172.21.15.79:0/1415345454 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558ed9349f30 0x558ed934c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:45.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.166+0000 7fcb757fa640 10 client.27965 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:45.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.166+0000 7fcb91a47640 1 --2- 172.21.15.79:0/1415345454 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558ed9349f30 0x558ed934c320 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef7005be0955aaa9 server_cookie=f3ed919f943482f3 in_seq=0 out_seq=0 2024-08-20T01:50:45.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.167+0000 7fcb757fa640 1 -- 172.21.15.79:0/1415345454 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558ed92a6880 con 0x558ed9349f30 2024-08-20T01:50:45.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.167+0000 7fcb757fa640 10 client.27965 handle_command_reply: tid=0 2024-08-20T01:50:45.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.167+0000 7fcb960a4740 1 client.27965 shutdown 2024-08-20T01:50:45.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.167+0000 7fcb960a4740 1 -- 172.21.15.79:0/1415345454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ed932e1a0 msgr2=0x558ed9337660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:45.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.167+0000 7fcb960a4740 1 --2- 172.21.15.79:0/1415345454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ed932e1a0 0x558ed9337660 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c0e1a60 tx=0x7fcb7c0aa870 comp rx=0 tx=0).stop 2024-08-20T01:50:45.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.167+0000 7fcb960a4740 1 -- 172.21.15.79:0/1415345454 shutdown_connections 2024-08-20T01:50:45.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.167+0000 7fcb960a4740 1 --2- 172.21.15.79:0/1415345454 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558ed9349f30 0x558ed934c320 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:45.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.167+0000 7fcb960a4740 1 --2- 172.21.15.79:0/1415345454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ed933a130 0x558ed9337ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:45.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.167+0000 7fcb960a4740 1 --2- 172.21.15.79:0/1415345454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ed932e1a0 0x558ed9337660 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:45.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.167+0000 7fcb960a4740 1 --2- 172.21.15.79:0/1415345454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ed932d880 0x558ed9337120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:45.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.167+0000 7fcb757fa640 0 client.27965 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:45.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.167+0000 7fcb960a4740 1 -- 172.21.15.79:0/1415345454 >> 172.21.15.79:0/1415345454 conn(0x558ed932b6b0 msgr2=0x558ed9331250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:45.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.167+0000 7fcb960a4740 1 -- 172.21.15.79:0/1415345454 shutdown_connections 2024-08-20T01:50:45.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.168+0000 7fcb960a4740 1 -- 172.21.15.79:0/1415345454 wait complete. 2024-08-20T01:50:45.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.168+0000 7fcb960a4740 20 client.27965 trim_cache size 0 max 16384 2024-08-20T01:50:45.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.181+0000 7fcb960a4740 1 Processor -- start 2024-08-20T01:50:45.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.181+0000 7fcb960a4740 1 -- start start 2024-08-20T01:50:45.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.181+0000 7fcb960a4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ed932d880 0x558ed93369b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:45.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.181+0000 7fcb960a4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ed932e1a0 0x558ed9338750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:45.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.181+0000 7fcb960a4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ed933a130 0x558ed9331920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:45.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.181+0000 7fcb960a4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8c1abd00 con 0x558ed933a130 2024-08-20T01:50:45.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.181+0000 7fcb960a4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8c1ad900 con 0x558ed932e1a0 2024-08-20T01:50:45.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.181+0000 7fcb960a4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8c1ac490 con 0x558ed932d880 2024-08-20T01:50:45.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.181+0000 7fcb91a47640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ed932d880 0x558ed93369b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:45.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.181+0000 7fcb91246640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ed932e1a0 0x558ed9338750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:45.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.181+0000 7fcb91a47640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ed932d880 0x558ed93369b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:53344/0 (socket says 172.21.15.79:53344) 2024-08-20T01:50:45.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.181+0000 7fcb91a47640 1 -- 172.21.15.79:0/592136266 learned_addr learned my addr 172.21.15.79:0/592136266 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:45.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.181+0000 7fcb91246640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ed932e1a0 0x558ed9338750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:39342/0 (socket says 172.21.15.79:39342) 2024-08-20T01:50:45.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.182+0000 7fcb92248640 1 --2- 172.21.15.79:0/592136266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ed933a130 0x558ed9331920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:45.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.182+0000 7fcb91246640 1 -- 172.21.15.79:0/592136266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ed932d880 msgr2=0x558ed93369b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:45.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.182+0000 7fcb91246640 1 --2- 172.21.15.79:0/592136266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ed932d880 0x558ed93369b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:45.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.182+0000 7fcb91246640 1 -- 172.21.15.79:0/592136266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ed933a130 msgr2=0x558ed9331920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:45.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.182+0000 7fcb91246640 1 --2- 172.21.15.79:0/592136266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ed933a130 0x558ed9331920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:45.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.182+0000 7fcb91246640 1 -- 172.21.15.79:0/592136266 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ed932c130 con 0x558ed932e1a0 2024-08-20T01:50:45.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.182+0000 7fcb91246640 1 --2- 172.21.15.79:0/592136266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ed932e1a0 0x558ed9338750 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c0a6ee0 tx=0x7fcb7c0e7710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b55eac515f8e4b4a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:45.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.182+0000 7fcb777fe640 1 -- 172.21.15.79:0/592136266 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c0a68c0 con 0x558ed932e1a0 2024-08-20T01:50:45.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.182+0000 7fcb777fe640 1 -- 172.21.15.79:0/592136266 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcb7c0aae60 con 0x558ed932e1a0 2024-08-20T01:50:45.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.182+0000 7fcb777fe640 1 -- 172.21.15.79:0/592136266 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c0a6d20 con 0x558ed932e1a0 2024-08-20T01:50:45.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.183+0000 7fcb960a4740 1 -- 172.21.15.79:0/592136266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ed932e1a0 msgr2=0x558ed9338750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:45.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.183+0000 7fcb960a4740 1 --2- 172.21.15.79:0/592136266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ed932e1a0 0x558ed9338750 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c0a6ee0 tx=0x7fcb7c0e7710 comp rx=0 tx=0).stop 2024-08-20T01:50:45.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.183+0000 7fcb960a4740 1 -- 172.21.15.79:0/592136266 shutdown_connections 2024-08-20T01:50:45.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.183+0000 7fcb960a4740 1 --2- 172.21.15.79:0/592136266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ed933a130 0x558ed9331920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:45.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.183+0000 7fcb960a4740 1 --2- 172.21.15.79:0/592136266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ed932e1a0 0x558ed9338750 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:45.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.183+0000 7fcb960a4740 1 --2- 172.21.15.79:0/592136266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ed932d880 0x558ed93369b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:45.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.183+0000 7fcb960a4740 1 -- 172.21.15.79:0/592136266 >> 172.21.15.79:0/592136266 conn(0x558ed932b6b0 msgr2=0x558ed932a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:45.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.183+0000 7fcb960a4740 1 -- 172.21.15.79:0/592136266 shutdown_connections 2024-08-20T01:50:45.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.183+0000 7fcb960a4740 1 -- 172.21.15.79:0/592136266 wait complete. 2024-08-20T01:50:45.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.183+0000 7fcb960a4740 1 -- start start 2024-08-20T01:50:45.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.184+0000 7fcb960a4740 1 Processor -- start 2024-08-20T01:50:45.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.184+0000 7fcb960a4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ed932d880 0x558ed933cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:45.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.184+0000 7fcb960a4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ed932e1a0 0x558ed933d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:45.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.184+0000 7fcb960a4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ed933a130 0x558ed93b2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:45.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.184+0000 7fcb960a4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8c1ad230 con 0x558ed932d880 2024-08-20T01:50:45.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.184+0000 7fcb960a4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8c1acb60 con 0x558ed933a130 2024-08-20T01:50:45.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.184+0000 7fcb960a4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8c1a9d00 con 0x558ed932e1a0 2024-08-20T01:50:45.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.184+0000 7fcb960a4740 10 client.0 _ll_register_callbacks cb 0x7fcb7c003d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:50:45.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.184+0000 7fcb91a47640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ed932d880 0x558ed933cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:45.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.184+0000 7fcb91a47640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ed932d880 0x558ed933cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41584/0 (socket says 172.21.15.79:41584) 2024-08-20T01:50:45.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.184+0000 7fcb91a47640 1 -- 172.21.15.79:0/3313229936 learned_addr learned my addr 172.21.15.79:0/3313229936 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:45.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.184+0000 7fcb92248640 1 --2- 172.21.15.79:0/3313229936 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ed933a130 0x558ed93b2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:45.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.184+0000 7fcb91246640 1 --2- 172.21.15.79:0/3313229936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ed932e1a0 0x558ed933d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:45.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.185+0000 7fcb91a47640 1 -- 172.21.15.79:0/3313229936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ed932e1a0 msgr2=0x558ed933d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:45.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.185+0000 7fcb91a47640 1 --2- 172.21.15.79:0/3313229936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ed932e1a0 0x558ed933d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:45.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.185+0000 7fcb91a47640 1 -- 172.21.15.79:0/3313229936 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ed933a130 msgr2=0x558ed93b2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:45.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.185+0000 7fcb91a47640 1 --2- 172.21.15.79:0/3313229936 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ed933a130 0x558ed93b2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:45.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.185+0000 7fcb91a47640 1 -- 172.21.15.79:0/3313229936 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ed933ddb0 con 0x558ed932d880 2024-08-20T01:50:45.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.185+0000 7fcb91a47640 1 --2- 172.21.15.79:0/3313229936 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ed932d880 0x558ed933cfe0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fcb880124d0 tx=0x7fcb880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3a744c0668bdb26 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:45.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.185+0000 7fcb757fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:50:45.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.185+0000 7fcb757fa640 1 -- 172.21.15.79:0/3313229936 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb88004030 con 0x558ed932d880 2024-08-20T01:50:45.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.185+0000 7fcb757fa640 1 -- 172.21.15.79:0/3313229936 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fcb880041d0 con 0x558ed932d880 2024-08-20T01:50:45.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.185+0000 7fcb960a4740 1 -- 172.21.15.79:0/3313229936 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb7c0aae60 con 0x558ed932d880 2024-08-20T01:50:45.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.185+0000 7fcb757fa640 1 -- 172.21.15.79:0/3313229936 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fcb880043d0 con 0x558ed932d880 2024-08-20T01:50:45.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.185+0000 7fcb960a4740 10 client.18852 fetch_fsmap learned FSMap version 53 2024-08-20T01:50:45.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.185+0000 7fcb960a4740 1 -- 172.21.15.79:0/3313229936 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x558ed93b41b0 con 0x558ed932d880 2024-08-20T01:50:45.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.185+0000 7fcb757fa640 1 -- 172.21.15.79:0/3313229936 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcb7c0aae60 con 0x558ed932d880 2024-08-20T01:50:45.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.185+0000 7fcb757fa640 1 -- 172.21.15.79:0/3313229936 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 53) ==== 8378+0+0 (secure 0 0 0) 0x7fcb8802b510 con 0x558ed932d880 2024-08-20T01:50:45.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.185+0000 7fcb960a4740 10 client.18852 fetch_fsmap finished waiting for FSMap version 53 2024-08-20T01:50:45.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.185+0000 7fcb960a4740 10 client.18852 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:50:45.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.185+0000 7fcb960a4740 20 client.18852 populate_metadata read hostname 'smithi079' 2024-08-20T01:50:45.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.186+0000 7fcb960a4740 1 --2- 172.21.15.79:0/3313229936 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558ed93b4910 0x558ed93b6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:45.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.186+0000 7fcb960a4740 4 client.18852 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:50:45.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.186+0000 7fcb960a4740 1 -- 172.21.15.79:0/3313229936 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558ed92a2320 con 0x558ed93b4910 2024-08-20T01:50:45.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.186+0000 7fcb91246640 1 --2- 172.21.15.79:0/3313229936 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558ed93b4910 0x558ed93b6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:45.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.186+0000 7fcb757fa640 10 client.18852 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:45.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.186+0000 7fcb91246640 1 --2- 172.21.15.79:0/3313229936 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558ed93b4910 0x558ed93b6d30 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e33349f8ebb14684 server_cookie=977e852088b483d5 in_seq=0 out_seq=0 2024-08-20T01:50:45.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.186+0000 7fcb757fa640 1 -- 172.21.15.79:0/3313229936 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558ed92a2320 con 0x558ed93b4910 2024-08-20T01:50:45.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.186+0000 7fcb757fa640 10 client.18852 handle_command_reply: tid=0 2024-08-20T01:50:45.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.186+0000 7fcb960a4740 1 client.18852 shutdown 2024-08-20T01:50:45.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.186+0000 7fcb960a4740 1 -- 172.21.15.79:0/3313229936 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ed932d880 msgr2=0x558ed933cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:45.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.186+0000 7fcb960a4740 1 --2- 172.21.15.79:0/3313229936 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ed932d880 0x558ed933cfe0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fcb880124d0 tx=0x7fcb880046c0 comp rx=0 tx=0).stop 2024-08-20T01:50:45.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.187+0000 7fcb960a4740 1 -- 172.21.15.79:0/3313229936 shutdown_connections 2024-08-20T01:50:45.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.187+0000 7fcb960a4740 1 --2- 172.21.15.79:0/3313229936 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558ed93b4910 0x558ed93b6d30 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:45.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.187+0000 7fcb960a4740 1 --2- 172.21.15.79:0/3313229936 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ed933a130 0x558ed93b2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:45.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.187+0000 7fcb960a4740 1 --2- 172.21.15.79:0/3313229936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558ed932e1a0 0x558ed933d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:45.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.187+0000 7fcb757fa640 0 client.18852 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:45.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.187+0000 7fcb960a4740 1 --2- 172.21.15.79:0/3313229936 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ed932d880 0x558ed933cfe0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:45.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.187+0000 7fcb960a4740 1 -- 172.21.15.79:0/3313229936 >> 172.21.15.79:0/3313229936 conn(0x558ed932b6b0 msgr2=0x558ed9329f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:45.215 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:50:45.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.187+0000 7fcb960a4740 1 -- 172.21.15.79:0/3313229936 shutdown_connections 2024-08-20T01:50:45.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.187+0000 7fcb960a4740 1 -- 172.21.15.79:0/3313229936 wait complete. 2024-08-20T01:50:45.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.187+0000 7fcb960a4740 20 client.18852 trim_cache size 0 max 16384 2024-08-20T01:50:45.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.187+0000 7fcb93cab640 1 -- 172.21.15.79:0/59526416 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fcb780b3bd0 msgr2=0x7fcb780b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:45.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.187+0000 7fcb93cab640 1 --2- 172.21.15.79:0/59526416 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fcb780b3bd0 0x7fcb780b6090 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fcb88009fd0 tx=0x7fcb88005f90 comp rx=0 tx=0).stop 2024-08-20T01:50:45.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.187+0000 7fcb93cab640 1 -- 172.21.15.79:0/59526416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb8c1042e0 msgr2=0x7fcb8c1993e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:45.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.187+0000 7fcb93cab640 1 --2- 172.21.15.79:0/59526416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb8c1042e0 0x7fcb8c1993e0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c00e9c0 tx=0x7fcb7c00ee80 comp rx=0 tx=0).stop 2024-08-20T01:50:45.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.187+0000 7fcb93cab640 1 -- 172.21.15.79:0/59526416 shutdown_connections 2024-08-20T01:50:45.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.187+0000 7fcb93cab640 1 --2- 172.21.15.79:0/59526416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb8c10ce20 0x7fcb8c19e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:45.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.187+0000 7fcb93cab640 1 --2- 172.21.15.79:0/59526416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb8c1042e0 0x7fcb8c1993e0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:45.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.187+0000 7fcb93cab640 1 --2- 172.21.15.79:0/59526416 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fcb780b3bd0 0x7fcb780b6090 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:45.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.187+0000 7fcb93cab640 1 --2- 172.21.15.79:0/59526416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb8c1039c0 0x7fcb8c198ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:45.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.187+0000 7fcb93cab640 1 -- 172.21.15.79:0/59526416 >> 172.21.15.79:0/59526416 conn(0x7fcb8c0fd400 msgr2=0x7fcb8c0fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:45.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.187+0000 7fcb93cab640 1 -- 172.21.15.79:0/59526416 shutdown_connections 2024-08-20T01:50:45.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:45.188+0000 7fcb93cab640 1 -- 172.21.15.79:0/59526416 wait complete. 2024-08-20T01:50:46.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:46 smithi079 ceph-mon[18656]: pgmap v750: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.1 MiB/s wr, 293 op/s 2024-08-20T01:50:46.690 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:46 smithi175 ceph-mon[22392]: pgmap v750: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.1 MiB/s wr, 293 op/s 2024-08-20T01:50:46.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:46 smithi081 ceph-mon[22209]: pgmap v750: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.1 MiB/s wr, 293 op/s 2024-08-20T01:50:46.948 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T01:50:46.949 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T01:50:47.212 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:50:47.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.720+0000 7f9930a7e640 1 -- 172.21.15.79:0/1856454171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f992c10ce00 msgr2=0x7f992c10f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:47.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.720+0000 7f9930a7e640 1 --2- 172.21.15.79:0/1856454171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f992c10ce00 0x7f992c10f260 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f9924009ca0 tx=0x7f992402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:50:47.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.720+0000 7f9930a7e640 1 -- 172.21.15.79:0/1856454171 shutdown_connections 2024-08-20T01:50:47.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.720+0000 7f9930a7e640 1 --2- 172.21.15.79:0/1856454171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f992c10ce00 0x7f992c10f260 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:47.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.720+0000 7f9930a7e640 1 --2- 172.21.15.79:0/1856454171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f992c1042c0 0x7f992c10c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:47.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.720+0000 7f9930a7e640 1 --2- 172.21.15.79:0/1856454171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f992c1039a0 0x7f992c103d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:47.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.720+0000 7f9930a7e640 1 -- 172.21.15.79:0/1856454171 >> 172.21.15.79:0/1856454171 conn(0x7f992c0fd400 msgr2=0x7f992c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:47.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.720+0000 7f9930a7e640 1 -- 172.21.15.79:0/1856454171 shutdown_connections 2024-08-20T01:50:47.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.720+0000 7f9930a7e640 1 -- 172.21.15.79:0/1856454171 wait complete. 2024-08-20T01:50:47.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.721+0000 7f9930a7e640 1 Processor -- start 2024-08-20T01:50:47.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.721+0000 7f9930a7e640 1 -- start start 2024-08-20T01:50:47.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.721+0000 7f9930a7e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f992c1039a0 0x7f992c198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:47.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.721+0000 7f9930a7e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f992c1042c0 0x7f992c1993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:47.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.721+0000 7f9930a7e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f992c10ce00 0x7f992c19e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:47.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.721+0000 7f9930a7e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f992c112970 con 0x7f992c10ce00 2024-08-20T01:50:47.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.721+0000 7f9930a7e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f992c1127f0 con 0x7f992c1039a0 2024-08-20T01:50:47.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.721+0000 7f9930a7e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f992c112af0 con 0x7f992c1042c0 2024-08-20T01:50:47.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.721+0000 7f992ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f992c10ce00 0x7f992c19e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:47.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.721+0000 7f9923fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f992c1042c0 0x7f992c1993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:47.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.721+0000 7f992ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f992c10ce00 0x7f992c19e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41612/0 (socket says 172.21.15.79:41612) 2024-08-20T01:50:47.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.721+0000 7f992ad9d640 1 -- 172.21.15.79:0/3237455436 learned_addr learned my addr 172.21.15.79:0/3237455436 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:47.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.721+0000 7f992a59c640 1 --2- 172.21.15.79:0/3237455436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f992c1039a0 0x7f992c198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:47.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.721+0000 7f9923fff640 1 -- 172.21.15.79:0/3237455436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f992c1039a0 msgr2=0x7f992c198e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:47.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.721+0000 7f9923fff640 1 --2- 172.21.15.79:0/3237455436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f992c1039a0 0x7f992c198e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:47.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.721+0000 7f9923fff640 1 -- 172.21.15.79:0/3237455436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f992c10ce00 msgr2=0x7f992c19e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:47.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.721+0000 7f9923fff640 1 --2- 172.21.15.79:0/3237455436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f992c10ce00 0x7f992c19e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:47.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.721+0000 7f9923fff640 1 -- 172.21.15.79:0/3237455436 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f992c19ef10 con 0x7f992c1042c0 2024-08-20T01:50:47.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.721+0000 7f992a59c640 1 --2- 172.21.15.79:0/3237455436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f992c1039a0 0x7f992c198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:50:47.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.722+0000 7f9923fff640 1 --2- 172.21.15.79:0/3237455436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f992c1042c0 0x7f992c1993a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f991400e770 tx=0x7f991400ec30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:47.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.722+0000 7f99237fe640 1 -- 172.21.15.79:0/3237455436 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991400ccc0 con 0x7f992c1042c0 2024-08-20T01:50:47.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.722+0000 7f9930a7e640 1 -- 172.21.15.79:0/3237455436 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f992c19f200 con 0x7f992c1042c0 2024-08-20T01:50:47.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.722+0000 7f99237fe640 1 -- 172.21.15.79:0/3237455436 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99140044b0 con 0x7f992c1042c0 2024-08-20T01:50:47.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.722+0000 7f99237fe640 1 -- 172.21.15.79:0/3237455436 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9914003d70 con 0x7f992c1042c0 2024-08-20T01:50:47.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.722+0000 7f9930a7e640 1 -- 172.21.15.79:0/3237455436 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f992c1a5a90 con 0x7f992c1042c0 2024-08-20T01:50:47.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.724+0000 7f9932e77740 1 Processor -- start 2024-08-20T01:50:47.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.724+0000 7f9932e77740 1 -- start start 2024-08-20T01:50:47.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.725+0000 7f9932e77740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f3d8293b0 0x555f3d829790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:47.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.725+0000 7f9932e77740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f3d829cd0 0x555f3d839b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:47.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.725+0000 7f9932e77740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f3d83a070 0x555f3d83c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:47.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.725+0000 7f9932e77740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555f3d79f940 con 0x555f3d829cd0 2024-08-20T01:50:47.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.725+0000 7f9932e77740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555f3d78ee40 con 0x555f3d83a070 2024-08-20T01:50:47.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.725+0000 7f9932e77740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555f3d792e80 con 0x555f3d8293b0 2024-08-20T01:50:47.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.725+0000 7f992a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f3d829cd0 0x555f3d839b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:47.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.725+0000 7f992a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f3d829cd0 0x555f3d839b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41618/0 (socket says 172.21.15.79:41618) 2024-08-20T01:50:47.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.725+0000 7f992a59c640 1 -- 172.21.15.79:0/2118726432 learned_addr learned my addr 172.21.15.79:0/2118726432 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:47.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.725+0000 7f992ad9d640 1 --2- 172.21.15.79:0/2118726432 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f3d8293b0 0x555f3d829790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:47.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.725+0000 7f99237fe640 1 -- 172.21.15.79:0/3237455436 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f9914004000 con 0x7f992c1042c0 2024-08-20T01:50:47.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.725+0000 7f992ad9d640 1 -- 172.21.15.79:0/2118726432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f3d83a070 msgr2=0x555f3d83c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:47.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.725+0000 7f9923fff640 1 --2- 172.21.15.79:0/2118726432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f3d83a070 0x555f3d83c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:47.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.725+0000 7f992ad9d640 1 --2- 172.21.15.79:0/2118726432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f3d83a070 0x555f3d83c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:47.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.725+0000 7f992ad9d640 1 -- 172.21.15.79:0/2118726432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f3d829cd0 msgr2=0x555f3d839b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:47.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.725+0000 7f992ad9d640 1 --2- 172.21.15.79:0/2118726432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f3d829cd0 0x555f3d839b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:47.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.725+0000 7f992ad9d640 1 -- 172.21.15.79:0/2118726432 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f3d72b520 con 0x555f3d8293b0 2024-08-20T01:50:47.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.725+0000 7f9923fff640 1 --2- 172.21.15.79:0/2118726432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f3d83a070 0x555f3d83c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:50:47.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.725+0000 7f992a59c640 1 --2- 172.21.15.79:0/2118726432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f3d829cd0 0x555f3d839b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:50:47.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.726+0000 7f992ad9d640 1 --2- 172.21.15.79:0/2118726432 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f3d8293b0 0x555f3d829790 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9924006010 tx=0x7f9924005f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9bfd48c7b3ab58c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:47.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.726+0000 7f9920ff9640 1 -- 172.21.15.79:0/2118726432 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9924031750 con 0x555f3d8293b0 2024-08-20T01:50:47.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.726+0000 7f9920ff9640 1 -- 172.21.15.79:0/2118726432 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9924036030 con 0x555f3d8293b0 2024-08-20T01:50:47.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.726+0000 7f9920ff9640 1 -- 172.21.15.79:0/2118726432 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9924004260 con 0x555f3d8293b0 2024-08-20T01:50:47.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.726+0000 7f99237fe640 1 --2- 172.21.15.79:0/3237455436 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f99180b3c50 0x7f99180b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:47.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.726+0000 7f992a59c640 1 --2- 172.21.15.79:0/3237455436 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f99180b3c50 0x7f99180b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:47.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.726+0000 7f99237fe640 1 -- 172.21.15.79:0/3237455436 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f99140e3dd0 con 0x7f992c1042c0 2024-08-20T01:50:47.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.727+0000 7f9932e77740 1 -- 172.21.15.79:0/2118726432 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f3d8293b0 msgr2=0x555f3d829790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:47.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.727+0000 7f992a59c640 1 --2- 172.21.15.79:0/3237455436 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f99180b3c50 0x7f99180b6110 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x555f3d8280c0 tx=0x7f991c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:47.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.727+0000 7f9932e77740 1 --2- 172.21.15.79:0/2118726432 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f3d8293b0 0x555f3d829790 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9924006010 tx=0x7f9924005f50 comp rx=0 tx=0).stop 2024-08-20T01:50:47.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.727+0000 7f9932e77740 1 -- 172.21.15.79:0/2118726432 shutdown_connections 2024-08-20T01:50:47.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.727+0000 7f9932e77740 1 --2- 172.21.15.79:0/2118726432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f3d83a070 0x555f3d83c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:47.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.727+0000 7f9932e77740 1 --2- 172.21.15.79:0/2118726432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f3d829cd0 0x555f3d839b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:47.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.727+0000 7f9932e77740 1 --2- 172.21.15.79:0/2118726432 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f3d8293b0 0x555f3d829790 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:47.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.727+0000 7f9932e77740 1 -- 172.21.15.79:0/2118726432 >> 172.21.15.79:0/2118726432 conn(0x555f3d8271e0 msgr2=0x555f3d828380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:47.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.727+0000 7f9932e77740 1 -- 172.21.15.79:0/2118726432 shutdown_connections 2024-08-20T01:50:47.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.727+0000 7f9932e77740 1 -- 172.21.15.79:0/2118726432 wait complete. 2024-08-20T01:50:47.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.727+0000 7f9932e77740 1 -- start start 2024-08-20T01:50:47.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.727+0000 7f9932e77740 1 Processor -- start 2024-08-20T01:50:47.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.728+0000 7f9932e77740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f3d8293b0 0x555f3d837090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:47.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.728+0000 7f9932e77740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f3d829cd0 0x555f3d8375d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:47.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.728+0000 7f9932e77740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f3d83a070 0x555f3d837b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:47.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.728+0000 7f9932e77740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555f3d5f1890 con 0x555f3d83a070 2024-08-20T01:50:47.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.728+0000 7f9932e77740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555f3d715700 con 0x555f3d829cd0 2024-08-20T01:50:47.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.728+0000 7f9932e77740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555f3d83cbb0 con 0x555f3d8293b0 2024-08-20T01:50:47.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.728+0000 7f9932e77740 10 client.0 _ll_register_callbacks cb 0x555f3d78a6f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:50:47.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.728+0000 7f992a59c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f3d8293b0 0x555f3d837090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:47.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.728+0000 7f992a59c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f3d8293b0 0x555f3d837090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:53406/0 (socket says 172.21.15.79:53406) 2024-08-20T01:50:47.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.728+0000 7f992ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f3d83a070 0x555f3d837b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:47.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.728+0000 7f992a59c640 1 -- 172.21.15.79:0/1537155246 learned_addr learned my addr 172.21.15.79:0/1537155246 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:47.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.728+0000 7f9923fff640 1 --2- 172.21.15.79:0/1537155246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f3d829cd0 0x555f3d8375d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:47.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.728+0000 7f992a59c640 1 -- 172.21.15.79:0/1537155246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f3d829cd0 msgr2=0x555f3d8375d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:47.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.728+0000 7f992a59c640 1 --2- 172.21.15.79:0/1537155246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f3d829cd0 0x555f3d8375d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:47.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.728+0000 7f992a59c640 1 -- 172.21.15.79:0/1537155246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f3d83a070 msgr2=0x555f3d837b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:47.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.728+0000 7f992a59c640 1 --2- 172.21.15.79:0/1537155246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f3d83a070 0x555f3d837b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:47.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.728+0000 7f992a59c640 1 -- 172.21.15.79:0/1537155246 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f3d4ee930 con 0x555f3d8293b0 2024-08-20T01:50:47.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.728+0000 7f992ad9d640 1 --2- 172.21.15.79:0/1537155246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f3d83a070 0x555f3d837b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:50:47.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.728+0000 7f992a59c640 1 --2- 172.21.15.79:0/1537155246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f3d8293b0 0x555f3d837090 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f991c009920 tx=0x7f991c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=814dbe27a8c97e18 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:47.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.728+0000 7f9911ffb640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:50:47.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.729+0000 7f9911ffb640 1 -- 172.21.15.79:0/1537155246 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991c01d640 con 0x555f3d8293b0 2024-08-20T01:50:47.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.729+0000 7f9932e77740 1 -- 172.21.15.79:0/1537155246 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9924036030 con 0x555f3d8293b0 2024-08-20T01:50:47.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.729+0000 7f9911ffb640 1 -- 172.21.15.79:0/1537155246 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f991c01d7e0 con 0x555f3d8293b0 2024-08-20T01:50:47.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.729+0000 7f9911ffb640 1 -- 172.21.15.79:0/1537155246 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f991c01da00 con 0x555f3d8293b0 2024-08-20T01:50:47.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.729+0000 7f9932e77740 10 client.27910 fetch_fsmap learned FSMap version 53 2024-08-20T01:50:47.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.729+0000 7f9932e77740 1 -- 172.21.15.79:0/1537155246 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x555f3d8487e0 con 0x555f3d8293b0 2024-08-20T01:50:47.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.729+0000 7f9911ffb640 1 -- 172.21.15.79:0/1537155246 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9924036030 con 0x555f3d8293b0 2024-08-20T01:50:47.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.729+0000 7f9911ffb640 1 -- 172.21.15.79:0/1537155246 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 53) ==== 8378+0+0 (secure 0 0 0) 0x7f991c026030 con 0x555f3d8293b0 2024-08-20T01:50:47.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.729+0000 7f9932e77740 10 client.27910 fetch_fsmap finished waiting for FSMap version 53 2024-08-20T01:50:47.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.729+0000 7f9932e77740 10 client.27910 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:50:47.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.729+0000 7f9932e77740 20 client.27910 populate_metadata read hostname 'smithi079' 2024-08-20T01:50:47.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.729+0000 7f9932e77740 1 --2- 172.21.15.79:0/1537155246 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x555f3d849d40 0x555f3d84c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:47.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.729+0000 7f9932e77740 4 client.27910 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:50:47.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.729+0000 7f9932e77740 1 -- 172.21.15.79:0/1537155246 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555f3d7a1890 con 0x555f3d849d40 2024-08-20T01:50:47.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.729+0000 7f9923fff640 1 --2- 172.21.15.79:0/1537155246 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x555f3d849d40 0x555f3d84c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:47.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.730+0000 7f9911ffb640 10 client.27910 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:47.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.730+0000 7f9923fff640 1 --2- 172.21.15.79:0/1537155246 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x555f3d849d40 0x555f3d84c150 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81c0912c8bf60d00 server_cookie=cae752ce8640fbcf in_seq=0 out_seq=0 2024-08-20T01:50:47.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.731+0000 7f9911ffb640 1 -- 172.21.15.79:0/1537155246 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555f3d7a1890 con 0x555f3d849d40 2024-08-20T01:50:47.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.731+0000 7f9911ffb640 10 client.27910 handle_command_reply: tid=0 2024-08-20T01:50:47.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.731+0000 7f9932e77740 1 client.27910 shutdown 2024-08-20T01:50:47.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.731+0000 7f9932e77740 1 -- 172.21.15.79:0/1537155246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f3d8293b0 msgr2=0x555f3d837090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:47.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.731+0000 7f9932e77740 1 --2- 172.21.15.79:0/1537155246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f3d8293b0 0x555f3d837090 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f991c009920 tx=0x7f991c004730 comp rx=0 tx=0).stop 2024-08-20T01:50:47.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.732+0000 7f9932e77740 1 -- 172.21.15.79:0/1537155246 shutdown_connections 2024-08-20T01:50:47.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.732+0000 7f9932e77740 1 --2- 172.21.15.79:0/1537155246 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x555f3d849d40 0x555f3d84c150 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:47.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.732+0000 7f9932e77740 1 --2- 172.21.15.79:0/1537155246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f3d83a070 0x555f3d837b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:47.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.732+0000 7f9932e77740 1 --2- 172.21.15.79:0/1537155246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f3d829cd0 0x555f3d8375d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:47.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.732+0000 7f9932e77740 1 --2- 172.21.15.79:0/1537155246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f3d8293b0 0x555f3d837090 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:47.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.732+0000 7f9932e77740 1 -- 172.21.15.79:0/1537155246 >> 172.21.15.79:0/1537155246 conn(0x555f3d8271e0 msgr2=0x555f3d82cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:47.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.732+0000 7f9911ffb640 0 client.27910 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:47.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.732+0000 7f9932e77740 1 -- 172.21.15.79:0/1537155246 shutdown_connections 2024-08-20T01:50:47.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.732+0000 7f9932e77740 1 -- 172.21.15.79:0/1537155246 wait complete. 2024-08-20T01:50:47.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.732+0000 7f9932e77740 20 client.27910 trim_cache size 0 max 16384 2024-08-20T01:50:47.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.751+0000 7f9932e77740 1 Processor -- start 2024-08-20T01:50:47.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.751+0000 7f9932e77740 1 -- start start 2024-08-20T01:50:47.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.751+0000 7f9932e77740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f3d8293b0 0x555f3d8365a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:47.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.751+0000 7f9932e77740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f3d829cd0 0x555f3d834b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:47.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.751+0000 7f9932e77740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f3d83a070 0x555f3d82c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:47.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.751+0000 7f9932e77740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f992c1abd00 con 0x555f3d83a070 2024-08-20T01:50:47.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.751+0000 7f9932e77740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f992c1ad900 con 0x555f3d8293b0 2024-08-20T01:50:47.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.751+0000 7f9932e77740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f992c1ac490 con 0x555f3d829cd0 2024-08-20T01:50:47.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.751+0000 7f992ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f3d83a070 0x555f3d82c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:47.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.751+0000 7f992ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f3d83a070 0x555f3d82c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41640/0 (socket says 172.21.15.79:41640) 2024-08-20T01:50:47.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.751+0000 7f992ad9d640 1 -- 172.21.15.79:0/3496915791 learned_addr learned my addr 172.21.15.79:0/3496915791 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:47.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.751+0000 7f992a59c640 1 --2- 172.21.15.79:0/3496915791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f3d8293b0 0x555f3d8365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:47.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.751+0000 7f9923fff640 1 --2- 172.21.15.79:0/3496915791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f3d829cd0 0x555f3d834b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:47.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.752+0000 7f992ad9d640 1 -- 172.21.15.79:0/3496915791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f3d829cd0 msgr2=0x555f3d834b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:47.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.752+0000 7f992ad9d640 1 --2- 172.21.15.79:0/3496915791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f3d829cd0 0x555f3d834b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:47.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.752+0000 7f992ad9d640 1 -- 172.21.15.79:0/3496915791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f3d8293b0 msgr2=0x555f3d8365a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:47.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.752+0000 7f992ad9d640 1 --2- 172.21.15.79:0/3496915791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f3d8293b0 0x555f3d8365a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:47.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.752+0000 7f992ad9d640 1 -- 172.21.15.79:0/3496915791 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f3d829b00 con 0x555f3d83a070 2024-08-20T01:50:47.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.752+0000 7f992ad9d640 1 --2- 172.21.15.79:0/3496915791 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f3d83a070 0x555f3d82c410 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f9924009a60 tx=0x7f99240098f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=715b89349bad4332 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:47.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.752+0000 7f9913fff640 1 -- 172.21.15.79:0/3496915791 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9924053070 con 0x555f3d83a070 2024-08-20T01:50:47.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.752+0000 7f9913fff640 1 -- 172.21.15.79:0/3496915791 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9924036040 con 0x555f3d83a070 2024-08-20T01:50:47.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.752+0000 7f9913fff640 1 -- 172.21.15.79:0/3496915791 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f992404a040 con 0x555f3d83a070 2024-08-20T01:50:47.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.753+0000 7f9932e77740 1 -- 172.21.15.79:0/3496915791 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f3d83a070 msgr2=0x555f3d82c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:47.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.753+0000 7f9932e77740 1 --2- 172.21.15.79:0/3496915791 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f3d83a070 0x555f3d82c410 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f9924009a60 tx=0x7f99240098f0 comp rx=0 tx=0).stop 2024-08-20T01:50:47.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.753+0000 7f9932e77740 1 -- 172.21.15.79:0/3496915791 shutdown_connections 2024-08-20T01:50:47.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.753+0000 7f9932e77740 1 --2- 172.21.15.79:0/3496915791 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f3d83a070 0x555f3d82c410 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:47.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.753+0000 7f9932e77740 1 --2- 172.21.15.79:0/3496915791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f3d829cd0 0x555f3d834b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:47.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.753+0000 7f9932e77740 1 --2- 172.21.15.79:0/3496915791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f3d8293b0 0x555f3d8365a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:47.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.753+0000 7f9932e77740 1 -- 172.21.15.79:0/3496915791 >> 172.21.15.79:0/3496915791 conn(0x555f3d8271e0 msgr2=0x555f3d838ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:47.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.753+0000 7f9932e77740 1 -- 172.21.15.79:0/3496915791 shutdown_connections 2024-08-20T01:50:47.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.753+0000 7f9932e77740 1 -- 172.21.15.79:0/3496915791 wait complete. 2024-08-20T01:50:47.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.753+0000 7f9932e77740 1 -- start start 2024-08-20T01:50:47.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.753+0000 7f9932e77740 1 Processor -- start 2024-08-20T01:50:47.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.754+0000 7f9932e77740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f3d8293b0 0x555f3d8424f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:47.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.754+0000 7f9932e77740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f3d829cd0 0x555f3d851420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:47.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.754+0000 7f9932e77740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f3d83a070 0x555f3d851980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:47.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.754+0000 7f9932e77740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f992c1ad230 con 0x555f3d83a070 2024-08-20T01:50:47.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.754+0000 7f9932e77740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f992c1acb60 con 0x555f3d8293b0 2024-08-20T01:50:47.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.754+0000 7f9932e77740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f992c1a9d00 con 0x555f3d829cd0 2024-08-20T01:50:47.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.754+0000 7f992ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f3d83a070 0x555f3d851980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:47.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.754+0000 7f9923fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f3d829cd0 0x555f3d851420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:47.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.754+0000 7f992ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f3d83a070 0x555f3d851980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41652/0 (socket says 172.21.15.79:41652) 2024-08-20T01:50:47.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.754+0000 7f992ad9d640 1 -- 172.21.15.79:0/840527797 learned_addr learned my addr 172.21.15.79:0/840527797 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:47.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.754+0000 7f9932e77740 10 client.0 _ll_register_callbacks cb 0x7f991c009870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:50:47.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.754+0000 7f992a59c640 1 --2- 172.21.15.79:0/840527797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f3d8293b0 0x555f3d8424f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:47.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.754+0000 7f992ad9d640 1 -- 172.21.15.79:0/840527797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f3d829cd0 msgr2=0x555f3d851420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:47.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.754+0000 7f992ad9d640 1 --2- 172.21.15.79:0/840527797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f3d829cd0 0x555f3d851420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:47.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.754+0000 7f992ad9d640 1 -- 172.21.15.79:0/840527797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f3d8293b0 msgr2=0x555f3d8424f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:47.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.754+0000 7f992ad9d640 1 --2- 172.21.15.79:0/840527797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f3d8293b0 0x555f3d8424f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:47.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.754+0000 7f992ad9d640 1 -- 172.21.15.79:0/840527797 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f3d8521b0 con 0x555f3d83a070 2024-08-20T01:50:47.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.754+0000 7f992ad9d640 1 --2- 172.21.15.79:0/840527797 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f3d83a070 0x555f3d851980 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f992402b0b0 tx=0x7f9924003d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96782102f7a079c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:47.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.754+0000 7f9911ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:50:47.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.755+0000 7f9911ffb640 1 -- 172.21.15.79:0/840527797 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9924053040 con 0x555f3d83a070 2024-08-20T01:50:47.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.755+0000 7f9911ffb640 1 -- 172.21.15.79:0/840527797 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9924031d90 con 0x555f3d83a070 2024-08-20T01:50:47.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.755+0000 7f9932e77740 1 -- 172.21.15.79:0/840527797 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9924036040 con 0x555f3d83a070 2024-08-20T01:50:47.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.755+0000 7f9911ffb640 1 -- 172.21.15.79:0/840527797 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f9924004000 con 0x555f3d83a070 2024-08-20T01:50:47.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.755+0000 7f9932e77740 10 client.18870 fetch_fsmap learned FSMap version 53 2024-08-20T01:50:47.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.755+0000 7f9932e77740 1 -- 172.21.15.79:0/840527797 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x555f3d8b4aa0 con 0x555f3d83a070 2024-08-20T01:50:47.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.755+0000 7f9911ffb640 1 -- 172.21.15.79:0/840527797 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9924036040 con 0x555f3d83a070 2024-08-20T01:50:47.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.755+0000 7f9911ffb640 1 -- 172.21.15.79:0/840527797 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 53) ==== 8378+0+0 (secure 0 0 0) 0x7f9924043070 con 0x555f3d83a070 2024-08-20T01:50:47.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.755+0000 7f9932e77740 10 client.18870 fetch_fsmap finished waiting for FSMap version 53 2024-08-20T01:50:47.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.755+0000 7f9932e77740 10 client.18870 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:50:47.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.755+0000 7f9932e77740 20 client.18870 populate_metadata read hostname 'smithi079' 2024-08-20T01:50:47.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.755+0000 7f9932e77740 1 --2- 172.21.15.79:0/840527797 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x555f3d8b4ed0 0x555f3d8b72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:47.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.755+0000 7f9932e77740 4 client.18870 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T01:50:47.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.755+0000 7f9932e77740 1 -- 172.21.15.79:0/840527797 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x555f3d79d330 con 0x555f3d8b4ed0 2024-08-20T01:50:47.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.756+0000 7f992a59c640 1 --2- 172.21.15.79:0/840527797 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x555f3d8b4ed0 0x555f3d8b72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:47.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.756+0000 7f992a59c640 1 --2- 172.21.15.79:0/840527797 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x555f3d8b4ed0 0x555f3d8b72f0 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9e98f54a1df6dff server_cookie=1fcc5acd4389ca2c in_seq=0 out_seq=0 2024-08-20T01:50:47.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.756+0000 7f9911ffb640 10 client.18870 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:47.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.757+0000 7f9911ffb640 1 -- 172.21.15.79:0/840527797 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555f3d79d330 con 0x555f3d8b4ed0 2024-08-20T01:50:47.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.757+0000 7f9911ffb640 10 client.18870 handle_command_reply: tid=0 2024-08-20T01:50:47.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.757+0000 7f9932e77740 1 client.18870 shutdown 2024-08-20T01:50:47.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.757+0000 7f9932e77740 1 -- 172.21.15.79:0/840527797 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f3d83a070 msgr2=0x555f3d851980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:47.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.757+0000 7f9932e77740 1 --2- 172.21.15.79:0/840527797 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f3d83a070 0x555f3d851980 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f992402b0b0 tx=0x7f9924003d90 comp rx=0 tx=0).stop 2024-08-20T01:50:47.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.757+0000 7f9932e77740 1 -- 172.21.15.79:0/840527797 shutdown_connections 2024-08-20T01:50:47.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.757+0000 7f9932e77740 1 --2- 172.21.15.79:0/840527797 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x555f3d8b4ed0 0x555f3d8b72f0 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:47.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.757+0000 7f9932e77740 1 --2- 172.21.15.79:0/840527797 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f3d83a070 0x555f3d851980 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:47.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.757+0000 7f9911ffb640 0 client.18870 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:47.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.757+0000 7f9932e77740 1 --2- 172.21.15.79:0/840527797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f3d829cd0 0x555f3d851420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:47.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.757+0000 7f9932e77740 1 --2- 172.21.15.79:0/840527797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f3d8293b0 0x555f3d8424f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:47.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.757+0000 7f9932e77740 1 -- 172.21.15.79:0/840527797 >> 172.21.15.79:0/840527797 conn(0x555f3d8271e0 msgr2=0x555f3d837000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:47.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.757+0000 7f9932e77740 1 -- 172.21.15.79:0/840527797 shutdown_connections 2024-08-20T01:50:47.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.757+0000 7f9932e77740 1 -- 172.21.15.79:0/840527797 wait complete. 2024-08-20T01:50:47.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.757+0000 7f9932e77740 20 client.18870 trim_cache size 0 max 16384 2024-08-20T01:50:47.767 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:50:47.767 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-08-20T01:50:47.767 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "d6bac60d-239f-40a3-8a13-04842025109d", 2024-08-20T01:50:47.767 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-08-20T01:50:47.767 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:50:47.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.758+0000 7f9930a7e640 1 -- 172.21.15.79:0/3237455436 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f99180b3c50 msgr2=0x7f99180b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:47.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.758+0000 7f9930a7e640 1 --2- 172.21.15.79:0/3237455436 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f99180b3c50 0x7f99180b6110 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x555f3d8280c0 tx=0x7f991c005f90 comp rx=0 tx=0).stop 2024-08-20T01:50:47.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.758+0000 7f9930a7e640 1 -- 172.21.15.79:0/3237455436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f992c1042c0 msgr2=0x7f992c1993a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:47.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.758+0000 7f9930a7e640 1 --2- 172.21.15.79:0/3237455436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f992c1042c0 0x7f992c1993a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f991400e770 tx=0x7f991400ec30 comp rx=0 tx=0).stop 2024-08-20T01:50:47.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.758+0000 7f9930a7e640 1 -- 172.21.15.79:0/3237455436 shutdown_connections 2024-08-20T01:50:47.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.758+0000 7f9930a7e640 1 --2- 172.21.15.79:0/3237455436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f992c10ce00 0x7f992c19e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:47.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.758+0000 7f9930a7e640 1 --2- 172.21.15.79:0/3237455436 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f99180b3c50 0x7f99180b6110 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:47.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.758+0000 7f9930a7e640 1 --2- 172.21.15.79:0/3237455436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f992c1042c0 0x7f992c1993a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:47.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.758+0000 7f9930a7e640 1 --2- 172.21.15.79:0/3237455436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f992c1039a0 0x7f992c198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:47.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.758+0000 7f9930a7e640 1 -- 172.21.15.79:0/3237455436 >> 172.21.15.79:0/3237455436 conn(0x7f992c0fd400 msgr2=0x7f992c0fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:47.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.758+0000 7f9930a7e640 1 -- 172.21.15.79:0/3237455436 shutdown_connections 2024-08-20T01:50:47.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:47.758+0000 7f9930a7e640 1 -- 172.21.15.79:0/3237455436 wait complete. 2024-08-20T01:50:48.469 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:50:48.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:48 smithi079 ceph-mon[18656]: pgmap v751: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 1011 KiB/s wr, 265 op/s 2024-08-20T01:50:48.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:48 smithi079 ceph-mon[18656]: scrub queued for path: / 2024-08-20T01:50:48.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:48 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:48.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:48 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:50:48.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:48 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:50:48.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:48 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:48.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:48 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:50:48.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:48 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:50:48.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:48 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:50:48.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:48 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:48.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:48 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:48.688 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:48 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:48.689 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:48 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:50:48.689 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:48 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:48.737 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:50:48.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:48 smithi081 ceph-mon[22209]: pgmap v751: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 1011 KiB/s wr, 265 op/s 2024-08-20T01:50:48.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:48 smithi081 ceph-mon[22209]: scrub queued for path: / 2024-08-20T01:50:48.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:48 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:48.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:48 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:50:48.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:48 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:50:48.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:48 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:48.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:48 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:50:48.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:48 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:50:48.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:48 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:50:48.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:48 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:48.780 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:48 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:48.780 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:48 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:48.780 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:48 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:50:48.780 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:48 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:48.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:48 smithi175 ceph-mon[22392]: pgmap v751: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 1011 KiB/s wr, 265 op/s 2024-08-20T01:50:48.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:48 smithi175 ceph-mon[22392]: scrub queued for path: / 2024-08-20T01:50:48.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:48 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:48.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:48 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:50:48.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:48 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:50:48.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:48 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:48.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:48 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:50:48.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:48 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:50:48.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:48 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:50:48.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:48 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:48.891 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:48 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:48.891 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:48 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:48.891 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:48 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:50:48.891 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:48 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:49.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.339+0000 7fe7c01c8640 1 -- 172.21.15.79:0/1529791650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7b810ce00 msgr2=0x7fe7b810f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:49.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.339+0000 7fe7c01c8640 1 --2- 172.21.15.79:0/1529791650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7b810ce00 0x7fe7b810f250 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0009ca0 tx=0x7fe7b002a8c0 comp rx=0 tx=0).stop 2024-08-20T01:50:49.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.339+0000 7fe7c01c8640 1 -- 172.21.15.79:0/1529791650 shutdown_connections 2024-08-20T01:50:49.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.339+0000 7fe7c01c8640 1 --2- 172.21.15.79:0/1529791650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7b810ce00 0x7fe7b810f250 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:49.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.339+0000 7fe7c01c8640 1 --2- 172.21.15.79:0/1529791650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7b8104250 0x7fe7b810c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:49.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.339+0000 7fe7c01c8640 1 --2- 172.21.15.79:0/1529791650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7b8103850 0x7fe7b8103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:49.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.339+0000 7fe7c01c8640 1 -- 172.21.15.79:0/1529791650 >> 172.21.15.79:0/1529791650 conn(0x7fe7b80fd400 msgr2=0x7fe7b80ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:49.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.339+0000 7fe7c01c8640 1 -- 172.21.15.79:0/1529791650 shutdown_connections 2024-08-20T01:50:49.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.339+0000 7fe7c01c8640 1 -- 172.21.15.79:0/1529791650 wait complete. 2024-08-20T01:50:49.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.339+0000 7fe7c01c8640 1 Processor -- start 2024-08-20T01:50:49.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.340+0000 7fe7c01c8640 1 -- start start 2024-08-20T01:50:49.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.340+0000 7fe7c01c8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7b8103850 0x7fe7b8198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:49.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.340+0000 7fe7c01c8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7b8104250 0x7fe7b81993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:49.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.340+0000 7fe7c01c8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7b810ce00 0x7fe7b819e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:49.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.340+0000 7fe7c01c8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b8112960 con 0x7fe7b8104250 2024-08-20T01:50:49.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.340+0000 7fe7c01c8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b81127e0 con 0x7fe7b8103850 2024-08-20T01:50:49.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.340+0000 7fe7c01c8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b8112ae0 con 0x7fe7b810ce00 2024-08-20T01:50:49.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.340+0000 7fe7bd763640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7b8104250 0x7fe7b81993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:49.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.340+0000 7fe7bd763640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7b8104250 0x7fe7b81993c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41664/0 (socket says 172.21.15.79:41664) 2024-08-20T01:50:49.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.340+0000 7fe7bd763640 1 -- 172.21.15.79:0/2840488522 learned_addr learned my addr 172.21.15.79:0/2840488522 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:49.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.340+0000 7fe7bdf64640 1 --2- 172.21.15.79:0/2840488522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7b8103850 0x7fe7b8198e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:49.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.340+0000 7fe7be765640 1 --2- 172.21.15.79:0/2840488522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7b810ce00 0x7fe7b819e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:49.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.340+0000 7fe7bd763640 1 -- 172.21.15.79:0/2840488522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7b810ce00 msgr2=0x7fe7b819e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:49.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.340+0000 7fe7bd763640 1 --2- 172.21.15.79:0/2840488522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7b810ce00 0x7fe7b819e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:49.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.340+0000 7fe7bd763640 1 -- 172.21.15.79:0/2840488522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7b8103850 msgr2=0x7fe7b8198e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:49.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.340+0000 7fe7bd763640 1 --2- 172.21.15.79:0/2840488522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7b8103850 0x7fe7b8198e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:49.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.340+0000 7fe7bd763640 1 -- 172.21.15.79:0/2840488522 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7b819ef30 con 0x7fe7b8104250 2024-08-20T01:50:49.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.340+0000 7fe7bd763640 1 --2- 172.21.15.79:0/2840488522 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7b8104250 0x7fe7b81993c0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fe7a800d950 tx=0x7fe7a800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:49.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.341+0000 7fe7aeffd640 1 -- 172.21.15.79:0/2840488522 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a8017030 con 0x7fe7b8104250 2024-08-20T01:50:49.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.341+0000 7fe7aeffd640 1 -- 172.21.15.79:0/2840488522 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe7a8004020 con 0x7fe7b8104250 2024-08-20T01:50:49.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.341+0000 7fe7c01c8640 1 -- 172.21.15.79:0/2840488522 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7b819f220 con 0x7fe7b8104250 2024-08-20T01:50:49.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.341+0000 7fe7aeffd640 1 -- 172.21.15.79:0/2840488522 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a80055d0 con 0x7fe7b8104250 2024-08-20T01:50:49.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.341+0000 7fe7c01c8640 1 -- 172.21.15.79:0/2840488522 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7b81a58e0 con 0x7fe7b8104250 2024-08-20T01:50:49.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.344+0000 7fe7c25c1740 1 Processor -- start 2024-08-20T01:50:49.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.344+0000 7fe7c25c1740 1 -- start start 2024-08-20T01:50:49.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.344+0000 7fe7aeffd640 1 -- 172.21.15.79:0/2840488522 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fe7a8009a30 con 0x7fe7b8104250 2024-08-20T01:50:49.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.344+0000 7fe7c25c1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596fac9a830 0x5596fac9ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:49.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.344+0000 7fe7c25c1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596fac9b150 0x5596facaafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:49.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.344+0000 7fe7c25c1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596facab4f0 0x5596facad8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:49.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.344+0000 7fe7c25c1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5596fac118e0 con 0x5596fac9b150 2024-08-20T01:50:49.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.344+0000 7fe7c25c1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5596fac00de0 con 0x5596fac9a830 2024-08-20T01:50:49.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.344+0000 7fe7c25c1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5596fac04e20 con 0x5596facab4f0 2024-08-20T01:50:49.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.345+0000 7fe7bdf64640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596fac9b150 0x5596facaafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:49.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.345+0000 7fe7be765640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596fac9a830 0x5596fac9ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:49.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.345+0000 7fe7bdf64640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596fac9b150 0x5596facaafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41666/0 (socket says 172.21.15.79:41666) 2024-08-20T01:50:49.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.345+0000 7fe7be765640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596fac9a830 0x5596fac9ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:39406/0 (socket says 172.21.15.79:39406) 2024-08-20T01:50:49.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.345+0000 7fe7bdf64640 1 -- 172.21.15.79:0/1887725288 learned_addr learned my addr 172.21.15.79:0/1887725288 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:49.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.345+0000 7fe7bd763640 1 --2- 172.21.15.79:0/1887725288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596facab4f0 0x5596facad8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:49.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.345+0000 7fe7be765640 1 -- 172.21.15.79:0/1887725288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596facab4f0 msgr2=0x5596facad8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:49.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.345+0000 7fe7be765640 1 --2- 172.21.15.79:0/1887725288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596facab4f0 0x5596facad8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:49.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.345+0000 7fe7be765640 1 -- 172.21.15.79:0/1887725288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596fac9b150 msgr2=0x5596facaafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:49.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.345+0000 7fe7be765640 1 --2- 172.21.15.79:0/1887725288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596fac9b150 0x5596facaafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:49.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.345+0000 7fe7be765640 1 -- 172.21.15.79:0/1887725288 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596fa960650 con 0x5596fac9a830 2024-08-20T01:50:49.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.345+0000 7fe7be765640 1 --2- 172.21.15.79:0/1887725288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596fac9a830 0x5596fac9ac10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0006010 tx=0x7fe7b0009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=214bf7c7ffc19d44 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:49.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.345+0000 7fe7aeffd640 1 --2- 172.21.15.79:0/2840488522 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe7a40b3bd0 0x7fe7a40b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:49.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.345+0000 7fe7a3fff640 1 -- 172.21.15.79:0/1887725288 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b00316d0 con 0x5596fac9a830 2024-08-20T01:50:49.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.345+0000 7fe7bdf64640 1 --2- 172.21.15.79:0/2840488522 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe7a40b3bd0 0x7fe7a40b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:49.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.345+0000 7fe7a3fff640 1 -- 172.21.15.79:0/1887725288 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe7b0036040 con 0x5596fac9a830 2024-08-20T01:50:49.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.345+0000 7fe7a3fff640 1 -- 172.21.15.79:0/1887725288 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b00042a0 con 0x5596fac9a830 2024-08-20T01:50:49.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.345+0000 7fe7aeffd640 1 -- 172.21.15.79:0/2840488522 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fe7a80e3630 con 0x7fe7b8104250 2024-08-20T01:50:49.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.346+0000 7fe7c25c1740 1 -- 172.21.15.79:0/1887725288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596fac9a830 msgr2=0x5596fac9ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:49.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.346+0000 7fe7bdf64640 1 --2- 172.21.15.79:0/2840488522 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe7a40b3bd0 0x7fe7a40b6090 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x5596fac9a310 tx=0x7fe7b4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:49.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.346+0000 7fe7c25c1740 1 --2- 172.21.15.79:0/1887725288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596fac9a830 0x5596fac9ac10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0006010 tx=0x7fe7b0009a20 comp rx=0 tx=0).stop 2024-08-20T01:50:49.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.346+0000 7fe7c25c1740 1 -- 172.21.15.79:0/1887725288 shutdown_connections 2024-08-20T01:50:49.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.346+0000 7fe7c25c1740 1 --2- 172.21.15.79:0/1887725288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596facab4f0 0x5596facad8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:49.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.346+0000 7fe7c25c1740 1 --2- 172.21.15.79:0/1887725288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596fac9b150 0x5596facaafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:49.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.346+0000 7fe7c25c1740 1 --2- 172.21.15.79:0/1887725288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596fac9a830 0x5596fac9ac10 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:49.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.346+0000 7fe7c25c1740 1 -- 172.21.15.79:0/1887725288 >> 172.21.15.79:0/1887725288 conn(0x5596fac98660 msgr2=0x5596fac99800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:49.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.346+0000 7fe7c25c1740 1 -- 172.21.15.79:0/1887725288 shutdown_connections 2024-08-20T01:50:49.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.346+0000 7fe7c25c1740 1 -- 172.21.15.79:0/1887725288 wait complete. 2024-08-20T01:50:49.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.347+0000 7fe7c25c1740 1 -- start start 2024-08-20T01:50:49.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.347+0000 7fe7c25c1740 1 Processor -- start 2024-08-20T01:50:49.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.347+0000 7fe7c25c1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596fac9a830 0x5596faca8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:49.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.347+0000 7fe7c25c1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596fac9b150 0x5596faca89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:49.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.347+0000 7fe7c25c1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596facab4f0 0x5596faca8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:49.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.347+0000 7fe7c25c1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5596faa63700 con 0x5596fac9a830 2024-08-20T01:50:49.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.347+0000 7fe7c25c1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5596fab877c0 con 0x5596facab4f0 2024-08-20T01:50:49.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.347+0000 7fe7c25c1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5596facae140 con 0x5596fac9b150 2024-08-20T01:50:49.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.347+0000 7fe7c25c1740 10 client.0 _ll_register_callbacks cb 0x5596fabfa6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:50:49.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.347+0000 7fe7bdf64640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596fac9a830 0x5596faca8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:49.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.347+0000 7fe7bdf64640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596fac9a830 0x5596faca8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41670/0 (socket says 172.21.15.79:41670) 2024-08-20T01:50:49.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.347+0000 7fe7be765640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596facab4f0 0x5596faca8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:49.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.347+0000 7fe7bd763640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596fac9b150 0x5596faca89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:49.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.347+0000 7fe7bdf64640 1 -- 172.21.15.79:0/1882220848 learned_addr learned my addr 172.21.15.79:0/1882220848 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:49.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.347+0000 7fe7bdf64640 1 -- 172.21.15.79:0/1882220848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596fac9b150 msgr2=0x5596faca89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:49.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.347+0000 7fe7bdf64640 1 --2- 172.21.15.79:0/1882220848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596fac9b150 0x5596faca89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:49.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.347+0000 7fe7bdf64640 1 -- 172.21.15.79:0/1882220848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596facab4f0 msgr2=0x5596faca8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:49.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.347+0000 7fe7bdf64640 1 --2- 172.21.15.79:0/1882220848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596facab4f0 0x5596faca8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:49.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.347+0000 7fe7bdf64640 1 -- 172.21.15.79:0/1882220848 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596facb7520 con 0x5596fac9a830 2024-08-20T01:50:49.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.348+0000 7fe7bdf64640 1 --2- 172.21.15.79:0/1882220848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596fac9a830 0x5596faca8490 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fe7b401ea00 tx=0x7fe7b4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=989065957dbb45c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:49.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.348+0000 7fe7a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:50:49.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.348+0000 7fe7a17fa640 1 -- 172.21.15.79:0/1882220848 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b402e060 con 0x5596fac9a830 2024-08-20T01:50:49.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.348+0000 7fe7a17fa640 1 -- 172.21.15.79:0/1882220848 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fe7b4018030 con 0x5596fac9a830 2024-08-20T01:50:49.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.348+0000 7fe7c25c1740 1 -- 172.21.15.79:0/1882220848 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5596fabb0100 con 0x5596fac9a830 2024-08-20T01:50:49.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.348+0000 7fe7a17fa640 1 -- 172.21.15.79:0/1882220848 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fe7b4029420 con 0x5596fac9a830 2024-08-20T01:50:49.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.348+0000 7fe7c25c1740 10 client.18882 fetch_fsmap learned FSMap version 53 2024-08-20T01:50:49.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.348+0000 7fe7c25c1740 1 -- 172.21.15.79:0/1882220848 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x5596facb9f30 con 0x5596fac9a830 2024-08-20T01:50:49.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.348+0000 7fe7a17fa640 1 -- 172.21.15.79:0/1882220848 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5596fabb0100 con 0x5596fac9a830 2024-08-20T01:50:49.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.348+0000 7fe7a17fa640 1 -- 172.21.15.79:0/1882220848 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 53) ==== 8378+0+0 (secure 0 0 0) 0x7fe7b401c4a0 con 0x5596fac9a830 2024-08-20T01:50:49.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.348+0000 7fe7c25c1740 10 client.18882 fetch_fsmap finished waiting for FSMap version 53 2024-08-20T01:50:49.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.348+0000 7fe7c25c1740 10 client.18882 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:50:49.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.348+0000 7fe7c25c1740 20 client.18882 populate_metadata read hostname 'smithi079' 2024-08-20T01:50:49.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.348+0000 7fe7c25c1740 1 --2- 172.21.15.79:0/1882220848 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5596facbb3f0 0x5596facbd830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:49.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.348+0000 7fe7c25c1740 4 client.18882 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:50:49.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.348+0000 7fe7c25c1740 1 -- 172.21.15.79:0/1882220848 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5596fac13830 con 0x5596facbb3f0 2024-08-20T01:50:49.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.349+0000 7fe7bd763640 1 --2- 172.21.15.79:0/1882220848 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5596facbb3f0 0x5596facbd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:49.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.349+0000 7fe7a17fa640 10 client.18882 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:49.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.349+0000 7fe7bd763640 1 --2- 172.21.15.79:0/1882220848 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5596facbb3f0 0x5596facbd830 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a4da915d7fa8596 server_cookie=28445d2e9f72a94 in_seq=0 out_seq=0 2024-08-20T01:50:49.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.350+0000 7fe7a17fa640 1 -- 172.21.15.79:0/1882220848 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5596fac13830 con 0x5596facbb3f0 2024-08-20T01:50:49.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.350+0000 7fe7a17fa640 10 client.18882 handle_command_reply: tid=0 2024-08-20T01:50:49.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.350+0000 7fe7c25c1740 1 client.18882 shutdown 2024-08-20T01:50:49.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.350+0000 7fe7c25c1740 1 -- 172.21.15.79:0/1882220848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596fac9a830 msgr2=0x5596faca8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:49.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.350+0000 7fe7c25c1740 1 --2- 172.21.15.79:0/1882220848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596fac9a830 0x5596faca8490 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fe7b401ea00 tx=0x7fe7b4004730 comp rx=0 tx=0).stop 2024-08-20T01:50:49.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.350+0000 7fe7c25c1740 1 -- 172.21.15.79:0/1882220848 shutdown_connections 2024-08-20T01:50:49.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.350+0000 7fe7c25c1740 1 --2- 172.21.15.79:0/1882220848 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5596facbb3f0 0x5596facbd830 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:49.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.350+0000 7fe7c25c1740 1 --2- 172.21.15.79:0/1882220848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596facab4f0 0x5596faca8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:49.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.350+0000 7fe7c25c1740 1 --2- 172.21.15.79:0/1882220848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596fac9b150 0x5596faca89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:49.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.350+0000 7fe7a17fa640 0 client.18882 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:49.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.350+0000 7fe7c25c1740 1 --2- 172.21.15.79:0/1882220848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596fac9a830 0x5596faca8490 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:49.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.350+0000 7fe7c25c1740 1 -- 172.21.15.79:0/1882220848 >> 172.21.15.79:0/1882220848 conn(0x5596fac98660 msgr2=0x5596fac9e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:49.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.350+0000 7fe7c25c1740 1 -- 172.21.15.79:0/1882220848 shutdown_connections 2024-08-20T01:50:49.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.350+0000 7fe7c25c1740 1 -- 172.21.15.79:0/1882220848 wait complete. 2024-08-20T01:50:49.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.350+0000 7fe7c25c1740 20 client.18882 trim_cache size 0 max 16384 2024-08-20T01:50:49.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.368+0000 7fe7c25c1740 1 Processor -- start 2024-08-20T01:50:49.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.368+0000 7fe7c25c1740 1 -- start start 2024-08-20T01:50:49.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.369+0000 7fe7c25c1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596fac9a830 0x5596faca5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:49.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.369+0000 7fe7c25c1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596fac9b150 0x5596faca7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:49.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.369+0000 7fe7c25c1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596facab4f0 0x5596faca8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:49.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.369+0000 7fe7c25c1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b81abe10 con 0x5596fac9a830 2024-08-20T01:50:49.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.369+0000 7fe7c25c1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b81ada10 con 0x5596fac9b150 2024-08-20T01:50:49.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.369+0000 7fe7c25c1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b81ac5a0 con 0x5596facab4f0 2024-08-20T01:50:49.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.369+0000 7fe7bdf64640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596fac9a830 0x5596faca5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:49.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.369+0000 7fe7bdf64640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596fac9a830 0x5596faca5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41674/0 (socket says 172.21.15.79:41674) 2024-08-20T01:50:49.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.369+0000 7fe7bdf64640 1 -- 172.21.15.79:0/2160393048 learned_addr learned my addr 172.21.15.79:0/2160393048 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:49.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.369+0000 7fe7bd763640 1 --2- 172.21.15.79:0/2160393048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596fac9b150 0x5596faca7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:49.528 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:49 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:50:49.528 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:49 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:49.528 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:49 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:49.529 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:50:49.529 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-20T01:50:49.529 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": { 2024-08-20T01:50:49.529 INFO:teuthology.orchestra.run.smithi079.stdout: "d6bac60d-239f-40a3-8a13-04842025109d": { 2024-08-20T01:50:49.529 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/", 2024-08-20T01:50:49.530 INFO:teuthology.orchestra.run.smithi079.stdout: "tag": "d6bac60d-239f-40a3-8a13-04842025109d", 2024-08-20T01:50:49.530 INFO:teuthology.orchestra.run.smithi079.stdout: "options": "recursive,force" 2024-08-20T01:50:49.530 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:50:49.530 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:50:49.530 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:50:49.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.369+0000 7fe7be765640 1 --2- 172.21.15.79:0/2160393048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596facab4f0 0x5596faca8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:49.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.369+0000 7fe7bdf64640 1 -- 172.21.15.79:0/2160393048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596facab4f0 msgr2=0x5596faca8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:49.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.369+0000 7fe7bdf64640 1 --2- 172.21.15.79:0/2160393048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596facab4f0 0x5596faca8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:49.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.369+0000 7fe7bdf64640 1 -- 172.21.15.79:0/2160393048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596fac9b150 msgr2=0x5596faca7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:49.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.369+0000 7fe7bdf64640 1 --2- 172.21.15.79:0/2160393048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596fac9b150 0x5596faca7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:49.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.369+0000 7fe7bdf64640 1 -- 172.21.15.79:0/2160393048 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596faca0990 con 0x5596fac9a830 2024-08-20T01:50:49.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.369+0000 7fe7bd763640 1 --2- 172.21.15.79:0/2160393048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596fac9b150 0x5596faca7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:50:49.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.369+0000 7fe7bdf64640 1 --2- 172.21.15.79:0/2160393048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596fac9a830 0x5596faca5f80 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4005eb0 tx=0x7fe7b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66516b47bd704a5d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:49.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.370+0000 7fe7a37fe640 1 -- 172.21.15.79:0/2160393048 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b4038070 con 0x5596fac9a830 2024-08-20T01:50:49.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.370+0000 7fe7a37fe640 1 -- 172.21.15.79:0/2160393048 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe7b4009c10 con 0x5596fac9a830 2024-08-20T01:50:49.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.370+0000 7fe7a37fe640 1 -- 172.21.15.79:0/2160393048 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b4029a50 con 0x5596fac9a830 2024-08-20T01:50:49.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.371+0000 7fe7c25c1740 1 -- 172.21.15.79:0/2160393048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596fac9a830 msgr2=0x5596faca5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:49.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.371+0000 7fe7c25c1740 1 --2- 172.21.15.79:0/2160393048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596fac9a830 0x5596faca5f80 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4005eb0 tx=0x7fe7b40046c0 comp rx=0 tx=0).stop 2024-08-20T01:50:49.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.371+0000 7fe7c25c1740 1 -- 172.21.15.79:0/2160393048 shutdown_connections 2024-08-20T01:50:49.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.371+0000 7fe7c25c1740 1 --2- 172.21.15.79:0/2160393048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596facab4f0 0x5596faca8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:49.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.371+0000 7fe7c25c1740 1 --2- 172.21.15.79:0/2160393048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596fac9b150 0x5596faca7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:49.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.371+0000 7fe7c25c1740 1 --2- 172.21.15.79:0/2160393048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596fac9a830 0x5596faca5f80 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:49.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.371+0000 7fe7c25c1740 1 -- 172.21.15.79:0/2160393048 >> 172.21.15.79:0/2160393048 conn(0x5596fac98660 msgr2=0x5596faca8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:49.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.371+0000 7fe7c25c1740 1 -- 172.21.15.79:0/2160393048 shutdown_connections 2024-08-20T01:50:49.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.371+0000 7fe7c25c1740 1 -- 172.21.15.79:0/2160393048 wait complete. 2024-08-20T01:50:49.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.371+0000 7fe7c25c1740 1 -- start start 2024-08-20T01:50:49.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.372+0000 7fe7c25c1740 1 Processor -- start 2024-08-20T01:50:49.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.372+0000 7fe7c25c1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596fac9a830 0x5596facb3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:49.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.372+0000 7fe7c25c1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596fac9b150 0x5596facc2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:49.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.372+0000 7fe7c25c1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596facab4f0 0x5596facc3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:49.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.372+0000 7fe7c25c1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b81ad340 con 0x5596fac9a830 2024-08-20T01:50:49.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.372+0000 7fe7c25c1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b81acc70 con 0x5596facab4f0 2024-08-20T01:50:49.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.372+0000 7fe7c25c1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b81a9df0 con 0x5596fac9b150 2024-08-20T01:50:49.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.372+0000 7fe7c25c1740 10 client.0 _ll_register_callbacks cb 0x7fe7b4009830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:50:49.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.372+0000 7fe7bdf64640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596fac9a830 0x5596facb3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:49.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.372+0000 7fe7bdf64640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596fac9a830 0x5596facb3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41680/0 (socket says 172.21.15.79:41680) 2024-08-20T01:50:49.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.372+0000 7fe7bdf64640 1 -- 172.21.15.79:0/1793436434 learned_addr learned my addr 172.21.15.79:0/1793436434 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:49.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.372+0000 7fe7be765640 1 --2- 172.21.15.79:0/1793436434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596facab4f0 0x5596facc3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:49.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.372+0000 7fe7bd763640 1 --2- 172.21.15.79:0/1793436434 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596fac9b150 0x5596facc2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:49.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.373+0000 7fe7bdf64640 1 -- 172.21.15.79:0/1793436434 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596fac9b150 msgr2=0x5596facc2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:49.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.373+0000 7fe7bdf64640 1 --2- 172.21.15.79:0/1793436434 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596fac9b150 0x5596facc2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:49.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.373+0000 7fe7bdf64640 1 -- 172.21.15.79:0/1793436434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596facab4f0 msgr2=0x5596facc3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:49.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.373+0000 7fe7bdf64640 1 --2- 172.21.15.79:0/1793436434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596facab4f0 0x5596facc3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:49.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.373+0000 7fe7bdf64640 1 -- 172.21.15.79:0/1793436434 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596facc3850 con 0x5596fac9a830 2024-08-20T01:50:49.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.373+0000 7fe7be765640 1 --2- 172.21.15.79:0/1793436434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596facab4f0 0x5596facc3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:50:49.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.373+0000 7fe7bdf64640 1 --2- 172.21.15.79:0/1793436434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596fac9a830 0x5596facb3ac0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fe7b401c890 tx=0x7fe7b401cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=771c1ff8527f29c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:49.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.373+0000 7fe7a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:50:49.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.373+0000 7fe7a17fa640 1 -- 172.21.15.79:0/1793436434 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b4041070 con 0x5596fac9a830 2024-08-20T01:50:49.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.373+0000 7fe7a17fa640 1 -- 172.21.15.79:0/1793436434 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fe7b4005250 con 0x5596fac9a830 2024-08-20T01:50:49.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.373+0000 7fe7c25c1740 1 -- 172.21.15.79:0/1793436434 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5596fac0f2d0 con 0x5596fac9a830 2024-08-20T01:50:49.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.373+0000 7fe7a17fa640 1 -- 172.21.15.79:0/1793436434 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fe7b404d050 con 0x5596fac9a830 2024-08-20T01:50:49.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.373+0000 7fe7c25c1740 10 client.18888 fetch_fsmap learned FSMap version 53 2024-08-20T01:50:49.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.373+0000 7fe7c25c1740 1 -- 172.21.15.79:0/1793436434 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x5596fad26140 con 0x5596fac9a830 2024-08-20T01:50:49.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.373+0000 7fe7a17fa640 1 -- 172.21.15.79:0/1793436434 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5596fac0f2d0 con 0x5596fac9a830 2024-08-20T01:50:49.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.374+0000 7fe7a17fa640 1 -- 172.21.15.79:0/1793436434 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 53) ==== 8378+0+0 (secure 0 0 0) 0x7fe7b4004730 con 0x5596fac9a830 2024-08-20T01:50:49.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.374+0000 7fe7c25c1740 10 client.18888 fetch_fsmap finished waiting for FSMap version 53 2024-08-20T01:50:49.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.374+0000 7fe7c25c1740 10 client.18888 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:50:49.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.374+0000 7fe7c25c1740 20 client.18888 populate_metadata read hostname 'smithi079' 2024-08-20T01:50:49.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.374+0000 7fe7c25c1740 1 --2- 172.21.15.79:0/1793436434 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5596fad26740 0x5596fad28b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:49.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.374+0000 7fe7c25c1740 4 client.18888 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:50:49.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.374+0000 7fe7c25c1740 1 -- 172.21.15.79:0/1793436434 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5596fac0ca10 con 0x5596fad26740 2024-08-20T01:50:49.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.374+0000 7fe7bd763640 1 --2- 172.21.15.79:0/1793436434 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5596fad26740 0x5596fad28b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:49.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.374+0000 7fe7a17fa640 10 client.18888 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:49.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.374+0000 7fe7bd763640 1 --2- 172.21.15.79:0/1793436434 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5596fad26740 0x5596fad28b60 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59005db7ea11a114 server_cookie=8cc4c4b6618c9c31 in_seq=0 out_seq=0 2024-08-20T01:50:49.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.375+0000 7fe7a17fa640 1 -- 172.21.15.79:0/1793436434 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5596fac0ca10 con 0x5596fad26740 2024-08-20T01:50:49.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.375+0000 7fe7a17fa640 10 client.18888 handle_command_reply: tid=0 2024-08-20T01:50:49.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.375+0000 7fe7c25c1740 1 client.18888 shutdown 2024-08-20T01:50:49.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.375+0000 7fe7c25c1740 1 -- 172.21.15.79:0/1793436434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596fac9a830 msgr2=0x5596facb3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:49.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.375+0000 7fe7c25c1740 1 --2- 172.21.15.79:0/1793436434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596fac9a830 0x5596facb3ac0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fe7b401c890 tx=0x7fe7b401cd30 comp rx=0 tx=0).stop 2024-08-20T01:50:49.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.375+0000 7fe7c25c1740 1 -- 172.21.15.79:0/1793436434 shutdown_connections 2024-08-20T01:50:49.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.375+0000 7fe7c25c1740 1 --2- 172.21.15.79:0/1793436434 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5596fad26740 0x5596fad28b60 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:49.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.375+0000 7fe7c25c1740 1 --2- 172.21.15.79:0/1793436434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5596facab4f0 0x5596facc3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:49.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.375+0000 7fe7c25c1740 1 --2- 172.21.15.79:0/1793436434 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596fac9b150 0x5596facc2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:49.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.375+0000 7fe7c25c1740 1 --2- 172.21.15.79:0/1793436434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5596fac9a830 0x5596facb3ac0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:49.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.375+0000 7fe7c25c1740 1 -- 172.21.15.79:0/1793436434 >> 172.21.15.79:0/1793436434 conn(0x5596fac98660 msgr2=0x5596faca01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:49.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.375+0000 7fe7a17fa640 0 client.18888 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:49.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.375+0000 7fe7c25c1740 1 -- 172.21.15.79:0/1793436434 shutdown_connections 2024-08-20T01:50:49.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.375+0000 7fe7c25c1740 1 -- 172.21.15.79:0/1793436434 wait complete. 2024-08-20T01:50:49.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.375+0000 7fe7c25c1740 20 client.18888 trim_cache size 0 max 16384 2024-08-20T01:50:49.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.376+0000 7fe7c01c8640 1 -- 172.21.15.79:0/2840488522 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe7a40b3bd0 msgr2=0x7fe7a40b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:49.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.376+0000 7fe7c01c8640 1 --2- 172.21.15.79:0/2840488522 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe7a40b3bd0 0x7fe7a40b6090 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x5596fac9a310 tx=0x7fe7b4005f90 comp rx=0 tx=0).stop 2024-08-20T01:50:49.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.376+0000 7fe7c01c8640 1 -- 172.21.15.79:0/2840488522 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7b8104250 msgr2=0x7fe7b81993c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:49.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.376+0000 7fe7c01c8640 1 --2- 172.21.15.79:0/2840488522 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7b8104250 0x7fe7b81993c0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fe7a800d950 tx=0x7fe7a800de10 comp rx=0 tx=0).stop 2024-08-20T01:50:49.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.376+0000 7fe7c01c8640 1 -- 172.21.15.79:0/2840488522 shutdown_connections 2024-08-20T01:50:49.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.376+0000 7fe7c01c8640 1 --2- 172.21.15.79:0/2840488522 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe7a40b3bd0 0x7fe7a40b6090 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:49.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.376+0000 7fe7c01c8640 1 --2- 172.21.15.79:0/2840488522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7b810ce00 0x7fe7b819e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:49.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.376+0000 7fe7c01c8640 1 --2- 172.21.15.79:0/2840488522 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7b8104250 0x7fe7b81993c0 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:49.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.376+0000 7fe7c01c8640 1 --2- 172.21.15.79:0/2840488522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7b8103850 0x7fe7b8198e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:49.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.376+0000 7fe7c01c8640 1 -- 172.21.15.79:0/2840488522 >> 172.21.15.79:0/2840488522 conn(0x7fe7b80fd400 msgr2=0x7fe7b80fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:49.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.376+0000 7fe7c01c8640 1 -- 172.21.15.79:0/2840488522 shutdown_connections 2024-08-20T01:50:49.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:50:49.376+0000 7fe7c01c8640 1 -- 172.21.15.79:0/2840488522 wait complete. 2024-08-20T01:50:49.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:49 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:50:49.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:49 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:49.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:49 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:49.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:49 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:50:49.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:49 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:49.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:49 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:50:50.434 INFO:tasks.cephfs.filesystem:scrub status for tag:d6bac60d-239f-40a3-8a13-04842025109d - {'path': '/', 'tag': 'd6bac60d-239f-40a3-8a13-04842025109d', 'options': 'recursive,force'} 2024-08-20T01:50:50.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:50 smithi079 ceph-mon[18656]: pgmap v752: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 MiB/s wr, 297 op/s 2024-08-20T01:50:50.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:50 smithi081 ceph-mon[22209]: pgmap v752: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 MiB/s wr, 297 op/s 2024-08-20T01:50:50.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:50 smithi175 ceph-mon[22392]: pgmap v752: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 MiB/s wr, 297 op/s 2024-08-20T01:50:52.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:52 smithi081 ceph-mon[22209]: pgmap v753: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 1001 KiB/s wr, 278 op/s 2024-08-20T01:50:52.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:52 smithi175 ceph-mon[22392]: pgmap v753: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 1001 KiB/s wr, 278 op/s 2024-08-20T01:50:52.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:52 smithi079 ceph-mon[18656]: pgmap v753: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 1001 KiB/s wr, 278 op/s 2024-08-20T01:50:54.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:54 smithi081 ceph-mon[22209]: pgmap v754: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 964 KiB/s wr, 273 op/s 2024-08-20T01:50:54.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:54 smithi175 ceph-mon[22392]: pgmap v754: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 964 KiB/s wr, 273 op/s 2024-08-20T01:50:54.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:54 smithi079 ceph-mon[18656]: pgmap v754: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 964 KiB/s wr, 273 op/s 2024-08-20T01:50:56.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.180+0000 7f133391d640 1 -- 172.21.15.79:0/3393869341 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f132c1026b0 msgr2=0x7f132c102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:56.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.180+0000 7f133391d640 1 --2- 172.21.15.79:0/3393869341 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f132c1026b0 0x7f132c102b30 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f131c009930 tx=0x7f131c02a420 comp rx=0 tx=0).stop 2024-08-20T01:50:56.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.180+0000 7f133391d640 1 -- 172.21.15.79:0/3393869341 shutdown_connections 2024-08-20T01:50:56.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.180+0000 7f133391d640 1 --2- 172.21.15.79:0/3393869341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f132c103070 0x7f132c1099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:56.185 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.180+0000 7f133391d640 1 --2- 172.21.15.79:0/3393869341 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f132c1026b0 0x7f132c102b30 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:56.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.180+0000 7f133391d640 1 --2- 172.21.15.79:0/3393869341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f132c101560 0x7f132c101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:56.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.180+0000 7f133391d640 1 -- 172.21.15.79:0/3393869341 >> 172.21.15.79:0/3393869341 conn(0x7f132c0fce40 msgr2=0x7f132c0ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:56.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.180+0000 7f133391d640 1 -- 172.21.15.79:0/3393869341 shutdown_connections 2024-08-20T01:50:56.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.180+0000 7f133391d640 1 -- 172.21.15.79:0/3393869341 wait complete. 2024-08-20T01:50:56.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.181+0000 7f133391d640 1 Processor -- start 2024-08-20T01:50:56.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.181+0000 7f133391d640 1 -- start start 2024-08-20T01:50:56.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.181+0000 7f133391d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f132c101560 0x7f132c06aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:56.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.181+0000 7f133391d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f132c1026b0 0x7f132c19d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:56.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.181+0000 7f133391d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f132c103070 0x7f132c19fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:56.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.181+0000 7f133391d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f132c10d080 con 0x7f132c1026b0 2024-08-20T01:50:56.186 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.181+0000 7f133391d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f132c10cf00 con 0x7f132c101560 2024-08-20T01:50:56.187 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.181+0000 7f133391d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f132c10d200 con 0x7f132c103070 2024-08-20T01:50:56.187 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.181+0000 7f1330eb8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f132c1026b0 0x7f132c19d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:56.187 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.181+0000 7f13316b9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f132c101560 0x7f132c06aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:56.187 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.181+0000 7f1330eb8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f132c1026b0 0x7f132c19d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51992/0 (socket says 172.21.15.79:51992) 2024-08-20T01:50:56.187 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.181+0000 7f1330eb8640 1 -- 172.21.15.79:0/739008373 learned_addr learned my addr 172.21.15.79:0/739008373 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:56.187 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.181+0000 7f1331eba640 1 --2- 172.21.15.79:0/739008373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f132c103070 0x7f132c19fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:56.187 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.181+0000 7f13316b9640 1 -- 172.21.15.79:0/739008373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f132c103070 msgr2=0x7f132c19fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:56.187 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.181+0000 7f13316b9640 1 --2- 172.21.15.79:0/739008373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f132c103070 0x7f132c19fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:56.187 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.181+0000 7f13316b9640 1 -- 172.21.15.79:0/739008373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f132c1026b0 msgr2=0x7f132c19d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:56.187 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.181+0000 7f13316b9640 1 --2- 172.21.15.79:0/739008373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f132c1026b0 0x7f132c19d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:56.187 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.181+0000 7f13316b9640 1 -- 172.21.15.79:0/739008373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f132c1a0550 con 0x7f132c101560 2024-08-20T01:50:56.187 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.181+0000 7f1330eb8640 1 --2- 172.21.15.79:0/739008373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f132c1026b0 0x7f132c19d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:50:56.188 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.182+0000 7f13316b9640 1 --2- 172.21.15.79:0/739008373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f132c101560 0x7f132c06aee0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f132800e9f0 tx=0x7f132800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:56.188 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.182+0000 7f13227fc640 1 -- 172.21.15.79:0/739008373 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f132800ccc0 con 0x7f132c101560 2024-08-20T01:50:56.188 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.182+0000 7f133391d640 1 -- 172.21.15.79:0/739008373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f132c1a0840 con 0x7f132c101560 2024-08-20T01:50:56.188 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.182+0000 7f13227fc640 1 -- 172.21.15.79:0/739008373 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f13280108c0 con 0x7f132c101560 2024-08-20T01:50:56.188 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.182+0000 7f13227fc640 1 -- 172.21.15.79:0/739008373 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13280187c0 con 0x7f132c101560 2024-08-20T01:50:56.188 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.182+0000 7f133391d640 1 -- 172.21.15.79:0/739008373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f132c1a0de0 con 0x7f132c101560 2024-08-20T01:50:56.194 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.184+0000 7f13367e7740 1 Processor -- start 2024-08-20T01:50:56.194 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.185+0000 7f13367e7740 1 -- start start 2024-08-20T01:50:56.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.185+0000 7f13227fc640 1 -- 172.21.15.79:0/739008373 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1328010430 con 0x7f132c101560 2024-08-20T01:50:56.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.185+0000 7f13367e7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd00afb8d0 0x55dd00afdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:56.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.185+0000 7f13367e7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd00afe200 0x55dd00b005f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:56.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.185+0000 7f13367e7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd00b00c40 0x55dd00b03100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:56.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.185+0000 7f13367e7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55dd00a6e360 con 0x55dd00b00c40 2024-08-20T01:50:56.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.185+0000 7f13367e7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55dd00a5d860 con 0x55dd00afb8d0 2024-08-20T01:50:56.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.185+0000 7f13367e7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55dd00a618a0 con 0x55dd00afe200 2024-08-20T01:50:56.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.185+0000 7f1330eb8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd00b00c40 0x55dd00b03100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:56.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.185+0000 7f1330eb8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd00b00c40 0x55dd00b03100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51994/0 (socket says 172.21.15.79:51994) 2024-08-20T01:50:56.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.185+0000 7f1331eba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd00afb8d0 0x55dd00afdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:56.195 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.185+0000 7f1330eb8640 1 -- 172.21.15.79:0/3017342430 learned_addr learned my addr 172.21.15.79:0/3017342430 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:56.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.185+0000 7f13316b9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd00afe200 0x55dd00b005f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:56.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.185+0000 7f1331eba640 1 -- 172.21.15.79:0/3017342430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd00afe200 msgr2=0x55dd00b005f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:56.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.185+0000 7f1331eba640 1 --2- 172.21.15.79:0/3017342430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd00afe200 0x55dd00b005f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:56.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.185+0000 7f1331eba640 1 -- 172.21.15.79:0/3017342430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd00b00c40 msgr2=0x55dd00b03100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:56.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.185+0000 7f1331eba640 1 --2- 172.21.15.79:0/3017342430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd00b00c40 0x55dd00b03100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:56.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.185+0000 7f1331eba640 1 -- 172.21.15.79:0/3017342430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd00a04e40 con 0x55dd00afb8d0 2024-08-20T01:50:56.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.185+0000 7f1330eb8640 1 --2- 172.21.15.79:0/3017342430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd00b00c40 0x55dd00b03100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:50:56.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.185+0000 7f1331eba640 1 --2- 172.21.15.79:0/3017342430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd00afb8d0 0x55dd00afdcc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1324009f00 tx=0x7f1324011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4766031a57148359 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:56.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.185+0000 7f13227fc640 1 --2- 172.21.15.79:0/739008373 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f13180b3bd0 0x7f13180b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:56.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.186+0000 7f13177fe640 1 -- 172.21.15.79:0/3017342430 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1324004d20 con 0x55dd00afb8d0 2024-08-20T01:50:56.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.186+0000 7f13177fe640 1 -- 172.21.15.79:0/3017342430 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1324004030 con 0x55dd00afb8d0 2024-08-20T01:50:56.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.186+0000 7f13177fe640 1 -- 172.21.15.79:0/3017342430 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1324005280 con 0x55dd00afb8d0 2024-08-20T01:50:56.196 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.186+0000 7f13316b9640 1 --2- 172.21.15.79:0/739008373 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f13180b3bd0 0x7f13180b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:56.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.186+0000 7f13227fc640 1 -- 172.21.15.79:0/739008373 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f13280e3f10 con 0x7f132c101560 2024-08-20T01:50:56.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.186+0000 7f13367e7740 1 -- 172.21.15.79:0/3017342430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd00afb8d0 msgr2=0x55dd00afdcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:56.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.186+0000 7f13367e7740 1 --2- 172.21.15.79:0/3017342430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd00afb8d0 0x55dd00afdcc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1324009f00 tx=0x7f1324011810 comp rx=0 tx=0).stop 2024-08-20T01:50:56.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.186+0000 7f13316b9640 1 --2- 172.21.15.79:0/739008373 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f13180b3bd0 0x7f13180b6090 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f13280a6f40 tx=0x7f13280e7950 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:56.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.186+0000 7f13367e7740 1 -- 172.21.15.79:0/3017342430 shutdown_connections 2024-08-20T01:50:56.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.186+0000 7f13367e7740 1 --2- 172.21.15.79:0/3017342430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd00b00c40 0x55dd00b03100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:56.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.186+0000 7f13367e7740 1 --2- 172.21.15.79:0/3017342430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd00afe200 0x55dd00b005f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:56.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.186+0000 7f13367e7740 1 --2- 172.21.15.79:0/3017342430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd00afb8d0 0x55dd00afdcc0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:56.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.186+0000 7f13367e7740 1 -- 172.21.15.79:0/3017342430 >> 172.21.15.79:0/3017342430 conn(0x55dd00af6a20 msgr2=0x55dd00af77b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:56.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.186+0000 7f13367e7740 1 -- 172.21.15.79:0/3017342430 shutdown_connections 2024-08-20T01:50:56.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.186+0000 7f13367e7740 1 -- 172.21.15.79:0/3017342430 wait complete. 2024-08-20T01:50:56.197 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.187+0000 7f13367e7740 1 -- start start 2024-08-20T01:50:56.198 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.187+0000 7f13367e7740 1 Processor -- start 2024-08-20T01:50:56.198 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.187+0000 7f13367e7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd00afb8d0 0x55dd00b05120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:56.198 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.187+0000 7f13367e7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd00afe200 0x55dd00b057c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:56.198 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.187+0000 7f13367e7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd00b00c40 0x55dd00b06390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:56.198 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.187+0000 7f13367e7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55dd00996ab0 con 0x55dd00afe200 2024-08-20T01:50:56.198 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.187+0000 7f13367e7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55dd009e4780 con 0x55dd00afb8d0 2024-08-20T01:50:56.198 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.187+0000 7f13367e7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55dd00b03c20 con 0x55dd00b00c40 2024-08-20T01:50:56.198 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.187+0000 7f13367e7740 10 client.0 _ll_register_callbacks cb 0x55dd0076ca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:50:56.198 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.187+0000 7f1330eb8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd00afe200 0x55dd00b057c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:56.198 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.187+0000 7f1330eb8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd00afe200 0x55dd00b057c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51998/0 (socket says 172.21.15.79:51998) 2024-08-20T01:50:56.198 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.187+0000 7f1330eb8640 1 -- 172.21.15.79:0/1064043124 learned_addr learned my addr 172.21.15.79:0/1064043124 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:56.199 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.187+0000 7f1331eba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd00afb8d0 0x55dd00b05120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:56.199 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.187+0000 7f1331eba640 1 --2- 172.21.15.79:0/1064043124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd00b00c40 0x55dd00b06390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:56.199 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.188+0000 7f1330eb8640 1 -- 172.21.15.79:0/1064043124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd00b00c40 msgr2=0x55dd00b06390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:56.199 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.188+0000 7f1330eb8640 1 --2- 172.21.15.79:0/1064043124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd00b00c40 0x55dd00b06390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:56.199 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.188+0000 7f1330eb8640 1 -- 172.21.15.79:0/1064043124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd00afb8d0 msgr2=0x55dd00b05120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:56.199 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.188+0000 7f1330eb8640 1 --2- 172.21.15.79:0/1064043124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd00afb8d0 0x55dd00b05120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:56.199 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.188+0000 7f1330eb8640 1 -- 172.21.15.79:0/1064043124 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd007c0790 con 0x55dd00afe200 2024-08-20T01:50:56.199 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.188+0000 7f1330eb8640 1 --2- 172.21.15.79:0/1064043124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd00afe200 0x55dd00b057c0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f131c0096c0 tx=0x7f131c031d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f920108e6bc1865e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:56.199 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.188+0000 7f1314ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:50:56.199 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.188+0000 7f1314ff9640 1 -- 172.21.15.79:0/1064043124 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f131c035040 con 0x55dd00afe200 2024-08-20T01:50:56.199 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.188+0000 7f1314ff9640 1 -- 172.21.15.79:0/1064043124 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f131c004450 con 0x55dd00afe200 2024-08-20T01:50:56.199 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.188+0000 7f13367e7740 1 -- 172.21.15.79:0/1064043124 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dd00a0ce00 con 0x55dd00afe200 2024-08-20T01:50:56.200 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.188+0000 7f1314ff9640 1 -- 172.21.15.79:0/1064043124 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f131c0035f0 con 0x55dd00afe200 2024-08-20T01:50:56.200 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.188+0000 7f13367e7740 10 client.18900 fetch_fsmap learned FSMap version 53 2024-08-20T01:50:56.200 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.188+0000 7f13367e7740 1 -- 172.21.15.79:0/1064043124 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x55dd00839620 con 0x55dd00afe200 2024-08-20T01:50:56.200 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.188+0000 7f1314ff9640 1 -- 172.21.15.79:0/1064043124 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55dd00a0ce00 con 0x55dd00afe200 2024-08-20T01:50:56.200 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.189+0000 7f1314ff9640 1 -- 172.21.15.79:0/1064043124 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 53) ==== 8378+0+0 (secure 0 0 0) 0x7f131c03c7d0 con 0x55dd00afe200 2024-08-20T01:50:56.200 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.189+0000 7f13367e7740 10 client.18900 fetch_fsmap finished waiting for FSMap version 53 2024-08-20T01:50:56.200 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.189+0000 7f13367e7740 10 client.18900 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:50:56.200 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.189+0000 7f13367e7740 20 client.18900 populate_metadata read hostname 'smithi079' 2024-08-20T01:50:56.200 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.189+0000 7f13367e7740 1 --2- 172.21.15.79:0/1064043124 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55dd00b10a70 0x55dd00b12e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:56.200 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.189+0000 7f13367e7740 4 client.18900 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:50:56.200 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.189+0000 7f13367e7740 1 -- 172.21.15.79:0/1064043124 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dd00a702b0 con 0x55dd00b10a70 2024-08-20T01:50:56.200 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.189+0000 7f1331eba640 1 --2- 172.21.15.79:0/1064043124 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55dd00b10a70 0x55dd00b12e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:56.200 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.189+0000 7f1331eba640 1 --2- 172.21.15.79:0/1064043124 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55dd00b10a70 0x55dd00b12e80 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=723420742fae7aeb server_cookie=7f2612173c450bf6 in_seq=0 out_seq=0 2024-08-20T01:50:56.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.189+0000 7f1314ff9640 10 client.18900 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:56.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.190+0000 7f1314ff9640 1 -- 172.21.15.79:0/1064043124 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dd00a702b0 con 0x55dd00b10a70 2024-08-20T01:50:56.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.190+0000 7f1314ff9640 10 client.18900 handle_command_reply: tid=0 2024-08-20T01:50:56.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.190+0000 7f13367e7740 1 client.18900 shutdown 2024-08-20T01:50:56.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.190+0000 7f13367e7740 1 -- 172.21.15.79:0/1064043124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd00afe200 msgr2=0x55dd00b057c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:56.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.190+0000 7f13367e7740 1 --2- 172.21.15.79:0/1064043124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd00afe200 0x55dd00b057c0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f131c0096c0 tx=0x7f131c031d10 comp rx=0 tx=0).stop 2024-08-20T01:50:56.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.190+0000 7f13367e7740 1 -- 172.21.15.79:0/1064043124 shutdown_connections 2024-08-20T01:50:56.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.190+0000 7f13367e7740 1 --2- 172.21.15.79:0/1064043124 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55dd00b10a70 0x55dd00b12e80 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:56.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.190+0000 7f13367e7740 1 --2- 172.21.15.79:0/1064043124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd00b00c40 0x55dd00b06390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:56.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.190+0000 7f1314ff9640 0 client.18900 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:56.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.190+0000 7f13367e7740 1 --2- 172.21.15.79:0/1064043124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd00afe200 0x55dd00b057c0 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:56.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.190+0000 7f13367e7740 1 --2- 172.21.15.79:0/1064043124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd00afb8d0 0x55dd00b05120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:56.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.190+0000 7f13367e7740 1 -- 172.21.15.79:0/1064043124 >> 172.21.15.79:0/1064043124 conn(0x55dd00af6a20 msgr2=0x55dd00af5ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:56.202 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.190+0000 7f13367e7740 1 -- 172.21.15.79:0/1064043124 shutdown_connections 2024-08-20T01:50:56.202 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.190+0000 7f13367e7740 1 -- 172.21.15.79:0/1064043124 wait complete. 2024-08-20T01:50:56.202 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.190+0000 7f13367e7740 20 client.18900 trim_cache size 0 max 16384 2024-08-20T01:50:56.210 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.205+0000 7f13367e7740 1 Processor -- start 2024-08-20T01:50:56.210 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.205+0000 7f13367e7740 1 -- start start 2024-08-20T01:50:56.210 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.205+0000 7f13367e7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd00afb8d0 0x55dd00b05830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:56.210 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.205+0000 7f13367e7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd00afe200 0x55dd00b01020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:56.210 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.205+0000 7f13367e7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd00b00c40 0x55dd00b01560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:56.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.205+0000 7f13367e7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f132c1a99e0 con 0x55dd00afe200 2024-08-20T01:50:56.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.205+0000 7f13367e7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f132c1ab5e0 con 0x55dd00b00c40 2024-08-20T01:50:56.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.205+0000 7f13367e7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f132c1aa170 con 0x55dd00afb8d0 2024-08-20T01:50:56.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.205+0000 7f1330eb8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd00afe200 0x55dd00b01020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:56.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.206+0000 7f1330eb8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd00afe200 0x55dd00b01020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52000/0 (socket says 172.21.15.79:52000) 2024-08-20T01:50:56.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.206+0000 7f1330eb8640 1 -- 172.21.15.79:0/2159934242 learned_addr learned my addr 172.21.15.79:0/2159934242 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:56.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.206+0000 7f1331eba640 1 --2- 172.21.15.79:0/2159934242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd00b00c40 0x55dd00b01560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:56.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.206+0000 7f1331eba640 1 --2- 172.21.15.79:0/2159934242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd00afb8d0 0x55dd00b05830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:56.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.206+0000 7f1330eb8640 1 -- 172.21.15.79:0/2159934242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd00afb8d0 msgr2=0x55dd00b05830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:56.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.206+0000 7f1330eb8640 1 --2- 172.21.15.79:0/2159934242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd00afb8d0 0x55dd00b05830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:56.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.206+0000 7f1330eb8640 1 -- 172.21.15.79:0/2159934242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd00b00c40 msgr2=0x55dd00b01560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:56.211 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.206+0000 7f1330eb8640 1 --2- 172.21.15.79:0/2159934242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd00b00c40 0x55dd00b01560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:56.212 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.206+0000 7f1330eb8640 1 -- 172.21.15.79:0/2159934242 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd00b00960 con 0x55dd00afe200 2024-08-20T01:50:56.212 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.206+0000 7f1330eb8640 1 --2- 172.21.15.79:0/2159934242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd00afe200 0x55dd00b01020 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f131c009850 tx=0x7f131c005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f92f5689c0fb73a1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:56.212 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.206+0000 7f1316ffd640 1 -- 172.21.15.79:0/2159934242 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f131c055020 con 0x55dd00afe200 2024-08-20T01:50:56.212 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.206+0000 7f1316ffd640 1 -- 172.21.15.79:0/2159934242 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f131c004450 con 0x55dd00afe200 2024-08-20T01:50:56.212 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.206+0000 7f1316ffd640 1 -- 172.21.15.79:0/2159934242 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f131c035040 con 0x55dd00afe200 2024-08-20T01:50:56.212 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.207+0000 7f13367e7740 1 -- 172.21.15.79:0/2159934242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd00afe200 msgr2=0x55dd00b01020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:56.212 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.207+0000 7f13367e7740 1 --2- 172.21.15.79:0/2159934242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd00afe200 0x55dd00b01020 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f131c009850 tx=0x7f131c005e80 comp rx=0 tx=0).stop 2024-08-20T01:50:56.212 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.207+0000 7f13367e7740 1 -- 172.21.15.79:0/2159934242 shutdown_connections 2024-08-20T01:50:56.212 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.207+0000 7f13367e7740 1 --2- 172.21.15.79:0/2159934242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd00b00c40 0x55dd00b01560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:56.212 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.207+0000 7f13367e7740 1 --2- 172.21.15.79:0/2159934242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd00afe200 0x55dd00b01020 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:56.212 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.207+0000 7f13367e7740 1 --2- 172.21.15.79:0/2159934242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd00afb8d0 0x55dd00b05830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:56.212 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.207+0000 7f13367e7740 1 -- 172.21.15.79:0/2159934242 >> 172.21.15.79:0/2159934242 conn(0x55dd00af6a20 msgr2=0x55dd00b05120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:56.212 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.207+0000 7f13367e7740 1 -- 172.21.15.79:0/2159934242 shutdown_connections 2024-08-20T01:50:56.213 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.207+0000 7f13367e7740 1 -- 172.21.15.79:0/2159934242 wait complete. 2024-08-20T01:50:56.213 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.207+0000 7f13367e7740 1 -- start start 2024-08-20T01:50:56.213 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.208+0000 7f13367e7740 1 Processor -- start 2024-08-20T01:50:56.215 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.208+0000 7f13367e7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd00afb8d0 0x55dd00b0c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:56.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.208+0000 7f13367e7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd00afe200 0x55dd00b0b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:56.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.208+0000 7f13367e7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd00b00c40 0x55dd00b0bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:56.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.208+0000 7f13367e7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f132c1aaf10 con 0x55dd00afe200 2024-08-20T01:50:56.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.208+0000 7f13367e7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f132c1aa840 con 0x55dd00b00c40 2024-08-20T01:50:56.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.208+0000 7f13367e7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f132c1a79c0 con 0x55dd00afb8d0 2024-08-20T01:50:56.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.208+0000 7f13367e7740 10 client.0 _ll_register_callbacks cb 0x7f131c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:50:56.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.208+0000 7f1330eb8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd00afe200 0x55dd00b0b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:56.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.208+0000 7f1330eb8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd00afe200 0x55dd00b0b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52006/0 (socket says 172.21.15.79:52006) 2024-08-20T01:50:56.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.208+0000 7f1330eb8640 1 -- 172.21.15.79:0/2867501046 learned_addr learned my addr 172.21.15.79:0/2867501046 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:50:56.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.208+0000 7f1331eba640 1 --2- 172.21.15.79:0/2867501046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd00afb8d0 0x55dd00b0c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:56.216 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.208+0000 7f1331eba640 1 --2- 172.21.15.79:0/2867501046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd00b00c40 0x55dd00b0bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:56.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.208+0000 7f1330eb8640 1 -- 172.21.15.79:0/2867501046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd00afb8d0 msgr2=0x55dd00b0c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:56.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.208+0000 7f1330eb8640 1 --2- 172.21.15.79:0/2867501046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd00afb8d0 0x55dd00b0c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:56.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.208+0000 7f1330eb8640 1 -- 172.21.15.79:0/2867501046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd00b00c40 msgr2=0x55dd00b0bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:50:56.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.208+0000 7f1330eb8640 1 --2- 172.21.15.79:0/2867501046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd00b00c40 0x55dd00b0bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:56.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.208+0000 7f1330eb8640 1 -- 172.21.15.79:0/2867501046 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd00b0c200 con 0x55dd00afe200 2024-08-20T01:50:56.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.208+0000 7f1331eba640 1 --2- 172.21.15.79:0/2867501046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd00afb8d0 0x55dd00b0c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:50:56.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.209+0000 7f1330eb8640 1 --2- 172.21.15.79:0/2867501046 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd00afe200 0x55dd00b0b680 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f131c0057c0 tx=0x7f131c031cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c9e862a847c3f72 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:50:56.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.209+0000 7f1314ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:50:56.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.209+0000 7f1314ff9640 1 -- 172.21.15.79:0/2867501046 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f131c035040 con 0x55dd00afe200 2024-08-20T01:50:56.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.209+0000 7f1314ff9640 1 -- 172.21.15.79:0/2867501046 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f131c03c920 con 0x55dd00afe200 2024-08-20T01:50:56.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.209+0000 7f13367e7740 1 -- 172.21.15.79:0/2867501046 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f131c004450 con 0x55dd00afe200 2024-08-20T01:50:56.217 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.209+0000 7f1314ff9640 1 -- 172.21.15.79:0/2867501046 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f131c048110 con 0x55dd00afe200 2024-08-20T01:50:56.218 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.209+0000 7f13367e7740 10 client.18906 fetch_fsmap learned FSMap version 53 2024-08-20T01:50:56.218 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.209+0000 7f13367e7740 1 -- 172.21.15.79:0/2867501046 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x55dd00b7b760 con 0x55dd00afe200 2024-08-20T01:50:56.218 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.209+0000 7f1314ff9640 1 -- 172.21.15.79:0/2867501046 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f131c004450 con 0x55dd00afe200 2024-08-20T01:50:56.218 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.209+0000 7f1314ff9640 1 -- 172.21.15.79:0/2867501046 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 53) ==== 8378+0+0 (secure 0 0 0) 0x7f131c0486b0 con 0x55dd00afe200 2024-08-20T01:50:56.218 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.209+0000 7f13367e7740 10 client.18906 fetch_fsmap finished waiting for FSMap version 53 2024-08-20T01:50:56.218 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.209+0000 7f13367e7740 10 client.18906 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:50:56.218 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.209+0000 7f13367e7740 20 client.18906 populate_metadata read hostname 'smithi079' 2024-08-20T01:50:56.218 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.209+0000 7f13367e7740 1 --2- 172.21.15.79:0/2867501046 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55dd00b7c0a0 0x55dd00b7e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:50:56.218 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.209+0000 7f13367e7740 4 client.18906 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:50:56.218 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.209+0000 7f13367e7740 1 -- 172.21.15.79:0/2867501046 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dd00a6bd50 con 0x55dd00b7c0a0 2024-08-20T01:50:56.218 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.210+0000 7f1331eba640 1 --2- 172.21.15.79:0/2867501046 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55dd00b7c0a0 0x55dd00b7e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:50:56.218 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.210+0000 7f1314ff9640 10 client.18906 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:56.219 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.210+0000 7f1331eba640 1 --2- 172.21.15.79:0/2867501046 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55dd00b7c0a0 0x55dd00b7e4c0 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae731c19d4aa2da6 server_cookie=ac17d1b96f3749d6 in_seq=0 out_seq=0 2024-08-20T01:50:56.220 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.217+0000 7f1314ff9640 1 -- 172.21.15.79:0/2867501046 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dd00a6bd50 con 0x55dd00b7c0a0 2024-08-20T01:50:56.220 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.217+0000 7f1314ff9640 10 client.18906 handle_command_reply: tid=0 2024-08-20T01:50:56.220 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.217+0000 7f13367e7740 1 client.18906 shutdown 2024-08-20T01:50:56.220 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.217+0000 7f13367e7740 1 -- 172.21.15.79:0/2867501046 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd00afe200 msgr2=0x55dd00b0b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:56.220 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.217+0000 7f13367e7740 1 --2- 172.21.15.79:0/2867501046 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd00afe200 0x55dd00b0b680 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f131c0057c0 tx=0x7f131c031cf0 comp rx=0 tx=0).stop 2024-08-20T01:50:56.220 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.217+0000 7f13367e7740 1 -- 172.21.15.79:0/2867501046 shutdown_connections 2024-08-20T01:50:56.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.217+0000 7f13367e7740 1 --2- 172.21.15.79:0/2867501046 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55dd00b7c0a0 0x55dd00b7e4c0 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:56.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.217+0000 7f13367e7740 1 --2- 172.21.15.79:0/2867501046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd00b00c40 0x55dd00b0bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:56.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.217+0000 7f1314ff9640 0 client.18906 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:50:56.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.217+0000 7f13367e7740 1 --2- 172.21.15.79:0/2867501046 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd00afe200 0x55dd00b0b680 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:56.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.217+0000 7f13367e7740 1 --2- 172.21.15.79:0/2867501046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd00afb8d0 0x55dd00b0c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:56.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.217+0000 7f13367e7740 1 -- 172.21.15.79:0/2867501046 >> 172.21.15.79:0/2867501046 conn(0x55dd00af6a20 msgr2=0x55dd00af52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:56.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.217+0000 7f13367e7740 1 -- 172.21.15.79:0/2867501046 shutdown_connections 2024-08-20T01:50:56.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.217+0000 7f13367e7740 1 -- 172.21.15.79:0/2867501046 wait complete. 2024-08-20T01:50:56.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.217+0000 7f13367e7740 20 client.18906 trim_cache size 0 max 16384 2024-08-20T01:50:56.221 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:50:56.222 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:50:56.222 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:50:56.222 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:50:56.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.218+0000 7f133391d640 1 -- 172.21.15.79:0/739008373 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f13180b3bd0 msgr2=0x7f13180b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:56.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.218+0000 7f133391d640 1 --2- 172.21.15.79:0/739008373 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f13180b3bd0 0x7f13180b6090 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f13280a6f40 tx=0x7f13280e7950 comp rx=0 tx=0).stop 2024-08-20T01:50:56.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.218+0000 7f133391d640 1 -- 172.21.15.79:0/739008373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f132c101560 msgr2=0x7f132c06aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:50:56.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.218+0000 7f133391d640 1 --2- 172.21.15.79:0/739008373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f132c101560 0x7f132c06aee0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f132800e9f0 tx=0x7f132800eeb0 comp rx=0 tx=0).stop 2024-08-20T01:50:56.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.218+0000 7f133391d640 1 -- 172.21.15.79:0/739008373 shutdown_connections 2024-08-20T01:50:56.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.218+0000 7f133391d640 1 --2- 172.21.15.79:0/739008373 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f13180b3bd0 0x7f13180b6090 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:56.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.218+0000 7f133391d640 1 --2- 172.21.15.79:0/739008373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f132c103070 0x7f132c19fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:56.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.218+0000 7f133391d640 1 --2- 172.21.15.79:0/739008373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f132c1026b0 0x7f132c19d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:56.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.218+0000 7f133391d640 1 --2- 172.21.15.79:0/739008373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f132c101560 0x7f132c06aee0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:50:56.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.218+0000 7f133391d640 1 -- 172.21.15.79:0/739008373 >> 172.21.15.79:0/739008373 conn(0x7f132c0fce40 msgr2=0x7f132c105af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:50:56.223 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.218+0000 7f133391d640 1 -- 172.21.15.79:0/739008373 shutdown_connections 2024-08-20T01:50:56.224 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:50:56.218+0000 7f133391d640 1 -- 172.21.15.79:0/739008373 wait complete. 2024-08-20T01:50:56.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:56 smithi081 ceph-mon[22209]: pgmap v755: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 1.1 MiB/s wr, 310 op/s 2024-08-20T01:50:56.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:56 smithi175 ceph-mon[22392]: pgmap v755: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 1.1 MiB/s wr, 310 op/s 2024-08-20T01:50:56.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:56 smithi079 ceph-mon[18656]: pgmap v755: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 1.1 MiB/s wr, 310 op/s 2024-08-20T01:50:56.975 INFO:tasks.workunit.client.0.smithi079.stdout:Syncing()...0 sec 2024-08-20T01:50:56.975 INFO:tasks.workunit.client.0.smithi079.stdout:FFSB benchmark finished at: Tue Aug 20 01:50:56 2024 2024-08-20T01:50:56.975 INFO:tasks.workunit.client.0.smithi079.stdout: 2024-08-20T01:50:56.975 INFO:tasks.workunit.client.0.smithi079.stdout:Results: 2024-08-20T01:50:56.975 INFO:tasks.workunit.client.0.smithi079.stdout:Benchmark took 332.26 sec 2024-08-20T01:50:56.975 INFO:tasks.workunit.client.0.smithi079.stdout: 2024-08-20T01:50:56.975 INFO:tasks.workunit.client.0.smithi079.stdout:Total Results 2024-08-20T01:50:56.976 INFO:tasks.workunit.client.0.smithi079.stdout:=============== 2024-08-20T01:50:56.976 INFO:tasks.workunit.client.0.smithi079.stdout: Op Name Transactions Trans/sec % Trans % Op Weight Throughput 2024-08-20T01:50:56.976 INFO:tasks.workunit.client.0.smithi079.stdout: ======= ============ ========= ======= =========== ========== 2024-08-20T01:50:56.976 INFO:tasks.workunit.client.0.smithi079.stdout: write : 2012160 6055.99 100.000% 100.000% 23.7MB/sec 2024-08-20T01:50:56.976 INFO:tasks.workunit.client.0.smithi079.stdout:- 2024-08-20T01:50:56.976 INFO:tasks.workunit.client.0.smithi079.stdout:6055.99 Transactions per Second 2024-08-20T01:50:56.976 INFO:tasks.workunit.client.0.smithi079.stdout: 2024-08-20T01:50:56.976 INFO:tasks.workunit.client.0.smithi079.stdout:Throughput Results 2024-08-20T01:50:56.976 INFO:tasks.workunit.client.0.smithi079.stdout:=================== 2024-08-20T01:50:56.976 INFO:tasks.workunit.client.0.smithi079.stdout:Write Throughput: 23.7MB/sec 2024-08-20T01:50:56.985 INFO:tasks.workunit.client.0.smithi079.stdout: 2024-08-20T01:50:56.986 INFO:tasks.workunit.client.0.smithi079.stdout:System Call Latency statistics in millisecs 2024-08-20T01:50:56.986 INFO:tasks.workunit.client.0.smithi079.stdout:===== 2024-08-20T01:50:56.986 INFO:tasks.workunit.client.0.smithi079.stdout: Min Avg Max Total Calls 2024-08-20T01:50:56.986 INFO:tasks.workunit.client.0.smithi079.stdout: ======== ======== ======== ============ 2024-08-20T01:50:56.986 INFO:tasks.workunit.client.0.smithi079.stdout:[ open] 0.453000 92.919490 3695.282959 1572 2024-08-20T01:50:56.986 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-08-20T01:50:56.986 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[1] 2000.000000 - 5000.000000 : 22 2024-08-20T01:50:56.986 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[2] 1000.000000 - 2000.000000 : 36 2024-08-20T01:50:56.986 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[3] 500.000000 - 1000.000000 : 10 2024-08-20T01:50:56.986 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[4] 200.000000 - 500.000000 : 3 2024-08-20T01:50:56.987 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[5] 100.000000 - 200.000000 : 3 2024-08-20T01:50:56.987 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[6] 50.000000 - 100.000000 : 20 2024-08-20T01:50:56.987 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[7] 20.000000 - 50.000000 : 281 2024-08-20T01:50:56.987 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[8] 10.000000 - 20.000000 : 798 2024-08-20T01:50:56.987 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[9] 5.000000 - 10.000000 : 275 2024-08-20T01:50:56.987 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[10] 2.000000 - 5.000000 : 104 2024-08-20T01:50:56.987 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[11] 1.000000 - 2.000000 : 15 2024-08-20T01:50:56.987 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[12] 0.500000 - 1.000000 : 4 2024-08-20T01:50:56.987 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[13] 0.200000 - 0.500000 : 1 2024-08-20T01:50:56.987 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[14] 0.100000 - 0.200000 : 0 2024-08-20T01:50:56.987 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[15] 0.050000 - 0.100000 : 0 2024-08-20T01:50:56.987 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[16] 0.020000 - 0.050000 : 0 2024-08-20T01:50:56.987 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2024-08-20T01:50:56.988 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-08-20T01:50:56.988 INFO:tasks.workunit.client.0.smithi079.stdout: 2024-08-20T01:50:56.988 INFO:tasks.workunit.client.0.smithi079.stdout:[ write] 0.087000 4.835338 5684.668945 2012160 2024-08-20T01:50:56.988 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[0] 5000.000000 - 10000.000000 : 3 2024-08-20T01:50:56.988 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[1] 2000.000000 - 5000.000000 : 95 2024-08-20T01:50:56.988 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[2] 1000.000000 - 2000.000000 : 162 2024-08-20T01:50:56.988 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[3] 500.000000 - 1000.000000 : 495 2024-08-20T01:50:56.988 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[4] 200.000000 - 500.000000 : 2387 2024-08-20T01:50:56.988 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[5] 100.000000 - 200.000000 : 1251 2024-08-20T01:50:56.988 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[6] 50.000000 - 100.000000 : 2160 2024-08-20T01:50:56.988 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[7] 20.000000 - 50.000000 : 26470 2024-08-20T01:50:56.989 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[8] 10.000000 - 20.000000 : 113494 2024-08-20T01:50:56.989 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[9] 5.000000 - 10.000000 : 339205 2024-08-20T01:50:56.989 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[10] 2.000000 - 5.000000 : 775369 2024-08-20T01:50:56.989 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[11] 1.000000 - 2.000000 : 344305 2024-08-20T01:50:56.989 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[12] 0.500000 - 1.000000 : 79429 2024-08-20T01:50:56.989 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[13] 0.200000 - 0.500000 : 186881 2024-08-20T01:50:56.989 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[14] 0.100000 - 0.200000 : 140114 2024-08-20T01:50:56.989 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[15] 0.050000 - 0.100000 : 340 2024-08-20T01:50:56.989 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[16] 0.020000 - 0.050000 : 0 2024-08-20T01:50:56.989 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2024-08-20T01:50:56.989 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-08-20T01:50:56.989 INFO:tasks.workunit.client.0.smithi079.stdout: 2024-08-20T01:50:56.989 INFO:tasks.workunit.client.0.smithi079.stdout:[ lseek] 0.000000 0.000898 1.557000 2012160 2024-08-20T01:50:56.990 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-08-20T01:50:56.990 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-08-20T01:50:56.990 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-08-20T01:50:56.990 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-08-20T01:50:56.990 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-08-20T01:50:56.990 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-08-20T01:50:56.990 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-08-20T01:50:56.990 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[7] 20.000000 - 50.000000 : 0 2024-08-20T01:50:56.990 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[8] 10.000000 - 20.000000 : 0 2024-08-20T01:50:56.990 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[9] 5.000000 - 10.000000 : 0 2024-08-20T01:50:56.990 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[10] 2.000000 - 5.000000 : 0 2024-08-20T01:50:56.990 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[11] 1.000000 - 2.000000 : 5 2024-08-20T01:50:56.991 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[12] 0.500000 - 1.000000 : 10 2024-08-20T01:50:56.991 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[13] 0.200000 - 0.500000 : 33 2024-08-20T01:50:56.991 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[14] 0.100000 - 0.200000 : 48 2024-08-20T01:50:56.991 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[15] 0.050000 - 0.100000 : 91 2024-08-20T01:50:56.991 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[16] 0.020000 - 0.050000 : 602 2024-08-20T01:50:56.991 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[17] 0.010000 - 0.020000 : 1772 2024-08-20T01:50:56.991 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[18] 0.000000 - 0.010000 : 2009599 2024-08-20T01:50:56.991 INFO:tasks.workunit.client.0.smithi079.stdout: 2024-08-20T01:50:56.991 INFO:tasks.workunit.client.0.smithi079.stdout:[ close] 0.017000 1.840315 90.254997 1572 2024-08-20T01:50:56.991 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-08-20T01:50:56.991 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-08-20T01:50:56.991 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-08-20T01:50:56.992 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-08-20T01:50:56.992 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-08-20T01:50:56.992 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-08-20T01:50:56.992 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[6] 50.000000 - 100.000000 : 1 2024-08-20T01:50:56.992 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[7] 20.000000 - 50.000000 : 16 2024-08-20T01:50:56.992 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[8] 10.000000 - 20.000000 : 43 2024-08-20T01:50:56.992 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[9] 5.000000 - 10.000000 : 70 2024-08-20T01:50:56.992 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[10] 2.000000 - 5.000000 : 206 2024-08-20T01:50:56.992 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[11] 1.000000 - 2.000000 : 295 2024-08-20T01:50:56.992 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[12] 0.500000 - 1.000000 : 180 2024-08-20T01:50:56.992 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[13] 0.200000 - 0.500000 : 51 2024-08-20T01:50:56.992 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[14] 0.100000 - 0.200000 : 145 2024-08-20T01:50:56.992 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[15] 0.050000 - 0.100000 : 126 2024-08-20T01:50:56.993 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[16] 0.020000 - 0.050000 : 436 2024-08-20T01:50:56.993 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[17] 0.010000 - 0.020000 : 3 2024-08-20T01:50:56.993 INFO:tasks.workunit.client.0.smithi079.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-08-20T01:50:56.993 INFO:tasks.workunit.client.0.smithi079.stdout: 2024-08-20T01:50:56.993 INFO:tasks.workunit.client.0.smithi079.stdout: 2024-08-20T01:50:56.993 INFO:tasks.workunit.client.0.smithi079.stdout: 2024-08-20T01:50:56.993 INFO:tasks.workunit.client.0.smithi079.stdout: 2024-08-20T01:50:56.993 INFO:tasks.workunit.client.0.smithi079.stdout:1.1% User Time 2024-08-20T01:50:56.993 INFO:tasks.workunit.client.0.smithi079.stdout:17.9% System Time 2024-08-20T01:50:56.993 INFO:tasks.workunit.client.0.smithi079.stdout:19.0% CPU Utilization 2024-08-20T01:50:56.994 INFO:tasks.workunit.client.0.smithi079.stderr:+ cd .. 2024-08-20T01:50:56.994 INFO:tasks.workunit.client.0.smithi079.stderr:+ rm -r tmp ffsb 2024-08-20T01:50:58.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:50:58 smithi081 ceph-mon[22209]: pgmap v756: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 994 KiB/s wr, 285 op/s 2024-08-20T01:50:58.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:50:58 smithi175 ceph-mon[22392]: pgmap v756: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 994 KiB/s wr, 285 op/s 2024-08-20T01:50:58.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:50:58 smithi079 ceph-mon[18656]: pgmap v756: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 994 KiB/s wr, 285 op/s 2024-08-20T01:51:00.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:00 smithi081 ceph-mon[22209]: pgmap v757: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 1.0 MiB/s wr, 295 op/s 2024-08-20T01:51:00.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:00 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:51:00.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:00 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:51:00.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:00 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:51:00.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:00 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:51:00.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:00 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:51:00.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:00 smithi175 ceph-mon[22392]: pgmap v757: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 1.0 MiB/s wr, 295 op/s 2024-08-20T01:51:00.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:00 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:51:00.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:00 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:51:00.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:00 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:51:00.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:00 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:51:00.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:00 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:51:00.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:00 smithi079 ceph-mon[18656]: pgmap v757: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 1.0 MiB/s wr, 295 op/s 2024-08-20T01:51:00.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:00 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:51:00.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:00 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:51:00.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:00 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:51:00.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:00 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:51:00.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:00 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:51:01.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:01 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:51:01.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:01 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:51:01.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:01 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:51:02.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:02 smithi081 ceph-mon[22209]: pgmap v758: 97 pgs: 97 active+clean; 12 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 906 KiB/s wr, 252 op/s 2024-08-20T01:51:02.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:02 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:51:02.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:02 smithi175 ceph-mon[22392]: pgmap v758: 97 pgs: 97 active+clean; 12 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 906 KiB/s wr, 252 op/s 2024-08-20T01:51:02.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:02 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:51:02.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:02 smithi079 ceph-mon[18656]: pgmap v758: 97 pgs: 97 active+clean; 12 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 906 KiB/s wr, 252 op/s 2024-08-20T01:51:02.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:02 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:51:04.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:04 smithi081 ceph-mon[22209]: pgmap v759: 97 pgs: 97 active+clean; 12 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 763 KiB/s wr, 206 op/s 2024-08-20T01:51:04.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:04 smithi175 ceph-mon[22392]: pgmap v759: 97 pgs: 97 active+clean; 12 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 763 KiB/s wr, 206 op/s 2024-08-20T01:51:04.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:04 smithi079 ceph-mon[18656]: pgmap v759: 97 pgs: 97 active+clean; 12 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 763 KiB/s wr, 206 op/s 2024-08-20T01:51:05.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:05 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:51:05.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:05 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:51:05.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:05 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:51:06.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:06 smithi081 ceph-mon[22209]: pgmap v760: 97 pgs: 97 active+clean; 12 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 673 KiB/s wr, 180 op/s 2024-08-20T01:51:06.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:06 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:51:06.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:06 smithi175 ceph-mon[22392]: pgmap v760: 97 pgs: 97 active+clean; 12 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 673 KiB/s wr, 180 op/s 2024-08-20T01:51:06.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:06 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:51:06.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:06 smithi079 ceph-mon[18656]: pgmap v760: 97 pgs: 97 active+clean; 12 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 673 KiB/s wr, 180 op/s 2024-08-20T01:51:06.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:06 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:51:07.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:07 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:51:07.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:07 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:51:07.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:07 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:51:08.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:08 smithi081 ceph-mon[22209]: pgmap v761: 97 pgs: 97 active+clean; 12 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 450 KiB/s wr, 119 op/s 2024-08-20T01:51:08.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:08 smithi175 ceph-mon[22392]: pgmap v761: 97 pgs: 97 active+clean; 12 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 450 KiB/s wr, 119 op/s 2024-08-20T01:51:08.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:08 smithi079 ceph-mon[18656]: pgmap v761: 97 pgs: 97 active+clean; 12 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 450 KiB/s wr, 119 op/s 2024-08-20T01:51:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.307+0000 7f74539ac640 1 -- 172.21.15.79:0/4246886828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f744c101560 msgr2=0x7f744c101960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.307+0000 7f74539ac640 1 --2- 172.21.15.79:0/4246886828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f744c101560 0x7f744c101960 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f7448009930 tx=0x7f744802a420 comp rx=0 tx=0).stop 2024-08-20T01:51:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.307+0000 7f74539ac640 1 -- 172.21.15.79:0/4246886828 shutdown_connections 2024-08-20T01:51:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.307+0000 7f74539ac640 1 --2- 172.21.15.79:0/4246886828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f744c103070 0x7f744c1099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.307+0000 7f74539ac640 1 --2- 172.21.15.79:0/4246886828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f744c1026b0 0x7f744c102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.307+0000 7f74539ac640 1 --2- 172.21.15.79:0/4246886828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f744c101560 0x7f744c101960 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.307+0000 7f74539ac640 1 -- 172.21.15.79:0/4246886828 >> 172.21.15.79:0/4246886828 conn(0x7f744c0fce40 msgr2=0x7f744c0ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.307+0000 7f74539ac640 1 -- 172.21.15.79:0/4246886828 shutdown_connections 2024-08-20T01:51:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.307+0000 7f74539ac640 1 -- 172.21.15.79:0/4246886828 wait complete. 2024-08-20T01:51:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.307+0000 7f74539ac640 1 Processor -- start 2024-08-20T01:51:09.313 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.307+0000 7f74539ac640 1 -- start start 2024-08-20T01:51:09.313 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.308+0000 7f74539ac640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f744c101560 0x7f744c1989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:09.313 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.308+0000 7f74539ac640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f744c1026b0 0x7f744c199010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:09.313 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.308+0000 7f74539ac640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f744c103070 0x7f744c199c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:09.313 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.308+0000 7f74539ac640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f744c06ae30 con 0x7f744c101560 2024-08-20T01:51:09.313 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.308+0000 7f74539ac640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f744c06acb0 con 0x7f744c103070 2024-08-20T01:51:09.314 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.308+0000 7f74539ac640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f744c06afb0 con 0x7f744c1026b0 2024-08-20T01:51:09.314 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.308+0000 7f7451748640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f744c101560 0x7f744c1989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:09.314 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.308+0000 7f7451748640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f744c101560 0x7f744c1989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54962/0 (socket says 172.21.15.79:54962) 2024-08-20T01:51:09.314 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.308+0000 7f7451748640 1 -- 172.21.15.79:0/379895209 learned_addr learned my addr 172.21.15.79:0/379895209 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:09.314 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.308+0000 7f7450f47640 1 --2- 172.21.15.79:0/379895209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f744c1026b0 0x7f744c199010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:09.314 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.308+0000 7f7451f49640 1 --2- 172.21.15.79:0/379895209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f744c103070 0x7f744c199c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:09.314 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.308+0000 7f7451748640 1 -- 172.21.15.79:0/379895209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f744c1026b0 msgr2=0x7f744c199010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:09.314 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.308+0000 7f7451748640 1 --2- 172.21.15.79:0/379895209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f744c1026b0 0x7f744c199010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:09.314 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.308+0000 7f7451748640 1 -- 172.21.15.79:0/379895209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f744c103070 msgr2=0x7f744c199c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:09.314 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.308+0000 7f7451748640 1 --2- 172.21.15.79:0/379895209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f744c103070 0x7f744c199c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:09.314 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.308+0000 7f7451748640 1 -- 172.21.15.79:0/379895209 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f744c19a500 con 0x7f744c101560 2024-08-20T01:51:09.315 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.308+0000 7f7451748640 1 --2- 172.21.15.79:0/379895209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f744c101560 0x7f744c1989c0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f7448005ab0 tx=0x7f74480042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:09.315 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.308+0000 7f74427fc640 1 -- 172.21.15.79:0/379895209 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f744803f030 con 0x7f744c101560 2024-08-20T01:51:09.315 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.308+0000 7f74539ac640 1 -- 172.21.15.79:0/379895209 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f744c19a790 con 0x7f744c101560 2024-08-20T01:51:09.315 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.308+0000 7f74427fc640 1 -- 172.21.15.79:0/379895209 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7448032e10 con 0x7f744c101560 2024-08-20T01:51:09.315 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.308+0000 7f74427fc640 1 -- 172.21.15.79:0/379895209 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7448035070 con 0x7f744c101560 2024-08-20T01:51:09.315 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.308+0000 7f74539ac640 1 -- 172.21.15.79:0/379895209 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f744c1a0ec0 con 0x7f744c101560 2024-08-20T01:51:09.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.311+0000 7f7456877740 1 Processor -- start 2024-08-20T01:51:09.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.311+0000 7f7456877740 1 -- start start 2024-08-20T01:51:09.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.311+0000 7f7456877740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b135a98d0 0x562b135abcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:09.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.311+0000 7f7456877740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b135ac200 0x562b135ae5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:09.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.311+0000 7f7456877740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b135aec40 0x562b135b1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:09.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.311+0000 7f7456877740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562b1351c360 con 0x562b135a98d0 2024-08-20T01:51:09.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.311+0000 7f7456877740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562b1350b860 con 0x562b135ac200 2024-08-20T01:51:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.311+0000 7f7456877740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562b1350f8a0 con 0x562b135aec40 2024-08-20T01:51:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.311+0000 7f7451f49640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b135a98d0 0x562b135abcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.311+0000 7f74427fc640 1 -- 172.21.15.79:0/379895209 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f7448042030 con 0x7f744c101560 2024-08-20T01:51:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.311+0000 7f7451f49640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b135a98d0 0x562b135abcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54976/0 (socket says 172.21.15.79:54976) 2024-08-20T01:51:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.311+0000 7f7450f47640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b135aec40 0x562b135b1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.311+0000 7f7451f49640 1 -- 172.21.15.79:0/2227486474 learned_addr learned my addr 172.21.15.79:0/2227486474 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.311+0000 7f7451748640 1 --2- 172.21.15.79:0/2227486474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b135ac200 0x562b135ae5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.312+0000 7f7451f49640 1 -- 172.21.15.79:0/2227486474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b135aec40 msgr2=0x562b135b1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.312+0000 7f7451f49640 1 --2- 172.21.15.79:0/2227486474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b135aec40 0x562b135b1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.312+0000 7f7451f49640 1 -- 172.21.15.79:0/2227486474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b135ac200 msgr2=0x562b135ae5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.312+0000 7f7451f49640 1 --2- 172.21.15.79:0/2227486474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b135ac200 0x562b135ae5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.312+0000 7f7451f49640 1 -- 172.21.15.79:0/2227486474 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b134b2e40 con 0x562b135a98d0 2024-08-20T01:51:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.312+0000 7f7451748640 1 --2- 172.21.15.79:0/2227486474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b135ac200 0x562b135ae5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:51:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.312+0000 7f7451f49640 1 --2- 172.21.15.79:0/2227486474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b135a98d0 0x562b135abcc0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f7444009f80 tx=0x7f7444010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf3d4f172734b4a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.312+0000 7f74377fe640 1 -- 172.21.15.79:0/2227486474 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7444003b70 con 0x562b135a98d0 2024-08-20T01:51:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.312+0000 7f74377fe640 1 -- 172.21.15.79:0/2227486474 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7444003d10 con 0x562b135a98d0 2024-08-20T01:51:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.312+0000 7f74377fe640 1 -- 172.21.15.79:0/2227486474 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7444011a00 con 0x562b135a98d0 2024-08-20T01:51:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.312+0000 7f74427fc640 1 --2- 172.21.15.79:0/379895209 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f74380b3bd0 0x7f74380b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.312+0000 7f7451748640 1 --2- 172.21.15.79:0/379895209 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f74380b3bd0 0x7f74380b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.312+0000 7f74427fc640 1 -- 172.21.15.79:0/379895209 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f7448104100 con 0x7f744c101560 2024-08-20T01:51:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.313+0000 7f7456877740 1 -- 172.21.15.79:0/2227486474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b135a98d0 msgr2=0x562b135abcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.313+0000 7f7451748640 1 --2- 172.21.15.79:0/379895209 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f74380b3bd0 0x7f74380b6090 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f74480caff0 tx=0x7f7448009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.313+0000 7f7456877740 1 --2- 172.21.15.79:0/2227486474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b135a98d0 0x562b135abcc0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f7444009f80 tx=0x7f7444010860 comp rx=0 tx=0).stop 2024-08-20T01:51:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.313+0000 7f7456877740 1 -- 172.21.15.79:0/2227486474 shutdown_connections 2024-08-20T01:51:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.313+0000 7f7456877740 1 --2- 172.21.15.79:0/2227486474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b135aec40 0x562b135b1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.313+0000 7f7456877740 1 --2- 172.21.15.79:0/2227486474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b135ac200 0x562b135ae5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.313+0000 7f7456877740 1 --2- 172.21.15.79:0/2227486474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b135a98d0 0x562b135abcc0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.313+0000 7f7456877740 1 -- 172.21.15.79:0/2227486474 >> 172.21.15.79:0/2227486474 conn(0x562b135a4a20 msgr2=0x562b135a57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.313+0000 7f7456877740 1 -- 172.21.15.79:0/2227486474 shutdown_connections 2024-08-20T01:51:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.313+0000 7f7456877740 1 -- 172.21.15.79:0/2227486474 wait complete. 2024-08-20T01:51:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.313+0000 7f7456877740 1 -- start start 2024-08-20T01:51:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.313+0000 7f7456877740 1 Processor -- start 2024-08-20T01:51:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.314+0000 7f7456877740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b135a98d0 0x562b135b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.314+0000 7f7456877740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b135ac200 0x562b135b3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.314+0000 7f7456877740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b135aec40 0x562b135b4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.314+0000 7f7456877740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562b13444ab0 con 0x562b135ac200 2024-08-20T01:51:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.314+0000 7f7456877740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562b13492780 con 0x562b135a98d0 2024-08-20T01:51:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.314+0000 7f7456877740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562b135b1c20 con 0x562b135aec40 2024-08-20T01:51:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.314+0000 7f7456877740 10 client.0 _ll_register_callbacks cb 0x562b1321aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:51:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.314+0000 7f7450f47640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b135ac200 0x562b135b3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.314+0000 7f7450f47640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b135ac200 0x562b135b3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54992/0 (socket says 172.21.15.79:54992) 2024-08-20T01:51:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.314+0000 7f7450f47640 1 -- 172.21.15.79:0/2825648864 learned_addr learned my addr 172.21.15.79:0/2825648864 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.314+0000 7f7451f49640 1 --2- 172.21.15.79:0/2825648864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b135a98d0 0x562b135b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.314+0000 7f7451f49640 1 --2- 172.21.15.79:0/2825648864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b135aec40 0x562b135b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.314+0000 7f7450f47640 1 -- 172.21.15.79:0/2825648864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b135aec40 msgr2=0x562b135b4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.314+0000 7f7450f47640 1 --2- 172.21.15.79:0/2825648864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b135aec40 0x562b135b4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.314+0000 7f7450f47640 1 -- 172.21.15.79:0/2825648864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b135a98d0 msgr2=0x562b135b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.314+0000 7f7450f47640 1 --2- 172.21.15.79:0/2825648864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b135a98d0 0x562b135b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.314+0000 7f7450f47640 1 -- 172.21.15.79:0/2825648864 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b1326e790 con 0x562b135ac200 2024-08-20T01:51:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.314+0000 7f7450f47640 1 --2- 172.21.15.79:0/2825648864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b135ac200 0x562b135b3730 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f743c012740 tx=0x7f743c012c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd3ee6858428561c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.314+0000 7f7434ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:51:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.314+0000 7f7434ff9640 1 -- 172.21.15.79:0/2825648864 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f743c00f920 con 0x562b135ac200 2024-08-20T01:51:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.314+0000 7f7434ff9640 1 -- 172.21.15.79:0/2825648864 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f743c00fac0 con 0x562b135ac200 2024-08-20T01:51:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.314+0000 7f7456877740 1 -- 172.21.15.79:0/2825648864 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562b134bae00 con 0x562b135ac200 2024-08-20T01:51:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.314+0000 7f7434ff9640 1 -- 172.21.15.79:0/2825648864 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7f743c00fcc0 con 0x562b135ac200 2024-08-20T01:51:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.314+0000 7f7456877740 10 client.18918 fetch_fsmap learned FSMap version 58 2024-08-20T01:51:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.315+0000 7f7456877740 1 -- 172.21.15.79:0/2825648864 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) -- 0x562b132e7620 con 0x562b135ac200 2024-08-20T01:51:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.315+0000 7f7434ff9640 1 -- 172.21.15.79:0/2825648864 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x562b134bae00 con 0x562b135ac200 2024-08-20T01:51:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.315+0000 7f7434ff9640 1 -- 172.21.15.79:0/2825648864 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 58) ==== 8406+0+0 (secure 0 0 0) 0x7f743c01c420 con 0x562b135ac200 2024-08-20T01:51:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.315+0000 7f7456877740 10 client.18918 fetch_fsmap finished waiting for FSMap version 58 2024-08-20T01:51:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.315+0000 7f7456877740 10 client.18918 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:51:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.315+0000 7f7456877740 20 client.18918 populate_metadata read hostname 'smithi079' 2024-08-20T01:51:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.315+0000 7f7456877740 1 --2- 172.21.15.79:0/2825648864 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x562b135bea10 0x562b135c0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.315+0000 7f7456877740 4 client.18918 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:51:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.315+0000 7f7456877740 1 -- 172.21.15.79:0/2825648864 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b1351e2b0 con 0x562b135bea10 2024-08-20T01:51:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.315+0000 7f7451f49640 1 --2- 172.21.15.79:0/2825648864 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x562b135bea10 0x562b135c0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.316+0000 7f7434ff9640 10 client.18918 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:51:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.316+0000 7f7451f49640 1 --2- 172.21.15.79:0/2825648864 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x562b135bea10 0x562b135c0e40 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23c7df881f29dd50 server_cookie=e19b6b5b3ee052db in_seq=0 out_seq=0 2024-08-20T01:51:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.316+0000 7f7434ff9640 1 -- 172.21.15.79:0/2825648864 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562b1351e2b0 con 0x562b135bea10 2024-08-20T01:51:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.316+0000 7f7434ff9640 10 client.18918 handle_command_reply: tid=0 2024-08-20T01:51:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.316+0000 7f7456877740 1 client.18918 shutdown 2024-08-20T01:51:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.316+0000 7f7456877740 1 -- 172.21.15.79:0/2825648864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b135ac200 msgr2=0x562b135b3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.316+0000 7f7456877740 1 --2- 172.21.15.79:0/2825648864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b135ac200 0x562b135b3730 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f743c012740 tx=0x7f743c012c00 comp rx=0 tx=0).stop 2024-08-20T01:51:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.316+0000 7f7456877740 1 -- 172.21.15.79:0/2825648864 shutdown_connections 2024-08-20T01:51:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.316+0000 7f7456877740 1 --2- 172.21.15.79:0/2825648864 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x562b135bea10 0x562b135c0e40 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:09.328 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.316+0000 7f7456877740 1 --2- 172.21.15.79:0/2825648864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b135aec40 0x562b135b4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:09.328 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.316+0000 7f7456877740 1 --2- 172.21.15.79:0/2825648864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b135ac200 0x562b135b3730 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:09.328 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.316+0000 7f7434ff9640 0 client.18918 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:51:09.328 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.316+0000 7f7456877740 1 --2- 172.21.15.79:0/2825648864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b135a98d0 0x562b135b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:09.328 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.316+0000 7f7456877740 1 -- 172.21.15.79:0/2825648864 >> 172.21.15.79:0/2825648864 conn(0x562b135a4a20 msgr2=0x562b135a3ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:09.328 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.316+0000 7f7456877740 1 -- 172.21.15.79:0/2825648864 shutdown_connections 2024-08-20T01:51:09.328 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.316+0000 7f7456877740 1 -- 172.21.15.79:0/2825648864 wait complete. 2024-08-20T01:51:09.328 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.317+0000 7f7456877740 20 client.18918 trim_cache size 0 max 16384 2024-08-20T01:51:09.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.331+0000 7f7456877740 1 Processor -- start 2024-08-20T01:51:09.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.331+0000 7f7456877740 1 -- start start 2024-08-20T01:51:09.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.331+0000 7f7456877740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b135a98d0 0x562b135a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:09.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.331+0000 7f7456877740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b135ac200 0x562b135a3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:09.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.331+0000 7f7456877740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b135aec40 0x562b135c5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:09.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.331+0000 7f7456877740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f744c1a9a80 con 0x562b135a98d0 2024-08-20T01:51:09.338 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.331+0000 7f7456877740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f744c1ab7a0 con 0x562b135ac200 2024-08-20T01:51:09.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.331+0000 7f7456877740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f744c1aa210 con 0x562b135aec40 2024-08-20T01:51:09.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.331+0000 7f7451f49640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b135a98d0 0x562b135a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:09.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.331+0000 7f7451f49640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b135a98d0 0x562b135a39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55002/0 (socket says 172.21.15.79:55002) 2024-08-20T01:51:09.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.331+0000 7f7451f49640 1 -- 172.21.15.79:0/3681377789 learned_addr learned my addr 172.21.15.79:0/3681377789 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:09.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.331+0000 7f7451f49640 1 --2- 172.21.15.79:0/3681377789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b135aec40 0x562b135c5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:09.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.331+0000 7f7450f47640 1 --2- 172.21.15.79:0/3681377789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b135ac200 0x562b135a3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:09.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.331+0000 7f7451f49640 1 -- 172.21.15.79:0/3681377789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b135aec40 msgr2=0x562b135c5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:09.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.331+0000 7f7451f49640 1 --2- 172.21.15.79:0/3681377789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b135aec40 0x562b135c5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:09.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.331+0000 7f7451f49640 1 -- 172.21.15.79:0/3681377789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b135ac200 msgr2=0x562b135a3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:09.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.331+0000 7f7451f49640 1 --2- 172.21.15.79:0/3681377789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b135ac200 0x562b135a3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:09.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.331+0000 7f7451f49640 1 -- 172.21.15.79:0/3681377789 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b135ac030 con 0x562b135a98d0 2024-08-20T01:51:09.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.331+0000 7f7450f47640 1 --2- 172.21.15.79:0/3681377789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b135ac200 0x562b135a3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:51:09.339 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.331+0000 7f7451f49640 1 --2- 172.21.15.79:0/3681377789 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b135a98d0 0x562b135a39d0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f7444010d60 tx=0x7f7444009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=298cf073a1c949ce server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.331+0000 7f7436ffd640 1 -- 172.21.15.79:0/3681377789 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7444025040 con 0x562b135a98d0 2024-08-20T01:51:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.332+0000 7f7436ffd640 1 -- 172.21.15.79:0/3681377789 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7444030070 con 0x562b135a98d0 2024-08-20T01:51:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.332+0000 7f7436ffd640 1 -- 172.21.15.79:0/3681377789 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7444013b90 con 0x562b135a98d0 2024-08-20T01:51:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.332+0000 7f7456877740 1 -- 172.21.15.79:0/3681377789 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b135a98d0 msgr2=0x562b135a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.332+0000 7f7456877740 1 --2- 172.21.15.79:0/3681377789 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b135a98d0 0x562b135a39d0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f7444010d60 tx=0x7f7444009b90 comp rx=0 tx=0).stop 2024-08-20T01:51:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.332+0000 7f7456877740 1 -- 172.21.15.79:0/3681377789 shutdown_connections 2024-08-20T01:51:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.332+0000 7f7456877740 1 --2- 172.21.15.79:0/3681377789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b135aec40 0x562b135c5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.332+0000 7f7456877740 1 --2- 172.21.15.79:0/3681377789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b135ac200 0x562b135a3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.332+0000 7f7456877740 1 --2- 172.21.15.79:0/3681377789 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b135a98d0 0x562b135a39d0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.332+0000 7f7456877740 1 -- 172.21.15.79:0/3681377789 >> 172.21.15.79:0/3681377789 conn(0x562b135a4a20 msgr2=0x562b135a32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.332+0000 7f7456877740 1 -- 172.21.15.79:0/3681377789 shutdown_connections 2024-08-20T01:51:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.332+0000 7f7456877740 1 -- 172.21.15.79:0/3681377789 wait complete. 2024-08-20T01:51:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.332+0000 7f7456877740 1 -- start start 2024-08-20T01:51:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.332+0000 7f7456877740 1 Processor -- start 2024-08-20T01:51:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.333+0000 7f7456877740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b135a98d0 0x562b135bab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.333+0000 7f7456877740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b135ac200 0x562b135b9870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.333+0000 7f7456877740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b135aec40 0x562b135b9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.333+0000 7f7456877740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f744c1ab070 con 0x562b135a98d0 2024-08-20T01:51:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.333+0000 7f7456877740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f744c1aa970 con 0x562b135aec40 2024-08-20T01:51:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.333+0000 7f7456877740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f744c1a7a60 con 0x562b135ac200 2024-08-20T01:51:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.333+0000 7f7456877740 10 client.0 _ll_register_callbacks cb 0x7f743c009850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:51:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.333+0000 7f7451f49640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b135a98d0 0x562b135bab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.333+0000 7f7451f49640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b135a98d0 0x562b135bab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55012/0 (socket says 172.21.15.79:55012) 2024-08-20T01:51:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.333+0000 7f7451f49640 1 -- 172.21.15.79:0/2243914718 learned_addr learned my addr 172.21.15.79:0/2243914718 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.333+0000 7f7450f47640 1 --2- 172.21.15.79:0/2243914718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b135ac200 0x562b135b9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.333+0000 7f7451f49640 1 --2- 172.21.15.79:0/2243914718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b135aec40 0x562b135b9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:09.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.333+0000 7f7451f49640 1 -- 172.21.15.79:0/2243914718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b135ac200 msgr2=0x562b135b9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:09.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.333+0000 7f7451f49640 1 --2- 172.21.15.79:0/2243914718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b135ac200 0x562b135b9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:09.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.333+0000 7f7451f49640 1 -- 172.21.15.79:0/2243914718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b135aec40 msgr2=0x562b135b9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:09.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.333+0000 7f7451f49640 1 --2- 172.21.15.79:0/2243914718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b135aec40 0x562b135b9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:09.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.333+0000 7f7451f49640 1 -- 172.21.15.79:0/2243914718 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b135ba5c0 con 0x562b135a98d0 2024-08-20T01:51:09.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.333+0000 7f7451f49640 1 --2- 172.21.15.79:0/2243914718 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b135a98d0 0x562b135bab70 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f7444013880 tx=0x7f7444011500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b31e36c4405bfa server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:09.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.333+0000 7f7434ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:51:09.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.333+0000 7f7434ff9640 1 -- 172.21.15.79:0/2243914718 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7444013370 con 0x562b135a98d0 2024-08-20T01:51:09.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.333+0000 7f7434ff9640 1 -- 172.21.15.79:0/2243914718 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f7444013930 con 0x562b135a98d0 2024-08-20T01:51:09.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.333+0000 7f7456877740 1 -- 172.21.15.79:0/2243914718 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7444030070 con 0x562b135a98d0 2024-08-20T01:51:09.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.334+0000 7f7434ff9640 1 -- 172.21.15.79:0/2243914718 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7f7444013b30 con 0x562b135a98d0 2024-08-20T01:51:09.342 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.334+0000 7f7456877740 10 client.18924 fetch_fsmap learned FSMap version 58 2024-08-20T01:51:09.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.334+0000 7f7456877740 1 -- 172.21.15.79:0/2243914718 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) -- 0x562b136296e0 con 0x562b135a98d0 2024-08-20T01:51:09.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.334+0000 7f7434ff9640 1 -- 172.21.15.79:0/2243914718 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7444030070 con 0x562b135a98d0 2024-08-20T01:51:09.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.334+0000 7f7434ff9640 1 -- 172.21.15.79:0/2243914718 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 58) ==== 8406+0+0 (secure 0 0 0) 0x7f744402b040 con 0x562b135a98d0 2024-08-20T01:51:09.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.334+0000 7f7456877740 10 client.18924 fetch_fsmap finished waiting for FSMap version 58 2024-08-20T01:51:09.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.334+0000 7f7456877740 10 client.18924 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:51:09.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.334+0000 7f7456877740 20 client.18924 populate_metadata read hostname 'smithi079' 2024-08-20T01:51:09.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.334+0000 7f7456877740 1 --2- 172.21.15.79:0/2243914718 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x562b13629f20 0x562b1362c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:09.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.334+0000 7f7456877740 4 client.18924 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:51:09.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.334+0000 7f7456877740 1 -- 172.21.15.79:0/2243914718 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562b13519d50 con 0x562b13629f20 2024-08-20T01:51:09.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.334+0000 7f7450f47640 1 --2- 172.21.15.79:0/2243914718 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x562b13629f20 0x562b1362c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:09.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.334+0000 7f7450f47640 1 --2- 172.21.15.79:0/2243914718 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x562b13629f20 0x562b1362c340 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6bda15a3c646a3d server_cookie=556a830e31db6a5 in_seq=0 out_seq=0 2024-08-20T01:51:09.343 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:09.334+0000 7f7434ff9640 10 client.18924 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:51:10.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:10 smithi175 ceph-mon[22392]: pgmap v762: 97 pgs: 97 active+clean; 12 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 313 KiB/s wr, 87 op/s 2024-08-20T01:51:10.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:10 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:51:10.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:10 smithi079 ceph-mon[18656]: pgmap v762: 97 pgs: 97 active+clean; 12 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 313 KiB/s wr, 87 op/s 2024-08-20T01:51:10.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:10 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:51:11.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:10 smithi081 ceph-mon[22209]: pgmap v762: 97 pgs: 97 active+clean; 12 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 313 KiB/s wr, 87 op/s 2024-08-20T01:51:11.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:10 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:51:11.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:11 smithi175 ceph-mon[22392]: Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-08-20T01:51:11.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:11 smithi079 ceph-mon[18656]: Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-08-20T01:51:12.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:11 smithi081 ceph-mon[22209]: Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-08-20T01:51:12.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:12 smithi175 ceph-mon[22392]: pgmap v763: 97 pgs: 97 active+clean; 12 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 134 KiB/s wr, 43 op/s 2024-08-20T01:51:12.929 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:12 smithi081 ceph-mon[22209]: pgmap v763: 97 pgs: 97 active+clean; 12 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 134 KiB/s wr, 43 op/s 2024-08-20T01:51:12.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:12 smithi079 ceph-mon[18656]: pgmap v763: 97 pgs: 97 active+clean; 12 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 134 KiB/s wr, 43 op/s 2024-08-20T01:51:14.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:14 smithi175 ceph-mon[22392]: pgmap v764: 97 pgs: 97 active+clean; 12 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 27 KiB/s wr, 20 op/s 2024-08-20T01:51:14.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:14 smithi079 ceph-mon[18656]: pgmap v764: 97 pgs: 97 active+clean; 12 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 27 KiB/s wr, 20 op/s 2024-08-20T01:51:15.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:14 smithi081 ceph-mon[22209]: pgmap v764: 97 pgs: 97 active+clean; 12 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 27 KiB/s wr, 20 op/s 2024-08-20T01:51:16.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:16 smithi175 ceph-mon[22392]: pgmap v765: 97 pgs: 97 active+clean; 12 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 25 KiB/s wr, 21 op/s 2024-08-20T01:51:16.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:16 smithi079 ceph-mon[18656]: pgmap v765: 97 pgs: 97 active+clean; 12 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 25 KiB/s wr, 21 op/s 2024-08-20T01:51:17.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:16 smithi081 ceph-mon[22209]: pgmap v765: 97 pgs: 97 active+clean; 12 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 25 KiB/s wr, 21 op/s 2024-08-20T01:51:18.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:18 smithi175 ceph-mon[22392]: pgmap v766: 97 pgs: 97 active+clean; 12 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 13 KiB/s wr, 19 op/s 2024-08-20T01:51:18.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:18 smithi175 ceph-mon[22392]: Health check update: 4 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-08-20T01:51:18.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:18 smithi079 ceph-mon[18656]: pgmap v766: 97 pgs: 97 active+clean; 12 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 13 KiB/s wr, 19 op/s 2024-08-20T01:51:18.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:18 smithi079 ceph-mon[18656]: Health check update: 4 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-08-20T01:51:19.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:18 smithi081 ceph-mon[22209]: pgmap v766: 97 pgs: 97 active+clean; 12 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 13 KiB/s wr, 19 op/s 2024-08-20T01:51:19.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:18 smithi081 ceph-mon[22209]: Health check update: 4 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-08-20T01:51:19.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:19 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:51:19.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:19 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:51:19.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:19 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:51:19.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:19 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:51:19.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:19 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:51:19.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:19 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:51:19.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:19 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:51:19.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:19 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:51:20.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:19 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:51:20.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:19 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:51:20.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:19 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:51:20.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:19 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:51:20.436 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:51:20.691 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:51:20.812 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:20 smithi079 ceph-mon[18656]: pgmap v767: 97 pgs: 97 active+clean; 12 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 7.4 KiB/s wr, 20 op/s 2024-08-20T01:51:20.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:20 smithi175 ceph-mon[22392]: pgmap v767: 97 pgs: 97 active+clean; 12 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 7.4 KiB/s wr, 20 op/s 2024-08-20T01:51:21.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:20 smithi081 ceph-mon[22209]: pgmap v767: 97 pgs: 97 active+clean; 12 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 7.4 KiB/s wr, 20 op/s 2024-08-20T01:51:21.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.154+0000 7f04fedf5640 1 -- 172.21.15.79:0/4221269726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f8108e20 msgr2=0x7f04f810f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:21.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.154+0000 7f04fedf5640 1 --2- 172.21.15.79:0/4221269726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f8108e20 0x7f04f810f620 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f04f0009ca0 tx=0x7f04f002a8c0 comp rx=0 tx=0).stop 2024-08-20T01:51:21.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.154+0000 7f04fedf5640 1 -- 172.21.15.79:0/4221269726 shutdown_connections 2024-08-20T01:51:21.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.154+0000 7f04fedf5640 1 --2- 172.21.15.79:0/4221269726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f8108e20 0x7f04f810f620 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:21.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.154+0000 7f04fedf5640 1 --2- 172.21.15.79:0/4221269726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04f81084a0 0x7f04f81088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:21.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.154+0000 7f04fedf5640 1 --2- 172.21.15.79:0/4221269726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04f8102a90 0x7f04f8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:21.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.154+0000 7f04fedf5640 1 -- 172.21.15.79:0/4221269726 >> 172.21.15.79:0/4221269726 conn(0x7f04f80fe540 msgr2=0x7f04f8100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:21.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.154+0000 7f04fedf5640 1 -- 172.21.15.79:0/4221269726 shutdown_connections 2024-08-20T01:51:21.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.155+0000 7f04fedf5640 1 -- 172.21.15.79:0/4221269726 wait complete. 2024-08-20T01:51:21.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.155+0000 7f04fedf5640 1 Processor -- start 2024-08-20T01:51:21.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.155+0000 7f04fedf5640 1 -- start start 2024-08-20T01:51:21.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.155+0000 7f04fedf5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04f8102a90 0x7f04f80751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:21.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.155+0000 7f04fedf5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04f81084a0 0x7f04f8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:21.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.155+0000 7f04fedf5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f8108e20 0x7f04f8075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:21.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.155+0000 7f04fedf5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f04f81129a0 con 0x7f04f8108e20 2024-08-20T01:51:21.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.155+0000 7f04fedf5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f04f8112820 con 0x7f04f8102a90 2024-08-20T01:51:21.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.155+0000 7f04fedf5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f04f8112b20 con 0x7f04f81084a0 2024-08-20T01:51:21.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.155+0000 7f04fcb91640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04f8102a90 0x7f04f80751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:21.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.156+0000 7f04fcb91640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04f8102a90 0x7f04f80751d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:40068/0 (socket says 172.21.15.79:40068) 2024-08-20T01:51:21.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.156+0000 7f04f7fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04f81084a0 0x7f04f8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:21.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.156+0000 7f04fd392640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f8108e20 0x7f04f8075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:21.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.156+0000 7f04fcb91640 1 -- 172.21.15.79:0/112291496 learned_addr learned my addr 172.21.15.79:0/112291496 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:21.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.156+0000 7f04fcb91640 1 -- 172.21.15.79:0/112291496 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04f81084a0 msgr2=0x7f04f8075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:21.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.156+0000 7f04fcb91640 1 --2- 172.21.15.79:0/112291496 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04f81084a0 0x7f04f8075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:21.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.156+0000 7f04fcb91640 1 -- 172.21.15.79:0/112291496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f8108e20 msgr2=0x7f04f8075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:21.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.156+0000 7f04fcb91640 1 --2- 172.21.15.79:0/112291496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f8108e20 0x7f04f8075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:21.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.156+0000 7f04fcb91640 1 -- 172.21.15.79:0/112291496 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04f81a72b0 con 0x7f04f8102a90 2024-08-20T01:51:21.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.156+0000 7f04fcb91640 1 --2- 172.21.15.79:0/112291496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04f8102a90 0x7f04f80751d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f04ec00d950 tx=0x7f04ec00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:21.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.156+0000 7f04f5ffb640 1 -- 172.21.15.79:0/112291496 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ec017070 con 0x7f04f8102a90 2024-08-20T01:51:21.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.156+0000 7f04f5ffb640 1 -- 172.21.15.79:0/112291496 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f04ec009c30 con 0x7f04f8102a90 2024-08-20T01:51:21.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.156+0000 7f04f5ffb640 1 -- 172.21.15.79:0/112291496 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ec00f620 con 0x7f04f8102a90 2024-08-20T01:51:21.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.156+0000 7f04fedf5640 1 -- 172.21.15.79:0/112291496 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04f81a75a0 con 0x7f04f8102a90 2024-08-20T01:51:21.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.157+0000 7f04fedf5640 1 -- 172.21.15.79:0/112291496 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04f81a7a90 con 0x7f04f8102a90 2024-08-20T01:51:21.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.159+0000 7f04f5ffb640 1 -- 172.21.15.79:0/112291496 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f04ec010460 con 0x7f04f8102a90 2024-08-20T01:51:21.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.159+0000 7f05011ee740 1 Processor -- start 2024-08-20T01:51:21.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.159+0000 7f05011ee740 1 -- start start 2024-08-20T01:51:21.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.159+0000 7f05011ee740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aab0ebd830 0x55aab0ebdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:21.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.159+0000 7f05011ee740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aab0ebe150 0x55aab0ec9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:21.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.159+0000 7f05011ee740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aab0eca0e0 0x55aab0ecc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:21.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.159+0000 7f05011ee740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55aab0e348e0 con 0x55aab0eca0e0 2024-08-20T01:51:21.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.159+0000 7f05011ee740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55aab0e23de0 con 0x55aab0ebd830 2024-08-20T01:51:21.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.159+0000 7f05011ee740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55aab0e27e20 con 0x55aab0ebe150 2024-08-20T01:51:21.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.159+0000 7f04fd392640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aab0ebd830 0x55aab0ebdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:21.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.159+0000 7f04f7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aab0eca0e0 0x55aab0ecc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:21.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.159+0000 7f04fd392640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aab0ebd830 0x55aab0ebdc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:40072/0 (socket says 172.21.15.79:40072) 2024-08-20T01:51:21.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.159+0000 7f04fd392640 1 -- 172.21.15.79:0/2954870639 learned_addr learned my addr 172.21.15.79:0/2954870639 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:21.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.159+0000 7f04fcb91640 1 --2- 172.21.15.79:0/2954870639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aab0ebe150 0x55aab0ec9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:21.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.160+0000 7f04f5ffb640 1 --2- 172.21.15.79:0/112291496 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f04e80b3bd0 0x7f04e80b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:21.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.160+0000 7f04fd392640 1 -- 172.21.15.79:0/2954870639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aab0ebe150 msgr2=0x55aab0ec9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:21.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.160+0000 7f04fd392640 1 --2- 172.21.15.79:0/2954870639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aab0ebe150 0x55aab0ec9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:21.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.160+0000 7f04fd392640 1 -- 172.21.15.79:0/2954870639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aab0eca0e0 msgr2=0x55aab0ecc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:21.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.160+0000 7f04fd392640 1 --2- 172.21.15.79:0/2954870639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aab0eca0e0 0x55aab0ecc4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:21.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.160+0000 7f04fd392640 1 -- 172.21.15.79:0/2954870639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aab0b83650 con 0x55aab0ebd830 2024-08-20T01:51:21.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.160+0000 7f04f5ffb640 1 -- 172.21.15.79:0/112291496 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f04ec0e37b0 con 0x7f04f8102a90 2024-08-20T01:51:21.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.160+0000 7f04fd392640 1 --2- 172.21.15.79:0/112291496 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f04e80b3bd0 0x7f04e80b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:21.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.160+0000 7f04fd392640 1 --2- 172.21.15.79:0/2954870639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aab0ebd830 0x55aab0ebdc10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f04f002aeb0 tx=0x7f04f0031450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=359fc0003faf5e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:21.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.160+0000 7f04e2ffd640 1 -- 172.21.15.79:0/2954870639 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f0031a20 con 0x55aab0ebd830 2024-08-20T01:51:21.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.160+0000 7f04e2ffd640 1 -- 172.21.15.79:0/2954870639 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f04f0036030 con 0x55aab0ebd830 2024-08-20T01:51:21.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.160+0000 7f04e2ffd640 1 -- 172.21.15.79:0/2954870639 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f00307c0 con 0x55aab0ebd830 2024-08-20T01:51:21.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.161+0000 7f05011ee740 1 -- 172.21.15.79:0/2954870639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aab0ebd830 msgr2=0x55aab0ebdc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:21.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.161+0000 7f05011ee740 1 --2- 172.21.15.79:0/2954870639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aab0ebd830 0x55aab0ebdc10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f04f002aeb0 tx=0x7f04f0031450 comp rx=0 tx=0).stop 2024-08-20T01:51:21.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.161+0000 7f04fd392640 1 --2- 172.21.15.79:0/112291496 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f04e80b3bd0 0x7f04e80b6090 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f04f0031920 tx=0x7f04f004b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:21.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.161+0000 7f05011ee740 1 -- 172.21.15.79:0/2954870639 shutdown_connections 2024-08-20T01:51:21.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.161+0000 7f05011ee740 1 --2- 172.21.15.79:0/2954870639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aab0eca0e0 0x55aab0ecc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:21.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.161+0000 7f05011ee740 1 --2- 172.21.15.79:0/2954870639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aab0ebe150 0x55aab0ec9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:21.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.161+0000 7f05011ee740 1 --2- 172.21.15.79:0/2954870639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aab0ebd830 0x55aab0ebdc10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:21.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.161+0000 7f05011ee740 1 -- 172.21.15.79:0/2954870639 >> 172.21.15.79:0/2954870639 conn(0x55aab0ebb660 msgr2=0x55aab0ebc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:21.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.161+0000 7f05011ee740 1 -- 172.21.15.79:0/2954870639 shutdown_connections 2024-08-20T01:51:21.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.161+0000 7f05011ee740 1 -- 172.21.15.79:0/2954870639 wait complete. 2024-08-20T01:51:21.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.162+0000 7f05011ee740 1 -- start start 2024-08-20T01:51:21.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.162+0000 7f05011ee740 1 Processor -- start 2024-08-20T01:51:21.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.162+0000 7f05011ee740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aab0ebd830 0x55aab0ec7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:21.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.162+0000 7f05011ee740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aab0ebe150 0x55aab0ec7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:21.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.162+0000 7f05011ee740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aab0eca0e0 0x55aab0ec7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:21.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.162+0000 7f05011ee740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55aab0c86700 con 0x55aab0ebd830 2024-08-20T01:51:21.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.162+0000 7f05011ee740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55aab0daa7c0 con 0x55aab0ebe150 2024-08-20T01:51:21.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.162+0000 7f05011ee740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55aab0eccc10 con 0x55aab0eca0e0 2024-08-20T01:51:21.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.162+0000 7f05011ee740 10 client.0 _ll_register_callbacks cb 0x55aab0e1d6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:51:21.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.162+0000 7f04f7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aab0ebe150 0x55aab0ec7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:21.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.162+0000 7f04fcb91640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aab0ebd830 0x55aab0ec7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:21.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.162+0000 7f04f7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aab0ebe150 0x55aab0ec7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:40078/0 (socket says 172.21.15.79:40078) 2024-08-20T01:51:21.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.162+0000 7f04f7fff640 1 -- 172.21.15.79:0/341395894 learned_addr learned my addr 172.21.15.79:0/341395894 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:21.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.162+0000 7f04fd392640 1 --2- 172.21.15.79:0/341395894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aab0eca0e0 0x55aab0ec7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:21.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.163+0000 7f04f7fff640 1 -- 172.21.15.79:0/341395894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aab0eca0e0 msgr2=0x55aab0ec7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:21.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.163+0000 7f04f7fff640 1 --2- 172.21.15.79:0/341395894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aab0eca0e0 0x55aab0ec7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:21.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.163+0000 7f04f7fff640 1 -- 172.21.15.79:0/341395894 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aab0ebd830 msgr2=0x55aab0ec7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:21.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.163+0000 7f04f7fff640 1 --2- 172.21.15.79:0/341395894 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aab0ebd830 0x55aab0ec7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:21.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.163+0000 7f04f7fff640 1 -- 172.21.15.79:0/341395894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aab0ed5fa0 con 0x55aab0ebe150 2024-08-20T01:51:21.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.163+0000 7f04f7fff640 1 --2- 172.21.15.79:0/341395894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aab0ebe150 0x55aab0ec7550 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f04e4012720 tx=0x7f04e4012be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85524c0f26b7fda2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:21.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.163+0000 7f04d7fff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:51:21.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.163+0000 7f04d7fff640 1 -- 172.21.15.79:0/341395894 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e400f920 con 0x55aab0ebe150 2024-08-20T01:51:21.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.163+0000 7f05011ee740 1 -- 172.21.15.79:0/341395894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55aab0dd3100 con 0x55aab0ebe150 2024-08-20T01:51:21.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.163+0000 7f04d7fff640 1 -- 172.21.15.79:0/341395894 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f04e400fac0 con 0x55aab0ebe150 2024-08-20T01:51:21.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.163+0000 7f04d7fff640 1 -- 172.21.15.79:0/341395894 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f04e400fd00 con 0x55aab0ebe150 2024-08-20T01:51:21.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.163+0000 7f05011ee740 10 client.28049 fetch_fsmap learned FSMap version 59 2024-08-20T01:51:21.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.163+0000 7f05011ee740 1 -- 172.21.15.79:0/341395894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) -- 0x55aab0ed8990 con 0x55aab0ebe150 2024-08-20T01:51:21.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.163+0000 7f04d7fff640 1 -- 172.21.15.79:0/341395894 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55aab0dd3100 con 0x55aab0ebe150 2024-08-20T01:51:21.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.163+0000 7f04d7fff640 1 -- 172.21.15.79:0/341395894 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 59) ==== 8410+0+0 (secure 0 0 0) 0x7f04e4010430 con 0x55aab0ebe150 2024-08-20T01:51:21.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.163+0000 7f05011ee740 10 client.28049 fetch_fsmap finished waiting for FSMap version 59 2024-08-20T01:51:21.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.164+0000 7f05011ee740 10 client.28049 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:51:21.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.164+0000 7f05011ee740 20 client.28049 populate_metadata read hostname 'smithi079' 2024-08-20T01:51:21.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.164+0000 7f05011ee740 1 --2- 172.21.15.79:0/341395894 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55aab0ed9ea0 0x55aab0edc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:21.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.164+0000 7f05011ee740 4 client.28049 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:51:21.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.164+0000 7f05011ee740 1 -- 172.21.15.79:0/341395894 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aab0e36830 con 0x55aab0ed9ea0 2024-08-20T01:51:21.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.164+0000 7f04fcb91640 1 --2- 172.21.15.79:0/341395894 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55aab0ed9ea0 0x55aab0edc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:21.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.164+0000 7f04d7fff640 10 client.28049 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:51:21.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.164+0000 7f04fcb91640 1 --2- 172.21.15.79:0/341395894 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55aab0ed9ea0 0x55aab0edc330 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7524cda431e05f75 server_cookie=8a98bec1b9c68224 in_seq=0 out_seq=0 2024-08-20T01:51:21.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.165+0000 7f04d7fff640 1 -- 172.21.15.79:0/341395894 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55aab0e36830 con 0x55aab0ed9ea0 2024-08-20T01:51:21.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.165+0000 7f04d7fff640 10 client.28049 handle_command_reply: tid=0 2024-08-20T01:51:21.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.165+0000 7f05011ee740 1 client.28049 shutdown 2024-08-20T01:51:21.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.165+0000 7f05011ee740 1 -- 172.21.15.79:0/341395894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aab0ebe150 msgr2=0x55aab0ec7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:21.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.165+0000 7f05011ee740 1 --2- 172.21.15.79:0/341395894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aab0ebe150 0x55aab0ec7550 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f04e4012720 tx=0x7f04e4012be0 comp rx=0 tx=0).stop 2024-08-20T01:51:21.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.165+0000 7f05011ee740 1 -- 172.21.15.79:0/341395894 shutdown_connections 2024-08-20T01:51:21.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.165+0000 7f05011ee740 1 --2- 172.21.15.79:0/341395894 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55aab0ed9ea0 0x55aab0edc330 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:21.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.165+0000 7f05011ee740 1 --2- 172.21.15.79:0/341395894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aab0eca0e0 0x55aab0ec7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:21.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.165+0000 7f05011ee740 1 --2- 172.21.15.79:0/341395894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aab0ebe150 0x55aab0ec7550 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:21.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.165+0000 7f05011ee740 1 --2- 172.21.15.79:0/341395894 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aab0ebd830 0x55aab0ec7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:21.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.165+0000 7f05011ee740 1 -- 172.21.15.79:0/341395894 >> 172.21.15.79:0/341395894 conn(0x55aab0ebb660 msgr2=0x55aab0ec1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:21.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.165+0000 7f04d7fff640 0 client.28049 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:51:21.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.165+0000 7f05011ee740 1 -- 172.21.15.79:0/341395894 shutdown_connections 2024-08-20T01:51:21.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.165+0000 7f05011ee740 1 -- 172.21.15.79:0/341395894 wait complete. 2024-08-20T01:51:21.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.165+0000 7f05011ee740 20 client.28049 trim_cache size 0 max 16384 2024-08-20T01:51:21.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.182+0000 7f05011ee740 1 Processor -- start 2024-08-20T01:51:21.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.183+0000 7f05011ee740 1 -- start start 2024-08-20T01:51:21.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.183+0000 7f05011ee740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aab0ebd830 0x55aab0ebce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:21.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.183+0000 7f05011ee740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aab0ebe150 0x55aab0ee1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:21.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.183+0000 7f05011ee740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aab0eca0e0 0x55aab0ee2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:21.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.183+0000 7f05011ee740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f04f81b0200 con 0x55aab0eca0e0 2024-08-20T01:51:21.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.183+0000 7f05011ee740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f04f81b1f20 con 0x55aab0ebd830 2024-08-20T01:51:21.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.183+0000 7f05011ee740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f04f81b0990 con 0x55aab0ebe150 2024-08-20T01:51:21.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.183+0000 7f04fd392640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aab0eca0e0 0x55aab0ee2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:21.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.183+0000 7f04fd392640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aab0eca0e0 0x55aab0ee2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43956/0 (socket says 172.21.15.79:43956) 2024-08-20T01:51:21.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.183+0000 7f04fd392640 1 -- 172.21.15.79:0/413807550 learned_addr learned my addr 172.21.15.79:0/413807550 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:21.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.183+0000 7f04fcb91640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aab0ebd830 0x55aab0ebce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:21.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.183+0000 7f04f7fff640 1 --2- 172.21.15.79:0/413807550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aab0ebe150 0x55aab0ee1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:21.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.183+0000 7f04fd392640 1 -- 172.21.15.79:0/413807550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aab0ebe150 msgr2=0x55aab0ee1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:21.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.183+0000 7f04fd392640 1 --2- 172.21.15.79:0/413807550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aab0ebe150 0x55aab0ee1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:21.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.183+0000 7f04fd392640 1 -- 172.21.15.79:0/413807550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aab0ebd830 msgr2=0x55aab0ebce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:21.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.183+0000 7f04fd392640 1 --2- 172.21.15.79:0/413807550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aab0ebd830 0x55aab0ebce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:21.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.183+0000 7f04fd392640 1 -- 172.21.15.79:0/413807550 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aab0ebc0e0 con 0x55aab0eca0e0 2024-08-20T01:51:21.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.183+0000 7f04fcb91640 1 --2- 172.21.15.79:0/413807550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aab0ebd830 0x55aab0ebce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:51:21.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.183+0000 7f04f7fff640 1 --2- 172.21.15.79:0/413807550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aab0ebe150 0x55aab0ee1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:51:21.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.183+0000 7f04fd392640 1 --2- 172.21.15.79:0/413807550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aab0eca0e0 0x55aab0ee2180 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f04f0009ca0 tx=0x7f04f0050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f53b14109e5c0bf3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:21.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.184+0000 7f04e27fc640 1 -- 172.21.15.79:0/413807550 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f0031980 con 0x55aab0eca0e0 2024-08-20T01:51:21.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.184+0000 7f04e27fc640 1 -- 172.21.15.79:0/413807550 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f04f0036040 con 0x55aab0eca0e0 2024-08-20T01:51:21.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.184+0000 7f04e27fc640 1 -- 172.21.15.79:0/413807550 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f00305c0 con 0x55aab0eca0e0 2024-08-20T01:51:21.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.184+0000 7f05011ee740 1 -- 172.21.15.79:0/413807550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aab0eca0e0 msgr2=0x55aab0ee2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:21.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.184+0000 7f05011ee740 1 --2- 172.21.15.79:0/413807550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aab0eca0e0 0x55aab0ee2180 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f04f0009ca0 tx=0x7f04f0050000 comp rx=0 tx=0).stop 2024-08-20T01:51:21.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.184+0000 7f05011ee740 1 -- 172.21.15.79:0/413807550 shutdown_connections 2024-08-20T01:51:21.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.185+0000 7f05011ee740 1 --2- 172.21.15.79:0/413807550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aab0eca0e0 0x55aab0ee2180 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:21.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.185+0000 7f05011ee740 1 --2- 172.21.15.79:0/413807550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aab0ebe150 0x55aab0ee1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:21.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.185+0000 7f05011ee740 1 --2- 172.21.15.79:0/413807550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aab0ebd830 0x55aab0ebce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:21.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.185+0000 7f05011ee740 1 -- 172.21.15.79:0/413807550 >> 172.21.15.79:0/413807550 conn(0x55aab0ebb660 msgr2=0x55aab0ebc770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:21.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.185+0000 7f05011ee740 1 -- 172.21.15.79:0/413807550 shutdown_connections 2024-08-20T01:51:21.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.185+0000 7f05011ee740 1 -- 172.21.15.79:0/413807550 wait complete. 2024-08-20T01:51:21.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.185+0000 7f05011ee740 1 -- start start 2024-08-20T01:51:21.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.185+0000 7f05011ee740 1 Processor -- start 2024-08-20T01:51:21.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.185+0000 7f05011ee740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aab0ebd830 0x55aab0ed20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:21.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.185+0000 7f05011ee740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aab0ebe150 0x55aab0ed25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:21.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.185+0000 7f05011ee740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aab0eca0e0 0x55aab0ec3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:21.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.185+0000 7f05011ee740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f04f81b17f0 con 0x55aab0ebe150 2024-08-20T01:51:21.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.185+0000 7f05011ee740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f04f81b10f0 con 0x55aab0eca0e0 2024-08-20T01:51:21.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.185+0000 7f05011ee740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f04f81ae1e0 con 0x55aab0ebd830 2024-08-20T01:51:21.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.185+0000 7f05011ee740 10 client.0 _ll_register_callbacks cb 0x7f04e4009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:51:21.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.186+0000 7f04f7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aab0ebe150 0x55aab0ed25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:21.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.186+0000 7f04f7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aab0ebe150 0x55aab0ed25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43970/0 (socket says 172.21.15.79:43970) 2024-08-20T01:51:21.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.186+0000 7f04f7fff640 1 -- 172.21.15.79:0/1359951319 learned_addr learned my addr 172.21.15.79:0/1359951319 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:21.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.186+0000 7f04fd392640 1 --2- 172.21.15.79:0/1359951319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aab0eca0e0 0x55aab0ec3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:21.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.186+0000 7f04fcb91640 1 --2- 172.21.15.79:0/1359951319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aab0ebd830 0x55aab0ed20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:21.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.186+0000 7f04f7fff640 1 -- 172.21.15.79:0/1359951319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aab0ebd830 msgr2=0x55aab0ed20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:21.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.186+0000 7f04f7fff640 1 --2- 172.21.15.79:0/1359951319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aab0ebd830 0x55aab0ed20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:21.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.186+0000 7f04f7fff640 1 -- 172.21.15.79:0/1359951319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aab0eca0e0 msgr2=0x55aab0ec3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:21.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.186+0000 7f04f7fff640 1 --2- 172.21.15.79:0/1359951319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aab0eca0e0 0x55aab0ec3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:21.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.186+0000 7f04f7fff640 1 -- 172.21.15.79:0/1359951319 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aab0ec3f50 con 0x55aab0ebe150 2024-08-20T01:51:21.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.186+0000 7f04fd392640 1 --2- 172.21.15.79:0/1359951319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aab0eca0e0 0x55aab0ec3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:51:21.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.186+0000 7f04f7fff640 1 --2- 172.21.15.79:0/1359951319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aab0ebe150 0x55aab0ed25f0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f04e4009e20 tx=0x7f04e400f830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a627b99e5b8db6a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:21.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.186+0000 7f04d7fff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:51:21.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.186+0000 7f04d7fff640 1 -- 172.21.15.79:0/1359951319 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e4010640 con 0x55aab0ebe150 2024-08-20T01:51:21.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.186+0000 7f04d7fff640 1 -- 172.21.15.79:0/1359951319 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f04e400f920 con 0x55aab0ebe150 2024-08-20T01:51:21.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.186+0000 7f05011ee740 1 -- 172.21.15.79:0/1359951319 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04f0036040 con 0x55aab0ebe150 2024-08-20T01:51:21.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.186+0000 7f04d7fff640 1 -- 172.21.15.79:0/1359951319 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f04e400fb20 con 0x55aab0ebe150 2024-08-20T01:51:21.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.186+0000 7f05011ee740 10 client.18942 fetch_fsmap learned FSMap version 59 2024-08-20T01:51:21.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.186+0000 7f05011ee740 1 -- 172.21.15.79:0/1359951319 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) -- 0x55aab0f44650 con 0x55aab0ebe150 2024-08-20T01:51:21.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.187+0000 7f04d7fff640 1 -- 172.21.15.79:0/1359951319 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f04f0036040 con 0x55aab0ebe150 2024-08-20T01:51:21.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.187+0000 7f04d7fff640 1 -- 172.21.15.79:0/1359951319 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 59) ==== 8410+0+0 (secure 0 0 0) 0x7f04e40039b0 con 0x55aab0ebe150 2024-08-20T01:51:21.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.187+0000 7f05011ee740 10 client.18942 fetch_fsmap finished waiting for FSMap version 59 2024-08-20T01:51:21.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.187+0000 7f05011ee740 10 client.18942 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:51:21.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.187+0000 7f05011ee740 20 client.18942 populate_metadata read hostname 'smithi079' 2024-08-20T01:51:21.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.187+0000 7f05011ee740 1 --2- 172.21.15.79:0/1359951319 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55aab0f44e30 0x55aab0f47250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:21.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.187+0000 7f05011ee740 4 client.18942 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:51:21.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.187+0000 7f05011ee740 1 -- 172.21.15.79:0/1359951319 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55aab0e322d0 con 0x55aab0f44e30 2024-08-20T01:51:21.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.187+0000 7f04fcb91640 1 --2- 172.21.15.79:0/1359951319 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55aab0f44e30 0x55aab0f47250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:21.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.188+0000 7f04fcb91640 1 --2- 172.21.15.79:0/1359951319 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55aab0f44e30 0x55aab0f47250 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=897bc4fc93967f0e server_cookie=c332819444eb897e in_seq=0 out_seq=0 2024-08-20T01:51:21.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.188+0000 7f04d7fff640 10 client.18942 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:51:21.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.188+0000 7f04d7fff640 1 -- 172.21.15.79:0/1359951319 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55aab0e322d0 con 0x55aab0f44e30 2024-08-20T01:51:21.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.188+0000 7f04d7fff640 10 client.18942 handle_command_reply: tid=0 2024-08-20T01:51:21.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.188+0000 7f05011ee740 1 client.18942 shutdown 2024-08-20T01:51:21.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.188+0000 7f05011ee740 1 -- 172.21.15.79:0/1359951319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aab0ebe150 msgr2=0x55aab0ed25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:21.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.188+0000 7f05011ee740 1 --2- 172.21.15.79:0/1359951319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aab0ebe150 0x55aab0ed25f0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f04e4009e20 tx=0x7f04e400f830 comp rx=0 tx=0).stop 2024-08-20T01:51:21.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.188+0000 7f05011ee740 1 -- 172.21.15.79:0/1359951319 shutdown_connections 2024-08-20T01:51:21.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.188+0000 7f05011ee740 1 --2- 172.21.15.79:0/1359951319 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55aab0f44e30 0x55aab0f47250 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:21.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.188+0000 7f05011ee740 1 --2- 172.21.15.79:0/1359951319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aab0eca0e0 0x55aab0ec3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:21.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.188+0000 7f05011ee740 1 --2- 172.21.15.79:0/1359951319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aab0ebe150 0x55aab0ed25f0 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:21.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.188+0000 7f05011ee740 1 --2- 172.21.15.79:0/1359951319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aab0ebd830 0x55aab0ed20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:21.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.188+0000 7f05011ee740 1 -- 172.21.15.79:0/1359951319 >> 172.21.15.79:0/1359951319 conn(0x55aab0ebb660 msgr2=0x55aab0ec6f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:21.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.188+0000 7f04d7fff640 0 client.18942 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:51:21.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.188+0000 7f05011ee740 1 -- 172.21.15.79:0/1359951319 shutdown_connections 2024-08-20T01:51:21.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.188+0000 7f05011ee740 1 -- 172.21.15.79:0/1359951319 wait complete. 2024-08-20T01:51:21.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.188+0000 7f05011ee740 20 client.18942 trim_cache size 0 max 16384 2024-08-20T01:51:21.198 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:51:21.198 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-08-20T01:51:21.198 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-08-20T01:51:21.198 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:51:21.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.189+0000 7f04fedf5640 1 -- 172.21.15.79:0/112291496 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f04e80b3bd0 msgr2=0x7f04e80b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:21.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.189+0000 7f04fedf5640 1 --2- 172.21.15.79:0/112291496 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f04e80b3bd0 0x7f04e80b6090 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f04f0031920 tx=0x7f04f004b000 comp rx=0 tx=0).stop 2024-08-20T01:51:21.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.189+0000 7f04fedf5640 1 -- 172.21.15.79:0/112291496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04f8102a90 msgr2=0x7f04f80751d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:21.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.189+0000 7f04fedf5640 1 --2- 172.21.15.79:0/112291496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04f8102a90 0x7f04f80751d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f04ec00d950 tx=0x7f04ec00de10 comp rx=0 tx=0).stop 2024-08-20T01:51:21.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.189+0000 7f04fedf5640 1 -- 172.21.15.79:0/112291496 shutdown_connections 2024-08-20T01:51:21.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.189+0000 7f04fedf5640 1 --2- 172.21.15.79:0/112291496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f8108e20 0x7f04f8075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:21.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.189+0000 7f04fedf5640 1 --2- 172.21.15.79:0/112291496 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f04e80b3bd0 0x7f04e80b6090 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:21.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.189+0000 7f04fedf5640 1 --2- 172.21.15.79:0/112291496 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04f81084a0 0x7f04f8075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:21.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.189+0000 7f04fedf5640 1 --2- 172.21.15.79:0/112291496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04f8102a90 0x7f04f80751d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:21.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.189+0000 7f04fedf5640 1 -- 172.21.15.79:0/112291496 >> 172.21.15.79:0/112291496 conn(0x7f04f80fe540 msgr2=0x7f04f80fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:21.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.189+0000 7f04fedf5640 1 -- 172.21.15.79:0/112291496 shutdown_connections 2024-08-20T01:51:21.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:21.189+0000 7f04fedf5640 1 -- 172.21.15.79:0/112291496 wait complete. 2024-08-20T01:51:22.013 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T01:51:22.014 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:51:22.269 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:51:22.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:22 smithi079 ceph-mon[18656]: pgmap v768: 97 pgs: 97 active+clean; 12 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 21 op/s 2024-08-20T01:51:22.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.801+0000 7f44925bf640 1 -- 172.21.15.79:0/291462280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f448c101990 msgr2=0x7f448c101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:22.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.801+0000 7f44925bf640 1 --2- 172.21.15.79:0/291462280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f448c101990 0x7f448c101d70 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f447c009900 tx=0x7f447c02a410 comp rx=0 tx=0).stop 2024-08-20T01:51:22.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.801+0000 7f44925bf640 1 -- 172.21.15.79:0/291462280 shutdown_connections 2024-08-20T01:51:22.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.801+0000 7f44925bf640 1 --2- 172.21.15.79:0/291462280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f448c107d20 0x7f448c10e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:22.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.801+0000 7f44925bf640 1 --2- 172.21.15.79:0/291462280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f448c1073a0 0x7f448c1077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:22.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.801+0000 7f44925bf640 1 --2- 172.21.15.79:0/291462280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f448c101990 0x7f448c101d70 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:22.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.801+0000 7f44925bf640 1 -- 172.21.15.79:0/291462280 >> 172.21.15.79:0/291462280 conn(0x7f448c0fd400 msgr2=0x7f448c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:22.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.801+0000 7f44925bf640 1 -- 172.21.15.79:0/291462280 shutdown_connections 2024-08-20T01:51:22.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.801+0000 7f44925bf640 1 -- 172.21.15.79:0/291462280 wait complete. 2024-08-20T01:51:22.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.802+0000 7f44925bf640 1 Processor -- start 2024-08-20T01:51:22.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.802+0000 7f44925bf640 1 -- start start 2024-08-20T01:51:22.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.802+0000 7f44925bf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f448c101990 0x7f448c198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:22.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.802+0000 7f44925bf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f448c1073a0 0x7f448c1993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:22.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.802+0000 7f44925bf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f448c107d20 0x7f448c19e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:22.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.802+0000 7f44925bf640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f448c1118e0 con 0x7f448c1073a0 2024-08-20T01:51:22.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.802+0000 7f44925bf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f448c111760 con 0x7f448c101990 2024-08-20T01:51:22.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.802+0000 7f44925bf640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f448c111a60 con 0x7f448c107d20 2024-08-20T01:51:22.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.802+0000 7f448b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f448c1073a0 0x7f448c1993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:22.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.802+0000 7f448bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f448c101990 0x7f448c198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:22.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.802+0000 7f448b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f448c1073a0 0x7f448c1993f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43988/0 (socket says 172.21.15.79:43988) 2024-08-20T01:51:22.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.802+0000 7f448bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f448c101990 0x7f448c198eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:40118/0 (socket says 172.21.15.79:40118) 2024-08-20T01:51:22.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.802+0000 7f448b7fe640 1 -- 172.21.15.79:0/2596463172 learned_addr learned my addr 172.21.15.79:0/2596463172 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:22.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.802+0000 7f4490b5c640 1 --2- 172.21.15.79:0/2596463172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f448c107d20 0x7f448c19e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:22.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.803+0000 7f448bfff640 1 -- 172.21.15.79:0/2596463172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f448c107d20 msgr2=0x7f448c19e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:22.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.803+0000 7f448bfff640 1 --2- 172.21.15.79:0/2596463172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f448c107d20 0x7f448c19e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:22.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.803+0000 7f448bfff640 1 -- 172.21.15.79:0/2596463172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f448c1073a0 msgr2=0x7f448c1993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:22.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.803+0000 7f448bfff640 1 --2- 172.21.15.79:0/2596463172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f448c1073a0 0x7f448c1993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:22.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.803+0000 7f448bfff640 1 -- 172.21.15.79:0/2596463172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f448c19ef60 con 0x7f448c101990 2024-08-20T01:51:22.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.803+0000 7f4490b5c640 1 --2- 172.21.15.79:0/2596463172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f448c107d20 0x7f448c19e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:51:22.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.803+0000 7f448b7fe640 1 --2- 172.21.15.79:0/2596463172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f448c1073a0 0x7f448c1993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:51:22.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.803+0000 7f448bfff640 1 --2- 172.21.15.79:0/2596463172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f448c101990 0x7f448c198eb0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f447c02a930 tx=0x7f447c003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:22.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.803+0000 7f44897fa640 1 -- 172.21.15.79:0/2596463172 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447c03f070 con 0x7f448c101990 2024-08-20T01:51:22.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.803+0000 7f44897fa640 1 -- 172.21.15.79:0/2596463172 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f447c03baf0 con 0x7f448c101990 2024-08-20T01:51:22.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.803+0000 7f44897fa640 1 -- 172.21.15.79:0/2596463172 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447c035030 con 0x7f448c101990 2024-08-20T01:51:22.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.803+0000 7f44925bf640 1 -- 172.21.15.79:0/2596463172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f448c19f1f0 con 0x7f448c101990 2024-08-20T01:51:22.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.803+0000 7f44925bf640 1 -- 172.21.15.79:0/2596463172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f448c1a5910 con 0x7f448c101990 2024-08-20T01:51:22.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.804+0000 7f44925bf640 1 -- 172.21.15.79:0/2596463172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f448c101d70 con 0x7f448c101990 2024-08-20T01:51:22.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.805+0000 7f44897fa640 1 -- 172.21.15.79:0/2596463172 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f447c042070 con 0x7f448c101990 2024-08-20T01:51:22.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.806+0000 7f44897fa640 1 --2- 172.21.15.79:0/2596463172 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f44740b3bd0 0x7f44740b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:22.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.806+0000 7f448b7fe640 1 --2- 172.21.15.79:0/2596463172 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f44740b3bd0 0x7f44740b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:22.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.806+0000 7f44897fa640 1 -- 172.21.15.79:0/2596463172 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f447c104540 con 0x7f448c101990 2024-08-20T01:51:22.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.806+0000 7f448b7fe640 1 --2- 172.21.15.79:0/2596463172 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f44740b3bd0 0x7f44740b6090 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f448c0fe760 tx=0x7f4480005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:22.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:22.809+0000 7f44897fa640 1 -- 172.21.15.79:0/2596463172 <== mon.2 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f447c0cb550 con 0x7f448c101990 2024-08-20T01:51:22.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:22 smithi175 ceph-mon[22392]: pgmap v768: 97 pgs: 97 active+clean; 12 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 21 op/s 2024-08-20T01:51:23.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:22 smithi081 ceph-mon[22209]: pgmap v768: 97 pgs: 97 active+clean; 12 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 21 op/s 2024-08-20T01:51:23.046 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:23.043+0000 7f44925bf640 1 -- 172.21.15.79:0/2596463172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f448c1a5c40 con 0x7f448c101990 2024-08-20T01:51:23.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:23.044+0000 7f44897fa640 1 -- 172.21.15.79:0/2596463172 <== mon.2 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+11992 (secure 0 0 0) 0x7f447c0d2e20 con 0x7f448c101990 2024-08-20T01:51:23.047 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:51:23.047 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":59,"btime":"2024-08-20T01:51:09:515016+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14670,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/735082912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":735082912},{"type":"v1","addr":"172.21.15.79:6835","nonce":735082912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2150339873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2150339873},{"type":"v1","addr":"172.21.15.79:6837","nonce":2150339873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":59,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:34:55.133562+0000","modified":"2024-08-20T01:51:08.718901+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24539,"mds_1":24538,"mds_2":24523,"mds_3":24514,"mds_4":24512},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14724":{"gid":14724,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/1071242274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1071242274},{"type":"v1","addr":"172.21.15.79:6839","nonce":1071242274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14730":{"gid":14730,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6841/2448977611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":2448977611},{"type":"v1","addr":"172.21.15.79:6841","nonce":2448977611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/1257507005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1257507005},{"type":"v1","addr":"172.21.15.81:6833","nonce":1257507005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1499936216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1499936216},{"type":"v1","addr":"172.21.15.81:6835","nonce":1499936216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/1107229215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1107229215},{"type":"v1","addr":"172.21.15.175:6833","nonce":1107229215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6837/2073598870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2073598870},{"type":"v1","addr":"172.21.15.81:6837","nonce":2073598870}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/2552601173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2552601173},{"type":"v1","addr":"172.21.15.175:6835","nonce":2552601173}]},"join_fscid":-1,"export_targets":[1,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6837/1767284089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1767284089},{"type":"v1","addr":"172.21.15.175:6837","nonce":1767284089}]},"join_fscid":-1,"export_targets":[0,1,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/1331748742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1331748742},{"type":"v1","addr":"172.21.15.175:6839","nonce":1331748742}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/4098410583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":4098410583},{"type":"v1","addr":"172.21.15.81:6839","nonce":4098410583}]},"join_fscid":-1,"export_targets":[1,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24539,"qdb_cluster":[24539,24523,24514,24538,24512]},"id":1}]} 2024-08-20T01:51:23.047 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 59 2024-08-20T01:51:23.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:23.046+0000 7f44925bf640 1 -- 172.21.15.79:0/2596463172 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f44740b3bd0 msgr2=0x7f44740b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:23.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:23.046+0000 7f44925bf640 1 --2- 172.21.15.79:0/2596463172 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f44740b3bd0 0x7f44740b6090 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f448c0fe760 tx=0x7f4480005f90 comp rx=0 tx=0).stop 2024-08-20T01:51:23.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:23.046+0000 7f44925bf640 1 -- 172.21.15.79:0/2596463172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f448c101990 msgr2=0x7f448c198eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:23.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:23.046+0000 7f44925bf640 1 --2- 172.21.15.79:0/2596463172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f448c101990 0x7f448c198eb0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f447c02a930 tx=0x7f447c003b90 comp rx=0 tx=0).stop 2024-08-20T01:51:23.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:23.046+0000 7f44925bf640 1 -- 172.21.15.79:0/2596463172 shutdown_connections 2024-08-20T01:51:23.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:23.046+0000 7f44925bf640 1 --2- 172.21.15.79:0/2596463172 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f44740b3bd0 0x7f44740b6090 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:23.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:23.046+0000 7f44925bf640 1 --2- 172.21.15.79:0/2596463172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f448c107d20 0x7f448c19e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:23.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:23.046+0000 7f44925bf640 1 --2- 172.21.15.79:0/2596463172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f448c1073a0 0x7f448c1993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:23.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:23.046+0000 7f44925bf640 1 --2- 172.21.15.79:0/2596463172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f448c101990 0x7f448c198eb0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:23.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:23.046+0000 7f44925bf640 1 -- 172.21.15.79:0/2596463172 >> 172.21.15.79:0/2596463172 conn(0x7f448c0fd400 msgr2=0x7f448c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:23.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:23.046+0000 7f44925bf640 1 -- 172.21.15.79:0/2596463172 shutdown_connections 2024-08-20T01:51:23.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:23.046+0000 7f44925bf640 1 -- 172.21.15.79:0/2596463172 wait complete. 2024-08-20T01:51:23.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:23 smithi079 ceph-mon[18656]: pgmap v769: 97 pgs: 97 active+clean; 12 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 19 op/s 2024-08-20T01:51:23.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:23 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2596463172' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:51:23.747 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-20T01:51:23.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:23 smithi175 ceph-mon[22392]: pgmap v769: 97 pgs: 97 active+clean; 12 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 19 op/s 2024-08-20T01:51:23.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:23 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2596463172' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:51:23.998 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:51:24.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:23 smithi081 ceph-mon[22209]: pgmap v769: 97 pgs: 97 active+clean; 12 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 19 op/s 2024-08-20T01:51:24.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:23 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2596463172' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:51:24.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.474+0000 7fdea1a71640 1 -- 172.21.15.79:0/521622796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde9c101990 msgr2=0x7fde9c101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:24.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.474+0000 7fdea1a71640 1 --2- 172.21.15.79:0/521622796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde9c101990 0x7fde9c101d70 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fde8c009ca0 tx=0x7fde8c02a8c0 comp rx=0 tx=0).stop 2024-08-20T01:51:24.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.474+0000 7fdea1a71640 1 -- 172.21.15.79:0/521622796 shutdown_connections 2024-08-20T01:51:24.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.474+0000 7fdea1a71640 1 --2- 172.21.15.79:0/521622796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde9c107d20 0x7fde9c10e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:24.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.474+0000 7fdea1a71640 1 --2- 172.21.15.79:0/521622796 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde9c1073a0 0x7fde9c1077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:24.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.474+0000 7fdea1a71640 1 --2- 172.21.15.79:0/521622796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde9c101990 0x7fde9c101d70 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:24.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.474+0000 7fdea1a71640 1 -- 172.21.15.79:0/521622796 >> 172.21.15.79:0/521622796 conn(0x7fde9c0fd400 msgr2=0x7fde9c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:24.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.474+0000 7fdea1a71640 1 -- 172.21.15.79:0/521622796 shutdown_connections 2024-08-20T01:51:24.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.474+0000 7fdea1a71640 1 -- 172.21.15.79:0/521622796 wait complete. 2024-08-20T01:51:24.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.475+0000 7fdea1a71640 1 Processor -- start 2024-08-20T01:51:24.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.475+0000 7fdea1a71640 1 -- start start 2024-08-20T01:51:24.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.475+0000 7fdea1a71640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde9c101990 0x7fde9c198f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:24.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.475+0000 7fdea1a71640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde9c1073a0 0x7fde9c199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:24.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.475+0000 7fdea1a71640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde9c107d20 0x7fde9c19e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:24.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.475+0000 7fdea1a71640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fde9c1118e0 con 0x7fde9c1073a0 2024-08-20T01:51:24.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.475+0000 7fdea1a71640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fde9c111760 con 0x7fde9c107d20 2024-08-20T01:51:24.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.475+0000 7fdea1a71640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fde9c111a60 con 0x7fde9c101990 2024-08-20T01:51:24.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.475+0000 7fde9affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde9c1073a0 0x7fde9c199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:24.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.475+0000 7fde9b7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde9c101990 0x7fde9c198f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:24.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.475+0000 7fde9affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde9c1073a0 0x7fde9c199440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44006/0 (socket says 172.21.15.79:44006) 2024-08-20T01:51:24.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.475+0000 7fde9affd640 1 -- 172.21.15.79:0/2844650147 learned_addr learned my addr 172.21.15.79:0/2844650147 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:24.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.475+0000 7fde9bfff640 1 --2- 172.21.15.79:0/2844650147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde9c107d20 0x7fde9c19e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:24.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.476+0000 7fde9affd640 1 -- 172.21.15.79:0/2844650147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde9c101990 msgr2=0x7fde9c198f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:24.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.476+0000 7fde9affd640 1 --2- 172.21.15.79:0/2844650147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde9c101990 0x7fde9c198f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:24.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.476+0000 7fde9affd640 1 -- 172.21.15.79:0/2844650147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde9c107d20 msgr2=0x7fde9c19e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:24.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.476+0000 7fde9affd640 1 --2- 172.21.15.79:0/2844650147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde9c107d20 0x7fde9c19e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:24.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.476+0000 7fde9affd640 1 -- 172.21.15.79:0/2844650147 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde9c19efb0 con 0x7fde9c1073a0 2024-08-20T01:51:24.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.476+0000 7fde9bfff640 1 --2- 172.21.15.79:0/2844650147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde9c107d20 0x7fde9c19e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:51:24.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.476+0000 7fde9affd640 1 --2- 172.21.15.79:0/2844650147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde9c1073a0 0x7fde9c199440 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fde9000e9f0 tx=0x7fde9000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:24.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.476+0000 7fde98ff9640 1 -- 172.21.15.79:0/2844650147 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde9000cd80 con 0x7fde9c1073a0 2024-08-20T01:51:24.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.476+0000 7fde98ff9640 1 -- 172.21.15.79:0/2844650147 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fde900054b0 con 0x7fde9c1073a0 2024-08-20T01:51:24.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.476+0000 7fdea1a71640 1 -- 172.21.15.79:0/2844650147 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde9c19f2a0 con 0x7fde9c1073a0 2024-08-20T01:51:24.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.476+0000 7fde98ff9640 1 -- 172.21.15.79:0/2844650147 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde90010430 con 0x7fde9c1073a0 2024-08-20T01:51:24.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.476+0000 7fdea1a71640 1 -- 172.21.15.79:0/2844650147 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde9c1a5960 con 0x7fde9c1073a0 2024-08-20T01:51:24.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.478+0000 7fde98ff9640 1 -- 172.21.15.79:0/2844650147 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fde900046c0 con 0x7fde9c1073a0 2024-08-20T01:51:24.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.479+0000 7fdea3e6a740 1 Processor -- start 2024-08-20T01:51:24.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.479+0000 7fdea3e6a740 1 -- start start 2024-08-20T01:51:24.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.479+0000 7fdea3e6a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd79317730 0x55dd79317b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:24.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.479+0000 7fdea3e6a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd79318050 0x55dd79323aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:24.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.479+0000 7fdea3e6a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd79323fe0 0x55dd793263d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:24.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.479+0000 7fdea3e6a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55dd7928e930 con 0x55dd79323fe0 2024-08-20T01:51:24.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.479+0000 7fdea3e6a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55dd7927de30 con 0x55dd79317730 2024-08-20T01:51:24.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.479+0000 7fdea3e6a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55dd79281e70 con 0x55dd79318050 2024-08-20T01:51:24.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.479+0000 7fde9affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd79323fe0 0x55dd793263d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:24.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.479+0000 7fde9bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd79317730 0x55dd79317b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:24.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.479+0000 7fde9bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd79317730 0x55dd79317b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:40142/0 (socket says 172.21.15.79:40142) 2024-08-20T01:51:24.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.479+0000 7fde9b7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd79318050 0x55dd79323aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:24.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.479+0000 7fde9bfff640 1 -- 172.21.15.79:0/1216905326 learned_addr learned my addr 172.21.15.79:0/1216905326 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:24.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.479+0000 7fde9bfff640 1 -- 172.21.15.79:0/1216905326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd79318050 msgr2=0x55dd79323aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:24.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.479+0000 7fde9bfff640 1 --2- 172.21.15.79:0/1216905326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd79318050 0x55dd79323aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:24.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.479+0000 7fde9bfff640 1 -- 172.21.15.79:0/1216905326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd79323fe0 msgr2=0x55dd793263d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:24.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.479+0000 7fde9bfff640 1 --2- 172.21.15.79:0/1216905326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd79323fe0 0x55dd793263d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:24.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.479+0000 7fde9bfff640 1 -- 172.21.15.79:0/1216905326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd78fdd650 con 0x55dd79317730 2024-08-20T01:51:24.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.480+0000 7fde98ff9640 1 --2- 172.21.15.79:0/2844650147 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fde840b3c50 0x7fde840b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:24.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.480+0000 7fde9bfff640 1 --2- 172.21.15.79:0/1216905326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd79317730 0x55dd79317b10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fde9400bfb0 tx=0x7fde94012bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b61f450c2561e178 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:24.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.480+0000 7fde9b7fe640 1 --2- 172.21.15.79:0/2844650147 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fde840b3c50 0x7fde840b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:24.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.480+0000 7fde98ff9640 1 -- 172.21.15.79:0/2844650147 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fde900e3ed0 con 0x7fde9c1073a0 2024-08-20T01:51:24.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.480+0000 7fde81ffb640 1 -- 172.21.15.79:0/1216905326 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde94020070 con 0x55dd79317730 2024-08-20T01:51:24.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.480+0000 7fde81ffb640 1 -- 172.21.15.79:0/1216905326 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fde9400de70 con 0x55dd79317730 2024-08-20T01:51:24.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.480+0000 7fde81ffb640 1 -- 172.21.15.79:0/1216905326 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde9401bcb0 con 0x55dd79317730 2024-08-20T01:51:24.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.481+0000 7fdea3e6a740 1 -- 172.21.15.79:0/1216905326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd79317730 msgr2=0x55dd79317b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:24.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.481+0000 7fde9b7fe640 1 --2- 172.21.15.79:0/2844650147 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fde840b3c50 0x7fde840b6110 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fde8c000f80 tx=0x7fde8c031000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:24.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.481+0000 7fdea3e6a740 1 --2- 172.21.15.79:0/1216905326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd79317730 0x55dd79317b10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fde9400bfb0 tx=0x7fde94012bf0 comp rx=0 tx=0).stop 2024-08-20T01:51:24.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.481+0000 7fdea3e6a740 1 -- 172.21.15.79:0/1216905326 shutdown_connections 2024-08-20T01:51:24.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.481+0000 7fdea3e6a740 1 --2- 172.21.15.79:0/1216905326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd79323fe0 0x55dd793263d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:24.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.481+0000 7fdea3e6a740 1 --2- 172.21.15.79:0/1216905326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd79318050 0x55dd79323aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:24.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.481+0000 7fdea3e6a740 1 --2- 172.21.15.79:0/1216905326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd79317730 0x55dd79317b10 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:24.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.481+0000 7fdea3e6a740 1 -- 172.21.15.79:0/1216905326 >> 172.21.15.79:0/1216905326 conn(0x55dd79315560 msgr2=0x55dd79316700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:24.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.481+0000 7fdea3e6a740 1 -- 172.21.15.79:0/1216905326 shutdown_connections 2024-08-20T01:51:24.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.481+0000 7fdea3e6a740 1 -- 172.21.15.79:0/1216905326 wait complete. 2024-08-20T01:51:24.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.481+0000 7fdea3e6a740 1 -- start start 2024-08-20T01:51:24.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.481+0000 7fdea3e6a740 1 Processor -- start 2024-08-20T01:51:24.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.482+0000 7fdea3e6a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd79317730 0x55dd79320fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:24.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.482+0000 7fdea3e6a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd79318050 0x55dd793214f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:24.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.482+0000 7fdea3e6a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd79323fe0 0x55dd79321a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:24.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.482+0000 7fdea3e6a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55dd790e0700 con 0x55dd79323fe0 2024-08-20T01:51:24.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.482+0000 7fdea3e6a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55dd79204810 con 0x55dd79317730 2024-08-20T01:51:24.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.482+0000 7fdea3e6a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55dd79326c90 con 0x55dd79318050 2024-08-20T01:51:24.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.482+0000 7fdea3e6a740 10 client.0 _ll_register_callbacks cb 0x55dd79277700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:51:24.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.482+0000 7fde9bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd79323fe0 0x55dd79321a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:24.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.482+0000 7fde9bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd79323fe0 0x55dd79321a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44034/0 (socket says 172.21.15.79:44034) 2024-08-20T01:51:24.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.482+0000 7fde9bfff640 1 -- 172.21.15.79:0/3005296017 learned_addr learned my addr 172.21.15.79:0/3005296017 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:24.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.482+0000 7fde9b7fe640 1 --2- 172.21.15.79:0/3005296017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd79317730 0x55dd79320fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:24.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.482+0000 7fde9affd640 1 --2- 172.21.15.79:0/3005296017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd79318050 0x55dd793214f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:24.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.482+0000 7fde9bfff640 1 -- 172.21.15.79:0/3005296017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd79318050 msgr2=0x55dd793214f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:24.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.482+0000 7fde9bfff640 1 --2- 172.21.15.79:0/3005296017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd79318050 0x55dd793214f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:24.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.482+0000 7fde9bfff640 1 -- 172.21.15.79:0/3005296017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd79317730 msgr2=0x55dd79320fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:24.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.482+0000 7fde9bfff640 1 --2- 172.21.15.79:0/3005296017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd79317730 0x55dd79320fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:24.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.482+0000 7fde9bfff640 1 -- 172.21.15.79:0/3005296017 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd79330070 con 0x55dd79323fe0 2024-08-20T01:51:24.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.482+0000 7fde9affd640 1 --2- 172.21.15.79:0/3005296017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd79318050 0x55dd793214f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:51:24.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.482+0000 7fde9bfff640 1 --2- 172.21.15.79:0/3005296017 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd79323fe0 0x55dd79321a30 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fde94000c00 tx=0x7fde9400bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef7e2c554b2c5903 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:24.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.482+0000 7fde7affd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:51:24.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.482+0000 7fde7affd640 1 -- 172.21.15.79:0/3005296017 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde9402b060 con 0x55dd79323fe0 2024-08-20T01:51:24.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.482+0000 7fde7affd640 1 -- 172.21.15.79:0/3005296017 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fde9401bc00 con 0x55dd79323fe0 2024-08-20T01:51:24.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.482+0000 7fdea3e6a740 1 -- 172.21.15.79:0/3005296017 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dd7922d150 con 0x55dd79323fe0 2024-08-20T01:51:24.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.483+0000 7fde7affd640 1 -- 172.21.15.79:0/3005296017 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7fde94020070 con 0x55dd79323fe0 2024-08-20T01:51:24.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.483+0000 7fdea3e6a740 10 client.18960 fetch_fsmap learned FSMap version 59 2024-08-20T01:51:24.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.483+0000 7fdea3e6a740 1 -- 172.21.15.79:0/3005296017 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) -- 0x55dd79332a20 con 0x55dd79323fe0 2024-08-20T01:51:24.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.483+0000 7fde7affd640 1 -- 172.21.15.79:0/3005296017 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55dd7922d150 con 0x55dd79323fe0 2024-08-20T01:51:24.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.483+0000 7fde7affd640 1 -- 172.21.15.79:0/3005296017 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 59) ==== 8410+0+0 (secure 0 0 0) 0x7fde940046c0 con 0x55dd79323fe0 2024-08-20T01:51:24.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.483+0000 7fdea3e6a740 10 client.18960 fetch_fsmap finished waiting for FSMap version 59 2024-08-20T01:51:24.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.483+0000 7fdea3e6a740 10 client.18960 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:51:24.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.483+0000 7fdea3e6a740 20 client.18960 populate_metadata read hostname 'smithi079' 2024-08-20T01:51:24.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.483+0000 7fdea3e6a740 1 --2- 172.21.15.79:0/3005296017 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55dd79333ee0 0x55dd793362d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:24.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.483+0000 7fdea3e6a740 4 client.18960 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:51:24.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.483+0000 7fdea3e6a740 1 -- 172.21.15.79:0/3005296017 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dd79290880 con 0x55dd79333ee0 2024-08-20T01:51:24.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.483+0000 7fde9b7fe640 1 --2- 172.21.15.79:0/3005296017 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55dd79333ee0 0x55dd793362d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:24.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.484+0000 7fde9b7fe640 1 --2- 172.21.15.79:0/3005296017 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55dd79333ee0 0x55dd793362d0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1f61be04167d9ca5 server_cookie=da50bf53ed42bab5 in_seq=0 out_seq=0 2024-08-20T01:51:24.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.484+0000 7fde7affd640 10 client.18960 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:51:24.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.484+0000 7fde7affd640 1 -- 172.21.15.79:0/3005296017 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dd79290880 con 0x55dd79333ee0 2024-08-20T01:51:24.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.484+0000 7fde7affd640 10 client.18960 handle_command_reply: tid=0 2024-08-20T01:51:24.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.484+0000 7fdea3e6a740 1 client.18960 shutdown 2024-08-20T01:51:24.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.484+0000 7fdea3e6a740 1 -- 172.21.15.79:0/3005296017 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd79323fe0 msgr2=0x55dd79321a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:24.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.484+0000 7fdea3e6a740 1 --2- 172.21.15.79:0/3005296017 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd79323fe0 0x55dd79321a30 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fde94000c00 tx=0x7fde9400bd80 comp rx=0 tx=0).stop 2024-08-20T01:51:24.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.484+0000 7fdea3e6a740 1 -- 172.21.15.79:0/3005296017 shutdown_connections 2024-08-20T01:51:24.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.484+0000 7fdea3e6a740 1 --2- 172.21.15.79:0/3005296017 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55dd79333ee0 0x55dd793362d0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:24.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.484+0000 7fdea3e6a740 1 --2- 172.21.15.79:0/3005296017 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd79323fe0 0x55dd79321a30 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:24.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.484+0000 7fdea3e6a740 1 --2- 172.21.15.79:0/3005296017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd79318050 0x55dd793214f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:24.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.484+0000 7fdea3e6a740 1 --2- 172.21.15.79:0/3005296017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd79317730 0x55dd79320fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:24.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.484+0000 7fdea3e6a740 1 -- 172.21.15.79:0/3005296017 >> 172.21.15.79:0/3005296017 conn(0x55dd79315560 msgr2=0x55dd7931b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:24.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.484+0000 7fde7affd640 0 client.18960 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:51:24.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.485+0000 7fdea3e6a740 1 -- 172.21.15.79:0/3005296017 shutdown_connections 2024-08-20T01:51:24.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.485+0000 7fdea3e6a740 1 -- 172.21.15.79:0/3005296017 wait complete. 2024-08-20T01:51:24.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.485+0000 7fdea3e6a740 20 client.18960 trim_cache size 0 max 16384 2024-08-20T01:51:24.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.497+0000 7fdea3e6a740 1 Processor -- start 2024-08-20T01:51:24.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.498+0000 7fdea3e6a740 1 -- start start 2024-08-20T01:51:24.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.498+0000 7fdea3e6a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd79317730 0x55dd7931b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:24.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.498+0000 7fdea3e6a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd79318050 0x55dd79322cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:24.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.498+0000 7fdea3e6a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd79323fe0 0x55dd793214b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:24.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.498+0000 7fdea3e6a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fde9c1abd90 con 0x55dd79318050 2024-08-20T01:51:24.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.498+0000 7fdea3e6a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fde9c1adab0 con 0x55dd79323fe0 2024-08-20T01:51:24.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.498+0000 7fdea3e6a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fde9c1ac520 con 0x55dd79317730 2024-08-20T01:51:24.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.498+0000 7fde9affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd79318050 0x55dd79322cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:24.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.498+0000 7fde9b7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd79317730 0x55dd7931b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:24.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.498+0000 7fde9affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd79318050 0x55dd79322cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44050/0 (socket says 172.21.15.79:44050) 2024-08-20T01:51:24.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.498+0000 7fde9affd640 1 -- 172.21.15.79:0/1515102137 learned_addr learned my addr 172.21.15.79:0/1515102137 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:24.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.498+0000 7fde9bfff640 1 --2- 172.21.15.79:0/1515102137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd79323fe0 0x55dd793214b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:24.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.498+0000 7fde9b7fe640 1 -- 172.21.15.79:0/1515102137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd79323fe0 msgr2=0x55dd793214b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:24.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.498+0000 7fde9b7fe640 1 --2- 172.21.15.79:0/1515102137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd79323fe0 0x55dd793214b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:24.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.498+0000 7fde9b7fe640 1 -- 172.21.15.79:0/1515102137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd79318050 msgr2=0x55dd79322cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:24.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.498+0000 7fde9b7fe640 1 --2- 172.21.15.79:0/1515102137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd79318050 0x55dd79322cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:24.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.498+0000 7fde9b7fe640 1 -- 172.21.15.79:0/1515102137 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd79315fe0 con 0x55dd79317730 2024-08-20T01:51:24.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.498+0000 7fde9b7fe640 1 --2- 172.21.15.79:0/1515102137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd79317730 0x55dd7931b7a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fde8c02aeb0 tx=0x7fde8c044000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4729c5aef23d012e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:24.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.499+0000 7fde817fa640 1 -- 172.21.15.79:0/1515102137 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde8c031980 con 0x55dd79317730 2024-08-20T01:51:24.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.499+0000 7fde817fa640 1 -- 172.21.15.79:0/1515102137 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fde8c036050 con 0x55dd79317730 2024-08-20T01:51:24.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.499+0000 7fde817fa640 1 -- 172.21.15.79:0/1515102137 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde8c055430 con 0x55dd79317730 2024-08-20T01:51:24.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.499+0000 7fdea3e6a740 1 -- 172.21.15.79:0/1515102137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd79317730 msgr2=0x55dd7931b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:24.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.499+0000 7fdea3e6a740 1 --2- 172.21.15.79:0/1515102137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd79317730 0x55dd7931b7a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fde8c02aeb0 tx=0x7fde8c044000 comp rx=0 tx=0).stop 2024-08-20T01:51:24.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.499+0000 7fdea3e6a740 1 -- 172.21.15.79:0/1515102137 shutdown_connections 2024-08-20T01:51:24.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.499+0000 7fdea3e6a740 1 --2- 172.21.15.79:0/1515102137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd79323fe0 0x55dd793214b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:24.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.499+0000 7fdea3e6a740 1 --2- 172.21.15.79:0/1515102137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd79318050 0x55dd79322cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:24.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.499+0000 7fdea3e6a740 1 --2- 172.21.15.79:0/1515102137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd79317730 0x55dd7931b7a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:24.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.499+0000 7fdea3e6a740 1 -- 172.21.15.79:0/1515102137 >> 172.21.15.79:0/1515102137 conn(0x55dd79315560 msgr2=0x55dd793225e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:24.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.499+0000 7fdea3e6a740 1 -- 172.21.15.79:0/1515102137 shutdown_connections 2024-08-20T01:51:24.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.499+0000 7fdea3e6a740 1 -- 172.21.15.79:0/1515102137 wait complete. 2024-08-20T01:51:24.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.500+0000 7fdea3e6a740 1 -- start start 2024-08-20T01:51:24.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.500+0000 7fdea3e6a740 1 Processor -- start 2024-08-20T01:51:24.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.500+0000 7fdea3e6a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd79317730 0x55dd79326ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:24.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.500+0000 7fdea3e6a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd79318050 0x55dd79327420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:24.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.500+0000 7fdea3e6a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd79323fe0 0x55dd79327960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:24.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.500+0000 7fdea3e6a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fde9c1ad380 con 0x55dd79317730 2024-08-20T01:51:24.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.500+0000 7fdea3e6a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fde9c1acc80 con 0x55dd79318050 2024-08-20T01:51:24.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.500+0000 7fdea3e6a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fde9c1a9d70 con 0x55dd79323fe0 2024-08-20T01:51:24.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.500+0000 7fdea3e6a740 10 client.0 _ll_register_callbacks cb 0x7fde9401e070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:51:24.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.500+0000 7fde9b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd79317730 0x55dd79326ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:24.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.500+0000 7fde9b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd79317730 0x55dd79326ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44052/0 (socket says 172.21.15.79:44052) 2024-08-20T01:51:24.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.500+0000 7fde9b7fe640 1 -- 172.21.15.79:0/3048952041 learned_addr learned my addr 172.21.15.79:0/3048952041 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:24.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.500+0000 7fde9bfff640 1 --2- 172.21.15.79:0/3048952041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd79323fe0 0x55dd79327960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:24.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.500+0000 7fde9affd640 1 --2- 172.21.15.79:0/3048952041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd79318050 0x55dd79327420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:24.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.501+0000 7fde9bfff640 1 -- 172.21.15.79:0/3048952041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd79318050 msgr2=0x55dd79327420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:24.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.501+0000 7fde9bfff640 1 --2- 172.21.15.79:0/3048952041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd79318050 0x55dd79327420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:24.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.501+0000 7fde9bfff640 1 -- 172.21.15.79:0/3048952041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd79317730 msgr2=0x55dd79326ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:24.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.501+0000 7fde9bfff640 1 --2- 172.21.15.79:0/3048952041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd79317730 0x55dd79326ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:24.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.501+0000 7fde9bfff640 1 -- 172.21.15.79:0/3048952041 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd7939ca40 con 0x55dd79323fe0 2024-08-20T01:51:24.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.501+0000 7fde9bfff640 1 --2- 172.21.15.79:0/3048952041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd79323fe0 0x55dd79327960 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fde94004c80 tx=0x7fde9400bd00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73eaf231bbdb579a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:24.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.501+0000 7fde7affd640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:51:24.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.501+0000 7fde7affd640 1 -- 172.21.15.79:0/3048952041 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde9402b070 con 0x55dd79323fe0 2024-08-20T01:51:24.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.501+0000 7fde7affd640 1 -- 172.21.15.79:0/3048952041 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fde9401b620 con 0x55dd79323fe0 2024-08-20T01:51:24.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.501+0000 7fdea3e6a740 1 -- 172.21.15.79:0/3048952041 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde8c036050 con 0x55dd79323fe0 2024-08-20T01:51:24.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.501+0000 7fde7affd640 1 -- 172.21.15.79:0/3048952041 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7fde94036040 con 0x55dd79323fe0 2024-08-20T01:51:24.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.501+0000 7fdea3e6a740 10 client.28012 fetch_fsmap learned FSMap version 59 2024-08-20T01:51:24.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.501+0000 7fdea3e6a740 1 -- 172.21.15.79:0/3048952041 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) -- 0x55dd7939dd20 con 0x55dd79323fe0 2024-08-20T01:51:24.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.501+0000 7fde7affd640 1 -- 172.21.15.79:0/3048952041 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fde8c036050 con 0x55dd79323fe0 2024-08-20T01:51:24.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.502+0000 7fde7affd640 1 -- 172.21.15.79:0/3048952041 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 59) ==== 8410+0+0 (secure 0 0 0) 0x7fde940046f0 con 0x55dd79323fe0 2024-08-20T01:51:24.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.502+0000 7fdea3e6a740 10 client.28012 fetch_fsmap finished waiting for FSMap version 59 2024-08-20T01:51:24.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.502+0000 7fdea3e6a740 10 client.28012 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:51:24.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.502+0000 7fdea3e6a740 20 client.28012 populate_metadata read hostname 'smithi079' 2024-08-20T01:51:24.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.502+0000 7fdea3e6a740 1 --2- 172.21.15.79:0/3048952041 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55dd7939e4d0 0x55dd793a08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:24.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.502+0000 7fdea3e6a740 4 client.28012 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:51:24.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.502+0000 7fdea3e6a740 1 -- 172.21.15.79:0/3048952041 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dd7928c320 con 0x55dd7939e4d0 2024-08-20T01:51:24.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.502+0000 7fde9b7fe640 1 --2- 172.21.15.79:0/3048952041 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55dd7939e4d0 0x55dd793a08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:24.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.502+0000 7fde7affd640 10 client.28012 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:51:24.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.502+0000 7fde9b7fe640 1 --2- 172.21.15.79:0/3048952041 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55dd7939e4d0 0x55dd793a08f0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=38b61f1d169192da server_cookie=dc96d42e723093b3 in_seq=0 out_seq=0 2024-08-20T01:51:24.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.502+0000 7fde7affd640 1 -- 172.21.15.79:0/3048952041 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55dd7928c320 con 0x55dd7939e4d0 2024-08-20T01:51:24.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.502+0000 7fde7affd640 10 client.28012 handle_command_reply: tid=0 2024-08-20T01:51:24.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.502+0000 7fdea3e6a740 1 client.28012 shutdown 2024-08-20T01:51:24.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.503+0000 7fdea3e6a740 1 -- 172.21.15.79:0/3048952041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd79323fe0 msgr2=0x55dd79327960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:24.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.503+0000 7fdea3e6a740 1 --2- 172.21.15.79:0/3048952041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd79323fe0 0x55dd79327960 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fde94004c80 tx=0x7fde9400bd00 comp rx=0 tx=0).stop 2024-08-20T01:51:24.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.503+0000 7fdea3e6a740 1 -- 172.21.15.79:0/3048952041 shutdown_connections 2024-08-20T01:51:24.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.503+0000 7fdea3e6a740 1 --2- 172.21.15.79:0/3048952041 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55dd7939e4d0 0x55dd793a08f0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:24.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.503+0000 7fdea3e6a740 1 --2- 172.21.15.79:0/3048952041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd79323fe0 0x55dd79327960 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:24.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.503+0000 7fdea3e6a740 1 --2- 172.21.15.79:0/3048952041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd79318050 0x55dd79327420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:24.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.503+0000 7fdea3e6a740 1 --2- 172.21.15.79:0/3048952041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd79317730 0x55dd79326ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:24.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.503+0000 7fde7affd640 0 client.28012 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:51:24.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.503+0000 7fdea3e6a740 1 -- 172.21.15.79:0/3048952041 >> 172.21.15.79:0/3048952041 conn(0x55dd79315560 msgr2=0x55dd793144f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:24.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.503+0000 7fdea3e6a740 1 -- 172.21.15.79:0/3048952041 shutdown_connections 2024-08-20T01:51:24.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.503+0000 7fdea3e6a740 1 -- 172.21.15.79:0/3048952041 wait complete. 2024-08-20T01:51:24.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.503+0000 7fdea3e6a740 20 client.28012 trim_cache size 0 max 16384 2024-08-20T01:51:24.522 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:51:24.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.503+0000 7fdea1a71640 1 -- 172.21.15.79:0/2844650147 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fde840b3c50 msgr2=0x7fde840b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:24.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.503+0000 7fdea1a71640 1 --2- 172.21.15.79:0/2844650147 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fde840b3c50 0x7fde840b6110 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fde8c000f80 tx=0x7fde8c031000 comp rx=0 tx=0).stop 2024-08-20T01:51:24.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.503+0000 7fdea1a71640 1 -- 172.21.15.79:0/2844650147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde9c1073a0 msgr2=0x7fde9c199440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:24.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.503+0000 7fdea1a71640 1 --2- 172.21.15.79:0/2844650147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde9c1073a0 0x7fde9c199440 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fde9000e9f0 tx=0x7fde9000edf0 comp rx=0 tx=0).stop 2024-08-20T01:51:24.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.503+0000 7fdea1a71640 1 -- 172.21.15.79:0/2844650147 shutdown_connections 2024-08-20T01:51:24.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.503+0000 7fdea1a71640 1 --2- 172.21.15.79:0/2844650147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde9c107d20 0x7fde9c19e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:24.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.503+0000 7fdea1a71640 1 --2- 172.21.15.79:0/2844650147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde9c1073a0 0x7fde9c199440 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:24.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.503+0000 7fdea1a71640 1 --2- 172.21.15.79:0/2844650147 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fde840b3c50 0x7fde840b6110 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:24.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.503+0000 7fdea1a71640 1 --2- 172.21.15.79:0/2844650147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde9c101990 0x7fde9c198f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:24.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.503+0000 7fdea1a71640 1 -- 172.21.15.79:0/2844650147 >> 172.21.15.79:0/2844650147 conn(0x7fde9c0fd400 msgr2=0x7fde9c06aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:24.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.504+0000 7fdea1a71640 1 -- 172.21.15.79:0/2844650147 shutdown_connections 2024-08-20T01:51:24.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:24.504+0000 7fdea1a71640 1 -- 172.21.15.79:0/2844650147 wait complete. 2024-08-20T01:51:25.141 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-20T01:51:25.395 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:51:25.783 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:25 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:51:25.784 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:25 smithi079 ceph-mon[18656]: pgmap v770: 97 pgs: 97 active+clean; 12 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 23 op/s 2024-08-20T01:51:25.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.865+0000 7ff283482640 1 -- 172.21.15.79:0/594719687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff27c1073a0 msgr2=0x7ff27c1077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:25.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.865+0000 7ff283482640 1 --2- 172.21.15.79:0/594719687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff27c1073a0 0x7ff27c1077e0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7ff26c009900 tx=0x7ff26c02a410 comp rx=0 tx=0).stop 2024-08-20T01:51:25.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.865+0000 7ff283482640 1 -- 172.21.15.79:0/594719687 shutdown_connections 2024-08-20T01:51:25.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.865+0000 7ff283482640 1 --2- 172.21.15.79:0/594719687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff27c107d20 0x7ff27c10e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:25.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.865+0000 7ff283482640 1 --2- 172.21.15.79:0/594719687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff27c1073a0 0x7ff27c1077e0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:25.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.865+0000 7ff283482640 1 --2- 172.21.15.79:0/594719687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff27c101990 0x7ff27c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:25.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.865+0000 7ff283482640 1 -- 172.21.15.79:0/594719687 >> 172.21.15.79:0/594719687 conn(0x7ff27c0fd400 msgr2=0x7ff27c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:25.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.865+0000 7ff283482640 1 -- 172.21.15.79:0/594719687 shutdown_connections 2024-08-20T01:51:25.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.865+0000 7ff283482640 1 -- 172.21.15.79:0/594719687 wait complete. 2024-08-20T01:51:25.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.865+0000 7ff283482640 1 Processor -- start 2024-08-20T01:51:25.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.865+0000 7ff283482640 1 -- start start 2024-08-20T01:51:25.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.866+0000 7ff283482640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff27c101990 0x7ff27c199cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:25.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.866+0000 7ff283482640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff27c1073a0 0x7ff27c19a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:25.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.866+0000 7ff283482640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff27c107d20 0x7ff27c19a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:25.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.866+0000 7ff283482640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c111850 con 0x7ff27c107d20 2024-08-20T01:51:25.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.866+0000 7ff283482640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c1116d0 con 0x7ff27c101990 2024-08-20T01:51:25.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.866+0000 7ff283482640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c1119d0 con 0x7ff27c1073a0 2024-08-20T01:51:25.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.866+0000 7ff281a1f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff27c107d20 0x7ff27c19a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:25.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.866+0000 7ff280a1d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff27c1073a0 0x7ff27c19a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:25.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.866+0000 7ff281a1f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff27c107d20 0x7ff27c19a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44068/0 (socket says 172.21.15.79:44068) 2024-08-20T01:51:25.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.866+0000 7ff28121e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff27c101990 0x7ff27c199cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:25.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.866+0000 7ff281a1f640 1 -- 172.21.15.79:0/2529161043 learned_addr learned my addr 172.21.15.79:0/2529161043 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:25.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.866+0000 7ff281a1f640 1 -- 172.21.15.79:0/2529161043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff27c1073a0 msgr2=0x7ff27c19a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:25.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.866+0000 7ff281a1f640 1 --2- 172.21.15.79:0/2529161043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff27c1073a0 0x7ff27c19a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:25.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.866+0000 7ff281a1f640 1 -- 172.21.15.79:0/2529161043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff27c101990 msgr2=0x7ff27c199cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:25.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.866+0000 7ff281a1f640 1 --2- 172.21.15.79:0/2529161043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff27c101990 0x7ff27c199cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:25.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.866+0000 7ff281a1f640 1 -- 172.21.15.79:0/2529161043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff27c1a5090 con 0x7ff27c107d20 2024-08-20T01:51:25.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.866+0000 7ff28121e640 1 --2- 172.21.15.79:0/2529161043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff27c101990 0x7ff27c199cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:51:25.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.866+0000 7ff281a1f640 1 --2- 172.21.15.79:0/2529161043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff27c107d20 0x7ff27c19a750 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7ff27400eb10 tx=0x7ff27400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:25.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.866+0000 7ff2727fc640 1 -- 172.21.15.79:0/2529161043 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff274004b20 con 0x7ff27c107d20 2024-08-20T01:51:25.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.866+0000 7ff2727fc640 1 -- 172.21.15.79:0/2529161043 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff274004cc0 con 0x7ff27c107d20 2024-08-20T01:51:25.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.866+0000 7ff283482640 1 -- 172.21.15.79:0/2529161043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff27c1a5380 con 0x7ff27c107d20 2024-08-20T01:51:25.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.866+0000 7ff2727fc640 1 -- 172.21.15.79:0/2529161043 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff274010690 con 0x7ff27c107d20 2024-08-20T01:51:25.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.866+0000 7ff283482640 1 -- 172.21.15.79:0/2529161043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff27c1a58e0 con 0x7ff27c107d20 2024-08-20T01:51:25.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.869+0000 7ff28587b740 1 Processor -- start 2024-08-20T01:51:25.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.869+0000 7ff2727fc640 1 -- 172.21.15.79:0/2529161043 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff274005020 con 0x7ff27c107d20 2024-08-20T01:51:25.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.869+0000 7ff28587b740 1 -- start start 2024-08-20T01:51:25.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.870+0000 7ff28587b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8331ca730 0x55e8331cab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:25.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.870+0000 7ff28587b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e8331cb050 0x55e8331daeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:25.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.870+0000 7ff28587b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8331db3f0 0x55e8331dd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:25.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.870+0000 7ff28587b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e833141930 con 0x55e8331cb050 2024-08-20T01:51:25.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.870+0000 7ff28587b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e833130e30 con 0x55e8331ca730 2024-08-20T01:51:25.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.870+0000 7ff28587b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e833134e70 con 0x55e8331db3f0 2024-08-20T01:51:25.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.870+0000 7ff28121e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e8331cb050 0x55e8331daeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:25.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.870+0000 7ff28121e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e8331cb050 0x55e8331daeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44082/0 (socket says 172.21.15.79:44082) 2024-08-20T01:51:25.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.870+0000 7ff28121e640 1 -- 172.21.15.79:0/1587114623 learned_addr learned my addr 172.21.15.79:0/1587114623 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:25.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.870+0000 7ff280a1d640 1 --2- 172.21.15.79:0/1587114623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8331ca730 0x55e8331cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:25.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.870+0000 7ff280a1d640 1 --2- 172.21.15.79:0/1587114623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8331db3f0 0x55e8331dd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:25.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.870+0000 7ff28121e640 1 -- 172.21.15.79:0/1587114623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8331db3f0 msgr2=0x55e8331dd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:25.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.870+0000 7ff28121e640 1 --2- 172.21.15.79:0/1587114623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8331db3f0 0x55e8331dd7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:25.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.870+0000 7ff28121e640 1 -- 172.21.15.79:0/1587114623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8331ca730 msgr2=0x55e8331cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:25.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.870+0000 7ff28121e640 1 --2- 172.21.15.79:0/1587114623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8331ca730 0x55e8331cab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:25.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.870+0000 7ff28121e640 1 -- 172.21.15.79:0/1587114623 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e832e90650 con 0x55e8331cb050 2024-08-20T01:51:25.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.870+0000 7ff280a1d640 1 --2- 172.21.15.79:0/1587114623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8331db3f0 0x55e8331dd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:51:25.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.870+0000 7ff28121e640 1 --2- 172.21.15.79:0/1587114623 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e8331cb050 0x55e8331daeb0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7ff278011620 tx=0x7ff278011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60406b0c4967c071 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:25.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.870+0000 7ff2727fc640 1 --2- 172.21.15.79:0/2529161043 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff2680b3c50 0x7ff2680b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:25.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.870+0000 7ff2677fe640 1 -- 172.21.15.79:0/1587114623 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27801e070 con 0x55e8331cb050 2024-08-20T01:51:25.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.870+0000 7ff280a1d640 1 --2- 172.21.15.79:0/2529161043 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff2680b3c50 0x7ff2680b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:25.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.870+0000 7ff2727fc640 1 -- 172.21.15.79:0/2529161043 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff2740e40c0 con 0x7ff27c107d20 2024-08-20T01:51:25.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.870+0000 7ff2677fe640 1 -- 172.21.15.79:0/1587114623 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff27800faf0 con 0x55e8331cb050 2024-08-20T01:51:25.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.870+0000 7ff2677fe640 1 -- 172.21.15.79:0/1587114623 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff278019b00 con 0x55e8331cb050 2024-08-20T01:51:25.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.871+0000 7ff28587b740 1 -- 172.21.15.79:0/1587114623 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e8331cb050 msgr2=0x55e8331daeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:25.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.871+0000 7ff280a1d640 1 --2- 172.21.15.79:0/2529161043 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff2680b3c50 0x7ff2680b6110 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ff26c0057c0 tx=0x7ff26c005bb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:25.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.871+0000 7ff28587b740 1 --2- 172.21.15.79:0/1587114623 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e8331cb050 0x55e8331daeb0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7ff278011620 tx=0x7ff278011ae0 comp rx=0 tx=0).stop 2024-08-20T01:51:25.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.871+0000 7ff28587b740 1 -- 172.21.15.79:0/1587114623 shutdown_connections 2024-08-20T01:51:25.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.871+0000 7ff28587b740 1 --2- 172.21.15.79:0/1587114623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8331db3f0 0x55e8331dd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:25.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.871+0000 7ff28587b740 1 --2- 172.21.15.79:0/1587114623 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e8331cb050 0x55e8331daeb0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:25.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.871+0000 7ff28587b740 1 --2- 172.21.15.79:0/1587114623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8331ca730 0x55e8331cab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:25.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.871+0000 7ff28587b740 1 -- 172.21.15.79:0/1587114623 >> 172.21.15.79:0/1587114623 conn(0x55e8331c8560 msgr2=0x55e8331c9700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:25.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.871+0000 7ff28587b740 1 -- 172.21.15.79:0/1587114623 shutdown_connections 2024-08-20T01:51:25.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.871+0000 7ff28587b740 1 -- 172.21.15.79:0/1587114623 wait complete. 2024-08-20T01:51:25.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.872+0000 7ff28587b740 1 -- start start 2024-08-20T01:51:25.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.872+0000 7ff28587b740 1 Processor -- start 2024-08-20T01:51:25.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.872+0000 7ff28587b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8331ca730 0x55e8331d83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:25.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.872+0000 7ff28587b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8331cb050 0x55e8331d8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:25.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.872+0000 7ff28587b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e8331db3f0 0x55e8331d8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:25.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.872+0000 7ff28587b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e832f93700 con 0x55e8331db3f0 2024-08-20T01:51:25.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.872+0000 7ff28587b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e8330b7810 con 0x55e8331cb050 2024-08-20T01:51:25.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.872+0000 7ff28587b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e8331de0a0 con 0x55e8331ca730 2024-08-20T01:51:25.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.872+0000 7ff28587b740 10 client.0 _ll_register_callbacks cb 0x55e83312a700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:51:25.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.872+0000 7ff281a1f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e8331db3f0 0x55e8331d8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:25.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.872+0000 7ff28121e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8331ca730 0x55e8331d83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:25.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.872+0000 7ff281a1f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e8331db3f0 0x55e8331d8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44098/0 (socket says 172.21.15.79:44098) 2024-08-20T01:51:25.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.872+0000 7ff281a1f640 1 -- 172.21.15.79:0/1205067001 learned_addr learned my addr 172.21.15.79:0/1205067001 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:25.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.872+0000 7ff280a1d640 1 --2- 172.21.15.79:0/1205067001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8331cb050 0x55e8331d8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:25.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.873+0000 7ff281a1f640 1 -- 172.21.15.79:0/1205067001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8331ca730 msgr2=0x55e8331d83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:25.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.873+0000 7ff281a1f640 1 --2- 172.21.15.79:0/1205067001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8331ca730 0x55e8331d83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:25.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.873+0000 7ff281a1f640 1 -- 172.21.15.79:0/1205067001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8331cb050 msgr2=0x55e8331d8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:25.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.873+0000 7ff281a1f640 1 --2- 172.21.15.79:0/1205067001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8331cb050 0x55e8331d8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:25.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.873+0000 7ff281a1f640 1 -- 172.21.15.79:0/1205067001 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8331e74a0 con 0x55e8331db3f0 2024-08-20T01:51:25.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.873+0000 7ff28121e640 1 --2- 172.21.15.79:0/1205067001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8331ca730 0x55e8331d83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:51:25.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.873+0000 7ff281a1f640 1 --2- 172.21.15.79:0/1205067001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e8331db3f0 0x55e8331d8e50 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7ff2740aafb0 tx=0x7ff2740aa790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48418df26e977050 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:25.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.873+0000 7ff264ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:51:25.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.873+0000 7ff264ff9640 1 -- 172.21.15.79:0/1205067001 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2740c4020 con 0x55e8331db3f0 2024-08-20T01:51:25.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.873+0000 7ff264ff9640 1 -- 172.21.15.79:0/1205067001 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff2740ab490 con 0x55e8331db3f0 2024-08-20T01:51:25.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.873+0000 7ff28587b740 1 -- 172.21.15.79:0/1205067001 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e8330e0150 con 0x55e8331db3f0 2024-08-20T01:51:25.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.873+0000 7ff264ff9640 1 -- 172.21.15.79:0/1205067001 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7ff2740ab020 con 0x55e8331db3f0 2024-08-20T01:51:25.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.873+0000 7ff28587b740 10 client.18978 fetch_fsmap learned FSMap version 60 2024-08-20T01:51:25.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.873+0000 7ff28587b740 1 -- 172.21.15.79:0/1205067001 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x55e8331e9e20 con 0x55e8331db3f0 2024-08-20T01:51:25.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.873+0000 7ff264ff9640 1 -- 172.21.15.79:0/1205067001 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55e8330e0150 con 0x55e8331db3f0 2024-08-20T01:51:25.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.873+0000 7ff264ff9640 1 -- 172.21.15.79:0/1205067001 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 60) ==== 8418+0+0 (secure 0 0 0) 0x7ff2740aa280 con 0x55e8331db3f0 2024-08-20T01:51:25.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.873+0000 7ff28587b740 10 client.18978 fetch_fsmap finished waiting for FSMap version 60 2024-08-20T01:51:25.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.873+0000 7ff28587b740 10 client.18978 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:51:25.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.873+0000 7ff28587b740 20 client.18978 populate_metadata read hostname 'smithi079' 2024-08-20T01:51:25.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.873+0000 7ff28587b740 1 --2- 172.21.15.79:0/1205067001 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x55e8331eb2f0 0x55e8331ed740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:25.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.873+0000 7ff28587b740 4 client.18978 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:51:25.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.873+0000 7ff28587b740 1 -- 172.21.15.79:0/1205067001 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e833143880 con 0x55e8331eb2f0 2024-08-20T01:51:25.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.874+0000 7ff28121e640 1 --2- 172.21.15.79:0/1205067001 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x55e8331eb2f0 0x55e8331ed740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:25.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.874+0000 7ff264ff9640 10 client.18978 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:51:25.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.874+0000 7ff28121e640 1 --2- 172.21.15.79:0/1205067001 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x55e8331eb2f0 0x55e8331ed740 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a7fdbd8ee75bb1d8 server_cookie=7ecb58c63537072f in_seq=0 out_seq=0 2024-08-20T01:51:25.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.875+0000 7ff264ff9640 1 -- 172.21.15.79:0/1205067001 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e833143880 con 0x55e8331eb2f0 2024-08-20T01:51:25.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.875+0000 7ff264ff9640 10 client.18978 handle_command_reply: tid=0 2024-08-20T01:51:25.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.875+0000 7ff28587b740 1 client.18978 shutdown 2024-08-20T01:51:25.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.875+0000 7ff28587b740 1 -- 172.21.15.79:0/1205067001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e8331db3f0 msgr2=0x55e8331d8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:25.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.875+0000 7ff28587b740 1 --2- 172.21.15.79:0/1205067001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e8331db3f0 0x55e8331d8e50 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7ff2740aafb0 tx=0x7ff2740aa790 comp rx=0 tx=0).stop 2024-08-20T01:51:25.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.875+0000 7ff28587b740 1 -- 172.21.15.79:0/1205067001 shutdown_connections 2024-08-20T01:51:25.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.875+0000 7ff28587b740 1 --2- 172.21.15.79:0/1205067001 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x55e8331eb2f0 0x55e8331ed740 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:25.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.875+0000 7ff28587b740 1 --2- 172.21.15.79:0/1205067001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e8331db3f0 0x55e8331d8e50 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:25.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.875+0000 7ff28587b740 1 --2- 172.21.15.79:0/1205067001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8331cb050 0x55e8331d8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:25.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.875+0000 7ff28587b740 1 --2- 172.21.15.79:0/1205067001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8331ca730 0x55e8331d83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:25.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.875+0000 7ff264ff9640 0 client.18978 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:51:25.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.875+0000 7ff28587b740 1 -- 172.21.15.79:0/1205067001 >> 172.21.15.79:0/1205067001 conn(0x55e8331c8560 msgr2=0x55e8331ce100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:25.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.875+0000 7ff28587b740 1 -- 172.21.15.79:0/1205067001 shutdown_connections 2024-08-20T01:51:25.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.875+0000 7ff28587b740 1 -- 172.21.15.79:0/1205067001 wait complete. 2024-08-20T01:51:25.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.875+0000 7ff28587b740 20 client.18978 trim_cache size 0 max 16384 2024-08-20T01:51:25.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.888+0000 7ff28587b740 1 Processor -- start 2024-08-20T01:51:25.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.888+0000 7ff28587b740 1 -- start start 2024-08-20T01:51:25.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.889+0000 7ff28587b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8331ca730 0x55e8331d5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:25.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.889+0000 7ff28587b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8331cb050 0x55e8331d7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:25.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.889+0000 7ff28587b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e8331db3f0 0x55e8331cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:25.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.889+0000 7ff28587b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c1abd70 con 0x55e8331db3f0 2024-08-20T01:51:25.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.889+0000 7ff28587b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c1adaf0 con 0x55e8331ca730 2024-08-20T01:51:25.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.889+0000 7ff28587b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c1ac500 con 0x55e8331cb050 2024-08-20T01:51:25.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.889+0000 7ff281a1f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e8331db3f0 0x55e8331cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:25.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.889+0000 7ff281a1f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e8331db3f0 0x55e8331cd8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44100/0 (socket says 172.21.15.79:44100) 2024-08-20T01:51:25.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.889+0000 7ff281a1f640 1 -- 172.21.15.79:0/3914292197 learned_addr learned my addr 172.21.15.79:0/3914292197 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:25.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.889+0000 7ff280a1d640 1 --2- 172.21.15.79:0/3914292197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8331cb050 0x55e8331d7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:25.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.889+0000 7ff28121e640 1 --2- 172.21.15.79:0/3914292197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8331ca730 0x55e8331d5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:25.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.889+0000 7ff281a1f640 1 -- 172.21.15.79:0/3914292197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8331cb050 msgr2=0x55e8331d7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:25.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.889+0000 7ff281a1f640 1 --2- 172.21.15.79:0/3914292197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8331cb050 0x55e8331d7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:25.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.889+0000 7ff281a1f640 1 -- 172.21.15.79:0/3914292197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8331ca730 msgr2=0x55e8331d5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:25.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.889+0000 7ff281a1f640 1 --2- 172.21.15.79:0/3914292197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8331ca730 0x55e8331d5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:25.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.889+0000 7ff281a1f640 1 -- 172.21.15.79:0/3914292197 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8331d63c0 con 0x55e8331db3f0 2024-08-20T01:51:25.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.889+0000 7ff28121e640 1 --2- 172.21.15.79:0/3914292197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8331ca730 0x55e8331d5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:51:25.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.889+0000 7ff281a1f640 1 --2- 172.21.15.79:0/3914292197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e8331db3f0 0x55e8331cd8e0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7ff2740049d0 tx=0x7ff274004e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67a651a191daefbf server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:25.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.889+0000 7ff266ffd640 1 -- 172.21.15.79:0/3914292197 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2740c4070 con 0x55e8331db3f0 2024-08-20T01:51:25.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.889+0000 7ff266ffd640 1 -- 172.21.15.79:0/3914292197 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff2740cb030 con 0x55e8331db3f0 2024-08-20T01:51:25.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.889+0000 7ff266ffd640 1 -- 172.21.15.79:0/3914292197 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2740ab490 con 0x55e8331db3f0 2024-08-20T01:51:25.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.890+0000 7ff28587b740 1 -- 172.21.15.79:0/3914292197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e8331db3f0 msgr2=0x55e8331cd8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:25.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.890+0000 7ff28587b740 1 --2- 172.21.15.79:0/3914292197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e8331db3f0 0x55e8331cd8e0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7ff2740049d0 tx=0x7ff274004e70 comp rx=0 tx=0).stop 2024-08-20T01:51:25.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.890+0000 7ff28587b740 1 -- 172.21.15.79:0/3914292197 shutdown_connections 2024-08-20T01:51:25.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.890+0000 7ff28587b740 1 --2- 172.21.15.79:0/3914292197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e8331db3f0 0x55e8331cd8e0 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:25.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.890+0000 7ff28587b740 1 --2- 172.21.15.79:0/3914292197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8331cb050 0x55e8331d7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:25.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.890+0000 7ff28587b740 1 --2- 172.21.15.79:0/3914292197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8331ca730 0x55e8331d5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:25.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.890+0000 7ff28587b740 1 -- 172.21.15.79:0/3914292197 >> 172.21.15.79:0/3914292197 conn(0x55e8331c8560 msgr2=0x55e8331c9a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:25.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.890+0000 7ff28587b740 1 -- 172.21.15.79:0/3914292197 shutdown_connections 2024-08-20T01:51:25.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.890+0000 7ff28587b740 1 -- 172.21.15.79:0/3914292197 wait complete. 2024-08-20T01:51:25.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.890+0000 7ff28587b740 1 -- start start 2024-08-20T01:51:25.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.891+0000 7ff28587b740 1 Processor -- start 2024-08-20T01:51:25.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.891+0000 7ff28587b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e8331ca730 0x55e8331f32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:25.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.891+0000 7ff28587b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8331cb050 0x55e8331f3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:25.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.891+0000 7ff28587b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8331db3f0 0x55e8331e3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:25.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.891+0000 7ff28587b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c1ad360 con 0x55e8331ca730 2024-08-20T01:51:25.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.891+0000 7ff28587b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c1acc60 con 0x55e8331cb050 2024-08-20T01:51:25.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.891+0000 7ff28587b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c1a9d50 con 0x55e8331db3f0 2024-08-20T01:51:25.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.891+0000 7ff28587b740 10 client.0 _ll_register_callbacks cb 0x7ff2740aadf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:51:25.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.891+0000 7ff28121e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e8331ca730 0x55e8331f32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:25.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.891+0000 7ff28121e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e8331ca730 0x55e8331f32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44116/0 (socket says 172.21.15.79:44116) 2024-08-20T01:51:25.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.891+0000 7ff28121e640 1 -- 172.21.15.79:0/790340404 learned_addr learned my addr 172.21.15.79:0/790340404 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:25.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.891+0000 7ff281a1f640 1 --2- 172.21.15.79:0/790340404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8331db3f0 0x55e8331e3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:25.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.891+0000 7ff280a1d640 1 --2- 172.21.15.79:0/790340404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8331cb050 0x55e8331f3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:25.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.891+0000 7ff28121e640 1 -- 172.21.15.79:0/790340404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8331db3f0 msgr2=0x55e8331e3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:25.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.891+0000 7ff28121e640 1 --2- 172.21.15.79:0/790340404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8331db3f0 0x55e8331e3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:25.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.891+0000 7ff28121e640 1 -- 172.21.15.79:0/790340404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8331cb050 msgr2=0x55e8331f3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:25.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.891+0000 7ff28121e640 1 --2- 172.21.15.79:0/790340404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8331cb050 0x55e8331f3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:25.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.891+0000 7ff28121e640 1 -- 172.21.15.79:0/790340404 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8331e3ca0 con 0x55e8331ca730 2024-08-20T01:51:25.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.892+0000 7ff28121e640 1 --2- 172.21.15.79:0/790340404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e8331ca730 0x55e8331f32a0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7ff278013010 tx=0x7ff278019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbe5c95266743746 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:25.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.892+0000 7ff264ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:51:25.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.892+0000 7ff264ff9640 1 -- 172.21.15.79:0/790340404 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27801e040 con 0x55e8331ca730 2024-08-20T01:51:25.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.892+0000 7ff264ff9640 1 -- 172.21.15.79:0/790340404 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff278009cc0 con 0x55e8331ca730 2024-08-20T01:51:25.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.892+0000 7ff28587b740 1 -- 172.21.15.79:0/790340404 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2740cb030 con 0x55e8331ca730 2024-08-20T01:51:25.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.892+0000 7ff264ff9640 1 -- 172.21.15.79:0/790340404 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7ff27801ab80 con 0x55e8331ca730 2024-08-20T01:51:25.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.892+0000 7ff28587b740 10 client.18984 fetch_fsmap learned FSMap version 60 2024-08-20T01:51:25.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.892+0000 7ff28587b740 1 -- 172.21.15.79:0/790340404 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x55e8331f2000 con 0x55e8331ca730 2024-08-20T01:51:25.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.892+0000 7ff264ff9640 1 -- 172.21.15.79:0/790340404 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff2740cb030 con 0x55e8331ca730 2024-08-20T01:51:25.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.892+0000 7ff264ff9640 1 -- 172.21.15.79:0/790340404 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 60) ==== 8418+0+0 (secure 0 0 0) 0x7ff278019910 con 0x55e8331ca730 2024-08-20T01:51:25.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.892+0000 7ff28587b740 10 client.18984 fetch_fsmap finished waiting for FSMap version 60 2024-08-20T01:51:25.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.892+0000 7ff28587b740 10 client.18984 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:51:25.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.892+0000 7ff28587b740 20 client.18984 populate_metadata read hostname 'smithi079' 2024-08-20T01:51:25.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.892+0000 7ff28587b740 1 --2- 172.21.15.79:0/790340404 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x55e8331f25a0 0x55e8331f29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:25.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.892+0000 7ff28587b740 4 client.18984 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:51:25.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.892+0000 7ff28587b740 1 -- 172.21.15.79:0/790340404 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e83313f320 con 0x55e8331f25a0 2024-08-20T01:51:25.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.893+0000 7ff280a1d640 1 --2- 172.21.15.79:0/790340404 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x55e8331f25a0 0x55e8331f29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:25.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.893+0000 7ff264ff9640 10 client.18984 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:51:25.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.893+0000 7ff280a1d640 1 --2- 172.21.15.79:0/790340404 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x55e8331f25a0 0x55e8331f29b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f1685b7e2f02051 server_cookie=1182c2e8f989e5f7 in_seq=0 out_seq=0 2024-08-20T01:51:25.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.893+0000 7ff264ff9640 1 -- 172.21.15.79:0/790340404 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e83313f320 con 0x55e8331f25a0 2024-08-20T01:51:25.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.893+0000 7ff264ff9640 10 client.18984 handle_command_reply: tid=0 2024-08-20T01:51:25.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.893+0000 7ff28587b740 1 client.18984 shutdown 2024-08-20T01:51:25.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.893+0000 7ff28587b740 1 -- 172.21.15.79:0/790340404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e8331ca730 msgr2=0x55e8331f32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:25.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.893+0000 7ff28587b740 1 --2- 172.21.15.79:0/790340404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e8331ca730 0x55e8331f32a0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7ff278013010 tx=0x7ff278019780 comp rx=0 tx=0).stop 2024-08-20T01:51:25.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.893+0000 7ff28587b740 1 -- 172.21.15.79:0/790340404 shutdown_connections 2024-08-20T01:51:25.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.893+0000 7ff28587b740 1 --2- 172.21.15.79:0/790340404 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x55e8331f25a0 0x55e8331f29b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:25.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.893+0000 7ff28587b740 1 --2- 172.21.15.79:0/790340404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e8331db3f0 0x55e8331e3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:25.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.893+0000 7ff28587b740 1 --2- 172.21.15.79:0/790340404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8331cb050 0x55e8331f3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:25.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.893+0000 7ff264ff9640 0 client.18984 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:51:25.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.893+0000 7ff28587b740 1 --2- 172.21.15.79:0/790340404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e8331ca730 0x55e8331f32a0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:25.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.893+0000 7ff28587b740 1 -- 172.21.15.79:0/790340404 >> 172.21.15.79:0/790340404 conn(0x55e8331c8560 msgr2=0x55e8331c9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:25.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.894+0000 7ff28587b740 1 -- 172.21.15.79:0/790340404 shutdown_connections 2024-08-20T01:51:25.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.894+0000 7ff28587b740 1 -- 172.21.15.79:0/790340404 wait complete. 2024-08-20T01:51:25.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.894+0000 7ff28587b740 20 client.18984 trim_cache size 0 max 16384 2024-08-20T01:51:25.906 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:51:25.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.894+0000 7ff283482640 1 -- 172.21.15.79:0/2529161043 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff2680b3c50 msgr2=0x7ff2680b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:25.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.894+0000 7ff283482640 1 --2- 172.21.15.79:0/2529161043 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff2680b3c50 0x7ff2680b6110 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ff26c0057c0 tx=0x7ff26c005bb0 comp rx=0 tx=0).stop 2024-08-20T01:51:25.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.894+0000 7ff283482640 1 -- 172.21.15.79:0/2529161043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff27c107d20 msgr2=0x7ff27c19a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:25.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.894+0000 7ff283482640 1 --2- 172.21.15.79:0/2529161043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff27c107d20 0x7ff27c19a750 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7ff27400eb10 tx=0x7ff27400c2d0 comp rx=0 tx=0).stop 2024-08-20T01:51:25.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.894+0000 7ff283482640 1 -- 172.21.15.79:0/2529161043 shutdown_connections 2024-08-20T01:51:25.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.894+0000 7ff283482640 1 --2- 172.21.15.79:0/2529161043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff27c107d20 0x7ff27c19a750 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:25.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.894+0000 7ff283482640 1 --2- 172.21.15.79:0/2529161043 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff2680b3c50 0x7ff2680b6110 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:25.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.894+0000 7ff283482640 1 --2- 172.21.15.79:0/2529161043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff27c1073a0 0x7ff27c19a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:25.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.894+0000 7ff283482640 1 --2- 172.21.15.79:0/2529161043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff27c101990 0x7ff27c199cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:25.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.894+0000 7ff283482640 1 -- 172.21.15.79:0/2529161043 >> 172.21.15.79:0/2529161043 conn(0x7ff27c0fd400 msgr2=0x7ff27c0ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:25.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.894+0000 7ff283482640 1 -- 172.21.15.79:0/2529161043 shutdown_connections 2024-08-20T01:51:25.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:25.894+0000 7ff283482640 1 -- 172.21.15.79:0/2529161043 wait complete. 2024-08-20T01:51:26.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:25 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:51:26.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:25 smithi081 ceph-mon[22209]: pgmap v770: 97 pgs: 97 active+clean; 12 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 23 op/s 2024-08-20T01:51:26.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:25 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:51:26.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:25 smithi175 ceph-mon[22392]: pgmap v770: 97 pgs: 97 active+clean; 12 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 23 op/s 2024-08-20T01:51:26.625 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T01:51:26.874 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:51:27.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.376+0000 7fe5a6f78640 1 -- 172.21.15.79:0/2908007285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5a01084c0 msgr2=0x7fe5a0108900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:27.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.376+0000 7fe5a6f78640 1 --2- 172.21.15.79:0/2908007285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5a01084c0 0x7fe5a0108900 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fe590009900 tx=0x7fe59002a410 comp rx=0 tx=0).stop 2024-08-20T01:51:27.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.376+0000 7fe5a6f78640 1 -- 172.21.15.79:0/2908007285 shutdown_connections 2024-08-20T01:51:27.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.376+0000 7fe5a6f78640 1 --2- 172.21.15.79:0/2908007285 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5a0108e40 0x7fe5a010f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:27.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.376+0000 7fe5a6f78640 1 --2- 172.21.15.79:0/2908007285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5a01084c0 0x7fe5a0108900 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:27.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.376+0000 7fe5a6f78640 1 --2- 172.21.15.79:0/2908007285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5a0102ab0 0x7fe5a0102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:27.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.376+0000 7fe5a6f78640 1 -- 172.21.15.79:0/2908007285 >> 172.21.15.79:0/2908007285 conn(0x7fe5a00fe580 msgr2=0x7fe5a01009a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:27.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.376+0000 7fe5a6f78640 1 -- 172.21.15.79:0/2908007285 shutdown_connections 2024-08-20T01:51:27.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.376+0000 7fe5a6f78640 1 -- 172.21.15.79:0/2908007285 wait complete. 2024-08-20T01:51:27.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.377+0000 7fe5a6f78640 1 Processor -- start 2024-08-20T01:51:27.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.377+0000 7fe5a6f78640 1 -- start start 2024-08-20T01:51:27.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.377+0000 7fe5a6f78640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5a0102ab0 0x7fe5a0198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:27.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.377+0000 7fe5a6f78640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5a01084c0 0x7fe5a0199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:27.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.377+0000 7fe5a6f78640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5a0108e40 0x7fe5a019e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:27.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.377+0000 7fe5a6f78640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a0112a00 con 0x7fe5a0102ab0 2024-08-20T01:51:27.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.377+0000 7fe5a6f78640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a0112880 con 0x7fe5a0108e40 2024-08-20T01:51:27.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.377+0000 7fe5a6f78640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a0112b80 con 0x7fe5a01084c0 2024-08-20T01:51:27.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.377+0000 7fe5a4d14640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5a0102ab0 0x7fe5a0198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:27.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.377+0000 7fe5a4d14640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5a0102ab0 0x7fe5a0198e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44142/0 (socket says 172.21.15.79:44142) 2024-08-20T01:51:27.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.377+0000 7fe5a4d14640 1 -- 172.21.15.79:0/35902001 learned_addr learned my addr 172.21.15.79:0/35902001 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:27.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.377+0000 7fe5a5515640 1 --2- 172.21.15.79:0/35902001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5a0108e40 0x7fe5a019e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:27.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.378+0000 7fe597fff640 1 --2- 172.21.15.79:0/35902001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5a01084c0 0x7fe5a0199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:27.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.378+0000 7fe5a4d14640 1 -- 172.21.15.79:0/35902001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5a01084c0 msgr2=0x7fe5a0199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:27.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.378+0000 7fe5a4d14640 1 --2- 172.21.15.79:0/35902001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5a01084c0 0x7fe5a0199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:27.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.378+0000 7fe5a4d14640 1 -- 172.21.15.79:0/35902001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5a0108e40 msgr2=0x7fe5a019e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:27.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.378+0000 7fe5a4d14640 1 --2- 172.21.15.79:0/35902001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5a0108e40 0x7fe5a019e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:27.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.378+0000 7fe5a4d14640 1 -- 172.21.15.79:0/35902001 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5a019eee0 con 0x7fe5a0102ab0 2024-08-20T01:51:27.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.378+0000 7fe597fff640 1 --2- 172.21.15.79:0/35902001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5a01084c0 0x7fe5a0199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:51:27.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.378+0000 7fe5a4d14640 1 --2- 172.21.15.79:0/35902001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5a0102ab0 0x7fe5a0198e30 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fe59c00d950 tx=0x7fe59c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:27.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.378+0000 7fe595ffb640 1 -- 172.21.15.79:0/35902001 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59c017070 con 0x7fe5a0102ab0 2024-08-20T01:51:27.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.378+0000 7fe5a6f78640 1 -- 172.21.15.79:0/35902001 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5a019f1d0 con 0x7fe5a0102ab0 2024-08-20T01:51:27.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.378+0000 7fe595ffb640 1 -- 172.21.15.79:0/35902001 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe59c009c30 con 0x7fe5a0102ab0 2024-08-20T01:51:27.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.378+0000 7fe595ffb640 1 -- 172.21.15.79:0/35902001 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59c00f620 con 0x7fe5a0102ab0 2024-08-20T01:51:27.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.378+0000 7fe5a6f78640 1 -- 172.21.15.79:0/35902001 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5a01a5a60 con 0x7fe5a0102ab0 2024-08-20T01:51:27.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.381+0000 7fe595ffb640 1 -- 172.21.15.79:0/35902001 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fe59c010460 con 0x7fe5a0102ab0 2024-08-20T01:51:27.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.381+0000 7fe5a9371740 1 Processor -- start 2024-08-20T01:51:27.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.381+0000 7fe5a9371740 1 -- start start 2024-08-20T01:51:27.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.381+0000 7fe595ffb640 1 --2- 172.21.15.79:0/35902001 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe5880b3bd0 0x7fe5880b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:27.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.381+0000 7fe5a5515640 1 --2- 172.21.15.79:0/35902001 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe5880b3bd0 0x7fe5880b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:27.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.381+0000 7fe5a9371740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bb5742730 0x560bb5742b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:27.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.382+0000 7fe5a9371740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560bb5743050 0x560bb574eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:27.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.382+0000 7fe595ffb640 1 -- 172.21.15.79:0/35902001 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fe59c0e3860 con 0x7fe5a0102ab0 2024-08-20T01:51:27.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.382+0000 7fe5a9371740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bb574efe0 0x560bb57513d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:27.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.382+0000 7fe5a9371740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560bb56b9930 con 0x560bb5742730 2024-08-20T01:51:27.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.382+0000 7fe5a9371740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560bb56a8e30 con 0x560bb5743050 2024-08-20T01:51:27.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.382+0000 7fe5a9371740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560bb56ace70 con 0x560bb574efe0 2024-08-20T01:51:27.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.382+0000 7fe5a4d14640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bb5742730 0x560bb5742b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:27.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.382+0000 7fe5a4d14640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bb5742730 0x560bb5742b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44156/0 (socket says 172.21.15.79:44156) 2024-08-20T01:51:27.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.382+0000 7fe5a4d14640 1 -- 172.21.15.79:0/3039060452 learned_addr learned my addr 172.21.15.79:0/3039060452 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:27.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.382+0000 7fe597fff640 1 --2- 172.21.15.79:0/3039060452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560bb5743050 0x560bb574eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:27.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.382+0000 7fe5a5515640 1 --2- 172.21.15.79:0/3039060452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bb574efe0 0x560bb57513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:27.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.382+0000 7fe5a4d14640 1 -- 172.21.15.79:0/3039060452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bb574efe0 msgr2=0x560bb57513d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:27.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.382+0000 7fe5a4d14640 1 --2- 172.21.15.79:0/3039060452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bb574efe0 0x560bb57513d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:27.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.382+0000 7fe5a4d14640 1 -- 172.21.15.79:0/3039060452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560bb5743050 msgr2=0x560bb574eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:27.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.382+0000 7fe5a4d14640 1 --2- 172.21.15.79:0/3039060452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560bb5743050 0x560bb574eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:27.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.382+0000 7fe5a4d14640 1 -- 172.21.15.79:0/3039060452 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bb5408650 con 0x560bb5742730 2024-08-20T01:51:27.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.382+0000 7fe597fff640 1 --2- 172.21.15.79:0/3039060452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560bb5743050 0x560bb574eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:51:27.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.382+0000 7fe5a5515640 1 --2- 172.21.15.79:0/35902001 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe5880b3bd0 0x7fe5880b6090 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fe598013750 tx=0x7fe598013b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:27.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.382+0000 7fe5a4d14640 1 --2- 172.21.15.79:0/3039060452 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bb5742730 0x560bb5742b10 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fe59c0b3220 tx=0x7fe59c0aa270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f443aaf93c10e550 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:27.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.382+0000 7fe586ffd640 1 -- 172.21.15.79:0/3039060452 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59c020040 con 0x560bb5742730 2024-08-20T01:51:27.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.382+0000 7fe586ffd640 1 -- 172.21.15.79:0/3039060452 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe59c0aa760 con 0x560bb5742730 2024-08-20T01:51:27.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.382+0000 7fe586ffd640 1 -- 172.21.15.79:0/3039060452 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59c0a60d0 con 0x560bb5742730 2024-08-20T01:51:27.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.383+0000 7fe5a9371740 1 -- 172.21.15.79:0/3039060452 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bb5742730 msgr2=0x560bb5742b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:27.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.383+0000 7fe5a9371740 1 --2- 172.21.15.79:0/3039060452 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bb5742730 0x560bb5742b10 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fe59c0b3220 tx=0x7fe59c0aa270 comp rx=0 tx=0).stop 2024-08-20T01:51:27.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.383+0000 7fe5a9371740 1 -- 172.21.15.79:0/3039060452 shutdown_connections 2024-08-20T01:51:27.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.383+0000 7fe5a9371740 1 --2- 172.21.15.79:0/3039060452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bb574efe0 0x560bb57513d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:27.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.383+0000 7fe5a9371740 1 --2- 172.21.15.79:0/3039060452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560bb5743050 0x560bb574eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:27.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.383+0000 7fe5a9371740 1 --2- 172.21.15.79:0/3039060452 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bb5742730 0x560bb5742b10 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:27.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.383+0000 7fe5a9371740 1 -- 172.21.15.79:0/3039060452 >> 172.21.15.79:0/3039060452 conn(0x560bb5740560 msgr2=0x560bb5741700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:27.417 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:51:27.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.383+0000 7fe5a9371740 1 -- 172.21.15.79:0/3039060452 shutdown_connections 2024-08-20T01:51:27.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.383+0000 7fe5a9371740 1 -- 172.21.15.79:0/3039060452 wait complete. 2024-08-20T01:51:27.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.383+0000 7fe5a9371740 1 -- start start 2024-08-20T01:51:27.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.384+0000 7fe5a9371740 1 Processor -- start 2024-08-20T01:51:27.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.384+0000 7fe5a9371740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bb5742730 0x560bb574c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:27.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.384+0000 7fe5a9371740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560bb5743050 0x560bb574c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:27.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.384+0000 7fe5a9371740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bb574efe0 0x560bb574caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:27.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.384+0000 7fe5a9371740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560bb550b700 con 0x560bb574efe0 2024-08-20T01:51:27.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.384+0000 7fe5a9371740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560bb562f810 con 0x560bb5743050 2024-08-20T01:51:27.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.384+0000 7fe5a9371740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560bb5751bd0 con 0x560bb5742730 2024-08-20T01:51:27.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.384+0000 7fe5a9371740 10 client.0 _ll_register_callbacks cb 0x560bb56a2700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:51:27.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.384+0000 7fe5a5515640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bb574efe0 0x560bb574caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:27.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.384+0000 7fe5a4d14640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bb5742730 0x560bb574c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:27.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.384+0000 7fe5a5515640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bb574efe0 0x560bb574caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44170/0 (socket says 172.21.15.79:44170) 2024-08-20T01:51:27.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.384+0000 7fe5a5515640 1 -- 172.21.15.79:0/961192403 learned_addr learned my addr 172.21.15.79:0/961192403 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:27.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.384+0000 7fe597fff640 1 --2- 172.21.15.79:0/961192403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560bb5743050 0x560bb574c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:27.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.384+0000 7fe5a4d14640 1 -- 172.21.15.79:0/961192403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560bb5743050 msgr2=0x560bb574c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:27.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.384+0000 7fe5a4d14640 1 --2- 172.21.15.79:0/961192403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560bb5743050 0x560bb574c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:27.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.384+0000 7fe5a4d14640 1 -- 172.21.15.79:0/961192403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bb574efe0 msgr2=0x560bb574caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:27.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.384+0000 7fe5a4d14640 1 --2- 172.21.15.79:0/961192403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bb574efe0 0x560bb574caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:27.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.384+0000 7fe5a4d14640 1 -- 172.21.15.79:0/961192403 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bb575b040 con 0x560bb5742730 2024-08-20T01:51:27.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.384+0000 7fe597fff640 1 --2- 172.21.15.79:0/961192403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560bb5743050 0x560bb574c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:51:27.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.385+0000 7fe5a4d14640 1 --2- 172.21.15.79:0/961192403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bb5742730 0x560bb574c070 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x560bb57436a0 tx=0x7fe59c0a6c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ff09f48bd1283a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:27.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.385+0000 7fe57ffff640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:51:27.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.385+0000 7fe57ffff640 1 -- 172.21.15.79:0/961192403 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59c0c4060 con 0x560bb5742730 2024-08-20T01:51:27.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.385+0000 7fe5a9371740 1 -- 172.21.15.79:0/961192403 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560bb5658150 con 0x560bb5742730 2024-08-20T01:51:27.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.385+0000 7fe57ffff640 1 -- 172.21.15.79:0/961192403 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fe59c0a6d50 con 0x560bb5742730 2024-08-20T01:51:27.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.385+0000 7fe57ffff640 1 -- 172.21.15.79:0/961192403 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7fe59c020050 con 0x560bb5742730 2024-08-20T01:51:27.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.385+0000 7fe5a9371740 10 client.28036 fetch_fsmap learned FSMap version 60 2024-08-20T01:51:27.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.385+0000 7fe5a9371740 1 -- 172.21.15.79:0/961192403 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x560bb575d9f0 con 0x560bb5742730 2024-08-20T01:51:27.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.385+0000 7fe57ffff640 1 -- 172.21.15.79:0/961192403 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x560bb5658150 con 0x560bb5742730 2024-08-20T01:51:27.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.385+0000 7fe57ffff640 1 -- 172.21.15.79:0/961192403 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 60) ==== 8418+0+0 (secure 0 0 0) 0x7fe59c010750 con 0x560bb5742730 2024-08-20T01:51:27.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.385+0000 7fe5a9371740 10 client.28036 fetch_fsmap finished waiting for FSMap version 60 2024-08-20T01:51:27.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.385+0000 7fe5a9371740 10 client.28036 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:51:27.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.385+0000 7fe5a9371740 20 client.28036 populate_metadata read hostname 'smithi079' 2024-08-20T01:51:27.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.385+0000 7fe5a9371740 1 --2- 172.21.15.79:0/961192403 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x560bb575ed40 0x560bb5761130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:27.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.385+0000 7fe5a9371740 4 client.28036 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:51:27.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.385+0000 7fe5a9371740 1 -- 172.21.15.79:0/961192403 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560bb56bb880 con 0x560bb575ed40 2024-08-20T01:51:27.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.385+0000 7fe597fff640 1 --2- 172.21.15.79:0/961192403 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x560bb575ed40 0x560bb5761130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:27.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.386+0000 7fe57ffff640 10 client.28036 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:51:27.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.386+0000 7fe597fff640 1 --2- 172.21.15.79:0/961192403 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x560bb575ed40 0x560bb5761130 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=66f176ce51997362 server_cookie=904fda0313a6ed70 in_seq=0 out_seq=0 2024-08-20T01:51:27.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.387+0000 7fe57ffff640 1 -- 172.21.15.79:0/961192403 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560bb56bb880 con 0x560bb575ed40 2024-08-20T01:51:27.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.387+0000 7fe57ffff640 10 client.28036 handle_command_reply: tid=0 2024-08-20T01:51:27.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.387+0000 7fe5a9371740 1 client.28036 shutdown 2024-08-20T01:51:27.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.387+0000 7fe5a9371740 1 -- 172.21.15.79:0/961192403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bb5742730 msgr2=0x560bb574c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:27.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.387+0000 7fe5a9371740 1 --2- 172.21.15.79:0/961192403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bb5742730 0x560bb574c070 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x560bb57436a0 tx=0x7fe59c0a6c20 comp rx=0 tx=0).stop 2024-08-20T01:51:27.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.387+0000 7fe5a9371740 1 -- 172.21.15.79:0/961192403 shutdown_connections 2024-08-20T01:51:27.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.387+0000 7fe5a9371740 1 --2- 172.21.15.79:0/961192403 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x560bb575ed40 0x560bb5761130 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:27.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.387+0000 7fe5a9371740 1 --2- 172.21.15.79:0/961192403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bb574efe0 0x560bb574caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:27.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.387+0000 7fe57ffff640 0 client.28036 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:51:27.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.387+0000 7fe5a9371740 1 --2- 172.21.15.79:0/961192403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560bb5743050 0x560bb574c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:27.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.387+0000 7fe5a9371740 1 --2- 172.21.15.79:0/961192403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bb5742730 0x560bb574c070 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:27.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.387+0000 7fe5a9371740 1 -- 172.21.15.79:0/961192403 >> 172.21.15.79:0/961192403 conn(0x560bb5740560 msgr2=0x560bb57460d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:27.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.387+0000 7fe5a9371740 1 -- 172.21.15.79:0/961192403 shutdown_connections 2024-08-20T01:51:27.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.387+0000 7fe5a9371740 1 -- 172.21.15.79:0/961192403 wait complete. 2024-08-20T01:51:27.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.387+0000 7fe5a9371740 20 client.28036 trim_cache size 0 max 16384 2024-08-20T01:51:27.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.400+0000 7fe5a9371740 1 Processor -- start 2024-08-20T01:51:27.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.400+0000 7fe5a9371740 1 -- start start 2024-08-20T01:51:27.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.400+0000 7fe5a9371740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560bb5742730 0x560bb574b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:27.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.400+0000 7fe5a9371740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bb5743050 0x560bb5749280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:27.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.400+0000 7fe5a9371740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bb574efe0 0x560bb57497c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:27.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.400+0000 7fe5a9371740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a01adfb0 con 0x560bb5743050 2024-08-20T01:51:27.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.400+0000 7fe5a9371740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a01afd30 con 0x560bb5742730 2024-08-20T01:51:27.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.400+0000 7fe5a9371740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a01ae740 con 0x560bb574efe0 2024-08-20T01:51:27.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.400+0000 7fe597fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bb5743050 0x560bb5749280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:27.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.400+0000 7fe597fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bb5743050 0x560bb5749280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44172/0 (socket says 172.21.15.79:44172) 2024-08-20T01:51:27.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.400+0000 7fe597fff640 1 -- 172.21.15.79:0/3397762832 learned_addr learned my addr 172.21.15.79:0/3397762832 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:27.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.400+0000 7fe5a4d14640 1 --2- 172.21.15.79:0/3397762832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560bb5742730 0x560bb574b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:27.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.401+0000 7fe5a5515640 1 --2- 172.21.15.79:0/3397762832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bb574efe0 0x560bb57497c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:27.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.401+0000 7fe597fff640 1 -- 172.21.15.79:0/3397762832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bb574efe0 msgr2=0x560bb57497c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:27.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.401+0000 7fe597fff640 1 --2- 172.21.15.79:0/3397762832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bb574efe0 0x560bb57497c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:27.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.401+0000 7fe597fff640 1 -- 172.21.15.79:0/3397762832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560bb5742730 msgr2=0x560bb574b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:27.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.401+0000 7fe597fff640 1 --2- 172.21.15.79:0/3397762832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560bb5742730 0x560bb574b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:27.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.401+0000 7fe597fff640 1 -- 172.21.15.79:0/3397762832 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bb5740fe0 con 0x560bb5743050 2024-08-20T01:51:27.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.401+0000 7fe597fff640 1 --2- 172.21.15.79:0/3397762832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bb5743050 0x560bb5749280 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fe590006010 tx=0x7fe590009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a262739d51ac3b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:27.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.401+0000 7fe5867fc640 1 -- 172.21.15.79:0/3397762832 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe590048070 con 0x560bb5743050 2024-08-20T01:51:27.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.401+0000 7fe5867fc640 1 -- 172.21.15.79:0/3397762832 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe590005530 con 0x560bb5743050 2024-08-20T01:51:27.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.401+0000 7fe5867fc640 1 -- 172.21.15.79:0/3397762832 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe590035040 con 0x560bb5743050 2024-08-20T01:51:27.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.402+0000 7fe5a9371740 1 -- 172.21.15.79:0/3397762832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bb5743050 msgr2=0x560bb5749280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:27.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.402+0000 7fe5a9371740 1 --2- 172.21.15.79:0/3397762832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bb5743050 0x560bb5749280 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fe590006010 tx=0x7fe590009560 comp rx=0 tx=0).stop 2024-08-20T01:51:27.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.402+0000 7fe5a9371740 1 -- 172.21.15.79:0/3397762832 shutdown_connections 2024-08-20T01:51:27.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.402+0000 7fe5a9371740 1 --2- 172.21.15.79:0/3397762832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bb574efe0 0x560bb57497c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:27.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.402+0000 7fe5a9371740 1 --2- 172.21.15.79:0/3397762832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bb5743050 0x560bb5749280 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:27.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.402+0000 7fe5a9371740 1 --2- 172.21.15.79:0/3397762832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560bb5742730 0x560bb574b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:27.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.402+0000 7fe5a9371740 1 -- 172.21.15.79:0/3397762832 >> 172.21.15.79:0/3397762832 conn(0x560bb5740560 msgr2=0x560bb573f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:27.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.402+0000 7fe5a9371740 1 -- 172.21.15.79:0/3397762832 shutdown_connections 2024-08-20T01:51:27.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.402+0000 7fe5a9371740 1 -- 172.21.15.79:0/3397762832 wait complete. 2024-08-20T01:51:27.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.402+0000 7fe5a9371740 1 -- start start 2024-08-20T01:51:27.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.402+0000 7fe5a9371740 1 Processor -- start 2024-08-20T01:51:27.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.402+0000 7fe5a9371740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560bb5742730 0x560bb5761140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:27.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.403+0000 7fe5a9371740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bb5743050 0x560bb5761680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:27.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.403+0000 7fe5a9371740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bb574efe0 0x560bb5761bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:27.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.403+0000 7fe5a9371740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a01af5a0 con 0x560bb574efe0 2024-08-20T01:51:27.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.403+0000 7fe5a9371740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a01aeea0 con 0x560bb5742730 2024-08-20T01:51:27.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.403+0000 7fe5a9371740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a01abf90 con 0x560bb5743050 2024-08-20T01:51:27.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.403+0000 7fe5a9371740 10 client.0 _ll_register_callbacks cb 0x7fe590009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:51:27.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.403+0000 7fe5a5515640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bb574efe0 0x560bb5761bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:27.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.403+0000 7fe597fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bb5743050 0x560bb5761680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:27.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.403+0000 7fe5a4d14640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560bb5742730 0x560bb5761140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:27.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.403+0000 7fe5a5515640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bb574efe0 0x560bb5761bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44182/0 (socket says 172.21.15.79:44182) 2024-08-20T01:51:27.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.403+0000 7fe5a5515640 1 -- 172.21.15.79:0/796342726 learned_addr learned my addr 172.21.15.79:0/796342726 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:27.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.403+0000 7fe5a4d14640 1 -- 172.21.15.79:0/796342726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bb5743050 msgr2=0x560bb5761680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:27.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.403+0000 7fe5a4d14640 1 --2- 172.21.15.79:0/796342726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bb5743050 0x560bb5761680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:27.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.403+0000 7fe5a4d14640 1 -- 172.21.15.79:0/796342726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bb574efe0 msgr2=0x560bb5761bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:27.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.403+0000 7fe5a4d14640 1 --2- 172.21.15.79:0/796342726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bb574efe0 0x560bb5761bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:27.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.403+0000 7fe5a4d14640 1 -- 172.21.15.79:0/796342726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bb57c77f0 con 0x560bb5742730 2024-08-20T01:51:27.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.403+0000 7fe597fff640 1 --2- 172.21.15.79:0/796342726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bb5743050 0x560bb5761680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:51:27.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.403+0000 7fe5a4d14640 1 --2- 172.21.15.79:0/796342726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560bb5742730 0x560bb5761140 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe59c0aa460 tx=0x7fe59c00dfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f823c7d8899f5ebf server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:27.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.403+0000 7fe57ffff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:51:27.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.403+0000 7fe57ffff640 1 -- 172.21.15.79:0/796342726 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59c0c4030 con 0x560bb5742730 2024-08-20T01:51:27.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.403+0000 7fe5a9371740 1 -- 172.21.15.79:0/796342726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe590005530 con 0x560bb5742730 2024-08-20T01:51:27.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.403+0000 7fe57ffff640 1 -- 172.21.15.79:0/796342726 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fe59c0bfe00 con 0x560bb5742730 2024-08-20T01:51:27.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.403+0000 7fe57ffff640 1 -- 172.21.15.79:0/796342726 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7fe59c0a6620 con 0x560bb5742730 2024-08-20T01:51:27.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.404+0000 7fe5a9371740 10 client.28115 fetch_fsmap learned FSMap version 60 2024-08-20T01:51:27.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.404+0000 7fe5a9371740 1 -- 172.21.15.79:0/796342726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x560bb57c8af0 con 0x560bb5742730 2024-08-20T01:51:27.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.404+0000 7fe57ffff640 1 -- 172.21.15.79:0/796342726 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe590005530 con 0x560bb5742730 2024-08-20T01:51:27.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.404+0000 7fe57ffff640 1 -- 172.21.15.79:0/796342726 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 60) ==== 8418+0+0 (secure 0 0 0) 0x7fe59c0aba90 con 0x560bb5742730 2024-08-20T01:51:27.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.404+0000 7fe5a9371740 10 client.28115 fetch_fsmap finished waiting for FSMap version 60 2024-08-20T01:51:27.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.404+0000 7fe5a9371740 10 client.28115 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:51:27.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.404+0000 7fe5a9371740 20 client.28115 populate_metadata read hostname 'smithi079' 2024-08-20T01:51:27.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.404+0000 7fe5a9371740 1 --2- 172.21.15.79:0/796342726 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x560bb57c9100 0x560bb57cb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:27.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.404+0000 7fe5a9371740 4 client.28115 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:51:27.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.404+0000 7fe5a9371740 1 -- 172.21.15.79:0/796342726 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560bb56b7320 con 0x560bb57c9100 2024-08-20T01:51:27.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.404+0000 7fe597fff640 1 --2- 172.21.15.79:0/796342726 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x560bb57c9100 0x560bb57cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:27.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.404+0000 7fe597fff640 1 --2- 172.21.15.79:0/796342726 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x560bb57c9100 0x560bb57cb520 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=975459d5e85ce0a1 server_cookie=f1dca60a52c328c3 in_seq=0 out_seq=0 2024-08-20T01:51:27.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.405+0000 7fe57ffff640 10 client.28115 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:51:27.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.405+0000 7fe57ffff640 1 -- 172.21.15.79:0/796342726 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560bb56b7320 con 0x560bb57c9100 2024-08-20T01:51:27.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.405+0000 7fe57ffff640 10 client.28115 handle_command_reply: tid=0 2024-08-20T01:51:27.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.405+0000 7fe5a9371740 1 client.28115 shutdown 2024-08-20T01:51:27.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.405+0000 7fe5a9371740 1 -- 172.21.15.79:0/796342726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560bb5742730 msgr2=0x560bb5761140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:27.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.405+0000 7fe5a9371740 1 --2- 172.21.15.79:0/796342726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560bb5742730 0x560bb5761140 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe59c0aa460 tx=0x7fe59c00dfa0 comp rx=0 tx=0).stop 2024-08-20T01:51:27.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.405+0000 7fe5a9371740 1 -- 172.21.15.79:0/796342726 shutdown_connections 2024-08-20T01:51:27.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.405+0000 7fe5a9371740 1 --2- 172.21.15.79:0/796342726 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x560bb57c9100 0x560bb57cb520 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:27.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.405+0000 7fe5a9371740 1 --2- 172.21.15.79:0/796342726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bb574efe0 0x560bb5761bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:27.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.405+0000 7fe5a9371740 1 --2- 172.21.15.79:0/796342726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bb5743050 0x560bb5761680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:27.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.405+0000 7fe57ffff640 0 client.28115 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:51:27.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.405+0000 7fe5a9371740 1 --2- 172.21.15.79:0/796342726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560bb5742730 0x560bb5761140 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:27.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.405+0000 7fe5a9371740 1 -- 172.21.15.79:0/796342726 >> 172.21.15.79:0/796342726 conn(0x560bb5740560 msgr2=0x560bb574bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:27.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.405+0000 7fe5a9371740 1 -- 172.21.15.79:0/796342726 shutdown_connections 2024-08-20T01:51:27.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.405+0000 7fe5a9371740 1 -- 172.21.15.79:0/796342726 wait complete. 2024-08-20T01:51:27.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.405+0000 7fe5a9371740 20 client.28115 trim_cache size 0 max 16384 2024-08-20T01:51:27.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.406+0000 7fe5a6f78640 1 -- 172.21.15.79:0/35902001 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe5880b3bd0 msgr2=0x7fe5880b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:27.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.406+0000 7fe5a6f78640 1 --2- 172.21.15.79:0/35902001 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe5880b3bd0 0x7fe5880b6090 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fe598013750 tx=0x7fe598013b50 comp rx=0 tx=0).stop 2024-08-20T01:51:27.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.406+0000 7fe5a6f78640 1 -- 172.21.15.79:0/35902001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5a0102ab0 msgr2=0x7fe5a0198e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:27.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.406+0000 7fe5a6f78640 1 --2- 172.21.15.79:0/35902001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5a0102ab0 0x7fe5a0198e30 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fe59c00d950 tx=0x7fe59c00de10 comp rx=0 tx=0).stop 2024-08-20T01:51:27.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.406+0000 7fe5a6f78640 1 -- 172.21.15.79:0/35902001 shutdown_connections 2024-08-20T01:51:27.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.406+0000 7fe5a6f78640 1 --2- 172.21.15.79:0/35902001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5a0108e40 0x7fe5a019e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:27.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.406+0000 7fe5a6f78640 1 --2- 172.21.15.79:0/35902001 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe5880b3bd0 0x7fe5880b6090 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:27.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.406+0000 7fe5a6f78640 1 --2- 172.21.15.79:0/35902001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5a01084c0 0x7fe5a0199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:27.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.406+0000 7fe5a6f78640 1 --2- 172.21.15.79:0/35902001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5a0102ab0 0x7fe5a0198e30 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:27.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.406+0000 7fe5a6f78640 1 -- 172.21.15.79:0/35902001 >> 172.21.15.79:0/35902001 conn(0x7fe5a00fe580 msgr2=0x7fe5a0100970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:27.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.406+0000 7fe5a6f78640 1 -- 172.21.15.79:0/35902001 shutdown_connections 2024-08-20T01:51:27.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:27.406+0000 7fe5a6f78640 1 -- 172.21.15.79:0/35902001 wait complete. 2024-08-20T01:51:28.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:27 smithi175 ceph-mon[22392]: pgmap v771: 97 pgs: 97 active+clean; 12 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 23 op/s 2024-08-20T01:51:28.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:27 smithi079 ceph-mon[18656]: pgmap v771: 97 pgs: 97 active+clean; 12 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 23 op/s 2024-08-20T01:51:28.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:27 smithi081 ceph-mon[22209]: pgmap v771: 97 pgs: 97 active+clean; 12 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 23 op/s 2024-08-20T01:51:28.412 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T01:51:28.665 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:51:29.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.172+0000 7f49c6368640 1 -- 172.21.15.79:0/2075062574 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49c01019d0 msgr2=0x7f49c0101db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:29.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.172+0000 7f49c6368640 1 --2- 172.21.15.79:0/2075062574 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49c01019d0 0x7f49c0101db0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f49b0009900 tx=0x7f49b002a410 comp rx=0 tx=0).stop 2024-08-20T01:51:29.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.172+0000 7f49c6368640 1 -- 172.21.15.79:0/2075062574 shutdown_connections 2024-08-20T01:51:29.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.172+0000 7f49c6368640 1 --2- 172.21.15.79:0/2075062574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49c0107d60 0x7f49c010e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:29.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.172+0000 7f49c6368640 1 --2- 172.21.15.79:0/2075062574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49c01073e0 0x7f49c0107820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:29.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.172+0000 7f49c6368640 1 --2- 172.21.15.79:0/2075062574 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49c01019d0 0x7f49c0101db0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:29.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.172+0000 7f49c6368640 1 -- 172.21.15.79:0/2075062574 >> 172.21.15.79:0/2075062574 conn(0x7f49c00fd440 msgr2=0x7f49c00ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:29.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.172+0000 7f49c6368640 1 -- 172.21.15.79:0/2075062574 shutdown_connections 2024-08-20T01:51:29.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.172+0000 7f49c6368640 1 -- 172.21.15.79:0/2075062574 wait complete. 2024-08-20T01:51:29.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.172+0000 7f49c6368640 1 Processor -- start 2024-08-20T01:51:29.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.173+0000 7f49c6368640 1 -- start start 2024-08-20T01:51:29.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.173+0000 7f49c6368640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49c01019d0 0x7f49c0198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:29.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.173+0000 7f49c6368640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49c01073e0 0x7f49c0199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:29.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.173+0000 7f49c6368640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49c0107d60 0x7f49c019e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:29.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.173+0000 7f49c6368640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f49c0111920 con 0x7f49c0107d60 2024-08-20T01:51:29.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.173+0000 7f49c6368640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f49c01117a0 con 0x7f49c01019d0 2024-08-20T01:51:29.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.173+0000 7f49c6368640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f49c0111aa0 con 0x7f49c01073e0 2024-08-20T01:51:29.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.173+0000 7f49c4905640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49c0107d60 0x7f49c019e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:29.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.173+0000 7f49bf7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49c01073e0 0x7f49c0199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:29.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.173+0000 7f49c4905640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49c0107d60 0x7f49c019e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44188/0 (socket says 172.21.15.79:44188) 2024-08-20T01:51:29.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.173+0000 7f49c4905640 1 -- 172.21.15.79:0/4170049227 learned_addr learned my addr 172.21.15.79:0/4170049227 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:29.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.173+0000 7f49bffff640 1 --2- 172.21.15.79:0/4170049227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49c01019d0 0x7f49c0198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:29.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.173+0000 7f49c4905640 1 -- 172.21.15.79:0/4170049227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49c01073e0 msgr2=0x7f49c0199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:29.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.173+0000 7f49c4905640 1 --2- 172.21.15.79:0/4170049227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49c01073e0 0x7f49c0199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:29.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.173+0000 7f49c4905640 1 -- 172.21.15.79:0/4170049227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49c01019d0 msgr2=0x7f49c0198e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:29.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.173+0000 7f49c4905640 1 --2- 172.21.15.79:0/4170049227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49c01019d0 0x7f49c0198e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:29.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.173+0000 7f49c4905640 1 -- 172.21.15.79:0/4170049227 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49c019ef00 con 0x7f49c0107d60 2024-08-20T01:51:29.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.174+0000 7f49c4905640 1 --2- 172.21.15.79:0/4170049227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49c0107d60 0x7f49c019e730 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f49b800eaa0 tx=0x7f49b800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:29.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.174+0000 7f49bd7fa640 1 -- 172.21.15.79:0/4170049227 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b8004d20 con 0x7f49c0107d60 2024-08-20T01:51:29.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.174+0000 7f49c6368640 1 -- 172.21.15.79:0/4170049227 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49c019f1f0 con 0x7f49c0107d60 2024-08-20T01:51:29.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.174+0000 7f49c6368640 1 -- 172.21.15.79:0/4170049227 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49c01a58b0 con 0x7f49c0107d60 2024-08-20T01:51:29.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.174+0000 7f49bd7fa640 1 -- 172.21.15.79:0/4170049227 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f49b8005020 con 0x7f49c0107d60 2024-08-20T01:51:29.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.174+0000 7f49bd7fa640 1 -- 172.21.15.79:0/4170049227 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b801f060 con 0x7f49c0107d60 2024-08-20T01:51:29.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.176+0000 7f49bd7fa640 1 -- 172.21.15.79:0/4170049227 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f49b800caf0 con 0x7f49c0107d60 2024-08-20T01:51:29.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.176+0000 7f49c8761740 1 Processor -- start 2024-08-20T01:51:29.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.177+0000 7f49c8761740 1 -- start start 2024-08-20T01:51:29.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.177+0000 7f49c8761740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a03b06880 0x564a03b06c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:29.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.177+0000 7f49c8761740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a03b071a0 0x564a03b12bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:29.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.177+0000 7f49c8761740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a03b13130 0x564a03b15520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:29.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.177+0000 7f49c8761740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564a03a7d930 con 0x564a03b071a0 2024-08-20T01:51:29.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.177+0000 7f49c8761740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564a03a6ce30 con 0x564a03b06880 2024-08-20T01:51:29.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.177+0000 7f49c8761740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564a03a70e70 con 0x564a03b13130 2024-08-20T01:51:29.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.177+0000 7f49bffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a03b071a0 0x564a03b12bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:29.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.177+0000 7f49bffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a03b071a0 0x564a03b12bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44202/0 (socket says 172.21.15.79:44202) 2024-08-20T01:51:29.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.177+0000 7f49bffff640 1 -- 172.21.15.79:0/616148657 learned_addr learned my addr 172.21.15.79:0/616148657 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:29.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.177+0000 7f49bf7fe640 1 --2- 172.21.15.79:0/616148657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a03b06880 0x564a03b06c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:29.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.177+0000 7f49bf7fe640 1 --2- 172.21.15.79:0/616148657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a03b13130 0x564a03b15520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:29.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.177+0000 7f49bffff640 1 -- 172.21.15.79:0/616148657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a03b13130 msgr2=0x564a03b15520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:29.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.177+0000 7f49bffff640 1 --2- 172.21.15.79:0/616148657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a03b13130 0x564a03b15520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:29.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.177+0000 7f49bffff640 1 -- 172.21.15.79:0/616148657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a03b06880 msgr2=0x564a03b06c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:29.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.177+0000 7f49bffff640 1 --2- 172.21.15.79:0/616148657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a03b06880 0x564a03b06c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:29.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.177+0000 7f49bffff640 1 -- 172.21.15.79:0/616148657 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a037cc650 con 0x564a03b071a0 2024-08-20T01:51:29.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.177+0000 7f49bd7fa640 1 --2- 172.21.15.79:0/4170049227 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f49a80b3bd0 0x7f49a80b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:29.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.177+0000 7f49bf7fe640 1 --2- 172.21.15.79:0/616148657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a03b06880 0x564a03b06c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:51:29.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.177+0000 7f49bf7fe640 1 --2- 172.21.15.79:0/4170049227 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f49a80b3bd0 0x7f49a80b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:29.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.177+0000 7f49bffff640 1 --2- 172.21.15.79:0/616148657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a03b071a0 0x564a03b12bf0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f49b0033000 tx=0x7f49b0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fa6e71ace826365 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:29.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.177+0000 7f49bd7fa640 1 -- 172.21.15.79:0/4170049227 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f49b80e3c00 con 0x7f49c0107d60 2024-08-20T01:51:29.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.178+0000 7f49a67fc640 1 -- 172.21.15.79:0/616148657 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b0035040 con 0x564a03b071a0 2024-08-20T01:51:29.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.178+0000 7f49a67fc640 1 -- 172.21.15.79:0/616148657 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f49b00044c0 con 0x564a03b071a0 2024-08-20T01:51:29.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.178+0000 7f49a67fc640 1 -- 172.21.15.79:0/616148657 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b0003850 con 0x564a03b071a0 2024-08-20T01:51:29.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.178+0000 7f49c8761740 1 -- 172.21.15.79:0/616148657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a03b071a0 msgr2=0x564a03b12bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:29.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.178+0000 7f49bf7fe640 1 --2- 172.21.15.79:0/4170049227 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f49a80b3bd0 0x7f49a80b6090 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x564a03b06830 tx=0x7f49b400a6c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:29.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.178+0000 7f49c8761740 1 --2- 172.21.15.79:0/616148657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a03b071a0 0x564a03b12bf0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f49b0033000 tx=0x7f49b0000bc0 comp rx=0 tx=0).stop 2024-08-20T01:51:29.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.179+0000 7f49c8761740 1 -- 172.21.15.79:0/616148657 shutdown_connections 2024-08-20T01:51:29.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.179+0000 7f49c8761740 1 --2- 172.21.15.79:0/616148657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a03b13130 0x564a03b15520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:29.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.179+0000 7f49c8761740 1 --2- 172.21.15.79:0/616148657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a03b071a0 0x564a03b12bf0 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:29.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.179+0000 7f49c8761740 1 --2- 172.21.15.79:0/616148657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a03b06880 0x564a03b06c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:29.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.179+0000 7f49c8761740 1 -- 172.21.15.79:0/616148657 >> 172.21.15.79:0/616148657 conn(0x564a03b046b0 msgr2=0x564a03b05850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:29.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.179+0000 7f49c8761740 1 -- 172.21.15.79:0/616148657 shutdown_connections 2024-08-20T01:51:29.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.179+0000 7f49c8761740 1 -- 172.21.15.79:0/616148657 wait complete. 2024-08-20T01:51:29.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.179+0000 7f49c8761740 1 -- start start 2024-08-20T01:51:29.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.179+0000 7f49c8761740 1 Processor -- start 2024-08-20T01:51:29.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.180+0000 7f49c8761740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a03b06880 0x564a03b100b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:29.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.180+0000 7f49c8761740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a03b071a0 0x564a03b105f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:29.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.180+0000 7f49c8761740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a03b13130 0x564a03b10b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:29.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.180+0000 7f49c8761740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564a038cf700 con 0x564a03b06880 2024-08-20T01:51:29.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.180+0000 7f49c8761740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564a039f3810 con 0x564a03b071a0 2024-08-20T01:51:29.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.180+0000 7f49c8761740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564a03b15d80 con 0x564a03b13130 2024-08-20T01:51:29.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.180+0000 7f49c8761740 10 client.0 _ll_register_callbacks cb 0x564a03a66700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:51:29.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.180+0000 7f49bffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a03b06880 0x564a03b100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:29.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.180+0000 7f49bffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a03b06880 0x564a03b100b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44206/0 (socket says 172.21.15.79:44206) 2024-08-20T01:51:29.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.180+0000 7f49bffff640 1 -- 172.21.15.79:0/3585552153 learned_addr learned my addr 172.21.15.79:0/3585552153 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:29.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.180+0000 7f49c4905640 1 --2- 172.21.15.79:0/3585552153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a03b13130 0x564a03b10b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:29.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.180+0000 7f49bf7fe640 1 --2- 172.21.15.79:0/3585552153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a03b071a0 0x564a03b105f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:29.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.180+0000 7f49bffff640 1 -- 172.21.15.79:0/3585552153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a03b13130 msgr2=0x564a03b10b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:29.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.180+0000 7f49bffff640 1 --2- 172.21.15.79:0/3585552153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a03b13130 0x564a03b10b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:29.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.180+0000 7f49bffff640 1 -- 172.21.15.79:0/3585552153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a03b071a0 msgr2=0x564a03b105f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:29.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.180+0000 7f49bffff640 1 --2- 172.21.15.79:0/3585552153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a03b071a0 0x564a03b105f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:29.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.180+0000 7f49bffff640 1 -- 172.21.15.79:0/3585552153 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a03b1f1c0 con 0x564a03b06880 2024-08-20T01:51:29.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.180+0000 7f49c4905640 1 --2- 172.21.15.79:0/3585552153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a03b13130 0x564a03b10b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:51:29.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.180+0000 7f49bf7fe640 1 --2- 172.21.15.79:0/3585552153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a03b071a0 0x564a03b105f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:51:29.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.180+0000 7f49bffff640 1 --2- 172.21.15.79:0/3585552153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a03b06880 0x564a03b100b0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f49b00057c0 tx=0x7f49b0004910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b105418cdc28ea5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:29.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.180+0000 7f499f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:51:29.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.180+0000 7f499f7fe640 1 -- 172.21.15.79:0/3585552153 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b0053060 con 0x564a03b06880 2024-08-20T01:51:29.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.180+0000 7f499f7fe640 1 -- 172.21.15.79:0/3585552153 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f49b0005230 con 0x564a03b06880 2024-08-20T01:51:29.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.180+0000 7f49c8761740 1 -- 172.21.15.79:0/3585552153 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564a03a1c150 con 0x564a03b06880 2024-08-20T01:51:29.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.181+0000 7f499f7fe640 1 -- 172.21.15.79:0/3585552153 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f49b0035050 con 0x564a03b06880 2024-08-20T01:51:29.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.181+0000 7f49c8761740 10 client.19014 fetch_fsmap learned FSMap version 60 2024-08-20T01:51:29.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.181+0000 7f49c8761740 1 -- 172.21.15.79:0/3585552153 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x564a03b21b50 con 0x564a03b06880 2024-08-20T01:51:29.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.181+0000 7f499f7fe640 1 -- 172.21.15.79:0/3585552153 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x564a03a1c150 con 0x564a03b06880 2024-08-20T01:51:29.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.181+0000 7f499f7fe640 1 -- 172.21.15.79:0/3585552153 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 60) ==== 8418+0+0 (secure 0 0 0) 0x7f49b003cb00 con 0x564a03b06880 2024-08-20T01:51:29.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.181+0000 7f49c8761740 10 client.19014 fetch_fsmap finished waiting for FSMap version 60 2024-08-20T01:51:29.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.181+0000 7f49c8761740 10 client.19014 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:51:29.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.181+0000 7f49c8761740 20 client.19014 populate_metadata read hostname 'smithi079' 2024-08-20T01:51:29.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.181+0000 7f49c8761740 1 --2- 172.21.15.79:0/3585552153 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x564a03b22ea0 0x564a03b25290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:29.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.181+0000 7f49c8761740 4 client.19014 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:51:29.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.181+0000 7f49c8761740 1 -- 172.21.15.79:0/3585552153 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a03a7f880 con 0x564a03b22ea0 2024-08-20T01:51:29.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.181+0000 7f49bf7fe640 1 --2- 172.21.15.79:0/3585552153 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x564a03b22ea0 0x564a03b25290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:29.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.182+0000 7f49bf7fe640 1 --2- 172.21.15.79:0/3585552153 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x564a03b22ea0 0x564a03b25290 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=55d6b6112f3cf435 server_cookie=3bb4d384ca82f3fd in_seq=0 out_seq=0 2024-08-20T01:51:29.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.182+0000 7f499f7fe640 10 client.19014 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:51:29.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.182+0000 7f499f7fe640 1 -- 172.21.15.79:0/3585552153 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564a03a7f880 con 0x564a03b22ea0 2024-08-20T01:51:29.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.182+0000 7f499f7fe640 10 client.19014 handle_command_reply: tid=0 2024-08-20T01:51:29.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.182+0000 7f49c8761740 1 client.19014 shutdown 2024-08-20T01:51:29.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.182+0000 7f49c8761740 1 -- 172.21.15.79:0/3585552153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a03b06880 msgr2=0x564a03b100b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:29.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.182+0000 7f49c8761740 1 --2- 172.21.15.79:0/3585552153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a03b06880 0x564a03b100b0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f49b00057c0 tx=0x7f49b0004910 comp rx=0 tx=0).stop 2024-08-20T01:51:29.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.183+0000 7f49c8761740 1 -- 172.21.15.79:0/3585552153 shutdown_connections 2024-08-20T01:51:29.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.183+0000 7f49c8761740 1 --2- 172.21.15.79:0/3585552153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a03b13130 0x564a03b10b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:29.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.183+0000 7f49c8761740 1 --2- 172.21.15.79:0/3585552153 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x564a03b22ea0 0x564a03b25290 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:29.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.183+0000 7f49c8761740 1 --2- 172.21.15.79:0/3585552153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a03b071a0 0x564a03b105f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:29.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.183+0000 7f499f7fe640 0 client.19014 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:51:29.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.183+0000 7f49c8761740 1 --2- 172.21.15.79:0/3585552153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a03b06880 0x564a03b100b0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:29.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.183+0000 7f49c8761740 1 -- 172.21.15.79:0/3585552153 >> 172.21.15.79:0/3585552153 conn(0x564a03b046b0 msgr2=0x564a03b0a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:29.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.183+0000 7f49c8761740 1 -- 172.21.15.79:0/3585552153 shutdown_connections 2024-08-20T01:51:29.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.183+0000 7f49c8761740 1 -- 172.21.15.79:0/3585552153 wait complete. 2024-08-20T01:51:29.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.183+0000 7f49c8761740 20 client.19014 trim_cache size 0 max 16384 2024-08-20T01:51:29.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.196+0000 7f49c8761740 1 Processor -- start 2024-08-20T01:51:29.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.196+0000 7f49c8761740 1 -- start start 2024-08-20T01:51:29.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.196+0000 7f49c8761740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a03b06880 0x564a03b11df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:29.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.196+0000 7f49c8761740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a03b071a0 0x564a03b105d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:29.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.196+0000 7f49c8761740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a03b13130 0x564a03b10b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:29.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.196+0000 7f49c8761740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f49ac00e430 con 0x564a03b13130 2024-08-20T01:51:29.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.196+0000 7f49c8761740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f49ac0101b0 con 0x564a03b071a0 2024-08-20T01:51:29.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.196+0000 7f49c8761740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f49ac00ebc0 con 0x564a03b06880 2024-08-20T01:51:29.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.196+0000 7f49c4905640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a03b13130 0x564a03b10b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:29.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.196+0000 7f49bffff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a03b06880 0x564a03b11df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:29.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.196+0000 7f49c4905640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a03b13130 0x564a03b10b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44222/0 (socket says 172.21.15.79:44222) 2024-08-20T01:51:29.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.196+0000 7f49bffff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a03b06880 0x564a03b11df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:42550/0 (socket says 172.21.15.79:42550) 2024-08-20T01:51:29.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.196+0000 7f49c4905640 1 -- 172.21.15.79:0/3752504784 learned_addr learned my addr 172.21.15.79:0/3752504784 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:29.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.196+0000 7f49bf7fe640 1 --2- 172.21.15.79:0/3752504784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a03b071a0 0x564a03b105d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:29.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.197+0000 7f49bffff640 1 -- 172.21.15.79:0/3752504784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a03b071a0 msgr2=0x564a03b105d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:29.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.197+0000 7f49bffff640 1 --2- 172.21.15.79:0/3752504784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a03b071a0 0x564a03b105d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:29.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.197+0000 7f49bffff640 1 -- 172.21.15.79:0/3752504784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a03b13130 msgr2=0x564a03b10b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:29.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.197+0000 7f49bffff640 1 --2- 172.21.15.79:0/3752504784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a03b13130 0x564a03b10b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:29.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.197+0000 7f49bffff640 1 -- 172.21.15.79:0/3752504784 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a03aff860 con 0x564a03b06880 2024-08-20T01:51:29.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.197+0000 7f49c4905640 1 --2- 172.21.15.79:0/3752504784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a03b13130 0x564a03b10b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:51:29.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.197+0000 7f49bffff640 1 --2- 172.21.15.79:0/3752504784 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a03b06880 0x564a03b11df0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f49b002aa00 tx=0x7f49b0005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=107401409e2cb0ac server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:29.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.197+0000 7f49a5ffb640 1 -- 172.21.15.79:0/3752504784 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b0053070 con 0x564a03b06880 2024-08-20T01:51:29.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.197+0000 7f49a5ffb640 1 -- 172.21.15.79:0/3752504784 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f49b0005850 con 0x564a03b06880 2024-08-20T01:51:29.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.197+0000 7f49a5ffb640 1 -- 172.21.15.79:0/3752504784 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b0003cc0 con 0x564a03b06880 2024-08-20T01:51:29.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.198+0000 7f49c8761740 1 -- 172.21.15.79:0/3752504784 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a03b06880 msgr2=0x564a03b11df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:29.219 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:51:29.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.198+0000 7f49c8761740 1 --2- 172.21.15.79:0/3752504784 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a03b06880 0x564a03b11df0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f49b002aa00 tx=0x7f49b0005fd0 comp rx=0 tx=0).stop 2024-08-20T01:51:29.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.198+0000 7f49c8761740 1 -- 172.21.15.79:0/3752504784 shutdown_connections 2024-08-20T01:51:29.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.198+0000 7f49c8761740 1 --2- 172.21.15.79:0/3752504784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a03b13130 0x564a03b10b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:29.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.198+0000 7f49c8761740 1 --2- 172.21.15.79:0/3752504784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a03b071a0 0x564a03b105d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:29.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.198+0000 7f49c8761740 1 --2- 172.21.15.79:0/3752504784 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a03b06880 0x564a03b11df0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:29.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.198+0000 7f49c8761740 1 -- 172.21.15.79:0/3752504784 >> 172.21.15.79:0/3752504784 conn(0x564a03b046b0 msgr2=0x564a03b116e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:29.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.198+0000 7f49c8761740 1 -- 172.21.15.79:0/3752504784 shutdown_connections 2024-08-20T01:51:29.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.198+0000 7f49c8761740 1 -- 172.21.15.79:0/3752504784 wait complete. 2024-08-20T01:51:29.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.198+0000 7f49c8761740 1 -- start start 2024-08-20T01:51:29.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.198+0000 7f49c8761740 1 Processor -- start 2024-08-20T01:51:29.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.199+0000 7f49c8761740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a03b06880 0x564a03b1b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:29.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.199+0000 7f49c8761740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a03b071a0 0x564a03b1b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:29.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.199+0000 7f49c8761740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a03b13130 0x564a03b0c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:29.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.199+0000 7f49c8761740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f49ac00fa20 con 0x564a03b071a0 2024-08-20T01:51:29.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.199+0000 7f49c8761740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f49ac00f320 con 0x564a03b13130 2024-08-20T01:51:29.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.199+0000 7f49c8761740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f49ac00c410 con 0x564a03b06880 2024-08-20T01:51:29.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.199+0000 7f49c8761740 10 client.0 _ll_register_callbacks cb 0x7f49b400aa10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:51:29.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.199+0000 7f49bf7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a03b071a0 0x564a03b1b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:29.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.199+0000 7f49bf7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a03b071a0 0x564a03b1b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44232/0 (socket says 172.21.15.79:44232) 2024-08-20T01:51:29.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.199+0000 7f49bf7fe640 1 -- 172.21.15.79:0/2856802400 learned_addr learned my addr 172.21.15.79:0/2856802400 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:29.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.199+0000 7f49bffff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a03b06880 0x564a03b1b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:29.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.199+0000 7f49c4905640 1 --2- 172.21.15.79:0/2856802400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a03b13130 0x564a03b0c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:29.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.199+0000 7f49bffff640 1 -- 172.21.15.79:0/2856802400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a03b13130 msgr2=0x564a03b0c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:29.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.199+0000 7f49bffff640 1 --2- 172.21.15.79:0/2856802400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a03b13130 0x564a03b0c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:29.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.199+0000 7f49bffff640 1 -- 172.21.15.79:0/2856802400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a03b071a0 msgr2=0x564a03b1b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:29.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.199+0000 7f49bffff640 1 --2- 172.21.15.79:0/2856802400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a03b071a0 0x564a03b1b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:29.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.199+0000 7f49bffff640 1 -- 172.21.15.79:0/2856802400 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a03b06fd0 con 0x564a03b06880 2024-08-20T01:51:29.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.199+0000 7f49bf7fe640 1 --2- 172.21.15.79:0/2856802400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a03b071a0 0x564a03b1b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:51:29.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.199+0000 7f49c4905640 1 --2- 172.21.15.79:0/2856802400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a03b13130 0x564a03b0c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:51:29.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.199+0000 7f49bffff640 1 --2- 172.21.15.79:0/2856802400 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a03b06880 0x564a03b1b0a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f49b002aa00 tx=0x7f49b0000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ad2969ae3f22d27 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:29.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.199+0000 7f499f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:51:29.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.199+0000 7f499f7fe640 1 -- 172.21.15.79:0/2856802400 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b005d070 con 0x564a03b06880 2024-08-20T01:51:29.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.199+0000 7f499f7fe640 1 -- 172.21.15.79:0/2856802400 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f49b0004e20 con 0x564a03b06880 2024-08-20T01:51:29.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.199+0000 7f49c8761740 1 -- 172.21.15.79:0/2856802400 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49b0005850 con 0x564a03b06880 2024-08-20T01:51:29.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.200+0000 7f499f7fe640 1 -- 172.21.15.79:0/2856802400 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f49b0053070 con 0x564a03b06880 2024-08-20T01:51:29.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.200+0000 7f49c8761740 10 client.28060 fetch_fsmap learned FSMap version 60 2024-08-20T01:51:29.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.200+0000 7f49c8761740 1 -- 172.21.15.79:0/2856802400 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x564a03b8ce90 con 0x564a03b06880 2024-08-20T01:51:29.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.200+0000 7f499f7fe640 1 -- 172.21.15.79:0/2856802400 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f49b0005850 con 0x564a03b06880 2024-08-20T01:51:29.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.200+0000 7f499f7fe640 1 -- 172.21.15.79:0/2856802400 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 60) ==== 8418+0+0 (secure 0 0 0) 0x7f49b003c5d0 con 0x564a03b06880 2024-08-20T01:51:29.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.200+0000 7f49c8761740 10 client.28060 fetch_fsmap finished waiting for FSMap version 60 2024-08-20T01:51:29.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.200+0000 7f49c8761740 10 client.28060 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:51:29.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.200+0000 7f49c8761740 20 client.28060 populate_metadata read hostname 'smithi079' 2024-08-20T01:51:29.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.200+0000 7f49c8761740 1 --2- 172.21.15.79:0/2856802400 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x564a03b8d570 0x564a03b8f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:29.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.200+0000 7f49c8761740 4 client.28060 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:51:29.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.200+0000 7f49c8761740 1 -- 172.21.15.79:0/2856802400 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564a03a7b320 con 0x564a03b8d570 2024-08-20T01:51:29.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.200+0000 7f49bf7fe640 1 --2- 172.21.15.79:0/2856802400 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x564a03b8d570 0x564a03b8f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:29.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.201+0000 7f49bf7fe640 1 --2- 172.21.15.79:0/2856802400 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x564a03b8d570 0x564a03b8f990 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=be711339e9890d4d server_cookie=fc4ca059a4383cf3 in_seq=0 out_seq=0 2024-08-20T01:51:29.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.201+0000 7f499f7fe640 10 client.28060 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:51:29.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.201+0000 7f499f7fe640 1 -- 172.21.15.79:0/2856802400 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564a03a7b320 con 0x564a03b8d570 2024-08-20T01:51:29.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.201+0000 7f499f7fe640 10 client.28060 handle_command_reply: tid=0 2024-08-20T01:51:29.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.201+0000 7f49c8761740 1 client.28060 shutdown 2024-08-20T01:51:29.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.201+0000 7f49c8761740 1 -- 172.21.15.79:0/2856802400 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a03b06880 msgr2=0x564a03b1b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:29.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.201+0000 7f49c8761740 1 --2- 172.21.15.79:0/2856802400 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a03b06880 0x564a03b1b0a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f49b002aa00 tx=0x7f49b0000bc0 comp rx=0 tx=0).stop 2024-08-20T01:51:29.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.201+0000 7f49c8761740 1 -- 172.21.15.79:0/2856802400 shutdown_connections 2024-08-20T01:51:29.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.201+0000 7f49c8761740 1 --2- 172.21.15.79:0/2856802400 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x564a03b8d570 0x564a03b8f990 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:29.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.201+0000 7f49c8761740 1 --2- 172.21.15.79:0/2856802400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a03b13130 0x564a03b0c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:29.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.201+0000 7f49c8761740 1 --2- 172.21.15.79:0/2856802400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a03b071a0 0x564a03b1b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:29.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.201+0000 7f499f7fe640 0 client.28060 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:51:29.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.201+0000 7f49c8761740 1 --2- 172.21.15.79:0/2856802400 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a03b06880 0x564a03b1b0a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:29.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.201+0000 7f49c8761740 1 -- 172.21.15.79:0/2856802400 >> 172.21.15.79:0/2856802400 conn(0x564a03b046b0 msgr2=0x564a03b03770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:29.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.201+0000 7f49c8761740 1 -- 172.21.15.79:0/2856802400 shutdown_connections 2024-08-20T01:51:29.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.201+0000 7f49c8761740 1 -- 172.21.15.79:0/2856802400 wait complete. 2024-08-20T01:51:29.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.201+0000 7f49c8761740 20 client.28060 trim_cache size 0 max 16384 2024-08-20T01:51:29.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.202+0000 7f49c6368640 1 -- 172.21.15.79:0/4170049227 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f49a80b3bd0 msgr2=0x7f49a80b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:29.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.202+0000 7f49c6368640 1 --2- 172.21.15.79:0/4170049227 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f49a80b3bd0 0x7f49a80b6090 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x564a03b06830 tx=0x7f49b400a6c0 comp rx=0 tx=0).stop 2024-08-20T01:51:29.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.202+0000 7f49c6368640 1 -- 172.21.15.79:0/4170049227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49c0107d60 msgr2=0x7f49c019e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:29.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.202+0000 7f49c6368640 1 --2- 172.21.15.79:0/4170049227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49c0107d60 0x7f49c019e730 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f49b800eaa0 tx=0x7f49b800eea0 comp rx=0 tx=0).stop 2024-08-20T01:51:29.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.202+0000 7f49c6368640 1 -- 172.21.15.79:0/4170049227 shutdown_connections 2024-08-20T01:51:29.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.202+0000 7f49c6368640 1 --2- 172.21.15.79:0/4170049227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49c0107d60 0x7f49c019e730 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:29.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.202+0000 7f49c6368640 1 --2- 172.21.15.79:0/4170049227 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f49a80b3bd0 0x7f49a80b6090 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:29.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.202+0000 7f49c6368640 1 --2- 172.21.15.79:0/4170049227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49c01073e0 0x7f49c0199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:29.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.202+0000 7f49c6368640 1 --2- 172.21.15.79:0/4170049227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49c01019d0 0x7f49c0198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:29.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.202+0000 7f49c6368640 1 -- 172.21.15.79:0/4170049227 >> 172.21.15.79:0/4170049227 conn(0x7f49c00fd440 msgr2=0x7f49c00ff1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:29.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.202+0000 7f49c6368640 1 -- 172.21.15.79:0/4170049227 shutdown_connections 2024-08-20T01:51:29.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:29.202+0000 7f49c6368640 1 -- 172.21.15.79:0/4170049227 wait complete. 2024-08-20T01:51:29.896 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T01:51:30.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:29 smithi175 ceph-mon[22392]: pgmap v772: 97 pgs: 97 active+clean; 11 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 23 op/s 2024-08-20T01:51:30.144 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:51:30.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:29 smithi079 ceph-mon[18656]: pgmap v772: 97 pgs: 97 active+clean; 11 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 23 op/s 2024-08-20T01:51:30.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:29 smithi081 ceph-mon[22209]: pgmap v772: 97 pgs: 97 active+clean; 11 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 23 op/s 2024-08-20T01:51:30.547 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:30.545+0000 7f7434ff9640 1 -- 172.21.15.79:0/2243914718 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562b13519d50 con 0x562b13629f20 2024-08-20T01:51:30.547 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:30.545+0000 7f7434ff9640 10 client.18924 handle_command_reply: tid=0 2024-08-20T01:51:30.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:30.545+0000 7f7456877740 1 client.18924 shutdown 2024-08-20T01:51:30.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:30.545+0000 7f7456877740 1 -- 172.21.15.79:0/2243914718 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b135a98d0 msgr2=0x562b135bab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:30.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:30.545+0000 7f7456877740 1 --2- 172.21.15.79:0/2243914718 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b135a98d0 0x562b135bab70 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f7444013880 tx=0x7f7444011500 comp rx=0 tx=0).stop 2024-08-20T01:51:30.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:30.545+0000 7f7456877740 1 -- 172.21.15.79:0/2243914718 shutdown_connections 2024-08-20T01:51:30.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:30.545+0000 7f7456877740 1 --2- 172.21.15.79:0/2243914718 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x562b13629f20 0x562b1362c340 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:30.545+0000 7f7456877740 1 --2- 172.21.15.79:0/2243914718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b135aec40 0x562b135b9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:30.545+0000 7f7456877740 1 --2- 172.21.15.79:0/2243914718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b135ac200 0x562b135b9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:30.545+0000 7f7456877740 1 --2- 172.21.15.79:0/2243914718 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b135a98d0 0x562b135bab70 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:30.545+0000 7f7434ff9640 0 client.18924 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:51:30.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:30.545+0000 7f7456877740 1 -- 172.21.15.79:0/2243914718 >> 172.21.15.79:0/2243914718 conn(0x562b135a4a20 msgr2=0x562b135a32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:30.549 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:30.545+0000 7f7456877740 1 -- 172.21.15.79:0/2243914718 shutdown_connections 2024-08-20T01:51:30.549 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:30.545+0000 7f7456877740 1 -- 172.21.15.79:0/2243914718 wait complete. 2024-08-20T01:51:30.549 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:30.545+0000 7f7456877740 20 client.18924 trim_cache size 0 max 16384 2024-08-20T01:51:30.549 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:51:30.549 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:51:30.549 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:51:30.549 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:51:30.550 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:30.546+0000 7f74539ac640 1 -- 172.21.15.79:0/379895209 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f74380b3bd0 msgr2=0x7f74380b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:30.550 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:30.546+0000 7f74539ac640 1 --2- 172.21.15.79:0/379895209 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f74380b3bd0 0x7f74380b6090 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f74480caff0 tx=0x7f7448009260 comp rx=0 tx=0).stop 2024-08-20T01:51:30.550 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:30.546+0000 7f74539ac640 1 -- 172.21.15.79:0/379895209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f744c101560 msgr2=0x7f744c1989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:30.550 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:30.546+0000 7f74539ac640 1 --2- 172.21.15.79:0/379895209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f744c101560 0x7f744c1989c0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f7448005ab0 tx=0x7f74480042f0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.551 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:30.546+0000 7f74539ac640 1 -- 172.21.15.79:0/379895209 shutdown_connections 2024-08-20T01:51:30.551 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:30.546+0000 7f74539ac640 1 --2- 172.21.15.79:0/379895209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f744c103070 0x7f744c199c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.551 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:30.546+0000 7f74539ac640 1 --2- 172.21.15.79:0/379895209 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f74380b3bd0 0x7f74380b6090 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.551 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:30.546+0000 7f74539ac640 1 --2- 172.21.15.79:0/379895209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f744c1026b0 0x7f744c199010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.551 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:30.546+0000 7f74539ac640 1 --2- 172.21.15.79:0/379895209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f744c101560 0x7f744c1989c0 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.551 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:30.546+0000 7f74539ac640 1 -- 172.21.15.79:0/379895209 >> 172.21.15.79:0/379895209 conn(0x7f744c0fce40 msgr2=0x7f744c105b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:30.551 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:30.546+0000 7f74539ac640 1 -- 172.21.15.79:0/379895209 shutdown_connections 2024-08-20T01:51:30.551 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:30.546+0000 7f74539ac640 1 -- 172.21.15.79:0/379895209 wait complete. 2024-08-20T01:51:30.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.670+0000 7f22e0241640 1 -- 172.21.15.79:0/2325494711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22d8107d20 msgr2=0x7f22d810e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:30.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.670+0000 7f22e0241640 1 --2- 172.21.15.79:0/2325494711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22d8107d20 0x7f22d810e520 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f22d0009ca0 tx=0x7f22d002a8c0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.670+0000 7f22e0241640 1 -- 172.21.15.79:0/2325494711 shutdown_connections 2024-08-20T01:51:30.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.670+0000 7f22e0241640 1 --2- 172.21.15.79:0/2325494711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22d8107d20 0x7f22d810e520 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.670+0000 7f22e0241640 1 --2- 172.21.15.79:0/2325494711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f22d81073a0 0x7f22d81077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.670+0000 7f22e0241640 1 --2- 172.21.15.79:0/2325494711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22d8101990 0x7f22d8101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.670+0000 7f22e0241640 1 -- 172.21.15.79:0/2325494711 >> 172.21.15.79:0/2325494711 conn(0x7f22d80fd400 msgr2=0x7f22d80ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:30.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.670+0000 7f22e0241640 1 -- 172.21.15.79:0/2325494711 shutdown_connections 2024-08-20T01:51:30.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.670+0000 7f22e0241640 1 -- 172.21.15.79:0/2325494711 wait complete. 2024-08-20T01:51:30.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.670+0000 7f22e0241640 1 Processor -- start 2024-08-20T01:51:30.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.670+0000 7f22e0241640 1 -- start start 2024-08-20T01:51:30.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.670+0000 7f22e0241640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22d8101990 0x7f22d810f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:30.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.671+0000 7f22e0241640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f22d81073a0 0x7f22d810f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:30.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.671+0000 7f22e0241640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22d8107d20 0x7f22d810fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:30.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.671+0000 7f22e0241640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f22d81129e0 con 0x7f22d8101990 2024-08-20T01:51:30.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.671+0000 7f22e0241640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f22d8112860 con 0x7f22d8107d20 2024-08-20T01:51:30.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.671+0000 7f22e0241640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f22d8112b60 con 0x7f22d81073a0 2024-08-20T01:51:30.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.671+0000 7f22ddfdd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22d8101990 0x7f22d810f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:30.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.671+0000 7f22ddfdd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22d8101990 0x7f22d810f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37976/0 (socket says 172.21.15.79:37976) 2024-08-20T01:51:30.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.671+0000 7f22ddfdd640 1 -- 172.21.15.79:0/1695494541 learned_addr learned my addr 172.21.15.79:0/1695494541 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:30.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.671+0000 7f22de7de640 1 --2- 172.21.15.79:0/1695494541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22d8107d20 0x7f22d810fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:30.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.671+0000 7f22dd7dc640 1 --2- 172.21.15.79:0/1695494541 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f22d81073a0 0x7f22d810f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:30.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.671+0000 7f22ddfdd640 1 -- 172.21.15.79:0/1695494541 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f22d81073a0 msgr2=0x7f22d810f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:30.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.671+0000 7f22ddfdd640 1 --2- 172.21.15.79:0/1695494541 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f22d81073a0 0x7f22d810f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.671+0000 7f22ddfdd640 1 -- 172.21.15.79:0/1695494541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22d8107d20 msgr2=0x7f22d810fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:30.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.671+0000 7f22ddfdd640 1 --2- 172.21.15.79:0/1695494541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22d8107d20 0x7f22d810fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.671+0000 7f22ddfdd640 1 -- 172.21.15.79:0/1695494541 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22d81a72b0 con 0x7f22d8101990 2024-08-20T01:51:30.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.671+0000 7f22ddfdd640 1 --2- 172.21.15.79:0/1695494541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22d8101990 0x7f22d810f030 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f22d400e9f0 tx=0x7f22d400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:30.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.671+0000 7f22ceffd640 1 -- 172.21.15.79:0/1695494541 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d400cd80 con 0x7f22d8101990 2024-08-20T01:51:30.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.671+0000 7f22ceffd640 1 -- 172.21.15.79:0/1695494541 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f22d40108c0 con 0x7f22d8101990 2024-08-20T01:51:30.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.671+0000 7f22e0241640 1 -- 172.21.15.79:0/1695494541 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22d81a75a0 con 0x7f22d8101990 2024-08-20T01:51:30.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.671+0000 7f22ceffd640 1 -- 172.21.15.79:0/1695494541 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d40187c0 con 0x7f22d8101990 2024-08-20T01:51:30.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.671+0000 7f22e0241640 1 -- 172.21.15.79:0/1695494541 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22d81a7ae0 con 0x7f22d8101990 2024-08-20T01:51:30.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.674+0000 7f22ceffd640 1 -- 172.21.15.79:0/1695494541 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f22d4010430 con 0x7f22d8101990 2024-08-20T01:51:30.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.674+0000 7f22e263a740 1 Processor -- start 2024-08-20T01:51:30.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.674+0000 7f22e263a740 1 -- start start 2024-08-20T01:51:30.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.674+0000 7f22e263a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56400173c880 0x56400173cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:30.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.674+0000 7f22e263a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56400173d1a0 0x564001748bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:30.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.675+0000 7f22e263a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564001749130 0x56400174b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:30.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.675+0000 7f22e263a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5640016b3930 con 0x56400173d1a0 2024-08-20T01:51:30.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.675+0000 7f22e263a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5640016a2e30 con 0x56400173c880 2024-08-20T01:51:30.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.675+0000 7f22e263a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5640016a6e70 con 0x564001749130 2024-08-20T01:51:30.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.675+0000 7f22ddfdd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56400173d1a0 0x564001748bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:30.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.675+0000 7f22dd7dc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564001749130 0x56400174b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:30.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.675+0000 7f22ddfdd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56400173d1a0 0x564001748bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37982/0 (socket says 172.21.15.79:37982) 2024-08-20T01:51:30.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.675+0000 7f22ddfdd640 1 -- 172.21.15.79:0/2957421098 learned_addr learned my addr 172.21.15.79:0/2957421098 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:30.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.675+0000 7f22de7de640 1 --2- 172.21.15.79:0/2957421098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56400173c880 0x56400173cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:30.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.675+0000 7f22dd7dc640 1 -- 172.21.15.79:0/2957421098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56400173c880 msgr2=0x56400173cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:30.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.675+0000 7f22dd7dc640 1 --2- 172.21.15.79:0/2957421098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56400173c880 0x56400173cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.675+0000 7f22dd7dc640 1 -- 172.21.15.79:0/2957421098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56400173d1a0 msgr2=0x564001748bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:30.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.675+0000 7f22dd7dc640 1 --2- 172.21.15.79:0/2957421098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56400173d1a0 0x564001748bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.675+0000 7f22dd7dc640 1 -- 172.21.15.79:0/2957421098 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564001402650 con 0x564001749130 2024-08-20T01:51:30.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.675+0000 7f22ddfdd640 1 --2- 172.21.15.79:0/2957421098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56400173d1a0 0x564001748bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:51:30.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.675+0000 7f22ceffd640 1 --2- 172.21.15.79:0/1695494541 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f22c40b3bd0 0x7f22c40b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:30.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.675+0000 7f22dd7dc640 1 --2- 172.21.15.79:0/2957421098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564001749130 0x56400174b520 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f22c8009c00 tx=0x7f22c8011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81c94cde8688647d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:30.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.675+0000 7f22de7de640 1 --2- 172.21.15.79:0/1695494541 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f22c40b3bd0 0x7f22c40b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:30.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.675+0000 7f22ceffd640 1 -- 172.21.15.79:0/1695494541 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f22d40e3fc0 con 0x7f22d8101990 2024-08-20T01:51:30.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.675+0000 7f22c3fff640 1 -- 172.21.15.79:0/2957421098 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c8004230 con 0x564001749130 2024-08-20T01:51:30.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.675+0000 7f22c3fff640 1 -- 172.21.15.79:0/2957421098 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f22c80043d0 con 0x564001749130 2024-08-20T01:51:30.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.675+0000 7f22c3fff640 1 -- 172.21.15.79:0/2957421098 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c8004b90 con 0x564001749130 2024-08-20T01:51:30.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.676+0000 7f22e263a740 1 -- 172.21.15.79:0/2957421098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564001749130 msgr2=0x56400174b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:30.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.676+0000 7f22de7de640 1 --2- 172.21.15.79:0/1695494541 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f22c40b3bd0 0x7f22c40b6090 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f22d81110f0 tx=0x7f22d0009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:30.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.676+0000 7f22e263a740 1 --2- 172.21.15.79:0/2957421098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564001749130 0x56400174b520 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f22c8009c00 tx=0x7f22c8011810 comp rx=0 tx=0).stop 2024-08-20T01:51:30.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.676+0000 7f22e263a740 1 -- 172.21.15.79:0/2957421098 shutdown_connections 2024-08-20T01:51:30.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.676+0000 7f22e263a740 1 --2- 172.21.15.79:0/2957421098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564001749130 0x56400174b520 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.676+0000 7f22e263a740 1 --2- 172.21.15.79:0/2957421098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56400173d1a0 0x564001748bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.676+0000 7f22e263a740 1 --2- 172.21.15.79:0/2957421098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56400173c880 0x56400173cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.676+0000 7f22e263a740 1 -- 172.21.15.79:0/2957421098 >> 172.21.15.79:0/2957421098 conn(0x56400173a6b0 msgr2=0x56400173b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:30.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.676+0000 7f22e263a740 1 -- 172.21.15.79:0/2957421098 shutdown_connections 2024-08-20T01:51:30.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.676+0000 7f22e263a740 1 -- 172.21.15.79:0/2957421098 wait complete. 2024-08-20T01:51:30.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.677+0000 7f22e263a740 1 -- start start 2024-08-20T01:51:30.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.677+0000 7f22e263a740 1 Processor -- start 2024-08-20T01:51:30.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.677+0000 7f22e263a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56400173c880 0x5640017460b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:30.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.677+0000 7f22e263a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56400173d1a0 0x5640017465f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:30.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.677+0000 7f22e263a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564001749130 0x564001746b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:30.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.677+0000 7f22e263a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564001505700 con 0x564001749130 2024-08-20T01:51:30.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.677+0000 7f22e263a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564001629810 con 0x56400173d1a0 2024-08-20T01:51:30.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.677+0000 7f22e263a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56400174bde0 con 0x56400173c880 2024-08-20T01:51:30.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.677+0000 7f22e263a740 10 client.0 _ll_register_callbacks cb 0x56400169c700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:51:30.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.677+0000 7f22ddfdd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56400173c880 0x5640017460b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:30.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.677+0000 7f22de7de640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564001749130 0x564001746b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:30.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.677+0000 7f22ddfdd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56400173c880 0x5640017460b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:44208/0 (socket says 172.21.15.79:44208) 2024-08-20T01:51:30.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.677+0000 7f22ddfdd640 1 -- 172.21.15.79:0/2382565021 learned_addr learned my addr 172.21.15.79:0/2382565021 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:30.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.677+0000 7f22dd7dc640 1 --2- 172.21.15.79:0/2382565021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56400173d1a0 0x5640017465f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:30.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.678+0000 7f22ddfdd640 1 -- 172.21.15.79:0/2382565021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56400173d1a0 msgr2=0x5640017465f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:30.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.678+0000 7f22ddfdd640 1 --2- 172.21.15.79:0/2382565021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56400173d1a0 0x5640017465f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.678+0000 7f22ddfdd640 1 -- 172.21.15.79:0/2382565021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564001749130 msgr2=0x564001746b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:30.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.678+0000 7f22ddfdd640 1 --2- 172.21.15.79:0/2382565021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564001749130 0x564001746b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.678+0000 7f22ddfdd640 1 -- 172.21.15.79:0/2382565021 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564001755190 con 0x56400173c880 2024-08-20T01:51:30.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.678+0000 7f22ddfdd640 1 --2- 172.21.15.79:0/2382565021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56400173c880 0x5640017460b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f22d4000c00 tx=0x7f22d40aadc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc201bde4f8ebe92 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:30.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.678+0000 7f22c17fa640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:51:30.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.678+0000 7f22c17fa640 1 -- 172.21.15.79:0/2382565021 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d40aaa80 con 0x56400173c880 2024-08-20T01:51:30.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.678+0000 7f22c17fa640 1 -- 172.21.15.79:0/2382565021 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f22d40e1b80 con 0x56400173c880 2024-08-20T01:51:30.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.678+0000 7f22e263a740 1 -- 172.21.15.79:0/2382565021 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564001652150 con 0x56400173c880 2024-08-20T01:51:30.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.678+0000 7f22c17fa640 1 -- 172.21.15.79:0/2382565021 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f22d40aaf70 con 0x56400173c880 2024-08-20T01:51:30.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.678+0000 7f22e263a740 10 client.28072 fetch_fsmap learned FSMap version 60 2024-08-20T01:51:30.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.678+0000 7f22e263a740 1 -- 172.21.15.79:0/2382565021 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x564001757b20 con 0x56400173c880 2024-08-20T01:51:30.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.678+0000 7f22c17fa640 1 -- 172.21.15.79:0/2382565021 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x564001652150 con 0x56400173c880 2024-08-20T01:51:30.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.678+0000 7f22c17fa640 1 -- 172.21.15.79:0/2382565021 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 60) ==== 8418+0+0 (secure 0 0 0) 0x7f22d40a68e0 con 0x56400173c880 2024-08-20T01:51:30.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.678+0000 7f22e263a740 10 client.28072 fetch_fsmap finished waiting for FSMap version 60 2024-08-20T01:51:30.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.678+0000 7f22e263a740 10 client.28072 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:51:30.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.678+0000 7f22e263a740 20 client.28072 populate_metadata read hostname 'smithi079' 2024-08-20T01:51:30.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.678+0000 7f22e263a740 1 --2- 172.21.15.79:0/2382565021 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5640017590a0 0x56400175b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:30.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.678+0000 7f22e263a740 4 client.28072 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:51:30.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.678+0000 7f22e263a740 1 -- 172.21.15.79:0/2382565021 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640016b5880 con 0x5640017590a0 2024-08-20T01:51:30.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.679+0000 7f22dd7dc640 1 --2- 172.21.15.79:0/2382565021 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5640017590a0 0x56400175b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:30.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.679+0000 7f22c17fa640 10 client.28072 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:51:30.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.679+0000 7f22dd7dc640 1 --2- 172.21.15.79:0/2382565021 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5640017590a0 0x56400175b4d0 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6d71bb46d5f2f02 server_cookie=5e8524c4f44ed77f in_seq=0 out_seq=0 2024-08-20T01:51:30.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.680+0000 7f22c17fa640 1 -- 172.21.15.79:0/2382565021 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5640016b5880 con 0x5640017590a0 2024-08-20T01:51:30.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.680+0000 7f22c17fa640 10 client.28072 handle_command_reply: tid=0 2024-08-20T01:51:30.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.680+0000 7f22e263a740 1 client.28072 shutdown 2024-08-20T01:51:30.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.680+0000 7f22e263a740 1 -- 172.21.15.79:0/2382565021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56400173c880 msgr2=0x5640017460b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:30.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.680+0000 7f22e263a740 1 --2- 172.21.15.79:0/2382565021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56400173c880 0x5640017460b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f22d4000c00 tx=0x7f22d40aadc0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.680+0000 7f22e263a740 1 -- 172.21.15.79:0/2382565021 shutdown_connections 2024-08-20T01:51:30.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.680+0000 7f22e263a740 1 --2- 172.21.15.79:0/2382565021 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5640017590a0 0x56400175b4d0 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.680+0000 7f22e263a740 1 --2- 172.21.15.79:0/2382565021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564001749130 0x564001746b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.680+0000 7f22e263a740 1 --2- 172.21.15.79:0/2382565021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56400173d1a0 0x5640017465f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.680+0000 7f22e263a740 1 --2- 172.21.15.79:0/2382565021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56400173c880 0x5640017460b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.680+0000 7f22c17fa640 0 client.28072 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:51:30.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.680+0000 7f22e263a740 1 -- 172.21.15.79:0/2382565021 >> 172.21.15.79:0/2382565021 conn(0x56400173a6b0 msgr2=0x564001740250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:30.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.680+0000 7f22e263a740 1 -- 172.21.15.79:0/2382565021 shutdown_connections 2024-08-20T01:51:30.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.680+0000 7f22e263a740 1 -- 172.21.15.79:0/2382565021 wait complete. 2024-08-20T01:51:30.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.680+0000 7f22e263a740 20 client.28072 trim_cache size 0 max 16384 2024-08-20T01:51:30.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.694+0000 7f22e263a740 1 Processor -- start 2024-08-20T01:51:30.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.694+0000 7f22e263a740 1 -- start start 2024-08-20T01:51:30.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.694+0000 7f22e263a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56400173c880 0x5640017481b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:30.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.694+0000 7f22e263a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56400173d1a0 0x564001740920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:30.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.694+0000 7f22e263a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564001749130 0x564001745940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:30.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.694+0000 7f22e263a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f22d81b01e0 con 0x564001749130 2024-08-20T01:51:30.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.694+0000 7f22e263a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f22d81b1f60 con 0x56400173d1a0 2024-08-20T01:51:30.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.694+0000 7f22e263a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f22d81b0970 con 0x56400173c880 2024-08-20T01:51:30.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.694+0000 7f22de7de640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564001749130 0x564001745940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:30.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.694+0000 7f22ddfdd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56400173c880 0x5640017481b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:30.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.694+0000 7f22dd7dc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56400173d1a0 0x564001740920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:30.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.694+0000 7f22de7de640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564001749130 0x564001745940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38010/0 (socket says 172.21.15.79:38010) 2024-08-20T01:51:30.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.694+0000 7f22de7de640 1 -- 172.21.15.79:0/3886277910 learned_addr learned my addr 172.21.15.79:0/3886277910 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:30.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.694+0000 7f22ddfdd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56400173c880 0x5640017481b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:44218/0 (socket says 172.21.15.79:44218) 2024-08-20T01:51:30.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.694+0000 7f22de7de640 1 -- 172.21.15.79:0/3886277910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56400173c880 msgr2=0x5640017481b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:30.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.694+0000 7f22de7de640 1 --2- 172.21.15.79:0/3886277910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56400173c880 0x5640017481b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.694+0000 7f22de7de640 1 -- 172.21.15.79:0/3886277910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56400173d1a0 msgr2=0x564001740920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:30.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.694+0000 7f22de7de640 1 --2- 172.21.15.79:0/3886277910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56400173d1a0 0x564001740920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.694+0000 7f22de7de640 1 -- 172.21.15.79:0/3886277910 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56400173b130 con 0x564001749130 2024-08-20T01:51:30.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.694+0000 7f22dd7dc640 1 --2- 172.21.15.79:0/3886277910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56400173d1a0 0x564001740920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:51:30.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.694+0000 7f22de7de640 1 --2- 172.21.15.79:0/3886277910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564001749130 0x564001745940 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f22d0009ca0 tx=0x7f22d0044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9e5d92c3a9547e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:30.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.695+0000 7f22c37fe640 1 -- 172.21.15.79:0/3886277910 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d0031b00 con 0x564001749130 2024-08-20T01:51:30.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.695+0000 7f22c37fe640 1 -- 172.21.15.79:0/3886277910 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f22d0036050 con 0x564001749130 2024-08-20T01:51:30.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.695+0000 7f22c37fe640 1 -- 172.21.15.79:0/3886277910 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d0030820 con 0x564001749130 2024-08-20T01:51:30.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.695+0000 7f22e263a740 1 -- 172.21.15.79:0/3886277910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564001749130 msgr2=0x564001745940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:30.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.695+0000 7f22e263a740 1 --2- 172.21.15.79:0/3886277910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564001749130 0x564001745940 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f22d0009ca0 tx=0x7f22d0044000 comp rx=0 tx=0).stop 2024-08-20T01:51:30.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.695+0000 7f22e263a740 1 -- 172.21.15.79:0/3886277910 shutdown_connections 2024-08-20T01:51:30.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.695+0000 7f22e263a740 1 --2- 172.21.15.79:0/3886277910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564001749130 0x564001745940 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.695+0000 7f22e263a740 1 --2- 172.21.15.79:0/3886277910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56400173d1a0 0x564001740920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.695+0000 7f22e263a740 1 --2- 172.21.15.79:0/3886277910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56400173c880 0x5640017481b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.695+0000 7f22e263a740 1 -- 172.21.15.79:0/3886277910 >> 172.21.15.79:0/3886277910 conn(0x56400173a6b0 msgr2=0x564001746840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:30.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.695+0000 7f22e263a740 1 -- 172.21.15.79:0/3886277910 shutdown_connections 2024-08-20T01:51:30.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.695+0000 7f22e263a740 1 -- 172.21.15.79:0/3886277910 wait complete. 2024-08-20T01:51:30.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.696+0000 7f22e263a740 1 -- start start 2024-08-20T01:51:30.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.696+0000 7f22e263a740 1 Processor -- start 2024-08-20T01:51:30.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.696+0000 7f22e263a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56400173c880 0x56400174c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:30.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.696+0000 7f22e263a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56400173d1a0 0x56400174cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:30.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.696+0000 7f22e263a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564001749130 0x5640017c1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:30.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.696+0000 7f22e263a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f22d81b17d0 con 0x564001749130 2024-08-20T01:51:30.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.696+0000 7f22e263a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f22d81b10d0 con 0x56400173c880 2024-08-20T01:51:30.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.696+0000 7f22e263a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f22d81ae1c0 con 0x56400173d1a0 2024-08-20T01:51:30.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.696+0000 7f22e263a740 10 client.0 _ll_register_callbacks cb 0x7f22d40e76f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:51:30.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.696+0000 7f22de7de640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564001749130 0x5640017c1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:30.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.696+0000 7f22de7de640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564001749130 0x5640017c1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38014/0 (socket says 172.21.15.79:38014) 2024-08-20T01:51:30.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.696+0000 7f22de7de640 1 -- 172.21.15.79:0/2852582200 learned_addr learned my addr 172.21.15.79:0/2852582200 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:30.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.696+0000 7f22ddfdd640 1 --2- 172.21.15.79:0/2852582200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56400173c880 0x56400174c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:30.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.696+0000 7f22dd7dc640 1 --2- 172.21.15.79:0/2852582200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56400173d1a0 0x56400174cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:30.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.697+0000 7f22de7de640 1 -- 172.21.15.79:0/2852582200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56400173d1a0 msgr2=0x56400174cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:30.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.697+0000 7f22de7de640 1 --2- 172.21.15.79:0/2852582200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56400173d1a0 0x56400174cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.697+0000 7f22de7de640 1 -- 172.21.15.79:0/2852582200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56400173c880 msgr2=0x56400174c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:30.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.697+0000 7f22de7de640 1 --2- 172.21.15.79:0/2852582200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56400173c880 0x56400174c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.697+0000 7f22de7de640 1 -- 172.21.15.79:0/2852582200 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640017c24e0 con 0x564001749130 2024-08-20T01:51:30.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.697+0000 7f22ddfdd640 1 --2- 172.21.15.79:0/2852582200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56400173c880 0x56400174c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:51:30.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.697+0000 7f22dd7dc640 1 --2- 172.21.15.79:0/2852582200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56400173d1a0 0x56400174cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:51:30.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.697+0000 7f22de7de640 1 --2- 172.21.15.79:0/2852582200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564001749130 0x5640017c1da0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f22d002ade0 tx=0x7f22d0031530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=900db5b4a7f442fb server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:30.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.697+0000 7f22c17fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:51:30.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.697+0000 7f22c17fa640 1 -- 172.21.15.79:0/2852582200 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d005b070 con 0x564001749130 2024-08-20T01:51:30.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.697+0000 7f22c17fa640 1 -- 172.21.15.79:0/2852582200 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f22d0004250 con 0x564001749130 2024-08-20T01:51:30.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.697+0000 7f22e263a740 1 -- 172.21.15.79:0/2852582200 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22d0036050 con 0x564001749130 2024-08-20T01:51:30.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.697+0000 7f22c17fa640 1 -- 172.21.15.79:0/2852582200 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f22d0067050 con 0x564001749130 2024-08-20T01:51:30.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.697+0000 7f22e263a740 10 client.19038 fetch_fsmap learned FSMap version 60 2024-08-20T01:51:30.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.697+0000 7f22e263a740 1 -- 172.21.15.79:0/2852582200 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x5640017c37e0 con 0x564001749130 2024-08-20T01:51:30.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.697+0000 7f22c17fa640 1 -- 172.21.15.79:0/2852582200 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f22d0036050 con 0x564001749130 2024-08-20T01:51:30.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.698+0000 7f22c17fa640 1 -- 172.21.15.79:0/2852582200 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 60) ==== 8418+0+0 (secure 0 0 0) 0x7f22d0030b30 con 0x564001749130 2024-08-20T01:51:30.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.698+0000 7f22e263a740 10 client.19038 fetch_fsmap finished waiting for FSMap version 60 2024-08-20T01:51:30.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.698+0000 7f22e263a740 10 client.19038 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:51:30.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.698+0000 7f22e263a740 20 client.19038 populate_metadata read hostname 'smithi079' 2024-08-20T01:51:30.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.698+0000 7f22e263a740 1 --2- 172.21.15.79:0/2852582200 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5640017c3fa0 0x5640017c63c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:30.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.698+0000 7f22e263a740 4 client.19038 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:51:30.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.698+0000 7f22e263a740 1 -- 172.21.15.79:0/2852582200 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5640016b1320 con 0x5640017c3fa0 2024-08-20T01:51:30.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.698+0000 7f22ddfdd640 1 --2- 172.21.15.79:0/2852582200 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5640017c3fa0 0x5640017c63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:30.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.698+0000 7f22ddfdd640 1 --2- 172.21.15.79:0/2852582200 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5640017c3fa0 0x5640017c63c0 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df6278a5763705f7 server_cookie=853e5e3dee434c24 in_seq=0 out_seq=0 2024-08-20T01:51:30.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.698+0000 7f22c17fa640 10 client.19038 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:51:30.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.698+0000 7f22c17fa640 1 -- 172.21.15.79:0/2852582200 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5640016b1320 con 0x5640017c3fa0 2024-08-20T01:51:30.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.698+0000 7f22c17fa640 10 client.19038 handle_command_reply: tid=0 2024-08-20T01:51:30.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.698+0000 7f22e263a740 1 client.19038 shutdown 2024-08-20T01:51:30.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.698+0000 7f22e263a740 1 -- 172.21.15.79:0/2852582200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564001749130 msgr2=0x5640017c1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:30.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.698+0000 7f22e263a740 1 --2- 172.21.15.79:0/2852582200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564001749130 0x5640017c1da0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f22d002ade0 tx=0x7f22d0031530 comp rx=0 tx=0).stop 2024-08-20T01:51:30.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.699+0000 7f22e263a740 1 -- 172.21.15.79:0/2852582200 shutdown_connections 2024-08-20T01:51:30.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.699+0000 7f22e263a740 1 --2- 172.21.15.79:0/2852582200 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5640017c3fa0 0x5640017c63c0 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.699+0000 7f22e263a740 1 --2- 172.21.15.79:0/2852582200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564001749130 0x5640017c1da0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.699+0000 7f22e263a740 1 --2- 172.21.15.79:0/2852582200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56400173d1a0 0x56400174cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.699+0000 7f22e263a740 1 --2- 172.21.15.79:0/2852582200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56400173c880 0x56400174c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.699+0000 7f22c17fa640 0 client.19038 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:51:30.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.699+0000 7f22e263a740 1 -- 172.21.15.79:0/2852582200 >> 172.21.15.79:0/2852582200 conn(0x56400173a6b0 msgr2=0x564001753ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:30.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.699+0000 7f22e263a740 1 -- 172.21.15.79:0/2852582200 shutdown_connections 2024-08-20T01:51:30.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.699+0000 7f22e263a740 1 -- 172.21.15.79:0/2852582200 wait complete. 2024-08-20T01:51:30.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.699+0000 7f22e263a740 20 client.19038 trim_cache size 0 max 16384 2024-08-20T01:51:30.718 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:51:30.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.699+0000 7f22e0241640 1 -- 172.21.15.79:0/1695494541 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f22c40b3bd0 msgr2=0x7f22c40b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:30.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.699+0000 7f22e0241640 1 --2- 172.21.15.79:0/1695494541 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f22c40b3bd0 0x7f22c40b6090 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f22d81110f0 tx=0x7f22d0009360 comp rx=0 tx=0).stop 2024-08-20T01:51:30.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.699+0000 7f22e0241640 1 -- 172.21.15.79:0/1695494541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22d8101990 msgr2=0x7f22d810f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:30.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.699+0000 7f22e0241640 1 --2- 172.21.15.79:0/1695494541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22d8101990 0x7f22d810f030 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f22d400e9f0 tx=0x7f22d400eeb0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.699+0000 7f22e0241640 1 -- 172.21.15.79:0/1695494541 shutdown_connections 2024-08-20T01:51:30.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.699+0000 7f22e0241640 1 --2- 172.21.15.79:0/1695494541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22d8107d20 0x7f22d810fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.719 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.699+0000 7f22e0241640 1 --2- 172.21.15.79:0/1695494541 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f22c40b3bd0 0x7f22c40b6090 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.699+0000 7f22e0241640 1 --2- 172.21.15.79:0/1695494541 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f22d81073a0 0x7f22d810f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.699+0000 7f22e0241640 1 --2- 172.21.15.79:0/1695494541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22d8101990 0x7f22d810f030 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:30.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.700+0000 7f22e0241640 1 -- 172.21.15.79:0/1695494541 >> 172.21.15.79:0/1695494541 conn(0x7f22d80fd400 msgr2=0x7f22d80ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:30.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.700+0000 7f22e0241640 1 -- 172.21.15.79:0/1695494541 shutdown_connections 2024-08-20T01:51:30.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:30.700+0000 7f22e0241640 1 -- 172.21.15.79:0/1695494541 wait complete. 2024-08-20T01:51:32.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:31 smithi175 ceph-mon[22392]: pgmap v773: 97 pgs: 97 active+clean; 11 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 23 op/s 2024-08-20T01:51:32.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:31 smithi079 ceph-mon[18656]: pgmap v773: 97 pgs: 97 active+clean; 11 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 23 op/s 2024-08-20T01:51:32.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:31 smithi081 ceph-mon[22209]: pgmap v773: 97 pgs: 97 active+clean; 11 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 23 op/s 2024-08-20T01:51:32.442 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T01:51:32.442 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T01:51:32.691 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:51:33.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.199+0000 7f12ff82e640 1 -- 172.21.15.79:0/1587252454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12f810a6c0 msgr2=0x7f12f810ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:33.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.199+0000 7f12ff82e640 1 --2- 172.21.15.79:0/1587252454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12f810a6c0 0x7f12f810ab00 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f12ec009900 tx=0x7f12ec02a410 comp rx=0 tx=0).stop 2024-08-20T01:51:33.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.199+0000 7f12ff82e640 1 -- 172.21.15.79:0/1587252454 shutdown_connections 2024-08-20T01:51:33.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.199+0000 7f12ff82e640 1 --2- 172.21.15.79:0/1587252454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12f810b040 0x7f12f8111840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:33.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.199+0000 7f12ff82e640 1 --2- 172.21.15.79:0/1587252454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12f810a6c0 0x7f12f810ab00 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:33.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.199+0000 7f12ff82e640 1 --2- 172.21.15.79:0/1587252454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12f8104cb0 0x7f12f8105090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:33.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.199+0000 7f12ff82e640 1 -- 172.21.15.79:0/1587252454 >> 172.21.15.79:0/1587252454 conn(0x7f12f8100720 msgr2=0x7f12f8102b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:33.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.199+0000 7f12ff82e640 1 -- 172.21.15.79:0/1587252454 shutdown_connections 2024-08-20T01:51:33.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.199+0000 7f12ff82e640 1 -- 172.21.15.79:0/1587252454 wait complete. 2024-08-20T01:51:33.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.200+0000 7f12ff82e640 1 Processor -- start 2024-08-20T01:51:33.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.200+0000 7f12ff82e640 1 -- start start 2024-08-20T01:51:33.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.200+0000 7f12ff82e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12f8104cb0 0x7f12f819b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:33.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.200+0000 7f12ff82e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12f810a6c0 0x7f12f819b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:33.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.200+0000 7f12ff82e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12f810b040 0x7f12f81a0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:33.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.200+0000 7f12ff82e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f12f8114bb0 con 0x7f12f8104cb0 2024-08-20T01:51:33.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.200+0000 7f12ff82e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f12f8114a30 con 0x7f12f810a6c0 2024-08-20T01:51:33.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.200+0000 7f12ff82e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f12f8114d30 con 0x7f12f810b040 2024-08-20T01:51:33.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.200+0000 7f12fd5ca640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12f8104cb0 0x7f12f819b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:33.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.200+0000 7f12fd5ca640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12f8104cb0 0x7f12f819b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38032/0 (socket says 172.21.15.79:38032) 2024-08-20T01:51:33.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.200+0000 7f12fd5ca640 1 -- 172.21.15.79:0/3479546069 learned_addr learned my addr 172.21.15.79:0/3479546069 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:33.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.200+0000 7f12fcdc9640 1 --2- 172.21.15.79:0/3479546069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12f810a6c0 0x7f12f819b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:33.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.200+0000 7f12fddcb640 1 --2- 172.21.15.79:0/3479546069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12f810b040 0x7f12f81a0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:33.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.200+0000 7f12fd5ca640 1 -- 172.21.15.79:0/3479546069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12f810b040 msgr2=0x7f12f81a0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:33.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.200+0000 7f12fd5ca640 1 --2- 172.21.15.79:0/3479546069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12f810b040 0x7f12f81a0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:33.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.200+0000 7f12fd5ca640 1 -- 172.21.15.79:0/3479546069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12f810a6c0 msgr2=0x7f12f819b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:33.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.200+0000 7f12fd5ca640 1 --2- 172.21.15.79:0/3479546069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12f810a6c0 0x7f12f819b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:33.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.200+0000 7f12fd5ca640 1 -- 172.21.15.79:0/3479546069 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12f81a1150 con 0x7f12f8104cb0 2024-08-20T01:51:33.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.201+0000 7f12fd5ca640 1 --2- 172.21.15.79:0/3479546069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12f8104cb0 0x7f12f819b0a0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f12f400e9f0 tx=0x7f12f400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:33.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.201+0000 7f12ea7fc640 1 -- 172.21.15.79:0/3479546069 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f400cd80 con 0x7f12f8104cb0 2024-08-20T01:51:33.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.201+0000 7f12ea7fc640 1 -- 172.21.15.79:0/3479546069 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f12f40108c0 con 0x7f12f8104cb0 2024-08-20T01:51:33.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.201+0000 7f12ea7fc640 1 -- 172.21.15.79:0/3479546069 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f40187c0 con 0x7f12f8104cb0 2024-08-20T01:51:33.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.201+0000 7f12ff82e640 1 -- 172.21.15.79:0/3479546069 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12f81a1440 con 0x7f12f8104cb0 2024-08-20T01:51:33.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.201+0000 7f12ff82e640 1 -- 172.21.15.79:0/3479546069 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12f81a7b00 con 0x7f12f8104cb0 2024-08-20T01:51:33.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.203+0000 7f1301c27740 1 Processor -- start 2024-08-20T01:51:33.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.204+0000 7f1301c27740 1 -- start start 2024-08-20T01:51:33.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.204+0000 7f12ea7fc640 1 -- 172.21.15.79:0/3479546069 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f12f4010430 con 0x7f12f8104cb0 2024-08-20T01:51:33.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.204+0000 7f1301c27740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ec325a3b0 0x563ec325a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:33.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.204+0000 7f1301c27740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ec325acd0 0x563ec3266720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:33.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.204+0000 7f1301c27740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ec3266c60 0x563ec3269050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:33.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.204+0000 7f1301c27740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563ec31d0940 con 0x563ec3266c60 2024-08-20T01:51:33.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.204+0000 7f1301c27740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563ec31bfe40 con 0x563ec325acd0 2024-08-20T01:51:33.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.204+0000 7f1301c27740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563ec31c3e80 con 0x563ec325a3b0 2024-08-20T01:51:33.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.204+0000 7f12fcdc9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ec3266c60 0x563ec3269050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:33.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.204+0000 7f12fcdc9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ec3266c60 0x563ec3269050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38038/0 (socket says 172.21.15.79:38038) 2024-08-20T01:51:33.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.204+0000 7f12fcdc9640 1 -- 172.21.15.79:0/3515087887 learned_addr learned my addr 172.21.15.79:0/3515087887 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:33.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.204+0000 7f12fddcb640 1 --2- 172.21.15.79:0/3515087887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ec325a3b0 0x563ec325a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:33.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.204+0000 7f12fd5ca640 1 --2- 172.21.15.79:0/3515087887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ec325acd0 0x563ec3266720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:33.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.204+0000 7f12fcdc9640 1 -- 172.21.15.79:0/3515087887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ec325a3b0 msgr2=0x563ec325a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:33.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.204+0000 7f12fcdc9640 1 --2- 172.21.15.79:0/3515087887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ec325a3b0 0x563ec325a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:33.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.204+0000 7f12fcdc9640 1 -- 172.21.15.79:0/3515087887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ec325acd0 msgr2=0x563ec3266720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:33.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.204+0000 7f12fcdc9640 1 --2- 172.21.15.79:0/3515087887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ec325acd0 0x563ec3266720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:33.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.204+0000 7f12fcdc9640 1 -- 172.21.15.79:0/3515087887 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ec315c520 con 0x563ec3266c60 2024-08-20T01:51:33.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.205+0000 7f12ea7fc640 1 --2- 172.21.15.79:0/3479546069 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f12e40b3bd0 0x7f12e40b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:33.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.205+0000 7f12fcdc9640 1 --2- 172.21.15.79:0/3515087887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ec3266c60 0x563ec3269050 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f12ec02a930 tx=0x7f12ec031a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5964e191f6984c7f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:33.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.205+0000 7f12fddcb640 1 --2- 172.21.15.79:0/3479546069 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f12e40b3bd0 0x7f12e40b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:33.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.205+0000 7f12e37fe640 1 -- 172.21.15.79:0/3515087887 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ec035070 con 0x563ec3266c60 2024-08-20T01:51:33.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.205+0000 7f12ea7fc640 1 -- 172.21.15.79:0/3479546069 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f12f40e4010 con 0x7f12f8104cb0 2024-08-20T01:51:33.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.205+0000 7f12e37fe640 1 -- 172.21.15.79:0/3515087887 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f12ec040070 con 0x563ec3266c60 2024-08-20T01:51:33.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.205+0000 7f12e37fe640 1 -- 172.21.15.79:0/3515087887 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ec003ab0 con 0x563ec3266c60 2024-08-20T01:51:33.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.206+0000 7f1301c27740 1 -- 172.21.15.79:0/3515087887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ec3266c60 msgr2=0x563ec3269050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:33.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.206+0000 7f1301c27740 1 --2- 172.21.15.79:0/3515087887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ec3266c60 0x563ec3269050 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f12ec02a930 tx=0x7f12ec031a70 comp rx=0 tx=0).stop 2024-08-20T01:51:33.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.206+0000 7f12fddcb640 1 --2- 172.21.15.79:0/3479546069 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f12e40b3bd0 0x7f12e40b6090 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f12f0005fd0 tx=0x7f12f0009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:33.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.206+0000 7f1301c27740 1 -- 172.21.15.79:0/3515087887 shutdown_connections 2024-08-20T01:51:33.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.206+0000 7f1301c27740 1 --2- 172.21.15.79:0/3515087887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ec3266c60 0x563ec3269050 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:33.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.206+0000 7f1301c27740 1 --2- 172.21.15.79:0/3515087887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ec325acd0 0x563ec3266720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:33.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.206+0000 7f1301c27740 1 --2- 172.21.15.79:0/3515087887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ec325a3b0 0x563ec325a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:33.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.206+0000 7f1301c27740 1 -- 172.21.15.79:0/3515087887 >> 172.21.15.79:0/3515087887 conn(0x563ec32581e0 msgr2=0x563ec3259380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:33.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.206+0000 7f1301c27740 1 -- 172.21.15.79:0/3515087887 shutdown_connections 2024-08-20T01:51:33.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.206+0000 7f1301c27740 1 -- 172.21.15.79:0/3515087887 wait complete. 2024-08-20T01:51:33.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.206+0000 7f1301c27740 1 -- start start 2024-08-20T01:51:33.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.206+0000 7f1301c27740 1 Processor -- start 2024-08-20T01:51:33.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.206+0000 7f1301c27740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ec325a3b0 0x563ec3263c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:33.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.206+0000 7f1301c27740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ec325acd0 0x563ec3264180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:33.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.207+0000 7f1301c27740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ec3266c60 0x563ec32646c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:33.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.207+0000 7f1301c27740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563ec3022890 con 0x563ec3266c60 2024-08-20T01:51:33.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.207+0000 7f1301c27740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563ec3146700 con 0x563ec325a3b0 2024-08-20T01:51:33.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.207+0000 7f1301c27740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563ec3269950 con 0x563ec325acd0 2024-08-20T01:51:33.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.207+0000 7f1301c27740 10 client.0 _ll_register_callbacks cb 0x563ec31bb6f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:51:33.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.207+0000 7f12fddcb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ec3266c60 0x563ec32646c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:33.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.207+0000 7f12fcdc9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ec325acd0 0x563ec3264180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:33.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.207+0000 7f12fd5ca640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ec325a3b0 0x563ec3263c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:33.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.207+0000 7f12fcdc9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ec325acd0 0x563ec3264180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:44248/0 (socket says 172.21.15.79:44248) 2024-08-20T01:51:33.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.207+0000 7f12fd5ca640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ec325a3b0 0x563ec3263c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:45780/0 (socket says 172.21.15.79:45780) 2024-08-20T01:51:33.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.207+0000 7f12fddcb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ec3266c60 0x563ec32646c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38048/0 (socket says 172.21.15.79:38048) 2024-08-20T01:51:33.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.207+0000 7f12fcdc9640 1 -- 172.21.15.79:0/4057204149 learned_addr learned my addr 172.21.15.79:0/4057204149 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:33.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.207+0000 7f12fcdc9640 1 -- 172.21.15.79:0/4057204149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ec325a3b0 msgr2=0x563ec3263c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:33.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.207+0000 7f12fcdc9640 1 --2- 172.21.15.79:0/4057204149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ec325a3b0 0x563ec3263c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:33.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.207+0000 7f12fcdc9640 1 -- 172.21.15.79:0/4057204149 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ec3266c60 msgr2=0x563ec32646c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:33.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.207+0000 7f12fcdc9640 1 --2- 172.21.15.79:0/4057204149 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ec3266c60 0x563ec32646c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:33.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.207+0000 7f12fcdc9640 1 -- 172.21.15.79:0/4057204149 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ec2f1f930 con 0x563ec325acd0 2024-08-20T01:51:33.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.207+0000 7f12fd5ca640 1 --2- 172.21.15.79:0/4057204149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ec325a3b0 0x563ec3263c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:51:33.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.207+0000 7f12fcdc9640 1 --2- 172.21.15.79:0/4057204149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ec325acd0 0x563ec3264180 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f12ec0316b0 tx=0x7f12ec0316e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbf31e77dce19861 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:33.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.207+0000 7f12e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:51:33.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.207+0000 7f12e0ff9640 1 -- 172.21.15.79:0/4057204149 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ec04c020 con 0x563ec325acd0 2024-08-20T01:51:33.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.207+0000 7f12e0ff9640 1 -- 172.21.15.79:0/4057204149 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f12ec045870 con 0x563ec325acd0 2024-08-20T01:51:33.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.207+0000 7f1301c27740 1 -- 172.21.15.79:0/4057204149 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12ec040070 con 0x563ec325acd0 2024-08-20T01:51:33.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.208+0000 7f12e0ff9640 1 -- 172.21.15.79:0/4057204149 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f12ec035070 con 0x563ec325acd0 2024-08-20T01:51:33.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.208+0000 7f1301c27740 10 client.28090 fetch_fsmap learned FSMap version 60 2024-08-20T01:51:33.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.208+0000 7f1301c27740 1 -- 172.21.15.79:0/4057204149 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x563ec3275530 con 0x563ec325acd0 2024-08-20T01:51:33.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.208+0000 7f12e0ff9640 1 -- 172.21.15.79:0/4057204149 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f12ec040070 con 0x563ec325acd0 2024-08-20T01:51:33.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.208+0000 7f12e0ff9640 1 -- 172.21.15.79:0/4057204149 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 60) ==== 8418+0+0 (secure 0 0 0) 0x7f12ec03c970 con 0x563ec325acd0 2024-08-20T01:51:33.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.208+0000 7f1301c27740 10 client.28090 fetch_fsmap finished waiting for FSMap version 60 2024-08-20T01:51:33.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.208+0000 7f1301c27740 10 client.28090 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:51:33.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.208+0000 7f1301c27740 20 client.28090 populate_metadata read hostname 'smithi079' 2024-08-20T01:51:33.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.208+0000 7f1301c27740 1 --2- 172.21.15.79:0/4057204149 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x563ec3276880 0x563ec3278c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:33.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.208+0000 7f1301c27740 4 client.28090 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:51:33.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.208+0000 7f1301c27740 1 -- 172.21.15.79:0/4057204149 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ec31d2890 con 0x563ec3276880 2024-08-20T01:51:33.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.208+0000 7f12fd5ca640 1 --2- 172.21.15.79:0/4057204149 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x563ec3276880 0x563ec3278c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:33.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.209+0000 7f12fd5ca640 1 --2- 172.21.15.79:0/4057204149 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x563ec3276880 0x563ec3278c70 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a564b1edd62aadfe server_cookie=2eb2614e475bff64 in_seq=0 out_seq=0 2024-08-20T01:51:33.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.209+0000 7f12e0ff9640 10 client.28090 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:51:33.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.209+0000 7f12e0ff9640 1 -- 172.21.15.79:0/4057204149 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563ec31d2890 con 0x563ec3276880 2024-08-20T01:51:33.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.209+0000 7f12e0ff9640 10 client.28090 handle_command_reply: tid=0 2024-08-20T01:51:33.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.209+0000 7f1301c27740 1 client.28090 shutdown 2024-08-20T01:51:33.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.209+0000 7f1301c27740 1 -- 172.21.15.79:0/4057204149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ec325acd0 msgr2=0x563ec3264180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:33.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.209+0000 7f1301c27740 1 --2- 172.21.15.79:0/4057204149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ec325acd0 0x563ec3264180 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f12ec0316b0 tx=0x7f12ec0316e0 comp rx=0 tx=0).stop 2024-08-20T01:51:33.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.209+0000 7f1301c27740 1 -- 172.21.15.79:0/4057204149 shutdown_connections 2024-08-20T01:51:33.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.209+0000 7f1301c27740 1 --2- 172.21.15.79:0/4057204149 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x563ec3276880 0x563ec3278c70 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:33.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.209+0000 7f1301c27740 1 --2- 172.21.15.79:0/4057204149 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ec3266c60 0x563ec32646c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:33.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.209+0000 7f1301c27740 1 --2- 172.21.15.79:0/4057204149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ec325acd0 0x563ec3264180 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:33.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.209+0000 7f1301c27740 1 --2- 172.21.15.79:0/4057204149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ec325a3b0 0x563ec3263c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:33.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.209+0000 7f12e0ff9640 0 client.28090 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:51:33.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.209+0000 7f1301c27740 1 -- 172.21.15.79:0/4057204149 >> 172.21.15.79:0/4057204149 conn(0x563ec32581e0 msgr2=0x563ec325dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:33.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.210+0000 7f1301c27740 1 -- 172.21.15.79:0/4057204149 shutdown_connections 2024-08-20T01:51:33.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.210+0000 7f1301c27740 1 -- 172.21.15.79:0/4057204149 wait complete. 2024-08-20T01:51:33.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.210+0000 7f1301c27740 20 client.28090 trim_cache size 0 max 16384 2024-08-20T01:51:33.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.227+0000 7f1301c27740 1 Processor -- start 2024-08-20T01:51:33.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.227+0000 7f1301c27740 1 -- start start 2024-08-20T01:51:33.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.227+0000 7f1301c27740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ec325a3b0 0x563ec3265980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:33.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.227+0000 7f1301c27740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ec325acd0 0x563ec327e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:33.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.227+0000 7f1301c27740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ec3266c60 0x563ec327e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:33.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.228+0000 7f1301c27740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f12f81b01b0 con 0x563ec3266c60 2024-08-20T01:51:33.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.228+0000 7f1301c27740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f12f81b1f30 con 0x563ec325a3b0 2024-08-20T01:51:33.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.228+0000 7f1301c27740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f12f81b0940 con 0x563ec325acd0 2024-08-20T01:51:33.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.228+0000 7f12fddcb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ec3266c60 0x563ec327e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:33.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.228+0000 7f12fd5ca640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ec325a3b0 0x563ec3265980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:33.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.228+0000 7f12fddcb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ec3266c60 0x563ec327e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38054/0 (socket says 172.21.15.79:38054) 2024-08-20T01:51:33.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.228+0000 7f12fddcb640 1 -- 172.21.15.79:0/367924132 learned_addr learned my addr 172.21.15.79:0/367924132 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:33.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.228+0000 7f12fcdc9640 1 --2- 172.21.15.79:0/367924132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ec325acd0 0x563ec327e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:33.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.228+0000 7f12fd5ca640 1 -- 172.21.15.79:0/367924132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ec325acd0 msgr2=0x563ec327e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:33.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.228+0000 7f12fd5ca640 1 --2- 172.21.15.79:0/367924132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ec325acd0 0x563ec327e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:33.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.228+0000 7f12fd5ca640 1 -- 172.21.15.79:0/367924132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ec3266c60 msgr2=0x563ec327e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:33.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.228+0000 7f12fd5ca640 1 --2- 172.21.15.79:0/367924132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ec3266c60 0x563ec327e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:33.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.228+0000 7f12fd5ca640 1 -- 172.21.15.79:0/367924132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ec3262ba0 con 0x563ec325a3b0 2024-08-20T01:51:33.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.228+0000 7f12fddcb640 1 --2- 172.21.15.79:0/367924132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ec3266c60 0x563ec327e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:51:33.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.228+0000 7f12fd5ca640 1 --2- 172.21.15.79:0/367924132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ec325a3b0 0x563ec3265980 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f12f40e1b70 tx=0x7f12f40e7af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30128e01e408c730 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:33.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.228+0000 7f12e2ffd640 1 -- 172.21.15.79:0/367924132 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f40aa6e0 con 0x563ec325a3b0 2024-08-20T01:51:33.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.228+0000 7f12e2ffd640 1 -- 172.21.15.79:0/367924132 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f12f40aaa80 con 0x563ec325a3b0 2024-08-20T01:51:33.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.228+0000 7f12e2ffd640 1 -- 172.21.15.79:0/367924132 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f4010720 con 0x563ec325a3b0 2024-08-20T01:51:33.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.229+0000 7f1301c27740 1 -- 172.21.15.79:0/367924132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ec325a3b0 msgr2=0x563ec3265980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:33.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.229+0000 7f1301c27740 1 --2- 172.21.15.79:0/367924132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ec325a3b0 0x563ec3265980 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f12f40e1b70 tx=0x7f12f40e7af0 comp rx=0 tx=0).stop 2024-08-20T01:51:33.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.229+0000 7f1301c27740 1 -- 172.21.15.79:0/367924132 shutdown_connections 2024-08-20T01:51:33.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.229+0000 7f1301c27740 1 --2- 172.21.15.79:0/367924132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ec3266c60 0x563ec327e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:33.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.229+0000 7f1301c27740 1 --2- 172.21.15.79:0/367924132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ec325acd0 0x563ec327e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:33.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.229+0000 7f1301c27740 1 --2- 172.21.15.79:0/367924132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ec325a3b0 0x563ec3265980 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:33.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.229+0000 7f1301c27740 1 -- 172.21.15.79:0/367924132 >> 172.21.15.79:0/367924132 conn(0x563ec32581e0 msgr2=0x563ec3265270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:33.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.229+0000 7f1301c27740 1 -- 172.21.15.79:0/367924132 shutdown_connections 2024-08-20T01:51:33.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.229+0000 7f1301c27740 1 -- 172.21.15.79:0/367924132 wait complete. 2024-08-20T01:51:33.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.229+0000 7f1301c27740 1 -- start start 2024-08-20T01:51:33.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.230+0000 7f1301c27740 1 Processor -- start 2024-08-20T01:51:33.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.230+0000 7f1301c27740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ec325a3b0 0x563ec326f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:33.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.230+0000 7f1301c27740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ec325acd0 0x563ec326a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:33.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.230+0000 7f1301c27740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ec3266c60 0x563ec326aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:33.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.230+0000 7f1301c27740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f12f81b17a0 con 0x563ec325acd0 2024-08-20T01:51:33.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.230+0000 7f1301c27740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f12f81b10a0 con 0x563ec3266c60 2024-08-20T01:51:33.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.230+0000 7f1301c27740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f12f81ae190 con 0x563ec325a3b0 2024-08-20T01:51:33.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.230+0000 7f1301c27740 10 client.0 _ll_register_callbacks cb 0x7f12f40e79c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:51:33.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.230+0000 7f12fcdc9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ec325acd0 0x563ec326a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:33.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.230+0000 7f12fcdc9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ec325acd0 0x563ec326a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38062/0 (socket says 172.21.15.79:38062) 2024-08-20T01:51:33.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.230+0000 7f12fcdc9640 1 -- 172.21.15.79:0/1031476656 learned_addr learned my addr 172.21.15.79:0/1031476656 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:33.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.230+0000 7f12fddcb640 1 --2- 172.21.15.79:0/1031476656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ec3266c60 0x563ec326aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:33.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.230+0000 7f12fd5ca640 1 --2- 172.21.15.79:0/1031476656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ec325a3b0 0x563ec326f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:33.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.230+0000 7f12fcdc9640 1 -- 172.21.15.79:0/1031476656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ec325a3b0 msgr2=0x563ec326f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:33.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.230+0000 7f12fcdc9640 1 --2- 172.21.15.79:0/1031476656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ec325a3b0 0x563ec326f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:33.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.230+0000 7f12fcdc9640 1 -- 172.21.15.79:0/1031476656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ec3266c60 msgr2=0x563ec326aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:33.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.230+0000 7f12fcdc9640 1 --2- 172.21.15.79:0/1031476656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ec3266c60 0x563ec326aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:33.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.230+0000 7f12fcdc9640 1 -- 172.21.15.79:0/1031476656 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ec326b0c0 con 0x563ec325acd0 2024-08-20T01:51:33.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.230+0000 7f12fddcb640 1 --2- 172.21.15.79:0/1031476656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ec3266c60 0x563ec326aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:51:33.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.231+0000 7f12fcdc9640 1 --2- 172.21.15.79:0/1031476656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ec325acd0 0x563ec326a540 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f12ec0057c0 tx=0x7f12ec0045b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=358fee622297c891 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:33.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.231+0000 7f12e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:51:33.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.231+0000 7f12e0ff9640 1 -- 172.21.15.79:0/1031476656 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ec04c070 con 0x563ec325acd0 2024-08-20T01:51:33.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.231+0000 7f12e0ff9640 1 -- 172.21.15.79:0/1031476656 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f12ec03c850 con 0x563ec325acd0 2024-08-20T01:51:33.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.231+0000 7f1301c27740 1 -- 172.21.15.79:0/1031476656 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12f40aaa80 con 0x563ec325acd0 2024-08-20T01:51:33.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.231+0000 7f12e0ff9640 1 -- 172.21.15.79:0/1031476656 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f12ec009520 con 0x563ec325acd0 2024-08-20T01:51:33.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.231+0000 7f1301c27740 10 client.19056 fetch_fsmap learned FSMap version 60 2024-08-20T01:51:33.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.231+0000 7f1301c27740 1 -- 172.21.15.79:0/1031476656 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x563ec32e10d0 con 0x563ec325acd0 2024-08-20T01:51:33.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.231+0000 7f12e0ff9640 1 -- 172.21.15.79:0/1031476656 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f12ec040040 con 0x563ec325acd0 2024-08-20T01:51:33.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.231+0000 7f12e0ff9640 1 -- 172.21.15.79:0/1031476656 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 60) ==== 8418+0+0 (secure 0 0 0) 0x7f12ec05a020 con 0x563ec325acd0 2024-08-20T01:51:33.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.231+0000 7f1301c27740 10 client.19056 fetch_fsmap finished waiting for FSMap version 60 2024-08-20T01:51:33.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.231+0000 7f1301c27740 10 client.19056 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:51:33.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.231+0000 7f1301c27740 20 client.19056 populate_metadata read hostname 'smithi079' 2024-08-20T01:51:33.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.231+0000 7f1301c27740 1 --2- 172.21.15.79:0/1031476656 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x563ec32e18b0 0x563ec32e3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:33.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.231+0000 7f1301c27740 4 client.19056 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T01:51:33.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.231+0000 7f1301c27740 1 -- 172.21.15.79:0/1031476656 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f12f40aaa80 con 0x563ec32e18b0 2024-08-20T01:51:33.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.232+0000 7f12fd5ca640 1 --2- 172.21.15.79:0/1031476656 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x563ec32e18b0 0x563ec32e3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:33.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.232+0000 7f12e0ff9640 10 client.19056 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:51:33.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.232+0000 7f12fd5ca640 1 --2- 172.21.15.79:0/1031476656 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x563ec32e18b0 0x563ec32e3cd0 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf9c4a795d4c855b server_cookie=d13da5c687a9e5ff in_seq=0 out_seq=0 2024-08-20T01:51:33.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.233+0000 7f12e0ff9640 1 -- 172.21.15.79:0/1031476656 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f12f40aaa80 con 0x563ec32e18b0 2024-08-20T01:51:33.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.233+0000 7f12e0ff9640 10 client.19056 handle_command_reply: tid=0 2024-08-20T01:51:33.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.233+0000 7f1301c27740 1 client.19056 shutdown 2024-08-20T01:51:33.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.233+0000 7f1301c27740 1 -- 172.21.15.79:0/1031476656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ec325acd0 msgr2=0x563ec326a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:33.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.233+0000 7f1301c27740 1 --2- 172.21.15.79:0/1031476656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ec325acd0 0x563ec326a540 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f12ec0057c0 tx=0x7f12ec0045b0 comp rx=0 tx=0).stop 2024-08-20T01:51:33.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.233+0000 7f1301c27740 1 -- 172.21.15.79:0/1031476656 shutdown_connections 2024-08-20T01:51:33.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.233+0000 7f1301c27740 1 --2- 172.21.15.79:0/1031476656 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x563ec32e18b0 0x563ec32e3cd0 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:33.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.233+0000 7f1301c27740 1 --2- 172.21.15.79:0/1031476656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ec3266c60 0x563ec326aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:33.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.233+0000 7f1301c27740 1 --2- 172.21.15.79:0/1031476656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ec325acd0 0x563ec326a540 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:33.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.233+0000 7f1301c27740 1 --2- 172.21.15.79:0/1031476656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ec325a3b0 0x563ec326f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:33.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.233+0000 7f1301c27740 1 -- 172.21.15.79:0/1031476656 >> 172.21.15.79:0/1031476656 conn(0x563ec32581e0 msgr2=0x563ec3265a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:33.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.233+0000 7f12e0ff9640 0 client.19056 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:51:33.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.233+0000 7f1301c27740 1 -- 172.21.15.79:0/1031476656 shutdown_connections 2024-08-20T01:51:33.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.233+0000 7f1301c27740 1 -- 172.21.15.79:0/1031476656 wait complete. 2024-08-20T01:51:33.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.233+0000 7f1301c27740 20 client.19056 trim_cache size 0 max 16384 2024-08-20T01:51:33.249 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:51:33.249 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-08-20T01:51:33.249 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "4f3234d5-0a92-4281-af23-1d494ce40f17", 2024-08-20T01:51:33.249 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-08-20T01:51:33.249 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:51:33.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.234+0000 7f12ff82e640 1 -- 172.21.15.79:0/3479546069 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f12e40b3bd0 msgr2=0x7f12e40b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:33.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.234+0000 7f12ff82e640 1 --2- 172.21.15.79:0/3479546069 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f12e40b3bd0 0x7f12e40b6090 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f12f0005fd0 tx=0x7f12f0009500 comp rx=0 tx=0).stop 2024-08-20T01:51:33.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.234+0000 7f12ff82e640 1 -- 172.21.15.79:0/3479546069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12f8104cb0 msgr2=0x7f12f819b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:33.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.234+0000 7f12ff82e640 1 --2- 172.21.15.79:0/3479546069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12f8104cb0 0x7f12f819b0a0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f12f400e9f0 tx=0x7f12f400eeb0 comp rx=0 tx=0).stop 2024-08-20T01:51:33.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.234+0000 7f12ff82e640 1 -- 172.21.15.79:0/3479546069 shutdown_connections 2024-08-20T01:51:33.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.234+0000 7f12ff82e640 1 --2- 172.21.15.79:0/3479546069 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f12e40b3bd0 0x7f12e40b6090 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:33.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.234+0000 7f12ff82e640 1 --2- 172.21.15.79:0/3479546069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12f810b040 0x7f12f81a0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:33.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.234+0000 7f12ff82e640 1 --2- 172.21.15.79:0/3479546069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12f810a6c0 0x7f12f819b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:33.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.234+0000 7f12ff82e640 1 --2- 172.21.15.79:0/3479546069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12f8104cb0 0x7f12f819b0a0 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:33.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.234+0000 7f12ff82e640 1 -- 172.21.15.79:0/3479546069 >> 172.21.15.79:0/3479546069 conn(0x7f12f8100720 msgr2=0x7f12f8102b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:33.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.234+0000 7f12ff82e640 1 -- 172.21.15.79:0/3479546069 shutdown_connections 2024-08-20T01:51:33.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:33.234+0000 7f12ff82e640 1 -- 172.21.15.79:0/3479546069 wait complete. 2024-08-20T01:51:33.957 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:51:34.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:33 smithi175 ceph-mon[22392]: pgmap v774: 97 pgs: 97 active+clean; 11 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.7 KiB/s wr, 20 op/s 2024-08-20T01:51:34.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:33 smithi175 ceph-mon[22392]: scrub queued for path: / 2024-08-20T01:51:34.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:33 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:51:34.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:33 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:51:34.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:33 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:51:34.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:33 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:51:34.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:33 smithi079 ceph-mon[18656]: pgmap v774: 97 pgs: 97 active+clean; 11 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.7 KiB/s wr, 20 op/s 2024-08-20T01:51:34.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:33 smithi079 ceph-mon[18656]: scrub queued for path: / 2024-08-20T01:51:34.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:33 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:51:34.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:33 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:51:34.188 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:33 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:51:34.188 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:33 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:51:34.212 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:51:34.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:33 smithi081 ceph-mon[22209]: pgmap v774: 97 pgs: 97 active+clean; 11 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.7 KiB/s wr, 20 op/s 2024-08-20T01:51:34.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:33 smithi081 ceph-mon[22209]: scrub queued for path: / 2024-08-20T01:51:34.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:33 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:51:34.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:33 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:51:34.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:33 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:51:34.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:33 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:51:34.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.714+0000 7f62dd057640 1 -- 172.21.15.79:0/775114632 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62d8104270 msgr2=0x7f62d810c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:34.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.714+0000 7f62dd057640 1 --2- 172.21.15.79:0/775114632 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62d8104270 0x7f62d810c850 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f62cc009900 tx=0x7f62cc02a410 comp rx=0 tx=0).stop 2024-08-20T01:51:34.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.714+0000 7f62dd057640 1 -- 172.21.15.79:0/775114632 shutdown_connections 2024-08-20T01:51:34.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.714+0000 7f62dd057640 1 --2- 172.21.15.79:0/775114632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62d810ce20 0x7f62d810f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:34.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.714+0000 7f62dd057640 1 --2- 172.21.15.79:0/775114632 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62d8104270 0x7f62d810c850 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:34.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.714+0000 7f62dd057640 1 --2- 172.21.15.79:0/775114632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62d8103870 0x7f62d8103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:34.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.714+0000 7f62dd057640 1 -- 172.21.15.79:0/775114632 >> 172.21.15.79:0/775114632 conn(0x7f62d80fd400 msgr2=0x7f62d80ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:34.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.714+0000 7f62dd057640 1 -- 172.21.15.79:0/775114632 shutdown_connections 2024-08-20T01:51:34.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.714+0000 7f62dd057640 1 -- 172.21.15.79:0/775114632 wait complete. 2024-08-20T01:51:34.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.715+0000 7f62dd057640 1 Processor -- start 2024-08-20T01:51:34.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.715+0000 7f62dd057640 1 -- start start 2024-08-20T01:51:34.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.715+0000 7f62dd057640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62d8103870 0x7f62d8198f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:34.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.715+0000 7f62dd057640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62d8104270 0x7f62d8199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:34.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.715+0000 7f62dd057640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62d810ce20 0x7f62d819e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:34.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.715+0000 7f62dd057640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f62d8112910 con 0x7f62d810ce20 2024-08-20T01:51:34.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.715+0000 7f62dd057640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f62d8112790 con 0x7f62d8103870 2024-08-20T01:51:34.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.715+0000 7f62dd057640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f62d8112a90 con 0x7f62d8104270 2024-08-20T01:51:34.720 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.715+0000 7f62d759e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62d810ce20 0x7f62d819e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:34.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.715+0000 7f62d659c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62d8104270 0x7f62d8199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:34.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.715+0000 7f62d759e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62d810ce20 0x7f62d819e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38094/0 (socket says 172.21.15.79:38094) 2024-08-20T01:51:34.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.715+0000 7f62d759e640 1 -- 172.21.15.79:0/2112326438 learned_addr learned my addr 172.21.15.79:0/2112326438 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:34.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.716+0000 7f62d6d9d640 1 --2- 172.21.15.79:0/2112326438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62d8103870 0x7f62d8198f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:34.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.716+0000 7f62d6d9d640 1 -- 172.21.15.79:0/2112326438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62d8104270 msgr2=0x7f62d8199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:34.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.716+0000 7f62d6d9d640 1 --2- 172.21.15.79:0/2112326438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62d8104270 0x7f62d8199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:34.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.716+0000 7f62d6d9d640 1 -- 172.21.15.79:0/2112326438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62d810ce20 msgr2=0x7f62d819e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:34.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.716+0000 7f62d6d9d640 1 --2- 172.21.15.79:0/2112326438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62d810ce20 0x7f62d819e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:34.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.716+0000 7f62d6d9d640 1 -- 172.21.15.79:0/2112326438 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62d819efb0 con 0x7f62d8103870 2024-08-20T01:51:34.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.716+0000 7f62d659c640 1 --2- 172.21.15.79:0/2112326438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62d8104270 0x7f62d8199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:51:34.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.716+0000 7f62d6d9d640 1 --2- 172.21.15.79:0/2112326438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62d8103870 0x7f62d8198f00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f62c800e9f0 tx=0x7f62c800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:34.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.716+0000 7f62bffff640 1 -- 172.21.15.79:0/2112326438 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c800ccc0 con 0x7f62d8103870 2024-08-20T01:51:34.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.716+0000 7f62bffff640 1 -- 172.21.15.79:0/2112326438 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f62c80108c0 con 0x7f62d8103870 2024-08-20T01:51:34.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.716+0000 7f62bffff640 1 -- 172.21.15.79:0/2112326438 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c80187e0 con 0x7f62d8103870 2024-08-20T01:51:34.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.716+0000 7f62dd057640 1 -- 172.21.15.79:0/2112326438 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62d819f2a0 con 0x7f62d8103870 2024-08-20T01:51:34.722 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.716+0000 7f62dd057640 1 -- 172.21.15.79:0/2112326438 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62d81a5b30 con 0x7f62d8103870 2024-08-20T01:51:34.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.719+0000 7f62df450740 1 Processor -- start 2024-08-20T01:51:34.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.719+0000 7f62df450740 1 -- start start 2024-08-20T01:51:34.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.719+0000 7f62bffff640 1 -- 172.21.15.79:0/2112326438 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f62c8010430 con 0x7f62d8103870 2024-08-20T01:51:34.724 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.719+0000 7f62df450740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de50761830 0x55de50761c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:34.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.720+0000 7f62df450740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de50762150 0x55de5076dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:34.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.720+0000 7f62df450740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de5076e0e0 0x55de507704d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:34.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.720+0000 7f62df450740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55de506d88e0 con 0x55de50761830 2024-08-20T01:51:34.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.720+0000 7f62df450740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55de506c7de0 con 0x55de50762150 2024-08-20T01:51:34.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.720+0000 7f62df450740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55de506cbe20 con 0x55de5076e0e0 2024-08-20T01:51:34.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.720+0000 7f62d759e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de50761830 0x55de50761c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:34.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.720+0000 7f62d6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de50762150 0x55de5076dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:34.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.720+0000 7f62d759e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de50761830 0x55de50761c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38110/0 (socket says 172.21.15.79:38110) 2024-08-20T01:51:34.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.720+0000 7f62d759e640 1 -- 172.21.15.79:0/4265047691 learned_addr learned my addr 172.21.15.79:0/4265047691 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:34.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.720+0000 7f62d659c640 1 --2- 172.21.15.79:0/4265047691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de5076e0e0 0x55de507704d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:34.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.720+0000 7f62d759e640 1 -- 172.21.15.79:0/4265047691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de5076e0e0 msgr2=0x55de507704d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:34.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.720+0000 7f62d759e640 1 --2- 172.21.15.79:0/4265047691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de5076e0e0 0x55de507704d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:34.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.720+0000 7f62d759e640 1 -- 172.21.15.79:0/4265047691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de50762150 msgr2=0x55de5076dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:34.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.720+0000 7f62d759e640 1 --2- 172.21.15.79:0/4265047691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de50762150 0x55de5076dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:34.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.720+0000 7f62d759e640 1 -- 172.21.15.79:0/4265047691 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de50427650 con 0x55de50761830 2024-08-20T01:51:34.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.720+0000 7f62d759e640 1 --2- 172.21.15.79:0/4265047691 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de50761830 0x55de50761c10 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f62d00114a0 tx=0x7f62d0011960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73f172231134a64a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:34.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.720+0000 7f62bd7fa640 1 -- 172.21.15.79:0/4265047691 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d0004b20 con 0x55de50761830 2024-08-20T01:51:34.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.720+0000 7f62bd7fa640 1 -- 172.21.15.79:0/4265047691 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f62d0004cc0 con 0x55de50761830 2024-08-20T01:51:34.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.720+0000 7f62bd7fa640 1 -- 172.21.15.79:0/4265047691 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d0005280 con 0x55de50761830 2024-08-20T01:51:34.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.721+0000 7f62bffff640 1 --2- 172.21.15.79:0/2112326438 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f62c00b3c50 0x7f62c00b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:34.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.721+0000 7f62d6d9d640 1 --2- 172.21.15.79:0/2112326438 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f62c00b3c50 0x7f62c00b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:34.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.721+0000 7f62bffff640 1 -- 172.21.15.79:0/2112326438 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f62c80e3e40 con 0x7f62d8103870 2024-08-20T01:51:34.726 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.721+0000 7f62df450740 1 -- 172.21.15.79:0/4265047691 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de50761830 msgr2=0x55de50761c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:34.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.721+0000 7f62df450740 1 --2- 172.21.15.79:0/4265047691 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de50761830 0x55de50761c10 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f62d00114a0 tx=0x7f62d0011960 comp rx=0 tx=0).stop 2024-08-20T01:51:34.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.721+0000 7f62d6d9d640 1 --2- 172.21.15.79:0/2112326438 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f62c00b3c50 0x7f62c00b6110 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f62c80e1cc0 tx=0x7f62c80e7920 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:34.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.721+0000 7f62df450740 1 -- 172.21.15.79:0/4265047691 shutdown_connections 2024-08-20T01:51:34.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.721+0000 7f62df450740 1 --2- 172.21.15.79:0/4265047691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de5076e0e0 0x55de507704d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:34.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.721+0000 7f62df450740 1 --2- 172.21.15.79:0/4265047691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de50762150 0x55de5076dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:34.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.721+0000 7f62df450740 1 --2- 172.21.15.79:0/4265047691 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de50761830 0x55de50761c10 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:34.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.721+0000 7f62df450740 1 -- 172.21.15.79:0/4265047691 >> 172.21.15.79:0/4265047691 conn(0x55de5075f660 msgr2=0x55de50760800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:34.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.721+0000 7f62df450740 1 -- 172.21.15.79:0/4265047691 shutdown_connections 2024-08-20T01:51:34.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.721+0000 7f62df450740 1 -- 172.21.15.79:0/4265047691 wait complete. 2024-08-20T01:51:34.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.722+0000 7f62df450740 1 -- start start 2024-08-20T01:51:34.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.722+0000 7f62df450740 1 Processor -- start 2024-08-20T01:51:34.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.722+0000 7f62df450740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de50761830 0x55de5076db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:34.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.722+0000 7f62df450740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de50762150 0x55de5076af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:34.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.722+0000 7f62df450740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de5076e0e0 0x55de5076b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:34.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.722+0000 7f62df450740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55de5052a700 con 0x55de5076e0e0 2024-08-20T01:51:34.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.722+0000 7f62df450740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55de5064e7c0 con 0x55de50762150 2024-08-20T01:51:34.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.722+0000 7f62df450740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55de50770d90 con 0x55de50761830 2024-08-20T01:51:34.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.722+0000 7f62df450740 10 client.0 _ll_register_callbacks cb 0x55de506c16b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:51:34.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.722+0000 7f62d759e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de5076e0e0 0x55de5076b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:34.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.722+0000 7f62d759e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de5076e0e0 0x55de5076b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38120/0 (socket says 172.21.15.79:38120) 2024-08-20T01:51:34.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.722+0000 7f62d759e640 1 -- 172.21.15.79:0/861479577 learned_addr learned my addr 172.21.15.79:0/861479577 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:34.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.722+0000 7f62d659c640 1 --2- 172.21.15.79:0/861479577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de50762150 0x55de5076af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:34.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.722+0000 7f62d759e640 1 --2- 172.21.15.79:0/861479577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de50761830 0x55de5076db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:34.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.722+0000 7f62d759e640 1 -- 172.21.15.79:0/861479577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de50761830 msgr2=0x55de5076db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:34.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.722+0000 7f62d759e640 1 --2- 172.21.15.79:0/861479577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de50761830 0x55de5076db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:34.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.722+0000 7f62d759e640 1 -- 172.21.15.79:0/861479577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de50762150 msgr2=0x55de5076af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:34.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.722+0000 7f62d759e640 1 --2- 172.21.15.79:0/861479577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de50762150 0x55de5076af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:34.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.722+0000 7f62d759e640 1 -- 172.21.15.79:0/861479577 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de5077a0f0 con 0x55de5076e0e0 2024-08-20T01:51:34.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.723+0000 7f62d759e640 1 --2- 172.21.15.79:0/861479577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de5076e0e0 0x55de5076b6a0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f62d000ff30 tx=0x7f62d000fe30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=101922c1840d6299 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:34.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.723+0000 7f62baff5640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:51:34.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.723+0000 7f62baff5640 1 -- 172.21.15.79:0/861479577 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d000fc60 con 0x55de5076e0e0 2024-08-20T01:51:34.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.723+0000 7f62baff5640 1 -- 172.21.15.79:0/861479577 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f62d0004a40 con 0x55de5076e0e0 2024-08-20T01:51:34.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.723+0000 7f62df450740 1 -- 172.21.15.79:0/861479577 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55de50677100 con 0x55de5076e0e0 2024-08-20T01:51:34.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.723+0000 7f62baff5640 1 -- 172.21.15.79:0/861479577 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f62d0004c40 con 0x55de5076e0e0 2024-08-20T01:51:34.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.723+0000 7f62df450740 10 client.19068 fetch_fsmap learned FSMap version 60 2024-08-20T01:51:34.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.723+0000 7f62df450740 1 -- 172.21.15.79:0/861479577 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x55de5077ca00 con 0x55de5076e0e0 2024-08-20T01:51:34.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.723+0000 7f62baff5640 1 -- 172.21.15.79:0/861479577 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55de50677100 con 0x55de5076e0e0 2024-08-20T01:51:34.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.723+0000 7f62baff5640 1 -- 172.21.15.79:0/861479577 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 60) ==== 8418+0+0 (secure 0 0 0) 0x7f62d0032480 con 0x55de5076e0e0 2024-08-20T01:51:34.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.723+0000 7f62df450740 10 client.19068 fetch_fsmap finished waiting for FSMap version 60 2024-08-20T01:51:34.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.723+0000 7f62df450740 10 client.19068 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:51:34.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.723+0000 7f62df450740 20 client.19068 populate_metadata read hostname 'smithi079' 2024-08-20T01:51:34.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.723+0000 7f62df450740 1 --2- 172.21.15.79:0/861479577 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55de5077de60 0x55de50780250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:34.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.723+0000 7f62df450740 4 client.19068 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:51:34.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.723+0000 7f62df450740 1 -- 172.21.15.79:0/861479577 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de506da830 con 0x55de5077de60 2024-08-20T01:51:34.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.724+0000 7f62d659c640 1 --2- 172.21.15.79:0/861479577 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55de5077de60 0x55de50780250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:34.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.724+0000 7f62d659c640 1 --2- 172.21.15.79:0/861479577 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55de5077de60 0x55de50780250 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3ddc9745c358e8 server_cookie=bb3940846a934109 in_seq=0 out_seq=0 2024-08-20T01:51:34.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.724+0000 7f62baff5640 10 client.19068 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:51:34.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.725+0000 7f62baff5640 1 -- 172.21.15.79:0/861479577 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55de506da830 con 0x55de5077de60 2024-08-20T01:51:34.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.725+0000 7f62baff5640 10 client.19068 handle_command_reply: tid=0 2024-08-20T01:51:34.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.725+0000 7f62df450740 1 client.19068 shutdown 2024-08-20T01:51:34.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.725+0000 7f62df450740 1 -- 172.21.15.79:0/861479577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de5076e0e0 msgr2=0x55de5076b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:34.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.725+0000 7f62df450740 1 --2- 172.21.15.79:0/861479577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de5076e0e0 0x55de5076b6a0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f62d000ff30 tx=0x7f62d000fe30 comp rx=0 tx=0).stop 2024-08-20T01:51:34.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.725+0000 7f62df450740 1 -- 172.21.15.79:0/861479577 shutdown_connections 2024-08-20T01:51:34.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.725+0000 7f62df450740 1 --2- 172.21.15.79:0/861479577 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55de5077de60 0x55de50780250 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:34.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.725+0000 7f62df450740 1 --2- 172.21.15.79:0/861479577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de5076e0e0 0x55de5076b6a0 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:34.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.725+0000 7f62df450740 1 --2- 172.21.15.79:0/861479577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de50762150 0x55de5076af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:34.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.725+0000 7f62df450740 1 --2- 172.21.15.79:0/861479577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de50761830 0x55de5076db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:34.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.725+0000 7f62df450740 1 -- 172.21.15.79:0/861479577 >> 172.21.15.79:0/861479577 conn(0x55de5075f660 msgr2=0x55de50765200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:34.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.725+0000 7f62baff5640 0 client.19068 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:51:34.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.725+0000 7f62df450740 1 -- 172.21.15.79:0/861479577 shutdown_connections 2024-08-20T01:51:34.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.725+0000 7f62df450740 1 -- 172.21.15.79:0/861479577 wait complete. 2024-08-20T01:51:34.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.725+0000 7f62df450740 20 client.19068 trim_cache size 0 max 16384 2024-08-20T01:51:34.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.742+0000 7f62df450740 1 Processor -- start 2024-08-20T01:51:34.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.742+0000 7f62df450740 1 -- start start 2024-08-20T01:51:34.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.742+0000 7f62df450740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de50761830 0x55de5076a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:34.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.742+0000 7f62df450740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de50762150 0x55de5075e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:34.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.742+0000 7f62df450740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de5076e0e0 0x55de50785ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:34.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.742+0000 7f62df450740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f62d81adfe0 con 0x55de50762150 2024-08-20T01:51:34.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.742+0000 7f62df450740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f62d81afd60 con 0x55de50761830 2024-08-20T01:51:34.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.742+0000 7f62df450740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f62d81ae770 con 0x55de5076e0e0 2024-08-20T01:51:34.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.743+0000 7f62d659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de50762150 0x55de5075e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:34.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.743+0000 7f62d759e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de50761830 0x55de5076a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:34.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.743+0000 7f62d659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de50762150 0x55de5075e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38136/0 (socket says 172.21.15.79:38136) 2024-08-20T01:51:34.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.743+0000 7f62d659c640 1 -- 172.21.15.79:0/1691084782 learned_addr learned my addr 172.21.15.79:0/1691084782 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:34.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.743+0000 7f62d759e640 1 --2- 172.21.15.79:0/1691084782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de5076e0e0 0x55de50785ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:34.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.743+0000 7f62d659c640 1 -- 172.21.15.79:0/1691084782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de5076e0e0 msgr2=0x55de50785ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:34.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.743+0000 7f62d659c640 1 --2- 172.21.15.79:0/1691084782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de5076e0e0 0x55de50785ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:34.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.743+0000 7f62d659c640 1 -- 172.21.15.79:0/1691084782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de50761830 msgr2=0x55de5076a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:34.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.743+0000 7f62d659c640 1 --2- 172.21.15.79:0/1691084782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de50761830 0x55de5076a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:34.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.743+0000 7f62d659c640 1 -- 172.21.15.79:0/1691084782 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de50761f80 con 0x55de50762150 2024-08-20T01:51:34.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.743+0000 7f62d659c640 1 --2- 172.21.15.79:0/1691084782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de50762150 0x55de5075e610 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f62cc0096c0 tx=0x7f62cc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ced8a4d4a6fbc796 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:34.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.743+0000 7f62bcff9640 1 -- 172.21.15.79:0/1691084782 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62cc035040 con 0x55de50762150 2024-08-20T01:51:34.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.743+0000 7f62bcff9640 1 -- 172.21.15.79:0/1691084782 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f62cc004300 con 0x55de50762150 2024-08-20T01:51:34.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.743+0000 7f62bcff9640 1 -- 172.21.15.79:0/1691084782 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62cc0323d0 con 0x55de50762150 2024-08-20T01:51:34.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.744+0000 7f62df450740 1 -- 172.21.15.79:0/1691084782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de50762150 msgr2=0x55de5075e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:34.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.744+0000 7f62df450740 1 --2- 172.21.15.79:0/1691084782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de50762150 0x55de5075e610 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f62cc0096c0 tx=0x7f62cc009260 comp rx=0 tx=0).stop 2024-08-20T01:51:34.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.744+0000 7f62df450740 1 -- 172.21.15.79:0/1691084782 shutdown_connections 2024-08-20T01:51:34.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.744+0000 7f62df450740 1 --2- 172.21.15.79:0/1691084782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de5076e0e0 0x55de50785ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:34.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.744+0000 7f62df450740 1 --2- 172.21.15.79:0/1691084782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de50762150 0x55de5075e610 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:34.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.744+0000 7f62df450740 1 --2- 172.21.15.79:0/1691084782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de50761830 0x55de5076a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:34.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.744+0000 7f62df450740 1 -- 172.21.15.79:0/1691084782 >> 172.21.15.79:0/1691084782 conn(0x55de5075f660 msgr2=0x55de5075df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:34.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.744+0000 7f62df450740 1 -- 172.21.15.79:0/1691084782 shutdown_connections 2024-08-20T01:51:34.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.744+0000 7f62df450740 1 -- 172.21.15.79:0/1691084782 wait complete. 2024-08-20T01:51:34.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.744+0000 7f62df450740 1 -- start start 2024-08-20T01:51:34.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.744+0000 7f62df450740 1 Processor -- start 2024-08-20T01:51:34.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.745+0000 7f62df450740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de50761830 0x55de50767310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:34.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.745+0000 7f62df450740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de50762150 0x55de50767850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:34.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.745+0000 7f62df450740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5076e0e0 0x55de50767d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:34.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.745+0000 7f62df450740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f62d81af5d0 con 0x55de50762150 2024-08-20T01:51:34.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.745+0000 7f62df450740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f62d81aeed0 con 0x55de5076e0e0 2024-08-20T01:51:34.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.745+0000 7f62df450740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f62d81abfc0 con 0x55de50761830 2024-08-20T01:51:34.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.745+0000 7f62df450740 10 client.0 _ll_register_callbacks cb 0x7f62d000f560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:51:34.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.745+0000 7f62d659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de50762150 0x55de50767850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:34.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.745+0000 7f62d659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de50762150 0x55de50767850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38144/0 (socket says 172.21.15.79:38144) 2024-08-20T01:51:34.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.745+0000 7f62d659c640 1 -- 172.21.15.79:0/2208892230 learned_addr learned my addr 172.21.15.79:0/2208892230 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:34.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.745+0000 7f62d759e640 1 --2- 172.21.15.79:0/2208892230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5076e0e0 0x55de50767d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:34.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.745+0000 7f62d759e640 1 --2- 172.21.15.79:0/2208892230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de50761830 0x55de50767310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:34.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.745+0000 7f62d659c640 1 -- 172.21.15.79:0/2208892230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de50761830 msgr2=0x55de50767310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:34.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.745+0000 7f62d659c640 1 --2- 172.21.15.79:0/2208892230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de50761830 0x55de50767310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:34.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.745+0000 7f62d659c640 1 -- 172.21.15.79:0/2208892230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5076e0e0 msgr2=0x55de50767d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:34.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.745+0000 7f62d659c640 1 --2- 172.21.15.79:0/2208892230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5076e0e0 0x55de50767d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:34.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.745+0000 7f62d659c640 1 -- 172.21.15.79:0/2208892230 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de50775200 con 0x55de50762150 2024-08-20T01:51:34.753 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.745+0000 7f62d759e640 1 --2- 172.21.15.79:0/2208892230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de50761830 0x55de50767310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:51:34.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.745+0000 7f62d659c640 1 --2- 172.21.15.79:0/2208892230 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de50762150 0x55de50767850 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f62cc009850 tx=0x7f62cc005bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea0578a87256dc64 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:34.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.745+0000 7f62baff5640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:51:34.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.745+0000 7f62baff5640 1 -- 172.21.15.79:0/2208892230 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62cc055070 con 0x55de50762150 2024-08-20T01:51:34.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.745+0000 7f62df450740 1 -- 172.21.15.79:0/2208892230 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62cc004300 con 0x55de50762150 2024-08-20T01:51:34.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.745+0000 7f62baff5640 1 -- 172.21.15.79:0/2208892230 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f62cc003800 con 0x55de50762150 2024-08-20T01:51:34.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.746+0000 7f62baff5640 1 -- 172.21.15.79:0/2208892230 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f62cc061050 con 0x55de50762150 2024-08-20T01:51:34.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.746+0000 7f62df450740 10 client.19074 fetch_fsmap learned FSMap version 60 2024-08-20T01:51:34.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.746+0000 7f62df450740 1 -- 172.21.15.79:0/2208892230 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x55de50776540 con 0x55de50762150 2024-08-20T01:51:34.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.746+0000 7f62baff5640 1 -- 172.21.15.79:0/2208892230 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f62cc004300 con 0x55de50762150 2024-08-20T01:51:34.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.746+0000 7f62baff5640 1 -- 172.21.15.79:0/2208892230 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 60) ==== 8418+0+0 (secure 0 0 0) 0x7f62cc0473d0 con 0x55de50762150 2024-08-20T01:51:34.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.746+0000 7f62df450740 10 client.19074 fetch_fsmap finished waiting for FSMap version 60 2024-08-20T01:51:34.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.746+0000 7f62df450740 10 client.19074 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:51:34.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.746+0000 7f62df450740 20 client.19074 populate_metadata read hostname 'smithi079' 2024-08-20T01:51:34.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.746+0000 7f62df450740 1 --2- 172.21.15.79:0/2208892230 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55de507e8a90 0x55de507eae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:34.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.746+0000 7f62df450740 4 client.19074 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:51:34.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.746+0000 7f62df450740 1 -- 172.21.15.79:0/2208892230 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55de506d62d0 con 0x55de507e8a90 2024-08-20T01:51:34.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.746+0000 7f62d759e640 1 --2- 172.21.15.79:0/2208892230 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55de507e8a90 0x55de507eae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:34.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.746+0000 7f62baff5640 10 client.19074 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:51:34.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.746+0000 7f62d759e640 1 --2- 172.21.15.79:0/2208892230 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55de507e8a90 0x55de507eae80 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c90b2fc3d6b037b8 server_cookie=9ee82c7ebde71a7 in_seq=0 out_seq=0 2024-08-20T01:51:34.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.747+0000 7f62baff5640 1 -- 172.21.15.79:0/2208892230 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55de506d62d0 con 0x55de507e8a90 2024-08-20T01:51:34.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.747+0000 7f62baff5640 10 client.19074 handle_command_reply: tid=0 2024-08-20T01:51:34.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.747+0000 7f62df450740 1 client.19074 shutdown 2024-08-20T01:51:34.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.747+0000 7f62df450740 1 -- 172.21.15.79:0/2208892230 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de50762150 msgr2=0x55de50767850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:34.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.747+0000 7f62df450740 1 --2- 172.21.15.79:0/2208892230 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de50762150 0x55de50767850 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f62cc009850 tx=0x7f62cc005bf0 comp rx=0 tx=0).stop 2024-08-20T01:51:34.755 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.747+0000 7f62df450740 1 -- 172.21.15.79:0/2208892230 shutdown_connections 2024-08-20T01:51:34.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.747+0000 7f62df450740 1 --2- 172.21.15.79:0/2208892230 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55de507e8a90 0x55de507eae80 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:34.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.747+0000 7f62df450740 1 --2- 172.21.15.79:0/2208892230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5076e0e0 0x55de50767d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:34.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.747+0000 7f62df450740 1 --2- 172.21.15.79:0/2208892230 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55de50762150 0x55de50767850 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:34.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.747+0000 7f62baff5640 0 client.19074 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:51:34.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.747+0000 7f62df450740 1 --2- 172.21.15.79:0/2208892230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de50761830 0x55de50767310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:34.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.747+0000 7f62df450740 1 -- 172.21.15.79:0/2208892230 >> 172.21.15.79:0/2208892230 conn(0x55de5075f660 msgr2=0x55de5076cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:34.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.747+0000 7f62df450740 1 -- 172.21.15.79:0/2208892230 shutdown_connections 2024-08-20T01:51:34.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.747+0000 7f62df450740 1 -- 172.21.15.79:0/2208892230 wait complete. 2024-08-20T01:51:34.756 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.747+0000 7f62df450740 20 client.19074 trim_cache size 0 max 16384 2024-08-20T01:51:34.756 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:51:34.756 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-20T01:51:34.757 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": { 2024-08-20T01:51:34.757 INFO:teuthology.orchestra.run.smithi079.stdout: "4f3234d5-0a92-4281-af23-1d494ce40f17": { 2024-08-20T01:51:34.757 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/", 2024-08-20T01:51:34.757 INFO:teuthology.orchestra.run.smithi079.stdout: "tag": "4f3234d5-0a92-4281-af23-1d494ce40f17", 2024-08-20T01:51:34.757 INFO:teuthology.orchestra.run.smithi079.stdout: "options": "recursive,force" 2024-08-20T01:51:34.757 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:51:34.757 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:51:34.757 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:51:34.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.748+0000 7f62dd057640 1 -- 172.21.15.79:0/2112326438 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f62c00b3c50 msgr2=0x7f62c00b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:34.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.748+0000 7f62dd057640 1 --2- 172.21.15.79:0/2112326438 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f62c00b3c50 0x7f62c00b6110 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f62c80e1cc0 tx=0x7f62c80e7920 comp rx=0 tx=0).stop 2024-08-20T01:51:34.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.748+0000 7f62dd057640 1 -- 172.21.15.79:0/2112326438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62d8103870 msgr2=0x7f62d8198f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:34.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.748+0000 7f62dd057640 1 --2- 172.21.15.79:0/2112326438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62d8103870 0x7f62d8198f00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f62c800e9f0 tx=0x7f62c800eeb0 comp rx=0 tx=0).stop 2024-08-20T01:51:34.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.748+0000 7f62dd057640 1 -- 172.21.15.79:0/2112326438 shutdown_connections 2024-08-20T01:51:34.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.748+0000 7f62dd057640 1 --2- 172.21.15.79:0/2112326438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62d810ce20 0x7f62d819e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:34.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.748+0000 7f62dd057640 1 --2- 172.21.15.79:0/2112326438 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f62c00b3c50 0x7f62c00b6110 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:34.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.748+0000 7f62dd057640 1 --2- 172.21.15.79:0/2112326438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62d8104270 0x7f62d8199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:34.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.748+0000 7f62dd057640 1 --2- 172.21.15.79:0/2112326438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62d8103870 0x7f62d8198f00 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:34.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.748+0000 7f62dd057640 1 -- 172.21.15.79:0/2112326438 >> 172.21.15.79:0/2112326438 conn(0x7f62d80fd400 msgr2=0x7f62d80fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:34.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.748+0000 7f62dd057640 1 -- 172.21.15.79:0/2112326438 shutdown_connections 2024-08-20T01:51:34.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:51:34.748+0000 7f62dd057640 1 -- 172.21.15.79:0/2112326438 wait complete. 2024-08-20T01:51:34.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:34 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:51:34.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:34 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:51:34.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:34 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:51:34.938 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:34 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:51:35.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:34 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:51:35.198 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:34 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:51:35.198 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:34 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:51:35.198 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:34 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:51:35.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:34 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:51:35.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:34 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:51:35.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:34 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:51:35.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:34 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:51:35.443 INFO:tasks.cephfs.filesystem:scrub status for tag:4f3234d5-0a92-4281-af23-1d494ce40f17 - {'path': '/', 'tag': '4f3234d5-0a92-4281-af23-1d494ce40f17', 'options': 'recursive,force'} 2024-08-20T01:51:36.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:35 smithi175 ceph-mon[22392]: pgmap v775: 97 pgs: 97 active+clean; 11 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.2 KiB/s wr, 28 op/s 2024-08-20T01:51:36.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:35 smithi079 ceph-mon[18656]: pgmap v775: 97 pgs: 97 active+clean; 11 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.2 KiB/s wr, 28 op/s 2024-08-20T01:51:36.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:35 smithi081 ceph-mon[22209]: pgmap v775: 97 pgs: 97 active+clean; 11 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.2 KiB/s wr, 28 op/s 2024-08-20T01:51:37.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:36 smithi175 ceph-mon[22392]: Health check update: 5 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-08-20T01:51:37.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:36 smithi079 ceph-mon[18656]: Health check update: 5 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-08-20T01:51:37.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:36 smithi081 ceph-mon[22209]: Health check update: 5 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-08-20T01:51:38.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:37 smithi175 ceph-mon[22392]: pgmap v776: 97 pgs: 97 active+clean; 11 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.5 KiB/s wr, 32 op/s 2024-08-20T01:51:38.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:37 smithi079 ceph-mon[18656]: pgmap v776: 97 pgs: 97 active+clean; 11 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.5 KiB/s wr, 32 op/s 2024-08-20T01:51:38.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:37 smithi081 ceph-mon[22209]: pgmap v776: 97 pgs: 97 active+clean; 11 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.5 KiB/s wr, 32 op/s 2024-08-20T01:51:40.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:39 smithi175 ceph-mon[22392]: pgmap v777: 97 pgs: 97 active+clean; 11 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.3 KiB/s wr, 35 op/s 2024-08-20T01:51:40.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:39 smithi079 ceph-mon[18656]: pgmap v777: 97 pgs: 97 active+clean; 11 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.3 KiB/s wr, 35 op/s 2024-08-20T01:51:40.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:39 smithi081 ceph-mon[22209]: pgmap v777: 97 pgs: 97 active+clean; 11 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.3 KiB/s wr, 35 op/s 2024-08-20T01:51:41.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:40 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:51:41.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:40 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:51:41.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:40 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:51:42.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:41 smithi175 ceph-mon[22392]: pgmap v778: 97 pgs: 97 active+clean; 11 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.4 KiB/s wr, 34 op/s 2024-08-20T01:51:42.179 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:41 smithi081 ceph-mon[22209]: pgmap v778: 97 pgs: 97 active+clean; 11 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.4 KiB/s wr, 34 op/s 2024-08-20T01:51:42.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:41 smithi079 ceph-mon[18656]: pgmap v778: 97 pgs: 97 active+clean; 11 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.4 KiB/s wr, 34 op/s 2024-08-20T01:51:43.639 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.634+0000 7f3fea9f7640 1 -- 172.21.15.79:0/49441037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fe4103070 msgr2=0x7f3fe41099f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:43.639 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.634+0000 7f3fea9f7640 1 --2- 172.21.15.79:0/49441037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fe4103070 0x7f3fe41099f0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc009cd0 tx=0x7f3fdc02a8e0 comp rx=0 tx=0).stop 2024-08-20T01:51:43.639 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.634+0000 7f3fea9f7640 1 -- 172.21.15.79:0/49441037 shutdown_connections 2024-08-20T01:51:43.639 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.634+0000 7f3fea9f7640 1 --2- 172.21.15.79:0/49441037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fe4103070 0x7f3fe41099f0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:43.639 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.634+0000 7f3fea9f7640 1 --2- 172.21.15.79:0/49441037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fe41026b0 0x7f3fe4102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:43.639 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.634+0000 7f3fea9f7640 1 --2- 172.21.15.79:0/49441037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fe4101560 0x7f3fe4101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:43.639 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.634+0000 7f3fea9f7640 1 -- 172.21.15.79:0/49441037 >> 172.21.15.79:0/49441037 conn(0x7f3fe40fce40 msgr2=0x7f3fe40ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:43.639 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.634+0000 7f3fea9f7640 1 -- 172.21.15.79:0/49441037 shutdown_connections 2024-08-20T01:51:43.639 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.634+0000 7f3fea9f7640 1 -- 172.21.15.79:0/49441037 wait complete. 2024-08-20T01:51:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.634+0000 7f3fea9f7640 1 Processor -- start 2024-08-20T01:51:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.634+0000 7f3fea9f7640 1 -- start start 2024-08-20T01:51:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.635+0000 7f3fea9f7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fe4101560 0x7f3fe406ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.635+0000 7f3fea9f7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fe41026b0 0x7f3fe419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.635+0000 7f3fea9f7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fe4103070 0x7f3fe419fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.635+0000 7f3fea9f7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe410d0d0 con 0x7f3fe41026b0 2024-08-20T01:51:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.635+0000 7f3fea9f7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe410cf50 con 0x7f3fe4101560 2024-08-20T01:51:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.635+0000 7f3fea9f7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe410d250 con 0x7f3fe4103070 2024-08-20T01:51:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.635+0000 7f3fe37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fe41026b0 0x7f3fe419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.635+0000 7f3fe3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fe4101560 0x7f3fe406ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.635+0000 7f3fe37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fe41026b0 0x7f3fe419d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57274/0 (socket says 172.21.15.79:57274) 2024-08-20T01:51:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.635+0000 7f3fe8f94640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fe4103070 0x7f3fe419fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.635+0000 7f3fe37fe640 1 -- 172.21.15.79:0/1962832156 learned_addr learned my addr 172.21.15.79:0/1962832156 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:43.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.635+0000 7f3fe37fe640 1 -- 172.21.15.79:0/1962832156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fe4103070 msgr2=0x7f3fe419fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:43.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.635+0000 7f3fe37fe640 1 --2- 172.21.15.79:0/1962832156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fe4103070 0x7f3fe419fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:43.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.635+0000 7f3fe37fe640 1 -- 172.21.15.79:0/1962832156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fe4101560 msgr2=0x7f3fe406ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:43.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.635+0000 7f3fe37fe640 1 --2- 172.21.15.79:0/1962832156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fe4101560 0x7f3fe406ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:43.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.635+0000 7f3fe37fe640 1 -- 172.21.15.79:0/1962832156 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe41a04f0 con 0x7f3fe41026b0 2024-08-20T01:51:43.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.635+0000 7f3fe37fe640 1 --2- 172.21.15.79:0/1962832156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fe41026b0 0x7f3fe419d640 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f3fd800e9f0 tx=0x7f3fd800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:43.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.636+0000 7f3fe17fa640 1 -- 172.21.15.79:0/1962832156 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd800cd80 con 0x7f3fe41026b0 2024-08-20T01:51:43.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.636+0000 7f3fea9f7640 1 -- 172.21.15.79:0/1962832156 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fe41a07e0 con 0x7f3fe41026b0 2024-08-20T01:51:43.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.636+0000 7f3fe17fa640 1 -- 172.21.15.79:0/1962832156 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3fd80054b0 con 0x7f3fe41026b0 2024-08-20T01:51:43.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.636+0000 7f3fe17fa640 1 -- 172.21.15.79:0/1962832156 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd8010430 con 0x7f3fe41026b0 2024-08-20T01:51:43.641 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.636+0000 7f3fea9f7640 1 -- 172.21.15.79:0/1962832156 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fe41a0ce0 con 0x7f3fe41026b0 2024-08-20T01:51:43.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.638+0000 7f3fed7f1740 1 Processor -- start 2024-08-20T01:51:43.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.638+0000 7f3fe17fa640 1 -- 172.21.15.79:0/1962832156 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3fd80046c0 con 0x7f3fe41026b0 2024-08-20T01:51:43.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.638+0000 7f3fed7f1740 1 -- start start 2024-08-20T01:51:43.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.638+0000 7f3fed7f1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dbb80c630 0x555dbb80ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:43.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.638+0000 7f3fed7f1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555dbb80ef60 0x555dbb811350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:43.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.638+0000 7f3fed7f1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbb8119a0 0x555dbb813e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:43.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.638+0000 7f3fed7f1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555dbb77f360 con 0x555dbb80c630 2024-08-20T01:51:43.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.638+0000 7f3fed7f1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555dbb76e860 con 0x555dbb8119a0 2024-08-20T01:51:43.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.638+0000 7f3fed7f1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555dbb7728a0 con 0x555dbb80ef60 2024-08-20T01:51:43.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.639+0000 7f3fe8f94640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dbb80c630 0x555dbb80ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:43.648 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.639+0000 7f3fe8f94640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dbb80c630 0x555dbb80ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57278/0 (socket says 172.21.15.79:57278) 2024-08-20T01:51:43.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.639+0000 7f3fe3fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555dbb80ef60 0x555dbb811350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:43.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.639+0000 7f3fe8f94640 1 -- 172.21.15.79:0/3366057660 learned_addr learned my addr 172.21.15.79:0/3366057660 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:43.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.639+0000 7f3fe37fe640 1 --2- 172.21.15.79:0/3366057660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbb8119a0 0x555dbb813e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:43.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.639+0000 7f3fe8f94640 1 -- 172.21.15.79:0/3366057660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555dbb80ef60 msgr2=0x555dbb811350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:43.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.639+0000 7f3fe8f94640 1 --2- 172.21.15.79:0/3366057660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555dbb80ef60 0x555dbb811350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:43.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.639+0000 7f3fe8f94640 1 -- 172.21.15.79:0/3366057660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbb8119a0 msgr2=0x555dbb813e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:43.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.639+0000 7f3fe8f94640 1 --2- 172.21.15.79:0/3366057660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbb8119a0 0x555dbb813e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:43.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.639+0000 7f3fe8f94640 1 -- 172.21.15.79:0/3366057660 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dbb715e40 con 0x555dbb80c630 2024-08-20T01:51:43.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.639+0000 7f3fe8f94640 1 --2- 172.21.15.79:0/3366057660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dbb80c630 0x555dbb80ea20 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc009cd0 tx=0x7f3fdc005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3684746b09dd2326 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:43.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.639+0000 7f3fe17fa640 1 --2- 172.21.15.79:0/1962832156 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3fcc0b3bd0 0x7f3fcc0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:43.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.639+0000 7f3fe3fff640 1 --2- 172.21.15.79:0/1962832156 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3fcc0b3bd0 0x7f3fcc0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:43.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.639+0000 7f3fca7fc640 1 -- 172.21.15.79:0/3366057660 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc048070 con 0x555dbb80c630 2024-08-20T01:51:43.649 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.639+0000 7f3fca7fc640 1 -- 172.21.15.79:0/3366057660 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3fdc036070 con 0x555dbb80c630 2024-08-20T01:51:43.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.639+0000 7f3fca7fc640 1 -- 172.21.15.79:0/3366057660 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc004570 con 0x555dbb80c630 2024-08-20T01:51:43.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.639+0000 7f3fe17fa640 1 -- 172.21.15.79:0/1962832156 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f3fd80e3ee0 con 0x7f3fe41026b0 2024-08-20T01:51:43.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.640+0000 7f3fed7f1740 1 -- 172.21.15.79:0/3366057660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dbb80c630 msgr2=0x555dbb80ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:43.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.640+0000 7f3fed7f1740 1 --2- 172.21.15.79:0/3366057660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dbb80c630 0x555dbb80ea20 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc009cd0 tx=0x7f3fdc005fa0 comp rx=0 tx=0).stop 2024-08-20T01:51:43.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.640+0000 7f3fe3fff640 1 --2- 172.21.15.79:0/1962832156 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3fcc0b3bd0 0x7f3fcc0b6090 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4005d00 tx=0x7f3fd400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:43.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.640+0000 7f3fed7f1740 1 -- 172.21.15.79:0/3366057660 shutdown_connections 2024-08-20T01:51:43.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.640+0000 7f3fed7f1740 1 --2- 172.21.15.79:0/3366057660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbb8119a0 0x555dbb813e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:43.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.640+0000 7f3fed7f1740 1 --2- 172.21.15.79:0/3366057660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555dbb80ef60 0x555dbb811350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:43.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.640+0000 7f3fed7f1740 1 --2- 172.21.15.79:0/3366057660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dbb80c630 0x555dbb80ea20 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:43.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.640+0000 7f3fed7f1740 1 -- 172.21.15.79:0/3366057660 >> 172.21.15.79:0/3366057660 conn(0x555dbb807730 msgr2=0x555dbb808510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:43.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.640+0000 7f3fed7f1740 1 -- 172.21.15.79:0/3366057660 shutdown_connections 2024-08-20T01:51:43.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.640+0000 7f3fed7f1740 1 -- 172.21.15.79:0/3366057660 wait complete. 2024-08-20T01:51:43.650 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.640+0000 7f3fed7f1740 1 -- start start 2024-08-20T01:51:43.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.641+0000 7f3fed7f1740 1 Processor -- start 2024-08-20T01:51:43.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.641+0000 7f3fed7f1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dbb80c630 0x555dbb815e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:43.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.641+0000 7f3fed7f1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbb80ef60 0x555dbb816500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:43.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.641+0000 7f3fed7f1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555dbb8119a0 0x555dbb8170d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:43.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.641+0000 7f3fed7f1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555dbb6a7ab0 con 0x555dbb80c630 2024-08-20T01:51:43.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.641+0000 7f3fed7f1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555dbb6f5780 con 0x555dbb80ef60 2024-08-20T01:51:43.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.641+0000 7f3fed7f1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555dbb814920 con 0x555dbb8119a0 2024-08-20T01:51:43.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.641+0000 7f3fe3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dbb80c630 0x555dbb815e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:43.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.641+0000 7f3fed7f1740 10 client.0 _ll_register_callbacks cb 0x555dbb47da00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:51:43.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.641+0000 7f3fe3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dbb80c630 0x555dbb815e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57292/0 (socket says 172.21.15.79:57292) 2024-08-20T01:51:43.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.641+0000 7f3fe3fff640 1 -- 172.21.15.79:0/3102133850 learned_addr learned my addr 172.21.15.79:0/3102133850 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:43.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.641+0000 7f3fe37fe640 1 --2- 172.21.15.79:0/3102133850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbb80ef60 0x555dbb816500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:43.651 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.641+0000 7f3fe8f94640 1 --2- 172.21.15.79:0/3102133850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555dbb8119a0 0x555dbb8170d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:43.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.641+0000 7f3fe3fff640 1 -- 172.21.15.79:0/3102133850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555dbb8119a0 msgr2=0x555dbb8170d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:43.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.641+0000 7f3fe3fff640 1 --2- 172.21.15.79:0/3102133850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555dbb8119a0 0x555dbb8170d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:43.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.641+0000 7f3fe3fff640 1 -- 172.21.15.79:0/3102133850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbb80ef60 msgr2=0x555dbb816500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:43.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.641+0000 7f3fe3fff640 1 --2- 172.21.15.79:0/3102133850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbb80ef60 0x555dbb816500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:43.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.641+0000 7f3fe3fff640 1 -- 172.21.15.79:0/3102133850 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555dbb4d1790 con 0x555dbb80c630 2024-08-20T01:51:43.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.641+0000 7f3fe8f94640 1 --2- 172.21.15.79:0/3102133850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555dbb8119a0 0x555dbb8170d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:51:43.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.641+0000 7f3fe3fff640 1 --2- 172.21.15.79:0/3102133850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dbb80c630 0x555dbb815e60 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f3fd401f550 tx=0x7f3fd4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5863b6ae934f7b34 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:43.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.641+0000 7f3fc37fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:51:43.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.642+0000 7f3fc37fe640 1 -- 172.21.15.79:0/3102133850 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd4005020 con 0x555dbb80c630 2024-08-20T01:51:43.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.642+0000 7f3fc37fe640 1 -- 172.21.15.79:0/3102133850 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f3fd4017030 con 0x555dbb80c630 2024-08-20T01:51:43.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.642+0000 7f3fed7f1740 1 -- 172.21.15.79:0/3102133850 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555dbb71de00 con 0x555dbb80c630 2024-08-20T01:51:43.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.642+0000 7f3fc37fe640 1 -- 172.21.15.79:0/3102133850 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f3fd40051c0 con 0x555dbb80c630 2024-08-20T01:51:43.652 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.642+0000 7f3fed7f1740 10 client.19086 fetch_fsmap learned FSMap version 60 2024-08-20T01:51:43.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.642+0000 7f3fed7f1740 1 -- 172.21.15.79:0/3102133850 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x555dbb54a620 con 0x555dbb80c630 2024-08-20T01:51:43.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.642+0000 7f3fc37fe640 1 -- 172.21.15.79:0/3102133850 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x555dbb71de00 con 0x555dbb80c630 2024-08-20T01:51:43.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.642+0000 7f3fc37fe640 1 -- 172.21.15.79:0/3102133850 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 60) ==== 8418+0+0 (secure 0 0 0) 0x7f3fd401c600 con 0x555dbb80c630 2024-08-20T01:51:43.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.642+0000 7f3fed7f1740 10 client.19086 fetch_fsmap finished waiting for FSMap version 60 2024-08-20T01:51:43.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.642+0000 7f3fed7f1740 10 client.19086 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:51:43.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.642+0000 7f3fed7f1740 20 client.19086 populate_metadata read hostname 'smithi079' 2024-08-20T01:51:43.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.642+0000 7f3fed7f1740 1 --2- 172.21.15.79:0/3102133850 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x555dbb821880 0x555dbb823d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:43.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.642+0000 7f3fed7f1740 4 client.19086 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:51:43.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.642+0000 7f3fed7f1740 1 -- 172.21.15.79:0/3102133850 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555dbb7812b0 con 0x555dbb821880 2024-08-20T01:51:43.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.642+0000 7f3fe37fe640 1 --2- 172.21.15.79:0/3102133850 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x555dbb821880 0x555dbb823d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:43.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.643+0000 7f3fe37fe640 1 --2- 172.21.15.79:0/3102133850 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x555dbb821880 0x555dbb823d20 crc :-1 s=READY pgs=304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6a3f2bdb09f340d server_cookie=1fe0347271a622f2 in_seq=0 out_seq=0 2024-08-20T01:51:43.653 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.643+0000 7f3fc37fe640 10 client.19086 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:51:43.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.643+0000 7f3fc37fe640 1 -- 172.21.15.79:0/3102133850 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555dbb7812b0 con 0x555dbb821880 2024-08-20T01:51:43.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.643+0000 7f3fc37fe640 10 client.19086 handle_command_reply: tid=0 2024-08-20T01:51:43.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.643+0000 7f3fed7f1740 1 client.19086 shutdown 2024-08-20T01:51:43.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.644+0000 7f3fed7f1740 1 -- 172.21.15.79:0/3102133850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dbb80c630 msgr2=0x555dbb815e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:43.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.644+0000 7f3fed7f1740 1 --2- 172.21.15.79:0/3102133850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dbb80c630 0x555dbb815e60 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f3fd401f550 tx=0x7f3fd4004730 comp rx=0 tx=0).stop 2024-08-20T01:51:43.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.644+0000 7f3fed7f1740 1 -- 172.21.15.79:0/3102133850 shutdown_connections 2024-08-20T01:51:43.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.644+0000 7f3fed7f1740 1 --2- 172.21.15.79:0/3102133850 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x555dbb821880 0x555dbb823d20 crc :-1 s=READY pgs=304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:43.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.644+0000 7f3fed7f1740 1 --2- 172.21.15.79:0/3102133850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555dbb8119a0 0x555dbb8170d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:43.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.644+0000 7f3fed7f1740 1 --2- 172.21.15.79:0/3102133850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbb80ef60 0x555dbb816500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:43.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.644+0000 7f3fc37fe640 0 client.19086 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:51:43.654 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.644+0000 7f3fed7f1740 1 --2- 172.21.15.79:0/3102133850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dbb80c630 0x555dbb815e60 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:43.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.644+0000 7f3fed7f1740 1 -- 172.21.15.79:0/3102133850 >> 172.21.15.79:0/3102133850 conn(0x555dbb807730 msgr2=0x555dbb806850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:43.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.644+0000 7f3fed7f1740 1 -- 172.21.15.79:0/3102133850 shutdown_connections 2024-08-20T01:51:43.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.644+0000 7f3fed7f1740 1 -- 172.21.15.79:0/3102133850 wait complete. 2024-08-20T01:51:43.655 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.644+0000 7f3fed7f1740 20 client.19086 trim_cache size 0 max 16384 2024-08-20T01:51:43.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.658+0000 7f3fed7f1740 1 Processor -- start 2024-08-20T01:51:43.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.658+0000 7f3fed7f1740 1 -- start start 2024-08-20T01:51:43.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.658+0000 7f3fed7f1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dbb80c630 0x555dbb80bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:43.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.658+0000 7f3fed7f1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555dbb80ef60 0x555dbb8133b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:43.665 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.658+0000 7f3fed7f1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbb8119a0 0x555dbb8138f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:43.666 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.658+0000 7f3fed7f1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe41a99c0 con 0x555dbb80c630 2024-08-20T01:51:43.666 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.658+0000 7f3fed7f1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe41ab740 con 0x555dbb8119a0 2024-08-20T01:51:43.666 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.658+0000 7f3fed7f1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe41aa150 con 0x555dbb80ef60 2024-08-20T01:51:43.666 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.658+0000 7f3fe3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dbb80c630 0x555dbb80bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:43.666 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.658+0000 7f3fe3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dbb80c630 0x555dbb80bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57304/0 (socket says 172.21.15.79:57304) 2024-08-20T01:51:43.666 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.658+0000 7f3fe3fff640 1 -- 172.21.15.79:0/3672536843 learned_addr learned my addr 172.21.15.79:0/3672536843 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:43.666 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.658+0000 7f3fe37fe640 1 --2- 172.21.15.79:0/3672536843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555dbb80ef60 0x555dbb8133b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:43.666 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.658+0000 7f3fe8f94640 1 --2- 172.21.15.79:0/3672536843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbb8119a0 0x555dbb8138f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:43.666 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.659+0000 7f3fe3fff640 1 -- 172.21.15.79:0/3672536843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555dbb80ef60 msgr2=0x555dbb8133b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:43.666 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.659+0000 7f3fe3fff640 1 --2- 172.21.15.79:0/3672536843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555dbb80ef60 0x555dbb8133b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:43.666 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.659+0000 7f3fe3fff640 1 -- 172.21.15.79:0/3672536843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbb8119a0 msgr2=0x555dbb8138f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:43.666 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.659+0000 7f3fe3fff640 1 --2- 172.21.15.79:0/3672536843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbb8119a0 0x555dbb8138f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:43.667 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.659+0000 7f3fe3fff640 1 -- 172.21.15.79:0/3672536843 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dbb8116c0 con 0x555dbb80c630 2024-08-20T01:51:43.667 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.659+0000 7f3fe3fff640 1 --2- 172.21.15.79:0/3672536843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dbb80c630 0x555dbb80bc50 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f3fd400bfd0 tx=0x7f3fd401dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0f69294344bd3ac server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:43.667 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.659+0000 7f3fc9ffb640 1 -- 172.21.15.79:0/3672536843 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd4036050 con 0x555dbb80c630 2024-08-20T01:51:43.667 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.659+0000 7f3fc9ffb640 1 -- 172.21.15.79:0/3672536843 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3fd401c800 con 0x555dbb80c630 2024-08-20T01:51:43.667 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.659+0000 7f3fc9ffb640 1 -- 172.21.15.79:0/3672536843 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd4004f60 con 0x555dbb80c630 2024-08-20T01:51:43.667 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.659+0000 7f3fed7f1740 1 -- 172.21.15.79:0/3672536843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dbb80c630 msgr2=0x555dbb80bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:43.667 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.659+0000 7f3fed7f1740 1 --2- 172.21.15.79:0/3672536843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dbb80c630 0x555dbb80bc50 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f3fd400bfd0 tx=0x7f3fd401dcf0 comp rx=0 tx=0).stop 2024-08-20T01:51:43.667 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.659+0000 7f3fed7f1740 1 -- 172.21.15.79:0/3672536843 shutdown_connections 2024-08-20T01:51:43.667 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.659+0000 7f3fed7f1740 1 --2- 172.21.15.79:0/3672536843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbb8119a0 0x555dbb8138f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:43.667 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.659+0000 7f3fed7f1740 1 --2- 172.21.15.79:0/3672536843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555dbb80ef60 0x555dbb8133b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:43.667 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.659+0000 7f3fed7f1740 1 --2- 172.21.15.79:0/3672536843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dbb80c630 0x555dbb80bc50 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:43.667 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.659+0000 7f3fed7f1740 1 -- 172.21.15.79:0/3672536843 >> 172.21.15.79:0/3672536843 conn(0x555dbb807730 msgr2=0x555dbb808410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:43.668 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.660+0000 7f3fed7f1740 1 -- 172.21.15.79:0/3672536843 shutdown_connections 2024-08-20T01:51:43.668 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.660+0000 7f3fed7f1740 1 -- 172.21.15.79:0/3672536843 wait complete. 2024-08-20T01:51:43.668 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.660+0000 7f3fed7f1740 1 -- start start 2024-08-20T01:51:43.668 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.660+0000 7f3fed7f1740 1 Processor -- start 2024-08-20T01:51:43.668 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.660+0000 7f3fed7f1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555dbb80c630 0x555dbb81aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:43.668 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.660+0000 7f3fed7f1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbb80ef60 0x555dbb81b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:43.668 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.660+0000 7f3fed7f1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dbb8119a0 0x555dbb81bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:43.668 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.660+0000 7f3fed7f1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe41aafb0 con 0x555dbb8119a0 2024-08-20T01:51:43.668 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.660+0000 7f3fed7f1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe41aa8b0 con 0x555dbb80ef60 2024-08-20T01:51:43.668 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.660+0000 7f3fed7f1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe41a79a0 con 0x555dbb80c630 2024-08-20T01:51:43.668 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.660+0000 7f3fed7f1740 10 client.0 _ll_register_callbacks cb 0x7f3fd401f430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:51:43.668 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.660+0000 7f3fe8f94640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dbb8119a0 0x555dbb81bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:43.669 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.660+0000 7f3fe8f94640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dbb8119a0 0x555dbb81bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57306/0 (socket says 172.21.15.79:57306) 2024-08-20T01:51:43.669 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.660+0000 7f3fe8f94640 1 -- 172.21.15.79:0/513050821 learned_addr learned my addr 172.21.15.79:0/513050821 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:51:43.669 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.660+0000 7f3fe3fff640 1 --2- 172.21.15.79:0/513050821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555dbb80c630 0x555dbb81aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:43.669 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.660+0000 7f3fe37fe640 1 --2- 172.21.15.79:0/513050821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbb80ef60 0x555dbb81b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:43.669 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.661+0000 7f3fe8f94640 1 -- 172.21.15.79:0/513050821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555dbb80c630 msgr2=0x555dbb81aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:43.669 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.661+0000 7f3fe8f94640 1 --2- 172.21.15.79:0/513050821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555dbb80c630 0x555dbb81aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:43.669 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.661+0000 7f3fe8f94640 1 -- 172.21.15.79:0/513050821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbb80ef60 msgr2=0x555dbb81b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:51:43.669 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.661+0000 7f3fe8f94640 1 --2- 172.21.15.79:0/513050821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbb80ef60 0x555dbb81b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:43.669 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.661+0000 7f3fe8f94640 1 -- 172.21.15.79:0/513050821 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555dbb81c500 con 0x555dbb8119a0 2024-08-20T01:51:43.669 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.661+0000 7f3fe8f94640 1 --2- 172.21.15.79:0/513050821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dbb8119a0 0x555dbb81bcd0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc009cd0 tx=0x7f3fdc02b020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6495f609d07b1bf server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:51:43.669 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.661+0000 7f3fc37fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:51:43.669 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.661+0000 7f3fc37fe640 1 -- 172.21.15.79:0/513050821 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc048040 con 0x555dbb8119a0 2024-08-20T01:51:43.669 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.661+0000 7f3fc37fe640 1 -- 172.21.15.79:0/513050821 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f3fdc003d80 con 0x555dbb8119a0 2024-08-20T01:51:43.670 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.661+0000 7f3fed7f1740 1 -- 172.21.15.79:0/513050821 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3fd401c800 con 0x555dbb8119a0 2024-08-20T01:51:43.670 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.661+0000 7f3fc37fe640 1 -- 172.21.15.79:0/513050821 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f3fdc009b20 con 0x555dbb8119a0 2024-08-20T01:51:43.670 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.661+0000 7f3fed7f1740 10 client.19092 fetch_fsmap learned FSMap version 60 2024-08-20T01:51:43.670 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.661+0000 7f3fed7f1740 1 -- 172.21.15.79:0/513050821 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x555dbb81d910 con 0x555dbb8119a0 2024-08-20T01:51:43.670 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.661+0000 7f3fc37fe640 1 -- 172.21.15.79:0/513050821 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3fd401c800 con 0x555dbb8119a0 2024-08-20T01:51:43.670 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.661+0000 7f3fc37fe640 1 -- 172.21.15.79:0/513050821 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 60) ==== 8418+0+0 (secure 0 0 0) 0x7f3fdc042030 con 0x555dbb8119a0 2024-08-20T01:51:43.670 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.661+0000 7f3fed7f1740 10 client.19092 fetch_fsmap finished waiting for FSMap version 60 2024-08-20T01:51:43.670 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.661+0000 7f3fed7f1740 10 client.19092 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:51:43.670 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.661+0000 7f3fed7f1740 20 client.19092 populate_metadata read hostname 'smithi079' 2024-08-20T01:51:43.670 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.661+0000 7f3fed7f1740 1 --2- 172.21.15.79:0/513050821 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x555dbb88c5c0 0x555dbb88e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:51:43.670 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.661+0000 7f3fed7f1740 4 client.19092 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:51:43.670 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.661+0000 7f3fed7f1740 1 -- 172.21.15.79:0/513050821 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555dbb77cd50 con 0x555dbb88c5c0 2024-08-20T01:51:43.670 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.662+0000 7f3fe3fff640 1 --2- 172.21.15.79:0/513050821 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x555dbb88c5c0 0x555dbb88e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:51:43.671 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.662+0000 7f3fc37fe640 10 client.19092 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:51:43.671 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:43.662+0000 7f3fe3fff640 1 --2- 172.21.15.79:0/513050821 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x555dbb88c5c0 0x555dbb88e9b0 crc :-1 s=READY pgs=305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64543b0d1a9267ea server_cookie=9e949e62e404dfd3 in_seq=0 out_seq=0 2024-08-20T01:51:44.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:43 smithi079 ceph-mon[18656]: pgmap v779: 97 pgs: 97 active+clean; 11 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.7 KiB/s wr, 32 op/s 2024-08-20T01:51:44.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:43 smithi079 ceph-mon[18656]: Health check update: 6 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-08-20T01:51:44.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:43 smithi081 ceph-mon[22209]: pgmap v779: 97 pgs: 97 active+clean; 11 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.7 KiB/s wr, 32 op/s 2024-08-20T01:51:44.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:43 smithi081 ceph-mon[22209]: Health check update: 6 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-08-20T01:51:44.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:43 smithi175 ceph-mon[22392]: pgmap v779: 97 pgs: 97 active+clean; 11 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.7 KiB/s wr, 32 op/s 2024-08-20T01:51:44.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:43 smithi175 ceph-mon[22392]: Health check update: 6 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-08-20T01:51:46.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:45 smithi079 ceph-mon[18656]: pgmap v780: 97 pgs: 97 active+clean; 11 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.0 KiB/s wr, 36 op/s 2024-08-20T01:51:46.191 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:45 smithi175 ceph-mon[22392]: pgmap v780: 97 pgs: 97 active+clean; 11 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.0 KiB/s wr, 36 op/s 2024-08-20T01:51:46.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:45 smithi081 ceph-mon[22209]: pgmap v780: 97 pgs: 97 active+clean; 11 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.0 KiB/s wr, 36 op/s 2024-08-20T01:51:48.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:47 smithi079 ceph-mon[18656]: pgmap v781: 97 pgs: 97 active+clean; 11 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.6 KiB/s wr, 30 op/s 2024-08-20T01:51:48.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:47 smithi081 ceph-mon[22209]: pgmap v781: 97 pgs: 97 active+clean; 11 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.6 KiB/s wr, 30 op/s 2024-08-20T01:51:48.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:47 smithi175 ceph-mon[22392]: pgmap v781: 97 pgs: 97 active+clean; 11 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.6 KiB/s wr, 30 op/s 2024-08-20T01:51:50.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:49 smithi079 ceph-mon[18656]: pgmap v782: 97 pgs: 97 active+clean; 11 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.1 KiB/s wr, 26 op/s 2024-08-20T01:51:50.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:49 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:51:50.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:49 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:51:50.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:49 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:51:50.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:49 smithi081 ceph-mon[22209]: pgmap v782: 97 pgs: 97 active+clean; 11 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.1 KiB/s wr, 26 op/s 2024-08-20T01:51:50.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:49 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:51:50.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:49 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:51:50.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:49 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:51:50.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:49 smithi175 ceph-mon[22392]: pgmap v782: 97 pgs: 97 active+clean; 11 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.1 KiB/s wr, 26 op/s 2024-08-20T01:51:50.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:49 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:51:50.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:49 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:51:50.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:49 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:51:51.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:50 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:51:51.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:50 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:51:51.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:50 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:51:52.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:51 smithi079 ceph-mon[18656]: pgmap v783: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 8.1 KiB/s wr, 24 op/s 2024-08-20T01:51:52.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:51 smithi081 ceph-mon[22209]: pgmap v783: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 8.1 KiB/s wr, 24 op/s 2024-08-20T01:51:52.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:51 smithi175 ceph-mon[22392]: pgmap v783: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 8.1 KiB/s wr, 24 op/s 2024-08-20T01:51:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:52.638+0000 7f3fc37fe640 1 -- 172.21.15.79:0/513050821 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555dbb77cd50 con 0x555dbb88c5c0 2024-08-20T01:51:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:52.638+0000 7f3fc37fe640 10 client.19092 handle_command_reply: tid=0 2024-08-20T01:51:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:52.638+0000 7f3fed7f1740 1 client.19092 shutdown 2024-08-20T01:51:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:52.639+0000 7f3fed7f1740 1 -- 172.21.15.79:0/513050821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dbb8119a0 msgr2=0x555dbb81bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:52.639+0000 7f3fed7f1740 1 --2- 172.21.15.79:0/513050821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dbb8119a0 0x555dbb81bcd0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc009cd0 tx=0x7f3fdc02b020 comp rx=0 tx=0).stop 2024-08-20T01:51:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:52.639+0000 7f3fed7f1740 1 -- 172.21.15.79:0/513050821 shutdown_connections 2024-08-20T01:51:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:52.639+0000 7f3fed7f1740 1 --2- 172.21.15.79:0/513050821 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x555dbb88c5c0 0x555dbb88e9b0 crc :-1 s=READY pgs=305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:52.639+0000 7f3fed7f1740 1 --2- 172.21.15.79:0/513050821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dbb8119a0 0x555dbb81bcd0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:52.639+0000 7f3fed7f1740 1 --2- 172.21.15.79:0/513050821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbb80ef60 0x555dbb81b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:52.639+0000 7f3fc37fe640 0 client.19092 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:51:52.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:52.639+0000 7f3fed7f1740 1 --2- 172.21.15.79:0/513050821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555dbb80c630 0x555dbb81aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:52.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:52.639+0000 7f3fed7f1740 1 -- 172.21.15.79:0/513050821 >> 172.21.15.79:0/513050821 conn(0x555dbb807730 msgr2=0x555dbb8133b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:52.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:52.639+0000 7f3fed7f1740 1 -- 172.21.15.79:0/513050821 shutdown_connections 2024-08-20T01:51:52.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:52.639+0000 7f3fed7f1740 1 -- 172.21.15.79:0/513050821 wait complete. 2024-08-20T01:51:52.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:52.639+0000 7f3fed7f1740 20 client.19092 trim_cache size 0 max 16384 2024-08-20T01:51:52.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:51:52.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:51:52.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:51:52.643 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:51:52.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:52.639+0000 7f3fea9f7640 1 -- 172.21.15.79:0/1962832156 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3fcc0b3bd0 msgr2=0x7f3fcc0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:52.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:52.639+0000 7f3fea9f7640 1 --2- 172.21.15.79:0/1962832156 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3fcc0b3bd0 0x7f3fcc0b6090 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4005d00 tx=0x7f3fd400b410 comp rx=0 tx=0).stop 2024-08-20T01:51:52.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:52.639+0000 7f3fea9f7640 1 -- 172.21.15.79:0/1962832156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fe41026b0 msgr2=0x7f3fe419d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:51:52.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:52.639+0000 7f3fea9f7640 1 --2- 172.21.15.79:0/1962832156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fe41026b0 0x7f3fe419d640 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f3fd800e9f0 tx=0x7f3fd800edf0 comp rx=0 tx=0).stop 2024-08-20T01:51:52.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:52.640+0000 7f3fea9f7640 1 -- 172.21.15.79:0/1962832156 shutdown_connections 2024-08-20T01:51:52.644 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:52.640+0000 7f3fea9f7640 1 --2- 172.21.15.79:0/1962832156 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3fcc0b3bd0 0x7f3fcc0b6090 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:52.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:52.640+0000 7f3fea9f7640 1 --2- 172.21.15.79:0/1962832156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fe4103070 0x7f3fe419fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:52.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:52.640+0000 7f3fea9f7640 1 --2- 172.21.15.79:0/1962832156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fe41026b0 0x7f3fe419d640 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:52.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:52.640+0000 7f3fea9f7640 1 --2- 172.21.15.79:0/1962832156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fe4101560 0x7f3fe406ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:51:52.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:52.640+0000 7f3fea9f7640 1 -- 172.21.15.79:0/1962832156 >> 172.21.15.79:0/1962832156 conn(0x7f3fe40fce40 msgr2=0x7f3fe4105a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:51:52.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:52.640+0000 7f3fea9f7640 1 -- 172.21.15.79:0/1962832156 shutdown_connections 2024-08-20T01:51:52.645 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:51:52.640+0000 7f3fea9f7640 1 -- 172.21.15.79:0/1962832156 wait complete. 2024-08-20T01:51:54.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:53 smithi079 ceph-mon[18656]: pgmap v784: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 6.8 KiB/s wr, 23 op/s 2024-08-20T01:51:54.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:53 smithi081 ceph-mon[22209]: pgmap v784: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 6.8 KiB/s wr, 23 op/s 2024-08-20T01:51:54.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:53 smithi175 ceph-mon[22392]: pgmap v784: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 6.8 KiB/s wr, 23 op/s 2024-08-20T01:51:56.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:55 smithi079 ceph-mon[18656]: pgmap v785: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.7 KiB/s wr, 27 op/s 2024-08-20T01:51:56.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:55 smithi081 ceph-mon[22209]: pgmap v785: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.7 KiB/s wr, 27 op/s 2024-08-20T01:51:56.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:55 smithi175 ceph-mon[22392]: pgmap v785: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.7 KiB/s wr, 27 op/s 2024-08-20T01:51:58.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:57 smithi079 ceph-mon[18656]: pgmap v786: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 8.9 KiB/s wr, 27 op/s 2024-08-20T01:51:58.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:57 smithi081 ceph-mon[22209]: pgmap v786: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 8.9 KiB/s wr, 27 op/s 2024-08-20T01:51:58.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:57 smithi175 ceph-mon[22392]: pgmap v786: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 8.9 KiB/s wr, 27 op/s 2024-08-20T01:52:00.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:59 smithi081 ceph-mon[22209]: pgmap v787: 97 pgs: 97 active+clean; 10 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 7.7 KiB/s wr, 26 op/s 2024-08-20T01:52:00.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:51:59 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:52:00.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:59 smithi175 ceph-mon[22392]: pgmap v787: 97 pgs: 97 active+clean; 10 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 7.7 KiB/s wr, 26 op/s 2024-08-20T01:52:00.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:51:59 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:52:00.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:59 smithi079 ceph-mon[18656]: pgmap v787: 97 pgs: 97 active+clean; 10 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 7.7 KiB/s wr, 26 op/s 2024-08-20T01:52:00.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:51:59 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:52:01.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:01 smithi081 ceph-mon[22209]: Health check update: 7 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-08-20T01:52:01.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:01 smithi175 ceph-mon[22392]: Health check update: 7 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-08-20T01:52:01.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:01 smithi079 ceph-mon[18656]: Health check update: 7 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-08-20T01:52:02.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:02 smithi081 ceph-mon[22209]: pgmap v788: 97 pgs: 97 active+clean; 10 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 7.3 KiB/s wr, 24 op/s 2024-08-20T01:52:02.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:02 smithi175 ceph-mon[22392]: pgmap v788: 97 pgs: 97 active+clean; 10 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 7.3 KiB/s wr, 24 op/s 2024-08-20T01:52:02.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:02 smithi079 ceph-mon[18656]: pgmap v788: 97 pgs: 97 active+clean; 10 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 7.3 KiB/s wr, 24 op/s 2024-08-20T01:52:04.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:04 smithi081 ceph-mon[22209]: pgmap v789: 97 pgs: 97 active+clean; 10 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 3.2 KiB/s wr, 19 op/s 2024-08-20T01:52:04.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:04 smithi175 ceph-mon[22392]: pgmap v789: 97 pgs: 97 active+clean; 10 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 3.2 KiB/s wr, 19 op/s 2024-08-20T01:52:04.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:04 smithi079 ceph-mon[18656]: pgmap v789: 97 pgs: 97 active+clean; 10 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 3.2 KiB/s wr, 19 op/s 2024-08-20T01:52:05.444 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:52:05.701 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:52:05.739 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.734+0000 7f96f50ee640 1 -- 172.21.15.79:0/255980541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96f01026b0 msgr2=0x7f96f0102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:05.739 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.734+0000 7f96f50ee640 1 --2- 172.21.15.79:0/255980541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96f01026b0 0x7f96f0102b30 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f96e4009930 tx=0x7f96e402a420 comp rx=0 tx=0).stop 2024-08-20T01:52:05.739 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.734+0000 7f96f50ee640 1 -- 172.21.15.79:0/255980541 shutdown_connections 2024-08-20T01:52:05.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.734+0000 7f96f50ee640 1 --2- 172.21.15.79:0/255980541 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96f0103070 0x7f96f01099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:05.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.734+0000 7f96f50ee640 1 --2- 172.21.15.79:0/255980541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96f01026b0 0x7f96f0102b30 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:05.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.734+0000 7f96f50ee640 1 --2- 172.21.15.79:0/255980541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96f0101560 0x7f96f0101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:05.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.734+0000 7f96f50ee640 1 -- 172.21.15.79:0/255980541 >> 172.21.15.79:0/255980541 conn(0x7f96f00fce40 msgr2=0x7f96f00ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:05.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.735+0000 7f96f50ee640 1 -- 172.21.15.79:0/255980541 shutdown_connections 2024-08-20T01:52:05.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.735+0000 7f96f50ee640 1 -- 172.21.15.79:0/255980541 wait complete. 2024-08-20T01:52:05.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.735+0000 7f96f50ee640 1 Processor -- start 2024-08-20T01:52:05.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.735+0000 7f96f50ee640 1 -- start start 2024-08-20T01:52:05.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.736+0000 7f96f50ee640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96f0101560 0x7f96f006ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:05.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.736+0000 7f96f50ee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96f01026b0 0x7f96f019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:05.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.736+0000 7f96f50ee640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96f0103070 0x7f96f019fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:05.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.736+0000 7f96f50ee640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f96f010d080 con 0x7f96f01026b0 2024-08-20T01:52:05.740 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.736+0000 7f96f50ee640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f96f010cf00 con 0x7f96f0103070 2024-08-20T01:52:05.741 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.736+0000 7f96f50ee640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f96f010d200 con 0x7f96f0101560 2024-08-20T01:52:05.741 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.736+0000 7f96eed9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96f0101560 0x7f96f006ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:05.741 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.736+0000 7f96ee59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96f01026b0 0x7f96f019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:05.741 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.736+0000 7f96eed9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96f0101560 0x7f96f006ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:60020/0 (socket says 172.21.15.79:60020) 2024-08-20T01:52:05.741 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.736+0000 7f96ee59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96f01026b0 0x7f96f019d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57966/0 (socket says 172.21.15.79:57966) 2024-08-20T01:52:05.741 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.736+0000 7f96eed9d640 1 -- 172.21.15.79:0/1865576301 learned_addr learned my addr 172.21.15.79:0/1865576301 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:05.741 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.736+0000 7f96ef59e640 1 --2- 172.21.15.79:0/1865576301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96f0103070 0x7f96f019fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:05.741 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.736+0000 7f96eed9d640 1 -- 172.21.15.79:0/1865576301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96f0103070 msgr2=0x7f96f019fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:05.741 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.736+0000 7f96eed9d640 1 --2- 172.21.15.79:0/1865576301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96f0103070 0x7f96f019fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:05.741 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.736+0000 7f96eed9d640 1 -- 172.21.15.79:0/1865576301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96f01026b0 msgr2=0x7f96f019d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:05.741 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.736+0000 7f96eed9d640 1 --2- 172.21.15.79:0/1865576301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96f01026b0 0x7f96f019d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:05.741 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.736+0000 7f96eed9d640 1 -- 172.21.15.79:0/1865576301 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96f01a0550 con 0x7f96f0101560 2024-08-20T01:52:05.742 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.736+0000 7f96eed9d640 1 --2- 172.21.15.79:0/1865576301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96f0101560 0x7f96f006ae80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f96e000e9f0 tx=0x7f96e000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:05.742 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.736+0000 7f96d7fff640 1 -- 172.21.15.79:0/1865576301 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e000cd80 con 0x7f96f0101560 2024-08-20T01:52:05.742 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.736+0000 7f96f50ee640 1 -- 172.21.15.79:0/1865576301 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96f01a0840 con 0x7f96f0101560 2024-08-20T01:52:05.742 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.736+0000 7f96d7fff640 1 -- 172.21.15.79:0/1865576301 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f96e00108c0 con 0x7f96f0101560 2024-08-20T01:52:05.742 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.736+0000 7f96f50ee640 1 -- 172.21.15.79:0/1865576301 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96f01a0de0 con 0x7f96f0101560 2024-08-20T01:52:05.742 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.736+0000 7f96d7fff640 1 -- 172.21.15.79:0/1865576301 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e0018780 con 0x7f96f0101560 2024-08-20T01:52:05.748 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.739+0000 7f96f7fbf740 1 Processor -- start 2024-08-20T01:52:05.748 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.739+0000 7f96f7fbf740 1 -- start start 2024-08-20T01:52:05.748 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.739+0000 7f96d7fff640 1 -- 172.21.15.79:0/1865576301 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f96e0010430 con 0x7f96f0101560 2024-08-20T01:52:05.748 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.739+0000 7f96f7fbf740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e1af28d0 0x5650e1af4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:05.748 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.739+0000 7f96f7fbf740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650e1af5200 0x5650e1af75f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:05.749 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.739+0000 7f96f7fbf740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650e1af7c40 0x5650e1afa100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:05.749 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.739+0000 7f96f7fbf740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5650e1a65360 con 0x5650e1af28d0 2024-08-20T01:52:05.749 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.739+0000 7f96f7fbf740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5650e1a54860 con 0x5650e1af5200 2024-08-20T01:52:05.749 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.739+0000 7f96f7fbf740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5650e1a588a0 con 0x5650e1af7c40 2024-08-20T01:52:05.749 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.739+0000 7f96ef59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e1af28d0 0x5650e1af4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:05.749 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.739+0000 7f96ef59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e1af28d0 0x5650e1af4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57972/0 (socket says 172.21.15.79:57972) 2024-08-20T01:52:05.749 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.739+0000 7f96ef59e640 1 -- 172.21.15.79:0/1385779194 learned_addr learned my addr 172.21.15.79:0/1385779194 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:05.749 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.739+0000 7f96ee59c640 1 --2- 172.21.15.79:0/1385779194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650e1af7c40 0x5650e1afa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:05.749 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.739+0000 7f96eed9d640 1 --2- 172.21.15.79:0/1385779194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650e1af5200 0x5650e1af75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:05.749 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.739+0000 7f96ef59e640 1 -- 172.21.15.79:0/1385779194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650e1af7c40 msgr2=0x5650e1afa100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:05.749 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.739+0000 7f96ef59e640 1 --2- 172.21.15.79:0/1385779194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650e1af7c40 0x5650e1afa100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:05.749 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.739+0000 7f96ef59e640 1 -- 172.21.15.79:0/1385779194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650e1af5200 msgr2=0x5650e1af75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:05.749 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.739+0000 7f96ef59e640 1 --2- 172.21.15.79:0/1385779194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650e1af5200 0x5650e1af75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:05.750 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.739+0000 7f96ef59e640 1 -- 172.21.15.79:0/1385779194 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650e19fbe40 con 0x5650e1af28d0 2024-08-20T01:52:05.750 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.739+0000 7f96eed9d640 1 --2- 172.21.15.79:0/1385779194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650e1af5200 0x5650e1af75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:52:05.750 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.740+0000 7f96ef59e640 1 --2- 172.21.15.79:0/1385779194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e1af28d0 0x5650e1af4cc0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f96e8009fc0 tx=0x7f96e8010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bfe48b536b64355 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:05.750 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.740+0000 7f96d57fa640 1 -- 172.21.15.79:0/1385779194 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e8003b70 con 0x5650e1af28d0 2024-08-20T01:52:05.750 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.740+0000 7f96d7fff640 1 --2- 172.21.15.79:0/1865576301 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f96d80b3bd0 0x7f96d80b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:05.750 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.740+0000 7f96d57fa640 1 -- 172.21.15.79:0/1385779194 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f96e8003d10 con 0x5650e1af28d0 2024-08-20T01:52:05.750 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.740+0000 7f96d57fa640 1 -- 172.21.15.79:0/1385779194 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e8011980 con 0x5650e1af28d0 2024-08-20T01:52:05.750 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.740+0000 7f96eed9d640 1 --2- 172.21.15.79:0/1865576301 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f96d80b3bd0 0x7f96d80b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:05.750 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.740+0000 7f96d7fff640 1 -- 172.21.15.79:0/1865576301 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f96e00e3ff0 con 0x7f96f0101560 2024-08-20T01:52:05.750 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.740+0000 7f96f7fbf740 1 -- 172.21.15.79:0/1385779194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e1af28d0 msgr2=0x5650e1af4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:05.750 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.740+0000 7f96f7fbf740 1 --2- 172.21.15.79:0/1385779194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e1af28d0 0x5650e1af4cc0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f96e8009fc0 tx=0x7f96e8010860 comp rx=0 tx=0).stop 2024-08-20T01:52:05.750 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.740+0000 7f96eed9d640 1 --2- 172.21.15.79:0/1865576301 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f96d80b3bd0 0x7f96d80b6090 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f96e00aaee0 tx=0x7f96e0092040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:05.751 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.741+0000 7f96f7fbf740 1 -- 172.21.15.79:0/1385779194 shutdown_connections 2024-08-20T01:52:05.751 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.741+0000 7f96f7fbf740 1 --2- 172.21.15.79:0/1385779194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650e1af7c40 0x5650e1afa100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:05.751 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.741+0000 7f96f7fbf740 1 --2- 172.21.15.79:0/1385779194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650e1af5200 0x5650e1af75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:05.751 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.741+0000 7f96f7fbf740 1 --2- 172.21.15.79:0/1385779194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e1af28d0 0x5650e1af4cc0 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:05.751 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.741+0000 7f96f7fbf740 1 -- 172.21.15.79:0/1385779194 >> 172.21.15.79:0/1385779194 conn(0x5650e1aeda20 msgr2=0x5650e1aee7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:05.751 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.741+0000 7f96f7fbf740 1 -- 172.21.15.79:0/1385779194 shutdown_connections 2024-08-20T01:52:05.751 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.741+0000 7f96f7fbf740 1 -- 172.21.15.79:0/1385779194 wait complete. 2024-08-20T01:52:05.751 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.741+0000 7f96f7fbf740 1 -- start start 2024-08-20T01:52:05.751 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.741+0000 7f96f7fbf740 1 Processor -- start 2024-08-20T01:52:05.751 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.741+0000 7f96f7fbf740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e1af28d0 0x5650e1afc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:05.751 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.741+0000 7f96f7fbf740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650e1af5200 0x5650e1afc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:05.751 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.741+0000 7f96f7fbf740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650e1af7c40 0x5650e1afd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:05.751 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.741+0000 7f96f7fbf740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5650e198dab0 con 0x5650e1af28d0 2024-08-20T01:52:05.752 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.741+0000 7f96f7fbf740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5650e19db780 con 0x5650e1af5200 2024-08-20T01:52:05.752 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.741+0000 7f96f7fbf740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5650e1afac20 con 0x5650e1af7c40 2024-08-20T01:52:05.752 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.741+0000 7f96f7fbf740 10 client.0 _ll_register_callbacks cb 0x5650e1763a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:52:05.752 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.741+0000 7f96ef59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e1af28d0 0x5650e1afc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:05.752 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.741+0000 7f96ef59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e1af28d0 0x5650e1afc170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57986/0 (socket says 172.21.15.79:57986) 2024-08-20T01:52:05.752 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.741+0000 7f96ef59e640 1 -- 172.21.15.79:0/1230713342 learned_addr learned my addr 172.21.15.79:0/1230713342 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:05.752 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.741+0000 7f96ee59c640 1 --2- 172.21.15.79:0/1230713342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650e1af5200 0x5650e1afc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:05.752 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.741+0000 7f96ef59e640 1 --2- 172.21.15.79:0/1230713342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650e1af7c40 0x5650e1afd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:05.752 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.742+0000 7f96ef59e640 1 -- 172.21.15.79:0/1230713342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650e1af7c40 msgr2=0x5650e1afd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:05.752 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.742+0000 7f96ef59e640 1 --2- 172.21.15.79:0/1230713342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650e1af7c40 0x5650e1afd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:05.752 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.742+0000 7f96ef59e640 1 -- 172.21.15.79:0/1230713342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650e1af5200 msgr2=0x5650e1afc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:05.752 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.742+0000 7f96ef59e640 1 --2- 172.21.15.79:0/1230713342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650e1af5200 0x5650e1afc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:05.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.742+0000 7f96ef59e640 1 -- 172.21.15.79:0/1230713342 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650e17b7790 con 0x5650e1af28d0 2024-08-20T01:52:05.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.742+0000 7f96ef59e640 1 --2- 172.21.15.79:0/1230713342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e1af28d0 0x5650e1afc170 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f96e80048f0 tx=0x7f96e8009280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4af8e9d98b9f38df server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:05.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.742+0000 7f96d2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:52:05.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.742+0000 7f96d2ff5640 1 -- 172.21.15.79:0/1230713342 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e8005040 con 0x5650e1af28d0 2024-08-20T01:52:05.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.742+0000 7f96d2ff5640 1 -- 172.21.15.79:0/1230713342 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f96e80051e0 con 0x5650e1af28d0 2024-08-20T01:52:05.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.742+0000 7f96f7fbf740 1 -- 172.21.15.79:0/1230713342 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5650e1a03e00 con 0x5650e1af28d0 2024-08-20T01:52:05.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.742+0000 7f96d2ff5640 1 -- 172.21.15.79:0/1230713342 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f96e8032050 con 0x5650e1af28d0 2024-08-20T01:52:05.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.742+0000 7f96f7fbf740 10 client.19104 fetch_fsmap learned FSMap version 61 2024-08-20T01:52:05.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.742+0000 7f96f7fbf740 1 -- 172.21.15.79:0/1230713342 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x5650e1830620 con 0x5650e1af28d0 2024-08-20T01:52:05.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.742+0000 7f96d2ff5640 1 -- 172.21.15.79:0/1230713342 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5650e1a03e00 con 0x5650e1af28d0 2024-08-20T01:52:05.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.742+0000 7f96d2ff5640 1 -- 172.21.15.79:0/1230713342 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 61) ==== 8410+0+0 (secure 0 0 0) 0x7f96e8029070 con 0x5650e1af28d0 2024-08-20T01:52:05.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.743+0000 7f96f7fbf740 10 client.19104 fetch_fsmap finished waiting for FSMap version 61 2024-08-20T01:52:05.753 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.743+0000 7f96f7fbf740 10 client.19104 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:52:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.743+0000 7f96f7fbf740 20 client.19104 populate_metadata read hostname 'smithi079' 2024-08-20T01:52:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.743+0000 7f96f7fbf740 1 --2- 172.21.15.79:0/1230713342 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5650e1b07720 0x5650e1b09b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.743+0000 7f96f7fbf740 4 client.19104 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:52:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.743+0000 7f96f7fbf740 1 -- 172.21.15.79:0/1230713342 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5650e1a672b0 con 0x5650e1b07720 2024-08-20T01:52:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.743+0000 7f96ee59c640 1 --2- 172.21.15.79:0/1230713342 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5650e1b07720 0x5650e1b09b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.743+0000 7f96d2ff5640 10 client.19104 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:52:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.743+0000 7f96ee59c640 1 --2- 172.21.15.79:0/1230713342 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5650e1b07720 0x5650e1b09b10 crc :-1 s=READY pgs=306 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6ec2dd6dbbd6009 server_cookie=a97fa84a52073e71 in_seq=0 out_seq=0 2024-08-20T01:52:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.744+0000 7f96d2ff5640 1 -- 172.21.15.79:0/1230713342 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5650e1a672b0 con 0x5650e1b07720 2024-08-20T01:52:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.744+0000 7f96d2ff5640 10 client.19104 handle_command_reply: tid=0 2024-08-20T01:52:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.744+0000 7f96f7fbf740 1 client.19104 shutdown 2024-08-20T01:52:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.744+0000 7f96f7fbf740 1 -- 172.21.15.79:0/1230713342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e1af28d0 msgr2=0x5650e1afc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.744+0000 7f96f7fbf740 1 --2- 172.21.15.79:0/1230713342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e1af28d0 0x5650e1afc170 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f96e80048f0 tx=0x7f96e8009280 comp rx=0 tx=0).stop 2024-08-20T01:52:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.744+0000 7f96f7fbf740 1 -- 172.21.15.79:0/1230713342 shutdown_connections 2024-08-20T01:52:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.744+0000 7f96f7fbf740 1 --2- 172.21.15.79:0/1230713342 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5650e1b07720 0x5650e1b09b10 crc :-1 s=READY pgs=306 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.744+0000 7f96f7fbf740 1 --2- 172.21.15.79:0/1230713342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650e1af7c40 0x5650e1afd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.744+0000 7f96f7fbf740 1 --2- 172.21.15.79:0/1230713342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650e1af5200 0x5650e1afc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.744+0000 7f96f7fbf740 1 --2- 172.21.15.79:0/1230713342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e1af28d0 0x5650e1afc170 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.744+0000 7f96d2ff5640 0 client.19104 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:52:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.744+0000 7f96f7fbf740 1 -- 172.21.15.79:0/1230713342 >> 172.21.15.79:0/1230713342 conn(0x5650e1aeda20 msgr2=0x5650e1aecae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.744+0000 7f96f7fbf740 1 -- 172.21.15.79:0/1230713342 shutdown_connections 2024-08-20T01:52:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.744+0000 7f96f7fbf740 1 -- 172.21.15.79:0/1230713342 wait complete. 2024-08-20T01:52:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.744+0000 7f96f7fbf740 20 client.19104 trim_cache size 0 max 16384 2024-08-20T01:52:05.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.758+0000 7f96f7fbf740 1 Processor -- start 2024-08-20T01:52:05.765 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.758+0000 7f96f7fbf740 1 -- start start 2024-08-20T01:52:05.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.758+0000 7f96f7fbf740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e1af28d0 0x5650e1afbee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:05.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.758+0000 7f96f7fbf740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650e1af5200 0x5650e1af8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:05.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.758+0000 7f96f7fbf740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650e1af7c40 0x5650e1af8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:05.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.758+0000 7f96f7fbf740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f96f01a9ac0 con 0x5650e1af28d0 2024-08-20T01:52:05.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.758+0000 7f96f7fbf740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f96f01ab7e0 con 0x5650e1af5200 2024-08-20T01:52:05.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.758+0000 7f96f7fbf740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f96f01aa1f0 con 0x5650e1af7c40 2024-08-20T01:52:05.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.759+0000 7f96ef59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e1af28d0 0x5650e1afbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:05.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.759+0000 7f96ef59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e1af28d0 0x5650e1afbee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57994/0 (socket says 172.21.15.79:57994) 2024-08-20T01:52:05.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.759+0000 7f96ef59e640 1 -- 172.21.15.79:0/3818234924 learned_addr learned my addr 172.21.15.79:0/3818234924 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:05.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.759+0000 7f96ee59c640 1 --2- 172.21.15.79:0/3818234924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650e1af5200 0x5650e1af8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:05.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.759+0000 7f96ef59e640 1 --2- 172.21.15.79:0/3818234924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650e1af7c40 0x5650e1af8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:05.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.759+0000 7f96ee59c640 1 -- 172.21.15.79:0/3818234924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650e1af7c40 msgr2=0x5650e1af8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:05.766 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.759+0000 7f96ee59c640 1 --2- 172.21.15.79:0/3818234924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650e1af7c40 0x5650e1af8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:05.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.759+0000 7f96ee59c640 1 -- 172.21.15.79:0/3818234924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e1af28d0 msgr2=0x5650e1afbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:05.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.759+0000 7f96ee59c640 1 --2- 172.21.15.79:0/3818234924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e1af28d0 0x5650e1afbee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:05.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.759+0000 7f96ee59c640 1 -- 172.21.15.79:0/3818234924 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650e1afd750 con 0x5650e1af5200 2024-08-20T01:52:05.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.759+0000 7f96ef59e640 1 --2- 172.21.15.79:0/3818234924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e1af28d0 0x5650e1afbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:52:05.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.759+0000 7f96ee59c640 1 --2- 172.21.15.79:0/3818234924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650e1af5200 0x5650e1af8020 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f96e4009900 tx=0x7f96e4004350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48440f9537a710cb server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:05.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.759+0000 7f96d4ff9640 1 -- 172.21.15.79:0/3818234924 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e4035040 con 0x5650e1af5200 2024-08-20T01:52:05.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.759+0000 7f96d4ff9640 1 -- 172.21.15.79:0/3818234924 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f96e40044c0 con 0x5650e1af5200 2024-08-20T01:52:05.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.759+0000 7f96d4ff9640 1 -- 172.21.15.79:0/3818234924 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e4003bc0 con 0x5650e1af5200 2024-08-20T01:52:05.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.760+0000 7f96f7fbf740 1 -- 172.21.15.79:0/3818234924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650e1af5200 msgr2=0x5650e1af8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:05.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.760+0000 7f96f7fbf740 1 --2- 172.21.15.79:0/3818234924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650e1af5200 0x5650e1af8020 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f96e4009900 tx=0x7f96e4004350 comp rx=0 tx=0).stop 2024-08-20T01:52:05.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.760+0000 7f96f7fbf740 1 -- 172.21.15.79:0/3818234924 shutdown_connections 2024-08-20T01:52:05.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.760+0000 7f96f7fbf740 1 --2- 172.21.15.79:0/3818234924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650e1af7c40 0x5650e1af8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:05.767 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.760+0000 7f96f7fbf740 1 --2- 172.21.15.79:0/3818234924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650e1af5200 0x5650e1af8020 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:05.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.760+0000 7f96f7fbf740 1 --2- 172.21.15.79:0/3818234924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e1af28d0 0x5650e1afbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:05.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.760+0000 7f96f7fbf740 1 -- 172.21.15.79:0/3818234924 >> 172.21.15.79:0/3818234924 conn(0x5650e1aeda20 msgr2=0x5650e1af9770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:05.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.760+0000 7f96f7fbf740 1 -- 172.21.15.79:0/3818234924 shutdown_connections 2024-08-20T01:52:05.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.760+0000 7f96f7fbf740 1 -- 172.21.15.79:0/3818234924 wait complete. 2024-08-20T01:52:05.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.760+0000 7f96f7fbf740 1 -- start start 2024-08-20T01:52:05.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.760+0000 7f96f7fbf740 1 Processor -- start 2024-08-20T01:52:05.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.760+0000 7f96f7fbf740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e1af28d0 0x5650e1b03a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:05.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.760+0000 7f96f7fbf740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650e1af5200 0x5650e1b02700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:05.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.760+0000 7f96f7fbf740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650e1af7c40 0x5650e1b02c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:05.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.760+0000 7f96f7fbf740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f96f01ab050 con 0x5650e1af28d0 2024-08-20T01:52:05.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.760+0000 7f96f7fbf740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f96f01aa950 con 0x5650e1af5200 2024-08-20T01:52:05.768 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.760+0000 7f96f7fbf740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f96f01a7aa0 con 0x5650e1af7c40 2024-08-20T01:52:05.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.760+0000 7f96f7fbf740 10 client.0 _ll_register_callbacks cb 0x7f96e80093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:52:05.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.760+0000 7f96ef59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e1af28d0 0x5650e1b03a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:05.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.760+0000 7f96ee59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650e1af5200 0x5650e1b02700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:05.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.761+0000 7f96ef59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e1af28d0 0x5650e1b03a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58002/0 (socket says 172.21.15.79:58002) 2024-08-20T01:52:05.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.761+0000 7f96ee59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650e1af5200 0x5650e1b02700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:48744/0 (socket says 172.21.15.79:48744) 2024-08-20T01:52:05.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.761+0000 7f96ef59e640 1 -- 172.21.15.79:0/1403787868 learned_addr learned my addr 172.21.15.79:0/1403787868 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:05.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.761+0000 7f96ef59e640 1 --2- 172.21.15.79:0/1403787868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650e1af7c40 0x5650e1b02c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:05.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.761+0000 7f96ee59c640 1 -- 172.21.15.79:0/1403787868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650e1af7c40 msgr2=0x5650e1b02c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:05.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.761+0000 7f96ee59c640 1 --2- 172.21.15.79:0/1403787868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650e1af7c40 0x5650e1b02c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:05.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.761+0000 7f96ee59c640 1 -- 172.21.15.79:0/1403787868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e1af28d0 msgr2=0x5650e1b03a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:05.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.761+0000 7f96ee59c640 1 --2- 172.21.15.79:0/1403787868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e1af28d0 0x5650e1b03a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:05.769 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.761+0000 7f96ee59c640 1 -- 172.21.15.79:0/1403787868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650e1b03200 con 0x5650e1af5200 2024-08-20T01:52:05.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.761+0000 7f96ef59e640 1 --2- 172.21.15.79:0/1403787868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e1af28d0 0x5650e1b03a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:52:05.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.761+0000 7f96ee59c640 1 --2- 172.21.15.79:0/1403787868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650e1af5200 0x5650e1b02700 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f96e4009900 tx=0x7f96e402a420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7535d0b06b5a64fe server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:05.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.761+0000 7f96d2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:52:05.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.761+0000 7f96d2ff5640 1 -- 172.21.15.79:0/1403787868 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e4053030 con 0x5650e1af5200 2024-08-20T01:52:05.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.761+0000 7f96f7fbf740 1 -- 172.21.15.79:0/1403787868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5650e1a62d50 con 0x5650e1af5200 2024-08-20T01:52:05.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.761+0000 7f96d2ff5640 1 -- 172.21.15.79:0/1403787868 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f96e4003c90 con 0x5650e1af5200 2024-08-20T01:52:05.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.761+0000 7f96d2ff5640 1 -- 172.21.15.79:0/1403787868 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f96e4035040 con 0x5650e1af5200 2024-08-20T01:52:05.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.761+0000 7f96f7fbf740 10 client.28220 fetch_fsmap learned FSMap version 61 2024-08-20T01:52:05.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.761+0000 7f96f7fbf740 1 -- 172.21.15.79:0/1403787868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x5650e1b02050 con 0x5650e1af5200 2024-08-20T01:52:05.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.761+0000 7f96d2ff5640 1 -- 172.21.15.79:0/1403787868 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5650e1a62d50 con 0x5650e1af5200 2024-08-20T01:52:05.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.762+0000 7f96d2ff5640 1 -- 172.21.15.79:0/1403787868 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 61) ==== 8410+0+0 (secure 0 0 0) 0x7f96e40463c0 con 0x5650e1af5200 2024-08-20T01:52:05.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.762+0000 7f96f7fbf740 10 client.28220 fetch_fsmap finished waiting for FSMap version 61 2024-08-20T01:52:05.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.762+0000 7f96f7fbf740 10 client.28220 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:52:05.770 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.762+0000 7f96f7fbf740 20 client.28220 populate_metadata read hostname 'smithi079' 2024-08-20T01:52:05.771 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.762+0000 7f96f7fbf740 1 --2- 172.21.15.79:0/1403787868 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5650e1b72bc0 0x5650e1b74fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:05.771 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.762+0000 7f96f7fbf740 4 client.28220 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:52:05.771 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.762+0000 7f96f7fbf740 1 -- 172.21.15.79:0/1403787868 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5650e1a60490 con 0x5650e1b72bc0 2024-08-20T01:52:05.771 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.762+0000 7f96ef59e640 1 --2- 172.21.15.79:0/1403787868 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5650e1b72bc0 0x5650e1b74fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:05.771 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.762+0000 7f96d2ff5640 10 client.28220 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:52:05.771 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:05.762+0000 7f96ef59e640 1 --2- 172.21.15.79:0/1403787868 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5650e1b72bc0 0x5650e1b74fe0 crc :-1 s=READY pgs=307 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47c2b400e06599d9 server_cookie=821f09ba7ef5906d in_seq=0 out_seq=0 2024-08-20T01:52:06.100 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:06 smithi079 ceph-mon[18656]: pgmap v790: 97 pgs: 97 active+clean; 9.9 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.4 KiB/s wr, 21 op/s 2024-08-20T01:52:06.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.180+0000 7f04122cd640 1 -- 172.21.15.79:0/1140219054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f040c1073a0 msgr2=0x7f040c1077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:06.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.180+0000 7f04122cd640 1 --2- 172.21.15.79:0/1140219054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f040c1073a0 0x7f040c1077e0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f0400009900 tx=0x7f040002a410 comp rx=0 tx=0).stop 2024-08-20T01:52:06.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.180+0000 7f04122cd640 1 -- 172.21.15.79:0/1140219054 shutdown_connections 2024-08-20T01:52:06.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.180+0000 7f04122cd640 1 --2- 172.21.15.79:0/1140219054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f040c107d20 0x7f040c10e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:06.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.180+0000 7f04122cd640 1 --2- 172.21.15.79:0/1140219054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f040c1073a0 0x7f040c1077e0 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:06.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.180+0000 7f04122cd640 1 --2- 172.21.15.79:0/1140219054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f040c101990 0x7f040c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:06.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.180+0000 7f04122cd640 1 -- 172.21.15.79:0/1140219054 >> 172.21.15.79:0/1140219054 conn(0x7f040c0fd400 msgr2=0x7f040c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:06.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.180+0000 7f04122cd640 1 -- 172.21.15.79:0/1140219054 shutdown_connections 2024-08-20T01:52:06.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.180+0000 7f04122cd640 1 -- 172.21.15.79:0/1140219054 wait complete. 2024-08-20T01:52:06.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.181+0000 7f04122cd640 1 Processor -- start 2024-08-20T01:52:06.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.181+0000 7f04122cd640 1 -- start start 2024-08-20T01:52:06.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.181+0000 7f04122cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f040c101990 0x7f040c0fd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:06.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.181+0000 7f04122cd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f040c1073a0 0x7f040c0fde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:06.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.181+0000 7f04122cd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f040c107d20 0x7f040c0fe380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:06.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.181+0000 7f04122cd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f040c111820 con 0x7f040c1073a0 2024-08-20T01:52:06.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.181+0000 7f04122cd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f040c1116a0 con 0x7f040c101990 2024-08-20T01:52:06.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.181+0000 7f04122cd640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f040c1119a0 con 0x7f040c107d20 2024-08-20T01:52:06.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.181+0000 7f040b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f040c1073a0 0x7f040c0fde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:06.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.181+0000 7f040bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f040c101990 0x7f040c0fd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:06.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.181+0000 7f040b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f040c1073a0 0x7f040c0fde40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58018/0 (socket says 172.21.15.79:58018) 2024-08-20T01:52:06.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.181+0000 7f040b7fe640 1 -- 172.21.15.79:0/294106607 learned_addr learned my addr 172.21.15.79:0/294106607 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:06.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.182+0000 7f041086a640 1 --2- 172.21.15.79:0/294106607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f040c107d20 0x7f040c0fe380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:06.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.182+0000 7f040b7fe640 1 -- 172.21.15.79:0/294106607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f040c107d20 msgr2=0x7f040c0fe380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:06.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.182+0000 7f040b7fe640 1 --2- 172.21.15.79:0/294106607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f040c107d20 0x7f040c0fe380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:06.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.182+0000 7f040b7fe640 1 -- 172.21.15.79:0/294106607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f040c101990 msgr2=0x7f040c0fd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:06.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.182+0000 7f040b7fe640 1 --2- 172.21.15.79:0/294106607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f040c101990 0x7f040c0fd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:06.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.182+0000 7f040b7fe640 1 -- 172.21.15.79:0/294106607 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f040c1a7320 con 0x7f040c1073a0 2024-08-20T01:52:06.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.182+0000 7f041086a640 1 --2- 172.21.15.79:0/294106607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f040c107d20 0x7f040c0fe380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:52:06.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.182+0000 7f040b7fe640 1 --2- 172.21.15.79:0/294106607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f040c1073a0 0x7f040c0fde40 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f0400009230 tx=0x7f04000319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:06.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.182+0000 7f04097fa640 1 -- 172.21.15.79:0/294106607 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f040003f030 con 0x7f040c1073a0 2024-08-20T01:52:06.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.182+0000 7f04097fa640 1 -- 172.21.15.79:0/294106607 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f04000043d0 con 0x7f040c1073a0 2024-08-20T01:52:06.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.182+0000 7f04122cd640 1 -- 172.21.15.79:0/294106607 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f040c1a75b0 con 0x7f040c1073a0 2024-08-20T01:52:06.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.182+0000 7f04097fa640 1 -- 172.21.15.79:0/294106607 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0400035070 con 0x7f040c1073a0 2024-08-20T01:52:06.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.182+0000 7f04122cd640 1 -- 172.21.15.79:0/294106607 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f040c1a7a90 con 0x7f040c1073a0 2024-08-20T01:52:06.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.185+0000 7f04097fa640 1 -- 172.21.15.79:0/294106607 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f0400042030 con 0x7f040c1073a0 2024-08-20T01:52:06.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.185+0000 7f04146c6740 1 Processor -- start 2024-08-20T01:52:06.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.185+0000 7f04146c6740 1 -- start start 2024-08-20T01:52:06.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.185+0000 7f04146c6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343186a830 0x56343186ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:06.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.185+0000 7f04146c6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56343186b150 0x563431876ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:06.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.185+0000 7f04146c6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634318770e0 0x5634318794d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:06.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.185+0000 7f04146c6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5634317e18e0 con 0x5634318770e0 2024-08-20T01:52:06.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.185+0000 7f04146c6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5634317d0de0 con 0x56343186a830 2024-08-20T01:52:06.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.185+0000 7f04146c6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5634317d4e20 con 0x56343186b150 2024-08-20T01:52:06.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.185+0000 7f040b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634318770e0 0x5634318794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:06.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.185+0000 7f041086a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343186a830 0x56343186ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:06.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.185+0000 7f041086a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343186a830 0x56343186ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:48786/0 (socket says 172.21.15.79:48786) 2024-08-20T01:52:06.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.185+0000 7f040bfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56343186b150 0x563431876ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:06.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.185+0000 7f041086a640 1 -- 172.21.15.79:0/3770229394 learned_addr learned my addr 172.21.15.79:0/3770229394 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:06.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.185+0000 7f040b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634318770e0 0x5634318794d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58022/0 (socket says 172.21.15.79:58022) 2024-08-20T01:52:06.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.185+0000 7f041086a640 1 -- 172.21.15.79:0/3770229394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56343186b150 msgr2=0x563431876ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:06.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.185+0000 7f041086a640 1 --2- 172.21.15.79:0/3770229394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56343186b150 0x563431876ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:06.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.185+0000 7f041086a640 1 -- 172.21.15.79:0/3770229394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634318770e0 msgr2=0x5634318794d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:06.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.185+0000 7f041086a640 1 --2- 172.21.15.79:0/3770229394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634318770e0 0x5634318794d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:06.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.185+0000 7f041086a640 1 -- 172.21.15.79:0/3770229394 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563431530650 con 0x56343186a830 2024-08-20T01:52:06.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.186+0000 7f04097fa640 1 --2- 172.21.15.79:0/294106607 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f03f40b3bd0 0x7f03f40b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:06.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.186+0000 7f041086a640 1 --2- 172.21.15.79:0/3770229394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343186a830 0x56343186ac10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0404010450 tx=0x7f0404010910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c61c68ef4debfdc9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:06.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.186+0000 7f040bfff640 1 --2- 172.21.15.79:0/294106607 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f03f40b3bd0 0x7f03f40b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:06.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.186+0000 7f03f27fc640 1 -- 172.21.15.79:0/3770229394 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0404017070 con 0x56343186a830 2024-08-20T01:52:06.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.186+0000 7f03f27fc640 1 -- 172.21.15.79:0/3770229394 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0404011bf0 con 0x56343186a830 2024-08-20T01:52:06.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.186+0000 7f03f27fc640 1 -- 172.21.15.79:0/3770229394 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f040401bc20 con 0x56343186a830 2024-08-20T01:52:06.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.186+0000 7f04097fa640 1 -- 172.21.15.79:0/294106607 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f0400103fc0 con 0x7f040c1073a0 2024-08-20T01:52:06.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.187+0000 7f04146c6740 1 -- 172.21.15.79:0/3770229394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343186a830 msgr2=0x56343186ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:06.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.187+0000 7f04146c6740 1 --2- 172.21.15.79:0/3770229394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343186a830 0x56343186ac10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0404010450 tx=0x7f0404010910 comp rx=0 tx=0).stop 2024-08-20T01:52:06.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.187+0000 7f040bfff640 1 --2- 172.21.15.79:0/294106607 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f03f40b3bd0 0x7f03f40b6090 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x56343186d9b0 tx=0x7f03fc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:06.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.187+0000 7f04146c6740 1 -- 172.21.15.79:0/3770229394 shutdown_connections 2024-08-20T01:52:06.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.187+0000 7f04146c6740 1 --2- 172.21.15.79:0/3770229394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5634318770e0 0x5634318794d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:06.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.187+0000 7f04146c6740 1 --2- 172.21.15.79:0/3770229394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56343186b150 0x563431876ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:06.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.187+0000 7f04146c6740 1 --2- 172.21.15.79:0/3770229394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343186a830 0x56343186ac10 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:06.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.187+0000 7f04146c6740 1 -- 172.21.15.79:0/3770229394 >> 172.21.15.79:0/3770229394 conn(0x563431868660 msgr2=0x563431869800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:06.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.187+0000 7f04146c6740 1 -- 172.21.15.79:0/3770229394 shutdown_connections 2024-08-20T01:52:06.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.187+0000 7f04146c6740 1 -- 172.21.15.79:0/3770229394 wait complete. 2024-08-20T01:52:06.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.187+0000 7f04146c6740 1 -- start start 2024-08-20T01:52:06.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.187+0000 7f04146c6740 1 Processor -- start 2024-08-20T01:52:06.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.188+0000 7f04146c6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56343186a830 0x563431874060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:06.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.188+0000 7f04146c6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343186b150 0x5634318745a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:06.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.188+0000 7f04146c6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634318770e0 0x563431874ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:06.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.188+0000 7f04146c6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563431633700 con 0x56343186a830 2024-08-20T01:52:06.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.188+0000 7f04146c6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5634317577c0 con 0x56343186b150 2024-08-20T01:52:06.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.188+0000 7f04146c6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563431879d90 con 0x5634318770e0 2024-08-20T01:52:06.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.188+0000 7f04146c6740 10 client.0 _ll_register_callbacks cb 0x5634317ca6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:52:06.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.188+0000 7f040b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343186b150 0x5634318745a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:06.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.188+0000 7f040bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56343186a830 0x563431874060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:06.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.188+0000 7f040b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343186b150 0x5634318745a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:48794/0 (socket says 172.21.15.79:48794) 2024-08-20T01:52:06.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.188+0000 7f040b7fe640 1 -- 172.21.15.79:0/1531837924 learned_addr learned my addr 172.21.15.79:0/1531837924 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:06.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.188+0000 7f041086a640 1 --2- 172.21.15.79:0/1531837924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634318770e0 0x563431874ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:06.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.188+0000 7f040bfff640 1 -- 172.21.15.79:0/1531837924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634318770e0 msgr2=0x563431874ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:06.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.188+0000 7f040bfff640 1 --2- 172.21.15.79:0/1531837924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634318770e0 0x563431874ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:06.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.188+0000 7f040bfff640 1 -- 172.21.15.79:0/1531837924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343186b150 msgr2=0x5634318745a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:06.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.188+0000 7f040bfff640 1 --2- 172.21.15.79:0/1531837924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343186b150 0x5634318745a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:06.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.188+0000 7f040bfff640 1 -- 172.21.15.79:0/1531837924 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563431883170 con 0x56343186a830 2024-08-20T01:52:06.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.188+0000 7f041086a640 1 --2- 172.21.15.79:0/1531837924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634318770e0 0x563431874ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:52:06.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.188+0000 7f040b7fe640 1 --2- 172.21.15.79:0/1531837924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343186b150 0x5634318745a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:52:06.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.188+0000 7f040bfff640 1 --2- 172.21.15.79:0/1531837924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56343186a830 0x563431874060 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f03fc012cb0 tx=0x7f03fc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f737d22b06b7708 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:06.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.188+0000 7f03eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:52:06.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.188+0000 7f03eb7fe640 1 -- 172.21.15.79:0/1531837924 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03fc01f640 con 0x56343186a830 2024-08-20T01:52:06.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.188+0000 7f03eb7fe640 1 -- 172.21.15.79:0/1531837924 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f03fc01f7e0 con 0x56343186a830 2024-08-20T01:52:06.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.188+0000 7f04146c6740 1 -- 172.21.15.79:0/1531837924 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563431780100 con 0x56343186a830 2024-08-20T01:52:06.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.189+0000 7f03eb7fe640 1 -- 172.21.15.79:0/1531837924 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f03fc01f9e0 con 0x56343186a830 2024-08-20T01:52:06.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.189+0000 7f04146c6740 10 client.19122 fetch_fsmap learned FSMap version 61 2024-08-20T01:52:06.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.189+0000 7f04146c6740 1 -- 172.21.15.79:0/1531837924 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x563431885b60 con 0x56343186a830 2024-08-20T01:52:06.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.189+0000 7f03eb7fe640 1 -- 172.21.15.79:0/1531837924 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x563431780100 con 0x56343186a830 2024-08-20T01:52:06.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.189+0000 7f03eb7fe640 1 -- 172.21.15.79:0/1531837924 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 61) ==== 8410+0+0 (secure 0 0 0) 0x7f03fc027070 con 0x56343186a830 2024-08-20T01:52:06.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.189+0000 7f04146c6740 10 client.19122 fetch_fsmap finished waiting for FSMap version 61 2024-08-20T01:52:06.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.189+0000 7f04146c6740 10 client.19122 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:52:06.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.189+0000 7f04146c6740 20 client.19122 populate_metadata read hostname 'smithi079' 2024-08-20T01:52:06.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.189+0000 7f04146c6740 1 --2- 172.21.15.79:0/1531837924 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x563431886fc0 0x563431889430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:06.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.189+0000 7f04146c6740 4 client.19122 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:52:06.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.189+0000 7f04146c6740 1 -- 172.21.15.79:0/1531837924 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5634317e3830 con 0x563431886fc0 2024-08-20T01:52:06.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.189+0000 7f040b7fe640 1 --2- 172.21.15.79:0/1531837924 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x563431886fc0 0x563431889430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:06.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.189+0000 7f040b7fe640 1 --2- 172.21.15.79:0/1531837924 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x563431886fc0 0x563431889430 crc :-1 s=READY pgs=308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdb7ee6f7630ca86 server_cookie=1491d4b99202c0df in_seq=0 out_seq=0 2024-08-20T01:52:06.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.189+0000 7f03eb7fe640 10 client.19122 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:52:06.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.190+0000 7f03eb7fe640 1 -- 172.21.15.79:0/1531837924 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5634317e3830 con 0x563431886fc0 2024-08-20T01:52:06.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.190+0000 7f03eb7fe640 10 client.19122 handle_command_reply: tid=0 2024-08-20T01:52:06.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.190+0000 7f04146c6740 1 client.19122 shutdown 2024-08-20T01:52:06.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.190+0000 7f04146c6740 1 -- 172.21.15.79:0/1531837924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56343186a830 msgr2=0x563431874060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:06.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.190+0000 7f04146c6740 1 --2- 172.21.15.79:0/1531837924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56343186a830 0x563431874060 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f03fc012cb0 tx=0x7f03fc004730 comp rx=0 tx=0).stop 2024-08-20T01:52:06.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.190+0000 7f04146c6740 1 -- 172.21.15.79:0/1531837924 shutdown_connections 2024-08-20T01:52:06.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.190+0000 7f04146c6740 1 --2- 172.21.15.79:0/1531837924 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x563431886fc0 0x563431889430 crc :-1 s=READY pgs=308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:06.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.190+0000 7f04146c6740 1 --2- 172.21.15.79:0/1531837924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634318770e0 0x563431874ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:06.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.190+0000 7f04146c6740 1 --2- 172.21.15.79:0/1531837924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343186b150 0x5634318745a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:06.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.190+0000 7f04146c6740 1 --2- 172.21.15.79:0/1531837924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56343186a830 0x563431874060 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:06.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.190+0000 7f04146c6740 1 -- 172.21.15.79:0/1531837924 >> 172.21.15.79:0/1531837924 conn(0x563431868660 msgr2=0x56343186e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:06.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.190+0000 7f03eb7fe640 0 client.19122 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:52:06.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.190+0000 7f04146c6740 1 -- 172.21.15.79:0/1531837924 shutdown_connections 2024-08-20T01:52:06.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.190+0000 7f04146c6740 1 -- 172.21.15.79:0/1531837924 wait complete. 2024-08-20T01:52:06.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.191+0000 7f04146c6740 20 client.19122 trim_cache size 0 max 16384 2024-08-20T01:52:06.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.207+0000 7f04146c6740 1 Processor -- start 2024-08-20T01:52:06.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.208+0000 7f04146c6740 1 -- start start 2024-08-20T01:52:06.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.208+0000 7f04146c6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56343186a830 0x5634318738f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:06.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.208+0000 7f04146c6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343186b150 0x56343186e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:06.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.208+0000 7f04146c6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634318770e0 0x56343188ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:06.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.208+0000 7f04146c6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f040c1b01b0 con 0x56343186a830 2024-08-20T01:52:06.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.208+0000 7f04146c6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f040c1b1ed0 con 0x56343186b150 2024-08-20T01:52:06.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.208+0000 7f04146c6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f040c1b08e0 con 0x5634318770e0 2024-08-20T01:52:06.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.208+0000 7f040bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56343186a830 0x5634318738f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:06.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.208+0000 7f040bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56343186a830 0x5634318738f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58048/0 (socket says 172.21.15.79:58048) 2024-08-20T01:52:06.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.208+0000 7f040bfff640 1 -- 172.21.15.79:0/2865539309 learned_addr learned my addr 172.21.15.79:0/2865539309 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:06.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.208+0000 7f040b7fe640 1 --2- 172.21.15.79:0/2865539309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343186b150 0x56343186e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:06.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.208+0000 7f041086a640 1 --2- 172.21.15.79:0/2865539309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634318770e0 0x56343188ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:06.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.208+0000 7f040bfff640 1 -- 172.21.15.79:0/2865539309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634318770e0 msgr2=0x56343188ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:06.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.208+0000 7f040bfff640 1 --2- 172.21.15.79:0/2865539309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634318770e0 0x56343188ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:06.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.208+0000 7f040bfff640 1 -- 172.21.15.79:0/2865539309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343186b150 msgr2=0x56343186e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:06.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.208+0000 7f040bfff640 1 --2- 172.21.15.79:0/2865539309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343186b150 0x56343186e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:06.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.208+0000 7f040bfff640 1 -- 172.21.15.79:0/2865539309 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56343186af80 con 0x56343186a830 2024-08-20T01:52:06.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.208+0000 7f040bfff640 1 --2- 172.21.15.79:0/2865539309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56343186a830 0x5634318738f0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f03fc0092e0 tx=0x7f03fc009fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b717c7da18271c03 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:06.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.208+0000 7f03f1ffb640 1 -- 172.21.15.79:0/2865539309 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03fc003e50 con 0x56343186a830 2024-08-20T01:52:06.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.208+0000 7f03f1ffb640 1 -- 172.21.15.79:0/2865539309 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f03fc02f030 con 0x56343186a830 2024-08-20T01:52:06.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.209+0000 7f03f1ffb640 1 -- 172.21.15.79:0/2865539309 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03fc01fde0 con 0x56343186a830 2024-08-20T01:52:06.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.209+0000 7f04146c6740 1 -- 172.21.15.79:0/2865539309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56343186a830 msgr2=0x5634318738f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:06.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.209+0000 7f04146c6740 1 --2- 172.21.15.79:0/2865539309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56343186a830 0x5634318738f0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f03fc0092e0 tx=0x7f03fc009fc0 comp rx=0 tx=0).stop 2024-08-20T01:52:06.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.209+0000 7f04146c6740 1 -- 172.21.15.79:0/2865539309 shutdown_connections 2024-08-20T01:52:06.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.209+0000 7f04146c6740 1 --2- 172.21.15.79:0/2865539309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634318770e0 0x56343188ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:06.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.209+0000 7f04146c6740 1 --2- 172.21.15.79:0/2865539309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343186b150 0x56343186e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:06.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.209+0000 7f04146c6740 1 --2- 172.21.15.79:0/2865539309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56343186a830 0x5634318738f0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:06.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.209+0000 7f04146c6740 1 -- 172.21.15.79:0/2865539309 >> 172.21.15.79:0/2865539309 conn(0x563431868660 msgr2=0x56343186d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:06.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.209+0000 7f04146c6740 1 -- 172.21.15.79:0/2865539309 shutdown_connections 2024-08-20T01:52:06.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.209+0000 7f04146c6740 1 -- 172.21.15.79:0/2865539309 wait complete. 2024-08-20T01:52:06.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.209+0000 7f04146c6740 1 -- start start 2024-08-20T01:52:06.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.210+0000 7f04146c6740 1 Processor -- start 2024-08-20T01:52:06.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.210+0000 7f04146c6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343186a830 0x56343187f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:06.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.210+0000 7f04146c6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56343186b150 0x56343187a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:06.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.210+0000 7f04146c6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634318770e0 0x56343187a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:06.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.210+0000 7f04146c6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f040c1b1740 con 0x56343186b150 2024-08-20T01:52:06.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.210+0000 7f04146c6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f040c1b1040 con 0x56343186a830 2024-08-20T01:52:06.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.210+0000 7f04146c6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f040c1ae190 con 0x5634318770e0 2024-08-20T01:52:06.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.210+0000 7f04146c6740 10 client.0 _ll_register_callbacks cb 0x7f03fc009ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:52:06.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.210+0000 7f040b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56343186b150 0x56343187a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:06.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.210+0000 7f040b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56343186b150 0x56343187a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58058/0 (socket says 172.21.15.79:58058) 2024-08-20T01:52:06.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.210+0000 7f040bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343186a830 0x56343187f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:06.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.210+0000 7f040b7fe640 1 -- 172.21.15.79:0/3202900405 learned_addr learned my addr 172.21.15.79:0/3202900405 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:06.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.210+0000 7f041086a640 1 --2- 172.21.15.79:0/3202900405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634318770e0 0x56343187a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:06.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.210+0000 7f040bfff640 1 -- 172.21.15.79:0/3202900405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634318770e0 msgr2=0x56343187a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:06.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.210+0000 7f040bfff640 1 --2- 172.21.15.79:0/3202900405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634318770e0 0x56343187a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:06.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.210+0000 7f040bfff640 1 -- 172.21.15.79:0/3202900405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56343186b150 msgr2=0x56343187a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:06.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.210+0000 7f040bfff640 1 --2- 172.21.15.79:0/3202900405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56343186b150 0x56343187a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:06.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.210+0000 7f040bfff640 1 -- 172.21.15.79:0/3202900405 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634318efd00 con 0x56343186a830 2024-08-20T01:52:06.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.210+0000 7f040b7fe640 1 --2- 172.21.15.79:0/3202900405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56343186b150 0x56343187a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:52:06.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.211+0000 7f040bfff640 1 --2- 172.21.15.79:0/3202900405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343186a830 0x56343187f8b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f03fc029cf0 tx=0x7f03fc01f750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a1233357978e303 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:06.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.211+0000 7f03eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:52:06.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.211+0000 7f03eb7fe640 1 -- 172.21.15.79:0/3202900405 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03fc042060 con 0x56343186a830 2024-08-20T01:52:06.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.211+0000 7f03eb7fe640 1 -- 172.21.15.79:0/3202900405 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f03fc01d400 con 0x56343186a830 2024-08-20T01:52:06.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.211+0000 7f04146c6740 1 -- 172.21.15.79:0/3202900405 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03fc02f030 con 0x56343186a830 2024-08-20T01:52:06.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.211+0000 7f03eb7fe640 1 -- 172.21.15.79:0/3202900405 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f03fc0043e0 con 0x56343186a830 2024-08-20T01:52:06.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.211+0000 7f04146c6740 10 client.28238 fetch_fsmap learned FSMap version 61 2024-08-20T01:52:06.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.211+0000 7f04146c6740 1 -- 172.21.15.79:0/3202900405 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x5634318f0f30 con 0x56343186a830 2024-08-20T01:52:06.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.211+0000 7f03eb7fe640 1 -- 172.21.15.79:0/3202900405 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f03fc02f030 con 0x56343186a830 2024-08-20T01:52:06.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.211+0000 7f03eb7fe640 1 -- 172.21.15.79:0/3202900405 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 61) ==== 8410+0+0 (secure 0 0 0) 0x7f03fc027030 con 0x56343186a830 2024-08-20T01:52:06.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.211+0000 7f04146c6740 10 client.28238 fetch_fsmap finished waiting for FSMap version 61 2024-08-20T01:52:06.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.211+0000 7f04146c6740 10 client.28238 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:52:06.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.211+0000 7f04146c6740 20 client.28238 populate_metadata read hostname 'smithi079' 2024-08-20T01:52:06.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.211+0000 7f04146c6740 1 --2- 172.21.15.79:0/3202900405 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5634318f15c0 0x5634318f39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:06.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.211+0000 7f04146c6740 4 client.28238 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:52:06.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.211+0000 7f04146c6740 1 -- 172.21.15.79:0/3202900405 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5634317df2d0 con 0x5634318f15c0 2024-08-20T01:52:06.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.212+0000 7f040b7fe640 1 --2- 172.21.15.79:0/3202900405 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5634318f15c0 0x5634318f39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:06.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.212+0000 7f040b7fe640 1 --2- 172.21.15.79:0/3202900405 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5634318f15c0 0x5634318f39e0 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=516d2229e208b843 server_cookie=8b0b2d75e980e047 in_seq=0 out_seq=0 2024-08-20T01:52:06.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.212+0000 7f03eb7fe640 10 client.28238 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:52:06.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.212+0000 7f03eb7fe640 1 -- 172.21.15.79:0/3202900405 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5634317df2d0 con 0x5634318f15c0 2024-08-20T01:52:06.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.212+0000 7f03eb7fe640 10 client.28238 handle_command_reply: tid=0 2024-08-20T01:52:06.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.212+0000 7f04146c6740 1 client.28238 shutdown 2024-08-20T01:52:06.235 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:52:06.235 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-08-20T01:52:06.235 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-08-20T01:52:06.235 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:52:06.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.212+0000 7f04146c6740 1 -- 172.21.15.79:0/3202900405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343186a830 msgr2=0x56343187f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:06.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.212+0000 7f04146c6740 1 --2- 172.21.15.79:0/3202900405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343186a830 0x56343187f8b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f03fc029cf0 tx=0x7f03fc01f750 comp rx=0 tx=0).stop 2024-08-20T01:52:06.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.212+0000 7f04146c6740 1 -- 172.21.15.79:0/3202900405 shutdown_connections 2024-08-20T01:52:06.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.212+0000 7f04146c6740 1 --2- 172.21.15.79:0/3202900405 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5634318f15c0 0x5634318f39e0 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:06.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.212+0000 7f04146c6740 1 --2- 172.21.15.79:0/3202900405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634318770e0 0x56343187a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:06.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.212+0000 7f03eb7fe640 0 client.28238 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:52:06.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.212+0000 7f04146c6740 1 --2- 172.21.15.79:0/3202900405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56343186b150 0x56343187a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:06.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.212+0000 7f04146c6740 1 --2- 172.21.15.79:0/3202900405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343186a830 0x56343187f8b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:06.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.212+0000 7f04146c6740 1 -- 172.21.15.79:0/3202900405 >> 172.21.15.79:0/3202900405 conn(0x563431868660 msgr2=0x563431867720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:06.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.212+0000 7f04146c6740 1 -- 172.21.15.79:0/3202900405 shutdown_connections 2024-08-20T01:52:06.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.212+0000 7f04146c6740 1 -- 172.21.15.79:0/3202900405 wait complete. 2024-08-20T01:52:06.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.212+0000 7f04146c6740 20 client.28238 trim_cache size 0 max 16384 2024-08-20T01:52:06.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.213+0000 7f04122cd640 1 -- 172.21.15.79:0/294106607 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f03f40b3bd0 msgr2=0x7f03f40b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:06.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.213+0000 7f04122cd640 1 --2- 172.21.15.79:0/294106607 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f03f40b3bd0 0x7f03f40b6090 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x56343186d9b0 tx=0x7f03fc005f90 comp rx=0 tx=0).stop 2024-08-20T01:52:06.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.213+0000 7f04122cd640 1 -- 172.21.15.79:0/294106607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f040c1073a0 msgr2=0x7f040c0fde40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:06.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.213+0000 7f04122cd640 1 --2- 172.21.15.79:0/294106607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f040c1073a0 0x7f040c0fde40 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f0400009230 tx=0x7f04000319a0 comp rx=0 tx=0).stop 2024-08-20T01:52:06.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.213+0000 7f04122cd640 1 -- 172.21.15.79:0/294106607 shutdown_connections 2024-08-20T01:52:06.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.213+0000 7f04122cd640 1 --2- 172.21.15.79:0/294106607 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f03f40b3bd0 0x7f03f40b6090 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:06.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.213+0000 7f04122cd640 1 --2- 172.21.15.79:0/294106607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f040c107d20 0x7f040c0fe380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:06.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.213+0000 7f04122cd640 1 --2- 172.21.15.79:0/294106607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f040c1073a0 0x7f040c0fde40 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:06.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.213+0000 7f04122cd640 1 --2- 172.21.15.79:0/294106607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f040c101990 0x7f040c0fd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:06.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.213+0000 7f04122cd640 1 -- 172.21.15.79:0/294106607 >> 172.21.15.79:0/294106607 conn(0x7f040c0fd400 msgr2=0x7f040c104540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:06.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.213+0000 7f04122cd640 1 -- 172.21.15.79:0/294106607 shutdown_connections 2024-08-20T01:52:06.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:06.213+0000 7f04122cd640 1 -- 172.21.15.79:0/294106607 wait complete. 2024-08-20T01:52:06.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:06 smithi081 ceph-mon[22209]: pgmap v790: 97 pgs: 97 active+clean; 9.9 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.4 KiB/s wr, 21 op/s 2024-08-20T01:52:06.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:06 smithi175 ceph-mon[22392]: pgmap v790: 97 pgs: 97 active+clean; 9.9 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.4 KiB/s wr, 21 op/s 2024-08-20T01:52:06.999 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T01:52:07.000 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:52:07.249 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:52:07.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.706+0000 7f58240b7640 1 -- 172.21.15.79:0/2053669337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f581c1073a0 msgr2=0x7f581c1077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:07.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.706+0000 7f58240b7640 1 --2- 172.21.15.79:0/2053669337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f581c1073a0 0x7f581c1077e0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f580c009900 tx=0x7f580c02a410 comp rx=0 tx=0).stop 2024-08-20T01:52:07.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.706+0000 7f58240b7640 1 -- 172.21.15.79:0/2053669337 shutdown_connections 2024-08-20T01:52:07.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.706+0000 7f58240b7640 1 --2- 172.21.15.79:0/2053669337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f581c107d20 0x7f581c10e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:07.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.706+0000 7f58240b7640 1 --2- 172.21.15.79:0/2053669337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f581c1073a0 0x7f581c1077e0 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:07.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.706+0000 7f58240b7640 1 --2- 172.21.15.79:0/2053669337 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f581c101990 0x7f581c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:07.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.706+0000 7f58240b7640 1 -- 172.21.15.79:0/2053669337 >> 172.21.15.79:0/2053669337 conn(0x7f581c0fd400 msgr2=0x7f581c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:07.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.706+0000 7f58240b7640 1 -- 172.21.15.79:0/2053669337 shutdown_connections 2024-08-20T01:52:07.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.706+0000 7f58240b7640 1 -- 172.21.15.79:0/2053669337 wait complete. 2024-08-20T01:52:07.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.706+0000 7f58240b7640 1 Processor -- start 2024-08-20T01:52:07.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.707+0000 7f58240b7640 1 -- start start 2024-08-20T01:52:07.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.707+0000 7f58240b7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f581c101990 0x7f581c198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:07.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.707+0000 7f58240b7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f581c1073a0 0x7f581c199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:07.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.707+0000 7f58240b7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f581c107d20 0x7f581c19e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:07.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.707+0000 7f58240b7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f581c111820 con 0x7f581c101990 2024-08-20T01:52:07.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.707+0000 7f58240b7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f581c1116a0 con 0x7f581c1073a0 2024-08-20T01:52:07.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.707+0000 7f58240b7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f581c1119a0 con 0x7f581c107d20 2024-08-20T01:52:07.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.707+0000 7f5821e53640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f581c101990 0x7f581c198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:07.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.707+0000 7f5821652640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f581c1073a0 0x7f581c199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:07.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.707+0000 7f5821e53640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f581c101990 0x7f581c198ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58062/0 (socket says 172.21.15.79:58062) 2024-08-20T01:52:07.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.707+0000 7f5821e53640 1 -- 172.21.15.79:0/3338767196 learned_addr learned my addr 172.21.15.79:0/3338767196 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:07.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.707+0000 7f5821652640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f581c1073a0 0x7f581c199400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:48836/0 (socket says 172.21.15.79:48836) 2024-08-20T01:52:07.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.707+0000 7f5822654640 1 --2- 172.21.15.79:0/3338767196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f581c107d20 0x7f581c19e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:07.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.707+0000 7f5821e53640 1 -- 172.21.15.79:0/3338767196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f581c107d20 msgr2=0x7f581c19e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:07.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.707+0000 7f5821e53640 1 --2- 172.21.15.79:0/3338767196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f581c107d20 0x7f581c19e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:07.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.707+0000 7f5821e53640 1 -- 172.21.15.79:0/3338767196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f581c1073a0 msgr2=0x7f581c199400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:07.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.707+0000 7f5821e53640 1 --2- 172.21.15.79:0/3338767196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f581c1073a0 0x7f581c199400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:07.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.707+0000 7f5821e53640 1 -- 172.21.15.79:0/3338767196 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f581c19ef70 con 0x7f581c101990 2024-08-20T01:52:07.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.707+0000 7f5821652640 1 --2- 172.21.15.79:0/3338767196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f581c1073a0 0x7f581c199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:52:07.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.707+0000 7f5821e53640 1 --2- 172.21.15.79:0/3338767196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f581c101990 0x7f581c198ec0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f581800e9f0 tx=0x7f581800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:07.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.708+0000 7f5812ffd640 1 -- 172.21.15.79:0/3338767196 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f581800cd80 con 0x7f581c101990 2024-08-20T01:52:07.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.708+0000 7f5812ffd640 1 -- 172.21.15.79:0/3338767196 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f58180108c0 con 0x7f581c101990 2024-08-20T01:52:07.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.708+0000 7f58240b7640 1 -- 172.21.15.79:0/3338767196 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f581c19f260 con 0x7f581c101990 2024-08-20T01:52:07.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.708+0000 7f5812ffd640 1 -- 172.21.15.79:0/3338767196 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58180187c0 con 0x7f581c101990 2024-08-20T01:52:07.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.708+0000 7f58240b7640 1 -- 172.21.15.79:0/3338767196 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f581c1a5af0 con 0x7f581c101990 2024-08-20T01:52:07.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.709+0000 7f58240b7640 1 -- 172.21.15.79:0/3338767196 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f581c102c40 con 0x7f581c101990 2024-08-20T01:52:07.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.710+0000 7f5812ffd640 1 -- 172.21.15.79:0/3338767196 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5818010430 con 0x7f581c101990 2024-08-20T01:52:07.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.711+0000 7f5812ffd640 1 --2- 172.21.15.79:0/3338767196 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f58080b3c50 0x7f58080b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:07.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.711+0000 7f5821652640 1 --2- 172.21.15.79:0/3338767196 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f58080b3c50 0x7f58080b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:07.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.711+0000 7f5812ffd640 1 -- 172.21.15.79:0/3338767196 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f58180e3f10 con 0x7f581c101990 2024-08-20T01:52:07.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.711+0000 7f5821652640 1 --2- 172.21.15.79:0/3338767196 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f58080b3c50 0x7f58080b6110 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f580c0057c0 tx=0x7f580c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:07.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.715+0000 7f5812ffd640 1 -- 172.21.15.79:0/3338767196 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f58180aaf20 con 0x7f581c101990 2024-08-20T01:52:07.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.939+0000 7f58240b7640 1 -- 172.21.15.79:0/3338767196 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f581c1a5cc0 con 0x7f581c101990 2024-08-20T01:52:07.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.940+0000 7f5812ffd640 1 -- 172.21.15.79:0/3338767196 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+11992 (secure 0 0 0) 0x7f58180af470 con 0x7f581c101990 2024-08-20T01:52:07.943 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:52:07.943 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":61,"btime":"2024-08-20T01:51:58:934672+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14670,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/735082912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":735082912},{"type":"v1","addr":"172.21.15.79:6835","nonce":735082912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2150339873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2150339873},{"type":"v1","addr":"172.21.15.79:6837","nonce":2150339873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":61,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:34:55.133562+0000","modified":"2024-08-20T01:51:58.574104+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24539,"mds_1":24538,"mds_2":24523,"mds_3":24514,"mds_4":24512},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14724":{"gid":14724,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/1071242274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1071242274},{"type":"v1","addr":"172.21.15.79:6839","nonce":1071242274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14730":{"gid":14730,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6841/2448977611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":2448977611},{"type":"v1","addr":"172.21.15.79:6841","nonce":2448977611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/1257507005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1257507005},{"type":"v1","addr":"172.21.15.81:6833","nonce":1257507005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1499936216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1499936216},{"type":"v1","addr":"172.21.15.81:6835","nonce":1499936216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/1107229215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1107229215},{"type":"v1","addr":"172.21.15.175:6833","nonce":1107229215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6837/2073598870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2073598870},{"type":"v1","addr":"172.21.15.81:6837","nonce":2073598870}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/2552601173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2552601173},{"type":"v1","addr":"172.21.15.175:6835","nonce":2552601173}]},"join_fscid":-1,"export_targets":[1,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6837/1767284089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1767284089},{"type":"v1","addr":"172.21.15.175:6837","nonce":1767284089}]},"join_fscid":-1,"export_targets":[0,1,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/1331748742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1331748742},{"type":"v1","addr":"172.21.15.175:6839","nonce":1331748742}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/4098410583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":4098410583},{"type":"v1","addr":"172.21.15.81:6839","nonce":4098410583}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24539,"qdb_cluster":[24539,24523,24514,24538,24512]},"id":1}]} 2024-08-20T01:52:07.943 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 61 2024-08-20T01:52:07.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.942+0000 7f58240b7640 1 -- 172.21.15.79:0/3338767196 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f58080b3c50 msgr2=0x7f58080b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:07.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.942+0000 7f58240b7640 1 --2- 172.21.15.79:0/3338767196 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f58080b3c50 0x7f58080b6110 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f580c0057c0 tx=0x7f580c0058d0 comp rx=0 tx=0).stop 2024-08-20T01:52:07.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.942+0000 7f58240b7640 1 -- 172.21.15.79:0/3338767196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f581c101990 msgr2=0x7f581c198ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:07.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.942+0000 7f58240b7640 1 --2- 172.21.15.79:0/3338767196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f581c101990 0x7f581c198ec0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f581800e9f0 tx=0x7f581800eeb0 comp rx=0 tx=0).stop 2024-08-20T01:52:07.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.942+0000 7f58240b7640 1 -- 172.21.15.79:0/3338767196 shutdown_connections 2024-08-20T01:52:07.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.942+0000 7f58240b7640 1 --2- 172.21.15.79:0/3338767196 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f58080b3c50 0x7f58080b6110 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:07.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.942+0000 7f58240b7640 1 --2- 172.21.15.79:0/3338767196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f581c107d20 0x7f581c19e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:07.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.942+0000 7f58240b7640 1 --2- 172.21.15.79:0/3338767196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f581c1073a0 0x7f581c199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:07.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.942+0000 7f58240b7640 1 --2- 172.21.15.79:0/3338767196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f581c101990 0x7f581c198ec0 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:07.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.942+0000 7f58240b7640 1 -- 172.21.15.79:0/3338767196 >> 172.21.15.79:0/3338767196 conn(0x7f581c0fd400 msgr2=0x7f581c06ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:07.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.942+0000 7f58240b7640 1 -- 172.21.15.79:0/3338767196 shutdown_connections 2024-08-20T01:52:07.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:07.942+0000 7f58240b7640 1 -- 172.21.15.79:0/3338767196 wait complete. 2024-08-20T01:52:08.272 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:08 smithi079 ceph-mon[18656]: pgmap v791: 97 pgs: 97 active+clean; 9.8 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 4.0 KiB/s wr, 18 op/s 2024-08-20T01:52:08.272 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:08 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/3338767196' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:52:08.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:08 smithi081 ceph-mon[22209]: pgmap v791: 97 pgs: 97 active+clean; 9.8 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 4.0 KiB/s wr, 18 op/s 2024-08-20T01:52:08.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:08 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/3338767196' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:52:08.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:08 smithi175 ceph-mon[22392]: pgmap v791: 97 pgs: 97 active+clean; 9.8 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 4.0 KiB/s wr, 18 op/s 2024-08-20T01:52:08.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:08 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/3338767196' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:52:08.710 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-20T01:52:08.963 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:52:09.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.442+0000 7fd493dab640 1 -- 172.21.15.79:0/3051221363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd48c107d20 msgr2=0x7fd48c10e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:09.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.442+0000 7fd493dab640 1 --2- 172.21.15.79:0/3051221363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd48c107d20 0x7fd48c10e520 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fd484009ca0 tx=0x7fd48402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:52:09.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.442+0000 7fd493dab640 1 -- 172.21.15.79:0/3051221363 shutdown_connections 2024-08-20T01:52:09.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.442+0000 7fd493dab640 1 --2- 172.21.15.79:0/3051221363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd48c107d20 0x7fd48c10e520 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:09.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.442+0000 7fd493dab640 1 --2- 172.21.15.79:0/3051221363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd48c1073a0 0x7fd48c1077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:09.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.442+0000 7fd493dab640 1 --2- 172.21.15.79:0/3051221363 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd48c101990 0x7fd48c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:09.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.442+0000 7fd493dab640 1 -- 172.21.15.79:0/3051221363 >> 172.21.15.79:0/3051221363 conn(0x7fd48c0fd400 msgr2=0x7fd48c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:09.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.442+0000 7fd493dab640 1 -- 172.21.15.79:0/3051221363 shutdown_connections 2024-08-20T01:52:09.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.442+0000 7fd493dab640 1 -- 172.21.15.79:0/3051221363 wait complete. 2024-08-20T01:52:09.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.442+0000 7fd493dab640 1 Processor -- start 2024-08-20T01:52:09.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.443+0000 7fd493dab640 1 -- start start 2024-08-20T01:52:09.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.443+0000 7fd493dab640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd48c101990 0x7fd48c198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:09.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.443+0000 7fd493dab640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd48c1073a0 0x7fd48c1993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:09.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.443+0000 7fd493dab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd48c107d20 0x7fd48c19e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:09.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.443+0000 7fd493dab640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd48c1118e0 con 0x7fd48c1073a0 2024-08-20T01:52:09.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.443+0000 7fd493dab640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd48c111760 con 0x7fd48c107d20 2024-08-20T01:52:09.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.443+0000 7fd493dab640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd48c111a60 con 0x7fd48c101990 2024-08-20T01:52:09.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.443+0000 7fd491346640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd48c1073a0 0x7fd48c1993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:09.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.443+0000 7fd491346640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd48c1073a0 0x7fd48c1993f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58086/0 (socket says 172.21.15.79:58086) 2024-08-20T01:52:09.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.443+0000 7fd491346640 1 -- 172.21.15.79:0/3889452528 learned_addr learned my addr 172.21.15.79:0/3889452528 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:09.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.443+0000 7fd491b47640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd48c101990 0x7fd48c198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:09.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.443+0000 7fd492348640 1 --2- 172.21.15.79:0/3889452528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd48c107d20 0x7fd48c19e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:09.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.443+0000 7fd491b47640 1 -- 172.21.15.79:0/3889452528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd48c107d20 msgr2=0x7fd48c19e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:09.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.443+0000 7fd491b47640 1 --2- 172.21.15.79:0/3889452528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd48c107d20 0x7fd48c19e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:09.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.443+0000 7fd491b47640 1 -- 172.21.15.79:0/3889452528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd48c1073a0 msgr2=0x7fd48c1993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:09.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.443+0000 7fd491b47640 1 --2- 172.21.15.79:0/3889452528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd48c1073a0 0x7fd48c1993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:09.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.443+0000 7fd491b47640 1 -- 172.21.15.79:0/3889452528 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd48c19ef60 con 0x7fd48c101990 2024-08-20T01:52:09.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.443+0000 7fd491346640 1 --2- 172.21.15.79:0/3889452528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd48c1073a0 0x7fd48c1993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:52:09.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.444+0000 7fd491b47640 1 --2- 172.21.15.79:0/3889452528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd48c101990 0x7fd48c198eb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd48800e9f0 tx=0x7fd48800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:09.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.444+0000 7fd482ffd640 1 -- 172.21.15.79:0/3889452528 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd48800ccc0 con 0x7fd48c101990 2024-08-20T01:52:09.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.444+0000 7fd482ffd640 1 -- 172.21.15.79:0/3889452528 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4880108c0 con 0x7fd48c101990 2024-08-20T01:52:09.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.444+0000 7fd482ffd640 1 -- 172.21.15.79:0/3889452528 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4880187e0 con 0x7fd48c101990 2024-08-20T01:52:09.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.444+0000 7fd493dab640 1 -- 172.21.15.79:0/3889452528 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd48c19f250 con 0x7fd48c101990 2024-08-20T01:52:09.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.444+0000 7fd493dab640 1 -- 172.21.15.79:0/3889452528 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd48c1a5910 con 0x7fd48c101990 2024-08-20T01:52:09.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.446+0000 7fd4961a4740 1 Processor -- start 2024-08-20T01:52:09.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.447+0000 7fd4961a4740 1 -- start start 2024-08-20T01:52:09.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.447+0000 7fd482ffd640 1 -- 172.21.15.79:0/3889452528 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fd488010430 con 0x7fd48c101990 2024-08-20T01:52:09.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.447+0000 7fd4961a4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5569342ff880 0x5569342ffc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:09.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.447+0000 7fd4961a4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569343001a0 0x55693430bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:09.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.447+0000 7fd4961a4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55693430c130 0x55693430e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:09.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.447+0000 7fd4961a4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556934276930 con 0x5569342ff880 2024-08-20T01:52:09.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.447+0000 7fd4961a4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556934265e30 con 0x55693430c130 2024-08-20T01:52:09.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.447+0000 7fd4961a4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556934269e70 con 0x5569343001a0 2024-08-20T01:52:09.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.447+0000 7fd492348640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5569342ff880 0x5569342ffc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:09.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.447+0000 7fd492348640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5569342ff880 0x5569342ffc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58098/0 (socket says 172.21.15.79:58098) 2024-08-20T01:52:09.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.447+0000 7fd492348640 1 -- 172.21.15.79:0/4260912433 learned_addr learned my addr 172.21.15.79:0/4260912433 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:09.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.447+0000 7fd491b47640 1 --2- 172.21.15.79:0/4260912433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569343001a0 0x55693430bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:09.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.447+0000 7fd491346640 1 --2- 172.21.15.79:0/4260912433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55693430c130 0x55693430e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:09.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.447+0000 7fd492348640 1 -- 172.21.15.79:0/4260912433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569343001a0 msgr2=0x55693430bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:09.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.447+0000 7fd492348640 1 --2- 172.21.15.79:0/4260912433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569343001a0 0x55693430bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:09.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.447+0000 7fd492348640 1 -- 172.21.15.79:0/4260912433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55693430c130 msgr2=0x55693430e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:09.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.447+0000 7fd492348640 1 --2- 172.21.15.79:0/4260912433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55693430c130 0x55693430e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:09.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.447+0000 7fd492348640 1 -- 172.21.15.79:0/4260912433 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556933fc5650 con 0x5569342ff880 2024-08-20T01:52:09.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.447+0000 7fd491b47640 1 --2- 172.21.15.79:0/4260912433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569343001a0 0x55693430bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:52:09.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.447+0000 7fd492348640 1 --2- 172.21.15.79:0/4260912433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5569342ff880 0x5569342ffc60 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fd484035000 tx=0x7fd4840093f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b91dedafd34c9d3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:09.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.448+0000 7fd482ffd640 1 --2- 172.21.15.79:0/3889452528 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd4780b3c50 0x7fd4780b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:09.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.448+0000 7fd477fff640 1 -- 172.21.15.79:0/4260912433 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd484031980 con 0x5569342ff880 2024-08-20T01:52:09.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.448+0000 7fd477fff640 1 -- 172.21.15.79:0/4260912433 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd484036070 con 0x5569342ff880 2024-08-20T01:52:09.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.448+0000 7fd477fff640 1 -- 172.21.15.79:0/4260912433 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd484004470 con 0x5569342ff880 2024-08-20T01:52:09.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.448+0000 7fd491b47640 1 --2- 172.21.15.79:0/3889452528 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd4780b3c50 0x7fd4780b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:09.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.448+0000 7fd482ffd640 1 -- 172.21.15.79:0/3889452528 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fd4880e3e40 con 0x7fd48c101990 2024-08-20T01:52:09.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.448+0000 7fd4961a4740 1 -- 172.21.15.79:0/4260912433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5569342ff880 msgr2=0x5569342ffc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:09.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.448+0000 7fd491b47640 1 --2- 172.21.15.79:0/3889452528 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd4780b3c50 0x7fd4780b6110 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fd4880e1cc0 tx=0x7fd4880e7920 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:09.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.448+0000 7fd4961a4740 1 --2- 172.21.15.79:0/4260912433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5569342ff880 0x5569342ffc60 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fd484035000 tx=0x7fd4840093f0 comp rx=0 tx=0).stop 2024-08-20T01:52:09.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.449+0000 7fd4961a4740 1 -- 172.21.15.79:0/4260912433 shutdown_connections 2024-08-20T01:52:09.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.449+0000 7fd4961a4740 1 --2- 172.21.15.79:0/4260912433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55693430c130 0x55693430e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:09.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.449+0000 7fd4961a4740 1 --2- 172.21.15.79:0/4260912433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569343001a0 0x55693430bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:09.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.449+0000 7fd4961a4740 1 --2- 172.21.15.79:0/4260912433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5569342ff880 0x5569342ffc60 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:09.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.449+0000 7fd4961a4740 1 -- 172.21.15.79:0/4260912433 >> 172.21.15.79:0/4260912433 conn(0x5569342fd6b0 msgr2=0x5569342fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:09.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.449+0000 7fd4961a4740 1 -- 172.21.15.79:0/4260912433 shutdown_connections 2024-08-20T01:52:09.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.449+0000 7fd4961a4740 1 -- 172.21.15.79:0/4260912433 wait complete. 2024-08-20T01:52:09.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.449+0000 7fd4961a4740 1 -- start start 2024-08-20T01:52:09.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.449+0000 7fd4961a4740 1 Processor -- start 2024-08-20T01:52:09.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.449+0000 7fd4961a4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569342ff880 0x556934309120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:09.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.449+0000 7fd4961a4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569343001a0 0x556934309660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:09.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.449+0000 7fd4961a4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55693430c130 0x556934309ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:09.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.449+0000 7fd4961a4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5569340c8700 con 0x55693430c130 2024-08-20T01:52:09.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.449+0000 7fd4961a4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5569341ec810 con 0x5569343001a0 2024-08-20T01:52:09.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.449+0000 7fd4961a4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55693430ec00 con 0x5569342ff880 2024-08-20T01:52:09.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.450+0000 7fd4961a4740 10 client.0 _ll_register_callbacks cb 0x55693425f700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:52:09.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.450+0000 7fd492348640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55693430c130 0x556934309ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:09.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.450+0000 7fd491346640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569343001a0 0x556934309660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:09.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.450+0000 7fd492348640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569342ff880 0x556934309120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:09.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.450+0000 7fd492348640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569342ff880 0x556934309120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:60166/0 (socket says 172.21.15.79:60166) 2024-08-20T01:52:09.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.450+0000 7fd492348640 1 -- 172.21.15.79:0/1630727451 learned_addr learned my addr 172.21.15.79:0/1630727451 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:09.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.450+0000 7fd491346640 1 -- 172.21.15.79:0/1630727451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569342ff880 msgr2=0x556934309120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:09.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.450+0000 7fd491346640 1 --2- 172.21.15.79:0/1630727451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569342ff880 0x556934309120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:09.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.450+0000 7fd491346640 1 -- 172.21.15.79:0/1630727451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55693430c130 msgr2=0x556934309ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:09.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.450+0000 7fd491346640 1 --2- 172.21.15.79:0/1630727451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55693430c130 0x556934309ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:09.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.450+0000 7fd491346640 1 -- 172.21.15.79:0/1630727451 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556934318000 con 0x5569343001a0 2024-08-20T01:52:09.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.450+0000 7fd492348640 1 --2- 172.21.15.79:0/1630727451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569342ff880 0x556934309120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:52:09.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.450+0000 7fd491346640 1 --2- 172.21.15.79:0/1630727451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569343001a0 0x556934309660 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd48c106bb0 tx=0x7fd47c0039c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8113b35ce47c7e2e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:09.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.450+0000 7fd4757fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:52:09.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.450+0000 7fd4757fa640 1 -- 172.21.15.79:0/1630727451 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47c0117d0 con 0x5569343001a0 2024-08-20T01:52:09.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.450+0000 7fd4757fa640 1 -- 172.21.15.79:0/1630727451 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fd47c011970 con 0x5569343001a0 2024-08-20T01:52:09.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.450+0000 7fd4961a4740 1 -- 172.21.15.79:0/1630727451 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556934215150 con 0x5569343001a0 2024-08-20T01:52:09.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.450+0000 7fd4757fa640 1 -- 172.21.15.79:0/1630727451 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fd47c011b70 con 0x5569343001a0 2024-08-20T01:52:09.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.450+0000 7fd4961a4740 10 client.28256 fetch_fsmap learned FSMap version 62 2024-08-20T01:52:09.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.450+0000 7fd4961a4740 1 -- 172.21.15.79:0/1630727451 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55693431a9f0 con 0x5569343001a0 2024-08-20T01:52:09.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.451+0000 7fd4757fa640 1 -- 172.21.15.79:0/1630727451 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x556934215150 con 0x5569343001a0 2024-08-20T01:52:09.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.451+0000 7fd4757fa640 1 -- 172.21.15.79:0/1630727451 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 62) ==== 8406+0+0 (secure 0 0 0) 0x7fd47c010440 con 0x5569343001a0 2024-08-20T01:52:09.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.451+0000 7fd4961a4740 10 client.28256 fetch_fsmap finished waiting for FSMap version 62 2024-08-20T01:52:09.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.451+0000 7fd4961a4740 10 client.28256 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:52:09.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.451+0000 7fd4961a4740 20 client.28256 populate_metadata read hostname 'smithi079' 2024-08-20T01:52:09.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.451+0000 7fd4961a4740 1 --2- 172.21.15.79:0/1630727451 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55693431bf50 0x55693431e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:09.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.451+0000 7fd4961a4740 4 client.28256 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:52:09.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.451+0000 7fd4961a4740 1 -- 172.21.15.79:0/1630727451 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556934278880 con 0x55693431bf50 2024-08-20T01:52:09.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.451+0000 7fd492348640 1 --2- 172.21.15.79:0/1630727451 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55693431bf50 0x55693431e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:09.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.451+0000 7fd4757fa640 10 client.28256 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:52:09.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.451+0000 7fd492348640 1 --2- 172.21.15.79:0/1630727451 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55693431bf50 0x55693431e340 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a9bb887c070fa323 server_cookie=79eaa24fcee3a06d in_seq=0 out_seq=0 2024-08-20T01:52:09.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.452+0000 7fd4757fa640 1 -- 172.21.15.79:0/1630727451 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556934278880 con 0x55693431bf50 2024-08-20T01:52:09.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.452+0000 7fd4757fa640 10 client.28256 handle_command_reply: tid=0 2024-08-20T01:52:09.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.452+0000 7fd4961a4740 1 client.28256 shutdown 2024-08-20T01:52:09.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.452+0000 7fd4961a4740 1 -- 172.21.15.79:0/1630727451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569343001a0 msgr2=0x556934309660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:09.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.452+0000 7fd4961a4740 1 --2- 172.21.15.79:0/1630727451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569343001a0 0x556934309660 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd48c106bb0 tx=0x7fd47c0039c0 comp rx=0 tx=0).stop 2024-08-20T01:52:09.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.452+0000 7fd4961a4740 1 -- 172.21.15.79:0/1630727451 shutdown_connections 2024-08-20T01:52:09.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.452+0000 7fd4961a4740 1 --2- 172.21.15.79:0/1630727451 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55693431bf50 0x55693431e340 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:09.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.452+0000 7fd4961a4740 1 --2- 172.21.15.79:0/1630727451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55693430c130 0x556934309ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:09.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.452+0000 7fd4961a4740 1 --2- 172.21.15.79:0/1630727451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569343001a0 0x556934309660 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:09.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.452+0000 7fd4961a4740 1 --2- 172.21.15.79:0/1630727451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569342ff880 0x556934309120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:09.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.452+0000 7fd4757fa640 0 client.28256 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:52:09.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.452+0000 7fd4961a4740 1 -- 172.21.15.79:0/1630727451 >> 172.21.15.79:0/1630727451 conn(0x5569342fd6b0 msgr2=0x556934303250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:09.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.452+0000 7fd4961a4740 1 -- 172.21.15.79:0/1630727451 shutdown_connections 2024-08-20T01:52:09.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.452+0000 7fd4961a4740 1 -- 172.21.15.79:0/1630727451 wait complete. 2024-08-20T01:52:09.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.453+0000 7fd4961a4740 20 client.28256 trim_cache size 0 max 16384 2024-08-20T01:52:09.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.465+0000 7fd4961a4740 1 Processor -- start 2024-08-20T01:52:09.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.465+0000 7fd4961a4740 1 -- start start 2024-08-20T01:52:09.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.466+0000 7fd4961a4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569342ff880 0x556934309bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:09.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.466+0000 7fd4961a4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569343001a0 0x5569343089b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:09.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.466+0000 7fd4961a4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55693430c130 0x556934323c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:09.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.466+0000 7fd4961a4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd48c1adfc0 con 0x55693430c130 2024-08-20T01:52:09.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.466+0000 7fd4961a4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd48c1afcb0 con 0x5569343001a0 2024-08-20T01:52:09.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.466+0000 7fd4961a4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd48c1ae6c0 con 0x5569342ff880 2024-08-20T01:52:09.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.466+0000 7fd492348640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55693430c130 0x556934323c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:09.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.466+0000 7fd491346640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569343001a0 0x5569343089b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:09.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.466+0000 7fd492348640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55693430c130 0x556934323c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58130/0 (socket says 172.21.15.79:58130) 2024-08-20T01:52:09.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.466+0000 7fd492348640 1 -- 172.21.15.79:0/3154840395 learned_addr learned my addr 172.21.15.79:0/3154840395 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:09.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.466+0000 7fd492348640 1 --2- 172.21.15.79:0/3154840395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569342ff880 0x556934309bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:09.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.466+0000 7fd492348640 1 -- 172.21.15.79:0/3154840395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569342ff880 msgr2=0x556934309bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:09.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.466+0000 7fd492348640 1 --2- 172.21.15.79:0/3154840395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569342ff880 0x556934309bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:09.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.466+0000 7fd492348640 1 -- 172.21.15.79:0/3154840395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569343001a0 msgr2=0x5569343089b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:09.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.466+0000 7fd492348640 1 --2- 172.21.15.79:0/3154840395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569343001a0 0x5569343089b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:09.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.466+0000 7fd492348640 1 -- 172.21.15.79:0/3154840395 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556934308ef0 con 0x55693430c130 2024-08-20T01:52:09.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.466+0000 7fd491346640 1 --2- 172.21.15.79:0/3154840395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569343001a0 0x5569343089b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:52:09.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.466+0000 7fd492348640 1 --2- 172.21.15.79:0/3154840395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55693430c130 0x556934323c00 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fd484005e30 tx=0x7fd484009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25b25de32b9af695 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:09.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.466+0000 7fd4777fe640 1 -- 172.21.15.79:0/3154840395 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd484003b70 con 0x55693430c130 2024-08-20T01:52:09.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.466+0000 7fd4777fe640 1 -- 172.21.15.79:0/3154840395 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd484036040 con 0x55693430c130 2024-08-20T01:52:09.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.466+0000 7fd4777fe640 1 -- 172.21.15.79:0/3154840395 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd484057690 con 0x55693430c130 2024-08-20T01:52:09.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.467+0000 7fd4961a4740 1 -- 172.21.15.79:0/3154840395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55693430c130 msgr2=0x556934323c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:09.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.467+0000 7fd4961a4740 1 --2- 172.21.15.79:0/3154840395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55693430c130 0x556934323c00 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fd484005e30 tx=0x7fd484009360 comp rx=0 tx=0).stop 2024-08-20T01:52:09.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.467+0000 7fd4961a4740 1 -- 172.21.15.79:0/3154840395 shutdown_connections 2024-08-20T01:52:09.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.467+0000 7fd4961a4740 1 --2- 172.21.15.79:0/3154840395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55693430c130 0x556934323c00 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:09.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.467+0000 7fd4961a4740 1 --2- 172.21.15.79:0/3154840395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569343001a0 0x5569343089b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:09.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.467+0000 7fd4961a4740 1 --2- 172.21.15.79:0/3154840395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569342ff880 0x556934309bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:09.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.467+0000 7fd4961a4740 1 -- 172.21.15.79:0/3154840395 >> 172.21.15.79:0/3154840395 conn(0x5569342fd6b0 msgr2=0x55693430af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:09.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.467+0000 7fd4961a4740 1 -- 172.21.15.79:0/3154840395 shutdown_connections 2024-08-20T01:52:09.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.467+0000 7fd4961a4740 1 -- 172.21.15.79:0/3154840395 wait complete. 2024-08-20T01:52:09.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.467+0000 7fd4961a4740 1 -- start start 2024-08-20T01:52:09.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.467+0000 7fd4961a4740 1 Processor -- start 2024-08-20T01:52:09.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.468+0000 7fd4961a4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569342ff880 0x556934314070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:09.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.468+0000 7fd4961a4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569343001a0 0x5569343145b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:09.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.468+0000 7fd4961a4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55693430c130 0x556934305950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:09.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.468+0000 7fd4961a4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd48c1af520 con 0x55693430c130 2024-08-20T01:52:09.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.468+0000 7fd4961a4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd48c1aee20 con 0x5569342ff880 2024-08-20T01:52:09.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.468+0000 7fd4961a4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd48c1abfa0 con 0x5569343001a0 2024-08-20T01:52:09.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.468+0000 7fd4961a4740 10 client.0 _ll_register_callbacks cb 0x7fd47c00be00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:52:09.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.468+0000 7fd492348640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55693430c130 0x556934305950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:09.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.468+0000 7fd491346640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569343001a0 0x5569343145b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:09.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.468+0000 7fd492348640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55693430c130 0x556934305950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58136/0 (socket says 172.21.15.79:58136) 2024-08-20T01:52:09.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.468+0000 7fd492348640 1 -- 172.21.15.79:0/3445098423 learned_addr learned my addr 172.21.15.79:0/3445098423 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:09.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.468+0000 7fd491346640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569343001a0 0x5569343145b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:60184/0 (socket says 172.21.15.79:60184) 2024-08-20T01:52:09.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.468+0000 7fd492348640 1 --2- 172.21.15.79:0/3445098423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569342ff880 0x556934314070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:09.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.468+0000 7fd491346640 1 -- 172.21.15.79:0/3445098423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569342ff880 msgr2=0x556934314070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:09.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.468+0000 7fd491346640 1 --2- 172.21.15.79:0/3445098423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569342ff880 0x556934314070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:09.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.468+0000 7fd491346640 1 -- 172.21.15.79:0/3445098423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55693430c130 msgr2=0x556934305950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:09.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.468+0000 7fd491346640 1 --2- 172.21.15.79:0/3445098423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55693430c130 0x556934305950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:09.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.468+0000 7fd491346640 1 -- 172.21.15.79:0/3445098423 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556934306060 con 0x5569343001a0 2024-08-20T01:52:09.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.468+0000 7fd492348640 1 --2- 172.21.15.79:0/3445098423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55693430c130 0x556934305950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:52:09.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.469+0000 7fd491346640 1 --2- 172.21.15.79:0/3445098423 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569343001a0 0x5569343145b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd47c0058c0 tx=0x7fd47c010e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91f3d4e9f671aae5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:09.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.469+0000 7fd4757fa640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:52:09.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.469+0000 7fd4757fa640 1 -- 172.21.15.79:0/3445098423 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47c036060 con 0x5569343001a0 2024-08-20T01:52:09.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.469+0000 7fd4757fa640 1 -- 172.21.15.79:0/3445098423 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fd47c010440 con 0x5569343001a0 2024-08-20T01:52:09.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.469+0000 7fd4961a4740 1 -- 172.21.15.79:0/3445098423 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd484036040 con 0x5569343001a0 2024-08-20T01:52:09.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.469+0000 7fd4757fa640 1 -- 172.21.15.79:0/3445098423 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fd47c010640 con 0x5569343001a0 2024-08-20T01:52:09.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.469+0000 7fd4961a4740 10 client.28186 fetch_fsmap learned FSMap version 62 2024-08-20T01:52:09.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.469+0000 7fd4961a4740 1 -- 172.21.15.79:0/3445098423 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x5569343865d0 con 0x5569343001a0 2024-08-20T01:52:09.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.469+0000 7fd4757fa640 1 -- 172.21.15.79:0/3445098423 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd484036040 con 0x5569343001a0 2024-08-20T01:52:09.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.469+0000 7fd4757fa640 1 -- 172.21.15.79:0/3445098423 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 62) ==== 8406+0+0 (secure 0 0 0) 0x7fd47c01b900 con 0x5569343001a0 2024-08-20T01:52:09.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.469+0000 7fd4961a4740 10 client.28186 fetch_fsmap finished waiting for FSMap version 62 2024-08-20T01:52:09.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.469+0000 7fd4961a4740 10 client.28186 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:52:09.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.469+0000 7fd4961a4740 20 client.28186 populate_metadata read hostname 'smithi079' 2024-08-20T01:52:09.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.470+0000 7fd4961a4740 1 --2- 172.21.15.79:0/3445098423 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x556934386db0 0x5569343891d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:09.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.470+0000 7fd4961a4740 4 client.28186 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:52:09.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.470+0000 7fd4961a4740 1 -- 172.21.15.79:0/3445098423 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556934274320 con 0x556934386db0 2024-08-20T01:52:09.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.470+0000 7fd492348640 1 --2- 172.21.15.79:0/3445098423 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x556934386db0 0x5569343891d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:09.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.470+0000 7fd492348640 1 --2- 172.21.15.79:0/3445098423 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x556934386db0 0x5569343891d0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=adf2e44593084c35 server_cookie=520b71c09285bde6 in_seq=0 out_seq=0 2024-08-20T01:52:09.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.470+0000 7fd4757fa640 10 client.28186 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:52:09.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.470+0000 7fd4757fa640 1 -- 172.21.15.79:0/3445098423 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556934274320 con 0x556934386db0 2024-08-20T01:52:09.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.470+0000 7fd4757fa640 10 client.28186 handle_command_reply: tid=0 2024-08-20T01:52:09.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.470+0000 7fd4961a4740 1 client.28186 shutdown 2024-08-20T01:52:09.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.470+0000 7fd4961a4740 1 -- 172.21.15.79:0/3445098423 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569343001a0 msgr2=0x5569343145b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:09.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.470+0000 7fd4961a4740 1 --2- 172.21.15.79:0/3445098423 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569343001a0 0x5569343145b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd47c0058c0 tx=0x7fd47c010e70 comp rx=0 tx=0).stop 2024-08-20T01:52:09.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.470+0000 7fd4961a4740 1 -- 172.21.15.79:0/3445098423 shutdown_connections 2024-08-20T01:52:09.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.470+0000 7fd4961a4740 1 --2- 172.21.15.79:0/3445098423 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x556934386db0 0x5569343891d0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:09.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.470+0000 7fd4961a4740 1 --2- 172.21.15.79:0/3445098423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55693430c130 0x556934305950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:09.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.470+0000 7fd4961a4740 1 --2- 172.21.15.79:0/3445098423 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569343001a0 0x5569343145b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:09.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.470+0000 7fd4961a4740 1 --2- 172.21.15.79:0/3445098423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569342ff880 0x556934314070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:09.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.470+0000 7fd4757fa640 0 client.28186 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:52:09.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.470+0000 7fd4961a4740 1 -- 172.21.15.79:0/3445098423 >> 172.21.15.79:0/3445098423 conn(0x5569342fd6b0 msgr2=0x55693430a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:09.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.471+0000 7fd4961a4740 1 -- 172.21.15.79:0/3445098423 shutdown_connections 2024-08-20T01:52:09.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.471+0000 7fd4961a4740 1 -- 172.21.15.79:0/3445098423 wait complete. 2024-08-20T01:52:09.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.471+0000 7fd4961a4740 20 client.28186 trim_cache size 0 max 16384 2024-08-20T01:52:09.492 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:52:09.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.471+0000 7fd493dab640 1 -- 172.21.15.79:0/3889452528 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd4780b3c50 msgr2=0x7fd4780b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:09.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.471+0000 7fd493dab640 1 --2- 172.21.15.79:0/3889452528 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd4780b3c50 0x7fd4780b6110 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fd4880e1cc0 tx=0x7fd4880e7920 comp rx=0 tx=0).stop 2024-08-20T01:52:09.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.471+0000 7fd493dab640 1 -- 172.21.15.79:0/3889452528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd48c101990 msgr2=0x7fd48c198eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:09.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.471+0000 7fd493dab640 1 --2- 172.21.15.79:0/3889452528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd48c101990 0x7fd48c198eb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd48800e9f0 tx=0x7fd48800eeb0 comp rx=0 tx=0).stop 2024-08-20T01:52:09.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.471+0000 7fd493dab640 1 -- 172.21.15.79:0/3889452528 shutdown_connections 2024-08-20T01:52:09.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.471+0000 7fd493dab640 1 --2- 172.21.15.79:0/3889452528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd48c107d20 0x7fd48c19e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:09.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.471+0000 7fd493dab640 1 --2- 172.21.15.79:0/3889452528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd48c1073a0 0x7fd48c1993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:09.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.471+0000 7fd493dab640 1 --2- 172.21.15.79:0/3889452528 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd4780b3c50 0x7fd4780b6110 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:09.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.471+0000 7fd493dab640 1 --2- 172.21.15.79:0/3889452528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd48c101990 0x7fd48c198eb0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:09.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.471+0000 7fd493dab640 1 -- 172.21.15.79:0/3889452528 >> 172.21.15.79:0/3889452528 conn(0x7fd48c0fd400 msgr2=0x7fd48c06aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:09.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.471+0000 7fd493dab640 1 -- 172.21.15.79:0/3889452528 shutdown_connections 2024-08-20T01:52:09.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:09.471+0000 7fd493dab640 1 -- 172.21.15.79:0/3889452528 wait complete. 2024-08-20T01:52:10.136 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-20T01:52:10.386 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:52:10.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:10 smithi175 ceph-mon[22392]: pgmap v792: 97 pgs: 97 active+clean; 9.8 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.5 KiB/s wr, 17 op/s 2024-08-20T01:52:10.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:10 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:52:10.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:10 smithi079 ceph-mon[18656]: pgmap v792: 97 pgs: 97 active+clean; 9.8 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.5 KiB/s wr, 17 op/s 2024-08-20T01:52:10.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:10 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:52:10.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:10 smithi081 ceph-mon[22209]: pgmap v792: 97 pgs: 97 active+clean; 9.8 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.5 KiB/s wr, 17 op/s 2024-08-20T01:52:10.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:10 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:52:10.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.954+0000 7f73a55af640 1 -- 172.21.15.79:0/2080501629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73a0107d20 msgr2=0x7f73a010e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:10.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.954+0000 7f73a55af640 1 --2- 172.21.15.79:0/2080501629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73a0107d20 0x7f73a010e520 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f7398009ca0 tx=0x7f739802a8c0 comp rx=0 tx=0).stop 2024-08-20T01:52:10.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.954+0000 7f73a55af640 1 -- 172.21.15.79:0/2080501629 shutdown_connections 2024-08-20T01:52:10.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.954+0000 7f73a55af640 1 --2- 172.21.15.79:0/2080501629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73a0107d20 0x7f73a010e520 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:10.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.954+0000 7f73a55af640 1 --2- 172.21.15.79:0/2080501629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73a01073a0 0x7f73a01077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:10.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.954+0000 7f73a55af640 1 --2- 172.21.15.79:0/2080501629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73a0101990 0x7f73a0101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:10.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.954+0000 7f73a55af640 1 -- 172.21.15.79:0/2080501629 >> 172.21.15.79:0/2080501629 conn(0x7f73a00fd400 msgr2=0x7f73a00ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:10.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.954+0000 7f73a55af640 1 -- 172.21.15.79:0/2080501629 shutdown_connections 2024-08-20T01:52:10.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.954+0000 7f73a55af640 1 -- 172.21.15.79:0/2080501629 wait complete. 2024-08-20T01:52:10.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.955+0000 7f73a55af640 1 Processor -- start 2024-08-20T01:52:10.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.955+0000 7f73a55af640 1 -- start start 2024-08-20T01:52:10.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.955+0000 7f73a55af640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73a0101990 0x7f73a019b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:10.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.955+0000 7f73a55af640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73a01073a0 0x7f73a019b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:10.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.955+0000 7f73a55af640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73a0107d20 0x7f73a01a0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:10.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.955+0000 7f73a55af640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f73a01118e0 con 0x7f73a0107d20 2024-08-20T01:52:10.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.955+0000 7f73a55af640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f73a0111760 con 0x7f73a01073a0 2024-08-20T01:52:10.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.955+0000 7f73a55af640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f73a0111a60 con 0x7f73a0101990 2024-08-20T01:52:10.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.955+0000 7f739f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73a0107d20 0x7f73a01a0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:10.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.955+0000 7f739f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73a0107d20 0x7f73a01a0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48100/0 (socket says 172.21.15.79:48100) 2024-08-20T01:52:10.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.955+0000 7f739f7fe640 1 -- 172.21.15.79:0/2569734434 learned_addr learned my addr 172.21.15.79:0/2569734434 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:10.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.955+0000 7f739effd640 1 --2- 172.21.15.79:0/2569734434 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73a0101990 0x7f73a019b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:10.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.955+0000 7f739e7fc640 1 --2- 172.21.15.79:0/2569734434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73a01073a0 0x7f73a019b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:10.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.956+0000 7f739f7fe640 1 -- 172.21.15.79:0/2569734434 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73a0101990 msgr2=0x7f73a019b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:10.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.956+0000 7f739f7fe640 1 --2- 172.21.15.79:0/2569734434 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73a0101990 0x7f73a019b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:10.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.956+0000 7f739f7fe640 1 -- 172.21.15.79:0/2569734434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73a01073a0 msgr2=0x7f73a019b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:10.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.956+0000 7f739f7fe640 1 --2- 172.21.15.79:0/2569734434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73a01073a0 0x7f73a019b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:10.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.956+0000 7f739f7fe640 1 -- 172.21.15.79:0/2569734434 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73a01a1130 con 0x7f73a0107d20 2024-08-20T01:52:10.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.956+0000 7f739e7fc640 1 --2- 172.21.15.79:0/2569734434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73a01073a0 0x7f73a019b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:52:10.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.956+0000 7f739f7fe640 1 --2- 172.21.15.79:0/2569734434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73a0107d20 0x7f73a01a0960 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f7398005e30 tx=0x7f73980093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:10.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.956+0000 7f7387fff640 1 -- 172.21.15.79:0/2569734434 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7398032d10 con 0x7f73a0107d20 2024-08-20T01:52:10.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.956+0000 7f7387fff640 1 -- 172.21.15.79:0/2569734434 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7398032eb0 con 0x7f73a0107d20 2024-08-20T01:52:10.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.956+0000 7f73a55af640 1 -- 172.21.15.79:0/2569734434 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73a01a13c0 con 0x7f73a0107d20 2024-08-20T01:52:10.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.956+0000 7f7387fff640 1 -- 172.21.15.79:0/2569734434 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7398030b20 con 0x7f73a0107d20 2024-08-20T01:52:10.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.956+0000 7f73a55af640 1 -- 172.21.15.79:0/2569734434 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73a01a7ae0 con 0x7f73a0107d20 2024-08-20T01:52:10.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.958+0000 7f7387fff640 1 -- 172.21.15.79:0/2569734434 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f7398030ce0 con 0x7f73a0107d20 2024-08-20T01:52:10.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.958+0000 7f73a79a8740 1 Processor -- start 2024-08-20T01:52:10.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.958+0000 7f73a79a8740 1 -- start start 2024-08-20T01:52:10.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.959+0000 7f73a79a8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564acace0880 0x564acace0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:10.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.959+0000 7f73a79a8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acace11a0 0x564acacecbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:10.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.959+0000 7f73a79a8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564acaced130 0x564acacef520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:10.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.959+0000 7f73a79a8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564acac57930 con 0x564acaced130 2024-08-20T01:52:10.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.959+0000 7f73a79a8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564acac46e30 con 0x564acace11a0 2024-08-20T01:52:10.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.959+0000 7f73a79a8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564acac4ae70 con 0x564acace0880 2024-08-20T01:52:10.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.959+0000 7f739e7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564acaced130 0x564acacef520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:10.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.959+0000 7f739e7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564acaced130 0x564acacef520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48102/0 (socket says 172.21.15.79:48102) 2024-08-20T01:52:10.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.959+0000 7f739effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acace11a0 0x564acacecbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:10.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.959+0000 7f739e7fc640 1 -- 172.21.15.79:0/864224586 learned_addr learned my addr 172.21.15.79:0/864224586 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:10.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.959+0000 7f739e7fc640 1 --2- 172.21.15.79:0/864224586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564acace0880 0x564acace0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:10.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.959+0000 7f739effd640 1 -- 172.21.15.79:0/864224586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564acace0880 msgr2=0x564acace0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:10.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.959+0000 7f739effd640 1 --2- 172.21.15.79:0/864224586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564acace0880 0x564acace0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:10.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.959+0000 7f739effd640 1 -- 172.21.15.79:0/864224586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564acaced130 msgr2=0x564acacef520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:10.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.959+0000 7f739effd640 1 --2- 172.21.15.79:0/864224586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564acaced130 0x564acacef520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:10.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.959+0000 7f7387fff640 1 --2- 172.21.15.79:0/2569734434 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f73880b3bd0 0x7f73880b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:10.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.959+0000 7f739effd640 1 -- 172.21.15.79:0/864224586 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564aca9a6650 con 0x564acace11a0 2024-08-20T01:52:10.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.959+0000 7f739e7fc640 1 --2- 172.21.15.79:0/864224586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564acaced130 0x564acacef520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:52:10.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.959+0000 7f739f7fe640 1 --2- 172.21.15.79:0/2569734434 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f73880b3bd0 0x7f73880b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:10.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.959+0000 7f739effd640 1 --2- 172.21.15.79:0/864224586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acace11a0 0x564acacecbf0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7390009c20 tx=0x7f7390011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51d3ee229a1fd801 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:10.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.959+0000 7f7387fff640 1 -- 172.21.15.79:0/2569734434 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f7398104fb0 con 0x7f73a0107d20 2024-08-20T01:52:10.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.960+0000 7f73857fa640 1 -- 172.21.15.79:0/864224586 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7390004050 con 0x564acace11a0 2024-08-20T01:52:10.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.960+0000 7f73857fa640 1 -- 172.21.15.79:0/864224586 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7390005020 con 0x564acace11a0 2024-08-20T01:52:10.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.960+0000 7f73857fa640 1 -- 172.21.15.79:0/864224586 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7390004b80 con 0x564acace11a0 2024-08-20T01:52:10.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.960+0000 7f73a79a8740 1 -- 172.21.15.79:0/864224586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acace11a0 msgr2=0x564acacecbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:10.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.960+0000 7f739f7fe640 1 --2- 172.21.15.79:0/2569734434 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f73880b3bd0 0x7f73880b6090 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f73980cbc10 tx=0x7f73980fbbf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:10.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.960+0000 7f73a79a8740 1 --2- 172.21.15.79:0/864224586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acace11a0 0x564acacecbf0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7390009c20 tx=0x7f7390011810 comp rx=0 tx=0).stop 2024-08-20T01:52:10.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.960+0000 7f73a79a8740 1 -- 172.21.15.79:0/864224586 shutdown_connections 2024-08-20T01:52:10.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.960+0000 7f73a79a8740 1 --2- 172.21.15.79:0/864224586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564acaced130 0x564acacef520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:10.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.960+0000 7f73a79a8740 1 --2- 172.21.15.79:0/864224586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acace11a0 0x564acacecbf0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:10.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.960+0000 7f73a79a8740 1 --2- 172.21.15.79:0/864224586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564acace0880 0x564acace0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:10.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.960+0000 7f73a79a8740 1 -- 172.21.15.79:0/864224586 >> 172.21.15.79:0/864224586 conn(0x564acacde6b0 msgr2=0x564acacdf850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:10.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.960+0000 7f73a79a8740 1 -- 172.21.15.79:0/864224586 shutdown_connections 2024-08-20T01:52:10.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.960+0000 7f73a79a8740 1 -- 172.21.15.79:0/864224586 wait complete. 2024-08-20T01:52:10.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.961+0000 7f73a79a8740 1 -- start start 2024-08-20T01:52:10.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.961+0000 7f73a79a8740 1 Processor -- start 2024-08-20T01:52:10.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.961+0000 7f73a79a8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564acace0880 0x564acacea070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:10.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.961+0000 7f73a79a8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acace11a0 0x564acacea5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:10.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.961+0000 7f73a79a8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564acaced130 0x564acaceaaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:10.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.961+0000 7f73a79a8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564acaaa9700 con 0x564acace0880 2024-08-20T01:52:10.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.961+0000 7f73a79a8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564acabcd810 con 0x564acace11a0 2024-08-20T01:52:10.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.961+0000 7f73a79a8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564acacefde0 con 0x564acaced130 2024-08-20T01:52:10.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.961+0000 7f73a79a8740 10 client.0 _ll_register_callbacks cb 0x564acac40700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:52:10.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.961+0000 7f739e7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564acace0880 0x564acacea070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:10.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.961+0000 7f739e7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564acace0880 0x564acacea070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48110/0 (socket says 172.21.15.79:48110) 2024-08-20T01:52:10.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.961+0000 7f739e7fc640 1 -- 172.21.15.79:0/2667579625 learned_addr learned my addr 172.21.15.79:0/2667579625 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:10.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.961+0000 7f739effd640 1 --2- 172.21.15.79:0/2667579625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acace11a0 0x564acacea5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:10.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.961+0000 7f739e7fc640 1 -- 172.21.15.79:0/2667579625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564acaced130 msgr2=0x564acaceaaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:10.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.961+0000 7f739e7fc640 1 --2- 172.21.15.79:0/2667579625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564acaced130 0x564acaceaaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:10.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.961+0000 7f739e7fc640 1 -- 172.21.15.79:0/2667579625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acace11a0 msgr2=0x564acacea5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:10.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.961+0000 7f739e7fc640 1 --2- 172.21.15.79:0/2667579625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acace11a0 0x564acacea5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:10.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.961+0000 7f739e7fc640 1 -- 172.21.15.79:0/2667579625 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564acacf9170 con 0x564acace0880 2024-08-20T01:52:10.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.962+0000 7f739e7fc640 1 --2- 172.21.15.79:0/2667579625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564acace0880 0x564acacea070 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f739400cf70 tx=0x7f7394014da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb8e9080ab37a9f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:10.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.962+0000 7f7382ff5640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:52:10.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.962+0000 7f7382ff5640 1 -- 172.21.15.79:0/2667579625 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7394012d70 con 0x564acace0880 2024-08-20T01:52:10.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.962+0000 7f7382ff5640 1 -- 172.21.15.79:0/2667579625 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f7394005020 con 0x564acace0880 2024-08-20T01:52:10.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.962+0000 7f73a79a8740 1 -- 172.21.15.79:0/2667579625 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564acabf6150 con 0x564acace0880 2024-08-20T01:52:10.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.962+0000 7f7382ff5640 1 -- 172.21.15.79:0/2667579625 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f7394005220 con 0x564acace0880 2024-08-20T01:52:10.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.962+0000 7f73a79a8740 10 client.19164 fetch_fsmap learned FSMap version 62 2024-08-20T01:52:10.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.962+0000 7f73a79a8740 1 -- 172.21.15.79:0/2667579625 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x564acacfbb20 con 0x564acace0880 2024-08-20T01:52:10.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.962+0000 7f7382ff5640 1 -- 172.21.15.79:0/2667579625 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x564acabf6150 con 0x564acace0880 2024-08-20T01:52:10.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.962+0000 7f7382ff5640 1 -- 172.21.15.79:0/2667579625 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 62) ==== 8406+0+0 (secure 0 0 0) 0x7f739400f4d0 con 0x564acace0880 2024-08-20T01:52:10.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.962+0000 7f73a79a8740 10 client.19164 fetch_fsmap finished waiting for FSMap version 62 2024-08-20T01:52:10.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.962+0000 7f73a79a8740 10 client.19164 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:52:10.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.962+0000 7f73a79a8740 20 client.19164 populate_metadata read hostname 'smithi079' 2024-08-20T01:52:10.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.962+0000 7f73a79a8740 1 --2- 172.21.15.79:0/2667579625 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x564acacfcfe0 0x564acacff3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:10.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.962+0000 7f73a79a8740 4 client.19164 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:52:10.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.963+0000 7f73a79a8740 1 -- 172.21.15.79:0/2667579625 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564acac59880 con 0x564acacfcfe0 2024-08-20T01:52:10.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.963+0000 7f739effd640 1 --2- 172.21.15.79:0/2667579625 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x564acacfcfe0 0x564acacff3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:10.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.963+0000 7f7382ff5640 10 client.19164 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:52:10.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.963+0000 7f739effd640 1 --2- 172.21.15.79:0/2667579625 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x564acacfcfe0 0x564acacff3d0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a4d8e03e21734234 server_cookie=a4f1ccafe9a5af9c in_seq=0 out_seq=0 2024-08-20T01:52:10.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.964+0000 7f7382ff5640 1 -- 172.21.15.79:0/2667579625 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564acac59880 con 0x564acacfcfe0 2024-08-20T01:52:10.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.964+0000 7f7382ff5640 10 client.19164 handle_command_reply: tid=0 2024-08-20T01:52:10.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.964+0000 7f73a79a8740 1 client.19164 shutdown 2024-08-20T01:52:10.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.964+0000 7f73a79a8740 1 -- 172.21.15.79:0/2667579625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564acace0880 msgr2=0x564acacea070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:10.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.964+0000 7f73a79a8740 1 --2- 172.21.15.79:0/2667579625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564acace0880 0x564acacea070 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f739400cf70 tx=0x7f7394014da0 comp rx=0 tx=0).stop 2024-08-20T01:52:10.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.964+0000 7f73a79a8740 1 -- 172.21.15.79:0/2667579625 shutdown_connections 2024-08-20T01:52:10.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.964+0000 7f73a79a8740 1 --2- 172.21.15.79:0/2667579625 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x564acacfcfe0 0x564acacff3d0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:10.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.964+0000 7f73a79a8740 1 --2- 172.21.15.79:0/2667579625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564acaced130 0x564acaceaaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:10.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.964+0000 7f73a79a8740 1 --2- 172.21.15.79:0/2667579625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acace11a0 0x564acacea5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:10.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.964+0000 7f7382ff5640 0 client.19164 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:52:10.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.964+0000 7f73a79a8740 1 --2- 172.21.15.79:0/2667579625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564acace0880 0x564acacea070 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:10.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.964+0000 7f73a79a8740 1 -- 172.21.15.79:0/2667579625 >> 172.21.15.79:0/2667579625 conn(0x564acacde6b0 msgr2=0x564acace4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:10.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.964+0000 7f73a79a8740 1 -- 172.21.15.79:0/2667579625 shutdown_connections 2024-08-20T01:52:10.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.964+0000 7f73a79a8740 1 -- 172.21.15.79:0/2667579625 wait complete. 2024-08-20T01:52:10.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.964+0000 7f73a79a8740 20 client.19164 trim_cache size 0 max 16384 2024-08-20T01:52:10.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.978+0000 7f73a79a8740 1 Processor -- start 2024-08-20T01:52:10.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.978+0000 7f73a79a8740 1 -- start start 2024-08-20T01:52:10.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.978+0000 7f73a79a8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acace0880 0x564acace4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:10.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.978+0000 7f73a79a8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564acace11a0 0x564acacebdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:10.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.978+0000 7f73a79a8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564acaced130 0x564acad04c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:10.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.978+0000 7f73a79a8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f73a01b0150 con 0x564acace11a0 2024-08-20T01:52:10.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.978+0000 7f73a79a8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f73a01b1e40 con 0x564acace0880 2024-08-20T01:52:10.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.978+0000 7f73a79a8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f73a01b0850 con 0x564acaced130 2024-08-20T01:52:10.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.978+0000 7f739effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564acace11a0 0x564acacebdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:10.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.978+0000 7f739effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564acace11a0 0x564acacebdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48126/0 (socket says 172.21.15.79:48126) 2024-08-20T01:52:10.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.978+0000 7f739effd640 1 -- 172.21.15.79:0/3688029093 learned_addr learned my addr 172.21.15.79:0/3688029093 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:10.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.979+0000 7f739e7fc640 1 --2- 172.21.15.79:0/3688029093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acace0880 0x564acace4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:10.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.979+0000 7f739e7fc640 1 --2- 172.21.15.79:0/3688029093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564acaced130 0x564acad04c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:10.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.979+0000 7f739effd640 1 -- 172.21.15.79:0/3688029093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564acaced130 msgr2=0x564acad04c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:10.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.979+0000 7f739effd640 1 --2- 172.21.15.79:0/3688029093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564acaced130 0x564acad04c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:10.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.979+0000 7f739effd640 1 -- 172.21.15.79:0/3688029093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acace0880 msgr2=0x564acace4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:10.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.979+0000 7f739effd640 1 --2- 172.21.15.79:0/3688029093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acace0880 0x564acace4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:10.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.979+0000 7f739effd640 1 -- 172.21.15.79:0/3688029093 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564acacffa30 con 0x564acace11a0 2024-08-20T01:52:10.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.979+0000 7f739e7fc640 1 --2- 172.21.15.79:0/3688029093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acace0880 0x564acace4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:52:10.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.979+0000 7f739effd640 1 --2- 172.21.15.79:0/3688029093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564acace11a0 0x564acacebdb0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f7390009b40 tx=0x7f73900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66038305c91160f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:10.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.979+0000 7f7384ff9640 1 -- 172.21.15.79:0/3688029093 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7390033070 con 0x564acace11a0 2024-08-20T01:52:10.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.979+0000 7f7384ff9640 1 -- 172.21.15.79:0/3688029093 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f73900035f0 con 0x564acace11a0 2024-08-20T01:52:10.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.979+0000 7f7384ff9640 1 -- 172.21.15.79:0/3688029093 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f739002e640 con 0x564acace11a0 2024-08-20T01:52:10.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.980+0000 7f73a79a8740 1 -- 172.21.15.79:0/3688029093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564acace11a0 msgr2=0x564acacebdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:10.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.980+0000 7f73a79a8740 1 --2- 172.21.15.79:0/3688029093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564acace11a0 0x564acacebdb0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f7390009b40 tx=0x7f73900046c0 comp rx=0 tx=0).stop 2024-08-20T01:52:10.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.980+0000 7f73a79a8740 1 -- 172.21.15.79:0/3688029093 shutdown_connections 2024-08-20T01:52:10.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.980+0000 7f73a79a8740 1 --2- 172.21.15.79:0/3688029093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564acaced130 0x564acad04c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:10.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.980+0000 7f73a79a8740 1 --2- 172.21.15.79:0/3688029093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564acace11a0 0x564acacebdb0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:10.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.980+0000 7f73a79a8740 1 --2- 172.21.15.79:0/3688029093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acace0880 0x564acace4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:10.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.980+0000 7f73a79a8740 1 -- 172.21.15.79:0/3688029093 >> 172.21.15.79:0/3688029093 conn(0x564acacde6b0 msgr2=0x564acaceb6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:10.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.980+0000 7f73a79a8740 1 -- 172.21.15.79:0/3688029093 shutdown_connections 2024-08-20T01:52:10.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.980+0000 7f73a79a8740 1 -- 172.21.15.79:0/3688029093 wait complete. 2024-08-20T01:52:10.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.980+0000 7f73a79a8740 1 -- start start 2024-08-20T01:52:10.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.980+0000 7f73a79a8740 1 Processor -- start 2024-08-20T01:52:10.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.980+0000 7f73a79a8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564acace0880 0x564acacf0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:10.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.980+0000 7f73a79a8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acace11a0 0x564acacf0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:10.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.980+0000 7f73a79a8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564acaced130 0x564acad68490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:10.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.980+0000 7f73a79a8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f73a01b16b0 con 0x564acace0880 2024-08-20T01:52:10.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.980+0000 7f73a79a8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f73a01b0fb0 con 0x564acace11a0 2024-08-20T01:52:10.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.980+0000 7f73a79a8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f73a01ae130 con 0x564acaced130 2024-08-20T01:52:10.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.980+0000 7f73a79a8740 10 client.0 _ll_register_callbacks cb 0x7f739400ce70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:52:10.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.980+0000 7f739e7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564acace0880 0x564acacf0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:10.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.981+0000 7f739e7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564acace0880 0x564acacf0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48138/0 (socket says 172.21.15.79:48138) 2024-08-20T01:52:10.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.981+0000 7f739e7fc640 1 -- 172.21.15.79:0/3751313204 learned_addr learned my addr 172.21.15.79:0/3751313204 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:10.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.981+0000 7f739effd640 1 --2- 172.21.15.79:0/3751313204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acace11a0 0x564acacf0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:10.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.981+0000 7f739e7fc640 1 --2- 172.21.15.79:0/3751313204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564acaced130 0x564acad68490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:10.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.981+0000 7f739e7fc640 1 -- 172.21.15.79:0/3751313204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564acaced130 msgr2=0x564acad68490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:10.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.981+0000 7f739e7fc640 1 --2- 172.21.15.79:0/3751313204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564acaced130 0x564acad68490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:10.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.981+0000 7f739e7fc640 1 -- 172.21.15.79:0/3751313204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acace11a0 msgr2=0x564acacf0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:10.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.981+0000 7f739e7fc640 1 --2- 172.21.15.79:0/3751313204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acace11a0 0x564acacf0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:10.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.981+0000 7f739e7fc640 1 -- 172.21.15.79:0/3751313204 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564acad68ba0 con 0x564acace0880 2024-08-20T01:52:10.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.981+0000 7f739effd640 1 --2- 172.21.15.79:0/3751313204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acace11a0 0x564acacf0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:52:10.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.981+0000 7f739e7fc640 1 --2- 172.21.15.79:0/3751313204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564acace0880 0x564acacf0950 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f7394014440 tx=0x7f73940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d1502f908999ca4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:10.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.981+0000 7f7382ff5640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:52:10.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.981+0000 7f7382ff5640 1 -- 172.21.15.79:0/3751313204 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f739400f640 con 0x564acace0880 2024-08-20T01:52:10.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.981+0000 7f7382ff5640 1 -- 172.21.15.79:0/3751313204 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f739400fb30 con 0x564acace0880 2024-08-20T01:52:10.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.981+0000 7f73a79a8740 1 -- 172.21.15.79:0/3751313204 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73900035f0 con 0x564acace0880 2024-08-20T01:52:10.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.981+0000 7f7382ff5640 1 -- 172.21.15.79:0/3751313204 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f7394004940 con 0x564acace0880 2024-08-20T01:52:10.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.981+0000 7f73a79a8740 10 client.19170 fetch_fsmap learned FSMap version 62 2024-08-20T01:52:10.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.981+0000 7f73a79a8740 1 -- 172.21.15.79:0/3751313204 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x564acad70030 con 0x564acace0880 2024-08-20T01:52:10.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.982+0000 7f7382ff5640 1 -- 172.21.15.79:0/3751313204 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f73900035f0 con 0x564acace0880 2024-08-20T01:52:10.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.982+0000 7f7382ff5640 1 -- 172.21.15.79:0/3751313204 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 62) ==== 8406+0+0 (secure 0 0 0) 0x7f7394004d30 con 0x564acace0880 2024-08-20T01:52:10.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.982+0000 7f73a79a8740 10 client.19170 fetch_fsmap finished waiting for FSMap version 62 2024-08-20T01:52:10.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.982+0000 7f73a79a8740 10 client.19170 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:52:10.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.982+0000 7f73a79a8740 20 client.19170 populate_metadata read hostname 'smithi079' 2024-08-20T01:52:10.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.982+0000 7f73a79a8740 1 --2- 172.21.15.79:0/3751313204 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x564acad70840 0x564acad72c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:10.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.982+0000 7f73a79a8740 4 client.19170 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:52:10.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.982+0000 7f73a79a8740 1 -- 172.21.15.79:0/3751313204 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564acac55320 con 0x564acad70840 2024-08-20T01:52:10.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.982+0000 7f739effd640 1 --2- 172.21.15.79:0/3751313204 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x564acad70840 0x564acad72c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:10.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.982+0000 7f739effd640 1 --2- 172.21.15.79:0/3751313204 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x564acad70840 0x564acad72c60 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2803038d1bb1e0c server_cookie=505a496dedaddcd1 in_seq=0 out_seq=0 2024-08-20T01:52:10.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.982+0000 7f7382ff5640 10 client.19170 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:52:10.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.983+0000 7f7382ff5640 1 -- 172.21.15.79:0/3751313204 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564acac55320 con 0x564acad70840 2024-08-20T01:52:10.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.983+0000 7f7382ff5640 10 client.19170 handle_command_reply: tid=0 2024-08-20T01:52:10.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.983+0000 7f73a79a8740 1 client.19170 shutdown 2024-08-20T01:52:10.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.983+0000 7f73a79a8740 1 -- 172.21.15.79:0/3751313204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564acace0880 msgr2=0x564acacf0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:10.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.983+0000 7f73a79a8740 1 --2- 172.21.15.79:0/3751313204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564acace0880 0x564acacf0950 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f7394014440 tx=0x7f73940046c0 comp rx=0 tx=0).stop 2024-08-20T01:52:10.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.983+0000 7f73a79a8740 1 -- 172.21.15.79:0/3751313204 shutdown_connections 2024-08-20T01:52:10.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.983+0000 7f73a79a8740 1 --2- 172.21.15.79:0/3751313204 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x564acad70840 0x564acad72c60 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:10.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.983+0000 7f73a79a8740 1 --2- 172.21.15.79:0/3751313204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564acaced130 0x564acad68490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:10.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.983+0000 7f73a79a8740 1 --2- 172.21.15.79:0/3751313204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acace11a0 0x564acacf0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:10.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.983+0000 7f7382ff5640 0 client.19170 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:52:10.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.983+0000 7f73a79a8740 1 --2- 172.21.15.79:0/3751313204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564acace0880 0x564acacf0950 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:10.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.983+0000 7f73a79a8740 1 -- 172.21.15.79:0/3751313204 >> 172.21.15.79:0/3751313204 conn(0x564acacde6b0 msgr2=0x564acacea800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:10.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.983+0000 7f73a79a8740 1 -- 172.21.15.79:0/3751313204 shutdown_connections 2024-08-20T01:52:10.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.983+0000 7f73a79a8740 1 -- 172.21.15.79:0/3751313204 wait complete. 2024-08-20T01:52:10.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.983+0000 7f73a79a8740 20 client.19170 trim_cache size 0 max 16384 2024-08-20T01:52:10.994 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:52:10.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.983+0000 7f73a55af640 1 -- 172.21.15.79:0/2569734434 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f73880b3bd0 msgr2=0x7f73880b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:10.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.983+0000 7f73a55af640 1 --2- 172.21.15.79:0/2569734434 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f73880b3bd0 0x7f73880b6090 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f73980cbc10 tx=0x7f73980fbbf0 comp rx=0 tx=0).stop 2024-08-20T01:52:10.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.983+0000 7f73a55af640 1 -- 172.21.15.79:0/2569734434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73a0107d20 msgr2=0x7f73a01a0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:10.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.983+0000 7f73a55af640 1 --2- 172.21.15.79:0/2569734434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73a0107d20 0x7f73a01a0960 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f7398005e30 tx=0x7f73980093d0 comp rx=0 tx=0).stop 2024-08-20T01:52:10.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.983+0000 7f73a55af640 1 -- 172.21.15.79:0/2569734434 shutdown_connections 2024-08-20T01:52:10.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.983+0000 7f73a55af640 1 --2- 172.21.15.79:0/2569734434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73a0107d20 0x7f73a01a0960 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:10.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.983+0000 7f73a55af640 1 --2- 172.21.15.79:0/2569734434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73a01073a0 0x7f73a019b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:10.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.983+0000 7f73a55af640 1 --2- 172.21.15.79:0/2569734434 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f73880b3bd0 0x7f73880b6090 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:10.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.983+0000 7f73a55af640 1 --2- 172.21.15.79:0/2569734434 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73a0101990 0x7f73a019b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:10.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.984+0000 7f73a55af640 1 -- 172.21.15.79:0/2569734434 >> 172.21.15.79:0/2569734434 conn(0x7f73a00fd400 msgr2=0x7f73a006afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:10.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.984+0000 7f73a55af640 1 -- 172.21.15.79:0/2569734434 shutdown_connections 2024-08-20T01:52:10.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:10.984+0000 7f73a55af640 1 -- 172.21.15.79:0/2569734434 wait complete. 2024-08-20T01:52:11.702 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T01:52:11.955 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:52:12.330 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:12 smithi081 ceph-mon[22209]: pgmap v793: 97 pgs: 97 active+clean; 9.7 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.0 KiB/s wr, 16 op/s 2024-08-20T01:52:12.364 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:12 smithi079 ceph-mon[18656]: pgmap v793: 97 pgs: 97 active+clean; 9.7 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.0 KiB/s wr, 16 op/s 2024-08-20T01:52:12.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:12 smithi175 ceph-mon[22392]: pgmap v793: 97 pgs: 97 active+clean; 9.7 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.0 KiB/s wr, 16 op/s 2024-08-20T01:52:12.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.444+0000 7f25ba8d9640 1 -- 172.21.15.79:0/3243974007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25b4101990 msgr2=0x7f25b4101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:12.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.444+0000 7f25ba8d9640 1 --2- 172.21.15.79:0/3243974007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25b4101990 0x7f25b4101d70 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f25a4009900 tx=0x7f25a402a410 comp rx=0 tx=0).stop 2024-08-20T01:52:12.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.444+0000 7f25ba8d9640 1 -- 172.21.15.79:0/3243974007 shutdown_connections 2024-08-20T01:52:12.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.444+0000 7f25ba8d9640 1 --2- 172.21.15.79:0/3243974007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25b4107d20 0x7f25b410e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:12.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.444+0000 7f25ba8d9640 1 --2- 172.21.15.79:0/3243974007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25b41073a0 0x7f25b41077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:12.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.444+0000 7f25ba8d9640 1 --2- 172.21.15.79:0/3243974007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25b4101990 0x7f25b4101d70 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:12.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.444+0000 7f25ba8d9640 1 -- 172.21.15.79:0/3243974007 >> 172.21.15.79:0/3243974007 conn(0x7f25b40fd400 msgr2=0x7f25b40ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:12.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.444+0000 7f25ba8d9640 1 -- 172.21.15.79:0/3243974007 shutdown_connections 2024-08-20T01:52:12.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.444+0000 7f25ba8d9640 1 -- 172.21.15.79:0/3243974007 wait complete. 2024-08-20T01:52:12.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.444+0000 7f25ba8d9640 1 Processor -- start 2024-08-20T01:52:12.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.445+0000 7f25ba8d9640 1 -- start start 2024-08-20T01:52:12.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.445+0000 7f25ba8d9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25b4101990 0x7f25b4199ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:12.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.445+0000 7f25ba8d9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25b41073a0 0x7f25b419a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:12.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.445+0000 7f25ba8d9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25b4107d20 0x7f25b41a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:12.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.445+0000 7f25ba8d9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f25b4111850 con 0x7f25b41073a0 2024-08-20T01:52:12.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.445+0000 7f25ba8d9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f25b41116d0 con 0x7f25b4101990 2024-08-20T01:52:12.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.445+0000 7f25ba8d9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f25b41119d0 con 0x7f25b4107d20 2024-08-20T01:52:12.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.445+0000 7f25b37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25b41073a0 0x7f25b419a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:12.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.445+0000 7f25b37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25b41073a0 0x7f25b419a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48156/0 (socket says 172.21.15.79:48156) 2024-08-20T01:52:12.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.445+0000 7f25b37fe640 1 -- 172.21.15.79:0/3713271290 learned_addr learned my addr 172.21.15.79:0/3713271290 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:12.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.445+0000 7f25b8e76640 1 --2- 172.21.15.79:0/3713271290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25b4107d20 0x7f25b41a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:12.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.445+0000 7f25b3fff640 1 --2- 172.21.15.79:0/3713271290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25b4101990 0x7f25b4199ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:12.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.445+0000 7f25b37fe640 1 -- 172.21.15.79:0/3713271290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25b4107d20 msgr2=0x7f25b41a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:12.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.445+0000 7f25b37fe640 1 --2- 172.21.15.79:0/3713271290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25b4107d20 0x7f25b41a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:12.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.445+0000 7f25b37fe640 1 -- 172.21.15.79:0/3713271290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25b4101990 msgr2=0x7f25b4199ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:12.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.445+0000 7f25b37fe640 1 --2- 172.21.15.79:0/3713271290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25b4101990 0x7f25b4199ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:12.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.445+0000 7f25b37fe640 1 -- 172.21.15.79:0/3713271290 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25b41a5260 con 0x7f25b41073a0 2024-08-20T01:52:12.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.445+0000 7f25b3fff640 1 --2- 172.21.15.79:0/3713271290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25b4101990 0x7f25b4199ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:52:12.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.446+0000 7f25b37fe640 1 --2- 172.21.15.79:0/3713271290 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25b41073a0 0x7f25b419a1e0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f25a800d950 tx=0x7f25a800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:12.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.446+0000 7f25b17fa640 1 -- 172.21.15.79:0/3713271290 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a8017070 con 0x7f25b41073a0 2024-08-20T01:52:12.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.446+0000 7f25b17fa640 1 -- 172.21.15.79:0/3713271290 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f25a8009c30 con 0x7f25b41073a0 2024-08-20T01:52:12.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.446+0000 7f25b17fa640 1 -- 172.21.15.79:0/3713271290 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a800f620 con 0x7f25b41073a0 2024-08-20T01:52:12.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.446+0000 7f25ba8d9640 1 -- 172.21.15.79:0/3713271290 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25b41a5430 con 0x7f25b41073a0 2024-08-20T01:52:12.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.446+0000 7f25ba8d9640 1 -- 172.21.15.79:0/3713271290 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25b41a5910 con 0x7f25b41073a0 2024-08-20T01:52:12.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.448+0000 7f25b17fa640 1 -- 172.21.15.79:0/3713271290 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f25a8010460 con 0x7f25b41073a0 2024-08-20T01:52:12.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.448+0000 7f25bccd2740 1 Processor -- start 2024-08-20T01:52:12.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.448+0000 7f25bccd2740 1 -- start start 2024-08-20T01:52:12.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.448+0000 7f25bccd2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a09627880 0x560a09627c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:12.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.448+0000 7f25bccd2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a096281a0 0x560a09633bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:12.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.448+0000 7f25bccd2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a09634130 0x560a09636520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:12.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.448+0000 7f25bccd2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560a0959e930 con 0x560a096281a0 2024-08-20T01:52:12.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.448+0000 7f25bccd2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560a0958de30 con 0x560a09627880 2024-08-20T01:52:12.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.448+0000 7f25bccd2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560a09591e70 con 0x560a09634130 2024-08-20T01:52:12.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.449+0000 7f25b3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a096281a0 0x560a09633bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:12.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.449+0000 7f25b8e76640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a09627880 0x560a09627c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:12.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.449+0000 7f25b3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a096281a0 0x560a09633bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48170/0 (socket says 172.21.15.79:48170) 2024-08-20T01:52:12.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.449+0000 7f25b3fff640 1 -- 172.21.15.79:0/2425911836 learned_addr learned my addr 172.21.15.79:0/2425911836 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:12.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.449+0000 7f25b37fe640 1 --2- 172.21.15.79:0/2425911836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a09634130 0x560a09636520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:12.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.449+0000 7f25b8e76640 1 -- 172.21.15.79:0/2425911836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a09634130 msgr2=0x560a09636520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:12.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.449+0000 7f25b8e76640 1 --2- 172.21.15.79:0/2425911836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a09634130 0x560a09636520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:12.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.449+0000 7f25b8e76640 1 -- 172.21.15.79:0/2425911836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a096281a0 msgr2=0x560a09633bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:12.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.449+0000 7f25b8e76640 1 --2- 172.21.15.79:0/2425911836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a096281a0 0x560a09633bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:12.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.449+0000 7f25b8e76640 1 -- 172.21.15.79:0/2425911836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a092ed650 con 0x560a09627880 2024-08-20T01:52:12.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.449+0000 7f25b3fff640 1 --2- 172.21.15.79:0/2425911836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a096281a0 0x560a09633bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:52:12.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.449+0000 7f25b17fa640 1 --2- 172.21.15.79:0/3713271290 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f259c0b3bd0 0x7f259c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:12.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.449+0000 7f25b37fe640 1 --2- 172.21.15.79:0/2425911836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a09634130 0x560a09636520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:52:12.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.449+0000 7f25b8e76640 1 --2- 172.21.15.79:0/2425911836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a09627880 0x560a09627c60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f25ac009f00 tx=0x7f25ac011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee8071fcab78ef44 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:12.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.449+0000 7f25b3fff640 1 --2- 172.21.15.79:0/3713271290 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f259c0b3bd0 0x7f259c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:12.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.449+0000 7f25b17fa640 1 -- 172.21.15.79:0/3713271290 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f25a80e37c0 con 0x7f25b41073a0 2024-08-20T01:52:12.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.449+0000 7f259a7fc640 1 -- 172.21.15.79:0/2425911836 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ac004d20 con 0x560a09627880 2024-08-20T01:52:12.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.449+0000 7f259a7fc640 1 -- 172.21.15.79:0/2425911836 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f25ac004030 con 0x560a09627880 2024-08-20T01:52:12.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.449+0000 7f259a7fc640 1 -- 172.21.15.79:0/2425911836 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ac005260 con 0x560a09627880 2024-08-20T01:52:12.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.450+0000 7f25bccd2740 1 -- 172.21.15.79:0/2425911836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a09627880 msgr2=0x560a09627c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:12.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.450+0000 7f25b3fff640 1 --2- 172.21.15.79:0/3713271290 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f259c0b3bd0 0x7f259c0b6090 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f25a40096c0 tx=0x7f25a4005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:12.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.450+0000 7f25bccd2740 1 --2- 172.21.15.79:0/2425911836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a09627880 0x560a09627c60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f25ac009f00 tx=0x7f25ac011810 comp rx=0 tx=0).stop 2024-08-20T01:52:12.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.450+0000 7f25bccd2740 1 -- 172.21.15.79:0/2425911836 shutdown_connections 2024-08-20T01:52:12.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.450+0000 7f25bccd2740 1 --2- 172.21.15.79:0/2425911836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a09634130 0x560a09636520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:12.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.450+0000 7f25bccd2740 1 --2- 172.21.15.79:0/2425911836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a096281a0 0x560a09633bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:12.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.450+0000 7f25bccd2740 1 --2- 172.21.15.79:0/2425911836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a09627880 0x560a09627c60 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:12.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.450+0000 7f25bccd2740 1 -- 172.21.15.79:0/2425911836 >> 172.21.15.79:0/2425911836 conn(0x560a096256b0 msgr2=0x560a09626850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:12.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.450+0000 7f25bccd2740 1 -- 172.21.15.79:0/2425911836 shutdown_connections 2024-08-20T01:52:12.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.450+0000 7f25bccd2740 1 -- 172.21.15.79:0/2425911836 wait complete. 2024-08-20T01:52:12.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.451+0000 7f25bccd2740 1 -- start start 2024-08-20T01:52:12.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.451+0000 7f25bccd2740 1 Processor -- start 2024-08-20T01:52:12.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.451+0000 7f25bccd2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a09627880 0x560a09631110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:12.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.451+0000 7f25bccd2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a096281a0 0x560a09631650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:12.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.451+0000 7f25bccd2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a09634130 0x560a09631b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:12.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.451+0000 7f25bccd2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560a093f0700 con 0x560a09634130 2024-08-20T01:52:12.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.451+0000 7f25bccd2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560a09514810 con 0x560a09627880 2024-08-20T01:52:12.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.451+0000 7f25bccd2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560a09636de0 con 0x560a096281a0 2024-08-20T01:52:12.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.451+0000 7f25bccd2740 10 client.0 _ll_register_callbacks cb 0x560a09587700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:52:12.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.451+0000 7f25b3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a09627880 0x560a09631110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:12.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.451+0000 7f25b3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a09627880 0x560a09631110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:36016/0 (socket says 172.21.15.79:36016) 2024-08-20T01:52:12.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.451+0000 7f25b3fff640 1 -- 172.21.15.79:0/2318626858 learned_addr learned my addr 172.21.15.79:0/2318626858 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:12.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.451+0000 7f25b8e76640 1 --2- 172.21.15.79:0/2318626858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a09634130 0x560a09631b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:12.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.451+0000 7f25b37fe640 1 --2- 172.21.15.79:0/2318626858 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a096281a0 0x560a09631650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:12.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.451+0000 7f25b3fff640 1 -- 172.21.15.79:0/2318626858 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a096281a0 msgr2=0x560a09631650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:12.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.451+0000 7f25b3fff640 1 --2- 172.21.15.79:0/2318626858 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a096281a0 0x560a09631650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:12.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.451+0000 7f25b3fff640 1 -- 172.21.15.79:0/2318626858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a09634130 msgr2=0x560a09631b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:12.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.451+0000 7f25b3fff640 1 --2- 172.21.15.79:0/2318626858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a09634130 0x560a09631b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:12.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.451+0000 7f25b3fff640 1 -- 172.21.15.79:0/2318626858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a096401e0 con 0x560a09627880 2024-08-20T01:52:12.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.452+0000 7f25b3fff640 1 --2- 172.21.15.79:0/2318626858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a09627880 0x560a09631110 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f25a4000c00 tx=0x7f25a4009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b21d6fd28cbdce3d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:12.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.452+0000 7f25937fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:52:12.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.452+0000 7f25937fe640 1 -- 172.21.15.79:0/2318626858 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a404c030 con 0x560a09627880 2024-08-20T01:52:12.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.452+0000 7f25937fe640 1 -- 172.21.15.79:0/2318626858 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f25a4005020 con 0x560a09627880 2024-08-20T01:52:12.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.452+0000 7f25bccd2740 1 -- 172.21.15.79:0/2318626858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560a0953d150 con 0x560a09627880 2024-08-20T01:52:12.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.452+0000 7f25937fe640 1 -- 172.21.15.79:0/2318626858 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f25a4058050 con 0x560a09627880 2024-08-20T01:52:12.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.452+0000 7f25bccd2740 10 client.28292 fetch_fsmap learned FSMap version 62 2024-08-20T01:52:12.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.452+0000 7f25bccd2740 1 -- 172.21.15.79:0/2318626858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x560a09642b90 con 0x560a09627880 2024-08-20T01:52:12.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.452+0000 7f25937fe640 1 -- 172.21.15.79:0/2318626858 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x560a0953d150 con 0x560a09627880 2024-08-20T01:52:12.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.452+0000 7f25937fe640 1 -- 172.21.15.79:0/2318626858 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 62) ==== 8406+0+0 (secure 0 0 0) 0x7f25a40035f0 con 0x560a09627880 2024-08-20T01:52:12.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.452+0000 7f25bccd2740 10 client.28292 fetch_fsmap finished waiting for FSMap version 62 2024-08-20T01:52:12.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.452+0000 7f25bccd2740 10 client.28292 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:52:12.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.452+0000 7f25bccd2740 20 client.28292 populate_metadata read hostname 'smithi079' 2024-08-20T01:52:12.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.452+0000 7f25bccd2740 1 --2- 172.21.15.79:0/2318626858 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x560a096440b0 0x560a096464a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:12.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.452+0000 7f25bccd2740 4 client.28292 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:52:12.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.452+0000 7f25bccd2740 1 -- 172.21.15.79:0/2318626858 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560a095a0880 con 0x560a096440b0 2024-08-20T01:52:12.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.453+0000 7f25b37fe640 1 --2- 172.21.15.79:0/2318626858 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x560a096440b0 0x560a096464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:12.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.453+0000 7f25937fe640 10 client.28292 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:52:12.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.453+0000 7f25b37fe640 1 --2- 172.21.15.79:0/2318626858 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x560a096440b0 0x560a096464a0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e4ccd6e5f5318d50 server_cookie=afcc10283d43e513 in_seq=0 out_seq=0 2024-08-20T01:52:12.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.454+0000 7f25937fe640 1 -- 172.21.15.79:0/2318626858 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560a095a0880 con 0x560a096440b0 2024-08-20T01:52:12.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.454+0000 7f25937fe640 10 client.28292 handle_command_reply: tid=0 2024-08-20T01:52:12.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.454+0000 7f25bccd2740 1 client.28292 shutdown 2024-08-20T01:52:12.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.454+0000 7f25bccd2740 1 -- 172.21.15.79:0/2318626858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a09627880 msgr2=0x560a09631110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:12.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.454+0000 7f25bccd2740 1 --2- 172.21.15.79:0/2318626858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a09627880 0x560a09631110 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f25a4000c00 tx=0x7f25a4009260 comp rx=0 tx=0).stop 2024-08-20T01:52:12.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.454+0000 7f25bccd2740 1 -- 172.21.15.79:0/2318626858 shutdown_connections 2024-08-20T01:52:12.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.454+0000 7f25bccd2740 1 --2- 172.21.15.79:0/2318626858 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x560a096440b0 0x560a096464a0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:12.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.454+0000 7f25bccd2740 1 --2- 172.21.15.79:0/2318626858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a09634130 0x560a09631b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:12.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.454+0000 7f25bccd2740 1 --2- 172.21.15.79:0/2318626858 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a096281a0 0x560a09631650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:12.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.454+0000 7f25937fe640 0 client.28292 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:52:12.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.454+0000 7f25bccd2740 1 --2- 172.21.15.79:0/2318626858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a09627880 0x560a09631110 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:12.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.454+0000 7f25bccd2740 1 -- 172.21.15.79:0/2318626858 >> 172.21.15.79:0/2318626858 conn(0x560a096256b0 msgr2=0x560a0962b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:12.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.454+0000 7f25bccd2740 1 -- 172.21.15.79:0/2318626858 shutdown_connections 2024-08-20T01:52:12.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.454+0000 7f25bccd2740 1 -- 172.21.15.79:0/2318626858 wait complete. 2024-08-20T01:52:12.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.454+0000 7f25bccd2740 20 client.28292 trim_cache size 0 max 16384 2024-08-20T01:52:12.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.467+0000 7f25bccd2740 1 Processor -- start 2024-08-20T01:52:12.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.467+0000 7f25bccd2740 1 -- start start 2024-08-20T01:52:12.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.467+0000 7f25bccd2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a09627880 0x560a09626de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:12.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.467+0000 7f25bccd2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a096281a0 0x560a0962b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:12.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.467+0000 7f25bccd2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a09634130 0x560a09632e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:12.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.467+0000 7f25bccd2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f25b41ae020 con 0x560a09634130 2024-08-20T01:52:12.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.467+0000 7f25bccd2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f25b41afd10 con 0x560a096281a0 2024-08-20T01:52:12.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.467+0000 7f25bccd2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f25b41ae720 con 0x560a09627880 2024-08-20T01:52:12.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.467+0000 7f25b8e76640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a09634130 0x560a09632e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:12.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.467+0000 7f25b3fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a09627880 0x560a09626de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:12.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.467+0000 7f25b8e76640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a09634130 0x560a09632e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48188/0 (socket says 172.21.15.79:48188) 2024-08-20T01:52:12.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.467+0000 7f25b3fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a09627880 0x560a09626de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:55770/0 (socket says 172.21.15.79:55770) 2024-08-20T01:52:12.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.467+0000 7f25b8e76640 1 -- 172.21.15.79:0/1096662016 learned_addr learned my addr 172.21.15.79:0/1096662016 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:12.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.467+0000 7f25b37fe640 1 --2- 172.21.15.79:0/1096662016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a096281a0 0x560a0962b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:12.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.467+0000 7f25b8e76640 1 -- 172.21.15.79:0/1096662016 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a09627880 msgr2=0x560a09626de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:12.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.467+0000 7f25b8e76640 1 --2- 172.21.15.79:0/1096662016 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a09627880 0x560a09626de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:12.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.467+0000 7f25b8e76640 1 -- 172.21.15.79:0/1096662016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a096281a0 msgr2=0x560a0962b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:12.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.467+0000 7f25b8e76640 1 --2- 172.21.15.79:0/1096662016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a096281a0 0x560a0962b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:12.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.467+0000 7f25b8e76640 1 -- 172.21.15.79:0/1096662016 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a09626130 con 0x560a09634130 2024-08-20T01:52:12.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.467+0000 7f25b3fff640 1 --2- 172.21.15.79:0/1096662016 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a09627880 0x560a09626de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:52:12.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.468+0000 7f25b8e76640 1 --2- 172.21.15.79:0/1096662016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a09634130 0x560a09632e50 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f25ac000f80 tx=0x7f25ac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c675a1028f682e48 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:12.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.468+0000 7f2599ffb640 1 -- 172.21.15.79:0/1096662016 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ac027020 con 0x560a09634130 2024-08-20T01:52:12.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.468+0000 7f2599ffb640 1 -- 172.21.15.79:0/1096662016 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f25ac005040 con 0x560a09634130 2024-08-20T01:52:12.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.468+0000 7f2599ffb640 1 -- 172.21.15.79:0/1096662016 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ac0236d0 con 0x560a09634130 2024-08-20T01:52:12.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.468+0000 7f25bccd2740 1 -- 172.21.15.79:0/1096662016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a09634130 msgr2=0x560a09632e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:12.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.468+0000 7f25bccd2740 1 --2- 172.21.15.79:0/1096662016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a09634130 0x560a09632e50 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f25ac000f80 tx=0x7f25ac009c00 comp rx=0 tx=0).stop 2024-08-20T01:52:12.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.468+0000 7f25bccd2740 1 -- 172.21.15.79:0/1096662016 shutdown_connections 2024-08-20T01:52:12.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.468+0000 7f25bccd2740 1 --2- 172.21.15.79:0/1096662016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a09634130 0x560a09632e50 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:12.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.468+0000 7f25bccd2740 1 --2- 172.21.15.79:0/1096662016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a096281a0 0x560a0962b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:12.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.468+0000 7f25bccd2740 1 --2- 172.21.15.79:0/1096662016 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a09627880 0x560a09626de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:12.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.468+0000 7f25bccd2740 1 -- 172.21.15.79:0/1096662016 >> 172.21.15.79:0/1096662016 conn(0x560a096256b0 msgr2=0x560a09632740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:12.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.468+0000 7f25bccd2740 1 -- 172.21.15.79:0/1096662016 shutdown_connections 2024-08-20T01:52:12.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.468+0000 7f25bccd2740 1 -- 172.21.15.79:0/1096662016 wait complete. 2024-08-20T01:52:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.469+0000 7f25bccd2740 1 -- start start 2024-08-20T01:52:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.469+0000 7f25bccd2740 1 Processor -- start 2024-08-20T01:52:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.469+0000 7f25bccd2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a09627880 0x560a09637820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.469+0000 7f25bccd2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a096281a0 0x560a09637d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.469+0000 7f25bccd2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a09634130 0x560a096acd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.469+0000 7f25bccd2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f25b41af580 con 0x560a09627880 2024-08-20T01:52:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.469+0000 7f25bccd2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f25b41aee80 con 0x560a096281a0 2024-08-20T01:52:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.469+0000 7f25bccd2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f25b41ac000 con 0x560a09634130 2024-08-20T01:52:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.469+0000 7f25bccd2740 10 client.0 _ll_register_callbacks cb 0x7f25a4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:52:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.469+0000 7f25b3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a09627880 0x560a09637820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.470+0000 7f25b3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a09627880 0x560a09637820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48196/0 (socket says 172.21.15.79:48196) 2024-08-20T01:52:12.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.470+0000 7f25b3fff640 1 -- 172.21.15.79:0/2492601608 learned_addr learned my addr 172.21.15.79:0/2492601608 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:12.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.470+0000 7f25b8e76640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a09634130 0x560a096acd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:12.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.470+0000 7f25b37fe640 1 --2- 172.21.15.79:0/2492601608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a096281a0 0x560a09637d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:12.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.470+0000 7f25b3fff640 1 -- 172.21.15.79:0/2492601608 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a09634130 msgr2=0x560a096acd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:12.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.470+0000 7f25b3fff640 1 --2- 172.21.15.79:0/2492601608 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a09634130 0x560a096acd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:12.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.470+0000 7f25b3fff640 1 -- 172.21.15.79:0/2492601608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a096281a0 msgr2=0x560a09637d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:12.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.470+0000 7f25b3fff640 1 --2- 172.21.15.79:0/2492601608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a096281a0 0x560a09637d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:12.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.470+0000 7f25b3fff640 1 -- 172.21.15.79:0/2492601608 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a096ad3b0 con 0x560a09627880 2024-08-20T01:52:12.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.470+0000 7f25b3fff640 1 --2- 172.21.15.79:0/2492601608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a09627880 0x560a09637820 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f25a4009230 tx=0x7f25a4032e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b1f7991124f0672 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:12.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.470+0000 7f25937fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:52:12.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.470+0000 7f25937fe640 1 -- 172.21.15.79:0/2492601608 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a404c040 con 0x560a09627880 2024-08-20T01:52:12.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.470+0000 7f25937fe640 1 -- 172.21.15.79:0/2492601608 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f25a4003c30 con 0x560a09627880 2024-08-20T01:52:12.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.470+0000 7f25bccd2740 1 -- 172.21.15.79:0/2492601608 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25ac005040 con 0x560a09627880 2024-08-20T01:52:12.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.470+0000 7f25937fe640 1 -- 172.21.15.79:0/2492601608 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f25a4035040 con 0x560a09627880 2024-08-20T01:52:12.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.470+0000 7f25bccd2740 10 client.19188 fetch_fsmap learned FSMap version 62 2024-08-20T01:52:12.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.470+0000 7f25bccd2740 1 -- 172.21.15.79:0/2492601608 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x560a096ae6b0 con 0x560a09627880 2024-08-20T01:52:12.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.470+0000 7f25937fe640 1 -- 172.21.15.79:0/2492601608 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f25ac005040 con 0x560a09627880 2024-08-20T01:52:12.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.471+0000 7f25937fe640 1 -- 172.21.15.79:0/2492601608 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 62) ==== 8406+0+0 (secure 0 0 0) 0x7f25a40047e0 con 0x560a09627880 2024-08-20T01:52:12.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.471+0000 7f25bccd2740 10 client.19188 fetch_fsmap finished waiting for FSMap version 62 2024-08-20T01:52:12.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.471+0000 7f25bccd2740 10 client.19188 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:52:12.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.471+0000 7f25bccd2740 20 client.19188 populate_metadata read hostname 'smithi079' 2024-08-20T01:52:12.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.471+0000 7f25bccd2740 1 --2- 172.21.15.79:0/2492601608 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x560a096aef40 0x560a096b1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:12.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.471+0000 7f25bccd2740 4 client.19188 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:52:12.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.471+0000 7f25bccd2740 1 -- 172.21.15.79:0/2492601608 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560a0959c320 con 0x560a096aef40 2024-08-20T01:52:12.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.471+0000 7f25b37fe640 1 --2- 172.21.15.79:0/2492601608 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x560a096aef40 0x560a096b1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:12.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.471+0000 7f25b37fe640 1 --2- 172.21.15.79:0/2492601608 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x560a096aef40 0x560a096b1360 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f7084ddd2842aa0f server_cookie=7320948df3715962 in_seq=0 out_seq=0 2024-08-20T01:52:12.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.471+0000 7f25937fe640 10 client.19188 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:52:12.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.471+0000 7f25937fe640 1 -- 172.21.15.79:0/2492601608 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560a0959c320 con 0x560a096aef40 2024-08-20T01:52:12.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.471+0000 7f25937fe640 10 client.19188 handle_command_reply: tid=0 2024-08-20T01:52:12.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.471+0000 7f25bccd2740 1 client.19188 shutdown 2024-08-20T01:52:12.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.472+0000 7f25bccd2740 1 -- 172.21.15.79:0/2492601608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a09627880 msgr2=0x560a09637820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:12.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.472+0000 7f25bccd2740 1 --2- 172.21.15.79:0/2492601608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a09627880 0x560a09637820 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f25a4009230 tx=0x7f25a4032e80 comp rx=0 tx=0).stop 2024-08-20T01:52:12.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.472+0000 7f25bccd2740 1 -- 172.21.15.79:0/2492601608 shutdown_connections 2024-08-20T01:52:12.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.472+0000 7f25bccd2740 1 --2- 172.21.15.79:0/2492601608 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a09634130 0x560a096acd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:12.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.472+0000 7f25bccd2740 1 --2- 172.21.15.79:0/2492601608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a096281a0 0x560a09637d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:12.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.472+0000 7f25bccd2740 1 --2- 172.21.15.79:0/2492601608 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x560a096aef40 0x560a096b1360 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:12.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.472+0000 7f25bccd2740 1 --2- 172.21.15.79:0/2492601608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a09627880 0x560a09637820 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:12.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.472+0000 7f25937fe640 0 client.19188 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:52:12.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.472+0000 7f25bccd2740 1 -- 172.21.15.79:0/2492601608 >> 172.21.15.79:0/2492601608 conn(0x560a096256b0 msgr2=0x560a09626c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:12.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.472+0000 7f25bccd2740 1 -- 172.21.15.79:0/2492601608 shutdown_connections 2024-08-20T01:52:12.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.472+0000 7f25bccd2740 1 -- 172.21.15.79:0/2492601608 wait complete. 2024-08-20T01:52:12.510 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:52:12.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.472+0000 7f25bccd2740 20 client.19188 trim_cache size 0 max 16384 2024-08-20T01:52:12.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.472+0000 7f25ba8d9640 1 -- 172.21.15.79:0/3713271290 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f259c0b3bd0 msgr2=0x7f259c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:12.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.472+0000 7f25ba8d9640 1 --2- 172.21.15.79:0/3713271290 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f259c0b3bd0 0x7f259c0b6090 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f25a40096c0 tx=0x7f25a4005b50 comp rx=0 tx=0).stop 2024-08-20T01:52:12.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.472+0000 7f25ba8d9640 1 -- 172.21.15.79:0/3713271290 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25b41073a0 msgr2=0x7f25b419a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:12.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.472+0000 7f25ba8d9640 1 --2- 172.21.15.79:0/3713271290 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25b41073a0 0x7f25b419a1e0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f25a800d950 tx=0x7f25a800de10 comp rx=0 tx=0).stop 2024-08-20T01:52:12.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.472+0000 7f25ba8d9640 1 -- 172.21.15.79:0/3713271290 shutdown_connections 2024-08-20T01:52:12.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.472+0000 7f25ba8d9640 1 --2- 172.21.15.79:0/3713271290 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f259c0b3bd0 0x7f259c0b6090 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:12.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.472+0000 7f25ba8d9640 1 --2- 172.21.15.79:0/3713271290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25b4107d20 0x7f25b41a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:12.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.472+0000 7f25ba8d9640 1 --2- 172.21.15.79:0/3713271290 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25b41073a0 0x7f25b419a1e0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:12.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.472+0000 7f25ba8d9640 1 --2- 172.21.15.79:0/3713271290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25b4101990 0x7f25b4199ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:12.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.472+0000 7f25ba8d9640 1 -- 172.21.15.79:0/3713271290 >> 172.21.15.79:0/3713271290 conn(0x7f25b40fd400 msgr2=0x7f25b40ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:12.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.472+0000 7f25ba8d9640 1 -- 172.21.15.79:0/3713271290 shutdown_connections 2024-08-20T01:52:12.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:12.472+0000 7f25ba8d9640 1 -- 172.21.15.79:0/3713271290 wait complete. 2024-08-20T01:52:13.172 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T01:52:13.421 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:52:13.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.877+0000 7f616b2e7640 1 -- 172.21.15.79:0/956511639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6164104250 msgr2=0x7f616410c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:13.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.877+0000 7f616b2e7640 1 --2- 172.21.15.79:0/956511639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6164104250 0x7f616410c830 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6158009900 tx=0x7f615802a410 comp rx=0 tx=0).stop 2024-08-20T01:52:13.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.877+0000 7f616b2e7640 1 -- 172.21.15.79:0/956511639 shutdown_connections 2024-08-20T01:52:13.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.877+0000 7f616b2e7640 1 --2- 172.21.15.79:0/956511639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f616410ce00 0x7f616410f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:13.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.877+0000 7f616b2e7640 1 --2- 172.21.15.79:0/956511639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6164104250 0x7f616410c830 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:13.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.877+0000 7f616b2e7640 1 --2- 172.21.15.79:0/956511639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6164103850 0x7f6164103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:13.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.877+0000 7f616b2e7640 1 -- 172.21.15.79:0/956511639 >> 172.21.15.79:0/956511639 conn(0x7f61640fd400 msgr2=0x7f61640ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:13.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.877+0000 7f616b2e7640 1 -- 172.21.15.79:0/956511639 shutdown_connections 2024-08-20T01:52:13.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.877+0000 7f616b2e7640 1 -- 172.21.15.79:0/956511639 wait complete. 2024-08-20T01:52:13.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.878+0000 7f616b2e7640 1 Processor -- start 2024-08-20T01:52:13.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.878+0000 7f616b2e7640 1 -- start start 2024-08-20T01:52:13.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.878+0000 7f616b2e7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6164103850 0x7f6164198f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:13.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.878+0000 7f616b2e7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6164104250 0x7f6164199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:13.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.878+0000 7f616b2e7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f616410ce00 0x7f616419e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:13.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.878+0000 7f616b2e7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6164112910 con 0x7f6164104250 2024-08-20T01:52:13.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.878+0000 7f616b2e7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6164112790 con 0x7f616410ce00 2024-08-20T01:52:13.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.878+0000 7f616b2e7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6164112a90 con 0x7f6164103850 2024-08-20T01:52:13.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.878+0000 7f6168882640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6164104250 0x7f6164199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:13.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.878+0000 7f6169083640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6164103850 0x7f6164198f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:13.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.878+0000 7f6169884640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f616410ce00 0x7f616419e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:13.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.878+0000 7f6169083640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6164103850 0x7f6164198f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:55798/0 (socket says 172.21.15.79:55798) 2024-08-20T01:52:13.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.878+0000 7f6168882640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6164104250 0x7f6164199440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48200/0 (socket says 172.21.15.79:48200) 2024-08-20T01:52:13.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.878+0000 7f6169884640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f616410ce00 0x7f616419e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:36070/0 (socket says 172.21.15.79:36070) 2024-08-20T01:52:13.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.878+0000 7f6169083640 1 -- 172.21.15.79:0/2989013129 learned_addr learned my addr 172.21.15.79:0/2989013129 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:13.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.879+0000 7f6169884640 1 -- 172.21.15.79:0/2989013129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6164103850 msgr2=0x7f6164198f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:13.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.879+0000 7f6169884640 1 --2- 172.21.15.79:0/2989013129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6164103850 0x7f6164198f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:13.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.879+0000 7f6169884640 1 -- 172.21.15.79:0/2989013129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6164104250 msgr2=0x7f6164199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:13.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.879+0000 7f6169884640 1 --2- 172.21.15.79:0/2989013129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6164104250 0x7f6164199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:13.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.879+0000 7f6169884640 1 -- 172.21.15.79:0/2989013129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f616419efb0 con 0x7f616410ce00 2024-08-20T01:52:13.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.879+0000 7f6169083640 1 --2- 172.21.15.79:0/2989013129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6164103850 0x7f6164198f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:52:13.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.879+0000 7f6168882640 1 --2- 172.21.15.79:0/2989013129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6164104250 0x7f6164199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:52:13.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.879+0000 7f6169884640 1 --2- 172.21.15.79:0/2989013129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f616410ce00 0x7f616419e7e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f615c00e970 tx=0x7f615c00ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:13.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.879+0000 7f61627fc640 1 -- 172.21.15.79:0/2989013129 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f615c00ccc0 con 0x7f616410ce00 2024-08-20T01:52:13.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.879+0000 7f61627fc640 1 -- 172.21.15.79:0/2989013129 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f615c0035f0 con 0x7f616410ce00 2024-08-20T01:52:13.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.879+0000 7f616b2e7640 1 -- 172.21.15.79:0/2989013129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f616419f2a0 con 0x7f616410ce00 2024-08-20T01:52:13.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.879+0000 7f61627fc640 1 -- 172.21.15.79:0/2989013129 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f615c00ce60 con 0x7f616410ce00 2024-08-20T01:52:13.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.879+0000 7f616b2e7640 1 -- 172.21.15.79:0/2989013129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61641a5960 con 0x7f616410ce00 2024-08-20T01:52:13.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.882+0000 7f61627fc640 1 -- 172.21.15.79:0/2989013129 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f615c004020 con 0x7f616410ce00 2024-08-20T01:52:13.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.882+0000 7f616d6e0740 1 Processor -- start 2024-08-20T01:52:13.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.882+0000 7f616d6e0740 1 -- start start 2024-08-20T01:52:13.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.882+0000 7f616d6e0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8d07d730 0x55ea8d07db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:13.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.882+0000 7f616d6e0740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8d07e050 0x55ea8d089aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:13.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.882+0000 7f616d6e0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8d089fe0 0x55ea8d08c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:13.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.882+0000 7f616d6e0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ea8cff4930 con 0x55ea8d089fe0 2024-08-20T01:52:13.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.882+0000 7f616d6e0740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ea8cfe3e30 con 0x55ea8d07e050 2024-08-20T01:52:13.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.882+0000 7f616d6e0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ea8cfe7e70 con 0x55ea8d07d730 2024-08-20T01:52:13.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.882+0000 7f6168882640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8d089fe0 0x55ea8d08c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:13.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.882+0000 7f6169083640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8d07e050 0x55ea8d089aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:13.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.882+0000 7f6168882640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8d089fe0 0x55ea8d08c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48206/0 (socket says 172.21.15.79:48206) 2024-08-20T01:52:13.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.882+0000 7f6169083640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8d07e050 0x55ea8d089aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:36074/0 (socket says 172.21.15.79:36074) 2024-08-20T01:52:13.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.882+0000 7f6168882640 1 -- 172.21.15.79:0/4250503095 learned_addr learned my addr 172.21.15.79:0/4250503095 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:13.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.882+0000 7f6168882640 1 --2- 172.21.15.79:0/4250503095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8d07d730 0x55ea8d07db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:13.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.883+0000 7f6169083640 1 -- 172.21.15.79:0/4250503095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8d07d730 msgr2=0x55ea8d07db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:13.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.883+0000 7f6169083640 1 --2- 172.21.15.79:0/4250503095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8d07d730 0x55ea8d07db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:13.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.883+0000 7f61627fc640 1 --2- 172.21.15.79:0/2989013129 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f614c0b3bd0 0x7f614c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:13.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.883+0000 7f6169083640 1 -- 172.21.15.79:0/4250503095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8d089fe0 msgr2=0x55ea8d08c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:13.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.883+0000 7f6169083640 1 --2- 172.21.15.79:0/4250503095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8d089fe0 0x55ea8d08c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:13.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.883+0000 7f6169083640 1 -- 172.21.15.79:0/4250503095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea8cd43650 con 0x55ea8d07e050 2024-08-20T01:52:13.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.883+0000 7f6168882640 1 --2- 172.21.15.79:0/4250503095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8d089fe0 0x55ea8d08c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:52:13.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.883+0000 7f6169884640 1 --2- 172.21.15.79:0/2989013129 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f614c0b3bd0 0x7f614c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:13.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.883+0000 7f6169083640 1 --2- 172.21.15.79:0/4250503095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8d07e050 0x55ea8d089aa0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6154011860 tx=0x7f6154011d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fccf3fdf219baa90 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:13.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.883+0000 7f61627fc640 1 -- 172.21.15.79:0/2989013129 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f615c0e3e70 con 0x7f616410ce00 2024-08-20T01:52:13.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.883+0000 7f614b7fe640 1 -- 172.21.15.79:0/4250503095 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61540112f0 con 0x55ea8d07e050 2024-08-20T01:52:13.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.883+0000 7f614b7fe640 1 -- 172.21.15.79:0/4250503095 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f615400f9a0 con 0x55ea8d07e050 2024-08-20T01:52:13.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.883+0000 7f614b7fe640 1 -- 172.21.15.79:0/4250503095 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6154005650 con 0x55ea8d07e050 2024-08-20T01:52:13.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.884+0000 7f616d6e0740 1 -- 172.21.15.79:0/4250503095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8d07e050 msgr2=0x55ea8d089aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:13.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.884+0000 7f6169884640 1 --2- 172.21.15.79:0/2989013129 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f614c0b3bd0 0x7f614c0b6090 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f615c0a7fe0 tx=0x7f615c0daa50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:13.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.884+0000 7f616d6e0740 1 --2- 172.21.15.79:0/4250503095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8d07e050 0x55ea8d089aa0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6154011860 tx=0x7f6154011d20 comp rx=0 tx=0).stop 2024-08-20T01:52:13.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.884+0000 7f616d6e0740 1 -- 172.21.15.79:0/4250503095 shutdown_connections 2024-08-20T01:52:13.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.884+0000 7f616d6e0740 1 --2- 172.21.15.79:0/4250503095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8d089fe0 0x55ea8d08c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:13.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.884+0000 7f616d6e0740 1 --2- 172.21.15.79:0/4250503095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8d07e050 0x55ea8d089aa0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:13.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.884+0000 7f616d6e0740 1 --2- 172.21.15.79:0/4250503095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8d07d730 0x55ea8d07db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:13.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.884+0000 7f616d6e0740 1 -- 172.21.15.79:0/4250503095 >> 172.21.15.79:0/4250503095 conn(0x55ea8d07b560 msgr2=0x55ea8d07c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:13.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.884+0000 7f616d6e0740 1 -- 172.21.15.79:0/4250503095 shutdown_connections 2024-08-20T01:52:13.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.884+0000 7f616d6e0740 1 -- 172.21.15.79:0/4250503095 wait complete. 2024-08-20T01:52:13.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.884+0000 7f616d6e0740 1 -- start start 2024-08-20T01:52:13.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.884+0000 7f616d6e0740 1 Processor -- start 2024-08-20T01:52:13.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.885+0000 7f616d6e0740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8d07d730 0x55ea8d086f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:13.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.885+0000 7f616d6e0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8d07e050 0x55ea8d087440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:13.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.885+0000 7f616d6e0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8d089fe0 0x55ea8d087980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:13.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.885+0000 7f616d6e0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ea8ce46700 con 0x55ea8d089fe0 2024-08-20T01:52:13.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.885+0000 7f616d6e0740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ea8cf6a810 con 0x55ea8d07d730 2024-08-20T01:52:13.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.885+0000 7f616d6e0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ea8d08cc90 con 0x55ea8d07e050 2024-08-20T01:52:13.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.885+0000 7f616d6e0740 10 client.0 _ll_register_callbacks cb 0x55ea8cfdd700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:52:13.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.885+0000 7f6169083640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8d07e050 0x55ea8d087440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:13.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.885+0000 7f6168882640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8d07d730 0x55ea8d086f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:13.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.885+0000 7f6169083640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8d07e050 0x55ea8d087440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:55814/0 (socket says 172.21.15.79:55814) 2024-08-20T01:52:13.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.885+0000 7f6169083640 1 -- 172.21.15.79:0/3155707022 learned_addr learned my addr 172.21.15.79:0/3155707022 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:13.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.885+0000 7f6168882640 1 --2- 172.21.15.79:0/3155707022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8d089fe0 0x55ea8d087980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:13.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.885+0000 7f6169083640 1 -- 172.21.15.79:0/3155707022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8d07d730 msgr2=0x55ea8d086f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:13.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.885+0000 7f6169083640 1 --2- 172.21.15.79:0/3155707022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8d07d730 0x55ea8d086f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:13.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.885+0000 7f6169083640 1 -- 172.21.15.79:0/3155707022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8d089fe0 msgr2=0x55ea8d087980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:13.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.885+0000 7f6169083640 1 --2- 172.21.15.79:0/3155707022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8d089fe0 0x55ea8d087980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:13.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.885+0000 7f6169083640 1 -- 172.21.15.79:0/3155707022 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea8d095fc0 con 0x55ea8d07e050 2024-08-20T01:52:13.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.885+0000 7f6169083640 1 --2- 172.21.15.79:0/3155707022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8d07e050 0x55ea8d087440 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6154009370 tx=0x7f615400fbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=810bccb1572a0e13 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:13.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.885+0000 7f6148ff9640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:52:13.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.886+0000 7f6148ff9640 1 -- 172.21.15.79:0/3155707022 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6154028020 con 0x55ea8d07e050 2024-08-20T01:52:13.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.886+0000 7f6148ff9640 1 -- 172.21.15.79:0/3155707022 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f61540057e0 con 0x55ea8d07e050 2024-08-20T01:52:13.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.886+0000 7f616d6e0740 1 -- 172.21.15.79:0/3155707022 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ea8cf93150 con 0x55ea8d07e050 2024-08-20T01:52:13.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.886+0000 7f6148ff9640 1 -- 172.21.15.79:0/3155707022 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f615400fe80 con 0x55ea8d07e050 2024-08-20T01:52:13.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.886+0000 7f616d6e0740 10 client.28231 fetch_fsmap learned FSMap version 62 2024-08-20T01:52:13.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.886+0000 7f616d6e0740 1 -- 172.21.15.79:0/3155707022 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55ea8d098970 con 0x55ea8d07e050 2024-08-20T01:52:13.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.886+0000 7f6148ff9640 1 -- 172.21.15.79:0/3155707022 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55ea8cf93150 con 0x55ea8d07e050 2024-08-20T01:52:13.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.886+0000 7f6148ff9640 1 -- 172.21.15.79:0/3155707022 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 62) ==== 8406+0+0 (secure 0 0 0) 0x7f6154018070 con 0x55ea8d07e050 2024-08-20T01:52:13.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.886+0000 7f616d6e0740 10 client.28231 fetch_fsmap finished waiting for FSMap version 62 2024-08-20T01:52:13.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.886+0000 7f616d6e0740 10 client.28231 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:52:13.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.886+0000 7f616d6e0740 20 client.28231 populate_metadata read hostname 'smithi079' 2024-08-20T01:52:13.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.886+0000 7f616d6e0740 1 --2- 172.21.15.79:0/3155707022 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55ea8d099d20 0x55ea8d09c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:13.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.886+0000 7f616d6e0740 4 client.28231 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:52:13.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.886+0000 7f616d6e0740 1 -- 172.21.15.79:0/3155707022 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea8cff6880 con 0x55ea8d099d20 2024-08-20T01:52:13.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.886+0000 7f6168882640 1 --2- 172.21.15.79:0/3155707022 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55ea8d099d20 0x55ea8d09c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:13.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.887+0000 7f6148ff9640 10 client.28231 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:52:13.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.887+0000 7f6168882640 1 --2- 172.21.15.79:0/3155707022 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55ea8d099d20 0x55ea8d09c110 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=70f92140240918a0 server_cookie=b9c1d7c3e374767 in_seq=0 out_seq=0 2024-08-20T01:52:13.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.887+0000 7f6148ff9640 1 -- 172.21.15.79:0/3155707022 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ea8cff6880 con 0x55ea8d099d20 2024-08-20T01:52:13.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.887+0000 7f6148ff9640 10 client.28231 handle_command_reply: tid=0 2024-08-20T01:52:13.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.887+0000 7f616d6e0740 1 client.28231 shutdown 2024-08-20T01:52:13.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.888+0000 7f616d6e0740 1 -- 172.21.15.79:0/3155707022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8d07e050 msgr2=0x55ea8d087440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:13.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.888+0000 7f616d6e0740 1 --2- 172.21.15.79:0/3155707022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8d07e050 0x55ea8d087440 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6154009370 tx=0x7f615400fbd0 comp rx=0 tx=0).stop 2024-08-20T01:52:13.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.888+0000 7f616d6e0740 1 -- 172.21.15.79:0/3155707022 shutdown_connections 2024-08-20T01:52:13.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.888+0000 7f616d6e0740 1 --2- 172.21.15.79:0/3155707022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8d089fe0 0x55ea8d087980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:13.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.888+0000 7f616d6e0740 1 --2- 172.21.15.79:0/3155707022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8d07e050 0x55ea8d087440 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:13.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.888+0000 7f616d6e0740 1 --2- 172.21.15.79:0/3155707022 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55ea8d099d20 0x55ea8d09c110 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:13.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.888+0000 7f616d6e0740 1 --2- 172.21.15.79:0/3155707022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8d07d730 0x55ea8d086f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:13.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.888+0000 7f6148ff9640 0 client.28231 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:52:13.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.888+0000 7f616d6e0740 1 -- 172.21.15.79:0/3155707022 >> 172.21.15.79:0/3155707022 conn(0x55ea8d07b560 msgr2=0x55ea8d081100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:13.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.888+0000 7f616d6e0740 1 -- 172.21.15.79:0/3155707022 shutdown_connections 2024-08-20T01:52:13.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.888+0000 7f616d6e0740 1 -- 172.21.15.79:0/3155707022 wait complete. 2024-08-20T01:52:13.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.888+0000 7f616d6e0740 20 client.28231 trim_cache size 0 max 16384 2024-08-20T01:52:13.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.901+0000 7f616d6e0740 1 Processor -- start 2024-08-20T01:52:13.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.901+0000 7f616d6e0740 1 -- start start 2024-08-20T01:52:13.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.901+0000 7f616d6e0740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8d07d730 0x55ea8d07ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:13.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.901+0000 7f616d6e0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8d07e050 0x55ea8d0a1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:13.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.901+0000 7f616d6e0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8d089fe0 0x55ea8d0a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:13.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.901+0000 7f616d6e0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f61641adf10 con 0x55ea8d089fe0 2024-08-20T01:52:13.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.901+0000 7f616d6e0740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f61641afc00 con 0x55ea8d07d730 2024-08-20T01:52:13.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.901+0000 7f616d6e0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f61641ae610 con 0x55ea8d07e050 2024-08-20T01:52:13.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.901+0000 7f6169083640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8d07e050 0x55ea8d0a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:13.913 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.901+0000 7f6168882640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8d07d730 0x55ea8d07ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:13.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.901+0000 7f6169083640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8d07e050 0x55ea8d0a1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:55818/0 (socket says 172.21.15.79:55818) 2024-08-20T01:52:13.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.901+0000 7f6169083640 1 -- 172.21.15.79:0/1669365699 learned_addr learned my addr 172.21.15.79:0/1669365699 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:13.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.901+0000 7f6168882640 1 --2- 172.21.15.79:0/1669365699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8d089fe0 0x55ea8d0a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:13.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.901+0000 7f6169083640 1 -- 172.21.15.79:0/1669365699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8d07d730 msgr2=0x55ea8d07ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:13.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.901+0000 7f6169083640 1 --2- 172.21.15.79:0/1669365699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8d07d730 0x55ea8d07ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:13.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.901+0000 7f6169083640 1 -- 172.21.15.79:0/1669365699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8d089fe0 msgr2=0x55ea8d0a1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:13.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.901+0000 7f6169083640 1 --2- 172.21.15.79:0/1669365699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8d089fe0 0x55ea8d0a1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:13.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.901+0000 7f6169083640 1 -- 172.21.15.79:0/1669365699 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea8d07bfe0 con 0x55ea8d07e050 2024-08-20T01:52:13.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.902+0000 7f6169083640 1 --2- 172.21.15.79:0/1669365699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8d07e050 0x55ea8d0a1910 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6154024770 tx=0x7f6154011d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84061fe6cc1a7f18 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:13.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.902+0000 7f614affd640 1 -- 172.21.15.79:0/1669365699 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6154028070 con 0x55ea8d07e050 2024-08-20T01:52:13.914 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.902+0000 7f614affd640 1 -- 172.21.15.79:0/1669365699 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f615401f040 con 0x55ea8d07e050 2024-08-20T01:52:13.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.902+0000 7f614affd640 1 -- 172.21.15.79:0/1669365699 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61540049d0 con 0x55ea8d07e050 2024-08-20T01:52:13.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.902+0000 7f616d6e0740 1 -- 172.21.15.79:0/1669365699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8d07e050 msgr2=0x55ea8d0a1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:13.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.902+0000 7f616d6e0740 1 --2- 172.21.15.79:0/1669365699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8d07e050 0x55ea8d0a1910 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6154024770 tx=0x7f6154011d20 comp rx=0 tx=0).stop 2024-08-20T01:52:13.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.902+0000 7f616d6e0740 1 -- 172.21.15.79:0/1669365699 shutdown_connections 2024-08-20T01:52:13.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.902+0000 7f616d6e0740 1 --2- 172.21.15.79:0/1669365699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8d089fe0 0x55ea8d0a1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:13.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.902+0000 7f616d6e0740 1 --2- 172.21.15.79:0/1669365699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8d07e050 0x55ea8d0a1910 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:13.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.903+0000 7f616d6e0740 1 --2- 172.21.15.79:0/1669365699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8d07d730 0x55ea8d07ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:13.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.903+0000 7f616d6e0740 1 -- 172.21.15.79:0/1669365699 >> 172.21.15.79:0/1669365699 conn(0x55ea8d07b560 msgr2=0x55ea8d07a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:13.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.903+0000 7f616d6e0740 1 -- 172.21.15.79:0/1669365699 shutdown_connections 2024-08-20T01:52:13.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.903+0000 7f616d6e0740 1 -- 172.21.15.79:0/1669365699 wait complete. 2024-08-20T01:52:13.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.903+0000 7f616d6e0740 1 -- start start 2024-08-20T01:52:13.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.903+0000 7f616d6e0740 1 Processor -- start 2024-08-20T01:52:13.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.903+0000 7f616d6e0740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8d07d730 0x55ea8d08ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:13.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.903+0000 7f616d6e0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8d07e050 0x55ea8d08f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:13.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.903+0000 7f616d6e0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8d089fe0 0x55ea8d08f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:13.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.903+0000 7f616d6e0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f61641af470 con 0x55ea8d07e050 2024-08-20T01:52:13.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.903+0000 7f616d6e0740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f61641aed70 con 0x55ea8d07d730 2024-08-20T01:52:13.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.903+0000 7f616d6e0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f61641abef0 con 0x55ea8d089fe0 2024-08-20T01:52:13.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.903+0000 7f616d6e0740 10 client.0 _ll_register_callbacks cb 0x7f61540114e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:52:13.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.903+0000 7f6169083640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8d07e050 0x55ea8d08f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:13.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.904+0000 7f6169083640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8d07e050 0x55ea8d08f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48234/0 (socket says 172.21.15.79:48234) 2024-08-20T01:52:13.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.904+0000 7f6169083640 1 -- 172.21.15.79:0/3922218282 learned_addr learned my addr 172.21.15.79:0/3922218282 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:13.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.904+0000 7f6168882640 1 --2- 172.21.15.79:0/3922218282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8d089fe0 0x55ea8d08f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:13.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.904+0000 7f6168882640 1 --2- 172.21.15.79:0/3922218282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8d07d730 0x55ea8d08ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:13.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.904+0000 7f6169083640 1 -- 172.21.15.79:0/3922218282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8d089fe0 msgr2=0x55ea8d08f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:13.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.904+0000 7f6169083640 1 --2- 172.21.15.79:0/3922218282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8d089fe0 0x55ea8d08f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:13.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.904+0000 7f6169083640 1 -- 172.21.15.79:0/3922218282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8d07d730 msgr2=0x55ea8d08ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:13.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.904+0000 7f6169083640 1 --2- 172.21.15.79:0/3922218282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8d07d730 0x55ea8d08ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:13.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.904+0000 7f6169083640 1 -- 172.21.15.79:0/3922218282 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea8d1028e0 con 0x55ea8d07e050 2024-08-20T01:52:13.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.904+0000 7f6169083640 1 --2- 172.21.15.79:0/3922218282 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8d07e050 0x55ea8d08f280 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f6154031040 tx=0x7f6154009a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7253ed9fff188a9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:13.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.904+0000 7f6148ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:52:13.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.904+0000 7f6148ff9640 1 -- 172.21.15.79:0/3922218282 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6154028070 con 0x55ea8d07e050 2024-08-20T01:52:13.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.904+0000 7f6148ff9640 1 -- 172.21.15.79:0/3922218282 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f61540057e0 con 0x55ea8d07e050 2024-08-20T01:52:13.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.904+0000 7f616d6e0740 1 -- 172.21.15.79:0/3922218282 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f615401f040 con 0x55ea8d07e050 2024-08-20T01:52:13.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.904+0000 7f6148ff9640 1 -- 172.21.15.79:0/3922218282 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f6154047050 con 0x55ea8d07e050 2024-08-20T01:52:13.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.904+0000 7f616d6e0740 10 client.19206 fetch_fsmap learned FSMap version 62 2024-08-20T01:52:13.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.904+0000 7f616d6e0740 1 -- 172.21.15.79:0/3922218282 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55ea8d103be0 con 0x55ea8d07e050 2024-08-20T01:52:13.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.905+0000 7f6148ff9640 1 -- 172.21.15.79:0/3922218282 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f615401f040 con 0x55ea8d07e050 2024-08-20T01:52:13.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.905+0000 7f6148ff9640 1 -- 172.21.15.79:0/3922218282 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 62) ==== 8406+0+0 (secure 0 0 0) 0x7f6154036030 con 0x55ea8d07e050 2024-08-20T01:52:13.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.905+0000 7f616d6e0740 10 client.19206 fetch_fsmap finished waiting for FSMap version 62 2024-08-20T01:52:13.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.905+0000 7f616d6e0740 10 client.19206 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:52:13.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.905+0000 7f616d6e0740 20 client.19206 populate_metadata read hostname 'smithi079' 2024-08-20T01:52:13.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.905+0000 7f616d6e0740 1 --2- 172.21.15.79:0/3922218282 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55ea8d104310 0x55ea8d106730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:13.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.905+0000 7f616d6e0740 4 client.19206 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:52:13.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.905+0000 7f616d6e0740 1 -- 172.21.15.79:0/3922218282 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ea8cff2320 con 0x55ea8d104310 2024-08-20T01:52:13.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.905+0000 7f6168882640 1 --2- 172.21.15.79:0/3922218282 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55ea8d104310 0x55ea8d106730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:13.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.905+0000 7f6168882640 1 --2- 172.21.15.79:0/3922218282 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55ea8d104310 0x55ea8d106730 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=60d58a20c36a3a77 server_cookie=3b5eeac9bb95fc97 in_seq=0 out_seq=0 2024-08-20T01:52:13.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.905+0000 7f6148ff9640 10 client.19206 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:52:13.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.905+0000 7f6148ff9640 1 -- 172.21.15.79:0/3922218282 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ea8cff2320 con 0x55ea8d104310 2024-08-20T01:52:13.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.906+0000 7f6148ff9640 10 client.19206 handle_command_reply: tid=0 2024-08-20T01:52:13.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.906+0000 7f616d6e0740 1 client.19206 shutdown 2024-08-20T01:52:13.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.906+0000 7f616d6e0740 1 -- 172.21.15.79:0/3922218282 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8d07e050 msgr2=0x55ea8d08f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:13.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.906+0000 7f616d6e0740 1 --2- 172.21.15.79:0/3922218282 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8d07e050 0x55ea8d08f280 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f6154031040 tx=0x7f6154009a30 comp rx=0 tx=0).stop 2024-08-20T01:52:13.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.906+0000 7f616d6e0740 1 -- 172.21.15.79:0/3922218282 shutdown_connections 2024-08-20T01:52:13.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.906+0000 7f616d6e0740 1 --2- 172.21.15.79:0/3922218282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea8d089fe0 0x55ea8d08f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:13.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.906+0000 7f616d6e0740 1 --2- 172.21.15.79:0/3922218282 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ea8d07e050 0x55ea8d08f280 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:13.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.906+0000 7f616d6e0740 1 --2- 172.21.15.79:0/3922218282 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55ea8d104310 0x55ea8d106730 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:13.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.906+0000 7f616d6e0740 1 --2- 172.21.15.79:0/3922218282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea8d07d730 0x55ea8d08ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:13.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.906+0000 7f616d6e0740 1 -- 172.21.15.79:0/3922218282 >> 172.21.15.79:0/3922218282 conn(0x55ea8d07b560 msgr2=0x55ea8d088530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:13.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.906+0000 7f6148ff9640 0 client.19206 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:52:13.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.906+0000 7f616d6e0740 1 -- 172.21.15.79:0/3922218282 shutdown_connections 2024-08-20T01:52:13.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.906+0000 7f616d6e0740 1 -- 172.21.15.79:0/3922218282 wait complete. 2024-08-20T01:52:13.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.906+0000 7f616d6e0740 20 client.19206 trim_cache size 0 max 16384 2024-08-20T01:52:13.920 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:52:13.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.907+0000 7f616b2e7640 1 -- 172.21.15.79:0/2989013129 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f614c0b3bd0 msgr2=0x7f614c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:13.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.907+0000 7f616b2e7640 1 --2- 172.21.15.79:0/2989013129 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f614c0b3bd0 0x7f614c0b6090 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f615c0a7fe0 tx=0x7f615c0daa50 comp rx=0 tx=0).stop 2024-08-20T01:52:13.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.907+0000 7f616b2e7640 1 -- 172.21.15.79:0/2989013129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f616410ce00 msgr2=0x7f616419e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:13.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.907+0000 7f616b2e7640 1 --2- 172.21.15.79:0/2989013129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f616410ce00 0x7f616419e7e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f615c00e970 tx=0x7f615c00ee30 comp rx=0 tx=0).stop 2024-08-20T01:52:13.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.907+0000 7f616b2e7640 1 -- 172.21.15.79:0/2989013129 shutdown_connections 2024-08-20T01:52:13.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.907+0000 7f616b2e7640 1 --2- 172.21.15.79:0/2989013129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f616410ce00 0x7f616419e7e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:13.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.907+0000 7f616b2e7640 1 --2- 172.21.15.79:0/2989013129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6164104250 0x7f6164199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:13.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.907+0000 7f616b2e7640 1 --2- 172.21.15.79:0/2989013129 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f614c0b3bd0 0x7f614c0b6090 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:13.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.907+0000 7f616b2e7640 1 --2- 172.21.15.79:0/2989013129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6164103850 0x7f6164198f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:13.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.907+0000 7f616b2e7640 1 -- 172.21.15.79:0/2989013129 >> 172.21.15.79:0/2989013129 conn(0x7f61640fd400 msgr2=0x7f61640fe140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:13.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.907+0000 7f616b2e7640 1 -- 172.21.15.79:0/2989013129 shutdown_connections 2024-08-20T01:52:13.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:13.907+0000 7f616b2e7640 1 -- 172.21.15.79:0/2989013129 wait complete. 2024-08-20T01:52:14.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:14 smithi079 ceph-mon[18656]: pgmap v794: 97 pgs: 97 active+clean; 9.6 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.7 KiB/s wr, 15 op/s 2024-08-20T01:52:14.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:14 smithi175 ceph-mon[22392]: pgmap v794: 97 pgs: 97 active+clean; 9.6 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.7 KiB/s wr, 15 op/s 2024-08-20T01:52:14.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:14 smithi081 ceph-mon[22209]: pgmap v794: 97 pgs: 97 active+clean; 9.6 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.7 KiB/s wr, 15 op/s 2024-08-20T01:52:14.622 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T01:52:14.875 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:52:15.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.364+0000 7f9ace901640 1 -- 172.21.15.79:0/3546212779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ac8108e60 msgr2=0x7f9ac810f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:15.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.364+0000 7f9ace901640 1 --2- 172.21.15.79:0/3546212779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ac8108e60 0x7f9ac810f660 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0009ca0 tx=0x7f9ac002a8c0 comp rx=0 tx=0).stop 2024-08-20T01:52:15.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.364+0000 7f9ace901640 1 -- 172.21.15.79:0/3546212779 shutdown_connections 2024-08-20T01:52:15.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.364+0000 7f9ace901640 1 --2- 172.21.15.79:0/3546212779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ac8108e60 0x7f9ac810f660 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:15.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.364+0000 7f9ace901640 1 --2- 172.21.15.79:0/3546212779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ac81084e0 0x7f9ac8108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:15.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.364+0000 7f9ace901640 1 --2- 172.21.15.79:0/3546212779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ac8102ad0 0x7f9ac8102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:15.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.364+0000 7f9ace901640 1 -- 172.21.15.79:0/3546212779 >> 172.21.15.79:0/3546212779 conn(0x7f9ac80fe540 msgr2=0x7f9ac8100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:15.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.364+0000 7f9ace901640 1 -- 172.21.15.79:0/3546212779 shutdown_connections 2024-08-20T01:52:15.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.364+0000 7f9ace901640 1 -- 172.21.15.79:0/3546212779 wait complete. 2024-08-20T01:52:15.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.365+0000 7f9ace901640 1 Processor -- start 2024-08-20T01:52:15.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.365+0000 7f9ace901640 1 -- start start 2024-08-20T01:52:15.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.365+0000 7f9ace901640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ac8102ad0 0x7f9ac80751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:15.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.365+0000 7f9ace901640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ac81084e0 0x7f9ac8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:15.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.365+0000 7f9ace901640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ac8108e60 0x7f9ac8075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:15.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.365+0000 7f9ace901640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac8112a20 con 0x7f9ac8108e60 2024-08-20T01:52:15.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.365+0000 7f9ace901640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac81128a0 con 0x7f9ac81084e0 2024-08-20T01:52:15.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.365+0000 7f9ace901640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac8112ba0 con 0x7f9ac8102ad0 2024-08-20T01:52:15.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.365+0000 7f9acce9e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ac8108e60 0x7f9ac8075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:15.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.365+0000 7f9acce9e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ac8108e60 0x7f9ac8075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48252/0 (socket says 172.21.15.79:48252) 2024-08-20T01:52:15.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.365+0000 7f9acce9e640 1 -- 172.21.15.79:0/390032840 learned_addr learned my addr 172.21.15.79:0/390032840 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:15.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.365+0000 7f9ac77fe640 1 --2- 172.21.15.79:0/390032840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ac81084e0 0x7f9ac8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:15.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.365+0000 7f9ac7fff640 1 --2- 172.21.15.79:0/390032840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ac8102ad0 0x7f9ac80751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:15.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.366+0000 7f9acce9e640 1 -- 172.21.15.79:0/390032840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ac8102ad0 msgr2=0x7f9ac80751d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:15.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.366+0000 7f9acce9e640 1 --2- 172.21.15.79:0/390032840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ac8102ad0 0x7f9ac80751d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:15.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.366+0000 7f9acce9e640 1 -- 172.21.15.79:0/390032840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ac81084e0 msgr2=0x7f9ac8075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:15.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.366+0000 7f9acce9e640 1 --2- 172.21.15.79:0/390032840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ac81084e0 0x7f9ac8075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:15.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.366+0000 7f9acce9e640 1 -- 172.21.15.79:0/390032840 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ac81a7310 con 0x7f9ac8108e60 2024-08-20T01:52:15.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.366+0000 7f9ac77fe640 1 --2- 172.21.15.79:0/390032840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ac81084e0 0x7f9ac8075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:52:15.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.366+0000 7f9acce9e640 1 --2- 172.21.15.79:0/390032840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ac8108e60 0x7f9ac8075c50 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0005e30 tx=0x7f9ac00093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:15.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.366+0000 7f9ac57fa640 1 -- 172.21.15.79:0/390032840 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac0032d10 con 0x7f9ac8108e60 2024-08-20T01:52:15.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.366+0000 7f9ac57fa640 1 -- 172.21.15.79:0/390032840 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ac0032eb0 con 0x7f9ac8108e60 2024-08-20T01:52:15.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.366+0000 7f9ace901640 1 -- 172.21.15.79:0/390032840 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ac81a75a0 con 0x7f9ac8108e60 2024-08-20T01:52:15.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.366+0000 7f9ac57fa640 1 -- 172.21.15.79:0/390032840 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac0030b20 con 0x7f9ac8108e60 2024-08-20T01:52:15.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.366+0000 7f9ace901640 1 -- 172.21.15.79:0/390032840 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ac81a7b30 con 0x7f9ac8108e60 2024-08-20T01:52:15.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.369+0000 7f9ac57fa640 1 -- 172.21.15.79:0/390032840 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f9ac0030cc0 con 0x7f9ac8108e60 2024-08-20T01:52:15.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.369+0000 7f9ad0cfa740 1 Processor -- start 2024-08-20T01:52:15.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.369+0000 7f9ad0cfa740 1 -- start start 2024-08-20T01:52:15.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.369+0000 7f9ad0cfa740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cf0efc880 0x558cf0efcc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:15.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.369+0000 7f9ad0cfa740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cf0efd1a0 0x558cf0f08bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:15.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.369+0000 7f9ad0cfa740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cf0f09130 0x558cf0f0b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:15.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.369+0000 7f9ad0cfa740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558cf0e73930 con 0x558cf0f09130 2024-08-20T01:52:15.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.369+0000 7f9ad0cfa740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558cf0e62e30 con 0x558cf0efc880 2024-08-20T01:52:15.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.369+0000 7f9ad0cfa740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558cf0e66e70 con 0x558cf0efd1a0 2024-08-20T01:52:15.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.369+0000 7f9ac77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cf0f09130 0x558cf0f0b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:15.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.369+0000 7f9ac7fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cf0efd1a0 0x558cf0f08bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:15.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.369+0000 7f9ac77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cf0efc880 0x558cf0efcc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:15.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.369+0000 7f9ac7fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cf0efd1a0 0x558cf0f08bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:55854/0 (socket says 172.21.15.79:55854) 2024-08-20T01:52:15.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.369+0000 7f9ac7fff640 1 -- 172.21.15.79:0/2372313172 learned_addr learned my addr 172.21.15.79:0/2372313172 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:15.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.369+0000 7f9ac57fa640 1 --2- 172.21.15.79:0/390032840 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9ab00b3c50 0x7f9ab00b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:15.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.369+0000 7f9ac77fe640 1 -- 172.21.15.79:0/2372313172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cf0efd1a0 msgr2=0x558cf0f08bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:15.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.369+0000 7f9ac77fe640 1 --2- 172.21.15.79:0/2372313172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cf0efd1a0 0x558cf0f08bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:15.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.369+0000 7f9ac77fe640 1 -- 172.21.15.79:0/2372313172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cf0f09130 msgr2=0x558cf0f0b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:15.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.369+0000 7f9ac77fe640 1 --2- 172.21.15.79:0/2372313172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cf0f09130 0x558cf0f0b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:15.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.369+0000 7f9ac77fe640 1 -- 172.21.15.79:0/2372313172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cf0bc2650 con 0x558cf0efc880 2024-08-20T01:52:15.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.370+0000 7f9ac57fa640 1 -- 172.21.15.79:0/390032840 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9ac0104e80 con 0x7f9ac8108e60 2024-08-20T01:52:15.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.370+0000 7f9ac77fe640 1 --2- 172.21.15.79:0/2372313172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cf0efc880 0x558cf0efcc60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9abc00b620 tx=0x7f9abc00b390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a03b67c1b746b3fb server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:15.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.370+0000 7f9acce9e640 1 --2- 172.21.15.79:0/390032840 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9ab00b3c50 0x7f9ab00b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:15.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.370+0000 7f9aae7fc640 1 -- 172.21.15.79:0/2372313172 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc005020 con 0x558cf0efc880 2024-08-20T01:52:15.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.370+0000 7f9aae7fc640 1 -- 172.21.15.79:0/2372313172 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9abc00f7f0 con 0x558cf0efc880 2024-08-20T01:52:15.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.370+0000 7f9aae7fc640 1 -- 172.21.15.79:0/2372313172 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc005650 con 0x558cf0efc880 2024-08-20T01:52:15.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.371+0000 7f9ad0cfa740 1 -- 172.21.15.79:0/2372313172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cf0efc880 msgr2=0x558cf0efcc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:15.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.371+0000 7f9ad0cfa740 1 --2- 172.21.15.79:0/2372313172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cf0efc880 0x558cf0efcc60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9abc00b620 tx=0x7f9abc00b390 comp rx=0 tx=0).stop 2024-08-20T01:52:15.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.371+0000 7f9acce9e640 1 --2- 172.21.15.79:0/390032840 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9ab00b3c50 0x7f9ab00b6110 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f9ac002ae80 tx=0x7f9ac00095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:15.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.371+0000 7f9ad0cfa740 1 -- 172.21.15.79:0/2372313172 shutdown_connections 2024-08-20T01:52:15.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.371+0000 7f9ad0cfa740 1 --2- 172.21.15.79:0/2372313172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cf0f09130 0x558cf0f0b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:15.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.371+0000 7f9ad0cfa740 1 --2- 172.21.15.79:0/2372313172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cf0efd1a0 0x558cf0f08bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:15.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.371+0000 7f9ad0cfa740 1 --2- 172.21.15.79:0/2372313172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cf0efc880 0x558cf0efcc60 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:15.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.371+0000 7f9ad0cfa740 1 -- 172.21.15.79:0/2372313172 >> 172.21.15.79:0/2372313172 conn(0x558cf0efa6b0 msgr2=0x558cf0efb850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:15.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.371+0000 7f9ad0cfa740 1 -- 172.21.15.79:0/2372313172 shutdown_connections 2024-08-20T01:52:15.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.371+0000 7f9ad0cfa740 1 -- 172.21.15.79:0/2372313172 wait complete. 2024-08-20T01:52:15.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.371+0000 7f9ad0cfa740 1 -- start start 2024-08-20T01:52:15.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.371+0000 7f9ad0cfa740 1 Processor -- start 2024-08-20T01:52:15.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.371+0000 7f9ad0cfa740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cf0efc880 0x558cf0f06110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:15.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.372+0000 7f9ad0cfa740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cf0efd1a0 0x558cf0f06650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:15.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.372+0000 7f9ad0cfa740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cf0f09130 0x558cf0f06b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:15.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.372+0000 7f9ad0cfa740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558cf0cc5700 con 0x558cf0efd1a0 2024-08-20T01:52:15.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.372+0000 7f9ad0cfa740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558cf0de9810 con 0x558cf0f09130 2024-08-20T01:52:15.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.372+0000 7f9ad0cfa740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558cf0f0bde0 con 0x558cf0efc880 2024-08-20T01:52:15.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.372+0000 7f9ad0cfa740 10 client.0 _ll_register_callbacks cb 0x558cf0e5c700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:52:15.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.372+0000 7f9ac7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cf0efd1a0 0x558cf0f06650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:15.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.372+0000 7f9ac7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cf0efd1a0 0x558cf0f06650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48272/0 (socket says 172.21.15.79:48272) 2024-08-20T01:52:15.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.372+0000 7f9ac7fff640 1 -- 172.21.15.79:0/1841264851 learned_addr learned my addr 172.21.15.79:0/1841264851 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:15.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.372+0000 7f9ac77fe640 1 --2- 172.21.15.79:0/1841264851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cf0f09130 0x558cf0f06b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:15.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.372+0000 7f9ac77fe640 1 --2- 172.21.15.79:0/1841264851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cf0efc880 0x558cf0f06110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:15.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.372+0000 7f9ac7fff640 1 -- 172.21.15.79:0/1841264851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cf0efc880 msgr2=0x558cf0f06110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:15.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.372+0000 7f9ac7fff640 1 --2- 172.21.15.79:0/1841264851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cf0efc880 0x558cf0f06110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:15.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.372+0000 7f9ac7fff640 1 -- 172.21.15.79:0/1841264851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cf0f09130 msgr2=0x558cf0f06b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:15.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.372+0000 7f9ac7fff640 1 --2- 172.21.15.79:0/1841264851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cf0f09130 0x558cf0f06b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:15.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.372+0000 7f9ac7fff640 1 -- 172.21.15.79:0/1841264851 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cf0f151e0 con 0x558cf0efd1a0 2024-08-20T01:52:15.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.372+0000 7f9ac77fe640 1 --2- 172.21.15.79:0/1841264851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cf0f09130 0x558cf0f06b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:52:15.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.372+0000 7f9ac7fff640 1 --2- 172.21.15.79:0/1841264851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cf0efd1a0 0x558cf0f06650 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8012870 tx=0x7f9ab8012d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ee863e93a4f7a7b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:15.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.372+0000 7f9aa77fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:52:15.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.372+0000 7f9aa77fe640 1 -- 172.21.15.79:0/1841264851 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab8004050 con 0x558cf0efd1a0 2024-08-20T01:52:15.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.372+0000 7f9aa77fe640 1 -- 172.21.15.79:0/1841264851 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9ab80041f0 con 0x558cf0efd1a0 2024-08-20T01:52:15.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.372+0000 7f9ad0cfa740 1 -- 172.21.15.79:0/1841264851 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558cf0e12150 con 0x558cf0efd1a0 2024-08-20T01:52:15.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.372+0000 7f9aa77fe640 1 -- 172.21.15.79:0/1841264851 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f9ab80043f0 con 0x558cf0efd1a0 2024-08-20T01:52:15.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.373+0000 7f9ad0cfa740 10 client.19218 fetch_fsmap learned FSMap version 62 2024-08-20T01:52:15.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.373+0000 7f9ad0cfa740 1 -- 172.21.15.79:0/1841264851 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x558cf0f17bf0 con 0x558cf0efd1a0 2024-08-20T01:52:15.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.373+0000 7f9aa77fe640 1 -- 172.21.15.79:0/1841264851 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x558cf0e12150 con 0x558cf0efd1a0 2024-08-20T01:52:15.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.373+0000 7f9aa77fe640 1 -- 172.21.15.79:0/1841264851 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 62) ==== 8406+0+0 (secure 0 0 0) 0x7f9ab80039f0 con 0x558cf0efd1a0 2024-08-20T01:52:15.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.373+0000 7f9ad0cfa740 10 client.19218 fetch_fsmap finished waiting for FSMap version 62 2024-08-20T01:52:15.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.373+0000 7f9ad0cfa740 10 client.19218 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:52:15.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.373+0000 7f9ad0cfa740 20 client.19218 populate_metadata read hostname 'smithi079' 2024-08-20T01:52:15.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.373+0000 7f9ad0cfa740 1 --2- 172.21.15.79:0/1841264851 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558cf0f191a0 0x558cf0f1b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:15.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.373+0000 7f9ad0cfa740 4 client.19218 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:52:15.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.373+0000 7f9ad0cfa740 1 -- 172.21.15.79:0/1841264851 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558cf0e75880 con 0x558cf0f191a0 2024-08-20T01:52:15.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.373+0000 7f9ac77fe640 1 --2- 172.21.15.79:0/1841264851 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558cf0f191a0 0x558cf0f1b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:15.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.374+0000 7f9aa77fe640 10 client.19218 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:52:15.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.374+0000 7f9ac77fe640 1 --2- 172.21.15.79:0/1841264851 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558cf0f191a0 0x558cf0f1b5c0 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be47d85bc47e6ef7 server_cookie=99f195d21f826fcd in_seq=0 out_seq=0 2024-08-20T01:52:15.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.374+0000 7f9aa77fe640 1 -- 172.21.15.79:0/1841264851 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558cf0e75880 con 0x558cf0f191a0 2024-08-20T01:52:15.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.374+0000 7f9aa77fe640 10 client.19218 handle_command_reply: tid=0 2024-08-20T01:52:15.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.374+0000 7f9ad0cfa740 1 client.19218 shutdown 2024-08-20T01:52:15.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.375+0000 7f9ad0cfa740 1 -- 172.21.15.79:0/1841264851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cf0efd1a0 msgr2=0x558cf0f06650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:15.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.375+0000 7f9ad0cfa740 1 --2- 172.21.15.79:0/1841264851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cf0efd1a0 0x558cf0f06650 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8012870 tx=0x7f9ab8012d30 comp rx=0 tx=0).stop 2024-08-20T01:52:15.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.375+0000 7f9ad0cfa740 1 -- 172.21.15.79:0/1841264851 shutdown_connections 2024-08-20T01:52:15.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.375+0000 7f9ad0cfa740 1 --2- 172.21.15.79:0/1841264851 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558cf0f191a0 0x558cf0f1b5c0 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:15.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.375+0000 7f9ad0cfa740 1 --2- 172.21.15.79:0/1841264851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cf0f09130 0x558cf0f06b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:15.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.375+0000 7f9ad0cfa740 1 --2- 172.21.15.79:0/1841264851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cf0efd1a0 0x558cf0f06650 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:15.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.375+0000 7f9aa77fe640 0 client.19218 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:52:15.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.375+0000 7f9ad0cfa740 1 --2- 172.21.15.79:0/1841264851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cf0efc880 0x558cf0f06110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:15.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.375+0000 7f9ad0cfa740 1 -- 172.21.15.79:0/1841264851 >> 172.21.15.79:0/1841264851 conn(0x558cf0efa6b0 msgr2=0x558cf0f00250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:15.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.375+0000 7f9ad0cfa740 1 -- 172.21.15.79:0/1841264851 shutdown_connections 2024-08-20T01:52:15.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.375+0000 7f9ad0cfa740 1 -- 172.21.15.79:0/1841264851 wait complete. 2024-08-20T01:52:15.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.375+0000 7f9ad0cfa740 20 client.19218 trim_cache size 0 max 16384 2024-08-20T01:52:15.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.388+0000 7f9ad0cfa740 1 Processor -- start 2024-08-20T01:52:15.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.388+0000 7f9ad0cfa740 1 -- start start 2024-08-20T01:52:15.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.388+0000 7f9ad0cfa740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cf0efc880 0x558cf0efbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:15.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.388+0000 7f9ad0cfa740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cf0efd1a0 0x558cf0f20e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:15.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.388+0000 7f9ad0cfa740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cf0f09130 0x558cf0f213d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:15.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.388+0000 7f9ad0cfa740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac81b01d0 con 0x558cf0efc880 2024-08-20T01:52:15.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.388+0000 7f9ad0cfa740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac81b1ec0 con 0x558cf0efd1a0 2024-08-20T01:52:15.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.388+0000 7f9ad0cfa740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac81b08d0 con 0x558cf0f09130 2024-08-20T01:52:15.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.388+0000 7f9ac77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cf0efc880 0x558cf0efbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:15.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.388+0000 7f9ac77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cf0efc880 0x558cf0efbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48282/0 (socket says 172.21.15.79:48282) 2024-08-20T01:52:15.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.388+0000 7f9ac77fe640 1 -- 172.21.15.79:0/3167611838 learned_addr learned my addr 172.21.15.79:0/3167611838 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:15.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.388+0000 7f9ac7fff640 1 --2- 172.21.15.79:0/3167611838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cf0efd1a0 0x558cf0f20e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:15.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.388+0000 7f9ac77fe640 1 --2- 172.21.15.79:0/3167611838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cf0f09130 0x558cf0f213d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:15.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.388+0000 7f9ac77fe640 1 -- 172.21.15.79:0/3167611838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cf0f09130 msgr2=0x558cf0f213d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:15.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.388+0000 7f9ac77fe640 1 --2- 172.21.15.79:0/3167611838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cf0f09130 0x558cf0f213d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:15.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.388+0000 7f9ac77fe640 1 -- 172.21.15.79:0/3167611838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cf0efd1a0 msgr2=0x558cf0f20e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:15.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.388+0000 7f9ac77fe640 1 --2- 172.21.15.79:0/3167611838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cf0efd1a0 0x558cf0f20e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:15.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.388+0000 7f9ac77fe640 1 -- 172.21.15.79:0/3167611838 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cf0efb130 con 0x558cf0efc880 2024-08-20T01:52:15.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.388+0000 7f9ac7fff640 1 --2- 172.21.15.79:0/3167611838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cf0efd1a0 0x558cf0f20e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:52:15.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.388+0000 7f9ac77fe640 1 --2- 172.21.15.79:0/3167611838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cf0efc880 0x558cf0efbaa0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f9abc00bb40 tx=0x7f9abc00b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=124cb2ee89bc18dd server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:15.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.389+0000 7f9aadffb640 1 -- 172.21.15.79:0/3167611838 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc030070 con 0x558cf0efc880 2024-08-20T01:52:15.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.389+0000 7f9aadffb640 1 -- 172.21.15.79:0/3167611838 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9abc0053e0 con 0x558cf0efc880 2024-08-20T01:52:15.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.389+0000 7f9aadffb640 1 -- 172.21.15.79:0/3167611838 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc00fce0 con 0x558cf0efc880 2024-08-20T01:52:15.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.389+0000 7f9ad0cfa740 1 -- 172.21.15.79:0/3167611838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cf0efc880 msgr2=0x558cf0efbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:15.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.389+0000 7f9ad0cfa740 1 --2- 172.21.15.79:0/3167611838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cf0efc880 0x558cf0efbaa0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f9abc00bb40 tx=0x7f9abc00b390 comp rx=0 tx=0).stop 2024-08-20T01:52:15.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.389+0000 7f9ad0cfa740 1 -- 172.21.15.79:0/3167611838 shutdown_connections 2024-08-20T01:52:15.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.389+0000 7f9ad0cfa740 1 --2- 172.21.15.79:0/3167611838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cf0f09130 0x558cf0f213d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:15.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.389+0000 7f9ad0cfa740 1 --2- 172.21.15.79:0/3167611838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cf0efd1a0 0x558cf0f20e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:15.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.389+0000 7f9ad0cfa740 1 --2- 172.21.15.79:0/3167611838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cf0efc880 0x558cf0efbaa0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:15.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.389+0000 7f9ad0cfa740 1 -- 172.21.15.79:0/3167611838 >> 172.21.15.79:0/3167611838 conn(0x558cf0efa6b0 msgr2=0x558cf0efb390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:15.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.390+0000 7f9ad0cfa740 1 -- 172.21.15.79:0/3167611838 shutdown_connections 2024-08-20T01:52:15.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.390+0000 7f9ad0cfa740 1 -- 172.21.15.79:0/3167611838 wait complete. 2024-08-20T01:52:15.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.390+0000 7f9ad0cfa740 1 -- start start 2024-08-20T01:52:15.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.390+0000 7f9ad0cfa740 1 Processor -- start 2024-08-20T01:52:15.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.390+0000 7f9ad0cfa740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cf0efc880 0x558cf0f0e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:15.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.390+0000 7f9ad0cfa740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cf0efd1a0 0x558cf0f0e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:15.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.390+0000 7f9ad0cfa740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cf0f09130 0x558cf0f0ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:15.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.390+0000 7f9ad0cfa740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac81b1730 con 0x558cf0efd1a0 2024-08-20T01:52:15.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.390+0000 7f9ad0cfa740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac81b1030 con 0x558cf0f09130 2024-08-20T01:52:15.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.390+0000 7f9ad0cfa740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac81ae1b0 con 0x558cf0efc880 2024-08-20T01:52:15.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.390+0000 7f9ad0cfa740 10 client.0 _ll_register_callbacks cb 0x7f9ab8009870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:52:15.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.391+0000 7f9ac7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cf0efd1a0 0x558cf0f0e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:15.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.391+0000 7f9ac77fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cf0efc880 0x558cf0f0e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:15.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.391+0000 7f9ac7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cf0efd1a0 0x558cf0f0e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48284/0 (socket says 172.21.15.79:48284) 2024-08-20T01:52:15.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.391+0000 7f9ac7fff640 1 -- 172.21.15.79:0/2472943695 learned_addr learned my addr 172.21.15.79:0/2472943695 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:15.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.391+0000 7f9ac77fe640 1 --2- 172.21.15.79:0/2472943695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cf0f09130 0x558cf0f0ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:15.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.391+0000 7f9ac7fff640 1 -- 172.21.15.79:0/2472943695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cf0efc880 msgr2=0x558cf0f0e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:15.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.391+0000 7f9ac7fff640 1 --2- 172.21.15.79:0/2472943695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cf0efc880 0x558cf0f0e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:15.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.391+0000 7f9ac7fff640 1 -- 172.21.15.79:0/2472943695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cf0f09130 msgr2=0x558cf0f0ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:15.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.391+0000 7f9ac7fff640 1 --2- 172.21.15.79:0/2472943695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cf0f09130 0x558cf0f0ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:15.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.391+0000 7f9ac7fff640 1 -- 172.21.15.79:0/2472943695 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cf0f82060 con 0x558cf0efd1a0 2024-08-20T01:52:15.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.391+0000 7f9ac77fe640 1 --2- 172.21.15.79:0/2472943695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cf0f09130 0x558cf0f0ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:52:15.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.391+0000 7f9ac7fff640 1 --2- 172.21.15.79:0/2472943695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cf0efd1a0 0x558cf0f0e590 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x558cf0f08a00 tx=0x7f9ab8012500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=febbb7733126f951 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:15.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.391+0000 7f9aa77fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:52:15.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.391+0000 7f9aa77fe640 1 -- 172.21.15.79:0/2472943695 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab800f920 con 0x558cf0efd1a0 2024-08-20T01:52:15.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.391+0000 7f9aa77fe640 1 -- 172.21.15.79:0/2472943695 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9ab800fac0 con 0x558cf0efd1a0 2024-08-20T01:52:15.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.391+0000 7f9ad0cfa740 1 -- 172.21.15.79:0/2472943695 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9abc0053e0 con 0x558cf0efd1a0 2024-08-20T01:52:15.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.391+0000 7f9aa77fe640 1 -- 172.21.15.79:0/2472943695 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f9ab800fcc0 con 0x558cf0efd1a0 2024-08-20T01:52:15.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.391+0000 7f9ad0cfa740 10 client.19224 fetch_fsmap learned FSMap version 62 2024-08-20T01:52:15.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.391+0000 7f9ad0cfa740 1 -- 172.21.15.79:0/2472943695 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x558cf0f83320 con 0x558cf0efd1a0 2024-08-20T01:52:15.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.392+0000 7f9aa77fe640 1 -- 172.21.15.79:0/2472943695 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9abc0053e0 con 0x558cf0efd1a0 2024-08-20T01:52:15.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.392+0000 7f9aa77fe640 1 -- 172.21.15.79:0/2472943695 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 62) ==== 8406+0+0 (secure 0 0 0) 0x7f9ab802f020 con 0x558cf0efd1a0 2024-08-20T01:52:15.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.392+0000 7f9ad0cfa740 10 client.19224 fetch_fsmap finished waiting for FSMap version 62 2024-08-20T01:52:15.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.392+0000 7f9ad0cfa740 10 client.19224 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:52:15.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.392+0000 7f9ad0cfa740 20 client.19224 populate_metadata read hostname 'smithi079' 2024-08-20T01:52:15.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.392+0000 7f9ad0cfa740 1 --2- 172.21.15.79:0/2472943695 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558cf0f83b60 0x558cf0f85f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:15.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.392+0000 7f9ad0cfa740 4 client.19224 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:52:15.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.392+0000 7f9ad0cfa740 1 -- 172.21.15.79:0/2472943695 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558cf0e71320 con 0x558cf0f83b60 2024-08-20T01:52:15.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.392+0000 7f9ac77fe640 1 --2- 172.21.15.79:0/2472943695 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558cf0f83b60 0x558cf0f85f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:15.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.393+0000 7f9ac77fe640 1 --2- 172.21.15.79:0/2472943695 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558cf0f83b60 0x558cf0f85f80 crc :-1 s=READY pgs=311 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5e712b653619408 server_cookie=9ebfe20814241e57 in_seq=0 out_seq=0 2024-08-20T01:52:15.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.393+0000 7f9aa77fe640 10 client.19224 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:52:15.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.393+0000 7f9aa77fe640 1 -- 172.21.15.79:0/2472943695 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558cf0e71320 con 0x558cf0f83b60 2024-08-20T01:52:15.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.393+0000 7f9aa77fe640 10 client.19224 handle_command_reply: tid=0 2024-08-20T01:52:15.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.393+0000 7f9ad0cfa740 1 client.19224 shutdown 2024-08-20T01:52:15.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.393+0000 7f9ad0cfa740 1 -- 172.21.15.79:0/2472943695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cf0efd1a0 msgr2=0x558cf0f0e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:15.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.393+0000 7f9ad0cfa740 1 --2- 172.21.15.79:0/2472943695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cf0efd1a0 0x558cf0f0e590 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x558cf0f08a00 tx=0x7f9ab8012500 comp rx=0 tx=0).stop 2024-08-20T01:52:15.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.393+0000 7f9ad0cfa740 1 -- 172.21.15.79:0/2472943695 shutdown_connections 2024-08-20T01:52:15.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.393+0000 7f9ad0cfa740 1 --2- 172.21.15.79:0/2472943695 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x558cf0f83b60 0x558cf0f85f80 crc :-1 s=READY pgs=311 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:15.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.393+0000 7f9ad0cfa740 1 --2- 172.21.15.79:0/2472943695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cf0f09130 0x558cf0f0ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:15.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.393+0000 7f9ad0cfa740 1 --2- 172.21.15.79:0/2472943695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cf0efd1a0 0x558cf0f0e590 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:15.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.393+0000 7f9aa77fe640 0 client.19224 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:52:15.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.393+0000 7f9ad0cfa740 1 --2- 172.21.15.79:0/2472943695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558cf0efc880 0x558cf0f0e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:15.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.393+0000 7f9ad0cfa740 1 -- 172.21.15.79:0/2472943695 >> 172.21.15.79:0/2472943695 conn(0x558cf0efa6b0 msgr2=0x558cf0efbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:15.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.393+0000 7f9ad0cfa740 1 -- 172.21.15.79:0/2472943695 shutdown_connections 2024-08-20T01:52:15.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.393+0000 7f9ad0cfa740 1 -- 172.21.15.79:0/2472943695 wait complete. 2024-08-20T01:52:15.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.393+0000 7f9ad0cfa740 20 client.19224 trim_cache size 0 max 16384 2024-08-20T01:52:15.412 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:52:15.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.394+0000 7f9ace901640 1 -- 172.21.15.79:0/390032840 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9ab00b3c50 msgr2=0x7f9ab00b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:15.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.394+0000 7f9ace901640 1 --2- 172.21.15.79:0/390032840 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9ab00b3c50 0x7f9ab00b6110 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f9ac002ae80 tx=0x7f9ac00095c0 comp rx=0 tx=0).stop 2024-08-20T01:52:15.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.394+0000 7f9ace901640 1 -- 172.21.15.79:0/390032840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ac8108e60 msgr2=0x7f9ac8075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:15.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.394+0000 7f9ace901640 1 --2- 172.21.15.79:0/390032840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ac8108e60 0x7f9ac8075c50 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0005e30 tx=0x7f9ac00093d0 comp rx=0 tx=0).stop 2024-08-20T01:52:15.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.394+0000 7f9ace901640 1 -- 172.21.15.79:0/390032840 shutdown_connections 2024-08-20T01:52:15.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.394+0000 7f9ace901640 1 --2- 172.21.15.79:0/390032840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ac8108e60 0x7f9ac8075c50 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:15.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.394+0000 7f9ace901640 1 --2- 172.21.15.79:0/390032840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ac81084e0 0x7f9ac8075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:15.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.394+0000 7f9ace901640 1 --2- 172.21.15.79:0/390032840 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9ab00b3c50 0x7f9ab00b6110 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:15.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.394+0000 7f9ace901640 1 --2- 172.21.15.79:0/390032840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ac8102ad0 0x7f9ac80751d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:15.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.394+0000 7f9ace901640 1 -- 172.21.15.79:0/390032840 >> 172.21.15.79:0/390032840 conn(0x7f9ac80fe540 msgr2=0x7f9ac8100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:15.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.394+0000 7f9ace901640 1 -- 172.21.15.79:0/390032840 shutdown_connections 2024-08-20T01:52:15.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:15.394+0000 7f9ace901640 1 -- 172.21.15.79:0/390032840 wait complete. 2024-08-20T01:52:16.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:16 smithi175 ceph-mon[22392]: pgmap v795: 97 pgs: 97 active+clean; 9.6 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.2 KiB/s wr, 19 op/s 2024-08-20T01:52:16.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:16 smithi079 ceph-mon[18656]: pgmap v795: 97 pgs: 97 active+clean; 9.6 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.2 KiB/s wr, 19 op/s 2024-08-20T01:52:16.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:16 smithi081 ceph-mon[22209]: pgmap v795: 97 pgs: 97 active+clean; 9.6 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.2 KiB/s wr, 19 op/s 2024-08-20T01:52:17.183 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T01:52:17.183 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T01:52:17.434 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:52:17.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.943+0000 7f4f07767640 1 -- 172.21.15.79:0/2511149051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f00108e20 msgr2=0x7f4f0010f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:17.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.943+0000 7f4f07767640 1 --2- 172.21.15.79:0/2511149051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f00108e20 0x7f4f0010f620 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8009ca0 tx=0x7f4ef802a8c0 comp rx=0 tx=0).stop 2024-08-20T01:52:17.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.943+0000 7f4f07767640 1 -- 172.21.15.79:0/2511149051 shutdown_connections 2024-08-20T01:52:17.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.943+0000 7f4f07767640 1 --2- 172.21.15.79:0/2511149051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f00108e20 0x7f4f0010f620 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:17.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.943+0000 7f4f07767640 1 --2- 172.21.15.79:0/2511149051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f001084a0 0x7f4f001088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:17.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.943+0000 7f4f07767640 1 --2- 172.21.15.79:0/2511149051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f00102a90 0x7f4f00102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:17.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.943+0000 7f4f07767640 1 -- 172.21.15.79:0/2511149051 >> 172.21.15.79:0/2511149051 conn(0x7f4f000fe540 msgr2=0x7f4f00100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:17.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.943+0000 7f4f07767640 1 -- 172.21.15.79:0/2511149051 shutdown_connections 2024-08-20T01:52:17.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.943+0000 7f4f07767640 1 -- 172.21.15.79:0/2511149051 wait complete. 2024-08-20T01:52:17.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.943+0000 7f4f07767640 1 Processor -- start 2024-08-20T01:52:17.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.943+0000 7f4f07767640 1 -- start start 2024-08-20T01:52:17.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.944+0000 7f4f07767640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f00102a90 0x7f4f00198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:17.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.944+0000 7f4f07767640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f001084a0 0x7f4f001993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:17.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.944+0000 7f4f07767640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f00108e20 0x7f4f0019e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:17.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.944+0000 7f4f07767640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4f001129a0 con 0x7f4f00102a90 2024-08-20T01:52:17.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.944+0000 7f4f07767640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4f00112820 con 0x7f4f00108e20 2024-08-20T01:52:17.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.944+0000 7f4f07767640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4f00112b20 con 0x7f4f001084a0 2024-08-20T01:52:17.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.944+0000 7f4f05503640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f00102a90 0x7f4f00198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:17.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.944+0000 7f4f05503640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f00102a90 0x7f4f00198eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48300/0 (socket says 172.21.15.79:48300) 2024-08-20T01:52:17.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.944+0000 7f4f05503640 1 -- 172.21.15.79:0/535574437 learned_addr learned my addr 172.21.15.79:0/535574437 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:17.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.944+0000 7f4f04d02640 1 --2- 172.21.15.79:0/535574437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f001084a0 0x7f4f001993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:17.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.944+0000 7f4f05d04640 1 --2- 172.21.15.79:0/535574437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f00108e20 0x7f4f0019e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:17.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.944+0000 7f4f05503640 1 -- 172.21.15.79:0/535574437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f001084a0 msgr2=0x7f4f001993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:17.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.944+0000 7f4f05503640 1 --2- 172.21.15.79:0/535574437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f001084a0 0x7f4f001993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:17.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.944+0000 7f4f05503640 1 -- 172.21.15.79:0/535574437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f00108e20 msgr2=0x7f4f0019e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:17.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.944+0000 7f4f05503640 1 --2- 172.21.15.79:0/535574437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f00108e20 0x7f4f0019e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:17.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.944+0000 7f4f05503640 1 -- 172.21.15.79:0/535574437 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f0019ef60 con 0x7f4f00102a90 2024-08-20T01:52:17.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.944+0000 7f4f05d04640 1 --2- 172.21.15.79:0/535574437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f00108e20 0x7f4f0019e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:52:17.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.944+0000 7f4f05503640 1 --2- 172.21.15.79:0/535574437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f00102a90 0x7f4f00198eb0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f4efc00d950 tx=0x7f4efc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:17.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.944+0000 7f4ef67fc640 1 -- 172.21.15.79:0/535574437 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4efc017070 con 0x7f4f00102a90 2024-08-20T01:52:17.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.944+0000 7f4f07767640 1 -- 172.21.15.79:0/535574437 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f0019f250 con 0x7f4f00102a90 2024-08-20T01:52:17.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.944+0000 7f4ef67fc640 1 -- 172.21.15.79:0/535574437 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4efc009c30 con 0x7f4f00102a90 2024-08-20T01:52:17.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.944+0000 7f4ef67fc640 1 -- 172.21.15.79:0/535574437 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4efc00f620 con 0x7f4f00102a90 2024-08-20T01:52:17.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.944+0000 7f4f07767640 1 -- 172.21.15.79:0/535574437 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f001a5ae0 con 0x7f4f00102a90 2024-08-20T01:52:17.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.947+0000 7f4f09b60740 1 Processor -- start 2024-08-20T01:52:17.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.947+0000 7f4f09b60740 1 -- start start 2024-08-20T01:52:17.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.947+0000 7f4ef67fc640 1 -- 172.21.15.79:0/535574437 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f4efc010460 con 0x7f4f00102a90 2024-08-20T01:52:17.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.947+0000 7f4f09b60740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be0fe3e3b0 0x55be0fe3e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:17.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.947+0000 7f4f09b60740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be0fe3ecd0 0x55be0fe4a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:17.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.947+0000 7f4f09b60740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be0fe4ac60 0x55be0fe4d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:17.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.947+0000 7f4f09b60740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55be0fdb4940 con 0x55be0fe4ac60 2024-08-20T01:52:17.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.947+0000 7f4f09b60740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55be0fda3e40 con 0x55be0fe3ecd0 2024-08-20T01:52:17.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.947+0000 7f4f09b60740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55be0fda7e80 con 0x55be0fe3e3b0 2024-08-20T01:52:17.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.947+0000 7f4f05503640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be0fe3ecd0 0x55be0fe4a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:17.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.947+0000 7f4f05d04640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be0fe3e3b0 0x55be0fe3e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:17.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.948+0000 7f4f05d04640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be0fe3e3b0 0x55be0fe3e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:55890/0 (socket says 172.21.15.79:55890) 2024-08-20T01:52:17.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.948+0000 7f4f05503640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be0fe3ecd0 0x55be0fe4a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:36168/0 (socket says 172.21.15.79:36168) 2024-08-20T01:52:17.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.948+0000 7f4f05d04640 1 -- 172.21.15.79:0/2026267929 learned_addr learned my addr 172.21.15.79:0/2026267929 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:17.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.948+0000 7f4f04d02640 1 --2- 172.21.15.79:0/2026267929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be0fe4ac60 0x55be0fe4d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:17.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.948+0000 7f4f05d04640 1 -- 172.21.15.79:0/2026267929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be0fe3ecd0 msgr2=0x55be0fe4a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:17.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.948+0000 7f4f05d04640 1 --2- 172.21.15.79:0/2026267929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be0fe3ecd0 0x55be0fe4a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:17.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.948+0000 7f4f05d04640 1 -- 172.21.15.79:0/2026267929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be0fe4ac60 msgr2=0x55be0fe4d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:17.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.948+0000 7f4f05d04640 1 --2- 172.21.15.79:0/2026267929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be0fe4ac60 0x55be0fe4d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:17.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.948+0000 7f4f05d04640 1 -- 172.21.15.79:0/2026267929 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be0fd40520 con 0x55be0fe3e3b0 2024-08-20T01:52:17.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.948+0000 7f4f05d04640 1 --2- 172.21.15.79:0/2026267929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be0fe3e3b0 0x55be0fe3e790 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8031500 tx=0x7f4ef8009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f46705f2ddd6de13 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:17.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.948+0000 7f4ef67fc640 1 --2- 172.21.15.79:0/535574437 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4eec0b3bd0 0x7f4eec0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:17.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.948+0000 7f4eeb7fe640 1 -- 172.21.15.79:0/2026267929 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef8031980 con 0x55be0fe3e3b0 2024-08-20T01:52:17.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.948+0000 7f4eeb7fe640 1 -- 172.21.15.79:0/2026267929 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4ef803f070 con 0x55be0fe3e3b0 2024-08-20T01:52:17.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.948+0000 7f4eeb7fe640 1 -- 172.21.15.79:0/2026267929 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef80043c0 con 0x55be0fe3e3b0 2024-08-20T01:52:17.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.949+0000 7f4f05503640 1 --2- 172.21.15.79:0/535574437 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4eec0b3bd0 0x7f4eec0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:17.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.949+0000 7f4ef67fc640 1 -- 172.21.15.79:0/535574437 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f4efc0e3800 con 0x7f4f00102a90 2024-08-20T01:52:17.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.949+0000 7f4f09b60740 1 -- 172.21.15.79:0/2026267929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be0fe3e3b0 msgr2=0x55be0fe3e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:17.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.949+0000 7f4f09b60740 1 --2- 172.21.15.79:0/2026267929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be0fe3e3b0 0x55be0fe3e790 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8031500 tx=0x7f4ef8009a20 comp rx=0 tx=0).stop 2024-08-20T01:52:17.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.949+0000 7f4f05503640 1 --2- 172.21.15.79:0/535574437 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4eec0b3bd0 0x7f4eec0b6090 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4efc0e1680 tx=0x7f4efc0ed960 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:17.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.949+0000 7f4f09b60740 1 -- 172.21.15.79:0/2026267929 shutdown_connections 2024-08-20T01:52:17.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.949+0000 7f4f09b60740 1 --2- 172.21.15.79:0/2026267929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be0fe4ac60 0x55be0fe4d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:17.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.949+0000 7f4f09b60740 1 --2- 172.21.15.79:0/2026267929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be0fe3ecd0 0x55be0fe4a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:17.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.949+0000 7f4f09b60740 1 --2- 172.21.15.79:0/2026267929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be0fe3e3b0 0x55be0fe3e790 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:17.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.949+0000 7f4f09b60740 1 -- 172.21.15.79:0/2026267929 >> 172.21.15.79:0/2026267929 conn(0x55be0fe3c1e0 msgr2=0x55be0fe3d380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:17.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.949+0000 7f4f09b60740 1 -- 172.21.15.79:0/2026267929 shutdown_connections 2024-08-20T01:52:17.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.949+0000 7f4f09b60740 1 -- 172.21.15.79:0/2026267929 wait complete. 2024-08-20T01:52:17.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.950+0000 7f4f09b60740 1 -- start start 2024-08-20T01:52:17.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.950+0000 7f4f09b60740 1 Processor -- start 2024-08-20T01:52:17.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.950+0000 7f4f09b60740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be0fe3e3b0 0x55be0fe47c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:17.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.950+0000 7f4f09b60740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be0fe3ecd0 0x55be0fe481c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:17.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.950+0000 7f4f09b60740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be0fe4ac60 0x55be0fe48700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:17.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.950+0000 7f4f09b60740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55be0fc06890 con 0x55be0fe4ac60 2024-08-20T01:52:17.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.950+0000 7f4f09b60740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55be0fd2a700 con 0x55be0fe3ecd0 2024-08-20T01:52:17.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.950+0000 7f4f09b60740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55be0fe4d950 con 0x55be0fe3e3b0 2024-08-20T01:52:17.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.951+0000 7f4f05d04640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be0fe4ac60 0x55be0fe48700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:17.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.950+0000 7f4f09b60740 10 client.0 _ll_register_callbacks cb 0x55be0fd9f6f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:52:17.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.951+0000 7f4f05d04640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be0fe3e3b0 0x55be0fe47c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:17.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.951+0000 7f4f05d04640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be0fe3e3b0 0x55be0fe47c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:55894/0 (socket says 172.21.15.79:55894) 2024-08-20T01:52:17.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.951+0000 7f4f04d02640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be0fe3ecd0 0x55be0fe481c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:17.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.951+0000 7f4f05d04640 1 -- 172.21.15.79:0/1695340613 learned_addr learned my addr 172.21.15.79:0/1695340613 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:17.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.951+0000 7f4f04d02640 1 -- 172.21.15.79:0/1695340613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be0fe3e3b0 msgr2=0x55be0fe47c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:17.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.951+0000 7f4f04d02640 1 --2- 172.21.15.79:0/1695340613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be0fe3e3b0 0x55be0fe47c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:17.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.951+0000 7f4f04d02640 1 -- 172.21.15.79:0/1695340613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be0fe4ac60 msgr2=0x55be0fe48700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:17.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.951+0000 7f4f04d02640 1 --2- 172.21.15.79:0/1695340613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be0fe4ac60 0x55be0fe48700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:17.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.951+0000 7f4f04d02640 1 -- 172.21.15.79:0/1695340613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be0fb03930 con 0x55be0fe3ecd0 2024-08-20T01:52:17.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.951+0000 7f4f04d02640 1 --2- 172.21.15.79:0/1695340613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be0fe3ecd0 0x55be0fe481c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4f00104b10 tx=0x7f4ef000bf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8901630f5019a769 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:17.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.951+0000 7f4ee8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:52:17.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.951+0000 7f4ee8ff9640 1 -- 172.21.15.79:0/1695340613 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0004020 con 0x55be0fe3ecd0 2024-08-20T01:52:17.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.951+0000 7f4f09b60740 1 -- 172.21.15.79:0/1695340613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ef803f070 con 0x55be0fe3ecd0 2024-08-20T01:52:17.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.951+0000 7f4ee8ff9640 1 -- 172.21.15.79:0/1695340613 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f4ef00041c0 con 0x55be0fe3ecd0 2024-08-20T01:52:17.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.951+0000 7f4ee8ff9640 1 -- 172.21.15.79:0/1695340613 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f4ef00043c0 con 0x55be0fe3ecd0 2024-08-20T01:52:17.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.951+0000 7f4f09b60740 10 client.28343 fetch_fsmap learned FSMap version 62 2024-08-20T01:52:17.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.951+0000 7f4f09b60740 1 -- 172.21.15.79:0/1695340613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55be0fe595e0 con 0x55be0fe3ecd0 2024-08-20T01:52:17.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.952+0000 7f4ee8ff9640 1 -- 172.21.15.79:0/1695340613 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4ef803f070 con 0x55be0fe3ecd0 2024-08-20T01:52:17.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.952+0000 7f4ee8ff9640 1 -- 172.21.15.79:0/1695340613 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 62) ==== 8406+0+0 (secure 0 0 0) 0x7f4ef00038b0 con 0x55be0fe3ecd0 2024-08-20T01:52:17.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.952+0000 7f4f09b60740 10 client.28343 fetch_fsmap finished waiting for FSMap version 62 2024-08-20T01:52:17.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.952+0000 7f4f09b60740 10 client.28343 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:52:17.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.952+0000 7f4f09b60740 20 client.28343 populate_metadata read hostname 'smithi079' 2024-08-20T01:52:17.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.952+0000 7f4f09b60740 1 --2- 172.21.15.79:0/1695340613 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55be0fe5aa60 0x55be0fe5ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:17.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.952+0000 7f4f09b60740 4 client.28343 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:52:17.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.952+0000 7f4f09b60740 1 -- 172.21.15.79:0/1695340613 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55be0fdb6890 con 0x55be0fe5aa60 2024-08-20T01:52:17.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.952+0000 7f4f05d04640 1 --2- 172.21.15.79:0/1695340613 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55be0fe5aa60 0x55be0fe5ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:17.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.952+0000 7f4f05d04640 1 --2- 172.21.15.79:0/1695340613 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55be0fe5aa60 0x55be0fe5ce80 crc :-1 s=READY pgs=312 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cf63d5d80964d8a server_cookie=90e6f7369346b96e in_seq=0 out_seq=0 2024-08-20T01:52:17.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.952+0000 7f4ee8ff9640 10 client.28343 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:52:17.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.953+0000 7f4ee8ff9640 1 -- 172.21.15.79:0/1695340613 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55be0fdb6890 con 0x55be0fe5aa60 2024-08-20T01:52:17.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.953+0000 7f4ee8ff9640 10 client.28343 handle_command_reply: tid=0 2024-08-20T01:52:17.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.953+0000 7f4f09b60740 1 client.28343 shutdown 2024-08-20T01:52:17.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.953+0000 7f4f09b60740 1 -- 172.21.15.79:0/1695340613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be0fe3ecd0 msgr2=0x55be0fe481c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:17.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.953+0000 7f4f09b60740 1 --2- 172.21.15.79:0/1695340613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be0fe3ecd0 0x55be0fe481c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4f00104b10 tx=0x7f4ef000bf90 comp rx=0 tx=0).stop 2024-08-20T01:52:17.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.953+0000 7f4f09b60740 1 -- 172.21.15.79:0/1695340613 shutdown_connections 2024-08-20T01:52:17.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.953+0000 7f4f09b60740 1 --2- 172.21.15.79:0/1695340613 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55be0fe5aa60 0x55be0fe5ce80 crc :-1 s=READY pgs=312 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:17.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.953+0000 7f4f09b60740 1 --2- 172.21.15.79:0/1695340613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be0fe4ac60 0x55be0fe48700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:17.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.953+0000 7f4ee8ff9640 0 client.28343 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:52:17.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.953+0000 7f4f09b60740 1 --2- 172.21.15.79:0/1695340613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be0fe3ecd0 0x55be0fe481c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:17.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.953+0000 7f4f09b60740 1 --2- 172.21.15.79:0/1695340613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be0fe3e3b0 0x55be0fe47c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:17.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.953+0000 7f4f09b60740 1 -- 172.21.15.79:0/1695340613 >> 172.21.15.79:0/1695340613 conn(0x55be0fe3c1e0 msgr2=0x55be0fe41d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:17.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.953+0000 7f4f09b60740 1 -- 172.21.15.79:0/1695340613 shutdown_connections 2024-08-20T01:52:17.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.953+0000 7f4f09b60740 1 -- 172.21.15.79:0/1695340613 wait complete. 2024-08-20T01:52:17.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.953+0000 7f4f09b60740 20 client.28343 trim_cache size 0 max 16384 2024-08-20T01:52:17.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.971+0000 7f4f09b60740 1 Processor -- start 2024-08-20T01:52:17.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.971+0000 7f4f09b60740 1 -- start start 2024-08-20T01:52:17.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.971+0000 7f4f09b60740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be0fe3e3b0 0x55be0fe41d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:17.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.971+0000 7f4f09b60740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be0fe3ecd0 0x55be0fe627a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:17.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.971+0000 7f4f09b60740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be0fe4ac60 0x55be0fe62ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:17.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.971+0000 7f4f09b60740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4f001abe00 con 0x55be0fe3ecd0 2024-08-20T01:52:17.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.971+0000 7f4f09b60740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4f001adaf0 con 0x55be0fe3e3b0 2024-08-20T01:52:17.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.971+0000 7f4f09b60740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4f001ac500 con 0x55be0fe4ac60 2024-08-20T01:52:17.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.972+0000 7f4f04d02640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be0fe3ecd0 0x55be0fe627a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:17.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.972+0000 7f4f04d02640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be0fe3ecd0 0x55be0fe627a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48324/0 (socket says 172.21.15.79:48324) 2024-08-20T01:52:17.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.972+0000 7f4f04d02640 1 -- 172.21.15.79:0/3923351453 learned_addr learned my addr 172.21.15.79:0/3923351453 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:17.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.972+0000 7f4f05d04640 1 --2- 172.21.15.79:0/3923351453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be0fe4ac60 0x55be0fe62ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:17.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.972+0000 7f4f05d04640 1 --2- 172.21.15.79:0/3923351453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be0fe3e3b0 0x55be0fe41d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:17.984 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.972+0000 7f4f04d02640 1 -- 172.21.15.79:0/3923351453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be0fe4ac60 msgr2=0x55be0fe62ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:17.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.972+0000 7f4f04d02640 1 --2- 172.21.15.79:0/3923351453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be0fe4ac60 0x55be0fe62ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:17.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.972+0000 7f4f04d02640 1 -- 172.21.15.79:0/3923351453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be0fe3e3b0 msgr2=0x55be0fe41d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:17.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.972+0000 7f4f04d02640 1 --2- 172.21.15.79:0/3923351453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be0fe3e3b0 0x55be0fe41d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:17.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.972+0000 7f4f04d02640 1 -- 172.21.15.79:0/3923351453 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be0fe5d500 con 0x55be0fe3ecd0 2024-08-20T01:52:17.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.972+0000 7f4f05d04640 1 --2- 172.21.15.79:0/3923351453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be0fe4ac60 0x55be0fe62ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:52:17.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.972+0000 7f4f04d02640 1 --2- 172.21.15.79:0/3923351453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be0fe3ecd0 0x55be0fe627a0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0000c00 tx=0x7f4ef0011d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f6a889838b1f7df server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:17.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.972+0000 7f4eeaffd640 1 -- 172.21.15.79:0/3923351453 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0004020 con 0x55be0fe3ecd0 2024-08-20T01:52:17.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.972+0000 7f4eeaffd640 1 -- 172.21.15.79:0/3923351453 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4ef0003a80 con 0x55be0fe3ecd0 2024-08-20T01:52:17.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.972+0000 7f4eeaffd640 1 -- 172.21.15.79:0/3923351453 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0010700 con 0x55be0fe3ecd0 2024-08-20T01:52:17.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.973+0000 7f4f09b60740 1 -- 172.21.15.79:0/3923351453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be0fe3ecd0 msgr2=0x55be0fe627a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:17.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.973+0000 7f4f09b60740 1 --2- 172.21.15.79:0/3923351453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be0fe3ecd0 0x55be0fe627a0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0000c00 tx=0x7f4ef0011d20 comp rx=0 tx=0).stop 2024-08-20T01:52:17.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.973+0000 7f4f09b60740 1 -- 172.21.15.79:0/3923351453 shutdown_connections 2024-08-20T01:52:17.985 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.973+0000 7f4f09b60740 1 --2- 172.21.15.79:0/3923351453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be0fe4ac60 0x55be0fe62ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:17.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.973+0000 7f4f09b60740 1 --2- 172.21.15.79:0/3923351453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be0fe3ecd0 0x55be0fe627a0 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:17.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.973+0000 7f4f09b60740 1 --2- 172.21.15.79:0/3923351453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be0fe3e3b0 0x55be0fe41d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:17.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.973+0000 7f4f09b60740 1 -- 172.21.15.79:0/3923351453 >> 172.21.15.79:0/3923351453 conn(0x55be0fe3c1e0 msgr2=0x55be0fe49ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:17.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.973+0000 7f4f09b60740 1 -- 172.21.15.79:0/3923351453 shutdown_connections 2024-08-20T01:52:17.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.973+0000 7f4f09b60740 1 -- 172.21.15.79:0/3923351453 wait complete. 2024-08-20T01:52:17.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.974+0000 7f4f09b60740 1 -- start start 2024-08-20T01:52:17.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.974+0000 7f4f09b60740 1 Processor -- start 2024-08-20T01:52:17.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.974+0000 7f4f09b60740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be0fe3e3b0 0x55be0fe53290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:17.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.974+0000 7f4f09b60740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be0fe3ecd0 0x55be0fe4e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:17.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.974+0000 7f4f09b60740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be0fe4ac60 0x55be0fe4eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:17.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.974+0000 7f4f09b60740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4f001ad360 con 0x55be0fe4ac60 2024-08-20T01:52:17.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.974+0000 7f4f09b60740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4f001acc60 con 0x55be0fe3ecd0 2024-08-20T01:52:17.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.974+0000 7f4f09b60740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4f001a9de0 con 0x55be0fe3e3b0 2024-08-20T01:52:17.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.974+0000 7f4f09b60740 10 client.0 _ll_register_callbacks cb 0x7f4ef000bb10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:52:17.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.974+0000 7f4f04d02640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be0fe3ecd0 0x55be0fe4e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:17.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.974+0000 7f4f05d04640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be0fe3e3b0 0x55be0fe53290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:17.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.974+0000 7f4f04d02640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be0fe3ecd0 0x55be0fe4e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:36196/0 (socket says 172.21.15.79:36196) 2024-08-20T01:52:17.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.974+0000 7f4f04d02640 1 -- 172.21.15.79:0/1371665689 learned_addr learned my addr 172.21.15.79:0/1371665689 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:17.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.974+0000 7f4f05d04640 1 --2- 172.21.15.79:0/1371665689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be0fe4ac60 0x55be0fe4eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:17.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.975+0000 7f4f04d02640 1 -- 172.21.15.79:0/1371665689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be0fe3e3b0 msgr2=0x55be0fe53290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:17.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.975+0000 7f4f04d02640 1 --2- 172.21.15.79:0/1371665689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be0fe3e3b0 0x55be0fe53290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:17.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.975+0000 7f4f04d02640 1 -- 172.21.15.79:0/1371665689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be0fe4ac60 msgr2=0x55be0fe4eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:17.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.975+0000 7f4f04d02640 1 --2- 172.21.15.79:0/1371665689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be0fe4ac60 0x55be0fe4eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:17.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.975+0000 7f4f04d02640 1 -- 172.21.15.79:0/1371665689 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be0fe4f4b0 con 0x55be0fe3ecd0 2024-08-20T01:52:17.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.975+0000 7f4f04d02640 1 --2- 172.21.15.79:0/1371665689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be0fe3ecd0 0x55be0fe4e760 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0012ff0 tx=0x7f4ef000b7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd84d96dc3acf363 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:17.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.975+0000 7f4ee8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:52:17.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.975+0000 7f4ee8ff9640 1 -- 172.21.15.79:0/1371665689 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef003b060 con 0x55be0fe3ecd0 2024-08-20T01:52:17.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.975+0000 7f4ee8ff9640 1 -- 172.21.15.79:0/1371665689 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f4ef0005380 con 0x55be0fe3ecd0 2024-08-20T01:52:17.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.975+0000 7f4f09b60740 1 -- 172.21.15.79:0/1371665689 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ef0003a80 con 0x55be0fe3ecd0 2024-08-20T01:52:17.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.975+0000 7f4ee8ff9640 1 -- 172.21.15.79:0/1371665689 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f4ef0005580 con 0x55be0fe3ecd0 2024-08-20T01:52:17.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.975+0000 7f4f09b60740 10 client.28349 fetch_fsmap learned FSMap version 62 2024-08-20T01:52:17.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.975+0000 7f4f09b60740 1 -- 172.21.15.79:0/1371665689 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55be0fec57f0 con 0x55be0fe3ecd0 2024-08-20T01:52:17.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.976+0000 7f4ee8ff9640 1 -- 172.21.15.79:0/1371665689 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4ef0003a80 con 0x55be0fe3ecd0 2024-08-20T01:52:17.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.976+0000 7f4ee8ff9640 1 -- 172.21.15.79:0/1371665689 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 62) ==== 8406+0+0 (secure 0 0 0) 0x7f4ef001b460 con 0x55be0fe3ecd0 2024-08-20T01:52:17.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.976+0000 7f4f09b60740 10 client.28349 fetch_fsmap finished waiting for FSMap version 62 2024-08-20T01:52:17.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.976+0000 7f4f09b60740 10 client.28349 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:52:17.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.976+0000 7f4f09b60740 20 client.28349 populate_metadata read hostname 'smithi079' 2024-08-20T01:52:17.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.976+0000 7f4f09b60740 1 --2- 172.21.15.79:0/1371665689 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55be0fec5f40 0x55be0fec8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:17.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.976+0000 7f4f09b60740 4 client.28349 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T01:52:17.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.976+0000 7f4f09b60740 1 -- 172.21.15.79:0/1371665689 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55be0fdb2330 con 0x55be0fec5f40 2024-08-20T01:52:17.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.976+0000 7f4f05d04640 1 --2- 172.21.15.79:0/1371665689 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55be0fec5f40 0x55be0fec8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:17.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.976+0000 7f4ee8ff9640 10 client.28349 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:52:17.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.976+0000 7f4f05d04640 1 --2- 172.21.15.79:0/1371665689 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55be0fec5f40 0x55be0fec8360 crc :-1 s=READY pgs=313 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dadba785aa3b6fb8 server_cookie=a9d5af72708f09ff in_seq=0 out_seq=0 2024-08-20T01:52:17.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.977+0000 7f4ee8ff9640 1 -- 172.21.15.79:0/1371665689 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55be0fdb2330 con 0x55be0fec5f40 2024-08-20T01:52:17.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.977+0000 7f4ee8ff9640 10 client.28349 handle_command_reply: tid=0 2024-08-20T01:52:17.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.977+0000 7f4f09b60740 1 client.28349 shutdown 2024-08-20T01:52:17.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.977+0000 7f4f09b60740 1 -- 172.21.15.79:0/1371665689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be0fe3ecd0 msgr2=0x55be0fe4e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:17.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.977+0000 7f4f09b60740 1 --2- 172.21.15.79:0/1371665689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be0fe3ecd0 0x55be0fe4e760 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0012ff0 tx=0x7f4ef000b7e0 comp rx=0 tx=0).stop 2024-08-20T01:52:17.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.977+0000 7f4f09b60740 1 -- 172.21.15.79:0/1371665689 shutdown_connections 2024-08-20T01:52:17.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.978+0000 7f4f09b60740 1 --2- 172.21.15.79:0/1371665689 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55be0fec5f40 0x55be0fec8360 crc :-1 s=READY pgs=313 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:17.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.978+0000 7f4f09b60740 1 --2- 172.21.15.79:0/1371665689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be0fe4ac60 0x55be0fe4eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:17.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.978+0000 7f4ee8ff9640 0 client.28349 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:52:17.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.978+0000 7f4f09b60740 1 --2- 172.21.15.79:0/1371665689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be0fe3ecd0 0x55be0fe4e760 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:17.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.978+0000 7f4f09b60740 1 --2- 172.21.15.79:0/1371665689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be0fe3e3b0 0x55be0fe53290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:17.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.978+0000 7f4f09b60740 1 -- 172.21.15.79:0/1371665689 >> 172.21.15.79:0/1371665689 conn(0x55be0fe3c1e0 msgr2=0x55be0fe3aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:17.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.978+0000 7f4f09b60740 1 -- 172.21.15.79:0/1371665689 shutdown_connections 2024-08-20T01:52:17.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.978+0000 7f4f09b60740 1 -- 172.21.15.79:0/1371665689 wait complete. 2024-08-20T01:52:17.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.978+0000 7f4f09b60740 20 client.28349 trim_cache size 0 max 16384 2024-08-20T01:52:17.990 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:52:17.991 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-08-20T01:52:17.991 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "af7a0a16-951c-4928-b610-212a98ea8d7f", 2024-08-20T01:52:17.991 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-08-20T01:52:17.991 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:52:17.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.978+0000 7f4f07767640 1 -- 172.21.15.79:0/535574437 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4eec0b3bd0 msgr2=0x7f4eec0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:17.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.978+0000 7f4f07767640 1 --2- 172.21.15.79:0/535574437 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4eec0b3bd0 0x7f4eec0b6090 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4efc0e1680 tx=0x7f4efc0ed960 comp rx=0 tx=0).stop 2024-08-20T01:52:17.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.978+0000 7f4f07767640 1 -- 172.21.15.79:0/535574437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f00102a90 msgr2=0x7f4f00198eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:17.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.978+0000 7f4f07767640 1 --2- 172.21.15.79:0/535574437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f00102a90 0x7f4f00198eb0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f4efc00d950 tx=0x7f4efc00de10 comp rx=0 tx=0).stop 2024-08-20T01:52:17.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.979+0000 7f4f07767640 1 -- 172.21.15.79:0/535574437 shutdown_connections 2024-08-20T01:52:17.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.979+0000 7f4f07767640 1 --2- 172.21.15.79:0/535574437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f00108e20 0x7f4f0019e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:17.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.979+0000 7f4f07767640 1 --2- 172.21.15.79:0/535574437 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4eec0b3bd0 0x7f4eec0b6090 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:17.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.979+0000 7f4f07767640 1 --2- 172.21.15.79:0/535574437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f001084a0 0x7f4f001993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:17.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.979+0000 7f4f07767640 1 --2- 172.21.15.79:0/535574437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f00102a90 0x7f4f00198eb0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:17.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.979+0000 7f4f07767640 1 -- 172.21.15.79:0/535574437 >> 172.21.15.79:0/535574437 conn(0x7f4f000fe540 msgr2=0x7f4f000feea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:17.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.979+0000 7f4f07767640 1 -- 172.21.15.79:0/535574437 shutdown_connections 2024-08-20T01:52:17.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:17.979+0000 7f4f07767640 1 -- 172.21.15.79:0/535574437 wait complete. 2024-08-20T01:52:18.179 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:18 smithi079 ceph-mon[18656]: pgmap v796: 97 pgs: 97 active+clean; 9.4 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.0 KiB/s wr, 19 op/s 2024-08-20T01:52:18.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:18 smithi175 ceph-mon[22392]: pgmap v796: 97 pgs: 97 active+clean; 9.4 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.0 KiB/s wr, 19 op/s 2024-08-20T01:52:18.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:18 smithi081 ceph-mon[22209]: pgmap v796: 97 pgs: 97 active+clean; 9.4 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.0 KiB/s wr, 19 op/s 2024-08-20T01:52:18.702 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:52:18.963 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:52:19.242 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:19 smithi079 ceph-mon[18656]: scrub queued for path: / 2024-08-20T01:52:19.242 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:19 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:52:19.242 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:19 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:52:19.242 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:19 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:52:19.243 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:19 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:52:19.243 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:19 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:52:19.243 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:19 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:52:19.243 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:19 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:52:19.243 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:19 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:52:19.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:19 smithi175 ceph-mon[22392]: scrub queued for path: / 2024-08-20T01:52:19.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:19 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:52:19.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:19 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:52:19.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:19 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:52:19.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:19 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:52:19.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:19 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:52:19.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:19 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:52:19.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:19 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:52:19.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:19 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:52:19.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.459+0000 7f715fe83640 1 -- 172.21.15.79:0/660557153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71581073a0 msgr2=0x7f71581077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:19.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.459+0000 7f715fe83640 1 --2- 172.21.15.79:0/660557153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71581073a0 0x7f71581077e0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f7148009900 tx=0x7f714802a410 comp rx=0 tx=0).stop 2024-08-20T01:52:19.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.459+0000 7f715fe83640 1 -- 172.21.15.79:0/660557153 shutdown_connections 2024-08-20T01:52:19.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.459+0000 7f715fe83640 1 --2- 172.21.15.79:0/660557153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7158107d20 0x7f715810e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:19.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.459+0000 7f715fe83640 1 --2- 172.21.15.79:0/660557153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71581073a0 0x7f71581077e0 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:19.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.459+0000 7f715fe83640 1 --2- 172.21.15.79:0/660557153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7158101990 0x7f7158101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:19.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.459+0000 7f715fe83640 1 -- 172.21.15.79:0/660557153 >> 172.21.15.79:0/660557153 conn(0x7f71580fd400 msgr2=0x7f71580ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:19.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.459+0000 7f715fe83640 1 -- 172.21.15.79:0/660557153 shutdown_connections 2024-08-20T01:52:19.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.459+0000 7f715fe83640 1 -- 172.21.15.79:0/660557153 wait complete. 2024-08-20T01:52:19.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.460+0000 7f715fe83640 1 Processor -- start 2024-08-20T01:52:19.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.460+0000 7f715fe83640 1 -- start start 2024-08-20T01:52:19.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.460+0000 7f715fe83640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7158101990 0x7f715819b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:19.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.460+0000 7f715fe83640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71581073a0 0x7f715819b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:19.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.460+0000 7f715fe83640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7158107d20 0x7f71581a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:19.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.460+0000 7f715fe83640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f71581129b0 con 0x7f71581073a0 2024-08-20T01:52:19.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.460+0000 7f715fe83640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7158112830 con 0x7f7158101990 2024-08-20T01:52:19.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.460+0000 7f715fe83640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7158112b30 con 0x7f7158107d20 2024-08-20T01:52:19.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.460+0000 7f715d41e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71581073a0 0x7f715819b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:19.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.460+0000 7f715dc1f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7158101990 0x7f715819b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:19.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.460+0000 7f715d41e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71581073a0 0x7f715819b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48354/0 (socket says 172.21.15.79:48354) 2024-08-20T01:52:19.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.460+0000 7f715d41e640 1 -- 172.21.15.79:0/2920694086 learned_addr learned my addr 172.21.15.79:0/2920694086 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:19.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.460+0000 7f715e420640 1 --2- 172.21.15.79:0/2920694086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7158107d20 0x7f71581a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:19.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.460+0000 7f715d41e640 1 -- 172.21.15.79:0/2920694086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7158107d20 msgr2=0x7f71581a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:19.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.460+0000 7f715d41e640 1 --2- 172.21.15.79:0/2920694086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7158107d20 0x7f71581a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:19.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.460+0000 7f715d41e640 1 -- 172.21.15.79:0/2920694086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7158101990 msgr2=0x7f715819b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:19.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.460+0000 7f715d41e640 1 --2- 172.21.15.79:0/2920694086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7158101990 0x7f715819b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:19.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.460+0000 7f715d41e640 1 -- 172.21.15.79:0/2920694086 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71581a1170 con 0x7f71581073a0 2024-08-20T01:52:19.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.461+0000 7f715d41e640 1 --2- 172.21.15.79:0/2920694086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71581073a0 0x7f715819b600 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f7148009230 tx=0x7f7148004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:19.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.461+0000 7f714effd640 1 -- 172.21.15.79:0/2920694086 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714803f030 con 0x7f71581073a0 2024-08-20T01:52:19.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.461+0000 7f715fe83640 1 -- 172.21.15.79:0/2920694086 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71581a1400 con 0x7f71581073a0 2024-08-20T01:52:19.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.461+0000 7f714effd640 1 -- 172.21.15.79:0/2920694086 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7148003a80 con 0x7f71581073a0 2024-08-20T01:52:19.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.461+0000 7f714effd640 1 -- 172.21.15.79:0/2920694086 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7148035070 con 0x7f71581073a0 2024-08-20T01:52:19.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.461+0000 7f715fe83640 1 -- 172.21.15.79:0/2920694086 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71581a7b20 con 0x7f71581073a0 2024-08-20T01:52:19.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.463+0000 7f714effd640 1 -- 172.21.15.79:0/2920694086 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f7148042030 con 0x7f71581073a0 2024-08-20T01:52:19.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.463+0000 7f716227c740 1 Processor -- start 2024-08-20T01:52:19.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.464+0000 7f716227c740 1 -- start start 2024-08-20T01:52:19.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.464+0000 7f716227c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d79675a830 0x55d79675ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:19.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.464+0000 7f716227c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d79675b150 0x55d796766ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:19.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.464+0000 7f716227c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7967670e0 0x55d7967694d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:19.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.464+0000 7f716227c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d7966d18e0 con 0x55d79675a830 2024-08-20T01:52:19.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.464+0000 7f716227c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d7966c0de0 con 0x55d79675b150 2024-08-20T01:52:19.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.464+0000 7f716227c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d7966c4e20 con 0x55d7967670e0 2024-08-20T01:52:19.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.464+0000 7f715e420640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d79675a830 0x55d79675ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:19.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.464+0000 7f715e420640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d79675a830 0x55d79675ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48364/0 (socket says 172.21.15.79:48364) 2024-08-20T01:52:19.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.464+0000 7f715dc1f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d79675b150 0x55d796766ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:19.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.464+0000 7f715e420640 1 -- 172.21.15.79:0/1399580800 learned_addr learned my addr 172.21.15.79:0/1399580800 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:19.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.464+0000 7f715d41e640 1 --2- 172.21.15.79:0/1399580800 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7967670e0 0x55d7967694d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:19.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.464+0000 7f715dc1f640 1 -- 172.21.15.79:0/1399580800 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7967670e0 msgr2=0x55d7967694d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:19.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.464+0000 7f715dc1f640 1 --2- 172.21.15.79:0/1399580800 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7967670e0 0x55d7967694d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:19.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.464+0000 7f715dc1f640 1 -- 172.21.15.79:0/1399580800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d79675a830 msgr2=0x55d79675ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:19.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.464+0000 7f715dc1f640 1 --2- 172.21.15.79:0/1399580800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d79675a830 0x55d79675ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:19.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.464+0000 7f715dc1f640 1 -- 172.21.15.79:0/1399580800 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d796420650 con 0x55d79675b150 2024-08-20T01:52:19.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.464+0000 7f714effd640 1 --2- 172.21.15.79:0/2920694086 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f71440b3bd0 0x7f71440b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:19.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.464+0000 7f715e420640 1 --2- 172.21.15.79:0/1399580800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d79675a830 0x55d79675ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:52:19.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.465+0000 7f715e420640 1 --2- 172.21.15.79:0/2920694086 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f71440b3bd0 0x7f71440b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:19.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.465+0000 7f714effd640 1 -- 172.21.15.79:0/2920694086 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f7148104180 con 0x7f71581073a0 2024-08-20T01:52:19.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.465+0000 7f715dc1f640 1 --2- 172.21.15.79:0/1399580800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d79675b150 0x55d796766ba0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f715400abf0 tx=0x7f715400f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f0c44e660ce91b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:19.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.465+0000 7f7143fff640 1 -- 172.21.15.79:0/1399580800 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7154005220 con 0x55d79675b150 2024-08-20T01:52:19.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.465+0000 7f715e420640 1 --2- 172.21.15.79:0/2920694086 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f71440b3bd0 0x7f71440b6090 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f7150005c40 tx=0x7f7150009760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:19.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.465+0000 7f7143fff640 1 -- 172.21.15.79:0/1399580800 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f71540047a0 con 0x55d79675b150 2024-08-20T01:52:19.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.465+0000 7f7143fff640 1 -- 172.21.15.79:0/1399580800 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7154018680 con 0x55d79675b150 2024-08-20T01:52:19.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.466+0000 7f716227c740 1 -- 172.21.15.79:0/1399580800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d79675b150 msgr2=0x55d796766ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:19.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.466+0000 7f716227c740 1 --2- 172.21.15.79:0/1399580800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d79675b150 0x55d796766ba0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f715400abf0 tx=0x7f715400f790 comp rx=0 tx=0).stop 2024-08-20T01:52:19.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.466+0000 7f716227c740 1 -- 172.21.15.79:0/1399580800 shutdown_connections 2024-08-20T01:52:19.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.466+0000 7f716227c740 1 --2- 172.21.15.79:0/1399580800 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7967670e0 0x55d7967694d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:19.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.466+0000 7f716227c740 1 --2- 172.21.15.79:0/1399580800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d79675b150 0x55d796766ba0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:19.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.466+0000 7f716227c740 1 --2- 172.21.15.79:0/1399580800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d79675a830 0x55d79675ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:19.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.466+0000 7f716227c740 1 -- 172.21.15.79:0/1399580800 >> 172.21.15.79:0/1399580800 conn(0x55d796758660 msgr2=0x55d796759800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:19.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.466+0000 7f716227c740 1 -- 172.21.15.79:0/1399580800 shutdown_connections 2024-08-20T01:52:19.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.466+0000 7f716227c740 1 -- 172.21.15.79:0/1399580800 wait complete. 2024-08-20T01:52:19.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.466+0000 7f716227c740 1 -- start start 2024-08-20T01:52:19.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.466+0000 7f716227c740 1 Processor -- start 2024-08-20T01:52:19.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.467+0000 7f716227c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d79675a830 0x55d796764080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:19.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.467+0000 7f716227c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d79675b150 0x55d7967645c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:19.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.467+0000 7f716227c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7967670e0 0x55d796764b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:19.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.467+0000 7f716227c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d796523700 con 0x55d7967670e0 2024-08-20T01:52:19.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.467+0000 7f716227c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d7966477c0 con 0x55d79675a830 2024-08-20T01:52:19.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.467+0000 7f716227c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d796769d90 con 0x55d79675b150 2024-08-20T01:52:19.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.467+0000 7f716227c740 10 client.0 _ll_register_callbacks cb 0x55d7966ba6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:52:19.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.467+0000 7f715e420640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7967670e0 0x55d796764b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:19.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.467+0000 7f715dc1f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d79675a830 0x55d796764080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:19.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.467+0000 7f715dc1f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d79675a830 0x55d796764080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:36220/0 (socket says 172.21.15.79:36220) 2024-08-20T01:52:19.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.467+0000 7f715dc1f640 1 -- 172.21.15.79:0/1596670959 learned_addr learned my addr 172.21.15.79:0/1596670959 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:19.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.467+0000 7f715e420640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7967670e0 0x55d796764b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48368/0 (socket says 172.21.15.79:48368) 2024-08-20T01:52:19.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.467+0000 7f715d41e640 1 --2- 172.21.15.79:0/1596670959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d79675b150 0x55d7967645c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:19.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.467+0000 7f715dc1f640 1 -- 172.21.15.79:0/1596670959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d79675b150 msgr2=0x55d7967645c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:19.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.467+0000 7f715dc1f640 1 --2- 172.21.15.79:0/1596670959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d79675b150 0x55d7967645c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:19.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.467+0000 7f715dc1f640 1 -- 172.21.15.79:0/1596670959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7967670e0 msgr2=0x55d796764b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:19.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.467+0000 7f715dc1f640 1 --2- 172.21.15.79:0/1596670959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7967670e0 0x55d796764b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:19.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.467+0000 7f715dc1f640 1 -- 172.21.15.79:0/1596670959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d796773140 con 0x55d79675a830 2024-08-20T01:52:19.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.467+0000 7f715e420640 1 --2- 172.21.15.79:0/1596670959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7967670e0 0x55d796764b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:52:19.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.467+0000 7f715dc1f640 1 --2- 172.21.15.79:0/1596670959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d79675a830 0x55d796764080 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f715401a040 tx=0x7f715400a860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edfd2be4d8a8a573 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:19.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.467+0000 7f71417fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:52:19.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.467+0000 7f71417fa640 1 -- 172.21.15.79:0/1596670959 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7154027070 con 0x55d79675a830 2024-08-20T01:52:19.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.468+0000 7f71417fa640 1 -- 172.21.15.79:0/1596670959 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f7154005140 con 0x55d79675a830 2024-08-20T01:52:19.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.468+0000 7f716227c740 1 -- 172.21.15.79:0/1596670959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d796670100 con 0x55d79675a830 2024-08-20T01:52:19.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.468+0000 7f71417fa640 1 -- 172.21.15.79:0/1596670959 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f7154033050 con 0x55d79675a830 2024-08-20T01:52:19.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.468+0000 7f716227c740 10 client.28358 fetch_fsmap learned FSMap version 62 2024-08-20T01:52:19.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.468+0000 7f716227c740 1 -- 172.21.15.79:0/1596670959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55d796775af0 con 0x55d79675a830 2024-08-20T01:52:19.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.468+0000 7f71417fa640 1 -- 172.21.15.79:0/1596670959 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55d796670100 con 0x55d79675a830 2024-08-20T01:52:19.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.468+0000 7f71417fa640 1 -- 172.21.15.79:0/1596670959 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 62) ==== 8406+0+0 (secure 0 0 0) 0x7f7154018b00 con 0x55d79675a830 2024-08-20T01:52:19.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.468+0000 7f716227c740 10 client.28358 fetch_fsmap finished waiting for FSMap version 62 2024-08-20T01:52:19.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.468+0000 7f716227c740 10 client.28358 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:52:19.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.468+0000 7f716227c740 20 client.28358 populate_metadata read hostname 'smithi079' 2024-08-20T01:52:19.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.468+0000 7f716227c740 1 --2- 172.21.15.79:0/1596670959 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d796776f00 0x55d7967792f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:19.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.468+0000 7f716227c740 4 client.28358 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:52:19.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.468+0000 7f716227c740 1 -- 172.21.15.79:0/1596670959 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d7966d3830 con 0x55d796776f00 2024-08-20T01:52:19.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.468+0000 7f715d41e640 1 --2- 172.21.15.79:0/1596670959 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d796776f00 0x55d7967792f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:19.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.469+0000 7f71417fa640 10 client.28358 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:52:19.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.469+0000 7f715d41e640 1 --2- 172.21.15.79:0/1596670959 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d796776f00 0x55d7967792f0 crc :-1 s=READY pgs=314 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83069faac3a0b8ba server_cookie=691acc2a983a77d7 in_seq=0 out_seq=0 2024-08-20T01:52:19.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.469+0000 7f71417fa640 1 -- 172.21.15.79:0/1596670959 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d7966d3830 con 0x55d796776f00 2024-08-20T01:52:19.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.469+0000 7f71417fa640 10 client.28358 handle_command_reply: tid=0 2024-08-20T01:52:19.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.469+0000 7f716227c740 1 client.28358 shutdown 2024-08-20T01:52:19.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.469+0000 7f716227c740 1 -- 172.21.15.79:0/1596670959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d79675a830 msgr2=0x55d796764080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:19.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.469+0000 7f716227c740 1 --2- 172.21.15.79:0/1596670959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d79675a830 0x55d796764080 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f715401a040 tx=0x7f715400a860 comp rx=0 tx=0).stop 2024-08-20T01:52:19.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.469+0000 7f716227c740 1 -- 172.21.15.79:0/1596670959 shutdown_connections 2024-08-20T01:52:19.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.469+0000 7f716227c740 1 --2- 172.21.15.79:0/1596670959 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d796776f00 0x55d7967792f0 crc :-1 s=READY pgs=314 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:19.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.469+0000 7f716227c740 1 --2- 172.21.15.79:0/1596670959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d7967670e0 0x55d796764b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:19.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.469+0000 7f716227c740 1 --2- 172.21.15.79:0/1596670959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d79675b150 0x55d7967645c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:19.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.469+0000 7f71417fa640 0 client.28358 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:52:19.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.469+0000 7f716227c740 1 --2- 172.21.15.79:0/1596670959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d79675a830 0x55d796764080 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:19.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.469+0000 7f716227c740 1 -- 172.21.15.79:0/1596670959 >> 172.21.15.79:0/1596670959 conn(0x55d796758660 msgr2=0x55d79675e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:19.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.470+0000 7f716227c740 1 -- 172.21.15.79:0/1596670959 shutdown_connections 2024-08-20T01:52:19.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.470+0000 7f716227c740 1 -- 172.21.15.79:0/1596670959 wait complete. 2024-08-20T01:52:19.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.470+0000 7f716227c740 20 client.28358 trim_cache size 0 max 16384 2024-08-20T01:52:19.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.487+0000 7f716227c740 1 Processor -- start 2024-08-20T01:52:19.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.487+0000 7f716227c740 1 -- start start 2024-08-20T01:52:19.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.487+0000 7f716227c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d79675a830 0x55d79675e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:19.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.487+0000 7f716227c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d79675b150 0x55d796759a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:19.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.487+0000 7f716227c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7967670e0 0x55d79677ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:19.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.487+0000 7f716227c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f71581b01e0 con 0x55d79675a830 2024-08-20T01:52:19.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.487+0000 7f716227c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f71581b1ed0 con 0x55d79675b150 2024-08-20T01:52:19.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.487+0000 7f716227c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f71581b08e0 con 0x55d7967670e0 2024-08-20T01:52:19.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.487+0000 7f715dc1f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d79675a830 0x55d79675e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:19.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.487+0000 7f715dc1f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d79675a830 0x55d79675e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48382/0 (socket says 172.21.15.79:48382) 2024-08-20T01:52:19.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.487+0000 7f715dc1f640 1 -- 172.21.15.79:0/2368651163 learned_addr learned my addr 172.21.15.79:0/2368651163 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:19.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.487+0000 7f715e420640 1 --2- 172.21.15.79:0/2368651163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7967670e0 0x55d79677ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:19.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.488+0000 7f715d41e640 1 --2- 172.21.15.79:0/2368651163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d79675b150 0x55d796759a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:19.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.488+0000 7f715dc1f640 1 -- 172.21.15.79:0/2368651163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7967670e0 msgr2=0x55d79677ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:19.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.488+0000 7f715dc1f640 1 --2- 172.21.15.79:0/2368651163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7967670e0 0x55d79677ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:19.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.488+0000 7f715dc1f640 1 -- 172.21.15.79:0/2368651163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d79675b150 msgr2=0x55d796759a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:19.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.488+0000 7f715dc1f640 1 --2- 172.21.15.79:0/2368651163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d79675b150 0x55d796759a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:19.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.488+0000 7f715dc1f640 1 -- 172.21.15.79:0/2368651163 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d796758490 con 0x55d79675a830 2024-08-20T01:52:19.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.488+0000 7f715d41e640 1 --2- 172.21.15.79:0/2368651163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d79675b150 0x55d796759a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:52:19.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.488+0000 7f715dc1f640 1 --2- 172.21.15.79:0/2368651163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d79675a830 0x55d79675e930 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f715400b010 tx=0x7f715400aef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26cb2073a85326fa server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:19.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.488+0000 7f71437fe640 1 -- 172.21.15.79:0/2368651163 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f715403c070 con 0x55d79675a830 2024-08-20T01:52:19.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.488+0000 7f71437fe640 1 -- 172.21.15.79:0/2368651163 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7154023e50 con 0x55d79675a830 2024-08-20T01:52:19.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.488+0000 7f71437fe640 1 -- 172.21.15.79:0/2368651163 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7154027040 con 0x55d79675a830 2024-08-20T01:52:19.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.489+0000 7f716227c740 1 -- 172.21.15.79:0/2368651163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d79675a830 msgr2=0x55d79675e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:19.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.489+0000 7f716227c740 1 --2- 172.21.15.79:0/2368651163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d79675a830 0x55d79675e930 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f715400b010 tx=0x7f715400aef0 comp rx=0 tx=0).stop 2024-08-20T01:52:19.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.489+0000 7f716227c740 1 -- 172.21.15.79:0/2368651163 shutdown_connections 2024-08-20T01:52:19.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.489+0000 7f716227c740 1 --2- 172.21.15.79:0/2368651163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7967670e0 0x55d79677ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:19.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.489+0000 7f716227c740 1 --2- 172.21.15.79:0/2368651163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d79675b150 0x55d796759a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:19.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.489+0000 7f716227c740 1 --2- 172.21.15.79:0/2368651163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d79675a830 0x55d79675e930 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:19.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.489+0000 7f716227c740 1 -- 172.21.15.79:0/2368651163 >> 172.21.15.79:0/2368651163 conn(0x55d796758660 msgr2=0x55d796759340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:19.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.489+0000 7f716227c740 1 -- 172.21.15.79:0/2368651163 shutdown_connections 2024-08-20T01:52:19.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.489+0000 7f716227c740 1 -- 172.21.15.79:0/2368651163 wait complete. 2024-08-20T01:52:19.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.489+0000 7f716227c740 1 -- start start 2024-08-20T01:52:19.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.489+0000 7f716227c740 1 Processor -- start 2024-08-20T01:52:19.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.490+0000 7f716227c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d79675a830 0x55d79676bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:19.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.490+0000 7f716227c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d79675b150 0x55d79676c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:19.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.490+0000 7f716227c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7967670e0 0x55d79676ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:19.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.490+0000 7f716227c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f71581b1740 con 0x55d79675a830 2024-08-20T01:52:19.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.490+0000 7f716227c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f71581b1040 con 0x55d7967670e0 2024-08-20T01:52:19.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.490+0000 7f716227c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f71581ae1c0 con 0x55d79675b150 2024-08-20T01:52:19.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.490+0000 7f716227c740 10 client.0 _ll_register_callbacks cb 0x7f7150009600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:52:19.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.490+0000 7f715dc1f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d79675a830 0x55d79676bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:19.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.490+0000 7f715dc1f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d79675a830 0x55d79676bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48390/0 (socket says 172.21.15.79:48390) 2024-08-20T01:52:19.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.490+0000 7f715dc1f640 1 -- 172.21.15.79:0/3452682678 learned_addr learned my addr 172.21.15.79:0/3452682678 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:19.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.490+0000 7f715e420640 1 --2- 172.21.15.79:0/3452682678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7967670e0 0x55d79676ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:19.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.490+0000 7f715dc1f640 1 -- 172.21.15.79:0/3452682678 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d79675b150 msgr2=0x55d79676c530 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:52:19.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.490+0000 7f715dc1f640 1 --2- 172.21.15.79:0/3452682678 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d79675b150 0x55d79676c530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:19.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.490+0000 7f715dc1f640 1 -- 172.21.15.79:0/3452682678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7967670e0 msgr2=0x55d79676ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:19.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.490+0000 7f715dc1f640 1 --2- 172.21.15.79:0/3452682678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7967670e0 0x55d79676ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:19.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.490+0000 7f715dc1f640 1 -- 172.21.15.79:0/3452682678 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7967dfa90 con 0x55d79675a830 2024-08-20T01:52:19.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.490+0000 7f715dc1f640 1 --2- 172.21.15.79:0/3452682678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d79675a830 0x55d79676bff0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f715403a040 tx=0x7f7154023810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=273ab053df325e2c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:19.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.490+0000 7f71417fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:52:19.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.490+0000 7f71417fa640 1 -- 172.21.15.79:0/3452682678 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f715403c030 con 0x55d79675a830 2024-08-20T01:52:19.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.491+0000 7f71417fa640 1 -- 172.21.15.79:0/3452682678 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f7154023bd0 con 0x55d79675a830 2024-08-20T01:52:19.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.491+0000 7f716227c740 1 -- 172.21.15.79:0/3452682678 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7154023e50 con 0x55d79675a830 2024-08-20T01:52:19.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.491+0000 7f71417fa640 1 -- 172.21.15.79:0/3452682678 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f71540052b0 con 0x55d79675a830 2024-08-20T01:52:19.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.491+0000 7f716227c740 10 client.19260 fetch_fsmap learned FSMap version 62 2024-08-20T01:52:19.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.491+0000 7f716227c740 1 -- 172.21.15.79:0/3452682678 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55d7967e0d10 con 0x55d79675a830 2024-08-20T01:52:19.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.491+0000 7f71417fa640 1 -- 172.21.15.79:0/3452682678 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7154018440 con 0x55d79675a830 2024-08-20T01:52:19.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.491+0000 7f71417fa640 1 -- 172.21.15.79:0/3452682678 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 62) ==== 8406+0+0 (secure 0 0 0) 0x7f7154043500 con 0x55d79675a830 2024-08-20T01:52:19.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.491+0000 7f716227c740 10 client.19260 fetch_fsmap finished waiting for FSMap version 62 2024-08-20T01:52:19.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.491+0000 7f716227c740 10 client.19260 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:52:19.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.491+0000 7f716227c740 20 client.19260 populate_metadata read hostname 'smithi079' 2024-08-20T01:52:19.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.491+0000 7f716227c740 1 --2- 172.21.15.79:0/3452682678 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d7967e13c0 0x55d7967e37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:19.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.491+0000 7f716227c740 4 client.19260 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:52:19.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.491+0000 7f716227c740 1 -- 172.21.15.79:0/3452682678 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f7154023e50 con 0x55d7967e13c0 2024-08-20T01:52:19.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.491+0000 7f715d41e640 1 --2- 172.21.15.79:0/3452682678 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d7967e13c0 0x55d7967e37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:19.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.492+0000 7f715d41e640 1 --2- 172.21.15.79:0/3452682678 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d7967e13c0 0x55d7967e37e0 crc :-1 s=READY pgs=315 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c493ea8083c62d1 server_cookie=7c7b39820a0ded82 in_seq=0 out_seq=0 2024-08-20T01:52:19.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.492+0000 7f71417fa640 10 client.19260 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:52:19.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.492+0000 7f71417fa640 1 -- 172.21.15.79:0/3452682678 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7f7154023e50 con 0x55d7967e13c0 2024-08-20T01:52:19.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.492+0000 7f71417fa640 10 client.19260 handle_command_reply: tid=0 2024-08-20T01:52:19.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.492+0000 7f716227c740 1 client.19260 shutdown 2024-08-20T01:52:19.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.492+0000 7f716227c740 1 -- 172.21.15.79:0/3452682678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d79675a830 msgr2=0x55d79676bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:19.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.492+0000 7f716227c740 1 --2- 172.21.15.79:0/3452682678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d79675a830 0x55d79676bff0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f715403a040 tx=0x7f7154023810 comp rx=0 tx=0).stop 2024-08-20T01:52:19.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.492+0000 7f716227c740 1 -- 172.21.15.79:0/3452682678 shutdown_connections 2024-08-20T01:52:19.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.492+0000 7f716227c740 1 --2- 172.21.15.79:0/3452682678 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d7967e13c0 0x55d7967e37e0 crc :-1 s=READY pgs=315 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:19.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.492+0000 7f716227c740 1 --2- 172.21.15.79:0/3452682678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7967670e0 0x55d79676ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:19.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.492+0000 7f71417fa640 0 client.19260 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:52:19.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.492+0000 7f716227c740 1 --2- 172.21.15.79:0/3452682678 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d79675b150 0x55d79676c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:19.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.492+0000 7f716227c740 1 --2- 172.21.15.79:0/3452682678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d79675a830 0x55d79676bff0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:19.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.492+0000 7f716227c740 1 -- 172.21.15.79:0/3452682678 >> 172.21.15.79:0/3452682678 conn(0x55d796758660 msgr2=0x55d796759b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:19.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.492+0000 7f716227c740 1 -- 172.21.15.79:0/3452682678 shutdown_connections 2024-08-20T01:52:19.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.492+0000 7f716227c740 1 -- 172.21.15.79:0/3452682678 wait complete. 2024-08-20T01:52:19.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.492+0000 7f716227c740 20 client.19260 trim_cache size 0 max 16384 2024-08-20T01:52:19.502 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:52:19.502 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-20T01:52:19.502 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": { 2024-08-20T01:52:19.502 INFO:teuthology.orchestra.run.smithi079.stdout: "af7a0a16-951c-4928-b610-212a98ea8d7f": { 2024-08-20T01:52:19.502 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/", 2024-08-20T01:52:19.502 INFO:teuthology.orchestra.run.smithi079.stdout: "tag": "af7a0a16-951c-4928-b610-212a98ea8d7f", 2024-08-20T01:52:19.502 INFO:teuthology.orchestra.run.smithi079.stdout: "options": "recursive,force" 2024-08-20T01:52:19.503 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:52:19.503 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:52:19.503 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:52:19.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.493+0000 7f715fe83640 1 -- 172.21.15.79:0/2920694086 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f71440b3bd0 msgr2=0x7f71440b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:19.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.493+0000 7f715fe83640 1 --2- 172.21.15.79:0/2920694086 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f71440b3bd0 0x7f71440b6090 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f7150005c40 tx=0x7f7150009760 comp rx=0 tx=0).stop 2024-08-20T01:52:19.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.493+0000 7f715fe83640 1 -- 172.21.15.79:0/2920694086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71581073a0 msgr2=0x7f715819b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:19.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.493+0000 7f715fe83640 1 --2- 172.21.15.79:0/2920694086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71581073a0 0x7f715819b600 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f7148009230 tx=0x7f7148004270 comp rx=0 tx=0).stop 2024-08-20T01:52:19.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.493+0000 7f715fe83640 1 -- 172.21.15.79:0/2920694086 shutdown_connections 2024-08-20T01:52:19.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.493+0000 7f715fe83640 1 --2- 172.21.15.79:0/2920694086 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f71440b3bd0 0x7f71440b6090 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:19.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.493+0000 7f715fe83640 1 --2- 172.21.15.79:0/2920694086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7158107d20 0x7f71581a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:19.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.493+0000 7f715fe83640 1 --2- 172.21.15.79:0/2920694086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71581073a0 0x7f715819b600 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:19.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.493+0000 7f715fe83640 1 --2- 172.21.15.79:0/2920694086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7158101990 0x7f715819b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:19.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.493+0000 7f715fe83640 1 -- 172.21.15.79:0/2920694086 >> 172.21.15.79:0/2920694086 conn(0x7f71580fd400 msgr2=0x7f7158104980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:19.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.493+0000 7f715fe83640 1 -- 172.21.15.79:0/2920694086 shutdown_connections 2024-08-20T01:52:19.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:19.493+0000 7f715fe83640 1 -- 172.21.15.79:0/2920694086 wait complete. 2024-08-20T01:52:19.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:19 smithi081 ceph-mon[22209]: scrub queued for path: / 2024-08-20T01:52:19.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:19 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:52:19.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:19 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:52:19.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:19 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:52:19.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:19 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:52:19.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:19 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:52:19.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:19 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:52:19.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:19 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:52:19.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:19 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:52:20.317 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:20 smithi079 ceph-mon[18656]: pgmap v797: 97 pgs: 97 active+clean; 9.3 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 2.3 KiB/s wr, 22 op/s 2024-08-20T01:52:20.317 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:20 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:52:20.346 INFO:tasks.cephfs.filesystem:scrub status for tag:af7a0a16-951c-4928-b610-212a98ea8d7f - {'path': '/', 'tag': 'af7a0a16-951c-4928-b610-212a98ea8d7f', 'options': 'recursive,force'} 2024-08-20T01:52:20.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:20 smithi175 ceph-mon[22392]: pgmap v797: 97 pgs: 97 active+clean; 9.3 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 2.3 KiB/s wr, 22 op/s 2024-08-20T01:52:20.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:20 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:52:20.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:20 smithi081 ceph-mon[22209]: pgmap v797: 97 pgs: 97 active+clean; 9.3 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 2.3 KiB/s wr, 22 op/s 2024-08-20T01:52:20.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:20 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:52:21.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:21 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:52:21.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:21 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:52:21.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:21 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:52:21.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:21 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:52:21.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:21 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:52:21.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:21 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:52:21.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:21 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:52:21.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:21 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:52:21.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:21 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:52:22.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:22 smithi081 ceph-mon[22209]: pgmap v798: 97 pgs: 97 active+clean; 9.3 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 3.3 KiB/s wr, 27 op/s 2024-08-20T01:52:22.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:22 smithi175 ceph-mon[22392]: pgmap v798: 97 pgs: 97 active+clean; 9.3 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 3.3 KiB/s wr, 27 op/s 2024-08-20T01:52:22.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:22 smithi079 ceph-mon[18656]: pgmap v798: 97 pgs: 97 active+clean; 9.3 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 3.3 KiB/s wr, 27 op/s 2024-08-20T01:52:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:23.946+0000 7f96d2ff5640 1 -- 172.21.15.79:0/1403787868 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5650e1a60490 con 0x5650e1b72bc0 2024-08-20T01:52:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:23.946+0000 7f96d2ff5640 10 client.28220 handle_command_reply: tid=0 2024-08-20T01:52:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:23.947+0000 7f96f7fbf740 1 client.28220 shutdown 2024-08-20T01:52:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:23.947+0000 7f96f7fbf740 1 -- 172.21.15.79:0/1403787868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650e1af5200 msgr2=0x5650e1b02700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:23.947+0000 7f96f7fbf740 1 --2- 172.21.15.79:0/1403787868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650e1af5200 0x5650e1b02700 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f96e4009900 tx=0x7f96e402a420 comp rx=0 tx=0).stop 2024-08-20T01:52:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:23.947+0000 7f96f7fbf740 1 -- 172.21.15.79:0/1403787868 shutdown_connections 2024-08-20T01:52:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:23.947+0000 7f96f7fbf740 1 --2- 172.21.15.79:0/1403787868 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5650e1b72bc0 0x5650e1b74fe0 crc :-1 s=READY pgs=307 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:23.947+0000 7f96f7fbf740 1 --2- 172.21.15.79:0/1403787868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650e1af7c40 0x5650e1b02c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:23.947+0000 7f96f7fbf740 1 --2- 172.21.15.79:0/1403787868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650e1af5200 0x5650e1b02700 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:23.947+0000 7f96f7fbf740 1 --2- 172.21.15.79:0/1403787868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650e1af28d0 0x5650e1b03a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:23.947+0000 7f96f7fbf740 1 -- 172.21.15.79:0/1403787868 >> 172.21.15.79:0/1403787868 conn(0x5650e1aeda20 msgr2=0x5650e1aec2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:23.947+0000 7f96d2ff5640 0 client.28220 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:52:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:23.947+0000 7f96f7fbf740 1 -- 172.21.15.79:0/1403787868 shutdown_connections 2024-08-20T01:52:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:23.947+0000 7f96f7fbf740 1 -- 172.21.15.79:0/1403787868 wait complete. 2024-08-20T01:52:23.952 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:23.947+0000 7f96f7fbf740 20 client.28220 trim_cache size 0 max 16384 2024-08-20T01:52:23.952 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:52:23.952 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:52:23.952 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:52:23.952 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:52:23.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:23.948+0000 7f96f50ee640 1 -- 172.21.15.79:0/1865576301 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f96d80b3bd0 msgr2=0x7f96d80b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:23.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:23.948+0000 7f96f50ee640 1 --2- 172.21.15.79:0/1865576301 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f96d80b3bd0 0x7f96d80b6090 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f96e00aaee0 tx=0x7f96e0092040 comp rx=0 tx=0).stop 2024-08-20T01:52:23.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:23.948+0000 7f96f50ee640 1 -- 172.21.15.79:0/1865576301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96f0101560 msgr2=0x7f96f006ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:23.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:23.948+0000 7f96f50ee640 1 --2- 172.21.15.79:0/1865576301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96f0101560 0x7f96f006ae80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f96e000e9f0 tx=0x7f96e000eeb0 comp rx=0 tx=0).stop 2024-08-20T01:52:23.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:23.948+0000 7f96f50ee640 1 -- 172.21.15.79:0/1865576301 shutdown_connections 2024-08-20T01:52:23.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:23.948+0000 7f96f50ee640 1 --2- 172.21.15.79:0/1865576301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96f0103070 0x7f96f019fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:23.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:23.948+0000 7f96f50ee640 1 --2- 172.21.15.79:0/1865576301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96f01026b0 0x7f96f019d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:23.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:23.948+0000 7f96f50ee640 1 --2- 172.21.15.79:0/1865576301 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f96d80b3bd0 0x7f96d80b6090 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:23.953 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:23.948+0000 7f96f50ee640 1 --2- 172.21.15.79:0/1865576301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96f0101560 0x7f96f006ae80 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:23.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:23.948+0000 7f96f50ee640 1 -- 172.21.15.79:0/1865576301 >> 172.21.15.79:0/1865576301 conn(0x7f96f00fce40 msgr2=0x7f96f0105af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:23.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:23.948+0000 7f96f50ee640 1 -- 172.21.15.79:0/1865576301 shutdown_connections 2024-08-20T01:52:23.954 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:23.948+0000 7f96f50ee640 1 -- 172.21.15.79:0/1865576301 wait complete. 2024-08-20T01:52:24.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:24 smithi081 ceph-mon[22209]: pgmap v799: 97 pgs: 97 active+clean; 9.2 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.8 KiB/s wr, 27 op/s 2024-08-20T01:52:24.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:24 smithi175 ceph-mon[22392]: pgmap v799: 97 pgs: 97 active+clean; 9.2 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.8 KiB/s wr, 27 op/s 2024-08-20T01:52:24.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:24 smithi079 ceph-mon[18656]: pgmap v799: 97 pgs: 97 active+clean; 9.2 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.8 KiB/s wr, 27 op/s 2024-08-20T01:52:26.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:26 smithi081 ceph-mon[22209]: pgmap v800: 97 pgs: 97 active+clean; 9.1 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 2.9 KiB/s wr, 31 op/s 2024-08-20T01:52:26.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:26 smithi175 ceph-mon[22392]: pgmap v800: 97 pgs: 97 active+clean; 9.1 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 2.9 KiB/s wr, 31 op/s 2024-08-20T01:52:26.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:26 smithi079 ceph-mon[18656]: pgmap v800: 97 pgs: 97 active+clean; 9.1 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 2.9 KiB/s wr, 31 op/s 2024-08-20T01:52:27.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:27 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:52:27.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:27 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:52:27.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:27 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:52:28.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:28 smithi081 ceph-mon[22209]: pgmap v801: 97 pgs: 97 active+clean; 9.0 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.1 KiB/s wr, 31 op/s 2024-08-20T01:52:28.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:28 smithi175 ceph-mon[22392]: pgmap v801: 97 pgs: 97 active+clean; 9.0 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.1 KiB/s wr, 31 op/s 2024-08-20T01:52:28.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:28 smithi079 ceph-mon[18656]: pgmap v801: 97 pgs: 97 active+clean; 9.0 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.1 KiB/s wr, 31 op/s 2024-08-20T01:52:30.781 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:30 smithi081 ceph-mon[22209]: pgmap v802: 97 pgs: 97 active+clean; 8.9 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.3 KiB/s wr, 32 op/s 2024-08-20T01:52:30.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:30 smithi175 ceph-mon[22392]: pgmap v802: 97 pgs: 97 active+clean; 8.9 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.3 KiB/s wr, 32 op/s 2024-08-20T01:52:30.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:30 smithi079 ceph-mon[18656]: pgmap v802: 97 pgs: 97 active+clean; 8.9 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.3 KiB/s wr, 32 op/s 2024-08-20T01:52:32.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:32 smithi081 ceph-mon[22209]: pgmap v803: 97 pgs: 97 active+clean; 8.8 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.1 KiB/s wr, 28 op/s 2024-08-20T01:52:32.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:32 smithi175 ceph-mon[22392]: pgmap v803: 97 pgs: 97 active+clean; 8.8 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.1 KiB/s wr, 28 op/s 2024-08-20T01:52:32.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:32 smithi079 ceph-mon[18656]: pgmap v803: 97 pgs: 97 active+clean; 8.8 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.1 KiB/s wr, 28 op/s 2024-08-20T01:52:34.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:34 smithi081 ceph-mon[22209]: pgmap v804: 97 pgs: 97 active+clean; 8.8 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.1 KiB/s wr, 22 op/s 2024-08-20T01:52:34.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:34 smithi175 ceph-mon[22392]: pgmap v804: 97 pgs: 97 active+clean; 8.8 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.1 KiB/s wr, 22 op/s 2024-08-20T01:52:34.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:34 smithi079 ceph-mon[18656]: pgmap v804: 97 pgs: 97 active+clean; 8.8 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.1 KiB/s wr, 22 op/s 2024-08-20T01:52:35.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:35 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:52:35.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:35 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:52:35.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:35 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:52:35.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:35 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:52:35.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:35 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:52:35.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:35 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:52:35.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:35 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:52:35.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:35 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:52:36.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:35 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:52:36.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:35 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:52:36.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:35 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:52:36.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:35 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:52:36.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:36 smithi175 ceph-mon[22392]: pgmap v805: 97 pgs: 97 active+clean; 8.7 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.8 KiB/s wr, 23 op/s 2024-08-20T01:52:36.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:36 smithi079 ceph-mon[18656]: pgmap v805: 97 pgs: 97 active+clean; 8.7 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.8 KiB/s wr, 23 op/s 2024-08-20T01:52:37.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:36 smithi081 ceph-mon[22209]: pgmap v805: 97 pgs: 97 active+clean; 8.7 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.8 KiB/s wr, 23 op/s 2024-08-20T01:52:37.041 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.038+0000 7f2e497fd640 1 -- 172.21.15.79:0/2482678137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e44103070 msgr2=0x7f2e441099f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:37.042 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.038+0000 7f2e497fd640 1 --2- 172.21.15.79:0/2482678137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e44103070 0x7f2e441099f0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c009cd0 tx=0x7f2e3c02a8e0 comp rx=0 tx=0).stop 2024-08-20T01:52:37.042 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.038+0000 7f2e497fd640 1 -- 172.21.15.79:0/2482678137 shutdown_connections 2024-08-20T01:52:37.042 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.039+0000 7f2e497fd640 1 --2- 172.21.15.79:0/2482678137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e44103070 0x7f2e441099f0 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:37.042 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.039+0000 7f2e497fd640 1 --2- 172.21.15.79:0/2482678137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e441026b0 0x7f2e44102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:37.042 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.039+0000 7f2e497fd640 1 --2- 172.21.15.79:0/2482678137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e44101560 0x7f2e44101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:37.042 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.039+0000 7f2e497fd640 1 -- 172.21.15.79:0/2482678137 >> 172.21.15.79:0/2482678137 conn(0x7f2e440fce40 msgr2=0x7f2e440ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:37.042 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.039+0000 7f2e497fd640 1 -- 172.21.15.79:0/2482678137 shutdown_connections 2024-08-20T01:52:37.042 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.039+0000 7f2e497fd640 1 -- 172.21.15.79:0/2482678137 wait complete. 2024-08-20T01:52:37.044 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.039+0000 7f2e497fd640 1 Processor -- start 2024-08-20T01:52:37.044 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.039+0000 7f2e497fd640 1 -- start start 2024-08-20T01:52:37.044 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.039+0000 7f2e497fd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e44101560 0x7f2e4406ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:37.044 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.039+0000 7f2e497fd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e441026b0 0x7f2e4419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:37.044 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.039+0000 7f2e497fd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e44103070 0x7f2e4419fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:37.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.039+0000 7f2e497fd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2e4410d080 con 0x7f2e44101560 2024-08-20T01:52:37.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.039+0000 7f2e497fd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2e4410cf00 con 0x7f2e44103070 2024-08-20T01:52:37.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.039+0000 7f2e497fd640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2e4410d200 con 0x7f2e441026b0 2024-08-20T01:52:37.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.040+0000 7f2e42ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e44101560 0x7f2e4406ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:37.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.040+0000 7f2e42ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e44101560 0x7f2e4406ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45886/0 (socket says 172.21.15.79:45886) 2024-08-20T01:52:37.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.040+0000 7f2e42ffd640 1 -- 172.21.15.79:0/3940158492 learned_addr learned my addr 172.21.15.79:0/3940158492 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:37.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.040+0000 7f2e3bfff640 1 --2- 172.21.15.79:0/3940158492 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e441026b0 0x7f2e4419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:37.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.040+0000 7f2e437fe640 1 --2- 172.21.15.79:0/3940158492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e44103070 0x7f2e4419fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:37.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.040+0000 7f2e42ffd640 1 -- 172.21.15.79:0/3940158492 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e441026b0 msgr2=0x7f2e4419d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:37.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.040+0000 7f2e42ffd640 1 --2- 172.21.15.79:0/3940158492 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e441026b0 0x7f2e4419d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:37.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.040+0000 7f2e42ffd640 1 -- 172.21.15.79:0/3940158492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e44103070 msgr2=0x7f2e4419fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:37.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.040+0000 7f2e42ffd640 1 --2- 172.21.15.79:0/3940158492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e44103070 0x7f2e4419fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:37.045 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.040+0000 7f2e42ffd640 1 -- 172.21.15.79:0/3940158492 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e441a04f0 con 0x7f2e44101560 2024-08-20T01:52:37.046 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.040+0000 7f2e42ffd640 1 --2- 172.21.15.79:0/3940158492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e44101560 0x7f2e4406ae80 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f2e3400d770 tx=0x7f2e3400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:37.046 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.040+0000 7f2e40ff9640 1 -- 172.21.15.79:0/3940158492 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e34017070 con 0x7f2e44101560 2024-08-20T01:52:37.046 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.040+0000 7f2e40ff9640 1 -- 172.21.15.79:0/3940158492 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e340054b0 con 0x7f2e44101560 2024-08-20T01:52:37.046 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.040+0000 7f2e497fd640 1 -- 172.21.15.79:0/3940158492 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e441a07e0 con 0x7f2e44101560 2024-08-20T01:52:37.046 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.040+0000 7f2e40ff9640 1 -- 172.21.15.79:0/3940158492 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e34004c60 con 0x7f2e44101560 2024-08-20T01:52:37.046 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.040+0000 7f2e497fd640 1 -- 172.21.15.79:0/3940158492 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e441a0ce0 con 0x7f2e44101560 2024-08-20T01:52:37.052 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.042+0000 7f2e4c5e8740 1 Processor -- start 2024-08-20T01:52:37.052 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.043+0000 7f2e4c5e8740 1 -- start start 2024-08-20T01:52:37.052 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.043+0000 7f2e40ff9640 1 -- 172.21.15.79:0/3940158492 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2e34004e00 con 0x7f2e44101560 2024-08-20T01:52:37.052 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.043+0000 7f2e4c5e8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2aa4298d0 0x55d2aa42bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:37.052 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.043+0000 7f2e4c5e8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2aa42c200 0x55d2aa42e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:37.052 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.043+0000 7f2e4c5e8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2aa42ec40 0x55d2aa431100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:37.052 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.043+0000 7f2e4c5e8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d2aa39c360 con 0x55d2aa42ec40 2024-08-20T01:52:37.052 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.043+0000 7f2e4c5e8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d2aa38b860 con 0x55d2aa42c200 2024-08-20T01:52:37.052 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.043+0000 7f2e4c5e8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d2aa38f8a0 con 0x55d2aa4298d0 2024-08-20T01:52:37.052 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.043+0000 7f2e3bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2aa42ec40 0x55d2aa431100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:37.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.043+0000 7f2e42ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2aa42c200 0x55d2aa42e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:37.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.043+0000 7f2e3bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2aa42ec40 0x55d2aa431100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45888/0 (socket says 172.21.15.79:45888) 2024-08-20T01:52:37.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.043+0000 7f2e3bfff640 1 -- 172.21.15.79:0/1543977866 learned_addr learned my addr 172.21.15.79:0/1543977866 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:37.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.043+0000 7f2e437fe640 1 --2- 172.21.15.79:0/1543977866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2aa4298d0 0x55d2aa42bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:37.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.043+0000 7f2e3bfff640 1 -- 172.21.15.79:0/1543977866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2aa4298d0 msgr2=0x55d2aa42bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:37.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.043+0000 7f2e3bfff640 1 --2- 172.21.15.79:0/1543977866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2aa4298d0 0x55d2aa42bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:37.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.043+0000 7f2e3bfff640 1 -- 172.21.15.79:0/1543977866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2aa42c200 msgr2=0x55d2aa42e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:37.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.043+0000 7f2e3bfff640 1 --2- 172.21.15.79:0/1543977866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2aa42c200 0x55d2aa42e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:37.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.043+0000 7f2e3bfff640 1 -- 172.21.15.79:0/1543977866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2aa332e40 con 0x55d2aa42ec40 2024-08-20T01:52:37.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.043+0000 7f2e42ffd640 1 --2- 172.21.15.79:0/1543977866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2aa42c200 0x55d2aa42e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:52:37.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.043+0000 7f2e3bfff640 1 --2- 172.21.15.79:0/1543977866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2aa42ec40 0x55d2aa431100 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c009cf0 tx=0x7f2e2c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a678e5797c623992 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:37.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.044+0000 7f2e397fa640 1 -- 172.21.15.79:0/1543977866 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c004230 con 0x55d2aa42ec40 2024-08-20T01:52:37.053 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.044+0000 7f2e40ff9640 1 --2- 172.21.15.79:0/3940158492 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2e300b3bd0 0x7f2e300b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:37.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.044+0000 7f2e397fa640 1 -- 172.21.15.79:0/1543977866 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e2c0043d0 con 0x55d2aa42ec40 2024-08-20T01:52:37.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.044+0000 7f2e397fa640 1 -- 172.21.15.79:0/1543977866 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c019710 con 0x55d2aa42ec40 2024-08-20T01:52:37.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.044+0000 7f2e437fe640 1 --2- 172.21.15.79:0/3940158492 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2e300b3bd0 0x7f2e300b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:37.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.044+0000 7f2e40ff9640 1 -- 172.21.15.79:0/3940158492 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f2e340e35e0 con 0x7f2e44101560 2024-08-20T01:52:37.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.044+0000 7f2e4c5e8740 1 -- 172.21.15.79:0/1543977866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2aa42ec40 msgr2=0x55d2aa431100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:37.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.044+0000 7f2e437fe640 1 --2- 172.21.15.79:0/3940158492 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2e300b3bd0 0x7f2e300b6090 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c004af0 tx=0x7f2e3c004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:37.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.044+0000 7f2e4c5e8740 1 --2- 172.21.15.79:0/1543977866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2aa42ec40 0x55d2aa431100 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c009cf0 tx=0x7f2e2c011810 comp rx=0 tx=0).stop 2024-08-20T01:52:37.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.045+0000 7f2e4c5e8740 1 -- 172.21.15.79:0/1543977866 shutdown_connections 2024-08-20T01:52:37.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.045+0000 7f2e4c5e8740 1 --2- 172.21.15.79:0/1543977866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2aa42ec40 0x55d2aa431100 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:37.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.045+0000 7f2e4c5e8740 1 --2- 172.21.15.79:0/1543977866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2aa42c200 0x55d2aa42e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:37.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.045+0000 7f2e4c5e8740 1 --2- 172.21.15.79:0/1543977866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2aa4298d0 0x55d2aa42bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:37.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.045+0000 7f2e4c5e8740 1 -- 172.21.15.79:0/1543977866 >> 172.21.15.79:0/1543977866 conn(0x55d2aa424a20 msgr2=0x55d2aa4257b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:37.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.045+0000 7f2e4c5e8740 1 -- 172.21.15.79:0/1543977866 shutdown_connections 2024-08-20T01:52:37.054 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.045+0000 7f2e4c5e8740 1 -- 172.21.15.79:0/1543977866 wait complete. 2024-08-20T01:52:37.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.045+0000 7f2e4c5e8740 1 -- start start 2024-08-20T01:52:37.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.045+0000 7f2e4c5e8740 1 Processor -- start 2024-08-20T01:52:37.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.045+0000 7f2e4c5e8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2aa4298d0 0x55d2aa433090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:37.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.045+0000 7f2e4c5e8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2aa42c200 0x55d2aa433730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:37.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.045+0000 7f2e4c5e8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2aa42ec40 0x55d2aa434300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:37.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.045+0000 7f2e4c5e8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d2aa2c4ab0 con 0x55d2aa4298d0 2024-08-20T01:52:37.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.045+0000 7f2e4c5e8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d2aa312780 con 0x55d2aa42c200 2024-08-20T01:52:37.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.045+0000 7f2e4c5e8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d2aa431c20 con 0x55d2aa42ec40 2024-08-20T01:52:37.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.045+0000 7f2e4c5e8740 10 client.0 _ll_register_callbacks cb 0x55d2aa09aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:52:37.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.045+0000 7f2e42ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2aa4298d0 0x55d2aa433090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:37.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.045+0000 7f2e42ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2aa4298d0 0x55d2aa433090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45904/0 (socket says 172.21.15.79:45904) 2024-08-20T01:52:37.055 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.045+0000 7f2e42ffd640 1 -- 172.21.15.79:0/209922908 learned_addr learned my addr 172.21.15.79:0/209922908 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:37.056 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.045+0000 7f2e3bfff640 1 --2- 172.21.15.79:0/209922908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2aa42c200 0x55d2aa433730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:37.056 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.046+0000 7f2e437fe640 1 --2- 172.21.15.79:0/209922908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2aa42ec40 0x55d2aa434300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:37.056 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.046+0000 7f2e42ffd640 1 -- 172.21.15.79:0/209922908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2aa42ec40 msgr2=0x55d2aa434300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:37.056 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.046+0000 7f2e42ffd640 1 --2- 172.21.15.79:0/209922908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2aa42ec40 0x55d2aa434300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:37.056 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.046+0000 7f2e42ffd640 1 -- 172.21.15.79:0/209922908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2aa42c200 msgr2=0x55d2aa433730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:37.056 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.046+0000 7f2e42ffd640 1 --2- 172.21.15.79:0/209922908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2aa42c200 0x55d2aa433730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:37.056 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.046+0000 7f2e42ffd640 1 -- 172.21.15.79:0/209922908 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2aa0ee790 con 0x55d2aa4298d0 2024-08-20T01:52:37.056 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.046+0000 7f2e42ffd640 1 --2- 172.21.15.79:0/209922908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2aa4298d0 0x55d2aa433090 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f2e340aa580 tx=0x7f2e34009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fedbaa5793ae1cff server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:37.056 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.046+0000 7f2e2a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:52:37.056 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.046+0000 7f2e2a7fc640 1 -- 172.21.15.79:0/209922908 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e34020070 con 0x55d2aa4298d0 2024-08-20T01:52:37.056 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.046+0000 7f2e2a7fc640 1 -- 172.21.15.79:0/209922908 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f2e340050f0 con 0x55d2aa4298d0 2024-08-20T01:52:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.046+0000 7f2e4c5e8740 1 -- 172.21.15.79:0/209922908 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d2aa33ae00 con 0x55d2aa4298d0 2024-08-20T01:52:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.046+0000 7f2e2a7fc640 1 -- 172.21.15.79:0/209922908 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f2e340aa3c0 con 0x55d2aa4298d0 2024-08-20T01:52:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.046+0000 7f2e4c5e8740 10 client.19272 fetch_fsmap learned FSMap version 62 2024-08-20T01:52:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.046+0000 7f2e4c5e8740 1 -- 172.21.15.79:0/209922908 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55d2aa167620 con 0x55d2aa4298d0 2024-08-20T01:52:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.046+0000 7f2e2a7fc640 1 -- 172.21.15.79:0/209922908 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55d2aa33ae00 con 0x55d2aa4298d0 2024-08-20T01:52:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.046+0000 7f2e2a7fc640 1 -- 172.21.15.79:0/209922908 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 62) ==== 8406+0+0 (secure 0 0 0) 0x7f2e340bfbe0 con 0x55d2aa4298d0 2024-08-20T01:52:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.046+0000 7f2e4c5e8740 10 client.19272 fetch_fsmap finished waiting for FSMap version 62 2024-08-20T01:52:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.046+0000 7f2e4c5e8740 10 client.19272 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:52:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.046+0000 7f2e4c5e8740 20 client.19272 populate_metadata read hostname 'smithi079' 2024-08-20T01:52:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.046+0000 7f2e4c5e8740 1 --2- 172.21.15.79:0/209922908 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d2aa43ea40 0x55d2aa440eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.046+0000 7f2e4c5e8740 4 client.19272 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:52:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.046+0000 7f2e4c5e8740 1 -- 172.21.15.79:0/209922908 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d2aa39e2b0 con 0x55d2aa43ea40 2024-08-20T01:52:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.047+0000 7f2e3bfff640 1 --2- 172.21.15.79:0/209922908 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d2aa43ea40 0x55d2aa440eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:37.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.047+0000 7f2e2a7fc640 10 client.19272 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:52:37.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.047+0000 7f2e3bfff640 1 --2- 172.21.15.79:0/209922908 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d2aa43ea40 0x55d2aa440eb0 crc :-1 s=READY pgs=316 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=414485726e19327f server_cookie=bffee96df12595ed in_seq=0 out_seq=0 2024-08-20T01:52:37.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.048+0000 7f2e2a7fc640 1 -- 172.21.15.79:0/209922908 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d2aa39e2b0 con 0x55d2aa43ea40 2024-08-20T01:52:37.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.048+0000 7f2e2a7fc640 10 client.19272 handle_command_reply: tid=0 2024-08-20T01:52:37.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.048+0000 7f2e4c5e8740 1 client.19272 shutdown 2024-08-20T01:52:37.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.048+0000 7f2e4c5e8740 1 -- 172.21.15.79:0/209922908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2aa4298d0 msgr2=0x55d2aa433090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:37.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.048+0000 7f2e4c5e8740 1 --2- 172.21.15.79:0/209922908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2aa4298d0 0x55d2aa433090 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f2e340aa580 tx=0x7f2e34009e60 comp rx=0 tx=0).stop 2024-08-20T01:52:37.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.048+0000 7f2e4c5e8740 1 -- 172.21.15.79:0/209922908 shutdown_connections 2024-08-20T01:52:37.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.048+0000 7f2e4c5e8740 1 --2- 172.21.15.79:0/209922908 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d2aa43ea40 0x55d2aa440eb0 crc :-1 s=READY pgs=316 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:37.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.048+0000 7f2e4c5e8740 1 --2- 172.21.15.79:0/209922908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2aa42ec40 0x55d2aa434300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:37.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.048+0000 7f2e4c5e8740 1 --2- 172.21.15.79:0/209922908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2aa42c200 0x55d2aa433730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:37.059 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.048+0000 7f2e2a7fc640 0 client.19272 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:52:37.059 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.048+0000 7f2e4c5e8740 1 --2- 172.21.15.79:0/209922908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2aa4298d0 0x55d2aa433090 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:37.059 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.048+0000 7f2e4c5e8740 1 -- 172.21.15.79:0/209922908 >> 172.21.15.79:0/209922908 conn(0x55d2aa424a20 msgr2=0x55d2aa423ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:37.059 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.048+0000 7f2e4c5e8740 1 -- 172.21.15.79:0/209922908 shutdown_connections 2024-08-20T01:52:37.059 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.048+0000 7f2e4c5e8740 1 -- 172.21.15.79:0/209922908 wait complete. 2024-08-20T01:52:37.059 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.048+0000 7f2e4c5e8740 20 client.19272 trim_cache size 0 max 16384 2024-08-20T01:52:37.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.062+0000 7f2e4c5e8740 1 Processor -- start 2024-08-20T01:52:37.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.062+0000 7f2e4c5e8740 1 -- start start 2024-08-20T01:52:37.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.062+0000 7f2e4c5e8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2aa4298d0 0x55d2aa41f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:37.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.062+0000 7f2e4c5e8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2aa42c200 0x55d2aa4232c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:37.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.062+0000 7f2e4c5e8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2aa42ec40 0x55d2aa423800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:37.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.062+0000 7f2e4c5e8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2e441a9ab0 con 0x55d2aa4298d0 2024-08-20T01:52:37.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.062+0000 7f2e4c5e8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2e441ab7a0 con 0x55d2aa42ec40 2024-08-20T01:52:37.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.062+0000 7f2e4c5e8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2e441aa1b0 con 0x55d2aa42c200 2024-08-20T01:52:37.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.062+0000 7f2e42ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2aa4298d0 0x55d2aa41f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:37.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.062+0000 7f2e42ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2aa4298d0 0x55d2aa41f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45920/0 (socket says 172.21.15.79:45920) 2024-08-20T01:52:37.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.062+0000 7f2e42ffd640 1 -- 172.21.15.79:0/3822205215 learned_addr learned my addr 172.21.15.79:0/3822205215 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:37.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.062+0000 7f2e437fe640 1 --2- 172.21.15.79:0/3822205215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2aa42ec40 0x55d2aa423800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:37.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.063+0000 7f2e3bfff640 1 --2- 172.21.15.79:0/3822205215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2aa42c200 0x55d2aa4232c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:37.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.063+0000 7f2e42ffd640 1 -- 172.21.15.79:0/3822205215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2aa42c200 msgr2=0x55d2aa4232c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:37.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.063+0000 7f2e42ffd640 1 --2- 172.21.15.79:0/3822205215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2aa42c200 0x55d2aa4232c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:37.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.063+0000 7f2e42ffd640 1 -- 172.21.15.79:0/3822205215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2aa42ec40 msgr2=0x55d2aa423800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:37.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.063+0000 7f2e42ffd640 1 --2- 172.21.15.79:0/3822205215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2aa42ec40 0x55d2aa423800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:37.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.063+0000 7f2e42ffd640 1 -- 172.21.15.79:0/3822205215 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2aa42c030 con 0x55d2aa4298d0 2024-08-20T01:52:37.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.063+0000 7f2e437fe640 1 --2- 172.21.15.79:0/3822205215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2aa42ec40 0x55d2aa423800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:52:37.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.063+0000 7f2e42ffd640 1 --2- 172.21.15.79:0/3822205215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2aa4298d0 0x55d2aa41f780 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f2e340a6670 tx=0x7f2e340e3970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daaf6b327a9344e7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:37.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.063+0000 7f2e38ff9640 1 -- 172.21.15.79:0/3822205215 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e34020070 con 0x55d2aa4298d0 2024-08-20T01:52:37.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.063+0000 7f2e38ff9640 1 -- 172.21.15.79:0/3822205215 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e340aa100 con 0x55d2aa4298d0 2024-08-20T01:52:37.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.063+0000 7f2e38ff9640 1 -- 172.21.15.79:0/3822205215 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e340a9d60 con 0x55d2aa4298d0 2024-08-20T01:52:37.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.064+0000 7f2e4c5e8740 1 -- 172.21.15.79:0/3822205215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2aa4298d0 msgr2=0x55d2aa41f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:37.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.064+0000 7f2e4c5e8740 1 --2- 172.21.15.79:0/3822205215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2aa4298d0 0x55d2aa41f780 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f2e340a6670 tx=0x7f2e340e3970 comp rx=0 tx=0).stop 2024-08-20T01:52:37.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.064+0000 7f2e4c5e8740 1 -- 172.21.15.79:0/3822205215 shutdown_connections 2024-08-20T01:52:37.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.064+0000 7f2e4c5e8740 1 --2- 172.21.15.79:0/3822205215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2aa42ec40 0x55d2aa423800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:37.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.064+0000 7f2e4c5e8740 1 --2- 172.21.15.79:0/3822205215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2aa42c200 0x55d2aa4232c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:37.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.064+0000 7f2e4c5e8740 1 --2- 172.21.15.79:0/3822205215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2aa4298d0 0x55d2aa41f780 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:37.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.064+0000 7f2e4c5e8740 1 -- 172.21.15.79:0/3822205215 >> 172.21.15.79:0/3822205215 conn(0x55d2aa424a20 msgr2=0x55d2aa430540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:37.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.064+0000 7f2e4c5e8740 1 -- 172.21.15.79:0/3822205215 shutdown_connections 2024-08-20T01:52:37.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.064+0000 7f2e4c5e8740 1 -- 172.21.15.79:0/3822205215 wait complete. 2024-08-20T01:52:37.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.064+0000 7f2e4c5e8740 1 -- start start 2024-08-20T01:52:37.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.064+0000 7f2e4c5e8740 1 Processor -- start 2024-08-20T01:52:37.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.064+0000 7f2e4c5e8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2aa4298d0 0x55d2aa43a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:37.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.064+0000 7f2e4c5e8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2aa42c200 0x55d2aa439650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:37.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.064+0000 7f2e4c5e8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2aa42ec40 0x55d2aa439b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:37.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.064+0000 7f2e4c5e8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2e441ab010 con 0x55d2aa42c200 2024-08-20T01:52:37.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.065+0000 7f2e4c5e8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2e441aa910 con 0x55d2aa42ec40 2024-08-20T01:52:37.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.065+0000 7f2e4c5e8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2e441a7a90 con 0x55d2aa4298d0 2024-08-20T01:52:37.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.065+0000 7f2e4c5e8740 10 client.0 _ll_register_callbacks cb 0x7f2e340046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:52:37.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.065+0000 7f2e3bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2aa42c200 0x55d2aa439650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:37.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.065+0000 7f2e3bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2aa42c200 0x55d2aa439650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45936/0 (socket says 172.21.15.79:45936) 2024-08-20T01:52:37.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.065+0000 7f2e3bfff640 1 -- 172.21.15.79:0/1950661155 learned_addr learned my addr 172.21.15.79:0/1950661155 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.065+0000 7f2e437fe640 1 --2- 172.21.15.79:0/1950661155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2aa42ec40 0x55d2aa439b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.065+0000 7f2e42ffd640 1 --2- 172.21.15.79:0/1950661155 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2aa4298d0 0x55d2aa43a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.065+0000 7f2e3bfff640 1 -- 172.21.15.79:0/1950661155 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2aa4298d0 msgr2=0x55d2aa43a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.065+0000 7f2e3bfff640 1 --2- 172.21.15.79:0/1950661155 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2aa4298d0 0x55d2aa43a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.065+0000 7f2e3bfff640 1 -- 172.21.15.79:0/1950661155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2aa42ec40 msgr2=0x55d2aa439b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.065+0000 7f2e3bfff640 1 --2- 172.21.15.79:0/1950661155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2aa42ec40 0x55d2aa439b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.065+0000 7f2e3bfff640 1 -- 172.21.15.79:0/1950661155 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2aa43a180 con 0x55d2aa42c200 2024-08-20T01:52:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.065+0000 7f2e3bfff640 1 --2- 172.21.15.79:0/1950661155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2aa42c200 0x55d2aa439650 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c0040c0 tx=0x7f2e2c009c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b62f8690fb9be0fb server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.065+0000 7f2e2a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:52:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.065+0000 7f2e2a7fc640 1 -- 172.21.15.79:0/1950661155 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c02f020 con 0x55d2aa42c200 2024-08-20T01:52:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.065+0000 7f2e2a7fc640 1 -- 172.21.15.79:0/1950661155 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f2e2c003a00 con 0x55d2aa42c200 2024-08-20T01:52:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.065+0000 7f2e4c5e8740 1 -- 172.21.15.79:0/1950661155 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e340aa100 con 0x55d2aa42c200 2024-08-20T01:52:37.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.065+0000 7f2e2a7fc640 1 -- 172.21.15.79:0/1950661155 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f2e2c003e50 con 0x55d2aa42c200 2024-08-20T01:52:37.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.065+0000 7f2e4c5e8740 10 client.19278 fetch_fsmap learned FSMap version 62 2024-08-20T01:52:37.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.065+0000 7f2e4c5e8740 1 -- 172.21.15.79:0/1950661155 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55d2aa4a9790 con 0x55d2aa42c200 2024-08-20T01:52:37.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.065+0000 7f2e2a7fc640 1 -- 172.21.15.79:0/1950661155 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e340aa100 con 0x55d2aa42c200 2024-08-20T01:52:37.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.066+0000 7f2e2a7fc640 1 -- 172.21.15.79:0/1950661155 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 62) ==== 8406+0+0 (secure 0 0 0) 0x7f2e2c02b330 con 0x55d2aa42c200 2024-08-20T01:52:37.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.066+0000 7f2e4c5e8740 10 client.19278 fetch_fsmap finished waiting for FSMap version 62 2024-08-20T01:52:37.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.066+0000 7f2e4c5e8740 10 client.19278 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:52:37.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.066+0000 7f2e4c5e8740 20 client.19278 populate_metadata read hostname 'smithi079' 2024-08-20T01:52:37.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.066+0000 7f2e4c5e8740 1 --2- 172.21.15.79:0/1950661155 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d2aa4a9f10 0x55d2aa4ac330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:37.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.066+0000 7f2e4c5e8740 4 client.19278 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:52:37.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.066+0000 7f2e4c5e8740 1 -- 172.21.15.79:0/1950661155 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d2aa399d50 con 0x55d2aa4a9f10 2024-08-20T01:52:37.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.066+0000 7f2e42ffd640 1 --2- 172.21.15.79:0/1950661155 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d2aa4a9f10 0x55d2aa4ac330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:37.074 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.066+0000 7f2e2a7fc640 10 client.19278 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:52:37.075 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:37.066+0000 7f2e42ffd640 1 --2- 172.21.15.79:0/1950661155 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d2aa4a9f10 0x55d2aa4ac330 crc :-1 s=READY pgs=317 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54a50a8d6c1cd2d3 server_cookie=b57d2a6902e4c4b4 in_seq=0 out_seq=0 2024-08-20T01:52:38.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:38 smithi175 ceph-mon[22392]: pgmap v806: 97 pgs: 97 active+clean; 8.6 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.4 KiB/s wr, 22 op/s 2024-08-20T01:52:38.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:38 smithi079 ceph-mon[18656]: pgmap v806: 97 pgs: 97 active+clean; 8.6 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.4 KiB/s wr, 22 op/s 2024-08-20T01:52:39.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:38 smithi081 ceph-mon[22209]: pgmap v806: 97 pgs: 97 active+clean; 8.6 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.4 KiB/s wr, 22 op/s 2024-08-20T01:52:40.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:40 smithi175 ceph-mon[22392]: pgmap v807: 97 pgs: 97 active+clean; 8.5 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.2 KiB/s wr, 23 op/s 2024-08-20T01:52:40.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:40 smithi079 ceph-mon[18656]: pgmap v807: 97 pgs: 97 active+clean; 8.5 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.2 KiB/s wr, 23 op/s 2024-08-20T01:52:41.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:40 smithi081 ceph-mon[22209]: pgmap v807: 97 pgs: 97 active+clean; 8.5 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.2 KiB/s wr, 23 op/s 2024-08-20T01:52:42.831 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:42 smithi081 ceph-mon[22209]: pgmap v808: 97 pgs: 97 active+clean; 8.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.4 KiB/s wr, 24 op/s 2024-08-20T01:52:42.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:42 smithi175 ceph-mon[22392]: pgmap v808: 97 pgs: 97 active+clean; 8.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.4 KiB/s wr, 24 op/s 2024-08-20T01:52:42.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:42 smithi079 ceph-mon[18656]: pgmap v808: 97 pgs: 97 active+clean; 8.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.4 KiB/s wr, 24 op/s 2024-08-20T01:52:44.857 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:44.853+0000 7f2e2a7fc640 1 -- 172.21.15.79:0/1950661155 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d2aa399d50 con 0x55d2aa4a9f10 2024-08-20T01:52:44.857 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:44.853+0000 7f2e2a7fc640 10 client.19278 handle_command_reply: tid=0 2024-08-20T01:52:44.857 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:44.853+0000 7f2e4c5e8740 1 client.19278 shutdown 2024-08-20T01:52:44.857 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:44.853+0000 7f2e4c5e8740 1 -- 172.21.15.79:0/1950661155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2aa42c200 msgr2=0x55d2aa439650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:44.857 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:44.853+0000 7f2e4c5e8740 1 --2- 172.21.15.79:0/1950661155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2aa42c200 0x55d2aa439650 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c0040c0 tx=0x7f2e2c009c60 comp rx=0 tx=0).stop 2024-08-20T01:52:44.857 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:44.853+0000 7f2e4c5e8740 1 -- 172.21.15.79:0/1950661155 shutdown_connections 2024-08-20T01:52:44.857 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:44.853+0000 7f2e4c5e8740 1 --2- 172.21.15.79:0/1950661155 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d2aa4a9f10 0x55d2aa4ac330 crc :-1 s=READY pgs=317 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:44.857 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:44.853+0000 7f2e4c5e8740 1 --2- 172.21.15.79:0/1950661155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2aa42ec40 0x55d2aa439b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:44.857 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:44.853+0000 7f2e4c5e8740 1 --2- 172.21.15.79:0/1950661155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d2aa42c200 0x55d2aa439650 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:44.857 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:44.853+0000 7f2e2a7fc640 0 client.19278 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:52:44.858 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:44.853+0000 7f2e4c5e8740 1 --2- 172.21.15.79:0/1950661155 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d2aa4298d0 0x55d2aa43a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:44.858 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:44.853+0000 7f2e4c5e8740 1 -- 172.21.15.79:0/1950661155 >> 172.21.15.79:0/1950661155 conn(0x55d2aa424a20 msgr2=0x55d2aa4232c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:44.858 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:44.854+0000 7f2e4c5e8740 1 -- 172.21.15.79:0/1950661155 shutdown_connections 2024-08-20T01:52:44.858 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:44.854+0000 7f2e4c5e8740 1 -- 172.21.15.79:0/1950661155 wait complete. 2024-08-20T01:52:44.858 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:44.854+0000 7f2e4c5e8740 20 client.19278 trim_cache size 0 max 16384 2024-08-20T01:52:44.858 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:52:44.858 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:52:44.859 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:52:44.859 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:52:44.859 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:44.854+0000 7f2e497fd640 1 -- 172.21.15.79:0/3940158492 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2e300b3bd0 msgr2=0x7f2e300b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:44.859 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:44.854+0000 7f2e497fd640 1 --2- 172.21.15.79:0/3940158492 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2e300b3bd0 0x7f2e300b6090 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c004af0 tx=0x7f2e3c004a40 comp rx=0 tx=0).stop 2024-08-20T01:52:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:44.854+0000 7f2e497fd640 1 -- 172.21.15.79:0/3940158492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e44101560 msgr2=0x7f2e4406ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:44.854+0000 7f2e497fd640 1 --2- 172.21.15.79:0/3940158492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e44101560 0x7f2e4406ae80 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f2e3400d770 tx=0x7f2e3400dc30 comp rx=0 tx=0).stop 2024-08-20T01:52:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:44.854+0000 7f2e497fd640 1 -- 172.21.15.79:0/3940158492 shutdown_connections 2024-08-20T01:52:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:44.854+0000 7f2e497fd640 1 --2- 172.21.15.79:0/3940158492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e44103070 0x7f2e4419fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:44.854+0000 7f2e497fd640 1 --2- 172.21.15.79:0/3940158492 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f2e300b3bd0 0x7f2e300b6090 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:44.854+0000 7f2e497fd640 1 --2- 172.21.15.79:0/3940158492 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e441026b0 0x7f2e4419d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:44.854+0000 7f2e497fd640 1 --2- 172.21.15.79:0/3940158492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e44101560 0x7f2e4406ae80 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:44.854+0000 7f2e497fd640 1 -- 172.21.15.79:0/3940158492 >> 172.21.15.79:0/3940158492 conn(0x7f2e440fce40 msgr2=0x7f2e44105ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:44.854+0000 7f2e497fd640 1 -- 172.21.15.79:0/3940158492 shutdown_connections 2024-08-20T01:52:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:44.854+0000 7f2e497fd640 1 -- 172.21.15.79:0/3940158492 wait complete. 2024-08-20T01:52:44.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:44 smithi175 ceph-mon[22392]: pgmap v809: 97 pgs: 97 active+clean; 8.3 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.9 KiB/s wr, 23 op/s 2024-08-20T01:52:44.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:44 smithi079 ceph-mon[18656]: pgmap v809: 97 pgs: 97 active+clean; 8.3 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.9 KiB/s wr, 23 op/s 2024-08-20T01:52:45.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:44 smithi081 ceph-mon[22209]: pgmap v809: 97 pgs: 97 active+clean; 8.3 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.9 KiB/s wr, 23 op/s 2024-08-20T01:52:46.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:46 smithi175 ceph-mon[22392]: pgmap v810: 97 pgs: 97 active+clean; 8.2 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 6.1 KiB/s wr, 27 op/s 2024-08-20T01:52:46.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:46 smithi079 ceph-mon[18656]: pgmap v810: 97 pgs: 97 active+clean; 8.2 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 6.1 KiB/s wr, 27 op/s 2024-08-20T01:52:47.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:46 smithi081 ceph-mon[22209]: pgmap v810: 97 pgs: 97 active+clean; 8.2 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 6.1 KiB/s wr, 27 op/s 2024-08-20T01:52:48.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:48 smithi175 ceph-mon[22392]: pgmap v811: 97 pgs: 97 active+clean; 8.1 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 KiB/s wr, 29 op/s 2024-08-20T01:52:48.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:48 smithi079 ceph-mon[18656]: pgmap v811: 97 pgs: 97 active+clean; 8.1 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 KiB/s wr, 29 op/s 2024-08-20T01:52:49.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:48 smithi081 ceph-mon[22209]: pgmap v811: 97 pgs: 97 active+clean; 8.1 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 KiB/s wr, 29 op/s 2024-08-20T01:52:50.347 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:52:50.608 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:52:50.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:50 smithi079 ceph-mon[18656]: pgmap v812: 97 pgs: 97 active+clean; 8.0 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 30 op/s 2024-08-20T01:52:50.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:50 smithi175 ceph-mon[22392]: pgmap v812: 97 pgs: 97 active+clean; 8.0 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 30 op/s 2024-08-20T01:52:51.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:50 smithi081 ceph-mon[22209]: pgmap v812: 97 pgs: 97 active+clean; 8.0 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 30 op/s 2024-08-20T01:52:51.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.124+0000 7ff72301a640 1 -- 172.21.15.79:0/2725382287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff71c1039a0 msgr2=0x7ff71c103d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:51.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.124+0000 7ff72301a640 1 --2- 172.21.15.79:0/2725382287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff71c1039a0 0x7ff71c103d80 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7ff710009900 tx=0x7ff71002a410 comp rx=0 tx=0).stop 2024-08-20T01:52:51.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.124+0000 7ff72301a640 1 -- 172.21.15.79:0/2725382287 shutdown_connections 2024-08-20T01:52:51.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.124+0000 7ff72301a640 1 --2- 172.21.15.79:0/2725382287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff71c10ce00 0x7ff71c10f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:51.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.124+0000 7ff72301a640 1 --2- 172.21.15.79:0/2725382287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff71c1042c0 0x7ff71c10c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:51.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.124+0000 7ff72301a640 1 --2- 172.21.15.79:0/2725382287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff71c1039a0 0x7ff71c103d80 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:51.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.124+0000 7ff72301a640 1 -- 172.21.15.79:0/2725382287 >> 172.21.15.79:0/2725382287 conn(0x7ff71c0fd400 msgr2=0x7ff71c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:51.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.124+0000 7ff72301a640 1 -- 172.21.15.79:0/2725382287 shutdown_connections 2024-08-20T01:52:51.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.124+0000 7ff72301a640 1 -- 172.21.15.79:0/2725382287 wait complete. 2024-08-20T01:52:51.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.125+0000 7ff72301a640 1 Processor -- start 2024-08-20T01:52:51.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.125+0000 7ff72301a640 1 -- start start 2024-08-20T01:52:51.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.125+0000 7ff72301a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff71c1039a0 0x7ff71c198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:51.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.125+0000 7ff72301a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff71c1042c0 0x7ff71c1993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:51.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.125+0000 7ff72301a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff71c10ce00 0x7ff71c19e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:51.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.125+0000 7ff72301a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff71c112920 con 0x7ff71c1042c0 2024-08-20T01:52:51.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.125+0000 7ff72301a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff71c1127a0 con 0x7ff71c1039a0 2024-08-20T01:52:51.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.125+0000 7ff72301a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff71c112aa0 con 0x7ff71c10ce00 2024-08-20T01:52:51.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.125+0000 7ff71bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff71c1042c0 0x7ff71c1993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:51.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.125+0000 7ff71bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff71c1042c0 0x7ff71c1993f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42994/0 (socket says 172.21.15.79:42994) 2024-08-20T01:52:51.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.125+0000 7ff71bfff640 1 -- 172.21.15.79:0/1027159453 learned_addr learned my addr 172.21.15.79:0/1027159453 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:51.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.125+0000 7ff720db6640 1 --2- 172.21.15.79:0/1027159453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff71c1039a0 0x7ff71c198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:51.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.126+0000 7ff7215b7640 1 --2- 172.21.15.79:0/1027159453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff71c10ce00 0x7ff71c19e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:51.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.126+0000 7ff71bfff640 1 -- 172.21.15.79:0/1027159453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff71c10ce00 msgr2=0x7ff71c19e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:51.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.126+0000 7ff71bfff640 1 --2- 172.21.15.79:0/1027159453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff71c10ce00 0x7ff71c19e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:51.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.126+0000 7ff71bfff640 1 -- 172.21.15.79:0/1027159453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff71c1039a0 msgr2=0x7ff71c198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:51.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.126+0000 7ff71bfff640 1 --2- 172.21.15.79:0/1027159453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff71c1039a0 0x7ff71c198eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:51.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.126+0000 7ff71bfff640 1 -- 172.21.15.79:0/1027159453 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff71c19ef60 con 0x7ff71c1042c0 2024-08-20T01:52:51.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.126+0000 7ff7215b7640 1 --2- 172.21.15.79:0/1027159453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff71c10ce00 0x7ff71c19e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:52:51.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.126+0000 7ff71bfff640 1 --2- 172.21.15.79:0/1027159453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff71c1042c0 0x7ff71c1993f0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7ff70800e9c0 tx=0x7ff70800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:51.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.126+0000 7ff719ffb640 1 -- 172.21.15.79:0/1027159453 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff70800ccc0 con 0x7ff71c1042c0 2024-08-20T01:52:51.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.126+0000 7ff719ffb640 1 -- 172.21.15.79:0/1027159453 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff7080044b0 con 0x7ff71c1042c0 2024-08-20T01:52:51.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.126+0000 7ff72301a640 1 -- 172.21.15.79:0/1027159453 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff71c19f250 con 0x7ff71c1042c0 2024-08-20T01:52:51.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.126+0000 7ff719ffb640 1 -- 172.21.15.79:0/1027159453 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff708003e50 con 0x7ff71c1042c0 2024-08-20T01:52:51.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.126+0000 7ff72301a640 1 -- 172.21.15.79:0/1027159453 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff71c1a5910 con 0x7ff71c1042c0 2024-08-20T01:52:51.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.129+0000 7ff719ffb640 1 -- 172.21.15.79:0/1027159453 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff708004000 con 0x7ff71c1042c0 2024-08-20T01:52:51.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.129+0000 7ff725413740 1 Processor -- start 2024-08-20T01:52:51.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.129+0000 7ff725413740 1 -- start start 2024-08-20T01:52:51.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.129+0000 7ff725413740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56f716830 0x55d56f716c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:51.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.129+0000 7ff725413740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d56f717150 0x55d56f722ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:51.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.129+0000 7ff725413740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d56f7230e0 0x55d56f7254d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:51.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.129+0000 7ff725413740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d56f68d8e0 con 0x55d56f7230e0 2024-08-20T01:52:51.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.129+0000 7ff725413740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d56f67cde0 con 0x55d56f717150 2024-08-20T01:52:51.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.129+0000 7ff725413740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d56f680e20 con 0x55d56f716830 2024-08-20T01:52:51.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.129+0000 7ff720db6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d56f717150 0x55d56f722ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:51.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.129+0000 7ff71bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d56f7230e0 0x55d56f7254d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:51.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.129+0000 7ff720db6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d56f717150 0x55d56f722ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:56982/0 (socket says 172.21.15.79:56982) 2024-08-20T01:52:51.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.129+0000 7ff720db6640 1 -- 172.21.15.79:0/4036682123 learned_addr learned my addr 172.21.15.79:0/4036682123 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:51.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.129+0000 7ff7215b7640 1 --2- 172.21.15.79:0/4036682123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56f716830 0x55d56f716c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:51.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.130+0000 7ff7215b7640 1 -- 172.21.15.79:0/4036682123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d56f717150 msgr2=0x55d56f722ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:51.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.130+0000 7ff7215b7640 1 --2- 172.21.15.79:0/4036682123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d56f717150 0x55d56f722ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:51.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.130+0000 7ff7215b7640 1 -- 172.21.15.79:0/4036682123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d56f7230e0 msgr2=0x55d56f7254d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:51.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.130+0000 7ff7215b7640 1 --2- 172.21.15.79:0/4036682123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d56f7230e0 0x55d56f7254d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:51.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.130+0000 7ff7215b7640 1 -- 172.21.15.79:0/4036682123 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d56f3dc650 con 0x55d56f716830 2024-08-20T01:52:51.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.130+0000 7ff719ffb640 1 --2- 172.21.15.79:0/1027159453 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff70c0b3d70 0x7ff70c0b6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:51.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.130+0000 7ff720db6640 1 --2- 172.21.15.79:0/1027159453 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff70c0b3d70 0x7ff70c0b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:51.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.130+0000 7ff7215b7640 1 --2- 172.21.15.79:0/4036682123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56f716830 0x55d56f716c10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff714009f70 tx=0x7ff71400f7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f00706ccfa86a69a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:51.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.130+0000 7ff719ffb640 1 -- 172.21.15.79:0/1027159453 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff7080e4020 con 0x7ff71c1042c0 2024-08-20T01:52:51.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.130+0000 7ff706ffd640 1 -- 172.21.15.79:0/4036682123 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff714011640 con 0x55d56f716830 2024-08-20T01:52:51.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.130+0000 7ff706ffd640 1 -- 172.21.15.79:0/4036682123 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff714017070 con 0x55d56f716830 2024-08-20T01:52:51.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.130+0000 7ff706ffd640 1 -- 172.21.15.79:0/4036682123 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff714010b80 con 0x55d56f716830 2024-08-20T01:52:51.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.131+0000 7ff725413740 1 -- 172.21.15.79:0/4036682123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56f716830 msgr2=0x55d56f716c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:51.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.131+0000 7ff720db6640 1 --2- 172.21.15.79:0/1027159453 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff70c0b3d70 0x7ff70c0b6230 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff7100096c0 tx=0x7ff7100058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:51.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.131+0000 7ff725413740 1 --2- 172.21.15.79:0/4036682123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56f716830 0x55d56f716c10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff714009f70 tx=0x7ff71400f7f0 comp rx=0 tx=0).stop 2024-08-20T01:52:51.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.131+0000 7ff725413740 1 -- 172.21.15.79:0/4036682123 shutdown_connections 2024-08-20T01:52:51.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.131+0000 7ff725413740 1 --2- 172.21.15.79:0/4036682123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d56f7230e0 0x55d56f7254d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:51.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.131+0000 7ff725413740 1 --2- 172.21.15.79:0/4036682123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d56f717150 0x55d56f722ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:51.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.131+0000 7ff725413740 1 --2- 172.21.15.79:0/4036682123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56f716830 0x55d56f716c10 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:51.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.131+0000 7ff725413740 1 -- 172.21.15.79:0/4036682123 >> 172.21.15.79:0/4036682123 conn(0x55d56f714660 msgr2=0x55d56f715800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:51.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.131+0000 7ff725413740 1 -- 172.21.15.79:0/4036682123 shutdown_connections 2024-08-20T01:52:51.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.131+0000 7ff725413740 1 -- 172.21.15.79:0/4036682123 wait complete. 2024-08-20T01:52:51.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.131+0000 7ff725413740 1 -- start start 2024-08-20T01:52:51.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.132+0000 7ff725413740 1 Processor -- start 2024-08-20T01:52:51.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.132+0000 7ff725413740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56f716830 0x55d56f720110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:51.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.132+0000 7ff725413740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d56f717150 0x55d56f720650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:51.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.132+0000 7ff725413740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d56f7230e0 0x55d56f720b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:51.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.132+0000 7ff725413740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d56f4df700 con 0x55d56f717150 2024-08-20T01:52:51.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.132+0000 7ff725413740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d56f6037c0 con 0x55d56f7230e0 2024-08-20T01:52:51.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.132+0000 7ff725413740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d56f725d90 con 0x55d56f716830 2024-08-20T01:52:51.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.132+0000 7ff725413740 10 client.0 _ll_register_callbacks cb 0x55d56f6766b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:52:51.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.132+0000 7ff71bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d56f717150 0x55d56f720650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:51.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.132+0000 7ff720db6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56f716830 0x55d56f720110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:51.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.132+0000 7ff71bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d56f717150 0x55d56f720650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43020/0 (socket says 172.21.15.79:43020) 2024-08-20T01:52:51.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.132+0000 7ff71bfff640 1 -- 172.21.15.79:0/1748622742 learned_addr learned my addr 172.21.15.79:0/1748622742 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:51.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.132+0000 7ff7215b7640 1 --2- 172.21.15.79:0/1748622742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d56f7230e0 0x55d56f720b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:51.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.132+0000 7ff71bfff640 1 -- 172.21.15.79:0/1748622742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56f716830 msgr2=0x55d56f720110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:51.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.132+0000 7ff71bfff640 1 --2- 172.21.15.79:0/1748622742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56f716830 0x55d56f720110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:51.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.132+0000 7ff71bfff640 1 -- 172.21.15.79:0/1748622742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d56f7230e0 msgr2=0x55d56f720b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:51.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.132+0000 7ff71bfff640 1 --2- 172.21.15.79:0/1748622742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d56f7230e0 0x55d56f720b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:51.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.132+0000 7ff71bfff640 1 -- 172.21.15.79:0/1748622742 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d56f72f1f0 con 0x55d56f717150 2024-08-20T01:52:51.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.133+0000 7ff720db6640 1 --2- 172.21.15.79:0/1748622742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56f716830 0x55d56f720110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:52:51.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.133+0000 7ff71bfff640 1 --2- 172.21.15.79:0/1748622742 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d56f717150 0x55d56f720650 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7ff7080e1b30 tx=0x7ff7080a6e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80193795eebde0a7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:51.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.133+0000 7ff6fbfff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:52:51.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.133+0000 7ff6fbfff640 1 -- 172.21.15.79:0/1748622742 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7080aa6f0 con 0x55d56f717150 2024-08-20T01:52:51.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.133+0000 7ff6fbfff640 1 -- 172.21.15.79:0/1748622742 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff7080e7cb0 con 0x55d56f717150 2024-08-20T01:52:51.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.133+0000 7ff725413740 1 -- 172.21.15.79:0/1748622742 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d56f62c100 con 0x55d56f717150 2024-08-20T01:52:51.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.133+0000 7ff6fbfff640 1 -- 172.21.15.79:0/1748622742 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7ff7080042f0 con 0x55d56f717150 2024-08-20T01:52:51.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.133+0000 7ff725413740 10 client.19290 fetch_fsmap learned FSMap version 62 2024-08-20T01:52:51.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.133+0000 7ff725413740 1 -- 172.21.15.79:0/1748622742 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55d56f731c30 con 0x55d56f717150 2024-08-20T01:52:51.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.133+0000 7ff6fbfff640 1 -- 172.21.15.79:0/1748622742 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55d56f62c100 con 0x55d56f717150 2024-08-20T01:52:51.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.133+0000 7ff6fbfff640 1 -- 172.21.15.79:0/1748622742 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 62) ==== 8406+0+0 (secure 0 0 0) 0x7ff7080701c0 con 0x55d56f717150 2024-08-20T01:52:51.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.134+0000 7ff725413740 10 client.19290 fetch_fsmap finished waiting for FSMap version 62 2024-08-20T01:52:51.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.134+0000 7ff725413740 10 client.19290 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:52:51.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.134+0000 7ff725413740 20 client.19290 populate_metadata read hostname 'smithi079' 2024-08-20T01:52:51.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.134+0000 7ff725413740 1 --2- 172.21.15.79:0/1748622742 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d56f733040 0x55d56f735430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:51.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.134+0000 7ff725413740 4 client.19290 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:52:51.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.134+0000 7ff725413740 1 -- 172.21.15.79:0/1748622742 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d56f68f830 con 0x55d56f733040 2024-08-20T01:52:51.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.134+0000 7ff720db6640 1 --2- 172.21.15.79:0/1748622742 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d56f733040 0x55d56f735430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:51.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.134+0000 7ff720db6640 1 --2- 172.21.15.79:0/1748622742 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d56f733040 0x55d56f735430 crc :-1 s=READY pgs=318 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25ab17c7f0a0e1c0 server_cookie=6ca7803b1f0af9c0 in_seq=0 out_seq=0 2024-08-20T01:52:51.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.134+0000 7ff6fbfff640 10 client.19290 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:52:51.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.135+0000 7ff6fbfff640 1 -- 172.21.15.79:0/1748622742 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d56f68f830 con 0x55d56f733040 2024-08-20T01:52:51.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.135+0000 7ff6fbfff640 10 client.19290 handle_command_reply: tid=0 2024-08-20T01:52:51.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.135+0000 7ff725413740 1 client.19290 shutdown 2024-08-20T01:52:51.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.135+0000 7ff725413740 1 -- 172.21.15.79:0/1748622742 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d56f717150 msgr2=0x55d56f720650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:51.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.135+0000 7ff725413740 1 --2- 172.21.15.79:0/1748622742 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d56f717150 0x55d56f720650 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7ff7080e1b30 tx=0x7ff7080a6e40 comp rx=0 tx=0).stop 2024-08-20T01:52:51.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.135+0000 7ff725413740 1 -- 172.21.15.79:0/1748622742 shutdown_connections 2024-08-20T01:52:51.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.135+0000 7ff725413740 1 --2- 172.21.15.79:0/1748622742 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d56f733040 0x55d56f735430 crc :-1 s=READY pgs=318 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:51.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.135+0000 7ff725413740 1 --2- 172.21.15.79:0/1748622742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d56f7230e0 0x55d56f720b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:51.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.135+0000 7ff725413740 1 --2- 172.21.15.79:0/1748622742 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d56f717150 0x55d56f720650 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:51.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.135+0000 7ff6fbfff640 0 client.19290 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:52:51.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.135+0000 7ff725413740 1 --2- 172.21.15.79:0/1748622742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56f716830 0x55d56f720110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:51.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.135+0000 7ff725413740 1 -- 172.21.15.79:0/1748622742 >> 172.21.15.79:0/1748622742 conn(0x55d56f714660 msgr2=0x55d56f71a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:51.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.135+0000 7ff725413740 1 -- 172.21.15.79:0/1748622742 shutdown_connections 2024-08-20T01:52:51.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.135+0000 7ff725413740 1 -- 172.21.15.79:0/1748622742 wait complete. 2024-08-20T01:52:51.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.135+0000 7ff725413740 20 client.19290 trim_cache size 0 max 16384 2024-08-20T01:52:51.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.152+0000 7ff725413740 1 Processor -- start 2024-08-20T01:52:51.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.152+0000 7ff725413740 1 -- start start 2024-08-20T01:52:51.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.152+0000 7ff725413740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56f716830 0x55d56f71a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:51.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.152+0000 7ff725413740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d56f717150 0x55d56f71f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:51.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.152+0000 7ff725413740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d56f7230e0 0x55d56f713610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:51.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.152+0000 7ff725413740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff71c1abdd0 con 0x55d56f7230e0 2024-08-20T01:52:51.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.152+0000 7ff725413740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff71c1adac0 con 0x55d56f717150 2024-08-20T01:52:51.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.152+0000 7ff725413740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff71c1ac4d0 con 0x55d56f716830 2024-08-20T01:52:51.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.152+0000 7ff7215b7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d56f7230e0 0x55d56f713610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:51.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.152+0000 7ff7215b7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d56f7230e0 0x55d56f713610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43030/0 (socket says 172.21.15.79:43030) 2024-08-20T01:52:51.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.152+0000 7ff7215b7640 1 -- 172.21.15.79:0/1788511423 learned_addr learned my addr 172.21.15.79:0/1788511423 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:51.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.153+0000 7ff720db6640 1 --2- 172.21.15.79:0/1788511423 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56f716830 0x55d56f71a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:51.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.153+0000 7ff71bfff640 1 --2- 172.21.15.79:0/1788511423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d56f717150 0x55d56f71f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:51.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.153+0000 7ff7215b7640 1 -- 172.21.15.79:0/1788511423 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56f716830 msgr2=0x55d56f71a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:51.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.153+0000 7ff7215b7640 1 --2- 172.21.15.79:0/1788511423 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56f716830 0x55d56f71a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:51.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.153+0000 7ff7215b7640 1 -- 172.21.15.79:0/1788511423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d56f717150 msgr2=0x55d56f71f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:51.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.153+0000 7ff7215b7640 1 --2- 172.21.15.79:0/1788511423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d56f717150 0x55d56f71f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:51.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.153+0000 7ff7215b7640 1 -- 172.21.15.79:0/1788511423 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d56f71f070 con 0x55d56f7230e0 2024-08-20T01:52:51.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.153+0000 7ff7215b7640 1 --2- 172.21.15.79:0/1788511423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d56f7230e0 0x55d56f713610 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7ff714009f70 tx=0x7ff7140092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aff3ad200e0a2cec server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:51.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.153+0000 7ff7067fc640 1 -- 172.21.15.79:0/1788511423 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff71402b070 con 0x55d56f7230e0 2024-08-20T01:52:51.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.153+0000 7ff7067fc640 1 -- 172.21.15.79:0/1788511423 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff714017040 con 0x55d56f7230e0 2024-08-20T01:52:51.157 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.153+0000 7ff7067fc640 1 -- 172.21.15.79:0/1788511423 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff714010da0 con 0x55d56f7230e0 2024-08-20T01:52:51.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.154+0000 7ff725413740 1 -- 172.21.15.79:0/1788511423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d56f7230e0 msgr2=0x55d56f713610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:51.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.154+0000 7ff725413740 1 --2- 172.21.15.79:0/1788511423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d56f7230e0 0x55d56f713610 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7ff714009f70 tx=0x7ff7140092e0 comp rx=0 tx=0).stop 2024-08-20T01:52:51.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.154+0000 7ff725413740 1 -- 172.21.15.79:0/1788511423 shutdown_connections 2024-08-20T01:52:51.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.154+0000 7ff725413740 1 --2- 172.21.15.79:0/1788511423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d56f7230e0 0x55d56f713610 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:51.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.154+0000 7ff725413740 1 --2- 172.21.15.79:0/1788511423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d56f717150 0x55d56f71f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:51.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.154+0000 7ff725413740 1 --2- 172.21.15.79:0/1788511423 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56f716830 0x55d56f71a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:51.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.154+0000 7ff725413740 1 -- 172.21.15.79:0/1788511423 >> 172.21.15.79:0/1788511423 conn(0x55d56f714660 msgr2=0x55d56f712f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:51.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.154+0000 7ff725413740 1 -- 172.21.15.79:0/1788511423 shutdown_connections 2024-08-20T01:52:51.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.154+0000 7ff725413740 1 -- 172.21.15.79:0/1788511423 wait complete. 2024-08-20T01:52:51.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.154+0000 7ff725413740 1 -- start start 2024-08-20T01:52:51.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.154+0000 7ff725413740 1 Processor -- start 2024-08-20T01:52:51.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.154+0000 7ff725413740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56f716830 0x55d56f72b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:51.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.154+0000 7ff725413740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d56f717150 0x55d56f726980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:51.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.155+0000 7ff725413740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d56f7230e0 0x55d56f726ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:51.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.155+0000 7ff725413740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff71c1ad330 con 0x55d56f7230e0 2024-08-20T01:52:51.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.155+0000 7ff725413740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff71c1acc30 con 0x55d56f717150 2024-08-20T01:52:51.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.155+0000 7ff725413740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff71c1a9db0 con 0x55d56f716830 2024-08-20T01:52:51.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.155+0000 7ff725413740 10 client.0 _ll_register_callbacks cb 0x7ff7080e77f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:52:51.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.155+0000 7ff71bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d56f717150 0x55d56f726980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:51.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.155+0000 7ff7215b7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d56f7230e0 0x55d56f726ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:51.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.155+0000 7ff71bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d56f717150 0x55d56f726980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:57006/0 (socket says 172.21.15.79:57006) 2024-08-20T01:52:51.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.155+0000 7ff71bfff640 1 -- 172.21.15.79:0/1254442352 learned_addr learned my addr 172.21.15.79:0/1254442352 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:51.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.155+0000 7ff720db6640 1 --2- 172.21.15.79:0/1254442352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56f716830 0x55d56f72b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:51.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.155+0000 7ff7215b7640 1 -- 172.21.15.79:0/1254442352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56f716830 msgr2=0x55d56f72b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:51.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.155+0000 7ff7215b7640 1 --2- 172.21.15.79:0/1254442352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56f716830 0x55d56f72b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:51.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.155+0000 7ff7215b7640 1 -- 172.21.15.79:0/1254442352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d56f717150 msgr2=0x55d56f726980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:51.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.155+0000 7ff7215b7640 1 --2- 172.21.15.79:0/1254442352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d56f717150 0x55d56f726980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:51.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.155+0000 7ff7215b7640 1 -- 172.21.15.79:0/1254442352 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d56f716f80 con 0x55d56f7230e0 2024-08-20T01:52:51.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.155+0000 7ff71bfff640 1 --2- 172.21.15.79:0/1254442352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d56f717150 0x55d56f726980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:52:51.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.155+0000 7ff7215b7640 1 --2- 172.21.15.79:0/1254442352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d56f7230e0 0x55d56f726ec0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7ff714029040 tx=0x7ff714004ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d2ea6254e83a41d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:51.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.155+0000 7ff6fbfff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:52:51.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.155+0000 7ff6fbfff640 1 -- 172.21.15.79:0/1254442352 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff71402b040 con 0x55d56f7230e0 2024-08-20T01:52:51.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.155+0000 7ff6fbfff640 1 -- 172.21.15.79:0/1254442352 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7ff7140105d0 con 0x55d56f7230e0 2024-08-20T01:52:51.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.155+0000 7ff725413740 1 -- 172.21.15.79:0/1254442352 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff714017040 con 0x55d56f7230e0 2024-08-20T01:52:51.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.156+0000 7ff6fbfff640 1 -- 172.21.15.79:0/1254442352 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7ff714010810 con 0x55d56f7230e0 2024-08-20T01:52:51.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.156+0000 7ff725413740 10 client.19296 fetch_fsmap learned FSMap version 62 2024-08-20T01:52:51.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.156+0000 7ff725413740 1 -- 172.21.15.79:0/1254442352 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55d56f7357a0 con 0x55d56f7230e0 2024-08-20T01:52:51.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.156+0000 7ff6fbfff640 1 -- 172.21.15.79:0/1254442352 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff714017040 con 0x55d56f7230e0 2024-08-20T01:52:51.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.156+0000 7ff6fbfff640 1 -- 172.21.15.79:0/1254442352 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 62) ==== 8406+0+0 (secure 0 0 0) 0x7ff71402e070 con 0x55d56f7230e0 2024-08-20T01:52:51.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.156+0000 7ff725413740 10 client.19296 fetch_fsmap finished waiting for FSMap version 62 2024-08-20T01:52:51.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.156+0000 7ff725413740 10 client.19296 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:52:51.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.156+0000 7ff725413740 20 client.19296 populate_metadata read hostname 'smithi079' 2024-08-20T01:52:51.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.156+0000 7ff725413740 1 --2- 172.21.15.79:0/1254442352 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d56f79dd30 0x55d56f7a0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:51.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.156+0000 7ff725413740 4 client.19296 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:52:51.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.156+0000 7ff725413740 1 -- 172.21.15.79:0/1254442352 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d56f68b2d0 con 0x55d56f79dd30 2024-08-20T01:52:51.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.156+0000 7ff720db6640 1 --2- 172.21.15.79:0/1254442352 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d56f79dd30 0x55d56f7a0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:51.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.157+0000 7ff6fbfff640 10 client.19296 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:52:51.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.157+0000 7ff720db6640 1 --2- 172.21.15.79:0/1254442352 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d56f79dd30 0x55d56f7a0150 crc :-1 s=READY pgs=319 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89f7056e493134db server_cookie=7235107faac9c0bf in_seq=0 out_seq=0 2024-08-20T01:52:51.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.157+0000 7ff6fbfff640 1 -- 172.21.15.79:0/1254442352 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55d56f68b2d0 con 0x55d56f79dd30 2024-08-20T01:52:51.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.157+0000 7ff6fbfff640 10 client.19296 handle_command_reply: tid=0 2024-08-20T01:52:51.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.157+0000 7ff725413740 1 client.19296 shutdown 2024-08-20T01:52:51.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.157+0000 7ff725413740 1 -- 172.21.15.79:0/1254442352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d56f7230e0 msgr2=0x55d56f726ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:51.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.157+0000 7ff725413740 1 --2- 172.21.15.79:0/1254442352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d56f7230e0 0x55d56f726ec0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7ff714029040 tx=0x7ff714004ce0 comp rx=0 tx=0).stop 2024-08-20T01:52:51.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.157+0000 7ff725413740 1 -- 172.21.15.79:0/1254442352 shutdown_connections 2024-08-20T01:52:51.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.157+0000 7ff725413740 1 --2- 172.21.15.79:0/1254442352 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55d56f79dd30 0x55d56f7a0150 crc :-1 s=READY pgs=319 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:51.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.157+0000 7ff725413740 1 --2- 172.21.15.79:0/1254442352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d56f7230e0 0x55d56f726ec0 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:51.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.157+0000 7ff725413740 1 --2- 172.21.15.79:0/1254442352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d56f717150 0x55d56f726980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:51.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.157+0000 7ff6fbfff640 0 client.19296 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:52:51.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.157+0000 7ff725413740 1 --2- 172.21.15.79:0/1254442352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56f716830 0x55d56f72b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:51.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.157+0000 7ff725413740 1 -- 172.21.15.79:0/1254442352 >> 172.21.15.79:0/1254442352 conn(0x55d56f714660 msgr2=0x55d56f721f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:51.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.157+0000 7ff725413740 1 -- 172.21.15.79:0/1254442352 shutdown_connections 2024-08-20T01:52:51.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.157+0000 7ff725413740 1 -- 172.21.15.79:0/1254442352 wait complete. 2024-08-20T01:52:51.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.157+0000 7ff725413740 20 client.19296 trim_cache size 0 max 16384 2024-08-20T01:52:51.167 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:52:51.167 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-08-20T01:52:51.167 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-08-20T01:52:51.167 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:52:51.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.158+0000 7ff72301a640 1 -- 172.21.15.79:0/1027159453 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff70c0b3d70 msgr2=0x7ff70c0b6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:51.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.158+0000 7ff72301a640 1 --2- 172.21.15.79:0/1027159453 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff70c0b3d70 0x7ff70c0b6230 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff7100096c0 tx=0x7ff7100058d0 comp rx=0 tx=0).stop 2024-08-20T01:52:51.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.158+0000 7ff72301a640 1 -- 172.21.15.79:0/1027159453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff71c1042c0 msgr2=0x7ff71c1993f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:51.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.158+0000 7ff72301a640 1 --2- 172.21.15.79:0/1027159453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff71c1042c0 0x7ff71c1993f0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7ff70800e9c0 tx=0x7ff70800ee80 comp rx=0 tx=0).stop 2024-08-20T01:52:51.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.158+0000 7ff72301a640 1 -- 172.21.15.79:0/1027159453 shutdown_connections 2024-08-20T01:52:51.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.158+0000 7ff72301a640 1 --2- 172.21.15.79:0/1027159453 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7ff70c0b3d70 0x7ff70c0b6230 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:51.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.158+0000 7ff72301a640 1 --2- 172.21.15.79:0/1027159453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff71c10ce00 0x7ff71c19e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:51.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.158+0000 7ff72301a640 1 --2- 172.21.15.79:0/1027159453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff71c1042c0 0x7ff71c1993f0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:51.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.158+0000 7ff72301a640 1 --2- 172.21.15.79:0/1027159453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff71c1039a0 0x7ff71c198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:51.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.158+0000 7ff72301a640 1 -- 172.21.15.79:0/1027159453 >> 172.21.15.79:0/1027159453 conn(0x7ff71c0fd400 msgr2=0x7ff71c0fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:51.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.158+0000 7ff72301a640 1 -- 172.21.15.79:0/1027159453 shutdown_connections 2024-08-20T01:52:51.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:51.158+0000 7ff72301a640 1 -- 172.21.15.79:0/1027159453 wait complete. 2024-08-20T01:52:52.035 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T01:52:52.035 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:52:52.286 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:52:52.662 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:52 smithi079 ceph-mon[18656]: pgmap v813: 97 pgs: 97 active+clean; 7.9 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 30 op/s 2024-08-20T01:52:52.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.742+0000 7f3ec7c7a640 1 -- 172.21.15.79:0/3705888295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ec0101990 msgr2=0x7f3ec0101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:52.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.742+0000 7f3ec7c7a640 1 --2- 172.21.15.79:0/3705888295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ec0101990 0x7f3ec0101d70 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc009900 tx=0x7f3ebc02a410 comp rx=0 tx=0).stop 2024-08-20T01:52:52.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.742+0000 7f3ec7c7a640 1 -- 172.21.15.79:0/3705888295 shutdown_connections 2024-08-20T01:52:52.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.742+0000 7f3ec7c7a640 1 --2- 172.21.15.79:0/3705888295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ec0107d20 0x7f3ec010e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:52.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.742+0000 7f3ec7c7a640 1 --2- 172.21.15.79:0/3705888295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ec01073a0 0x7f3ec01077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:52.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.742+0000 7f3ec7c7a640 1 --2- 172.21.15.79:0/3705888295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ec0101990 0x7f3ec0101d70 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:52.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.742+0000 7f3ec7c7a640 1 -- 172.21.15.79:0/3705888295 >> 172.21.15.79:0/3705888295 conn(0x7f3ec00fd400 msgr2=0x7f3ec00ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:52.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.742+0000 7f3ec7c7a640 1 -- 172.21.15.79:0/3705888295 shutdown_connections 2024-08-20T01:52:52.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.742+0000 7f3ec7c7a640 1 -- 172.21.15.79:0/3705888295 wait complete. 2024-08-20T01:52:52.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.743+0000 7f3ec7c7a640 1 Processor -- start 2024-08-20T01:52:52.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.743+0000 7f3ec7c7a640 1 -- start start 2024-08-20T01:52:52.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.743+0000 7f3ec7c7a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ec0101990 0x7f3ec0199d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:52.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.743+0000 7f3ec7c7a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ec01073a0 0x7f3ec019a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:52.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.743+0000 7f3ec7c7a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ec0107d20 0x7f3ec019a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:52.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.743+0000 7f3ec7c7a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec0111890 con 0x7f3ec0101990 2024-08-20T01:52:52.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.743+0000 7f3ec7c7a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec0111710 con 0x7f3ec01073a0 2024-08-20T01:52:52.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.743+0000 7f3ec7c7a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec0111a10 con 0x7f3ec0107d20 2024-08-20T01:52:52.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.743+0000 7f3ec5a16640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ec0101990 0x7f3ec0199d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:52.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.743+0000 7f3ec5a16640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ec0101990 0x7f3ec0199d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43044/0 (socket says 172.21.15.79:43044) 2024-08-20T01:52:52.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.743+0000 7f3ec5a16640 1 -- 172.21.15.79:0/4070472327 learned_addr learned my addr 172.21.15.79:0/4070472327 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:52.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.743+0000 7f3ec5215640 1 --2- 172.21.15.79:0/4070472327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ec01073a0 0x7f3ec019a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:52.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.743+0000 7f3ec6217640 1 --2- 172.21.15.79:0/4070472327 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ec0107d20 0x7f3ec019a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:52.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.743+0000 7f3ec5a16640 1 -- 172.21.15.79:0/4070472327 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ec0107d20 msgr2=0x7f3ec019a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:52.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.743+0000 7f3ec5a16640 1 --2- 172.21.15.79:0/4070472327 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ec0107d20 0x7f3ec019a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:52.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.744+0000 7f3ec5a16640 1 -- 172.21.15.79:0/4070472327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ec01073a0 msgr2=0x7f3ec019a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:52.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.744+0000 7f3ec5a16640 1 --2- 172.21.15.79:0/4070472327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ec01073a0 0x7f3ec019a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:52.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.744+0000 7f3ec5a16640 1 -- 172.21.15.79:0/4070472327 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ec01a5100 con 0x7f3ec0101990 2024-08-20T01:52:52.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.744+0000 7f3ec6217640 1 --2- 172.21.15.79:0/4070472327 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ec0107d20 0x7f3ec019a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:52:52.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.744+0000 7f3ec5a16640 1 --2- 172.21.15.79:0/4070472327 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ec0101990 0x7f3ec0199d20 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc009230 tx=0x7f3ebc0319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:52.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.744+0000 7f3eb6ffd640 1 -- 172.21.15.79:0/4070472327 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc03f030 con 0x7f3ec0101990 2024-08-20T01:52:52.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.744+0000 7f3eb6ffd640 1 -- 172.21.15.79:0/4070472327 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3ebc0043d0 con 0x7f3ec0101990 2024-08-20T01:52:52.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.744+0000 7f3ec7c7a640 1 -- 172.21.15.79:0/4070472327 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ec01a5390 con 0x7f3ec0101990 2024-08-20T01:52:52.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.744+0000 7f3eb6ffd640 1 -- 172.21.15.79:0/4070472327 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc035070 con 0x7f3ec0101990 2024-08-20T01:52:52.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.744+0000 7f3ec7c7a640 1 -- 172.21.15.79:0/4070472327 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ec01a58c0 con 0x7f3ec0101990 2024-08-20T01:52:52.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.745+0000 7f3ec7c7a640 1 -- 172.21.15.79:0/4070472327 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ec0101d70 con 0x7f3ec0101990 2024-08-20T01:52:52.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.746+0000 7f3eb6ffd640 1 -- 172.21.15.79:0/4070472327 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3ebc042030 con 0x7f3ec0101990 2024-08-20T01:52:52.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.747+0000 7f3eb6ffd640 1 --2- 172.21.15.79:0/4070472327 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3eac0b3c50 0x7f3eac0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:52.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.747+0000 7f3ec5215640 1 --2- 172.21.15.79:0/4070472327 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3eac0b3c50 0x7f3eac0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:52.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.747+0000 7f3eb6ffd640 1 -- 172.21.15.79:0/4070472327 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f3ebc1043b0 con 0x7f3ec0101990 2024-08-20T01:52:52.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.748+0000 7f3ec5215640 1 --2- 172.21.15.79:0/4070472327 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3eac0b3c50 0x7f3eac0b6110 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f3ec006b3b0 tx=0x7f3eb0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:52.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.750+0000 7f3eb6ffd640 1 -- 172.21.15.79:0/4070472327 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f3ebc0cba10 con 0x7f3ec0101990 2024-08-20T01:52:52.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:52 smithi175 ceph-mon[22392]: pgmap v813: 97 pgs: 97 active+clean; 7.9 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 30 op/s 2024-08-20T01:52:52.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.973+0000 7f3ec7c7a640 1 -- 172.21.15.79:0/4070472327 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3ec002e340 con 0x7f3ec0101990 2024-08-20T01:52:52.977 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.974+0000 7f3eb6ffd640 1 -- 172.21.15.79:0/4070472327 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+11990 (secure 0 0 0) 0x7f3ebc0cb310 con 0x7f3ec0101990 2024-08-20T01:52:52.977 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:52:52.977 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":62,"btime":"2024-08-20T01:52:09:013106+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14670,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/735082912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":735082912},{"type":"v1","addr":"172.21.15.79:6835","nonce":735082912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2150339873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2150339873},{"type":"v1","addr":"172.21.15.79:6837","nonce":2150339873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":62,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:34:55.133562+0000","modified":"2024-08-20T01:52:08.574444+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24539,"mds_1":24538,"mds_2":24523,"mds_3":24514,"mds_4":24512},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14724":{"gid":14724,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/1071242274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1071242274},{"type":"v1","addr":"172.21.15.79:6839","nonce":1071242274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14730":{"gid":14730,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6841/2448977611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":2448977611},{"type":"v1","addr":"172.21.15.79:6841","nonce":2448977611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/1257507005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1257507005},{"type":"v1","addr":"172.21.15.81:6833","nonce":1257507005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1499936216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1499936216},{"type":"v1","addr":"172.21.15.81:6835","nonce":1499936216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/1107229215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1107229215},{"type":"v1","addr":"172.21.15.175:6833","nonce":1107229215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6837/2073598870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2073598870},{"type":"v1","addr":"172.21.15.81:6837","nonce":2073598870}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/2552601173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2552601173},{"type":"v1","addr":"172.21.15.175:6835","nonce":2552601173}]},"join_fscid":-1,"export_targets":[1,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6837/1767284089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1767284089},{"type":"v1","addr":"172.21.15.175:6837","nonce":1767284089}]},"join_fscid":-1,"export_targets":[0,1,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/1331748742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1331748742},{"type":"v1","addr":"172.21.15.175:6839","nonce":1331748742}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/4098410583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":4098410583},{"type":"v1","addr":"172.21.15.81:6839","nonce":4098410583}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24539,"qdb_cluster":[24512,24538,24514,24523,24539]},"id":1}]} 2024-08-20T01:52:52.977 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 62 2024-08-20T01:52:52.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.976+0000 7f3ec7c7a640 1 -- 172.21.15.79:0/4070472327 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3eac0b3c50 msgr2=0x7f3eac0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:52.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.976+0000 7f3ec7c7a640 1 --2- 172.21.15.79:0/4070472327 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3eac0b3c50 0x7f3eac0b6110 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f3ec006b3b0 tx=0x7f3eb0005f90 comp rx=0 tx=0).stop 2024-08-20T01:52:52.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.976+0000 7f3ec7c7a640 1 -- 172.21.15.79:0/4070472327 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ec0101990 msgr2=0x7f3ec0199d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:52.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.976+0000 7f3ec7c7a640 1 --2- 172.21.15.79:0/4070472327 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ec0101990 0x7f3ec0199d20 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc009230 tx=0x7f3ebc0319a0 comp rx=0 tx=0).stop 2024-08-20T01:52:52.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.976+0000 7f3ec7c7a640 1 -- 172.21.15.79:0/4070472327 shutdown_connections 2024-08-20T01:52:52.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.976+0000 7f3ec7c7a640 1 --2- 172.21.15.79:0/4070472327 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3eac0b3c50 0x7f3eac0b6110 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:52.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.976+0000 7f3ec7c7a640 1 --2- 172.21.15.79:0/4070472327 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ec0107d20 0x7f3ec019a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:52.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.976+0000 7f3ec7c7a640 1 --2- 172.21.15.79:0/4070472327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ec01073a0 0x7f3ec019a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:52.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.976+0000 7f3ec7c7a640 1 --2- 172.21.15.79:0/4070472327 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ec0101990 0x7f3ec0199d20 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:52.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.976+0000 7f3ec7c7a640 1 -- 172.21.15.79:0/4070472327 >> 172.21.15.79:0/4070472327 conn(0x7f3ec00fd400 msgr2=0x7f3ec00ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:52.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.976+0000 7f3ec7c7a640 1 -- 172.21.15.79:0/4070472327 shutdown_connections 2024-08-20T01:52:52.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:52.976+0000 7f3ec7c7a640 1 -- 172.21.15.79:0/4070472327 wait complete. 2024-08-20T01:52:53.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:52 smithi081 ceph-mon[22209]: pgmap v813: 97 pgs: 97 active+clean; 7.9 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 30 op/s 2024-08-20T01:52:53.676 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:53 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/4070472327' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:52:53.705 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-20T01:52:53.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:53 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/4070472327' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:52:53.958 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:52:54.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:53 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/4070472327' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:52:54.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.461+0000 7fd165392640 1 -- 172.21.15.79:0/2981027829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1601137f0 msgr2=0x7fd160115be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:54.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.461+0000 7fd165392640 1 --2- 172.21.15.79:0/2981027829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1601137f0 0x7fd160115be0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fd158009ca0 tx=0x7fd15802a8c0 comp rx=0 tx=0).stop 2024-08-20T01:52:54.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.461+0000 7fd165392640 1 -- 172.21.15.79:0/2981027829 shutdown_connections 2024-08-20T01:52:54.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.461+0000 7fd165392640 1 --2- 172.21.15.79:0/2981027829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1601137f0 0x7fd160115be0 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:54.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.461+0000 7fd165392640 1 --2- 172.21.15.79:0/2981027829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd160075b90 0x7fd1601132b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:54.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.461+0000 7fd165392640 1 --2- 172.21.15.79:0/2981027829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd160075270 0x7fd160075650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:54.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.461+0000 7fd165392640 1 -- 172.21.15.79:0/2981027829 >> 172.21.15.79:0/2981027829 conn(0x7fd1600fe540 msgr2=0x7fd160100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:54.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.461+0000 7fd165392640 1 -- 172.21.15.79:0/2981027829 shutdown_connections 2024-08-20T01:52:54.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.461+0000 7fd165392640 1 -- 172.21.15.79:0/2981027829 wait complete. 2024-08-20T01:52:54.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.462+0000 7fd165392640 1 Processor -- start 2024-08-20T01:52:54.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.462+0000 7fd165392640 1 -- start start 2024-08-20T01:52:54.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.462+0000 7fd165392640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd160075270 0x7fd16019f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:54.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.462+0000 7fd165392640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd160075b90 0x7fd16019fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:54.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.462+0000 7fd165392640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1601137f0 0x7fd1601a4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:54.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.462+0000 7fd165392640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd160118f60 con 0x7fd160075b90 2024-08-20T01:52:54.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.462+0000 7fd165392640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd160118de0 con 0x7fd1601137f0 2024-08-20T01:52:54.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.462+0000 7fd165392640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd1601190e0 con 0x7fd160075270 2024-08-20T01:52:54.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.462+0000 7fd157fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd160075b90 0x7fd16019fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:54.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.462+0000 7fd157fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd160075b90 0x7fd16019fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43062/0 (socket says 172.21.15.79:43062) 2024-08-20T01:52:54.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.462+0000 7fd157fff640 1 -- 172.21.15.79:0/3586884993 learned_addr learned my addr 172.21.15.79:0/3586884993 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:54.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.462+0000 7fd15f7fe640 1 --2- 172.21.15.79:0/3586884993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1601137f0 0x7fd1601a4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:54.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.462+0000 7fd15effd640 1 --2- 172.21.15.79:0/3586884993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd160075270 0x7fd16019f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:54.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.462+0000 7fd157fff640 1 -- 172.21.15.79:0/3586884993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd160075270 msgr2=0x7fd16019f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:54.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.462+0000 7fd157fff640 1 --2- 172.21.15.79:0/3586884993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd160075270 0x7fd16019f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:54.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.462+0000 7fd157fff640 1 -- 172.21.15.79:0/3586884993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1601137f0 msgr2=0x7fd1601a4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:54.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.462+0000 7fd157fff640 1 --2- 172.21.15.79:0/3586884993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1601137f0 0x7fd1601a4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:54.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.462+0000 7fd157fff640 1 -- 172.21.15.79:0/3586884993 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1601a5580 con 0x7fd160075b90 2024-08-20T01:52:54.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.463+0000 7fd157fff640 1 --2- 172.21.15.79:0/3586884993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd160075b90 0x7fd16019fa10 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7fd14800d950 tx=0x7fd14800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:54.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.463+0000 7fd15cff9640 1 -- 172.21.15.79:0/3586884993 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd148017030 con 0x7fd160075b90 2024-08-20T01:52:54.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.463+0000 7fd15cff9640 1 -- 172.21.15.79:0/3586884993 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd148004020 con 0x7fd160075b90 2024-08-20T01:52:54.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.463+0000 7fd165392640 1 -- 172.21.15.79:0/3586884993 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1601a5870 con 0x7fd160075b90 2024-08-20T01:52:54.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.463+0000 7fd15cff9640 1 -- 172.21.15.79:0/3586884993 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1480055d0 con 0x7fd160075b90 2024-08-20T01:52:54.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.463+0000 7fd165392640 1 -- 172.21.15.79:0/3586884993 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1601abf30 con 0x7fd160075b90 2024-08-20T01:52:54.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.466+0000 7fd16778b740 1 Processor -- start 2024-08-20T01:52:54.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.466+0000 7fd16778b740 1 -- start start 2024-08-20T01:52:54.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.466+0000 7fd15cff9640 1 -- 172.21.15.79:0/3586884993 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fd148009a30 con 0x7fd160075b90 2024-08-20T01:52:54.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.466+0000 7fd16778b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4e662880 0x55be4e662c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:54.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.466+0000 7fd16778b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4e6631a0 0x55be4e66ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:54.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.466+0000 7fd16778b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4e66f130 0x55be4e671520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:54.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.466+0000 7fd16778b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55be4e5d9930 con 0x55be4e662880 2024-08-20T01:52:54.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.466+0000 7fd16778b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55be4e5c8e30 con 0x55be4e66f130 2024-08-20T01:52:54.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.466+0000 7fd16778b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55be4e5cce70 con 0x55be4e6631a0 2024-08-20T01:52:54.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.466+0000 7fd15f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4e662880 0x55be4e662c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:54.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.466+0000 7fd15f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4e662880 0x55be4e662c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43072/0 (socket says 172.21.15.79:43072) 2024-08-20T01:52:54.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.466+0000 7fd15f7fe640 1 -- 172.21.15.79:0/191758594 learned_addr learned my addr 172.21.15.79:0/191758594 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:54.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.467+0000 7fd15effd640 1 --2- 172.21.15.79:0/191758594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4e6631a0 0x55be4e66ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:54.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.467+0000 7fd157fff640 1 --2- 172.21.15.79:0/191758594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4e66f130 0x55be4e671520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:54.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.467+0000 7fd15f7fe640 1 -- 172.21.15.79:0/191758594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4e6631a0 msgr2=0x55be4e66ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:54.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.467+0000 7fd15f7fe640 1 --2- 172.21.15.79:0/191758594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4e6631a0 0x55be4e66ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:54.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.467+0000 7fd15f7fe640 1 -- 172.21.15.79:0/191758594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4e66f130 msgr2=0x55be4e671520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:54.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.467+0000 7fd15f7fe640 1 --2- 172.21.15.79:0/191758594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4e66f130 0x55be4e671520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:54.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.467+0000 7fd15f7fe640 1 -- 172.21.15.79:0/191758594 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be4e328650 con 0x55be4e662880 2024-08-20T01:52:54.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.467+0000 7fd15effd640 1 --2- 172.21.15.79:0/191758594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4e6631a0 0x55be4e66ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:52:54.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.467+0000 7fd15f7fe640 1 --2- 172.21.15.79:0/191758594 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4e662880 0x55be4e662c60 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fd158035000 tx=0x7fd1580093f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=536bc5314310b0fa server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:54.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.467+0000 7fd1557fa640 1 -- 172.21.15.79:0/191758594 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd158031980 con 0x55be4e662880 2024-08-20T01:52:54.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.467+0000 7fd1557fa640 1 -- 172.21.15.79:0/191758594 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd158036070 con 0x55be4e662880 2024-08-20T01:52:54.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.467+0000 7fd1557fa640 1 -- 172.21.15.79:0/191758594 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd158004400 con 0x55be4e662880 2024-08-20T01:52:54.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.468+0000 7fd15cff9640 1 --2- 172.21.15.79:0/3586884993 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd14c0b3c50 0x7fd14c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:54.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.468+0000 7fd15effd640 1 --2- 172.21.15.79:0/3586884993 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd14c0b3c50 0x7fd14c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:54.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.468+0000 7fd15cff9640 1 -- 172.21.15.79:0/3586884993 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fd1480e3500 con 0x7fd160075b90 2024-08-20T01:52:54.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.468+0000 7fd16778b740 1 -- 172.21.15.79:0/191758594 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4e662880 msgr2=0x55be4e662c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:54.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.468+0000 7fd16778b740 1 --2- 172.21.15.79:0/191758594 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4e662880 0x55be4e662c60 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fd158035000 tx=0x7fd1580093f0 comp rx=0 tx=0).stop 2024-08-20T01:52:54.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.468+0000 7fd15effd640 1 --2- 172.21.15.79:0/3586884993 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd14c0b3c50 0x7fd14c0b6110 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x55be4e665a00 tx=0x7fd150005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:54.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.468+0000 7fd16778b740 1 -- 172.21.15.79:0/191758594 shutdown_connections 2024-08-20T01:52:54.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.468+0000 7fd16778b740 1 --2- 172.21.15.79:0/191758594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4e66f130 0x55be4e671520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:54.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.468+0000 7fd16778b740 1 --2- 172.21.15.79:0/191758594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4e6631a0 0x55be4e66ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:54.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.468+0000 7fd16778b740 1 --2- 172.21.15.79:0/191758594 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4e662880 0x55be4e662c60 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:54.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.468+0000 7fd16778b740 1 -- 172.21.15.79:0/191758594 >> 172.21.15.79:0/191758594 conn(0x55be4e6606b0 msgr2=0x55be4e661850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:54.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.468+0000 7fd16778b740 1 -- 172.21.15.79:0/191758594 shutdown_connections 2024-08-20T01:52:54.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.468+0000 7fd16778b740 1 -- 172.21.15.79:0/191758594 wait complete. 2024-08-20T01:52:54.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.469+0000 7fd16778b740 1 -- start start 2024-08-20T01:52:54.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.469+0000 7fd16778b740 1 Processor -- start 2024-08-20T01:52:54.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.469+0000 7fd16778b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4e662880 0x55be4e66c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:54.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.469+0000 7fd16778b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4e6631a0 0x55be4e66c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:54.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.469+0000 7fd16778b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4e66f130 0x55be4e66cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:54.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.469+0000 7fd16778b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55be4e42b700 con 0x55be4e662880 2024-08-20T01:52:54.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.469+0000 7fd16778b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55be4e54f810 con 0x55be4e6631a0 2024-08-20T01:52:54.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.469+0000 7fd16778b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55be4e671c00 con 0x55be4e66f130 2024-08-20T01:52:54.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.469+0000 7fd16778b740 10 client.0 _ll_register_callbacks cb 0x55be4e5c2700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:52:54.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.469+0000 7fd15effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4e662880 0x55be4e66c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:54.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.469+0000 7fd15effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4e662880 0x55be4e66c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43084/0 (socket says 172.21.15.79:43084) 2024-08-20T01:52:54.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.469+0000 7fd15effd640 1 -- 172.21.15.79:0/960851287 learned_addr learned my addr 172.21.15.79:0/960851287 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:54.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.469+0000 7fd157fff640 1 --2- 172.21.15.79:0/960851287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4e6631a0 0x55be4e66c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:54.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.469+0000 7fd15f7fe640 1 --2- 172.21.15.79:0/960851287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4e66f130 0x55be4e66cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:54.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.469+0000 7fd15effd640 1 -- 172.21.15.79:0/960851287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4e66f130 msgr2=0x55be4e66cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:54.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.469+0000 7fd15effd640 1 --2- 172.21.15.79:0/960851287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4e66f130 0x55be4e66cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:54.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.469+0000 7fd15effd640 1 -- 172.21.15.79:0/960851287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4e6631a0 msgr2=0x55be4e66c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:54.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.469+0000 7fd15effd640 1 --2- 172.21.15.79:0/960851287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4e6631a0 0x55be4e66c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:54.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.469+0000 7fd15effd640 1 -- 172.21.15.79:0/960851287 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be4e67b040 con 0x55be4e662880 2024-08-20T01:52:54.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.469+0000 7fd157fff640 1 --2- 172.21.15.79:0/960851287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4e6631a0 0x55be4e66c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:52:54.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.470+0000 7fd15effd640 1 --2- 172.21.15.79:0/960851287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4e662880 0x55be4e66c100 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fd15001e9d0 tx=0x7fd150004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a410d44e89843fac server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:54.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.470+0000 7fd1467fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:52:54.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.470+0000 7fd1467fc640 1 -- 172.21.15.79:0/960851287 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd150009830 con 0x55be4e662880 2024-08-20T01:52:54.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.470+0000 7fd1467fc640 1 -- 172.21.15.79:0/960851287 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fd150018030 con 0x55be4e662880 2024-08-20T01:52:54.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.470+0000 7fd16778b740 1 -- 172.21.15.79:0/960851287 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55be4e578150 con 0x55be4e662880 2024-08-20T01:52:54.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.470+0000 7fd1467fc640 1 -- 172.21.15.79:0/960851287 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fd150004020 con 0x55be4e662880 2024-08-20T01:52:54.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.470+0000 7fd16778b740 10 client.19314 fetch_fsmap learned FSMap version 62 2024-08-20T01:52:54.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.470+0000 7fd16778b740 1 -- 172.21.15.79:0/960851287 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55be4e67da50 con 0x55be4e662880 2024-08-20T01:52:54.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.470+0000 7fd1467fc640 1 -- 172.21.15.79:0/960851287 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55be4e578150 con 0x55be4e662880 2024-08-20T01:52:54.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.470+0000 7fd1467fc640 1 -- 172.21.15.79:0/960851287 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 62) ==== 8406+0+0 (secure 0 0 0) 0x7fd150034450 con 0x55be4e662880 2024-08-20T01:52:54.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.470+0000 7fd16778b740 10 client.19314 fetch_fsmap finished waiting for FSMap version 62 2024-08-20T01:52:54.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.470+0000 7fd16778b740 10 client.19314 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:52:54.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.470+0000 7fd16778b740 20 client.19314 populate_metadata read hostname 'smithi079' 2024-08-20T01:52:54.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.470+0000 7fd16778b740 1 --2- 172.21.15.79:0/960851287 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55be4e67eeb0 0x55be4e681340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:54.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.470+0000 7fd16778b740 4 client.19314 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:52:54.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.470+0000 7fd16778b740 1 -- 172.21.15.79:0/960851287 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55be4e5db880 con 0x55be4e67eeb0 2024-08-20T01:52:54.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.471+0000 7fd157fff640 1 --2- 172.21.15.79:0/960851287 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55be4e67eeb0 0x55be4e681340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:54.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.471+0000 7fd1467fc640 10 client.19314 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:52:54.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.471+0000 7fd157fff640 1 --2- 172.21.15.79:0/960851287 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55be4e67eeb0 0x55be4e681340 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2f364bbfee75d93a server_cookie=bc29ec52580f558c in_seq=0 out_seq=0 2024-08-20T01:52:54.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.471+0000 7fd1467fc640 1 -- 172.21.15.79:0/960851287 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55be4e5db880 con 0x55be4e67eeb0 2024-08-20T01:52:54.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.471+0000 7fd1467fc640 10 client.19314 handle_command_reply: tid=0 2024-08-20T01:52:54.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.472+0000 7fd16778b740 1 client.19314 shutdown 2024-08-20T01:52:54.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.472+0000 7fd16778b740 1 -- 172.21.15.79:0/960851287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4e662880 msgr2=0x55be4e66c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:54.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.472+0000 7fd16778b740 1 --2- 172.21.15.79:0/960851287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4e662880 0x55be4e66c100 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fd15001e9d0 tx=0x7fd150004730 comp rx=0 tx=0).stop 2024-08-20T01:52:54.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.472+0000 7fd16778b740 1 -- 172.21.15.79:0/960851287 shutdown_connections 2024-08-20T01:52:54.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.472+0000 7fd16778b740 1 --2- 172.21.15.79:0/960851287 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55be4e67eeb0 0x55be4e681340 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:54.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.472+0000 7fd16778b740 1 --2- 172.21.15.79:0/960851287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4e66f130 0x55be4e66cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:54.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.472+0000 7fd16778b740 1 --2- 172.21.15.79:0/960851287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4e6631a0 0x55be4e66c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:54.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.472+0000 7fd1467fc640 0 client.19314 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:52:54.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.472+0000 7fd16778b740 1 --2- 172.21.15.79:0/960851287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4e662880 0x55be4e66c100 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:54.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.472+0000 7fd16778b740 1 -- 172.21.15.79:0/960851287 >> 172.21.15.79:0/960851287 conn(0x55be4e6606b0 msgr2=0x55be4e666250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:54.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.472+0000 7fd16778b740 1 -- 172.21.15.79:0/960851287 shutdown_connections 2024-08-20T01:52:54.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.472+0000 7fd16778b740 1 -- 172.21.15.79:0/960851287 wait complete. 2024-08-20T01:52:54.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.472+0000 7fd16778b740 20 client.19314 trim_cache size 0 max 16384 2024-08-20T01:52:54.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.485+0000 7fd16778b740 1 Processor -- start 2024-08-20T01:52:54.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.485+0000 7fd16778b740 1 -- start start 2024-08-20T01:52:54.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.486+0000 7fd16778b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4e662880 0x55be4e66b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:54.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.486+0000 7fd16778b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4e6631a0 0x55be4e686c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:54.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.486+0000 7fd16778b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4e66f130 0x55be4e687150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:54.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.486+0000 7fd16778b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd1601b4580 con 0x55be4e66f130 2024-08-20T01:52:54.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.486+0000 7fd16778b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd1601b6270 con 0x55be4e662880 2024-08-20T01:52:54.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.486+0000 7fd16778b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd1601b4c80 con 0x55be4e6631a0 2024-08-20T01:52:54.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.486+0000 7fd15f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4e66f130 0x55be4e687150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:54.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.486+0000 7fd15f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4e66f130 0x55be4e687150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43088/0 (socket says 172.21.15.79:43088) 2024-08-20T01:52:54.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.486+0000 7fd15f7fe640 1 -- 172.21.15.79:0/3209842620 learned_addr learned my addr 172.21.15.79:0/3209842620 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:54.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.486+0000 7fd15effd640 1 --2- 172.21.15.79:0/3209842620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4e662880 0x55be4e66b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:54.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.486+0000 7fd157fff640 1 --2- 172.21.15.79:0/3209842620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4e6631a0 0x55be4e686c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:54.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.486+0000 7fd15f7fe640 1 -- 172.21.15.79:0/3209842620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4e6631a0 msgr2=0x55be4e686c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:54.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.486+0000 7fd15f7fe640 1 --2- 172.21.15.79:0/3209842620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4e6631a0 0x55be4e686c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:54.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.486+0000 7fd15f7fe640 1 -- 172.21.15.79:0/3209842620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4e662880 msgr2=0x55be4e66b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:54.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.486+0000 7fd15f7fe640 1 --2- 172.21.15.79:0/3209842620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4e662880 0x55be4e66b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:54.510 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:52:54.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.486+0000 7fd15f7fe640 1 -- 172.21.15.79:0/3209842620 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be4e661130 con 0x55be4e66f130 2024-08-20T01:52:54.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.486+0000 7fd15effd640 1 --2- 172.21.15.79:0/3209842620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4e662880 0x55be4e66b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:52:54.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.486+0000 7fd15f7fe640 1 --2- 172.21.15.79:0/3209842620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4e66f130 0x55be4e687150 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fd158035000 tx=0x7fd158000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59f634b37e247943 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:54.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.486+0000 7fd154ff9640 1 -- 172.21.15.79:0/3209842620 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd158031980 con 0x55be4e66f130 2024-08-20T01:52:54.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.487+0000 7fd154ff9640 1 -- 172.21.15.79:0/3209842620 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd158036040 con 0x55be4e66f130 2024-08-20T01:52:54.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.487+0000 7fd154ff9640 1 -- 172.21.15.79:0/3209842620 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd158004440 con 0x55be4e66f130 2024-08-20T01:52:54.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.487+0000 7fd16778b740 1 -- 172.21.15.79:0/3209842620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4e66f130 msgr2=0x55be4e687150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:54.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.487+0000 7fd16778b740 1 --2- 172.21.15.79:0/3209842620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4e66f130 0x55be4e687150 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fd158035000 tx=0x7fd158000f40 comp rx=0 tx=0).stop 2024-08-20T01:52:54.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.487+0000 7fd16778b740 1 -- 172.21.15.79:0/3209842620 shutdown_connections 2024-08-20T01:52:54.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.487+0000 7fd16778b740 1 --2- 172.21.15.79:0/3209842620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4e66f130 0x55be4e687150 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:54.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.487+0000 7fd16778b740 1 --2- 172.21.15.79:0/3209842620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4e6631a0 0x55be4e686c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:54.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.487+0000 7fd16778b740 1 --2- 172.21.15.79:0/3209842620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4e662880 0x55be4e66b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:54.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.487+0000 7fd16778b740 1 -- 172.21.15.79:0/3209842620 >> 172.21.15.79:0/3209842620 conn(0x55be4e6606b0 msgr2=0x55be4e66df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:54.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.487+0000 7fd16778b740 1 -- 172.21.15.79:0/3209842620 shutdown_connections 2024-08-20T01:52:54.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.487+0000 7fd16778b740 1 -- 172.21.15.79:0/3209842620 wait complete. 2024-08-20T01:52:54.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.488+0000 7fd16778b740 1 -- start start 2024-08-20T01:52:54.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.488+0000 7fd16778b740 1 Processor -- start 2024-08-20T01:52:54.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.488+0000 7fd16778b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4e662880 0x55be4e6734a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:54.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.488+0000 7fd16778b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4e6631a0 0x55be4e6739e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:54.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.488+0000 7fd16778b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4e66f130 0x55be4e673f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:54.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.488+0000 7fd16778b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd1601b5ae0 con 0x55be4e66f130 2024-08-20T01:52:54.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.488+0000 7fd16778b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd1601b53e0 con 0x55be4e662880 2024-08-20T01:52:54.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.488+0000 7fd16778b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd1601b2560 con 0x55be4e6631a0 2024-08-20T01:52:54.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.488+0000 7fd16778b740 10 client.0 _ll_register_callbacks cb 0x7fd150009660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:52:54.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.488+0000 7fd15f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4e66f130 0x55be4e673f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:54.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.488+0000 7fd15f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4e66f130 0x55be4e673f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43098/0 (socket says 172.21.15.79:43098) 2024-08-20T01:52:54.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.488+0000 7fd15f7fe640 1 -- 172.21.15.79:0/28316159 learned_addr learned my addr 172.21.15.79:0/28316159 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:54.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.488+0000 7fd15effd640 1 --2- 172.21.15.79:0/28316159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4e662880 0x55be4e6734a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:54.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.488+0000 7fd157fff640 1 --2- 172.21.15.79:0/28316159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4e6631a0 0x55be4e6739e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:54.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.488+0000 7fd15f7fe640 1 -- 172.21.15.79:0/28316159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4e6631a0 msgr2=0x55be4e6739e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:54.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.488+0000 7fd15f7fe640 1 --2- 172.21.15.79:0/28316159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4e6631a0 0x55be4e6739e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:54.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.488+0000 7fd15f7fe640 1 -- 172.21.15.79:0/28316159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4e662880 msgr2=0x55be4e6734a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:54.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.488+0000 7fd15f7fe640 1 --2- 172.21.15.79:0/28316159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4e662880 0x55be4e6734a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:54.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.488+0000 7fd15f7fe640 1 -- 172.21.15.79:0/28316159 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be4e662260 con 0x55be4e66f130 2024-08-20T01:52:54.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.488+0000 7fd157fff640 1 --2- 172.21.15.79:0/28316159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4e6631a0 0x55be4e6739e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:52:54.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.489+0000 7fd15f7fe640 1 --2- 172.21.15.79:0/28316159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4e66f130 0x55be4e673f20 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fd158005e30 tx=0x7fd158031c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db2f699b1ec28ac5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:54.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.489+0000 7fd1467fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:52:54.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.489+0000 7fd1467fc640 1 -- 172.21.15.79:0/28316159 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd15805c060 con 0x55be4e66f130 2024-08-20T01:52:54.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.489+0000 7fd1467fc640 1 -- 172.21.15.79:0/28316159 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fd158004350 con 0x55be4e66f130 2024-08-20T01:52:54.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.489+0000 7fd16778b740 1 -- 172.21.15.79:0/28316159 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd158036040 con 0x55be4e66f130 2024-08-20T01:52:54.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.489+0000 7fd1467fc640 1 -- 172.21.15.79:0/28316159 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fd158031e50 con 0x55be4e66f130 2024-08-20T01:52:54.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.489+0000 7fd16778b740 10 client.19320 fetch_fsmap learned FSMap version 62 2024-08-20T01:52:54.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.489+0000 7fd16778b740 1 -- 172.21.15.79:0/28316159 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55be4e6e8f20 con 0x55be4e66f130 2024-08-20T01:52:54.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.489+0000 7fd1467fc640 1 -- 172.21.15.79:0/28316159 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd158036040 con 0x55be4e66f130 2024-08-20T01:52:54.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.489+0000 7fd1467fc640 1 -- 172.21.15.79:0/28316159 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 62) ==== 8406+0+0 (secure 0 0 0) 0x7fd15804d070 con 0x55be4e66f130 2024-08-20T01:52:54.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.489+0000 7fd16778b740 10 client.19320 fetch_fsmap finished waiting for FSMap version 62 2024-08-20T01:52:54.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.489+0000 7fd16778b740 10 client.19320 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:52:54.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.489+0000 7fd16778b740 20 client.19320 populate_metadata read hostname 'smithi079' 2024-08-20T01:52:54.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.489+0000 7fd16778b740 1 --2- 172.21.15.79:0/28316159 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55be4e6e9360 0x55be4e6eb750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:54.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.489+0000 7fd16778b740 4 client.19320 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:52:54.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.489+0000 7fd16778b740 1 -- 172.21.15.79:0/28316159 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55be4e5d7320 con 0x55be4e6e9360 2024-08-20T01:52:54.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.490+0000 7fd15effd640 1 --2- 172.21.15.79:0/28316159 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55be4e6e9360 0x55be4e6eb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:54.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.490+0000 7fd1467fc640 10 client.19320 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:52:54.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.490+0000 7fd15effd640 1 --2- 172.21.15.79:0/28316159 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55be4e6e9360 0x55be4e6eb750 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=709174bbf8c9ae0e server_cookie=a009b4c63a524495 in_seq=0 out_seq=0 2024-08-20T01:52:54.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.490+0000 7fd1467fc640 1 -- 172.21.15.79:0/28316159 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55be4e5d7320 con 0x55be4e6e9360 2024-08-20T01:52:54.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.490+0000 7fd1467fc640 10 client.19320 handle_command_reply: tid=0 2024-08-20T01:52:54.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.490+0000 7fd16778b740 1 client.19320 shutdown 2024-08-20T01:52:54.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.490+0000 7fd16778b740 1 -- 172.21.15.79:0/28316159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4e66f130 msgr2=0x55be4e673f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:54.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.490+0000 7fd16778b740 1 --2- 172.21.15.79:0/28316159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4e66f130 0x55be4e673f20 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fd158005e30 tx=0x7fd158031c30 comp rx=0 tx=0).stop 2024-08-20T01:52:54.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.490+0000 7fd16778b740 1 -- 172.21.15.79:0/28316159 shutdown_connections 2024-08-20T01:52:54.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.490+0000 7fd16778b740 1 --2- 172.21.15.79:0/28316159 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55be4e6e9360 0x55be4e6eb750 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:54.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.490+0000 7fd16778b740 1 --2- 172.21.15.79:0/28316159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55be4e66f130 0x55be4e673f20 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:54.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.490+0000 7fd1467fc640 0 client.19320 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:52:54.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.490+0000 7fd16778b740 1 --2- 172.21.15.79:0/28316159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55be4e6631a0 0x55be4e6739e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:54.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.490+0000 7fd16778b740 1 --2- 172.21.15.79:0/28316159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55be4e662880 0x55be4e6734a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:54.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.490+0000 7fd16778b740 1 -- 172.21.15.79:0/28316159 >> 172.21.15.79:0/28316159 conn(0x55be4e6606b0 msgr2=0x55be4e65ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:54.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.491+0000 7fd16778b740 1 -- 172.21.15.79:0/28316159 shutdown_connections 2024-08-20T01:52:54.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.491+0000 7fd16778b740 1 -- 172.21.15.79:0/28316159 wait complete. 2024-08-20T01:52:54.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.491+0000 7fd16778b740 20 client.19320 trim_cache size 0 max 16384 2024-08-20T01:52:54.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.491+0000 7fd165392640 1 -- 172.21.15.79:0/3586884993 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd14c0b3c50 msgr2=0x7fd14c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:54.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.491+0000 7fd165392640 1 --2- 172.21.15.79:0/3586884993 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd14c0b3c50 0x7fd14c0b6110 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x55be4e665a00 tx=0x7fd150005f90 comp rx=0 tx=0).stop 2024-08-20T01:52:54.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.491+0000 7fd165392640 1 -- 172.21.15.79:0/3586884993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd160075b90 msgr2=0x7fd16019fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:54.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.491+0000 7fd165392640 1 --2- 172.21.15.79:0/3586884993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd160075b90 0x7fd16019fa10 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7fd14800d950 tx=0x7fd14800de10 comp rx=0 tx=0).stop 2024-08-20T01:52:54.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.491+0000 7fd165392640 1 -- 172.21.15.79:0/3586884993 shutdown_connections 2024-08-20T01:52:54.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.491+0000 7fd165392640 1 --2- 172.21.15.79:0/3586884993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1601137f0 0x7fd1601a4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:54.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.491+0000 7fd165392640 1 --2- 172.21.15.79:0/3586884993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd160075b90 0x7fd16019fa10 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:54.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.491+0000 7fd165392640 1 --2- 172.21.15.79:0/3586884993 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd14c0b3c50 0x7fd14c0b6110 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:54.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.491+0000 7fd165392640 1 --2- 172.21.15.79:0/3586884993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd160075270 0x7fd16019f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:54.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.491+0000 7fd165392640 1 -- 172.21.15.79:0/3586884993 >> 172.21.15.79:0/3586884993 conn(0x7fd1600fe540 msgr2=0x7fd1600ff1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:54.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.491+0000 7fd165392640 1 -- 172.21.15.79:0/3586884993 shutdown_connections 2024-08-20T01:52:54.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:54.491+0000 7fd165392640 1 -- 172.21.15.79:0/3586884993 wait complete. 2024-08-20T01:52:54.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:54 smithi079 ceph-mon[18656]: pgmap v814: 97 pgs: 97 active+clean; 7.9 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 KiB/s wr, 25 op/s 2024-08-20T01:52:54.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:54 smithi175 ceph-mon[22392]: pgmap v814: 97 pgs: 97 active+clean; 7.9 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 KiB/s wr, 25 op/s 2024-08-20T01:52:55.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:54 smithi081 ceph-mon[22209]: pgmap v814: 97 pgs: 97 active+clean; 7.9 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 KiB/s wr, 25 op/s 2024-08-20T01:52:55.361 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-20T01:52:55.610 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:52:56.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.236+0000 7f2993189640 1 -- 172.21.15.79:0/573160311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f298c1042c0 msgr2=0x7f298c10c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:56.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.236+0000 7f2993189640 1 --2- 172.21.15.79:0/573160311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f298c1042c0 0x7f298c10c7b0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f2978009900 tx=0x7f297802a410 comp rx=0 tx=0).stop 2024-08-20T01:52:56.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.237+0000 7f2993189640 1 -- 172.21.15.79:0/573160311 shutdown_connections 2024-08-20T01:52:56.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.237+0000 7f2993189640 1 --2- 172.21.15.79:0/573160311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f298c10ce00 0x7f298c10f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:56.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.237+0000 7f2993189640 1 --2- 172.21.15.79:0/573160311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f298c1042c0 0x7f298c10c7b0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:56.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.237+0000 7f2993189640 1 --2- 172.21.15.79:0/573160311 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f298c1039a0 0x7f298c103d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:56.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.237+0000 7f2993189640 1 -- 172.21.15.79:0/573160311 >> 172.21.15.79:0/573160311 conn(0x7f298c0fd400 msgr2=0x7f298c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:56.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.237+0000 7f2993189640 1 -- 172.21.15.79:0/573160311 shutdown_connections 2024-08-20T01:52:56.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.237+0000 7f2993189640 1 -- 172.21.15.79:0/573160311 wait complete. 2024-08-20T01:52:56.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.237+0000 7f2993189640 1 Processor -- start 2024-08-20T01:52:56.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.237+0000 7f2993189640 1 -- start start 2024-08-20T01:52:56.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.237+0000 7f2993189640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f298c1039a0 0x7f298c198f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:56.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.238+0000 7f2993189640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f298c1042c0 0x7f298c199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:56.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.238+0000 7f2993189640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f298c10ce00 0x7f298c19e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:56.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.238+0000 7f2993189640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f298c112920 con 0x7f298c1042c0 2024-08-20T01:52:56.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.238+0000 7f2993189640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f298c1127a0 con 0x7f298c10ce00 2024-08-20T01:52:56.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.238+0000 7f2993189640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f298c112aa0 con 0x7f298c1039a0 2024-08-20T01:52:56.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.238+0000 7f298bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f298c1042c0 0x7f298c199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:56.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.238+0000 7f2990f25640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f298c1039a0 0x7f298c198f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:56.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.238+0000 7f2991726640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f298c10ce00 0x7f298c19e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:56.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.238+0000 7f2990f25640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f298c1039a0 0x7f298c198f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:49634/0 (socket says 172.21.15.79:49634) 2024-08-20T01:52:56.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.238+0000 7f2991726640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f298c10ce00 0x7f298c19e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:57082/0 (socket says 172.21.15.79:57082) 2024-08-20T01:52:56.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.238+0000 7f298bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f298c1042c0 0x7f298c199450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43112/0 (socket says 172.21.15.79:43112) 2024-08-20T01:52:56.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.238+0000 7f2990f25640 1 -- 172.21.15.79:0/3617508869 learned_addr learned my addr 172.21.15.79:0/3617508869 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:56.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.238+0000 7f298bfff640 1 -- 172.21.15.79:0/3617508869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f298c1039a0 msgr2=0x7f298c198f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:56.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.238+0000 7f298bfff640 1 --2- 172.21.15.79:0/3617508869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f298c1039a0 0x7f298c198f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:56.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.238+0000 7f298bfff640 1 -- 172.21.15.79:0/3617508869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f298c10ce00 msgr2=0x7f298c19e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:56.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.238+0000 7f298bfff640 1 --2- 172.21.15.79:0/3617508869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f298c10ce00 0x7f298c19e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:56.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.238+0000 7f298bfff640 1 -- 172.21.15.79:0/3617508869 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f298c19efc0 con 0x7f298c1042c0 2024-08-20T01:52:56.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.238+0000 7f298bfff640 1 --2- 172.21.15.79:0/3617508869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f298c1042c0 0x7f298c199450 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f2978009230 tx=0x7f2978005e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:56.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.238+0000 7f2989ffb640 1 -- 172.21.15.79:0/3617508869 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f297803f070 con 0x7f298c1042c0 2024-08-20T01:52:56.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.238+0000 7f2993189640 1 -- 172.21.15.79:0/3617508869 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f298c19f250 con 0x7f298c1042c0 2024-08-20T01:52:56.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.238+0000 7f2989ffb640 1 -- 172.21.15.79:0/3617508869 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2978003a80 con 0x7f298c1042c0 2024-08-20T01:52:56.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.238+0000 7f2989ffb640 1 -- 172.21.15.79:0/3617508869 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2978035070 con 0x7f298c1042c0 2024-08-20T01:52:56.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.239+0000 7f2993189640 1 -- 172.21.15.79:0/3617508869 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f298c1a5970 con 0x7f298c1042c0 2024-08-20T01:52:56.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.241+0000 7f2995582740 1 Processor -- start 2024-08-20T01:52:56.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.242+0000 7f2995582740 1 -- start start 2024-08-20T01:52:56.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.242+0000 7f2989ffb640 1 -- 172.21.15.79:0/3617508869 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f29780035f0 con 0x7f298c1042c0 2024-08-20T01:52:56.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.242+0000 7f2995582740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588ea204730 0x5588ea204b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:56.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.242+0000 7f2995582740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588ea205050 0x5588ea210aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:56.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.242+0000 7f2995582740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588ea210fe0 0x5588ea2133d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:56.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.242+0000 7f2995582740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5588ea17b930 con 0x5588ea205050 2024-08-20T01:52:56.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.242+0000 7f2995582740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5588ea16ae30 con 0x5588ea210fe0 2024-08-20T01:52:56.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.242+0000 7f2995582740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5588ea16ee70 con 0x5588ea204730 2024-08-20T01:52:56.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.242+0000 7f2990f25640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588ea205050 0x5588ea210aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:56.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.242+0000 7f2990f25640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588ea205050 0x5588ea210aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43116/0 (socket says 172.21.15.79:43116) 2024-08-20T01:52:56.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.242+0000 7f2990f25640 1 -- 172.21.15.79:0/2281932785 learned_addr learned my addr 172.21.15.79:0/2281932785 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:56.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.242+0000 7f2991726640 1 --2- 172.21.15.79:0/2281932785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588ea204730 0x5588ea204b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:56.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.242+0000 7f298bfff640 1 --2- 172.21.15.79:0/2281932785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588ea210fe0 0x5588ea2133d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:56.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.242+0000 7f2990f25640 1 -- 172.21.15.79:0/2281932785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588ea204730 msgr2=0x5588ea204b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:56.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.242+0000 7f2990f25640 1 --2- 172.21.15.79:0/2281932785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588ea204730 0x5588ea204b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:56.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.242+0000 7f2990f25640 1 -- 172.21.15.79:0/2281932785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588ea210fe0 msgr2=0x5588ea2133d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:56.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.242+0000 7f2990f25640 1 --2- 172.21.15.79:0/2281932785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588ea210fe0 0x5588ea2133d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:56.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.242+0000 7f2990f25640 1 -- 172.21.15.79:0/2281932785 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588e9eca650 con 0x5588ea205050 2024-08-20T01:52:56.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.243+0000 7f2990f25640 1 --2- 172.21.15.79:0/2281932785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588ea205050 0x5588ea210aa0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f2980009e40 tx=0x7f2980011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be666e0ef3f04dd4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:56.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.243+0000 7f2976ffd640 1 -- 172.21.15.79:0/2281932785 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f298001e070 con 0x5588ea205050 2024-08-20T01:52:56.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.243+0000 7f2976ffd640 1 -- 172.21.15.79:0/2281932785 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29800198a0 con 0x5588ea205050 2024-08-20T01:52:56.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.243+0000 7f2976ffd640 1 -- 172.21.15.79:0/2281932785 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f298000f7e0 con 0x5588ea205050 2024-08-20T01:52:56.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.243+0000 7f2989ffb640 1 --2- 172.21.15.79:0/3617508869 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f297c0b3bd0 0x7f297c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:56.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.243+0000 7f2991726640 1 --2- 172.21.15.79:0/3617508869 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f297c0b3bd0 0x7f297c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:56.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.243+0000 7f2989ffb640 1 -- 172.21.15.79:0/3617508869 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f2978103ca0 con 0x7f298c1042c0 2024-08-20T01:52:56.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.243+0000 7f2995582740 1 -- 172.21.15.79:0/2281932785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588ea205050 msgr2=0x5588ea210aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:56.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.243+0000 7f2991726640 1 --2- 172.21.15.79:0/3617508869 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f297c0b3bd0 0x7f297c0b6090 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2984005fd0 tx=0x7f2984009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:56.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.243+0000 7f2995582740 1 --2- 172.21.15.79:0/2281932785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588ea205050 0x5588ea210aa0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f2980009e40 tx=0x7f2980011810 comp rx=0 tx=0).stop 2024-08-20T01:52:56.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.243+0000 7f2995582740 1 -- 172.21.15.79:0/2281932785 shutdown_connections 2024-08-20T01:52:56.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.243+0000 7f2995582740 1 --2- 172.21.15.79:0/2281932785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588ea210fe0 0x5588ea2133d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:56.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.243+0000 7f2995582740 1 --2- 172.21.15.79:0/2281932785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588ea205050 0x5588ea210aa0 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:56.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.243+0000 7f2995582740 1 --2- 172.21.15.79:0/2281932785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588ea204730 0x5588ea204b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:56.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.243+0000 7f2995582740 1 -- 172.21.15.79:0/2281932785 >> 172.21.15.79:0/2281932785 conn(0x5588ea202560 msgr2=0x5588ea203700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:56.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.244+0000 7f2995582740 1 -- 172.21.15.79:0/2281932785 shutdown_connections 2024-08-20T01:52:56.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.244+0000 7f2995582740 1 -- 172.21.15.79:0/2281932785 wait complete. 2024-08-20T01:52:56.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.244+0000 7f2995582740 1 -- start start 2024-08-20T01:52:56.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.244+0000 7f2995582740 1 Processor -- start 2024-08-20T01:52:56.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.244+0000 7f2995582740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588ea204730 0x5588ea20df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:56.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.244+0000 7f2995582740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588ea205050 0x5588ea20e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:56.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.244+0000 7f2995582740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588ea210fe0 0x5588ea20ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:56.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.244+0000 7f2995582740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5588e9fcd700 con 0x5588ea210fe0 2024-08-20T01:52:56.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.244+0000 7f2995582740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5588ea0f1810 con 0x5588ea205050 2024-08-20T01:52:56.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.244+0000 7f2995582740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5588ea213c90 con 0x5588ea204730 2024-08-20T01:52:56.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.244+0000 7f2995582740 10 client.0 _ll_register_callbacks cb 0x5588ea164700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:52:56.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.244+0000 7f2991726640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588ea210fe0 0x5588ea20ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:56.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.244+0000 7f298bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588ea205050 0x5588ea20e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:56.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.244+0000 7f2991726640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588ea210fe0 0x5588ea20ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43124/0 (socket says 172.21.15.79:43124) 2024-08-20T01:52:56.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.245+0000 7f2991726640 1 -- 172.21.15.79:0/1414891026 learned_addr learned my addr 172.21.15.79:0/1414891026 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:56.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.245+0000 7f2990f25640 1 --2- 172.21.15.79:0/1414891026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588ea204730 0x5588ea20df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:56.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.245+0000 7f298bfff640 1 -- 172.21.15.79:0/1414891026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588ea204730 msgr2=0x5588ea20df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:56.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.245+0000 7f298bfff640 1 --2- 172.21.15.79:0/1414891026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588ea204730 0x5588ea20df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:56.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.245+0000 7f298bfff640 1 -- 172.21.15.79:0/1414891026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588ea210fe0 msgr2=0x5588ea20ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:56.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.245+0000 7f298bfff640 1 --2- 172.21.15.79:0/1414891026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588ea210fe0 0x5588ea20ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:56.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.245+0000 7f298bfff640 1 -- 172.21.15.79:0/1414891026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588ea21d070 con 0x5588ea205050 2024-08-20T01:52:56.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.245+0000 7f2991726640 1 --2- 172.21.15.79:0/1414891026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588ea210fe0 0x5588ea20ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:52:56.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.245+0000 7f298bfff640 1 --2- 172.21.15.79:0/1414891026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588ea205050 0x5588ea20e4c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2978101800 tx=0x7f2978003f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc04c25bc8d9173d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:56.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.245+0000 7f296bfff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:52:56.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.245+0000 7f296bfff640 1 -- 172.21.15.79:0/1414891026 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2978048070 con 0x5588ea205050 2024-08-20T01:52:56.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.245+0000 7f296bfff640 1 -- 172.21.15.79:0/1414891026 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f29780caf10 con 0x5588ea205050 2024-08-20T01:52:56.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.245+0000 7f2995582740 1 -- 172.21.15.79:0/1414891026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5588ea11a150 con 0x5588ea205050 2024-08-20T01:52:56.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.245+0000 7f296bfff640 1 -- 172.21.15.79:0/1414891026 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f29780ca420 con 0x5588ea205050 2024-08-20T01:52:56.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.245+0000 7f2995582740 10 client.28433 fetch_fsmap learned FSMap version 62 2024-08-20T01:52:56.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.245+0000 7f2995582740 1 -- 172.21.15.79:0/1414891026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x5588ea21fa20 con 0x5588ea205050 2024-08-20T01:52:56.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.246+0000 7f296bfff640 1 -- 172.21.15.79:0/1414891026 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5588ea11a150 con 0x5588ea205050 2024-08-20T01:52:56.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.246+0000 7f296bfff640 1 -- 172.21.15.79:0/1414891026 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 62) ==== 8406+0+0 (secure 0 0 0) 0x7f297804b060 con 0x5588ea205050 2024-08-20T01:52:56.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.246+0000 7f2995582740 10 client.28433 fetch_fsmap finished waiting for FSMap version 62 2024-08-20T01:52:56.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.246+0000 7f2995582740 10 client.28433 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:52:56.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.246+0000 7f2995582740 20 client.28433 populate_metadata read hostname 'smithi079' 2024-08-20T01:52:56.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.246+0000 7f2995582740 1 --2- 172.21.15.79:0/1414891026 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5588ea220dc0 0x5588ea223220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:56.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.246+0000 7f2995582740 4 client.28433 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:52:56.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.246+0000 7f2995582740 1 -- 172.21.15.79:0/1414891026 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5588ea17d880 con 0x5588ea220dc0 2024-08-20T01:52:56.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.246+0000 7f2990f25640 1 --2- 172.21.15.79:0/1414891026 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5588ea220dc0 0x5588ea223220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:56.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.247+0000 7f296bfff640 10 client.28433 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:52:56.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.247+0000 7f2990f25640 1 --2- 172.21.15.79:0/1414891026 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5588ea220dc0 0x5588ea223220 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=cbe4c723020bdac0 server_cookie=1a6849aaffda781 in_seq=0 out_seq=0 2024-08-20T01:52:56.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.247+0000 7f296bfff640 1 -- 172.21.15.79:0/1414891026 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5588ea17d880 con 0x5588ea220dc0 2024-08-20T01:52:56.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.247+0000 7f296bfff640 10 client.28433 handle_command_reply: tid=0 2024-08-20T01:52:56.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.247+0000 7f2995582740 1 client.28433 shutdown 2024-08-20T01:52:56.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.247+0000 7f2995582740 1 -- 172.21.15.79:0/1414891026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588ea205050 msgr2=0x5588ea20e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:56.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.247+0000 7f2995582740 1 --2- 172.21.15.79:0/1414891026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588ea205050 0x5588ea20e4c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2978101800 tx=0x7f2978003f90 comp rx=0 tx=0).stop 2024-08-20T01:52:56.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.247+0000 7f2995582740 1 -- 172.21.15.79:0/1414891026 shutdown_connections 2024-08-20T01:52:56.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.247+0000 7f2995582740 1 --2- 172.21.15.79:0/1414891026 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5588ea220dc0 0x5588ea223220 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:56.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.247+0000 7f2995582740 1 --2- 172.21.15.79:0/1414891026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588ea210fe0 0x5588ea20ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:56.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.247+0000 7f296bfff640 0 client.28433 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:52:56.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.247+0000 7f2995582740 1 --2- 172.21.15.79:0/1414891026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588ea205050 0x5588ea20e4c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:56.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.247+0000 7f2995582740 1 --2- 172.21.15.79:0/1414891026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588ea204730 0x5588ea20df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:56.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.247+0000 7f2995582740 1 -- 172.21.15.79:0/1414891026 >> 172.21.15.79:0/1414891026 conn(0x5588ea202560 msgr2=0x5588ea208100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:56.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.248+0000 7f2995582740 1 -- 172.21.15.79:0/1414891026 shutdown_connections 2024-08-20T01:52:56.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.248+0000 7f2995582740 1 -- 172.21.15.79:0/1414891026 wait complete. 2024-08-20T01:52:56.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.248+0000 7f2995582740 20 client.28433 trim_cache size 0 max 16384 2024-08-20T01:52:56.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.261+0000 7f2995582740 1 Processor -- start 2024-08-20T01:52:56.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.261+0000 7f2995582740 1 -- start start 2024-08-20T01:52:56.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.261+0000 7f2995582740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588ea204730 0x5588ea2088f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:56.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.261+0000 7f2995582740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588ea205050 0x5588ea228af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:56.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.261+0000 7f2995582740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588ea210fe0 0x5588ea229030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:56.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.261+0000 7f2995582740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f298c1adf30 con 0x5588ea204730 2024-08-20T01:52:56.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.261+0000 7f2995582740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f298c1afc20 con 0x5588ea205050 2024-08-20T01:52:56.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.261+0000 7f2995582740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f298c1ae630 con 0x5588ea210fe0 2024-08-20T01:52:56.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.261+0000 7f2990f25640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588ea204730 0x5588ea2088f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:56.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.261+0000 7f2990f25640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588ea204730 0x5588ea2088f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43130/0 (socket says 172.21.15.79:43130) 2024-08-20T01:52:56.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.261+0000 7f2990f25640 1 -- 172.21.15.79:0/146603194 learned_addr learned my addr 172.21.15.79:0/146603194 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:56.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.262+0000 7f298bfff640 1 --2- 172.21.15.79:0/146603194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588ea205050 0x5588ea228af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:56.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.262+0000 7f2990f25640 1 -- 172.21.15.79:0/146603194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588ea210fe0 msgr2=0x5588ea229030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:56.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.262+0000 7f2991726640 1 --2- 172.21.15.79:0/146603194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588ea210fe0 0x5588ea229030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:56.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.262+0000 7f2990f25640 1 --2- 172.21.15.79:0/146603194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588ea210fe0 0x5588ea229030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:56.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.262+0000 7f2990f25640 1 -- 172.21.15.79:0/146603194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588ea205050 msgr2=0x5588ea228af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:56.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.262+0000 7f2990f25640 1 --2- 172.21.15.79:0/146603194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588ea205050 0x5588ea228af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:56.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.262+0000 7f2990f25640 1 -- 172.21.15.79:0/146603194 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588ea202fe0 con 0x5588ea204730 2024-08-20T01:52:56.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.262+0000 7f298bfff640 1 --2- 172.21.15.79:0/146603194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588ea205050 0x5588ea228af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:52:56.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.262+0000 7f2991726640 1 --2- 172.21.15.79:0/146603194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588ea210fe0 0x5588ea229030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:52:56.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.262+0000 7f2990f25640 1 --2- 172.21.15.79:0/146603194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588ea204730 0x5588ea2088f0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f2980011d10 tx=0x7f29800097a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79308eb36110def1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:56.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.262+0000 7f29767fc640 1 -- 172.21.15.79:0/146603194 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f298001e040 con 0x5588ea204730 2024-08-20T01:52:56.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.262+0000 7f29767fc640 1 -- 172.21.15.79:0/146603194 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2980005c70 con 0x5588ea204730 2024-08-20T01:52:56.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.262+0000 7f29767fc640 1 -- 172.21.15.79:0/146603194 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2980004da0 con 0x5588ea204730 2024-08-20T01:52:56.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.263+0000 7f2995582740 1 -- 172.21.15.79:0/146603194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588ea204730 msgr2=0x5588ea2088f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:56.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.263+0000 7f2995582740 1 --2- 172.21.15.79:0/146603194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588ea204730 0x5588ea2088f0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f2980011d10 tx=0x7f29800097a0 comp rx=0 tx=0).stop 2024-08-20T01:52:56.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.263+0000 7f2995582740 1 -- 172.21.15.79:0/146603194 shutdown_connections 2024-08-20T01:52:56.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.263+0000 7f2995582740 1 --2- 172.21.15.79:0/146603194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588ea210fe0 0x5588ea229030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:56.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.263+0000 7f2995582740 1 --2- 172.21.15.79:0/146603194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588ea205050 0x5588ea228af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:56.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.263+0000 7f2995582740 1 --2- 172.21.15.79:0/146603194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588ea204730 0x5588ea2088f0 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:56.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.263+0000 7f2995582740 1 -- 172.21.15.79:0/146603194 >> 172.21.15.79:0/146603194 conn(0x5588ea202560 msgr2=0x5588ea2014f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:56.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.263+0000 7f2995582740 1 -- 172.21.15.79:0/146603194 shutdown_connections 2024-08-20T01:52:56.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.263+0000 7f2995582740 1 -- 172.21.15.79:0/146603194 wait complete. 2024-08-20T01:52:56.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.263+0000 7f2995582740 1 -- start start 2024-08-20T01:52:56.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.263+0000 7f2995582740 1 Processor -- start 2024-08-20T01:52:56.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.264+0000 7f2995582740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588ea204730 0x5588ea216980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:56.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.264+0000 7f2995582740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588ea205050 0x5588ea216f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:56.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.264+0000 7f2995582740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588ea210fe0 0x5588ea282af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:56.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.264+0000 7f2995582740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f298c1af490 con 0x5588ea204730 2024-08-20T01:52:56.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.264+0000 7f2995582740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f298c1aed90 con 0x5588ea210fe0 2024-08-20T01:52:56.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.264+0000 7f2995582740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f298c1abf10 con 0x5588ea205050 2024-08-20T01:52:56.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.264+0000 7f2995582740 10 client.0 _ll_register_callbacks cb 0x7f2978009260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:52:56.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.264+0000 7f2990f25640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588ea204730 0x5588ea216980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:56.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.264+0000 7f298bfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588ea205050 0x5588ea216f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:56.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.264+0000 7f2990f25640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588ea204730 0x5588ea216980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43140/0 (socket says 172.21.15.79:43140) 2024-08-20T01:52:56.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.264+0000 7f2990f25640 1 -- 172.21.15.79:0/1845041396 learned_addr learned my addr 172.21.15.79:0/1845041396 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:56.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.264+0000 7f2991726640 1 --2- 172.21.15.79:0/1845041396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588ea210fe0 0x5588ea282af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:56.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.264+0000 7f2990f25640 1 -- 172.21.15.79:0/1845041396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588ea205050 msgr2=0x5588ea216f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:56.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.264+0000 7f2990f25640 1 --2- 172.21.15.79:0/1845041396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588ea205050 0x5588ea216f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:56.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.264+0000 7f2990f25640 1 -- 172.21.15.79:0/1845041396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588ea210fe0 msgr2=0x5588ea282af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:56.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.264+0000 7f2990f25640 1 --2- 172.21.15.79:0/1845041396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588ea210fe0 0x5588ea282af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:56.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.264+0000 7f2990f25640 1 -- 172.21.15.79:0/1845041396 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588ea283230 con 0x5588ea204730 2024-08-20T01:52:56.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.264+0000 7f298bfff640 1 --2- 172.21.15.79:0/1845041396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588ea205050 0x5588ea216f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:52:56.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.264+0000 7f2991726640 1 --2- 172.21.15.79:0/1845041396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588ea210fe0 0x5588ea282af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:52:56.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.264+0000 7f2990f25640 1 --2- 172.21.15.79:0/1845041396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588ea204730 0x5588ea216980 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f2980009900 tx=0x7f2980004710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e24396cb7db7738d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:56.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.264+0000 7f296bfff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:52:56.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.265+0000 7f296bfff640 1 -- 172.21.15.79:0/1845041396 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f298003b070 con 0x5588ea204730 2024-08-20T01:52:56.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.265+0000 7f296bfff640 1 -- 172.21.15.79:0/1845041396 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f2980004b20 con 0x5588ea204730 2024-08-20T01:52:56.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.265+0000 7f2995582740 1 -- 172.21.15.79:0/1845041396 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5588ea179320 con 0x5588ea204730 2024-08-20T01:52:56.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.265+0000 7f296bfff640 1 -- 172.21.15.79:0/1845041396 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f2980047050 con 0x5588ea204730 2024-08-20T01:52:56.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.265+0000 7f2995582740 10 client.19338 fetch_fsmap learned FSMap version 62 2024-08-20T01:52:56.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.265+0000 7f2995582740 1 -- 172.21.15.79:0/1845041396 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x5588ea28b730 con 0x5588ea204730 2024-08-20T01:52:56.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.265+0000 7f296bfff640 1 -- 172.21.15.79:0/1845041396 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5588ea179320 con 0x5588ea204730 2024-08-20T01:52:56.302 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:52:56.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.265+0000 7f296bfff640 1 -- 172.21.15.79:0/1845041396 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 62) ==== 8406+0+0 (secure 0 0 0) 0x7f298000f5a0 con 0x5588ea204730 2024-08-20T01:52:56.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.265+0000 7f2995582740 10 client.19338 fetch_fsmap finished waiting for FSMap version 62 2024-08-20T01:52:56.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.265+0000 7f2995582740 10 client.19338 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:52:56.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.265+0000 7f2995582740 20 client.19338 populate_metadata read hostname 'smithi079' 2024-08-20T01:52:56.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.265+0000 7f2995582740 1 --2- 172.21.15.79:0/1845041396 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5588ea28bd60 0x5588ea28e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:56.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.265+0000 7f2995582740 4 client.19338 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:52:56.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.265+0000 7f2995582740 1 -- 172.21.15.79:0/1845041396 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5588ea176a60 con 0x5588ea28bd60 2024-08-20T01:52:56.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.265+0000 7f298bfff640 1 --2- 172.21.15.79:0/1845041396 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5588ea28bd60 0x5588ea28e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:56.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.266+0000 7f298bfff640 1 --2- 172.21.15.79:0/1845041396 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5588ea28bd60 0x5588ea28e180 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=20b66cabce57d0ed server_cookie=734acd201a9869c1 in_seq=0 out_seq=0 2024-08-20T01:52:56.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.266+0000 7f296bfff640 10 client.19338 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:52:56.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.266+0000 7f296bfff640 1 -- 172.21.15.79:0/1845041396 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5588ea176a60 con 0x5588ea28bd60 2024-08-20T01:52:56.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.266+0000 7f296bfff640 10 client.19338 handle_command_reply: tid=0 2024-08-20T01:52:56.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.266+0000 7f2995582740 1 client.19338 shutdown 2024-08-20T01:52:56.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.266+0000 7f2995582740 1 -- 172.21.15.79:0/1845041396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588ea204730 msgr2=0x5588ea216980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:56.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.266+0000 7f2995582740 1 --2- 172.21.15.79:0/1845041396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588ea204730 0x5588ea216980 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f2980009900 tx=0x7f2980004710 comp rx=0 tx=0).stop 2024-08-20T01:52:56.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.266+0000 7f2995582740 1 -- 172.21.15.79:0/1845041396 shutdown_connections 2024-08-20T01:52:56.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.266+0000 7f2995582740 1 --2- 172.21.15.79:0/1845041396 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x5588ea28bd60 0x5588ea28e180 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:56.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.266+0000 7f2995582740 1 --2- 172.21.15.79:0/1845041396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588ea210fe0 0x5588ea282af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:56.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.266+0000 7f2995582740 1 --2- 172.21.15.79:0/1845041396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588ea205050 0x5588ea216f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:56.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.266+0000 7f296bfff640 0 client.19338 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:52:56.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.266+0000 7f2995582740 1 --2- 172.21.15.79:0/1845041396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588ea204730 0x5588ea216980 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:56.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.266+0000 7f2995582740 1 -- 172.21.15.79:0/1845041396 >> 172.21.15.79:0/1845041396 conn(0x5588ea202560 msgr2=0x5588ea20f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:56.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.266+0000 7f2995582740 1 -- 172.21.15.79:0/1845041396 shutdown_connections 2024-08-20T01:52:56.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.266+0000 7f2995582740 1 -- 172.21.15.79:0/1845041396 wait complete. 2024-08-20T01:52:56.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.266+0000 7f2995582740 20 client.19338 trim_cache size 0 max 16384 2024-08-20T01:52:56.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.267+0000 7f2993189640 1 -- 172.21.15.79:0/3617508869 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f297c0b3bd0 msgr2=0x7f297c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:56.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.267+0000 7f2993189640 1 --2- 172.21.15.79:0/3617508869 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f297c0b3bd0 0x7f297c0b6090 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2984005fd0 tx=0x7f2984009600 comp rx=0 tx=0).stop 2024-08-20T01:52:56.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.267+0000 7f2993189640 1 -- 172.21.15.79:0/3617508869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f298c1042c0 msgr2=0x7f298c199450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:56.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.267+0000 7f2993189640 1 --2- 172.21.15.79:0/3617508869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f298c1042c0 0x7f298c199450 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f2978009230 tx=0x7f2978005e10 comp rx=0 tx=0).stop 2024-08-20T01:52:56.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.267+0000 7f2993189640 1 -- 172.21.15.79:0/3617508869 shutdown_connections 2024-08-20T01:52:56.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.267+0000 7f2993189640 1 --2- 172.21.15.79:0/3617508869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f298c10ce00 0x7f298c19e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:56.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.267+0000 7f2993189640 1 --2- 172.21.15.79:0/3617508869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f298c1042c0 0x7f298c199450 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:56.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.267+0000 7f2993189640 1 --2- 172.21.15.79:0/3617508869 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f297c0b3bd0 0x7f297c0b6090 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:56.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.267+0000 7f2993189640 1 --2- 172.21.15.79:0/3617508869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f298c1039a0 0x7f298c198f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:56.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.267+0000 7f2993189640 1 -- 172.21.15.79:0/3617508869 >> 172.21.15.79:0/3617508869 conn(0x7f298c0fd400 msgr2=0x7f298c0fe140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:56.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.267+0000 7f2993189640 1 -- 172.21.15.79:0/3617508869 shutdown_connections 2024-08-20T01:52:56.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:56.267+0000 7f2993189640 1 -- 172.21.15.79:0/3617508869 wait complete. 2024-08-20T01:52:56.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:56 smithi175 ceph-mon[22392]: pgmap v815: 97 pgs: 97 active+clean; 7.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 KiB/s wr, 27 op/s 2024-08-20T01:52:56.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:56 smithi079 ceph-mon[18656]: pgmap v815: 97 pgs: 97 active+clean; 7.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 KiB/s wr, 27 op/s 2024-08-20T01:52:57.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:56 smithi081 ceph-mon[22209]: pgmap v815: 97 pgs: 97 active+clean; 7.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 KiB/s wr, 27 op/s 2024-08-20T01:52:57.066 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T01:52:57.370 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:52:57.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.877+0000 7fa7ab39e640 1 -- 172.21.15.79:0/1451915702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7a4101800 msgr2=0x7fa7a4101be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:57.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.877+0000 7fa7ab39e640 1 --2- 172.21.15.79:0/1451915702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7a4101800 0x7fa7a4101be0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0009860 tx=0x7fa7a002a340 comp rx=0 tx=0).stop 2024-08-20T01:52:57.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.877+0000 7fa7ab39e640 1 -- 172.21.15.79:0/1451915702 shutdown_connections 2024-08-20T01:52:57.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.877+0000 7fa7ab39e640 1 --2- 172.21.15.79:0/1451915702 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7a4107b90 0x7fa7a410e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.877+0000 7fa7ab39e640 1 --2- 172.21.15.79:0/1451915702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7a4107210 0x7fa7a4107650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.877+0000 7fa7ab39e640 1 --2- 172.21.15.79:0/1451915702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7a4101800 0x7fa7a4101be0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.877+0000 7fa7ab39e640 1 -- 172.21.15.79:0/1451915702 >> 172.21.15.79:0/1451915702 conn(0x7fa7a40fd2d0 msgr2=0x7fa7a40ff6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:57.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.877+0000 7fa7ab39e640 1 -- 172.21.15.79:0/1451915702 shutdown_connections 2024-08-20T01:52:57.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.877+0000 7fa7ab39e640 1 -- 172.21.15.79:0/1451915702 wait complete. 2024-08-20T01:52:57.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.878+0000 7fa7ab39e640 1 Processor -- start 2024-08-20T01:52:57.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.878+0000 7fa7ab39e640 1 -- start start 2024-08-20T01:52:57.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.878+0000 7fa7ab39e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7a4101800 0x7fa7a4198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:57.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.878+0000 7fa7ab39e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7a4107210 0x7fa7a4199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:57.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.878+0000 7fa7ab39e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7a4107b90 0x7fa7a419e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:57.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.878+0000 7fa7ab39e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a4111700 con 0x7fa7a4107210 2024-08-20T01:52:57.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.878+0000 7fa7ab39e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a4111580 con 0x7fa7a4101800 2024-08-20T01:52:57.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.878+0000 7fa7ab39e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a4111880 con 0x7fa7a4107b90 2024-08-20T01:52:57.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.878+0000 7fa7a9b9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7a4107210 0x7fa7a4199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:57.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.878+0000 7fa7a9b9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7a4107210 0x7fa7a4199230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43152/0 (socket says 172.21.15.79:43152) 2024-08-20T01:52:57.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.878+0000 7fa7a9b9b640 1 -- 172.21.15.79:0/1021467822 learned_addr learned my addr 172.21.15.79:0/1021467822 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:57.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.878+0000 7fa7aa39c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7a4101800 0x7fa7a4198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:57.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.878+0000 7fa7aab9d640 1 --2- 172.21.15.79:0/1021467822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7a4107b90 0x7fa7a419e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:57.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.879+0000 7fa7a9b9b640 1 -- 172.21.15.79:0/1021467822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7a4107b90 msgr2=0x7fa7a419e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:57.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.879+0000 7fa7a9b9b640 1 --2- 172.21.15.79:0/1021467822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7a4107b90 0x7fa7a419e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.879+0000 7fa7a9b9b640 1 -- 172.21.15.79:0/1021467822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7a4101800 msgr2=0x7fa7a4198cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:57.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.879+0000 7fa7a9b9b640 1 --2- 172.21.15.79:0/1021467822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7a4101800 0x7fa7a4198cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.879+0000 7fa7a9b9b640 1 -- 172.21.15.79:0/1021467822 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7a419eda0 con 0x7fa7a4107210 2024-08-20T01:52:57.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.879+0000 7fa7aa39c640 1 --2- 172.21.15.79:0/1021467822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7a4101800 0x7fa7a4198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:52:57.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.879+0000 7fa7aab9d640 1 --2- 172.21.15.79:0/1021467822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7a4107b90 0x7fa7a419e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:52:57.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.879+0000 7fa7a9b9b640 1 --2- 172.21.15.79:0/1021467822 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7a4107210 0x7fa7a4199230 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fa79400e9f0 tx=0x7fa79400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:57.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.879+0000 7fa79b7fe640 1 -- 172.21.15.79:0/1021467822 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79400cd80 con 0x7fa7a4107210 2024-08-20T01:52:57.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.879+0000 7fa7ab39e640 1 -- 172.21.15.79:0/1021467822 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7a419f090 con 0x7fa7a4107210 2024-08-20T01:52:57.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.879+0000 7fa79b7fe640 1 -- 172.21.15.79:0/1021467822 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa7940054b0 con 0x7fa7a4107210 2024-08-20T01:52:57.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.879+0000 7fa79b7fe640 1 -- 172.21.15.79:0/1021467822 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa794010430 con 0x7fa7a4107210 2024-08-20T01:52:57.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.879+0000 7fa7ab39e640 1 -- 172.21.15.79:0/1021467822 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7a41a5750 con 0x7fa7a4107210 2024-08-20T01:52:57.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.882+0000 7fa7ae9f9740 1 Processor -- start 2024-08-20T01:52:57.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.882+0000 7fa7ae9f9740 1 -- start start 2024-08-20T01:52:57.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.882+0000 7fa79b7fe640 1 -- 172.21.15.79:0/1021467822 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa7940046c0 con 0x7fa7a4107210 2024-08-20T01:52:57.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.882+0000 7fa7ae9f9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561947717a30 0x561947717e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:57.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.882+0000 7fa7ae9f9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561947718350 0x561947723da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:57.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.882+0000 7fa7ae9f9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619477242e0 0x5619477266d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:57.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.882+0000 7fa7ae9f9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56194768e930 con 0x5619477242e0 2024-08-20T01:52:57.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.882+0000 7fa7ae9f9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56194767de30 con 0x561947717a30 2024-08-20T01:52:57.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.882+0000 7fa7ae9f9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561947681e70 con 0x561947718350 2024-08-20T01:52:57.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.882+0000 7fa7a9b9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619477242e0 0x5619477266d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:57.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.882+0000 7fa7a9b9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619477242e0 0x5619477266d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43154/0 (socket says 172.21.15.79:43154) 2024-08-20T01:52:57.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.882+0000 7fa7a9b9b640 1 -- 172.21.15.79:0/3153063307 learned_addr learned my addr 172.21.15.79:0/3153063307 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:57.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.882+0000 7fa7aab9d640 1 --2- 172.21.15.79:0/3153063307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561947717a30 0x561947717e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:57.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.883+0000 7fa7aa39c640 1 --2- 172.21.15.79:0/3153063307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561947718350 0x561947723da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:57.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.883+0000 7fa7aab9d640 1 -- 172.21.15.79:0/3153063307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561947718350 msgr2=0x561947723da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:57.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.883+0000 7fa7aab9d640 1 --2- 172.21.15.79:0/3153063307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561947718350 0x561947723da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.883+0000 7fa7aab9d640 1 -- 172.21.15.79:0/3153063307 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619477242e0 msgr2=0x5619477266d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:57.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.883+0000 7fa7aab9d640 1 --2- 172.21.15.79:0/3153063307 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619477242e0 0x5619477266d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.883+0000 7fa7aab9d640 1 -- 172.21.15.79:0/3153063307 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619473dd650 con 0x561947717a30 2024-08-20T01:52:57.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.883+0000 7fa7a9b9b640 1 --2- 172.21.15.79:0/3153063307 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619477242e0 0x5619477266d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:52:57.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.883+0000 7fa7aab9d640 1 --2- 172.21.15.79:0/3153063307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561947717a30 0x561947717e10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa79c009fc0 tx=0x7fa79c00eb70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0b2b16d84751497 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:57.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.883+0000 7fa798ff9640 1 -- 172.21.15.79:0/3153063307 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79c01d070 con 0x561947717a30 2024-08-20T01:52:57.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.883+0000 7fa79b7fe640 1 --2- 172.21.15.79:0/1021467822 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa7900b3c70 0x7fa7900b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:57.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.883+0000 7fa798ff9640 1 -- 172.21.15.79:0/3153063307 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa79c003e00 con 0x561947717a30 2024-08-20T01:52:57.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.883+0000 7fa798ff9640 1 -- 172.21.15.79:0/3153063307 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79c004600 con 0x561947717a30 2024-08-20T01:52:57.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.883+0000 7fa7aa39c640 1 --2- 172.21.15.79:0/1021467822 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa7900b3c70 0x7fa7900b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:57.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.884+0000 7fa79b7fe640 1 -- 172.21.15.79:0/1021467822 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fa7940e3f50 con 0x7fa7a4107210 2024-08-20T01:52:57.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.884+0000 7fa7ae9f9740 1 -- 172.21.15.79:0/3153063307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561947717a30 msgr2=0x561947717e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:57.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.884+0000 7fa7aa39c640 1 --2- 172.21.15.79:0/1021467822 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa7900b3c70 0x7fa7900b6130 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fa7a00057c0 tx=0x7fa7a00058b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:57.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.884+0000 7fa7ae9f9740 1 --2- 172.21.15.79:0/3153063307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561947717a30 0x561947717e10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa79c009fc0 tx=0x7fa79c00eb70 comp rx=0 tx=0).stop 2024-08-20T01:52:57.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.884+0000 7fa7ae9f9740 1 -- 172.21.15.79:0/3153063307 shutdown_connections 2024-08-20T01:52:57.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.884+0000 7fa7ae9f9740 1 --2- 172.21.15.79:0/3153063307 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619477242e0 0x5619477266d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.884+0000 7fa7ae9f9740 1 --2- 172.21.15.79:0/3153063307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561947718350 0x561947723da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.884+0000 7fa7ae9f9740 1 --2- 172.21.15.79:0/3153063307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561947717a30 0x561947717e10 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.884+0000 7fa7ae9f9740 1 -- 172.21.15.79:0/3153063307 >> 172.21.15.79:0/3153063307 conn(0x561947715860 msgr2=0x561947716a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:57.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.884+0000 7fa7ae9f9740 1 -- 172.21.15.79:0/3153063307 shutdown_connections 2024-08-20T01:52:57.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.884+0000 7fa7ae9f9740 1 -- 172.21.15.79:0/3153063307 wait complete. 2024-08-20T01:52:57.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.885+0000 7fa7ae9f9740 1 -- start start 2024-08-20T01:52:57.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.885+0000 7fa7ae9f9740 1 Processor -- start 2024-08-20T01:52:57.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.885+0000 7fa7ae9f9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561947717a30 0x561947721290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:57.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.885+0000 7fa7ae9f9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561947718350 0x5619477217d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:57.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.885+0000 7fa7ae9f9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619477242e0 0x561947721d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:57.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.885+0000 7fa7ae9f9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5619474e0700 con 0x561947717a30 2024-08-20T01:52:57.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.885+0000 7fa7ae9f9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561947604810 con 0x5619477242e0 2024-08-20T01:52:57.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.885+0000 7fa7ae9f9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561947726f90 con 0x561947718350 2024-08-20T01:52:57.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.885+0000 7fa7ae9f9740 10 client.0 _ll_register_callbacks cb 0x561947677700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:52:57.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.885+0000 7fa7aa39c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561947717a30 0x561947721290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:57.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.885+0000 7fa7aa39c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561947717a30 0x561947721290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43168/0 (socket says 172.21.15.79:43168) 2024-08-20T01:52:57.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.885+0000 7fa7aa39c640 1 -- 172.21.15.79:0/1021904413 learned_addr learned my addr 172.21.15.79:0/1021904413 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:57.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.885+0000 7fa7aab9d640 1 --2- 172.21.15.79:0/1021904413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619477242e0 0x561947721d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:57.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.885+0000 7fa7a9b9b640 1 --2- 172.21.15.79:0/1021904413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561947718350 0x5619477217d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:57.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.886+0000 7fa7aab9d640 1 -- 172.21.15.79:0/1021904413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561947718350 msgr2=0x5619477217d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:57.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.886+0000 7fa7aab9d640 1 --2- 172.21.15.79:0/1021904413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561947718350 0x5619477217d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.886+0000 7fa7aab9d640 1 -- 172.21.15.79:0/1021904413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561947717a30 msgr2=0x561947721290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:57.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.886+0000 7fa7aab9d640 1 --2- 172.21.15.79:0/1021904413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561947717a30 0x561947721290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.886+0000 7fa7aab9d640 1 -- 172.21.15.79:0/1021904413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561947730370 con 0x5619477242e0 2024-08-20T01:52:57.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.886+0000 7fa7aa39c640 1 --2- 172.21.15.79:0/1021904413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561947717a30 0x561947721290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:52:57.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.886+0000 7fa7aab9d640 1 --2- 172.21.15.79:0/1021904413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619477242e0 0x561947721d10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa79c01a000 tx=0x7fa79c0045b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f00ed4da7b391f09 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:57.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.886+0000 7fa78dffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:52:57.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.886+0000 7fa78dffb640 1 -- 172.21.15.79:0/1021904413 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79c028060 con 0x5619477242e0 2024-08-20T01:52:57.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.886+0000 7fa78dffb640 1 -- 172.21.15.79:0/1021904413 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fa79c004a40 con 0x5619477242e0 2024-08-20T01:52:57.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.886+0000 7fa7ae9f9740 1 -- 172.21.15.79:0/1021904413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56194762d150 con 0x5619477242e0 2024-08-20T01:52:57.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.886+0000 7fa78dffb640 1 -- 172.21.15.79:0/1021904413 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fa79c01d040 con 0x5619477242e0 2024-08-20T01:52:57.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.886+0000 7fa7ae9f9740 10 client.28448 fetch_fsmap learned FSMap version 62 2024-08-20T01:52:57.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.886+0000 7fa7ae9f9740 1 -- 172.21.15.79:0/1021904413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x561947732d00 con 0x5619477242e0 2024-08-20T01:52:57.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.886+0000 7fa78dffb640 1 -- 172.21.15.79:0/1021904413 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56194762d150 con 0x5619477242e0 2024-08-20T01:52:57.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.887+0000 7fa78dffb640 1 -- 172.21.15.79:0/1021904413 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 62) ==== 8406+0+0 (secure 0 0 0) 0x7fa79c00b040 con 0x5619477242e0 2024-08-20T01:52:57.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.887+0000 7fa7ae9f9740 10 client.28448 fetch_fsmap finished waiting for FSMap version 62 2024-08-20T01:52:57.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.887+0000 7fa7ae9f9740 10 client.28448 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:52:57.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.887+0000 7fa7ae9f9740 20 client.28448 populate_metadata read hostname 'smithi079' 2024-08-20T01:52:57.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.887+0000 7fa7ae9f9740 1 --2- 172.21.15.79:0/1021904413 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x561947734160 0x561947736550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:57.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.887+0000 7fa7ae9f9740 4 client.28448 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:52:57.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.887+0000 7fa7ae9f9740 1 -- 172.21.15.79:0/1021904413 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561947690880 con 0x561947734160 2024-08-20T01:52:57.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.887+0000 7fa7aa39c640 1 --2- 172.21.15.79:0/1021904413 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x561947734160 0x561947736550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:57.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.887+0000 7fa78dffb640 10 client.28448 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:52:57.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.887+0000 7fa7aa39c640 1 --2- 172.21.15.79:0/1021904413 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x561947734160 0x561947736550 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9882c04ffe36ef1b server_cookie=34b827f379ade043 in_seq=0 out_seq=0 2024-08-20T01:52:57.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.888+0000 7fa78dffb640 1 -- 172.21.15.79:0/1021904413 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561947690880 con 0x561947734160 2024-08-20T01:52:57.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.888+0000 7fa78dffb640 10 client.28448 handle_command_reply: tid=0 2024-08-20T01:52:57.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.888+0000 7fa7ae9f9740 1 client.28448 shutdown 2024-08-20T01:52:57.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.888+0000 7fa7ae9f9740 1 -- 172.21.15.79:0/1021904413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619477242e0 msgr2=0x561947721d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:57.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.888+0000 7fa7ae9f9740 1 --2- 172.21.15.79:0/1021904413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619477242e0 0x561947721d10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa79c01a000 tx=0x7fa79c0045b0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.888+0000 7fa7ae9f9740 1 -- 172.21.15.79:0/1021904413 shutdown_connections 2024-08-20T01:52:57.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.888+0000 7fa7ae9f9740 1 --2- 172.21.15.79:0/1021904413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619477242e0 0x561947721d10 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.888+0000 7fa7ae9f9740 1 --2- 172.21.15.79:0/1021904413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561947718350 0x5619477217d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.888+0000 7fa7ae9f9740 1 --2- 172.21.15.79:0/1021904413 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x561947734160 0x561947736550 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.889+0000 7fa7ae9f9740 1 --2- 172.21.15.79:0/1021904413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561947717a30 0x561947721290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.889+0000 7fa78dffb640 0 client.28448 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:52:57.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.889+0000 7fa7ae9f9740 1 -- 172.21.15.79:0/1021904413 >> 172.21.15.79:0/1021904413 conn(0x561947715860 msgr2=0x56194771b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:57.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.889+0000 7fa7ae9f9740 1 -- 172.21.15.79:0/1021904413 shutdown_connections 2024-08-20T01:52:57.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.889+0000 7fa7ae9f9740 1 -- 172.21.15.79:0/1021904413 wait complete. 2024-08-20T01:52:57.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.889+0000 7fa7ae9f9740 20 client.28448 trim_cache size 0 max 16384 2024-08-20T01:52:57.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.916+0000 7fa7ae9f9740 1 Processor -- start 2024-08-20T01:52:57.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.916+0000 7fa7ae9f9740 1 -- start start 2024-08-20T01:52:57.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.916+0000 7fa7ae9f9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561947717a30 0x561947716e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:57.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.916+0000 7fa7ae9f9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561947718350 0x56194773bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:57.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.916+0000 7fa7ae9f9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619477242e0 0x56194773c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:57.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.916+0000 7fa7ae9f9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a41adda0 con 0x561947718350 2024-08-20T01:52:57.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.916+0000 7fa7ae9f9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a41afa90 con 0x5619477242e0 2024-08-20T01:52:57.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.916+0000 7fa7ae9f9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a41ae4a0 con 0x561947717a30 2024-08-20T01:52:57.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.916+0000 7fa7a9b9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561947718350 0x56194773bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:57.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.916+0000 7fa7a9b9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561947718350 0x56194773bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43184/0 (socket says 172.21.15.79:43184) 2024-08-20T01:52:57.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.916+0000 7fa7a9b9b640 1 -- 172.21.15.79:0/1753873528 learned_addr learned my addr 172.21.15.79:0/1753873528 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:57.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.916+0000 7fa7aab9d640 1 --2- 172.21.15.79:0/1753873528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619477242e0 0x56194773c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:57.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.917+0000 7fa7aa39c640 1 --2- 172.21.15.79:0/1753873528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561947717a30 0x561947716e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:57.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.917+0000 7fa7a9b9b640 1 -- 172.21.15.79:0/1753873528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561947717a30 msgr2=0x561947716e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:57.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.917+0000 7fa7a9b9b640 1 --2- 172.21.15.79:0/1753873528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561947717a30 0x561947716e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.917+0000 7fa7a9b9b640 1 -- 172.21.15.79:0/1753873528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619477242e0 msgr2=0x56194773c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:57.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.917+0000 7fa7a9b9b640 1 --2- 172.21.15.79:0/1753873528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619477242e0 0x56194773c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.917+0000 7fa7a9b9b640 1 -- 172.21.15.79:0/1753873528 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561947718180 con 0x561947718350 2024-08-20T01:52:57.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.917+0000 7fa7aab9d640 1 --2- 172.21.15.79:0/1753873528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619477242e0 0x56194773c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:52:57.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.917+0000 7fa7a9b9b640 1 --2- 172.21.15.79:0/1753873528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561947718350 0x56194773bb80 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fa7940e1ab0 tx=0x7fa7940e7720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7451e9810a2c41d9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:57.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.917+0000 7fa78ffff640 1 -- 172.21.15.79:0/1753873528 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7940aac80 con 0x561947718350 2024-08-20T01:52:57.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.917+0000 7fa78ffff640 1 -- 172.21.15.79:0/1753873528 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa7940aa9c0 con 0x561947718350 2024-08-20T01:52:57.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.917+0000 7fa78ffff640 1 -- 172.21.15.79:0/1753873528 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7940aa620 con 0x561947718350 2024-08-20T01:52:57.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.918+0000 7fa7ae9f9740 1 -- 172.21.15.79:0/1753873528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561947718350 msgr2=0x56194773bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:57.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.918+0000 7fa7ae9f9740 1 --2- 172.21.15.79:0/1753873528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561947718350 0x56194773bb80 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fa7940e1ab0 tx=0x7fa7940e7720 comp rx=0 tx=0).stop 2024-08-20T01:52:57.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.918+0000 7fa7ae9f9740 1 -- 172.21.15.79:0/1753873528 shutdown_connections 2024-08-20T01:52:57.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.918+0000 7fa7ae9f9740 1 --2- 172.21.15.79:0/1753873528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619477242e0 0x56194773c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.918+0000 7fa7ae9f9740 1 --2- 172.21.15.79:0/1753873528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561947718350 0x56194773bb80 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.918+0000 7fa7ae9f9740 1 --2- 172.21.15.79:0/1753873528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561947717a30 0x561947716e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.918+0000 7fa7ae9f9740 1 -- 172.21.15.79:0/1753873528 >> 172.21.15.79:0/1753873528 conn(0x561947715860 msgr2=0x561947716770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:57.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.918+0000 7fa7ae9f9740 1 -- 172.21.15.79:0/1753873528 shutdown_connections 2024-08-20T01:52:57.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.918+0000 7fa7ae9f9740 1 -- 172.21.15.79:0/1753873528 wait complete. 2024-08-20T01:52:57.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.918+0000 7fa7ae9f9740 1 -- start start 2024-08-20T01:52:57.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.918+0000 7fa7ae9f9740 1 Processor -- start 2024-08-20T01:52:57.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.919+0000 7fa7ae9f9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561947717a30 0x561947796cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:57.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.919+0000 7fa7ae9f9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561947718350 0x561947797290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:57.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.919+0000 7fa7ae9f9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619477242e0 0x56194772bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:57.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.919+0000 7fa7ae9f9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a41af300 con 0x5619477242e0 2024-08-20T01:52:57.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.919+0000 7fa7ae9f9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a41aec00 con 0x561947717a30 2024-08-20T01:52:57.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.919+0000 7fa7ae9f9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a41abd80 con 0x561947718350 2024-08-20T01:52:57.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.919+0000 7fa7ae9f9740 10 client.0 _ll_register_callbacks cb 0x7fa79c01b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:52:57.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.919+0000 7fa7aa39c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561947717a30 0x561947796cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:57.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.919+0000 7fa7aab9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619477242e0 0x56194772bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:57.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.919+0000 7fa7aa39c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561947717a30 0x561947796cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:57164/0 (socket says 172.21.15.79:57164) 2024-08-20T01:52:57.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.919+0000 7fa7aa39c640 1 -- 172.21.15.79:0/4132923282 learned_addr learned my addr 172.21.15.79:0/4132923282 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:57.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.919+0000 7fa7a9b9b640 1 --2- 172.21.15.79:0/4132923282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561947718350 0x561947797290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:57.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.919+0000 7fa7aa39c640 1 -- 172.21.15.79:0/4132923282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561947718350 msgr2=0x561947797290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:57.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.919+0000 7fa7aa39c640 1 --2- 172.21.15.79:0/4132923282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561947718350 0x561947797290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.919+0000 7fa7aa39c640 1 -- 172.21.15.79:0/4132923282 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619477242e0 msgr2=0x56194772bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:57.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.919+0000 7fa7aa39c640 1 --2- 172.21.15.79:0/4132923282 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619477242e0 0x56194772bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.919+0000 7fa7aa39c640 1 -- 172.21.15.79:0/4132923282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56194772c680 con 0x561947717a30 2024-08-20T01:52:57.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.919+0000 7fa7aab9d640 1 --2- 172.21.15.79:0/4132923282 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619477242e0 0x56194772bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:52:57.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.919+0000 7fa7aa39c640 1 --2- 172.21.15.79:0/4132923282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561947717a30 0x561947796cf0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0009860 tx=0x7fa7a0005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9b8015eb7e782b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:57.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.919+0000 7fa78dffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:52:57.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.920+0000 7fa78dffb640 1 -- 172.21.15.79:0/4132923282 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a005b060 con 0x561947717a30 2024-08-20T01:52:57.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.920+0000 7fa78dffb640 1 -- 172.21.15.79:0/4132923282 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fa7a0032b70 con 0x561947717a30 2024-08-20T01:52:57.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.920+0000 7fa7ae9f9740 1 -- 172.21.15.79:0/4132923282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7940aa9c0 con 0x561947717a30 2024-08-20T01:52:57.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.920+0000 7fa78dffb640 1 -- 172.21.15.79:0/4132923282 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fa7a0037040 con 0x561947717a30 2024-08-20T01:52:57.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.920+0000 7fa7ae9f9740 10 client.28454 fetch_fsmap learned FSMap version 62 2024-08-20T01:52:57.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.920+0000 7fa7ae9f9740 1 -- 172.21.15.79:0/4132923282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x56194779e710 con 0x561947717a30 2024-08-20T01:52:57.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.920+0000 7fa78dffb640 1 -- 172.21.15.79:0/4132923282 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa7940aa9c0 con 0x561947717a30 2024-08-20T01:52:57.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.920+0000 7fa78dffb640 1 -- 172.21.15.79:0/4132923282 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 62) ==== 8406+0+0 (secure 0 0 0) 0x7fa7a004b040 con 0x561947717a30 2024-08-20T01:52:57.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.920+0000 7fa7ae9f9740 10 client.28454 fetch_fsmap finished waiting for FSMap version 62 2024-08-20T01:52:57.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.920+0000 7fa7ae9f9740 10 client.28454 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:52:57.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.920+0000 7fa7ae9f9740 20 client.28454 populate_metadata read hostname 'smithi079' 2024-08-20T01:52:57.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.920+0000 7fa7ae9f9740 1 --2- 172.21.15.79:0/4132923282 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x56194779ef00 0x5619477a1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:57.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.920+0000 7fa7ae9f9740 4 client.28454 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:52:57.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.920+0000 7fa7ae9f9740 1 -- 172.21.15.79:0/4132923282 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56194768c320 con 0x56194779ef00 2024-08-20T01:52:57.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.920+0000 7fa7a9b9b640 1 --2- 172.21.15.79:0/4132923282 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x56194779ef00 0x5619477a1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:57.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.921+0000 7fa78dffb640 10 client.28454 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:52:57.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.921+0000 7fa7a9b9b640 1 --2- 172.21.15.79:0/4132923282 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x56194779ef00 0x5619477a1320 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=373823c8308aad66 server_cookie=528f68af40076c84 in_seq=0 out_seq=0 2024-08-20T01:52:57.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.921+0000 7fa78dffb640 1 -- 172.21.15.79:0/4132923282 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56194768c320 con 0x56194779ef00 2024-08-20T01:52:57.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.921+0000 7fa78dffb640 10 client.28454 handle_command_reply: tid=0 2024-08-20T01:52:57.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.921+0000 7fa7ae9f9740 1 client.28454 shutdown 2024-08-20T01:52:57.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.921+0000 7fa7ae9f9740 1 -- 172.21.15.79:0/4132923282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561947717a30 msgr2=0x561947796cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:57.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.921+0000 7fa7ae9f9740 1 --2- 172.21.15.79:0/4132923282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561947717a30 0x561947796cf0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0009860 tx=0x7fa7a0005f90 comp rx=0 tx=0).stop 2024-08-20T01:52:57.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.921+0000 7fa7ae9f9740 1 -- 172.21.15.79:0/4132923282 shutdown_connections 2024-08-20T01:52:57.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.921+0000 7fa7ae9f9740 1 --2- 172.21.15.79:0/4132923282 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x56194779ef00 0x5619477a1320 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.921+0000 7fa7ae9f9740 1 --2- 172.21.15.79:0/4132923282 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619477242e0 0x56194772bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.921+0000 7fa7ae9f9740 1 --2- 172.21.15.79:0/4132923282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561947718350 0x561947797290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.921+0000 7fa78dffb640 0 client.28454 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:52:57.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.921+0000 7fa7ae9f9740 1 --2- 172.21.15.79:0/4132923282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561947717a30 0x561947796cf0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.921+0000 7fa7ae9f9740 1 -- 172.21.15.79:0/4132923282 >> 172.21.15.79:0/4132923282 conn(0x561947715860 msgr2=0x561947716e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:57.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.921+0000 7fa7ae9f9740 1 -- 172.21.15.79:0/4132923282 shutdown_connections 2024-08-20T01:52:57.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.921+0000 7fa7ae9f9740 1 -- 172.21.15.79:0/4132923282 wait complete. 2024-08-20T01:52:57.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.921+0000 7fa7ae9f9740 20 client.28454 trim_cache size 0 max 16384 2024-08-20T01:52:57.931 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:52:57.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.922+0000 7fa7ab39e640 1 -- 172.21.15.79:0/1021467822 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa7900b3c70 msgr2=0x7fa7900b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:57.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.922+0000 7fa7ab39e640 1 --2- 172.21.15.79:0/1021467822 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa7900b3c70 0x7fa7900b6130 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fa7a00057c0 tx=0x7fa7a00058b0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.922+0000 7fa7ab39e640 1 -- 172.21.15.79:0/1021467822 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7a4107210 msgr2=0x7fa7a4199230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:57.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.922+0000 7fa7ab39e640 1 --2- 172.21.15.79:0/1021467822 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7a4107210 0x7fa7a4199230 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fa79400e9f0 tx=0x7fa79400edf0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.922+0000 7fa7ab39e640 1 -- 172.21.15.79:0/1021467822 shutdown_connections 2024-08-20T01:52:57.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.922+0000 7fa7ab39e640 1 --2- 172.21.15.79:0/1021467822 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa7900b3c70 0x7fa7900b6130 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.922+0000 7fa7ab39e640 1 --2- 172.21.15.79:0/1021467822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7a4107b90 0x7fa7a419e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.922+0000 7fa7ab39e640 1 --2- 172.21.15.79:0/1021467822 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7a4107210 0x7fa7a4199230 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.922+0000 7fa7ab39e640 1 --2- 172.21.15.79:0/1021467822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7a4101800 0x7fa7a4198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.922+0000 7fa7ab39e640 1 -- 172.21.15.79:0/1021467822 >> 172.21.15.79:0/1021467822 conn(0x7fa7a40fd2d0 msgr2=0x7fa7a406aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:57.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.922+0000 7fa7ab39e640 1 -- 172.21.15.79:0/1021467822 shutdown_connections 2024-08-20T01:52:57.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:57.922+0000 7fa7ab39e640 1 -- 172.21.15.79:0/1021467822 wait complete. 2024-08-20T01:52:57.966 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.960+0000 7f329af43640 1 -- 172.21.15.79:0/1236633540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3294101560 msgr2=0x7f3294101960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:57.966 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.960+0000 7f329af43640 1 --2- 172.21.15.79:0/1236633540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3294101560 0x7f3294101960 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f3288009930 tx=0x7f328802a420 comp rx=0 tx=0).stop 2024-08-20T01:52:57.966 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.961+0000 7f329af43640 1 -- 172.21.15.79:0/1236633540 shutdown_connections 2024-08-20T01:52:57.966 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.961+0000 7f329af43640 1 --2- 172.21.15.79:0/1236633540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3294103070 0x7f32941099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.966 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.961+0000 7f329af43640 1 --2- 172.21.15.79:0/1236633540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32941026b0 0x7f3294102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.966 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.961+0000 7f329af43640 1 --2- 172.21.15.79:0/1236633540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3294101560 0x7f3294101960 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.966 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.961+0000 7f329af43640 1 -- 172.21.15.79:0/1236633540 >> 172.21.15.79:0/1236633540 conn(0x7f32940fce40 msgr2=0x7f32940ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:57.966 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.961+0000 7f329af43640 1 -- 172.21.15.79:0/1236633540 shutdown_connections 2024-08-20T01:52:57.966 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.961+0000 7f329af43640 1 -- 172.21.15.79:0/1236633540 wait complete. 2024-08-20T01:52:57.966 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.961+0000 7f329af43640 1 Processor -- start 2024-08-20T01:52:57.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.961+0000 7f329af43640 1 -- start start 2024-08-20T01:52:57.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.961+0000 7f329af43640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3294101560 0x7f32941989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:57.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.961+0000 7f329af43640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32941026b0 0x7f3294199020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:57.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.961+0000 7f329af43640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3294103070 0x7f3294199c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:57.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.961+0000 7f329af43640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f329410d090 con 0x7f32941026b0 2024-08-20T01:52:57.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.961+0000 7f329af43640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f329410cf10 con 0x7f3294101560 2024-08-20T01:52:57.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.961+0000 7f329af43640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f329410d210 con 0x7f3294103070 2024-08-20T01:52:57.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.961+0000 7f3293fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32941026b0 0x7f3294199020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:57.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.962+0000 7f3293fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32941026b0 0x7f3294199020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43230/0 (socket says 172.21.15.79:43230) 2024-08-20T01:52:57.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.962+0000 7f32994e0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3294103070 0x7f3294199c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:57.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.962+0000 7f3293fff640 1 -- 172.21.15.79:0/2714986325 learned_addr learned my addr 172.21.15.79:0/2714986325 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:57.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.962+0000 7f3298cdf640 1 --2- 172.21.15.79:0/2714986325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3294101560 0x7f32941989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:57.968 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.962+0000 7f3293fff640 1 -- 172.21.15.79:0/2714986325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3294103070 msgr2=0x7f3294199c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:57.968 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.962+0000 7f3293fff640 1 --2- 172.21.15.79:0/2714986325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3294103070 0x7f3294199c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.968 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.962+0000 7f3293fff640 1 -- 172.21.15.79:0/2714986325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3294101560 msgr2=0x7f32941989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:57.968 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.962+0000 7f3293fff640 1 --2- 172.21.15.79:0/2714986325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3294101560 0x7f32941989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.968 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.962+0000 7f3293fff640 1 -- 172.21.15.79:0/2714986325 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f329419a510 con 0x7f32941026b0 2024-08-20T01:52:57.968 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.962+0000 7f32994e0640 1 --2- 172.21.15.79:0/2714986325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3294103070 0x7f3294199c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:52:57.968 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.962+0000 7f3293fff640 1 --2- 172.21.15.79:0/2714986325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32941026b0 0x7f3294199020 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f328000e9f0 tx=0x7f328000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:57.968 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.962+0000 7f3291ffb640 1 -- 172.21.15.79:0/2714986325 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328000cd80 con 0x7f32941026b0 2024-08-20T01:52:57.968 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.962+0000 7f3291ffb640 1 -- 172.21.15.79:0/2714986325 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f32800108c0 con 0x7f32941026b0 2024-08-20T01:52:57.968 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.962+0000 7f329af43640 1 -- 172.21.15.79:0/2714986325 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f329419a800 con 0x7f32941026b0 2024-08-20T01:52:57.968 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.962+0000 7f3291ffb640 1 -- 172.21.15.79:0/2714986325 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32800187c0 con 0x7f32941026b0 2024-08-20T01:52:57.969 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.962+0000 7f329af43640 1 -- 172.21.15.79:0/2714986325 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32941a0ed0 con 0x7f32941026b0 2024-08-20T01:52:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.965+0000 7f3291ffb640 1 -- 172.21.15.79:0/2714986325 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3280010430 con 0x7f32941026b0 2024-08-20T01:52:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.965+0000 7f329de09740 1 Processor -- start 2024-08-20T01:52:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.965+0000 7f329de09740 1 -- start start 2024-08-20T01:52:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.965+0000 7f329de09740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2ed2a18d0 0x55c2ed2a3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.965+0000 7f329de09740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2ed2a4200 0x55c2ed2a65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.965+0000 7f329de09740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2ed2a6c40 0x55c2ed2a9100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.965+0000 7f329de09740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c2ed214360 con 0x55c2ed2a6c40 2024-08-20T01:52:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.965+0000 7f329de09740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c2ed203860 con 0x55c2ed2a18d0 2024-08-20T01:52:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.965+0000 7f329de09740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c2ed2078a0 con 0x55c2ed2a4200 2024-08-20T01:52:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.965+0000 7f3293fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2ed2a6c40 0x55c2ed2a9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.965+0000 7f3293fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2ed2a6c40 0x55c2ed2a9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43236/0 (socket says 172.21.15.79:43236) 2024-08-20T01:52:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.965+0000 7f3293fff640 1 -- 172.21.15.79:0/4001744344 learned_addr learned my addr 172.21.15.79:0/4001744344 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.966+0000 7f3298cdf640 1 --2- 172.21.15.79:0/4001744344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2ed2a4200 0x55c2ed2a65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.966+0000 7f32994e0640 1 --2- 172.21.15.79:0/4001744344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2ed2a18d0 0x55c2ed2a3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.966+0000 7f3293fff640 1 -- 172.21.15.79:0/4001744344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2ed2a4200 msgr2=0x55c2ed2a65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.966+0000 7f3293fff640 1 --2- 172.21.15.79:0/4001744344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2ed2a4200 0x55c2ed2a65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.966+0000 7f3293fff640 1 -- 172.21.15.79:0/4001744344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2ed2a18d0 msgr2=0x55c2ed2a3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.966+0000 7f3293fff640 1 --2- 172.21.15.79:0/4001744344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2ed2a18d0 0x55c2ed2a3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.966+0000 7f3293fff640 1 -- 172.21.15.79:0/4001744344 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2ed1aae40 con 0x55c2ed2a6c40 2024-08-20T01:52:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.966+0000 7f3298cdf640 1 --2- 172.21.15.79:0/4001744344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2ed2a4200 0x55c2ed2a65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:52:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.966+0000 7f3293fff640 1 --2- 172.21.15.79:0/4001744344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2ed2a6c40 0x55c2ed2a9100 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f32800ec160 tx=0x7f32800ec620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28a4aaea030fd2a1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.966+0000 7f3291ffb640 1 --2- 172.21.15.79:0/2714986325 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f32840b3bd0 0x7f32840b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.966+0000 7f327effd640 1 -- 172.21.15.79:0/4001744344 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32800f7070 con 0x55c2ed2a6c40 2024-08-20T01:52:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.966+0000 7f32994e0640 1 --2- 172.21.15.79:0/2714986325 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f32840b3bd0 0x7f32840b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.966+0000 7f327effd640 1 -- 172.21.15.79:0/4001744344 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f32800ece50 con 0x55c2ed2a6c40 2024-08-20T01:52:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.966+0000 7f327effd640 1 -- 172.21.15.79:0/4001744344 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32800aa8c0 con 0x55c2ed2a6c40 2024-08-20T01:52:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.966+0000 7f3291ffb640 1 -- 172.21.15.79:0/2714986325 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f32800e3f60 con 0x7f32941026b0 2024-08-20T01:52:57.978 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.967+0000 7f32994e0640 1 --2- 172.21.15.79:0/2714986325 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f32840b3bd0 0x7f32840b6090 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f328c009fd0 tx=0x7f328c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:57.978 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.967+0000 7f329de09740 1 -- 172.21.15.79:0/4001744344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2ed2a6c40 msgr2=0x55c2ed2a9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:57.978 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.967+0000 7f329de09740 1 --2- 172.21.15.79:0/4001744344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2ed2a6c40 0x55c2ed2a9100 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f32800ec160 tx=0x7f32800ec620 comp rx=0 tx=0).stop 2024-08-20T01:52:57.978 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.967+0000 7f329de09740 1 -- 172.21.15.79:0/4001744344 shutdown_connections 2024-08-20T01:52:57.978 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.967+0000 7f329de09740 1 --2- 172.21.15.79:0/4001744344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2ed2a6c40 0x55c2ed2a9100 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.978 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.967+0000 7f329de09740 1 --2- 172.21.15.79:0/4001744344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2ed2a4200 0x55c2ed2a65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.978 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.967+0000 7f329de09740 1 --2- 172.21.15.79:0/4001744344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2ed2a18d0 0x55c2ed2a3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.978 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.967+0000 7f329de09740 1 -- 172.21.15.79:0/4001744344 >> 172.21.15.79:0/4001744344 conn(0x55c2ed29ca20 msgr2=0x55c2ed29d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:57.978 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.967+0000 7f329de09740 1 -- 172.21.15.79:0/4001744344 shutdown_connections 2024-08-20T01:52:57.978 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.967+0000 7f329de09740 1 -- 172.21.15.79:0/4001744344 wait complete. 2024-08-20T01:52:57.978 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.967+0000 7f329de09740 1 -- start start 2024-08-20T01:52:57.978 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.967+0000 7f329de09740 1 Processor -- start 2024-08-20T01:52:57.978 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.968+0000 7f329de09740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2ed2a18d0 0x55c2ed2ab070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.968+0000 7f329de09740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2ed2a4200 0x55c2ed2ab710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.968+0000 7f329de09740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2ed2a6c40 0x55c2ed2ac2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.968+0000 7f329de09740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c2ed13cab0 con 0x55c2ed2a18d0 2024-08-20T01:52:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.968+0000 7f329de09740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c2ed18a780 con 0x55c2ed2a6c40 2024-08-20T01:52:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.968+0000 7f329de09740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c2ed2a9c20 con 0x55c2ed2a4200 2024-08-20T01:52:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.968+0000 7f329de09740 10 client.0 _ll_register_callbacks cb 0x55c2ecf12a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:52:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.968+0000 7f3298cdf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2ed2a18d0 0x55c2ed2ab070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.968+0000 7f3298cdf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2ed2a18d0 0x55c2ed2ab070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43248/0 (socket says 172.21.15.79:43248) 2024-08-20T01:52:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.968+0000 7f3298cdf640 1 -- 172.21.15.79:0/2691404134 learned_addr learned my addr 172.21.15.79:0/2691404134 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.968+0000 7f32994e0640 1 --2- 172.21.15.79:0/2691404134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2ed2a6c40 0x55c2ed2ac2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.968+0000 7f3293fff640 1 --2- 172.21.15.79:0/2691404134 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2ed2a4200 0x55c2ed2ab710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.968+0000 7f3298cdf640 1 -- 172.21.15.79:0/2691404134 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2ed2a4200 msgr2=0x55c2ed2ab710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.968+0000 7f3298cdf640 1 --2- 172.21.15.79:0/2691404134 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2ed2a4200 0x55c2ed2ab710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.980 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.968+0000 7f3298cdf640 1 -- 172.21.15.79:0/2691404134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2ed2a6c40 msgr2=0x55c2ed2ac2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:57.980 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.968+0000 7f3298cdf640 1 --2- 172.21.15.79:0/2691404134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2ed2a6c40 0x55c2ed2ac2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.980 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.968+0000 7f3298cdf640 1 -- 172.21.15.79:0/2691404134 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2ecf66790 con 0x55c2ed2a18d0 2024-08-20T01:52:57.980 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.968+0000 7f3298cdf640 1 --2- 172.21.15.79:0/2691404134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2ed2a18d0 0x55c2ed2ab070 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f3288009230 tx=0x7f32880317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38c0be4c8918e520 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:57.980 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.968+0000 7f3273fff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:52:57.980 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.969+0000 7f3273fff640 1 -- 172.21.15.79:0/2691404134 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3288035070 con 0x55c2ed2a18d0 2024-08-20T01:52:57.980 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.969+0000 7f3273fff640 1 -- 172.21.15.79:0/2691404134 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f3288004240 con 0x55c2ed2a18d0 2024-08-20T01:52:57.980 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.969+0000 7f329de09740 1 -- 172.21.15.79:0/2691404134 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c2ed1b2e00 con 0x55c2ed2a18d0 2024-08-20T01:52:57.980 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.969+0000 7f3273fff640 1 -- 172.21.15.79:0/2691404134 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f3288004440 con 0x55c2ed2a18d0 2024-08-20T01:52:57.980 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.969+0000 7f329de09740 10 client.19368 fetch_fsmap learned FSMap version 62 2024-08-20T01:52:57.980 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.969+0000 7f329de09740 1 -- 172.21.15.79:0/2691404134 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55c2ecfdf620 con 0x55c2ed2a18d0 2024-08-20T01:52:57.980 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.969+0000 7f3273fff640 1 -- 172.21.15.79:0/2691404134 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55c2ed1b2e00 con 0x55c2ed2a18d0 2024-08-20T01:52:57.980 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.969+0000 7f3273fff640 1 -- 172.21.15.79:0/2691404134 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 62) ==== 8406+0+0 (secure 0 0 0) 0x7f328803b630 con 0x55c2ed2a18d0 2024-08-20T01:52:57.981 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.969+0000 7f329de09740 10 client.19368 fetch_fsmap finished waiting for FSMap version 62 2024-08-20T01:52:57.981 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.969+0000 7f329de09740 10 client.19368 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:52:57.981 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.969+0000 7f329de09740 20 client.19368 populate_metadata read hostname 'smithi079' 2024-08-20T01:52:57.981 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.969+0000 7f329de09740 1 --2- 172.21.15.79:0/2691404134 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55c2ed2b6a30 0x55c2ed2b8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:57.981 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.969+0000 7f329de09740 4 client.19368 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:52:57.981 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.969+0000 7f329de09740 1 -- 172.21.15.79:0/2691404134 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2ed2162b0 con 0x55c2ed2b6a30 2024-08-20T01:52:57.981 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.969+0000 7f3293fff640 1 --2- 172.21.15.79:0/2691404134 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55c2ed2b6a30 0x55c2ed2b8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:57.981 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.970+0000 7f3273fff640 10 client.19368 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:52:57.981 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.970+0000 7f3293fff640 1 --2- 172.21.15.79:0/2691404134 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55c2ed2b6a30 0x55c2ed2b8eb0 crc :-1 s=READY pgs=320 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c31d97ab8b2df2b4 server_cookie=194c04a9b65cb2be in_seq=0 out_seq=0 2024-08-20T01:52:57.981 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.970+0000 7f3273fff640 1 -- 172.21.15.79:0/2691404134 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c2ed2162b0 con 0x55c2ed2b6a30 2024-08-20T01:52:57.981 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.970+0000 7f3273fff640 10 client.19368 handle_command_reply: tid=0 2024-08-20T01:52:57.981 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.970+0000 7f329de09740 1 client.19368 shutdown 2024-08-20T01:52:57.981 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.971+0000 7f329de09740 1 -- 172.21.15.79:0/2691404134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2ed2a18d0 msgr2=0x55c2ed2ab070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:57.982 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.971+0000 7f329de09740 1 --2- 172.21.15.79:0/2691404134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2ed2a18d0 0x55c2ed2ab070 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f3288009230 tx=0x7f32880317b0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.982 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.971+0000 7f329de09740 1 -- 172.21.15.79:0/2691404134 shutdown_connections 2024-08-20T01:52:57.982 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.971+0000 7f329de09740 1 --2- 172.21.15.79:0/2691404134 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55c2ed2b6a30 0x55c2ed2b8eb0 crc :-1 s=READY pgs=320 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.982 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.971+0000 7f329de09740 1 --2- 172.21.15.79:0/2691404134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2ed2a6c40 0x55c2ed2ac2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.982 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.971+0000 7f3273fff640 0 client.19368 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:52:57.982 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.971+0000 7f329de09740 1 --2- 172.21.15.79:0/2691404134 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2ed2a4200 0x55c2ed2ab710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.982 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.971+0000 7f329de09740 1 --2- 172.21.15.79:0/2691404134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2ed2a18d0 0x55c2ed2ab070 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.982 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.971+0000 7f329de09740 1 -- 172.21.15.79:0/2691404134 >> 172.21.15.79:0/2691404134 conn(0x55c2ed29ca20 msgr2=0x55c2ed29bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:57.982 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.971+0000 7f329de09740 1 -- 172.21.15.79:0/2691404134 shutdown_connections 2024-08-20T01:52:57.982 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.971+0000 7f329de09740 1 -- 172.21.15.79:0/2691404134 wait complete. 2024-08-20T01:52:57.982 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.971+0000 7f329de09740 20 client.19368 trim_cache size 0 max 16384 2024-08-20T01:52:57.992 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.985+0000 7f329de09740 1 Processor -- start 2024-08-20T01:52:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.985+0000 7f329de09740 1 -- start start 2024-08-20T01:52:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.985+0000 7f329de09740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2ed2a18d0 0x55c2ed29d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.985+0000 7f329de09740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2ed2a4200 0x55c2ed2a7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.985+0000 7f329de09740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2ed2a6c40 0x55c2ed2a7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.985+0000 7f329de09740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f32941a9bb0 con 0x55c2ed2a6c40 2024-08-20T01:52:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.985+0000 7f329de09740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f32941ab8a0 con 0x55c2ed2a18d0 2024-08-20T01:52:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.985+0000 7f329de09740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f32941aa2b0 con 0x55c2ed2a4200 2024-08-20T01:52:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.985+0000 7f32994e0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2ed2a6c40 0x55c2ed2a7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.985+0000 7f32994e0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2ed2a6c40 0x55c2ed2a7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43262/0 (socket says 172.21.15.79:43262) 2024-08-20T01:52:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.985+0000 7f32994e0640 1 -- 172.21.15.79:0/2828029256 learned_addr learned my addr 172.21.15.79:0/2828029256 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.985+0000 7f3298cdf640 1 --2- 172.21.15.79:0/2828029256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2ed2a18d0 0x55c2ed29d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.986+0000 7f3293fff640 1 --2- 172.21.15.79:0/2828029256 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2ed2a4200 0x55c2ed2a7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.986+0000 7f32994e0640 1 -- 172.21.15.79:0/2828029256 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2ed2a4200 msgr2=0x55c2ed2a7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.986+0000 7f32994e0640 1 --2- 172.21.15.79:0/2828029256 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2ed2a4200 0x55c2ed2a7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.986+0000 7f32994e0640 1 -- 172.21.15.79:0/2828029256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2ed2a18d0 msgr2=0x55c2ed29d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.986+0000 7f32994e0640 1 --2- 172.21.15.79:0/2828029256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2ed2a18d0 0x55c2ed29d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.986+0000 7f32994e0640 1 -- 172.21.15.79:0/2828029256 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2ed2aa020 con 0x55c2ed2a6c40 2024-08-20T01:52:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.986+0000 7f32994e0640 1 --2- 172.21.15.79:0/2828029256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2ed2a6c40 0x55c2ed2a7560 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f328c003b00 tx=0x7f328c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da2ca476e913dfae server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.986+0000 7f327e7fc640 1 -- 172.21.15.79:0/2828029256 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328c004b20 con 0x55c2ed2a6c40 2024-08-20T01:52:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.986+0000 7f327e7fc640 1 -- 172.21.15.79:0/2828029256 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f328c004cc0 con 0x55c2ed2a6c40 2024-08-20T01:52:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.986+0000 7f327e7fc640 1 -- 172.21.15.79:0/2828029256 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328c005390 con 0x55c2ed2a6c40 2024-08-20T01:52:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.986+0000 7f329de09740 1 -- 172.21.15.79:0/2828029256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2ed2a6c40 msgr2=0x55c2ed2a7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.986+0000 7f329de09740 1 --2- 172.21.15.79:0/2828029256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2ed2a6c40 0x55c2ed2a7560 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f328c003b00 tx=0x7f328c012000 comp rx=0 tx=0).stop 2024-08-20T01:52:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.987+0000 7f329de09740 1 -- 172.21.15.79:0/2828029256 shutdown_connections 2024-08-20T01:52:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.987+0000 7f329de09740 1 --2- 172.21.15.79:0/2828029256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2ed2a6c40 0x55c2ed2a7560 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.987+0000 7f329de09740 1 --2- 172.21.15.79:0/2828029256 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2ed2a4200 0x55c2ed2a7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.987+0000 7f329de09740 1 --2- 172.21.15.79:0/2828029256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2ed2a18d0 0x55c2ed29d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.987+0000 7f329de09740 1 -- 172.21.15.79:0/2828029256 >> 172.21.15.79:0/2828029256 conn(0x55c2ed29ca20 msgr2=0x55c2ed2a8530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.987+0000 7f329de09740 1 -- 172.21.15.79:0/2828029256 shutdown_connections 2024-08-20T01:52:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.987+0000 7f329de09740 1 -- 172.21.15.79:0/2828029256 wait complete. 2024-08-20T01:52:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.987+0000 7f329de09740 1 -- start start 2024-08-20T01:52:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.987+0000 7f329de09740 1 Processor -- start 2024-08-20T01:52:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.987+0000 7f329de09740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2ed2a18d0 0x55c2ed2b2af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.987+0000 7f329de09740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2ed2a4200 0x55c2ed2b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.987+0000 7f329de09740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2ed2a6c40 0x55c2ed2b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.988+0000 7f329de09740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f32941ab110 con 0x55c2ed2a18d0 2024-08-20T01:52:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.988+0000 7f329de09740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f32941aaa10 con 0x55c2ed2a4200 2024-08-20T01:52:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.988+0000 7f329de09740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f32941a7b90 con 0x55c2ed2a6c40 2024-08-20T01:52:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.988+0000 7f3298cdf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2ed2a18d0 0x55c2ed2b2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.988+0000 7f3298cdf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2ed2a18d0 0x55c2ed2b2af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43274/0 (socket says 172.21.15.79:43274) 2024-08-20T01:52:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.988+0000 7f3298cdf640 1 -- 172.21.15.79:0/103946210 learned_addr learned my addr 172.21.15.79:0/103946210 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.988+0000 7f329de09740 10 client.0 _ll_register_callbacks cb 0x7f328c0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:52:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.988+0000 7f32994e0640 1 --2- 172.21.15.79:0/103946210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2ed2a6c40 0x55c2ed2b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.988+0000 7f3293fff640 1 --2- 172.21.15.79:0/103946210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2ed2a4200 0x55c2ed2b17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.988+0000 7f3298cdf640 1 -- 172.21.15.79:0/103946210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2ed2a6c40 msgr2=0x55c2ed2b1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.988+0000 7f3298cdf640 1 --2- 172.21.15.79:0/103946210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2ed2a6c40 0x55c2ed2b1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.988+0000 7f3298cdf640 1 -- 172.21.15.79:0/103946210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2ed2a4200 msgr2=0x55c2ed2b17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.988+0000 7f3298cdf640 1 --2- 172.21.15.79:0/103946210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2ed2a4200 0x55c2ed2b17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.988+0000 7f3298cdf640 1 -- 172.21.15.79:0/103946210 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2ed2b2560 con 0x55c2ed2a18d0 2024-08-20T01:52:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.988+0000 7f3293fff640 1 --2- 172.21.15.79:0/103946210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2ed2a4200 0x55c2ed2b17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:52:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.988+0000 7f3298cdf640 1 --2- 172.21.15.79:0/103946210 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2ed2a18d0 0x55c2ed2b2af0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f3288031a40 tx=0x7f3288005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40c817819ddf58fb server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.988+0000 7f3273fff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:52:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.988+0000 7f3273fff640 1 -- 172.21.15.79:0/103946210 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3288035040 con 0x55c2ed2a18d0 2024-08-20T01:52:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.988+0000 7f3273fff640 1 -- 172.21.15.79:0/103946210 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f32880444b0 con 0x55c2ed2a18d0 2024-08-20T01:52:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.988+0000 7f329de09740 1 -- 172.21.15.79:0/103946210 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f328c004cc0 con 0x55c2ed2a18d0 2024-08-20T01:52:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.988+0000 7f3273fff640 1 -- 172.21.15.79:0/103946210 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f3288060050 con 0x55c2ed2a18d0 2024-08-20T01:52:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.988+0000 7f329de09740 10 client.19374 fetch_fsmap learned FSMap version 62 2024-08-20T01:52:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.988+0000 7f329de09740 1 -- 172.21.15.79:0/103946210 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55c2ed321820 con 0x55c2ed2a18d0 2024-08-20T01:52:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.989+0000 7f3273fff640 1 -- 172.21.15.79:0/103946210 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f328c004cc0 con 0x55c2ed2a18d0 2024-08-20T01:52:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.989+0000 7f3273fff640 1 -- 172.21.15.79:0/103946210 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 62) ==== 8406+0+0 (secure 0 0 0) 0x7f3288050450 con 0x55c2ed2a18d0 2024-08-20T01:52:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.989+0000 7f329de09740 10 client.19374 fetch_fsmap finished waiting for FSMap version 62 2024-08-20T01:52:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.989+0000 7f329de09740 10 client.19374 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:52:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.989+0000 7f329de09740 20 client.19374 populate_metadata read hostname 'smithi079' 2024-08-20T01:52:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.989+0000 7f329de09740 1 --2- 172.21.15.79:0/103946210 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55c2ed2b6a30 0x55c2ed324270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.989+0000 7f329de09740 4 client.19374 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:52:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.989+0000 7f329de09740 1 -- 172.21.15.79:0/103946210 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c2ed211d50 con 0x55c2ed2b6a30 2024-08-20T01:52:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.989+0000 7f3293fff640 1 --2- 172.21.15.79:0/103946210 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55c2ed2b6a30 0x55c2ed324270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.989+0000 7f3273fff640 10 client.19374 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:52:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:52:57.989+0000 7f3293fff640 1 --2- 172.21.15.79:0/103946210 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55c2ed2b6a30 0x55c2ed324270 crc :-1 s=READY pgs=321 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7899d8281616b783 server_cookie=9d9152d96969ac8a in_seq=0 out_seq=0 2024-08-20T01:52:58.684 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T01:52:58.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:52:58 smithi175 ceph-mon[22392]: pgmap v816: 97 pgs: 97 active+clean; 7.7 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 KiB/s wr, 24 op/s 2024-08-20T01:52:58.935 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:52:58.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:52:58 smithi079 ceph-mon[18656]: pgmap v816: 97 pgs: 97 active+clean; 7.7 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 KiB/s wr, 24 op/s 2024-08-20T01:52:59.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:52:58 smithi081 ceph-mon[22209]: pgmap v816: 97 pgs: 97 active+clean; 7.7 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 KiB/s wr, 24 op/s 2024-08-20T01:52:59.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.461+0000 7f93f5322640 1 -- 172.21.15.79:0/3500269981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93f0104290 msgr2=0x7f93f010c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:59.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.461+0000 7f93f5322640 1 --2- 172.21.15.79:0/3500269981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93f0104290 0x7f93f010c870 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f93d8009900 tx=0x7f93d802a410 comp rx=0 tx=0).stop 2024-08-20T01:52:59.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.461+0000 7f93f5322640 1 -- 172.21.15.79:0/3500269981 shutdown_connections 2024-08-20T01:52:59.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.461+0000 7f93f5322640 1 --2- 172.21.15.79:0/3500269981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93f010ce40 0x7f93f010f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:59.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.461+0000 7f93f5322640 1 --2- 172.21.15.79:0/3500269981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93f0104290 0x7f93f010c870 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:59.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.461+0000 7f93f5322640 1 --2- 172.21.15.79:0/3500269981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93f0103890 0x7f93f0103c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:59.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.461+0000 7f93f5322640 1 -- 172.21.15.79:0/3500269981 >> 172.21.15.79:0/3500269981 conn(0x7f93f00fd400 msgr2=0x7f93f00ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:59.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.462+0000 7f93f5322640 1 -- 172.21.15.79:0/3500269981 shutdown_connections 2024-08-20T01:52:59.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.462+0000 7f93f5322640 1 -- 172.21.15.79:0/3500269981 wait complete. 2024-08-20T01:52:59.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.462+0000 7f93f5322640 1 Processor -- start 2024-08-20T01:52:59.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.462+0000 7f93f5322640 1 -- start start 2024-08-20T01:52:59.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.462+0000 7f93f5322640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93f0103890 0x7f93f0101710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:59.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.463+0000 7f93f5322640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93f0104290 0x7f93f0101c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:59.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.463+0000 7f93f5322640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93f010ce40 0x7f93f0102190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:59.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.463+0000 7f93f5322640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f93f0112910 con 0x7f93f0103890 2024-08-20T01:52:59.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.463+0000 7f93f5322640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f93f0112790 con 0x7f93f0104290 2024-08-20T01:52:59.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.463+0000 7f93f5322640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f93f0112a90 con 0x7f93f010ce40 2024-08-20T01:52:59.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.463+0000 7f93eeffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93f0103890 0x7f93f0101710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:59.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.463+0000 7f93eeffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93f0103890 0x7f93f0101710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43288/0 (socket says 172.21.15.79:43288) 2024-08-20T01:52:59.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.463+0000 7f93eeffd640 1 -- 172.21.15.79:0/1017629330 learned_addr learned my addr 172.21.15.79:0/1017629330 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:59.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.463+0000 7f93ee7fc640 1 --2- 172.21.15.79:0/1017629330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93f0104290 0x7f93f0101c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:59.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.463+0000 7f93ef7fe640 1 --2- 172.21.15.79:0/1017629330 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93f010ce40 0x7f93f0102190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:59.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.463+0000 7f93eeffd640 1 -- 172.21.15.79:0/1017629330 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93f010ce40 msgr2=0x7f93f0102190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:59.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.463+0000 7f93eeffd640 1 --2- 172.21.15.79:0/1017629330 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93f010ce40 0x7f93f0102190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:59.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.463+0000 7f93eeffd640 1 -- 172.21.15.79:0/1017629330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93f0104290 msgr2=0x7f93f0101c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:59.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.463+0000 7f93eeffd640 1 --2- 172.21.15.79:0/1017629330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93f0104290 0x7f93f0101c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:59.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.463+0000 7f93eeffd640 1 -- 172.21.15.79:0/1017629330 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93f01a7300 con 0x7f93f0103890 2024-08-20T01:52:59.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.463+0000 7f93ef7fe640 1 --2- 172.21.15.79:0/1017629330 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93f010ce40 0x7f93f0102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:52:59.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.463+0000 7f93eeffd640 1 --2- 172.21.15.79:0/1017629330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93f0103890 0x7f93f0101710 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f93e000d770 tx=0x7f93e000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:59.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.463+0000 7f93e7fff640 1 -- 172.21.15.79:0/1017629330 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e0017070 con 0x7f93f0103890 2024-08-20T01:52:59.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.463+0000 7f93e7fff640 1 -- 172.21.15.79:0/1017629330 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f93e00054b0 con 0x7f93f0103890 2024-08-20T01:52:59.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.463+0000 7f93f5322640 1 -- 172.21.15.79:0/1017629330 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93f01a75f0 con 0x7f93f0103890 2024-08-20T01:52:59.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.463+0000 7f93e7fff640 1 -- 172.21.15.79:0/1017629330 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e0004c60 con 0x7f93f0103890 2024-08-20T01:52:59.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.463+0000 7f93f5322640 1 -- 172.21.15.79:0/1017629330 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93f01a7ab0 con 0x7f93f0103890 2024-08-20T01:52:59.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.466+0000 7f93e7fff640 1 -- 172.21.15.79:0/1017629330 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f93e0004e00 con 0x7f93f0103890 2024-08-20T01:52:59.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.466+0000 7f93f771b740 1 Processor -- start 2024-08-20T01:52:59.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.466+0000 7f93f771b740 1 -- start start 2024-08-20T01:52:59.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.466+0000 7f93f771b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4fa29b880 0x55f4fa29bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:59.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.466+0000 7f93f771b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4fa29c1a0 0x55f4fa2a7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:59.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.466+0000 7f93f771b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4fa2a8130 0x55f4fa2aa520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:59.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.466+0000 7f93f771b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f4fa212930 con 0x55f4fa2a8130 2024-08-20T01:52:59.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.466+0000 7f93f771b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f4fa201e30 con 0x55f4fa29c1a0 2024-08-20T01:52:59.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.466+0000 7f93f771b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f4fa205e70 con 0x55f4fa29b880 2024-08-20T01:52:59.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.466+0000 7f93ee7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4fa2a8130 0x55f4fa2aa520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:59.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.466+0000 7f93ee7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4fa2a8130 0x55f4fa2aa520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43290/0 (socket says 172.21.15.79:43290) 2024-08-20T01:52:59.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.466+0000 7f93ee7fc640 1 -- 172.21.15.79:0/4093405859 learned_addr learned my addr 172.21.15.79:0/4093405859 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:59.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.466+0000 7f93ef7fe640 1 --2- 172.21.15.79:0/4093405859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4fa29b880 0x55f4fa29bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:59.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.467+0000 7f93eeffd640 1 --2- 172.21.15.79:0/4093405859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4fa29c1a0 0x55f4fa2a7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:59.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.467+0000 7f93ee7fc640 1 -- 172.21.15.79:0/4093405859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4fa29b880 msgr2=0x55f4fa29bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:59.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.467+0000 7f93ee7fc640 1 --2- 172.21.15.79:0/4093405859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4fa29b880 0x55f4fa29bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:59.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.467+0000 7f93ee7fc640 1 -- 172.21.15.79:0/4093405859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4fa29c1a0 msgr2=0x55f4fa2a7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:59.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.467+0000 7f93ee7fc640 1 --2- 172.21.15.79:0/4093405859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4fa29c1a0 0x55f4fa2a7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:59.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.467+0000 7f93ee7fc640 1 -- 172.21.15.79:0/4093405859 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4f9f61650 con 0x55f4fa2a8130 2024-08-20T01:52:59.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.467+0000 7f93eeffd640 1 --2- 172.21.15.79:0/4093405859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4fa29c1a0 0x55f4fa2a7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:52:59.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.467+0000 7f93e7fff640 1 --2- 172.21.15.79:0/1017629330 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f93dc0b3bd0 0x7f93dc0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:59.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.467+0000 7f93ee7fc640 1 --2- 172.21.15.79:0/4093405859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4fa2a8130 0x55f4fa2aa520 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f93d8000c00 tx=0x7f93d8031ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6209fabd725f3ba server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:59.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.467+0000 7f93ef7fe640 1 --2- 172.21.15.79:0/1017629330 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f93dc0b3bd0 0x7f93dc0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:59.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.467+0000 7f93e7fff640 1 -- 172.21.15.79:0/1017629330 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f93e00e3690 con 0x7f93f0103890 2024-08-20T01:52:59.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.467+0000 7f93e57fa640 1 -- 172.21.15.79:0/4093405859 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d8035070 con 0x55f4fa2a8130 2024-08-20T01:52:59.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.467+0000 7f93e57fa640 1 -- 172.21.15.79:0/4093405859 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f93d8040070 con 0x55f4fa2a8130 2024-08-20T01:52:59.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.467+0000 7f93e57fa640 1 -- 172.21.15.79:0/4093405859 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d8003b10 con 0x55f4fa2a8130 2024-08-20T01:52:59.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.468+0000 7f93f771b740 1 -- 172.21.15.79:0/4093405859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4fa2a8130 msgr2=0x55f4fa2aa520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:59.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.468+0000 7f93ef7fe640 1 --2- 172.21.15.79:0/1017629330 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f93dc0b3bd0 0x7f93dc0b6090 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f93f01037d0 tx=0x7f93e80097b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:59.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.468+0000 7f93f771b740 1 --2- 172.21.15.79:0/4093405859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4fa2a8130 0x55f4fa2aa520 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f93d8000c00 tx=0x7f93d8031ba0 comp rx=0 tx=0).stop 2024-08-20T01:52:59.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.468+0000 7f93f771b740 1 -- 172.21.15.79:0/4093405859 shutdown_connections 2024-08-20T01:52:59.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.468+0000 7f93f771b740 1 --2- 172.21.15.79:0/4093405859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4fa2a8130 0x55f4fa2aa520 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:59.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.468+0000 7f93f771b740 1 --2- 172.21.15.79:0/4093405859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4fa29c1a0 0x55f4fa2a7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:59.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.468+0000 7f93f771b740 1 --2- 172.21.15.79:0/4093405859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4fa29b880 0x55f4fa29bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:59.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.468+0000 7f93f771b740 1 -- 172.21.15.79:0/4093405859 >> 172.21.15.79:0/4093405859 conn(0x55f4fa2996b0 msgr2=0x55f4fa29a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:59.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.468+0000 7f93f771b740 1 -- 172.21.15.79:0/4093405859 shutdown_connections 2024-08-20T01:52:59.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.468+0000 7f93f771b740 1 -- 172.21.15.79:0/4093405859 wait complete. 2024-08-20T01:52:59.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.469+0000 7f93f771b740 1 -- start start 2024-08-20T01:52:59.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.469+0000 7f93f771b740 1 Processor -- start 2024-08-20T01:52:59.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.469+0000 7f93f771b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4fa29b880 0x55f4fa2a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:59.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.469+0000 7f93f771b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4fa29c1a0 0x55f4fa2a5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:59.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.469+0000 7f93f771b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4fa2a8130 0x55f4fa2a5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:59.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.469+0000 7f93f771b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f4fa064700 con 0x55f4fa29b880 2024-08-20T01:52:59.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.469+0000 7f93f771b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f4fa188810 con 0x55f4fa29c1a0 2024-08-20T01:52:59.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.469+0000 7f93f771b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f4fa2aad80 con 0x55f4fa2a8130 2024-08-20T01:52:59.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.469+0000 7f93f771b740 10 client.0 _ll_register_callbacks cb 0x55f4fa1fb700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:52:59.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.469+0000 7f93eeffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4fa29b880 0x55f4fa2a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:59.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.469+0000 7f93ee7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4fa29c1a0 0x55f4fa2a5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:59.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.469+0000 7f93eeffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4fa29b880 0x55f4fa2a50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43304/0 (socket says 172.21.15.79:43304) 2024-08-20T01:52:59.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.469+0000 7f93eeffd640 1 -- 172.21.15.79:0/1402464043 learned_addr learned my addr 172.21.15.79:0/1402464043 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:59.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.469+0000 7f93ef7fe640 1 --2- 172.21.15.79:0/1402464043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4fa2a8130 0x55f4fa2a5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:59.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.469+0000 7f93eeffd640 1 -- 172.21.15.79:0/1402464043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4fa2a8130 msgr2=0x55f4fa2a5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:59.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.469+0000 7f93eeffd640 1 --2- 172.21.15.79:0/1402464043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4fa2a8130 0x55f4fa2a5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:59.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.469+0000 7f93eeffd640 1 -- 172.21.15.79:0/1402464043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4fa29c1a0 msgr2=0x55f4fa2a5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:59.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.469+0000 7f93eeffd640 1 --2- 172.21.15.79:0/1402464043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4fa29c1a0 0x55f4fa2a5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:59.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.469+0000 7f93eeffd640 1 -- 172.21.15.79:0/1402464043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4fa2b4130 con 0x55f4fa29b880 2024-08-20T01:52:59.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.469+0000 7f93ee7fc640 1 --2- 172.21.15.79:0/1402464043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4fa29c1a0 0x55f4fa2a5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:52:59.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.470+0000 7f93eeffd640 1 --2- 172.21.15.79:0/1402464043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4fa29b880 0x55f4fa2a50c0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f93e00a7860 tx=0x7f93e00aa480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa0103f94957a533 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:59.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.470+0000 7f93d67fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:52:59.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.470+0000 7f93d67fc640 1 -- 172.21.15.79:0/1402464043 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e0020070 con 0x55f4fa29b880 2024-08-20T01:52:59.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.470+0000 7f93d67fc640 1 -- 172.21.15.79:0/1402464043 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f93e00a6880 con 0x55f4fa29b880 2024-08-20T01:52:59.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.470+0000 7f93f771b740 1 -- 172.21.15.79:0/1402464043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f4fa1b1150 con 0x55f4fa29b880 2024-08-20T01:52:59.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.470+0000 7f93d67fc640 1 -- 172.21.15.79:0/1402464043 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f93e00aacf0 con 0x55f4fa29b880 2024-08-20T01:52:59.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.470+0000 7f93f771b740 10 client.19386 fetch_fsmap learned FSMap version 62 2024-08-20T01:52:59.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.470+0000 7f93f771b740 1 -- 172.21.15.79:0/1402464043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55f4fa2b6b40 con 0x55f4fa29b880 2024-08-20T01:52:59.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.470+0000 7f93d67fc640 1 -- 172.21.15.79:0/1402464043 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55f4fa1b1150 con 0x55f4fa29b880 2024-08-20T01:52:59.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.470+0000 7f93d67fc640 1 -- 172.21.15.79:0/1402464043 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 62) ==== 8406+0+0 (secure 0 0 0) 0x7f93e00050f0 con 0x55f4fa29b880 2024-08-20T01:52:59.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.470+0000 7f93f771b740 10 client.19386 fetch_fsmap finished waiting for FSMap version 62 2024-08-20T01:52:59.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.470+0000 7f93f771b740 10 client.19386 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:52:59.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.470+0000 7f93f771b740 20 client.19386 populate_metadata read hostname 'smithi079' 2024-08-20T01:52:59.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.470+0000 7f93f771b740 1 --2- 172.21.15.79:0/1402464043 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55f4fa2b8000 0x55f4fa2ba450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:59.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.470+0000 7f93f771b740 4 client.19386 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:52:59.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.470+0000 7f93f771b740 1 -- 172.21.15.79:0/1402464043 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f4fa214880 con 0x55f4fa2b8000 2024-08-20T01:52:59.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.471+0000 7f93ee7fc640 1 --2- 172.21.15.79:0/1402464043 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55f4fa2b8000 0x55f4fa2ba450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:59.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.471+0000 7f93d67fc640 10 client.19386 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:52:59.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.471+0000 7f93ee7fc640 1 --2- 172.21.15.79:0/1402464043 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55f4fa2b8000 0x55f4fa2ba450 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=37798540b85183fe server_cookie=bd2ecc05a1f0dafb in_seq=0 out_seq=0 2024-08-20T01:52:59.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.472+0000 7f93d67fc640 1 -- 172.21.15.79:0/1402464043 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f4fa214880 con 0x55f4fa2b8000 2024-08-20T01:52:59.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.472+0000 7f93d67fc640 10 client.19386 handle_command_reply: tid=0 2024-08-20T01:52:59.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.472+0000 7f93f771b740 1 client.19386 shutdown 2024-08-20T01:52:59.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.472+0000 7f93f771b740 1 -- 172.21.15.79:0/1402464043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4fa29b880 msgr2=0x55f4fa2a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:59.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.472+0000 7f93f771b740 1 --2- 172.21.15.79:0/1402464043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4fa29b880 0x55f4fa2a50c0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f93e00a7860 tx=0x7f93e00aa480 comp rx=0 tx=0).stop 2024-08-20T01:52:59.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.472+0000 7f93f771b740 1 -- 172.21.15.79:0/1402464043 shutdown_connections 2024-08-20T01:52:59.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.472+0000 7f93f771b740 1 --2- 172.21.15.79:0/1402464043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4fa2a8130 0x55f4fa2a5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:59.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.472+0000 7f93f771b740 1 --2- 172.21.15.79:0/1402464043 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55f4fa2b8000 0x55f4fa2ba450 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:59.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.472+0000 7f93f771b740 1 --2- 172.21.15.79:0/1402464043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4fa29c1a0 0x55f4fa2a5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:59.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.472+0000 7f93d67fc640 0 client.19386 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:52:59.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.472+0000 7f93f771b740 1 --2- 172.21.15.79:0/1402464043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4fa29b880 0x55f4fa2a50c0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:59.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.472+0000 7f93f771b740 1 -- 172.21.15.79:0/1402464043 >> 172.21.15.79:0/1402464043 conn(0x55f4fa2996b0 msgr2=0x55f4fa29f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:59.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.472+0000 7f93f771b740 1 -- 172.21.15.79:0/1402464043 shutdown_connections 2024-08-20T01:52:59.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.472+0000 7f93f771b740 1 -- 172.21.15.79:0/1402464043 wait complete. 2024-08-20T01:52:59.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.472+0000 7f93f771b740 20 client.19386 trim_cache size 0 max 16384 2024-08-20T01:52:59.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.485+0000 7f93f771b740 1 Processor -- start 2024-08-20T01:52:59.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.485+0000 7f93f771b740 1 -- start start 2024-08-20T01:52:59.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.485+0000 7f93f771b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4fa29b880 0x55f4fa2a4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:59.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.485+0000 7f93f771b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4fa29c1a0 0x55f4fa2a6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:59.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.485+0000 7f93f771b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4fa2a8130 0x55f4fa2bfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:59.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.485+0000 7f93f771b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f93f01b01a0 con 0x55f4fa29b880 2024-08-20T01:52:59.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.485+0000 7f93f771b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f93f01b1e90 con 0x55f4fa29c1a0 2024-08-20T01:52:59.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.485+0000 7f93f771b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f93f01b08a0 con 0x55f4fa2a8130 2024-08-20T01:52:59.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.485+0000 7f93eeffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4fa29b880 0x55f4fa2a4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:59.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.485+0000 7f93eeffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4fa29b880 0x55f4fa2a4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43312/0 (socket says 172.21.15.79:43312) 2024-08-20T01:52:59.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.485+0000 7f93eeffd640 1 -- 172.21.15.79:0/3841261308 learned_addr learned my addr 172.21.15.79:0/3841261308 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:59.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.486+0000 7f93ef7fe640 1 --2- 172.21.15.79:0/3841261308 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4fa2a8130 0x55f4fa2bfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:59.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.486+0000 7f93ee7fc640 1 --2- 172.21.15.79:0/3841261308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4fa29c1a0 0x55f4fa2a6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:59.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.486+0000 7f93eeffd640 1 -- 172.21.15.79:0/3841261308 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4fa2a8130 msgr2=0x55f4fa2bfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:59.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.486+0000 7f93eeffd640 1 --2- 172.21.15.79:0/3841261308 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4fa2a8130 0x55f4fa2bfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:59.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.486+0000 7f93eeffd640 1 -- 172.21.15.79:0/3841261308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4fa29c1a0 msgr2=0x55f4fa2a6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:59.494 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.486+0000 7f93eeffd640 1 --2- 172.21.15.79:0/3841261308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4fa29c1a0 0x55f4fa2a6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:59.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.486+0000 7f93eeffd640 1 -- 172.21.15.79:0/3841261308 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4fa2b4800 con 0x55f4fa29b880 2024-08-20T01:52:59.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.486+0000 7f93eeffd640 1 --2- 172.21.15.79:0/3841261308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4fa29b880 0x55f4fa2a4950 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f93e00cd310 tx=0x7f93e00aa4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcf8f60285dd3340 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:59.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.486+0000 7f93e4ff9640 1 -- 172.21.15.79:0/3841261308 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e0020070 con 0x55f4fa29b880 2024-08-20T01:52:59.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.486+0000 7f93e4ff9640 1 -- 172.21.15.79:0/3841261308 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f93e00aa5f0 con 0x55f4fa29b880 2024-08-20T01:52:59.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.486+0000 7f93e4ff9640 1 -- 172.21.15.79:0/3841261308 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e00a6880 con 0x55f4fa29b880 2024-08-20T01:52:59.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.487+0000 7f93f771b740 1 -- 172.21.15.79:0/3841261308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4fa29b880 msgr2=0x55f4fa2a4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:59.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.487+0000 7f93f771b740 1 --2- 172.21.15.79:0/3841261308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4fa29b880 0x55f4fa2a4950 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f93e00cd310 tx=0x7f93e00aa4f0 comp rx=0 tx=0).stop 2024-08-20T01:52:59.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.487+0000 7f93f771b740 1 -- 172.21.15.79:0/3841261308 shutdown_connections 2024-08-20T01:52:59.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.487+0000 7f93f771b740 1 --2- 172.21.15.79:0/3841261308 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4fa2a8130 0x55f4fa2bfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:59.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.487+0000 7f93f771b740 1 --2- 172.21.15.79:0/3841261308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4fa29c1a0 0x55f4fa2a6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:59.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.487+0000 7f93f771b740 1 --2- 172.21.15.79:0/3841261308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4fa29b880 0x55f4fa2a4950 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:59.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.487+0000 7f93f771b740 1 -- 172.21.15.79:0/3841261308 >> 172.21.15.79:0/3841261308 conn(0x55f4fa2996b0 msgr2=0x55f4fa2a66f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:59.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.487+0000 7f93f771b740 1 -- 172.21.15.79:0/3841261308 shutdown_connections 2024-08-20T01:52:59.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.487+0000 7f93f771b740 1 -- 172.21.15.79:0/3841261308 wait complete. 2024-08-20T01:52:59.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.487+0000 7f93f771b740 1 -- start start 2024-08-20T01:52:59.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.487+0000 7f93f771b740 1 Processor -- start 2024-08-20T01:52:59.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.488+0000 7f93f771b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4fa29b880 0x55f4fa2b0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:59.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.488+0000 7f93f771b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4fa29c1a0 0x55f4fa2aaff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:59.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.488+0000 7f93f771b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4fa2a8130 0x55f4fa2ab780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:59.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.488+0000 7f93f771b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f93f01b1700 con 0x55f4fa29c1a0 2024-08-20T01:52:59.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.488+0000 7f93f771b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f93f01b1000 con 0x55f4fa2a8130 2024-08-20T01:52:59.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.488+0000 7f93f771b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f93f01ae180 con 0x55f4fa29b880 2024-08-20T01:52:59.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.488+0000 7f93f771b740 10 client.0 _ll_register_callbacks cb 0x7f93e000d6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:52:59.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.488+0000 7f93ee7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4fa29c1a0 0x55f4fa2aaff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:59.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.488+0000 7f93ef7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4fa2a8130 0x55f4fa2ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:59.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.488+0000 7f93ee7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4fa29c1a0 0x55f4fa2aaff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43318/0 (socket says 172.21.15.79:43318) 2024-08-20T01:52:59.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.488+0000 7f93ee7fc640 1 -- 172.21.15.79:0/2527522993 learned_addr learned my addr 172.21.15.79:0/2527522993 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:52:59.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.488+0000 7f93eeffd640 1 --2- 172.21.15.79:0/2527522993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4fa29b880 0x55f4fa2b0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:59.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.488+0000 7f93ee7fc640 1 -- 172.21.15.79:0/2527522993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4fa29b880 msgr2=0x55f4fa2b0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:59.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.488+0000 7f93ee7fc640 1 --2- 172.21.15.79:0/2527522993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4fa29b880 0x55f4fa2b0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:59.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.488+0000 7f93ee7fc640 1 -- 172.21.15.79:0/2527522993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4fa2a8130 msgr2=0x55f4fa2ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:52:59.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.488+0000 7f93ee7fc640 1 --2- 172.21.15.79:0/2527522993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4fa2a8130 0x55f4fa2ab780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:59.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.488+0000 7f93ee7fc640 1 -- 172.21.15.79:0/2527522993 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4fa329540 con 0x55f4fa29c1a0 2024-08-20T01:52:59.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.488+0000 7f93ef7fe640 1 --2- 172.21.15.79:0/2527522993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4fa2a8130 0x55f4fa2ab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:52:59.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.488+0000 7f93eeffd640 1 --2- 172.21.15.79:0/2527522993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4fa29b880 0x55f4fa2b0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:52:59.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.488+0000 7f93ee7fc640 1 --2- 172.21.15.79:0/2527522993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4fa29c1a0 0x55f4fa2aaff0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f93d8000c00 tx=0x7f93d8031c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f61bdd32e642d853 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:52:59.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.488+0000 7f93d67fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:52:59.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.488+0000 7f93d67fc640 1 -- 172.21.15.79:0/2527522993 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d8035040 con 0x55f4fa29c1a0 2024-08-20T01:52:59.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.488+0000 7f93d67fc640 1 -- 172.21.15.79:0/2527522993 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f93d8004240 con 0x55f4fa29c1a0 2024-08-20T01:52:59.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.488+0000 7f93f771b740 1 -- 172.21.15.79:0/2527522993 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93e00aa5f0 con 0x55f4fa29c1a0 2024-08-20T01:52:59.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.489+0000 7f93d67fc640 1 -- 172.21.15.79:0/2527522993 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f93d80318b0 con 0x55f4fa29c1a0 2024-08-20T01:52:59.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.489+0000 7f93f771b740 10 client.19392 fetch_fsmap learned FSMap version 62 2024-08-20T01:52:59.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.489+0000 7f93f771b740 1 -- 172.21.15.79:0/2527522993 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55f4fa32a810 con 0x55f4fa29c1a0 2024-08-20T01:52:59.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.489+0000 7f93d67fc640 1 -- 172.21.15.79:0/2527522993 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f93e00aa5f0 con 0x55f4fa29c1a0 2024-08-20T01:52:59.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.489+0000 7f93d67fc640 1 -- 172.21.15.79:0/2527522993 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 62) ==== 8406+0+0 (secure 0 0 0) 0x7f93d804e040 con 0x55f4fa29c1a0 2024-08-20T01:52:59.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.489+0000 7f93f771b740 10 client.19392 fetch_fsmap finished waiting for FSMap version 62 2024-08-20T01:52:59.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.489+0000 7f93f771b740 10 client.19392 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:52:59.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.489+0000 7f93f771b740 20 client.19392 populate_metadata read hostname 'smithi079' 2024-08-20T01:52:59.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.489+0000 7f93f771b740 1 --2- 172.21.15.79:0/2527522993 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55f4fa32abf0 0x55f4fa32cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:52:59.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.489+0000 7f93f771b740 4 client.19392 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:52:59.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.489+0000 7f93f771b740 1 -- 172.21.15.79:0/2527522993 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f4fa210320 con 0x55f4fa32abf0 2024-08-20T01:52:59.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.489+0000 7f93eeffd640 1 --2- 172.21.15.79:0/2527522993 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55f4fa32abf0 0x55f4fa32cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:52:59.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.489+0000 7f93eeffd640 1 --2- 172.21.15.79:0/2527522993 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55f4fa32abf0 0x55f4fa32cfe0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e437bdb3fe33ae43 server_cookie=60531a9a5ea42990 in_seq=0 out_seq=0 2024-08-20T01:52:59.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.489+0000 7f93d67fc640 10 client.19392 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:52:59.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.490+0000 7f93d67fc640 1 -- 172.21.15.79:0/2527522993 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f4fa210320 con 0x55f4fa32abf0 2024-08-20T01:52:59.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.490+0000 7f93d67fc640 10 client.19392 handle_command_reply: tid=0 2024-08-20T01:52:59.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.490+0000 7f93f771b740 1 client.19392 shutdown 2024-08-20T01:52:59.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.490+0000 7f93f771b740 1 -- 172.21.15.79:0/2527522993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4fa29c1a0 msgr2=0x55f4fa2aaff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:59.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.490+0000 7f93f771b740 1 --2- 172.21.15.79:0/2527522993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4fa29c1a0 0x55f4fa2aaff0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f93d8000c00 tx=0x7f93d8031c90 comp rx=0 tx=0).stop 2024-08-20T01:52:59.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.490+0000 7f93f771b740 1 -- 172.21.15.79:0/2527522993 shutdown_connections 2024-08-20T01:52:59.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.490+0000 7f93f771b740 1 --2- 172.21.15.79:0/2527522993 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55f4fa32abf0 0x55f4fa32cfe0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:59.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.490+0000 7f93f771b740 1 --2- 172.21.15.79:0/2527522993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4fa2a8130 0x55f4fa2ab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:59.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.490+0000 7f93f771b740 1 --2- 172.21.15.79:0/2527522993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4fa29c1a0 0x55f4fa2aaff0 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:59.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.490+0000 7f93f771b740 1 --2- 172.21.15.79:0/2527522993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4fa29b880 0x55f4fa2b0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:59.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.490+0000 7f93f771b740 1 -- 172.21.15.79:0/2527522993 >> 172.21.15.79:0/2527522993 conn(0x55f4fa2996b0 msgr2=0x55f4fa2a6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:59.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.490+0000 7f93d67fc640 0 client.19392 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:52:59.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.490+0000 7f93f771b740 1 -- 172.21.15.79:0/2527522993 shutdown_connections 2024-08-20T01:52:59.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.490+0000 7f93f771b740 1 -- 172.21.15.79:0/2527522993 wait complete. 2024-08-20T01:52:59.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.490+0000 7f93f771b740 20 client.19392 trim_cache size 0 max 16384 2024-08-20T01:52:59.500 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:52:59.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.490+0000 7f93f5322640 1 -- 172.21.15.79:0/1017629330 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f93dc0b3bd0 msgr2=0x7f93dc0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:59.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.490+0000 7f93f5322640 1 --2- 172.21.15.79:0/1017629330 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f93dc0b3bd0 0x7f93dc0b6090 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f93f01037d0 tx=0x7f93e80097b0 comp rx=0 tx=0).stop 2024-08-20T01:52:59.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.490+0000 7f93f5322640 1 -- 172.21.15.79:0/1017629330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93f0103890 msgr2=0x7f93f0101710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:52:59.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.491+0000 7f93f5322640 1 --2- 172.21.15.79:0/1017629330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93f0103890 0x7f93f0101710 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f93e000d770 tx=0x7f93e000dc30 comp rx=0 tx=0).stop 2024-08-20T01:52:59.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.491+0000 7f93f5322640 1 -- 172.21.15.79:0/1017629330 shutdown_connections 2024-08-20T01:52:59.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.491+0000 7f93f5322640 1 --2- 172.21.15.79:0/1017629330 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f93dc0b3bd0 0x7f93dc0b6090 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:59.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.491+0000 7f93f5322640 1 --2- 172.21.15.79:0/1017629330 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93f010ce40 0x7f93f0102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:59.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.491+0000 7f93f5322640 1 --2- 172.21.15.79:0/1017629330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93f0104290 0x7f93f0101c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:59.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.491+0000 7f93f5322640 1 --2- 172.21.15.79:0/1017629330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93f0103890 0x7f93f0101710 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:52:59.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.491+0000 7f93f5322640 1 -- 172.21.15.79:0/1017629330 >> 172.21.15.79:0/1017629330 conn(0x7f93f00fd400 msgr2=0x7f93f00fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:52:59.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.491+0000 7f93f5322640 1 -- 172.21.15.79:0/1017629330 shutdown_connections 2024-08-20T01:52:59.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:52:59.491+0000 7f93f5322640 1 -- 172.21.15.79:0/1017629330 wait complete. 2024-08-20T01:53:00.201 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T01:53:00.452 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:53:00.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:00 smithi175 ceph-mon[22392]: pgmap v817: 97 pgs: 97 active+clean; 7.6 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 7.5 KiB/s wr, 22 op/s 2024-08-20T01:53:00.928 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:00 smithi079 ceph-mon[18656]: pgmap v817: 97 pgs: 97 active+clean; 7.6 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 7.5 KiB/s wr, 22 op/s 2024-08-20T01:53:01.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:00 smithi081 ceph-mon[22209]: pgmap v817: 97 pgs: 97 active+clean; 7.6 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 7.5 KiB/s wr, 22 op/s 2024-08-20T01:53:01.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.008+0000 7fefa073a640 1 -- 172.21.15.79:0/2067855934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef981084b0 msgr2=0x7fef981088f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:01.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.008+0000 7fefa073a640 1 --2- 172.21.15.79:0/2067855934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef981084b0 0x7fef981088f0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fef88009900 tx=0x7fef8802a410 comp rx=0 tx=0).stop 2024-08-20T01:53:01.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.008+0000 7fefa073a640 1 -- 172.21.15.79:0/2067855934 shutdown_connections 2024-08-20T01:53:01.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.008+0000 7fefa073a640 1 --2- 172.21.15.79:0/2067855934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef98108e30 0x7fef9810f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:01.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.008+0000 7fefa073a640 1 --2- 172.21.15.79:0/2067855934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef981084b0 0x7fef981088f0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:01.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.008+0000 7fefa073a640 1 --2- 172.21.15.79:0/2067855934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef98102aa0 0x7fef98102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:01.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.008+0000 7fefa073a640 1 -- 172.21.15.79:0/2067855934 >> 172.21.15.79:0/2067855934 conn(0x7fef980fe550 msgr2=0x7fef98100970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:01.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.008+0000 7fefa073a640 1 -- 172.21.15.79:0/2067855934 shutdown_connections 2024-08-20T01:53:01.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.008+0000 7fefa073a640 1 -- 172.21.15.79:0/2067855934 wait complete. 2024-08-20T01:53:01.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.009+0000 7fefa073a640 1 Processor -- start 2024-08-20T01:53:01.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.009+0000 7fefa073a640 1 -- start start 2024-08-20T01:53:01.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.009+0000 7fefa073a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef98102aa0 0x7fef98198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:01.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.009+0000 7fefa073a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef981084b0 0x7fef981993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:01.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.009+0000 7fefa073a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef98108e30 0x7fef9819e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:01.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.009+0000 7fefa073a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fef981129a0 con 0x7fef981084b0 2024-08-20T01:53:01.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.009+0000 7fefa073a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fef98112820 con 0x7fef98102aa0 2024-08-20T01:53:01.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.009+0000 7fefa073a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fef98112b20 con 0x7fef98108e30 2024-08-20T01:53:01.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.009+0000 7fef9dcd5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef981084b0 0x7fef981993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:01.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.009+0000 7fef9dcd5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef981084b0 0x7fef981993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50240/0 (socket says 172.21.15.79:50240) 2024-08-20T01:53:01.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.009+0000 7fef9dcd5640 1 -- 172.21.15.79:0/1518116627 learned_addr learned my addr 172.21.15.79:0/1518116627 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:01.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.009+0000 7fef9ecd7640 1 --2- 172.21.15.79:0/1518116627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef98108e30 0x7fef9819e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:01.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.009+0000 7fef9e4d6640 1 --2- 172.21.15.79:0/1518116627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef98102aa0 0x7fef98198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:01.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.010+0000 7fef9dcd5640 1 -- 172.21.15.79:0/1518116627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef98108e30 msgr2=0x7fef9819e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:01.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.010+0000 7fef9dcd5640 1 --2- 172.21.15.79:0/1518116627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef98108e30 0x7fef9819e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:01.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.010+0000 7fef9dcd5640 1 -- 172.21.15.79:0/1518116627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef98102aa0 msgr2=0x7fef98198e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:01.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.010+0000 7fef9dcd5640 1 --2- 172.21.15.79:0/1518116627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef98102aa0 0x7fef98198e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:01.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.010+0000 7fef9dcd5640 1 -- 172.21.15.79:0/1518116627 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef9819ef40 con 0x7fef981084b0 2024-08-20T01:53:01.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.010+0000 7fef9ecd7640 1 --2- 172.21.15.79:0/1518116627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef98108e30 0x7fef9819e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:53:01.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.010+0000 7fef9e4d6640 1 --2- 172.21.15.79:0/1518116627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef98102aa0 0x7fef98198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:53:01.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.010+0000 7fef9dcd5640 1 --2- 172.21.15.79:0/1518116627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef981084b0 0x7fef981993d0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fef88009230 tx=0x7fef880319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:01.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.010+0000 7fef8f7fe640 1 -- 172.21.15.79:0/1518116627 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef8803f030 con 0x7fef981084b0 2024-08-20T01:53:01.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.010+0000 7fef8f7fe640 1 -- 172.21.15.79:0/1518116627 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fef880043d0 con 0x7fef981084b0 2024-08-20T01:53:01.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.010+0000 7fefa073a640 1 -- 172.21.15.79:0/1518116627 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef9819f1d0 con 0x7fef981084b0 2024-08-20T01:53:01.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.010+0000 7fef8f7fe640 1 -- 172.21.15.79:0/1518116627 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef88035070 con 0x7fef981084b0 2024-08-20T01:53:01.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.010+0000 7fefa073a640 1 -- 172.21.15.79:0/1518116627 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef981a58f0 con 0x7fef981084b0 2024-08-20T01:53:01.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.013+0000 7fef8f7fe640 1 -- 172.21.15.79:0/1518116627 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fef88042030 con 0x7fef981084b0 2024-08-20T01:53:01.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.013+0000 7fefa2b33740 1 Processor -- start 2024-08-20T01:53:01.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.013+0000 7fefa2b33740 1 -- start start 2024-08-20T01:53:01.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.013+0000 7fefa2b33740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c8d1a3c880 0x55c8d1a3cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:01.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.013+0000 7fefa2b33740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8d1a3d1a0 0x55c8d1a48bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:01.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.014+0000 7fefa2b33740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8d1a49130 0x55c8d1a4b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:01.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.014+0000 7fefa2b33740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c8d19b3930 con 0x55c8d1a3c880 2024-08-20T01:53:01.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.014+0000 7fefa2b33740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c8d19a2e30 con 0x55c8d1a49130 2024-08-20T01:53:01.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.014+0000 7fefa2b33740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c8d19a6e70 con 0x55c8d1a3d1a0 2024-08-20T01:53:01.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.014+0000 7fef9e4d6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8d1a3d1a0 0x55c8d1a48bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:01.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.014+0000 7fef9ecd7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c8d1a3c880 0x55c8d1a3cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:01.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.014+0000 7fef9e4d6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8d1a3d1a0 0x55c8d1a48bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:47588/0 (socket says 172.21.15.79:47588) 2024-08-20T01:53:01.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.014+0000 7fef9ecd7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c8d1a3c880 0x55c8d1a3cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50256/0 (socket says 172.21.15.79:50256) 2024-08-20T01:53:01.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.014+0000 7fef9e4d6640 1 -- 172.21.15.79:0/3787249495 learned_addr learned my addr 172.21.15.79:0/3787249495 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:01.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.014+0000 7fef9dcd5640 1 --2- 172.21.15.79:0/3787249495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8d1a49130 0x55c8d1a4b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:01.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.014+0000 7fef8f7fe640 1 --2- 172.21.15.79:0/1518116627 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fef840b3bd0 0x7fef840b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:01.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.014+0000 7fef9ecd7640 1 --2- 172.21.15.79:0/1518116627 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fef840b3bd0 0x7fef840b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:01.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.014+0000 7fef9ecd7640 1 -- 172.21.15.79:0/3787249495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8d1a3d1a0 msgr2=0x55c8d1a48bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:01.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.014+0000 7fef9ecd7640 1 --2- 172.21.15.79:0/3787249495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8d1a3d1a0 0x55c8d1a48bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:01.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.014+0000 7fef9ecd7640 1 -- 172.21.15.79:0/3787249495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8d1a49130 msgr2=0x55c8d1a4b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:01.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.014+0000 7fef9ecd7640 1 --2- 172.21.15.79:0/3787249495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8d1a49130 0x55c8d1a4b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:01.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.014+0000 7fef8f7fe640 1 -- 172.21.15.79:0/1518116627 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fef88103ef0 con 0x7fef981084b0 2024-08-20T01:53:01.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.014+0000 7fef9ecd7640 1 -- 172.21.15.79:0/3787249495 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8d1702650 con 0x55c8d1a3c880 2024-08-20T01:53:01.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.014+0000 7fef9dcd5640 1 --2- 172.21.15.79:0/3787249495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8d1a49130 0x55c8d1a4b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:53:01.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.014+0000 7fef9ecd7640 1 --2- 172.21.15.79:0/3787249495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c8d1a3c880 0x55c8d1a3cc60 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fef90013e40 tx=0x7fef9000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=770923a395e2ba1b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:01.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.015+0000 7fef8cff9640 1 -- 172.21.15.79:0/3787249495 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef90023030 con 0x55c8d1a3c880 2024-08-20T01:53:01.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.015+0000 7fef9ecd7640 1 --2- 172.21.15.79:0/1518116627 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fef840b3bd0 0x7fef840b6090 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fef90023000 tx=0x7fef90022000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:01.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.015+0000 7fef8cff9640 1 -- 172.21.15.79:0/3787249495 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fef90013820 con 0x55c8d1a3c880 2024-08-20T01:53:01.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.015+0000 7fef8cff9640 1 -- 172.21.15.79:0/3787249495 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef900056f0 con 0x55c8d1a3c880 2024-08-20T01:53:01.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.015+0000 7fefa2b33740 1 -- 172.21.15.79:0/3787249495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c8d1a3c880 msgr2=0x55c8d1a3cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:01.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.015+0000 7fefa2b33740 1 --2- 172.21.15.79:0/3787249495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c8d1a3c880 0x55c8d1a3cc60 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fef90013e40 tx=0x7fef9000f790 comp rx=0 tx=0).stop 2024-08-20T01:53:01.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.016+0000 7fefa2b33740 1 -- 172.21.15.79:0/3787249495 shutdown_connections 2024-08-20T01:53:01.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.016+0000 7fefa2b33740 1 --2- 172.21.15.79:0/3787249495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8d1a49130 0x55c8d1a4b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:01.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.016+0000 7fefa2b33740 1 --2- 172.21.15.79:0/3787249495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8d1a3d1a0 0x55c8d1a48bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:01.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.016+0000 7fefa2b33740 1 --2- 172.21.15.79:0/3787249495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c8d1a3c880 0x55c8d1a3cc60 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:01.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.016+0000 7fefa2b33740 1 -- 172.21.15.79:0/3787249495 >> 172.21.15.79:0/3787249495 conn(0x55c8d1a3a6b0 msgr2=0x55c8d1a3b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:01.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.016+0000 7fefa2b33740 1 -- 172.21.15.79:0/3787249495 shutdown_connections 2024-08-20T01:53:01.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.016+0000 7fefa2b33740 1 -- 172.21.15.79:0/3787249495 wait complete. 2024-08-20T01:53:01.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.016+0000 7fefa2b33740 1 -- start start 2024-08-20T01:53:01.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.016+0000 7fefa2b33740 1 Processor -- start 2024-08-20T01:53:01.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.016+0000 7fefa2b33740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8d1a3c880 0x55c8d1a460e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:01.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.016+0000 7fefa2b33740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c8d1a3d1a0 0x55c8d1a46620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:01.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.016+0000 7fefa2b33740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8d1a49130 0x55c8d1a46b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:01.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.016+0000 7fefa2b33740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c8d1805700 con 0x55c8d1a3d1a0 2024-08-20T01:53:01.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.016+0000 7fefa2b33740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c8d1929810 con 0x55c8d1a49130 2024-08-20T01:53:01.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.016+0000 7fefa2b33740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c8d1a4bde0 con 0x55c8d1a3c880 2024-08-20T01:53:01.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.017+0000 7fef9dcd5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c8d1a3d1a0 0x55c8d1a46620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:01.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.017+0000 7fef9e4d6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8d1a3c880 0x55c8d1a460e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:01.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.017+0000 7fefa2b33740 10 client.0 _ll_register_callbacks cb 0x55c8d199c700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:53:01.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.017+0000 7fef9dcd5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c8d1a3d1a0 0x55c8d1a46620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50268/0 (socket says 172.21.15.79:50268) 2024-08-20T01:53:01.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.017+0000 7fef9e4d6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8d1a3c880 0x55c8d1a460e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:47594/0 (socket says 172.21.15.79:47594) 2024-08-20T01:53:01.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.017+0000 7fef9dcd5640 1 -- 172.21.15.79:0/840184163 learned_addr learned my addr 172.21.15.79:0/840184163 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:01.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.017+0000 7fef9ecd7640 1 --2- 172.21.15.79:0/840184163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8d1a49130 0x55c8d1a46b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:01.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.017+0000 7fef9e4d6640 1 -- 172.21.15.79:0/840184163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8d1a49130 msgr2=0x55c8d1a46b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:01.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.017+0000 7fef9e4d6640 1 --2- 172.21.15.79:0/840184163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8d1a49130 0x55c8d1a46b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:01.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.017+0000 7fef9e4d6640 1 -- 172.21.15.79:0/840184163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c8d1a3d1a0 msgr2=0x55c8d1a46620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:01.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.017+0000 7fef9e4d6640 1 --2- 172.21.15.79:0/840184163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c8d1a3d1a0 0x55c8d1a46620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:01.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.017+0000 7fef9e4d6640 1 -- 172.21.15.79:0/840184163 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8d1a551c0 con 0x55c8d1a3c880 2024-08-20T01:53:01.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.017+0000 7fef9dcd5640 1 --2- 172.21.15.79:0/840184163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c8d1a3d1a0 0x55c8d1a46620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:53:01.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.017+0000 7fef9ecd7640 1 --2- 172.21.15.79:0/840184163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8d1a49130 0x55c8d1a46b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:53:01.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.017+0000 7fef9e4d6640 1 --2- 172.21.15.79:0/840184163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8d1a3c880 0x55c8d1a460e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55c8d1a3fa00 tx=0x7fef94012f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2f511f8230bde71 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:01.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.017+0000 7fef81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:53:01.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.017+0000 7fef81ffb640 1 -- 172.21.15.79:0/840184163 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9400fa70 con 0x55c8d1a3c880 2024-08-20T01:53:01.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.017+0000 7fef81ffb640 1 -- 172.21.15.79:0/840184163 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fef9400fc10 con 0x55c8d1a3c880 2024-08-20T01:53:01.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.017+0000 7fefa2b33740 1 -- 172.21.15.79:0/840184163 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c8d1952150 con 0x55c8d1a3c880 2024-08-20T01:53:01.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.018+0000 7fef81ffb640 1 -- 172.21.15.79:0/840184163 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fef9400fe10 con 0x55c8d1a3c880 2024-08-20T01:53:01.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.018+0000 7fefa2b33740 10 client.28417 fetch_fsmap learned FSMap version 62 2024-08-20T01:53:01.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.018+0000 7fefa2b33740 1 -- 172.21.15.79:0/840184163 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55c8d1a57bb0 con 0x55c8d1a3c880 2024-08-20T01:53:01.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.018+0000 7fef81ffb640 1 -- 172.21.15.79:0/840184163 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55c8d1952150 con 0x55c8d1a3c880 2024-08-20T01:53:01.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.018+0000 7fef81ffb640 1 -- 172.21.15.79:0/840184163 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 62) ==== 8406+0+0 (secure 0 0 0) 0x7fef9401a400 con 0x55c8d1a3c880 2024-08-20T01:53:01.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.018+0000 7fefa2b33740 10 client.28417 fetch_fsmap finished waiting for FSMap version 62 2024-08-20T01:53:01.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.018+0000 7fefa2b33740 10 client.28417 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:53:01.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.018+0000 7fefa2b33740 20 client.28417 populate_metadata read hostname 'smithi079' 2024-08-20T01:53:01.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.018+0000 7fefa2b33740 1 --2- 172.21.15.79:0/840184163 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55c8d1a590c0 0x55c8d1a5b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:01.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.018+0000 7fefa2b33740 4 client.28417 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:53:01.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.018+0000 7fefa2b33740 1 -- 172.21.15.79:0/840184163 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c8d19b5880 con 0x55c8d1a590c0 2024-08-20T01:53:01.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.018+0000 7fef9dcd5640 1 --2- 172.21.15.79:0/840184163 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55c8d1a590c0 0x55c8d1a5b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:01.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.019+0000 7fef9dcd5640 1 --2- 172.21.15.79:0/840184163 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55c8d1a590c0 0x55c8d1a5b4f0 crc :-1 s=READY pgs=322 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c6c8a3e021f77cb server_cookie=3adf52b7cbe2d0e0 in_seq=0 out_seq=0 2024-08-20T01:53:01.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.019+0000 7fef81ffb640 10 client.28417 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:53:01.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.019+0000 7fef81ffb640 1 -- 172.21.15.79:0/840184163 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c8d19b5880 con 0x55c8d1a590c0 2024-08-20T01:53:01.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.019+0000 7fef81ffb640 10 client.28417 handle_command_reply: tid=0 2024-08-20T01:53:01.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.019+0000 7fefa2b33740 1 client.28417 shutdown 2024-08-20T01:53:01.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.020+0000 7fefa2b33740 1 -- 172.21.15.79:0/840184163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8d1a3c880 msgr2=0x55c8d1a460e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:01.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.020+0000 7fefa2b33740 1 --2- 172.21.15.79:0/840184163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8d1a3c880 0x55c8d1a460e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55c8d1a3fa00 tx=0x7fef94012f70 comp rx=0 tx=0).stop 2024-08-20T01:53:01.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.020+0000 7fefa2b33740 1 -- 172.21.15.79:0/840184163 shutdown_connections 2024-08-20T01:53:01.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.020+0000 7fefa2b33740 1 --2- 172.21.15.79:0/840184163 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55c8d1a590c0 0x55c8d1a5b4f0 crc :-1 s=READY pgs=322 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:01.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.020+0000 7fefa2b33740 1 --2- 172.21.15.79:0/840184163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8d1a49130 0x55c8d1a46b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:01.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.020+0000 7fef81ffb640 0 client.28417 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:53:01.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.020+0000 7fefa2b33740 1 --2- 172.21.15.79:0/840184163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c8d1a3d1a0 0x55c8d1a46620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:01.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.020+0000 7fefa2b33740 1 --2- 172.21.15.79:0/840184163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8d1a3c880 0x55c8d1a460e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:01.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.020+0000 7fefa2b33740 1 -- 172.21.15.79:0/840184163 >> 172.21.15.79:0/840184163 conn(0x55c8d1a3a6b0 msgr2=0x55c8d1a40250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:01.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.020+0000 7fefa2b33740 1 -- 172.21.15.79:0/840184163 shutdown_connections 2024-08-20T01:53:01.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.020+0000 7fefa2b33740 1 -- 172.21.15.79:0/840184163 wait complete. 2024-08-20T01:53:01.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.020+0000 7fefa2b33740 20 client.28417 trim_cache size 0 max 16384 2024-08-20T01:53:01.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.033+0000 7fefa2b33740 1 Processor -- start 2024-08-20T01:53:01.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.033+0000 7fefa2b33740 1 -- start start 2024-08-20T01:53:01.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.034+0000 7fefa2b33740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c8d1a3c880 0x55c8d1a40a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:01.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.034+0000 7fefa2b33740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8d1a3d1a0 0x55c8d1a60dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:01.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.034+0000 7fefa2b33740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8d1a49130 0x55c8d1a61300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:01.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.034+0000 7fefa2b33740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fef981adf00 con 0x55c8d1a3c880 2024-08-20T01:53:01.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.034+0000 7fefa2b33740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fef981afbf0 con 0x55c8d1a49130 2024-08-20T01:53:01.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.034+0000 7fefa2b33740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fef981ae600 con 0x55c8d1a3d1a0 2024-08-20T01:53:01.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.034+0000 7fef9e4d6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c8d1a3c880 0x55c8d1a40a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:01.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.034+0000 7fef9e4d6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c8d1a3c880 0x55c8d1a40a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50276/0 (socket says 172.21.15.79:50276) 2024-08-20T01:53:01.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.034+0000 7fef9e4d6640 1 -- 172.21.15.79:0/877789757 learned_addr learned my addr 172.21.15.79:0/877789757 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:01.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.034+0000 7fef9ecd7640 1 --2- 172.21.15.79:0/877789757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8d1a49130 0x55c8d1a61300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:01.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.034+0000 7fef9dcd5640 1 --2- 172.21.15.79:0/877789757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8d1a3d1a0 0x55c8d1a60dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:01.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.034+0000 7fef9e4d6640 1 -- 172.21.15.79:0/877789757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8d1a3d1a0 msgr2=0x55c8d1a60dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:01.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.034+0000 7fef9e4d6640 1 --2- 172.21.15.79:0/877789757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8d1a3d1a0 0x55c8d1a60dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:01.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.034+0000 7fef9e4d6640 1 -- 172.21.15.79:0/877789757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8d1a49130 msgr2=0x55c8d1a61300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:01.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.034+0000 7fef9e4d6640 1 --2- 172.21.15.79:0/877789757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8d1a49130 0x55c8d1a61300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:01.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.034+0000 7fef9e4d6640 1 -- 172.21.15.79:0/877789757 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8d1a38af0 con 0x55c8d1a3c880 2024-08-20T01:53:01.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.034+0000 7fef9e4d6640 1 --2- 172.21.15.79:0/877789757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c8d1a3c880 0x55c8d1a40a40 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7fef9400f850 tx=0x7fef9400f880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63ddd62a62b914d2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:01.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.035+0000 7fef83fff640 1 -- 172.21.15.79:0/877789757 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9402c070 con 0x55c8d1a3c880 2024-08-20T01:53:01.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.035+0000 7fef83fff640 1 -- 172.21.15.79:0/877789757 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fef9401ab00 con 0x55c8d1a3c880 2024-08-20T01:53:01.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.035+0000 7fef83fff640 1 -- 172.21.15.79:0/877789757 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9401a370 con 0x55c8d1a3c880 2024-08-20T01:53:01.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.035+0000 7fefa2b33740 1 -- 172.21.15.79:0/877789757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c8d1a3c880 msgr2=0x55c8d1a40a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:01.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.035+0000 7fefa2b33740 1 --2- 172.21.15.79:0/877789757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c8d1a3c880 0x55c8d1a40a40 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7fef9400f850 tx=0x7fef9400f880 comp rx=0 tx=0).stop 2024-08-20T01:53:01.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.035+0000 7fefa2b33740 1 -- 172.21.15.79:0/877789757 shutdown_connections 2024-08-20T01:53:01.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.035+0000 7fefa2b33740 1 --2- 172.21.15.79:0/877789757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8d1a49130 0x55c8d1a61300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:01.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.035+0000 7fefa2b33740 1 --2- 172.21.15.79:0/877789757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8d1a3d1a0 0x55c8d1a60dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:01.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.035+0000 7fefa2b33740 1 --2- 172.21.15.79:0/877789757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c8d1a3c880 0x55c8d1a40a40 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:01.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.035+0000 7fefa2b33740 1 -- 172.21.15.79:0/877789757 >> 172.21.15.79:0/877789757 conn(0x55c8d1a3a6b0 msgr2=0x55c8d1a47f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:01.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.036+0000 7fefa2b33740 1 -- 172.21.15.79:0/877789757 shutdown_connections 2024-08-20T01:53:01.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.036+0000 7fefa2b33740 1 -- 172.21.15.79:0/877789757 wait complete. 2024-08-20T01:53:01.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.036+0000 7fefa2b33740 1 -- start start 2024-08-20T01:53:01.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.036+0000 7fefa2b33740 1 Processor -- start 2024-08-20T01:53:01.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.036+0000 7fefa2b33740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8d1a3c880 0x55c8d1a4ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:01.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.036+0000 7fefa2b33740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c8d1a3d1a0 0x55c8d1a4e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:01.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.036+0000 7fefa2b33740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8d1a49130 0x55c8d1abbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:01.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.036+0000 7fefa2b33740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fef981af460 con 0x55c8d1a3d1a0 2024-08-20T01:53:01.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.036+0000 7fefa2b33740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fef981aed60 con 0x55c8d1a49130 2024-08-20T01:53:01.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.036+0000 7fefa2b33740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fef981abee0 con 0x55c8d1a3c880 2024-08-20T01:53:01.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.036+0000 7fefa2b33740 10 client.0 _ll_register_callbacks cb 0x7fef94009d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:53:01.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.037+0000 7fef9dcd5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c8d1a3d1a0 0x55c8d1a4e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:01.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.037+0000 7fef9ecd7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8d1a49130 0x55c8d1abbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:01.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.037+0000 7fef9dcd5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c8d1a3d1a0 0x55c8d1a4e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50282/0 (socket says 172.21.15.79:50282) 2024-08-20T01:53:01.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.037+0000 7fef9dcd5640 1 -- 172.21.15.79:0/3439048394 learned_addr learned my addr 172.21.15.79:0/3439048394 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:01.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.037+0000 7fef9ecd7640 1 -- 172.21.15.79:0/3439048394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8d1a3c880 msgr2=0x55c8d1a4ddc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T01:53:01.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.037+0000 7fef9ecd7640 1 --2- 172.21.15.79:0/3439048394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8d1a3c880 0x55c8d1a4ddc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:01.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.037+0000 7fef9ecd7640 1 -- 172.21.15.79:0/3439048394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c8d1a3d1a0 msgr2=0x55c8d1a4e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:01.143 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.037+0000 7fef9ecd7640 1 --2- 172.21.15.79:0/3439048394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c8d1a3d1a0 0x55c8d1a4e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:01.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.037+0000 7fef9ecd7640 1 -- 172.21.15.79:0/3439048394 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8d1a3b5a0 con 0x55c8d1a49130 2024-08-20T01:53:01.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.037+0000 7fef9dcd5640 1 --2- 172.21.15.79:0/3439048394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c8d1a3d1a0 0x55c8d1a4e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:53:01.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.037+0000 7fef9ecd7640 1 --2- 172.21.15.79:0/3439048394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8d1a49130 0x55c8d1abbdc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fef90006010 tx=0x7fef90005230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=805e19af425a48cd server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:01.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.037+0000 7fef81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:53:01.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.037+0000 7fef81ffb640 1 -- 172.21.15.79:0/3439048394 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef90009e00 con 0x55c8d1a49130 2024-08-20T01:53:01.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.037+0000 7fefa2b33740 1 -- 172.21.15.79:0/3439048394 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef9401ab00 con 0x55c8d1a49130 2024-08-20T01:53:01.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.037+0000 7fef81ffb640 1 -- 172.21.15.79:0/3439048394 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fef90005950 con 0x55c8d1a49130 2024-08-20T01:53:01.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.038+0000 7fef81ffb640 1 -- 172.21.15.79:0/3439048394 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fef90005b50 con 0x55c8d1a49130 2024-08-20T01:53:01.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.038+0000 7fefa2b33740 10 client.28508 fetch_fsmap learned FSMap version 62 2024-08-20T01:53:01.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.038+0000 7fefa2b33740 1 -- 172.21.15.79:0/3439048394 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55c8d1ac3700 con 0x55c8d1a49130 2024-08-20T01:53:01.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.038+0000 7fef81ffb640 1 -- 172.21.15.79:0/3439048394 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fef9401ab00 con 0x55c8d1a49130 2024-08-20T01:53:01.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.038+0000 7fef81ffb640 1 -- 172.21.15.79:0/3439048394 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 62) ==== 8406+0+0 (secure 0 0 0) 0x7fef9001f480 con 0x55c8d1a49130 2024-08-20T01:53:01.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.038+0000 7fefa2b33740 10 client.28508 fetch_fsmap finished waiting for FSMap version 62 2024-08-20T01:53:01.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.038+0000 7fefa2b33740 10 client.28508 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:53:01.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.038+0000 7fefa2b33740 20 client.28508 populate_metadata read hostname 'smithi079' 2024-08-20T01:53:01.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.038+0000 7fefa2b33740 1 --2- 172.21.15.79:0/3439048394 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55c8d1ac3cc0 0x55c8d1ac60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:01.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.038+0000 7fefa2b33740 4 client.28508 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:53:01.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.038+0000 7fefa2b33740 1 -- 172.21.15.79:0/3439048394 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c8d19b1320 con 0x55c8d1ac3cc0 2024-08-20T01:53:01.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.038+0000 7fef9e4d6640 1 --2- 172.21.15.79:0/3439048394 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55c8d1ac3cc0 0x55c8d1ac60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:01.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.039+0000 7fef81ffb640 10 client.28508 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:53:01.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.039+0000 7fef9e4d6640 1 --2- 172.21.15.79:0/3439048394 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55c8d1ac3cc0 0x55c8d1ac60e0 crc :-1 s=READY pgs=323 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8835a059d0907da1 server_cookie=219c63a33e31dbe4 in_seq=0 out_seq=0 2024-08-20T01:53:01.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.039+0000 7fef81ffb640 1 -- 172.21.15.79:0/3439048394 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c8d19b1320 con 0x55c8d1ac3cc0 2024-08-20T01:53:01.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.039+0000 7fef81ffb640 10 client.28508 handle_command_reply: tid=0 2024-08-20T01:53:01.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.039+0000 7fefa2b33740 1 client.28508 shutdown 2024-08-20T01:53:01.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.039+0000 7fefa2b33740 1 -- 172.21.15.79:0/3439048394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8d1a49130 msgr2=0x55c8d1abbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:01.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.039+0000 7fefa2b33740 1 --2- 172.21.15.79:0/3439048394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8d1a49130 0x55c8d1abbdc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fef90006010 tx=0x7fef90005230 comp rx=0 tx=0).stop 2024-08-20T01:53:01.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.039+0000 7fefa2b33740 1 -- 172.21.15.79:0/3439048394 shutdown_connections 2024-08-20T01:53:01.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.039+0000 7fefa2b33740 1 --2- 172.21.15.79:0/3439048394 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55c8d1ac3cc0 0x55c8d1ac60e0 crc :-1 s=READY pgs=323 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:01.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.039+0000 7fefa2b33740 1 --2- 172.21.15.79:0/3439048394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8d1a49130 0x55c8d1abbdc0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:01.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.039+0000 7fef81ffb640 0 client.28508 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:53:01.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.039+0000 7fefa2b33740 1 --2- 172.21.15.79:0/3439048394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c8d1a3d1a0 0x55c8d1a4e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:01.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.039+0000 7fefa2b33740 1 --2- 172.21.15.79:0/3439048394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8d1a3c880 0x55c8d1a4ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:01.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.039+0000 7fefa2b33740 1 -- 172.21.15.79:0/3439048394 >> 172.21.15.79:0/3439048394 conn(0x55c8d1a3a6b0 msgr2=0x55c8d1a38f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:01.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.039+0000 7fefa2b33740 1 -- 172.21.15.79:0/3439048394 shutdown_connections 2024-08-20T01:53:01.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.039+0000 7fefa2b33740 1 -- 172.21.15.79:0/3439048394 wait complete. 2024-08-20T01:53:01.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.039+0000 7fefa2b33740 20 client.28508 trim_cache size 0 max 16384 2024-08-20T01:53:01.146 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:53:01.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.040+0000 7fefa073a640 1 -- 172.21.15.79:0/1518116627 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fef840b3bd0 msgr2=0x7fef840b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:01.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.040+0000 7fefa073a640 1 --2- 172.21.15.79:0/1518116627 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fef840b3bd0 0x7fef840b6090 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fef90023000 tx=0x7fef90022000 comp rx=0 tx=0).stop 2024-08-20T01:53:01.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.040+0000 7fefa073a640 1 -- 172.21.15.79:0/1518116627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef981084b0 msgr2=0x7fef981993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:01.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.040+0000 7fefa073a640 1 --2- 172.21.15.79:0/1518116627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef981084b0 0x7fef981993d0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fef88009230 tx=0x7fef880319a0 comp rx=0 tx=0).stop 2024-08-20T01:53:01.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.040+0000 7fefa073a640 1 -- 172.21.15.79:0/1518116627 shutdown_connections 2024-08-20T01:53:01.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.040+0000 7fefa073a640 1 --2- 172.21.15.79:0/1518116627 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fef840b3bd0 0x7fef840b6090 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:01.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.040+0000 7fefa073a640 1 --2- 172.21.15.79:0/1518116627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef98108e30 0x7fef9819e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:01.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.040+0000 7fefa073a640 1 --2- 172.21.15.79:0/1518116627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef981084b0 0x7fef981993d0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:01.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.040+0000 7fefa073a640 1 --2- 172.21.15.79:0/1518116627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef98102aa0 0x7fef98198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:01.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.040+0000 7fefa073a640 1 -- 172.21.15.79:0/1518116627 >> 172.21.15.79:0/1518116627 conn(0x7fef980fe550 msgr2=0x7fef98100940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:01.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.041+0000 7fefa073a640 1 -- 172.21.15.79:0/1518116627 shutdown_connections 2024-08-20T01:53:01.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:01.041+0000 7fefa073a640 1 -- 172.21.15.79:0/1518116627 wait complete. 2024-08-20T01:53:01.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:01 smithi079 ceph-mon[18656]: pgmap v818: 97 pgs: 97 active+clean; 7.5 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 7.5 KiB/s wr, 20 op/s 2024-08-20T01:53:01.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:01 smithi079 ceph-mon[18656]: Health check update: 8 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-08-20T01:53:02.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:01 smithi081 ceph-mon[22209]: pgmap v818: 97 pgs: 97 active+clean; 7.5 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 7.5 KiB/s wr, 20 op/s 2024-08-20T01:53:02.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:01 smithi081 ceph-mon[22209]: Health check update: 8 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-08-20T01:53:02.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:01 smithi175 ceph-mon[22392]: pgmap v818: 97 pgs: 97 active+clean; 7.5 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 7.5 KiB/s wr, 20 op/s 2024-08-20T01:53:02.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:01 smithi175 ceph-mon[22392]: Health check update: 8 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-08-20T01:53:03.087 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T01:53:03.088 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T01:53:03.339 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:53:03.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.836+0000 7fbfd169a640 1 -- 172.21.15.79:0/2899159694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbfcc1084e0 msgr2=0x7fbfcc108920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:03.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.836+0000 7fbfd169a640 1 --2- 172.21.15.79:0/2899159694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbfcc1084e0 0x7fbfcc108920 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4009900 tx=0x7fbfb402a410 comp rx=0 tx=0).stop 2024-08-20T01:53:03.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.836+0000 7fbfd169a640 1 -- 172.21.15.79:0/2899159694 shutdown_connections 2024-08-20T01:53:03.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.836+0000 7fbfd169a640 1 --2- 172.21.15.79:0/2899159694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbfcc108e60 0x7fbfcc10f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:03.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.836+0000 7fbfd169a640 1 --2- 172.21.15.79:0/2899159694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbfcc1084e0 0x7fbfcc108920 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:03.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.836+0000 7fbfd169a640 1 --2- 172.21.15.79:0/2899159694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfcc102ad0 0x7fbfcc102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:03.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.836+0000 7fbfd169a640 1 -- 172.21.15.79:0/2899159694 >> 172.21.15.79:0/2899159694 conn(0x7fbfcc0fe540 msgr2=0x7fbfcc100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:03.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.836+0000 7fbfd169a640 1 -- 172.21.15.79:0/2899159694 shutdown_connections 2024-08-20T01:53:03.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.836+0000 7fbfd169a640 1 -- 172.21.15.79:0/2899159694 wait complete. 2024-08-20T01:53:03.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.837+0000 7fbfd169a640 1 Processor -- start 2024-08-20T01:53:03.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.837+0000 7fbfd169a640 1 -- start start 2024-08-20T01:53:03.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.837+0000 7fbfd169a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbfcc102ad0 0x7fbfcc0751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:03.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.837+0000 7fbfd169a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfcc1084e0 0x7fbfcc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:03.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.837+0000 7fbfd169a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbfcc108e60 0x7fbfcc075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:03.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.837+0000 7fbfd169a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbfcc112990 con 0x7fbfcc102ad0 2024-08-20T01:53:03.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.837+0000 7fbfd169a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbfcc112810 con 0x7fbfcc1084e0 2024-08-20T01:53:03.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.837+0000 7fbfd169a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbfcc112b10 con 0x7fbfcc108e60 2024-08-20T01:53:03.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.837+0000 7fbfcaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbfcc102ad0 0x7fbfcc0751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:03.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.837+0000 7fbfcaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbfcc102ad0 0x7fbfcc0751d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50306/0 (socket says 172.21.15.79:50306) 2024-08-20T01:53:03.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.837+0000 7fbfcaffd640 1 -- 172.21.15.79:0/3559030343 learned_addr learned my addr 172.21.15.79:0/3559030343 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:03.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.838+0000 7fbfc27fc640 1 --2- 172.21.15.79:0/3559030343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfcc1084e0 0x7fbfcc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:03.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.838+0000 7fbfcb7fe640 1 --2- 172.21.15.79:0/3559030343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbfcc108e60 0x7fbfcc075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:03.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.838+0000 7fbfcaffd640 1 -- 172.21.15.79:0/3559030343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbfcc108e60 msgr2=0x7fbfcc075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:03.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.838+0000 7fbfcaffd640 1 --2- 172.21.15.79:0/3559030343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbfcc108e60 0x7fbfcc075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:03.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.838+0000 7fbfcaffd640 1 -- 172.21.15.79:0/3559030343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfcc1084e0 msgr2=0x7fbfcc075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:03.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.838+0000 7fbfcaffd640 1 --2- 172.21.15.79:0/3559030343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfcc1084e0 0x7fbfcc075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:03.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.838+0000 7fbfcaffd640 1 -- 172.21.15.79:0/3559030343 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfcc1a72c0 con 0x7fbfcc102ad0 2024-08-20T01:53:03.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.838+0000 7fbfcaffd640 1 --2- 172.21.15.79:0/3559030343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbfcc102ad0 0x7fbfcc0751d0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc00e9f0 tx=0x7fbfbc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:03.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.838+0000 7fbfc8ff9640 1 -- 172.21.15.79:0/3559030343 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc00cd80 con 0x7fbfcc102ad0 2024-08-20T01:53:03.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.838+0000 7fbfc8ff9640 1 -- 172.21.15.79:0/3559030343 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbfbc0108c0 con 0x7fbfcc102ad0 2024-08-20T01:53:03.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.838+0000 7fbfd169a640 1 -- 172.21.15.79:0/3559030343 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfcc1a75b0 con 0x7fbfcc102ad0 2024-08-20T01:53:03.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.838+0000 7fbfc8ff9640 1 -- 172.21.15.79:0/3559030343 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc0187c0 con 0x7fbfcc102ad0 2024-08-20T01:53:03.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.838+0000 7fbfd169a640 1 -- 172.21.15.79:0/3559030343 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfcc1a7b10 con 0x7fbfcc102ad0 2024-08-20T01:53:03.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.840+0000 7fbfc8ff9640 1 -- 172.21.15.79:0/3559030343 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fbfbc010430 con 0x7fbfcc102ad0 2024-08-20T01:53:03.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.841+0000 7fbfd3a93740 1 Processor -- start 2024-08-20T01:53:03.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.841+0000 7fbfd3a93740 1 -- start start 2024-08-20T01:53:03.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.841+0000 7fbfd3a93740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557341a803b0 0x557341a80790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:03.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.841+0000 7fbfd3a93740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557341a80cd0 0x557341a8c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:03.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.841+0000 7fbfd3a93740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557341a8cc60 0x557341a8f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:03.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.841+0000 7fbfd3a93740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5573419f6940 con 0x557341a80cd0 2024-08-20T01:53:03.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.841+0000 7fbfd3a93740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5573419e5e40 con 0x557341a8cc60 2024-08-20T01:53:03.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.841+0000 7fbfd3a93740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5573419e9e80 con 0x557341a803b0 2024-08-20T01:53:03.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.841+0000 7fbfcaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557341a80cd0 0x557341a8c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:03.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.841+0000 7fbfc8ff9640 1 --2- 172.21.15.79:0/3559030343 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbfb80b3c50 0x7fbfb80b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:03.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.841+0000 7fbfcaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557341a80cd0 0x557341a8c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50310/0 (socket says 172.21.15.79:50310) 2024-08-20T01:53:03.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.841+0000 7fbfc27fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557341a8cc60 0x557341a8f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:03.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.841+0000 7fbfcaffd640 1 -- 172.21.15.79:0/34740291 learned_addr learned my addr 172.21.15.79:0/34740291 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:03.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.841+0000 7fbfcb7fe640 1 --2- 172.21.15.79:0/34740291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557341a803b0 0x557341a80790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:03.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.842+0000 7fbfcb7fe640 1 --2- 172.21.15.79:0/3559030343 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbfb80b3c50 0x7fbfb80b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:03.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.842+0000 7fbfc27fc640 1 -- 172.21.15.79:0/34740291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557341a803b0 msgr2=0x557341a80790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:03.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.842+0000 7fbfc27fc640 1 --2- 172.21.15.79:0/34740291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557341a803b0 0x557341a80790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:03.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.842+0000 7fbfc27fc640 1 -- 172.21.15.79:0/34740291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557341a80cd0 msgr2=0x557341a8c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:03.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.842+0000 7fbfc27fc640 1 --2- 172.21.15.79:0/34740291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557341a80cd0 0x557341a8c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:03.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.842+0000 7fbfc8ff9640 1 -- 172.21.15.79:0/3559030343 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fbfbc0e3f20 con 0x7fbfcc102ad0 2024-08-20T01:53:03.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.842+0000 7fbfc27fc640 1 -- 172.21.15.79:0/34740291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557341982520 con 0x557341a8cc60 2024-08-20T01:53:03.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.842+0000 7fbfcb7fe640 1 --2- 172.21.15.79:0/34740291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557341a803b0 0x557341a80790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:53:03.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.842+0000 7fbfcaffd640 1 --2- 172.21.15.79:0/34740291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557341a80cd0 0x557341a8c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:53:03.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.842+0000 7fbfc27fc640 1 --2- 172.21.15.79:0/34740291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557341a8cc60 0x557341a8f050 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4005940 tx=0x7fbfb4005c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2e8ddf740e842b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:03.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.842+0000 7fbfcb7fe640 1 --2- 172.21.15.79:0/3559030343 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbfb80b3c50 0x7fbfb80b6110 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4005c40 tx=0x7fbfc4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:03.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.842+0000 7fbfc17fa640 1 -- 172.21.15.79:0/34740291 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb4035030 con 0x557341a8cc60 2024-08-20T01:53:03.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.842+0000 7fbfc17fa640 1 -- 172.21.15.79:0/34740291 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbfb4040070 con 0x557341a8cc60 2024-08-20T01:53:03.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.842+0000 7fbfc17fa640 1 -- 172.21.15.79:0/34740291 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb40037f0 con 0x557341a8cc60 2024-08-20T01:53:03.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.843+0000 7fbfd3a93740 1 -- 172.21.15.79:0/34740291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557341a8cc60 msgr2=0x557341a8f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:03.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.843+0000 7fbfd3a93740 1 --2- 172.21.15.79:0/34740291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557341a8cc60 0x557341a8f050 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4005940 tx=0x7fbfb4005c00 comp rx=0 tx=0).stop 2024-08-20T01:53:03.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.843+0000 7fbfd3a93740 1 -- 172.21.15.79:0/34740291 shutdown_connections 2024-08-20T01:53:03.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.843+0000 7fbfd3a93740 1 --2- 172.21.15.79:0/34740291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557341a8cc60 0x557341a8f050 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:03.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.843+0000 7fbfd3a93740 1 --2- 172.21.15.79:0/34740291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557341a80cd0 0x557341a8c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:03.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.843+0000 7fbfd3a93740 1 --2- 172.21.15.79:0/34740291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557341a803b0 0x557341a80790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:03.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.843+0000 7fbfd3a93740 1 -- 172.21.15.79:0/34740291 >> 172.21.15.79:0/34740291 conn(0x557341a7e1e0 msgr2=0x557341a7f380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:03.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.843+0000 7fbfd3a93740 1 -- 172.21.15.79:0/34740291 shutdown_connections 2024-08-20T01:53:03.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.843+0000 7fbfd3a93740 1 -- 172.21.15.79:0/34740291 wait complete. 2024-08-20T01:53:03.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.843+0000 7fbfd3a93740 1 -- start start 2024-08-20T01:53:03.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.844+0000 7fbfd3a93740 1 Processor -- start 2024-08-20T01:53:03.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.844+0000 7fbfd3a93740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557341a803b0 0x557341a89c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:03.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.844+0000 7fbfd3a93740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557341a80cd0 0x557341a8a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:03.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.844+0000 7fbfd3a93740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557341a8cc60 0x557341a8a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:03.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.844+0000 7fbfd3a93740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557341848890 con 0x557341a80cd0 2024-08-20T01:53:03.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.844+0000 7fbfd3a93740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55734196c700 con 0x557341a803b0 2024-08-20T01:53:03.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.844+0000 7fbfd3a93740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557341a8f950 con 0x557341a8cc60 2024-08-20T01:53:03.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.844+0000 7fbfd3a93740 10 client.0 _ll_register_callbacks cb 0x5573419e16f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:53:03.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.844+0000 7fbfc27fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557341a80cd0 0x557341a8a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:03.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.844+0000 7fbfc27fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557341a80cd0 0x557341a8a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50324/0 (socket says 172.21.15.79:50324) 2024-08-20T01:53:03.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.844+0000 7fbfc27fc640 1 -- 172.21.15.79:0/2012172343 learned_addr learned my addr 172.21.15.79:0/2012172343 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:03.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.844+0000 7fbfcb7fe640 1 --2- 172.21.15.79:0/2012172343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557341a8cc60 0x557341a8a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:03.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.844+0000 7fbfcaffd640 1 --2- 172.21.15.79:0/2012172343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557341a803b0 0x557341a89c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:03.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.844+0000 7fbfc27fc640 1 -- 172.21.15.79:0/2012172343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557341a8cc60 msgr2=0x557341a8a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:03.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.844+0000 7fbfc27fc640 1 --2- 172.21.15.79:0/2012172343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557341a8cc60 0x557341a8a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:03.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.844+0000 7fbfc27fc640 1 -- 172.21.15.79:0/2012172343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557341a803b0 msgr2=0x557341a89c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:03.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.844+0000 7fbfc27fc640 1 --2- 172.21.15.79:0/2012172343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557341a803b0 0x557341a89c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:03.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.844+0000 7fbfc27fc640 1 -- 172.21.15.79:0/2012172343 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557341745930 con 0x557341a80cd0 2024-08-20T01:53:03.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.844+0000 7fbfcb7fe640 1 --2- 172.21.15.79:0/2012172343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557341a8cc60 0x557341a8a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:53:03.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.844+0000 7fbfcaffd640 1 --2- 172.21.15.79:0/2012172343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557341a803b0 0x557341a89c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:53:03.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.844+0000 7fbfc27fc640 1 --2- 172.21.15.79:0/2012172343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557341a80cd0 0x557341a8a1c0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4009a20 tx=0x7fbfb4009660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d93eeb03fe9bdb3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:03.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.844+0000 7fbfb27fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:53:03.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.845+0000 7fbfb27fc640 1 -- 172.21.15.79:0/2012172343 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb404c070 con 0x557341a80cd0 2024-08-20T01:53:03.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.845+0000 7fbfb27fc640 1 -- 172.21.15.79:0/2012172343 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fbfb4031810 con 0x557341a80cd0 2024-08-20T01:53:03.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.845+0000 7fbfd3a93740 1 -- 172.21.15.79:0/2012172343 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfb4040070 con 0x557341a80cd0 2024-08-20T01:53:03.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.845+0000 7fbfb27fc640 1 -- 172.21.15.79:0/2012172343 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7fbfb4058050 con 0x557341a80cd0 2024-08-20T01:53:03.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.845+0000 7fbfd3a93740 10 client.19422 fetch_fsmap learned FSMap version 63 2024-08-20T01:53:03.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.845+0000 7fbfd3a93740 1 -- 172.21.15.79:0/2012172343 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x557341a9b560 con 0x557341a80cd0 2024-08-20T01:53:03.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.845+0000 7fbfb27fc640 1 -- 172.21.15.79:0/2012172343 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbfb4040070 con 0x557341a80cd0 2024-08-20T01:53:03.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.845+0000 7fbfb27fc640 1 -- 172.21.15.79:0/2012172343 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 63) ==== 8402+0+0 (secure 0 0 0) 0x7fbfb4044510 con 0x557341a80cd0 2024-08-20T01:53:03.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.845+0000 7fbfd3a93740 10 client.19422 fetch_fsmap finished waiting for FSMap version 63 2024-08-20T01:53:03.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.845+0000 7fbfd3a93740 10 client.19422 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:53:03.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.845+0000 7fbfd3a93740 20 client.19422 populate_metadata read hostname 'smithi079' 2024-08-20T01:53:03.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.845+0000 7fbfd3a93740 1 --2- 172.21.15.79:0/2012172343 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557341a9c8b0 0x557341a9eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:03.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.845+0000 7fbfd3a93740 4 client.19422 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:53:03.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.845+0000 7fbfd3a93740 1 -- 172.21.15.79:0/2012172343 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5573419f8890 con 0x557341a9c8b0 2024-08-20T01:53:03.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.846+0000 7fbfcaffd640 1 --2- 172.21.15.79:0/2012172343 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557341a9c8b0 0x557341a9eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:03.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.846+0000 7fbfcaffd640 1 --2- 172.21.15.79:0/2012172343 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557341a9c8b0 0x557341a9eca0 crc :-1 s=READY pgs=324 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11f660c144bb5083 server_cookie=a4242bb374d431f2 in_seq=0 out_seq=0 2024-08-20T01:53:03.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.846+0000 7fbfb27fc640 10 client.19422 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:53:03.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.846+0000 7fbfb27fc640 1 -- 172.21.15.79:0/2012172343 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fbfbc0bae80 con 0x557341a9c8b0 2024-08-20T01:53:03.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.846+0000 7fbfb27fc640 10 client.19422 handle_command_reply: tid=0 2024-08-20T01:53:03.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.846+0000 7fbfd3a93740 1 client.19422 shutdown 2024-08-20T01:53:03.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.847+0000 7fbfd3a93740 1 -- 172.21.15.79:0/2012172343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557341a80cd0 msgr2=0x557341a8a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:03.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.847+0000 7fbfd3a93740 1 --2- 172.21.15.79:0/2012172343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557341a80cd0 0x557341a8a1c0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4009a20 tx=0x7fbfb4009660 comp rx=0 tx=0).stop 2024-08-20T01:53:03.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.847+0000 7fbfd3a93740 1 -- 172.21.15.79:0/2012172343 shutdown_connections 2024-08-20T01:53:03.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.847+0000 7fbfd3a93740 1 --2- 172.21.15.79:0/2012172343 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557341a9c8b0 0x557341a9eca0 crc :-1 s=READY pgs=324 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:03.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.847+0000 7fbfd3a93740 1 --2- 172.21.15.79:0/2012172343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557341a8cc60 0x557341a8a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:03.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.847+0000 7fbfd3a93740 1 --2- 172.21.15.79:0/2012172343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557341a80cd0 0x557341a8a1c0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:03.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.847+0000 7fbfb27fc640 0 client.19422 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:53:03.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.847+0000 7fbfd3a93740 1 --2- 172.21.15.79:0/2012172343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557341a803b0 0x557341a89c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:03.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.847+0000 7fbfd3a93740 1 -- 172.21.15.79:0/2012172343 >> 172.21.15.79:0/2012172343 conn(0x557341a7e1e0 msgr2=0x557341a83d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:03.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.847+0000 7fbfd3a93740 1 -- 172.21.15.79:0/2012172343 shutdown_connections 2024-08-20T01:53:03.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.847+0000 7fbfd3a93740 1 -- 172.21.15.79:0/2012172343 wait complete. 2024-08-20T01:53:03.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.847+0000 7fbfd3a93740 20 client.19422 trim_cache size 0 max 16384 2024-08-20T01:53:03.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.865+0000 7fbfd3a93740 1 Processor -- start 2024-08-20T01:53:03.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.865+0000 7fbfd3a93740 1 -- start start 2024-08-20T01:53:03.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.865+0000 7fbfd3a93740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557341a803b0 0x557341aa42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:03.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.865+0000 7fbfd3a93740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557341a80cd0 0x557341aa47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:03.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.865+0000 7fbfd3a93740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557341a8cc60 0x557341a86e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:03.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.865+0000 7fbfd3a93740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbfcc1b0240 con 0x557341a803b0 2024-08-20T01:53:03.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.865+0000 7fbfd3a93740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbfcc1b1f00 con 0x557341a80cd0 2024-08-20T01:53:03.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.865+0000 7fbfd3a93740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbfcc1b0910 con 0x557341a8cc60 2024-08-20T01:53:03.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.865+0000 7fbfcaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557341a803b0 0x557341aa42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:03.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.865+0000 7fbfcaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557341a803b0 0x557341aa42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50330/0 (socket says 172.21.15.79:50330) 2024-08-20T01:53:03.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.865+0000 7fbfcaffd640 1 -- 172.21.15.79:0/4270049391 learned_addr learned my addr 172.21.15.79:0/4270049391 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:03.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.865+0000 7fbfc27fc640 1 --2- 172.21.15.79:0/4270049391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557341a80cd0 0x557341aa47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:03.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.865+0000 7fbfcb7fe640 1 --2- 172.21.15.79:0/4270049391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557341a8cc60 0x557341a86e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:03.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.866+0000 7fbfcaffd640 1 -- 172.21.15.79:0/4270049391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557341a8cc60 msgr2=0x557341a86e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:03.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.866+0000 7fbfcaffd640 1 --2- 172.21.15.79:0/4270049391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557341a8cc60 0x557341a86e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:03.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.866+0000 7fbfcaffd640 1 -- 172.21.15.79:0/4270049391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557341a80cd0 msgr2=0x557341aa47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:03.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.866+0000 7fbfcaffd640 1 --2- 172.21.15.79:0/4270049391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557341a80cd0 0x557341aa47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:03.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.866+0000 7fbfcaffd640 1 -- 172.21.15.79:0/4270049391 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557341a88be0 con 0x557341a803b0 2024-08-20T01:53:03.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.866+0000 7fbfcaffd640 1 --2- 172.21.15.79:0/4270049391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557341a803b0 0x557341aa42a0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc00e9c0 tx=0x7fbfbc0aae30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1967fae78d73593 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:03.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.866+0000 7fbfc0ff9640 1 -- 172.21.15.79:0/4270049391 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc0af480 con 0x557341a803b0 2024-08-20T01:53:03.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.866+0000 7fbfc0ff9640 1 -- 172.21.15.79:0/4270049391 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5573419f8890 con 0x557341a803b0 2024-08-20T01:53:03.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.866+0000 7fbfc0ff9640 1 -- 172.21.15.79:0/4270049391 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc0b3aa0 con 0x557341a803b0 2024-08-20T01:53:03.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.867+0000 7fbfd3a93740 1 -- 172.21.15.79:0/4270049391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557341a803b0 msgr2=0x557341aa42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:03.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.867+0000 7fbfd3a93740 1 --2- 172.21.15.79:0/4270049391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557341a803b0 0x557341aa42a0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc00e9c0 tx=0x7fbfbc0aae30 comp rx=0 tx=0).stop 2024-08-20T01:53:03.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.867+0000 7fbfd3a93740 1 -- 172.21.15.79:0/4270049391 shutdown_connections 2024-08-20T01:53:03.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.867+0000 7fbfd3a93740 1 --2- 172.21.15.79:0/4270049391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557341a8cc60 0x557341a86e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:03.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.867+0000 7fbfd3a93740 1 --2- 172.21.15.79:0/4270049391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557341a80cd0 0x557341aa47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:03.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.867+0000 7fbfd3a93740 1 --2- 172.21.15.79:0/4270049391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557341a803b0 0x557341aa42a0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:03.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.867+0000 7fbfd3a93740 1 -- 172.21.15.79:0/4270049391 >> 172.21.15.79:0/4270049391 conn(0x557341a7e1e0 msgr2=0x557341a8bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:03.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.867+0000 7fbfd3a93740 1 -- 172.21.15.79:0/4270049391 shutdown_connections 2024-08-20T01:53:03.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.867+0000 7fbfd3a93740 1 -- 172.21.15.79:0/4270049391 wait complete. 2024-08-20T01:53:03.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.867+0000 7fbfd3a93740 1 -- start start 2024-08-20T01:53:03.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.867+0000 7fbfd3a93740 1 Processor -- start 2024-08-20T01:53:03.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.867+0000 7fbfd3a93740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557341a803b0 0x557341a911d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:03.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.868+0000 7fbfd3a93740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557341a80cd0 0x557341a91710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:03.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.868+0000 7fbfd3a93740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557341a8cc60 0x557341b06270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:03.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.868+0000 7fbfd3a93740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbfcc1b1770 con 0x557341a803b0 2024-08-20T01:53:03.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.868+0000 7fbfd3a93740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbfcc1b1070 con 0x557341a80cd0 2024-08-20T01:53:03.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.868+0000 7fbfd3a93740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbfcc1ae220 con 0x557341a8cc60 2024-08-20T01:53:03.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.868+0000 7fbfd3a93740 10 client.0 _ll_register_callbacks cb 0x7fbfbc0aad00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:53:03.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.868+0000 7fbfcaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557341a803b0 0x557341a911d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:03.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.868+0000 7fbfcaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557341a803b0 0x557341a911d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50340/0 (socket says 172.21.15.79:50340) 2024-08-20T01:53:03.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.868+0000 7fbfcaffd640 1 -- 172.21.15.79:0/1687010025 learned_addr learned my addr 172.21.15.79:0/1687010025 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:03.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.868+0000 7fbfc27fc640 1 --2- 172.21.15.79:0/1687010025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557341a80cd0 0x557341a91710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:03.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.868+0000 7fbfcb7fe640 1 --2- 172.21.15.79:0/1687010025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557341a8cc60 0x557341b06270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:03.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.868+0000 7fbfcaffd640 1 -- 172.21.15.79:0/1687010025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557341a8cc60 msgr2=0x557341b06270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:03.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.868+0000 7fbfcaffd640 1 --2- 172.21.15.79:0/1687010025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557341a8cc60 0x557341b06270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:03.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.868+0000 7fbfcaffd640 1 -- 172.21.15.79:0/1687010025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557341a80cd0 msgr2=0x557341a91710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:03.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.868+0000 7fbfcaffd640 1 --2- 172.21.15.79:0/1687010025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557341a80cd0 0x557341a91710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:03.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.868+0000 7fbfcaffd640 1 -- 172.21.15.79:0/1687010025 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557341b06880 con 0x557341a803b0 2024-08-20T01:53:03.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.868+0000 7fbfcb7fe640 1 --2- 172.21.15.79:0/1687010025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557341a8cc60 0x557341b06270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:53:03.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.868+0000 7fbfcaffd640 1 --2- 172.21.15.79:0/1687010025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557341a803b0 0x557341a911d0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc0e1a80 tx=0x7fbfbc0ab080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4fc46c4e9271160 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:03.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.868+0000 7fbfb27fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:53:03.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.868+0000 7fbfb27fc640 1 -- 172.21.15.79:0/1687010025 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc0c4070 con 0x557341a803b0 2024-08-20T01:53:03.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.868+0000 7fbfb27fc640 1 -- 172.21.15.79:0/1687010025 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fbfbc0a71c0 con 0x557341a803b0 2024-08-20T01:53:03.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.868+0000 7fbfd3a93740 1 -- 172.21.15.79:0/1687010025 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5573419f8890 con 0x557341a803b0 2024-08-20T01:53:03.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.869+0000 7fbfb27fc640 1 -- 172.21.15.79:0/1687010025 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7fbfbc0af480 con 0x557341a803b0 2024-08-20T01:53:03.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.869+0000 7fbfd3a93740 10 client.19428 fetch_fsmap learned FSMap version 63 2024-08-20T01:53:03.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.869+0000 7fbfd3a93740 1 -- 172.21.15.79:0/1687010025 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x557341b07bc0 con 0x557341a803b0 2024-08-20T01:53:03.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.869+0000 7fbfb27fc640 1 -- 172.21.15.79:0/1687010025 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbfbc0b5020 con 0x557341a803b0 2024-08-20T01:53:03.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.869+0000 7fbfb27fc640 1 -- 172.21.15.79:0/1687010025 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 63) ==== 8402+0+0 (secure 0 0 0) 0x7fbfbc0a9c00 con 0x557341a803b0 2024-08-20T01:53:03.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.869+0000 7fbfd3a93740 10 client.19428 fetch_fsmap finished waiting for FSMap version 63 2024-08-20T01:53:03.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.869+0000 7fbfd3a93740 10 client.19428 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:53:03.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.869+0000 7fbfd3a93740 20 client.19428 populate_metadata read hostname 'smithi079' 2024-08-20T01:53:03.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.869+0000 7fbfd3a93740 1 --2- 172.21.15.79:0/1687010025 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557341b082e0 0x557341b0a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:03.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.869+0000 7fbfd3a93740 4 client.19428 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T01:53:03.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.869+0000 7fbfd3a93740 1 -- 172.21.15.79:0/1687010025 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5573419f4330 con 0x557341b082e0 2024-08-20T01:53:03.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.869+0000 7fbfc27fc640 1 --2- 172.21.15.79:0/1687010025 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557341b082e0 0x557341b0a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:03.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.870+0000 7fbfb27fc640 10 client.19428 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:53:03.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.870+0000 7fbfc27fc640 1 --2- 172.21.15.79:0/1687010025 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557341b082e0 0x557341b0a700 crc :-1 s=READY pgs=325 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99770d8448571ec3 server_cookie=7c3b82afdd159e8d in_seq=0 out_seq=0 2024-08-20T01:53:03.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.871+0000 7fbfb27fc640 1 -- 172.21.15.79:0/1687010025 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5573419f4330 con 0x557341b082e0 2024-08-20T01:53:03.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.871+0000 7fbfb27fc640 10 client.19428 handle_command_reply: tid=0 2024-08-20T01:53:03.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.871+0000 7fbfd3a93740 1 client.19428 shutdown 2024-08-20T01:53:03.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.871+0000 7fbfd3a93740 1 -- 172.21.15.79:0/1687010025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557341a803b0 msgr2=0x557341a911d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:03.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.871+0000 7fbfd3a93740 1 --2- 172.21.15.79:0/1687010025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557341a803b0 0x557341a911d0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc0e1a80 tx=0x7fbfbc0ab080 comp rx=0 tx=0).stop 2024-08-20T01:53:03.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.871+0000 7fbfd3a93740 1 -- 172.21.15.79:0/1687010025 shutdown_connections 2024-08-20T01:53:03.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.871+0000 7fbfd3a93740 1 --2- 172.21.15.79:0/1687010025 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x557341b082e0 0x557341b0a700 crc :-1 s=READY pgs=325 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:03.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.871+0000 7fbfd3a93740 1 --2- 172.21.15.79:0/1687010025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557341a8cc60 0x557341b06270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:03.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.871+0000 7fbfd3a93740 1 --2- 172.21.15.79:0/1687010025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557341a80cd0 0x557341a91710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:03.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.871+0000 7fbfb27fc640 0 client.19428 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:53:03.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.871+0000 7fbfd3a93740 1 --2- 172.21.15.79:0/1687010025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557341a803b0 0x557341a911d0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:03.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.871+0000 7fbfd3a93740 1 -- 172.21.15.79:0/1687010025 >> 172.21.15.79:0/1687010025 conn(0x557341a7e1e0 msgr2=0x557341a89bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:03.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.871+0000 7fbfd3a93740 1 -- 172.21.15.79:0/1687010025 shutdown_connections 2024-08-20T01:53:03.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.871+0000 7fbfd3a93740 1 -- 172.21.15.79:0/1687010025 wait complete. 2024-08-20T01:53:03.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.871+0000 7fbfd3a93740 20 client.19428 trim_cache size 0 max 16384 2024-08-20T01:53:03.879 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:53:03.879 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-08-20T01:53:03.879 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "6f75046f-e190-41b1-ab0c-c0d87ab024a2", 2024-08-20T01:53:03.879 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-08-20T01:53:03.879 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:53:03.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.872+0000 7fbfd169a640 1 -- 172.21.15.79:0/3559030343 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbfb80b3c50 msgr2=0x7fbfb80b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:03.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.872+0000 7fbfd169a640 1 --2- 172.21.15.79:0/3559030343 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbfb80b3c50 0x7fbfb80b6110 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4005c40 tx=0x7fbfc4009500 comp rx=0 tx=0).stop 2024-08-20T01:53:03.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.872+0000 7fbfd169a640 1 -- 172.21.15.79:0/3559030343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbfcc102ad0 msgr2=0x7fbfcc0751d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:03.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.872+0000 7fbfd169a640 1 --2- 172.21.15.79:0/3559030343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbfcc102ad0 0x7fbfcc0751d0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc00e9f0 tx=0x7fbfbc00eeb0 comp rx=0 tx=0).stop 2024-08-20T01:53:03.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.872+0000 7fbfd169a640 1 -- 172.21.15.79:0/3559030343 shutdown_connections 2024-08-20T01:53:03.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.872+0000 7fbfd169a640 1 --2- 172.21.15.79:0/3559030343 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fbfb80b3c50 0x7fbfb80b6110 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:03.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.872+0000 7fbfd169a640 1 --2- 172.21.15.79:0/3559030343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbfcc108e60 0x7fbfcc075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:03.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.872+0000 7fbfd169a640 1 --2- 172.21.15.79:0/3559030343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfcc1084e0 0x7fbfcc075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:03.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.872+0000 7fbfd169a640 1 --2- 172.21.15.79:0/3559030343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbfcc102ad0 0x7fbfcc0751d0 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:03.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.872+0000 7fbfd169a640 1 -- 172.21.15.79:0/3559030343 >> 172.21.15.79:0/3559030343 conn(0x7fbfcc0fe540 msgr2=0x7fbfcc100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:03.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.872+0000 7fbfd169a640 1 -- 172.21.15.79:0/3559030343 shutdown_connections 2024-08-20T01:53:03.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:03.872+0000 7fbfd169a640 1 -- 172.21.15.79:0/3559030343 wait complete. 2024-08-20T01:53:04.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:03 smithi175 ceph-mon[22392]: pgmap v819: 97 pgs: 97 active+clean; 7.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.2 KiB/s wr, 18 op/s 2024-08-20T01:53:04.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:03 smithi079 ceph-mon[18656]: pgmap v819: 97 pgs: 97 active+clean; 7.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.2 KiB/s wr, 18 op/s 2024-08-20T01:53:04.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:03 smithi081 ceph-mon[22209]: pgmap v819: 97 pgs: 97 active+clean; 7.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.2 KiB/s wr, 18 op/s 2024-08-20T01:53:04.772 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:53:05.027 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:53:05.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:04 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:53:05.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:04 smithi175 ceph-mon[22392]: scrub queued for path: / 2024-08-20T01:53:05.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:04 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:53:05.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:04 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:53:05.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:04 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:53:05.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:04 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:53:05.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:04 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:53:05.147 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:04 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:53:05.147 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:04 smithi079 ceph-mon[18656]: scrub queued for path: / 2024-08-20T01:53:05.147 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:04 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:53:05.147 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:04 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:53:05.147 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:04 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:53:05.147 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:04 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:53:05.147 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:04 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:53:05.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:04 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:53:05.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:04 smithi081 ceph-mon[22209]: scrub queued for path: / 2024-08-20T01:53:05.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:04 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:53:05.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:04 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:53:05.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:04 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:53:05.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:04 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:53:05.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:04 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:53:05.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.571+0000 7f25e6f08640 1 -- 172.21.15.79:0/143226407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25e01084a0 msgr2=0x7f25e01088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:05.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.571+0000 7f25e6f08640 1 --2- 172.21.15.79:0/143226407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25e01084a0 0x7f25e01088e0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f25cc009900 tx=0x7f25cc02a410 comp rx=0 tx=0).stop 2024-08-20T01:53:05.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.571+0000 7f25e6f08640 1 -- 172.21.15.79:0/143226407 shutdown_connections 2024-08-20T01:53:05.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.571+0000 7f25e6f08640 1 --2- 172.21.15.79:0/143226407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25e0108e20 0x7f25e010f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.571+0000 7f25e6f08640 1 --2- 172.21.15.79:0/143226407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25e01084a0 0x7f25e01088e0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.571+0000 7f25e6f08640 1 --2- 172.21.15.79:0/143226407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25e0102a90 0x7f25e0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.571+0000 7f25e6f08640 1 -- 172.21.15.79:0/143226407 >> 172.21.15.79:0/143226407 conn(0x7f25e00fe540 msgr2=0x7f25e0100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:05.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.571+0000 7f25e6f08640 1 -- 172.21.15.79:0/143226407 shutdown_connections 2024-08-20T01:53:05.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.571+0000 7f25e6f08640 1 -- 172.21.15.79:0/143226407 wait complete. 2024-08-20T01:53:05.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.572+0000 7f25e6f08640 1 Processor -- start 2024-08-20T01:53:05.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.572+0000 7f25e6f08640 1 -- start start 2024-08-20T01:53:05.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.572+0000 7f25e6f08640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25e0102a90 0x7f25e0198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:05.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.572+0000 7f25e6f08640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25e01084a0 0x7f25e01993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:05.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.572+0000 7f25e6f08640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25e0108e20 0x7f25e019e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:05.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.572+0000 7f25e6f08640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f25e0112920 con 0x7f25e01084a0 2024-08-20T01:53:05.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.572+0000 7f25e6f08640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f25e01127a0 con 0x7f25e0102a90 2024-08-20T01:53:05.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.572+0000 7f25e6f08640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f25e0112aa0 con 0x7f25e0108e20 2024-08-20T01:53:05.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.572+0000 7f25dffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25e01084a0 0x7f25e01993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:05.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.572+0000 7f25dffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25e01084a0 0x7f25e01993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50372/0 (socket says 172.21.15.79:50372) 2024-08-20T01:53:05.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.572+0000 7f25dffff640 1 -- 172.21.15.79:0/3541401843 learned_addr learned my addr 172.21.15.79:0/3541401843 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:05.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.572+0000 7f25e54a5640 1 --2- 172.21.15.79:0/3541401843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25e0108e20 0x7f25e019e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:05.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.572+0000 7f25e4ca4640 1 --2- 172.21.15.79:0/3541401843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25e0102a90 0x7f25e0198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:05.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.573+0000 7f25dffff640 1 -- 172.21.15.79:0/3541401843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25e0108e20 msgr2=0x7f25e019e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:05.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.573+0000 7f25dffff640 1 --2- 172.21.15.79:0/3541401843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25e0108e20 0x7f25e019e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.573+0000 7f25dffff640 1 -- 172.21.15.79:0/3541401843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25e0102a90 msgr2=0x7f25e0198e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:05.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.573+0000 7f25dffff640 1 --2- 172.21.15.79:0/3541401843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25e0102a90 0x7f25e0198e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.573+0000 7f25dffff640 1 -- 172.21.15.79:0/3541401843 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25e019ef40 con 0x7f25e01084a0 2024-08-20T01:53:05.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.573+0000 7f25e4ca4640 1 --2- 172.21.15.79:0/3541401843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25e0102a90 0x7f25e0198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:53:05.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.573+0000 7f25dffff640 1 --2- 172.21.15.79:0/3541401843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25e01084a0 0x7f25e01993d0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f25cc009230 tx=0x7f25cc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:05.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.573+0000 7f25ddffb640 1 -- 172.21.15.79:0/3541401843 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25cc03f030 con 0x7f25e01084a0 2024-08-20T01:53:05.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.573+0000 7f25ddffb640 1 -- 172.21.15.79:0/3541401843 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f25cc003a80 con 0x7f25e01084a0 2024-08-20T01:53:05.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.573+0000 7f25e6f08640 1 -- 172.21.15.79:0/3541401843 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25e019f1d0 con 0x7f25e01084a0 2024-08-20T01:53:05.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.573+0000 7f25ddffb640 1 -- 172.21.15.79:0/3541401843 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25cc035070 con 0x7f25e01084a0 2024-08-20T01:53:05.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.573+0000 7f25e6f08640 1 -- 172.21.15.79:0/3541401843 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25e01a58f0 con 0x7f25e01084a0 2024-08-20T01:53:05.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.576+0000 7f25ddffb640 1 -- 172.21.15.79:0/3541401843 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f25cc042030 con 0x7f25e01084a0 2024-08-20T01:53:05.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.576+0000 7f25e9301740 1 Processor -- start 2024-08-20T01:53:05.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.576+0000 7f25e9301740 1 -- start start 2024-08-20T01:53:05.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.576+0000 7f25e9301740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6294476e0 0x55b629447ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:05.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.576+0000 7f25e9301740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b629448000 0x55b629457e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:05.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.576+0000 7f25e9301740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6294583a0 0x55b62945a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:05.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.576+0000 7f25e9301740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b6293be8e0 con 0x55b629448000 2024-08-20T01:53:05.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.576+0000 7f25e9301740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b6293adde0 con 0x55b6294583a0 2024-08-20T01:53:05.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.576+0000 7f25e9301740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b6293b1e20 con 0x55b6294476e0 2024-08-20T01:53:05.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.576+0000 7f25e4ca4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b629448000 0x55b629457e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:05.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.576+0000 7f25e4ca4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b629448000 0x55b629457e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50388/0 (socket says 172.21.15.79:50388) 2024-08-20T01:53:05.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.576+0000 7f25e4ca4640 1 -- 172.21.15.79:0/2678221699 learned_addr learned my addr 172.21.15.79:0/2678221699 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:05.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.576+0000 7f25e54a5640 1 --2- 172.21.15.79:0/2678221699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6294476e0 0x55b629447ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:05.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.576+0000 7f25dffff640 1 --2- 172.21.15.79:0/2678221699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6294583a0 0x55b62945a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:05.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.577+0000 7f25e4ca4640 1 -- 172.21.15.79:0/2678221699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6294476e0 msgr2=0x55b629447ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:05.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.577+0000 7f25e4ca4640 1 --2- 172.21.15.79:0/2678221699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6294476e0 0x55b629447ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.577+0000 7f25e4ca4640 1 -- 172.21.15.79:0/2678221699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6294583a0 msgr2=0x55b62945a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:05.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.577+0000 7f25e4ca4640 1 --2- 172.21.15.79:0/2678221699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6294583a0 0x55b62945a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.577+0000 7f25e4ca4640 1 -- 172.21.15.79:0/2678221699 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b62910d650 con 0x55b629448000 2024-08-20T01:53:05.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.577+0000 7f25e54a5640 1 --2- 172.21.15.79:0/2678221699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6294476e0 0x55b629447ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:53:05.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.577+0000 7f25e4ca4640 1 --2- 172.21.15.79:0/2678221699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b629448000 0x55b629457e60 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f25d400bd40 tx=0x7f25d400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2824e3347b2c047 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:05.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.577+0000 7f25ddffb640 1 --2- 172.21.15.79:0/3541401843 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f25d00b3c50 0x7f25d00b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:05.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.577+0000 7f25caffd640 1 -- 172.21.15.79:0/2678221699 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d4015070 con 0x55b629448000 2024-08-20T01:53:05.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.577+0000 7f25caffd640 1 -- 172.21.15.79:0/2678221699 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f25d400be30 con 0x55b629448000 2024-08-20T01:53:05.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.577+0000 7f25e54a5640 1 --2- 172.21.15.79:0/3541401843 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f25d00b3c50 0x7f25d00b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:05.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.577+0000 7f25caffd640 1 -- 172.21.15.79:0/2678221699 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d40118a0 con 0x55b629448000 2024-08-20T01:53:05.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.577+0000 7f25ddffb640 1 -- 172.21.15.79:0/3541401843 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f25cc1045b0 con 0x7f25e01084a0 2024-08-20T01:53:05.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.578+0000 7f25e9301740 1 -- 172.21.15.79:0/2678221699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b629448000 msgr2=0x55b629457e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:05.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.578+0000 7f25e54a5640 1 --2- 172.21.15.79:0/3541401843 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f25d00b3c50 0x7f25d00b6110 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f25d8009fd0 tx=0x7f25d8009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:05.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.578+0000 7f25e9301740 1 --2- 172.21.15.79:0/2678221699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b629448000 0x55b629457e60 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f25d400bd40 tx=0x7f25d400f730 comp rx=0 tx=0).stop 2024-08-20T01:53:05.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.578+0000 7f25e9301740 1 -- 172.21.15.79:0/2678221699 shutdown_connections 2024-08-20T01:53:05.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.578+0000 7f25e9301740 1 --2- 172.21.15.79:0/2678221699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6294583a0 0x55b62945a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.578+0000 7f25e9301740 1 --2- 172.21.15.79:0/2678221699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b629448000 0x55b629457e60 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.578+0000 7f25e9301740 1 --2- 172.21.15.79:0/2678221699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6294476e0 0x55b629447ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.578+0000 7f25e9301740 1 -- 172.21.15.79:0/2678221699 >> 172.21.15.79:0/2678221699 conn(0x55b629445510 msgr2=0x55b6294466b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:05.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.578+0000 7f25e9301740 1 -- 172.21.15.79:0/2678221699 shutdown_connections 2024-08-20T01:53:05.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.578+0000 7f25e9301740 1 -- 172.21.15.79:0/2678221699 wait complete. 2024-08-20T01:53:05.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.578+0000 7f25e9301740 1 -- start start 2024-08-20T01:53:05.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.578+0000 7f25e9301740 1 Processor -- start 2024-08-20T01:53:05.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.579+0000 7f25e9301740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6294476e0 0x55b629455330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:05.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.579+0000 7f25e9301740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b629448000 0x55b629455870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:05.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.579+0000 7f25e9301740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6294583a0 0x55b629455db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:05.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.579+0000 7f25e9301740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b629210700 con 0x55b6294583a0 2024-08-20T01:53:05.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.579+0000 7f25e9301740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b6293347c0 con 0x55b629448000 2024-08-20T01:53:05.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.579+0000 7f25e9301740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b62945b050 con 0x55b6294476e0 2024-08-20T01:53:05.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.579+0000 7f25e9301740 10 client.0 _ll_register_callbacks cb 0x55b6293a76b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:53:05.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.579+0000 7f25e54a5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6294583a0 0x55b629455db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:05.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.579+0000 7f25e54a5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6294583a0 0x55b629455db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50400/0 (socket says 172.21.15.79:50400) 2024-08-20T01:53:05.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.579+0000 7f25e4ca4640 1 --2- 172.21.15.79:0/1488075487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6294476e0 0x55b629455330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:05.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.579+0000 7f25dffff640 1 --2- 172.21.15.79:0/1488075487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b629448000 0x55b629455870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:05.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.579+0000 7f25e54a5640 1 -- 172.21.15.79:0/1488075487 learned_addr learned my addr 172.21.15.79:0/1488075487 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:05.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.579+0000 7f25e54a5640 1 -- 172.21.15.79:0/1488075487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6294476e0 msgr2=0x55b629455330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:05.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.579+0000 7f25e54a5640 1 --2- 172.21.15.79:0/1488075487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6294476e0 0x55b629455330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.579+0000 7f25e54a5640 1 -- 172.21.15.79:0/1488075487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b629448000 msgr2=0x55b629455870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:05.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.579+0000 7f25e54a5640 1 --2- 172.21.15.79:0/1488075487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b629448000 0x55b629455870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.605 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.579+0000 7f25e54a5640 1 -- 172.21.15.79:0/1488075487 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b629464430 con 0x55b6294583a0 2024-08-20T01:53:05.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.579+0000 7f25e4ca4640 1 --2- 172.21.15.79:0/1488075487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6294476e0 0x55b629455330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:53:05.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.579+0000 7f25dffff640 1 --2- 172.21.15.79:0/1488075487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b629448000 0x55b629455870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:53:05.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.579+0000 7f25e54a5640 1 --2- 172.21.15.79:0/1488075487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6294583a0 0x55b629455db0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f25d8011e60 tx=0x7f25d8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=436383dfe740c8d3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:05.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.579+0000 7f25bffff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:53:05.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.580+0000 7f25bffff640 1 -- 172.21.15.79:0/1488075487 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d801f9b0 con 0x55b6294583a0 2024-08-20T01:53:05.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.580+0000 7f25bffff640 1 -- 172.21.15.79:0/1488075487 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f25d801fb50 con 0x55b6294583a0 2024-08-20T01:53:05.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.580+0000 7f25e9301740 1 -- 172.21.15.79:0/1488075487 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b62935d100 con 0x55b6294583a0 2024-08-20T01:53:05.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.580+0000 7f25bffff640 1 -- 172.21.15.79:0/1488075487 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f25d801fd50 con 0x55b6294583a0 2024-08-20T01:53:05.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.580+0000 7f25e9301740 10 client.19440 fetch_fsmap learned FSMap version 63 2024-08-20T01:53:05.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.580+0000 7f25e9301740 1 -- 172.21.15.79:0/1488075487 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x55b629466e40 con 0x55b6294583a0 2024-08-20T01:53:05.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.580+0000 7f25bffff640 1 -- 172.21.15.79:0/1488075487 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55b62935d100 con 0x55b6294583a0 2024-08-20T01:53:05.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.580+0000 7f25bffff640 1 -- 172.21.15.79:0/1488075487 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 63) ==== 8402+0+0 (secure 0 0 0) 0x7f25d8026020 con 0x55b6294583a0 2024-08-20T01:53:05.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.580+0000 7f25e9301740 10 client.19440 fetch_fsmap finished waiting for FSMap version 63 2024-08-20T01:53:05.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.580+0000 7f25e9301740 10 client.19440 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:53:05.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.580+0000 7f25e9301740 20 client.19440 populate_metadata read hostname 'smithi079' 2024-08-20T01:53:05.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.580+0000 7f25e9301740 1 --2- 172.21.15.79:0/1488075487 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55b6294683d0 0x55b62946a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:05.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.580+0000 7f25e9301740 4 client.19440 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:53:05.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.580+0000 7f25e9301740 1 -- 172.21.15.79:0/1488075487 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b6293c0830 con 0x55b6294683d0 2024-08-20T01:53:05.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.581+0000 7f25e4ca4640 1 --2- 172.21.15.79:0/1488075487 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55b6294683d0 0x55b62946a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:05.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.581+0000 7f25bffff640 10 client.19440 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:53:05.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.581+0000 7f25e4ca4640 1 --2- 172.21.15.79:0/1488075487 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55b6294683d0 0x55b62946a810 crc :-1 s=READY pgs=326 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2d92439d051f201 server_cookie=c5ba1e26653d844a in_seq=0 out_seq=0 2024-08-20T01:53:05.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.581+0000 7f25bffff640 1 -- 172.21.15.79:0/1488075487 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b6293c0830 con 0x55b6294683d0 2024-08-20T01:53:05.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.581+0000 7f25bffff640 10 client.19440 handle_command_reply: tid=0 2024-08-20T01:53:05.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.582+0000 7f25e9301740 1 client.19440 shutdown 2024-08-20T01:53:05.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.582+0000 7f25e9301740 1 -- 172.21.15.79:0/1488075487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6294583a0 msgr2=0x55b629455db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:05.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.582+0000 7f25e9301740 1 --2- 172.21.15.79:0/1488075487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6294583a0 0x55b629455db0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f25d8011e60 tx=0x7f25d8004ab0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.582+0000 7f25e9301740 1 -- 172.21.15.79:0/1488075487 shutdown_connections 2024-08-20T01:53:05.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.582+0000 7f25e9301740 1 --2- 172.21.15.79:0/1488075487 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55b6294683d0 0x55b62946a810 crc :-1 s=READY pgs=326 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.582+0000 7f25e9301740 1 --2- 172.21.15.79:0/1488075487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6294583a0 0x55b629455db0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.582+0000 7f25e9301740 1 --2- 172.21.15.79:0/1488075487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b629448000 0x55b629455870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.582+0000 7f25e9301740 1 --2- 172.21.15.79:0/1488075487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6294476e0 0x55b629455330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.582+0000 7f25bffff640 0 client.19440 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:53:05.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.582+0000 7f25e9301740 1 -- 172.21.15.79:0/1488075487 >> 172.21.15.79:0/1488075487 conn(0x55b629445510 msgr2=0x55b62944b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:05.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.582+0000 7f25e9301740 1 -- 172.21.15.79:0/1488075487 shutdown_connections 2024-08-20T01:53:05.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.582+0000 7f25e9301740 1 -- 172.21.15.79:0/1488075487 wait complete. 2024-08-20T01:53:05.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.582+0000 7f25e9301740 20 client.19440 trim_cache size 0 max 16384 2024-08-20T01:53:05.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.599+0000 7f25e9301740 1 Processor -- start 2024-08-20T01:53:05.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.599+0000 7f25e9301740 1 -- start start 2024-08-20T01:53:05.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.600+0000 7f25e9301740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6294476e0 0x55b629452e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:05.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.600+0000 7f25e9301740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b629448000 0x55b629455830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:05.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.600+0000 7f25e9301740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6294583a0 0x55b629455d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:05.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.600+0000 7f25e9301740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f25e01abd50 con 0x55b6294476e0 2024-08-20T01:53:05.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.600+0000 7f25e9301740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f25e01ada10 con 0x55b629448000 2024-08-20T01:53:05.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.600+0000 7f25e9301740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f25e01ac420 con 0x55b6294583a0 2024-08-20T01:53:05.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.600+0000 7f25e4ca4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6294476e0 0x55b629452e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:05.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.600+0000 7f25e4ca4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6294476e0 0x55b629452e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50402/0 (socket says 172.21.15.79:50402) 2024-08-20T01:53:05.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.600+0000 7f25e4ca4640 1 -- 172.21.15.79:0/3255432159 learned_addr learned my addr 172.21.15.79:0/3255432159 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:05.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.600+0000 7f25e54a5640 1 --2- 172.21.15.79:0/3255432159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6294583a0 0x55b629455d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:05.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.600+0000 7f25dffff640 1 --2- 172.21.15.79:0/3255432159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b629448000 0x55b629455830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:05.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.600+0000 7f25e4ca4640 1 -- 172.21.15.79:0/3255432159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6294583a0 msgr2=0x55b629455d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:05.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.600+0000 7f25e4ca4640 1 --2- 172.21.15.79:0/3255432159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6294583a0 0x55b629455d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.600+0000 7f25e4ca4640 1 -- 172.21.15.79:0/3255432159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b629448000 msgr2=0x55b629455830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:05.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.600+0000 7f25e4ca4640 1 --2- 172.21.15.79:0/3255432159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b629448000 0x55b629455830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.600+0000 7f25e4ca4640 1 -- 172.21.15.79:0/3255432159 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b629445f50 con 0x55b6294476e0 2024-08-20T01:53:05.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.600+0000 7f25e54a5640 1 --2- 172.21.15.79:0/3255432159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6294583a0 0x55b629455d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:53:05.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.600+0000 7f25e4ca4640 1 --2- 172.21.15.79:0/3255432159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6294476e0 0x55b629452e30 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f25d400bd40 tx=0x7f25d4005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=500bf32ac0e4a423 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:05.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.600+0000 7f25ca7fc640 1 -- 172.21.15.79:0/3255432159 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d4015070 con 0x55b6294476e0 2024-08-20T01:53:05.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.600+0000 7f25ca7fc640 1 -- 172.21.15.79:0/3255432159 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f25d40054d0 con 0x55b6294476e0 2024-08-20T01:53:05.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.600+0000 7f25ca7fc640 1 -- 172.21.15.79:0/3255432159 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d40048e0 con 0x55b6294476e0 2024-08-20T01:53:05.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.601+0000 7f25e9301740 1 -- 172.21.15.79:0/3255432159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6294476e0 msgr2=0x55b629452e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:05.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.601+0000 7f25e9301740 1 --2- 172.21.15.79:0/3255432159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6294476e0 0x55b629452e30 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f25d400bd40 tx=0x7f25d4005fd0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.601+0000 7f25e9301740 1 -- 172.21.15.79:0/3255432159 shutdown_connections 2024-08-20T01:53:05.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.601+0000 7f25e9301740 1 --2- 172.21.15.79:0/3255432159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b6294583a0 0x55b629455d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.601+0000 7f25e9301740 1 --2- 172.21.15.79:0/3255432159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b629448000 0x55b629455830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.601+0000 7f25e9301740 1 --2- 172.21.15.79:0/3255432159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6294476e0 0x55b629452e30 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.601+0000 7f25e9301740 1 -- 172.21.15.79:0/3255432159 >> 172.21.15.79:0/3255432159 conn(0x55b629445510 msgr2=0x55b629446bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:05.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.601+0000 7f25e9301740 1 -- 172.21.15.79:0/3255432159 shutdown_connections 2024-08-20T01:53:05.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.601+0000 7f25e9301740 1 -- 172.21.15.79:0/3255432159 wait complete. 2024-08-20T01:53:05.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.601+0000 7f25e9301740 1 -- start start 2024-08-20T01:53:05.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.601+0000 7f25e9301740 1 Processor -- start 2024-08-20T01:53:05.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.602+0000 7f25e9301740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6294476e0 0x55b629460310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:05.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.602+0000 7f25e9301740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b629448000 0x55b629460850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:05.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.602+0000 7f25e9301740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6294583a0 0x55b62946f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:05.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.602+0000 7f25e9301740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f25e01ad280 con 0x55b6294583a0 2024-08-20T01:53:05.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.602+0000 7f25e9301740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f25e01acb80 con 0x55b6294476e0 2024-08-20T01:53:05.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.602+0000 7f25e9301740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f25e01a9d30 con 0x55b629448000 2024-08-20T01:53:05.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.602+0000 7f25e9301740 10 client.0 _ll_register_callbacks cb 0x7f25d8009be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:53:05.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.602+0000 7f25e54a5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6294583a0 0x55b62946f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:05.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.602+0000 7f25e4ca4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6294476e0 0x55b629460310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:05.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.602+0000 7f25e54a5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6294583a0 0x55b62946f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50418/0 (socket says 172.21.15.79:50418) 2024-08-20T01:53:05.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.602+0000 7f25e54a5640 1 -- 172.21.15.79:0/2782242206 learned_addr learned my addr 172.21.15.79:0/2782242206 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:05.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.602+0000 7f25dffff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b629448000 0x55b629460850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:05.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.602+0000 7f25e54a5640 1 -- 172.21.15.79:0/2782242206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b629448000 msgr2=0x55b629460850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:05.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.602+0000 7f25e54a5640 1 --2- 172.21.15.79:0/2782242206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b629448000 0x55b629460850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.602+0000 7f25e54a5640 1 -- 172.21.15.79:0/2782242206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6294476e0 msgr2=0x55b629460310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:05.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.602+0000 7f25e54a5640 1 --2- 172.21.15.79:0/2782242206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6294476e0 0x55b629460310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.602+0000 7f25e54a5640 1 -- 172.21.15.79:0/2782242206 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b629470c00 con 0x55b6294583a0 2024-08-20T01:53:05.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.602+0000 7f25e54a5640 1 --2- 172.21.15.79:0/2782242206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6294583a0 0x55b62946f0d0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f25d8004600 tx=0x7f25d801fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4176fd90d0525a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:05.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.602+0000 7f25bffff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:53:05.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.603+0000 7f25bffff640 1 -- 172.21.15.79:0/2782242206 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d801c820 con 0x55b6294583a0 2024-08-20T01:53:05.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.603+0000 7f25bffff640 1 -- 172.21.15.79:0/2782242206 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f25d801c9c0 con 0x55b6294583a0 2024-08-20T01:53:05.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.603+0000 7f25e9301740 1 -- 172.21.15.79:0/2782242206 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25d40054d0 con 0x55b6294583a0 2024-08-20T01:53:05.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.603+0000 7f25bffff640 1 -- 172.21.15.79:0/2782242206 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f25d801cc00 con 0x55b6294583a0 2024-08-20T01:53:05.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.603+0000 7f25e9301740 10 client.19446 fetch_fsmap learned FSMap version 63 2024-08-20T01:53:05.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.603+0000 7f25e9301740 1 -- 172.21.15.79:0/2782242206 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x55b6294d25d0 con 0x55b6294583a0 2024-08-20T01:53:05.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.603+0000 7f25bffff640 1 -- 172.21.15.79:0/2782242206 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f25d40054d0 con 0x55b6294583a0 2024-08-20T01:53:05.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.603+0000 7f25bffff640 1 -- 172.21.15.79:0/2782242206 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 63) ==== 8402+0+0 (secure 0 0 0) 0x7f25d8026040 con 0x55b6294583a0 2024-08-20T01:53:05.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.603+0000 7f25e9301740 10 client.19446 fetch_fsmap finished waiting for FSMap version 63 2024-08-20T01:53:05.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.603+0000 7f25e9301740 10 client.19446 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:53:05.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.603+0000 7f25e9301740 20 client.19446 populate_metadata read hostname 'smithi079' 2024-08-20T01:53:05.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.603+0000 7f25e9301740 1 --2- 172.21.15.79:0/2782242206 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55b6294d2db0 0x55b6294d51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:05.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.603+0000 7f25e9301740 4 client.19446 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:53:05.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.603+0000 7f25e9301740 1 -- 172.21.15.79:0/2782242206 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b6293bc2d0 con 0x55b6294d2db0 2024-08-20T01:53:05.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.604+0000 7f25e4ca4640 1 --2- 172.21.15.79:0/2782242206 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55b6294d2db0 0x55b6294d51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:05.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.604+0000 7f25bffff640 10 client.19446 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:53:05.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.604+0000 7f25e4ca4640 1 --2- 172.21.15.79:0/2782242206 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55b6294d2db0 0x55b6294d51d0 crc :-1 s=READY pgs=327 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6ff33b5dd3d8b73 server_cookie=6d2cc8297960d0ba in_seq=0 out_seq=0 2024-08-20T01:53:05.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.604+0000 7f25bffff640 1 -- 172.21.15.79:0/2782242206 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x55b6293bc2d0 con 0x55b6294d2db0 2024-08-20T01:53:05.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.604+0000 7f25bffff640 10 client.19446 handle_command_reply: tid=0 2024-08-20T01:53:05.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.604+0000 7f25e9301740 1 client.19446 shutdown 2024-08-20T01:53:05.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.604+0000 7f25e9301740 1 -- 172.21.15.79:0/2782242206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6294583a0 msgr2=0x55b62946f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:05.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.604+0000 7f25e9301740 1 --2- 172.21.15.79:0/2782242206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6294583a0 0x55b62946f0d0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f25d8004600 tx=0x7f25d801fce0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.604+0000 7f25e9301740 1 -- 172.21.15.79:0/2782242206 shutdown_connections 2024-08-20T01:53:05.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.604+0000 7f25e9301740 1 --2- 172.21.15.79:0/2782242206 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55b6294d2db0 0x55b6294d51d0 crc :-1 s=READY pgs=327 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.604+0000 7f25e9301740 1 --2- 172.21.15.79:0/2782242206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6294583a0 0x55b62946f0d0 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.604+0000 7f25e9301740 1 --2- 172.21.15.79:0/2782242206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b629448000 0x55b629460850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.604+0000 7f25e9301740 1 --2- 172.21.15.79:0/2782242206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6294476e0 0x55b629460310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.604+0000 7f25e9301740 1 -- 172.21.15.79:0/2782242206 >> 172.21.15.79:0/2782242206 conn(0x55b629445510 msgr2=0x55b629456960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:05.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.604+0000 7f25bffff640 0 client.19446 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:53:05.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.604+0000 7f25e9301740 1 -- 172.21.15.79:0/2782242206 shutdown_connections 2024-08-20T01:53:05.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.604+0000 7f25e9301740 1 -- 172.21.15.79:0/2782242206 wait complete. 2024-08-20T01:53:05.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.605+0000 7f25e9301740 20 client.19446 trim_cache size 0 max 16384 2024-08-20T01:53:05.621 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:53:05.621 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "scrub active (0 inodes in the stack)", 2024-08-20T01:53:05.621 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": { 2024-08-20T01:53:05.621 INFO:teuthology.orchestra.run.smithi079.stdout: "6f75046f-e190-41b1-ab0c-c0d87ab024a2": { 2024-08-20T01:53:05.621 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/", 2024-08-20T01:53:05.621 INFO:teuthology.orchestra.run.smithi079.stdout: "tag": "6f75046f-e190-41b1-ab0c-c0d87ab024a2", 2024-08-20T01:53:05.621 INFO:teuthology.orchestra.run.smithi079.stdout: "options": "recursive,force" 2024-08-20T01:53:05.621 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:53:05.622 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:53:05.622 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:53:05.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.605+0000 7f25e6f08640 1 -- 172.21.15.79:0/3541401843 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f25d00b3c50 msgr2=0x7f25d00b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:05.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.605+0000 7f25e6f08640 1 --2- 172.21.15.79:0/3541401843 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f25d00b3c50 0x7f25d00b6110 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f25d8009fd0 tx=0x7f25d8009500 comp rx=0 tx=0).stop 2024-08-20T01:53:05.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.605+0000 7f25e6f08640 1 -- 172.21.15.79:0/3541401843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25e01084a0 msgr2=0x7f25e01993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:05.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.605+0000 7f25e6f08640 1 --2- 172.21.15.79:0/3541401843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25e01084a0 0x7f25e01993d0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f25cc009230 tx=0x7f25cc004270 comp rx=0 tx=0).stop 2024-08-20T01:53:05.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.605+0000 7f25e6f08640 1 -- 172.21.15.79:0/3541401843 shutdown_connections 2024-08-20T01:53:05.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.605+0000 7f25e6f08640 1 --2- 172.21.15.79:0/3541401843 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f25d00b3c50 0x7f25d00b6110 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.605+0000 7f25e6f08640 1 --2- 172.21.15.79:0/3541401843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25e0108e20 0x7f25e019e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.605+0000 7f25e6f08640 1 --2- 172.21.15.79:0/3541401843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25e01084a0 0x7f25e01993d0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.605+0000 7f25e6f08640 1 --2- 172.21.15.79:0/3541401843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25e0102a90 0x7f25e0198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.605+0000 7f25e6f08640 1 -- 172.21.15.79:0/3541401843 >> 172.21.15.79:0/3541401843 conn(0x7f25e00fe540 msgr2=0x7f25e0100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:05.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.605+0000 7f25e6f08640 1 -- 172.21.15.79:0/3541401843 shutdown_connections 2024-08-20T01:53:05.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:05.605+0000 7f25e6f08640 1 -- 172.21.15.79:0/3541401843 wait complete. 2024-08-20T01:53:05.993 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:05.990+0000 7f3273fff640 1 -- 172.21.15.79:0/103946210 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c2ed211d50 con 0x55c2ed2b6a30 2024-08-20T01:53:05.994 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:05.990+0000 7f3273fff640 10 client.19374 handle_command_reply: tid=0 2024-08-20T01:53:05.994 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:05.990+0000 7f329de09740 1 client.19374 shutdown 2024-08-20T01:53:05.994 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:05.990+0000 7f329de09740 1 -- 172.21.15.79:0/103946210 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2ed2a18d0 msgr2=0x55c2ed2b2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:05.994 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:05.990+0000 7f329de09740 1 --2- 172.21.15.79:0/103946210 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2ed2a18d0 0x55c2ed2b2af0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f3288031a40 tx=0x7f3288005b50 comp rx=0 tx=0).stop 2024-08-20T01:53:05.994 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:05.990+0000 7f329de09740 1 -- 172.21.15.79:0/103946210 shutdown_connections 2024-08-20T01:53:05.994 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:05.990+0000 7f329de09740 1 --2- 172.21.15.79:0/103946210 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55c2ed2b6a30 0x55c2ed324270 crc :-1 s=READY pgs=321 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.994 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:05.990+0000 7f329de09740 1 --2- 172.21.15.79:0/103946210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2ed2a6c40 0x55c2ed2b1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.994 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:05.990+0000 7f3273fff640 0 client.19374 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:53:05.994 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:05.990+0000 7f329de09740 1 --2- 172.21.15.79:0/103946210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2ed2a4200 0x55c2ed2b17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.994 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:05.990+0000 7f329de09740 1 --2- 172.21.15.79:0/103946210 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2ed2a18d0 0x55c2ed2b2af0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.994 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:05.990+0000 7f329de09740 1 -- 172.21.15.79:0/103946210 >> 172.21.15.79:0/103946210 conn(0x55c2ed29ca20 msgr2=0x55c2ed29b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:05.995 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:05.990+0000 7f329de09740 1 -- 172.21.15.79:0/103946210 shutdown_connections 2024-08-20T01:53:05.995 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:05.990+0000 7f329de09740 1 -- 172.21.15.79:0/103946210 wait complete. 2024-08-20T01:53:05.995 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:05.990+0000 7f329de09740 20 client.19374 trim_cache size 0 max 16384 2024-08-20T01:53:05.995 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:53:05.995 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:53:05.995 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:53:05.995 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:53:05.996 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:05.991+0000 7f329af43640 1 -- 172.21.15.79:0/2714986325 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f32840b3bd0 msgr2=0x7f32840b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:05.996 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:05.991+0000 7f329af43640 1 --2- 172.21.15.79:0/2714986325 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f32840b3bd0 0x7f32840b6090 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f328c009fd0 tx=0x7f328c009500 comp rx=0 tx=0).stop 2024-08-20T01:53:05.996 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:05.991+0000 7f329af43640 1 -- 172.21.15.79:0/2714986325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32941026b0 msgr2=0x7f3294199020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:05.996 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:05.991+0000 7f329af43640 1 --2- 172.21.15.79:0/2714986325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32941026b0 0x7f3294199020 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f328000e9f0 tx=0x7f328000eeb0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:05.991+0000 7f329af43640 1 -- 172.21.15.79:0/2714986325 shutdown_connections 2024-08-20T01:53:05.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:05.991+0000 7f329af43640 1 --2- 172.21.15.79:0/2714986325 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f32840b3bd0 0x7f32840b6090 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:05.991+0000 7f329af43640 1 --2- 172.21.15.79:0/2714986325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3294103070 0x7f3294199c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:05.991+0000 7f329af43640 1 --2- 172.21.15.79:0/2714986325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32941026b0 0x7f3294199020 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:05.991+0000 7f329af43640 1 --2- 172.21.15.79:0/2714986325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3294101560 0x7f32941989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:05.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:05.991+0000 7f329af43640 1 -- 172.21.15.79:0/2714986325 >> 172.21.15.79:0/2714986325 conn(0x7f32940fce40 msgr2=0x7f32940fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:05.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:05.991+0000 7f329af43640 1 -- 172.21.15.79:0/2714986325 shutdown_connections 2024-08-20T01:53:05.997 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:05.991+0000 7f329af43640 1 -- 172.21.15.79:0/2714986325 wait complete. 2024-08-20T01:53:06.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:05 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:53:06.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:05 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:53:06.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:05 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:53:06.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:05 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:53:06.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:05 smithi175 ceph-mon[22392]: pgmap v820: 97 pgs: 97 active+clean; 7.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.3 KiB/s wr, 21 op/s 2024-08-20T01:53:06.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:05 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:53:06.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:05 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:53:06.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:05 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:53:06.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:05 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:53:06.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:05 smithi079 ceph-mon[18656]: pgmap v820: 97 pgs: 97 active+clean; 7.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.3 KiB/s wr, 21 op/s 2024-08-20T01:53:06.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:05 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:53:06.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:05 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:53:06.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:05 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:53:06.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:05 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:53:06.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:05 smithi081 ceph-mon[22209]: pgmap v820: 97 pgs: 97 active+clean; 7.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.3 KiB/s wr, 21 op/s 2024-08-20T01:53:06.564 INFO:tasks.cephfs.filesystem:scrub status for tag:6f75046f-e190-41b1-ab0c-c0d87ab024a2 - {'path': '/', 'tag': '6f75046f-e190-41b1-ab0c-c0d87ab024a2', 'options': 'recursive,force'} 2024-08-20T01:53:08.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:07 smithi175 ceph-mon[22392]: pgmap v821: 97 pgs: 97 active+clean; 7.3 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.2 KiB/s wr, 23 op/s 2024-08-20T01:53:08.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:07 smithi079 ceph-mon[18656]: pgmap v821: 97 pgs: 97 active+clean; 7.3 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.2 KiB/s wr, 23 op/s 2024-08-20T01:53:08.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:07 smithi081 ceph-mon[22209]: pgmap v821: 97 pgs: 97 active+clean; 7.3 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.2 KiB/s wr, 23 op/s 2024-08-20T01:53:09.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:08 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:53:09.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:08 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:53:09.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:08 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:53:10.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:09 smithi175 ceph-mon[22392]: pgmap v822: 97 pgs: 97 active+clean; 7.2 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.4 KiB/s wr, 27 op/s 2024-08-20T01:53:10.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:09 smithi079 ceph-mon[18656]: pgmap v822: 97 pgs: 97 active+clean; 7.2 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.4 KiB/s wr, 27 op/s 2024-08-20T01:53:10.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:09 smithi081 ceph-mon[22209]: pgmap v822: 97 pgs: 97 active+clean; 7.2 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.4 KiB/s wr, 27 op/s 2024-08-20T01:53:12.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:11 smithi175 ceph-mon[22392]: pgmap v823: 97 pgs: 97 active+clean; 7.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.2 KiB/s wr, 24 op/s 2024-08-20T01:53:12.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:11 smithi079 ceph-mon[18656]: pgmap v823: 97 pgs: 97 active+clean; 7.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.2 KiB/s wr, 24 op/s 2024-08-20T01:53:12.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:11 smithi081 ceph-mon[22209]: pgmap v823: 97 pgs: 97 active+clean; 7.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.2 KiB/s wr, 24 op/s 2024-08-20T01:53:13.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:12 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:53:13.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:12 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:53:13.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:12 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:53:14.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:13 smithi175 ceph-mon[22392]: pgmap v824: 97 pgs: 97 active+clean; 7.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.2 KiB/s wr, 24 op/s 2024-08-20T01:53:14.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:13 smithi079 ceph-mon[18656]: pgmap v824: 97 pgs: 97 active+clean; 7.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.2 KiB/s wr, 24 op/s 2024-08-20T01:53:14.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:13 smithi081 ceph-mon[22209]: pgmap v824: 97 pgs: 97 active+clean; 7.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.2 KiB/s wr, 24 op/s 2024-08-20T01:53:15.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:14 smithi079 ceph-mon[18656]: Health check update: 9 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-08-20T01:53:15.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:14 smithi081 ceph-mon[22209]: Health check update: 9 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-08-20T01:53:15.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:14 smithi175 ceph-mon[22392]: Health check update: 9 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-08-20T01:53:16.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:15 smithi079 ceph-mon[18656]: pgmap v825: 97 pgs: 97 active+clean; 7.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.1 KiB/s wr, 25 op/s 2024-08-20T01:53:16.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:15 smithi081 ceph-mon[22209]: pgmap v825: 97 pgs: 97 active+clean; 7.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.1 KiB/s wr, 25 op/s 2024-08-20T01:53:16.291 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:15 smithi175 ceph-mon[22392]: pgmap v825: 97 pgs: 97 active+clean; 7.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.1 KiB/s wr, 25 op/s 2024-08-20T01:53:18.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:17 smithi081 ceph-mon[22209]: pgmap v826: 97 pgs: 97 active+clean; 6.9 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.7 KiB/s wr, 24 op/s 2024-08-20T01:53:18.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:17 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:53:18.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:17 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:53:18.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:17 smithi175 ceph-mon[22392]: pgmap v826: 97 pgs: 97 active+clean; 6.9 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.7 KiB/s wr, 24 op/s 2024-08-20T01:53:18.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:17 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:53:18.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:17 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:53:18.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:17 smithi079 ceph-mon[18656]: pgmap v826: 97 pgs: 97 active+clean; 6.9 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.7 KiB/s wr, 24 op/s 2024-08-20T01:53:18.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:17 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:53:18.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:17 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:53:19.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.079+0000 7f1a020b7640 1 -- 172.21.15.79:0/1955654794 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19fc101560 msgr2=0x7f19fc101960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:19.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.079+0000 7f1a020b7640 1 --2- 172.21.15.79:0/1955654794 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19fc101560 0x7f19fc101960 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f19ec009930 tx=0x7f19ec02a420 comp rx=0 tx=0).stop 2024-08-20T01:53:19.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.080+0000 7f1a020b7640 1 -- 172.21.15.79:0/1955654794 shutdown_connections 2024-08-20T01:53:19.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.080+0000 7f1a020b7640 1 --2- 172.21.15.79:0/1955654794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19fc103070 0x7f19fc1099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:19.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.080+0000 7f1a020b7640 1 --2- 172.21.15.79:0/1955654794 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19fc1026b0 0x7f19fc102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:19.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.080+0000 7f1a020b7640 1 --2- 172.21.15.79:0/1955654794 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19fc101560 0x7f19fc101960 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:19.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.080+0000 7f1a020b7640 1 -- 172.21.15.79:0/1955654794 >> 172.21.15.79:0/1955654794 conn(0x7f19fc0fce40 msgr2=0x7f19fc0ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:19.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.080+0000 7f1a020b7640 1 -- 172.21.15.79:0/1955654794 shutdown_connections 2024-08-20T01:53:19.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.080+0000 7f1a020b7640 1 -- 172.21.15.79:0/1955654794 wait complete. 2024-08-20T01:53:19.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.080+0000 7f1a020b7640 1 Processor -- start 2024-08-20T01:53:19.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.080+0000 7f1a020b7640 1 -- start start 2024-08-20T01:53:19.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.081+0000 7f1a020b7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19fc101560 0x7f19fc1967d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:19.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.081+0000 7f1a020b7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19fc1026b0 0x7f19fc196e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:19.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.081+0000 7f1a020b7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19fc103070 0x7f19fc197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:19.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.081+0000 7f1a020b7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f19fc10bf60 con 0x7f19fc103070 2024-08-20T01:53:19.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.081+0000 7f1a020b7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f19fc10bde0 con 0x7f19fc1026b0 2024-08-20T01:53:19.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.081+0000 7f1a020b7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f19fc10c0e0 con 0x7f19fc101560 2024-08-20T01:53:19.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.081+0000 7f19fbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19fc103070 0x7f19fc197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:19.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.081+0000 7f19fb7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19fc101560 0x7f19fc1967d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:19.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.081+0000 7f19fbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19fc103070 0x7f19fc197a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46768/0 (socket says 172.21.15.79:46768) 2024-08-20T01:53:19.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.081+0000 7f19fbfff640 1 -- 172.21.15.79:0/2601506122 learned_addr learned my addr 172.21.15.79:0/2601506122 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:19.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.081+0000 7f19f3fff640 1 --2- 172.21.15.79:0/2601506122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19fc1026b0 0x7f19fc196e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:19.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.081+0000 7f19fb7fe640 1 -- 172.21.15.79:0/2601506122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19fc1026b0 msgr2=0x7f19fc196e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:19.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.081+0000 7f19fb7fe640 1 --2- 172.21.15.79:0/2601506122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19fc1026b0 0x7f19fc196e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:19.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.081+0000 7f19fb7fe640 1 -- 172.21.15.79:0/2601506122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19fc103070 msgr2=0x7f19fc197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:19.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.081+0000 7f19fb7fe640 1 --2- 172.21.15.79:0/2601506122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19fc103070 0x7f19fc197a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:19.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.081+0000 7f19fb7fe640 1 -- 172.21.15.79:0/2601506122 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19fc198310 con 0x7f19fc101560 2024-08-20T01:53:19.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.081+0000 7f19fbfff640 1 --2- 172.21.15.79:0/2601506122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19fc103070 0x7f19fc197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:53:19.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.081+0000 7f19fb7fe640 1 --2- 172.21.15.79:0/2601506122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19fc101560 0x7f19fc1967d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f19ec009900 tx=0x7f19ec0042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:19.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.081+0000 7f19f97fa640 1 -- 172.21.15.79:0/2601506122 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ec03f070 con 0x7f19fc101560 2024-08-20T01:53:19.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.081+0000 7f1a020b7640 1 -- 172.21.15.79:0/2601506122 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19fc1985a0 con 0x7f19fc101560 2024-08-20T01:53:19.088 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.081+0000 7f19f97fa640 1 -- 172.21.15.79:0/2601506122 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f19ec032e10 con 0x7f19fc101560 2024-08-20T01:53:19.088 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.081+0000 7f19f97fa640 1 -- 172.21.15.79:0/2601506122 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ec035070 con 0x7f19fc101560 2024-08-20T01:53:19.088 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.082+0000 7f1a020b7640 1 -- 172.21.15.79:0/2601506122 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19fc19eaf0 con 0x7f19fc101560 2024-08-20T01:53:19.094 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.084+0000 7f19f97fa640 1 -- 172.21.15.79:0/2601506122 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f19ec003a00 con 0x7f19fc101560 2024-08-20T01:53:19.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.084+0000 7f1a04ea3740 1 Processor -- start 2024-08-20T01:53:19.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.084+0000 7f1a04ea3740 1 -- start start 2024-08-20T01:53:19.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.084+0000 7f1a04ea3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f32442630 0x564f32444a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:19.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.084+0000 7f1a04ea3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f32444f60 0x564f32447350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:19.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.084+0000 7f1a04ea3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f324479a0 0x564f32449e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:19.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.084+0000 7f1a04ea3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564f323b5360 con 0x564f32442630 2024-08-20T01:53:19.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.084+0000 7f1a04ea3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564f323a4860 con 0x564f32444f60 2024-08-20T01:53:19.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.084+0000 7f1a04ea3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564f323a88a0 con 0x564f324479a0 2024-08-20T01:53:19.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.084+0000 7f19fbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f32442630 0x564f32444a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:19.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.084+0000 7f19fbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f32442630 0x564f32444a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46776/0 (socket says 172.21.15.79:46776) 2024-08-20T01:53:19.095 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.084+0000 7f19fbfff640 1 -- 172.21.15.79:0/3972254541 learned_addr learned my addr 172.21.15.79:0/3972254541 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:19.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.084+0000 7f19fb7fe640 1 --2- 172.21.15.79:0/3972254541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f32444f60 0x564f32447350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:19.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.084+0000 7f19fbfff640 1 -- 172.21.15.79:0/3972254541 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f324479a0 msgr2=0x564f32449e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:19.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.084+0000 7f19f3fff640 1 --2- 172.21.15.79:0/3972254541 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f324479a0 0x564f32449e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:19.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.084+0000 7f19f97fa640 1 --2- 172.21.15.79:0/2601506122 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f19e80b5de0 0x7f19e80b82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:19.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.084+0000 7f19fbfff640 1 --2- 172.21.15.79:0/3972254541 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f324479a0 0x564f32449e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:19.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.084+0000 7f19fbfff640 1 -- 172.21.15.79:0/3972254541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f32444f60 msgr2=0x564f32447350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:19.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.084+0000 7f19fbfff640 1 --2- 172.21.15.79:0/3972254541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f32444f60 0x564f32447350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:19.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.084+0000 7f19fbfff640 1 -- 172.21.15.79:0/3972254541 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f3234be40 con 0x564f32442630 2024-08-20T01:53:19.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.084+0000 7f19fb7fe640 1 --2- 172.21.15.79:0/3972254541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f32444f60 0x564f32447350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:53:19.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.084+0000 7f19f3fff640 1 --2- 172.21.15.79:0/3972254541 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f324479a0 0x564f32449e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:53:19.096 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.085+0000 7f19fbfff640 1 --2- 172.21.15.79:0/3972254541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f32442630 0x564f32444a20 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f19f4011890 tx=0x7f19f4011d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eba675424c4383a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:19.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.085+0000 7f19f97fa640 1 -- 172.21.15.79:0/2601506122 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f19ec103e20 con 0x7f19fc101560 2024-08-20T01:53:19.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.085+0000 7f19fbfff640 1 --2- 172.21.15.79:0/2601506122 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f19e80b5de0 0x7f19e80b82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:19.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.085+0000 7f19f1ffb640 1 -- 172.21.15.79:0/3972254541 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f4011270 con 0x564f32442630 2024-08-20T01:53:19.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.085+0000 7f19f1ffb640 1 -- 172.21.15.79:0/3972254541 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f19f401a3f0 con 0x564f32442630 2024-08-20T01:53:19.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.085+0000 7f19f1ffb640 1 -- 172.21.15.79:0/3972254541 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f40106d0 con 0x564f32442630 2024-08-20T01:53:19.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.086+0000 7f1a04ea3740 1 -- 172.21.15.79:0/3972254541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f32442630 msgr2=0x564f32444a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:19.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.086+0000 7f19fbfff640 1 --2- 172.21.15.79:0/2601506122 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f19e80b5de0 0x7f19e80b82a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f19f401b000 tx=0x7f19f4010a70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:19.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.086+0000 7f1a04ea3740 1 --2- 172.21.15.79:0/3972254541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f32442630 0x564f32444a20 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f19f4011890 tx=0x7f19f4011d50 comp rx=0 tx=0).stop 2024-08-20T01:53:19.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.086+0000 7f1a04ea3740 1 -- 172.21.15.79:0/3972254541 shutdown_connections 2024-08-20T01:53:19.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.086+0000 7f1a04ea3740 1 --2- 172.21.15.79:0/3972254541 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f324479a0 0x564f32449e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:19.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.086+0000 7f1a04ea3740 1 --2- 172.21.15.79:0/3972254541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f32444f60 0x564f32447350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:19.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.086+0000 7f1a04ea3740 1 --2- 172.21.15.79:0/3972254541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f32442630 0x564f32444a20 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:19.097 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.086+0000 7f1a04ea3740 1 -- 172.21.15.79:0/3972254541 >> 172.21.15.79:0/3972254541 conn(0x564f3243d730 msgr2=0x564f3243e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:19.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.086+0000 7f1a04ea3740 1 -- 172.21.15.79:0/3972254541 shutdown_connections 2024-08-20T01:53:19.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.086+0000 7f1a04ea3740 1 -- 172.21.15.79:0/3972254541 wait complete. 2024-08-20T01:53:19.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.086+0000 7f1a04ea3740 1 -- start start 2024-08-20T01:53:19.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.086+0000 7f1a04ea3740 1 Processor -- start 2024-08-20T01:53:19.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.086+0000 7f1a04ea3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f32442630 0x564f3244bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:19.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.086+0000 7f1a04ea3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f32444f60 0x564f3244c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:19.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.086+0000 7f1a04ea3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f324479a0 0x564f3244d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:19.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.086+0000 7f1a04ea3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564f322ddab0 con 0x564f324479a0 2024-08-20T01:53:19.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.086+0000 7f1a04ea3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564f3232b780 con 0x564f32442630 2024-08-20T01:53:19.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.086+0000 7f1a04ea3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564f3244a920 con 0x564f32444f60 2024-08-20T01:53:19.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.086+0000 7f1a04ea3740 10 client.0 _ll_register_callbacks cb 0x564f320b3a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:53:19.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.087+0000 7f19fb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f32442630 0x564f3244bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:19.098 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.087+0000 7f19f3fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f32444f60 0x564f3244c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:19.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.087+0000 7f19fbfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f324479a0 0x564f3244d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:19.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.087+0000 7f19fb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f32442630 0x564f3244bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:37698/0 (socket says 172.21.15.79:37698) 2024-08-20T01:53:19.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.087+0000 7f19f3fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f32444f60 0x564f3244c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:43302/0 (socket says 172.21.15.79:43302) 2024-08-20T01:53:19.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.087+0000 7f19fb7fe640 1 -- 172.21.15.79:0/3730040804 learned_addr learned my addr 172.21.15.79:0/3730040804 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:19.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.087+0000 7f19fb7fe640 1 -- 172.21.15.79:0/3730040804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f32444f60 msgr2=0x564f3244c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:19.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.087+0000 7f19fb7fe640 1 --2- 172.21.15.79:0/3730040804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f32444f60 0x564f3244c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:19.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.087+0000 7f19fb7fe640 1 -- 172.21.15.79:0/3730040804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f324479a0 msgr2=0x564f3244d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:19.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.087+0000 7f19fb7fe640 1 --2- 172.21.15.79:0/3730040804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f324479a0 0x564f3244d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:19.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.087+0000 7f19fb7fe640 1 -- 172.21.15.79:0/3730040804 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f32107790 con 0x564f32442630 2024-08-20T01:53:19.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.087+0000 7f19fbfff640 1 --2- 172.21.15.79:0/3730040804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f324479a0 0x564f3244d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:53:19.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.087+0000 7f19fb7fe640 1 --2- 172.21.15.79:0/3730040804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f32442630 0x564f3244bd90 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f19ec0caad0 tx=0x7f19ec0cac60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56e938a8f76a3b99 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:19.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.087+0000 7f19daffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:53:19.099 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.087+0000 7f19daffd640 1 -- 172.21.15.79:0/3730040804 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ec048070 con 0x564f32442630 2024-08-20T01:53:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.087+0000 7f19daffd640 1 -- 172.21.15.79:0/3730040804 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f19ec0c7060 con 0x564f32442630 2024-08-20T01:53:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.087+0000 7f1a04ea3740 1 -- 172.21.15.79:0/3730040804 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564f32353e00 con 0x564f32442630 2024-08-20T01:53:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.087+0000 7f19daffd640 1 -- 172.21.15.79:0/3730040804 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) ==== 24+0+0 (secure 0 0 0) 0x7f19ec0044e0 con 0x564f32442630 2024-08-20T01:53:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.087+0000 7f1a04ea3740 10 client.28553 fetch_fsmap learned FSMap version 65 2024-08-20T01:53:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.087+0000 7f1a04ea3740 1 -- 172.21.15.79:0/3730040804 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) -- 0x564f32180620 con 0x564f32442630 2024-08-20T01:53:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.087+0000 7f19daffd640 1 -- 172.21.15.79:0/3730040804 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f19ec0cf020 con 0x564f32442630 2024-08-20T01:53:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.088+0000 7f19daffd640 1 -- 172.21.15.79:0/3730040804 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 65) ==== 8394+0+0 (secure 0 0 0) 0x7f19ec04b060 con 0x564f32442630 2024-08-20T01:53:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.088+0000 7f1a04ea3740 10 client.28553 fetch_fsmap finished waiting for FSMap version 65 2024-08-20T01:53:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.088+0000 7f1a04ea3740 10 client.28553 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:53:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.088+0000 7f1a04ea3740 20 client.28553 populate_metadata read hostname 'smithi079' 2024-08-20T01:53:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.088+0000 7f1a04ea3740 1 --2- 172.21.15.79:0/3730040804 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564f32457610 0x564f32459a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.088+0000 7f1a04ea3740 4 client.28553 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:53:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.088+0000 7f1a04ea3740 1 -- 172.21.15.79:0/3730040804 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f323b72b0 con 0x564f32457610 2024-08-20T01:53:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.088+0000 7f19f3fff640 1 --2- 172.21.15.79:0/3730040804 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564f32457610 0x564f32459a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.088+0000 7f19daffd640 10 client.28553 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:53:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.088+0000 7f19f3fff640 1 --2- 172.21.15.79:0/3730040804 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564f32457610 0x564f32459a70 crc :-1 s=READY pgs=328 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f39d63fd75ad6bcd server_cookie=c6e5d20018e81082 in_seq=0 out_seq=0 2024-08-20T01:53:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.089+0000 7f19daffd640 1 -- 172.21.15.79:0/3730040804 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564f323b72b0 con 0x564f32457610 2024-08-20T01:53:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.089+0000 7f19daffd640 10 client.28553 handle_command_reply: tid=0 2024-08-20T01:53:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.089+0000 7f1a04ea3740 1 client.28553 shutdown 2024-08-20T01:53:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.089+0000 7f1a04ea3740 1 -- 172.21.15.79:0/3730040804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f32442630 msgr2=0x564f3244bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.089+0000 7f1a04ea3740 1 --2- 172.21.15.79:0/3730040804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f32442630 0x564f3244bd90 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f19ec0caad0 tx=0x7f19ec0cac60 comp rx=0 tx=0).stop 2024-08-20T01:53:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.089+0000 7f1a04ea3740 1 -- 172.21.15.79:0/3730040804 shutdown_connections 2024-08-20T01:53:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.089+0000 7f1a04ea3740 1 --2- 172.21.15.79:0/3730040804 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564f32457610 0x564f32459a70 crc :-1 s=READY pgs=328 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.089+0000 7f1a04ea3740 1 --2- 172.21.15.79:0/3730040804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f324479a0 0x564f3244d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.089+0000 7f19daffd640 0 client.28553 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:53:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.089+0000 7f1a04ea3740 1 --2- 172.21.15.79:0/3730040804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f32444f60 0x564f3244c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.089+0000 7f1a04ea3740 1 --2- 172.21.15.79:0/3730040804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f32442630 0x564f3244bd90 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.089+0000 7f1a04ea3740 1 -- 172.21.15.79:0/3730040804 >> 172.21.15.79:0/3730040804 conn(0x564f3243d730 msgr2=0x564f3243c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.089+0000 7f1a04ea3740 1 -- 172.21.15.79:0/3730040804 shutdown_connections 2024-08-20T01:53:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.089+0000 7f1a04ea3740 1 -- 172.21.15.79:0/3730040804 wait complete. 2024-08-20T01:53:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.089+0000 7f1a04ea3740 20 client.28553 trim_cache size 0 max 16384 2024-08-20T01:53:19.111 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.103+0000 7f1a04ea3740 1 Processor -- start 2024-08-20T01:53:19.111 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.103+0000 7f1a04ea3740 1 -- start start 2024-08-20T01:53:19.111 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.103+0000 7f1a04ea3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f32442630 0x564f3244af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:19.111 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.103+0000 7f1a04ea3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f32444f60 0x564f32447d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:19.111 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.103+0000 7f1a04ea3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f324479a0 0x564f324482c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:19.111 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.104+0000 7f1a04ea3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f19fc1a7920 con 0x564f32442630 2024-08-20T01:53:19.111 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.104+0000 7f1a04ea3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f19fc1a9580 con 0x564f324479a0 2024-08-20T01:53:19.111 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.104+0000 7f1a04ea3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f19fc1a7ff0 con 0x564f32444f60 2024-08-20T01:53:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.104+0000 7f19fb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f32442630 0x564f3244af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.104+0000 7f19fb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f32442630 0x564f3244af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46796/0 (socket says 172.21.15.79:46796) 2024-08-20T01:53:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.104+0000 7f19fb7fe640 1 -- 172.21.15.79:0/4286012593 learned_addr learned my addr 172.21.15.79:0/4286012593 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.104+0000 7f19f3fff640 1 --2- 172.21.15.79:0/4286012593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f32444f60 0x564f32447d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.104+0000 7f19fbfff640 1 --2- 172.21.15.79:0/4286012593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f324479a0 0x564f324482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.104+0000 7f19fb7fe640 1 -- 172.21.15.79:0/4286012593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f32444f60 msgr2=0x564f32447d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.104+0000 7f19fb7fe640 1 --2- 172.21.15.79:0/4286012593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f32444f60 0x564f32447d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.104+0000 7f19fb7fe640 1 -- 172.21.15.79:0/4286012593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f324479a0 msgr2=0x564f324482c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.104+0000 7f19fb7fe640 1 --2- 172.21.15.79:0/4286012593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f324479a0 0x564f324482c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.104+0000 7f19fb7fe640 1 -- 172.21.15.79:0/4286012593 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f32444d90 con 0x564f32442630 2024-08-20T01:53:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.104+0000 7f19fb7fe640 1 --2- 172.21.15.79:0/4286012593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f32442630 0x564f3244af30 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f19ec0cf4e0 tx=0x7f19ec0cacd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b7f8f76394a8035 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.104+0000 7f19f17fa640 1 -- 172.21.15.79:0/4286012593 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ec048070 con 0x564f32442630 2024-08-20T01:53:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.104+0000 7f19f17fa640 1 -- 172.21.15.79:0/4286012593 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f19ec0ea070 con 0x564f32442630 2024-08-20T01:53:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.104+0000 7f19f17fa640 1 -- 172.21.15.79:0/4286012593 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ec03bb10 con 0x564f32442630 2024-08-20T01:53:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.105+0000 7f1a04ea3740 1 -- 172.21.15.79:0/4286012593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f32442630 msgr2=0x564f3244af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.105+0000 7f1a04ea3740 1 --2- 172.21.15.79:0/4286012593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f32442630 0x564f3244af30 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f19ec0cf4e0 tx=0x7f19ec0cacd0 comp rx=0 tx=0).stop 2024-08-20T01:53:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.105+0000 7f1a04ea3740 1 -- 172.21.15.79:0/4286012593 shutdown_connections 2024-08-20T01:53:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.105+0000 7f1a04ea3740 1 --2- 172.21.15.79:0/4286012593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f324479a0 0x564f324482c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.105+0000 7f1a04ea3740 1 --2- 172.21.15.79:0/4286012593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f32444f60 0x564f32447d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.105+0000 7f1a04ea3740 1 --2- 172.21.15.79:0/4286012593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f32442630 0x564f3244af30 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.105+0000 7f1a04ea3740 1 -- 172.21.15.79:0/4286012593 >> 172.21.15.79:0/4286012593 conn(0x564f3243d730 msgr2=0x564f32449350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.105+0000 7f1a04ea3740 1 -- 172.21.15.79:0/4286012593 shutdown_connections 2024-08-20T01:53:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.105+0000 7f1a04ea3740 1 -- 172.21.15.79:0/4286012593 wait complete. 2024-08-20T01:53:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.105+0000 7f1a04ea3740 1 -- start start 2024-08-20T01:53:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.105+0000 7f1a04ea3740 1 Processor -- start 2024-08-20T01:53:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.106+0000 7f1a04ea3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f32442630 0x564f32453370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.106+0000 7f1a04ea3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f32444f60 0x564f32453a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.106+0000 7f1a04ea3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f324479a0 0x564f32452090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.106+0000 7f1a04ea3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f19fc1a8df0 con 0x564f32444f60 2024-08-20T01:53:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.106+0000 7f1a04ea3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f19fc1a8720 con 0x564f324479a0 2024-08-20T01:53:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.106+0000 7f1a04ea3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f19fc1a5900 con 0x564f32442630 2024-08-20T01:53:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.106+0000 7f1a04ea3740 10 client.0 _ll_register_callbacks cb 0x7f19ec009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:53:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.106+0000 7f19f3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f32444f60 0x564f32453a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.106+0000 7f19f3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f32444f60 0x564f32453a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46804/0 (socket says 172.21.15.79:46804) 2024-08-20T01:53:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.106+0000 7f19f3fff640 1 -- 172.21.15.79:0/4244496201 learned_addr learned my addr 172.21.15.79:0/4244496201 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.106+0000 7f19fbfff640 1 --2- 172.21.15.79:0/4244496201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f324479a0 0x564f32452090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.106+0000 7f19fb7fe640 1 --2- 172.21.15.79:0/4244496201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f32442630 0x564f32453370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:19.115 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.106+0000 7f19f3fff640 1 -- 172.21.15.79:0/4244496201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f32442630 msgr2=0x564f32453370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:19.115 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.106+0000 7f19f3fff640 1 --2- 172.21.15.79:0/4244496201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f32442630 0x564f32453370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:19.115 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.106+0000 7f19f3fff640 1 -- 172.21.15.79:0/4244496201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f324479a0 msgr2=0x564f32452090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:19.115 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.106+0000 7f19f3fff640 1 --2- 172.21.15.79:0/4244496201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f324479a0 0x564f32452090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:19.115 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.106+0000 7f19f3fff640 1 -- 172.21.15.79:0/4244496201 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f324528c0 con 0x564f32444f60 2024-08-20T01:53:19.115 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.106+0000 7f19f3fff640 1 --2- 172.21.15.79:0/4244496201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f32444f60 0x564f32453a10 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f19e4009460 tx=0x7f19e40149a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bde34fb5b581fc94 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:19.115 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.106+0000 7f19daffd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:53:19.115 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.106+0000 7f19daffd640 1 -- 172.21.15.79:0/4244496201 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e4004250 con 0x564f32444f60 2024-08-20T01:53:19.115 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.106+0000 7f19daffd640 1 -- 172.21.15.79:0/4244496201 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f19e40043f0 con 0x564f32444f60 2024-08-20T01:53:19.115 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.106+0000 7f1a04ea3740 1 -- 172.21.15.79:0/4244496201 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19ec0ea070 con 0x564f32444f60 2024-08-20T01:53:19.115 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.106+0000 7f19daffd640 1 -- 172.21.15.79:0/4244496201 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) ==== 24+0+0 (secure 0 0 0) 0x7f19e402e050 con 0x564f32444f60 2024-08-20T01:53:19.115 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.106+0000 7f1a04ea3740 10 client.19464 fetch_fsmap learned FSMap version 65 2024-08-20T01:53:19.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.106+0000 7f1a04ea3740 1 -- 172.21.15.79:0/4244496201 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) -- 0x564f32451780 con 0x564f32444f60 2024-08-20T01:53:19.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.107+0000 7f19daffd640 1 -- 172.21.15.79:0/4244496201 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f19ec0ea070 con 0x564f32444f60 2024-08-20T01:53:19.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.107+0000 7f19daffd640 1 -- 172.21.15.79:0/4244496201 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 65) ==== 8394+0+0 (secure 0 0 0) 0x7f19e401e6a0 con 0x564f32444f60 2024-08-20T01:53:19.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.107+0000 7f1a04ea3740 10 client.19464 fetch_fsmap finished waiting for FSMap version 65 2024-08-20T01:53:19.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.107+0000 7f1a04ea3740 10 client.19464 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:53:19.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.107+0000 7f1a04ea3740 20 client.19464 populate_metadata read hostname 'smithi079' 2024-08-20T01:53:19.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.107+0000 7f1a04ea3740 1 --2- 172.21.15.79:0/4244496201 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564f324c29b0 0x564f324c4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:19.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.107+0000 7f1a04ea3740 4 client.19464 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:53:19.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.107+0000 7f1a04ea3740 1 -- 172.21.15.79:0/4244496201 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564f323b2d50 con 0x564f324c29b0 2024-08-20T01:53:19.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.107+0000 7f19fb7fe640 1 --2- 172.21.15.79:0/4244496201 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564f324c29b0 0x564f324c4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:19.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.107+0000 7f19daffd640 10 client.19464 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:53:19.116 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:19.107+0000 7f19fb7fe640 1 --2- 172.21.15.79:0/4244496201 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564f324c29b0 0x564f324c4dd0 crc :-1 s=READY pgs=329 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cc0aacaa71a503 server_cookie=19c728e95d81ac17 in_seq=0 out_seq=0 2024-08-20T01:53:20.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:19 smithi079 ceph-mon[18656]: pgmap v827: 97 pgs: 97 active+clean; 6.8 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 2.9 KiB/s wr, 22 op/s 2024-08-20T01:53:20.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:19 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:53:20.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:19 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:53:20.239 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:19 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:53:20.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:19 smithi081 ceph-mon[22209]: pgmap v827: 97 pgs: 97 active+clean; 6.8 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 2.9 KiB/s wr, 22 op/s 2024-08-20T01:53:20.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:19 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:53:20.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:19 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:53:20.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:19 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:53:20.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:19 smithi175 ceph-mon[22392]: pgmap v827: 97 pgs: 97 active+clean; 6.8 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 2.9 KiB/s wr, 22 op/s 2024-08-20T01:53:20.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:19 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:53:20.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:19 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:53:20.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:19 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:53:21.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:20 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:53:21.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:20 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:53:21.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:20 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:53:21.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:20 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:53:21.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:20 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:53:21.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:20 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:53:21.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:20 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:53:21.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:20 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:53:21.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:20 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:53:22.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:21 smithi079 ceph-mon[18656]: pgmap v828: 97 pgs: 97 active+clean; 6.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.0 KiB/s wr, 18 op/s 2024-08-20T01:53:22.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:21 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:53:22.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:21 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:53:22.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:21 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:53:22.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:21 smithi081 ceph-mon[22209]: pgmap v828: 97 pgs: 97 active+clean; 6.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.0 KiB/s wr, 18 op/s 2024-08-20T01:53:22.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:21 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:53:22.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:21 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:53:22.279 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:21 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:53:22.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:21 smithi175 ceph-mon[22392]: pgmap v828: 97 pgs: 97 active+clean; 6.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.0 KiB/s wr, 18 op/s 2024-08-20T01:53:22.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:21 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:53:22.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:21 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:53:22.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:21 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:53:23.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:23 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:53:23.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:23 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:53:23.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:23 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:53:24.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:24 smithi175 ceph-mon[22392]: pgmap v829: 97 pgs: 97 active+clean; 6.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.7 KiB/s wr, 19 op/s 2024-08-20T01:53:24.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:24 smithi079 ceph-mon[18656]: pgmap v829: 97 pgs: 97 active+clean; 6.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.7 KiB/s wr, 19 op/s 2024-08-20T01:53:24.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:24 smithi081 ceph-mon[22209]: pgmap v829: 97 pgs: 97 active+clean; 6.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.7 KiB/s wr, 19 op/s 2024-08-20T01:53:25.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:25 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:53:25.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:25 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:53:25.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:25 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:53:26.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:26 smithi175 ceph-mon[22392]: pgmap v830: 97 pgs: 97 active+clean; 6.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 6.2 KiB/s wr, 20 op/s 2024-08-20T01:53:26.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:26 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:53:26.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:26 smithi079 ceph-mon[18656]: pgmap v830: 97 pgs: 97 active+clean; 6.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 6.2 KiB/s wr, 20 op/s 2024-08-20T01:53:26.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:26 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:53:26.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:26 smithi081 ceph-mon[22209]: pgmap v830: 97 pgs: 97 active+clean; 6.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 6.2 KiB/s wr, 20 op/s 2024-08-20T01:53:26.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:26 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:53:27.200 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:27.197+0000 7f19daffd640 1 -- 172.21.15.79:0/4244496201 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564f323b2d50 con 0x564f324c29b0 2024-08-20T01:53:27.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:27.197+0000 7f19daffd640 10 client.19464 handle_command_reply: tid=0 2024-08-20T01:53:27.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:27.197+0000 7f1a04ea3740 1 client.19464 shutdown 2024-08-20T01:53:27.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:27.197+0000 7f1a04ea3740 1 -- 172.21.15.79:0/4244496201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f32444f60 msgr2=0x564f32453a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:27.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:27.197+0000 7f1a04ea3740 1 --2- 172.21.15.79:0/4244496201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f32444f60 0x564f32453a10 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f19e4009460 tx=0x7f19e40149a0 comp rx=0 tx=0).stop 2024-08-20T01:53:27.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:27.197+0000 7f1a04ea3740 1 -- 172.21.15.79:0/4244496201 shutdown_connections 2024-08-20T01:53:27.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:27.197+0000 7f1a04ea3740 1 --2- 172.21.15.79:0/4244496201 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564f324c29b0 0x564f324c4dd0 crc :-1 s=READY pgs=329 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:27.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:27.197+0000 7f1a04ea3740 1 --2- 172.21.15.79:0/4244496201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f324479a0 0x564f32452090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:27.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:27.197+0000 7f1a04ea3740 1 --2- 172.21.15.79:0/4244496201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f32444f60 0x564f32453a10 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:27.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:27.197+0000 7f1a04ea3740 1 --2- 172.21.15.79:0/4244496201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f32442630 0x564f32453370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:27.201 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:27.197+0000 7f1a04ea3740 1 -- 172.21.15.79:0/4244496201 >> 172.21.15.79:0/4244496201 conn(0x564f3243d730 msgr2=0x564f3243c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:27.202 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:27.197+0000 7f19daffd640 0 client.19464 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:53:27.202 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:27.197+0000 7f1a04ea3740 1 -- 172.21.15.79:0/4244496201 shutdown_connections 2024-08-20T01:53:27.202 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:27.197+0000 7f1a04ea3740 1 -- 172.21.15.79:0/4244496201 wait complete. 2024-08-20T01:53:27.202 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:27.197+0000 7f1a04ea3740 20 client.19464 trim_cache size 0 max 16384 2024-08-20T01:53:27.202 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:53:27.202 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:53:27.202 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:53:27.202 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:53:27.203 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:27.198+0000 7f1a020b7640 1 -- 172.21.15.79:0/2601506122 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f19e80b5de0 msgr2=0x7f19e80b82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:27.203 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:27.198+0000 7f1a020b7640 1 --2- 172.21.15.79:0/2601506122 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f19e80b5de0 0x7f19e80b82a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f19f401b000 tx=0x7f19f4010a70 comp rx=0 tx=0).stop 2024-08-20T01:53:27.203 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:27.198+0000 7f1a020b7640 1 -- 172.21.15.79:0/2601506122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19fc101560 msgr2=0x7f19fc1967d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:27.198+0000 7f1a020b7640 1 --2- 172.21.15.79:0/2601506122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19fc101560 0x7f19fc1967d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f19ec009900 tx=0x7f19ec0042f0 comp rx=0 tx=0).stop 2024-08-20T01:53:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:27.198+0000 7f1a020b7640 1 -- 172.21.15.79:0/2601506122 shutdown_connections 2024-08-20T01:53:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:27.198+0000 7f1a020b7640 1 --2- 172.21.15.79:0/2601506122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19fc103070 0x7f19fc197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:27.198+0000 7f1a020b7640 1 --2- 172.21.15.79:0/2601506122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19fc1026b0 0x7f19fc196e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:27.198+0000 7f1a020b7640 1 --2- 172.21.15.79:0/2601506122 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f19e80b5de0 0x7f19e80b82a0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:27.198+0000 7f1a020b7640 1 --2- 172.21.15.79:0/2601506122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19fc101560 0x7f19fc1967d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:27.198+0000 7f1a020b7640 1 -- 172.21.15.79:0/2601506122 >> 172.21.15.79:0/2601506122 conn(0x7f19fc0fce40 msgr2=0x7f19fc105b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:27.198+0000 7f1a020b7640 1 -- 172.21.15.79:0/2601506122 shutdown_connections 2024-08-20T01:53:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:27.198+0000 7f1a020b7640 1 -- 172.21.15.79:0/2601506122 wait complete. 2024-08-20T01:53:28.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:28 smithi175 ceph-mon[22392]: pgmap v831: 97 pgs: 97 active+clean; 6.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 8.0 KiB/s wr, 20 op/s 2024-08-20T01:53:28.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:28 smithi079 ceph-mon[18656]: pgmap v831: 97 pgs: 97 active+clean; 6.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 8.0 KiB/s wr, 20 op/s 2024-08-20T01:53:28.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:28 smithi081 ceph-mon[22209]: pgmap v831: 97 pgs: 97 active+clean; 6.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 8.0 KiB/s wr, 20 op/s 2024-08-20T01:53:30.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:30 smithi175 ceph-mon[22392]: pgmap v832: 97 pgs: 97 active+clean; 6.5 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.9 KiB/s wr, 21 op/s 2024-08-20T01:53:30.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:30 smithi079 ceph-mon[18656]: pgmap v832: 97 pgs: 97 active+clean; 6.5 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.9 KiB/s wr, 21 op/s 2024-08-20T01:53:30.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:30 smithi081 ceph-mon[22209]: pgmap v832: 97 pgs: 97 active+clean; 6.5 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.9 KiB/s wr, 21 op/s 2024-08-20T01:53:32.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:32 smithi079 ceph-mon[18656]: pgmap v833: 97 pgs: 97 active+clean; 6.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 8.0 KiB/s wr, 20 op/s 2024-08-20T01:53:32.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:32 smithi175 ceph-mon[22392]: pgmap v833: 97 pgs: 97 active+clean; 6.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 8.0 KiB/s wr, 20 op/s 2024-08-20T01:53:32.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:32 smithi081 ceph-mon[22209]: pgmap v833: 97 pgs: 97 active+clean; 6.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 8.0 KiB/s wr, 20 op/s 2024-08-20T01:53:34.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:34 smithi175 ceph-mon[22392]: pgmap v834: 97 pgs: 97 active+clean; 6.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.5 KiB/s wr, 19 op/s 2024-08-20T01:53:34.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:34 smithi079 ceph-mon[18656]: pgmap v834: 97 pgs: 97 active+clean; 6.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.5 KiB/s wr, 19 op/s 2024-08-20T01:53:34.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:34 smithi081 ceph-mon[22209]: pgmap v834: 97 pgs: 97 active+clean; 6.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.5 KiB/s wr, 19 op/s 2024-08-20T01:53:36.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:36 smithi175 ceph-mon[22392]: pgmap v835: 97 pgs: 97 active+clean; 6.3 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.1 KiB/s wr, 21 op/s 2024-08-20T01:53:36.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:36 smithi079 ceph-mon[18656]: pgmap v835: 97 pgs: 97 active+clean; 6.3 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.1 KiB/s wr, 21 op/s 2024-08-20T01:53:36.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:36 smithi081 ceph-mon[22209]: pgmap v835: 97 pgs: 97 active+clean; 6.3 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.1 KiB/s wr, 21 op/s 2024-08-20T01:53:36.565 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:53:36.815 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:53:37.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.320+0000 7f36169b4640 1 -- 172.21.15.79:0/455847713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36101073a0 msgr2=0x7f36101077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:37.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.320+0000 7f36169b4640 1 --2- 172.21.15.79:0/455847713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36101073a0 0x7f36101077e0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f35f8009900 tx=0x7f35f802a410 comp rx=0 tx=0).stop 2024-08-20T01:53:37.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.320+0000 7f36169b4640 1 -- 172.21.15.79:0/455847713 shutdown_connections 2024-08-20T01:53:37.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.320+0000 7f36169b4640 1 --2- 172.21.15.79:0/455847713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3610107d20 0x7f361010e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:37.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.320+0000 7f36169b4640 1 --2- 172.21.15.79:0/455847713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36101073a0 0x7f36101077e0 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:37.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.320+0000 7f36169b4640 1 --2- 172.21.15.79:0/455847713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3610101990 0x7f3610101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:37.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.320+0000 7f36169b4640 1 -- 172.21.15.79:0/455847713 >> 172.21.15.79:0/455847713 conn(0x7f36100fd400 msgr2=0x7f36100ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:37.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.320+0000 7f36169b4640 1 -- 172.21.15.79:0/455847713 shutdown_connections 2024-08-20T01:53:37.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.320+0000 7f36169b4640 1 -- 172.21.15.79:0/455847713 wait complete. 2024-08-20T01:53:37.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.320+0000 7f36169b4640 1 Processor -- start 2024-08-20T01:53:37.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.320+0000 7f36169b4640 1 -- start start 2024-08-20T01:53:37.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.320+0000 7f36169b4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3610101990 0x7f3610198f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:37.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.320+0000 7f36169b4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36101073a0 0x7f36101994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:37.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.320+0000 7f36169b4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3610107d20 0x7f361019e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:37.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.320+0000 7f36169b4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3610111850 con 0x7f3610107d20 2024-08-20T01:53:37.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.320+0000 7f36169b4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f36101116d0 con 0x7f3610101990 2024-08-20T01:53:37.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.320+0000 7f36169b4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f36101119d0 con 0x7f36101073a0 2024-08-20T01:53:37.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.321+0000 7f3614f51640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3610107d20 0x7f361019e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:37.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.321+0000 7f360ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3610101990 0x7f3610198f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:37.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.321+0000 7f3614f51640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3610107d20 0x7f361019e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59016/0 (socket says 172.21.15.79:59016) 2024-08-20T01:53:37.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.321+0000 7f3614f51640 1 -- 172.21.15.79:0/3311470025 learned_addr learned my addr 172.21.15.79:0/3311470025 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:37.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.321+0000 7f3607fff640 1 --2- 172.21.15.79:0/3311470025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36101073a0 0x7f36101994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:37.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.321+0000 7f3614f51640 1 -- 172.21.15.79:0/3311470025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36101073a0 msgr2=0x7f36101994b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:37.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.321+0000 7f3614f51640 1 --2- 172.21.15.79:0/3311470025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36101073a0 0x7f36101994b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:37.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.321+0000 7f3614f51640 1 -- 172.21.15.79:0/3311470025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3610101990 msgr2=0x7f3610198f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:37.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.321+0000 7f3614f51640 1 --2- 172.21.15.79:0/3311470025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3610101990 0x7f3610198f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:37.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.321+0000 7f3614f51640 1 -- 172.21.15.79:0/3311470025 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f361019f020 con 0x7f3610107d20 2024-08-20T01:53:37.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.321+0000 7f3614f51640 1 --2- 172.21.15.79:0/3311470025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3610107d20 0x7f361019e850 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f360800eaa0 tx=0x7f360800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:37.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.321+0000 7f360dffb640 1 -- 172.21.15.79:0/3311470025 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360800cdb0 con 0x7f3610107d20 2024-08-20T01:53:37.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.321+0000 7f360dffb640 1 -- 172.21.15.79:0/3311470025 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3608005020 con 0x7f3610107d20 2024-08-20T01:53:37.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.321+0000 7f36169b4640 1 -- 172.21.15.79:0/3311470025 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f361019f310 con 0x7f3610107d20 2024-08-20T01:53:37.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.321+0000 7f360dffb640 1 -- 172.21.15.79:0/3311470025 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36080116d0 con 0x7f3610107d20 2024-08-20T01:53:37.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.321+0000 7f36169b4640 1 -- 172.21.15.79:0/3311470025 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36101a59d0 con 0x7f3610107d20 2024-08-20T01:53:37.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.324+0000 7f3618dad740 1 Processor -- start 2024-08-20T01:53:37.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.324+0000 7f360dffb640 1 -- 172.21.15.79:0/3311470025 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f36080051d0 con 0x7f3610107d20 2024-08-20T01:53:37.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.324+0000 7f3618dad740 1 -- start start 2024-08-20T01:53:37.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.324+0000 7f3618dad740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56207d429830 0x56207d429c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:37.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.324+0000 7f3618dad740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56207d42a150 0x56207d439fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:37.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.324+0000 7f3618dad740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56207d43a4f0 0x56207d43c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:37.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.324+0000 7f3618dad740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56207d3a08e0 con 0x56207d429830 2024-08-20T01:53:37.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.324+0000 7f3618dad740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56207d38fde0 con 0x56207d42a150 2024-08-20T01:53:37.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.324+0000 7f3618dad740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56207d393e20 con 0x56207d43a4f0 2024-08-20T01:53:37.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.324+0000 7f3607fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56207d429830 0x56207d429c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:37.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.324+0000 7f360ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56207d42a150 0x56207d439fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:37.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.324+0000 7f3607fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56207d429830 0x56207d429c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59030/0 (socket says 172.21.15.79:59030) 2024-08-20T01:53:37.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.324+0000 7f360ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56207d42a150 0x56207d439fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:50726/0 (socket says 172.21.15.79:50726) 2024-08-20T01:53:37.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.324+0000 7f3607fff640 1 -- 172.21.15.79:0/3734215817 learned_addr learned my addr 172.21.15.79:0/3734215817 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:37.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.324+0000 7f3607fff640 1 --2- 172.21.15.79:0/3734215817 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56207d43a4f0 0x56207d43c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:37.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.324+0000 7f360ffff640 1 -- 172.21.15.79:0/3734215817 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56207d43a4f0 msgr2=0x56207d43c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:37.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.324+0000 7f360ffff640 1 --2- 172.21.15.79:0/3734215817 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56207d43a4f0 0x56207d43c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:37.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.324+0000 7f360ffff640 1 -- 172.21.15.79:0/3734215817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56207d429830 msgr2=0x56207d429c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:37.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.324+0000 7f360ffff640 1 --2- 172.21.15.79:0/3734215817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56207d429830 0x56207d429c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:37.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.324+0000 7f360ffff640 1 -- 172.21.15.79:0/3734215817 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56207d0ef650 con 0x56207d42a150 2024-08-20T01:53:37.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.324+0000 7f3607fff640 1 --2- 172.21.15.79:0/3734215817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56207d429830 0x56207d429c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:53:37.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.325+0000 7f360dffb640 1 --2- 172.21.15.79:0/3311470025 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f35fc0b3bd0 0x7f35fc0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:37.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.325+0000 7f360ffff640 1 --2- 172.21.15.79:0/3734215817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56207d42a150 0x56207d439fb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3600009c00 tx=0x7f3600011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96e08bc1046e8f18 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:37.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.325+0000 7f3607fff640 1 --2- 172.21.15.79:0/3311470025 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f35fc0b3bd0 0x7f35fc0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:37.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.325+0000 7f36067fc640 1 -- 172.21.15.79:0/3734215817 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3600004230 con 0x56207d42a150 2024-08-20T01:53:37.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.325+0000 7f360dffb640 1 -- 172.21.15.79:0/3311470025 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f36080e3ca0 con 0x7f3610107d20 2024-08-20T01:53:37.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.325+0000 7f36067fc640 1 -- 172.21.15.79:0/3734215817 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f36000043d0 con 0x56207d42a150 2024-08-20T01:53:37.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.325+0000 7f36067fc640 1 -- 172.21.15.79:0/3734215817 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3600004b90 con 0x56207d42a150 2024-08-20T01:53:37.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.326+0000 7f3618dad740 1 -- 172.21.15.79:0/3734215817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56207d42a150 msgr2=0x56207d439fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:37.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.326+0000 7f3607fff640 1 --2- 172.21.15.79:0/3311470025 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f35fc0b3bd0 0x7f35fc0b6090 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f35f8000c00 tx=0x7f35f8005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:37.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.326+0000 7f3618dad740 1 --2- 172.21.15.79:0/3734215817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56207d42a150 0x56207d439fb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3600009c00 tx=0x7f3600011810 comp rx=0 tx=0).stop 2024-08-20T01:53:37.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.326+0000 7f3618dad740 1 -- 172.21.15.79:0/3734215817 shutdown_connections 2024-08-20T01:53:37.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.326+0000 7f3618dad740 1 --2- 172.21.15.79:0/3734215817 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56207d43a4f0 0x56207d43c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:37.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.326+0000 7f3618dad740 1 --2- 172.21.15.79:0/3734215817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56207d42a150 0x56207d439fb0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:37.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.326+0000 7f3618dad740 1 --2- 172.21.15.79:0/3734215817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56207d429830 0x56207d429c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:37.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.326+0000 7f3618dad740 1 -- 172.21.15.79:0/3734215817 >> 172.21.15.79:0/3734215817 conn(0x56207d427660 msgr2=0x56207d428800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:37.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.326+0000 7f3618dad740 1 -- 172.21.15.79:0/3734215817 shutdown_connections 2024-08-20T01:53:37.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.326+0000 7f3618dad740 1 -- 172.21.15.79:0/3734215817 wait complete. 2024-08-20T01:53:37.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.326+0000 7f3618dad740 1 -- start start 2024-08-20T01:53:37.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.326+0000 7f3618dad740 1 Processor -- start 2024-08-20T01:53:37.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.326+0000 7f3618dad740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56207d429830 0x56207d437440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:37.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.327+0000 7f3618dad740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56207d42a150 0x56207d437980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:37.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.327+0000 7f3618dad740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56207d43a4f0 0x56207d437ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:37.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.327+0000 7f3618dad740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56207d1f2700 con 0x56207d43a4f0 2024-08-20T01:53:37.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.327+0000 7f3618dad740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56207d3167c0 con 0x56207d42a150 2024-08-20T01:53:37.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.327+0000 7f3618dad740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56207d43d170 con 0x56207d429830 2024-08-20T01:53:37.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.327+0000 7f3618dad740 10 client.0 _ll_register_callbacks cb 0x56207d3896b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:53:37.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.327+0000 7f3614f51640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56207d43a4f0 0x56207d437ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:37.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.327+0000 7f3614f51640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56207d43a4f0 0x56207d437ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59042/0 (socket says 172.21.15.79:59042) 2024-08-20T01:53:37.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.327+0000 7f3614f51640 1 -- 172.21.15.79:0/3232460378 learned_addr learned my addr 172.21.15.79:0/3232460378 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:37.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.327+0000 7f360ffff640 1 --2- 172.21.15.79:0/3232460378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56207d429830 0x56207d437440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:37.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.327+0000 7f3607fff640 1 --2- 172.21.15.79:0/3232460378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56207d42a150 0x56207d437980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:37.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.327+0000 7f3614f51640 1 -- 172.21.15.79:0/3232460378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56207d429830 msgr2=0x56207d437440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:37.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.327+0000 7f3614f51640 1 --2- 172.21.15.79:0/3232460378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56207d429830 0x56207d437440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:37.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.327+0000 7f3614f51640 1 -- 172.21.15.79:0/3232460378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56207d42a150 msgr2=0x56207d437980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:37.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.327+0000 7f3614f51640 1 --2- 172.21.15.79:0/3232460378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56207d42a150 0x56207d437980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:37.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.327+0000 7f3614f51640 1 -- 172.21.15.79:0/3232460378 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56207d4464d0 con 0x56207d43a4f0 2024-08-20T01:53:37.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.327+0000 7f3614f51640 1 --2- 172.21.15.79:0/3232460378 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56207d43a4f0 0x56207d437ec0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f36080aac40 tx=0x7f36080aa880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaa47a15fe084f2e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:37.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.327+0000 7f35ef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:53:37.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.327+0000 7f35ef7fe640 1 -- 172.21.15.79:0/3232460378 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360801f040 con 0x56207d43a4f0 2024-08-20T01:53:37.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.327+0000 7f35ef7fe640 1 -- 172.21.15.79:0/3232460378 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f36080a9f10 con 0x56207d43a4f0 2024-08-20T01:53:37.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.327+0000 7f3618dad740 1 -- 172.21.15.79:0/3232460378 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56207d33f100 con 0x56207d43a4f0 2024-08-20T01:53:37.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.327+0000 7f35ef7fe640 1 -- 172.21.15.79:0/3232460378 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f36080b3cb0 con 0x56207d43a4f0 2024-08-20T01:53:37.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.327+0000 7f3618dad740 10 client.19476 fetch_fsmap learned FSMap version 69 2024-08-20T01:53:37.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.327+0000 7f3618dad740 1 -- 172.21.15.79:0/3232460378 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) -- 0x56207d448e80 con 0x56207d43a4f0 2024-08-20T01:53:37.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.328+0000 7f35ef7fe640 1 -- 172.21.15.79:0/3232460378 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56207d33f100 con 0x56207d43a4f0 2024-08-20T01:53:37.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.328+0000 7f35ef7fe640 1 -- 172.21.15.79:0/3232460378 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 69) ==== 8366+0+0 (secure 0 0 0) 0x7f360800f040 con 0x56207d43a4f0 2024-08-20T01:53:37.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.328+0000 7f3618dad740 10 client.19476 fetch_fsmap finished waiting for FSMap version 69 2024-08-20T01:53:37.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.328+0000 7f3618dad740 10 client.19476 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:53:37.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.328+0000 7f3618dad740 20 client.19476 populate_metadata read hostname 'smithi079' 2024-08-20T01:53:37.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.328+0000 7f3618dad740 1 --2- 172.21.15.79:0/3232460378 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56207d44a390 0x56207d44c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:37.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.328+0000 7f3618dad740 4 client.19476 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:53:37.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.328+0000 7f3618dad740 1 -- 172.21.15.79:0/3232460378 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56207d3a2830 con 0x56207d44a390 2024-08-20T01:53:37.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.328+0000 7f360ffff640 1 --2- 172.21.15.79:0/3232460378 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56207d44a390 0x56207d44c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:37.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.329+0000 7f360ffff640 1 --2- 172.21.15.79:0/3232460378 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56207d44a390 0x56207d44c7c0 crc :-1 s=READY pgs=330 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc16b97a7f7e1b08 server_cookie=7fe7ddbf1f80e34d in_seq=0 out_seq=0 2024-08-20T01:53:37.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.329+0000 7f35ef7fe640 10 client.19476 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:53:37.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.329+0000 7f35ef7fe640 1 -- 172.21.15.79:0/3232460378 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56207d3a2830 con 0x56207d44a390 2024-08-20T01:53:37.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.329+0000 7f35ef7fe640 10 client.19476 handle_command_reply: tid=0 2024-08-20T01:53:37.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.329+0000 7f3618dad740 1 client.19476 shutdown 2024-08-20T01:53:37.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.329+0000 7f3618dad740 1 -- 172.21.15.79:0/3232460378 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56207d43a4f0 msgr2=0x56207d437ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:37.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.329+0000 7f3618dad740 1 --2- 172.21.15.79:0/3232460378 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56207d43a4f0 0x56207d437ec0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f36080aac40 tx=0x7f36080aa880 comp rx=0 tx=0).stop 2024-08-20T01:53:37.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.329+0000 7f3618dad740 1 -- 172.21.15.79:0/3232460378 shutdown_connections 2024-08-20T01:53:37.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.329+0000 7f3618dad740 1 --2- 172.21.15.79:0/3232460378 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56207d44a390 0x56207d44c7c0 crc :-1 s=READY pgs=330 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:37.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.329+0000 7f3618dad740 1 --2- 172.21.15.79:0/3232460378 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56207d43a4f0 0x56207d437ec0 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:37.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.329+0000 7f3618dad740 1 --2- 172.21.15.79:0/3232460378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56207d42a150 0x56207d437980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:37.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.329+0000 7f35ef7fe640 0 client.19476 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:53:37.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.329+0000 7f3618dad740 1 --2- 172.21.15.79:0/3232460378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56207d429830 0x56207d437440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:37.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.329+0000 7f3618dad740 1 -- 172.21.15.79:0/3232460378 >> 172.21.15.79:0/3232460378 conn(0x56207d427660 msgr2=0x56207d42d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:37.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.330+0000 7f3618dad740 1 -- 172.21.15.79:0/3232460378 shutdown_connections 2024-08-20T01:53:37.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.330+0000 7f3618dad740 1 -- 172.21.15.79:0/3232460378 wait complete. 2024-08-20T01:53:37.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.330+0000 7f3618dad740 20 client.19476 trim_cache size 0 max 16384 2024-08-20T01:53:37.351 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.347+0000 7f3618dad740 1 Processor -- start 2024-08-20T01:53:37.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.347+0000 7f3618dad740 1 -- start start 2024-08-20T01:53:37.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.347+0000 7f3618dad740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56207d429830 0x56207d434f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:37.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.347+0000 7f3618dad740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56207d42a150 0x56207d425f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:37.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.347+0000 7f3618dad740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56207d43a4f0 0x56207d426440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:37.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.347+0000 7f3618dad740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f36101abde0 con 0x56207d429830 2024-08-20T01:53:37.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.347+0000 7f3618dad740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f36101ad920 con 0x56207d42a150 2024-08-20T01:53:37.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.347+0000 7f3618dad740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f36101ac4b0 con 0x56207d43a4f0 2024-08-20T01:53:37.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.347+0000 7f360ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56207d429830 0x56207d434f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:37.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.347+0000 7f3607fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56207d42a150 0x56207d425f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:37.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.347+0000 7f360ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56207d429830 0x56207d434f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59044/0 (socket says 172.21.15.79:59044) 2024-08-20T01:53:37.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.347+0000 7f360ffff640 1 -- 172.21.15.79:0/240800868 learned_addr learned my addr 172.21.15.79:0/240800868 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:37.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.347+0000 7f3614f51640 1 --2- 172.21.15.79:0/240800868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56207d43a4f0 0x56207d426440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:37.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.348+0000 7f360ffff640 1 -- 172.21.15.79:0/240800868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56207d43a4f0 msgr2=0x56207d426440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:37.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.348+0000 7f360ffff640 1 --2- 172.21.15.79:0/240800868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56207d43a4f0 0x56207d426440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:37.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.348+0000 7f360ffff640 1 -- 172.21.15.79:0/240800868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56207d42a150 msgr2=0x56207d425f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:37.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.348+0000 7f360ffff640 1 --2- 172.21.15.79:0/240800868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56207d42a150 0x56207d425f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:37.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.348+0000 7f360ffff640 1 -- 172.21.15.79:0/240800868 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56207d428340 con 0x56207d429830 2024-08-20T01:53:37.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.348+0000 7f3614f51640 1 --2- 172.21.15.79:0/240800868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56207d43a4f0 0x56207d426440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:53:37.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.348+0000 7f3607fff640 1 --2- 172.21.15.79:0/240800868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56207d42a150 0x56207d425f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:53:37.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.348+0000 7f360ffff640 1 --2- 172.21.15.79:0/240800868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56207d429830 0x56207d434f80 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f36000058c0 tx=0x7f3600009890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23dcaef44b52169d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:37.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.348+0000 7f3605ffb640 1 -- 172.21.15.79:0/240800868 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360001e040 con 0x56207d429830 2024-08-20T01:53:37.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.348+0000 7f3605ffb640 1 -- 172.21.15.79:0/240800868 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f36000044a0 con 0x56207d429830 2024-08-20T01:53:37.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.348+0000 7f3605ffb640 1 -- 172.21.15.79:0/240800868 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3600024420 con 0x56207d429830 2024-08-20T01:53:37.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.349+0000 7f3618dad740 1 -- 172.21.15.79:0/240800868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56207d429830 msgr2=0x56207d434f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:37.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.349+0000 7f3618dad740 1 --2- 172.21.15.79:0/240800868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56207d429830 0x56207d434f80 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f36000058c0 tx=0x7f3600009890 comp rx=0 tx=0).stop 2024-08-20T01:53:37.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.349+0000 7f3618dad740 1 -- 172.21.15.79:0/240800868 shutdown_connections 2024-08-20T01:53:37.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.349+0000 7f3618dad740 1 --2- 172.21.15.79:0/240800868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56207d43a4f0 0x56207d426440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:37.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.349+0000 7f3618dad740 1 --2- 172.21.15.79:0/240800868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56207d42a150 0x56207d425f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:37.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.349+0000 7f3618dad740 1 --2- 172.21.15.79:0/240800868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56207d429830 0x56207d434f80 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:37.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.349+0000 7f3618dad740 1 -- 172.21.15.79:0/240800868 >> 172.21.15.79:0/240800868 conn(0x56207d427660 msgr2=0x56207d43b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:37.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.349+0000 7f3618dad740 1 -- 172.21.15.79:0/240800868 shutdown_connections 2024-08-20T01:53:37.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.349+0000 7f3618dad740 1 -- 172.21.15.79:0/240800868 wait complete. 2024-08-20T01:53:37.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.349+0000 7f3618dad740 1 -- start start 2024-08-20T01:53:37.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.349+0000 7f3618dad740 1 Processor -- start 2024-08-20T01:53:37.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.350+0000 7f3618dad740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56207d429830 0x56207d452460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:37.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.350+0000 7f3618dad740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56207d42a150 0x56207d442400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:37.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.350+0000 7f3618dad740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56207d43a4f0 0x56207d442940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:37.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.350+0000 7f3618dad740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f36101ad250 con 0x56207d429830 2024-08-20T01:53:37.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.350+0000 7f3618dad740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f36101acb80 con 0x56207d42a150 2024-08-20T01:53:37.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.350+0000 7f3618dad740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f36101a9dc0 con 0x56207d43a4f0 2024-08-20T01:53:37.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.350+0000 7f3618dad740 10 client.0 _ll_register_callbacks cb 0x7f36080057c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:53:37.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.350+0000 7f3607fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56207d42a150 0x56207d442400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:37.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.350+0000 7f360ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56207d429830 0x56207d452460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:37.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.350+0000 7f3607fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56207d42a150 0x56207d442400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:50760/0 (socket says 172.21.15.79:50760) 2024-08-20T01:53:37.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.350+0000 7f3607fff640 1 -- 172.21.15.79:0/1174622523 learned_addr learned my addr 172.21.15.79:0/1174622523 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:37.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.350+0000 7f360ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56207d429830 0x56207d452460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59060/0 (socket says 172.21.15.79:59060) 2024-08-20T01:53:37.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.350+0000 7f3614f51640 1 --2- 172.21.15.79:0/1174622523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56207d43a4f0 0x56207d442940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:37.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.350+0000 7f3607fff640 1 -- 172.21.15.79:0/1174622523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56207d43a4f0 msgr2=0x56207d442940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:37.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.350+0000 7f3607fff640 1 --2- 172.21.15.79:0/1174622523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56207d43a4f0 0x56207d442940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:37.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.350+0000 7f3607fff640 1 -- 172.21.15.79:0/1174622523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56207d429830 msgr2=0x56207d452460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:37.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.350+0000 7f3607fff640 1 --2- 172.21.15.79:0/1174622523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56207d429830 0x56207d452460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:37.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.350+0000 7f3607fff640 1 -- 172.21.15.79:0/1174622523 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56207d442eb0 con 0x56207d42a150 2024-08-20T01:53:37.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.350+0000 7f3614f51640 1 --2- 172.21.15.79:0/1174622523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56207d43a4f0 0x56207d442940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:53:37.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.350+0000 7f360ffff640 1 --2- 172.21.15.79:0/1174622523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56207d429830 0x56207d452460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:53:37.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.350+0000 7f3607fff640 1 --2- 172.21.15.79:0/1174622523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56207d42a150 0x56207d442400 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f35f802a930 tx=0x7f35f802a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64c9b8085b7fcc2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:37.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.350+0000 7f35ef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:53:37.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.350+0000 7f35ef7fe640 1 -- 172.21.15.79:0/1174622523 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f8058060 con 0x56207d42a150 2024-08-20T01:53:37.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.351+0000 7f35ef7fe640 1 -- 172.21.15.79:0/1174622523 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f35f8044070 con 0x56207d42a150 2024-08-20T01:53:37.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.351+0000 7f3618dad740 1 -- 172.21.15.79:0/1174622523 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36000044a0 con 0x56207d42a150 2024-08-20T01:53:37.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.351+0000 7f35ef7fe640 1 -- 172.21.15.79:0/1174622523 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f35f8035040 con 0x56207d42a150 2024-08-20T01:53:37.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.351+0000 7f3618dad740 10 client.28577 fetch_fsmap learned FSMap version 69 2024-08-20T01:53:37.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.351+0000 7f3618dad740 1 -- 172.21.15.79:0/1174622523 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) -- 0x56207d4b4060 con 0x56207d42a150 2024-08-20T01:53:37.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.351+0000 7f35ef7fe640 1 -- 172.21.15.79:0/1174622523 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f36000044a0 con 0x56207d42a150 2024-08-20T01:53:37.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.351+0000 7f35ef7fe640 1 -- 172.21.15.79:0/1174622523 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 69) ==== 8366+0+0 (secure 0 0 0) 0x7f35f8047040 con 0x56207d42a150 2024-08-20T01:53:37.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.351+0000 7f3618dad740 10 client.28577 fetch_fsmap finished waiting for FSMap version 69 2024-08-20T01:53:37.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.351+0000 7f3618dad740 10 client.28577 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:53:37.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.351+0000 7f3618dad740 20 client.28577 populate_metadata read hostname 'smithi079' 2024-08-20T01:53:37.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.351+0000 7f3618dad740 1 --2- 172.21.15.79:0/1174622523 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56207d4b47d0 0x56207d4b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:37.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.351+0000 7f3618dad740 4 client.28577 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:53:37.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.351+0000 7f3618dad740 1 -- 172.21.15.79:0/1174622523 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56207d39e2d0 con 0x56207d4b47d0 2024-08-20T01:53:37.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.351+0000 7f360ffff640 1 --2- 172.21.15.79:0/1174622523 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56207d4b47d0 0x56207d4b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:37.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.352+0000 7f360ffff640 1 --2- 172.21.15.79:0/1174622523 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56207d4b47d0 0x56207d4b6bf0 crc :-1 s=READY pgs=331 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9efd834caf7ac9e3 server_cookie=1adcc1fabb13e0c3 in_seq=0 out_seq=0 2024-08-20T01:53:37.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.352+0000 7f35ef7fe640 10 client.28577 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:53:37.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.352+0000 7f35ef7fe640 1 -- 172.21.15.79:0/1174622523 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56207d39e2d0 con 0x56207d4b47d0 2024-08-20T01:53:37.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.352+0000 7f35ef7fe640 10 client.28577 handle_command_reply: tid=0 2024-08-20T01:53:37.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.352+0000 7f3618dad740 1 client.28577 shutdown 2024-08-20T01:53:37.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.352+0000 7f3618dad740 1 -- 172.21.15.79:0/1174622523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56207d42a150 msgr2=0x56207d442400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:37.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.352+0000 7f3618dad740 1 --2- 172.21.15.79:0/1174622523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56207d42a150 0x56207d442400 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f35f802a930 tx=0x7f35f802a410 comp rx=0 tx=0).stop 2024-08-20T01:53:37.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.352+0000 7f3618dad740 1 -- 172.21.15.79:0/1174622523 shutdown_connections 2024-08-20T01:53:37.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.352+0000 7f3618dad740 1 --2- 172.21.15.79:0/1174622523 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56207d4b47d0 0x56207d4b6bf0 crc :-1 s=READY pgs=331 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:37.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.352+0000 7f3618dad740 1 --2- 172.21.15.79:0/1174622523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56207d43a4f0 0x56207d442940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:37.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.352+0000 7f35ef7fe640 0 client.28577 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:53:37.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.352+0000 7f3618dad740 1 --2- 172.21.15.79:0/1174622523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56207d42a150 0x56207d442400 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:37.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.352+0000 7f3618dad740 1 --2- 172.21.15.79:0/1174622523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56207d429830 0x56207d452460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:37.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.352+0000 7f3618dad740 1 -- 172.21.15.79:0/1174622523 >> 172.21.15.79:0/1174622523 conn(0x56207d427660 msgr2=0x56207d438a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:37.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.352+0000 7f3618dad740 1 -- 172.21.15.79:0/1174622523 shutdown_connections 2024-08-20T01:53:37.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.352+0000 7f3618dad740 1 -- 172.21.15.79:0/1174622523 wait complete. 2024-08-20T01:53:37.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.352+0000 7f3618dad740 20 client.28577 trim_cache size 0 max 16384 2024-08-20T01:53:37.362 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:53:37.362 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-08-20T01:53:37.362 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-08-20T01:53:37.362 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:53:37.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.353+0000 7f36169b4640 1 -- 172.21.15.79:0/3311470025 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f35fc0b3bd0 msgr2=0x7f35fc0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:37.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.353+0000 7f36169b4640 1 --2- 172.21.15.79:0/3311470025 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f35fc0b3bd0 0x7f35fc0b6090 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f35f8000c00 tx=0x7f35f8005fd0 comp rx=0 tx=0).stop 2024-08-20T01:53:37.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.353+0000 7f36169b4640 1 -- 172.21.15.79:0/3311470025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3610107d20 msgr2=0x7f361019e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:37.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.353+0000 7f36169b4640 1 --2- 172.21.15.79:0/3311470025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3610107d20 0x7f361019e850 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f360800eaa0 tx=0x7f360800ef60 comp rx=0 tx=0).stop 2024-08-20T01:53:37.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.353+0000 7f36169b4640 1 -- 172.21.15.79:0/3311470025 shutdown_connections 2024-08-20T01:53:37.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.353+0000 7f36169b4640 1 --2- 172.21.15.79:0/3311470025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3610107d20 0x7f361019e850 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:37.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.353+0000 7f36169b4640 1 --2- 172.21.15.79:0/3311470025 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f35fc0b3bd0 0x7f35fc0b6090 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:37.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.353+0000 7f36169b4640 1 --2- 172.21.15.79:0/3311470025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36101073a0 0x7f36101994b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:37.363 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.353+0000 7f36169b4640 1 --2- 172.21.15.79:0/3311470025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3610101990 0x7f3610198f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:37.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.353+0000 7f36169b4640 1 -- 172.21.15.79:0/3311470025 >> 172.21.15.79:0/3311470025 conn(0x7f36100fd400 msgr2=0x7f3610104980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:37.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.353+0000 7f36169b4640 1 -- 172.21.15.79:0/3311470025 shutdown_connections 2024-08-20T01:53:37.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:37.353+0000 7f36169b4640 1 -- 172.21.15.79:0/3311470025 wait complete. 2024-08-20T01:53:38.139 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T01:53:38.140 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:53:38.388 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:53:38.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:38 smithi175 ceph-mon[22392]: pgmap v836: 97 pgs: 97 active+clean; 6.2 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.6 KiB/s wr, 21 op/s 2024-08-20T01:53:38.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:38 smithi079 ceph-mon[18656]: pgmap v836: 97 pgs: 97 active+clean; 6.2 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.6 KiB/s wr, 21 op/s 2024-08-20T01:53:38.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:38 smithi081 ceph-mon[22209]: pgmap v836: 97 pgs: 97 active+clean; 6.2 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.6 KiB/s wr, 21 op/s 2024-08-20T01:53:38.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:38.886+0000 7fe4d1424640 1 -- 172.21.15.79:0/708559432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe4cc1042c0 msgr2=0x7fe4cc10c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:38.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:38.886+0000 7fe4d1424640 1 --2- 172.21.15.79:0/708559432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe4cc1042c0 0x7fe4cc10c7b0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4009900 tx=0x7fe4b402a410 comp rx=0 tx=0).stop 2024-08-20T01:53:38.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:38.886+0000 7fe4d1424640 1 -- 172.21.15.79:0/708559432 shutdown_connections 2024-08-20T01:53:38.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:38.886+0000 7fe4d1424640 1 --2- 172.21.15.79:0/708559432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4cc10ce00 0x7fe4cc10f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:38.915 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:38.886+0000 7fe4d1424640 1 --2- 172.21.15.79:0/708559432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe4cc1042c0 0x7fe4cc10c7b0 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:38.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:38.886+0000 7fe4d1424640 1 --2- 172.21.15.79:0/708559432 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4cc1039a0 0x7fe4cc103d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:38.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:38.886+0000 7fe4d1424640 1 -- 172.21.15.79:0/708559432 >> 172.21.15.79:0/708559432 conn(0x7fe4cc0fd400 msgr2=0x7fe4cc0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:38.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:38.886+0000 7fe4d1424640 1 -- 172.21.15.79:0/708559432 shutdown_connections 2024-08-20T01:53:38.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:38.886+0000 7fe4d1424640 1 -- 172.21.15.79:0/708559432 wait complete. 2024-08-20T01:53:38.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:38.887+0000 7fe4d1424640 1 Processor -- start 2024-08-20T01:53:38.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:38.887+0000 7fe4d1424640 1 -- start start 2024-08-20T01:53:38.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:38.887+0000 7fe4d1424640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4cc1039a0 0x7fe4cc198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:38.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:38.887+0000 7fe4d1424640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4cc1042c0 0x7fe4cc1993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:38.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:38.887+0000 7fe4d1424640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe4cc10ce00 0x7fe4cc19e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:38.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:38.887+0000 7fe4d1424640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe4cc112920 con 0x7fe4cc10ce00 2024-08-20T01:53:38.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:38.887+0000 7fe4d1424640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe4cc1127a0 con 0x7fe4cc1039a0 2024-08-20T01:53:38.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:38.887+0000 7fe4d1424640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe4cc112aa0 con 0x7fe4cc1042c0 2024-08-20T01:53:38.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:38.887+0000 7fe4cb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe4cc10ce00 0x7fe4cc19e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:38.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:38.887+0000 7fe4caffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4cc1039a0 0x7fe4cc198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:38.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:38.887+0000 7fe4cb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe4cc10ce00 0x7fe4cc19e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59076/0 (socket says 172.21.15.79:59076) 2024-08-20T01:53:38.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:38.887+0000 7fe4caffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4cc1039a0 0x7fe4cc198eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:50786/0 (socket says 172.21.15.79:50786) 2024-08-20T01:53:38.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:38.887+0000 7fe4cb7fe640 1 -- 172.21.15.79:0/2909059766 learned_addr learned my addr 172.21.15.79:0/2909059766 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:38.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:38.887+0000 7fe4c3fff640 1 --2- 172.21.15.79:0/2909059766 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4cc1042c0 0x7fe4cc1993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:38.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:38.887+0000 7fe4cb7fe640 1 -- 172.21.15.79:0/2909059766 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4cc1042c0 msgr2=0x7fe4cc1993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:38.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:38.887+0000 7fe4cb7fe640 1 --2- 172.21.15.79:0/2909059766 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4cc1042c0 0x7fe4cc1993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:38.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:38.887+0000 7fe4cb7fe640 1 -- 172.21.15.79:0/2909059766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4cc1039a0 msgr2=0x7fe4cc198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:38.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:38.887+0000 7fe4cb7fe640 1 --2- 172.21.15.79:0/2909059766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4cc1039a0 0x7fe4cc198eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:38.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:38.887+0000 7fe4cb7fe640 1 -- 172.21.15.79:0/2909059766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4cc19ef60 con 0x7fe4cc10ce00 2024-08-20T01:53:38.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:38.887+0000 7fe4caffd640 1 --2- 172.21.15.79:0/2909059766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4cc1039a0 0x7fe4cc198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:53:38.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:38.888+0000 7fe4cb7fe640 1 --2- 172.21.15.79:0/2909059766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe4cc10ce00 0x7fe4cc19e790 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fe4c400eb10 tx=0x7fe4c400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:38.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:38.888+0000 7fe4c8ff9640 1 -- 172.21.15.79:0/2909059766 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c4004b20 con 0x7fe4cc10ce00 2024-08-20T01:53:38.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:38.888+0000 7fe4d1424640 1 -- 172.21.15.79:0/2909059766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4cc19f250 con 0x7fe4cc10ce00 2024-08-20T01:53:38.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:38.888+0000 7fe4c8ff9640 1 -- 172.21.15.79:0/2909059766 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe4c4004cc0 con 0x7fe4cc10ce00 2024-08-20T01:53:38.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:38.888+0000 7fe4c8ff9640 1 -- 172.21.15.79:0/2909059766 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c4010690 con 0x7fe4cc10ce00 2024-08-20T01:53:38.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:38.888+0000 7fe4d1424640 1 -- 172.21.15.79:0/2909059766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4cc1a5910 con 0x7fe4cc10ce00 2024-08-20T01:53:38.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:38.889+0000 7fe4d1424640 1 -- 172.21.15.79:0/2909059766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4cc06aeb0 con 0x7fe4cc10ce00 2024-08-20T01:53:38.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:38.890+0000 7fe4c8ff9640 1 -- 172.21.15.79:0/2909059766 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fe4c4005000 con 0x7fe4cc10ce00 2024-08-20T01:53:38.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:38.891+0000 7fe4c8ff9640 1 --2- 172.21.15.79:0/2909059766 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe4b80b3bd0 0x7fe4b80b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:38.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:38.891+0000 7fe4caffd640 1 --2- 172.21.15.79:0/2909059766 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe4b80b3bd0 0x7fe4b80b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:38.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:38.891+0000 7fe4c8ff9640 1 -- 172.21.15.79:0/2909059766 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fe4c40e4430 con 0x7fe4cc10ce00 2024-08-20T01:53:38.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:38.891+0000 7fe4caffd640 1 --2- 172.21.15.79:0/2909059766 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe4b80b3bd0 0x7fe4b80b6090 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc00bfd0 tx=0x7fe4bc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:38.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:38.894+0000 7fe4c8ff9640 1 -- 172.21.15.79:0/2909059766 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fe4c4055e20 con 0x7fe4cc10ce00 2024-08-20T01:53:39.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:39.119+0000 7fe4d1424640 1 -- 172.21.15.79:0/2909059766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe4cc103d80 con 0x7fe4cc10ce00 2024-08-20T01:53:39.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:39.119+0000 7fe4c8ff9640 1 -- 172.21.15.79:0/2909059766 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+11974 (secure 0 0 0) 0x7fe4c40aba90 con 0x7fe4cc10ce00 2024-08-20T01:53:39.123 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:53:39.123 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":69,"btime":"2024-08-20T01:53:25:044474+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14670,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/735082912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":735082912},{"type":"v1","addr":"172.21.15.79:6835","nonce":735082912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2150339873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2150339873},{"type":"v1","addr":"172.21.15.79:6837","nonce":2150339873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":69,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:34:55.133562+0000","modified":"2024-08-20T01:53:24.617837+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24539,"mds_1":24538,"mds_2":24523,"mds_3":24514,"mds_4":24512},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14724":{"gid":14724,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/1071242274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1071242274},{"type":"v1","addr":"172.21.15.79:6839","nonce":1071242274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14730":{"gid":14730,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6841/2448977611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":2448977611},{"type":"v1","addr":"172.21.15.79:6841","nonce":2448977611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/1257507005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1257507005},{"type":"v1","addr":"172.21.15.81:6833","nonce":1257507005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1499936216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1499936216},{"type":"v1","addr":"172.21.15.81:6835","nonce":1499936216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/1107229215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1107229215},{"type":"v1","addr":"172.21.15.175:6833","nonce":1107229215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6837/2073598870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2073598870},{"type":"v1","addr":"172.21.15.81:6837","nonce":2073598870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/2552601173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2552601173},{"type":"v1","addr":"172.21.15.175:6835","nonce":2552601173}]},"join_fscid":-1,"export_targets":[4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6837/1767284089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1767284089},{"type":"v1","addr":"172.21.15.175:6837","nonce":1767284089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/1331748742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1331748742},{"type":"v1","addr":"172.21.15.175:6839","nonce":1331748742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/4098410583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":4098410583},{"type":"v1","addr":"172.21.15.81:6839","nonce":4098410583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24539,"qdb_cluster":[24539,24523,24514,24538,24512]},"id":1}]} 2024-08-20T01:53:39.123 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 69 2024-08-20T01:53:39.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:39.121+0000 7fe4d1424640 1 -- 172.21.15.79:0/2909059766 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe4b80b3bd0 msgr2=0x7fe4b80b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:39.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:39.121+0000 7fe4d1424640 1 --2- 172.21.15.79:0/2909059766 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe4b80b3bd0 0x7fe4b80b6090 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc00bfd0 tx=0x7fe4bc00b390 comp rx=0 tx=0).stop 2024-08-20T01:53:39.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:39.122+0000 7fe4d1424640 1 -- 172.21.15.79:0/2909059766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe4cc10ce00 msgr2=0x7fe4cc19e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:39.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:39.122+0000 7fe4d1424640 1 --2- 172.21.15.79:0/2909059766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe4cc10ce00 0x7fe4cc19e790 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fe4c400eb10 tx=0x7fe4c400c2d0 comp rx=0 tx=0).stop 2024-08-20T01:53:39.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:39.122+0000 7fe4d1424640 1 -- 172.21.15.79:0/2909059766 shutdown_connections 2024-08-20T01:53:39.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:39.122+0000 7fe4d1424640 1 --2- 172.21.15.79:0/2909059766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe4cc10ce00 0x7fe4cc19e790 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:39.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:39.122+0000 7fe4d1424640 1 --2- 172.21.15.79:0/2909059766 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fe4b80b3bd0 0x7fe4b80b6090 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:39.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:39.122+0000 7fe4d1424640 1 --2- 172.21.15.79:0/2909059766 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4cc1042c0 0x7fe4cc1993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:39.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:39.122+0000 7fe4d1424640 1 --2- 172.21.15.79:0/2909059766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4cc1039a0 0x7fe4cc198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:39.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:39.122+0000 7fe4d1424640 1 -- 172.21.15.79:0/2909059766 >> 172.21.15.79:0/2909059766 conn(0x7fe4cc0fd400 msgr2=0x7fe4cc0fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:39.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:39.122+0000 7fe4d1424640 1 -- 172.21.15.79:0/2909059766 shutdown_connections 2024-08-20T01:53:39.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:39.122+0000 7fe4d1424640 1 -- 172.21.15.79:0/2909059766 wait complete. 2024-08-20T01:53:39.911 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-20T01:53:40.163 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:53:40.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:40 smithi079 ceph-mon[18656]: pgmap v837: 97 pgs: 97 active+clean; 6.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 4.7 KiB/s wr, 21 op/s 2024-08-20T01:53:40.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:40 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2909059766' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:53:40.291 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.286+0000 7f970fc67640 1 -- 172.21.15.79:0/325210239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9708101560 msgr2=0x7f9708101960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:40.291 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.286+0000 7f970fc67640 1 --2- 172.21.15.79:0/325210239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9708101560 0x7f9708101960 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f9704009930 tx=0x7f970402a420 comp rx=0 tx=0).stop 2024-08-20T01:53:40.292 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.286+0000 7f970fc67640 1 -- 172.21.15.79:0/325210239 shutdown_connections 2024-08-20T01:53:40.292 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.286+0000 7f970fc67640 1 --2- 172.21.15.79:0/325210239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9708103070 0x7f97081099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.292 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.286+0000 7f970fc67640 1 --2- 172.21.15.79:0/325210239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97081026b0 0x7f9708102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.292 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.286+0000 7f970fc67640 1 --2- 172.21.15.79:0/325210239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9708101560 0x7f9708101960 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.292 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.286+0000 7f970fc67640 1 -- 172.21.15.79:0/325210239 >> 172.21.15.79:0/325210239 conn(0x7f97080fce40 msgr2=0x7f97080ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:40.292 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.286+0000 7f970fc67640 1 -- 172.21.15.79:0/325210239 shutdown_connections 2024-08-20T01:53:40.292 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.286+0000 7f970fc67640 1 -- 172.21.15.79:0/325210239 wait complete. 2024-08-20T01:53:40.292 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.287+0000 7f970fc67640 1 Processor -- start 2024-08-20T01:53:40.292 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.287+0000 7f970fc67640 1 -- start start 2024-08-20T01:53:40.292 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.287+0000 7f970fc67640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9708101560 0x7f97081978f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:40.293 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.287+0000 7f970fc67640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97081026b0 0x7f9708197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:40.293 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.287+0000 7f970fc67640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9708103070 0x7f9708198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:40.293 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.287+0000 7f970fc67640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f970810d0b0 con 0x7f9708103070 2024-08-20T01:53:40.293 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.287+0000 7f970fc67640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f970810cf30 con 0x7f9708101560 2024-08-20T01:53:40.293 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.287+0000 7f970fc67640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f970810d230 con 0x7f97081026b0 2024-08-20T01:53:40.293 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.287+0000 7f970e204640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9708103070 0x7f9708198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:40.293 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.287+0000 7f970e204640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9708103070 0x7f9708198b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35628/0 (socket says 172.21.15.79:35628) 2024-08-20T01:53:40.293 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.287+0000 7f970e204640 1 -- 172.21.15.79:0/4052488114 learned_addr learned my addr 172.21.15.79:0/4052488114 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:40.293 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.287+0000 7f970da03640 1 --2- 172.21.15.79:0/4052488114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9708101560 0x7f97081978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:40.293 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.287+0000 7f970d202640 1 --2- 172.21.15.79:0/4052488114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97081026b0 0x7f9708197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:40.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.287+0000 7f970e204640 1 -- 172.21.15.79:0/4052488114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97081026b0 msgr2=0x7f9708197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:40.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.287+0000 7f970e204640 1 --2- 172.21.15.79:0/4052488114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97081026b0 0x7f9708197f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.287+0000 7f970e204640 1 -- 172.21.15.79:0/4052488114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9708101560 msgr2=0x7f97081978f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:40.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.287+0000 7f970e204640 1 --2- 172.21.15.79:0/4052488114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9708101560 0x7f97081978f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.287+0000 7f970e204640 1 -- 172.21.15.79:0/4052488114 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9708199430 con 0x7f9708103070 2024-08-20T01:53:40.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.287+0000 7f970da03640 1 --2- 172.21.15.79:0/4052488114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9708101560 0x7f97081978f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:53:40.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.288+0000 7f970e204640 1 --2- 172.21.15.79:0/4052488114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9708103070 0x7f9708198b70 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f970000efd0 tx=0x7f970000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:40.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.288+0000 7f96feffd640 1 -- 172.21.15.79:0/4052488114 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9700003b70 con 0x7f9708103070 2024-08-20T01:53:40.294 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.288+0000 7f96feffd640 1 -- 172.21.15.79:0/4052488114 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9700003d10 con 0x7f9708103070 2024-08-20T01:53:40.295 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.288+0000 7f970fc67640 1 -- 172.21.15.79:0/4052488114 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9708199720 con 0x7f9708103070 2024-08-20T01:53:40.295 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.288+0000 7f96feffd640 1 -- 172.21.15.79:0/4052488114 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9700010850 con 0x7f9708103070 2024-08-20T01:53:40.295 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.288+0000 7f970fc67640 1 -- 172.21.15.79:0/4052488114 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f970819fdf0 con 0x7f9708103070 2024-08-20T01:53:40.301 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.290+0000 7f9712a60740 1 Processor -- start 2024-08-20T01:53:40.301 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.290+0000 7f96feffd640 1 -- 172.21.15.79:0/4052488114 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f9700004020 con 0x7f9708103070 2024-08-20T01:53:40.301 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.291+0000 7f9712a60740 1 -- start start 2024-08-20T01:53:40.301 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.291+0000 7f9712a60740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a411e30ae0 0x55a411e32ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:40.301 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.291+0000 7f9712a60740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a411e33410 0x55a411e35800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:40.302 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.291+0000 7f9712a60740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a411e35e50 0x55a411e38310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:40.302 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.291+0000 7f9712a60740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a411da1360 con 0x55a411e35e50 2024-08-20T01:53:40.302 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.291+0000 7f9712a60740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a411d90860 con 0x55a411e33410 2024-08-20T01:53:40.302 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.291+0000 7f9712a60740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a411d948a0 con 0x55a411e30ae0 2024-08-20T01:53:40.302 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.291+0000 7f970da03640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a411e33410 0x55a411e35800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:40.302 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.291+0000 7f970da03640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a411e33410 0x55a411e35800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:46016/0 (socket says 172.21.15.79:46016) 2024-08-20T01:53:40.302 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.291+0000 7f970da03640 1 -- 172.21.15.79:0/3155196934 learned_addr learned my addr 172.21.15.79:0/3155196934 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:40.302 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.291+0000 7f970d202640 1 --2- 172.21.15.79:0/3155196934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a411e35e50 0x55a411e38310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:40.302 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.291+0000 7f970d202640 1 --2- 172.21.15.79:0/3155196934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a411e30ae0 0x55a411e32ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:40.302 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.291+0000 7f970da03640 1 -- 172.21.15.79:0/3155196934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a411e30ae0 msgr2=0x55a411e32ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:40.302 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.291+0000 7f970da03640 1 --2- 172.21.15.79:0/3155196934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a411e30ae0 0x55a411e32ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.302 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.291+0000 7f970da03640 1 -- 172.21.15.79:0/3155196934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a411e35e50 msgr2=0x55a411e38310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:40.303 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.291+0000 7f970da03640 1 --2- 172.21.15.79:0/3155196934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a411e35e50 0x55a411e38310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.303 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.291+0000 7f970da03640 1 -- 172.21.15.79:0/3155196934 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a411d37e40 con 0x55a411e33410 2024-08-20T01:53:40.303 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.291+0000 7f96feffd640 1 --2- 172.21.15.79:0/4052488114 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f96f40b3bd0 0x7f96f40b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:40.303 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.291+0000 7f970da03640 1 --2- 172.21.15.79:0/3155196934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a411e33410 0x55a411e35800 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9704006010 tx=0x7f9704004150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a30e1413565a3aef server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:40.303 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.291+0000 7f970d202640 1 --2- 172.21.15.79:0/4052488114 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f96f40b3bd0 0x7f96f40b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:40.303 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.292+0000 7f96f3fff640 1 -- 172.21.15.79:0/3155196934 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9704040070 con 0x55a411e33410 2024-08-20T01:53:40.303 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.292+0000 7f96feffd640 1 -- 172.21.15.79:0/4052488114 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f97000e4140 con 0x7f9708103070 2024-08-20T01:53:40.303 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.292+0000 7f96f3fff640 1 -- 172.21.15.79:0/3155196934 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9704003a80 con 0x55a411e33410 2024-08-20T01:53:40.303 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.292+0000 7f96f3fff640 1 -- 172.21.15.79:0/3155196934 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9704035030 con 0x55a411e33410 2024-08-20T01:53:40.303 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.292+0000 7f9712a60740 1 -- 172.21.15.79:0/3155196934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a411e33410 msgr2=0x55a411e35800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:40.303 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.292+0000 7f970d202640 1 --2- 172.21.15.79:0/4052488114 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f96f40b3bd0 0x7f96f40b6090 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f96f8009dc0 tx=0x7f96f8009720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:40.303 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.292+0000 7f9712a60740 1 --2- 172.21.15.79:0/3155196934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a411e33410 0x55a411e35800 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9704006010 tx=0x7f9704004150 comp rx=0 tx=0).stop 2024-08-20T01:53:40.303 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.292+0000 7f9712a60740 1 -- 172.21.15.79:0/3155196934 shutdown_connections 2024-08-20T01:53:40.303 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.292+0000 7f9712a60740 1 --2- 172.21.15.79:0/3155196934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a411e35e50 0x55a411e38310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.292+0000 7f9712a60740 1 --2- 172.21.15.79:0/3155196934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a411e33410 0x55a411e35800 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.292+0000 7f9712a60740 1 --2- 172.21.15.79:0/3155196934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a411e30ae0 0x55a411e32ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.292+0000 7f9712a60740 1 -- 172.21.15.79:0/3155196934 >> 172.21.15.79:0/3155196934 conn(0x55a411e29a20 msgr2=0x55a411e2a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:40.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.292+0000 7f9712a60740 1 -- 172.21.15.79:0/3155196934 shutdown_connections 2024-08-20T01:53:40.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.293+0000 7f9712a60740 1 -- 172.21.15.79:0/3155196934 wait complete. 2024-08-20T01:53:40.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.293+0000 7f9712a60740 1 -- start start 2024-08-20T01:53:40.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.293+0000 7f9712a60740 1 Processor -- start 2024-08-20T01:53:40.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.293+0000 7f9712a60740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a411e30ae0 0x55a411e3a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:40.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.293+0000 7f9712a60740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a411e33410 0x55a411e3a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:40.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.293+0000 7f9712a60740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a411e35e50 0x55a411e3b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:40.304 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.293+0000 7f9712a60740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a411cc9ab0 con 0x55a411e33410 2024-08-20T01:53:40.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.293+0000 7f9712a60740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a411d17780 con 0x55a411e30ae0 2024-08-20T01:53:40.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.293+0000 7f9712a60740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a411e38dd0 con 0x55a411e35e50 2024-08-20T01:53:40.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.293+0000 7f9712a60740 10 client.0 _ll_register_callbacks cb 0x55a411a9fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:53:40.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.293+0000 7f970d202640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a411e33410 0x55a411e3a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:40.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.293+0000 7f970d202640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a411e33410 0x55a411e3a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35652/0 (socket says 172.21.15.79:35652) 2024-08-20T01:53:40.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.293+0000 7f970d202640 1 -- 172.21.15.79:0/1892855873 learned_addr learned my addr 172.21.15.79:0/1892855873 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:40.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.293+0000 7f970da03640 1 --2- 172.21.15.79:0/1892855873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a411e30ae0 0x55a411e3a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:40.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.294+0000 7f970e204640 1 --2- 172.21.15.79:0/1892855873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a411e35e50 0x55a411e3b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:40.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.294+0000 7f970d202640 1 -- 172.21.15.79:0/1892855873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a411e35e50 msgr2=0x55a411e3b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:40.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.294+0000 7f970d202640 1 --2- 172.21.15.79:0/1892855873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a411e35e50 0x55a411e3b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.294+0000 7f970d202640 1 -- 172.21.15.79:0/1892855873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a411e30ae0 msgr2=0x55a411e3a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:40.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.294+0000 7f970d202640 1 --2- 172.21.15.79:0/1892855873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a411e30ae0 0x55a411e3a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.294+0000 7f970d202640 1 -- 172.21.15.79:0/1892855873 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a411af3790 con 0x55a411e33410 2024-08-20T01:53:40.305 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.294+0000 7f970da03640 1 --2- 172.21.15.79:0/1892855873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a411e30ae0 0x55a411e3a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:53:40.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.294+0000 7f970d202640 1 --2- 172.21.15.79:0/1892855873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a411e33410 0x55a411e3a8b0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f96f801e9f0 tx=0x7f96f8005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9df2f2cd7a7bc576 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:40.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.294+0000 7f96f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:53:40.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.294+0000 7f96f17fa640 1 -- 172.21.15.79:0/1892855873 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f8004020 con 0x55a411e33410 2024-08-20T01:53:40.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.294+0000 7f96f17fa640 1 -- 172.21.15.79:0/1892855873 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f96f80041c0 con 0x55a411e33410 2024-08-20T01:53:40.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.294+0000 7f9712a60740 1 -- 172.21.15.79:0/1892855873 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a411d3fe00 con 0x55a411e33410 2024-08-20T01:53:40.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.294+0000 7f96f17fa640 1 -- 172.21.15.79:0/1892855873 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f96f80043c0 con 0x55a411e33410 2024-08-20T01:53:40.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.294+0000 7f9712a60740 10 client.19500 fetch_fsmap learned FSMap version 69 2024-08-20T01:53:40.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.294+0000 7f9712a60740 1 -- 172.21.15.79:0/1892855873 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) -- 0x55a411b6c620 con 0x55a411e33410 2024-08-20T01:53:40.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.294+0000 7f96f17fa640 1 -- 172.21.15.79:0/1892855873 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55a411d3fe00 con 0x55a411e33410 2024-08-20T01:53:40.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.294+0000 7f96f17fa640 1 -- 172.21.15.79:0/1892855873 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 69) ==== 8366+0+0 (secure 0 0 0) 0x7f96f8003af0 con 0x55a411e33410 2024-08-20T01:53:40.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.295+0000 7f9712a60740 10 client.19500 fetch_fsmap finished waiting for FSMap version 69 2024-08-20T01:53:40.306 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.295+0000 7f9712a60740 10 client.19500 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:53:40.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.295+0000 7f9712a60740 20 client.19500 populate_metadata read hostname 'smithi079' 2024-08-20T01:53:40.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.295+0000 7f9712a60740 1 --2- 172.21.15.79:0/1892855873 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55a411e45c10 0x55a411e48060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:40.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.295+0000 7f9712a60740 4 client.19500 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:53:40.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.295+0000 7f9712a60740 1 -- 172.21.15.79:0/1892855873 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a411da32b0 con 0x55a411e45c10 2024-08-20T01:53:40.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.295+0000 7f970da03640 1 --2- 172.21.15.79:0/1892855873 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55a411e45c10 0x55a411e48060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:40.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.295+0000 7f970da03640 1 --2- 172.21.15.79:0/1892855873 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55a411e45c10 0x55a411e48060 crc :-1 s=READY pgs=332 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c05917b2b0e486e3 server_cookie=e68a0588c4be3191 in_seq=0 out_seq=0 2024-08-20T01:53:40.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.295+0000 7f96f17fa640 10 client.19500 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:53:40.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.296+0000 7f96f17fa640 1 -- 172.21.15.79:0/1892855873 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a411da32b0 con 0x55a411e45c10 2024-08-20T01:53:40.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.296+0000 7f96f17fa640 10 client.19500 handle_command_reply: tid=0 2024-08-20T01:53:40.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.296+0000 7f9712a60740 1 client.19500 shutdown 2024-08-20T01:53:40.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.296+0000 7f9712a60740 1 -- 172.21.15.79:0/1892855873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a411e33410 msgr2=0x55a411e3a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:40.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.296+0000 7f9712a60740 1 --2- 172.21.15.79:0/1892855873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a411e33410 0x55a411e3a8b0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f96f801e9f0 tx=0x7f96f8005f90 comp rx=0 tx=0).stop 2024-08-20T01:53:40.307 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.296+0000 7f9712a60740 1 -- 172.21.15.79:0/1892855873 shutdown_connections 2024-08-20T01:53:40.308 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.296+0000 7f9712a60740 1 --2- 172.21.15.79:0/1892855873 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55a411e45c10 0x55a411e48060 crc :-1 s=READY pgs=332 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.308 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.296+0000 7f9712a60740 1 --2- 172.21.15.79:0/1892855873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a411e35e50 0x55a411e3b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.308 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.296+0000 7f96f17fa640 0 client.19500 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:53:40.308 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.296+0000 7f9712a60740 1 --2- 172.21.15.79:0/1892855873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a411e33410 0x55a411e3a8b0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.308 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.296+0000 7f9712a60740 1 --2- 172.21.15.79:0/1892855873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a411e30ae0 0x55a411e3a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.308 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.296+0000 7f9712a60740 1 -- 172.21.15.79:0/1892855873 >> 172.21.15.79:0/1892855873 conn(0x55a411e29a20 msgr2=0x55a411e28ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:40.308 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.296+0000 7f9712a60740 1 -- 172.21.15.79:0/1892855873 shutdown_connections 2024-08-20T01:53:40.308 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.296+0000 7f9712a60740 1 -- 172.21.15.79:0/1892855873 wait complete. 2024-08-20T01:53:40.308 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.296+0000 7f9712a60740 20 client.19500 trim_cache size 0 max 16384 2024-08-20T01:53:40.318 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.311+0000 7f9712a60740 1 Processor -- start 2024-08-20T01:53:40.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.311+0000 7f9712a60740 1 -- start start 2024-08-20T01:53:40.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.311+0000 7f9712a60740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a411e30ae0 0x55a411e37720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:40.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.311+0000 7f9712a60740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a411e33410 0x55a411e37c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:40.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.311+0000 7f9712a60740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a411e35e50 0x55a411e36230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:40.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.311+0000 7f9712a60740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f97081a7870 con 0x55a411e35e50 2024-08-20T01:53:40.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.311+0000 7f9712a60740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f97081a93b0 con 0x55a411e33410 2024-08-20T01:53:40.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.311+0000 7f9712a60740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f97081a7f40 con 0x55a411e30ae0 2024-08-20T01:53:40.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.311+0000 7f970e204640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a411e35e50 0x55a411e36230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:40.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.311+0000 7f970e204640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a411e35e50 0x55a411e36230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35658/0 (socket says 172.21.15.79:35658) 2024-08-20T01:53:40.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.311+0000 7f970e204640 1 -- 172.21.15.79:0/1068778219 learned_addr learned my addr 172.21.15.79:0/1068778219 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:40.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.311+0000 7f970d202640 1 --2- 172.21.15.79:0/1068778219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a411e33410 0x55a411e37c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:40.319 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.311+0000 7f970da03640 1 --2- 172.21.15.79:0/1068778219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a411e30ae0 0x55a411e37720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:40.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.311+0000 7f970e204640 1 -- 172.21.15.79:0/1068778219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a411e30ae0 msgr2=0x55a411e37720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:40.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.311+0000 7f970e204640 1 --2- 172.21.15.79:0/1068778219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a411e30ae0 0x55a411e37720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.311+0000 7f970e204640 1 -- 172.21.15.79:0/1068778219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a411e33410 msgr2=0x55a411e37c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:40.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.311+0000 7f970e204640 1 --2- 172.21.15.79:0/1068778219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a411e33410 0x55a411e37c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.311+0000 7f970e204640 1 -- 172.21.15.79:0/1068778219 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a411e35b70 con 0x55a411e35e50 2024-08-20T01:53:40.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.311+0000 7f970e204640 1 --2- 172.21.15.79:0/1068778219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a411e35e50 0x55a411e36230 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f97000e1ca0 tx=0x7f97000aac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc16a3601428bb95 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:40.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.312+0000 7f96f37fe640 1 -- 172.21.15.79:0/1068778219 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97000c4070 con 0x55a411e35e50 2024-08-20T01:53:40.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.312+0000 7f96f37fe640 1 -- 172.21.15.79:0/1068778219 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f97000af6a0 con 0x55a411e35e50 2024-08-20T01:53:40.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.312+0000 7f96f37fe640 1 -- 172.21.15.79:0/1068778219 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97000a6c70 con 0x55a411e35e50 2024-08-20T01:53:40.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.312+0000 7f9712a60740 1 -- 172.21.15.79:0/1068778219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a411e35e50 msgr2=0x55a411e36230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:40.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.312+0000 7f9712a60740 1 --2- 172.21.15.79:0/1068778219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a411e35e50 0x55a411e36230 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f97000e1ca0 tx=0x7f97000aac70 comp rx=0 tx=0).stop 2024-08-20T01:53:40.320 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.312+0000 7f9712a60740 1 -- 172.21.15.79:0/1068778219 shutdown_connections 2024-08-20T01:53:40.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.313+0000 7f9712a60740 1 --2- 172.21.15.79:0/1068778219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a411e35e50 0x55a411e36230 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.313+0000 7f9712a60740 1 --2- 172.21.15.79:0/1068778219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a411e33410 0x55a411e37c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.313+0000 7f9712a60740 1 --2- 172.21.15.79:0/1068778219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a411e30ae0 0x55a411e37720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.313+0000 7f9712a60740 1 -- 172.21.15.79:0/1068778219 >> 172.21.15.79:0/1068778219 conn(0x55a411e29a20 msgr2=0x55a411e391d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:40.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.313+0000 7f9712a60740 1 -- 172.21.15.79:0/1068778219 shutdown_connections 2024-08-20T01:53:40.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.313+0000 7f9712a60740 1 -- 172.21.15.79:0/1068778219 wait complete. 2024-08-20T01:53:40.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.313+0000 7f9712a60740 1 -- start start 2024-08-20T01:53:40.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.313+0000 7f9712a60740 1 Processor -- start 2024-08-20T01:53:40.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.314+0000 7f9712a60740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a411e30ae0 0x55a411e3efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:40.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.314+0000 7f9712a60740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a411e33410 0x55a411e3f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:40.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.314+0000 7f9712a60740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a411e35e50 0x55a411e401d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:40.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.314+0000 7f9712a60740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f97081a8ce0 con 0x55a411e33410 2024-08-20T01:53:40.321 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.314+0000 7f9712a60740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f97081a8610 con 0x55a411e35e50 2024-08-20T01:53:40.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.314+0000 7f9712a60740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f97081a5850 con 0x55a411e30ae0 2024-08-20T01:53:40.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.314+0000 7f9712a60740 10 client.0 _ll_register_callbacks cb 0x7f96f801e880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:53:40.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.314+0000 7f970d202640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a411e33410 0x55a411e3f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:40.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.314+0000 7f970d202640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a411e33410 0x55a411e3f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35666/0 (socket says 172.21.15.79:35666) 2024-08-20T01:53:40.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.314+0000 7f970d202640 1 -- 172.21.15.79:0/2696622747 learned_addr learned my addr 172.21.15.79:0/2696622747 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:40.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.314+0000 7f970da03640 1 --2- 172.21.15.79:0/2696622747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a411e30ae0 0x55a411e3efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:40.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.314+0000 7f970e204640 1 --2- 172.21.15.79:0/2696622747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a411e35e50 0x55a411e401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:40.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.314+0000 7f970d202640 1 -- 172.21.15.79:0/2696622747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a411e30ae0 msgr2=0x55a411e3efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:40.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.314+0000 7f970d202640 1 --2- 172.21.15.79:0/2696622747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a411e30ae0 0x55a411e3efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.314+0000 7f970d202640 1 -- 172.21.15.79:0/2696622747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a411e35e50 msgr2=0x55a411e401d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:40.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.314+0000 7f970d202640 1 --2- 172.21.15.79:0/2696622747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a411e35e50 0x55a411e401d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.322 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.314+0000 7f970d202640 1 -- 172.21.15.79:0/2696622747 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a411e40a00 con 0x55a411e33410 2024-08-20T01:53:40.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.314+0000 7f970d202640 1 --2- 172.21.15.79:0/2696622747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a411e33410 0x55a411e3f670 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f96f80099a0 tx=0x7f96f8012e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f80f47ba8622fbfe server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:40.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.314+0000 7f96f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:53:40.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.314+0000 7f96f17fa640 1 -- 172.21.15.79:0/2696622747 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f8037070 con 0x55a411e33410 2024-08-20T01:53:40.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.314+0000 7f96f17fa640 1 -- 172.21.15.79:0/2696622747 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f96f8028af0 con 0x55a411e33410 2024-08-20T01:53:40.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.314+0000 7f9712a60740 1 -- 172.21.15.79:0/2696622747 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97000af6a0 con 0x55a411e33410 2024-08-20T01:53:40.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.315+0000 7f96f17fa640 1 -- 172.21.15.79:0/2696622747 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f96f80041f0 con 0x55a411e33410 2024-08-20T01:53:40.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.315+0000 7f9712a60740 10 client.19506 fetch_fsmap learned FSMap version 69 2024-08-20T01:53:40.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.315+0000 7f9712a60740 1 -- 172.21.15.79:0/2696622747 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) -- 0x55a411e41d70 con 0x55a411e33410 2024-08-20T01:53:40.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.315+0000 7f96f17fa640 1 -- 172.21.15.79:0/2696622747 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f97000af6a0 con 0x55a411e33410 2024-08-20T01:53:40.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.315+0000 7f96f17fa640 1 -- 172.21.15.79:0/2696622747 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 69) ==== 8366+0+0 (secure 0 0 0) 0x7f96f8003780 con 0x55a411e33410 2024-08-20T01:53:40.323 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.315+0000 7f9712a60740 10 client.19506 fetch_fsmap finished waiting for FSMap version 69 2024-08-20T01:53:40.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.315+0000 7f9712a60740 10 client.19506 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:53:40.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.315+0000 7f9712a60740 20 client.19506 populate_metadata read hostname 'smithi079' 2024-08-20T01:53:40.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.315+0000 7f9712a60740 1 --2- 172.21.15.79:0/2696622747 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55a411eb0b50 0x55a411eb2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:40.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.315+0000 7f9712a60740 4 client.19506 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:53:40.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.315+0000 7f9712a60740 1 -- 172.21.15.79:0/2696622747 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a411d9ed50 con 0x55a411eb0b50 2024-08-20T01:53:40.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.315+0000 7f970da03640 1 --2- 172.21.15.79:0/2696622747 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55a411eb0b50 0x55a411eb2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:40.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.316+0000 7f96f17fa640 10 client.19506 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:53:40.324 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:40.316+0000 7f970da03640 1 --2- 172.21.15.79:0/2696622747 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55a411eb0b50 0x55a411eb2f70 crc :-1 s=READY pgs=333 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e37947c4d0d5432 server_cookie=cd6e7227665a9921 in_seq=0 out_seq=0 2024-08-20T01:53:40.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:40 smithi175 ceph-mon[22392]: pgmap v837: 97 pgs: 97 active+clean; 6.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 4.7 KiB/s wr, 21 op/s 2024-08-20T01:53:40.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:40 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2909059766' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:53:40.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:40 smithi081 ceph-mon[22209]: pgmap v837: 97 pgs: 97 active+clean; 6.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 4.7 KiB/s wr, 21 op/s 2024-08-20T01:53:40.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:40 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2909059766' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:53:40.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.653+0000 7f3f4e48c640 1 -- 172.21.15.79:0/3811187926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f481019b0 msgr2=0x7f3f48101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:40.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.653+0000 7f3f4e48c640 1 --2- 172.21.15.79:0/3811187926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f481019b0 0x7f3f48101d90 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f3f38009900 tx=0x7f3f3802a410 comp rx=0 tx=0).stop 2024-08-20T01:53:40.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.653+0000 7f3f4e48c640 1 -- 172.21.15.79:0/3811187926 shutdown_connections 2024-08-20T01:53:40.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.653+0000 7f3f4e48c640 1 --2- 172.21.15.79:0/3811187926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f48107d40 0x7f3f4810e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.653+0000 7f3f4e48c640 1 --2- 172.21.15.79:0/3811187926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f481073c0 0x7f3f48107800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.653+0000 7f3f4e48c640 1 --2- 172.21.15.79:0/3811187926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f481019b0 0x7f3f48101d90 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.653+0000 7f3f4e48c640 1 -- 172.21.15.79:0/3811187926 >> 172.21.15.79:0/3811187926 conn(0x7f3f480fd420 msgr2=0x7f3f480ff840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:40.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.653+0000 7f3f4e48c640 1 -- 172.21.15.79:0/3811187926 shutdown_connections 2024-08-20T01:53:40.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.653+0000 7f3f4e48c640 1 -- 172.21.15.79:0/3811187926 wait complete. 2024-08-20T01:53:40.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.654+0000 7f3f4e48c640 1 Processor -- start 2024-08-20T01:53:40.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.654+0000 7f3f4e48c640 1 -- start start 2024-08-20T01:53:40.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.654+0000 7f3f4e48c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f481019b0 0x7f3f4810f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:40.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.654+0000 7f3f4e48c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f481073c0 0x7f3f4810f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:40.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.654+0000 7f3f4e48c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f48107d40 0x7f3f4810fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:40.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.654+0000 7f3f4e48c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3f481129d0 con 0x7f3f48107d40 2024-08-20T01:53:40.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.654+0000 7f3f4e48c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3f48112850 con 0x7f3f481073c0 2024-08-20T01:53:40.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.654+0000 7f3f4e48c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3f48112b50 con 0x7f3f481019b0 2024-08-20T01:53:40.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.654+0000 7f3f477fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f481073c0 0x7f3f4810f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:40.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.654+0000 7f3f4ca29640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f48107d40 0x7f3f4810fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:40.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.654+0000 7f3f477fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f481073c0 0x7f3f4810f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:46064/0 (socket says 172.21.15.79:46064) 2024-08-20T01:53:40.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.654+0000 7f3f477fe640 1 -- 172.21.15.79:0/1034685968 learned_addr learned my addr 172.21.15.79:0/1034685968 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:40.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.654+0000 7f3f47fff640 1 --2- 172.21.15.79:0/1034685968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f481019b0 0x7f3f4810f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:40.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.654+0000 7f3f477fe640 1 -- 172.21.15.79:0/1034685968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f481019b0 msgr2=0x7f3f4810f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:40.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.654+0000 7f3f477fe640 1 --2- 172.21.15.79:0/1034685968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f481019b0 0x7f3f4810f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.654+0000 7f3f477fe640 1 -- 172.21.15.79:0/1034685968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f48107d40 msgr2=0x7f3f4810fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:40.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.654+0000 7f3f477fe640 1 --2- 172.21.15.79:0/1034685968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f48107d40 0x7f3f4810fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.655+0000 7f3f477fe640 1 -- 172.21.15.79:0/1034685968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f481a7300 con 0x7f3f481073c0 2024-08-20T01:53:40.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.655+0000 7f3f477fe640 1 --2- 172.21.15.79:0/1034685968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f481073c0 0x7f3f4810f590 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c00d770 tx=0x7f3f3c00dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:40.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.655+0000 7f3f457fa640 1 -- 172.21.15.79:0/1034685968 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c017070 con 0x7f3f481073c0 2024-08-20T01:53:40.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.655+0000 7f3f4e48c640 1 -- 172.21.15.79:0/1034685968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f481a75f0 con 0x7f3f481073c0 2024-08-20T01:53:40.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.655+0000 7f3f457fa640 1 -- 172.21.15.79:0/1034685968 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f3c0054b0 con 0x7f3f481073c0 2024-08-20T01:53:40.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.655+0000 7f3f457fa640 1 -- 172.21.15.79:0/1034685968 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c004c60 con 0x7f3f481073c0 2024-08-20T01:53:40.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.655+0000 7f3f4e48c640 1 -- 172.21.15.79:0/1034685968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f481a7ae0 con 0x7f3f481073c0 2024-08-20T01:53:40.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.658+0000 7f3f50885740 1 Processor -- start 2024-08-20T01:53:40.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.658+0000 7f3f50885740 1 -- start start 2024-08-20T01:53:40.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.658+0000 7f3f457fa640 1 -- 172.21.15.79:0/1034685968 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3f3c004e00 con 0x7f3f481073c0 2024-08-20T01:53:40.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.658+0000 7f3f50885740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56480e1fb880 0x56480e1fbc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:40.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.658+0000 7f3f50885740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56480e1fc1a0 0x56480e207bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:40.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.658+0000 7f3f50885740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56480e208130 0x56480e20a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:40.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.658+0000 7f3f50885740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56480e172930 con 0x56480e208130 2024-08-20T01:53:40.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.658+0000 7f3f50885740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56480e161e30 con 0x56480e1fc1a0 2024-08-20T01:53:40.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.658+0000 7f3f50885740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56480e165e70 con 0x56480e1fb880 2024-08-20T01:53:40.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.658+0000 7f3f477fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56480e208130 0x56480e20a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:40.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.658+0000 7f3f47fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56480e1fc1a0 0x56480e207bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:40.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.658+0000 7f3f4ca29640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56480e1fb880 0x56480e1fbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:40.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.658+0000 7f3f47fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56480e1fc1a0 0x56480e207bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:46068/0 (socket says 172.21.15.79:46068) 2024-08-20T01:53:40.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.658+0000 7f3f47fff640 1 -- 172.21.15.79:0/3111851879 learned_addr learned my addr 172.21.15.79:0/3111851879 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:40.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.659+0000 7f3f477fe640 1 -- 172.21.15.79:0/3111851879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56480e1fb880 msgr2=0x56480e1fbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:40.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.659+0000 7f3f477fe640 1 --2- 172.21.15.79:0/3111851879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56480e1fb880 0x56480e1fbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.659+0000 7f3f477fe640 1 -- 172.21.15.79:0/3111851879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56480e1fc1a0 msgr2=0x56480e207bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:40.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.659+0000 7f3f477fe640 1 --2- 172.21.15.79:0/3111851879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56480e1fc1a0 0x56480e207bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.659+0000 7f3f477fe640 1 -- 172.21.15.79:0/3111851879 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56480dec1650 con 0x56480e208130 2024-08-20T01:53:40.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.659+0000 7f3f47fff640 1 --2- 172.21.15.79:0/3111851879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56480e1fc1a0 0x56480e207bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:53:40.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.659+0000 7f3f477fe640 1 --2- 172.21.15.79:0/3111851879 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56480e208130 0x56480e20a520 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c0e1140 tx=0x7f3f3c0eb690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d0ff2588f9ff831 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:40.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.659+0000 7f3f457fa640 1 --2- 172.21.15.79:0/1034685968 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3f300b3bd0 0x7f3f300b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:40.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.659+0000 7f3f2e7fc640 1 -- 172.21.15.79:0/3111851879 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c0f2070 con 0x56480e208130 2024-08-20T01:53:40.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.659+0000 7f3f4ca29640 1 --2- 172.21.15.79:0/1034685968 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3f300b3bd0 0x7f3f300b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:40.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.659+0000 7f3f2e7fc640 1 -- 172.21.15.79:0/3111851879 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f3c0aa100 con 0x56480e208130 2024-08-20T01:53:40.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.659+0000 7f3f457fa640 1 -- 172.21.15.79:0/1034685968 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f3f3c0e3690 con 0x7f3f481073c0 2024-08-20T01:53:40.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.659+0000 7f3f2e7fc640 1 -- 172.21.15.79:0/3111851879 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c0a9f40 con 0x56480e208130 2024-08-20T01:53:40.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.660+0000 7f3f50885740 1 -- 172.21.15.79:0/3111851879 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56480e208130 msgr2=0x56480e20a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:40.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.660+0000 7f3f4ca29640 1 --2- 172.21.15.79:0/1034685968 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3f300b3bd0 0x7f3f300b6090 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f3f48111110 tx=0x7f3f40009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:40.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.660+0000 7f3f50885740 1 --2- 172.21.15.79:0/3111851879 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56480e208130 0x56480e20a520 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c0e1140 tx=0x7f3f3c0eb690 comp rx=0 tx=0).stop 2024-08-20T01:53:40.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.660+0000 7f3f50885740 1 -- 172.21.15.79:0/3111851879 shutdown_connections 2024-08-20T01:53:40.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.660+0000 7f3f50885740 1 --2- 172.21.15.79:0/3111851879 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56480e208130 0x56480e20a520 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.660+0000 7f3f50885740 1 --2- 172.21.15.79:0/3111851879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56480e1fc1a0 0x56480e207bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.660+0000 7f3f50885740 1 --2- 172.21.15.79:0/3111851879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56480e1fb880 0x56480e1fbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.660+0000 7f3f50885740 1 -- 172.21.15.79:0/3111851879 >> 172.21.15.79:0/3111851879 conn(0x56480e1f96b0 msgr2=0x56480e1fa850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:40.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.660+0000 7f3f50885740 1 -- 172.21.15.79:0/3111851879 shutdown_connections 2024-08-20T01:53:40.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.660+0000 7f3f50885740 1 -- 172.21.15.79:0/3111851879 wait complete. 2024-08-20T01:53:40.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.660+0000 7f3f50885740 1 -- start start 2024-08-20T01:53:40.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.661+0000 7f3f50885740 1 Processor -- start 2024-08-20T01:53:40.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.661+0000 7f3f50885740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56480e1fb880 0x56480e207ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:40.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.661+0000 7f3f50885740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56480e1fc1a0 0x56480e204ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:40.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.661+0000 7f3f50885740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56480e208130 0x56480e205780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:40.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.661+0000 7f3f50885740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56480dfc4700 con 0x56480e1fc1a0 2024-08-20T01:53:40.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.661+0000 7f3f50885740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56480e0e8810 con 0x56480e208130 2024-08-20T01:53:40.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.661+0000 7f3f50885740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56480e20ae30 con 0x56480e1fb880 2024-08-20T01:53:40.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.661+0000 7f3f50885740 10 client.0 _ll_register_callbacks cb 0x56480e15b700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:53:40.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.661+0000 7f3f477fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56480e1fc1a0 0x56480e204ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:40.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.661+0000 7f3f477fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56480e1fc1a0 0x56480e204ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35722/0 (socket says 172.21.15.79:35722) 2024-08-20T01:53:40.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.661+0000 7f3f477fe640 1 -- 172.21.15.79:0/737351426 learned_addr learned my addr 172.21.15.79:0/737351426 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:40.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.661+0000 7f3f4ca29640 1 --2- 172.21.15.79:0/737351426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56480e208130 0x56480e205780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:40.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.661+0000 7f3f47fff640 1 --2- 172.21.15.79:0/737351426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56480e1fb880 0x56480e207ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:40.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.661+0000 7f3f477fe640 1 -- 172.21.15.79:0/737351426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56480e1fb880 msgr2=0x56480e207ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:40.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.661+0000 7f3f477fe640 1 --2- 172.21.15.79:0/737351426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56480e1fb880 0x56480e207ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.661+0000 7f3f477fe640 1 -- 172.21.15.79:0/737351426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56480e208130 msgr2=0x56480e205780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:40.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.661+0000 7f3f477fe640 1 --2- 172.21.15.79:0/737351426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56480e208130 0x56480e205780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.661+0000 7f3f477fe640 1 -- 172.21.15.79:0/737351426 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56480e214160 con 0x56480e1fc1a0 2024-08-20T01:53:40.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.661+0000 7f3f4ca29640 1 --2- 172.21.15.79:0/737351426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56480e208130 0x56480e205780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:53:40.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.661+0000 7f3f477fe640 1 --2- 172.21.15.79:0/737351426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56480e1fc1a0 0x56480e204ff0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c0a7860 tx=0x7f3f3c005bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=874b98574ad0e478 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:40.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.661+0000 7f3f277fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:53:40.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.662+0000 7f3f277fe640 1 -- 172.21.15.79:0/737351426 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c07b2d0 con 0x56480e1fc1a0 2024-08-20T01:53:40.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.662+0000 7f3f277fe640 1 -- 172.21.15.79:0/737351426 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f3f3c009c30 con 0x56480e1fc1a0 2024-08-20T01:53:40.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.662+0000 7f3f50885740 1 -- 172.21.15.79:0/737351426 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56480e111150 con 0x56480e1fc1a0 2024-08-20T01:53:40.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.662+0000 7f3f277fe640 1 -- 172.21.15.79:0/737351426 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f3f3c020020 con 0x56480e1fc1a0 2024-08-20T01:53:40.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.662+0000 7f3f50885740 10 client.19518 fetch_fsmap learned FSMap version 69 2024-08-20T01:53:40.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.662+0000 7f3f50885740 1 -- 172.21.15.79:0/737351426 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) -- 0x56480e216ac0 con 0x56480e1fc1a0 2024-08-20T01:53:40.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.662+0000 7f3f277fe640 1 -- 172.21.15.79:0/737351426 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56480e111150 con 0x56480e1fc1a0 2024-08-20T01:53:40.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.662+0000 7f3f277fe640 1 -- 172.21.15.79:0/737351426 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 69) ==== 8366+0+0 (secure 0 0 0) 0x7f3f3c0a6880 con 0x56480e1fc1a0 2024-08-20T01:53:40.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.662+0000 7f3f50885740 10 client.19518 fetch_fsmap finished waiting for FSMap version 69 2024-08-20T01:53:40.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.662+0000 7f3f50885740 10 client.19518 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:53:40.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.662+0000 7f3f50885740 20 client.19518 populate_metadata read hostname 'smithi079' 2024-08-20T01:53:40.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.662+0000 7f3f50885740 1 --2- 172.21.15.79:0/737351426 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x56480e217e10 0x56480e21a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:40.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.662+0000 7f3f50885740 4 client.19518 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:53:40.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.662+0000 7f3f50885740 1 -- 172.21.15.79:0/737351426 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56480e174880 con 0x56480e217e10 2024-08-20T01:53:40.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.662+0000 7f3f47fff640 1 --2- 172.21.15.79:0/737351426 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x56480e217e10 0x56480e21a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:40.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.663+0000 7f3f47fff640 1 --2- 172.21.15.79:0/737351426 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x56480e217e10 0x56480e21a200 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ddb40f3eb9dd191d server_cookie=e304e4c8208034d0 in_seq=0 out_seq=0 2024-08-20T01:53:40.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.663+0000 7f3f277fe640 10 client.19518 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:53:40.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.663+0000 7f3f277fe640 1 -- 172.21.15.79:0/737351426 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56480e174880 con 0x56480e217e10 2024-08-20T01:53:40.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.663+0000 7f3f277fe640 10 client.19518 handle_command_reply: tid=0 2024-08-20T01:53:40.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.663+0000 7f3f50885740 1 client.19518 shutdown 2024-08-20T01:53:40.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.664+0000 7f3f50885740 1 -- 172.21.15.79:0/737351426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56480e1fc1a0 msgr2=0x56480e204ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:40.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.664+0000 7f3f50885740 1 --2- 172.21.15.79:0/737351426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56480e1fc1a0 0x56480e204ff0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c0a7860 tx=0x7f3f3c005bb0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.664+0000 7f3f50885740 1 -- 172.21.15.79:0/737351426 shutdown_connections 2024-08-20T01:53:40.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.664+0000 7f3f50885740 1 --2- 172.21.15.79:0/737351426 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x56480e217e10 0x56480e21a200 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.664+0000 7f3f50885740 1 --2- 172.21.15.79:0/737351426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56480e208130 0x56480e205780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.664+0000 7f3f277fe640 0 client.19518 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:53:40.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.664+0000 7f3f50885740 1 --2- 172.21.15.79:0/737351426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56480e1fc1a0 0x56480e204ff0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.664+0000 7f3f50885740 1 --2- 172.21.15.79:0/737351426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56480e1fb880 0x56480e207ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.664+0000 7f3f50885740 1 -- 172.21.15.79:0/737351426 >> 172.21.15.79:0/737351426 conn(0x56480e1f96b0 msgr2=0x56480e1ff250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:40.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.664+0000 7f3f50885740 1 -- 172.21.15.79:0/737351426 shutdown_connections 2024-08-20T01:53:40.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.664+0000 7f3f50885740 1 -- 172.21.15.79:0/737351426 wait complete. 2024-08-20T01:53:40.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.664+0000 7f3f50885740 20 client.19518 trim_cache size 0 max 16384 2024-08-20T01:53:40.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.676+0000 7f3f50885740 1 Processor -- start 2024-08-20T01:53:40.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.677+0000 7f3f50885740 1 -- start start 2024-08-20T01:53:40.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.677+0000 7f3f50885740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56480e1fb880 0x56480e1ffa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:40.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.677+0000 7f3f50885740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56480e1fc1a0 0x56480e204880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:40.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.677+0000 7f3f50885740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56480e208130 0x56480e21f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:40.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.677+0000 7f3f50885740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3f481b0170 con 0x56480e1fc1a0 2024-08-20T01:53:40.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.677+0000 7f3f50885740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3f481b1cb0 con 0x56480e208130 2024-08-20T01:53:40.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.677+0000 7f3f50885740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3f481b0840 con 0x56480e1fb880 2024-08-20T01:53:40.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.677+0000 7f3f477fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56480e1fc1a0 0x56480e204880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:40.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.677+0000 7f3f477fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56480e1fc1a0 0x56480e204880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35726/0 (socket says 172.21.15.79:35726) 2024-08-20T01:53:40.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.677+0000 7f3f477fe640 1 -- 172.21.15.79:0/4275270602 learned_addr learned my addr 172.21.15.79:0/4275270602 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:40.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.677+0000 7f3f4ca29640 1 --2- 172.21.15.79:0/4275270602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56480e208130 0x56480e21f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:40.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.677+0000 7f3f47fff640 1 --2- 172.21.15.79:0/4275270602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56480e1fb880 0x56480e1ffa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:40.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.677+0000 7f3f477fe640 1 -- 172.21.15.79:0/4275270602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56480e1fb880 msgr2=0x56480e1ffa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:40.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.677+0000 7f3f477fe640 1 --2- 172.21.15.79:0/4275270602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56480e1fb880 0x56480e1ffa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.677+0000 7f3f477fe640 1 -- 172.21.15.79:0/4275270602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56480e208130 msgr2=0x56480e21f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:40.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.677+0000 7f3f477fe640 1 --2- 172.21.15.79:0/4275270602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56480e208130 0x56480e21f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.677+0000 7f3f477fe640 1 -- 172.21.15.79:0/4275270602 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56480e205af0 con 0x56480e1fc1a0 2024-08-20T01:53:40.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.677+0000 7f3f477fe640 1 --2- 172.21.15.79:0/4275270602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56480e1fc1a0 0x56480e204880 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c0e1510 tx=0x7f3f3c0eb690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca0de23e02cc7fab server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:40.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.677+0000 7f3f2dffb640 1 -- 172.21.15.79:0/4275270602 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c0f2050 con 0x56480e1fc1a0 2024-08-20T01:53:40.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.677+0000 7f3f2dffb640 1 -- 172.21.15.79:0/4275270602 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f3c0aacf0 con 0x56480e1fc1a0 2024-08-20T01:53:40.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.677+0000 7f3f2dffb640 1 -- 172.21.15.79:0/4275270602 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c07b850 con 0x56480e1fc1a0 2024-08-20T01:53:40.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.678+0000 7f3f50885740 1 -- 172.21.15.79:0/4275270602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56480e1fc1a0 msgr2=0x56480e204880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:40.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.678+0000 7f3f50885740 1 --2- 172.21.15.79:0/4275270602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56480e1fc1a0 0x56480e204880 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c0e1510 tx=0x7f3f3c0eb690 comp rx=0 tx=0).stop 2024-08-20T01:53:40.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.678+0000 7f3f50885740 1 -- 172.21.15.79:0/4275270602 shutdown_connections 2024-08-20T01:53:40.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.678+0000 7f3f50885740 1 --2- 172.21.15.79:0/4275270602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56480e208130 0x56480e21f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.678+0000 7f3f50885740 1 --2- 172.21.15.79:0/4275270602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56480e1fc1a0 0x56480e204880 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.678+0000 7f3f50885740 1 --2- 172.21.15.79:0/4275270602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56480e1fb880 0x56480e1ffa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.678+0000 7f3f50885740 1 -- 172.21.15.79:0/4275270602 >> 172.21.15.79:0/4275270602 conn(0x56480e1f96b0 msgr2=0x56480e206e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:40.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.678+0000 7f3f50885740 1 -- 172.21.15.79:0/4275270602 shutdown_connections 2024-08-20T01:53:40.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.678+0000 7f3f50885740 1 -- 172.21.15.79:0/4275270602 wait complete. 2024-08-20T01:53:40.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.678+0000 7f3f50885740 1 -- start start 2024-08-20T01:53:40.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.679+0000 7f3f50885740 1 Processor -- start 2024-08-20T01:53:40.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.679+0000 7f3f50885740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56480e1fb880 0x56480e210480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:40.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.679+0000 7f3f50885740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56480e1fc1a0 0x56480e20b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:40.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.679+0000 7f3f50885740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56480e208130 0x56480e20be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:40.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.679+0000 7f3f50885740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3f481b15e0 con 0x56480e208130 2024-08-20T01:53:40.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.679+0000 7f3f50885740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3f481b0f10 con 0x56480e1fb880 2024-08-20T01:53:40.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.679+0000 7f3f50885740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3f481ae150 con 0x56480e1fc1a0 2024-08-20T01:53:40.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.679+0000 7f3f50885740 10 client.0 _ll_register_callbacks cb 0x7f3f400093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:53:40.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.679+0000 7f3f4ca29640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56480e208130 0x56480e20be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:40.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.679+0000 7f3f47fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56480e1fb880 0x56480e210480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:40.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.679+0000 7f3f4ca29640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56480e208130 0x56480e20be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35734/0 (socket says 172.21.15.79:35734) 2024-08-20T01:53:40.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.679+0000 7f3f4ca29640 1 -- 172.21.15.79:0/919869695 learned_addr learned my addr 172.21.15.79:0/919869695 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:40.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.679+0000 7f3f477fe640 1 --2- 172.21.15.79:0/919869695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56480e1fc1a0 0x56480e20b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:40.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.679+0000 7f3f4ca29640 1 -- 172.21.15.79:0/919869695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56480e1fc1a0 msgr2=0x56480e20b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:40.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.679+0000 7f3f4ca29640 1 --2- 172.21.15.79:0/919869695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56480e1fc1a0 0x56480e20b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.679+0000 7f3f4ca29640 1 -- 172.21.15.79:0/919869695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56480e1fb880 msgr2=0x56480e210480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:40.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.679+0000 7f3f4ca29640 1 --2- 172.21.15.79:0/919869695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56480e1fb880 0x56480e210480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.679+0000 7f3f4ca29640 1 -- 172.21.15.79:0/919869695 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56480e20c400 con 0x56480e208130 2024-08-20T01:53:40.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.679+0000 7f3f47fff640 1 --2- 172.21.15.79:0/919869695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56480e1fb880 0x56480e210480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:53:40.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.679+0000 7f3f4ca29640 1 --2- 172.21.15.79:0/919869695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56480e208130 0x56480e20be90 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f3f40003fb0 tx=0x7f3f40004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6debde1478d4686c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:40.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.679+0000 7f3f277fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:53:40.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.680+0000 7f3f277fe640 1 -- 172.21.15.79:0/919869695 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f4002e060 con 0x56480e208130 2024-08-20T01:53:40.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.680+0000 7f3f277fe640 1 -- 172.21.15.79:0/919869695 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f3f4000f870 con 0x56480e208130 2024-08-20T01:53:40.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.680+0000 7f3f50885740 1 -- 172.21.15.79:0/919869695 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f3c0aacf0 con 0x56480e208130 2024-08-20T01:53:40.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.680+0000 7f3f277fe640 1 -- 172.21.15.79:0/919869695 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f3f4000fa70 con 0x56480e208130 2024-08-20T01:53:40.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.680+0000 7f3f50885740 10 client.19524 fetch_fsmap learned FSMap version 69 2024-08-20T01:53:40.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.680+0000 7f3f50885740 1 -- 172.21.15.79:0/919869695 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) -- 0x56480e282550 con 0x56480e208130 2024-08-20T01:53:40.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.680+0000 7f3f277fe640 1 -- 172.21.15.79:0/919869695 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f3c0aacf0 con 0x56480e208130 2024-08-20T01:53:40.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.680+0000 7f3f277fe640 1 -- 172.21.15.79:0/919869695 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 69) ==== 8366+0+0 (secure 0 0 0) 0x7f3f40028070 con 0x56480e208130 2024-08-20T01:53:40.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.680+0000 7f3f50885740 10 client.19524 fetch_fsmap finished waiting for FSMap version 69 2024-08-20T01:53:40.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.680+0000 7f3f50885740 10 client.19524 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:53:40.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.680+0000 7f3f50885740 20 client.19524 populate_metadata read hostname 'smithi079' 2024-08-20T01:53:40.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.680+0000 7f3f50885740 1 --2- 172.21.15.79:0/919869695 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x56480e282d00 0x56480e285120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:40.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.680+0000 7f3f50885740 4 client.19524 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:53:40.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.680+0000 7f3f50885740 1 -- 172.21.15.79:0/919869695 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56480e170320 con 0x56480e282d00 2024-08-20T01:53:40.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.680+0000 7f3f47fff640 1 --2- 172.21.15.79:0/919869695 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x56480e282d00 0x56480e285120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:40.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.681+0000 7f3f277fe640 10 client.19524 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:53:40.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.681+0000 7f3f47fff640 1 --2- 172.21.15.79:0/919869695 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x56480e282d00 0x56480e285120 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a3863927740e70d8 server_cookie=434ff3595ea42e5e in_seq=0 out_seq=0 2024-08-20T01:53:40.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.681+0000 7f3f277fe640 1 -- 172.21.15.79:0/919869695 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56480e170320 con 0x56480e282d00 2024-08-20T01:53:40.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.681+0000 7f3f277fe640 10 client.19524 handle_command_reply: tid=0 2024-08-20T01:53:40.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.681+0000 7f3f50885740 1 client.19524 shutdown 2024-08-20T01:53:40.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.681+0000 7f3f50885740 1 -- 172.21.15.79:0/919869695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56480e208130 msgr2=0x56480e20be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:40.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.681+0000 7f3f50885740 1 --2- 172.21.15.79:0/919869695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56480e208130 0x56480e20be90 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f3f40003fb0 tx=0x7f3f40004ab0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.681+0000 7f3f50885740 1 -- 172.21.15.79:0/919869695 shutdown_connections 2024-08-20T01:53:40.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.681+0000 7f3f50885740 1 --2- 172.21.15.79:0/919869695 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x56480e282d00 0x56480e285120 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.681+0000 7f3f50885740 1 --2- 172.21.15.79:0/919869695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56480e208130 0x56480e20be90 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.681+0000 7f3f50885740 1 --2- 172.21.15.79:0/919869695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56480e1fc1a0 0x56480e20b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.681+0000 7f3f277fe640 0 client.19524 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:53:40.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.681+0000 7f3f50885740 1 --2- 172.21.15.79:0/919869695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56480e1fb880 0x56480e210480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.681+0000 7f3f50885740 1 -- 172.21.15.79:0/919869695 >> 172.21.15.79:0/919869695 conn(0x56480e1f96b0 msgr2=0x56480e1f7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:40.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.681+0000 7f3f50885740 1 -- 172.21.15.79:0/919869695 shutdown_connections 2024-08-20T01:53:40.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.681+0000 7f3f50885740 1 -- 172.21.15.79:0/919869695 wait complete. 2024-08-20T01:53:40.708 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:53:40.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.681+0000 7f3f50885740 20 client.19524 trim_cache size 0 max 16384 2024-08-20T01:53:40.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.682+0000 7f3f4e48c640 1 -- 172.21.15.79:0/1034685968 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3f300b3bd0 msgr2=0x7f3f300b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:40.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.682+0000 7f3f4e48c640 1 --2- 172.21.15.79:0/1034685968 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3f300b3bd0 0x7f3f300b6090 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f3f48111110 tx=0x7f3f40009500 comp rx=0 tx=0).stop 2024-08-20T01:53:40.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.682+0000 7f3f4e48c640 1 -- 172.21.15.79:0/1034685968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f481073c0 msgr2=0x7f3f4810f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:40.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.682+0000 7f3f4e48c640 1 --2- 172.21.15.79:0/1034685968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f481073c0 0x7f3f4810f590 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c00d770 tx=0x7f3f3c00dc30 comp rx=0 tx=0).stop 2024-08-20T01:53:40.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.682+0000 7f3f4e48c640 1 -- 172.21.15.79:0/1034685968 shutdown_connections 2024-08-20T01:53:40.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.682+0000 7f3f4e48c640 1 --2- 172.21.15.79:0/1034685968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f48107d40 0x7f3f4810fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.682+0000 7f3f4e48c640 1 --2- 172.21.15.79:0/1034685968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f481073c0 0x7f3f4810f590 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.682+0000 7f3f4e48c640 1 --2- 172.21.15.79:0/1034685968 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3f300b3bd0 0x7f3f300b6090 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.682+0000 7f3f4e48c640 1 --2- 172.21.15.79:0/1034685968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f481019b0 0x7f3f4810f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:40.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.682+0000 7f3f4e48c640 1 -- 172.21.15.79:0/1034685968 >> 172.21.15.79:0/1034685968 conn(0x7f3f480fd420 msgr2=0x7f3f480ff810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:40.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.682+0000 7f3f4e48c640 1 -- 172.21.15.79:0/1034685968 shutdown_connections 2024-08-20T01:53:40.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:40.682+0000 7f3f4e48c640 1 -- 172.21.15.79:0/1034685968 wait complete. 2024-08-20T01:53:41.532 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-20T01:53:41.779 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:53:42.175 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:42 smithi079 ceph-mon[18656]: pgmap v838: 97 pgs: 97 active+clean; 6.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.6 KiB/s wr, 21 op/s 2024-08-20T01:53:42.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.254+0000 7fac8d4c3640 1 -- 172.21.15.79:0/3838310687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac88102ab0 msgr2=0x7fac88102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:42.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.254+0000 7fac8d4c3640 1 --2- 172.21.15.79:0/3838310687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac88102ab0 0x7fac88102e90 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fac78009900 tx=0x7fac7802a410 comp rx=0 tx=0).stop 2024-08-20T01:53:42.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.254+0000 7fac8d4c3640 1 -- 172.21.15.79:0/3838310687 shutdown_connections 2024-08-20T01:53:42.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.254+0000 7fac8d4c3640 1 --2- 172.21.15.79:0/3838310687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac88108e40 0x7fac8810f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:42.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.254+0000 7fac8d4c3640 1 --2- 172.21.15.79:0/3838310687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac881084c0 0x7fac88108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:42.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.254+0000 7fac8d4c3640 1 --2- 172.21.15.79:0/3838310687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac88102ab0 0x7fac88102e90 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:42.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.254+0000 7fac8d4c3640 1 -- 172.21.15.79:0/3838310687 >> 172.21.15.79:0/3838310687 conn(0x7fac880fe500 msgr2=0x7fac88100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:42.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.254+0000 7fac8d4c3640 1 -- 172.21.15.79:0/3838310687 shutdown_connections 2024-08-20T01:53:42.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.254+0000 7fac8d4c3640 1 -- 172.21.15.79:0/3838310687 wait complete. 2024-08-20T01:53:42.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.255+0000 7fac8d4c3640 1 Processor -- start 2024-08-20T01:53:42.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.255+0000 7fac8d4c3640 1 -- start start 2024-08-20T01:53:42.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.255+0000 7fac8d4c3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac88102ab0 0x7fac88198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:42.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.255+0000 7fac8d4c3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac881084c0 0x7fac88199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:42.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.255+0000 7fac8d4c3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac88108e40 0x7fac8819e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:42.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.255+0000 7fac8d4c3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fac881129b0 con 0x7fac88108e40 2024-08-20T01:53:42.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.255+0000 7fac8d4c3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fac88112830 con 0x7fac881084c0 2024-08-20T01:53:42.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.255+0000 7fac8d4c3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fac88112b30 con 0x7fac88102ab0 2024-08-20T01:53:42.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.255+0000 7fac877fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac88108e40 0x7fac8819e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:42.278 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.255+0000 7fac877fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac88108e40 0x7fac8819e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35744/0 (socket says 172.21.15.79:35744) 2024-08-20T01:53:42.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.255+0000 7fac877fe640 1 -- 172.21.15.79:0/2674882400 learned_addr learned my addr 172.21.15.79:0/2674882400 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:42.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.256+0000 7fac867fc640 1 --2- 172.21.15.79:0/2674882400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac881084c0 0x7fac88199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:42.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.256+0000 7fac86ffd640 1 --2- 172.21.15.79:0/2674882400 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac88102ab0 0x7fac88198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:42.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.256+0000 7fac877fe640 1 -- 172.21.15.79:0/2674882400 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac88102ab0 msgr2=0x7fac88198ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:42.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.256+0000 7fac877fe640 1 --2- 172.21.15.79:0/2674882400 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac88102ab0 0x7fac88198ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:42.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.256+0000 7fac877fe640 1 -- 172.21.15.79:0/2674882400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac881084c0 msgr2=0x7fac88199400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:42.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.256+0000 7fac877fe640 1 --2- 172.21.15.79:0/2674882400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac881084c0 0x7fac88199400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:42.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.256+0000 7fac877fe640 1 -- 172.21.15.79:0/2674882400 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac8819ef70 con 0x7fac88108e40 2024-08-20T01:53:42.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.256+0000 7fac867fc640 1 --2- 172.21.15.79:0/2674882400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac881084c0 0x7fac88199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:53:42.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.256+0000 7fac877fe640 1 --2- 172.21.15.79:0/2674882400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac88108e40 0x7fac8819e7a0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fac80009fd0 tx=0x7fac8000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:42.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.256+0000 7fac6ffff640 1 -- 172.21.15.79:0/2674882400 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac80017070 con 0x7fac88108e40 2024-08-20T01:53:42.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.256+0000 7fac6ffff640 1 -- 172.21.15.79:0/2674882400 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fac80003e00 con 0x7fac88108e40 2024-08-20T01:53:42.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.256+0000 7fac8d4c3640 1 -- 172.21.15.79:0/2674882400 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac8819f260 con 0x7fac88108e40 2024-08-20T01:53:42.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.256+0000 7fac6ffff640 1 -- 172.21.15.79:0/2674882400 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac80010460 con 0x7fac88108e40 2024-08-20T01:53:42.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.256+0000 7fac8d4c3640 1 -- 172.21.15.79:0/2674882400 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac881a5920 con 0x7fac88108e40 2024-08-20T01:53:42.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.258+0000 7fac8f8bc740 1 Processor -- start 2024-08-20T01:53:42.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.259+0000 7fac6ffff640 1 -- 172.21.15.79:0/2674882400 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fac80003970 con 0x7fac88108e40 2024-08-20T01:53:42.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.259+0000 7fac8f8bc740 1 -- start start 2024-08-20T01:53:42.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.259+0000 7fac8f8bc740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56019b9e0880 0x56019b9e0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:42.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.259+0000 7fac8f8bc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56019b9e11a0 0x56019b9ecbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:42.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.259+0000 7fac8f8bc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56019b9ed130 0x56019b9ef520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:42.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.259+0000 7fac8f8bc740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56019b957930 con 0x56019b9e0880 2024-08-20T01:53:42.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.259+0000 7fac8f8bc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56019b946e30 con 0x56019b9e11a0 2024-08-20T01:53:42.280 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.259+0000 7fac8f8bc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56019b94ae70 con 0x56019b9ed130 2024-08-20T01:53:42.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.259+0000 7fac867fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56019b9e0880 0x56019b9e0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:42.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.259+0000 7fac867fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56019b9e0880 0x56019b9e0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35750/0 (socket says 172.21.15.79:35750) 2024-08-20T01:53:42.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.259+0000 7fac867fc640 1 -- 172.21.15.79:0/563269652 learned_addr learned my addr 172.21.15.79:0/563269652 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:42.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.259+0000 7fac86ffd640 1 --2- 172.21.15.79:0/563269652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56019b9e11a0 0x56019b9ecbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:42.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.259+0000 7fac867fc640 1 --2- 172.21.15.79:0/563269652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56019b9ed130 0x56019b9ef520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:42.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.259+0000 7fac867fc640 1 -- 172.21.15.79:0/563269652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56019b9ed130 msgr2=0x56019b9ef520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:42.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.259+0000 7fac867fc640 1 --2- 172.21.15.79:0/563269652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56019b9ed130 0x56019b9ef520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:42.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.259+0000 7fac867fc640 1 -- 172.21.15.79:0/563269652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56019b9e11a0 msgr2=0x56019b9ecbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:42.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.259+0000 7fac867fc640 1 --2- 172.21.15.79:0/563269652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56019b9e11a0 0x56019b9ecbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:42.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.259+0000 7fac867fc640 1 -- 172.21.15.79:0/563269652 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56019b6a6650 con 0x56019b9e0880 2024-08-20T01:53:42.281 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.259+0000 7fac6ffff640 1 --2- 172.21.15.79:0/2674882400 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fac700b3bd0 0x7fac700b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:42.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.259+0000 7fac867fc640 1 --2- 172.21.15.79:0/563269652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56019b9e0880 0x56019b9e0c60 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fac7c0139d0 tx=0x7fac7c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=169fb114c1c747ee server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:42.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.260+0000 7fac86ffd640 1 --2- 172.21.15.79:0/2674882400 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fac700b3bd0 0x7fac700b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:42.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.260+0000 7fac6ffff640 1 -- 172.21.15.79:0/2674882400 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fac800e3cd0 con 0x7fac88108e40 2024-08-20T01:53:42.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.260+0000 7fac6d7fa640 1 -- 172.21.15.79:0/563269652 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7c00fa00 con 0x56019b9e0880 2024-08-20T01:53:42.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.260+0000 7fac6d7fa640 1 -- 172.21.15.79:0/563269652 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fac7c004030 con 0x56019b9e0880 2024-08-20T01:53:42.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.260+0000 7fac6d7fa640 1 -- 172.21.15.79:0/563269652 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7c0039e0 con 0x56019b9e0880 2024-08-20T01:53:42.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.260+0000 7fac8f8bc740 1 -- 172.21.15.79:0/563269652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56019b9e0880 msgr2=0x56019b9e0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:42.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.260+0000 7fac86ffd640 1 --2- 172.21.15.79:0/2674882400 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fac700b3bd0 0x7fac700b6090 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fac780057c0 tx=0x7fac780058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:42.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.260+0000 7fac8f8bc740 1 --2- 172.21.15.79:0/563269652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56019b9e0880 0x56019b9e0c60 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fac7c0139d0 tx=0x7fac7c009c00 comp rx=0 tx=0).stop 2024-08-20T01:53:42.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.261+0000 7fac8f8bc740 1 -- 172.21.15.79:0/563269652 shutdown_connections 2024-08-20T01:53:42.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.261+0000 7fac8f8bc740 1 --2- 172.21.15.79:0/563269652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56019b9ed130 0x56019b9ef520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:42.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.261+0000 7fac8f8bc740 1 --2- 172.21.15.79:0/563269652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56019b9e11a0 0x56019b9ecbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:42.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.261+0000 7fac8f8bc740 1 --2- 172.21.15.79:0/563269652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56019b9e0880 0x56019b9e0c60 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:42.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.261+0000 7fac8f8bc740 1 -- 172.21.15.79:0/563269652 >> 172.21.15.79:0/563269652 conn(0x56019b9de6b0 msgr2=0x56019b9df850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:42.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.261+0000 7fac8f8bc740 1 -- 172.21.15.79:0/563269652 shutdown_connections 2024-08-20T01:53:42.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.261+0000 7fac8f8bc740 1 -- 172.21.15.79:0/563269652 wait complete. 2024-08-20T01:53:42.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.261+0000 7fac8f8bc740 1 -- start start 2024-08-20T01:53:42.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.261+0000 7fac8f8bc740 1 Processor -- start 2024-08-20T01:53:42.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.261+0000 7fac8f8bc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56019b9e0880 0x56019b9ea0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:42.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.261+0000 7fac8f8bc740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56019b9e11a0 0x56019b9ea630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:42.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.261+0000 7fac8f8bc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56019b9ed130 0x56019b9eab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:42.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.261+0000 7fac8f8bc740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56019b7a9700 con 0x56019b9e11a0 2024-08-20T01:53:42.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.261+0000 7fac8f8bc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56019b8cd810 con 0x56019b9ed130 2024-08-20T01:53:42.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.261+0000 7fac8f8bc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56019b9efde0 con 0x56019b9e0880 2024-08-20T01:53:42.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.261+0000 7fac8f8bc740 10 client.0 _ll_register_callbacks cb 0x56019b940700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:53:42.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.261+0000 7fac867fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56019b9e11a0 0x56019b9ea630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:42.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.261+0000 7fac867fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56019b9e11a0 0x56019b9ea630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35754/0 (socket says 172.21.15.79:35754) 2024-08-20T01:53:42.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.261+0000 7fac867fc640 1 -- 172.21.15.79:0/2274775861 learned_addr learned my addr 172.21.15.79:0/2274775861 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:42.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.261+0000 7fac877fe640 1 --2- 172.21.15.79:0/2274775861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56019b9ed130 0x56019b9eab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:42.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.262+0000 7fac86ffd640 1 --2- 172.21.15.79:0/2274775861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56019b9e0880 0x56019b9ea0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:42.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.262+0000 7fac867fc640 1 -- 172.21.15.79:0/2274775861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56019b9e0880 msgr2=0x56019b9ea0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:42.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.262+0000 7fac867fc640 1 --2- 172.21.15.79:0/2274775861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56019b9e0880 0x56019b9ea0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:42.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.262+0000 7fac867fc640 1 -- 172.21.15.79:0/2274775861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56019b9ed130 msgr2=0x56019b9eab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:42.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.262+0000 7fac867fc640 1 --2- 172.21.15.79:0/2274775861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56019b9ed130 0x56019b9eab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:42.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.262+0000 7fac867fc640 1 -- 172.21.15.79:0/2274775861 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56019b9f91c0 con 0x56019b9e11a0 2024-08-20T01:53:42.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.262+0000 7fac877fe640 1 --2- 172.21.15.79:0/2274775861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56019b9ed130 0x56019b9eab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:53:42.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.262+0000 7fac867fc640 1 --2- 172.21.15.79:0/2274775861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56019b9e11a0 0x56019b9ea630 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fac7c005890 tx=0x7fac7c005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f03ccaf08d76b1c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:42.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.262+0000 7fac6aff5640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:53:42.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.262+0000 7fac6aff5640 1 -- 172.21.15.79:0/2274775861 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7c01f630 con 0x56019b9e11a0 2024-08-20T01:53:42.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.262+0000 7fac6aff5640 1 -- 172.21.15.79:0/2274775861 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fac7c01f7d0 con 0x56019b9e11a0 2024-08-20T01:53:42.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.262+0000 7fac8f8bc740 1 -- 172.21.15.79:0/2274775861 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56019b8f6150 con 0x56019b9e11a0 2024-08-20T01:53:42.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.262+0000 7fac6aff5640 1 -- 172.21.15.79:0/2274775861 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7fac7c01f9d0 con 0x56019b9e11a0 2024-08-20T01:53:42.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.262+0000 7fac8f8bc740 10 client.19536 fetch_fsmap learned FSMap version 69 2024-08-20T01:53:42.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.262+0000 7fac8f8bc740 1 -- 172.21.15.79:0/2274775861 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) -- 0x56019b9fbb70 con 0x56019b9e11a0 2024-08-20T01:53:42.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.262+0000 7fac6aff5640 1 -- 172.21.15.79:0/2274775861 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56019b8f6150 con 0x56019b9e11a0 2024-08-20T01:53:42.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.263+0000 7fac6aff5640 1 -- 172.21.15.79:0/2274775861 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 69) ==== 8366+0+0 (secure 0 0 0) 0x7fac7c01e070 con 0x56019b9e11a0 2024-08-20T01:53:42.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.263+0000 7fac8f8bc740 10 client.19536 fetch_fsmap finished waiting for FSMap version 69 2024-08-20T01:53:42.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.263+0000 7fac8f8bc740 10 client.19536 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:53:42.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.263+0000 7fac8f8bc740 20 client.19536 populate_metadata read hostname 'smithi079' 2024-08-20T01:53:42.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.263+0000 7fac8f8bc740 1 --2- 172.21.15.79:0/2274775861 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x56019b9fcec0 0x56019b9ff2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:42.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.263+0000 7fac8f8bc740 4 client.19536 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:53:42.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.263+0000 7fac8f8bc740 1 -- 172.21.15.79:0/2274775861 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56019b959880 con 0x56019b9fcec0 2024-08-20T01:53:42.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.263+0000 7fac86ffd640 1 --2- 172.21.15.79:0/2274775861 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x56019b9fcec0 0x56019b9ff2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:42.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.263+0000 7fac86ffd640 1 --2- 172.21.15.79:0/2274775861 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x56019b9fcec0 0x56019b9ff2b0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8113c6bf6e6d8027 server_cookie=e7021ab35a490fd5 in_seq=0 out_seq=0 2024-08-20T01:53:42.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.263+0000 7fac6aff5640 10 client.19536 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:53:42.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.264+0000 7fac6aff5640 1 -- 172.21.15.79:0/2274775861 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56019b959880 con 0x56019b9fcec0 2024-08-20T01:53:42.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.264+0000 7fac6aff5640 10 client.19536 handle_command_reply: tid=0 2024-08-20T01:53:42.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.264+0000 7fac8f8bc740 1 client.19536 shutdown 2024-08-20T01:53:42.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.264+0000 7fac8f8bc740 1 -- 172.21.15.79:0/2274775861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56019b9e11a0 msgr2=0x56019b9ea630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:42.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.264+0000 7fac8f8bc740 1 --2- 172.21.15.79:0/2274775861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56019b9e11a0 0x56019b9ea630 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fac7c005890 tx=0x7fac7c005dc0 comp rx=0 tx=0).stop 2024-08-20T01:53:42.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.264+0000 7fac8f8bc740 1 -- 172.21.15.79:0/2274775861 shutdown_connections 2024-08-20T01:53:42.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.264+0000 7fac8f8bc740 1 --2- 172.21.15.79:0/2274775861 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x56019b9fcec0 0x56019b9ff2b0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:42.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.264+0000 7fac8f8bc740 1 --2- 172.21.15.79:0/2274775861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56019b9ed130 0x56019b9eab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:42.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.264+0000 7fac8f8bc740 1 --2- 172.21.15.79:0/2274775861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56019b9e11a0 0x56019b9ea630 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:42.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.264+0000 7fac8f8bc740 1 --2- 172.21.15.79:0/2274775861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56019b9e0880 0x56019b9ea0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:42.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.264+0000 7fac8f8bc740 1 -- 172.21.15.79:0/2274775861 >> 172.21.15.79:0/2274775861 conn(0x56019b9de6b0 msgr2=0x56019b9e4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:42.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.264+0000 7fac6aff5640 0 client.19536 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:53:42.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.264+0000 7fac8f8bc740 1 -- 172.21.15.79:0/2274775861 shutdown_connections 2024-08-20T01:53:42.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.264+0000 7fac8f8bc740 1 -- 172.21.15.79:0/2274775861 wait complete. 2024-08-20T01:53:42.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.265+0000 7fac8f8bc740 20 client.19536 trim_cache size 0 max 16384 2024-08-20T01:53:42.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.278+0000 7fac8f8bc740 1 Processor -- start 2024-08-20T01:53:42.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.278+0000 7fac8f8bc740 1 -- start start 2024-08-20T01:53:42.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.278+0000 7fac8f8bc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56019b9e0880 0x56019b9d91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:42.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.278+0000 7fac8f8bc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56019b9ed130 0x56019b9e9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:42.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.278+0000 7fac8f8bc740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56019ba04b40 0x56019ba04ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:42.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.278+0000 7fac8f8bc740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fac881adfb0 con 0x56019ba04b40 2024-08-20T01:53:42.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.278+0000 7fac8f8bc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fac881afaf0 con 0x56019b9ed130 2024-08-20T01:53:42.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.278+0000 7fac8f8bc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fac881ae680 con 0x56019b9e0880 2024-08-20T01:53:42.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.278+0000 7fac877fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56019ba04b40 0x56019ba04ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:42.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.278+0000 7fac877fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56019ba04b40 0x56019ba04ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35764/0 (socket says 172.21.15.79:35764) 2024-08-20T01:53:42.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.278+0000 7fac877fe640 1 -- 172.21.15.79:0/1801217351 learned_addr learned my addr 172.21.15.79:0/1801217351 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:42.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.278+0000 7fac867fc640 1 --2- 172.21.15.79:0/1801217351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56019b9ed130 0x56019b9e9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:42.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.278+0000 7fac877fe640 1 -- 172.21.15.79:0/1801217351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56019b9e0880 msgr2=0x56019b9d91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:42.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.278+0000 7fac86ffd640 1 --2- 172.21.15.79:0/1801217351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56019b9e0880 0x56019b9d91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:42.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.278+0000 7fac877fe640 1 --2- 172.21.15.79:0/1801217351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56019b9e0880 0x56019b9d91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:42.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.278+0000 7fac877fe640 1 -- 172.21.15.79:0/1801217351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56019b9ed130 msgr2=0x56019b9e9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:42.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.278+0000 7fac877fe640 1 --2- 172.21.15.79:0/1801217351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56019b9ed130 0x56019b9e9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:42.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.278+0000 7fac877fe640 1 -- 172.21.15.79:0/1801217351 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56019b9df130 con 0x56019ba04b40 2024-08-20T01:53:42.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.278+0000 7fac867fc640 1 --2- 172.21.15.79:0/1801217351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56019b9ed130 0x56019b9e9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:53:42.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.279+0000 7fac877fe640 1 --2- 172.21.15.79:0/1801217351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56019ba04b40 0x56019ba04ff0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fac800e1830 tx=0x7fac800aabe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4279c66a87bd2512 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:42.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.279+0000 7fac6cff9640 1 -- 172.21.15.79:0/1801217351 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac80020030 con 0x56019ba04b40 2024-08-20T01:53:42.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.279+0000 7fac6cff9640 1 -- 172.21.15.79:0/1801217351 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fac800af230 con 0x56019ba04b40 2024-08-20T01:53:42.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.279+0000 7fac6cff9640 1 -- 172.21.15.79:0/1801217351 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac800b3ab0 con 0x56019ba04b40 2024-08-20T01:53:42.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.279+0000 7fac8f8bc740 1 -- 172.21.15.79:0/1801217351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56019ba04b40 msgr2=0x56019ba04ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:42.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.279+0000 7fac8f8bc740 1 --2- 172.21.15.79:0/1801217351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56019ba04b40 0x56019ba04ff0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fac800e1830 tx=0x7fac800aabe0 comp rx=0 tx=0).stop 2024-08-20T01:53:42.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.279+0000 7fac8f8bc740 1 -- 172.21.15.79:0/1801217351 shutdown_connections 2024-08-20T01:53:42.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.279+0000 7fac8f8bc740 1 --2- 172.21.15.79:0/1801217351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56019ba04b40 0x56019ba04ff0 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:42.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.279+0000 7fac8f8bc740 1 --2- 172.21.15.79:0/1801217351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56019b9ed130 0x56019b9e9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:42.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.279+0000 7fac8f8bc740 1 --2- 172.21.15.79:0/1801217351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56019b9e0880 0x56019b9d91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:42.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.279+0000 7fac8f8bc740 1 -- 172.21.15.79:0/1801217351 >> 172.21.15.79:0/1801217351 conn(0x56019b9de6b0 msgr2=0x56019b9e8970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:42.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.280+0000 7fac8f8bc740 1 -- 172.21.15.79:0/1801217351 shutdown_connections 2024-08-20T01:53:42.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.280+0000 7fac8f8bc740 1 -- 172.21.15.79:0/1801217351 wait complete. 2024-08-20T01:53:42.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.280+0000 7fac8f8bc740 1 -- start start 2024-08-20T01:53:42.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.280+0000 7fac8f8bc740 1 Processor -- start 2024-08-20T01:53:42.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.280+0000 7fac8f8bc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56019b9e0880 0x56019ba5fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:42.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.280+0000 7fac8f8bc740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56019b9ed130 0x56019ba60260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:42.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.280+0000 7fac8f8bc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56019ba04b40 0x56019ba607a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:42.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.280+0000 7fac8f8bc740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fac881af420 con 0x56019b9ed130 2024-08-20T01:53:42.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.280+0000 7fac8f8bc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fac881aed50 con 0x56019ba04b40 2024-08-20T01:53:42.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.280+0000 7fac8f8bc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fac881abf90 con 0x56019b9e0880 2024-08-20T01:53:42.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.280+0000 7fac8f8bc740 10 client.0 _ll_register_callbacks cb 0x7fac7c013f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:53:42.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.280+0000 7fac867fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56019b9ed130 0x56019ba60260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:42.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.280+0000 7fac867fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56019b9ed130 0x56019ba60260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35774/0 (socket says 172.21.15.79:35774) 2024-08-20T01:53:42.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.280+0000 7fac867fc640 1 -- 172.21.15.79:0/2769364919 learned_addr learned my addr 172.21.15.79:0/2769364919 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:42.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.280+0000 7fac877fe640 1 --2- 172.21.15.79:0/2769364919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56019ba04b40 0x56019ba607a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:42.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.281+0000 7fac86ffd640 1 --2- 172.21.15.79:0/2769364919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56019b9e0880 0x56019ba5fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:42.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.281+0000 7fac867fc640 1 -- 172.21.15.79:0/2769364919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56019b9e0880 msgr2=0x56019ba5fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:42.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.281+0000 7fac867fc640 1 --2- 172.21.15.79:0/2769364919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56019b9e0880 0x56019ba5fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:42.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.281+0000 7fac867fc640 1 -- 172.21.15.79:0/2769364919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56019ba04b40 msgr2=0x56019ba607a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:42.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.281+0000 7fac867fc640 1 --2- 172.21.15.79:0/2769364919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56019ba04b40 0x56019ba607a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:42.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.281+0000 7fac867fc640 1 -- 172.21.15.79:0/2769364919 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56019b9f42e0 con 0x56019b9ed130 2024-08-20T01:53:42.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.281+0000 7fac877fe640 1 --2- 172.21.15.79:0/2769364919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56019ba04b40 0x56019ba607a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:53:42.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.281+0000 7fac867fc640 1 --2- 172.21.15.79:0/2769364919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56019b9ed130 0x56019ba60260 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fac7c0058c0 tx=0x7fac7c00ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8db122cb9a048e35 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:42.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.281+0000 7fac6aff5640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:53:42.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.281+0000 7fac6aff5640 1 -- 172.21.15.79:0/2769364919 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7c01f430 con 0x56019b9ed130 2024-08-20T01:53:42.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.281+0000 7fac8f8bc740 1 -- 172.21.15.79:0/2769364919 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac800af230 con 0x56019b9ed130 2024-08-20T01:53:42.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.281+0000 7fac6aff5640 1 -- 172.21.15.79:0/2769364919 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fac7c01f5d0 con 0x56019b9ed130 2024-08-20T01:53:42.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.281+0000 7fac6aff5640 1 -- 172.21.15.79:0/2769364919 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7fac7c01f7d0 con 0x56019b9ed130 2024-08-20T01:53:42.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.281+0000 7fac8f8bc740 10 client.19542 fetch_fsmap learned FSMap version 69 2024-08-20T01:53:42.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.281+0000 7fac8f8bc740 1 -- 172.21.15.79:0/2769364919 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) -- 0x56019b9f55e0 con 0x56019b9ed130 2024-08-20T01:53:42.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.281+0000 7fac6aff5640 1 -- 172.21.15.79:0/2769364919 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fac800af230 con 0x56019b9ed130 2024-08-20T01:53:42.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.282+0000 7fac6aff5640 1 -- 172.21.15.79:0/2769364919 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 69) ==== 8366+0+0 (secure 0 0 0) 0x7fac7c01e040 con 0x56019b9ed130 2024-08-20T01:53:42.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.282+0000 7fac8f8bc740 10 client.19542 fetch_fsmap finished waiting for FSMap version 69 2024-08-20T01:53:42.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.282+0000 7fac8f8bc740 10 client.19542 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:53:42.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.282+0000 7fac8f8bc740 20 client.19542 populate_metadata read hostname 'smithi079' 2024-08-20T01:53:42.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.282+0000 7fac8f8bc740 1 --2- 172.21.15.79:0/2769364919 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x56019ba6bf20 0x56019ba6e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:42.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.282+0000 7fac8f8bc740 4 client.19542 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:53:42.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.282+0000 7fac8f8bc740 1 -- 172.21.15.79:0/2769364919 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56019b9d9880 con 0x56019ba6bf20 2024-08-20T01:53:42.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.282+0000 7fac86ffd640 1 --2- 172.21.15.79:0/2769364919 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x56019ba6bf20 0x56019ba6e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:42.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.282+0000 7fac6aff5640 10 client.19542 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:53:42.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.282+0000 7fac86ffd640 1 --2- 172.21.15.79:0/2769364919 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x56019ba6bf20 0x56019ba6e310 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=99dfb67ff510aa61 server_cookie=f32d2d5d6949c11a in_seq=0 out_seq=0 2024-08-20T01:53:42.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.283+0000 7fac6aff5640 1 -- 172.21.15.79:0/2769364919 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56019b9d9880 con 0x56019ba6bf20 2024-08-20T01:53:42.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.283+0000 7fac6aff5640 10 client.19542 handle_command_reply: tid=0 2024-08-20T01:53:42.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.283+0000 7fac8f8bc740 1 client.19542 shutdown 2024-08-20T01:53:42.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.283+0000 7fac8f8bc740 1 -- 172.21.15.79:0/2769364919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56019b9ed130 msgr2=0x56019ba60260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:42.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.283+0000 7fac8f8bc740 1 --2- 172.21.15.79:0/2769364919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56019b9ed130 0x56019ba60260 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fac7c0058c0 tx=0x7fac7c00ff90 comp rx=0 tx=0).stop 2024-08-20T01:53:42.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.283+0000 7fac8f8bc740 1 -- 172.21.15.79:0/2769364919 shutdown_connections 2024-08-20T01:53:42.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.283+0000 7fac8f8bc740 1 --2- 172.21.15.79:0/2769364919 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x56019ba6bf20 0x56019ba6e310 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:42.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.283+0000 7fac8f8bc740 1 --2- 172.21.15.79:0/2769364919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56019ba04b40 0x56019ba607a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:42.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.283+0000 7fac6aff5640 0 client.19542 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:53:42.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.283+0000 7fac8f8bc740 1 --2- 172.21.15.79:0/2769364919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56019b9ed130 0x56019ba60260 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:42.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.283+0000 7fac8f8bc740 1 --2- 172.21.15.79:0/2769364919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56019b9e0880 0x56019ba5fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:42.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.283+0000 7fac8f8bc740 1 -- 172.21.15.79:0/2769364919 >> 172.21.15.79:0/2769364919 conn(0x56019b9de6b0 msgr2=0x56019b9e8970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:42.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.283+0000 7fac8f8bc740 1 -- 172.21.15.79:0/2769364919 shutdown_connections 2024-08-20T01:53:42.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.283+0000 7fac8f8bc740 1 -- 172.21.15.79:0/2769364919 wait complete. 2024-08-20T01:53:42.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.283+0000 7fac8f8bc740 20 client.19542 trim_cache size 0 max 16384 2024-08-20T01:53:42.300 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:53:42.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.283+0000 7fac8d4c3640 1 -- 172.21.15.79:0/2674882400 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fac700b3bd0 msgr2=0x7fac700b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:42.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.283+0000 7fac8d4c3640 1 --2- 172.21.15.79:0/2674882400 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fac700b3bd0 0x7fac700b6090 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fac780057c0 tx=0x7fac780058d0 comp rx=0 tx=0).stop 2024-08-20T01:53:42.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.283+0000 7fac8d4c3640 1 -- 172.21.15.79:0/2674882400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac88108e40 msgr2=0x7fac8819e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:42.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.283+0000 7fac8d4c3640 1 --2- 172.21.15.79:0/2674882400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac88108e40 0x7fac8819e7a0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fac80009fd0 tx=0x7fac8000b260 comp rx=0 tx=0).stop 2024-08-20T01:53:42.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.283+0000 7fac8d4c3640 1 -- 172.21.15.79:0/2674882400 shutdown_connections 2024-08-20T01:53:42.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.283+0000 7fac8d4c3640 1 --2- 172.21.15.79:0/2674882400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac88108e40 0x7fac8819e7a0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:42.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.283+0000 7fac8d4c3640 1 --2- 172.21.15.79:0/2674882400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac881084c0 0x7fac88199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:42.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.283+0000 7fac8d4c3640 1 --2- 172.21.15.79:0/2674882400 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fac700b3bd0 0x7fac700b6090 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:42.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.283+0000 7fac8d4c3640 1 --2- 172.21.15.79:0/2674882400 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac88102ab0 0x7fac88198ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:42.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.283+0000 7fac8d4c3640 1 -- 172.21.15.79:0/2674882400 >> 172.21.15.79:0/2674882400 conn(0x7fac880fe500 msgr2=0x7fac880ffec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:42.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.284+0000 7fac8d4c3640 1 -- 172.21.15.79:0/2674882400 shutdown_connections 2024-08-20T01:53:42.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:42.284+0000 7fac8d4c3640 1 -- 172.21.15.79:0/2674882400 wait complete. 2024-08-20T01:53:42.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:42 smithi175 ceph-mon[22392]: pgmap v838: 97 pgs: 97 active+clean; 6.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.6 KiB/s wr, 21 op/s 2024-08-20T01:53:42.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:42 smithi081 ceph-mon[22209]: pgmap v838: 97 pgs: 97 active+clean; 6.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.6 KiB/s wr, 21 op/s 2024-08-20T01:53:43.128 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T01:53:43.373 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:53:43.866 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.854+0000 7f36c805b640 1 -- 172.21.15.79:0/3517725090 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36c0108e60 msgr2=0x7f36c010f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:43.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.854+0000 7f36c805b640 1 --2- 172.21.15.79:0/3517725090 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36c0108e60 0x7f36c010f660 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f36b8009ca0 tx=0x7f36b802a8c0 comp rx=0 tx=0).stop 2024-08-20T01:53:43.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.854+0000 7f36c805b640 1 -- 172.21.15.79:0/3517725090 shutdown_connections 2024-08-20T01:53:43.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.854+0000 7f36c805b640 1 --2- 172.21.15.79:0/3517725090 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36c0108e60 0x7f36c010f660 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:43.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.854+0000 7f36c805b640 1 --2- 172.21.15.79:0/3517725090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36c01084e0 0x7f36c0108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:43.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.854+0000 7f36c805b640 1 --2- 172.21.15.79:0/3517725090 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36c0102ad0 0x7f36c0102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:43.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.854+0000 7f36c805b640 1 -- 172.21.15.79:0/3517725090 >> 172.21.15.79:0/3517725090 conn(0x7f36c00fe540 msgr2=0x7f36c0100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:43.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.854+0000 7f36c805b640 1 -- 172.21.15.79:0/3517725090 shutdown_connections 2024-08-20T01:53:43.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.854+0000 7f36c805b640 1 -- 172.21.15.79:0/3517725090 wait complete. 2024-08-20T01:53:43.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.855+0000 7f36c805b640 1 Processor -- start 2024-08-20T01:53:43.867 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.855+0000 7f36c805b640 1 -- start start 2024-08-20T01:53:43.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.855+0000 7f36c805b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36c0102ad0 0x7f36c0198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:43.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.855+0000 7f36c805b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36c01084e0 0x7f36c0199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:43.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.855+0000 7f36c805b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36c0108e60 0x7f36c019e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:43.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.855+0000 7f36c805b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f36c01129e0 con 0x7f36c0102ad0 2024-08-20T01:53:43.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.855+0000 7f36c805b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f36c0112860 con 0x7f36c01084e0 2024-08-20T01:53:43.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.855+0000 7f36c805b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f36c0112b60 con 0x7f36c0108e60 2024-08-20T01:53:43.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.855+0000 7f36c5df7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36c0102ad0 0x7f36c0198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:43.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.855+0000 7f36c5df7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36c0102ad0 0x7f36c0198e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35804/0 (socket says 172.21.15.79:35804) 2024-08-20T01:53:43.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.855+0000 7f36c5df7640 1 -- 172.21.15.79:0/4248065566 learned_addr learned my addr 172.21.15.79:0/4248065566 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:43.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.855+0000 7f36c55f6640 1 --2- 172.21.15.79:0/4248065566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36c01084e0 0x7f36c0199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:43.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.855+0000 7f36c65f8640 1 --2- 172.21.15.79:0/4248065566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36c0108e60 0x7f36c019e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:43.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.855+0000 7f36c5df7640 1 -- 172.21.15.79:0/4248065566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36c0108e60 msgr2=0x7f36c019e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:43.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.855+0000 7f36c5df7640 1 --2- 172.21.15.79:0/4248065566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36c0108e60 0x7f36c019e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:43.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.855+0000 7f36c5df7640 1 -- 172.21.15.79:0/4248065566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36c01084e0 msgr2=0x7f36c0199380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:43.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.855+0000 7f36c5df7640 1 --2- 172.21.15.79:0/4248065566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36c01084e0 0x7f36c0199380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:43.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.855+0000 7f36c5df7640 1 -- 172.21.15.79:0/4248065566 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36c019eef0 con 0x7f36c0102ad0 2024-08-20T01:53:43.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.855+0000 7f36c5df7640 1 --2- 172.21.15.79:0/4248065566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36c0102ad0 0x7f36c0198e40 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f36bc00c920 tx=0x7f36bc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:43.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.856+0000 7f36b6ffd640 1 -- 172.21.15.79:0/4248065566 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36bc007c70 con 0x7f36c0102ad0 2024-08-20T01:53:43.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.856+0000 7f36b6ffd640 1 -- 172.21.15.79:0/4248065566 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f36bc007e10 con 0x7f36c0102ad0 2024-08-20T01:53:43.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.856+0000 7f36c805b640 1 -- 172.21.15.79:0/4248065566 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36c019f1e0 con 0x7f36c0102ad0 2024-08-20T01:53:43.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.856+0000 7f36b6ffd640 1 -- 172.21.15.79:0/4248065566 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36bc018710 con 0x7f36c0102ad0 2024-08-20T01:53:43.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.856+0000 7f36c805b640 1 -- 172.21.15.79:0/4248065566 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36c01a58a0 con 0x7f36c0102ad0 2024-08-20T01:53:43.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.858+0000 7f36b6ffd640 1 -- 172.21.15.79:0/4248065566 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f36bc00f450 con 0x7f36c0102ad0 2024-08-20T01:53:43.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.858+0000 7f36ca454740 1 Processor -- start 2024-08-20T01:53:43.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.858+0000 7f36ca454740 1 -- start start 2024-08-20T01:53:43.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.859+0000 7f36ca454740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cffdcd730 0x560cffdcdb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:43.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.859+0000 7f36ca454740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cffdce050 0x560cffdd9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:43.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.859+0000 7f36ca454740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cffdd9fe0 0x560cffddc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:43.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.859+0000 7f36ca454740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560cffd44930 con 0x560cffdce050 2024-08-20T01:53:43.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.859+0000 7f36ca454740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560cffd33e30 con 0x560cffdd9fe0 2024-08-20T01:53:43.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.859+0000 7f36ca454740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560cffd37e70 con 0x560cffdcd730 2024-08-20T01:53:43.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.859+0000 7f36c5df7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cffdce050 0x560cffdd9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:43.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.859+0000 7f36c5df7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cffdce050 0x560cffdd9aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35816/0 (socket says 172.21.15.79:35816) 2024-08-20T01:53:43.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.859+0000 7f36c5df7640 1 -- 172.21.15.79:0/2554700909 learned_addr learned my addr 172.21.15.79:0/2554700909 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:43.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.859+0000 7f36c65f8640 1 --2- 172.21.15.79:0/2554700909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cffdcd730 0x560cffdcdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:43.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.859+0000 7f36c55f6640 1 --2- 172.21.15.79:0/2554700909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cffdd9fe0 0x560cffddc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:43.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.859+0000 7f36b6ffd640 1 --2- 172.21.15.79:0/4248065566 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f36ac0b3bd0 0x7f36ac0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:43.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.859+0000 7f36c5df7640 1 -- 172.21.15.79:0/2554700909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cffdcd730 msgr2=0x560cffdcdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:43.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.859+0000 7f36c5df7640 1 --2- 172.21.15.79:0/2554700909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cffdcd730 0x560cffdcdb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:43.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.859+0000 7f36c5df7640 1 -- 172.21.15.79:0/2554700909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cffdd9fe0 msgr2=0x560cffddc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:43.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.859+0000 7f36c5df7640 1 --2- 172.21.15.79:0/2554700909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cffdd9fe0 0x560cffddc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:43.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.859+0000 7f36c5df7640 1 -- 172.21.15.79:0/2554700909 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cffa93650 con 0x560cffdce050 2024-08-20T01:53:43.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.859+0000 7f36c65f8640 1 --2- 172.21.15.79:0/4248065566 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f36ac0b3bd0 0x7f36ac0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:43.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.860+0000 7f36c5df7640 1 --2- 172.21.15.79:0/2554700909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cffdce050 0x560cffdd9aa0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f36bc0b6fe0 tx=0x7f36bc0a6bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da5f196d4983d2a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:43.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.860+0000 7f36b6ffd640 1 -- 172.21.15.79:0/4248065566 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f36bc0e3dd0 con 0x7f36c0102ad0 2024-08-20T01:53:43.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.860+0000 7f36abfff640 1 -- 172.21.15.79:0/2554700909 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36bc0a66a0 con 0x560cffdce050 2024-08-20T01:53:43.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.860+0000 7f36abfff640 1 -- 172.21.15.79:0/2554700909 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f36bc0b6840 con 0x560cffdce050 2024-08-20T01:53:43.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.860+0000 7f36abfff640 1 -- 172.21.15.79:0/2554700909 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36bc0b6a30 con 0x560cffdce050 2024-08-20T01:53:43.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.860+0000 7f36c65f8640 1 --2- 172.21.15.79:0/4248065566 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f36ac0b3bd0 0x7f36ac0b6090 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f36b8005fe0 tx=0x7f36b80095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:43.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.860+0000 7f36ca454740 1 -- 172.21.15.79:0/2554700909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cffdce050 msgr2=0x560cffdd9aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:43.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.860+0000 7f36ca454740 1 --2- 172.21.15.79:0/2554700909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cffdce050 0x560cffdd9aa0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f36bc0b6fe0 tx=0x7f36bc0a6bf0 comp rx=0 tx=0).stop 2024-08-20T01:53:43.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.861+0000 7f36ca454740 1 -- 172.21.15.79:0/2554700909 shutdown_connections 2024-08-20T01:53:43.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.861+0000 7f36ca454740 1 --2- 172.21.15.79:0/2554700909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cffdd9fe0 0x560cffddc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:43.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.861+0000 7f36ca454740 1 --2- 172.21.15.79:0/2554700909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cffdce050 0x560cffdd9aa0 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:43.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.861+0000 7f36ca454740 1 --2- 172.21.15.79:0/2554700909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cffdcd730 0x560cffdcdb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:43.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.861+0000 7f36ca454740 1 -- 172.21.15.79:0/2554700909 >> 172.21.15.79:0/2554700909 conn(0x560cffdcb560 msgr2=0x560cffdcc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:43.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.861+0000 7f36ca454740 1 -- 172.21.15.79:0/2554700909 shutdown_connections 2024-08-20T01:53:43.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.861+0000 7f36ca454740 1 -- 172.21.15.79:0/2554700909 wait complete. 2024-08-20T01:53:43.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.861+0000 7f36ca454740 1 -- start start 2024-08-20T01:53:43.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.861+0000 7f36ca454740 1 Processor -- start 2024-08-20T01:53:43.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.861+0000 7f36ca454740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cffdcd730 0x560cffdd6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:43.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.862+0000 7f36ca454740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cffdce050 0x560cffdd7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:43.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.862+0000 7f36ca454740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cffdd9fe0 0x560cffdd79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:43.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.862+0000 7f36ca454740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560cffb96700 con 0x560cffdce050 2024-08-20T01:53:43.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.862+0000 7f36ca454740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560cffcba810 con 0x560cffdd9fe0 2024-08-20T01:53:43.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.862+0000 7f36ca454740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560cffddcc90 con 0x560cffdcd730 2024-08-20T01:53:43.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.862+0000 7f36ca454740 10 client.0 _ll_register_callbacks cb 0x560cffd2d700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:53:43.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.862+0000 7f36c65f8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cffdd9fe0 0x560cffdd79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:43.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.862+0000 7f36c55f6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cffdce050 0x560cffdd7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:43.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.862+0000 7f36c65f8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cffdd9fe0 0x560cffdd79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:46192/0 (socket says 172.21.15.79:46192) 2024-08-20T01:53:43.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.862+0000 7f36c65f8640 1 -- 172.21.15.79:0/2459364246 learned_addr learned my addr 172.21.15.79:0/2459364246 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:43.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.862+0000 7f36c5df7640 1 --2- 172.21.15.79:0/2459364246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cffdcd730 0x560cffdd6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:43.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.862+0000 7f36c65f8640 1 -- 172.21.15.79:0/2459364246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cffdcd730 msgr2=0x560cffdd6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:43.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.862+0000 7f36c65f8640 1 --2- 172.21.15.79:0/2459364246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cffdcd730 0x560cffdd6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:43.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.862+0000 7f36c65f8640 1 -- 172.21.15.79:0/2459364246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cffdce050 msgr2=0x560cffdd7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:43.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.862+0000 7f36c65f8640 1 --2- 172.21.15.79:0/2459364246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cffdce050 0x560cffdd7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:43.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.862+0000 7f36c65f8640 1 -- 172.21.15.79:0/2459364246 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cffde6010 con 0x560cffdd9fe0 2024-08-20T01:53:43.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.862+0000 7f36c55f6640 1 --2- 172.21.15.79:0/2459364246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cffdce050 0x560cffdd7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:53:43.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.862+0000 7f36c65f8640 1 --2- 172.21.15.79:0/2459364246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cffdd9fe0 0x560cffdd79c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f36b8003bf0 tx=0x7f36b802a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ff783d46604488e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:43.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.862+0000 7f36a97fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:53:43.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.862+0000 7f36a97fa640 1 -- 172.21.15.79:0/2459364246 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b80047c0 con 0x560cffdd9fe0 2024-08-20T01:53:43.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.862+0000 7f36a97fa640 1 -- 172.21.15.79:0/2459364246 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f36b80305c0 con 0x560cffdd9fe0 2024-08-20T01:53:43.874 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.862+0000 7f36ca454740 1 -- 172.21.15.79:0/2459364246 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560cffce3150 con 0x560cffdd9fe0 2024-08-20T01:53:43.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.863+0000 7f36a97fa640 1 -- 172.21.15.79:0/2459364246 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f36b8031780 con 0x560cffdd9fe0 2024-08-20T01:53:43.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.863+0000 7f36ca454740 10 client.28646 fetch_fsmap learned FSMap version 69 2024-08-20T01:53:43.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.863+0000 7f36ca454740 1 -- 172.21.15.79:0/2459364246 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) -- 0x560cffde89c0 con 0x560cffdd9fe0 2024-08-20T01:53:43.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.863+0000 7f36a97fa640 1 -- 172.21.15.79:0/2459364246 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x560cffce3150 con 0x560cffdd9fe0 2024-08-20T01:53:43.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.863+0000 7f36a97fa640 1 -- 172.21.15.79:0/2459364246 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 69) ==== 8366+0+0 (secure 0 0 0) 0x7f36b80534b0 con 0x560cffdd9fe0 2024-08-20T01:53:43.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.863+0000 7f36ca454740 10 client.28646 fetch_fsmap finished waiting for FSMap version 69 2024-08-20T01:53:43.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.863+0000 7f36ca454740 10 client.28646 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:53:43.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.863+0000 7f36ca454740 20 client.28646 populate_metadata read hostname 'smithi079' 2024-08-20T01:53:43.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.863+0000 7f36ca454740 1 --2- 172.21.15.79:0/2459364246 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x560cffde9e70 0x560cffdec290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:43.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.863+0000 7f36ca454740 4 client.28646 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:53:43.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.863+0000 7f36ca454740 1 -- 172.21.15.79:0/2459364246 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560cffd46880 con 0x560cffde9e70 2024-08-20T01:53:43.875 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.863+0000 7f36c5df7640 1 --2- 172.21.15.79:0/2459364246 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x560cffde9e70 0x560cffdec290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:43.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.864+0000 7f36c5df7640 1 --2- 172.21.15.79:0/2459364246 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x560cffde9e70 0x560cffdec290 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a476e1b4dfdf5190 server_cookie=bb2b8779e0eb6472 in_seq=0 out_seq=0 2024-08-20T01:53:43.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.864+0000 7f36a97fa640 10 client.28646 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:53:43.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.865+0000 7f36a97fa640 1 -- 172.21.15.79:0/2459364246 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560cffd46880 con 0x560cffde9e70 2024-08-20T01:53:43.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.865+0000 7f36a97fa640 10 client.28646 handle_command_reply: tid=0 2024-08-20T01:53:43.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.865+0000 7f36ca454740 1 client.28646 shutdown 2024-08-20T01:53:43.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.865+0000 7f36ca454740 1 -- 172.21.15.79:0/2459364246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cffdd9fe0 msgr2=0x560cffdd79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:43.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.865+0000 7f36ca454740 1 --2- 172.21.15.79:0/2459364246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cffdd9fe0 0x560cffdd79c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f36b8003bf0 tx=0x7f36b802a8c0 comp rx=0 tx=0).stop 2024-08-20T01:53:43.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.865+0000 7f36ca454740 1 -- 172.21.15.79:0/2459364246 shutdown_connections 2024-08-20T01:53:43.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.865+0000 7f36ca454740 1 --2- 172.21.15.79:0/2459364246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cffdd9fe0 0x560cffdd79c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:43.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.865+0000 7f36ca454740 1 --2- 172.21.15.79:0/2459364246 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x560cffde9e70 0x560cffdec290 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:43.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.865+0000 7f36ca454740 1 --2- 172.21.15.79:0/2459364246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cffdce050 0x560cffdd7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:43.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.865+0000 7f36ca454740 1 --2- 172.21.15.79:0/2459364246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cffdcd730 0x560cffdd6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:43.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.865+0000 7f36a97fa640 0 client.28646 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:53:43.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.865+0000 7f36ca454740 1 -- 172.21.15.79:0/2459364246 >> 172.21.15.79:0/2459364246 conn(0x560cffdcb560 msgr2=0x560cffdd10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:43.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.865+0000 7f36ca454740 1 -- 172.21.15.79:0/2459364246 shutdown_connections 2024-08-20T01:53:43.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.865+0000 7f36ca454740 1 -- 172.21.15.79:0/2459364246 wait complete. 2024-08-20T01:53:43.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.865+0000 7f36ca454740 20 client.28646 trim_cache size 0 max 16384 2024-08-20T01:53:43.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.878+0000 7f36ca454740 1 Processor -- start 2024-08-20T01:53:43.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.879+0000 7f36ca454740 1 -- start start 2024-08-20T01:53:43.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.879+0000 7f36ca454740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cffdcd730 0x560cffdca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:43.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.879+0000 7f36ca454740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cffdce050 0x560cffdf1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:43.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.879+0000 7f36ca454740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cffdd9fe0 0x560cffdf20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:43.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.879+0000 7f36ca454740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f36c01abdb0 con 0x560cffdd9fe0 2024-08-20T01:53:43.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.879+0000 7f36ca454740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f36c01ad8f0 con 0x560cffdce050 2024-08-20T01:53:43.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.879+0000 7f36ca454740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f36c01ac480 con 0x560cffdcd730 2024-08-20T01:53:43.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.879+0000 7f36c65f8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cffdd9fe0 0x560cffdf20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:43.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.879+0000 7f36c65f8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cffdd9fe0 0x560cffdf20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35840/0 (socket says 172.21.15.79:35840) 2024-08-20T01:53:43.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.879+0000 7f36c65f8640 1 -- 172.21.15.79:0/4161225755 learned_addr learned my addr 172.21.15.79:0/4161225755 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:43.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.879+0000 7f36c55f6640 1 --2- 172.21.15.79:0/4161225755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cffdce050 0x560cffdf1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:43.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.879+0000 7f36c5df7640 1 --2- 172.21.15.79:0/4161225755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cffdcd730 0x560cffdca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:43.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.879+0000 7f36c65f8640 1 -- 172.21.15.79:0/4161225755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cffdcd730 msgr2=0x560cffdca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:43.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.879+0000 7f36c65f8640 1 --2- 172.21.15.79:0/4161225755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cffdcd730 0x560cffdca3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:43.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.879+0000 7f36c65f8640 1 -- 172.21.15.79:0/4161225755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cffdce050 msgr2=0x560cffdf1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:43.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.879+0000 7f36c65f8640 1 --2- 172.21.15.79:0/4161225755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cffdce050 0x560cffdf1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:43.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.879+0000 7f36c65f8640 1 -- 172.21.15.79:0/4161225755 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cffdcbfe0 con 0x560cffdd9fe0 2024-08-20T01:53:43.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.879+0000 7f36c65f8640 1 --2- 172.21.15.79:0/4161225755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cffdd9fe0 0x560cffdf20e0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f36b8009ca0 tx=0x7f36b8031680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d807f22e033cf961 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:43.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.880+0000 7f36ab7fe640 1 -- 172.21.15.79:0/4161225755 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b8031450 con 0x560cffdd9fe0 2024-08-20T01:53:43.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.880+0000 7f36ab7fe640 1 -- 172.21.15.79:0/4161225755 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f36b804e030 con 0x560cffdd9fe0 2024-08-20T01:53:43.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.880+0000 7f36ab7fe640 1 -- 172.21.15.79:0/4161225755 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b80305c0 con 0x560cffdd9fe0 2024-08-20T01:53:43.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.880+0000 7f36ca454740 1 -- 172.21.15.79:0/4161225755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cffdd9fe0 msgr2=0x560cffdf20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:43.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.880+0000 7f36ca454740 1 --2- 172.21.15.79:0/4161225755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cffdd9fe0 0x560cffdf20e0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f36b8009ca0 tx=0x7f36b8031680 comp rx=0 tx=0).stop 2024-08-20T01:53:43.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.880+0000 7f36ca454740 1 -- 172.21.15.79:0/4161225755 shutdown_connections 2024-08-20T01:53:43.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.880+0000 7f36ca454740 1 --2- 172.21.15.79:0/4161225755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cffdd9fe0 0x560cffdf20e0 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:43.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.880+0000 7f36ca454740 1 --2- 172.21.15.79:0/4161225755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cffdce050 0x560cffdf1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:43.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.880+0000 7f36ca454740 1 --2- 172.21.15.79:0/4161225755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cffdcd730 0x560cffdca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:43.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.880+0000 7f36ca454740 1 -- 172.21.15.79:0/4161225755 >> 172.21.15.79:0/4161225755 conn(0x560cffdcb560 msgr2=0x560cffdc9cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:43.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.880+0000 7f36ca454740 1 -- 172.21.15.79:0/4161225755 shutdown_connections 2024-08-20T01:53:43.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.880+0000 7f36ca454740 1 -- 172.21.15.79:0/4161225755 wait complete. 2024-08-20T01:53:43.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.881+0000 7f36ca454740 1 -- start start 2024-08-20T01:53:43.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.881+0000 7f36ca454740 1 Processor -- start 2024-08-20T01:53:43.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.881+0000 7f36ca454740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cffdcd730 0x560cffddf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:43.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.881+0000 7f36ca454740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cffdce050 0x560cffddfa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:43.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.881+0000 7f36ca454740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cffdd9fe0 0x560cffe52b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:43.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.881+0000 7f36ca454740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f36c01ad220 con 0x560cffdcd730 2024-08-20T01:53:43.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.881+0000 7f36ca454740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f36c01acb50 con 0x560cffdd9fe0 2024-08-20T01:53:43.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.881+0000 7f36ca454740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f36c01a9d90 con 0x560cffdce050 2024-08-20T01:53:43.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.881+0000 7f36ca454740 10 client.0 _ll_register_callbacks cb 0x7f36b8009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:53:43.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.881+0000 7f36c5df7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cffdcd730 0x560cffddf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:43.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.881+0000 7f36c5df7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cffdcd730 0x560cffddf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35856/0 (socket says 172.21.15.79:35856) 2024-08-20T01:53:43.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.881+0000 7f36c5df7640 1 -- 172.21.15.79:0/4292745874 learned_addr learned my addr 172.21.15.79:0/4292745874 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:43.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.881+0000 7f36c65f8640 1 --2- 172.21.15.79:0/4292745874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cffdd9fe0 0x560cffe52b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:43.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.881+0000 7f36c55f6640 1 --2- 172.21.15.79:0/4292745874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cffdce050 0x560cffddfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:43.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.882+0000 7f36c5df7640 1 -- 172.21.15.79:0/4292745874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cffdce050 msgr2=0x560cffddfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:43.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.882+0000 7f36c5df7640 1 --2- 172.21.15.79:0/4292745874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cffdce050 0x560cffddfa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:43.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.882+0000 7f36c5df7640 1 -- 172.21.15.79:0/4292745874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cffdd9fe0 msgr2=0x560cffe52b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:43.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.882+0000 7f36c5df7640 1 --2- 172.21.15.79:0/4292745874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cffdd9fe0 0x560cffe52b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:43.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.882+0000 7f36c5df7640 1 -- 172.21.15.79:0/4292745874 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cffe530e0 con 0x560cffdcd730 2024-08-20T01:53:43.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.882+0000 7f36c65f8640 1 --2- 172.21.15.79:0/4292745874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cffdd9fe0 0x560cffe52b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:53:43.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.882+0000 7f36c5df7640 1 --2- 172.21.15.79:0/4292745874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cffdcd730 0x560cffddf4e0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f36bc0e1c50 tx=0x7f36bc00cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=556d45301bfeee19 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:43.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.882+0000 7f36a97fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:53:43.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.882+0000 7f36a97fa640 1 -- 172.21.15.79:0/4292745874 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36bc0a9f90 con 0x560cffdcd730 2024-08-20T01:53:43.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.882+0000 7f36a97fa640 1 -- 172.21.15.79:0/4292745874 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f36bc0e7680 con 0x560cffdcd730 2024-08-20T01:53:43.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.882+0000 7f36ca454740 1 -- 172.21.15.79:0/4292745874 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36b804e030 con 0x560cffdcd730 2024-08-20T01:53:43.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.882+0000 7f36a97fa640 1 -- 172.21.15.79:0/4292745874 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f36bc0aa2c0 con 0x560cffdcd730 2024-08-20T01:53:43.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.882+0000 7f36ca454740 10 client.19560 fetch_fsmap learned FSMap version 69 2024-08-20T01:53:43.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.882+0000 7f36ca454740 1 -- 172.21.15.79:0/4292745874 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) -- 0x560cffe54440 con 0x560cffdcd730 2024-08-20T01:53:43.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.882+0000 7f36a97fa640 1 -- 172.21.15.79:0/4292745874 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f36b804e030 con 0x560cffdcd730 2024-08-20T01:53:43.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.883+0000 7f36a97fa640 1 -- 172.21.15.79:0/4292745874 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 69) ==== 8366+0+0 (secure 0 0 0) 0x7f36bc0e7040 con 0x560cffdcd730 2024-08-20T01:53:43.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.883+0000 7f36ca454740 10 client.19560 fetch_fsmap finished waiting for FSMap version 69 2024-08-20T01:53:43.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.883+0000 7f36ca454740 10 client.19560 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:53:43.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.883+0000 7f36ca454740 20 client.19560 populate_metadata read hostname 'smithi079' 2024-08-20T01:53:43.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.883+0000 7f36ca454740 1 --2- 172.21.15.79:0/4292745874 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x560cffe547d0 0x560cffe56bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:43.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.883+0000 7f36ca454740 4 client.19560 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:53:43.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.883+0000 7f36ca454740 1 -- 172.21.15.79:0/4292745874 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560cffd42320 con 0x560cffe547d0 2024-08-20T01:53:43.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.883+0000 7f36c55f6640 1 --2- 172.21.15.79:0/4292745874 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x560cffe547d0 0x560cffe56bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:43.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.883+0000 7f36c55f6640 1 --2- 172.21.15.79:0/4292745874 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x560cffe547d0 0x560cffe56bc0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fd1a471e1c010013 server_cookie=f6dbc689d22412f in_seq=0 out_seq=0 2024-08-20T01:53:43.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.883+0000 7f36a97fa640 10 client.19560 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:53:43.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.884+0000 7f36a97fa640 1 -- 172.21.15.79:0/4292745874 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560cffd42320 con 0x560cffe547d0 2024-08-20T01:53:43.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.884+0000 7f36a97fa640 10 client.19560 handle_command_reply: tid=0 2024-08-20T01:53:43.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.884+0000 7f36ca454740 1 client.19560 shutdown 2024-08-20T01:53:43.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.884+0000 7f36ca454740 1 -- 172.21.15.79:0/4292745874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cffdcd730 msgr2=0x560cffddf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:43.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.884+0000 7f36ca454740 1 --2- 172.21.15.79:0/4292745874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cffdcd730 0x560cffddf4e0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f36bc0e1c50 tx=0x7f36bc00cf10 comp rx=0 tx=0).stop 2024-08-20T01:53:43.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.884+0000 7f36ca454740 1 -- 172.21.15.79:0/4292745874 shutdown_connections 2024-08-20T01:53:43.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.884+0000 7f36ca454740 1 --2- 172.21.15.79:0/4292745874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560cffdd9fe0 0x560cffe52b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:43.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.884+0000 7f36ca454740 1 --2- 172.21.15.79:0/4292745874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560cffdce050 0x560cffddfa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:43.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.884+0000 7f36ca454740 1 --2- 172.21.15.79:0/4292745874 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x560cffe547d0 0x560cffe56bc0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:43.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.884+0000 7f36ca454740 1 --2- 172.21.15.79:0/4292745874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560cffdcd730 0x560cffddf4e0 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:43.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.884+0000 7f36a97fa640 0 client.19560 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:53:43.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.884+0000 7f36ca454740 1 -- 172.21.15.79:0/4292745874 >> 172.21.15.79:0/4292745874 conn(0x560cffdcb560 msgr2=0x560cffdca4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:43.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.884+0000 7f36ca454740 1 -- 172.21.15.79:0/4292745874 shutdown_connections 2024-08-20T01:53:43.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.884+0000 7f36ca454740 1 -- 172.21.15.79:0/4292745874 wait complete. 2024-08-20T01:53:43.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.884+0000 7f36ca454740 20 client.19560 trim_cache size 0 max 16384 2024-08-20T01:53:43.893 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:53:43.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.884+0000 7f36c805b640 1 -- 172.21.15.79:0/4248065566 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f36ac0b3bd0 msgr2=0x7f36ac0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:43.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.884+0000 7f36c805b640 1 --2- 172.21.15.79:0/4248065566 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f36ac0b3bd0 0x7f36ac0b6090 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f36b8005fe0 tx=0x7f36b80095c0 comp rx=0 tx=0).stop 2024-08-20T01:53:43.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.884+0000 7f36c805b640 1 -- 172.21.15.79:0/4248065566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36c0102ad0 msgr2=0x7f36c0198e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:43.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.884+0000 7f36c805b640 1 --2- 172.21.15.79:0/4248065566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36c0102ad0 0x7f36c0198e40 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f36bc00c920 tx=0x7f36bc00cde0 comp rx=0 tx=0).stop 2024-08-20T01:53:43.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.885+0000 7f36c805b640 1 -- 172.21.15.79:0/4248065566 shutdown_connections 2024-08-20T01:53:43.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.885+0000 7f36c805b640 1 --2- 172.21.15.79:0/4248065566 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f36ac0b3bd0 0x7f36ac0b6090 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:43.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.885+0000 7f36c805b640 1 --2- 172.21.15.79:0/4248065566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36c0108e60 0x7f36c019e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:43.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.885+0000 7f36c805b640 1 --2- 172.21.15.79:0/4248065566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36c01084e0 0x7f36c0199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:43.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.885+0000 7f36c805b640 1 --2- 172.21.15.79:0/4248065566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36c0102ad0 0x7f36c0198e40 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:43.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.885+0000 7f36c805b640 1 -- 172.21.15.79:0/4248065566 >> 172.21.15.79:0/4248065566 conn(0x7f36c00fe540 msgr2=0x7f36c00fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:43.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.885+0000 7f36c805b640 1 -- 172.21.15.79:0/4248065566 shutdown_connections 2024-08-20T01:53:43.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:43.885+0000 7f36c805b640 1 -- 172.21.15.79:0/4248065566 wait complete. 2024-08-20T01:53:44.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:44 smithi175 ceph-mon[22392]: pgmap v839: 97 pgs: 97 active+clean; 6.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 KiB/s wr, 19 op/s 2024-08-20T01:53:44.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:44 smithi079 ceph-mon[18656]: pgmap v839: 97 pgs: 97 active+clean; 6.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 KiB/s wr, 19 op/s 2024-08-20T01:53:44.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:44 smithi081 ceph-mon[22209]: pgmap v839: 97 pgs: 97 active+clean; 6.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 KiB/s wr, 19 op/s 2024-08-20T01:53:44.690 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T01:53:44.939 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:53:45.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.433+0000 7f0ef1a23640 1 -- 172.21.15.79:0/66713974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0eec108e20 msgr2=0x7f0eec10f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:45.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.433+0000 7f0ef1a23640 1 --2- 172.21.15.79:0/66713974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0eec108e20 0x7f0eec10f620 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4009ca0 tx=0x7f0ee402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:53:45.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.433+0000 7f0ef1a23640 1 -- 172.21.15.79:0/66713974 shutdown_connections 2024-08-20T01:53:45.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.433+0000 7f0ef1a23640 1 --2- 172.21.15.79:0/66713974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0eec108e20 0x7f0eec10f620 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:45.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.433+0000 7f0ef1a23640 1 --2- 172.21.15.79:0/66713974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0eec1084a0 0x7f0eec1088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:45.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.433+0000 7f0ef1a23640 1 --2- 172.21.15.79:0/66713974 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0eec102a90 0x7f0eec102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:45.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.433+0000 7f0ef1a23640 1 -- 172.21.15.79:0/66713974 >> 172.21.15.79:0/66713974 conn(0x7f0eec0fe540 msgr2=0x7f0eec100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:45.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.433+0000 7f0ef1a23640 1 -- 172.21.15.79:0/66713974 shutdown_connections 2024-08-20T01:53:45.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.433+0000 7f0ef1a23640 1 -- 172.21.15.79:0/66713974 wait complete. 2024-08-20T01:53:45.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.434+0000 7f0ef1a23640 1 Processor -- start 2024-08-20T01:53:45.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.434+0000 7f0ef1a23640 1 -- start start 2024-08-20T01:53:45.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.434+0000 7f0ef1a23640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0eec102a90 0x7f0eec0751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:45.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.434+0000 7f0ef1a23640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0eec1084a0 0x7f0eec075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:45.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.434+0000 7f0ef1a23640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0eec108e20 0x7f0eec075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:45.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.434+0000 7f0ef1a23640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0eec1129e0 con 0x7f0eec108e20 2024-08-20T01:53:45.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.434+0000 7f0ef1a23640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0eec112860 con 0x7f0eec1084a0 2024-08-20T01:53:45.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.434+0000 7f0ef1a23640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0eec112b60 con 0x7f0eec102a90 2024-08-20T01:53:45.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.435+0000 7f0eeb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0eec108e20 0x7f0eec075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:45.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.435+0000 7f0eea7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0eec1084a0 0x7f0eec075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:45.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.435+0000 7f0eeb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0eec108e20 0x7f0eec075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35878/0 (socket says 172.21.15.79:35878) 2024-08-20T01:53:45.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.435+0000 7f0eeaffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0eec102a90 0x7f0eec0751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:45.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.435+0000 7f0eea7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0eec1084a0 0x7f0eec075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:46242/0 (socket says 172.21.15.79:46242) 2024-08-20T01:53:45.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.435+0000 7f0eeb7fe640 1 -- 172.21.15.79:0/661361458 learned_addr learned my addr 172.21.15.79:0/661361458 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:45.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.435+0000 7f0eea7fc640 1 -- 172.21.15.79:0/661361458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0eec102a90 msgr2=0x7f0eec0751d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:45.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.435+0000 7f0eea7fc640 1 --2- 172.21.15.79:0/661361458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0eec102a90 0x7f0eec0751d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:45.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.435+0000 7f0eea7fc640 1 -- 172.21.15.79:0/661361458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0eec108e20 msgr2=0x7f0eec075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:45.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.435+0000 7f0eea7fc640 1 --2- 172.21.15.79:0/661361458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0eec108e20 0x7f0eec075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:45.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.435+0000 7f0eea7fc640 1 -- 172.21.15.79:0/661361458 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eec1a72d0 con 0x7f0eec1084a0 2024-08-20T01:53:45.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.435+0000 7f0eea7fc640 1 --2- 172.21.15.79:0/661361458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0eec1084a0 0x7f0eec075710 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0ee000e9f0 tx=0x7f0ee000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:45.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.435+0000 7f0ef0a21640 1 -- 172.21.15.79:0/661361458 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee000ccc0 con 0x7f0eec1084a0 2024-08-20T01:53:45.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.435+0000 7f0ef0a21640 1 -- 172.21.15.79:0/661361458 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0ee00108c0 con 0x7f0eec1084a0 2024-08-20T01:53:45.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.435+0000 7f0ef0a21640 1 -- 172.21.15.79:0/661361458 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee00187e0 con 0x7f0eec1084a0 2024-08-20T01:53:45.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.435+0000 7f0ef1a23640 1 -- 172.21.15.79:0/661361458 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0eec1a75c0 con 0x7f0eec1084a0 2024-08-20T01:53:45.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.435+0000 7f0ef1a23640 1 -- 172.21.15.79:0/661361458 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0eec1a7b50 con 0x7f0eec1084a0 2024-08-20T01:53:45.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.437+0000 7f0ef0a21640 1 -- 172.21.15.79:0/661361458 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f0ee0010430 con 0x7f0eec1084a0 2024-08-20T01:53:45.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.438+0000 7f0ef3e1c740 1 Processor -- start 2024-08-20T01:53:45.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.438+0000 7f0ef3e1c740 1 -- start start 2024-08-20T01:53:45.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.438+0000 7f0ef3e1c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b652f9880 0x564b652f9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:45.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.438+0000 7f0ef3e1c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b652fa1a0 0x564b65305bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:45.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.438+0000 7f0ef3e1c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b65306130 0x564b65308520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:45.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.438+0000 7f0ef3e1c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564b65270930 con 0x564b65306130 2024-08-20T01:53:45.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.438+0000 7f0ef3e1c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564b6525fe30 con 0x564b652fa1a0 2024-08-20T01:53:45.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.438+0000 7f0ef3e1c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564b65263e70 con 0x564b652f9880 2024-08-20T01:53:45.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.438+0000 7f0eea7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b65306130 0x564b65308520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:45.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.438+0000 7f0eeb7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b652f9880 0x564b652f9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:45.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.438+0000 7f0eeaffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b652fa1a0 0x564b65305bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:45.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.438+0000 7f0eea7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b65306130 0x564b65308520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35892/0 (socket says 172.21.15.79:35892) 2024-08-20T01:53:45.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.438+0000 7f0eeb7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b652f9880 0x564b652f9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:48836/0 (socket says 172.21.15.79:48836) 2024-08-20T01:53:45.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.438+0000 7f0eea7fc640 1 -- 172.21.15.79:0/3171321213 learned_addr learned my addr 172.21.15.79:0/3171321213 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:45.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.438+0000 7f0ef0a21640 1 --2- 172.21.15.79:0/661361458 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0ed40b3c50 0x7f0ed40b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:45.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.438+0000 7f0eeaffd640 1 -- 172.21.15.79:0/3171321213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b652f9880 msgr2=0x564b652f9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:45.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.438+0000 7f0eeb7fe640 1 --2- 172.21.15.79:0/661361458 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0ed40b3c50 0x7f0ed40b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:45.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.438+0000 7f0eeaffd640 1 --2- 172.21.15.79:0/3171321213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b652f9880 0x564b652f9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:45.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.438+0000 7f0eeaffd640 1 -- 172.21.15.79:0/3171321213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b65306130 msgr2=0x564b65308520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:45.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.438+0000 7f0eeaffd640 1 --2- 172.21.15.79:0/3171321213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b65306130 0x564b65308520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:45.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.438+0000 7f0eeaffd640 1 -- 172.21.15.79:0/3171321213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b64fbf650 con 0x564b652fa1a0 2024-08-20T01:53:45.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.439+0000 7f0ef0a21640 1 -- 172.21.15.79:0/661361458 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f0ee00e3db0 con 0x7f0eec1084a0 2024-08-20T01:53:45.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.439+0000 7f0eeaffd640 1 --2- 172.21.15.79:0/3171321213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b652fa1a0 0x564b65305bf0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0edc009c00 tx=0x7f0edc011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=837743d90833fa1f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:45.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.439+0000 7f0eeb7fe640 1 --2- 172.21.15.79:0/661361458 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0ed40b3c50 0x7f0ed40b6110 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4031040 tx=0x7f0ee402a8c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:45.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.439+0000 7f0ed1ffb640 1 -- 172.21.15.79:0/3171321213 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0edc004230 con 0x564b652fa1a0 2024-08-20T01:53:45.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.439+0000 7f0ed1ffb640 1 -- 172.21.15.79:0/3171321213 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0edc0043d0 con 0x564b652fa1a0 2024-08-20T01:53:45.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.439+0000 7f0ed1ffb640 1 -- 172.21.15.79:0/3171321213 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0edc004bc0 con 0x564b652fa1a0 2024-08-20T01:53:45.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.440+0000 7f0ef3e1c740 1 -- 172.21.15.79:0/3171321213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b652fa1a0 msgr2=0x564b65305bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:45.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.440+0000 7f0ef3e1c740 1 --2- 172.21.15.79:0/3171321213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b652fa1a0 0x564b65305bf0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0edc009c00 tx=0x7f0edc011810 comp rx=0 tx=0).stop 2024-08-20T01:53:45.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.440+0000 7f0ef3e1c740 1 -- 172.21.15.79:0/3171321213 shutdown_connections 2024-08-20T01:53:45.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.440+0000 7f0ef3e1c740 1 --2- 172.21.15.79:0/3171321213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b65306130 0x564b65308520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:45.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.440+0000 7f0ef3e1c740 1 --2- 172.21.15.79:0/3171321213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b652fa1a0 0x564b65305bf0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:45.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.440+0000 7f0ef3e1c740 1 --2- 172.21.15.79:0/3171321213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b652f9880 0x564b652f9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:45.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.440+0000 7f0ef3e1c740 1 -- 172.21.15.79:0/3171321213 >> 172.21.15.79:0/3171321213 conn(0x564b652f76b0 msgr2=0x564b652f8850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:45.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.440+0000 7f0ef3e1c740 1 -- 172.21.15.79:0/3171321213 shutdown_connections 2024-08-20T01:53:45.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.440+0000 7f0ef3e1c740 1 -- 172.21.15.79:0/3171321213 wait complete. 2024-08-20T01:53:45.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.440+0000 7f0ef3e1c740 1 -- start start 2024-08-20T01:53:45.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.440+0000 7f0ef3e1c740 1 Processor -- start 2024-08-20T01:53:45.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.441+0000 7f0ef3e1c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b652f9880 0x564b65305ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:45.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.441+0000 7f0ef3e1c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b652fa1a0 0x564b65302ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:45.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.441+0000 7f0ef3e1c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b65306130 0x564b65303780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:45.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.441+0000 7f0ef3e1c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564b650c2700 con 0x564b65306130 2024-08-20T01:53:45.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.441+0000 7f0ef3e1c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564b651e6810 con 0x564b652f9880 2024-08-20T01:53:45.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.441+0000 7f0ef3e1c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564b65308de0 con 0x564b652fa1a0 2024-08-20T01:53:45.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.441+0000 7f0ef3e1c740 10 client.0 _ll_register_callbacks cb 0x564b65259700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:53:45.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.441+0000 7f0eeb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b65306130 0x564b65303780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:45.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.441+0000 7f0eeb7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b65306130 0x564b65303780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35908/0 (socket says 172.21.15.79:35908) 2024-08-20T01:53:45.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.441+0000 7f0eea7fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b652fa1a0 0x564b65302ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:45.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.441+0000 7f0eeb7fe640 1 -- 172.21.15.79:0/905374710 learned_addr learned my addr 172.21.15.79:0/905374710 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:45.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.441+0000 7f0eeaffd640 1 --2- 172.21.15.79:0/905374710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b652f9880 0x564b65305ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:45.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.441+0000 7f0eea7fc640 1 -- 172.21.15.79:0/905374710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b652f9880 msgr2=0x564b65305ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:45.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.441+0000 7f0eea7fc640 1 --2- 172.21.15.79:0/905374710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b652f9880 0x564b65305ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:45.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.441+0000 7f0eea7fc640 1 -- 172.21.15.79:0/905374710 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b65306130 msgr2=0x564b65303780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:45.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.441+0000 7f0eea7fc640 1 --2- 172.21.15.79:0/905374710 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b65306130 0x564b65303780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:45.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.441+0000 7f0eea7fc640 1 -- 172.21.15.79:0/905374710 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b65312110 con 0x564b652fa1a0 2024-08-20T01:53:45.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.441+0000 7f0eeb7fe640 1 --2- 172.21.15.79:0/905374710 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b65306130 0x564b65303780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:53:45.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.441+0000 7f0eea7fc640 1 --2- 172.21.15.79:0/905374710 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b652fa1a0 0x564b65302ff0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0ee00e1c30 tx=0x7f0ee00e7480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0507f220855d776 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:45.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.441+0000 7f0ecaffd640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:53:45.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.442+0000 7f0ecaffd640 1 -- 172.21.15.79:0/905374710 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee0010720 con 0x564b652fa1a0 2024-08-20T01:53:45.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.442+0000 7f0ecaffd640 1 -- 172.21.15.79:0/905374710 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f0ee00b3b30 con 0x564b652fa1a0 2024-08-20T01:53:45.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.442+0000 7f0ef3e1c740 1 -- 172.21.15.79:0/905374710 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564b6520f150 con 0x564b652fa1a0 2024-08-20T01:53:45.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.442+0000 7f0ecaffd640 1 -- 172.21.15.79:0/905374710 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f0ee00aa8d0 con 0x564b652fa1a0 2024-08-20T01:53:45.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.442+0000 7f0ef3e1c740 10 client.28555 fetch_fsmap learned FSMap version 69 2024-08-20T01:53:45.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.442+0000 7f0ef3e1c740 1 -- 172.21.15.79:0/905374710 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) -- 0x564b65314a70 con 0x564b652fa1a0 2024-08-20T01:53:45.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.442+0000 7f0ecaffd640 1 -- 172.21.15.79:0/905374710 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x564b6520f150 con 0x564b652fa1a0 2024-08-20T01:53:45.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.442+0000 7f0ecaffd640 1 -- 172.21.15.79:0/905374710 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 69) ==== 8366+0+0 (secure 0 0 0) 0x7f0ee00a60d0 con 0x564b652fa1a0 2024-08-20T01:53:45.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.442+0000 7f0ef3e1c740 10 client.28555 fetch_fsmap finished waiting for FSMap version 69 2024-08-20T01:53:45.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.442+0000 7f0ef3e1c740 10 client.28555 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:53:45.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.442+0000 7f0ef3e1c740 20 client.28555 populate_metadata read hostname 'smithi079' 2024-08-20T01:53:45.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.442+0000 7f0ef3e1c740 1 --2- 172.21.15.79:0/905374710 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x564b65315f80 0x564b653183a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:45.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.442+0000 7f0ef3e1c740 4 client.28555 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:53:45.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.442+0000 7f0ef3e1c740 1 -- 172.21.15.79:0/905374710 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b65272880 con 0x564b65315f80 2024-08-20T01:53:45.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.442+0000 7f0eeaffd640 1 --2- 172.21.15.79:0/905374710 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x564b65315f80 0x564b653183a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:45.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.443+0000 7f0ecaffd640 10 client.28555 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:53:45.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.443+0000 7f0eeaffd640 1 --2- 172.21.15.79:0/905374710 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x564b65315f80 0x564b653183a0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=56eaea6555db1198 server_cookie=7afac17ddd812ed0 in_seq=0 out_seq=0 2024-08-20T01:53:45.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.443+0000 7f0ecaffd640 1 -- 172.21.15.79:0/905374710 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564b65272880 con 0x564b65315f80 2024-08-20T01:53:45.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.443+0000 7f0ecaffd640 10 client.28555 handle_command_reply: tid=0 2024-08-20T01:53:45.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.443+0000 7f0ef3e1c740 1 client.28555 shutdown 2024-08-20T01:53:45.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.444+0000 7f0ef3e1c740 1 -- 172.21.15.79:0/905374710 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b652fa1a0 msgr2=0x564b65302ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:45.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.444+0000 7f0ef3e1c740 1 --2- 172.21.15.79:0/905374710 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b652fa1a0 0x564b65302ff0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0ee00e1c30 tx=0x7f0ee00e7480 comp rx=0 tx=0).stop 2024-08-20T01:53:45.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.444+0000 7f0ef3e1c740 1 -- 172.21.15.79:0/905374710 shutdown_connections 2024-08-20T01:53:45.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.444+0000 7f0ef3e1c740 1 --2- 172.21.15.79:0/905374710 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b65306130 0x564b65303780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:45.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.444+0000 7f0ef3e1c740 1 --2- 172.21.15.79:0/905374710 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b652fa1a0 0x564b65302ff0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:45.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.444+0000 7f0ef3e1c740 1 --2- 172.21.15.79:0/905374710 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x564b65315f80 0x564b653183a0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:45.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.444+0000 7f0ef3e1c740 1 --2- 172.21.15.79:0/905374710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b652f9880 0x564b65305ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:45.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.444+0000 7f0ecaffd640 0 client.28555 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:53:45.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.444+0000 7f0ef3e1c740 1 -- 172.21.15.79:0/905374710 >> 172.21.15.79:0/905374710 conn(0x564b652f76b0 msgr2=0x564b652fd250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:45.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.444+0000 7f0ef3e1c740 1 -- 172.21.15.79:0/905374710 shutdown_connections 2024-08-20T01:53:45.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.444+0000 7f0ef3e1c740 1 -- 172.21.15.79:0/905374710 wait complete. 2024-08-20T01:53:45.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.444+0000 7f0ef3e1c740 20 client.28555 trim_cache size 0 max 16384 2024-08-20T01:53:45.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.457+0000 7f0ef3e1c740 1 Processor -- start 2024-08-20T01:53:45.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.457+0000 7f0ef3e1c740 1 -- start start 2024-08-20T01:53:45.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.457+0000 7f0ef3e1c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b652f9880 0x564b65308590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:45.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.457+0000 7f0ef3e1c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b652fa1a0 0x564b652f8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:45.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.457+0000 7f0ef3e1c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b65306130 0x564b6531dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:45.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.457+0000 7f0ef3e1c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0eec1b0210 con 0x564b652fa1a0 2024-08-20T01:53:45.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.457+0000 7f0ef3e1c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0eec1b1d50 con 0x564b652f9880 2024-08-20T01:53:45.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.457+0000 7f0ef3e1c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0eec1b08e0 con 0x564b65306130 2024-08-20T01:53:45.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.457+0000 7f0eea7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b652fa1a0 0x564b652f8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:45.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.457+0000 7f0eea7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b652fa1a0 0x564b652f8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35920/0 (socket says 172.21.15.79:35920) 2024-08-20T01:53:45.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.457+0000 7f0eea7fc640 1 -- 172.21.15.79:0/4178088626 learned_addr learned my addr 172.21.15.79:0/4178088626 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:45.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.457+0000 7f0eeb7fe640 1 --2- 172.21.15.79:0/4178088626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b65306130 0x564b6531dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:45.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.457+0000 7f0eeaffd640 1 --2- 172.21.15.79:0/4178088626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b652f9880 0x564b65308590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:45.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.457+0000 7f0eea7fc640 1 -- 172.21.15.79:0/4178088626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b65306130 msgr2=0x564b6531dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:45.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.457+0000 7f0eea7fc640 1 --2- 172.21.15.79:0/4178088626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b65306130 0x564b6531dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:45.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.457+0000 7f0eea7fc640 1 -- 172.21.15.79:0/4178088626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b652f9880 msgr2=0x564b65308590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:45.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.457+0000 7f0eea7fc640 1 --2- 172.21.15.79:0/4178088626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b652f9880 0x564b65308590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:45.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.457+0000 7f0eea7fc640 1 -- 172.21.15.79:0/4178088626 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b653014f0 con 0x564b652fa1a0 2024-08-20T01:53:45.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.457+0000 7f0eea7fc640 1 --2- 172.21.15.79:0/4178088626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b652fa1a0 0x564b652f8e10 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f0ee000e9c0 tx=0x7f0ee00a6d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52296fa6f41e1626 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:45.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.458+0000 7f0ed17fa640 1 -- 172.21.15.79:0/4178088626 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee00de070 con 0x564b652fa1a0 2024-08-20T01:53:45.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.458+0000 7f0ed17fa640 1 -- 172.21.15.79:0/4178088626 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0ee00a6240 con 0x564b652fa1a0 2024-08-20T01:53:45.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.458+0000 7f0ed17fa640 1 -- 172.21.15.79:0/4178088626 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee00b3b90 con 0x564b652fa1a0 2024-08-20T01:53:45.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.458+0000 7f0ef3e1c740 1 -- 172.21.15.79:0/4178088626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b652fa1a0 msgr2=0x564b652f8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:45.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.458+0000 7f0ef3e1c740 1 --2- 172.21.15.79:0/4178088626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b652fa1a0 0x564b652f8e10 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f0ee000e9c0 tx=0x7f0ee00a6d30 comp rx=0 tx=0).stop 2024-08-20T01:53:45.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.458+0000 7f0ef3e1c740 1 -- 172.21.15.79:0/4178088626 shutdown_connections 2024-08-20T01:53:45.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.458+0000 7f0ef3e1c740 1 --2- 172.21.15.79:0/4178088626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b65306130 0x564b6531dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:45.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.458+0000 7f0ef3e1c740 1 --2- 172.21.15.79:0/4178088626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b652fa1a0 0x564b652f8e10 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:45.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.458+0000 7f0ef3e1c740 1 --2- 172.21.15.79:0/4178088626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b652f9880 0x564b65308590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:45.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.458+0000 7f0ef3e1c740 1 -- 172.21.15.79:0/4178088626 >> 172.21.15.79:0/4178088626 conn(0x564b652f76b0 msgr2=0x564b652f8700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:45.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.458+0000 7f0ef3e1c740 1 -- 172.21.15.79:0/4178088626 shutdown_connections 2024-08-20T01:53:45.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.458+0000 7f0ef3e1c740 1 -- 172.21.15.79:0/4178088626 wait complete. 2024-08-20T01:53:45.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.459+0000 7f0ef3e1c740 1 -- start start 2024-08-20T01:53:45.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.459+0000 7f0ef3e1c740 1 Processor -- start 2024-08-20T01:53:45.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.459+0000 7f0ef3e1c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b652f9880 0x564b653099a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:45.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.459+0000 7f0ef3e1c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b652fa1a0 0x564b65309f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:45.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.459+0000 7f0ef3e1c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b65306130 0x564b65378cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:45.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.459+0000 7f0ef3e1c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0eec1b1680 con 0x564b652fa1a0 2024-08-20T01:53:45.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.459+0000 7f0ef3e1c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0eec1b0fb0 con 0x564b65306130 2024-08-20T01:53:45.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.459+0000 7f0ef3e1c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0eec1ae1f0 con 0x564b652f9880 2024-08-20T01:53:45.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.459+0000 7f0ef3e1c740 10 client.0 _ll_register_callbacks cb 0x7f0ee00aab90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:53:45.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.459+0000 7f0eea7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b652fa1a0 0x564b65309f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:45.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.459+0000 7f0eeaffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b652f9880 0x564b653099a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:45.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.459+0000 7f0eea7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b652fa1a0 0x564b65309f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35924/0 (socket says 172.21.15.79:35924) 2024-08-20T01:53:45.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.459+0000 7f0eea7fc640 1 -- 172.21.15.79:0/828311059 learned_addr learned my addr 172.21.15.79:0/828311059 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:45.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.459+0000 7f0eeb7fe640 1 --2- 172.21.15.79:0/828311059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b65306130 0x564b65378cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:45.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.460+0000 7f0eeaffd640 1 -- 172.21.15.79:0/828311059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b65306130 msgr2=0x564b65378cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:45.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.460+0000 7f0eeaffd640 1 --2- 172.21.15.79:0/828311059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b65306130 0x564b65378cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:45.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.460+0000 7f0eeaffd640 1 -- 172.21.15.79:0/828311059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b652fa1a0 msgr2=0x564b65309f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:45.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.460+0000 7f0eeaffd640 1 --2- 172.21.15.79:0/828311059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b652fa1a0 0x564b65309f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:45.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.460+0000 7f0eeaffd640 1 -- 172.21.15.79:0/828311059 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b653793f0 con 0x564b652f9880 2024-08-20T01:53:45.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.460+0000 7f0eea7fc640 1 --2- 172.21.15.79:0/828311059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b652fa1a0 0x564b65309f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:53:45.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.460+0000 7f0eeaffd640 1 --2- 172.21.15.79:0/828311059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b652f9880 0x564b653099a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0edc011d10 tx=0x7f0edc011e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96984eb0f84db82e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:45.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.460+0000 7f0ecaffd640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:53:45.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.460+0000 7f0ecaffd640 1 -- 172.21.15.79:0/828311059 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0edc01e040 con 0x564b652f9880 2024-08-20T01:53:45.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.460+0000 7f0ecaffd640 1 -- 172.21.15.79:0/828311059 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f0edc009780 con 0x564b652f9880 2024-08-20T01:53:45.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.460+0000 7f0ef3e1c740 1 -- 172.21.15.79:0/828311059 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ee00a6240 con 0x564b652f9880 2024-08-20T01:53:45.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.460+0000 7f0ecaffd640 1 -- 172.21.15.79:0/828311059 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f0edc004140 con 0x564b652f9880 2024-08-20T01:53:45.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.460+0000 7f0ef3e1c740 10 client.28561 fetch_fsmap learned FSMap version 69 2024-08-20T01:53:45.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.460+0000 7f0ef3e1c740 1 -- 172.21.15.79:0/828311059 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) -- 0x564b65380870 con 0x564b652f9880 2024-08-20T01:53:45.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.461+0000 7f0ecaffd640 1 -- 172.21.15.79:0/828311059 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0ee00a6240 con 0x564b652f9880 2024-08-20T01:53:45.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.461+0000 7f0ecaffd640 1 -- 172.21.15.79:0/828311059 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 69) ==== 8366+0+0 (secure 0 0 0) 0x7f0edc018070 con 0x564b652f9880 2024-08-20T01:53:45.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.461+0000 7f0ef3e1c740 10 client.28561 fetch_fsmap finished waiting for FSMap version 69 2024-08-20T01:53:45.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.461+0000 7f0ef3e1c740 10 client.28561 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:53:45.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.461+0000 7f0ef3e1c740 20 client.28561 populate_metadata read hostname 'smithi079' 2024-08-20T01:53:45.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.461+0000 7f0ef3e1c740 1 --2- 172.21.15.79:0/828311059 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x564b65380eb0 0x564b653832d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:45.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.461+0000 7f0ef3e1c740 4 client.28561 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:53:45.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.461+0000 7f0ef3e1c740 1 -- 172.21.15.79:0/828311059 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564b652f2880 con 0x564b65380eb0 2024-08-20T01:53:45.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.461+0000 7f0eea7fc640 1 --2- 172.21.15.79:0/828311059 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x564b65380eb0 0x564b653832d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:45.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.461+0000 7f0ecaffd640 10 client.28561 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:53:45.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.461+0000 7f0eea7fc640 1 --2- 172.21.15.79:0/828311059 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x564b65380eb0 0x564b653832d0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=25689cd4587e7af3 server_cookie=d8586598c58e17a2 in_seq=0 out_seq=0 2024-08-20T01:53:45.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.461+0000 7f0ecaffd640 1 -- 172.21.15.79:0/828311059 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564b652f2880 con 0x564b65380eb0 2024-08-20T01:53:45.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.461+0000 7f0ecaffd640 10 client.28561 handle_command_reply: tid=0 2024-08-20T01:53:45.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.461+0000 7f0ef3e1c740 1 client.28561 shutdown 2024-08-20T01:53:45.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.462+0000 7f0ef3e1c740 1 -- 172.21.15.79:0/828311059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b652f9880 msgr2=0x564b653099a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:45.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.462+0000 7f0ef3e1c740 1 --2- 172.21.15.79:0/828311059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b652f9880 0x564b653099a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0edc011d10 tx=0x7f0edc011e50 comp rx=0 tx=0).stop 2024-08-20T01:53:45.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.462+0000 7f0ef3e1c740 1 -- 172.21.15.79:0/828311059 shutdown_connections 2024-08-20T01:53:45.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.462+0000 7f0ef3e1c740 1 --2- 172.21.15.79:0/828311059 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x564b65380eb0 0x564b653832d0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:45.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.462+0000 7f0ef3e1c740 1 --2- 172.21.15.79:0/828311059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b65306130 0x564b65378cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:45.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.462+0000 7f0ef3e1c740 1 --2- 172.21.15.79:0/828311059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564b652fa1a0 0x564b65309f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:45.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.462+0000 7f0ecaffd640 0 client.28561 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:53:45.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.462+0000 7f0ef3e1c740 1 --2- 172.21.15.79:0/828311059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b652f9880 0x564b653099a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:45.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.462+0000 7f0ef3e1c740 1 -- 172.21.15.79:0/828311059 >> 172.21.15.79:0/828311059 conn(0x564b652f76b0 msgr2=0x564b652f5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:45.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.462+0000 7f0ef3e1c740 1 -- 172.21.15.79:0/828311059 shutdown_connections 2024-08-20T01:53:45.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.462+0000 7f0ef3e1c740 1 -- 172.21.15.79:0/828311059 wait complete. 2024-08-20T01:53:45.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.462+0000 7f0ef3e1c740 20 client.28561 trim_cache size 0 max 16384 2024-08-20T01:53:45.481 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:53:45.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.462+0000 7f0ef1a23640 1 -- 172.21.15.79:0/661361458 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0ed40b3c50 msgr2=0x7f0ed40b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:45.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.462+0000 7f0ef1a23640 1 --2- 172.21.15.79:0/661361458 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0ed40b3c50 0x7f0ed40b6110 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4031040 tx=0x7f0ee402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:53:45.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.462+0000 7f0ef1a23640 1 -- 172.21.15.79:0/661361458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0eec1084a0 msgr2=0x7f0eec075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:45.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.462+0000 7f0ef1a23640 1 --2- 172.21.15.79:0/661361458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0eec1084a0 0x7f0eec075710 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0ee000e9f0 tx=0x7f0ee000eeb0 comp rx=0 tx=0).stop 2024-08-20T01:53:45.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.462+0000 7f0ef1a23640 1 -- 172.21.15.79:0/661361458 shutdown_connections 2024-08-20T01:53:45.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.462+0000 7f0ef1a23640 1 --2- 172.21.15.79:0/661361458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0eec108e20 0x7f0eec075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:45.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.462+0000 7f0ef1a23640 1 --2- 172.21.15.79:0/661361458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0eec1084a0 0x7f0eec075710 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:45.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.462+0000 7f0ef1a23640 1 --2- 172.21.15.79:0/661361458 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0ed40b3c50 0x7f0ed40b6110 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:45.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.462+0000 7f0ef1a23640 1 --2- 172.21.15.79:0/661361458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0eec102a90 0x7f0eec0751d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:45.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.462+0000 7f0ef1a23640 1 -- 172.21.15.79:0/661361458 >> 172.21.15.79:0/661361458 conn(0x7f0eec0fe540 msgr2=0x7f0eec100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:45.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.463+0000 7f0ef1a23640 1 -- 172.21.15.79:0/661361458 shutdown_connections 2024-08-20T01:53:45.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:45.463+0000 7f0ef1a23640 1 -- 172.21.15.79:0/661361458 wait complete. 2024-08-20T01:53:46.166 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T01:53:46.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:46 smithi175 ceph-mon[22392]: pgmap v840: 97 pgs: 97 active+clean; 6.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.9 KiB/s wr, 22 op/s 2024-08-20T01:53:46.423 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:53:46.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:46 smithi079 ceph-mon[18656]: pgmap v840: 97 pgs: 97 active+clean; 6.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.9 KiB/s wr, 22 op/s 2024-08-20T01:53:46.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:46 smithi081 ceph-mon[22209]: pgmap v840: 97 pgs: 97 active+clean; 6.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.9 KiB/s wr, 22 op/s 2024-08-20T01:53:46.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.900+0000 7f6050e24640 1 -- 172.21.15.79:0/1922652769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f604c101990 msgr2=0x7f604c101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:46.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.900+0000 7f6050e24640 1 --2- 172.21.15.79:0/1922652769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f604c101990 0x7f604c101d70 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f603c009900 tx=0x7f603c02a410 comp rx=0 tx=0).stop 2024-08-20T01:53:46.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.900+0000 7f6050e24640 1 -- 172.21.15.79:0/1922652769 shutdown_connections 2024-08-20T01:53:46.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.900+0000 7f6050e24640 1 --2- 172.21.15.79:0/1922652769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f604c107d20 0x7f604c10e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:46.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.900+0000 7f6050e24640 1 --2- 172.21.15.79:0/1922652769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f604c1073a0 0x7f604c1077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:46.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.900+0000 7f6050e24640 1 --2- 172.21.15.79:0/1922652769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f604c101990 0x7f604c101d70 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:46.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.900+0000 7f6050e24640 1 -- 172.21.15.79:0/1922652769 >> 172.21.15.79:0/1922652769 conn(0x7f604c0fd400 msgr2=0x7f604c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:46.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.900+0000 7f6050e24640 1 -- 172.21.15.79:0/1922652769 shutdown_connections 2024-08-20T01:53:46.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.900+0000 7f6050e24640 1 -- 172.21.15.79:0/1922652769 wait complete. 2024-08-20T01:53:46.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.901+0000 7f6050e24640 1 Processor -- start 2024-08-20T01:53:46.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.901+0000 7f6050e24640 1 -- start start 2024-08-20T01:53:46.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.901+0000 7f6050e24640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f604c101990 0x7f604c199dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:46.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.901+0000 7f6050e24640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f604c1073a0 0x7f604c19a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:46.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.902+0000 7f6050e24640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f604c107d20 0x7f604c19a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:46.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.902+0000 7f6050e24640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f604c111890 con 0x7f604c107d20 2024-08-20T01:53:46.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.902+0000 7f6050e24640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f604c111710 con 0x7f604c101990 2024-08-20T01:53:46.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.902+0000 7f6050e24640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f604c111a10 con 0x7f604c1073a0 2024-08-20T01:53:46.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.902+0000 7f604ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f604c107d20 0x7f604c19a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:46.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.902+0000 7f604ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f604c107d20 0x7f604c19a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35950/0 (socket says 172.21.15.79:35950) 2024-08-20T01:53:46.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.902+0000 7f604ad9d640 1 -- 172.21.15.79:0/978792684 learned_addr learned my addr 172.21.15.79:0/978792684 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:46.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.902+0000 7f6049d9b640 1 --2- 172.21.15.79:0/978792684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f604c1073a0 0x7f604c19a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:46.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.902+0000 7f604a59c640 1 --2- 172.21.15.79:0/978792684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f604c101990 0x7f604c199dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:46.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.902+0000 7f604ad9d640 1 -- 172.21.15.79:0/978792684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f604c1073a0 msgr2=0x7f604c19a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:46.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.902+0000 7f604ad9d640 1 --2- 172.21.15.79:0/978792684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f604c1073a0 0x7f604c19a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:46.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.902+0000 7f604ad9d640 1 -- 172.21.15.79:0/978792684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f604c101990 msgr2=0x7f604c199dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:46.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.902+0000 7f604ad9d640 1 --2- 172.21.15.79:0/978792684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f604c101990 0x7f604c199dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:46.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.902+0000 7f604ad9d640 1 -- 172.21.15.79:0/978792684 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f604c1a51b0 con 0x7f604c107d20 2024-08-20T01:53:46.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.902+0000 7f6049d9b640 1 --2- 172.21.15.79:0/978792684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f604c1073a0 0x7f604c19a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:53:46.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.902+0000 7f604ad9d640 1 --2- 172.21.15.79:0/978792684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f604c107d20 0x7f604c19a870 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f6044009fd0 tx=0x7f604400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:46.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.902+0000 7f603b7fe640 1 -- 172.21.15.79:0/978792684 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6044017070 con 0x7f604c107d20 2024-08-20T01:53:46.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.902+0000 7f6050e24640 1 -- 172.21.15.79:0/978792684 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f604c1a54a0 con 0x7f604c107d20 2024-08-20T01:53:46.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.902+0000 7f603b7fe640 1 -- 172.21.15.79:0/978792684 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6044003e00 con 0x7f604c107d20 2024-08-20T01:53:46.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.902+0000 7f603b7fe640 1 -- 172.21.15.79:0/978792684 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6044010460 con 0x7f604c107d20 2024-08-20T01:53:46.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.902+0000 7f6050e24640 1 -- 172.21.15.79:0/978792684 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f604c1a5990 con 0x7f604c107d20 2024-08-20T01:53:46.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.905+0000 7f603b7fe640 1 -- 172.21.15.79:0/978792684 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f6044003970 con 0x7f604c107d20 2024-08-20T01:53:46.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.905+0000 7f605321d740 1 Processor -- start 2024-08-20T01:53:46.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.905+0000 7f605321d740 1 -- start start 2024-08-20T01:53:46.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.906+0000 7f605321d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560062732880 0x560062732c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:46.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.906+0000 7f605321d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600627331a0 0x56006273ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:46.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.906+0000 7f605321d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56006273f130 0x560062741520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:46.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.906+0000 7f605321d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5600626a9930 con 0x560062732880 2024-08-20T01:53:46.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.906+0000 7f605321d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560062698e30 con 0x56006273f130 2024-08-20T01:53:46.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.906+0000 7f605321d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56006269ce70 con 0x5600627331a0 2024-08-20T01:53:46.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.906+0000 7f6049d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560062732880 0x560062732c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:46.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.906+0000 7f6049d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560062732880 0x560062732c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35958/0 (socket says 172.21.15.79:35958) 2024-08-20T01:53:46.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.906+0000 7f6049d9b640 1 -- 172.21.15.79:0/1453602201 learned_addr learned my addr 172.21.15.79:0/1453602201 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:46.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.906+0000 7f604a59c640 1 --2- 172.21.15.79:0/1453602201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600627331a0 0x56006273ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:46.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.906+0000 7f6049d9b640 1 --2- 172.21.15.79:0/1453602201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56006273f130 0x560062741520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:46.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.906+0000 7f603b7fe640 1 --2- 172.21.15.79:0/978792684 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f60340b3bd0 0x7f60340b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:46.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.906+0000 7f6049d9b640 1 -- 172.21.15.79:0/1453602201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600627331a0 msgr2=0x56006273ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:46.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.906+0000 7f6049d9b640 1 --2- 172.21.15.79:0/1453602201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600627331a0 0x56006273ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:46.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.906+0000 7f6049d9b640 1 -- 172.21.15.79:0/1453602201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56006273f130 msgr2=0x560062741520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:46.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.906+0000 7f6049d9b640 1 --2- 172.21.15.79:0/1453602201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56006273f130 0x560062741520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:46.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.906+0000 7f6049d9b640 1 -- 172.21.15.79:0/1453602201 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600623f8650 con 0x560062732880 2024-08-20T01:53:46.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.906+0000 7f604ad9d640 1 --2- 172.21.15.79:0/978792684 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f60340b3bd0 0x7f60340b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:46.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.906+0000 7f6049d9b640 1 --2- 172.21.15.79:0/1453602201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560062732880 0x560062732c60 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f6040013a40 tx=0x7f6040009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90c5c13c0b0def63 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:46.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.906+0000 7f603b7fe640 1 -- 172.21.15.79:0/978792684 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f60440e3c50 con 0x7f604c107d20 2024-08-20T01:53:46.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.906+0000 7f6038ff9640 1 -- 172.21.15.79:0/1453602201 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6040004050 con 0x560062732880 2024-08-20T01:53:46.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.907+0000 7f6038ff9640 1 -- 172.21.15.79:0/1453602201 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f604000f980 con 0x560062732880 2024-08-20T01:53:46.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.907+0000 7f6038ff9640 1 -- 172.21.15.79:0/1453602201 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6040003950 con 0x560062732880 2024-08-20T01:53:46.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.907+0000 7f605321d740 1 -- 172.21.15.79:0/1453602201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560062732880 msgr2=0x560062732c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:46.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.907+0000 7f604ad9d640 1 --2- 172.21.15.79:0/978792684 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f60340b3bd0 0x7f60340b6090 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f60440a6ce0 tx=0x7f6044078400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:46.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.907+0000 7f605321d740 1 --2- 172.21.15.79:0/1453602201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560062732880 0x560062732c60 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f6040013a40 tx=0x7f6040009c00 comp rx=0 tx=0).stop 2024-08-20T01:53:46.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.907+0000 7f605321d740 1 -- 172.21.15.79:0/1453602201 shutdown_connections 2024-08-20T01:53:46.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.907+0000 7f605321d740 1 --2- 172.21.15.79:0/1453602201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56006273f130 0x560062741520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:46.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.907+0000 7f605321d740 1 --2- 172.21.15.79:0/1453602201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600627331a0 0x56006273ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:46.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.907+0000 7f605321d740 1 --2- 172.21.15.79:0/1453602201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560062732880 0x560062732c60 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:46.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.907+0000 7f605321d740 1 -- 172.21.15.79:0/1453602201 >> 172.21.15.79:0/1453602201 conn(0x5600627306b0 msgr2=0x560062731850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:46.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.907+0000 7f605321d740 1 -- 172.21.15.79:0/1453602201 shutdown_connections 2024-08-20T01:53:46.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.907+0000 7f605321d740 1 -- 172.21.15.79:0/1453602201 wait complete. 2024-08-20T01:53:46.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.908+0000 7f605321d740 1 -- start start 2024-08-20T01:53:46.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.908+0000 7f605321d740 1 Processor -- start 2024-08-20T01:53:46.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.908+0000 7f605321d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560062732880 0x56006273c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:46.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.908+0000 7f605321d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5600627331a0 0x56006273c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:46.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.908+0000 7f605321d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56006273f130 0x56006273cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:46.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.908+0000 7f605321d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5600624fb700 con 0x5600627331a0 2024-08-20T01:53:46.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.908+0000 7f605321d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56006261f810 con 0x560062732880 2024-08-20T01:53:46.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.908+0000 7f605321d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560062741de0 con 0x56006273f130 2024-08-20T01:53:46.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.908+0000 7f605321d740 10 client.0 _ll_register_callbacks cb 0x560062692700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:53:46.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.908+0000 7f604a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5600627331a0 0x56006273c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:46.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.908+0000 7f6049d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560062732880 0x56006273c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:46.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.908+0000 7f604a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5600627331a0 0x56006273c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35964/0 (socket says 172.21.15.79:35964) 2024-08-20T01:53:46.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.908+0000 7f604a59c640 1 -- 172.21.15.79:0/1973116162 learned_addr learned my addr 172.21.15.79:0/1973116162 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:46.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.908+0000 7f6049d9b640 1 --2- 172.21.15.79:0/1973116162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56006273f130 0x56006273cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:46.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.909+0000 7f604a59c640 1 -- 172.21.15.79:0/1973116162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56006273f130 msgr2=0x56006273cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:46.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.909+0000 7f604a59c640 1 --2- 172.21.15.79:0/1973116162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56006273f130 0x56006273cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:46.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.909+0000 7f604a59c640 1 -- 172.21.15.79:0/1973116162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560062732880 msgr2=0x56006273c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:46.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.909+0000 7f604a59c640 1 --2- 172.21.15.79:0/1973116162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560062732880 0x56006273c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:46.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.909+0000 7f604a59c640 1 -- 172.21.15.79:0/1973116162 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56006274b210 con 0x5600627331a0 2024-08-20T01:53:46.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.909+0000 7f6049d9b640 1 --2- 172.21.15.79:0/1973116162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560062732880 0x56006273c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:53:46.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.909+0000 7f604a59c640 1 --2- 172.21.15.79:0/1973116162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5600627331a0 0x56006273c680 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f603c02a930 tx=0x7f603c031f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b06b06a44358db34 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:46.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.909+0000 7f6031ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:53:46.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.909+0000 7f6031ffb640 1 -- 172.21.15.79:0/1973116162 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f603c035040 con 0x5600627331a0 2024-08-20T01:53:46.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.909+0000 7f6031ffb640 1 -- 172.21.15.79:0/1973116162 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f603c004040 con 0x5600627331a0 2024-08-20T01:53:46.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.909+0000 7f605321d740 1 -- 172.21.15.79:0/1973116162 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560062648150 con 0x5600627331a0 2024-08-20T01:53:46.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.909+0000 7f6031ffb640 1 -- 172.21.15.79:0/1973116162 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f603c004240 con 0x5600627331a0 2024-08-20T01:53:46.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.909+0000 7f605321d740 10 client.19590 fetch_fsmap learned FSMap version 69 2024-08-20T01:53:46.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.909+0000 7f605321d740 1 -- 172.21.15.79:0/1973116162 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) -- 0x56006274dbc0 con 0x5600627331a0 2024-08-20T01:53:46.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.909+0000 7f6031ffb640 1 -- 172.21.15.79:0/1973116162 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x560062648150 con 0x5600627331a0 2024-08-20T01:53:46.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.909+0000 7f6031ffb640 1 -- 172.21.15.79:0/1973116162 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 69) ==== 8366+0+0 (secure 0 0 0) 0x7f603c044020 con 0x5600627331a0 2024-08-20T01:53:46.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.909+0000 7f605321d740 10 client.19590 fetch_fsmap finished waiting for FSMap version 69 2024-08-20T01:53:46.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.909+0000 7f605321d740 10 client.19590 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:53:46.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.910+0000 7f605321d740 20 client.19590 populate_metadata read hostname 'smithi079' 2024-08-20T01:53:46.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.910+0000 7f605321d740 1 --2- 172.21.15.79:0/1973116162 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56006274f080 0x560062751470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:46.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.910+0000 7f605321d740 4 client.19590 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:53:46.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.910+0000 7f605321d740 1 -- 172.21.15.79:0/1973116162 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5600626ab880 con 0x56006274f080 2024-08-20T01:53:46.944 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.910+0000 7f6049d9b640 1 --2- 172.21.15.79:0/1973116162 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56006274f080 0x560062751470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:46.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.910+0000 7f6049d9b640 1 --2- 172.21.15.79:0/1973116162 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56006274f080 0x560062751470 crc :-1 s=READY pgs=334 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a3f0f995b366b72 server_cookie=4b657cdeba3d47c0 in_seq=0 out_seq=0 2024-08-20T01:53:46.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.910+0000 7f6031ffb640 10 client.19590 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:53:46.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.911+0000 7f6031ffb640 1 -- 172.21.15.79:0/1973116162 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5600626ab880 con 0x56006274f080 2024-08-20T01:53:46.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.911+0000 7f6031ffb640 10 client.19590 handle_command_reply: tid=0 2024-08-20T01:53:46.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.911+0000 7f605321d740 1 client.19590 shutdown 2024-08-20T01:53:46.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.911+0000 7f605321d740 1 -- 172.21.15.79:0/1973116162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5600627331a0 msgr2=0x56006273c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:46.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.911+0000 7f605321d740 1 --2- 172.21.15.79:0/1973116162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5600627331a0 0x56006273c680 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f603c02a930 tx=0x7f603c031f00 comp rx=0 tx=0).stop 2024-08-20T01:53:46.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.911+0000 7f605321d740 1 -- 172.21.15.79:0/1973116162 shutdown_connections 2024-08-20T01:53:46.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.911+0000 7f605321d740 1 --2- 172.21.15.79:0/1973116162 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56006274f080 0x560062751470 crc :-1 s=READY pgs=334 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:46.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.911+0000 7f605321d740 1 --2- 172.21.15.79:0/1973116162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56006273f130 0x56006273cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:46.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.911+0000 7f6031ffb640 0 client.19590 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:53:46.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.911+0000 7f605321d740 1 --2- 172.21.15.79:0/1973116162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5600627331a0 0x56006273c680 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:46.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.911+0000 7f605321d740 1 --2- 172.21.15.79:0/1973116162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560062732880 0x56006273c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:46.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.911+0000 7f605321d740 1 -- 172.21.15.79:0/1973116162 >> 172.21.15.79:0/1973116162 conn(0x5600627306b0 msgr2=0x560062736220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:46.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.911+0000 7f605321d740 1 -- 172.21.15.79:0/1973116162 shutdown_connections 2024-08-20T01:53:46.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.911+0000 7f605321d740 1 -- 172.21.15.79:0/1973116162 wait complete. 2024-08-20T01:53:46.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.911+0000 7f605321d740 20 client.19590 trim_cache size 0 max 16384 2024-08-20T01:53:46.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.924+0000 7f605321d740 1 Processor -- start 2024-08-20T01:53:46.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.924+0000 7f605321d740 1 -- start start 2024-08-20T01:53:46.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.924+0000 7f605321d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560062732880 0x560062736920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:46.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.924+0000 7f605321d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56006273f130 0x56006273de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:46.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.924+0000 7f605321d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560062756d40 0x5600627571f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:46.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.924+0000 7f605321d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f604c1adfe0 con 0x560062732880 2024-08-20T01:53:46.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.924+0000 7f605321d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f604c1afb20 con 0x56006273f130 2024-08-20T01:53:46.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.924+0000 7f605321d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f604c1ae6b0 con 0x560062756d40 2024-08-20T01:53:46.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.924+0000 7f6049d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560062732880 0x560062736920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:46.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.924+0000 7f6049d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560062732880 0x560062736920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35966/0 (socket says 172.21.15.79:35966) 2024-08-20T01:53:46.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.924+0000 7f6049d9b640 1 -- 172.21.15.79:0/1584333692 learned_addr learned my addr 172.21.15.79:0/1584333692 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:46.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.924+0000 7f604a59c640 1 --2- 172.21.15.79:0/1584333692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56006273f130 0x56006273de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:46.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.924+0000 7f6049d9b640 1 --2- 172.21.15.79:0/1584333692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560062756d40 0x5600627571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:46.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.924+0000 7f6049d9b640 1 -- 172.21.15.79:0/1584333692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560062756d40 msgr2=0x5600627571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:46.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.924+0000 7f6049d9b640 1 --2- 172.21.15.79:0/1584333692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560062756d40 0x5600627571f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:46.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.924+0000 7f6049d9b640 1 -- 172.21.15.79:0/1584333692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56006273f130 msgr2=0x56006273de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:46.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.924+0000 7f6049d9b640 1 --2- 172.21.15.79:0/1584333692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56006273f130 0x56006273de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:46.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.924+0000 7f6049d9b640 1 -- 172.21.15.79:0/1584333692 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600627304e0 con 0x560062732880 2024-08-20T01:53:46.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.925+0000 7f6049d9b640 1 --2- 172.21.15.79:0/1584333692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560062732880 0x560062736920 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f60400058c0 tx=0x7f60400035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afe8878556933eb8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:46.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.925+0000 7f6033fff640 1 -- 172.21.15.79:0/1584333692 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6040013270 con 0x560062732880 2024-08-20T01:53:46.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.925+0000 7f6033fff640 1 -- 172.21.15.79:0/1584333692 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6040034070 con 0x560062732880 2024-08-20T01:53:46.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.925+0000 7f6033fff640 1 -- 172.21.15.79:0/1584333692 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60400039e0 con 0x560062732880 2024-08-20T01:53:46.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.925+0000 7f605321d740 1 -- 172.21.15.79:0/1584333692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560062732880 msgr2=0x560062736920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:46.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.925+0000 7f605321d740 1 --2- 172.21.15.79:0/1584333692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560062732880 0x560062736920 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f60400058c0 tx=0x7f60400035f0 comp rx=0 tx=0).stop 2024-08-20T01:53:46.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.925+0000 7f605321d740 1 -- 172.21.15.79:0/1584333692 shutdown_connections 2024-08-20T01:53:46.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.925+0000 7f605321d740 1 --2- 172.21.15.79:0/1584333692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560062756d40 0x5600627571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:46.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.925+0000 7f605321d740 1 --2- 172.21.15.79:0/1584333692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56006273f130 0x56006273de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:46.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.925+0000 7f605321d740 1 --2- 172.21.15.79:0/1584333692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560062732880 0x560062736920 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:46.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.925+0000 7f605321d740 1 -- 172.21.15.79:0/1584333692 >> 172.21.15.79:0/1584333692 conn(0x5600627306b0 msgr2=0x56006273d770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:46.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.925+0000 7f605321d740 1 -- 172.21.15.79:0/1584333692 shutdown_connections 2024-08-20T01:53:46.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.925+0000 7f605321d740 1 -- 172.21.15.79:0/1584333692 wait complete. 2024-08-20T01:53:46.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.926+0000 7f605321d740 1 -- start start 2024-08-20T01:53:46.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.926+0000 7f605321d740 1 Processor -- start 2024-08-20T01:53:46.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.926+0000 7f605321d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560062732880 0x5600627478f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:46.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.926+0000 7f605321d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56006273f130 0x560062739130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:46.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.926+0000 7f605321d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560062756d40 0x5600627398c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:46.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.926+0000 7f605321d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f604c1af450 con 0x560062732880 2024-08-20T01:53:46.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.926+0000 7f605321d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f604c1aed80 con 0x56006273f130 2024-08-20T01:53:46.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.926+0000 7f605321d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f604c1abfc0 con 0x560062756d40 2024-08-20T01:53:46.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.926+0000 7f605321d740 10 client.0 _ll_register_callbacks cb 0x7f603c009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:53:46.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.926+0000 7f6049d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560062732880 0x5600627478f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:46.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.926+0000 7f6049d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560062732880 0x5600627478f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35980/0 (socket says 172.21.15.79:35980) 2024-08-20T01:53:46.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.926+0000 7f6049d9b640 1 -- 172.21.15.79:0/2491785648 learned_addr learned my addr 172.21.15.79:0/2491785648 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:46.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.926+0000 7f604a59c640 1 --2- 172.21.15.79:0/2491785648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56006273f130 0x560062739130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:46.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.926+0000 7f6049d9b640 1 --2- 172.21.15.79:0/2491785648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560062756d40 0x5600627398c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:46.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.926+0000 7f6049d9b640 1 -- 172.21.15.79:0/2491785648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560062756d40 msgr2=0x5600627398c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:46.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.926+0000 7f6049d9b640 1 --2- 172.21.15.79:0/2491785648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560062756d40 0x5600627398c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:46.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.926+0000 7f6049d9b640 1 -- 172.21.15.79:0/2491785648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56006273f130 msgr2=0x560062739130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:46.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.926+0000 7f6049d9b640 1 --2- 172.21.15.79:0/2491785648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56006273f130 0x560062739130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:46.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.926+0000 7f6049d9b640 1 -- 172.21.15.79:0/2491785648 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560062731130 con 0x560062732880 2024-08-20T01:53:46.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.927+0000 7f6049d9b640 1 --2- 172.21.15.79:0/2491785648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560062732880 0x5600627478f0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f6040009380 tx=0x7f6040003660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ed2439ee1644701 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:46.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.927+0000 7f6031ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:53:46.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.927+0000 7f6031ffb640 1 -- 172.21.15.79:0/2491785648 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f604000fc90 con 0x560062732880 2024-08-20T01:53:46.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.927+0000 7f6031ffb640 1 -- 172.21.15.79:0/2491785648 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f60400050c0 con 0x560062732880 2024-08-20T01:53:46.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.927+0000 7f605321d740 1 -- 172.21.15.79:0/2491785648 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6040034070 con 0x560062732880 2024-08-20T01:53:46.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.927+0000 7f6031ffb640 1 -- 172.21.15.79:0/2491785648 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f60400052c0 con 0x560062732880 2024-08-20T01:53:46.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.927+0000 7f605321d740 10 client.19596 fetch_fsmap learned FSMap version 69 2024-08-20T01:53:46.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.927+0000 7f605321d740 1 -- 172.21.15.79:0/2491785648 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) -- 0x5600627b9d80 con 0x560062732880 2024-08-20T01:53:46.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.927+0000 7f6031ffb640 1 -- 172.21.15.79:0/2491785648 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6040034070 con 0x560062732880 2024-08-20T01:53:46.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.927+0000 7f6031ffb640 1 -- 172.21.15.79:0/2491785648 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 69) ==== 8366+0+0 (secure 0 0 0) 0x7f604002f040 con 0x560062732880 2024-08-20T01:53:46.951 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:53:46.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.927+0000 7f605321d740 10 client.19596 fetch_fsmap finished waiting for FSMap version 69 2024-08-20T01:53:46.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.927+0000 7f605321d740 10 client.19596 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:53:46.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.927+0000 7f605321d740 20 client.19596 populate_metadata read hostname 'smithi079' 2024-08-20T01:53:46.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.927+0000 7f605321d740 1 --2- 172.21.15.79:0/2491785648 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5600627ba0b0 0x5600627bc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:46.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.927+0000 7f605321d740 4 client.19596 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:53:46.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.927+0000 7f605321d740 1 -- 172.21.15.79:0/2491785648 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5600626a7320 con 0x5600627ba0b0 2024-08-20T01:53:46.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.927+0000 7f604a59c640 1 --2- 172.21.15.79:0/2491785648 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5600627ba0b0 0x5600627bc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:46.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.928+0000 7f6031ffb640 10 client.19596 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:53:46.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.928+0000 7f604a59c640 1 --2- 172.21.15.79:0/2491785648 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5600627ba0b0 0x5600627bc4a0 crc :-1 s=READY pgs=335 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3cee5f6f97f37bd server_cookie=c6617ed7bc1a4cc5 in_seq=0 out_seq=0 2024-08-20T01:53:46.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.928+0000 7f6031ffb640 1 -- 172.21.15.79:0/2491785648 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5600626a7320 con 0x5600627ba0b0 2024-08-20T01:53:46.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.928+0000 7f6031ffb640 10 client.19596 handle_command_reply: tid=0 2024-08-20T01:53:46.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.928+0000 7f605321d740 1 client.19596 shutdown 2024-08-20T01:53:46.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.928+0000 7f605321d740 1 -- 172.21.15.79:0/2491785648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560062732880 msgr2=0x5600627478f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:46.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.928+0000 7f605321d740 1 --2- 172.21.15.79:0/2491785648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560062732880 0x5600627478f0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f6040009380 tx=0x7f6040003660 comp rx=0 tx=0).stop 2024-08-20T01:53:46.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.928+0000 7f605321d740 1 -- 172.21.15.79:0/2491785648 shutdown_connections 2024-08-20T01:53:46.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.928+0000 7f605321d740 1 --2- 172.21.15.79:0/2491785648 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5600627ba0b0 0x5600627bc4a0 crc :-1 s=READY pgs=335 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:46.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.928+0000 7f605321d740 1 --2- 172.21.15.79:0/2491785648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560062756d40 0x5600627398c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:46.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.928+0000 7f605321d740 1 --2- 172.21.15.79:0/2491785648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56006273f130 0x560062739130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:46.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.928+0000 7f6031ffb640 0 client.19596 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:53:46.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.928+0000 7f605321d740 1 --2- 172.21.15.79:0/2491785648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560062732880 0x5600627478f0 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:46.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.928+0000 7f605321d740 1 -- 172.21.15.79:0/2491785648 >> 172.21.15.79:0/2491785648 conn(0x5600627306b0 msgr2=0x56006273d770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:46.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.928+0000 7f605321d740 1 -- 172.21.15.79:0/2491785648 shutdown_connections 2024-08-20T01:53:46.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.928+0000 7f605321d740 1 -- 172.21.15.79:0/2491785648 wait complete. 2024-08-20T01:53:46.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.928+0000 7f605321d740 20 client.19596 trim_cache size 0 max 16384 2024-08-20T01:53:46.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.929+0000 7f6050e24640 1 -- 172.21.15.79:0/978792684 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f60340b3bd0 msgr2=0x7f60340b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:46.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.929+0000 7f6050e24640 1 --2- 172.21.15.79:0/978792684 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f60340b3bd0 0x7f60340b6090 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f60440a6ce0 tx=0x7f6044078400 comp rx=0 tx=0).stop 2024-08-20T01:53:46.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.929+0000 7f6050e24640 1 -- 172.21.15.79:0/978792684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f604c107d20 msgr2=0x7f604c19a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:46.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.929+0000 7f6050e24640 1 --2- 172.21.15.79:0/978792684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f604c107d20 0x7f604c19a870 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f6044009fd0 tx=0x7f604400b260 comp rx=0 tx=0).stop 2024-08-20T01:53:46.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.929+0000 7f6050e24640 1 -- 172.21.15.79:0/978792684 shutdown_connections 2024-08-20T01:53:46.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.929+0000 7f6050e24640 1 --2- 172.21.15.79:0/978792684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f604c107d20 0x7f604c19a870 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:46.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.929+0000 7f6050e24640 1 --2- 172.21.15.79:0/978792684 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f60340b3bd0 0x7f60340b6090 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:46.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.929+0000 7f6050e24640 1 --2- 172.21.15.79:0/978792684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f604c1073a0 0x7f604c19a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:46.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.929+0000 7f6050e24640 1 --2- 172.21.15.79:0/978792684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f604c101990 0x7f604c199dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:46.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.929+0000 7f6050e24640 1 -- 172.21.15.79:0/978792684 >> 172.21.15.79:0/978792684 conn(0x7f604c0fd400 msgr2=0x7f604c0ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:46.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.929+0000 7f6050e24640 1 -- 172.21.15.79:0/978792684 shutdown_connections 2024-08-20T01:53:46.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:46.929+0000 7f6050e24640 1 -- 172.21.15.79:0/978792684 wait complete. 2024-08-20T01:53:48.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:48 smithi079 ceph-mon[18656]: pgmap v841: 97 pgs: 97 active+clean; 6.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 7.7 KiB/s wr, 21 op/s 2024-08-20T01:53:48.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:48 smithi175 ceph-mon[22392]: pgmap v841: 97 pgs: 97 active+clean; 6.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 7.7 KiB/s wr, 21 op/s 2024-08-20T01:53:48.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:48 smithi081 ceph-mon[22209]: pgmap v841: 97 pgs: 97 active+clean; 6.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 7.7 KiB/s wr, 21 op/s 2024-08-20T01:53:48.927 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T01:53:48.927 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T01:53:49.175 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:53:49.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.662+0000 7f6350d6a640 1 -- 172.21.15.79:0/2606460030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f634c108e80 msgr2=0x7f634c10f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:49.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.662+0000 7f6350d6a640 1 --2- 172.21.15.79:0/2606460030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f634c108e80 0x7f634c10f680 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f6344009ca0 tx=0x7f634402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:53:49.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.662+0000 7f6350d6a640 1 -- 172.21.15.79:0/2606460030 shutdown_connections 2024-08-20T01:53:49.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.662+0000 7f6350d6a640 1 --2- 172.21.15.79:0/2606460030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f634c108e80 0x7f634c10f680 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:49.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.662+0000 7f6350d6a640 1 --2- 172.21.15.79:0/2606460030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f634c108500 0x7f634c108940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:49.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.662+0000 7f6350d6a640 1 --2- 172.21.15.79:0/2606460030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f634c102af0 0x7f634c102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:49.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.662+0000 7f6350d6a640 1 -- 172.21.15.79:0/2606460030 >> 172.21.15.79:0/2606460030 conn(0x7f634c0fe540 msgr2=0x7f634c100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:49.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.662+0000 7f6350d6a640 1 -- 172.21.15.79:0/2606460030 shutdown_connections 2024-08-20T01:53:49.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.662+0000 7f6350d6a640 1 -- 172.21.15.79:0/2606460030 wait complete. 2024-08-20T01:53:49.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.663+0000 7f6350d6a640 1 Processor -- start 2024-08-20T01:53:49.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.663+0000 7f6350d6a640 1 -- start start 2024-08-20T01:53:49.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.663+0000 7f6350d6a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f634c102af0 0x7f634c0751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:49.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.663+0000 7f6350d6a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f634c108500 0x7f634c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:49.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.663+0000 7f6350d6a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f634c108e80 0x7f634c075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:49.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.663+0000 7f6350d6a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f634c112a00 con 0x7f634c108e80 2024-08-20T01:53:49.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.663+0000 7f6350d6a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f634c112880 con 0x7f634c102af0 2024-08-20T01:53:49.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.663+0000 7f6350d6a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f634c112b80 con 0x7f634c108500 2024-08-20T01:53:49.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.663+0000 7f634ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f634c108e80 0x7f634c075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:49.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.663+0000 7f634ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f634c108e80 0x7f634c075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35996/0 (socket says 172.21.15.79:35996) 2024-08-20T01:53:49.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.663+0000 7f634ad9d640 1 -- 172.21.15.79:0/3199342634 learned_addr learned my addr 172.21.15.79:0/3199342634 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:49.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.663+0000 7f6349d9b640 1 --2- 172.21.15.79:0/3199342634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f634c108500 0x7f634c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:49.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.663+0000 7f634a59c640 1 --2- 172.21.15.79:0/3199342634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f634c102af0 0x7f634c0751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:49.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.664+0000 7f6349d9b640 1 -- 172.21.15.79:0/3199342634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f634c102af0 msgr2=0x7f634c0751d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:49.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.664+0000 7f6349d9b640 1 --2- 172.21.15.79:0/3199342634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f634c102af0 0x7f634c0751d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:49.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.664+0000 7f6349d9b640 1 -- 172.21.15.79:0/3199342634 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f634c108e80 msgr2=0x7f634c075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:49.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.664+0000 7f6349d9b640 1 --2- 172.21.15.79:0/3199342634 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f634c108e80 0x7f634c075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:49.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.664+0000 7f6349d9b640 1 -- 172.21.15.79:0/3199342634 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f634c1a72d0 con 0x7f634c108500 2024-08-20T01:53:49.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.664+0000 7f634ad9d640 1 --2- 172.21.15.79:0/3199342634 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f634c108e80 0x7f634c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:53:49.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.664+0000 7f6349d9b640 1 --2- 172.21.15.79:0/3199342634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f634c108500 0x7f634c075710 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f634000e9f0 tx=0x7f634000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:49.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.664+0000 7f633b7fe640 1 -- 172.21.15.79:0/3199342634 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f634000ccc0 con 0x7f634c108500 2024-08-20T01:53:49.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.664+0000 7f6350d6a640 1 -- 172.21.15.79:0/3199342634 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f634c1a75c0 con 0x7f634c108500 2024-08-20T01:53:49.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.664+0000 7f633b7fe640 1 -- 172.21.15.79:0/3199342634 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f63400108c0 con 0x7f634c108500 2024-08-20T01:53:49.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.664+0000 7f633b7fe640 1 -- 172.21.15.79:0/3199342634 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63400187c0 con 0x7f634c108500 2024-08-20T01:53:49.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.664+0000 7f6350d6a640 1 -- 172.21.15.79:0/3199342634 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f634c1a7b50 con 0x7f634c108500 2024-08-20T01:53:49.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.666+0000 7f633b7fe640 1 -- 172.21.15.79:0/3199342634 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f6340010430 con 0x7f634c108500 2024-08-20T01:53:49.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.667+0000 7f6353163740 1 Processor -- start 2024-08-20T01:53:49.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.667+0000 7f6353163740 1 -- start start 2024-08-20T01:53:49.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.667+0000 7f6353163740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594193543b0 0x559419354790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:49.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.667+0000 7f6353163740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559419354cd0 0x559419360720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:49.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.667+0000 7f6353163740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559419360c60 0x559419363050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:49.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.667+0000 7f6353163740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5594192ca940 con 0x559419354cd0 2024-08-20T01:53:49.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.667+0000 7f6353163740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5594192b9e40 con 0x559419360c60 2024-08-20T01:53:49.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.667+0000 7f6353163740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5594192bde80 con 0x5594193543b0 2024-08-20T01:53:49.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.667+0000 7f634a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559419354cd0 0x559419360720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:49.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.667+0000 7f634a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559419354cd0 0x559419360720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36002/0 (socket says 172.21.15.79:36002) 2024-08-20T01:53:49.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.667+0000 7f634a59c640 1 -- 172.21.15.79:0/3297523270 learned_addr learned my addr 172.21.15.79:0/3297523270 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:49.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.667+0000 7f634ad9d640 1 --2- 172.21.15.79:0/3297523270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594193543b0 0x559419354790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:49.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.667+0000 7f6349d9b640 1 --2- 172.21.15.79:0/3297523270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559419360c60 0x559419363050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:49.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.668+0000 7f633b7fe640 1 --2- 172.21.15.79:0/3199342634 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f63340b3bd0 0x7f63340b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:49.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.668+0000 7f634a59c640 1 -- 172.21.15.79:0/3297523270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594193543b0 msgr2=0x559419354790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:49.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.668+0000 7f634a59c640 1 --2- 172.21.15.79:0/3297523270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594193543b0 0x559419354790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:49.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.668+0000 7f634a59c640 1 -- 172.21.15.79:0/3297523270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559419360c60 msgr2=0x559419363050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:49.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.668+0000 7f634a59c640 1 --2- 172.21.15.79:0/3297523270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559419360c60 0x559419363050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:49.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.668+0000 7f634a59c640 1 -- 172.21.15.79:0/3297523270 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559419256520 con 0x559419354cd0 2024-08-20T01:53:49.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.668+0000 7f634ad9d640 1 --2- 172.21.15.79:0/3199342634 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f63340b3bd0 0x7f63340b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:49.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.668+0000 7f633b7fe640 1 -- 172.21.15.79:0/3199342634 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f63400e3f10 con 0x7f634c108500 2024-08-20T01:53:49.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.668+0000 7f634a59c640 1 --2- 172.21.15.79:0/3297523270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559419354cd0 0x559419360720 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f633c009d50 tx=0x7f633c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b50764e19cc55490 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:49.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.668+0000 7f6338ff9640 1 -- 172.21.15.79:0/3297523270 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c01e070 con 0x559419354cd0 2024-08-20T01:53:49.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.668+0000 7f6338ff9640 1 -- 172.21.15.79:0/3297523270 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f633c019ac0 con 0x559419354cd0 2024-08-20T01:53:49.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.668+0000 7f6338ff9640 1 -- 172.21.15.79:0/3297523270 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c00e960 con 0x559419354cd0 2024-08-20T01:53:49.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.669+0000 7f6353163740 1 -- 172.21.15.79:0/3297523270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559419354cd0 msgr2=0x559419360720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:49.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.669+0000 7f634ad9d640 1 --2- 172.21.15.79:0/3199342634 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f63340b3bd0 0x7f63340b6090 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f6344031040 tx=0x7f634402a8c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:49.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.669+0000 7f6353163740 1 --2- 172.21.15.79:0/3297523270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559419354cd0 0x559419360720 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f633c009d50 tx=0x7f633c011810 comp rx=0 tx=0).stop 2024-08-20T01:53:49.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.669+0000 7f6353163740 1 -- 172.21.15.79:0/3297523270 shutdown_connections 2024-08-20T01:53:49.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.669+0000 7f6353163740 1 --2- 172.21.15.79:0/3297523270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559419360c60 0x559419363050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:49.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.669+0000 7f6353163740 1 --2- 172.21.15.79:0/3297523270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559419354cd0 0x559419360720 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:49.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.669+0000 7f6353163740 1 --2- 172.21.15.79:0/3297523270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594193543b0 0x559419354790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:49.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.669+0000 7f6353163740 1 -- 172.21.15.79:0/3297523270 >> 172.21.15.79:0/3297523270 conn(0x5594193521e0 msgr2=0x559419353380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:49.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.669+0000 7f6353163740 1 -- 172.21.15.79:0/3297523270 shutdown_connections 2024-08-20T01:53:49.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.669+0000 7f6353163740 1 -- 172.21.15.79:0/3297523270 wait complete. 2024-08-20T01:53:49.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.669+0000 7f6353163740 1 -- start start 2024-08-20T01:53:49.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.669+0000 7f6353163740 1 Processor -- start 2024-08-20T01:53:49.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.670+0000 7f6353163740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5594193543b0 0x55941935dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:49.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.670+0000 7f6353163740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559419354cd0 0x55941935e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:49.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.670+0000 7f6353163740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559419360c60 0x55941935e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:49.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.670+0000 7f6353163740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55941911c890 con 0x559419354cd0 2024-08-20T01:53:49.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.670+0000 7f6353163740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559419240700 con 0x5594193543b0 2024-08-20T01:53:49.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.670+0000 7f6353163740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5594193639b0 con 0x559419360c60 2024-08-20T01:53:49.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.670+0000 7f6353163740 10 client.0 _ll_register_callbacks cb 0x5594192b56f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:53:49.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.670+0000 7f6349d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559419354cd0 0x55941935e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:49.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.670+0000 7f6349d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559419354cd0 0x55941935e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36018/0 (socket says 172.21.15.79:36018) 2024-08-20T01:53:49.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.670+0000 7f6349d9b640 1 -- 172.21.15.79:0/2830203754 learned_addr learned my addr 172.21.15.79:0/2830203754 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:49.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.670+0000 7f634a59c640 1 --2- 172.21.15.79:0/2830203754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5594193543b0 0x55941935dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:49.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.670+0000 7f634ad9d640 1 --2- 172.21.15.79:0/2830203754 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559419360c60 0x55941935e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:49.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.670+0000 7f6349d9b640 1 -- 172.21.15.79:0/2830203754 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559419360c60 msgr2=0x55941935e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:49.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.670+0000 7f6349d9b640 1 --2- 172.21.15.79:0/2830203754 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559419360c60 0x55941935e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:49.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.670+0000 7f6349d9b640 1 -- 172.21.15.79:0/2830203754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5594193543b0 msgr2=0x55941935dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:49.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.670+0000 7f6349d9b640 1 --2- 172.21.15.79:0/2830203754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5594193543b0 0x55941935dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:49.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.670+0000 7f6349d9b640 1 -- 172.21.15.79:0/2830203754 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559419019930 con 0x559419354cd0 2024-08-20T01:53:49.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.670+0000 7f634a59c640 1 --2- 172.21.15.79:0/2830203754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5594193543b0 0x55941935dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:53:49.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.670+0000 7f6349d9b640 1 --2- 172.21.15.79:0/2830203754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559419354cd0 0x55941935e140 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f63400a6f40 tx=0x7f63400e7540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7483949c8316ca7f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:49.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.670+0000 7f6331ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:53:49.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.670+0000 7f6331ffb640 1 -- 172.21.15.79:0/2830203754 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63400aa9d0 con 0x559419354cd0 2024-08-20T01:53:49.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.670+0000 7f6331ffb640 1 -- 172.21.15.79:0/2830203754 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f63400aa120 con 0x559419354cd0 2024-08-20T01:53:49.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.670+0000 7f6353163740 1 -- 172.21.15.79:0/2830203754 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f633c019ac0 con 0x559419354cd0 2024-08-20T01:53:49.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.670+0000 7f6331ffb640 1 -- 172.21.15.79:0/2830203754 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f63400af020 con 0x559419354cd0 2024-08-20T01:53:49.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.670+0000 7f6353163740 10 client.19608 fetch_fsmap learned FSMap version 69 2024-08-20T01:53:49.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.670+0000 7f6353163740 1 -- 172.21.15.79:0/2830203754 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) -- 0x55941936f540 con 0x559419354cd0 2024-08-20T01:53:49.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.671+0000 7f6331ffb640 1 -- 172.21.15.79:0/2830203754 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f633c019ac0 con 0x559419354cd0 2024-08-20T01:53:49.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.671+0000 7f6331ffb640 1 -- 172.21.15.79:0/2830203754 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 69) ==== 8366+0+0 (secure 0 0 0) 0x7f63400a6830 con 0x559419354cd0 2024-08-20T01:53:49.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.671+0000 7f6353163740 10 client.19608 fetch_fsmap finished waiting for FSMap version 69 2024-08-20T01:53:49.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.671+0000 7f6353163740 10 client.19608 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:53:49.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.671+0000 7f6353163740 20 client.19608 populate_metadata read hostname 'smithi079' 2024-08-20T01:53:49.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.671+0000 7f6353163740 1 --2- 172.21.15.79:0/2830203754 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x559419370a00 0x559419372df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:49.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.671+0000 7f6353163740 4 client.19608 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:53:49.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.671+0000 7f6353163740 1 -- 172.21.15.79:0/2830203754 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5594192cc890 con 0x559419370a00 2024-08-20T01:53:49.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.671+0000 7f634a59c640 1 --2- 172.21.15.79:0/2830203754 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x559419370a00 0x559419372df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:49.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.672+0000 7f634a59c640 1 --2- 172.21.15.79:0/2830203754 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x559419370a00 0x559419372df0 crc :-1 s=READY pgs=336 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3e68938d8de4924 server_cookie=1f65f954c210f36e in_seq=0 out_seq=0 2024-08-20T01:53:49.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.672+0000 7f6331ffb640 10 client.19608 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:53:49.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.672+0000 7f6331ffb640 1 -- 172.21.15.79:0/2830203754 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5594192cc890 con 0x559419370a00 2024-08-20T01:53:49.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.672+0000 7f6331ffb640 10 client.19608 handle_command_reply: tid=0 2024-08-20T01:53:49.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.672+0000 7f6353163740 1 client.19608 shutdown 2024-08-20T01:53:49.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.672+0000 7f6353163740 1 -- 172.21.15.79:0/2830203754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559419354cd0 msgr2=0x55941935e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:49.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.672+0000 7f6353163740 1 --2- 172.21.15.79:0/2830203754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559419354cd0 0x55941935e140 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f63400a6f40 tx=0x7f63400e7540 comp rx=0 tx=0).stop 2024-08-20T01:53:49.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.672+0000 7f6353163740 1 -- 172.21.15.79:0/2830203754 shutdown_connections 2024-08-20T01:53:49.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.672+0000 7f6353163740 1 --2- 172.21.15.79:0/2830203754 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x559419370a00 0x559419372df0 crc :-1 s=READY pgs=336 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:49.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.673+0000 7f6353163740 1 --2- 172.21.15.79:0/2830203754 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559419360c60 0x55941935e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:49.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.673+0000 7f6353163740 1 --2- 172.21.15.79:0/2830203754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559419354cd0 0x55941935e140 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:49.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.673+0000 7f6331ffb640 0 client.19608 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:53:49.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.673+0000 7f6353163740 1 --2- 172.21.15.79:0/2830203754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5594193543b0 0x55941935dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:49.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.673+0000 7f6353163740 1 -- 172.21.15.79:0/2830203754 >> 172.21.15.79:0/2830203754 conn(0x5594193521e0 msgr2=0x559419357d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:49.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.673+0000 7f6353163740 1 -- 172.21.15.79:0/2830203754 shutdown_connections 2024-08-20T01:53:49.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.673+0000 7f6353163740 1 -- 172.21.15.79:0/2830203754 wait complete. 2024-08-20T01:53:49.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.673+0000 7f6353163740 20 client.19608 trim_cache size 0 max 16384 2024-08-20T01:53:49.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.690+0000 7f6353163740 1 Processor -- start 2024-08-20T01:53:49.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.690+0000 7f6353163740 1 -- start start 2024-08-20T01:53:49.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.690+0000 7f6353163740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5594193543b0 0x559419378650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:49.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.690+0000 7f6353163740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559419354cd0 0x559419378b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:49.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.690+0000 7f6353163740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559419360c60 0x55941935ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:49.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.690+0000 7f6353163740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f634c1b01e0 con 0x559419360c60 2024-08-20T01:53:49.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.690+0000 7f6353163740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f634c1b1d20 con 0x5594193543b0 2024-08-20T01:53:49.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.690+0000 7f6353163740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f634c1b08b0 con 0x559419354cd0 2024-08-20T01:53:49.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.690+0000 7f634ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559419360c60 0x55941935ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:49.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.690+0000 7f634ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559419360c60 0x55941935ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36028/0 (socket says 172.21.15.79:36028) 2024-08-20T01:53:49.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.690+0000 7f634ad9d640 1 -- 172.21.15.79:0/4096436556 learned_addr learned my addr 172.21.15.79:0/4096436556 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:49.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.690+0000 7f634a59c640 1 --2- 172.21.15.79:0/4096436556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5594193543b0 0x559419378650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:49.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.690+0000 7f6349d9b640 1 --2- 172.21.15.79:0/4096436556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559419354cd0 0x559419378b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:49.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.691+0000 7f634a59c640 1 -- 172.21.15.79:0/4096436556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559419354cd0 msgr2=0x559419378b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:49.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.691+0000 7f634a59c640 1 --2- 172.21.15.79:0/4096436556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559419354cd0 0x559419378b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:49.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.691+0000 7f634a59c640 1 -- 172.21.15.79:0/4096436556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559419360c60 msgr2=0x55941935ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:49.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.691+0000 7f634a59c640 1 --2- 172.21.15.79:0/4096436556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559419360c60 0x55941935ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:49.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.691+0000 7f634a59c640 1 -- 172.21.15.79:0/4096436556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55941935cb60 con 0x5594193543b0 2024-08-20T01:53:49.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.691+0000 7f634ad9d640 1 --2- 172.21.15.79:0/4096436556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559419360c60 0x55941935ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:53:49.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.691+0000 7f6349d9b640 1 --2- 172.21.15.79:0/4096436556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559419354cd0 0x559419378b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:53:49.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.691+0000 7f634a59c640 1 --2- 172.21.15.79:0/4096436556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5594193543b0 0x559419378650 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f633c01c040 tx=0x7f633c00e510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ef1f5f802cfc58d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:49.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.691+0000 7f6333fff640 1 -- 172.21.15.79:0/4096436556 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c01e040 con 0x5594193543b0 2024-08-20T01:53:49.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.691+0000 7f6333fff640 1 -- 172.21.15.79:0/4096436556 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f633c01f040 con 0x5594193543b0 2024-08-20T01:53:49.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.691+0000 7f6333fff640 1 -- 172.21.15.79:0/4096436556 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c00e6b0 con 0x5594193543b0 2024-08-20T01:53:49.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.692+0000 7f6353163740 1 -- 172.21.15.79:0/4096436556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5594193543b0 msgr2=0x559419378650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:49.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.692+0000 7f6353163740 1 --2- 172.21.15.79:0/4096436556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5594193543b0 0x559419378650 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f633c01c040 tx=0x7f633c00e510 comp rx=0 tx=0).stop 2024-08-20T01:53:49.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.692+0000 7f6353163740 1 -- 172.21.15.79:0/4096436556 shutdown_connections 2024-08-20T01:53:49.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.692+0000 7f6353163740 1 --2- 172.21.15.79:0/4096436556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559419360c60 0x55941935ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:49.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.692+0000 7f6353163740 1 --2- 172.21.15.79:0/4096436556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559419354cd0 0x559419378b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:49.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.692+0000 7f6353163740 1 --2- 172.21.15.79:0/4096436556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5594193543b0 0x559419378650 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:49.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.692+0000 7f6353163740 1 -- 172.21.15.79:0/4096436556 >> 172.21.15.79:0/4096436556 conn(0x5594193521e0 msgr2=0x55941935fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:49.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.692+0000 7f6353163740 1 -- 172.21.15.79:0/4096436556 shutdown_connections 2024-08-20T01:53:49.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.692+0000 7f6353163740 1 -- 172.21.15.79:0/4096436556 wait complete. 2024-08-20T01:53:49.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.692+0000 7f6353163740 1 -- start start 2024-08-20T01:53:49.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.692+0000 7f6353163740 1 Processor -- start 2024-08-20T01:53:49.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.693+0000 7f6353163740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5594193543b0 0x559419368c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:49.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.693+0000 7f6353163740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559419354cd0 0x559419369180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:49.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.693+0000 7f6353163740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559419360c60 0x559419365c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:49.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.693+0000 7f6353163740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f634c1b1650 con 0x559419354cd0 2024-08-20T01:53:49.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.693+0000 7f6353163740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f634c1b0f80 con 0x5594193543b0 2024-08-20T01:53:49.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.693+0000 7f6353163740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f634c1ae1c0 con 0x559419360c60 2024-08-20T01:53:49.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.693+0000 7f6353163740 10 client.0 _ll_register_callbacks cb 0x7f63400e7640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:53:49.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.693+0000 7f6349d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559419354cd0 0x559419369180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:49.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.693+0000 7f6349d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559419354cd0 0x559419369180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36036/0 (socket says 172.21.15.79:36036) 2024-08-20T01:53:49.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.693+0000 7f6349d9b640 1 -- 172.21.15.79:0/1461638383 learned_addr learned my addr 172.21.15.79:0/1461638383 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:49.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.693+0000 7f634a59c640 1 --2- 172.21.15.79:0/1461638383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5594193543b0 0x559419368c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:49.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.693+0000 7f634ad9d640 1 --2- 172.21.15.79:0/1461638383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559419360c60 0x559419365c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:49.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.693+0000 7f6349d9b640 1 -- 172.21.15.79:0/1461638383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559419360c60 msgr2=0x559419365c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:49.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.693+0000 7f6349d9b640 1 --2- 172.21.15.79:0/1461638383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559419360c60 0x559419365c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:49.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.693+0000 7f6349d9b640 1 -- 172.21.15.79:0/1461638383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5594193543b0 msgr2=0x559419368c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:49.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.693+0000 7f6349d9b640 1 --2- 172.21.15.79:0/1461638383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5594193543b0 0x559419368c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:49.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.693+0000 7f6349d9b640 1 -- 172.21.15.79:0/1461638383 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559419366150 con 0x559419354cd0 2024-08-20T01:53:49.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.693+0000 7f634a59c640 1 --2- 172.21.15.79:0/1461638383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5594193543b0 0x559419368c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:53:49.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.693+0000 7f6349d9b640 1 --2- 172.21.15.79:0/1461638383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559419354cd0 0x559419369180 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f63400aae50 tx=0x7f63400aa330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb796cc3d3ebc66 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:49.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.693+0000 7f6331ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:53:49.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.693+0000 7f6331ffb640 1 -- 172.21.15.79:0/1461638383 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63400aa9d0 con 0x559419354cd0 2024-08-20T01:53:49.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.693+0000 7f6331ffb640 1 -- 172.21.15.79:0/1461638383 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f63400a9da0 con 0x559419354cd0 2024-08-20T01:53:49.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.693+0000 7f6353163740 1 -- 172.21.15.79:0/1461638383 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f633c01f040 con 0x559419354cd0 2024-08-20T01:53:49.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.694+0000 7f6331ffb640 1 -- 172.21.15.79:0/1461638383 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f63400af410 con 0x559419354cd0 2024-08-20T01:53:49.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.694+0000 7f6353163740 10 client.19614 fetch_fsmap learned FSMap version 69 2024-08-20T01:53:49.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.694+0000 7f6353163740 1 -- 172.21.15.79:0/1461638383 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) -- 0x5594193dbd20 con 0x559419354cd0 2024-08-20T01:53:49.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.694+0000 7f6331ffb640 1 -- 172.21.15.79:0/1461638383 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f633c01f040 con 0x559419354cd0 2024-08-20T01:53:49.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.694+0000 7f6331ffb640 1 -- 172.21.15.79:0/1461638383 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 69) ==== 8366+0+0 (secure 0 0 0) 0x7f63400e7ad0 con 0x559419354cd0 2024-08-20T01:53:49.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.694+0000 7f6353163740 10 client.19614 fetch_fsmap finished waiting for FSMap version 69 2024-08-20T01:53:49.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.694+0000 7f6353163740 10 client.19614 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:53:49.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.694+0000 7f6353163740 20 client.19614 populate_metadata read hostname 'smithi079' 2024-08-20T01:53:49.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.694+0000 7f6353163740 1 --2- 172.21.15.79:0/1461638383 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x559419370a00 0x5594193de4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:49.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.694+0000 7f6353163740 4 client.19614 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T01:53:49.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.694+0000 7f6353163740 1 -- 172.21.15.79:0/1461638383 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5594192c8330 con 0x559419370a00 2024-08-20T01:53:49.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.694+0000 7f634a59c640 1 --2- 172.21.15.79:0/1461638383 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x559419370a00 0x5594193de4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:49.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.695+0000 7f634a59c640 1 --2- 172.21.15.79:0/1461638383 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x559419370a00 0x5594193de4b0 crc :-1 s=READY pgs=337 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61c81445a637193 server_cookie=c4cdd4a43752bdc4 in_seq=0 out_seq=0 2024-08-20T01:53:49.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.695+0000 7f6331ffb640 10 client.19614 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:53:49.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.695+0000 7f6331ffb640 1 -- 172.21.15.79:0/1461638383 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5594192c8330 con 0x559419370a00 2024-08-20T01:53:49.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.695+0000 7f6331ffb640 10 client.19614 handle_command_reply: tid=0 2024-08-20T01:53:49.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.696+0000 7f6353163740 1 client.19614 shutdown 2024-08-20T01:53:49.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.696+0000 7f6353163740 1 -- 172.21.15.79:0/1461638383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559419354cd0 msgr2=0x559419369180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:49.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.696+0000 7f6353163740 1 --2- 172.21.15.79:0/1461638383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559419354cd0 0x559419369180 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f63400aae50 tx=0x7f63400aa330 comp rx=0 tx=0).stop 2024-08-20T01:53:49.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.696+0000 7f6353163740 1 -- 172.21.15.79:0/1461638383 shutdown_connections 2024-08-20T01:53:49.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.696+0000 7f6353163740 1 --2- 172.21.15.79:0/1461638383 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x559419370a00 0x5594193de4b0 crc :-1 s=READY pgs=337 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:49.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.696+0000 7f6353163740 1 --2- 172.21.15.79:0/1461638383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559419360c60 0x559419365c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:49.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.696+0000 7f6353163740 1 --2- 172.21.15.79:0/1461638383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559419354cd0 0x559419369180 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:49.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.696+0000 7f6331ffb640 0 client.19614 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:53:49.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.696+0000 7f6353163740 1 --2- 172.21.15.79:0/1461638383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5594193543b0 0x559419368c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:49.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.696+0000 7f6353163740 1 -- 172.21.15.79:0/1461638383 >> 172.21.15.79:0/1461638383 conn(0x5594193521e0 msgr2=0x55941935db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:49.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.696+0000 7f6353163740 1 -- 172.21.15.79:0/1461638383 shutdown_connections 2024-08-20T01:53:49.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.696+0000 7f6353163740 1 -- 172.21.15.79:0/1461638383 wait complete. 2024-08-20T01:53:49.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.696+0000 7f6353163740 20 client.19614 trim_cache size 0 max 16384 2024-08-20T01:53:49.710 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:53:49.710 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-08-20T01:53:49.710 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "0b94f3a1-65db-45a7-873f-7fd33d87702c", 2024-08-20T01:53:49.711 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-08-20T01:53:49.711 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:53:49.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.697+0000 7f6350d6a640 1 -- 172.21.15.79:0/3199342634 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f63340b3bd0 msgr2=0x7f63340b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:49.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.697+0000 7f6350d6a640 1 --2- 172.21.15.79:0/3199342634 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f63340b3bd0 0x7f63340b6090 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f6344031040 tx=0x7f634402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:53:49.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.697+0000 7f6350d6a640 1 -- 172.21.15.79:0/3199342634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f634c108500 msgr2=0x7f634c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:49.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.697+0000 7f6350d6a640 1 --2- 172.21.15.79:0/3199342634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f634c108500 0x7f634c075710 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f634000e9f0 tx=0x7f634000eeb0 comp rx=0 tx=0).stop 2024-08-20T01:53:49.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.697+0000 7f6350d6a640 1 -- 172.21.15.79:0/3199342634 shutdown_connections 2024-08-20T01:53:49.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.697+0000 7f6350d6a640 1 --2- 172.21.15.79:0/3199342634 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f634c108e80 0x7f634c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:49.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.697+0000 7f6350d6a640 1 --2- 172.21.15.79:0/3199342634 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f63340b3bd0 0x7f63340b6090 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:49.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.697+0000 7f6350d6a640 1 --2- 172.21.15.79:0/3199342634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f634c108500 0x7f634c075710 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:49.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.697+0000 7f6350d6a640 1 --2- 172.21.15.79:0/3199342634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f634c102af0 0x7f634c0751d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:49.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.697+0000 7f6350d6a640 1 -- 172.21.15.79:0/3199342634 >> 172.21.15.79:0/3199342634 conn(0x7f634c0fe540 msgr2=0x7f634c0fee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:49.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.697+0000 7f6350d6a640 1 -- 172.21.15.79:0/3199342634 shutdown_connections 2024-08-20T01:53:49.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:49.697+0000 7f6350d6a640 1 -- 172.21.15.79:0/3199342634 wait complete. 2024-08-20T01:53:50.329 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:50 smithi079 ceph-mon[18656]: pgmap v842: 97 pgs: 97 active+clean; 5.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.7 KiB/s wr, 21 op/s 2024-08-20T01:53:50.329 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:50 smithi079 ceph-mon[18656]: scrub queued for path: / 2024-08-20T01:53:50.329 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:50 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:53:50.329 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:50 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:53:50.330 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:50 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:53:50.330 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:50 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:53:50.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:50 smithi175 ceph-mon[22392]: pgmap v842: 97 pgs: 97 active+clean; 5.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.7 KiB/s wr, 21 op/s 2024-08-20T01:53:50.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:50 smithi175 ceph-mon[22392]: scrub queued for path: / 2024-08-20T01:53:50.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:50 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:53:50.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:50 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:53:50.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:50 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:53:50.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:50 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:53:50.437 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:53:50.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:50 smithi081 ceph-mon[22209]: pgmap v842: 97 pgs: 97 active+clean; 5.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.7 KiB/s wr, 21 op/s 2024-08-20T01:53:50.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:50 smithi081 ceph-mon[22209]: scrub queued for path: / 2024-08-20T01:53:50.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:50 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:53:50.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:50 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:53:50.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:50 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:53:50.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:50 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:53:50.688 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:53:51.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.157+0000 7f4591192640 1 -- 172.21.15.79:0/335166393 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f458c1073a0 msgr2=0x7f458c1077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:51.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.157+0000 7f4591192640 1 --2- 172.21.15.79:0/335166393 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f458c1073a0 0x7f458c1077e0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f4574009900 tx=0x7f457402a410 comp rx=0 tx=0).stop 2024-08-20T01:53:51.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.157+0000 7f4591192640 1 -- 172.21.15.79:0/335166393 shutdown_connections 2024-08-20T01:53:51.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.157+0000 7f4591192640 1 --2- 172.21.15.79:0/335166393 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f458c107d20 0x7f458c10e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:51.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.157+0000 7f4591192640 1 --2- 172.21.15.79:0/335166393 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f458c1073a0 0x7f458c1077e0 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:51.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.157+0000 7f4591192640 1 --2- 172.21.15.79:0/335166393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f458c101990 0x7f458c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:51.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.157+0000 7f4591192640 1 -- 172.21.15.79:0/335166393 >> 172.21.15.79:0/335166393 conn(0x7f458c0fd400 msgr2=0x7f458c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:51.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.157+0000 7f4591192640 1 -- 172.21.15.79:0/335166393 shutdown_connections 2024-08-20T01:53:51.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.157+0000 7f4591192640 1 -- 172.21.15.79:0/335166393 wait complete. 2024-08-20T01:53:51.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.158+0000 7f4591192640 1 Processor -- start 2024-08-20T01:53:51.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.158+0000 7f4591192640 1 -- start start 2024-08-20T01:53:51.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.158+0000 7f4591192640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f458c101990 0x7f458c10f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:51.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.158+0000 7f4591192640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f458c1073a0 0x7f458c10f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:51.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.158+0000 7f4591192640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f458c107d20 0x7f458c10fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:51.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.158+0000 7f4591192640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f458c1129b0 con 0x7f458c107d20 2024-08-20T01:53:51.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.158+0000 7f4591192640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f458c112830 con 0x7f458c1073a0 2024-08-20T01:53:51.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.158+0000 7f4591192640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f458c112b30 con 0x7f458c101990 2024-08-20T01:53:51.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.158+0000 7f458b59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f458c107d20 0x7f458c10fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:51.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.158+0000 7f458b59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f458c107d20 0x7f458c10fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47478/0 (socket says 172.21.15.79:47478) 2024-08-20T01:53:51.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.158+0000 7f458b59e640 1 -- 172.21.15.79:0/1226780602 learned_addr learned my addr 172.21.15.79:0/1226780602 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:51.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.159+0000 7f458259c640 1 --2- 172.21.15.79:0/1226780602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f458c1073a0 0x7f458c10f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:51.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.159+0000 7f458ad9d640 1 --2- 172.21.15.79:0/1226780602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f458c101990 0x7f458c10f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:51.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.159+0000 7f458b59e640 1 -- 172.21.15.79:0/1226780602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f458c101990 msgr2=0x7f458c10f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:51.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.159+0000 7f458b59e640 1 --2- 172.21.15.79:0/1226780602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f458c101990 0x7f458c10f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:51.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.159+0000 7f458b59e640 1 -- 172.21.15.79:0/1226780602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f458c1073a0 msgr2=0x7f458c10f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:51.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.159+0000 7f458b59e640 1 --2- 172.21.15.79:0/1226780602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f458c1073a0 0x7f458c10f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:51.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.159+0000 7f458b59e640 1 -- 172.21.15.79:0/1226780602 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f458c1a72e0 con 0x7f458c107d20 2024-08-20T01:53:51.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.159+0000 7f458b59e640 1 --2- 172.21.15.79:0/1226780602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f458c107d20 0x7f458c10fab0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f458400eaa0 tx=0x7f458400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:51.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.159+0000 7f4588d99640 1 -- 172.21.15.79:0/1226780602 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458400cdb0 con 0x7f458c107d20 2024-08-20T01:53:51.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.159+0000 7f4588d99640 1 -- 172.21.15.79:0/1226780602 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4584005020 con 0x7f458c107d20 2024-08-20T01:53:51.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.159+0000 7f4591192640 1 -- 172.21.15.79:0/1226780602 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f458c1a75d0 con 0x7f458c107d20 2024-08-20T01:53:51.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.159+0000 7f4588d99640 1 -- 172.21.15.79:0/1226780602 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45840116d0 con 0x7f458c107d20 2024-08-20T01:53:51.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.159+0000 7f4591192640 1 -- 172.21.15.79:0/1226780602 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f458c1a7ae0 con 0x7f458c107d20 2024-08-20T01:53:51.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.162+0000 7f4588d99640 1 -- 172.21.15.79:0/1226780602 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f45840051d0 con 0x7f458c107d20 2024-08-20T01:53:51.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.162+0000 7f459358b740 1 Processor -- start 2024-08-20T01:53:51.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.162+0000 7f459358b740 1 -- start start 2024-08-20T01:53:51.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.162+0000 7f459358b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560af415d830 0x560af415dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:51.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.162+0000 7f459358b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af415e150 0x560af4169ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:51.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.162+0000 7f459358b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560af416a0e0 0x560af416c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:51.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.162+0000 7f459358b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560af40d48e0 con 0x560af415d830 2024-08-20T01:53:51.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.162+0000 7f459358b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560af40c3de0 con 0x560af416a0e0 2024-08-20T01:53:51.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.162+0000 7f459358b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560af40c7e20 con 0x560af415e150 2024-08-20T01:53:51.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.162+0000 7f458259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560af415d830 0x560af415dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:51.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.162+0000 7f458259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560af415d830 0x560af415dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47492/0 (socket says 172.21.15.79:47492) 2024-08-20T01:53:51.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.162+0000 7f458ad9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af415e150 0x560af4169ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:51.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.162+0000 7f458259c640 1 -- 172.21.15.79:0/3433205962 learned_addr learned my addr 172.21.15.79:0/3433205962 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:51.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.162+0000 7f458259c640 1 --2- 172.21.15.79:0/3433205962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560af416a0e0 0x560af416c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:51.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.163+0000 7f458ad9d640 1 -- 172.21.15.79:0/3433205962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560af416a0e0 msgr2=0x560af416c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:51.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.163+0000 7f458ad9d640 1 --2- 172.21.15.79:0/3433205962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560af416a0e0 0x560af416c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:51.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.163+0000 7f458ad9d640 1 -- 172.21.15.79:0/3433205962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560af415d830 msgr2=0x560af415dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:51.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.163+0000 7f458ad9d640 1 --2- 172.21.15.79:0/3433205962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560af415d830 0x560af415dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:51.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.163+0000 7f458ad9d640 1 -- 172.21.15.79:0/3433205962 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560af3e23650 con 0x560af415e150 2024-08-20T01:53:51.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.163+0000 7f458259c640 1 --2- 172.21.15.79:0/3433205962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560af415d830 0x560af415dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:53:51.203 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:53:51.203 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "scrub active (0 inodes in the stack)", 2024-08-20T01:53:51.203 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": { 2024-08-20T01:53:51.203 INFO:teuthology.orchestra.run.smithi079.stdout: "0b94f3a1-65db-45a7-873f-7fd33d87702c": { 2024-08-20T01:53:51.203 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/", 2024-08-20T01:53:51.204 INFO:teuthology.orchestra.run.smithi079.stdout: "tag": "0b94f3a1-65db-45a7-873f-7fd33d87702c", 2024-08-20T01:53:51.204 INFO:teuthology.orchestra.run.smithi079.stdout: "options": "recursive,force" 2024-08-20T01:53:51.204 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:53:51.204 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:53:51.204 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:53:51.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.163+0000 7f458ad9d640 1 --2- 172.21.15.79:0/3433205962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af415e150 0x560af4169ba0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f457c00bc20 tx=0x7f457c0107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=993777fb2c70c9e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:51.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.163+0000 7f4588d99640 1 --2- 172.21.15.79:0/1226780602 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f45780b3bd0 0x7f45780b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:51.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.163+0000 7f458159a640 1 -- 172.21.15.79:0/3433205962 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457c004030 con 0x560af415e150 2024-08-20T01:53:51.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.163+0000 7f458159a640 1 -- 172.21.15.79:0/3433205962 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f457c0035f0 con 0x560af415e150 2024-08-20T01:53:51.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.163+0000 7f458159a640 1 -- 172.21.15.79:0/3433205962 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457c0116a0 con 0x560af415e150 2024-08-20T01:53:51.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.163+0000 7f458259c640 1 --2- 172.21.15.79:0/1226780602 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f45780b3bd0 0x7f45780b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:51.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.163+0000 7f4588d99640 1 -- 172.21.15.79:0/1226780602 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f45840e3cf0 con 0x7f458c107d20 2024-08-20T01:53:51.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.164+0000 7f459358b740 1 -- 172.21.15.79:0/3433205962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af415e150 msgr2=0x560af4169ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:51.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.164+0000 7f458259c640 1 --2- 172.21.15.79:0/1226780602 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f45780b3bd0 0x7f45780b6090 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x560af415d7e0 tx=0x7f4574005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:51.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.164+0000 7f459358b740 1 --2- 172.21.15.79:0/3433205962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af415e150 0x560af4169ba0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f457c00bc20 tx=0x7f457c0107a0 comp rx=0 tx=0).stop 2024-08-20T01:53:51.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.164+0000 7f459358b740 1 -- 172.21.15.79:0/3433205962 shutdown_connections 2024-08-20T01:53:51.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.164+0000 7f459358b740 1 --2- 172.21.15.79:0/3433205962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560af416a0e0 0x560af416c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:51.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.164+0000 7f459358b740 1 --2- 172.21.15.79:0/3433205962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af415e150 0x560af4169ba0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:51.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.164+0000 7f459358b740 1 --2- 172.21.15.79:0/3433205962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560af415d830 0x560af415dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:51.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.164+0000 7f459358b740 1 -- 172.21.15.79:0/3433205962 >> 172.21.15.79:0/3433205962 conn(0x560af415b660 msgr2=0x560af415c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:51.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.164+0000 7f459358b740 1 -- 172.21.15.79:0/3433205962 shutdown_connections 2024-08-20T01:53:51.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.164+0000 7f459358b740 1 -- 172.21.15.79:0/3433205962 wait complete. 2024-08-20T01:53:51.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.164+0000 7f459358b740 1 -- start start 2024-08-20T01:53:51.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.164+0000 7f459358b740 1 Processor -- start 2024-08-20T01:53:51.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.165+0000 7f459358b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af415d830 0x560af41670a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:51.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.165+0000 7f459358b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560af415e150 0x560af41675e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:51.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.165+0000 7f459358b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560af416a0e0 0x560af4167b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:51.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.165+0000 7f459358b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560af3f26700 con 0x560af415e150 2024-08-20T01:53:51.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.165+0000 7f459358b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560af404a7c0 con 0x560af416a0e0 2024-08-20T01:53:51.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.165+0000 7f459358b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560af416cd90 con 0x560af415d830 2024-08-20T01:53:51.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.165+0000 7f459358b740 10 client.0 _ll_register_callbacks cb 0x560af40bd6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:53:51.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.165+0000 7f458259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560af415e150 0x560af41675e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:51.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.165+0000 7f458259c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560af415e150 0x560af41675e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47494/0 (socket says 172.21.15.79:47494) 2024-08-20T01:53:51.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.165+0000 7f458259c640 1 -- 172.21.15.79:0/1743978003 learned_addr learned my addr 172.21.15.79:0/1743978003 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:51.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.165+0000 7f458b59e640 1 --2- 172.21.15.79:0/1743978003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560af416a0e0 0x560af4167b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:51.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.165+0000 7f458ad9d640 1 --2- 172.21.15.79:0/1743978003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af415d830 0x560af41670a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:51.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.165+0000 7f458b59e640 1 -- 172.21.15.79:0/1743978003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af415d830 msgr2=0x560af41670a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:51.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.165+0000 7f458b59e640 1 --2- 172.21.15.79:0/1743978003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af415d830 0x560af41670a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:51.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.165+0000 7f458b59e640 1 -- 172.21.15.79:0/1743978003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560af415e150 msgr2=0x560af41675e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:51.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.165+0000 7f458b59e640 1 --2- 172.21.15.79:0/1743978003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560af415e150 0x560af41675e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:51.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.165+0000 7f458b59e640 1 -- 172.21.15.79:0/1743978003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560af41761a0 con 0x560af416a0e0 2024-08-20T01:53:51.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.165+0000 7f458259c640 1 --2- 172.21.15.79:0/1743978003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560af415e150 0x560af41675e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:53:51.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.165+0000 7f458b59e640 1 --2- 172.21.15.79:0/1743978003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560af416a0e0 0x560af4167b20 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4584009270 tx=0x7f45840aa970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0c008945be93aeb server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:51.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.165+0000 7f45727fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:53:51.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.165+0000 7f45727fc640 1 -- 172.21.15.79:0/1743978003 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458401f040 con 0x560af416a0e0 2024-08-20T01:53:51.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.166+0000 7f45727fc640 1 -- 172.21.15.79:0/1743978003 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f45840a9f60 con 0x560af416a0e0 2024-08-20T01:53:51.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.166+0000 7f459358b740 1 -- 172.21.15.79:0/1743978003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560af4073100 con 0x560af416a0e0 2024-08-20T01:53:51.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.166+0000 7f45727fc640 1 -- 172.21.15.79:0/1743978003 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f45840aa1a0 con 0x560af416a0e0 2024-08-20T01:53:51.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.166+0000 7f459358b740 10 client.28718 fetch_fsmap learned FSMap version 69 2024-08-20T01:53:51.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.166+0000 7f459358b740 1 -- 172.21.15.79:0/1743978003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) -- 0x560af4178b50 con 0x560af416a0e0 2024-08-20T01:53:51.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.166+0000 7f45727fc640 1 -- 172.21.15.79:0/1743978003 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x560af4073100 con 0x560af416a0e0 2024-08-20T01:53:51.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.166+0000 7f45727fc640 1 -- 172.21.15.79:0/1743978003 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 69) ==== 8366+0+0 (secure 0 0 0) 0x7f45840c1060 con 0x560af416a0e0 2024-08-20T01:53:51.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.166+0000 7f459358b740 10 client.28718 fetch_fsmap finished waiting for FSMap version 69 2024-08-20T01:53:51.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.166+0000 7f459358b740 10 client.28718 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:53:51.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.166+0000 7f459358b740 20 client.28718 populate_metadata read hostname 'smithi079' 2024-08-20T01:53:51.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.166+0000 7f459358b740 1 --2- 172.21.15.79:0/1743978003 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560af4179fd0 0x560af417c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:51.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.166+0000 7f459358b740 4 client.28718 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:53:51.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.166+0000 7f459358b740 1 -- 172.21.15.79:0/1743978003 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560af40d6830 con 0x560af4179fd0 2024-08-20T01:53:51.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.166+0000 7f458ad9d640 1 --2- 172.21.15.79:0/1743978003 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560af4179fd0 0x560af417c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:51.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.167+0000 7f458ad9d640 1 --2- 172.21.15.79:0/1743978003 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560af4179fd0 0x560af417c3e0 crc :-1 s=READY pgs=338 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a15f73cf7ddd5b33 server_cookie=56de96c683808895 in_seq=0 out_seq=0 2024-08-20T01:53:51.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.167+0000 7f45727fc640 10 client.28718 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:53:51.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.167+0000 7f45727fc640 1 -- 172.21.15.79:0/1743978003 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560af40d6830 con 0x560af4179fd0 2024-08-20T01:53:51.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.167+0000 7f45727fc640 10 client.28718 handle_command_reply: tid=0 2024-08-20T01:53:51.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.167+0000 7f459358b740 1 client.28718 shutdown 2024-08-20T01:53:51.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.167+0000 7f459358b740 1 -- 172.21.15.79:0/1743978003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560af416a0e0 msgr2=0x560af4167b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:51.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.167+0000 7f459358b740 1 --2- 172.21.15.79:0/1743978003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560af416a0e0 0x560af4167b20 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4584009270 tx=0x7f45840aa970 comp rx=0 tx=0).stop 2024-08-20T01:53:51.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.167+0000 7f459358b740 1 -- 172.21.15.79:0/1743978003 shutdown_connections 2024-08-20T01:53:51.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.167+0000 7f459358b740 1 --2- 172.21.15.79:0/1743978003 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560af4179fd0 0x560af417c3e0 crc :-1 s=READY pgs=338 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:51.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.167+0000 7f459358b740 1 --2- 172.21.15.79:0/1743978003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560af416a0e0 0x560af4167b20 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:51.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.167+0000 7f459358b740 1 --2- 172.21.15.79:0/1743978003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560af415e150 0x560af41675e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:51.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.167+0000 7f459358b740 1 --2- 172.21.15.79:0/1743978003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af415d830 0x560af41670a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:51.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.167+0000 7f45727fc640 0 client.28718 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:53:51.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.167+0000 7f459358b740 1 -- 172.21.15.79:0/1743978003 >> 172.21.15.79:0/1743978003 conn(0x560af415b660 msgr2=0x560af4161200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:51.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.167+0000 7f459358b740 1 -- 172.21.15.79:0/1743978003 shutdown_connections 2024-08-20T01:53:51.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.168+0000 7f459358b740 1 -- 172.21.15.79:0/1743978003 wait complete. 2024-08-20T01:53:51.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.168+0000 7f459358b740 20 client.28718 trim_cache size 0 max 16384 2024-08-20T01:53:51.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.185+0000 7f459358b740 1 Processor -- start 2024-08-20T01:53:51.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.185+0000 7f459358b740 1 -- start start 2024-08-20T01:53:51.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.186+0000 7f459358b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af415d830 0x560af415ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:51.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.186+0000 7f459358b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560af415e150 0x560af4181d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:51.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.186+0000 7f459358b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560af416a0e0 0x560af4182240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:51.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.186+0000 7f459358b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f458c1b01d0 con 0x560af416a0e0 2024-08-20T01:53:51.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.186+0000 7f459358b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f458c1b1d10 con 0x560af415e150 2024-08-20T01:53:51.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.186+0000 7f459358b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f458c1b08a0 con 0x560af415d830 2024-08-20T01:53:51.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.186+0000 7f458b59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560af416a0e0 0x560af4182240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:51.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.186+0000 7f458b59e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560af416a0e0 0x560af4182240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47500/0 (socket says 172.21.15.79:47500) 2024-08-20T01:53:51.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.186+0000 7f458b59e640 1 -- 172.21.15.79:0/2807105676 learned_addr learned my addr 172.21.15.79:0/2807105676 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:51.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.186+0000 7f458ad9d640 1 --2- 172.21.15.79:0/2807105676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af415d830 0x560af415ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:51.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.186+0000 7f458259c640 1 --2- 172.21.15.79:0/2807105676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560af415e150 0x560af4181d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:51.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.186+0000 7f458b59e640 1 -- 172.21.15.79:0/2807105676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af415d830 msgr2=0x560af415ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:51.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.186+0000 7f458b59e640 1 --2- 172.21.15.79:0/2807105676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af415d830 0x560af415ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:51.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.186+0000 7f458b59e640 1 -- 172.21.15.79:0/2807105676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560af415e150 msgr2=0x560af4181d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:51.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.186+0000 7f458b59e640 1 --2- 172.21.15.79:0/2807105676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560af415e150 0x560af4181d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:51.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.186+0000 7f458b59e640 1 -- 172.21.15.79:0/2807105676 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560af415b490 con 0x560af416a0e0 2024-08-20T01:53:51.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.186+0000 7f458ad9d640 1 --2- 172.21.15.79:0/2807105676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af415d830 0x560af415ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:53:51.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.186+0000 7f458259c640 1 --2- 172.21.15.79:0/2807105676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560af415e150 0x560af4181d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:53:51.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.186+0000 7f458b59e640 1 --2- 172.21.15.79:0/2807105676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560af416a0e0 0x560af4182240 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f45840e4010 tx=0x7f45840b3e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c23daeebb65a6a4e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:51.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.186+0000 7f4580d99640 1 -- 172.21.15.79:0/2807105676 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458401f030 con 0x560af416a0e0 2024-08-20T01:53:51.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.186+0000 7f4580d99640 1 -- 172.21.15.79:0/2807105676 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45840a9f60 con 0x560af416a0e0 2024-08-20T01:53:51.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.186+0000 7f4580d99640 1 -- 172.21.15.79:0/2807105676 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45840b03e0 con 0x560af416a0e0 2024-08-20T01:53:51.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.187+0000 7f459358b740 1 -- 172.21.15.79:0/2807105676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560af416a0e0 msgr2=0x560af4182240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:51.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.187+0000 7f459358b740 1 --2- 172.21.15.79:0/2807105676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560af416a0e0 0x560af4182240 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f45840e4010 tx=0x7f45840b3e80 comp rx=0 tx=0).stop 2024-08-20T01:53:51.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.187+0000 7f459358b740 1 -- 172.21.15.79:0/2807105676 shutdown_connections 2024-08-20T01:53:51.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.187+0000 7f459358b740 1 --2- 172.21.15.79:0/2807105676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560af416a0e0 0x560af4182240 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:51.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.187+0000 7f459358b740 1 --2- 172.21.15.79:0/2807105676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560af415e150 0x560af4181d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:51.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.187+0000 7f459358b740 1 --2- 172.21.15.79:0/2807105676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af415d830 0x560af415ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:51.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.187+0000 7f459358b740 1 -- 172.21.15.79:0/2807105676 >> 172.21.15.79:0/2807105676 conn(0x560af415b660 msgr2=0x560af415c770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:51.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.187+0000 7f459358b740 1 -- 172.21.15.79:0/2807105676 shutdown_connections 2024-08-20T01:53:51.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.187+0000 7f459358b740 1 -- 172.21.15.79:0/2807105676 wait complete. 2024-08-20T01:53:51.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.188+0000 7f459358b740 1 -- start start 2024-08-20T01:53:51.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.188+0000 7f459358b740 1 Processor -- start 2024-08-20T01:53:51.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.188+0000 7f459358b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560af415d830 0x560af416f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:51.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.188+0000 7f459358b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560af415e150 0x560af416f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:51.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.188+0000 7f459358b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af416a0e0 0x560af41e2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:51.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.188+0000 7f459358b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f458c1b1640 con 0x560af415d830 2024-08-20T01:53:51.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.188+0000 7f459358b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f458c1b0f70 con 0x560af415e150 2024-08-20T01:53:51.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.188+0000 7f459358b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f458c1ae1b0 con 0x560af416a0e0 2024-08-20T01:53:51.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.188+0000 7f459358b740 10 client.0 _ll_register_callbacks cb 0x7f45840a6bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:53:51.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.188+0000 7f458ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560af415d830 0x560af416f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:51.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.188+0000 7f458ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560af415d830 0x560af416f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47506/0 (socket says 172.21.15.79:47506) 2024-08-20T01:53:51.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.188+0000 7f458ad9d640 1 -- 172.21.15.79:0/3708844418 learned_addr learned my addr 172.21.15.79:0/3708844418 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:53:51.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.188+0000 7f458259c640 1 --2- 172.21.15.79:0/3708844418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560af415e150 0x560af416f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:51.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.188+0000 7f458b59e640 1 --2- 172.21.15.79:0/3708844418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af416a0e0 0x560af41e2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:51.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.188+0000 7f458ad9d640 1 -- 172.21.15.79:0/3708844418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af416a0e0 msgr2=0x560af41e2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:51.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.188+0000 7f458ad9d640 1 --2- 172.21.15.79:0/3708844418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af416a0e0 0x560af41e2cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:51.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.188+0000 7f458ad9d640 1 -- 172.21.15.79:0/3708844418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560af415e150 msgr2=0x560af416f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:53:51.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.188+0000 7f458ad9d640 1 --2- 172.21.15.79:0/3708844418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560af415e150 0x560af416f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:51.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.188+0000 7f458ad9d640 1 -- 172.21.15.79:0/3708844418 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560af41e3210 con 0x560af415d830 2024-08-20T01:53:51.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.188+0000 7f458ad9d640 1 --2- 172.21.15.79:0/3708844418 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560af415d830 0x560af416f1c0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f457c00bc20 tx=0x7f457c00b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea05d758a2fde2f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:53:51.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.188+0000 7f45727fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:53:51.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.189+0000 7f45727fc640 1 -- 172.21.15.79:0/3708844418 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457c0054c0 con 0x560af415d830 2024-08-20T01:53:51.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.189+0000 7f45727fc640 1 -- 172.21.15.79:0/3708844418 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f457c0035f0 con 0x560af415d830 2024-08-20T01:53:51.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.189+0000 7f459358b740 1 -- 172.21.15.79:0/3708844418 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45840a9f60 con 0x560af415d830 2024-08-20T01:53:51.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.189+0000 7f45727fc640 1 -- 172.21.15.79:0/3708844418 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f457c003830 con 0x560af415d830 2024-08-20T01:53:51.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.189+0000 7f459358b740 10 client.19632 fetch_fsmap learned FSMap version 69 2024-08-20T01:53:51.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.189+0000 7f459358b740 1 -- 172.21.15.79:0/3708844418 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) -- 0x560af41e4330 con 0x560af415d830 2024-08-20T01:53:51.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.189+0000 7f45727fc640 1 -- 172.21.15.79:0/3708844418 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45840a9f60 con 0x560af415d830 2024-08-20T01:53:51.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.189+0000 7f45727fc640 1 -- 172.21.15.79:0/3708844418 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 69) ==== 8366+0+0 (secure 0 0 0) 0x7f457c011790 con 0x560af415d830 2024-08-20T01:53:51.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.189+0000 7f459358b740 10 client.19632 fetch_fsmap finished waiting for FSMap version 69 2024-08-20T01:53:51.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.189+0000 7f459358b740 10 client.19632 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:53:51.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.189+0000 7f459358b740 20 client.19632 populate_metadata read hostname 'smithi079' 2024-08-20T01:53:51.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.189+0000 7f459358b740 1 --2- 172.21.15.79:0/3708844418 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560af41e4950 0x560af41e6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:53:51.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.189+0000 7f459358b740 4 client.19632 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:53:51.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.189+0000 7f459358b740 1 -- 172.21.15.79:0/3708844418 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560af4156830 con 0x560af41e4950 2024-08-20T01:53:51.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.189+0000 7f458259c640 1 --2- 172.21.15.79:0/3708844418 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560af41e4950 0x560af41e6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:53:51.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.190+0000 7f45727fc640 10 client.19632 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:53:51.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.190+0000 7f458259c640 1 --2- 172.21.15.79:0/3708844418 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560af41e4950 0x560af41e6d70 crc :-1 s=READY pgs=339 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed50c1c2ec8290ee server_cookie=6af39e9214924227 in_seq=0 out_seq=0 2024-08-20T01:53:51.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.190+0000 7f45727fc640 1 -- 172.21.15.79:0/3708844418 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x560af4156830 con 0x560af41e4950 2024-08-20T01:53:51.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.190+0000 7f45727fc640 10 client.19632 handle_command_reply: tid=0 2024-08-20T01:53:51.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.190+0000 7f459358b740 1 client.19632 shutdown 2024-08-20T01:53:51.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.190+0000 7f459358b740 1 -- 172.21.15.79:0/3708844418 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560af415d830 msgr2=0x560af416f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:51.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.190+0000 7f459358b740 1 --2- 172.21.15.79:0/3708844418 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560af415d830 0x560af416f1c0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f457c00bc20 tx=0x7f457c00b930 comp rx=0 tx=0).stop 2024-08-20T01:53:51.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.190+0000 7f459358b740 1 -- 172.21.15.79:0/3708844418 shutdown_connections 2024-08-20T01:53:51.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.190+0000 7f459358b740 1 --2- 172.21.15.79:0/3708844418 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x560af41e4950 0x560af41e6d70 crc :-1 s=READY pgs=339 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:51.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.190+0000 7f459358b740 1 --2- 172.21.15.79:0/3708844418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af416a0e0 0x560af41e2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:51.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.190+0000 7f45727fc640 0 client.19632 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:53:51.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.190+0000 7f459358b740 1 --2- 172.21.15.79:0/3708844418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560af415e150 0x560af416f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:51.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.190+0000 7f459358b740 1 --2- 172.21.15.79:0/3708844418 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560af415d830 0x560af416f1c0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:51.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.190+0000 7f459358b740 1 -- 172.21.15.79:0/3708844418 >> 172.21.15.79:0/3708844418 conn(0x560af415b660 msgr2=0x560af41609e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:51.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.190+0000 7f459358b740 1 -- 172.21.15.79:0/3708844418 shutdown_connections 2024-08-20T01:53:51.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.190+0000 7f459358b740 1 -- 172.21.15.79:0/3708844418 wait complete. 2024-08-20T01:53:51.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.190+0000 7f459358b740 20 client.19632 trim_cache size 0 max 16384 2024-08-20T01:53:51.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.191+0000 7f4591192640 1 -- 172.21.15.79:0/1226780602 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f45780b3bd0 msgr2=0x7f45780b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:51.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.191+0000 7f4591192640 1 --2- 172.21.15.79:0/1226780602 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f45780b3bd0 0x7f45780b6090 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x560af415d7e0 tx=0x7f4574005fd0 comp rx=0 tx=0).stop 2024-08-20T01:53:51.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.191+0000 7f4591192640 1 -- 172.21.15.79:0/1226780602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f458c107d20 msgr2=0x7f458c10fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:51.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.191+0000 7f4591192640 1 --2- 172.21.15.79:0/1226780602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f458c107d20 0x7f458c10fab0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f458400eaa0 tx=0x7f458400ef60 comp rx=0 tx=0).stop 2024-08-20T01:53:51.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.191+0000 7f4591192640 1 -- 172.21.15.79:0/1226780602 shutdown_connections 2024-08-20T01:53:51.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.191+0000 7f4591192640 1 --2- 172.21.15.79:0/1226780602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f458c107d20 0x7f458c10fab0 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:51.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.191+0000 7f4591192640 1 --2- 172.21.15.79:0/1226780602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f458c1073a0 0x7f458c10f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:51.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.191+0000 7f4591192640 1 --2- 172.21.15.79:0/1226780602 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f45780b3bd0 0x7f45780b6090 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:51.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.191+0000 7f4591192640 1 --2- 172.21.15.79:0/1226780602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f458c101990 0x7f458c10f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:51.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.191+0000 7f4591192640 1 -- 172.21.15.79:0/1226780602 >> 172.21.15.79:0/1226780602 conn(0x7f458c0fd400 msgr2=0x7f458c0ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:51.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.191+0000 7f4591192640 1 -- 172.21.15.79:0/1226780602 shutdown_connections 2024-08-20T01:53:51.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:53:51.191+0000 7f4591192640 1 -- 172.21.15.79:0/1226780602 wait complete. 2024-08-20T01:53:51.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:51 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:53:51.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:51 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:53:51.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:51 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:53:51.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:51 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:53:51.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:51 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:53:51.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:51 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:53:51.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:51 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:53:51.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:51 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:53:51.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:51 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:53:51.998 INFO:tasks.cephfs.filesystem:scrub status for tag:0b94f3a1-65db-45a7-873f-7fd33d87702c - {'path': '/', 'tag': '0b94f3a1-65db-45a7-873f-7fd33d87702c', 'options': 'recursive,force'} 2024-08-20T01:53:52.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:52 smithi175 ceph-mon[22392]: pgmap v843: 97 pgs: 97 active+clean; 5.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 5.9 KiB/s wr, 21 op/s 2024-08-20T01:53:52.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:52 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:53:52.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:52 smithi079 ceph-mon[18656]: pgmap v843: 97 pgs: 97 active+clean; 5.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 5.9 KiB/s wr, 21 op/s 2024-08-20T01:53:52.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:52 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:53:52.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:52 smithi081 ceph-mon[22209]: pgmap v843: 97 pgs: 97 active+clean; 5.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 5.9 KiB/s wr, 21 op/s 2024-08-20T01:53:52.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:52 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:53:52.964 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:52.961+0000 7f96f17fa640 1 -- 172.21.15.79:0/2696622747 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a411d9ed50 con 0x55a411eb0b50 2024-08-20T01:53:52.964 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:52.961+0000 7f96f17fa640 10 client.19506 handle_command_reply: tid=0 2024-08-20T01:53:52.964 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:52.961+0000 7f9712a60740 1 client.19506 shutdown 2024-08-20T01:53:52.964 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:52.961+0000 7f9712a60740 1 -- 172.21.15.79:0/2696622747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a411e33410 msgr2=0x55a411e3f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:52.964 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:52.961+0000 7f9712a60740 1 --2- 172.21.15.79:0/2696622747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a411e33410 0x55a411e3f670 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f96f80099a0 tx=0x7f96f8012e40 comp rx=0 tx=0).stop 2024-08-20T01:53:52.965 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:52.961+0000 7f9712a60740 1 -- 172.21.15.79:0/2696622747 shutdown_connections 2024-08-20T01:53:52.965 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:52.961+0000 7f9712a60740 1 --2- 172.21.15.79:0/2696622747 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55a411eb0b50 0x55a411eb2f70 crc :-1 s=READY pgs=333 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:52.965 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:52.961+0000 7f9712a60740 1 --2- 172.21.15.79:0/2696622747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a411e35e50 0x55a411e401d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:52.965 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:52.961+0000 7f9712a60740 1 --2- 172.21.15.79:0/2696622747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a411e33410 0x55a411e3f670 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:52.965 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:52.961+0000 7f96f17fa640 0 client.19506 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:53:52.965 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:52.961+0000 7f9712a60740 1 --2- 172.21.15.79:0/2696622747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a411e30ae0 0x55a411e3efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:52.965 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:52.961+0000 7f9712a60740 1 -- 172.21.15.79:0/2696622747 >> 172.21.15.79:0/2696622747 conn(0x55a411e29a20 msgr2=0x55a411e37720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:52.965 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:52.961+0000 7f9712a60740 1 -- 172.21.15.79:0/2696622747 shutdown_connections 2024-08-20T01:53:52.965 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:52.961+0000 7f9712a60740 1 -- 172.21.15.79:0/2696622747 wait complete. 2024-08-20T01:53:52.965 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:52.961+0000 7f9712a60740 20 client.19506 trim_cache size 0 max 16384 2024-08-20T01:53:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:53:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:53:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:53:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:53:52.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:52.962+0000 7f970fc67640 1 -- 172.21.15.79:0/4052488114 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f96f40b3bd0 msgr2=0x7f96f40b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:52.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:52.962+0000 7f970fc67640 1 --2- 172.21.15.79:0/4052488114 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f96f40b3bd0 0x7f96f40b6090 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f96f8009dc0 tx=0x7f96f8009720 comp rx=0 tx=0).stop 2024-08-20T01:53:52.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:52.962+0000 7f970fc67640 1 -- 172.21.15.79:0/4052488114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9708103070 msgr2=0x7f9708198b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:53:52.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:52.962+0000 7f970fc67640 1 --2- 172.21.15.79:0/4052488114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9708103070 0x7f9708198b70 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f970000efd0 tx=0x7f970000c6a0 comp rx=0 tx=0).stop 2024-08-20T01:53:52.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:52.962+0000 7f970fc67640 1 -- 172.21.15.79:0/4052488114 shutdown_connections 2024-08-20T01:53:52.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:52.962+0000 7f970fc67640 1 --2- 172.21.15.79:0/4052488114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9708103070 0x7f9708198b70 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:52.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:52.962+0000 7f970fc67640 1 --2- 172.21.15.79:0/4052488114 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f96f40b3bd0 0x7f96f40b6090 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:52.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:52.962+0000 7f970fc67640 1 --2- 172.21.15.79:0/4052488114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97081026b0 0x7f9708197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:52.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:52.962+0000 7f970fc67640 1 --2- 172.21.15.79:0/4052488114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9708101560 0x7f97081978f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:53:52.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:52.962+0000 7f970fc67640 1 -- 172.21.15.79:0/4052488114 >> 172.21.15.79:0/4052488114 conn(0x7f97080fce40 msgr2=0x7f9708105b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:53:52.967 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:52.962+0000 7f970fc67640 1 -- 172.21.15.79:0/4052488114 shutdown_connections 2024-08-20T01:53:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:53:52.962+0000 7f970fc67640 1 -- 172.21.15.79:0/4052488114 wait complete. 2024-08-20T01:53:54.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:54 smithi079 ceph-mon[18656]: pgmap v844: 97 pgs: 97 active+clean; 5.7 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.2 KiB/s wr, 22 op/s 2024-08-20T01:53:54.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:54 smithi081 ceph-mon[22209]: pgmap v844: 97 pgs: 97 active+clean; 5.7 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.2 KiB/s wr, 22 op/s 2024-08-20T01:53:54.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:54 smithi175 ceph-mon[22392]: pgmap v844: 97 pgs: 97 active+clean; 5.7 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.2 KiB/s wr, 22 op/s 2024-08-20T01:53:55.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:55 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:53:55.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:55 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:53:55.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:55 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:53:56.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:56 smithi079 ceph-mon[18656]: pgmap v845: 97 pgs: 97 active+clean; 5.7 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.9 KiB/s wr, 25 op/s 2024-08-20T01:53:56.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:56 smithi081 ceph-mon[22209]: pgmap v845: 97 pgs: 97 active+clean; 5.7 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.9 KiB/s wr, 25 op/s 2024-08-20T01:53:56.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:56 smithi175 ceph-mon[22392]: pgmap v845: 97 pgs: 97 active+clean; 5.7 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.9 KiB/s wr, 25 op/s 2024-08-20T01:53:58.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:53:58 smithi079 ceph-mon[18656]: pgmap v846: 97 pgs: 97 active+clean; 5.6 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 3.2 KiB/s wr, 23 op/s 2024-08-20T01:53:58.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:53:58 smithi081 ceph-mon[22209]: pgmap v846: 97 pgs: 97 active+clean; 5.6 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 3.2 KiB/s wr, 23 op/s 2024-08-20T01:53:58.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:53:58 smithi175 ceph-mon[22392]: pgmap v846: 97 pgs: 97 active+clean; 5.6 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 3.2 KiB/s wr, 23 op/s 2024-08-20T01:54:00.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:00 smithi079 ceph-mon[18656]: pgmap v847: 97 pgs: 97 active+clean; 5.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.5 KiB/s wr, 24 op/s 2024-08-20T01:54:00.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:00 smithi081 ceph-mon[22209]: pgmap v847: 97 pgs: 97 active+clean; 5.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.5 KiB/s wr, 24 op/s 2024-08-20T01:54:00.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:00 smithi175 ceph-mon[22392]: pgmap v847: 97 pgs: 97 active+clean; 5.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.5 KiB/s wr, 24 op/s 2024-08-20T01:54:02.187 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:02 smithi079 ceph-mon[18656]: pgmap v848: 97 pgs: 97 active+clean; 5.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 2.6 KiB/s wr, 22 op/s 2024-08-20T01:54:02.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:02 smithi081 ceph-mon[22209]: pgmap v848: 97 pgs: 97 active+clean; 5.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 2.6 KiB/s wr, 22 op/s 2024-08-20T01:54:02.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:02 smithi175 ceph-mon[22392]: pgmap v848: 97 pgs: 97 active+clean; 5.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 2.6 KiB/s wr, 22 op/s 2024-08-20T01:54:04.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:04 smithi079 ceph-mon[18656]: pgmap v849: 97 pgs: 97 active+clean; 5.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.4 KiB/s wr, 20 op/s 2024-08-20T01:54:04.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:04 smithi081 ceph-mon[22209]: pgmap v849: 97 pgs: 97 active+clean; 5.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.4 KiB/s wr, 20 op/s 2024-08-20T01:54:04.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:04 smithi175 ceph-mon[22392]: pgmap v849: 97 pgs: 97 active+clean; 5.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.4 KiB/s wr, 20 op/s 2024-08-20T01:54:05.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:05 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:54:05.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:05 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:54:05.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:05 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:54:05.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:05 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:54:05.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:05 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:54:05.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:05 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:54:05.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:05 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:54:05.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:05 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:54:05.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:05 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:54:06.056 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.051+0000 7f9d9ce8d640 1 -- 172.21.15.79:0/2219334696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d98103070 msgr2=0x7f9d981099f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:06.056 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.051+0000 7f9d9ce8d640 1 --2- 172.21.15.79:0/2219334696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d98103070 0x7f9d981099f0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f9d90009cd0 tx=0x7f9d9002a8e0 comp rx=0 tx=0).stop 2024-08-20T01:54:06.056 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.051+0000 7f9d9ce8d640 1 -- 172.21.15.79:0/2219334696 shutdown_connections 2024-08-20T01:54:06.056 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.051+0000 7f9d9ce8d640 1 --2- 172.21.15.79:0/2219334696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d98103070 0x7f9d981099f0 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:06.056 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.051+0000 7f9d9ce8d640 1 --2- 172.21.15.79:0/2219334696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d981026b0 0x7f9d98102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:06.056 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.051+0000 7f9d9ce8d640 1 --2- 172.21.15.79:0/2219334696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d98101560 0x7f9d98101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:06.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.051+0000 7f9d9ce8d640 1 -- 172.21.15.79:0/2219334696 >> 172.21.15.79:0/2219334696 conn(0x7f9d980fce40 msgr2=0x7f9d980ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:06.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.051+0000 7f9d9ce8d640 1 -- 172.21.15.79:0/2219334696 shutdown_connections 2024-08-20T01:54:06.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.051+0000 7f9d9ce8d640 1 -- 172.21.15.79:0/2219334696 wait complete. 2024-08-20T01:54:06.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.052+0000 7f9d9ce8d640 1 Processor -- start 2024-08-20T01:54:06.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.052+0000 7f9d9ce8d640 1 -- start start 2024-08-20T01:54:06.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.052+0000 7f9d9ce8d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d98101560 0x7f9d98198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:06.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.052+0000 7f9d9ce8d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d981026b0 0x7f9d98198fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:06.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.052+0000 7f9d9ce8d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d98103070 0x7f9d98199bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:06.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.052+0000 7f9d9ce8d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9d9810d080 con 0x7f9d98101560 2024-08-20T01:54:06.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.052+0000 7f9d9ce8d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9d9810cf00 con 0x7f9d981026b0 2024-08-20T01:54:06.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.052+0000 7f9d9ce8d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9d9810d200 con 0x7f9d98103070 2024-08-20T01:54:06.057 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.052+0000 7f9d9659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d98101560 0x7f9d98198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.052+0000 7f9d9659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d98101560 0x7f9d98198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46922/0 (socket says 172.21.15.79:46922) 2024-08-20T01:54:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.052+0000 7f9d9659c640 1 -- 172.21.15.79:0/3737606966 learned_addr learned my addr 172.21.15.79:0/3737606966 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.052+0000 7f9d96d9d640 1 --2- 172.21.15.79:0/3737606966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d98103070 0x7f9d98199bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.052+0000 7f9d95d9b640 1 --2- 172.21.15.79:0/3737606966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d981026b0 0x7f9d98198fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.052+0000 7f9d9659c640 1 -- 172.21.15.79:0/3737606966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d98103070 msgr2=0x7f9d98199bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.052+0000 7f9d9659c640 1 --2- 172.21.15.79:0/3737606966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d98103070 0x7f9d98199bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.053+0000 7f9d9659c640 1 -- 172.21.15.79:0/3737606966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d981026b0 msgr2=0x7f9d98198fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.053+0000 7f9d9659c640 1 --2- 172.21.15.79:0/3737606966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d981026b0 0x7f9d98198fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.053+0000 7f9d9659c640 1 -- 172.21.15.79:0/3737606966 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d9819a490 con 0x7f9d98101560 2024-08-20T01:54:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.053+0000 7f9d9659c640 1 --2- 172.21.15.79:0/3737606966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d98101560 0x7f9d98198950 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f9d8800e9f0 tx=0x7f9d8800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.053+0000 7f9d877fe640 1 -- 172.21.15.79:0/3737606966 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8800cd80 con 0x7f9d98101560 2024-08-20T01:54:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.053+0000 7f9d877fe640 1 -- 172.21.15.79:0/3737606966 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9d880054b0 con 0x7f9d98101560 2024-08-20T01:54:06.059 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.053+0000 7f9d9ce8d640 1 -- 172.21.15.79:0/3737606966 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d9819a780 con 0x7f9d98101560 2024-08-20T01:54:06.059 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.053+0000 7f9d877fe640 1 -- 172.21.15.79:0/3737606966 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d88010430 con 0x7f9d98101560 2024-08-20T01:54:06.059 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.053+0000 7f9d9ce8d640 1 -- 172.21.15.79:0/3737606966 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d981a0e50 con 0x7f9d98101560 2024-08-20T01:54:06.065 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.055+0000 7f9d877fe640 1 -- 172.21.15.79:0/3737606966 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f9d880046c0 con 0x7f9d98101560 2024-08-20T01:54:06.065 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.055+0000 7f9d9fc77740 1 Processor -- start 2024-08-20T01:54:06.065 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.056+0000 7f9d9fc77740 1 -- start start 2024-08-20T01:54:06.065 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.056+0000 7f9d9fc77740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f24000dce0 0x55f2400100d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:06.065 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.056+0000 7f9d9fc77740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f240010610 0x55f240012a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:06.065 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.056+0000 7f9d9fc77740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f240013050 0x55f240015510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:06.065 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.056+0000 7f9d9fc77740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f23ff7c360 con 0x55f240010610 2024-08-20T01:54:06.065 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.056+0000 7f9d9fc77740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f23ff6b860 con 0x55f240013050 2024-08-20T01:54:06.065 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.056+0000 7f9d9fc77740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f23ff6f8a0 con 0x55f24000dce0 2024-08-20T01:54:06.066 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.056+0000 7f9d9659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f240010610 0x55f240012a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:06.066 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.056+0000 7f9d96d9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f24000dce0 0x55f2400100d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:06.066 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.056+0000 7f9d9659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f240010610 0x55f240012a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46924/0 (socket says 172.21.15.79:46924) 2024-08-20T01:54:06.066 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.056+0000 7f9d9659c640 1 -- 172.21.15.79:0/1709498521 learned_addr learned my addr 172.21.15.79:0/1709498521 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:06.066 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.056+0000 7f9d95d9b640 1 --2- 172.21.15.79:0/1709498521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f240013050 0x55f240015510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:06.066 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.056+0000 7f9d96d9d640 1 -- 172.21.15.79:0/1709498521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f240013050 msgr2=0x55f240015510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:06.066 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.056+0000 7f9d96d9d640 1 --2- 172.21.15.79:0/1709498521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f240013050 0x55f240015510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:06.066 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.056+0000 7f9d96d9d640 1 -- 172.21.15.79:0/1709498521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f240010610 msgr2=0x55f240012a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:06.066 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.056+0000 7f9d96d9d640 1 --2- 172.21.15.79:0/1709498521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f240010610 0x55f240012a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:06.066 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.056+0000 7f9d96d9d640 1 -- 172.21.15.79:0/1709498521 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f23ff12e40 con 0x55f24000dce0 2024-08-20T01:54:06.066 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.056+0000 7f9d877fe640 1 --2- 172.21.15.79:0/3737606966 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9d800b3c50 0x7f9d800b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:06.066 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.056+0000 7f9d9659c640 1 --2- 172.21.15.79:0/1709498521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f240010610 0x55f240012a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:54:06.067 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.057+0000 7f9d9659c640 1 --2- 172.21.15.79:0/3737606966 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9d800b3c50 0x7f9d800b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:06.067 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.057+0000 7f9d96d9d640 1 --2- 172.21.15.79:0/1709498521 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f24000dce0 0x55f2400100d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9d90006010 tx=0x7f9d90009360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7096bab22d1cc92f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:06.067 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.057+0000 7f9d877fe640 1 -- 172.21.15.79:0/3737606966 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9d880e3f80 con 0x7f9d98101560 2024-08-20T01:54:06.067 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.057+0000 7f9d84ff9640 1 -- 172.21.15.79:0/1709498521 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d90048070 con 0x55f24000dce0 2024-08-20T01:54:06.067 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.057+0000 7f9d84ff9640 1 -- 172.21.15.79:0/1709498521 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9d90036070 con 0x55f24000dce0 2024-08-20T01:54:06.067 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.057+0000 7f9d84ff9640 1 -- 172.21.15.79:0/1709498521 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d900043c0 con 0x55f24000dce0 2024-08-20T01:54:06.067 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.058+0000 7f9d9fc77740 1 -- 172.21.15.79:0/1709498521 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f24000dce0 msgr2=0x55f2400100d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:06.067 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.058+0000 7f9d9fc77740 1 --2- 172.21.15.79:0/1709498521 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f24000dce0 0x55f2400100d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9d90006010 tx=0x7f9d90009360 comp rx=0 tx=0).stop 2024-08-20T01:54:06.067 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.058+0000 7f9d9659c640 1 --2- 172.21.15.79:0/3737606966 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9d800b3c50 0x7f9d800b6110 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f9d88055070 tx=0x7f9d88092040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:06.067 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.058+0000 7f9d9fc77740 1 -- 172.21.15.79:0/1709498521 shutdown_connections 2024-08-20T01:54:06.067 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.058+0000 7f9d9fc77740 1 --2- 172.21.15.79:0/1709498521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f240013050 0x55f240015510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:06.067 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.058+0000 7f9d9fc77740 1 --2- 172.21.15.79:0/1709498521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f240010610 0x55f240012a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:06.067 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.058+0000 7f9d9fc77740 1 --2- 172.21.15.79:0/1709498521 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f24000dce0 0x55f2400100d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:06.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.058+0000 7f9d9fc77740 1 -- 172.21.15.79:0/1709498521 >> 172.21.15.79:0/1709498521 conn(0x55f240004a20 msgr2=0x55f2400057b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:06.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.058+0000 7f9d9fc77740 1 -- 172.21.15.79:0/1709498521 shutdown_connections 2024-08-20T01:54:06.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.058+0000 7f9d9fc77740 1 -- 172.21.15.79:0/1709498521 wait complete. 2024-08-20T01:54:06.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.058+0000 7f9d9fc77740 1 -- start start 2024-08-20T01:54:06.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.058+0000 7f9d9fc77740 1 Processor -- start 2024-08-20T01:54:06.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.058+0000 7f9d9fc77740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f24000dce0 0x55f240017470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:06.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.058+0000 7f9d9fc77740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f240010610 0x55f240017b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:06.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.058+0000 7f9d9fc77740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f240013050 0x55f2400186e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:06.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.058+0000 7f9d9fc77740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f23fea4ab0 con 0x55f24000dce0 2024-08-20T01:54:06.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.058+0000 7f9d9fc77740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f23fef2780 con 0x55f240010610 2024-08-20T01:54:06.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.058+0000 7f9d9fc77740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f240015fd0 con 0x55f240013050 2024-08-20T01:54:06.068 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.058+0000 7f9d9fc77740 10 client.0 _ll_register_callbacks cb 0x55f23fc7aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:54:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.058+0000 7f9d96d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f24000dce0 0x55f240017470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.058+0000 7f9d96d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f24000dce0 0x55f240017470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46940/0 (socket says 172.21.15.79:46940) 2024-08-20T01:54:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.058+0000 7f9d96d9d640 1 -- 172.21.15.79:0/372939031 learned_addr learned my addr 172.21.15.79:0/372939031 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.058+0000 7f9d95d9b640 1 --2- 172.21.15.79:0/372939031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f240010610 0x55f240017b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.059+0000 7f9d96d9d640 1 --2- 172.21.15.79:0/372939031 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f240013050 0x55f2400186e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.059+0000 7f9d96d9d640 1 -- 172.21.15.79:0/372939031 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f240013050 msgr2=0x55f2400186e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.059+0000 7f9d96d9d640 1 --2- 172.21.15.79:0/372939031 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f240013050 0x55f2400186e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.059+0000 7f9d96d9d640 1 -- 172.21.15.79:0/372939031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f240010610 msgr2=0x55f240017b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.059+0000 7f9d96d9d640 1 --2- 172.21.15.79:0/372939031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f240010610 0x55f240017b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.059+0000 7f9d96d9d640 1 -- 172.21.15.79:0/372939031 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f23fcce790 con 0x55f24000dce0 2024-08-20T01:54:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.059+0000 7f9d95d9b640 1 --2- 172.21.15.79:0/372939031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f240010610 0x55f240017b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:54:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.059+0000 7f9d96d9d640 1 --2- 172.21.15.79:0/372939031 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f24000dce0 0x55f240017470 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f9d90009bf0 tx=0x7f9d9002a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47a1925a6299edbc server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:06.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.059+0000 7f9d7dffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:54:06.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.059+0000 7f9d7dffb640 1 -- 172.21.15.79:0/372939031 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d90056060 con 0x55f24000dce0 2024-08-20T01:54:06.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.059+0000 7f9d7dffb640 1 -- 172.21.15.79:0/372939031 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9d90004340 con 0x55f24000dce0 2024-08-20T01:54:06.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.059+0000 7f9d9fc77740 1 -- 172.21.15.79:0/372939031 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f23ff1ae00 con 0x55f24000dce0 2024-08-20T01:54:06.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.059+0000 7f9d7dffb640 1 -- 172.21.15.79:0/372939031 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f9d90048070 con 0x55f24000dce0 2024-08-20T01:54:06.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.059+0000 7f9d9fc77740 10 client.19644 fetch_fsmap learned FSMap version 69 2024-08-20T01:54:06.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.059+0000 7f9d9fc77740 1 -- 172.21.15.79:0/372939031 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) -- 0x55f23fd47620 con 0x55f24000dce0 2024-08-20T01:54:06.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.059+0000 7f9d7dffb640 1 -- 172.21.15.79:0/372939031 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55f23ff1ae00 con 0x55f24000dce0 2024-08-20T01:54:06.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.060+0000 7f9d7dffb640 1 -- 172.21.15.79:0/372939031 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 69) ==== 8366+0+0 (secure 0 0 0) 0x7f9d90042030 con 0x55f24000dce0 2024-08-20T01:54:06.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.060+0000 7f9d9fc77740 10 client.19644 fetch_fsmap finished waiting for FSMap version 69 2024-08-20T01:54:06.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.060+0000 7f9d9fc77740 10 client.19644 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:54:06.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.060+0000 7f9d9fc77740 20 client.19644 populate_metadata read hostname 'smithi079' 2024-08-20T01:54:06.070 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.060+0000 7f9d9fc77740 1 --2- 172.21.15.79:0/372939031 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f240022910 0x55f240024d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:06.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.060+0000 7f9d9fc77740 4 client.19644 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:54:06.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.060+0000 7f9d9fc77740 1 -- 172.21.15.79:0/372939031 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f23ff7e2b0 con 0x55f240022910 2024-08-20T01:54:06.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.060+0000 7f9d95d9b640 1 --2- 172.21.15.79:0/372939031 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f240022910 0x55f240024d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:06.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.060+0000 7f9d7dffb640 10 client.19644 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:54:06.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.060+0000 7f9d95d9b640 1 --2- 172.21.15.79:0/372939031 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f240022910 0x55f240024d00 crc :-1 s=READY pgs=340 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9bc392e81ab7dc07 server_cookie=5faac18a88677be9 in_seq=0 out_seq=0 2024-08-20T01:54:06.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.061+0000 7f9d7dffb640 1 -- 172.21.15.79:0/372939031 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f23ff7e2b0 con 0x55f240022910 2024-08-20T01:54:06.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.061+0000 7f9d7dffb640 10 client.19644 handle_command_reply: tid=0 2024-08-20T01:54:06.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.061+0000 7f9d9fc77740 1 client.19644 shutdown 2024-08-20T01:54:06.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.061+0000 7f9d9fc77740 1 -- 172.21.15.79:0/372939031 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f24000dce0 msgr2=0x55f240017470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:06.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.061+0000 7f9d9fc77740 1 --2- 172.21.15.79:0/372939031 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f24000dce0 0x55f240017470 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f9d90009bf0 tx=0x7f9d9002a8e0 comp rx=0 tx=0).stop 2024-08-20T01:54:06.071 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.061+0000 7f9d9fc77740 1 -- 172.21.15.79:0/372939031 shutdown_connections 2024-08-20T01:54:06.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.061+0000 7f9d9fc77740 1 --2- 172.21.15.79:0/372939031 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f240022910 0x55f240024d00 crc :-1 s=READY pgs=340 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:06.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.061+0000 7f9d9fc77740 1 --2- 172.21.15.79:0/372939031 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f240013050 0x55f2400186e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:06.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.061+0000 7f9d7dffb640 0 client.19644 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:54:06.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.061+0000 7f9d9fc77740 1 --2- 172.21.15.79:0/372939031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f240010610 0x55f240017b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:06.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.061+0000 7f9d9fc77740 1 --2- 172.21.15.79:0/372939031 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f24000dce0 0x55f240017470 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:06.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.061+0000 7f9d9fc77740 1 -- 172.21.15.79:0/372939031 >> 172.21.15.79:0/372939031 conn(0x55f240004a20 msgr2=0x55f240003ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:06.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.061+0000 7f9d9fc77740 1 -- 172.21.15.79:0/372939031 shutdown_connections 2024-08-20T01:54:06.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.061+0000 7f9d9fc77740 1 -- 172.21.15.79:0/372939031 wait complete. 2024-08-20T01:54:06.072 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.061+0000 7f9d9fc77740 20 client.19644 trim_cache size 0 max 16384 2024-08-20T01:54:06.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.075+0000 7f9d9fc77740 1 Processor -- start 2024-08-20T01:54:06.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.076+0000 7f9d9fc77740 1 -- start start 2024-08-20T01:54:06.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.076+0000 7f9d9fc77740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f24000dce0 0x55f240013430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:06.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.076+0000 7f9d9fc77740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f240010610 0x55f240013970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:06.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.076+0000 7f9d9fc77740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f240013050 0x55f240013eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:06.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.076+0000 7f9d9fc77740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9d981a7790 con 0x55f24000dce0 2024-08-20T01:54:06.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.076+0000 7f9d9fc77740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9d981a92d0 con 0x55f240013050 2024-08-20T01:54:06.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.076+0000 7f9d9fc77740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9d981a7e60 con 0x55f240010610 2024-08-20T01:54:06.082 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.076+0000 7f9d96d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f24000dce0 0x55f240013430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:06.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.076+0000 7f9d96d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f24000dce0 0x55f240013430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46956/0 (socket says 172.21.15.79:46956) 2024-08-20T01:54:06.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.076+0000 7f9d96d9d640 1 -- 172.21.15.79:0/261574815 learned_addr learned my addr 172.21.15.79:0/261574815 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:06.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.076+0000 7f9d96d9d640 1 --2- 172.21.15.79:0/261574815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f240013050 0x55f240013eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:06.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.076+0000 7f9d95d9b640 1 --2- 172.21.15.79:0/261574815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f240010610 0x55f240013970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:06.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.076+0000 7f9d96d9d640 1 -- 172.21.15.79:0/261574815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f240010610 msgr2=0x55f240013970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:06.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.076+0000 7f9d96d9d640 1 --2- 172.21.15.79:0/261574815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f240010610 0x55f240013970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:06.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.076+0000 7f9d96d9d640 1 -- 172.21.15.79:0/261574815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f240013050 msgr2=0x55f240013eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:06.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.076+0000 7f9d96d9d640 1 --2- 172.21.15.79:0/261574815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f240013050 0x55f240013eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:06.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.076+0000 7f9d96d9d640 1 -- 172.21.15.79:0/261574815 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f240025070 con 0x55f24000dce0 2024-08-20T01:54:06.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.076+0000 7f9d96d9d640 1 --2- 172.21.15.79:0/261574815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f24000dce0 0x55f240013430 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f9d90005d90 tx=0x7f9d90009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac1521aa8e6f07f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:06.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.076+0000 7f9d7ffff640 1 -- 172.21.15.79:0/261574815 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d90056070 con 0x55f24000dce0 2024-08-20T01:54:06.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.076+0000 7f9d7ffff640 1 -- 172.21.15.79:0/261574815 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9d90036040 con 0x55f24000dce0 2024-08-20T01:54:06.083 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.076+0000 7f9d7ffff640 1 -- 172.21.15.79:0/261574815 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d90061040 con 0x55f24000dce0 2024-08-20T01:54:06.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.077+0000 7f9d9fc77740 1 -- 172.21.15.79:0/261574815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f24000dce0 msgr2=0x55f240013430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:06.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.077+0000 7f9d9fc77740 1 --2- 172.21.15.79:0/261574815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f24000dce0 0x55f240013430 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f9d90005d90 tx=0x7f9d90009360 comp rx=0 tx=0).stop 2024-08-20T01:54:06.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.077+0000 7f9d9fc77740 1 -- 172.21.15.79:0/261574815 shutdown_connections 2024-08-20T01:54:06.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.077+0000 7f9d9fc77740 1 --2- 172.21.15.79:0/261574815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f240013050 0x55f240013eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:06.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.077+0000 7f9d9fc77740 1 --2- 172.21.15.79:0/261574815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f240010610 0x55f240013970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:06.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.077+0000 7f9d9fc77740 1 --2- 172.21.15.79:0/261574815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f24000dce0 0x55f240013430 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:06.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.077+0000 7f9d9fc77740 1 -- 172.21.15.79:0/261574815 >> 172.21.15.79:0/261574815 conn(0x55f240004a20 msgr2=0x55f240014b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:06.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.077+0000 7f9d9fc77740 1 -- 172.21.15.79:0/261574815 shutdown_connections 2024-08-20T01:54:06.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.077+0000 7f9d9fc77740 1 -- 172.21.15.79:0/261574815 wait complete. 2024-08-20T01:54:06.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.077+0000 7f9d9fc77740 1 -- start start 2024-08-20T01:54:06.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.077+0000 7f9d9fc77740 1 Processor -- start 2024-08-20T01:54:06.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.077+0000 7f9d9fc77740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f24000dce0 0x55f24001eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:06.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.077+0000 7f9d9fc77740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f240010610 0x55f24001daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:06.084 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.077+0000 7f9d9fc77740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f240013050 0x55f24001dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:06.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.077+0000 7f9d9fc77740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9d981a8c00 con 0x55f240010610 2024-08-20T01:54:06.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.077+0000 7f9d9fc77740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9d981a8530 con 0x55f24000dce0 2024-08-20T01:54:06.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.077+0000 7f9d9fc77740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9d981a5770 con 0x55f240013050 2024-08-20T01:54:06.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.078+0000 7f9d9fc77740 10 client.0 _ll_register_callbacks cb 0x7f9d90046070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:54:06.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.078+0000 7f9d95d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f240010610 0x55f24001daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:06.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.078+0000 7f9d96d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f24000dce0 0x55f24001eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:06.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.078+0000 7f9d95d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f240010610 0x55f24001daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46966/0 (socket says 172.21.15.79:46966) 2024-08-20T01:54:06.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.078+0000 7f9d96d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f24000dce0 0x55f24001eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:55598/0 (socket says 172.21.15.79:55598) 2024-08-20T01:54:06.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.078+0000 7f9d95d9b640 1 -- 172.21.15.79:0/3410536033 learned_addr learned my addr 172.21.15.79:0/3410536033 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:06.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.078+0000 7f9d96d9d640 1 --2- 172.21.15.79:0/3410536033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f240013050 0x55f24001dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:06.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.078+0000 7f9d95d9b640 1 -- 172.21.15.79:0/3410536033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f240013050 msgr2=0x55f24001dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:06.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.078+0000 7f9d95d9b640 1 --2- 172.21.15.79:0/3410536033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f240013050 0x55f24001dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:06.085 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.078+0000 7f9d95d9b640 1 -- 172.21.15.79:0/3410536033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f24000dce0 msgr2=0x55f24001eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.078+0000 7f9d95d9b640 1 --2- 172.21.15.79:0/3410536033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f24000dce0 0x55f24001eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.078+0000 7f9d95d9b640 1 -- 172.21.15.79:0/3410536033 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f24001e650 con 0x55f240010610 2024-08-20T01:54:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.078+0000 7f9d95d9b640 1 --2- 172.21.15.79:0/3410536033 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f240010610 0x55f24001daa0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x55f240025470 tx=0x7f9d8c0054d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13fc1d46c9dc21ad server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.078+0000 7f9d7dffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:54:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.078+0000 7f9d7dffb640 1 -- 172.21.15.79:0/3410536033 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c024070 con 0x55f240010610 2024-08-20T01:54:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.078+0000 7f9d7dffb640 1 -- 172.21.15.79:0/3410536033 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9d8c004220 con 0x55f240010610 2024-08-20T01:54:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.078+0000 7f9d9fc77740 1 -- 172.21.15.79:0/3410536033 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d90036040 con 0x55f240010610 2024-08-20T01:54:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.078+0000 7f9d7dffb640 1 -- 172.21.15.79:0/3410536033 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f9d8c004e60 con 0x55f240010610 2024-08-20T01:54:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.078+0000 7f9d9fc77740 10 client.19650 fetch_fsmap learned FSMap version 69 2024-08-20T01:54:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.078+0000 7f9d9fc77740 1 -- 172.21.15.79:0/3410536033 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) -- 0x55f24008d4d0 con 0x55f240010610 2024-08-20T01:54:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.079+0000 7f9d7dffb640 1 -- 172.21.15.79:0/3410536033 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9d90036040 con 0x55f240010610 2024-08-20T01:54:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.079+0000 7f9d7dffb640 1 -- 172.21.15.79:0/3410536033 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 69) ==== 8366+0+0 (secure 0 0 0) 0x7f9d8c00f040 con 0x55f240010610 2024-08-20T01:54:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.079+0000 7f9d9fc77740 10 client.19650 fetch_fsmap finished waiting for FSMap version 69 2024-08-20T01:54:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.079+0000 7f9d9fc77740 10 client.19650 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:54:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.079+0000 7f9d9fc77740 20 client.19650 populate_metadata read hostname 'smithi079' 2024-08-20T01:54:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.079+0000 7f9d9fc77740 1 --2- 172.21.15.79:0/3410536033 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f24008de50 0x55f240090270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.079+0000 7f9d9fc77740 4 client.19650 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:54:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.079+0000 7f9d9fc77740 1 -- 172.21.15.79:0/3410536033 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f23ff79d50 con 0x55f24008de50 2024-08-20T01:54:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.079+0000 7f9d96d9d640 1 --2- 172.21.15.79:0/3410536033 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f24008de50 0x55f240090270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.079+0000 7f9d7dffb640 10 client.19650 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:54:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:06.079+0000 7f9d96d9d640 1 --2- 172.21.15.79:0/3410536033 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f24008de50 0x55f240090270 crc :-1 s=READY pgs=341 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b66185a21f954f18 server_cookie=d5dd24f8fbdb86d6 in_seq=0 out_seq=0 2024-08-20T01:54:06.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:06 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:54:06.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:06 smithi079 ceph-mon[18656]: pgmap v850: 97 pgs: 97 active+clean; 5.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.0 KiB/s wr, 19 op/s 2024-08-20T01:54:06.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:06 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:54:06.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:06 smithi081 ceph-mon[22209]: pgmap v850: 97 pgs: 97 active+clean; 5.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.0 KiB/s wr, 19 op/s 2024-08-20T01:54:06.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:06 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:54:06.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:06 smithi175 ceph-mon[22392]: pgmap v850: 97 pgs: 97 active+clean; 5.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.0 KiB/s wr, 19 op/s 2024-08-20T01:54:08.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:08 smithi081 ceph-mon[22209]: pgmap v851: 97 pgs: 97 active+clean; 5.3 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 17 op/s 2024-08-20T01:54:08.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:08 smithi175 ceph-mon[22392]: pgmap v851: 97 pgs: 97 active+clean; 5.3 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 17 op/s 2024-08-20T01:54:08.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:08 smithi079 ceph-mon[18656]: pgmap v851: 97 pgs: 97 active+clean; 5.3 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 17 op/s 2024-08-20T01:54:10.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:10 smithi081 ceph-mon[22209]: pgmap v852: 97 pgs: 97 active+clean; 5.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 19 op/s 2024-08-20T01:54:10.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:10 smithi175 ceph-mon[22392]: pgmap v852: 97 pgs: 97 active+clean; 5.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 19 op/s 2024-08-20T01:54:10.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:10 smithi079 ceph-mon[18656]: pgmap v852: 97 pgs: 97 active+clean; 5.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 19 op/s 2024-08-20T01:54:12.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:12 smithi081 ceph-mon[22209]: pgmap v853: 97 pgs: 97 active+clean; 5.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.6 KiB/s wr, 18 op/s 2024-08-20T01:54:12.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:12 smithi175 ceph-mon[22392]: pgmap v853: 97 pgs: 97 active+clean; 5.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.6 KiB/s wr, 18 op/s 2024-08-20T01:54:12.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:12 smithi079 ceph-mon[18656]: pgmap v853: 97 pgs: 97 active+clean; 5.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.6 KiB/s wr, 18 op/s 2024-08-20T01:54:14.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:14 smithi081 ceph-mon[22209]: pgmap v854: 97 pgs: 97 active+clean; 5.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.8 KiB/s wr, 18 op/s 2024-08-20T01:54:14.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:14 smithi175 ceph-mon[22392]: pgmap v854: 97 pgs: 97 active+clean; 5.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.8 KiB/s wr, 18 op/s 2024-08-20T01:54:14.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:14 smithi079 ceph-mon[18656]: pgmap v854: 97 pgs: 97 active+clean; 5.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.8 KiB/s wr, 18 op/s 2024-08-20T01:54:15.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:15 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:54:15.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:15 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:54:15.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:15 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:54:16.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:16 smithi081 ceph-mon[22209]: pgmap v855: 97 pgs: 97 active+clean; 5.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.1 KiB/s wr, 20 op/s 2024-08-20T01:54:16.540 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:16 smithi175 ceph-mon[22392]: pgmap v855: 97 pgs: 97 active+clean; 5.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.1 KiB/s wr, 20 op/s 2024-08-20T01:54:16.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:16 smithi079 ceph-mon[18656]: pgmap v855: 97 pgs: 97 active+clean; 5.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.1 KiB/s wr, 20 op/s 2024-08-20T01:54:18.431 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:18.427+0000 7f9d7dffb640 1 -- 172.21.15.79:0/3410536033 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f23ff79d50 con 0x55f24008de50 2024-08-20T01:54:18.431 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:18.428+0000 7f9d7dffb640 10 client.19650 handle_command_reply: tid=0 2024-08-20T01:54:18.431 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:18.428+0000 7f9d9fc77740 1 client.19650 shutdown 2024-08-20T01:54:18.431 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:18.428+0000 7f9d9fc77740 1 -- 172.21.15.79:0/3410536033 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f240010610 msgr2=0x55f24001daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:18.431 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:18.428+0000 7f9d9fc77740 1 --2- 172.21.15.79:0/3410536033 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f240010610 0x55f24001daa0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x55f240025470 tx=0x7f9d8c0054d0 comp rx=0 tx=0).stop 2024-08-20T01:54:18.431 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:18.428+0000 7f9d9fc77740 1 -- 172.21.15.79:0/3410536033 shutdown_connections 2024-08-20T01:54:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:18.428+0000 7f9d9fc77740 1 --2- 172.21.15.79:0/3410536033 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55f24008de50 0x55f240090270 crc :-1 s=READY pgs=341 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:18.428+0000 7f9d9fc77740 1 --2- 172.21.15.79:0/3410536033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f240013050 0x55f24001dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:18.428+0000 7f9d9fc77740 1 --2- 172.21.15.79:0/3410536033 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f240010610 0x55f24001daa0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:18.428+0000 7f9d7dffb640 0 client.19650 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:54:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:18.428+0000 7f9d9fc77740 1 --2- 172.21.15.79:0/3410536033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f24000dce0 0x55f24001eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:18.428+0000 7f9d9fc77740 1 -- 172.21.15.79:0/3410536033 >> 172.21.15.79:0/3410536033 conn(0x55f240004a20 msgr2=0x55f2400032c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:18.428+0000 7f9d9fc77740 1 -- 172.21.15.79:0/3410536033 shutdown_connections 2024-08-20T01:54:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:18.428+0000 7f9d9fc77740 1 -- 172.21.15.79:0/3410536033 wait complete. 2024-08-20T01:54:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:18.428+0000 7f9d9fc77740 20 client.19650 trim_cache size 0 max 16384 2024-08-20T01:54:18.433 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:{ 2024-08-20T01:54:18.433 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "message": "", 2024-08-20T01:54:18.433 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout: "return_code": 0 2024-08-20T01:54:18.433 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stdout:} 2024-08-20T01:54:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:18.429+0000 7f9d9ce8d640 1 -- 172.21.15.79:0/3737606966 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9d800b3c50 msgr2=0x7f9d800b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:18.429+0000 7f9d9ce8d640 1 --2- 172.21.15.79:0/3737606966 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9d800b3c50 0x7f9d800b6110 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f9d88055070 tx=0x7f9d88092040 comp rx=0 tx=0).stop 2024-08-20T01:54:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:18.429+0000 7f9d9ce8d640 1 -- 172.21.15.79:0/3737606966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d98101560 msgr2=0x7f9d98198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:18.429+0000 7f9d9ce8d640 1 --2- 172.21.15.79:0/3737606966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d98101560 0x7f9d98198950 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f9d8800e9f0 tx=0x7f9d8800edf0 comp rx=0 tx=0).stop 2024-08-20T01:54:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:18.429+0000 7f9d9ce8d640 1 -- 172.21.15.79:0/3737606966 shutdown_connections 2024-08-20T01:54:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:18.429+0000 7f9d9ce8d640 1 --2- 172.21.15.79:0/3737606966 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9d800b3c50 0x7f9d800b6110 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:18.429+0000 7f9d9ce8d640 1 --2- 172.21.15.79:0/3737606966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d98103070 0x7f9d98199bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:18.429+0000 7f9d9ce8d640 1 --2- 172.21.15.79:0/3737606966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d981026b0 0x7f9d98198fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:18.429+0000 7f9d9ce8d640 1 --2- 172.21.15.79:0/3737606966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d98101560 0x7f9d98198950 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:18.429+0000 7f9d9ce8d640 1 -- 172.21.15.79:0/3737606966 >> 172.21.15.79:0/3737606966 conn(0x7f9d980fce40 msgr2=0x7f9d980fe8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:18.429+0000 7f9d9ce8d640 1 -- 172.21.15.79:0/3737606966 shutdown_connections 2024-08-20T01:54:18.435 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:18.429+0000 7f9d9ce8d640 1 -- 172.21.15.79:0/3737606966 wait complete. 2024-08-20T01:54:18.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:18 smithi081 ceph-mon[22209]: pgmap v856: 97 pgs: 97 active+clean; 4.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.2 KiB/s wr, 21 op/s 2024-08-20T01:54:18.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:18 smithi175 ceph-mon[22392]: pgmap v856: 97 pgs: 97 active+clean; 4.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.2 KiB/s wr, 21 op/s 2024-08-20T01:54:18.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:18 smithi079 ceph-mon[18656]: pgmap v856: 97 pgs: 97 active+clean; 4.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.2 KiB/s wr, 21 op/s 2024-08-20T01:54:20.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:20 smithi081 ceph-mon[22209]: pgmap v857: 97 pgs: 97 active+clean; 4.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.0 KiB/s wr, 22 op/s 2024-08-20T01:54:20.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:20 smithi081 ceph-mon[22209]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:54:20.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:20 smithi175 ceph-mon[22392]: pgmap v857: 97 pgs: 97 active+clean; 4.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.0 KiB/s wr, 22 op/s 2024-08-20T01:54:20.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:20 smithi175 ceph-mon[22392]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:54:20.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:20 smithi079 ceph-mon[18656]: pgmap v857: 97 pgs: 97 active+clean; 4.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.0 KiB/s wr, 22 op/s 2024-08-20T01:54:20.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:20 smithi079 ceph-mon[18656]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T01:54:21.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:21 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:54:21.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:21 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:54:21.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:21 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:54:22.000 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:54:22.251 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:54:22.374 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:22 smithi079 ceph-mon[18656]: pgmap v858: 97 pgs: 97 active+clean; 4.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.0 KiB/s wr, 21 op/s 2024-08-20T01:54:22.374 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:22 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T01:54:22.374 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:22 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T01:54:22.374 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:22 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T01:54:22.374 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:22 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-20T01:54:22.374 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:22 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-20T01:54:22.374 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:22 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-20T01:54:22.375 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:22 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-20T01:54:22.375 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:22 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-20T01:54:22.375 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:22 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-20T01:54:22.375 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:22 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-20T01:54:22.375 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:22 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-20T01:54:22.375 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:22 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-20T01:54:22.375 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:22 smithi079 ceph-mon[18656]: Adjusting osd_memory_target on smithi079 to 176.0M 2024-08-20T01:54:22.375 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:22 smithi079 ceph-mon[18656]: Adjusting osd_memory_target on smithi081 to 176.0M 2024-08-20T01:54:22.375 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:22 smithi079 ceph-mon[18656]: Adjusting osd_memory_target on smithi175 to 176.0M 2024-08-20T01:54:22.375 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:22 smithi079 ceph-mon[18656]: Unable to set osd_memory_target on smithi079 to 184590336: error parsing value: Value '184590336' is below minimum 939524096 2024-08-20T01:54:22.375 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:22 smithi079 ceph-mon[18656]: Unable to set osd_memory_target on smithi081 to 184590336: error parsing value: Value '184590336' is below minimum 939524096 2024-08-20T01:54:22.376 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:22 smithi079 ceph-mon[18656]: Unable to set osd_memory_target on smithi175 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-08-20T01:54:22.376 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:22 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:54:22.376 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:22 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:54:22.376 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:22 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:54:22.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:22 smithi081 ceph-mon[22209]: pgmap v858: 97 pgs: 97 active+clean; 4.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.0 KiB/s wr, 21 op/s 2024-08-20T01:54:22.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:22 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T01:54:22.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:22 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T01:54:22.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:22 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T01:54:22.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:22 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-20T01:54:22.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:22 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-20T01:54:22.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:22 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-20T01:54:22.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:22 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-20T01:54:22.530 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:22 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-20T01:54:22.530 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:22 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-20T01:54:22.530 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:22 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-20T01:54:22.530 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:22 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-20T01:54:22.530 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:22 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-20T01:54:22.530 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:22 smithi081 ceph-mon[22209]: Adjusting osd_memory_target on smithi079 to 176.0M 2024-08-20T01:54:22.530 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:22 smithi081 ceph-mon[22209]: Adjusting osd_memory_target on smithi081 to 176.0M 2024-08-20T01:54:22.530 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:22 smithi081 ceph-mon[22209]: Adjusting osd_memory_target on smithi175 to 176.0M 2024-08-20T01:54:22.530 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:22 smithi081 ceph-mon[22209]: Unable to set osd_memory_target on smithi079 to 184590336: error parsing value: Value '184590336' is below minimum 939524096 2024-08-20T01:54:22.530 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:22 smithi081 ceph-mon[22209]: Unable to set osd_memory_target on smithi081 to 184590336: error parsing value: Value '184590336' is below minimum 939524096 2024-08-20T01:54:22.530 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:22 smithi081 ceph-mon[22209]: Unable to set osd_memory_target on smithi175 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-08-20T01:54:22.530 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:22 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:54:22.530 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:22 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:54:22.531 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:22 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:54:22.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:22 smithi175 ceph-mon[22392]: pgmap v858: 97 pgs: 97 active+clean; 4.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.0 KiB/s wr, 21 op/s 2024-08-20T01:54:22.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:22 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T01:54:22.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:22 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T01:54:22.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:22 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T01:54:22.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:22 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-20T01:54:22.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:22 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-20T01:54:22.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:22 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-20T01:54:22.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:22 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-20T01:54:22.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:22 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-20T01:54:22.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:22 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-20T01:54:22.641 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:22 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-20T01:54:22.641 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:22 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-20T01:54:22.641 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:22 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-20T01:54:22.641 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:22 smithi175 ceph-mon[22392]: Adjusting osd_memory_target on smithi079 to 176.0M 2024-08-20T01:54:22.641 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:22 smithi175 ceph-mon[22392]: Adjusting osd_memory_target on smithi081 to 176.0M 2024-08-20T01:54:22.641 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:22 smithi175 ceph-mon[22392]: Adjusting osd_memory_target on smithi175 to 176.0M 2024-08-20T01:54:22.641 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:22 smithi175 ceph-mon[22392]: Unable to set osd_memory_target on smithi079 to 184590336: error parsing value: Value '184590336' is below minimum 939524096 2024-08-20T01:54:22.641 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:22 smithi175 ceph-mon[22392]: Unable to set osd_memory_target on smithi081 to 184590336: error parsing value: Value '184590336' is below minimum 939524096 2024-08-20T01:54:22.641 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:22 smithi175 ceph-mon[22392]: Unable to set osd_memory_target on smithi175 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-08-20T01:54:22.641 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:22 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:54:22.641 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:22 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:54:22.641 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:22 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:54:22.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.751+0000 7fdeec4d5640 1 -- 172.21.15.79:0/2493861478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdee41084f0 msgr2=0x7fdee4108930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:22.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.751+0000 7fdeec4d5640 1 --2- 172.21.15.79:0/2493861478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdee41084f0 0x7fdee4108930 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fded4009900 tx=0x7fded402a410 comp rx=0 tx=0).stop 2024-08-20T01:54:22.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.752+0000 7fdeec4d5640 1 -- 172.21.15.79:0/2493861478 shutdown_connections 2024-08-20T01:54:22.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.752+0000 7fdeec4d5640 1 --2- 172.21.15.79:0/2493861478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdee4108e70 0x7fdee410f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:22.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.752+0000 7fdeec4d5640 1 --2- 172.21.15.79:0/2493861478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdee41084f0 0x7fdee4108930 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:22.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.752+0000 7fdeec4d5640 1 --2- 172.21.15.79:0/2493861478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdee4102ae0 0x7fdee4102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:22.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.752+0000 7fdeec4d5640 1 -- 172.21.15.79:0/2493861478 >> 172.21.15.79:0/2493861478 conn(0x7fdee40fe510 msgr2=0x7fdee4100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:22.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.752+0000 7fdeec4d5640 1 -- 172.21.15.79:0/2493861478 shutdown_connections 2024-08-20T01:54:22.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.752+0000 7fdeec4d5640 1 -- 172.21.15.79:0/2493861478 wait complete. 2024-08-20T01:54:22.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.752+0000 7fdeec4d5640 1 Processor -- start 2024-08-20T01:54:22.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.752+0000 7fdeec4d5640 1 -- start start 2024-08-20T01:54:22.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.753+0000 7fdeec4d5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdee4102ae0 0x7fdee4198ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:22.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.753+0000 7fdeec4d5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdee41084f0 0x7fdee4199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:22.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.753+0000 7fdeec4d5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdee4108e70 0x7fdee419e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:22.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.753+0000 7fdeec4d5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdee41129e0 con 0x7fdee4102ae0 2024-08-20T01:54:22.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.753+0000 7fdeec4d5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdee4112860 con 0x7fdee4108e70 2024-08-20T01:54:22.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.753+0000 7fdeec4d5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdee4112b60 con 0x7fdee41084f0 2024-08-20T01:54:22.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.753+0000 7fdeea271640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdee4102ae0 0x7fdee4198ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:22.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.753+0000 7fdeea271640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdee4102ae0 0x7fdee4198ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53928/0 (socket says 172.21.15.79:53928) 2024-08-20T01:54:22.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.753+0000 7fdeea271640 1 -- 172.21.15.79:0/177728169 learned_addr learned my addr 172.21.15.79:0/177728169 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:22.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.753+0000 7fdee9a70640 1 --2- 172.21.15.79:0/177728169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdee41084f0 0x7fdee4199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:22.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.753+0000 7fdeeaa72640 1 --2- 172.21.15.79:0/177728169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdee4108e70 0x7fdee419e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:22.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.753+0000 7fdeea271640 1 -- 172.21.15.79:0/177728169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdee41084f0 msgr2=0x7fdee4199410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:22.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.753+0000 7fdeea271640 1 --2- 172.21.15.79:0/177728169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdee41084f0 0x7fdee4199410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:22.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.753+0000 7fdeea271640 1 -- 172.21.15.79:0/177728169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdee4108e70 msgr2=0x7fdee419e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:22.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.753+0000 7fdeea271640 1 --2- 172.21.15.79:0/177728169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdee4108e70 0x7fdee419e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:22.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.753+0000 7fdeea271640 1 -- 172.21.15.79:0/177728169 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee419ef80 con 0x7fdee4102ae0 2024-08-20T01:54:22.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.753+0000 7fdee9a70640 1 --2- 172.21.15.79:0/177728169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdee41084f0 0x7fdee4199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:54:22.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.753+0000 7fdeea271640 1 --2- 172.21.15.79:0/177728169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdee4102ae0 0x7fdee4198ed0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fdee000e9f0 tx=0x7fdee000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:22.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.754+0000 7fdedb7fe640 1 -- 172.21.15.79:0/177728169 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee000cd80 con 0x7fdee4102ae0 2024-08-20T01:54:22.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.754+0000 7fdedb7fe640 1 -- 172.21.15.79:0/177728169 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdee00108c0 con 0x7fdee4102ae0 2024-08-20T01:54:22.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.754+0000 7fdeec4d5640 1 -- 172.21.15.79:0/177728169 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdee419f270 con 0x7fdee4102ae0 2024-08-20T01:54:22.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.754+0000 7fdedb7fe640 1 -- 172.21.15.79:0/177728169 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee00187c0 con 0x7fdee4102ae0 2024-08-20T01:54:22.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.754+0000 7fdeec4d5640 1 -- 172.21.15.79:0/177728169 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdee41a5930 con 0x7fdee4102ae0 2024-08-20T01:54:22.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.756+0000 7fdeee8ce740 1 Processor -- start 2024-08-20T01:54:22.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.757+0000 7fdeee8ce740 1 -- start start 2024-08-20T01:54:22.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.757+0000 7fdeee8ce740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564711236830 0x564711236c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:22.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.757+0000 7fdedb7fe640 1 -- 172.21.15.79:0/177728169 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fdee0010430 con 0x7fdee4102ae0 2024-08-20T01:54:22.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.757+0000 7fdeee8ce740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564711237150 0x564711246fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:22.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.757+0000 7fdeee8ce740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5647112474f0 0x5647112498e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:22.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.757+0000 7fdeee8ce740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5647111ad8e0 con 0x564711237150 2024-08-20T01:54:22.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.757+0000 7fdeee8ce740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56471119cde0 con 0x564711236830 2024-08-20T01:54:22.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.757+0000 7fdeee8ce740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5647111a0e20 con 0x5647112474f0 2024-08-20T01:54:22.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.757+0000 7fdeea271640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564711237150 0x564711246fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:22.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.757+0000 7fdeea271640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564711237150 0x564711246fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53934/0 (socket says 172.21.15.79:53934) 2024-08-20T01:54:22.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.757+0000 7fdeea271640 1 -- 172.21.15.79:0/4084557420 learned_addr learned my addr 172.21.15.79:0/4084557420 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:22.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.757+0000 7fdee9a70640 1 --2- 172.21.15.79:0/4084557420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5647112474f0 0x5647112498e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:22.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.758+0000 7fdeea271640 1 -- 172.21.15.79:0/4084557420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5647112474f0 msgr2=0x5647112498e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:22.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.758+0000 7fdeea271640 1 --2- 172.21.15.79:0/4084557420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5647112474f0 0x5647112498e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:22.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.758+0000 7fdeea271640 1 -- 172.21.15.79:0/4084557420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564711236830 msgr2=0x564711236c10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:54:22.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.758+0000 7fdeea271640 1 --2- 172.21.15.79:0/4084557420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564711236830 0x564711236c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:22.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.758+0000 7fdeea271640 1 -- 172.21.15.79:0/4084557420 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564710efc650 con 0x564711237150 2024-08-20T01:54:22.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.758+0000 7fdee9a70640 1 --2- 172.21.15.79:0/4084557420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5647112474f0 0x5647112498e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:54:22.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.758+0000 7fdeea271640 1 --2- 172.21.15.79:0/4084557420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564711237150 0x564711246fb0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fdee00ec210 tx=0x7fdee00ec6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e08610dc81656dae server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:22.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.758+0000 7fdedb7fe640 1 --2- 172.21.15.79:0/177728169 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fded00b3bd0 0x7fded00b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:22.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.758+0000 7fded8ff9640 1 -- 172.21.15.79:0/4084557420 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee00f7070 con 0x564711237150 2024-08-20T01:54:22.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.758+0000 7fded8ff9640 1 -- 172.21.15.79:0/4084557420 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdee00aaa60 con 0x564711237150 2024-08-20T01:54:22.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.758+0000 7fded8ff9640 1 -- 172.21.15.79:0/4084557420 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee00aa6c0 con 0x564711237150 2024-08-20T01:54:22.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.758+0000 7fdeeaa72640 1 --2- 172.21.15.79:0/177728169 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fded00b3bd0 0x7fded00b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:22.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.758+0000 7fdedb7fe640 1 -- 172.21.15.79:0/177728169 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fdee00e3ff0 con 0x7fdee4102ae0 2024-08-20T01:54:22.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.759+0000 7fdeee8ce740 1 -- 172.21.15.79:0/4084557420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564711237150 msgr2=0x564711246fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:22.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.759+0000 7fdeee8ce740 1 --2- 172.21.15.79:0/4084557420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564711237150 0x564711246fb0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fdee00ec210 tx=0x7fdee00ec6d0 comp rx=0 tx=0).stop 2024-08-20T01:54:22.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.759+0000 7fdeeaa72640 1 --2- 172.21.15.79:0/177728169 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fded00b3bd0 0x7fded00b6090 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fdedc005fd0 tx=0x7fdedc009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:22.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.759+0000 7fdeee8ce740 1 -- 172.21.15.79:0/4084557420 shutdown_connections 2024-08-20T01:54:22.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.759+0000 7fdeee8ce740 1 --2- 172.21.15.79:0/4084557420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5647112474f0 0x5647112498e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:22.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.759+0000 7fdeee8ce740 1 --2- 172.21.15.79:0/4084557420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564711237150 0x564711246fb0 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:22.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.759+0000 7fdeee8ce740 1 --2- 172.21.15.79:0/4084557420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564711236830 0x564711236c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:22.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.759+0000 7fdeee8ce740 1 -- 172.21.15.79:0/4084557420 >> 172.21.15.79:0/4084557420 conn(0x564711234660 msgr2=0x564711235800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:22.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.759+0000 7fdeee8ce740 1 -- 172.21.15.79:0/4084557420 shutdown_connections 2024-08-20T01:54:22.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.759+0000 7fdeee8ce740 1 -- 172.21.15.79:0/4084557420 wait complete. 2024-08-20T01:54:22.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.759+0000 7fdeee8ce740 1 -- start start 2024-08-20T01:54:22.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.760+0000 7fdeee8ce740 1 Processor -- start 2024-08-20T01:54:22.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.760+0000 7fdeee8ce740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564711236830 0x564711244420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:22.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.760+0000 7fdeee8ce740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564711237150 0x564711244960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:22.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.760+0000 7fdeee8ce740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647112474f0 0x564711244ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:22.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.760+0000 7fdeee8ce740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564710fff700 con 0x5647112474f0 2024-08-20T01:54:22.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.760+0000 7fdeee8ce740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5647111237c0 con 0x564711236830 2024-08-20T01:54:22.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.760+0000 7fdeee8ce740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56471124a1a0 con 0x564711237150 2024-08-20T01:54:22.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.760+0000 7fdeee8ce740 10 client.0 _ll_register_callbacks cb 0x5647111966b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:54:22.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.760+0000 7fdeea271640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564711236830 0x564711244420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:22.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.760+0000 7fdeeaa72640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647112474f0 0x564711244ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:22.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.760+0000 7fdeea271640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564711236830 0x564711244420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:40772/0 (socket says 172.21.15.79:40772) 2024-08-20T01:54:22.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.760+0000 7fdeea271640 1 -- 172.21.15.79:0/2258197407 learned_addr learned my addr 172.21.15.79:0/2258197407 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:22.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.760+0000 7fdee9a70640 1 --2- 172.21.15.79:0/2258197407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564711237150 0x564711244960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:22.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.760+0000 7fdeea271640 1 -- 172.21.15.79:0/2258197407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564711237150 msgr2=0x564711244960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:22.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.760+0000 7fdeea271640 1 --2- 172.21.15.79:0/2258197407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564711237150 0x564711244960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:22.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.760+0000 7fdeea271640 1 -- 172.21.15.79:0/2258197407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647112474f0 msgr2=0x564711244ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:22.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.760+0000 7fdeea271640 1 --2- 172.21.15.79:0/2258197407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647112474f0 0x564711244ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:22.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.760+0000 7fdeea271640 1 -- 172.21.15.79:0/2258197407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564711253530 con 0x564711236830 2024-08-20T01:54:22.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.760+0000 7fdee9a70640 1 --2- 172.21.15.79:0/2258197407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564711237150 0x564711244960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:54:22.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.760+0000 7fdeea271640 1 --2- 172.21.15.79:0/2258197407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564711236830 0x564711244420 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fdee00aaee0 tx=0x7fdee000c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6192fe4aec9f4d5d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:22.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.761+0000 7fdecdffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:54:22.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.761+0000 7fdecdffb640 1 -- 172.21.15.79:0/2258197407 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee007eeb0 con 0x564711236830 2024-08-20T01:54:22.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.761+0000 7fdecdffb640 1 -- 172.21.15.79:0/2258197407 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fdee0010a70 con 0x564711236830 2024-08-20T01:54:22.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.761+0000 7fdeee8ce740 1 -- 172.21.15.79:0/2258197407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56471114c100 con 0x564711236830 2024-08-20T01:54:22.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.761+0000 7fdecdffb640 1 -- 172.21.15.79:0/2258197407 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fdee007f0a0 con 0x564711236830 2024-08-20T01:54:22.822 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.761+0000 7fdeee8ce740 10 client.28748 fetch_fsmap learned FSMap version 71 2024-08-20T01:54:22.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.761+0000 7fdeee8ce740 1 -- 172.21.15.79:0/2258197407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x564711255ec0 con 0x564711236830 2024-08-20T01:54:22.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.761+0000 7fdecdffb640 1 -- 172.21.15.79:0/2258197407 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56471114c100 con 0x564711236830 2024-08-20T01:54:22.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.761+0000 7fdecdffb640 1 -- 172.21.15.79:0/2258197407 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 71) ==== 8374+0+0 (secure 0 0 0) 0x7fdee007da70 con 0x564711236830 2024-08-20T01:54:22.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.761+0000 7fdeee8ce740 10 client.28748 fetch_fsmap finished waiting for FSMap version 71 2024-08-20T01:54:22.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.761+0000 7fdeee8ce740 10 client.28748 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:54:22.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.761+0000 7fdeee8ce740 20 client.28748 populate_metadata read hostname 'smithi079' 2024-08-20T01:54:22.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.761+0000 7fdeee8ce740 1 --2- 172.21.15.79:0/2258197407 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564711257210 0x564711259600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:22.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.761+0000 7fdeee8ce740 4 client.28748 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:54:22.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.761+0000 7fdeee8ce740 1 -- 172.21.15.79:0/2258197407 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5647111af830 con 0x564711257210 2024-08-20T01:54:22.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.762+0000 7fdee9a70640 1 --2- 172.21.15.79:0/2258197407 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564711257210 0x564711259600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:22.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.762+0000 7fdecdffb640 10 client.28748 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:54:22.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.762+0000 7fdee9a70640 1 --2- 172.21.15.79:0/2258197407 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564711257210 0x564711259600 crc :-1 s=READY pgs=342 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc0f1a37b6cb5c58 server_cookie=7079c200d17a52e8 in_seq=0 out_seq=0 2024-08-20T01:54:22.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.762+0000 7fdecdffb640 1 -- 172.21.15.79:0/2258197407 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5647111af830 con 0x564711257210 2024-08-20T01:54:22.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.762+0000 7fdecdffb640 10 client.28748 handle_command_reply: tid=0 2024-08-20T01:54:22.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.762+0000 7fdeee8ce740 1 client.28748 shutdown 2024-08-20T01:54:22.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.763+0000 7fdeee8ce740 1 -- 172.21.15.79:0/2258197407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564711236830 msgr2=0x564711244420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:22.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.763+0000 7fdeee8ce740 1 --2- 172.21.15.79:0/2258197407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564711236830 0x564711244420 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fdee00aaee0 tx=0x7fdee000c7d0 comp rx=0 tx=0).stop 2024-08-20T01:54:22.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.763+0000 7fdeee8ce740 1 -- 172.21.15.79:0/2258197407 shutdown_connections 2024-08-20T01:54:22.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.763+0000 7fdeee8ce740 1 --2- 172.21.15.79:0/2258197407 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x564711257210 0x564711259600 crc :-1 s=READY pgs=342 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:22.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.763+0000 7fdeee8ce740 1 --2- 172.21.15.79:0/2258197407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647112474f0 0x564711244ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:22.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.763+0000 7fdeee8ce740 1 --2- 172.21.15.79:0/2258197407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564711237150 0x564711244960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:22.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.763+0000 7fdecdffb640 0 client.28748 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:54:22.825 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:54:22.825 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-08-20T01:54:22.825 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-08-20T01:54:22.825 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:54:22.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.763+0000 7fdeee8ce740 1 --2- 172.21.15.79:0/2258197407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564711236830 0x564711244420 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:22.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.763+0000 7fdeee8ce740 1 -- 172.21.15.79:0/2258197407 >> 172.21.15.79:0/2258197407 conn(0x564711234660 msgr2=0x56471123a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:22.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.763+0000 7fdeee8ce740 1 -- 172.21.15.79:0/2258197407 shutdown_connections 2024-08-20T01:54:22.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.763+0000 7fdeee8ce740 1 -- 172.21.15.79:0/2258197407 wait complete. 2024-08-20T01:54:22.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.763+0000 7fdeee8ce740 20 client.28748 trim_cache size 0 max 16384 2024-08-20T01:54:22.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.781+0000 7fdeee8ce740 1 Processor -- start 2024-08-20T01:54:22.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.781+0000 7fdeee8ce740 1 -- start start 2024-08-20T01:54:22.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.781+0000 7fdeee8ce740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564711236830 0x564711241f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:22.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.781+0000 7fdeee8ce740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564711237150 0x564711233f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:22.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.781+0000 7fdeee8ce740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647112474f0 0x564711246160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:22.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.781+0000 7fdeee8ce740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdee41abde0 con 0x564711236830 2024-08-20T01:54:22.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.781+0000 7fdeee8ce740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdee41ad950 con 0x5647112474f0 2024-08-20T01:54:22.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.781+0000 7fdeee8ce740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdee41ac4e0 con 0x564711237150 2024-08-20T01:54:22.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.781+0000 7fdeea271640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564711236830 0x564711241f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:22.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.781+0000 7fdeea271640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564711236830 0x564711241f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53946/0 (socket says 172.21.15.79:53946) 2024-08-20T01:54:22.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.781+0000 7fdeea271640 1 -- 172.21.15.79:0/3833286100 learned_addr learned my addr 172.21.15.79:0/3833286100 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:22.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.782+0000 7fdee9a70640 1 --2- 172.21.15.79:0/3833286100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564711237150 0x564711233f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:22.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.782+0000 7fdeeaa72640 1 --2- 172.21.15.79:0/3833286100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647112474f0 0x564711246160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:22.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.782+0000 7fdeea271640 1 -- 172.21.15.79:0/3833286100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564711237150 msgr2=0x564711233f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:22.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.782+0000 7fdeea271640 1 --2- 172.21.15.79:0/3833286100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564711237150 0x564711233f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:22.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.782+0000 7fdeea271640 1 -- 172.21.15.79:0/3833286100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647112474f0 msgr2=0x564711246160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:22.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.782+0000 7fdeea271640 1 --2- 172.21.15.79:0/3833286100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647112474f0 0x564711246160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:22.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.782+0000 7fdeea271640 1 -- 172.21.15.79:0/3833286100 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564711236210 con 0x564711236830 2024-08-20T01:54:22.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.782+0000 7fdeea271640 1 --2- 172.21.15.79:0/3833286100 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564711236830 0x564711241f80 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fdee000c6a0 tx=0x7fdee000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5e760d43b7226d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:22.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.782+0000 7fdecffff640 1 -- 172.21.15.79:0/3833286100 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee007f630 con 0x564711236830 2024-08-20T01:54:22.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.782+0000 7fdecffff640 1 -- 172.21.15.79:0/3833286100 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdee00aaa60 con 0x564711236830 2024-08-20T01:54:22.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.782+0000 7fdecffff640 1 -- 172.21.15.79:0/3833286100 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee007f830 con 0x564711236830 2024-08-20T01:54:22.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.783+0000 7fdeee8ce740 1 -- 172.21.15.79:0/3833286100 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564711236830 msgr2=0x564711241f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:22.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.783+0000 7fdeee8ce740 1 --2- 172.21.15.79:0/3833286100 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564711236830 0x564711241f80 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fdee000c6a0 tx=0x7fdee000c840 comp rx=0 tx=0).stop 2024-08-20T01:54:22.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.783+0000 7fdeee8ce740 1 -- 172.21.15.79:0/3833286100 shutdown_connections 2024-08-20T01:54:22.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.783+0000 7fdeee8ce740 1 --2- 172.21.15.79:0/3833286100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647112474f0 0x564711246160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:22.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.783+0000 7fdeee8ce740 1 --2- 172.21.15.79:0/3833286100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564711237150 0x564711233f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:22.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.783+0000 7fdeee8ce740 1 --2- 172.21.15.79:0/3833286100 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564711236830 0x564711241f80 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:22.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.783+0000 7fdeee8ce740 1 -- 172.21.15.79:0/3833286100 >> 172.21.15.79:0/3833286100 conn(0x564711234660 msgr2=0x564711245a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:22.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.783+0000 7fdeee8ce740 1 -- 172.21.15.79:0/3833286100 shutdown_connections 2024-08-20T01:54:22.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.783+0000 7fdeee8ce740 1 -- 172.21.15.79:0/3833286100 wait complete. 2024-08-20T01:54:22.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.783+0000 7fdeee8ce740 1 -- start start 2024-08-20T01:54:22.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.784+0000 7fdeee8ce740 1 Processor -- start 2024-08-20T01:54:22.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.784+0000 7fdeee8ce740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564711236830 0x56471125ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:22.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.784+0000 7fdeee8ce740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564711237150 0x564711237f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:22.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.784+0000 7fdeee8ce740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647112474f0 0x5647112384c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:22.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.784+0000 7fdeee8ce740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdee41ad280 con 0x5647112474f0 2024-08-20T01:54:22.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.784+0000 7fdeee8ce740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdee41acbb0 con 0x564711236830 2024-08-20T01:54:22.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.784+0000 7fdeee8ce740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdee41a9da0 con 0x564711237150 2024-08-20T01:54:22.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.784+0000 7fdeee8ce740 10 client.0 _ll_register_callbacks cb 0x7fdee00f5070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:54:22.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.784+0000 7fdeeaa72640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647112474f0 0x5647112384c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:22.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.784+0000 7fdee9a70640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564711237150 0x564711237f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:22.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.784+0000 7fdeeaa72640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647112474f0 0x5647112384c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53952/0 (socket says 172.21.15.79:53952) 2024-08-20T01:54:22.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.784+0000 7fdeeaa72640 1 -- 172.21.15.79:0/2935621115 learned_addr learned my addr 172.21.15.79:0/2935621115 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:22.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.784+0000 7fdeea271640 1 --2- 172.21.15.79:0/2935621115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564711236830 0x56471125ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:22.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.784+0000 7fdeeaa72640 1 -- 172.21.15.79:0/2935621115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564711237150 msgr2=0x564711237f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:22.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.784+0000 7fdeeaa72640 1 --2- 172.21.15.79:0/2935621115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564711237150 0x564711237f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:22.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.784+0000 7fdeeaa72640 1 -- 172.21.15.79:0/2935621115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564711236830 msgr2=0x56471125ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:22.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.784+0000 7fdeeaa72640 1 --2- 172.21.15.79:0/2935621115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564711236830 0x56471125ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:22.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.784+0000 7fdeeaa72640 1 -- 172.21.15.79:0/2935621115 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564711238a30 con 0x5647112474f0 2024-08-20T01:54:22.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.784+0000 7fdee9a70640 1 --2- 172.21.15.79:0/2935621115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564711237150 0x564711237f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:54:22.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.784+0000 7fdeeaa72640 1 --2- 172.21.15.79:0/2935621115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647112474f0 0x5647112384c0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fdedc0042f0 tx=0x7fdedc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5196818f9a03ce4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:22.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.784+0000 7fdecdffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:54:22.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.785+0000 7fdecdffb640 1 -- 172.21.15.79:0/2935621115 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc01fb40 con 0x5647112474f0 2024-08-20T01:54:22.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.785+0000 7fdecdffb640 1 -- 172.21.15.79:0/2935621115 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fdedc01fce0 con 0x5647112474f0 2024-08-20T01:54:22.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.785+0000 7fdeee8ce740 1 -- 172.21.15.79:0/2935621115 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdee00aaa60 con 0x5647112474f0 2024-08-20T01:54:22.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.785+0000 7fdecdffb640 1 -- 172.21.15.79:0/2935621115 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fdedc004b20 con 0x5647112474f0 2024-08-20T01:54:22.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.785+0000 7fdeee8ce740 10 client.19668 fetch_fsmap learned FSMap version 71 2024-08-20T01:54:22.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.785+0000 7fdeee8ce740 1 -- 172.21.15.79:0/2935621115 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x5647112c18f0 con 0x5647112474f0 2024-08-20T01:54:22.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.785+0000 7fdecdffb640 1 -- 172.21.15.79:0/2935621115 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdee00aaa60 con 0x5647112474f0 2024-08-20T01:54:22.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.785+0000 7fdecdffb640 1 -- 172.21.15.79:0/2935621115 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 71) ==== 8374+0+0 (secure 0 0 0) 0x7fdedc0056e0 con 0x5647112474f0 2024-08-20T01:54:22.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.785+0000 7fdeee8ce740 10 client.19668 fetch_fsmap finished waiting for FSMap version 71 2024-08-20T01:54:22.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.785+0000 7fdeee8ce740 10 client.19668 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:54:22.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.785+0000 7fdeee8ce740 20 client.19668 populate_metadata read hostname 'smithi079' 2024-08-20T01:54:22.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.785+0000 7fdeee8ce740 1 --2- 172.21.15.79:0/2935621115 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5647112c2140 0x5647112c4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:22.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.785+0000 7fdeee8ce740 4 client.19668 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:54:22.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.785+0000 7fdeee8ce740 1 -- 172.21.15.79:0/2935621115 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5647111ab2d0 con 0x5647112c2140 2024-08-20T01:54:22.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.785+0000 7fdeea271640 1 --2- 172.21.15.79:0/2935621115 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5647112c2140 0x5647112c4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:22.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.786+0000 7fdecdffb640 10 client.19668 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:54:22.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.786+0000 7fdeea271640 1 --2- 172.21.15.79:0/2935621115 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5647112c2140 0x5647112c4560 crc :-1 s=READY pgs=343 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2bf73010333756b server_cookie=fb0d0668bc0f6901 in_seq=0 out_seq=0 2024-08-20T01:54:22.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.786+0000 7fdecdffb640 1 -- 172.21.15.79:0/2935621115 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5647111ab2d0 con 0x5647112c2140 2024-08-20T01:54:22.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.786+0000 7fdecdffb640 10 client.19668 handle_command_reply: tid=0 2024-08-20T01:54:22.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.786+0000 7fdeee8ce740 1 client.19668 shutdown 2024-08-20T01:54:22.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.786+0000 7fdeee8ce740 1 -- 172.21.15.79:0/2935621115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647112474f0 msgr2=0x5647112384c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:22.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.786+0000 7fdeee8ce740 1 --2- 172.21.15.79:0/2935621115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647112474f0 0x5647112384c0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fdedc0042f0 tx=0x7fdedc004ab0 comp rx=0 tx=0).stop 2024-08-20T01:54:22.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.786+0000 7fdeee8ce740 1 -- 172.21.15.79:0/2935621115 shutdown_connections 2024-08-20T01:54:22.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.786+0000 7fdeee8ce740 1 --2- 172.21.15.79:0/2935621115 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5647112c2140 0x5647112c4560 crc :-1 s=READY pgs=343 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:22.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.786+0000 7fdeee8ce740 1 --2- 172.21.15.79:0/2935621115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647112474f0 0x5647112384c0 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:22.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.786+0000 7fdeee8ce740 1 --2- 172.21.15.79:0/2935621115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564711237150 0x564711237f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:22.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.786+0000 7fdecdffb640 0 client.19668 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:54:22.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.786+0000 7fdeee8ce740 1 --2- 172.21.15.79:0/2935621115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564711236830 0x56471125ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:22.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.786+0000 7fdeee8ce740 1 -- 172.21.15.79:0/2935621115 >> 172.21.15.79:0/2935621115 conn(0x564711234660 msgr2=0x564711246270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:22.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.786+0000 7fdeee8ce740 1 -- 172.21.15.79:0/2935621115 shutdown_connections 2024-08-20T01:54:22.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.786+0000 7fdeee8ce740 1 -- 172.21.15.79:0/2935621115 wait complete. 2024-08-20T01:54:22.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.787+0000 7fdeee8ce740 20 client.19668 trim_cache size 0 max 16384 2024-08-20T01:54:22.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.787+0000 7fdeec4d5640 1 -- 172.21.15.79:0/177728169 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fded00b3bd0 msgr2=0x7fded00b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:22.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.787+0000 7fdeec4d5640 1 --2- 172.21.15.79:0/177728169 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fded00b3bd0 0x7fded00b6090 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fdedc005fd0 tx=0x7fdedc009500 comp rx=0 tx=0).stop 2024-08-20T01:54:22.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.787+0000 7fdeec4d5640 1 -- 172.21.15.79:0/177728169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdee4102ae0 msgr2=0x7fdee4198ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:22.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.787+0000 7fdeec4d5640 1 --2- 172.21.15.79:0/177728169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdee4102ae0 0x7fdee4198ed0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fdee000e9f0 tx=0x7fdee000eeb0 comp rx=0 tx=0).stop 2024-08-20T01:54:22.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.787+0000 7fdeec4d5640 1 -- 172.21.15.79:0/177728169 shutdown_connections 2024-08-20T01:54:22.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.787+0000 7fdeec4d5640 1 --2- 172.21.15.79:0/177728169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdee4108e70 0x7fdee419e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:22.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.787+0000 7fdeec4d5640 1 --2- 172.21.15.79:0/177728169 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fded00b3bd0 0x7fded00b6090 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:22.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.787+0000 7fdeec4d5640 1 --2- 172.21.15.79:0/177728169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdee41084f0 0x7fdee4199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:22.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.787+0000 7fdeec4d5640 1 --2- 172.21.15.79:0/177728169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdee4102ae0 0x7fdee4198ed0 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:22.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.787+0000 7fdeec4d5640 1 -- 172.21.15.79:0/177728169 >> 172.21.15.79:0/177728169 conn(0x7fdee40fe510 msgr2=0x7fdee4100900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:22.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.787+0000 7fdeec4d5640 1 -- 172.21.15.79:0/177728169 shutdown_connections 2024-08-20T01:54:22.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:22.787+0000 7fdeec4d5640 1 -- 172.21.15.79:0/177728169 wait complete. 2024-08-20T01:54:23.706 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T01:54:23.706 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:54:23.959 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:54:24.382 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:24 smithi079 ceph-mon[18656]: pgmap v859: 97 pgs: 97 active+clean; 4.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.6 KiB/s wr, 20 op/s 2024-08-20T01:54:24.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.461+0000 7f6244428640 1 -- 172.21.15.79:0/3839930270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f623c1073a0 msgr2=0x7f623c1077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:24.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.461+0000 7f6244428640 1 --2- 172.21.15.79:0/3839930270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f623c1073a0 0x7f623c1077e0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f622c009900 tx=0x7f622c02a410 comp rx=0 tx=0).stop 2024-08-20T01:54:24.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.461+0000 7f6244428640 1 -- 172.21.15.79:0/3839930270 shutdown_connections 2024-08-20T01:54:24.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.461+0000 7f6244428640 1 --2- 172.21.15.79:0/3839930270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f623c107d20 0x7f623c10e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:24.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.461+0000 7f6244428640 1 --2- 172.21.15.79:0/3839930270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f623c1073a0 0x7f623c1077e0 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:24.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.461+0000 7f6244428640 1 --2- 172.21.15.79:0/3839930270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f623c101990 0x7f623c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:24.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.461+0000 7f6244428640 1 -- 172.21.15.79:0/3839930270 >> 172.21.15.79:0/3839930270 conn(0x7f623c0fd400 msgr2=0x7f623c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:24.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.461+0000 7f6244428640 1 -- 172.21.15.79:0/3839930270 shutdown_connections 2024-08-20T01:54:24.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.461+0000 7f6244428640 1 -- 172.21.15.79:0/3839930270 wait complete. 2024-08-20T01:54:24.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.462+0000 7f6244428640 1 Processor -- start 2024-08-20T01:54:24.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.462+0000 7f6244428640 1 -- start start 2024-08-20T01:54:24.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.462+0000 7f6244428640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f623c101990 0x7f623c198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:24.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.462+0000 7f6244428640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f623c1073a0 0x7f623c199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:24.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.462+0000 7f6244428640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f623c107d20 0x7f623c19e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:24.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.462+0000 7f6244428640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f623c1129b0 con 0x7f623c1073a0 2024-08-20T01:54:24.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.462+0000 7f6244428640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f623c112830 con 0x7f623c107d20 2024-08-20T01:54:24.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.462+0000 7f6244428640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f623c112b30 con 0x7f623c101990 2024-08-20T01:54:24.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.462+0000 7f62419c3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f623c1073a0 0x7f623c199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:24.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.462+0000 7f62419c3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f623c1073a0 0x7f623c199400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53964/0 (socket says 172.21.15.79:53964) 2024-08-20T01:54:24.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.462+0000 7f62419c3640 1 -- 172.21.15.79:0/1198623133 learned_addr learned my addr 172.21.15.79:0/1198623133 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:24.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.462+0000 7f62421c4640 1 --2- 172.21.15.79:0/1198623133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f623c101990 0x7f623c198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:24.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.462+0000 7f62429c5640 1 --2- 172.21.15.79:0/1198623133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f623c107d20 0x7f623c19e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:24.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.462+0000 7f62419c3640 1 -- 172.21.15.79:0/1198623133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f623c101990 msgr2=0x7f623c198ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:24.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.462+0000 7f62419c3640 1 --2- 172.21.15.79:0/1198623133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f623c101990 0x7f623c198ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:24.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.462+0000 7f62419c3640 1 -- 172.21.15.79:0/1198623133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f623c107d20 msgr2=0x7f623c19e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:24.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.462+0000 7f62419c3640 1 --2- 172.21.15.79:0/1198623133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f623c107d20 0x7f623c19e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:24.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.462+0000 7f62419c3640 1 -- 172.21.15.79:0/1198623133 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f623c19ef70 con 0x7f623c1073a0 2024-08-20T01:54:24.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.462+0000 7f62429c5640 1 --2- 172.21.15.79:0/1198623133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f623c107d20 0x7f623c19e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:54:24.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.462+0000 7f62419c3640 1 --2- 172.21.15.79:0/1198623133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f623c1073a0 0x7f623c199400 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f622c009230 tx=0x7f622c0319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:24.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.463+0000 7f62337fe640 1 -- 172.21.15.79:0/1198623133 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622c03f030 con 0x7f623c1073a0 2024-08-20T01:54:24.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.463+0000 7f62337fe640 1 -- 172.21.15.79:0/1198623133 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f622c0043d0 con 0x7f623c1073a0 2024-08-20T01:54:24.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.463+0000 7f6244428640 1 -- 172.21.15.79:0/1198623133 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f623c19f200 con 0x7f623c1073a0 2024-08-20T01:54:24.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.463+0000 7f62337fe640 1 -- 172.21.15.79:0/1198623133 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622c035070 con 0x7f623c1073a0 2024-08-20T01:54:24.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.463+0000 7f6244428640 1 -- 172.21.15.79:0/1198623133 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f623c1a5920 con 0x7f623c1073a0 2024-08-20T01:54:24.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.464+0000 7f6244428640 1 -- 172.21.15.79:0/1198623133 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f623c101d70 con 0x7f623c1073a0 2024-08-20T01:54:24.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.465+0000 7f62337fe640 1 -- 172.21.15.79:0/1198623133 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f622c042030 con 0x7f623c1073a0 2024-08-20T01:54:24.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.466+0000 7f62337fe640 1 --2- 172.21.15.79:0/1198623133 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f62280b3c50 0x7f62280b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:24.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.466+0000 7f62421c4640 1 --2- 172.21.15.79:0/1198623133 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f62280b3c50 0x7f62280b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:24.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.467+0000 7f62337fe640 1 -- 172.21.15.79:0/1198623133 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f622c1043b0 con 0x7f623c1073a0 2024-08-20T01:54:24.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.467+0000 7f62421c4640 1 --2- 172.21.15.79:0/1198623133 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f62280b3c50 0x7f62280b6110 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f6238009bd0 tx=0x7f6238005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:24.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.469+0000 7f62337fe640 1 -- 172.21.15.79:0/1198623133 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f622c0cb9f0 con 0x7f623c1073a0 2024-08-20T01:54:24.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:24 smithi081 ceph-mon[22209]: pgmap v859: 97 pgs: 97 active+clean; 4.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.6 KiB/s wr, 20 op/s 2024-08-20T01:54:24.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:24 smithi175 ceph-mon[22392]: pgmap v859: 97 pgs: 97 active+clean; 4.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.6 KiB/s wr, 20 op/s 2024-08-20T01:54:24.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.692+0000 7f6244428640 1 -- 172.21.15.79:0/1198623133 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f623c109b00 con 0x7f623c1073a0 2024-08-20T01:54:24.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.693+0000 7f62337fe640 1 -- 172.21.15.79:0/1198623133 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+11977 (secure 0 0 0) 0x7f622c0cb2f0 con 0x7f623c1073a0 2024-08-20T01:54:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:54:24.696 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":71,"btime":"2024-08-20T01:54:19:232668+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14670,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/735082912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":735082912},{"type":"v1","addr":"172.21.15.79:6835","nonce":735082912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2150339873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2150339873},{"type":"v1","addr":"172.21.15.79:6837","nonce":2150339873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":71,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:34:55.133562+0000","modified":"2024-08-20T01:54:18.576580+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24539,"mds_1":24538,"mds_2":24523,"mds_3":24514,"mds_4":24512},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14724":{"gid":14724,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/1071242274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1071242274},{"type":"v1","addr":"172.21.15.79:6839","nonce":1071242274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14730":{"gid":14730,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6841/2448977611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":2448977611},{"type":"v1","addr":"172.21.15.79:6841","nonce":2448977611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/1257507005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1257507005},{"type":"v1","addr":"172.21.15.81:6833","nonce":1257507005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1499936216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1499936216},{"type":"v1","addr":"172.21.15.81:6835","nonce":1499936216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/1107229215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1107229215},{"type":"v1","addr":"172.21.15.175:6833","nonce":1107229215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6837/2073598870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2073598870},{"type":"v1","addr":"172.21.15.81:6837","nonce":2073598870}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/2552601173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2552601173},{"type":"v1","addr":"172.21.15.175:6835","nonce":2552601173}]},"join_fscid":-1,"export_targets":[0,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6837/1767284089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1767284089},{"type":"v1","addr":"172.21.15.175:6837","nonce":1767284089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/1331748742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1331748742},{"type":"v1","addr":"172.21.15.175:6839","nonce":1331748742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/4098410583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":4098410583},{"type":"v1","addr":"172.21.15.81:6839","nonce":4098410583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24539,"qdb_cluster":[24539,24523,24514,24538,24512]},"id":1}]} 2024-08-20T01:54:24.696 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 71 2024-08-20T01:54:24.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.695+0000 7f6244428640 1 -- 172.21.15.79:0/1198623133 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f62280b3c50 msgr2=0x7f62280b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:24.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.695+0000 7f6244428640 1 --2- 172.21.15.79:0/1198623133 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f62280b3c50 0x7f62280b6110 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f6238009bd0 tx=0x7f6238005f90 comp rx=0 tx=0).stop 2024-08-20T01:54:24.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.695+0000 7f6244428640 1 -- 172.21.15.79:0/1198623133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f623c1073a0 msgr2=0x7f623c199400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:24.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.695+0000 7f6244428640 1 --2- 172.21.15.79:0/1198623133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f623c1073a0 0x7f623c199400 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f622c009230 tx=0x7f622c0319a0 comp rx=0 tx=0).stop 2024-08-20T01:54:24.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.695+0000 7f6244428640 1 -- 172.21.15.79:0/1198623133 shutdown_connections 2024-08-20T01:54:24.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.695+0000 7f6244428640 1 --2- 172.21.15.79:0/1198623133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f623c107d20 0x7f623c19e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:24.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.695+0000 7f6244428640 1 --2- 172.21.15.79:0/1198623133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f623c1073a0 0x7f623c199400 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:24.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.695+0000 7f6244428640 1 --2- 172.21.15.79:0/1198623133 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f62280b3c50 0x7f62280b6110 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:24.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.695+0000 7f6244428640 1 --2- 172.21.15.79:0/1198623133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f623c101990 0x7f623c198ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:24.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.695+0000 7f6244428640 1 -- 172.21.15.79:0/1198623133 >> 172.21.15.79:0/1198623133 conn(0x7f623c0fd400 msgr2=0x7f623c0ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:24.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.695+0000 7f6244428640 1 -- 172.21.15.79:0/1198623133 shutdown_connections 2024-08-20T01:54:24.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:24.695+0000 7f6244428640 1 -- 172.21.15.79:0/1198623133 wait complete. 2024-08-20T01:54:25.386 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:25 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/1198623133' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:54:25.412 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-20T01:54:25.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:25 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/1198623133' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:54:25.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:25 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/1198623133' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:54:25.662 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:54:26.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.176+0000 7fb786723640 1 -- 172.21.15.79:0/454126308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb780101330 msgr2=0x7fb780101710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:26.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.177+0000 7fb786723640 1 --2- 172.21.15.79:0/454126308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb780101330 0x7fb780101710 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fb770009900 tx=0x7fb77002a410 comp rx=0 tx=0).stop 2024-08-20T01:54:26.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.177+0000 7fb786723640 1 -- 172.21.15.79:0/454126308 shutdown_connections 2024-08-20T01:54:26.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.177+0000 7fb786723640 1 --2- 172.21.15.79:0/454126308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb78010efe0 0x7fb780111450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:26.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.177+0000 7fb786723640 1 --2- 172.21.15.79:0/454126308 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb780101d30 0x7fb78010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:26.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.177+0000 7fb786723640 1 --2- 172.21.15.79:0/454126308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb780101330 0x7fb780101710 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:26.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.177+0000 7fb786723640 1 -- 172.21.15.79:0/454126308 >> 172.21.15.79:0/454126308 conn(0x7fb780076bd0 msgr2=0x7fb780076fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:26.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.177+0000 7fb786723640 1 -- 172.21.15.79:0/454126308 shutdown_connections 2024-08-20T01:54:26.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.177+0000 7fb786723640 1 -- 172.21.15.79:0/454126308 wait complete. 2024-08-20T01:54:26.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.177+0000 7fb786723640 1 Processor -- start 2024-08-20T01:54:26.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.177+0000 7fb786723640 1 -- start start 2024-08-20T01:54:26.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.178+0000 7fb786723640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb780101330 0x7fb78019b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:26.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.178+0000 7fb786723640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb780101d30 0x7fb78019b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:26.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.178+0000 7fb786723640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb78010efe0 0x7fb7801a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:26.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.178+0000 7fb786723640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb780114b10 con 0x7fb780101330 2024-08-20T01:54:26.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.178+0000 7fb786723640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb780114990 con 0x7fb78010efe0 2024-08-20T01:54:26.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.178+0000 7fb786723640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb780114c90 con 0x7fb780101d30 2024-08-20T01:54:26.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.178+0000 7fb77ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb780101330 0x7fb78019b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:26.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.178+0000 7fb77ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb780101330 0x7fb78019b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53988/0 (socket says 172.21.15.79:53988) 2024-08-20T01:54:26.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.178+0000 7fb77ffff640 1 -- 172.21.15.79:0/3186465030 learned_addr learned my addr 172.21.15.79:0/3186465030 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:26.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.178+0000 7fb784cc0640 1 --2- 172.21.15.79:0/3186465030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb78010efe0 0x7fb7801a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:26.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.178+0000 7fb77f7fe640 1 --2- 172.21.15.79:0/3186465030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb780101d30 0x7fb78019b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:26.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.178+0000 7fb784cc0640 1 -- 172.21.15.79:0/3186465030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb780101d30 msgr2=0x7fb78019b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:26.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.178+0000 7fb784cc0640 1 --2- 172.21.15.79:0/3186465030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb780101d30 0x7fb78019b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:26.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.178+0000 7fb784cc0640 1 -- 172.21.15.79:0/3186465030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb780101330 msgr2=0x7fb78019b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:26.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.178+0000 7fb784cc0640 1 --2- 172.21.15.79:0/3186465030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb780101330 0x7fb78019b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:26.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.178+0000 7fb784cc0640 1 -- 172.21.15.79:0/3186465030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7801a1240 con 0x7fb78010efe0 2024-08-20T01:54:26.183 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.178+0000 7fb77ffff640 1 --2- 172.21.15.79:0/3186465030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb780101330 0x7fb78019b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:54:26.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.178+0000 7fb784cc0640 1 --2- 172.21.15.79:0/3186465030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb78010efe0 0x7fb7801a0a70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb77800ec50 tx=0x7fb77800c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:26.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.178+0000 7fb77d7fa640 1 -- 172.21.15.79:0/3186465030 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb778003b70 con 0x7fb78010efe0 2024-08-20T01:54:26.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.179+0000 7fb77d7fa640 1 -- 172.21.15.79:0/3186465030 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb778003d10 con 0x7fb78010efe0 2024-08-20T01:54:26.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.179+0000 7fb786723640 1 -- 172.21.15.79:0/3186465030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7801a1530 con 0x7fb78010efe0 2024-08-20T01:54:26.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.179+0000 7fb77d7fa640 1 -- 172.21.15.79:0/3186465030 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7780107a0 con 0x7fb78010efe0 2024-08-20T01:54:26.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.179+0000 7fb786723640 1 -- 172.21.15.79:0/3186465030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7801a7bf0 con 0x7fb78010efe0 2024-08-20T01:54:26.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.181+0000 7fb77d7fa640 1 -- 172.21.15.79:0/3186465030 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb778003fc0 con 0x7fb78010efe0 2024-08-20T01:54:26.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.181+0000 7fb788b1c740 1 Processor -- start 2024-08-20T01:54:26.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.181+0000 7fb788b1c740 1 -- start start 2024-08-20T01:54:26.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.181+0000 7fb788b1c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559709aa1880 0x559709aa1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:26.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.181+0000 7fb788b1c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559709aa21a0 0x559709aadbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:26.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.181+0000 7fb788b1c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559709aae130 0x559709ab0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:26.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.181+0000 7fb788b1c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559709a18930 con 0x559709aa1880 2024-08-20T01:54:26.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.181+0000 7fb788b1c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559709a07e30 con 0x559709aa21a0 2024-08-20T01:54:26.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.181+0000 7fb788b1c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559709a0be70 con 0x559709aae130 2024-08-20T01:54:26.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.181+0000 7fb77f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559709aa1880 0x559709aa1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:26.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.181+0000 7fb77f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559709aa1880 0x559709aa1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53998/0 (socket says 172.21.15.79:53998) 2024-08-20T01:54:26.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.181+0000 7fb77f7fe640 1 -- 172.21.15.79:0/3069739993 learned_addr learned my addr 172.21.15.79:0/3069739993 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:26.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.182+0000 7fb77ffff640 1 --2- 172.21.15.79:0/3069739993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559709aa21a0 0x559709aadbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:26.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.182+0000 7fb77f7fe640 1 --2- 172.21.15.79:0/3069739993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559709aae130 0x559709ab0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:26.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.182+0000 7fb77d7fa640 1 --2- 172.21.15.79:0/3186465030 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb7680b3bd0 0x7fb7680b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:26.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.182+0000 7fb77f7fe640 1 -- 172.21.15.79:0/3069739993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559709aae130 msgr2=0x559709ab0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:26.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.182+0000 7fb77f7fe640 1 --2- 172.21.15.79:0/3069739993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559709aae130 0x559709ab0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:26.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.182+0000 7fb77f7fe640 1 -- 172.21.15.79:0/3069739993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559709aa21a0 msgr2=0x559709aadbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:26.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.182+0000 7fb77f7fe640 1 --2- 172.21.15.79:0/3069739993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559709aa21a0 0x559709aadbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:26.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.182+0000 7fb77f7fe640 1 -- 172.21.15.79:0/3069739993 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559709767650 con 0x559709aa1880 2024-08-20T01:54:26.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.182+0000 7fb784cc0640 1 --2- 172.21.15.79:0/3186465030 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb7680b3bd0 0x7fb7680b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:26.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.182+0000 7fb77f7fe640 1 --2- 172.21.15.79:0/3069739993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559709aa1880 0x559709aa1c60 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fb774013830 tx=0x7fb774009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a38a127aed67a86 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:26.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.182+0000 7fb77d7fa640 1 -- 172.21.15.79:0/3186465030 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fb7780e40d0 con 0x7fb78010efe0 2024-08-20T01:54:26.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.182+0000 7fb7667fc640 1 -- 172.21.15.79:0/3069739993 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb774004030 con 0x559709aa1880 2024-08-20T01:54:26.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.182+0000 7fb7667fc640 1 -- 172.21.15.79:0/3069739993 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb7740117e0 con 0x559709aa1880 2024-08-20T01:54:26.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.182+0000 7fb7667fc640 1 -- 172.21.15.79:0/3069739993 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb774003830 con 0x559709aa1880 2024-08-20T01:54:26.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.183+0000 7fb788b1c740 1 -- 172.21.15.79:0/3069739993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559709aa1880 msgr2=0x559709aa1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:26.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.183+0000 7fb788b1c740 1 --2- 172.21.15.79:0/3069739993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559709aa1880 0x559709aa1c60 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fb774013830 tx=0x7fb774009780 comp rx=0 tx=0).stop 2024-08-20T01:54:26.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.183+0000 7fb784cc0640 1 --2- 172.21.15.79:0/3186465030 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb7680b3bd0 0x7fb7680b6090 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fb7780a5680 tx=0x7fb77806d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:26.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.183+0000 7fb788b1c740 1 -- 172.21.15.79:0/3069739993 shutdown_connections 2024-08-20T01:54:26.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.183+0000 7fb788b1c740 1 --2- 172.21.15.79:0/3069739993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559709aae130 0x559709ab0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:26.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.183+0000 7fb788b1c740 1 --2- 172.21.15.79:0/3069739993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559709aa21a0 0x559709aadbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:26.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.183+0000 7fb788b1c740 1 --2- 172.21.15.79:0/3069739993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559709aa1880 0x559709aa1c60 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:26.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.183+0000 7fb788b1c740 1 -- 172.21.15.79:0/3069739993 >> 172.21.15.79:0/3069739993 conn(0x559709a9f6b0 msgr2=0x559709aa0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:26.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.183+0000 7fb788b1c740 1 -- 172.21.15.79:0/3069739993 shutdown_connections 2024-08-20T01:54:26.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.183+0000 7fb788b1c740 1 -- 172.21.15.79:0/3069739993 wait complete. 2024-08-20T01:54:26.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.183+0000 7fb788b1c740 1 -- start start 2024-08-20T01:54:26.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.184+0000 7fb788b1c740 1 Processor -- start 2024-08-20T01:54:26.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.184+0000 7fb788b1c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559709aa1880 0x559709aab110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:26.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.184+0000 7fb788b1c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559709aa21a0 0x559709aab650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:26.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.184+0000 7fb788b1c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559709aae130 0x559709aabb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:26.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.184+0000 7fb788b1c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55970986a700 con 0x559709aa21a0 2024-08-20T01:54:26.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.184+0000 7fb788b1c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55970998e810 con 0x559709aa1880 2024-08-20T01:54:26.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.184+0000 7fb788b1c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559709ab0de0 con 0x559709aae130 2024-08-20T01:54:26.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.184+0000 7fb788b1c740 10 client.0 _ll_register_callbacks cb 0x559709a01700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:54:26.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.184+0000 7fb77f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559709aa1880 0x559709aab110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:26.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.184+0000 7fb77ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559709aa21a0 0x559709aab650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:26.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.184+0000 7fb77f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559709aa1880 0x559709aab110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:40848/0 (socket says 172.21.15.79:40848) 2024-08-20T01:54:26.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.184+0000 7fb77f7fe640 1 -- 172.21.15.79:0/4101029821 learned_addr learned my addr 172.21.15.79:0/4101029821 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:26.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.184+0000 7fb77f7fe640 1 --2- 172.21.15.79:0/4101029821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559709aae130 0x559709aabb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:26.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.184+0000 7fb77f7fe640 1 -- 172.21.15.79:0/4101029821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559709aae130 msgr2=0x559709aabb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:26.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.184+0000 7fb77f7fe640 1 --2- 172.21.15.79:0/4101029821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559709aae130 0x559709aabb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:26.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.184+0000 7fb77f7fe640 1 -- 172.21.15.79:0/4101029821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559709aa21a0 msgr2=0x559709aab650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:26.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.184+0000 7fb77f7fe640 1 --2- 172.21.15.79:0/4101029821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559709aa21a0 0x559709aab650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:26.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.184+0000 7fb77f7fe640 1 -- 172.21.15.79:0/4101029821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559709aba1e0 con 0x559709aa1880 2024-08-20T01:54:26.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.185+0000 7fb77f7fe640 1 --2- 172.21.15.79:0/4101029821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559709aa1880 0x559709aab110 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb774011f60 tx=0x7fb774015040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=238860788eca3414 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:26.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.185+0000 7fb75f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:54:26.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.185+0000 7fb75f7fe640 1 -- 172.21.15.79:0/4101029821 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7740208b0 con 0x559709aa1880 2024-08-20T01:54:26.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.185+0000 7fb75f7fe640 1 -- 172.21.15.79:0/4101029821 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fb774020a50 con 0x559709aa1880 2024-08-20T01:54:26.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.185+0000 7fb788b1c740 1 -- 172.21.15.79:0/4101029821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5597099b7150 con 0x559709aa1880 2024-08-20T01:54:26.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.185+0000 7fb75f7fe640 1 -- 172.21.15.79:0/4101029821 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fb774020c50 con 0x559709aa1880 2024-08-20T01:54:26.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.185+0000 7fb788b1c740 10 client.28772 fetch_fsmap learned FSMap version 71 2024-08-20T01:54:26.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.185+0000 7fb788b1c740 1 -- 172.21.15.79:0/4101029821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x559709abcb90 con 0x559709aa1880 2024-08-20T01:54:26.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.185+0000 7fb75f7fe640 1 -- 172.21.15.79:0/4101029821 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5597099b7150 con 0x559709aa1880 2024-08-20T01:54:26.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.185+0000 7fb75f7fe640 1 -- 172.21.15.79:0/4101029821 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 71) ==== 8374+0+0 (secure 0 0 0) 0x7fb77402ecd0 con 0x559709aa1880 2024-08-20T01:54:26.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.185+0000 7fb788b1c740 10 client.28772 fetch_fsmap finished waiting for FSMap version 71 2024-08-20T01:54:26.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.185+0000 7fb788b1c740 10 client.28772 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:54:26.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.185+0000 7fb788b1c740 20 client.28772 populate_metadata read hostname 'smithi079' 2024-08-20T01:54:26.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.185+0000 7fb788b1c740 1 --2- 172.21.15.79:0/4101029821 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x559709abdee0 0x559709ac02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:26.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.185+0000 7fb788b1c740 4 client.28772 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:54:26.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.185+0000 7fb788b1c740 1 -- 172.21.15.79:0/4101029821 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559709a1a880 con 0x559709abdee0 2024-08-20T01:54:26.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.186+0000 7fb77ffff640 1 --2- 172.21.15.79:0/4101029821 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x559709abdee0 0x559709ac02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:26.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.186+0000 7fb77ffff640 1 --2- 172.21.15.79:0/4101029821 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x559709abdee0 0x559709ac02d0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b323ce9f1b1a6c7 server_cookie=8f2ff9d670b959ec in_seq=0 out_seq=0 2024-08-20T01:54:26.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.186+0000 7fb75f7fe640 10 client.28772 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:54:26.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.187+0000 7fb75f7fe640 1 -- 172.21.15.79:0/4101029821 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559709a1a880 con 0x559709abdee0 2024-08-20T01:54:26.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.187+0000 7fb75f7fe640 10 client.28772 handle_command_reply: tid=0 2024-08-20T01:54:26.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.187+0000 7fb788b1c740 1 client.28772 shutdown 2024-08-20T01:54:26.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.187+0000 7fb788b1c740 1 -- 172.21.15.79:0/4101029821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559709aa1880 msgr2=0x559709aab110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:26.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.187+0000 7fb788b1c740 1 --2- 172.21.15.79:0/4101029821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559709aa1880 0x559709aab110 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb774011f60 tx=0x7fb774015040 comp rx=0 tx=0).stop 2024-08-20T01:54:26.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.187+0000 7fb788b1c740 1 -- 172.21.15.79:0/4101029821 shutdown_connections 2024-08-20T01:54:26.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.187+0000 7fb788b1c740 1 --2- 172.21.15.79:0/4101029821 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x559709abdee0 0x559709ac02d0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:26.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.187+0000 7fb788b1c740 1 --2- 172.21.15.79:0/4101029821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559709aae130 0x559709aabb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:26.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.187+0000 7fb75f7fe640 0 client.28772 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:54:26.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.187+0000 7fb788b1c740 1 --2- 172.21.15.79:0/4101029821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559709aa21a0 0x559709aab650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:26.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.187+0000 7fb788b1c740 1 --2- 172.21.15.79:0/4101029821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559709aa1880 0x559709aab110 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:26.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.187+0000 7fb788b1c740 1 -- 172.21.15.79:0/4101029821 >> 172.21.15.79:0/4101029821 conn(0x559709a9f6b0 msgr2=0x559709aa5220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:26.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.187+0000 7fb788b1c740 1 -- 172.21.15.79:0/4101029821 shutdown_connections 2024-08-20T01:54:26.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.187+0000 7fb788b1c740 1 -- 172.21.15.79:0/4101029821 wait complete. 2024-08-20T01:54:26.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.187+0000 7fb788b1c740 20 client.28772 trim_cache size 0 max 16384 2024-08-20T01:54:26.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.203+0000 7fb788b1c740 1 Processor -- start 2024-08-20T01:54:26.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.204+0000 7fb788b1c740 1 -- start start 2024-08-20T01:54:26.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.205+0000 7fb788b1c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559709aa1880 0x559709aad210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:26.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.205+0000 7fb788b1c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559709aa21a0 0x559709aaa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:26.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.205+0000 7fb788b1c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559709aae130 0x559709ac5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:26.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.205+0000 7fb788b1c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb7801b0210 con 0x559709aa21a0 2024-08-20T01:54:26.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.205+0000 7fb77ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559709aa21a0 0x559709aaa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:26.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.205+0000 7fb788b1c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb7801b1d80 con 0x559709aa1880 2024-08-20T01:54:26.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.205+0000 7fb788b1c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb7801b0910 con 0x559709aae130 2024-08-20T01:54:26.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.205+0000 7fb77f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559709aa1880 0x559709aad210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:26.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.205+0000 7fb77ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559709aa21a0 0x559709aaa9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54026/0 (socket says 172.21.15.79:54026) 2024-08-20T01:54:26.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.205+0000 7fb77ffff640 1 -- 172.21.15.79:0/1064329318 learned_addr learned my addr 172.21.15.79:0/1064329318 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:26.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.205+0000 7fb77f7fe640 1 --2- 172.21.15.79:0/1064329318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559709aae130 0x559709ac5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:26.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.206+0000 7fb77f7fe640 1 -- 172.21.15.79:0/1064329318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559709aae130 msgr2=0x559709ac5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:26.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.206+0000 7fb77f7fe640 1 --2- 172.21.15.79:0/1064329318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559709aae130 0x559709ac5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:26.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.206+0000 7fb77f7fe640 1 -- 172.21.15.79:0/1064329318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559709aa21a0 msgr2=0x559709aaa9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:26.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.206+0000 7fb77f7fe640 1 --2- 172.21.15.79:0/1064329318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559709aa21a0 0x559709aaa9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:26.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.206+0000 7fb77f7fe640 1 -- 172.21.15.79:0/1064329318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559709aa0130 con 0x559709aa1880 2024-08-20T01:54:26.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.206+0000 7fb77f7fe640 1 --2- 172.21.15.79:0/1064329318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559709aa1880 0x559709aad210 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb774015010 tx=0x7fb7740096a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12df3123aaa9b3c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:26.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.206+0000 7fb765ffb640 1 -- 172.21.15.79:0/1064329318 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77403d040 con 0x559709aa1880 2024-08-20T01:54:26.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.206+0000 7fb765ffb640 1 -- 172.21.15.79:0/1064329318 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb774017030 con 0x559709aa1880 2024-08-20T01:54:26.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.206+0000 7fb765ffb640 1 -- 172.21.15.79:0/1064329318 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77402d910 con 0x559709aa1880 2024-08-20T01:54:26.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.207+0000 7fb788b1c740 1 -- 172.21.15.79:0/1064329318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559709aa1880 msgr2=0x559709aad210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:26.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.207+0000 7fb788b1c740 1 --2- 172.21.15.79:0/1064329318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559709aa1880 0x559709aad210 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb774015010 tx=0x7fb7740096a0 comp rx=0 tx=0).stop 2024-08-20T01:54:26.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.207+0000 7fb788b1c740 1 -- 172.21.15.79:0/1064329318 shutdown_connections 2024-08-20T01:54:26.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.207+0000 7fb788b1c740 1 --2- 172.21.15.79:0/1064329318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559709aae130 0x559709ac5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:26.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.207+0000 7fb788b1c740 1 --2- 172.21.15.79:0/1064329318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559709aa21a0 0x559709aaa9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:26.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.207+0000 7fb788b1c740 1 --2- 172.21.15.79:0/1064329318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559709aa1880 0x559709aad210 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:26.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.207+0000 7fb788b1c740 1 -- 172.21.15.79:0/1064329318 >> 172.21.15.79:0/1064329318 conn(0x559709a9f6b0 msgr2=0x559709aab8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:26.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.207+0000 7fb788b1c740 1 -- 172.21.15.79:0/1064329318 shutdown_connections 2024-08-20T01:54:26.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.207+0000 7fb788b1c740 1 -- 172.21.15.79:0/1064329318 wait complete. 2024-08-20T01:54:26.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.208+0000 7fb788b1c740 1 -- start start 2024-08-20T01:54:26.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.208+0000 7fb788b1c740 1 Processor -- start 2024-08-20T01:54:26.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.208+0000 7fb788b1c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559709aa1880 0x559709ab1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:26.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.208+0000 7fb788b1c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559709aa21a0 0x559709ab1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:26.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.208+0000 7fb788b1c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559709aae130 0x559709b269d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:26.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.208+0000 7fb788b1c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb7801b16b0 con 0x559709aae130 2024-08-20T01:54:26.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.208+0000 7fb788b1c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb7801b0fe0 con 0x559709aa1880 2024-08-20T01:54:26.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.208+0000 7fb788b1c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb7801ae1f0 con 0x559709aa21a0 2024-08-20T01:54:26.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.208+0000 7fb788b1c740 10 client.0 _ll_register_callbacks cb 0x7fb774005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:54:26.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.208+0000 7fb77f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559709aa1880 0x559709ab1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:26.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.209+0000 7fb77ffff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559709aa21a0 0x559709ab1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:26.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.209+0000 7fb77f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559709aa1880 0x559709ab1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:40860/0 (socket says 172.21.15.79:40860) 2024-08-20T01:54:26.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.209+0000 7fb77f7fe640 1 -- 172.21.15.79:0/3110763389 learned_addr learned my addr 172.21.15.79:0/3110763389 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:26.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.209+0000 7fb77f7fe640 1 --2- 172.21.15.79:0/3110763389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559709aae130 0x559709b269d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:26.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.209+0000 7fb77ffff640 1 -- 172.21.15.79:0/3110763389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559709aa1880 msgr2=0x559709ab1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:26.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.209+0000 7fb77ffff640 1 --2- 172.21.15.79:0/3110763389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559709aa1880 0x559709ab1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:26.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.209+0000 7fb77ffff640 1 -- 172.21.15.79:0/3110763389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559709aae130 msgr2=0x559709b269d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:26.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.209+0000 7fb77ffff640 1 --2- 172.21.15.79:0/3110763389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559709aae130 0x559709b269d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:26.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.209+0000 7fb77ffff640 1 -- 172.21.15.79:0/3110763389 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559709aabfb0 con 0x559709aa21a0 2024-08-20T01:54:26.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.209+0000 7fb77f7fe640 1 --2- 172.21.15.79:0/3110763389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559709aa1880 0x559709ab1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:54:26.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.209+0000 7fb77ffff640 1 --2- 172.21.15.79:0/3110763389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559709aa21a0 0x559709ab1d60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x559709abb080 tx=0x7fb770004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8878548d063fea3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:26.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.209+0000 7fb75f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:54:26.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.209+0000 7fb75f7fe640 1 -- 172.21.15.79:0/3110763389 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77004d030 con 0x559709aa21a0 2024-08-20T01:54:26.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.209+0000 7fb75f7fe640 1 -- 172.21.15.79:0/3110763389 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fb770004480 con 0x559709aa21a0 2024-08-20T01:54:26.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.209+0000 7fb788b1c740 1 -- 172.21.15.79:0/3110763389 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb774017030 con 0x559709aa21a0 2024-08-20T01:54:26.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.209+0000 7fb75f7fe640 1 -- 172.21.15.79:0/3110763389 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fb770035040 con 0x559709aa21a0 2024-08-20T01:54:26.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.209+0000 7fb788b1c740 10 client.28672 fetch_fsmap learned FSMap version 71 2024-08-20T01:54:26.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.209+0000 7fb788b1c740 1 -- 172.21.15.79:0/3110763389 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x559709b28110 con 0x559709aa21a0 2024-08-20T01:54:26.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.210+0000 7fb75f7fe640 1 -- 172.21.15.79:0/3110763389 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb774017030 con 0x559709aa21a0 2024-08-20T01:54:26.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.210+0000 7fb75f7fe640 1 -- 172.21.15.79:0/3110763389 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 71) ==== 8374+0+0 (secure 0 0 0) 0x7fb7700321f0 con 0x559709aa21a0 2024-08-20T01:54:26.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.210+0000 7fb788b1c740 10 client.28672 fetch_fsmap finished waiting for FSMap version 71 2024-08-20T01:54:26.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.210+0000 7fb788b1c740 10 client.28672 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:54:26.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.210+0000 7fb788b1c740 20 client.28672 populate_metadata read hostname 'smithi079' 2024-08-20T01:54:26.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.210+0000 7fb788b1c740 1 --2- 172.21.15.79:0/3110763389 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x559709b288f0 0x559709b2ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:26.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.210+0000 7fb788b1c740 4 client.28672 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:54:26.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.210+0000 7fb788b1c740 1 -- 172.21.15.79:0/3110763389 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559709a16320 con 0x559709b288f0 2024-08-20T01:54:26.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.210+0000 7fb77f7fe640 1 --2- 172.21.15.79:0/3110763389 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x559709b288f0 0x559709b2ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:26.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.210+0000 7fb75f7fe640 10 client.28672 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:54:26.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.210+0000 7fb77f7fe640 1 --2- 172.21.15.79:0/3110763389 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x559709b288f0 0x559709b2ad10 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f46d4818137eebcb server_cookie=8fad115717ebb94 in_seq=0 out_seq=0 2024-08-20T01:54:26.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.211+0000 7fb75f7fe640 1 -- 172.21.15.79:0/3110763389 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559709a16320 con 0x559709b288f0 2024-08-20T01:54:26.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.211+0000 7fb75f7fe640 10 client.28672 handle_command_reply: tid=0 2024-08-20T01:54:26.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.211+0000 7fb788b1c740 1 client.28672 shutdown 2024-08-20T01:54:26.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.211+0000 7fb788b1c740 1 -- 172.21.15.79:0/3110763389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559709aa21a0 msgr2=0x559709ab1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:26.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.211+0000 7fb788b1c740 1 --2- 172.21.15.79:0/3110763389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559709aa21a0 0x559709ab1d60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x559709abb080 tx=0x7fb770004040 comp rx=0 tx=0).stop 2024-08-20T01:54:26.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.211+0000 7fb788b1c740 1 -- 172.21.15.79:0/3110763389 shutdown_connections 2024-08-20T01:54:26.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.211+0000 7fb788b1c740 1 --2- 172.21.15.79:0/3110763389 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x559709b288f0 0x559709b2ad10 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:26.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.211+0000 7fb788b1c740 1 --2- 172.21.15.79:0/3110763389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559709aae130 0x559709b269d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:26.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.211+0000 7fb788b1c740 1 --2- 172.21.15.79:0/3110763389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559709aa21a0 0x559709ab1d60 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:26.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.211+0000 7fb75f7fe640 0 client.28672 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:54:26.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.211+0000 7fb788b1c740 1 --2- 172.21.15.79:0/3110763389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559709aa1880 0x559709ab1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:26.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.211+0000 7fb788b1c740 1 -- 172.21.15.79:0/3110763389 >> 172.21.15.79:0/3110763389 conn(0x559709a9f6b0 msgr2=0x559709aa4910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:26.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.211+0000 7fb788b1c740 1 -- 172.21.15.79:0/3110763389 shutdown_connections 2024-08-20T01:54:26.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.211+0000 7fb788b1c740 1 -- 172.21.15.79:0/3110763389 wait complete. 2024-08-20T01:54:26.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.211+0000 7fb788b1c740 20 client.28672 trim_cache size 0 max 16384 2024-08-20T01:54:26.220 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:54:26.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.212+0000 7fb786723640 1 -- 172.21.15.79:0/3186465030 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb7680b3bd0 msgr2=0x7fb7680b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:26.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.212+0000 7fb786723640 1 --2- 172.21.15.79:0/3186465030 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb7680b3bd0 0x7fb7680b6090 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fb7780a5680 tx=0x7fb77806d040 comp rx=0 tx=0).stop 2024-08-20T01:54:26.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.212+0000 7fb786723640 1 -- 172.21.15.79:0/3186465030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb78010efe0 msgr2=0x7fb7801a0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:26.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.212+0000 7fb786723640 1 --2- 172.21.15.79:0/3186465030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb78010efe0 0x7fb7801a0a70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb77800ec50 tx=0x7fb77800c6a0 comp rx=0 tx=0).stop 2024-08-20T01:54:26.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.212+0000 7fb786723640 1 -- 172.21.15.79:0/3186465030 shutdown_connections 2024-08-20T01:54:26.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.212+0000 7fb786723640 1 --2- 172.21.15.79:0/3186465030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb78010efe0 0x7fb7801a0a70 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:26.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.212+0000 7fb786723640 1 --2- 172.21.15.79:0/3186465030 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb7680b3bd0 0x7fb7680b6090 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:26.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.212+0000 7fb786723640 1 --2- 172.21.15.79:0/3186465030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb780101d30 0x7fb78019b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:26.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.212+0000 7fb786723640 1 --2- 172.21.15.79:0/3186465030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb780101330 0x7fb78019b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:26.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.212+0000 7fb786723640 1 -- 172.21.15.79:0/3186465030 >> 172.21.15.79:0/3186465030 conn(0x7fb780076bd0 msgr2=0x7fb78010f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:26.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.212+0000 7fb786723640 1 -- 172.21.15.79:0/3186465030 shutdown_connections 2024-08-20T01:54:26.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:26.212+0000 7fb786723640 1 -- 172.21.15.79:0/3186465030 wait complete. 2024-08-20T01:54:26.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:26 smithi079 ceph-mon[18656]: pgmap v860: 97 pgs: 97 active+clean; 4.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.7 KiB/s wr, 21 op/s 2024-08-20T01:54:26.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:26 smithi175 ceph-mon[22392]: pgmap v860: 97 pgs: 97 active+clean; 4.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.7 KiB/s wr, 21 op/s 2024-08-20T01:54:26.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:26 smithi081 ceph-mon[22209]: pgmap v860: 97 pgs: 97 active+clean; 4.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.7 KiB/s wr, 21 op/s 2024-08-20T01:54:27.020 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-20T01:54:27.271 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:54:27.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.771+0000 7f9afab86640 1 -- 172.21.15.79:0/4293619944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9af4104210 msgr2=0x7f9af410c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:27.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.771+0000 7f9afab86640 1 --2- 172.21.15.79:0/4293619944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9af4104210 0x7f9af410c7f0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0009900 tx=0x7f9ae002a410 comp rx=0 tx=0).stop 2024-08-20T01:54:27.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.771+0000 7f9afab86640 1 -- 172.21.15.79:0/4293619944 shutdown_connections 2024-08-20T01:54:27.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.771+0000 7f9afab86640 1 --2- 172.21.15.79:0/4293619944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9af410cdc0 0x7f9af410f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:27.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.771+0000 7f9afab86640 1 --2- 172.21.15.79:0/4293619944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9af4104210 0x7f9af410c7f0 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:27.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.771+0000 7f9afab86640 1 --2- 172.21.15.79:0/4293619944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9af4103810 0x7f9af4103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:27.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.771+0000 7f9afab86640 1 -- 172.21.15.79:0/4293619944 >> 172.21.15.79:0/4293619944 conn(0x7f9af40fd400 msgr2=0x7f9af40ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:27.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.771+0000 7f9afab86640 1 -- 172.21.15.79:0/4293619944 shutdown_connections 2024-08-20T01:54:27.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.771+0000 7f9afab86640 1 -- 172.21.15.79:0/4293619944 wait complete. 2024-08-20T01:54:27.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.772+0000 7f9afab86640 1 Processor -- start 2024-08-20T01:54:27.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.772+0000 7f9afab86640 1 -- start start 2024-08-20T01:54:27.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.772+0000 7f9afab86640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9af4103810 0x7f9af4101690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:27.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.772+0000 7f9afab86640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9af4104210 0x7f9af4101bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:27.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.772+0000 7f9afab86640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9af410cdc0 0x7f9af4102110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:27.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.772+0000 7f9afab86640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9af4112950 con 0x7f9af410cdc0 2024-08-20T01:54:27.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.772+0000 7f9afab86640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9af41127d0 con 0x7f9af4104210 2024-08-20T01:54:27.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.772+0000 7f9afab86640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9af4112ad0 con 0x7f9af4103810 2024-08-20T01:54:27.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.773+0000 7f9af9123640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9af410cdc0 0x7f9af4102110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:27.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.773+0000 7f9af3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9af4104210 0x7f9af4101bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:27.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.773+0000 7f9af9123640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9af410cdc0 0x7f9af4102110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54058/0 (socket says 172.21.15.79:54058) 2024-08-20T01:54:27.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.773+0000 7f9af8922640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9af4103810 0x7f9af4101690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:27.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.773+0000 7f9af9123640 1 -- 172.21.15.79:0/2462560803 learned_addr learned my addr 172.21.15.79:0/2462560803 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:27.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.773+0000 7f9af9123640 1 -- 172.21.15.79:0/2462560803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9af4103810 msgr2=0x7f9af4101690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:27.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.773+0000 7f9af9123640 1 --2- 172.21.15.79:0/2462560803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9af4103810 0x7f9af4101690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:27.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.773+0000 7f9af9123640 1 -- 172.21.15.79:0/2462560803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9af4104210 msgr2=0x7f9af4101bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:27.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.773+0000 7f9af9123640 1 --2- 172.21.15.79:0/2462560803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9af4104210 0x7f9af4101bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:27.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.773+0000 7f9af9123640 1 -- 172.21.15.79:0/2462560803 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af41a7340 con 0x7f9af410cdc0 2024-08-20T01:54:27.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.773+0000 7f9af9123640 1 --2- 172.21.15.79:0/2462560803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9af410cdc0 0x7f9af4102110 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f9aec00eaa0 tx=0x7f9aec00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:27.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.773+0000 7f9af1ffb640 1 -- 172.21.15.79:0/2462560803 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aec00cdb0 con 0x7f9af410cdc0 2024-08-20T01:54:27.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.773+0000 7f9afab86640 1 -- 172.21.15.79:0/2462560803 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9af41a7630 con 0x7f9af410cdc0 2024-08-20T01:54:27.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.773+0000 7f9af1ffb640 1 -- 172.21.15.79:0/2462560803 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9aec005020 con 0x7f9af410cdc0 2024-08-20T01:54:27.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.773+0000 7f9af1ffb640 1 -- 172.21.15.79:0/2462560803 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aec0116d0 con 0x7f9af410cdc0 2024-08-20T01:54:27.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.774+0000 7f9afab86640 1 -- 172.21.15.79:0/2462560803 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9af41a7af0 con 0x7f9af410cdc0 2024-08-20T01:54:27.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.777+0000 7f9afcf7f740 1 Processor -- start 2024-08-20T01:54:27.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.777+0000 7f9af1ffb640 1 -- 172.21.15.79:0/2462560803 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f9aec0051d0 con 0x7f9af410cdc0 2024-08-20T01:54:27.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.777+0000 7f9afcf7f740 1 -- start start 2024-08-20T01:54:27.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.777+0000 7f9afcf7f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56051b7bc880 0x56051b7bcc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:27.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.777+0000 7f9afcf7f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56051b7bd1a0 0x56051b7c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:27.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.777+0000 7f9afcf7f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56051b7c9130 0x56051b7cb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:27.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.777+0000 7f9afcf7f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56051b733930 con 0x56051b7bd1a0 2024-08-20T01:54:27.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.777+0000 7f9afcf7f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56051b722e30 con 0x56051b7c9130 2024-08-20T01:54:27.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.777+0000 7f9afcf7f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56051b726e70 con 0x56051b7bc880 2024-08-20T01:54:27.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.777+0000 7f9af8922640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56051b7bd1a0 0x56051b7c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:27.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.777+0000 7f9af8922640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56051b7bd1a0 0x56051b7c8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54074/0 (socket says 172.21.15.79:54074) 2024-08-20T01:54:27.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.777+0000 7f9af8922640 1 -- 172.21.15.79:0/2931404552 learned_addr learned my addr 172.21.15.79:0/2931404552 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:27.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.777+0000 7f9af3fff640 1 --2- 172.21.15.79:0/2931404552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56051b7c9130 0x56051b7cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:27.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.777+0000 7f9af3fff640 1 --2- 172.21.15.79:0/2931404552 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56051b7bc880 0x56051b7bcc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:27.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.777+0000 7f9af8922640 1 -- 172.21.15.79:0/2931404552 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56051b7bc880 msgr2=0x56051b7bcc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:27.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.777+0000 7f9af8922640 1 --2- 172.21.15.79:0/2931404552 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56051b7bc880 0x56051b7bcc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:27.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.778+0000 7f9af8922640 1 -- 172.21.15.79:0/2931404552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56051b7c9130 msgr2=0x56051b7cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:27.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.778+0000 7f9af8922640 1 --2- 172.21.15.79:0/2931404552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56051b7c9130 0x56051b7cb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:27.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.778+0000 7f9af8922640 1 -- 172.21.15.79:0/2931404552 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56051b482650 con 0x56051b7bd1a0 2024-08-20T01:54:27.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.778+0000 7f9af3fff640 1 --2- 172.21.15.79:0/2931404552 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56051b7bc880 0x56051b7bcc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:54:27.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.778+0000 7f9af1ffb640 1 --2- 172.21.15.79:0/2462560803 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9ae40b3bd0 0x7f9ae40b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:27.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.778+0000 7f9af8922640 1 --2- 172.21.15.79:0/2931404552 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56051b7bd1a0 0x56051b7c8bf0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f9ae800bd00 tx=0x7f9ae80107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57457648459caa93 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:27.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.778+0000 7f9af3fff640 1 --2- 172.21.15.79:0/2462560803 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9ae40b3bd0 0x7f9ae40b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:27.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.778+0000 7f9af1ffb640 1 -- 172.21.15.79:0/2462560803 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9aec0e3ca0 con 0x7f9af410cdc0 2024-08-20T01:54:27.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.778+0000 7f9adeffd640 1 -- 172.21.15.79:0/2931404552 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae8005220 con 0x56051b7bd1a0 2024-08-20T01:54:27.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.778+0000 7f9adeffd640 1 -- 172.21.15.79:0/2931404552 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ae8004c30 con 0x56051b7bd1a0 2024-08-20T01:54:27.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.778+0000 7f9adeffd640 1 -- 172.21.15.79:0/2931404552 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae80116a0 con 0x56051b7bd1a0 2024-08-20T01:54:27.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.779+0000 7f9afcf7f740 1 -- 172.21.15.79:0/2931404552 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56051b7bd1a0 msgr2=0x56051b7c8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:27.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.779+0000 7f9afcf7f740 1 --2- 172.21.15.79:0/2931404552 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56051b7bd1a0 0x56051b7c8bf0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f9ae800bd00 tx=0x7f9ae80107a0 comp rx=0 tx=0).stop 2024-08-20T01:54:27.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.779+0000 7f9af3fff640 1 --2- 172.21.15.79:0/2462560803 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9ae40b3bd0 0x7f9ae40b6090 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0006010 tx=0x7f9ae0041040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:27.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.779+0000 7f9afcf7f740 1 -- 172.21.15.79:0/2931404552 shutdown_connections 2024-08-20T01:54:27.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.779+0000 7f9afcf7f740 1 --2- 172.21.15.79:0/2931404552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56051b7c9130 0x56051b7cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:27.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.779+0000 7f9afcf7f740 1 --2- 172.21.15.79:0/2931404552 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56051b7bd1a0 0x56051b7c8bf0 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:27.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.779+0000 7f9afcf7f740 1 --2- 172.21.15.79:0/2931404552 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56051b7bc880 0x56051b7bcc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:27.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.779+0000 7f9afcf7f740 1 -- 172.21.15.79:0/2931404552 >> 172.21.15.79:0/2931404552 conn(0x56051b7ba6b0 msgr2=0x56051b7bb850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:27.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.779+0000 7f9afcf7f740 1 -- 172.21.15.79:0/2931404552 shutdown_connections 2024-08-20T01:54:27.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.779+0000 7f9afcf7f740 1 -- 172.21.15.79:0/2931404552 wait complete. 2024-08-20T01:54:27.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.779+0000 7f9afcf7f740 1 -- start start 2024-08-20T01:54:27.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.779+0000 7f9afcf7f740 1 Processor -- start 2024-08-20T01:54:27.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.780+0000 7f9afcf7f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56051b7bc880 0x56051b7c6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:27.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.780+0000 7f9afcf7f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56051b7bd1a0 0x56051b7c6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:27.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.780+0000 7f9afcf7f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56051b7c9130 0x56051b7c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:27.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.780+0000 7f9afcf7f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56051b585700 con 0x56051b7bc880 2024-08-20T01:54:27.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.780+0000 7f9afcf7f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56051b6a9810 con 0x56051b7c9130 2024-08-20T01:54:27.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.780+0000 7f9afcf7f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56051b7cbde0 con 0x56051b7bd1a0 2024-08-20T01:54:27.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.780+0000 7f9afcf7f740 10 client.0 _ll_register_callbacks cb 0x56051b71c700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:54:27.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.780+0000 7f9af3fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56051b7bd1a0 0x56051b7c6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:27.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.780+0000 7f9af8922640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56051b7bc880 0x56051b7c6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:27.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.780+0000 7f9af3fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56051b7bd1a0 0x56051b7c6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:42718/0 (socket says 172.21.15.79:42718) 2024-08-20T01:54:27.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.780+0000 7f9af3fff640 1 -- 172.21.15.79:0/3671969695 learned_addr learned my addr 172.21.15.79:0/3671969695 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:27.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.780+0000 7f9af9123640 1 --2- 172.21.15.79:0/3671969695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56051b7c9130 0x56051b7c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:27.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.780+0000 7f9af3fff640 1 -- 172.21.15.79:0/3671969695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56051b7c9130 msgr2=0x56051b7c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:27.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.780+0000 7f9af3fff640 1 --2- 172.21.15.79:0/3671969695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56051b7c9130 0x56051b7c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:27.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.780+0000 7f9af3fff640 1 -- 172.21.15.79:0/3671969695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56051b7bc880 msgr2=0x56051b7c6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:27.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.780+0000 7f9af3fff640 1 --2- 172.21.15.79:0/3671969695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56051b7bc880 0x56051b7c6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:27.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.780+0000 7f9af3fff640 1 -- 172.21.15.79:0/3671969695 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56051b7d51e0 con 0x56051b7bd1a0 2024-08-20T01:54:27.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.780+0000 7f9af8922640 1 --2- 172.21.15.79:0/3671969695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56051b7bc880 0x56051b7c6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:54:27.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.781+0000 7f9af3fff640 1 --2- 172.21.15.79:0/3671969695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56051b7bd1a0 0x56051b7c6650 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0005540 tx=0x7f9ae002a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90900c4b7ff09027 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:27.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.781+0000 7f9ad3fff640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:54:27.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.781+0000 7f9ad3fff640 1 -- 172.21.15.79:0/3671969695 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae0051070 con 0x56051b7bd1a0 2024-08-20T01:54:27.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.781+0000 7f9ad3fff640 1 -- 172.21.15.79:0/3671969695 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9ae0004c50 con 0x56051b7bd1a0 2024-08-20T01:54:27.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.781+0000 7f9afcf7f740 1 -- 172.21.15.79:0/3671969695 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56051b6d2150 con 0x56051b7bd1a0 2024-08-20T01:54:27.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.781+0000 7f9ad3fff640 1 -- 172.21.15.79:0/3671969695 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f9ae005d050 con 0x56051b7bd1a0 2024-08-20T01:54:27.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.781+0000 7f9afcf7f740 10 client.28684 fetch_fsmap learned FSMap version 71 2024-08-20T01:54:27.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.781+0000 7f9afcf7f740 1 -- 172.21.15.79:0/3671969695 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x56051b7d7b90 con 0x56051b7bd1a0 2024-08-20T01:54:27.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.781+0000 7f9ad3fff640 1 -- 172.21.15.79:0/3671969695 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56051b6d2150 con 0x56051b7bd1a0 2024-08-20T01:54:27.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.781+0000 7f9ad3fff640 1 -- 172.21.15.79:0/3671969695 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 71) ==== 8374+0+0 (secure 0 0 0) 0x7f9ae003d450 con 0x56051b7bd1a0 2024-08-20T01:54:27.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.781+0000 7f9afcf7f740 10 client.28684 fetch_fsmap finished waiting for FSMap version 71 2024-08-20T01:54:27.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.781+0000 7f9afcf7f740 10 client.28684 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:54:27.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.781+0000 7f9afcf7f740 20 client.28684 populate_metadata read hostname 'smithi079' 2024-08-20T01:54:27.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.781+0000 7f9afcf7f740 1 --2- 172.21.15.79:0/3671969695 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x56051b7d9010 0x56051b7db4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:27.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.781+0000 7f9afcf7f740 4 client.28684 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:54:27.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.781+0000 7f9afcf7f740 1 -- 172.21.15.79:0/3671969695 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56051b735880 con 0x56051b7d9010 2024-08-20T01:54:27.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.782+0000 7f9af8922640 1 --2- 172.21.15.79:0/3671969695 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x56051b7d9010 0x56051b7db4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:27.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.782+0000 7f9af8922640 1 --2- 172.21.15.79:0/3671969695 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x56051b7d9010 0x56051b7db4b0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=908a264bf98a55c6 server_cookie=c54dd1e85aebbfef in_seq=0 out_seq=0 2024-08-20T01:54:27.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.782+0000 7f9ad3fff640 10 client.28684 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:54:27.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.783+0000 7f9ad3fff640 1 -- 172.21.15.79:0/3671969695 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56051b735880 con 0x56051b7d9010 2024-08-20T01:54:27.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.783+0000 7f9ad3fff640 10 client.28684 handle_command_reply: tid=0 2024-08-20T01:54:27.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.783+0000 7f9afcf7f740 1 client.28684 shutdown 2024-08-20T01:54:27.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.783+0000 7f9afcf7f740 1 -- 172.21.15.79:0/3671969695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56051b7bd1a0 msgr2=0x56051b7c6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:27.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.783+0000 7f9afcf7f740 1 --2- 172.21.15.79:0/3671969695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56051b7bd1a0 0x56051b7c6650 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0005540 tx=0x7f9ae002a410 comp rx=0 tx=0).stop 2024-08-20T01:54:27.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.783+0000 7f9afcf7f740 1 -- 172.21.15.79:0/3671969695 shutdown_connections 2024-08-20T01:54:27.791 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.783+0000 7f9afcf7f740 1 --2- 172.21.15.79:0/3671969695 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x56051b7d9010 0x56051b7db4b0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:27.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.783+0000 7f9afcf7f740 1 --2- 172.21.15.79:0/3671969695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56051b7c9130 0x56051b7c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:27.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.783+0000 7f9afcf7f740 1 --2- 172.21.15.79:0/3671969695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56051b7bd1a0 0x56051b7c6650 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:27.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.783+0000 7f9ad3fff640 0 client.28684 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:54:27.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.783+0000 7f9afcf7f740 1 --2- 172.21.15.79:0/3671969695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56051b7bc880 0x56051b7c6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:27.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.783+0000 7f9afcf7f740 1 -- 172.21.15.79:0/3671969695 >> 172.21.15.79:0/3671969695 conn(0x56051b7ba6b0 msgr2=0x56051b7c0250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:27.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.783+0000 7f9afcf7f740 1 -- 172.21.15.79:0/3671969695 shutdown_connections 2024-08-20T01:54:27.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.783+0000 7f9afcf7f740 1 -- 172.21.15.79:0/3671969695 wait complete. 2024-08-20T01:54:27.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.783+0000 7f9afcf7f740 20 client.28684 trim_cache size 0 max 16384 2024-08-20T01:54:27.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.797+0000 7f9afcf7f740 1 Processor -- start 2024-08-20T01:54:27.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.797+0000 7f9afcf7f740 1 -- start start 2024-08-20T01:54:27.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.797+0000 7f9afcf7f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56051b7bc880 0x56051b7c59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:27.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.797+0000 7f9afcf7f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56051b7bd1a0 0x56051b7e0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:27.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.797+0000 7f9afcf7f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56051b7c9130 0x56051b7e1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:27.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.797+0000 7f9afcf7f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9af41b0190 con 0x56051b7bc880 2024-08-20T01:54:27.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.797+0000 7f9afcf7f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9af41b1d00 con 0x56051b7c9130 2024-08-20T01:54:27.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.797+0000 7f9afcf7f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9af41b0890 con 0x56051b7bd1a0 2024-08-20T01:54:27.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.797+0000 7f9af8922640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56051b7bc880 0x56051b7c59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:27.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.797+0000 7f9af8922640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56051b7bc880 0x56051b7c59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54090/0 (socket says 172.21.15.79:54090) 2024-08-20T01:54:27.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.798+0000 7f9af8922640 1 -- 172.21.15.79:0/315235699 learned_addr learned my addr 172.21.15.79:0/315235699 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:27.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.798+0000 7f9af3fff640 1 --2- 172.21.15.79:0/315235699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56051b7bd1a0 0x56051b7e0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:27.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.798+0000 7f9af9123640 1 --2- 172.21.15.79:0/315235699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56051b7c9130 0x56051b7e1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:27.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.798+0000 7f9af8922640 1 -- 172.21.15.79:0/315235699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56051b7bd1a0 msgr2=0x56051b7e0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:27.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.798+0000 7f9af8922640 1 --2- 172.21.15.79:0/315235699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56051b7bd1a0 0x56051b7e0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:27.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.798+0000 7f9af8922640 1 -- 172.21.15.79:0/315235699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56051b7c9130 msgr2=0x56051b7e1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:27.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.798+0000 7f9af8922640 1 --2- 172.21.15.79:0/315235699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56051b7c9130 0x56051b7e1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:27.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.798+0000 7f9af8922640 1 -- 172.21.15.79:0/315235699 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56051b7ba4e0 con 0x56051b7bc880 2024-08-20T01:54:27.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.798+0000 7f9af8922640 1 --2- 172.21.15.79:0/315235699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56051b7bc880 0x56051b7c59a0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f9ae8000c00 tx=0x7f9ae8005600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c81096fe5212fd20 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:27.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.798+0000 7f9ade7fc640 1 -- 172.21.15.79:0/315235699 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae8004220 con 0x56051b7bc880 2024-08-20T01:54:27.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.798+0000 7f9ade7fc640 1 -- 172.21.15.79:0/315235699 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ae800b710 con 0x56051b7bc880 2024-08-20T01:54:27.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.798+0000 7f9ade7fc640 1 -- 172.21.15.79:0/315235699 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae80116c0 con 0x56051b7bc880 2024-08-20T01:54:27.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.799+0000 7f9afcf7f740 1 -- 172.21.15.79:0/315235699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56051b7bc880 msgr2=0x56051b7c59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:27.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.799+0000 7f9afcf7f740 1 --2- 172.21.15.79:0/315235699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56051b7bc880 0x56051b7c59a0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f9ae8000c00 tx=0x7f9ae8005600 comp rx=0 tx=0).stop 2024-08-20T01:54:27.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.799+0000 7f9afcf7f740 1 -- 172.21.15.79:0/315235699 shutdown_connections 2024-08-20T01:54:27.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.799+0000 7f9afcf7f740 1 --2- 172.21.15.79:0/315235699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56051b7c9130 0x56051b7e1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:27.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.799+0000 7f9afcf7f740 1 --2- 172.21.15.79:0/315235699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56051b7bd1a0 0x56051b7e0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:27.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.799+0000 7f9afcf7f740 1 --2- 172.21.15.79:0/315235699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56051b7bc880 0x56051b7c59a0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:27.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.799+0000 7f9afcf7f740 1 -- 172.21.15.79:0/315235699 >> 172.21.15.79:0/315235699 conn(0x56051b7ba6b0 msgr2=0x56051b7c7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:27.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.799+0000 7f9afcf7f740 1 -- 172.21.15.79:0/315235699 shutdown_connections 2024-08-20T01:54:27.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.799+0000 7f9afcf7f740 1 -- 172.21.15.79:0/315235699 wait complete. 2024-08-20T01:54:27.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.799+0000 7f9afcf7f740 1 -- start start 2024-08-20T01:54:27.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.799+0000 7f9afcf7f740 1 Processor -- start 2024-08-20T01:54:27.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.800+0000 7f9afcf7f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56051b7bc880 0x56051b7d1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:27.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.800+0000 7f9afcf7f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56051b7bd1a0 0x56051b7d15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:27.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.800+0000 7f9afcf7f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56051b7c9130 0x56051b7c2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:27.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.800+0000 7f9afcf7f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9af41b1630 con 0x56051b7bd1a0 2024-08-20T01:54:27.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.800+0000 7f9afcf7f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9af41b0f60 con 0x56051b7bc880 2024-08-20T01:54:27.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.800+0000 7f9afcf7f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9af41ae170 con 0x56051b7c9130 2024-08-20T01:54:27.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.800+0000 7f9afcf7f740 10 client.0 _ll_register_callbacks cb 0x7f9ae0004460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:54:27.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.800+0000 7f9af8922640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56051b7bc880 0x56051b7d1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:27.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.800+0000 7f9af9123640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56051b7c9130 0x56051b7c2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:27.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.800+0000 7f9af3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56051b7bd1a0 0x56051b7d15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:27.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.800+0000 7f9af8922640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56051b7bc880 0x56051b7d1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:40922/0 (socket says 172.21.15.79:40922) 2024-08-20T01:54:27.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.800+0000 7f9af8922640 1 -- 172.21.15.79:0/760677991 learned_addr learned my addr 172.21.15.79:0/760677991 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:27.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.800+0000 7f9af8922640 1 -- 172.21.15.79:0/760677991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56051b7c9130 msgr2=0x56051b7c2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:27.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.800+0000 7f9af8922640 1 --2- 172.21.15.79:0/760677991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56051b7c9130 0x56051b7c2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:27.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.800+0000 7f9af8922640 1 -- 172.21.15.79:0/760677991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56051b7bd1a0 msgr2=0x56051b7d15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:27.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.800+0000 7f9af8922640 1 --2- 172.21.15.79:0/760677991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56051b7bd1a0 0x56051b7d15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:27.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.800+0000 7f9af8922640 1 -- 172.21.15.79:0/760677991 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56051b7bb130 con 0x56051b7bc880 2024-08-20T01:54:27.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.800+0000 7f9af3fff640 1 --2- 172.21.15.79:0/760677991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56051b7bd1a0 0x56051b7d15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:54:27.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.800+0000 7f9af9123640 1 --2- 172.21.15.79:0/760677991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56051b7c9130 0x56051b7c2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:54:27.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.800+0000 7f9af8922640 1 --2- 172.21.15.79:0/760677991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56051b7bc880 0x56051b7d1070 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9ae800ba60 tx=0x7f9ae800beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=776ee01942bb96a0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:27.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.800+0000 7f9ad3fff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:54:27.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.801+0000 7f9ad3fff640 1 -- 172.21.15.79:0/760677991 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae80038c0 con 0x56051b7bc880 2024-08-20T01:54:27.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.801+0000 7f9ad3fff640 1 -- 172.21.15.79:0/760677991 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9ae8003a60 con 0x56051b7bc880 2024-08-20T01:54:27.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.801+0000 7f9afcf7f740 1 -- 172.21.15.79:0/760677991 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ae800b710 con 0x56051b7bc880 2024-08-20T01:54:27.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.801+0000 7f9ad3fff640 1 -- 172.21.15.79:0/760677991 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f9ae8003d00 con 0x56051b7bc880 2024-08-20T01:54:27.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.801+0000 7f9afcf7f740 10 client.28796 fetch_fsmap learned FSMap version 71 2024-08-20T01:54:27.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.801+0000 7f9afcf7f740 1 -- 172.21.15.79:0/760677991 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x56051b8434e0 con 0x56051b7bc880 2024-08-20T01:54:27.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.801+0000 7f9ad3fff640 1 -- 172.21.15.79:0/760677991 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ae800b710 con 0x56051b7bc880 2024-08-20T01:54:27.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.801+0000 7f9ad3fff640 1 -- 172.21.15.79:0/760677991 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 71) ==== 8374+0+0 (secure 0 0 0) 0x7f9ae802e030 con 0x56051b7bc880 2024-08-20T01:54:27.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.801+0000 7f9afcf7f740 10 client.28796 fetch_fsmap finished waiting for FSMap version 71 2024-08-20T01:54:27.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.801+0000 7f9afcf7f740 10 client.28796 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:54:27.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.801+0000 7f9afcf7f740 20 client.28796 populate_metadata read hostname 'smithi079' 2024-08-20T01:54:27.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.801+0000 7f9afcf7f740 1 --2- 172.21.15.79:0/760677991 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x56051b843af0 0x56051b845f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:27.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.801+0000 7f9afcf7f740 4 client.28796 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:54:27.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.801+0000 7f9afcf7f740 1 -- 172.21.15.79:0/760677991 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56051b731320 con 0x56051b843af0 2024-08-20T01:54:27.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.801+0000 7f9af3fff640 1 --2- 172.21.15.79:0/760677991 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x56051b843af0 0x56051b845f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:27.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.802+0000 7f9af3fff640 1 --2- 172.21.15.79:0/760677991 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x56051b843af0 0x56051b845f10 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e32628c3afe78e25 server_cookie=d82ab08c54b1977 in_seq=0 out_seq=0 2024-08-20T01:54:27.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.802+0000 7f9ad3fff640 10 client.28796 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:54:27.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.802+0000 7f9ad3fff640 1 -- 172.21.15.79:0/760677991 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56051b731320 con 0x56051b843af0 2024-08-20T01:54:27.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.802+0000 7f9ad3fff640 10 client.28796 handle_command_reply: tid=0 2024-08-20T01:54:27.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.802+0000 7f9afcf7f740 1 client.28796 shutdown 2024-08-20T01:54:27.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.802+0000 7f9afcf7f740 1 -- 172.21.15.79:0/760677991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56051b7bc880 msgr2=0x56051b7d1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:27.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.802+0000 7f9afcf7f740 1 --2- 172.21.15.79:0/760677991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56051b7bc880 0x56051b7d1070 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9ae800ba60 tx=0x7f9ae800beb0 comp rx=0 tx=0).stop 2024-08-20T01:54:27.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.802+0000 7f9afcf7f740 1 -- 172.21.15.79:0/760677991 shutdown_connections 2024-08-20T01:54:27.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.802+0000 7f9afcf7f740 1 --2- 172.21.15.79:0/760677991 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x56051b843af0 0x56051b845f10 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:27.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.802+0000 7f9afcf7f740 1 --2- 172.21.15.79:0/760677991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56051b7c9130 0x56051b7c2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:27.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.802+0000 7f9afcf7f740 1 --2- 172.21.15.79:0/760677991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56051b7bd1a0 0x56051b7d15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:27.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.802+0000 7f9ad3fff640 0 client.28796 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:54:27.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.802+0000 7f9afcf7f740 1 --2- 172.21.15.79:0/760677991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56051b7bc880 0x56051b7d1070 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:27.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.802+0000 7f9afcf7f740 1 -- 172.21.15.79:0/760677991 >> 172.21.15.79:0/760677991 conn(0x56051b7ba6b0 msgr2=0x56051b7c6080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:27.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.802+0000 7f9afcf7f740 1 -- 172.21.15.79:0/760677991 shutdown_connections 2024-08-20T01:54:27.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.802+0000 7f9afcf7f740 1 -- 172.21.15.79:0/760677991 wait complete. 2024-08-20T01:54:27.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.802+0000 7f9afcf7f740 20 client.28796 trim_cache size 0 max 16384 2024-08-20T01:54:27.812 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:54:27.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.803+0000 7f9afab86640 1 -- 172.21.15.79:0/2462560803 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9ae40b3bd0 msgr2=0x7f9ae40b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:27.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.803+0000 7f9afab86640 1 --2- 172.21.15.79:0/2462560803 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9ae40b3bd0 0x7f9ae40b6090 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0006010 tx=0x7f9ae0041040 comp rx=0 tx=0).stop 2024-08-20T01:54:27.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.803+0000 7f9afab86640 1 -- 172.21.15.79:0/2462560803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9af410cdc0 msgr2=0x7f9af4102110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:27.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.803+0000 7f9afab86640 1 --2- 172.21.15.79:0/2462560803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9af410cdc0 0x7f9af4102110 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f9aec00eaa0 tx=0x7f9aec00ef60 comp rx=0 tx=0).stop 2024-08-20T01:54:27.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.803+0000 7f9afab86640 1 -- 172.21.15.79:0/2462560803 shutdown_connections 2024-08-20T01:54:27.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.803+0000 7f9afab86640 1 --2- 172.21.15.79:0/2462560803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9af410cdc0 0x7f9af4102110 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:27.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.803+0000 7f9afab86640 1 --2- 172.21.15.79:0/2462560803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9af4104210 0x7f9af4101bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:27.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.803+0000 7f9afab86640 1 --2- 172.21.15.79:0/2462560803 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f9ae40b3bd0 0x7f9ae40b6090 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:27.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.803+0000 7f9afab86640 1 --2- 172.21.15.79:0/2462560803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9af4103810 0x7f9af4101690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:27.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.803+0000 7f9afab86640 1 -- 172.21.15.79:0/2462560803 >> 172.21.15.79:0/2462560803 conn(0x7f9af40fd400 msgr2=0x7f9af40fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:27.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.803+0000 7f9afab86640 1 -- 172.21.15.79:0/2462560803 shutdown_connections 2024-08-20T01:54:27.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:27.803+0000 7f9afab86640 1 -- 172.21.15.79:0/2462560803 wait complete. 2024-08-20T01:54:28.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:28 smithi175 ceph-mon[22392]: pgmap v861: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.4 KiB/s wr, 21 op/s 2024-08-20T01:54:28.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:28 smithi079 ceph-mon[18656]: pgmap v861: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.4 KiB/s wr, 21 op/s 2024-08-20T01:54:28.715 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T01:54:28.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:28 smithi081 ceph-mon[22209]: pgmap v861: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.4 KiB/s wr, 21 op/s 2024-08-20T01:54:28.973 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:54:29.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.454+0000 7f04d47f0640 1 -- 172.21.15.79:0/3509756903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04cc1074d0 msgr2=0x7f04cc10dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:29.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.454+0000 7f04d47f0640 1 --2- 172.21.15.79:0/3509756903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04cc1074d0 0x7f04cc10dcd0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f04c4009ca0 tx=0x7f04c402a8c0 comp rx=0 tx=0).stop 2024-08-20T01:54:29.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.454+0000 7f04d47f0640 1 -- 172.21.15.79:0/3509756903 shutdown_connections 2024-08-20T01:54:29.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.454+0000 7f04d47f0640 1 --2- 172.21.15.79:0/3509756903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04cc1074d0 0x7f04cc10dcd0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:29.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.454+0000 7f04d47f0640 1 --2- 172.21.15.79:0/3509756903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04cc106b50 0x7f04cc106f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:29.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.454+0000 7f04d47f0640 1 --2- 172.21.15.79:0/3509756903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04cc101520 0x7f04cc101900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:29.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.454+0000 7f04d47f0640 1 -- 172.21.15.79:0/3509756903 >> 172.21.15.79:0/3509756903 conn(0x7f04cc076cc0 msgr2=0x7f04cc0770d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:29.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.454+0000 7f04d47f0640 1 -- 172.21.15.79:0/3509756903 shutdown_connections 2024-08-20T01:54:29.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.454+0000 7f04d47f0640 1 -- 172.21.15.79:0/3509756903 wait complete. 2024-08-20T01:54:29.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.455+0000 7f04d47f0640 1 Processor -- start 2024-08-20T01:54:29.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.455+0000 7f04d47f0640 1 -- start start 2024-08-20T01:54:29.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.455+0000 7f04d47f0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04cc101520 0x7f04cc198f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:29.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.455+0000 7f04d47f0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04cc106b50 0x7f04cc199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:29.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.455+0000 7f04d47f0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04cc1074d0 0x7f04cc19e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:29.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.455+0000 7f04d47f0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f04cc112a00 con 0x7f04cc106b50 2024-08-20T01:54:29.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.455+0000 7f04d47f0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f04cc112880 con 0x7f04cc1074d0 2024-08-20T01:54:29.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.455+0000 7f04d47f0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f04cc112b80 con 0x7f04cc101520 2024-08-20T01:54:29.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.456+0000 7f04d258c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04cc101520 0x7f04cc198f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:29.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.456+0000 7f04d258c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04cc101520 0x7f04cc198f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:42762/0 (socket says 172.21.15.79:42762) 2024-08-20T01:54:29.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.456+0000 7f04d1d8b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04cc106b50 0x7f04cc199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:29.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.456+0000 7f04d258c640 1 -- 172.21.15.79:0/3210779461 learned_addr learned my addr 172.21.15.79:0/3210779461 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:29.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.456+0000 7f04d2d8d640 1 --2- 172.21.15.79:0/3210779461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04cc1074d0 0x7f04cc19e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:29.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.456+0000 7f04d258c640 1 -- 172.21.15.79:0/3210779461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04cc1074d0 msgr2=0x7f04cc19e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:29.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.456+0000 7f04d258c640 1 --2- 172.21.15.79:0/3210779461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04cc1074d0 0x7f04cc19e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:29.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.456+0000 7f04d258c640 1 -- 172.21.15.79:0/3210779461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04cc106b50 msgr2=0x7f04cc199470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:29.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.456+0000 7f04d258c640 1 --2- 172.21.15.79:0/3210779461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04cc106b50 0x7f04cc199470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:29.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.456+0000 7f04d258c640 1 -- 172.21.15.79:0/3210779461 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04cc19efe0 con 0x7f04cc101520 2024-08-20T01:54:29.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.456+0000 7f04d1d8b640 1 --2- 172.21.15.79:0/3210779461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04cc106b50 0x7f04cc199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:54:29.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.456+0000 7f04d258c640 1 --2- 172.21.15.79:0/3210779461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04cc101520 0x7f04cc198f30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f04bc00ea60 tx=0x7f04bc00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:29.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.456+0000 7f04c37fe640 1 -- 172.21.15.79:0/3210779461 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc00cde0 con 0x7f04cc101520 2024-08-20T01:54:29.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.456+0000 7f04d47f0640 1 -- 172.21.15.79:0/3210779461 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04cc19f2d0 con 0x7f04cc101520 2024-08-20T01:54:29.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.456+0000 7f04c37fe640 1 -- 172.21.15.79:0/3210779461 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f04bc0035f0 con 0x7f04cc101520 2024-08-20T01:54:29.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.456+0000 7f04c37fe640 1 -- 172.21.15.79:0/3210779461 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc010690 con 0x7f04cc101520 2024-08-20T01:54:29.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.456+0000 7f04d47f0640 1 -- 172.21.15.79:0/3210779461 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04cc1a5990 con 0x7f04cc101520 2024-08-20T01:54:29.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.459+0000 7f04c37fe640 1 -- 172.21.15.79:0/3210779461 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f04bc004000 con 0x7f04cc101520 2024-08-20T01:54:29.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.459+0000 7f04d6be9740 1 Processor -- start 2024-08-20T01:54:29.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.459+0000 7f04d6be9740 1 -- start start 2024-08-20T01:54:29.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.459+0000 7f04d6be9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619142a5730 0x5619142a5b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:29.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.459+0000 7f04d6be9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619142a6050 0x5619142b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:29.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.459+0000 7f04d6be9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619142b1fe0 0x5619142b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:29.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.459+0000 7f04d6be9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56191421c930 con 0x5619142a6050 2024-08-20T01:54:29.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.459+0000 7f04d6be9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56191420be30 con 0x5619142a5730 2024-08-20T01:54:29.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.459+0000 7f04d6be9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56191420fe70 con 0x5619142b1fe0 2024-08-20T01:54:29.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.459+0000 7f04d258c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619142a6050 0x5619142b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:29.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.459+0000 7f04d1d8b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619142b1fe0 0x5619142b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:29.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.459+0000 7f04d258c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619142a6050 0x5619142b1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54110/0 (socket says 172.21.15.79:54110) 2024-08-20T01:54:29.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.459+0000 7f04d258c640 1 -- 172.21.15.79:0/3309987595 learned_addr learned my addr 172.21.15.79:0/3309987595 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:29.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.459+0000 7f04d1d8b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619142b1fe0 0x5619142b43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:42770/0 (socket says 172.21.15.79:42770) 2024-08-20T01:54:29.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.459+0000 7f04d2d8d640 1 --2- 172.21.15.79:0/3309987595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619142a5730 0x5619142a5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:29.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.460+0000 7f04d1d8b640 1 -- 172.21.15.79:0/3309987595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619142a5730 msgr2=0x5619142a5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:29.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.460+0000 7f04d1d8b640 1 --2- 172.21.15.79:0/3309987595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619142a5730 0x5619142a5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:29.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.460+0000 7f04d1d8b640 1 -- 172.21.15.79:0/3309987595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619142a6050 msgr2=0x5619142b1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:29.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.460+0000 7f04d1d8b640 1 --2- 172.21.15.79:0/3309987595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619142a6050 0x5619142b1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:29.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.460+0000 7f04d1d8b640 1 -- 172.21.15.79:0/3309987595 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561913f6b650 con 0x5619142b1fe0 2024-08-20T01:54:29.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.460+0000 7f04d258c640 1 --2- 172.21.15.79:0/3309987595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619142a6050 0x5619142b1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:54:29.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.460+0000 7f04c37fe640 1 --2- 172.21.15.79:0/3210779461 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f04b80b3bd0 0x7f04b80b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:29.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.460+0000 7f04d2d8d640 1 --2- 172.21.15.79:0/3210779461 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f04b80b3bd0 0x7f04b80b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:29.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.460+0000 7f04d1d8b640 1 --2- 172.21.15.79:0/3309987595 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619142b1fe0 0x5619142b43d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f04c8009f50 tx=0x7f04c80118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c132c21151fe2293 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:29.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.460+0000 7f04c37fe640 1 -- 172.21.15.79:0/3210779461 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f04bc0e3f70 con 0x7f04cc101520 2024-08-20T01:54:29.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.460+0000 7f04c0ff9640 1 -- 172.21.15.79:0/3309987595 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c8004030 con 0x5619142b1fe0 2024-08-20T01:54:29.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.460+0000 7f04c0ff9640 1 -- 172.21.15.79:0/3309987595 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f04c8005020 con 0x5619142b1fe0 2024-08-20T01:54:29.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.460+0000 7f04c0ff9640 1 -- 172.21.15.79:0/3309987595 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c8004b20 con 0x5619142b1fe0 2024-08-20T01:54:29.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.461+0000 7f04d6be9740 1 -- 172.21.15.79:0/3309987595 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619142b1fe0 msgr2=0x5619142b43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:29.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.461+0000 7f04d2d8d640 1 --2- 172.21.15.79:0/3210779461 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f04b80b3bd0 0x7f04b80b6090 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f04c4004af0 tx=0x7f04c4005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:29.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.461+0000 7f04d6be9740 1 --2- 172.21.15.79:0/3309987595 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619142b1fe0 0x5619142b43d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f04c8009f50 tx=0x7f04c80118d0 comp rx=0 tx=0).stop 2024-08-20T01:54:29.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.461+0000 7f04d6be9740 1 -- 172.21.15.79:0/3309987595 shutdown_connections 2024-08-20T01:54:29.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.461+0000 7f04d6be9740 1 --2- 172.21.15.79:0/3309987595 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619142b1fe0 0x5619142b43d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:29.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.461+0000 7f04d6be9740 1 --2- 172.21.15.79:0/3309987595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619142a6050 0x5619142b1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:29.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.461+0000 7f04d6be9740 1 --2- 172.21.15.79:0/3309987595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619142a5730 0x5619142a5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:29.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.461+0000 7f04d6be9740 1 -- 172.21.15.79:0/3309987595 >> 172.21.15.79:0/3309987595 conn(0x5619142a3560 msgr2=0x5619142a4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:29.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.461+0000 7f04d6be9740 1 -- 172.21.15.79:0/3309987595 shutdown_connections 2024-08-20T01:54:29.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.461+0000 7f04d6be9740 1 -- 172.21.15.79:0/3309987595 wait complete. 2024-08-20T01:54:29.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.461+0000 7f04d6be9740 1 -- start start 2024-08-20T01:54:29.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.461+0000 7f04d6be9740 1 Processor -- start 2024-08-20T01:54:29.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.462+0000 7f04d6be9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619142a5730 0x5619142b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:29.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.462+0000 7f04d6be9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619142a6050 0x5619142aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:29.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.462+0000 7f04d6be9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619142b1fe0 0x5619142af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:29.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.462+0000 7f04d6be9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56191406e700 con 0x5619142a5730 2024-08-20T01:54:29.506 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:54:29.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.462+0000 7f04d6be9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561914192810 con 0x5619142a6050 2024-08-20T01:54:29.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.462+0000 7f04d6be9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5619142b4c90 con 0x5619142b1fe0 2024-08-20T01:54:29.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.462+0000 7f04d6be9740 10 client.0 _ll_register_callbacks cb 0x561914205700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:54:29.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.462+0000 7f04d258c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619142a5730 0x5619142b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:29.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.462+0000 7f04d258c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619142a5730 0x5619142b1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54122/0 (socket says 172.21.15.79:54122) 2024-08-20T01:54:29.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.462+0000 7f04d258c640 1 -- 172.21.15.79:0/1699015077 learned_addr learned my addr 172.21.15.79:0/1699015077 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:29.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.462+0000 7f04d1d8b640 1 --2- 172.21.15.79:0/1699015077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619142a6050 0x5619142aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:29.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.462+0000 7f04d2d8d640 1 --2- 172.21.15.79:0/1699015077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619142b1fe0 0x5619142af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:29.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.462+0000 7f04d258c640 1 -- 172.21.15.79:0/1699015077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619142b1fe0 msgr2=0x5619142af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:29.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.462+0000 7f04d258c640 1 --2- 172.21.15.79:0/1699015077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619142b1fe0 0x5619142af6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:29.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.462+0000 7f04d258c640 1 -- 172.21.15.79:0/1699015077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619142a6050 msgr2=0x5619142aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:29.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.462+0000 7f04d258c640 1 --2- 172.21.15.79:0/1699015077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619142a6050 0x5619142aef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:29.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.462+0000 7f04d258c640 1 -- 172.21.15.79:0/1699015077 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619142bdfc0 con 0x5619142a5730 2024-08-20T01:54:29.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.462+0000 7f04d1d8b640 1 --2- 172.21.15.79:0/1699015077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619142a6050 0x5619142aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:54:29.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.462+0000 7f04d258c640 1 --2- 172.21.15.79:0/1699015077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619142a5730 0x5619142b1aa0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f04bc0e1ad0 tx=0x7f04bc009490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f7338904d410fa7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:29.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.462+0000 7f04b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:54:29.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.462+0000 7f04b5ffb640 1 -- 172.21.15.79:0/1699015077 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc0aa820 con 0x5619142a5730 2024-08-20T01:54:29.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.462+0000 7f04b5ffb640 1 -- 172.21.15.79:0/1699015077 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f04bc003ac0 con 0x5619142a5730 2024-08-20T01:54:29.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.462+0000 7f04d6be9740 1 -- 172.21.15.79:0/1699015077 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5619141bb150 con 0x5619142a5730 2024-08-20T01:54:29.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.463+0000 7f04b5ffb640 1 -- 172.21.15.79:0/1699015077 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f04bc0042f0 con 0x5619142a5730 2024-08-20T01:54:29.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.463+0000 7f04d6be9740 10 client.19722 fetch_fsmap learned FSMap version 71 2024-08-20T01:54:29.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.463+0000 7f04d6be9740 1 -- 172.21.15.79:0/1699015077 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x5619142c0970 con 0x5619142a5730 2024-08-20T01:54:29.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.463+0000 7f04b5ffb640 1 -- 172.21.15.79:0/1699015077 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5619141bb150 con 0x5619142a5730 2024-08-20T01:54:29.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.463+0000 7f04b5ffb640 1 -- 172.21.15.79:0/1699015077 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 71) ==== 8374+0+0 (secure 0 0 0) 0x7f04bc0af050 con 0x5619142a5730 2024-08-20T01:54:29.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.463+0000 7f04d6be9740 10 client.19722 fetch_fsmap finished waiting for FSMap version 71 2024-08-20T01:54:29.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.463+0000 7f04d6be9740 10 client.19722 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:54:29.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.463+0000 7f04d6be9740 20 client.19722 populate_metadata read hostname 'smithi079' 2024-08-20T01:54:29.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.463+0000 7f04d6be9740 1 --2- 172.21.15.79:0/1699015077 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x5619142c1e30 0x5619142c4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:29.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.463+0000 7f04d6be9740 4 client.19722 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:54:29.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.463+0000 7f04d6be9740 1 -- 172.21.15.79:0/1699015077 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56191421e880 con 0x5619142c1e30 2024-08-20T01:54:29.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.463+0000 7f04d1d8b640 1 --2- 172.21.15.79:0/1699015077 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x5619142c1e30 0x5619142c4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:29.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.464+0000 7f04b5ffb640 10 client.19722 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:54:29.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.464+0000 7f04d1d8b640 1 --2- 172.21.15.79:0/1699015077 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x5619142c1e30 0x5619142c4240 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7bfd03de5023586 server_cookie=c7e006e76a4dd2ee in_seq=0 out_seq=0 2024-08-20T01:54:29.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.464+0000 7f04b5ffb640 1 -- 172.21.15.79:0/1699015077 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56191421e880 con 0x5619142c1e30 2024-08-20T01:54:29.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.464+0000 7f04b5ffb640 10 client.19722 handle_command_reply: tid=0 2024-08-20T01:54:29.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.464+0000 7f04d6be9740 1 client.19722 shutdown 2024-08-20T01:54:29.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.465+0000 7f04d6be9740 1 -- 172.21.15.79:0/1699015077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619142a5730 msgr2=0x5619142b1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:29.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.465+0000 7f04d6be9740 1 --2- 172.21.15.79:0/1699015077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619142a5730 0x5619142b1aa0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f04bc0e1ad0 tx=0x7f04bc009490 comp rx=0 tx=0).stop 2024-08-20T01:54:29.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.465+0000 7f04d6be9740 1 -- 172.21.15.79:0/1699015077 shutdown_connections 2024-08-20T01:54:29.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.465+0000 7f04d6be9740 1 --2- 172.21.15.79:0/1699015077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619142b1fe0 0x5619142af6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:29.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.465+0000 7f04d6be9740 1 --2- 172.21.15.79:0/1699015077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619142a6050 0x5619142aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:29.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.465+0000 7f04d6be9740 1 --2- 172.21.15.79:0/1699015077 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x5619142c1e30 0x5619142c4240 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:29.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.465+0000 7f04d6be9740 1 --2- 172.21.15.79:0/1699015077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619142a5730 0x5619142b1aa0 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:29.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.465+0000 7f04b5ffb640 0 client.19722 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:54:29.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.465+0000 7f04d6be9740 1 -- 172.21.15.79:0/1699015077 >> 172.21.15.79:0/1699015077 conn(0x5619142a3560 msgr2=0x5619142a9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:29.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.465+0000 7f04d6be9740 1 -- 172.21.15.79:0/1699015077 shutdown_connections 2024-08-20T01:54:29.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.465+0000 7f04d6be9740 1 -- 172.21.15.79:0/1699015077 wait complete. 2024-08-20T01:54:29.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.465+0000 7f04d6be9740 20 client.19722 trim_cache size 0 max 16384 2024-08-20T01:54:29.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.478+0000 7f04d6be9740 1 Processor -- start 2024-08-20T01:54:29.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.478+0000 7f04d6be9740 1 -- start start 2024-08-20T01:54:29.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.478+0000 7f04d6be9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619142a5730 0x5619142a2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:29.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.478+0000 7f04d6be9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619142a6050 0x5619142be230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:29.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.478+0000 7f04d6be9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619142b1fe0 0x5619142a45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:29.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.478+0000 7f04d6be9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f04cc1ae0b0 con 0x5619142a6050 2024-08-20T01:54:29.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.478+0000 7f04d6be9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f04cc1afc20 con 0x5619142b1fe0 2024-08-20T01:54:29.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.478+0000 7f04d6be9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f04cc1ae7b0 con 0x5619142a5730 2024-08-20T01:54:29.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.478+0000 7f04d1d8b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619142a6050 0x5619142be230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:29.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.478+0000 7f04d258c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619142a5730 0x5619142a2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:29.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.478+0000 7f04d2d8d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619142b1fe0 0x5619142a45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:29.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.478+0000 7f04d1d8b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619142a6050 0x5619142be230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54128/0 (socket says 172.21.15.79:54128) 2024-08-20T01:54:29.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.478+0000 7f04d1d8b640 1 -- 172.21.15.79:0/2490208186 learned_addr learned my addr 172.21.15.79:0/2490208186 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:29.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.478+0000 7f04d258c640 1 -- 172.21.15.79:0/2490208186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619142b1fe0 msgr2=0x5619142a45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:29.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.478+0000 7f04d258c640 1 --2- 172.21.15.79:0/2490208186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619142b1fe0 0x5619142a45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:29.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.478+0000 7f04d258c640 1 -- 172.21.15.79:0/2490208186 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619142a6050 msgr2=0x5619142be230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:29.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.478+0000 7f04d258c640 1 --2- 172.21.15.79:0/2490208186 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619142a6050 0x5619142be230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:29.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.478+0000 7f04d258c640 1 -- 172.21.15.79:0/2490208186 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619142afa30 con 0x5619142a5730 2024-08-20T01:54:29.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.479+0000 7f04d2d8d640 1 --2- 172.21.15.79:0/2490208186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619142b1fe0 0x5619142a45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:54:29.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.479+0000 7f04d258c640 1 --2- 172.21.15.79:0/2490208186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619142a5730 0x5619142a2f20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f04bc0e1df0 tx=0x7f04bc003a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb7db2de84e163eb server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:29.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.479+0000 7f04b7fff640 1 -- 172.21.15.79:0/2490208186 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc0aa640 con 0x5619142a5730 2024-08-20T01:54:29.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.479+0000 7f04b7fff640 1 -- 172.21.15.79:0/2490208186 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f04bc0aa9e0 con 0x5619142a5730 2024-08-20T01:54:29.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.479+0000 7f04b7fff640 1 -- 172.21.15.79:0/2490208186 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc0ab5d0 con 0x5619142a5730 2024-08-20T01:54:29.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.480+0000 7f04d6be9740 1 -- 172.21.15.79:0/2490208186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619142a5730 msgr2=0x5619142a2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:29.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.480+0000 7f04d6be9740 1 --2- 172.21.15.79:0/2490208186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619142a5730 0x5619142a2f20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f04bc0e1df0 tx=0x7f04bc003a30 comp rx=0 tx=0).stop 2024-08-20T01:54:29.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.480+0000 7f04d6be9740 1 -- 172.21.15.79:0/2490208186 shutdown_connections 2024-08-20T01:54:29.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.480+0000 7f04d6be9740 1 --2- 172.21.15.79:0/2490208186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619142b1fe0 0x5619142a45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:29.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.480+0000 7f04d6be9740 1 --2- 172.21.15.79:0/2490208186 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619142a6050 0x5619142be230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:29.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.480+0000 7f04d6be9740 1 --2- 172.21.15.79:0/2490208186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619142a5730 0x5619142a2f20 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:29.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.480+0000 7f04d6be9740 1 -- 172.21.15.79:0/2490208186 >> 172.21.15.79:0/2490208186 conn(0x5619142a3560 msgr2=0x5619142ad770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:29.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.480+0000 7f04d6be9740 1 -- 172.21.15.79:0/2490208186 shutdown_connections 2024-08-20T01:54:29.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.480+0000 7f04d6be9740 1 -- 172.21.15.79:0/2490208186 wait complete. 2024-08-20T01:54:29.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.480+0000 7f04d6be9740 1 -- start start 2024-08-20T01:54:29.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.480+0000 7f04d6be9740 1 Processor -- start 2024-08-20T01:54:29.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.480+0000 7f04d6be9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619142a5730 0x5619142ba670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:29.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.480+0000 7f04d6be9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619142a6050 0x5619142b9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:29.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.480+0000 7f04d6be9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619142b1fe0 0x5619142b97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:29.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.480+0000 7f04d6be9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f04cc1af550 con 0x5619142a5730 2024-08-20T01:54:29.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.480+0000 7f04d6be9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f04cc1aee80 con 0x5619142b1fe0 2024-08-20T01:54:29.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.480+0000 7f04d6be9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f04cc1ac090 con 0x5619142a6050 2024-08-20T01:54:29.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.480+0000 7f04d6be9740 10 client.0 _ll_register_callbacks cb 0x7f04bc00e9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:54:29.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.480+0000 7f04d258c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619142a5730 0x5619142ba670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:29.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.481+0000 7f04d258c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619142a5730 0x5619142ba670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54138/0 (socket says 172.21.15.79:54138) 2024-08-20T01:54:29.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.481+0000 7f04d258c640 1 -- 172.21.15.79:0/2966017233 learned_addr learned my addr 172.21.15.79:0/2966017233 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:29.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.481+0000 7f04d2d8d640 1 --2- 172.21.15.79:0/2966017233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619142b1fe0 0x5619142b97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:29.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.481+0000 7f04d1d8b640 1 --2- 172.21.15.79:0/2966017233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619142a6050 0x5619142b9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:29.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.481+0000 7f04d258c640 1 -- 172.21.15.79:0/2966017233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619142a6050 msgr2=0x5619142b9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:29.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.481+0000 7f04d258c640 1 --2- 172.21.15.79:0/2966017233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619142a6050 0x5619142b9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:29.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.481+0000 7f04d258c640 1 -- 172.21.15.79:0/2966017233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619142b1fe0 msgr2=0x5619142b97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:29.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.481+0000 7f04d258c640 1 --2- 172.21.15.79:0/2966017233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619142b1fe0 0x5619142b97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:29.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.481+0000 7f04d258c640 1 -- 172.21.15.79:0/2966017233 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619142af2a0 con 0x5619142a5730 2024-08-20T01:54:29.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.481+0000 7f04d258c640 1 --2- 172.21.15.79:0/2966017233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619142a5730 0x5619142ba670 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f04bc0af640 tx=0x7f04bc0e7510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cf2e0fca758ecab server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:29.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.481+0000 7f04b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:54:29.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.481+0000 7f04b5ffb640 1 -- 172.21.15.79:0/2966017233 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc0aa640 con 0x5619142a5730 2024-08-20T01:54:29.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.481+0000 7f04b5ffb640 1 -- 172.21.15.79:0/2966017233 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f04bc0aa340 con 0x5619142a5730 2024-08-20T01:54:29.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.481+0000 7f04d6be9740 1 -- 172.21.15.79:0/2966017233 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04bc0aa9e0 con 0x5619142a5730 2024-08-20T01:54:29.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.481+0000 7f04b5ffb640 1 -- 172.21.15.79:0/2966017233 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f04bc0a7250 con 0x5619142a5730 2024-08-20T01:54:29.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.481+0000 7f04d6be9740 10 client.19728 fetch_fsmap learned FSMap version 71 2024-08-20T01:54:29.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.481+0000 7f04d6be9740 1 -- 172.21.15.79:0/2966017233 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x56191432ba10 con 0x5619142a5730 2024-08-20T01:54:29.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.481+0000 7f04b5ffb640 1 -- 172.21.15.79:0/2966017233 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f04bc0aa9e0 con 0x5619142a5730 2024-08-20T01:54:29.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.482+0000 7f04b5ffb640 1 -- 172.21.15.79:0/2966017233 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 71) ==== 8374+0+0 (secure 0 0 0) 0x7f04bc0af040 con 0x5619142a5730 2024-08-20T01:54:29.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.482+0000 7f04d6be9740 10 client.19728 fetch_fsmap finished waiting for FSMap version 71 2024-08-20T01:54:29.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.482+0000 7f04d6be9740 10 client.19728 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:54:29.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.482+0000 7f04d6be9740 20 client.19728 populate_metadata read hostname 'smithi079' 2024-08-20T01:54:29.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.482+0000 7f04d6be9740 1 --2- 172.21.15.79:0/2966017233 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x56191432bee0 0x56191432e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:29.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.482+0000 7f04d6be9740 4 client.19728 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:54:29.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.482+0000 7f04d6be9740 1 -- 172.21.15.79:0/2966017233 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56191421a320 con 0x56191432bee0 2024-08-20T01:54:29.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.482+0000 7f04d1d8b640 1 --2- 172.21.15.79:0/2966017233 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x56191432bee0 0x56191432e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:29.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.482+0000 7f04b5ffb640 10 client.19728 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:54:29.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.482+0000 7f04d1d8b640 1 --2- 172.21.15.79:0/2966017233 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x56191432bee0 0x56191432e2d0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d0bade6575d5a06f server_cookie=6ba319d993617c06 in_seq=0 out_seq=0 2024-08-20T01:54:29.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.482+0000 7f04b5ffb640 1 -- 172.21.15.79:0/2966017233 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56191421a320 con 0x56191432bee0 2024-08-20T01:54:29.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.482+0000 7f04b5ffb640 10 client.19728 handle_command_reply: tid=0 2024-08-20T01:54:29.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.482+0000 7f04d6be9740 1 client.19728 shutdown 2024-08-20T01:54:29.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.482+0000 7f04d6be9740 1 -- 172.21.15.79:0/2966017233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619142a5730 msgr2=0x5619142ba670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:29.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.482+0000 7f04d6be9740 1 --2- 172.21.15.79:0/2966017233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619142a5730 0x5619142ba670 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f04bc0af640 tx=0x7f04bc0e7510 comp rx=0 tx=0).stop 2024-08-20T01:54:29.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.482+0000 7f04d6be9740 1 -- 172.21.15.79:0/2966017233 shutdown_connections 2024-08-20T01:54:29.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.482+0000 7f04d6be9740 1 --2- 172.21.15.79:0/2966017233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619142b1fe0 0x5619142b97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:29.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.482+0000 7f04d6be9740 1 --2- 172.21.15.79:0/2966017233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619142a6050 0x5619142b9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:29.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.482+0000 7f04d6be9740 1 --2- 172.21.15.79:0/2966017233 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x56191432bee0 0x56191432e2d0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:29.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.482+0000 7f04d6be9740 1 --2- 172.21.15.79:0/2966017233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5619142a5730 0x5619142ba670 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:29.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.482+0000 7f04d6be9740 1 -- 172.21.15.79:0/2966017233 >> 172.21.15.79:0/2966017233 conn(0x5619142a3560 msgr2=0x5619142a1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:29.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.482+0000 7f04b5ffb640 0 client.19728 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:54:29.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.483+0000 7f04d6be9740 1 -- 172.21.15.79:0/2966017233 shutdown_connections 2024-08-20T01:54:29.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.483+0000 7f04d6be9740 1 -- 172.21.15.79:0/2966017233 wait complete. 2024-08-20T01:54:29.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.483+0000 7f04d6be9740 20 client.19728 trim_cache size 0 max 16384 2024-08-20T01:54:29.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.483+0000 7f04d47f0640 1 -- 172.21.15.79:0/3210779461 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f04b80b3bd0 msgr2=0x7f04b80b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:29.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.483+0000 7f04d47f0640 1 --2- 172.21.15.79:0/3210779461 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f04b80b3bd0 0x7f04b80b6090 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f04c4004af0 tx=0x7f04c4005d80 comp rx=0 tx=0).stop 2024-08-20T01:54:29.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.483+0000 7f04d47f0640 1 -- 172.21.15.79:0/3210779461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04cc101520 msgr2=0x7f04cc198f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:29.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.483+0000 7f04d47f0640 1 --2- 172.21.15.79:0/3210779461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04cc101520 0x7f04cc198f30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f04bc00ea60 tx=0x7f04bc00ef20 comp rx=0 tx=0).stop 2024-08-20T01:54:29.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.483+0000 7f04d47f0640 1 -- 172.21.15.79:0/3210779461 shutdown_connections 2024-08-20T01:54:29.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.483+0000 7f04d47f0640 1 --2- 172.21.15.79:0/3210779461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04cc1074d0 0x7f04cc19e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:29.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.483+0000 7f04d47f0640 1 --2- 172.21.15.79:0/3210779461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04cc106b50 0x7f04cc199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:29.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.483+0000 7f04d47f0640 1 --2- 172.21.15.79:0/3210779461 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f04b80b3bd0 0x7f04b80b6090 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:29.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.483+0000 7f04d47f0640 1 --2- 172.21.15.79:0/3210779461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04cc101520 0x7f04cc198f30 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:29.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.483+0000 7f04d47f0640 1 -- 172.21.15.79:0/3210779461 >> 172.21.15.79:0/3210779461 conn(0x7f04cc076cc0 msgr2=0x7f04cc0ff310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:29.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.483+0000 7f04d47f0640 1 -- 172.21.15.79:0/3210779461 shutdown_connections 2024-08-20T01:54:29.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:29.483+0000 7f04d47f0640 1 -- 172.21.15.79:0/3210779461 wait complete. 2024-08-20T01:54:30.190 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T01:54:30.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:30 smithi079 ceph-mon[18656]: pgmap v862: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.3 KiB/s wr, 20 op/s 2024-08-20T01:54:30.445 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:54:30.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:30 smithi175 ceph-mon[22392]: pgmap v862: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.3 KiB/s wr, 20 op/s 2024-08-20T01:54:30.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:30 smithi081 ceph-mon[22209]: pgmap v862: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.3 KiB/s wr, 20 op/s 2024-08-20T01:54:30.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.913+0000 7f7565dc5640 1 -- 172.21.15.79:0/2475662914 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75601073c0 msgr2=0x7f7560107800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:30.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.913+0000 7f7565dc5640 1 --2- 172.21.15.79:0/2475662914 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75601073c0 0x7f7560107800 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f7554009900 tx=0x7f755402a410 comp rx=0 tx=0).stop 2024-08-20T01:54:30.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.914+0000 7f7565dc5640 1 -- 172.21.15.79:0/2475662914 shutdown_connections 2024-08-20T01:54:30.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.914+0000 7f7565dc5640 1 --2- 172.21.15.79:0/2475662914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7560107d40 0x7f756010e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:30.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.914+0000 7f7565dc5640 1 --2- 172.21.15.79:0/2475662914 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75601073c0 0x7f7560107800 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:30.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.914+0000 7f7565dc5640 1 --2- 172.21.15.79:0/2475662914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75601019b0 0x7f7560101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:30.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.914+0000 7f7565dc5640 1 -- 172.21.15.79:0/2475662914 >> 172.21.15.79:0/2475662914 conn(0x7f75600fd400 msgr2=0x7f75600ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:30.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.914+0000 7f7565dc5640 1 -- 172.21.15.79:0/2475662914 shutdown_connections 2024-08-20T01:54:30.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.914+0000 7f7565dc5640 1 -- 172.21.15.79:0/2475662914 wait complete. 2024-08-20T01:54:30.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.914+0000 7f7565dc5640 1 Processor -- start 2024-08-20T01:54:30.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.914+0000 7f7565dc5640 1 -- start start 2024-08-20T01:54:30.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.915+0000 7f7565dc5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75601019b0 0x7f756010f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:30.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.915+0000 7f7565dc5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75601073c0 0x7f756010f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:30.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.915+0000 7f7565dc5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7560107d40 0x7f756010fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:30.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.915+0000 7f7565dc5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f75601129d0 con 0x7f7560107d40 2024-08-20T01:54:30.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.915+0000 7f7565dc5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7560112850 con 0x7f75601019b0 2024-08-20T01:54:30.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.915+0000 7f7565dc5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7560112b50 con 0x7f75601073c0 2024-08-20T01:54:30.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.915+0000 7f755ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7560107d40 0x7f756010fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:30.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.915+0000 7f755ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7560107d40 0x7f756010fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49452/0 (socket says 172.21.15.79:49452) 2024-08-20T01:54:30.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.915+0000 7f755ffff640 1 -- 172.21.15.79:0/3143985032 learned_addr learned my addr 172.21.15.79:0/3143985032 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:30.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.915+0000 7f755f7fe640 1 --2- 172.21.15.79:0/3143985032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75601019b0 0x7f756010f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:30.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.915+0000 7f755effd640 1 --2- 172.21.15.79:0/3143985032 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75601073c0 0x7f756010f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:30.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.915+0000 7f755ffff640 1 -- 172.21.15.79:0/3143985032 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75601073c0 msgr2=0x7f756010f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:30.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.915+0000 7f755ffff640 1 --2- 172.21.15.79:0/3143985032 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75601073c0 0x7f756010f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:30.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.915+0000 7f755ffff640 1 -- 172.21.15.79:0/3143985032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75601019b0 msgr2=0x7f756010f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:30.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.915+0000 7f755ffff640 1 --2- 172.21.15.79:0/3143985032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75601019b0 0x7f756010f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:30.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.915+0000 7f755ffff640 1 -- 172.21.15.79:0/3143985032 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75601a72e0 con 0x7f7560107d40 2024-08-20T01:54:30.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.915+0000 7f755f7fe640 1 --2- 172.21.15.79:0/3143985032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75601019b0 0x7f756010f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:54:30.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.915+0000 7f755ffff640 1 --2- 172.21.15.79:0/3143985032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7560107d40 0x7f756010fad0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f755800eb10 tx=0x7f755800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:30.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.916+0000 7f755cff9640 1 -- 172.21.15.79:0/3143985032 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7558004b20 con 0x7f7560107d40 2024-08-20T01:54:30.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.916+0000 7f755cff9640 1 -- 172.21.15.79:0/3143985032 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7558004cc0 con 0x7f7560107d40 2024-08-20T01:54:30.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.916+0000 7f7565dc5640 1 -- 172.21.15.79:0/3143985032 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75601a75d0 con 0x7f7560107d40 2024-08-20T01:54:30.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.916+0000 7f755cff9640 1 -- 172.21.15.79:0/3143985032 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7558010690 con 0x7f7560107d40 2024-08-20T01:54:30.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.916+0000 7f7565dc5640 1 -- 172.21.15.79:0/3143985032 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75601a7a90 con 0x7f7560107d40 2024-08-20T01:54:30.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.918+0000 7f755cff9640 1 -- 172.21.15.79:0/3143985032 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f7558005020 con 0x7f7560107d40 2024-08-20T01:54:30.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.918+0000 7f75681be740 1 Processor -- start 2024-08-20T01:54:30.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.918+0000 7f75681be740 1 -- start start 2024-08-20T01:54:30.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.918+0000 7f75681be740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f44c287880 0x55f44c287c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:30.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.918+0000 7f75681be740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f44c2881a0 0x55f44c293bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:30.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.918+0000 7f75681be740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f44c294130 0x55f44c296520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:30.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.919+0000 7f75681be740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f44c1fe930 con 0x55f44c294130 2024-08-20T01:54:30.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.919+0000 7f75681be740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f44c1ede30 con 0x55f44c287880 2024-08-20T01:54:30.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.919+0000 7f75681be740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f44c1f1e70 con 0x55f44c2881a0 2024-08-20T01:54:30.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.919+0000 7f755effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f44c294130 0x55f44c296520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:30.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.919+0000 7f755effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f44c294130 0x55f44c296520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49468/0 (socket says 172.21.15.79:49468) 2024-08-20T01:54:30.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.919+0000 7f755effd640 1 -- 172.21.15.79:0/1572176698 learned_addr learned my addr 172.21.15.79:0/1572176698 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:30.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.919+0000 7f755effd640 1 --2- 172.21.15.79:0/1572176698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f44c287880 0x55f44c287c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:30.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.919+0000 7f755f7fe640 1 --2- 172.21.15.79:0/1572176698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f44c2881a0 0x55f44c293bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:30.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.919+0000 7f755effd640 1 -- 172.21.15.79:0/1572176698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f44c2881a0 msgr2=0x55f44c293bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:30.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.919+0000 7f755effd640 1 --2- 172.21.15.79:0/1572176698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f44c2881a0 0x55f44c293bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:30.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.919+0000 7f755effd640 1 -- 172.21.15.79:0/1572176698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f44c287880 msgr2=0x55f44c287c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:30.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.919+0000 7f755effd640 1 --2- 172.21.15.79:0/1572176698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f44c287880 0x55f44c287c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:30.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.919+0000 7f755effd640 1 -- 172.21.15.79:0/1572176698 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f44bf4d650 con 0x55f44c294130 2024-08-20T01:54:30.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.919+0000 7f755cff9640 1 --2- 172.21.15.79:0/3143985032 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f75480b3bd0 0x7f75480b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:30.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.919+0000 7f755effd640 1 --2- 172.21.15.79:0/1572176698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f44c294130 0x55f44c296520 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f7554033000 tx=0x7f755402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e2a8930dc821889 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:30.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.919+0000 7f755f7fe640 1 --2- 172.21.15.79:0/3143985032 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f75480b3bd0 0x7f75480b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:30.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.919+0000 7f755cff9640 1 -- 172.21.15.79:0/3143985032 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f75580e41a0 con 0x7f7560107d40 2024-08-20T01:54:30.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.920+0000 7f7545ffb640 1 -- 172.21.15.79:0/1572176698 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7554035040 con 0x55f44c294130 2024-08-20T01:54:30.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.920+0000 7f7545ffb640 1 -- 172.21.15.79:0/1572176698 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7554004030 con 0x55f44c294130 2024-08-20T01:54:30.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.920+0000 7f7545ffb640 1 -- 172.21.15.79:0/1572176698 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7554003850 con 0x55f44c294130 2024-08-20T01:54:30.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.920+0000 7f75681be740 1 -- 172.21.15.79:0/1572176698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f44c294130 msgr2=0x55f44c296520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:30.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.920+0000 7f75681be740 1 --2- 172.21.15.79:0/1572176698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f44c294130 0x55f44c296520 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f7554033000 tx=0x7f755402a410 comp rx=0 tx=0).stop 2024-08-20T01:54:30.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.920+0000 7f755f7fe640 1 --2- 172.21.15.79:0/3143985032 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f75480b3bd0 0x7f75480b6090 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x55f44c28aa00 tx=0x7f755000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:30.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.920+0000 7f75681be740 1 -- 172.21.15.79:0/1572176698 shutdown_connections 2024-08-20T01:54:30.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.920+0000 7f75681be740 1 --2- 172.21.15.79:0/1572176698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f44c294130 0x55f44c296520 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:30.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.920+0000 7f75681be740 1 --2- 172.21.15.79:0/1572176698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f44c2881a0 0x55f44c293bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:30.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.920+0000 7f75681be740 1 --2- 172.21.15.79:0/1572176698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f44c287880 0x55f44c287c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:30.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.920+0000 7f75681be740 1 -- 172.21.15.79:0/1572176698 >> 172.21.15.79:0/1572176698 conn(0x55f44c2856b0 msgr2=0x55f44c286850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:30.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.920+0000 7f75681be740 1 -- 172.21.15.79:0/1572176698 shutdown_connections 2024-08-20T01:54:30.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.920+0000 7f75681be740 1 -- 172.21.15.79:0/1572176698 wait complete. 2024-08-20T01:54:30.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.921+0000 7f75681be740 1 -- start start 2024-08-20T01:54:30.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.921+0000 7f75681be740 1 Processor -- start 2024-08-20T01:54:30.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.921+0000 7f75681be740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f44c287880 0x55f44c291180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:30.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.921+0000 7f75681be740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f44c2881a0 0x55f44c2916c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:30.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.921+0000 7f75681be740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f44c294130 0x55f44c291c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:30.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.921+0000 7f75681be740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f44c050700 con 0x55f44c2881a0 2024-08-20T01:54:30.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.921+0000 7f75681be740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f44c174810 con 0x55f44c294130 2024-08-20T01:54:30.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.921+0000 7f75681be740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f44c296d80 con 0x55f44c287880 2024-08-20T01:54:30.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.921+0000 7f75681be740 10 client.0 _ll_register_callbacks cb 0x55f44c1e7700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:54:30.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.921+0000 7f755f7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f44c287880 0x55f44c291180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:30.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.921+0000 7f755effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f44c2881a0 0x55f44c2916c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:30.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.921+0000 7f755f7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f44c287880 0x55f44c291180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:46724/0 (socket says 172.21.15.79:46724) 2024-08-20T01:54:30.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.921+0000 7f755f7fe640 1 -- 172.21.15.79:0/4141643005 learned_addr learned my addr 172.21.15.79:0/4141643005 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:30.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.922+0000 7f755ffff640 1 --2- 172.21.15.79:0/4141643005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f44c294130 0x55f44c291c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:30.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.922+0000 7f755effd640 1 -- 172.21.15.79:0/4141643005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f44c287880 msgr2=0x55f44c291180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:30.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.922+0000 7f755effd640 1 --2- 172.21.15.79:0/4141643005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f44c287880 0x55f44c291180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:30.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.922+0000 7f755effd640 1 -- 172.21.15.79:0/4141643005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f44c294130 msgr2=0x55f44c291c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:30.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.922+0000 7f755effd640 1 --2- 172.21.15.79:0/4141643005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f44c294130 0x55f44c291c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:30.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.922+0000 7f755effd640 1 -- 172.21.15.79:0/4141643005 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f44c2a01e0 con 0x55f44c2881a0 2024-08-20T01:54:30.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.922+0000 7f755effd640 1 --2- 172.21.15.79:0/4141643005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f44c2881a0 0x55f44c2916c0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f7554004620 tx=0x7f75540316e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e6dd0fffdb3d80d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:30.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.922+0000 7f753effd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:54:30.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.922+0000 7f753effd640 1 -- 172.21.15.79:0/4141643005 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755404e070 con 0x55f44c2881a0 2024-08-20T01:54:30.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.922+0000 7f753effd640 1 -- 172.21.15.79:0/4141643005 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f755403d860 con 0x55f44c2881a0 2024-08-20T01:54:30.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.922+0000 7f75681be740 1 -- 172.21.15.79:0/4141643005 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f44c19d150 con 0x55f44c2881a0 2024-08-20T01:54:30.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.922+0000 7f753effd640 1 -- 172.21.15.79:0/4141643005 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f755405a050 con 0x55f44c2881a0 2024-08-20T01:54:30.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.922+0000 7f75681be740 10 client.19740 fetch_fsmap learned FSMap version 71 2024-08-20T01:54:30.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.922+0000 7f75681be740 1 -- 172.21.15.79:0/4141643005 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55f44c2a2b90 con 0x55f44c2881a0 2024-08-20T01:54:30.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.923+0000 7f753effd640 1 -- 172.21.15.79:0/4141643005 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55f44c19d150 con 0x55f44c2881a0 2024-08-20T01:54:30.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.923+0000 7f753effd640 1 -- 172.21.15.79:0/4141643005 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 71) ==== 8374+0+0 (secure 0 0 0) 0x7f75540537d0 con 0x55f44c2881a0 2024-08-20T01:54:30.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.923+0000 7f75681be740 10 client.19740 fetch_fsmap finished waiting for FSMap version 71 2024-08-20T01:54:30.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.923+0000 7f75681be740 10 client.19740 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:54:30.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.923+0000 7f75681be740 20 client.19740 populate_metadata read hostname 'smithi079' 2024-08-20T01:54:30.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.923+0000 7f75681be740 1 --2- 172.21.15.79:0/4141643005 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55f44c2a3ee0 0x55f44c2a62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:30.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.923+0000 7f75681be740 4 client.19740 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:54:30.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.923+0000 7f75681be740 1 -- 172.21.15.79:0/4141643005 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f44c200880 con 0x55f44c2a3ee0 2024-08-20T01:54:30.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.923+0000 7f755f7fe640 1 --2- 172.21.15.79:0/4141643005 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55f44c2a3ee0 0x55f44c2a62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:30.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.923+0000 7f753effd640 10 client.19740 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:54:30.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.923+0000 7f755f7fe640 1 --2- 172.21.15.79:0/4141643005 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55f44c2a3ee0 0x55f44c2a62d0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c00e57f4db2adfaa server_cookie=8e9f09a81bec2066 in_seq=0 out_seq=0 2024-08-20T01:54:30.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.924+0000 7f753effd640 1 -- 172.21.15.79:0/4141643005 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f44c200880 con 0x55f44c2a3ee0 2024-08-20T01:54:30.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.924+0000 7f753effd640 10 client.19740 handle_command_reply: tid=0 2024-08-20T01:54:30.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.924+0000 7f75681be740 1 client.19740 shutdown 2024-08-20T01:54:30.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.924+0000 7f75681be740 1 -- 172.21.15.79:0/4141643005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f44c2881a0 msgr2=0x55f44c2916c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:30.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.924+0000 7f75681be740 1 --2- 172.21.15.79:0/4141643005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f44c2881a0 0x55f44c2916c0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f7554004620 tx=0x7f75540316e0 comp rx=0 tx=0).stop 2024-08-20T01:54:30.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.925+0000 7f75681be740 1 -- 172.21.15.79:0/4141643005 shutdown_connections 2024-08-20T01:54:30.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.925+0000 7f75681be740 1 --2- 172.21.15.79:0/4141643005 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55f44c2a3ee0 0x55f44c2a62d0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:30.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.925+0000 7f75681be740 1 --2- 172.21.15.79:0/4141643005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f44c294130 0x55f44c291c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:30.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.925+0000 7f75681be740 1 --2- 172.21.15.79:0/4141643005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f44c2881a0 0x55f44c2916c0 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:30.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.925+0000 7f75681be740 1 --2- 172.21.15.79:0/4141643005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f44c287880 0x55f44c291180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:30.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.925+0000 7f75681be740 1 -- 172.21.15.79:0/4141643005 >> 172.21.15.79:0/4141643005 conn(0x55f44c2856b0 msgr2=0x55f44c28b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:30.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.925+0000 7f753effd640 0 client.19740 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:54:30.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.925+0000 7f75681be740 1 -- 172.21.15.79:0/4141643005 shutdown_connections 2024-08-20T01:54:30.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.925+0000 7f75681be740 1 -- 172.21.15.79:0/4141643005 wait complete. 2024-08-20T01:54:30.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.925+0000 7f75681be740 20 client.19740 trim_cache size 0 max 16384 2024-08-20T01:54:30.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.937+0000 7f75681be740 1 Processor -- start 2024-08-20T01:54:30.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.938+0000 7f75681be740 1 -- start start 2024-08-20T01:54:30.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.938+0000 7f75681be740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f44c287880 0x55f44c28e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:30.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.938+0000 7f75681be740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f44c2881a0 0x55f44c28e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:30.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.938+0000 7f75681be740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f44c294130 0x55f44c28aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:30.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.938+0000 7f75681be740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f75601b0130 con 0x55f44c2881a0 2024-08-20T01:54:30.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.938+0000 7f75681be740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f75601b1ca0 con 0x55f44c287880 2024-08-20T01:54:30.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.938+0000 7f75681be740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f75601b0830 con 0x55f44c294130 2024-08-20T01:54:30.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.938+0000 7f755effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f44c2881a0 0x55f44c28e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:30.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.938+0000 7f755effd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f44c2881a0 0x55f44c28e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49490/0 (socket says 172.21.15.79:49490) 2024-08-20T01:54:30.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.938+0000 7f755effd640 1 -- 172.21.15.79:0/1964780435 learned_addr learned my addr 172.21.15.79:0/1964780435 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:30.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.938+0000 7f755ffff640 1 --2- 172.21.15.79:0/1964780435 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f44c294130 0x55f44c28aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:30.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.938+0000 7f755f7fe640 1 --2- 172.21.15.79:0/1964780435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f44c287880 0x55f44c28e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:30.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.938+0000 7f755effd640 1 -- 172.21.15.79:0/1964780435 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f44c294130 msgr2=0x55f44c28aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:30.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.938+0000 7f755effd640 1 --2- 172.21.15.79:0/1964780435 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f44c294130 0x55f44c28aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:30.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.938+0000 7f755effd640 1 -- 172.21.15.79:0/1964780435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f44c287880 msgr2=0x55f44c28e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:30.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.938+0000 7f755effd640 1 --2- 172.21.15.79:0/1964780435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f44c287880 0x55f44c28e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:30.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.938+0000 7f755effd640 1 -- 172.21.15.79:0/1964780435 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f44c286130 con 0x55f44c2881a0 2024-08-20T01:54:30.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.938+0000 7f755ffff640 1 --2- 172.21.15.79:0/1964780435 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f44c294130 0x55f44c28aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:54:30.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.938+0000 7f755effd640 1 --2- 172.21.15.79:0/1964780435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f44c2881a0 0x55f44c28e8d0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f7554004650 tx=0x7f7554031420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dfd463d462826b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:30.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.938+0000 7f75457fa640 1 -- 172.21.15.79:0/1964780435 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755404e040 con 0x55f44c2881a0 2024-08-20T01:54:30.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.939+0000 7f75457fa640 1 -- 172.21.15.79:0/1964780435 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7554031750 con 0x55f44c2881a0 2024-08-20T01:54:30.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.939+0000 7f75457fa640 1 -- 172.21.15.79:0/1964780435 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7554035070 con 0x55f44c2881a0 2024-08-20T01:54:30.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.939+0000 7f75681be740 1 -- 172.21.15.79:0/1964780435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f44c2881a0 msgr2=0x55f44c28e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:30.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.939+0000 7f75681be740 1 --2- 172.21.15.79:0/1964780435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f44c2881a0 0x55f44c28e8d0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f7554004650 tx=0x7f7554031420 comp rx=0 tx=0).stop 2024-08-20T01:54:30.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.939+0000 7f75681be740 1 -- 172.21.15.79:0/1964780435 shutdown_connections 2024-08-20T01:54:30.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.939+0000 7f75681be740 1 --2- 172.21.15.79:0/1964780435 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f44c294130 0x55f44c28aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:30.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.939+0000 7f75681be740 1 --2- 172.21.15.79:0/1964780435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f44c2881a0 0x55f44c28e8d0 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:30.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.939+0000 7f75681be740 1 --2- 172.21.15.79:0/1964780435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f44c287880 0x55f44c28e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:30.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.939+0000 7f75681be740 1 -- 172.21.15.79:0/1964780435 >> 172.21.15.79:0/1964780435 conn(0x55f44c2856b0 msgr2=0x55f44c29f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:30.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.939+0000 7f75681be740 1 -- 172.21.15.79:0/1964780435 shutdown_connections 2024-08-20T01:54:30.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.939+0000 7f75681be740 1 -- 172.21.15.79:0/1964780435 wait complete. 2024-08-20T01:54:30.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.939+0000 7f75681be740 1 -- start start 2024-08-20T01:54:30.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.940+0000 7f75681be740 1 Processor -- start 2024-08-20T01:54:30.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.940+0000 7f75681be740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f44c287880 0x55f44c2a8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:30.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.940+0000 7f75681be740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f44c2881a0 0x55f44c2a8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:30.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.940+0000 7f75681be740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f44c294130 0x55f44c30c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:30.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.940+0000 7f75681be740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f75601b15d0 con 0x55f44c287880 2024-08-20T01:54:30.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.940+0000 7f75681be740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f75601b0f00 con 0x55f44c2881a0 2024-08-20T01:54:30.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.940+0000 7f75681be740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f75601ae110 con 0x55f44c294130 2024-08-20T01:54:30.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.940+0000 7f755f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f44c287880 0x55f44c2a8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:30.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.940+0000 7f755f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f44c287880 0x55f44c2a8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49494/0 (socket says 172.21.15.79:49494) 2024-08-20T01:54:30.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.940+0000 7f755f7fe640 1 -- 172.21.15.79:0/2880710351 learned_addr learned my addr 172.21.15.79:0/2880710351 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:30.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.940+0000 7f75681be740 10 client.0 _ll_register_callbacks cb 0x7f7554032c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:54:30.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.940+0000 7f755effd640 1 --2- 172.21.15.79:0/2880710351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f44c2881a0 0x55f44c2a8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:30.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.940+0000 7f755ffff640 1 --2- 172.21.15.79:0/2880710351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f44c294130 0x55f44c30c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:30.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.940+0000 7f755f7fe640 1 -- 172.21.15.79:0/2880710351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f44c294130 msgr2=0x55f44c30c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:30.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.940+0000 7f755f7fe640 1 --2- 172.21.15.79:0/2880710351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f44c294130 0x55f44c30c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:30.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.940+0000 7f755f7fe640 1 -- 172.21.15.79:0/2880710351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f44c2881a0 msgr2=0x55f44c2a8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:30.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.940+0000 7f755f7fe640 1 --2- 172.21.15.79:0/2880710351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f44c2881a0 0x55f44c2a8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:30.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.940+0000 7f755f7fe640 1 -- 172.21.15.79:0/2880710351 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f44c2865a0 con 0x55f44c287880 2024-08-20T01:54:30.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.941+0000 7f755f7fe640 1 --2- 172.21.15.79:0/2880710351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f44c287880 0x55f44c2a8140 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f7550003f40 tx=0x7f75500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6059e1b1d87cca2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:30.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.941+0000 7f753effd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:54:30.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.941+0000 7f753effd640 1 -- 172.21.15.79:0/2880710351 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755002f070 con 0x55f44c287880 2024-08-20T01:54:30.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.941+0000 7f753effd640 1 -- 172.21.15.79:0/2880710351 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f755001ed60 con 0x55f44c287880 2024-08-20T01:54:30.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.941+0000 7f75681be740 1 -- 172.21.15.79:0/2880710351 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7554031750 con 0x55f44c287880 2024-08-20T01:54:30.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.941+0000 7f753effd640 1 -- 172.21.15.79:0/2880710351 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f755003b050 con 0x55f44c287880 2024-08-20T01:54:30.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.941+0000 7f75681be740 10 client.19746 fetch_fsmap learned FSMap version 71 2024-08-20T01:54:30.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.941+0000 7f75681be740 1 -- 172.21.15.79:0/2880710351 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55f44c30dce0 con 0x55f44c287880 2024-08-20T01:54:30.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.941+0000 7f753effd640 1 -- 172.21.15.79:0/2880710351 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7554031750 con 0x55f44c287880 2024-08-20T01:54:30.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.941+0000 7f753effd640 1 -- 172.21.15.79:0/2880710351 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 71) ==== 8374+0+0 (secure 0 0 0) 0x7f755001d610 con 0x55f44c287880 2024-08-20T01:54:30.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.941+0000 7f75681be740 10 client.19746 fetch_fsmap finished waiting for FSMap version 71 2024-08-20T01:54:30.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.941+0000 7f75681be740 10 client.19746 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:54:30.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.941+0000 7f75681be740 20 client.19746 populate_metadata read hostname 'smithi079' 2024-08-20T01:54:30.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.942+0000 7f75681be740 1 --2- 172.21.15.79:0/2880710351 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55f44c30e470 0x55f44c310890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:30.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.942+0000 7f75681be740 4 client.19746 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:54:30.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.942+0000 7f75681be740 1 -- 172.21.15.79:0/2880710351 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f44c1fc320 con 0x55f44c30e470 2024-08-20T01:54:30.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.942+0000 7f755effd640 1 --2- 172.21.15.79:0/2880710351 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55f44c30e470 0x55f44c310890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:30.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.942+0000 7f755effd640 1 --2- 172.21.15.79:0/2880710351 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55f44c30e470 0x55f44c310890 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a695b427c27901fb server_cookie=e4aadb9107c2679b in_seq=0 out_seq=0 2024-08-20T01:54:30.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.942+0000 7f753effd640 10 client.19746 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:54:30.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.942+0000 7f753effd640 1 -- 172.21.15.79:0/2880710351 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f44c1fc320 con 0x55f44c30e470 2024-08-20T01:54:30.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.942+0000 7f753effd640 10 client.19746 handle_command_reply: tid=0 2024-08-20T01:54:30.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.942+0000 7f75681be740 1 client.19746 shutdown 2024-08-20T01:54:30.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.942+0000 7f75681be740 1 -- 172.21.15.79:0/2880710351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f44c287880 msgr2=0x55f44c2a8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:30.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.942+0000 7f75681be740 1 --2- 172.21.15.79:0/2880710351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f44c287880 0x55f44c2a8140 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f7550003f40 tx=0x7f75500046c0 comp rx=0 tx=0).stop 2024-08-20T01:54:30.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.942+0000 7f75681be740 1 -- 172.21.15.79:0/2880710351 shutdown_connections 2024-08-20T01:54:30.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.942+0000 7f75681be740 1 --2- 172.21.15.79:0/2880710351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f44c294130 0x55f44c30c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:30.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.942+0000 7f75681be740 1 --2- 172.21.15.79:0/2880710351 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55f44c30e470 0x55f44c310890 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:30.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.943+0000 7f75681be740 1 --2- 172.21.15.79:0/2880710351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f44c2881a0 0x55f44c2a8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:30.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.943+0000 7f753effd640 0 client.19746 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:54:30.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.943+0000 7f75681be740 1 --2- 172.21.15.79:0/2880710351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f44c287880 0x55f44c2a8140 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:30.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.943+0000 7f75681be740 1 -- 172.21.15.79:0/2880710351 >> 172.21.15.79:0/2880710351 conn(0x55f44c2856b0 msgr2=0x55f44c28aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:30.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.943+0000 7f75681be740 1 -- 172.21.15.79:0/2880710351 shutdown_connections 2024-08-20T01:54:30.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.943+0000 7f75681be740 1 -- 172.21.15.79:0/2880710351 wait complete. 2024-08-20T01:54:30.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.943+0000 7f75681be740 20 client.19746 trim_cache size 0 max 16384 2024-08-20T01:54:30.950 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:54:30.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.943+0000 7f7565dc5640 1 -- 172.21.15.79:0/3143985032 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f75480b3bd0 msgr2=0x7f75480b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:30.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.943+0000 7f7565dc5640 1 --2- 172.21.15.79:0/3143985032 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f75480b3bd0 0x7f75480b6090 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x55f44c28aa00 tx=0x7f755000b390 comp rx=0 tx=0).stop 2024-08-20T01:54:30.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.943+0000 7f7565dc5640 1 -- 172.21.15.79:0/3143985032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7560107d40 msgr2=0x7f756010fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:30.951 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.943+0000 7f7565dc5640 1 --2- 172.21.15.79:0/3143985032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7560107d40 0x7f756010fad0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f755800eb10 tx=0x7f755800c2d0 comp rx=0 tx=0).stop 2024-08-20T01:54:30.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.943+0000 7f7565dc5640 1 -- 172.21.15.79:0/3143985032 shutdown_connections 2024-08-20T01:54:30.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.943+0000 7f7565dc5640 1 --2- 172.21.15.79:0/3143985032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7560107d40 0x7f756010fad0 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:30.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.943+0000 7f7565dc5640 1 --2- 172.21.15.79:0/3143985032 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f75480b3bd0 0x7f75480b6090 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:30.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.943+0000 7f7565dc5640 1 --2- 172.21.15.79:0/3143985032 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75601073c0 0x7f756010f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:30.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.943+0000 7f7565dc5640 1 --2- 172.21.15.79:0/3143985032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75601019b0 0x7f756010f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:30.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.943+0000 7f7565dc5640 1 -- 172.21.15.79:0/3143985032 >> 172.21.15.79:0/3143985032 conn(0x7f75600fd400 msgr2=0x7f75600ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:30.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.944+0000 7f7565dc5640 1 -- 172.21.15.79:0/3143985032 shutdown_connections 2024-08-20T01:54:30.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:30.944+0000 7f7565dc5640 1 -- 172.21.15.79:0/3143985032 wait complete. 2024-08-20T01:54:31.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.520+0000 7f4b4151d640 1 -- 172.21.15.79:0/2126262595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b3c103070 msgr2=0x7f4b3c1099f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:31.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.520+0000 7f4b4151d640 1 --2- 172.21.15.79:0/2126262595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b3c103070 0x7f4b3c1099f0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f4b34009cd0 tx=0x7f4b3402a8e0 comp rx=0 tx=0).stop 2024-08-20T01:54:31.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.520+0000 7f4b4151d640 1 -- 172.21.15.79:0/2126262595 shutdown_connections 2024-08-20T01:54:31.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.520+0000 7f4b4151d640 1 --2- 172.21.15.79:0/2126262595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b3c103070 0x7f4b3c1099f0 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:31.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.520+0000 7f4b4151d640 1 --2- 172.21.15.79:0/2126262595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b3c1026b0 0x7f4b3c102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:31.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.520+0000 7f4b4151d640 1 --2- 172.21.15.79:0/2126262595 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b3c101560 0x7f4b3c101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:31.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.520+0000 7f4b4151d640 1 -- 172.21.15.79:0/2126262595 >> 172.21.15.79:0/2126262595 conn(0x7f4b3c0fce40 msgr2=0x7f4b3c0ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:31.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.520+0000 7f4b4151d640 1 -- 172.21.15.79:0/2126262595 shutdown_connections 2024-08-20T01:54:31.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.520+0000 7f4b4151d640 1 -- 172.21.15.79:0/2126262595 wait complete. 2024-08-20T01:54:31.524 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.520+0000 7f4b4151d640 1 Processor -- start 2024-08-20T01:54:31.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.521+0000 7f4b4151d640 1 -- start start 2024-08-20T01:54:31.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.521+0000 7f4b4151d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b3c101560 0x7f4b3c06ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:31.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.521+0000 7f4b4151d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b3c1026b0 0x7f4b3c19d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:31.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.521+0000 7f4b4151d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b3c103070 0x7f4b3c19fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:31.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.521+0000 7f4b4151d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c10d080 con 0x7f4b3c103070 2024-08-20T01:54:31.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.521+0000 7f4b4151d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c10cf00 con 0x7f4b3c101560 2024-08-20T01:54:31.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.521+0000 7f4b4151d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c10d200 con 0x7f4b3c1026b0 2024-08-20T01:54:31.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.521+0000 7f4b3b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b3c103070 0x7f4b3c19fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:31.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.521+0000 7f4b3b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b3c103070 0x7f4b3c19fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49504/0 (socket says 172.21.15.79:49504) 2024-08-20T01:54:31.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.521+0000 7f4b3b7fe640 1 -- 172.21.15.79:0/1310328445 learned_addr learned my addr 172.21.15.79:0/1310328445 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:31.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.521+0000 7f4b3affd640 1 --2- 172.21.15.79:0/1310328445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b3c101560 0x7f4b3c06ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:31.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.521+0000 7f4b33fff640 1 --2- 172.21.15.79:0/1310328445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b3c1026b0 0x7f4b3c19d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:31.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.521+0000 7f4b3b7fe640 1 -- 172.21.15.79:0/1310328445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b3c1026b0 msgr2=0x7f4b3c19d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:31.525 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.521+0000 7f4b3b7fe640 1 --2- 172.21.15.79:0/1310328445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b3c1026b0 0x7f4b3c19d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:31.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.521+0000 7f4b3b7fe640 1 -- 172.21.15.79:0/1310328445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b3c101560 msgr2=0x7f4b3c06ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:31.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.521+0000 7f4b3b7fe640 1 --2- 172.21.15.79:0/1310328445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b3c101560 0x7f4b3c06ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:31.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.521+0000 7f4b3b7fe640 1 -- 172.21.15.79:0/1310328445 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b3c1a04f0 con 0x7f4b3c103070 2024-08-20T01:54:31.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.521+0000 7f4b33fff640 1 --2- 172.21.15.79:0/1310328445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b3c1026b0 0x7f4b3c19d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:54:31.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.521+0000 7f4b3b7fe640 1 --2- 172.21.15.79:0/1310328445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b3c103070 0x7f4b3c19fc30 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f4b340097b0 tx=0x7f4b34003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:31.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.521+0000 7f4b38ff9640 1 -- 172.21.15.79:0/1310328445 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b34004240 con 0x7f4b3c103070 2024-08-20T01:54:31.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.522+0000 7f4b38ff9640 1 -- 172.21.15.79:0/1310328445 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b34003e20 con 0x7f4b3c103070 2024-08-20T01:54:31.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.522+0000 7f4b38ff9640 1 -- 172.21.15.79:0/1310328445 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b3403b400 con 0x7f4b3c103070 2024-08-20T01:54:31.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.522+0000 7f4b4151d640 1 -- 172.21.15.79:0/1310328445 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b3c1a0780 con 0x7f4b3c103070 2024-08-20T01:54:31.526 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.522+0000 7f4b4151d640 1 -- 172.21.15.79:0/1310328445 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b3c1a0cd0 con 0x7f4b3c103070 2024-08-20T01:54:31.532 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.524+0000 7f4b38ff9640 1 -- 172.21.15.79:0/1310328445 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f4b34030630 con 0x7f4b3c103070 2024-08-20T01:54:31.532 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.524+0000 7f4b443e4740 1 Processor -- start 2024-08-20T01:54:31.533 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.524+0000 7f4b443e4740 1 -- start start 2024-08-20T01:54:31.533 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.525+0000 7f4b443e4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56152de64a40 0x56152de66e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:31.533 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.525+0000 7f4b443e4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152de67370 0x56152de69760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:31.533 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.525+0000 7f4b443e4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56152de69db0 0x56152de6c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:31.533 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.525+0000 7f4b443e4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56152ddd3360 con 0x56152de69db0 2024-08-20T01:54:31.533 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.525+0000 7f4b443e4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56152ddc2860 con 0x56152de67370 2024-08-20T01:54:31.533 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.525+0000 7f4b443e4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56152ddc68a0 con 0x56152de64a40 2024-08-20T01:54:31.533 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.525+0000 7f4b33fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56152de69db0 0x56152de6c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:31.533 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.525+0000 7f4b3affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152de67370 0x56152de69760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:31.533 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.525+0000 7f4b33fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56152de69db0 0x56152de6c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49520/0 (socket says 172.21.15.79:49520) 2024-08-20T01:54:31.533 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.525+0000 7f4b33fff640 1 -- 172.21.15.79:0/1552672906 learned_addr learned my addr 172.21.15.79:0/1552672906 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:31.533 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.525+0000 7f4b33fff640 1 --2- 172.21.15.79:0/1552672906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56152de64a40 0x56152de66e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.525+0000 7f4b33fff640 1 -- 172.21.15.79:0/1552672906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56152de64a40 msgr2=0x56152de66e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.525+0000 7f4b33fff640 1 --2- 172.21.15.79:0/1552672906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56152de64a40 0x56152de66e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.525+0000 7f4b33fff640 1 -- 172.21.15.79:0/1552672906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152de67370 msgr2=0x56152de69760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.525+0000 7f4b33fff640 1 --2- 172.21.15.79:0/1552672906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152de67370 0x56152de69760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.525+0000 7f4b33fff640 1 -- 172.21.15.79:0/1552672906 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56152dd69e40 con 0x56152de69db0 2024-08-20T01:54:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.525+0000 7f4b3affd640 1 --2- 172.21.15.79:0/1552672906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152de67370 0x56152de69760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:54:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.525+0000 7f4b38ff9640 1 --2- 172.21.15.79:0/1310328445 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4b280b3bd0 0x7f4b280b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.525+0000 7f4b33fff640 1 --2- 172.21.15.79:0/1552672906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56152de69db0 0x56152de6c270 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f4b24011c40 tx=0x7f4b24009bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f5c180d30ffae6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.525+0000 7f4b3affd640 1 --2- 172.21.15.79:0/1310328445 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4b280b3bd0 0x7f4b280b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.525+0000 7f4b38ff9640 1 -- 172.21.15.79:0/1310328445 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f4b3402e030 con 0x7f4b3c103070 2024-08-20T01:54:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.525+0000 7f4b317fa640 1 -- 172.21.15.79:0/1552672906 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2400fc50 con 0x56152de69db0 2024-08-20T01:54:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.526+0000 7f4b317fa640 1 -- 172.21.15.79:0/1552672906 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b2400fdf0 con 0x56152de69db0 2024-08-20T01:54:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.526+0000 7f4b317fa640 1 -- 172.21.15.79:0/1552672906 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2400e610 con 0x56152de69db0 2024-08-20T01:54:31.535 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.526+0000 7f4b443e4740 1 -- 172.21.15.79:0/1552672906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56152de69db0 msgr2=0x56152de6c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:31.535 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.526+0000 7f4b3affd640 1 --2- 172.21.15.79:0/1310328445 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f4b280b3bd0 0x7f4b280b6090 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c009f70 tx=0x7f4b2c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:31.535 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.526+0000 7f4b443e4740 1 --2- 172.21.15.79:0/1552672906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56152de69db0 0x56152de6c270 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f4b24011c40 tx=0x7f4b24009bc0 comp rx=0 tx=0).stop 2024-08-20T01:54:31.535 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.527+0000 7f4b443e4740 1 -- 172.21.15.79:0/1552672906 shutdown_connections 2024-08-20T01:54:31.535 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.527+0000 7f4b443e4740 1 --2- 172.21.15.79:0/1552672906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56152de69db0 0x56152de6c270 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:31.535 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.527+0000 7f4b443e4740 1 --2- 172.21.15.79:0/1552672906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152de67370 0x56152de69760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:31.535 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.527+0000 7f4b443e4740 1 --2- 172.21.15.79:0/1552672906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56152de64a40 0x56152de66e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:31.535 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.527+0000 7f4b443e4740 1 -- 172.21.15.79:0/1552672906 >> 172.21.15.79:0/1552672906 conn(0x56152de5b730 msgr2=0x56152de5c510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:31.535 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.527+0000 7f4b443e4740 1 -- 172.21.15.79:0/1552672906 shutdown_connections 2024-08-20T01:54:31.535 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.527+0000 7f4b443e4740 1 -- 172.21.15.79:0/1552672906 wait complete. 2024-08-20T01:54:31.535 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.527+0000 7f4b443e4740 1 -- start start 2024-08-20T01:54:31.535 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.527+0000 7f4b443e4740 1 Processor -- start 2024-08-20T01:54:31.535 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.527+0000 7f4b443e4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152de64a40 0x56152de6e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.527+0000 7f4b443e4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56152de67370 0x56152de6e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.527+0000 7f4b443e4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56152de69db0 0x56152de6f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.527+0000 7f4b443e4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56152dcfbab0 con 0x56152de69db0 2024-08-20T01:54:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.527+0000 7f4b443e4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56152dd49780 con 0x56152de64a40 2024-08-20T01:54:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.527+0000 7f4b443e4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56152de6cd90 con 0x56152de67370 2024-08-20T01:54:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.527+0000 7f4b443e4740 10 client.0 _ll_register_callbacks cb 0x56152dad1a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:54:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.527+0000 7f4b3b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56152de69db0 0x56152de6f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.527+0000 7f4b3b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56152de69db0 0x56152de6f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49532/0 (socket says 172.21.15.79:49532) 2024-08-20T01:54:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.527+0000 7f4b3b7fe640 1 -- 172.21.15.79:0/2292543397 learned_addr learned my addr 172.21.15.79:0/2292543397 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.527+0000 7f4b33fff640 1 --2- 172.21.15.79:0/2292543397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56152de67370 0x56152de6e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.527+0000 7f4b3affd640 1 --2- 172.21.15.79:0/2292543397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152de64a40 0x56152de6e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.528+0000 7f4b3b7fe640 1 -- 172.21.15.79:0/2292543397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56152de67370 msgr2=0x56152de6e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.528+0000 7f4b3b7fe640 1 --2- 172.21.15.79:0/2292543397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56152de67370 0x56152de6e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.528+0000 7f4b3b7fe640 1 -- 172.21.15.79:0/2292543397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152de64a40 msgr2=0x56152de6e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.528+0000 7f4b3b7fe640 1 --2- 172.21.15.79:0/2292543397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152de64a40 0x56152de6e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.528+0000 7f4b3b7fe640 1 -- 172.21.15.79:0/2292543397 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56152db25790 con 0x56152de69db0 2024-08-20T01:54:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.528+0000 7f4b3affd640 1 --2- 172.21.15.79:0/2292543397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152de64a40 0x56152de6e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:54:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.528+0000 7f4b3b7fe640 1 --2- 172.21.15.79:0/2292543397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56152de69db0 0x56152de6f540 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f4b340cb900 tx=0x7f4b340cba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d666f99eab87053 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.528+0000 7f4b227fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:54:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.528+0000 7f4b227fc640 1 -- 172.21.15.79:0/2292543397 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b340cc300 con 0x56152de69db0 2024-08-20T01:54:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.528+0000 7f4b227fc640 1 -- 172.21.15.79:0/2292543397 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f4b340b3320 con 0x56152de69db0 2024-08-20T01:54:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.528+0000 7f4b443e4740 1 -- 172.21.15.79:0/2292543397 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56152dd71e00 con 0x56152de69db0 2024-08-20T01:54:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.528+0000 7f4b227fc640 1 -- 172.21.15.79:0/2292543397 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f4b340cbc00 con 0x56152de69db0 2024-08-20T01:54:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.528+0000 7f4b443e4740 10 client.19758 fetch_fsmap learned FSMap version 71 2024-08-20T01:54:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.528+0000 7f4b443e4740 1 -- 172.21.15.79:0/2292543397 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x56152db9e620 con 0x56152de69db0 2024-08-20T01:54:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.528+0000 7f4b227fc640 1 -- 172.21.15.79:0/2292543397 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56152dd71e00 con 0x56152de69db0 2024-08-20T01:54:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.528+0000 7f4b227fc640 1 -- 172.21.15.79:0/2292543397 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 71) ==== 8374+0+0 (secure 0 0 0) 0x7f4b340e3060 con 0x56152de69db0 2024-08-20T01:54:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.528+0000 7f4b443e4740 10 client.19758 fetch_fsmap finished waiting for FSMap version 71 2024-08-20T01:54:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.528+0000 7f4b443e4740 10 client.19758 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:54:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.528+0000 7f4b443e4740 20 client.19758 populate_metadata read hostname 'smithi079' 2024-08-20T01:54:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.528+0000 7f4b443e4740 1 --2- 172.21.15.79:0/2292543397 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56152de79b00 0x56152de7bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.528+0000 7f4b443e4740 4 client.19758 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:54:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.528+0000 7f4b443e4740 1 -- 172.21.15.79:0/2292543397 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56152ddd52b0 con 0x56152de79b00 2024-08-20T01:54:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.529+0000 7f4b3affd640 1 --2- 172.21.15.79:0/2292543397 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56152de79b00 0x56152de7bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.529+0000 7f4b3affd640 1 --2- 172.21.15.79:0/2292543397 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56152de79b00 0x56152de7bf70 crc :-1 s=READY pgs=344 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b19f7e8775dcad0e server_cookie=671d2fedbdf8152a in_seq=0 out_seq=0 2024-08-20T01:54:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.529+0000 7f4b227fc640 10 client.19758 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:54:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.530+0000 7f4b227fc640 1 -- 172.21.15.79:0/2292543397 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56152ddd52b0 con 0x56152de79b00 2024-08-20T01:54:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.530+0000 7f4b227fc640 10 client.19758 handle_command_reply: tid=0 2024-08-20T01:54:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.530+0000 7f4b443e4740 1 client.19758 shutdown 2024-08-20T01:54:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.530+0000 7f4b443e4740 1 -- 172.21.15.79:0/2292543397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56152de69db0 msgr2=0x56152de6f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.530+0000 7f4b443e4740 1 --2- 172.21.15.79:0/2292543397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56152de69db0 0x56152de6f540 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f4b340cb900 tx=0x7f4b340cba90 comp rx=0 tx=0).stop 2024-08-20T01:54:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.530+0000 7f4b443e4740 1 -- 172.21.15.79:0/2292543397 shutdown_connections 2024-08-20T01:54:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.530+0000 7f4b443e4740 1 --2- 172.21.15.79:0/2292543397 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56152de79b00 0x56152de7bf70 crc :-1 s=READY pgs=344 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.530+0000 7f4b443e4740 1 --2- 172.21.15.79:0/2292543397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56152de69db0 0x56152de6f540 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.530+0000 7f4b227fc640 0 client.19758 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:54:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.530+0000 7f4b443e4740 1 --2- 172.21.15.79:0/2292543397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56152de67370 0x56152de6e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.530+0000 7f4b443e4740 1 --2- 172.21.15.79:0/2292543397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152de64a40 0x56152de6e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.530+0000 7f4b443e4740 1 -- 172.21.15.79:0/2292543397 >> 172.21.15.79:0/2292543397 conn(0x56152de5b730 msgr2=0x56152de5a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.530+0000 7f4b443e4740 1 -- 172.21.15.79:0/2292543397 shutdown_connections 2024-08-20T01:54:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.530+0000 7f4b443e4740 1 -- 172.21.15.79:0/2292543397 wait complete. 2024-08-20T01:54:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.530+0000 7f4b443e4740 20 client.19758 trim_cache size 0 max 16384 2024-08-20T01:54:31.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.544+0000 7f4b443e4740 1 Processor -- start 2024-08-20T01:54:31.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.544+0000 7f4b443e4740 1 -- start start 2024-08-20T01:54:31.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.545+0000 7f4b443e4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56152de64a40 0x56152de5a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:31.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.545+0000 7f4b443e4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152de67370 0x56152de5a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:31.548 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.545+0000 7f4b443e4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56152de69db0 0x56152de5d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.545+0000 7f4b443e4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c1a7850 con 0x56152de64a40 2024-08-20T01:54:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.545+0000 7f4b443e4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c1a93c0 con 0x56152de67370 2024-08-20T01:54:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.545+0000 7f4b443e4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c1a7f50 con 0x56152de69db0 2024-08-20T01:54:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.545+0000 7f4b3affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56152de64a40 0x56152de5a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.545+0000 7f4b33fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152de67370 0x56152de5a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.545+0000 7f4b3affd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56152de64a40 0x56152de5a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49544/0 (socket says 172.21.15.79:49544) 2024-08-20T01:54:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.545+0000 7f4b3affd640 1 -- 172.21.15.79:0/1819012539 learned_addr learned my addr 172.21.15.79:0/1819012539 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.545+0000 7f4b3b7fe640 1 --2- 172.21.15.79:0/1819012539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56152de69db0 0x56152de5d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.545+0000 7f4b3affd640 1 -- 172.21.15.79:0/1819012539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56152de69db0 msgr2=0x56152de5d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.545+0000 7f4b3affd640 1 --2- 172.21.15.79:0/1819012539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56152de69db0 0x56152de5d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.545+0000 7f4b3affd640 1 -- 172.21.15.79:0/1819012539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152de67370 msgr2=0x56152de5a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.545+0000 7f4b3affd640 1 --2- 172.21.15.79:0/1819012539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152de67370 0x56152de5a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:31.550 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.545+0000 7f4b3affd640 1 -- 172.21.15.79:0/1819012539 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56152de6ddd0 con 0x56152de64a40 2024-08-20T01:54:31.550 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.545+0000 7f4b3b7fe640 1 --2- 172.21.15.79:0/1819012539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56152de69db0 0x56152de5d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:54:31.550 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.545+0000 7f4b33fff640 1 --2- 172.21.15.79:0/1819012539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152de67370 0x56152de5a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:54:31.550 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.545+0000 7f4b3affd640 1 --2- 172.21.15.79:0/1819012539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56152de64a40 0x56152de5a030 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c01d6a0 tx=0x7f4b2c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6870eb85f957340 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:31.550 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.546+0000 7f4b30ff9640 1 -- 172.21.15.79:0/1819012539 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c004030 con 0x56152de64a40 2024-08-20T01:54:31.550 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.546+0000 7f4b30ff9640 1 -- 172.21.15.79:0/1819012539 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b2c005020 con 0x56152de64a40 2024-08-20T01:54:31.550 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.546+0000 7f4b30ff9640 1 -- 172.21.15.79:0/1819012539 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c004bc0 con 0x56152de64a40 2024-08-20T01:54:31.550 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.546+0000 7f4b443e4740 1 -- 172.21.15.79:0/1819012539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56152de64a40 msgr2=0x56152de5a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:31.550 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.546+0000 7f4b443e4740 1 --2- 172.21.15.79:0/1819012539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56152de64a40 0x56152de5a030 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c01d6a0 tx=0x7f4b2c01b000 comp rx=0 tx=0).stop 2024-08-20T01:54:31.550 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.546+0000 7f4b443e4740 1 -- 172.21.15.79:0/1819012539 shutdown_connections 2024-08-20T01:54:31.550 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.546+0000 7f4b443e4740 1 --2- 172.21.15.79:0/1819012539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56152de69db0 0x56152de5d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:31.550 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.546+0000 7f4b443e4740 1 --2- 172.21.15.79:0/1819012539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152de67370 0x56152de5a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:31.550 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.546+0000 7f4b443e4740 1 --2- 172.21.15.79:0/1819012539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56152de64a40 0x56152de5a030 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:31.551 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.546+0000 7f4b443e4740 1 -- 172.21.15.79:0/1819012539 >> 172.21.15.79:0/1819012539 conn(0x56152de5b730 msgr2=0x56152de5c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:31.551 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.546+0000 7f4b443e4740 1 -- 172.21.15.79:0/1819012539 shutdown_connections 2024-08-20T01:54:31.551 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.546+0000 7f4b443e4740 1 -- 172.21.15.79:0/1819012539 wait complete. 2024-08-20T01:54:31.551 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.547+0000 7f4b443e4740 1 -- start start 2024-08-20T01:54:31.551 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.547+0000 7f4b443e4740 1 Processor -- start 2024-08-20T01:54:31.553 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.547+0000 7f4b443e4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56152de64a40 0x56152de74fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:31.553 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.547+0000 7f4b443e4740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56152de67370 0x56152de754f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:31.553 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.547+0000 7f4b443e4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152de69db0 0x56152de75a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:31.553 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.547+0000 7f4b443e4740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c1a8cf0 con 0x56152de67370 2024-08-20T01:54:31.553 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.547+0000 7f4b443e4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c1a8620 con 0x56152de69db0 2024-08-20T01:54:31.553 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.547+0000 7f4b443e4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c1a5830 con 0x56152de64a40 2024-08-20T01:54:31.553 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.547+0000 7f4b443e4740 10 client.0 _ll_register_callbacks cb 0x7f4b34005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:54:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.547+0000 7f4b33fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56152de67370 0x56152de754f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.547+0000 7f4b33fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56152de67370 0x56152de754f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49546/0 (socket says 172.21.15.79:49546) 2024-08-20T01:54:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.547+0000 7f4b33fff640 1 -- 172.21.15.79:0/636174640 learned_addr learned my addr 172.21.15.79:0/636174640 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.547+0000 7f4b3b7fe640 1 --2- 172.21.15.79:0/636174640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152de69db0 0x56152de75a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.547+0000 7f4b3affd640 1 --2- 172.21.15.79:0/636174640 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56152de64a40 0x56152de74fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.547+0000 7f4b33fff640 1 -- 172.21.15.79:0/636174640 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56152de64a40 msgr2=0x56152de74fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.547+0000 7f4b33fff640 1 --2- 172.21.15.79:0/636174640 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56152de64a40 0x56152de74fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.547+0000 7f4b33fff640 1 -- 172.21.15.79:0/636174640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152de69db0 msgr2=0x56152de75a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.547+0000 7f4b33fff640 1 --2- 172.21.15.79:0/636174640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152de69db0 0x56152de75a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.547+0000 7f4b33fff640 1 -- 172.21.15.79:0/636174640 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56152de73d70 con 0x56152de67370 2024-08-20T01:54:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.548+0000 7f4b33fff640 1 --2- 172.21.15.79:0/636174640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56152de67370 0x56152de754f0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f4b2401e000 tx=0x7f4b2400ffc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6d53f6659183dcd server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.548+0000 7f4b227fc640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:54:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.548+0000 7f4b227fc640 1 -- 172.21.15.79:0/636174640 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b240053c0 con 0x56152de67370 2024-08-20T01:54:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.548+0000 7f4b227fc640 1 -- 172.21.15.79:0/636174640 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f4b24019040 con 0x56152de67370 2024-08-20T01:54:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.548+0000 7f4b443e4740 1 -- 172.21.15.79:0/636174640 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b2c005020 con 0x56152de67370 2024-08-20T01:54:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.548+0000 7f4b227fc640 1 -- 172.21.15.79:0/636174640 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f4b24005560 con 0x56152de67370 2024-08-20T01:54:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.548+0000 7f4b443e4740 10 client.19764 fetch_fsmap learned FSMap version 71 2024-08-20T01:54:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.548+0000 7f4b443e4740 1 -- 172.21.15.79:0/636174640 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x56152dee4d00 con 0x56152de67370 2024-08-20T01:54:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.548+0000 7f4b227fc640 1 -- 172.21.15.79:0/636174640 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b2c005020 con 0x56152de67370 2024-08-20T01:54:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.548+0000 7f4b227fc640 1 -- 172.21.15.79:0/636174640 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 71) ==== 8374+0+0 (secure 0 0 0) 0x7f4b2401d020 con 0x56152de67370 2024-08-20T01:54:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.548+0000 7f4b443e4740 10 client.19764 fetch_fsmap finished waiting for FSMap version 71 2024-08-20T01:54:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.548+0000 7f4b443e4740 10 client.19764 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T01:54:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.548+0000 7f4b443e4740 20 client.19764 populate_metadata read hostname 'smithi079' 2024-08-20T01:54:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.548+0000 7f4b443e4740 1 --2- 172.21.15.79:0/636174640 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56152de79b00 0x56152dee7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.548+0000 7f4b443e4740 4 client.19764 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T01:54:31.556 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.548+0000 7f4b443e4740 1 -- 172.21.15.79:0/636174640 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56152ddd0d50 con 0x56152de79b00 2024-08-20T01:54:31.556 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.549+0000 7f4b3affd640 1 --2- 172.21.15.79:0/636174640 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56152de79b00 0x56152dee7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:31.556 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.549+0000 7f4b3affd640 1 --2- 172.21.15.79:0/636174640 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x56152de79b00 0x56152dee7480 crc :-1 s=READY pgs=345 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a7259cbe9021838 server_cookie=566cbd5aa0556ae8 in_seq=0 out_seq=0 2024-08-20T01:54:31.556 INFO:teuthology.task.background_exec.ubuntu@smithi079.front.sepia.ceph.com.smithi079.stderr:2024-08-20T01:54:31.549+0000 7f4b227fc640 10 client.19764 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:54:31.647 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T01:54:31.894 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:54:32.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.388+0000 7f52a95cf640 1 -- 172.21.15.79:0/3993509402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52a4107d20 msgr2=0x7f52a410e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:32.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.388+0000 7f52a95cf640 1 --2- 172.21.15.79:0/3993509402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52a4107d20 0x7f52a410e520 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f529c009ca0 tx=0x7f529c02a8c0 comp rx=0 tx=0).stop 2024-08-20T01:54:32.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.388+0000 7f52a95cf640 1 -- 172.21.15.79:0/3993509402 shutdown_connections 2024-08-20T01:54:32.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.388+0000 7f52a95cf640 1 --2- 172.21.15.79:0/3993509402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52a4107d20 0x7f52a410e520 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:32.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.388+0000 7f52a95cf640 1 --2- 172.21.15.79:0/3993509402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52a41073a0 0x7f52a41077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:32.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.388+0000 7f52a95cf640 1 --2- 172.21.15.79:0/3993509402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52a4101990 0x7f52a4101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:32.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.388+0000 7f52a95cf640 1 -- 172.21.15.79:0/3993509402 >> 172.21.15.79:0/3993509402 conn(0x7f52a40fd400 msgr2=0x7f52a40ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:32.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.388+0000 7f52a95cf640 1 -- 172.21.15.79:0/3993509402 shutdown_connections 2024-08-20T01:54:32.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.388+0000 7f52a95cf640 1 -- 172.21.15.79:0/3993509402 wait complete. 2024-08-20T01:54:32.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.388+0000 7f52a95cf640 1 Processor -- start 2024-08-20T01:54:32.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.389+0000 7f52a95cf640 1 -- start start 2024-08-20T01:54:32.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.389+0000 7f52a95cf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52a4101990 0x7f52a40fd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:32.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.389+0000 7f52a95cf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52a41073a0 0x7f52a40fde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:32.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.389+0000 7f52a95cf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52a4107d20 0x7f52a40fe380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:32.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.389+0000 7f52a95cf640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f52a41118a0 con 0x7f52a41073a0 2024-08-20T01:54:32.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.389+0000 7f52a95cf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f52a4111720 con 0x7f52a4101990 2024-08-20T01:54:32.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.389+0000 7f52a95cf640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f52a4111a20 con 0x7f52a4107d20 2024-08-20T01:54:32.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.389+0000 7f52a27fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52a41073a0 0x7f52a40fde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:32.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.389+0000 7f52a27fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52a41073a0 0x7f52a40fde40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49560/0 (socket says 172.21.15.79:49560) 2024-08-20T01:54:32.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.389+0000 7f52a27fc640 1 -- 172.21.15.79:0/2309502550 learned_addr learned my addr 172.21.15.79:0/2309502550 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:32.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.389+0000 7f52a37fe640 1 --2- 172.21.15.79:0/2309502550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52a4107d20 0x7f52a40fe380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:32.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.389+0000 7f52a2ffd640 1 --2- 172.21.15.79:0/2309502550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52a4101990 0x7f52a40fd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:32.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.389+0000 7f52a27fc640 1 -- 172.21.15.79:0/2309502550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52a4107d20 msgr2=0x7f52a40fe380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:32.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.389+0000 7f52a27fc640 1 --2- 172.21.15.79:0/2309502550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52a4107d20 0x7f52a40fe380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:32.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.389+0000 7f52a27fc640 1 -- 172.21.15.79:0/2309502550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52a4101990 msgr2=0x7f52a40fd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:32.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.389+0000 7f52a27fc640 1 --2- 172.21.15.79:0/2309502550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52a4101990 0x7f52a40fd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:32.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.389+0000 7f52a27fc640 1 -- 172.21.15.79:0/2309502550 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52a41a7330 con 0x7f52a41073a0 2024-08-20T01:54:32.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.389+0000 7f52a2ffd640 1 --2- 172.21.15.79:0/2309502550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52a4101990 0x7f52a40fd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:54:32.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.389+0000 7f52a27fc640 1 --2- 172.21.15.79:0/2309502550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52a41073a0 0x7f52a40fde40 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f529800e9f0 tx=0x7f529800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:32.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.390+0000 7f528bfff640 1 -- 172.21.15.79:0/2309502550 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f529800cd80 con 0x7f52a41073a0 2024-08-20T01:54:32.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.390+0000 7f52a95cf640 1 -- 172.21.15.79:0/2309502550 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52a41a7620 con 0x7f52a41073a0 2024-08-20T01:54:32.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.390+0000 7f528bfff640 1 -- 172.21.15.79:0/2309502550 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f52980054b0 con 0x7f52a41073a0 2024-08-20T01:54:32.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.390+0000 7f528bfff640 1 -- 172.21.15.79:0/2309502550 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5298010430 con 0x7f52a41073a0 2024-08-20T01:54:32.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.390+0000 7f52a95cf640 1 -- 172.21.15.79:0/2309502550 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52a41a7b60 con 0x7f52a41073a0 2024-08-20T01:54:32.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.392+0000 7f52ab9c8740 1 Processor -- start 2024-08-20T01:54:32.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.392+0000 7f52ab9c8740 1 -- start start 2024-08-20T01:54:32.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.392+0000 7f528bfff640 1 -- 172.21.15.79:0/2309502550 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f52980046c0 con 0x7f52a41073a0 2024-08-20T01:54:32.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.392+0000 7f52ab9c8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624f0a83880 0x5624f0a83c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:32.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.392+0000 7f52ab9c8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624f0a841a0 0x5624f0a8fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:32.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.392+0000 7f52ab9c8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624f0a90130 0x5624f0a92520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:32.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.392+0000 7f52ab9c8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5624f09fa930 con 0x5624f0a90130 2024-08-20T01:54:32.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.392+0000 7f52ab9c8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5624f09e9e30 con 0x5624f0a83880 2024-08-20T01:54:32.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.392+0000 7f52ab9c8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5624f09ede70 con 0x5624f0a841a0 2024-08-20T01:54:32.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.392+0000 7f52a27fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624f0a90130 0x5624f0a92520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:32.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.392+0000 7f52a2ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624f0a841a0 0x5624f0a8fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:32.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.392+0000 7f52a27fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624f0a90130 0x5624f0a92520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49572/0 (socket says 172.21.15.79:49572) 2024-08-20T01:54:32.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.392+0000 7f52a2ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624f0a841a0 0x5624f0a8fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:46846/0 (socket says 172.21.15.79:46846) 2024-08-20T01:54:32.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.392+0000 7f52a27fc640 1 -- 172.21.15.79:0/2196937127 learned_addr learned my addr 172.21.15.79:0/2196937127 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:32.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.392+0000 7f52a37fe640 1 --2- 172.21.15.79:0/2196937127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624f0a83880 0x5624f0a83c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:32.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.393+0000 7f52a27fc640 1 -- 172.21.15.79:0/2196937127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624f0a841a0 msgr2=0x5624f0a8fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:32.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.393+0000 7f52a27fc640 1 --2- 172.21.15.79:0/2196937127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624f0a841a0 0x5624f0a8fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:32.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.393+0000 7f52a27fc640 1 -- 172.21.15.79:0/2196937127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624f0a83880 msgr2=0x5624f0a83c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:32.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.393+0000 7f52a27fc640 1 --2- 172.21.15.79:0/2196937127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624f0a83880 0x5624f0a83c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:32.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.393+0000 7f52a27fc640 1 -- 172.21.15.79:0/2196937127 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624f0749650 con 0x5624f0a90130 2024-08-20T01:54:32.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.393+0000 7f52a2ffd640 1 --2- 172.21.15.79:0/2196937127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624f0a841a0 0x5624f0a8fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:54:32.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.393+0000 7f52a27fc640 1 --2- 172.21.15.79:0/2196937127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624f0a90130 0x5624f0a92520 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f52980e7f40 tx=0x7f52980ec1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ded124846e27d0d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:32.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.393+0000 7f528bfff640 1 --2- 172.21.15.79:0/2309502550 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f528c0b3bd0 0x7f528c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:32.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.393+0000 7f52897fa640 1 -- 172.21.15.79:0/2196937127 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52980f7070 con 0x5624f0a90130 2024-08-20T01:54:32.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.393+0000 7f52a37fe640 1 --2- 172.21.15.79:0/2309502550 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f528c0b3bd0 0x7f528c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:32.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.393+0000 7f52897fa640 1 -- 172.21.15.79:0/2196937127 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f52980aaa00 con 0x5624f0a90130 2024-08-20T01:54:32.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.393+0000 7f52897fa640 1 -- 172.21.15.79:0/2196937127 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52980aa840 con 0x5624f0a90130 2024-08-20T01:54:32.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.393+0000 7f528bfff640 1 -- 172.21.15.79:0/2309502550 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f52980e3f90 con 0x7f52a41073a0 2024-08-20T01:54:32.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.394+0000 7f52ab9c8740 1 -- 172.21.15.79:0/2196937127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624f0a90130 msgr2=0x5624f0a92520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:32.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.394+0000 7f52ab9c8740 1 --2- 172.21.15.79:0/2196937127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624f0a90130 0x5624f0a92520 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f52980e7f40 tx=0x7f52980ec1a0 comp rx=0 tx=0).stop 2024-08-20T01:54:32.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.394+0000 7f52a37fe640 1 --2- 172.21.15.79:0/2309502550 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f528c0b3bd0 0x7f528c0b6090 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f52a40ff9c0 tx=0x7f529c009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:32.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.394+0000 7f52ab9c8740 1 -- 172.21.15.79:0/2196937127 shutdown_connections 2024-08-20T01:54:32.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.394+0000 7f52ab9c8740 1 --2- 172.21.15.79:0/2196937127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624f0a90130 0x5624f0a92520 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:32.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.394+0000 7f52ab9c8740 1 --2- 172.21.15.79:0/2196937127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624f0a841a0 0x5624f0a8fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:32.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.394+0000 7f52ab9c8740 1 --2- 172.21.15.79:0/2196937127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624f0a83880 0x5624f0a83c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:32.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.394+0000 7f52ab9c8740 1 -- 172.21.15.79:0/2196937127 >> 172.21.15.79:0/2196937127 conn(0x5624f0a816b0 msgr2=0x5624f0a82850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:32.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.394+0000 7f52ab9c8740 1 -- 172.21.15.79:0/2196937127 shutdown_connections 2024-08-20T01:54:32.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.394+0000 7f52ab9c8740 1 -- 172.21.15.79:0/2196937127 wait complete. 2024-08-20T01:54:32.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.394+0000 7f52ab9c8740 1 -- start start 2024-08-20T01:54:32.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.395+0000 7f52ab9c8740 1 Processor -- start 2024-08-20T01:54:32.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.395+0000 7f52ab9c8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624f0a83880 0x5624f0a8d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:32.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.395+0000 7f52ab9c8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624f0a841a0 0x5624f0a8d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:32.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.395+0000 7f52ab9c8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624f0a90130 0x5624f0a8dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:32.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.395+0000 7f52ab9c8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5624f084c700 con 0x5624f0a90130 2024-08-20T01:54:32.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.395+0000 7f52ab9c8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5624f0970810 con 0x5624f0a83880 2024-08-20T01:54:32.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.395+0000 7f52ab9c8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5624f0a92de0 con 0x5624f0a841a0 2024-08-20T01:54:32.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.395+0000 7f52ab9c8740 10 client.0 _ll_register_callbacks cb 0x5624f09e3700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:54:32.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.395+0000 7f52a37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624f0a90130 0x5624f0a8dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:32.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.395+0000 7f52a37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624f0a90130 0x5624f0a8dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49582/0 (socket says 172.21.15.79:49582) 2024-08-20T01:54:32.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.395+0000 7f52a37fe640 1 -- 172.21.15.79:0/2384976277 learned_addr learned my addr 172.21.15.79:0/2384976277 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:32.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.395+0000 7f52a2ffd640 1 --2- 172.21.15.79:0/2384976277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624f0a83880 0x5624f0a8d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:32.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.395+0000 7f52a27fc640 1 --2- 172.21.15.79:0/2384976277 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624f0a841a0 0x5624f0a8d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:32.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.395+0000 7f52a37fe640 1 -- 172.21.15.79:0/2384976277 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624f0a841a0 msgr2=0x5624f0a8d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:32.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.395+0000 7f52a37fe640 1 --2- 172.21.15.79:0/2384976277 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624f0a841a0 0x5624f0a8d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:32.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.395+0000 7f52a37fe640 1 -- 172.21.15.79:0/2384976277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624f0a83880 msgr2=0x5624f0a8d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:32.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.395+0000 7f52a37fe640 1 --2- 172.21.15.79:0/2384976277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624f0a83880 0x5624f0a8d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:32.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.395+0000 7f52a37fe640 1 -- 172.21.15.79:0/2384976277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624f0a9c170 con 0x5624f0a90130 2024-08-20T01:54:32.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.395+0000 7f52a27fc640 1 --2- 172.21.15.79:0/2384976277 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624f0a841a0 0x5624f0a8d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:54:32.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.395+0000 7f52a2ffd640 1 --2- 172.21.15.79:0/2384976277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624f0a83880 0x5624f0a8d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:54:32.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.395+0000 7f52a37fe640 1 --2- 172.21.15.79:0/2384976277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624f0a90130 0x5624f0a8dae0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f529c009ca0 tx=0x7f529c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a03289302ad1e963 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:32.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.395+0000 7f5286ff5640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:54:32.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.396+0000 7f5286ff5640 1 -- 172.21.15.79:0/2384976277 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f529c031e10 con 0x5624f0a90130 2024-08-20T01:54:32.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.396+0000 7f5286ff5640 1 -- 172.21.15.79:0/2384976277 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f529c004040 con 0x5624f0a90130 2024-08-20T01:54:32.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.396+0000 7f52ab9c8740 1 -- 172.21.15.79:0/2384976277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5624f0999150 con 0x5624f0a90130 2024-08-20T01:54:32.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.396+0000 7f5286ff5640 1 -- 172.21.15.79:0/2384976277 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f529c004240 con 0x5624f0a90130 2024-08-20T01:54:32.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.396+0000 7f52ab9c8740 10 client.19776 fetch_fsmap learned FSMap version 71 2024-08-20T01:54:32.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.396+0000 7f52ab9c8740 1 -- 172.21.15.79:0/2384976277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x5624f0a9eb00 con 0x5624f0a90130 2024-08-20T01:54:32.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.396+0000 7f5286ff5640 1 -- 172.21.15.79:0/2384976277 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5624f0999150 con 0x5624f0a90130 2024-08-20T01:54:32.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.396+0000 7f5286ff5640 1 -- 172.21.15.79:0/2384976277 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 71) ==== 8374+0+0 (secure 0 0 0) 0x7f529c051070 con 0x5624f0a90130 2024-08-20T01:54:32.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.396+0000 7f52ab9c8740 10 client.19776 fetch_fsmap finished waiting for FSMap version 71 2024-08-20T01:54:32.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.396+0000 7f52ab9c8740 10 client.19776 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:54:32.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.396+0000 7f52ab9c8740 20 client.19776 populate_metadata read hostname 'smithi079' 2024-08-20T01:54:32.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.396+0000 7f52ab9c8740 1 --2- 172.21.15.79:0/2384976277 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5624f0a9ffb0 0x5624f0aa2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:32.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.396+0000 7f52ab9c8740 4 client.19776 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:54:32.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.396+0000 7f52ab9c8740 1 -- 172.21.15.79:0/2384976277 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5624f09fc880 con 0x5624f0a9ffb0 2024-08-20T01:54:32.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.396+0000 7f52a2ffd640 1 --2- 172.21.15.79:0/2384976277 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5624f0a9ffb0 0x5624f0aa2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:32.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.397+0000 7f5286ff5640 10 client.19776 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:54:32.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.397+0000 7f52a2ffd640 1 --2- 172.21.15.79:0/2384976277 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5624f0a9ffb0 0x5624f0aa2410 crc :-1 s=READY pgs=346 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a513f7c0ef91a14 server_cookie=3404e18888d2c39d in_seq=0 out_seq=0 2024-08-20T01:54:32.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.397+0000 7f5286ff5640 1 -- 172.21.15.79:0/2384976277 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5624f09fc880 con 0x5624f0a9ffb0 2024-08-20T01:54:32.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.397+0000 7f5286ff5640 10 client.19776 handle_command_reply: tid=0 2024-08-20T01:54:32.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.397+0000 7f52ab9c8740 1 client.19776 shutdown 2024-08-20T01:54:32.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.397+0000 7f52ab9c8740 1 -- 172.21.15.79:0/2384976277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624f0a90130 msgr2=0x5624f0a8dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:32.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.398+0000 7f52ab9c8740 1 --2- 172.21.15.79:0/2384976277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624f0a90130 0x5624f0a8dae0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f529c009ca0 tx=0x7f529c02a8c0 comp rx=0 tx=0).stop 2024-08-20T01:54:32.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.398+0000 7f52ab9c8740 1 -- 172.21.15.79:0/2384976277 shutdown_connections 2024-08-20T01:54:32.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.398+0000 7f52ab9c8740 1 --2- 172.21.15.79:0/2384976277 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5624f0a9ffb0 0x5624f0aa2410 crc :-1 s=READY pgs=346 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:32.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.398+0000 7f52ab9c8740 1 --2- 172.21.15.79:0/2384976277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624f0a90130 0x5624f0a8dae0 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:32.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.398+0000 7f52ab9c8740 1 --2- 172.21.15.79:0/2384976277 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624f0a841a0 0x5624f0a8d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:32.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.398+0000 7f5286ff5640 0 client.19776 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:54:32.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.398+0000 7f52ab9c8740 1 --2- 172.21.15.79:0/2384976277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624f0a83880 0x5624f0a8d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:32.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.398+0000 7f52ab9c8740 1 -- 172.21.15.79:0/2384976277 >> 172.21.15.79:0/2384976277 conn(0x5624f0a816b0 msgr2=0x5624f0a87250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:32.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.398+0000 7f52ab9c8740 1 -- 172.21.15.79:0/2384976277 shutdown_connections 2024-08-20T01:54:32.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.398+0000 7f52ab9c8740 1 -- 172.21.15.79:0/2384976277 wait complete. 2024-08-20T01:54:32.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.398+0000 7f52ab9c8740 20 client.19776 trim_cache size 0 max 16384 2024-08-20T01:54:32.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.410+0000 7f52ab9c8740 1 Processor -- start 2024-08-20T01:54:32.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.411+0000 7f52ab9c8740 1 -- start start 2024-08-20T01:54:32.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.411+0000 7f52ab9c8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624f0a83880 0x5624f0a87a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:32.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.411+0000 7f52ab9c8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624f0a841a0 0x5624f0aa7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:32.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.411+0000 7f52ab9c8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624f0a90130 0x5624f0aa8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:32.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.411+0000 7f52ab9c8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f52a41b02a0 con 0x5624f0a90130 2024-08-20T01:54:32.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.411+0000 7f52ab9c8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f52a41b1e10 con 0x5624f0a841a0 2024-08-20T01:54:32.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.411+0000 7f52ab9c8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f52a41b09a0 con 0x5624f0a83880 2024-08-20T01:54:32.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.411+0000 7f52a37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624f0a90130 0x5624f0aa8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:32.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.411+0000 7f52a37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624f0a90130 0x5624f0aa8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49586/0 (socket says 172.21.15.79:49586) 2024-08-20T01:54:32.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.411+0000 7f52a37fe640 1 -- 172.21.15.79:0/3600178773 learned_addr learned my addr 172.21.15.79:0/3600178773 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:32.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.411+0000 7f52a2ffd640 1 --2- 172.21.15.79:0/3600178773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624f0a83880 0x5624f0a87a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:32.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.411+0000 7f52a27fc640 1 --2- 172.21.15.79:0/3600178773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624f0a841a0 0x5624f0aa7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:32.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.411+0000 7f52a37fe640 1 -- 172.21.15.79:0/3600178773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624f0a83880 msgr2=0x5624f0a87a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:32.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.411+0000 7f52a37fe640 1 --2- 172.21.15.79:0/3600178773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624f0a83880 0x5624f0a87a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:32.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.411+0000 7f52a37fe640 1 -- 172.21.15.79:0/3600178773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624f0a841a0 msgr2=0x5624f0aa7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:32.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.411+0000 7f52a37fe640 1 --2- 172.21.15.79:0/3600178773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624f0a841a0 0x5624f0aa7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:32.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.411+0000 7f52a37fe640 1 -- 172.21.15.79:0/3600178773 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624f0a7faf0 con 0x5624f0a90130 2024-08-20T01:54:32.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.411+0000 7f52a2ffd640 1 --2- 172.21.15.79:0/3600178773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624f0a83880 0x5624f0a87a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:54:32.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.411+0000 7f52a37fe640 1 --2- 172.21.15.79:0/3600178773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624f0a90130 0x5624f0aa8220 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f529c030c20 tx=0x7f529c0039f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba9d1accd62372de server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:32.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.412+0000 7f5288ff9640 1 -- 172.21.15.79:0/3600178773 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f529c062070 con 0x5624f0a90130 2024-08-20T01:54:32.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.412+0000 7f5288ff9640 1 -- 172.21.15.79:0/3600178773 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f529c059030 con 0x5624f0a90130 2024-08-20T01:54:32.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.412+0000 7f5288ff9640 1 -- 172.21.15.79:0/3600178773 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f529c004640 con 0x5624f0a90130 2024-08-20T01:54:32.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.412+0000 7f52ab9c8740 1 -- 172.21.15.79:0/3600178773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624f0a90130 msgr2=0x5624f0aa8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:32.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.412+0000 7f52ab9c8740 1 --2- 172.21.15.79:0/3600178773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624f0a90130 0x5624f0aa8220 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f529c030c20 tx=0x7f529c0039f0 comp rx=0 tx=0).stop 2024-08-20T01:54:32.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.412+0000 7f52ab9c8740 1 -- 172.21.15.79:0/3600178773 shutdown_connections 2024-08-20T01:54:32.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.412+0000 7f52ab9c8740 1 --2- 172.21.15.79:0/3600178773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624f0a90130 0x5624f0aa8220 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:32.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.412+0000 7f52ab9c8740 1 --2- 172.21.15.79:0/3600178773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624f0a841a0 0x5624f0aa7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:32.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.412+0000 7f52ab9c8740 1 --2- 172.21.15.79:0/3600178773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624f0a83880 0x5624f0a87a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:32.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.412+0000 7f52ab9c8740 1 -- 172.21.15.79:0/3600178773 >> 172.21.15.79:0/3600178773 conn(0x5624f0a816b0 msgr2=0x5624f0a88370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:32.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.412+0000 7f52ab9c8740 1 -- 172.21.15.79:0/3600178773 shutdown_connections 2024-08-20T01:54:32.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.412+0000 7f52ab9c8740 1 -- 172.21.15.79:0/3600178773 wait complete. 2024-08-20T01:54:32.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.413+0000 7f52ab9c8740 1 -- start start 2024-08-20T01:54:32.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.413+0000 7f52ab9c8740 1 Processor -- start 2024-08-20T01:54:32.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.413+0000 7f52ab9c8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624f0a83880 0x5624f0a93820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:32.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.413+0000 7f52ab9c8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624f0a841a0 0x5624f0a93d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:32.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.413+0000 7f52ab9c8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624f0a90130 0x5624f0b08ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:32.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.413+0000 7f52ab9c8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f52a41b1740 con 0x5624f0a83880 2024-08-20T01:54:32.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.413+0000 7f52ab9c8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f52a41b1070 con 0x5624f0a841a0 2024-08-20T01:54:32.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.413+0000 7f52ab9c8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f52a41ae280 con 0x5624f0a90130 2024-08-20T01:54:32.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.413+0000 7f52ab9c8740 10 client.0 _ll_register_callbacks cb 0x7f529c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:54:32.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.413+0000 7f52a2ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624f0a83880 0x5624f0a93820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:32.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.413+0000 7f52a2ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624f0a83880 0x5624f0a93820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49592/0 (socket says 172.21.15.79:49592) 2024-08-20T01:54:32.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.413+0000 7f52a2ffd640 1 -- 172.21.15.79:0/3672117808 learned_addr learned my addr 172.21.15.79:0/3672117808 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:32.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.413+0000 7f52a37fe640 1 --2- 172.21.15.79:0/3672117808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624f0a90130 0x5624f0b08ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:32.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.413+0000 7f52a27fc640 1 --2- 172.21.15.79:0/3672117808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624f0a841a0 0x5624f0a93d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:32.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.414+0000 7f52a2ffd640 1 -- 172.21.15.79:0/3672117808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624f0a90130 msgr2=0x5624f0b08ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:32.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.414+0000 7f52a2ffd640 1 --2- 172.21.15.79:0/3672117808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624f0a90130 0x5624f0b08ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:32.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.414+0000 7f52a2ffd640 1 -- 172.21.15.79:0/3672117808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624f0a841a0 msgr2=0x5624f0a93d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:32.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.414+0000 7f52a2ffd640 1 --2- 172.21.15.79:0/3672117808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624f0a841a0 0x5624f0a93d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:32.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.414+0000 7f52a2ffd640 1 -- 172.21.15.79:0/3672117808 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624f0b09340 con 0x5624f0a83880 2024-08-20T01:54:32.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.414+0000 7f52a37fe640 1 --2- 172.21.15.79:0/3672117808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624f0a90130 0x5624f0b08ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:54:32.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.414+0000 7f52a2ffd640 1 --2- 172.21.15.79:0/3672117808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624f0a83880 0x5624f0a93820 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f5294009f10 tx=0x7f5294012cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40b2c22dad0ab29d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:32.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.414+0000 7f5286ff5640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:54:32.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.414+0000 7f5286ff5640 1 -- 172.21.15.79:0/3672117808 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f529401fc40 con 0x5624f0a83880 2024-08-20T01:54:32.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.414+0000 7f5286ff5640 1 -- 172.21.15.79:0/3672117808 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f529401fde0 con 0x5624f0a83880 2024-08-20T01:54:32.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.414+0000 7f52ab9c8740 1 -- 172.21.15.79:0/3672117808 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f529c059030 con 0x5624f0a83880 2024-08-20T01:54:32.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.414+0000 7f5286ff5640 1 -- 172.21.15.79:0/3672117808 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f5294032480 con 0x5624f0a83880 2024-08-20T01:54:32.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.414+0000 7f52ab9c8740 10 client.19782 fetch_fsmap learned FSMap version 71 2024-08-20T01:54:32.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.414+0000 7f52ab9c8740 1 -- 172.21.15.79:0/3672117808 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x5624f0b0a680 con 0x5624f0a83880 2024-08-20T01:54:32.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.414+0000 7f5286ff5640 1 -- 172.21.15.79:0/3672117808 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f529c059030 con 0x5624f0a83880 2024-08-20T01:54:32.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.414+0000 7f5286ff5640 1 -- 172.21.15.79:0/3672117808 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 71) ==== 8374+0+0 (secure 0 0 0) 0x7f5294026400 con 0x5624f0a83880 2024-08-20T01:54:32.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.415+0000 7f52ab9c8740 10 client.19782 fetch_fsmap finished waiting for FSMap version 71 2024-08-20T01:54:32.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.415+0000 7f52ab9c8740 10 client.19782 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:54:32.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.415+0000 7f52ab9c8740 20 client.19782 populate_metadata read hostname 'smithi079' 2024-08-20T01:54:32.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.415+0000 7f52ab9c8740 1 --2- 172.21.15.79:0/3672117808 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5624f0b0ae80 0x5624f0b0d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:32.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.415+0000 7f52ab9c8740 4 client.19782 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:54:32.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.415+0000 7f52ab9c8740 1 -- 172.21.15.79:0/3672117808 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5624f09f8320 con 0x5624f0b0ae80 2024-08-20T01:54:32.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.415+0000 7f52a27fc640 1 --2- 172.21.15.79:0/3672117808 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5624f0b0ae80 0x5624f0b0d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:32.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.415+0000 7f52a27fc640 1 --2- 172.21.15.79:0/3672117808 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5624f0b0ae80 0x5624f0b0d2a0 crc :-1 s=READY pgs=347 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8284510c6fbae2e3 server_cookie=fc5a8dccc8c0b93f in_seq=0 out_seq=0 2024-08-20T01:54:32.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.415+0000 7f5286ff5640 10 client.19782 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:54:32.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.415+0000 7f5286ff5640 1 -- 172.21.15.79:0/3672117808 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5624f09f8320 con 0x5624f0b0ae80 2024-08-20T01:54:32.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.415+0000 7f5286ff5640 10 client.19782 handle_command_reply: tid=0 2024-08-20T01:54:32.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.415+0000 7f52ab9c8740 1 client.19782 shutdown 2024-08-20T01:54:32.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.415+0000 7f52ab9c8740 1 -- 172.21.15.79:0/3672117808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624f0a83880 msgr2=0x5624f0a93820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:32.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.415+0000 7f52ab9c8740 1 --2- 172.21.15.79:0/3672117808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624f0a83880 0x5624f0a93820 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f5294009f10 tx=0x7f5294012cb0 comp rx=0 tx=0).stop 2024-08-20T01:54:32.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.415+0000 7f52ab9c8740 1 -- 172.21.15.79:0/3672117808 shutdown_connections 2024-08-20T01:54:32.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.415+0000 7f52ab9c8740 1 --2- 172.21.15.79:0/3672117808 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5624f0b0ae80 0x5624f0b0d2a0 crc :-1 s=READY pgs=347 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:32.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.415+0000 7f52ab9c8740 1 --2- 172.21.15.79:0/3672117808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624f0a90130 0x5624f0b08ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:32.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.415+0000 7f52ab9c8740 1 --2- 172.21.15.79:0/3672117808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624f0a841a0 0x5624f0a93d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:32.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.415+0000 7f5286ff5640 0 client.19782 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:54:32.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.415+0000 7f52ab9c8740 1 --2- 172.21.15.79:0/3672117808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624f0a83880 0x5624f0a93820 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:32.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.415+0000 7f52ab9c8740 1 -- 172.21.15.79:0/3672117808 >> 172.21.15.79:0/3672117808 conn(0x5624f0a816b0 msgr2=0x5624f0a8e690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:32.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.416+0000 7f52ab9c8740 1 -- 172.21.15.79:0/3672117808 shutdown_connections 2024-08-20T01:54:32.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.416+0000 7f52ab9c8740 1 -- 172.21.15.79:0/3672117808 wait complete. 2024-08-20T01:54:32.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.416+0000 7f52ab9c8740 20 client.19782 trim_cache size 0 max 16384 2024-08-20T01:54:32.430 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:54:32.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.416+0000 7f52a95cf640 1 -- 172.21.15.79:0/2309502550 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f528c0b3bd0 msgr2=0x7f528c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:32.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.416+0000 7f52a95cf640 1 --2- 172.21.15.79:0/2309502550 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f528c0b3bd0 0x7f528c0b6090 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f52a40ff9c0 tx=0x7f529c009360 comp rx=0 tx=0).stop 2024-08-20T01:54:32.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.416+0000 7f52a95cf640 1 -- 172.21.15.79:0/2309502550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52a41073a0 msgr2=0x7f52a40fde40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:32.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.416+0000 7f52a95cf640 1 --2- 172.21.15.79:0/2309502550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52a41073a0 0x7f52a40fde40 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f529800e9f0 tx=0x7f529800edf0 comp rx=0 tx=0).stop 2024-08-20T01:54:32.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.416+0000 7f52a95cf640 1 -- 172.21.15.79:0/2309502550 shutdown_connections 2024-08-20T01:54:32.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.416+0000 7f52a95cf640 1 --2- 172.21.15.79:0/2309502550 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f528c0b3bd0 0x7f528c0b6090 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:32.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.416+0000 7f52a95cf640 1 --2- 172.21.15.79:0/2309502550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52a4107d20 0x7f52a40fe380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:32.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.416+0000 7f52a95cf640 1 --2- 172.21.15.79:0/2309502550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52a41073a0 0x7f52a40fde40 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:32.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.416+0000 7f52a95cf640 1 --2- 172.21.15.79:0/2309502550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52a4101990 0x7f52a40fd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:32.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.416+0000 7f52a95cf640 1 -- 172.21.15.79:0/2309502550 >> 172.21.15.79:0/2309502550 conn(0x7f52a40fd400 msgr2=0x7f52a406ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:32.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.416+0000 7f52a95cf640 1 -- 172.21.15.79:0/2309502550 shutdown_connections 2024-08-20T01:54:32.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:32.416+0000 7f52a95cf640 1 -- 172.21.15.79:0/2309502550 wait complete. 2024-08-20T01:54:32.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:32 smithi175 ceph-mon[22392]: pgmap v863: 97 pgs: 97 active+clean; 4.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 15 KiB/s wr, 19 op/s 2024-08-20T01:54:32.689 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:32 smithi079 ceph-mon[18656]: pgmap v863: 97 pgs: 97 active+clean; 4.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 15 KiB/s wr, 19 op/s 2024-08-20T01:54:32.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:32 smithi081 ceph-mon[22209]: pgmap v863: 97 pgs: 97 active+clean; 4.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 15 KiB/s wr, 19 op/s 2024-08-20T01:54:34.374 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T01:54:34.374 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T01:54:34.388 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-20T01:54:34.389 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-20T01:54:34.639 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:54:34.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:34 smithi175 ceph-mon[22392]: pgmap v864: 97 pgs: 97 active+clean; 4.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-08-20T01:54:34.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:34 smithi079 ceph-mon[18656]: pgmap v864: 97 pgs: 97 active+clean; 4.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-08-20T01:54:34.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:34 smithi081 ceph-mon[22209]: pgmap v864: 97 pgs: 97 active+clean; 4.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-08-20T01:54:35.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.148+0000 7f6c75ba0640 1 -- 172.21.15.79:0/749778434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c70102ab0 msgr2=0x7f6c70102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:35.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.148+0000 7f6c75ba0640 1 --2- 172.21.15.79:0/749778434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c70102ab0 0x7f6c70102e90 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f6c60009900 tx=0x7f6c6002a410 comp rx=0 tx=0).stop 2024-08-20T01:54:35.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.148+0000 7f6c75ba0640 1 -- 172.21.15.79:0/749778434 shutdown_connections 2024-08-20T01:54:35.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.148+0000 7f6c75ba0640 1 --2- 172.21.15.79:0/749778434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c70108e40 0x7f6c7010f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:35.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.148+0000 7f6c75ba0640 1 --2- 172.21.15.79:0/749778434 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c701084c0 0x7f6c70108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:35.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.148+0000 7f6c75ba0640 1 --2- 172.21.15.79:0/749778434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c70102ab0 0x7f6c70102e90 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:35.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.148+0000 7f6c75ba0640 1 -- 172.21.15.79:0/749778434 >> 172.21.15.79:0/749778434 conn(0x7f6c700fe500 msgr2=0x7f6c70100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:35.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.148+0000 7f6c75ba0640 1 -- 172.21.15.79:0/749778434 shutdown_connections 2024-08-20T01:54:35.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.148+0000 7f6c75ba0640 1 -- 172.21.15.79:0/749778434 wait complete. 2024-08-20T01:54:35.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.149+0000 7f6c75ba0640 1 Processor -- start 2024-08-20T01:54:35.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.149+0000 7f6c75ba0640 1 -- start start 2024-08-20T01:54:35.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.149+0000 7f6c75ba0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c70102ab0 0x7f6c70198f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:35.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.149+0000 7f6c75ba0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c701084c0 0x7f6c70199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:35.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.149+0000 7f6c75ba0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c70108e40 0x7f6c7019e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:35.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.149+0000 7f6c75ba0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6c70112970 con 0x7f6c70102ab0 2024-08-20T01:54:35.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.149+0000 7f6c75ba0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6c701127f0 con 0x7f6c701084c0 2024-08-20T01:54:35.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.149+0000 7f6c75ba0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6c70112af0 con 0x7f6c70108e40 2024-08-20T01:54:35.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.149+0000 7f6c6f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c70102ab0 0x7f6c70198f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:35.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.149+0000 7f6c6f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c70102ab0 0x7f6c70198f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49600/0 (socket says 172.21.15.79:49600) 2024-08-20T01:54:35.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.149+0000 7f6c6f7fe640 1 -- 172.21.15.79:0/3476739409 learned_addr learned my addr 172.21.15.79:0/3476739409 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:35.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.149+0000 7f6c6effd640 1 --2- 172.21.15.79:0/3476739409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c701084c0 0x7f6c70199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:35.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.149+0000 7f6c6ffff640 1 --2- 172.21.15.79:0/3476739409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c70108e40 0x7f6c7019e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:35.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.150+0000 7f6c6f7fe640 1 -- 172.21.15.79:0/3476739409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c70108e40 msgr2=0x7f6c7019e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:35.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.150+0000 7f6c6f7fe640 1 --2- 172.21.15.79:0/3476739409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c70108e40 0x7f6c7019e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:35.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.150+0000 7f6c6f7fe640 1 -- 172.21.15.79:0/3476739409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c701084c0 msgr2=0x7f6c70199460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:35.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.150+0000 7f6c6f7fe640 1 --2- 172.21.15.79:0/3476739409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c701084c0 0x7f6c70199460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:35.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.150+0000 7f6c6f7fe640 1 -- 172.21.15.79:0/3476739409 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c7019efd0 con 0x7f6c70102ab0 2024-08-20T01:54:35.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.150+0000 7f6c6effd640 1 --2- 172.21.15.79:0/3476739409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c701084c0 0x7f6c70199460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:54:35.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.150+0000 7f6c6f7fe640 1 --2- 172.21.15.79:0/3476739409 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c70102ab0 0x7f6c70198f20 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f6c60009230 tx=0x7f6c60004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:35.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.150+0000 7f6c6cff9640 1 -- 172.21.15.79:0/3476739409 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c6003f030 con 0x7f6c70102ab0 2024-08-20T01:54:35.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.150+0000 7f6c6cff9640 1 -- 172.21.15.79:0/3476739409 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6c60003a80 con 0x7f6c70102ab0 2024-08-20T01:54:35.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.150+0000 7f6c75ba0640 1 -- 172.21.15.79:0/3476739409 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c7019f260 con 0x7f6c70102ab0 2024-08-20T01:54:35.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.150+0000 7f6c6cff9640 1 -- 172.21.15.79:0/3476739409 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c60035070 con 0x7f6c70102ab0 2024-08-20T01:54:35.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.150+0000 7f6c75ba0640 1 -- 172.21.15.79:0/3476739409 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c700750b0 con 0x7f6c70102ab0 2024-08-20T01:54:35.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.153+0000 7f6c6cff9640 1 -- 172.21.15.79:0/3476739409 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f6c60042030 con 0x7f6c70102ab0 2024-08-20T01:54:35.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.153+0000 7f6c77f99740 1 Processor -- start 2024-08-20T01:54:35.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.153+0000 7f6c77f99740 1 -- start start 2024-08-20T01:54:35.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.153+0000 7f6c77f99740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576928b33b0 0x5576928b3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:35.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.153+0000 7f6c77f99740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5576928b3cd0 0x5576928bf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:35.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.153+0000 7f6c77f99740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576928bfc60 0x5576928c2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:35.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.153+0000 7f6c77f99740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557692829940 con 0x5576928b33b0 2024-08-20T01:54:35.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.153+0000 7f6c77f99740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557692818e40 con 0x5576928bfc60 2024-08-20T01:54:35.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.153+0000 7f6c77f99740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55769281ce80 con 0x5576928b3cd0 2024-08-20T01:54:35.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.153+0000 7f6c6ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576928b33b0 0x5576928b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:35.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.153+0000 7f6c6ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576928b33b0 0x5576928b3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49610/0 (socket says 172.21.15.79:49610) 2024-08-20T01:54:35.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.153+0000 7f6c6ffff640 1 -- 172.21.15.79:0/3804041558 learned_addr learned my addr 172.21.15.79:0/3804041558 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:35.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.153+0000 7f6c6effd640 1 --2- 172.21.15.79:0/3804041558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576928bfc60 0x5576928c2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:35.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.153+0000 7f6c6f7fe640 1 --2- 172.21.15.79:0/3804041558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5576928b3cd0 0x5576928bf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:35.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.154+0000 7f6c6effd640 1 -- 172.21.15.79:0/3804041558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5576928b3cd0 msgr2=0x5576928bf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:35.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.154+0000 7f6c6effd640 1 --2- 172.21.15.79:0/3804041558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5576928b3cd0 0x5576928bf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:35.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.154+0000 7f6c6effd640 1 -- 172.21.15.79:0/3804041558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576928b33b0 msgr2=0x5576928b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:35.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.154+0000 7f6c6effd640 1 --2- 172.21.15.79:0/3804041558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576928b33b0 0x5576928b3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:35.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.154+0000 7f6c6effd640 1 -- 172.21.15.79:0/3804041558 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576927b5520 con 0x5576928bfc60 2024-08-20T01:54:35.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.154+0000 7f6c6ffff640 1 --2- 172.21.15.79:0/3804041558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576928b33b0 0x5576928b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:54:35.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.154+0000 7f6c6cff9640 1 --2- 172.21.15.79:0/3476739409 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6c580b3c50 0x7f6c580b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:35.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.154+0000 7f6c6effd640 1 --2- 172.21.15.79:0/3804041558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576928bfc60 0x5576928c2050 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6c6400bfb0 tx=0x7f6c64010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a911cafefa4909 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:35.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.154+0000 7f6c6ffff640 1 --2- 172.21.15.79:0/3476739409 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6c580b3c50 0x7f6c580b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:35.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.154+0000 7f6c6cff9640 1 -- 172.21.15.79:0/3476739409 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f6c60104240 con 0x7f6c70102ab0 2024-08-20T01:54:35.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.154+0000 7f6c55ffb640 1 -- 172.21.15.79:0/3804041558 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c64004220 con 0x5576928bfc60 2024-08-20T01:54:35.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.154+0000 7f6c55ffb640 1 -- 172.21.15.79:0/3804041558 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6c640043c0 con 0x5576928bfc60 2024-08-20T01:54:35.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.154+0000 7f6c55ffb640 1 -- 172.21.15.79:0/3804041558 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c64011940 con 0x5576928bfc60 2024-08-20T01:54:35.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.155+0000 7f6c77f99740 1 -- 172.21.15.79:0/3804041558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576928bfc60 msgr2=0x5576928c2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:35.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.155+0000 7f6c6ffff640 1 --2- 172.21.15.79:0/3476739409 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6c580b3c50 0x7f6c580b6110 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f6c68009fd0 tx=0x7f6c68009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:35.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.155+0000 7f6c77f99740 1 --2- 172.21.15.79:0/3804041558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576928bfc60 0x5576928c2050 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6c6400bfb0 tx=0x7f6c64010860 comp rx=0 tx=0).stop 2024-08-20T01:54:35.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.155+0000 7f6c77f99740 1 -- 172.21.15.79:0/3804041558 shutdown_connections 2024-08-20T01:54:35.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.155+0000 7f6c77f99740 1 --2- 172.21.15.79:0/3804041558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576928bfc60 0x5576928c2050 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:35.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.155+0000 7f6c77f99740 1 --2- 172.21.15.79:0/3804041558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5576928b3cd0 0x5576928bf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:35.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.155+0000 7f6c77f99740 1 --2- 172.21.15.79:0/3804041558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576928b33b0 0x5576928b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:35.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.155+0000 7f6c77f99740 1 -- 172.21.15.79:0/3804041558 >> 172.21.15.79:0/3804041558 conn(0x5576928b11e0 msgr2=0x5576928b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:35.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.155+0000 7f6c77f99740 1 -- 172.21.15.79:0/3804041558 shutdown_connections 2024-08-20T01:54:35.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.155+0000 7f6c77f99740 1 -- 172.21.15.79:0/3804041558 wait complete. 2024-08-20T01:54:35.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.155+0000 7f6c77f99740 1 -- start start 2024-08-20T01:54:35.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.155+0000 7f6c77f99740 1 Processor -- start 2024-08-20T01:54:35.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.156+0000 7f6c77f99740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576928b33b0 0x5576928bcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:35.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.156+0000 7f6c77f99740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5576928b3cd0 0x5576928bd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:35.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.156+0000 7f6c77f99740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576928bfc60 0x5576928bd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:35.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.156+0000 7f6c77f99740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55769267b890 con 0x5576928bfc60 2024-08-20T01:54:35.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.156+0000 7f6c77f99740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55769279f700 con 0x5576928b33b0 2024-08-20T01:54:35.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.156+0000 7f6c77f99740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5576928c29b0 con 0x5576928b3cd0 2024-08-20T01:54:35.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.156+0000 7f6c77f99740 10 client.0 _ll_register_callbacks cb 0x5576928146f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:54:35.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.156+0000 7f6c6ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576928bfc60 0x5576928bd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:35.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.156+0000 7f6c6ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576928bfc60 0x5576928bd6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49622/0 (socket says 172.21.15.79:49622) 2024-08-20T01:54:35.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.156+0000 7f6c6ffff640 1 -- 172.21.15.79:0/1593017007 learned_addr learned my addr 172.21.15.79:0/1593017007 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:35.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.156+0000 7f6c6f7fe640 1 --2- 172.21.15.79:0/1593017007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576928b33b0 0x5576928bcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:35.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.156+0000 7f6c6effd640 1 --2- 172.21.15.79:0/1593017007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5576928b3cd0 0x5576928bd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:35.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.156+0000 7f6c6ffff640 1 -- 172.21.15.79:0/1593017007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5576928b3cd0 msgr2=0x5576928bd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:35.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.156+0000 7f6c6ffff640 1 --2- 172.21.15.79:0/1593017007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5576928b3cd0 0x5576928bd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:35.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.156+0000 7f6c6ffff640 1 -- 172.21.15.79:0/1593017007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576928b33b0 msgr2=0x5576928bcc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:35.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.156+0000 7f6c6ffff640 1 --2- 172.21.15.79:0/1593017007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576928b33b0 0x5576928bcc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:35.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.156+0000 7f6c6ffff640 1 -- 172.21.15.79:0/1593017007 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557692578930 con 0x5576928bfc60 2024-08-20T01:54:35.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.156+0000 7f6c6f7fe640 1 --2- 172.21.15.79:0/1593017007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576928b33b0 0x5576928bcc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:54:35.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.156+0000 7f6c6effd640 1 --2- 172.21.15.79:0/1593017007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5576928b3cd0 0x5576928bd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:54:35.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.156+0000 7f6c6ffff640 1 --2- 172.21.15.79:0/1593017007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576928bfc60 0x5576928bd6f0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f6c6800fab0 tx=0x7f6c68004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f6445eb22c5837e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:35.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.156+0000 7f6c4effd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:54:35.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.156+0000 7f6c4effd640 1 -- 172.21.15.79:0/1593017007 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c68003970 con 0x5576928bfc60 2024-08-20T01:54:35.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.157+0000 7f6c4effd640 1 -- 172.21.15.79:0/1593017007 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f6c68017030 con 0x5576928bfc60 2024-08-20T01:54:35.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.157+0000 7f6c77f99740 1 -- 172.21.15.79:0/1593017007 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c640043c0 con 0x5576928bfc60 2024-08-20T01:54:35.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.157+0000 7f6c4effd640 1 -- 172.21.15.79:0/1593017007 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f6c68003b10 con 0x5576928bfc60 2024-08-20T01:54:35.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.157+0000 7f6c77f99740 10 client.19794 fetch_fsmap learned FSMap version 71 2024-08-20T01:54:35.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.157+0000 7f6c77f99740 1 -- 172.21.15.79:0/1593017007 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x5576928ce620 con 0x5576928bfc60 2024-08-20T01:54:35.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.157+0000 7f6c4effd640 1 -- 172.21.15.79:0/1593017007 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6c640043c0 con 0x5576928bfc60 2024-08-20T01:54:35.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.157+0000 7f6c4effd640 1 -- 172.21.15.79:0/1593017007 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 71) ==== 8374+0+0 (secure 0 0 0) 0x7f6c6801d5e0 con 0x5576928bfc60 2024-08-20T01:54:35.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.157+0000 7f6c77f99740 10 client.19794 fetch_fsmap finished waiting for FSMap version 71 2024-08-20T01:54:35.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.157+0000 7f6c77f99740 10 client.19794 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:54:35.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.157+0000 7f6c77f99740 20 client.19794 populate_metadata read hostname 'smithi079' 2024-08-20T01:54:35.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.157+0000 7f6c77f99740 1 --2- 172.21.15.79:0/1593017007 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5576928cfbd0 0x5576928d2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:35.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.157+0000 7f6c77f99740 4 client.19794 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:54:35.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.157+0000 7f6c77f99740 1 -- 172.21.15.79:0/1593017007 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55769282b890 con 0x5576928cfbd0 2024-08-20T01:54:35.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.157+0000 7f6c6f7fe640 1 --2- 172.21.15.79:0/1593017007 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5576928cfbd0 0x5576928d2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:35.166 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.158+0000 7f6c4effd640 10 client.19794 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:54:35.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.158+0000 7f6c6f7fe640 1 --2- 172.21.15.79:0/1593017007 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5576928cfbd0 0x5576928d2050 crc :-1 s=READY pgs=348 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=463622b87f6bc173 server_cookie=d0332e035f5a7d90 in_seq=0 out_seq=0 2024-08-20T01:54:35.167 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.158+0000 7f6c4effd640 1 -- 172.21.15.79:0/1593017007 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55769282b890 con 0x5576928cfbd0 2024-08-20T01:54:35.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.158+0000 7f6c4effd640 10 client.19794 handle_command_reply: tid=0 2024-08-20T01:54:35.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.158+0000 7f6c77f99740 1 client.19794 shutdown 2024-08-20T01:54:35.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.159+0000 7f6c77f99740 1 -- 172.21.15.79:0/1593017007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576928bfc60 msgr2=0x5576928bd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:35.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.159+0000 7f6c77f99740 1 --2- 172.21.15.79:0/1593017007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576928bfc60 0x5576928bd6f0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f6c6800fab0 tx=0x7f6c68004ab0 comp rx=0 tx=0).stop 2024-08-20T01:54:35.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.159+0000 7f6c77f99740 1 -- 172.21.15.79:0/1593017007 shutdown_connections 2024-08-20T01:54:35.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.159+0000 7f6c77f99740 1 --2- 172.21.15.79:0/1593017007 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x5576928cfbd0 0x5576928d2050 crc :-1 s=READY pgs=348 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:35.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.159+0000 7f6c77f99740 1 --2- 172.21.15.79:0/1593017007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576928bfc60 0x5576928bd6f0 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:35.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.159+0000 7f6c77f99740 1 --2- 172.21.15.79:0/1593017007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5576928b3cd0 0x5576928bd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:35.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.159+0000 7f6c77f99740 1 --2- 172.21.15.79:0/1593017007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576928b33b0 0x5576928bcc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:35.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.159+0000 7f6c77f99740 1 -- 172.21.15.79:0/1593017007 >> 172.21.15.79:0/1593017007 conn(0x5576928b11e0 msgr2=0x5576928b6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:35.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.159+0000 7f6c4effd640 0 client.19794 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:54:35.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.159+0000 7f6c77f99740 1 -- 172.21.15.79:0/1593017007 shutdown_connections 2024-08-20T01:54:35.168 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.159+0000 7f6c77f99740 1 -- 172.21.15.79:0/1593017007 wait complete. 2024-08-20T01:54:35.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.159+0000 7f6c77f99740 20 client.19794 trim_cache size 0 max 16384 2024-08-20T01:54:35.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.176+0000 7f6c77f99740 1 Processor -- start 2024-08-20T01:54:35.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.176+0000 7f6c77f99740 1 -- start start 2024-08-20T01:54:35.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.176+0000 7f6c77f99740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576928b33b0 0x5576928b7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:35.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.176+0000 7f6c77f99740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576928b3cd0 0x5576928b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:35.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.176+0000 7f6c77f99740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5576928bfc60 0x5576928d7920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:35.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.176+0000 7f6c77f99740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6c701b01f0 con 0x5576928b33b0 2024-08-20T01:54:35.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.176+0000 7f6c77f99740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6c701b1d60 con 0x5576928b3cd0 2024-08-20T01:54:35.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.176+0000 7f6c77f99740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6c701b08f0 con 0x5576928bfc60 2024-08-20T01:54:35.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.176+0000 7f6c6f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576928b33b0 0x5576928b7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:35.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.176+0000 7f6c6f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576928b33b0 0x5576928b7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49634/0 (socket says 172.21.15.79:49634) 2024-08-20T01:54:35.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.176+0000 7f6c6f7fe640 1 -- 172.21.15.79:0/29062579 learned_addr learned my addr 172.21.15.79:0/29062579 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:35.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.176+0000 7f6c6effd640 1 --2- 172.21.15.79:0/29062579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576928b3cd0 0x5576928b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:35.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.176+0000 7f6c6f7fe640 1 -- 172.21.15.79:0/29062579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5576928bfc60 msgr2=0x5576928d7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:35.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.176+0000 7f6c6f7fe640 1 --2- 172.21.15.79:0/29062579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5576928bfc60 0x5576928d7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:35.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.176+0000 7f6c6f7fe640 1 -- 172.21.15.79:0/29062579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576928b3cd0 msgr2=0x5576928b01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:35.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.176+0000 7f6c6f7fe640 1 --2- 172.21.15.79:0/29062579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576928b3cd0 0x5576928b01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:35.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.176+0000 7f6c6f7fe640 1 -- 172.21.15.79:0/29062579 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576928b3ac0 con 0x5576928b33b0 2024-08-20T01:54:35.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.176+0000 7f6c6effd640 1 --2- 172.21.15.79:0/29062579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576928b3cd0 0x5576928b01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:54:35.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.177+0000 7f6c6f7fe640 1 --2- 172.21.15.79:0/29062579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576928b33b0 0x5576928b7570 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f6c600cb180 tx=0x7f6c6004b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f99c8cd0c3537997 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:35.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.177+0000 7f6c557fa640 1 -- 172.21.15.79:0/29062579 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c60049040 con 0x5576928b33b0 2024-08-20T01:54:35.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.177+0000 7f6c557fa640 1 -- 172.21.15.79:0/29062579 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6c600cad00 con 0x5576928b33b0 2024-08-20T01:54:35.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.177+0000 7f6c557fa640 1 -- 172.21.15.79:0/29062579 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c600035f0 con 0x5576928b33b0 2024-08-20T01:54:35.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.177+0000 7f6c77f99740 1 -- 172.21.15.79:0/29062579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576928b33b0 msgr2=0x5576928b7570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:35.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.177+0000 7f6c77f99740 1 --2- 172.21.15.79:0/29062579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576928b33b0 0x5576928b7570 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f6c600cb180 tx=0x7f6c6004b000 comp rx=0 tx=0).stop 2024-08-20T01:54:35.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.177+0000 7f6c77f99740 1 -- 172.21.15.79:0/29062579 shutdown_connections 2024-08-20T01:54:35.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.177+0000 7f6c77f99740 1 --2- 172.21.15.79:0/29062579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5576928bfc60 0x5576928d7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:35.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.177+0000 7f6c77f99740 1 --2- 172.21.15.79:0/29062579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576928b3cd0 0x5576928b01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:35.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.177+0000 7f6c77f99740 1 --2- 172.21.15.79:0/29062579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576928b33b0 0x5576928b7570 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:35.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.177+0000 7f6c77f99740 1 -- 172.21.15.79:0/29062579 >> 172.21.15.79:0/29062579 conn(0x5576928b11e0 msgr2=0x5576928afae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:35.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.177+0000 7f6c77f99740 1 -- 172.21.15.79:0/29062579 shutdown_connections 2024-08-20T01:54:35.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.177+0000 7f6c77f99740 1 -- 172.21.15.79:0/29062579 wait complete. 2024-08-20T01:54:35.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.178+0000 7f6c77f99740 1 -- start start 2024-08-20T01:54:35.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.178+0000 7f6c77f99740 1 Processor -- start 2024-08-20T01:54:35.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.178+0000 7f6c77f99740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5576928b33b0 0x5576928c8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:35.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.178+0000 7f6c77f99740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576928b3cd0 0x5576928b9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:35.185 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.178+0000 7f6c77f99740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576928bfc60 0x5576928ba290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:35.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.178+0000 7f6c77f99740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6c701b1690 con 0x5576928bfc60 2024-08-20T01:54:35.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.178+0000 7f6c77f99740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6c701b0fc0 con 0x5576928b3cd0 2024-08-20T01:54:35.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.178+0000 7f6c77f99740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6c701ae1d0 con 0x5576928b33b0 2024-08-20T01:54:35.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.178+0000 7f6c77f99740 10 client.0 _ll_register_callbacks cb 0x7f6c68011de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:54:35.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.178+0000 7f6c6ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576928bfc60 0x5576928ba290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:35.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.178+0000 7f6c6effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576928b3cd0 0x5576928b9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:35.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.178+0000 7f6c6effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576928b3cd0 0x5576928b9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:42828/0 (socket says 172.21.15.79:42828) 2024-08-20T01:54:35.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.178+0000 7f6c6effd640 1 -- 172.21.15.79:0/3893517530 learned_addr learned my addr 172.21.15.79:0/3893517530 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:35.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.178+0000 7f6c6f7fe640 1 --2- 172.21.15.79:0/3893517530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5576928b33b0 0x5576928c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:35.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.179+0000 7f6c6ffff640 1 -- 172.21.15.79:0/3893517530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5576928b33b0 msgr2=0x5576928c8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:35.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.179+0000 7f6c6ffff640 1 --2- 172.21.15.79:0/3893517530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5576928b33b0 0x5576928c8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:35.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.179+0000 7f6c6ffff640 1 -- 172.21.15.79:0/3893517530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576928b3cd0 msgr2=0x5576928b9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:35.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.179+0000 7f6c6ffff640 1 --2- 172.21.15.79:0/3893517530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576928b3cd0 0x5576928b9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:35.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.179+0000 7f6c6ffff640 1 -- 172.21.15.79:0/3893517530 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576929398f0 con 0x5576928bfc60 2024-08-20T01:54:35.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.179+0000 7f6c6ffff640 1 --2- 172.21.15.79:0/3893517530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576928bfc60 0x5576928ba290 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f6c6801da50 tx=0x7f6c68003a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4454127545c08181 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:35.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.179+0000 7f6c4effd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:54:35.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.179+0000 7f6c4effd640 1 -- 172.21.15.79:0/3893517530 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c68037070 con 0x5576928bfc60 2024-08-20T01:54:35.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.179+0000 7f6c4effd640 1 -- 172.21.15.79:0/3893517530 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f6c6801d040 con 0x5576928bfc60 2024-08-20T01:54:35.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.179+0000 7f6c77f99740 1 -- 172.21.15.79:0/3893517530 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c600cad00 con 0x5576928bfc60 2024-08-20T01:54:35.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.179+0000 7f6c4effd640 1 -- 172.21.15.79:0/3893517530 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f6c68042050 con 0x5576928bfc60 2024-08-20T01:54:35.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.179+0000 7f6c77f99740 10 client.19800 fetch_fsmap learned FSMap version 71 2024-08-20T01:54:35.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.179+0000 7f6c77f99740 1 -- 172.21.15.79:0/3893517530 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55769293aaa0 con 0x5576928bfc60 2024-08-20T01:54:35.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.179+0000 7f6c4effd640 1 -- 172.21.15.79:0/3893517530 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6c600cad00 con 0x5576928bfc60 2024-08-20T01:54:35.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.179+0000 7f6c4effd640 1 -- 172.21.15.79:0/3893517530 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 71) ==== 8374+0+0 (secure 0 0 0) 0x7f6c68028420 con 0x5576928bfc60 2024-08-20T01:54:35.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.179+0000 7f6c77f99740 10 client.19800 fetch_fsmap finished waiting for FSMap version 71 2024-08-20T01:54:35.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.179+0000 7f6c77f99740 10 client.19800 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:54:35.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.179+0000 7f6c77f99740 20 client.19800 populate_metadata read hostname 'smithi079' 2024-08-20T01:54:35.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.179+0000 7f6c77f99740 1 --2- 172.21.15.79:0/3893517530 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55769293b190 0x55769293d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:35.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.180+0000 7f6c77f99740 4 client.19800 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T01:54:35.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.180+0000 7f6c77f99740 1 -- 172.21.15.79:0/3893517530 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557692827330 con 0x55769293b190 2024-08-20T01:54:35.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.180+0000 7f6c6f7fe640 1 --2- 172.21.15.79:0/3893517530 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55769293b190 0x55769293d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:35.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.180+0000 7f6c4effd640 10 client.19800 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:54:35.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.180+0000 7f6c6f7fe640 1 --2- 172.21.15.79:0/3893517530 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55769293b190 0x55769293d5b0 crc :-1 s=READY pgs=349 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e9b9b83f98fe134 server_cookie=d072025418290e95 in_seq=0 out_seq=0 2024-08-20T01:54:35.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.181+0000 7f6c4effd640 1 -- 172.21.15.79:0/3893517530 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557692827330 con 0x55769293b190 2024-08-20T01:54:35.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.181+0000 7f6c4effd640 10 client.19800 handle_command_reply: tid=0 2024-08-20T01:54:35.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.181+0000 7f6c77f99740 1 client.19800 shutdown 2024-08-20T01:54:35.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.181+0000 7f6c77f99740 1 -- 172.21.15.79:0/3893517530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576928bfc60 msgr2=0x5576928ba290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:35.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.181+0000 7f6c77f99740 1 --2- 172.21.15.79:0/3893517530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576928bfc60 0x5576928ba290 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f6c6801da50 tx=0x7f6c68003a80 comp rx=0 tx=0).stop 2024-08-20T01:54:35.188 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.181+0000 7f6c77f99740 1 -- 172.21.15.79:0/3893517530 shutdown_connections 2024-08-20T01:54:35.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.181+0000 7f6c77f99740 1 --2- 172.21.15.79:0/3893517530 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55769293b190 0x55769293d5b0 crc :-1 s=READY pgs=349 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:35.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.181+0000 7f6c77f99740 1 --2- 172.21.15.79:0/3893517530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5576928bfc60 0x5576928ba290 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:35.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.181+0000 7f6c77f99740 1 --2- 172.21.15.79:0/3893517530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576928b3cd0 0x5576928b9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:35.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.181+0000 7f6c77f99740 1 --2- 172.21.15.79:0/3893517530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5576928b33b0 0x5576928c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:35.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.181+0000 7f6c4effd640 0 client.19800 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:54:35.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.181+0000 7f6c77f99740 1 -- 172.21.15.79:0/3893517530 >> 172.21.15.79:0/3893517530 conn(0x5576928b11e0 msgr2=0x5576928beac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:35.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.181+0000 7f6c77f99740 1 -- 172.21.15.79:0/3893517530 shutdown_connections 2024-08-20T01:54:35.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.181+0000 7f6c77f99740 1 -- 172.21.15.79:0/3893517530 wait complete. 2024-08-20T01:54:35.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.181+0000 7f6c77f99740 20 client.19800 trim_cache size 0 max 16384 2024-08-20T01:54:35.189 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:54:35.189 INFO:teuthology.orchestra.run.smithi079.stdout: "return_code": 0, 2024-08-20T01:54:35.190 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_tag": "58c9d287-c4aa-4ee7-b70f-6bc2529e40fa", 2024-08-20T01:54:35.190 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": "asynchronous" 2024-08-20T01:54:35.190 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:54:35.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.182+0000 7f6c75ba0640 1 -- 172.21.15.79:0/3476739409 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6c580b3c50 msgr2=0x7f6c580b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:35.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.182+0000 7f6c75ba0640 1 --2- 172.21.15.79:0/3476739409 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6c580b3c50 0x7f6c580b6110 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f6c68009fd0 tx=0x7f6c68009500 comp rx=0 tx=0).stop 2024-08-20T01:54:35.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.182+0000 7f6c75ba0640 1 -- 172.21.15.79:0/3476739409 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c70102ab0 msgr2=0x7f6c70198f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:35.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.182+0000 7f6c75ba0640 1 --2- 172.21.15.79:0/3476739409 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c70102ab0 0x7f6c70198f20 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f6c60009230 tx=0x7f6c60004270 comp rx=0 tx=0).stop 2024-08-20T01:54:35.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.182+0000 7f6c75ba0640 1 -- 172.21.15.79:0/3476739409 shutdown_connections 2024-08-20T01:54:35.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.182+0000 7f6c75ba0640 1 --2- 172.21.15.79:0/3476739409 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f6c580b3c50 0x7f6c580b6110 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:35.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.182+0000 7f6c75ba0640 1 --2- 172.21.15.79:0/3476739409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c70108e40 0x7f6c7019e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:35.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.182+0000 7f6c75ba0640 1 --2- 172.21.15.79:0/3476739409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c701084c0 0x7f6c70199460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:35.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.182+0000 7f6c75ba0640 1 --2- 172.21.15.79:0/3476739409 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c70102ab0 0x7f6c70198f20 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:35.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.182+0000 7f6c75ba0640 1 -- 172.21.15.79:0/3476739409 >> 172.21.15.79:0/3476739409 conn(0x7f6c700fe500 msgr2=0x7f6c701008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:35.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.182+0000 7f6c75ba0640 1 -- 172.21.15.79:0/3476739409 shutdown_connections 2024-08-20T01:54:35.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:35.182+0000 7f6c75ba0640 1 -- 172.21.15.79:0/3476739409 wait complete. 2024-08-20T01:54:35.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:35 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:54:35.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:35 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:54:35.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:35 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:54:35.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:35 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:54:35.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:35 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:54:35.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:35 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:54:35.932 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:54:36.180 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:54:36.592 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:36 smithi079 ceph-mon[18656]: pgmap v865: 97 pgs: 97 active+clean; 4.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 19 op/s 2024-08-20T01:54:36.593 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:36 smithi079 ceph-mon[18656]: scrub queued for path: / 2024-08-20T01:54:36.593 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:36 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:54:36.593 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:36 smithi079 ceph-mon[18656]: scrub summary: active paths [/] 2024-08-20T01:54:36.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:36 smithi175 ceph-mon[22392]: pgmap v865: 97 pgs: 97 active+clean; 4.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 19 op/s 2024-08-20T01:54:36.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:36 smithi175 ceph-mon[22392]: scrub queued for path: / 2024-08-20T01:54:36.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:36 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:54:36.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:36 smithi175 ceph-mon[22392]: scrub summary: active paths [/] 2024-08-20T01:54:36.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.672+0000 7fd20a561640 1 -- 172.21.15.79:0/3915231663 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd20410ce00 msgr2=0x7fd20410f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:36.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.672+0000 7fd20a561640 1 --2- 172.21.15.79:0/3915231663 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd20410ce00 0x7fd20410f250 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc009ca0 tx=0x7fd1fc02a8c0 comp rx=0 tx=0).stop 2024-08-20T01:54:36.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.672+0000 7fd20a561640 1 -- 172.21.15.79:0/3915231663 shutdown_connections 2024-08-20T01:54:36.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.672+0000 7fd20a561640 1 --2- 172.21.15.79:0/3915231663 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd20410ce00 0x7fd20410f250 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:36.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.672+0000 7fd20a561640 1 --2- 172.21.15.79:0/3915231663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd204104250 0x7fd20410c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:36.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.672+0000 7fd20a561640 1 --2- 172.21.15.79:0/3915231663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd204103850 0x7fd204103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:36.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.672+0000 7fd20a561640 1 -- 172.21.15.79:0/3915231663 >> 172.21.15.79:0/3915231663 conn(0x7fd2040fd400 msgr2=0x7fd2040ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:36.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.672+0000 7fd20a561640 1 -- 172.21.15.79:0/3915231663 shutdown_connections 2024-08-20T01:54:36.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.672+0000 7fd20a561640 1 -- 172.21.15.79:0/3915231663 wait complete. 2024-08-20T01:54:36.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.673+0000 7fd20a561640 1 Processor -- start 2024-08-20T01:54:36.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.673+0000 7fd20a561640 1 -- start start 2024-08-20T01:54:36.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.673+0000 7fd20a561640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd204103850 0x7fd204198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:36.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.674+0000 7fd20a561640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd204104250 0x7fd2041993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:36.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.674+0000 7fd20a561640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd20410ce00 0x7fd20419e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:36.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.674+0000 7fd20a561640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd204112960 con 0x7fd204104250 2024-08-20T01:54:36.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.674+0000 7fd20a561640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd2041127e0 con 0x7fd20410ce00 2024-08-20T01:54:36.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.674+0000 7fd20a561640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd204112ae0 con 0x7fd204103850 2024-08-20T01:54:36.686 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.674+0000 7fd2037fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd204104250 0x7fd2041993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:36.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.674+0000 7fd2037fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd204104250 0x7fd2041993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49658/0 (socket says 172.21.15.79:49658) 2024-08-20T01:54:36.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.674+0000 7fd2037fe640 1 -- 172.21.15.79:0/2005007886 learned_addr learned my addr 172.21.15.79:0/2005007886 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:36.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.674+0000 7fd208afe640 1 --2- 172.21.15.79:0/2005007886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd20410ce00 0x7fd20419e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:36.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.674+0000 7fd203fff640 1 --2- 172.21.15.79:0/2005007886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd204103850 0x7fd204198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:36.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.674+0000 7fd2037fe640 1 -- 172.21.15.79:0/2005007886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd204103850 msgr2=0x7fd204198e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:36.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.674+0000 7fd2037fe640 1 --2- 172.21.15.79:0/2005007886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd204103850 0x7fd204198e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:36.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.674+0000 7fd2037fe640 1 -- 172.21.15.79:0/2005007886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd20410ce00 msgr2=0x7fd20419e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:36.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.674+0000 7fd2037fe640 1 --2- 172.21.15.79:0/2005007886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd20410ce00 0x7fd20419e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:36.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.674+0000 7fd2037fe640 1 -- 172.21.15.79:0/2005007886 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd20419ef40 con 0x7fd204104250 2024-08-20T01:54:36.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.674+0000 7fd2037fe640 1 --2- 172.21.15.79:0/2005007886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd204104250 0x7fd2041993d0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fd1f800e9f0 tx=0x7fd1f800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:36.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.674+0000 7fd2017fa640 1 -- 172.21.15.79:0/2005007886 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f800cd80 con 0x7fd204104250 2024-08-20T01:54:36.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.674+0000 7fd20a561640 1 -- 172.21.15.79:0/2005007886 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd20419f230 con 0x7fd204104250 2024-08-20T01:54:36.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.674+0000 7fd2017fa640 1 -- 172.21.15.79:0/2005007886 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd1f80054b0 con 0x7fd204104250 2024-08-20T01:54:36.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.674+0000 7fd2017fa640 1 -- 172.21.15.79:0/2005007886 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8010430 con 0x7fd204104250 2024-08-20T01:54:36.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.674+0000 7fd20a561640 1 -- 172.21.15.79:0/2005007886 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2041a58f0 con 0x7fd204104250 2024-08-20T01:54:36.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.677+0000 7fd20c95a740 1 Processor -- start 2024-08-20T01:54:36.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.677+0000 7fd20c95a740 1 -- start start 2024-08-20T01:54:36.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.677+0000 7fd20c95a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc580e8830 0x55cc580e8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:36.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.677+0000 7fd20c95a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc580e9150 0x55cc580f4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:36.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.677+0000 7fd20c95a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc580f50e0 0x55cc580f74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:36.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.677+0000 7fd20c95a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55cc5805f8e0 con 0x55cc580e9150 2024-08-20T01:54:36.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.677+0000 7fd20c95a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55cc5804ede0 con 0x55cc580f50e0 2024-08-20T01:54:36.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.677+0000 7fd20c95a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55cc58052e20 con 0x55cc580e8830 2024-08-20T01:54:36.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.677+0000 7fd203fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc580e9150 0x55cc580f4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:36.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.677+0000 7fd203fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc580e9150 0x55cc580f4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49660/0 (socket says 172.21.15.79:49660) 2024-08-20T01:54:36.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.677+0000 7fd203fff640 1 -- 172.21.15.79:0/435023207 learned_addr learned my addr 172.21.15.79:0/435023207 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:36.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.677+0000 7fd208afe640 1 --2- 172.21.15.79:0/435023207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc580e8830 0x55cc580e8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:36.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.678+0000 7fd203fff640 1 -- 172.21.15.79:0/435023207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc580e8830 msgr2=0x55cc580e8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:36.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.678+0000 7fd203fff640 1 --2- 172.21.15.79:0/435023207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc580e8830 0x55cc580e8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:36.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.678+0000 7fd203fff640 1 -- 172.21.15.79:0/435023207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc580f50e0 msgr2=0x55cc580f74d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T01:54:36.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.678+0000 7fd203fff640 1 --2- 172.21.15.79:0/435023207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc580f50e0 0x55cc580f74d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:36.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.678+0000 7fd203fff640 1 -- 172.21.15.79:0/435023207 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc57dae650 con 0x55cc580e9150 2024-08-20T01:54:36.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.678+0000 7fd2017fa640 1 -- 172.21.15.79:0/2005007886 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fd1f80046c0 con 0x7fd204104250 2024-08-20T01:54:36.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.678+0000 7fd203fff640 1 --2- 172.21.15.79:0/435023207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc580e9150 0x55cc580f4ba0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4009d20 tx=0x7fd1f4011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a3934f7baa64f5e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:36.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.678+0000 7fd1ea7fc640 1 -- 172.21.15.79:0/435023207 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f4004230 con 0x55cc580e9150 2024-08-20T01:54:36.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.678+0000 7fd1ea7fc640 1 -- 172.21.15.79:0/435023207 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd1f40043d0 con 0x55cc580e9150 2024-08-20T01:54:36.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.678+0000 7fd1ea7fc640 1 -- 172.21.15.79:0/435023207 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f4019750 con 0x55cc580e9150 2024-08-20T01:54:36.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.679+0000 7fd2017fa640 1 --2- 172.21.15.79:0/2005007886 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd1ec0b3bd0 0x7fd1ec0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:36.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.679+0000 7fd208afe640 1 --2- 172.21.15.79:0/2005007886 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd1ec0b3bd0 0x7fd1ec0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:36.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.679+0000 7fd2017fa640 1 -- 172.21.15.79:0/2005007886 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fd1f80e3f30 con 0x7fd204104250 2024-08-20T01:54:36.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.679+0000 7fd20c95a740 1 -- 172.21.15.79:0/435023207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc580e9150 msgr2=0x55cc580f4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:36.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.679+0000 7fd20c95a740 1 --2- 172.21.15.79:0/435023207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc580e9150 0x55cc580f4ba0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4009d20 tx=0x7fd1f4011810 comp rx=0 tx=0).stop 2024-08-20T01:54:36.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.679+0000 7fd20c95a740 1 -- 172.21.15.79:0/435023207 shutdown_connections 2024-08-20T01:54:36.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.679+0000 7fd20c95a740 1 --2- 172.21.15.79:0/435023207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc580f50e0 0x55cc580f74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:36.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.679+0000 7fd20c95a740 1 --2- 172.21.15.79:0/435023207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc580e9150 0x55cc580f4ba0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:36.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.679+0000 7fd20c95a740 1 --2- 172.21.15.79:0/435023207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc580e8830 0x55cc580e8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:36.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.679+0000 7fd20c95a740 1 -- 172.21.15.79:0/435023207 >> 172.21.15.79:0/435023207 conn(0x55cc580e6660 msgr2=0x55cc580e7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:36.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.679+0000 7fd208afe640 1 --2- 172.21.15.79:0/2005007886 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd1ec0b3bd0 0x7fd1ec0b6090 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc006010 tx=0x7fd1fc009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:36.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.679+0000 7fd20c95a740 1 -- 172.21.15.79:0/435023207 shutdown_connections 2024-08-20T01:54:36.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.679+0000 7fd20c95a740 1 -- 172.21.15.79:0/435023207 wait complete. 2024-08-20T01:54:36.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.680+0000 7fd20c95a740 1 -- start start 2024-08-20T01:54:36.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.680+0000 7fd20c95a740 1 Processor -- start 2024-08-20T01:54:36.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.680+0000 7fd20c95a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc580e8830 0x55cc580f2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:36.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.680+0000 7fd20c95a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc580e9150 0x55cc580f25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:36.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.680+0000 7fd20c95a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc580f50e0 0x55cc580f2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:36.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.680+0000 7fd20c95a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55cc57eb1700 con 0x55cc580e8830 2024-08-20T01:54:36.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.680+0000 7fd20c95a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55cc57fd57c0 con 0x55cc580e9150 2024-08-20T01:54:36.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.680+0000 7fd20c95a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55cc580f7d90 con 0x55cc580f50e0 2024-08-20T01:54:36.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.680+0000 7fd20c95a740 10 client.0 _ll_register_callbacks cb 0x55cc580486b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:54:36.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.680+0000 7fd203fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc580e8830 0x55cc580f2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:36.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.680+0000 7fd203fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc580e8830 0x55cc580f2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49670/0 (socket says 172.21.15.79:49670) 2024-08-20T01:54:36.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.680+0000 7fd203fff640 1 -- 172.21.15.79:0/1654991218 learned_addr learned my addr 172.21.15.79:0/1654991218 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:36.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.680+0000 7fd2037fe640 1 --2- 172.21.15.79:0/1654991218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc580e9150 0x55cc580f25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:36.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.680+0000 7fd208afe640 1 --2- 172.21.15.79:0/1654991218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc580f50e0 0x55cc580f2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:36.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.680+0000 7fd203fff640 1 -- 172.21.15.79:0/1654991218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc580f50e0 msgr2=0x55cc580f2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:36.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.681+0000 7fd203fff640 1 --2- 172.21.15.79:0/1654991218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc580f50e0 0x55cc580f2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:36.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.681+0000 7fd203fff640 1 -- 172.21.15.79:0/1654991218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc580e9150 msgr2=0x55cc580f25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:36.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.681+0000 7fd203fff640 1 --2- 172.21.15.79:0/1654991218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc580e9150 0x55cc580f25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:36.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.681+0000 7fd203fff640 1 -- 172.21.15.79:0/1654991218 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc58101170 con 0x55cc580e8830 2024-08-20T01:54:36.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.681+0000 7fd2037fe640 1 --2- 172.21.15.79:0/1654991218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc580e9150 0x55cc580f25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:54:36.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.681+0000 7fd208afe640 1 --2- 172.21.15.79:0/1654991218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc580f50e0 0x55cc580f2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:54:36.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.681+0000 7fd203fff640 1 --2- 172.21.15.79:0/1654991218 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc580e8830 0x55cc580f2060 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4005320 tx=0x7fd1f4005350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3f50c988a4b0713 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:36.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.681+0000 7fd1e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:54:36.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.681+0000 7fd1e37fe640 1 -- 172.21.15.79:0/1654991218 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f4027070 con 0x55cc580e8830 2024-08-20T01:54:36.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.681+0000 7fd1e37fe640 1 -- 172.21.15.79:0/1654991218 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fd1f40037f0 con 0x55cc580e8830 2024-08-20T01:54:36.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.681+0000 7fd20c95a740 1 -- 172.21.15.79:0/1654991218 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cc57ffe100 con 0x55cc580e8830 2024-08-20T01:54:36.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.681+0000 7fd1e37fe640 1 -- 172.21.15.79:0/1654991218 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fd1f4033050 con 0x55cc580e8830 2024-08-20T01:54:36.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.681+0000 7fd20c95a740 10 client.19812 fetch_fsmap learned FSMap version 71 2024-08-20T01:54:36.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.681+0000 7fd20c95a740 1 -- 172.21.15.79:0/1654991218 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55cc58103b00 con 0x55cc580e8830 2024-08-20T01:54:36.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.682+0000 7fd1e37fe640 1 -- 172.21.15.79:0/1654991218 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55cc57ffe100 con 0x55cc580e8830 2024-08-20T01:54:36.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.682+0000 7fd1e37fe640 1 -- 172.21.15.79:0/1654991218 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 71) ==== 8374+0+0 (secure 0 0 0) 0x7fd1f40048c0 con 0x55cc580e8830 2024-08-20T01:54:36.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.682+0000 7fd20c95a740 10 client.19812 fetch_fsmap finished waiting for FSMap version 71 2024-08-20T01:54:36.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.682+0000 7fd20c95a740 10 client.19812 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:54:36.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.682+0000 7fd20c95a740 20 client.19812 populate_metadata read hostname 'smithi079' 2024-08-20T01:54:36.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.682+0000 7fd20c95a740 1 --2- 172.21.15.79:0/1654991218 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55cc58104f10 0x55cc58107300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:36.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.682+0000 7fd20c95a740 4 client.19812 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:54:36.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.682+0000 7fd20c95a740 1 -- 172.21.15.79:0/1654991218 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc58061830 con 0x55cc58104f10 2024-08-20T01:54:36.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.682+0000 7fd2037fe640 1 --2- 172.21.15.79:0/1654991218 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55cc58104f10 0x55cc58107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:36.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.682+0000 7fd2037fe640 1 --2- 172.21.15.79:0/1654991218 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55cc58104f10 0x55cc58107300 crc :-1 s=READY pgs=350 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f894386533b80ef5 server_cookie=f55767a7a5527ab6 in_seq=0 out_seq=0 2024-08-20T01:54:36.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.682+0000 7fd1e37fe640 10 client.19812 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:54:36.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.683+0000 7fd1e37fe640 1 -- 172.21.15.79:0/1654991218 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cc58061830 con 0x55cc58104f10 2024-08-20T01:54:36.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.683+0000 7fd1e37fe640 10 client.19812 handle_command_reply: tid=0 2024-08-20T01:54:36.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.683+0000 7fd20c95a740 1 client.19812 shutdown 2024-08-20T01:54:36.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.683+0000 7fd20c95a740 1 -- 172.21.15.79:0/1654991218 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc580e8830 msgr2=0x55cc580f2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:36.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.683+0000 7fd20c95a740 1 --2- 172.21.15.79:0/1654991218 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc580e8830 0x55cc580f2060 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4005320 tx=0x7fd1f4005350 comp rx=0 tx=0).stop 2024-08-20T01:54:36.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.683+0000 7fd20c95a740 1 -- 172.21.15.79:0/1654991218 shutdown_connections 2024-08-20T01:54:36.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.683+0000 7fd20c95a740 1 --2- 172.21.15.79:0/1654991218 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55cc58104f10 0x55cc58107300 crc :-1 s=READY pgs=350 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:36.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.683+0000 7fd20c95a740 1 --2- 172.21.15.79:0/1654991218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc580f50e0 0x55cc580f2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:36.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.683+0000 7fd20c95a740 1 --2- 172.21.15.79:0/1654991218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc580e9150 0x55cc580f25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:36.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.683+0000 7fd1e37fe640 0 client.19812 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:54:36.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.683+0000 7fd20c95a740 1 --2- 172.21.15.79:0/1654991218 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc580e8830 0x55cc580f2060 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:36.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.683+0000 7fd20c95a740 1 -- 172.21.15.79:0/1654991218 >> 172.21.15.79:0/1654991218 conn(0x55cc580e6660 msgr2=0x55cc580ec200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:36.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.683+0000 7fd20c95a740 1 -- 172.21.15.79:0/1654991218 shutdown_connections 2024-08-20T01:54:36.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.684+0000 7fd20c95a740 1 -- 172.21.15.79:0/1654991218 wait complete. 2024-08-20T01:54:36.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.684+0000 7fd20c95a740 20 client.19812 trim_cache size 0 max 16384 2024-08-20T01:54:36.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.701+0000 7fd20c95a740 1 Processor -- start 2024-08-20T01:54:36.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.701+0000 7fd20c95a740 1 -- start start 2024-08-20T01:54:36.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.701+0000 7fd20c95a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc580e8830 0x55cc580ec930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:36.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.701+0000 7fd20c95a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc580e9150 0x55cc580f3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:36.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.701+0000 7fd20c95a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc580f50e0 0x55cc580fd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:36.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.701+0000 7fd20c95a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd2041adff0 con 0x55cc580e9150 2024-08-20T01:54:36.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.701+0000 7fd20c95a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd2041afb60 con 0x55cc580e8830 2024-08-20T01:54:36.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.701+0000 7fd20c95a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd2041ae6f0 con 0x55cc580f50e0 2024-08-20T01:54:36.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.701+0000 7fd2037fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc580e9150 0x55cc580f3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:36.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.701+0000 7fd2037fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc580e9150 0x55cc580f3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49680/0 (socket says 172.21.15.79:49680) 2024-08-20T01:54:36.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.701+0000 7fd2037fe640 1 -- 172.21.15.79:0/914592779 learned_addr learned my addr 172.21.15.79:0/914592779 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:36.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.701+0000 7fd203fff640 1 --2- 172.21.15.79:0/914592779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc580e8830 0x55cc580ec930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:36.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.701+0000 7fd2037fe640 1 -- 172.21.15.79:0/914592779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc580f50e0 msgr2=0x55cc580fd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:36.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.701+0000 7fd2037fe640 1 --2- 172.21.15.79:0/914592779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc580f50e0 0x55cc580fd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:36.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.701+0000 7fd2037fe640 1 -- 172.21.15.79:0/914592779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc580e8830 msgr2=0x55cc580ec930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:36.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.701+0000 7fd2037fe640 1 --2- 172.21.15.79:0/914592779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc580e8830 0x55cc580ec930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:36.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.701+0000 7fd2037fe640 1 -- 172.21.15.79:0/914592779 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc58107670 con 0x55cc580e9150 2024-08-20T01:54:36.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.701+0000 7fd2037fe640 1 --2- 172.21.15.79:0/914592779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc580e9150 0x55cc580f3da0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fd1f80aab90 tx=0x7fd1f800cfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8c6edbc152bad40 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:36.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.702+0000 7fd1e9ffb640 1 -- 172.21.15.79:0/914592779 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f80c02d0 con 0x55cc580e9150 2024-08-20T01:54:36.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.702+0000 7fd1e9ffb640 1 -- 172.21.15.79:0/914592779 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd1f80be030 con 0x55cc580e9150 2024-08-20T01:54:36.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.702+0000 7fd1e9ffb640 1 -- 172.21.15.79:0/914592779 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f80b3d10 con 0x55cc580e9150 2024-08-20T01:54:36.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.702+0000 7fd20c95a740 1 -- 172.21.15.79:0/914592779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc580e9150 msgr2=0x55cc580f3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:36.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.702+0000 7fd20c95a740 1 --2- 172.21.15.79:0/914592779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc580e9150 0x55cc580f3da0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fd1f80aab90 tx=0x7fd1f800cfa0 comp rx=0 tx=0).stop 2024-08-20T01:54:36.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.702+0000 7fd20c95a740 1 -- 172.21.15.79:0/914592779 shutdown_connections 2024-08-20T01:54:36.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.702+0000 7fd20c95a740 1 --2- 172.21.15.79:0/914592779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc580f50e0 0x55cc580fd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:36.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.702+0000 7fd20c95a740 1 --2- 172.21.15.79:0/914592779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc580e9150 0x55cc580f3da0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:36.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.702+0000 7fd20c95a740 1 --2- 172.21.15.79:0/914592779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc580e8830 0x55cc580ec930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:36.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.702+0000 7fd20c95a740 1 -- 172.21.15.79:0/914592779 >> 172.21.15.79:0/914592779 conn(0x55cc580e6660 msgr2=0x55cc580f3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:36.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.702+0000 7fd20c95a740 1 -- 172.21.15.79:0/914592779 shutdown_connections 2024-08-20T01:54:36.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.702+0000 7fd20c95a740 1 -- 172.21.15.79:0/914592779 wait complete. 2024-08-20T01:54:36.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.703+0000 7fd20c95a740 1 -- start start 2024-08-20T01:54:36.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.703+0000 7fd20c95a740 1 Processor -- start 2024-08-20T01:54:36.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.703+0000 7fd20c95a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc580e8830 0x55cc580efc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:36.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.703+0000 7fd20c95a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc580e9150 0x55cc580ee2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:36.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.703+0000 7fd20c95a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc580f50e0 0x55cc580ee950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:36.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.703+0000 7fd20c95a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd2041af490 con 0x55cc580e8830 2024-08-20T01:54:36.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.703+0000 7fd20c95a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd2041aedc0 con 0x55cc580f50e0 2024-08-20T01:54:36.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.703+0000 7fd20c95a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd2041abfd0 con 0x55cc580e9150 2024-08-20T01:54:36.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.703+0000 7fd20c95a740 10 client.0 _ll_register_callbacks cb 0x7fd1f8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:54:36.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.703+0000 7fd203fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc580e8830 0x55cc580efc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:36.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.703+0000 7fd203fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc580e8830 0x55cc580efc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49694/0 (socket says 172.21.15.79:49694) 2024-08-20T01:54:36.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.703+0000 7fd203fff640 1 -- 172.21.15.79:0/1879201340 learned_addr learned my addr 172.21.15.79:0/1879201340 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:54:36.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.703+0000 7fd208afe640 1 --2- 172.21.15.79:0/1879201340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc580f50e0 0x55cc580ee950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:36.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.703+0000 7fd203fff640 1 -- 172.21.15.79:0/1879201340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc580e9150 msgr2=0x55cc580ee2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:36.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.703+0000 7fd2037fe640 1 --2- 172.21.15.79:0/1879201340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc580e9150 0x55cc580ee2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:36.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.704+0000 7fd203fff640 1 --2- 172.21.15.79:0/1879201340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc580e9150 0x55cc580ee2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:36.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.704+0000 7fd203fff640 1 -- 172.21.15.79:0/1879201340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc580f50e0 msgr2=0x55cc580ee950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:54:36.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.704+0000 7fd203fff640 1 --2- 172.21.15.79:0/1879201340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc580f50e0 0x55cc580ee950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:36.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.704+0000 7fd203fff640 1 -- 172.21.15.79:0/1879201340 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc58171ac0 con 0x55cc580e8830 2024-08-20T01:54:36.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.704+0000 7fd203fff640 1 --2- 172.21.15.79:0/1879201340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc580e8830 0x55cc580efc60 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fd1f40057c0 tx=0x7fd1f4005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7762ba2a080218f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:54:36.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.704+0000 7fd1e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:54:36.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.704+0000 7fd1e37fe640 1 -- 172.21.15.79:0/1879201340 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f403c060 con 0x55cc580e8830 2024-08-20T01:54:36.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.704+0000 7fd20c95a740 1 -- 172.21.15.79:0/1879201340 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1f80be030 con 0x55cc580e8830 2024-08-20T01:54:36.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.704+0000 7fd1e37fe640 1 -- 172.21.15.79:0/1879201340 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fd1f4019a00 con 0x55cc580e8830 2024-08-20T01:54:36.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.704+0000 7fd1e37fe640 1 -- 172.21.15.79:0/1879201340 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fd1f4027070 con 0x55cc580e8830 2024-08-20T01:54:36.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.704+0000 7fd20c95a740 10 client.19818 fetch_fsmap learned FSMap version 71 2024-08-20T01:54:36.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.704+0000 7fd20c95a740 1 -- 172.21.15.79:0/1879201340 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55cc58172cd0 con 0x55cc580e8830 2024-08-20T01:54:36.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.704+0000 7fd1e37fe640 1 -- 172.21.15.79:0/1879201340 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd1f80be030 con 0x55cc580e8830 2024-08-20T01:54:36.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.704+0000 7fd1e37fe640 1 -- 172.21.15.79:0/1879201340 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 71) ==== 8374+0+0 (secure 0 0 0) 0x7fd1f4019c00 con 0x55cc580e8830 2024-08-20T01:54:36.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.704+0000 7fd20c95a740 10 client.19818 fetch_fsmap finished waiting for FSMap version 71 2024-08-20T01:54:36.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.704+0000 7fd20c95a740 10 client.19818 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:54:36.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.704+0000 7fd20c95a740 20 client.19818 populate_metadata read hostname 'smithi079' 2024-08-20T01:54:36.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.704+0000 7fd20c95a740 1 --2- 172.21.15.79:0/1879201340 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55cc58173480 0x55cc581758a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:54:36.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.704+0000 7fd20c95a740 4 client.19818 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:54:36.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.704+0000 7fd20c95a740 1 -- 172.21.15.79:0/1879201340 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cc5805d2d0 con 0x55cc58173480 2024-08-20T01:54:36.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.705+0000 7fd2037fe640 1 --2- 172.21.15.79:0/1879201340 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55cc58173480 0x55cc581758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:54:36.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.705+0000 7fd1e37fe640 10 client.19818 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:54:36.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.705+0000 7fd2037fe640 1 --2- 172.21.15.79:0/1879201340 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55cc58173480 0x55cc581758a0 crc :-1 s=READY pgs=351 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed93440e8868dd85 server_cookie=a6cbb9a676e695e9 in_seq=0 out_seq=0 2024-08-20T01:54:36.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.705+0000 7fd1e37fe640 1 -- 172.21.15.79:0/1879201340 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x55cc5805d2d0 con 0x55cc58173480 2024-08-20T01:54:36.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.705+0000 7fd1e37fe640 10 client.19818 handle_command_reply: tid=0 2024-08-20T01:54:36.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.705+0000 7fd20c95a740 1 client.19818 shutdown 2024-08-20T01:54:36.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.705+0000 7fd20c95a740 1 -- 172.21.15.79:0/1879201340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc580e8830 msgr2=0x55cc580efc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:36.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.705+0000 7fd20c95a740 1 --2- 172.21.15.79:0/1879201340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc580e8830 0x55cc580efc60 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fd1f40057c0 tx=0x7fd1f4005f90 comp rx=0 tx=0).stop 2024-08-20T01:54:36.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.705+0000 7fd20c95a740 1 -- 172.21.15.79:0/1879201340 shutdown_connections 2024-08-20T01:54:36.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.705+0000 7fd20c95a740 1 --2- 172.21.15.79:0/1879201340 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55cc58173480 0x55cc581758a0 crc :-1 s=READY pgs=351 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:36.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.705+0000 7fd20c95a740 1 --2- 172.21.15.79:0/1879201340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc580f50e0 0x55cc580ee950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:36.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.705+0000 7fd20c95a740 1 --2- 172.21.15.79:0/1879201340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc580e9150 0x55cc580ee2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:36.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.705+0000 7fd1e37fe640 0 client.19818 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:54:36.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.705+0000 7fd20c95a740 1 --2- 172.21.15.79:0/1879201340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc580e8830 0x55cc580efc60 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:36.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.705+0000 7fd20c95a740 1 -- 172.21.15.79:0/1879201340 >> 172.21.15.79:0/1879201340 conn(0x55cc580e6660 msgr2=0x55cc580e5720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:36.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.705+0000 7fd20c95a740 1 -- 172.21.15.79:0/1879201340 shutdown_connections 2024-08-20T01:54:36.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.705+0000 7fd20c95a740 1 -- 172.21.15.79:0/1879201340 wait complete. 2024-08-20T01:54:36.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.706+0000 7fd20c95a740 20 client.19818 trim_cache size 0 max 16384 2024-08-20T01:54:36.715 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:54:36.715 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "scrub active (0 inodes in the stack)", 2024-08-20T01:54:36.715 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": { 2024-08-20T01:54:36.715 INFO:teuthology.orchestra.run.smithi079.stdout: "58c9d287-c4aa-4ee7-b70f-6bc2529e40fa": { 2024-08-20T01:54:36.715 INFO:teuthology.orchestra.run.smithi079.stdout: "path": "/", 2024-08-20T01:54:36.715 INFO:teuthology.orchestra.run.smithi079.stdout: "tag": "58c9d287-c4aa-4ee7-b70f-6bc2529e40fa", 2024-08-20T01:54:36.715 INFO:teuthology.orchestra.run.smithi079.stdout: "options": "recursive,force" 2024-08-20T01:54:36.715 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:54:36.715 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:54:36.715 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:54:36.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.706+0000 7fd20a561640 1 -- 172.21.15.79:0/2005007886 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd1ec0b3bd0 msgr2=0x7fd1ec0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:36.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.706+0000 7fd20a561640 1 --2- 172.21.15.79:0/2005007886 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd1ec0b3bd0 0x7fd1ec0b6090 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc006010 tx=0x7fd1fc009360 comp rx=0 tx=0).stop 2024-08-20T01:54:36.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.706+0000 7fd20a561640 1 -- 172.21.15.79:0/2005007886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd204104250 msgr2=0x7fd2041993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:54:36.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.706+0000 7fd20a561640 1 --2- 172.21.15.79:0/2005007886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd204104250 0x7fd2041993d0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fd1f800e9f0 tx=0x7fd1f800edf0 comp rx=0 tx=0).stop 2024-08-20T01:54:36.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.706+0000 7fd20a561640 1 -- 172.21.15.79:0/2005007886 shutdown_connections 2024-08-20T01:54:36.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.706+0000 7fd20a561640 1 --2- 172.21.15.79:0/2005007886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd20410ce00 0x7fd20419e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:36.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.706+0000 7fd20a561640 1 --2- 172.21.15.79:0/2005007886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd204104250 0x7fd2041993d0 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:36.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.706+0000 7fd20a561640 1 --2- 172.21.15.79:0/2005007886 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd1ec0b3bd0 0x7fd1ec0b6090 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:36.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.706+0000 7fd20a561640 1 --2- 172.21.15.79:0/2005007886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd204103850 0x7fd204198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:54:36.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.706+0000 7fd20a561640 1 -- 172.21.15.79:0/2005007886 >> 172.21.15.79:0/2005007886 conn(0x7fd2040fd400 msgr2=0x7fd2040fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:54:36.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.706+0000 7fd20a561640 1 -- 172.21.15.79:0/2005007886 shutdown_connections 2024-08-20T01:54:36.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:54:36.706+0000 7fd20a561640 1 -- 172.21.15.79:0/2005007886 wait complete. 2024-08-20T01:54:36.732 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.0... 2024-08-20T01:54:36.732 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-08-20T01:54:36.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:36 smithi081 ceph-mon[22209]: pgmap v865: 97 pgs: 97 active+clean; 4.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 19 op/s 2024-08-20T01:54:36.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:36 smithi081 ceph-mon[22209]: scrub queued for path: / 2024-08-20T01:54:36.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:36 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:54:36.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:36 smithi081 ceph-mon[22209]: scrub summary: active paths [/] 2024-08-20T01:54:37.135 DEBUG:teuthology.parallel:result is None 2024-08-20T01:54:37.135 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-08-20T01:54:37.621 INFO:tasks.cephfs.filesystem:scrub status for tag:58c9d287-c4aa-4ee7-b70f-6bc2529e40fa - {'path': '/', 'tag': '58c9d287-c4aa-4ee7-b70f-6bc2529e40fa', 'options': 'recursive,force'} 2024-08-20T01:54:38.181 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-08-20T01:54:38.181 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-08-20T01:54:38.192 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi079.front.sepia.ceph.com 2024-08-20T01:54:38.201 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-08-20T01:54:38.210 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-08-20T01:54:38.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:38 smithi079 ceph-mon[18656]: pgmap v866: 97 pgs: 97 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 19 op/s 2024-08-20T01:54:38.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:38 smithi175 ceph-mon[22392]: pgmap v866: 97 pgs: 97 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 19 op/s 2024-08-20T01:54:38.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:38 smithi081 ceph-mon[22209]: pgmap v866: 97 pgs: 97 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 19 op/s 2024-08-20T01:54:40.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:40 smithi175 ceph-mon[22392]: pgmap v867: 97 pgs: 97 active+clean; 4.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 24 op/s 2024-08-20T01:54:40.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:40 smithi079 ceph-mon[18656]: pgmap v867: 97 pgs: 97 active+clean; 4.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 24 op/s 2024-08-20T01:54:40.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:40 smithi081 ceph-mon[22209]: pgmap v867: 97 pgs: 97 active+clean; 4.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 24 op/s 2024-08-20T01:54:41.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:41 smithi175 ceph-mon[22392]: scrub summary: idle+waiting paths [/] 2024-08-20T01:54:41.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:41 smithi079 ceph-mon[18656]: scrub summary: idle+waiting paths [/] 2024-08-20T01:54:41.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:41 smithi081 ceph-mon[22209]: scrub summary: idle+waiting paths [/] 2024-08-20T01:54:42.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:42 smithi175 ceph-mon[22392]: pgmap v868: 97 pgs: 97 active+clean; 4.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 KiB/s wr, 27 op/s 2024-08-20T01:54:42.679 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:42 smithi081 ceph-mon[22209]: pgmap v868: 97 pgs: 97 active+clean; 4.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 KiB/s wr, 27 op/s 2024-08-20T01:54:42.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:42 smithi079 ceph-mon[18656]: pgmap v868: 97 pgs: 97 active+clean; 4.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 KiB/s wr, 27 op/s 2024-08-20T01:54:44.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:44 smithi175 ceph-mon[22392]: pgmap v869: 97 pgs: 97 active+clean; 3.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.4 KiB/s wr, 27 op/s 2024-08-20T01:54:44.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:44 smithi079 ceph-mon[18656]: pgmap v869: 97 pgs: 97 active+clean; 3.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.4 KiB/s wr, 27 op/s 2024-08-20T01:54:44.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:44 smithi081 ceph-mon[22209]: pgmap v869: 97 pgs: 97 active+clean; 3.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.4 KiB/s wr, 27 op/s 2024-08-20T01:54:45.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:45 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:54:45.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:45 smithi175 ceph-mon[22392]: scrub summary: idle 2024-08-20T01:54:45.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:45 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:54:45.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:45 smithi079 ceph-mon[18656]: scrub summary: idle 2024-08-20T01:54:45.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:45 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:54:45.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:45 smithi081 ceph-mon[22209]: scrub summary: idle 2024-08-20T01:54:46.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:46 smithi175 ceph-mon[22392]: pgmap v870: 97 pgs: 97 active+clean; 3.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.0 KiB/s wr, 29 op/s 2024-08-20T01:54:46.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:46 smithi079 ceph-mon[18656]: pgmap v870: 97 pgs: 97 active+clean; 3.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.0 KiB/s wr, 29 op/s 2024-08-20T01:54:46.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:46 smithi081 ceph-mon[22209]: pgmap v870: 97 pgs: 97 active+clean; 3.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.0 KiB/s wr, 29 op/s 2024-08-20T01:54:48.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:48 smithi175 ceph-mon[22392]: pgmap v871: 97 pgs: 97 active+clean; 3.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 8.3 KiB/s wr, 30 op/s 2024-08-20T01:54:48.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:48 smithi079 ceph-mon[18656]: pgmap v871: 97 pgs: 97 active+clean; 3.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 8.3 KiB/s wr, 30 op/s 2024-08-20T01:54:48.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:48 smithi081 ceph-mon[22209]: pgmap v871: 97 pgs: 97 active+clean; 3.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 8.3 KiB/s wr, 30 op/s 2024-08-20T01:54:50.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:50 smithi175 ceph-mon[22392]: pgmap v872: 97 pgs: 97 active+clean; 3.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 8.9 KiB/s wr, 32 op/s 2024-08-20T01:54:50.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:50 smithi079 ceph-mon[18656]: pgmap v872: 97 pgs: 97 active+clean; 3.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 8.9 KiB/s wr, 32 op/s 2024-08-20T01:54:50.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:50 smithi081 ceph-mon[22209]: pgmap v872: 97 pgs: 97 active+clean; 3.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 8.9 KiB/s wr, 32 op/s 2024-08-20T01:54:52.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:52 smithi175 ceph-mon[22392]: pgmap v873: 97 pgs: 97 active+clean; 3.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 8.3 KiB/s wr, 27 op/s 2024-08-20T01:54:52.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:52 smithi079 ceph-mon[18656]: pgmap v873: 97 pgs: 97 active+clean; 3.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 8.3 KiB/s wr, 27 op/s 2024-08-20T01:54:52.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:52 smithi081 ceph-mon[22209]: pgmap v873: 97 pgs: 97 active+clean; 3.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 8.3 KiB/s wr, 27 op/s 2024-08-20T01:54:54.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:54 smithi175 ceph-mon[22392]: pgmap v874: 97 pgs: 97 active+clean; 3.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.2 KiB/s wr, 23 op/s 2024-08-20T01:54:54.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:54 smithi079 ceph-mon[18656]: pgmap v874: 97 pgs: 97 active+clean; 3.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.2 KiB/s wr, 23 op/s 2024-08-20T01:54:54.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:54 smithi081 ceph-mon[22209]: pgmap v874: 97 pgs: 97 active+clean; 3.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.2 KiB/s wr, 23 op/s 2024-08-20T01:54:56.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:56 smithi175 ceph-mon[22392]: pgmap v875: 97 pgs: 97 active+clean; 3.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.9 KiB/s wr, 24 op/s 2024-08-20T01:54:56.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:56 smithi079 ceph-mon[18656]: pgmap v875: 97 pgs: 97 active+clean; 3.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.9 KiB/s wr, 24 op/s 2024-08-20T01:54:56.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:56 smithi081 ceph-mon[22209]: pgmap v875: 97 pgs: 97 active+clean; 3.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.9 KiB/s wr, 24 op/s 2024-08-20T01:54:58.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:54:58 smithi175 ceph-mon[22392]: pgmap v876: 97 pgs: 97 active+clean; 3.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.2 KiB/s wr, 22 op/s 2024-08-20T01:54:58.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:54:58 smithi079 ceph-mon[18656]: pgmap v876: 97 pgs: 97 active+clean; 3.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.2 KiB/s wr, 22 op/s 2024-08-20T01:54:58.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:54:58 smithi081 ceph-mon[22209]: pgmap v876: 97 pgs: 97 active+clean; 3.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.2 KiB/s wr, 22 op/s 2024-08-20T01:55:00.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:00 smithi175 ceph-mon[22392]: pgmap v877: 97 pgs: 97 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.1 KiB/s wr, 24 op/s 2024-08-20T01:55:00.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:00 smithi079 ceph-mon[18656]: pgmap v877: 97 pgs: 97 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.1 KiB/s wr, 24 op/s 2024-08-20T01:55:00.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:00 smithi081 ceph-mon[22209]: pgmap v877: 97 pgs: 97 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.1 KiB/s wr, 24 op/s 2024-08-20T01:55:02.640 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:02 smithi175 ceph-mon[22392]: pgmap v878: 97 pgs: 97 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.4 KiB/s wr, 21 op/s 2024-08-20T01:55:02.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:02 smithi079 ceph-mon[18656]: pgmap v878: 97 pgs: 97 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.4 KiB/s wr, 21 op/s 2024-08-20T01:55:02.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:02 smithi081 ceph-mon[22209]: pgmap v878: 97 pgs: 97 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.4 KiB/s wr, 21 op/s 2024-08-20T01:55:04.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:04 smithi175 ceph-mon[22392]: pgmap v879: 97 pgs: 97 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.3 KiB/s wr, 21 op/s 2024-08-20T01:55:04.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:04 smithi079 ceph-mon[18656]: pgmap v879: 97 pgs: 97 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.3 KiB/s wr, 21 op/s 2024-08-20T01:55:04.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:04 smithi081 ceph-mon[22209]: pgmap v879: 97 pgs: 97 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.3 KiB/s wr, 21 op/s 2024-08-20T01:55:06.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:06 smithi175 ceph-mon[22392]: pgmap v880: 97 pgs: 97 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 2.4 KiB/s wr, 22 op/s 2024-08-20T01:55:06.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:06 smithi079 ceph-mon[18656]: pgmap v880: 97 pgs: 97 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 2.4 KiB/s wr, 22 op/s 2024-08-20T01:55:06.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:06 smithi081 ceph-mon[22209]: pgmap v880: 97 pgs: 97 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 2.4 KiB/s wr, 22 op/s 2024-08-20T01:55:07.622 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T01:55:07.883 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:55:08.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.401+0000 7fdde8290640 1 -- 172.21.15.79:0/267307233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdde0107d20 msgr2=0x7fdde010e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:08.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.401+0000 7fdde8290640 1 --2- 172.21.15.79:0/267307233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdde0107d20 0x7fdde010e520 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fddd8009ca0 tx=0x7fddd802a8c0 comp rx=0 tx=0).stop 2024-08-20T01:55:08.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.401+0000 7fdde8290640 1 -- 172.21.15.79:0/267307233 shutdown_connections 2024-08-20T01:55:08.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.401+0000 7fdde8290640 1 --2- 172.21.15.79:0/267307233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdde0107d20 0x7fdde010e520 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:08.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.401+0000 7fdde8290640 1 --2- 172.21.15.79:0/267307233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdde01073a0 0x7fdde01077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:08.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.401+0000 7fdde8290640 1 --2- 172.21.15.79:0/267307233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdde0101990 0x7fdde0101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:08.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.401+0000 7fdde8290640 1 -- 172.21.15.79:0/267307233 >> 172.21.15.79:0/267307233 conn(0x7fdde00fd400 msgr2=0x7fdde00ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:08.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.401+0000 7fdde8290640 1 -- 172.21.15.79:0/267307233 shutdown_connections 2024-08-20T01:55:08.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.401+0000 7fdde8290640 1 -- 172.21.15.79:0/267307233 wait complete. 2024-08-20T01:55:08.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.401+0000 7fdde8290640 1 Processor -- start 2024-08-20T01:55:08.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.401+0000 7fdde8290640 1 -- start start 2024-08-20T01:55:08.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.402+0000 7fdde8290640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdde0101990 0x7fdde0198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:08.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.402+0000 7fdde8290640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdde01073a0 0x7fdde01993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:08.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.402+0000 7fdde8290640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdde0107d20 0x7fdde019e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:08.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.402+0000 7fdde8290640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdde01118e0 con 0x7fdde0101990 2024-08-20T01:55:08.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.402+0000 7fdde8290640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdde0111760 con 0x7fdde0107d20 2024-08-20T01:55:08.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.402+0000 7fdde8290640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdde0111a60 con 0x7fdde01073a0 2024-08-20T01:55:08.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.402+0000 7fdde602c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdde0101990 0x7fdde0198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:08.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.402+0000 7fdde602c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdde0101990 0x7fdde0198e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50498/0 (socket says 172.21.15.79:50498) 2024-08-20T01:55:08.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.402+0000 7fdde602c640 1 -- 172.21.15.79:0/2872373862 learned_addr learned my addr 172.21.15.79:0/2872373862 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:08.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.402+0000 7fdde682d640 1 --2- 172.21.15.79:0/2872373862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdde0107d20 0x7fdde019e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:08.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.402+0000 7fdde582b640 1 --2- 172.21.15.79:0/2872373862 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdde01073a0 0x7fdde01993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:08.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.402+0000 7fdde602c640 1 -- 172.21.15.79:0/2872373862 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdde01073a0 msgr2=0x7fdde01993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:08.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.402+0000 7fdde602c640 1 --2- 172.21.15.79:0/2872373862 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdde01073a0 0x7fdde01993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:08.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.402+0000 7fdde602c640 1 -- 172.21.15.79:0/2872373862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdde0107d20 msgr2=0x7fdde019e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:08.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.402+0000 7fdde602c640 1 --2- 172.21.15.79:0/2872373862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdde0107d20 0x7fdde019e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:08.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.402+0000 7fdde602c640 1 -- 172.21.15.79:0/2872373862 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdde019ef20 con 0x7fdde0101990 2024-08-20T01:55:08.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.402+0000 7fdde682d640 1 --2- 172.21.15.79:0/2872373862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdde0107d20 0x7fdde019e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:55:08.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.402+0000 7fdde602c640 1 --2- 172.21.15.79:0/2872373862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdde0101990 0x7fdde0198e70 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fdddc00e9f0 tx=0x7fdddc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:08.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.403+0000 7fddd77fe640 1 -- 172.21.15.79:0/2872373862 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdddc00cd80 con 0x7fdde0101990 2024-08-20T01:55:08.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.403+0000 7fddd77fe640 1 -- 172.21.15.79:0/2872373862 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdddc0108c0 con 0x7fdde0101990 2024-08-20T01:55:08.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.403+0000 7fdde8290640 1 -- 172.21.15.79:0/2872373862 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdde019f210 con 0x7fdde0101990 2024-08-20T01:55:08.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.403+0000 7fddd77fe640 1 -- 172.21.15.79:0/2872373862 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdddc0187c0 con 0x7fdde0101990 2024-08-20T01:55:08.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.403+0000 7fdde8290640 1 -- 172.21.15.79:0/2872373862 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdde01a5aa0 con 0x7fdde0101990 2024-08-20T01:55:08.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.405+0000 7fddea689740 1 Processor -- start 2024-08-20T01:55:08.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.405+0000 7fddd77fe640 1 -- 172.21.15.79:0/2872373862 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fdddc018980 con 0x7fdde0101990 2024-08-20T01:55:08.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.405+0000 7fddea689740 1 -- start start 2024-08-20T01:55:08.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.406+0000 7fddea689740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb0c72d830 0x55fb0c72dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:08.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.406+0000 7fddea689740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fb0c72e150 0x55fb0c739ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:08.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.406+0000 7fddea689740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb0c73a0e0 0x55fb0c73c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:08.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.406+0000 7fddea689740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fb0c6a48e0 con 0x55fb0c72e150 2024-08-20T01:55:08.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.406+0000 7fddea689740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55fb0c693de0 con 0x55fb0c73a0e0 2024-08-20T01:55:08.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.406+0000 7fddea689740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55fb0c697e20 con 0x55fb0c72d830 2024-08-20T01:55:08.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.406+0000 7fdde602c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fb0c72e150 0x55fb0c739ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:08.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.406+0000 7fdde582b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb0c73a0e0 0x55fb0c73c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:08.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.406+0000 7fdde602c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fb0c72e150 0x55fb0c739ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50508/0 (socket says 172.21.15.79:50508) 2024-08-20T01:55:08.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.406+0000 7fdde602c640 1 -- 172.21.15.79:0/2297862622 learned_addr learned my addr 172.21.15.79:0/2297862622 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:08.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.406+0000 7fdde582b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb0c73a0e0 0x55fb0c73c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:60746/0 (socket says 172.21.15.79:60746) 2024-08-20T01:55:08.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.406+0000 7fdde682d640 1 --2- 172.21.15.79:0/2297862622 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb0c72d830 0x55fb0c72dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:08.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.406+0000 7fdde582b640 1 -- 172.21.15.79:0/2297862622 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb0c72d830 msgr2=0x55fb0c72dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:08.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.406+0000 7fdde582b640 1 --2- 172.21.15.79:0/2297862622 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb0c72d830 0x55fb0c72dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:08.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.406+0000 7fdde582b640 1 -- 172.21.15.79:0/2297862622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fb0c72e150 msgr2=0x55fb0c739ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:08.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.406+0000 7fdde582b640 1 --2- 172.21.15.79:0/2297862622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fb0c72e150 0x55fb0c739ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:08.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.406+0000 7fdde582b640 1 -- 172.21.15.79:0/2297862622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb0c3f3650 con 0x55fb0c73a0e0 2024-08-20T01:55:08.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.406+0000 7fddd77fe640 1 --2- 172.21.15.79:0/2872373862 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fddcc0b3c50 0x7fddcc0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:08.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.407+0000 7fdde682d640 1 --2- 172.21.15.79:0/2872373862 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fddcc0b3c50 0x7fddcc0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:08.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.407+0000 7fddd77fe640 1 -- 172.21.15.79:0/2872373862 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fdddc0e3f50 con 0x7fdde0101990 2024-08-20T01:55:08.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.407+0000 7fdde582b640 1 --2- 172.21.15.79:0/2297862622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb0c73a0e0 0x55fb0c73c4d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fddd0009bf0 tx=0x7fddd0011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=deda6d843131eae2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:08.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.407+0000 7fddd4de6640 1 -- 172.21.15.79:0/2297862622 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd001e070 con 0x55fb0c73a0e0 2024-08-20T01:55:08.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.407+0000 7fddd4de6640 1 -- 172.21.15.79:0/2297862622 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fddd0009da0 con 0x55fb0c73a0e0 2024-08-20T01:55:08.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.407+0000 7fddd4de6640 1 -- 172.21.15.79:0/2297862622 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd0018730 con 0x55fb0c73a0e0 2024-08-20T01:55:08.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.408+0000 7fddea689740 1 -- 172.21.15.79:0/2297862622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb0c73a0e0 msgr2=0x55fb0c73c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:08.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.408+0000 7fddea689740 1 --2- 172.21.15.79:0/2297862622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb0c73a0e0 0x55fb0c73c4d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fddd0009bf0 tx=0x7fddd0011810 comp rx=0 tx=0).stop 2024-08-20T01:55:08.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.408+0000 7fdde682d640 1 --2- 172.21.15.79:0/2872373862 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fddcc0b3c50 0x7fddcc0b6110 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fddd8006010 tx=0x7fddd8009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:08.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.408+0000 7fddea689740 1 -- 172.21.15.79:0/2297862622 shutdown_connections 2024-08-20T01:55:08.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.408+0000 7fddea689740 1 --2- 172.21.15.79:0/2297862622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb0c73a0e0 0x55fb0c73c4d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:08.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.408+0000 7fddea689740 1 --2- 172.21.15.79:0/2297862622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fb0c72e150 0x55fb0c739ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:08.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.408+0000 7fddea689740 1 --2- 172.21.15.79:0/2297862622 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb0c72d830 0x55fb0c72dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:08.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.408+0000 7fddea689740 1 -- 172.21.15.79:0/2297862622 >> 172.21.15.79:0/2297862622 conn(0x55fb0c72b660 msgr2=0x55fb0c72c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:08.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.408+0000 7fddea689740 1 -- 172.21.15.79:0/2297862622 shutdown_connections 2024-08-20T01:55:08.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.408+0000 7fddea689740 1 -- 172.21.15.79:0/2297862622 wait complete. 2024-08-20T01:55:08.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.408+0000 7fddea689740 1 -- start start 2024-08-20T01:55:08.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.408+0000 7fddea689740 1 Processor -- start 2024-08-20T01:55:08.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.408+0000 7fddea689740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb0c72d830 0x55fb0c737050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:08.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.408+0000 7fddea689740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb0c72e150 0x55fb0c737590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:08.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.408+0000 7fddea689740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fb0c73a0e0 0x55fb0c737ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:08.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.409+0000 7fddea689740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fb0c4f6700 con 0x55fb0c73a0e0 2024-08-20T01:55:08.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.409+0000 7fddea689740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55fb0c61a7c0 con 0x55fb0c72d830 2024-08-20T01:55:08.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.409+0000 7fddea689740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55fb0c73cd90 con 0x55fb0c72e150 2024-08-20T01:55:08.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.409+0000 7fddea689740 10 client.0 _ll_register_callbacks cb 0x55fb0c68d6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:55:08.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.409+0000 7fdde602c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb0c72d830 0x55fb0c737050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:08.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.409+0000 7fdde582b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb0c72e150 0x55fb0c737590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:08.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.409+0000 7fdde682d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fb0c73a0e0 0x55fb0c737ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:08.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.409+0000 7fdde602c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb0c72d830 0x55fb0c737050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:60760/0 (socket says 172.21.15.79:60760) 2024-08-20T01:55:08.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.409+0000 7fdde602c640 1 -- 172.21.15.79:0/2888415336 learned_addr learned my addr 172.21.15.79:0/2888415336 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:08.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.409+0000 7fdde582b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb0c72e150 0x55fb0c737590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:39852/0 (socket says 172.21.15.79:39852) 2024-08-20T01:55:08.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.409+0000 7fdde602c640 1 -- 172.21.15.79:0/2888415336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb0c72e150 msgr2=0x55fb0c737590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:08.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.409+0000 7fdde602c640 1 --2- 172.21.15.79:0/2888415336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb0c72e150 0x55fb0c737590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:08.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.409+0000 7fdde602c640 1 -- 172.21.15.79:0/2888415336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fb0c73a0e0 msgr2=0x55fb0c737ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:08.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.409+0000 7fdde602c640 1 --2- 172.21.15.79:0/2888415336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fb0c73a0e0 0x55fb0c737ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:08.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.409+0000 7fdde602c640 1 -- 172.21.15.79:0/2888415336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb0c746110 con 0x55fb0c72d830 2024-08-20T01:55:08.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.409+0000 7fdde582b640 1 --2- 172.21.15.79:0/2888415336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb0c72e150 0x55fb0c737590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:55:08.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.409+0000 7fdde682d640 1 --2- 172.21.15.79:0/2888415336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fb0c73a0e0 0x55fb0c737ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:55:08.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.409+0000 7fdde602c640 1 --2- 172.21.15.79:0/2888415336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb0c72d830 0x55fb0c737050 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fdddc0aaef0 tx=0x7fdddc0aad30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a417007f33fcd14 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:08.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.409+0000 7fddc9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:55:08.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.409+0000 7fddc9ffb640 1 -- 172.21.15.79:0/2888415336 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdddc0aaa70 con 0x55fb0c72d830 2024-08-20T01:55:08.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.409+0000 7fddc9ffb640 1 -- 172.21.15.79:0/2888415336 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fdddc010d50 con 0x55fb0c72d830 2024-08-20T01:55:08.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.409+0000 7fddea689740 1 -- 172.21.15.79:0/2888415336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fb0c643100 con 0x55fb0c72d830 2024-08-20T01:55:08.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.410+0000 7fddc9ffb640 1 -- 172.21.15.79:0/2888415336 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fdddc018c70 con 0x55fb0c72d830 2024-08-20T01:55:08.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.410+0000 7fddea689740 10 client.28910 fetch_fsmap learned FSMap version 71 2024-08-20T01:55:08.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.410+0000 7fddea689740 1 -- 172.21.15.79:0/2888415336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55fb0c748ac0 con 0x55fb0c72d830 2024-08-20T01:55:08.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.410+0000 7fddc9ffb640 1 -- 172.21.15.79:0/2888415336 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55fb0c643100 con 0x55fb0c72d830 2024-08-20T01:55:08.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.410+0000 7fddc9ffb640 1 -- 172.21.15.79:0/2888415336 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 71) ==== 8374+0+0 (secure 0 0 0) 0x7fdddc0b3ad0 con 0x55fb0c72d830 2024-08-20T01:55:08.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.410+0000 7fddea689740 10 client.28910 fetch_fsmap finished waiting for FSMap version 71 2024-08-20T01:55:08.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.410+0000 7fddea689740 10 client.28910 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:55:08.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.410+0000 7fddea689740 20 client.28910 populate_metadata read hostname 'smithi079' 2024-08-20T01:55:08.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.410+0000 7fddea689740 1 --2- 172.21.15.79:0/2888415336 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55fb0c74a020 0x55fb0c74c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:08.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.410+0000 7fddea689740 4 client.28910 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:55:08.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.410+0000 7fddea689740 1 -- 172.21.15.79:0/2888415336 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb0c6a6830 con 0x55fb0c74a020 2024-08-20T01:55:08.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.410+0000 7fdde582b640 1 --2- 172.21.15.79:0/2888415336 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55fb0c74a020 0x55fb0c74c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:08.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.411+0000 7fdde582b640 1 --2- 172.21.15.79:0/2888415336 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55fb0c74a020 0x55fb0c74c410 crc :-1 s=READY pgs=352 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27f1618690aeb0a6 server_cookie=9fd3bb948c33e78f in_seq=0 out_seq=0 2024-08-20T01:55:08.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.411+0000 7fddc9ffb640 10 client.28910 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:55:08.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.411+0000 7fddc9ffb640 1 -- 172.21.15.79:0/2888415336 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fb0c6a6830 con 0x55fb0c74a020 2024-08-20T01:55:08.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.411+0000 7fddc9ffb640 10 client.28910 handle_command_reply: tid=0 2024-08-20T01:55:08.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.411+0000 7fddea689740 1 client.28910 shutdown 2024-08-20T01:55:08.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.411+0000 7fddea689740 1 -- 172.21.15.79:0/2888415336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb0c72d830 msgr2=0x55fb0c737050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:08.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.411+0000 7fddea689740 1 --2- 172.21.15.79:0/2888415336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb0c72d830 0x55fb0c737050 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fdddc0aaef0 tx=0x7fdddc0aad30 comp rx=0 tx=0).stop 2024-08-20T01:55:08.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.411+0000 7fddea689740 1 -- 172.21.15.79:0/2888415336 shutdown_connections 2024-08-20T01:55:08.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.411+0000 7fddea689740 1 --2- 172.21.15.79:0/2888415336 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55fb0c74a020 0x55fb0c74c410 crc :-1 s=READY pgs=352 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:08.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.411+0000 7fddea689740 1 --2- 172.21.15.79:0/2888415336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fb0c73a0e0 0x55fb0c737ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:08.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.411+0000 7fddea689740 1 --2- 172.21.15.79:0/2888415336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb0c72e150 0x55fb0c737590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:08.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.411+0000 7fddc9ffb640 0 client.28910 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:55:08.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.411+0000 7fddea689740 1 --2- 172.21.15.79:0/2888415336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb0c72d830 0x55fb0c737050 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:08.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.411+0000 7fddea689740 1 -- 172.21.15.79:0/2888415336 >> 172.21.15.79:0/2888415336 conn(0x55fb0c72b660 msgr2=0x55fb0c731200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:08.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.411+0000 7fddea689740 1 -- 172.21.15.79:0/2888415336 shutdown_connections 2024-08-20T01:55:08.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.411+0000 7fddea689740 1 -- 172.21.15.79:0/2888415336 wait complete. 2024-08-20T01:55:08.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.412+0000 7fddea689740 20 client.28910 trim_cache size 0 max 16384 2024-08-20T01:55:08.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.429+0000 7fddea689740 1 Processor -- start 2024-08-20T01:55:08.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.429+0000 7fddea689740 1 -- start start 2024-08-20T01:55:08.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.429+0000 7fddea689740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb0c72d830 0x55fb0c7368e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:08.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.429+0000 7fddea689740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fb0c72e150 0x55fb0c7318d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:08.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.429+0000 7fddea689740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb0c73a0e0 0x55fb0c751ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:08.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.429+0000 7fddea689740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdde01abe60 con 0x55fb0c72e150 2024-08-20T01:55:08.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.429+0000 7fddea689740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdde01ad9d0 con 0x55fb0c72d830 2024-08-20T01:55:08.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.429+0000 7fddea689740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdde01ac560 con 0x55fb0c73a0e0 2024-08-20T01:55:08.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.429+0000 7fdde582b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fb0c72e150 0x55fb0c7318d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:08.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.429+0000 7fdde582b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fb0c72e150 0x55fb0c7318d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50518/0 (socket says 172.21.15.79:50518) 2024-08-20T01:55:08.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.429+0000 7fdde582b640 1 -- 172.21.15.79:0/1994139535 learned_addr learned my addr 172.21.15.79:0/1994139535 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:08.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.429+0000 7fdde682d640 1 --2- 172.21.15.79:0/1994139535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb0c73a0e0 0x55fb0c751ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:08.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.429+0000 7fdde602c640 1 --2- 172.21.15.79:0/1994139535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb0c72d830 0x55fb0c7368e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:08.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.430+0000 7fdde582b640 1 -- 172.21.15.79:0/1994139535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb0c73a0e0 msgr2=0x55fb0c751ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:08.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.430+0000 7fdde582b640 1 --2- 172.21.15.79:0/1994139535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb0c73a0e0 0x55fb0c751ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:08.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.430+0000 7fdde582b640 1 -- 172.21.15.79:0/1994139535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb0c72d830 msgr2=0x55fb0c7368e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:08.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.430+0000 7fdde582b640 1 --2- 172.21.15.79:0/1994139535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb0c72d830 0x55fb0c7368e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:08.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.430+0000 7fdde582b640 1 -- 172.21.15.79:0/1994139535 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb0c74c780 con 0x55fb0c72e150 2024-08-20T01:55:08.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.430+0000 7fdde582b640 1 --2- 172.21.15.79:0/1994139535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fb0c72e150 0x55fb0c7318d0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fddd0014040 tx=0x7fddd0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=658d85c4c65de8b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:08.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.430+0000 7fddcbfff640 1 -- 172.21.15.79:0/1994139535 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd001e040 con 0x55fb0c72e150 2024-08-20T01:55:08.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.430+0000 7fddcbfff640 1 -- 172.21.15.79:0/1994139535 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fddd002a070 con 0x55fb0c72e150 2024-08-20T01:55:08.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.430+0000 7fddcbfff640 1 -- 172.21.15.79:0/1994139535 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd0019b00 con 0x55fb0c72e150 2024-08-20T01:55:08.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.431+0000 7fddea689740 1 -- 172.21.15.79:0/1994139535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fb0c72e150 msgr2=0x55fb0c7318d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:08.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.431+0000 7fddea689740 1 --2- 172.21.15.79:0/1994139535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fb0c72e150 0x55fb0c7318d0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fddd0014040 tx=0x7fddd0009b60 comp rx=0 tx=0).stop 2024-08-20T01:55:08.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.431+0000 7fddea689740 1 -- 172.21.15.79:0/1994139535 shutdown_connections 2024-08-20T01:55:08.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.431+0000 7fddea689740 1 --2- 172.21.15.79:0/1994139535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb0c73a0e0 0x55fb0c751ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:08.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.431+0000 7fddea689740 1 --2- 172.21.15.79:0/1994139535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fb0c72e150 0x55fb0c7318d0 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:08.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.431+0000 7fddea689740 1 --2- 172.21.15.79:0/1994139535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb0c72d830 0x55fb0c7368e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:08.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.431+0000 7fddea689740 1 -- 172.21.15.79:0/1994139535 >> 172.21.15.79:0/1994139535 conn(0x55fb0c72b660 msgr2=0x55fb0c72cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:08.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.431+0000 7fddea689740 1 -- 172.21.15.79:0/1994139535 shutdown_connections 2024-08-20T01:55:08.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.431+0000 7fddea689740 1 -- 172.21.15.79:0/1994139535 wait complete. 2024-08-20T01:55:08.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.432+0000 7fddea689740 1 -- start start 2024-08-20T01:55:08.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.432+0000 7fddea689740 1 Processor -- start 2024-08-20T01:55:08.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.432+0000 7fddea689740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb0c72d830 0x55fb0c73cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:08.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.432+0000 7fddea689740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb0c72e150 0x55fb0c73d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:08.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.432+0000 7fddea689740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fb0c73a0e0 0x55fb0c73da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:08.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.432+0000 7fddea689740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdde01ad300 con 0x55fb0c73a0e0 2024-08-20T01:55:08.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.432+0000 7fddea689740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdde01acc30 con 0x55fb0c72e150 2024-08-20T01:55:08.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.432+0000 7fddea689740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdde01a9e40 con 0x55fb0c72d830 2024-08-20T01:55:08.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.432+0000 7fddea689740 10 client.0 _ll_register_callbacks cb 0x7fdddc00cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:55:08.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.432+0000 7fdde582b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb0c72e150 0x55fb0c73d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:08.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.432+0000 7fdde582b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb0c72e150 0x55fb0c73d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:60780/0 (socket says 172.21.15.79:60780) 2024-08-20T01:55:08.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.432+0000 7fdde582b640 1 -- 172.21.15.79:0/3807266274 learned_addr learned my addr 172.21.15.79:0/3807266274 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:08.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.432+0000 7fdde682d640 1 --2- 172.21.15.79:0/3807266274 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fb0c73a0e0 0x55fb0c73da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:08.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.432+0000 7fdde602c640 1 --2- 172.21.15.79:0/3807266274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb0c72d830 0x55fb0c73cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:08.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.432+0000 7fdde582b640 1 -- 172.21.15.79:0/3807266274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb0c72d830 msgr2=0x55fb0c73cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:08.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.432+0000 7fdde582b640 1 --2- 172.21.15.79:0/3807266274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb0c72d830 0x55fb0c73cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:08.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.432+0000 7fdde582b640 1 -- 172.21.15.79:0/3807266274 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fb0c73a0e0 msgr2=0x55fb0c73da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:08.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.432+0000 7fdde582b640 1 --2- 172.21.15.79:0/3807266274 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fb0c73a0e0 0x55fb0c73da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:08.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.433+0000 7fdde582b640 1 -- 172.21.15.79:0/3807266274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb0c7b2e20 con 0x55fb0c72e150 2024-08-20T01:55:08.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.433+0000 7fdde582b640 1 --2- 172.21.15.79:0/3807266274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb0c72e150 0x55fb0c73d520 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fddd00095f0 tx=0x7fddd0009500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5100bf0ccc331b4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:08.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.433+0000 7fddc9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:55:08.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.433+0000 7fddc9ffb640 1 -- 172.21.15.79:0/3807266274 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd0038060 con 0x55fb0c72e150 2024-08-20T01:55:08.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.433+0000 7fddc9ffb640 1 -- 172.21.15.79:0/3807266274 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fddd00053c0 con 0x55fb0c72e150 2024-08-20T01:55:08.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.433+0000 7fddea689740 1 -- 172.21.15.79:0/3807266274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fddd002a070 con 0x55fb0c72e150 2024-08-20T01:55:08.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.433+0000 7fddc9ffb640 1 -- 172.21.15.79:0/3807266274 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fddd001e070 con 0x55fb0c72e150 2024-08-20T01:55:08.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.433+0000 7fddea689740 10 client.28916 fetch_fsmap learned FSMap version 71 2024-08-20T01:55:08.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.433+0000 7fddea689740 1 -- 172.21.15.79:0/3807266274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55fb0c7b4130 con 0x55fb0c72e150 2024-08-20T01:55:08.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.433+0000 7fddc9ffb640 1 -- 172.21.15.79:0/3807266274 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fddd002a070 con 0x55fb0c72e150 2024-08-20T01:55:08.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.433+0000 7fddc9ffb640 1 -- 172.21.15.79:0/3807266274 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 71) ==== 8374+0+0 (secure 0 0 0) 0x7fddd0003680 con 0x55fb0c72e150 2024-08-20T01:55:08.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.434+0000 7fddea689740 10 client.28916 fetch_fsmap finished waiting for FSMap version 71 2024-08-20T01:55:08.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.434+0000 7fddea689740 10 client.28916 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:55:08.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.434+0000 7fddea689740 20 client.28916 populate_metadata read hostname 'smithi079' 2024-08-20T01:55:08.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.434+0000 7fddea689740 1 --2- 172.21.15.79:0/3807266274 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55fb0c7b4690 0x55fb0c7b6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:08.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.434+0000 7fddea689740 4 client.28916 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T01:55:08.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.434+0000 7fddea689740 1 -- 172.21.15.79:0/3807266274 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fb0c6a22d0 con 0x55fb0c7b4690 2024-08-20T01:55:08.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.434+0000 7fdde602c640 1 --2- 172.21.15.79:0/3807266274 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55fb0c7b4690 0x55fb0c7b6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:08.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.434+0000 7fdde602c640 1 --2- 172.21.15.79:0/3807266274 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55fb0c7b4690 0x55fb0c7b6ab0 crc :-1 s=READY pgs=353 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58b69e9697f23c99 server_cookie=bf4c1f7bc0205f42 in_seq=0 out_seq=0 2024-08-20T01:55:08.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.434+0000 7fddc9ffb640 10 client.28916 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:55:08.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.434+0000 7fddc9ffb640 1 -- 172.21.15.79:0/3807266274 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55fb0c6a22d0 con 0x55fb0c7b4690 2024-08-20T01:55:08.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.434+0000 7fddc9ffb640 10 client.28916 handle_command_reply: tid=0 2024-08-20T01:55:08.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.434+0000 7fddea689740 1 client.28916 shutdown 2024-08-20T01:55:08.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.434+0000 7fddea689740 1 -- 172.21.15.79:0/3807266274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb0c72e150 msgr2=0x55fb0c73d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:08.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.434+0000 7fddea689740 1 --2- 172.21.15.79:0/3807266274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb0c72e150 0x55fb0c73d520 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fddd00095f0 tx=0x7fddd0009500 comp rx=0 tx=0).stop 2024-08-20T01:55:08.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.434+0000 7fddea689740 1 -- 172.21.15.79:0/3807266274 shutdown_connections 2024-08-20T01:55:08.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.434+0000 7fddea689740 1 --2- 172.21.15.79:0/3807266274 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55fb0c7b4690 0x55fb0c7b6ab0 crc :-1 s=READY pgs=353 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:08.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.434+0000 7fddea689740 1 --2- 172.21.15.79:0/3807266274 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fb0c73a0e0 0x55fb0c73da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:08.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.434+0000 7fddea689740 1 --2- 172.21.15.79:0/3807266274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb0c72e150 0x55fb0c73d520 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:08.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.434+0000 7fddc9ffb640 0 client.28916 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:55:08.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.434+0000 7fddea689740 1 --2- 172.21.15.79:0/3807266274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb0c72d830 0x55fb0c73cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:08.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.434+0000 7fddea689740 1 -- 172.21.15.79:0/3807266274 >> 172.21.15.79:0/3807266274 conn(0x55fb0c72b660 msgr2=0x55fb0c736fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:08.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.435+0000 7fddea689740 1 -- 172.21.15.79:0/3807266274 shutdown_connections 2024-08-20T01:55:08.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.435+0000 7fddea689740 1 -- 172.21.15.79:0/3807266274 wait complete. 2024-08-20T01:55:08.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.435+0000 7fddea689740 20 client.28916 trim_cache size 0 max 16384 2024-08-20T01:55:08.447 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:55:08.447 INFO:teuthology.orchestra.run.smithi079.stdout: "status": "no active scrubs running", 2024-08-20T01:55:08.447 INFO:teuthology.orchestra.run.smithi079.stdout: "scrubs": {} 2024-08-20T01:55:08.448 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:55:08.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.435+0000 7fdde8290640 1 -- 172.21.15.79:0/2872373862 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fddcc0b3c50 msgr2=0x7fddcc0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:08.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.435+0000 7fdde8290640 1 --2- 172.21.15.79:0/2872373862 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fddcc0b3c50 0x7fddcc0b6110 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fddd8006010 tx=0x7fddd8009360 comp rx=0 tx=0).stop 2024-08-20T01:55:08.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.435+0000 7fdde8290640 1 -- 172.21.15.79:0/2872373862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdde0101990 msgr2=0x7fdde0198e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:08.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.435+0000 7fdde8290640 1 --2- 172.21.15.79:0/2872373862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdde0101990 0x7fdde0198e70 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fdddc00e9f0 tx=0x7fdddc00eeb0 comp rx=0 tx=0).stop 2024-08-20T01:55:08.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.435+0000 7fdde8290640 1 -- 172.21.15.79:0/2872373862 shutdown_connections 2024-08-20T01:55:08.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.435+0000 7fdde8290640 1 --2- 172.21.15.79:0/2872373862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdde0107d20 0x7fdde019e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:08.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.435+0000 7fdde8290640 1 --2- 172.21.15.79:0/2872373862 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fddcc0b3c50 0x7fddcc0b6110 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:08.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.435+0000 7fdde8290640 1 --2- 172.21.15.79:0/2872373862 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdde01073a0 0x7fdde01993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:08.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.435+0000 7fdde8290640 1 --2- 172.21.15.79:0/2872373862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdde0101990 0x7fdde0198e70 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:08.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.435+0000 7fdde8290640 1 -- 172.21.15.79:0/2872373862 >> 172.21.15.79:0/2872373862 conn(0x7fdde00fd400 msgr2=0x7fdde006aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:08.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.436+0000 7fdde8290640 1 -- 172.21.15.79:0/2872373862 shutdown_connections 2024-08-20T01:55:08.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:08.436+0000 7fdde8290640 1 -- 172.21.15.79:0/2872373862 wait complete. 2024-08-20T01:55:08.604 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:08 smithi079 ceph-mon[18656]: pgmap v881: 97 pgs: 97 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 21 op/s 2024-08-20T01:55:08.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:08 smithi081 ceph-mon[22209]: pgmap v881: 97 pgs: 97 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 21 op/s 2024-08-20T01:55:08.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:08 smithi175 ceph-mon[22392]: pgmap v881: 97 pgs: 97 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 21 op/s 2024-08-20T01:55:09.344 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T01:55:09.344 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:55:09.604 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:55:10.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.087+0000 7fedee0c5640 1 -- 172.21.15.79:0/3301779583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fede8101990 msgr2=0x7fede8101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:10.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.087+0000 7fedee0c5640 1 --2- 172.21.15.79:0/3301779583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fede8101990 0x7fede8101d70 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fedd8009900 tx=0x7fedd802a410 comp rx=0 tx=0).stop 2024-08-20T01:55:10.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.087+0000 7fedee0c5640 1 -- 172.21.15.79:0/3301779583 shutdown_connections 2024-08-20T01:55:10.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.087+0000 7fedee0c5640 1 --2- 172.21.15.79:0/3301779583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fede8107d20 0x7fede810e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:10.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.087+0000 7fedee0c5640 1 --2- 172.21.15.79:0/3301779583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fede81073a0 0x7fede81077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:10.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.087+0000 7fedee0c5640 1 --2- 172.21.15.79:0/3301779583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fede8101990 0x7fede8101d70 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:10.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.087+0000 7fedee0c5640 1 -- 172.21.15.79:0/3301779583 >> 172.21.15.79:0/3301779583 conn(0x7fede80fd400 msgr2=0x7fede80ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:10.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.088+0000 7fedee0c5640 1 -- 172.21.15.79:0/3301779583 shutdown_connections 2024-08-20T01:55:10.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.088+0000 7fedee0c5640 1 -- 172.21.15.79:0/3301779583 wait complete. 2024-08-20T01:55:10.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.088+0000 7fedee0c5640 1 Processor -- start 2024-08-20T01:55:10.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.088+0000 7fedee0c5640 1 -- start start 2024-08-20T01:55:10.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.089+0000 7fedee0c5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fede8101990 0x7fede8199cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:10.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.089+0000 7fedee0c5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fede81073a0 0x7fede819a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:10.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.089+0000 7fedee0c5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fede8107d20 0x7fede819a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:10.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.089+0000 7fedee0c5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fede81118e0 con 0x7fede8107d20 2024-08-20T01:55:10.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.089+0000 7fedee0c5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fede8111760 con 0x7fede8101990 2024-08-20T01:55:10.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.089+0000 7fedee0c5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fede8111a60 con 0x7fede81073a0 2024-08-20T01:55:10.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.089+0000 7fede7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fede8107d20 0x7fede819a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:10.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.089+0000 7fede7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fede8107d20 0x7fede819a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50538/0 (socket says 172.21.15.79:50538) 2024-08-20T01:55:10.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.089+0000 7fede7fff640 1 -- 172.21.15.79:0/1116847768 learned_addr learned my addr 172.21.15.79:0/1116847768 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:10.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.089+0000 7fede77fe640 1 --2- 172.21.15.79:0/1116847768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fede8101990 0x7fede8199cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:10.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.089+0000 7fede6ffd640 1 --2- 172.21.15.79:0/1116847768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fede81073a0 0x7fede819a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:10.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.089+0000 7fede7fff640 1 -- 172.21.15.79:0/1116847768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fede81073a0 msgr2=0x7fede819a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:10.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.089+0000 7fede7fff640 1 --2- 172.21.15.79:0/1116847768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fede81073a0 0x7fede819a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:10.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.089+0000 7fede7fff640 1 -- 172.21.15.79:0/1116847768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fede8101990 msgr2=0x7fede8199cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:10.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.089+0000 7fede7fff640 1 --2- 172.21.15.79:0/1116847768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fede8101990 0x7fede8199cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:10.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.089+0000 7fede7fff640 1 -- 172.21.15.79:0/1116847768 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fede81a5090 con 0x7fede8107d20 2024-08-20T01:55:10.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.089+0000 7fede6ffd640 1 --2- 172.21.15.79:0/1116847768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fede81073a0 0x7fede819a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:55:10.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.089+0000 7fede7fff640 1 --2- 172.21.15.79:0/1116847768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fede8107d20 0x7fede819a750 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fede000cce0 tx=0x7fede000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:10.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.089+0000 7fede4ff9640 1 -- 172.21.15.79:0/1116847768 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede000f450 con 0x7fede8107d20 2024-08-20T01:55:10.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.089+0000 7fede4ff9640 1 -- 172.21.15.79:0/1116847768 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fede000fa80 con 0x7fede8107d20 2024-08-20T01:55:10.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.089+0000 7fedee0c5640 1 -- 172.21.15.79:0/1116847768 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fede81a5380 con 0x7fede8107d20 2024-08-20T01:55:10.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.090+0000 7fede4ff9640 1 -- 172.21.15.79:0/1116847768 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede0018ad0 con 0x7fede8107d20 2024-08-20T01:55:10.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.090+0000 7fedee0c5640 1 -- 172.21.15.79:0/1116847768 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fede81a5870 con 0x7fede8107d20 2024-08-20T01:55:10.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.090+0000 7fedee0c5640 1 -- 172.21.15.79:0/1116847768 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fede8101d70 con 0x7fede8107d20 2024-08-20T01:55:10.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.092+0000 7fede4ff9640 1 -- 172.21.15.79:0/1116847768 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fede000f5f0 con 0x7fede8107d20 2024-08-20T01:55:10.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.093+0000 7fede4ff9640 1 --2- 172.21.15.79:0/1116847768 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fedd00b3bd0 0x7fedd00b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:10.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.093+0000 7fede77fe640 1 --2- 172.21.15.79:0/1116847768 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fedd00b3bd0 0x7fedd00b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:10.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.093+0000 7fede4ff9640 1 -- 172.21.15.79:0/1116847768 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fede00e4470 con 0x7fede8107d20 2024-08-20T01:55:10.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.093+0000 7fede77fe640 1 --2- 172.21.15.79:0/1116847768 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fedd00b3bd0 0x7fedd00b6090 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fedd8006010 tx=0x7fedd8005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:10.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.095+0000 7fede4ff9640 1 -- 172.21.15.79:0/1116847768 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fede0014030 con 0x7fede8107d20 2024-08-20T01:55:10.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.307+0000 7fedee0c5640 1 -- 172.21.15.79:0/1116847768 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fede806abc0 con 0x7fede8107d20 2024-08-20T01:55:10.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.308+0000 7fede4ff9640 1 -- 172.21.15.79:0/1116847768 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+11977 (secure 0 0 0) 0x7fede00abb60 con 0x7fede8107d20 2024-08-20T01:55:10.311 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:55:10.311 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":71,"btime":"2024-08-20T01:54:19:232668+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14670,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/735082912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":735082912},{"type":"v1","addr":"172.21.15.79:6835","nonce":735082912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2150339873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2150339873},{"type":"v1","addr":"172.21.15.79:6837","nonce":2150339873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":71,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:34:55.133562+0000","modified":"2024-08-20T01:54:18.576580+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24539,"mds_1":24538,"mds_2":24523,"mds_3":24514,"mds_4":24512},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14724":{"gid":14724,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/1071242274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1071242274},{"type":"v1","addr":"172.21.15.79:6839","nonce":1071242274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14730":{"gid":14730,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6841/2448977611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":2448977611},{"type":"v1","addr":"172.21.15.79:6841","nonce":2448977611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/1257507005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1257507005},{"type":"v1","addr":"172.21.15.81:6833","nonce":1257507005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1499936216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1499936216},{"type":"v1","addr":"172.21.15.81:6835","nonce":1499936216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/1107229215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1107229215},{"type":"v1","addr":"172.21.15.175:6833","nonce":1107229215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6837/2073598870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2073598870},{"type":"v1","addr":"172.21.15.81:6837","nonce":2073598870}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/2552601173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2552601173},{"type":"v1","addr":"172.21.15.175:6835","nonce":2552601173}]},"join_fscid":-1,"export_targets":[0,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6837/1767284089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1767284089},{"type":"v1","addr":"172.21.15.175:6837","nonce":1767284089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/1331748742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1331748742},{"type":"v1","addr":"172.21.15.175:6839","nonce":1331748742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/4098410583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":4098410583},{"type":"v1","addr":"172.21.15.81:6839","nonce":4098410583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24539,"qdb_cluster":[24539,24523,24514,24538,24512]},"id":1}]} 2024-08-20T01:55:10.311 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 71 2024-08-20T01:55:10.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.310+0000 7fedee0c5640 1 -- 172.21.15.79:0/1116847768 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fedd00b3bd0 msgr2=0x7fedd00b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:10.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.310+0000 7fedee0c5640 1 --2- 172.21.15.79:0/1116847768 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fedd00b3bd0 0x7fedd00b6090 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fedd8006010 tx=0x7fedd8005e80 comp rx=0 tx=0).stop 2024-08-20T01:55:10.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.310+0000 7fedee0c5640 1 -- 172.21.15.79:0/1116847768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fede8107d20 msgr2=0x7fede819a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:10.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.310+0000 7fedee0c5640 1 --2- 172.21.15.79:0/1116847768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fede8107d20 0x7fede819a750 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fede000cce0 tx=0x7fede000a620 comp rx=0 tx=0).stop 2024-08-20T01:55:10.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.310+0000 7fedee0c5640 1 -- 172.21.15.79:0/1116847768 shutdown_connections 2024-08-20T01:55:10.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.310+0000 7fedee0c5640 1 --2- 172.21.15.79:0/1116847768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fede8107d20 0x7fede819a750 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:10.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.310+0000 7fedee0c5640 1 --2- 172.21.15.79:0/1116847768 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fedd00b3bd0 0x7fedd00b6090 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:10.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.310+0000 7fedee0c5640 1 --2- 172.21.15.79:0/1116847768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fede81073a0 0x7fede819a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:10.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.310+0000 7fedee0c5640 1 --2- 172.21.15.79:0/1116847768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fede8101990 0x7fede8199cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:10.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.310+0000 7fedee0c5640 1 -- 172.21.15.79:0/1116847768 >> 172.21.15.79:0/1116847768 conn(0x7fede80fd400 msgr2=0x7fede80feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:10.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.310+0000 7fedee0c5640 1 -- 172.21.15.79:0/1116847768 shutdown_connections 2024-08-20T01:55:10.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:10.310+0000 7fedee0c5640 1 -- 172.21.15.79:0/1116847768 wait complete. 2024-08-20T01:55:10.672 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:10 smithi079 ceph-mon[18656]: pgmap v882: 97 pgs: 97 active+clean; 2.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 23 op/s 2024-08-20T01:55:10.672 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:10 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/1116847768' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:55:10.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:10 smithi081 ceph-mon[22209]: pgmap v882: 97 pgs: 97 active+clean; 2.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 23 op/s 2024-08-20T01:55:10.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:10 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/1116847768' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:55:10.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:10 smithi175 ceph-mon[22392]: pgmap v882: 97 pgs: 97 active+clean; 2.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 23 op/s 2024-08-20T01:55:10.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:10 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/1116847768' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:55:11.025 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-20T01:55:11.274 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:55:11.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.732+0000 7fb5e35c1640 1 -- 172.21.15.79:0/176941932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5dc102ad0 msgr2=0x7fb5dc102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:11.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.732+0000 7fb5e35c1640 1 --2- 172.21.15.79:0/176941932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5dc102ad0 0x7fb5dc102eb0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc009900 tx=0x7fb5cc02a410 comp rx=0 tx=0).stop 2024-08-20T01:55:11.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.732+0000 7fb5e35c1640 1 -- 172.21.15.79:0/176941932 shutdown_connections 2024-08-20T01:55:11.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.732+0000 7fb5e35c1640 1 --2- 172.21.15.79:0/176941932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5dc108e60 0x7fb5dc10f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:11.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.732+0000 7fb5e35c1640 1 --2- 172.21.15.79:0/176941932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5dc1084e0 0x7fb5dc108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:11.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.732+0000 7fb5e35c1640 1 --2- 172.21.15.79:0/176941932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5dc102ad0 0x7fb5dc102eb0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:11.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.732+0000 7fb5e35c1640 1 -- 172.21.15.79:0/176941932 >> 172.21.15.79:0/176941932 conn(0x7fb5dc0fe540 msgr2=0x7fb5dc100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:11.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.732+0000 7fb5e35c1640 1 -- 172.21.15.79:0/176941932 shutdown_connections 2024-08-20T01:55:11.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.732+0000 7fb5e35c1640 1 -- 172.21.15.79:0/176941932 wait complete. 2024-08-20T01:55:11.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.733+0000 7fb5e35c1640 1 Processor -- start 2024-08-20T01:55:11.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.733+0000 7fb5e35c1640 1 -- start start 2024-08-20T01:55:11.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.733+0000 7fb5e35c1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5dc102ad0 0x7fb5dc198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:11.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.733+0000 7fb5e35c1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5dc1084e0 0x7fb5dc199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:11.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.733+0000 7fb5e35c1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5dc108e60 0x7fb5dc19e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:11.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.733+0000 7fb5e35c1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb5dc1129d0 con 0x7fb5dc102ad0 2024-08-20T01:55:11.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.733+0000 7fb5e35c1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb5dc112850 con 0x7fb5dc108e60 2024-08-20T01:55:11.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.733+0000 7fb5e35c1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb5dc112b50 con 0x7fb5dc1084e0 2024-08-20T01:55:11.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.733+0000 7fb5e135d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5dc102ad0 0x7fb5dc198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:11.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.733+0000 7fb5e135d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5dc102ad0 0x7fb5dc198ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57582/0 (socket says 172.21.15.79:57582) 2024-08-20T01:55:11.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.733+0000 7fb5e135d640 1 -- 172.21.15.79:0/1681622169 learned_addr learned my addr 172.21.15.79:0/1681622169 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:11.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.733+0000 7fb5e0b5c640 1 --2- 172.21.15.79:0/1681622169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5dc1084e0 0x7fb5dc199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:11.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.733+0000 7fb5e1b5e640 1 --2- 172.21.15.79:0/1681622169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5dc108e60 0x7fb5dc19e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:11.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.733+0000 7fb5e135d640 1 -- 172.21.15.79:0/1681622169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5dc1084e0 msgr2=0x7fb5dc199400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:11.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.733+0000 7fb5e135d640 1 --2- 172.21.15.79:0/1681622169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5dc1084e0 0x7fb5dc199400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:11.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.733+0000 7fb5e135d640 1 -- 172.21.15.79:0/1681622169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5dc108e60 msgr2=0x7fb5dc19e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:11.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.733+0000 7fb5e135d640 1 --2- 172.21.15.79:0/1681622169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5dc108e60 0x7fb5dc19e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:11.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.733+0000 7fb5e135d640 1 -- 172.21.15.79:0/1681622169 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5dc19ef70 con 0x7fb5dc102ad0 2024-08-20T01:55:11.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.733+0000 7fb5e135d640 1 --2- 172.21.15.79:0/1681622169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5dc102ad0 0x7fb5dc198ec0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc009230 tx=0x7fb5cc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:11.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.734+0000 7fb5d27fc640 1 -- 172.21.15.79:0/1681622169 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc03f030 con 0x7fb5dc102ad0 2024-08-20T01:55:11.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.734+0000 7fb5d27fc640 1 -- 172.21.15.79:0/1681622169 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb5cc003a80 con 0x7fb5dc102ad0 2024-08-20T01:55:11.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.734+0000 7fb5e35c1640 1 -- 172.21.15.79:0/1681622169 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5dc19f200 con 0x7fb5dc102ad0 2024-08-20T01:55:11.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.734+0000 7fb5d27fc640 1 -- 172.21.15.79:0/1681622169 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc035070 con 0x7fb5dc102ad0 2024-08-20T01:55:11.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.734+0000 7fb5e35c1640 1 -- 172.21.15.79:0/1681622169 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5dc1a5920 con 0x7fb5dc102ad0 2024-08-20T01:55:11.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.736+0000 7fb5e59ba740 1 Processor -- start 2024-08-20T01:55:11.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.736+0000 7fb5d27fc640 1 -- 172.21.15.79:0/1681622169 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb5cc042030 con 0x7fb5dc102ad0 2024-08-20T01:55:11.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.736+0000 7fb5e59ba740 1 -- start start 2024-08-20T01:55:11.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.737+0000 7fb5e59ba740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da60d5f880 0x55da60d5fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:11.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.737+0000 7fb5e59ba740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da60d601a0 0x55da60d6bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:11.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.737+0000 7fb5e59ba740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da60d6c130 0x55da60d6e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:11.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.737+0000 7fb5e59ba740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55da60cd6930 con 0x55da60d5f880 2024-08-20T01:55:11.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.737+0000 7fb5e59ba740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55da60cc5e30 con 0x55da60d6c130 2024-08-20T01:55:11.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.737+0000 7fb5e59ba740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55da60cc9e70 con 0x55da60d601a0 2024-08-20T01:55:11.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.737+0000 7fb5e1b5e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da60d5f880 0x55da60d5fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:11.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.737+0000 7fb5e1b5e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da60d5f880 0x55da60d5fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57598/0 (socket says 172.21.15.79:57598) 2024-08-20T01:55:11.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.737+0000 7fb5e1b5e640 1 -- 172.21.15.79:0/2035000371 learned_addr learned my addr 172.21.15.79:0/2035000371 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:11.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.737+0000 7fb5e0b5c640 1 --2- 172.21.15.79:0/2035000371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da60d6c130 0x55da60d6e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:11.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.737+0000 7fb5e135d640 1 --2- 172.21.15.79:0/2035000371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da60d601a0 0x55da60d6bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:11.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.737+0000 7fb5e1b5e640 1 -- 172.21.15.79:0/2035000371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da60d601a0 msgr2=0x55da60d6bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:11.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.737+0000 7fb5e1b5e640 1 --2- 172.21.15.79:0/2035000371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da60d601a0 0x55da60d6bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:11.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.737+0000 7fb5e1b5e640 1 -- 172.21.15.79:0/2035000371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da60d6c130 msgr2=0x55da60d6e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:11.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.737+0000 7fb5e1b5e640 1 --2- 172.21.15.79:0/2035000371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da60d6c130 0x55da60d6e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:11.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.737+0000 7fb5e1b5e640 1 -- 172.21.15.79:0/2035000371 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da60a25650 con 0x55da60d5f880 2024-08-20T01:55:11.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.737+0000 7fb5e0b5c640 1 --2- 172.21.15.79:0/2035000371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da60d6c130 0x55da60d6e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:55:11.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.737+0000 7fb5e1b5e640 1 --2- 172.21.15.79:0/2035000371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da60d5f880 0x55da60d5fc60 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fb5d40103a0 tx=0x7fb5d4010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f4dfdbcf5637165 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:11.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.738+0000 7fb5d27fc640 1 --2- 172.21.15.79:0/1681622169 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb5c80b3c50 0x7fb5c80b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:11.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.738+0000 7fb5c77fe640 1 -- 172.21.15.79:0/2035000371 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4016070 con 0x55da60d5f880 2024-08-20T01:55:11.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.738+0000 7fb5c77fe640 1 -- 172.21.15.79:0/2035000371 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb5d4004d20 con 0x55da60d5f880 2024-08-20T01:55:11.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.738+0000 7fb5c77fe640 1 -- 172.21.15.79:0/2035000371 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4005330 con 0x55da60d5f880 2024-08-20T01:55:11.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.738+0000 7fb5e135d640 1 --2- 172.21.15.79:0/1681622169 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb5c80b3c50 0x7fb5c80b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:11.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.738+0000 7fb5d27fc640 1 -- 172.21.15.79:0/1681622169 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fb5cc1041e0 con 0x7fb5dc102ad0 2024-08-20T01:55:11.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.738+0000 7fb5e59ba740 1 -- 172.21.15.79:0/2035000371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da60d5f880 msgr2=0x55da60d5fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:11.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.738+0000 7fb5e135d640 1 --2- 172.21.15.79:0/1681622169 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb5c80b3c50 0x7fb5c80b6110 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc102060 tx=0x7fb5cc031970 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:11.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.738+0000 7fb5e59ba740 1 --2- 172.21.15.79:0/2035000371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da60d5f880 0x55da60d5fc60 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fb5d40103a0 tx=0x7fb5d4010860 comp rx=0 tx=0).stop 2024-08-20T01:55:11.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.738+0000 7fb5e59ba740 1 -- 172.21.15.79:0/2035000371 shutdown_connections 2024-08-20T01:55:11.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.739+0000 7fb5e59ba740 1 --2- 172.21.15.79:0/2035000371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da60d6c130 0x55da60d6e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:11.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.739+0000 7fb5e59ba740 1 --2- 172.21.15.79:0/2035000371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da60d601a0 0x55da60d6bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:11.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.739+0000 7fb5e59ba740 1 --2- 172.21.15.79:0/2035000371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da60d5f880 0x55da60d5fc60 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:11.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.739+0000 7fb5e59ba740 1 -- 172.21.15.79:0/2035000371 >> 172.21.15.79:0/2035000371 conn(0x55da60d5d6b0 msgr2=0x55da60d5e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:11.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.739+0000 7fb5e59ba740 1 -- 172.21.15.79:0/2035000371 shutdown_connections 2024-08-20T01:55:11.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.739+0000 7fb5e59ba740 1 -- 172.21.15.79:0/2035000371 wait complete. 2024-08-20T01:55:11.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.739+0000 7fb5e59ba740 1 -- start start 2024-08-20T01:55:11.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.739+0000 7fb5e59ba740 1 Processor -- start 2024-08-20T01:55:11.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.739+0000 7fb5e59ba740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da60d5f880 0x55da60d69130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:11.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.739+0000 7fb5e59ba740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da60d601a0 0x55da60d69670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:11.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.739+0000 7fb5e59ba740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da60d6c130 0x55da60d69bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:11.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.739+0000 7fb5e59ba740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55da60b28700 con 0x55da60d5f880 2024-08-20T01:55:11.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.739+0000 7fb5e59ba740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55da60c4c810 con 0x55da60d6c130 2024-08-20T01:55:11.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.739+0000 7fb5e59ba740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55da60d6ede0 con 0x55da60d601a0 2024-08-20T01:55:11.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.739+0000 7fb5e59ba740 10 client.0 _ll_register_callbacks cb 0x55da60cbf700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:55:11.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.739+0000 7fb5e1b5e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da60d5f880 0x55da60d69130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:11.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.740+0000 7fb5e1b5e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da60d5f880 0x55da60d69130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57608/0 (socket says 172.21.15.79:57608) 2024-08-20T01:55:11.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.740+0000 7fb5e1b5e640 1 -- 172.21.15.79:0/3141203952 learned_addr learned my addr 172.21.15.79:0/3141203952 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:11.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.740+0000 7fb5e0b5c640 1 --2- 172.21.15.79:0/3141203952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da60d601a0 0x55da60d69670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:11.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.740+0000 7fb5e1b5e640 1 --2- 172.21.15.79:0/3141203952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da60d6c130 0x55da60d69bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:11.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.740+0000 7fb5e1b5e640 1 -- 172.21.15.79:0/3141203952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da60d601a0 msgr2=0x55da60d69670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:11.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.740+0000 7fb5e1b5e640 1 --2- 172.21.15.79:0/3141203952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da60d601a0 0x55da60d69670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:11.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.740+0000 7fb5e1b5e640 1 -- 172.21.15.79:0/3141203952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da60d6c130 msgr2=0x55da60d69bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:11.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.740+0000 7fb5e1b5e640 1 --2- 172.21.15.79:0/3141203952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da60d6c130 0x55da60d69bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:11.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.740+0000 7fb5e1b5e640 1 -- 172.21.15.79:0/3141203952 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da60d78240 con 0x55da60d5f880 2024-08-20T01:55:11.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.740+0000 7fb5e1b5e640 1 --2- 172.21.15.79:0/3141203952 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da60d5f880 0x55da60d69130 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4000f80 tx=0x7fb5d4009cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c239331d69b80f8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:11.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.740+0000 7fb5c4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:55:11.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.740+0000 7fb5c4ff9640 1 -- 172.21.15.79:0/3141203952 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4016070 con 0x55da60d5f880 2024-08-20T01:55:11.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.740+0000 7fb5c4ff9640 1 -- 172.21.15.79:0/3141203952 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fb5d4005090 con 0x55da60d5f880 2024-08-20T01:55:11.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.740+0000 7fb5e59ba740 1 -- 172.21.15.79:0/3141203952 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55da60c75150 con 0x55da60d5f880 2024-08-20T01:55:11.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.740+0000 7fb5c4ff9640 1 -- 172.21.15.79:0/3141203952 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fb5d4012c90 con 0x55da60d5f880 2024-08-20T01:55:11.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.740+0000 7fb5e59ba740 10 client.19854 fetch_fsmap learned FSMap version 71 2024-08-20T01:55:11.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.740+0000 7fb5e59ba740 1 -- 172.21.15.79:0/3141203952 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55da60d7abd0 con 0x55da60d5f880 2024-08-20T01:55:11.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.740+0000 7fb5c4ff9640 1 -- 172.21.15.79:0/3141203952 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55da60c75150 con 0x55da60d5f880 2024-08-20T01:55:11.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.741+0000 7fb5c4ff9640 1 -- 172.21.15.79:0/3141203952 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 71) ==== 8374+0+0 (secure 0 0 0) 0x7fb5d400f040 con 0x55da60d5f880 2024-08-20T01:55:11.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.741+0000 7fb5e59ba740 10 client.19854 fetch_fsmap finished waiting for FSMap version 71 2024-08-20T01:55:11.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.741+0000 7fb5e59ba740 10 client.19854 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:55:11.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.741+0000 7fb5e59ba740 20 client.19854 populate_metadata read hostname 'smithi079' 2024-08-20T01:55:11.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.741+0000 7fb5e59ba740 1 --2- 172.21.15.79:0/3141203952 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55da60d7bf20 0x55da60d7e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:11.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.741+0000 7fb5e59ba740 4 client.19854 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:55:11.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.741+0000 7fb5e59ba740 1 -- 172.21.15.79:0/3141203952 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da60cd8880 con 0x55da60d7bf20 2024-08-20T01:55:11.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.741+0000 7fb5e0b5c640 1 --2- 172.21.15.79:0/3141203952 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55da60d7bf20 0x55da60d7e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:11.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.741+0000 7fb5c4ff9640 10 client.19854 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:55:11.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.741+0000 7fb5e0b5c640 1 --2- 172.21.15.79:0/3141203952 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55da60d7bf20 0x55da60d7e310 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=cde1c5e20b893d00 server_cookie=de990326a4db5318 in_seq=0 out_seq=0 2024-08-20T01:55:11.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.742+0000 7fb5c4ff9640 1 -- 172.21.15.79:0/3141203952 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55da60cd8880 con 0x55da60d7bf20 2024-08-20T01:55:11.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.742+0000 7fb5c4ff9640 10 client.19854 handle_command_reply: tid=0 2024-08-20T01:55:11.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.742+0000 7fb5e59ba740 1 client.19854 shutdown 2024-08-20T01:55:11.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.742+0000 7fb5e59ba740 1 -- 172.21.15.79:0/3141203952 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da60d5f880 msgr2=0x55da60d69130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:11.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.742+0000 7fb5e59ba740 1 --2- 172.21.15.79:0/3141203952 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da60d5f880 0x55da60d69130 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4000f80 tx=0x7fb5d4009cb0 comp rx=0 tx=0).stop 2024-08-20T01:55:11.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.742+0000 7fb5e59ba740 1 -- 172.21.15.79:0/3141203952 shutdown_connections 2024-08-20T01:55:11.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.742+0000 7fb5e59ba740 1 --2- 172.21.15.79:0/3141203952 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55da60d7bf20 0x55da60d7e310 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:11.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.742+0000 7fb5e59ba740 1 --2- 172.21.15.79:0/3141203952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da60d6c130 0x55da60d69bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:11.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.742+0000 7fb5e59ba740 1 --2- 172.21.15.79:0/3141203952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da60d601a0 0x55da60d69670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:11.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.742+0000 7fb5e59ba740 1 --2- 172.21.15.79:0/3141203952 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da60d5f880 0x55da60d69130 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:11.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.742+0000 7fb5e59ba740 1 -- 172.21.15.79:0/3141203952 >> 172.21.15.79:0/3141203952 conn(0x55da60d5d6b0 msgr2=0x55da60d63250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:11.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.742+0000 7fb5c4ff9640 0 client.19854 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:55:11.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.742+0000 7fb5e59ba740 1 -- 172.21.15.79:0/3141203952 shutdown_connections 2024-08-20T01:55:11.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.742+0000 7fb5e59ba740 1 -- 172.21.15.79:0/3141203952 wait complete. 2024-08-20T01:55:11.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.742+0000 7fb5e59ba740 20 client.19854 trim_cache size 0 max 16384 2024-08-20T01:55:11.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.755+0000 7fb5e59ba740 1 Processor -- start 2024-08-20T01:55:11.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.755+0000 7fb5e59ba740 1 -- start start 2024-08-20T01:55:11.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.755+0000 7fb5e59ba740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da60d5f880 0x55da60d6b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:11.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.755+0000 7fb5e59ba740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da60d601a0 0x55da60d68890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:11.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.755+0000 7fb5e59ba740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da60d6c130 0x55da60d83940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:11.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.755+0000 7fb5e59ba740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb5dc1adf70 con 0x55da60d6c130 2024-08-20T01:55:11.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.755+0000 7fb5e59ba740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb5dc1afae0 con 0x55da60d601a0 2024-08-20T01:55:11.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.755+0000 7fb5e59ba740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb5dc1ae670 con 0x55da60d5f880 2024-08-20T01:55:11.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.755+0000 7fb5e1b5e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da60d6c130 0x55da60d83940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:11.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.755+0000 7fb5e1b5e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da60d6c130 0x55da60d83940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57614/0 (socket says 172.21.15.79:57614) 2024-08-20T01:55:11.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.755+0000 7fb5e1b5e640 1 -- 172.21.15.79:0/1926704848 learned_addr learned my addr 172.21.15.79:0/1926704848 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:11.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.755+0000 7fb5e1b5e640 1 --2- 172.21.15.79:0/1926704848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da60d5f880 0x55da60d6b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:11.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.756+0000 7fb5e0b5c640 1 --2- 172.21.15.79:0/1926704848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da60d601a0 0x55da60d68890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:11.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.756+0000 7fb5e1b5e640 1 -- 172.21.15.79:0/1926704848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da60d5f880 msgr2=0x55da60d6b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:11.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.756+0000 7fb5e1b5e640 1 --2- 172.21.15.79:0/1926704848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da60d5f880 0x55da60d6b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:11.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.756+0000 7fb5e1b5e640 1 -- 172.21.15.79:0/1926704848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da60d601a0 msgr2=0x55da60d68890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:11.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.756+0000 7fb5e1b5e640 1 --2- 172.21.15.79:0/1926704848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da60d601a0 0x55da60d68890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:11.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.756+0000 7fb5e1b5e640 1 -- 172.21.15.79:0/1926704848 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da60d5e130 con 0x55da60d6c130 2024-08-20T01:55:11.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.756+0000 7fb5e0b5c640 1 --2- 172.21.15.79:0/1926704848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da60d601a0 0x55da60d68890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:55:11.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.756+0000 7fb5e1b5e640 1 --2- 172.21.15.79:0/1926704848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da60d6c130 0x55da60d83940 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4004f00 tx=0x7fb5d4014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a862a885a8c3c100 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:11.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.756+0000 7fb5c6ffd640 1 -- 172.21.15.79:0/1926704848 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4009920 con 0x55da60d6c130 2024-08-20T01:55:11.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.756+0000 7fb5c6ffd640 1 -- 172.21.15.79:0/1926704848 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb5d4025040 con 0x55da60d6c130 2024-08-20T01:55:11.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.756+0000 7fb5c6ffd640 1 -- 172.21.15.79:0/1926704848 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4012a90 con 0x55da60d6c130 2024-08-20T01:55:11.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.757+0000 7fb5e59ba740 1 -- 172.21.15.79:0/1926704848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da60d6c130 msgr2=0x55da60d83940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:11.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.757+0000 7fb5e59ba740 1 --2- 172.21.15.79:0/1926704848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da60d6c130 0x55da60d83940 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4004f00 tx=0x7fb5d4014040 comp rx=0 tx=0).stop 2024-08-20T01:55:11.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.757+0000 7fb5e59ba740 1 -- 172.21.15.79:0/1926704848 shutdown_connections 2024-08-20T01:55:11.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.757+0000 7fb5e59ba740 1 --2- 172.21.15.79:0/1926704848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da60d6c130 0x55da60d83940 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:11.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.757+0000 7fb5e59ba740 1 --2- 172.21.15.79:0/1926704848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da60d601a0 0x55da60d68890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:11.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.757+0000 7fb5e59ba740 1 --2- 172.21.15.79:0/1926704848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da60d5f880 0x55da60d6b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:11.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.757+0000 7fb5e59ba740 1 -- 172.21.15.79:0/1926704848 >> 172.21.15.79:0/1926704848 conn(0x55da60d5d6b0 msgr2=0x55da60d63250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:11.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.757+0000 7fb5e59ba740 1 -- 172.21.15.79:0/1926704848 shutdown_connections 2024-08-20T01:55:11.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.757+0000 7fb5e59ba740 1 -- 172.21.15.79:0/1926704848 wait complete. 2024-08-20T01:55:11.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.757+0000 7fb5e59ba740 1 -- start start 2024-08-20T01:55:11.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.757+0000 7fb5e59ba740 1 Processor -- start 2024-08-20T01:55:11.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.757+0000 7fb5e59ba740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da60d5f880 0x55da60d6f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:11.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.757+0000 7fb5e59ba740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da60d601a0 0x55da60d6f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:11.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.758+0000 7fb5e59ba740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da60d6c130 0x55da60de4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:11.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.758+0000 7fb5e59ba740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb5dc1af410 con 0x55da60d601a0 2024-08-20T01:55:11.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.758+0000 7fb5e59ba740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb5dc1aed40 con 0x55da60d5f880 2024-08-20T01:55:11.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.758+0000 7fb5e59ba740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb5dc1abf50 con 0x55da60d6c130 2024-08-20T01:55:11.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.758+0000 7fb5e59ba740 10 client.0 _ll_register_callbacks cb 0x7fb5d8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:55:11.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.758+0000 7fb5e1b5e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da60d5f880 0x55da60d6f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:11.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.758+0000 7fb5e1b5e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da60d5f880 0x55da60d6f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:47586/0 (socket says 172.21.15.79:47586) 2024-08-20T01:55:11.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.758+0000 7fb5e1b5e640 1 -- 172.21.15.79:0/292302548 learned_addr learned my addr 172.21.15.79:0/292302548 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:11.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.758+0000 7fb5e0b5c640 1 --2- 172.21.15.79:0/292302548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da60d601a0 0x55da60d6f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:11.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.758+0000 7fb5e1b5e640 1 --2- 172.21.15.79:0/292302548 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da60d6c130 0x55da60de4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:11.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.759+0000 7fb5e1b5e640 1 -- 172.21.15.79:0/292302548 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da60d6c130 msgr2=0x55da60de4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:11.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.759+0000 7fb5e1b5e640 1 --2- 172.21.15.79:0/292302548 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da60d6c130 0x55da60de4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:11.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.759+0000 7fb5e1b5e640 1 -- 172.21.15.79:0/292302548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da60d601a0 msgr2=0x55da60d6f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:11.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.759+0000 7fb5e1b5e640 1 --2- 172.21.15.79:0/292302548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da60d601a0 0x55da60d6f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:11.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.759+0000 7fb5e1b5e640 1 -- 172.21.15.79:0/292302548 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da60d70030 con 0x55da60d5f880 2024-08-20T01:55:11.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.759+0000 7fb5e1b5e640 1 --2- 172.21.15.79:0/292302548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da60d5f880 0x55da60d6f200 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4038040 tx=0x7fb5d4009600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2b05bb1e5ea6287 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:11.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.759+0000 7fb5c4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-08-20T01:55:11.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.759+0000 7fb5c4ff9640 1 -- 172.21.15.79:0/292302548 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d403a070 con 0x55da60d5f880 2024-08-20T01:55:11.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.759+0000 7fb5c4ff9640 1 -- 172.21.15.79:0/292302548 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fb5d401aa10 con 0x55da60d5f880 2024-08-20T01:55:11.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.759+0000 7fb5e59ba740 1 -- 172.21.15.79:0/292302548 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5d4025040 con 0x55da60d5f880 2024-08-20T01:55:11.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.759+0000 7fb5c4ff9640 1 -- 172.21.15.79:0/292302548 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fb5d4009bf0 con 0x55da60d5f880 2024-08-20T01:55:11.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.759+0000 7fb5e59ba740 10 client.28937 fetch_fsmap learned FSMap version 71 2024-08-20T01:55:11.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.759+0000 7fb5e59ba740 1 -- 172.21.15.79:0/292302548 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55da60de5ee0 con 0x55da60d5f880 2024-08-20T01:55:11.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.759+0000 7fb5c4ff9640 1 -- 172.21.15.79:0/292302548 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb5d4025040 con 0x55da60d5f880 2024-08-20T01:55:11.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.760+0000 7fb5c4ff9640 1 -- 172.21.15.79:0/292302548 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 71) ==== 8374+0+0 (secure 0 0 0) 0x7fb5d4045900 con 0x55da60d5f880 2024-08-20T01:55:11.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.760+0000 7fb5e59ba740 10 client.28937 fetch_fsmap finished waiting for FSMap version 71 2024-08-20T01:55:11.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.760+0000 7fb5e59ba740 10 client.28937 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-20T01:55:11.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.760+0000 7fb5e59ba740 20 client.28937 populate_metadata read hostname 'smithi079' 2024-08-20T01:55:11.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.760+0000 7fb5e59ba740 1 --2- 172.21.15.79:0/292302548 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55da60de6570 0x55da60de8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:11.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.760+0000 7fb5e59ba740 4 client.28937 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:55:11.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.760+0000 7fb5e59ba740 1 -- 172.21.15.79:0/292302548 --> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55da60cd4320 con 0x55da60de6570 2024-08-20T01:55:11.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.760+0000 7fb5e0b5c640 1 --2- 172.21.15.79:0/292302548 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55da60de6570 0x55da60de8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:11.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.760+0000 7fb5c4ff9640 10 client.28937 ms_handle_connect on v2:172.21.15.81:6836/2073598870 2024-08-20T01:55:11.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.760+0000 7fb5e0b5c640 1 --2- 172.21.15.79:0/292302548 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55da60de6570 0x55da60de8990 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=af67bc38c9505497 server_cookie=6cfbcfb8dc176e83 in_seq=0 out_seq=0 2024-08-20T01:55:11.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.760+0000 7fb5c4ff9640 1 -- 172.21.15.79:0/292302548 <== mds.4 v2:172.21.15.81:6836/2073598870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55da60cd4320 con 0x55da60de6570 2024-08-20T01:55:11.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.760+0000 7fb5c4ff9640 10 client.28937 handle_command_reply: tid=0 2024-08-20T01:55:11.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.760+0000 7fb5e59ba740 1 client.28937 shutdown 2024-08-20T01:55:11.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.760+0000 7fb5e59ba740 1 -- 172.21.15.79:0/292302548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da60d5f880 msgr2=0x55da60d6f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:11.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.760+0000 7fb5e59ba740 1 --2- 172.21.15.79:0/292302548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da60d5f880 0x55da60d6f200 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4038040 tx=0x7fb5d4009600 comp rx=0 tx=0).stop 2024-08-20T01:55:11.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.761+0000 7fb5e59ba740 1 -- 172.21.15.79:0/292302548 shutdown_connections 2024-08-20T01:55:11.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.761+0000 7fb5e59ba740 1 --2- 172.21.15.79:0/292302548 >> [v2:172.21.15.81:6836/2073598870,v1:172.21.15.81:6837/2073598870] conn(0x55da60de6570 0x55da60de8990 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:11.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.761+0000 7fb5e59ba740 1 --2- 172.21.15.79:0/292302548 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da60d6c130 0x55da60de4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:11.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.761+0000 7fb5e59ba740 1 --2- 172.21.15.79:0/292302548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da60d601a0 0x55da60d6f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:11.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.761+0000 7fb5e59ba740 1 --2- 172.21.15.79:0/292302548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da60d5f880 0x55da60d6f200 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:11.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.761+0000 7fb5e59ba740 1 -- 172.21.15.79:0/292302548 >> 172.21.15.79:0/292302548 conn(0x55da60d5d6b0 msgr2=0x55da60d690a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:11.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.761+0000 7fb5c4ff9640 0 client.28937 ms_handle_reset on v2:172.21.15.81:6836/2073598870 2024-08-20T01:55:11.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.761+0000 7fb5e59ba740 1 -- 172.21.15.79:0/292302548 shutdown_connections 2024-08-20T01:55:11.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.761+0000 7fb5e59ba740 1 -- 172.21.15.79:0/292302548 wait complete. 2024-08-20T01:55:11.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.761+0000 7fb5e59ba740 20 client.28937 trim_cache size 0 max 16384 2024-08-20T01:55:11.780 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:55:11.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.761+0000 7fb5e35c1640 1 -- 172.21.15.79:0/1681622169 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb5c80b3c50 msgr2=0x7fb5c80b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:11.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.761+0000 7fb5e35c1640 1 --2- 172.21.15.79:0/1681622169 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb5c80b3c50 0x7fb5c80b6110 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc102060 tx=0x7fb5cc031970 comp rx=0 tx=0).stop 2024-08-20T01:55:11.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.761+0000 7fb5e35c1640 1 -- 172.21.15.79:0/1681622169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5dc102ad0 msgr2=0x7fb5dc198ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:11.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.761+0000 7fb5e35c1640 1 --2- 172.21.15.79:0/1681622169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5dc102ad0 0x7fb5dc198ec0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc009230 tx=0x7fb5cc004270 comp rx=0 tx=0).stop 2024-08-20T01:55:11.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.761+0000 7fb5e35c1640 1 -- 172.21.15.79:0/1681622169 shutdown_connections 2024-08-20T01:55:11.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.761+0000 7fb5e35c1640 1 --2- 172.21.15.79:0/1681622169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5dc108e60 0x7fb5dc19e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:11.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.761+0000 7fb5e35c1640 1 --2- 172.21.15.79:0/1681622169 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb5c80b3c50 0x7fb5c80b6110 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:11.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.761+0000 7fb5e35c1640 1 --2- 172.21.15.79:0/1681622169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5dc1084e0 0x7fb5dc199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:11.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.761+0000 7fb5e35c1640 1 --2- 172.21.15.79:0/1681622169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5dc102ad0 0x7fb5dc198ec0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:11.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.761+0000 7fb5e35c1640 1 -- 172.21.15.79:0/1681622169 >> 172.21.15.79:0/1681622169 conn(0x7fb5dc0fe540 msgr2=0x7fb5dc100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:11.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.762+0000 7fb5e35c1640 1 -- 172.21.15.79:0/1681622169 shutdown_connections 2024-08-20T01:55:11.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:11.762+0000 7fb5e35c1640 1 -- 172.21.15.79:0/1681622169 wait complete. 2024-08-20T01:55:12.477 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-20T01:55:12.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:12 smithi079 ceph-mon[18656]: pgmap v883: 97 pgs: 97 active+clean; 2.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 21 op/s 2024-08-20T01:55:12.725 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:55:12.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:12 smithi081 ceph-mon[22209]: pgmap v883: 97 pgs: 97 active+clean; 2.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 21 op/s 2024-08-20T01:55:12.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:12 smithi175 ceph-mon[22392]: pgmap v883: 97 pgs: 97 active+clean; 2.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 21 op/s 2024-08-20T01:55:13.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.274+0000 7f1cc6e19640 1 -- 172.21.15.79:0/680571287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cc0107d40 msgr2=0x7f1cc010e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:13.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.274+0000 7f1cc6e19640 1 --2- 172.21.15.79:0/680571287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cc0107d40 0x7f1cc010e540 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8009ca0 tx=0x7f1cb802a8c0 comp rx=0 tx=0).stop 2024-08-20T01:55:13.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.274+0000 7f1cc6e19640 1 -- 172.21.15.79:0/680571287 shutdown_connections 2024-08-20T01:55:13.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.274+0000 7f1cc6e19640 1 --2- 172.21.15.79:0/680571287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cc0107d40 0x7f1cc010e540 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:13.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.274+0000 7f1cc6e19640 1 --2- 172.21.15.79:0/680571287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cc01073c0 0x7f1cc0107800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:13.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.274+0000 7f1cc6e19640 1 --2- 172.21.15.79:0/680571287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cc01019b0 0x7f1cc0101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:13.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.274+0000 7f1cc6e19640 1 -- 172.21.15.79:0/680571287 >> 172.21.15.79:0/680571287 conn(0x7f1cc00fd420 msgr2=0x7f1cc00ff840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:13.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.274+0000 7f1cc6e19640 1 -- 172.21.15.79:0/680571287 shutdown_connections 2024-08-20T01:55:13.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.274+0000 7f1cc6e19640 1 -- 172.21.15.79:0/680571287 wait complete. 2024-08-20T01:55:13.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.275+0000 7f1cc6e19640 1 Processor -- start 2024-08-20T01:55:13.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.275+0000 7f1cc6e19640 1 -- start start 2024-08-20T01:55:13.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.275+0000 7f1cc6e19640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cc01019b0 0x7f1cc0198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:13.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.275+0000 7f1cc6e19640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cc01073c0 0x7f1cc01993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:13.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.275+0000 7f1cc6e19640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cc0107d40 0x7f1cc019e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:13.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.275+0000 7f1cc6e19640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc01118c0 con 0x7f1cc01019b0 2024-08-20T01:55:13.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.275+0000 7f1cc6e19640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc0111740 con 0x7f1cc01073c0 2024-08-20T01:55:13.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.275+0000 7f1cc6e19640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc0111a40 con 0x7f1cc0107d40 2024-08-20T01:55:13.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.275+0000 7f1cc4bb5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cc01019b0 0x7f1cc0198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:13.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.275+0000 7f1cc4bb5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cc01019b0 0x7f1cc0198e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57644/0 (socket says 172.21.15.79:57644) 2024-08-20T01:55:13.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.275+0000 7f1cc4bb5640 1 -- 172.21.15.79:0/3795579085 learned_addr learned my addr 172.21.15.79:0/3795579085 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:13.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.275+0000 7f1cbffff640 1 --2- 172.21.15.79:0/3795579085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cc01073c0 0x7f1cc01993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:13.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.275+0000 7f1cc53b6640 1 --2- 172.21.15.79:0/3795579085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cc0107d40 0x7f1cc019e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:13.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.276+0000 7f1cc4bb5640 1 -- 172.21.15.79:0/3795579085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cc0107d40 msgr2=0x7f1cc019e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:13.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.276+0000 7f1cc4bb5640 1 --2- 172.21.15.79:0/3795579085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cc0107d40 0x7f1cc019e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:13.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.276+0000 7f1cc4bb5640 1 -- 172.21.15.79:0/3795579085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cc01073c0 msgr2=0x7f1cc01993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:13.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.276+0000 7f1cc4bb5640 1 --2- 172.21.15.79:0/3795579085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cc01073c0 0x7f1cc01993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:13.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.276+0000 7f1cc4bb5640 1 -- 172.21.15.79:0/3795579085 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cc019ef20 con 0x7f1cc01019b0 2024-08-20T01:55:13.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.276+0000 7f1cbffff640 1 --2- 172.21.15.79:0/3795579085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cc01073c0 0x7f1cc01993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:55:13.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.276+0000 7f1cc4bb5640 1 --2- 172.21.15.79:0/3795579085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cc01019b0 0x7f1cc0198e70 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f1cb400d950 tx=0x7f1cb400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:13.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.276+0000 7f1cbdffb640 1 -- 172.21.15.79:0/3795579085 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb4017070 con 0x7f1cc01019b0 2024-08-20T01:55:13.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.276+0000 7f1cc6e19640 1 -- 172.21.15.79:0/3795579085 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cc019f210 con 0x7f1cc01019b0 2024-08-20T01:55:13.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.276+0000 7f1cbdffb640 1 -- 172.21.15.79:0/3795579085 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1cb4009c30 con 0x7f1cc01019b0 2024-08-20T01:55:13.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.276+0000 7f1cbdffb640 1 -- 172.21.15.79:0/3795579085 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb400f620 con 0x7f1cc01019b0 2024-08-20T01:55:13.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.276+0000 7f1cc6e19640 1 -- 172.21.15.79:0/3795579085 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cc01a5aa0 con 0x7f1cc01019b0 2024-08-20T01:55:13.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.278+0000 7f1cbdffb640 1 -- 172.21.15.79:0/3795579085 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1cb4010460 con 0x7f1cc01019b0 2024-08-20T01:55:13.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.279+0000 7f1cc9212740 1 Processor -- start 2024-08-20T01:55:13.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.279+0000 7f1cc9212740 1 -- start start 2024-08-20T01:55:13.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.279+0000 7f1cc9212740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b002748880 0x55b002748c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:13.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.279+0000 7f1cc9212740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b0027491a0 0x55b002759000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:13.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.279+0000 7f1cc9212740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b002759540 0x55b00275b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:13.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.279+0000 7f1cc9212740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b0026bf930 con 0x55b002748880 2024-08-20T01:55:13.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.279+0000 7f1cc9212740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b0026aee30 con 0x55b0027491a0 2024-08-20T01:55:13.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.279+0000 7f1cc9212740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b0026b2e70 con 0x55b002759540 2024-08-20T01:55:13.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.279+0000 7f1cc53b6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b002748880 0x55b002748c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:13.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.279+0000 7f1cc53b6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b002748880 0x55b002748c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57648/0 (socket says 172.21.15.79:57648) 2024-08-20T01:55:13.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.279+0000 7f1cc53b6640 1 -- 172.21.15.79:0/675151679 learned_addr learned my addr 172.21.15.79:0/675151679 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:13.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.279+0000 7f1cbffff640 1 --2- 172.21.15.79:0/675151679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b002759540 0x55b00275b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:13.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.279+0000 7f1cbdffb640 1 --2- 172.21.15.79:0/3795579085 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1cb00b3bd0 0x7f1cb00b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:13.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.279+0000 7f1cc4bb5640 1 --2- 172.21.15.79:0/675151679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b0027491a0 0x55b002759000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:13.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.280+0000 7f1cc53b6640 1 -- 172.21.15.79:0/675151679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b002759540 msgr2=0x55b00275b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:13.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.280+0000 7f1cc53b6640 1 --2- 172.21.15.79:0/675151679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b002759540 0x55b00275b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:13.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.280+0000 7f1cc53b6640 1 -- 172.21.15.79:0/675151679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b0027491a0 msgr2=0x55b002759000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:13.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.280+0000 7f1cc53b6640 1 --2- 172.21.15.79:0/675151679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b0027491a0 0x55b002759000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:13.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.280+0000 7f1cc53b6640 1 -- 172.21.15.79:0/675151679 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b00240e650 con 0x55b002748880 2024-08-20T01:55:13.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.280+0000 7f1cbdffb640 1 -- 172.21.15.79:0/3795579085 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f1cb40e3750 con 0x7f1cc01019b0 2024-08-20T01:55:13.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.280+0000 7f1cc53b6640 1 --2- 172.21.15.79:0/3795579085 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1cb00b3bd0 0x7f1cb00b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:13.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.280+0000 7f1cc53b6640 1 --2- 172.21.15.79:0/675151679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b002748880 0x55b002748c60 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f1cb802ade0 tx=0x7f1cb8031520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb7c6c94bd8b241c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:13.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.280+0000 7f1caaffd640 1 -- 172.21.15.79:0/675151679 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb8042040 con 0x55b002748880 2024-08-20T01:55:13.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.280+0000 7f1caaffd640 1 -- 172.21.15.79:0/675151679 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1cb8036070 con 0x55b002748880 2024-08-20T01:55:13.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.280+0000 7f1caaffd640 1 -- 172.21.15.79:0/675151679 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb80305c0 con 0x55b002748880 2024-08-20T01:55:13.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.280+0000 7f1cc53b6640 1 --2- 172.21.15.79:0/3795579085 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1cb00b3bd0 0x7f1cb00b6090 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f1cb804d000 tx=0x7f1cb804e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:13.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.281+0000 7f1cc9212740 1 -- 172.21.15.79:0/675151679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b002748880 msgr2=0x55b002748c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:13.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.281+0000 7f1cc9212740 1 --2- 172.21.15.79:0/675151679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b002748880 0x55b002748c60 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f1cb802ade0 tx=0x7f1cb8031520 comp rx=0 tx=0).stop 2024-08-20T01:55:13.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.281+0000 7f1cc9212740 1 -- 172.21.15.79:0/675151679 shutdown_connections 2024-08-20T01:55:13.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.281+0000 7f1cc9212740 1 --2- 172.21.15.79:0/675151679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b002759540 0x55b00275b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:13.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.281+0000 7f1cc9212740 1 --2- 172.21.15.79:0/675151679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b0027491a0 0x55b002759000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:13.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.281+0000 7f1cc9212740 1 --2- 172.21.15.79:0/675151679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b002748880 0x55b002748c60 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:13.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.281+0000 7f1cc9212740 1 -- 172.21.15.79:0/675151679 >> 172.21.15.79:0/675151679 conn(0x55b0027466b0 msgr2=0x55b002747850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:13.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.281+0000 7f1cc9212740 1 -- 172.21.15.79:0/675151679 shutdown_connections 2024-08-20T01:55:13.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.281+0000 7f1cc9212740 1 -- 172.21.15.79:0/675151679 wait complete. 2024-08-20T01:55:13.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.281+0000 7f1cc9212740 1 -- start start 2024-08-20T01:55:13.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.282+0000 7f1cc9212740 1 Processor -- start 2024-08-20T01:55:13.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.282+0000 7f1cc9212740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b002748880 0x55b002758ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:13.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.282+0000 7f1cc9212740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b0027491a0 0x55b002756480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:13.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.282+0000 7f1cc9212740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b002759540 0x55b002756c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:13.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.282+0000 7f1cc9212740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b002511700 con 0x55b0027491a0 2024-08-20T01:55:13.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.282+0000 7f1cc9212740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b002635810 con 0x55b002748880 2024-08-20T01:55:13.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.282+0000 7f1cc9212740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b00275c1f0 con 0x55b002759540 2024-08-20T01:55:13.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.282+0000 7f1cc9212740 10 client.0 _ll_register_callbacks cb 0x55b0026a8700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:55:13.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.282+0000 7f1cbffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b0027491a0 0x55b002756480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:13.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.282+0000 7f1cbffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b0027491a0 0x55b002756480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57652/0 (socket says 172.21.15.79:57652) 2024-08-20T01:55:13.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.282+0000 7f1cbffff640 1 -- 172.21.15.79:0/1448470604 learned_addr learned my addr 172.21.15.79:0/1448470604 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:13.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.282+0000 7f1cc53b6640 1 --2- 172.21.15.79:0/1448470604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b002759540 0x55b002756c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:13.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.282+0000 7f1cc4bb5640 1 --2- 172.21.15.79:0/1448470604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b002748880 0x55b002758ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:13.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.282+0000 7f1cbffff640 1 -- 172.21.15.79:0/1448470604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b002759540 msgr2=0x55b002756c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:13.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.282+0000 7f1cbffff640 1 --2- 172.21.15.79:0/1448470604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b002759540 0x55b002756c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:13.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.282+0000 7f1cbffff640 1 -- 172.21.15.79:0/1448470604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b002748880 msgr2=0x55b002758ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:13.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.282+0000 7f1cbffff640 1 --2- 172.21.15.79:0/1448470604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b002748880 0x55b002758ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:13.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.282+0000 7f1cbffff640 1 -- 172.21.15.79:0/1448470604 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b002765520 con 0x55b0027491a0 2024-08-20T01:55:13.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.283+0000 7f1cbffff640 1 --2- 172.21.15.79:0/1448470604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b0027491a0 0x55b002756480 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f1cac004460 tx=0x7f1cac0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e445d447b7d3af74 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:13.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.283+0000 7f1c9ffff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:55:13.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.283+0000 7f1c9ffff640 1 -- 172.21.15.79:0/1448470604 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cac011710 con 0x55b0027491a0 2024-08-20T01:55:13.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.283+0000 7f1cc9212740 1 -- 172.21.15.79:0/1448470604 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b00265e150 con 0x55b0027491a0 2024-08-20T01:55:13.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.283+0000 7f1c9ffff640 1 -- 172.21.15.79:0/1448470604 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f1cac0118b0 con 0x55b0027491a0 2024-08-20T01:55:13.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.283+0000 7f1c9ffff640 1 -- 172.21.15.79:0/1448470604 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f1cac011ab0 con 0x55b0027491a0 2024-08-20T01:55:13.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.283+0000 7f1cc9212740 10 client.19872 fetch_fsmap learned FSMap version 71 2024-08-20T01:55:13.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.283+0000 7f1cc9212740 1 -- 172.21.15.79:0/1448470604 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55b002767f80 con 0x55b0027491a0 2024-08-20T01:55:13.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.283+0000 7f1c9ffff640 1 -- 172.21.15.79:0/1448470604 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55b00265e150 con 0x55b0027491a0 2024-08-20T01:55:13.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.283+0000 7f1c9ffff640 1 -- 172.21.15.79:0/1448470604 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 71) ==== 8374+0+0 (secure 0 0 0) 0x7f1cac01bcd0 con 0x55b0027491a0 2024-08-20T01:55:13.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.283+0000 7f1cc9212740 10 client.19872 fetch_fsmap finished waiting for FSMap version 71 2024-08-20T01:55:13.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.283+0000 7f1cc9212740 10 client.19872 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:55:13.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.283+0000 7f1cc9212740 20 client.19872 populate_metadata read hostname 'smithi079' 2024-08-20T01:55:13.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.283+0000 7f1cc9212740 1 --2- 172.21.15.79:0/1448470604 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x55b0027693e0 0x55b00276b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:13.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.283+0000 7f1cc9212740 4 client.19872 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:55:13.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.283+0000 7f1cc9212740 1 -- 172.21.15.79:0/1448470604 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b0026c1880 con 0x55b0027693e0 2024-08-20T01:55:13.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.284+0000 7f1cc4bb5640 1 --2- 172.21.15.79:0/1448470604 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x55b0027693e0 0x55b00276b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:13.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.284+0000 7f1cc4bb5640 1 --2- 172.21.15.79:0/1448470604 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x55b0027693e0 0x55b00276b850 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=eb7e42ffaecbe00c server_cookie=ac5169f178c1f241 in_seq=0 out_seq=0 2024-08-20T01:55:13.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.284+0000 7f1c9ffff640 10 client.19872 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:55:13.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.285+0000 7f1c9ffff640 1 -- 172.21.15.79:0/1448470604 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b0026c1880 con 0x55b0027693e0 2024-08-20T01:55:13.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.285+0000 7f1c9ffff640 10 client.19872 handle_command_reply: tid=0 2024-08-20T01:55:13.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.285+0000 7f1cc9212740 1 client.19872 shutdown 2024-08-20T01:55:13.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.285+0000 7f1cc9212740 1 -- 172.21.15.79:0/1448470604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b0027491a0 msgr2=0x55b002756480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:13.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.285+0000 7f1cc9212740 1 --2- 172.21.15.79:0/1448470604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b0027491a0 0x55b002756480 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f1cac004460 tx=0x7f1cac0039c0 comp rx=0 tx=0).stop 2024-08-20T01:55:13.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.285+0000 7f1cc9212740 1 -- 172.21.15.79:0/1448470604 shutdown_connections 2024-08-20T01:55:13.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.285+0000 7f1cc9212740 1 --2- 172.21.15.79:0/1448470604 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x55b0027693e0 0x55b00276b850 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:13.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.285+0000 7f1cc9212740 1 --2- 172.21.15.79:0/1448470604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b002759540 0x55b002756c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:13.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.285+0000 7f1cc9212740 1 --2- 172.21.15.79:0/1448470604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b0027491a0 0x55b002756480 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:13.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.285+0000 7f1cc9212740 1 --2- 172.21.15.79:0/1448470604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b002748880 0x55b002758ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:13.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.285+0000 7f1c9ffff640 0 client.19872 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:55:13.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.285+0000 7f1cc9212740 1 -- 172.21.15.79:0/1448470604 >> 172.21.15.79:0/1448470604 conn(0x55b0027466b0 msgr2=0x55b00274c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:13.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.285+0000 7f1cc9212740 1 -- 172.21.15.79:0/1448470604 shutdown_connections 2024-08-20T01:55:13.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.285+0000 7f1cc9212740 1 -- 172.21.15.79:0/1448470604 wait complete. 2024-08-20T01:55:13.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.285+0000 7f1cc9212740 20 client.19872 trim_cache size 0 max 16384 2024-08-20T01:55:13.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.298+0000 7f1cc9212740 1 Processor -- start 2024-08-20T01:55:13.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.298+0000 7f1cc9212740 1 -- start start 2024-08-20T01:55:13.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.298+0000 7f1cc9212740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b002748880 0x55b002753fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:13.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.298+0000 7f1cc9212740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b0027491a0 0x55b002755cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:13.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.298+0000 7f1cc9212740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b002759540 0x55b0027599c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:13.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.298+0000 7f1cc9212740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc01abd30 con 0x55b002748880 2024-08-20T01:55:13.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.298+0000 7f1cc9212740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc01ad8a0 con 0x55b0027491a0 2024-08-20T01:55:13.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.298+0000 7f1cc9212740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc01ac430 con 0x55b002759540 2024-08-20T01:55:13.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.298+0000 7f1cc4bb5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b002748880 0x55b002753fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:13.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.298+0000 7f1cc4bb5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b002748880 0x55b002753fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57668/0 (socket says 172.21.15.79:57668) 2024-08-20T01:55:13.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.298+0000 7f1cc4bb5640 1 -- 172.21.15.79:0/3489674855 learned_addr learned my addr 172.21.15.79:0/3489674855 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:13.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.298+0000 7f1cbffff640 1 --2- 172.21.15.79:0/3489674855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b0027491a0 0x55b002755cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:13.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.298+0000 7f1cc53b6640 1 --2- 172.21.15.79:0/3489674855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b002759540 0x55b0027599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:13.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.298+0000 7f1cc4bb5640 1 -- 172.21.15.79:0/3489674855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b002759540 msgr2=0x55b0027599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:13.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.298+0000 7f1cc4bb5640 1 --2- 172.21.15.79:0/3489674855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b002759540 0x55b0027599c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:13.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.298+0000 7f1cc4bb5640 1 -- 172.21.15.79:0/3489674855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b0027491a0 msgr2=0x55b002755cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:13.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.298+0000 7f1cc4bb5640 1 --2- 172.21.15.79:0/3489674855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b0027491a0 0x55b002755cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:13.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.298+0000 7f1cc4bb5640 1 -- 172.21.15.79:0/3489674855 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0027464e0 con 0x55b002748880 2024-08-20T01:55:13.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.298+0000 7f1cc53b6640 1 --2- 172.21.15.79:0/3489674855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b002759540 0x55b0027599c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:55:13.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.299+0000 7f1cc4bb5640 1 --2- 172.21.15.79:0/3489674855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b002748880 0x55b002753fd0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f1cb40aa460 tx=0x7f1cb40cd040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=835f1884a30b3619 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:13.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.299+0000 7f1caa7fc640 1 -- 172.21.15.79:0/3489674855 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb4020040 con 0x55b002748880 2024-08-20T01:55:13.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.299+0000 7f1caa7fc640 1 -- 172.21.15.79:0/3489674855 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1cb40aa760 con 0x55b002748880 2024-08-20T01:55:13.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.299+0000 7f1caa7fc640 1 -- 172.21.15.79:0/3489674855 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb40cd0b0 con 0x55b002748880 2024-08-20T01:55:13.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.299+0000 7f1cc9212740 1 -- 172.21.15.79:0/3489674855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b002748880 msgr2=0x55b002753fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:13.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.299+0000 7f1cc9212740 1 --2- 172.21.15.79:0/3489674855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b002748880 0x55b002753fd0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f1cb40aa460 tx=0x7f1cb40cd040 comp rx=0 tx=0).stop 2024-08-20T01:55:13.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.299+0000 7f1cc9212740 1 -- 172.21.15.79:0/3489674855 shutdown_connections 2024-08-20T01:55:13.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.299+0000 7f1cc9212740 1 --2- 172.21.15.79:0/3489674855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b002759540 0x55b0027599c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:13.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.299+0000 7f1cc9212740 1 --2- 172.21.15.79:0/3489674855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b0027491a0 0x55b002755cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:13.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.299+0000 7f1cc9212740 1 --2- 172.21.15.79:0/3489674855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b002748880 0x55b002753fd0 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:13.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.299+0000 7f1cc9212740 1 -- 172.21.15.79:0/3489674855 >> 172.21.15.79:0/3489674855 conn(0x55b0027466b0 msgr2=0x55b002757a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:13.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.299+0000 7f1cc9212740 1 -- 172.21.15.79:0/3489674855 shutdown_connections 2024-08-20T01:55:13.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.299+0000 7f1cc9212740 1 -- 172.21.15.79:0/3489674855 wait complete. 2024-08-20T01:55:13.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.300+0000 7f1cc9212740 1 -- start start 2024-08-20T01:55:13.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.300+0000 7f1cc9212740 1 Processor -- start 2024-08-20T01:55:13.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.300+0000 7f1cc9212740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b002748880 0x55b0027617c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:13.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.300+0000 7f1cc9212740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b0027491a0 0x55b002761d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:13.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.300+0000 7f1cc9212740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b002759540 0x55b002770a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:13.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.300+0000 7f1cc9212740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc01ad1d0 con 0x55b0027491a0 2024-08-20T01:55:13.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.300+0000 7f1cc9212740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc01acb00 con 0x55b002759540 2024-08-20T01:55:13.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.300+0000 7f1cc9212740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc01a9d10 con 0x55b002748880 2024-08-20T01:55:13.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.300+0000 7f1cc9212740 10 client.0 _ll_register_callbacks cb 0x7f1cac00bba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:55:13.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.300+0000 7f1cbffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b0027491a0 0x55b002761d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:13.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.300+0000 7f1cbffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b0027491a0 0x55b002761d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57676/0 (socket says 172.21.15.79:57676) 2024-08-20T01:55:13.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.300+0000 7f1cbffff640 1 -- 172.21.15.79:0/2417387292 learned_addr learned my addr 172.21.15.79:0/2417387292 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:13.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.300+0000 7f1cc53b6640 1 --2- 172.21.15.79:0/2417387292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b002759540 0x55b002770a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:13.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.300+0000 7f1cc4bb5640 1 --2- 172.21.15.79:0/2417387292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b002748880 0x55b0027617c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:13.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.301+0000 7f1cbffff640 1 -- 172.21.15.79:0/2417387292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b002748880 msgr2=0x55b0027617c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:13.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.301+0000 7f1cbffff640 1 --2- 172.21.15.79:0/2417387292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b002748880 0x55b0027617c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:13.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.301+0000 7f1cbffff640 1 -- 172.21.15.79:0/2417387292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b002759540 msgr2=0x55b002770a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:13.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.301+0000 7f1cbffff640 1 --2- 172.21.15.79:0/2417387292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b002759540 0x55b002770a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:13.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.301+0000 7f1cbffff640 1 -- 172.21.15.79:0/2417387292 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b002771240 con 0x55b0027491a0 2024-08-20T01:55:13.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.301+0000 7f1cbffff640 1 --2- 172.21.15.79:0/2417387292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b0027491a0 0x55b002761d20 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f1cac0106b0 tx=0x7f1cac004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e684ea38a65bcc9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:13.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.301+0000 7f1c9ffff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:55:13.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.301+0000 7f1c9ffff640 1 -- 172.21.15.79:0/2417387292 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cac02b070 con 0x55b0027491a0 2024-08-20T01:55:13.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.301+0000 7f1c9ffff640 1 -- 172.21.15.79:0/2417387292 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f1cac005250 con 0x55b0027491a0 2024-08-20T01:55:13.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.301+0000 7f1cc9212740 1 -- 172.21.15.79:0/2417387292 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b002741880 con 0x55b0027491a0 2024-08-20T01:55:13.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.301+0000 7f1c9ffff640 1 -- 172.21.15.79:0/2417387292 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f1cac005450 con 0x55b0027491a0 2024-08-20T01:55:13.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.301+0000 7f1cc9212740 10 client.19878 fetch_fsmap learned FSMap version 71 2024-08-20T01:55:13.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.301+0000 7f1cc9212740 1 -- 172.21.15.79:0/2417387292 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55b0027d3e40 con 0x55b0027491a0 2024-08-20T01:55:13.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.301+0000 7f1c9ffff640 1 -- 172.21.15.79:0/2417387292 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55b002741880 con 0x55b0027491a0 2024-08-20T01:55:13.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.302+0000 7f1c9ffff640 1 -- 172.21.15.79:0/2417387292 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 71) ==== 8374+0+0 (secure 0 0 0) 0x7f1cac004680 con 0x55b0027491a0 2024-08-20T01:55:13.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.302+0000 7f1cc9212740 10 client.19878 fetch_fsmap finished waiting for FSMap version 71 2024-08-20T01:55:13.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.302+0000 7f1cc9212740 10 client.19878 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-20T01:55:13.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.302+0000 7f1cc9212740 20 client.19878 populate_metadata read hostname 'smithi079' 2024-08-20T01:55:13.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.302+0000 7f1cc9212740 1 --2- 172.21.15.79:0/2417387292 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x55b0027d4650 0x55b0027d6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:13.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.302+0000 7f1cc9212740 4 client.19878 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:55:13.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.302+0000 7f1cc9212740 1 -- 172.21.15.79:0/2417387292 --> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b00275a0a0 con 0x55b0027d4650 2024-08-20T01:55:13.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.302+0000 7f1cc4bb5640 1 --2- 172.21.15.79:0/2417387292 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x55b0027d4650 0x55b0027d6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:13.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.302+0000 7f1c9ffff640 10 client.19878 ms_handle_connect on v2:172.21.15.175:6834/2552601173 2024-08-20T01:55:13.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.302+0000 7f1cc4bb5640 1 --2- 172.21.15.79:0/2417387292 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x55b0027d4650 0x55b0027d6a70 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2d22d09cdcd155fb server_cookie=d4e697a30a43a8fd in_seq=0 out_seq=0 2024-08-20T01:55:13.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.302+0000 7f1c9ffff640 1 -- 172.21.15.79:0/2417387292 <== mds.3 v2:172.21.15.175:6834/2552601173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b00275a0a0 con 0x55b0027d4650 2024-08-20T01:55:13.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.302+0000 7f1c9ffff640 10 client.19878 handle_command_reply: tid=0 2024-08-20T01:55:13.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.302+0000 7f1cc9212740 1 client.19878 shutdown 2024-08-20T01:55:13.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.302+0000 7f1cc9212740 1 -- 172.21.15.79:0/2417387292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b0027491a0 msgr2=0x55b002761d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:13.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.302+0000 7f1cc9212740 1 --2- 172.21.15.79:0/2417387292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b0027491a0 0x55b002761d20 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f1cac0106b0 tx=0x7f1cac004060 comp rx=0 tx=0).stop 2024-08-20T01:55:13.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.302+0000 7f1cc9212740 1 -- 172.21.15.79:0/2417387292 shutdown_connections 2024-08-20T01:55:13.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.302+0000 7f1cc9212740 1 --2- 172.21.15.79:0/2417387292 >> [v2:172.21.15.175:6834/2552601173,v1:172.21.15.175:6835/2552601173] conn(0x55b0027d4650 0x55b0027d6a70 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:13.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.302+0000 7f1cc9212740 1 --2- 172.21.15.79:0/2417387292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b002759540 0x55b002770a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:13.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.302+0000 7f1cc9212740 1 --2- 172.21.15.79:0/2417387292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b0027491a0 0x55b002761d20 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:13.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.302+0000 7f1c9ffff640 0 client.19878 ms_handle_reset on v2:172.21.15.175:6834/2552601173 2024-08-20T01:55:13.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.302+0000 7f1cc9212740 1 --2- 172.21.15.79:0/2417387292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b002748880 0x55b0027617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:13.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.302+0000 7f1cc9212740 1 -- 172.21.15.79:0/2417387292 >> 172.21.15.79:0/2417387292 conn(0x55b0027466b0 msgr2=0x55b002757a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:13.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.303+0000 7f1cc9212740 1 -- 172.21.15.79:0/2417387292 shutdown_connections 2024-08-20T01:55:13.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.303+0000 7f1cc9212740 1 -- 172.21.15.79:0/2417387292 wait complete. 2024-08-20T01:55:13.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.303+0000 7f1cc9212740 20 client.19878 trim_cache size 0 max 16384 2024-08-20T01:55:13.324 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:55:13.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.303+0000 7f1cc6e19640 1 -- 172.21.15.79:0/3795579085 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1cb00b3bd0 msgr2=0x7f1cb00b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:13.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.303+0000 7f1cc6e19640 1 --2- 172.21.15.79:0/3795579085 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1cb00b3bd0 0x7f1cb00b6090 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f1cb804d000 tx=0x7f1cb804e000 comp rx=0 tx=0).stop 2024-08-20T01:55:13.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.303+0000 7f1cc6e19640 1 -- 172.21.15.79:0/3795579085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cc01019b0 msgr2=0x7f1cc0198e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:13.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.303+0000 7f1cc6e19640 1 --2- 172.21.15.79:0/3795579085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cc01019b0 0x7f1cc0198e70 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f1cb400d950 tx=0x7f1cb400de10 comp rx=0 tx=0).stop 2024-08-20T01:55:13.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.303+0000 7f1cc6e19640 1 -- 172.21.15.79:0/3795579085 shutdown_connections 2024-08-20T01:55:13.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.303+0000 7f1cc6e19640 1 --2- 172.21.15.79:0/3795579085 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1cb00b3bd0 0x7f1cb00b6090 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:13.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.303+0000 7f1cc6e19640 1 --2- 172.21.15.79:0/3795579085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cc0107d40 0x7f1cc019e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:13.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.303+0000 7f1cc6e19640 1 --2- 172.21.15.79:0/3795579085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cc01073c0 0x7f1cc01993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:13.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.304+0000 7f1cc6e19640 1 --2- 172.21.15.79:0/3795579085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cc01019b0 0x7f1cc0198e70 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:13.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.304+0000 7f1cc6e19640 1 -- 172.21.15.79:0/3795579085 >> 172.21.15.79:0/3795579085 conn(0x7f1cc00fd420 msgr2=0x7f1cc006b470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:13.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.304+0000 7f1cc6e19640 1 -- 172.21.15.79:0/3795579085 shutdown_connections 2024-08-20T01:55:13.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:13.304+0000 7f1cc6e19640 1 -- 172.21.15.79:0/3795579085 wait complete. 2024-08-20T01:55:14.094 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T01:55:14.344 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:55:14.661 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:14 smithi079 ceph-mon[18656]: pgmap v884: 97 pgs: 97 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 170 B/s wr, 20 op/s 2024-08-20T01:55:14.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:14 smithi081 ceph-mon[22209]: pgmap v884: 97 pgs: 97 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 170 B/s wr, 20 op/s 2024-08-20T01:55:14.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.859+0000 7f28d00d2640 1 -- 172.21.15.79:0/4106164019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28c81039a0 msgr2=0x7f28c8103d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:14.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.859+0000 7f28d00d2640 1 --2- 172.21.15.79:0/4106164019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28c81039a0 0x7f28c8103d80 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f28c4009900 tx=0x7f28c402a410 comp rx=0 tx=0).stop 2024-08-20T01:55:14.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.859+0000 7f28d00d2640 1 -- 172.21.15.79:0/4106164019 shutdown_connections 2024-08-20T01:55:14.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.859+0000 7f28d00d2640 1 --2- 172.21.15.79:0/4106164019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28c810ce00 0x7f28c810f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:14.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.859+0000 7f28d00d2640 1 --2- 172.21.15.79:0/4106164019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28c81042c0 0x7f28c810c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:14.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.859+0000 7f28d00d2640 1 --2- 172.21.15.79:0/4106164019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28c81039a0 0x7f28c8103d80 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:14.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.859+0000 7f28d00d2640 1 -- 172.21.15.79:0/4106164019 >> 172.21.15.79:0/4106164019 conn(0x7f28c80fd3e0 msgr2=0x7f28c80ff800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:14.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.859+0000 7f28d00d2640 1 -- 172.21.15.79:0/4106164019 shutdown_connections 2024-08-20T01:55:14.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.859+0000 7f28d00d2640 1 -- 172.21.15.79:0/4106164019 wait complete. 2024-08-20T01:55:14.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.859+0000 7f28d00d2640 1 Processor -- start 2024-08-20T01:55:14.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.859+0000 7f28d00d2640 1 -- start start 2024-08-20T01:55:14.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.859+0000 7f28d00d2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28c81039a0 0x7f28c8198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:14.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.859+0000 7f28d00d2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28c81042c0 0x7f28c8199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:14.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.859+0000 7f28d00d2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28c810ce00 0x7f28c819e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:14.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.859+0000 7f28d00d2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f28c8112920 con 0x7f28c810ce00 2024-08-20T01:55:14.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.859+0000 7f28d00d2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f28c81127a0 con 0x7f28c81042c0 2024-08-20T01:55:14.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.859+0000 7f28d00d2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f28c8112aa0 con 0x7f28c81039a0 2024-08-20T01:55:14.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.860+0000 7f28ce66f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28c810ce00 0x7f28c819e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:14.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.860+0000 7f28cde6e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28c81039a0 0x7f28c8198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:14.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.860+0000 7f28ce66f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28c810ce00 0x7f28c819e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57706/0 (socket says 172.21.15.79:57706) 2024-08-20T01:55:14.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.860+0000 7f28cde6e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28c81039a0 0x7f28c8198e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:50670/0 (socket says 172.21.15.79:50670) 2024-08-20T01:55:14.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.860+0000 7f28ce66f640 1 -- 172.21.15.79:0/1464407063 learned_addr learned my addr 172.21.15.79:0/1464407063 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:14.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.860+0000 7f28cd66d640 1 --2- 172.21.15.79:0/1464407063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28c81042c0 0x7f28c8199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:14.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.860+0000 7f28ce66f640 1 -- 172.21.15.79:0/1464407063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28c81039a0 msgr2=0x7f28c8198e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:14.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.860+0000 7f28ce66f640 1 --2- 172.21.15.79:0/1464407063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28c81039a0 0x7f28c8198e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:14.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.860+0000 7f28ce66f640 1 -- 172.21.15.79:0/1464407063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28c81042c0 msgr2=0x7f28c8199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:14.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.860+0000 7f28ce66f640 1 --2- 172.21.15.79:0/1464407063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28c81042c0 0x7f28c8199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:14.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.860+0000 7f28ce66f640 1 -- 172.21.15.79:0/1464407063 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28c819eec0 con 0x7f28c810ce00 2024-08-20T01:55:14.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.860+0000 7f28cde6e640 1 --2- 172.21.15.79:0/1464407063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28c81039a0 0x7f28c8198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:55:14.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.860+0000 7f28ce66f640 1 --2- 172.21.15.79:0/1464407063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28c810ce00 0x7f28c819e6f0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f28c000eb10 tx=0x7f28c000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:14.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.860+0000 7f28beffd640 1 -- 172.21.15.79:0/1464407063 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c0004b20 con 0x7f28c810ce00 2024-08-20T01:55:14.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.860+0000 7f28beffd640 1 -- 172.21.15.79:0/1464407063 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f28c0004cc0 con 0x7f28c810ce00 2024-08-20T01:55:14.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.860+0000 7f28beffd640 1 -- 172.21.15.79:0/1464407063 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c0010690 con 0x7f28c810ce00 2024-08-20T01:55:14.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.860+0000 7f28d00d2640 1 -- 172.21.15.79:0/1464407063 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28c819f1b0 con 0x7f28c810ce00 2024-08-20T01:55:14.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.860+0000 7f28d00d2640 1 -- 172.21.15.79:0/1464407063 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28c81a5870 con 0x7f28c810ce00 2024-08-20T01:55:14.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.863+0000 7f28beffd640 1 -- 172.21.15.79:0/1464407063 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f28c0005020 con 0x7f28c810ce00 2024-08-20T01:55:14.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.863+0000 7f28d24cb740 1 Processor -- start 2024-08-20T01:55:14.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.863+0000 7f28d24cb740 1 -- start start 2024-08-20T01:55:14.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.863+0000 7f28d24cb740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654be686c90 0x5654be687070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:14.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.863+0000 7f28d24cb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654be6875b0 0x5654be693000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:14.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.863+0000 7f28d24cb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654be693540 0x5654be695930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:14.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.863+0000 7f28d24cb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5654be5f9930 con 0x5654be693540 2024-08-20T01:55:14.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.863+0000 7f28d24cb740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5654be5e8e30 con 0x5654be686c90 2024-08-20T01:55:14.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.863+0000 7f28d24cb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5654be5ece70 con 0x5654be6875b0 2024-08-20T01:55:14.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.863+0000 7f28cd66d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654be693540 0x5654be695930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:14.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.863+0000 7f28cd66d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654be693540 0x5654be695930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57710/0 (socket says 172.21.15.79:57710) 2024-08-20T01:55:14.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.863+0000 7f28cd66d640 1 -- 172.21.15.79:0/1107967994 learned_addr learned my addr 172.21.15.79:0/1107967994 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:14.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.863+0000 7f28cd66d640 1 --2- 172.21.15.79:0/1107967994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654be686c90 0x5654be687070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:14.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.863+0000 7f28cde6e640 1 --2- 172.21.15.79:0/1107967994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654be6875b0 0x5654be693000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:14.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.864+0000 7f28beffd640 1 --2- 172.21.15.79:0/1464407063 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f28b40b3c50 0x7f28b40b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:14.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.864+0000 7f28cd66d640 1 -- 172.21.15.79:0/1107967994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654be6875b0 msgr2=0x5654be693000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:14.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.864+0000 7f28cd66d640 1 --2- 172.21.15.79:0/1107967994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654be6875b0 0x5654be693000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:14.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.864+0000 7f28cd66d640 1 -- 172.21.15.79:0/1107967994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654be686c90 msgr2=0x5654be687070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:14.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.864+0000 7f28cd66d640 1 --2- 172.21.15.79:0/1107967994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654be686c90 0x5654be687070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:14.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.864+0000 7f28cd66d640 1 -- 172.21.15.79:0/1107967994 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654be348650 con 0x5654be693540 2024-08-20T01:55:14.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.864+0000 7f28ce66f640 1 --2- 172.21.15.79:0/1464407063 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f28b40b3c50 0x7f28b40b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:14.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.864+0000 7f28cd66d640 1 --2- 172.21.15.79:0/1107967994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654be693540 0x5654be695930 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f28b80128c0 tx=0x7f28b800b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a871e08ff6d75399 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:14.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.864+0000 7f28beffd640 1 -- 172.21.15.79:0/1464407063 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f28c00e41c0 con 0x7f28c810ce00 2024-08-20T01:55:14.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.864+0000 7f28b3fff640 1 -- 172.21.15.79:0/1107967994 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b8004030 con 0x5654be693540 2024-08-20T01:55:14.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.864+0000 7f28b3fff640 1 -- 172.21.15.79:0/1107967994 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f28b800e750 con 0x5654be693540 2024-08-20T01:55:14.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.864+0000 7f28b3fff640 1 -- 172.21.15.79:0/1107967994 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b8003850 con 0x5654be693540 2024-08-20T01:55:14.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.865+0000 7f28d24cb740 1 -- 172.21.15.79:0/1107967994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654be693540 msgr2=0x5654be695930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:14.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.865+0000 7f28ce66f640 1 --2- 172.21.15.79:0/1464407063 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f28b40b3c50 0x7f28b40b6110 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f28c00a8390 tx=0x7f28c0077040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:14.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.865+0000 7f28d24cb740 1 --2- 172.21.15.79:0/1107967994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654be693540 0x5654be695930 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f28b80128c0 tx=0x7f28b800b4c0 comp rx=0 tx=0).stop 2024-08-20T01:55:14.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.865+0000 7f28d24cb740 1 -- 172.21.15.79:0/1107967994 shutdown_connections 2024-08-20T01:55:14.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.865+0000 7f28d24cb740 1 --2- 172.21.15.79:0/1107967994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654be693540 0x5654be695930 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:14.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.865+0000 7f28d24cb740 1 --2- 172.21.15.79:0/1107967994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654be6875b0 0x5654be693000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:14.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.865+0000 7f28d24cb740 1 --2- 172.21.15.79:0/1107967994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654be686c90 0x5654be687070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:14.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.865+0000 7f28d24cb740 1 -- 172.21.15.79:0/1107967994 >> 172.21.15.79:0/1107967994 conn(0x5654be684ac0 msgr2=0x5654be685c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:14.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.865+0000 7f28d24cb740 1 -- 172.21.15.79:0/1107967994 shutdown_connections 2024-08-20T01:55:14.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.865+0000 7f28d24cb740 1 -- 172.21.15.79:0/1107967994 wait complete. 2024-08-20T01:55:14.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.865+0000 7f28d24cb740 1 -- start start 2024-08-20T01:55:14.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.866+0000 7f28d24cb740 1 Processor -- start 2024-08-20T01:55:14.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.866+0000 7f28d24cb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654be686c90 0x5654be690460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:14.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.866+0000 7f28d24cb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654be6875b0 0x5654be6909a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:14.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.866+0000 7f28d24cb740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654be693540 0x5654be690ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:14.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.866+0000 7f28d24cb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5654be44b700 con 0x5654be686c90 2024-08-20T01:55:14.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.866+0000 7f28d24cb740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5654be56f810 con 0x5654be693540 2024-08-20T01:55:14.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.866+0000 7f28d24cb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5654be696160 con 0x5654be6875b0 2024-08-20T01:55:14.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.866+0000 7f28d24cb740 10 client.0 _ll_register_callbacks cb 0x5654be5e2700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:55:14.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.866+0000 7f28cd66d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654be686c90 0x5654be690460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:14.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.866+0000 7f28cd66d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654be686c90 0x5654be690460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57716/0 (socket says 172.21.15.79:57716) 2024-08-20T01:55:14.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.866+0000 7f28cd66d640 1 -- 172.21.15.79:0/569696174 learned_addr learned my addr 172.21.15.79:0/569696174 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:14.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.866+0000 7f28cde6e640 1 --2- 172.21.15.79:0/569696174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654be6875b0 0x5654be6909a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:14.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.866+0000 7f28cd66d640 1 --2- 172.21.15.79:0/569696174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654be693540 0x5654be690ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:14.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.866+0000 7f28cd66d640 1 -- 172.21.15.79:0/569696174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654be6875b0 msgr2=0x5654be6909a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:14.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.866+0000 7f28cd66d640 1 --2- 172.21.15.79:0/569696174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654be6875b0 0x5654be6909a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:14.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.866+0000 7f28cd66d640 1 -- 172.21.15.79:0/569696174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654be693540 msgr2=0x5654be690ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:14.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.866+0000 7f28cd66d640 1 --2- 172.21.15.79:0/569696174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654be693540 0x5654be690ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:14.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.866+0000 7f28cd66d640 1 -- 172.21.15.79:0/569696174 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654be69f4c0 con 0x5654be686c90 2024-08-20T01:55:14.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.867+0000 7f28cd66d640 1 --2- 172.21.15.79:0/569696174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654be686c90 0x5654be690460 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f28b8006010 tx=0x7f28b800b400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a8f69fd30b2cfae server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:14.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.867+0000 7f28b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:55:14.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.867+0000 7f28b17fa640 1 -- 172.21.15.79:0/569696174 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b8005240 con 0x5654be686c90 2024-08-20T01:55:14.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.867+0000 7f28b17fa640 1 -- 172.21.15.79:0/569696174 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f28b80053e0 con 0x5654be686c90 2024-08-20T01:55:14.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.867+0000 7f28d24cb740 1 -- 172.21.15.79:0/569696174 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5654be598150 con 0x5654be686c90 2024-08-20T01:55:14.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.867+0000 7f28b17fa640 1 -- 172.21.15.79:0/569696174 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f28b802a080 con 0x5654be686c90 2024-08-20T01:55:14.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.867+0000 7f28d24cb740 10 client.19890 fetch_fsmap learned FSMap version 71 2024-08-20T01:55:14.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.867+0000 7f28d24cb740 1 -- 172.21.15.79:0/569696174 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x5654be6a1e70 con 0x5654be686c90 2024-08-20T01:55:14.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.867+0000 7f28b17fa640 1 -- 172.21.15.79:0/569696174 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5654be598150 con 0x5654be686c90 2024-08-20T01:55:14.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.867+0000 7f28b17fa640 1 -- 172.21.15.79:0/569696174 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 71) ==== 8374+0+0 (secure 0 0 0) 0x7f28b801ec40 con 0x5654be686c90 2024-08-20T01:55:14.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.867+0000 7f28d24cb740 10 client.19890 fetch_fsmap finished waiting for FSMap version 71 2024-08-20T01:55:14.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.867+0000 7f28d24cb740 10 client.19890 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:55:14.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.867+0000 7f28d24cb740 20 client.19890 populate_metadata read hostname 'smithi079' 2024-08-20T01:55:14.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.867+0000 7f28d24cb740 1 --2- 172.21.15.79:0/569696174 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x5654be6a3270 0x5654be6a5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:14.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.867+0000 7f28d24cb740 4 client.19890 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:55:14.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.867+0000 7f28d24cb740 1 -- 172.21.15.79:0/569696174 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5654be5fb880 con 0x5654be6a3270 2024-08-20T01:55:14.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.868+0000 7f28cde6e640 1 --2- 172.21.15.79:0/569696174 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x5654be6a3270 0x5654be6a5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:14.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.868+0000 7f28cde6e640 1 --2- 172.21.15.79:0/569696174 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x5654be6a3270 0x5654be6a5660 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=56fd206eacc58cea server_cookie=9cc3da3109469182 in_seq=0 out_seq=0 2024-08-20T01:55:14.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.868+0000 7f28b17fa640 10 client.19890 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:55:14.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.869+0000 7f28b17fa640 1 -- 172.21.15.79:0/569696174 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5654be5fb880 con 0x5654be6a3270 2024-08-20T01:55:14.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.869+0000 7f28b17fa640 10 client.19890 handle_command_reply: tid=0 2024-08-20T01:55:14.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.869+0000 7f28d24cb740 1 client.19890 shutdown 2024-08-20T01:55:14.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.869+0000 7f28d24cb740 1 -- 172.21.15.79:0/569696174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654be686c90 msgr2=0x5654be690460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:14.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.869+0000 7f28d24cb740 1 --2- 172.21.15.79:0/569696174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654be686c90 0x5654be690460 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f28b8006010 tx=0x7f28b800b400 comp rx=0 tx=0).stop 2024-08-20T01:55:14.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.869+0000 7f28d24cb740 1 -- 172.21.15.79:0/569696174 shutdown_connections 2024-08-20T01:55:14.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.869+0000 7f28d24cb740 1 --2- 172.21.15.79:0/569696174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654be693540 0x5654be690ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:14.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.869+0000 7f28d24cb740 1 --2- 172.21.15.79:0/569696174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654be6875b0 0x5654be6909a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:14.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.869+0000 7f28d24cb740 1 --2- 172.21.15.79:0/569696174 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x5654be6a3270 0x5654be6a5660 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:14.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.869+0000 7f28d24cb740 1 --2- 172.21.15.79:0/569696174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654be686c90 0x5654be690460 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:14.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.869+0000 7f28b17fa640 0 client.19890 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:55:14.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.869+0000 7f28d24cb740 1 -- 172.21.15.79:0/569696174 >> 172.21.15.79:0/569696174 conn(0x5654be684ac0 msgr2=0x5654be68a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:14.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.869+0000 7f28d24cb740 1 -- 172.21.15.79:0/569696174 shutdown_connections 2024-08-20T01:55:14.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.869+0000 7f28d24cb740 1 -- 172.21.15.79:0/569696174 wait complete. 2024-08-20T01:55:14.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.869+0000 7f28d24cb740 20 client.19890 trim_cache size 0 max 16384 2024-08-20T01:55:14.891 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:14 smithi175 ceph-mon[22392]: pgmap v884: 97 pgs: 97 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 170 B/s wr, 20 op/s 2024-08-20T01:55:14.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.883+0000 7f28d24cb740 1 Processor -- start 2024-08-20T01:55:14.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.883+0000 7f28d24cb740 1 -- start start 2024-08-20T01:55:14.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.883+0000 7f28d24cb740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654be686c90 0x5654be692560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:14.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.883+0000 7f28d24cb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654be6875b0 0x5654be68abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:14.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.883+0000 7f28d24cb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654be693540 0x5654be68fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:14.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.883+0000 7f28d24cb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f28c81abd30 con 0x5654be6875b0 2024-08-20T01:55:14.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.883+0000 7f28d24cb740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f28c81ad8a0 con 0x5654be686c90 2024-08-20T01:55:14.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.883+0000 7f28d24cb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f28c81ac430 con 0x5654be693540 2024-08-20T01:55:14.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.883+0000 7f28cde6e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654be6875b0 0x5654be68abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:14.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.883+0000 7f28cde6e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654be6875b0 0x5654be68abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57732/0 (socket says 172.21.15.79:57732) 2024-08-20T01:55:14.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.884+0000 7f28cde6e640 1 -- 172.21.15.79:0/3430255234 learned_addr learned my addr 172.21.15.79:0/3430255234 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:14.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.884+0000 7f28cd66d640 1 --2- 172.21.15.79:0/3430255234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654be686c90 0x5654be692560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:14.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.884+0000 7f28cd66d640 1 --2- 172.21.15.79:0/3430255234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654be693540 0x5654be68fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:14.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.884+0000 7f28cde6e640 1 -- 172.21.15.79:0/3430255234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654be693540 msgr2=0x5654be68fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:14.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.884+0000 7f28cde6e640 1 --2- 172.21.15.79:0/3430255234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654be693540 0x5654be68fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:14.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.884+0000 7f28cde6e640 1 -- 172.21.15.79:0/3430255234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654be686c90 msgr2=0x5654be692560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:14.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.884+0000 7f28cde6e640 1 --2- 172.21.15.79:0/3430255234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654be686c90 0x5654be692560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:14.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.884+0000 7f28cde6e640 1 -- 172.21.15.79:0/3430255234 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654be6a5ac0 con 0x5654be6875b0 2024-08-20T01:55:14.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.884+0000 7f28cd66d640 1 --2- 172.21.15.79:0/3430255234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654be693540 0x5654be68fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:55:14.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.884+0000 7f28cde6e640 1 --2- 172.21.15.79:0/3430255234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654be6875b0 0x5654be68abd0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f28c4006010 tx=0x7f28c4032850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab6ce28bc5699bda server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:14.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.884+0000 7f28b37fe640 1 -- 172.21.15.79:0/3430255234 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c404d020 con 0x5654be6875b0 2024-08-20T01:55:14.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.884+0000 7f28b37fe640 1 -- 172.21.15.79:0/3430255234 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f28c4004240 con 0x5654be6875b0 2024-08-20T01:55:14.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.884+0000 7f28b37fe640 1 -- 172.21.15.79:0/3430255234 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c4035040 con 0x5654be6875b0 2024-08-20T01:55:14.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.885+0000 7f28d24cb740 1 -- 172.21.15.79:0/3430255234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654be6875b0 msgr2=0x5654be68abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:14.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.885+0000 7f28d24cb740 1 --2- 172.21.15.79:0/3430255234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654be6875b0 0x5654be68abd0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f28c4006010 tx=0x7f28c4032850 comp rx=0 tx=0).stop 2024-08-20T01:55:14.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.885+0000 7f28d24cb740 1 -- 172.21.15.79:0/3430255234 shutdown_connections 2024-08-20T01:55:14.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.885+0000 7f28d24cb740 1 --2- 172.21.15.79:0/3430255234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654be693540 0x5654be68fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:14.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.885+0000 7f28d24cb740 1 --2- 172.21.15.79:0/3430255234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654be6875b0 0x5654be68abd0 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:14.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.885+0000 7f28d24cb740 1 --2- 172.21.15.79:0/3430255234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654be686c90 0x5654be692560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:14.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.885+0000 7f28d24cb740 1 -- 172.21.15.79:0/3430255234 >> 172.21.15.79:0/3430255234 conn(0x5654be684ac0 msgr2=0x5654be67f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:14.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.885+0000 7f28d24cb740 1 -- 172.21.15.79:0/3430255234 shutdown_connections 2024-08-20T01:55:14.898 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.885+0000 7f28d24cb740 1 -- 172.21.15.79:0/3430255234 wait complete. 2024-08-20T01:55:14.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.885+0000 7f28d24cb740 1 -- start start 2024-08-20T01:55:14.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.885+0000 7f28d24cb740 1 Processor -- start 2024-08-20T01:55:14.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.886+0000 7f28d24cb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654be686c90 0x5654be68cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:14.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.886+0000 7f28d24cb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654be6875b0 0x5654be68d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:14.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.886+0000 7f28d24cb740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654be693540 0x5654be69a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:14.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.886+0000 7f28d24cb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f28c81ad1d0 con 0x5654be6875b0 2024-08-20T01:55:14.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.886+0000 7f28d24cb740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f28c81acb00 con 0x5654be693540 2024-08-20T01:55:14.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.886+0000 7f28d24cb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f28c81a9d30 con 0x5654be686c90 2024-08-20T01:55:14.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.886+0000 7f28d24cb740 10 client.0 _ll_register_callbacks cb 0x7f28b800bdd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:55:14.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.886+0000 7f28cde6e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654be6875b0 0x5654be68d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:14.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.886+0000 7f28cde6e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654be6875b0 0x5654be68d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57740/0 (socket says 172.21.15.79:57740) 2024-08-20T01:55:14.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.886+0000 7f28cde6e640 1 -- 172.21.15.79:0/591304927 learned_addr learned my addr 172.21.15.79:0/591304927 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:14.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.886+0000 7f28cd66d640 1 --2- 172.21.15.79:0/591304927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654be686c90 0x5654be68cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:14.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.886+0000 7f28cd66d640 1 --2- 172.21.15.79:0/591304927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654be693540 0x5654be69a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:14.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.886+0000 7f28cde6e640 1 -- 172.21.15.79:0/591304927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654be686c90 msgr2=0x5654be68cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:14.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.886+0000 7f28cde6e640 1 --2- 172.21.15.79:0/591304927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654be686c90 0x5654be68cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:14.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.886+0000 7f28cde6e640 1 -- 172.21.15.79:0/591304927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654be693540 msgr2=0x5654be69a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:14.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.886+0000 7f28cde6e640 1 --2- 172.21.15.79:0/591304927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654be693540 0x5654be69a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:14.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.886+0000 7f28cde6e640 1 -- 172.21.15.79:0/591304927 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654be69a960 con 0x5654be6875b0 2024-08-20T01:55:14.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.886+0000 7f28cde6e640 1 --2- 172.21.15.79:0/591304927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654be6875b0 0x5654be68d1b0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f28c40040c0 tx=0x7f28c40040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf3470d51b039ca server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:14.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.886+0000 7f28b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:55:14.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.887+0000 7f28b17fa640 1 -- 172.21.15.79:0/591304927 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c4057060 con 0x5654be6875b0 2024-08-20T01:55:14.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.887+0000 7f28b17fa640 1 -- 172.21.15.79:0/591304927 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f28c40037f0 con 0x5654be6875b0 2024-08-20T01:55:14.900 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.887+0000 7f28d24cb740 1 -- 172.21.15.79:0/591304927 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28c4004240 con 0x5654be6875b0 2024-08-20T01:55:14.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.887+0000 7f28b17fa640 1 -- 172.21.15.79:0/591304927 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f28c404d030 con 0x5654be6875b0 2024-08-20T01:55:14.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.887+0000 7f28d24cb740 10 client.19896 fetch_fsmap learned FSMap version 71 2024-08-20T01:55:14.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.887+0000 7f28d24cb740 1 -- 172.21.15.79:0/591304927 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x5654be69bb90 con 0x5654be6875b0 2024-08-20T01:55:14.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.887+0000 7f28b17fa640 1 -- 172.21.15.79:0/591304927 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f28c4004240 con 0x5654be6875b0 2024-08-20T01:55:14.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.887+0000 7f28b17fa640 1 -- 172.21.15.79:0/591304927 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 71) ==== 8374+0+0 (secure 0 0 0) 0x7f28c4031620 con 0x5654be6875b0 2024-08-20T01:55:14.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.887+0000 7f28d24cb740 10 client.19896 fetch_fsmap finished waiting for FSMap version 71 2024-08-20T01:55:14.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.887+0000 7f28d24cb740 10 client.19896 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-20T01:55:14.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.887+0000 7f28d24cb740 20 client.19896 populate_metadata read hostname 'smithi079' 2024-08-20T01:55:14.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.887+0000 7f28d24cb740 1 --2- 172.21.15.79:0/591304927 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x5654be70dd90 0x5654be7101b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:14.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.887+0000 7f28d24cb740 4 client.19896 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:55:14.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.887+0000 7f28d24cb740 1 -- 172.21.15.79:0/591304927 --> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5654be5f7320 con 0x5654be70dd90 2024-08-20T01:55:14.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.887+0000 7f28cd66d640 1 --2- 172.21.15.79:0/591304927 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x5654be70dd90 0x5654be7101b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:14.901 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.888+0000 7f28b17fa640 10 client.19896 ms_handle_connect on v2:172.21.15.175:6836/1767284089 2024-08-20T01:55:14.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.888+0000 7f28cd66d640 1 --2- 172.21.15.79:0/591304927 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x5654be70dd90 0x5654be7101b0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3bc2416c2da22f76 server_cookie=a601c5c964bbbe92 in_seq=0 out_seq=0 2024-08-20T01:55:14.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.888+0000 7f28b17fa640 1 -- 172.21.15.79:0/591304927 <== mds.2 v2:172.21.15.175:6836/1767284089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5654be5f7320 con 0x5654be70dd90 2024-08-20T01:55:14.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.888+0000 7f28b17fa640 10 client.19896 handle_command_reply: tid=0 2024-08-20T01:55:14.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.888+0000 7f28d24cb740 1 client.19896 shutdown 2024-08-20T01:55:14.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.888+0000 7f28d24cb740 1 -- 172.21.15.79:0/591304927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654be6875b0 msgr2=0x5654be68d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:14.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.888+0000 7f28d24cb740 1 --2- 172.21.15.79:0/591304927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654be6875b0 0x5654be68d1b0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f28c40040c0 tx=0x7f28c40040f0 comp rx=0 tx=0).stop 2024-08-20T01:55:14.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.888+0000 7f28d24cb740 1 -- 172.21.15.79:0/591304927 shutdown_connections 2024-08-20T01:55:14.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.888+0000 7f28d24cb740 1 --2- 172.21.15.79:0/591304927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654be693540 0x5654be69a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:14.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.888+0000 7f28d24cb740 1 --2- 172.21.15.79:0/591304927 >> [v2:172.21.15.175:6836/1767284089,v1:172.21.15.175:6837/1767284089] conn(0x5654be70dd90 0x5654be7101b0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:14.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.888+0000 7f28d24cb740 1 --2- 172.21.15.79:0/591304927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654be6875b0 0x5654be68d1b0 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:14.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.888+0000 7f28d24cb740 1 --2- 172.21.15.79:0/591304927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654be686c90 0x5654be68cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:14.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.888+0000 7f28b17fa640 0 client.19896 ms_handle_reset on v2:172.21.15.175:6836/1767284089 2024-08-20T01:55:14.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.888+0000 7f28d24cb740 1 -- 172.21.15.79:0/591304927 >> 172.21.15.79:0/591304927 conn(0x5654be684ac0 msgr2=0x5654be6903d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:14.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.888+0000 7f28d24cb740 1 -- 172.21.15.79:0/591304927 shutdown_connections 2024-08-20T01:55:14.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.888+0000 7f28d24cb740 1 -- 172.21.15.79:0/591304927 wait complete. 2024-08-20T01:55:14.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.888+0000 7f28d24cb740 20 client.19896 trim_cache size 0 max 16384 2024-08-20T01:55:14.903 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:55:14.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.889+0000 7f28d00d2640 1 -- 172.21.15.79:0/1464407063 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f28b40b3c50 msgr2=0x7f28b40b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:14.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.889+0000 7f28d00d2640 1 --2- 172.21.15.79:0/1464407063 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f28b40b3c50 0x7f28b40b6110 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f28c00a8390 tx=0x7f28c0077040 comp rx=0 tx=0).stop 2024-08-20T01:55:14.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.889+0000 7f28d00d2640 1 -- 172.21.15.79:0/1464407063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28c810ce00 msgr2=0x7f28c819e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:14.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.889+0000 7f28d00d2640 1 --2- 172.21.15.79:0/1464407063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28c810ce00 0x7f28c819e6f0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f28c000eb10 tx=0x7f28c000c2d0 comp rx=0 tx=0).stop 2024-08-20T01:55:14.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.889+0000 7f28d00d2640 1 -- 172.21.15.79:0/1464407063 shutdown_connections 2024-08-20T01:55:14.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.889+0000 7f28d00d2640 1 --2- 172.21.15.79:0/1464407063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28c810ce00 0x7f28c819e6f0 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:14.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.889+0000 7f28d00d2640 1 --2- 172.21.15.79:0/1464407063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28c81042c0 0x7f28c8199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:14.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.889+0000 7f28d00d2640 1 --2- 172.21.15.79:0/1464407063 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f28b40b3c50 0x7f28b40b6110 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:14.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.889+0000 7f28d00d2640 1 --2- 172.21.15.79:0/1464407063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28c81039a0 0x7f28c8198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:14.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.889+0000 7f28d00d2640 1 -- 172.21.15.79:0/1464407063 >> 172.21.15.79:0/1464407063 conn(0x7f28c80fd3e0 msgr2=0x7f28c80fdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:14.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.889+0000 7f28d00d2640 1 -- 172.21.15.79:0/1464407063 shutdown_connections 2024-08-20T01:55:14.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:14.889+0000 7f28d00d2640 1 -- 172.21.15.79:0/1464407063 wait complete. 2024-08-20T01:55:15.720 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T01:55:15.969 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:55:16.622 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:16 smithi079 ceph-mon[18656]: pgmap v885: 97 pgs: 97 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 341 B/s wr, 21 op/s 2024-08-20T01:55:16.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.620+0000 7f961ad46640 1 -- 172.21.15.79:0/2723861247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9614104cc0 msgr2=0x7f96141050a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:16.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.620+0000 7f961ad46640 1 --2- 172.21.15.79:0/2723861247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9614104cc0 0x7f96141050a0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f9608009900 tx=0x7f960802a410 comp rx=0 tx=0).stop 2024-08-20T01:55:16.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.620+0000 7f961ad46640 1 -- 172.21.15.79:0/2723861247 shutdown_connections 2024-08-20T01:55:16.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.620+0000 7f961ad46640 1 --2- 172.21.15.79:0/2723861247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f961410b050 0x7f9614111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:16.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.620+0000 7f961ad46640 1 --2- 172.21.15.79:0/2723861247 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f961410a6d0 0x7f961410ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:16.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.620+0000 7f961ad46640 1 --2- 172.21.15.79:0/2723861247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9614104cc0 0x7f96141050a0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:16.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.620+0000 7f961ad46640 1 -- 172.21.15.79:0/2723861247 >> 172.21.15.79:0/2723861247 conn(0x7f96141006f0 msgr2=0x7f9614102b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:16.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.620+0000 7f961ad46640 1 -- 172.21.15.79:0/2723861247 shutdown_connections 2024-08-20T01:55:16.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.620+0000 7f961ad46640 1 -- 172.21.15.79:0/2723861247 wait complete. 2024-08-20T01:55:16.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.621+0000 7f961ad46640 1 Processor -- start 2024-08-20T01:55:16.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.621+0000 7f961ad46640 1 -- start start 2024-08-20T01:55:16.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.621+0000 7f961ad46640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9614104cc0 0x7f961419b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:16.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.621+0000 7f961ad46640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f961410a6d0 0x7f961419b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:16.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.621+0000 7f961ad46640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f961410b050 0x7f96141a0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:16.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.621+0000 7f961ad46640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9614114b80 con 0x7f9614104cc0 2024-08-20T01:55:16.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.621+0000 7f961ad46640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9614114a00 con 0x7f961410b050 2024-08-20T01:55:16.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.621+0000 7f961ad46640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9614114d00 con 0x7f961410a6d0 2024-08-20T01:55:16.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.621+0000 7f9618ae2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9614104cc0 0x7f961419b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:16.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.621+0000 7f9613fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f961410a6d0 0x7f961419b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:16.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.621+0000 7f9613fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f961410a6d0 0x7f961419b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:50728/0 (socket says 172.21.15.79:50728) 2024-08-20T01:55:16.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.621+0000 7f9613fff640 1 -- 172.21.15.79:0/3527863249 learned_addr learned my addr 172.21.15.79:0/3527863249 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:16.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.622+0000 7f96192e3640 1 --2- 172.21.15.79:0/3527863249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f961410b050 0x7f96141a0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:16.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.622+0000 7f9613fff640 1 -- 172.21.15.79:0/3527863249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f961410b050 msgr2=0x7f96141a0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:16.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.622+0000 7f9613fff640 1 --2- 172.21.15.79:0/3527863249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f961410b050 0x7f96141a0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:16.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.622+0000 7f9613fff640 1 -- 172.21.15.79:0/3527863249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9614104cc0 msgr2=0x7f961419b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:16.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.622+0000 7f9613fff640 1 --2- 172.21.15.79:0/3527863249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9614104cc0 0x7f961419b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:16.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.622+0000 7f9613fff640 1 -- 172.21.15.79:0/3527863249 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96141a1160 con 0x7f961410a6d0 2024-08-20T01:55:16.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.622+0000 7f9618ae2640 1 --2- 172.21.15.79:0/3527863249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9614104cc0 0x7f961419b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:55:16.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.622+0000 7f9613fff640 1 --2- 172.21.15.79:0/3527863249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f961410a6d0 0x7f961419b5f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f960000d950 tx=0x7f960000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:16.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.622+0000 7f9611ffb640 1 -- 172.21.15.79:0/3527863249 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9600017070 con 0x7f961410a6d0 2024-08-20T01:55:16.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.622+0000 7f961ad46640 1 -- 172.21.15.79:0/3527863249 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96141a1450 con 0x7f961410a6d0 2024-08-20T01:55:16.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.622+0000 7f9611ffb640 1 -- 172.21.15.79:0/3527863249 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9600009c30 con 0x7f961410a6d0 2024-08-20T01:55:16.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.622+0000 7f9611ffb640 1 -- 172.21.15.79:0/3527863249 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960000f620 con 0x7f961410a6d0 2024-08-20T01:55:16.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.622+0000 7f961ad46640 1 -- 172.21.15.79:0/3527863249 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96141a7ce0 con 0x7f961410a6d0 2024-08-20T01:55:16.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.625+0000 7f9611ffb640 1 -- 172.21.15.79:0/3527863249 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f9600010460 con 0x7f961410a6d0 2024-08-20T01:55:16.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.625+0000 7f961d13f740 1 Processor -- start 2024-08-20T01:55:16.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.625+0000 7f961d13f740 1 -- start start 2024-08-20T01:55:16.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.625+0000 7f961d13f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e22238b880 0x55e22238bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:16.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.625+0000 7f961d13f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22238c1a0 0x55e222397bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:16.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.625+0000 7f961d13f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e222398130 0x55e22239a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:16.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.626+0000 7f961d13f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e222302930 con 0x55e222398130 2024-08-20T01:55:16.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.626+0000 7f961d13f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e2222f1e30 con 0x55e22238b880 2024-08-20T01:55:16.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.626+0000 7f961d13f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e2222f5e70 con 0x55e22238c1a0 2024-08-20T01:55:16.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.626+0000 7f9611ffb640 1 --2- 172.21.15.79:0/3527863249 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f96040b3bd0 0x7f96040b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:16.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.626+0000 7f96192e3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e22238b880 0x55e22238bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:16.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.626+0000 7f9613fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e222398130 0x55e22239a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:16.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.626+0000 7f96192e3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e22238b880 0x55e22238bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:47740/0 (socket says 172.21.15.79:47740) 2024-08-20T01:55:16.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.626+0000 7f96192e3640 1 -- 172.21.15.79:0/3363154976 learned_addr learned my addr 172.21.15.79:0/3363154976 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:16.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.626+0000 7f9618ae2640 1 --2- 172.21.15.79:0/3363154976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22238c1a0 0x55e222397bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:16.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.626+0000 7f96192e3640 1 --2- 172.21.15.79:0/3527863249 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f96040b3bd0 0x7f96040b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:16.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.626+0000 7f9611ffb640 1 -- 172.21.15.79:0/3527863249 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f96000e3860 con 0x7f961410a6d0 2024-08-20T01:55:16.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.626+0000 7f9613fff640 1 -- 172.21.15.79:0/3363154976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22238c1a0 msgr2=0x55e222397bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:16.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.626+0000 7f9613fff640 1 --2- 172.21.15.79:0/3363154976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22238c1a0 0x55e222397bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:16.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.626+0000 7f9613fff640 1 -- 172.21.15.79:0/3363154976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e22238b880 msgr2=0x55e22238bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:16.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.626+0000 7f9613fff640 1 --2- 172.21.15.79:0/3363154976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e22238b880 0x55e22238bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:16.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.626+0000 7f9613fff640 1 -- 172.21.15.79:0/3363154976 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e222051650 con 0x55e222398130 2024-08-20T01:55:16.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.626+0000 7f9618ae2640 1 --2- 172.21.15.79:0/3363154976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22238c1a0 0x55e222397bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:55:16.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.626+0000 7f96192e3640 1 --2- 172.21.15.79:0/3363154976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e22238b880 0x55e22238bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:55:16.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.626+0000 7f9613fff640 1 --2- 172.21.15.79:0/3363154976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e222398130 0x55e22239a520 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f96000e12e0 tx=0x7f96000a6750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b30ed7e05acd006 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:16.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.626+0000 7f95feffd640 1 -- 172.21.15.79:0/3363154976 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9600020070 con 0x55e222398130 2024-08-20T01:55:16.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.627+0000 7f96192e3640 1 --2- 172.21.15.79:0/3527863249 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f96040b3bd0 0x7f96040b6090 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f960c009370 tx=0x7f960c004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:16.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.627+0000 7f95feffd640 1 -- 172.21.15.79:0/3363154976 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f96000aa270 con 0x55e222398130 2024-08-20T01:55:16.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.627+0000 7f95feffd640 1 -- 172.21.15.79:0/3363154976 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96000cd2f0 con 0x55e222398130 2024-08-20T01:55:16.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.627+0000 7f961d13f740 1 -- 172.21.15.79:0/3363154976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e222398130 msgr2=0x55e22239a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:16.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.627+0000 7f961d13f740 1 --2- 172.21.15.79:0/3363154976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e222398130 0x55e22239a520 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f96000e12e0 tx=0x7f96000a6750 comp rx=0 tx=0).stop 2024-08-20T01:55:16.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.627+0000 7f961d13f740 1 -- 172.21.15.79:0/3363154976 shutdown_connections 2024-08-20T01:55:16.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.627+0000 7f961d13f740 1 --2- 172.21.15.79:0/3363154976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e222398130 0x55e22239a520 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:16.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.627+0000 7f961d13f740 1 --2- 172.21.15.79:0/3363154976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22238c1a0 0x55e222397bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:16.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.627+0000 7f961d13f740 1 --2- 172.21.15.79:0/3363154976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e22238b880 0x55e22238bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:16.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.627+0000 7f961d13f740 1 -- 172.21.15.79:0/3363154976 >> 172.21.15.79:0/3363154976 conn(0x55e2223896b0 msgr2=0x55e22238a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:16.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.627+0000 7f961d13f740 1 -- 172.21.15.79:0/3363154976 shutdown_connections 2024-08-20T01:55:16.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.627+0000 7f961d13f740 1 -- 172.21.15.79:0/3363154976 wait complete. 2024-08-20T01:55:16.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.628+0000 7f961d13f740 1 -- start start 2024-08-20T01:55:16.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.628+0000 7f961d13f740 1 Processor -- start 2024-08-20T01:55:16.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.628+0000 7f961d13f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22238b880 0x55e222395130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:16.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.628+0000 7f961d13f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e22238c1a0 0x55e222395670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:16.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.628+0000 7f961d13f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e222398130 0x55e222395bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:16.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.628+0000 7f961d13f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e222154700 con 0x55e222398130 2024-08-20T01:55:16.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.628+0000 7f961d13f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e222278810 con 0x55e22238c1a0 2024-08-20T01:55:16.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.628+0000 7f961d13f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e22239ad20 con 0x55e22238b880 2024-08-20T01:55:16.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.628+0000 7f961d13f740 10 client.0 _ll_register_callbacks cb 0x55e2222eb700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:55:16.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.628+0000 7f96192e3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e222398130 0x55e222395bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:16.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.628+0000 7f96192e3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e222398130 0x55e222395bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57766/0 (socket says 172.21.15.79:57766) 2024-08-20T01:55:16.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.628+0000 7f9618ae2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22238b880 0x55e222395130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:16.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.628+0000 7f96192e3640 1 -- 172.21.15.79:0/306282896 learned_addr learned my addr 172.21.15.79:0/306282896 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:16.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.629+0000 7f9613fff640 1 --2- 172.21.15.79:0/306282896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e22238c1a0 0x55e222395670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:16.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.629+0000 7f9618ae2640 1 -- 172.21.15.79:0/306282896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e22238c1a0 msgr2=0x55e222395670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:16.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.629+0000 7f9618ae2640 1 --2- 172.21.15.79:0/306282896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e22238c1a0 0x55e222395670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:16.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.629+0000 7f9618ae2640 1 -- 172.21.15.79:0/306282896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e222398130 msgr2=0x55e222395bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:16.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.629+0000 7f9618ae2640 1 --2- 172.21.15.79:0/306282896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e222398130 0x55e222395bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:16.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.629+0000 7f9618ae2640 1 -- 172.21.15.79:0/306282896 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2223a4150 con 0x55e22238b880 2024-08-20T01:55:16.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.629+0000 7f9618ae2640 1 --2- 172.21.15.79:0/306282896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22238b880 0x55e222395130 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9608005940 tx=0x7f9608031800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d149aec533c1cef server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:16.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.629+0000 7f95f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-08-20T01:55:16.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.629+0000 7f95f3fff640 1 -- 172.21.15.79:0/306282896 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9608035040 con 0x55e22238b880 2024-08-20T01:55:16.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.629+0000 7f95f3fff640 1 -- 172.21.15.79:0/306282896 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9608004450 con 0x55e22238b880 2024-08-20T01:55:16.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.629+0000 7f961d13f740 1 -- 172.21.15.79:0/306282896 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e2222a1150 con 0x55e22238b880 2024-08-20T01:55:16.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.629+0000 7f95f3fff640 1 -- 172.21.15.79:0/306282896 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f96080035f0 con 0x55e22238b880 2024-08-20T01:55:16.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.629+0000 7f961d13f740 10 client.28861 fetch_fsmap learned FSMap version 71 2024-08-20T01:55:16.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.629+0000 7f961d13f740 1 -- 172.21.15.79:0/306282896 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55e2223a6b30 con 0x55e22238b880 2024-08-20T01:55:16.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.630+0000 7f95f3fff640 1 -- 172.21.15.79:0/306282896 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55e2222a1150 con 0x55e22238b880 2024-08-20T01:55:16.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.630+0000 7f95f3fff640 1 -- 172.21.15.79:0/306282896 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 71) ==== 8374+0+0 (secure 0 0 0) 0x7f9608044070 con 0x55e22238b880 2024-08-20T01:55:16.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.630+0000 7f961d13f740 10 client.28861 fetch_fsmap finished waiting for FSMap version 71 2024-08-20T01:55:16.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.630+0000 7f961d13f740 10 client.28861 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:55:16.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.630+0000 7f961d13f740 20 client.28861 populate_metadata read hostname 'smithi079' 2024-08-20T01:55:16.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.630+0000 7f961d13f740 1 --2- 172.21.15.79:0/306282896 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55e2223a7fe0 0x55e2223aa3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:16.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.630+0000 7f961d13f740 4 client.28861 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:55:16.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.630+0000 7f961d13f740 1 -- 172.21.15.79:0/306282896 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e222304880 con 0x55e2223a7fe0 2024-08-20T01:55:16.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.630+0000 7f9613fff640 1 --2- 172.21.15.79:0/306282896 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55e2223a7fe0 0x55e2223aa3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:16.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.630+0000 7f9613fff640 1 --2- 172.21.15.79:0/306282896 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55e2223a7fe0 0x55e2223aa3d0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1828402294748be7 server_cookie=75bb06503c4cc5c7 in_seq=0 out_seq=0 2024-08-20T01:55:16.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.630+0000 7f95f3fff640 10 client.28861 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:55:16.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.631+0000 7f95f3fff640 1 -- 172.21.15.79:0/306282896 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e222304880 con 0x55e2223a7fe0 2024-08-20T01:55:16.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.631+0000 7f95f3fff640 10 client.28861 handle_command_reply: tid=0 2024-08-20T01:55:16.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.631+0000 7f961d13f740 1 client.28861 shutdown 2024-08-20T01:55:16.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.631+0000 7f961d13f740 1 -- 172.21.15.79:0/306282896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22238b880 msgr2=0x55e222395130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:16.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.631+0000 7f961d13f740 1 --2- 172.21.15.79:0/306282896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22238b880 0x55e222395130 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9608005940 tx=0x7f9608031800 comp rx=0 tx=0).stop 2024-08-20T01:55:16.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.631+0000 7f961d13f740 1 -- 172.21.15.79:0/306282896 shutdown_connections 2024-08-20T01:55:16.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.631+0000 7f961d13f740 1 --2- 172.21.15.79:0/306282896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e222398130 0x55e222395bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:16.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.631+0000 7f961d13f740 1 --2- 172.21.15.79:0/306282896 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55e2223a7fe0 0x55e2223aa3d0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:16.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.631+0000 7f961d13f740 1 --2- 172.21.15.79:0/306282896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e22238c1a0 0x55e222395670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:16.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.631+0000 7f961d13f740 1 --2- 172.21.15.79:0/306282896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22238b880 0x55e222395130 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:16.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.631+0000 7f95f3fff640 0 client.28861 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:55:16.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.631+0000 7f961d13f740 1 -- 172.21.15.79:0/306282896 >> 172.21.15.79:0/306282896 conn(0x55e2223896b0 msgr2=0x55e22238f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:16.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.631+0000 7f961d13f740 1 -- 172.21.15.79:0/306282896 shutdown_connections 2024-08-20T01:55:16.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.631+0000 7f961d13f740 1 -- 172.21.15.79:0/306282896 wait complete. 2024-08-20T01:55:16.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.632+0000 7f961d13f740 20 client.28861 trim_cache size 0 max 16384 2024-08-20T01:55:16.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.644+0000 7f961d13f740 1 Processor -- start 2024-08-20T01:55:16.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.644+0000 7f961d13f740 1 -- start start 2024-08-20T01:55:16.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.644+0000 7f961d13f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e22238b880 0x55e222397230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:16.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.644+0000 7f961d13f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22238c1a0 0x55e2223afca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:16.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.644+0000 7f961d13f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e222398130 0x55e2223b01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:16.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.644+0000 7f961d13f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f96141b0110 con 0x55e222398130 2024-08-20T01:55:16.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.644+0000 7f961d13f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f96141b1c80 con 0x55e22238b880 2024-08-20T01:55:16.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.644+0000 7f961d13f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f96141b0810 con 0x55e22238c1a0 2024-08-20T01:55:16.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.644+0000 7f96192e3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e222398130 0x55e2223b01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:16.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.645+0000 7f96192e3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e222398130 0x55e2223b01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57778/0 (socket says 172.21.15.79:57778) 2024-08-20T01:55:16.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.645+0000 7f96192e3640 1 -- 172.21.15.79:0/3300427346 learned_addr learned my addr 172.21.15.79:0/3300427346 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:16.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.645+0000 7f9613fff640 1 --2- 172.21.15.79:0/3300427346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22238c1a0 0x55e2223afca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:16.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.645+0000 7f9618ae2640 1 --2- 172.21.15.79:0/3300427346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e22238b880 0x55e222397230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:16.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.645+0000 7f96192e3640 1 -- 172.21.15.79:0/3300427346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22238c1a0 msgr2=0x55e2223afca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:16.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.645+0000 7f96192e3640 1 --2- 172.21.15.79:0/3300427346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22238c1a0 0x55e2223afca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:16.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.645+0000 7f96192e3640 1 -- 172.21.15.79:0/3300427346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e22238b880 msgr2=0x55e222397230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:16.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.645+0000 7f96192e3640 1 --2- 172.21.15.79:0/3300427346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e22238b880 0x55e222397230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:16.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.645+0000 7f96192e3640 1 -- 172.21.15.79:0/3300427346 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2223aa740 con 0x55e222398130 2024-08-20T01:55:16.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.645+0000 7f9613fff640 1 --2- 172.21.15.79:0/3300427346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22238c1a0 0x55e2223afca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:55:16.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.645+0000 7f9618ae2640 1 --2- 172.21.15.79:0/3300427346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e22238b880 0x55e222397230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:55:16.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.645+0000 7f96192e3640 1 --2- 172.21.15.79:0/3300427346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e222398130 0x55e2223b01e0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f960c011c40 tx=0x7f960c009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7a339287b71fef2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:16.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.645+0000 7f95fe7fc640 1 -- 172.21.15.79:0/3300427346 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960c014250 con 0x55e222398130 2024-08-20T01:55:16.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.645+0000 7f95fe7fc640 1 -- 172.21.15.79:0/3300427346 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f960c018070 con 0x55e222398130 2024-08-20T01:55:16.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.645+0000 7f95fe7fc640 1 -- 172.21.15.79:0/3300427346 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960c0053a0 con 0x55e222398130 2024-08-20T01:55:16.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.646+0000 7f961d13f740 1 -- 172.21.15.79:0/3300427346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e222398130 msgr2=0x55e2223b01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:16.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.646+0000 7f961d13f740 1 --2- 172.21.15.79:0/3300427346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e222398130 0x55e2223b01e0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f960c011c40 tx=0x7f960c009800 comp rx=0 tx=0).stop 2024-08-20T01:55:16.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.646+0000 7f961d13f740 1 -- 172.21.15.79:0/3300427346 shutdown_connections 2024-08-20T01:55:16.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.646+0000 7f961d13f740 1 --2- 172.21.15.79:0/3300427346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e222398130 0x55e2223b01e0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:16.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.646+0000 7f961d13f740 1 --2- 172.21.15.79:0/3300427346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22238c1a0 0x55e2223afca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:16.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.646+0000 7f961d13f740 1 --2- 172.21.15.79:0/3300427346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e22238b880 0x55e222397230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:16.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.646+0000 7f961d13f740 1 -- 172.21.15.79:0/3300427346 >> 172.21.15.79:0/3300427346 conn(0x55e2223896b0 msgr2=0x55e2223a3650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:16.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.646+0000 7f961d13f740 1 -- 172.21.15.79:0/3300427346 shutdown_connections 2024-08-20T01:55:16.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.646+0000 7f961d13f740 1 -- 172.21.15.79:0/3300427346 wait complete. 2024-08-20T01:55:16.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.646+0000 7f961d13f740 1 -- start start 2024-08-20T01:55:16.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.646+0000 7f961d13f740 1 Processor -- start 2024-08-20T01:55:16.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.647+0000 7f961d13f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e22238b880 0x55e22239de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:16.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.647+0000 7f961d13f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e22238c1a0 0x55e22239e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:16.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.647+0000 7f961d13f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e222398130 0x55e22239e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:16.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.647+0000 7f961d13f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f96141b15b0 con 0x55e22238b880 2024-08-20T01:55:16.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.647+0000 7f961d13f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f96141b0ee0 con 0x55e22238c1a0 2024-08-20T01:55:16.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.647+0000 7f961d13f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f96141ae0f0 con 0x55e222398130 2024-08-20T01:55:16.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.647+0000 7f961d13f740 10 client.0 _ll_register_callbacks cb 0x7f9608009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:55:16.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.647+0000 7f9618ae2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e22238b880 0x55e22239de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:16.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.647+0000 7f9618ae2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e22238b880 0x55e22239de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57792/0 (socket says 172.21.15.79:57792) 2024-08-20T01:55:16.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.647+0000 7f9618ae2640 1 -- 172.21.15.79:0/3435061557 learned_addr learned my addr 172.21.15.79:0/3435061557 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:16.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.647+0000 7f96192e3640 1 --2- 172.21.15.79:0/3435061557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e222398130 0x55e22239e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:16.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.647+0000 7f9613fff640 1 --2- 172.21.15.79:0/3435061557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e22238c1a0 0x55e22239e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:16.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.647+0000 7f9618ae2640 1 -- 172.21.15.79:0/3435061557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e222398130 msgr2=0x55e22239e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:16.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.647+0000 7f9618ae2640 1 --2- 172.21.15.79:0/3435061557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e222398130 0x55e22239e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:16.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.647+0000 7f9618ae2640 1 -- 172.21.15.79:0/3435061557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e22238c1a0 msgr2=0x55e22239e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:16.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.647+0000 7f9618ae2640 1 --2- 172.21.15.79:0/3435061557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e22238c1a0 0x55e22239e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:16.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.647+0000 7f9618ae2640 1 -- 172.21.15.79:0/3435061557 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e222411d00 con 0x55e22238b880 2024-08-20T01:55:16.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.647+0000 7f96192e3640 1 --2- 172.21.15.79:0/3435061557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e222398130 0x55e22239e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:55:16.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.647+0000 7f9618ae2640 1 --2- 172.21.15.79:0/3435061557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e22238b880 0x55e22239de60 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f960802a450 tx=0x7f9608046750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1472105dc7592bcc server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:16.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.647+0000 7f95f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:55:16.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.648+0000 7f95f3fff640 1 -- 172.21.15.79:0/3435061557 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9608054020 con 0x55e22238b880 2024-08-20T01:55:16.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.648+0000 7f95f3fff640 1 -- 172.21.15.79:0/3435061557 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f9608004450 con 0x55e22238b880 2024-08-20T01:55:16.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.648+0000 7f961d13f740 1 -- 172.21.15.79:0/3435061557 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f960c018070 con 0x55e22238b880 2024-08-20T01:55:16.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.648+0000 7f95f3fff640 1 -- 172.21.15.79:0/3435061557 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f9608035040 con 0x55e22238b880 2024-08-20T01:55:16.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.648+0000 7f961d13f740 10 client.19914 fetch_fsmap learned FSMap version 71 2024-08-20T01:55:16.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.648+0000 7f961d13f740 1 -- 172.21.15.79:0/3435061557 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55e222413000 con 0x55e22238b880 2024-08-20T01:55:16.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.648+0000 7f95f3fff640 1 -- 172.21.15.79:0/3435061557 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f960c018070 con 0x55e22238b880 2024-08-20T01:55:16.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.648+0000 7f95f3fff640 1 -- 172.21.15.79:0/3435061557 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 71) ==== 8374+0+0 (secure 0 0 0) 0x7f9608044050 con 0x55e22238b880 2024-08-20T01:55:16.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.648+0000 7f961d13f740 10 client.19914 fetch_fsmap finished waiting for FSMap version 71 2024-08-20T01:55:16.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.648+0000 7f961d13f740 10 client.19914 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T01:55:16.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.648+0000 7f961d13f740 20 client.19914 populate_metadata read hostname 'smithi079' 2024-08-20T01:55:16.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.648+0000 7f961d13f740 1 --2- 172.21.15.79:0/3435061557 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55e2224137d0 0x55e222415bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:16.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.648+0000 7f961d13f740 4 client.19914 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:55:16.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.648+0000 7f961d13f740 1 -- 172.21.15.79:0/3435061557 --> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e222300320 con 0x55e2224137d0 2024-08-20T01:55:16.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.648+0000 7f9613fff640 1 --2- 172.21.15.79:0/3435061557 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55e2224137d0 0x55e222415bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:16.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.649+0000 7f95f3fff640 10 client.19914 ms_handle_connect on v2:172.21.15.175:6838/1331748742 2024-08-20T01:55:16.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.649+0000 7f9613fff640 1 --2- 172.21.15.79:0/3435061557 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55e2224137d0 0x55e222415bf0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=69f126928673d2c3 server_cookie=7b1aa0e0360728ea in_seq=0 out_seq=0 2024-08-20T01:55:16.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.649+0000 7f95f3fff640 1 -- 172.21.15.79:0/3435061557 <== mds.1 v2:172.21.15.175:6838/1331748742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e222300320 con 0x55e2224137d0 2024-08-20T01:55:16.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.649+0000 7f95f3fff640 10 client.19914 handle_command_reply: tid=0 2024-08-20T01:55:16.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.649+0000 7f961d13f740 1 client.19914 shutdown 2024-08-20T01:55:16.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.649+0000 7f961d13f740 1 -- 172.21.15.79:0/3435061557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e22238b880 msgr2=0x55e22239de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:16.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.649+0000 7f961d13f740 1 --2- 172.21.15.79:0/3435061557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e22238b880 0x55e22239de60 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f960802a450 tx=0x7f9608046750 comp rx=0 tx=0).stop 2024-08-20T01:55:16.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.649+0000 7f961d13f740 1 -- 172.21.15.79:0/3435061557 shutdown_connections 2024-08-20T01:55:16.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.649+0000 7f961d13f740 1 --2- 172.21.15.79:0/3435061557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e222398130 0x55e22239e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:16.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.649+0000 7f961d13f740 1 --2- 172.21.15.79:0/3435061557 >> [v2:172.21.15.175:6838/1331748742,v1:172.21.15.175:6839/1331748742] conn(0x55e2224137d0 0x55e222415bf0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:16.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.649+0000 7f961d13f740 1 --2- 172.21.15.79:0/3435061557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e22238c1a0 0x55e22239e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:16.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.649+0000 7f961d13f740 1 --2- 172.21.15.79:0/3435061557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e22238b880 0x55e22239de60 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:16.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.649+0000 7f95f3fff640 0 client.19914 ms_handle_reset on v2:172.21.15.175:6838/1331748742 2024-08-20T01:55:16.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.649+0000 7f961d13f740 1 -- 172.21.15.79:0/3435061557 >> 172.21.15.79:0/3435061557 conn(0x55e2223896b0 msgr2=0x55e222387f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:16.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.649+0000 7f961d13f740 1 -- 172.21.15.79:0/3435061557 shutdown_connections 2024-08-20T01:55:16.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.649+0000 7f961d13f740 1 -- 172.21.15.79:0/3435061557 wait complete. 2024-08-20T01:55:16.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.649+0000 7f961d13f740 20 client.19914 trim_cache size 0 max 16384 2024-08-20T01:55:16.658 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:55:16.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.650+0000 7f961ad46640 1 -- 172.21.15.79:0/3527863249 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f96040b3bd0 msgr2=0x7f96040b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:16.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.650+0000 7f961ad46640 1 --2- 172.21.15.79:0/3527863249 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f96040b3bd0 0x7f96040b6090 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f960c009370 tx=0x7f960c004ab0 comp rx=0 tx=0).stop 2024-08-20T01:55:16.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.650+0000 7f961ad46640 1 -- 172.21.15.79:0/3527863249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f961410a6d0 msgr2=0x7f961419b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:16.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.650+0000 7f961ad46640 1 --2- 172.21.15.79:0/3527863249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f961410a6d0 0x7f961419b5f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f960000d950 tx=0x7f960000de10 comp rx=0 tx=0).stop 2024-08-20T01:55:16.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.650+0000 7f961ad46640 1 -- 172.21.15.79:0/3527863249 shutdown_connections 2024-08-20T01:55:16.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.650+0000 7f961ad46640 1 --2- 172.21.15.79:0/3527863249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f961410b050 0x7f96141a0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:16.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.650+0000 7f961ad46640 1 --2- 172.21.15.79:0/3527863249 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f96040b3bd0 0x7f96040b6090 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:16.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.650+0000 7f961ad46640 1 --2- 172.21.15.79:0/3527863249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f961410a6d0 0x7f961419b5f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:16.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.650+0000 7f961ad46640 1 --2- 172.21.15.79:0/3527863249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9614104cc0 0x7f961419b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:16.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.650+0000 7f961ad46640 1 -- 172.21.15.79:0/3527863249 >> 172.21.15.79:0/3527863249 conn(0x7f96141006f0 msgr2=0x7f9614102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:16.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.650+0000 7f961ad46640 1 -- 172.21.15.79:0/3527863249 shutdown_connections 2024-08-20T01:55:16.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:16.650+0000 7f961ad46640 1 -- 172.21.15.79:0/3527863249 wait complete. 2024-08-20T01:55:16.691 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:16 smithi175 ceph-mon[22392]: pgmap v885: 97 pgs: 97 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 341 B/s wr, 21 op/s 2024-08-20T01:55:16.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:16 smithi081 ceph-mon[22209]: pgmap v885: 97 pgs: 97 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 341 B/s wr, 21 op/s 2024-08-20T01:55:17.440 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T01:55:17.687 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:55:18.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.178+0000 7f18b6304640 1 -- 172.21.15.79:0/3714067618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18b0107d20 msgr2=0x7f18b010e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:18.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.178+0000 7f18b6304640 1 --2- 172.21.15.79:0/3714067618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18b0107d20 0x7f18b010e520 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f18a8009ca0 tx=0x7f18a802a8c0 comp rx=0 tx=0).stop 2024-08-20T01:55:18.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.178+0000 7f18b6304640 1 -- 172.21.15.79:0/3714067618 shutdown_connections 2024-08-20T01:55:18.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.178+0000 7f18b6304640 1 --2- 172.21.15.79:0/3714067618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18b0107d20 0x7f18b010e520 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:18.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.178+0000 7f18b6304640 1 --2- 172.21.15.79:0/3714067618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18b01073a0 0x7f18b01077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:18.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.178+0000 7f18b6304640 1 --2- 172.21.15.79:0/3714067618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18b0101990 0x7f18b0101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:18.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.178+0000 7f18b6304640 1 -- 172.21.15.79:0/3714067618 >> 172.21.15.79:0/3714067618 conn(0x7f18b00fd400 msgr2=0x7f18b00ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:18.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.178+0000 7f18b6304640 1 -- 172.21.15.79:0/3714067618 shutdown_connections 2024-08-20T01:55:18.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.178+0000 7f18b6304640 1 -- 172.21.15.79:0/3714067618 wait complete. 2024-08-20T01:55:18.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.179+0000 7f18b6304640 1 Processor -- start 2024-08-20T01:55:18.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.179+0000 7f18b6304640 1 -- start start 2024-08-20T01:55:18.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.179+0000 7f18b6304640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18b0101990 0x7f18b0198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:18.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.179+0000 7f18b6304640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18b01073a0 0x7f18b0199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:18.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.179+0000 7f18b6304640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18b0107d20 0x7f18b019e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:18.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.179+0000 7f18b6304640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f18b01118a0 con 0x7f18b0107d20 2024-08-20T01:55:18.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.179+0000 7f18b6304640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f18b0111720 con 0x7f18b01073a0 2024-08-20T01:55:18.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.179+0000 7f18b6304640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f18b0111a20 con 0x7f18b0101990 2024-08-20T01:55:18.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.179+0000 7f18b48a1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18b0107d20 0x7f18b019e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:18.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.179+0000 7f18b48a1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18b0107d20 0x7f18b019e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57822/0 (socket says 172.21.15.79:57822) 2024-08-20T01:55:18.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.179+0000 7f18b48a1640 1 -- 172.21.15.79:0/1903129278 learned_addr learned my addr 172.21.15.79:0/1903129278 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:18.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.179+0000 7f18affff640 1 --2- 172.21.15.79:0/1903129278 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18b0101990 0x7f18b0198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:18.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.179+0000 7f18af7fe640 1 --2- 172.21.15.79:0/1903129278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18b01073a0 0x7f18b0199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:18.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.179+0000 7f18b48a1640 1 -- 172.21.15.79:0/1903129278 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18b0101990 msgr2=0x7f18b0198e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:18.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.179+0000 7f18b48a1640 1 --2- 172.21.15.79:0/1903129278 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18b0101990 0x7f18b0198e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:18.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.180+0000 7f18b48a1640 1 -- 172.21.15.79:0/1903129278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18b01073a0 msgr2=0x7f18b0199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:18.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.180+0000 7f18b48a1640 1 --2- 172.21.15.79:0/1903129278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18b01073a0 0x7f18b0199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:18.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.180+0000 7f18b48a1640 1 -- 172.21.15.79:0/1903129278 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18b019eed0 con 0x7f18b0107d20 2024-08-20T01:55:18.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.180+0000 7f18b48a1640 1 --2- 172.21.15.79:0/1903129278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18b0107d20 0x7f18b019e700 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f18a8005cc0 tx=0x7f18a8032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:18.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.180+0000 7f18ad7fa640 1 -- 172.21.15.79:0/1903129278 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a8032e00 con 0x7f18b0107d20 2024-08-20T01:55:18.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.180+0000 7f18b6304640 1 -- 172.21.15.79:0/1903129278 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18b019f160 con 0x7f18b0107d20 2024-08-20T01:55:18.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.180+0000 7f18ad7fa640 1 -- 172.21.15.79:0/1903129278 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f18a80044d0 con 0x7f18b0107d20 2024-08-20T01:55:18.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.180+0000 7f18ad7fa640 1 -- 172.21.15.79:0/1903129278 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a8030b70 con 0x7f18b0107d20 2024-08-20T01:55:18.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.180+0000 7f18b6304640 1 -- 172.21.15.79:0/1903129278 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18b01a5880 con 0x7f18b0107d20 2024-08-20T01:55:18.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.183+0000 7f18b86fd740 1 Processor -- start 2024-08-20T01:55:18.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.183+0000 7f18ad7fa640 1 -- 172.21.15.79:0/1903129278 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f18a8004680 con 0x7f18b0107d20 2024-08-20T01:55:18.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.183+0000 7f18b86fd740 1 -- start start 2024-08-20T01:55:18.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.183+0000 7f18b86fd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf87314880 0x55bf87314c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:18.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.183+0000 7f18b86fd740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf873151a0 0x55bf87325000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:18.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.183+0000 7f18b86fd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf87325540 0x55bf87327930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:18.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.183+0000 7f18b86fd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bf8728b930 con 0x55bf87314880 2024-08-20T01:55:18.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.183+0000 7f18b86fd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bf8727ae30 con 0x55bf87325540 2024-08-20T01:55:18.194 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.183+0000 7f18b86fd740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55bf8727ee70 con 0x55bf873151a0 2024-08-20T01:55:18.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.183+0000 7f18af7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf87314880 0x55bf87314c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:18.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.183+0000 7f18af7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf87314880 0x55bf87314c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57838/0 (socket says 172.21.15.79:57838) 2024-08-20T01:55:18.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.184+0000 7f18af7fe640 1 -- 172.21.15.79:0/875510259 learned_addr learned my addr 172.21.15.79:0/875510259 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:18.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.184+0000 7f18af7fe640 1 --2- 172.21.15.79:0/875510259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf87325540 0x55bf87327930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:18.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.184+0000 7f18affff640 1 --2- 172.21.15.79:0/875510259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf873151a0 0x55bf87325000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:18.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.184+0000 7f18af7fe640 1 -- 172.21.15.79:0/875510259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf873151a0 msgr2=0x55bf87325000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:18.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.184+0000 7f18af7fe640 1 --2- 172.21.15.79:0/875510259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf873151a0 0x55bf87325000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:18.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.184+0000 7f18af7fe640 1 -- 172.21.15.79:0/875510259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf87325540 msgr2=0x55bf87327930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:18.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.184+0000 7f18af7fe640 1 --2- 172.21.15.79:0/875510259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf87325540 0x55bf87327930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:18.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.184+0000 7f18af7fe640 1 -- 172.21.15.79:0/875510259 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf86fda650 con 0x55bf87314880 2024-08-20T01:55:18.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.184+0000 7f18ad7fa640 1 --2- 172.21.15.79:0/1903129278 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f18980b3bd0 0x7f18980b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:18.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.184+0000 7f18af7fe640 1 --2- 172.21.15.79:0/875510259 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf87314880 0x55bf87314c60 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f18a40135d0 tx=0x7f18a400b450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d9394b691c50f14 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:18.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.184+0000 7f18affff640 1 --2- 172.21.15.79:0/1903129278 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f18980b3bd0 0x7f18980b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:18.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.184+0000 7f18ad7fa640 1 -- 172.21.15.79:0/1903129278 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f18a81050a0 con 0x7f18b0107d20 2024-08-20T01:55:18.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.184+0000 7f18967fc640 1 -- 172.21.15.79:0/875510259 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a4019030 con 0x55bf87314880 2024-08-20T01:55:18.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.184+0000 7f18967fc640 1 -- 172.21.15.79:0/875510259 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f18a40035f0 con 0x55bf87314880 2024-08-20T01:55:18.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.184+0000 7f18967fc640 1 -- 172.21.15.79:0/875510259 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a4010690 con 0x55bf87314880 2024-08-20T01:55:18.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.185+0000 7f18b86fd740 1 -- 172.21.15.79:0/875510259 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf87314880 msgr2=0x55bf87314c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:18.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.185+0000 7f18affff640 1 --2- 172.21.15.79:0/1903129278 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f18980b3bd0 0x7f18980b6090 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x55bf87317a00 tx=0x7f18a000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:18.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.185+0000 7f18b86fd740 1 --2- 172.21.15.79:0/875510259 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf87314880 0x55bf87314c60 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f18a40135d0 tx=0x7f18a400b450 comp rx=0 tx=0).stop 2024-08-20T01:55:18.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.185+0000 7f18b86fd740 1 -- 172.21.15.79:0/875510259 shutdown_connections 2024-08-20T01:55:18.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.185+0000 7f18b86fd740 1 --2- 172.21.15.79:0/875510259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf87325540 0x55bf87327930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:18.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.185+0000 7f18b86fd740 1 --2- 172.21.15.79:0/875510259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf873151a0 0x55bf87325000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:18.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.185+0000 7f18b86fd740 1 --2- 172.21.15.79:0/875510259 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf87314880 0x55bf87314c60 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:18.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.185+0000 7f18b86fd740 1 -- 172.21.15.79:0/875510259 >> 172.21.15.79:0/875510259 conn(0x55bf873126b0 msgr2=0x55bf87313850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:18.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.185+0000 7f18b86fd740 1 -- 172.21.15.79:0/875510259 shutdown_connections 2024-08-20T01:55:18.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.185+0000 7f18b86fd740 1 -- 172.21.15.79:0/875510259 wait complete. 2024-08-20T01:55:18.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.185+0000 7f18b86fd740 1 -- start start 2024-08-20T01:55:18.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.186+0000 7f18b86fd740 1 Processor -- start 2024-08-20T01:55:18.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.186+0000 7f18b86fd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf87314880 0x55bf87322570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:18.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.186+0000 7f18b86fd740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf873151a0 0x55bf87322ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:18.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.186+0000 7f18b86fd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf87325540 0x55bf87322ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:18.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.186+0000 7f18b86fd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bf870dd700 con 0x55bf87314880 2024-08-20T01:55:18.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.186+0000 7f18b86fd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bf87201810 con 0x55bf87325540 2024-08-20T01:55:18.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.186+0000 7f18b86fd740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55bf873281f0 con 0x55bf873151a0 2024-08-20T01:55:18.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.186+0000 7f18b86fd740 10 client.0 _ll_register_callbacks cb 0x55bf87274700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:55:18.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.186+0000 7f18affff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf87314880 0x55bf87322570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:18.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.186+0000 7f18af7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf873151a0 0x55bf87322ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:18.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.186+0000 7f18b48a1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf87325540 0x55bf87322ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:18.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.186+0000 7f18affff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf87314880 0x55bf87322570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57846/0 (socket says 172.21.15.79:57846) 2024-08-20T01:55:18.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.186+0000 7f18affff640 1 -- 172.21.15.79:0/3901632774 learned_addr learned my addr 172.21.15.79:0/3901632774 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:18.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.186+0000 7f18affff640 1 -- 172.21.15.79:0/3901632774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf873151a0 msgr2=0x55bf87322ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:18.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.186+0000 7f18affff640 1 --2- 172.21.15.79:0/3901632774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf873151a0 0x55bf87322ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:18.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.186+0000 7f18affff640 1 -- 172.21.15.79:0/3901632774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf87325540 msgr2=0x55bf87322ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:18.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.186+0000 7f18affff640 1 --2- 172.21.15.79:0/3901632774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf87325540 0x55bf87322ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:18.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.186+0000 7f18affff640 1 -- 172.21.15.79:0/3901632774 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf87331680 con 0x55bf87314880 2024-08-20T01:55:18.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.186+0000 7f18b48a1640 1 --2- 172.21.15.79:0/3901632774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf87325540 0x55bf87322ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:55:18.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.186+0000 7f18af7fe640 1 --2- 172.21.15.79:0/3901632774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf873151a0 0x55bf87322ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T01:55:18.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.187+0000 7f18affff640 1 --2- 172.21.15.79:0/3901632774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf87314880 0x55bf87322570 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f18a000a7a0 tx=0x7f18a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e16990ad2d90125c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:18.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.187+0000 7f188f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:55:18.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.187+0000 7f188f7fe640 1 -- 172.21.15.79:0/3901632774 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a000f8c0 con 0x55bf87314880 2024-08-20T01:55:18.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.187+0000 7f188f7fe640 1 -- 172.21.15.79:0/3901632774 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f18a000fa60 con 0x55bf87314880 2024-08-20T01:55:18.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.187+0000 7f18b86fd740 1 -- 172.21.15.79:0/3901632774 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bf8722a150 con 0x55bf87314880 2024-08-20T01:55:18.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.187+0000 7f188f7fe640 1 -- 172.21.15.79:0/3901632774 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f18a000fc60 con 0x55bf87314880 2024-08-20T01:55:18.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.187+0000 7f18b86fd740 10 client.19926 fetch_fsmap learned FSMap version 71 2024-08-20T01:55:18.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.187+0000 7f18b86fd740 1 -- 172.21.15.79:0/3901632774 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55bf87334070 con 0x55bf87314880 2024-08-20T01:55:18.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.187+0000 7f188f7fe640 1 -- 172.21.15.79:0/3901632774 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55bf8722a150 con 0x55bf87314880 2024-08-20T01:55:18.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.187+0000 7f188f7fe640 1 -- 172.21.15.79:0/3901632774 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 71) ==== 8374+0+0 (secure 0 0 0) 0x7f18a001d410 con 0x55bf87314880 2024-08-20T01:55:18.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.187+0000 7f18b86fd740 10 client.19926 fetch_fsmap finished waiting for FSMap version 71 2024-08-20T01:55:18.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.187+0000 7f18b86fd740 10 client.19926 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:55:18.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.187+0000 7f18b86fd740 20 client.19926 populate_metadata read hostname 'smithi079' 2024-08-20T01:55:18.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.187+0000 7f18b86fd740 1 --2- 172.21.15.79:0/3901632774 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55bf873354d0 0x55bf87337940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:18.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.187+0000 7f18b86fd740 4 client.19926 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T01:55:18.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.187+0000 7f18b86fd740 1 -- 172.21.15.79:0/3901632774 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bf8728d880 con 0x55bf873354d0 2024-08-20T01:55:18.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.188+0000 7f18af7fe640 1 --2- 172.21.15.79:0/3901632774 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55bf873354d0 0x55bf87337940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:18.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.188+0000 7f18af7fe640 1 --2- 172.21.15.79:0/3901632774 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55bf873354d0 0x55bf87337940 crc :-1 s=READY pgs=354 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7268ad68230015a9 server_cookie=21bc4c479b774912 in_seq=0 out_seq=0 2024-08-20T01:55:18.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.188+0000 7f188f7fe640 10 client.19926 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:55:18.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.189+0000 7f188f7fe640 1 -- 172.21.15.79:0/3901632774 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bf8728d880 con 0x55bf873354d0 2024-08-20T01:55:18.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.189+0000 7f188f7fe640 10 client.19926 handle_command_reply: tid=0 2024-08-20T01:55:18.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.189+0000 7f18b86fd740 1 client.19926 shutdown 2024-08-20T01:55:18.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.189+0000 7f18b86fd740 1 -- 172.21.15.79:0/3901632774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf87314880 msgr2=0x55bf87322570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:18.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.189+0000 7f18b86fd740 1 --2- 172.21.15.79:0/3901632774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf87314880 0x55bf87322570 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f18a000a7a0 tx=0x7f18a00046c0 comp rx=0 tx=0).stop 2024-08-20T01:55:18.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.189+0000 7f18b86fd740 1 -- 172.21.15.79:0/3901632774 shutdown_connections 2024-08-20T01:55:18.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.189+0000 7f18b86fd740 1 --2- 172.21.15.79:0/3901632774 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55bf873354d0 0x55bf87337940 crc :-1 s=READY pgs=354 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:18.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.189+0000 7f18b86fd740 1 --2- 172.21.15.79:0/3901632774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf87325540 0x55bf87322ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:18.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.189+0000 7f18b86fd740 1 --2- 172.21.15.79:0/3901632774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf873151a0 0x55bf87322ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.189+0000 7f18b86fd740 1 --2- 172.21.15.79:0/3901632774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf87314880 0x55bf87322570 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.189+0000 7f18b86fd740 1 -- 172.21.15.79:0/3901632774 >> 172.21.15.79:0/3901632774 conn(0x55bf873126b0 msgr2=0x55bf87318250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.189+0000 7f188f7fe640 0 client.19926 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:55:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.189+0000 7f18b86fd740 1 -- 172.21.15.79:0/3901632774 shutdown_connections 2024-08-20T01:55:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.189+0000 7f18b86fd740 1 -- 172.21.15.79:0/3901632774 wait complete. 2024-08-20T01:55:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.189+0000 7f18b86fd740 20 client.19926 trim_cache size 0 max 16384 2024-08-20T01:55:18.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.202+0000 7f18b86fd740 1 Processor -- start 2024-08-20T01:55:18.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.202+0000 7f18b86fd740 1 -- start start 2024-08-20T01:55:18.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.202+0000 7f18b86fd740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf87314880 0x55bf87321e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:18.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.202+0000 7f18b86fd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf873151a0 0x55bf8731ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:18.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.202+0000 7f18b86fd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf87325540 0x55bf87322bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:18.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.202+0000 7f18b86fd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f18b01abd20 con 0x55bf873151a0 2024-08-20T01:55:18.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.202+0000 7f18b86fd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f18b01ad890 con 0x55bf87325540 2024-08-20T01:55:18.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.202+0000 7f18b86fd740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f18b01ac420 con 0x55bf87314880 2024-08-20T01:55:18.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.202+0000 7f18af7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf873151a0 0x55bf8731ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:18.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.202+0000 7f18af7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf873151a0 0x55bf8731ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57860/0 (socket says 172.21.15.79:57860) 2024-08-20T01:55:18.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.202+0000 7f18af7fe640 1 -- 172.21.15.79:0/38988207 learned_addr learned my addr 172.21.15.79:0/38988207 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:18.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.202+0000 7f18affff640 1 --2- 172.21.15.79:0/38988207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf87314880 0x55bf87321e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:18.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.202+0000 7f18b48a1640 1 --2- 172.21.15.79:0/38988207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf87325540 0x55bf87322bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.202+0000 7f18af7fe640 1 -- 172.21.15.79:0/38988207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf87314880 msgr2=0x55bf87321e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.202+0000 7f18af7fe640 1 --2- 172.21.15.79:0/38988207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf87314880 0x55bf87321e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.202+0000 7f18af7fe640 1 -- 172.21.15.79:0/38988207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf87325540 msgr2=0x55bf87322bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.202+0000 7f18af7fe640 1 --2- 172.21.15.79:0/38988207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf87325540 0x55bf87322bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.202+0000 7f18af7fe640 1 -- 172.21.15.79:0/38988207 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf87337fc0 con 0x55bf873151a0 2024-08-20T01:55:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.203+0000 7f18af7fe640 1 --2- 172.21.15.79:0/38988207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf873151a0 0x55bf8731ffd0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f18a4005e00 tx=0x7f18a4005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=950032942bf2bf29 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.203+0000 7f1895ffb640 1 -- 172.21.15.79:0/38988207 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a4019040 con 0x55bf873151a0 2024-08-20T01:55:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.203+0000 7f1895ffb640 1 -- 172.21.15.79:0/38988207 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f18a40054d0 con 0x55bf873151a0 2024-08-20T01:55:18.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.203+0000 7f1895ffb640 1 -- 172.21.15.79:0/38988207 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a4004c00 con 0x55bf873151a0 2024-08-20T01:55:18.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.203+0000 7f18b86fd740 1 -- 172.21.15.79:0/38988207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf873151a0 msgr2=0x55bf8731ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:18.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.203+0000 7f18b86fd740 1 --2- 172.21.15.79:0/38988207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf873151a0 0x55bf8731ffd0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f18a4005e00 tx=0x7f18a4005850 comp rx=0 tx=0).stop 2024-08-20T01:55:18.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.204+0000 7f18b86fd740 1 -- 172.21.15.79:0/38988207 shutdown_connections 2024-08-20T01:55:18.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.204+0000 7f18b86fd740 1 --2- 172.21.15.79:0/38988207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf87325540 0x55bf87322bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:18.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.204+0000 7f18b86fd740 1 --2- 172.21.15.79:0/38988207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf873151a0 0x55bf8731ffd0 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:18.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.204+0000 7f18b86fd740 1 --2- 172.21.15.79:0/38988207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf87314880 0x55bf87321e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:18.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.204+0000 7f18b86fd740 1 -- 172.21.15.79:0/38988207 >> 172.21.15.79:0/38988207 conn(0x55bf873126b0 msgr2=0x55bf873224e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:18.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.204+0000 7f18b86fd740 1 -- 172.21.15.79:0/38988207 shutdown_connections 2024-08-20T01:55:18.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.204+0000 7f18b86fd740 1 -- 172.21.15.79:0/38988207 wait complete. 2024-08-20T01:55:18.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.204+0000 7f18b86fd740 1 -- start start 2024-08-20T01:55:18.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.204+0000 7f18b86fd740 1 Processor -- start 2024-08-20T01:55:18.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.204+0000 7f18b86fd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf87314880 0x55bf8733d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:18.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.204+0000 7f18b86fd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf873151a0 0x55bf8733dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:18.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.204+0000 7f18b86fd740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf87325540 0x55bf8732d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:18.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.204+0000 7f18b86fd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f18b01ad1c0 con 0x55bf873151a0 2024-08-20T01:55:18.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.204+0000 7f18b86fd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f18b01acaf0 con 0x55bf87314880 2024-08-20T01:55:18.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.204+0000 7f18b86fd740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f18b01a9d00 con 0x55bf87325540 2024-08-20T01:55:18.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.204+0000 7f18b86fd740 10 client.0 _ll_register_callbacks cb 0x7f18a000a990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T01:55:18.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.205+0000 7f18af7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf873151a0 0x55bf8733dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:18.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.205+0000 7f18af7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf873151a0 0x55bf8733dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57870/0 (socket says 172.21.15.79:57870) 2024-08-20T01:55:18.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.205+0000 7f18af7fe640 1 -- 172.21.15.79:0/4056966971 learned_addr learned my addr 172.21.15.79:0/4056966971 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:18.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.205+0000 7f18b48a1640 1 --2- 172.21.15.79:0/4056966971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf87325540 0x55bf8732d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:18.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.205+0000 7f18affff640 1 --2- 172.21.15.79:0/4056966971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf87314880 0x55bf8733d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:18.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.205+0000 7f18af7fe640 1 -- 172.21.15.79:0/4056966971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf87325540 msgr2=0x55bf8732d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:18.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.205+0000 7f18af7fe640 1 --2- 172.21.15.79:0/4056966971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf87325540 0x55bf8732d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:18.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.205+0000 7f18af7fe640 1 -- 172.21.15.79:0/4056966971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf87314880 msgr2=0x55bf8733d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T01:55:18.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.205+0000 7f18af7fe640 1 --2- 172.21.15.79:0/4056966971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf87314880 0x55bf8733d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:18.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.205+0000 7f18af7fe640 1 -- 172.21.15.79:0/4056966971 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf8732df30 con 0x55bf873151a0 2024-08-20T01:55:18.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.205+0000 7f18affff640 1 --2- 172.21.15.79:0/4056966971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf87314880 0x55bf8733d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:55:18.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.205+0000 7f18b48a1640 1 --2- 172.21.15.79:0/4056966971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf87325540 0x55bf8732d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:55:18.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.205+0000 7f18af7fe640 1 --2- 172.21.15.79:0/4056966971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf873151a0 0x55bf8733dab0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x55bf87310bc0 tx=0x7f18a4005680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35698f1b74bf2a89 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:18.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.205+0000 7f188f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-08-20T01:55:18.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.205+0000 7f188f7fe640 1 -- 172.21.15.79:0/4056966971 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a4019040 con 0x55bf873151a0 2024-08-20T01:55:18.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.205+0000 7f188f7fe640 1 -- 172.21.15.79:0/4056966971 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f18a40042a0 con 0x55bf873151a0 2024-08-20T01:55:18.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.205+0000 7f18b86fd740 1 -- 172.21.15.79:0/4056966971 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18a40054d0 con 0x55bf873151a0 2024-08-20T01:55:18.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.205+0000 7f188f7fe640 1 -- 172.21.15.79:0/4056966971 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f18a40044a0 con 0x55bf873151a0 2024-08-20T01:55:18.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.205+0000 7f18b86fd740 10 client.19932 fetch_fsmap learned FSMap version 71 2024-08-20T01:55:18.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.205+0000 7f18b86fd740 1 -- 172.21.15.79:0/4056966971 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55bf873a01e0 con 0x55bf873151a0 2024-08-20T01:55:18.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.206+0000 7f188f7fe640 1 -- 172.21.15.79:0/4056966971 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f18a40054d0 con 0x55bf873151a0 2024-08-20T01:55:18.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.206+0000 7f188f7fe640 1 -- 172.21.15.79:0/4056966971 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 71) ==== 8374+0+0 (secure 0 0 0) 0x7f18a402b560 con 0x55bf873151a0 2024-08-20T01:55:18.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.206+0000 7f18b86fd740 10 client.19932 fetch_fsmap finished waiting for FSMap version 71 2024-08-20T01:55:18.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.206+0000 7f18b86fd740 10 client.19932 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T01:55:18.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.206+0000 7f18b86fd740 20 client.19932 populate_metadata read hostname 'smithi079' 2024-08-20T01:55:18.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.206+0000 7f18b86fd740 1 --2- 172.21.15.79:0/4056966971 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55bf873a0590 0x55bf873a29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:18.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.206+0000 7f18b86fd740 4 client.19932 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T01:55:18.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.206+0000 7f18b86fd740 1 -- 172.21.15.79:0/4056966971 --> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bf87289320 con 0x55bf873a0590 2024-08-20T01:55:18.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.206+0000 7f18affff640 1 --2- 172.21.15.79:0/4056966971 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55bf873a0590 0x55bf873a29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:18.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.206+0000 7f188f7fe640 10 client.19932 ms_handle_connect on v2:172.21.15.81:6838/4098410583 2024-08-20T01:55:18.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.206+0000 7f18affff640 1 --2- 172.21.15.79:0/4056966971 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55bf873a0590 0x55bf873a29b0 crc :-1 s=READY pgs=355 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89c0530fbc1b49d2 server_cookie=2a0033493e4ddc7b in_seq=0 out_seq=0 2024-08-20T01:55:18.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.207+0000 7f188f7fe640 1 -- 172.21.15.79:0/4056966971 <== mds.0 v2:172.21.15.81:6838/4098410583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bf87289320 con 0x55bf873a0590 2024-08-20T01:55:18.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.207+0000 7f188f7fe640 10 client.19932 handle_command_reply: tid=0 2024-08-20T01:55:18.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.207+0000 7f18b86fd740 1 client.19932 shutdown 2024-08-20T01:55:18.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.207+0000 7f18b86fd740 1 -- 172.21.15.79:0/4056966971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf873151a0 msgr2=0x55bf8733dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:18.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.207+0000 7f18b86fd740 1 --2- 172.21.15.79:0/4056966971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf873151a0 0x55bf8733dab0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x55bf87310bc0 tx=0x7f18a4005680 comp rx=0 tx=0).stop 2024-08-20T01:55:18.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.207+0000 7f18b86fd740 1 -- 172.21.15.79:0/4056966971 shutdown_connections 2024-08-20T01:55:18.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.207+0000 7f18b86fd740 1 --2- 172.21.15.79:0/4056966971 >> [v2:172.21.15.81:6838/4098410583,v1:172.21.15.81:6839/4098410583] conn(0x55bf873a0590 0x55bf873a29b0 crc :-1 s=READY pgs=355 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:18.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.207+0000 7f18b86fd740 1 --2- 172.21.15.79:0/4056966971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf87325540 0x55bf8732d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:18.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.207+0000 7f18b86fd740 1 --2- 172.21.15.79:0/4056966971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf873151a0 0x55bf8733dab0 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:18.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.207+0000 7f18b86fd740 1 --2- 172.21.15.79:0/4056966971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf87314880 0x55bf8733d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:18.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.207+0000 7f18b86fd740 1 -- 172.21.15.79:0/4056966971 >> 172.21.15.79:0/4056966971 conn(0x55bf873126b0 msgr2=0x55bf87311770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:18.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.207+0000 7f188f7fe640 0 client.19932 ms_handle_reset on v2:172.21.15.81:6838/4098410583 2024-08-20T01:55:18.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.207+0000 7f18b86fd740 1 -- 172.21.15.79:0/4056966971 shutdown_connections 2024-08-20T01:55:18.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.207+0000 7f18b86fd740 1 -- 172.21.15.79:0/4056966971 wait complete. 2024-08-20T01:55:18.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.207+0000 7f18b86fd740 20 client.19932 trim_cache size 0 max 16384 2024-08-20T01:55:18.216 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2024-08-20T01:55:18.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.207+0000 7f18b6304640 1 -- 172.21.15.79:0/1903129278 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f18980b3bd0 msgr2=0x7f18980b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:18.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.208+0000 7f18b6304640 1 --2- 172.21.15.79:0/1903129278 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f18980b3bd0 0x7f18980b6090 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x55bf87317a00 tx=0x7f18a000a2d0 comp rx=0 tx=0).stop 2024-08-20T01:55:18.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.208+0000 7f18b6304640 1 -- 172.21.15.79:0/1903129278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18b0107d20 msgr2=0x7f18b019e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:18.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.208+0000 7f18b6304640 1 --2- 172.21.15.79:0/1903129278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18b0107d20 0x7f18b019e700 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f18a8005cc0 tx=0x7f18a8032a10 comp rx=0 tx=0).stop 2024-08-20T01:55:18.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.208+0000 7f18b6304640 1 -- 172.21.15.79:0/1903129278 shutdown_connections 2024-08-20T01:55:18.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.208+0000 7f18b6304640 1 --2- 172.21.15.79:0/1903129278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18b0107d20 0x7f18b019e700 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:18.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.208+0000 7f18b6304640 1 --2- 172.21.15.79:0/1903129278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18b01073a0 0x7f18b0199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:18.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.208+0000 7f18b6304640 1 --2- 172.21.15.79:0/1903129278 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f18980b3bd0 0x7f18980b6090 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:18.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.208+0000 7f18b6304640 1 --2- 172.21.15.79:0/1903129278 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18b0101990 0x7f18b0198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:18.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.208+0000 7f18b6304640 1 -- 172.21.15.79:0/1903129278 >> 172.21.15.79:0/1903129278 conn(0x7f18b00fd400 msgr2=0x7f18b006aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:18.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.208+0000 7f18b6304640 1 -- 172.21.15.79:0/1903129278 shutdown_connections 2024-08-20T01:55:18.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:18.208+0000 7f18b6304640 1 -- 172.21.15.79:0/1903129278 wait complete. 2024-08-20T01:55:18.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:18 smithi079 ceph-mon[18656]: pgmap v886: 97 pgs: 97 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 20 op/s 2024-08-20T01:55:18.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:18 smithi081 ceph-mon[22209]: pgmap v886: 97 pgs: 97 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 20 op/s 2024-08-20T01:55:18.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:18 smithi175 ceph-mon[22392]: pgmap v886: 97 pgs: 97 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 20 op/s 2024-08-20T01:55:18.945 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_ef4275410d8483698016fe484b2a3c664080b4c1/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/github.com_ceph_ceph-c_ef4275410d8483698016fe484b2a3c664080b4c1/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/github.com_ceph_ceph-c_ef4275410d8483698016fe484b2a3c664080b4c1/qa/tasks/thrasher.py", line 50, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-08-20T01:55:18.946 INFO:tasks.fwd_scrub:done joining 2024-08-20T01:55:18.946 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-08-20T01:55:18.958 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-20T01:55:19.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.069+0000 7fd052583640 1 -- 172.21.15.79:0/3076992013 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd04c1026e0 msgr2=0x7fd04c102b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:19.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.069+0000 7fd052583640 1 --2- 172.21.15.79:0/3076992013 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd04c1026e0 0x7fd04c102b60 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7fd040009890 tx=0x7fd04002a380 comp rx=0 tx=0).stop 2024-08-20T01:55:19.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.069+0000 7fd052583640 1 -- 172.21.15.79:0/3076992013 shutdown_connections 2024-08-20T01:55:19.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.069+0000 7fd052583640 1 --2- 172.21.15.79:0/3076992013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd04c1030a0 0x7fd04c109a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:19.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.069+0000 7fd052583640 1 --2- 172.21.15.79:0/3076992013 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd04c1026e0 0x7fd04c102b60 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:19.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.069+0000 7fd052583640 1 --2- 172.21.15.79:0/3076992013 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd04c101590 0x7fd04c101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:19.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.069+0000 7fd052583640 1 -- 172.21.15.79:0/3076992013 >> 172.21.15.79:0/3076992013 conn(0x7fd04c0fce70 msgr2=0x7fd04c0ff290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:19.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.069+0000 7fd052583640 1 -- 172.21.15.79:0/3076992013 shutdown_connections 2024-08-20T01:55:19.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.069+0000 7fd052583640 1 -- 172.21.15.79:0/3076992013 wait complete. 2024-08-20T01:55:19.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.070+0000 7fd052583640 1 Processor -- start 2024-08-20T01:55:19.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.070+0000 7fd052583640 1 -- start start 2024-08-20T01:55:19.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.070+0000 7fd052583640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd04c101590 0x7fd04c06a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:19.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.070+0000 7fd052583640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd04c1026e0 0x7fd04c19d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:19.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.070+0000 7fd052583640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd04c1030a0 0x7fd04c19fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:19.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.070+0000 7fd052583640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd04c10d0b0 con 0x7fd04c1026e0 2024-08-20T01:55:19.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.070+0000 7fd052583640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd04c10cf30 con 0x7fd04c1030a0 2024-08-20T01:55:19.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.070+0000 7fd052583640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd04c10d230 con 0x7fd04c101590 2024-08-20T01:55:19.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.070+0000 7fd04b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd04c1026e0 0x7fd04c19d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:19.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.070+0000 7fd04b7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd04c1026e0 0x7fd04c19d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57902/0 (socket says 172.21.15.79:57902) 2024-08-20T01:55:19.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.070+0000 7fd04b7fe640 1 -- 172.21.15.79:0/86605954 learned_addr learned my addr 172.21.15.79:0/86605954 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:19.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.071+0000 7fd04bfff640 1 --2- 172.21.15.79:0/86605954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd04c101590 0x7fd04c06a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:19.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.071+0000 7fd050b20640 1 --2- 172.21.15.79:0/86605954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd04c1030a0 0x7fd04c19fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:19.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.071+0000 7fd04b7fe640 1 -- 172.21.15.79:0/86605954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd04c101590 msgr2=0x7fd04c06a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:19.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.071+0000 7fd04b7fe640 1 --2- 172.21.15.79:0/86605954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd04c101590 0x7fd04c06a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:19.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.071+0000 7fd04b7fe640 1 -- 172.21.15.79:0/86605954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd04c1030a0 msgr2=0x7fd04c19fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:19.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.071+0000 7fd04b7fe640 1 --2- 172.21.15.79:0/86605954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd04c1030a0 0x7fd04c19fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:19.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.071+0000 7fd04b7fe640 1 -- 172.21.15.79:0/86605954 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd04c1a0590 con 0x7fd04c1026e0 2024-08-20T01:55:19.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.071+0000 7fd04b7fe640 1 --2- 172.21.15.79:0/86605954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd04c1026e0 0x7fd04c19d6e0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7fd040035040 tx=0x7fd04002ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:19.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.071+0000 7fd0497fa640 1 -- 172.21.15.79:0/86605954 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd040037040 con 0x7fd04c1026e0 2024-08-20T01:55:19.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.071+0000 7fd052583640 1 -- 172.21.15.79:0/86605954 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd04c1a0820 con 0x7fd04c1026e0 2024-08-20T01:55:19.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.071+0000 7fd0497fa640 1 -- 172.21.15.79:0/86605954 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd040041070 con 0x7fd04c1026e0 2024-08-20T01:55:19.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.071+0000 7fd0497fa640 1 -- 172.21.15.79:0/86605954 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd040005290 con 0x7fd04c1026e0 2024-08-20T01:55:19.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.071+0000 7fd052583640 1 -- 172.21.15.79:0/86605954 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd04c1a0d10 con 0x7fd04c1026e0 2024-08-20T01:55:19.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.072+0000 7fd052583640 1 -- 172.21.15.79:0/86605954 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd04c108900 con 0x7fd04c1026e0 2024-08-20T01:55:19.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.073+0000 7fd0497fa640 1 -- 172.21.15.79:0/86605954 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fd040005430 con 0x7fd04c1026e0 2024-08-20T01:55:19.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.074+0000 7fd0497fa640 1 --2- 172.21.15.79:0/86605954 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd0340b3bd0 0x7fd0340b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:19.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.074+0000 7fd04bfff640 1 --2- 172.21.15.79:0/86605954 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd0340b3bd0 0x7fd0340b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:19.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.074+0000 7fd0497fa640 1 -- 172.21.15.79:0/86605954 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fd040104540 con 0x7fd04c1026e0 2024-08-20T01:55:19.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.075+0000 7fd04bfff640 1 --2- 172.21.15.79:0/86605954 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd0340b3bd0 0x7fd0340b6090 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fd03c005fd0 tx=0x7fd03c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:19.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.077+0000 7fd0497fa640 1 -- 172.21.15.79:0/86605954 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fd0400cbba0 con 0x7fd04c1026e0 2024-08-20T01:55:19.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.265+0000 7fd052583640 1 -- 172.21.15.79:0/86605954 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd04c02e590 con 0x7fd04c1026e0 2024-08-20T01:55:19.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.266+0000 7fd0497fa640 1 -- 172.21.15.79:0/86605954 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22676 (secure 0 0 0) 0x7fd0400d2e20 con 0x7fd04c1026e0 2024-08-20T01:55:19.268 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:55:19.269 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":74,"fsid":"28484e9a-5e93-11ef-bccf-c7b262605968","created":"2024-08-20T01:27:07.792689+0000","modified":"2024-08-20T01:35:53.774800+0000","last_up_change":"2024-08-20T01:34:05.838937+0000","last_in_change":"2024-08-20T01:33:43.645153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-20T01:30:30.693903+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-20T01:34:50.585939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-20T01:34:52.980599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ccdbeb3d-bb9d-4275-ad7e-49f2cc1222cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6803","nonce":1274927648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6805","nonce":1274927648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6809","nonce":1274927648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6807","nonce":1274927648}]},"public_addr":"172.21.15.79:6803/1274927648","cluster_addr":"172.21.15.79:6805/1274927648","heartbeat_back_addr":"172.21.15.79:6809/1274927648","heartbeat_front_addr":"172.21.15.79:6807/1274927648","state":["exists","up"]},{"osd":1,"uuid":"0906bc46-f89d-482d-9402-43d17e4246a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6801","nonce":1174012328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6803","nonce":1174012328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6807","nonce":1174012328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6805","nonce":1174012328}]},"public_addr":"172.21.15.81:6801/1174012328","cluster_addr":"172.21.15.81:6803/1174012328","heartbeat_back_addr":"172.21.15.81:6807/1174012328","heartbeat_front_addr":"172.21.15.81:6805/1174012328","state":["exists","up"]},{"osd":2,"uuid":"11d8fb9d-cb2c-41c8-994c-603a1d8e01a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6801","nonce":1132306232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6803","nonce":1132306232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6807","nonce":1132306232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6805","nonce":1132306232}]},"public_addr":"172.21.15.175:6801/1132306232","cluster_addr":"172.21.15.175:6803/1132306232","heartbeat_back_addr":"172.21.15.175:6807/1132306232","heartbeat_front_addr":"172.21.15.175:6805/1132306232","state":["exists","up"]},{"osd":3,"uuid":"29e35242-957f-404b-b99e-d4dd0045c35d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6811","nonce":1364181822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6813","nonce":1364181822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6817","nonce":1364181822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6815","nonce":1364181822}]},"public_addr":"172.21.15.79:6811/1364181822","cluster_addr":"172.21.15.79:6813/1364181822","heartbeat_back_addr":"172.21.15.79:6817/1364181822","heartbeat_front_addr":"172.21.15.79:6815/1364181822","state":["exists","up"]},{"osd":4,"uuid":"9139c469-270f-4465-8adb-1e748529fa68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6809","nonce":306873968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6811","nonce":306873968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6815","nonce":306873968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6813","nonce":306873968}]},"public_addr":"172.21.15.81:6809/306873968","cluster_addr":"172.21.15.81:6811/306873968","heartbeat_back_addr":"172.21.15.81:6815/306873968","heartbeat_front_addr":"172.21.15.81:6813/306873968","state":["exists","up"]},{"osd":5,"uuid":"6394e462-4510-45d6-bc99-8660085cb206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6809","nonce":3908133424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6811","nonce":3908133424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6815","nonce":3908133424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6813","nonce":3908133424}]},"public_addr":"172.21.15.175:6809/3908133424","cluster_addr":"172.21.15.175:6811/3908133424","heartbeat_back_addr":"172.21.15.175:6815/3908133424","heartbeat_front_addr":"172.21.15.175:6813/3908133424","state":["exists","up"]},{"osd":6,"uuid":"e8e51380-e2be-4c4c-82d8-d86306d9fc1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6819","nonce":3379368280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6821","nonce":3379368280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6825","nonce":3379368280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6823","nonce":3379368280}]},"public_addr":"172.21.15.79:6819/3379368280","cluster_addr":"172.21.15.79:6821/3379368280","heartbeat_back_addr":"172.21.15.79:6825/3379368280","heartbeat_front_addr":"172.21.15.79:6823/3379368280","state":["exists","up"]},{"osd":7,"uuid":"875f7876-a2ca-4254-a8cc-27eebb11cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6817","nonce":747356685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6819","nonce":747356685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6823","nonce":747356685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6821","nonce":747356685}]},"public_addr":"172.21.15.81:6817/747356685","cluster_addr":"172.21.15.81:6819/747356685","heartbeat_back_addr":"172.21.15.81:6823/747356685","heartbeat_front_addr":"172.21.15.81:6821/747356685","state":["exists","up"]},{"osd":8,"uuid":"d714a33b-8df5-411d-bc99-b33b4b27cc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6817","nonce":1537762925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6819","nonce":1537762925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6823","nonce":1537762925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6821","nonce":1537762925}]},"public_addr":"172.21.15.175:6817/1537762925","cluster_addr":"172.21.15.175:6819/1537762925","heartbeat_back_addr":"172.21.15.175:6823/1537762925","heartbeat_front_addr":"172.21.15.175:6821/1537762925","state":["exists","up"]},{"osd":9,"uuid":"82db8305-1d72-4bef-99d6-5486e4de5b03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6827","nonce":2400574113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6829","nonce":2400574113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6833","nonce":2400574113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6831","nonce":2400574113}]},"public_addr":"172.21.15.79:6827/2400574113","cluster_addr":"172.21.15.79:6829/2400574113","heartbeat_back_addr":"172.21.15.79:6833/2400574113","heartbeat_front_addr":"172.21.15.79:6831/2400574113","state":["exists","up"]},{"osd":10,"uuid":"797e1e3f-12b5-4958-9e1f-f796cffaaf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6825","nonce":4188407500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6827","nonce":4188407500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6831","nonce":4188407500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6829","nonce":4188407500}]},"public_addr":"172.21.15.81:6825/4188407500","cluster_addr":"172.21.15.81:6827/4188407500","heartbeat_back_addr":"172.21.15.81:6831/4188407500","heartbeat_front_addr":"172.21.15.81:6829/4188407500","state":["exists","up"]},{"osd":11,"uuid":"a4d218ae-5a41-4b34-9c4e-e795c4a6a16d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6825","nonce":451069549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6827","nonce":451069549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6831","nonce":451069549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6829","nonce":451069549}]},"public_addr":"172.21.15.175:6825/451069549","cluster_addr":"172.21.15.175:6827/451069549","heartbeat_back_addr":"172.21.15.175:6831/451069549","heartbeat_front_addr":"172.21.15.175:6829/451069549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:29:42.003425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:30:05.353547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:30:28.916727+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:30:52.845671+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:31:16.926826+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:31:39.840986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:32:04.013287+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:32:28.237482+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:32:51.270643+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:33:15.825156+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:33:40.037915+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:34:04.477377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":3,"to":7}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:0/1750500064":"2024-08-21T01:27:52.389553+0000","172.21.15.79:0/103962305":"2024-08-21T01:27:52.389553+0000","172.21.15.79:6800/4045769179":"2024-08-21T01:27:29.643647+0000","172.21.15.79:0/525482354":"2024-08-21T01:27:52.389553+0000","172.21.15.79:6801/4045769179":"2024-08-21T01:27:29.643647+0000","172.21.15.79:0/1023212241":"2024-08-21T01:27:29.643647+0000","172.21.15.79:0/2368377219":"2024-08-21T01:27:29.643647+0000","172.21.15.79:6801/3302536522":"2024-08-21T01:27:52.389553+0000","172.21.15.79:6800/3302536522":"2024-08-21T01:27:52.389553+0000","172.21.15.79:0/3498829332":"2024-08-21T01:27:29.643647+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-20T01:55:19.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.269+0000 7fd052583640 1 -- 172.21.15.79:0/86605954 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd0340b3bd0 msgr2=0x7fd0340b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:19.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.269+0000 7fd052583640 1 --2- 172.21.15.79:0/86605954 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd0340b3bd0 0x7fd0340b6090 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fd03c005fd0 tx=0x7fd03c009260 comp rx=0 tx=0).stop 2024-08-20T01:55:19.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.269+0000 7fd052583640 1 -- 172.21.15.79:0/86605954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd04c1026e0 msgr2=0x7fd04c19d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:19.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.269+0000 7fd052583640 1 --2- 172.21.15.79:0/86605954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd04c1026e0 0x7fd04c19d6e0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7fd040035040 tx=0x7fd04002ada0 comp rx=0 tx=0).stop 2024-08-20T01:55:19.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.269+0000 7fd052583640 1 -- 172.21.15.79:0/86605954 shutdown_connections 2024-08-20T01:55:19.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.269+0000 7fd052583640 1 --2- 172.21.15.79:0/86605954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd04c1030a0 0x7fd04c19fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:19.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.269+0000 7fd052583640 1 --2- 172.21.15.79:0/86605954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd04c1026e0 0x7fd04c19d6e0 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:19.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.269+0000 7fd052583640 1 --2- 172.21.15.79:0/86605954 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd0340b3bd0 0x7fd0340b6090 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:19.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.269+0000 7fd052583640 1 --2- 172.21.15.79:0/86605954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd04c101590 0x7fd04c06a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:19.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.269+0000 7fd052583640 1 -- 172.21.15.79:0/86605954 >> 172.21.15.79:0/86605954 conn(0x7fd04c0fce70 msgr2=0x7fd04c105ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:19.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.269+0000 7fd052583640 1 -- 172.21.15.79:0/86605954 shutdown_connections 2024-08-20T01:55:19.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.269+0000 7fd052583640 1 -- 172.21.15.79:0/86605954 wait complete. 2024-08-20T01:55:19.283 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-20T01:30:30.693903+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-20T01:34:50.585939+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-20T01:34:52.980599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-20T01:55:19.283 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-20T01:55:19.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.389+0000 7f20405bf640 1 -- 172.21.15.79:0/2336818424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20381026c0 msgr2=0x7f2038102b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:19.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.389+0000 7f20405bf640 1 --2- 172.21.15.79:0/2336818424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20381026c0 0x7f2038102b40 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2028009900 tx=0x7f202802a410 comp rx=0 tx=0).stop 2024-08-20T01:55:19.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.389+0000 7f20405bf640 1 -- 172.21.15.79:0/2336818424 shutdown_connections 2024-08-20T01:55:19.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.389+0000 7f20405bf640 1 --2- 172.21.15.79:0/2336818424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2038103080 0x7f2038109a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:19.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.389+0000 7f20405bf640 1 --2- 172.21.15.79:0/2336818424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20381026c0 0x7f2038102b40 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:19.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.389+0000 7f20405bf640 1 --2- 172.21.15.79:0/2336818424 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2038101570 0x7f2038101970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:19.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.389+0000 7f20405bf640 1 -- 172.21.15.79:0/2336818424 >> 172.21.15.79:0/2336818424 conn(0x7f20380fce50 msgr2=0x7f20380ff270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:19.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.389+0000 7f20405bf640 1 -- 172.21.15.79:0/2336818424 shutdown_connections 2024-08-20T01:55:19.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.389+0000 7f20405bf640 1 -- 172.21.15.79:0/2336818424 wait complete. 2024-08-20T01:55:19.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.390+0000 7f20405bf640 1 Processor -- start 2024-08-20T01:55:19.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.390+0000 7f20405bf640 1 -- start start 2024-08-20T01:55:19.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.390+0000 7f20405bf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2038101570 0x7f2038197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:19.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.390+0000 7f20405bf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20381026c0 0x7f2038197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:19.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.390+0000 7f20405bf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2038103080 0x7f2038198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:19.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.390+0000 7f20405bf640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f203810d0e0 con 0x7f20381026c0 2024-08-20T01:55:19.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.390+0000 7f20405bf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f203810cf60 con 0x7f2038101570 2024-08-20T01:55:19.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.390+0000 7f20405bf640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f203810d260 con 0x7f2038103080 2024-08-20T01:55:19.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.390+0000 7f203db5a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20381026c0 0x7f2038197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:19.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.390+0000 7f203e35b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2038101570 0x7f2038197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:19.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.390+0000 7f203e35b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2038101570 0x7f2038197860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:47854/0 (socket says 172.21.15.79:47854) 2024-08-20T01:55:19.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.390+0000 7f203e35b640 1 -- 172.21.15.79:0/4103827951 learned_addr learned my addr 172.21.15.79:0/4103827951 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:19.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.390+0000 7f203eb5c640 1 --2- 172.21.15.79:0/4103827951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2038103080 0x7f2038198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:19.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.390+0000 7f203db5a640 1 -- 172.21.15.79:0/4103827951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2038103080 msgr2=0x7f2038198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:19.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.390+0000 7f203db5a640 1 --2- 172.21.15.79:0/4103827951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2038103080 0x7f2038198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:19.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.390+0000 7f203db5a640 1 -- 172.21.15.79:0/4103827951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2038101570 msgr2=0x7f2038197860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:19.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.390+0000 7f203db5a640 1 --2- 172.21.15.79:0/4103827951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2038101570 0x7f2038197860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:19.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.390+0000 7f203db5a640 1 -- 172.21.15.79:0/4103827951 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20381993a0 con 0x7f20381026c0 2024-08-20T01:55:19.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.390+0000 7f203e35b640 1 --2- 172.21.15.79:0/4103827951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2038101570 0x7f2038197860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:55:19.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.391+0000 7f203db5a640 1 --2- 172.21.15.79:0/4103827951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20381026c0 0x7f2038197eb0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f202802aa00 tx=0x7f2028003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:19.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.391+0000 7f202f7fe640 1 -- 172.21.15.79:0/4103827951 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202803f070 con 0x7f20381026c0 2024-08-20T01:55:19.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.391+0000 7f20405bf640 1 -- 172.21.15.79:0/4103827951 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2038199630 con 0x7f20381026c0 2024-08-20T01:55:19.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.391+0000 7f202f7fe640 1 -- 172.21.15.79:0/4103827951 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2028031b10 con 0x7f20381026c0 2024-08-20T01:55:19.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.391+0000 7f202f7fe640 1 -- 172.21.15.79:0/4103827951 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2028035030 con 0x7f20381026c0 2024-08-20T01:55:19.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.391+0000 7f20405bf640 1 -- 172.21.15.79:0/4103827951 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f203819fb80 con 0x7f20381026c0 2024-08-20T01:55:19.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.392+0000 7f20405bf640 1 -- 172.21.15.79:0/4103827951 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20381088e0 con 0x7f20381026c0 2024-08-20T01:55:19.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.394+0000 7f202f7fe640 1 -- 172.21.15.79:0/4103827951 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2028042070 con 0x7f20381026c0 2024-08-20T01:55:19.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.394+0000 7f202f7fe640 1 --2- 172.21.15.79:0/4103827951 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f20240b3bd0 0x7f20240b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:19.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.395+0000 7f203e35b640 1 --2- 172.21.15.79:0/4103827951 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f20240b3bd0 0x7f20240b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:19.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.395+0000 7f202f7fe640 1 -- 172.21.15.79:0/4103827951 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f2028104670 con 0x7f20381026c0 2024-08-20T01:55:19.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.395+0000 7f203e35b640 1 --2- 172.21.15.79:0/4103827951 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f20240b3bd0 0x7f20240b6090 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f2034011550 tx=0x7f2034005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:19.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.397+0000 7f202f7fe640 1 -- 172.21.15.79:0/4103827951 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f20280cb680 con 0x7f20381026c0 2024-08-20T01:55:19.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.575+0000 7f20405bf640 1 -- 172.21.15.79:0/4103827951 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f203802e340 con 0x7f20381026c0 2024-08-20T01:55:19.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.576+0000 7f202f7fe640 1 -- 172.21.15.79:0/4103827951 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) ==== 93+0+10 (secure 0 0 0) 0x7f20280cfbd0 con 0x7f20381026c0 2024-08-20T01:55:19.578 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-08-20T01:55:19.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.578+0000 7f20405bf640 1 -- 172.21.15.79:0/4103827951 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f20240b3bd0 msgr2=0x7f20240b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:19.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.578+0000 7f20405bf640 1 --2- 172.21.15.79:0/4103827951 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f20240b3bd0 0x7f20240b6090 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f2034011550 tx=0x7f2034005f90 comp rx=0 tx=0).stop 2024-08-20T01:55:19.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.578+0000 7f20405bf640 1 -- 172.21.15.79:0/4103827951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20381026c0 msgr2=0x7f2038197eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:19.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.578+0000 7f20405bf640 1 --2- 172.21.15.79:0/4103827951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20381026c0 0x7f2038197eb0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f202802aa00 tx=0x7f2028003c10 comp rx=0 tx=0).stop 2024-08-20T01:55:19.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.578+0000 7f20405bf640 1 -- 172.21.15.79:0/4103827951 shutdown_connections 2024-08-20T01:55:19.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.578+0000 7f20405bf640 1 --2- 172.21.15.79:0/4103827951 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f20240b3bd0 0x7f20240b6090 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:19.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.578+0000 7f20405bf640 1 --2- 172.21.15.79:0/4103827951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2038103080 0x7f2038198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:19.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.578+0000 7f20405bf640 1 --2- 172.21.15.79:0/4103827951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20381026c0 0x7f2038197eb0 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:19.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.578+0000 7f20405bf640 1 --2- 172.21.15.79:0/4103827951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2038101570 0x7f2038197860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:19.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.578+0000 7f20405bf640 1 -- 172.21.15.79:0/4103827951 >> 172.21.15.79:0/4103827951 conn(0x7f20380fce50 msgr2=0x7f2038105ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:19.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.578+0000 7f20405bf640 1 -- 172.21.15.79:0/4103827951 shutdown_connections 2024-08-20T01:55:19.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.578+0000 7f20405bf640 1 -- 172.21.15.79:0/4103827951 wait complete. 2024-08-20T01:55:19.591 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:19 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/86605954' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:55:19.593 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-20T01:55:19.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.696+0000 7fb57576b640 1 -- 172.21.15.79:0/1250709496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb570103090 msgr2=0x7fb570109bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:19.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.696+0000 7fb57576b640 1 --2- 172.21.15.79:0/1250709496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb570103090 0x7fb570109bd0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7fb568009cd0 tx=0x7fb56802a8e0 comp rx=0 tx=0).stop 2024-08-20T01:55:19.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.696+0000 7fb57576b640 1 -- 172.21.15.79:0/1250709496 shutdown_connections 2024-08-20T01:55:19.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.696+0000 7fb57576b640 1 --2- 172.21.15.79:0/1250709496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb570103090 0x7fb570109bd0 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:19.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.696+0000 7fb57576b640 1 --2- 172.21.15.79:0/1250709496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb570102520 0x7fb5701029a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:19.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.696+0000 7fb57576b640 1 --2- 172.21.15.79:0/1250709496 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb570101be0 0x7fb570101fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:19.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.696+0000 7fb57576b640 1 -- 172.21.15.79:0/1250709496 >> 172.21.15.79:0/1250709496 conn(0x7fb5700fc590 msgr2=0x7fb5700fe9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:19.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.696+0000 7fb57576b640 1 -- 172.21.15.79:0/1250709496 shutdown_connections 2024-08-20T01:55:19.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.696+0000 7fb57576b640 1 -- 172.21.15.79:0/1250709496 wait complete. 2024-08-20T01:55:19.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.697+0000 7fb57576b640 1 Processor -- start 2024-08-20T01:55:19.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.697+0000 7fb57576b640 1 -- start start 2024-08-20T01:55:19.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.697+0000 7fb57576b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb570101be0 0x7fb570197810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:19.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.697+0000 7fb57576b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb570102520 0x7fb570197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:19.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.697+0000 7fb57576b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb570103090 0x7fb570198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:19.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.697+0000 7fb57576b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb57010d070 con 0x7fb570103090 2024-08-20T01:55:19.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.697+0000 7fb57576b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb57010cef0 con 0x7fb570102520 2024-08-20T01:55:19.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.697+0000 7fb57576b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb57010d1f0 con 0x7fb570101be0 2024-08-20T01:55:19.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.697+0000 7fb56f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb570103090 0x7fb570198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:19.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.697+0000 7fb56f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb570103090 0x7fb570198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57930/0 (socket says 172.21.15.79:57930) 2024-08-20T01:55:19.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.697+0000 7fb56f7fe640 1 -- 172.21.15.79:0/2142282343 learned_addr learned my addr 172.21.15.79:0/2142282343 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:19.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.697+0000 7fb56e7fc640 1 --2- 172.21.15.79:0/2142282343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb570102520 0x7fb570197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:19.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.697+0000 7fb56effd640 1 --2- 172.21.15.79:0/2142282343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb570101be0 0x7fb570197810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:19.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.697+0000 7fb56f7fe640 1 -- 172.21.15.79:0/2142282343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb570101be0 msgr2=0x7fb570197810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:19.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.697+0000 7fb56f7fe640 1 --2- 172.21.15.79:0/2142282343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb570101be0 0x7fb570197810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:19.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.697+0000 7fb56f7fe640 1 -- 172.21.15.79:0/2142282343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb570102520 msgr2=0x7fb570197e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:19.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.697+0000 7fb56f7fe640 1 --2- 172.21.15.79:0/2142282343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb570102520 0x7fb570197e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:19.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.697+0000 7fb56f7fe640 1 -- 172.21.15.79:0/2142282343 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb570199350 con 0x7fb570103090 2024-08-20T01:55:19.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.697+0000 7fb56effd640 1 --2- 172.21.15.79:0/2142282343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb570101be0 0x7fb570197810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:55:19.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.697+0000 7fb56e7fc640 1 --2- 172.21.15.79:0/2142282343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb570102520 0x7fb570197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:55:19.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.698+0000 7fb56f7fe640 1 --2- 172.21.15.79:0/2142282343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb570103090 0x7fb570198a90 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fb5680097b0 tx=0x7fb568003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:19.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.698+0000 7fb567fff640 1 -- 172.21.15.79:0/2142282343 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb568004450 con 0x7fb570103090 2024-08-20T01:55:19.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.698+0000 7fb567fff640 1 -- 172.21.15.79:0/2142282343 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb568003e10 con 0x7fb570103090 2024-08-20T01:55:19.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.698+0000 7fb57576b640 1 -- 172.21.15.79:0/2142282343 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5701995e0 con 0x7fb570103090 2024-08-20T01:55:19.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.698+0000 7fb567fff640 1 -- 172.21.15.79:0/2142282343 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb568046480 con 0x7fb570103090 2024-08-20T01:55:19.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.698+0000 7fb57576b640 1 -- 172.21.15.79:0/2142282343 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb57019fd10 con 0x7fb570103090 2024-08-20T01:55:19.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.699+0000 7fb57576b640 1 -- 172.21.15.79:0/2142282343 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb570101fe0 con 0x7fb570103090 2024-08-20T01:55:19.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.701+0000 7fb567fff640 1 -- 172.21.15.79:0/2142282343 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb5680046f0 con 0x7fb570103090 2024-08-20T01:55:19.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.701+0000 7fb567fff640 1 --2- 172.21.15.79:0/2142282343 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb55c0b3bd0 0x7fb55c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:19.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.702+0000 7fb56effd640 1 --2- 172.21.15.79:0/2142282343 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb55c0b3bd0 0x7fb55c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:19.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.702+0000 7fb567fff640 1 -- 172.21.15.79:0/2142282343 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fb56802e030 con 0x7fb570103090 2024-08-20T01:55:19.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.702+0000 7fb56effd640 1 --2- 172.21.15.79:0/2142282343 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb55c0b3bd0 0x7fb55c0b6090 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fb560005d00 tx=0x7fb560005ed0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:19.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.705+0000 7fb567fff640 1 -- 172.21.15.79:0/2142282343 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fb56804b060 con 0x7fb570103090 2024-08-20T01:55:19.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:19 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/86605954' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:55:19.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:19 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/86605954' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:55:19.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.887+0000 7fb57576b640 1 -- 172.21.15.79:0/2142282343 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb57019fee0 con 0x7fb570103090 2024-08-20T01:55:19.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.888+0000 7fb567fff640 1 -- 172.21.15.79:0/2142282343 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v74) ==== 104+0+11 (secure 0 0 0) 0x7fb5680ccdb0 con 0x7fb570103090 2024-08-20T01:55:19.891 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2024-08-20T01:55:19.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.890+0000 7fb57576b640 1 -- 172.21.15.79:0/2142282343 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb55c0b3bd0 msgr2=0x7fb55c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:19.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.890+0000 7fb57576b640 1 --2- 172.21.15.79:0/2142282343 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb55c0b3bd0 0x7fb55c0b6090 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fb560005d00 tx=0x7fb560005ed0 comp rx=0 tx=0).stop 2024-08-20T01:55:19.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.890+0000 7fb57576b640 1 -- 172.21.15.79:0/2142282343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb570103090 msgr2=0x7fb570198a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:19.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.890+0000 7fb57576b640 1 --2- 172.21.15.79:0/2142282343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb570103090 0x7fb570198a90 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fb5680097b0 tx=0x7fb568003c20 comp rx=0 tx=0).stop 2024-08-20T01:55:19.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.890+0000 7fb57576b640 1 -- 172.21.15.79:0/2142282343 shutdown_connections 2024-08-20T01:55:19.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.890+0000 7fb57576b640 1 --2- 172.21.15.79:0/2142282343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb570103090 0x7fb570198a90 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:19.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.890+0000 7fb57576b640 1 --2- 172.21.15.79:0/2142282343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb570102520 0x7fb570197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:19.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.890+0000 7fb57576b640 1 --2- 172.21.15.79:0/2142282343 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fb55c0b3bd0 0x7fb55c0b6090 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:19.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.890+0000 7fb57576b640 1 --2- 172.21.15.79:0/2142282343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb570101be0 0x7fb570197810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:19.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.890+0000 7fb57576b640 1 -- 172.21.15.79:0/2142282343 >> 172.21.15.79:0/2142282343 conn(0x7fb5700fc590 msgr2=0x7fb570103c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:19.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.891+0000 7fb57576b640 1 -- 172.21.15.79:0/2142282343 shutdown_connections 2024-08-20T01:55:19.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:19.891+0000 7fb57576b640 1 -- 172.21.15.79:0/2142282343 wait complete. 2024-08-20T01:55:19.905 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-20T01:55:20.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.005+0000 7f3cd1bef640 1 -- 172.21.15.79:0/578993241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ccc102680 msgr2=0x7f3ccc102a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:20.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.005+0000 7f3cd1bef640 1 --2- 172.21.15.79:0/578993241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ccc102680 0x7f3ccc102a80 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc009930 tx=0x7f3cbc02a420 comp rx=0 tx=0).stop 2024-08-20T01:55:20.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.005+0000 7f3cd1bef640 1 -- 172.21.15.79:0/578993241 shutdown_connections 2024-08-20T01:55:20.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.005+0000 7f3cd1bef640 1 --2- 172.21.15.79:0/578993241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ccc104190 0x7f3ccc10ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:20.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.005+0000 7f3cd1bef640 1 --2- 172.21.15.79:0/578993241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ccc1037d0 0x7f3ccc103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:20.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.005+0000 7f3cd1bef640 1 --2- 172.21.15.79:0/578993241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ccc102680 0x7f3ccc102a80 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:20.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.005+0000 7f3cd1bef640 1 -- 172.21.15.79:0/578993241 >> 172.21.15.79:0/578993241 conn(0x7f3ccc0fdf40 msgr2=0x7f3ccc100360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:20.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.005+0000 7f3cd1bef640 1 -- 172.21.15.79:0/578993241 shutdown_connections 2024-08-20T01:55:20.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.005+0000 7f3cd1bef640 1 -- 172.21.15.79:0/578993241 wait complete. 2024-08-20T01:55:20.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.006+0000 7f3cd1bef640 1 Processor -- start 2024-08-20T01:55:20.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.006+0000 7f3cd1bef640 1 -- start start 2024-08-20T01:55:20.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.006+0000 7f3cd1bef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ccc102680 0x7f3ccc076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:20.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.006+0000 7f3cd1bef640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ccc1037d0 0x7f3ccc075270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:20.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.006+0000 7f3cd1bef640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ccc104190 0x7f3ccc0757b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:20.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.006+0000 7f3cd1bef640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3ccc10e1a0 con 0x7f3ccc1037d0 2024-08-20T01:55:20.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.006+0000 7f3cd1bef640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3ccc10e020 con 0x7f3ccc102680 2024-08-20T01:55:20.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.006+0000 7f3cd1bef640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3ccc10e320 con 0x7f3ccc104190 2024-08-20T01:55:20.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.006+0000 7f3ccaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ccc1037d0 0x7f3ccc075270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:20.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.006+0000 7f3ccaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ccc1037d0 0x7f3ccc075270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57950/0 (socket says 172.21.15.79:57950) 2024-08-20T01:55:20.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.006+0000 7f3ccaffd640 1 -- 172.21.15.79:0/3562559851 learned_addr learned my addr 172.21.15.79:0/3562559851 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:20.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.006+0000 7f3ccbfff640 1 --2- 172.21.15.79:0/3562559851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ccc104190 0x7f3ccc0757b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:20.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.006+0000 7f3ccb7fe640 1 --2- 172.21.15.79:0/3562559851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ccc102680 0x7f3ccc076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:20.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.006+0000 7f3ccaffd640 1 -- 172.21.15.79:0/3562559851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ccc104190 msgr2=0x7f3ccc0757b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:20.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.006+0000 7f3ccaffd640 1 --2- 172.21.15.79:0/3562559851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ccc104190 0x7f3ccc0757b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:20.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.006+0000 7f3ccaffd640 1 -- 172.21.15.79:0/3562559851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ccc102680 msgr2=0x7f3ccc076a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:20.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.006+0000 7f3ccaffd640 1 --2- 172.21.15.79:0/3562559851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ccc102680 0x7f3ccc076a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:20.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.006+0000 7f3ccaffd640 1 -- 172.21.15.79:0/3562559851 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ccc076020 con 0x7f3ccc1037d0 2024-08-20T01:55:20.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.007+0000 7f3ccaffd640 1 --2- 172.21.15.79:0/3562559851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ccc1037d0 0x7f3ccc075270 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f3cc000d950 tx=0x7f3cc000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:20.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.007+0000 7f3cc8ff9640 1 -- 172.21.15.79:0/3562559851 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc0017070 con 0x7f3ccc1037d0 2024-08-20T01:55:20.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.007+0000 7f3cc8ff9640 1 -- 172.21.15.79:0/3562559851 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3cc0009c30 con 0x7f3ccc1037d0 2024-08-20T01:55:20.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.007+0000 7f3cd1bef640 1 -- 172.21.15.79:0/3562559851 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ccc1a2aa0 con 0x7f3ccc1037d0 2024-08-20T01:55:20.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.007+0000 7f3cc8ff9640 1 -- 172.21.15.79:0/3562559851 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc000f620 con 0x7f3ccc1037d0 2024-08-20T01:55:20.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.007+0000 7f3cd1bef640 1 -- 172.21.15.79:0/3562559851 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ccc1a2fc0 con 0x7f3ccc1037d0 2024-08-20T01:55:20.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.008+0000 7f3cd1bef640 1 -- 172.21.15.79:0/3562559851 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ccc109a40 con 0x7f3ccc1037d0 2024-08-20T01:55:20.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.009+0000 7f3cc8ff9640 1 -- 172.21.15.79:0/3562559851 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3cc0010460 con 0x7f3ccc1037d0 2024-08-20T01:55:20.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.011+0000 7f3cc8ff9640 1 --2- 172.21.15.79:0/3562559851 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3cb40b3bd0 0x7f3cb40b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:20.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.011+0000 7f3ccb7fe640 1 --2- 172.21.15.79:0/3562559851 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3cb40b3bd0 0x7f3cb40b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:20.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.011+0000 7f3cc8ff9640 1 -- 172.21.15.79:0/3562559851 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f3cc00e3810 con 0x7f3ccc1037d0 2024-08-20T01:55:20.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.011+0000 7f3ccb7fe640 1 --2- 172.21.15.79:0/3562559851 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3cb40b3bd0 0x7f3cb40b6090 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc0057c0 tx=0x7f3cbc031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:20.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.014+0000 7f3cc8ff9640 1 -- 172.21.15.79:0/3562559851 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f3cc0009de0 con 0x7f3ccc1037d0 2024-08-20T01:55:20.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.193+0000 7f3cd1bef640 1 -- 172.21.15.79:0/3562559851 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f3ccc02e590 con 0x7f3ccc1037d0 2024-08-20T01:55:20.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.194+0000 7f3cc8ff9640 1 -- 172.21.15.79:0/3562559851 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v74) ==== 100+0+11 (secure 0 0 0) 0x7f3cc00b30e0 con 0x7f3ccc1037d0 2024-08-20T01:55:20.197 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2024-08-20T01:55:20.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.196+0000 7f3cd1bef640 1 -- 172.21.15.79:0/3562559851 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3cb40b3bd0 msgr2=0x7f3cb40b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:20.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.196+0000 7f3cd1bef640 1 --2- 172.21.15.79:0/3562559851 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3cb40b3bd0 0x7f3cb40b6090 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc0057c0 tx=0x7f3cbc031400 comp rx=0 tx=0).stop 2024-08-20T01:55:20.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.196+0000 7f3cd1bef640 1 -- 172.21.15.79:0/3562559851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ccc1037d0 msgr2=0x7f3ccc075270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:20.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.196+0000 7f3cd1bef640 1 --2- 172.21.15.79:0/3562559851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ccc1037d0 0x7f3ccc075270 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f3cc000d950 tx=0x7f3cc000de10 comp rx=0 tx=0).stop 2024-08-20T01:55:20.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.196+0000 7f3cd1bef640 1 -- 172.21.15.79:0/3562559851 shutdown_connections 2024-08-20T01:55:20.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.196+0000 7f3cd1bef640 1 --2- 172.21.15.79:0/3562559851 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f3cb40b3bd0 0x7f3cb40b6090 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:20.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.196+0000 7f3cd1bef640 1 --2- 172.21.15.79:0/3562559851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ccc104190 0x7f3ccc0757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:20.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.196+0000 7f3cd1bef640 1 --2- 172.21.15.79:0/3562559851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ccc1037d0 0x7f3ccc075270 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:20.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.196+0000 7f3cd1bef640 1 --2- 172.21.15.79:0/3562559851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ccc102680 0x7f3ccc076a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:20.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.196+0000 7f3cd1bef640 1 -- 172.21.15.79:0/3562559851 >> 172.21.15.79:0/3562559851 conn(0x7f3ccc0fdf40 msgr2=0x7f3ccc106c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:20.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.196+0000 7f3cd1bef640 1 -- 172.21.15.79:0/3562559851 shutdown_connections 2024-08-20T01:55:20.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.196+0000 7f3cd1bef640 1 -- 172.21.15.79:0/3562559851 wait complete. 2024-08-20T01:55:20.210 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-08-20T01:55:20.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.310+0000 7f729ee60640 1 -- 172.21.15.79:0/3281874612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72981037f0 msgr2=0x7f7298103c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:20.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.310+0000 7f729ee60640 1 --2- 172.21.15.79:0/3281874612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72981037f0 0x7f7298103c70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7284009860 tx=0x7f728402a340 comp rx=0 tx=0).stop 2024-08-20T01:55:20.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.310+0000 7f729ee60640 1 -- 172.21.15.79:0/3281874612 shutdown_connections 2024-08-20T01:55:20.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.310+0000 7f729ee60640 1 --2- 172.21.15.79:0/3281874612 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72981041b0 0x7f729810ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:20.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.310+0000 7f729ee60640 1 --2- 172.21.15.79:0/3281874612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72981037f0 0x7f7298103c70 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:20.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.310+0000 7f729ee60640 1 --2- 172.21.15.79:0/3281874612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72981026a0 0x7f7298102aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:20.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.310+0000 7f729ee60640 1 -- 172.21.15.79:0/3281874612 >> 172.21.15.79:0/3281874612 conn(0x7f72980fdf40 msgr2=0x7f7298100380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:20.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.310+0000 7f729ee60640 1 -- 172.21.15.79:0/3281874612 shutdown_connections 2024-08-20T01:55:20.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.310+0000 7f729ee60640 1 -- 172.21.15.79:0/3281874612 wait complete. 2024-08-20T01:55:20.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.310+0000 7f729ee60640 1 Processor -- start 2024-08-20T01:55:20.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.310+0000 7f729ee60640 1 -- start start 2024-08-20T01:55:20.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.311+0000 7f729ee60640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72981026a0 0x7f72981989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:20.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.311+0000 7f729ee60640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72981037f0 0x7f7298198ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:20.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.311+0000 7f729ee60640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72981041b0 0x7f7298199c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:20.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.311+0000 7f729ee60640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f729810e1c0 con 0x7f72981041b0 2024-08-20T01:55:20.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.311+0000 7f729ee60640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f729810e040 con 0x7f72981037f0 2024-08-20T01:55:20.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.311+0000 7f729ee60640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f729810e340 con 0x7f72981026a0 2024-08-20T01:55:20.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.311+0000 7f729d3fd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72981041b0 0x7f7298199c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:20.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.311+0000 7f729d3fd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72981041b0 0x7f7298199c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53672/0 (socket says 172.21.15.79:53672) 2024-08-20T01:55:20.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.311+0000 7f729d3fd640 1 -- 172.21.15.79:0/54728953 learned_addr learned my addr 172.21.15.79:0/54728953 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:20.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.311+0000 7f7297fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72981037f0 0x7f7298198ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:20.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.311+0000 7f729cbfc640 1 --2- 172.21.15.79:0/54728953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72981026a0 0x7f72981989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:20.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.311+0000 7f729d3fd640 1 -- 172.21.15.79:0/54728953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72981026a0 msgr2=0x7f72981989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:20.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.311+0000 7f729d3fd640 1 --2- 172.21.15.79:0/54728953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72981026a0 0x7f72981989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:20.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.311+0000 7f729d3fd640 1 -- 172.21.15.79:0/54728953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72981037f0 msgr2=0x7f7298198ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:20.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.311+0000 7f729d3fd640 1 --2- 172.21.15.79:0/54728953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72981037f0 0x7f7298198ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:20.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.311+0000 7f729d3fd640 1 -- 172.21.15.79:0/54728953 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f729819a4e0 con 0x7f72981041b0 2024-08-20T01:55:20.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.311+0000 7f729d3fd640 1 --2- 172.21.15.79:0/54728953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72981041b0 0x7f7298199c20 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f729000efc0 tx=0x7f729000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:20.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.311+0000 7f7295ffb640 1 -- 172.21.15.79:0/54728953 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7290003970 con 0x7f72981041b0 2024-08-20T01:55:20.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.311+0000 7f729ee60640 1 -- 172.21.15.79:0/54728953 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f729819a7d0 con 0x7f72981041b0 2024-08-20T01:55:20.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.311+0000 7f7295ffb640 1 -- 172.21.15.79:0/54728953 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7290004020 con 0x7f72981041b0 2024-08-20T01:55:20.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.311+0000 7f7295ffb640 1 -- 172.21.15.79:0/54728953 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f729000b850 con 0x7f72981041b0 2024-08-20T01:55:20.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.312+0000 7f729ee60640 1 -- 172.21.15.79:0/54728953 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72981a0ea0 con 0x7f72981041b0 2024-08-20T01:55:20.318 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.313+0000 7f729ee60640 1 -- 172.21.15.79:0/54728953 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72981a1070 con 0x7f72981041b0 2024-08-20T01:55:20.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.314+0000 7f7295ffb640 1 -- 172.21.15.79:0/54728953 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f729001d020 con 0x7f72981041b0 2024-08-20T01:55:20.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.314+0000 7f7295ffb640 1 --2- 172.21.15.79:0/54728953 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f72880b3bd0 0x7f72880b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:20.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.314+0000 7f7295ffb640 1 -- 172.21.15.79:0/54728953 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f72900e3a70 con 0x7f72981041b0 2024-08-20T01:55:20.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.315+0000 7f729cbfc640 1 --2- 172.21.15.79:0/54728953 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f72880b3bd0 0x7f72880b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:20.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.315+0000 7f729cbfc640 1 --2- 172.21.15.79:0/54728953 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f72880b3bd0 0x7f72880b6090 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f728c009bd0 tx=0x7f728c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:20.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.318+0000 7f7295ffb640 1 -- 172.21.15.79:0/54728953 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f72900ab0d0 con 0x7f72981041b0 2024-08-20T01:55:20.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.546+0000 7f729ee60640 1 -- 172.21.15.79:0/54728953 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f72981a1240 con 0x7f72981041b0 2024-08-20T01:55:20.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.554+0000 7f7295ffb640 1 -- 172.21.15.79:0/54728953 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+821378 (secure 0 0 0) 0x7f72900aa9d0 con 0x7f72981041b0 2024-08-20T01:55:20.569 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:55:20.569 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:55:20.569 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 18, 2024-08-20T01:55:20.569 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.569 INFO:teuthology.orchestra.run.smithi079.stdout: "active_gid": 14150, 2024-08-20T01:55:20.569 INFO:teuthology.orchestra.run.smithi079.stdout: "active_name": "x", 2024-08-20T01:55:20.569 INFO:teuthology.orchestra.run.smithi079.stdout: "active_addrs": { 2024-08-20T01:55:20.569 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-08-20T01:55:20.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:20.569 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-08-20T01:55:20.569 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2024-08-20T01:55:20.570 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3038112779 2024-08-20T01:55:20.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:20.570 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-08-20T01:55:20.570 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2024-08-20T01:55:20.570 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3038112779 2024-08-20T01:55:20.570 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.570 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-08-20T01:55:20.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.570 INFO:teuthology.orchestra.run.smithi079.stdout: "active_addr": "172.21.15.79:6801/3038112779", 2024-08-20T01:55:20.570 INFO:teuthology.orchestra.run.smithi079.stdout: "active_change": "2024-08-20T01:27:52.389685+0000", 2024-08-20T01:55:20.571 INFO:teuthology.orchestra.run.smithi079.stdout: "active_mgr_features": 4540701547738038271, 2024-08-20T01:55:20.571 INFO:teuthology.orchestra.run.smithi079.stdout: "available": true, 2024-08-20T01:55:20.571 INFO:teuthology.orchestra.run.smithi079.stdout: "standbys": [ 2024-08-20T01:55:20.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:20.571 INFO:teuthology.orchestra.run.smithi079.stdout: "gid": 24119, 2024-08-20T01:55:20.571 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "y", 2024-08-20T01:55:20.571 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_features": 4540701547738038271, 2024-08-20T01:55:20.571 INFO:teuthology.orchestra.run.smithi079.stdout: "available_modules": [ 2024-08-20T01:55:20.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:20.571 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "alerts", 2024-08-20T01:55:20.571 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:20.571 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:20.571 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:20.572 INFO:teuthology.orchestra.run.smithi079.stdout: "interval": { 2024-08-20T01:55:20.572 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "interval", 2024-08-20T01:55:20.572 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:20.572 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.572 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.572 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "60", 2024-08-20T01:55:20.572 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.572 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.572 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.572 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "How frequently to reexamine health status", 2024-08-20T01:55:20.572 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.573 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.573 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.573 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:20.573 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:20.573 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.573 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.573 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.573 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.573 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.573 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.574 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.574 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.574 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.574 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.574 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.574 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.574 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.574 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.575 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.575 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.575 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.575 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.575 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:20.575 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:20.575 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.575 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.575 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.575 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.575 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.576 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.576 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.576 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.576 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.576 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.576 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.576 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:20.576 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:20.576 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.576 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.576 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.576 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:20.576 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.577 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.577 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.577 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.577 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.577 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.577 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.577 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.577 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.577 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.577 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.577 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.577 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.577 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.578 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:20.578 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:20.578 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.578 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.578 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.578 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.578 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.578 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.578 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.578 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.578 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.579 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.579 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.579 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_destination": { 2024-08-20T01:55:20.579 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_destination", 2024-08-20T01:55:20.579 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.579 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.579 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.579 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.579 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.579 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.579 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.579 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Email address to send alerts to", 2024-08-20T01:55:20.579 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.580 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.580 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.580 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_from_name": { 2024-08-20T01:55:20.580 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_from_name", 2024-08-20T01:55:20.580 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.580 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.580 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.580 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "Ceph", 2024-08-20T01:55:20.580 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.580 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.580 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.580 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Email From: name", 2024-08-20T01:55:20.580 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.581 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.581 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.581 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_host": { 2024-08-20T01:55:20.581 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_host", 2024-08-20T01:55:20.581 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.581 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.581 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.581 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.581 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.581 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.581 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.581 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "SMTP server", 2024-08-20T01:55:20.581 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.582 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.582 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.582 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_password": { 2024-08-20T01:55:20.582 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_password", 2024-08-20T01:55:20.582 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.582 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.582 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.582 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.582 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.582 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.582 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.582 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Password to authenticate with", 2024-08-20T01:55:20.583 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.583 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.583 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.583 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_port": { 2024-08-20T01:55:20.583 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_port", 2024-08-20T01:55:20.583 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.583 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.583 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.583 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "465", 2024-08-20T01:55:20.583 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.583 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.583 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.583 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "SMTP port", 2024-08-20T01:55:20.584 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.584 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.584 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.584 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_sender": { 2024-08-20T01:55:20.584 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_sender", 2024-08-20T01:55:20.584 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.584 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.584 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.584 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.584 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.584 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.584 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.584 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "SMTP envelope sender", 2024-08-20T01:55:20.585 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.585 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.585 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.585 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_ssl": { 2024-08-20T01:55:20.585 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_ssl", 2024-08-20T01:55:20.585 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.585 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.586 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.586 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:20.586 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.586 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.586 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.586 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-20T01:55:20.586 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.586 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.586 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.586 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_user": { 2024-08-20T01:55:20.586 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_user", 2024-08-20T01:55:20.587 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.587 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.587 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.587 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.587 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.587 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.587 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.587 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "User to authenticate as", 2024-08-20T01:55:20.587 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.587 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.587 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.587 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:20.587 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:20.588 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.588 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:20.588 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.588 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:20.588 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.588 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.588 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.588 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.588 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.588 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.588 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.588 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.588 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:20.589 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "balancer", 2024-08-20T01:55:20.589 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:20.589 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:20.589 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:20.589 INFO:teuthology.orchestra.run.smithi079.stdout: "active": { 2024-08-20T01:55:20.589 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "active", 2024-08-20T01:55:20.589 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.589 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.589 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.589 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:20.589 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.589 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.589 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.590 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "automatically balance PGs across cluster", 2024-08-20T01:55:20.590 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.590 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.590 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.590 INFO:teuthology.orchestra.run.smithi079.stdout: "begin_time": { 2024-08-20T01:55:20.590 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "begin_time", 2024-08-20T01:55:20.590 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.590 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.590 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.591 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0000", 2024-08-20T01:55:20.591 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.591 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.591 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.591 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "beginning time of day to automatically balance", 2024-08-20T01:55:20.591 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-20T01:55:20.591 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.591 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.591 INFO:teuthology.orchestra.run.smithi079.stdout: "begin_weekday": { 2024-08-20T01:55:20.591 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "begin_weekday", 2024-08-20T01:55:20.591 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "uint", 2024-08-20T01:55:20.591 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.591 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.592 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:20.592 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "0", 2024-08-20T01:55:20.592 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "6", 2024-08-20T01:55:20.592 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.592 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-20T01:55:20.592 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-20T01:55:20.592 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.592 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.592 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_compat_max_iterations": { 2024-08-20T01:55:20.592 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "crush_compat_max_iterations", 2024-08-20T01:55:20.592 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "uint", 2024-08-20T01:55:20.593 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.593 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.593 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "25", 2024-08-20T01:55:20.593 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "1", 2024-08-20T01:55:20.593 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "250", 2024-08-20T01:55:20.593 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.593 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-20T01:55:20.593 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.593 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.593 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.593 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_compat_metrics": { 2024-08-20T01:55:20.593 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "crush_compat_metrics", 2024-08-20T01:55:20.593 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.594 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.594 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.594 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "pgs,objects,bytes", 2024-08-20T01:55:20.594 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.594 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.594 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.594 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-20T01:55:20.594 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-20T01:55:20.594 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.594 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.594 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_compat_step": { 2024-08-20T01:55:20.594 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "crush_compat_step", 2024-08-20T01:55:20.594 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2024-08-20T01:55:20.595 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.595 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.595 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0.5", 2024-08-20T01:55:20.595 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "0.001", 2024-08-20T01:55:20.595 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "0.999", 2024-08-20T01:55:20.595 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.595 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "aggressiveness of optimization", 2024-08-20T01:55:20.595 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-20T01:55:20.595 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.595 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.595 INFO:teuthology.orchestra.run.smithi079.stdout: "end_time": { 2024-08-20T01:55:20.595 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "end_time", 2024-08-20T01:55:20.596 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.596 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.596 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.596 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "2359", 2024-08-20T01:55:20.596 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.596 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.596 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.596 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "ending time of day to automatically balance", 2024-08-20T01:55:20.596 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-20T01:55:20.596 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.596 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.596 INFO:teuthology.orchestra.run.smithi079.stdout: "end_weekday": { 2024-08-20T01:55:20.597 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "end_weekday", 2024-08-20T01:55:20.597 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "uint", 2024-08-20T01:55:20.597 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.597 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.597 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:20.597 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "0", 2024-08-20T01:55:20.597 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "6", 2024-08-20T01:55:20.597 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.597 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-20T01:55:20.597 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-20T01:55:20.597 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.597 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.597 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:20.598 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:20.598 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.598 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.598 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.598 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.598 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.598 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.598 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.598 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.598 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.598 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.598 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.598 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.599 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.599 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.599 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.599 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.599 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.599 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.599 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:20.599 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:20.599 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.599 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.599 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.599 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.600 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.600 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.600 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.600 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.600 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.600 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.600 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.600 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:20.600 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:20.600 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.600 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.600 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.601 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:20.601 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.601 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.601 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.601 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.601 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.601 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.601 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.601 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.601 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.601 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.601 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.602 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.602 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.602 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.602 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:20.602 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:20.602 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.602 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.602 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.602 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.602 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.602 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.603 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.603 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.603 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.603 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.603 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.603 INFO:teuthology.orchestra.run.smithi079.stdout: "min_score": { 2024-08-20T01:55:20.603 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "min_score", 2024-08-20T01:55:20.603 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2024-08-20T01:55:20.603 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.603 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.603 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:20.603 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.603 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.604 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.604 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-20T01:55:20.604 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.604 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.604 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.604 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": { 2024-08-20T01:55:20.604 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "mode", 2024-08-20T01:55:20.604 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.604 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.604 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.604 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "upmap", 2024-08-20T01:55:20.604 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.605 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.605 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.605 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-compat", 2024-08-20T01:55:20.605 INFO:teuthology.orchestra.run.smithi079.stdout: "none", 2024-08-20T01:55:20.605 INFO:teuthology.orchestra.run.smithi079.stdout: "read", 2024-08-20T01:55:20.605 INFO:teuthology.orchestra.run.smithi079.stdout: "upmap", 2024-08-20T01:55:20.605 INFO:teuthology.orchestra.run.smithi079.stdout: "upmap-read" 2024-08-20T01:55:20.605 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.605 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Balancer mode", 2024-08-20T01:55:20.605 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.605 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.605 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.606 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_ids": { 2024-08-20T01:55:20.606 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "pool_ids", 2024-08-20T01:55:20.606 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.606 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.606 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.606 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.606 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.607 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.607 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.607 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-20T01:55:20.607 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.607 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.608 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.608 INFO:teuthology.orchestra.run.smithi079.stdout: "sleep_interval": { 2024-08-20T01:55:20.608 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sleep_interval", 2024-08-20T01:55:20.608 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:20.608 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.608 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.608 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "60", 2024-08-20T01:55:20.608 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.608 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.608 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.608 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-20T01:55:20.609 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.609 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.609 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.609 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:20.609 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:20.609 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.609 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:20.609 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.609 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:20.609 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.609 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.609 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.610 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.610 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.610 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.610 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.610 INFO:teuthology.orchestra.run.smithi079.stdout: "upmap_max_deviation": { 2024-08-20T01:55:20.610 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "upmap_max_deviation", 2024-08-20T01:55:20.610 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.610 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.610 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.610 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5", 2024-08-20T01:55:20.610 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "1", 2024-08-20T01:55:20.611 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.611 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.611 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-20T01:55:20.611 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-20T01:55:20.611 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.611 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.611 INFO:teuthology.orchestra.run.smithi079.stdout: "upmap_max_optimizations": { 2024-08-20T01:55:20.611 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "upmap_max_optimizations", 2024-08-20T01:55:20.611 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "uint", 2024-08-20T01:55:20.611 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.611 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.611 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-08-20T01:55:20.611 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.612 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.612 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.612 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-20T01:55:20.612 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.612 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.612 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.612 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.612 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:20.612 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "cephadm", 2024-08-20T01:55:20.612 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:20.612 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:20.613 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:20.613 INFO:teuthology.orchestra.run.smithi079.stdout: "agent_down_multiplier": { 2024-08-20T01:55:20.613 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "agent_down_multiplier", 2024-08-20T01:55:20.613 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2024-08-20T01:55:20.613 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.613 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.613 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "3.0", 2024-08-20T01:55:20.613 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.613 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.613 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.613 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-20T01:55:20.613 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.613 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.613 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.614 INFO:teuthology.orchestra.run.smithi079.stdout: "agent_refresh_rate": { 2024-08-20T01:55:20.614 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "agent_refresh_rate", 2024-08-20T01:55:20.614 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:20.614 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.614 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.614 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "20", 2024-08-20T01:55:20.614 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.614 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.614 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.614 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-20T01:55:20.614 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.614 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.615 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.615 INFO:teuthology.orchestra.run.smithi079.stdout: "agent_starting_port": { 2024-08-20T01:55:20.615 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "agent_starting_port", 2024-08-20T01:55:20.615 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.615 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.615 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.615 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "4721", 2024-08-20T01:55:20.615 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.615 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.615 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.615 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-20T01:55:20.615 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.616 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.616 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.616 INFO:teuthology.orchestra.run.smithi079.stdout: "allow_ptrace": { 2024-08-20T01:55:20.616 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "allow_ptrace", 2024-08-20T01:55:20.616 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.616 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.616 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.616 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.616 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.616 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.617 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.617 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-20T01:55:20.617 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-20T01:55:20.617 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.617 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.617 INFO:teuthology.orchestra.run.smithi079.stdout: "autotune_interval": { 2024-08-20T01:55:20.617 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "autotune_interval", 2024-08-20T01:55:20.617 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:20.617 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.617 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.617 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "600", 2024-08-20T01:55:20.618 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.618 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.618 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.618 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-20T01:55:20.618 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.618 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.618 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.618 INFO:teuthology.orchestra.run.smithi079.stdout: "autotune_memory_target_ratio": { 2024-08-20T01:55:20.618 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "autotune_memory_target_ratio", 2024-08-20T01:55:20.618 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2024-08-20T01:55:20.618 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.619 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.619 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0.7", 2024-08-20T01:55:20.619 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.619 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.619 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.619 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-20T01:55:20.619 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.619 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.619 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.619 INFO:teuthology.orchestra.run.smithi079.stdout: "cephadm_log_destination": { 2024-08-20T01:55:20.619 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "cephadm_log_destination", 2024-08-20T01:55:20.619 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.619 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.620 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.620 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.620 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.620 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.620 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.620 INFO:teuthology.orchestra.run.smithi079.stdout: "file", 2024-08-20T01:55:20.620 INFO:teuthology.orchestra.run.smithi079.stdout: "file,syslog", 2024-08-20T01:55:20.620 INFO:teuthology.orchestra.run.smithi079.stdout: "syslog" 2024-08-20T01:55:20.620 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.620 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-20T01:55:20.620 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.620 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.620 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.621 INFO:teuthology.orchestra.run.smithi079.stdout: "cgroups_split": { 2024-08-20T01:55:20.621 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "cgroups_split", 2024-08-20T01:55:20.621 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.621 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.621 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.621 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:20.621 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.621 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.621 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.621 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-20T01:55:20.621 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.621 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.621 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.622 INFO:teuthology.orchestra.run.smithi079.stdout: "config_checks_enabled": { 2024-08-20T01:55:20.622 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "config_checks_enabled", 2024-08-20T01:55:20.622 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.622 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.622 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.622 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.622 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.622 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.622 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.622 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-20T01:55:20.623 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.623 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.623 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.623 INFO:teuthology.orchestra.run.smithi079.stdout: "config_dashboard": { 2024-08-20T01:55:20.623 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "config_dashboard", 2024-08-20T01:55:20.623 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.623 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.623 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.623 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:20.623 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.623 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.624 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.624 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-20T01:55:20.624 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.624 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.624 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.624 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_alertmanager": { 2024-08-20T01:55:20.624 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_alertmanager", 2024-08-20T01:55:20.624 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.624 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.624 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.624 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-08-20T01:55:20.624 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.624 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.625 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.625 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Prometheus container image", 2024-08-20T01:55:20.625 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.625 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.625 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.625 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_base": { 2024-08-20T01:55:20.625 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_base", 2024-08-20T01:55:20.625 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.625 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.625 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.626 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-20T01:55:20.626 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.626 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.626 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.626 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Container image name, without the tag", 2024-08-20T01:55:20.626 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.626 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.626 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.626 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_elasticsearch": { 2024-08-20T01:55:20.626 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_elasticsearch", 2024-08-20T01:55:20.627 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.627 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.627 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.627 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-20T01:55:20.627 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.627 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.627 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.627 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "elasticsearch container image", 2024-08-20T01:55:20.627 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.627 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.627 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.628 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_grafana": { 2024-08-20T01:55:20.628 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_grafana", 2024-08-20T01:55:20.628 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.628 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.628 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.628 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-08-20T01:55:20.628 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.628 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.628 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.628 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Prometheus container image", 2024-08-20T01:55:20.628 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.629 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.629 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.629 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_haproxy": { 2024-08-20T01:55:20.629 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_haproxy", 2024-08-20T01:55:20.629 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.629 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.629 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.629 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-20T01:55:20.629 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.629 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.629 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.629 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "HAproxy container image", 2024-08-20T01:55:20.630 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.630 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.630 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.630 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_jaeger_agent": { 2024-08-20T01:55:20.630 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_jaeger_agent", 2024-08-20T01:55:20.630 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.630 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.630 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.630 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-20T01:55:20.630 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.630 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.631 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.631 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Jaeger agent container image", 2024-08-20T01:55:20.631 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.631 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.631 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.631 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_jaeger_collector": { 2024-08-20T01:55:20.631 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_jaeger_collector", 2024-08-20T01:55:20.631 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.631 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.631 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.631 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-20T01:55:20.631 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.632 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.632 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.632 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Jaeger collector container image", 2024-08-20T01:55:20.632 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.632 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.632 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.632 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_jaeger_query": { 2024-08-20T01:55:20.632 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_jaeger_query", 2024-08-20T01:55:20.632 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.632 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.632 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.633 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-20T01:55:20.633 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.633 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.633 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.633 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Jaeger query container image", 2024-08-20T01:55:20.633 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.633 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.633 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.633 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_keepalived": { 2024-08-20T01:55:20.633 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_keepalived", 2024-08-20T01:55:20.633 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.633 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.633 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.634 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-20T01:55:20.634 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.634 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.634 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.634 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Keepalived container image", 2024-08-20T01:55:20.634 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.634 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.634 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.634 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_loki": { 2024-08-20T01:55:20.634 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_loki", 2024-08-20T01:55:20.635 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.635 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.635 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.635 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-20T01:55:20.635 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.635 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.635 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.635 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Loki container image", 2024-08-20T01:55:20.635 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.635 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.635 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.635 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_nginx": { 2024-08-20T01:55:20.635 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_nginx", 2024-08-20T01:55:20.636 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.636 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.636 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.636 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-08-20T01:55:20.636 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.636 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.636 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.636 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Nginx container image", 2024-08-20T01:55:20.636 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.636 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.636 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.637 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_node_exporter": { 2024-08-20T01:55:20.637 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_node_exporter", 2024-08-20T01:55:20.637 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.637 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.637 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.637 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-08-20T01:55:20.637 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.637 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.637 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.637 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Prometheus container image", 2024-08-20T01:55:20.637 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.637 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.637 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.638 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_nvmeof": { 2024-08-20T01:55:20.638 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_nvmeof", 2024-08-20T01:55:20.638 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.638 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.638 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.638 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-08-20T01:55:20.638 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.638 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.638 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.638 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Nvme-of container image", 2024-08-20T01:55:20.638 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.638 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.639 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.639 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_prometheus": { 2024-08-20T01:55:20.639 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_prometheus", 2024-08-20T01:55:20.639 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.639 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.639 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.639 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-08-20T01:55:20.639 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.639 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.639 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.639 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Prometheus container image", 2024-08-20T01:55:20.639 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.639 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.640 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.640 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_promtail": { 2024-08-20T01:55:20.640 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_promtail", 2024-08-20T01:55:20.640 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.640 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.640 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.640 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-20T01:55:20.640 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.640 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.640 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.640 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Promtail container image", 2024-08-20T01:55:20.641 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.641 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.641 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.641 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_samba": { 2024-08-20T01:55:20.641 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_samba", 2024-08-20T01:55:20.641 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.641 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.641 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.641 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-20T01:55:20.641 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.641 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.641 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.642 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Samba/SMB container image", 2024-08-20T01:55:20.642 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.642 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.642 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.642 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_snmp_gateway": { 2024-08-20T01:55:20.642 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_snmp_gateway", 2024-08-20T01:55:20.642 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.642 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.642 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.642 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-20T01:55:20.642 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.643 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.643 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.643 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "SNMP Gateway container image", 2024-08-20T01:55:20.643 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.643 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.643 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.643 INFO:teuthology.orchestra.run.smithi079.stdout: "container_init": { 2024-08-20T01:55:20.643 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_init", 2024-08-20T01:55:20.643 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.643 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.643 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.643 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:20.644 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.644 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.644 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.644 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Run podman/docker with `--init`", 2024-08-20T01:55:20.644 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.644 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.644 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.644 INFO:teuthology.orchestra.run.smithi079.stdout: "daemon_cache_timeout": { 2024-08-20T01:55:20.644 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "daemon_cache_timeout", 2024-08-20T01:55:20.644 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:20.644 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.644 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.645 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "600", 2024-08-20T01:55:20.645 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.645 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.645 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.645 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-20T01:55:20.645 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.645 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.645 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.645 INFO:teuthology.orchestra.run.smithi079.stdout: "default_cephadm_command_timeout": { 2024-08-20T01:55:20.645 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "default_cephadm_command_timeout", 2024-08-20T01:55:20.645 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.645 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.646 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.646 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "900", 2024-08-20T01:55:20.646 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.646 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.646 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.646 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-20T01:55:20.646 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.646 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.646 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.647 INFO:teuthology.orchestra.run.smithi079.stdout: "default_registry": { 2024-08-20T01:55:20.647 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "default_registry", 2024-08-20T01:55:20.647 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.647 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.647 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.647 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "docker.io", 2024-08-20T01:55:20.647 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.647 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.647 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.647 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-20T01:55:20.647 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.647 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.647 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.648 INFO:teuthology.orchestra.run.smithi079.stdout: "device_cache_timeout": { 2024-08-20T01:55:20.648 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "device_cache_timeout", 2024-08-20T01:55:20.648 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:20.648 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.648 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.648 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "1800", 2024-08-20T01:55:20.648 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.648 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.648 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.648 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "seconds to cache device inventory", 2024-08-20T01:55:20.648 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.648 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.649 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.649 INFO:teuthology.orchestra.run.smithi079.stdout: "device_enhanced_scan": { 2024-08-20T01:55:20.649 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "device_enhanced_scan", 2024-08-20T01:55:20.649 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.649 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.649 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.649 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.649 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.649 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.649 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.649 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-20T01:55:20.649 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.650 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.650 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.650 INFO:teuthology.orchestra.run.smithi079.stdout: "facts_cache_timeout": { 2024-08-20T01:55:20.650 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "facts_cache_timeout", 2024-08-20T01:55:20.650 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:20.650 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.650 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.650 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "60", 2024-08-20T01:55:20.650 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.650 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.650 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.651 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "seconds to cache host facts data", 2024-08-20T01:55:20.651 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.651 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.651 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.651 INFO:teuthology.orchestra.run.smithi079.stdout: "grafana_dashboards_path": { 2024-08-20T01:55:20.651 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "grafana_dashboards_path", 2024-08-20T01:55:20.651 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.651 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.651 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.651 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-20T01:55:20.651 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.651 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.651 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.652 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-20T01:55:20.652 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.652 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.652 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.652 INFO:teuthology.orchestra.run.smithi079.stdout: "host_check_interval": { 2024-08-20T01:55:20.652 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "host_check_interval", 2024-08-20T01:55:20.652 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:20.652 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.652 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.652 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "600", 2024-08-20T01:55:20.652 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.652 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.652 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.653 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how frequently to perform a host check", 2024-08-20T01:55:20.653 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.653 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.653 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.653 INFO:teuthology.orchestra.run.smithi079.stdout: "hw_monitoring": { 2024-08-20T01:55:20.653 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "hw_monitoring", 2024-08-20T01:55:20.653 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.653 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.653 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.653 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.653 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.653 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.653 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.654 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-20T01:55:20.654 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.654 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.654 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.654 INFO:teuthology.orchestra.run.smithi079.stdout: "inventory_list_all": { 2024-08-20T01:55:20.654 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "inventory_list_all", 2024-08-20T01:55:20.654 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.654 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.654 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.654 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.655 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.655 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.655 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.655 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-20T01:55:20.655 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.655 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.655 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.655 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:20.655 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:20.655 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.655 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.656 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.656 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.656 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.656 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.656 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.656 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.656 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.656 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.656 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.656 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.656 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.656 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.656 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.657 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.657 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.657 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.657 INFO:teuthology.orchestra.run.smithi079.stdout: "log_refresh_metadata": { 2024-08-20T01:55:20.657 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_refresh_metadata", 2024-08-20T01:55:20.657 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.657 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.657 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.657 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.657 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.657 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.657 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.657 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-20T01:55:20.658 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.658 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.658 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.658 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:20.658 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:20.658 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.658 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.658 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.658 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:20.658 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.659 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.659 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.659 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-20T01:55:20.659 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.659 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.659 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.659 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:20.659 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:20.659 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.659 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.659 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.659 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:20.660 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.660 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.660 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.660 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.660 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.660 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.660 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.660 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.660 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.660 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.660 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.660 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.661 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.661 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.661 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:20.661 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:20.661 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.661 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.661 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.661 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.661 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.661 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.661 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.661 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.661 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.662 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.662 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.662 INFO:teuthology.orchestra.run.smithi079.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-20T01:55:20.662 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-20T01:55:20.662 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.662 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.662 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.662 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.662 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.662 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.662 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.663 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-20T01:55:20.663 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.663 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.663 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.663 INFO:teuthology.orchestra.run.smithi079.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-20T01:55:20.663 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-20T01:55:20.663 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.663 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.663 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.663 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "*", 2024-08-20T01:55:20.663 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.663 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.664 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.664 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-20T01:55:20.664 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.664 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.664 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.664 INFO:teuthology.orchestra.run.smithi079.stdout: "max_count_per_host": { 2024-08-20T01:55:20.664 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "max_count_per_host", 2024-08-20T01:55:20.664 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.664 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.664 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.664 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-08-20T01:55:20.664 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.665 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.665 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.665 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "max number of daemons per service per host", 2024-08-20T01:55:20.665 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.665 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.665 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.665 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd_draining_count": { 2024-08-20T01:55:20.665 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "max_osd_draining_count", 2024-08-20T01:55:20.665 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.665 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.665 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.665 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-08-20T01:55:20.665 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.666 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.666 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.666 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-20T01:55:20.666 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.666 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.666 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.666 INFO:teuthology.orchestra.run.smithi079.stdout: "migration_current": { 2024-08-20T01:55:20.666 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "migration_current", 2024-08-20T01:55:20.666 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.666 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.666 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.666 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.667 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.667 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.667 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.667 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "internal - do not modify", 2024-08-20T01:55:20.667 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.667 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.667 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.667 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": { 2024-08-20T01:55:20.667 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "mode", 2024-08-20T01:55:20.667 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.667 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.667 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.667 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "root", 2024-08-20T01:55:20.668 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.668 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.668 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.668 INFO:teuthology.orchestra.run.smithi079.stdout: "cephadm-package", 2024-08-20T01:55:20.668 INFO:teuthology.orchestra.run.smithi079.stdout: "root" 2024-08-20T01:55:20.668 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.668 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "mode for remote execution of cephadm", 2024-08-20T01:55:20.668 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.668 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.668 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.669 INFO:teuthology.orchestra.run.smithi079.stdout: "oob_default_addr": { 2024-08-20T01:55:20.669 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "oob_default_addr", 2024-08-20T01:55:20.669 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.669 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.669 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.669 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "169.254.1.1", 2024-08-20T01:55:20.669 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.669 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.669 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.669 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-20T01:55:20.669 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.669 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.670 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.670 INFO:teuthology.orchestra.run.smithi079.stdout: "prometheus_alerts_path": { 2024-08-20T01:55:20.670 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "prometheus_alerts_path", 2024-08-20T01:55:20.670 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.670 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.670 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.670 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-20T01:55:20.670 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.670 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.670 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.670 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-20T01:55:20.670 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.671 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.671 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.671 INFO:teuthology.orchestra.run.smithi079.stdout: "registry_insecure": { 2024-08-20T01:55:20.671 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "registry_insecure", 2024-08-20T01:55:20.671 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.671 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.671 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.671 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.671 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.672 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.672 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.672 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-20T01:55:20.672 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.672 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.672 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.672 INFO:teuthology.orchestra.run.smithi079.stdout: "registry_password": { 2024-08-20T01:55:20.672 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "registry_password", 2024-08-20T01:55:20.672 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.672 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.672 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.673 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.673 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.673 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.673 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.673 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-20T01:55:20.673 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.673 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.673 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.673 INFO:teuthology.orchestra.run.smithi079.stdout: "registry_url": { 2024-08-20T01:55:20.673 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "registry_url", 2024-08-20T01:55:20.674 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.674 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.674 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.674 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.674 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.674 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.674 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.674 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-20T01:55:20.674 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.675 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.675 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.675 INFO:teuthology.orchestra.run.smithi079.stdout: "registry_username": { 2024-08-20T01:55:20.675 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "registry_username", 2024-08-20T01:55:20.675 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.675 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.675 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.675 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.675 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.675 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.676 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.676 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-20T01:55:20.676 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.676 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.676 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.676 INFO:teuthology.orchestra.run.smithi079.stdout: "secure_monitoring_stack": { 2024-08-20T01:55:20.676 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "secure_monitoring_stack", 2024-08-20T01:55:20.676 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.676 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.676 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.676 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.676 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.677 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.677 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.677 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-20T01:55:20.677 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.677 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.677 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.677 INFO:teuthology.orchestra.run.smithi079.stdout: "service_discovery_port": { 2024-08-20T01:55:20.677 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "service_discovery_port", 2024-08-20T01:55:20.677 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.677 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.677 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.677 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "8765", 2024-08-20T01:55:20.678 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.678 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.678 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.678 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "cephadm service discovery port", 2024-08-20T01:55:20.678 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.678 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.678 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.678 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:20.678 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:20.678 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.678 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:20.678 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.679 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:20.679 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.679 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.679 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.679 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.679 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.679 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.679 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.679 INFO:teuthology.orchestra.run.smithi079.stdout: "ssh_config_file": { 2024-08-20T01:55:20.679 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ssh_config_file", 2024-08-20T01:55:20.679 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.679 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.680 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.680 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.680 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.680 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.680 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.680 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-20T01:55:20.680 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.680 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.680 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.680 INFO:teuthology.orchestra.run.smithi079.stdout: "use_agent": { 2024-08-20T01:55:20.680 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "use_agent", 2024-08-20T01:55:20.680 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.680 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.681 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.681 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.681 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.681 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.681 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.681 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-20T01:55:20.681 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.681 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.681 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.681 INFO:teuthology.orchestra.run.smithi079.stdout: "use_repo_digest": { 2024-08-20T01:55:20.681 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "use_repo_digest", 2024-08-20T01:55:20.681 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.681 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.682 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.682 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:20.682 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.682 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.682 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.682 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-20T01:55:20.682 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.682 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.682 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.682 INFO:teuthology.orchestra.run.smithi079.stdout: "warn_on_failed_host_check": { 2024-08-20T01:55:20.682 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "warn_on_failed_host_check", 2024-08-20T01:55:20.682 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.683 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.683 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.683 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:20.683 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.683 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.683 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.683 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "raise a health warning if the host check fails", 2024-08-20T01:55:20.683 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.683 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.683 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.683 INFO:teuthology.orchestra.run.smithi079.stdout: "warn_on_stray_daemons": { 2024-08-20T01:55:20.683 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "warn_on_stray_daemons", 2024-08-20T01:55:20.684 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.684 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.684 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.684 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:20.684 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.684 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.684 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.684 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-20T01:55:20.684 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.684 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.684 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.684 INFO:teuthology.orchestra.run.smithi079.stdout: "warn_on_stray_hosts": { 2024-08-20T01:55:20.684 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "warn_on_stray_hosts", 2024-08-20T01:55:20.685 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.685 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.685 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.685 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:20.685 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.685 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.685 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.685 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-20T01:55:20.685 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.685 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.686 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.686 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.686 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:20.686 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "crash", 2024-08-20T01:55:20.686 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:20.686 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:20.686 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:20.686 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:20.686 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:20.687 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.687 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.687 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.687 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.687 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.687 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.687 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.687 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.687 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.687 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.687 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.687 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.687 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.688 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.688 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.688 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.688 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.688 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.688 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:20.688 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:20.688 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.688 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.688 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.688 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.688 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.688 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.689 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.689 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.689 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.689 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.689 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.689 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:20.689 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:20.689 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.689 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.689 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.689 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:20.689 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.689 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.690 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.690 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.690 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.690 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.690 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.690 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.690 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.690 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.690 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.690 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.690 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.690 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.691 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:20.691 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:20.691 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.691 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.691 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.691 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.691 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.691 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.691 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.691 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.691 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.691 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.691 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.692 INFO:teuthology.orchestra.run.smithi079.stdout: "retain_interval": { 2024-08-20T01:55:20.692 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "retain_interval", 2024-08-20T01:55:20.692 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:20.692 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.692 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.692 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "31536000", 2024-08-20T01:55:20.692 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.692 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.692 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.692 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-20T01:55:20.692 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.692 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.692 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.693 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:20.693 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:20.693 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.693 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:20.693 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.693 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:20.693 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.693 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.693 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.693 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.693 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.693 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.694 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.694 INFO:teuthology.orchestra.run.smithi079.stdout: "warn_recent_interval": { 2024-08-20T01:55:20.694 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "warn_recent_interval", 2024-08-20T01:55:20.694 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:20.694 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.694 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.694 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "1209600", 2024-08-20T01:55:20.694 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.694 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.694 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.694 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-20T01:55:20.694 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.694 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.695 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.695 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.695 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:20.695 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "dashboard", 2024-08-20T01:55:20.695 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:20.695 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:20.695 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:20.695 INFO:teuthology.orchestra.run.smithi079.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-20T01:55:20.695 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-20T01:55:20.695 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.695 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.696 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.696 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-08-20T01:55:20.696 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.696 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.696 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.696 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.696 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.696 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.696 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.696 INFO:teuthology.orchestra.run.smithi079.stdout: "ALERTMANAGER_API_HOST": { 2024-08-20T01:55:20.696 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-20T01:55:20.696 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.697 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.697 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.697 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.697 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.697 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.697 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.697 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.697 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.697 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.697 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.697 INFO:teuthology.orchestra.run.smithi079.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-20T01:55:20.697 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-20T01:55:20.698 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.698 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.698 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.698 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:20.698 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.698 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.698 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.698 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.698 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.698 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.698 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.698 INFO:teuthology.orchestra.run.smithi079.stdout: "AUDIT_API_ENABLED": { 2024-08-20T01:55:20.699 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "AUDIT_API_ENABLED", 2024-08-20T01:55:20.699 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.699 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.699 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.699 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.699 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.699 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.699 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.699 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.699 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.699 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.699 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.699 INFO:teuthology.orchestra.run.smithi079.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-20T01:55:20.700 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-20T01:55:20.700 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.700 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.700 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.700 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:20.700 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.700 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.700 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.700 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.700 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.700 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.700 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.701 INFO:teuthology.orchestra.run.smithi079.stdout: "ENABLE_BROWSABLE_API": { 2024-08-20T01:55:20.701 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-20T01:55:20.701 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.701 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.701 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.701 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:20.701 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.701 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.701 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.701 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.701 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.701 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.702 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.702 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-20T01:55:20.702 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-20T01:55:20.702 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.702 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.702 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.702 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:20.702 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.702 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.702 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.703 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.703 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.703 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.703 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.703 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-20T01:55:20.704 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-20T01:55:20.704 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.704 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.704 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.704 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:20.704 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.705 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.705 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.705 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.705 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.705 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.705 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.705 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-20T01:55:20.705 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-20T01:55:20.705 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.705 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.705 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.705 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:20.706 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.706 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.706 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.706 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.706 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.706 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.706 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.706 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-20T01:55:20.706 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-20T01:55:20.706 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.706 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.706 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.707 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:20.707 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.707 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.707 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.707 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.707 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.707 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.708 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.708 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-20T01:55:20.708 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-20T01:55:20.708 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.709 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.709 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.709 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:20.709 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.709 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.709 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.709 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.709 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.709 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.709 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.709 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-20T01:55:20.709 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-20T01:55:20.710 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.710 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.710 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.710 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:20.710 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.710 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.710 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.710 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.710 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.710 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.710 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.711 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-20T01:55:20.711 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-20T01:55:20.711 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.711 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.711 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.711 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:20.711 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.711 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.711 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.711 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.711 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.712 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.712 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.712 INFO:teuthology.orchestra.run.smithi079.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-20T01:55:20.712 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-20T01:55:20.712 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.712 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.712 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.712 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.712 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.713 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.713 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.713 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.713 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.713 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.713 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.713 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_API_PASSWORD": { 2024-08-20T01:55:20.713 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-20T01:55:20.713 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.713 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.713 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.714 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "admin", 2024-08-20T01:55:20.714 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.714 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.714 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.714 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.714 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.714 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.714 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.714 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-20T01:55:20.714 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-20T01:55:20.714 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.715 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.715 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.715 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:20.715 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.715 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.715 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.715 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.715 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.715 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.715 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.716 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_API_URL": { 2024-08-20T01:55:20.716 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_API_URL", 2024-08-20T01:55:20.716 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.716 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.716 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.716 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.716 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.716 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.716 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.716 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.716 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.716 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.717 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.717 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.717 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_API_USERNAME": { 2024-08-20T01:55:20.717 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-20T01:55:20.717 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.717 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.717 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.717 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "admin", 2024-08-20T01:55:20.717 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.718 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.718 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.718 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.718 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.718 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.718 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.718 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-20T01:55:20.718 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-20T01:55:20.718 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.718 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.718 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.719 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.719 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.719 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.719 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.719 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.719 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.719 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.719 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.719 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-20T01:55:20.719 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-20T01:55:20.719 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.719 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.719 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.720 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.720 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.720 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.720 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.720 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.720 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.720 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.720 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.720 INFO:teuthology.orchestra.run.smithi079.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-20T01:55:20.720 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-20T01:55:20.720 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.720 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.720 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.721 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:20.721 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.721 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.721 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.721 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.721 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.721 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.721 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.721 INFO:teuthology.orchestra.run.smithi079.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-20T01:55:20.721 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-20T01:55:20.721 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.721 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.721 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.722 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.722 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.722 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.722 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.722 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.722 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.722 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.722 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.722 INFO:teuthology.orchestra.run.smithi079.stdout: "MANAGED_BY_CLUSTERS": { 2024-08-20T01:55:20.722 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-08-20T01:55:20.723 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.723 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.723 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.723 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "[]", 2024-08-20T01:55:20.723 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.723 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.723 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.723 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.723 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.723 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.723 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.724 INFO:teuthology.orchestra.run.smithi079.stdout: "MULTICLUSTER_CONFIG": { 2024-08-20T01:55:20.724 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "MULTICLUSTER_CONFIG", 2024-08-20T01:55:20.724 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.724 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.724 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.724 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "{}", 2024-08-20T01:55:20.724 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.724 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.724 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.724 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.724 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.724 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.724 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.725 INFO:teuthology.orchestra.run.smithi079.stdout: "PROMETHEUS_API_HOST": { 2024-08-20T01:55:20.725 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-20T01:55:20.725 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.725 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.725 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.725 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.725 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.725 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.725 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.725 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.725 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.725 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.725 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.726 INFO:teuthology.orchestra.run.smithi079.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-20T01:55:20.726 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-20T01:55:20.726 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.726 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.726 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.726 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:20.726 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.726 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.726 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.726 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.726 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.726 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.727 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.727 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-20T01:55:20.727 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-20T01:55:20.727 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.727 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.727 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.727 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.727 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.727 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.727 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.727 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.727 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.728 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.728 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.728 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-20T01:55:20.728 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-20T01:55:20.728 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.728 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.728 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.728 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.728 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.728 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.728 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.728 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.729 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.729 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.729 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.729 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-20T01:55:20.729 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-20T01:55:20.729 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.729 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.729 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.729 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:20.729 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.730 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.730 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.730 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.730 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.730 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.730 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.730 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-20T01:55:20.730 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-20T01:55:20.730 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.730 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.730 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.731 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:20.731 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.731 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.731 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.731 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.731 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.731 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.731 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.731 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-20T01:55:20.731 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-20T01:55:20.731 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.731 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.731 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.732 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.732 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.732 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.732 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.732 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.732 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.732 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.732 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.732 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.732 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-20T01:55:20.732 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-20T01:55:20.732 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.732 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.733 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.733 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.733 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.733 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.733 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.733 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.733 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.733 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.733 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.733 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.733 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-20T01:55:20.733 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-20T01:55:20.733 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.733 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.734 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.734 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.734 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.734 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.734 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.734 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.734 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.734 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.734 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.734 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.734 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_ENABLED": { 2024-08-20T01:55:20.734 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-20T01:55:20.735 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.735 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.735 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.735 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:20.735 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.735 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.735 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.735 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.735 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.735 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.735 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.735 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-20T01:55:20.735 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-20T01:55:20.736 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.736 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.736 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.736 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-20T01:55:20.736 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.736 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.736 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.736 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.736 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.736 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.736 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.737 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-20T01:55:20.737 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-20T01:55:20.737 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.737 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.737 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.737 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-08-20T01:55:20.737 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.737 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.737 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.737 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.737 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.737 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.738 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.738 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-20T01:55:20.738 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-20T01:55:20.738 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.738 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.738 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.738 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "8", 2024-08-20T01:55:20.738 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.738 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.738 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.738 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.738 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.739 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.739 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.739 INFO:teuthology.orchestra.run.smithi079.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-20T01:55:20.739 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-20T01:55:20.739 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.739 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.739 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.739 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "45", 2024-08-20T01:55:20.739 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.739 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.739 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.740 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.740 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.740 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.740 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.740 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.740 INFO:teuthology.orchestra.run.smithi079.stdout: "RGW_API_ACCESS_KEY": { 2024-08-20T01:55:20.740 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-20T01:55:20.740 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.740 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.740 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.740 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.740 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.740 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.740 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.741 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.741 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.741 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.741 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.741 INFO:teuthology.orchestra.run.smithi079.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-20T01:55:20.741 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-20T01:55:20.741 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.741 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.741 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.741 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "admin", 2024-08-20T01:55:20.741 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.741 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.742 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.742 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.742 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.742 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.742 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.742 INFO:teuthology.orchestra.run.smithi079.stdout: "RGW_API_SECRET_KEY": { 2024-08-20T01:55:20.742 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-20T01:55:20.742 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.742 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.742 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.743 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.743 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.743 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.743 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.743 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.743 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.743 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.743 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.743 INFO:teuthology.orchestra.run.smithi079.stdout: "RGW_API_SSL_VERIFY": { 2024-08-20T01:55:20.743 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-20T01:55:20.743 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.744 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.744 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.744 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:20.744 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.744 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.744 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.744 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.744 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.744 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.744 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.744 INFO:teuthology.orchestra.run.smithi079.stdout: "UNSAFE_TLS_v1_2": { 2024-08-20T01:55:20.744 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "UNSAFE_TLS_v1_2", 2024-08-20T01:55:20.745 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.745 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.745 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.745 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.745 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.745 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.745 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.745 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.745 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.745 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.745 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.745 INFO:teuthology.orchestra.run.smithi079.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-20T01:55:20.746 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-20T01:55:20.746 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.746 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.746 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.746 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:20.746 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.746 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.746 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.746 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.746 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.746 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.747 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.747 INFO:teuthology.orchestra.run.smithi079.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-20T01:55:20.747 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-20T01:55:20.747 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.747 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.747 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.747 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-08-20T01:55:20.747 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.747 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.747 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.747 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.747 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.747 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.748 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.748 INFO:teuthology.orchestra.run.smithi079.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-20T01:55:20.748 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-20T01:55:20.748 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.748 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.748 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.748 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5", 2024-08-20T01:55:20.748 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.748 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.748 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.748 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.748 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.748 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.749 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.749 INFO:teuthology.orchestra.run.smithi079.stdout: "cross_origin_url": { 2024-08-20T01:55:20.749 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "cross_origin_url", 2024-08-20T01:55:20.749 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.749 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.749 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.749 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.749 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.749 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.749 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.749 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.749 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.750 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.750 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.750 INFO:teuthology.orchestra.run.smithi079.stdout: "crt_file": { 2024-08-20T01:55:20.750 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "crt_file", 2024-08-20T01:55:20.750 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.750 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.750 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.750 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.750 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.750 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.750 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.751 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.751 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.751 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.751 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.751 INFO:teuthology.orchestra.run.smithi079.stdout: "debug": { 2024-08-20T01:55:20.751 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "debug", 2024-08-20T01:55:20.751 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.751 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.751 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.751 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.751 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.751 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.751 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.752 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Enable/disable debug options", 2024-08-20T01:55:20.752 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.752 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.752 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.752 INFO:teuthology.orchestra.run.smithi079.stdout: "jwt_token_ttl": { 2024-08-20T01:55:20.752 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "jwt_token_ttl", 2024-08-20T01:55:20.752 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.752 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.752 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.752 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "28800", 2024-08-20T01:55:20.752 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.752 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.752 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.753 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.753 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.753 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.753 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.753 INFO:teuthology.orchestra.run.smithi079.stdout: "key_file": { 2024-08-20T01:55:20.753 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "key_file", 2024-08-20T01:55:20.753 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.753 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.753 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.753 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.753 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.753 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.753 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.754 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.754 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.754 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.754 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.754 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:20.754 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:20.754 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.754 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.754 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.754 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.755 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.755 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.755 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.755 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.755 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.755 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.755 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.755 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.755 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.755 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.755 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.755 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.755 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.756 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.756 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:20.756 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:20.756 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.756 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.756 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.756 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.756 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.756 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.756 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.756 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.756 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.757 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.757 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.757 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.757 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:20.757 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:20.757 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.757 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.757 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.757 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:20.757 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.757 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.757 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.758 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.758 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.758 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.758 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.758 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.758 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.758 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.758 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.758 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.758 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.758 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.758 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.758 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:20.759 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:20.759 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.759 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.759 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.759 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.759 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.759 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.759 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.759 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.759 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.759 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.759 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.759 INFO:teuthology.orchestra.run.smithi079.stdout: "motd": { 2024-08-20T01:55:20.760 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "motd", 2024-08-20T01:55:20.760 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.760 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.760 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.760 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.760 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.760 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.760 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.760 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "The message of the day", 2024-08-20T01:55:20.760 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.760 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.761 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.761 INFO:teuthology.orchestra.run.smithi079.stdout: "redirect_resolve_ip_addr": { 2024-08-20T01:55:20.761 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "redirect_resolve_ip_addr", 2024-08-20T01:55:20.761 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.761 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.761 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.761 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.761 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.761 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.761 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.761 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.761 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.761 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.762 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.762 INFO:teuthology.orchestra.run.smithi079.stdout: "server_addr": { 2024-08-20T01:55:20.762 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_addr", 2024-08-20T01:55:20.762 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.762 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.762 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.762 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "::", 2024-08-20T01:55:20.763 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.763 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.763 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.763 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.763 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.763 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.763 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.763 INFO:teuthology.orchestra.run.smithi079.stdout: "server_port": { 2024-08-20T01:55:20.763 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_port", 2024-08-20T01:55:20.763 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.763 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.763 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.764 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "8080", 2024-08-20T01:55:20.764 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.764 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.764 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.764 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.764 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.764 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.764 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.764 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:20.764 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:20.764 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.764 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:20.764 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.765 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:20.765 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.765 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.765 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.765 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.765 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.765 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.765 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.765 INFO:teuthology.orchestra.run.smithi079.stdout: "ssl": { 2024-08-20T01:55:20.765 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ssl", 2024-08-20T01:55:20.765 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.765 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.766 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.766 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:20.766 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.766 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.766 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.766 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.766 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.766 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.766 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.766 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.766 INFO:teuthology.orchestra.run.smithi079.stdout: "ssl_server_port": { 2024-08-20T01:55:20.766 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ssl_server_port", 2024-08-20T01:55:20.766 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.767 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.767 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.767 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "8443", 2024-08-20T01:55:20.767 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.767 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.767 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.767 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.767 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.767 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.767 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.767 INFO:teuthology.orchestra.run.smithi079.stdout: "standby_behaviour": { 2024-08-20T01:55:20.767 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "standby_behaviour", 2024-08-20T01:55:20.768 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.768 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.768 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.768 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "redirect", 2024-08-20T01:55:20.768 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.768 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.768 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.768 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.768 INFO:teuthology.orchestra.run.smithi079.stdout: "redirect" 2024-08-20T01:55:20.768 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.768 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.768 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.768 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.769 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.769 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.769 INFO:teuthology.orchestra.run.smithi079.stdout: "standby_error_status_code": { 2024-08-20T01:55:20.769 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "standby_error_status_code", 2024-08-20T01:55:20.769 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.769 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.769 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.769 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "500", 2024-08-20T01:55:20.769 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "400", 2024-08-20T01:55:20.769 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "599", 2024-08-20T01:55:20.769 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.770 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.770 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.770 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.770 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.770 INFO:teuthology.orchestra.run.smithi079.stdout: "url_prefix": { 2024-08-20T01:55:20.770 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "url_prefix", 2024-08-20T01:55:20.770 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.770 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.770 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.770 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.770 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.770 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.771 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.771 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.771 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.771 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.771 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.771 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.771 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.771 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:20.771 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "devicehealth", 2024-08-20T01:55:20.771 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:20.771 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:20.771 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:20.771 INFO:teuthology.orchestra.run.smithi079.stdout: "enable_monitoring": { 2024-08-20T01:55:20.772 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "enable_monitoring", 2024-08-20T01:55:20.772 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.772 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.772 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.772 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:20.772 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.772 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.772 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.772 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "monitor device health metrics", 2024-08-20T01:55:20.772 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.772 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.773 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.773 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:20.773 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:20.773 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.773 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.773 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.773 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.773 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.773 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.773 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.773 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.773 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.774 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.774 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.774 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.774 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.774 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.774 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.774 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.774 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.774 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.775 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:20.775 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:20.775 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.775 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.775 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.775 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.775 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.775 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.775 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.775 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.776 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.776 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.776 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.776 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:20.776 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:20.776 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.776 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.776 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.776 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:20.776 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.776 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.776 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.777 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.777 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.777 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.777 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.777 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.777 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.777 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.777 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.777 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.777 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.777 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.777 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:20.777 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:20.778 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.778 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.778 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.778 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.778 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.778 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.778 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.778 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.778 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.778 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.778 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.779 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.779 INFO:teuthology.orchestra.run.smithi079.stdout: "mark_out_threshold": { 2024-08-20T01:55:20.779 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "mark_out_threshold", 2024-08-20T01:55:20.779 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:20.779 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.779 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.779 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "2419200", 2024-08-20T01:55:20.779 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.779 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.779 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.779 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-20T01:55:20.779 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.779 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.779 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.780 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.780 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": { 2024-08-20T01:55:20.780 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "pool_name", 2024-08-20T01:55:20.780 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.780 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.780 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.780 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "device_health_metrics", 2024-08-20T01:55:20.780 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.780 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.780 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.780 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-20T01:55:20.780 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.780 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.781 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.781 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.781 INFO:teuthology.orchestra.run.smithi079.stdout: "retention_period": { 2024-08-20T01:55:20.781 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "retention_period", 2024-08-20T01:55:20.781 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:20.781 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.781 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.781 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "15552000", 2024-08-20T01:55:20.781 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.781 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.781 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.781 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how long to retain device health metrics", 2024-08-20T01:55:20.781 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.781 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.782 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.782 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.782 INFO:teuthology.orchestra.run.smithi079.stdout: "scrape_frequency": { 2024-08-20T01:55:20.782 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "scrape_frequency", 2024-08-20T01:55:20.782 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:20.782 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.782 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.782 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "86400", 2024-08-20T01:55:20.782 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.782 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.782 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.782 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-20T01:55:20.782 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.783 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.783 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.783 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.783 INFO:teuthology.orchestra.run.smithi079.stdout: "self_heal": { 2024-08-20T01:55:20.783 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "self_heal", 2024-08-20T01:55:20.783 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.783 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.783 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.783 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:20.783 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.783 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.783 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.783 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-20T01:55:20.784 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.784 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.784 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.784 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.784 INFO:teuthology.orchestra.run.smithi079.stdout: "sleep_interval": { 2024-08-20T01:55:20.784 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sleep_interval", 2024-08-20T01:55:20.784 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:20.784 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.784 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.784 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "600", 2024-08-20T01:55:20.784 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.784 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.784 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.785 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how frequently to wake up and check device health", 2024-08-20T01:55:20.785 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.785 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.785 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.785 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.785 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:20.785 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:20.785 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.785 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:20.786 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.786 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:20.786 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.786 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.786 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.786 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.786 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.786 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.786 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.786 INFO:teuthology.orchestra.run.smithi079.stdout: "warn_threshold": { 2024-08-20T01:55:20.786 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "warn_threshold", 2024-08-20T01:55:20.787 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:20.787 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.787 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.787 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "7257600", 2024-08-20T01:55:20.787 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.787 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.787 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.787 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-20T01:55:20.787 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.787 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.787 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.787 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.787 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.788 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.788 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:20.788 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "diskprediction_local", 2024-08-20T01:55:20.788 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:20.788 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:20.788 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:20.788 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:20.788 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:20.788 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.788 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.788 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.788 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.788 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.789 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.789 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.789 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.789 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.789 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.789 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.789 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.789 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.789 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.789 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.789 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.789 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.789 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.789 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.790 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:20.790 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:20.790 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.790 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.790 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.790 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.790 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.790 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.790 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.790 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.790 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.790 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.791 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.791 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.791 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:20.791 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:20.791 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.791 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.791 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.791 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:20.791 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.791 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.791 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.791 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.791 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.791 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.792 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.792 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.792 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.792 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.792 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.792 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.792 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.792 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.792 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.792 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:20.792 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:20.792 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.792 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.793 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.793 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.793 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.793 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.793 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.793 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.793 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.793 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.793 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.793 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.793 INFO:teuthology.orchestra.run.smithi079.stdout: "predict_interval": { 2024-08-20T01:55:20.793 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "predict_interval", 2024-08-20T01:55:20.794 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.794 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.794 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.794 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "86400", 2024-08-20T01:55:20.794 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.794 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.794 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.794 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.794 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.794 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.794 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.794 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.794 INFO:teuthology.orchestra.run.smithi079.stdout: "predictor_model": { 2024-08-20T01:55:20.795 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "predictor_model", 2024-08-20T01:55:20.795 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.795 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.795 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.795 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "prophetstor", 2024-08-20T01:55:20.795 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.795 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.795 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.795 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.795 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.795 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.795 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.795 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.796 INFO:teuthology.orchestra.run.smithi079.stdout: "sleep_interval": { 2024-08-20T01:55:20.796 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sleep_interval", 2024-08-20T01:55:20.796 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.796 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.796 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.796 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "600", 2024-08-20T01:55:20.796 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.796 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.796 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.796 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.796 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.796 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.796 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.797 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.797 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:20.797 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:20.797 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.797 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:20.797 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.797 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:20.797 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.797 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.797 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.797 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.797 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.797 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.798 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.798 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.798 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.798 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.798 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:20.798 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "influx", 2024-08-20T01:55:20.798 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": false, 2024-08-20T01:55:20.798 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "influxdb python module not found", 2024-08-20T01:55:20.798 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:20.798 INFO:teuthology.orchestra.run.smithi079.stdout: "batch_size": { 2024-08-20T01:55:20.798 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "batch_size", 2024-08-20T01:55:20.798 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.799 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.799 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.799 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5000", 2024-08-20T01:55:20.799 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.799 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.799 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.799 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-20T01:55:20.799 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.799 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.799 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.799 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.799 INFO:teuthology.orchestra.run.smithi079.stdout: "database": { 2024-08-20T01:55:20.799 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "database", 2024-08-20T01:55:20.799 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.800 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.800 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.800 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "ceph", 2024-08-20T01:55:20.800 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.800 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.800 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.800 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-20T01:55:20.800 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.800 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.800 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.800 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.800 INFO:teuthology.orchestra.run.smithi079.stdout: "hostname": { 2024-08-20T01:55:20.800 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "hostname", 2024-08-20T01:55:20.800 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.801 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.801 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.801 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.801 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.801 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.801 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.801 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "InfluxDB server hostname", 2024-08-20T01:55:20.801 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.801 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.801 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.801 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.802 INFO:teuthology.orchestra.run.smithi079.stdout: "interval": { 2024-08-20T01:55:20.802 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "interval", 2024-08-20T01:55:20.802 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:20.802 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.802 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.802 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "30", 2024-08-20T01:55:20.802 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "5", 2024-08-20T01:55:20.802 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.802 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.802 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-20T01:55:20.802 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.803 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.803 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.803 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:20.803 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:20.803 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.803 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.803 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.803 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.803 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.803 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.803 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.804 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.804 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.804 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.804 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.804 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.804 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.804 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.804 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.804 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.804 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.804 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.804 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.804 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:20.805 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:20.805 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.805 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.805 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.805 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.805 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.805 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.805 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.805 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.805 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.805 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.805 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.806 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:20.806 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:20.806 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.806 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.806 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.806 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:20.806 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.806 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.806 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.806 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.806 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.806 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.807 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.807 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.807 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.807 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.807 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.807 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.807 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.807 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.807 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:20.807 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:20.807 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.807 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.807 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.808 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.808 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.808 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.808 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.808 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.808 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.809 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.809 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.809 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.809 INFO:teuthology.orchestra.run.smithi079.stdout: "password": { 2024-08-20T01:55:20.809 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "password", 2024-08-20T01:55:20.810 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.810 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.810 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.810 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.810 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.810 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.810 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.810 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "password of InfluxDB server user", 2024-08-20T01:55:20.810 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.810 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.810 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.811 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.811 INFO:teuthology.orchestra.run.smithi079.stdout: "port": { 2024-08-20T01:55:20.811 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "port", 2024-08-20T01:55:20.811 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.811 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.811 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.811 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "8086", 2024-08-20T01:55:20.811 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.811 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.811 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.811 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "InfluxDB server port", 2024-08-20T01:55:20.811 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.812 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.812 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.812 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:20.812 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:20.812 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.812 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:20.812 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.812 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:20.812 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.812 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.812 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.812 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.812 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.813 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.813 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.813 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.813 INFO:teuthology.orchestra.run.smithi079.stdout: "ssl": { 2024-08-20T01:55:20.813 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ssl", 2024-08-20T01:55:20.813 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.813 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.813 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.813 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "false", 2024-08-20T01:55:20.813 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.813 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.814 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.814 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-20T01:55:20.814 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.814 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.814 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.814 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.814 INFO:teuthology.orchestra.run.smithi079.stdout: "threads": { 2024-08-20T01:55:20.814 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "threads", 2024-08-20T01:55:20.814 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.814 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.814 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.814 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5", 2024-08-20T01:55:20.815 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "1", 2024-08-20T01:55:20.815 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "32", 2024-08-20T01:55:20.815 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.815 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-20T01:55:20.815 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.815 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.815 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.815 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.815 INFO:teuthology.orchestra.run.smithi079.stdout: "username": { 2024-08-20T01:55:20.815 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "username", 2024-08-20T01:55:20.815 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.815 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.815 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.816 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.816 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.816 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.816 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.816 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "username of InfluxDB server user", 2024-08-20T01:55:20.816 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.816 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.816 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.816 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.816 INFO:teuthology.orchestra.run.smithi079.stdout: "verify_ssl": { 2024-08-20T01:55:20.816 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "verify_ssl", 2024-08-20T01:55:20.816 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.816 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.816 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.816 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "true", 2024-08-20T01:55:20.817 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.817 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.817 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.817 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-20T01:55:20.817 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.817 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.817 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.817 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.817 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.817 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.818 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:20.818 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "insights", 2024-08-20T01:55:20.818 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:20.818 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:20.818 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:20.818 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:20.818 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:20.818 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.818 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.818 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.819 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.819 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.819 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.819 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.819 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.819 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.819 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.819 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.819 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.819 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.819 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.819 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.819 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.819 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.820 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.820 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.820 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:20.820 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:20.820 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.820 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.820 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.820 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.820 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.820 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.820 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.820 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.820 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.821 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.821 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.821 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:20.821 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:20.821 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.821 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.821 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.821 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:20.821 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.821 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.821 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.821 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.821 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.822 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.822 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.822 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.822 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.822 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.822 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.822 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.822 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.822 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.822 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:20.822 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:20.822 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.823 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.823 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.823 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.823 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.823 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.823 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.823 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.823 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.823 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.823 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.823 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.824 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:20.824 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:20.824 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.824 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:20.824 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.824 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:20.824 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.824 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.824 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.824 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.824 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.824 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.824 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.824 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.825 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:20.825 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "iostat", 2024-08-20T01:55:20.825 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:20.825 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:20.825 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:20.825 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:20.825 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:20.825 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.825 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.825 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.826 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.826 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.826 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.826 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.826 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.826 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.826 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.826 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.826 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.826 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.826 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.826 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.827 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.827 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.827 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.827 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:20.827 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:20.827 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.827 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.827 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.827 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.827 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.827 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.827 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.828 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.828 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.828 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.828 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.828 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:20.828 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:20.828 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.828 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.828 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.828 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:20.828 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.828 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.828 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.829 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.829 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.829 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.829 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.829 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.829 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.829 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.829 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.829 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.829 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.829 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.830 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:20.830 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:20.830 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.830 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.830 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.830 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.830 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.830 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.830 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.830 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.830 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.830 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.831 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.831 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:20.831 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:20.831 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.831 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:20.831 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.831 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:20.831 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.831 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.831 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.831 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.832 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.832 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.832 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.832 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.832 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.832 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:20.832 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "k8sevents", 2024-08-20T01:55:20.832 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:20.832 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:20.832 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:20.832 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_event_retention_days": { 2024-08-20T01:55:20.832 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ceph_event_retention_days", 2024-08-20T01:55:20.832 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.833 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.833 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.833 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "7", 2024-08-20T01:55:20.833 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.833 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.833 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.833 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-20T01:55:20.833 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.833 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.833 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.833 INFO:teuthology.orchestra.run.smithi079.stdout: "config_check_secs": { 2024-08-20T01:55:20.833 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "config_check_secs", 2024-08-20T01:55:20.834 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.834 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.834 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.834 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-08-20T01:55:20.834 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "10", 2024-08-20T01:55:20.834 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.834 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.834 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-20T01:55:20.834 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.834 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.834 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.835 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:20.835 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:20.835 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.835 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.835 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.835 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.835 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.835 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.835 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.835 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.835 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.835 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.835 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.836 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.836 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.836 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.836 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.836 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.836 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.836 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.836 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:20.836 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:20.836 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.837 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.837 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.837 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.837 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.837 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.837 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.837 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.837 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.837 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.837 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.838 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:20.838 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:20.838 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.838 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.838 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.838 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:20.838 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.838 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.838 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.838 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.838 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.838 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.839 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.839 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.839 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.839 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.839 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.839 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.839 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.839 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.839 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:20.839 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:20.839 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.839 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.839 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.840 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.840 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.840 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.840 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.840 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.840 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.840 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.840 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.840 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:20.840 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:20.840 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.840 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:20.840 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.841 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:20.841 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.841 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.841 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.841 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.841 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.841 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.841 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.841 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.841 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:20.841 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "localpool", 2024-08-20T01:55:20.841 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:20.842 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:20.842 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:20.842 INFO:teuthology.orchestra.run.smithi079.stdout: "failure_domain": { 2024-08-20T01:55:20.842 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "failure_domain", 2024-08-20T01:55:20.842 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.842 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.842 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.842 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "host", 2024-08-20T01:55:20.842 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.842 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.842 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.842 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "failure domain for any created local pool", 2024-08-20T01:55:20.842 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-20T01:55:20.843 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.843 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.843 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:20.843 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:20.843 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.843 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.843 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.843 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.843 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.843 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.843 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.844 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.844 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.844 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.844 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.844 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.844 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.844 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.844 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.844 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.844 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.844 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.844 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:20.844 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:20.845 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.845 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.845 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.845 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.845 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.845 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.845 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.845 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.845 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.845 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.845 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.845 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:20.846 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:20.846 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.846 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.846 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.846 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:20.846 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.846 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.846 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.846 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.846 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.846 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.846 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.847 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.847 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.847 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.847 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.847 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.847 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.847 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.847 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:20.847 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:20.847 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.847 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.847 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.848 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.848 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.848 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.848 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.848 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.848 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.848 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.848 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.848 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": { 2024-08-20T01:55:20.848 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "min_size", 2024-08-20T01:55:20.848 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.848 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.848 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.849 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.849 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.849 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.849 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.849 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "default min_size for any created local pool", 2024-08-20T01:55:20.849 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-20T01:55:20.849 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.849 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.849 INFO:teuthology.orchestra.run.smithi079.stdout: "num_rep": { 2024-08-20T01:55:20.849 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "num_rep", 2024-08-20T01:55:20.849 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.850 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.850 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.850 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "3", 2024-08-20T01:55:20.850 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.850 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.850 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.850 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "default replica count for any created local pool", 2024-08-20T01:55:20.850 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.850 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.850 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.850 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": { 2024-08-20T01:55:20.850 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "pg_num", 2024-08-20T01:55:20.851 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.851 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.851 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.851 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "128", 2024-08-20T01:55:20.851 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.851 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.851 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.851 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "default pg_num for any created local pool", 2024-08-20T01:55:20.851 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.851 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.851 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.851 INFO:teuthology.orchestra.run.smithi079.stdout: "prefix": { 2024-08-20T01:55:20.851 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "prefix", 2024-08-20T01:55:20.852 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.852 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.852 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.852 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.852 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.852 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.852 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.852 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "name prefix for any created local pool", 2024-08-20T01:55:20.852 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.852 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.852 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.852 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:20.852 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:20.853 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.853 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:20.853 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.853 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:20.853 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.853 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.853 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.853 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.853 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.853 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.853 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.854 INFO:teuthology.orchestra.run.smithi079.stdout: "subtree": { 2024-08-20T01:55:20.854 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "subtree", 2024-08-20T01:55:20.854 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.854 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.854 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.854 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "rack", 2024-08-20T01:55:20.854 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.854 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.854 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.854 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-20T01:55:20.854 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-20T01:55:20.854 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.855 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.855 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.855 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:20.855 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "mds_autoscaler", 2024-08-20T01:55:20.855 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:20.855 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:20.855 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:20.855 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:20.855 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:20.855 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.855 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.856 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.856 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.856 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.856 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.856 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.856 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.856 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.856 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.856 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.856 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.856 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.856 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.856 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.857 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.857 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.857 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.857 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:20.857 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:20.857 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.857 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.857 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.857 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.857 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.857 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.857 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.858 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.858 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.858 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.858 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.858 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:20.858 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:20.858 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.858 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.858 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.858 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:20.859 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.859 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.859 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.859 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.859 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.859 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.859 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.859 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.859 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.859 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.859 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.859 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.860 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.860 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.860 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:20.860 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:20.860 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.860 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.860 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.860 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.860 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.860 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.860 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.860 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.861 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.861 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.861 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.861 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:20.861 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:20.861 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.861 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:20.861 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.861 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:20.861 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.861 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.862 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.862 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.862 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.862 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.862 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.862 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.862 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:20.862 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "mirroring", 2024-08-20T01:55:20.862 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:20.862 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:20.863 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:20.863 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:20.863 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:20.863 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.863 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.863 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.863 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.863 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.863 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.863 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.863 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.864 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.864 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.864 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.864 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.864 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.864 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.865 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.865 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.865 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.865 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.865 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:20.866 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:20.866 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.866 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.866 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.866 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.866 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.866 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.866 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.866 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.866 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.867 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.867 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.867 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:20.867 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:20.867 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.868 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.868 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.868 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:20.868 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.868 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.868 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.869 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.869 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.869 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.869 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.869 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.869 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.869 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.869 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.869 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.869 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.869 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.870 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:20.870 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:20.870 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.870 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.870 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.871 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.871 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.871 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.871 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.871 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.871 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.872 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.872 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.872 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:20.872 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:20.872 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.872 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:20.873 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.873 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:20.873 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.873 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.873 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.873 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.873 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.873 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.873 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.873 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.873 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:20.874 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "nfs", 2024-08-20T01:55:20.874 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:20.874 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:20.874 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:20.874 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:20.874 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:20.874 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.874 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.874 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.875 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.875 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.875 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.875 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.875 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.875 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.875 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.875 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.875 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.875 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.876 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.876 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.876 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.876 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.876 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.876 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:20.876 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:20.876 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.877 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.877 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.877 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.877 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.877 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.877 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.877 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.877 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.877 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.877 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.877 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:20.877 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:20.878 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.878 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.878 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.878 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:20.878 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.878 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.878 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.878 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.878 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.878 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.878 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.879 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.879 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.879 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.879 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.879 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.879 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.879 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.879 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:20.879 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:20.879 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.879 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.879 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.880 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.880 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.880 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.880 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.880 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.880 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.880 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.880 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.880 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:20.880 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:20.880 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.880 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:20.880 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.881 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:20.881 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.881 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.881 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.881 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.881 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.881 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.881 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.881 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.881 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:20.881 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "orchestrator", 2024-08-20T01:55:20.881 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:20.882 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:20.882 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:20.882 INFO:teuthology.orchestra.run.smithi079.stdout: "fail_fs": { 2024-08-20T01:55:20.882 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "fail_fs", 2024-08-20T01:55:20.882 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.882 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.882 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.882 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.882 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.882 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.882 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.882 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-20T01:55:20.883 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.883 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.883 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.883 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:20.883 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:20.883 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.883 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.883 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.883 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.883 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.883 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.883 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.883 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.884 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.884 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.884 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.884 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.884 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.884 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.884 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.884 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.884 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.884 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.884 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:20.885 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:20.885 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.885 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.885 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.885 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.885 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.885 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.885 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.885 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.885 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.885 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.885 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.886 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:20.886 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:20.886 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.886 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.886 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.886 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:20.886 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.886 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.886 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.887 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.887 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.887 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.887 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.887 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.887 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.887 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.887 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.887 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.887 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.887 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.887 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:20.888 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:20.888 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.888 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.888 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.888 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.888 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.888 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.888 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.888 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.888 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.888 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.888 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.889 INFO:teuthology.orchestra.run.smithi079.stdout: "orchestrator": { 2024-08-20T01:55:20.889 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "orchestrator", 2024-08-20T01:55:20.889 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.889 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.889 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.889 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.889 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.889 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.889 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.889 INFO:teuthology.orchestra.run.smithi079.stdout: "cephadm", 2024-08-20T01:55:20.889 INFO:teuthology.orchestra.run.smithi079.stdout: "rook", 2024-08-20T01:55:20.889 INFO:teuthology.orchestra.run.smithi079.stdout: "test_orchestrator" 2024-08-20T01:55:20.889 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.890 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Orchestrator backend", 2024-08-20T01:55:20.890 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.890 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.890 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.890 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:20.890 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:20.890 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.890 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:20.890 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.890 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:20.890 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.891 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.891 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.891 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.891 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.891 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.891 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.891 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.891 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:20.891 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "osd_perf_query", 2024-08-20T01:55:20.891 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:20.891 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:20.891 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:20.892 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:20.892 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:20.892 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.892 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.892 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.892 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.892 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.892 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.892 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.892 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.892 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.892 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.892 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.892 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.893 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.893 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.893 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.893 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.893 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.893 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.893 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:20.893 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:20.893 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.893 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.893 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.893 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.894 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.894 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.894 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.894 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.894 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.894 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.894 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.894 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:20.894 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:20.894 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.895 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.895 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.895 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:20.895 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.895 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.895 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.895 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.895 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.895 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.895 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.895 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.895 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.895 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.895 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.896 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.896 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.896 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.896 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:20.896 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:20.896 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.896 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.896 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.896 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.896 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.896 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.896 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.896 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.897 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.897 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.897 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.897 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:20.897 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:20.897 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.897 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:20.897 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.897 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:20.897 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.897 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.897 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.897 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.898 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.898 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.898 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.898 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.898 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:20.898 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "osd_support", 2024-08-20T01:55:20.898 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:20.898 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:20.898 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:20.898 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:20.899 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:20.899 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.899 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.899 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.899 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.899 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.899 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.899 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.899 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.899 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.899 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.899 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.899 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.900 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.900 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.900 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.900 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.900 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.900 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.900 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:20.900 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:20.900 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.900 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.900 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.900 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.901 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.901 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.901 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.901 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.901 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.901 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.901 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.901 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:20.901 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:20.901 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.901 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.901 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.902 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:20.902 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.902 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.902 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.902 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.902 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.902 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.902 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.902 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.902 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.902 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.903 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.903 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.903 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.903 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.903 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:20.903 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:20.903 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.903 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.903 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.903 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.903 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.903 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.903 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.904 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.904 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.904 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.904 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.904 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:20.904 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:20.904 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.904 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:20.904 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.904 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:20.905 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.905 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.905 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.905 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.905 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.905 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.905 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.905 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.905 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:20.905 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "pg_autoscaler", 2024-08-20T01:55:20.905 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:20.906 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:20.906 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:20.906 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:20.906 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:20.906 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.906 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.906 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.906 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.906 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.906 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.906 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.906 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.907 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.907 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.907 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.907 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.907 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.907 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.907 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.907 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.907 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.907 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.907 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:20.907 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:20.908 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.908 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.908 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.908 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.908 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.908 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.908 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.908 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.908 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.908 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.908 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.909 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:20.909 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:20.909 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.909 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.909 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.909 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:20.910 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.910 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.910 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.910 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.910 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.910 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.911 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.911 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.911 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.911 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.911 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.911 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.911 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.911 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.911 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:20.911 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:20.911 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.912 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.912 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.912 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.912 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.912 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.912 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.912 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.912 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.912 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.912 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.912 INFO:teuthology.orchestra.run.smithi079.stdout: "sleep_interval": { 2024-08-20T01:55:20.912 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sleep_interval", 2024-08-20T01:55:20.912 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:20.913 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.913 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.913 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "60", 2024-08-20T01:55:20.913 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.913 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.913 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.913 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.913 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.913 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.913 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.914 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:20.914 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:20.914 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.914 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:20.914 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.914 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:20.914 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.914 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.914 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.914 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.914 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.915 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.915 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.915 INFO:teuthology.orchestra.run.smithi079.stdout: "threshold": { 2024-08-20T01:55:20.915 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "threshold", 2024-08-20T01:55:20.915 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2024-08-20T01:55:20.915 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.915 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.915 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "3.0", 2024-08-20T01:55:20.915 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "1.0", 2024-08-20T01:55:20.915 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.915 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.915 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "scaling threshold", 2024-08-20T01:55:20.916 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-20T01:55:20.916 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.916 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.916 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.916 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:20.916 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "progress", 2024-08-20T01:55:20.916 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:20.916 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:20.916 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:20.916 INFO:teuthology.orchestra.run.smithi079.stdout: "allow_pg_recovery_event": { 2024-08-20T01:55:20.917 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "allow_pg_recovery_event", 2024-08-20T01:55:20.917 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.917 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.917 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.917 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.917 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.917 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.917 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.917 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-20T01:55:20.917 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.917 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.917 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.918 INFO:teuthology.orchestra.run.smithi079.stdout: "enabled": { 2024-08-20T01:55:20.918 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "enabled", 2024-08-20T01:55:20.918 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.918 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.918 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.918 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:20.918 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.918 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.918 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.919 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.919 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.919 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.919 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.919 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:20.919 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:20.919 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.919 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.919 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.919 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.919 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.920 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.920 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.920 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.920 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.920 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.920 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.920 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.920 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.920 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.920 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.920 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.920 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.920 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.921 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:20.921 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:20.921 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.921 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.921 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.921 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.921 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.921 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.921 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.921 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.921 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.921 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.921 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.922 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:20.922 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:20.922 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.922 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.922 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.922 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:20.922 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.922 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.922 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.922 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.923 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.923 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.923 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.923 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.923 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.923 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.923 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.923 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.923 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.923 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.924 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:20.924 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:20.924 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.924 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.924 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.924 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.924 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.924 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.924 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.924 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.924 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.924 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.925 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.925 INFO:teuthology.orchestra.run.smithi079.stdout: "max_completed_events": { 2024-08-20T01:55:20.925 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "max_completed_events", 2024-08-20T01:55:20.925 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.925 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.925 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.926 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "50", 2024-08-20T01:55:20.926 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.926 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.926 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.926 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "number of past completed events to remember", 2024-08-20T01:55:20.927 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.927 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.927 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.927 INFO:teuthology.orchestra.run.smithi079.stdout: "sleep_interval": { 2024-08-20T01:55:20.927 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sleep_interval", 2024-08-20T01:55:20.927 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:20.927 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.927 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.927 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5", 2024-08-20T01:55:20.927 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.928 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.928 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.928 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how long the module is going to sleep", 2024-08-20T01:55:20.928 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.928 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.928 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.928 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:20.928 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:20.928 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.928 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:20.928 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.928 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:20.928 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.929 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.929 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.929 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.929 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.929 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.929 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.929 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.929 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:20.929 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "prometheus", 2024-08-20T01:55:20.929 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:20.929 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:20.930 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:20.930 INFO:teuthology.orchestra.run.smithi079.stdout: "cache": { 2024-08-20T01:55:20.930 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "cache", 2024-08-20T01:55:20.930 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.930 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.930 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.930 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:20.930 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.930 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.930 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.930 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.931 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.931 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.931 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.931 INFO:teuthology.orchestra.run.smithi079.stdout: "exclude_perf_counters": { 2024-08-20T01:55:20.931 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "exclude_perf_counters", 2024-08-20T01:55:20.931 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.931 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.931 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.931 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:20.931 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.931 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.931 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.931 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-20T01:55:20.932 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-20T01:55:20.932 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.932 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.932 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:20.932 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:20.932 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.932 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.932 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.932 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.933 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.933 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.933 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.933 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.933 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.933 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.933 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.933 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.933 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.933 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.933 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.933 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.933 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.934 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.934 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:20.934 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:20.934 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.934 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.934 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.934 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.934 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.934 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.934 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.934 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.935 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.935 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.935 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.935 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:20.935 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:20.935 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.935 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.935 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.935 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:20.935 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.935 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.935 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.935 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.936 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.936 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.936 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.936 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.936 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.936 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.936 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.936 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.936 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.936 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.936 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:20.936 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:20.936 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.937 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.937 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.937 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.937 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.937 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.937 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.937 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.937 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.937 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.937 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.938 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_stats_pools": { 2024-08-20T01:55:20.938 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rbd_stats_pools", 2024-08-20T01:55:20.938 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.938 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.938 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.938 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.938 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.938 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.938 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.938 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.938 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.939 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.939 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.939 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-20T01:55:20.939 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-20T01:55:20.939 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.939 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.939 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.939 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "300", 2024-08-20T01:55:20.939 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.939 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.939 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.939 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.940 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.940 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.940 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.940 INFO:teuthology.orchestra.run.smithi079.stdout: "scrape_interval": { 2024-08-20T01:55:20.940 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "scrape_interval", 2024-08-20T01:55:20.940 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2024-08-20T01:55:20.940 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.940 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.940 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "15.0", 2024-08-20T01:55:20.940 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.940 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.940 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.941 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.941 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.941 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.941 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.941 INFO:teuthology.orchestra.run.smithi079.stdout: "server_addr": { 2024-08-20T01:55:20.941 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_addr", 2024-08-20T01:55:20.941 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.941 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.941 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.941 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "::", 2024-08-20T01:55:20.941 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.941 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.941 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.942 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-20T01:55:20.942 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.942 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.942 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.942 INFO:teuthology.orchestra.run.smithi079.stdout: "server_port": { 2024-08-20T01:55:20.942 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_port", 2024-08-20T01:55:20.942 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.942 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.942 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.942 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "9283", 2024-08-20T01:55:20.942 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.943 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.943 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.943 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-20T01:55:20.943 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.943 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.943 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.943 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:20.943 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:20.943 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.943 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:20.943 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.944 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:20.944 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.944 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.944 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.944 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.944 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.944 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.944 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.944 INFO:teuthology.orchestra.run.smithi079.stdout: "stale_cache_strategy": { 2024-08-20T01:55:20.944 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "stale_cache_strategy", 2024-08-20T01:55:20.944 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.944 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.944 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.945 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "log", 2024-08-20T01:55:20.945 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.945 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.945 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.945 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.945 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.945 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.945 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.945 INFO:teuthology.orchestra.run.smithi079.stdout: "standby_behaviour": { 2024-08-20T01:55:20.945 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "standby_behaviour", 2024-08-20T01:55:20.945 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.945 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.946 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.946 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "default", 2024-08-20T01:55:20.946 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.946 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.946 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.946 INFO:teuthology.orchestra.run.smithi079.stdout: "default", 2024-08-20T01:55:20.946 INFO:teuthology.orchestra.run.smithi079.stdout: "error" 2024-08-20T01:55:20.946 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.946 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.946 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.946 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.946 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.947 INFO:teuthology.orchestra.run.smithi079.stdout: "standby_error_status_code": { 2024-08-20T01:55:20.947 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "standby_error_status_code", 2024-08-20T01:55:20.947 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.947 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.947 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.947 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "500", 2024-08-20T01:55:20.947 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "400", 2024-08-20T01:55:20.947 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "599", 2024-08-20T01:55:20.947 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.947 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.947 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.947 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.948 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.948 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.948 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:20.948 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rbd_support", 2024-08-20T01:55:20.948 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:20.948 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:20.948 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:20.948 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:20.948 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:20.948 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.948 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.948 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.949 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.949 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.949 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.949 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.949 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.949 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.949 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.949 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.949 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.949 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.949 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.949 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.949 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.950 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.950 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.950 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:20.950 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:20.950 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.950 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.950 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.950 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.950 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.950 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.951 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.951 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.951 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.951 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.951 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.951 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:20.951 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:20.951 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.951 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.951 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.951 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:20.951 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.951 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.952 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.952 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.952 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.952 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.952 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.952 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.952 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.952 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.952 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.952 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.952 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.952 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.952 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:20.953 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:20.953 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.953 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.953 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.953 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.953 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.953 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.953 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.953 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.953 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.953 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.953 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.954 INFO:teuthology.orchestra.run.smithi079.stdout: "max_concurrent_snap_create": { 2024-08-20T01:55:20.954 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "max_concurrent_snap_create", 2024-08-20T01:55:20.954 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.954 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.954 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.954 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-08-20T01:55:20.954 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.954 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.954 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.954 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.954 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.954 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.954 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.955 INFO:teuthology.orchestra.run.smithi079.stdout: "mirror_snapshot_schedule": { 2024-08-20T01:55:20.955 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "mirror_snapshot_schedule", 2024-08-20T01:55:20.955 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.955 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.955 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.955 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.955 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.955 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.955 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.955 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.955 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.955 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.955 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.956 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:20.956 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:20.956 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.956 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:20.956 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.956 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:20.956 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.956 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.956 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.956 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.956 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.956 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.956 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.957 INFO:teuthology.orchestra.run.smithi079.stdout: "trash_purge_schedule": { 2024-08-20T01:55:20.957 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "trash_purge_schedule", 2024-08-20T01:55:20.957 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.957 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.957 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.957 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.957 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.957 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.957 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.957 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.957 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.957 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.957 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.958 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.958 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:20.958 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "restful", 2024-08-20T01:55:20.958 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:20.958 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:20.958 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:20.958 INFO:teuthology.orchestra.run.smithi079.stdout: "enable_auth": { 2024-08-20T01:55:20.958 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "enable_auth", 2024-08-20T01:55:20.958 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.958 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.958 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.959 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:20.959 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.959 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.959 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.959 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.959 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.959 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.959 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.959 INFO:teuthology.orchestra.run.smithi079.stdout: "key_file": { 2024-08-20T01:55:20.959 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "key_file", 2024-08-20T01:55:20.959 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.959 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.959 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.960 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.960 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.960 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.960 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.960 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.960 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.960 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.960 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.960 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:20.960 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:20.960 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.960 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.961 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.961 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.961 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.961 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.961 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.961 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.961 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.961 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.961 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.961 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.961 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.961 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.962 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.962 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.962 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.962 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.962 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:20.962 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:20.962 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.962 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.962 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.962 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.963 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.963 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.963 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.963 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.963 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.963 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.963 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.963 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:20.963 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:20.963 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.964 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.964 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.964 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:20.964 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.964 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.964 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.964 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.964 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.964 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.964 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.965 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.965 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.965 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.965 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.965 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.965 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.965 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.965 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:20.965 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:20.965 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.965 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.965 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.966 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.966 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.966 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.966 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.966 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.966 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.966 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.966 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.966 INFO:teuthology.orchestra.run.smithi079.stdout: "server_addr": { 2024-08-20T01:55:20.966 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_addr", 2024-08-20T01:55:20.966 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.966 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.967 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.967 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.967 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.967 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.967 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.967 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.967 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.967 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.967 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.967 INFO:teuthology.orchestra.run.smithi079.stdout: "server_port": { 2024-08-20T01:55:20.967 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_port", 2024-08-20T01:55:20.967 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.967 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.968 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.968 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.968 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.968 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.968 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.968 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.968 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.968 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.968 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.968 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:20.968 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:20.969 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.969 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:20.969 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.969 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:20.969 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.969 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.969 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.969 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.969 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.970 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.970 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.970 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.970 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:20.970 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rgw", 2024-08-20T01:55:20.970 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:20.970 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:20.970 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:20.970 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:20.970 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:20.971 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.971 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.971 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.971 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.971 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.971 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.971 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.971 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.971 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.971 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.971 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.972 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.972 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.972 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.972 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.972 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.972 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.972 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.972 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:20.972 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:20.972 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.972 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.972 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.973 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.973 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.973 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.973 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.973 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.973 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.973 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.973 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.973 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:20.973 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:20.974 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.974 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.974 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.974 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:20.974 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.974 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.974 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.974 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.974 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.974 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.974 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.975 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.975 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.975 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.975 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.975 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.975 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.975 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.975 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:20.976 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:20.976 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.976 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.976 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.976 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.976 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.976 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.976 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.976 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.976 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.976 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.976 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.977 INFO:teuthology.orchestra.run.smithi079.stdout: "secondary_zone_period_retry_limit": { 2024-08-20T01:55:20.977 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "secondary_zone_period_retry_limit", 2024-08-20T01:55:20.977 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.977 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.977 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.977 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5", 2024-08-20T01:55:20.977 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.977 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.977 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.977 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-08-20T01:55:20.977 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.978 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.978 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.978 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:20.978 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:20.978 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.978 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:20.978 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.978 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:20.978 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.978 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.978 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.979 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.979 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.979 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.979 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.979 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.979 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:20.979 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rook", 2024-08-20T01:55:20.979 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:20.979 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:20.979 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:20.979 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:20.979 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:20.980 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.980 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.980 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.980 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.980 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.980 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.980 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.980 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.980 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.980 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.980 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.980 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.980 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.981 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.981 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.981 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.981 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.981 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.981 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:20.981 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:20.981 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.981 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.981 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.981 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.981 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.981 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.982 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.982 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.982 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.982 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.982 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.982 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:20.982 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:20.982 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.982 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.982 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.982 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:20.982 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.983 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.983 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.983 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.983 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.983 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.983 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.983 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.983 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.983 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.983 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.983 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.983 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.983 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.984 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:20.984 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:20.984 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.984 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.984 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.984 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.984 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.984 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.984 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.984 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.984 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.984 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.984 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.985 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:20.985 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:20.985 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.985 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:20.985 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.985 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:20.985 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.985 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.985 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.985 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.985 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.985 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.985 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.986 INFO:teuthology.orchestra.run.smithi079.stdout: "storage_class": { 2024-08-20T01:55:20.986 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "storage_class", 2024-08-20T01:55:20.986 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.986 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.986 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.986 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "local", 2024-08-20T01:55:20.986 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.986 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.986 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.986 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-20T01:55:20.986 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.986 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.987 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.987 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.987 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:20.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:20.987 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "selftest", 2024-08-20T01:55:20.987 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:20.987 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:20.987 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:20.987 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:20.987 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:20.987 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.987 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.987 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.988 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.988 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.988 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.988 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.988 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.988 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.988 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.988 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.988 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.988 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.988 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.988 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.988 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.988 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.989 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.989 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:20.989 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:20.989 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.989 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.989 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.989 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.989 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.989 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.989 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.989 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.989 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.990 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.990 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.990 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:20.990 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:20.990 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.990 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.990 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.990 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:20.990 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.990 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.990 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:20.990 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:20.991 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:20.991 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:20.991 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:20.991 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:20.991 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:20.991 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:20.991 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.991 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.991 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.991 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.991 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:20.991 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:20.991 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.992 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.992 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:20.992 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:20.992 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.992 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.992 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.992 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.992 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.992 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.992 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.992 INFO:teuthology.orchestra.run.smithi079.stdout: "roption1": { 2024-08-20T01:55:20.992 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "roption1", 2024-08-20T01:55:20.992 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.993 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.993 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.993 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.993 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.993 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.993 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.993 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.993 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.993 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.993 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.993 INFO:teuthology.orchestra.run.smithi079.stdout: "roption2": { 2024-08-20T01:55:20.993 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "roption2", 2024-08-20T01:55:20.994 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.994 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.994 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.994 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "xyz", 2024-08-20T01:55:20.994 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.994 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.994 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.994 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.994 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.994 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.994 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.995 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption1": { 2024-08-20T01:55:20.995 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption1", 2024-08-20T01:55:20.995 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.995 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.995 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.995 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.995 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.995 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.995 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.995 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.995 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.995 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.995 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.996 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption2": { 2024-08-20T01:55:20.996 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption2", 2024-08-20T01:55:20.996 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:20.996 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.996 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.996 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.996 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.996 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.996 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.996 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.996 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.996 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.996 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.997 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption3": { 2024-08-20T01:55:20.997 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption3", 2024-08-20T01:55:20.997 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2024-08-20T01:55:20.997 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.997 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.997 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.997 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.997 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.997 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.997 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.997 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.997 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.997 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.998 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption4": { 2024-08-20T01:55:20.998 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption4", 2024-08-20T01:55:20.998 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:20.998 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.998 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.998 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.998 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.998 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.998 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.998 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:20.998 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:20.999 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:20.999 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:20.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:20.999 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption5": { 2024-08-20T01:55:20.999 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption5", 2024-08-20T01:55:20.999 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:20.999 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:20.999 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:20.999 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:20.999 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:20.999 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:20.999 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:20.999 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.000 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.000 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.000 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.000 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption6": { 2024-08-20T01:55:21.000 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption6", 2024-08-20T01:55:21.000 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.000 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.000 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.000 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.000 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.000 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.000 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.000 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.001 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.001 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.001 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.001 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption7": { 2024-08-20T01:55:21.001 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption7", 2024-08-20T01:55:21.001 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.001 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.001 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.001 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.001 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "1", 2024-08-20T01:55:21.001 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "42", 2024-08-20T01:55:21.001 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.001 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.002 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.002 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.002 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.002 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.002 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.002 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.002 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.002 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.002 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.002 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.002 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.003 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.003 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.003 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.003 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.003 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.003 INFO:teuthology.orchestra.run.smithi079.stdout: "testkey": { 2024-08-20T01:55:21.003 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "testkey", 2024-08-20T01:55:21.003 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.003 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.003 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.003 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.003 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.004 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.004 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.004 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.004 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.004 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.004 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.004 INFO:teuthology.orchestra.run.smithi079.stdout: "testlkey": { 2024-08-20T01:55:21.004 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "testlkey", 2024-08-20T01:55:21.004 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.004 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.004 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.004 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.004 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.005 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.005 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.005 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.005 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.005 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.005 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.005 INFO:teuthology.orchestra.run.smithi079.stdout: "testnewline": { 2024-08-20T01:55:21.005 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "testnewline", 2024-08-20T01:55:21.005 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.005 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.005 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.006 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.006 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.006 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.006 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.006 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.006 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.006 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.006 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.006 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.006 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.006 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smb", 2024-08-20T01:55:21.007 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.007 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.007 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.007 INFO:teuthology.orchestra.run.smithi079.stdout: "internal_store_backend": { 2024-08-20T01:55:21.007 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "internal_store_backend", 2024-08-20T01:55:21.007 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.007 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.007 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.007 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.007 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.007 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.007 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.007 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-08-20T01:55:21.008 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.008 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.008 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.008 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.008 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.008 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.008 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.008 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.008 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.008 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.008 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.009 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.009 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.009 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.009 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.009 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.009 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.009 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.009 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.009 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.009 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.009 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.009 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.010 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.010 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.010 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.010 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.010 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.010 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.010 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.011 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.011 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.011 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.011 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.011 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.011 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.012 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.012 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.012 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.012 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.012 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.012 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.012 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.012 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.012 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.012 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.012 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.012 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.013 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.013 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.013 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.013 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.013 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.013 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.013 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.013 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.013 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.013 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.013 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.013 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.014 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.014 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.014 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.014 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.014 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.014 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.014 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.014 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.014 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.015 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.015 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.015 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.015 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.015 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.015 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.015 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.015 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.015 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.015 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.015 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.015 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.016 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.016 INFO:teuthology.orchestra.run.smithi079.stdout: "update_orchestration": { 2024-08-20T01:55:21.016 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "update_orchestration", 2024-08-20T01:55:21.016 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.016 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.016 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.016 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.016 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.016 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.016 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.016 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-08-20T01:55:21.016 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.017 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.017 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.017 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.017 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.017 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "snap_schedule", 2024-08-20T01:55:21.017 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.017 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.017 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.017 INFO:teuthology.orchestra.run.smithi079.stdout: "allow_m_granularity": { 2024-08-20T01:55:21.017 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "allow_m_granularity", 2024-08-20T01:55:21.017 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.017 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.018 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.018 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.018 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.018 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.018 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.018 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "allow minute scheduled snapshots", 2024-08-20T01:55:21.018 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.018 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.018 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.018 INFO:teuthology.orchestra.run.smithi079.stdout: "dump_on_update": { 2024-08-20T01:55:21.019 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "dump_on_update", 2024-08-20T01:55:21.019 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.019 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.019 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.019 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.019 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.019 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.019 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.019 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "dump database to debug log on update", 2024-08-20T01:55:21.019 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.019 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.020 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.020 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.020 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.020 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.020 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.020 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.020 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.020 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.020 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.020 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.020 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.021 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.021 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.021 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.021 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.021 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.021 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.021 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.021 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.021 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.021 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.021 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.021 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.021 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.022 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.022 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.022 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.022 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.022 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.022 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.022 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.022 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.022 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.022 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.022 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.022 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.023 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.023 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.023 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.023 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.023 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.023 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.023 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.023 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.023 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.023 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.023 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.023 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.023 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.023 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.024 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.024 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.024 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.024 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.024 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.024 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.024 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.024 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.025 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.025 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.025 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.025 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.025 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.025 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.025 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.025 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.025 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.025 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.025 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.025 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.026 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.026 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.026 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.026 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.026 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.026 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.026 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.026 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.026 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.026 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.027 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.027 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.027 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "stats", 2024-08-20T01:55:21.027 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.027 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.027 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.027 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.027 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.027 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.027 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.027 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.028 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.028 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.028 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.028 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.028 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.028 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.028 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.028 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.028 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.028 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.028 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.028 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.028 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.029 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.029 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.029 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.029 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.029 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.029 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.029 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.029 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.029 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.029 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.029 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.029 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.029 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.030 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.030 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.030 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.030 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.030 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.030 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.030 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.030 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.030 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.030 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.030 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.030 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.031 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.031 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.031 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.031 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.031 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.031 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.031 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.031 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.031 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.031 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.031 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.031 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.031 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.032 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.032 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.032 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.032 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.032 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.032 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.032 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.032 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.032 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.032 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.032 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.032 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.032 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.033 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.033 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.033 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.033 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.033 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.033 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.033 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.033 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.033 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.033 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.033 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.033 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.034 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "status", 2024-08-20T01:55:21.034 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.034 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.034 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.034 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.034 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.034 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.034 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.034 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.034 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.034 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.034 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.034 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.035 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.035 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.035 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.035 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.035 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.035 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.035 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.035 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.035 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.035 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.035 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.035 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.035 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.036 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.036 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.036 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.036 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.036 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.036 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.036 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.036 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.036 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.036 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.036 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.036 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.036 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.037 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.037 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.037 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.037 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.037 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.037 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.037 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.037 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.037 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.037 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.037 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.037 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.038 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.038 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.038 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.038 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.038 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.038 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.038 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.038 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.038 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.038 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.038 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.039 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.039 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.039 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.039 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.039 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.039 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.039 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.039 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.039 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.039 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.039 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.039 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.040 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.040 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.040 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.040 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.040 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.040 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.040 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.040 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.040 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.040 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.040 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.040 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "telegraf", 2024-08-20T01:55:21.041 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.041 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.041 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.041 INFO:teuthology.orchestra.run.smithi079.stdout: "address": { 2024-08-20T01:55:21.041 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "address", 2024-08-20T01:55:21.041 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.041 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.041 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.041 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-20T01:55:21.041 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.041 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.041 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.041 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.042 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.042 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.042 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.042 INFO:teuthology.orchestra.run.smithi079.stdout: "interval": { 2024-08-20T01:55:21.042 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "interval", 2024-08-20T01:55:21.042 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:21.042 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.042 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.042 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "15", 2024-08-20T01:55:21.042 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.042 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.042 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.042 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.043 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.043 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.043 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.043 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.043 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.043 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.043 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.043 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.043 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.043 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.043 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.043 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.043 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.044 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.044 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.044 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.044 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.044 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.044 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.044 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.044 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.044 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.044 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.044 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.045 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.045 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.045 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.045 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.045 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.045 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.045 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.045 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.045 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.045 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.045 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.045 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.045 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.046 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.046 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.046 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.046 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.046 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.046 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.046 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.046 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.046 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.046 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.047 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.047 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.047 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.047 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.047 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.047 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.047 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.047 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.047 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.047 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.047 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.047 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.048 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.048 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.048 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.048 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.048 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.048 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.048 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.048 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.048 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.048 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.048 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.048 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.048 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.049 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.049 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.049 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.049 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.049 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.049 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.049 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.049 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.049 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.049 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.049 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.049 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.050 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "telemetry", 2024-08-20T01:55:21.050 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.050 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.050 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.050 INFO:teuthology.orchestra.run.smithi079.stdout: "channel_basic": { 2024-08-20T01:55:21.050 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "channel_basic", 2024-08-20T01:55:21.050 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.050 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.050 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.050 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.050 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.050 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.051 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.051 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-20T01:55:21.051 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.051 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.051 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.051 INFO:teuthology.orchestra.run.smithi079.stdout: "channel_crash": { 2024-08-20T01:55:21.051 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "channel_crash", 2024-08-20T01:55:21.051 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.051 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.051 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.051 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.051 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.051 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.052 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.052 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-20T01:55:21.052 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.052 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.052 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.052 INFO:teuthology.orchestra.run.smithi079.stdout: "channel_device": { 2024-08-20T01:55:21.052 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "channel_device", 2024-08-20T01:55:21.052 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.052 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.052 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.052 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.052 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.052 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.053 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.053 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-20T01:55:21.053 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.053 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.053 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.053 INFO:teuthology.orchestra.run.smithi079.stdout: "channel_ident": { 2024-08-20T01:55:21.053 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "channel_ident", 2024-08-20T01:55:21.053 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.053 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.053 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.053 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.053 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.054 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.054 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.054 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-20T01:55:21.054 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.054 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.054 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.054 INFO:teuthology.orchestra.run.smithi079.stdout: "channel_perf": { 2024-08-20T01:55:21.054 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "channel_perf", 2024-08-20T01:55:21.054 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.054 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.054 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.054 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.055 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.055 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.055 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.055 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-20T01:55:21.055 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.055 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.055 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.055 INFO:teuthology.orchestra.run.smithi079.stdout: "contact": { 2024-08-20T01:55:21.055 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "contact", 2024-08-20T01:55:21.055 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.055 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.055 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.056 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.056 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.056 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.056 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.056 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.056 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.056 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.056 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.056 INFO:teuthology.orchestra.run.smithi079.stdout: "description": { 2024-08-20T01:55:21.056 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "description", 2024-08-20T01:55:21.056 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.056 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.056 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.057 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.057 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.057 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.057 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.057 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.057 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.057 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.057 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.057 INFO:teuthology.orchestra.run.smithi079.stdout: "device_url": { 2024-08-20T01:55:21.057 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "device_url", 2024-08-20T01:55:21.057 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.058 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.058 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.058 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-20T01:55:21.058 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.058 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.058 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.058 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.058 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.058 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.058 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.058 INFO:teuthology.orchestra.run.smithi079.stdout: "enabled": { 2024-08-20T01:55:21.058 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "enabled", 2024-08-20T01:55:21.058 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.059 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.059 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.059 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.059 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.059 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.059 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.059 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.059 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.059 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.059 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.059 INFO:teuthology.orchestra.run.smithi079.stdout: "interval": { 2024-08-20T01:55:21.059 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "interval", 2024-08-20T01:55:21.060 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.060 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.060 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.060 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "24", 2024-08-20T01:55:21.060 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "8", 2024-08-20T01:55:21.060 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.060 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.060 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.060 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.060 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.060 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.061 INFO:teuthology.orchestra.run.smithi079.stdout: "last_opt_revision": { 2024-08-20T01:55:21.061 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "last_opt_revision", 2024-08-20T01:55:21.061 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.061 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.061 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.061 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "1", 2024-08-20T01:55:21.061 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.061 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.061 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.061 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.061 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.061 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.061 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.062 INFO:teuthology.orchestra.run.smithi079.stdout: "leaderboard": { 2024-08-20T01:55:21.062 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "leaderboard", 2024-08-20T01:55:21.062 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.062 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.062 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.062 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.062 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.062 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.062 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.062 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.062 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.062 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.063 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.063 INFO:teuthology.orchestra.run.smithi079.stdout: "leaderboard_description": { 2024-08-20T01:55:21.063 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "leaderboard_description", 2024-08-20T01:55:21.063 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.063 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.063 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.063 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.063 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.063 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.063 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.063 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.063 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.063 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.064 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.064 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.064 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.064 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.064 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.064 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.064 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.064 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.065 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.065 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.065 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.065 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.065 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.065 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.065 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.065 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.065 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.065 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.065 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.065 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.065 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.066 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.066 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.066 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.066 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.066 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.066 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.066 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.066 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.066 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.066 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.066 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.067 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.067 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.067 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.067 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.067 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.067 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.067 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.067 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.067 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.067 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.067 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.067 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.067 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.068 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.068 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.068 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.068 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.068 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.068 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.068 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.068 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.068 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.068 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.068 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.069 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.069 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.069 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.069 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.069 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.069 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.069 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.069 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.069 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.069 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.069 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.069 INFO:teuthology.orchestra.run.smithi079.stdout: "organization": { 2024-08-20T01:55:21.069 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "organization", 2024-08-20T01:55:21.070 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.070 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.070 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.070 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.070 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.070 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.070 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.070 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.070 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.070 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.070 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.071 INFO:teuthology.orchestra.run.smithi079.stdout: "proxy": { 2024-08-20T01:55:21.071 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "proxy", 2024-08-20T01:55:21.071 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.071 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.071 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.071 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.071 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.071 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.071 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.071 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.071 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.072 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.072 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.072 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.072 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.072 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.072 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.072 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.072 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.072 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.072 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.073 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.073 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.073 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.073 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.073 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.073 INFO:teuthology.orchestra.run.smithi079.stdout: "url": { 2024-08-20T01:55:21.073 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "url", 2024-08-20T01:55:21.073 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.073 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.073 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.073 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-20T01:55:21.073 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.074 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.074 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.074 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.074 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.074 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.074 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.074 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.074 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.075 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "test_orchestrator", 2024-08-20T01:55:21.075 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.075 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.075 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.075 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.075 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.075 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.075 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.075 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.075 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.075 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.076 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.076 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.076 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.076 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.076 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.076 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.076 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.076 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.076 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.076 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.076 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.076 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.076 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.077 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.077 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.077 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.077 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.077 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.077 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.077 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.077 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.077 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.078 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.078 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.078 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.078 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.078 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.078 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.078 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.078 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.078 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.078 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.078 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.078 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.079 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.079 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.079 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.079 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.079 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.079 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.079 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.079 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.079 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.079 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.079 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.079 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.080 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.080 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.080 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.080 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.080 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.080 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.080 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.080 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.080 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.080 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.080 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.080 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.080 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.081 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.081 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.081 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.081 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.081 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.081 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.081 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.081 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.081 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.081 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.081 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.081 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.082 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.082 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.082 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.082 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "volumes", 2024-08-20T01:55:21.082 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.082 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.082 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.082 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.082 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.082 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.082 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.083 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.083 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.083 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.083 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.083 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.083 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.083 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.083 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.083 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.083 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.083 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.083 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.083 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.083 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.083 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.084 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.084 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.084 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.084 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.084 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.084 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.084 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.084 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.084 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.084 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.084 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.085 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.085 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.085 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.085 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.085 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.085 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.085 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.085 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.085 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.085 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.085 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.085 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.085 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.086 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.086 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.086 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.086 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.086 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.086 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.086 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.086 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.086 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.086 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.086 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.086 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.087 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.087 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.087 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.087 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.087 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.087 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.087 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.087 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.087 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.087 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.087 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.087 INFO:teuthology.orchestra.run.smithi079.stdout: "max_concurrent_clones": { 2024-08-20T01:55:21.088 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "max_concurrent_clones", 2024-08-20T01:55:21.088 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.088 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.088 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.088 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "4", 2024-08-20T01:55:21.088 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.088 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.088 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.088 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-20T01:55:21.088 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.088 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.088 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.088 INFO:teuthology.orchestra.run.smithi079.stdout: "periodic_async_work": { 2024-08-20T01:55:21.089 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "periodic_async_work", 2024-08-20T01:55:21.089 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.089 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.089 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.089 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.089 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.089 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.089 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.089 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Periodically check for async work", 2024-08-20T01:55:21.089 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.089 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.089 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.089 INFO:teuthology.orchestra.run.smithi079.stdout: "snapshot_clone_delay": { 2024-08-20T01:55:21.090 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "snapshot_clone_delay", 2024-08-20T01:55:21.090 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.090 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.090 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.090 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.090 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.090 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.090 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.090 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-20T01:55:21.090 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.090 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.090 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.091 INFO:teuthology.orchestra.run.smithi079.stdout: "snapshot_clone_no_wait": { 2024-08-20T01:55:21.091 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "snapshot_clone_no_wait", 2024-08-20T01:55:21.091 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.091 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.091 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.091 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.091 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.091 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.091 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.091 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-20T01:55:21.091 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.091 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.091 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.092 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.092 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.092 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.092 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.092 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.092 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.092 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.092 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.092 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.092 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.092 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.092 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.093 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.093 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.093 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.093 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "zabbix", 2024-08-20T01:55:21.093 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.093 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.093 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.093 INFO:teuthology.orchestra.run.smithi079.stdout: "discovery_interval": { 2024-08-20T01:55:21.093 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "discovery_interval", 2024-08-20T01:55:21.093 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "uint", 2024-08-20T01:55:21.093 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.094 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.094 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "100", 2024-08-20T01:55:21.094 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.094 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.094 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.094 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.094 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.094 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.094 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.094 INFO:teuthology.orchestra.run.smithi079.stdout: "identifier": { 2024-08-20T01:55:21.094 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "identifier", 2024-08-20T01:55:21.094 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.095 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.095 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.095 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.095 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.095 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.095 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.095 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.095 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.095 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.095 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.095 INFO:teuthology.orchestra.run.smithi079.stdout: "interval": { 2024-08-20T01:55:21.095 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "interval", 2024-08-20T01:55:21.096 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:21.096 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.096 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.096 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "60", 2024-08-20T01:55:21.096 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.096 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.096 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.096 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.096 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.096 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.096 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.096 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.096 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.097 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.097 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.097 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.097 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.097 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.097 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.097 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.097 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.097 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.097 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.097 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.097 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.097 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.097 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.098 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.098 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.098 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.098 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.098 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.098 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.098 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.098 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.098 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.098 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.098 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.098 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.099 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.099 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.099 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.099 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.099 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.099 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.099 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.099 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.099 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.099 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.099 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.099 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.100 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.100 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.100 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.100 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.100 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.100 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.100 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.100 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.100 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.100 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.100 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.100 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.100 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.101 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.101 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.101 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.101 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.101 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.101 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.101 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.101 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.101 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.101 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.101 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.101 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.101 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.102 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.102 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.102 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.102 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.102 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.102 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.102 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.102 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.102 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.102 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.102 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.102 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.103 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.103 INFO:teuthology.orchestra.run.smithi079.stdout: "zabbix_host": { 2024-08-20T01:55:21.103 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "zabbix_host", 2024-08-20T01:55:21.103 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.103 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.103 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.103 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.103 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.103 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.103 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.103 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.103 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.104 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.104 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.104 INFO:teuthology.orchestra.run.smithi079.stdout: "zabbix_port": { 2024-08-20T01:55:21.104 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "zabbix_port", 2024-08-20T01:55:21.104 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.104 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.104 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.104 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10051", 2024-08-20T01:55:21.104 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.104 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.104 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.104 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.105 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.105 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.105 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.105 INFO:teuthology.orchestra.run.smithi079.stdout: "zabbix_sender": { 2024-08-20T01:55:21.105 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "zabbix_sender", 2024-08-20T01:55:21.105 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.105 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.105 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.105 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-20T01:55:21.105 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.105 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.105 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.105 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.106 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.106 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.106 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.106 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.106 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.106 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.106 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-08-20T01:55:21.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.106 INFO:teuthology.orchestra.run.smithi079.stdout: "gid": 24121, 2024-08-20T01:55:21.106 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "z", 2024-08-20T01:55:21.107 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_features": 4540701547738038271, 2024-08-20T01:55:21.107 INFO:teuthology.orchestra.run.smithi079.stdout: "available_modules": [ 2024-08-20T01:55:21.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.107 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "alerts", 2024-08-20T01:55:21.107 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.107 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.107 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.107 INFO:teuthology.orchestra.run.smithi079.stdout: "interval": { 2024-08-20T01:55:21.107 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "interval", 2024-08-20T01:55:21.107 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:21.107 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.107 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.107 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "60", 2024-08-20T01:55:21.107 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.108 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.108 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.108 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "How frequently to reexamine health status", 2024-08-20T01:55:21.108 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.108 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.108 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.108 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.108 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.108 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.108 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.108 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.108 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.108 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.109 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.109 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.109 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.109 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.109 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.109 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.109 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.109 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.109 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.109 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.109 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.109 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.110 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.110 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.110 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.110 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.110 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.110 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.110 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.110 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.110 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.110 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.110 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.111 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.111 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.111 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.111 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.111 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.112 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.112 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.112 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.112 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.112 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.112 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.112 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.112 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.113 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.113 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.113 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.113 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.113 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.113 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.113 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.113 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.113 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.113 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.113 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.113 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.113 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.114 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.114 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.114 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.114 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.114 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.114 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.114 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.114 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.114 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.114 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.115 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_destination": { 2024-08-20T01:55:21.115 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_destination", 2024-08-20T01:55:21.115 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.115 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.115 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.115 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.115 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.115 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.115 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.115 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Email address to send alerts to", 2024-08-20T01:55:21.115 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.115 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.116 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.116 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_from_name": { 2024-08-20T01:55:21.116 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_from_name", 2024-08-20T01:55:21.116 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.116 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.116 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.116 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "Ceph", 2024-08-20T01:55:21.116 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.116 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.116 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.116 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Email From: name", 2024-08-20T01:55:21.116 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.117 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.117 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.117 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_host": { 2024-08-20T01:55:21.117 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_host", 2024-08-20T01:55:21.117 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.117 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.117 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.117 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.117 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.117 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.117 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.117 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "SMTP server", 2024-08-20T01:55:21.118 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.118 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.118 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.118 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_password": { 2024-08-20T01:55:21.118 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_password", 2024-08-20T01:55:21.118 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.118 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.118 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.118 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.118 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.119 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.119 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.119 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Password to authenticate with", 2024-08-20T01:55:21.119 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.119 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.119 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.119 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_port": { 2024-08-20T01:55:21.119 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_port", 2024-08-20T01:55:21.120 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.120 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.120 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.120 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "465", 2024-08-20T01:55:21.120 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.120 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.120 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.120 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "SMTP port", 2024-08-20T01:55:21.120 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.120 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.120 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.120 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_sender": { 2024-08-20T01:55:21.121 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_sender", 2024-08-20T01:55:21.121 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.121 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.121 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.121 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.121 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.121 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.121 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.121 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "SMTP envelope sender", 2024-08-20T01:55:21.121 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.121 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.121 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.121 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_ssl": { 2024-08-20T01:55:21.122 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_ssl", 2024-08-20T01:55:21.122 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.122 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.122 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.122 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.122 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.122 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.122 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.122 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-20T01:55:21.122 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.122 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.122 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.123 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_user": { 2024-08-20T01:55:21.123 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_user", 2024-08-20T01:55:21.123 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.123 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.123 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.123 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.123 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.123 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.123 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.123 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "User to authenticate as", 2024-08-20T01:55:21.123 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.123 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.123 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.124 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.124 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.124 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.124 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.124 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.124 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.124 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.124 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.124 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.124 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.125 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.125 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.125 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.125 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.125 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.125 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "balancer", 2024-08-20T01:55:21.125 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.125 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.125 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.125 INFO:teuthology.orchestra.run.smithi079.stdout: "active": { 2024-08-20T01:55:21.125 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "active", 2024-08-20T01:55:21.126 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.126 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.126 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.126 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.126 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.126 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.126 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.126 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "automatically balance PGs across cluster", 2024-08-20T01:55:21.126 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.126 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.126 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.127 INFO:teuthology.orchestra.run.smithi079.stdout: "begin_time": { 2024-08-20T01:55:21.127 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "begin_time", 2024-08-20T01:55:21.127 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.127 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.127 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.127 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0000", 2024-08-20T01:55:21.127 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.127 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.127 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.127 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "beginning time of day to automatically balance", 2024-08-20T01:55:21.128 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-20T01:55:21.128 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.128 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.128 INFO:teuthology.orchestra.run.smithi079.stdout: "begin_weekday": { 2024-08-20T01:55:21.128 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "begin_weekday", 2024-08-20T01:55:21.128 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "uint", 2024-08-20T01:55:21.128 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.128 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.128 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.128 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "0", 2024-08-20T01:55:21.128 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "6", 2024-08-20T01:55:21.128 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.128 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-20T01:55:21.129 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-20T01:55:21.129 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.129 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.129 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_compat_max_iterations": { 2024-08-20T01:55:21.129 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "crush_compat_max_iterations", 2024-08-20T01:55:21.129 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "uint", 2024-08-20T01:55:21.129 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.129 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.129 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "25", 2024-08-20T01:55:21.129 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "1", 2024-08-20T01:55:21.129 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "250", 2024-08-20T01:55:21.129 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.130 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-20T01:55:21.130 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.130 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.130 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.130 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_compat_metrics": { 2024-08-20T01:55:21.130 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "crush_compat_metrics", 2024-08-20T01:55:21.130 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.130 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.130 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.130 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "pgs,objects,bytes", 2024-08-20T01:55:21.130 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.131 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.131 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.131 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-20T01:55:21.131 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-20T01:55:21.131 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.131 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.131 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_compat_step": { 2024-08-20T01:55:21.131 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "crush_compat_step", 2024-08-20T01:55:21.131 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2024-08-20T01:55:21.131 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.131 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.131 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0.5", 2024-08-20T01:55:21.131 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "0.001", 2024-08-20T01:55:21.132 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "0.999", 2024-08-20T01:55:21.132 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.132 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "aggressiveness of optimization", 2024-08-20T01:55:21.132 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-20T01:55:21.132 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.132 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.132 INFO:teuthology.orchestra.run.smithi079.stdout: "end_time": { 2024-08-20T01:55:21.132 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "end_time", 2024-08-20T01:55:21.132 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.132 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.132 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.132 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "2359", 2024-08-20T01:55:21.132 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.133 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.133 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.133 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "ending time of day to automatically balance", 2024-08-20T01:55:21.133 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-20T01:55:21.133 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.133 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.133 INFO:teuthology.orchestra.run.smithi079.stdout: "end_weekday": { 2024-08-20T01:55:21.133 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "end_weekday", 2024-08-20T01:55:21.133 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "uint", 2024-08-20T01:55:21.133 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.133 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.134 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.134 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "0", 2024-08-20T01:55:21.134 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "6", 2024-08-20T01:55:21.134 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.134 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-20T01:55:21.134 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-20T01:55:21.134 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.134 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.134 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.134 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.134 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.135 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.135 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.135 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.135 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.135 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.135 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.135 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.135 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.135 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.135 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.135 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.135 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.135 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.135 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.136 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.136 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.136 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.136 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.136 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.136 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.136 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.136 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.136 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.136 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.136 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.136 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.136 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.137 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.137 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.137 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.137 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.137 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.137 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.137 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.137 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.137 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.137 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.137 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.137 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.137 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.138 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.138 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.138 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.138 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.138 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.138 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.138 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.138 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.138 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.139 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.139 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.139 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.139 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.139 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.139 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.139 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.139 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.139 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.139 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.139 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.139 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.139 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.140 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.140 INFO:teuthology.orchestra.run.smithi079.stdout: "min_score": { 2024-08-20T01:55:21.140 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "min_score", 2024-08-20T01:55:21.140 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2024-08-20T01:55:21.140 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.140 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.140 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.140 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.140 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.140 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.140 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-20T01:55:21.141 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.141 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.141 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.141 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": { 2024-08-20T01:55:21.141 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "mode", 2024-08-20T01:55:21.141 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.141 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.141 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.141 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "upmap", 2024-08-20T01:55:21.141 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.141 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.141 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.142 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-compat", 2024-08-20T01:55:21.142 INFO:teuthology.orchestra.run.smithi079.stdout: "none", 2024-08-20T01:55:21.142 INFO:teuthology.orchestra.run.smithi079.stdout: "read", 2024-08-20T01:55:21.142 INFO:teuthology.orchestra.run.smithi079.stdout: "upmap", 2024-08-20T01:55:21.142 INFO:teuthology.orchestra.run.smithi079.stdout: "upmap-read" 2024-08-20T01:55:21.142 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.142 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Balancer mode", 2024-08-20T01:55:21.142 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.142 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.142 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.143 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_ids": { 2024-08-20T01:55:21.143 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "pool_ids", 2024-08-20T01:55:21.143 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.143 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.143 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.143 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.143 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.143 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.143 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.143 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-20T01:55:21.143 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.143 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.143 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.144 INFO:teuthology.orchestra.run.smithi079.stdout: "sleep_interval": { 2024-08-20T01:55:21.144 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sleep_interval", 2024-08-20T01:55:21.144 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:21.144 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.144 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.144 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "60", 2024-08-20T01:55:21.144 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.144 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.144 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.144 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-20T01:55:21.144 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.144 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.145 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.145 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.145 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.145 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.145 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.145 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.145 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.145 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.145 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.145 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.145 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.145 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.146 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.146 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.146 INFO:teuthology.orchestra.run.smithi079.stdout: "upmap_max_deviation": { 2024-08-20T01:55:21.146 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "upmap_max_deviation", 2024-08-20T01:55:21.146 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.146 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.146 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.146 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5", 2024-08-20T01:55:21.146 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "1", 2024-08-20T01:55:21.146 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.146 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.147 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-20T01:55:21.147 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-20T01:55:21.147 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.147 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.147 INFO:teuthology.orchestra.run.smithi079.stdout: "upmap_max_optimizations": { 2024-08-20T01:55:21.147 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "upmap_max_optimizations", 2024-08-20T01:55:21.147 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "uint", 2024-08-20T01:55:21.147 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.147 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.147 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-08-20T01:55:21.147 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.148 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.148 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.148 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-20T01:55:21.148 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.148 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.148 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.148 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.148 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.148 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "cephadm", 2024-08-20T01:55:21.148 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.148 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.148 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.149 INFO:teuthology.orchestra.run.smithi079.stdout: "agent_down_multiplier": { 2024-08-20T01:55:21.149 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "agent_down_multiplier", 2024-08-20T01:55:21.149 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2024-08-20T01:55:21.149 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.149 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.149 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "3.0", 2024-08-20T01:55:21.149 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.149 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.149 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.149 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-20T01:55:21.149 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.149 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.149 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.150 INFO:teuthology.orchestra.run.smithi079.stdout: "agent_refresh_rate": { 2024-08-20T01:55:21.150 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "agent_refresh_rate", 2024-08-20T01:55:21.150 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:21.150 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.150 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.150 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "20", 2024-08-20T01:55:21.150 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.150 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.150 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.150 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-20T01:55:21.150 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.150 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.151 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.151 INFO:teuthology.orchestra.run.smithi079.stdout: "agent_starting_port": { 2024-08-20T01:55:21.151 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "agent_starting_port", 2024-08-20T01:55:21.151 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.151 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.151 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.151 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "4721", 2024-08-20T01:55:21.151 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.151 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.151 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.151 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-20T01:55:21.151 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.151 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.152 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.152 INFO:teuthology.orchestra.run.smithi079.stdout: "allow_ptrace": { 2024-08-20T01:55:21.152 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "allow_ptrace", 2024-08-20T01:55:21.152 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.152 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.152 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.152 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.152 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.152 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.152 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.152 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-20T01:55:21.152 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-20T01:55:21.152 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.153 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.153 INFO:teuthology.orchestra.run.smithi079.stdout: "autotune_interval": { 2024-08-20T01:55:21.153 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "autotune_interval", 2024-08-20T01:55:21.153 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:21.153 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.153 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.153 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "600", 2024-08-20T01:55:21.153 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.153 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.153 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.153 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-20T01:55:21.153 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.153 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.154 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.154 INFO:teuthology.orchestra.run.smithi079.stdout: "autotune_memory_target_ratio": { 2024-08-20T01:55:21.154 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "autotune_memory_target_ratio", 2024-08-20T01:55:21.154 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2024-08-20T01:55:21.154 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.154 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.154 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0.7", 2024-08-20T01:55:21.154 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.154 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.154 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.154 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-20T01:55:21.154 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.155 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.155 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.155 INFO:teuthology.orchestra.run.smithi079.stdout: "cephadm_log_destination": { 2024-08-20T01:55:21.155 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "cephadm_log_destination", 2024-08-20T01:55:21.155 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.155 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.155 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.155 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.155 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.155 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.155 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.155 INFO:teuthology.orchestra.run.smithi079.stdout: "file", 2024-08-20T01:55:21.156 INFO:teuthology.orchestra.run.smithi079.stdout: "file,syslog", 2024-08-20T01:55:21.156 INFO:teuthology.orchestra.run.smithi079.stdout: "syslog" 2024-08-20T01:55:21.156 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.156 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-20T01:55:21.156 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.156 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.156 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.156 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.156 INFO:teuthology.orchestra.run.smithi079.stdout: "cgroups_split": { 2024-08-20T01:55:21.156 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "cgroups_split", 2024-08-20T01:55:21.156 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.156 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.157 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.157 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.157 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.157 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.157 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.157 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-20T01:55:21.157 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.157 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.157 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.157 INFO:teuthology.orchestra.run.smithi079.stdout: "config_checks_enabled": { 2024-08-20T01:55:21.157 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "config_checks_enabled", 2024-08-20T01:55:21.157 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.158 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.158 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.158 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.158 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.158 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.158 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.158 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-20T01:55:21.158 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.158 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.158 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.159 INFO:teuthology.orchestra.run.smithi079.stdout: "config_dashboard": { 2024-08-20T01:55:21.159 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "config_dashboard", 2024-08-20T01:55:21.159 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.159 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.159 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.159 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.159 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.159 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.159 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.159 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-20T01:55:21.159 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.159 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.159 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.160 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_alertmanager": { 2024-08-20T01:55:21.160 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_alertmanager", 2024-08-20T01:55:21.160 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.160 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.160 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.160 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-08-20T01:55:21.160 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.160 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.160 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.160 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Prometheus container image", 2024-08-20T01:55:21.160 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.160 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.160 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.161 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_base": { 2024-08-20T01:55:21.161 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_base", 2024-08-20T01:55:21.161 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.161 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.161 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.161 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-20T01:55:21.161 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.161 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.161 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.161 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Container image name, without the tag", 2024-08-20T01:55:21.161 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.161 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.162 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.162 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.162 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_elasticsearch": { 2024-08-20T01:55:21.162 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_elasticsearch", 2024-08-20T01:55:21.162 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.162 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.162 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.162 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-20T01:55:21.162 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.162 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.162 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.162 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "elasticsearch container image", 2024-08-20T01:55:21.162 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.163 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.163 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.163 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_grafana": { 2024-08-20T01:55:21.163 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_grafana", 2024-08-20T01:55:21.163 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.163 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.163 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.163 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-08-20T01:55:21.163 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.163 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.163 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.164 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Prometheus container image", 2024-08-20T01:55:21.164 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.164 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.164 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.164 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_haproxy": { 2024-08-20T01:55:21.164 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_haproxy", 2024-08-20T01:55:21.164 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.164 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.164 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.164 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-20T01:55:21.164 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.164 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.165 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.165 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "HAproxy container image", 2024-08-20T01:55:21.165 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.165 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.165 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.165 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_jaeger_agent": { 2024-08-20T01:55:21.165 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_jaeger_agent", 2024-08-20T01:55:21.165 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.165 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.166 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.166 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-20T01:55:21.166 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.166 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.166 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.166 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Jaeger agent container image", 2024-08-20T01:55:21.166 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.166 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.166 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.166 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_jaeger_collector": { 2024-08-20T01:55:21.166 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_jaeger_collector", 2024-08-20T01:55:21.166 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.167 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.167 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.167 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-20T01:55:21.167 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.167 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.167 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.167 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Jaeger collector container image", 2024-08-20T01:55:21.167 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.167 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.167 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.167 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.167 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_jaeger_query": { 2024-08-20T01:55:21.167 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_jaeger_query", 2024-08-20T01:55:21.167 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.168 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.168 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.168 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-20T01:55:21.168 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.168 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.168 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.168 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Jaeger query container image", 2024-08-20T01:55:21.168 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.168 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.168 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.168 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_keepalived": { 2024-08-20T01:55:21.168 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_keepalived", 2024-08-20T01:55:21.168 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.169 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.169 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.169 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-20T01:55:21.169 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.169 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.169 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.169 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Keepalived container image", 2024-08-20T01:55:21.169 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.169 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.169 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.169 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_loki": { 2024-08-20T01:55:21.169 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_loki", 2024-08-20T01:55:21.169 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.170 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.170 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.170 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-20T01:55:21.170 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.170 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.170 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.170 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Loki container image", 2024-08-20T01:55:21.170 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.170 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.170 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.170 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_nginx": { 2024-08-20T01:55:21.171 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_nginx", 2024-08-20T01:55:21.171 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.171 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.171 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.171 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-08-20T01:55:21.171 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.171 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.171 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.171 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Nginx container image", 2024-08-20T01:55:21.171 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.171 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.171 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.171 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_node_exporter": { 2024-08-20T01:55:21.172 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_node_exporter", 2024-08-20T01:55:21.172 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.172 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.172 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.172 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-08-20T01:55:21.172 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.172 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.172 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.172 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Prometheus container image", 2024-08-20T01:55:21.172 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.172 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.172 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.173 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_nvmeof": { 2024-08-20T01:55:21.173 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_nvmeof", 2024-08-20T01:55:21.173 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.173 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.173 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.173 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-08-20T01:55:21.173 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.173 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.173 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.173 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Nvme-of container image", 2024-08-20T01:55:21.173 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.173 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.174 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.174 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_prometheus": { 2024-08-20T01:55:21.174 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_prometheus", 2024-08-20T01:55:21.174 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.174 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.174 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.174 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-08-20T01:55:21.174 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.174 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.174 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.175 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Prometheus container image", 2024-08-20T01:55:21.175 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.175 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.175 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.175 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_promtail": { 2024-08-20T01:55:21.175 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_promtail", 2024-08-20T01:55:21.175 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.175 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.175 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.175 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-20T01:55:21.175 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.175 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.176 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.176 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Promtail container image", 2024-08-20T01:55:21.176 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.176 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.176 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.176 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_samba": { 2024-08-20T01:55:21.176 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_samba", 2024-08-20T01:55:21.176 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.176 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.177 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.177 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-20T01:55:21.177 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.177 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.177 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.177 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Samba/SMB container image", 2024-08-20T01:55:21.177 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.177 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.177 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.178 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.178 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_snmp_gateway": { 2024-08-20T01:55:21.178 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_snmp_gateway", 2024-08-20T01:55:21.178 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.178 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.178 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.178 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-20T01:55:21.178 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.178 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.178 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.178 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "SNMP Gateway container image", 2024-08-20T01:55:21.178 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.179 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.179 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.179 INFO:teuthology.orchestra.run.smithi079.stdout: "container_init": { 2024-08-20T01:55:21.179 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_init", 2024-08-20T01:55:21.179 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.179 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.179 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.179 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.179 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.179 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.179 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.179 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Run podman/docker with `--init`", 2024-08-20T01:55:21.179 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.180 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.180 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.180 INFO:teuthology.orchestra.run.smithi079.stdout: "daemon_cache_timeout": { 2024-08-20T01:55:21.180 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "daemon_cache_timeout", 2024-08-20T01:55:21.180 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:21.180 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.180 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.180 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "600", 2024-08-20T01:55:21.180 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.180 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.180 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.180 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-20T01:55:21.180 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.181 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.181 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.181 INFO:teuthology.orchestra.run.smithi079.stdout: "default_cephadm_command_timeout": { 2024-08-20T01:55:21.181 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "default_cephadm_command_timeout", 2024-08-20T01:55:21.181 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.181 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.181 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.181 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "900", 2024-08-20T01:55:21.181 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.181 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.182 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.182 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-20T01:55:21.182 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.182 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.182 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.182 INFO:teuthology.orchestra.run.smithi079.stdout: "default_registry": { 2024-08-20T01:55:21.182 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "default_registry", 2024-08-20T01:55:21.182 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.182 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.182 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.182 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "docker.io", 2024-08-20T01:55:21.183 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.183 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.183 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.183 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-20T01:55:21.183 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.183 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.183 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.183 INFO:teuthology.orchestra.run.smithi079.stdout: "device_cache_timeout": { 2024-08-20T01:55:21.183 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "device_cache_timeout", 2024-08-20T01:55:21.183 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:21.183 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.183 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.184 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "1800", 2024-08-20T01:55:21.184 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.184 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.184 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.184 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "seconds to cache device inventory", 2024-08-20T01:55:21.184 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.184 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.184 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.184 INFO:teuthology.orchestra.run.smithi079.stdout: "device_enhanced_scan": { 2024-08-20T01:55:21.184 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "device_enhanced_scan", 2024-08-20T01:55:21.184 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.184 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.184 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.185 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.185 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.185 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.185 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.185 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-20T01:55:21.185 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.185 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.185 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.185 INFO:teuthology.orchestra.run.smithi079.stdout: "facts_cache_timeout": { 2024-08-20T01:55:21.185 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "facts_cache_timeout", 2024-08-20T01:55:21.185 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:21.185 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.185 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.186 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "60", 2024-08-20T01:55:21.186 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.186 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.186 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.186 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "seconds to cache host facts data", 2024-08-20T01:55:21.186 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.186 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.186 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.186 INFO:teuthology.orchestra.run.smithi079.stdout: "grafana_dashboards_path": { 2024-08-20T01:55:21.186 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "grafana_dashboards_path", 2024-08-20T01:55:21.186 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.187 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.187 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.187 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-20T01:55:21.187 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.187 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.187 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.187 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-20T01:55:21.187 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.187 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.187 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.187 INFO:teuthology.orchestra.run.smithi079.stdout: "host_check_interval": { 2024-08-20T01:55:21.187 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "host_check_interval", 2024-08-20T01:55:21.188 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:21.188 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.188 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.188 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "600", 2024-08-20T01:55:21.188 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.188 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.188 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.188 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how frequently to perform a host check", 2024-08-20T01:55:21.188 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.188 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.188 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.188 INFO:teuthology.orchestra.run.smithi079.stdout: "hw_monitoring": { 2024-08-20T01:55:21.188 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "hw_monitoring", 2024-08-20T01:55:21.189 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.189 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.189 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.189 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.189 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.189 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.189 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.189 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-20T01:55:21.189 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.189 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.189 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.189 INFO:teuthology.orchestra.run.smithi079.stdout: "inventory_list_all": { 2024-08-20T01:55:21.190 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "inventory_list_all", 2024-08-20T01:55:21.190 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.190 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.190 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.190 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.190 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.190 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.190 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.190 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-20T01:55:21.190 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.190 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.191 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.191 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.191 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.191 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.191 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.191 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.191 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.191 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.191 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.191 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.191 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.191 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.192 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.192 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.192 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.192 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.192 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.192 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.192 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.192 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.192 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.192 INFO:teuthology.orchestra.run.smithi079.stdout: "log_refresh_metadata": { 2024-08-20T01:55:21.193 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_refresh_metadata", 2024-08-20T01:55:21.193 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.193 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.193 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.193 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.193 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.193 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.193 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.193 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-20T01:55:21.193 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.193 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.193 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.194 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.194 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.194 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.194 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.194 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.194 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.194 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.194 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.194 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.194 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-20T01:55:21.194 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.194 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.195 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.195 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.195 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.195 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.195 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.195 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.195 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.195 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.195 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.195 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.195 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.195 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.195 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.196 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.196 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.196 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.196 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.196 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.196 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.196 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.196 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.196 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.196 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.196 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.196 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.196 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.197 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.197 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.197 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.197 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.197 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.197 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.197 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.197 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.197 INFO:teuthology.orchestra.run.smithi079.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-20T01:55:21.197 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-20T01:55:21.197 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.197 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.197 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.198 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.198 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.198 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.198 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.198 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-20T01:55:21.198 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.198 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.198 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.198 INFO:teuthology.orchestra.run.smithi079.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-20T01:55:21.198 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-20T01:55:21.199 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.199 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.199 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.199 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "*", 2024-08-20T01:55:21.199 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.199 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.199 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.199 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-20T01:55:21.199 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.199 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.199 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.199 INFO:teuthology.orchestra.run.smithi079.stdout: "max_count_per_host": { 2024-08-20T01:55:21.199 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "max_count_per_host", 2024-08-20T01:55:21.200 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.200 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.200 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.200 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-08-20T01:55:21.200 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.200 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.200 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.200 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "max number of daemons per service per host", 2024-08-20T01:55:21.200 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.200 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.200 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.201 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd_draining_count": { 2024-08-20T01:55:21.201 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "max_osd_draining_count", 2024-08-20T01:55:21.201 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.201 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.201 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.201 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-08-20T01:55:21.201 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.201 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.201 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.201 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-20T01:55:21.202 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.202 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.202 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.202 INFO:teuthology.orchestra.run.smithi079.stdout: "migration_current": { 2024-08-20T01:55:21.202 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "migration_current", 2024-08-20T01:55:21.202 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.202 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.202 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.202 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.202 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.202 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.202 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.203 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "internal - do not modify", 2024-08-20T01:55:21.203 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.203 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.203 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.203 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": { 2024-08-20T01:55:21.203 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "mode", 2024-08-20T01:55:21.203 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.203 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.203 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.203 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "root", 2024-08-20T01:55:21.204 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.204 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.204 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.204 INFO:teuthology.orchestra.run.smithi079.stdout: "cephadm-package", 2024-08-20T01:55:21.204 INFO:teuthology.orchestra.run.smithi079.stdout: "root" 2024-08-20T01:55:21.204 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.204 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "mode for remote execution of cephadm", 2024-08-20T01:55:21.204 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.204 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.204 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.204 INFO:teuthology.orchestra.run.smithi079.stdout: "oob_default_addr": { 2024-08-20T01:55:21.204 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "oob_default_addr", 2024-08-20T01:55:21.204 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.205 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.205 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.205 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "169.254.1.1", 2024-08-20T01:55:21.205 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.205 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.205 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.205 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-20T01:55:21.205 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.205 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.205 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.205 INFO:teuthology.orchestra.run.smithi079.stdout: "prometheus_alerts_path": { 2024-08-20T01:55:21.205 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "prometheus_alerts_path", 2024-08-20T01:55:21.205 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.206 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.206 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.206 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-20T01:55:21.206 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.206 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.206 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.206 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-20T01:55:21.206 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.206 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.206 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.206 INFO:teuthology.orchestra.run.smithi079.stdout: "registry_insecure": { 2024-08-20T01:55:21.206 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "registry_insecure", 2024-08-20T01:55:21.207 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.207 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.207 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.207 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.207 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.207 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.207 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.207 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-20T01:55:21.207 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.207 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.207 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.207 INFO:teuthology.orchestra.run.smithi079.stdout: "registry_password": { 2024-08-20T01:55:21.208 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "registry_password", 2024-08-20T01:55:21.208 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.208 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.208 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.208 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.208 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.208 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.208 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.208 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-20T01:55:21.208 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.208 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.208 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.209 INFO:teuthology.orchestra.run.smithi079.stdout: "registry_url": { 2024-08-20T01:55:21.209 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "registry_url", 2024-08-20T01:55:21.209 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.209 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.209 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.209 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.209 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.209 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.209 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.209 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-20T01:55:21.209 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.209 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.209 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.210 INFO:teuthology.orchestra.run.smithi079.stdout: "registry_username": { 2024-08-20T01:55:21.210 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "registry_username", 2024-08-20T01:55:21.210 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.210 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.210 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.210 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.210 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.210 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.210 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.210 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-20T01:55:21.210 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.211 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.211 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.211 INFO:teuthology.orchestra.run.smithi079.stdout: "secure_monitoring_stack": { 2024-08-20T01:55:21.211 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "secure_monitoring_stack", 2024-08-20T01:55:21.211 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.211 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.211 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.211 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.211 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.211 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.211 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.212 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-20T01:55:21.212 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.212 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.212 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.213 INFO:teuthology.orchestra.run.smithi079.stdout: "service_discovery_port": { 2024-08-20T01:55:21.213 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "service_discovery_port", 2024-08-20T01:55:21.213 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.213 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.213 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.213 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "8765", 2024-08-20T01:55:21.213 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.214 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.214 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.214 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "cephadm service discovery port", 2024-08-20T01:55:21.214 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.214 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.214 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.214 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.214 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.214 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.214 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.215 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.215 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.215 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.215 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.215 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.215 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.215 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.215 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.215 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.216 INFO:teuthology.orchestra.run.smithi079.stdout: "ssh_config_file": { 2024-08-20T01:55:21.216 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ssh_config_file", 2024-08-20T01:55:21.216 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.216 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.216 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.216 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.216 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.216 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.216 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.216 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-20T01:55:21.216 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.216 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.217 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.217 INFO:teuthology.orchestra.run.smithi079.stdout: "use_agent": { 2024-08-20T01:55:21.217 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "use_agent", 2024-08-20T01:55:21.217 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.217 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.217 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.217 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.217 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.217 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.217 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.217 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-20T01:55:21.218 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.218 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.218 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.218 INFO:teuthology.orchestra.run.smithi079.stdout: "use_repo_digest": { 2024-08-20T01:55:21.218 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "use_repo_digest", 2024-08-20T01:55:21.218 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.218 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.218 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.218 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.218 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.218 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.218 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.218 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-20T01:55:21.219 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.219 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.219 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.219 INFO:teuthology.orchestra.run.smithi079.stdout: "warn_on_failed_host_check": { 2024-08-20T01:55:21.219 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "warn_on_failed_host_check", 2024-08-20T01:55:21.219 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.219 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.219 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.219 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.219 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.220 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.220 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.220 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "raise a health warning if the host check fails", 2024-08-20T01:55:21.220 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.220 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.220 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.220 INFO:teuthology.orchestra.run.smithi079.stdout: "warn_on_stray_daemons": { 2024-08-20T01:55:21.220 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "warn_on_stray_daemons", 2024-08-20T01:55:21.220 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.220 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.220 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.221 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.221 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.221 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.221 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.221 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-20T01:55:21.221 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.221 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.221 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.221 INFO:teuthology.orchestra.run.smithi079.stdout: "warn_on_stray_hosts": { 2024-08-20T01:55:21.221 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "warn_on_stray_hosts", 2024-08-20T01:55:21.221 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.221 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.221 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.222 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.222 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.222 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.222 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.222 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-20T01:55:21.222 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.222 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.222 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.222 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.222 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.222 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "crash", 2024-08-20T01:55:21.222 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.223 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.223 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.223 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.223 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.223 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.223 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.223 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.223 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.223 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.223 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.223 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.223 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.223 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.223 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.224 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.224 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.224 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.224 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.224 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.224 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.224 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.224 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.224 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.224 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.225 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.225 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.225 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.225 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.225 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.225 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.225 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.225 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.225 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.225 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.225 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.225 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.226 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.226 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.226 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.226 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.226 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.226 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.226 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.226 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.226 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.226 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.226 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.227 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.227 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.227 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.227 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.227 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.227 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.227 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.227 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.227 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.227 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.227 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.227 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.227 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.228 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.228 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.228 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.228 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.228 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.228 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.228 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.228 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.228 INFO:teuthology.orchestra.run.smithi079.stdout: "retain_interval": { 2024-08-20T01:55:21.228 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "retain_interval", 2024-08-20T01:55:21.229 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:21.229 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.229 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.229 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "31536000", 2024-08-20T01:55:21.229 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.229 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.229 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.229 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-20T01:55:21.229 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.229 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.229 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.229 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.229 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.230 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.230 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.230 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.230 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.230 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.230 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.230 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.230 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.230 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.230 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.230 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.230 INFO:teuthology.orchestra.run.smithi079.stdout: "warn_recent_interval": { 2024-08-20T01:55:21.231 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "warn_recent_interval", 2024-08-20T01:55:21.231 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:21.231 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.231 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.231 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "1209600", 2024-08-20T01:55:21.231 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.231 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.231 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.231 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-20T01:55:21.231 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.231 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.231 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.231 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.231 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.232 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "dashboard", 2024-08-20T01:55:21.232 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.232 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.232 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.232 INFO:teuthology.orchestra.run.smithi079.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-20T01:55:21.232 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-20T01:55:21.232 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.232 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.232 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.232 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-08-20T01:55:21.232 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.233 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.233 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.233 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.233 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.233 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.233 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.233 INFO:teuthology.orchestra.run.smithi079.stdout: "ALERTMANAGER_API_HOST": { 2024-08-20T01:55:21.233 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-20T01:55:21.233 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.233 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.233 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.233 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.233 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.233 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.234 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.234 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.234 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.234 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.234 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.234 INFO:teuthology.orchestra.run.smithi079.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-20T01:55:21.234 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-20T01:55:21.234 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.234 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.234 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.235 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.235 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.235 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.235 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.235 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.235 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.235 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.235 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.235 INFO:teuthology.orchestra.run.smithi079.stdout: "AUDIT_API_ENABLED": { 2024-08-20T01:55:21.235 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "AUDIT_API_ENABLED", 2024-08-20T01:55:21.235 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.235 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.235 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.236 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.236 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.236 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.236 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.236 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.236 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.236 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.236 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.236 INFO:teuthology.orchestra.run.smithi079.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-20T01:55:21.236 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-20T01:55:21.236 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.236 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.236 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.237 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.237 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.237 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.237 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.237 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.237 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.237 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.237 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.237 INFO:teuthology.orchestra.run.smithi079.stdout: "ENABLE_BROWSABLE_API": { 2024-08-20T01:55:21.237 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-20T01:55:21.237 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.237 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.237 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.238 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.238 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.238 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.238 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.238 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.238 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.238 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.238 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.238 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-20T01:55:21.239 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-20T01:55:21.239 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.239 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.239 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.239 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.239 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.239 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.239 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.239 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.239 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.239 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.239 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.239 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-20T01:55:21.240 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-20T01:55:21.240 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.240 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.240 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.240 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.240 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.240 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.240 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.240 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.240 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.240 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.240 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.240 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-20T01:55:21.241 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-20T01:55:21.241 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.241 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.241 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.241 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.241 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.241 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.241 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.241 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.241 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.241 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.241 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.242 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-20T01:55:21.242 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-20T01:55:21.242 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.242 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.242 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.242 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.242 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.242 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.242 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.242 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.242 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.243 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.243 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.243 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-20T01:55:21.243 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-20T01:55:21.243 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.243 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.243 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.243 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.243 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.243 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.243 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.243 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.243 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.244 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.244 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.244 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-20T01:55:21.244 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-20T01:55:21.244 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.244 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.244 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.244 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.244 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.244 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.244 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.245 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.245 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.245 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.245 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.245 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-20T01:55:21.245 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-20T01:55:21.245 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.245 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.245 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.245 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.245 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.246 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.246 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.246 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.246 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.246 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.246 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.246 INFO:teuthology.orchestra.run.smithi079.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-20T01:55:21.246 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-20T01:55:21.246 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.246 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.246 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.247 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.247 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.247 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.247 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.247 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.247 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.247 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.247 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.247 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_API_PASSWORD": { 2024-08-20T01:55:21.247 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-20T01:55:21.247 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.247 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.248 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.248 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "admin", 2024-08-20T01:55:21.248 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.248 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.248 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.248 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.248 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.248 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.248 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.248 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-20T01:55:21.248 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-20T01:55:21.248 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.249 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.249 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.249 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.249 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.249 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.249 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.249 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.249 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.249 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.249 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.249 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_API_URL": { 2024-08-20T01:55:21.249 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_API_URL", 2024-08-20T01:55:21.250 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.250 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.250 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.250 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.250 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.250 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.250 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.250 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.250 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.250 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.250 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.250 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_API_USERNAME": { 2024-08-20T01:55:21.251 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-20T01:55:21.251 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.251 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.251 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.251 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "admin", 2024-08-20T01:55:21.251 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.251 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.251 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.251 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.251 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.251 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.251 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.251 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-20T01:55:21.252 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-20T01:55:21.252 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.252 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.252 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.252 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.252 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.252 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.252 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.252 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.252 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.252 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.252 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.252 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-20T01:55:21.253 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-20T01:55:21.253 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.253 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.253 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.253 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.253 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.253 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.253 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.253 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.253 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.253 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.253 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.253 INFO:teuthology.orchestra.run.smithi079.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-20T01:55:21.254 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-20T01:55:21.254 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.254 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.254 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.254 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.254 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.254 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.254 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.254 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.254 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.254 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.254 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.255 INFO:teuthology.orchestra.run.smithi079.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-20T01:55:21.255 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-20T01:55:21.255 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.255 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.255 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.255 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.255 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.255 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.255 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.255 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.255 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.255 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.255 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.256 INFO:teuthology.orchestra.run.smithi079.stdout: "MANAGED_BY_CLUSTERS": { 2024-08-20T01:55:21.256 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-08-20T01:55:21.256 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.256 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.256 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.256 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "[]", 2024-08-20T01:55:21.256 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.256 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.256 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.256 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.256 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.256 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.256 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.257 INFO:teuthology.orchestra.run.smithi079.stdout: "MULTICLUSTER_CONFIG": { 2024-08-20T01:55:21.257 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "MULTICLUSTER_CONFIG", 2024-08-20T01:55:21.257 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.257 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.257 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.257 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "{}", 2024-08-20T01:55:21.257 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.257 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.257 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.257 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.257 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.257 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.257 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.258 INFO:teuthology.orchestra.run.smithi079.stdout: "PROMETHEUS_API_HOST": { 2024-08-20T01:55:21.258 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-20T01:55:21.258 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.258 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.258 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.258 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.258 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.258 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.258 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.259 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.259 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.259 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.259 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.259 INFO:teuthology.orchestra.run.smithi079.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-20T01:55:21.259 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-20T01:55:21.259 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.259 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.259 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.259 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.259 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.260 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.260 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.260 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.260 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.260 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.260 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.260 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-20T01:55:21.260 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-20T01:55:21.260 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.260 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.260 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.260 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.260 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.261 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.261 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.261 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.261 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.261 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.261 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.261 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-20T01:55:21.261 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-20T01:55:21.261 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.261 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.261 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.261 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.262 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.262 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.262 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.262 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.262 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.262 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.262 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.262 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-20T01:55:21.262 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-20T01:55:21.262 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.262 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.262 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.263 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.263 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.263 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.263 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.263 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.263 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.263 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.263 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.263 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-20T01:55:21.263 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-20T01:55:21.263 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.264 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.264 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.264 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.264 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.264 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.264 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.264 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.264 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.264 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.264 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.264 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-20T01:55:21.264 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-20T01:55:21.265 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.265 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.265 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.265 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.265 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.265 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.265 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.265 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.265 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.265 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.266 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.266 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-20T01:55:21.266 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-20T01:55:21.266 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.266 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.266 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.266 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.266 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.266 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.266 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.266 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.266 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.267 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.267 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.267 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-20T01:55:21.267 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-20T01:55:21.267 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.267 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.267 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.267 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.267 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.267 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.267 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.267 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.267 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.268 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.268 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.268 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_ENABLED": { 2024-08-20T01:55:21.268 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-20T01:55:21.268 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.268 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.268 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.268 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.268 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.268 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.268 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.268 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.268 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.268 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.269 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.269 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-20T01:55:21.269 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-20T01:55:21.269 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.269 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.269 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.269 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-20T01:55:21.269 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.269 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.269 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.269 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.269 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.270 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.270 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.270 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-20T01:55:21.270 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-20T01:55:21.270 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.270 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.270 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.270 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-08-20T01:55:21.270 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.270 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.270 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.270 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.271 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.271 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.271 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.271 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-20T01:55:21.271 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-20T01:55:21.271 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.271 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.271 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.271 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "8", 2024-08-20T01:55:21.271 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.271 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.271 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.272 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.272 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.272 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.272 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.272 INFO:teuthology.orchestra.run.smithi079.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-20T01:55:21.272 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-20T01:55:21.272 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.272 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.272 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.272 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "45", 2024-08-20T01:55:21.272 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.272 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.272 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.273 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.273 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.273 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.273 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.273 INFO:teuthology.orchestra.run.smithi079.stdout: "RGW_API_ACCESS_KEY": { 2024-08-20T01:55:21.273 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-20T01:55:21.273 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.273 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.273 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.273 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.273 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.274 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.274 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.274 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.274 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.274 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.274 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.274 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.274 INFO:teuthology.orchestra.run.smithi079.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-20T01:55:21.274 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-20T01:55:21.274 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.274 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.275 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.275 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "admin", 2024-08-20T01:55:21.275 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.275 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.275 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.275 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.275 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.275 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.275 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.275 INFO:teuthology.orchestra.run.smithi079.stdout: "RGW_API_SECRET_KEY": { 2024-08-20T01:55:21.275 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-20T01:55:21.275 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.276 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.276 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.276 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.276 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.276 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.276 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.276 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.276 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.276 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.276 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.277 INFO:teuthology.orchestra.run.smithi079.stdout: "RGW_API_SSL_VERIFY": { 2024-08-20T01:55:21.277 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-20T01:55:21.277 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.277 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.277 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.277 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.277 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.277 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.277 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.277 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.277 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.277 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.278 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.278 INFO:teuthology.orchestra.run.smithi079.stdout: "UNSAFE_TLS_v1_2": { 2024-08-20T01:55:21.278 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "UNSAFE_TLS_v1_2", 2024-08-20T01:55:21.278 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.278 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.278 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.278 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.278 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.278 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.279 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.279 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.279 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.279 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.279 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.279 INFO:teuthology.orchestra.run.smithi079.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-20T01:55:21.279 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-20T01:55:21.279 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.279 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.280 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.280 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.280 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.280 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.280 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.280 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.280 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.280 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.280 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.280 INFO:teuthology.orchestra.run.smithi079.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-20T01:55:21.280 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-20T01:55:21.280 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.281 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.281 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.281 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-08-20T01:55:21.281 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.281 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.281 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.281 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.281 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.281 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.281 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.281 INFO:teuthology.orchestra.run.smithi079.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-20T01:55:21.281 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-20T01:55:21.281 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.282 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.282 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.282 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5", 2024-08-20T01:55:21.282 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.282 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.282 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.282 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.282 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.282 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.282 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.282 INFO:teuthology.orchestra.run.smithi079.stdout: "cross_origin_url": { 2024-08-20T01:55:21.283 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "cross_origin_url", 2024-08-20T01:55:21.283 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.283 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.283 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.283 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.283 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.283 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.283 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.283 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.283 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.283 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.283 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.284 INFO:teuthology.orchestra.run.smithi079.stdout: "crt_file": { 2024-08-20T01:55:21.284 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "crt_file", 2024-08-20T01:55:21.284 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.284 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.284 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.284 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.284 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.284 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.284 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.284 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.284 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.284 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.284 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.285 INFO:teuthology.orchestra.run.smithi079.stdout: "debug": { 2024-08-20T01:55:21.285 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "debug", 2024-08-20T01:55:21.285 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.285 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.285 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.285 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.285 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.285 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.285 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.285 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Enable/disable debug options", 2024-08-20T01:55:21.285 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.285 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.286 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.286 INFO:teuthology.orchestra.run.smithi079.stdout: "jwt_token_ttl": { 2024-08-20T01:55:21.286 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "jwt_token_ttl", 2024-08-20T01:55:21.286 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.286 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.286 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.286 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "28800", 2024-08-20T01:55:21.286 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.286 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.286 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.286 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.286 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.287 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.287 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.287 INFO:teuthology.orchestra.run.smithi079.stdout: "key_file": { 2024-08-20T01:55:21.287 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "key_file", 2024-08-20T01:55:21.287 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.287 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.287 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.287 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.287 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.287 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.287 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.287 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.287 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.288 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.288 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.288 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.288 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.288 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.288 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.288 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.288 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.288 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.288 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.288 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.288 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.288 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.289 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.289 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.289 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.289 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.289 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.289 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.289 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.289 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.289 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.289 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.289 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.289 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.289 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.290 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.290 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.290 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.290 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.290 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.290 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.290 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.290 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.290 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.290 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.290 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.290 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.291 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.291 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.291 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.291 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.291 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.291 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.291 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.291 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.291 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.291 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.291 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.291 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.291 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.291 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.292 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.292 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.292 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.292 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.292 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.292 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.292 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.292 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.292 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.292 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.292 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.292 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.292 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.292 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.293 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.293 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.293 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.293 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.293 INFO:teuthology.orchestra.run.smithi079.stdout: "motd": { 2024-08-20T01:55:21.293 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "motd", 2024-08-20T01:55:21.293 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.293 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.293 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.293 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.293 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.293 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.293 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.293 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "The message of the day", 2024-08-20T01:55:21.294 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.294 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.294 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.294 INFO:teuthology.orchestra.run.smithi079.stdout: "redirect_resolve_ip_addr": { 2024-08-20T01:55:21.294 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "redirect_resolve_ip_addr", 2024-08-20T01:55:21.294 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.294 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.294 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.294 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.294 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.294 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.294 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.295 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.295 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.295 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.295 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.295 INFO:teuthology.orchestra.run.smithi079.stdout: "server_addr": { 2024-08-20T01:55:21.295 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_addr", 2024-08-20T01:55:21.295 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.295 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.295 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.295 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "::", 2024-08-20T01:55:21.295 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.295 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.295 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.296 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.296 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.296 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.296 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.296 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.296 INFO:teuthology.orchestra.run.smithi079.stdout: "server_port": { 2024-08-20T01:55:21.296 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_port", 2024-08-20T01:55:21.296 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.296 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.296 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.296 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "8080", 2024-08-20T01:55:21.296 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.296 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.296 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.297 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.297 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.297 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.297 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.297 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.297 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.297 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.297 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.297 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.297 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.297 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.297 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.297 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.297 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.298 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.298 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.298 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.298 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.298 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.298 INFO:teuthology.orchestra.run.smithi079.stdout: "ssl": { 2024-08-20T01:55:21.298 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ssl", 2024-08-20T01:55:21.298 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.298 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.298 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.298 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.298 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.298 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.299 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.299 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.299 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.299 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.299 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.299 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.299 INFO:teuthology.orchestra.run.smithi079.stdout: "ssl_server_port": { 2024-08-20T01:55:21.299 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ssl_server_port", 2024-08-20T01:55:21.299 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.299 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.299 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.299 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "8443", 2024-08-20T01:55:21.299 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.299 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.300 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.300 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.300 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.300 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.300 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.300 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.300 INFO:teuthology.orchestra.run.smithi079.stdout: "standby_behaviour": { 2024-08-20T01:55:21.300 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "standby_behaviour", 2024-08-20T01:55:21.300 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.300 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.300 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.300 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "redirect", 2024-08-20T01:55:21.301 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.301 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.301 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.301 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.301 INFO:teuthology.orchestra.run.smithi079.stdout: "redirect" 2024-08-20T01:55:21.301 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.301 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.301 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.301 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.301 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.301 INFO:teuthology.orchestra.run.smithi079.stdout: "standby_error_status_code": { 2024-08-20T01:55:21.301 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "standby_error_status_code", 2024-08-20T01:55:21.302 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.302 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.302 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.302 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "500", 2024-08-20T01:55:21.302 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "400", 2024-08-20T01:55:21.302 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "599", 2024-08-20T01:55:21.302 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.302 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.302 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.302 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.302 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.302 INFO:teuthology.orchestra.run.smithi079.stdout: "url_prefix": { 2024-08-20T01:55:21.303 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "url_prefix", 2024-08-20T01:55:21.303 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.303 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.303 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.303 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.303 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.303 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.303 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.303 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.303 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.303 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.303 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.304 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.304 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.304 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "devicehealth", 2024-08-20T01:55:21.304 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.304 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.304 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.304 INFO:teuthology.orchestra.run.smithi079.stdout: "enable_monitoring": { 2024-08-20T01:55:21.304 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "enable_monitoring", 2024-08-20T01:55:21.304 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.304 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.304 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.305 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.305 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.305 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.305 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.305 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "monitor device health metrics", 2024-08-20T01:55:21.305 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.305 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.305 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.305 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.305 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.305 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.305 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.305 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.305 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.306 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.306 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.306 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.306 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.306 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.306 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.306 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.306 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.306 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.306 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.306 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.306 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.306 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.307 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.307 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.307 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.307 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.307 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.307 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.307 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.307 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.307 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.307 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.308 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.308 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.308 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.308 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.308 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.308 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.308 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.308 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.308 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.308 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.308 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.308 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.308 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.309 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.309 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.309 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.309 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.309 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.309 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.309 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.309 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.309 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.309 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.309 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.310 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.310 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.310 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.310 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.310 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.310 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.310 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.310 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.310 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.310 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.310 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.310 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.311 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.311 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.311 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.311 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.311 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.311 INFO:teuthology.orchestra.run.smithi079.stdout: "mark_out_threshold": { 2024-08-20T01:55:21.311 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "mark_out_threshold", 2024-08-20T01:55:21.311 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:21.311 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.311 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.311 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "2419200", 2024-08-20T01:55:21.311 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.311 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.312 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.312 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-20T01:55:21.312 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.312 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.312 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.312 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.312 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": { 2024-08-20T01:55:21.312 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "pool_name", 2024-08-20T01:55:21.312 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.312 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.312 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.313 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "device_health_metrics", 2024-08-20T01:55:21.313 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.313 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.313 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.313 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-20T01:55:21.313 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.314 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.314 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.314 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.314 INFO:teuthology.orchestra.run.smithi079.stdout: "retention_period": { 2024-08-20T01:55:21.314 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "retention_period", 2024-08-20T01:55:21.314 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:21.314 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.315 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.315 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "15552000", 2024-08-20T01:55:21.315 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.315 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.315 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.315 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how long to retain device health metrics", 2024-08-20T01:55:21.315 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.315 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.315 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.316 INFO:teuthology.orchestra.run.smithi079.stdout: "scrape_frequency": { 2024-08-20T01:55:21.316 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "scrape_frequency", 2024-08-20T01:55:21.316 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:21.316 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.316 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.316 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "86400", 2024-08-20T01:55:21.316 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.316 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.316 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.316 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-20T01:55:21.316 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.316 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.316 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.317 INFO:teuthology.orchestra.run.smithi079.stdout: "self_heal": { 2024-08-20T01:55:21.317 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "self_heal", 2024-08-20T01:55:21.317 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.317 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.317 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.317 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.317 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.317 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.317 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.317 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-20T01:55:21.317 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.317 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.318 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.318 INFO:teuthology.orchestra.run.smithi079.stdout: "sleep_interval": { 2024-08-20T01:55:21.318 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sleep_interval", 2024-08-20T01:55:21.318 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:21.318 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.318 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.318 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "600", 2024-08-20T01:55:21.318 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.318 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.318 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.318 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how frequently to wake up and check device health", 2024-08-20T01:55:21.318 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.319 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.319 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.319 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.319 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.319 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.319 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.319 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.319 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.319 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.319 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.319 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.320 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.320 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.320 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.320 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.320 INFO:teuthology.orchestra.run.smithi079.stdout: "warn_threshold": { 2024-08-20T01:55:21.320 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "warn_threshold", 2024-08-20T01:55:21.320 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:21.320 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.321 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.321 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "7257600", 2024-08-20T01:55:21.321 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.321 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.321 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.321 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-20T01:55:21.321 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.321 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.321 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.321 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.321 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.321 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "diskprediction_local", 2024-08-20T01:55:21.322 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.322 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.322 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.322 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.322 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.322 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.322 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.322 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.322 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.322 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.322 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.322 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.322 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.323 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.323 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.323 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.323 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.323 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.323 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.323 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.323 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.323 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.323 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.323 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.323 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.324 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.324 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.324 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.324 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.324 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.324 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.324 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.324 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.324 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.324 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.324 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.324 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.324 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.325 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.325 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.325 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.325 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.325 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.325 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.325 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.325 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.325 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.325 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.326 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.326 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.326 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.326 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.326 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.326 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.326 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.326 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.326 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.326 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.326 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.326 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.326 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.327 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.327 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.327 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.327 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.327 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.327 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.327 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.327 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.327 INFO:teuthology.orchestra.run.smithi079.stdout: "predict_interval": { 2024-08-20T01:55:21.327 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "predict_interval", 2024-08-20T01:55:21.327 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.327 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.328 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.328 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "86400", 2024-08-20T01:55:21.328 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.328 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.328 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.328 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.328 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.328 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.328 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.328 INFO:teuthology.orchestra.run.smithi079.stdout: "predictor_model": { 2024-08-20T01:55:21.328 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "predictor_model", 2024-08-20T01:55:21.328 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.329 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.329 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.329 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "prophetstor", 2024-08-20T01:55:21.329 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.329 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.329 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.329 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.329 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.329 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.329 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.330 INFO:teuthology.orchestra.run.smithi079.stdout: "sleep_interval": { 2024-08-20T01:55:21.330 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sleep_interval", 2024-08-20T01:55:21.330 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.330 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.330 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.330 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "600", 2024-08-20T01:55:21.330 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.330 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.330 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.330 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.330 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.330 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.330 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.331 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.331 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.331 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.331 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.331 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.331 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.331 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.331 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.331 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.331 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.331 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.331 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.332 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.332 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.332 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.332 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "influx", 2024-08-20T01:55:21.332 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": false, 2024-08-20T01:55:21.332 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "influxdb python module not found", 2024-08-20T01:55:21.332 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.332 INFO:teuthology.orchestra.run.smithi079.stdout: "batch_size": { 2024-08-20T01:55:21.332 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "batch_size", 2024-08-20T01:55:21.332 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.332 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.332 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.333 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5000", 2024-08-20T01:55:21.333 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.333 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.333 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.333 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-20T01:55:21.333 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.333 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.333 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.333 INFO:teuthology.orchestra.run.smithi079.stdout: "database": { 2024-08-20T01:55:21.333 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "database", 2024-08-20T01:55:21.333 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.334 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.334 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.334 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "ceph", 2024-08-20T01:55:21.334 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.334 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.334 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.334 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-20T01:55:21.334 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.334 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.334 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.334 INFO:teuthology.orchestra.run.smithi079.stdout: "hostname": { 2024-08-20T01:55:21.334 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "hostname", 2024-08-20T01:55:21.335 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.335 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.335 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.335 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.335 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.335 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.335 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.335 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "InfluxDB server hostname", 2024-08-20T01:55:21.335 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.335 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.335 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.335 INFO:teuthology.orchestra.run.smithi079.stdout: "interval": { 2024-08-20T01:55:21.335 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "interval", 2024-08-20T01:55:21.336 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:21.336 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.336 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.336 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "30", 2024-08-20T01:55:21.336 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "5", 2024-08-20T01:55:21.336 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.336 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.336 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-20T01:55:21.336 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.336 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.336 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.337 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.337 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.337 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.337 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.337 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.337 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.337 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.337 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.337 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.337 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.337 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.337 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.337 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.337 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.338 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.338 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.338 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.338 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.338 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.338 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.338 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.338 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.338 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.338 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.338 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.339 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.339 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.339 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.339 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.339 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.339 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.339 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.339 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.339 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.339 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.340 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.340 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.340 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.340 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.340 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.340 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.340 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.340 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.340 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.340 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.340 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.340 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.341 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.341 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.341 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.341 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.341 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.341 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.341 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.341 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.341 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.341 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.341 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.341 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.341 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.342 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.342 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.342 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.342 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.342 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.342 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.342 INFO:teuthology.orchestra.run.smithi079.stdout: "password": { 2024-08-20T01:55:21.342 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "password", 2024-08-20T01:55:21.342 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.342 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.343 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.343 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.343 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.343 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.343 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.343 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "password of InfluxDB server user", 2024-08-20T01:55:21.343 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.343 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.343 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.343 INFO:teuthology.orchestra.run.smithi079.stdout: "port": { 2024-08-20T01:55:21.343 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "port", 2024-08-20T01:55:21.343 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.344 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.344 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.344 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "8086", 2024-08-20T01:55:21.344 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.344 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.344 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.344 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "InfluxDB server port", 2024-08-20T01:55:21.344 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.344 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.344 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.345 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.345 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.345 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.345 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.345 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.345 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.345 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.345 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.345 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.345 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.345 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.345 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.345 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.346 INFO:teuthology.orchestra.run.smithi079.stdout: "ssl": { 2024-08-20T01:55:21.346 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ssl", 2024-08-20T01:55:21.346 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.346 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.346 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.346 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "false", 2024-08-20T01:55:21.346 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.346 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.346 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.346 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-20T01:55:21.346 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.347 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.347 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.347 INFO:teuthology.orchestra.run.smithi079.stdout: "threads": { 2024-08-20T01:55:21.347 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "threads", 2024-08-20T01:55:21.347 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.347 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.347 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.347 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5", 2024-08-20T01:55:21.347 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "1", 2024-08-20T01:55:21.347 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "32", 2024-08-20T01:55:21.347 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.347 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-20T01:55:21.348 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.348 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.348 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.348 INFO:teuthology.orchestra.run.smithi079.stdout: "username": { 2024-08-20T01:55:21.348 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "username", 2024-08-20T01:55:21.348 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.348 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.348 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.348 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.348 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.348 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.349 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.349 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "username of InfluxDB server user", 2024-08-20T01:55:21.349 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.349 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.349 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.349 INFO:teuthology.orchestra.run.smithi079.stdout: "verify_ssl": { 2024-08-20T01:55:21.349 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "verify_ssl", 2024-08-20T01:55:21.349 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.349 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.349 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.349 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "true", 2024-08-20T01:55:21.350 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.350 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.350 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.350 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-20T01:55:21.350 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.350 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.350 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.350 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.350 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.351 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "insights", 2024-08-20T01:55:21.351 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.351 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.351 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.351 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.351 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.351 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.351 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.351 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.351 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.351 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.351 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.352 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.352 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.352 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.352 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.352 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.352 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.352 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.352 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.352 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.352 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.352 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.352 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.352 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.353 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.353 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.353 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.353 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.353 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.353 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.353 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.353 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.353 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.353 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.353 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.353 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.354 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.354 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.354 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.354 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.354 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.354 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.354 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.354 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.354 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.354 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.354 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.355 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.355 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.355 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.355 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.355 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.355 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.355 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.355 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.355 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.355 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.355 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.356 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.356 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.356 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.356 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.356 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.356 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.356 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.356 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.356 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.356 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.356 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.357 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.357 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.357 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.357 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.357 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.357 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.357 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.357 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.357 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.357 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.357 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.357 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.357 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.358 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.358 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.358 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "iostat", 2024-08-20T01:55:21.358 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.358 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.358 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.358 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.358 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.358 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.358 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.359 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.359 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.359 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.359 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.359 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.359 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.359 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.359 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.359 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.359 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.359 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.359 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.360 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.360 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.360 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.360 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.360 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.360 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.360 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.360 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.360 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.360 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.360 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.360 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.361 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.361 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.361 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.361 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.361 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.361 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.361 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.361 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.361 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.361 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.361 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.361 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.362 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.362 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.362 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.362 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.362 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.362 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.362 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.362 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.362 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.362 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.362 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.362 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.363 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.363 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.363 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.363 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.363 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.363 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.363 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.363 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.363 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.363 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.364 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.364 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.364 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.364 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.364 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.364 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.364 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.364 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.364 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.364 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.364 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.365 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.365 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.365 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.365 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.365 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.365 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.365 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.365 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.366 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "k8sevents", 2024-08-20T01:55:21.366 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.366 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.366 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.366 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_event_retention_days": { 2024-08-20T01:55:21.366 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ceph_event_retention_days", 2024-08-20T01:55:21.366 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.366 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.366 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.366 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "7", 2024-08-20T01:55:21.366 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.366 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.367 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.367 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-20T01:55:21.367 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.367 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.367 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.367 INFO:teuthology.orchestra.run.smithi079.stdout: "config_check_secs": { 2024-08-20T01:55:21.367 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "config_check_secs", 2024-08-20T01:55:21.367 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.367 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.367 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.367 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-08-20T01:55:21.368 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "10", 2024-08-20T01:55:21.368 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.368 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.368 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-20T01:55:21.368 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.368 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.368 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.368 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.368 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.368 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.368 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.368 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.369 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.369 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.369 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.369 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.369 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.369 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.369 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.369 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.369 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.369 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.369 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.369 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.369 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.370 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.370 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.370 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.370 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.370 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.370 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.370 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.370 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.370 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.370 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.370 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.370 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.371 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.371 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.371 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.371 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.371 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.371 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.371 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.371 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.371 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.371 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.371 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.371 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.371 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.372 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.372 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.372 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.372 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.372 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.372 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.372 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.372 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.372 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.372 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.372 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.372 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.373 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.373 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.373 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.373 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.373 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.373 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.373 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.373 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.373 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.373 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.373 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.373 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.374 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.374 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.374 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.374 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.374 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.374 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.374 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.374 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.374 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.374 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.375 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.375 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.375 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.375 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.375 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "localpool", 2024-08-20T01:55:21.375 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.375 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.375 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.376 INFO:teuthology.orchestra.run.smithi079.stdout: "failure_domain": { 2024-08-20T01:55:21.376 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "failure_domain", 2024-08-20T01:55:21.376 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.376 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.376 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.376 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "host", 2024-08-20T01:55:21.376 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.376 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.376 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.376 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "failure domain for any created local pool", 2024-08-20T01:55:21.376 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-20T01:55:21.377 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.377 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.377 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.377 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.377 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.377 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.377 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.377 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.377 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.378 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.378 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.378 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.378 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.378 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.378 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.378 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.378 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.378 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.379 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.379 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.379 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.379 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.379 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.379 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.379 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.379 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.379 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.379 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.380 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.380 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.380 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.380 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.380 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.380 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.380 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.380 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.380 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.380 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.380 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.380 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.381 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.381 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.381 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.381 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.381 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.381 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.381 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.381 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.381 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.381 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.381 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.381 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.382 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.382 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.382 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.382 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.382 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.382 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.382 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.382 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.382 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.382 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.382 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.382 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.383 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.383 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.383 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.383 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.383 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": { 2024-08-20T01:55:21.383 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "min_size", 2024-08-20T01:55:21.383 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.383 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.383 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.383 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.383 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.384 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.384 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.384 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "default min_size for any created local pool", 2024-08-20T01:55:21.384 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-20T01:55:21.384 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.384 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.384 INFO:teuthology.orchestra.run.smithi079.stdout: "num_rep": { 2024-08-20T01:55:21.384 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "num_rep", 2024-08-20T01:55:21.384 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.384 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.384 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.385 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "3", 2024-08-20T01:55:21.385 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.385 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.385 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.385 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "default replica count for any created local pool", 2024-08-20T01:55:21.385 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.385 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.385 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.385 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": { 2024-08-20T01:55:21.385 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "pg_num", 2024-08-20T01:55:21.385 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.385 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.386 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.386 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "128", 2024-08-20T01:55:21.386 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.386 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.386 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.386 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "default pg_num for any created local pool", 2024-08-20T01:55:21.386 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.386 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.386 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.386 INFO:teuthology.orchestra.run.smithi079.stdout: "prefix": { 2024-08-20T01:55:21.386 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "prefix", 2024-08-20T01:55:21.386 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.387 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.387 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.387 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.387 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.387 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.387 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.387 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "name prefix for any created local pool", 2024-08-20T01:55:21.387 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.387 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.387 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.387 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.388 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.388 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.388 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.388 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.388 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.388 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.388 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.388 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.388 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.388 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.388 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.388 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.389 INFO:teuthology.orchestra.run.smithi079.stdout: "subtree": { 2024-08-20T01:55:21.389 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "subtree", 2024-08-20T01:55:21.389 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.389 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.389 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.389 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "rack", 2024-08-20T01:55:21.389 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.389 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.389 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.389 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-20T01:55:21.389 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-20T01:55:21.389 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.389 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.390 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.390 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.390 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "mds_autoscaler", 2024-08-20T01:55:21.390 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.390 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.390 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.390 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.390 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.390 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.390 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.390 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.391 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.391 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.391 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.391 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.391 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.391 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.391 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.391 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.391 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.391 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.391 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.391 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.392 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.392 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.392 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.392 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.392 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.392 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.392 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.392 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.392 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.392 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.392 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.392 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.393 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.393 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.393 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.393 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.393 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.393 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.393 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.393 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.393 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.393 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.393 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.394 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.394 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.394 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.394 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.394 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.394 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.394 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.394 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.394 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.394 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.394 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.395 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.395 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.395 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.395 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.395 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.395 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.395 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.395 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.395 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.395 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.395 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "mirroring", 2024-08-20T01:55:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.398 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.398 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.398 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.398 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.398 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.398 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.398 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.398 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.398 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.398 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.398 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.398 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.399 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.399 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.399 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.399 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.399 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.399 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.399 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.399 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.399 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.399 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.399 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.399 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.400 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.400 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.400 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.400 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.400 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.400 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.400 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.400 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.400 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.400 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.400 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.400 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.401 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.401 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.401 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.401 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.401 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.401 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.401 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.401 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.401 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.401 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.401 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.401 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.402 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.402 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.402 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.402 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.402 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.402 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.402 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.402 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.402 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.402 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.402 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.402 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.403 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.403 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.403 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.403 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.403 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.403 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.403 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.403 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.403 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.403 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.403 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.404 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.404 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.404 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.404 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.404 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.404 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.404 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.404 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.404 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.404 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.404 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.404 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.405 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "nfs", 2024-08-20T01:55:21.405 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.405 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.405 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.405 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.405 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.405 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.405 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.405 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.405 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.405 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.406 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.406 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.406 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.406 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.406 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.406 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.406 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.406 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.406 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.406 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.406 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.406 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.407 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.407 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.407 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.407 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.407 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.407 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.407 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.407 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.407 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.407 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.407 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.408 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.408 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.408 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.408 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.408 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.408 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.408 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.408 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.409 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.409 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.409 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.409 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.409 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.409 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.409 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.409 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.409 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.409 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.409 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.410 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.410 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.410 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.410 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.410 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.410 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.410 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.410 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.410 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.410 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.411 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.411 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.411 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.411 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.411 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.411 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.411 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.411 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.411 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.411 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.411 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.411 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.412 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.412 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.412 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.412 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.412 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.412 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.412 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.412 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.412 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.412 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.413 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "orchestrator", 2024-08-20T01:55:21.413 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.413 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.413 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.413 INFO:teuthology.orchestra.run.smithi079.stdout: "fail_fs": { 2024-08-20T01:55:21.413 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "fail_fs", 2024-08-20T01:55:21.413 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.413 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.413 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.414 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.414 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.414 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.414 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.414 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-20T01:55:21.415 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.415 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.415 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.415 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.415 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.415 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.415 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.415 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.415 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.416 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.416 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.416 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.416 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.416 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.416 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.416 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.416 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.416 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.417 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.417 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.417 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.417 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.417 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.417 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.417 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.417 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.417 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.417 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.417 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.418 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.418 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.418 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.418 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.418 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.418 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.418 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.418 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.418 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.418 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.419 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.419 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.419 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.419 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.419 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.419 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.419 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.419 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.419 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.419 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.419 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.419 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.419 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.419 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.420 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.420 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.420 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.420 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.420 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.420 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.420 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.420 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.420 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.420 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.421 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.421 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.421 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.421 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.421 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.421 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.421 INFO:teuthology.orchestra.run.smithi079.stdout: "orchestrator": { 2024-08-20T01:55:21.421 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "orchestrator", 2024-08-20T01:55:21.422 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.422 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.422 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.422 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.422 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.422 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.422 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.422 INFO:teuthology.orchestra.run.smithi079.stdout: "cephadm", 2024-08-20T01:55:21.422 INFO:teuthology.orchestra.run.smithi079.stdout: "rook", 2024-08-20T01:55:21.422 INFO:teuthology.orchestra.run.smithi079.stdout: "test_orchestrator" 2024-08-20T01:55:21.422 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.422 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Orchestrator backend", 2024-08-20T01:55:21.423 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.423 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.423 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.423 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.423 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.423 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.423 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.423 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.423 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.423 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.423 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.424 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.424 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.424 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.424 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.424 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.424 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.424 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.424 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "osd_perf_query", 2024-08-20T01:55:21.425 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.425 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.425 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.425 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.425 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.425 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.425 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.426 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.426 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.426 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.426 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.426 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.427 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.427 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.427 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.427 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.427 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.427 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.427 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.427 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.427 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.427 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.428 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.428 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.428 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.428 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.428 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.428 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.428 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.428 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.428 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.428 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.428 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.428 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.429 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.429 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.429 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.429 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.429 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.429 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.429 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.429 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.429 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.429 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.429 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.430 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.430 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.430 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.430 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.430 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.430 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.430 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.430 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.430 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.430 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.430 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.431 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.431 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.431 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.431 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.431 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.431 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.431 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.431 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.431 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.431 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.431 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.431 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.431 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.432 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.432 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.432 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.432 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.432 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.432 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.432 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.432 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.432 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.432 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.432 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.433 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.433 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.433 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.433 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.433 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "osd_support", 2024-08-20T01:55:21.433 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.433 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.433 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.433 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.433 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.433 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.434 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.434 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.434 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.434 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.434 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.434 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.434 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.434 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.434 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.434 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.434 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.434 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.435 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.435 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.435 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.435 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.435 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.435 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.435 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.435 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.435 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.435 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.435 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.435 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.436 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.436 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.436 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.436 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.436 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.436 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.436 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.436 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.436 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.436 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.436 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.436 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.437 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.437 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.437 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.437 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.437 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.437 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.437 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.437 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.437 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.437 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.437 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.437 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.437 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.438 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.438 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.438 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.438 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.438 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.438 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.438 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.438 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.438 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.438 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.438 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.439 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.439 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.439 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.439 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.439 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.439 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.439 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.439 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.439 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.440 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.440 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.440 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.440 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.440 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.440 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.440 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.440 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.440 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.440 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "pg_autoscaler", 2024-08-20T01:55:21.441 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.441 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.441 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.441 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.441 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.441 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.441 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.441 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.441 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.441 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.441 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.441 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.441 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.442 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.442 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.442 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.442 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.442 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.442 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.442 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.442 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.442 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.442 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.442 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.443 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.443 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.443 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.443 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.443 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.443 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.443 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.443 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.443 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.443 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.443 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.444 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.444 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.444 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.444 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.444 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.444 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.444 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.444 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.444 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.444 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.444 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.445 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.445 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.445 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.445 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.445 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.445 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.445 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.445 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.445 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.445 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.446 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.446 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.446 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.446 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.446 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.446 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.446 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.446 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.446 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.446 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.446 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.446 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.447 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.447 INFO:teuthology.orchestra.run.smithi079.stdout: "sleep_interval": { 2024-08-20T01:55:21.447 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sleep_interval", 2024-08-20T01:55:21.447 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:21.447 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.447 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.447 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "60", 2024-08-20T01:55:21.447 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.447 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.447 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.447 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.448 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.448 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.448 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.448 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.448 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.448 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.448 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.448 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.448 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.448 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.448 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.448 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.449 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.449 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.449 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.449 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.449 INFO:teuthology.orchestra.run.smithi079.stdout: "threshold": { 2024-08-20T01:55:21.449 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "threshold", 2024-08-20T01:55:21.449 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2024-08-20T01:55:21.449 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.449 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.449 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "3.0", 2024-08-20T01:55:21.449 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "1.0", 2024-08-20T01:55:21.450 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.450 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.450 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "scaling threshold", 2024-08-20T01:55:21.450 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-20T01:55:21.450 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.450 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.450 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.450 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.450 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "progress", 2024-08-20T01:55:21.450 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.451 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.451 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.451 INFO:teuthology.orchestra.run.smithi079.stdout: "allow_pg_recovery_event": { 2024-08-20T01:55:21.451 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "allow_pg_recovery_event", 2024-08-20T01:55:21.451 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.451 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.451 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.451 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.451 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.451 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.451 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.451 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-20T01:55:21.452 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.452 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.452 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.452 INFO:teuthology.orchestra.run.smithi079.stdout: "enabled": { 2024-08-20T01:55:21.452 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "enabled", 2024-08-20T01:55:21.452 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.452 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.452 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.452 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.452 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.452 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.452 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.453 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.453 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.453 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.453 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.453 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.453 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.453 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.453 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.453 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.453 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.453 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.454 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.454 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.454 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.454 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.454 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.454 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.454 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.454 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.454 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.454 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.454 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.455 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.455 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.455 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.455 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.455 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.455 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.455 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.455 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.455 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.455 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.455 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.456 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.456 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.456 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.456 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.456 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.456 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.456 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.456 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.456 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.456 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.456 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.457 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.457 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.457 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.457 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.457 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.457 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.457 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.457 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.457 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.457 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.457 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.457 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.458 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.458 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.458 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.458 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.458 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.458 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.458 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.458 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.458 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.458 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.458 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.459 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.459 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.459 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.459 INFO:teuthology.orchestra.run.smithi079.stdout: "max_completed_events": { 2024-08-20T01:55:21.459 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "max_completed_events", 2024-08-20T01:55:21.459 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.459 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.459 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.459 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "50", 2024-08-20T01:55:21.459 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.460 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.460 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.460 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "number of past completed events to remember", 2024-08-20T01:55:21.460 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.460 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.460 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.460 INFO:teuthology.orchestra.run.smithi079.stdout: "sleep_interval": { 2024-08-20T01:55:21.460 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sleep_interval", 2024-08-20T01:55:21.460 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:21.460 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.460 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.461 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5", 2024-08-20T01:55:21.461 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.461 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.461 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.461 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how long the module is going to sleep", 2024-08-20T01:55:21.461 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.461 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.461 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.461 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.461 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.461 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.462 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.462 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.462 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.462 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.462 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.462 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.462 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.462 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.462 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.462 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.462 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.463 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.463 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "prometheus", 2024-08-20T01:55:21.463 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.463 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.463 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.463 INFO:teuthology.orchestra.run.smithi079.stdout: "cache": { 2024-08-20T01:55:21.463 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "cache", 2024-08-20T01:55:21.463 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.463 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.463 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.464 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.464 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.464 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.464 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.464 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.464 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.464 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.464 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.464 INFO:teuthology.orchestra.run.smithi079.stdout: "exclude_perf_counters": { 2024-08-20T01:55:21.464 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "exclude_perf_counters", 2024-08-20T01:55:21.464 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.465 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.465 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.465 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.465 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.465 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.465 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.465 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-20T01:55:21.465 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-20T01:55:21.465 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.465 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.465 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.466 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.466 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.466 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.466 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.466 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.466 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.466 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.466 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.466 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.467 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.467 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.467 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.467 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.467 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.467 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.467 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.467 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.467 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.467 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.467 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.468 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.468 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.468 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.468 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.468 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.468 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.468 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.468 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.468 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.468 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.468 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.468 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.469 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.469 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.469 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.469 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.469 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.469 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.469 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.469 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.469 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.469 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.469 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.469 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.470 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.470 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.470 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.470 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.470 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.470 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.470 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.470 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.470 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.471 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.471 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.471 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.471 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.471 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.471 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.471 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.471 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.471 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.471 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.471 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.471 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.472 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_stats_pools": { 2024-08-20T01:55:21.472 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rbd_stats_pools", 2024-08-20T01:55:21.472 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.472 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.472 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.472 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.472 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.472 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.472 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.472 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.472 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.472 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.472 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.473 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-20T01:55:21.473 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-20T01:55:21.473 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.473 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.473 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.473 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "300", 2024-08-20T01:55:21.473 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.473 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.473 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.473 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.473 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.473 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.474 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.474 INFO:teuthology.orchestra.run.smithi079.stdout: "scrape_interval": { 2024-08-20T01:55:21.474 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "scrape_interval", 2024-08-20T01:55:21.474 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2024-08-20T01:55:21.474 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.474 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.474 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "15.0", 2024-08-20T01:55:21.474 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.474 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.474 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.475 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.475 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.475 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.475 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.475 INFO:teuthology.orchestra.run.smithi079.stdout: "server_addr": { 2024-08-20T01:55:21.475 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_addr", 2024-08-20T01:55:21.475 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.475 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.475 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.476 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "::", 2024-08-20T01:55:21.476 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.476 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.476 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.476 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-20T01:55:21.476 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.476 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.476 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.476 INFO:teuthology.orchestra.run.smithi079.stdout: "server_port": { 2024-08-20T01:55:21.476 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_port", 2024-08-20T01:55:21.476 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.477 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.477 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.477 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "9283", 2024-08-20T01:55:21.477 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.477 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.477 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.477 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-20T01:55:21.477 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.477 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.478 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.478 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.478 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.478 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.478 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.478 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.478 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.478 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.478 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.478 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.479 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.479 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.479 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.479 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.479 INFO:teuthology.orchestra.run.smithi079.stdout: "stale_cache_strategy": { 2024-08-20T01:55:21.479 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "stale_cache_strategy", 2024-08-20T01:55:21.479 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.479 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.479 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.480 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "log", 2024-08-20T01:55:21.480 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.480 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.480 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.480 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.480 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.480 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.480 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.480 INFO:teuthology.orchestra.run.smithi079.stdout: "standby_behaviour": { 2024-08-20T01:55:21.480 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "standby_behaviour", 2024-08-20T01:55:21.480 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.480 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.481 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.481 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "default", 2024-08-20T01:55:21.481 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.481 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.481 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.481 INFO:teuthology.orchestra.run.smithi079.stdout: "default", 2024-08-20T01:55:21.481 INFO:teuthology.orchestra.run.smithi079.stdout: "error" 2024-08-20T01:55:21.481 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.481 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.481 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.481 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.481 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.482 INFO:teuthology.orchestra.run.smithi079.stdout: "standby_error_status_code": { 2024-08-20T01:55:21.482 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "standby_error_status_code", 2024-08-20T01:55:21.482 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.482 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.482 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.482 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "500", 2024-08-20T01:55:21.482 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "400", 2024-08-20T01:55:21.482 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "599", 2024-08-20T01:55:21.482 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.482 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.482 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.482 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.483 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.483 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.483 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.483 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rbd_support", 2024-08-20T01:55:21.483 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.483 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.483 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.483 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.484 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.484 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.484 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.484 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.484 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.484 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.484 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.484 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.484 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.484 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.484 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.484 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.484 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.484 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.485 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.485 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.485 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.485 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.485 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.485 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.485 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.485 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.485 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.485 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.485 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.486 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.486 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.486 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.486 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.486 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.486 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.486 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.486 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.486 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.486 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.486 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.487 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.487 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.487 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.487 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.487 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.487 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.487 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.487 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.487 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.487 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.487 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.487 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.487 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.488 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.488 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.488 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.488 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.488 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.488 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.488 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.488 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.488 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.488 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.488 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.489 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.489 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.489 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.489 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.489 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.489 INFO:teuthology.orchestra.run.smithi079.stdout: "max_concurrent_snap_create": { 2024-08-20T01:55:21.489 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "max_concurrent_snap_create", 2024-08-20T01:55:21.489 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.489 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.489 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.489 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-08-20T01:55:21.489 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.490 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.490 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.490 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.490 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.490 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.490 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.490 INFO:teuthology.orchestra.run.smithi079.stdout: "mirror_snapshot_schedule": { 2024-08-20T01:55:21.490 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "mirror_snapshot_schedule", 2024-08-20T01:55:21.490 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.490 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.490 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.491 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.491 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.491 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.491 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.491 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.491 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.491 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.491 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.491 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.491 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.491 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.491 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.492 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.492 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.492 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.492 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.492 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.492 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.492 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.492 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.492 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.492 INFO:teuthology.orchestra.run.smithi079.stdout: "trash_purge_schedule": { 2024-08-20T01:55:21.492 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "trash_purge_schedule", 2024-08-20T01:55:21.492 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.493 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.493 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.493 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.493 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.493 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.493 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.493 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.493 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.493 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.493 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.493 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.493 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.494 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "restful", 2024-08-20T01:55:21.494 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.494 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.494 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.494 INFO:teuthology.orchestra.run.smithi079.stdout: "enable_auth": { 2024-08-20T01:55:21.494 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "enable_auth", 2024-08-20T01:55:21.494 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.494 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.494 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.494 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.494 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.494 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.495 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.495 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.495 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.495 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.495 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.495 INFO:teuthology.orchestra.run.smithi079.stdout: "key_file": { 2024-08-20T01:55:21.495 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "key_file", 2024-08-20T01:55:21.495 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.495 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.495 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.496 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.496 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.496 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.496 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.496 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.496 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.496 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.496 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.496 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.496 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.496 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.496 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.497 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.497 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.497 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.497 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.497 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.497 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.497 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.497 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.497 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.497 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.497 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.497 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.498 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.498 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.498 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.498 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.498 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.498 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.498 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.498 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.498 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.498 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.498 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.499 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.499 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.499 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.499 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.499 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.499 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.499 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.499 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.499 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.499 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.499 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.499 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.499 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.500 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.500 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.500 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.500 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.500 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.500 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.500 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.500 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.500 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.500 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.500 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.500 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.500 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.501 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.501 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.501 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.501 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.501 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.501 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.501 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.501 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.501 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.501 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.501 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.501 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.502 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.502 INFO:teuthology.orchestra.run.smithi079.stdout: "server_addr": { 2024-08-20T01:55:21.502 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_addr", 2024-08-20T01:55:21.502 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.502 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.502 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.502 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.502 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.502 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.502 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.502 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.503 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.503 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.503 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.503 INFO:teuthology.orchestra.run.smithi079.stdout: "server_port": { 2024-08-20T01:55:21.503 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_port", 2024-08-20T01:55:21.503 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.503 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.503 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.503 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.503 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.504 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.504 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.504 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.504 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.504 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.504 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.504 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.504 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.504 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.504 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.504 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.505 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.505 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.505 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.505 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.505 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.505 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.505 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.505 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.505 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.505 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.505 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rgw", 2024-08-20T01:55:21.506 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.506 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.506 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.506 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.506 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.506 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.506 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.506 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.506 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.506 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.506 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.507 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.507 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.507 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.507 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.507 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.507 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.507 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.507 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.507 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.508 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.508 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.508 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.508 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.508 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.508 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.508 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.508 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.508 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.508 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.509 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.509 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.509 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.509 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.509 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.509 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.509 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.509 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.509 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.510 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.510 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.510 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.510 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.510 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.510 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.510 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.510 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.510 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.510 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.511 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.511 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.511 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.511 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.511 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.511 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.511 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.511 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.511 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.511 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.511 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.511 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.512 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.512 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.512 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.512 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.512 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.512 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.512 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.512 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.512 INFO:teuthology.orchestra.run.smithi079.stdout: "secondary_zone_period_retry_limit": { 2024-08-20T01:55:21.512 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "secondary_zone_period_retry_limit", 2024-08-20T01:55:21.512 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.513 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.513 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.513 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5", 2024-08-20T01:55:21.513 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.513 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.513 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.513 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-08-20T01:55:21.513 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.513 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.513 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.513 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.514 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.514 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.514 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.514 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.514 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.514 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.514 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.514 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.514 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.515 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.515 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.515 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.515 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.515 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.516 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rook", 2024-08-20T01:55:21.516 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.516 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.516 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.516 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.516 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.517 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.517 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.517 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.517 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.517 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.517 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.517 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.517 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.517 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.517 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.517 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.517 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.518 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.518 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.518 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.518 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.518 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.518 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.518 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.518 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.518 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.518 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.519 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.519 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.519 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.519 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.519 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.519 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.519 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.519 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.519 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.519 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.519 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.520 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.520 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.520 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.520 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.520 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.520 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.520 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.520 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.520 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.520 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.520 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.520 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.521 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.521 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.521 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.521 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.521 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.521 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.521 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.522 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.522 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.522 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.522 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.522 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.522 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.522 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.522 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.522 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.522 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.522 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.522 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.523 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.523 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.523 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.523 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.523 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.523 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.523 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.523 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.523 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.523 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.523 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.523 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.524 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.524 INFO:teuthology.orchestra.run.smithi079.stdout: "storage_class": { 2024-08-20T01:55:21.524 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "storage_class", 2024-08-20T01:55:21.524 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.524 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.524 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.524 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "local", 2024-08-20T01:55:21.524 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.524 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.524 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.524 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-20T01:55:21.524 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.525 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.525 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.525 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.525 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.525 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "selftest", 2024-08-20T01:55:21.525 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.525 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.525 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.525 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.526 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.526 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.526 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.526 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.526 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.526 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.526 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.526 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.526 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.526 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.527 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.527 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.527 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.527 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.527 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.527 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.527 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.527 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.527 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.527 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.528 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.528 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.528 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.528 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.528 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.528 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.528 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.528 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.528 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.528 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.528 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.528 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.529 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.529 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.529 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.529 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.529 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.529 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.529 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.529 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.529 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.529 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.529 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.530 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.530 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.530 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.530 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.530 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.530 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.530 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.530 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.530 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.530 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.530 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.531 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.531 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.531 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.531 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.531 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.531 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.531 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.531 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.531 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.531 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.531 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.532 INFO:teuthology.orchestra.run.smithi079.stdout: "roption1": { 2024-08-20T01:55:21.532 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "roption1", 2024-08-20T01:55:21.532 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.532 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.532 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.532 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.532 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.532 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.532 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.532 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.532 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.532 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.533 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.533 INFO:teuthology.orchestra.run.smithi079.stdout: "roption2": { 2024-08-20T01:55:21.533 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "roption2", 2024-08-20T01:55:21.533 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.533 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.533 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.533 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "xyz", 2024-08-20T01:55:21.533 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.533 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.533 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.533 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.533 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.534 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.534 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.534 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption1": { 2024-08-20T01:55:21.534 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption1", 2024-08-20T01:55:21.534 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.534 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.534 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.534 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.534 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.534 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.534 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.534 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.535 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.535 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.535 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.535 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption2": { 2024-08-20T01:55:21.535 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption2", 2024-08-20T01:55:21.535 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.535 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.535 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.535 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.535 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.535 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.535 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.535 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.536 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.536 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.536 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.536 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption3": { 2024-08-20T01:55:21.536 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption3", 2024-08-20T01:55:21.536 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2024-08-20T01:55:21.536 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.536 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.536 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.536 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.536 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.537 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.537 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.537 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.537 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.537 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.537 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption4": { 2024-08-20T01:55:21.537 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption4", 2024-08-20T01:55:21.537 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.537 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.537 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.537 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.538 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.538 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.538 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.538 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.538 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.538 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.538 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.538 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption5": { 2024-08-20T01:55:21.538 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption5", 2024-08-20T01:55:21.538 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.538 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.539 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.539 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.539 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.539 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.539 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.539 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.539 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.539 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.539 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.540 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption6": { 2024-08-20T01:55:21.540 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption6", 2024-08-20T01:55:21.540 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.540 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.540 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.540 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.540 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.540 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.540 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.540 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.540 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.540 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.540 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.541 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption7": { 2024-08-20T01:55:21.541 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption7", 2024-08-20T01:55:21.541 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.541 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.541 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.541 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.541 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "1", 2024-08-20T01:55:21.541 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "42", 2024-08-20T01:55:21.541 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.541 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.541 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.542 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.542 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.542 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.542 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.543 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.543 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.543 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.543 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.543 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.544 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.544 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.544 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.544 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.544 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.544 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.544 INFO:teuthology.orchestra.run.smithi079.stdout: "testkey": { 2024-08-20T01:55:21.544 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "testkey", 2024-08-20T01:55:21.544 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.545 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.545 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.545 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.545 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.545 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.545 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.545 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.545 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.545 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.545 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.546 INFO:teuthology.orchestra.run.smithi079.stdout: "testlkey": { 2024-08-20T01:55:21.546 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "testlkey", 2024-08-20T01:55:21.546 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.546 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.546 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.546 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.546 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.546 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.546 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.546 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.546 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.547 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.547 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.547 INFO:teuthology.orchestra.run.smithi079.stdout: "testnewline": { 2024-08-20T01:55:21.547 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "testnewline", 2024-08-20T01:55:21.547 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.547 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.547 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.547 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.547 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.547 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.547 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.547 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.547 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.548 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.548 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.548 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.548 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.548 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smb", 2024-08-20T01:55:21.548 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.548 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.548 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.548 INFO:teuthology.orchestra.run.smithi079.stdout: "internal_store_backend": { 2024-08-20T01:55:21.548 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "internal_store_backend", 2024-08-20T01:55:21.548 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.549 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.549 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.549 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.549 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.549 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.549 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.549 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-08-20T01:55:21.549 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.549 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.549 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.549 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.550 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.550 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.550 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.550 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.550 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.550 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.550 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.550 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.550 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.550 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.550 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.550 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.551 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.551 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.551 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.551 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.551 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.551 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.551 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.551 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.551 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.551 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.551 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.551 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.551 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.552 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.552 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.552 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.552 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.552 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.552 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.552 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.552 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.552 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.553 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.553 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.553 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.553 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.553 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.553 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.553 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.553 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.553 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.553 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.553 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.554 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.554 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.554 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.554 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.554 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.554 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.554 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.554 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.554 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.554 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.554 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.554 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.555 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.555 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.555 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.555 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.555 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.555 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.555 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.555 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.555 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.555 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.555 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.555 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.555 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.556 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.556 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.556 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.556 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.556 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.556 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.556 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.556 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.556 INFO:teuthology.orchestra.run.smithi079.stdout: "update_orchestration": { 2024-08-20T01:55:21.556 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "update_orchestration", 2024-08-20T01:55:21.556 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.556 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.556 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.557 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.557 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.557 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.557 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.557 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-08-20T01:55:21.557 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.557 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.557 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.557 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.557 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.557 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "snap_schedule", 2024-08-20T01:55:21.558 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.558 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.558 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.558 INFO:teuthology.orchestra.run.smithi079.stdout: "allow_m_granularity": { 2024-08-20T01:55:21.558 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "allow_m_granularity", 2024-08-20T01:55:21.558 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.558 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.558 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.558 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.558 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.558 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.558 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.558 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "allow minute scheduled snapshots", 2024-08-20T01:55:21.559 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.559 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.559 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.559 INFO:teuthology.orchestra.run.smithi079.stdout: "dump_on_update": { 2024-08-20T01:55:21.559 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "dump_on_update", 2024-08-20T01:55:21.559 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.559 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.559 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.559 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.559 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.559 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.559 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.560 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "dump database to debug log on update", 2024-08-20T01:55:21.560 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.560 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.560 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.560 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.560 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.560 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.560 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.560 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.560 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.560 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.561 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.561 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.561 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.561 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.561 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.561 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.561 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.561 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.561 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.561 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.561 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.561 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.561 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.562 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.562 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.562 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.562 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.562 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.562 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.562 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.562 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.562 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.562 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.562 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.562 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.563 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.563 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.563 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.563 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.563 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.563 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.563 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.563 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.563 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.563 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.563 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.563 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.564 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.564 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.564 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.564 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.564 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.564 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.564 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.564 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.565 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.565 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.565 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.565 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.565 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.565 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.565 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.565 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.565 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.565 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.565 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.566 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.566 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.566 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.566 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.566 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.566 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.566 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.566 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.567 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.567 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.567 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.567 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.567 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.567 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.567 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.567 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.567 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.567 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.567 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.568 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "stats", 2024-08-20T01:55:21.568 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.568 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.568 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.568 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.568 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.568 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.568 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.568 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.568 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.568 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.568 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.568 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.569 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.569 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.569 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.569 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.569 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.569 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.569 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.569 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.569 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.569 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.569 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.569 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.570 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.570 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.570 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.570 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.570 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.570 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.570 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.570 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.570 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.570 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.571 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.571 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.571 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.571 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.571 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.571 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.571 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.571 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.571 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.571 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.571 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.571 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.572 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.572 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.572 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.572 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.572 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.572 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.572 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.572 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.572 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.572 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.572 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.572 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.572 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.573 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.573 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.573 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.573 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.573 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.573 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.573 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.573 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.573 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.573 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.573 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.573 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.574 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.574 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.574 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.574 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.574 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.574 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.574 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.574 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.574 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.574 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.574 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.575 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.575 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.575 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "status", 2024-08-20T01:55:21.575 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.575 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.575 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.575 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.575 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.575 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.575 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.575 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.575 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.576 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.576 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.576 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.576 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.576 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.576 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.576 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.576 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.577 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.577 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.577 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.577 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.577 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.577 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.577 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.577 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.577 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.577 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.578 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.578 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.578 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.578 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.578 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.578 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.578 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.578 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.578 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.578 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.579 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.579 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.579 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.579 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.579 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.579 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.579 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.579 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.579 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.580 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.580 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.580 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.580 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.580 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.580 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.580 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.580 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.580 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.580 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.580 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.580 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.580 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.581 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.581 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.581 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.581 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.581 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.581 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.581 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.581 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.581 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.581 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.581 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.581 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.582 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.582 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.582 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.582 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.582 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.582 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.582 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.582 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.582 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.582 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.582 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.582 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.582 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.583 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "telegraf", 2024-08-20T01:55:21.583 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.583 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.583 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.583 INFO:teuthology.orchestra.run.smithi079.stdout: "address": { 2024-08-20T01:55:21.583 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "address", 2024-08-20T01:55:21.583 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.583 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.583 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.583 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-20T01:55:21.584 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.584 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.584 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.584 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.584 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.584 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.584 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.584 INFO:teuthology.orchestra.run.smithi079.stdout: "interval": { 2024-08-20T01:55:21.584 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "interval", 2024-08-20T01:55:21.584 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:21.584 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.584 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.585 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "15", 2024-08-20T01:55:21.585 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.585 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.585 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.585 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.585 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.585 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.585 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.585 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.585 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.585 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.585 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.585 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.586 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.586 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.586 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.586 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.586 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.586 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.586 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.586 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.586 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.586 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.586 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.586 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.586 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.587 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.587 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.587 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.587 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.587 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.587 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.587 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.587 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.587 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.587 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.587 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.588 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.588 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.588 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.588 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.588 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.588 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.588 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.588 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.588 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.588 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.588 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.589 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.589 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.589 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.589 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.589 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.589 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.589 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.589 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.589 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.589 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.589 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.589 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.589 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.590 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.590 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.590 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.590 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.590 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.590 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.590 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.590 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.590 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.590 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.590 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.591 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.591 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.591 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.591 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.591 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.591 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.591 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.591 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.591 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.591 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.591 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.591 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.592 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.592 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.592 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.592 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.592 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.592 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "telemetry", 2024-08-20T01:55:21.592 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.592 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.592 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.592 INFO:teuthology.orchestra.run.smithi079.stdout: "channel_basic": { 2024-08-20T01:55:21.593 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "channel_basic", 2024-08-20T01:55:21.593 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.593 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.593 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.593 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.593 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.593 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.593 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.593 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-20T01:55:21.593 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.593 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.593 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.594 INFO:teuthology.orchestra.run.smithi079.stdout: "channel_crash": { 2024-08-20T01:55:21.594 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "channel_crash", 2024-08-20T01:55:21.594 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.594 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.594 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.594 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.594 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.594 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.595 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.595 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-20T01:55:21.595 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.595 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.595 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.595 INFO:teuthology.orchestra.run.smithi079.stdout: "channel_device": { 2024-08-20T01:55:21.595 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "channel_device", 2024-08-20T01:55:21.596 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.596 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.596 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.596 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.596 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.596 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.596 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.596 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-20T01:55:21.596 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.596 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.597 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.597 INFO:teuthology.orchestra.run.smithi079.stdout: "channel_ident": { 2024-08-20T01:55:21.597 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "channel_ident", 2024-08-20T01:55:21.597 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.597 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.597 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.597 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.597 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.597 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.597 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.598 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-20T01:55:21.598 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.598 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.598 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.598 INFO:teuthology.orchestra.run.smithi079.stdout: "channel_perf": { 2024-08-20T01:55:21.598 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "channel_perf", 2024-08-20T01:55:21.598 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.598 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.598 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.598 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.598 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.599 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.599 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.599 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-20T01:55:21.599 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.599 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.599 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.599 INFO:teuthology.orchestra.run.smithi079.stdout: "contact": { 2024-08-20T01:55:21.599 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "contact", 2024-08-20T01:55:21.599 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.599 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.599 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.599 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.600 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.600 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.600 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.600 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.600 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.600 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.600 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.600 INFO:teuthology.orchestra.run.smithi079.stdout: "description": { 2024-08-20T01:55:21.600 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "description", 2024-08-20T01:55:21.600 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.600 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.600 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.600 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.601 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.601 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.601 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.601 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.601 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.601 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.601 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.601 INFO:teuthology.orchestra.run.smithi079.stdout: "device_url": { 2024-08-20T01:55:21.601 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "device_url", 2024-08-20T01:55:21.601 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.601 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.601 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.601 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-20T01:55:21.602 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.602 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.602 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.602 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.602 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.602 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.602 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.602 INFO:teuthology.orchestra.run.smithi079.stdout: "enabled": { 2024-08-20T01:55:21.602 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "enabled", 2024-08-20T01:55:21.602 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.603 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.603 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.603 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.603 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.603 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.603 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.603 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.603 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.603 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.603 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.603 INFO:teuthology.orchestra.run.smithi079.stdout: "interval": { 2024-08-20T01:55:21.603 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "interval", 2024-08-20T01:55:21.604 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.604 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.604 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.604 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "24", 2024-08-20T01:55:21.604 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "8", 2024-08-20T01:55:21.604 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.604 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.604 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.604 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.604 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.604 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.605 INFO:teuthology.orchestra.run.smithi079.stdout: "last_opt_revision": { 2024-08-20T01:55:21.605 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "last_opt_revision", 2024-08-20T01:55:21.605 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.605 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.605 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.605 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "1", 2024-08-20T01:55:21.605 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.605 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.605 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.605 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.605 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.605 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.605 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.606 INFO:teuthology.orchestra.run.smithi079.stdout: "leaderboard": { 2024-08-20T01:55:21.606 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "leaderboard", 2024-08-20T01:55:21.606 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.606 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.606 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.606 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.606 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.606 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.606 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.606 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.606 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.607 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.607 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.607 INFO:teuthology.orchestra.run.smithi079.stdout: "leaderboard_description": { 2024-08-20T01:55:21.607 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "leaderboard_description", 2024-08-20T01:55:21.607 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.607 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.607 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.607 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.607 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.607 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.607 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.608 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.608 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.608 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.608 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.608 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.608 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.608 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.608 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.608 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.608 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.609 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.609 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.609 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.609 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.609 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.609 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.609 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.609 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.609 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.609 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.609 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.609 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.609 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.610 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.610 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.610 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.610 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.610 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.610 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.610 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.611 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.611 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.611 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.611 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.611 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.611 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.611 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.611 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.611 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.611 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.611 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.611 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.612 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.612 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.612 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.612 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.612 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.612 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.612 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.612 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.612 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.612 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.612 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.612 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.612 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.613 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.613 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.613 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.613 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.613 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.613 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.613 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.613 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.613 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.613 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.613 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.613 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.614 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.614 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.614 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.614 INFO:teuthology.orchestra.run.smithi079.stdout: "organization": { 2024-08-20T01:55:21.614 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "organization", 2024-08-20T01:55:21.614 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.614 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.614 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.614 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.614 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.614 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.615 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.615 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.615 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.615 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.615 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.615 INFO:teuthology.orchestra.run.smithi079.stdout: "proxy": { 2024-08-20T01:55:21.615 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "proxy", 2024-08-20T01:55:21.616 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.616 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.616 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.616 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.616 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.617 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.617 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.617 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.617 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.617 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.617 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.617 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.617 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.618 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.618 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.618 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.618 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.618 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.618 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.618 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.618 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.618 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.618 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.619 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.619 INFO:teuthology.orchestra.run.smithi079.stdout: "url": { 2024-08-20T01:55:21.619 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "url", 2024-08-20T01:55:21.619 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.619 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.619 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.619 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-20T01:55:21.619 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.619 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.619 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.619 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.620 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.620 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.620 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.620 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.620 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.620 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "test_orchestrator", 2024-08-20T01:55:21.620 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.620 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.620 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.620 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.621 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.621 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.621 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.621 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.621 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.621 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.621 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.621 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.621 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.621 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.621 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.621 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.622 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.622 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.622 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.622 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.622 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.622 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.622 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.622 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.623 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.623 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.623 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.623 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.623 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.623 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.623 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.623 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.623 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.623 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.623 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.623 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.624 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.624 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.624 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.624 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.624 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.624 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.624 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.624 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.624 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.624 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.624 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.625 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.625 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.625 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.625 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.625 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.625 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.625 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.625 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.625 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.625 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.626 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.626 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.626 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.626 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.626 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.626 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.626 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.626 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.626 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.627 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.627 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.627 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.627 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.627 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.627 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.627 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.627 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.627 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.627 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.627 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.628 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.628 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.628 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.628 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.628 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.628 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.628 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.629 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "volumes", 2024-08-20T01:55:21.629 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.629 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.629 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.629 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.629 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.629 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.629 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.629 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.629 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.629 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.630 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.630 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.630 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.630 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.630 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.630 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.630 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.630 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.630 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.630 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.630 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.631 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.631 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.631 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.631 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.631 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.631 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.631 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.631 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.631 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.631 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.631 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.632 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.632 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.632 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.632 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.632 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.632 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.632 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.632 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.632 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.632 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.632 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.632 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.633 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.633 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.633 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.633 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.633 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.633 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.633 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.633 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.633 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.633 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.633 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.634 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.634 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.634 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.634 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.634 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.634 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.634 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.634 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.634 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.634 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.634 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.635 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.635 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.635 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.635 INFO:teuthology.orchestra.run.smithi079.stdout: "max_concurrent_clones": { 2024-08-20T01:55:21.635 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "max_concurrent_clones", 2024-08-20T01:55:21.635 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.635 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.635 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.635 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "4", 2024-08-20T01:55:21.635 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.636 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.636 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.636 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-20T01:55:21.636 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.636 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.636 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.636 INFO:teuthology.orchestra.run.smithi079.stdout: "periodic_async_work": { 2024-08-20T01:55:21.636 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "periodic_async_work", 2024-08-20T01:55:21.636 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.636 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.636 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.636 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.637 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.637 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.637 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.637 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Periodically check for async work", 2024-08-20T01:55:21.637 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.637 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.637 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.637 INFO:teuthology.orchestra.run.smithi079.stdout: "snapshot_clone_delay": { 2024-08-20T01:55:21.637 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "snapshot_clone_delay", 2024-08-20T01:55:21.637 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.638 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.638 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.638 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.638 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.638 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.638 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.638 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-20T01:55:21.638 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.638 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.638 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.639 INFO:teuthology.orchestra.run.smithi079.stdout: "snapshot_clone_no_wait": { 2024-08-20T01:55:21.639 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "snapshot_clone_no_wait", 2024-08-20T01:55:21.639 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.639 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.639 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.639 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.639 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.639 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.639 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.639 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-20T01:55:21.639 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.639 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.639 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.640 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.640 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.640 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.640 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.640 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.640 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.640 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.640 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.641 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.641 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.641 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.641 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.641 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.641 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.641 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.641 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "zabbix", 2024-08-20T01:55:21.641 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.641 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.642 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.642 INFO:teuthology.orchestra.run.smithi079.stdout: "discovery_interval": { 2024-08-20T01:55:21.642 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "discovery_interval", 2024-08-20T01:55:21.642 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "uint", 2024-08-20T01:55:21.642 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.642 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.642 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "100", 2024-08-20T01:55:21.642 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.642 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.642 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.642 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.643 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.643 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.643 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.643 INFO:teuthology.orchestra.run.smithi079.stdout: "identifier": { 2024-08-20T01:55:21.643 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "identifier", 2024-08-20T01:55:21.643 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.643 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.643 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.643 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.643 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.643 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.643 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.644 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.644 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.644 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.644 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.644 INFO:teuthology.orchestra.run.smithi079.stdout: "interval": { 2024-08-20T01:55:21.644 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "interval", 2024-08-20T01:55:21.644 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:21.644 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.644 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.644 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "60", 2024-08-20T01:55:21.644 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.645 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.645 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.645 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.645 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.645 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.645 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.645 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.645 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.645 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.645 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.645 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.645 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.646 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.646 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.646 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.646 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.646 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.646 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.646 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.646 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.646 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.646 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.646 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.646 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.647 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.647 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.647 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.647 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.647 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.647 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.647 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.647 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.647 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.647 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.647 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.647 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.647 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.648 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.648 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.648 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.648 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.648 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.648 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.648 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.648 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.648 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.648 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.648 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.648 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.649 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.649 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.649 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.649 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.649 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.649 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.649 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.649 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.649 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.649 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.649 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.649 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.650 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.650 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.650 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.650 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.650 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.650 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.650 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.650 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.650 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.650 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.651 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.651 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.651 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.651 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.651 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.651 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.651 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.651 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.651 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.651 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.651 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.652 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.652 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.652 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.652 INFO:teuthology.orchestra.run.smithi079.stdout: "zabbix_host": { 2024-08-20T01:55:21.652 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "zabbix_host", 2024-08-20T01:55:21.652 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.652 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.652 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.652 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.652 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.652 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.652 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.653 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.653 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.653 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.653 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.653 INFO:teuthology.orchestra.run.smithi079.stdout: "zabbix_port": { 2024-08-20T01:55:21.653 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "zabbix_port", 2024-08-20T01:55:21.653 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.653 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.653 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.653 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10051", 2024-08-20T01:55:21.653 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.653 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.653 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.654 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.654 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.654 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.654 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.654 INFO:teuthology.orchestra.run.smithi079.stdout: "zabbix_sender": { 2024-08-20T01:55:21.654 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "zabbix_sender", 2024-08-20T01:55:21.654 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.654 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.654 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.654 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-20T01:55:21.654 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.654 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.655 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.655 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.655 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.655 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.655 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.655 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.655 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.655 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.655 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-08-20T01:55:21.655 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.655 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.655 INFO:teuthology.orchestra.run.smithi079.stdout: "modules": [ 2024-08-20T01:55:21.655 INFO:teuthology.orchestra.run.smithi079.stdout: "cephadm", 2024-08-20T01:55:21.655 INFO:teuthology.orchestra.run.smithi079.stdout: "dashboard", 2024-08-20T01:55:21.656 INFO:teuthology.orchestra.run.smithi079.stdout: "iostat", 2024-08-20T01:55:21.656 INFO:teuthology.orchestra.run.smithi079.stdout: "nfs", 2024-08-20T01:55:21.656 INFO:teuthology.orchestra.run.smithi079.stdout: "restful" 2024-08-20T01:55:21.656 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.656 INFO:teuthology.orchestra.run.smithi079.stdout: "available_modules": [ 2024-08-20T01:55:21.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.656 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "alerts", 2024-08-20T01:55:21.656 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.656 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.656 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.656 INFO:teuthology.orchestra.run.smithi079.stdout: "interval": { 2024-08-20T01:55:21.656 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "interval", 2024-08-20T01:55:21.656 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:21.656 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.657 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.657 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "60", 2024-08-20T01:55:21.657 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.657 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.657 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.657 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "How frequently to reexamine health status", 2024-08-20T01:55:21.657 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.657 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.657 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.657 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.657 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.657 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.658 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.658 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.658 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.658 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.658 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.658 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.658 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.658 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.658 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.658 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.658 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.658 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.658 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.659 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.659 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.659 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.659 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.659 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.659 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.659 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.659 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.659 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.659 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.659 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.659 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.659 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.660 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.660 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.660 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.660 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.660 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.660 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.660 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.660 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.660 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.660 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.660 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.660 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.660 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.661 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.661 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.661 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.661 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.661 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.661 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.661 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.661 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.661 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.661 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.661 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.662 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.662 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.662 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.662 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.662 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.662 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.662 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.662 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.662 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.662 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.662 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.662 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.662 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.663 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_destination": { 2024-08-20T01:55:21.663 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_destination", 2024-08-20T01:55:21.663 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.663 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.663 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.663 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.663 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.663 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.663 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.663 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Email address to send alerts to", 2024-08-20T01:55:21.663 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.663 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.663 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.664 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_from_name": { 2024-08-20T01:55:21.664 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_from_name", 2024-08-20T01:55:21.664 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.664 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.664 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.664 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "Ceph", 2024-08-20T01:55:21.664 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.664 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.664 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.664 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Email From: name", 2024-08-20T01:55:21.664 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.664 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.665 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.665 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_host": { 2024-08-20T01:55:21.665 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_host", 2024-08-20T01:55:21.665 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.665 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.665 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.665 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.665 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.665 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.665 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.665 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "SMTP server", 2024-08-20T01:55:21.665 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.665 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.666 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.666 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_password": { 2024-08-20T01:55:21.666 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_password", 2024-08-20T01:55:21.666 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.666 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.666 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.666 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.666 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.666 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.666 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.666 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Password to authenticate with", 2024-08-20T01:55:21.667 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.667 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.667 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.667 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_port": { 2024-08-20T01:55:21.667 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_port", 2024-08-20T01:55:21.667 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.667 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.667 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.667 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "465", 2024-08-20T01:55:21.667 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.667 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.668 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.668 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "SMTP port", 2024-08-20T01:55:21.668 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.668 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.668 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.668 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_sender": { 2024-08-20T01:55:21.668 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_sender", 2024-08-20T01:55:21.668 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.668 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.668 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.668 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.668 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.668 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.669 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.669 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "SMTP envelope sender", 2024-08-20T01:55:21.669 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.669 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.669 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.669 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_ssl": { 2024-08-20T01:55:21.669 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_ssl", 2024-08-20T01:55:21.669 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.669 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.669 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.669 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.669 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.670 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.670 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.670 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-20T01:55:21.670 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.670 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.670 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.670 INFO:teuthology.orchestra.run.smithi079.stdout: "smtp_user": { 2024-08-20T01:55:21.670 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smtp_user", 2024-08-20T01:55:21.670 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.670 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.670 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.670 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.671 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.671 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.671 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.671 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "User to authenticate as", 2024-08-20T01:55:21.671 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.671 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.671 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.671 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.671 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.671 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.671 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.671 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.672 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.672 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.672 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.672 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.672 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.672 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.672 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.672 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.673 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.673 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.673 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "balancer", 2024-08-20T01:55:21.673 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.673 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.673 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.673 INFO:teuthology.orchestra.run.smithi079.stdout: "active": { 2024-08-20T01:55:21.673 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "active", 2024-08-20T01:55:21.673 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.673 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.673 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.673 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.674 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.674 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.674 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.674 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "automatically balance PGs across cluster", 2024-08-20T01:55:21.674 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.674 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.674 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.674 INFO:teuthology.orchestra.run.smithi079.stdout: "begin_time": { 2024-08-20T01:55:21.674 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "begin_time", 2024-08-20T01:55:21.674 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.674 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.674 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.675 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0000", 2024-08-20T01:55:21.675 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.675 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.675 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.675 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "beginning time of day to automatically balance", 2024-08-20T01:55:21.675 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-20T01:55:21.675 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.675 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.675 INFO:teuthology.orchestra.run.smithi079.stdout: "begin_weekday": { 2024-08-20T01:55:21.675 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "begin_weekday", 2024-08-20T01:55:21.675 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "uint", 2024-08-20T01:55:21.675 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.675 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.676 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.676 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "0", 2024-08-20T01:55:21.676 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "6", 2024-08-20T01:55:21.676 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.676 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-20T01:55:21.676 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-20T01:55:21.676 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.676 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.676 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_compat_max_iterations": { 2024-08-20T01:55:21.676 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "crush_compat_max_iterations", 2024-08-20T01:55:21.676 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "uint", 2024-08-20T01:55:21.676 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.677 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.677 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "25", 2024-08-20T01:55:21.677 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "1", 2024-08-20T01:55:21.677 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "250", 2024-08-20T01:55:21.677 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.677 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-20T01:55:21.677 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.677 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.677 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.677 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_compat_metrics": { 2024-08-20T01:55:21.678 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "crush_compat_metrics", 2024-08-20T01:55:21.678 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.678 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.678 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.678 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "pgs,objects,bytes", 2024-08-20T01:55:21.678 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.678 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.678 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.678 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-20T01:55:21.678 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-20T01:55:21.679 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.679 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.679 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_compat_step": { 2024-08-20T01:55:21.679 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "crush_compat_step", 2024-08-20T01:55:21.679 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2024-08-20T01:55:21.679 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.679 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.679 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0.5", 2024-08-20T01:55:21.679 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "0.001", 2024-08-20T01:55:21.679 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "0.999", 2024-08-20T01:55:21.680 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.680 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "aggressiveness of optimization", 2024-08-20T01:55:21.680 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-20T01:55:21.680 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.680 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.680 INFO:teuthology.orchestra.run.smithi079.stdout: "end_time": { 2024-08-20T01:55:21.680 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "end_time", 2024-08-20T01:55:21.680 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.680 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.681 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.681 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "2359", 2024-08-20T01:55:21.681 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.681 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.681 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.681 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "ending time of day to automatically balance", 2024-08-20T01:55:21.681 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-20T01:55:21.681 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.681 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.681 INFO:teuthology.orchestra.run.smithi079.stdout: "end_weekday": { 2024-08-20T01:55:21.681 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "end_weekday", 2024-08-20T01:55:21.681 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "uint", 2024-08-20T01:55:21.682 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.682 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.682 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.682 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "0", 2024-08-20T01:55:21.682 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "6", 2024-08-20T01:55:21.682 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.682 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-20T01:55:21.682 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-20T01:55:21.682 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.682 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.682 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.682 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.682 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.683 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.683 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.683 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.683 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.683 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.683 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.683 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.683 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.683 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.683 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.683 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.683 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.683 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.683 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.684 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.684 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.684 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.684 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.684 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.684 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.684 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.684 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.684 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.684 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.684 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.684 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.685 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.685 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.685 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.685 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.685 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.685 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.685 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.685 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.685 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.685 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.685 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.685 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.686 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.686 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.686 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.686 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.686 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.686 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.686 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.686 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.686 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.686 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.686 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.686 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.687 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.687 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.687 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.687 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.687 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.687 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.687 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.687 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.687 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.687 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.687 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.687 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.687 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.688 INFO:teuthology.orchestra.run.smithi079.stdout: "min_score": { 2024-08-20T01:55:21.688 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "min_score", 2024-08-20T01:55:21.688 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2024-08-20T01:55:21.688 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.688 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.688 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.688 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.688 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.688 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.688 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-20T01:55:21.688 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.688 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.688 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.689 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": { 2024-08-20T01:55:21.689 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "mode", 2024-08-20T01:55:21.689 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.689 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.689 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.689 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "upmap", 2024-08-20T01:55:21.689 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.689 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.689 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.689 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-compat", 2024-08-20T01:55:21.689 INFO:teuthology.orchestra.run.smithi079.stdout: "none", 2024-08-20T01:55:21.689 INFO:teuthology.orchestra.run.smithi079.stdout: "read", 2024-08-20T01:55:21.689 INFO:teuthology.orchestra.run.smithi079.stdout: "upmap", 2024-08-20T01:55:21.690 INFO:teuthology.orchestra.run.smithi079.stdout: "upmap-read" 2024-08-20T01:55:21.690 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.690 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Balancer mode", 2024-08-20T01:55:21.690 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.690 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.690 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.690 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_ids": { 2024-08-20T01:55:21.690 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "pool_ids", 2024-08-20T01:55:21.690 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.690 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.690 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.690 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.690 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.691 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.691 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.691 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-20T01:55:21.691 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.691 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.691 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.691 INFO:teuthology.orchestra.run.smithi079.stdout: "sleep_interval": { 2024-08-20T01:55:21.691 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sleep_interval", 2024-08-20T01:55:21.691 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:21.691 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.691 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.691 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "60", 2024-08-20T01:55:21.692 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.692 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.692 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.692 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-20T01:55:21.692 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.692 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.692 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.692 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.692 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.692 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.692 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.692 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.693 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.693 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.693 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.693 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.693 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.693 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.693 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.693 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.693 INFO:teuthology.orchestra.run.smithi079.stdout: "upmap_max_deviation": { 2024-08-20T01:55:21.693 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "upmap_max_deviation", 2024-08-20T01:55:21.693 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.693 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.693 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.694 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5", 2024-08-20T01:55:21.694 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "1", 2024-08-20T01:55:21.694 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.694 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.694 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-20T01:55:21.694 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-20T01:55:21.694 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.694 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.694 INFO:teuthology.orchestra.run.smithi079.stdout: "upmap_max_optimizations": { 2024-08-20T01:55:21.694 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "upmap_max_optimizations", 2024-08-20T01:55:21.694 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "uint", 2024-08-20T01:55:21.695 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.695 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.695 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-08-20T01:55:21.695 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.695 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.695 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.695 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-20T01:55:21.695 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.695 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.695 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.695 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.695 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.696 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "cephadm", 2024-08-20T01:55:21.696 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.696 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.696 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.696 INFO:teuthology.orchestra.run.smithi079.stdout: "agent_down_multiplier": { 2024-08-20T01:55:21.696 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "agent_down_multiplier", 2024-08-20T01:55:21.696 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2024-08-20T01:55:21.696 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.696 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.696 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "3.0", 2024-08-20T01:55:21.696 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.696 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.696 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.697 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-20T01:55:21.697 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.697 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.697 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.697 INFO:teuthology.orchestra.run.smithi079.stdout: "agent_refresh_rate": { 2024-08-20T01:55:21.697 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "agent_refresh_rate", 2024-08-20T01:55:21.697 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:21.697 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.697 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.697 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "20", 2024-08-20T01:55:21.697 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.697 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.698 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.698 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-20T01:55:21.698 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.698 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.698 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.698 INFO:teuthology.orchestra.run.smithi079.stdout: "agent_starting_port": { 2024-08-20T01:55:21.698 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "agent_starting_port", 2024-08-20T01:55:21.698 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.698 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.698 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.698 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "4721", 2024-08-20T01:55:21.698 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.699 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.699 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.699 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-20T01:55:21.699 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.699 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.699 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.699 INFO:teuthology.orchestra.run.smithi079.stdout: "allow_ptrace": { 2024-08-20T01:55:21.699 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "allow_ptrace", 2024-08-20T01:55:21.699 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.699 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.699 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.699 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.699 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.700 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.700 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.700 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-20T01:55:21.700 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-20T01:55:21.700 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.700 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.700 INFO:teuthology.orchestra.run.smithi079.stdout: "autotune_interval": { 2024-08-20T01:55:21.700 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "autotune_interval", 2024-08-20T01:55:21.700 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:21.700 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.700 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.701 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "600", 2024-08-20T01:55:21.701 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.701 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.701 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.701 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-20T01:55:21.701 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.701 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.701 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.701 INFO:teuthology.orchestra.run.smithi079.stdout: "autotune_memory_target_ratio": { 2024-08-20T01:55:21.701 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "autotune_memory_target_ratio", 2024-08-20T01:55:21.701 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2024-08-20T01:55:21.702 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.702 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.702 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0.7", 2024-08-20T01:55:21.702 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.702 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.702 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.702 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-20T01:55:21.702 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.702 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.702 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.702 INFO:teuthology.orchestra.run.smithi079.stdout: "cephadm_log_destination": { 2024-08-20T01:55:21.703 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "cephadm_log_destination", 2024-08-20T01:55:21.703 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.703 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.703 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.703 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.703 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.703 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.703 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.703 INFO:teuthology.orchestra.run.smithi079.stdout: "file", 2024-08-20T01:55:21.703 INFO:teuthology.orchestra.run.smithi079.stdout: "file,syslog", 2024-08-20T01:55:21.703 INFO:teuthology.orchestra.run.smithi079.stdout: "syslog" 2024-08-20T01:55:21.703 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.704 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-20T01:55:21.704 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.704 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.704 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.704 INFO:teuthology.orchestra.run.smithi079.stdout: "cgroups_split": { 2024-08-20T01:55:21.704 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "cgroups_split", 2024-08-20T01:55:21.704 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.704 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.704 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.704 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.704 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.705 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.705 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.705 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-20T01:55:21.705 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.705 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.705 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.705 INFO:teuthology.orchestra.run.smithi079.stdout: "config_checks_enabled": { 2024-08-20T01:55:21.705 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "config_checks_enabled", 2024-08-20T01:55:21.705 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.705 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.706 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.706 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.706 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.706 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.706 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.706 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-20T01:55:21.706 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.706 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.706 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.706 INFO:teuthology.orchestra.run.smithi079.stdout: "config_dashboard": { 2024-08-20T01:55:21.707 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "config_dashboard", 2024-08-20T01:55:21.707 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.707 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.707 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.707 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.707 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.707 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.707 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.707 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-20T01:55:21.707 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.707 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.707 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.708 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_alertmanager": { 2024-08-20T01:55:21.708 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_alertmanager", 2024-08-20T01:55:21.708 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.708 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.708 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.708 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-08-20T01:55:21.708 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.708 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.708 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.708 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Prometheus container image", 2024-08-20T01:55:21.708 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.708 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.708 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.709 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_base": { 2024-08-20T01:55:21.709 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_base", 2024-08-20T01:55:21.709 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.709 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.709 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.709 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-20T01:55:21.709 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.709 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.709 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.709 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Container image name, without the tag", 2024-08-20T01:55:21.709 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.709 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.709 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.710 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_elasticsearch": { 2024-08-20T01:55:21.710 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_elasticsearch", 2024-08-20T01:55:21.710 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.710 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.710 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.710 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-20T01:55:21.710 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.710 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.710 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.710 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "elasticsearch container image", 2024-08-20T01:55:21.710 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.711 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.711 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.711 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_grafana": { 2024-08-20T01:55:21.711 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_grafana", 2024-08-20T01:55:21.711 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.711 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.711 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.711 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-08-20T01:55:21.711 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.711 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.711 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.711 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Prometheus container image", 2024-08-20T01:55:21.711 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.712 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.712 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.712 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_haproxy": { 2024-08-20T01:55:21.712 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_haproxy", 2024-08-20T01:55:21.712 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.712 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.712 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.712 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-20T01:55:21.712 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.712 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.712 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.712 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "HAproxy container image", 2024-08-20T01:55:21.713 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.713 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.713 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.713 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_jaeger_agent": { 2024-08-20T01:55:21.713 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_jaeger_agent", 2024-08-20T01:55:21.713 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.713 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.713 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.713 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-20T01:55:21.713 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.713 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.713 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.714 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Jaeger agent container image", 2024-08-20T01:55:21.714 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.714 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.714 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.714 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_jaeger_collector": { 2024-08-20T01:55:21.714 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_jaeger_collector", 2024-08-20T01:55:21.714 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.714 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.714 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.714 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-20T01:55:21.714 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.714 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.715 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.715 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Jaeger collector container image", 2024-08-20T01:55:21.715 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.715 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.715 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.715 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_jaeger_query": { 2024-08-20T01:55:21.715 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_jaeger_query", 2024-08-20T01:55:21.715 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.715 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.715 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.715 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-20T01:55:21.715 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.715 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.716 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.716 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Jaeger query container image", 2024-08-20T01:55:21.716 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.716 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.716 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.716 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_keepalived": { 2024-08-20T01:55:21.716 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_keepalived", 2024-08-20T01:55:21.717 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.717 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.717 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.717 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-20T01:55:21.717 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.718 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.718 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.718 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Keepalived container image", 2024-08-20T01:55:21.718 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.718 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.718 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.718 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_loki": { 2024-08-20T01:55:21.718 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_loki", 2024-08-20T01:55:21.718 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.718 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.718 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.719 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-20T01:55:21.719 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.719 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.719 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.719 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Loki container image", 2024-08-20T01:55:21.719 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.719 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.719 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.719 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_nginx": { 2024-08-20T01:55:21.719 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_nginx", 2024-08-20T01:55:21.719 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.719 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.719 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.720 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-08-20T01:55:21.720 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.720 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.720 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.720 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Nginx container image", 2024-08-20T01:55:21.720 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.720 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.720 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.720 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_node_exporter": { 2024-08-20T01:55:21.720 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_node_exporter", 2024-08-20T01:55:21.720 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.721 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.721 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.721 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-08-20T01:55:21.721 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.721 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.721 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.721 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Prometheus container image", 2024-08-20T01:55:21.721 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.721 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.721 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.721 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_nvmeof": { 2024-08-20T01:55:21.722 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_nvmeof", 2024-08-20T01:55:21.722 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.722 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.722 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.722 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-08-20T01:55:21.722 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.722 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.722 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.722 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Nvme-of container image", 2024-08-20T01:55:21.722 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.723 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.723 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.723 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_prometheus": { 2024-08-20T01:55:21.723 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_prometheus", 2024-08-20T01:55:21.723 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.723 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.723 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.723 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-08-20T01:55:21.723 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.723 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.723 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.723 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Prometheus container image", 2024-08-20T01:55:21.724 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.724 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.724 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.724 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_promtail": { 2024-08-20T01:55:21.724 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_promtail", 2024-08-20T01:55:21.724 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.724 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.724 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.724 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-20T01:55:21.724 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.724 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.724 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.724 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Promtail container image", 2024-08-20T01:55:21.725 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.725 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.725 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.725 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_samba": { 2024-08-20T01:55:21.725 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_samba", 2024-08-20T01:55:21.725 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.725 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.725 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.725 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-20T01:55:21.725 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.725 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.725 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.725 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Samba/SMB container image", 2024-08-20T01:55:21.726 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.726 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.726 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.726 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image_snmp_gateway": { 2024-08-20T01:55:21.726 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_image_snmp_gateway", 2024-08-20T01:55:21.726 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.726 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.726 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.726 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-20T01:55:21.726 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.727 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.727 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.727 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "SNMP Gateway container image", 2024-08-20T01:55:21.727 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.727 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.727 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.727 INFO:teuthology.orchestra.run.smithi079.stdout: "container_init": { 2024-08-20T01:55:21.727 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "container_init", 2024-08-20T01:55:21.727 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.727 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.727 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.728 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.728 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.728 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.728 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.728 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Run podman/docker with `--init`", 2024-08-20T01:55:21.728 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.728 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.728 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.728 INFO:teuthology.orchestra.run.smithi079.stdout: "daemon_cache_timeout": { 2024-08-20T01:55:21.728 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "daemon_cache_timeout", 2024-08-20T01:55:21.728 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:21.728 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.729 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.729 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "600", 2024-08-20T01:55:21.729 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.729 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.729 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.729 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-20T01:55:21.729 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.729 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.729 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.729 INFO:teuthology.orchestra.run.smithi079.stdout: "default_cephadm_command_timeout": { 2024-08-20T01:55:21.730 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "default_cephadm_command_timeout", 2024-08-20T01:55:21.730 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.730 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.730 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.730 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "900", 2024-08-20T01:55:21.730 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.730 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.730 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.730 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-20T01:55:21.730 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.730 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.731 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.731 INFO:teuthology.orchestra.run.smithi079.stdout: "default_registry": { 2024-08-20T01:55:21.731 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "default_registry", 2024-08-20T01:55:21.731 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.731 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.731 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.731 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "docker.io", 2024-08-20T01:55:21.731 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.731 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.731 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.731 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-20T01:55:21.731 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.731 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.732 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.732 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.732 INFO:teuthology.orchestra.run.smithi079.stdout: "device_cache_timeout": { 2024-08-20T01:55:21.732 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "device_cache_timeout", 2024-08-20T01:55:21.732 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:21.732 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.732 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.732 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "1800", 2024-08-20T01:55:21.732 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.732 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.732 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.732 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "seconds to cache device inventory", 2024-08-20T01:55:21.732 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.732 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.733 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.733 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.733 INFO:teuthology.orchestra.run.smithi079.stdout: "device_enhanced_scan": { 2024-08-20T01:55:21.733 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "device_enhanced_scan", 2024-08-20T01:55:21.733 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.733 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.733 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.733 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.733 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.733 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.733 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.733 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-20T01:55:21.733 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.734 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.734 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.734 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.734 INFO:teuthology.orchestra.run.smithi079.stdout: "facts_cache_timeout": { 2024-08-20T01:55:21.734 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "facts_cache_timeout", 2024-08-20T01:55:21.734 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:21.734 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.734 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.734 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "60", 2024-08-20T01:55:21.734 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.734 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.734 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.734 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "seconds to cache host facts data", 2024-08-20T01:55:21.735 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.735 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.735 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.735 INFO:teuthology.orchestra.run.smithi079.stdout: "grafana_dashboards_path": { 2024-08-20T01:55:21.735 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "grafana_dashboards_path", 2024-08-20T01:55:21.735 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.735 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.735 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.735 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-20T01:55:21.735 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.735 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.735 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.735 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-20T01:55:21.736 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.736 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.736 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.736 INFO:teuthology.orchestra.run.smithi079.stdout: "host_check_interval": { 2024-08-20T01:55:21.736 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "host_check_interval", 2024-08-20T01:55:21.736 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:21.736 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.736 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.736 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "600", 2024-08-20T01:55:21.736 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.736 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.736 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.736 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how frequently to perform a host check", 2024-08-20T01:55:21.737 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.737 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.737 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.737 INFO:teuthology.orchestra.run.smithi079.stdout: "hw_monitoring": { 2024-08-20T01:55:21.737 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "hw_monitoring", 2024-08-20T01:55:21.737 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.737 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.737 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.737 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.737 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.737 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.737 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.738 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-20T01:55:21.738 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.738 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.738 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.738 INFO:teuthology.orchestra.run.smithi079.stdout: "inventory_list_all": { 2024-08-20T01:55:21.738 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "inventory_list_all", 2024-08-20T01:55:21.738 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.738 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.738 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.738 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.738 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.738 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.739 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.739 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-20T01:55:21.739 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.739 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.739 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.739 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.739 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.739 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.739 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.739 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.739 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.739 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.739 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.740 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.740 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.740 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.740 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.740 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.740 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.740 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.740 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.741 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.741 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.741 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.741 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.741 INFO:teuthology.orchestra.run.smithi079.stdout: "log_refresh_metadata": { 2024-08-20T01:55:21.741 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_refresh_metadata", 2024-08-20T01:55:21.741 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.741 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.741 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.741 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.741 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.741 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.741 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.742 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-20T01:55:21.742 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.742 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.742 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.742 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.742 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.742 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.742 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.742 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.742 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.742 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.742 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.743 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.743 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-20T01:55:21.743 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.743 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.743 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.743 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.743 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.743 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.743 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.743 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.743 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.743 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.744 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.744 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.744 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.744 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.744 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.744 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.744 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.744 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.744 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.744 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.744 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.744 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.744 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.745 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.745 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.745 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.745 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.745 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.745 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.745 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.745 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.745 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.745 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.745 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.745 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.746 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.746 INFO:teuthology.orchestra.run.smithi079.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-20T01:55:21.746 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-20T01:55:21.746 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.746 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.746 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.746 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.746 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.746 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.746 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.746 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-20T01:55:21.747 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.747 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.747 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.747 INFO:teuthology.orchestra.run.smithi079.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-20T01:55:21.747 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-20T01:55:21.747 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.747 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.747 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.747 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "*", 2024-08-20T01:55:21.747 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.747 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.747 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.748 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-20T01:55:21.748 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.748 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.748 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.748 INFO:teuthology.orchestra.run.smithi079.stdout: "max_count_per_host": { 2024-08-20T01:55:21.748 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "max_count_per_host", 2024-08-20T01:55:21.748 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.748 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.748 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.748 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-08-20T01:55:21.748 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.748 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.748 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.749 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "max number of daemons per service per host", 2024-08-20T01:55:21.749 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.749 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.749 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.749 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd_draining_count": { 2024-08-20T01:55:21.749 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "max_osd_draining_count", 2024-08-20T01:55:21.749 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.749 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.749 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.749 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-08-20T01:55:21.749 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.749 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.750 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.750 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-20T01:55:21.750 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.750 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.750 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.750 INFO:teuthology.orchestra.run.smithi079.stdout: "migration_current": { 2024-08-20T01:55:21.750 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "migration_current", 2024-08-20T01:55:21.750 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.750 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.750 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.750 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.750 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.751 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.751 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.751 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "internal - do not modify", 2024-08-20T01:55:21.751 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.751 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.751 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.751 INFO:teuthology.orchestra.run.smithi079.stdout: "mode": { 2024-08-20T01:55:21.751 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "mode", 2024-08-20T01:55:21.751 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.751 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.751 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.752 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "root", 2024-08-20T01:55:21.752 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.752 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.752 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.752 INFO:teuthology.orchestra.run.smithi079.stdout: "cephadm-package", 2024-08-20T01:55:21.752 INFO:teuthology.orchestra.run.smithi079.stdout: "root" 2024-08-20T01:55:21.752 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.752 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "mode for remote execution of cephadm", 2024-08-20T01:55:21.752 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.752 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.752 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.752 INFO:teuthology.orchestra.run.smithi079.stdout: "oob_default_addr": { 2024-08-20T01:55:21.753 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "oob_default_addr", 2024-08-20T01:55:21.753 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.753 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.753 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.753 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "169.254.1.1", 2024-08-20T01:55:21.753 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.753 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.753 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.753 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-20T01:55:21.753 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.753 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.753 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.753 INFO:teuthology.orchestra.run.smithi079.stdout: "prometheus_alerts_path": { 2024-08-20T01:55:21.754 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "prometheus_alerts_path", 2024-08-20T01:55:21.754 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.754 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.754 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.754 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-20T01:55:21.754 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.754 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.754 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.754 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-20T01:55:21.754 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.754 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.754 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.755 INFO:teuthology.orchestra.run.smithi079.stdout: "registry_insecure": { 2024-08-20T01:55:21.755 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "registry_insecure", 2024-08-20T01:55:21.755 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.755 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.755 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.755 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.755 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.755 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.755 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.755 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-20T01:55:21.755 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.755 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.755 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.755 INFO:teuthology.orchestra.run.smithi079.stdout: "registry_password": { 2024-08-20T01:55:21.756 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "registry_password", 2024-08-20T01:55:21.756 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.756 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.756 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.756 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.756 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.756 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.756 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.756 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-20T01:55:21.756 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.756 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.756 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.757 INFO:teuthology.orchestra.run.smithi079.stdout: "registry_url": { 2024-08-20T01:55:21.757 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "registry_url", 2024-08-20T01:55:21.757 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.757 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.757 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.757 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.757 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.757 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.757 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.757 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-20T01:55:21.757 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.757 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.757 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.758 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.758 INFO:teuthology.orchestra.run.smithi079.stdout: "registry_username": { 2024-08-20T01:55:21.758 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "registry_username", 2024-08-20T01:55:21.758 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.758 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.758 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.758 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.758 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.758 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.758 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.758 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-20T01:55:21.758 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.758 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.758 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.759 INFO:teuthology.orchestra.run.smithi079.stdout: "secure_monitoring_stack": { 2024-08-20T01:55:21.759 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "secure_monitoring_stack", 2024-08-20T01:55:21.759 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.759 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.759 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.759 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.759 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.759 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.759 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.759 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-20T01:55:21.759 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.759 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.760 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.760 INFO:teuthology.orchestra.run.smithi079.stdout: "service_discovery_port": { 2024-08-20T01:55:21.760 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "service_discovery_port", 2024-08-20T01:55:21.760 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.760 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.760 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.760 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "8765", 2024-08-20T01:55:21.760 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.760 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.760 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.760 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "cephadm service discovery port", 2024-08-20T01:55:21.760 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.760 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.761 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.761 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.761 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.761 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.761 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.761 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.761 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.761 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.761 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.761 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.761 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.761 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.761 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.762 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.762 INFO:teuthology.orchestra.run.smithi079.stdout: "ssh_config_file": { 2024-08-20T01:55:21.762 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ssh_config_file", 2024-08-20T01:55:21.762 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.762 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.762 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.762 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.762 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.762 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.762 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.762 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-20T01:55:21.763 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.763 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.763 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.763 INFO:teuthology.orchestra.run.smithi079.stdout: "use_agent": { 2024-08-20T01:55:21.763 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "use_agent", 2024-08-20T01:55:21.763 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.763 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.763 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.763 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.763 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.763 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.763 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.764 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-20T01:55:21.764 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.764 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.764 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.764 INFO:teuthology.orchestra.run.smithi079.stdout: "use_repo_digest": { 2024-08-20T01:55:21.764 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "use_repo_digest", 2024-08-20T01:55:21.764 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.764 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.764 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.764 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.764 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.764 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.764 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.765 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-20T01:55:21.765 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.765 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.765 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.765 INFO:teuthology.orchestra.run.smithi079.stdout: "warn_on_failed_host_check": { 2024-08-20T01:55:21.765 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "warn_on_failed_host_check", 2024-08-20T01:55:21.765 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.765 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.765 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.765 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.765 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.765 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.765 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.766 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "raise a health warning if the host check fails", 2024-08-20T01:55:21.766 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.766 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.766 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.766 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.766 INFO:teuthology.orchestra.run.smithi079.stdout: "warn_on_stray_daemons": { 2024-08-20T01:55:21.766 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "warn_on_stray_daemons", 2024-08-20T01:55:21.766 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.766 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.766 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.766 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.766 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.766 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.767 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.767 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-20T01:55:21.767 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.767 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.767 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.767 INFO:teuthology.orchestra.run.smithi079.stdout: "warn_on_stray_hosts": { 2024-08-20T01:55:21.767 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "warn_on_stray_hosts", 2024-08-20T01:55:21.767 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.767 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.768 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.768 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.768 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.768 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.768 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.768 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-20T01:55:21.768 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.768 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.768 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.768 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.768 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.768 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.768 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "crash", 2024-08-20T01:55:21.769 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.769 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.769 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.769 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.769 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.769 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.769 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.769 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.769 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.769 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.769 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.769 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.769 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.769 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.770 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.770 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.770 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.770 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.770 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.770 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.770 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.770 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.770 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.770 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.770 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.771 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.771 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.771 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.771 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.771 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.771 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.771 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.771 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.771 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.771 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.771 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.771 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.771 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.772 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.772 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.772 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.772 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.772 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.772 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.772 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.772 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.772 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.772 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.772 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.772 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.772 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.773 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.773 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.773 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.773 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.773 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.773 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.773 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.773 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.773 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.773 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.773 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.773 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.773 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.774 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.774 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.774 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.774 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.774 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.774 INFO:teuthology.orchestra.run.smithi079.stdout: "retain_interval": { 2024-08-20T01:55:21.774 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "retain_interval", 2024-08-20T01:55:21.774 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:21.774 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.774 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.774 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "31536000", 2024-08-20T01:55:21.774 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.775 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.775 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.775 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-20T01:55:21.775 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.775 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.775 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.775 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.775 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.775 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.775 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.775 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.775 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.775 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.775 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.776 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.776 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.776 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.776 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.776 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.776 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.776 INFO:teuthology.orchestra.run.smithi079.stdout: "warn_recent_interval": { 2024-08-20T01:55:21.776 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "warn_recent_interval", 2024-08-20T01:55:21.776 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:21.776 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.776 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.776 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "1209600", 2024-08-20T01:55:21.777 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.777 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.777 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.777 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-20T01:55:21.777 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.777 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.777 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.777 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.777 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.777 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.777 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "dashboard", 2024-08-20T01:55:21.777 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.777 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.778 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.778 INFO:teuthology.orchestra.run.smithi079.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-20T01:55:21.778 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-20T01:55:21.778 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.778 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.778 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.778 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-08-20T01:55:21.778 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.778 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.779 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.779 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.779 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.779 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.779 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.779 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.779 INFO:teuthology.orchestra.run.smithi079.stdout: "ALERTMANAGER_API_HOST": { 2024-08-20T01:55:21.779 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-20T01:55:21.779 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.779 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.779 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.779 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.779 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.780 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.780 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.780 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.780 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.780 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.780 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.780 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.780 INFO:teuthology.orchestra.run.smithi079.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-20T01:55:21.780 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-20T01:55:21.780 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.780 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.781 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.781 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.781 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.781 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.781 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.781 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.781 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.781 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.781 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.781 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.781 INFO:teuthology.orchestra.run.smithi079.stdout: "AUDIT_API_ENABLED": { 2024-08-20T01:55:21.781 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "AUDIT_API_ENABLED", 2024-08-20T01:55:21.781 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.782 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.782 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.782 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.782 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.782 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.782 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.782 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.782 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.782 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.782 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.782 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.782 INFO:teuthology.orchestra.run.smithi079.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-20T01:55:21.782 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-20T01:55:21.782 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.783 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.783 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.783 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.783 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.783 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.783 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.783 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.783 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.783 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.783 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.783 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.783 INFO:teuthology.orchestra.run.smithi079.stdout: "ENABLE_BROWSABLE_API": { 2024-08-20T01:55:21.783 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-20T01:55:21.783 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.784 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.784 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.784 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.784 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.784 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.784 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.784 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.784 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.784 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.784 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.784 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.784 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-20T01:55:21.784 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-20T01:55:21.784 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.785 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.785 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.785 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.785 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.785 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.785 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.785 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.785 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.785 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.785 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.785 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.786 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-20T01:55:21.786 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-20T01:55:21.786 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.786 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.786 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.786 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.786 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.786 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.786 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.786 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.786 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.786 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.786 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.787 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.787 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-20T01:55:21.787 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-20T01:55:21.787 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.787 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.787 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.787 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.787 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.787 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.787 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.787 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.787 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.787 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.787 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.788 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.788 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-20T01:55:21.788 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-20T01:55:21.788 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.788 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.788 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.788 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.788 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.788 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.788 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.788 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.788 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.788 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.788 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.789 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.789 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-20T01:55:21.789 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-20T01:55:21.789 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.789 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.789 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.789 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.789 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.789 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.789 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.789 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.789 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.789 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.789 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.790 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.790 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-20T01:55:21.790 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-20T01:55:21.790 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.790 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.790 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.790 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.790 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.790 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.790 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.790 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.790 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.790 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.791 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.791 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.791 INFO:teuthology.orchestra.run.smithi079.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-20T01:55:21.791 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-20T01:55:21.791 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.791 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.791 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.791 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.791 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.791 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.791 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.791 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.791 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.791 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.792 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.792 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.792 INFO:teuthology.orchestra.run.smithi079.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-20T01:55:21.792 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-20T01:55:21.792 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.792 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.792 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.792 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.792 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.792 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.792 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.792 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.793 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.793 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.793 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.793 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.793 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_API_PASSWORD": { 2024-08-20T01:55:21.793 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-20T01:55:21.793 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.793 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.793 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.793 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "admin", 2024-08-20T01:55:21.793 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.793 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.793 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.793 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.794 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.794 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.794 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.794 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.794 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-20T01:55:21.794 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-20T01:55:21.794 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.794 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.794 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.794 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.794 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.794 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.794 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.795 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.795 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.795 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.795 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.795 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.795 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_API_URL": { 2024-08-20T01:55:21.795 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_API_URL", 2024-08-20T01:55:21.795 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.795 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.795 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.795 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.795 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.795 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.796 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.796 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.796 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.796 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.796 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.796 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.796 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_API_USERNAME": { 2024-08-20T01:55:21.796 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-20T01:55:21.796 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.796 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.796 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.796 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "admin", 2024-08-20T01:55:21.796 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.796 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.797 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.797 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.797 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.797 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.797 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.797 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.797 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-20T01:55:21.797 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-20T01:55:21.797 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.797 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.797 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.797 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.797 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.798 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.798 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.798 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.798 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.798 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.798 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.798 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.798 INFO:teuthology.orchestra.run.smithi079.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-20T01:55:21.798 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-20T01:55:21.798 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.798 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.798 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.798 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.798 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.799 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.799 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.799 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.799 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.799 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.799 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.799 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.799 INFO:teuthology.orchestra.run.smithi079.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-20T01:55:21.799 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-20T01:55:21.799 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.799 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.799 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.799 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.800 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.800 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.800 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.800 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.800 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.800 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.800 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.800 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.800 INFO:teuthology.orchestra.run.smithi079.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-20T01:55:21.800 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-20T01:55:21.800 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.800 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.800 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.800 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.801 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.801 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.801 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.801 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.801 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.801 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.801 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.801 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.801 INFO:teuthology.orchestra.run.smithi079.stdout: "MANAGED_BY_CLUSTERS": { 2024-08-20T01:55:21.801 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-08-20T01:55:21.801 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.801 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.801 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.801 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "[]", 2024-08-20T01:55:21.802 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.802 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.802 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.802 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.802 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.802 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.802 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.802 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.802 INFO:teuthology.orchestra.run.smithi079.stdout: "MULTICLUSTER_CONFIG": { 2024-08-20T01:55:21.802 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "MULTICLUSTER_CONFIG", 2024-08-20T01:55:21.802 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.802 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.802 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.803 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "{}", 2024-08-20T01:55:21.803 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.803 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.803 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.803 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.803 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.803 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.803 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.803 INFO:teuthology.orchestra.run.smithi079.stdout: "PROMETHEUS_API_HOST": { 2024-08-20T01:55:21.803 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-20T01:55:21.803 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.803 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.804 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.804 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.804 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.804 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.804 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.804 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.804 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.804 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.804 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.804 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.804 INFO:teuthology.orchestra.run.smithi079.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-20T01:55:21.804 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-20T01:55:21.805 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.805 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.805 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.805 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.805 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.805 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.805 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.805 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.805 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.805 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.805 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.805 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-20T01:55:21.806 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-20T01:55:21.806 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.806 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.806 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.806 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.806 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.806 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.806 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.806 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.806 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.806 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.806 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.807 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-20T01:55:21.807 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-20T01:55:21.807 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.807 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.807 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.807 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.807 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.807 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.807 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.807 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.807 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.807 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.807 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.808 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.808 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-20T01:55:21.808 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-20T01:55:21.808 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.808 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.808 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.808 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.808 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.808 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.808 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.808 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.808 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.808 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.808 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.809 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.809 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-20T01:55:21.809 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-20T01:55:21.809 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.809 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.809 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.809 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.809 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.809 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.809 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.809 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.809 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.809 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.810 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.810 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.810 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-20T01:55:21.810 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-20T01:55:21.810 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.810 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.810 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.810 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.810 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.810 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.810 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.811 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.811 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.811 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.811 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.811 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.811 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-20T01:55:21.811 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-20T01:55:21.811 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.811 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.811 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.811 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.811 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.811 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.812 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.812 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.812 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.812 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.812 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.812 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-20T01:55:21.812 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-20T01:55:21.812 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.812 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.812 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.812 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.812 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.812 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.813 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.813 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.813 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.813 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.813 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.813 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.813 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_ENABLED": { 2024-08-20T01:55:21.813 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-20T01:55:21.813 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.813 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.813 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.813 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.813 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.814 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.814 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.814 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.814 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.814 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.814 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.814 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.814 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-20T01:55:21.815 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-20T01:55:21.815 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.815 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.815 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.815 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-20T01:55:21.815 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.815 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.816 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.816 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.816 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.816 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.816 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.816 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.816 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-20T01:55:21.816 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-20T01:55:21.816 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.817 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.817 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.817 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-08-20T01:55:21.817 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.817 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.817 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.818 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.818 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.818 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.818 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.819 INFO:teuthology.orchestra.run.smithi079.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-20T01:55:21.819 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-20T01:55:21.819 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.819 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.819 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.819 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "8", 2024-08-20T01:55:21.820 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.820 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.820 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.820 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.820 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.820 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.821 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.821 INFO:teuthology.orchestra.run.smithi079.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-20T01:55:21.821 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-20T01:55:21.821 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.822 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.822 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.822 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "45", 2024-08-20T01:55:21.822 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.823 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.823 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.823 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.823 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.823 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.823 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.824 INFO:teuthology.orchestra.run.smithi079.stdout: "RGW_API_ACCESS_KEY": { 2024-08-20T01:55:21.824 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-20T01:55:21.824 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.824 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.824 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.825 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.825 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.825 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.825 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.825 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.826 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.826 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.826 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.826 INFO:teuthology.orchestra.run.smithi079.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-20T01:55:21.827 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-20T01:55:21.827 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.827 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.827 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.827 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "admin", 2024-08-20T01:55:21.828 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.828 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.828 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.828 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.828 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.828 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.829 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.829 INFO:teuthology.orchestra.run.smithi079.stdout: "RGW_API_SECRET_KEY": { 2024-08-20T01:55:21.829 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-20T01:55:21.829 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.830 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.830 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.830 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.830 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.830 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.831 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.831 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.831 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.831 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.831 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.832 INFO:teuthology.orchestra.run.smithi079.stdout: "RGW_API_SSL_VERIFY": { 2024-08-20T01:55:21.832 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-20T01:55:21.832 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.832 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.832 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.832 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.833 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.833 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.833 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.833 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.833 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.834 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.834 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.834 INFO:teuthology.orchestra.run.smithi079.stdout: "UNSAFE_TLS_v1_2": { 2024-08-20T01:55:21.834 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "UNSAFE_TLS_v1_2", 2024-08-20T01:55:21.835 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.835 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.835 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.835 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.835 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.835 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.836 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.836 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.836 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.836 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.836 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.837 INFO:teuthology.orchestra.run.smithi079.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-20T01:55:21.837 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-20T01:55:21.837 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.837 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.837 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.838 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.838 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.838 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.838 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.838 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.839 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.839 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.839 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.839 INFO:teuthology.orchestra.run.smithi079.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-20T01:55:21.840 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-20T01:55:21.840 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.840 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.840 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.840 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-08-20T01:55:21.840 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.841 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.841 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.841 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.841 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.841 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.841 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.842 INFO:teuthology.orchestra.run.smithi079.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-20T01:55:21.842 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-20T01:55:21.842 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.842 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.842 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.842 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5", 2024-08-20T01:55:21.842 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.842 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.842 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.842 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.842 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.843 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.843 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.843 INFO:teuthology.orchestra.run.smithi079.stdout: "cross_origin_url": { 2024-08-20T01:55:21.843 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "cross_origin_url", 2024-08-20T01:55:21.843 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.843 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.843 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.843 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.843 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.843 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.843 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.844 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.844 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.844 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.844 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.844 INFO:teuthology.orchestra.run.smithi079.stdout: "crt_file": { 2024-08-20T01:55:21.844 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "crt_file", 2024-08-20T01:55:21.844 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.844 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.844 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.844 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.844 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.844 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.845 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.845 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.845 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.845 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.845 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.845 INFO:teuthology.orchestra.run.smithi079.stdout: "debug": { 2024-08-20T01:55:21.845 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "debug", 2024-08-20T01:55:21.845 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.845 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.845 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.845 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.846 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.846 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.846 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.846 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Enable/disable debug options", 2024-08-20T01:55:21.846 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.846 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.846 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.846 INFO:teuthology.orchestra.run.smithi079.stdout: "jwt_token_ttl": { 2024-08-20T01:55:21.846 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "jwt_token_ttl", 2024-08-20T01:55:21.846 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.846 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.847 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.847 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "28800", 2024-08-20T01:55:21.847 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.847 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.847 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.847 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.847 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.847 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.847 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.847 INFO:teuthology.orchestra.run.smithi079.stdout: "key_file": { 2024-08-20T01:55:21.847 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "key_file", 2024-08-20T01:55:21.847 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.847 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.848 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.848 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.848 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.848 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.848 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.848 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.848 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.848 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.848 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.848 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.848 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.848 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.849 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.849 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.849 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.849 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.849 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.849 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.849 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.849 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.849 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.849 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.849 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.849 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.849 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.849 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.850 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.850 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.850 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.850 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.850 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.850 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.850 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.850 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.850 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.850 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.850 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.851 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.851 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.851 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.851 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.851 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.851 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.851 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.851 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.851 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.851 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.851 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.851 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.851 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.852 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.852 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.852 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.852 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.852 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.852 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.852 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.852 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.852 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.852 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.852 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.852 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.852 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.853 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.853 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.853 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.853 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.853 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.853 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.853 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.853 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.853 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.853 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.853 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.853 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.854 INFO:teuthology.orchestra.run.smithi079.stdout: "motd": { 2024-08-20T01:55:21.854 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "motd", 2024-08-20T01:55:21.854 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.854 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.854 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.854 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.854 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.854 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.854 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.854 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "The message of the day", 2024-08-20T01:55:21.854 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.854 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.854 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.855 INFO:teuthology.orchestra.run.smithi079.stdout: "redirect_resolve_ip_addr": { 2024-08-20T01:55:21.855 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "redirect_resolve_ip_addr", 2024-08-20T01:55:21.855 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.855 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.855 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.855 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.855 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.855 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.855 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.855 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.855 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.855 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.855 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.856 INFO:teuthology.orchestra.run.smithi079.stdout: "server_addr": { 2024-08-20T01:55:21.856 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_addr", 2024-08-20T01:55:21.856 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.856 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.856 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.856 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "::", 2024-08-20T01:55:21.856 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.856 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.856 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.856 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.856 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.856 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.856 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.857 INFO:teuthology.orchestra.run.smithi079.stdout: "server_port": { 2024-08-20T01:55:21.857 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_port", 2024-08-20T01:55:21.857 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.857 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.857 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.857 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "8080", 2024-08-20T01:55:21.857 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.857 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.857 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.857 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.857 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.857 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.857 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.858 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.858 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.858 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.858 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.858 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.858 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.858 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.858 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.858 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.858 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.858 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.858 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.859 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.859 INFO:teuthology.orchestra.run.smithi079.stdout: "ssl": { 2024-08-20T01:55:21.859 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ssl", 2024-08-20T01:55:21.859 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.859 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.859 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.859 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.859 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.859 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.859 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.859 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.859 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.859 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.860 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.860 INFO:teuthology.orchestra.run.smithi079.stdout: "ssl_server_port": { 2024-08-20T01:55:21.860 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ssl_server_port", 2024-08-20T01:55:21.860 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.860 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.860 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.860 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "8443", 2024-08-20T01:55:21.860 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.860 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.860 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.860 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.860 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.861 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.861 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.861 INFO:teuthology.orchestra.run.smithi079.stdout: "standby_behaviour": { 2024-08-20T01:55:21.861 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "standby_behaviour", 2024-08-20T01:55:21.861 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.861 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.861 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.861 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "redirect", 2024-08-20T01:55:21.861 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.861 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.861 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.862 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.862 INFO:teuthology.orchestra.run.smithi079.stdout: "redirect" 2024-08-20T01:55:21.862 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.862 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.862 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.862 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.862 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.862 INFO:teuthology.orchestra.run.smithi079.stdout: "standby_error_status_code": { 2024-08-20T01:55:21.862 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "standby_error_status_code", 2024-08-20T01:55:21.862 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.862 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.862 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.863 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "500", 2024-08-20T01:55:21.863 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "400", 2024-08-20T01:55:21.863 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "599", 2024-08-20T01:55:21.863 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.863 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.863 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.863 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.863 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.863 INFO:teuthology.orchestra.run.smithi079.stdout: "url_prefix": { 2024-08-20T01:55:21.863 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "url_prefix", 2024-08-20T01:55:21.863 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.864 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.864 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.864 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.864 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.864 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.864 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.864 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.864 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.864 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.864 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.864 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.864 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.865 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "devicehealth", 2024-08-20T01:55:21.865 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.865 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.865 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.865 INFO:teuthology.orchestra.run.smithi079.stdout: "enable_monitoring": { 2024-08-20T01:55:21.865 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "enable_monitoring", 2024-08-20T01:55:21.865 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.865 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.865 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.865 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.866 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.866 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.866 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.866 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "monitor device health metrics", 2024-08-20T01:55:21.866 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.866 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.866 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.866 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.866 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.866 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.866 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.867 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.867 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.867 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.867 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.867 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.867 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.867 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.867 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.867 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.867 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.867 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.868 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.868 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.868 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.868 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.868 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.868 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.868 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.868 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.868 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.868 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.869 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.869 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.869 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.869 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.869 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.869 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.869 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.869 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.869 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.869 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.869 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.869 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.870 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.870 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.870 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.870 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.870 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.870 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.870 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.870 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.870 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.870 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.870 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.871 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.871 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.871 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.871 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.871 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.871 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.871 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.871 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.871 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.871 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.871 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.871 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.872 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.872 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.872 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.872 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.872 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.872 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.872 INFO:teuthology.orchestra.run.smithi079.stdout: "mark_out_threshold": { 2024-08-20T01:55:21.872 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "mark_out_threshold", 2024-08-20T01:55:21.872 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:21.872 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.872 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.873 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "2419200", 2024-08-20T01:55:21.873 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.873 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.873 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.873 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-20T01:55:21.873 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.873 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.873 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.873 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": { 2024-08-20T01:55:21.873 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "pool_name", 2024-08-20T01:55:21.873 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.873 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.874 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.874 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "device_health_metrics", 2024-08-20T01:55:21.874 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.874 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.874 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.874 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-20T01:55:21.874 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.874 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.874 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.874 INFO:teuthology.orchestra.run.smithi079.stdout: "retention_period": { 2024-08-20T01:55:21.875 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "retention_period", 2024-08-20T01:55:21.875 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:21.875 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.875 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.875 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "15552000", 2024-08-20T01:55:21.875 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.875 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.875 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.875 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how long to retain device health metrics", 2024-08-20T01:55:21.875 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.875 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.875 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.876 INFO:teuthology.orchestra.run.smithi079.stdout: "scrape_frequency": { 2024-08-20T01:55:21.876 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "scrape_frequency", 2024-08-20T01:55:21.876 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:21.876 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.876 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.876 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "86400", 2024-08-20T01:55:21.876 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.876 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.876 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.876 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-20T01:55:21.876 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.876 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.877 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.877 INFO:teuthology.orchestra.run.smithi079.stdout: "self_heal": { 2024-08-20T01:55:21.877 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "self_heal", 2024-08-20T01:55:21.877 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.877 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.877 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.877 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:21.877 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.877 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.877 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.878 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-20T01:55:21.878 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.878 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.878 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.878 INFO:teuthology.orchestra.run.smithi079.stdout: "sleep_interval": { 2024-08-20T01:55:21.878 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sleep_interval", 2024-08-20T01:55:21.878 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:21.878 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.878 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.879 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "600", 2024-08-20T01:55:21.879 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.879 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.879 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.879 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how frequently to wake up and check device health", 2024-08-20T01:55:21.879 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.879 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.879 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.879 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.879 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.880 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.880 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.880 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.880 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.880 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.880 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.880 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.880 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.880 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.880 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.880 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.881 INFO:teuthology.orchestra.run.smithi079.stdout: "warn_threshold": { 2024-08-20T01:55:21.881 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "warn_threshold", 2024-08-20T01:55:21.881 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:21.881 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.881 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.881 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "7257600", 2024-08-20T01:55:21.881 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.881 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.881 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.882 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-20T01:55:21.882 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.882 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.882 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.882 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.882 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.882 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "diskprediction_local", 2024-08-20T01:55:21.882 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.882 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.882 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.883 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.883 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.883 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.883 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.883 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.883 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.883 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.883 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.883 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.883 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.883 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.883 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.883 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.883 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.884 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.884 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.884 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.884 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.884 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.884 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.884 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.884 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.884 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.884 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.884 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.884 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.885 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.885 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.885 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.885 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.885 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.885 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.885 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.885 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.885 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.885 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.885 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.886 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.886 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.886 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.886 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.886 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.886 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.886 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.886 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.886 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.886 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.886 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.887 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.887 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.887 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.887 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.887 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.887 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.887 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.887 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.887 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.887 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.887 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.887 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.888 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.888 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.888 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.888 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.888 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.888 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.888 INFO:teuthology.orchestra.run.smithi079.stdout: "predict_interval": { 2024-08-20T01:55:21.888 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "predict_interval", 2024-08-20T01:55:21.888 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.888 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.888 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.888 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "86400", 2024-08-20T01:55:21.888 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.888 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.889 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.889 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.889 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.889 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.889 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.889 INFO:teuthology.orchestra.run.smithi079.stdout: "predictor_model": { 2024-08-20T01:55:21.889 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "predictor_model", 2024-08-20T01:55:21.889 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.889 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.889 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.889 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "prophetstor", 2024-08-20T01:55:21.889 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.890 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.890 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.890 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.890 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.890 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.890 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.890 INFO:teuthology.orchestra.run.smithi079.stdout: "sleep_interval": { 2024-08-20T01:55:21.890 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sleep_interval", 2024-08-20T01:55:21.890 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.890 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.891 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.891 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "600", 2024-08-20T01:55:21.891 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.891 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.891 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.891 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.891 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.891 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.891 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.891 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.891 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.891 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.891 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.892 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.892 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.892 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.892 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.892 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.892 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.892 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.892 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.892 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.892 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.892 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.893 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "influx", 2024-08-20T01:55:21.893 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": false, 2024-08-20T01:55:21.893 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "influxdb python module not found", 2024-08-20T01:55:21.893 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.893 INFO:teuthology.orchestra.run.smithi079.stdout: "batch_size": { 2024-08-20T01:55:21.893 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "batch_size", 2024-08-20T01:55:21.893 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.893 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.894 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.894 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5000", 2024-08-20T01:55:21.894 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.894 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.894 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.894 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-20T01:55:21.894 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.894 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.894 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.895 INFO:teuthology.orchestra.run.smithi079.stdout: "database": { 2024-08-20T01:55:21.895 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "database", 2024-08-20T01:55:21.895 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.895 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.895 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.895 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "ceph", 2024-08-20T01:55:21.895 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.896 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.896 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.896 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-20T01:55:21.896 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.896 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.896 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.896 INFO:teuthology.orchestra.run.smithi079.stdout: "hostname": { 2024-08-20T01:55:21.896 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "hostname", 2024-08-20T01:55:21.896 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.896 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.896 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.897 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.897 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.897 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.897 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.897 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "InfluxDB server hostname", 2024-08-20T01:55:21.897 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.897 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.897 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.897 INFO:teuthology.orchestra.run.smithi079.stdout: "interval": { 2024-08-20T01:55:21.897 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "interval", 2024-08-20T01:55:21.897 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:21.897 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.898 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.898 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "30", 2024-08-20T01:55:21.898 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "5", 2024-08-20T01:55:21.898 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.898 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.898 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-20T01:55:21.898 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.898 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.898 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.898 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.898 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.899 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.899 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.899 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.899 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.899 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.899 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.899 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.899 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.899 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.899 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.899 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.899 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.899 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.899 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.900 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.900 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.900 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.900 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.900 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.900 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.900 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.900 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.900 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.900 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.900 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.900 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.900 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.901 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.901 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.901 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.901 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.901 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.901 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.901 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.901 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.901 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.901 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.901 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.901 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.902 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.902 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.902 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.902 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.902 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.902 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.902 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.902 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.902 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.902 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.902 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.902 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.903 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.903 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.903 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.903 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.903 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.903 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.903 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.903 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.903 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.903 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.903 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.903 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.903 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.904 INFO:teuthology.orchestra.run.smithi079.stdout: "password": { 2024-08-20T01:55:21.904 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "password", 2024-08-20T01:55:21.904 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.904 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.904 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.904 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.904 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.904 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.904 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.904 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "password of InfluxDB server user", 2024-08-20T01:55:21.904 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.904 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.904 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.905 INFO:teuthology.orchestra.run.smithi079.stdout: "port": { 2024-08-20T01:55:21.905 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "port", 2024-08-20T01:55:21.905 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.905 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.905 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.905 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "8086", 2024-08-20T01:55:21.905 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.905 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.905 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.905 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "InfluxDB server port", 2024-08-20T01:55:21.905 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.906 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.906 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.906 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.906 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.906 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.906 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.906 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.906 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.906 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.906 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.906 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.907 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.907 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.907 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.907 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.907 INFO:teuthology.orchestra.run.smithi079.stdout: "ssl": { 2024-08-20T01:55:21.907 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ssl", 2024-08-20T01:55:21.907 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.907 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.907 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.907 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "false", 2024-08-20T01:55:21.907 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.907 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.907 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.908 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-20T01:55:21.908 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.908 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.908 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.908 INFO:teuthology.orchestra.run.smithi079.stdout: "threads": { 2024-08-20T01:55:21.908 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "threads", 2024-08-20T01:55:21.908 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.908 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.908 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.908 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5", 2024-08-20T01:55:21.908 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "1", 2024-08-20T01:55:21.908 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "32", 2024-08-20T01:55:21.908 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.909 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-20T01:55:21.909 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.909 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.909 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.909 INFO:teuthology.orchestra.run.smithi079.stdout: "username": { 2024-08-20T01:55:21.909 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "username", 2024-08-20T01:55:21.909 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.909 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.909 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.909 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.909 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.909 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.909 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.910 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "username of InfluxDB server user", 2024-08-20T01:55:21.910 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.910 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.910 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.910 INFO:teuthology.orchestra.run.smithi079.stdout: "verify_ssl": { 2024-08-20T01:55:21.910 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "verify_ssl", 2024-08-20T01:55:21.910 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.910 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.910 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.910 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "true", 2024-08-20T01:55:21.910 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.911 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.911 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.911 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-20T01:55:21.911 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.911 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.911 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.911 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.911 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.911 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "insights", 2024-08-20T01:55:21.911 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.911 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.911 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.912 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.912 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.912 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.912 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.912 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.912 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.912 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.912 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.912 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.912 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.912 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.912 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.912 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.912 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.913 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.913 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.913 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.913 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.913 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.913 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.913 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.913 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.913 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.913 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.913 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.913 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.913 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.914 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.914 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.914 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.914 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.914 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.914 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.914 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.914 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.914 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.914 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.915 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.915 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.915 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.915 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.915 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.915 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.915 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.915 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.915 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.915 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.915 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.915 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.915 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.915 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.916 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.916 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.916 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.916 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.916 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.916 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.916 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.916 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.916 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.916 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.916 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.916 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.917 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.917 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.917 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.917 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.917 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.917 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.917 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.917 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.917 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.917 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.917 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.917 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.917 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.918 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.918 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.918 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.918 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.918 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.918 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "iostat", 2024-08-20T01:55:21.918 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.919 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.919 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.919 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.919 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.919 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.919 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.919 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.919 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.919 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.919 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.919 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.919 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.919 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.920 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.920 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.920 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.920 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.920 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.920 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.920 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.920 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.920 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.920 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.920 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.920 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.920 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.921 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.921 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.921 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.921 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.921 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.921 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.921 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.921 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.921 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.921 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.921 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.921 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.922 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.922 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.922 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.922 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.922 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.922 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.922 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.922 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.922 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.922 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.922 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.923 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.923 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.923 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.923 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.923 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.923 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.923 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.923 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.923 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.923 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.923 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.923 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.924 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.924 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.924 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.924 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.924 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.924 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.924 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.924 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.924 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.924 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.924 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.924 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.925 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.925 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.925 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.925 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.925 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.925 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.925 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.925 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.925 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.925 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.926 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "k8sevents", 2024-08-20T01:55:21.926 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.926 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.926 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.926 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_event_retention_days": { 2024-08-20T01:55:21.926 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "ceph_event_retention_days", 2024-08-20T01:55:21.926 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.926 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.926 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.926 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "7", 2024-08-20T01:55:21.926 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.926 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.927 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.927 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-20T01:55:21.927 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.927 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.927 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.927 INFO:teuthology.orchestra.run.smithi079.stdout: "config_check_secs": { 2024-08-20T01:55:21.927 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "config_check_secs", 2024-08-20T01:55:21.927 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.927 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.927 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.927 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-08-20T01:55:21.928 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "10", 2024-08-20T01:55:21.928 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.928 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.928 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-20T01:55:21.928 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.928 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.928 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.928 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.928 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.928 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.928 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.928 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.929 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.929 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.929 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.929 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.929 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.929 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.929 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.929 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.929 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.929 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.929 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.929 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.929 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.929 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.930 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.930 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.930 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.930 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.930 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.930 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.930 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.930 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.930 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.931 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.931 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.931 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.931 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.931 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.931 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.931 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.931 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.931 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.931 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.931 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.931 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.931 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.932 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.932 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.932 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.932 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.932 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.932 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.932 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.932 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.932 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.932 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.932 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.932 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.932 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.933 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.933 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.933 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.933 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.933 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.933 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.933 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.933 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.933 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.933 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.933 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.934 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.934 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.934 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.934 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.934 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.934 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.934 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.934 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.934 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.934 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.935 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.935 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.935 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.935 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.935 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.935 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.935 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "localpool", 2024-08-20T01:55:21.935 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.935 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.936 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.936 INFO:teuthology.orchestra.run.smithi079.stdout: "failure_domain": { 2024-08-20T01:55:21.936 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "failure_domain", 2024-08-20T01:55:21.936 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.936 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.936 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.936 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "host", 2024-08-20T01:55:21.936 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.936 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.936 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.936 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "failure domain for any created local pool", 2024-08-20T01:55:21.936 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-20T01:55:21.937 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.937 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.937 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.937 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.937 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.937 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.937 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.937 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.937 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.937 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.937 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.938 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.938 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.938 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.938 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.938 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.938 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.938 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.938 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.938 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.938 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.938 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.939 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.939 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.939 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.939 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.939 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.939 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.939 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.939 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.939 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.939 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.939 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.940 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.940 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.940 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.940 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.940 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.940 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.940 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.940 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.940 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.940 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.940 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.941 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.941 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.941 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.941 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.941 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.941 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.941 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.941 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.941 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.941 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.941 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.942 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.942 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.942 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.942 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.942 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.942 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.942 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.942 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.942 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.942 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.942 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.942 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.943 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.943 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": { 2024-08-20T01:55:21.943 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "min_size", 2024-08-20T01:55:21.943 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.943 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.943 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.943 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.943 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.943 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.943 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.943 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "default min_size for any created local pool", 2024-08-20T01:55:21.944 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-20T01:55:21.944 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.944 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.944 INFO:teuthology.orchestra.run.smithi079.stdout: "num_rep": { 2024-08-20T01:55:21.944 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "num_rep", 2024-08-20T01:55:21.944 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.944 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.944 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.944 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "3", 2024-08-20T01:55:21.944 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.944 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.944 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.944 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "default replica count for any created local pool", 2024-08-20T01:55:21.945 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.945 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.945 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.945 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": { 2024-08-20T01:55:21.945 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "pg_num", 2024-08-20T01:55:21.945 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.945 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.945 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.945 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "128", 2024-08-20T01:55:21.945 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.945 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.946 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.946 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "default pg_num for any created local pool", 2024-08-20T01:55:21.946 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.946 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.946 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.946 INFO:teuthology.orchestra.run.smithi079.stdout: "prefix": { 2024-08-20T01:55:21.946 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "prefix", 2024-08-20T01:55:21.946 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.946 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.946 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.946 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.947 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.947 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.947 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.947 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "name prefix for any created local pool", 2024-08-20T01:55:21.947 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.947 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.947 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.947 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.947 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.947 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.947 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.947 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.947 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.948 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.948 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.948 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.948 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.948 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.948 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.948 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.948 INFO:teuthology.orchestra.run.smithi079.stdout: "subtree": { 2024-08-20T01:55:21.948 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "subtree", 2024-08-20T01:55:21.948 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.948 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.948 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.948 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "rack", 2024-08-20T01:55:21.949 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.949 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.949 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.949 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-20T01:55:21.949 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-20T01:55:21.949 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.949 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.949 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.949 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.949 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "mds_autoscaler", 2024-08-20T01:55:21.949 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.949 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.950 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.950 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.950 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.950 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.950 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.950 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.950 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.950 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.950 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.950 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.950 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.950 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.951 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.951 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.951 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.951 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.951 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.951 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.951 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.951 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.951 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.951 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.951 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.951 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.951 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.952 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.952 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.952 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.952 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.952 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.952 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.952 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.952 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.952 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.952 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.952 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.952 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.953 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.953 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.953 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.953 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.953 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.953 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.953 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.953 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.953 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.953 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.953 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.953 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.953 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.954 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.954 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.954 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.954 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.954 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.954 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.954 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.954 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.954 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.954 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.954 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.955 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.955 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.955 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.955 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.955 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.955 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.955 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.955 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.955 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.955 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.955 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.955 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.955 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.956 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.956 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.956 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.956 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.956 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.956 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.956 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.956 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.956 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "mirroring", 2024-08-20T01:55:21.956 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.956 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.956 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.957 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.957 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.957 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.957 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.957 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.957 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.957 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.957 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.957 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.957 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.957 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.957 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.957 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.958 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.958 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.958 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.958 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.958 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.958 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.958 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.958 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.958 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.958 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.958 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.958 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.959 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.959 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.959 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.959 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.959 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.959 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.959 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.959 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.959 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.959 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.959 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.959 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.959 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.960 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.960 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.960 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.960 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.960 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.960 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.960 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.960 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.960 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.960 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.960 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.960 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.960 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.960 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.961 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.961 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.961 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.961 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.961 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.961 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.961 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.961 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.961 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.961 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.961 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.961 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.961 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.962 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.962 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.962 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.962 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.962 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.962 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.962 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.962 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.962 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.962 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.962 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.962 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.962 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.963 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.963 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.963 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.963 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "nfs", 2024-08-20T01:55:21.963 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.963 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.963 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.963 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.963 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.963 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.964 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.964 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.964 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.964 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.964 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.964 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.964 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.964 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.964 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.964 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.964 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.964 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.964 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.965 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.965 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.965 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.965 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.965 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.965 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.965 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.965 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.965 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.965 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.965 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.965 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.966 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.966 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.966 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.966 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.966 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.966 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.966 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.966 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.966 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.966 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.966 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.967 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.967 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.967 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.967 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.967 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.967 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.967 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.967 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.967 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.967 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.967 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.967 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.967 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.967 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.968 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.968 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.968 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.968 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.968 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.968 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.968 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.968 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.968 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.968 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.969 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.969 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.969 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.969 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.969 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.969 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.969 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.969 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.969 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.969 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.969 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.969 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.970 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.970 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.970 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.970 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.970 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.970 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.970 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "orchestrator", 2024-08-20T01:55:21.970 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.970 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.970 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.970 INFO:teuthology.orchestra.run.smithi079.stdout: "fail_fs": { 2024-08-20T01:55:21.971 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "fail_fs", 2024-08-20T01:55:21.971 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.971 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.971 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.971 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.971 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.971 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.971 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.971 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-20T01:55:21.971 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.971 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.971 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.971 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.972 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.972 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.972 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.972 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.972 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.972 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.972 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.972 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.972 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.972 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.972 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.972 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.972 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.973 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.973 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.973 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.973 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.973 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.973 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.973 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.973 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.973 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.973 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.973 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.973 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.973 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.974 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.974 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.974 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.974 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.974 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.974 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.974 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.974 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.974 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.974 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.974 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.974 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.975 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.975 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.975 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.975 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.975 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.975 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.975 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.975 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.975 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.975 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.975 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.975 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.975 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.976 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.976 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.976 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.976 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.976 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.976 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.976 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.976 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.976 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.976 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.976 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.976 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.976 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.977 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.977 INFO:teuthology.orchestra.run.smithi079.stdout: "orchestrator": { 2024-08-20T01:55:21.977 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "orchestrator", 2024-08-20T01:55:21.977 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.977 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.977 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.977 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.977 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.977 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.977 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.977 INFO:teuthology.orchestra.run.smithi079.stdout: "cephadm", 2024-08-20T01:55:21.977 INFO:teuthology.orchestra.run.smithi079.stdout: "rook", 2024-08-20T01:55:21.978 INFO:teuthology.orchestra.run.smithi079.stdout: "test_orchestrator" 2024-08-20T01:55:21.978 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.978 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Orchestrator backend", 2024-08-20T01:55:21.978 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.978 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.978 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.978 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.978 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.978 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.978 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.979 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.979 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.979 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.979 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.979 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.979 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.979 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.979 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.979 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.979 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.979 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.980 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "osd_perf_query", 2024-08-20T01:55:21.980 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.980 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.980 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.980 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.980 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.980 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.980 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.980 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.980 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.980 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.980 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.981 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.981 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.981 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.981 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.981 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.981 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.981 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.981 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.981 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.981 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.981 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.982 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.982 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.982 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.982 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.982 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.982 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.982 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.982 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.982 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.982 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.982 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.983 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.983 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.983 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.983 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.983 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.983 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.983 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.983 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.983 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.983 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.983 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.983 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.983 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.984 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.984 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.984 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.984 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.984 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.984 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.984 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.984 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.984 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.984 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.984 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.984 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.984 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.985 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.985 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.985 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.985 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.985 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.985 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.985 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.985 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.985 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.985 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.985 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.985 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.985 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.986 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.986 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.986 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.986 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.986 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.986 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.986 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.986 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.986 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.986 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.986 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.986 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.987 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "osd_support", 2024-08-20T01:55:21.987 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.987 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.987 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.987 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.987 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.987 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.987 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.987 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.987 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.987 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.987 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.987 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.988 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.988 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.988 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.988 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.988 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.988 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.988 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.988 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.988 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.988 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.988 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.988 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.989 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.989 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.989 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.989 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.989 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.989 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.989 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.989 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.989 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.989 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.989 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.989 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.989 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.990 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.990 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.990 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.990 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.990 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.990 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.990 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.990 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.990 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.990 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.990 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.990 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.991 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.991 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.991 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.991 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.991 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.991 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.991 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.991 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.991 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.991 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.991 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.991 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.991 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.992 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.992 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.992 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.992 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.992 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.992 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.992 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.992 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:21.992 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:21.992 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:21.992 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:21.992 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.993 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:21.993 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.993 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.993 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.993 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.993 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.993 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.993 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.993 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.993 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:21.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:21.993 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "pg_autoscaler", 2024-08-20T01:55:21.993 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:21.994 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:21.994 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:21.994 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:21.994 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:21.994 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.994 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.994 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.994 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:21.994 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.994 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.994 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.994 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.994 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.995 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.995 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.995 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.995 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.995 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.995 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.995 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.995 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.995 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.995 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:21.995 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:21.995 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.995 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.996 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.996 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.996 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.996 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.996 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.996 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.996 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.996 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.996 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.996 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:21.996 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:21.996 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:21.996 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.997 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.997 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:21.997 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.997 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.997 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:21.997 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:21.997 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:21.997 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:21.997 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:21.997 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:21.997 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:21.997 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:21.997 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.997 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.998 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.998 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.998 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:21.998 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:21.998 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:21.998 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.998 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:21.998 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:21.998 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.998 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.998 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.998 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:21.999 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:21.999 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:21.999 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:21.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:21.999 INFO:teuthology.orchestra.run.smithi079.stdout: "sleep_interval": { 2024-08-20T01:55:21.999 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sleep_interval", 2024-08-20T01:55:21.999 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:21.999 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:21.999 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:21.999 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "60", 2024-08-20T01:55:21.999 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:21.999 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:21.999 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:21.999 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.000 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.000 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.000 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.000 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:22.000 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:22.000 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:22.000 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:22.000 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.000 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:22.000 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.000 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.000 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.000 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.001 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.001 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.001 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.001 INFO:teuthology.orchestra.run.smithi079.stdout: "threshold": { 2024-08-20T01:55:22.001 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "threshold", 2024-08-20T01:55:22.001 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2024-08-20T01:55:22.001 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.001 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.001 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "3.0", 2024-08-20T01:55:22.001 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "1.0", 2024-08-20T01:55:22.001 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.001 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.001 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "scaling threshold", 2024-08-20T01:55:22.001 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-20T01:55:22.002 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.002 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.002 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:22.002 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:22.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:22.002 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "progress", 2024-08-20T01:55:22.002 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:22.002 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:22.002 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:22.002 INFO:teuthology.orchestra.run.smithi079.stdout: "allow_pg_recovery_event": { 2024-08-20T01:55:22.002 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "allow_pg_recovery_event", 2024-08-20T01:55:22.002 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.003 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.003 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.003 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:22.003 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.003 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.003 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.003 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-20T01:55:22.003 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.003 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.003 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.003 INFO:teuthology.orchestra.run.smithi079.stdout: "enabled": { 2024-08-20T01:55:22.003 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "enabled", 2024-08-20T01:55:22.003 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.004 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.004 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.004 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:22.004 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.004 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.004 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.004 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.004 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.004 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.004 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.004 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:22.004 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:22.004 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.005 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.005 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.005 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:22.005 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.005 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.005 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:22.005 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:22.005 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:22.005 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:22.005 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:22.005 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:22.005 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:22.005 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:22.006 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.006 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.006 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.006 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.006 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:22.006 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:22.006 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.006 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.006 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.006 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:22.006 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.007 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.007 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.007 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.007 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.007 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.007 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.007 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:22.007 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:22.007 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.007 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.007 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.007 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:22.008 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.008 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.008 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:22.008 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:22.008 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:22.008 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:22.008 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:22.008 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:22.008 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:22.008 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:22.008 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.008 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.008 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.008 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.009 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:22.009 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:22.009 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.009 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.009 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.009 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:22.009 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.009 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.009 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.009 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.009 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.009 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.009 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.010 INFO:teuthology.orchestra.run.smithi079.stdout: "max_completed_events": { 2024-08-20T01:55:22.010 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "max_completed_events", 2024-08-20T01:55:22.010 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:22.010 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.010 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.010 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "50", 2024-08-20T01:55:22.010 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.010 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.010 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.010 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "number of past completed events to remember", 2024-08-20T01:55:22.010 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.010 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.011 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.011 INFO:teuthology.orchestra.run.smithi079.stdout: "sleep_interval": { 2024-08-20T01:55:22.011 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sleep_interval", 2024-08-20T01:55:22.011 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:22.011 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.011 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.011 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5", 2024-08-20T01:55:22.011 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.011 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.011 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.011 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "how long the module is going to sleep", 2024-08-20T01:55:22.012 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.012 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.012 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.012 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:22.012 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:22.012 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:22.012 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:22.012 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.012 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:22.012 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.012 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.012 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.013 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.013 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.013 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.013 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.013 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:22.013 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:22.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:22.013 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "prometheus", 2024-08-20T01:55:22.013 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:22.013 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:22.013 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:22.013 INFO:teuthology.orchestra.run.smithi079.stdout: "cache": { 2024-08-20T01:55:22.013 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "cache", 2024-08-20T01:55:22.014 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.014 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.014 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.014 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:22.014 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.014 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.014 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.014 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.014 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.014 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.014 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.015 INFO:teuthology.orchestra.run.smithi079.stdout: "exclude_perf_counters": { 2024-08-20T01:55:22.015 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "exclude_perf_counters", 2024-08-20T01:55:22.015 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.015 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.015 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.015 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:22.015 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.015 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.015 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.015 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-20T01:55:22.015 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-20T01:55:22.015 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.016 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.016 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:22.016 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:22.016 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.016 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.016 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.016 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:22.016 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.016 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.016 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:22.016 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:22.016 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:22.016 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:22.017 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:22.017 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:22.017 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:22.017 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:22.017 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.017 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.017 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.017 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.017 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:22.017 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:22.017 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.017 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.017 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.018 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:22.018 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.018 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.018 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.018 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.018 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.018 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.018 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.018 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:22.018 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:22.018 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.018 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.019 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.019 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:22.019 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.019 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.019 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:22.019 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:22.019 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:22.019 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:22.019 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:22.019 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:22.020 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:22.020 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:22.020 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.020 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.020 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.020 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.020 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:22.020 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:22.020 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.020 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.020 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.020 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:22.021 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.021 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.021 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.021 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.021 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.021 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.021 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.021 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_stats_pools": { 2024-08-20T01:55:22.021 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rbd_stats_pools", 2024-08-20T01:55:22.021 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.022 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.022 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.022 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:22.022 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.022 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.022 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.022 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.022 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.022 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.022 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.023 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-20T01:55:22.023 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-20T01:55:22.023 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:22.023 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.023 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.023 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "300", 2024-08-20T01:55:22.023 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.023 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.023 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.023 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.023 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.023 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.023 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.024 INFO:teuthology.orchestra.run.smithi079.stdout: "scrape_interval": { 2024-08-20T01:55:22.024 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "scrape_interval", 2024-08-20T01:55:22.024 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2024-08-20T01:55:22.024 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.024 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.024 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "15.0", 2024-08-20T01:55:22.024 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.024 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.024 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.024 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.024 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.025 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.025 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.025 INFO:teuthology.orchestra.run.smithi079.stdout: "server_addr": { 2024-08-20T01:55:22.025 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_addr", 2024-08-20T01:55:22.025 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.025 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.025 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.025 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "::", 2024-08-20T01:55:22.025 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.025 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.025 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.025 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-20T01:55:22.025 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.026 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.026 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.026 INFO:teuthology.orchestra.run.smithi079.stdout: "server_port": { 2024-08-20T01:55:22.026 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_port", 2024-08-20T01:55:22.026 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:22.026 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.026 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.026 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "9283", 2024-08-20T01:55:22.026 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.026 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.026 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.026 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-20T01:55:22.026 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.027 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.027 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.027 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:22.027 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:22.027 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:22.027 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:22.027 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.027 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:22.027 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.027 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.027 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.027 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.028 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.028 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.028 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.028 INFO:teuthology.orchestra.run.smithi079.stdout: "stale_cache_strategy": { 2024-08-20T01:55:22.028 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "stale_cache_strategy", 2024-08-20T01:55:22.028 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.028 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.028 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.028 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "log", 2024-08-20T01:55:22.028 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.028 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.029 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.029 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.029 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.029 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.029 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.029 INFO:teuthology.orchestra.run.smithi079.stdout: "standby_behaviour": { 2024-08-20T01:55:22.029 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "standby_behaviour", 2024-08-20T01:55:22.029 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.029 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.029 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.029 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "default", 2024-08-20T01:55:22.029 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.029 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.030 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:22.030 INFO:teuthology.orchestra.run.smithi079.stdout: "default", 2024-08-20T01:55:22.030 INFO:teuthology.orchestra.run.smithi079.stdout: "error" 2024-08-20T01:55:22.030 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:22.030 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.030 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.030 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.030 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.030 INFO:teuthology.orchestra.run.smithi079.stdout: "standby_error_status_code": { 2024-08-20T01:55:22.030 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "standby_error_status_code", 2024-08-20T01:55:22.031 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:22.031 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.031 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.031 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "500", 2024-08-20T01:55:22.031 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "400", 2024-08-20T01:55:22.031 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "599", 2024-08-20T01:55:22.031 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.031 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.031 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.031 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.031 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.031 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:22.032 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:22.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:22.032 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rbd_support", 2024-08-20T01:55:22.032 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:22.032 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:22.032 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:22.032 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:22.032 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:22.032 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.032 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.032 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.032 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:22.032 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.033 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.033 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:22.033 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:22.033 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:22.033 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:22.033 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:22.033 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:22.033 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:22.033 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:22.033 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.033 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.033 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.033 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.034 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:22.034 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:22.034 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.034 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.034 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.034 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:22.034 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.034 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.034 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.034 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.034 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.034 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.034 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.035 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:22.035 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:22.035 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.035 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.035 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.035 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:22.035 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.035 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.035 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:22.035 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:22.035 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:22.035 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:22.036 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:22.036 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:22.036 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:22.036 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:22.036 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.036 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.036 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.036 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.036 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:22.036 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:22.036 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.036 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.036 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.036 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:22.037 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.037 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.037 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.037 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.037 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.037 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.037 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.037 INFO:teuthology.orchestra.run.smithi079.stdout: "max_concurrent_snap_create": { 2024-08-20T01:55:22.037 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "max_concurrent_snap_create", 2024-08-20T01:55:22.037 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:22.037 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.037 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.037 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10", 2024-08-20T01:55:22.038 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.038 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.038 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.038 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.038 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.038 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.038 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.038 INFO:teuthology.orchestra.run.smithi079.stdout: "mirror_snapshot_schedule": { 2024-08-20T01:55:22.038 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "mirror_snapshot_schedule", 2024-08-20T01:55:22.038 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.038 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.038 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.039 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:22.039 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.039 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.039 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.039 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.039 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.039 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.039 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.039 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:22.039 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:22.039 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:22.039 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:22.039 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.040 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:22.040 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.040 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.040 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.040 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.040 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.040 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.040 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.040 INFO:teuthology.orchestra.run.smithi079.stdout: "trash_purge_schedule": { 2024-08-20T01:55:22.040 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "trash_purge_schedule", 2024-08-20T01:55:22.040 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.040 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.040 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.041 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:22.041 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.041 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.041 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.041 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.041 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.041 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.041 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.041 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:22.041 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:22.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:22.042 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "restful", 2024-08-20T01:55:22.042 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:22.042 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:22.042 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:22.042 INFO:teuthology.orchestra.run.smithi079.stdout: "enable_auth": { 2024-08-20T01:55:22.042 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "enable_auth", 2024-08-20T01:55:22.042 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.042 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.042 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.042 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:22.042 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.042 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.042 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.043 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.043 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.043 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.043 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.043 INFO:teuthology.orchestra.run.smithi079.stdout: "key_file": { 2024-08-20T01:55:22.043 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "key_file", 2024-08-20T01:55:22.043 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.043 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.043 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.043 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:22.043 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.043 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.043 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.044 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.044 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.044 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.044 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.044 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:22.044 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:22.044 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.044 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.044 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.044 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:22.044 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.044 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.044 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:22.045 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:22.045 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:22.045 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:22.045 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:22.045 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:22.045 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:22.045 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:22.045 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.045 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.045 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.045 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.046 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:22.046 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:22.046 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.046 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.046 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.046 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:22.046 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.046 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.046 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.046 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.046 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.046 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.046 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.047 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:22.047 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:22.047 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.047 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.047 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.047 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:22.047 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.047 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.047 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:22.047 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:22.047 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:22.047 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:22.047 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:22.048 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:22.048 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:22.048 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:22.048 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.048 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.048 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.048 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.048 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:22.048 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:22.048 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.048 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.049 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.049 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:22.049 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.049 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.049 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.049 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.049 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.049 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.049 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.049 INFO:teuthology.orchestra.run.smithi079.stdout: "server_addr": { 2024-08-20T01:55:22.049 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_addr", 2024-08-20T01:55:22.049 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.049 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.050 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.050 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:22.050 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.050 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.050 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.050 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.050 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.050 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.050 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.050 INFO:teuthology.orchestra.run.smithi079.stdout: "server_port": { 2024-08-20T01:55:22.050 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "server_port", 2024-08-20T01:55:22.050 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.050 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.051 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.051 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:22.051 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.051 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.051 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.051 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.051 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.051 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.051 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.051 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:22.051 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:22.051 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:22.052 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:22.052 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.052 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:22.052 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.052 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.052 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.052 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.052 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.052 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.052 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.052 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:22.052 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:22.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:22.053 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rgw", 2024-08-20T01:55:22.053 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:22.053 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:22.053 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:22.053 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:22.053 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:22.053 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.053 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.053 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.053 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:22.053 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.054 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.054 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:22.054 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:22.054 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:22.054 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:22.054 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:22.054 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:22.054 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:22.054 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:22.054 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.054 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.054 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.054 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.055 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:22.055 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:22.055 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.055 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.055 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.055 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:22.055 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.055 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.055 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.055 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.055 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.055 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.055 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.056 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:22.056 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:22.056 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.056 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.056 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.056 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:22.056 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.056 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.056 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:22.056 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:22.056 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:22.056 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:22.056 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:22.056 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:22.057 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:22.057 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:22.057 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.057 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.057 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.057 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.057 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:22.057 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:22.057 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.057 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.057 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.057 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:22.057 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.058 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.058 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.058 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.058 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.058 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.058 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.058 INFO:teuthology.orchestra.run.smithi079.stdout: "secondary_zone_period_retry_limit": { 2024-08-20T01:55:22.058 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "secondary_zone_period_retry_limit", 2024-08-20T01:55:22.058 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:22.058 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.058 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.058 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "5", 2024-08-20T01:55:22.059 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.059 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.059 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.059 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-08-20T01:55:22.059 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.059 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.059 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.059 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:22.059 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:22.059 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:22.059 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:22.059 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.059 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:22.060 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.060 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.060 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.060 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.060 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.060 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.060 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.060 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:22.060 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:22.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:22.060 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rook", 2024-08-20T01:55:22.060 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:22.061 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:22.061 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:22.061 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:22.061 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:22.061 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.061 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.061 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.061 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:22.061 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.061 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.061 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:22.061 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:22.061 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:22.061 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:22.062 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:22.062 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:22.062 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:22.062 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:22.062 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.062 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.062 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.062 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.062 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:22.062 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:22.062 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.062 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.063 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.063 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:22.063 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.063 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.063 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.063 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.063 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.063 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.063 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.063 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:22.063 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:22.063 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.063 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.064 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.064 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:22.064 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.064 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.064 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:22.064 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:22.064 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:22.064 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:22.064 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:22.064 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:22.064 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:22.064 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:22.064 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.065 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.065 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.065 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.065 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:22.065 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:22.065 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.065 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.065 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.065 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:22.065 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.065 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.065 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.065 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.066 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.066 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.066 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.066 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:22.066 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:22.066 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:22.066 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:22.066 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.066 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:22.066 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.067 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.067 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.067 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.067 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.067 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.067 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.067 INFO:teuthology.orchestra.run.smithi079.stdout: "storage_class": { 2024-08-20T01:55:22.067 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "storage_class", 2024-08-20T01:55:22.067 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.067 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.067 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.067 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "local", 2024-08-20T01:55:22.067 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.068 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.068 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.068 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-20T01:55:22.068 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.068 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.068 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.068 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:22.068 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:22.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:22.068 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "selftest", 2024-08-20T01:55:22.068 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:22.069 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:22.069 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:22.069 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:22.069 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:22.069 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.069 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.069 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.069 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:22.069 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.069 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.069 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:22.069 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:22.069 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:22.069 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:22.070 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:22.070 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:22.070 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:22.070 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:22.070 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.070 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.070 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.070 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.070 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:22.070 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:22.070 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.070 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.071 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.071 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:22.071 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.071 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.071 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.071 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.071 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.071 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.071 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.071 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:22.071 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:22.071 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.071 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.072 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.072 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:22.072 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.072 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.072 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:22.072 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:22.072 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:22.072 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:22.072 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:22.072 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:22.072 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:22.072 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:22.072 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.073 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.073 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.073 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.073 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:22.073 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:22.073 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.073 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.073 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.073 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:22.073 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.073 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.073 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.074 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.074 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.074 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.074 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.074 INFO:teuthology.orchestra.run.smithi079.stdout: "roption1": { 2024-08-20T01:55:22.074 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "roption1", 2024-08-20T01:55:22.074 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.074 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.074 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.074 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:22.074 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.074 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.075 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.075 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.075 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.075 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.075 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.075 INFO:teuthology.orchestra.run.smithi079.stdout: "roption2": { 2024-08-20T01:55:22.075 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "roption2", 2024-08-20T01:55:22.075 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.075 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.075 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.075 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "xyz", 2024-08-20T01:55:22.075 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.075 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.076 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.076 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.076 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.076 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.076 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.076 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption1": { 2024-08-20T01:55:22.076 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption1", 2024-08-20T01:55:22.076 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.076 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.076 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.076 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:22.076 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.076 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.077 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.077 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.077 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.077 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.077 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.077 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption2": { 2024-08-20T01:55:22.077 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption2", 2024-08-20T01:55:22.077 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:22.077 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.077 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.077 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:22.077 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.077 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.078 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.078 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.078 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.078 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.078 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.078 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption3": { 2024-08-20T01:55:22.078 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption3", 2024-08-20T01:55:22.078 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "float", 2024-08-20T01:55:22.078 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.078 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.078 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:22.079 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.079 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.079 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.079 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.079 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.079 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.079 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.079 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption4": { 2024-08-20T01:55:22.079 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption4", 2024-08-20T01:55:22.079 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.080 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.080 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.080 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:22.080 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.080 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.080 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.080 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.080 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.080 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.080 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.080 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption5": { 2024-08-20T01:55:22.080 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption5", 2024-08-20T01:55:22.081 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.081 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.081 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.081 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:22.081 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.081 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.081 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.081 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.081 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.081 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.081 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.081 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption6": { 2024-08-20T01:55:22.082 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption6", 2024-08-20T01:55:22.082 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.082 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.082 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.082 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:22.082 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.082 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.082 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.082 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.082 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.083 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.083 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.083 INFO:teuthology.orchestra.run.smithi079.stdout: "rwoption7": { 2024-08-20T01:55:22.083 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rwoption7", 2024-08-20T01:55:22.083 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:22.083 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.083 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.083 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:22.083 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "1", 2024-08-20T01:55:22.083 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "42", 2024-08-20T01:55:22.083 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.083 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.083 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.084 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.084 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.084 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:22.084 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:22.084 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:22.084 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:22.084 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.084 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:22.084 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.084 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.084 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.084 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.085 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.085 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.085 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.085 INFO:teuthology.orchestra.run.smithi079.stdout: "testkey": { 2024-08-20T01:55:22.085 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "testkey", 2024-08-20T01:55:22.085 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.085 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.085 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.085 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:22.085 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.085 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.085 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.085 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.086 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.086 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.086 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.086 INFO:teuthology.orchestra.run.smithi079.stdout: "testlkey": { 2024-08-20T01:55:22.086 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "testlkey", 2024-08-20T01:55:22.086 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.086 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.086 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.086 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:22.086 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.086 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.086 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.087 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.087 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.087 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.087 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.087 INFO:teuthology.orchestra.run.smithi079.stdout: "testnewline": { 2024-08-20T01:55:22.087 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "testnewline", 2024-08-20T01:55:22.087 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.087 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.087 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.087 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:22.087 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.088 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.088 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.088 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.088 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.088 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.088 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.088 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:22.088 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:22.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:22.088 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "smb", 2024-08-20T01:55:22.088 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:22.088 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:22.089 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:22.089 INFO:teuthology.orchestra.run.smithi079.stdout: "internal_store_backend": { 2024-08-20T01:55:22.089 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "internal_store_backend", 2024-08-20T01:55:22.089 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.089 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:22.089 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.089 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:22.089 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.089 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.089 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.089 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-08-20T01:55:22.089 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.089 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.090 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.090 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:22.090 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:22.090 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.090 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.090 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.090 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:22.090 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.090 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.090 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:22.091 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:22.091 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:22.091 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:22.091 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:22.091 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:22.091 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:22.091 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:22.091 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.091 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.091 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.091 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.091 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:22.091 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:22.092 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.092 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.092 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.092 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:22.092 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.092 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.092 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.092 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.092 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.092 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.092 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.092 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:22.092 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:22.093 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.093 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.093 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.093 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:22.093 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.093 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.093 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:22.093 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:22.093 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:22.093 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:22.093 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:22.093 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:22.093 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:22.093 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:22.094 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.094 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.094 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.094 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.094 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:22.094 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:22.094 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.094 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.094 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.094 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:22.094 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.094 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.095 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.095 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.095 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.095 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.095 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.095 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:22.095 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:22.095 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:22.095 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:22.095 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.095 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:22.096 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.096 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.096 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.096 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.096 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.096 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.096 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.096 INFO:teuthology.orchestra.run.smithi079.stdout: "update_orchestration": { 2024-08-20T01:55:22.096 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "update_orchestration", 2024-08-20T01:55:22.096 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.096 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.096 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.096 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:22.097 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.097 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.097 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.097 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-08-20T01:55:22.097 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.097 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.097 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.097 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:22.097 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:22.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:22.097 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "snap_schedule", 2024-08-20T01:55:22.097 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:22.098 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:22.098 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:22.098 INFO:teuthology.orchestra.run.smithi079.stdout: "allow_m_granularity": { 2024-08-20T01:55:22.098 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "allow_m_granularity", 2024-08-20T01:55:22.098 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.098 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.098 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.098 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:22.098 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.098 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.098 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.099 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "allow minute scheduled snapshots", 2024-08-20T01:55:22.099 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.099 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.099 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.099 INFO:teuthology.orchestra.run.smithi079.stdout: "dump_on_update": { 2024-08-20T01:55:22.099 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "dump_on_update", 2024-08-20T01:55:22.099 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.099 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.099 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.099 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:22.099 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.099 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.099 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.100 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "dump database to debug log on update", 2024-08-20T01:55:22.100 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.100 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.100 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.100 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:22.100 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:22.100 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.100 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.100 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.100 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:22.100 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.100 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.100 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:22.101 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:22.101 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:22.101 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:22.101 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:22.101 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:22.101 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:22.101 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:22.101 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.101 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.101 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.101 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.101 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:22.102 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:22.102 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.102 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.102 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.102 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:22.102 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.102 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.102 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.102 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.102 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.102 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.102 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.103 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:22.103 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:22.103 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.103 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.103 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.103 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:22.103 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.103 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.103 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:22.103 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:22.103 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:22.103 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:22.103 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:22.104 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:22.104 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:22.104 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:22.104 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.104 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.104 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.104 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.104 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:22.104 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:22.104 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.104 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.104 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.105 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:22.105 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.105 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.105 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.105 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.105 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.105 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.105 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.105 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:22.106 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:22.106 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:22.106 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:22.106 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.106 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:22.106 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.106 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.106 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.106 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.107 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.107 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.107 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.107 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:22.107 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:22.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:22.107 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "stats", 2024-08-20T01:55:22.107 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:22.107 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:22.107 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:22.108 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:22.108 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:22.108 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.108 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.108 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.108 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:22.108 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.108 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.108 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:22.108 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:22.108 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:22.108 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:22.108 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:22.108 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:22.109 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:22.109 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:22.109 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.109 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.109 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.109 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.109 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:22.109 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:22.109 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.109 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.109 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.109 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:22.110 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.110 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.110 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.110 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.110 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.110 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.110 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.110 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:22.110 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:22.110 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.111 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.111 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.111 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:22.111 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.111 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.111 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:22.111 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:22.111 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:22.111 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:22.111 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:22.111 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:22.112 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:22.112 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:22.112 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.112 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.112 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.112 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.112 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:22.112 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:22.112 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.112 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.113 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.113 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:22.113 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.113 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.113 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.113 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.113 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.113 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.113 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.113 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:22.113 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:22.114 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:22.114 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:22.114 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.114 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:22.114 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.114 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.114 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.114 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.114 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.114 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.114 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.115 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:22.115 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:22.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:22.115 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "status", 2024-08-20T01:55:22.115 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:22.115 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:22.115 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:22.115 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:22.115 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:22.115 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.116 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.116 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.116 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:22.116 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.116 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.116 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:22.116 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:22.116 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:22.116 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:22.116 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:22.116 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:22.117 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:22.117 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:22.117 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.117 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.117 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.117 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.117 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:22.117 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:22.117 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.117 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.117 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.118 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:22.118 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.118 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.118 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.118 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.118 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.118 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.118 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.118 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:22.118 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:22.118 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.118 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.119 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.119 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:22.119 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.119 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.119 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:22.119 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:22.119 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:22.119 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:22.119 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:22.120 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:22.120 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:22.120 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:22.120 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.120 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.120 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.120 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.120 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:22.120 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:22.121 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.121 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.121 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.121 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:22.121 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.121 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.121 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.121 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.121 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.121 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.121 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.122 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:22.122 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:22.122 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:22.122 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:22.122 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.122 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:22.122 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.122 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.122 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.122 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.122 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.122 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.123 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.123 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:22.123 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:22.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:22.123 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "telegraf", 2024-08-20T01:55:22.123 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:22.123 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:22.123 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:22.123 INFO:teuthology.orchestra.run.smithi079.stdout: "address": { 2024-08-20T01:55:22.123 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "address", 2024-08-20T01:55:22.123 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.124 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.124 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.124 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-20T01:55:22.124 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.124 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.124 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.124 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.124 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.124 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.124 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.124 INFO:teuthology.orchestra.run.smithi079.stdout: "interval": { 2024-08-20T01:55:22.124 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "interval", 2024-08-20T01:55:22.125 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:22.125 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.125 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.125 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "15", 2024-08-20T01:55:22.125 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.125 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.125 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.125 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.125 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.125 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.125 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.125 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:22.126 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:22.126 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.126 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.126 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.126 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:22.126 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.126 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.126 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:22.126 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:22.126 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:22.126 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:22.126 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:22.127 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:22.127 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:22.127 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:22.127 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.127 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.127 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.127 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.127 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:22.127 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:22.127 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.127 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.127 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.127 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:22.128 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.128 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.128 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.128 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.128 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.128 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.128 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.128 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:22.128 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:22.128 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.128 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.128 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.129 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:22.129 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.129 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.129 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:22.129 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:22.129 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:22.129 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:22.129 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:22.129 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:22.129 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:22.129 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:22.129 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.129 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.130 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.130 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.130 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:22.130 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:22.130 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.130 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.130 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.130 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:22.130 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.130 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.130 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.130 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.131 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.131 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.131 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.131 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:22.131 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:22.131 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:22.131 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:22.131 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.131 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:22.131 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.132 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.132 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.132 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.132 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.132 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.132 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.132 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:22.132 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:22.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:22.132 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "telemetry", 2024-08-20T01:55:22.132 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:22.132 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:22.132 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:22.133 INFO:teuthology.orchestra.run.smithi079.stdout: "channel_basic": { 2024-08-20T01:55:22.133 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "channel_basic", 2024-08-20T01:55:22.133 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.133 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.133 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.133 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:22.133 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.133 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.133 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.133 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-20T01:55:22.133 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.133 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.133 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.134 INFO:teuthology.orchestra.run.smithi079.stdout: "channel_crash": { 2024-08-20T01:55:22.134 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "channel_crash", 2024-08-20T01:55:22.134 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.134 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.134 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.134 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:22.134 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.134 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.134 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.134 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-20T01:55:22.134 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.134 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.134 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.135 INFO:teuthology.orchestra.run.smithi079.stdout: "channel_device": { 2024-08-20T01:55:22.135 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "channel_device", 2024-08-20T01:55:22.135 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.135 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.135 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.135 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:22.135 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.135 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.135 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.135 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-20T01:55:22.136 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.136 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.136 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.136 INFO:teuthology.orchestra.run.smithi079.stdout: "channel_ident": { 2024-08-20T01:55:22.136 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "channel_ident", 2024-08-20T01:55:22.136 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.136 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.136 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.136 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:22.136 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.136 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.136 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.137 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-20T01:55:22.137 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.137 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.137 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.137 INFO:teuthology.orchestra.run.smithi079.stdout: "channel_perf": { 2024-08-20T01:55:22.137 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "channel_perf", 2024-08-20T01:55:22.137 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.137 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.137 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.137 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:22.138 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.138 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.138 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.138 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-20T01:55:22.138 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.138 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.138 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.138 INFO:teuthology.orchestra.run.smithi079.stdout: "contact": { 2024-08-20T01:55:22.138 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "contact", 2024-08-20T01:55:22.139 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.139 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.139 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.139 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:22.139 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.139 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.139 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.139 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.139 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.139 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.140 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.140 INFO:teuthology.orchestra.run.smithi079.stdout: "description": { 2024-08-20T01:55:22.140 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "description", 2024-08-20T01:55:22.140 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.140 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.140 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.140 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:22.140 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.140 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.140 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.141 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.141 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.141 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.141 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.141 INFO:teuthology.orchestra.run.smithi079.stdout: "device_url": { 2024-08-20T01:55:22.141 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "device_url", 2024-08-20T01:55:22.141 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.141 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.141 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.141 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-20T01:55:22.142 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.142 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.142 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.142 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.142 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.142 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.142 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.142 INFO:teuthology.orchestra.run.smithi079.stdout: "enabled": { 2024-08-20T01:55:22.143 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "enabled", 2024-08-20T01:55:22.143 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.143 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.143 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.143 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:22.143 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.143 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.143 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.143 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.143 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.144 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.144 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.144 INFO:teuthology.orchestra.run.smithi079.stdout: "interval": { 2024-08-20T01:55:22.144 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "interval", 2024-08-20T01:55:22.144 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:22.144 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.144 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.144 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "24", 2024-08-20T01:55:22.144 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "8", 2024-08-20T01:55:22.144 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.145 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.145 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.145 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.145 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.145 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.145 INFO:teuthology.orchestra.run.smithi079.stdout: "last_opt_revision": { 2024-08-20T01:55:22.145 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "last_opt_revision", 2024-08-20T01:55:22.145 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:22.145 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.145 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.146 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "1", 2024-08-20T01:55:22.146 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.146 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.146 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.146 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.146 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.146 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.146 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.146 INFO:teuthology.orchestra.run.smithi079.stdout: "leaderboard": { 2024-08-20T01:55:22.146 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "leaderboard", 2024-08-20T01:55:22.147 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.147 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.147 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.147 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:22.147 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.147 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.147 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.147 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.147 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.147 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.147 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.148 INFO:teuthology.orchestra.run.smithi079.stdout: "leaderboard_description": { 2024-08-20T01:55:22.148 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "leaderboard_description", 2024-08-20T01:55:22.148 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.148 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.148 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.148 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:22.148 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.148 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.148 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.148 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.148 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.149 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.149 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.149 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:22.149 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:22.149 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.149 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.149 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.149 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:22.149 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.149 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.149 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:22.150 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:22.150 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:22.150 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:22.150 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:22.150 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:22.150 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:22.150 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:22.150 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.150 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.150 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.150 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.151 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:22.151 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:22.151 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.151 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.151 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.151 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:22.151 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.151 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.151 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.151 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.151 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.151 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.151 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.152 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:22.152 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:22.152 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.152 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.152 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.152 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:22.152 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.152 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.152 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:22.152 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:22.152 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:22.152 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:22.153 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:22.153 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:22.153 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:22.153 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:22.153 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.153 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.153 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.153 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.153 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:22.153 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:22.153 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.153 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.153 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.154 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:22.154 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.154 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.154 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.154 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.154 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.154 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.154 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.154 INFO:teuthology.orchestra.run.smithi079.stdout: "organization": { 2024-08-20T01:55:22.154 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "organization", 2024-08-20T01:55:22.154 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.155 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.155 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.155 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:22.155 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.155 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.155 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.155 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.155 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.155 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.155 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.155 INFO:teuthology.orchestra.run.smithi079.stdout: "proxy": { 2024-08-20T01:55:22.155 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "proxy", 2024-08-20T01:55:22.156 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.156 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.156 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.156 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:22.156 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.156 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.156 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.156 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.156 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.156 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.157 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.157 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:22.157 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:22.157 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:22.157 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:22.157 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.157 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:22.157 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.157 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.157 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.157 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.158 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.158 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.158 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.158 INFO:teuthology.orchestra.run.smithi079.stdout: "url": { 2024-08-20T01:55:22.158 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "url", 2024-08-20T01:55:22.158 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.158 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.158 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.158 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-20T01:55:22.158 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.158 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.159 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.159 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.159 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.159 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.159 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.159 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:22.159 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:22.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.159 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:22.159 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "test_orchestrator", 2024-08-20T01:55:22.159 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:22.159 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:22.159 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:22.160 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:22.160 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:22.160 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.160 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.160 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.160 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:22.160 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.160 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.160 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:22.160 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:22.160 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:22.160 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:22.160 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:22.161 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:22.161 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:22.161 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:22.161 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.161 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.161 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.161 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.161 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:22.161 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:22.161 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.161 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.161 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.162 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:22.162 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.162 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.162 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.162 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.162 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.162 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.162 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.162 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.162 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:22.162 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:22.162 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.162 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.163 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.163 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:22.163 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.163 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.163 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:22.163 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:22.163 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:22.163 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:22.163 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:22.163 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:22.163 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:22.163 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:22.164 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.164 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.164 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.164 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.164 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:22.164 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:22.164 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.164 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.164 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.164 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:22.164 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.164 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.165 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.165 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.165 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.165 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.165 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.165 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:22.165 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:22.165 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:22.165 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:22.166 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.166 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:22.166 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.166 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.166 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.166 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.166 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.166 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.166 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.166 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:22.166 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:22.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.166 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:22.167 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "volumes", 2024-08-20T01:55:22.167 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:22.167 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:22.167 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:22.167 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:22.167 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:22.167 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.167 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.167 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.167 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:22.167 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.167 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.168 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:22.168 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:22.168 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:22.168 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:22.168 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:22.168 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:22.168 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:22.168 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:22.168 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.168 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.168 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.168 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.169 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:22.169 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:22.169 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.169 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.169 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.169 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:22.169 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.169 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.169 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.169 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.169 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.169 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.170 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.170 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:22.170 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:22.170 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.170 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.170 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.170 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:22.170 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.170 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.170 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:22.170 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:22.170 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:22.171 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:22.171 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:22.171 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:22.171 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:22.171 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:22.171 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.171 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.171 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.171 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.171 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:22.171 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:22.171 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.172 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.172 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.172 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:22.172 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.172 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.172 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.172 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.172 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.172 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.172 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.172 INFO:teuthology.orchestra.run.smithi079.stdout: "max_concurrent_clones": { 2024-08-20T01:55:22.172 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "max_concurrent_clones", 2024-08-20T01:55:22.172 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:22.173 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.173 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.173 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "4", 2024-08-20T01:55:22.173 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.173 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.173 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.173 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-20T01:55:22.173 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.173 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.173 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.173 INFO:teuthology.orchestra.run.smithi079.stdout: "periodic_async_work": { 2024-08-20T01:55:22.173 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "periodic_async_work", 2024-08-20T01:55:22.174 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.174 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.174 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.174 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:22.174 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.174 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.174 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.174 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Periodically check for async work", 2024-08-20T01:55:22.174 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.174 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.174 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.175 INFO:teuthology.orchestra.run.smithi079.stdout: "snapshot_clone_delay": { 2024-08-20T01:55:22.175 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "snapshot_clone_delay", 2024-08-20T01:55:22.175 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:22.175 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.175 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.175 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:22.175 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.175 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.175 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.175 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-20T01:55:22.175 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.175 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.176 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.176 INFO:teuthology.orchestra.run.smithi079.stdout: "snapshot_clone_no_wait": { 2024-08-20T01:55:22.176 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "snapshot_clone_no_wait", 2024-08-20T01:55:22.176 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.176 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.176 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.176 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "True", 2024-08-20T01:55:22.176 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.176 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.176 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.176 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-20T01:55:22.176 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.176 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.177 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.177 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:22.177 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:22.177 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:22.177 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:22.177 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.177 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:22.177 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.177 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.177 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.177 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.177 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.177 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.178 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.178 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:22.178 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:22.178 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:22.178 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "zabbix", 2024-08-20T01:55:22.178 INFO:teuthology.orchestra.run.smithi079.stdout: "can_run": true, 2024-08-20T01:55:22.178 INFO:teuthology.orchestra.run.smithi079.stdout: "error_string": "", 2024-08-20T01:55:22.178 INFO:teuthology.orchestra.run.smithi079.stdout: "module_options": { 2024-08-20T01:55:22.178 INFO:teuthology.orchestra.run.smithi079.stdout: "discovery_interval": { 2024-08-20T01:55:22.178 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "discovery_interval", 2024-08-20T01:55:22.178 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "uint", 2024-08-20T01:55:22.179 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.179 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.179 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "100", 2024-08-20T01:55:22.179 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.179 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.179 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.179 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.179 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.179 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.179 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.180 INFO:teuthology.orchestra.run.smithi079.stdout: "identifier": { 2024-08-20T01:55:22.180 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "identifier", 2024-08-20T01:55:22.180 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.180 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.180 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.180 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:22.180 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.180 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.180 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.180 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.180 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.180 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.181 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.181 INFO:teuthology.orchestra.run.smithi079.stdout: "interval": { 2024-08-20T01:55:22.181 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "interval", 2024-08-20T01:55:22.181 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "secs", 2024-08-20T01:55:22.181 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.181 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.181 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "60", 2024-08-20T01:55:22.181 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.181 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.181 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.181 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.181 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.182 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.182 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.182 INFO:teuthology.orchestra.run.smithi079.stdout: "log_level": { 2024-08-20T01:55:22.182 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_level", 2024-08-20T01:55:22.182 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.182 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.182 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.182 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:22.182 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.182 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.182 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:22.183 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:22.183 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:22.183 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:22.183 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:22.183 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:22.183 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:22.183 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:22.183 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.183 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.183 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.183 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.183 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster": { 2024-08-20T01:55:22.184 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster", 2024-08-20T01:55:22.184 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.184 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.184 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.184 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:22.184 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.184 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.184 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.184 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.184 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.184 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.184 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.185 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_cluster_level": { 2024-08-20T01:55:22.185 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_cluster_level", 2024-08-20T01:55:22.185 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.185 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.185 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.185 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "info", 2024-08-20T01:55:22.185 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.185 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.185 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [ 2024-08-20T01:55:22.185 INFO:teuthology.orchestra.run.smithi079.stdout: "", 2024-08-20T01:55:22.185 INFO:teuthology.orchestra.run.smithi079.stdout: "critical", 2024-08-20T01:55:22.185 INFO:teuthology.orchestra.run.smithi079.stdout: "debug", 2024-08-20T01:55:22.186 INFO:teuthology.orchestra.run.smithi079.stdout: "error", 2024-08-20T01:55:22.186 INFO:teuthology.orchestra.run.smithi079.stdout: "info", 2024-08-20T01:55:22.186 INFO:teuthology.orchestra.run.smithi079.stdout: "warning" 2024-08-20T01:55:22.186 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:22.186 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.186 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.186 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.186 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.186 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": { 2024-08-20T01:55:22.186 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "log_to_file", 2024-08-20T01:55:22.186 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "bool", 2024-08-20T01:55:22.187 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.187 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.187 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "False", 2024-08-20T01:55:22.187 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.187 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.187 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.187 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.187 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.187 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.187 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.187 INFO:teuthology.orchestra.run.smithi079.stdout: "sqlite3_killpoint": { 2024-08-20T01:55:22.187 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "sqlite3_killpoint", 2024-08-20T01:55:22.188 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:22.188 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "dev", 2024-08-20T01:55:22.188 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-08-20T01:55:22.188 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "0", 2024-08-20T01:55:22.188 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.188 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.188 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.188 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.188 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.188 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.188 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.188 INFO:teuthology.orchestra.run.smithi079.stdout: "zabbix_host": { 2024-08-20T01:55:22.188 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "zabbix_host", 2024-08-20T01:55:22.189 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.189 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.189 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.189 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "", 2024-08-20T01:55:22.189 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.189 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.189 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.189 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.189 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.189 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.189 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.189 INFO:teuthology.orchestra.run.smithi079.stdout: "zabbix_port": { 2024-08-20T01:55:22.190 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "zabbix_port", 2024-08-20T01:55:22.190 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "int", 2024-08-20T01:55:22.190 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.190 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.190 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "10051", 2024-08-20T01:55:22.190 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.190 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.190 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.190 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.190 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.190 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.190 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.191 INFO:teuthology.orchestra.run.smithi079.stdout: "zabbix_sender": { 2024-08-20T01:55:22.191 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "zabbix_sender", 2024-08-20T01:55:22.191 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "str", 2024-08-20T01:55:22.191 INFO:teuthology.orchestra.run.smithi079.stdout: "level": "advanced", 2024-08-20T01:55:22.191 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 0, 2024-08-20T01:55:22.191 INFO:teuthology.orchestra.run.smithi079.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-20T01:55:22.191 INFO:teuthology.orchestra.run.smithi079.stdout: "min": "", 2024-08-20T01:55:22.191 INFO:teuthology.orchestra.run.smithi079.stdout: "max": "", 2024-08-20T01:55:22.191 INFO:teuthology.orchestra.run.smithi079.stdout: "enum_allowed": [], 2024-08-20T01:55:22.191 INFO:teuthology.orchestra.run.smithi079.stdout: "desc": "", 2024-08-20T01:55:22.191 INFO:teuthology.orchestra.run.smithi079.stdout: "long_desc": "", 2024-08-20T01:55:22.192 INFO:teuthology.orchestra.run.smithi079.stdout: "tags": [], 2024-08-20T01:55:22.192 INFO:teuthology.orchestra.run.smithi079.stdout: "see_also": [] 2024-08-20T01:55:22.192 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:22.192 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:22.192 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:22.192 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:22.192 INFO:teuthology.orchestra.run.smithi079.stdout: "services": { 2024-08-20T01:55:22.192 INFO:teuthology.orchestra.run.smithi079.stdout: "dashboard": "https://172.21.15.79:8443/" 2024-08-20T01:55:22.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.192 INFO:teuthology.orchestra.run.smithi079.stdout: "always_on_modules": { 2024-08-20T01:55:22.192 INFO:teuthology.orchestra.run.smithi079.stdout: "octopus": [ 2024-08-20T01:55:22.192 INFO:teuthology.orchestra.run.smithi079.stdout: "balancer", 2024-08-20T01:55:22.192 INFO:teuthology.orchestra.run.smithi079.stdout: "crash", 2024-08-20T01:55:22.193 INFO:teuthology.orchestra.run.smithi079.stdout: "devicehealth", 2024-08-20T01:55:22.193 INFO:teuthology.orchestra.run.smithi079.stdout: "orchestrator", 2024-08-20T01:55:22.193 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscaler", 2024-08-20T01:55:22.193 INFO:teuthology.orchestra.run.smithi079.stdout: "progress", 2024-08-20T01:55:22.193 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_support", 2024-08-20T01:55:22.193 INFO:teuthology.orchestra.run.smithi079.stdout: "status", 2024-08-20T01:55:22.193 INFO:teuthology.orchestra.run.smithi079.stdout: "telemetry", 2024-08-20T01:55:22.193 INFO:teuthology.orchestra.run.smithi079.stdout: "volumes" 2024-08-20T01:55:22.193 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:22.193 INFO:teuthology.orchestra.run.smithi079.stdout: "pacific": [ 2024-08-20T01:55:22.193 INFO:teuthology.orchestra.run.smithi079.stdout: "balancer", 2024-08-20T01:55:22.194 INFO:teuthology.orchestra.run.smithi079.stdout: "crash", 2024-08-20T01:55:22.194 INFO:teuthology.orchestra.run.smithi079.stdout: "devicehealth", 2024-08-20T01:55:22.194 INFO:teuthology.orchestra.run.smithi079.stdout: "orchestrator", 2024-08-20T01:55:22.194 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscaler", 2024-08-20T01:55:22.194 INFO:teuthology.orchestra.run.smithi079.stdout: "progress", 2024-08-20T01:55:22.194 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_support", 2024-08-20T01:55:22.194 INFO:teuthology.orchestra.run.smithi079.stdout: "status", 2024-08-20T01:55:22.194 INFO:teuthology.orchestra.run.smithi079.stdout: "telemetry", 2024-08-20T01:55:22.194 INFO:teuthology.orchestra.run.smithi079.stdout: "volumes" 2024-08-20T01:55:22.194 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:22.194 INFO:teuthology.orchestra.run.smithi079.stdout: "quincy": [ 2024-08-20T01:55:22.194 INFO:teuthology.orchestra.run.smithi079.stdout: "balancer", 2024-08-20T01:55:22.195 INFO:teuthology.orchestra.run.smithi079.stdout: "crash", 2024-08-20T01:55:22.195 INFO:teuthology.orchestra.run.smithi079.stdout: "devicehealth", 2024-08-20T01:55:22.195 INFO:teuthology.orchestra.run.smithi079.stdout: "orchestrator", 2024-08-20T01:55:22.195 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscaler", 2024-08-20T01:55:22.195 INFO:teuthology.orchestra.run.smithi079.stdout: "progress", 2024-08-20T01:55:22.195 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_support", 2024-08-20T01:55:22.195 INFO:teuthology.orchestra.run.smithi079.stdout: "status", 2024-08-20T01:55:22.195 INFO:teuthology.orchestra.run.smithi079.stdout: "telemetry", 2024-08-20T01:55:22.195 INFO:teuthology.orchestra.run.smithi079.stdout: "volumes" 2024-08-20T01:55:22.195 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:22.195 INFO:teuthology.orchestra.run.smithi079.stdout: "reef": [ 2024-08-20T01:55:22.195 INFO:teuthology.orchestra.run.smithi079.stdout: "balancer", 2024-08-20T01:55:22.196 INFO:teuthology.orchestra.run.smithi079.stdout: "crash", 2024-08-20T01:55:22.196 INFO:teuthology.orchestra.run.smithi079.stdout: "devicehealth", 2024-08-20T01:55:22.196 INFO:teuthology.orchestra.run.smithi079.stdout: "orchestrator", 2024-08-20T01:55:22.196 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscaler", 2024-08-20T01:55:22.196 INFO:teuthology.orchestra.run.smithi079.stdout: "progress", 2024-08-20T01:55:22.196 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_support", 2024-08-20T01:55:22.196 INFO:teuthology.orchestra.run.smithi079.stdout: "status", 2024-08-20T01:55:22.196 INFO:teuthology.orchestra.run.smithi079.stdout: "telemetry", 2024-08-20T01:55:22.196 INFO:teuthology.orchestra.run.smithi079.stdout: "volumes" 2024-08-20T01:55:22.196 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-08-20T01:55:22.196 INFO:teuthology.orchestra.run.smithi079.stdout: "squid": [ 2024-08-20T01:55:22.196 INFO:teuthology.orchestra.run.smithi079.stdout: "balancer", 2024-08-20T01:55:22.196 INFO:teuthology.orchestra.run.smithi079.stdout: "crash", 2024-08-20T01:55:22.197 INFO:teuthology.orchestra.run.smithi079.stdout: "devicehealth", 2024-08-20T01:55:22.197 INFO:teuthology.orchestra.run.smithi079.stdout: "orchestrator", 2024-08-20T01:55:22.197 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscaler", 2024-08-20T01:55:22.197 INFO:teuthology.orchestra.run.smithi079.stdout: "progress", 2024-08-20T01:55:22.197 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_support", 2024-08-20T01:55:22.197 INFO:teuthology.orchestra.run.smithi079.stdout: "status", 2024-08-20T01:55:22.197 INFO:teuthology.orchestra.run.smithi079.stdout: "telemetry", 2024-08-20T01:55:22.197 INFO:teuthology.orchestra.run.smithi079.stdout: "volumes" 2024-08-20T01:55:22.197 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-08-20T01:55:22.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.197 INFO:teuthology.orchestra.run.smithi079.stdout: "last_failure_osd_epoch": 3, 2024-08-20T01:55:22.197 INFO:teuthology.orchestra.run.smithi079.stdout: "active_clients": [ 2024-08-20T01:55:22.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:22.197 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "devicehealth", 2024-08-20T01:55:22.198 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-08-20T01:55:22.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:22.198 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-08-20T01:55:22.198 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:0", 2024-08-20T01:55:22.198 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2175610949 2024-08-20T01:55:22.198 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:22.198 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-08-20T01:55:22.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:22.198 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "libcephsqlite", 2024-08-20T01:55:22.198 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-08-20T01:55:22.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:22.198 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-08-20T01:55:22.199 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:0", 2024-08-20T01:55:22.199 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 212469750 2024-08-20T01:55:22.199 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:22.199 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-08-20T01:55:22.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:22.199 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "rbd_support", 2024-08-20T01:55:22.199 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-08-20T01:55:22.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:22.199 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-08-20T01:55:22.199 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:0", 2024-08-20T01:55:22.199 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2518410933 2024-08-20T01:55:22.199 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:22.200 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-08-20T01:55:22.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:22.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:22.200 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "volumes", 2024-08-20T01:55:22.200 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-08-20T01:55:22.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-08-20T01:55:22.200 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-08-20T01:55:22.200 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:0", 2024-08-20T01:55:22.200 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2569963596 2024-08-20T01:55:22.200 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:22.200 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-08-20T01:55:22.200 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:22.200 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-08-20T01:55:22.201 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:55:22.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.560+0000 7f729ee60640 1 -- 172.21.15.79:0/54728953 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f72880b3bd0 msgr2=0x7f72880b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:22.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.560+0000 7f729ee60640 1 --2- 172.21.15.79:0/54728953 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f72880b3bd0 0x7f72880b6090 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f728c009bd0 tx=0x7f728c005f90 comp rx=0 tx=0).stop 2024-08-20T01:55:22.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.560+0000 7f729ee60640 1 -- 172.21.15.79:0/54728953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72981041b0 msgr2=0x7f7298199c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:22.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.560+0000 7f729ee60640 1 --2- 172.21.15.79:0/54728953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72981041b0 0x7f7298199c20 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f729000efc0 tx=0x7f729000c800 comp rx=0 tx=0).stop 2024-08-20T01:55:22.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.561+0000 7f729ee60640 1 -- 172.21.15.79:0/54728953 shutdown_connections 2024-08-20T01:55:22.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.561+0000 7f729ee60640 1 --2- 172.21.15.79:0/54728953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72981041b0 0x7f7298199c20 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:22.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.561+0000 7f729ee60640 1 --2- 172.21.15.79:0/54728953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72981037f0 0x7f7298198ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:22.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.561+0000 7f729ee60640 1 --2- 172.21.15.79:0/54728953 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f72880b3bd0 0x7f72880b6090 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:22.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.561+0000 7f729ee60640 1 --2- 172.21.15.79:0/54728953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72981026a0 0x7f72981989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:22.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.561+0000 7f729ee60640 1 -- 172.21.15.79:0/54728953 >> 172.21.15.79:0/54728953 conn(0x7f72980fdf40 msgr2=0x7f7298104bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:22.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.561+0000 7f729ee60640 1 -- 172.21.15.79:0/54728953 shutdown_connections 2024-08-20T01:55:22.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:20.561+0000 7f729ee60640 1 -- 172.21.15.79:0/54728953 wait complete. 2024-08-20T01:55:22.268 DEBUG:tasks.check_counter:Getting stats from a 2024-08-20T01:55:22.268 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph daemon mds.a perf dump 2024-08-20T01:55:22.269 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:20 smithi079 ceph-mon[18656]: pgmap v887: 97 pgs: 97 active+clean; 2.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 20 op/s 2024-08-20T01:55:22.269 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:20 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/4103827951' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-20T01:55:22.269 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:20 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2142282343' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-20T01:55:22.269 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:20 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/3562559851' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-20T01:55:22.269 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:21 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/54728953' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-08-20T01:55:22.270 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:20 smithi175 ceph-mon[22392]: pgmap v887: 97 pgs: 97 active+clean; 2.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 20 op/s 2024-08-20T01:55:22.271 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:20 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/4103827951' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-20T01:55:22.271 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:20 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2142282343' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-20T01:55:22.271 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:20 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/3562559851' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-20T01:55:22.271 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:21 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/54728953' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-08-20T01:55:22.271 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:20 smithi081 ceph-mon[22209]: pgmap v887: 97 pgs: 97 active+clean; 2.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 20 op/s 2024-08-20T01:55:22.271 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:20 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/4103827951' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-20T01:55:22.271 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:20 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2142282343' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-20T01:55:22.271 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:20 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/3562559851' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-20T01:55:22.271 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:21 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/54728953' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-08-20T01:55:22.523 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:55:22.644 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:22 smithi079 ceph-mon[18656]: pgmap v888: 97 pgs: 97 active+clean; 2.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 18 op/s 2024-08-20T01:55:22.644 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:22 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:55:22.644 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:22 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:55:22.644 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:22 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:55:22.644 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:22 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:55:22.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:22 smithi081 ceph-mon[22209]: pgmap v888: 97 pgs: 97 active+clean; 2.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 18 op/s 2024-08-20T01:55:22.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:22 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:55:22.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:22 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:55:22.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:22 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:55:22.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:22 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:55:22.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:22 smithi175 ceph-mon[22392]: pgmap v888: 97 pgs: 97 active+clean; 2.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 18 op/s 2024-08-20T01:55:22.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:22 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T01:55:22.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:22 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T01:55:22.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:22 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T01:55:22.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:22 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' 2024-08-20T01:55:23.138 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:55:23.139 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-0": { 2024-08-20T01:55:23.139 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 2445, 2024-08-20T01:55:23.139 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 2447, 2024-08-20T01:55:23.139 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 2669894, 2024-08-20T01:55:23.139 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 777511, 2024-08-20T01:55:23.139 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 6, 2024-08-20T01:55:23.139 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 2, 2024-08-20T01:55:23.139 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.226430595, 2024-08-20T01:55:23.139 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.096268704, 2024-08-20T01:55:23.139 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.052930126, 2024-08-20T01:55:23.139 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.062079158, 2024-08-20T01:55:23.140 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:55:23.140 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 2445, 2024-08-20T01:55:23.140 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.098247249, 2024-08-20T01:55:23.140 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000040182 2024-08-20T01:55:23.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.140 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:55:23.140 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:23.140 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:23.140 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:23.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.140 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-20T01:55:23.140 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 0 2024-08-20T01:55:23.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.141 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-1": { 2024-08-20T01:55:23.141 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 987, 2024-08-20T01:55:23.141 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 1238, 2024-08-20T01:55:23.141 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 243282, 2024-08-20T01:55:23.141 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 930882, 2024-08-20T01:55:23.141 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 7, 2024-08-20T01:55:23.141 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 4, 2024-08-20T01:55:23.141 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.107078855, 2024-08-20T01:55:23.141 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.051808438, 2024-08-20T01:55:23.141 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.018302696, 2024-08-20T01:55:23.141 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.029439954, 2024-08-20T01:55:23.141 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:55:23.142 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 1236, 2024-08-20T01:55:23.142 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.048730527, 2024-08-20T01:55:23.142 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000039425 2024-08-20T01:55:23.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.142 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:55:23.142 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:23.142 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:23.142 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:23.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.142 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-20T01:55:23.142 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 617584 2024-08-20T01:55:23.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.143 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-2": { 2024-08-20T01:55:23.143 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 389, 2024-08-20T01:55:23.143 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 340, 2024-08-20T01:55:23.143 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 867196, 2024-08-20T01:55:23.143 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 206030, 2024-08-20T01:55:23.143 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 4, 2024-08-20T01:55:23.143 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 2, 2024-08-20T01:55:23.143 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.048891333, 2024-08-20T01:55:23.143 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.024747357, 2024-08-20T01:55:23.143 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.029574466, 2024-08-20T01:55:23.143 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.000021138, 2024-08-20T01:55:23.143 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:55:23.143 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 340, 2024-08-20T01:55:23.144 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.019934223, 2024-08-20T01:55:23.144 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000058630 2024-08-20T01:55:23.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.144 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:55:23.144 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:23.144 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:23.144 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:23.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.144 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 866928, 2024-08-20T01:55:23.144 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 205712 2024-08-20T01:55:23.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.144 INFO:teuthology.orchestra.run.smithi079.stdout: "cct": { 2024-08-20T01:55:23.144 INFO:teuthology.orchestra.run.smithi079.stdout: "total_workers": 1, 2024-08-20T01:55:23.145 INFO:teuthology.orchestra.run.smithi079.stdout: "unhealthy_workers": 0 2024-08-20T01:55:23.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.145 INFO:teuthology.orchestra.run.smithi079.stdout: "finisher-MDSRank": { 2024-08-20T01:55:23.145 INFO:teuthology.orchestra.run.smithi079.stdout: "queue_len": 0, 2024-08-20T01:55:23.145 INFO:teuthology.orchestra.run.smithi079.stdout: "complete_latency": { 2024-08-20T01:55:23.145 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 5784, 2024-08-20T01:55:23.145 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.131520892, 2024-08-20T01:55:23.145 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000022738 2024-08-20T01:55:23.145 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:23.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.145 INFO:teuthology.orchestra.run.smithi079.stdout: "finisher-PurgeQueue": { 2024-08-20T01:55:23.145 INFO:teuthology.orchestra.run.smithi079.stdout: "queue_len": 0, 2024-08-20T01:55:23.146 INFO:teuthology.orchestra.run.smithi079.stdout: "complete_latency": { 2024-08-20T01:55:23.146 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:23.146 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:23.146 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:23.146 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:23.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.146 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": { 2024-08-20T01:55:23.146 INFO:teuthology.orchestra.run.smithi079.stdout: "request": 0, 2024-08-20T01:55:23.146 INFO:teuthology.orchestra.run.smithi079.stdout: "reply": 0, 2024-08-20T01:55:23.146 INFO:teuthology.orchestra.run.smithi079.stdout: "reply_latency": { 2024-08-20T01:55:23.146 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:23.146 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:23.147 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:23.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.147 INFO:teuthology.orchestra.run.smithi079.stdout: "slow_reply": 0, 2024-08-20T01:55:23.147 INFO:teuthology.orchestra.run.smithi079.stdout: "forward": 0, 2024-08-20T01:55:23.147 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_fetch_complete": 0, 2024-08-20T01:55:23.147 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_fetch_keys": 0, 2024-08-20T01:55:23.147 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_commit": 0, 2024-08-20T01:55:23.147 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_split": 0, 2024-08-20T01:55:23.147 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_merge": 0, 2024-08-20T01:55:23.147 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes": 181, 2024-08-20T01:55:23.147 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_top": 0, 2024-08-20T01:55:23.147 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_bottom": 181, 2024-08-20T01:55:23.147 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_pin_tail": 0, 2024-08-20T01:55:23.148 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_pinned": 181, 2024-08-20T01:55:23.148 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_expired": 4, 2024-08-20T01:55:23.148 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_with_caps": 0, 2024-08-20T01:55:23.148 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": 0, 2024-08-20T01:55:23.148 INFO:teuthology.orchestra.run.smithi079.stdout: "subtrees": 1, 2024-08-20T01:55:23.148 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse": 0, 2024-08-20T01:55:23.148 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_hit": 0, 2024-08-20T01:55:23.148 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_forward": 0, 2024-08-20T01:55:23.148 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_discover": 0, 2024-08-20T01:55:23.148 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_dir_fetch": 0, 2024-08-20T01:55:23.148 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_remote_ino": 0, 2024-08-20T01:55:23.149 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_lock": 0, 2024-08-20T01:55:23.149 INFO:teuthology.orchestra.run.smithi079.stdout: "load_cent": 0, 2024-08-20T01:55:23.149 INFO:teuthology.orchestra.run.smithi079.stdout: "q": 0, 2024-08-20T01:55:23.149 INFO:teuthology.orchestra.run.smithi079.stdout: "exported": 0, 2024-08-20T01:55:23.149 INFO:teuthology.orchestra.run.smithi079.stdout: "exported_inodes": 0, 2024-08-20T01:55:23.149 INFO:teuthology.orchestra.run.smithi079.stdout: "imported": 0, 2024-08-20T01:55:23.149 INFO:teuthology.orchestra.run.smithi079.stdout: "imported_inodes": 0, 2024-08-20T01:55:23.149 INFO:teuthology.orchestra.run.smithi079.stdout: "openino_dir_fetch": 0, 2024-08-20T01:55:23.149 INFO:teuthology.orchestra.run.smithi079.stdout: "openino_backtrace_fetch": 0, 2024-08-20T01:55:23.149 INFO:teuthology.orchestra.run.smithi079.stdout: "openino_peer_discover": 0, 2024-08-20T01:55:23.149 INFO:teuthology.orchestra.run.smithi079.stdout: "root_rfiles": 0, 2024-08-20T01:55:23.149 INFO:teuthology.orchestra.run.smithi079.stdout: "root_rbytes": 0, 2024-08-20T01:55:23.149 INFO:teuthology.orchestra.run.smithi079.stdout: "root_rsnaps": 0, 2024-08-20T01:55:23.149 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_backtrace_fetch": 0, 2024-08-20T01:55:23.150 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_set_tag": 0, 2024-08-20T01:55:23.150 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_backtrace_repaired": 0, 2024-08-20T01:55:23.150 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_inotable_repaired": 0, 2024-08-20T01:55:23.150 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_dir_inodes": 0, 2024-08-20T01:55:23.150 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_dir_base_inodes": 0, 2024-08-20T01:55:23.150 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_dirfrag_rstats": 0, 2024-08-20T01:55:23.150 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_file_inodes": 0, 2024-08-20T01:55:23.150 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_inode_file_caps": 0, 2024-08-20T01:55:23.150 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_revoke": 0, 2024-08-20T01:55:23.150 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_grant": 0, 2024-08-20T01:55:23.150 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_trunc": 0, 2024-08-20T01:55:23.150 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-20T01:55:23.150 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-20T01:55:23.151 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_caps": 0, 2024-08-20T01:55:23.151 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_caps_dirty": 0, 2024-08-20T01:55:23.151 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_cap_release": 0, 2024-08-20T01:55:23.151 INFO:teuthology.orchestra.run.smithi079.stdout: "process_request_cap_release": 0 2024-08-20T01:55:23.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.151 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_cache": { 2024-08-20T01:55:23.151 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_update": 0, 2024-08-20T01:55:23.151 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_update_receipt": 0, 2024-08-20T01:55:23.151 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_try_discover": 0, 2024-08-20T01:55:23.151 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_send_discover": 0, 2024-08-20T01:55:23.151 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_handle_discover": 0, 2024-08-20T01:55:23.151 INFO:teuthology.orchestra.run.smithi079.stdout: "num_strays": 0, 2024-08-20T01:55:23.151 INFO:teuthology.orchestra.run.smithi079.stdout: "num_strays_delayed": 0, 2024-08-20T01:55:23.152 INFO:teuthology.orchestra.run.smithi079.stdout: "num_strays_enqueuing": 0, 2024-08-20T01:55:23.152 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_created": 0, 2024-08-20T01:55:23.152 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_enqueued": 0, 2024-08-20T01:55:23.152 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_reintegrated": 0, 2024-08-20T01:55:23.152 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_migrated": 0, 2024-08-20T01:55:23.152 INFO:teuthology.orchestra.run.smithi079.stdout: "num_recovering_processing": 0, 2024-08-20T01:55:23.152 INFO:teuthology.orchestra.run.smithi079.stdout: "num_recovering_enqueued": 0, 2024-08-20T01:55:23.152 INFO:teuthology.orchestra.run.smithi079.stdout: "num_recovering_prioritized": 0, 2024-08-20T01:55:23.152 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_started": 0, 2024-08-20T01:55:23.152 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_completed": 0, 2024-08-20T01:55:23.152 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_quiesce_path": 0, 2024-08-20T01:55:23.152 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_quiesce_inode": 0, 2024-08-20T01:55:23.152 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_enqueue_scrub": 0, 2024-08-20T01:55:23.153 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_exportdir": 0, 2024-08-20T01:55:23.153 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_flush": 0, 2024-08-20T01:55:23.153 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_fragmentdir": 0, 2024-08-20T01:55:23.153 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_fragstats": 0, 2024-08-20T01:55:23.153 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_inodestats": 0 2024-08-20T01:55:23.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.153 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_log": { 2024-08-20T01:55:23.153 INFO:teuthology.orchestra.run.smithi079.stdout: "evlrg": 0, 2024-08-20T01:55:23.153 INFO:teuthology.orchestra.run.smithi079.stdout: "evadd": 0, 2024-08-20T01:55:23.153 INFO:teuthology.orchestra.run.smithi079.stdout: "evex": 0, 2024-08-20T01:55:23.153 INFO:teuthology.orchestra.run.smithi079.stdout: "evtrm": 0, 2024-08-20T01:55:23.153 INFO:teuthology.orchestra.run.smithi079.stdout: "ev": 1323, 2024-08-20T01:55:23.153 INFO:teuthology.orchestra.run.smithi079.stdout: "evexg": 0, 2024-08-20T01:55:23.153 INFO:teuthology.orchestra.run.smithi079.stdout: "evexd": 0, 2024-08-20T01:55:23.154 INFO:teuthology.orchestra.run.smithi079.stdout: "segadd": 0, 2024-08-20T01:55:23.154 INFO:teuthology.orchestra.run.smithi079.stdout: "segex": 0, 2024-08-20T01:55:23.154 INFO:teuthology.orchestra.run.smithi079.stdout: "segtrm": 0, 2024-08-20T01:55:23.154 INFO:teuthology.orchestra.run.smithi079.stdout: "seg": 3, 2024-08-20T01:55:23.154 INFO:teuthology.orchestra.run.smithi079.stdout: "segmjr": 2, 2024-08-20T01:55:23.154 INFO:teuthology.orchestra.run.smithi079.stdout: "segexg": 0, 2024-08-20T01:55:23.154 INFO:teuthology.orchestra.run.smithi079.stdout: "segexd": 0, 2024-08-20T01:55:23.154 INFO:teuthology.orchestra.run.smithi079.stdout: "expos": 4194304, 2024-08-20T01:55:23.154 INFO:teuthology.orchestra.run.smithi079.stdout: "wrpos": 6148001, 2024-08-20T01:55:23.154 INFO:teuthology.orchestra.run.smithi079.stdout: "rdpos": 6145778, 2024-08-20T01:55:23.154 INFO:teuthology.orchestra.run.smithi079.stdout: "jlat": { 2024-08-20T01:55:23.154 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:23.154 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:23.155 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:23.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.155 INFO:teuthology.orchestra.run.smithi079.stdout: "replayed": 1323 2024-08-20T01:55:23.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.155 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_mem": { 2024-08-20T01:55:23.155 INFO:teuthology.orchestra.run.smithi079.stdout: "ino": 5, 2024-08-20T01:55:23.155 INFO:teuthology.orchestra.run.smithi079.stdout: "ino+": 212, 2024-08-20T01:55:23.155 INFO:teuthology.orchestra.run.smithi079.stdout: "ino-": 207, 2024-08-20T01:55:23.155 INFO:teuthology.orchestra.run.smithi079.stdout: "dir": 3, 2024-08-20T01:55:23.155 INFO:teuthology.orchestra.run.smithi079.stdout: "dir+": 100, 2024-08-20T01:55:23.155 INFO:teuthology.orchestra.run.smithi079.stdout: "dir-": 97, 2024-08-20T01:55:23.155 INFO:teuthology.orchestra.run.smithi079.stdout: "dn": 181, 2024-08-20T01:55:23.155 INFO:teuthology.orchestra.run.smithi079.stdout: "dn+": 449, 2024-08-20T01:55:23.156 INFO:teuthology.orchestra.run.smithi079.stdout: "dn-": 268, 2024-08-20T01:55:23.156 INFO:teuthology.orchestra.run.smithi079.stdout: "cap": 0, 2024-08-20T01:55:23.156 INFO:teuthology.orchestra.run.smithi079.stdout: "cap+": 0, 2024-08-20T01:55:23.156 INFO:teuthology.orchestra.run.smithi079.stdout: "cap-": 0, 2024-08-20T01:55:23.156 INFO:teuthology.orchestra.run.smithi079.stdout: "rss": 52724, 2024-08-20T01:55:23.156 INFO:teuthology.orchestra.run.smithi079.stdout: "heap": 250339328 2024-08-20T01:55:23.156 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.156 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_server": { 2024-08-20T01:55:23.156 INFO:teuthology.orchestra.run.smithi079.stdout: "dispatch_client_request": 0, 2024-08-20T01:55:23.156 INFO:teuthology.orchestra.run.smithi079.stdout: "dispatch_server_request": 0, 2024-08-20T01:55:23.156 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_request": 0, 2024-08-20T01:55:23.156 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_session": 0, 2024-08-20T01:55:23.156 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_peer_request": 0, 2024-08-20T01:55:23.157 INFO:teuthology.orchestra.run.smithi079.stdout: "req_create_latency": { 2024-08-20T01:55:23.157 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:23.157 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:23.157 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:23.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.157 INFO:teuthology.orchestra.run.smithi079.stdout: "req_getattr_latency": { 2024-08-20T01:55:23.157 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:23.157 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:23.157 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:23.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.157 INFO:teuthology.orchestra.run.smithi079.stdout: "req_getfilelock_latency": { 2024-08-20T01:55:23.157 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:23.157 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:23.158 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:23.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.158 INFO:teuthology.orchestra.run.smithi079.stdout: "req_link_latency": { 2024-08-20T01:55:23.158 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:23.158 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:23.158 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:23.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.158 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookup_latency": { 2024-08-20T01:55:23.158 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:23.158 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:23.159 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:23.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.159 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookuphash_latency": { 2024-08-20T01:55:23.159 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:23.159 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:23.159 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:23.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.159 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupino_latency": { 2024-08-20T01:55:23.159 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:23.159 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:23.159 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:23.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.160 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupname_latency": { 2024-08-20T01:55:23.160 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:23.160 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:23.160 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:23.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.160 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupparent_latency": { 2024-08-20T01:55:23.160 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:23.160 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:23.160 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:23.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.160 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupsnap_latency": { 2024-08-20T01:55:23.161 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:23.161 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:23.161 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:23.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.161 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lssnap_latency": { 2024-08-20T01:55:23.161 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:23.161 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:23.161 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:23.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.161 INFO:teuthology.orchestra.run.smithi079.stdout: "req_mkdir_latency": { 2024-08-20T01:55:23.162 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:23.162 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:23.162 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:23.162 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.162 INFO:teuthology.orchestra.run.smithi079.stdout: "req_mknod_latency": { 2024-08-20T01:55:23.162 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:23.162 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:23.163 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:23.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.163 INFO:teuthology.orchestra.run.smithi079.stdout: "req_mksnap_latency": { 2024-08-20T01:55:23.163 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:23.163 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:23.163 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:23.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.163 INFO:teuthology.orchestra.run.smithi079.stdout: "req_open_latency": { 2024-08-20T01:55:23.163 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:23.163 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:23.163 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:23.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.163 INFO:teuthology.orchestra.run.smithi079.stdout: "req_readdir_latency": { 2024-08-20T01:55:23.164 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:23.164 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:23.164 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:23.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.164 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rename_latency": { 2024-08-20T01:55:23.164 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:23.164 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:23.164 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:23.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.164 INFO:teuthology.orchestra.run.smithi079.stdout: "req_renamesnap_latency": { 2024-08-20T01:55:23.164 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:23.164 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:23.164 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:23.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.165 INFO:teuthology.orchestra.run.smithi079.stdout: "req_snapdiff_latency": { 2024-08-20T01:55:23.165 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:23.165 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:23.165 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:23.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.165 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rmdir_latency": { 2024-08-20T01:55:23.165 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:23.165 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:23.165 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:23.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.165 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rmsnap_latency": { 2024-08-20T01:55:23.165 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:23.165 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:23.166 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:23.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.166 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rmxattr_latency": { 2024-08-20T01:55:23.166 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:23.166 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:23.166 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:23.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.166 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setattr_latency": { 2024-08-20T01:55:23.166 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:23.166 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:23.166 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:23.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.166 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setdirlayout_latency": { 2024-08-20T01:55:23.167 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:23.167 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:23.167 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:23.167 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.167 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setfilelock_latency": { 2024-08-20T01:55:23.167 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:23.167 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:23.167 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:23.167 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.167 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setlayout_latency": { 2024-08-20T01:55:23.167 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:23.167 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:23.167 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:23.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.168 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setxattr_latency": { 2024-08-20T01:55:23.168 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:23.168 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:23.168 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:23.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.168 INFO:teuthology.orchestra.run.smithi079.stdout: "req_symlink_latency": { 2024-08-20T01:55:23.168 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:23.168 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:23.168 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:23.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.168 INFO:teuthology.orchestra.run.smithi079.stdout: "req_unlink_latency": { 2024-08-20T01:55:23.169 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:23.169 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:23.169 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:23.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.169 INFO:teuthology.orchestra.run.smithi079.stdout: "cap_revoke_eviction": 0, 2024-08-20T01:55:23.169 INFO:teuthology.orchestra.run.smithi079.stdout: "cap_acquisition_throttle": 0, 2024-08-20T01:55:23.169 INFO:teuthology.orchestra.run.smithi079.stdout: "req_getvxattr_latency": { 2024-08-20T01:55:23.169 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:23.169 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:23.169 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:23.169 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:23.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.169 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_sessions": { 2024-08-20T01:55:23.170 INFO:teuthology.orchestra.run.smithi079.stdout: "session_count": 1, 2024-08-20T01:55:23.170 INFO:teuthology.orchestra.run.smithi079.stdout: "session_add": 1, 2024-08-20T01:55:23.170 INFO:teuthology.orchestra.run.smithi079.stdout: "session_remove": 0, 2024-08-20T01:55:23.170 INFO:teuthology.orchestra.run.smithi079.stdout: "sessions_open": 1, 2024-08-20T01:55:23.170 INFO:teuthology.orchestra.run.smithi079.stdout: "sessions_stale": 0, 2024-08-20T01:55:23.170 INFO:teuthology.orchestra.run.smithi079.stdout: "total_load": 0, 2024-08-20T01:55:23.170 INFO:teuthology.orchestra.run.smithi079.stdout: "average_load": 0, 2024-08-20T01:55:23.170 INFO:teuthology.orchestra.run.smithi079.stdout: "avg_session_uptime": 2094, 2024-08-20T01:55:23.170 INFO:teuthology.orchestra.run.smithi079.stdout: "mdthresh_evicted": 0 2024-08-20T01:55:23.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.170 INFO:teuthology.orchestra.run.smithi079.stdout: "mempool": { 2024-08-20T01:55:23.170 INFO:teuthology.orchestra.run.smithi079.stdout: "bloom_filter_bytes": 0, 2024-08-20T01:55:23.171 INFO:teuthology.orchestra.run.smithi079.stdout: "bloom_filter_items": 0, 2024-08-20T01:55:23.171 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_alloc_bytes": 0, 2024-08-20T01:55:23.171 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_alloc_items": 0, 2024-08-20T01:55:23.171 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_data_bytes": 0, 2024-08-20T01:55:23.171 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_data_items": 0, 2024-08-20T01:55:23.171 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-20T01:55:23.171 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_onode_items": 0, 2024-08-20T01:55:23.171 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-20T01:55:23.171 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_meta_items": 0, 2024-08-20T01:55:23.171 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_other_bytes": 0, 2024-08-20T01:55:23.171 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_other_items": 0, 2024-08-20T01:55:23.171 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-20T01:55:23.171 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_buffer_items": 0, 2024-08-20T01:55:23.172 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_extent_bytes": 0, 2024-08-20T01:55:23.172 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_extent_items": 0, 2024-08-20T01:55:23.172 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_blob_bytes": 0, 2024-08-20T01:55:23.172 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_blob_items": 0, 2024-08-20T01:55:23.172 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-20T01:55:23.172 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_shared_blob_items": 0, 2024-08-20T01:55:23.172 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-20T01:55:23.172 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_inline_bl_items": 0, 2024-08-20T01:55:23.172 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_bytes": 0, 2024-08-20T01:55:23.172 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_items": 0, 2024-08-20T01:55:23.172 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_txc_bytes": 0, 2024-08-20T01:55:23.172 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_txc_items": 0, 2024-08-20T01:55:23.172 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-20T01:55:23.173 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_deferred_items": 0, 2024-08-20T01:55:23.173 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_bytes": 0, 2024-08-20T01:55:23.173 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_items": 0, 2024-08-20T01:55:23.173 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_bytes": 0, 2024-08-20T01:55:23.173 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_items": 0, 2024-08-20T01:55:23.173 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_reader_bytes": 0, 2024-08-20T01:55:23.173 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_reader_items": 0, 2024-08-20T01:55:23.173 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_writer_bytes": 0, 2024-08-20T01:55:23.173 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_writer_items": 0, 2024-08-20T01:55:23.173 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_anon_bytes": 190167, 2024-08-20T01:55:23.173 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_anon_items": 52, 2024-08-20T01:55:23.173 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_meta_bytes": 0, 2024-08-20T01:55:23.173 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_meta_items": 0, 2024-08-20T01:55:23.174 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_bytes": 0, 2024-08-20T01:55:23.174 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_items": 0, 2024-08-20T01:55:23.174 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mapbl_bytes": 0, 2024-08-20T01:55:23.174 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mapbl_items": 0, 2024-08-20T01:55:23.174 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pglog_bytes": 0, 2024-08-20T01:55:23.174 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pglog_items": 0, 2024-08-20T01:55:23.174 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_bytes": 7496, 2024-08-20T01:55:23.174 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_items": 154, 2024-08-20T01:55:23.174 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_mapping_bytes": 0, 2024-08-20T01:55:23.174 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_mapping_items": 0, 2024-08-20T01:55:23.174 INFO:teuthology.orchestra.run.smithi079.stdout: "pgmap_bytes": 0, 2024-08-20T01:55:23.174 INFO:teuthology.orchestra.run.smithi079.stdout: "pgmap_items": 0, 2024-08-20T01:55:23.175 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_co_bytes": 138640, 2024-08-20T01:55:23.175 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_co_items": 764, 2024-08-20T01:55:23.175 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_1_bytes": 0, 2024-08-20T01:55:23.175 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_1_items": 0, 2024-08-20T01:55:23.175 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_2_bytes": 0, 2024-08-20T01:55:23.175 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_2_items": 0 2024-08-20T01:55:23.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.175 INFO:teuthology.orchestra.run.smithi079.stdout: "objecter": { 2024-08-20T01:55:23.175 INFO:teuthology.orchestra.run.smithi079.stdout: "op_active": 0, 2024-08-20T01:55:23.175 INFO:teuthology.orchestra.run.smithi079.stdout: "op_laggy": 0, 2024-08-20T01:55:23.175 INFO:teuthology.orchestra.run.smithi079.stdout: "op_send": 3431, 2024-08-20T01:55:23.176 INFO:teuthology.orchestra.run.smithi079.stdout: "op_send_bytes": 21, 2024-08-20T01:55:23.176 INFO:teuthology.orchestra.run.smithi079.stdout: "op_resend": 3, 2024-08-20T01:55:23.176 INFO:teuthology.orchestra.run.smithi079.stdout: "op_reply": 3431, 2024-08-20T01:55:23.176 INFO:teuthology.orchestra.run.smithi079.stdout: "op_latency": { 2024-08-20T01:55:23.176 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 3431, 2024-08-20T01:55:23.176 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 135.370035350, 2024-08-20T01:55:23.176 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.039454979 2024-08-20T01:55:23.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.176 INFO:teuthology.orchestra.run.smithi079.stdout: "op_inflight": 0, 2024-08-20T01:55:23.176 INFO:teuthology.orchestra.run.smithi079.stdout: "oplen_avg": { 2024-08-20T01:55:23.176 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 3431, 2024-08-20T01:55:23.176 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 3432 2024-08-20T01:55:23.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.177 INFO:teuthology.orchestra.run.smithi079.stdout: "op": 3431, 2024-08-20T01:55:23.177 INFO:teuthology.orchestra.run.smithi079.stdout: "op_r": 3431, 2024-08-20T01:55:23.177 INFO:teuthology.orchestra.run.smithi079.stdout: "op_w": 0, 2024-08-20T01:55:23.177 INFO:teuthology.orchestra.run.smithi079.stdout: "op_rmw": 0, 2024-08-20T01:55:23.177 INFO:teuthology.orchestra.run.smithi079.stdout: "op_pg": 0, 2024-08-20T01:55:23.177 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_stat": 2064, 2024-08-20T01:55:23.177 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_create": 0, 2024-08-20T01:55:23.177 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_read": 1365, 2024-08-20T01:55:23.177 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_write": 0, 2024-08-20T01:55:23.177 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_writefull": 0, 2024-08-20T01:55:23.177 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_writesame": 0, 2024-08-20T01:55:23.177 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_append": 0, 2024-08-20T01:55:23.177 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_zero": 0, 2024-08-20T01:55:23.178 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_truncate": 0, 2024-08-20T01:55:23.178 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_delete": 0, 2024-08-20T01:55:23.178 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_mapext": 0, 2024-08-20T01:55:23.178 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_sparse_read": 0, 2024-08-20T01:55:23.178 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_clonerange": 0, 2024-08-20T01:55:23.178 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_getxattr": 1, 2024-08-20T01:55:23.178 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_setxattr": 0, 2024-08-20T01:55:23.178 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_cmpxattr": 0, 2024-08-20T01:55:23.178 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_rmxattr": 0, 2024-08-20T01:55:23.178 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_resetxattrs": 0, 2024-08-20T01:55:23.178 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_call": 0, 2024-08-20T01:55:23.179 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_watch": 0, 2024-08-20T01:55:23.179 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_notify": 0, 2024-08-20T01:55:23.179 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_src_cmpxattr": 0, 2024-08-20T01:55:23.179 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_pgls": 0, 2024-08-20T01:55:23.179 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_pgls_filter": 0, 2024-08-20T01:55:23.179 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_other": 0, 2024-08-20T01:55:23.179 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_active": 0, 2024-08-20T01:55:23.179 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_send": 0, 2024-08-20T01:55:23.179 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_resend": 0, 2024-08-20T01:55:23.179 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_ping": 0, 2024-08-20T01:55:23.179 INFO:teuthology.orchestra.run.smithi079.stdout: "poolop_active": 0, 2024-08-20T01:55:23.179 INFO:teuthology.orchestra.run.smithi079.stdout: "poolop_send": 0, 2024-08-20T01:55:23.179 INFO:teuthology.orchestra.run.smithi079.stdout: "poolop_resend": 0, 2024-08-20T01:55:23.180 INFO:teuthology.orchestra.run.smithi079.stdout: "poolstat_active": 0, 2024-08-20T01:55:23.180 INFO:teuthology.orchestra.run.smithi079.stdout: "poolstat_send": 0, 2024-08-20T01:55:23.180 INFO:teuthology.orchestra.run.smithi079.stdout: "poolstat_resend": 0, 2024-08-20T01:55:23.180 INFO:teuthology.orchestra.run.smithi079.stdout: "statfs_active": 0, 2024-08-20T01:55:23.180 INFO:teuthology.orchestra.run.smithi079.stdout: "statfs_send": 0, 2024-08-20T01:55:23.180 INFO:teuthology.orchestra.run.smithi079.stdout: "statfs_resend": 0, 2024-08-20T01:55:23.180 INFO:teuthology.orchestra.run.smithi079.stdout: "command_active": 0, 2024-08-20T01:55:23.180 INFO:teuthology.orchestra.run.smithi079.stdout: "command_send": 0, 2024-08-20T01:55:23.180 INFO:teuthology.orchestra.run.smithi079.stdout: "command_resend": 0, 2024-08-20T01:55:23.180 INFO:teuthology.orchestra.run.smithi079.stdout: "map_epoch": 74, 2024-08-20T01:55:23.180 INFO:teuthology.orchestra.run.smithi079.stdout: "map_full": 0, 2024-08-20T01:55:23.180 INFO:teuthology.orchestra.run.smithi079.stdout: "map_inc": 2, 2024-08-20T01:55:23.180 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_sessions": 5, 2024-08-20T01:55:23.181 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_session_open": 7, 2024-08-20T01:55:23.181 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_session_close": 2, 2024-08-20T01:55:23.181 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_laggy": 0, 2024-08-20T01:55:23.181 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_wr": 0, 2024-08-20T01:55:23.181 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_rd": 2, 2024-08-20T01:55:23.181 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_del": 0 2024-08-20T01:55:23.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.181 INFO:teuthology.orchestra.run.smithi079.stdout: "oft": { 2024-08-20T01:55:23.181 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_objs": 0, 2024-08-20T01:55:23.181 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_kv_pairs": 0, 2024-08-20T01:55:23.181 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_updates": 0, 2024-08-20T01:55:23.181 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_removes": 0 2024-08-20T01:55:23.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.182 INFO:teuthology.orchestra.run.smithi079.stdout: "purge_queue": { 2024-08-20T01:55:23.182 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing_ops": 0, 2024-08-20T01:55:23.182 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing_ops_high_water": 0, 2024-08-20T01:55:23.182 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing": 0, 2024-08-20T01:55:23.182 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing_high_water": 0, 2024-08-20T01:55:23.182 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executed_ops": 0, 2024-08-20T01:55:23.182 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executed": 0, 2024-08-20T01:55:23.182 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_item_in_journal": 0 2024-08-20T01:55:23.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.182 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-20T01:55:23.182 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2024-08-20T01:55:23.182 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 104857600, 2024-08-20T01:55:23.183 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2024-08-20T01:55:23.183 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 3817, 2024-08-20T01:55:23.183 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 3414266, 2024-08-20T01:55:23.183 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:23.183 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 3817, 2024-08-20T01:55:23.183 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 0, 2024-08-20T01:55:23.183 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 0, 2024-08-20T01:55:23.183 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 3817, 2024-08-20T01:55:23.183 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 3414266, 2024-08-20T01:55:23.183 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2024-08-20T01:55:23.183 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:23.183 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:23.184 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:23.184 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:23.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.184 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-objecter_bytes": { 2024-08-20T01:55:23.184 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2024-08-20T01:55:23.184 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 104857600, 2024-08-20T01:55:23.184 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2024-08-20T01:55:23.184 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 0, 2024-08-20T01:55:23.184 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 0, 2024-08-20T01:55:23.184 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:23.184 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 0, 2024-08-20T01:55:23.184 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 3431, 2024-08-20T01:55:23.184 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 1953702, 2024-08-20T01:55:23.185 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 3431, 2024-08-20T01:55:23.185 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 1953702, 2024-08-20T01:55:23.185 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2024-08-20T01:55:23.185 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:23.185 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:23.185 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:23.185 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:23.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.185 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-objecter_ops": { 2024-08-20T01:55:23.185 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2024-08-20T01:55:23.185 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 1024, 2024-08-20T01:55:23.185 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2024-08-20T01:55:23.185 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 0, 2024-08-20T01:55:23.186 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 0, 2024-08-20T01:55:23.186 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:23.186 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 0, 2024-08-20T01:55:23.186 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 3431, 2024-08-20T01:55:23.186 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 3431, 2024-08-20T01:55:23.186 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 3431, 2024-08-20T01:55:23.186 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 3431, 2024-08-20T01:55:23.186 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2024-08-20T01:55:23.186 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:23.186 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:23.186 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:23.186 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:23.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.187 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-write_buf_throttle": { 2024-08-20T01:55:23.187 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2024-08-20T01:55:23.187 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 3758096384, 2024-08-20T01:55:23.187 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2024-08-20T01:55:23.187 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 0, 2024-08-20T01:55:23.187 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 0, 2024-08-20T01:55:23.187 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:23.187 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 0, 2024-08-20T01:55:23.187 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 0, 2024-08-20T01:55:23.187 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 0, 2024-08-20T01:55:23.187 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 0, 2024-08-20T01:55:23.187 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 0, 2024-08-20T01:55:23.188 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2024-08-20T01:55:23.188 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:23.188 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:23.188 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:23.188 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:23.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.188 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-write_buf_throttle-0x55611bd96960": { 2024-08-20T01:55:23.188 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2024-08-20T01:55:23.188 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 3758096384, 2024-08-20T01:55:23.188 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2024-08-20T01:55:23.188 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 0, 2024-08-20T01:55:23.188 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 0, 2024-08-20T01:55:23.188 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:23.188 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 0, 2024-08-20T01:55:23.189 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 0, 2024-08-20T01:55:23.189 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 0, 2024-08-20T01:55:23.189 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 0, 2024-08-20T01:55:23.189 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 0, 2024-08-20T01:55:23.189 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2024-08-20T01:55:23.189 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:23.189 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:23.189 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:23.189 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:23.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:23.189 INFO:teuthology.orchestra.run.smithi079.stdout: "trackedop": { 2024-08-20T01:55:23.189 INFO:teuthology.orchestra.run.smithi079.stdout: "slow_ops_count": 0 2024-08-20T01:55:23.189 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:23.189 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:55:24.023 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-08-20T01:55:24.023 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-08-20T01:55:24.023 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2024-08-20T01:55:24.023 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=0 2024-08-20T01:55:24.024 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=0 2024-08-20T01:55:24.024 DEBUG:tasks.check_counter:Getting stats from d 2024-08-20T01:55:24.024 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph daemon mds.d perf dump 2024-08-20T01:55:24.283 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:55:24.666 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:24 smithi079 ceph-mon[18656]: pgmap v889: 97 pgs: 97 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 18 op/s 2024-08-20T01:55:24.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:24 smithi081 ceph-mon[22209]: pgmap v889: 97 pgs: 97 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 18 op/s 2024-08-20T01:55:24.783 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:55:24.783 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-0": { 2024-08-20T01:55:24.783 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 0, 2024-08-20T01:55:24.783 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 2, 2024-08-20T01:55:24.783 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 0, 2024-08-20T01:55:24.783 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 0, 2024-08-20T01:55:24.783 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 4, 2024-08-20T01:55:24.783 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 0, 2024-08-20T01:55:24.783 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.001366785, 2024-08-20T01:55:24.783 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.000000000, 2024-08-20T01:55:24.784 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.000231553, 2024-08-20T01:55:24.784 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-20T01:55:24.784 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:55:24.784 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:24.784 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:24.784 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:24.784 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:24.784 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:55:24.784 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:24.784 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:24.784 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:24.784 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:24.784 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-20T01:55:24.784 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 0 2024-08-20T01:55:24.785 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:24.785 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-1": { 2024-08-20T01:55:24.785 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 339, 2024-08-20T01:55:24.785 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 336, 2024-08-20T01:55:24.785 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 552560, 2024-08-20T01:55:24.785 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 207616, 2024-08-20T01:55:24.785 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 2, 2024-08-20T01:55:24.785 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 1, 2024-08-20T01:55:24.785 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.047398523, 2024-08-20T01:55:24.785 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.025110615, 2024-08-20T01:55:24.785 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.026598038, 2024-08-20T01:55:24.785 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-20T01:55:24.785 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:55:24.785 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 335, 2024-08-20T01:55:24.786 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.015558300, 2024-08-20T01:55:24.786 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000046442 2024-08-20T01:55:24.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:24.786 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:55:24.786 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:24.786 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:24.786 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:24.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:24.786 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 552560, 2024-08-20T01:55:24.786 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 207616 2024-08-20T01:55:24.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:24.786 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-2": { 2024-08-20T01:55:24.786 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 6, 2024-08-20T01:55:24.787 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 259, 2024-08-20T01:55:24.787 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 3264, 2024-08-20T01:55:24.787 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 205680, 2024-08-20T01:55:24.787 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 4, 2024-08-20T01:55:24.787 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 2, 2024-08-20T01:55:24.787 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.023508327, 2024-08-20T01:55:24.787 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.017553167, 2024-08-20T01:55:24.787 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.004140259, 2024-08-20T01:55:24.787 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-20T01:55:24.787 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:55:24.787 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 258, 2024-08-20T01:55:24.787 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.015229130, 2024-08-20T01:55:24.787 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000059027 2024-08-20T01:55:24.788 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:24.788 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:55:24.788 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:24.788 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:24.788 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:24.788 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:24.788 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 3264, 2024-08-20T01:55:24.788 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 205680 2024-08-20T01:55:24.788 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:24.788 INFO:teuthology.orchestra.run.smithi079.stdout: "cct": { 2024-08-20T01:55:24.788 INFO:teuthology.orchestra.run.smithi079.stdout: "total_workers": 0, 2024-08-20T01:55:24.788 INFO:teuthology.orchestra.run.smithi079.stdout: "unhealthy_workers": 0 2024-08-20T01:55:24.788 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:24.789 INFO:teuthology.orchestra.run.smithi079.stdout: "mempool": { 2024-08-20T01:55:24.789 INFO:teuthology.orchestra.run.smithi079.stdout: "bloom_filter_bytes": 0, 2024-08-20T01:55:24.789 INFO:teuthology.orchestra.run.smithi079.stdout: "bloom_filter_items": 0, 2024-08-20T01:55:24.789 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_alloc_bytes": 0, 2024-08-20T01:55:24.789 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_alloc_items": 0, 2024-08-20T01:55:24.789 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_data_bytes": 0, 2024-08-20T01:55:24.789 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_data_items": 0, 2024-08-20T01:55:24.789 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-20T01:55:24.789 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_onode_items": 0, 2024-08-20T01:55:24.789 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-20T01:55:24.789 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_meta_items": 0, 2024-08-20T01:55:24.789 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_other_bytes": 0, 2024-08-20T01:55:24.789 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_other_items": 0, 2024-08-20T01:55:24.789 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-20T01:55:24.790 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_buffer_items": 0, 2024-08-20T01:55:24.790 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_extent_bytes": 0, 2024-08-20T01:55:24.790 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_extent_items": 0, 2024-08-20T01:55:24.790 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_blob_bytes": 0, 2024-08-20T01:55:24.790 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_blob_items": 0, 2024-08-20T01:55:24.790 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-20T01:55:24.790 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_shared_blob_items": 0, 2024-08-20T01:55:24.790 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-20T01:55:24.790 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_inline_bl_items": 0, 2024-08-20T01:55:24.790 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_bytes": 0, 2024-08-20T01:55:24.790 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_items": 0, 2024-08-20T01:55:24.790 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_txc_bytes": 0, 2024-08-20T01:55:24.790 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_txc_items": 0, 2024-08-20T01:55:24.791 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-20T01:55:24.791 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_deferred_items": 0, 2024-08-20T01:55:24.791 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_bytes": 0, 2024-08-20T01:55:24.791 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_items": 0, 2024-08-20T01:55:24.791 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_bytes": 0, 2024-08-20T01:55:24.791 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_items": 0, 2024-08-20T01:55:24.791 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_reader_bytes": 0, 2024-08-20T01:55:24.791 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_reader_items": 0, 2024-08-20T01:55:24.791 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_writer_bytes": 0, 2024-08-20T01:55:24.791 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_writer_items": 0, 2024-08-20T01:55:24.791 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_anon_bytes": 148682, 2024-08-20T01:55:24.791 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_anon_items": 29, 2024-08-20T01:55:24.791 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_meta_bytes": 0, 2024-08-20T01:55:24.792 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_meta_items": 0, 2024-08-20T01:55:24.792 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_bytes": 0, 2024-08-20T01:55:24.792 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_items": 0, 2024-08-20T01:55:24.792 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mapbl_bytes": 0, 2024-08-20T01:55:24.792 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mapbl_items": 0, 2024-08-20T01:55:24.792 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pglog_bytes": 0, 2024-08-20T01:55:24.792 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pglog_items": 0, 2024-08-20T01:55:24.792 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_bytes": 0, 2024-08-20T01:55:24.792 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_items": 0, 2024-08-20T01:55:24.792 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_mapping_bytes": 0, 2024-08-20T01:55:24.792 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_mapping_items": 0, 2024-08-20T01:55:24.792 INFO:teuthology.orchestra.run.smithi079.stdout: "pgmap_bytes": 0, 2024-08-20T01:55:24.792 INFO:teuthology.orchestra.run.smithi079.stdout: "pgmap_items": 0, 2024-08-20T01:55:24.792 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_co_bytes": 928, 2024-08-20T01:55:24.793 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_co_items": 2, 2024-08-20T01:55:24.793 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_1_bytes": 0, 2024-08-20T01:55:24.793 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_1_items": 0, 2024-08-20T01:55:24.793 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_2_bytes": 0, 2024-08-20T01:55:24.793 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_2_items": 0 2024-08-20T01:55:24.793 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:24.793 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-20T01:55:24.793 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2024-08-20T01:55:24.793 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 104857600, 2024-08-20T01:55:24.793 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2024-08-20T01:55:24.793 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 341, 2024-08-20T01:55:24.793 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 504637, 2024-08-20T01:55:24.793 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:24.793 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 341, 2024-08-20T01:55:24.794 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 0, 2024-08-20T01:55:24.794 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 0, 2024-08-20T01:55:24.794 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 341, 2024-08-20T01:55:24.794 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 504637, 2024-08-20T01:55:24.794 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2024-08-20T01:55:24.794 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:24.794 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:24.794 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:24.794 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:24.794 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:24.794 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:55:24.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:24 smithi175 ceph-mon[22392]: pgmap v889: 97 pgs: 97 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 18 op/s 2024-08-20T01:55:25.457 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-08-20T01:55:25.457 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-08-20T01:55:25.457 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-08-20T01:55:25.457 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-08-20T01:55:25.457 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-08-20T01:55:25.457 DEBUG:tasks.check_counter:Getting stats from g 2024-08-20T01:55:25.457 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph daemon mds.g perf dump 2024-08-20T01:55:25.708 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:55:26.246 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:55:26.246 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-0": { 2024-08-20T01:55:26.246 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 1476, 2024-08-20T01:55:26.246 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 1429, 2024-08-20T01:55:26.246 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 1230832, 2024-08-20T01:55:26.246 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 552842, 2024-08-20T01:55:26.246 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 5, 2024-08-20T01:55:26.247 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 1, 2024-08-20T01:55:26.247 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.168915573, 2024-08-20T01:55:26.247 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.086903613, 2024-08-20T01:55:26.247 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.051259936, 2024-08-20T01:55:26.247 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.028034980, 2024-08-20T01:55:26.247 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:55:26.247 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 1428, 2024-08-20T01:55:26.247 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.078528471, 2024-08-20T01:55:26.247 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000054991 2024-08-20T01:55:26.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.247 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:55:26.247 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:26.247 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:26.247 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:26.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.248 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 864256, 2024-08-20T01:55:26.248 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 205904 2024-08-20T01:55:26.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.248 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-1": { 2024-08-20T01:55:26.248 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 2329, 2024-08-20T01:55:26.248 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 2581, 2024-08-20T01:55:26.248 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 1858438, 2024-08-20T01:55:26.248 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 1357803, 2024-08-20T01:55:26.248 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 6, 2024-08-20T01:55:26.248 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 4, 2024-08-20T01:55:26.248 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.178715483, 2024-08-20T01:55:26.249 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.080020409, 2024-08-20T01:55:26.249 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.037514198, 2024-08-20T01:55:26.249 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.050326890, 2024-08-20T01:55:26.249 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:55:26.249 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 2579, 2024-08-20T01:55:26.249 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.099054724, 2024-08-20T01:55:26.249 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000038408 2024-08-20T01:55:26.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.249 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:55:26.249 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:26.249 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:26.249 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:26.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.250 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-20T01:55:26.250 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 617760 2024-08-20T01:55:26.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.250 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-2": { 2024-08-20T01:55:26.250 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 8, 2024-08-20T01:55:26.250 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 8, 2024-08-20T01:55:26.250 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 4573, 2024-08-20T01:55:26.250 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 1732, 2024-08-20T01:55:26.250 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 7, 2024-08-20T01:55:26.250 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 4, 2024-08-20T01:55:26.250 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.003986062, 2024-08-20T01:55:26.250 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.000147593, 2024-08-20T01:55:26.251 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.003616868, 2024-08-20T01:55:26.251 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.000070564, 2024-08-20T01:55:26.251 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:55:26.251 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 7, 2024-08-20T01:55:26.251 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.006112807, 2024-08-20T01:55:26.251 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000873258 2024-08-20T01:55:26.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.251 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:55:26.251 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:26.251 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:26.251 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:26.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.251 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-08-20T01:55:26.251 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 448 2024-08-20T01:55:26.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.252 INFO:teuthology.orchestra.run.smithi079.stdout: "cct": { 2024-08-20T01:55:26.252 INFO:teuthology.orchestra.run.smithi079.stdout: "total_workers": 1, 2024-08-20T01:55:26.252 INFO:teuthology.orchestra.run.smithi079.stdout: "unhealthy_workers": 0 2024-08-20T01:55:26.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.252 INFO:teuthology.orchestra.run.smithi079.stdout: "finisher-MDSRank": { 2024-08-20T01:55:26.252 INFO:teuthology.orchestra.run.smithi079.stdout: "queue_len": 0, 2024-08-20T01:55:26.252 INFO:teuthology.orchestra.run.smithi079.stdout: "complete_latency": { 2024-08-20T01:55:26.252 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 5729, 2024-08-20T01:55:26.252 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.122407110, 2024-08-20T01:55:26.253 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000021366 2024-08-20T01:55:26.253 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:26.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.253 INFO:teuthology.orchestra.run.smithi079.stdout: "finisher-PurgeQueue": { 2024-08-20T01:55:26.253 INFO:teuthology.orchestra.run.smithi079.stdout: "queue_len": 0, 2024-08-20T01:55:26.253 INFO:teuthology.orchestra.run.smithi079.stdout: "complete_latency": { 2024-08-20T01:55:26.253 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:26.253 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:26.253 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:26.253 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:26.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.254 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": { 2024-08-20T01:55:26.254 INFO:teuthology.orchestra.run.smithi079.stdout: "request": 0, 2024-08-20T01:55:26.254 INFO:teuthology.orchestra.run.smithi079.stdout: "reply": 0, 2024-08-20T01:55:26.254 INFO:teuthology.orchestra.run.smithi079.stdout: "reply_latency": { 2024-08-20T01:55:26.254 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:26.254 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:26.254 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:26.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.254 INFO:teuthology.orchestra.run.smithi079.stdout: "slow_reply": 0, 2024-08-20T01:55:26.254 INFO:teuthology.orchestra.run.smithi079.stdout: "forward": 0, 2024-08-20T01:55:26.254 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_fetch_complete": 0, 2024-08-20T01:55:26.254 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_fetch_keys": 0, 2024-08-20T01:55:26.254 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_commit": 0, 2024-08-20T01:55:26.254 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_split": 0, 2024-08-20T01:55:26.255 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_merge": 0, 2024-08-20T01:55:26.255 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes": 29, 2024-08-20T01:55:26.255 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_top": 0, 2024-08-20T01:55:26.255 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_bottom": 29, 2024-08-20T01:55:26.255 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_pin_tail": 0, 2024-08-20T01:55:26.255 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_pinned": 29, 2024-08-20T01:55:26.255 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_expired": 1, 2024-08-20T01:55:26.255 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_with_caps": 0, 2024-08-20T01:55:26.255 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": 0, 2024-08-20T01:55:26.255 INFO:teuthology.orchestra.run.smithi079.stdout: "subtrees": 1, 2024-08-20T01:55:26.256 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse": 0, 2024-08-20T01:55:26.256 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_hit": 0, 2024-08-20T01:55:26.256 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_forward": 0, 2024-08-20T01:55:26.256 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_discover": 0, 2024-08-20T01:55:26.256 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_dir_fetch": 0, 2024-08-20T01:55:26.256 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_remote_ino": 0, 2024-08-20T01:55:26.256 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_lock": 0, 2024-08-20T01:55:26.256 INFO:teuthology.orchestra.run.smithi079.stdout: "load_cent": 0, 2024-08-20T01:55:26.256 INFO:teuthology.orchestra.run.smithi079.stdout: "q": 0, 2024-08-20T01:55:26.256 INFO:teuthology.orchestra.run.smithi079.stdout: "exported": 0, 2024-08-20T01:55:26.256 INFO:teuthology.orchestra.run.smithi079.stdout: "exported_inodes": 0, 2024-08-20T01:55:26.256 INFO:teuthology.orchestra.run.smithi079.stdout: "imported": 0, 2024-08-20T01:55:26.257 INFO:teuthology.orchestra.run.smithi079.stdout: "imported_inodes": 0, 2024-08-20T01:55:26.257 INFO:teuthology.orchestra.run.smithi079.stdout: "openino_dir_fetch": 0, 2024-08-20T01:55:26.257 INFO:teuthology.orchestra.run.smithi079.stdout: "openino_backtrace_fetch": 0, 2024-08-20T01:55:26.257 INFO:teuthology.orchestra.run.smithi079.stdout: "openino_peer_discover": 0, 2024-08-20T01:55:26.257 INFO:teuthology.orchestra.run.smithi079.stdout: "root_rfiles": 0, 2024-08-20T01:55:26.257 INFO:teuthology.orchestra.run.smithi079.stdout: "root_rbytes": 0, 2024-08-20T01:55:26.257 INFO:teuthology.orchestra.run.smithi079.stdout: "root_rsnaps": 0, 2024-08-20T01:55:26.257 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_backtrace_fetch": 0, 2024-08-20T01:55:26.257 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_set_tag": 0, 2024-08-20T01:55:26.257 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_backtrace_repaired": 0, 2024-08-20T01:55:26.258 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_inotable_repaired": 0, 2024-08-20T01:55:26.258 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_dir_inodes": 0, 2024-08-20T01:55:26.258 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_dir_base_inodes": 0, 2024-08-20T01:55:26.258 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_dirfrag_rstats": 0, 2024-08-20T01:55:26.258 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_file_inodes": 0, 2024-08-20T01:55:26.258 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_inode_file_caps": 0, 2024-08-20T01:55:26.258 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_revoke": 0, 2024-08-20T01:55:26.258 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_grant": 0, 2024-08-20T01:55:26.258 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_trunc": 0, 2024-08-20T01:55:26.258 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-20T01:55:26.258 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-20T01:55:26.258 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_caps": 0, 2024-08-20T01:55:26.258 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_caps_dirty": 0, 2024-08-20T01:55:26.259 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_cap_release": 0, 2024-08-20T01:55:26.259 INFO:teuthology.orchestra.run.smithi079.stdout: "process_request_cap_release": 0 2024-08-20T01:55:26.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.259 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_cache": { 2024-08-20T01:55:26.259 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_update": 0, 2024-08-20T01:55:26.259 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_update_receipt": 0, 2024-08-20T01:55:26.259 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_try_discover": 0, 2024-08-20T01:55:26.259 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_send_discover": 0, 2024-08-20T01:55:26.259 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_handle_discover": 0, 2024-08-20T01:55:26.259 INFO:teuthology.orchestra.run.smithi079.stdout: "num_strays": 0, 2024-08-20T01:55:26.259 INFO:teuthology.orchestra.run.smithi079.stdout: "num_strays_delayed": 0, 2024-08-20T01:55:26.259 INFO:teuthology.orchestra.run.smithi079.stdout: "num_strays_enqueuing": 0, 2024-08-20T01:55:26.260 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_created": 0, 2024-08-20T01:55:26.260 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_enqueued": 0, 2024-08-20T01:55:26.260 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_reintegrated": 0, 2024-08-20T01:55:26.260 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_migrated": 0, 2024-08-20T01:55:26.260 INFO:teuthology.orchestra.run.smithi079.stdout: "num_recovering_processing": 0, 2024-08-20T01:55:26.260 INFO:teuthology.orchestra.run.smithi079.stdout: "num_recovering_enqueued": 0, 2024-08-20T01:55:26.260 INFO:teuthology.orchestra.run.smithi079.stdout: "num_recovering_prioritized": 0, 2024-08-20T01:55:26.260 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_started": 0, 2024-08-20T01:55:26.260 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_completed": 0, 2024-08-20T01:55:26.260 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_quiesce_path": 0, 2024-08-20T01:55:26.260 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_quiesce_inode": 0, 2024-08-20T01:55:26.260 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_enqueue_scrub": 0, 2024-08-20T01:55:26.260 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_exportdir": 0, 2024-08-20T01:55:26.260 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_flush": 0, 2024-08-20T01:55:26.261 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_fragmentdir": 0, 2024-08-20T01:55:26.261 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_fragstats": 0, 2024-08-20T01:55:26.261 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_inodestats": 0 2024-08-20T01:55:26.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.261 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_log": { 2024-08-20T01:55:26.261 INFO:teuthology.orchestra.run.smithi079.stdout: "evlrg": 0, 2024-08-20T01:55:26.261 INFO:teuthology.orchestra.run.smithi079.stdout: "evadd": 0, 2024-08-20T01:55:26.261 INFO:teuthology.orchestra.run.smithi079.stdout: "evex": 0, 2024-08-20T01:55:26.261 INFO:teuthology.orchestra.run.smithi079.stdout: "evtrm": 0, 2024-08-20T01:55:26.261 INFO:teuthology.orchestra.run.smithi079.stdout: "ev": 906, 2024-08-20T01:55:26.261 INFO:teuthology.orchestra.run.smithi079.stdout: "evexg": 0, 2024-08-20T01:55:26.261 INFO:teuthology.orchestra.run.smithi079.stdout: "evexd": 0, 2024-08-20T01:55:26.261 INFO:teuthology.orchestra.run.smithi079.stdout: "segadd": 0, 2024-08-20T01:55:26.261 INFO:teuthology.orchestra.run.smithi079.stdout: "segex": 0, 2024-08-20T01:55:26.262 INFO:teuthology.orchestra.run.smithi079.stdout: "segtrm": 0, 2024-08-20T01:55:26.262 INFO:teuthology.orchestra.run.smithi079.stdout: "seg": 2, 2024-08-20T01:55:26.262 INFO:teuthology.orchestra.run.smithi079.stdout: "segmjr": 2, 2024-08-20T01:55:26.262 INFO:teuthology.orchestra.run.smithi079.stdout: "segexg": 0, 2024-08-20T01:55:26.262 INFO:teuthology.orchestra.run.smithi079.stdout: "segexd": 0, 2024-08-20T01:55:26.262 INFO:teuthology.orchestra.run.smithi079.stdout: "expos": 4194304, 2024-08-20T01:55:26.262 INFO:teuthology.orchestra.run.smithi079.stdout: "wrpos": 5462460, 2024-08-20T01:55:26.262 INFO:teuthology.orchestra.run.smithi079.stdout: "rdpos": 5460237, 2024-08-20T01:55:26.262 INFO:teuthology.orchestra.run.smithi079.stdout: "jlat": { 2024-08-20T01:55:26.262 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:26.262 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:26.262 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:26.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.263 INFO:teuthology.orchestra.run.smithi079.stdout: "replayed": 906 2024-08-20T01:55:26.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.263 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_mem": { 2024-08-20T01:55:26.263 INFO:teuthology.orchestra.run.smithi079.stdout: "ino": 4, 2024-08-20T01:55:26.263 INFO:teuthology.orchestra.run.smithi079.stdout: "ino+": 168, 2024-08-20T01:55:26.263 INFO:teuthology.orchestra.run.smithi079.stdout: "ino-": 164, 2024-08-20T01:55:26.263 INFO:teuthology.orchestra.run.smithi079.stdout: "dir": 2, 2024-08-20T01:55:26.263 INFO:teuthology.orchestra.run.smithi079.stdout: "dir+": 42, 2024-08-20T01:55:26.263 INFO:teuthology.orchestra.run.smithi079.stdout: "dir-": 40, 2024-08-20T01:55:26.263 INFO:teuthology.orchestra.run.smithi079.stdout: "dn": 29, 2024-08-20T01:55:26.263 INFO:teuthology.orchestra.run.smithi079.stdout: "dn+": 197, 2024-08-20T01:55:26.263 INFO:teuthology.orchestra.run.smithi079.stdout: "dn-": 168, 2024-08-20T01:55:26.264 INFO:teuthology.orchestra.run.smithi079.stdout: "cap": 0, 2024-08-20T01:55:26.264 INFO:teuthology.orchestra.run.smithi079.stdout: "cap+": 0, 2024-08-20T01:55:26.264 INFO:teuthology.orchestra.run.smithi079.stdout: "cap-": 0, 2024-08-20T01:55:26.264 INFO:teuthology.orchestra.run.smithi079.stdout: "rss": 52056, 2024-08-20T01:55:26.264 INFO:teuthology.orchestra.run.smithi079.stdout: "heap": 249282560 2024-08-20T01:55:26.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.264 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_server": { 2024-08-20T01:55:26.264 INFO:teuthology.orchestra.run.smithi079.stdout: "dispatch_client_request": 0, 2024-08-20T01:55:26.264 INFO:teuthology.orchestra.run.smithi079.stdout: "dispatch_server_request": 0, 2024-08-20T01:55:26.264 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_request": 0, 2024-08-20T01:55:26.264 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_session": 0, 2024-08-20T01:55:26.264 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_peer_request": 0, 2024-08-20T01:55:26.264 INFO:teuthology.orchestra.run.smithi079.stdout: "req_create_latency": { 2024-08-20T01:55:26.264 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:26.265 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:26.265 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:26.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.265 INFO:teuthology.orchestra.run.smithi079.stdout: "req_getattr_latency": { 2024-08-20T01:55:26.265 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:26.265 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:26.265 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:26.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.265 INFO:teuthology.orchestra.run.smithi079.stdout: "req_getfilelock_latency": { 2024-08-20T01:55:26.265 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:26.265 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:26.265 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:26.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.266 INFO:teuthology.orchestra.run.smithi079.stdout: "req_link_latency": { 2024-08-20T01:55:26.266 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:26.266 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:26.266 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:26.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.266 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookup_latency": { 2024-08-20T01:55:26.266 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:26.266 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:26.266 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:26.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.267 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookuphash_latency": { 2024-08-20T01:55:26.267 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:26.267 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:26.267 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:26.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.267 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupino_latency": { 2024-08-20T01:55:26.267 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:26.267 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:26.267 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:26.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.267 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupname_latency": { 2024-08-20T01:55:26.268 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:26.268 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:26.268 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:26.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.268 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupparent_latency": { 2024-08-20T01:55:26.268 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:26.268 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:26.268 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:26.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.268 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupsnap_latency": { 2024-08-20T01:55:26.268 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:26.268 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:26.268 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:26.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.269 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lssnap_latency": { 2024-08-20T01:55:26.269 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:26.269 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:26.269 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:26.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.269 INFO:teuthology.orchestra.run.smithi079.stdout: "req_mkdir_latency": { 2024-08-20T01:55:26.269 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:26.270 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:26.270 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:26.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.270 INFO:teuthology.orchestra.run.smithi079.stdout: "req_mknod_latency": { 2024-08-20T01:55:26.270 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:26.270 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:26.270 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:26.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.270 INFO:teuthology.orchestra.run.smithi079.stdout: "req_mksnap_latency": { 2024-08-20T01:55:26.270 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:26.270 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:26.270 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:26.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.271 INFO:teuthology.orchestra.run.smithi079.stdout: "req_open_latency": { 2024-08-20T01:55:26.271 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:26.271 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:26.271 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:26.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.271 INFO:teuthology.orchestra.run.smithi079.stdout: "req_readdir_latency": { 2024-08-20T01:55:26.271 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:26.271 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:26.271 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:26.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.271 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rename_latency": { 2024-08-20T01:55:26.271 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:26.271 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:26.272 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:26.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.272 INFO:teuthology.orchestra.run.smithi079.stdout: "req_renamesnap_latency": { 2024-08-20T01:55:26.272 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:26.272 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:26.272 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:26.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.272 INFO:teuthology.orchestra.run.smithi079.stdout: "req_snapdiff_latency": { 2024-08-20T01:55:26.272 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:26.272 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:26.272 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:26.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.272 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rmdir_latency": { 2024-08-20T01:55:26.272 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:26.273 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:26.273 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:26.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.273 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rmsnap_latency": { 2024-08-20T01:55:26.273 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:26.273 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:26.273 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:26.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.273 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rmxattr_latency": { 2024-08-20T01:55:26.273 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:26.273 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:26.273 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:26.274 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.274 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setattr_latency": { 2024-08-20T01:55:26.274 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:26.274 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:26.274 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:26.274 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.274 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setdirlayout_latency": { 2024-08-20T01:55:26.274 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:26.274 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:26.274 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:26.274 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.274 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setfilelock_latency": { 2024-08-20T01:55:26.274 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:26.275 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:26.275 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:26.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.275 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setlayout_latency": { 2024-08-20T01:55:26.275 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:26.275 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:26.275 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:26.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.275 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setxattr_latency": { 2024-08-20T01:55:26.275 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:26.275 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:26.275 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:26.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.276 INFO:teuthology.orchestra.run.smithi079.stdout: "req_symlink_latency": { 2024-08-20T01:55:26.276 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:26.276 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:26.276 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:26.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.276 INFO:teuthology.orchestra.run.smithi079.stdout: "req_unlink_latency": { 2024-08-20T01:55:26.276 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:26.276 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:26.276 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:26.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.276 INFO:teuthology.orchestra.run.smithi079.stdout: "cap_revoke_eviction": 0, 2024-08-20T01:55:26.276 INFO:teuthology.orchestra.run.smithi079.stdout: "cap_acquisition_throttle": 0, 2024-08-20T01:55:26.276 INFO:teuthology.orchestra.run.smithi079.stdout: "req_getvxattr_latency": { 2024-08-20T01:55:26.277 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:26.277 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:26.277 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:26.277 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:26.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.277 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_sessions": { 2024-08-20T01:55:26.277 INFO:teuthology.orchestra.run.smithi079.stdout: "session_count": 1, 2024-08-20T01:55:26.277 INFO:teuthology.orchestra.run.smithi079.stdout: "session_add": 1, 2024-08-20T01:55:26.277 INFO:teuthology.orchestra.run.smithi079.stdout: "session_remove": 0, 2024-08-20T01:55:26.277 INFO:teuthology.orchestra.run.smithi079.stdout: "sessions_open": 1, 2024-08-20T01:55:26.277 INFO:teuthology.orchestra.run.smithi079.stdout: "sessions_stale": 0, 2024-08-20T01:55:26.277 INFO:teuthology.orchestra.run.smithi079.stdout: "total_load": 0, 2024-08-20T01:55:26.278 INFO:teuthology.orchestra.run.smithi079.stdout: "average_load": 0, 2024-08-20T01:55:26.278 INFO:teuthology.orchestra.run.smithi079.stdout: "avg_session_uptime": 2096, 2024-08-20T01:55:26.278 INFO:teuthology.orchestra.run.smithi079.stdout: "mdthresh_evicted": 0 2024-08-20T01:55:26.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.278 INFO:teuthology.orchestra.run.smithi079.stdout: "mempool": { 2024-08-20T01:55:26.278 INFO:teuthology.orchestra.run.smithi079.stdout: "bloom_filter_bytes": 0, 2024-08-20T01:55:26.278 INFO:teuthology.orchestra.run.smithi079.stdout: "bloom_filter_items": 0, 2024-08-20T01:55:26.278 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_alloc_bytes": 0, 2024-08-20T01:55:26.278 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_alloc_items": 0, 2024-08-20T01:55:26.278 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_data_bytes": 0, 2024-08-20T01:55:26.278 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_data_items": 0, 2024-08-20T01:55:26.278 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-20T01:55:26.278 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_onode_items": 0, 2024-08-20T01:55:26.278 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-20T01:55:26.279 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_meta_items": 0, 2024-08-20T01:55:26.279 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_other_bytes": 0, 2024-08-20T01:55:26.279 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_other_items": 0, 2024-08-20T01:55:26.279 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-20T01:55:26.279 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_buffer_items": 0, 2024-08-20T01:55:26.279 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_extent_bytes": 0, 2024-08-20T01:55:26.279 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_extent_items": 0, 2024-08-20T01:55:26.279 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_blob_bytes": 0, 2024-08-20T01:55:26.279 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_blob_items": 0, 2024-08-20T01:55:26.279 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-20T01:55:26.279 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_shared_blob_items": 0, 2024-08-20T01:55:26.279 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-20T01:55:26.279 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_inline_bl_items": 0, 2024-08-20T01:55:26.280 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_bytes": 0, 2024-08-20T01:55:26.280 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_items": 0, 2024-08-20T01:55:26.280 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_txc_bytes": 0, 2024-08-20T01:55:26.280 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_txc_items": 0, 2024-08-20T01:55:26.280 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-20T01:55:26.280 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_deferred_items": 0, 2024-08-20T01:55:26.280 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_bytes": 0, 2024-08-20T01:55:26.280 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_items": 0, 2024-08-20T01:55:26.280 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_bytes": 0, 2024-08-20T01:55:26.280 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_items": 0, 2024-08-20T01:55:26.280 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_reader_bytes": 0, 2024-08-20T01:55:26.280 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_reader_items": 0, 2024-08-20T01:55:26.281 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_writer_bytes": 0, 2024-08-20T01:55:26.281 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_writer_items": 0, 2024-08-20T01:55:26.281 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_anon_bytes": 198287, 2024-08-20T01:55:26.281 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_anon_items": 57, 2024-08-20T01:55:26.281 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_meta_bytes": 0, 2024-08-20T01:55:26.281 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_meta_items": 0, 2024-08-20T01:55:26.281 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_bytes": 0, 2024-08-20T01:55:26.281 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_items": 0, 2024-08-20T01:55:26.281 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mapbl_bytes": 0, 2024-08-20T01:55:26.281 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mapbl_items": 0, 2024-08-20T01:55:26.281 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pglog_bytes": 0, 2024-08-20T01:55:26.281 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pglog_items": 0, 2024-08-20T01:55:26.282 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_bytes": 7496, 2024-08-20T01:55:26.282 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_items": 154, 2024-08-20T01:55:26.282 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_mapping_bytes": 0, 2024-08-20T01:55:26.282 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_mapping_items": 0, 2024-08-20T01:55:26.282 INFO:teuthology.orchestra.run.smithi079.stdout: "pgmap_bytes": 0, 2024-08-20T01:55:26.282 INFO:teuthology.orchestra.run.smithi079.stdout: "pgmap_items": 0, 2024-08-20T01:55:26.282 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_co_bytes": 31776, 2024-08-20T01:55:26.282 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_co_items": 145, 2024-08-20T01:55:26.282 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_1_bytes": 0, 2024-08-20T01:55:26.282 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_1_items": 0, 2024-08-20T01:55:26.282 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_2_bytes": 0, 2024-08-20T01:55:26.282 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_2_items": 0 2024-08-20T01:55:26.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.283 INFO:teuthology.orchestra.run.smithi079.stdout: "objecter": { 2024-08-20T01:55:26.283 INFO:teuthology.orchestra.run.smithi079.stdout: "op_active": 0, 2024-08-20T01:55:26.283 INFO:teuthology.orchestra.run.smithi079.stdout: "op_laggy": 0, 2024-08-20T01:55:26.283 INFO:teuthology.orchestra.run.smithi079.stdout: "op_send": 3422, 2024-08-20T01:55:26.283 INFO:teuthology.orchestra.run.smithi079.stdout: "op_send_bytes": 21, 2024-08-20T01:55:26.283 INFO:teuthology.orchestra.run.smithi079.stdout: "op_resend": 3, 2024-08-20T01:55:26.283 INFO:teuthology.orchestra.run.smithi079.stdout: "op_reply": 3422, 2024-08-20T01:55:26.283 INFO:teuthology.orchestra.run.smithi079.stdout: "op_latency": { 2024-08-20T01:55:26.283 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 3422, 2024-08-20T01:55:26.283 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 129.511157471, 2024-08-20T01:55:26.283 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.037846626 2024-08-20T01:55:26.283 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.283 INFO:teuthology.orchestra.run.smithi079.stdout: "op_inflight": 0, 2024-08-20T01:55:26.284 INFO:teuthology.orchestra.run.smithi079.stdout: "oplen_avg": { 2024-08-20T01:55:26.284 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 3422, 2024-08-20T01:55:26.284 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 3423 2024-08-20T01:55:26.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.284 INFO:teuthology.orchestra.run.smithi079.stdout: "op": 3422, 2024-08-20T01:55:26.284 INFO:teuthology.orchestra.run.smithi079.stdout: "op_r": 3422, 2024-08-20T01:55:26.284 INFO:teuthology.orchestra.run.smithi079.stdout: "op_w": 0, 2024-08-20T01:55:26.284 INFO:teuthology.orchestra.run.smithi079.stdout: "op_rmw": 0, 2024-08-20T01:55:26.284 INFO:teuthology.orchestra.run.smithi079.stdout: "op_pg": 0, 2024-08-20T01:55:26.284 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_stat": 2082, 2024-08-20T01:55:26.284 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_create": 0, 2024-08-20T01:55:26.284 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_read": 1338, 2024-08-20T01:55:26.284 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_write": 0, 2024-08-20T01:55:26.285 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_writefull": 0, 2024-08-20T01:55:26.285 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_writesame": 0, 2024-08-20T01:55:26.285 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_append": 0, 2024-08-20T01:55:26.285 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_zero": 0, 2024-08-20T01:55:26.285 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_truncate": 0, 2024-08-20T01:55:26.285 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_delete": 0, 2024-08-20T01:55:26.285 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_mapext": 0, 2024-08-20T01:55:26.285 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_sparse_read": 0, 2024-08-20T01:55:26.285 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_clonerange": 0, 2024-08-20T01:55:26.285 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_getxattr": 1, 2024-08-20T01:55:26.285 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_setxattr": 0, 2024-08-20T01:55:26.285 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_cmpxattr": 0, 2024-08-20T01:55:26.285 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_rmxattr": 0, 2024-08-20T01:55:26.286 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_resetxattrs": 0, 2024-08-20T01:55:26.286 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_call": 0, 2024-08-20T01:55:26.286 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_watch": 0, 2024-08-20T01:55:26.286 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_notify": 0, 2024-08-20T01:55:26.286 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_src_cmpxattr": 0, 2024-08-20T01:55:26.286 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_pgls": 0, 2024-08-20T01:55:26.286 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_pgls_filter": 0, 2024-08-20T01:55:26.286 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_other": 0, 2024-08-20T01:55:26.286 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_active": 0, 2024-08-20T01:55:26.286 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_send": 0, 2024-08-20T01:55:26.286 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_resend": 0, 2024-08-20T01:55:26.286 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_ping": 0, 2024-08-20T01:55:26.286 INFO:teuthology.orchestra.run.smithi079.stdout: "poolop_active": 0, 2024-08-20T01:55:26.287 INFO:teuthology.orchestra.run.smithi079.stdout: "poolop_send": 0, 2024-08-20T01:55:26.287 INFO:teuthology.orchestra.run.smithi079.stdout: "poolop_resend": 0, 2024-08-20T01:55:26.287 INFO:teuthology.orchestra.run.smithi079.stdout: "poolstat_active": 0, 2024-08-20T01:55:26.287 INFO:teuthology.orchestra.run.smithi079.stdout: "poolstat_send": 0, 2024-08-20T01:55:26.287 INFO:teuthology.orchestra.run.smithi079.stdout: "poolstat_resend": 0, 2024-08-20T01:55:26.287 INFO:teuthology.orchestra.run.smithi079.stdout: "statfs_active": 0, 2024-08-20T01:55:26.287 INFO:teuthology.orchestra.run.smithi079.stdout: "statfs_send": 0, 2024-08-20T01:55:26.287 INFO:teuthology.orchestra.run.smithi079.stdout: "statfs_resend": 0, 2024-08-20T01:55:26.287 INFO:teuthology.orchestra.run.smithi079.stdout: "command_active": 0, 2024-08-20T01:55:26.287 INFO:teuthology.orchestra.run.smithi079.stdout: "command_send": 0, 2024-08-20T01:55:26.287 INFO:teuthology.orchestra.run.smithi079.stdout: "command_resend": 0, 2024-08-20T01:55:26.287 INFO:teuthology.orchestra.run.smithi079.stdout: "map_epoch": 74, 2024-08-20T01:55:26.287 INFO:teuthology.orchestra.run.smithi079.stdout: "map_full": 0, 2024-08-20T01:55:26.287 INFO:teuthology.orchestra.run.smithi079.stdout: "map_inc": 2, 2024-08-20T01:55:26.288 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_sessions": 6, 2024-08-20T01:55:26.288 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_session_open": 8, 2024-08-20T01:55:26.288 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_session_close": 2, 2024-08-20T01:55:26.288 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_laggy": 0, 2024-08-20T01:55:26.288 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_wr": 0, 2024-08-20T01:55:26.288 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_rd": 2, 2024-08-20T01:55:26.288 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_del": 0 2024-08-20T01:55:26.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.288 INFO:teuthology.orchestra.run.smithi079.stdout: "oft": { 2024-08-20T01:55:26.288 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_objs": 0, 2024-08-20T01:55:26.288 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_kv_pairs": 0, 2024-08-20T01:55:26.288 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_updates": 0, 2024-08-20T01:55:26.288 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_removes": 0 2024-08-20T01:55:26.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.289 INFO:teuthology.orchestra.run.smithi079.stdout: "purge_queue": { 2024-08-20T01:55:26.289 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing_ops": 0, 2024-08-20T01:55:26.289 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing_ops_high_water": 0, 2024-08-20T01:55:26.289 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing": 0, 2024-08-20T01:55:26.289 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing_high_water": 0, 2024-08-20T01:55:26.289 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executed_ops": 0, 2024-08-20T01:55:26.289 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executed": 0, 2024-08-20T01:55:26.289 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_item_in_journal": 0 2024-08-20T01:55:26.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.289 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-20T01:55:26.289 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2024-08-20T01:55:26.289 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 104857600, 2024-08-20T01:55:26.289 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2024-08-20T01:55:26.290 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 3809, 2024-08-20T01:55:26.290 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 2728405, 2024-08-20T01:55:26.290 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:26.290 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 3809, 2024-08-20T01:55:26.290 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 0, 2024-08-20T01:55:26.290 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 0, 2024-08-20T01:55:26.290 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 3809, 2024-08-20T01:55:26.290 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 2728405, 2024-08-20T01:55:26.290 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2024-08-20T01:55:26.290 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:26.290 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:26.290 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:26.290 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:26.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.291 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-objecter_bytes": { 2024-08-20T01:55:26.291 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2024-08-20T01:55:26.291 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 104857600, 2024-08-20T01:55:26.291 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2024-08-20T01:55:26.291 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 0, 2024-08-20T01:55:26.291 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 0, 2024-08-20T01:55:26.291 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:26.291 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 0, 2024-08-20T01:55:26.291 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 3422, 2024-08-20T01:55:26.291 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 1268161, 2024-08-20T01:55:26.291 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 3422, 2024-08-20T01:55:26.291 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 1268161, 2024-08-20T01:55:26.291 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2024-08-20T01:55:26.292 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:26.292 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:26.292 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:26.292 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:26.292 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.292 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-objecter_ops": { 2024-08-20T01:55:26.292 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2024-08-20T01:55:26.292 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 1024, 2024-08-20T01:55:26.292 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2024-08-20T01:55:26.292 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 0, 2024-08-20T01:55:26.292 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 0, 2024-08-20T01:55:26.292 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:26.292 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 0, 2024-08-20T01:55:26.293 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 3422, 2024-08-20T01:55:26.293 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 3422, 2024-08-20T01:55:26.293 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 3422, 2024-08-20T01:55:26.293 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 3422, 2024-08-20T01:55:26.293 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2024-08-20T01:55:26.293 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:26.293 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:26.293 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:26.293 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:26.293 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.293 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-write_buf_throttle": { 2024-08-20T01:55:26.293 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2024-08-20T01:55:26.294 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 3758096384, 2024-08-20T01:55:26.294 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2024-08-20T01:55:26.294 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 0, 2024-08-20T01:55:26.294 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 0, 2024-08-20T01:55:26.294 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:26.294 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 0, 2024-08-20T01:55:26.294 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 0, 2024-08-20T01:55:26.294 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 0, 2024-08-20T01:55:26.294 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 0, 2024-08-20T01:55:26.294 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 0, 2024-08-20T01:55:26.294 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2024-08-20T01:55:26.294 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:26.294 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:26.295 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:26.295 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:26.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.295 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-write_buf_throttle-0x560ef1f9a960": { 2024-08-20T01:55:26.295 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2024-08-20T01:55:26.295 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 3758096384, 2024-08-20T01:55:26.295 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2024-08-20T01:55:26.295 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 0, 2024-08-20T01:55:26.295 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 0, 2024-08-20T01:55:26.295 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:26.295 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 0, 2024-08-20T01:55:26.295 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 0, 2024-08-20T01:55:26.296 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 0, 2024-08-20T01:55:26.296 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 0, 2024-08-20T01:55:26.296 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 0, 2024-08-20T01:55:26.296 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2024-08-20T01:55:26.296 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:26.296 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:26.296 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:26.296 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:26.296 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:26.296 INFO:teuthology.orchestra.run.smithi079.stdout: "trackedop": { 2024-08-20T01:55:26.296 INFO:teuthology.orchestra.run.smithi079.stdout: "slow_ops_count": 0 2024-08-20T01:55:26.296 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:26.296 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:55:26.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:26 smithi081 ceph-mon[22209]: pgmap v890: 97 pgs: 97 active+clean; 2.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 341 B/s wr, 19 op/s 2024-08-20T01:55:26.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:26 smithi175 ceph-mon[22392]: pgmap v890: 97 pgs: 97 active+clean; 2.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 341 B/s wr, 19 op/s 2024-08-20T01:55:26.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:26 smithi079 ceph-mon[18656]: pgmap v890: 97 pgs: 97 active+clean; 2.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 341 B/s wr, 19 op/s 2024-08-20T01:55:27.049 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-08-20T01:55:27.049 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-08-20T01:55:27.049 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2024-08-20T01:55:27.049 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2024-08-20T01:55:27.049 INFO:tasks.check_counter:Daemon mds.g mds.dir_split=0 2024-08-20T01:55:27.049 DEBUG:tasks.check_counter:Getting stats from j 2024-08-20T01:55:27.050 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph daemon mds.j perf dump 2024-08-20T01:55:27.302 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:55:27.820 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-08-20T01:55:27.821 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-0": { 2024-08-20T01:55:27.821 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 4, 2024-08-20T01:55:27.821 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 4, 2024-08-20T01:55:27.821 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 2944, 2024-08-20T01:55:27.821 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 448, 2024-08-20T01:55:27.821 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 4, 2024-08-20T01:55:27.821 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 0, 2024-08-20T01:55:27.821 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.003034402, 2024-08-20T01:55:27.821 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.000038205, 2024-08-20T01:55:27.821 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.002220207, 2024-08-20T01:55:27.821 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-20T01:55:27.822 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:55:27.822 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 3, 2024-08-20T01:55:27.822 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.003997376, 2024-08-20T01:55:27.822 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.001332458 2024-08-20T01:55:27.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:27.822 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:55:27.822 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:27.822 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:27.822 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:27.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:27.822 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-08-20T01:55:27.822 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 448 2024-08-20T01:55:27.823 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:27.823 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-1": { 2024-08-20T01:55:27.823 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 340, 2024-08-20T01:55:27.823 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 337, 2024-08-20T01:55:27.823 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 552832, 2024-08-20T01:55:27.823 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 208256, 2024-08-20T01:55:27.823 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 2, 2024-08-20T01:55:27.823 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 1, 2024-08-20T01:55:27.823 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.046098792, 2024-08-20T01:55:27.823 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.023905016, 2024-08-20T01:55:27.823 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.026769842, 2024-08-20T01:55:27.824 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-20T01:55:27.824 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:55:27.824 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 336, 2024-08-20T01:55:27.824 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.015741219, 2024-08-20T01:55:27.824 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000046848 2024-08-20T01:55:27.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:27.824 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:55:27.824 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:27.824 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:27.824 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:27.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:27.824 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 552832, 2024-08-20T01:55:27.825 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 208256 2024-08-20T01:55:27.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:27.825 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-2": { 2024-08-20T01:55:27.825 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 2, 2024-08-20T01:55:27.825 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 258, 2024-08-20T01:55:27.825 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 320, 2024-08-20T01:55:27.825 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 205408, 2024-08-20T01:55:27.825 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 4, 2024-08-20T01:55:27.825 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 2, 2024-08-20T01:55:27.825 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.021018148, 2024-08-20T01:55:27.825 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.017366551, 2024-08-20T01:55:27.825 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.001789197, 2024-08-20T01:55:27.826 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-20T01:55:27.826 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:55:27.826 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 256, 2024-08-20T01:55:27.826 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.011633686, 2024-08-20T01:55:27.826 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000045444 2024-08-20T01:55:27.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:27.826 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:55:27.826 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:27.826 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:27.826 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:27.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:27.827 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-20T01:55:27.827 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 205408 2024-08-20T01:55:27.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:27.827 INFO:teuthology.orchestra.run.smithi079.stdout: "cct": { 2024-08-20T01:55:27.827 INFO:teuthology.orchestra.run.smithi079.stdout: "total_workers": 0, 2024-08-20T01:55:27.827 INFO:teuthology.orchestra.run.smithi079.stdout: "unhealthy_workers": 0 2024-08-20T01:55:27.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:27.827 INFO:teuthology.orchestra.run.smithi079.stdout: "mempool": { 2024-08-20T01:55:27.827 INFO:teuthology.orchestra.run.smithi079.stdout: "bloom_filter_bytes": 0, 2024-08-20T01:55:27.827 INFO:teuthology.orchestra.run.smithi079.stdout: "bloom_filter_items": 0, 2024-08-20T01:55:27.827 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_alloc_bytes": 0, 2024-08-20T01:55:27.827 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_alloc_items": 0, 2024-08-20T01:55:27.827 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_data_bytes": 0, 2024-08-20T01:55:27.828 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_data_items": 0, 2024-08-20T01:55:27.828 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-20T01:55:27.828 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_onode_items": 0, 2024-08-20T01:55:27.828 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-20T01:55:27.828 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_meta_items": 0, 2024-08-20T01:55:27.828 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_other_bytes": 0, 2024-08-20T01:55:27.828 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_other_items": 0, 2024-08-20T01:55:27.828 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-20T01:55:27.828 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_buffer_items": 0, 2024-08-20T01:55:27.828 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_extent_bytes": 0, 2024-08-20T01:55:27.828 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_extent_items": 0, 2024-08-20T01:55:27.828 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_blob_bytes": 0, 2024-08-20T01:55:27.828 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_blob_items": 0, 2024-08-20T01:55:27.828 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-20T01:55:27.829 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_shared_blob_items": 0, 2024-08-20T01:55:27.829 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-20T01:55:27.829 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_inline_bl_items": 0, 2024-08-20T01:55:27.829 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_bytes": 0, 2024-08-20T01:55:27.829 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_items": 0, 2024-08-20T01:55:27.829 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_txc_bytes": 0, 2024-08-20T01:55:27.829 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_txc_items": 0, 2024-08-20T01:55:27.829 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-20T01:55:27.829 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_deferred_items": 0, 2024-08-20T01:55:27.829 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_bytes": 0, 2024-08-20T01:55:27.829 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_items": 0, 2024-08-20T01:55:27.829 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_bytes": 0, 2024-08-20T01:55:27.829 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_items": 0, 2024-08-20T01:55:27.829 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_reader_bytes": 0, 2024-08-20T01:55:27.830 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_reader_items": 0, 2024-08-20T01:55:27.830 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_writer_bytes": 0, 2024-08-20T01:55:27.830 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_writer_items": 0, 2024-08-20T01:55:27.830 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_anon_bytes": 148721, 2024-08-20T01:55:27.830 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_anon_items": 30, 2024-08-20T01:55:27.830 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_meta_bytes": 0, 2024-08-20T01:55:27.830 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_meta_items": 0, 2024-08-20T01:55:27.830 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_bytes": 0, 2024-08-20T01:55:27.830 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_items": 0, 2024-08-20T01:55:27.830 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mapbl_bytes": 0, 2024-08-20T01:55:27.830 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mapbl_items": 0, 2024-08-20T01:55:27.830 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pglog_bytes": 0, 2024-08-20T01:55:27.831 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pglog_items": 0, 2024-08-20T01:55:27.831 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_bytes": 0, 2024-08-20T01:55:27.831 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_items": 0, 2024-08-20T01:55:27.831 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_mapping_bytes": 0, 2024-08-20T01:55:27.831 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_mapping_items": 0, 2024-08-20T01:55:27.831 INFO:teuthology.orchestra.run.smithi079.stdout: "pgmap_bytes": 0, 2024-08-20T01:55:27.831 INFO:teuthology.orchestra.run.smithi079.stdout: "pgmap_items": 0, 2024-08-20T01:55:27.831 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_co_bytes": 928, 2024-08-20T01:55:27.831 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_co_items": 2, 2024-08-20T01:55:27.831 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_1_bytes": 0, 2024-08-20T01:55:27.831 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_1_items": 0, 2024-08-20T01:55:27.831 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_2_bytes": 0, 2024-08-20T01:55:27.831 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_2_items": 0 2024-08-20T01:55:27.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-08-20T01:55:27.832 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-20T01:55:27.832 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2024-08-20T01:55:27.832 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 104857600, 2024-08-20T01:55:27.832 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2024-08-20T01:55:27.832 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 342, 2024-08-20T01:55:27.832 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 504767, 2024-08-20T01:55:27.832 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:27.832 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 342, 2024-08-20T01:55:27.832 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 0, 2024-08-20T01:55:27.832 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 0, 2024-08-20T01:55:27.832 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 342, 2024-08-20T01:55:27.832 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 504767, 2024-08-20T01:55:27.832 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2024-08-20T01:55:27.833 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-08-20T01:55:27.833 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-08-20T01:55:27.833 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-08-20T01:55:27.833 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:27.833 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-08-20T01:55:27.833 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-08-20T01:55:28.575 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-08-20T01:55:28.575 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-08-20T01:55:28.575 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-08-20T01:55:28.575 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-08-20T01:55:28.575 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-08-20T01:55:28.575 DEBUG:tasks.check_counter:Getting stats from b 2024-08-20T01:55:28.575 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph daemon mds.b perf dump 2024-08-20T01:55:28.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:28 smithi081 ceph-mon[22209]: pgmap v891: 97 pgs: 97 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 19 op/s 2024-08-20T01:55:28.829 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.b/config 2024-08-20T01:55:28.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:28 smithi175 ceph-mon[22392]: pgmap v891: 97 pgs: 97 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 19 op/s 2024-08-20T01:55:28.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:28 smithi079 ceph-mon[18656]: pgmap v891: 97 pgs: 97 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 19 op/s 2024-08-20T01:55:29.344 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-08-20T01:55:29.344 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-0": { 2024-08-20T01:55:29.345 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 11611, 2024-08-20T01:55:29.345 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 13805, 2024-08-20T01:55:29.345 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 4874865, 2024-08-20T01:55:29.345 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 12518225, 2024-08-20T01:55:29.345 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 47, 2024-08-20T01:55:29.345 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 5, 2024-08-20T01:55:29.345 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.977501054, 2024-08-20T01:55:29.345 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.446609855, 2024-08-20T01:55:29.345 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.469558272, 2024-08-20T01:55:29.345 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.103400816, 2024-08-20T01:55:29.345 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:55:29.345 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 13805, 2024-08-20T01:55:29.346 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 1.456324845, 2024-08-20T01:55:29.346 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000105492 2024-08-20T01:55:29.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.346 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:55:29.346 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 20293, 2024-08-20T01:55:29.346 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.003220653, 2024-08-20T01:55:29.346 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000158 2024-08-20T01:55:29.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.346 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 960928, 2024-08-20T01:55:29.346 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 272864 2024-08-20T01:55:29.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.347 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-1": { 2024-08-20T01:55:29.347 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 4535, 2024-08-20T01:55:29.347 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 5489, 2024-08-20T01:55:29.347 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 1764241, 2024-08-20T01:55:29.347 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 4349274, 2024-08-20T01:55:29.347 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 12, 2024-08-20T01:55:29.347 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 6, 2024-08-20T01:55:29.347 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.381955851, 2024-08-20T01:55:29.347 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.182212513, 2024-08-20T01:55:29.347 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.146200316, 2024-08-20T01:55:29.347 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.055379637, 2024-08-20T01:55:29.347 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:55:29.347 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 5490, 2024-08-20T01:55:29.348 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 1.128802394, 2024-08-20T01:55:29.348 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000205610 2024-08-20T01:55:29.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.348 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:55:29.348 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 4962, 2024-08-20T01:55:29.348 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000897115, 2024-08-20T01:55:29.348 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000180 2024-08-20T01:55:29.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.348 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-20T01:55:29.348 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 630768 2024-08-20T01:55:29.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.348 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-2": { 2024-08-20T01:55:29.349 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 7314, 2024-08-20T01:55:29.349 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 8429, 2024-08-20T01:55:29.349 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 2778477, 2024-08-20T01:55:29.349 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 11363545, 2024-08-20T01:55:29.349 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 303, 2024-08-20T01:55:29.349 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 10, 2024-08-20T01:55:29.349 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.674298255, 2024-08-20T01:55:29.349 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.307457823, 2024-08-20T01:55:29.349 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.344020430, 2024-08-20T01:55:29.349 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.053750753, 2024-08-20T01:55:29.349 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:55:29.349 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 8423, 2024-08-20T01:55:29.349 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.981784606, 2024-08-20T01:55:29.350 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000116559 2024-08-20T01:55:29.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.350 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:55:29.350 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 10648, 2024-08-20T01:55:29.350 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.001829355, 2024-08-20T01:55:29.350 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000171 2024-08-20T01:55:29.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.350 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-20T01:55:29.350 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 0 2024-08-20T01:55:29.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.350 INFO:teuthology.orchestra.run.smithi081.stdout: "cct": { 2024-08-20T01:55:29.350 INFO:teuthology.orchestra.run.smithi081.stdout: "total_workers": 1, 2024-08-20T01:55:29.351 INFO:teuthology.orchestra.run.smithi081.stdout: "unhealthy_workers": 0 2024-08-20T01:55:29.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.351 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-MDSRank": { 2024-08-20T01:55:29.351 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2024-08-20T01:55:29.351 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2024-08-20T01:55:29.351 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 4448, 2024-08-20T01:55:29.351 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 2.281392089, 2024-08-20T01:55:29.351 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000512902 2024-08-20T01:55:29.351 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-08-20T01:55:29.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.351 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-PurgeQueue": { 2024-08-20T01:55:29.351 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2024-08-20T01:55:29.351 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2024-08-20T01:55:29.352 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 1630, 2024-08-20T01:55:29.352 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.071650254, 2024-08-20T01:55:29.352 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000043957 2024-08-20T01:55:29.352 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-08-20T01:55:29.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.352 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-08-20T01:55:29.352 INFO:teuthology.orchestra.run.smithi081.stdout: "request": 3250, 2024-08-20T01:55:29.352 INFO:teuthology.orchestra.run.smithi081.stdout: "reply": 3039, 2024-08-20T01:55:29.352 INFO:teuthology.orchestra.run.smithi081.stdout: "reply_latency": { 2024-08-20T01:55:29.352 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 3039, 2024-08-20T01:55:29.352 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 83.137861086, 2024-08-20T01:55:29.352 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.027356979 2024-08-20T01:55:29.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.353 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_reply": 0, 2024-08-20T01:55:29.353 INFO:teuthology.orchestra.run.smithi081.stdout: "forward": 211, 2024-08-20T01:55:29.353 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_complete": 7, 2024-08-20T01:55:29.353 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_keys": 1, 2024-08-20T01:55:29.353 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_commit": 546, 2024-08-20T01:55:29.353 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_split": 0, 2024-08-20T01:55:29.353 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_merge": 0, 2024-08-20T01:55:29.353 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes": 62, 2024-08-20T01:55:29.353 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_top": 4, 2024-08-20T01:55:29.353 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_bottom": 47, 2024-08-20T01:55:29.353 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pin_tail": 11, 2024-08-20T01:55:29.353 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pinned": 56, 2024-08-20T01:55:29.353 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_expired": 462, 2024-08-20T01:55:29.354 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_with_caps": 2, 2024-08-20T01:55:29.354 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": 2, 2024-08-20T01:55:29.354 INFO:teuthology.orchestra.run.smithi081.stdout: "subtrees": 5, 2024-08-20T01:55:29.354 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse": 4877, 2024-08-20T01:55:29.354 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_hit": 4463, 2024-08-20T01:55:29.354 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_forward": 201, 2024-08-20T01:55:29.354 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_discover": 14, 2024-08-20T01:55:29.354 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_dir_fetch": 0, 2024-08-20T01:55:29.354 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_remote_ino": 0, 2024-08-20T01:55:29.354 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_lock": 49, 2024-08-20T01:55:29.354 INFO:teuthology.orchestra.run.smithi081.stdout: "load_cent": 9, 2024-08-20T01:55:29.354 INFO:teuthology.orchestra.run.smithi081.stdout: "q": 0, 2024-08-20T01:55:29.354 INFO:teuthology.orchestra.run.smithi081.stdout: "exported": 9, 2024-08-20T01:55:29.354 INFO:teuthology.orchestra.run.smithi081.stdout: "exported_inodes": 371, 2024-08-20T01:55:29.355 INFO:teuthology.orchestra.run.smithi081.stdout: "imported": 7, 2024-08-20T01:55:29.355 INFO:teuthology.orchestra.run.smithi081.stdout: "imported_inodes": 127, 2024-08-20T01:55:29.355 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_dir_fetch": 0, 2024-08-20T01:55:29.355 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_backtrace_fetch": 2101, 2024-08-20T01:55:29.355 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_peer_discover": 0, 2024-08-20T01:55:29.355 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rfiles": 4, 2024-08-20T01:55:29.355 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rbytes": 234, 2024-08-20T01:55:29.355 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rsnaps": 0, 2024-08-20T01:55:29.355 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_fetch": 2101, 2024-08-20T01:55:29.355 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_set_tag": 0, 2024-08-20T01:55:29.355 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_repaired": 0, 2024-08-20T01:55:29.355 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_inotable_repaired": 0, 2024-08-20T01:55:29.355 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_inodes": 442, 2024-08-20T01:55:29.356 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_base_inodes": 24, 2024-08-20T01:55:29.356 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dirfrag_rstats": 418, 2024-08-20T01:55:29.356 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_file_inodes": 1659, 2024-08-20T01:55:29.356 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_inode_file_caps": 4, 2024-08-20T01:55:29.356 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_revoke": 1071, 2024-08-20T01:55:29.356 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_grant": 1557, 2024-08-20T01:55:29.356 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_trunc": 6, 2024-08-20T01:55:29.356 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-20T01:55:29.356 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-20T01:55:29.356 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps": 2961, 2024-08-20T01:55:29.356 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps_dirty": 1034, 2024-08-20T01:55:29.356 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_cap_release": 25, 2024-08-20T01:55:29.356 INFO:teuthology.orchestra.run.smithi081.stdout: "process_request_cap_release": 2177 2024-08-20T01:55:29.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.356 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cache": { 2024-08-20T01:55:29.357 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update": 327, 2024-08-20T01:55:29.357 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update_receipt": 101, 2024-08-20T01:55:29.357 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_try_discover": 56, 2024-08-20T01:55:29.357 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_send_discover": 109, 2024-08-20T01:55:29.357 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_handle_discover": 684, 2024-08-20T01:55:29.357 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays": 0, 2024-08-20T01:55:29.357 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_delayed": 0, 2024-08-20T01:55:29.357 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_enqueuing": 0, 2024-08-20T01:55:29.357 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_created": 643, 2024-08-20T01:55:29.357 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_enqueued": 582, 2024-08-20T01:55:29.357 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_reintegrated": 61, 2024-08-20T01:55:29.357 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_migrated": 0, 2024-08-20T01:55:29.357 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_processing": 0, 2024-08-20T01:55:29.358 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_enqueued": 0, 2024-08-20T01:55:29.358 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_prioritized": 0, 2024-08-20T01:55:29.358 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_started": 0, 2024-08-20T01:55:29.358 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_completed": 0, 2024-08-20T01:55:29.358 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_quiesce_path": 0, 2024-08-20T01:55:29.358 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_quiesce_inode": 0, 2024-08-20T01:55:29.358 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_enqueue_scrub": 24, 2024-08-20T01:55:29.358 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_exportdir": 9, 2024-08-20T01:55:29.358 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_flush": 0, 2024-08-20T01:55:29.358 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragmentdir": 0, 2024-08-20T01:55:29.358 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragstats": 0, 2024-08-20T01:55:29.358 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_inodestats": 0 2024-08-20T01:55:29.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.358 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_log": { 2024-08-20T01:55:29.359 INFO:teuthology.orchestra.run.smithi081.stdout: "evlrg": 0, 2024-08-20T01:55:29.359 INFO:teuthology.orchestra.run.smithi081.stdout: "evadd": 4369, 2024-08-20T01:55:29.359 INFO:teuthology.orchestra.run.smithi081.stdout: "evex": 4314, 2024-08-20T01:55:29.359 INFO:teuthology.orchestra.run.smithi081.stdout: "evtrm": 4314, 2024-08-20T01:55:29.359 INFO:teuthology.orchestra.run.smithi081.stdout: "ev": 55, 2024-08-20T01:55:29.359 INFO:teuthology.orchestra.run.smithi081.stdout: "evexg": 0, 2024-08-20T01:55:29.359 INFO:teuthology.orchestra.run.smithi081.stdout: "evexd": 46, 2024-08-20T01:55:29.359 INFO:teuthology.orchestra.run.smithi081.stdout: "segadd": 77, 2024-08-20T01:55:29.359 INFO:teuthology.orchestra.run.smithi081.stdout: "segex": 76, 2024-08-20T01:55:29.359 INFO:teuthology.orchestra.run.smithi081.stdout: "segtrm": 76, 2024-08-20T01:55:29.359 INFO:teuthology.orchestra.run.smithi081.stdout: "seg": 1, 2024-08-20T01:55:29.359 INFO:teuthology.orchestra.run.smithi081.stdout: "segmjr": 1, 2024-08-20T01:55:29.359 INFO:teuthology.orchestra.run.smithi081.stdout: "segexg": 0, 2024-08-20T01:55:29.359 INFO:teuthology.orchestra.run.smithi081.stdout: "segexd": 1, 2024-08-20T01:55:29.360 INFO:teuthology.orchestra.run.smithi081.stdout: "expos": 13967937, 2024-08-20T01:55:29.360 INFO:teuthology.orchestra.run.smithi081.stdout: "wrpos": 14034333, 2024-08-20T01:55:29.360 INFO:teuthology.orchestra.run.smithi081.stdout: "rdpos": 0, 2024-08-20T01:55:29.360 INFO:teuthology.orchestra.run.smithi081.stdout: "jlat": { 2024-08-20T01:55:29.360 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 931, 2024-08-20T01:55:29.360 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 244.737768389, 2024-08-20T01:55:29.360 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.262876228 2024-08-20T01:55:29.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.360 INFO:teuthology.orchestra.run.smithi081.stdout: "replayed": 0 2024-08-20T01:55:29.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.360 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_mem": { 2024-08-20T01:55:29.360 INFO:teuthology.orchestra.run.smithi081.stdout: "ino": 27, 2024-08-20T01:55:29.360 INFO:teuthology.orchestra.run.smithi081.stdout: "ino+": 938, 2024-08-20T01:55:29.361 INFO:teuthology.orchestra.run.smithi081.stdout: "ino-": 911, 2024-08-20T01:55:29.361 INFO:teuthology.orchestra.run.smithi081.stdout: "dir": 22, 2024-08-20T01:55:29.361 INFO:teuthology.orchestra.run.smithi081.stdout: "dir+": 184, 2024-08-20T01:55:29.361 INFO:teuthology.orchestra.run.smithi081.stdout: "dir-": 162, 2024-08-20T01:55:29.361 INFO:teuthology.orchestra.run.smithi081.stdout: "dn": 62, 2024-08-20T01:55:29.361 INFO:teuthology.orchestra.run.smithi081.stdout: "dn+": 1281, 2024-08-20T01:55:29.361 INFO:teuthology.orchestra.run.smithi081.stdout: "dn-": 1219, 2024-08-20T01:55:29.361 INFO:teuthology.orchestra.run.smithi081.stdout: "cap": 2, 2024-08-20T01:55:29.361 INFO:teuthology.orchestra.run.smithi081.stdout: "cap+": 890, 2024-08-20T01:55:29.361 INFO:teuthology.orchestra.run.smithi081.stdout: "cap-": 888, 2024-08-20T01:55:29.361 INFO:teuthology.orchestra.run.smithi081.stdout: "rss": 67464, 2024-08-20T01:55:29.361 INFO:teuthology.orchestra.run.smithi081.stdout: "heap": 280870912 2024-08-20T01:55:29.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.361 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_server": { 2024-08-20T01:55:29.362 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_client_request": 4019, 2024-08-20T01:55:29.362 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_server_request": 26, 2024-08-20T01:55:29.362 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_request": 3250, 2024-08-20T01:55:29.362 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_session": 27, 2024-08-20T01:55:29.362 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_peer_request": 93, 2024-08-20T01:55:29.362 INFO:teuthology.orchestra.run.smithi081.stdout: "req_create_latency": { 2024-08-20T01:55:29.362 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 642, 2024-08-20T01:55:29.362 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.596255311, 2024-08-20T01:55:29.362 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000928746 2024-08-20T01:55:29.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.362 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getattr_latency": { 2024-08-20T01:55:29.362 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 844, 2024-08-20T01:55:29.362 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 2.617166536, 2024-08-20T01:55:29.363 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.003100908 2024-08-20T01:55:29.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.363 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getfilelock_latency": { 2024-08-20T01:55:29.363 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:29.363 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:29.363 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:29.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.363 INFO:teuthology.orchestra.run.smithi081.stdout: "req_link_latency": { 2024-08-20T01:55:29.363 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 61, 2024-08-20T01:55:29.363 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.115608623, 2024-08-20T01:55:29.363 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.001895223 2024-08-20T01:55:29.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.363 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookup_latency": { 2024-08-20T01:55:29.364 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 244, 2024-08-20T01:55:29.364 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 51.728902898, 2024-08-20T01:55:29.364 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.212003700 2024-08-20T01:55:29.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.364 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookuphash_latency": { 2024-08-20T01:55:29.364 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:29.364 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:29.364 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:29.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.364 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupino_latency": { 2024-08-20T01:55:29.364 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:29.364 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:29.364 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:29.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.365 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupname_latency": { 2024-08-20T01:55:29.365 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:29.365 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:29.365 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:29.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.365 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupparent_latency": { 2024-08-20T01:55:29.365 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:29.365 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:29.365 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:29.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.365 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupsnap_latency": { 2024-08-20T01:55:29.365 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:29.366 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:29.366 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:29.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.366 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lssnap_latency": { 2024-08-20T01:55:29.366 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:29.366 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:29.367 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:29.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.367 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mkdir_latency": { 2024-08-20T01:55:29.367 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 105, 2024-08-20T01:55:29.367 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.099942883, 2024-08-20T01:55:29.367 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000951836 2024-08-20T01:55:29.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.367 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mknod_latency": { 2024-08-20T01:55:29.367 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:29.367 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:29.367 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:29.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.368 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mksnap_latency": { 2024-08-20T01:55:29.368 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:29.368 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:29.368 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:29.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.368 INFO:teuthology.orchestra.run.smithi081.stdout: "req_open_latency": { 2024-08-20T01:55:29.368 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 228, 2024-08-20T01:55:29.368 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.153305777, 2024-08-20T01:55:29.368 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000672393 2024-08-20T01:55:29.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.368 INFO:teuthology.orchestra.run.smithi081.stdout: "req_readdir_latency": { 2024-08-20T01:55:29.368 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 164, 2024-08-20T01:55:29.368 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 3.841448768, 2024-08-20T01:55:29.368 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.023423468 2024-08-20T01:55:29.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.369 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rename_latency": { 2024-08-20T01:55:29.369 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 113, 2024-08-20T01:55:29.369 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 5.495084536, 2024-08-20T01:55:29.369 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.048629066 2024-08-20T01:55:29.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.369 INFO:teuthology.orchestra.run.smithi081.stdout: "req_renamesnap_latency": { 2024-08-20T01:55:29.369 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:29.369 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:29.369 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:29.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.369 INFO:teuthology.orchestra.run.smithi081.stdout: "req_snapdiff_latency": { 2024-08-20T01:55:29.369 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:29.369 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:29.370 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:29.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.370 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmdir_latency": { 2024-08-20T01:55:29.370 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 24, 2024-08-20T01:55:29.370 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 17.604751982, 2024-08-20T01:55:29.370 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.733531332 2024-08-20T01:55:29.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.370 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmsnap_latency": { 2024-08-20T01:55:29.370 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:29.370 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:29.370 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:29.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.370 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmxattr_latency": { 2024-08-20T01:55:29.371 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:29.371 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:29.371 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:29.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.371 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setattr_latency": { 2024-08-20T01:55:29.371 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 4, 2024-08-20T01:55:29.371 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.009619513, 2024-08-20T01:55:29.371 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.002404878 2024-08-20T01:55:29.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.371 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setdirlayout_latency": { 2024-08-20T01:55:29.371 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:29.371 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:29.371 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:29.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.372 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setfilelock_latency": { 2024-08-20T01:55:29.372 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 4, 2024-08-20T01:55:29.372 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.001246423, 2024-08-20T01:55:29.372 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000311605 2024-08-20T01:55:29.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.372 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setlayout_latency": { 2024-08-20T01:55:29.372 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:29.372 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:29.372 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:29.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.372 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setxattr_latency": { 2024-08-20T01:55:29.372 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 7, 2024-08-20T01:55:29.372 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.019058743, 2024-08-20T01:55:29.372 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.002722677 2024-08-20T01:55:29.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.373 INFO:teuthology.orchestra.run.smithi081.stdout: "req_symlink_latency": { 2024-08-20T01:55:29.373 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 13, 2024-08-20T01:55:29.373 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.009318848, 2024-08-20T01:55:29.373 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000716834 2024-08-20T01:55:29.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.373 INFO:teuthology.orchestra.run.smithi081.stdout: "req_unlink_latency": { 2024-08-20T01:55:29.373 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 586, 2024-08-20T01:55:29.373 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.846150245, 2024-08-20T01:55:29.373 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.001443942 2024-08-20T01:55:29.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.373 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_revoke_eviction": 0, 2024-08-20T01:55:29.373 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_acquisition_throttle": 0, 2024-08-20T01:55:29.373 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getvxattr_latency": { 2024-08-20T01:55:29.374 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:29.374 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:29.374 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:29.374 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-08-20T01:55:29.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.374 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_sessions": { 2024-08-20T01:55:29.374 INFO:teuthology.orchestra.run.smithi081.stdout: "session_count": 1, 2024-08-20T01:55:29.374 INFO:teuthology.orchestra.run.smithi081.stdout: "session_add": 2, 2024-08-20T01:55:29.374 INFO:teuthology.orchestra.run.smithi081.stdout: "session_remove": 1, 2024-08-20T01:55:29.374 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_open": 1, 2024-08-20T01:55:29.374 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_stale": 0, 2024-08-20T01:55:29.374 INFO:teuthology.orchestra.run.smithi081.stdout: "total_load": 68, 2024-08-20T01:55:29.374 INFO:teuthology.orchestra.run.smithi081.stdout: "average_load": 68, 2024-08-20T01:55:29.374 INFO:teuthology.orchestra.run.smithi081.stdout: "avg_session_uptime": 1118, 2024-08-20T01:55:29.375 INFO:teuthology.orchestra.run.smithi081.stdout: "mdthresh_evicted": 0 2024-08-20T01:55:29.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.375 INFO:teuthology.orchestra.run.smithi081.stdout: "mempool": { 2024-08-20T01:55:29.375 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_bytes": 0, 2024-08-20T01:55:29.375 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_items": 0, 2024-08-20T01:55:29.375 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_bytes": 0, 2024-08-20T01:55:29.375 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_items": 0, 2024-08-20T01:55:29.375 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_bytes": 0, 2024-08-20T01:55:29.375 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_items": 0, 2024-08-20T01:55:29.375 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-20T01:55:29.375 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_items": 0, 2024-08-20T01:55:29.375 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-20T01:55:29.376 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_items": 0, 2024-08-20T01:55:29.376 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_bytes": 0, 2024-08-20T01:55:29.376 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_items": 0, 2024-08-20T01:55:29.376 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-20T01:55:29.376 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_items": 0, 2024-08-20T01:55:29.376 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_bytes": 0, 2024-08-20T01:55:29.376 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_items": 0, 2024-08-20T01:55:29.376 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_bytes": 0, 2024-08-20T01:55:29.376 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_items": 0, 2024-08-20T01:55:29.376 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-20T01:55:29.376 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_items": 0, 2024-08-20T01:55:29.376 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-20T01:55:29.376 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_items": 0, 2024-08-20T01:55:29.376 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_bytes": 0, 2024-08-20T01:55:29.377 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_items": 0, 2024-08-20T01:55:29.377 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_bytes": 0, 2024-08-20T01:55:29.377 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_items": 0, 2024-08-20T01:55:29.377 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-20T01:55:29.377 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_items": 0, 2024-08-20T01:55:29.377 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_bytes": 0, 2024-08-20T01:55:29.377 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_items": 0, 2024-08-20T01:55:29.377 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_bytes": 0, 2024-08-20T01:55:29.377 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_items": 0, 2024-08-20T01:55:29.377 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_bytes": 0, 2024-08-20T01:55:29.377 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_items": 0, 2024-08-20T01:55:29.377 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_bytes": 0, 2024-08-20T01:55:29.377 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_items": 0, 2024-08-20T01:55:29.377 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_bytes": 316256, 2024-08-20T01:55:29.378 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_items": 127, 2024-08-20T01:55:29.378 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_bytes": 0, 2024-08-20T01:55:29.378 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_items": 0, 2024-08-20T01:55:29.378 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bytes": 0, 2024-08-20T01:55:29.378 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_items": 0, 2024-08-20T01:55:29.378 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_bytes": 0, 2024-08-20T01:55:29.378 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_items": 0, 2024-08-20T01:55:29.378 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_bytes": 0, 2024-08-20T01:55:29.378 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_items": 0, 2024-08-20T01:55:29.378 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_bytes": 7496, 2024-08-20T01:55:29.378 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_items": 154, 2024-08-20T01:55:29.378 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_bytes": 0, 2024-08-20T01:55:29.378 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_items": 0, 2024-08-20T01:55:29.379 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_bytes": 0, 2024-08-20T01:55:29.379 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_items": 0, 2024-08-20T01:55:29.379 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_bytes": 138709, 2024-08-20T01:55:29.379 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_items": 1032, 2024-08-20T01:55:29.379 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_bytes": 0, 2024-08-20T01:55:29.379 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_items": 0, 2024-08-20T01:55:29.379 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_bytes": 0, 2024-08-20T01:55:29.379 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_items": 0 2024-08-20T01:55:29.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.379 INFO:teuthology.orchestra.run.smithi081.stdout: "objecter": { 2024-08-20T01:55:29.379 INFO:teuthology.orchestra.run.smithi081.stdout: "op_active": 0, 2024-08-20T01:55:29.379 INFO:teuthology.orchestra.run.smithi081.stdout: "op_laggy": 0, 2024-08-20T01:55:29.379 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send": 6222, 2024-08-20T01:55:29.379 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send_bytes": 10890255, 2024-08-20T01:55:29.379 INFO:teuthology.orchestra.run.smithi081.stdout: "op_resend": 37, 2024-08-20T01:55:29.380 INFO:teuthology.orchestra.run.smithi081.stdout: "op_reply": 6222, 2024-08-20T01:55:29.380 INFO:teuthology.orchestra.run.smithi081.stdout: "op_latency": { 2024-08-20T01:55:29.380 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 6222, 2024-08-20T01:55:29.380 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 2759.157540137, 2024-08-20T01:55:29.380 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.443451870 2024-08-20T01:55:29.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.380 INFO:teuthology.orchestra.run.smithi081.stdout: "op_inflight": 0, 2024-08-20T01:55:29.380 INFO:teuthology.orchestra.run.smithi081.stdout: "oplen_avg": { 2024-08-20T01:55:29.380 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 6222, 2024-08-20T01:55:29.380 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 8317 2024-08-20T01:55:29.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.380 INFO:teuthology.orchestra.run.smithi081.stdout: "op": 6222, 2024-08-20T01:55:29.380 INFO:teuthology.orchestra.run.smithi081.stdout: "op_r": 2199, 2024-08-20T01:55:29.380 INFO:teuthology.orchestra.run.smithi081.stdout: "op_w": 4023, 2024-08-20T01:55:29.381 INFO:teuthology.orchestra.run.smithi081.stdout: "op_rmw": 0, 2024-08-20T01:55:29.381 INFO:teuthology.orchestra.run.smithi081.stdout: "op_pg": 0, 2024-08-20T01:55:29.381 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_stat": 445, 2024-08-20T01:55:29.381 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_create": 374, 2024-08-20T01:55:29.381 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_read": 66, 2024-08-20T01:55:29.381 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_write": 975, 2024-08-20T01:55:29.381 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writefull": 267, 2024-08-20T01:55:29.381 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writesame": 0, 2024-08-20T01:55:29.381 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_append": 0, 2024-08-20T01:55:29.381 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_zero": 0, 2024-08-20T01:55:29.381 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_truncate": 0, 2024-08-20T01:55:29.381 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_delete": 1530, 2024-08-20T01:55:29.381 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_mapext": 0, 2024-08-20T01:55:29.381 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_sparse_read": 0, 2024-08-20T01:55:29.382 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_clonerange": 0, 2024-08-20T01:55:29.382 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_getxattr": 2133, 2024-08-20T01:55:29.382 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_setxattr": 748, 2024-08-20T01:55:29.382 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_cmpxattr": 0, 2024-08-20T01:55:29.382 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_rmxattr": 0, 2024-08-20T01:55:29.382 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_resetxattrs": 0, 2024-08-20T01:55:29.382 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_call": 0, 2024-08-20T01:55:29.382 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_watch": 0, 2024-08-20T01:55:29.382 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_notify": 0, 2024-08-20T01:55:29.382 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_src_cmpxattr": 0, 2024-08-20T01:55:29.382 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls": 0, 2024-08-20T01:55:29.382 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls_filter": 0, 2024-08-20T01:55:29.382 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_other": 6, 2024-08-20T01:55:29.382 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_active": 0, 2024-08-20T01:55:29.383 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_send": 0, 2024-08-20T01:55:29.383 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_resend": 0, 2024-08-20T01:55:29.383 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_ping": 0, 2024-08-20T01:55:29.383 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_active": 0, 2024-08-20T01:55:29.383 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_send": 0, 2024-08-20T01:55:29.383 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_resend": 0, 2024-08-20T01:55:29.383 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_active": 0, 2024-08-20T01:55:29.383 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_send": 0, 2024-08-20T01:55:29.383 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_resend": 0, 2024-08-20T01:55:29.383 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_active": 0, 2024-08-20T01:55:29.383 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_send": 0, 2024-08-20T01:55:29.383 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_resend": 0, 2024-08-20T01:55:29.383 INFO:teuthology.orchestra.run.smithi081.stdout: "command_active": 0, 2024-08-20T01:55:29.384 INFO:teuthology.orchestra.run.smithi081.stdout: "command_send": 0, 2024-08-20T01:55:29.384 INFO:teuthology.orchestra.run.smithi081.stdout: "command_resend": 0, 2024-08-20T01:55:29.384 INFO:teuthology.orchestra.run.smithi081.stdout: "map_epoch": 74, 2024-08-20T01:55:29.384 INFO:teuthology.orchestra.run.smithi081.stdout: "map_full": 0, 2024-08-20T01:55:29.384 INFO:teuthology.orchestra.run.smithi081.stdout: "map_inc": 2, 2024-08-20T01:55:29.384 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_sessions": 12, 2024-08-20T01:55:29.384 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_open": 12, 2024-08-20T01:55:29.384 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_close": 0, 2024-08-20T01:55:29.384 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_laggy": 0, 2024-08-20T01:55:29.384 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_wr": 1540, 2024-08-20T01:55:29.384 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_rd": 16, 2024-08-20T01:55:29.384 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_del": 217 2024-08-20T01:55:29.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.385 INFO:teuthology.orchestra.run.smithi081.stdout: "oft": { 2024-08-20T01:55:29.385 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_objs": 1, 2024-08-20T01:55:29.385 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_kv_pairs": 0, 2024-08-20T01:55:29.385 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_updates": 0, 2024-08-20T01:55:29.385 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_removes": 0 2024-08-20T01:55:29.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.385 INFO:teuthology.orchestra.run.smithi081.stdout: "purge_queue": { 2024-08-20T01:55:29.385 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops": 0, 2024-08-20T01:55:29.385 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops_high_water": 30, 2024-08-20T01:55:29.385 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing": 0, 2024-08-20T01:55:29.385 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_high_water": 6, 2024-08-20T01:55:29.385 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executed_ops": 1014, 2024-08-20T01:55:29.385 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executed": 582, 2024-08-20T01:55:29.385 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_item_in_journal": 0 2024-08-20T01:55:29.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.386 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-20T01:55:29.386 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-08-20T01:55:29.386 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-08-20T01:55:29.386 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-08-20T01:55:29.386 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 23456, 2024-08-20T01:55:29.386 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 7273837, 2024-08-20T01:55:29.386 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:29.386 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 23456, 2024-08-20T01:55:29.386 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-08-20T01:55:29.386 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-08-20T01:55:29.386 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 23456, 2024-08-20T01:55:29.387 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 7273837, 2024-08-20T01:55:29.387 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-08-20T01:55:29.387 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:29.387 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:29.387 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:29.387 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-08-20T01:55:29.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.387 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_bytes": { 2024-08-20T01:55:29.387 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-08-20T01:55:29.387 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-08-20T01:55:29.387 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-08-20T01:55:29.387 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-08-20T01:55:29.387 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-08-20T01:55:29.388 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:29.388 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-08-20T01:55:29.388 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 6222, 2024-08-20T01:55:29.388 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 10948921, 2024-08-20T01:55:29.388 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 6222, 2024-08-20T01:55:29.388 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 10948921, 2024-08-20T01:55:29.388 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-08-20T01:55:29.388 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:29.388 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:29.388 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:29.388 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-08-20T01:55:29.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.388 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_ops": { 2024-08-20T01:55:29.388 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-08-20T01:55:29.389 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 1024, 2024-08-20T01:55:29.389 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-08-20T01:55:29.389 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-08-20T01:55:29.389 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-08-20T01:55:29.389 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:29.389 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-08-20T01:55:29.389 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 6222, 2024-08-20T01:55:29.389 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 6222, 2024-08-20T01:55:29.389 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 6222, 2024-08-20T01:55:29.389 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 6222, 2024-08-20T01:55:29.389 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-08-20T01:55:29.389 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:29.389 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:29.390 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:29.390 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-08-20T01:55:29.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.390 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle": { 2024-08-20T01:55:29.390 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-08-20T01:55:29.390 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2024-08-20T01:55:29.390 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-08-20T01:55:29.390 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 582, 2024-08-20T01:55:29.390 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 58782, 2024-08-20T01:55:29.390 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:29.390 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 582, 2024-08-20T01:55:29.390 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-08-20T01:55:29.391 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-08-20T01:55:29.391 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 44, 2024-08-20T01:55:29.391 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 58782, 2024-08-20T01:55:29.391 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-08-20T01:55:29.391 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:29.391 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:29.391 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:29.391 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-08-20T01:55:29.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.391 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle-0x561cffd9a6e0": { 2024-08-20T01:55:29.391 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-08-20T01:55:29.391 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2024-08-20T01:55:29.391 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-08-20T01:55:29.392 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 4369, 2024-08-20T01:55:29.392 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 9840029, 2024-08-20T01:55:29.392 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:29.392 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 4369, 2024-08-20T01:55:29.392 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-08-20T01:55:29.392 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-08-20T01:55:29.392 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 931, 2024-08-20T01:55:29.392 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 9840029, 2024-08-20T01:55:29.392 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-08-20T01:55:29.392 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:29.393 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:29.393 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:29.393 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-08-20T01:55:29.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:29.393 INFO:teuthology.orchestra.run.smithi081.stdout: "trackedop": { 2024-08-20T01:55:29.393 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_ops_count": 6 2024-08-20T01:55:29.393 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-08-20T01:55:29.393 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-08-20T01:55:30.176 INFO:tasks.check_counter:Daemon mds.b mds.exported=9 2024-08-20T01:55:30.177 INFO:tasks.check_counter:Daemon mds.b mds.imported=7 2024-08-20T01:55:30.177 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=327 2024-08-20T01:55:30.177 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=101 2024-08-20T01:55:30.177 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=0 2024-08-20T01:55:30.177 DEBUG:tasks.check_counter:Getting stats from e 2024-08-20T01:55:30.177 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph daemon mds.e perf dump 2024-08-20T01:55:30.437 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.b/config 2024-08-20T01:55:30.740 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:30 smithi081 ceph-mon[22209]: pgmap v892: 97 pgs: 97 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 21 op/s 2024-08-20T01:55:30.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:30 smithi175 ceph-mon[22392]: pgmap v892: 97 pgs: 97 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 21 op/s 2024-08-20T01:55:30.923 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:30 smithi079 ceph-mon[18656]: pgmap v892: 97 pgs: 97 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 21 op/s 2024-08-20T01:55:30.947 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-08-20T01:55:30.948 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-0": { 2024-08-20T01:55:30.948 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 1584, 2024-08-20T01:55:30.948 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 1535, 2024-08-20T01:55:30.948 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 1268960, 2024-08-20T01:55:30.948 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 587990, 2024-08-20T01:55:30.948 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 5, 2024-08-20T01:55:30.948 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 1, 2024-08-20T01:55:30.948 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.188957353, 2024-08-20T01:55:30.948 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.097498405, 2024-08-20T01:55:30.948 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.057117477, 2024-08-20T01:55:30.948 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.029086327, 2024-08-20T01:55:30.949 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:55:30.949 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 1535, 2024-08-20T01:55:30.949 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.076053294, 2024-08-20T01:55:30.949 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000049546 2024-08-20T01:55:30.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.949 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:55:30.949 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:30.949 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:30.949 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:30.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.949 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 869456, 2024-08-20T01:55:30.949 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 209888 2024-08-20T01:55:30.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.950 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-1": { 2024-08-20T01:55:30.950 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 4, 2024-08-20T01:55:30.950 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 259, 2024-08-20T01:55:30.950 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 876, 2024-08-20T01:55:30.950 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 620602, 2024-08-20T01:55:30.950 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 6, 2024-08-20T01:55:30.950 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 3, 2024-08-20T01:55:30.950 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.017910248, 2024-08-20T01:55:30.950 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.013578327, 2024-08-20T01:55:30.950 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.002057835, 2024-08-20T01:55:30.950 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000064310, 2024-08-20T01:55:30.950 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:55:30.951 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 257, 2024-08-20T01:55:30.951 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.013234681, 2024-08-20T01:55:30.951 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000051496 2024-08-20T01:55:30.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.951 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:55:30.951 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:30.951 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:30.951 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:30.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.951 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-20T01:55:30.951 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 619904 2024-08-20T01:55:30.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.951 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-2": { 2024-08-20T01:55:30.952 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 2896, 2024-08-20T01:55:30.952 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 2898, 2024-08-20T01:55:30.952 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 4923600, 2024-08-20T01:55:30.952 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 920935, 2024-08-20T01:55:30.952 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 5, 2024-08-20T01:55:30.952 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 3, 2024-08-20T01:55:30.952 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.198993508, 2024-08-20T01:55:30.952 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.070943925, 2024-08-20T01:55:30.952 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.053719925, 2024-08-20T01:55:30.952 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.063768489, 2024-08-20T01:55:30.952 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:55:30.953 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 2896, 2024-08-20T01:55:30.953 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.085141701, 2024-08-20T01:55:30.953 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000029399 2024-08-20T01:55:30.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.953 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:55:30.953 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:30.953 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:30.953 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:30.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.953 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-20T01:55:30.953 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 0 2024-08-20T01:55:30.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.954 INFO:teuthology.orchestra.run.smithi081.stdout: "cct": { 2024-08-20T01:55:30.954 INFO:teuthology.orchestra.run.smithi081.stdout: "total_workers": 1, 2024-08-20T01:55:30.954 INFO:teuthology.orchestra.run.smithi081.stdout: "unhealthy_workers": 0 2024-08-20T01:55:30.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.954 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-MDSRank": { 2024-08-20T01:55:30.954 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2024-08-20T01:55:30.954 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2024-08-20T01:55:30.954 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 7055, 2024-08-20T01:55:30.954 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.137381646, 2024-08-20T01:55:30.954 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000019472 2024-08-20T01:55:30.954 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-08-20T01:55:30.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.955 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-PurgeQueue": { 2024-08-20T01:55:30.955 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2024-08-20T01:55:30.955 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2024-08-20T01:55:30.955 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:30.955 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:30.955 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:30.955 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-08-20T01:55:30.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.955 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-08-20T01:55:30.955 INFO:teuthology.orchestra.run.smithi081.stdout: "request": 0, 2024-08-20T01:55:30.956 INFO:teuthology.orchestra.run.smithi081.stdout: "reply": 0, 2024-08-20T01:55:30.956 INFO:teuthology.orchestra.run.smithi081.stdout: "reply_latency": { 2024-08-20T01:55:30.956 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:30.956 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:30.956 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:30.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.956 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_reply": 0, 2024-08-20T01:55:30.956 INFO:teuthology.orchestra.run.smithi081.stdout: "forward": 0, 2024-08-20T01:55:30.956 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_complete": 0, 2024-08-20T01:55:30.956 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_keys": 0, 2024-08-20T01:55:30.956 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_commit": 0, 2024-08-20T01:55:30.956 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_split": 0, 2024-08-20T01:55:30.957 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_merge": 0, 2024-08-20T01:55:30.957 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes": 31, 2024-08-20T01:55:30.957 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_top": 0, 2024-08-20T01:55:30.957 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_bottom": 31, 2024-08-20T01:55:30.957 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pin_tail": 0, 2024-08-20T01:55:30.957 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pinned": 31, 2024-08-20T01:55:30.957 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_expired": 0, 2024-08-20T01:55:30.957 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_with_caps": 0, 2024-08-20T01:55:30.957 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": 0, 2024-08-20T01:55:30.957 INFO:teuthology.orchestra.run.smithi081.stdout: "subtrees": 1, 2024-08-20T01:55:30.958 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse": 0, 2024-08-20T01:55:30.958 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_hit": 0, 2024-08-20T01:55:30.958 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_forward": 0, 2024-08-20T01:55:30.958 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_discover": 0, 2024-08-20T01:55:30.958 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_dir_fetch": 0, 2024-08-20T01:55:30.958 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_remote_ino": 0, 2024-08-20T01:55:30.958 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_lock": 0, 2024-08-20T01:55:30.958 INFO:teuthology.orchestra.run.smithi081.stdout: "load_cent": 0, 2024-08-20T01:55:30.958 INFO:teuthology.orchestra.run.smithi081.stdout: "q": 0, 2024-08-20T01:55:30.958 INFO:teuthology.orchestra.run.smithi081.stdout: "exported": 0, 2024-08-20T01:55:30.958 INFO:teuthology.orchestra.run.smithi081.stdout: "exported_inodes": 0, 2024-08-20T01:55:30.958 INFO:teuthology.orchestra.run.smithi081.stdout: "imported": 0, 2024-08-20T01:55:30.959 INFO:teuthology.orchestra.run.smithi081.stdout: "imported_inodes": 0, 2024-08-20T01:55:30.959 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_dir_fetch": 0, 2024-08-20T01:55:30.959 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_backtrace_fetch": 0, 2024-08-20T01:55:30.959 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_peer_discover": 0, 2024-08-20T01:55:30.959 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rfiles": 0, 2024-08-20T01:55:30.959 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rbytes": 0, 2024-08-20T01:55:30.959 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rsnaps": 0, 2024-08-20T01:55:30.959 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_fetch": 0, 2024-08-20T01:55:30.959 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_set_tag": 0, 2024-08-20T01:55:30.959 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_repaired": 0, 2024-08-20T01:55:30.959 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_inotable_repaired": 0, 2024-08-20T01:55:30.959 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_inodes": 0, 2024-08-20T01:55:30.959 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_base_inodes": 0, 2024-08-20T01:55:30.960 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dirfrag_rstats": 0, 2024-08-20T01:55:30.960 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_file_inodes": 0, 2024-08-20T01:55:30.960 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_inode_file_caps": 0, 2024-08-20T01:55:30.960 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_revoke": 0, 2024-08-20T01:55:30.960 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_grant": 0, 2024-08-20T01:55:30.960 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_trunc": 0, 2024-08-20T01:55:30.960 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-20T01:55:30.960 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-20T01:55:30.960 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps": 0, 2024-08-20T01:55:30.960 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps_dirty": 0, 2024-08-20T01:55:30.960 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_cap_release": 0, 2024-08-20T01:55:30.961 INFO:teuthology.orchestra.run.smithi081.stdout: "process_request_cap_release": 0 2024-08-20T01:55:30.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.961 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cache": { 2024-08-20T01:55:30.961 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update": 0, 2024-08-20T01:55:30.961 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update_receipt": 0, 2024-08-20T01:55:30.961 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_try_discover": 0, 2024-08-20T01:55:30.961 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_send_discover": 0, 2024-08-20T01:55:30.961 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_handle_discover": 0, 2024-08-20T01:55:30.961 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays": 0, 2024-08-20T01:55:30.961 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_delayed": 0, 2024-08-20T01:55:30.961 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_enqueuing": 0, 2024-08-20T01:55:30.961 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_created": 0, 2024-08-20T01:55:30.961 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_enqueued": 0, 2024-08-20T01:55:30.962 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_reintegrated": 0, 2024-08-20T01:55:30.962 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_migrated": 0, 2024-08-20T01:55:30.962 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_processing": 0, 2024-08-20T01:55:30.962 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_enqueued": 0, 2024-08-20T01:55:30.962 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_prioritized": 0, 2024-08-20T01:55:30.962 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_started": 0, 2024-08-20T01:55:30.962 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_completed": 0, 2024-08-20T01:55:30.962 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_quiesce_path": 0, 2024-08-20T01:55:30.962 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_quiesce_inode": 0, 2024-08-20T01:55:30.962 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_enqueue_scrub": 0, 2024-08-20T01:55:30.962 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_exportdir": 0, 2024-08-20T01:55:30.962 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_flush": 0, 2024-08-20T01:55:30.963 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragmentdir": 0, 2024-08-20T01:55:30.963 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragstats": 0, 2024-08-20T01:55:30.963 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_inodestats": 0 2024-08-20T01:55:30.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.963 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_log": { 2024-08-20T01:55:30.963 INFO:teuthology.orchestra.run.smithi081.stdout: "evlrg": 0, 2024-08-20T01:55:30.963 INFO:teuthology.orchestra.run.smithi081.stdout: "evadd": 0, 2024-08-20T01:55:30.963 INFO:teuthology.orchestra.run.smithi081.stdout: "evex": 0, 2024-08-20T01:55:30.963 INFO:teuthology.orchestra.run.smithi081.stdout: "evtrm": 0, 2024-08-20T01:55:30.963 INFO:teuthology.orchestra.run.smithi081.stdout: "ev": 2063, 2024-08-20T01:55:30.963 INFO:teuthology.orchestra.run.smithi081.stdout: "evexg": 0, 2024-08-20T01:55:30.963 INFO:teuthology.orchestra.run.smithi081.stdout: "evexd": 0, 2024-08-20T01:55:30.963 INFO:teuthology.orchestra.run.smithi081.stdout: "segadd": 0, 2024-08-20T01:55:30.964 INFO:teuthology.orchestra.run.smithi081.stdout: "segex": 0, 2024-08-20T01:55:30.964 INFO:teuthology.orchestra.run.smithi081.stdout: "segtrm": 0, 2024-08-20T01:55:30.964 INFO:teuthology.orchestra.run.smithi081.stdout: "seg": 4, 2024-08-20T01:55:30.964 INFO:teuthology.orchestra.run.smithi081.stdout: "segmjr": 2, 2024-08-20T01:55:30.964 INFO:teuthology.orchestra.run.smithi081.stdout: "segexg": 0, 2024-08-20T01:55:30.964 INFO:teuthology.orchestra.run.smithi081.stdout: "segexd": 0, 2024-08-20T01:55:30.964 INFO:teuthology.orchestra.run.smithi081.stdout: "expos": 4194304, 2024-08-20T01:55:30.964 INFO:teuthology.orchestra.run.smithi081.stdout: "wrpos": 8385819, 2024-08-20T01:55:30.964 INFO:teuthology.orchestra.run.smithi081.stdout: "rdpos": 8385220, 2024-08-20T01:55:30.965 INFO:teuthology.orchestra.run.smithi081.stdout: "jlat": { 2024-08-20T01:55:30.965 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:30.965 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:30.965 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:30.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.965 INFO:teuthology.orchestra.run.smithi081.stdout: "replayed": 2063 2024-08-20T01:55:30.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.965 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_mem": { 2024-08-20T01:55:30.965 INFO:teuthology.orchestra.run.smithi081.stdout: "ino": 4, 2024-08-20T01:55:30.965 INFO:teuthology.orchestra.run.smithi081.stdout: "ino+": 298, 2024-08-20T01:55:30.965 INFO:teuthology.orchestra.run.smithi081.stdout: "ino-": 294, 2024-08-20T01:55:30.966 INFO:teuthology.orchestra.run.smithi081.stdout: "dir": 2, 2024-08-20T01:55:30.966 INFO:teuthology.orchestra.run.smithi081.stdout: "dir+": 97, 2024-08-20T01:55:30.966 INFO:teuthology.orchestra.run.smithi081.stdout: "dir-": 95, 2024-08-20T01:55:30.966 INFO:teuthology.orchestra.run.smithi081.stdout: "dn": 31, 2024-08-20T01:55:30.966 INFO:teuthology.orchestra.run.smithi081.stdout: "dn+": 399, 2024-08-20T01:55:30.966 INFO:teuthology.orchestra.run.smithi081.stdout: "dn-": 368, 2024-08-20T01:55:30.966 INFO:teuthology.orchestra.run.smithi081.stdout: "cap": 0, 2024-08-20T01:55:30.966 INFO:teuthology.orchestra.run.smithi081.stdout: "cap+": 0, 2024-08-20T01:55:30.966 INFO:teuthology.orchestra.run.smithi081.stdout: "cap-": 0, 2024-08-20T01:55:30.966 INFO:teuthology.orchestra.run.smithi081.stdout: "rss": 50256, 2024-08-20T01:55:30.966 INFO:teuthology.orchestra.run.smithi081.stdout: "heap": 252502016 2024-08-20T01:55:30.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.967 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_server": { 2024-08-20T01:55:30.967 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_client_request": 0, 2024-08-20T01:55:30.967 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_server_request": 0, 2024-08-20T01:55:30.967 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_request": 0, 2024-08-20T01:55:30.967 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_session": 0, 2024-08-20T01:55:30.967 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_peer_request": 0, 2024-08-20T01:55:30.967 INFO:teuthology.orchestra.run.smithi081.stdout: "req_create_latency": { 2024-08-20T01:55:30.967 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:30.967 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:30.967 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:30.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.967 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getattr_latency": { 2024-08-20T01:55:30.967 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:30.968 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:30.968 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:30.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.968 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getfilelock_latency": { 2024-08-20T01:55:30.968 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:30.968 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:30.968 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:30.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.968 INFO:teuthology.orchestra.run.smithi081.stdout: "req_link_latency": { 2024-08-20T01:55:30.968 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:30.968 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:30.968 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:30.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.969 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookup_latency": { 2024-08-20T01:55:30.969 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:30.969 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:30.969 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:30.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.969 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookuphash_latency": { 2024-08-20T01:55:30.969 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:30.969 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:30.969 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:30.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.969 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupino_latency": { 2024-08-20T01:55:30.969 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:30.969 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:30.970 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:30.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.970 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupname_latency": { 2024-08-20T01:55:30.970 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:30.970 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:30.970 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:30.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.970 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupparent_latency": { 2024-08-20T01:55:30.970 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:30.970 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:30.970 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:30.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.970 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupsnap_latency": { 2024-08-20T01:55:30.971 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:30.971 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:30.971 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:30.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.971 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lssnap_latency": { 2024-08-20T01:55:30.971 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:30.971 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:30.971 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:30.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.971 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mkdir_latency": { 2024-08-20T01:55:30.972 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:30.972 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:30.972 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:30.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.972 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mknod_latency": { 2024-08-20T01:55:30.972 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:30.972 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:30.972 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:30.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.972 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mksnap_latency": { 2024-08-20T01:55:30.972 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:30.973 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:30.973 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:30.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.973 INFO:teuthology.orchestra.run.smithi081.stdout: "req_open_latency": { 2024-08-20T01:55:30.973 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:30.973 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:30.973 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:30.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.973 INFO:teuthology.orchestra.run.smithi081.stdout: "req_readdir_latency": { 2024-08-20T01:55:30.973 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:30.973 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:30.973 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:30.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.974 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rename_latency": { 2024-08-20T01:55:30.974 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:30.974 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:30.974 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:30.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.974 INFO:teuthology.orchestra.run.smithi081.stdout: "req_renamesnap_latency": { 2024-08-20T01:55:30.974 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:30.974 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:30.974 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:30.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.974 INFO:teuthology.orchestra.run.smithi081.stdout: "req_snapdiff_latency": { 2024-08-20T01:55:30.975 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:30.975 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:30.975 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:30.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.975 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmdir_latency": { 2024-08-20T01:55:30.975 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:30.975 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:30.975 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:30.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.975 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmsnap_latency": { 2024-08-20T01:55:30.975 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:30.975 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:30.976 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:30.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.976 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmxattr_latency": { 2024-08-20T01:55:30.976 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:30.976 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:30.976 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:30.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.976 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setattr_latency": { 2024-08-20T01:55:30.976 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:30.976 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:30.976 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:30.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.976 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setdirlayout_latency": { 2024-08-20T01:55:30.976 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:30.977 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:30.977 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:30.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.977 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setfilelock_latency": { 2024-08-20T01:55:30.977 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:30.977 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:30.977 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:30.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.977 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setlayout_latency": { 2024-08-20T01:55:30.977 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:30.977 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:30.977 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:30.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.978 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setxattr_latency": { 2024-08-20T01:55:30.978 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:30.978 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:30.978 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:30.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.978 INFO:teuthology.orchestra.run.smithi081.stdout: "req_symlink_latency": { 2024-08-20T01:55:30.978 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:30.978 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:30.978 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:30.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.978 INFO:teuthology.orchestra.run.smithi081.stdout: "req_unlink_latency": { 2024-08-20T01:55:30.978 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:30.979 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:30.979 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:30.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.979 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_revoke_eviction": 0, 2024-08-20T01:55:30.979 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_acquisition_throttle": 0, 2024-08-20T01:55:30.979 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getvxattr_latency": { 2024-08-20T01:55:30.979 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:30.979 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:30.979 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:30.979 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-08-20T01:55:30.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.979 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_sessions": { 2024-08-20T01:55:30.979 INFO:teuthology.orchestra.run.smithi081.stdout: "session_count": 1, 2024-08-20T01:55:30.979 INFO:teuthology.orchestra.run.smithi081.stdout: "session_add": 1, 2024-08-20T01:55:30.980 INFO:teuthology.orchestra.run.smithi081.stdout: "session_remove": 0, 2024-08-20T01:55:30.980 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_open": 1, 2024-08-20T01:55:30.980 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_stale": 0, 2024-08-20T01:55:30.980 INFO:teuthology.orchestra.run.smithi081.stdout: "total_load": 0, 2024-08-20T01:55:30.980 INFO:teuthology.orchestra.run.smithi081.stdout: "average_load": 0, 2024-08-20T01:55:30.980 INFO:teuthology.orchestra.run.smithi081.stdout: "avg_session_uptime": 2101, 2024-08-20T01:55:30.980 INFO:teuthology.orchestra.run.smithi081.stdout: "mdthresh_evicted": 0 2024-08-20T01:55:30.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.980 INFO:teuthology.orchestra.run.smithi081.stdout: "mempool": { 2024-08-20T01:55:30.980 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_bytes": 0, 2024-08-20T01:55:30.980 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_items": 0, 2024-08-20T01:55:30.980 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_bytes": 0, 2024-08-20T01:55:30.980 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_items": 0, 2024-08-20T01:55:30.980 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_bytes": 0, 2024-08-20T01:55:30.981 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_items": 0, 2024-08-20T01:55:30.981 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-20T01:55:30.981 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_items": 0, 2024-08-20T01:55:30.981 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-20T01:55:30.981 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_items": 0, 2024-08-20T01:55:30.981 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_bytes": 0, 2024-08-20T01:55:30.981 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_items": 0, 2024-08-20T01:55:30.981 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-20T01:55:30.981 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_items": 0, 2024-08-20T01:55:30.981 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_bytes": 0, 2024-08-20T01:55:30.981 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_items": 0, 2024-08-20T01:55:30.981 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_bytes": 0, 2024-08-20T01:55:30.981 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_items": 0, 2024-08-20T01:55:30.981 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-20T01:55:30.982 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_items": 0, 2024-08-20T01:55:30.982 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-20T01:55:30.982 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_items": 0, 2024-08-20T01:55:30.982 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_bytes": 0, 2024-08-20T01:55:30.982 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_items": 0, 2024-08-20T01:55:30.982 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_bytes": 0, 2024-08-20T01:55:30.982 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_items": 0, 2024-08-20T01:55:30.982 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-20T01:55:30.982 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_items": 0, 2024-08-20T01:55:30.982 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_bytes": 0, 2024-08-20T01:55:30.982 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_items": 0, 2024-08-20T01:55:30.982 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_bytes": 0, 2024-08-20T01:55:30.983 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_items": 0, 2024-08-20T01:55:30.983 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_bytes": 0, 2024-08-20T01:55:30.983 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_items": 0, 2024-08-20T01:55:30.983 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_bytes": 0, 2024-08-20T01:55:30.983 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_items": 0, 2024-08-20T01:55:30.983 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_bytes": 182087, 2024-08-20T01:55:30.983 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_items": 48, 2024-08-20T01:55:30.983 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_bytes": 0, 2024-08-20T01:55:30.983 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_items": 0, 2024-08-20T01:55:30.983 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bytes": 0, 2024-08-20T01:55:30.983 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_items": 0, 2024-08-20T01:55:30.983 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_bytes": 0, 2024-08-20T01:55:30.983 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_items": 0, 2024-08-20T01:55:30.983 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_bytes": 0, 2024-08-20T01:55:30.984 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_items": 0, 2024-08-20T01:55:30.984 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_bytes": 7496, 2024-08-20T01:55:30.984 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_items": 154, 2024-08-20T01:55:30.984 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_bytes": 0, 2024-08-20T01:55:30.984 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_items": 0, 2024-08-20T01:55:30.984 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_bytes": 0, 2024-08-20T01:55:30.984 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_items": 0, 2024-08-20T01:55:30.984 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_bytes": 33128, 2024-08-20T01:55:30.984 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_items": 152, 2024-08-20T01:55:30.984 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_bytes": 0, 2024-08-20T01:55:30.984 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_items": 0, 2024-08-20T01:55:30.984 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_bytes": 0, 2024-08-20T01:55:30.984 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_items": 0 2024-08-20T01:55:30.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.985 INFO:teuthology.orchestra.run.smithi081.stdout: "objecter": { 2024-08-20T01:55:30.985 INFO:teuthology.orchestra.run.smithi081.stdout: "op_active": 0, 2024-08-20T01:55:30.985 INFO:teuthology.orchestra.run.smithi081.stdout: "op_laggy": 0, 2024-08-20T01:55:30.985 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send": 4087, 2024-08-20T01:55:30.985 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send_bytes": 21, 2024-08-20T01:55:30.985 INFO:teuthology.orchestra.run.smithi081.stdout: "op_resend": 3, 2024-08-20T01:55:30.985 INFO:teuthology.orchestra.run.smithi081.stdout: "op_reply": 4087, 2024-08-20T01:55:30.985 INFO:teuthology.orchestra.run.smithi081.stdout: "op_latency": { 2024-08-20T01:55:30.985 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 4087, 2024-08-20T01:55:30.985 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 35.748319650, 2024-08-20T01:55:30.985 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.008746836 2024-08-20T01:55:30.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.985 INFO:teuthology.orchestra.run.smithi081.stdout: "op_inflight": 0, 2024-08-20T01:55:30.986 INFO:teuthology.orchestra.run.smithi081.stdout: "oplen_avg": { 2024-08-20T01:55:30.986 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 4087, 2024-08-20T01:55:30.986 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 4088 2024-08-20T01:55:30.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.986 INFO:teuthology.orchestra.run.smithi081.stdout: "op": 4087, 2024-08-20T01:55:30.986 INFO:teuthology.orchestra.run.smithi081.stdout: "op_r": 4087, 2024-08-20T01:55:30.986 INFO:teuthology.orchestra.run.smithi081.stdout: "op_w": 0, 2024-08-20T01:55:30.986 INFO:teuthology.orchestra.run.smithi081.stdout: "op_rmw": 0, 2024-08-20T01:55:30.986 INFO:teuthology.orchestra.run.smithi081.stdout: "op_pg": 0, 2024-08-20T01:55:30.986 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_stat": 2278, 2024-08-20T01:55:30.986 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_create": 0, 2024-08-20T01:55:30.986 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_read": 1807, 2024-08-20T01:55:30.986 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_write": 0, 2024-08-20T01:55:30.987 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writefull": 0, 2024-08-20T01:55:30.987 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writesame": 0, 2024-08-20T01:55:30.987 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_append": 0, 2024-08-20T01:55:30.987 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_zero": 0, 2024-08-20T01:55:30.987 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_truncate": 0, 2024-08-20T01:55:30.987 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_delete": 0, 2024-08-20T01:55:30.987 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_mapext": 0, 2024-08-20T01:55:30.987 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_sparse_read": 0, 2024-08-20T01:55:30.987 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_clonerange": 0, 2024-08-20T01:55:30.987 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_getxattr": 1, 2024-08-20T01:55:30.987 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_setxattr": 0, 2024-08-20T01:55:30.987 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_cmpxattr": 0, 2024-08-20T01:55:30.987 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_rmxattr": 0, 2024-08-20T01:55:30.987 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_resetxattrs": 0, 2024-08-20T01:55:30.988 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_call": 0, 2024-08-20T01:55:30.988 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_watch": 0, 2024-08-20T01:55:30.988 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_notify": 0, 2024-08-20T01:55:30.988 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_src_cmpxattr": 0, 2024-08-20T01:55:30.988 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls": 0, 2024-08-20T01:55:30.988 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls_filter": 0, 2024-08-20T01:55:30.988 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_other": 0, 2024-08-20T01:55:30.988 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_active": 0, 2024-08-20T01:55:30.988 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_send": 0, 2024-08-20T01:55:30.988 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_resend": 0, 2024-08-20T01:55:30.988 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_ping": 0, 2024-08-20T01:55:30.988 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_active": 0, 2024-08-20T01:55:30.988 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_send": 0, 2024-08-20T01:55:30.988 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_resend": 0, 2024-08-20T01:55:30.989 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_active": 0, 2024-08-20T01:55:30.989 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_send": 0, 2024-08-20T01:55:30.989 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_resend": 0, 2024-08-20T01:55:30.989 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_active": 0, 2024-08-20T01:55:30.989 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_send": 0, 2024-08-20T01:55:30.989 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_resend": 0, 2024-08-20T01:55:30.989 INFO:teuthology.orchestra.run.smithi081.stdout: "command_active": 0, 2024-08-20T01:55:30.989 INFO:teuthology.orchestra.run.smithi081.stdout: "command_send": 0, 2024-08-20T01:55:30.989 INFO:teuthology.orchestra.run.smithi081.stdout: "command_resend": 0, 2024-08-20T01:55:30.989 INFO:teuthology.orchestra.run.smithi081.stdout: "map_epoch": 74, 2024-08-20T01:55:30.989 INFO:teuthology.orchestra.run.smithi081.stdout: "map_full": 0, 2024-08-20T01:55:30.989 INFO:teuthology.orchestra.run.smithi081.stdout: "map_inc": 2, 2024-08-20T01:55:30.989 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_sessions": 4, 2024-08-20T01:55:30.989 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_open": 6, 2024-08-20T01:55:30.990 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_close": 2, 2024-08-20T01:55:30.990 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_laggy": 0, 2024-08-20T01:55:30.990 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_wr": 0, 2024-08-20T01:55:30.990 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_rd": 2, 2024-08-20T01:55:30.990 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_del": 0 2024-08-20T01:55:30.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.990 INFO:teuthology.orchestra.run.smithi081.stdout: "oft": { 2024-08-20T01:55:30.990 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_objs": 0, 2024-08-20T01:55:30.990 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_kv_pairs": 0, 2024-08-20T01:55:30.990 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_updates": 0, 2024-08-20T01:55:30.990 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_removes": 0 2024-08-20T01:55:30.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.991 INFO:teuthology.orchestra.run.smithi081.stdout: "purge_queue": { 2024-08-20T01:55:30.991 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops": 0, 2024-08-20T01:55:30.991 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops_high_water": 0, 2024-08-20T01:55:30.991 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing": 0, 2024-08-20T01:55:30.991 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_high_water": 0, 2024-08-20T01:55:30.991 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executed_ops": 0, 2024-08-20T01:55:30.991 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executed": 0, 2024-08-20T01:55:30.991 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_item_in_journal": 0 2024-08-20T01:55:30.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.991 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-20T01:55:30.991 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-08-20T01:55:30.991 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-08-20T01:55:30.991 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-08-20T01:55:30.991 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 4480, 2024-08-20T01:55:30.992 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 5767309, 2024-08-20T01:55:30.992 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:30.992 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 4480, 2024-08-20T01:55:30.992 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-08-20T01:55:30.992 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-08-20T01:55:30.992 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 4480, 2024-08-20T01:55:30.992 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 5767309, 2024-08-20T01:55:30.992 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-08-20T01:55:30.992 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:30.992 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:30.992 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:30.992 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-08-20T01:55:30.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.992 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_bytes": { 2024-08-20T01:55:30.992 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-08-20T01:55:30.993 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-08-20T01:55:30.993 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-08-20T01:55:30.993 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-08-20T01:55:30.993 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-08-20T01:55:30.993 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:30.993 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-08-20T01:55:30.993 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 4087, 2024-08-20T01:55:30.993 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 4191520, 2024-08-20T01:55:30.993 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 4087, 2024-08-20T01:55:30.993 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 4191520, 2024-08-20T01:55:30.993 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-08-20T01:55:30.993 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:30.993 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:30.993 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:30.994 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-08-20T01:55:30.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.994 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_ops": { 2024-08-20T01:55:30.994 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-08-20T01:55:30.994 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 1024, 2024-08-20T01:55:30.994 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-08-20T01:55:30.994 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-08-20T01:55:30.994 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-08-20T01:55:30.994 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:30.994 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-08-20T01:55:30.994 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 4087, 2024-08-20T01:55:30.994 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 4087, 2024-08-20T01:55:30.995 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 4087, 2024-08-20T01:55:30.995 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 4087, 2024-08-20T01:55:30.995 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-08-20T01:55:30.995 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:30.995 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:30.995 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:30.995 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-08-20T01:55:30.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.995 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle": { 2024-08-20T01:55:30.995 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-08-20T01:55:30.995 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2024-08-20T01:55:30.995 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-08-20T01:55:30.995 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-08-20T01:55:30.996 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-08-20T01:55:30.996 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:30.996 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-08-20T01:55:30.996 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-08-20T01:55:30.996 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-08-20T01:55:30.996 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 0, 2024-08-20T01:55:30.996 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 0, 2024-08-20T01:55:30.996 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-08-20T01:55:30.996 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:30.996 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:30.996 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:30.996 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-08-20T01:55:30.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.996 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle-0x557af6260960": { 2024-08-20T01:55:30.997 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-08-20T01:55:30.997 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2024-08-20T01:55:30.997 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-08-20T01:55:30.997 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-08-20T01:55:30.997 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-08-20T01:55:30.997 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:30.997 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-08-20T01:55:30.997 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-08-20T01:55:30.997 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-08-20T01:55:30.997 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 0, 2024-08-20T01:55:30.997 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 0, 2024-08-20T01:55:30.998 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-08-20T01:55:30.998 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:30.998 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:30.998 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:30.998 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-08-20T01:55:30.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:30.998 INFO:teuthology.orchestra.run.smithi081.stdout: "trackedop": { 2024-08-20T01:55:30.998 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_ops_count": 0 2024-08-20T01:55:30.998 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-08-20T01:55:30.998 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-08-20T01:55:31.699 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-08-20T01:55:31.700 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-08-20T01:55:31.700 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-08-20T01:55:31.700 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-08-20T01:55:31.700 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2024-08-20T01:55:31.700 DEBUG:tasks.check_counter:Getting stats from h 2024-08-20T01:55:31.700 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph daemon mds.h perf dump 2024-08-20T01:55:31.957 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.b/config 2024-08-20T01:55:32.574 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-08-20T01:55:32.574 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-0": { 2024-08-20T01:55:32.574 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 3562, 2024-08-20T01:55:32.574 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 3886, 2024-08-20T01:55:32.574 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 2157688, 2024-08-20T01:55:32.574 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 3082357, 2024-08-20T01:55:32.574 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 15, 2024-08-20T01:55:32.574 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 6, 2024-08-20T01:55:32.574 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.324908351, 2024-08-20T01:55:32.575 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.151638808, 2024-08-20T01:55:32.575 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.175061899, 2024-08-20T01:55:32.575 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.025096212, 2024-08-20T01:55:32.575 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:55:32.575 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 3883, 2024-08-20T01:55:32.575 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.317703325, 2024-08-20T01:55:32.575 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000081819 2024-08-20T01:55:32.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.575 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:55:32.575 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 4429, 2024-08-20T01:55:32.575 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000887333, 2024-08-20T01:55:32.575 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000200 2024-08-20T01:55:32.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.576 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 882320, 2024-08-20T01:55:32.576 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 225296 2024-08-20T01:55:32.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.576 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-1": { 2024-08-20T01:55:32.576 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 4913, 2024-08-20T01:55:32.576 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 4111, 2024-08-20T01:55:32.576 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 2043633, 2024-08-20T01:55:32.576 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 2233594, 2024-08-20T01:55:32.576 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 11, 2024-08-20T01:55:32.576 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 6, 2024-08-20T01:55:32.576 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.342606820, 2024-08-20T01:55:32.576 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.175884233, 2024-08-20T01:55:32.576 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.182785797, 2024-08-20T01:55:32.577 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.014263479, 2024-08-20T01:55:32.577 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:55:32.577 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 4112, 2024-08-20T01:55:32.577 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.120631341, 2024-08-20T01:55:32.577 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000029336 2024-08-20T01:55:32.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.577 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:55:32.577 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 7777, 2024-08-20T01:55:32.577 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.001238455, 2024-08-20T01:55:32.577 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000159 2024-08-20T01:55:32.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.577 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 3264, 2024-08-20T01:55:32.577 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 621808 2024-08-20T01:55:32.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.578 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-2": { 2024-08-20T01:55:32.578 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 1077, 2024-08-20T01:55:32.578 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 1280, 2024-08-20T01:55:32.578 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 540755, 2024-08-20T01:55:32.578 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 1250588, 2024-08-20T01:55:32.578 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 57, 2024-08-20T01:55:32.578 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 9, 2024-08-20T01:55:32.578 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.117472109, 2024-08-20T01:55:32.578 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.042795039, 2024-08-20T01:55:32.578 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.047101826, 2024-08-20T01:55:32.578 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.021474067, 2024-08-20T01:55:32.578 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:55:32.579 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 1278, 2024-08-20T01:55:32.579 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.064341310, 2024-08-20T01:55:32.579 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000050345 2024-08-20T01:55:32.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.579 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:55:32.579 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 831, 2024-08-20T01:55:32.579 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000159950, 2024-08-20T01:55:32.579 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000192 2024-08-20T01:55:32.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.579 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-20T01:55:32.579 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 0 2024-08-20T01:55:32.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.579 INFO:teuthology.orchestra.run.smithi081.stdout: "cct": { 2024-08-20T01:55:32.579 INFO:teuthology.orchestra.run.smithi081.stdout: "total_workers": 1, 2024-08-20T01:55:32.580 INFO:teuthology.orchestra.run.smithi081.stdout: "unhealthy_workers": 0 2024-08-20T01:55:32.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.580 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-MDSRank": { 2024-08-20T01:55:32.580 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2024-08-20T01:55:32.580 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2024-08-20T01:55:32.580 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 1643, 2024-08-20T01:55:32.580 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.301336275, 2024-08-20T01:55:32.580 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000183406 2024-08-20T01:55:32.580 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-08-20T01:55:32.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.580 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-PurgeQueue": { 2024-08-20T01:55:32.580 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2024-08-20T01:55:32.580 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2024-08-20T01:55:32.581 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 539, 2024-08-20T01:55:32.581 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.015652491, 2024-08-20T01:55:32.581 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000029039 2024-08-20T01:55:32.581 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-08-20T01:55:32.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.581 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-08-20T01:55:32.581 INFO:teuthology.orchestra.run.smithi081.stdout: "request": 626, 2024-08-20T01:55:32.581 INFO:teuthology.orchestra.run.smithi081.stdout: "reply": 532, 2024-08-20T01:55:32.581 INFO:teuthology.orchestra.run.smithi081.stdout: "reply_latency": { 2024-08-20T01:55:32.581 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 532, 2024-08-20T01:55:32.581 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 73.228473604, 2024-08-20T01:55:32.581 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.137647506 2024-08-20T01:55:32.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.581 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_reply": 0, 2024-08-20T01:55:32.582 INFO:teuthology.orchestra.run.smithi081.stdout: "forward": 94, 2024-08-20T01:55:32.582 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_complete": 0, 2024-08-20T01:55:32.582 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_keys": 0, 2024-08-20T01:55:32.582 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_commit": 11, 2024-08-20T01:55:32.582 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_split": 0, 2024-08-20T01:55:32.582 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_merge": 0, 2024-08-20T01:55:32.582 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes": 22, 2024-08-20T01:55:32.582 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_top": 4, 2024-08-20T01:55:32.582 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_bottom": 8, 2024-08-20T01:55:32.582 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pin_tail": 10, 2024-08-20T01:55:32.582 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pinned": 13, 2024-08-20T01:55:32.582 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_expired": 255, 2024-08-20T01:55:32.582 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_with_caps": 0, 2024-08-20T01:55:32.583 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": 0, 2024-08-20T01:55:32.583 INFO:teuthology.orchestra.run.smithi081.stdout: "subtrees": 5, 2024-08-20T01:55:32.583 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse": 1063, 2024-08-20T01:55:32.583 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_hit": 852, 2024-08-20T01:55:32.583 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_forward": 88, 2024-08-20T01:55:32.583 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_discover": 82, 2024-08-20T01:55:32.583 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_dir_fetch": 0, 2024-08-20T01:55:32.583 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_remote_ino": 0, 2024-08-20T01:55:32.583 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_lock": 0, 2024-08-20T01:55:32.583 INFO:teuthology.orchestra.run.smithi081.stdout: "load_cent": 0, 2024-08-20T01:55:32.583 INFO:teuthology.orchestra.run.smithi081.stdout: "q": 0, 2024-08-20T01:55:32.583 INFO:teuthology.orchestra.run.smithi081.stdout: "exported": 4, 2024-08-20T01:55:32.583 INFO:teuthology.orchestra.run.smithi081.stdout: "exported_inodes": 120, 2024-08-20T01:55:32.584 INFO:teuthology.orchestra.run.smithi081.stdout: "imported": 9, 2024-08-20T01:55:32.584 INFO:teuthology.orchestra.run.smithi081.stdout: "imported_inodes": 150, 2024-08-20T01:55:32.584 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_dir_fetch": 0, 2024-08-20T01:55:32.584 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_backtrace_fetch": 637, 2024-08-20T01:55:32.584 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_peer_discover": 0, 2024-08-20T01:55:32.584 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rfiles": 4, 2024-08-20T01:55:32.584 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rbytes": 234, 2024-08-20T01:55:32.584 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rsnaps": 0, 2024-08-20T01:55:32.584 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_fetch": 637, 2024-08-20T01:55:32.584 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_set_tag": 0, 2024-08-20T01:55:32.584 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_repaired": 0, 2024-08-20T01:55:32.584 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_inotable_repaired": 0, 2024-08-20T01:55:32.584 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_inodes": 73, 2024-08-20T01:55:32.584 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_base_inodes": 0, 2024-08-20T01:55:32.585 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dirfrag_rstats": 73, 2024-08-20T01:55:32.585 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_file_inodes": 564, 2024-08-20T01:55:32.585 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_inode_file_caps": 20, 2024-08-20T01:55:32.585 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_revoke": 53, 2024-08-20T01:55:32.585 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_grant": 389, 2024-08-20T01:55:32.585 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_trunc": 0, 2024-08-20T01:55:32.585 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-20T01:55:32.585 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-20T01:55:32.585 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps": 655, 2024-08-20T01:55:32.585 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps_dirty": 371, 2024-08-20T01:55:32.585 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_cap_release": 18, 2024-08-20T01:55:32.585 INFO:teuthology.orchestra.run.smithi081.stdout: "process_request_cap_release": 60 2024-08-20T01:55:32.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.586 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cache": { 2024-08-20T01:55:32.586 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update": 6, 2024-08-20T01:55:32.586 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update_receipt": 269, 2024-08-20T01:55:32.586 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_try_discover": 175, 2024-08-20T01:55:32.586 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_send_discover": 198, 2024-08-20T01:55:32.586 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_handle_discover": 55, 2024-08-20T01:55:32.586 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays": 0, 2024-08-20T01:55:32.586 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_delayed": 0, 2024-08-20T01:55:32.586 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_enqueuing": 0, 2024-08-20T01:55:32.586 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_created": 28, 2024-08-20T01:55:32.586 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_enqueued": 28, 2024-08-20T01:55:32.586 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_reintegrated": 0, 2024-08-20T01:55:32.586 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_migrated": 0, 2024-08-20T01:55:32.586 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_processing": 0, 2024-08-20T01:55:32.587 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_enqueued": 0, 2024-08-20T01:55:32.587 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_prioritized": 0, 2024-08-20T01:55:32.587 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_started": 0, 2024-08-20T01:55:32.587 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_completed": 0, 2024-08-20T01:55:32.587 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_quiesce_path": 0, 2024-08-20T01:55:32.587 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_quiesce_inode": 0, 2024-08-20T01:55:32.587 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_enqueue_scrub": 0, 2024-08-20T01:55:32.587 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_exportdir": 4, 2024-08-20T01:55:32.587 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_flush": 0, 2024-08-20T01:55:32.587 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragmentdir": 0, 2024-08-20T01:55:32.587 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragstats": 0, 2024-08-20T01:55:32.587 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_inodestats": 0 2024-08-20T01:55:32.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.588 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_log": { 2024-08-20T01:55:32.588 INFO:teuthology.orchestra.run.smithi081.stdout: "evlrg": 0, 2024-08-20T01:55:32.588 INFO:teuthology.orchestra.run.smithi081.stdout: "evadd": 906, 2024-08-20T01:55:32.588 INFO:teuthology.orchestra.run.smithi081.stdout: "evex": 0, 2024-08-20T01:55:32.588 INFO:teuthology.orchestra.run.smithi081.stdout: "evtrm": 0, 2024-08-20T01:55:32.588 INFO:teuthology.orchestra.run.smithi081.stdout: "ev": 906, 2024-08-20T01:55:32.588 INFO:teuthology.orchestra.run.smithi081.stdout: "evexg": 0, 2024-08-20T01:55:32.588 INFO:teuthology.orchestra.run.smithi081.stdout: "evexd": 0, 2024-08-20T01:55:32.588 INFO:teuthology.orchestra.run.smithi081.stdout: "segadd": 2, 2024-08-20T01:55:32.588 INFO:teuthology.orchestra.run.smithi081.stdout: "segex": 0, 2024-08-20T01:55:32.588 INFO:teuthology.orchestra.run.smithi081.stdout: "segtrm": 0, 2024-08-20T01:55:32.588 INFO:teuthology.orchestra.run.smithi081.stdout: "seg": 2, 2024-08-20T01:55:32.588 INFO:teuthology.orchestra.run.smithi081.stdout: "segmjr": 2, 2024-08-20T01:55:32.589 INFO:teuthology.orchestra.run.smithi081.stdout: "segexg": 0, 2024-08-20T01:55:32.589 INFO:teuthology.orchestra.run.smithi081.stdout: "segexd": 0, 2024-08-20T01:55:32.589 INFO:teuthology.orchestra.run.smithi081.stdout: "expos": 4194304, 2024-08-20T01:55:32.589 INFO:teuthology.orchestra.run.smithi081.stdout: "wrpos": 5462460, 2024-08-20T01:55:32.589 INFO:teuthology.orchestra.run.smithi081.stdout: "rdpos": 0, 2024-08-20T01:55:32.589 INFO:teuthology.orchestra.run.smithi081.stdout: "jlat": { 2024-08-20T01:55:32.589 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 423, 2024-08-20T01:55:32.589 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 344.795567293, 2024-08-20T01:55:32.589 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.815119544 2024-08-20T01:55:32.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.589 INFO:teuthology.orchestra.run.smithi081.stdout: "replayed": 0 2024-08-20T01:55:32.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.589 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_mem": { 2024-08-20T01:55:32.589 INFO:teuthology.orchestra.run.smithi081.stdout: "ino": 28, 2024-08-20T01:55:32.590 INFO:teuthology.orchestra.run.smithi081.stdout: "ino+": 244, 2024-08-20T01:55:32.590 INFO:teuthology.orchestra.run.smithi081.stdout: "ino-": 216, 2024-08-20T01:55:32.590 INFO:teuthology.orchestra.run.smithi081.stdout: "dir": 26, 2024-08-20T01:55:32.590 INFO:teuthology.orchestra.run.smithi081.stdout: "dir+": 135, 2024-08-20T01:55:32.590 INFO:teuthology.orchestra.run.smithi081.stdout: "dir-": 109, 2024-08-20T01:55:32.590 INFO:teuthology.orchestra.run.smithi081.stdout: "dn": 22, 2024-08-20T01:55:32.590 INFO:teuthology.orchestra.run.smithi081.stdout: "dn+": 337, 2024-08-20T01:55:32.590 INFO:teuthology.orchestra.run.smithi081.stdout: "dn-": 315, 2024-08-20T01:55:32.590 INFO:teuthology.orchestra.run.smithi081.stdout: "cap": 0, 2024-08-20T01:55:32.590 INFO:teuthology.orchestra.run.smithi081.stdout: "cap+": 158, 2024-08-20T01:55:32.590 INFO:teuthology.orchestra.run.smithi081.stdout: "cap-": 158, 2024-08-20T01:55:32.590 INFO:teuthology.orchestra.run.smithi081.stdout: "rss": 56036, 2024-08-20T01:55:32.590 INFO:teuthology.orchestra.run.smithi081.stdout: "heap": 262926336 2024-08-20T01:55:32.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.591 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_server": { 2024-08-20T01:55:32.591 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_client_request": 701, 2024-08-20T01:55:32.591 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_server_request": 27, 2024-08-20T01:55:32.591 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_request": 626, 2024-08-20T01:55:32.591 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_session": 16, 2024-08-20T01:55:32.591 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_peer_request": 104, 2024-08-20T01:55:32.591 INFO:teuthology.orchestra.run.smithi081.stdout: "req_create_latency": { 2024-08-20T01:55:32.591 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 2, 2024-08-20T01:55:32.591 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.007324938, 2024-08-20T01:55:32.591 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.003662469 2024-08-20T01:55:32.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.591 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getattr_latency": { 2024-08-20T01:55:32.591 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 79, 2024-08-20T01:55:32.591 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.018664440, 2024-08-20T01:55:32.592 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000236258 2024-08-20T01:55:32.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.592 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getfilelock_latency": { 2024-08-20T01:55:32.592 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:32.592 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:32.592 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:32.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.592 INFO:teuthology.orchestra.run.smithi081.stdout: "req_link_latency": { 2024-08-20T01:55:32.592 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:32.592 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:32.592 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:32.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.592 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookup_latency": { 2024-08-20T01:55:32.593 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 161, 2024-08-20T01:55:32.593 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 31.105127333, 2024-08-20T01:55:32.593 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.193199548 2024-08-20T01:55:32.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.593 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookuphash_latency": { 2024-08-20T01:55:32.593 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:32.593 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:32.593 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:32.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.593 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupino_latency": { 2024-08-20T01:55:32.593 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:32.593 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:32.593 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:32.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.594 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupname_latency": { 2024-08-20T01:55:32.594 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:32.594 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:32.594 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:32.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.594 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupparent_latency": { 2024-08-20T01:55:32.594 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:32.594 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:32.594 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:32.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.594 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupsnap_latency": { 2024-08-20T01:55:32.594 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:32.595 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:32.595 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:32.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.595 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lssnap_latency": { 2024-08-20T01:55:32.595 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:32.595 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:32.595 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:32.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.596 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mkdir_latency": { 2024-08-20T01:55:32.596 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:32.596 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:32.596 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:32.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.596 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mknod_latency": { 2024-08-20T01:55:32.596 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:32.596 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:32.596 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:32.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.596 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mksnap_latency": { 2024-08-20T01:55:32.596 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:32.596 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:32.596 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:32.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.597 INFO:teuthology.orchestra.run.smithi081.stdout: "req_open_latency": { 2024-08-20T01:55:32.597 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 260, 2024-08-20T01:55:32.597 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.171407119, 2024-08-20T01:55:32.597 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000659258 2024-08-20T01:55:32.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.597 INFO:teuthology.orchestra.run.smithi081.stdout: "req_readdir_latency": { 2024-08-20T01:55:32.597 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 2, 2024-08-20T01:55:32.597 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.001150102, 2024-08-20T01:55:32.597 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000575051 2024-08-20T01:55:32.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.597 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rename_latency": { 2024-08-20T01:55:32.597 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:32.598 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:32.598 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:32.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.598 INFO:teuthology.orchestra.run.smithi081.stdout: "req_renamesnap_latency": { 2024-08-20T01:55:32.598 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:32.598 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:32.598 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:32.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.598 INFO:teuthology.orchestra.run.smithi081.stdout: "req_snapdiff_latency": { 2024-08-20T01:55:32.598 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:32.598 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:32.598 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:32.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.599 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmdir_latency": { 2024-08-20T01:55:32.599 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 6, 2024-08-20T01:55:32.599 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 41.900147675, 2024-08-20T01:55:32.599 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 6.983357945 2024-08-20T01:55:32.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.599 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmsnap_latency": { 2024-08-20T01:55:32.599 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:32.599 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:32.599 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:32.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.599 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmxattr_latency": { 2024-08-20T01:55:32.599 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:32.599 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:32.599 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:32.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.600 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setattr_latency": { 2024-08-20T01:55:32.600 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:32.600 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:32.600 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:32.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.600 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setdirlayout_latency": { 2024-08-20T01:55:32.600 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:32.600 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:32.600 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:32.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.600 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setfilelock_latency": { 2024-08-20T01:55:32.600 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:32.601 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:32.601 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:32.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.601 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setlayout_latency": { 2024-08-20T01:55:32.601 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:32.601 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:32.601 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:32.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.601 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setxattr_latency": { 2024-08-20T01:55:32.601 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:32.601 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:32.601 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:32.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.602 INFO:teuthology.orchestra.run.smithi081.stdout: "req_symlink_latency": { 2024-08-20T01:55:32.602 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:32.602 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:32.602 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:32.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.602 INFO:teuthology.orchestra.run.smithi081.stdout: "req_unlink_latency": { 2024-08-20T01:55:32.602 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 22, 2024-08-20T01:55:32.602 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.024651997, 2024-08-20T01:55:32.602 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.001120545 2024-08-20T01:55:32.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.602 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_revoke_eviction": 0, 2024-08-20T01:55:32.602 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_acquisition_throttle": 0, 2024-08-20T01:55:32.602 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getvxattr_latency": { 2024-08-20T01:55:32.603 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:32.603 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:32.603 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:32.603 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-08-20T01:55:32.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.603 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_sessions": { 2024-08-20T01:55:32.603 INFO:teuthology.orchestra.run.smithi081.stdout: "session_count": 1, 2024-08-20T01:55:32.603 INFO:teuthology.orchestra.run.smithi081.stdout: "session_add": 1, 2024-08-20T01:55:32.603 INFO:teuthology.orchestra.run.smithi081.stdout: "session_remove": 0, 2024-08-20T01:55:32.603 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_open": 1, 2024-08-20T01:55:32.603 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_stale": 0, 2024-08-20T01:55:32.603 INFO:teuthology.orchestra.run.smithi081.stdout: "total_load": 52, 2024-08-20T01:55:32.604 INFO:teuthology.orchestra.run.smithi081.stdout: "average_load": 52, 2024-08-20T01:55:32.604 INFO:teuthology.orchestra.run.smithi081.stdout: "avg_session_uptime": 1122, 2024-08-20T01:55:32.604 INFO:teuthology.orchestra.run.smithi081.stdout: "mdthresh_evicted": 0 2024-08-20T01:55:32.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.604 INFO:teuthology.orchestra.run.smithi081.stdout: "mempool": { 2024-08-20T01:55:32.604 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_bytes": 0, 2024-08-20T01:55:32.604 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_items": 0, 2024-08-20T01:55:32.604 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_bytes": 0, 2024-08-20T01:55:32.604 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_items": 0, 2024-08-20T01:55:32.604 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_bytes": 0, 2024-08-20T01:55:32.604 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_items": 0, 2024-08-20T01:55:32.604 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-20T01:55:32.604 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_items": 0, 2024-08-20T01:55:32.604 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-20T01:55:32.605 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_items": 0, 2024-08-20T01:55:32.605 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_bytes": 0, 2024-08-20T01:55:32.605 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_items": 0, 2024-08-20T01:55:32.605 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-20T01:55:32.605 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_items": 0, 2024-08-20T01:55:32.605 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_bytes": 0, 2024-08-20T01:55:32.605 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_items": 0, 2024-08-20T01:55:32.605 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_bytes": 0, 2024-08-20T01:55:32.605 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_items": 0, 2024-08-20T01:55:32.605 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-20T01:55:32.605 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_items": 0, 2024-08-20T01:55:32.605 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-20T01:55:32.605 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_items": 0, 2024-08-20T01:55:32.605 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_bytes": 0, 2024-08-20T01:55:32.606 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_items": 0, 2024-08-20T01:55:32.606 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_bytes": 0, 2024-08-20T01:55:32.606 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_items": 0, 2024-08-20T01:55:32.606 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-20T01:55:32.606 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_items": 0, 2024-08-20T01:55:32.606 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_bytes": 0, 2024-08-20T01:55:32.606 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_items": 0, 2024-08-20T01:55:32.606 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_bytes": 0, 2024-08-20T01:55:32.606 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_items": 0, 2024-08-20T01:55:32.606 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_bytes": 0, 2024-08-20T01:55:32.606 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_items": 0, 2024-08-20T01:55:32.606 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_bytes": 0, 2024-08-20T01:55:32.606 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_items": 0, 2024-08-20T01:55:32.607 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_bytes": 285380, 2024-08-20T01:55:32.607 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_items": 106, 2024-08-20T01:55:32.607 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_bytes": 0, 2024-08-20T01:55:32.607 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_items": 0, 2024-08-20T01:55:32.607 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bytes": 0, 2024-08-20T01:55:32.607 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_items": 0, 2024-08-20T01:55:32.607 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_bytes": 0, 2024-08-20T01:55:32.607 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_items": 0, 2024-08-20T01:55:32.607 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_bytes": 0, 2024-08-20T01:55:32.607 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_items": 0, 2024-08-20T01:55:32.607 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_bytes": 7496, 2024-08-20T01:55:32.607 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_items": 154, 2024-08-20T01:55:32.607 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_bytes": 0, 2024-08-20T01:55:32.607 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_items": 0, 2024-08-20T01:55:32.608 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_bytes": 0, 2024-08-20T01:55:32.608 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_items": 0, 2024-08-20T01:55:32.608 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_bytes": 112301, 2024-08-20T01:55:32.608 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_items": 482, 2024-08-20T01:55:32.608 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_bytes": 0, 2024-08-20T01:55:32.608 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_items": 0, 2024-08-20T01:55:32.608 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_bytes": 0, 2024-08-20T01:55:32.608 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_items": 0 2024-08-20T01:55:32.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.608 INFO:teuthology.orchestra.run.smithi081.stdout: "objecter": { 2024-08-20T01:55:32.608 INFO:teuthology.orchestra.run.smithi081.stdout: "op_active": 0, 2024-08-20T01:55:32.608 INFO:teuthology.orchestra.run.smithi081.stdout: "op_laggy": 0, 2024-08-20T01:55:32.608 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send": 1892, 2024-08-20T01:55:32.608 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send_bytes": 1327954, 2024-08-20T01:55:32.609 INFO:teuthology.orchestra.run.smithi081.stdout: "op_resend": 33, 2024-08-20T01:55:32.609 INFO:teuthology.orchestra.run.smithi081.stdout: "op_reply": 1892, 2024-08-20T01:55:32.609 INFO:teuthology.orchestra.run.smithi081.stdout: "op_latency": { 2024-08-20T01:55:32.609 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 1892, 2024-08-20T01:55:32.609 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 2301.808031652, 2024-08-20T01:55:32.609 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 1.216600439 2024-08-20T01:55:32.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.609 INFO:teuthology.orchestra.run.smithi081.stdout: "op_inflight": 0, 2024-08-20T01:55:32.609 INFO:teuthology.orchestra.run.smithi081.stdout: "oplen_avg": { 2024-08-20T01:55:32.609 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 1892, 2024-08-20T01:55:32.609 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 2280 2024-08-20T01:55:32.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.609 INFO:teuthology.orchestra.run.smithi081.stdout: "op": 1892, 2024-08-20T01:55:32.610 INFO:teuthology.orchestra.run.smithi081.stdout: "op_r": 642, 2024-08-20T01:55:32.610 INFO:teuthology.orchestra.run.smithi081.stdout: "op_w": 1250, 2024-08-20T01:55:32.610 INFO:teuthology.orchestra.run.smithi081.stdout: "op_rmw": 0, 2024-08-20T01:55:32.610 INFO:teuthology.orchestra.run.smithi081.stdout: "op_pg": 0, 2024-08-20T01:55:32.610 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_stat": 0, 2024-08-20T01:55:32.610 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_create": 10, 2024-08-20T01:55:32.610 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_read": 5, 2024-08-20T01:55:32.610 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_write": 429, 2024-08-20T01:55:32.610 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writefull": 56, 2024-08-20T01:55:32.610 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writesame": 0, 2024-08-20T01:55:32.610 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_append": 0, 2024-08-20T01:55:32.610 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_zero": 0, 2024-08-20T01:55:32.610 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_truncate": 0, 2024-08-20T01:55:32.610 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_delete": 472, 2024-08-20T01:55:32.611 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_mapext": 0, 2024-08-20T01:55:32.611 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_sparse_read": 0, 2024-08-20T01:55:32.611 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_clonerange": 0, 2024-08-20T01:55:32.611 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_getxattr": 637, 2024-08-20T01:55:32.611 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_setxattr": 20, 2024-08-20T01:55:32.611 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_cmpxattr": 0, 2024-08-20T01:55:32.611 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_rmxattr": 0, 2024-08-20T01:55:32.611 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_resetxattrs": 0, 2024-08-20T01:55:32.611 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_call": 0, 2024-08-20T01:55:32.611 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_watch": 0, 2024-08-20T01:55:32.611 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_notify": 0, 2024-08-20T01:55:32.611 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_src_cmpxattr": 0, 2024-08-20T01:55:32.611 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls": 0, 2024-08-20T01:55:32.611 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls_filter": 0, 2024-08-20T01:55:32.612 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_other": 0, 2024-08-20T01:55:32.612 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_active": 0, 2024-08-20T01:55:32.612 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_send": 0, 2024-08-20T01:55:32.612 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_resend": 0, 2024-08-20T01:55:32.612 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_ping": 0, 2024-08-20T01:55:32.612 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_active": 0, 2024-08-20T01:55:32.612 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_send": 0, 2024-08-20T01:55:32.612 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_resend": 0, 2024-08-20T01:55:32.612 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_active": 0, 2024-08-20T01:55:32.612 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_send": 0, 2024-08-20T01:55:32.612 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_resend": 0, 2024-08-20T01:55:32.612 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_active": 0, 2024-08-20T01:55:32.612 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_send": 0, 2024-08-20T01:55:32.613 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_resend": 0, 2024-08-20T01:55:32.613 INFO:teuthology.orchestra.run.smithi081.stdout: "command_active": 0, 2024-08-20T01:55:32.613 INFO:teuthology.orchestra.run.smithi081.stdout: "command_send": 0, 2024-08-20T01:55:32.613 INFO:teuthology.orchestra.run.smithi081.stdout: "command_resend": 0, 2024-08-20T01:55:32.613 INFO:teuthology.orchestra.run.smithi081.stdout: "map_epoch": 74, 2024-08-20T01:55:32.613 INFO:teuthology.orchestra.run.smithi081.stdout: "map_full": 0, 2024-08-20T01:55:32.613 INFO:teuthology.orchestra.run.smithi081.stdout: "map_inc": 2, 2024-08-20T01:55:32.613 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_sessions": 12, 2024-08-20T01:55:32.613 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_open": 12, 2024-08-20T01:55:32.613 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_close": 0, 2024-08-20T01:55:32.613 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_laggy": 0, 2024-08-20T01:55:32.613 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_wr": 473, 2024-08-20T01:55:32.613 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_rd": 0, 2024-08-20T01:55:32.614 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_del": 178 2024-08-20T01:55:32.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.614 INFO:teuthology.orchestra.run.smithi081.stdout: "oft": { 2024-08-20T01:55:32.614 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_objs": 1, 2024-08-20T01:55:32.614 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_kv_pairs": 0, 2024-08-20T01:55:32.614 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_updates": 0, 2024-08-20T01:55:32.614 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_removes": 0 2024-08-20T01:55:32.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.614 INFO:teuthology.orchestra.run.smithi081.stdout: "purge_queue": { 2024-08-20T01:55:32.614 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops": 0, 2024-08-20T01:55:32.614 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops_high_water": 25, 2024-08-20T01:55:32.614 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing": 0, 2024-08-20T01:55:32.614 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_high_water": 6, 2024-08-20T01:55:32.614 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executed_ops": 460, 2024-08-20T01:55:32.615 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executed": 28, 2024-08-20T01:55:32.615 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_item_in_journal": 0 2024-08-20T01:55:32.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.615 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-20T01:55:32.615 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-08-20T01:55:32.615 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-08-20T01:55:32.615 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-08-20T01:55:32.615 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 9548, 2024-08-20T01:55:32.615 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 3857240, 2024-08-20T01:55:32.615 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:32.615 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 9548, 2024-08-20T01:55:32.615 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-08-20T01:55:32.615 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-08-20T01:55:32.615 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 9548, 2024-08-20T01:55:32.616 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 3857240, 2024-08-20T01:55:32.616 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-08-20T01:55:32.616 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:32.616 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:32.616 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:32.616 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-08-20T01:55:32.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.616 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_bytes": { 2024-08-20T01:55:32.616 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-08-20T01:55:32.616 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-08-20T01:55:32.616 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-08-20T01:55:32.616 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-08-20T01:55:32.616 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-08-20T01:55:32.617 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:32.617 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-08-20T01:55:32.617 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 1892, 2024-08-20T01:55:32.617 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 1330782, 2024-08-20T01:55:32.617 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 1892, 2024-08-20T01:55:32.617 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 1330782, 2024-08-20T01:55:32.617 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-08-20T01:55:32.617 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:32.617 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:32.617 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:32.617 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-08-20T01:55:32.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.617 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_ops": { 2024-08-20T01:55:32.617 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-08-20T01:55:32.618 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 1024, 2024-08-20T01:55:32.618 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-08-20T01:55:32.618 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-08-20T01:55:32.618 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-08-20T01:55:32.618 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:32.618 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-08-20T01:55:32.618 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 1892, 2024-08-20T01:55:32.618 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 1892, 2024-08-20T01:55:32.618 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 1892, 2024-08-20T01:55:32.618 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 1892, 2024-08-20T01:55:32.618 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-08-20T01:55:32.618 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:32.619 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:32.619 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:32.619 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-08-20T01:55:32.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.619 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle": { 2024-08-20T01:55:32.619 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-08-20T01:55:32.619 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2024-08-20T01:55:32.619 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-08-20T01:55:32.619 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 28, 2024-08-20T01:55:32.619 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 2828, 2024-08-20T01:55:32.619 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:32.619 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 28, 2024-08-20T01:55:32.619 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-08-20T01:55:32.619 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-08-20T01:55:32.620 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 6, 2024-08-20T01:55:32.620 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 2828, 2024-08-20T01:55:32.620 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-08-20T01:55:32.620 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:32.620 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:32.620 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:32.620 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-08-20T01:55:32.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.620 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle-0x55a933a186e0": { 2024-08-20T01:55:32.620 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-08-20T01:55:32.620 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2024-08-20T01:55:32.620 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-08-20T01:55:32.620 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 906, 2024-08-20T01:55:32.620 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 1268156, 2024-08-20T01:55:32.621 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:32.621 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 906, 2024-08-20T01:55:32.621 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-08-20T01:55:32.621 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-08-20T01:55:32.621 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 423, 2024-08-20T01:55:32.621 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 1268156, 2024-08-20T01:55:32.621 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-08-20T01:55:32.621 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:32.621 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:32.621 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:32.621 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-08-20T01:55:32.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:32.621 INFO:teuthology.orchestra.run.smithi081.stdout: "trackedop": { 2024-08-20T01:55:32.622 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_ops_count": 10 2024-08-20T01:55:32.622 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-08-20T01:55:32.622 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-08-20T01:55:32.622 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:32 smithi081 ceph-mon[22209]: pgmap v893: 97 pgs: 97 active+clean; 2.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 20 op/s 2024-08-20T01:55:32.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:32 smithi175 ceph-mon[22392]: pgmap v893: 97 pgs: 97 active+clean; 2.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 20 op/s 2024-08-20T01:55:32.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:32 smithi079 ceph-mon[18656]: pgmap v893: 97 pgs: 97 active+clean; 2.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 20 op/s 2024-08-20T01:55:33.372 INFO:tasks.check_counter:Daemon mds.h mds.exported=4 2024-08-20T01:55:33.372 INFO:tasks.check_counter:Daemon mds.h mds.imported=9 2024-08-20T01:55:33.372 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=6 2024-08-20T01:55:33.372 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=269 2024-08-20T01:55:33.372 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=0 2024-08-20T01:55:33.372 DEBUG:tasks.check_counter:Getting stats from k 2024-08-20T01:55:33.372 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph daemon mds.k perf dump 2024-08-20T01:55:33.627 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.b/config 2024-08-20T01:55:34.199 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-08-20T01:55:34.200 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-0": { 2024-08-20T01:55:34.200 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 1372, 2024-08-20T01:55:34.200 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 1374, 2024-08-20T01:55:34.200 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 1190186, 2024-08-20T01:55:34.200 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 436360, 2024-08-20T01:55:34.200 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 6, 2024-08-20T01:55:34.200 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 2, 2024-08-20T01:55:34.200 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.125002912, 2024-08-20T01:55:34.200 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.062512425, 2024-08-20T01:55:34.200 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.025664580, 2024-08-20T01:55:34.200 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.026815010, 2024-08-20T01:55:34.201 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:55:34.201 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 1372, 2024-08-20T01:55:34.201 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.042321588, 2024-08-20T01:55:34.201 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000030846 2024-08-20T01:55:34.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.201 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:55:34.201 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:34.201 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:34.201 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:34.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.201 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-20T01:55:34.201 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 0 2024-08-20T01:55:34.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.202 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-1": { 2024-08-20T01:55:34.202 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 1092, 2024-08-20T01:55:34.202 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 1350, 2024-08-20T01:55:34.202 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 268568, 2024-08-20T01:55:34.202 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 879263, 2024-08-20T01:55:34.202 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 5, 2024-08-20T01:55:34.202 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 4, 2024-08-20T01:55:34.202 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.113938844, 2024-08-20T01:55:34.202 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.054602746, 2024-08-20T01:55:34.202 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.019191366, 2024-08-20T01:55:34.202 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.030709422, 2024-08-20T01:55:34.202 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:55:34.203 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 1348, 2024-08-20T01:55:34.203 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.045303025, 2024-08-20T01:55:34.203 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000033607 2024-08-20T01:55:34.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.203 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:55:34.203 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:34.203 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:34.203 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:34.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.203 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-20T01:55:34.203 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 532320 2024-08-20T01:55:34.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.203 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-2": { 2024-08-20T01:55:34.204 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 1587, 2024-08-20T01:55:34.204 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 1538, 2024-08-20T01:55:34.204 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 1269776, 2024-08-20T01:55:34.204 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 589910, 2024-08-20T01:55:34.204 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 3, 2024-08-20T01:55:34.204 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 2, 2024-08-20T01:55:34.204 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.197154733, 2024-08-20T01:55:34.204 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.090644648, 2024-08-20T01:55:34.204 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.064048103, 2024-08-20T01:55:34.204 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.038171952, 2024-08-20T01:55:34.204 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:55:34.204 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 1538, 2024-08-20T01:55:34.204 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.078823286, 2024-08-20T01:55:34.205 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000051250 2024-08-20T01:55:34.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.205 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:55:34.205 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:34.205 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:34.205 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:34.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.205 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 870272, 2024-08-20T01:55:34.205 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 211808 2024-08-20T01:55:34.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.205 INFO:teuthology.orchestra.run.smithi081.stdout: "cct": { 2024-08-20T01:55:34.205 INFO:teuthology.orchestra.run.smithi081.stdout: "total_workers": 1, 2024-08-20T01:55:34.206 INFO:teuthology.orchestra.run.smithi081.stdout: "unhealthy_workers": 0 2024-08-20T01:55:34.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.206 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-MDSRank": { 2024-08-20T01:55:34.206 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2024-08-20T01:55:34.206 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2024-08-20T01:55:34.206 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 6073, 2024-08-20T01:55:34.206 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.148283675, 2024-08-20T01:55:34.206 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000024416 2024-08-20T01:55:34.206 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-08-20T01:55:34.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.206 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-PurgeQueue": { 2024-08-20T01:55:34.206 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2024-08-20T01:55:34.207 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2024-08-20T01:55:34.207 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:34.207 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:34.207 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:34.207 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-08-20T01:55:34.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.207 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-08-20T01:55:34.207 INFO:teuthology.orchestra.run.smithi081.stdout: "request": 0, 2024-08-20T01:55:34.207 INFO:teuthology.orchestra.run.smithi081.stdout: "reply": 0, 2024-08-20T01:55:34.207 INFO:teuthology.orchestra.run.smithi081.stdout: "reply_latency": { 2024-08-20T01:55:34.207 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:34.207 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:34.208 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:34.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.208 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_reply": 0, 2024-08-20T01:55:34.208 INFO:teuthology.orchestra.run.smithi081.stdout: "forward": 0, 2024-08-20T01:55:34.208 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_complete": 0, 2024-08-20T01:55:34.208 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_keys": 0, 2024-08-20T01:55:34.208 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_commit": 0, 2024-08-20T01:55:34.208 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_split": 0, 2024-08-20T01:55:34.208 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_merge": 0, 2024-08-20T01:55:34.208 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes": 60, 2024-08-20T01:55:34.208 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_top": 0, 2024-08-20T01:55:34.208 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_bottom": 60, 2024-08-20T01:55:34.209 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pin_tail": 0, 2024-08-20T01:55:34.209 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pinned": 59, 2024-08-20T01:55:34.209 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_expired": 0, 2024-08-20T01:55:34.209 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_with_caps": 0, 2024-08-20T01:55:34.209 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": 0, 2024-08-20T01:55:34.209 INFO:teuthology.orchestra.run.smithi081.stdout: "subtrees": 3, 2024-08-20T01:55:34.209 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse": 0, 2024-08-20T01:55:34.209 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_hit": 0, 2024-08-20T01:55:34.209 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_forward": 0, 2024-08-20T01:55:34.209 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_discover": 0, 2024-08-20T01:55:34.209 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_dir_fetch": 0, 2024-08-20T01:55:34.209 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_remote_ino": 0, 2024-08-20T01:55:34.209 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_lock": 0, 2024-08-20T01:55:34.210 INFO:teuthology.orchestra.run.smithi081.stdout: "load_cent": 0, 2024-08-20T01:55:34.210 INFO:teuthology.orchestra.run.smithi081.stdout: "q": 0, 2024-08-20T01:55:34.210 INFO:teuthology.orchestra.run.smithi081.stdout: "exported": 0, 2024-08-20T01:55:34.210 INFO:teuthology.orchestra.run.smithi081.stdout: "exported_inodes": 0, 2024-08-20T01:55:34.210 INFO:teuthology.orchestra.run.smithi081.stdout: "imported": 0, 2024-08-20T01:55:34.210 INFO:teuthology.orchestra.run.smithi081.stdout: "imported_inodes": 0, 2024-08-20T01:55:34.210 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_dir_fetch": 0, 2024-08-20T01:55:34.210 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_backtrace_fetch": 0, 2024-08-20T01:55:34.210 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_peer_discover": 0, 2024-08-20T01:55:34.210 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rfiles": 0, 2024-08-20T01:55:34.210 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rbytes": 0, 2024-08-20T01:55:34.210 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rsnaps": 0, 2024-08-20T01:55:34.210 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_fetch": 0, 2024-08-20T01:55:34.210 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_set_tag": 0, 2024-08-20T01:55:34.211 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_repaired": 0, 2024-08-20T01:55:34.211 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_inotable_repaired": 0, 2024-08-20T01:55:34.211 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_inodes": 0, 2024-08-20T01:55:34.211 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_base_inodes": 0, 2024-08-20T01:55:34.211 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dirfrag_rstats": 0, 2024-08-20T01:55:34.211 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_file_inodes": 0, 2024-08-20T01:55:34.211 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_inode_file_caps": 0, 2024-08-20T01:55:34.211 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_revoke": 0, 2024-08-20T01:55:34.211 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_grant": 0, 2024-08-20T01:55:34.211 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_trunc": 0, 2024-08-20T01:55:34.211 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-20T01:55:34.211 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-20T01:55:34.211 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps": 0, 2024-08-20T01:55:34.212 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps_dirty": 0, 2024-08-20T01:55:34.212 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_cap_release": 0, 2024-08-20T01:55:34.212 INFO:teuthology.orchestra.run.smithi081.stdout: "process_request_cap_release": 0 2024-08-20T01:55:34.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.212 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cache": { 2024-08-20T01:55:34.212 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update": 0, 2024-08-20T01:55:34.212 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update_receipt": 0, 2024-08-20T01:55:34.212 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_try_discover": 0, 2024-08-20T01:55:34.212 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_send_discover": 0, 2024-08-20T01:55:34.212 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_handle_discover": 0, 2024-08-20T01:55:34.212 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays": 0, 2024-08-20T01:55:34.212 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_delayed": 0, 2024-08-20T01:55:34.212 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_enqueuing": 0, 2024-08-20T01:55:34.213 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_created": 0, 2024-08-20T01:55:34.213 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_enqueued": 0, 2024-08-20T01:55:34.213 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_reintegrated": 0, 2024-08-20T01:55:34.213 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_migrated": 0, 2024-08-20T01:55:34.213 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_processing": 0, 2024-08-20T01:55:34.213 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_enqueued": 0, 2024-08-20T01:55:34.213 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_prioritized": 0, 2024-08-20T01:55:34.213 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_started": 0, 2024-08-20T01:55:34.213 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_completed": 0, 2024-08-20T01:55:34.213 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_quiesce_path": 0, 2024-08-20T01:55:34.213 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_quiesce_inode": 0, 2024-08-20T01:55:34.213 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_enqueue_scrub": 0, 2024-08-20T01:55:34.213 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_exportdir": 0, 2024-08-20T01:55:34.214 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_flush": 0, 2024-08-20T01:55:34.214 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragmentdir": 0, 2024-08-20T01:55:34.214 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragstats": 0, 2024-08-20T01:55:34.214 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_inodestats": 0 2024-08-20T01:55:34.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.214 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_log": { 2024-08-20T01:55:34.214 INFO:teuthology.orchestra.run.smithi081.stdout: "evlrg": 0, 2024-08-20T01:55:34.214 INFO:teuthology.orchestra.run.smithi081.stdout: "evadd": 0, 2024-08-20T01:55:34.214 INFO:teuthology.orchestra.run.smithi081.stdout: "evex": 0, 2024-08-20T01:55:34.214 INFO:teuthology.orchestra.run.smithi081.stdout: "evtrm": 0, 2024-08-20T01:55:34.214 INFO:teuthology.orchestra.run.smithi081.stdout: "ev": 638, 2024-08-20T01:55:34.214 INFO:teuthology.orchestra.run.smithi081.stdout: "evexg": 0, 2024-08-20T01:55:34.214 INFO:teuthology.orchestra.run.smithi081.stdout: "evexd": 0, 2024-08-20T01:55:34.215 INFO:teuthology.orchestra.run.smithi081.stdout: "segadd": 0, 2024-08-20T01:55:34.215 INFO:teuthology.orchestra.run.smithi081.stdout: "segex": 0, 2024-08-20T01:55:34.215 INFO:teuthology.orchestra.run.smithi081.stdout: "segtrm": 0, 2024-08-20T01:55:34.215 INFO:teuthology.orchestra.run.smithi081.stdout: "seg": 2, 2024-08-20T01:55:34.215 INFO:teuthology.orchestra.run.smithi081.stdout: "segmjr": 2, 2024-08-20T01:55:34.215 INFO:teuthology.orchestra.run.smithi081.stdout: "segexg": 0, 2024-08-20T01:55:34.215 INFO:teuthology.orchestra.run.smithi081.stdout: "segexd": 0, 2024-08-20T01:55:34.215 INFO:teuthology.orchestra.run.smithi081.stdout: "expos": 4194304, 2024-08-20T01:55:34.215 INFO:teuthology.orchestra.run.smithi081.stdout: "wrpos": 5027267, 2024-08-20T01:55:34.215 INFO:teuthology.orchestra.run.smithi081.stdout: "rdpos": 5025036, 2024-08-20T01:55:34.215 INFO:teuthology.orchestra.run.smithi081.stdout: "jlat": { 2024-08-20T01:55:34.215 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:34.215 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:34.215 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:34.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.216 INFO:teuthology.orchestra.run.smithi081.stdout: "replayed": 638 2024-08-20T01:55:34.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.216 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_mem": { 2024-08-20T01:55:34.216 INFO:teuthology.orchestra.run.smithi081.stdout: "ino": 9, 2024-08-20T01:55:34.216 INFO:teuthology.orchestra.run.smithi081.stdout: "ino+": 77, 2024-08-20T01:55:34.216 INFO:teuthology.orchestra.run.smithi081.stdout: "ino-": 68, 2024-08-20T01:55:34.216 INFO:teuthology.orchestra.run.smithi081.stdout: "dir": 7, 2024-08-20T01:55:34.216 INFO:teuthology.orchestra.run.smithi081.stdout: "dir+": 23, 2024-08-20T01:55:34.216 INFO:teuthology.orchestra.run.smithi081.stdout: "dir-": 16, 2024-08-20T01:55:34.216 INFO:teuthology.orchestra.run.smithi081.stdout: "dn": 60, 2024-08-20T01:55:34.216 INFO:teuthology.orchestra.run.smithi081.stdout: "dn+": 132, 2024-08-20T01:55:34.216 INFO:teuthology.orchestra.run.smithi081.stdout: "dn-": 72, 2024-08-20T01:55:34.216 INFO:teuthology.orchestra.run.smithi081.stdout: "cap": 0, 2024-08-20T01:55:34.217 INFO:teuthology.orchestra.run.smithi081.stdout: "cap+": 0, 2024-08-20T01:55:34.217 INFO:teuthology.orchestra.run.smithi081.stdout: "cap-": 0, 2024-08-20T01:55:34.217 INFO:teuthology.orchestra.run.smithi081.stdout: "rss": 52704, 2024-08-20T01:55:34.217 INFO:teuthology.orchestra.run.smithi081.stdout: "heap": 250343424 2024-08-20T01:55:34.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.217 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_server": { 2024-08-20T01:55:34.217 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_client_request": 0, 2024-08-20T01:55:34.217 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_server_request": 0, 2024-08-20T01:55:34.217 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_request": 0, 2024-08-20T01:55:34.217 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_session": 0, 2024-08-20T01:55:34.217 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_peer_request": 0, 2024-08-20T01:55:34.217 INFO:teuthology.orchestra.run.smithi081.stdout: "req_create_latency": { 2024-08-20T01:55:34.217 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:34.217 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:34.218 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:34.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.218 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getattr_latency": { 2024-08-20T01:55:34.218 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:34.218 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:34.218 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:34.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.218 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getfilelock_latency": { 2024-08-20T01:55:34.218 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:34.218 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:34.218 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:34.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.218 INFO:teuthology.orchestra.run.smithi081.stdout: "req_link_latency": { 2024-08-20T01:55:34.219 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:34.219 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:34.219 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:34.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.219 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookup_latency": { 2024-08-20T01:55:34.219 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:34.219 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:34.219 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:34.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.219 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookuphash_latency": { 2024-08-20T01:55:34.219 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:34.219 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:34.219 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:34.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.220 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupino_latency": { 2024-08-20T01:55:34.220 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:34.220 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:34.220 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:34.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.220 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupname_latency": { 2024-08-20T01:55:34.220 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:34.220 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:34.220 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:34.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.220 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupparent_latency": { 2024-08-20T01:55:34.220 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:34.220 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:34.221 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:34.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.221 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupsnap_latency": { 2024-08-20T01:55:34.221 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:34.221 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:34.221 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:34.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.221 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lssnap_latency": { 2024-08-20T01:55:34.221 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:34.221 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:34.221 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:34.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.221 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mkdir_latency": { 2024-08-20T01:55:34.222 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:34.222 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:34.222 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:34.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.222 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mknod_latency": { 2024-08-20T01:55:34.222 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:34.222 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:34.223 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:34.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.223 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mksnap_latency": { 2024-08-20T01:55:34.223 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:34.223 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:34.223 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:34.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.223 INFO:teuthology.orchestra.run.smithi081.stdout: "req_open_latency": { 2024-08-20T01:55:34.223 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:34.223 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:34.223 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:34.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.223 INFO:teuthology.orchestra.run.smithi081.stdout: "req_readdir_latency": { 2024-08-20T01:55:34.223 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:34.224 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:34.224 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:34.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.224 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rename_latency": { 2024-08-20T01:55:34.224 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:34.224 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:34.224 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:34.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.224 INFO:teuthology.orchestra.run.smithi081.stdout: "req_renamesnap_latency": { 2024-08-20T01:55:34.224 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:34.224 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:34.224 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:34.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.224 INFO:teuthology.orchestra.run.smithi081.stdout: "req_snapdiff_latency": { 2024-08-20T01:55:34.225 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:34.225 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:34.225 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:34.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.225 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmdir_latency": { 2024-08-20T01:55:34.225 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:34.225 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:34.225 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:34.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.225 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmsnap_latency": { 2024-08-20T01:55:34.225 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:34.225 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:34.226 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:34.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.226 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmxattr_latency": { 2024-08-20T01:55:34.226 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:34.226 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:34.226 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:34.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.226 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setattr_latency": { 2024-08-20T01:55:34.226 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:34.226 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:34.226 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:34.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.226 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setdirlayout_latency": { 2024-08-20T01:55:34.227 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:34.227 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:34.227 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:34.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.227 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setfilelock_latency": { 2024-08-20T01:55:34.227 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:34.227 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:34.227 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:34.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.227 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setlayout_latency": { 2024-08-20T01:55:34.227 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:34.227 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:34.227 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:34.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.228 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setxattr_latency": { 2024-08-20T01:55:34.228 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:34.228 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:34.228 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:34.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.228 INFO:teuthology.orchestra.run.smithi081.stdout: "req_symlink_latency": { 2024-08-20T01:55:34.228 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:34.228 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:34.228 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:34.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.228 INFO:teuthology.orchestra.run.smithi081.stdout: "req_unlink_latency": { 2024-08-20T01:55:34.228 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:34.228 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:34.228 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:34.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.229 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_revoke_eviction": 0, 2024-08-20T01:55:34.229 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_acquisition_throttle": 0, 2024-08-20T01:55:34.229 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getvxattr_latency": { 2024-08-20T01:55:34.229 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:34.229 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:34.229 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:34.229 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-08-20T01:55:34.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.229 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_sessions": { 2024-08-20T01:55:34.229 INFO:teuthology.orchestra.run.smithi081.stdout: "session_count": 1, 2024-08-20T01:55:34.229 INFO:teuthology.orchestra.run.smithi081.stdout: "session_add": 1, 2024-08-20T01:55:34.229 INFO:teuthology.orchestra.run.smithi081.stdout: "session_remove": 0, 2024-08-20T01:55:34.230 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_open": 1, 2024-08-20T01:55:34.230 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_stale": 0, 2024-08-20T01:55:34.230 INFO:teuthology.orchestra.run.smithi081.stdout: "total_load": 0, 2024-08-20T01:55:34.230 INFO:teuthology.orchestra.run.smithi081.stdout: "average_load": 0, 2024-08-20T01:55:34.230 INFO:teuthology.orchestra.run.smithi081.stdout: "avg_session_uptime": 2107, 2024-08-20T01:55:34.230 INFO:teuthology.orchestra.run.smithi081.stdout: "mdthresh_evicted": 0 2024-08-20T01:55:34.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.230 INFO:teuthology.orchestra.run.smithi081.stdout: "mempool": { 2024-08-20T01:55:34.230 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_bytes": 0, 2024-08-20T01:55:34.230 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_items": 0, 2024-08-20T01:55:34.230 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_bytes": 0, 2024-08-20T01:55:34.230 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_items": 0, 2024-08-20T01:55:34.230 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_bytes": 0, 2024-08-20T01:55:34.231 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_items": 0, 2024-08-20T01:55:34.231 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-20T01:55:34.231 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_items": 0, 2024-08-20T01:55:34.231 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-20T01:55:34.231 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_items": 0, 2024-08-20T01:55:34.231 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_bytes": 0, 2024-08-20T01:55:34.231 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_items": 0, 2024-08-20T01:55:34.231 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-20T01:55:34.231 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_items": 0, 2024-08-20T01:55:34.231 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_bytes": 0, 2024-08-20T01:55:34.231 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_items": 0, 2024-08-20T01:55:34.231 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_bytes": 0, 2024-08-20T01:55:34.231 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_items": 0, 2024-08-20T01:55:34.232 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-20T01:55:34.232 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_items": 0, 2024-08-20T01:55:34.232 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-20T01:55:34.232 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_items": 0, 2024-08-20T01:55:34.232 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_bytes": 0, 2024-08-20T01:55:34.232 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_items": 0, 2024-08-20T01:55:34.232 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_bytes": 0, 2024-08-20T01:55:34.232 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_items": 0, 2024-08-20T01:55:34.232 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-20T01:55:34.232 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_items": 0, 2024-08-20T01:55:34.232 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_bytes": 0, 2024-08-20T01:55:34.232 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_items": 0, 2024-08-20T01:55:34.232 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_bytes": 0, 2024-08-20T01:55:34.232 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_items": 0, 2024-08-20T01:55:34.233 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_bytes": 0, 2024-08-20T01:55:34.233 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_items": 0, 2024-08-20T01:55:34.233 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_bytes": 0, 2024-08-20T01:55:34.233 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_items": 0, 2024-08-20T01:55:34.233 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_bytes": 189423, 2024-08-20T01:55:34.233 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_items": 51, 2024-08-20T01:55:34.233 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_bytes": 0, 2024-08-20T01:55:34.233 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_items": 0, 2024-08-20T01:55:34.233 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bytes": 0, 2024-08-20T01:55:34.233 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_items": 0, 2024-08-20T01:55:34.233 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_bytes": 0, 2024-08-20T01:55:34.233 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_items": 0, 2024-08-20T01:55:34.233 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_bytes": 0, 2024-08-20T01:55:34.234 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_items": 0, 2024-08-20T01:55:34.234 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_bytes": 7496, 2024-08-20T01:55:34.234 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_items": 154, 2024-08-20T01:55:34.234 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_bytes": 0, 2024-08-20T01:55:34.234 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_items": 0, 2024-08-20T01:55:34.234 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_bytes": 0, 2024-08-20T01:55:34.234 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_items": 0, 2024-08-20T01:55:34.234 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_bytes": 70213, 2024-08-20T01:55:34.234 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_items": 336, 2024-08-20T01:55:34.234 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_bytes": 0, 2024-08-20T01:55:34.234 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_items": 0, 2024-08-20T01:55:34.234 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_bytes": 0, 2024-08-20T01:55:34.235 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_items": 0 2024-08-20T01:55:34.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.235 INFO:teuthology.orchestra.run.smithi081.stdout: "objecter": { 2024-08-20T01:55:34.235 INFO:teuthology.orchestra.run.smithi081.stdout: "op_active": 0, 2024-08-20T01:55:34.235 INFO:teuthology.orchestra.run.smithi081.stdout: "op_laggy": 0, 2024-08-20T01:55:34.235 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send": 3652, 2024-08-20T01:55:34.235 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send_bytes": 21, 2024-08-20T01:55:34.235 INFO:teuthology.orchestra.run.smithi081.stdout: "op_resend": 3, 2024-08-20T01:55:34.235 INFO:teuthology.orchestra.run.smithi081.stdout: "op_reply": 3652, 2024-08-20T01:55:34.235 INFO:teuthology.orchestra.run.smithi081.stdout: "op_latency": { 2024-08-20T01:55:34.235 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 3652, 2024-08-20T01:55:34.235 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 39.050251851, 2024-08-20T01:55:34.235 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.010692840 2024-08-20T01:55:34.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.236 INFO:teuthology.orchestra.run.smithi081.stdout: "op_inflight": 0, 2024-08-20T01:55:34.236 INFO:teuthology.orchestra.run.smithi081.stdout: "oplen_avg": { 2024-08-20T01:55:34.236 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 3652, 2024-08-20T01:55:34.236 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 3653 2024-08-20T01:55:34.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.236 INFO:teuthology.orchestra.run.smithi081.stdout: "op": 3652, 2024-08-20T01:55:34.236 INFO:teuthology.orchestra.run.smithi081.stdout: "op_r": 3652, 2024-08-20T01:55:34.236 INFO:teuthology.orchestra.run.smithi081.stdout: "op_w": 0, 2024-08-20T01:55:34.236 INFO:teuthology.orchestra.run.smithi081.stdout: "op_rmw": 0, 2024-08-20T01:55:34.236 INFO:teuthology.orchestra.run.smithi081.stdout: "op_pg": 0, 2024-08-20T01:55:34.236 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_stat": 2278, 2024-08-20T01:55:34.236 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_create": 0, 2024-08-20T01:55:34.237 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_read": 1372, 2024-08-20T01:55:34.237 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_write": 0, 2024-08-20T01:55:34.237 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writefull": 0, 2024-08-20T01:55:34.237 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writesame": 0, 2024-08-20T01:55:34.237 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_append": 0, 2024-08-20T01:55:34.237 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_zero": 0, 2024-08-20T01:55:34.237 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_truncate": 0, 2024-08-20T01:55:34.237 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_delete": 0, 2024-08-20T01:55:34.237 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_mapext": 0, 2024-08-20T01:55:34.237 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_sparse_read": 0, 2024-08-20T01:55:34.237 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_clonerange": 0, 2024-08-20T01:55:34.237 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_getxattr": 1, 2024-08-20T01:55:34.237 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_setxattr": 0, 2024-08-20T01:55:34.237 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_cmpxattr": 0, 2024-08-20T01:55:34.237 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_rmxattr": 0, 2024-08-20T01:55:34.238 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_resetxattrs": 0, 2024-08-20T01:55:34.238 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_call": 0, 2024-08-20T01:55:34.238 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_watch": 0, 2024-08-20T01:55:34.238 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_notify": 0, 2024-08-20T01:55:34.238 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_src_cmpxattr": 0, 2024-08-20T01:55:34.238 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls": 0, 2024-08-20T01:55:34.238 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls_filter": 0, 2024-08-20T01:55:34.238 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_other": 0, 2024-08-20T01:55:34.238 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_active": 0, 2024-08-20T01:55:34.238 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_send": 0, 2024-08-20T01:55:34.238 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_resend": 0, 2024-08-20T01:55:34.238 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_ping": 0, 2024-08-20T01:55:34.239 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_active": 0, 2024-08-20T01:55:34.239 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_send": 0, 2024-08-20T01:55:34.239 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_resend": 0, 2024-08-20T01:55:34.239 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_active": 0, 2024-08-20T01:55:34.239 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_send": 0, 2024-08-20T01:55:34.239 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_resend": 0, 2024-08-20T01:55:34.239 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_active": 0, 2024-08-20T01:55:34.239 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_send": 0, 2024-08-20T01:55:34.239 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_resend": 0, 2024-08-20T01:55:34.239 INFO:teuthology.orchestra.run.smithi081.stdout: "command_active": 0, 2024-08-20T01:55:34.239 INFO:teuthology.orchestra.run.smithi081.stdout: "command_send": 0, 2024-08-20T01:55:34.239 INFO:teuthology.orchestra.run.smithi081.stdout: "command_resend": 0, 2024-08-20T01:55:34.240 INFO:teuthology.orchestra.run.smithi081.stdout: "map_epoch": 74, 2024-08-20T01:55:34.240 INFO:teuthology.orchestra.run.smithi081.stdout: "map_full": 0, 2024-08-20T01:55:34.240 INFO:teuthology.orchestra.run.smithi081.stdout: "map_inc": 2, 2024-08-20T01:55:34.240 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_sessions": 5, 2024-08-20T01:55:34.240 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_open": 5, 2024-08-20T01:55:34.240 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_close": 0, 2024-08-20T01:55:34.240 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_laggy": 0, 2024-08-20T01:55:34.240 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_wr": 0, 2024-08-20T01:55:34.240 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_rd": 2, 2024-08-20T01:55:34.240 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_del": 0 2024-08-20T01:55:34.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.240 INFO:teuthology.orchestra.run.smithi081.stdout: "oft": { 2024-08-20T01:55:34.241 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_objs": 0, 2024-08-20T01:55:34.241 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_kv_pairs": 0, 2024-08-20T01:55:34.241 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_updates": 0, 2024-08-20T01:55:34.241 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_removes": 0 2024-08-20T01:55:34.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.241 INFO:teuthology.orchestra.run.smithi081.stdout: "purge_queue": { 2024-08-20T01:55:34.241 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops": 0, 2024-08-20T01:55:34.241 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops_high_water": 0, 2024-08-20T01:55:34.241 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing": 0, 2024-08-20T01:55:34.241 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_high_water": 0, 2024-08-20T01:55:34.241 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executed_ops": 0, 2024-08-20T01:55:34.241 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executed": 0, 2024-08-20T01:55:34.241 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_item_in_journal": 0 2024-08-20T01:55:34.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.242 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-20T01:55:34.242 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-08-20T01:55:34.242 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-08-20T01:55:34.242 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-08-20T01:55:34.242 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 4047, 2024-08-20T01:55:34.242 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 2341260, 2024-08-20T01:55:34.242 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:34.242 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 4047, 2024-08-20T01:55:34.242 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-08-20T01:55:34.242 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-08-20T01:55:34.242 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 4047, 2024-08-20T01:55:34.242 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 2341260, 2024-08-20T01:55:34.242 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-08-20T01:55:34.243 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:34.243 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:34.243 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:34.243 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-08-20T01:55:34.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.243 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_bytes": { 2024-08-20T01:55:34.243 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-08-20T01:55:34.243 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-08-20T01:55:34.243 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-08-20T01:55:34.243 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-08-20T01:55:34.243 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-08-20T01:55:34.243 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:34.243 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-08-20T01:55:34.243 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 3652, 2024-08-20T01:55:34.244 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 832968, 2024-08-20T01:55:34.244 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 3652, 2024-08-20T01:55:34.244 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 832968, 2024-08-20T01:55:34.244 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-08-20T01:55:34.244 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:34.244 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:34.244 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:34.244 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-08-20T01:55:34.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.244 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_ops": { 2024-08-20T01:55:34.244 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-08-20T01:55:34.244 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 1024, 2024-08-20T01:55:34.245 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-08-20T01:55:34.245 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-08-20T01:55:34.245 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-08-20T01:55:34.245 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:34.245 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-08-20T01:55:34.245 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 3652, 2024-08-20T01:55:34.245 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 3652, 2024-08-20T01:55:34.245 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 3652, 2024-08-20T01:55:34.245 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 3652, 2024-08-20T01:55:34.245 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-08-20T01:55:34.245 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:34.245 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:34.246 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:34.246 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-08-20T01:55:34.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.246 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle": { 2024-08-20T01:55:34.246 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-08-20T01:55:34.246 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2024-08-20T01:55:34.246 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-08-20T01:55:34.246 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-08-20T01:55:34.246 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-08-20T01:55:34.246 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:34.246 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-08-20T01:55:34.246 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-08-20T01:55:34.246 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-08-20T01:55:34.247 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 0, 2024-08-20T01:55:34.247 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 0, 2024-08-20T01:55:34.247 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-08-20T01:55:34.247 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:34.247 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:34.247 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:34.247 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-08-20T01:55:34.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.247 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle-0x5605d65a0960": { 2024-08-20T01:55:34.247 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-08-20T01:55:34.247 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2024-08-20T01:55:34.247 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-08-20T01:55:34.247 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-08-20T01:55:34.247 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-08-20T01:55:34.248 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:34.248 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-08-20T01:55:34.248 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-08-20T01:55:34.248 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-08-20T01:55:34.248 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 0, 2024-08-20T01:55:34.248 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 0, 2024-08-20T01:55:34.248 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-08-20T01:55:34.248 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-08-20T01:55:34.248 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-08-20T01:55:34.248 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-08-20T01:55:34.248 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-08-20T01:55:34.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-08-20T01:55:34.248 INFO:teuthology.orchestra.run.smithi081.stdout: "trackedop": { 2024-08-20T01:55:34.249 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_ops_count": 0 2024-08-20T01:55:34.249 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-08-20T01:55:34.249 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-08-20T01:55:34.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:34 smithi081 ceph-mon[22209]: pgmap v894: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 170 B/s wr, 19 op/s 2024-08-20T01:55:34.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:34 smithi175 ceph-mon[22392]: pgmap v894: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 170 B/s wr, 19 op/s 2024-08-20T01:55:34.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:34 smithi079 ceph-mon[18656]: pgmap v894: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 170 B/s wr, 19 op/s 2024-08-20T01:55:34.967 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-08-20T01:55:34.967 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-08-20T01:55:34.967 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2024-08-20T01:55:34.968 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2024-08-20T01:55:34.968 INFO:tasks.check_counter:Daemon mds.k mds.dir_split=0 2024-08-20T01:55:34.968 DEBUG:tasks.check_counter:Getting stats from c 2024-08-20T01:55:34.968 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph daemon mds.c perf dump 2024-08-20T01:55:35.225 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T01:55:35.795 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-08-20T01:55:35.795 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-0": { 2024-08-20T01:55:35.795 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 3261, 2024-08-20T01:55:35.795 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 2784, 2024-08-20T01:55:35.795 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 2018118, 2024-08-20T01:55:35.795 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 2181646, 2024-08-20T01:55:35.796 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 14, 2024-08-20T01:55:35.796 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 5, 2024-08-20T01:55:35.796 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.268197392, 2024-08-20T01:55:35.796 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.123017800, 2024-08-20T01:55:35.796 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.152235585, 2024-08-20T01:55:35.796 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.018367690, 2024-08-20T01:55:35.796 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:55:35.796 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2784, 2024-08-20T01:55:35.796 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.117859199, 2024-08-20T01:55:35.796 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000042334 2024-08-20T01:55:35.796 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.796 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:55:35.797 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 3927, 2024-08-20T01:55:35.797 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000609606, 2024-08-20T01:55:35.797 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000155 2024-08-20T01:55:35.797 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.797 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 899712, 2024-08-20T01:55:35.797 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 239680 2024-08-20T01:55:35.797 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.797 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-1": { 2024-08-20T01:55:35.797 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 1888, 2024-08-20T01:55:35.797 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 1690, 2024-08-20T01:55:35.797 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 1101011, 2024-08-20T01:55:35.797 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 1743672, 2024-08-20T01:55:35.797 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 37, 2024-08-20T01:55:35.798 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 7, 2024-08-20T01:55:35.798 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.179226918, 2024-08-20T01:55:35.798 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.083928708, 2024-08-20T01:55:35.798 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.086241280, 2024-08-20T01:55:35.798 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.016310539, 2024-08-20T01:55:35.798 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:55:35.798 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1688, 2024-08-20T01:55:35.798 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.092188663, 2024-08-20T01:55:35.798 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000054614 2024-08-20T01:55:35.798 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.798 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:55:35.798 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2161, 2024-08-20T01:55:35.799 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000391155, 2024-08-20T01:55:35.799 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000181 2024-08-20T01:55:35.799 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.799 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-20T01:55:35.799 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 534048 2024-08-20T01:55:35.799 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.799 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-2": { 2024-08-20T01:55:35.799 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 3606, 2024-08-20T01:55:35.799 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 2758, 2024-08-20T01:55:35.799 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 1340630, 2024-08-20T01:55:35.799 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 1251897, 2024-08-20T01:55:35.799 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 30, 2024-08-20T01:55:35.799 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 8, 2024-08-20T01:55:35.799 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.275988591, 2024-08-20T01:55:35.800 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.116116473, 2024-08-20T01:55:35.800 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.148076327, 2024-08-20T01:55:35.800 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.028645569, 2024-08-20T01:55:35.800 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:55:35.800 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2756, 2024-08-20T01:55:35.800 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.109676824, 2024-08-20T01:55:35.800 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000039795 2024-08-20T01:55:35.800 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.800 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:55:35.800 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 4879, 2024-08-20T01:55:35.800 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000875638, 2024-08-20T01:55:35.800 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000179 2024-08-20T01:55:35.801 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.801 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-20T01:55:35.801 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 0 2024-08-20T01:55:35.801 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.801 INFO:teuthology.orchestra.run.smithi175.stdout: "cct": { 2024-08-20T01:55:35.801 INFO:teuthology.orchestra.run.smithi175.stdout: "total_workers": 1, 2024-08-20T01:55:35.801 INFO:teuthology.orchestra.run.smithi175.stdout: "unhealthy_workers": 0 2024-08-20T01:55:35.801 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.801 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-MDSRank": { 2024-08-20T01:55:35.801 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-08-20T01:55:35.801 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-08-20T01:55:35.801 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1132, 2024-08-20T01:55:35.802 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.224563000, 2024-08-20T01:55:35.802 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000198377 2024-08-20T01:55:35.802 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-08-20T01:55:35.802 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.802 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-PurgeQueue": { 2024-08-20T01:55:35.802 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-08-20T01:55:35.802 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-08-20T01:55:35.802 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 698, 2024-08-20T01:55:35.802 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.021842792, 2024-08-20T01:55:35.802 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000031293 2024-08-20T01:55:35.802 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-08-20T01:55:35.802 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.803 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": { 2024-08-20T01:55:35.803 INFO:teuthology.orchestra.run.smithi175.stdout: "request": 440, 2024-08-20T01:55:35.803 INFO:teuthology.orchestra.run.smithi175.stdout: "reply": 365, 2024-08-20T01:55:35.803 INFO:teuthology.orchestra.run.smithi175.stdout: "reply_latency": { 2024-08-20T01:55:35.803 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 365, 2024-08-20T01:55:35.803 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 23.884919819, 2024-08-20T01:55:35.803 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.065438136 2024-08-20T01:55:35.803 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.803 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_reply": 0, 2024-08-20T01:55:35.803 INFO:teuthology.orchestra.run.smithi175.stdout: "forward": 75, 2024-08-20T01:55:35.803 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_complete": 0, 2024-08-20T01:55:35.803 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_keys": 0, 2024-08-20T01:55:35.803 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_commit": 11, 2024-08-20T01:55:35.803 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_split": 0, 2024-08-20T01:55:35.804 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_merge": 0, 2024-08-20T01:55:35.804 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes": 25, 2024-08-20T01:55:35.804 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_top": 5, 2024-08-20T01:55:35.804 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_bottom": 9, 2024-08-20T01:55:35.804 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pin_tail": 11, 2024-08-20T01:55:35.804 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pinned": 15, 2024-08-20T01:55:35.804 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_expired": 171, 2024-08-20T01:55:35.804 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_with_caps": 1, 2024-08-20T01:55:35.804 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": 1, 2024-08-20T01:55:35.804 INFO:teuthology.orchestra.run.smithi175.stdout: "subtrees": 7, 2024-08-20T01:55:35.804 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse": 784, 2024-08-20T01:55:35.804 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_hit": 604, 2024-08-20T01:55:35.804 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_forward": 75, 2024-08-20T01:55:35.805 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_discover": 86, 2024-08-20T01:55:35.805 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_dir_fetch": 0, 2024-08-20T01:55:35.805 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_remote_ino": 0, 2024-08-20T01:55:35.805 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_lock": 0, 2024-08-20T01:55:35.805 INFO:teuthology.orchestra.run.smithi175.stdout: "load_cent": 0, 2024-08-20T01:55:35.805 INFO:teuthology.orchestra.run.smithi175.stdout: "q": 0, 2024-08-20T01:55:35.805 INFO:teuthology.orchestra.run.smithi175.stdout: "exported": 6, 2024-08-20T01:55:35.805 INFO:teuthology.orchestra.run.smithi175.stdout: "exported_inodes": 3, 2024-08-20T01:55:35.805 INFO:teuthology.orchestra.run.smithi175.stdout: "imported": 7, 2024-08-20T01:55:35.805 INFO:teuthology.orchestra.run.smithi175.stdout: "imported_inodes": 57, 2024-08-20T01:55:35.805 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_dir_fetch": 0, 2024-08-20T01:55:35.805 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_backtrace_fetch": 515, 2024-08-20T01:55:35.805 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_peer_discover": 0, 2024-08-20T01:55:35.806 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rfiles": 4, 2024-08-20T01:55:35.806 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rbytes": 234, 2024-08-20T01:55:35.806 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rsnaps": 0, 2024-08-20T01:55:35.806 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_fetch": 515, 2024-08-20T01:55:35.806 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_set_tag": 0, 2024-08-20T01:55:35.806 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_repaired": 0, 2024-08-20T01:55:35.806 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_inotable_repaired": 0, 2024-08-20T01:55:35.806 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_inodes": 19, 2024-08-20T01:55:35.806 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_base_inodes": 0, 2024-08-20T01:55:35.806 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dirfrag_rstats": 19, 2024-08-20T01:55:35.806 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_file_inodes": 496, 2024-08-20T01:55:35.806 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_inode_file_caps": 3, 2024-08-20T01:55:35.807 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_revoke": 56, 2024-08-20T01:55:35.807 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_grant": 239, 2024-08-20T01:55:35.807 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_trunc": 0, 2024-08-20T01:55:35.807 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-20T01:55:35.807 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-20T01:55:35.807 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps": 415, 2024-08-20T01:55:35.807 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps_dirty": 232, 2024-08-20T01:55:35.807 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_cap_release": 16, 2024-08-20T01:55:35.807 INFO:teuthology.orchestra.run.smithi175.stdout: "process_request_cap_release": 109 2024-08-20T01:55:35.807 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.807 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_cache": { 2024-08-20T01:55:35.807 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update": 14, 2024-08-20T01:55:35.808 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update_receipt": 268, 2024-08-20T01:55:35.808 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_try_discover": 175, 2024-08-20T01:55:35.808 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_send_discover": 185, 2024-08-20T01:55:35.808 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_handle_discover": 21, 2024-08-20T01:55:35.808 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays": 0, 2024-08-20T01:55:35.808 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_delayed": 0, 2024-08-20T01:55:35.808 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_enqueuing": 0, 2024-08-20T01:55:35.808 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_created": 54, 2024-08-20T01:55:35.808 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_enqueued": 54, 2024-08-20T01:55:35.808 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_reintegrated": 0, 2024-08-20T01:55:35.808 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_migrated": 0, 2024-08-20T01:55:35.808 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_processing": 0, 2024-08-20T01:55:35.809 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_enqueued": 0, 2024-08-20T01:55:35.809 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_prioritized": 0, 2024-08-20T01:55:35.809 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_started": 0, 2024-08-20T01:55:35.809 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_completed": 0, 2024-08-20T01:55:35.809 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_path": 0, 2024-08-20T01:55:35.809 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_inode": 0, 2024-08-20T01:55:35.809 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_enqueue_scrub": 0, 2024-08-20T01:55:35.809 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_exportdir": 6, 2024-08-20T01:55:35.809 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_flush": 0, 2024-08-20T01:55:35.809 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragmentdir": 0, 2024-08-20T01:55:35.809 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragstats": 0, 2024-08-20T01:55:35.809 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_inodestats": 0 2024-08-20T01:55:35.810 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.810 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_log": { 2024-08-20T01:55:35.810 INFO:teuthology.orchestra.run.smithi175.stdout: "evlrg": 0, 2024-08-20T01:55:35.810 INFO:teuthology.orchestra.run.smithi175.stdout: "evadd": 638, 2024-08-20T01:55:35.810 INFO:teuthology.orchestra.run.smithi175.stdout: "evex": 0, 2024-08-20T01:55:35.810 INFO:teuthology.orchestra.run.smithi175.stdout: "evtrm": 0, 2024-08-20T01:55:35.810 INFO:teuthology.orchestra.run.smithi175.stdout: "ev": 638, 2024-08-20T01:55:35.810 INFO:teuthology.orchestra.run.smithi175.stdout: "evexg": 0, 2024-08-20T01:55:35.810 INFO:teuthology.orchestra.run.smithi175.stdout: "evexd": 0, 2024-08-20T01:55:35.810 INFO:teuthology.orchestra.run.smithi175.stdout: "segadd": 2, 2024-08-20T01:55:35.810 INFO:teuthology.orchestra.run.smithi175.stdout: "segex": 0, 2024-08-20T01:55:35.810 INFO:teuthology.orchestra.run.smithi175.stdout: "segtrm": 0, 2024-08-20T01:55:35.810 INFO:teuthology.orchestra.run.smithi175.stdout: "seg": 2, 2024-08-20T01:55:35.813 INFO:teuthology.orchestra.run.smithi175.stdout: "segmjr": 2, 2024-08-20T01:55:35.813 INFO:teuthology.orchestra.run.smithi175.stdout: "segexg": 0, 2024-08-20T01:55:35.813 INFO:teuthology.orchestra.run.smithi175.stdout: "segexd": 0, 2024-08-20T01:55:35.814 INFO:teuthology.orchestra.run.smithi175.stdout: "expos": 4194304, 2024-08-20T01:55:35.814 INFO:teuthology.orchestra.run.smithi175.stdout: "wrpos": 5027267, 2024-08-20T01:55:35.814 INFO:teuthology.orchestra.run.smithi175.stdout: "rdpos": 0, 2024-08-20T01:55:35.814 INFO:teuthology.orchestra.run.smithi175.stdout: "jlat": { 2024-08-20T01:55:35.814 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 253, 2024-08-20T01:55:35.814 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 89.382313347, 2024-08-20T01:55:35.814 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.353289776 2024-08-20T01:55:35.814 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.814 INFO:teuthology.orchestra.run.smithi175.stdout: "replayed": 0 2024-08-20T01:55:35.814 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.814 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_mem": { 2024-08-20T01:55:35.814 INFO:teuthology.orchestra.run.smithi175.stdout: "ino": 32, 2024-08-20T01:55:35.814 INFO:teuthology.orchestra.run.smithi175.stdout: "ino+": 172, 2024-08-20T01:55:35.815 INFO:teuthology.orchestra.run.smithi175.stdout: "ino-": 140, 2024-08-20T01:55:35.815 INFO:teuthology.orchestra.run.smithi175.stdout: "dir": 30, 2024-08-20T01:55:35.815 INFO:teuthology.orchestra.run.smithi175.stdout: "dir+": 129, 2024-08-20T01:55:35.815 INFO:teuthology.orchestra.run.smithi175.stdout: "dir-": 99, 2024-08-20T01:55:35.815 INFO:teuthology.orchestra.run.smithi175.stdout: "dn": 25, 2024-08-20T01:55:35.815 INFO:teuthology.orchestra.run.smithi175.stdout: "dn+": 303, 2024-08-20T01:55:35.815 INFO:teuthology.orchestra.run.smithi175.stdout: "dn-": 278, 2024-08-20T01:55:35.815 INFO:teuthology.orchestra.run.smithi175.stdout: "cap": 1, 2024-08-20T01:55:35.815 INFO:teuthology.orchestra.run.smithi175.stdout: "cap+": 73, 2024-08-20T01:55:35.815 INFO:teuthology.orchestra.run.smithi175.stdout: "cap-": 72, 2024-08-20T01:55:35.815 INFO:teuthology.orchestra.run.smithi175.stdout: "rss": 54784, 2024-08-20T01:55:35.815 INFO:teuthology.orchestra.run.smithi175.stdout: "heap": 262922240 2024-08-20T01:55:35.816 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.816 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_server": { 2024-08-20T01:55:35.816 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_client_request": 497, 2024-08-20T01:55:35.816 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_server_request": 10, 2024-08-20T01:55:35.816 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_request": 440, 2024-08-20T01:55:35.816 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_session": 14, 2024-08-20T01:55:35.816 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_peer_request": 39, 2024-08-20T01:55:35.816 INFO:teuthology.orchestra.run.smithi175.stdout: "req_create_latency": { 2024-08-20T01:55:35.816 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1, 2024-08-20T01:55:35.816 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.008595070, 2024-08-20T01:55:35.816 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.008595070 2024-08-20T01:55:35.816 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.816 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getattr_latency": { 2024-08-20T01:55:35.817 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1, 2024-08-20T01:55:35.817 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000213569, 2024-08-20T01:55:35.817 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000213569 2024-08-20T01:55:35.817 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.817 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getfilelock_latency": { 2024-08-20T01:55:35.817 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:35.817 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:35.817 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:35.817 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.817 INFO:teuthology.orchestra.run.smithi175.stdout: "req_link_latency": { 2024-08-20T01:55:35.818 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:35.818 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:35.818 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:35.818 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.818 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookup_latency": { 2024-08-20T01:55:35.818 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 160, 2024-08-20T01:55:35.818 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 23.722174656, 2024-08-20T01:55:35.818 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.148263591 2024-08-20T01:55:35.818 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.818 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookuphash_latency": { 2024-08-20T01:55:35.818 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:35.818 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:35.819 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:35.819 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.819 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupino_latency": { 2024-08-20T01:55:35.819 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:35.819 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:35.819 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:35.819 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.819 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupname_latency": { 2024-08-20T01:55:35.819 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:35.819 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:35.819 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:35.819 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.820 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupparent_latency": { 2024-08-20T01:55:35.820 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:35.820 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:35.820 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:35.820 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.820 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupsnap_latency": { 2024-08-20T01:55:35.820 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:35.820 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:35.820 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:35.820 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.820 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lssnap_latency": { 2024-08-20T01:55:35.820 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:35.820 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:35.821 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:35.821 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.821 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mkdir_latency": { 2024-08-20T01:55:35.821 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:35.821 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:35.822 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:35.822 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.822 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mknod_latency": { 2024-08-20T01:55:35.822 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:35.822 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:35.822 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:35.822 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.822 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mksnap_latency": { 2024-08-20T01:55:35.822 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:35.822 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:35.822 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:35.823 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.823 INFO:teuthology.orchestra.run.smithi175.stdout: "req_open_latency": { 2024-08-20T01:55:35.823 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 140, 2024-08-20T01:55:35.823 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.089908812, 2024-08-20T01:55:35.823 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000642205 2024-08-20T01:55:35.823 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.823 INFO:teuthology.orchestra.run.smithi175.stdout: "req_readdir_latency": { 2024-08-20T01:55:35.823 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 9, 2024-08-20T01:55:35.823 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.003509383, 2024-08-20T01:55:35.823 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000389931 2024-08-20T01:55:35.823 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.823 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rename_latency": { 2024-08-20T01:55:35.823 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:35.824 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:35.824 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:35.824 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.824 INFO:teuthology.orchestra.run.smithi175.stdout: "req_renamesnap_latency": { 2024-08-20T01:55:35.824 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:35.824 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:35.824 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:35.824 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.824 INFO:teuthology.orchestra.run.smithi175.stdout: "req_snapdiff_latency": { 2024-08-20T01:55:35.824 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:35.824 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:35.824 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:35.825 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.825 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmdir_latency": { 2024-08-20T01:55:35.825 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:35.825 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:35.825 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:35.825 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.825 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmsnap_latency": { 2024-08-20T01:55:35.825 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:35.825 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:35.825 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:35.825 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.826 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmxattr_latency": { 2024-08-20T01:55:35.826 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:35.826 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:35.826 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:35.826 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.826 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setattr_latency": { 2024-08-20T01:55:35.826 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:35.826 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:35.826 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:35.826 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.826 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setdirlayout_latency": { 2024-08-20T01:55:35.826 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:35.827 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:35.827 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:35.827 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.827 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setfilelock_latency": { 2024-08-20T01:55:35.827 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:35.827 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:35.827 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:35.827 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.827 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setlayout_latency": { 2024-08-20T01:55:35.827 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:35.827 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:35.827 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:35.828 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.828 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setxattr_latency": { 2024-08-20T01:55:35.828 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:35.828 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:35.828 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:35.828 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.828 INFO:teuthology.orchestra.run.smithi175.stdout: "req_symlink_latency": { 2024-08-20T01:55:35.828 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:35.828 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:35.828 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:35.828 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.828 INFO:teuthology.orchestra.run.smithi175.stdout: "req_unlink_latency": { 2024-08-20T01:55:35.829 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 54, 2024-08-20T01:55:35.829 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.060518329, 2024-08-20T01:55:35.829 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.001120709 2024-08-20T01:55:35.829 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.829 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_revoke_eviction": 0, 2024-08-20T01:55:35.829 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_acquisition_throttle": 0, 2024-08-20T01:55:35.829 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getvxattr_latency": { 2024-08-20T01:55:35.829 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:35.829 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:35.829 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:35.829 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-08-20T01:55:35.829 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.829 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_sessions": { 2024-08-20T01:55:35.830 INFO:teuthology.orchestra.run.smithi175.stdout: "session_count": 1, 2024-08-20T01:55:35.830 INFO:teuthology.orchestra.run.smithi175.stdout: "session_add": 1, 2024-08-20T01:55:35.830 INFO:teuthology.orchestra.run.smithi175.stdout: "session_remove": 0, 2024-08-20T01:55:35.830 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_open": 1, 2024-08-20T01:55:35.830 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_stale": 0, 2024-08-20T01:55:35.830 INFO:teuthology.orchestra.run.smithi175.stdout: "total_load": 54, 2024-08-20T01:55:35.830 INFO:teuthology.orchestra.run.smithi175.stdout: "average_load": 54, 2024-08-20T01:55:35.830 INFO:teuthology.orchestra.run.smithi175.stdout: "avg_session_uptime": 1124, 2024-08-20T01:55:35.830 INFO:teuthology.orchestra.run.smithi175.stdout: "mdthresh_evicted": 0 2024-08-20T01:55:35.830 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.830 INFO:teuthology.orchestra.run.smithi175.stdout: "mempool": { 2024-08-20T01:55:35.831 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_bytes": 0, 2024-08-20T01:55:35.831 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_items": 0, 2024-08-20T01:55:35.831 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_bytes": 0, 2024-08-20T01:55:35.831 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_items": 0, 2024-08-20T01:55:35.831 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_bytes": 0, 2024-08-20T01:55:35.831 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_items": 0, 2024-08-20T01:55:35.831 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-20T01:55:35.831 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_items": 0, 2024-08-20T01:55:35.831 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-20T01:55:35.831 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_items": 0, 2024-08-20T01:55:35.831 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_bytes": 0, 2024-08-20T01:55:35.831 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_items": 0, 2024-08-20T01:55:35.831 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-20T01:55:35.831 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_items": 0, 2024-08-20T01:55:35.832 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_bytes": 0, 2024-08-20T01:55:35.832 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_items": 0, 2024-08-20T01:55:35.832 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_bytes": 0, 2024-08-20T01:55:35.832 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_items": 0, 2024-08-20T01:55:35.832 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-20T01:55:35.832 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_items": 0, 2024-08-20T01:55:35.832 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-20T01:55:35.832 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_items": 0, 2024-08-20T01:55:35.832 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_bytes": 0, 2024-08-20T01:55:35.832 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_items": 0, 2024-08-20T01:55:35.832 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_bytes": 0, 2024-08-20T01:55:35.832 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_items": 0, 2024-08-20T01:55:35.832 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-20T01:55:35.833 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_items": 0, 2024-08-20T01:55:35.833 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_bytes": 0, 2024-08-20T01:55:35.833 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_items": 0, 2024-08-20T01:55:35.833 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_bytes": 0, 2024-08-20T01:55:35.833 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_items": 0, 2024-08-20T01:55:35.833 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_bytes": 0, 2024-08-20T01:55:35.833 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_items": 0, 2024-08-20T01:55:35.833 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_bytes": 0, 2024-08-20T01:55:35.833 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_items": 0, 2024-08-20T01:55:35.833 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_bytes": 327895, 2024-08-20T01:55:35.833 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_items": 127, 2024-08-20T01:55:35.833 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_bytes": 88, 2024-08-20T01:55:35.834 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_items": 1, 2024-08-20T01:55:35.834 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_bytes": 0, 2024-08-20T01:55:35.834 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_items": 0, 2024-08-20T01:55:35.834 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_bytes": 0, 2024-08-20T01:55:35.834 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_items": 0, 2024-08-20T01:55:35.834 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_bytes": 0, 2024-08-20T01:55:35.834 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_items": 0, 2024-08-20T01:55:35.834 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_bytes": 7496, 2024-08-20T01:55:35.834 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_items": 154, 2024-08-20T01:55:35.834 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_bytes": 0, 2024-08-20T01:55:35.834 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_items": 0, 2024-08-20T01:55:35.834 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_bytes": 0, 2024-08-20T01:55:35.834 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_items": 0, 2024-08-20T01:55:35.835 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_bytes": 127858, 2024-08-20T01:55:35.835 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_items": 530, 2024-08-20T01:55:35.835 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_bytes": 0, 2024-08-20T01:55:35.835 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_items": 0, 2024-08-20T01:55:35.835 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_bytes": 0, 2024-08-20T01:55:35.835 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_items": 0 2024-08-20T01:55:35.835 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.835 INFO:teuthology.orchestra.run.smithi175.stdout: "objecter": { 2024-08-20T01:55:35.835 INFO:teuthology.orchestra.run.smithi175.stdout: "op_active": 2, 2024-08-20T01:55:35.835 INFO:teuthology.orchestra.run.smithi175.stdout: "op_laggy": 0, 2024-08-20T01:55:35.835 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send": 1680, 2024-08-20T01:55:35.835 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send_bytes": 882417, 2024-08-20T01:55:35.835 INFO:teuthology.orchestra.run.smithi175.stdout: "op_resend": 29, 2024-08-20T01:55:35.836 INFO:teuthology.orchestra.run.smithi175.stdout: "op_reply": 1678, 2024-08-20T01:55:35.836 INFO:teuthology.orchestra.run.smithi175.stdout: "op_latency": { 2024-08-20T01:55:35.836 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1678, 2024-08-20T01:55:35.836 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 2374.019648089, 2024-08-20T01:55:35.836 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 1.414791208 2024-08-20T01:55:35.836 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.836 INFO:teuthology.orchestra.run.smithi175.stdout: "op_inflight": 2, 2024-08-20T01:55:35.836 INFO:teuthology.orchestra.run.smithi175.stdout: "oplen_avg": { 2024-08-20T01:55:35.836 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1680, 2024-08-20T01:55:35.836 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 1950 2024-08-20T01:55:35.836 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.837 INFO:teuthology.orchestra.run.smithi175.stdout: "op": 1680, 2024-08-20T01:55:35.837 INFO:teuthology.orchestra.run.smithi175.stdout: "op_r": 516, 2024-08-20T01:55:35.837 INFO:teuthology.orchestra.run.smithi175.stdout: "op_w": 1164, 2024-08-20T01:55:35.837 INFO:teuthology.orchestra.run.smithi175.stdout: "op_rmw": 0, 2024-08-20T01:55:35.837 INFO:teuthology.orchestra.run.smithi175.stdout: "op_pg": 0, 2024-08-20T01:55:35.837 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_stat": 0, 2024-08-20T01:55:35.837 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_create": 10, 2024-08-20T01:55:35.837 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_read": 1, 2024-08-20T01:55:35.837 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_write": 254, 2024-08-20T01:55:35.837 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writefull": 48, 2024-08-20T01:55:35.837 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writesame": 0, 2024-08-20T01:55:35.837 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_append": 0, 2024-08-20T01:55:35.837 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_zero": 0, 2024-08-20T01:55:35.838 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_truncate": 0, 2024-08-20T01:55:35.838 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_delete": 634, 2024-08-20T01:55:35.838 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_mapext": 0, 2024-08-20T01:55:35.838 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_sparse_read": 0, 2024-08-20T01:55:35.838 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_clonerange": 0, 2024-08-20T01:55:35.838 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_getxattr": 515, 2024-08-20T01:55:35.838 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_setxattr": 20, 2024-08-20T01:55:35.838 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_cmpxattr": 0, 2024-08-20T01:55:35.838 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_rmxattr": 0, 2024-08-20T01:55:35.838 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_resetxattrs": 0, 2024-08-20T01:55:35.838 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_call": 0, 2024-08-20T01:55:35.838 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_watch": 0, 2024-08-20T01:55:35.839 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_notify": 0, 2024-08-20T01:55:35.839 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_src_cmpxattr": 0, 2024-08-20T01:55:35.839 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls": 0, 2024-08-20T01:55:35.839 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls_filter": 0, 2024-08-20T01:55:35.839 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_other": 0, 2024-08-20T01:55:35.839 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_active": 0, 2024-08-20T01:55:35.839 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_send": 0, 2024-08-20T01:55:35.839 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_resend": 0, 2024-08-20T01:55:35.839 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_ping": 0, 2024-08-20T01:55:35.839 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_active": 0, 2024-08-20T01:55:35.839 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_send": 0, 2024-08-20T01:55:35.839 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_resend": 0, 2024-08-20T01:55:35.839 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_active": 0, 2024-08-20T01:55:35.839 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_send": 0, 2024-08-20T01:55:35.840 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_resend": 0, 2024-08-20T01:55:35.840 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_active": 0, 2024-08-20T01:55:35.840 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_send": 0, 2024-08-20T01:55:35.840 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_resend": 0, 2024-08-20T01:55:35.840 INFO:teuthology.orchestra.run.smithi175.stdout: "command_active": 0, 2024-08-20T01:55:35.840 INFO:teuthology.orchestra.run.smithi175.stdout: "command_send": 0, 2024-08-20T01:55:35.840 INFO:teuthology.orchestra.run.smithi175.stdout: "command_resend": 0, 2024-08-20T01:55:35.840 INFO:teuthology.orchestra.run.smithi175.stdout: "map_epoch": 74, 2024-08-20T01:55:35.840 INFO:teuthology.orchestra.run.smithi175.stdout: "map_full": 0, 2024-08-20T01:55:35.840 INFO:teuthology.orchestra.run.smithi175.stdout: "map_inc": 2, 2024-08-20T01:55:35.840 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_sessions": 12, 2024-08-20T01:55:35.840 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_open": 12, 2024-08-20T01:55:35.840 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_close": 0, 2024-08-20T01:55:35.841 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_laggy": 0, 2024-08-20T01:55:35.841 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_wr": 344, 2024-08-20T01:55:35.841 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_rd": 0, 2024-08-20T01:55:35.841 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_del": 124 2024-08-20T01:55:35.841 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.841 INFO:teuthology.orchestra.run.smithi175.stdout: "oft": { 2024-08-20T01:55:35.841 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_objs": 1, 2024-08-20T01:55:35.841 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_kv_pairs": 0, 2024-08-20T01:55:35.841 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_updates": 0, 2024-08-20T01:55:35.841 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_removes": 0 2024-08-20T01:55:35.841 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.841 INFO:teuthology.orchestra.run.smithi175.stdout: "purge_queue": { 2024-08-20T01:55:35.841 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops": 25, 2024-08-20T01:55:35.841 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops_high_water": 30, 2024-08-20T01:55:35.842 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing": 1, 2024-08-20T01:55:35.842 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_high_water": 6, 2024-08-20T01:55:35.842 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed_ops": 597, 2024-08-20T01:55:35.842 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed": 45, 2024-08-20T01:55:35.842 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_item_in_journal": 9 2024-08-20T01:55:35.842 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.842 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-20T01:55:35.842 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-08-20T01:55:35.842 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-08-20T01:55:35.842 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-08-20T01:55:35.842 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 8751, 2024-08-20T01:55:35.842 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 3646041, 2024-08-20T01:55:35.843 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:35.843 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 8751, 2024-08-20T01:55:35.843 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-08-20T01:55:35.843 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-08-20T01:55:35.843 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 8751, 2024-08-20T01:55:35.843 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 3646041, 2024-08-20T01:55:35.843 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-08-20T01:55:35.843 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:35.843 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:35.843 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:35.843 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-08-20T01:55:35.843 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.843 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_bytes": { 2024-08-20T01:55:35.843 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-08-20T01:55:35.844 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-08-20T01:55:35.844 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-08-20T01:55:35.844 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-08-20T01:55:35.844 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-08-20T01:55:35.844 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:35.844 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-08-20T01:55:35.844 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 1680, 2024-08-20T01:55:35.844 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 887871, 2024-08-20T01:55:35.844 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 1678, 2024-08-20T01:55:35.844 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 887871, 2024-08-20T01:55:35.844 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-08-20T01:55:35.844 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:35.844 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:35.845 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:35.845 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-08-20T01:55:35.845 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.845 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_ops": { 2024-08-20T01:55:35.845 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 2, 2024-08-20T01:55:35.845 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 1024, 2024-08-20T01:55:35.845 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-08-20T01:55:35.845 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-08-20T01:55:35.845 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-08-20T01:55:35.845 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:35.845 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-08-20T01:55:35.845 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 1680, 2024-08-20T01:55:35.846 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 1680, 2024-08-20T01:55:35.846 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 1678, 2024-08-20T01:55:35.846 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 1678, 2024-08-20T01:55:35.846 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-08-20T01:55:35.846 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:35.846 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:35.846 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:35.846 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-08-20T01:55:35.846 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.846 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle": { 2024-08-20T01:55:35.846 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-08-20T01:55:35.846 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-08-20T01:55:35.846 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-08-20T01:55:35.847 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 54, 2024-08-20T01:55:35.847 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 5454, 2024-08-20T01:55:35.847 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:35.847 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 54, 2024-08-20T01:55:35.847 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-08-20T01:55:35.847 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-08-20T01:55:35.847 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 1, 2024-08-20T01:55:35.847 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 5454, 2024-08-20T01:55:35.847 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-08-20T01:55:35.847 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:35.847 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:35.847 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:35.848 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-08-20T01:55:35.848 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.848 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle-0x5567c3ea86e0": { 2024-08-20T01:55:35.848 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-08-20T01:55:35.848 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-08-20T01:55:35.848 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-08-20T01:55:35.848 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 638, 2024-08-20T01:55:35.848 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 832963, 2024-08-20T01:55:35.848 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:35.848 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 638, 2024-08-20T01:55:35.848 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-08-20T01:55:35.849 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-08-20T01:55:35.849 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 253, 2024-08-20T01:55:35.849 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 832963, 2024-08-20T01:55:35.849 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-08-20T01:55:35.849 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:35.849 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:35.849 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:35.849 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-08-20T01:55:35.849 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:35.849 INFO:teuthology.orchestra.run.smithi175.stdout: "trackedop": { 2024-08-20T01:55:35.849 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_ops_count": 2 2024-08-20T01:55:35.849 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-08-20T01:55:35.849 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-08-20T01:55:36.556 INFO:tasks.check_counter:Daemon mds.c mds.exported=6 2024-08-20T01:55:36.556 INFO:tasks.check_counter:Daemon mds.c mds.imported=7 2024-08-20T01:55:36.556 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=14 2024-08-20T01:55:36.556 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=268 2024-08-20T01:55:36.556 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=0 2024-08-20T01:55:36.556 DEBUG:tasks.check_counter:Getting stats from f 2024-08-20T01:55:36.557 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph daemon mds.f perf dump 2024-08-20T01:55:36.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:36 smithi175 ceph-mon[22392]: pgmap v895: 97 pgs: 97 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 170 B/s wr, 20 op/s 2024-08-20T01:55:36.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:36 smithi081 ceph-mon[22209]: pgmap v895: 97 pgs: 97 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 170 B/s wr, 20 op/s 2024-08-20T01:55:36.816 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T01:55:36.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:36 smithi079 ceph-mon[18656]: pgmap v895: 97 pgs: 97 active+clean; 2.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 170 B/s wr, 20 op/s 2024-08-20T01:55:37.314 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-08-20T01:55:37.314 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-0": { 2024-08-20T01:55:37.314 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 4064, 2024-08-20T01:55:37.314 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 4752, 2024-08-20T01:55:37.314 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 1552947, 2024-08-20T01:55:37.314 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 4140642, 2024-08-20T01:55:37.315 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 25, 2024-08-20T01:55:37.315 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 5, 2024-08-20T01:55:37.315 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.372280881, 2024-08-20T01:55:37.315 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.165893112, 2024-08-20T01:55:37.315 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.156149813, 2024-08-20T01:55:37.315 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.057084770, 2024-08-20T01:55:37.315 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:55:37.315 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 4751, 2024-08-20T01:55:37.315 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.217867106, 2024-08-20T01:55:37.315 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000045857 2024-08-20T01:55:37.315 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.316 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:55:37.316 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 4065, 2024-08-20T01:55:37.316 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000753723, 2024-08-20T01:55:37.316 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000185 2024-08-20T01:55:37.316 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.316 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-08-20T01:55:37.316 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 448 2024-08-20T01:55:37.316 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.316 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-1": { 2024-08-20T01:55:37.316 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 3102, 2024-08-20T01:55:37.316 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 3688, 2024-08-20T01:55:37.316 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 1836706, 2024-08-20T01:55:37.317 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 2184520, 2024-08-20T01:55:37.317 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 10, 2024-08-20T01:55:37.317 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 7, 2024-08-20T01:55:37.317 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.247008934, 2024-08-20T01:55:37.317 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.124009132, 2024-08-20T01:55:37.317 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.112602246, 2024-08-20T01:55:37.317 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.020377546, 2024-08-20T01:55:37.317 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:55:37.317 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 3686, 2024-08-20T01:55:37.317 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.134095419, 2024-08-20T01:55:37.317 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000036379 2024-08-20T01:55:37.317 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.318 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:55:37.318 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 4400, 2024-08-20T01:55:37.318 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000854422, 2024-08-20T01:55:37.318 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000194 2024-08-20T01:55:37.318 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.318 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-20T01:55:37.318 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 626048 2024-08-20T01:55:37.318 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.318 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-2": { 2024-08-20T01:55:37.318 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 5239, 2024-08-20T01:55:37.318 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 5127, 2024-08-20T01:55:37.318 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 2897058, 2024-08-20T01:55:37.319 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 2614004, 2024-08-20T01:55:37.319 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 48, 2024-08-20T01:55:37.319 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 9, 2024-08-20T01:55:37.319 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.419372108, 2024-08-20T01:55:37.319 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.200523691, 2024-08-20T01:55:37.319 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.219425574, 2024-08-20T01:55:37.319 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.026140525, 2024-08-20T01:55:37.319 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:55:37.319 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 5126, 2024-08-20T01:55:37.319 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.186895361, 2024-08-20T01:55:37.319 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000036460 2024-08-20T01:55:37.319 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.320 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:55:37.320 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 7154, 2024-08-20T01:55:37.320 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.001384849, 2024-08-20T01:55:37.320 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000193 2024-08-20T01:55:37.320 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.320 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 892048, 2024-08-20T01:55:37.320 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 234288 2024-08-20T01:55:37.320 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.320 INFO:teuthology.orchestra.run.smithi175.stdout: "cct": { 2024-08-20T01:55:37.320 INFO:teuthology.orchestra.run.smithi175.stdout: "total_workers": 1, 2024-08-20T01:55:37.320 INFO:teuthology.orchestra.run.smithi175.stdout: "unhealthy_workers": 0 2024-08-20T01:55:37.321 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.321 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-MDSRank": { 2024-08-20T01:55:37.321 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-08-20T01:55:37.321 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-08-20T01:55:37.321 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 3131, 2024-08-20T01:55:37.321 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.763690806, 2024-08-20T01:55:37.321 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000243912 2024-08-20T01:55:37.321 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-08-20T01:55:37.321 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.321 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-PurgeQueue": { 2024-08-20T01:55:37.321 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-08-20T01:55:37.321 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-08-20T01:55:37.321 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 784, 2024-08-20T01:55:37.322 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.033321636, 2024-08-20T01:55:37.322 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000042502 2024-08-20T01:55:37.322 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-08-20T01:55:37.322 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.322 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": { 2024-08-20T01:55:37.322 INFO:teuthology.orchestra.run.smithi175.stdout: "request": 956, 2024-08-20T01:55:37.322 INFO:teuthology.orchestra.run.smithi175.stdout: "reply": 910, 2024-08-20T01:55:37.322 INFO:teuthology.orchestra.run.smithi175.stdout: "reply_latency": { 2024-08-20T01:55:37.322 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 910, 2024-08-20T01:55:37.322 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 133.689771741, 2024-08-20T01:55:37.322 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.146911837 2024-08-20T01:55:37.322 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.322 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_reply": 0, 2024-08-20T01:55:37.323 INFO:teuthology.orchestra.run.smithi175.stdout: "forward": 46, 2024-08-20T01:55:37.323 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_complete": 0, 2024-08-20T01:55:37.323 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_keys": 0, 2024-08-20T01:55:37.323 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_commit": 11, 2024-08-20T01:55:37.323 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_split": 0, 2024-08-20T01:55:37.323 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_merge": 0, 2024-08-20T01:55:37.323 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes": 20, 2024-08-20T01:55:37.323 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_top": 3, 2024-08-20T01:55:37.323 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_bottom": 7, 2024-08-20T01:55:37.323 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pin_tail": 10, 2024-08-20T01:55:37.323 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pinned": 13, 2024-08-20T01:55:37.323 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_expired": 47, 2024-08-20T01:55:37.323 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_with_caps": 0, 2024-08-20T01:55:37.323 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": 0, 2024-08-20T01:55:37.324 INFO:teuthology.orchestra.run.smithi175.stdout: "subtrees": 5, 2024-08-20T01:55:37.324 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse": 1759, 2024-08-20T01:55:37.324 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_hit": 1434, 2024-08-20T01:55:37.324 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_forward": 46, 2024-08-20T01:55:37.324 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_discover": 87, 2024-08-20T01:55:37.324 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_dir_fetch": 0, 2024-08-20T01:55:37.324 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_remote_ino": 0, 2024-08-20T01:55:37.324 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_lock": 0, 2024-08-20T01:55:37.324 INFO:teuthology.orchestra.run.smithi175.stdout: "load_cent": 0, 2024-08-20T01:55:37.324 INFO:teuthology.orchestra.run.smithi175.stdout: "q": 0, 2024-08-20T01:55:37.324 INFO:teuthology.orchestra.run.smithi175.stdout: "exported": 8, 2024-08-20T01:55:37.324 INFO:teuthology.orchestra.run.smithi175.stdout: "exported_inodes": 1, 2024-08-20T01:55:37.324 INFO:teuthology.orchestra.run.smithi175.stdout: "imported": 8, 2024-08-20T01:55:37.324 INFO:teuthology.orchestra.run.smithi175.stdout: "imported_inodes": 236, 2024-08-20T01:55:37.325 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_dir_fetch": 0, 2024-08-20T01:55:37.325 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_backtrace_fetch": 2618, 2024-08-20T01:55:37.325 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_peer_discover": 0, 2024-08-20T01:55:37.325 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rfiles": 4, 2024-08-20T01:55:37.325 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rbytes": 234, 2024-08-20T01:55:37.325 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rsnaps": 0, 2024-08-20T01:55:37.325 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_fetch": 2618, 2024-08-20T01:55:37.325 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_set_tag": 0, 2024-08-20T01:55:37.325 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_repaired": 0, 2024-08-20T01:55:37.325 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_inotable_repaired": 0, 2024-08-20T01:55:37.325 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_inodes": 1081, 2024-08-20T01:55:37.325 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_base_inodes": 0, 2024-08-20T01:55:37.326 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dirfrag_rstats": 1081, 2024-08-20T01:55:37.326 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_file_inodes": 1537, 2024-08-20T01:55:37.326 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_inode_file_caps": 38, 2024-08-20T01:55:37.326 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_revoke": 153, 2024-08-20T01:55:37.326 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_grant": 571, 2024-08-20T01:55:37.326 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_trunc": 0, 2024-08-20T01:55:37.326 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-20T01:55:37.326 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-20T01:55:37.326 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps": 818, 2024-08-20T01:55:37.326 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps_dirty": 452, 2024-08-20T01:55:37.326 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_cap_release": 51, 2024-08-20T01:55:37.326 INFO:teuthology.orchestra.run.smithi175.stdout: "process_request_cap_release": 362 2024-08-20T01:55:37.326 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.326 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_cache": { 2024-08-20T01:55:37.327 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update": 51, 2024-08-20T01:55:37.327 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update_receipt": 267, 2024-08-20T01:55:37.327 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_try_discover": 175, 2024-08-20T01:55:37.327 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_send_discover": 184, 2024-08-20T01:55:37.327 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_handle_discover": 75, 2024-08-20T01:55:37.327 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays": 0, 2024-08-20T01:55:37.327 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_delayed": 0, 2024-08-20T01:55:37.327 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_enqueuing": 0, 2024-08-20T01:55:37.327 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_created": 179, 2024-08-20T01:55:37.327 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_enqueued": 179, 2024-08-20T01:55:37.327 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_reintegrated": 0, 2024-08-20T01:55:37.327 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_migrated": 0, 2024-08-20T01:55:37.327 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_processing": 0, 2024-08-20T01:55:37.327 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_enqueued": 0, 2024-08-20T01:55:37.328 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_prioritized": 0, 2024-08-20T01:55:37.328 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_started": 0, 2024-08-20T01:55:37.328 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_completed": 0, 2024-08-20T01:55:37.328 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_path": 0, 2024-08-20T01:55:37.328 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_inode": 0, 2024-08-20T01:55:37.328 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_enqueue_scrub": 0, 2024-08-20T01:55:37.328 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_exportdir": 10, 2024-08-20T01:55:37.328 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_flush": 0, 2024-08-20T01:55:37.328 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragmentdir": 0, 2024-08-20T01:55:37.328 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragstats": 0, 2024-08-20T01:55:37.328 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_inodestats": 0 2024-08-20T01:55:37.328 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.328 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_log": { 2024-08-20T01:55:37.329 INFO:teuthology.orchestra.run.smithi175.stdout: "evlrg": 0, 2024-08-20T01:55:37.329 INFO:teuthology.orchestra.run.smithi175.stdout: "evadd": 1323, 2024-08-20T01:55:37.329 INFO:teuthology.orchestra.run.smithi175.stdout: "evex": 0, 2024-08-20T01:55:37.329 INFO:teuthology.orchestra.run.smithi175.stdout: "evtrm": 0, 2024-08-20T01:55:37.329 INFO:teuthology.orchestra.run.smithi175.stdout: "ev": 1323, 2024-08-20T01:55:37.329 INFO:teuthology.orchestra.run.smithi175.stdout: "evexg": 0, 2024-08-20T01:55:37.329 INFO:teuthology.orchestra.run.smithi175.stdout: "evexd": 0, 2024-08-20T01:55:37.329 INFO:teuthology.orchestra.run.smithi175.stdout: "segadd": 3, 2024-08-20T01:55:37.329 INFO:teuthology.orchestra.run.smithi175.stdout: "segex": 0, 2024-08-20T01:55:37.329 INFO:teuthology.orchestra.run.smithi175.stdout: "segtrm": 0, 2024-08-20T01:55:37.329 INFO:teuthology.orchestra.run.smithi175.stdout: "seg": 3, 2024-08-20T01:55:37.329 INFO:teuthology.orchestra.run.smithi175.stdout: "segmjr": 2, 2024-08-20T01:55:37.330 INFO:teuthology.orchestra.run.smithi175.stdout: "segexg": 0, 2024-08-20T01:55:37.330 INFO:teuthology.orchestra.run.smithi175.stdout: "segexd": 0, 2024-08-20T01:55:37.330 INFO:teuthology.orchestra.run.smithi175.stdout: "expos": 4194304, 2024-08-20T01:55:37.330 INFO:teuthology.orchestra.run.smithi175.stdout: "wrpos": 6148001, 2024-08-20T01:55:37.330 INFO:teuthology.orchestra.run.smithi175.stdout: "rdpos": 0, 2024-08-20T01:55:37.330 INFO:teuthology.orchestra.run.smithi175.stdout: "jlat": { 2024-08-20T01:55:37.330 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 534, 2024-08-20T01:55:37.330 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 254.629198017, 2024-08-20T01:55:37.330 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.476833704 2024-08-20T01:55:37.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.330 INFO:teuthology.orchestra.run.smithi175.stdout: "replayed": 0 2024-08-20T01:55:37.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.330 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_mem": { 2024-08-20T01:55:37.330 INFO:teuthology.orchestra.run.smithi175.stdout: "ino": 26, 2024-08-20T01:55:37.331 INFO:teuthology.orchestra.run.smithi175.stdout: "ino+": 229, 2024-08-20T01:55:37.331 INFO:teuthology.orchestra.run.smithi175.stdout: "ino-": 203, 2024-08-20T01:55:37.331 INFO:teuthology.orchestra.run.smithi175.stdout: "dir": 25, 2024-08-20T01:55:37.331 INFO:teuthology.orchestra.run.smithi175.stdout: "dir+": 128, 2024-08-20T01:55:37.331 INFO:teuthology.orchestra.run.smithi175.stdout: "dir-": 103, 2024-08-20T01:55:37.331 INFO:teuthology.orchestra.run.smithi175.stdout: "dn": 20, 2024-08-20T01:55:37.331 INFO:teuthology.orchestra.run.smithi175.stdout: "dn+": 485, 2024-08-20T01:55:37.331 INFO:teuthology.orchestra.run.smithi175.stdout: "dn-": 465, 2024-08-20T01:55:37.331 INFO:teuthology.orchestra.run.smithi175.stdout: "cap": 0, 2024-08-20T01:55:37.331 INFO:teuthology.orchestra.run.smithi175.stdout: "cap+": 193, 2024-08-20T01:55:37.331 INFO:teuthology.orchestra.run.smithi175.stdout: "cap-": 193, 2024-08-20T01:55:37.331 INFO:teuthology.orchestra.run.smithi175.stdout: "rss": 58592, 2024-08-20T01:55:37.331 INFO:teuthology.orchestra.run.smithi175.stdout: "heap": 266067968 2024-08-20T01:55:37.331 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.332 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_server": { 2024-08-20T01:55:37.332 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_client_request": 1518, 2024-08-20T01:55:37.332 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_server_request": 11, 2024-08-20T01:55:37.332 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_request": 956, 2024-08-20T01:55:37.332 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_session": 14, 2024-08-20T01:55:37.332 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_peer_request": 55, 2024-08-20T01:55:37.332 INFO:teuthology.orchestra.run.smithi175.stdout: "req_create_latency": { 2024-08-20T01:55:37.332 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 4, 2024-08-20T01:55:37.332 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.011455050, 2024-08-20T01:55:37.332 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.002863762 2024-08-20T01:55:37.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.332 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getattr_latency": { 2024-08-20T01:55:37.332 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 209, 2024-08-20T01:55:37.332 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.039052185, 2024-08-20T01:55:37.333 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000186852 2024-08-20T01:55:37.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.333 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getfilelock_latency": { 2024-08-20T01:55:37.333 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:37.333 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:37.333 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:37.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.333 INFO:teuthology.orchestra.run.smithi175.stdout: "req_link_latency": { 2024-08-20T01:55:37.333 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:37.333 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:37.333 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:37.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.333 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookup_latency": { 2024-08-20T01:55:37.334 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 237, 2024-08-20T01:55:37.334 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 28.001444725, 2024-08-20T01:55:37.334 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.118149555 2024-08-20T01:55:37.334 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.334 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookuphash_latency": { 2024-08-20T01:55:37.334 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:37.334 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:37.334 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:37.334 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.334 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupino_latency": { 2024-08-20T01:55:37.334 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:37.334 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:37.334 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:37.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.335 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupname_latency": { 2024-08-20T01:55:37.335 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:37.335 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:37.335 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:37.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.335 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupparent_latency": { 2024-08-20T01:55:37.335 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:37.335 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:37.335 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:37.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.335 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupsnap_latency": { 2024-08-20T01:55:37.335 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:37.335 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:37.336 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:37.336 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.336 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lssnap_latency": { 2024-08-20T01:55:37.336 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:37.336 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:37.336 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:37.336 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.336 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mkdir_latency": { 2024-08-20T01:55:37.336 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:37.336 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:37.336 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:37.336 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.336 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mknod_latency": { 2024-08-20T01:55:37.337 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:37.337 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:37.337 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:37.337 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.337 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mksnap_latency": { 2024-08-20T01:55:37.337 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:37.337 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:37.337 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:37.337 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.337 INFO:teuthology.orchestra.run.smithi175.stdout: "req_open_latency": { 2024-08-20T01:55:37.337 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 272, 2024-08-20T01:55:37.337 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.193273926, 2024-08-20T01:55:37.337 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000710565 2024-08-20T01:55:37.337 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.338 INFO:teuthology.orchestra.run.smithi175.stdout: "req_readdir_latency": { 2024-08-20T01:55:37.338 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 9, 2024-08-20T01:55:37.338 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.004998726, 2024-08-20T01:55:37.338 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000555414 2024-08-20T01:55:37.338 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.338 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rename_latency": { 2024-08-20T01:55:37.338 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:37.338 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:37.338 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:37.338 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.338 INFO:teuthology.orchestra.run.smithi175.stdout: "req_renamesnap_latency": { 2024-08-20T01:55:37.338 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:37.338 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:37.338 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:37.339 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.339 INFO:teuthology.orchestra.run.smithi175.stdout: "req_snapdiff_latency": { 2024-08-20T01:55:37.339 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:37.339 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:37.339 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:37.339 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.339 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmdir_latency": { 2024-08-20T01:55:37.339 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 67, 2024-08-20T01:55:37.339 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 105.305858990, 2024-08-20T01:55:37.339 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 1.571729238 2024-08-20T01:55:37.339 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.339 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmsnap_latency": { 2024-08-20T01:55:37.339 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:37.340 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:37.340 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:37.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.340 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmxattr_latency": { 2024-08-20T01:55:37.340 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:37.340 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:37.340 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:37.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.340 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setattr_latency": { 2024-08-20T01:55:37.340 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:37.340 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:37.340 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:37.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.340 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setdirlayout_latency": { 2024-08-20T01:55:37.341 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:37.341 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:37.341 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:37.341 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.341 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setfilelock_latency": { 2024-08-20T01:55:37.341 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:37.341 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:37.341 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:37.341 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.341 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setlayout_latency": { 2024-08-20T01:55:37.341 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:37.341 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:37.341 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:37.341 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.342 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setxattr_latency": { 2024-08-20T01:55:37.342 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:37.342 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:37.342 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:37.342 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.342 INFO:teuthology.orchestra.run.smithi175.stdout: "req_symlink_latency": { 2024-08-20T01:55:37.342 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:37.342 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:37.342 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:37.342 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.342 INFO:teuthology.orchestra.run.smithi175.stdout: "req_unlink_latency": { 2024-08-20T01:55:37.342 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 112, 2024-08-20T01:55:37.342 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.133688139, 2024-08-20T01:55:37.343 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.001193644 2024-08-20T01:55:37.343 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.343 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_revoke_eviction": 0, 2024-08-20T01:55:37.343 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_acquisition_throttle": 0, 2024-08-20T01:55:37.343 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getvxattr_latency": { 2024-08-20T01:55:37.343 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:37.343 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:37.343 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:37.343 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-08-20T01:55:37.343 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.343 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_sessions": { 2024-08-20T01:55:37.343 INFO:teuthology.orchestra.run.smithi175.stdout: "session_count": 1, 2024-08-20T01:55:37.344 INFO:teuthology.orchestra.run.smithi175.stdout: "session_add": 1, 2024-08-20T01:55:37.344 INFO:teuthology.orchestra.run.smithi175.stdout: "session_remove": 0, 2024-08-20T01:55:37.344 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_open": 1, 2024-08-20T01:55:37.344 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_stale": 0, 2024-08-20T01:55:37.344 INFO:teuthology.orchestra.run.smithi175.stdout: "total_load": 177, 2024-08-20T01:55:37.344 INFO:teuthology.orchestra.run.smithi175.stdout: "average_load": 177, 2024-08-20T01:55:37.344 INFO:teuthology.orchestra.run.smithi175.stdout: "avg_session_uptime": 1127, 2024-08-20T01:55:37.344 INFO:teuthology.orchestra.run.smithi175.stdout: "mdthresh_evicted": 0 2024-08-20T01:55:37.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.344 INFO:teuthology.orchestra.run.smithi175.stdout: "mempool": { 2024-08-20T01:55:37.344 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_bytes": 0, 2024-08-20T01:55:37.344 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_items": 0, 2024-08-20T01:55:37.344 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_bytes": 0, 2024-08-20T01:55:37.344 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_items": 0, 2024-08-20T01:55:37.345 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_bytes": 0, 2024-08-20T01:55:37.345 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_items": 0, 2024-08-20T01:55:37.345 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-20T01:55:37.345 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_items": 0, 2024-08-20T01:55:37.345 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-20T01:55:37.345 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_items": 0, 2024-08-20T01:55:37.345 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_bytes": 0, 2024-08-20T01:55:37.345 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_items": 0, 2024-08-20T01:55:37.345 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-20T01:55:37.345 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_items": 0, 2024-08-20T01:55:37.345 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_bytes": 0, 2024-08-20T01:55:37.345 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_items": 0, 2024-08-20T01:55:37.345 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_bytes": 0, 2024-08-20T01:55:37.346 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_items": 0, 2024-08-20T01:55:37.346 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-20T01:55:37.346 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_items": 0, 2024-08-20T01:55:37.346 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-20T01:55:37.346 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_items": 0, 2024-08-20T01:55:37.346 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_bytes": 0, 2024-08-20T01:55:37.346 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_items": 0, 2024-08-20T01:55:37.346 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_bytes": 0, 2024-08-20T01:55:37.346 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_items": 0, 2024-08-20T01:55:37.346 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-20T01:55:37.346 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_items": 0, 2024-08-20T01:55:37.346 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_bytes": 0, 2024-08-20T01:55:37.347 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_items": 0, 2024-08-20T01:55:37.347 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_bytes": 0, 2024-08-20T01:55:37.347 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_items": 0, 2024-08-20T01:55:37.347 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_bytes": 0, 2024-08-20T01:55:37.347 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_items": 0, 2024-08-20T01:55:37.347 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_bytes": 0, 2024-08-20T01:55:37.347 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_items": 0, 2024-08-20T01:55:37.347 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_bytes": 350695, 2024-08-20T01:55:37.347 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_items": 155, 2024-08-20T01:55:37.347 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_bytes": 2112, 2024-08-20T01:55:37.347 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_items": 24, 2024-08-20T01:55:37.347 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_bytes": 0, 2024-08-20T01:55:37.347 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_items": 0, 2024-08-20T01:55:37.348 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_bytes": 0, 2024-08-20T01:55:37.348 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_items": 0, 2024-08-20T01:55:37.348 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_bytes": 0, 2024-08-20T01:55:37.348 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_items": 0, 2024-08-20T01:55:37.348 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_bytes": 7496, 2024-08-20T01:55:37.348 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_items": 154, 2024-08-20T01:55:37.348 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_bytes": 0, 2024-08-20T01:55:37.348 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_items": 0, 2024-08-20T01:55:37.348 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_bytes": 0, 2024-08-20T01:55:37.348 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_items": 0, 2024-08-20T01:55:37.348 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_bytes": 105701, 2024-08-20T01:55:37.348 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_items": 453, 2024-08-20T01:55:37.348 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_bytes": 0, 2024-08-20T01:55:37.349 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_items": 0, 2024-08-20T01:55:37.349 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_bytes": 0, 2024-08-20T01:55:37.349 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_items": 0 2024-08-20T01:55:37.349 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.349 INFO:teuthology.orchestra.run.smithi175.stdout: "objecter": { 2024-08-20T01:55:37.349 INFO:teuthology.orchestra.run.smithi175.stdout: "op_active": 11, 2024-08-20T01:55:37.349 INFO:teuthology.orchestra.run.smithi175.stdout: "op_laggy": 0, 2024-08-20T01:55:37.349 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send": 4243, 2024-08-20T01:55:37.349 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send_bytes": 2051630, 2024-08-20T01:55:37.349 INFO:teuthology.orchestra.run.smithi175.stdout: "op_resend": 33, 2024-08-20T01:55:37.349 INFO:teuthology.orchestra.run.smithi175.stdout: "op_reply": 4232, 2024-08-20T01:55:37.349 INFO:teuthology.orchestra.run.smithi175.stdout: "op_latency": { 2024-08-20T01:55:37.349 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 4232, 2024-08-20T01:55:37.349 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 2778.354745795, 2024-08-20T01:55:37.350 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.656511045 2024-08-20T01:55:37.350 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.350 INFO:teuthology.orchestra.run.smithi175.stdout: "op_inflight": 0, 2024-08-20T01:55:37.350 INFO:teuthology.orchestra.run.smithi175.stdout: "oplen_avg": { 2024-08-20T01:55:37.350 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 4243, 2024-08-20T01:55:37.350 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 4680 2024-08-20T01:55:37.350 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.350 INFO:teuthology.orchestra.run.smithi175.stdout: "op": 4243, 2024-08-20T01:55:37.350 INFO:teuthology.orchestra.run.smithi175.stdout: "op_r": 2642, 2024-08-20T01:55:37.350 INFO:teuthology.orchestra.run.smithi175.stdout: "op_w": 1601, 2024-08-20T01:55:37.350 INFO:teuthology.orchestra.run.smithi175.stdout: "op_rmw": 0, 2024-08-20T01:55:37.350 INFO:teuthology.orchestra.run.smithi175.stdout: "op_pg": 0, 2024-08-20T01:55:37.350 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_stat": 0, 2024-08-20T01:55:37.350 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_create": 10, 2024-08-20T01:55:37.351 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_read": 24, 2024-08-20T01:55:37.351 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_write": 569, 2024-08-20T01:55:37.351 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writefull": 61, 2024-08-20T01:55:37.351 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writesame": 0, 2024-08-20T01:55:37.351 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_append": 0, 2024-08-20T01:55:37.351 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_zero": 0, 2024-08-20T01:55:37.351 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_truncate": 0, 2024-08-20T01:55:37.351 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_delete": 647, 2024-08-20T01:55:37.351 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_mapext": 0, 2024-08-20T01:55:37.351 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_sparse_read": 0, 2024-08-20T01:55:37.351 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_clonerange": 0, 2024-08-20T01:55:37.351 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_getxattr": 2618, 2024-08-20T01:55:37.351 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_setxattr": 20, 2024-08-20T01:55:37.352 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_cmpxattr": 0, 2024-08-20T01:55:37.352 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_rmxattr": 0, 2024-08-20T01:55:37.352 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_resetxattrs": 0, 2024-08-20T01:55:37.352 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_call": 0, 2024-08-20T01:55:37.352 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_watch": 0, 2024-08-20T01:55:37.352 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_notify": 0, 2024-08-20T01:55:37.352 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_src_cmpxattr": 0, 2024-08-20T01:55:37.352 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls": 0, 2024-08-20T01:55:37.352 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls_filter": 0, 2024-08-20T01:55:37.352 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_other": 0, 2024-08-20T01:55:37.352 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_active": 0, 2024-08-20T01:55:37.352 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_send": 0, 2024-08-20T01:55:37.352 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_resend": 0, 2024-08-20T01:55:37.352 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_ping": 0, 2024-08-20T01:55:37.353 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_active": 0, 2024-08-20T01:55:37.353 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_send": 0, 2024-08-20T01:55:37.353 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_resend": 0, 2024-08-20T01:55:37.353 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_active": 0, 2024-08-20T01:55:37.353 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_send": 0, 2024-08-20T01:55:37.353 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_resend": 0, 2024-08-20T01:55:37.353 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_active": 0, 2024-08-20T01:55:37.353 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_send": 0, 2024-08-20T01:55:37.353 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_resend": 0, 2024-08-20T01:55:37.353 INFO:teuthology.orchestra.run.smithi175.stdout: "command_active": 0, 2024-08-20T01:55:37.353 INFO:teuthology.orchestra.run.smithi175.stdout: "command_send": 0, 2024-08-20T01:55:37.353 INFO:teuthology.orchestra.run.smithi175.stdout: "command_resend": 0, 2024-08-20T01:55:37.354 INFO:teuthology.orchestra.run.smithi175.stdout: "map_epoch": 74, 2024-08-20T01:55:37.354 INFO:teuthology.orchestra.run.smithi175.stdout: "map_full": 0, 2024-08-20T01:55:37.354 INFO:teuthology.orchestra.run.smithi175.stdout: "map_inc": 2, 2024-08-20T01:55:37.354 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_sessions": 12, 2024-08-20T01:55:37.354 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_open": 12, 2024-08-20T01:55:37.354 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_close": 0, 2024-08-20T01:55:37.354 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_laggy": 0, 2024-08-20T01:55:37.354 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_wr": 520, 2024-08-20T01:55:37.354 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_rd": 0, 2024-08-20T01:55:37.354 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_del": 211 2024-08-20T01:55:37.354 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.354 INFO:teuthology.orchestra.run.smithi175.stdout: "oft": { 2024-08-20T01:55:37.354 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_objs": 1, 2024-08-20T01:55:37.355 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_kv_pairs": 0, 2024-08-20T01:55:37.355 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_updates": 0, 2024-08-20T01:55:37.355 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_removes": 0 2024-08-20T01:55:37.355 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.355 INFO:teuthology.orchestra.run.smithi175.stdout: "purge_queue": { 2024-08-20T01:55:37.355 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops": 25, 2024-08-20T01:55:37.355 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops_high_water": 25, 2024-08-20T01:55:37.355 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing": 1, 2024-08-20T01:55:37.355 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_high_water": 1, 2024-08-20T01:55:37.355 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed_ops": 625, 2024-08-20T01:55:37.355 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed": 25, 2024-08-20T01:55:37.355 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_item_in_journal": 154 2024-08-20T01:55:37.356 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.356 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-20T01:55:37.356 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-08-20T01:55:37.356 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-08-20T01:55:37.356 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-08-20T01:55:37.356 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 12401, 2024-08-20T01:55:37.356 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 5144404, 2024-08-20T01:55:37.356 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:37.356 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 12401, 2024-08-20T01:55:37.356 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-08-20T01:55:37.356 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-08-20T01:55:37.356 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 12401, 2024-08-20T01:55:37.356 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 5144404, 2024-08-20T01:55:37.357 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-08-20T01:55:37.357 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:37.357 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:37.357 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:37.357 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-08-20T01:55:37.357 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.357 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_bytes": { 2024-08-20T01:55:37.357 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 90, 2024-08-20T01:55:37.357 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-08-20T01:55:37.357 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-08-20T01:55:37.357 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-08-20T01:55:37.357 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-08-20T01:55:37.357 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:37.358 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-08-20T01:55:37.358 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 4243, 2024-08-20T01:55:37.358 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 2069709, 2024-08-20T01:55:37.358 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 4232, 2024-08-20T01:55:37.358 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 2069619, 2024-08-20T01:55:37.358 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-08-20T01:55:37.358 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:37.358 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:37.358 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:37.358 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-08-20T01:55:37.358 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.358 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_ops": { 2024-08-20T01:55:37.358 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 11, 2024-08-20T01:55:37.359 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 1024, 2024-08-20T01:55:37.359 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-08-20T01:55:37.359 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-08-20T01:55:37.359 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-08-20T01:55:37.359 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:37.359 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-08-20T01:55:37.359 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 4243, 2024-08-20T01:55:37.359 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 4243, 2024-08-20T01:55:37.359 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 4232, 2024-08-20T01:55:37.359 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 4232, 2024-08-20T01:55:37.359 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-08-20T01:55:37.359 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:37.359 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:37.359 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:37.360 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-08-20T01:55:37.360 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.360 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle": { 2024-08-20T01:55:37.360 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-08-20T01:55:37.360 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-08-20T01:55:37.360 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-08-20T01:55:37.360 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 179, 2024-08-20T01:55:37.360 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 18079, 2024-08-20T01:55:37.360 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:37.360 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 179, 2024-08-20T01:55:37.360 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-08-20T01:55:37.360 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-08-20T01:55:37.360 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 35, 2024-08-20T01:55:37.360 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 18079, 2024-08-20T01:55:37.361 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-08-20T01:55:37.361 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:37.361 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:37.361 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:37.361 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-08-20T01:55:37.361 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.361 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle-0x559b6175a6e0": { 2024-08-20T01:55:37.361 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-08-20T01:55:37.361 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-08-20T01:55:37.361 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-08-20T01:55:37.361 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 1323, 2024-08-20T01:55:37.361 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 1953697, 2024-08-20T01:55:37.361 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:37.362 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 1323, 2024-08-20T01:55:37.362 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-08-20T01:55:37.362 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-08-20T01:55:37.362 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 534, 2024-08-20T01:55:37.362 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 1953697, 2024-08-20T01:55:37.362 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-08-20T01:55:37.362 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:37.362 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:37.362 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:37.362 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-08-20T01:55:37.362 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:37.362 INFO:teuthology.orchestra.run.smithi175.stdout: "trackedop": { 2024-08-20T01:55:37.362 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_ops_count": 14 2024-08-20T01:55:37.362 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-08-20T01:55:37.363 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-08-20T01:55:38.097 INFO:tasks.check_counter:Daemon mds.f mds.exported=8 2024-08-20T01:55:38.097 INFO:tasks.check_counter:Daemon mds.f mds.imported=8 2024-08-20T01:55:38.097 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=51 2024-08-20T01:55:38.097 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=267 2024-08-20T01:55:38.097 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=0 2024-08-20T01:55:38.097 DEBUG:tasks.check_counter:Getting stats from i 2024-08-20T01:55:38.097 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph daemon mds.i perf dump 2024-08-20T01:55:38.348 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T01:55:38.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:38 smithi081 ceph-mon[22209]: pgmap v896: 97 pgs: 97 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 20 op/s 2024-08-20T01:55:38.855 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:38 smithi175 ceph-mon[22392]: pgmap v896: 97 pgs: 97 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 20 op/s 2024-08-20T01:55:38.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:38 smithi079 ceph-mon[18656]: pgmap v896: 97 pgs: 97 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 20 op/s 2024-08-20T01:55:38.960 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-08-20T01:55:38.960 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-0": { 2024-08-20T01:55:38.961 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 6010, 2024-08-20T01:55:38.961 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 5587, 2024-08-20T01:55:38.961 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 3133930, 2024-08-20T01:55:38.961 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 6820019, 2024-08-20T01:55:38.961 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 10, 2024-08-20T01:55:38.961 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 5, 2024-08-20T01:55:38.961 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.542696278, 2024-08-20T01:55:38.961 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.258689877, 2024-08-20T01:55:38.961 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.249608383, 2024-08-20T01:55:38.961 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.058632989, 2024-08-20T01:55:38.961 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:55:38.961 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 5586, 2024-08-20T01:55:38.962 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.237015096, 2024-08-20T01:55:38.962 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000042430 2024-08-20T01:55:38.962 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.962 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:55:38.962 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 7033, 2024-08-20T01:55:38.962 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.001458535, 2024-08-20T01:55:38.962 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000207 2024-08-20T01:55:38.962 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.962 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 899504, 2024-08-20T01:55:38.962 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 230688 2024-08-20T01:55:38.962 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.963 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-1": { 2024-08-20T01:55:38.963 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 4448, 2024-08-20T01:55:38.963 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 6678, 2024-08-20T01:55:38.963 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 1815240, 2024-08-20T01:55:38.963 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 3598658, 2024-08-20T01:55:38.963 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 13, 2024-08-20T01:55:38.963 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 6, 2024-08-20T01:55:38.963 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.494976170, 2024-08-20T01:55:38.963 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.253381636, 2024-08-20T01:55:38.963 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.277319013, 2024-08-20T01:55:38.963 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.011545445, 2024-08-20T01:55:38.963 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:55:38.964 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 6679, 2024-08-20T01:55:38.964 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.239589424, 2024-08-20T01:55:38.964 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000035872 2024-08-20T01:55:38.964 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.964 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:55:38.964 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 9539, 2024-08-20T01:55:38.964 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.002186677, 2024-08-20T01:55:38.964 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000229 2024-08-20T01:55:38.964 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.964 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-08-20T01:55:38.964 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 535632 2024-08-20T01:55:38.964 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.965 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-2": { 2024-08-20T01:55:38.965 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 1292, 2024-08-20T01:55:38.965 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 1300, 2024-08-20T01:55:38.965 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 368603, 2024-08-20T01:55:38.965 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 1115116, 2024-08-20T01:55:38.965 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 58, 2024-08-20T01:55:38.965 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 9, 2024-08-20T01:55:38.965 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.148202446, 2024-08-20T01:55:38.965 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.056722235, 2024-08-20T01:55:38.965 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.042874582, 2024-08-20T01:55:38.965 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.036997627, 2024-08-20T01:55:38.965 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:55:38.965 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1296, 2024-08-20T01:55:38.966 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.061844753, 2024-08-20T01:55:38.966 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000047719 2024-08-20T01:55:38.966 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.966 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:55:38.966 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 48, 2024-08-20T01:55:38.966 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000005522, 2024-08-20T01:55:38.966 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000115 2024-08-20T01:55:38.966 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.966 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-20T01:55:38.966 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 0 2024-08-20T01:55:38.966 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.966 INFO:teuthology.orchestra.run.smithi175.stdout: "cct": { 2024-08-20T01:55:38.966 INFO:teuthology.orchestra.run.smithi175.stdout: "total_workers": 1, 2024-08-20T01:55:38.967 INFO:teuthology.orchestra.run.smithi175.stdout: "unhealthy_workers": 0 2024-08-20T01:55:38.967 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.967 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-MDSRank": { 2024-08-20T01:55:38.967 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-08-20T01:55:38.967 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-08-20T01:55:38.967 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 3957, 2024-08-20T01:55:38.967 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.753198033, 2024-08-20T01:55:38.967 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000190345 2024-08-20T01:55:38.967 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-08-20T01:55:38.967 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.967 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-PurgeQueue": { 2024-08-20T01:55:38.967 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-08-20T01:55:38.967 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-08-20T01:55:38.968 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 689, 2024-08-20T01:55:38.968 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.020940614, 2024-08-20T01:55:38.968 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000030392 2024-08-20T01:55:38.968 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-08-20T01:55:38.968 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.968 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": { 2024-08-20T01:55:38.968 INFO:teuthology.orchestra.run.smithi175.stdout: "request": 820, 2024-08-20T01:55:38.968 INFO:teuthology.orchestra.run.smithi175.stdout: "reply": 661, 2024-08-20T01:55:38.968 INFO:teuthology.orchestra.run.smithi175.stdout: "reply_latency": { 2024-08-20T01:55:38.968 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 661, 2024-08-20T01:55:38.968 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 29.414854228, 2024-08-20T01:55:38.968 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.044500535 2024-08-20T01:55:38.968 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.969 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_reply": 0, 2024-08-20T01:55:38.969 INFO:teuthology.orchestra.run.smithi175.stdout: "forward": 159, 2024-08-20T01:55:38.969 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_complete": 0, 2024-08-20T01:55:38.969 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_keys": 0, 2024-08-20T01:55:38.969 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_commit": 19, 2024-08-20T01:55:38.969 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_split": 1, 2024-08-20T01:55:38.969 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_merge": 0, 2024-08-20T01:55:38.969 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes": 20, 2024-08-20T01:55:38.969 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_top": 3, 2024-08-20T01:55:38.969 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_bottom": 7, 2024-08-20T01:55:38.969 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pin_tail": 10, 2024-08-20T01:55:38.969 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pinned": 13, 2024-08-20T01:55:38.969 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_expired": 390, 2024-08-20T01:55:38.970 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_with_caps": 2, 2024-08-20T01:55:38.970 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": 2, 2024-08-20T01:55:38.970 INFO:teuthology.orchestra.run.smithi175.stdout: "subtrees": 5, 2024-08-20T01:55:38.970 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse": 1277, 2024-08-20T01:55:38.970 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_hit": 948, 2024-08-20T01:55:38.970 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_forward": 146, 2024-08-20T01:55:38.970 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_discover": 99, 2024-08-20T01:55:38.970 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_dir_fetch": 0, 2024-08-20T01:55:38.970 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_remote_ino": 0, 2024-08-20T01:55:38.970 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_lock": 0, 2024-08-20T01:55:38.970 INFO:teuthology.orchestra.run.smithi175.stdout: "load_cent": 0, 2024-08-20T01:55:38.970 INFO:teuthology.orchestra.run.smithi175.stdout: "q": 0, 2024-08-20T01:55:38.970 INFO:teuthology.orchestra.run.smithi175.stdout: "exported": 15, 2024-08-20T01:55:38.971 INFO:teuthology.orchestra.run.smithi175.stdout: "exported_inodes": 316, 2024-08-20T01:55:38.971 INFO:teuthology.orchestra.run.smithi175.stdout: "imported": 11, 2024-08-20T01:55:38.971 INFO:teuthology.orchestra.run.smithi175.stdout: "imported_inodes": 241, 2024-08-20T01:55:38.971 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_dir_fetch": 0, 2024-08-20T01:55:38.971 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_backtrace_fetch": 822, 2024-08-20T01:55:38.971 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_peer_discover": 0, 2024-08-20T01:55:38.971 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rfiles": 4, 2024-08-20T01:55:38.971 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rbytes": 234, 2024-08-20T01:55:38.971 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rsnaps": 0, 2024-08-20T01:55:38.971 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_fetch": 822, 2024-08-20T01:55:38.971 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_set_tag": 0, 2024-08-20T01:55:38.971 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_repaired": 0, 2024-08-20T01:55:38.971 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_inotable_repaired": 0, 2024-08-20T01:55:38.972 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_inodes": 82, 2024-08-20T01:55:38.972 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_base_inodes": 0, 2024-08-20T01:55:38.972 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dirfrag_rstats": 82, 2024-08-20T01:55:38.972 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_file_inodes": 740, 2024-08-20T01:55:38.972 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_inode_file_caps": 8, 2024-08-20T01:55:38.972 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_revoke": 32, 2024-08-20T01:55:38.972 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_grant": 1350, 2024-08-20T01:55:38.972 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_trunc": 0, 2024-08-20T01:55:38.972 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-20T01:55:38.972 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-20T01:55:38.972 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps": 1709, 2024-08-20T01:55:38.972 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps_dirty": 1426, 2024-08-20T01:55:38.972 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_cap_release": 2, 2024-08-20T01:55:38.972 INFO:teuthology.orchestra.run.smithi175.stdout: "process_request_cap_release": 180 2024-08-20T01:55:38.973 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.973 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_cache": { 2024-08-20T01:55:38.973 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update": 33, 2024-08-20T01:55:38.973 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update_receipt": 311, 2024-08-20T01:55:38.973 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_try_discover": 204, 2024-08-20T01:55:38.973 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_send_discover": 224, 2024-08-20T01:55:38.973 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_handle_discover": 65, 2024-08-20T01:55:38.973 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays": 0, 2024-08-20T01:55:38.973 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_delayed": 0, 2024-08-20T01:55:38.973 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_enqueuing": 0, 2024-08-20T01:55:38.973 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_created": 30, 2024-08-20T01:55:38.973 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_enqueued": 30, 2024-08-20T01:55:38.973 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_reintegrated": 0, 2024-08-20T01:55:38.974 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_migrated": 0, 2024-08-20T01:55:38.974 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_processing": 0, 2024-08-20T01:55:38.974 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_enqueued": 0, 2024-08-20T01:55:38.974 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_prioritized": 0, 2024-08-20T01:55:38.974 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_started": 0, 2024-08-20T01:55:38.974 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_completed": 0, 2024-08-20T01:55:38.974 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_path": 0, 2024-08-20T01:55:38.974 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_inode": 0, 2024-08-20T01:55:38.974 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_enqueue_scrub": 0, 2024-08-20T01:55:38.974 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_exportdir": 16, 2024-08-20T01:55:38.974 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_flush": 0, 2024-08-20T01:55:38.975 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragmentdir": 1, 2024-08-20T01:55:38.975 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragstats": 0, 2024-08-20T01:55:38.975 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_inodestats": 0 2024-08-20T01:55:38.975 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.975 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_log": { 2024-08-20T01:55:38.975 INFO:teuthology.orchestra.run.smithi175.stdout: "evlrg": 0, 2024-08-20T01:55:38.975 INFO:teuthology.orchestra.run.smithi175.stdout: "evadd": 2063, 2024-08-20T01:55:38.975 INFO:teuthology.orchestra.run.smithi175.stdout: "evex": 0, 2024-08-20T01:55:38.975 INFO:teuthology.orchestra.run.smithi175.stdout: "evtrm": 0, 2024-08-20T01:55:38.975 INFO:teuthology.orchestra.run.smithi175.stdout: "ev": 2063, 2024-08-20T01:55:38.975 INFO:teuthology.orchestra.run.smithi175.stdout: "evexg": 0, 2024-08-20T01:55:38.975 INFO:teuthology.orchestra.run.smithi175.stdout: "evexd": 0, 2024-08-20T01:55:38.975 INFO:teuthology.orchestra.run.smithi175.stdout: "segadd": 4, 2024-08-20T01:55:38.976 INFO:teuthology.orchestra.run.smithi175.stdout: "segex": 0, 2024-08-20T01:55:38.976 INFO:teuthology.orchestra.run.smithi175.stdout: "segtrm": 0, 2024-08-20T01:55:38.976 INFO:teuthology.orchestra.run.smithi175.stdout: "seg": 4, 2024-08-20T01:55:38.976 INFO:teuthology.orchestra.run.smithi175.stdout: "segmjr": 2, 2024-08-20T01:55:38.976 INFO:teuthology.orchestra.run.smithi175.stdout: "segexg": 0, 2024-08-20T01:55:38.976 INFO:teuthology.orchestra.run.smithi175.stdout: "segexd": 0, 2024-08-20T01:55:38.976 INFO:teuthology.orchestra.run.smithi175.stdout: "expos": 4194304, 2024-08-20T01:55:38.976 INFO:teuthology.orchestra.run.smithi175.stdout: "wrpos": 8385819, 2024-08-20T01:55:38.976 INFO:teuthology.orchestra.run.smithi175.stdout: "rdpos": 0, 2024-08-20T01:55:38.976 INFO:teuthology.orchestra.run.smithi175.stdout: "jlat": { 2024-08-20T01:55:38.976 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1390, 2024-08-20T01:55:38.976 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 117.904047594, 2024-08-20T01:55:38.976 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.084823055 2024-08-20T01:55:38.976 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.977 INFO:teuthology.orchestra.run.smithi175.stdout: "replayed": 0 2024-08-20T01:55:38.977 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.977 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_mem": { 2024-08-20T01:55:38.977 INFO:teuthology.orchestra.run.smithi175.stdout: "ino": 27, 2024-08-20T01:55:38.977 INFO:teuthology.orchestra.run.smithi175.stdout: "ino+": 345, 2024-08-20T01:55:38.977 INFO:teuthology.orchestra.run.smithi175.stdout: "ino-": 318, 2024-08-20T01:55:38.977 INFO:teuthology.orchestra.run.smithi175.stdout: "dir": 25, 2024-08-20T01:55:38.977 INFO:teuthology.orchestra.run.smithi175.stdout: "dir+": 160, 2024-08-20T01:55:38.977 INFO:teuthology.orchestra.run.smithi175.stdout: "dir-": 135, 2024-08-20T01:55:38.977 INFO:teuthology.orchestra.run.smithi175.stdout: "dn": 20, 2024-08-20T01:55:38.977 INFO:teuthology.orchestra.run.smithi175.stdout: "dn+": 472, 2024-08-20T01:55:38.977 INFO:teuthology.orchestra.run.smithi175.stdout: "dn-": 452, 2024-08-20T01:55:38.977 INFO:teuthology.orchestra.run.smithi175.stdout: "cap": 2, 2024-08-20T01:55:38.978 INFO:teuthology.orchestra.run.smithi175.stdout: "cap+": 288, 2024-08-20T01:55:38.978 INFO:teuthology.orchestra.run.smithi175.stdout: "cap-": 286, 2024-08-20T01:55:38.978 INFO:teuthology.orchestra.run.smithi175.stdout: "rss": 55892, 2024-08-20T01:55:38.978 INFO:teuthology.orchestra.run.smithi175.stdout: "heap": 263966720 2024-08-20T01:55:38.978 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.978 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_server": { 2024-08-20T01:55:38.978 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_client_request": 885, 2024-08-20T01:55:38.978 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_server_request": 50, 2024-08-20T01:55:38.978 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_request": 820, 2024-08-20T01:55:38.978 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_session": 26, 2024-08-20T01:55:38.978 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_peer_request": 117, 2024-08-20T01:55:38.978 INFO:teuthology.orchestra.run.smithi175.stdout: "req_create_latency": { 2024-08-20T01:55:38.979 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 116, 2024-08-20T01:55:38.979 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.130347597, 2024-08-20T01:55:38.979 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.001123686 2024-08-20T01:55:38.979 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.979 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getattr_latency": { 2024-08-20T01:55:38.979 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 7, 2024-08-20T01:55:38.979 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.002718161, 2024-08-20T01:55:38.979 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000388308 2024-08-20T01:55:38.979 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.979 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getfilelock_latency": { 2024-08-20T01:55:38.979 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:38.979 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:38.979 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:38.979 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.980 INFO:teuthology.orchestra.run.smithi175.stdout: "req_link_latency": { 2024-08-20T01:55:38.980 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:38.980 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:38.980 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:38.980 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.980 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookup_latency": { 2024-08-20T01:55:38.980 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 236, 2024-08-20T01:55:38.980 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 28.753233138, 2024-08-20T01:55:38.980 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.121835733 2024-08-20T01:55:38.980 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.980 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookuphash_latency": { 2024-08-20T01:55:38.980 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:38.980 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:38.980 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:38.981 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.981 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupino_latency": { 2024-08-20T01:55:38.981 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:38.981 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:38.981 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:38.981 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.981 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupname_latency": { 2024-08-20T01:55:38.981 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:38.981 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:38.981 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:38.981 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.981 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupparent_latency": { 2024-08-20T01:55:38.981 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:38.982 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:38.982 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:38.982 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.982 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupsnap_latency": { 2024-08-20T01:55:38.982 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:38.982 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:38.982 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:38.982 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.982 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lssnap_latency": { 2024-08-20T01:55:38.982 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:38.982 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:38.983 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:38.983 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.983 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mkdir_latency": { 2024-08-20T01:55:38.983 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:38.983 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:38.983 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:38.983 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.983 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mknod_latency": { 2024-08-20T01:55:38.983 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:38.984 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:38.984 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:38.984 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.984 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mksnap_latency": { 2024-08-20T01:55:38.984 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:38.984 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:38.984 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:38.984 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.984 INFO:teuthology.orchestra.run.smithi175.stdout: "req_open_latency": { 2024-08-20T01:55:38.984 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 269, 2024-08-20T01:55:38.984 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.486513970, 2024-08-20T01:55:38.984 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.001808602 2024-08-20T01:55:38.985 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.985 INFO:teuthology.orchestra.run.smithi175.stdout: "req_readdir_latency": { 2024-08-20T01:55:38.985 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 3, 2024-08-20T01:55:38.985 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.001620366, 2024-08-20T01:55:38.985 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000540122 2024-08-20T01:55:38.985 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.985 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rename_latency": { 2024-08-20T01:55:38.985 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:38.985 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:38.985 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:38.985 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.985 INFO:teuthology.orchestra.run.smithi175.stdout: "req_renamesnap_latency": { 2024-08-20T01:55:38.985 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:38.986 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:38.986 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:38.986 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.986 INFO:teuthology.orchestra.run.smithi175.stdout: "req_snapdiff_latency": { 2024-08-20T01:55:38.986 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:38.986 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:38.986 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:38.986 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.986 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmdir_latency": { 2024-08-20T01:55:38.986 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2, 2024-08-20T01:55:38.986 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.011220878, 2024-08-20T01:55:38.986 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.005610439 2024-08-20T01:55:38.986 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.987 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmsnap_latency": { 2024-08-20T01:55:38.987 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:38.987 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:38.987 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:38.987 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.987 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmxattr_latency": { 2024-08-20T01:55:38.987 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:38.987 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:38.987 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:38.987 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.987 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setattr_latency": { 2024-08-20T01:55:38.987 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:38.987 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:38.987 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:38.988 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.988 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setdirlayout_latency": { 2024-08-20T01:55:38.988 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:38.988 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:38.988 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:38.988 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.988 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setfilelock_latency": { 2024-08-20T01:55:38.988 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:38.988 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:38.988 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:38.988 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.988 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setlayout_latency": { 2024-08-20T01:55:38.988 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:38.989 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:38.989 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:38.989 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.989 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setxattr_latency": { 2024-08-20T01:55:38.989 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:38.989 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:38.989 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:38.989 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.989 INFO:teuthology.orchestra.run.smithi175.stdout: "req_symlink_latency": { 2024-08-20T01:55:38.989 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:38.989 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:38.989 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:38.989 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.989 INFO:teuthology.orchestra.run.smithi175.stdout: "req_unlink_latency": { 2024-08-20T01:55:38.990 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 28, 2024-08-20T01:55:38.990 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.029200118, 2024-08-20T01:55:38.990 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.001042861 2024-08-20T01:55:38.990 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.990 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_revoke_eviction": 0, 2024-08-20T01:55:38.990 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_acquisition_throttle": 0, 2024-08-20T01:55:38.990 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getvxattr_latency": { 2024-08-20T01:55:38.990 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:38.990 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:38.990 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:38.990 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-08-20T01:55:38.990 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.990 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_sessions": { 2024-08-20T01:55:38.991 INFO:teuthology.orchestra.run.smithi175.stdout: "session_count": 1, 2024-08-20T01:55:38.991 INFO:teuthology.orchestra.run.smithi175.stdout: "session_add": 1, 2024-08-20T01:55:38.991 INFO:teuthology.orchestra.run.smithi175.stdout: "session_remove": 0, 2024-08-20T01:55:38.991 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_open": 1, 2024-08-20T01:55:38.991 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_stale": 0, 2024-08-20T01:55:38.991 INFO:teuthology.orchestra.run.smithi175.stdout: "total_load": 123, 2024-08-20T01:55:38.991 INFO:teuthology.orchestra.run.smithi175.stdout: "average_load": 123, 2024-08-20T01:55:38.991 INFO:teuthology.orchestra.run.smithi175.stdout: "avg_session_uptime": 1129, 2024-08-20T01:55:38.991 INFO:teuthology.orchestra.run.smithi175.stdout: "mdthresh_evicted": 0 2024-08-20T01:55:38.991 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.991 INFO:teuthology.orchestra.run.smithi175.stdout: "mempool": { 2024-08-20T01:55:38.991 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_bytes": 0, 2024-08-20T01:55:38.991 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_items": 0, 2024-08-20T01:55:38.992 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_bytes": 0, 2024-08-20T01:55:38.992 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_items": 0, 2024-08-20T01:55:38.992 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_bytes": 0, 2024-08-20T01:55:38.992 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_items": 0, 2024-08-20T01:55:38.992 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-20T01:55:38.992 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_items": 0, 2024-08-20T01:55:38.992 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-20T01:55:38.992 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_items": 0, 2024-08-20T01:55:38.992 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_bytes": 0, 2024-08-20T01:55:38.992 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_items": 0, 2024-08-20T01:55:38.992 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-20T01:55:38.992 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_items": 0, 2024-08-20T01:55:38.992 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_bytes": 0, 2024-08-20T01:55:38.993 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_items": 0, 2024-08-20T01:55:38.993 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_bytes": 0, 2024-08-20T01:55:38.993 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_items": 0, 2024-08-20T01:55:38.993 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-20T01:55:38.993 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_items": 0, 2024-08-20T01:55:38.993 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-20T01:55:38.993 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_items": 0, 2024-08-20T01:55:38.993 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_bytes": 0, 2024-08-20T01:55:38.993 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_items": 0, 2024-08-20T01:55:38.993 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_bytes": 0, 2024-08-20T01:55:38.993 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_items": 0, 2024-08-20T01:55:38.993 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-20T01:55:38.993 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_items": 0, 2024-08-20T01:55:38.993 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_bytes": 0, 2024-08-20T01:55:38.994 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_items": 0, 2024-08-20T01:55:38.994 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_bytes": 0, 2024-08-20T01:55:38.994 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_items": 0, 2024-08-20T01:55:38.994 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_bytes": 0, 2024-08-20T01:55:38.994 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_items": 0, 2024-08-20T01:55:38.994 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_bytes": 0, 2024-08-20T01:55:38.994 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_items": 0, 2024-08-20T01:55:38.994 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_bytes": 315725, 2024-08-20T01:55:38.994 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_items": 117, 2024-08-20T01:55:38.994 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_bytes": 176, 2024-08-20T01:55:38.994 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_items": 2, 2024-08-20T01:55:38.994 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_bytes": 0, 2024-08-20T01:55:38.995 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_items": 0, 2024-08-20T01:55:38.995 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_bytes": 0, 2024-08-20T01:55:38.995 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_items": 0, 2024-08-20T01:55:38.995 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_bytes": 0, 2024-08-20T01:55:38.995 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_items": 0, 2024-08-20T01:55:38.995 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_bytes": 7496, 2024-08-20T01:55:38.995 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_items": 154, 2024-08-20T01:55:38.995 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_bytes": 0, 2024-08-20T01:55:38.995 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_items": 0, 2024-08-20T01:55:38.995 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_bytes": 0, 2024-08-20T01:55:38.995 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_items": 0, 2024-08-20T01:55:38.995 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_bytes": 107701, 2024-08-20T01:55:38.995 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_items": 436, 2024-08-20T01:55:38.996 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_bytes": 0, 2024-08-20T01:55:38.996 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_items": 0, 2024-08-20T01:55:38.996 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_bytes": 0, 2024-08-20T01:55:38.996 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_items": 0 2024-08-20T01:55:38.996 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.996 INFO:teuthology.orchestra.run.smithi175.stdout: "objecter": { 2024-08-20T01:55:38.996 INFO:teuthology.orchestra.run.smithi175.stdout: "op_active": 10, 2024-08-20T01:55:38.996 INFO:teuthology.orchestra.run.smithi175.stdout: "op_laggy": 0, 2024-08-20T01:55:38.996 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send": 3422, 2024-08-20T01:55:38.996 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send_bytes": 4331821, 2024-08-20T01:55:38.996 INFO:teuthology.orchestra.run.smithi175.stdout: "op_resend": 32, 2024-08-20T01:55:38.996 INFO:teuthology.orchestra.run.smithi175.stdout: "op_reply": 3412, 2024-08-20T01:55:38.996 INFO:teuthology.orchestra.run.smithi175.stdout: "op_latency": { 2024-08-20T01:55:38.996 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 3412, 2024-08-20T01:55:38.997 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 2381.624667536, 2024-08-20T01:55:38.997 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.698014263 2024-08-20T01:55:38.997 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.997 INFO:teuthology.orchestra.run.smithi175.stdout: "op_inflight": 9, 2024-08-20T01:55:38.997 INFO:teuthology.orchestra.run.smithi175.stdout: "oplen_avg": { 2024-08-20T01:55:38.997 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 3422, 2024-08-20T01:55:38.997 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 4018 2024-08-20T01:55:38.997 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:38.997 INFO:teuthology.orchestra.run.smithi175.stdout: "op": 3422, 2024-08-20T01:55:38.997 INFO:teuthology.orchestra.run.smithi175.stdout: "op_r": 824, 2024-08-20T01:55:38.997 INFO:teuthology.orchestra.run.smithi175.stdout: "op_w": 2598, 2024-08-20T01:55:38.997 INFO:teuthology.orchestra.run.smithi175.stdout: "op_rmw": 0, 2024-08-20T01:55:38.997 INFO:teuthology.orchestra.run.smithi175.stdout: "op_pg": 0, 2024-08-20T01:55:38.998 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_stat": 0, 2024-08-20T01:55:38.998 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_create": 10, 2024-08-20T01:55:38.998 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_read": 2, 2024-08-20T01:55:38.998 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_write": 1392, 2024-08-20T01:55:38.998 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writefull": 70, 2024-08-20T01:55:38.998 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writesame": 0, 2024-08-20T01:55:38.998 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_append": 0, 2024-08-20T01:55:38.998 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_zero": 0, 2024-08-20T01:55:38.998 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_truncate": 1, 2024-08-20T01:55:38.998 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_delete": 634, 2024-08-20T01:55:38.998 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_mapext": 0, 2024-08-20T01:55:38.998 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_sparse_read": 0, 2024-08-20T01:55:38.998 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_clonerange": 0, 2024-08-20T01:55:38.999 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_getxattr": 822, 2024-08-20T01:55:38.999 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_setxattr": 20, 2024-08-20T01:55:38.999 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_cmpxattr": 0, 2024-08-20T01:55:38.999 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_rmxattr": 0, 2024-08-20T01:55:38.999 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_resetxattrs": 0, 2024-08-20T01:55:38.999 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_call": 0, 2024-08-20T01:55:38.999 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_watch": 0, 2024-08-20T01:55:38.999 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_notify": 0, 2024-08-20T01:55:38.999 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_src_cmpxattr": 0, 2024-08-20T01:55:38.999 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls": 0, 2024-08-20T01:55:38.999 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls_filter": 0, 2024-08-20T01:55:38.999 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_other": 0, 2024-08-20T01:55:39.000 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_active": 0, 2024-08-20T01:55:39.000 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_send": 0, 2024-08-20T01:55:39.000 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_resend": 0, 2024-08-20T01:55:39.000 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_ping": 0, 2024-08-20T01:55:39.000 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_active": 0, 2024-08-20T01:55:39.000 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_send": 0, 2024-08-20T01:55:39.000 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_resend": 0, 2024-08-20T01:55:39.000 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_active": 0, 2024-08-20T01:55:39.000 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_send": 0, 2024-08-20T01:55:39.000 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_resend": 0, 2024-08-20T01:55:39.000 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_active": 0, 2024-08-20T01:55:39.000 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_send": 0, 2024-08-20T01:55:39.000 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_resend": 0, 2024-08-20T01:55:39.001 INFO:teuthology.orchestra.run.smithi175.stdout: "command_active": 0, 2024-08-20T01:55:39.001 INFO:teuthology.orchestra.run.smithi175.stdout: "command_send": 0, 2024-08-20T01:55:39.001 INFO:teuthology.orchestra.run.smithi175.stdout: "command_resend": 0, 2024-08-20T01:55:39.001 INFO:teuthology.orchestra.run.smithi175.stdout: "map_epoch": 74, 2024-08-20T01:55:39.001 INFO:teuthology.orchestra.run.smithi175.stdout: "map_full": 0, 2024-08-20T01:55:39.001 INFO:teuthology.orchestra.run.smithi175.stdout: "map_inc": 2, 2024-08-20T01:55:39.001 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_sessions": 12, 2024-08-20T01:55:39.001 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_open": 12, 2024-08-20T01:55:39.001 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_close": 0, 2024-08-20T01:55:39.001 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_laggy": 0, 2024-08-20T01:55:39.001 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_wr": 789, 2024-08-20T01:55:39.001 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_rd": 0, 2024-08-20T01:55:39.001 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_del": 278 2024-08-20T01:55:39.002 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:39.002 INFO:teuthology.orchestra.run.smithi175.stdout: "oft": { 2024-08-20T01:55:39.002 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_objs": 1, 2024-08-20T01:55:39.002 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_kv_pairs": 0, 2024-08-20T01:55:39.002 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_updates": 0, 2024-08-20T01:55:39.002 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_removes": 0 2024-08-20T01:55:39.002 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:39.002 INFO:teuthology.orchestra.run.smithi175.stdout: "purge_queue": { 2024-08-20T01:55:39.002 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops": 25, 2024-08-20T01:55:39.002 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops_high_water": 25, 2024-08-20T01:55:39.002 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing": 1, 2024-08-20T01:55:39.003 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_high_water": 1, 2024-08-20T01:55:39.003 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed_ops": 600, 2024-08-20T01:55:39.003 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed": 24, 2024-08-20T01:55:39.003 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_item_in_journal": 6 2024-08-20T01:55:39.003 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:39.003 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-20T01:55:39.003 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-08-20T01:55:39.003 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-08-20T01:55:39.003 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-08-20T01:55:39.003 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 11746, 2024-08-20T01:55:39.003 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 4234707, 2024-08-20T01:55:39.003 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:39.004 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 11746, 2024-08-20T01:55:39.004 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-08-20T01:55:39.004 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-08-20T01:55:39.004 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 11746, 2024-08-20T01:55:39.004 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 4234707, 2024-08-20T01:55:39.004 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-08-20T01:55:39.004 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:39.004 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:39.004 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:39.004 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-08-20T01:55:39.004 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:39.004 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_bytes": { 2024-08-20T01:55:39.004 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-08-20T01:55:39.005 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-08-20T01:55:39.005 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-08-20T01:55:39.005 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-08-20T01:55:39.005 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-08-20T01:55:39.005 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:39.005 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-08-20T01:55:39.005 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 3422, 2024-08-20T01:55:39.005 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 4334859, 2024-08-20T01:55:39.005 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 3412, 2024-08-20T01:55:39.005 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 4334859, 2024-08-20T01:55:39.005 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-08-20T01:55:39.005 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:39.006 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:39.006 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:39.006 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-08-20T01:55:39.006 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:39.006 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_ops": { 2024-08-20T01:55:39.006 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 10, 2024-08-20T01:55:39.006 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 1024, 2024-08-20T01:55:39.006 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-08-20T01:55:39.006 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-08-20T01:55:39.006 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-08-20T01:55:39.006 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:39.007 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-08-20T01:55:39.007 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 3422, 2024-08-20T01:55:39.007 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 3422, 2024-08-20T01:55:39.007 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 3412, 2024-08-20T01:55:39.007 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 3412, 2024-08-20T01:55:39.007 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-08-20T01:55:39.007 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:39.007 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:39.007 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:39.007 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-08-20T01:55:39.007 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:39.007 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle": { 2024-08-20T01:55:39.008 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-08-20T01:55:39.008 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-08-20T01:55:39.008 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-08-20T01:55:39.008 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 30, 2024-08-20T01:55:39.008 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 3038, 2024-08-20T01:55:39.008 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:39.008 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 30, 2024-08-20T01:55:39.008 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-08-20T01:55:39.008 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-08-20T01:55:39.008 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 2, 2024-08-20T01:55:39.008 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 3038, 2024-08-20T01:55:39.008 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-08-20T01:55:39.008 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:39.008 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:39.009 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:39.009 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-08-20T01:55:39.009 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:39.009 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle-0x5580b5c886e0": { 2024-08-20T01:55:39.009 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-08-20T01:55:39.009 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-08-20T01:55:39.009 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-08-20T01:55:39.009 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 2063, 2024-08-20T01:55:39.009 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 4191515, 2024-08-20T01:55:39.009 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:39.009 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 2063, 2024-08-20T01:55:39.009 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-08-20T01:55:39.009 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-08-20T01:55:39.010 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 1390, 2024-08-20T01:55:39.010 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 4191515, 2024-08-20T01:55:39.010 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-08-20T01:55:39.010 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:39.010 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:39.010 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:39.010 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-08-20T01:55:39.010 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:39.010 INFO:teuthology.orchestra.run.smithi175.stdout: "trackedop": { 2024-08-20T01:55:39.010 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_ops_count": 2 2024-08-20T01:55:39.010 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-08-20T01:55:39.010 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-08-20T01:55:39.629 INFO:tasks.check_counter:Daemon mds.i mds.exported=15 2024-08-20T01:55:39.629 INFO:tasks.check_counter:Daemon mds.i mds.imported=11 2024-08-20T01:55:39.629 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=33 2024-08-20T01:55:39.629 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=311 2024-08-20T01:55:39.629 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=1 2024-08-20T01:55:39.629 DEBUG:tasks.check_counter:Getting stats from l 2024-08-20T01:55:39.629 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph daemon mds.l perf dump 2024-08-20T01:55:39.883 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T01:55:40.405 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-08-20T01:55:40.405 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-0": { 2024-08-20T01:55:40.405 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 1321, 2024-08-20T01:55:40.405 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 1323, 2024-08-20T01:55:40.405 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 4623179, 2024-08-20T01:55:40.405 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 420088, 2024-08-20T01:55:40.405 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 7, 2024-08-20T01:55:40.405 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 2, 2024-08-20T01:55:40.406 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.163371266, 2024-08-20T01:55:40.406 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.069631614, 2024-08-20T01:55:40.406 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.038712129, 2024-08-20T01:55:40.406 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.041951255, 2024-08-20T01:55:40.406 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:55:40.406 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1321, 2024-08-20T01:55:40.406 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.064477691, 2024-08-20T01:55:40.406 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000048809 2024-08-20T01:55:40.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.406 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:55:40.406 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:40.406 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:40.406 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:40.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.407 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-20T01:55:40.407 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 0 2024-08-20T01:55:40.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.407 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-1": { 2024-08-20T01:55:40.407 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 1462, 2024-08-20T01:55:40.407 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 1720, 2024-08-20T01:55:40.407 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 1819603, 2024-08-20T01:55:40.407 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 998128, 2024-08-20T01:55:40.407 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 5, 2024-08-20T01:55:40.407 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 4, 2024-08-20T01:55:40.407 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.142376379, 2024-08-20T01:55:40.408 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.070506896, 2024-08-20T01:55:40.408 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.027107045, 2024-08-20T01:55:40.408 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.034779398, 2024-08-20T01:55:40.408 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:55:40.408 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1719, 2024-08-20T01:55:40.408 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.069017779, 2024-08-20T01:55:40.408 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000040149 2024-08-20T01:55:40.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.408 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:55:40.408 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:40.408 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:40.408 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:40.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.409 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-08-20T01:55:40.409 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 534736 2024-08-20T01:55:40.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.409 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-2": { 2024-08-20T01:55:40.409 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 1302, 2024-08-20T01:55:40.409 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 1255, 2024-08-20T01:55:40.409 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 5294173, 2024-08-20T01:55:40.409 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 500591, 2024-08-20T01:55:40.409 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 3, 2024-08-20T01:55:40.409 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 2, 2024-08-20T01:55:40.409 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.142177694, 2024-08-20T01:55:40.409 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.072867620, 2024-08-20T01:55:40.409 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.050616976, 2024-08-20T01:55:40.409 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.019106218, 2024-08-20T01:55:40.410 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T01:55:40.410 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1254, 2024-08-20T01:55:40.410 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.051964649, 2024-08-20T01:55:40.410 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000041439 2024-08-20T01:55:40.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.410 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-08-20T01:55:40.410 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:40.410 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:40.410 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:40.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.410 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 868032, 2024-08-20T01:55:40.410 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 212800 2024-08-20T01:55:40.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.411 INFO:teuthology.orchestra.run.smithi175.stdout: "cct": { 2024-08-20T01:55:40.411 INFO:teuthology.orchestra.run.smithi175.stdout: "total_workers": 1, 2024-08-20T01:55:40.411 INFO:teuthology.orchestra.run.smithi175.stdout: "unhealthy_workers": 0 2024-08-20T01:55:40.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.411 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-MDSRank": { 2024-08-20T01:55:40.411 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-08-20T01:55:40.411 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-08-20T01:55:40.411 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 6134, 2024-08-20T01:55:40.411 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.157451428, 2024-08-20T01:55:40.411 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000025668 2024-08-20T01:55:40.411 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-08-20T01:55:40.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.411 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-PurgeQueue": { 2024-08-20T01:55:40.412 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-08-20T01:55:40.412 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-08-20T01:55:40.412 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:40.412 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:40.412 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:40.412 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-08-20T01:55:40.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.412 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": { 2024-08-20T01:55:40.412 INFO:teuthology.orchestra.run.smithi175.stdout: "request": 0, 2024-08-20T01:55:40.412 INFO:teuthology.orchestra.run.smithi175.stdout: "reply": 0, 2024-08-20T01:55:40.412 INFO:teuthology.orchestra.run.smithi175.stdout: "reply_latency": { 2024-08-20T01:55:40.412 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:40.412 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:40.413 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:40.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.413 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_reply": 0, 2024-08-20T01:55:40.413 INFO:teuthology.orchestra.run.smithi175.stdout: "forward": 0, 2024-08-20T01:55:40.413 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_complete": 0, 2024-08-20T01:55:40.413 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_keys": 0, 2024-08-20T01:55:40.413 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_commit": 0, 2024-08-20T01:55:40.413 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_split": 0, 2024-08-20T01:55:40.413 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_merge": 0, 2024-08-20T01:55:40.413 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes": 657, 2024-08-20T01:55:40.413 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_top": 422, 2024-08-20T01:55:40.413 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_bottom": 235, 2024-08-20T01:55:40.413 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pin_tail": 0, 2024-08-20T01:55:40.413 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pinned": 54, 2024-08-20T01:55:40.414 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_expired": 0, 2024-08-20T01:55:40.414 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_with_caps": 0, 2024-08-20T01:55:40.414 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": 0, 2024-08-20T01:55:40.414 INFO:teuthology.orchestra.run.smithi175.stdout: "subtrees": 3, 2024-08-20T01:55:40.414 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse": 0, 2024-08-20T01:55:40.414 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_hit": 0, 2024-08-20T01:55:40.414 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_forward": 0, 2024-08-20T01:55:40.414 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_discover": 0, 2024-08-20T01:55:40.414 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_dir_fetch": 0, 2024-08-20T01:55:40.414 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_remote_ino": 0, 2024-08-20T01:55:40.414 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_lock": 0, 2024-08-20T01:55:40.414 INFO:teuthology.orchestra.run.smithi175.stdout: "load_cent": 0, 2024-08-20T01:55:40.414 INFO:teuthology.orchestra.run.smithi175.stdout: "q": 0, 2024-08-20T01:55:40.415 INFO:teuthology.orchestra.run.smithi175.stdout: "exported": 0, 2024-08-20T01:55:40.415 INFO:teuthology.orchestra.run.smithi175.stdout: "exported_inodes": 0, 2024-08-20T01:55:40.415 INFO:teuthology.orchestra.run.smithi175.stdout: "imported": 0, 2024-08-20T01:55:40.415 INFO:teuthology.orchestra.run.smithi175.stdout: "imported_inodes": 0, 2024-08-20T01:55:40.415 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_dir_fetch": 0, 2024-08-20T01:55:40.415 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_backtrace_fetch": 0, 2024-08-20T01:55:40.415 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_peer_discover": 0, 2024-08-20T01:55:40.415 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rfiles": 4, 2024-08-20T01:55:40.415 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rbytes": 234, 2024-08-20T01:55:40.415 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rsnaps": 0, 2024-08-20T01:55:40.415 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_fetch": 0, 2024-08-20T01:55:40.415 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_set_tag": 0, 2024-08-20T01:55:40.415 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_repaired": 0, 2024-08-20T01:55:40.415 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_inotable_repaired": 0, 2024-08-20T01:55:40.416 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_inodes": 0, 2024-08-20T01:55:40.416 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_base_inodes": 0, 2024-08-20T01:55:40.416 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dirfrag_rstats": 0, 2024-08-20T01:55:40.416 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_file_inodes": 0, 2024-08-20T01:55:40.416 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_inode_file_caps": 0, 2024-08-20T01:55:40.416 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_revoke": 0, 2024-08-20T01:55:40.416 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_grant": 0, 2024-08-20T01:55:40.416 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_trunc": 0, 2024-08-20T01:55:40.416 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-20T01:55:40.416 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-20T01:55:40.416 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps": 0, 2024-08-20T01:55:40.416 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps_dirty": 0, 2024-08-20T01:55:40.416 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_cap_release": 0, 2024-08-20T01:55:40.416 INFO:teuthology.orchestra.run.smithi175.stdout: "process_request_cap_release": 0 2024-08-20T01:55:40.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.417 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_cache": { 2024-08-20T01:55:40.417 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update": 0, 2024-08-20T01:55:40.417 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update_receipt": 0, 2024-08-20T01:55:40.417 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_try_discover": 0, 2024-08-20T01:55:40.417 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_send_discover": 0, 2024-08-20T01:55:40.417 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_handle_discover": 0, 2024-08-20T01:55:40.417 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays": 0, 2024-08-20T01:55:40.417 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_delayed": 0, 2024-08-20T01:55:40.417 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_enqueuing": 0, 2024-08-20T01:55:40.417 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_created": 0, 2024-08-20T01:55:40.417 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_enqueued": 0, 2024-08-20T01:55:40.418 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_reintegrated": 0, 2024-08-20T01:55:40.418 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_migrated": 0, 2024-08-20T01:55:40.418 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_processing": 0, 2024-08-20T01:55:40.418 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_enqueued": 0, 2024-08-20T01:55:40.418 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_prioritized": 0, 2024-08-20T01:55:40.418 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_started": 0, 2024-08-20T01:55:40.418 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_completed": 0, 2024-08-20T01:55:40.418 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_path": 0, 2024-08-20T01:55:40.418 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_inode": 0, 2024-08-20T01:55:40.418 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_enqueue_scrub": 0, 2024-08-20T01:55:40.418 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_exportdir": 0, 2024-08-20T01:55:40.418 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_flush": 0, 2024-08-20T01:55:40.418 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragmentdir": 0, 2024-08-20T01:55:40.419 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragstats": 0, 2024-08-20T01:55:40.419 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_inodestats": 0 2024-08-20T01:55:40.419 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.419 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_log": { 2024-08-20T01:55:40.419 INFO:teuthology.orchestra.run.smithi175.stdout: "evlrg": 0, 2024-08-20T01:55:40.419 INFO:teuthology.orchestra.run.smithi175.stdout: "evadd": 0, 2024-08-20T01:55:40.419 INFO:teuthology.orchestra.run.smithi175.stdout: "evex": 0, 2024-08-20T01:55:40.419 INFO:teuthology.orchestra.run.smithi175.stdout: "evtrm": 0, 2024-08-20T01:55:40.419 INFO:teuthology.orchestra.run.smithi175.stdout: "ev": 4369, 2024-08-20T01:55:40.419 INFO:teuthology.orchestra.run.smithi175.stdout: "evexg": 0, 2024-08-20T01:55:40.419 INFO:teuthology.orchestra.run.smithi175.stdout: "evexd": 0, 2024-08-20T01:55:40.419 INFO:teuthology.orchestra.run.smithi175.stdout: "segadd": 0, 2024-08-20T01:55:40.420 INFO:teuthology.orchestra.run.smithi175.stdout: "segex": 0, 2024-08-20T01:55:40.420 INFO:teuthology.orchestra.run.smithi175.stdout: "segtrm": 0, 2024-08-20T01:55:40.420 INFO:teuthology.orchestra.run.smithi175.stdout: "seg": 2, 2024-08-20T01:55:40.420 INFO:teuthology.orchestra.run.smithi175.stdout: "segmjr": 73, 2024-08-20T01:55:40.420 INFO:teuthology.orchestra.run.smithi175.stdout: "segexg": 0, 2024-08-20T01:55:40.420 INFO:teuthology.orchestra.run.smithi175.stdout: "segexd": 0, 2024-08-20T01:55:40.420 INFO:teuthology.orchestra.run.smithi175.stdout: "expos": 13967937, 2024-08-20T01:55:40.420 INFO:teuthology.orchestra.run.smithi175.stdout: "wrpos": 14034333, 2024-08-20T01:55:40.420 INFO:teuthology.orchestra.run.smithi175.stdout: "rdpos": 14033734, 2024-08-20T01:55:40.420 INFO:teuthology.orchestra.run.smithi175.stdout: "jlat": { 2024-08-20T01:55:40.420 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:40.420 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:40.421 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:40.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.421 INFO:teuthology.orchestra.run.smithi175.stdout: "replayed": 4369 2024-08-20T01:55:40.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.421 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_mem": { 2024-08-20T01:55:40.421 INFO:teuthology.orchestra.run.smithi175.stdout: "ino": 16, 2024-08-20T01:55:40.421 INFO:teuthology.orchestra.run.smithi175.stdout: "ino+": 896, 2024-08-20T01:55:40.421 INFO:teuthology.orchestra.run.smithi175.stdout: "ino-": 880, 2024-08-20T01:55:40.421 INFO:teuthology.orchestra.run.smithi175.stdout: "dir": 12, 2024-08-20T01:55:40.421 INFO:teuthology.orchestra.run.smithi175.stdout: "dir+": 130, 2024-08-20T01:55:40.421 INFO:teuthology.orchestra.run.smithi175.stdout: "dir-": 118, 2024-08-20T01:55:40.421 INFO:teuthology.orchestra.run.smithi175.stdout: "dn": 657, 2024-08-20T01:55:40.421 INFO:teuthology.orchestra.run.smithi175.stdout: "dn+": 1254, 2024-08-20T01:55:40.422 INFO:teuthology.orchestra.run.smithi175.stdout: "dn-": 597, 2024-08-20T01:55:40.422 INFO:teuthology.orchestra.run.smithi175.stdout: "cap": 0, 2024-08-20T01:55:40.422 INFO:teuthology.orchestra.run.smithi175.stdout: "cap+": 0, 2024-08-20T01:55:40.422 INFO:teuthology.orchestra.run.smithi175.stdout: "cap-": 0, 2024-08-20T01:55:40.422 INFO:teuthology.orchestra.run.smithi175.stdout: "rss": 52104, 2024-08-20T01:55:40.422 INFO:teuthology.orchestra.run.smithi175.stdout: "heap": 252497920 2024-08-20T01:55:40.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.422 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_server": { 2024-08-20T01:55:40.422 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_client_request": 0, 2024-08-20T01:55:40.422 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_server_request": 0, 2024-08-20T01:55:40.422 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_request": 0, 2024-08-20T01:55:40.422 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_session": 0, 2024-08-20T01:55:40.422 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_peer_request": 0, 2024-08-20T01:55:40.423 INFO:teuthology.orchestra.run.smithi175.stdout: "req_create_latency": { 2024-08-20T01:55:40.423 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:40.423 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:40.423 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:40.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.423 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getattr_latency": { 2024-08-20T01:55:40.423 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:40.423 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:40.423 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:40.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.423 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getfilelock_latency": { 2024-08-20T01:55:40.423 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:40.423 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:40.424 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:40.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.424 INFO:teuthology.orchestra.run.smithi175.stdout: "req_link_latency": { 2024-08-20T01:55:40.424 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:40.424 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:40.424 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:40.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.424 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookup_latency": { 2024-08-20T01:55:40.424 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:40.424 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:40.424 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:40.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.424 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookuphash_latency": { 2024-08-20T01:55:40.424 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:40.425 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:40.425 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:40.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.425 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupino_latency": { 2024-08-20T01:55:40.425 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:40.425 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:40.425 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:40.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.425 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupname_latency": { 2024-08-20T01:55:40.425 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:40.425 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:40.426 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:40.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.426 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupparent_latency": { 2024-08-20T01:55:40.426 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:40.426 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:40.426 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:40.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.426 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupsnap_latency": { 2024-08-20T01:55:40.426 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:40.426 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:40.426 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:40.427 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.427 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lssnap_latency": { 2024-08-20T01:55:40.427 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:40.427 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:40.427 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:40.427 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.427 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mkdir_latency": { 2024-08-20T01:55:40.427 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:40.427 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:40.427 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:40.427 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.428 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mknod_latency": { 2024-08-20T01:55:40.428 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:40.428 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:40.428 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:40.428 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.428 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mksnap_latency": { 2024-08-20T01:55:40.428 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:40.428 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:40.428 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:40.428 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.428 INFO:teuthology.orchestra.run.smithi175.stdout: "req_open_latency": { 2024-08-20T01:55:40.429 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:40.429 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:40.429 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:40.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.429 INFO:teuthology.orchestra.run.smithi175.stdout: "req_readdir_latency": { 2024-08-20T01:55:40.429 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:40.429 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:40.429 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:40.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.429 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rename_latency": { 2024-08-20T01:55:40.429 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:40.429 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:40.430 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:40.430 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.430 INFO:teuthology.orchestra.run.smithi175.stdout: "req_renamesnap_latency": { 2024-08-20T01:55:40.430 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:40.430 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:40.430 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:40.430 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.430 INFO:teuthology.orchestra.run.smithi175.stdout: "req_snapdiff_latency": { 2024-08-20T01:55:40.430 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:40.430 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:40.430 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:40.430 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.431 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmdir_latency": { 2024-08-20T01:55:40.431 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:40.431 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:40.431 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:40.431 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.431 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmsnap_latency": { 2024-08-20T01:55:40.431 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:40.431 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:40.431 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:40.431 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.431 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmxattr_latency": { 2024-08-20T01:55:40.431 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:40.432 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:40.432 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:40.432 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.432 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setattr_latency": { 2024-08-20T01:55:40.432 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:40.432 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:40.432 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:40.432 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.432 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setdirlayout_latency": { 2024-08-20T01:55:40.432 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:40.432 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:40.432 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:40.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.433 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setfilelock_latency": { 2024-08-20T01:55:40.433 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:40.433 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:40.433 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:40.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.433 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setlayout_latency": { 2024-08-20T01:55:40.433 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:40.433 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:40.433 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:40.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.433 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setxattr_latency": { 2024-08-20T01:55:40.433 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:40.434 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:40.434 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:40.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.434 INFO:teuthology.orchestra.run.smithi175.stdout: "req_symlink_latency": { 2024-08-20T01:55:40.434 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:40.434 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:40.434 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:40.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.434 INFO:teuthology.orchestra.run.smithi175.stdout: "req_unlink_latency": { 2024-08-20T01:55:40.434 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:40.434 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:40.434 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:40.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.435 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_revoke_eviction": 0, 2024-08-20T01:55:40.435 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_acquisition_throttle": 0, 2024-08-20T01:55:40.435 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getvxattr_latency": { 2024-08-20T01:55:40.435 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:40.435 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:40.435 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:40.435 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-08-20T01:55:40.435 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.435 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_sessions": { 2024-08-20T01:55:40.435 INFO:teuthology.orchestra.run.smithi175.stdout: "session_count": 1, 2024-08-20T01:55:40.435 INFO:teuthology.orchestra.run.smithi175.stdout: "session_add": 2, 2024-08-20T01:55:40.435 INFO:teuthology.orchestra.run.smithi175.stdout: "session_remove": 1, 2024-08-20T01:55:40.435 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_open": 1, 2024-08-20T01:55:40.436 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_stale": 0, 2024-08-20T01:55:40.436 INFO:teuthology.orchestra.run.smithi175.stdout: "total_load": 0, 2024-08-20T01:55:40.436 INFO:teuthology.orchestra.run.smithi175.stdout: "average_load": 0, 2024-08-20T01:55:40.436 INFO:teuthology.orchestra.run.smithi175.stdout: "avg_session_uptime": 2111, 2024-08-20T01:55:40.436 INFO:teuthology.orchestra.run.smithi175.stdout: "mdthresh_evicted": 0 2024-08-20T01:55:40.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.436 INFO:teuthology.orchestra.run.smithi175.stdout: "mempool": { 2024-08-20T01:55:40.436 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_bytes": 0, 2024-08-20T01:55:40.436 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_items": 0, 2024-08-20T01:55:40.436 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_bytes": 0, 2024-08-20T01:55:40.436 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_items": 0, 2024-08-20T01:55:40.436 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_bytes": 0, 2024-08-20T01:55:40.436 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_items": 0, 2024-08-20T01:55:40.437 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-20T01:55:40.437 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_items": 0, 2024-08-20T01:55:40.437 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-20T01:55:40.437 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_items": 0, 2024-08-20T01:55:40.437 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_bytes": 0, 2024-08-20T01:55:40.437 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_items": 0, 2024-08-20T01:55:40.437 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-20T01:55:40.437 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_items": 0, 2024-08-20T01:55:40.437 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_bytes": 0, 2024-08-20T01:55:40.437 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_items": 0, 2024-08-20T01:55:40.437 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_bytes": 0, 2024-08-20T01:55:40.437 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_items": 0, 2024-08-20T01:55:40.437 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-20T01:55:40.438 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_items": 0, 2024-08-20T01:55:40.438 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-20T01:55:40.438 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_items": 0, 2024-08-20T01:55:40.438 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_bytes": 0, 2024-08-20T01:55:40.438 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_items": 0, 2024-08-20T01:55:40.438 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_bytes": 0, 2024-08-20T01:55:40.438 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_items": 0, 2024-08-20T01:55:40.438 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-20T01:55:40.438 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_items": 0, 2024-08-20T01:55:40.438 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_bytes": 0, 2024-08-20T01:55:40.438 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_items": 0, 2024-08-20T01:55:40.438 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_bytes": 0, 2024-08-20T01:55:40.438 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_items": 0, 2024-08-20T01:55:40.439 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_bytes": 0, 2024-08-20T01:55:40.439 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_items": 0, 2024-08-20T01:55:40.439 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_bytes": 0, 2024-08-20T01:55:40.439 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_items": 0, 2024-08-20T01:55:40.439 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_bytes": 190247, 2024-08-20T01:55:40.439 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_items": 54, 2024-08-20T01:55:40.439 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_bytes": 0, 2024-08-20T01:55:40.439 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_items": 0, 2024-08-20T01:55:40.439 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_bytes": 0, 2024-08-20T01:55:40.439 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_items": 0, 2024-08-20T01:55:40.439 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_bytes": 0, 2024-08-20T01:55:40.439 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_items": 0, 2024-08-20T01:55:40.439 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_bytes": 0, 2024-08-20T01:55:40.440 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_items": 0, 2024-08-20T01:55:40.440 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_bytes": 7496, 2024-08-20T01:55:40.440 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_items": 154, 2024-08-20T01:55:40.440 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_bytes": 0, 2024-08-20T01:55:40.440 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_items": 0, 2024-08-20T01:55:40.440 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_bytes": 0, 2024-08-20T01:55:40.440 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_items": 0, 2024-08-20T01:55:40.440 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_bytes": 498005, 2024-08-20T01:55:40.440 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_items": 2808, 2024-08-20T01:55:40.440 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_bytes": 0, 2024-08-20T01:55:40.440 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_items": 0, 2024-08-20T01:55:40.440 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_bytes": 0, 2024-08-20T01:55:40.440 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_items": 0 2024-08-20T01:55:40.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.441 INFO:teuthology.orchestra.run.smithi175.stdout: "objecter": { 2024-08-20T01:55:40.441 INFO:teuthology.orchestra.run.smithi175.stdout: "op_active": 0, 2024-08-20T01:55:40.441 INFO:teuthology.orchestra.run.smithi175.stdout: "op_laggy": 0, 2024-08-20T01:55:40.441 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send": 3683, 2024-08-20T01:55:40.441 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send_bytes": 26, 2024-08-20T01:55:40.441 INFO:teuthology.orchestra.run.smithi175.stdout: "op_resend": 4, 2024-08-20T01:55:40.441 INFO:teuthology.orchestra.run.smithi175.stdout: "op_reply": 3683, 2024-08-20T01:55:40.441 INFO:teuthology.orchestra.run.smithi175.stdout: "op_latency": { 2024-08-20T01:55:40.441 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 3683, 2024-08-20T01:55:40.441 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 117.689241156, 2024-08-20T01:55:40.441 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.031954722 2024-08-20T01:55:40.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.442 INFO:teuthology.orchestra.run.smithi175.stdout: "op_inflight": 0, 2024-08-20T01:55:40.442 INFO:teuthology.orchestra.run.smithi175.stdout: "oplen_avg": { 2024-08-20T01:55:40.442 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 3683, 2024-08-20T01:55:40.442 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 3684 2024-08-20T01:55:40.442 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.442 INFO:teuthology.orchestra.run.smithi175.stdout: "op": 3683, 2024-08-20T01:55:40.442 INFO:teuthology.orchestra.run.smithi175.stdout: "op_r": 3683, 2024-08-20T01:55:40.442 INFO:teuthology.orchestra.run.smithi175.stdout: "op_w": 0, 2024-08-20T01:55:40.442 INFO:teuthology.orchestra.run.smithi175.stdout: "op_rmw": 0, 2024-08-20T01:55:40.442 INFO:teuthology.orchestra.run.smithi175.stdout: "op_pg": 0, 2024-08-20T01:55:40.442 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_stat": 2225, 2024-08-20T01:55:40.442 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_create": 0, 2024-08-20T01:55:40.442 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_read": 1455, 2024-08-20T01:55:40.443 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_write": 0, 2024-08-20T01:55:40.443 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writefull": 0, 2024-08-20T01:55:40.443 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writesame": 0, 2024-08-20T01:55:40.443 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_append": 0, 2024-08-20T01:55:40.443 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_zero": 0, 2024-08-20T01:55:40.443 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_truncate": 0, 2024-08-20T01:55:40.443 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_delete": 0, 2024-08-20T01:55:40.443 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_mapext": 0, 2024-08-20T01:55:40.443 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_sparse_read": 0, 2024-08-20T01:55:40.443 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_clonerange": 0, 2024-08-20T01:55:40.443 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_getxattr": 2, 2024-08-20T01:55:40.443 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_setxattr": 0, 2024-08-20T01:55:40.444 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_cmpxattr": 0, 2024-08-20T01:55:40.444 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_rmxattr": 0, 2024-08-20T01:55:40.444 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_resetxattrs": 0, 2024-08-20T01:55:40.444 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_call": 0, 2024-08-20T01:55:40.444 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_watch": 0, 2024-08-20T01:55:40.444 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_notify": 0, 2024-08-20T01:55:40.444 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_src_cmpxattr": 0, 2024-08-20T01:55:40.444 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls": 0, 2024-08-20T01:55:40.444 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls_filter": 0, 2024-08-20T01:55:40.444 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_other": 0, 2024-08-20T01:55:40.444 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_active": 0, 2024-08-20T01:55:40.444 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_send": 0, 2024-08-20T01:55:40.445 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_resend": 0, 2024-08-20T01:55:40.445 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_ping": 0, 2024-08-20T01:55:40.445 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_active": 0, 2024-08-20T01:55:40.445 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_send": 0, 2024-08-20T01:55:40.445 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_resend": 0, 2024-08-20T01:55:40.445 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_active": 0, 2024-08-20T01:55:40.445 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_send": 0, 2024-08-20T01:55:40.445 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_resend": 0, 2024-08-20T01:55:40.445 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_active": 0, 2024-08-20T01:55:40.445 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_send": 0, 2024-08-20T01:55:40.445 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_resend": 0, 2024-08-20T01:55:40.445 INFO:teuthology.orchestra.run.smithi175.stdout: "command_active": 0, 2024-08-20T01:55:40.445 INFO:teuthology.orchestra.run.smithi175.stdout: "command_send": 0, 2024-08-20T01:55:40.445 INFO:teuthology.orchestra.run.smithi175.stdout: "command_resend": 0, 2024-08-20T01:55:40.446 INFO:teuthology.orchestra.run.smithi175.stdout: "map_epoch": 74, 2024-08-20T01:55:40.446 INFO:teuthology.orchestra.run.smithi175.stdout: "map_full": 0, 2024-08-20T01:55:40.446 INFO:teuthology.orchestra.run.smithi175.stdout: "map_inc": 2, 2024-08-20T01:55:40.446 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_sessions": 5, 2024-08-20T01:55:40.446 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_open": 6, 2024-08-20T01:55:40.446 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_close": 1, 2024-08-20T01:55:40.446 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_laggy": 0, 2024-08-20T01:55:40.446 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_wr": 0, 2024-08-20T01:55:40.446 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_rd": 2, 2024-08-20T01:55:40.446 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_del": 0 2024-08-20T01:55:40.446 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.447 INFO:teuthology.orchestra.run.smithi175.stdout: "oft": { 2024-08-20T01:55:40.447 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_objs": 0, 2024-08-20T01:55:40.447 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_kv_pairs": 0, 2024-08-20T01:55:40.447 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_updates": 0, 2024-08-20T01:55:40.447 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_removes": 0 2024-08-20T01:55:40.447 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.447 INFO:teuthology.orchestra.run.smithi175.stdout: "purge_queue": { 2024-08-20T01:55:40.447 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops": 0, 2024-08-20T01:55:40.447 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops_high_water": 0, 2024-08-20T01:55:40.447 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing": 0, 2024-08-20T01:55:40.447 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_high_water": 0, 2024-08-20T01:55:40.447 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed_ops": 0, 2024-08-20T01:55:40.447 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed": 0, 2024-08-20T01:55:40.448 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_item_in_journal": 0 2024-08-20T01:55:40.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.448 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-20T01:55:40.448 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-08-20T01:55:40.448 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-08-20T01:55:40.448 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-08-20T01:55:40.448 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 4081, 2024-08-20T01:55:40.448 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 11346475, 2024-08-20T01:55:40.448 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:40.448 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 4081, 2024-08-20T01:55:40.448 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-08-20T01:55:40.448 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-08-20T01:55:40.448 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 4081, 2024-08-20T01:55:40.448 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 11346475, 2024-08-20T01:55:40.448 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-08-20T01:55:40.449 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:40.449 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:40.449 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:40.449 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-08-20T01:55:40.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.449 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_bytes": { 2024-08-20T01:55:40.449 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-08-20T01:55:40.449 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-08-20T01:55:40.449 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-08-20T01:55:40.449 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-08-20T01:55:40.449 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-08-20T01:55:40.449 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:40.450 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-08-20T01:55:40.450 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 3683, 2024-08-20T01:55:40.450 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 9840039, 2024-08-20T01:55:40.450 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 3683, 2024-08-20T01:55:40.450 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 9840039, 2024-08-20T01:55:40.450 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-08-20T01:55:40.450 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:40.450 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:40.450 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:40.450 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-08-20T01:55:40.450 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.450 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_ops": { 2024-08-20T01:55:40.450 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-08-20T01:55:40.451 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 1024, 2024-08-20T01:55:40.451 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-08-20T01:55:40.451 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-08-20T01:55:40.451 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-08-20T01:55:40.451 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:40.451 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-08-20T01:55:40.451 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 3683, 2024-08-20T01:55:40.451 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 3683, 2024-08-20T01:55:40.451 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 3683, 2024-08-20T01:55:40.451 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 3683, 2024-08-20T01:55:40.451 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-08-20T01:55:40.451 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:40.451 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:40.452 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:40.452 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-08-20T01:55:40.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.452 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle": { 2024-08-20T01:55:40.452 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-08-20T01:55:40.452 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-08-20T01:55:40.452 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-08-20T01:55:40.452 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-08-20T01:55:40.452 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-08-20T01:55:40.452 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:40.452 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-08-20T01:55:40.453 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-08-20T01:55:40.453 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-08-20T01:55:40.453 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 0, 2024-08-20T01:55:40.453 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 0, 2024-08-20T01:55:40.453 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-08-20T01:55:40.453 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:40.453 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:40.453 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:40.453 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-08-20T01:55:40.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.453 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle-0x55a8ab72e960": { 2024-08-20T01:55:40.453 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-08-20T01:55:40.453 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-08-20T01:55:40.454 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-08-20T01:55:40.454 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-08-20T01:55:40.454 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-08-20T01:55:40.454 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-08-20T01:55:40.454 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-08-20T01:55:40.454 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-08-20T01:55:40.454 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-08-20T01:55:40.454 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 0, 2024-08-20T01:55:40.454 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 0, 2024-08-20T01:55:40.454 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-08-20T01:55:40.455 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-08-20T01:55:40.455 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-08-20T01:55:40.455 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-08-20T01:55:40.455 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-08-20T01:55:40.455 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-08-20T01:55:40.455 INFO:teuthology.orchestra.run.smithi175.stdout: "trackedop": { 2024-08-20T01:55:40.455 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_ops_count": 0 2024-08-20T01:55:40.455 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-08-20T01:55:40.455 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-08-20T01:55:40.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:40 smithi175 ceph-mon[22392]: pgmap v897: 97 pgs: 97 active+clean; 1.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 20 op/s 2024-08-20T01:55:40.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:40 smithi081 ceph-mon[22209]: pgmap v897: 97 pgs: 97 active+clean; 1.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 20 op/s 2024-08-20T01:55:40.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:40 smithi079 ceph-mon[18656]: pgmap v897: 97 pgs: 97 active+clean; 1.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 20 op/s 2024-08-20T01:55:41.153 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-08-20T01:55:41.153 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-08-20T01:55:41.153 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2024-08-20T01:55:41.153 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2024-08-20T01:55:41.153 INFO:tasks.check_counter:Daemon mds.l mds.dir_split=0 2024-08-20T01:55:41.153 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-08-20T01:55:41.165 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-08-20T01:55:41.165 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-08-20T01:55:41.165 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-20T01:55:41.200 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-08-20T01:55:41.200 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-20T01:55:41.257 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph osd blocklist ls 2024-08-20T01:55:41.547 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:55:42.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.073+0000 7fd2c7450640 1 -- 172.21.15.79:0/3088788003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2c0107d20 msgr2=0x7fd2c010e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:42.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.073+0000 7fd2c7450640 1 --2- 172.21.15.79:0/3088788003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2c0107d20 0x7fd2c010e520 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8009ca0 tx=0x7fd2b802a8c0 comp rx=0 tx=0).stop 2024-08-20T01:55:42.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.073+0000 7fd2c7450640 1 -- 172.21.15.79:0/3088788003 shutdown_connections 2024-08-20T01:55:42.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.073+0000 7fd2c7450640 1 --2- 172.21.15.79:0/3088788003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2c0107d20 0x7fd2c010e520 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:42.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.073+0000 7fd2c7450640 1 --2- 172.21.15.79:0/3088788003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2c01073a0 0x7fd2c01077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:42.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.073+0000 7fd2c7450640 1 --2- 172.21.15.79:0/3088788003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2c0101990 0x7fd2c0101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:42.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.074+0000 7fd2c7450640 1 -- 172.21.15.79:0/3088788003 >> 172.21.15.79:0/3088788003 conn(0x7fd2c00fd400 msgr2=0x7fd2c00ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:42.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.074+0000 7fd2c7450640 1 -- 172.21.15.79:0/3088788003 shutdown_connections 2024-08-20T01:55:42.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.074+0000 7fd2c7450640 1 -- 172.21.15.79:0/3088788003 wait complete. 2024-08-20T01:55:42.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.074+0000 7fd2c7450640 1 Processor -- start 2024-08-20T01:55:42.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.074+0000 7fd2c7450640 1 -- start start 2024-08-20T01:55:42.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.075+0000 7fd2c7450640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2c0101990 0x7fd2c0198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:42.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.075+0000 7fd2c7450640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2c01073a0 0x7fd2c0199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:42.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.075+0000 7fd2c7450640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2c0107d20 0x7fd2c019e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:42.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.075+0000 7fd2c7450640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c01118e0 con 0x7fd2c0101990 2024-08-20T01:55:42.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.075+0000 7fd2c7450640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c0111760 con 0x7fd2c0107d20 2024-08-20T01:55:42.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.075+0000 7fd2c7450640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c0111a60 con 0x7fd2c01073a0 2024-08-20T01:55:42.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.075+0000 7fd2c51ec640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2c0101990 0x7fd2c0198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:42.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.075+0000 7fd2c51ec640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2c0101990 0x7fd2c0198de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46294/0 (socket says 172.21.15.79:46294) 2024-08-20T01:55:42.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.075+0000 7fd2c51ec640 1 -- 172.21.15.79:0/4051821304 learned_addr learned my addr 172.21.15.79:0/4051821304 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:42.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.075+0000 7fd2c49eb640 1 --2- 172.21.15.79:0/4051821304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2c01073a0 0x7fd2c0199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:42.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.075+0000 7fd2c59ed640 1 --2- 172.21.15.79:0/4051821304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2c0107d20 0x7fd2c019e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:42.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.075+0000 7fd2c51ec640 1 -- 172.21.15.79:0/4051821304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2c01073a0 msgr2=0x7fd2c0199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:42.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.075+0000 7fd2c51ec640 1 --2- 172.21.15.79:0/4051821304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2c01073a0 0x7fd2c0199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:42.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.075+0000 7fd2c51ec640 1 -- 172.21.15.79:0/4051821304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2c0107d20 msgr2=0x7fd2c019e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:42.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.075+0000 7fd2c51ec640 1 --2- 172.21.15.79:0/4051821304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2c0107d20 0x7fd2c019e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:42.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.075+0000 7fd2c51ec640 1 -- 172.21.15.79:0/4051821304 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2c019ee90 con 0x7fd2c0101990 2024-08-20T01:55:42.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.075+0000 7fd2c51ec640 1 --2- 172.21.15.79:0/4051821304 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2c0101990 0x7fd2c0198de0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc00d950 tx=0x7fd2bc00dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:42.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.075+0000 7fd2b67fc640 1 -- 172.21.15.79:0/4051821304 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc017070 con 0x7fd2c0101990 2024-08-20T01:55:42.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.075+0000 7fd2c7450640 1 -- 172.21.15.79:0/4051821304 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2c019f180 con 0x7fd2c0101990 2024-08-20T01:55:42.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.075+0000 7fd2b67fc640 1 -- 172.21.15.79:0/4051821304 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd2bc00de80 con 0x7fd2c0101990 2024-08-20T01:55:42.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.076+0000 7fd2b67fc640 1 -- 172.21.15.79:0/4051821304 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc00f620 con 0x7fd2c0101990 2024-08-20T01:55:42.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.076+0000 7fd2c7450640 1 -- 172.21.15.79:0/4051821304 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2c01a5a10 con 0x7fd2c0101990 2024-08-20T01:55:42.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.077+0000 7fd2c7450640 1 -- 172.21.15.79:0/4051821304 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2c0101d70 con 0x7fd2c0101990 2024-08-20T01:55:42.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.078+0000 7fd2b67fc640 1 -- 172.21.15.79:0/4051821304 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fd2bc009c30 con 0x7fd2c0101990 2024-08-20T01:55:42.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.079+0000 7fd2b67fc640 1 --2- 172.21.15.79:0/4051821304 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd2ac0b3c50 0x7fd2ac0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:42.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.079+0000 7fd2c49eb640 1 --2- 172.21.15.79:0/4051821304 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd2ac0b3c50 0x7fd2ac0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:42.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.079+0000 7fd2b67fc640 1 -- 172.21.15.79:0/4051821304 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7fd2bc0e3730 con 0x7fd2c0101990 2024-08-20T01:55:42.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.079+0000 7fd2c49eb640 1 --2- 172.21.15.79:0/4051821304 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd2ac0b3c50 0x7fd2ac0b6110 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0106b40 tx=0x7fd2b000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:42.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.082+0000 7fd2b67fc640 1 -- 172.21.15.79:0/4051821304 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fd2bc0aae10 con 0x7fd2c0101990 2024-08-20T01:55:42.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.276+0000 7fd2c7450640 1 -- 172.21.15.79:0/4051821304 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd2c010ab70 con 0x7fd2c0101990 2024-08-20T01:55:42.279 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.277+0000 7fd2b67fc640 1 -- 172.21.15.79:0/4051821304 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v74) ==== 81+0+590 (secure 0 0 0) 0x7fd2bc0aa710 con 0x7fd2c0101990 2024-08-20T01:55:42.280 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/1750500064 2024-08-21T01:27:52.389553+0000 2024-08-20T01:55:42.280 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/103962305 2024-08-21T01:27:52.389553+0000 2024-08-20T01:55:42.280 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6800/4045769179 2024-08-21T01:27:29.643647+0000 2024-08-20T01:55:42.280 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/525482354 2024-08-21T01:27:52.389553+0000 2024-08-20T01:55:42.280 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6801/4045769179 2024-08-21T01:27:29.643647+0000 2024-08-20T01:55:42.280 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/1023212241 2024-08-21T01:27:29.643647+0000 2024-08-20T01:55:42.280 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/2368377219 2024-08-21T01:27:29.643647+0000 2024-08-20T01:55:42.280 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6801/3302536522 2024-08-21T01:27:52.389553+0000 2024-08-20T01:55:42.280 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6800/3302536522 2024-08-21T01:27:52.389553+0000 2024-08-20T01:55:42.281 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/3498829332 2024-08-21T01:27:29.643647+0000 2024-08-20T01:55:42.281 INFO:teuthology.orchestra.run.smithi079.stderr:listed 10 entries 2024-08-20T01:55:42.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.279+0000 7fd2c7450640 1 -- 172.21.15.79:0/4051821304 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd2ac0b3c50 msgr2=0x7fd2ac0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:42.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.279+0000 7fd2c7450640 1 --2- 172.21.15.79:0/4051821304 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd2ac0b3c50 0x7fd2ac0b6110 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0106b40 tx=0x7fd2b000a2d0 comp rx=0 tx=0).stop 2024-08-20T01:55:42.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.279+0000 7fd2c7450640 1 -- 172.21.15.79:0/4051821304 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2c0101990 msgr2=0x7fd2c0198de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:42.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.279+0000 7fd2c7450640 1 --2- 172.21.15.79:0/4051821304 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2c0101990 0x7fd2c0198de0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc00d950 tx=0x7fd2bc00dd50 comp rx=0 tx=0).stop 2024-08-20T01:55:42.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.279+0000 7fd2c7450640 1 -- 172.21.15.79:0/4051821304 shutdown_connections 2024-08-20T01:55:42.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.279+0000 7fd2c7450640 1 --2- 172.21.15.79:0/4051821304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2c0107d20 0x7fd2c019e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:42.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.279+0000 7fd2c7450640 1 --2- 172.21.15.79:0/4051821304 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fd2ac0b3c50 0x7fd2ac0b6110 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:42.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.279+0000 7fd2c7450640 1 --2- 172.21.15.79:0/4051821304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2c01073a0 0x7fd2c0199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:42.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.279+0000 7fd2c7450640 1 --2- 172.21.15.79:0/4051821304 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2c0101990 0x7fd2c0198de0 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:42.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.279+0000 7fd2c7450640 1 -- 172.21.15.79:0/4051821304 >> 172.21.15.79:0/4051821304 conn(0x7fd2c00fd400 msgr2=0x7fd2c006a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:42.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.279+0000 7fd2c7450640 1 -- 172.21.15.79:0/4051821304 shutdown_connections 2024-08-20T01:55:42.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:42.279+0000 7fd2c7450640 1 -- 172.21.15.79:0/4051821304 wait complete. 2024-08-20T01:55:42.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:42 smithi081 ceph-mon[22209]: pgmap v898: 97 pgs: 97 active+clean; 1.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 18 op/s 2024-08-20T01:55:42.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:42 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/4051821304' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-20T01:55:42.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:42 smithi175 ceph-mon[22392]: pgmap v898: 97 pgs: 97 active+clean; 1.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 18 op/s 2024-08-20T01:55:42.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:42 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/4051821304' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-20T01:55:42.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:42 smithi079 ceph-mon[18656]: pgmap v898: 97 pgs: 97 active+clean; 1.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 18 op/s 2024-08-20T01:55:42.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:42 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/4051821304' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-20T01:55:43.060 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-08-20T01:55:43.060 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-20T01:55:43.077 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph osd blocklist ls 2024-08-20T01:55:43.377 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:55:44.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:43.997+0000 7f1b42bc6640 1 -- 172.21.15.79:0/3574324003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b3c10cdc0 msgr2=0x7f1b3c10f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:44.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:43.997+0000 7f1b42bc6640 1 --2- 172.21.15.79:0/3574324003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b3c10cdc0 0x7f1b3c10f260 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f1b34009900 tx=0x7f1b3402a410 comp rx=0 tx=0).stop 2024-08-20T01:55:44.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:43.997+0000 7f1b42bc6640 1 -- 172.21.15.79:0/3574324003 shutdown_connections 2024-08-20T01:55:44.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:43.997+0000 7f1b42bc6640 1 --2- 172.21.15.79:0/3574324003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b3c10cdc0 0x7f1b3c10f260 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:44.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:43.997+0000 7f1b42bc6640 1 --2- 172.21.15.79:0/3574324003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b3c101f00 0x7f1b3c10c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:44.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:43.997+0000 7f1b42bc6640 1 --2- 172.21.15.79:0/3574324003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b3c101500 0x7f1b3c1018e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:44.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:43.997+0000 7f1b42bc6640 1 -- 172.21.15.79:0/3574324003 >> 172.21.15.79:0/3574324003 conn(0x7f1b3c076bd0 msgr2=0x7f1b3c076fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:44.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:43.997+0000 7f1b42bc6640 1 -- 172.21.15.79:0/3574324003 shutdown_connections 2024-08-20T01:55:44.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:43.997+0000 7f1b42bc6640 1 -- 172.21.15.79:0/3574324003 wait complete. 2024-08-20T01:55:44.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:43.997+0000 7f1b42bc6640 1 Processor -- start 2024-08-20T01:55:44.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:43.997+0000 7f1b42bc6640 1 -- start start 2024-08-20T01:55:44.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:43.998+0000 7f1b42bc6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b3c101500 0x7f1b3c198ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:44.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:43.998+0000 7f1b42bc6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b3c101f00 0x7f1b3c199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:44.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:43.998+0000 7f1b42bc6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b3c10cdc0 0x7f1b3c19e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:44.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:43.998+0000 7f1b42bc6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1b3c112920 con 0x7f1b3c10cdc0 2024-08-20T01:55:44.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:43.998+0000 7f1b42bc6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1b3c1127a0 con 0x7f1b3c101f00 2024-08-20T01:55:44.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:43.998+0000 7f1b42bc6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1b3c112aa0 con 0x7f1b3c101500 2024-08-20T01:55:44.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:43.998+0000 7f1b41163640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b3c10cdc0 0x7f1b3c19e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:44.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:43.998+0000 7f1b40962640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b3c101500 0x7f1b3c198ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:44.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:43.998+0000 7f1b3bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b3c101f00 0x7f1b3c199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:44.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:43.998+0000 7f1b41163640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b3c10cdc0 0x7f1b3c19e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46306/0 (socket says 172.21.15.79:46306) 2024-08-20T01:55:44.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:43.998+0000 7f1b40962640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b3c101500 0x7f1b3c198ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.79:49826/0 (socket says 172.21.15.79:49826) 2024-08-20T01:55:44.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:43.998+0000 7f1b41163640 1 -- 172.21.15.79:0/3445846621 learned_addr learned my addr 172.21.15.79:0/3445846621 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:44.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:43.998+0000 7f1b3bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b3c101f00 0x7f1b3c199430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.79:34222/0 (socket says 172.21.15.79:34222) 2024-08-20T01:55:44.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:43.998+0000 7f1b41163640 1 -- 172.21.15.79:0/3445846621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b3c101500 msgr2=0x7f1b3c198ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:44.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:43.998+0000 7f1b41163640 1 --2- 172.21.15.79:0/3445846621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b3c101500 0x7f1b3c198ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:44.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:43.998+0000 7f1b41163640 1 -- 172.21.15.79:0/3445846621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b3c101f00 msgr2=0x7f1b3c199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:44.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:43.998+0000 7f1b41163640 1 --2- 172.21.15.79:0/3445846621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b3c101f00 0x7f1b3c199430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:44.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:43.998+0000 7f1b41163640 1 -- 172.21.15.79:0/3445846621 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b3c19efa0 con 0x7f1b3c10cdc0 2024-08-20T01:55:44.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:43.998+0000 7f1b41163640 1 --2- 172.21.15.79:0/3445846621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b3c10cdc0 0x7f1b3c19e7d0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f1b34005ab0 tx=0x7f1b34004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:44.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:43.998+0000 7f1b39ffb640 1 -- 172.21.15.79:0/3445846621 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3403f030 con 0x7f1b3c10cdc0 2024-08-20T01:55:44.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:43.999+0000 7f1b42bc6640 1 -- 172.21.15.79:0/3445846621 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b3c19f230 con 0x7f1b3c10cdc0 2024-08-20T01:55:44.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:43.999+0000 7f1b39ffb640 1 -- 172.21.15.79:0/3445846621 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b34004440 con 0x7f1b3c10cdc0 2024-08-20T01:55:44.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:43.999+0000 7f1b39ffb640 1 -- 172.21.15.79:0/3445846621 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b34035070 con 0x7f1b3c10cdc0 2024-08-20T01:55:44.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:43.999+0000 7f1b42bc6640 1 -- 172.21.15.79:0/3445846621 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b3c102440 con 0x7f1b3c10cdc0 2024-08-20T01:55:44.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:44.000+0000 7f1b42bc6640 1 -- 172.21.15.79:0/3445846621 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b3c1018e0 con 0x7f1b3c10cdc0 2024-08-20T01:55:44.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:44.001+0000 7f1b39ffb640 1 -- 172.21.15.79:0/3445846621 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1b34042030 con 0x7f1b3c10cdc0 2024-08-20T01:55:44.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:44.002+0000 7f1b39ffb640 1 --2- 172.21.15.79:0/3445846621 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1b280b3bd0 0x7f1b280b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:44.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:44.002+0000 7f1b40962640 1 --2- 172.21.15.79:0/3445846621 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1b280b3bd0 0x7f1b280b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:44.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:44.002+0000 7f1b39ffb640 1 -- 172.21.15.79:0/3445846621 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f1b34104360 con 0x7f1b3c10cdc0 2024-08-20T01:55:44.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:44.002+0000 7f1b40962640 1 --2- 172.21.15.79:0/3445846621 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1b280b3bd0 0x7f1b280b6090 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c005fd0 tx=0x7f1b2c009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:44.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:44.005+0000 7f1b39ffb640 1 -- 172.21.15.79:0/3445846621 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f1b340cb370 con 0x7f1b3c10cdc0 2024-08-20T01:55:44.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:44.196+0000 7f1b42bc6640 1 -- 172.21.15.79:0/3445846621 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1b3c19a020 con 0x7f1b3c10cdc0 2024-08-20T01:55:44.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:44.196+0000 7f1b39ffb640 1 -- 172.21.15.79:0/3445846621 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v74) ==== 81+0+590 (secure 0 0 0) 0x7f1b340cf8c0 con 0x7f1b3c10cdc0 2024-08-20T01:55:44.199 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/1750500064 2024-08-21T01:27:52.389553+0000 2024-08-20T01:55:44.199 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/103962305 2024-08-21T01:27:52.389553+0000 2024-08-20T01:55:44.199 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6800/4045769179 2024-08-21T01:27:29.643647+0000 2024-08-20T01:55:44.199 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/525482354 2024-08-21T01:27:52.389553+0000 2024-08-20T01:55:44.199 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6801/4045769179 2024-08-21T01:27:29.643647+0000 2024-08-20T01:55:44.199 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/1023212241 2024-08-21T01:27:29.643647+0000 2024-08-20T01:55:44.200 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/2368377219 2024-08-21T01:27:29.643647+0000 2024-08-20T01:55:44.200 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6801/3302536522 2024-08-21T01:27:52.389553+0000 2024-08-20T01:55:44.200 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6800/3302536522 2024-08-21T01:27:52.389553+0000 2024-08-20T01:55:44.200 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/3498829332 2024-08-21T01:27:29.643647+0000 2024-08-20T01:55:44.200 INFO:teuthology.orchestra.run.smithi079.stderr:listed 10 entries 2024-08-20T01:55:44.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:44.198+0000 7f1b42bc6640 1 -- 172.21.15.79:0/3445846621 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1b280b3bd0 msgr2=0x7f1b280b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:44.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:44.198+0000 7f1b42bc6640 1 --2- 172.21.15.79:0/3445846621 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1b280b3bd0 0x7f1b280b6090 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c005fd0 tx=0x7f1b2c009680 comp rx=0 tx=0).stop 2024-08-20T01:55:44.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:44.198+0000 7f1b42bc6640 1 -- 172.21.15.79:0/3445846621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b3c10cdc0 msgr2=0x7f1b3c19e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:44.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:44.198+0000 7f1b42bc6640 1 --2- 172.21.15.79:0/3445846621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b3c10cdc0 0x7f1b3c19e7d0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f1b34005ab0 tx=0x7f1b34004040 comp rx=0 tx=0).stop 2024-08-20T01:55:44.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:44.198+0000 7f1b42bc6640 1 -- 172.21.15.79:0/3445846621 shutdown_connections 2024-08-20T01:55:44.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:44.198+0000 7f1b42bc6640 1 --2- 172.21.15.79:0/3445846621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b3c10cdc0 0x7f1b3c19e7d0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:44.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:44.198+0000 7f1b42bc6640 1 --2- 172.21.15.79:0/3445846621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b3c101f00 0x7f1b3c199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:44.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:44.198+0000 7f1b42bc6640 1 --2- 172.21.15.79:0/3445846621 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f1b280b3bd0 0x7f1b280b6090 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:44.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:44.198+0000 7f1b42bc6640 1 --2- 172.21.15.79:0/3445846621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b3c101500 0x7f1b3c198ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:44.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:44.198+0000 7f1b42bc6640 1 -- 172.21.15.79:0/3445846621 >> 172.21.15.79:0/3445846621 conn(0x7f1b3c076bd0 msgr2=0x7f1b3c0ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:44.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:44.198+0000 7f1b42bc6640 1 -- 172.21.15.79:0/3445846621 shutdown_connections 2024-08-20T01:55:44.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:44.198+0000 7f1b42bc6640 1 -- 172.21.15.79:0/3445846621 wait complete. 2024-08-20T01:55:44.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:44 smithi081 ceph-mon[22209]: pgmap v899: 97 pgs: 97 active+clean; 1.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 18 op/s 2024-08-20T01:55:44.779 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:44 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/3445846621' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-20T01:55:44.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:44 smithi175 ceph-mon[22392]: pgmap v899: 97 pgs: 97 active+clean; 1.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 18 op/s 2024-08-20T01:55:44.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:44 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/3445846621' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-20T01:55:44.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:44 smithi079 ceph-mon[18656]: pgmap v899: 97 pgs: 97 active+clean; 1.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 18 op/s 2024-08-20T01:55:44.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:44 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/3445846621' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-20T01:55:45.001 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi079.front.sepia.ceph.com... 2024-08-20T01:55:45.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T01:55:45.001 DEBUG:teuthology.orchestra.run.smithi079:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-08-20T01:55:45.063 INFO:teuthology.orchestra.run:waiting for 300 2024-08-20T01:55:45.066 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[69504]: fuse finished with error 0 and tester_r 0 2024-08-20T01:55:46.639 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:46 smithi175 ceph-mon[22392]: pgmap v900: 97 pgs: 97 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 170 B/s wr, 20 op/s 2024-08-20T01:55:46.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:46 smithi081 ceph-mon[22209]: pgmap v900: 97 pgs: 97 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 170 B/s wr, 20 op/s 2024-08-20T01:55:46.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:46 smithi079 ceph-mon[18656]: pgmap v900: 97 pgs: 97 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 170 B/s wr, 20 op/s 2024-08-20T01:55:48.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:48 smithi081 ceph-mon[22209]: pgmap v901: 97 pgs: 97 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 18 op/s 2024-08-20T01:55:48.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:48 smithi175 ceph-mon[22392]: pgmap v901: 97 pgs: 97 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 18 op/s 2024-08-20T01:55:48.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:48 smithi079 ceph-mon[18656]: pgmap v901: 97 pgs: 97 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 18 op/s 2024-08-20T01:55:50.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:50 smithi175 ceph-mon[22392]: pgmap v902: 97 pgs: 97 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 341 B/s wr, 19 op/s 2024-08-20T01:55:50.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:50 smithi079 ceph-mon[18656]: pgmap v902: 97 pgs: 97 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 341 B/s wr, 19 op/s 2024-08-20T01:55:51.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:50 smithi081 ceph-mon[22209]: pgmap v902: 97 pgs: 97 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 341 B/s wr, 19 op/s 2024-08-20T01:55:51.165 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-08-20T01:55:51.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T01:55:51.165 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-20T01:55:51.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T01:55:51.182 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-08-20T01:55:51.252 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-20T01:55:51.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T01:55:51.252 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-20T01:55:51.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T01:55:51.318 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link delete ceph-brx 2024-08-20T01:55:51.406 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-08-20T01:55:51.417 INFO:tasks.cephadm:Teardown begin 2024-08-20T01:55:51.418 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-20T01:55:51.418 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:55:51.687 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:55:52.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.225+0000 7f0dd6e59640 1 -- 172.21.15.79:0/2495586056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0dd0107d20 msgr2=0x7f0dd010e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:52.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.225+0000 7f0dd6e59640 1 --2- 172.21.15.79:0/2495586056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0dd0107d20 0x7f0dd010e520 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8009ca0 tx=0x7f0dc802a8c0 comp rx=0 tx=0).stop 2024-08-20T01:55:52.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.225+0000 7f0dd6e59640 1 -- 172.21.15.79:0/2495586056 shutdown_connections 2024-08-20T01:55:52.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.225+0000 7f0dd6e59640 1 --2- 172.21.15.79:0/2495586056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0dd0107d20 0x7f0dd010e520 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:52.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.225+0000 7f0dd6e59640 1 --2- 172.21.15.79:0/2495586056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd01073a0 0x7f0dd01077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:52.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.225+0000 7f0dd6e59640 1 --2- 172.21.15.79:0/2495586056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0dd0101990 0x7f0dd0101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:52.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.225+0000 7f0dd6e59640 1 -- 172.21.15.79:0/2495586056 >> 172.21.15.79:0/2495586056 conn(0x7f0dd00fd400 msgr2=0x7f0dd00ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:52.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.225+0000 7f0dd6e59640 1 -- 172.21.15.79:0/2495586056 shutdown_connections 2024-08-20T01:55:52.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.225+0000 7f0dd6e59640 1 -- 172.21.15.79:0/2495586056 wait complete. 2024-08-20T01:55:52.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.225+0000 7f0dd6e59640 1 Processor -- start 2024-08-20T01:55:52.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.225+0000 7f0dd6e59640 1 -- start start 2024-08-20T01:55:52.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.225+0000 7f0dd6e59640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd0101990 0x7f0dd00fd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:52.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.226+0000 7f0dd6e59640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0dd01073a0 0x7f0dd00fde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:52.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.226+0000 7f0dd6e59640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0dd0107d20 0x7f0dd00fe380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:52.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.226+0000 7f0dd6e59640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd01118e0 con 0x7f0dd0107d20 2024-08-20T01:55:52.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.226+0000 7f0dd6e59640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd0111760 con 0x7f0dd0101990 2024-08-20T01:55:52.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.226+0000 7f0dd6e59640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd0111a60 con 0x7f0dd01073a0 2024-08-20T01:55:52.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.226+0000 7f0dd53f6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0dd0107d20 0x7f0dd00fe380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:52.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.226+0000 7f0dd53f6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0dd0107d20 0x7f0dd00fe380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56946/0 (socket says 172.21.15.79:56946) 2024-08-20T01:55:52.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.226+0000 7f0dd53f6640 1 -- 172.21.15.79:0/3002400317 learned_addr learned my addr 172.21.15.79:0/3002400317 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:52.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.226+0000 7f0dd4bf5640 1 --2- 172.21.15.79:0/3002400317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd0101990 0x7f0dd00fd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:52.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.226+0000 7f0dcffff640 1 --2- 172.21.15.79:0/3002400317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0dd01073a0 0x7f0dd00fde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:52.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.226+0000 7f0dd53f6640 1 -- 172.21.15.79:0/3002400317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0dd01073a0 msgr2=0x7f0dd00fde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:52.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.226+0000 7f0dd53f6640 1 --2- 172.21.15.79:0/3002400317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0dd01073a0 0x7f0dd00fde40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:52.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.226+0000 7f0dd53f6640 1 -- 172.21.15.79:0/3002400317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd0101990 msgr2=0x7f0dd00fd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:52.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.226+0000 7f0dd53f6640 1 --2- 172.21.15.79:0/3002400317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd0101990 0x7f0dd00fd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:52.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.226+0000 7f0dd53f6640 1 -- 172.21.15.79:0/3002400317 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dd01a72d0 con 0x7f0dd0107d20 2024-08-20T01:55:52.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.226+0000 7f0dd53f6640 1 --2- 172.21.15.79:0/3002400317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0dd0107d20 0x7f0dd00fe380 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8005cc0 tx=0x7f0dc8003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:52.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.226+0000 7f0dcdffb640 1 -- 172.21.15.79:0/3002400317 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc8032c10 con 0x7f0dd0107d20 2024-08-20T01:55:52.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.226+0000 7f0dcdffb640 1 -- 172.21.15.79:0/3002400317 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0dc8032db0 con 0x7f0dd0107d20 2024-08-20T01:55:52.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.226+0000 7f0dd6e59640 1 -- 172.21.15.79:0/3002400317 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dd01a7560 con 0x7f0dd0107d20 2024-08-20T01:55:52.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.226+0000 7f0dcdffb640 1 -- 172.21.15.79:0/3002400317 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc8030a60 con 0x7f0dd0107d20 2024-08-20T01:55:52.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.227+0000 7f0dd6e59640 1 -- 172.21.15.79:0/3002400317 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dd01a7af0 con 0x7f0dd0107d20 2024-08-20T01:55:52.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.228+0000 7f0dd6e59640 1 -- 172.21.15.79:0/3002400317 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dd0101d70 con 0x7f0dd0107d20 2024-08-20T01:55:52.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.229+0000 7f0dcdffb640 1 -- 172.21.15.79:0/3002400317 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f0dc8030c00 con 0x7f0dd0107d20 2024-08-20T01:55:52.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.230+0000 7f0dcdffb640 1 --2- 172.21.15.79:0/3002400317 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0dc00b3c50 0x7f0dc00b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:52.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.230+0000 7f0dd4bf5640 1 --2- 172.21.15.79:0/3002400317 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0dc00b3c50 0x7f0dc00b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:52.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.230+0000 7f0dcdffb640 1 -- 172.21.15.79:0/3002400317 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f0dc8104f70 con 0x7f0dd0107d20 2024-08-20T01:55:52.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.230+0000 7f0dd4bf5640 1 --2- 172.21.15.79:0/3002400317 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0dc00b3c50 0x7f0dc00b6110 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4009bd0 tx=0x7f0dc4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:52.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.233+0000 7f0dcdffb640 1 -- 172.21.15.79:0/3002400317 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f0dc80cc5d0 con 0x7f0dd0107d20 2024-08-20T01:55:52.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.456+0000 7f0dd6e59640 1 -- 172.21.15.79:0/3002400317 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0dd00fec00 con 0x7f0dd0107d20 2024-08-20T01:55:52.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.457+0000 7f0dcdffb640 1 -- 172.21.15.79:0/3002400317 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+11977 (secure 0 0 0) 0x7f0dd00fec00 con 0x7f0dd0107d20 2024-08-20T01:55:52.460 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:55:52.460 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":71,"btime":"2024-08-20T01:54:19:232668+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14670,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/735082912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":735082912},{"type":"v1","addr":"172.21.15.79:6835","nonce":735082912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2150339873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2150339873},{"type":"v1","addr":"172.21.15.79:6837","nonce":2150339873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":71,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:34:55.133562+0000","modified":"2024-08-20T01:54:18.576580+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24539,"mds_1":24538,"mds_2":24523,"mds_3":24514,"mds_4":24512},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14724":{"gid":14724,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/1071242274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1071242274},{"type":"v1","addr":"172.21.15.79:6839","nonce":1071242274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14730":{"gid":14730,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6841/2448977611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":2448977611},{"type":"v1","addr":"172.21.15.79:6841","nonce":2448977611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/1257507005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1257507005},{"type":"v1","addr":"172.21.15.81:6833","nonce":1257507005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1499936216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1499936216},{"type":"v1","addr":"172.21.15.81:6835","nonce":1499936216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/1107229215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1107229215},{"type":"v1","addr":"172.21.15.175:6833","nonce":1107229215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6837/2073598870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2073598870},{"type":"v1","addr":"172.21.15.81:6837","nonce":2073598870}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/2552601173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2552601173},{"type":"v1","addr":"172.21.15.175:6835","nonce":2552601173}]},"join_fscid":-1,"export_targets":[0,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6837/1767284089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1767284089},{"type":"v1","addr":"172.21.15.175:6837","nonce":1767284089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/1331748742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1331748742},{"type":"v1","addr":"172.21.15.175:6839","nonce":1331748742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/4098410583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":4098410583},{"type":"v1","addr":"172.21.15.81:6839","nonce":4098410583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24539,"qdb_cluster":[24539,24523,24514,24538,24512]},"id":1}]} 2024-08-20T01:55:52.460 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 71 2024-08-20T01:55:52.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.459+0000 7f0dd6e59640 1 -- 172.21.15.79:0/3002400317 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0dc00b3c50 msgr2=0x7f0dc00b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:52.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.459+0000 7f0dd6e59640 1 --2- 172.21.15.79:0/3002400317 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0dc00b3c50 0x7f0dc00b6110 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4009bd0 tx=0x7f0dc4005f90 comp rx=0 tx=0).stop 2024-08-20T01:55:52.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.459+0000 7f0dd6e59640 1 -- 172.21.15.79:0/3002400317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0dd0107d20 msgr2=0x7f0dd00fe380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:52.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.459+0000 7f0dd6e59640 1 --2- 172.21.15.79:0/3002400317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0dd0107d20 0x7f0dd00fe380 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8005cc0 tx=0x7f0dc8003f90 comp rx=0 tx=0).stop 2024-08-20T01:55:52.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.459+0000 7f0dd6e59640 1 -- 172.21.15.79:0/3002400317 shutdown_connections 2024-08-20T01:55:52.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.459+0000 7f0dd6e59640 1 --2- 172.21.15.79:0/3002400317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0dd0107d20 0x7f0dd00fe380 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:52.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.459+0000 7f0dd6e59640 1 --2- 172.21.15.79:0/3002400317 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f0dc00b3c50 0x7f0dc00b6110 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:52.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.459+0000 7f0dd6e59640 1 --2- 172.21.15.79:0/3002400317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0dd01073a0 0x7f0dd00fde40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:52.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.459+0000 7f0dd6e59640 1 --2- 172.21.15.79:0/3002400317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd0101990 0x7f0dd00fd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:52.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.459+0000 7f0dd6e59640 1 -- 172.21.15.79:0/3002400317 >> 172.21.15.79:0/3002400317 conn(0x7f0dd00fd400 msgr2=0x7f0dd006aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:52.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.459+0000 7f0dd6e59640 1 -- 172.21.15.79:0/3002400317 shutdown_connections 2024-08-20T01:55:52.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:52.459+0000 7f0dd6e59640 1 -- 172.21.15.79:0/3002400317 wait complete. 2024-08-20T01:55:52.818 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:52 smithi079 ceph-mon[18656]: pgmap v903: 97 pgs: 97 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 17 op/s 2024-08-20T01:55:52.818 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:52 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/3002400317' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:55:52.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:52 smithi175 ceph-mon[22392]: pgmap v903: 97 pgs: 97 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 17 op/s 2024-08-20T01:55:52.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:52 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/3002400317' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:55:53.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:52 smithi081 ceph-mon[22209]: pgmap v903: 97 pgs: 97 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 17 op/s 2024-08-20T01:55:53.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:52 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/3002400317' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:55:53.303 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T01:55:53.558 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:55:54.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.033+0000 7f21ff8b1640 1 -- 172.21.15.79:0/40442967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21f81039a0 msgr2=0x7f21f8103d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:54.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.033+0000 7f21ff8b1640 1 --2- 172.21.15.79:0/40442967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21f81039a0 0x7f21f8103d80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f21e8009be0 tx=0x7f21e802a6c0 comp rx=0 tx=0).stop 2024-08-20T01:55:54.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.033+0000 7f21ff8b1640 1 -- 172.21.15.79:0/40442967 shutdown_connections 2024-08-20T01:55:54.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.033+0000 7f21ff8b1640 1 --2- 172.21.15.79:0/40442967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21f810ce00 0x7f21f810f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:54.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.033+0000 7f21ff8b1640 1 --2- 172.21.15.79:0/40442967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21f81042c0 0x7f21f810c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:54.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.033+0000 7f21ff8b1640 1 --2- 172.21.15.79:0/40442967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21f81039a0 0x7f21f8103d80 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:54.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.033+0000 7f21ff8b1640 1 -- 172.21.15.79:0/40442967 >> 172.21.15.79:0/40442967 conn(0x7f21f80fd400 msgr2=0x7f21f80ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:54.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.033+0000 7f21ff8b1640 1 -- 172.21.15.79:0/40442967 shutdown_connections 2024-08-20T01:55:54.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.033+0000 7f21ff8b1640 1 -- 172.21.15.79:0/40442967 wait complete. 2024-08-20T01:55:54.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.034+0000 7f21ff8b1640 1 Processor -- start 2024-08-20T01:55:54.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.034+0000 7f21ff8b1640 1 -- start start 2024-08-20T01:55:54.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.034+0000 7f21ff8b1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21f81039a0 0x7f21f8198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:54.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.034+0000 7f21ff8b1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21f81042c0 0x7f21f81993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:54.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.034+0000 7f21ff8b1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21f810ce00 0x7f21f819e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:54.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.034+0000 7f21ff8b1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f21f8112920 con 0x7f21f810ce00 2024-08-20T01:55:54.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.034+0000 7f21ff8b1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f21f81127a0 con 0x7f21f81042c0 2024-08-20T01:55:54.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.034+0000 7f21ff8b1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f21f8112aa0 con 0x7f21f81039a0 2024-08-20T01:55:54.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.034+0000 7f21fde4e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21f810ce00 0x7f21f819e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:54.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.034+0000 7f21fce4c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21f81042c0 0x7f21f81993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:54.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.034+0000 7f21fde4e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21f810ce00 0x7f21f819e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56960/0 (socket says 172.21.15.79:56960) 2024-08-20T01:55:54.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.034+0000 7f21fde4e640 1 -- 172.21.15.79:0/1190790152 learned_addr learned my addr 172.21.15.79:0/1190790152 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:54.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.034+0000 7f21fd64d640 1 --2- 172.21.15.79:0/1190790152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21f81039a0 0x7f21f8198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:54.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.035+0000 7f21fce4c640 1 -- 172.21.15.79:0/1190790152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21f81039a0 msgr2=0x7f21f8198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:54.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.035+0000 7f21fce4c640 1 --2- 172.21.15.79:0/1190790152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21f81039a0 0x7f21f8198eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:54.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.035+0000 7f21fce4c640 1 -- 172.21.15.79:0/1190790152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21f810ce00 msgr2=0x7f21f819e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:54.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.035+0000 7f21fce4c640 1 --2- 172.21.15.79:0/1190790152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21f810ce00 0x7f21f819e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:54.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.035+0000 7f21fce4c640 1 -- 172.21.15.79:0/1190790152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21f819ef60 con 0x7f21f81042c0 2024-08-20T01:55:54.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.035+0000 7f21fde4e640 1 --2- 172.21.15.79:0/1190790152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21f810ce00 0x7f21f819e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:55:54.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.035+0000 7f21fce4c640 1 --2- 172.21.15.79:0/1190790152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21f81042c0 0x7f21f81993f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f21ec005fd0 tx=0x7f21ec00ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:54.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.035+0000 7f21f67fc640 1 -- 172.21.15.79:0/1190790152 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ec00cc40 con 0x7f21f81042c0 2024-08-20T01:55:54.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.035+0000 7f21f67fc640 1 -- 172.21.15.79:0/1190790152 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f21ec00cde0 con 0x7f21f81042c0 2024-08-20T01:55:54.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.035+0000 7f21ff8b1640 1 -- 172.21.15.79:0/1190790152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21f819f250 con 0x7f21f81042c0 2024-08-20T01:55:54.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.035+0000 7f21f67fc640 1 -- 172.21.15.79:0/1190790152 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ec018710 con 0x7f21f81042c0 2024-08-20T01:55:54.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.035+0000 7f21ff8b1640 1 -- 172.21.15.79:0/1190790152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21f81a5910 con 0x7f21f81042c0 2024-08-20T01:55:54.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.036+0000 7f21ff8b1640 1 -- 172.21.15.79:0/1190790152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21f8103d80 con 0x7f21f81042c0 2024-08-20T01:55:54.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.037+0000 7f21f67fc640 1 -- 172.21.15.79:0/1190790152 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f21ec01f020 con 0x7f21f81042c0 2024-08-20T01:55:54.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.038+0000 7f21f67fc640 1 --2- 172.21.15.79:0/1190790152 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f21e00b3bd0 0x7f21e00b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:54.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.038+0000 7f21fd64d640 1 --2- 172.21.15.79:0/1190790152 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f21e00b3bd0 0x7f21e00b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:54.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.038+0000 7f21f67fc640 1 -- 172.21.15.79:0/1190790152 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f21ec0e3e00 con 0x7f21f81042c0 2024-08-20T01:55:54.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.039+0000 7f21fd64d640 1 --2- 172.21.15.79:0/1190790152 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f21e00b3bd0 0x7f21e00b6090 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f21e8000f80 tx=0x7f21e8005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:54.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.041+0000 7f21f67fc640 1 -- 172.21.15.79:0/1190790152 <== mon.2 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f21ec0ab400 con 0x7f21f81042c0 2024-08-20T01:55:54.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.261+0000 7f21ff8b1640 1 -- 172.21.15.79:0/1190790152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f21f8199fe0 con 0x7f21f81042c0 2024-08-20T01:55:54.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.262+0000 7f21f67fc640 1 -- 172.21.15.79:0/1190790152 <== mon.2 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+11977 (secure 0 0 0) 0x7f21ec0aad00 con 0x7f21f81042c0 2024-08-20T01:55:54.264 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:55:54.265 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 71 2024-08-20T01:55:54.265 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":71,"btime":"2024-08-20T01:54:19:232668+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14670,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/735082912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":735082912},{"type":"v1","addr":"172.21.15.79:6835","nonce":735082912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2150339873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2150339873},{"type":"v1","addr":"172.21.15.79:6837","nonce":2150339873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":71,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T01:34:55.133562+0000","modified":"2024-08-20T01:54:18.576580+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24539,"mds_1":24538,"mds_2":24523,"mds_3":24514,"mds_4":24512},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14724":{"gid":14724,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6839/1071242274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1071242274},{"type":"v1","addr":"172.21.15.79:6839","nonce":1071242274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14730":{"gid":14730,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6841/2448977611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6840","nonce":2448977611},{"type":"v1","addr":"172.21.15.79:6841","nonce":2448977611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/1257507005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1257507005},{"type":"v1","addr":"172.21.15.81:6833","nonce":1257507005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1499936216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1499936216},{"type":"v1","addr":"172.21.15.81:6835","nonce":1499936216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/1107229215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1107229215},{"type":"v1","addr":"172.21.15.175:6833","nonce":1107229215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6837/2073598870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2073598870},{"type":"v1","addr":"172.21.15.81:6837","nonce":2073598870}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6835/2552601173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2552601173},{"type":"v1","addr":"172.21.15.175:6835","nonce":2552601173}]},"join_fscid":-1,"export_targets":[0,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.175:6837/1767284089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1767284089},{"type":"v1","addr":"172.21.15.175:6837","nonce":1767284089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/1331748742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1331748742},{"type":"v1","addr":"172.21.15.175:6839","nonce":1331748742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/4098410583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":4098410583},{"type":"v1","addr":"172.21.15.81:6839","nonce":4098410583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24539,"qdb_cluster":[24539,24523,24514,24538,24512]},"id":1}]} 2024-08-20T01:55:54.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.264+0000 7f21ff8b1640 1 -- 172.21.15.79:0/1190790152 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f21e00b3bd0 msgr2=0x7f21e00b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:54.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.264+0000 7f21ff8b1640 1 --2- 172.21.15.79:0/1190790152 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f21e00b3bd0 0x7f21e00b6090 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f21e8000f80 tx=0x7f21e8005fd0 comp rx=0 tx=0).stop 2024-08-20T01:55:54.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.264+0000 7f21ff8b1640 1 -- 172.21.15.79:0/1190790152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21f81042c0 msgr2=0x7f21f81993f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:54.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.264+0000 7f21ff8b1640 1 --2- 172.21.15.79:0/1190790152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21f81042c0 0x7f21f81993f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f21ec005fd0 tx=0x7f21ec00ee50 comp rx=0 tx=0).stop 2024-08-20T01:55:54.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.264+0000 7f21ff8b1640 1 -- 172.21.15.79:0/1190790152 shutdown_connections 2024-08-20T01:55:54.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.264+0000 7f21ff8b1640 1 --2- 172.21.15.79:0/1190790152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21f810ce00 0x7f21f819e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:54.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.264+0000 7f21ff8b1640 1 --2- 172.21.15.79:0/1190790152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21f81042c0 0x7f21f81993f0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:54.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.264+0000 7f21ff8b1640 1 --2- 172.21.15.79:0/1190790152 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f21e00b3bd0 0x7f21e00b6090 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:54.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.264+0000 7f21ff8b1640 1 --2- 172.21.15.79:0/1190790152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21f81039a0 0x7f21f8198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:54.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.264+0000 7f21ff8b1640 1 -- 172.21.15.79:0/1190790152 >> 172.21.15.79:0/1190790152 conn(0x7f21f80fd400 msgr2=0x7f21f80fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:54.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.264+0000 7f21ff8b1640 1 -- 172.21.15.79:0/1190790152 shutdown_connections 2024-08-20T01:55:54.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:54.264+0000 7f21ff8b1640 1 -- 172.21.15.79:0/1190790152 wait complete. 2024-08-20T01:55:54.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:54 smithi081 ceph-mon[22209]: pgmap v904: 97 pgs: 97 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 17 op/s 2024-08-20T01:55:54.778 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:54 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/1190790152' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:55:54.836 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:54 smithi079 ceph-mon[18656]: pgmap v904: 97 pgs: 97 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 17 op/s 2024-08-20T01:55:54.836 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:54 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/1190790152' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:55:54.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:54 smithi175 ceph-mon[22392]: pgmap v904: 97 pgs: 97 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 17 op/s 2024-08-20T01:55:54.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:54 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/1190790152' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T01:55:54.968 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-20T01:55:55.225 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:55:55.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.748+0000 7f4648571640 1 -- 172.21.15.79:0/962356225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4640107d20 msgr2=0x7f464010e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:55.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.748+0000 7f4648571640 1 --2- 172.21.15.79:0/962356225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4640107d20 0x7f464010e520 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f4638009ca0 tx=0x7f463802a8c0 comp rx=0 tx=0).stop 2024-08-20T01:55:55.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.748+0000 7f4648571640 1 -- 172.21.15.79:0/962356225 shutdown_connections 2024-08-20T01:55:55.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.748+0000 7f4648571640 1 --2- 172.21.15.79:0/962356225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4640107d20 0x7f464010e520 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:55.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.748+0000 7f4648571640 1 --2- 172.21.15.79:0/962356225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46401073a0 0x7f46401077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:55.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.748+0000 7f4648571640 1 --2- 172.21.15.79:0/962356225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4640101990 0x7f4640101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:55.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.748+0000 7f4648571640 1 -- 172.21.15.79:0/962356225 >> 172.21.15.79:0/962356225 conn(0x7f46400fd400 msgr2=0x7f46400ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:55.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.748+0000 7f4648571640 1 -- 172.21.15.79:0/962356225 shutdown_connections 2024-08-20T01:55:55.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.748+0000 7f4648571640 1 -- 172.21.15.79:0/962356225 wait complete. 2024-08-20T01:55:55.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.748+0000 7f4648571640 1 Processor -- start 2024-08-20T01:55:55.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.748+0000 7f4648571640 1 -- start start 2024-08-20T01:55:55.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.748+0000 7f4648571640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4640101990 0x7f4640199cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:55.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.748+0000 7f4648571640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46401073a0 0x7f464019a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:55.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.749+0000 7f4648571640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4640107d20 0x7f464019a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:55.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.749+0000 7f4648571640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f46401118e0 con 0x7f4640101990 2024-08-20T01:55:55.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.749+0000 7f4648571640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4640111760 con 0x7f46401073a0 2024-08-20T01:55:55.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.749+0000 7f4648571640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4640111a60 con 0x7f4640107d20 2024-08-20T01:55:55.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.749+0000 7f464630d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4640101990 0x7f4640199cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:55.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.749+0000 7f4645b0c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46401073a0 0x7f464019a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:55.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.749+0000 7f464630d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4640101990 0x7f4640199cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56984/0 (socket says 172.21.15.79:56984) 2024-08-20T01:55:55.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.749+0000 7f464630d640 1 -- 172.21.15.79:0/1411053511 learned_addr learned my addr 172.21.15.79:0/1411053511 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:55.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.749+0000 7f4646b0e640 1 --2- 172.21.15.79:0/1411053511 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4640107d20 0x7f464019a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:55.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.749+0000 7f464630d640 1 -- 172.21.15.79:0/1411053511 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4640107d20 msgr2=0x7f464019a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:55.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.749+0000 7f464630d640 1 --2- 172.21.15.79:0/1411053511 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4640107d20 0x7f464019a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:55.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.749+0000 7f464630d640 1 -- 172.21.15.79:0/1411053511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46401073a0 msgr2=0x7f464019a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:55.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.749+0000 7f464630d640 1 --2- 172.21.15.79:0/1411053511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46401073a0 0x7f464019a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:55.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.749+0000 7f464630d640 1 -- 172.21.15.79:0/1411053511 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46401a5090 con 0x7f4640101990 2024-08-20T01:55:55.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.749+0000 7f4645b0c640 1 --2- 172.21.15.79:0/1411053511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46401073a0 0x7f464019a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:55:55.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.749+0000 7f464630d640 1 --2- 172.21.15.79:0/1411053511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4640101990 0x7f4640199cb0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f463c00c970 tx=0x7f463c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:55.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.749+0000 7f46377fe640 1 -- 172.21.15.79:0/1411053511 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f463c007bb0 con 0x7f4640101990 2024-08-20T01:55:55.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.749+0000 7f46377fe640 1 -- 172.21.15.79:0/1411053511 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f463c007d50 con 0x7f4640101990 2024-08-20T01:55:55.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.749+0000 7f4648571640 1 -- 172.21.15.79:0/1411053511 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46401a5380 con 0x7f4640101990 2024-08-20T01:55:55.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.749+0000 7f46377fe640 1 -- 172.21.15.79:0/1411053511 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f463c004e40 con 0x7f4640101990 2024-08-20T01:55:55.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.749+0000 7f4648571640 1 -- 172.21.15.79:0/1411053511 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46401a5870 con 0x7f4640101990 2024-08-20T01:55:55.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.750+0000 7f4648571640 1 -- 172.21.15.79:0/1411053511 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4640101d70 con 0x7f4640101990 2024-08-20T01:55:55.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.753+0000 7f46377fe640 1 -- 172.21.15.79:0/1411053511 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f463c005000 con 0x7f4640101990 2024-08-20T01:55:55.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.753+0000 7f46377fe640 1 --2- 172.21.15.79:0/1411053511 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f462c0b3bd0 0x7f462c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:55.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.753+0000 7f4645b0c640 1 --2- 172.21.15.79:0/1411053511 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f462c0b3bd0 0x7f462c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:55.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.753+0000 7f46377fe640 1 -- 172.21.15.79:0/1411053511 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f463c0e3d40 con 0x7f4640101990 2024-08-20T01:55:55.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.754+0000 7f4645b0c640 1 --2- 172.21.15.79:0/1411053511 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f462c0b3bd0 0x7f462c0b6090 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f464006b3b0 tx=0x7f4630005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:55.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.756+0000 7f46377fe640 1 -- 172.21.15.79:0/1411053511 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f463c014030 con 0x7f4640101990 2024-08-20T01:55:55.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.940+0000 7f4648571640 1 -- 172.21.15.79:0/1411053511 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f464006abc0 con 0x7f4640101990 2024-08-20T01:55:55.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.941+0000 7f46377fe640 1 -- 172.21.15.79:0/1411053511 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22676 (secure 0 0 0) 0x7f464006abc0 con 0x7f4640101990 2024-08-20T01:55:55.944 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-08-20T01:55:55.944 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":74,"fsid":"28484e9a-5e93-11ef-bccf-c7b262605968","created":"2024-08-20T01:27:07.792689+0000","modified":"2024-08-20T01:35:53.774800+0000","last_up_change":"2024-08-20T01:34:05.838937+0000","last_in_change":"2024-08-20T01:33:43.645153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-20T01:30:30.693903+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-20T01:34:50.585939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-20T01:34:52.980599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ccdbeb3d-bb9d-4275-ad7e-49f2cc1222cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6803","nonce":1274927648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6805","nonce":1274927648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6809","nonce":1274927648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1274927648},{"type":"v1","addr":"172.21.15.79:6807","nonce":1274927648}]},"public_addr":"172.21.15.79:6803/1274927648","cluster_addr":"172.21.15.79:6805/1274927648","heartbeat_back_addr":"172.21.15.79:6809/1274927648","heartbeat_front_addr":"172.21.15.79:6807/1274927648","state":["exists","up"]},{"osd":1,"uuid":"0906bc46-f89d-482d-9402-43d17e4246a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6801","nonce":1174012328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6803","nonce":1174012328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6807","nonce":1174012328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1174012328},{"type":"v1","addr":"172.21.15.81:6805","nonce":1174012328}]},"public_addr":"172.21.15.81:6801/1174012328","cluster_addr":"172.21.15.81:6803/1174012328","heartbeat_back_addr":"172.21.15.81:6807/1174012328","heartbeat_front_addr":"172.21.15.81:6805/1174012328","state":["exists","up"]},{"osd":2,"uuid":"11d8fb9d-cb2c-41c8-994c-603a1d8e01a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6801","nonce":1132306232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6803","nonce":1132306232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6807","nonce":1132306232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1132306232},{"type":"v1","addr":"172.21.15.175:6805","nonce":1132306232}]},"public_addr":"172.21.15.175:6801/1132306232","cluster_addr":"172.21.15.175:6803/1132306232","heartbeat_back_addr":"172.21.15.175:6807/1132306232","heartbeat_front_addr":"172.21.15.175:6805/1132306232","state":["exists","up"]},{"osd":3,"uuid":"29e35242-957f-404b-b99e-d4dd0045c35d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6811","nonce":1364181822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6813","nonce":1364181822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6817","nonce":1364181822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1364181822},{"type":"v1","addr":"172.21.15.79:6815","nonce":1364181822}]},"public_addr":"172.21.15.79:6811/1364181822","cluster_addr":"172.21.15.79:6813/1364181822","heartbeat_back_addr":"172.21.15.79:6817/1364181822","heartbeat_front_addr":"172.21.15.79:6815/1364181822","state":["exists","up"]},{"osd":4,"uuid":"9139c469-270f-4465-8adb-1e748529fa68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6809","nonce":306873968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6811","nonce":306873968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6815","nonce":306873968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":306873968},{"type":"v1","addr":"172.21.15.81:6813","nonce":306873968}]},"public_addr":"172.21.15.81:6809/306873968","cluster_addr":"172.21.15.81:6811/306873968","heartbeat_back_addr":"172.21.15.81:6815/306873968","heartbeat_front_addr":"172.21.15.81:6813/306873968","state":["exists","up"]},{"osd":5,"uuid":"6394e462-4510-45d6-bc99-8660085cb206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6809","nonce":3908133424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6811","nonce":3908133424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6815","nonce":3908133424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3908133424},{"type":"v1","addr":"172.21.15.175:6813","nonce":3908133424}]},"public_addr":"172.21.15.175:6809/3908133424","cluster_addr":"172.21.15.175:6811/3908133424","heartbeat_back_addr":"172.21.15.175:6815/3908133424","heartbeat_front_addr":"172.21.15.175:6813/3908133424","state":["exists","up"]},{"osd":6,"uuid":"e8e51380-e2be-4c4c-82d8-d86306d9fc1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6819","nonce":3379368280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6821","nonce":3379368280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6825","nonce":3379368280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3379368280},{"type":"v1","addr":"172.21.15.79:6823","nonce":3379368280}]},"public_addr":"172.21.15.79:6819/3379368280","cluster_addr":"172.21.15.79:6821/3379368280","heartbeat_back_addr":"172.21.15.79:6825/3379368280","heartbeat_front_addr":"172.21.15.79:6823/3379368280","state":["exists","up"]},{"osd":7,"uuid":"875f7876-a2ca-4254-a8cc-27eebb11cf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6817","nonce":747356685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6819","nonce":747356685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6823","nonce":747356685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":747356685},{"type":"v1","addr":"172.21.15.81:6821","nonce":747356685}]},"public_addr":"172.21.15.81:6817/747356685","cluster_addr":"172.21.15.81:6819/747356685","heartbeat_back_addr":"172.21.15.81:6823/747356685","heartbeat_front_addr":"172.21.15.81:6821/747356685","state":["exists","up"]},{"osd":8,"uuid":"d714a33b-8df5-411d-bc99-b33b4b27cc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6817","nonce":1537762925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6819","nonce":1537762925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6823","nonce":1537762925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1537762925},{"type":"v1","addr":"172.21.15.175:6821","nonce":1537762925}]},"public_addr":"172.21.15.175:6817/1537762925","cluster_addr":"172.21.15.175:6819/1537762925","heartbeat_back_addr":"172.21.15.175:6823/1537762925","heartbeat_front_addr":"172.21.15.175:6821/1537762925","state":["exists","up"]},{"osd":9,"uuid":"82db8305-1d72-4bef-99d6-5486e4de5b03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6827","nonce":2400574113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6829","nonce":2400574113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6833","nonce":2400574113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":2400574113},{"type":"v1","addr":"172.21.15.79:6831","nonce":2400574113}]},"public_addr":"172.21.15.79:6827/2400574113","cluster_addr":"172.21.15.79:6829/2400574113","heartbeat_back_addr":"172.21.15.79:6833/2400574113","heartbeat_front_addr":"172.21.15.79:6831/2400574113","state":["exists","up"]},{"osd":10,"uuid":"797e1e3f-12b5-4958-9e1f-f796cffaaf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6825","nonce":4188407500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6827","nonce":4188407500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6831","nonce":4188407500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4188407500},{"type":"v1","addr":"172.21.15.81:6829","nonce":4188407500}]},"public_addr":"172.21.15.81:6825/4188407500","cluster_addr":"172.21.15.81:6827/4188407500","heartbeat_back_addr":"172.21.15.81:6831/4188407500","heartbeat_front_addr":"172.21.15.81:6829/4188407500","state":["exists","up"]},{"osd":11,"uuid":"a4d218ae-5a41-4b34-9c4e-e795c4a6a16d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6825","nonce":451069549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6827","nonce":451069549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6831","nonce":451069549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":451069549},{"type":"v1","addr":"172.21.15.175:6829","nonce":451069549}]},"public_addr":"172.21.15.175:6825/451069549","cluster_addr":"172.21.15.175:6827/451069549","heartbeat_back_addr":"172.21.15.175:6831/451069549","heartbeat_front_addr":"172.21.15.175:6829/451069549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:29:42.003425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:30:05.353547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:30:28.916727+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:30:52.845671+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:31:16.926826+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:31:39.840986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:32:04.013287+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:32:28.237482+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:32:51.270643+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:33:15.825156+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:33:40.037915+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T01:34:04.477377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":3,"to":7}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:0/1750500064":"2024-08-21T01:27:52.389553+0000","172.21.15.79:0/103962305":"2024-08-21T01:27:52.389553+0000","172.21.15.79:6800/4045769179":"2024-08-21T01:27:29.643647+0000","172.21.15.79:0/525482354":"2024-08-21T01:27:52.389553+0000","172.21.15.79:6801/4045769179":"2024-08-21T01:27:29.643647+0000","172.21.15.79:0/1023212241":"2024-08-21T01:27:29.643647+0000","172.21.15.79:0/2368377219":"2024-08-21T01:27:29.643647+0000","172.21.15.79:6801/3302536522":"2024-08-21T01:27:52.389553+0000","172.21.15.79:6800/3302536522":"2024-08-21T01:27:52.389553+0000","172.21.15.79:0/3498829332":"2024-08-21T01:27:29.643647+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-20T01:55:55.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.943+0000 7f4648571640 1 -- 172.21.15.79:0/1411053511 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f462c0b3bd0 msgr2=0x7f462c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:55.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.943+0000 7f4648571640 1 --2- 172.21.15.79:0/1411053511 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f462c0b3bd0 0x7f462c0b6090 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f464006b3b0 tx=0x7f4630005f90 comp rx=0 tx=0).stop 2024-08-20T01:55:55.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.943+0000 7f4648571640 1 -- 172.21.15.79:0/1411053511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4640101990 msgr2=0x7f4640199cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:55.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.943+0000 7f4648571640 1 --2- 172.21.15.79:0/1411053511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4640101990 0x7f4640199cb0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f463c00c970 tx=0x7f463c00ce30 comp rx=0 tx=0).stop 2024-08-20T01:55:55.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.943+0000 7f4648571640 1 -- 172.21.15.79:0/1411053511 shutdown_connections 2024-08-20T01:55:55.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.943+0000 7f4648571640 1 --2- 172.21.15.79:0/1411053511 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f462c0b3bd0 0x7f462c0b6090 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:55.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.943+0000 7f4648571640 1 --2- 172.21.15.79:0/1411053511 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4640107d20 0x7f464019a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:55.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.943+0000 7f4648571640 1 --2- 172.21.15.79:0/1411053511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46401073a0 0x7f464019a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:55.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.943+0000 7f4648571640 1 --2- 172.21.15.79:0/1411053511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4640101990 0x7f4640199cb0 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:55.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.943+0000 7f4648571640 1 -- 172.21.15.79:0/1411053511 >> 172.21.15.79:0/1411053511 conn(0x7f46400fd400 msgr2=0x7f46400ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:55.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.943+0000 7f4648571640 1 -- 172.21.15.79:0/1411053511 shutdown_connections 2024-08-20T01:55:55.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:55.943+0000 7f4648571640 1 -- 172.21.15.79:0/1411053511 wait complete. 2024-08-20T01:55:56.643 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:56 smithi079 ceph-mon[18656]: pgmap v905: 97 pgs: 97 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 18 op/s 2024-08-20T01:55:56.643 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:56 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/1411053511' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:55:56.670 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs fail cephfs 2024-08-20T01:55:56.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:56 smithi175 ceph-mon[22392]: pgmap v905: 97 pgs: 97 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 18 op/s 2024-08-20T01:55:56.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:56 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/1411053511' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:55:56.925 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:55:57.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:56 smithi081 ceph-mon[22209]: pgmap v905: 97 pgs: 97 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 18 op/s 2024-08-20T01:55:57.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:56 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/1411053511' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T01:55:57.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.435+0000 7f13bc8e8640 1 -- 172.21.15.79:0/1754980508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13b8108600 msgr2=0x7f13b8108a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:57.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.435+0000 7f13bc8e8640 1 --2- 172.21.15.79:0/1754980508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13b8108600 0x7f13b8108a40 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f13ac009930 tx=0x7f13ac02a420 comp rx=0 tx=0).stop 2024-08-20T01:55:57.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.435+0000 7f13bc8e8640 1 -- 172.21.15.79:0/1754980508 shutdown_connections 2024-08-20T01:55:57.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.435+0000 7f13bc8e8640 1 --2- 172.21.15.79:0/1754980508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13b8108f80 0x7f13b810f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:57.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.435+0000 7f13bc8e8640 1 --2- 172.21.15.79:0/1754980508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13b8108600 0x7f13b8108a40 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:57.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.435+0000 7f13bc8e8640 1 --2- 172.21.15.79:0/1754980508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13b8101500 0x7f13b81018e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:57.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.435+0000 7f13bc8e8640 1 -- 172.21.15.79:0/1754980508 >> 172.21.15.79:0/1754980508 conn(0x7f13b8076cc0 msgr2=0x7f13b80770d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:57.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.435+0000 7f13bc8e8640 1 -- 172.21.15.79:0/1754980508 shutdown_connections 2024-08-20T01:55:57.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.435+0000 7f13bc8e8640 1 -- 172.21.15.79:0/1754980508 wait complete. 2024-08-20T01:55:57.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.436+0000 7f13bc8e8640 1 Processor -- start 2024-08-20T01:55:57.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.436+0000 7f13bc8e8640 1 -- start start 2024-08-20T01:55:57.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.436+0000 7f13bc8e8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13b8101500 0x7f13b819b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:57.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.436+0000 7f13bc8e8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13b8108600 0x7f13b819b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:57.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.436+0000 7f13bc8e8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13b8108f80 0x7f13b81a0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:57.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.436+0000 7f13bc8e8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f13b81129f0 con 0x7f13b8108f80 2024-08-20T01:55:57.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.436+0000 7f13bc8e8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f13b8112870 con 0x7f13b8108600 2024-08-20T01:55:57.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.436+0000 7f13bc8e8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f13b8112b70 con 0x7f13b8101500 2024-08-20T01:55:57.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.436+0000 7f13b6d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13b8108f80 0x7f13b81a0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:57.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.436+0000 7f13b6d9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13b8108f80 0x7f13b81a0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56996/0 (socket says 172.21.15.79:56996) 2024-08-20T01:55:57.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.436+0000 7f13b6d9d640 1 -- 172.21.15.79:0/1989701853 learned_addr learned my addr 172.21.15.79:0/1989701853 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:57.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.436+0000 7f13b5d9b640 1 --2- 172.21.15.79:0/1989701853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13b8108600 0x7f13b819b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:57.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.436+0000 7f13b659c640 1 --2- 172.21.15.79:0/1989701853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13b8101500 0x7f13b819b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:57.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.436+0000 7f13b6d9d640 1 -- 172.21.15.79:0/1989701853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13b8101500 msgr2=0x7f13b819b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:57.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.436+0000 7f13b6d9d640 1 --2- 172.21.15.79:0/1989701853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13b8101500 0x7f13b819b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:57.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.436+0000 7f13b6d9d640 1 -- 172.21.15.79:0/1989701853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13b8108600 msgr2=0x7f13b819b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:57.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.436+0000 7f13b6d9d640 1 --2- 172.21.15.79:0/1989701853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13b8108600 0x7f13b819b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:57.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.436+0000 7f13b6d9d640 1 -- 172.21.15.79:0/1989701853 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13b81a11d0 con 0x7f13b8108f80 2024-08-20T01:55:57.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.436+0000 7f13b6d9d640 1 --2- 172.21.15.79:0/1989701853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13b8108f80 0x7f13b81a0a00 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f13b000eaa0 tx=0x7f13b000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:57.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.436+0000 7f13a77fe640 1 -- 172.21.15.79:0/1989701853 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b000cdb0 con 0x7f13b8108f80 2024-08-20T01:55:57.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.437+0000 7f13bc8e8640 1 -- 172.21.15.79:0/1989701853 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13b81a14c0 con 0x7f13b8108f80 2024-08-20T01:55:57.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.437+0000 7f13a77fe640 1 -- 172.21.15.79:0/1989701853 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f13b0005020 con 0x7f13b8108f80 2024-08-20T01:55:57.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.437+0000 7f13a77fe640 1 -- 172.21.15.79:0/1989701853 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b00116d0 con 0x7f13b8108f80 2024-08-20T01:55:57.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.437+0000 7f13bc8e8640 1 -- 172.21.15.79:0/1989701853 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13b81a7b80 con 0x7f13b8108f80 2024-08-20T01:55:57.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.438+0000 7f13bc8e8640 1 -- 172.21.15.79:0/1989701853 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13b81018e0 con 0x7f13b8108f80 2024-08-20T01:55:57.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.439+0000 7f13a77fe640 1 -- 172.21.15.79:0/1989701853 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f13b0004a40 con 0x7f13b8108f80 2024-08-20T01:55:57.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.440+0000 7f13a77fe640 1 --2- 172.21.15.79:0/1989701853 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f13a00b3bd0 0x7f13a00b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:57.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.440+0000 7f13b659c640 1 --2- 172.21.15.79:0/1989701853 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f13a00b3bd0 0x7f13a00b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:57.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.440+0000 7f13a77fe640 1 -- 172.21.15.79:0/1989701853 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8211+0+0 (secure 0 0 0) 0x7f13b00e3fc0 con 0x7f13b8108f80 2024-08-20T01:55:57.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.440+0000 7f13b659c640 1 --2- 172.21.15.79:0/1989701853 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f13a00b3bd0 0x7f13a00b6090 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f13a8009bd0 tx=0x7f13a8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:57.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.443+0000 7f13a77fe640 1 -- 172.21.15.79:0/1989701853 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f13b0016030 con 0x7f13b8108f80 2024-08-20T01:55:57.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.665+0000 7f13bc8e8640 1 -- 172.21.15.79:0/1989701853 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f13b81a7ee0 con 0x7f13b8108f80 2024-08-20T01:55:57.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.668+0000 7f13a77fe640 1 -- 172.21.15.79:0/1989701853 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v72) ==== 161+0+0 (secure 0 0 0) 0x7f13b00ab070 con 0x7f13b8108f80 2024-08-20T01:55:57.670 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-20T01:55:57.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.671+0000 7f13bc8e8640 1 -- 172.21.15.79:0/1989701853 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f13a00b3bd0 msgr2=0x7f13a00b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:57.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.671+0000 7f13bc8e8640 1 --2- 172.21.15.79:0/1989701853 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f13a00b3bd0 0x7f13a00b6090 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f13a8009bd0 tx=0x7f13a8005f90 comp rx=0 tx=0).stop 2024-08-20T01:55:57.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.671+0000 7f13bc8e8640 1 -- 172.21.15.79:0/1989701853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13b8108f80 msgr2=0x7f13b81a0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:57.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.671+0000 7f13bc8e8640 1 --2- 172.21.15.79:0/1989701853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13b8108f80 0x7f13b81a0a00 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f13b000eaa0 tx=0x7f13b000ef60 comp rx=0 tx=0).stop 2024-08-20T01:55:57.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.671+0000 7f13bc8e8640 1 -- 172.21.15.79:0/1989701853 shutdown_connections 2024-08-20T01:55:57.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.671+0000 7f13bc8e8640 1 --2- 172.21.15.79:0/1989701853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13b8108f80 0x7f13b81a0a00 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:57.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.671+0000 7f13bc8e8640 1 --2- 172.21.15.79:0/1989701853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13b8108600 0x7f13b819b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:57.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.671+0000 7f13bc8e8640 1 --2- 172.21.15.79:0/1989701853 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f13a00b3bd0 0x7f13a00b6090 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:57.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.671+0000 7f13bc8e8640 1 --2- 172.21.15.79:0/1989701853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13b8101500 0x7f13b819b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:57.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.671+0000 7f13bc8e8640 1 -- 172.21.15.79:0/1989701853 >> 172.21.15.79:0/1989701853 conn(0x7f13b8076cc0 msgr2=0x7f13b80ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:57.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.671+0000 7f13bc8e8640 1 -- 172.21.15.79:0/1989701853 shutdown_connections 2024-08-20T01:55:57.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:57.671+0000 7f13bc8e8640 1 -- 172.21.15.79:0/1989701853 wait complete. 2024-08-20T01:55:57.889 INFO:journalctl@ceph.mds.f.smithi175.stdout:Aug 20 01:55:57 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-f[51984]: ignoring --setuser ceph since I am not root 2024-08-20T01:55:57.890 INFO:journalctl@ceph.mds.f.smithi175.stdout:Aug 20 01:55:57 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-f[51984]: ignoring --setgroup ceph since I am not root 2024-08-20T01:55:57.890 INFO:journalctl@ceph.mds.f.smithi175.stdout:Aug 20 01:55:57 smithi175 ceph-mds[51988]: -- 172.21.15.175:0/2489431388 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5604ade03860 con 0x5604adde0800 2024-08-20T01:55:57.890 INFO:journalctl@ceph.mds.f.smithi175.stdout:Aug 20 01:55:57 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-f[51984]: starting mds.f at 2024-08-20T01:55:57.890 INFO:journalctl@ceph.mds.l.smithi175.stdout:Aug 20 01:55:57 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-l[51679]: ignoring --setuser ceph since I am not root 2024-08-20T01:55:57.890 INFO:journalctl@ceph.mds.l.smithi175.stdout:Aug 20 01:55:57 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-l[51679]: ignoring --setgroup ceph since I am not root 2024-08-20T01:55:57.890 INFO:journalctl@ceph.mds.l.smithi175.stdout:Aug 20 01:55:57 smithi175 ceph-mds[51683]: -- 172.21.15.175:0/1010489523 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c8a57e7c20 con 0x55c8a57c5400 2024-08-20T01:55:57.890 INFO:journalctl@ceph.mds.l.smithi175.stdout:Aug 20 01:55:57 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-l[51679]: starting mds.l at 2024-08-20T01:55:57.891 INFO:journalctl@ceph.mds.i.smithi175.stdout:Aug 20 01:55:57 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-i[52590]: ignoring --setuser ceph since I am not root 2024-08-20T01:55:57.891 INFO:journalctl@ceph.mds.i.smithi175.stdout:Aug 20 01:55:57 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-i[52590]: ignoring --setgroup ceph since I am not root 2024-08-20T01:55:57.891 INFO:journalctl@ceph.mds.i.smithi175.stdout:Aug 20 01:55:57 smithi175 ceph-mds[52594]: -- 172.21.15.175:0/3029709036 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5577f9c93860 con 0x5577f9c71000 2024-08-20T01:55:57.891 INFO:journalctl@ceph.mds.i.smithi175.stdout:Aug 20 01:55:57 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-i[52590]: starting mds.i at 2024-08-20T01:55:57.891 INFO:journalctl@ceph.mds.c.smithi175.stdout:Aug 20 01:55:57 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-c[52287]: ignoring --setuser ceph since I am not root 2024-08-20T01:55:57.891 INFO:journalctl@ceph.mds.c.smithi175.stdout:Aug 20 01:55:57 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-c[52287]: ignoring --setgroup ceph since I am not root 2024-08-20T01:55:57.891 INFO:journalctl@ceph.mds.c.smithi175.stdout:Aug 20 01:55:57 smithi175 ceph-mds[52291]: --2- 172.21.15.175:0/407573545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5589a7a0f000 0x5589a7b66580 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x5589a7ae6e10 tx=0x5589a7ae0780 comp rx=0 tx=0).write_message sending message m=0x5589a7a6e8c0 seq=3 auth(proto 2 2 bytes epoch 0) 2024-08-20T01:55:57.891 INFO:journalctl@ceph.mds.c.smithi175.stdout:Aug 20 01:55:57 smithi175 ceph-mds[52291]: -- 172.21.15.175:0/407573545 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5589a7a3b520 con 0x5589a7a0f000 2024-08-20T01:55:57.891 INFO:journalctl@ceph.mds.c.smithi175.stdout:Aug 20 01:55:57 smithi175 ceph-mds[52291]: -- 172.21.15.175:0/407573545 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5589a7a31860 con 0x5589a7a0f000 2024-08-20T01:55:57.892 INFO:journalctl@ceph.mds.c.smithi175.stdout:Aug 20 01:55:57 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-c[52287]: starting mds.c at 2024-08-20T01:55:57.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:57 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mon-a[18652]: 2024-08-20T01:55:57.666+0000 7f9acf25d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-20T01:55:57.938 INFO:journalctl@ceph.mds.a.smithi079.stdout:Aug 20 01:55:57 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-a[58672]: ignoring --setuser ceph since I am not root 2024-08-20T01:55:57.938 INFO:journalctl@ceph.mds.a.smithi079.stdout:Aug 20 01:55:57 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-a[58672]: ignoring --setgroup ceph since I am not root 2024-08-20T01:55:57.938 INFO:journalctl@ceph.mds.a.smithi079.stdout:Aug 20 01:55:57 smithi079 ceph-mds[58688]: -- 172.21.15.79:0/162860880 <== mon.0 v2:172.21.15.79:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55abc3a91860 con 0x55abc3a6f400 2024-08-20T01:55:57.938 INFO:journalctl@ceph.mds.a.smithi079.stdout:Aug 20 01:55:57 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-a[58672]: starting mds.a at 2024-08-20T01:55:58.028 INFO:journalctl@ceph.mds.e.smithi081.stdout:Aug 20 01:55:57 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-e[51369]: ignoring --setuser ceph since I am not root 2024-08-20T01:55:58.029 INFO:journalctl@ceph.mds.e.smithi081.stdout:Aug 20 01:55:57 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-e[51369]: ignoring --setgroup ceph since I am not root 2024-08-20T01:55:58.029 INFO:journalctl@ceph.mds.e.smithi081.stdout:Aug 20 01:55:57 smithi081 ceph-mds[51373]: -- 172.21.15.81:0/56455417 <== mon.0 v2:172.21.15.79:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5585d49f3860 con 0x5585d49d1000 2024-08-20T01:55:58.029 INFO:journalctl@ceph.mds.e.smithi081.stdout:Aug 20 01:55:57 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-e[51369]: starting mds.e at 2024-08-20T01:55:58.029 INFO:journalctl@ceph.mds.b.smithi081.stdout:Aug 20 01:55:57 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-b[51985]: ignoring --setuser ceph since I am not root 2024-08-20T01:55:58.029 INFO:journalctl@ceph.mds.b.smithi081.stdout:Aug 20 01:55:57 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-b[51985]: ignoring --setgroup ceph since I am not root 2024-08-20T01:55:58.029 INFO:journalctl@ceph.mds.b.smithi081.stdout:Aug 20 01:55:57 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-b[51985]: starting mds.b at 2024-08-20T01:55:58.030 INFO:journalctl@ceph.mds.k.smithi081.stdout:Aug 20 01:55:57 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-k[51054]: ignoring --setuser ceph since I am not root 2024-08-20T01:55:58.030 INFO:journalctl@ceph.mds.k.smithi081.stdout:Aug 20 01:55:57 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-k[51054]: ignoring --setgroup ceph since I am not root 2024-08-20T01:55:58.030 INFO:journalctl@ceph.mds.k.smithi081.stdout:Aug 20 01:55:57 smithi081 ceph-mds[51058]: -- 172.21.15.81:0/505732687 <== mon.0 v2:172.21.15.79:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56441279fc20 con 0x56441277c800 2024-08-20T01:55:58.030 INFO:journalctl@ceph.mds.k.smithi081.stdout:Aug 20 01:55:57 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-k[51054]: starting mds.k at 2024-08-20T01:55:58.030 INFO:journalctl@ceph.mds.h.smithi081.stdout:Aug 20 01:55:57 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-h[51670]: ignoring --setuser ceph since I am not root 2024-08-20T01:55:58.030 INFO:journalctl@ceph.mds.h.smithi081.stdout:Aug 20 01:55:57 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-h[51670]: ignoring --setgroup ceph since I am not root 2024-08-20T01:55:58.030 INFO:journalctl@ceph.mds.h.smithi081.stdout:Aug 20 01:55:57 smithi081 ceph-mds[51674]: -- 172.21.15.81:0/3659009922 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562507a41860 con 0x562507a1e800 2024-08-20T01:55:58.031 INFO:journalctl@ceph.mds.h.smithi081.stdout:Aug 20 01:55:57 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-h[51670]: starting mds.h at 2024-08-20T01:55:58.361 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-08-20T01:55:58.614 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:55:58.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:58 smithi079 ceph-mon[18656]: pgmap v906: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.2 KiB/s wr, 19 op/s 2024-08-20T01:55:58.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:58 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/1989701853' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-08-20T01:55:58.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:58 smithi079 ceph-mon[18656]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-20T01:55:58.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:58 smithi079 ceph-mon[18656]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-20T01:55:58.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:58 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/1989701853' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-20T01:55:58.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:58 smithi079 ceph-mon[18656]: osdmap e75: 12 total, 12 up, 12 in 2024-08-20T01:55:58.687 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:58 smithi079 ceph-mon[18656]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-08-20T01:55:58.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:58 smithi175 ceph-mon[22392]: pgmap v906: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.2 KiB/s wr, 19 op/s 2024-08-20T01:55:58.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:58 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/1989701853' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-08-20T01:55:58.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:58 smithi175 ceph-mon[22392]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-20T01:55:58.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:58 smithi175 ceph-mon[22392]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-20T01:55:58.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:58 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/1989701853' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-20T01:55:58.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:58 smithi175 ceph-mon[22392]: osdmap e75: 12 total, 12 up, 12 in 2024-08-20T01:55:58.890 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:58 smithi175 ceph-mon[22392]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-08-20T01:55:59.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:58 smithi081 ceph-mon[22209]: pgmap v906: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.2 KiB/s wr, 19 op/s 2024-08-20T01:55:59.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:58 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/1989701853' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-08-20T01:55:59.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:58 smithi081 ceph-mon[22209]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-20T01:55:59.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:58 smithi081 ceph-mon[22209]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-20T01:55:59.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:58 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/1989701853' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-20T01:55:59.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:58 smithi081 ceph-mon[22209]: osdmap e75: 12 total, 12 up, 12 in 2024-08-20T01:55:59.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:58 smithi081 ceph-mon[22209]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-08-20T01:55:59.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.070+0000 7fa21b0dc640 1 -- 172.21.15.79:0/2359162211 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa214101990 msgr2=0x7fa214101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:59.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.070+0000 7fa21b0dc640 1 --2- 172.21.15.79:0/2359162211 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa214101990 0x7fa214101d70 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fa204009900 tx=0x7fa20402a410 comp rx=0 tx=0).stop 2024-08-20T01:55:59.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.070+0000 7fa21b0dc640 1 -- 172.21.15.79:0/2359162211 shutdown_connections 2024-08-20T01:55:59.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.070+0000 7fa21b0dc640 1 --2- 172.21.15.79:0/2359162211 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa214107d20 0x7fa21410e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:59.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.070+0000 7fa21b0dc640 1 --2- 172.21.15.79:0/2359162211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2141073a0 0x7fa2141077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:59.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.070+0000 7fa21b0dc640 1 --2- 172.21.15.79:0/2359162211 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa214101990 0x7fa214101d70 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:59.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.070+0000 7fa21b0dc640 1 -- 172.21.15.79:0/2359162211 >> 172.21.15.79:0/2359162211 conn(0x7fa2140fd400 msgr2=0x7fa2140ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:59.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.070+0000 7fa21b0dc640 1 -- 172.21.15.79:0/2359162211 shutdown_connections 2024-08-20T01:55:59.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.070+0000 7fa21b0dc640 1 -- 172.21.15.79:0/2359162211 wait complete. 2024-08-20T01:55:59.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.070+0000 7fa21b0dc640 1 Processor -- start 2024-08-20T01:55:59.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.070+0000 7fa21b0dc640 1 -- start start 2024-08-20T01:55:59.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.071+0000 7fa21b0dc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa214101990 0x7fa214198fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:59.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.071+0000 7fa21b0dc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2141073a0 0x7fa214199510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:59.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.071+0000 7fa21b0dc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa214107d20 0x7fa21419e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:59.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.071+0000 7fa21b0dc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa2141129e0 con 0x7fa214107d20 2024-08-20T01:55:59.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.071+0000 7fa21b0dc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa214112860 con 0x7fa214101990 2024-08-20T01:55:59.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.071+0000 7fa21b0dc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa214112b60 con 0x7fa2141073a0 2024-08-20T01:55:59.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.071+0000 7fa219679640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa214107d20 0x7fa21419e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:59.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.071+0000 7fa219679640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa214107d20 0x7fa21419e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57020/0 (socket says 172.21.15.79:57020) 2024-08-20T01:55:59.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.071+0000 7fa219679640 1 -- 172.21.15.79:0/2189080473 learned_addr learned my addr 172.21.15.79:0/2189080473 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:55:59.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.071+0000 7fa218e78640 1 --2- 172.21.15.79:0/2189080473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa214101990 0x7fa214198fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:59.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.071+0000 7fa219679640 1 -- 172.21.15.79:0/2189080473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2141073a0 msgr2=0x7fa214199510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:59.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.071+0000 7fa219679640 1 --2- 172.21.15.79:0/2189080473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2141073a0 0x7fa214199510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:59.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.071+0000 7fa219679640 1 -- 172.21.15.79:0/2189080473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa214101990 msgr2=0x7fa214198fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:59.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.071+0000 7fa219679640 1 --2- 172.21.15.79:0/2189080473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa214101990 0x7fa214198fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:59.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.071+0000 7fa219679640 1 -- 172.21.15.79:0/2189080473 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa21419f080 con 0x7fa214107d20 2024-08-20T01:55:59.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.071+0000 7fa218e78640 1 --2- 172.21.15.79:0/2189080473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa214101990 0x7fa214198fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T01:55:59.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.071+0000 7fa219679640 1 --2- 172.21.15.79:0/2189080473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa214107d20 0x7fa21419e8b0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7fa20c009fd0 tx=0x7fa20c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:59.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.071+0000 7fa211ffb640 1 -- 172.21.15.79:0/2189080473 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20c011830 con 0x7fa214107d20 2024-08-20T01:55:59.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.071+0000 7fa211ffb640 1 -- 172.21.15.79:0/2189080473 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa20c016070 con 0x7fa214107d20 2024-08-20T01:55:59.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.072+0000 7fa21b0dc640 1 -- 172.21.15.79:0/2189080473 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa21419f370 con 0x7fa214107d20 2024-08-20T01:55:59.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.072+0000 7fa211ffb640 1 -- 172.21.15.79:0/2189080473 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20c010d20 con 0x7fa214107d20 2024-08-20T01:55:59.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.072+0000 7fa21b0dc640 1 -- 172.21.15.79:0/2189080473 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2141a5a30 con 0x7fa214107d20 2024-08-20T01:55:59.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.073+0000 7fa21b0dc640 1 -- 172.21.15.79:0/2189080473 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa214101d70 con 0x7fa214107d20 2024-08-20T01:55:59.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.074+0000 7fa211ffb640 1 -- 172.21.15.79:0/2189080473 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa20c0119d0 con 0x7fa214107d20 2024-08-20T01:55:59.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.075+0000 7fa211ffb640 1 --2- 172.21.15.79:0/2189080473 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa2000b3bd0 0x7fa2000b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:55:59.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.075+0000 7fa218e78640 1 --2- 172.21.15.79:0/2189080473 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa2000b3bd0 0x7fa2000b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:55:59.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.075+0000 7fa211ffb640 1 -- 172.21.15.79:0/2189080473 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8641+0+0 (secure 0 0 0) 0x7fa20c0e3ae0 con 0x7fa214107d20 2024-08-20T01:55:59.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.075+0000 7fa218e78640 1 --2- 172.21.15.79:0/2189080473 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa2000b3bd0 0x7fa2000b6090 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa204006010 tx=0x7fa204000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:55:59.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.078+0000 7fa211ffb640 1 -- 172.21.15.79:0/2189080473 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fa20c0aaf90 con 0x7fa214107d20 2024-08-20T01:55:59.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.300+0000 7fa21b0dc640 1 -- 172.21.15.79:0/2189080473 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fa21419a100 con 0x7fa214107d20 2024-08-20T01:55:59.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.676+0000 7fa211ffb640 1 -- 172.21.15.79:0/2189080473 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v74) ==== 104+0+0 (secure 0 0 0) 0x7fa20c0aa890 con 0x7fa214107d20 2024-08-20T01:55:59.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.678+0000 7fa21b0dc640 1 -- 172.21.15.79:0/2189080473 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa2000b3bd0 msgr2=0x7fa2000b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:59.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.678+0000 7fa21b0dc640 1 --2- 172.21.15.79:0/2189080473 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa2000b3bd0 0x7fa2000b6090 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa204006010 tx=0x7fa204000bc0 comp rx=0 tx=0).stop 2024-08-20T01:55:59.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.678+0000 7fa21b0dc640 1 -- 172.21.15.79:0/2189080473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa214107d20 msgr2=0x7fa21419e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:55:59.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.678+0000 7fa21b0dc640 1 --2- 172.21.15.79:0/2189080473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa214107d20 0x7fa21419e8b0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7fa20c009fd0 tx=0x7fa20c00b8e0 comp rx=0 tx=0).stop 2024-08-20T01:55:59.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.678+0000 7fa21b0dc640 1 -- 172.21.15.79:0/2189080473 shutdown_connections 2024-08-20T01:55:59.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.678+0000 7fa21b0dc640 1 --2- 172.21.15.79:0/2189080473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa214107d20 0x7fa21419e8b0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:59.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.678+0000 7fa21b0dc640 1 --2- 172.21.15.79:0/2189080473 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7fa2000b3bd0 0x7fa2000b6090 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:59.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.678+0000 7fa21b0dc640 1 --2- 172.21.15.79:0/2189080473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2141073a0 0x7fa214199510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:59.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.678+0000 7fa21b0dc640 1 --2- 172.21.15.79:0/2189080473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa214101990 0x7fa214198fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:55:59.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.678+0000 7fa21b0dc640 1 -- 172.21.15.79:0/2189080473 >> 172.21.15.79:0/2189080473 conn(0x7fa2140fd400 msgr2=0x7fa2140fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:55:59.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.679+0000 7fa21b0dc640 1 -- 172.21.15.79:0/2189080473 shutdown_connections 2024-08-20T01:55:59.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:55:59.679+0000 7fa21b0dc640 1 -- 172.21.15.79:0/2189080473 wait complete. 2024-08-20T01:55:59.937 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:59 smithi079 ceph-mon[18656]: mds.? [v2:172.21.15.175:6833/3603668570,v1:172.21.15.175:6837/3603668570] up:boot 2024-08-20T01:55:59.938 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:59 smithi079 ceph-mon[18656]: mds.? [v2:172.21.15.175:6834/193079820,v1:172.21.15.175:6838/193079820] up:boot 2024-08-20T01:55:59.938 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:59 smithi079 ceph-mon[18656]: mds.? [v2:172.21.15.175:6832/2741662803,v1:172.21.15.175:6836/2741662803] up:boot 2024-08-20T01:55:59.938 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:59 smithi079 ceph-mon[18656]: mds.? [v2:172.21.15.175:6835/3705502392,v1:172.21.15.175:6839/3705502392] up:boot 2024-08-20T01:55:59.938 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:59 smithi079 ceph-mon[18656]: mds.? [v2:172.21.15.81:6832/3895316729,v1:172.21.15.81:6834/3895316729] up:boot 2024-08-20T01:55:59.938 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:59 smithi079 ceph-mon[18656]: mds.? [v2:172.21.15.81:6833/2324276752,v1:172.21.15.81:6835/2324276752] up:boot 2024-08-20T01:55:59.938 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:59 smithi079 ceph-mon[18656]: mds.? [v2:172.21.15.81:6836/3761300561,v1:172.21.15.81:6837/3761300561] up:boot 2024-08-20T01:55:59.938 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:59 smithi079 ceph-mon[18656]: mds.? [v2:172.21.15.81:6838/4209861517,v1:172.21.15.81:6839/4209861517] up:boot 2024-08-20T01:55:59.938 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:59 smithi079 ceph-mon[18656]: mds.? [v2:172.21.15.79:6838/3822924875,v1:172.21.15.79:6840/3822924875] up:boot 2024-08-20T01:55:59.938 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:59 smithi079 ceph-mon[18656]: mds.? [v2:172.21.15.79:6839/272498785,v1:172.21.15.79:6841/272498785] up:boot 2024-08-20T01:55:59.939 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:59 smithi079 ceph-mon[18656]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-08-20T01:55:59.939 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:59 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-20T01:55:59.939 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:59 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-20T01:55:59.939 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:59 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-20T01:55:59.939 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:59 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-20T01:55:59.939 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:59 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-20T01:55:59.939 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:59 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-20T01:55:59.939 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:59 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-20T01:55:59.939 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:59 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-20T01:55:59.939 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:59 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-20T01:55:59.939 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:59 smithi079 ceph-mon[18656]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-20T01:55:59.939 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:59 smithi079 ceph-mon[18656]: pgmap v908: 97 pgs: 97 active+clean; 1.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.4 KiB/s wr, 19 op/s 2024-08-20T01:55:59.940 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:55:59 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2189080473' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-08-20T01:56:00.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:59 smithi081 ceph-mon[22209]: mds.? [v2:172.21.15.175:6833/3603668570,v1:172.21.15.175:6837/3603668570] up:boot 2024-08-20T01:56:00.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:59 smithi081 ceph-mon[22209]: mds.? [v2:172.21.15.175:6834/193079820,v1:172.21.15.175:6838/193079820] up:boot 2024-08-20T01:56:00.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:59 smithi081 ceph-mon[22209]: mds.? [v2:172.21.15.175:6832/2741662803,v1:172.21.15.175:6836/2741662803] up:boot 2024-08-20T01:56:00.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:59 smithi081 ceph-mon[22209]: mds.? [v2:172.21.15.175:6835/3705502392,v1:172.21.15.175:6839/3705502392] up:boot 2024-08-20T01:56:00.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:59 smithi081 ceph-mon[22209]: mds.? [v2:172.21.15.81:6832/3895316729,v1:172.21.15.81:6834/3895316729] up:boot 2024-08-20T01:56:00.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:59 smithi081 ceph-mon[22209]: mds.? [v2:172.21.15.81:6833/2324276752,v1:172.21.15.81:6835/2324276752] up:boot 2024-08-20T01:56:00.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:59 smithi081 ceph-mon[22209]: mds.? [v2:172.21.15.81:6836/3761300561,v1:172.21.15.81:6837/3761300561] up:boot 2024-08-20T01:56:00.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:59 smithi081 ceph-mon[22209]: mds.? [v2:172.21.15.81:6838/4209861517,v1:172.21.15.81:6839/4209861517] up:boot 2024-08-20T01:56:00.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:59 smithi081 ceph-mon[22209]: mds.? [v2:172.21.15.79:6838/3822924875,v1:172.21.15.79:6840/3822924875] up:boot 2024-08-20T01:56:00.030 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:59 smithi081 ceph-mon[22209]: mds.? [v2:172.21.15.79:6839/272498785,v1:172.21.15.79:6841/272498785] up:boot 2024-08-20T01:56:00.030 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:59 smithi081 ceph-mon[22209]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-08-20T01:56:00.030 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:59 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-20T01:56:00.030 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:59 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-20T01:56:00.030 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:59 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-20T01:56:00.030 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:59 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-20T01:56:00.030 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:59 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-20T01:56:00.030 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:59 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-20T01:56:00.030 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:59 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-20T01:56:00.030 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:59 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-20T01:56:00.030 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:59 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-20T01:56:00.030 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:59 smithi081 ceph-mon[22209]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-20T01:56:00.031 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:59 smithi081 ceph-mon[22209]: pgmap v908: 97 pgs: 97 active+clean; 1.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.4 KiB/s wr, 19 op/s 2024-08-20T01:56:00.031 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:55:59 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2189080473' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-08-20T01:56:00.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:59 smithi175 ceph-mon[22392]: mds.? [v2:172.21.15.175:6833/3603668570,v1:172.21.15.175:6837/3603668570] up:boot 2024-08-20T01:56:00.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:59 smithi175 ceph-mon[22392]: mds.? [v2:172.21.15.175:6834/193079820,v1:172.21.15.175:6838/193079820] up:boot 2024-08-20T01:56:00.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:59 smithi175 ceph-mon[22392]: mds.? [v2:172.21.15.175:6832/2741662803,v1:172.21.15.175:6836/2741662803] up:boot 2024-08-20T01:56:00.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:59 smithi175 ceph-mon[22392]: mds.? [v2:172.21.15.175:6835/3705502392,v1:172.21.15.175:6839/3705502392] up:boot 2024-08-20T01:56:00.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:59 smithi175 ceph-mon[22392]: mds.? [v2:172.21.15.81:6832/3895316729,v1:172.21.15.81:6834/3895316729] up:boot 2024-08-20T01:56:00.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:59 smithi175 ceph-mon[22392]: mds.? [v2:172.21.15.81:6833/2324276752,v1:172.21.15.81:6835/2324276752] up:boot 2024-08-20T01:56:00.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:59 smithi175 ceph-mon[22392]: mds.? [v2:172.21.15.81:6836/3761300561,v1:172.21.15.81:6837/3761300561] up:boot 2024-08-20T01:56:00.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:59 smithi175 ceph-mon[22392]: mds.? [v2:172.21.15.81:6838/4209861517,v1:172.21.15.81:6839/4209861517] up:boot 2024-08-20T01:56:00.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:59 smithi175 ceph-mon[22392]: mds.? [v2:172.21.15.79:6838/3822924875,v1:172.21.15.79:6840/3822924875] up:boot 2024-08-20T01:56:00.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:59 smithi175 ceph-mon[22392]: mds.? [v2:172.21.15.79:6839/272498785,v1:172.21.15.79:6841/272498785] up:boot 2024-08-20T01:56:00.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:59 smithi175 ceph-mon[22392]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-08-20T01:56:00.141 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:59 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-20T01:56:00.141 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:59 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-20T01:56:00.141 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:59 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-20T01:56:00.141 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:59 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-20T01:56:00.141 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:59 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-20T01:56:00.141 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:59 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-20T01:56:00.141 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:59 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-20T01:56:00.141 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:59 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-20T01:56:00.141 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:59 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-20T01:56:00.141 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:59 smithi175 ceph-mon[22392]: from='mgr.14150 172.21.15.79:0/3660753502' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-20T01:56:00.141 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:59 smithi175 ceph-mon[22392]: pgmap v908: 97 pgs: 97 active+clean; 1.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.4 KiB/s wr, 19 op/s 2024-08-20T01:56:00.141 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:55:59 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2189080473' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-08-20T01:56:00.369 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-20T01:56:00.611 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:56:00.931 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:56:00 smithi079 ceph-mon[18656]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-20T01:56:00.931 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:56:00 smithi079 ceph-mon[18656]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-20T01:56:00.931 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:56:00 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/2189080473' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-08-20T01:56:00.931 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:56:00 smithi079 ceph-mon[18656]: fsmap 12 up:standby 2024-08-20T01:56:01.028 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:56:00 smithi081 ceph-mon[22209]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-20T01:56:01.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:56:00 smithi081 ceph-mon[22209]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-20T01:56:01.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:56:00 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/2189080473' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-08-20T01:56:01.029 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:56:00 smithi081 ceph-mon[22209]: fsmap 12 up:standby 2024-08-20T01:56:01.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:01.136+0000 7effd3552640 1 -- 172.21.15.79:0/779147226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effcc1084e0 msgr2=0x7effcc108920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:56:01.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:01.136+0000 7effd3552640 1 --2- 172.21.15.79:0/779147226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effcc1084e0 0x7effcc108920 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7effbc009900 tx=0x7effbc02a410 comp rx=0 tx=0).stop 2024-08-20T01:56:01.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:01.137+0000 7effd3552640 1 -- 172.21.15.79:0/779147226 shutdown_connections 2024-08-20T01:56:01.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:01.137+0000 7effd3552640 1 --2- 172.21.15.79:0/779147226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effcc108e60 0x7effcc10f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:56:01.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:01.137+0000 7effd3552640 1 --2- 172.21.15.79:0/779147226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effcc1084e0 0x7effcc108920 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:56:01.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:01.137+0000 7effd3552640 1 --2- 172.21.15.79:0/779147226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effcc102ad0 0x7effcc102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:56:01.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:01.137+0000 7effd3552640 1 -- 172.21.15.79:0/779147226 >> 172.21.15.79:0/779147226 conn(0x7effcc0fe540 msgr2=0x7effcc100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:56:01.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:01.137+0000 7effd3552640 1 -- 172.21.15.79:0/779147226 shutdown_connections 2024-08-20T01:56:01.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:01.137+0000 7effd3552640 1 -- 172.21.15.79:0/779147226 wait complete. 2024-08-20T01:56:01.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:01.137+0000 7effd3552640 1 Processor -- start 2024-08-20T01:56:01.139 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:01.137+0000 7effd3552640 1 -- start start 2024-08-20T01:56:01.142 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:56:00 smithi175 ceph-mon[22392]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-20T01:56:01.142 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:56:00 smithi175 ceph-mon[22392]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-20T01:56:01.142 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:56:00 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/2189080473' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-08-20T01:56:01.142 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:56:00 smithi175 ceph-mon[22392]: fsmap 12 up:standby 2024-08-20T01:56:01.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:01.137+0000 7effd3552640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effcc102ad0 0x7effcc198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:56:01.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:01.137+0000 7effd3552640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effcc1084e0 0x7effcc199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:56:01.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:01.137+0000 7effd3552640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effcc108e60 0x7effcc19e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:56:01.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:01.137+0000 7effd3552640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7effcc1129b0 con 0x7effcc102ad0 2024-08-20T01:56:01.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:01.137+0000 7effd3552640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7effcc112830 con 0x7effcc108e60 2024-08-20T01:56:01.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:01.137+0000 7effd3552640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7effcc112b30 con 0x7effcc1084e0 2024-08-20T01:56:01.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:01.138+0000 7effd12ee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effcc102ad0 0x7effcc198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:56:01.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:01.138+0000 7effd12ee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effcc102ad0 0x7effcc198ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42780/0 (socket says 172.21.15.79:42780) 2024-08-20T01:56:01.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:01.138+0000 7effd12ee640 1 -- 172.21.15.79:0/3161698093 learned_addr learned my addr 172.21.15.79:0/3161698093 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:56:01.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:01.138+0000 7effd1aef640 1 --2- 172.21.15.79:0/3161698093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effcc108e60 0x7effcc19e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:56:01.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:01.138+0000 7effd0aed640 1 --2- 172.21.15.79:0/3161698093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effcc1084e0 0x7effcc199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:56:01.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:01.138+0000 7effd12ee640 1 -- 172.21.15.79:0/3161698093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effcc1084e0 msgr2=0x7effcc199400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:56:01.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:01.138+0000 7effd12ee640 1 --2- 172.21.15.79:0/3161698093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effcc1084e0 0x7effcc199400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:56:01.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:01.138+0000 7effd12ee640 1 -- 172.21.15.79:0/3161698093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effcc108e60 msgr2=0x7effcc19e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:56:01.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:01.138+0000 7effd12ee640 1 --2- 172.21.15.79:0/3161698093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effcc108e60 0x7effcc19e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:56:01.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:01.138+0000 7effd12ee640 1 -- 172.21.15.79:0/3161698093 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effcc19ef70 con 0x7effcc102ad0 2024-08-20T01:56:01.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:01.138+0000 7effd0aed640 1 --2- 172.21.15.79:0/3161698093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effcc1084e0 0x7effcc199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T01:56:01.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:01.138+0000 7effd12ee640 1 --2- 172.21.15.79:0/3161698093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effcc102ad0 0x7effcc198ec0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7effc800c890 tx=0x7effc800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:56:01.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:01.138+0000 7effc27fc640 1 -- 172.21.15.79:0/3161698093 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc8004220 con 0x7effcc102ad0 2024-08-20T01:56:01.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:01.138+0000 7effc27fc640 1 -- 172.21.15.79:0/3161698093 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7effc8007e40 con 0x7effcc102ad0 2024-08-20T01:56:01.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:01.138+0000 7effd3552640 1 -- 172.21.15.79:0/3161698093 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effcc19f260 con 0x7effcc102ad0 2024-08-20T01:56:01.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:01.138+0000 7effc27fc640 1 -- 172.21.15.79:0/3161698093 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc8004a00 con 0x7effcc102ad0 2024-08-20T01:56:01.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:01.138+0000 7effd3552640 1 -- 172.21.15.79:0/3161698093 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effcc1a5920 con 0x7effcc102ad0 2024-08-20T01:56:01.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:01.139+0000 7effd3552640 1 -- 172.21.15.79:0/3161698093 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effcc102eb0 con 0x7effcc102ad0 2024-08-20T01:56:01.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:01.141+0000 7effc27fc640 1 -- 172.21.15.79:0/3161698093 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7effc80079b0 con 0x7effcc102ad0 2024-08-20T01:56:01.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:01.141+0000 7effc27fc640 1 --2- 172.21.15.79:0/3161698093 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7effb80b3bd0 0x7effb80b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:56:01.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:01.141+0000 7effd0aed640 1 --2- 172.21.15.79:0/3161698093 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7effb80b3bd0 0x7effb80b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:56:01.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:01.141+0000 7effc27fc640 1 -- 172.21.15.79:0/3161698093 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8641+0+0 (secure 0 0 0) 0x7effc80e3b40 con 0x7effcc102ad0 2024-08-20T01:56:01.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:01.142+0000 7effd0aed640 1 --2- 172.21.15.79:0/3161698093 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7effb80b3bd0 0x7effb80b6090 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7effbc02a930 tx=0x7effbc005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:56:01.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:01.145+0000 7effc27fc640 1 -- 172.21.15.79:0/3161698093 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7effc8014030 con 0x7effcc102ad0 2024-08-20T01:56:01.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:01.323+0000 7effd3552640 1 -- 172.21.15.79:0/3161698093 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7effcc02e340 con 0x7effcc102ad0 2024-08-20T01:56:02.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:02.102+0000 7effc27fc640 1 -- 172.21.15.79:0/3161698093 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v76) ==== 181+0+0 (secure 0 0 0) 0x7effc80aaf90 con 0x7effcc102ad0 2024-08-20T01:56:02.104 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2024-08-20T01:56:02.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:02.105+0000 7effd3552640 1 -- 172.21.15.79:0/3161698093 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7effb80b3bd0 msgr2=0x7effb80b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:56:02.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:02.105+0000 7effd3552640 1 --2- 172.21.15.79:0/3161698093 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7effb80b3bd0 0x7effb80b6090 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7effbc02a930 tx=0x7effbc005fd0 comp rx=0 tx=0).stop 2024-08-20T01:56:02.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:02.105+0000 7effd3552640 1 -- 172.21.15.79:0/3161698093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effcc102ad0 msgr2=0x7effcc198ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:56:02.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:02.105+0000 7effd3552640 1 --2- 172.21.15.79:0/3161698093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effcc102ad0 0x7effcc198ec0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7effc800c890 tx=0x7effc800cd50 comp rx=0 tx=0).stop 2024-08-20T01:56:02.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:02.105+0000 7effd3552640 1 -- 172.21.15.79:0/3161698093 shutdown_connections 2024-08-20T01:56:02.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:02.105+0000 7effd3552640 1 --2- 172.21.15.79:0/3161698093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effcc108e60 0x7effcc19e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:56:02.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:02.105+0000 7effd3552640 1 --2- 172.21.15.79:0/3161698093 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7effb80b3bd0 0x7effb80b6090 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:56:02.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:02.105+0000 7effd3552640 1 --2- 172.21.15.79:0/3161698093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effcc1084e0 0x7effcc199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:56:02.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:02.105+0000 7effd3552640 1 --2- 172.21.15.79:0/3161698093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effcc102ad0 0x7effcc198ec0 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:56:02.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:02.105+0000 7effd3552640 1 -- 172.21.15.79:0/3161698093 >> 172.21.15.79:0/3161698093 conn(0x7effcc0fe540 msgr2=0x7effcc100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:56:02.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:02.106+0000 7effd3552640 1 -- 172.21.15.79:0/3161698093 shutdown_connections 2024-08-20T01:56:02.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:02.106+0000 7effd3552640 1 -- 172.21.15.79:0/3161698093 wait complete. 2024-08-20T01:56:02.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:56:02 smithi175 ceph-mon[22392]: pgmap v909: 97 pgs: 97 active+clean; 1018 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.1 KiB/s wr, 19 op/s 2024-08-20T01:56:02.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:56:02 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/3161698093' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-08-20T01:56:02.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:56:02 smithi079 ceph-mon[18656]: pgmap v909: 97 pgs: 97 active+clean; 1018 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.1 KiB/s wr, 19 op/s 2024-08-20T01:56:02.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:56:02 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/3161698093' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-08-20T01:56:02.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:56:02 smithi081 ceph-mon[22209]: pgmap v909: 97 pgs: 97 active+clean; 1018 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.1 KiB/s wr, 19 op/s 2024-08-20T01:56:02.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:56:02 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/3161698093' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-08-20T01:56:02.814 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-20T01:56:03.061 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T01:56:03.363 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:56:03 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/3161698093' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-08-20T01:56:03.363 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:56:03 smithi079 ceph-mon[18656]: osdmap e76: 12 total, 12 up, 12 in 2024-08-20T01:56:03.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:56:03 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/3161698093' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-08-20T01:56:03.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:56:03 smithi175 ceph-mon[22392]: osdmap e76: 12 total, 12 up, 12 in 2024-08-20T01:56:03.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:56:03 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/3161698093' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-08-20T01:56:03.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:56:03 smithi081 ceph-mon[22209]: osdmap e76: 12 total, 12 up, 12 in 2024-08-20T01:56:03.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:03.553+0000 7f3917d21640 1 -- 172.21.15.79:0/2539440671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3910104270 msgr2=0x7f391010c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:56:03.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:03.553+0000 7f3917d21640 1 --2- 172.21.15.79:0/2539440671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3910104270 0x7f391010c850 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f3900009900 tx=0x7f390002a410 comp rx=0 tx=0).stop 2024-08-20T01:56:03.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:03.553+0000 7f3917d21640 1 -- 172.21.15.79:0/2539440671 shutdown_connections 2024-08-20T01:56:03.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:03.553+0000 7f3917d21640 1 --2- 172.21.15.79:0/2539440671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f391010ce20 0x7f391010f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:56:03.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:03.553+0000 7f3917d21640 1 --2- 172.21.15.79:0/2539440671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3910104270 0x7f391010c850 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:56:03.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:03.553+0000 7f3917d21640 1 --2- 172.21.15.79:0/2539440671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3910103870 0x7f3910103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:56:03.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:03.553+0000 7f3917d21640 1 -- 172.21.15.79:0/2539440671 >> 172.21.15.79:0/2539440671 conn(0x7f39100fd400 msgr2=0x7f39100ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:56:03.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:03.554+0000 7f3917d21640 1 -- 172.21.15.79:0/2539440671 shutdown_connections 2024-08-20T01:56:03.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:03.554+0000 7f3917d21640 1 -- 172.21.15.79:0/2539440671 wait complete. 2024-08-20T01:56:03.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:03.554+0000 7f3917d21640 1 Processor -- start 2024-08-20T01:56:03.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:03.554+0000 7f3917d21640 1 -- start start 2024-08-20T01:56:03.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:03.554+0000 7f3917d21640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3910103870 0x7f39101016f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:56:03.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:03.554+0000 7f3917d21640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3910104270 0x7f3910101c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:56:03.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:03.554+0000 7f3917d21640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f391010ce20 0x7f3910102170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:56:03.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:03.554+0000 7f3917d21640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3910112910 con 0x7f391010ce20 2024-08-20T01:56:03.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:03.554+0000 7f3917d21640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3910112790 con 0x7f3910103870 2024-08-20T01:56:03.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:03.554+0000 7f3917d21640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3910112a90 con 0x7f3910104270 2024-08-20T01:56:03.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:03.554+0000 7f39162be640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f391010ce20 0x7f3910102170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:56:03.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:03.555+0000 7f39162be640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f391010ce20 0x7f3910102170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42800/0 (socket says 172.21.15.79:42800) 2024-08-20T01:56:03.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:03.555+0000 7f39162be640 1 -- 172.21.15.79:0/1873667552 learned_addr learned my addr 172.21.15.79:0/1873667552 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-08-20T01:56:03.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:03.555+0000 7f39152bc640 1 --2- 172.21.15.79:0/1873667552 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3910104270 0x7f3910101c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:56:03.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:03.555+0000 7f3915abd640 1 --2- 172.21.15.79:0/1873667552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3910103870 0x7f39101016f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:56:03.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:03.555+0000 7f39162be640 1 -- 172.21.15.79:0/1873667552 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3910104270 msgr2=0x7f3910101c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:56:03.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:03.555+0000 7f39162be640 1 --2- 172.21.15.79:0/1873667552 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3910104270 0x7f3910101c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:56:03.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:03.555+0000 7f39162be640 1 -- 172.21.15.79:0/1873667552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3910103870 msgr2=0x7f39101016f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:56:03.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:03.555+0000 7f39162be640 1 --2- 172.21.15.79:0/1873667552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3910103870 0x7f39101016f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:56:03.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:03.555+0000 7f39162be640 1 -- 172.21.15.79:0/1873667552 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39101a7280 con 0x7f391010ce20 2024-08-20T01:56:03.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:03.555+0000 7f39162be640 1 --2- 172.21.15.79:0/1873667552 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f391010ce20 0x7f3910102170 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f390800cad0 tx=0x7f390800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:56:03.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:03.555+0000 7f3906ffd640 1 -- 172.21.15.79:0/1873667552 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390800ae20 con 0x7f391010ce20 2024-08-20T01:56:03.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:03.555+0000 7f3906ffd640 1 -- 172.21.15.79:0/1873667552 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3908005020 con 0x7f391010ce20 2024-08-20T01:56:03.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:03.555+0000 7f3917d21640 1 -- 172.21.15.79:0/1873667552 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39101a7570 con 0x7f391010ce20 2024-08-20T01:56:03.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:03.555+0000 7f3906ffd640 1 -- 172.21.15.79:0/1873667552 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390800f6b0 con 0x7f391010ce20 2024-08-20T01:56:03.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:03.555+0000 7f3917d21640 1 -- 172.21.15.79:0/1873667552 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39101a7a80 con 0x7f391010ce20 2024-08-20T01:56:03.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:03.556+0000 7f3917d21640 1 -- 172.21.15.79:0/1873667552 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3910103c50 con 0x7f391010ce20 2024-08-20T01:56:03.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:03.557+0000 7f3906ffd640 1 -- 172.21.15.79:0/1873667552 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f39080051d0 con 0x7f391010ce20 2024-08-20T01:56:03.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:03.558+0000 7f3906ffd640 1 --2- 172.21.15.79:0/1873667552 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f38fc0b3bd0 0x7f38fc0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T01:56:03.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:03.559+0000 7f3915abd640 1 --2- 172.21.15.79:0/1873667552 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f38fc0b3bd0 0x7f38fc0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T01:56:03.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:03.559+0000 7f3906ffd640 1 -- 172.21.15.79:0/1873667552 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8145+0+0 (secure 0 0 0) 0x7f39080e3f40 con 0x7f391010ce20 2024-08-20T01:56:03.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:03.559+0000 7f3915abd640 1 --2- 172.21.15.79:0/1873667552 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f38fc0b3bd0 0x7f38fc0b6090 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f390c005d00 tx=0x7f390c005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T01:56:03.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:03.562+0000 7f3906ffd640 1 -- 172.21.15.79:0/1873667552 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f3908014030 con 0x7f391010ce20 2024-08-20T01:56:03.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:03.737+0000 7f3917d21640 1 -- 172.21.15.79:0/1873667552 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f391002e340 con 0x7f391010ce20 2024-08-20T01:56:04.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:04.110+0000 7f3906ffd640 1 -- 172.21.15.79:0/1873667552 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v77) ==== 169+0+0 (secure 0 0 0) 0x7f39080ab590 con 0x7f391010ce20 2024-08-20T01:56:04.112 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' removed 2024-08-20T01:56:04.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:04.112+0000 7f3917d21640 1 -- 172.21.15.79:0/1873667552 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f38fc0b3bd0 msgr2=0x7f38fc0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:56:04.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:04.112+0000 7f3917d21640 1 --2- 172.21.15.79:0/1873667552 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f38fc0b3bd0 0x7f38fc0b6090 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f390c005d00 tx=0x7f390c005c50 comp rx=0 tx=0).stop 2024-08-20T01:56:04.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:04.112+0000 7f3917d21640 1 -- 172.21.15.79:0/1873667552 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f391010ce20 msgr2=0x7f3910102170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T01:56:04.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:04.112+0000 7f3917d21640 1 --2- 172.21.15.79:0/1873667552 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f391010ce20 0x7f3910102170 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f390800cad0 tx=0x7f390800cf90 comp rx=0 tx=0).stop 2024-08-20T01:56:04.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:04.112+0000 7f3917d21640 1 -- 172.21.15.79:0/1873667552 shutdown_connections 2024-08-20T01:56:04.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:04.112+0000 7f3917d21640 1 --2- 172.21.15.79:0/1873667552 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f391010ce20 0x7f3910102170 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:56:04.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:04.112+0000 7f3917d21640 1 --2- 172.21.15.79:0/1873667552 >> [v2:172.21.15.79:6800/3038112779,v1:172.21.15.79:6801/3038112779] conn(0x7f38fc0b3bd0 0x7f38fc0b6090 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:56:04.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:04.112+0000 7f3917d21640 1 --2- 172.21.15.79:0/1873667552 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3910104270 0x7f3910101c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:56:04.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:04.112+0000 7f3917d21640 1 --2- 172.21.15.79:0/1873667552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3910103870 0x7f39101016f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T01:56:04.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:04.113+0000 7f3917d21640 1 -- 172.21.15.79:0/1873667552 >> 172.21.15.79:0/1873667552 conn(0x7f39100fd400 msgr2=0x7f39100fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T01:56:04.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:04.113+0000 7f3917d21640 1 -- 172.21.15.79:0/1873667552 shutdown_connections 2024-08-20T01:56:04.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-08-20T01:56:04.113+0000 7f3917d21640 1 -- 172.21.15.79:0/1873667552 wait complete. 2024-08-20T01:56:04.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:56:04 smithi175 ceph-mon[22392]: pgmap v911: 65 pgs: 65 active+clean; 981 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:56:04.390 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:56:04 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/1873667552' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-08-20T01:56:04.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:56:04 smithi079 ceph-mon[18656]: pgmap v911: 65 pgs: 65 active+clean; 981 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:56:04.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:56:04 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/1873667552' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-08-20T01:56:04.528 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:56:04 smithi081 ceph-mon[22209]: pgmap v911: 65 pgs: 65 active+clean; 981 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T01:56:04.529 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:56:04 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/1873667552' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-08-20T01:56:04.843 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-20T01:56:04.891 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-20T01:56:04.918 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-20T01:56:04.946 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-08-20T01:56:04.946 DEBUG:teuthology.orchestra.run.smithi079:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-20T01:56:04.962 DEBUG:teuthology.orchestra.run.smithi081:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-20T01:56:04.976 DEBUG:teuthology.orchestra.run.smithi175:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-20T01:56:05.001 INFO:tasks.cephadm:Stopping all daemons... 2024-08-20T01:56:05.001 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-08-20T01:56:05.001 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mon.a 2024-08-20T01:56:05.129 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:56:05 smithi079 systemd[1]: Stopping Ceph mon.a for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:56:05.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:56:05 smithi081 ceph-mon[22209]: from='client.? 172.21.15.79:0/1873667552' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-08-20T01:56:05.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:56:05 smithi081 ceph-mon[22209]: osdmap e77: 12 total, 12 up, 12 in 2024-08-20T01:56:05.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:56:05 smithi175 ceph-mon[22392]: from='client.? 172.21.15.79:0/1873667552' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-08-20T01:56:05.389 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:56:05 smithi175 ceph-mon[22392]: osdmap e77: 12 total, 12 up, 12 in 2024-08-20T01:56:05.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:56:05 smithi079 ceph-mon[18656]: from='client.? 172.21.15.79:0/1873667552' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-08-20T01:56:05.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:56:05 smithi079 ceph-mon[18656]: osdmap e77: 12 total, 12 up, 12 in 2024-08-20T01:56:05.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:56:05 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mon-a[18652]: 2024-08-20T01:56:05.335+0000 7f9ad4a68640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:56:05.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:56:05 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mon-a[18652]: 2024-08-20T01:56:05.335+0000 7f9ad4a68640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-08-20T01:56:05.852 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:56:05 smithi079 podman[149969]: 2024-08-20 01:56:05.508520594 +0000 UTC m=+0.296131970 container died 6399ab7138052474f9f49084a6d41ce1b989c63f6b85d7c3bf2c8309b882b5cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-08-20T01:56:06.181 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:56:05 smithi079 podman[149969]: 2024-08-20 01:56:05.944629887 +0000 UTC m=+0.732241314 container cleanup 6399ab7138052474f9f49084a6d41ce1b989c63f6b85d7c3bf2c8309b882b5cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-08-20T01:56:06.181 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:56:05 smithi079 bash[149969]: ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mon-a 2024-08-20T01:56:06.400 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mon.a.service' 2024-08-20T01:56:06.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:56:06 smithi079 podman[149982]: 2024-08-20 01:56:06.179201349 +0000 UTC m=+0.670629045 container remove 6399ab7138052474f9f49084a6d41ce1b989c63f6b85d7c3bf2c8309b882b5cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-08-20T01:56:06.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:56:06 smithi079 systemd[1]: ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mon.a.service: Deactivated successfully. 2024-08-20T01:56:06.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:56:06 smithi079 systemd[1]: Stopped Ceph mon.a for 28484e9a-5e93-11ef-bccf-c7b262605968. 2024-08-20T01:56:06.437 INFO:journalctl@ceph.mon.a.smithi079.stdout:Aug 20 01:56:06 smithi079 systemd[1]: ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mon.a.service: Consumed 23.854s CPU time. 2024-08-20T01:56:06.455 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:56:06.456 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-08-20T01:56:06.456 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-08-20T01:56:06.456 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mon.b 2024-08-20T01:56:06.743 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:56:06 smithi081 systemd[1]: Stopping Ceph mon.b for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:56:07.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:56:06 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mon-b[22205]: 2024-08-20T01:56:06.740+0000 7f5c1e1eb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:56:07.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:56:06 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mon-b[22205]: 2024-08-20T01:56:06.740+0000 7f5c1e1eb640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-08-20T01:56:07.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:56:07 smithi081 podman[57983]: 2024-08-20 01:56:07.005367602 +0000 UTC m=+0.359077484 container died c7fb4d2ef7eaf9f7ed64b06811b0a2a20b98e603369f31b1be512de1b3359231 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mon-b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-08-20T01:56:07.619 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:56:07 smithi081 podman[57983]: 2024-08-20 01:56:07.38235304 +0000 UTC m=+0.736062920 container cleanup c7fb4d2ef7eaf9f7ed64b06811b0a2a20b98e603369f31b1be512de1b3359231 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mon-b, ceph=True, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-20T01:56:07.619 INFO:journalctl@ceph.mon.b.smithi081.stdout:Aug 20 01:56:07 smithi081 bash[57983]: ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mon-b 2024-08-20T01:56:07.769 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mon.b.service' 2024-08-20T01:56:07.813 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:56:07.813 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-08-20T01:56:07.813 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-08-20T01:56:07.813 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mon.c 2024-08-20T01:56:08.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:56:07 smithi175 systemd[1]: Stopping Ceph mon.c for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:56:08.629 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:56:08 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mon-c[22388]: 2024-08-20T01:56:08.143+0000 7fc164006640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:56:08.629 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:56:08 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mon-c[22388]: 2024-08-20T01:56:08.143+0000 7fc164006640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-08-20T01:56:08.629 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:56:08 smithi175 podman[58136]: 2024-08-20 01:56:08.357266869 +0000 UTC m=+0.357279915 container died e7b3dc17999d2be7e4d8fa7ea4b0689a7a10339721bf090fbcca7595710a3466 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mon-c, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True) 2024-08-20T01:56:08.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:56:08 smithi175 podman[58136]: 2024-08-20 01:56:08.735359644 +0000 UTC m=+0.735372687 container cleanup e7b3dc17999d2be7e4d8fa7ea4b0689a7a10339721bf090fbcca7595710a3466 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-08-20T01:56:08.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Aug 20 01:56:08 smithi175 bash[58136]: ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mon-c 2024-08-20T01:56:09.172 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mon.c.service' 2024-08-20T01:56:09.217 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:56:09.217 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-08-20T01:56:09.218 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-08-20T01:56:09.218 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mgr.x 2024-08-20T01:56:09.535 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:56:09 smithi079 systemd[1]: Stopping Ceph mgr.x for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:56:09.894 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:56:09 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x[18884]: 2024-08-20T01:56:09.531+0000 7f285a53a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:56:09.894 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:56:09 smithi079 podman[150091]: 2024-08-20 01:56:09.563393138 +0000 UTC m=+0.162141080 container died a969c0130e1ca40cb9d6fabbe95f2b94bf6e8ed3a7635eec7047cdd5ebcf7e57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T01:56:10.187 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:56:09 smithi079 podman[150091]: 2024-08-20 01:56:09.991015656 +0000 UTC m=+0.589763590 container cleanup a969c0130e1ca40cb9d6fabbe95f2b94bf6e8ed3a7635eec7047cdd5ebcf7e57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-08-20T01:56:10.187 INFO:journalctl@ceph.mgr.x.smithi079.stdout:Aug 20 01:56:09 smithi079 bash[150091]: ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-x 2024-08-20T01:56:10.421 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mgr.x.service' 2024-08-20T01:56:10.455 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:56:10.455 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-08-20T01:56:10.455 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-08-20T01:56:10.455 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mgr.y 2024-08-20T01:56:10.768 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Aug 20 01:56:10 smithi081 systemd[1]: Stopping Ceph mgr.y for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:56:11.028 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Aug 20 01:56:10 smithi081 podman[58109]: 2024-08-20 01:56:10.766149776 +0000 UTC m=+0.116336536 container died 78334f5c956f78b7ecd406e89d3fd4c4e1f546a192e421d650d18137a9aa23a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-y, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0) 2024-08-20T01:56:11.407 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Aug 20 01:56:11 smithi081 podman[58109]: 2024-08-20 01:56:11.170560136 +0000 UTC m=+0.520746941 container cleanup 78334f5c956f78b7ecd406e89d3fd4c4e1f546a192e421d650d18137a9aa23a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0) 2024-08-20T01:56:11.407 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Aug 20 01:56:11 smithi081 bash[58109]: ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-y 2024-08-20T01:56:11.551 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mgr.y.service' 2024-08-20T01:56:11.584 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:56:11.584 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-08-20T01:56:11.585 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-08-20T01:56:11.585 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mgr.z 2024-08-20T01:56:11.889 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Aug 20 01:56:11 smithi175 systemd[1]: Stopping Ceph mgr.z for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:56:12.200 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Aug 20 01:56:11 smithi175 podman[58264]: 2024-08-20 01:56:11.91077205 +0000 UTC m=+0.141232350 container died 2f5bfd5c2c46f8047e59ac80c96f1a4e6a812e313f30fa6b26bad1aa049ddd23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-20T01:56:12.542 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Aug 20 01:56:12 smithi175 podman[58264]: 2024-08-20 01:56:12.281332436 +0000 UTC m=+0.511792738 container cleanup 2f5bfd5c2c46f8047e59ac80c96f1a4e6a812e313f30fa6b26bad1aa049ddd23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-20T01:56:12.542 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Aug 20 01:56:12 smithi175 bash[58264]: ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mgr-z 2024-08-20T01:56:12.703 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mgr.z.service' 2024-08-20T01:56:12.736 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:56:12.737 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-08-20T01:56:12.737 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-08-20T01:56:12.737 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-28484e9a-5e93-11ef-bccf-c7b262605968@osd.0 2024-08-20T01:56:13.022 INFO:journalctl@ceph.osd.0.smithi079.stdout:Aug 20 01:56:12 smithi079 systemd[1]: Stopping Ceph osd.0 for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:56:13.437 INFO:journalctl@ceph.osd.0.smithi079.stdout:Aug 20 01:56:13 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-0[32290]: 2024-08-20T01:56:13.019+0000 7f1774229640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:56:13.437 INFO:journalctl@ceph.osd.0.smithi079.stdout:Aug 20 01:56:13 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-0[32290]: 2024-08-20T01:56:13.019+0000 7f1774229640 -1 osd.0 77 *** Got signal Terminated *** 2024-08-20T01:56:13.437 INFO:journalctl@ceph.osd.0.smithi079.stdout:Aug 20 01:56:13 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-0[32290]: 2024-08-20T01:56:13.019+0000 7f1774229640 -1 osd.0 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-20T01:56:25.187 INFO:journalctl@ceph.osd.0.smithi079.stdout:Aug 20 01:56:24 smithi079 podman[150214]: 2024-08-20 01:56:24.922458695 +0000 UTC m=+12.007066225 container died 4dd33d561847810076abc7328ef59e2a843293de1a3cdf7fc37b1c2694b95db4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-20T01:56:25.687 INFO:journalctl@ceph.osd.0.smithi079.stdout:Aug 20 01:56:25 smithi079 podman[150214]: 2024-08-20 01:56:25.428585373 +0000 UTC m=+12.513192906 container cleanup 4dd33d561847810076abc7328ef59e2a843293de1a3cdf7fc37b1c2694b95db4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_BRANCH=HEAD) 2024-08-20T01:56:25.687 INFO:journalctl@ceph.osd.0.smithi079.stdout:Aug 20 01:56:25 smithi079 bash[150214]: ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-0 2024-08-20T01:56:26.003 INFO:journalctl@ceph.osd.0.smithi079.stdout:Aug 20 01:56:25 smithi079 podman[150243]: 2024-08-20 01:56:25.696665385 +0000 UTC m=+0.769368029 container remove 4dd33d561847810076abc7328ef59e2a843293de1a3cdf7fc37b1c2694b95db4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-0, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-08-20T01:56:26.410 INFO:journalctl@ceph.osd.0.smithi079.stdout:Aug 20 01:56:26 smithi079 podman[150334]: 2024-08-20 01:56:25.904142778 +0000 UTC m=+0.015925053 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:56:26.410 INFO:journalctl@ceph.osd.0.smithi079.stdout:Aug 20 01:56:26 smithi079 podman[150334]: 2024-08-20 01:56:26.0141946 +0000 UTC m=+0.125976878 container create 52ae16ba13d340c95d98c2d73c8d1557586f8f94775fb6c47416273cb0e8828d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-08-20T01:56:26.411 INFO:journalctl@ceph.osd.0.smithi079.stdout:Aug 20 01:56:26 smithi079 podman[150334]: 2024-08-20 01:56:26.4085643 +0000 UTC m=+0.520346579 container init 52ae16ba13d340c95d98c2d73c8d1557586f8f94775fb6c47416273cb0e8828d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0) 2024-08-20T01:56:26.687 INFO:journalctl@ceph.osd.0.smithi079.stdout:Aug 20 01:56:26 smithi079 podman[150334]: 2024-08-20 01:56:26.412613132 +0000 UTC m=+0.524395408 container start 52ae16ba13d340c95d98c2d73c8d1557586f8f94775fb6c47416273cb0e8828d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-08-20T01:56:26.687 INFO:journalctl@ceph.osd.0.smithi079.stdout:Aug 20 01:56:26 smithi079 podman[150334]: 2024-08-20 01:56:26.525514246 +0000 UTC m=+0.637296593 container attach 52ae16ba13d340c95d98c2d73c8d1557586f8f94775fb6c47416273cb0e8828d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-20T01:56:27.163 INFO:journalctl@ceph.osd.0.smithi079.stdout:Aug 20 01:56:26 smithi079 podman[150334]: 2024-08-20 01:56:26.807579655 +0000 UTC m=+0.919361940 container died 52ae16ba13d340c95d98c2d73c8d1557586f8f94775fb6c47416273cb0e8828d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, GIT_BRANCH=HEAD) 2024-08-20T01:56:27.573 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@osd.0.service' 2024-08-20T01:56:27.613 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:56:27.613 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-08-20T01:56:27.613 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-08-20T01:56:27.614 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-28484e9a-5e93-11ef-bccf-c7b262605968@osd.1 2024-08-20T01:56:27.902 INFO:journalctl@ceph.osd.1.smithi081.stdout:Aug 20 01:56:27 smithi081 systemd[1]: Stopping Ceph osd.1 for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:56:28.278 INFO:journalctl@ceph.osd.1.smithi081.stdout:Aug 20 01:56:27 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-1[26622]: 2024-08-20T01:56:27.899+0000 7ffbdab33640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:56:28.279 INFO:journalctl@ceph.osd.1.smithi081.stdout:Aug 20 01:56:27 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-1[26622]: 2024-08-20T01:56:27.899+0000 7ffbdab33640 -1 osd.1 77 *** Got signal Terminated *** 2024-08-20T01:56:28.279 INFO:journalctl@ceph.osd.1.smithi081.stdout:Aug 20 01:56:27 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-1[26622]: 2024-08-20T01:56:27.899+0000 7ffbdab33640 -1 osd.1 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-20T01:56:33.678 INFO:journalctl@ceph.osd.1.smithi081.stdout:Aug 20 01:56:33 smithi081 podman[58246]: 2024-08-20 01:56:33.410414026 +0000 UTC m=+5.604213886 container died 5ce4f6fa7d884975c5c7b0df8d1abcae0a44c28d917bdd80863c5ea591b4d21f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-1, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0) 2024-08-20T01:56:34.028 INFO:journalctl@ceph.osd.1.smithi081.stdout:Aug 20 01:56:33 smithi081 podman[58246]: 2024-08-20 01:56:33.749824736 +0000 UTC m=+5.943624603 container cleanup 5ce4f6fa7d884975c5c7b0df8d1abcae0a44c28d917bdd80863c5ea591b4d21f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-20T01:56:34.029 INFO:journalctl@ceph.osd.1.smithi081.stdout:Aug 20 01:56:33 smithi081 bash[58246]: ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-1 2024-08-20T01:56:34.029 INFO:journalctl@ceph.osd.1.smithi081.stdout:Aug 20 01:56:33 smithi081 podman[58262]: 2024-08-20 01:56:33.9179134 +0000 UTC m=+0.509213139 container remove 5ce4f6fa7d884975c5c7b0df8d1abcae0a44c28d917bdd80863c5ea591b4d21f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD) 2024-08-20T01:56:34.648 INFO:journalctl@ceph.osd.1.smithi081.stdout:Aug 20 01:56:34 smithi081 podman[58354]: 2024-08-20 01:56:34.258218493 +0000 UTC m=+0.015579704 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:56:34.648 INFO:journalctl@ceph.osd.1.smithi081.stdout:Aug 20 01:56:34 smithi081 podman[58354]: 2024-08-20 01:56:34.393631448 +0000 UTC m=+0.150992648 container create 1aedfb1cc0e864821f9024f64b5ce9230a0f7d1a700124b2b14681c3cc542724 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-1-deactivate, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-08-20T01:56:35.029 INFO:journalctl@ceph.osd.1.smithi081.stdout:Aug 20 01:56:34 smithi081 podman[58354]: 2024-08-20 01:56:34.646305993 +0000 UTC m=+0.403667198 container init 1aedfb1cc0e864821f9024f64b5ce9230a0f7d1a700124b2b14681c3cc542724 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-08-20T01:56:35.029 INFO:journalctl@ceph.osd.1.smithi081.stdout:Aug 20 01:56:34 smithi081 podman[58354]: 2024-08-20 01:56:34.64962972 +0000 UTC m=+0.406990923 container start 1aedfb1cc0e864821f9024f64b5ce9230a0f7d1a700124b2b14681c3cc542724 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux ) 2024-08-20T01:56:35.029 INFO:journalctl@ceph.osd.1.smithi081.stdout:Aug 20 01:56:34 smithi081 podman[58354]: 2024-08-20 01:56:34.729616453 +0000 UTC m=+0.486977675 container attach 1aedfb1cc0e864821f9024f64b5ce9230a0f7d1a700124b2b14681c3cc542724 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.36.0) 2024-08-20T01:56:35.029 INFO:journalctl@ceph.osd.1.smithi081.stdout:Aug 20 01:56:34 smithi081 podman[58354]: 2024-08-20 01:56:34.841935055 +0000 UTC m=+0.599296267 container died 1aedfb1cc0e864821f9024f64b5ce9230a0f7d1a700124b2b14681c3cc542724 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.36.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-08-20T01:56:35.379 INFO:journalctl@ceph.osd.1.smithi081.stdout:Aug 20 01:56:35 smithi081 podman[58378]: 2024-08-20 01:56:35.37475852 +0000 UTC m=+0.526432288 container remove 1aedfb1cc0e864821f9024f64b5ce9230a0f7d1a700124b2b14681c3cc542724 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-08-20T01:56:35.400 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@osd.1.service' 2024-08-20T01:56:35.439 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:56:35.440 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-08-20T01:56:35.440 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-08-20T01:56:35.440 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-28484e9a-5e93-11ef-bccf-c7b262605968@osd.2 2024-08-20T01:56:35.719 INFO:journalctl@ceph.osd.2.smithi175.stdout:Aug 20 01:56:35 smithi175 systemd[1]: Stopping Ceph osd.2 for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:56:36.139 INFO:journalctl@ceph.osd.2.smithi175.stdout:Aug 20 01:56:35 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-2[27341]: 2024-08-20T01:56:35.716+0000 7f5f731bb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:56:36.139 INFO:journalctl@ceph.osd.2.smithi175.stdout:Aug 20 01:56:35 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-2[27341]: 2024-08-20T01:56:35.716+0000 7f5f731bb640 -1 osd.2 77 *** Got signal Terminated *** 2024-08-20T01:56:36.139 INFO:journalctl@ceph.osd.2.smithi175.stdout:Aug 20 01:56:35 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-2[27341]: 2024-08-20T01:56:35.716+0000 7f5f731bb640 -1 osd.2 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-20T01:56:41.560 INFO:journalctl@ceph.osd.2.smithi175.stdout:Aug 20 01:56:41 smithi175 podman[58401]: 2024-08-20 01:56:41.291737428 +0000 UTC m=+5.660272391 container died f5cc59dbc8281bfb699314dee4115ced8b3a938a559b263a94c0ef6d7b1de79b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.schema-version=1.0) 2024-08-20T01:56:41.819 INFO:journalctl@ceph.osd.2.smithi175.stdout:Aug 20 01:56:41 smithi175 podman[58401]: 2024-08-20 01:56:41.633147856 +0000 UTC m=+6.001682822 container cleanup f5cc59dbc8281bfb699314dee4115ced8b3a938a559b263a94c0ef6d7b1de79b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T01:56:41.819 INFO:journalctl@ceph.osd.2.smithi175.stdout:Aug 20 01:56:41 smithi175 bash[58401]: ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-2 2024-08-20T01:56:42.139 INFO:journalctl@ceph.osd.2.smithi175.stdout:Aug 20 01:56:41 smithi175 podman[58418]: 2024-08-20 01:56:41.817687047 +0000 UTC m=+0.521302945 container remove f5cc59dbc8281bfb699314dee4115ced8b3a938a559b263a94c0ef6d7b1de79b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.schema-version=1.0) 2024-08-20T01:56:42.534 INFO:journalctl@ceph.osd.2.smithi175.stdout:Aug 20 01:56:42 smithi175 podman[58505]: 2024-08-20 01:56:42.145922243 +0000 UTC m=+0.015656373 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:56:42.535 INFO:journalctl@ceph.osd.2.smithi175.stdout:Aug 20 01:56:42 smithi175 podman[58505]: 2024-08-20 01:56:42.276905626 +0000 UTC m=+0.146639784 container create 8037cac35df46933ec2d9e625b3930d18079816b68d62a2df1b595433b968ca8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-2-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-08-20T01:56:42.535 INFO:journalctl@ceph.osd.2.smithi175.stdout:Aug 20 01:56:42 smithi175 podman[58505]: 2024-08-20 01:56:42.445909066 +0000 UTC m=+0.315643189 container init 8037cac35df46933ec2d9e625b3930d18079816b68d62a2df1b595433b968ca8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-2-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T01:56:42.535 INFO:journalctl@ceph.osd.2.smithi175.stdout:Aug 20 01:56:42 smithi175 podman[58505]: 2024-08-20 01:56:42.449166224 +0000 UTC m=+0.318900350 container start 8037cac35df46933ec2d9e625b3930d18079816b68d62a2df1b595433b968ca8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0) 2024-08-20T01:56:42.535 INFO:journalctl@ceph.osd.2.smithi175.stdout:Aug 20 01:56:42 smithi175 podman[58505]: 2024-08-20 01:56:42.532040637 +0000 UTC m=+0.401774762 container attach 8037cac35df46933ec2d9e625b3930d18079816b68d62a2df1b595433b968ca8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T01:56:42.867 INFO:journalctl@ceph.osd.2.smithi175.stdout:Aug 20 01:56:42 smithi175 podman[58505]: 2024-08-20 01:56:42.637169226 +0000 UTC m=+0.506903342 container died 8037cac35df46933ec2d9e625b3930d18079816b68d62a2df1b595433b968ca8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-08-20T01:56:43.132 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@osd.2.service' 2024-08-20T01:56:43.171 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:56:43.171 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-08-20T01:56:43.171 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-08-20T01:56:43.171 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-28484e9a-5e93-11ef-bccf-c7b262605968@osd.3 2024-08-20T01:56:43.474 INFO:journalctl@ceph.osd.3.smithi079.stdout:Aug 20 01:56:43 smithi079 systemd[1]: Stopping Ceph osd.3 for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:56:43.938 INFO:journalctl@ceph.osd.3.smithi079.stdout:Aug 20 01:56:43 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-3[38748]: 2024-08-20T01:56:43.471+0000 7ff184433640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:56:43.938 INFO:journalctl@ceph.osd.3.smithi079.stdout:Aug 20 01:56:43 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-3[38748]: 2024-08-20T01:56:43.471+0000 7ff184433640 -1 osd.3 77 *** Got signal Terminated *** 2024-08-20T01:56:43.938 INFO:journalctl@ceph.osd.3.smithi079.stdout:Aug 20 01:56:43 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-3[38748]: 2024-08-20T01:56:43.471+0000 7ff184433640 -1 osd.3 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-20T01:56:49.332 INFO:journalctl@ceph.osd.3.smithi079.stdout:Aug 20 01:56:49 smithi079 podman[150437]: 2024-08-20 01:56:49.048997312 +0000 UTC m=+5.685644631 container died eb4f8a817d1867f04265cb2306ba1235c656a2c148b5104a71d0a553278aab0a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-3, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-08-20T01:56:49.687 INFO:journalctl@ceph.osd.3.smithi079.stdout:Aug 20 01:56:49 smithi079 podman[150437]: 2024-08-20 01:56:49.530572809 +0000 UTC m=+6.167220167 container cleanup eb4f8a817d1867f04265cb2306ba1235c656a2c148b5104a71d0a553278aab0a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux ) 2024-08-20T01:56:49.687 INFO:journalctl@ceph.osd.3.smithi079.stdout:Aug 20 01:56:49 smithi079 bash[150437]: ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-3 2024-08-20T01:56:50.143 INFO:journalctl@ceph.osd.3.smithi079.stdout:Aug 20 01:56:49 smithi079 podman[150453]: 2024-08-20 01:56:49.80712806 +0000 UTC m=+0.756681364 container remove eb4f8a817d1867f04265cb2306ba1235c656a2c148b5104a71d0a553278aab0a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-3, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True) 2024-08-20T01:56:50.437 INFO:journalctl@ceph.osd.3.smithi079.stdout:Aug 20 01:56:50 smithi079 podman[150542]: 2024-08-20 01:56:50.044017603 +0000 UTC m=+0.015564748 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:56:50.437 INFO:journalctl@ceph.osd.3.smithi079.stdout:Aug 20 01:56:50 smithi079 podman[150542]: 2024-08-20 01:56:50.149452987 +0000 UTC m=+0.121000165 container create 50e8063713881628ba87a21c44e14c8aac338bcdb2b43161a5968756a6982561 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-08-20T01:56:50.437 INFO:journalctl@ceph.osd.3.smithi079.stdout:Aug 20 01:56:50 smithi079 podman[150542]: 2024-08-20 01:56:50.377147128 +0000 UTC m=+0.348694265 container init 50e8063713881628ba87a21c44e14c8aac338bcdb2b43161a5968756a6982561 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-3-deactivate, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T01:56:50.437 INFO:journalctl@ceph.osd.3.smithi079.stdout:Aug 20 01:56:50 smithi079 podman[150542]: 2024-08-20 01:56:50.38036883 +0000 UTC m=+0.351915974 container start 50e8063713881628ba87a21c44e14c8aac338bcdb2b43161a5968756a6982561 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.36.0) 2024-08-20T01:56:50.915 INFO:journalctl@ceph.osd.3.smithi079.stdout:Aug 20 01:56:50 smithi079 podman[150542]: 2024-08-20 01:56:50.469005247 +0000 UTC m=+0.440552392 container attach 50e8063713881628ba87a21c44e14c8aac338bcdb2b43161a5968756a6982561 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-08-20T01:56:50.916 INFO:journalctl@ceph.osd.3.smithi079.stdout:Aug 20 01:56:50 smithi079 podman[150542]: 2024-08-20 01:56:50.571242492 +0000 UTC m=+0.542789634 container died 50e8063713881628ba87a21c44e14c8aac338bcdb2b43161a5968756a6982561 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-08-20T01:56:51.207 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@osd.3.service' 2024-08-20T01:56:51.244 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:56:51.244 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-08-20T01:56:51.244 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-08-20T01:56:51.245 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-28484e9a-5e93-11ef-bccf-c7b262605968@osd.4 2024-08-20T01:56:51.529 INFO:journalctl@ceph.osd.4.smithi081.stdout:Aug 20 01:56:51 smithi081 systemd[1]: Stopping Ceph osd.4 for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:56:51.782 INFO:journalctl@ceph.osd.4.smithi081.stdout:Aug 20 01:56:51 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-4[33060]: 2024-08-20T01:56:51.535+0000 7ffbe29d3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:56:51.782 INFO:journalctl@ceph.osd.4.smithi081.stdout:Aug 20 01:56:51 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-4[33060]: 2024-08-20T01:56:51.535+0000 7ffbe29d3640 -1 osd.4 77 *** Got signal Terminated *** 2024-08-20T01:56:51.782 INFO:journalctl@ceph.osd.4.smithi081.stdout:Aug 20 01:56:51 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-4[33060]: 2024-08-20T01:56:51.535+0000 7ffbe29d3640 -1 osd.4 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-20T01:56:57.364 INFO:journalctl@ceph.osd.4.smithi081.stdout:Aug 20 01:56:57 smithi081 podman[58472]: 2024-08-20 01:56:57.089545994 +0000 UTC m=+5.648459581 container died 3ded9d5a8ac67cdd24d7c56e4d664895354792ea410f1edc27d651c1b1d4fd16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-4, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-08-20T01:56:57.707 INFO:journalctl@ceph.osd.4.smithi081.stdout:Aug 20 01:56:57 smithi081 podman[58472]: 2024-08-20 01:56:57.45349117 +0000 UTC m=+6.012404746 container cleanup 3ded9d5a8ac67cdd24d7c56e4d664895354792ea410f1edc27d651c1b1d4fd16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-4, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-08-20T01:56:57.707 INFO:journalctl@ceph.osd.4.smithi081.stdout:Aug 20 01:56:57 smithi081 bash[58472]: ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-4 2024-08-20T01:56:58.028 INFO:journalctl@ceph.osd.4.smithi081.stdout:Aug 20 01:56:57 smithi081 podman[58498]: 2024-08-20 01:56:57.705313647 +0000 UTC m=+0.616148418 container remove 3ded9d5a8ac67cdd24d7c56e4d664895354792ea410f1edc27d651c1b1d4fd16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-4, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-08-20T01:56:58.368 INFO:journalctl@ceph.osd.4.smithi081.stdout:Aug 20 01:56:58 smithi081 podman[58588]: 2024-08-20 01:56:57.969821481 +0000 UTC m=+0.015734675 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:56:58.369 INFO:journalctl@ceph.osd.4.smithi081.stdout:Aug 20 01:56:58 smithi081 podman[58588]: 2024-08-20 01:56:58.114756824 +0000 UTC m=+0.160670009 container create 5d3229ed32913629d905e3f83b02adf758a250ea4c6abbe2289b587c0ccf76af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-08-20T01:56:58.369 INFO:journalctl@ceph.osd.4.smithi081.stdout:Aug 20 01:56:58 smithi081 podman[58588]: 2024-08-20 01:56:58.30865099 +0000 UTC m=+0.354564182 container init 5d3229ed32913629d905e3f83b02adf758a250ea4c6abbe2289b587c0ccf76af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-20T01:56:58.369 INFO:journalctl@ceph.osd.4.smithi081.stdout:Aug 20 01:56:58 smithi081 podman[58588]: 2024-08-20 01:56:58.312065339 +0000 UTC m=+0.357978530 container start 5d3229ed32913629d905e3f83b02adf758a250ea4c6abbe2289b587c0ccf76af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-4-deactivate, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_CLEAN=True) 2024-08-20T01:56:58.369 INFO:journalctl@ceph.osd.4.smithi081.stdout:Aug 20 01:56:58 smithi081 podman[58588]: 2024-08-20 01:56:58.367058232 +0000 UTC m=+0.412971421 container attach 5d3229ed32913629d905e3f83b02adf758a250ea4c6abbe2289b587c0ccf76af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.36.0) 2024-08-20T01:56:58.772 INFO:journalctl@ceph.osd.4.smithi081.stdout:Aug 20 01:56:58 smithi081 podman[58610]: 2024-08-20 01:56:58.517428148 +0000 UTC m=+0.016681024 container died 5d3229ed32913629d905e3f83b02adf758a250ea4c6abbe2289b587c0ccf76af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-4-deactivate, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-08-20T01:56:59.041 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@osd.4.service' 2024-08-20T01:56:59.080 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:56:59.080 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-08-20T01:56:59.080 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-08-20T01:56:59.080 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-28484e9a-5e93-11ef-bccf-c7b262605968@osd.5 2024-08-20T01:56:59.386 INFO:journalctl@ceph.osd.5.smithi175.stdout:Aug 20 01:56:59 smithi175 systemd[1]: Stopping Ceph osd.5 for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:56:59.639 INFO:journalctl@ceph.osd.5.smithi175.stdout:Aug 20 01:56:59 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-5[33904]: 2024-08-20T01:56:59.383+0000 7f93ca539640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:56:59.639 INFO:journalctl@ceph.osd.5.smithi175.stdout:Aug 20 01:56:59 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-5[33904]: 2024-08-20T01:56:59.383+0000 7f93ca539640 -1 osd.5 77 *** Got signal Terminated *** 2024-08-20T01:56:59.639 INFO:journalctl@ceph.osd.5.smithi175.stdout:Aug 20 01:56:59 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-5[33904]: 2024-08-20T01:56:59.383+0000 7f93ca539640 -1 osd.5 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-20T01:57:05.253 INFO:journalctl@ceph.osd.5.smithi175.stdout:Aug 20 01:57:04 smithi175 podman[58619]: 2024-08-20 01:57:04.95040361 +0000 UTC m=+5.672869911 container died 28b9fb249ff07c4f1ad62b577983c6e7a58821f30ab9f17524f733bac9ac4277 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-5, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux ) 2024-08-20T01:57:05.578 INFO:journalctl@ceph.osd.5.smithi175.stdout:Aug 20 01:57:05 smithi175 podman[58619]: 2024-08-20 01:57:05.325225476 +0000 UTC m=+6.047691812 container cleanup 28b9fb249ff07c4f1ad62b577983c6e7a58821f30ab9f17524f733bac9ac4277 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=) 2024-08-20T01:57:05.578 INFO:journalctl@ceph.osd.5.smithi175.stdout:Aug 20 01:57:05 smithi175 bash[58619]: ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-5 2024-08-20T01:57:05.870 INFO:journalctl@ceph.osd.5.smithi175.stdout:Aug 20 01:57:05 smithi175 podman[58636]: 2024-08-20 01:57:05.576405532 +0000 UTC m=+0.628127268 container remove 28b9fb249ff07c4f1ad62b577983c6e7a58821f30ab9f17524f733bac9ac4277 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-5, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-08-20T01:57:06.140 INFO:journalctl@ceph.osd.5.smithi175.stdout:Aug 20 01:57:05 smithi175 podman[58725]: 2024-08-20 01:57:05.868747539 +0000 UTC m=+0.099812893 container create 7808cf71bdbb66b5d091b628a6be08749cfc5b9e2bcba3ab42493446b6e953a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-08-20T01:57:06.140 INFO:journalctl@ceph.osd.5.smithi175.stdout:Aug 20 01:57:05 smithi175 podman[58725]: 2024-08-20 01:57:05.7844566 +0000 UTC m=+0.015521964 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:57:06.140 INFO:journalctl@ceph.osd.5.smithi175.stdout:Aug 20 01:57:06 smithi175 podman[58725]: 2024-08-20 01:57:06.079506829 +0000 UTC m=+0.310572181 container init 7808cf71bdbb66b5d091b628a6be08749cfc5b9e2bcba3ab42493446b6e953a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0) 2024-08-20T01:57:06.140 INFO:journalctl@ceph.osd.5.smithi175.stdout:Aug 20 01:57:06 smithi175 podman[58725]: 2024-08-20 01:57:06.083016079 +0000 UTC m=+0.314081433 container start 7808cf71bdbb66b5d091b628a6be08749cfc5b9e2bcba3ab42493446b6e953a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T01:57:06.639 INFO:journalctl@ceph.osd.5.smithi175.stdout:Aug 20 01:57:06 smithi175 podman[58725]: 2024-08-20 01:57:06.179401361 +0000 UTC m=+0.410466732 container attach 7808cf71bdbb66b5d091b628a6be08749cfc5b9e2bcba3ab42493446b6e953a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-08-20T01:57:06.639 INFO:journalctl@ceph.osd.5.smithi175.stdout:Aug 20 01:57:06 smithi175 podman[58725]: 2024-08-20 01:57:06.277050485 +0000 UTC m=+0.508115838 container died 7808cf71bdbb66b5d091b628a6be08749cfc5b9e2bcba3ab42493446b6e953a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-5-deactivate, ceph=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-20T01:57:06.875 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@osd.5.service' 2024-08-20T01:57:06.913 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:57:06.913 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-08-20T01:57:06.913 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-08-20T01:57:06.913 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-28484e9a-5e93-11ef-bccf-c7b262605968@osd.6 2024-08-20T01:57:07.225 INFO:journalctl@ceph.osd.6.smithi079.stdout:Aug 20 01:57:06 smithi079 systemd[1]: Stopping Ceph osd.6 for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:57:07.687 INFO:journalctl@ceph.osd.6.smithi079.stdout:Aug 20 01:57:07 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-6[45200]: 2024-08-20T01:57:07.222+0000 7fa05b31a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:57:07.687 INFO:journalctl@ceph.osd.6.smithi079.stdout:Aug 20 01:57:07 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-6[45200]: 2024-08-20T01:57:07.222+0000 7fa05b31a640 -1 osd.6 77 *** Got signal Terminated *** 2024-08-20T01:57:07.687 INFO:journalctl@ceph.osd.6.smithi079.stdout:Aug 20 01:57:07 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-6[45200]: 2024-08-20T01:57:07.222+0000 7fa05b31a640 -1 osd.6 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-20T01:57:13.083 INFO:journalctl@ceph.osd.6.smithi079.stdout:Aug 20 01:57:12 smithi079 podman[150642]: 2024-08-20 01:57:12.79174364 +0000 UTC m=+5.690897574 container died 206905df47023eb2ef7acc1910bc4770b230724e127ff9e3233ed370fa745c6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-6, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-20T01:57:13.437 INFO:journalctl@ceph.osd.6.smithi079.stdout:Aug 20 01:57:13 smithi079 podman[150642]: 2024-08-20 01:57:13.272212376 +0000 UTC m=+6.171366308 container cleanup 206905df47023eb2ef7acc1910bc4770b230724e127ff9e3233ed370fa745c6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-6, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-08-20T01:57:13.437 INFO:journalctl@ceph.osd.6.smithi079.stdout:Aug 20 01:57:13 smithi079 bash[150642]: ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-6 2024-08-20T01:57:13.805 INFO:journalctl@ceph.osd.6.smithi079.stdout:Aug 20 01:57:13 smithi079 podman[150656]: 2024-08-20 01:57:13.481848846 +0000 UTC m=+0.692158370 container remove 206905df47023eb2ef7acc1910bc4770b230724e127ff9e3233ed370fa745c6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-6, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-08-20T01:57:14.061 INFO:journalctl@ceph.osd.6.smithi079.stdout:Aug 20 01:57:13 smithi079 podman[150746]: 2024-08-20 01:57:13.706891834 +0000 UTC m=+0.015812031 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:57:14.061 INFO:journalctl@ceph.osd.6.smithi079.stdout:Aug 20 01:57:13 smithi079 podman[150746]: 2024-08-20 01:57:13.815916308 +0000 UTC m=+0.124836538 container create e2e9463a3ed85e40bc19c72b0a39f7621f22a85cc90cb3b5821b2f362e670db9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-08-20T01:57:14.062 INFO:journalctl@ceph.osd.6.smithi079.stdout:Aug 20 01:57:14 smithi079 podman[150746]: 2024-08-20 01:57:14.060183234 +0000 UTC m=+0.369103426 container init e2e9463a3ed85e40bc19c72b0a39f7621f22a85cc90cb3b5821b2f362e670db9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-08-20T01:57:14.331 INFO:journalctl@ceph.osd.6.smithi079.stdout:Aug 20 01:57:14 smithi079 podman[150746]: 2024-08-20 01:57:14.063726876 +0000 UTC m=+0.372647074 container start e2e9463a3ed85e40bc19c72b0a39f7621f22a85cc90cb3b5821b2f362e670db9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-08-20T01:57:14.331 INFO:journalctl@ceph.osd.6.smithi079.stdout:Aug 20 01:57:14 smithi079 podman[150746]: 2024-08-20 01:57:14.176879792 +0000 UTC m=+0.485800008 container attach e2e9463a3ed85e40bc19c72b0a39f7621f22a85cc90cb3b5821b2f362e670db9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-08-20T01:57:14.331 INFO:journalctl@ceph.osd.6.smithi079.stdout:Aug 20 01:57:14 smithi079 podman[150746]: 2024-08-20 01:57:14.263384855 +0000 UTC m=+0.572305055 container died e2e9463a3ed85e40bc19c72b0a39f7621f22a85cc90cb3b5821b2f362e670db9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-6-deactivate, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_CLEAN=True) 2024-08-20T01:57:14.935 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@osd.6.service' 2024-08-20T01:57:14.973 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:57:14.974 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-08-20T01:57:14.974 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-08-20T01:57:14.974 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-28484e9a-5e93-11ef-bccf-c7b262605968@osd.7 2024-08-20T01:57:15.258 INFO:journalctl@ceph.osd.7.smithi081.stdout:Aug 20 01:57:15 smithi081 systemd[1]: Stopping Ceph osd.7 for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:57:15.528 INFO:journalctl@ceph.osd.7.smithi081.stdout:Aug 20 01:57:15 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-7[39958]: 2024-08-20T01:57:15.256+0000 7fccf0840640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:57:15.529 INFO:journalctl@ceph.osd.7.smithi081.stdout:Aug 20 01:57:15 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-7[39958]: 2024-08-20T01:57:15.256+0000 7fccf0840640 -1 osd.7 77 *** Got signal Terminated *** 2024-08-20T01:57:15.529 INFO:journalctl@ceph.osd.7.smithi081.stdout:Aug 20 01:57:15 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-7[39958]: 2024-08-20T01:57:15.256+0000 7fccf0840640 -1 osd.7 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-20T01:57:21.093 INFO:journalctl@ceph.osd.7.smithi081.stdout:Aug 20 01:57:20 smithi081 podman[58690]: 2024-08-20 01:57:20.839863099 +0000 UTC m=+5.677170916 container died f947a91ce5d6e520dc8ef1343324297c39e95bb04b80797988196aedba0e5df0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True) 2024-08-20T01:57:21.093 INFO:journalctl@ceph.osd.7.smithi081.stdout:Aug 20 01:57:21 smithi081 podman[58690]: 2024-08-20 01:57:21.089150879 +0000 UTC m=+5.926458705 container cleanup f947a91ce5d6e520dc8ef1343324297c39e95bb04b80797988196aedba0e5df0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T01:57:21.093 INFO:journalctl@ceph.osd.7.smithi081.stdout:Aug 20 01:57:21 smithi081 bash[58690]: ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-7 2024-08-20T01:57:21.705 INFO:journalctl@ceph.osd.7.smithi081.stdout:Aug 20 01:57:21 smithi081 podman[58707]: 2024-08-20 01:57:21.349665348 +0000 UTC m=+0.513257370 container remove f947a91ce5d6e520dc8ef1343324297c39e95bb04b80797988196aedba0e5df0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-7, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-08-20T01:57:21.971 INFO:journalctl@ceph.osd.7.smithi081.stdout:Aug 20 01:57:21 smithi081 podman[58794]: 2024-08-20 01:57:21.606626442 +0000 UTC m=+0.015806222 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:57:21.972 INFO:journalctl@ceph.osd.7.smithi081.stdout:Aug 20 01:57:21 smithi081 podman[58794]: 2024-08-20 01:57:21.725683801 +0000 UTC m=+0.134863580 container create fd7fd3c569f8f7c93792b63bbc669c9410ebaa2296bbcc25a228dbd38647a40b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.schema-version=1.0) 2024-08-20T01:57:22.278 INFO:journalctl@ceph.osd.7.smithi081.stdout:Aug 20 01:57:21 smithi081 podman[58794]: 2024-08-20 01:57:21.970385618 +0000 UTC m=+0.379565387 container init fd7fd3c569f8f7c93792b63bbc669c9410ebaa2296bbcc25a228dbd38647a40b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-7-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-08-20T01:57:22.279 INFO:journalctl@ceph.osd.7.smithi081.stdout:Aug 20 01:57:21 smithi081 podman[58794]: 2024-08-20 01:57:21.97365787 +0000 UTC m=+0.382837649 container start fd7fd3c569f8f7c93792b63bbc669c9410ebaa2296bbcc25a228dbd38647a40b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-7-deactivate, io.buildah.version=1.36.0, ceph=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-08-20T01:57:22.279 INFO:journalctl@ceph.osd.7.smithi081.stdout:Aug 20 01:57:22 smithi081 podman[58794]: 2024-08-20 01:57:22.037380341 +0000 UTC m=+0.446560119 container attach fd7fd3c569f8f7c93792b63bbc669c9410ebaa2296bbcc25a228dbd38647a40b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-7-deactivate, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0) 2024-08-20T01:57:22.279 INFO:journalctl@ceph.osd.7.smithi081.stdout:Aug 20 01:57:22 smithi081 podman[58794]: 2024-08-20 01:57:22.167820526 +0000 UTC m=+0.577000302 container died fd7fd3c569f8f7c93792b63bbc669c9410ebaa2296bbcc25a228dbd38647a40b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-20T01:57:22.748 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@osd.7.service' 2024-08-20T01:57:22.786 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:57:22.787 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-08-20T01:57:22.787 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-08-20T01:57:22.787 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-28484e9a-5e93-11ef-bccf-c7b262605968@osd.8 2024-08-20T01:57:23.069 INFO:journalctl@ceph.osd.8.smithi175.stdout:Aug 20 01:57:22 smithi175 systemd[1]: Stopping Ceph osd.8 for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:57:23.389 INFO:journalctl@ceph.osd.8.smithi175.stdout:Aug 20 01:57:23 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-8[40676]: 2024-08-20T01:57:23.066+0000 7feef348b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:57:23.390 INFO:journalctl@ceph.osd.8.smithi175.stdout:Aug 20 01:57:23 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-8[40676]: 2024-08-20T01:57:23.066+0000 7feef348b640 -1 osd.8 77 *** Got signal Terminated *** 2024-08-20T01:57:23.390 INFO:journalctl@ceph.osd.8.smithi175.stdout:Aug 20 01:57:23 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-8[40676]: 2024-08-20T01:57:23.066+0000 7feef348b640 -1 osd.8 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-20T01:57:28.968 INFO:journalctl@ceph.osd.8.smithi175.stdout:Aug 20 01:57:28 smithi175 podman[58830]: 2024-08-20 01:57:28.684236073 +0000 UTC m=+5.708619468 container died 394121331a5b6e0001718a22f4e829e9e69010f52bec3bd7e4e590bfef336332 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-8, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-20T01:57:29.335 INFO:journalctl@ceph.osd.8.smithi175.stdout:Aug 20 01:57:29 smithi175 podman[58830]: 2024-08-20 01:57:29.066084577 +0000 UTC m=+6.090467974 container cleanup 394121331a5b6e0001718a22f4e829e9e69010f52bec3bd7e4e590bfef336332 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-8, ceph=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-08-20T01:57:29.335 INFO:journalctl@ceph.osd.8.smithi175.stdout:Aug 20 01:57:29 smithi175 bash[58830]: ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-8 2024-08-20T01:57:29.639 INFO:journalctl@ceph.osd.8.smithi175.stdout:Aug 20 01:57:29 smithi175 podman[58847]: 2024-08-20 01:57:29.359072058 +0000 UTC m=+0.663846084 container remove 394121331a5b6e0001718a22f4e829e9e69010f52bec3bd7e4e590bfef336332 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-8, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0) 2024-08-20T01:57:29.640 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:29 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:29.509+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:17.997157+0000 front 2024-08-20T01:56:17.997217+0000 (oldest deadline 2024-08-20T01:57:29.197884+0000) 2024-08-20T01:57:29.960 INFO:journalctl@ceph.osd.8.smithi175.stdout:Aug 20 01:57:29 smithi175 podman[58943]: 2024-08-20 01:57:29.578031486 +0000 UTC m=+0.018310647 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:57:29.960 INFO:journalctl@ceph.osd.8.smithi175.stdout:Aug 20 01:57:29 smithi175 podman[58943]: 2024-08-20 01:57:29.676450795 +0000 UTC m=+0.116729931 container create a26a627d92ca617ad6822fad5d7545422b2206a9d15888bc0e7d70a0eec0cb60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-08-20T01:57:29.960 INFO:journalctl@ceph.osd.8.smithi175.stdout:Aug 20 01:57:29 smithi175 podman[58943]: 2024-08-20 01:57:29.87029622 +0000 UTC m=+0.310575365 container init a26a627d92ca617ad6822fad5d7545422b2206a9d15888bc0e7d70a0eec0cb60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0) 2024-08-20T01:57:29.960 INFO:journalctl@ceph.osd.8.smithi175.stdout:Aug 20 01:57:29 smithi175 podman[58943]: 2024-08-20 01:57:29.873694482 +0000 UTC m=+0.313973628 container start a26a627d92ca617ad6822fad5d7545422b2206a9d15888bc0e7d70a0eec0cb60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-08-20T01:57:29.960 INFO:journalctl@ceph.osd.8.smithi175.stdout:Aug 20 01:57:29 smithi175 podman[58943]: 2024-08-20 01:57:29.958570116 +0000 UTC m=+0.398849261 container attach a26a627d92ca617ad6822fad5d7545422b2206a9d15888bc0e7d70a0eec0cb60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-08-20T01:57:30.187 INFO:journalctl@ceph.osd.9.smithi079.stdout:Aug 20 01:57:29 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-9[51886]: 2024-08-20T01:57:29.885+0000 7fcbae656640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:16.135604+0000 front 2024-08-20T01:56:16.135647+0000 (oldest deadline 2024-08-20T01:57:28.937015+0000) 2024-08-20T01:57:30.278 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:57:29 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-10[46759]: 2024-08-20T01:57:29.920+0000 7f690d6da640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:15.592946+0000 front 2024-08-20T01:56:15.592883+0000 (oldest deadline 2024-08-20T01:57:29.494822+0000) 2024-08-20T01:57:30.389 INFO:journalctl@ceph.osd.8.smithi175.stdout:Aug 20 01:57:30 smithi175 podman[58943]: 2024-08-20 01:57:30.072340918 +0000 UTC m=+0.512620071 container died a26a627d92ca617ad6822fad5d7545422b2206a9d15888bc0e7d70a0eec0cb60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-8-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-08-20T01:57:30.716 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@osd.8.service' 2024-08-20T01:57:30.739 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:30 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:30.538+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:17.997157+0000 front 2024-08-20T01:56:17.997217+0000 (oldest deadline 2024-08-20T01:57:29.197884+0000) 2024-08-20T01:57:30.739 INFO:journalctl@ceph.osd.8.smithi175.stdout:Aug 20 01:57:30 smithi175 podman[58968]: 2024-08-20 01:57:30.695252833 +0000 UTC m=+0.617084938 container remove a26a627d92ca617ad6822fad5d7545422b2206a9d15888bc0e7d70a0eec0cb60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-08-20T01:57:30.739 INFO:journalctl@ceph.osd.8.smithi175.stdout:Aug 20 01:57:30 smithi175 systemd[1]: ceph-28484e9a-5e93-11ef-bccf-c7b262605968@osd.8.service: Deactivated successfully. 2024-08-20T01:57:30.740 INFO:journalctl@ceph.osd.8.smithi175.stdout:Aug 20 01:57:30 smithi175 systemd[1]: Stopped Ceph osd.8 for 28484e9a-5e93-11ef-bccf-c7b262605968. 2024-08-20T01:57:30.740 INFO:journalctl@ceph.osd.8.smithi175.stdout:Aug 20 01:57:30 smithi175 systemd[1]: ceph-28484e9a-5e93-11ef-bccf-c7b262605968@osd.8.service: Consumed 4min 55.443s CPU time. 2024-08-20T01:57:30.755 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:57:30.755 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-08-20T01:57:30.755 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-08-20T01:57:30.756 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-28484e9a-5e93-11ef-bccf-c7b262605968@osd.9 2024-08-20T01:57:31.075 INFO:journalctl@ceph.osd.9.smithi079.stdout:Aug 20 01:57:30 smithi079 systemd[1]: Stopping Ceph osd.9 for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:57:31.075 INFO:journalctl@ceph.osd.9.smithi079.stdout:Aug 20 01:57:30 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-9[51886]: 2024-08-20T01:57:30.837+0000 7fcbae656640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:16.135604+0000 front 2024-08-20T01:56:16.135647+0000 (oldest deadline 2024-08-20T01:57:28.937015+0000) 2024-08-20T01:57:31.278 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:57:30 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-10[46759]: 2024-08-20T01:57:30.942+0000 7f690d6da640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:15.592946+0000 front 2024-08-20T01:56:15.592883+0000 (oldest deadline 2024-08-20T01:57:29.494822+0000) 2024-08-20T01:57:31.436 INFO:journalctl@ceph.osd.9.smithi079.stdout:Aug 20 01:57:31 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-9[51886]: 2024-08-20T01:57:31.072+0000 7fcbb2041640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:57:31.437 INFO:journalctl@ceph.osd.9.smithi079.stdout:Aug 20 01:57:31 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-9[51886]: 2024-08-20T01:57:31.072+0000 7fcbb2041640 -1 osd.9 77 *** Got signal Terminated *** 2024-08-20T01:57:31.437 INFO:journalctl@ceph.osd.9.smithi079.stdout:Aug 20 01:57:31 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-9[51886]: 2024-08-20T01:57:31.072+0000 7fcbb2041640 -1 osd.9 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-20T01:57:31.889 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:31 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:31.507+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:17.997157+0000 front 2024-08-20T01:56:17.997217+0000 (oldest deadline 2024-08-20T01:57:29.197884+0000) 2024-08-20T01:57:32.187 INFO:journalctl@ceph.osd.9.smithi079.stdout:Aug 20 01:57:31 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-9[51886]: 2024-08-20T01:57:31.809+0000 7fcbae656640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:16.135604+0000 front 2024-08-20T01:56:16.135647+0000 (oldest deadline 2024-08-20T01:57:28.937015+0000) 2024-08-20T01:57:32.278 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:57:31 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-10[46759]: 2024-08-20T01:57:31.929+0000 7f690d6da640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:15.592946+0000 front 2024-08-20T01:56:15.592883+0000 (oldest deadline 2024-08-20T01:57:29.494822+0000) 2024-08-20T01:57:32.889 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:32 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:32.525+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:17.997157+0000 front 2024-08-20T01:56:17.997217+0000 (oldest deadline 2024-08-20T01:57:29.197884+0000) 2024-08-20T01:57:33.187 INFO:journalctl@ceph.osd.9.smithi079.stdout:Aug 20 01:57:32 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-9[51886]: 2024-08-20T01:57:32.821+0000 7fcbae656640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:16.135604+0000 front 2024-08-20T01:56:16.135647+0000 (oldest deadline 2024-08-20T01:57:28.937015+0000) 2024-08-20T01:57:33.278 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:57:32 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-10[46759]: 2024-08-20T01:57:32.885+0000 7f690d6da640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:15.592946+0000 front 2024-08-20T01:56:15.592883+0000 (oldest deadline 2024-08-20T01:57:29.494822+0000) 2024-08-20T01:57:33.889 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:33 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:33.513+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:17.997157+0000 front 2024-08-20T01:56:17.997217+0000 (oldest deadline 2024-08-20T01:57:29.197884+0000) 2024-08-20T01:57:34.187 INFO:journalctl@ceph.osd.9.smithi079.stdout:Aug 20 01:57:33 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-9[51886]: 2024-08-20T01:57:33.824+0000 7fcbae656640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:16.135604+0000 front 2024-08-20T01:56:16.135647+0000 (oldest deadline 2024-08-20T01:57:28.937015+0000) 2024-08-20T01:57:34.278 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:57:33 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-10[46759]: 2024-08-20T01:57:33.863+0000 7f690d6da640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:15.592946+0000 front 2024-08-20T01:56:15.592883+0000 (oldest deadline 2024-08-20T01:57:29.494822+0000) 2024-08-20T01:57:34.889 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:34 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:34.477+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:17.997157+0000 front 2024-08-20T01:56:17.997217+0000 (oldest deadline 2024-08-20T01:57:29.197884+0000) 2024-08-20T01:57:35.187 INFO:journalctl@ceph.osd.9.smithi079.stdout:Aug 20 01:57:34 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-9[51886]: 2024-08-20T01:57:34.871+0000 7fcbae656640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:16.135604+0000 front 2024-08-20T01:56:16.135647+0000 (oldest deadline 2024-08-20T01:57:28.937015+0000) 2024-08-20T01:57:35.187 INFO:journalctl@ceph.osd.9.smithi079.stdout:Aug 20 01:57:34 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-9[51886]: 2024-08-20T01:57:34.871+0000 7fcbae656640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-08-20T01:56:28.937591+0000 front 2024-08-20T01:56:28.937740+0000 (oldest deadline 2024-08-20T01:57:34.837438+0000) 2024-08-20T01:57:35.278 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:57:34 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-10[46759]: 2024-08-20T01:57:34.911+0000 7f690d6da640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:15.592946+0000 front 2024-08-20T01:56:15.592883+0000 (oldest deadline 2024-08-20T01:57:29.494822+0000) 2024-08-20T01:57:35.278 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:57:34 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-10[46759]: 2024-08-20T01:57:34.911+0000 7f690d6da640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-08-20T01:56:29.495334+0000 front 2024-08-20T01:56:29.495359+0000 (oldest deadline 2024-08-20T01:57:34.195474+0000) 2024-08-20T01:57:35.889 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:35 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:35.436+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:17.997157+0000 front 2024-08-20T01:56:17.997217+0000 (oldest deadline 2024-08-20T01:57:29.197884+0000) 2024-08-20T01:57:36.187 INFO:journalctl@ceph.osd.9.smithi079.stdout:Aug 20 01:57:35 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-9[51886]: 2024-08-20T01:57:35.833+0000 7fcbae656640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:16.135604+0000 front 2024-08-20T01:56:16.135647+0000 (oldest deadline 2024-08-20T01:57:28.937015+0000) 2024-08-20T01:57:36.187 INFO:journalctl@ceph.osd.9.smithi079.stdout:Aug 20 01:57:35 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-9[51886]: 2024-08-20T01:57:35.833+0000 7fcbae656640 -1 osd.9 77 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-08-20T01:56:28.937591+0000 front 2024-08-20T01:56:28.937740+0000 (oldest deadline 2024-08-20T01:57:34.837438+0000) 2024-08-20T01:57:36.278 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:57:35 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-10[46759]: 2024-08-20T01:57:35.940+0000 7f690d6da640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:15.592946+0000 front 2024-08-20T01:56:15.592883+0000 (oldest deadline 2024-08-20T01:57:29.494822+0000) 2024-08-20T01:57:36.279 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:57:35 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-10[46759]: 2024-08-20T01:57:35.940+0000 7f690d6da640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-08-20T01:56:29.495334+0000 front 2024-08-20T01:56:29.495359+0000 (oldest deadline 2024-08-20T01:57:34.195474+0000) 2024-08-20T01:57:36.889 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:36 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:36.415+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:17.997157+0000 front 2024-08-20T01:56:17.997217+0000 (oldest deadline 2024-08-20T01:57:29.197884+0000) 2024-08-20T01:57:36.937 INFO:journalctl@ceph.osd.9.smithi079.stdout:Aug 20 01:57:36 smithi079 podman[150866]: 2024-08-20 01:57:36.669001295 +0000 UTC m=+5.720433690 container died 528ae44eb302c929937f5d13adc0c1d579a31916320ca515b4ccb81b6d09fb03 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-08-20T01:57:37.278 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:57:36 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-10[46759]: 2024-08-20T01:57:36.963+0000 7f690d6da640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:15.592946+0000 front 2024-08-20T01:56:15.592883+0000 (oldest deadline 2024-08-20T01:57:29.494822+0000) 2024-08-20T01:57:37.278 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:57:36 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-10[46759]: 2024-08-20T01:57:36.963+0000 7f690d6da640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-08-20T01:56:29.495334+0000 front 2024-08-20T01:56:29.495359+0000 (oldest deadline 2024-08-20T01:57:34.195474+0000) 2024-08-20T01:57:37.409 INFO:journalctl@ceph.osd.9.smithi079.stdout:Aug 20 01:57:37 smithi079 podman[150866]: 2024-08-20 01:57:37.114440197 +0000 UTC m=+6.165872632 container cleanup 528ae44eb302c929937f5d13adc0c1d579a31916320ca515b4ccb81b6d09fb03 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-9, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T01:57:37.409 INFO:journalctl@ceph.osd.9.smithi079.stdout:Aug 20 01:57:37 smithi079 bash[150866]: ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-9 2024-08-20T01:57:37.687 INFO:journalctl@ceph.osd.9.smithi079.stdout:Aug 20 01:57:37 smithi079 podman[150882]: 2024-08-20 01:57:37.407377953 +0000 UTC m=+0.734764493 container remove 528ae44eb302c929937f5d13adc0c1d579a31916320ca515b4ccb81b6d09fb03 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-9, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-08-20T01:57:37.889 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:37 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:37.420+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:17.997157+0000 front 2024-08-20T01:56:17.997217+0000 (oldest deadline 2024-08-20T01:57:29.197884+0000) 2024-08-20T01:57:38.020 INFO:journalctl@ceph.osd.9.smithi079.stdout:Aug 20 01:57:37 smithi079 podman[150969]: 2024-08-20 01:57:37.616023197 +0000 UTC m=+0.015900608 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:57:38.021 INFO:journalctl@ceph.osd.9.smithi079.stdout:Aug 20 01:57:37 smithi079 podman[150969]: 2024-08-20 01:57:37.716470229 +0000 UTC m=+0.116347641 container create 3aa10a45994da1dc47a42cf85af0361a717b314735082c91e521254636c6af4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-20T01:57:38.021 INFO:journalctl@ceph.osd.9.smithi079.stdout:Aug 20 01:57:37 smithi079 podman[150969]: 2024-08-20 01:57:37.935680773 +0000 UTC m=+0.335558181 container init 3aa10a45994da1dc47a42cf85af0361a717b314735082c91e521254636c6af4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-9-deactivate, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-08-20T01:57:38.021 INFO:journalctl@ceph.osd.9.smithi079.stdout:Aug 20 01:57:37 smithi079 podman[150969]: 2024-08-20 01:57:37.939015756 +0000 UTC m=+0.338893171 container start 3aa10a45994da1dc47a42cf85af0361a717b314735082c91e521254636c6af4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-9-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-08-20T01:57:38.021 INFO:journalctl@ceph.osd.9.smithi079.stdout:Aug 20 01:57:38 smithi079 podman[150969]: 2024-08-20 01:57:38.018762302 +0000 UTC m=+0.418639720 container attach 3aa10a45994da1dc47a42cf85af0361a717b314735082c91e521254636c6af4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-9-deactivate, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-20T01:57:38.278 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:57:38 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-10[46759]: 2024-08-20T01:57:38.005+0000 7f690d6da640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:15.592946+0000 front 2024-08-20T01:56:15.592883+0000 (oldest deadline 2024-08-20T01:57:29.494822+0000) 2024-08-20T01:57:38.279 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:57:38 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-10[46759]: 2024-08-20T01:57:38.005+0000 7f690d6da640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-08-20T01:56:29.495334+0000 front 2024-08-20T01:56:29.495359+0000 (oldest deadline 2024-08-20T01:57:34.195474+0000) 2024-08-20T01:57:38.437 INFO:journalctl@ceph.osd.9.smithi079.stdout:Aug 20 01:57:38 smithi079 podman[150969]: 2024-08-20 01:57:38.121229163 +0000 UTC m=+0.521106580 container died 3aa10a45994da1dc47a42cf85af0361a717b314735082c91e521254636c6af4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-08-20T01:57:38.748 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@osd.9.service' 2024-08-20T01:57:38.788 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:57:38.788 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-08-20T01:57:38.788 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-08-20T01:57:38.788 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-28484e9a-5e93-11ef-bccf-c7b262605968@osd.10 2024-08-20T01:57:38.889 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:38 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:38.439+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:17.997157+0000 front 2024-08-20T01:56:17.997217+0000 (oldest deadline 2024-08-20T01:57:29.197884+0000) 2024-08-20T01:57:38.889 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:38 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:38.439+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-08-20T01:56:32.099087+0000 front 2024-08-20T01:56:32.099071+0000 (oldest deadline 2024-08-20T01:57:37.999119+0000) 2024-08-20T01:57:39.095 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:57:38 smithi081 systemd[1]: Stopping Ceph osd.10 for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:57:39.095 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:57:39 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-10[46759]: 2024-08-20T01:57:39.023+0000 7f690d6da640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:15.592946+0000 front 2024-08-20T01:56:15.592883+0000 (oldest deadline 2024-08-20T01:57:29.494822+0000) 2024-08-20T01:57:39.095 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:57:39 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-10[46759]: 2024-08-20T01:57:39.023+0000 7f690d6da640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-08-20T01:56:29.495334+0000 front 2024-08-20T01:56:29.495359+0000 (oldest deadline 2024-08-20T01:57:34.195474+0000) 2024-08-20T01:57:39.096 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:57:39 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-10[46759]: 2024-08-20T01:57:39.093+0000 7f69150cd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:57:39.096 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:57:39 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-10[46759]: 2024-08-20T01:57:39.093+0000 7f69150cd640 -1 osd.10 77 *** Got signal Terminated *** 2024-08-20T01:57:39.096 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:57:39 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-10[46759]: 2024-08-20T01:57:39.093+0000 7f69150cd640 -1 osd.10 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-20T01:57:39.889 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:39 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:39.447+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:17.997157+0000 front 2024-08-20T01:56:17.997217+0000 (oldest deadline 2024-08-20T01:57:29.197884+0000) 2024-08-20T01:57:39.889 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:39 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:39.447+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-08-20T01:56:32.099087+0000 front 2024-08-20T01:56:32.099071+0000 (oldest deadline 2024-08-20T01:57:37.999119+0000) 2024-08-20T01:57:40.278 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:57:39 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-10[46759]: 2024-08-20T01:57:39.985+0000 7f690d6da640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:15.592946+0000 front 2024-08-20T01:56:15.592883+0000 (oldest deadline 2024-08-20T01:57:29.494822+0000) 2024-08-20T01:57:40.278 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:57:39 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-10[46759]: 2024-08-20T01:57:39.985+0000 7f690d6da640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-08-20T01:56:29.495334+0000 front 2024-08-20T01:56:29.495359+0000 (oldest deadline 2024-08-20T01:57:34.195474+0000) 2024-08-20T01:57:40.639 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:40 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:40.436+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:17.997157+0000 front 2024-08-20T01:56:17.997217+0000 (oldest deadline 2024-08-20T01:57:29.197884+0000) 2024-08-20T01:57:40.639 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:40 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:40.436+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-08-20T01:56:32.099087+0000 front 2024-08-20T01:56:32.099071+0000 (oldest deadline 2024-08-20T01:57:37.999119+0000) 2024-08-20T01:57:41.278 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:57:40 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-10[46759]: 2024-08-20T01:57:40.939+0000 7f690d6da640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:15.592946+0000 front 2024-08-20T01:56:15.592883+0000 (oldest deadline 2024-08-20T01:57:29.494822+0000) 2024-08-20T01:57:41.278 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:57:40 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-10[46759]: 2024-08-20T01:57:40.939+0000 7f690d6da640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-08-20T01:56:29.495334+0000 front 2024-08-20T01:56:29.495359+0000 (oldest deadline 2024-08-20T01:57:34.195474+0000) 2024-08-20T01:57:41.889 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:41 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:41.462+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:17.997157+0000 front 2024-08-20T01:56:17.997217+0000 (oldest deadline 2024-08-20T01:57:29.197884+0000) 2024-08-20T01:57:41.889 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:41 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:41.462+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-08-20T01:56:32.099087+0000 front 2024-08-20T01:56:32.099071+0000 (oldest deadline 2024-08-20T01:57:37.999119+0000) 2024-08-20T01:57:42.278 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:57:41 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-10[46759]: 2024-08-20T01:57:41.974+0000 7f690d6da640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:15.592946+0000 front 2024-08-20T01:56:15.592883+0000 (oldest deadline 2024-08-20T01:57:29.494822+0000) 2024-08-20T01:57:42.279 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:57:41 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-10[46759]: 2024-08-20T01:57:41.974+0000 7f690d6da640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-08-20T01:56:29.495334+0000 front 2024-08-20T01:56:29.495359+0000 (oldest deadline 2024-08-20T01:57:34.195474+0000) 2024-08-20T01:57:42.889 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:42 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:42.484+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:17.997157+0000 front 2024-08-20T01:56:17.997217+0000 (oldest deadline 2024-08-20T01:57:29.197884+0000) 2024-08-20T01:57:42.889 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:42 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:42.484+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-08-20T01:56:32.099087+0000 front 2024-08-20T01:56:32.099071+0000 (oldest deadline 2024-08-20T01:57:37.999119+0000) 2024-08-20T01:57:42.889 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:42 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:42.484+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-08-20T01:56:37.999436+0000 front 2024-08-20T01:56:37.999530+0000 (oldest deadline 2024-08-20T01:57:42.099530+0000) 2024-08-20T01:57:43.278 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:57:42 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-10[46759]: 2024-08-20T01:57:42.979+0000 7f690d6da640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:15.592946+0000 front 2024-08-20T01:56:15.592883+0000 (oldest deadline 2024-08-20T01:57:29.494822+0000) 2024-08-20T01:57:43.278 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:57:42 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-10[46759]: 2024-08-20T01:57:42.979+0000 7f690d6da640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-08-20T01:56:29.495334+0000 front 2024-08-20T01:56:29.495359+0000 (oldest deadline 2024-08-20T01:57:34.195474+0000) 2024-08-20T01:57:43.889 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:43 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:43.446+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:17.997157+0000 front 2024-08-20T01:56:17.997217+0000 (oldest deadline 2024-08-20T01:57:29.197884+0000) 2024-08-20T01:57:43.889 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:43 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:43.446+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-08-20T01:56:32.099087+0000 front 2024-08-20T01:56:32.099071+0000 (oldest deadline 2024-08-20T01:57:37.999119+0000) 2024-08-20T01:57:43.889 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:43 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:43.446+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-08-20T01:56:37.999436+0000 front 2024-08-20T01:56:37.999530+0000 (oldest deadline 2024-08-20T01:57:42.099530+0000) 2024-08-20T01:57:44.278 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:57:43 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-10[46759]: 2024-08-20T01:57:43.937+0000 7f690d6da640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:15.592946+0000 front 2024-08-20T01:56:15.592883+0000 (oldest deadline 2024-08-20T01:57:29.494822+0000) 2024-08-20T01:57:44.279 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:57:43 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-10[46759]: 2024-08-20T01:57:43.937+0000 7f690d6da640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-08-20T01:56:29.495334+0000 front 2024-08-20T01:56:29.495359+0000 (oldest deadline 2024-08-20T01:57:34.195474+0000) 2024-08-20T01:57:44.279 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:57:43 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-10[46759]: 2024-08-20T01:57:43.937+0000 7f690d6da640 -1 osd.10 77 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-08-20T01:56:39.496252+0000 front 2024-08-20T01:56:39.496303+0000 (oldest deadline 2024-08-20T01:57:43.596360+0000) 2024-08-20T01:57:44.887 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:57:44 smithi081 podman[58907]: 2024-08-20 01:57:44.630195761 +0000 UTC m=+5.652513333 container died 50e418ec5603e6d8f0520e0f38114177092873b07fdab5e05df3b6f4c300b45b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-10, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-08-20T01:57:44.889 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:44 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:44.486+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:17.997157+0000 front 2024-08-20T01:56:17.997217+0000 (oldest deadline 2024-08-20T01:57:29.197884+0000) 2024-08-20T01:57:44.889 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:44 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:44.486+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-08-20T01:56:32.099087+0000 front 2024-08-20T01:56:32.099071+0000 (oldest deadline 2024-08-20T01:57:37.999119+0000) 2024-08-20T01:57:44.889 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:44 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:44.486+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-08-20T01:56:37.999436+0000 front 2024-08-20T01:56:37.999530+0000 (oldest deadline 2024-08-20T01:57:42.099530+0000) 2024-08-20T01:57:45.271 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:57:44 smithi081 podman[58907]: 2024-08-20 01:57:44.976906078 +0000 UTC m=+5.999223650 container cleanup 50e418ec5603e6d8f0520e0f38114177092873b07fdab5e05df3b6f4c300b45b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-10, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-08-20T01:57:45.271 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:57:44 smithi081 bash[58907]: ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-10 2024-08-20T01:57:45.528 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:57:45 smithi081 podman[58922]: 2024-08-20 01:57:45.269783922 +0000 UTC m=+0.641961602 container remove 50e418ec5603e6d8f0520e0f38114177092873b07fdab5e05df3b6f4c300b45b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-10, ceph=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-08-20T01:57:45.858 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:57:45 smithi081 podman[59009]: 2024-08-20 01:57:45.483642115 +0000 UTC m=+0.016175514 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:57:45.858 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:57:45 smithi081 podman[59009]: 2024-08-20 01:57:45.628988516 +0000 UTC m=+0.161521956 container create 8c277ceb928a240d9176d117d77f3450f89f1bff420a66665057f539f8bcd290 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-10-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-20T01:57:45.858 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:57:45 smithi081 podman[59009]: 2024-08-20 01:57:45.856811794 +0000 UTC m=+0.389345179 container init 8c277ceb928a240d9176d117d77f3450f89f1bff420a66665057f539f8bcd290 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-10-deactivate, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-08-20T01:57:45.889 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:45 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:45.435+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:17.997157+0000 front 2024-08-20T01:56:17.997217+0000 (oldest deadline 2024-08-20T01:57:29.197884+0000) 2024-08-20T01:57:45.889 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:45 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:45.435+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-08-20T01:56:32.099087+0000 front 2024-08-20T01:56:32.099071+0000 (oldest deadline 2024-08-20T01:57:37.999119+0000) 2024-08-20T01:57:45.889 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:45 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:45.435+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-08-20T01:56:37.999436+0000 front 2024-08-20T01:56:37.999530+0000 (oldest deadline 2024-08-20T01:57:42.099530+0000) 2024-08-20T01:57:46.279 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:57:45 smithi081 podman[59009]: 2024-08-20 01:57:45.860116321 +0000 UTC m=+0.392649709 container start 8c277ceb928a240d9176d117d77f3450f89f1bff420a66665057f539f8bcd290 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T01:57:46.279 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:57:45 smithi081 podman[59009]: 2024-08-20 01:57:45.939973488 +0000 UTC m=+0.472506885 container attach 8c277ceb928a240d9176d117d77f3450f89f1bff420a66665057f539f8bcd290 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T01:57:46.279 INFO:journalctl@ceph.osd.10.smithi081.stdout:Aug 20 01:57:46 smithi081 podman[59009]: 2024-08-20 01:57:46.052251537 +0000 UTC m=+0.584784927 container died 8c277ceb928a240d9176d117d77f3450f89f1bff420a66665057f539f8bcd290 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-10-deactivate, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-08-20T01:57:46.623 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@osd.10.service' 2024-08-20T01:57:46.660 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:57:46.660 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-08-20T01:57:46.660 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-08-20T01:57:46.660 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-28484e9a-5e93-11ef-bccf-c7b262605968@osd.11 2024-08-20T01:57:46.706 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:46 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:46.446+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:17.997157+0000 front 2024-08-20T01:56:17.997217+0000 (oldest deadline 2024-08-20T01:57:29.197884+0000) 2024-08-20T01:57:46.706 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:46 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:46.446+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-08-20T01:56:32.099087+0000 front 2024-08-20T01:56:32.099071+0000 (oldest deadline 2024-08-20T01:57:37.999119+0000) 2024-08-20T01:57:46.706 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:46 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:46.446+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-08-20T01:56:37.999436+0000 front 2024-08-20T01:56:37.999530+0000 (oldest deadline 2024-08-20T01:57:42.099530+0000) 2024-08-20T01:57:47.140 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:46 smithi175 systemd[1]: Stopping Ceph osd.11 for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:57:47.140 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:46 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:46.937+0000 7fb48727d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:57:47.140 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:46 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:46.937+0000 7fb48727d640 -1 osd.11 77 *** Got signal Terminated *** 2024-08-20T01:57:47.140 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:46 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:46.937+0000 7fb48727d640 -1 osd.11 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-20T01:57:47.889 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:47 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:47.464+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:17.997157+0000 front 2024-08-20T01:56:17.997217+0000 (oldest deadline 2024-08-20T01:57:29.197884+0000) 2024-08-20T01:57:47.889 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:47 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:47.464+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-08-20T01:56:32.099087+0000 front 2024-08-20T01:56:32.099071+0000 (oldest deadline 2024-08-20T01:57:37.999119+0000) 2024-08-20T01:57:47.889 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:47 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:47.464+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-08-20T01:56:37.999436+0000 front 2024-08-20T01:56:37.999530+0000 (oldest deadline 2024-08-20T01:57:42.099530+0000) 2024-08-20T01:57:48.889 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:48 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:48.464+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:17.997157+0000 front 2024-08-20T01:56:17.997217+0000 (oldest deadline 2024-08-20T01:57:29.197884+0000) 2024-08-20T01:57:48.890 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:48 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:48.464+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-08-20T01:56:32.099087+0000 front 2024-08-20T01:56:32.099071+0000 (oldest deadline 2024-08-20T01:57:37.999119+0000) 2024-08-20T01:57:48.890 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:48 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:48.464+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-08-20T01:56:37.999436+0000 front 2024-08-20T01:56:37.999530+0000 (oldest deadline 2024-08-20T01:57:42.099530+0000) 2024-08-20T01:57:49.889 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:49 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:49.489+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:17.997157+0000 front 2024-08-20T01:56:17.997217+0000 (oldest deadline 2024-08-20T01:57:29.197884+0000) 2024-08-20T01:57:49.889 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:49 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:49.489+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-08-20T01:56:32.099087+0000 front 2024-08-20T01:56:32.099071+0000 (oldest deadline 2024-08-20T01:57:37.999119+0000) 2024-08-20T01:57:49.889 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:49 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:49.489+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-08-20T01:56:37.999436+0000 front 2024-08-20T01:56:37.999530+0000 (oldest deadline 2024-08-20T01:57:42.099530+0000) 2024-08-20T01:57:50.889 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:50 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:50.512+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:17.997157+0000 front 2024-08-20T01:56:17.997217+0000 (oldest deadline 2024-08-20T01:57:29.197884+0000) 2024-08-20T01:57:50.889 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:50 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:50.512+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-08-20T01:56:32.099087+0000 front 2024-08-20T01:56:32.099071+0000 (oldest deadline 2024-08-20T01:57:37.999119+0000) 2024-08-20T01:57:50.889 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:50 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:50.512+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-08-20T01:56:37.999436+0000 front 2024-08-20T01:56:37.999530+0000 (oldest deadline 2024-08-20T01:57:42.099530+0000) 2024-08-20T01:57:51.889 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:51 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:51.510+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-08-20T01:56:17.997157+0000 front 2024-08-20T01:56:17.997217+0000 (oldest deadline 2024-08-20T01:57:29.197884+0000) 2024-08-20T01:57:51.889 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:51 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:51.510+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-08-20T01:56:32.099087+0000 front 2024-08-20T01:56:32.099071+0000 (oldest deadline 2024-08-20T01:57:37.999119+0000) 2024-08-20T01:57:51.889 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:51 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11[47359]: 2024-08-20T01:57:51.510+0000 7fb483892640 -1 osd.11 77 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-08-20T01:56:37.999436+0000 front 2024-08-20T01:56:37.999530+0000 (oldest deadline 2024-08-20T01:57:42.099530+0000) 2024-08-20T01:57:52.631 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:52 smithi175 podman[59047]: 2024-08-20 01:57:52.360199834 +0000 UTC m=+5.510728210 container died a32f31d156b893138608d0a80fc673ca3ce7e3f3cf85cdb6afe8bf095e1c3955 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-20T01:57:52.889 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:52 smithi175 podman[59047]: 2024-08-20 01:57:52.729236235 +0000 UTC m=+5.879764613 container cleanup a32f31d156b893138608d0a80fc673ca3ce7e3f3cf85cdb6afe8bf095e1c3955 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-20T01:57:52.889 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:52 smithi175 bash[59047]: ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11 2024-08-20T01:57:53.324 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:52 smithi175 podman[59062]: 2024-08-20 01:57:52.980273091 +0000 UTC m=+0.614107051 container remove a32f31d156b893138608d0a80fc673ca3ce7e3f3cf85cdb6afe8bf095e1c3955 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-08-20T01:57:53.585 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:53 smithi175 podman[59150]: 2024-08-20 01:57:53.322740219 +0000 UTC m=+0.097529665 container create 095c96d6d3915555b283280c87fc6039353386f725a7caef9de7696da7518eee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-20T01:57:53.585 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:53 smithi175 podman[59150]: 2024-08-20 01:57:53.240675761 +0000 UTC m=+0.015465176 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T01:57:53.585 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:53 smithi175 podman[59150]: 2024-08-20 01:57:53.516413671 +0000 UTC m=+0.291203084 container init 095c96d6d3915555b283280c87fc6039353386f725a7caef9de7696da7518eee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-08-20T01:57:53.585 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:53 smithi175 podman[59150]: 2024-08-20 01:57:53.519802421 +0000 UTC m=+0.294591827 container start 095c96d6d3915555b283280c87fc6039353386f725a7caef9de7696da7518eee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11-deactivate, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-08-20T01:57:53.889 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:53 smithi175 podman[59150]: 2024-08-20 01:57:53.583010403 +0000 UTC m=+0.357799816 container attach 095c96d6d3915555b283280c87fc6039353386f725a7caef9de7696da7518eee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T01:57:53.889 INFO:journalctl@ceph.osd.11.smithi175.stdout:Aug 20 01:57:53 smithi175 podman[59150]: 2024-08-20 01:57:53.708752142 +0000 UTC m=+0.483541547 container died 095c96d6d3915555b283280c87fc6039353386f725a7caef9de7696da7518eee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-osd-11-deactivate, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-20T01:57:54.295 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@osd.11.service' 2024-08-20T01:57:54.335 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:57:54.336 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-08-20T01:57:54.336 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-08-20T01:57:54.336 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mds.a 2024-08-20T01:57:54.633 INFO:journalctl@ceph.mds.a.smithi079.stdout:Aug 20 01:57:54 smithi079 systemd[1]: Stopping Ceph mds.a for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:57:54.937 INFO:journalctl@ceph.mds.a.smithi079.stdout:Aug 20 01:57:54 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-a[58672]: 2024-08-20T01:57:54.630+0000 7f9fc5a49640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:57:54.937 INFO:journalctl@ceph.mds.a.smithi079.stdout:Aug 20 01:57:54 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-a[58672]: 2024-08-20T01:57:54.630+0000 7f9fc5a49640 -1 mds.a *** got signal Terminated *** 2024-08-20T01:57:58.099 INFO:journalctl@ceph.mds.a.smithi079.stdout:Aug 20 01:57:57 smithi079 podman[151071]: 2024-08-20 01:57:57.826773836 +0000 UTC m=+3.297317535 container died 833c34652cfc382bd8141a5927acb067f915feeac1667341c7978ea9de1c2e7b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T01:57:58.437 INFO:journalctl@ceph.mds.a.smithi079.stdout:Aug 20 01:57:58 smithi079 podman[151071]: 2024-08-20 01:57:58.280320307 +0000 UTC m=+3.750863995 container cleanup 833c34652cfc382bd8141a5927acb067f915feeac1667341c7978ea9de1c2e7b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-a, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-20T01:57:58.437 INFO:journalctl@ceph.mds.a.smithi079.stdout:Aug 20 01:57:58 smithi079 bash[151071]: ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-a 2024-08-20T01:57:58.711 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mds.a.service' 2024-08-20T01:57:58.744 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:57:58.744 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-08-20T01:57:58.745 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-08-20T01:57:58.745 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mds.d 2024-08-20T01:57:59.187 INFO:journalctl@ceph.mds.d.smithi079.stdout:Aug 20 01:57:58 smithi079 systemd[1]: Stopping Ceph mds.d for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:57:59.187 INFO:journalctl@ceph.mds.d.smithi079.stdout:Aug 20 01:57:59 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-d[57578]: 2024-08-20T01:57:59.051+0000 7f73ea6e5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:57:59.187 INFO:journalctl@ceph.mds.d.smithi079.stdout:Aug 20 01:57:59 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-d[57578]: 2024-08-20T01:57:59.051+0000 7f73ea6e5640 -1 mds.d *** got signal Terminated *** 2024-08-20T01:58:03.354 INFO:journalctl@ceph.mds.d.smithi079.stdout:Aug 20 01:58:03 smithi079 podman[151189]: 2024-08-20 01:58:03.065364121 +0000 UTC m=+4.108270932 container died c62e0325de33938b683824a204df249f1f4f75c92bb237187ec6704d3076d9e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-d, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-20T01:58:03.687 INFO:journalctl@ceph.mds.d.smithi079.stdout:Aug 20 01:58:03 smithi079 podman[151189]: 2024-08-20 01:58:03.526044718 +0000 UTC m=+4.568951528 container cleanup c62e0325de33938b683824a204df249f1f4f75c92bb237187ec6704d3076d9e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_CLEAN=True) 2024-08-20T01:58:03.687 INFO:journalctl@ceph.mds.d.smithi079.stdout:Aug 20 01:58:03 smithi079 bash[151189]: ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-d 2024-08-20T01:58:03.955 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mds.d.service' 2024-08-20T01:58:03.989 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:58:03.989 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-08-20T01:58:03.989 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-08-20T01:58:03.990 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mds.g 2024-08-20T01:58:04.437 INFO:journalctl@ceph.mds.g.smithi079.stdout:Aug 20 01:58:04 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-g[58353]: 2024-08-20T01:58:04.304+0000 7f8837995640 -1 mds.g *** got signal Terminated *** 2024-08-20T01:58:06.090 INFO:journalctl@ceph.mds.g.smithi079.stdout:Aug 20 01:58:05 smithi079 podman[151323]: 2024-08-20 01:58:05.820598902 +0000 UTC m=+1.621207113 container died d8192a226ede5bc9c91a355badbf75f3fca8ce6f4d3c456417ab37f764d76cce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-g, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, org.label-schema.license=GPLv2) 2024-08-20T01:58:06.437 INFO:journalctl@ceph.mds.g.smithi079.stdout:Aug 20 01:58:06 smithi079 podman[151323]: 2024-08-20 01:58:06.280169807 +0000 UTC m=+2.080778014 container cleanup d8192a226ede5bc9c91a355badbf75f3fca8ce6f4d3c456417ab37f764d76cce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-08-20T01:58:06.437 INFO:journalctl@ceph.mds.g.smithi079.stdout:Aug 20 01:58:06 smithi079 bash[151323]: ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-g 2024-08-20T01:58:06.758 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mds.g.service' 2024-08-20T01:58:06.793 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:58:06.794 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-08-20T01:58:06.794 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-08-20T01:58:06.794 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mds.j 2024-08-20T01:58:07.187 INFO:journalctl@ceph.mds.j.smithi079.stdout:Aug 20 01:58:06 smithi079 systemd[1]: Stopping Ceph mds.j for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:58:07.187 INFO:journalctl@ceph.mds.j.smithi079.stdout:Aug 20 01:58:07 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-j[57169]: 2024-08-20T01:58:07.102+0000 7f0accd70640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:58:07.187 INFO:journalctl@ceph.mds.j.smithi079.stdout:Aug 20 01:58:07 smithi079 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-j[57169]: 2024-08-20T01:58:07.102+0000 7f0accd70640 -1 mds.j *** got signal Terminated *** 2024-08-20T01:58:08.687 INFO:journalctl@ceph.mds.j.smithi079.stdout:Aug 20 01:58:08 smithi079 podman[151447]: 2024-08-20 01:58:08.36436935 +0000 UTC m=+1.356495544 container died d45e53552b35f55490845b64659b76d8a60a47c83c540720447468d44a6c0044 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-j, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T01:58:09.106 INFO:journalctl@ceph.mds.j.smithi079.stdout:Aug 20 01:58:08 smithi079 podman[151447]: 2024-08-20 01:58:08.861549192 +0000 UTC m=+1.853675341 container cleanup d45e53552b35f55490845b64659b76d8a60a47c83c540720447468d44a6c0044 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-j, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD) 2024-08-20T01:58:09.106 INFO:journalctl@ceph.mds.j.smithi079.stdout:Aug 20 01:58:08 smithi079 bash[151447]: ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-j 2024-08-20T01:58:09.222 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mds.j.service' 2024-08-20T01:58:09.255 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:58:09.255 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-08-20T01:58:09.255 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-08-20T01:58:09.255 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mds.b 2024-08-20T01:58:09.552 INFO:journalctl@ceph.mds.b.smithi081.stdout:Aug 20 01:58:09 smithi081 systemd[1]: Stopping Ceph mds.b for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:58:09.552 INFO:journalctl@ceph.mds.b.smithi081.stdout:Aug 20 01:58:09 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-b[51985]: 2024-08-20T01:58:09.519+0000 7fd09227d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:58:09.552 INFO:journalctl@ceph.mds.b.smithi081.stdout:Aug 20 01:58:09 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-b[51985]: 2024-08-20T01:58:09.519+0000 7fd09227d640 -1 mds.b *** got signal Terminated *** 2024-08-20T01:58:13.798 INFO:journalctl@ceph.mds.b.smithi081.stdout:Aug 20 01:58:13 smithi081 podman[59111]: 2024-08-20 01:58:13.533467707 +0000 UTC m=+4.087121534 container died a428163ca8fbb70e5e998377c21750e78a6738c87cb22bd89ce6509190c4f4d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T01:58:14.056 INFO:journalctl@ceph.mds.b.smithi081.stdout:Aug 20 01:58:13 smithi081 podman[59111]: 2024-08-20 01:58:13.869588665 +0000 UTC m=+4.423242490 container cleanup a428163ca8fbb70e5e998377c21750e78a6738c87cb22bd89ce6509190c4f4d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-b, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-08-20T01:58:14.056 INFO:journalctl@ceph.mds.b.smithi081.stdout:Aug 20 01:58:13 smithi081 bash[59111]: ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-b 2024-08-20T01:58:14.304 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mds.b.service' 2024-08-20T01:58:14.327 INFO:journalctl@ceph.mds.b.smithi081.stdout:Aug 20 01:58:14 smithi081 podman[59136]: 2024-08-20 01:58:14.054162598 +0000 UTC m=+0.517926660 container remove a428163ca8fbb70e5e998377c21750e78a6738c87cb22bd89ce6509190c4f4d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-b, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-08-20T01:58:14.327 INFO:journalctl@ceph.mds.b.smithi081.stdout:Aug 20 01:58:14 smithi081 systemd[1]: ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mds.b.service: Deactivated successfully. 2024-08-20T01:58:14.327 INFO:journalctl@ceph.mds.b.smithi081.stdout:Aug 20 01:58:14 smithi081 systemd[1]: Stopped Ceph mds.b for 28484e9a-5e93-11ef-bccf-c7b262605968. 2024-08-20T01:58:14.327 INFO:journalctl@ceph.mds.b.smithi081.stdout:Aug 20 01:58:14 smithi081 systemd[1]: ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mds.b.service: Consumed 14.712s CPU time. 2024-08-20T01:58:14.340 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:58:14.341 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-08-20T01:58:14.341 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-08-20T01:58:14.341 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mds.e 2024-08-20T01:58:14.692 INFO:journalctl@ceph.mds.e.smithi081.stdout:Aug 20 01:58:14 smithi081 systemd[1]: Stopping Ceph mds.e for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:58:15.028 INFO:journalctl@ceph.mds.e.smithi081.stdout:Aug 20 01:58:14 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-e[51369]: 2024-08-20T01:58:14.690+0000 7f1b91efc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:58:15.028 INFO:journalctl@ceph.mds.e.smithi081.stdout:Aug 20 01:58:14 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-e[51369]: 2024-08-20T01:58:14.690+0000 7f1b91efc640 -1 mds.e *** got signal Terminated *** 2024-08-20T01:58:18.010 INFO:journalctl@ceph.mds.e.smithi081.stdout:Aug 20 01:58:17 smithi081 podman[59244]: 2024-08-20 01:58:17.743380443 +0000 UTC m=+3.191362320 container died 2bed42758d3d21a337cd2cddfb7f0849808656111f686394960dd3e65e587fe1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.36.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-08-20T01:58:18.278 INFO:journalctl@ceph.mds.e.smithi081.stdout:Aug 20 01:58:18 smithi081 podman[59244]: 2024-08-20 01:58:18.106682938 +0000 UTC m=+3.554664814 container cleanup 2bed42758d3d21a337cd2cddfb7f0849808656111f686394960dd3e65e587fe1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-e, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-20T01:58:18.278 INFO:journalctl@ceph.mds.e.smithi081.stdout:Aug 20 01:58:18 smithi081 bash[59244]: ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-e 2024-08-20T01:58:18.548 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mds.e.service' 2024-08-20T01:58:18.581 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:58:18.581 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-08-20T01:58:18.581 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-08-20T01:58:18.581 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mds.h 2024-08-20T01:58:19.028 INFO:journalctl@ceph.mds.h.smithi081.stdout:Aug 20 01:58:18 smithi081 systemd[1]: Stopping Ceph mds.h for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:58:19.028 INFO:journalctl@ceph.mds.h.smithi081.stdout:Aug 20 01:58:18 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-h[51670]: 2024-08-20T01:58:18.902+0000 7fd2fcaf2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:58:19.028 INFO:journalctl@ceph.mds.h.smithi081.stdout:Aug 20 01:58:18 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-h[51670]: 2024-08-20T01:58:18.902+0000 7fd2fcaf2640 -1 mds.h *** got signal Terminated *** 2024-08-20T01:58:22.013 INFO:journalctl@ceph.mds.h.smithi081.stdout:Aug 20 01:58:21 smithi081 podman[59365]: 2024-08-20 01:58:21.747258902 +0000 UTC m=+2.946950337 container died 5aca4c06d84130d555b777738b3b1b934a6f58fae5ee24acf2fbdf9ef2ed0148 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T01:58:22.278 INFO:journalctl@ceph.mds.h.smithi081.stdout:Aug 20 01:58:22 smithi081 podman[59365]: 2024-08-20 01:58:22.103093026 +0000 UTC m=+3.302784457 container cleanup 5aca4c06d84130d555b777738b3b1b934a6f58fae5ee24acf2fbdf9ef2ed0148 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-h, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T01:58:22.278 INFO:journalctl@ceph.mds.h.smithi081.stdout:Aug 20 01:58:22 smithi081 bash[59365]: ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-h 2024-08-20T01:58:22.535 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mds.h.service' 2024-08-20T01:58:22.566 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:58:22.566 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-08-20T01:58:22.567 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-08-20T01:58:22.567 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mds.k 2024-08-20T01:58:23.028 INFO:journalctl@ceph.mds.k.smithi081.stdout:Aug 20 01:58:22 smithi081 systemd[1]: Stopping Ceph mds.k for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:58:23.028 INFO:journalctl@ceph.mds.k.smithi081.stdout:Aug 20 01:58:22 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-k[51054]: 2024-08-20T01:58:22.881+0000 7f1713656640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:58:23.028 INFO:journalctl@ceph.mds.k.smithi081.stdout:Aug 20 01:58:22 smithi081 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-k[51054]: 2024-08-20T01:58:22.881+0000 7f1713656640 -1 mds.k *** got signal Terminated *** 2024-08-20T01:58:26.025 INFO:journalctl@ceph.mds.k.smithi081.stdout:Aug 20 01:58:25 smithi081 podman[59485]: 2024-08-20 01:58:25.742227891 +0000 UTC m=+2.966359479 container died ef9bfcfd23454b3f76f018ecabed6a982a95ec765371da22fef6ac6125e986e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-k, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0) 2024-08-20T01:58:26.278 INFO:journalctl@ceph.mds.k.smithi081.stdout:Aug 20 01:58:26 smithi081 podman[59485]: 2024-08-20 01:58:26.114952291 +0000 UTC m=+3.339083878 container cleanup ef9bfcfd23454b3f76f018ecabed6a982a95ec765371da22fef6ac6125e986e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-k, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-20T01:58:26.278 INFO:journalctl@ceph.mds.k.smithi081.stdout:Aug 20 01:58:26 smithi081 bash[59485]: ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-k 2024-08-20T01:58:26.545 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mds.k.service' 2024-08-20T01:58:26.576 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:58:26.577 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-08-20T01:58:26.577 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-08-20T01:58:26.577 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mds.c 2024-08-20T01:58:26.870 INFO:journalctl@ceph.mds.c.smithi175.stdout:Aug 20 01:58:26 smithi175 systemd[1]: Stopping Ceph mds.c for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:58:27.126 INFO:journalctl@ceph.mds.c.smithi175.stdout:Aug 20 01:58:26 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-c[52287]: 2024-08-20T01:58:26.867+0000 7f307abf4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:58:27.127 INFO:journalctl@ceph.mds.c.smithi175.stdout:Aug 20 01:58:26 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-c[52287]: 2024-08-20T01:58:26.867+0000 7f307abf4640 -1 mds.c *** got signal Terminated *** 2024-08-20T01:58:30.011 INFO:journalctl@ceph.mds.c.smithi175.stdout:Aug 20 01:58:29 smithi175 podman[59253]: 2024-08-20 01:58:29.73056267 +0000 UTC m=+2.969507058 container died 0c8a3553794ec926269aac307784216658410c0217c3c30b1f40d8a8962d2f79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-c, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-20T01:58:30.345 INFO:journalctl@ceph.mds.c.smithi175.stdout:Aug 20 01:58:30 smithi175 podman[59253]: 2024-08-20 01:58:30.092329597 +0000 UTC m=+3.331274024 container cleanup 0c8a3553794ec926269aac307784216658410c0217c3c30b1f40d8a8962d2f79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-c, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-08-20T01:58:30.345 INFO:journalctl@ceph.mds.c.smithi175.stdout:Aug 20 01:58:30 smithi175 bash[59253]: ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-c 2024-08-20T01:58:30.477 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mds.c.service' 2024-08-20T01:58:30.513 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:58:30.513 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-08-20T01:58:30.514 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-08-20T01:58:30.514 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mds.f 2024-08-20T01:58:30.639 INFO:journalctl@ceph.mds.f.smithi175.stdout:Aug 20 01:58:30 smithi175 systemd[1]: Stopping Ceph mds.f for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:58:31.139 INFO:journalctl@ceph.mds.f.smithi175.stdout:Aug 20 01:58:30 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-f[51984]: 2024-08-20T01:58:30.829+0000 7f3157194640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:58:31.139 INFO:journalctl@ceph.mds.f.smithi175.stdout:Aug 20 01:58:30 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-f[51984]: 2024-08-20T01:58:30.829+0000 7f3157194640 -1 mds.f *** got signal Terminated *** 2024-08-20T01:58:34.024 INFO:journalctl@ceph.mds.f.smithi175.stdout:Aug 20 01:58:33 smithi175 podman[59383]: 2024-08-20 01:58:33.738288246 +0000 UTC m=+3.011994450 container died 03c0cd0b89f4b043a006d8570e51b764c2e6f9bbd0c0c435b0ce3e5b7b93e176 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-f, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, maintainer=Guillaume Abrioux ) 2024-08-20T01:58:34.365 INFO:journalctl@ceph.mds.f.smithi175.stdout:Aug 20 01:58:34 smithi175 podman[59383]: 2024-08-20 01:58:34.095458452 +0000 UTC m=+3.369164658 container cleanup 03c0cd0b89f4b043a006d8570e51b764c2e6f9bbd0c0c435b0ce3e5b7b93e176 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-f, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True) 2024-08-20T01:58:34.365 INFO:journalctl@ceph.mds.f.smithi175.stdout:Aug 20 01:58:34 smithi175 bash[59383]: ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-f 2024-08-20T01:58:34.498 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mds.f.service' 2024-08-20T01:58:34.532 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:58:34.532 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-08-20T01:58:34.532 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-08-20T01:58:34.532 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mds.i 2024-08-20T01:58:34.639 INFO:journalctl@ceph.mds.i.smithi175.stdout:Aug 20 01:58:34 smithi175 systemd[1]: Stopping Ceph mds.i for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:58:35.139 INFO:journalctl@ceph.mds.i.smithi175.stdout:Aug 20 01:58:34 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-i[52590]: 2024-08-20T01:58:34.849+0000 7fefb8bfc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:58:35.139 INFO:journalctl@ceph.mds.i.smithi175.stdout:Aug 20 01:58:34 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-i[52590]: 2024-08-20T01:58:34.849+0000 7fefb8bfc640 -1 mds.i *** got signal Terminated *** 2024-08-20T01:58:37.889 INFO:journalctl@ceph.mds.i.smithi175.stdout:Aug 20 01:58:37 smithi175 podman[59505]: 2024-08-20 01:58:37.735607125 +0000 UTC m=+2.989204171 container died 62a2ffb0d5a18d1d55df3b17cc50935f8a1eaf8e0e3b820ce2c1fa4fd446dc6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-i, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-20T01:58:38.343 INFO:journalctl@ceph.mds.i.smithi175.stdout:Aug 20 01:58:38 smithi175 podman[59505]: 2024-08-20 01:58:38.140816124 +0000 UTC m=+3.394413172 container cleanup 62a2ffb0d5a18d1d55df3b17cc50935f8a1eaf8e0e3b820ce2c1fa4fd446dc6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-i, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_CLEAN=True) 2024-08-20T01:58:38.343 INFO:journalctl@ceph.mds.i.smithi175.stdout:Aug 20 01:58:38 smithi175 bash[59505]: ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-i 2024-08-20T01:58:38.476 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mds.i.service' 2024-08-20T01:58:38.509 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:58:38.509 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-08-20T01:58:38.509 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-08-20T01:58:38.509 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mds.l 2024-08-20T01:58:38.639 INFO:journalctl@ceph.mds.l.smithi175.stdout:Aug 20 01:58:38 smithi175 systemd[1]: Stopping Ceph mds.l for 28484e9a-5e93-11ef-bccf-c7b262605968... 2024-08-20T01:58:39.139 INFO:journalctl@ceph.mds.l.smithi175.stdout:Aug 20 01:58:38 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-l[51679]: 2024-08-20T01:58:38.819+0000 7f6ddff4a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T01:58:39.139 INFO:journalctl@ceph.mds.l.smithi175.stdout:Aug 20 01:58:38 smithi175 ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-l[51679]: 2024-08-20T01:58:38.819+0000 7f6ddff4a640 -1 mds.l *** got signal Terminated *** 2024-08-20T01:58:42.003 INFO:journalctl@ceph.mds.l.smithi175.stdout:Aug 20 01:58:41 smithi175 podman[59625]: 2024-08-20 01:58:41.739076588 +0000 UTC m=+3.017604811 container died fd8ed55dd4270e8150ce830b3a0c11469ee81443c104d5961afe7f6505b3c680 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-l, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-20T01:58:42.004 INFO:journalctl@ceph.mds.l.smithi175.stdout:Aug 20 01:58:42 smithi175 podman[59625]: 2024-08-20 01:58:42.002179917 +0000 UTC m=+3.280708140 container cleanup fd8ed55dd4270e8150ce830b3a0c11469ee81443c104d5961afe7f6505b3c680 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-l, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0) 2024-08-20T01:58:42.254 INFO:journalctl@ceph.mds.l.smithi175.stdout:Aug 20 01:58:42 smithi175 bash[59625]: ceph-28484e9a-5e93-11ef-bccf-c7b262605968-mds-l 2024-08-20T01:58:42.424 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-28484e9a-5e93-11ef-bccf-c7b262605968@mds.l.service' 2024-08-20T01:58:42.455 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T01:58:42.455 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-08-20T01:58:42.456 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 --force --keep-logs 2024-08-20T01:58:42.656 INFO:teuthology.orchestra.run.smithi079.stdout:Deleting cluster with fsid: 28484e9a-5e93-11ef-bccf-c7b262605968 2024-08-20T01:58:45.256 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 --force --keep-logs 2024-08-20T01:58:45.458 INFO:teuthology.orchestra.run.smithi081.stdout:Deleting cluster with fsid: 28484e9a-5e93-11ef-bccf-c7b262605968 2024-08-20T01:58:47.922 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 --force --keep-logs 2024-08-20T01:58:48.123 INFO:teuthology.orchestra.run.smithi175.stdout:Deleting cluster with fsid: 28484e9a-5e93-11ef-bccf-c7b262605968 2024-08-20T01:58:50.432 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-20T01:58:50.466 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-20T01:58:50.499 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-20T01:58:50.526 INFO:tasks.cephadm:Archiving crash dumps... 2024-08-20T01:58:50.529 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-08-19_19:57:23-fs-wip-hemanth-testing-2024-08-19-1357-distro-default-smithi/7861331/remote/smithi079/crash 2024-08-20T01:58:50.529 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/crash -- . 2024-08-20T01:58:50.595 INFO:teuthology.orchestra.run.smithi079.stderr:tar: /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/crash: Cannot open: No such file or directory 2024-08-20T01:58:50.595 INFO:teuthology.orchestra.run.smithi079.stderr:tar: Error is not recoverable: exiting now 2024-08-20T01:58:50.597 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-08-19_19:57:23-fs-wip-hemanth-testing-2024-08-19-1357-distro-default-smithi/7861331/remote/smithi081/crash 2024-08-20T01:58:50.598 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/crash -- . 2024-08-20T01:58:50.668 INFO:teuthology.orchestra.run.smithi081.stderr:tar: /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/crash: Cannot open: No such file or directory 2024-08-20T01:58:50.668 INFO:teuthology.orchestra.run.smithi081.stderr:tar: Error is not recoverable: exiting now 2024-08-20T01:58:50.670 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-08-19_19:57:23-fs-wip-hemanth-testing-2024-08-19-1357-distro-default-smithi/7861331/remote/smithi175/crash 2024-08-20T01:58:50.671 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/crash -- . 2024-08-20T01:58:50.716 INFO:teuthology.orchestra.run.smithi175.stderr:tar: /var/lib/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/crash: Cannot open: No such file or directory 2024-08-20T01:58:50.717 INFO:teuthology.orchestra.run.smithi175.stderr:tar: Error is not recoverable: exiting now 2024-08-20T01:58:50.718 INFO:tasks.cephadm:Checking cluster log for badness... 2024-08-20T01:58:50.718 DEBUG:teuthology.orchestra.run.smithi079:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-08-20T01:58:50.811 INFO:teuthology.orchestra.run.smithi079.stdout:2024-08-20T01:51:11.528435+0000 mon.a (mon.0) 1270 : cluster [WRN] Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-08-20T01:58:50.812 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-08-20T01:58:50.813 DEBUG:teuthology.orchestra.run.smithi079:> sudo egrep '\[SEC\]' /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-08-20T01:58:50.849 DEBUG:teuthology.orchestra.run.smithi079:> sudo egrep '\[ERR\]' /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-08-20T01:58:50.924 DEBUG:teuthology.orchestra.run.smithi079:> sudo egrep '\[WRN\]' /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-08-20T01:58:50.997 INFO:teuthology.orchestra.run.smithi079.stdout:2024-08-20T01:51:11.528435+0000 mon.a (mon.0) 1270 : cluster [WRN] Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-08-20T01:58:50.998 INFO:tasks.cephadm:Compressing logs... 2024-08-20T01:58:50.998 DEBUG:teuthology.orchestra.run.smithi079:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-20T01:58:51.042 DEBUG:teuthology.orchestra.run.smithi081:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-20T01:58:51.044 DEBUG:teuthology.orchestra.run.smithi175:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-20T01:58:51.071 INFO:teuthology.orchestra.run.smithi175.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-20T01:58:51.071 INFO:teuthology.orchestra.run.smithi175.stderr:: No such file or directory 2024-08-20T01:58:51.071 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph.audit.log 2024-08-20T01:58:51.071 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-osd.2.log 2024-08-20T01:58:51.071 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-osd.8.log 2024-08-20T01:58:51.072 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mgr.z.log 2024-08-20T01:58:51.078 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-osd.5.log 2024-08-20T01:58:51.078 INFO:teuthology.orchestra.run.smithi175.stderr: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-20T01:58:51.078 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mds.c.log 2024-08-20T01:58:51.078 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mds.f.log 2024-08-20T01:58:51.078 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-osd.11.log 2024-08-20T01:58:51.078 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mds.i.log 2024-08-20T01:58:51.078 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-osd.11.log: 90.5% -- replaced with /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph.audit.log.gz 2024-08-20T01:58:51.078 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph.cephadm.log 2024-08-20T01:58:51.079 INFO:teuthology.orchestra.run.smithi081.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-08-20T01:58:51.079 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-20T01:58:51.079 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-osd.4.log 2024-08-20T01:58:51.079 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph.audit.log 2024-08-20T01:58:51.079 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-osd.1.log 2024-08-20T01:58:51.079 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-osd.4.log: /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mon.b.log 2024-08-20T01:58:51.079 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-osd.1.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-20T01:58:51.080 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mds.h.log 2024-08-20T01:58:51.080 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-osd.10.log 2024-08-20T01:58:51.080 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mon.b.log: /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mds.k.log 2024-08-20T01:58:51.080 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mgr.y.log 2024-08-20T01:58:51.080 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph.cephadm.log 2024-08-20T01:58:51.080 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mgr.y.log: 90.5% -- replaced with /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph.audit.log.gz 2024-08-20T01:58:51.080 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mds.i.log: 93.1% -- replaced with /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mgr.z.log.gz 2024-08-20T01:58:51.084 INFO:teuthology.orchestra.run.smithi081.stderr: 93.0% -- replaced with /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mgr.y.log.gz 2024-08-20T01:58:51.087 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mds.e.log 2024-08-20T01:58:51.087 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-volume.log 83.6% -- replaced with /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph.cephadm.log.gz 2024-08-20T01:58:51.087 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-08-20T01:58:51.087 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-osd.7.log 2024-08-20T01:58:51.089 INFO:teuthology.orchestra.run.smithi079.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-08-20T01:58:51.096 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-volume.log 2024-08-20T01:58:51.096 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph.cephadm.log: 83.6% -- replaced with /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph.cephadm.log.gz 2024-08-20T01:58:51.097 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-20T01:58:51.099 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph.audit.log 2024-08-20T01:58:51.099 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-osd.6.log 2024-08-20T01:58:51.100 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mds.g.log 2024-08-20T01:58:51.100 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mds.d.log 2024-08-20T01:58:51.100 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-osd.0.log 2024-08-20T01:58:51.100 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mgr.x.log 2024-08-20T01:58:51.100 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-osd.3.log 2024-08-20T01:58:51.100 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mon.a.log 2024-08-20T01:58:51.101 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-volume.log: /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mds.b.log 2024-08-20T01:58:51.101 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-osd.7.log: 90.8% -- replaced with /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-volume.log.gz 2024-08-20T01:58:51.103 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mds.a.log 2024-08-20T01:58:51.103 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mds.j.log 2024-08-20T01:58:51.103 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-osd.9.log 2024-08-20T01:58:51.103 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph.cephadm.log 2024-08-20T01:58:51.103 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-volume.log 2024-08-20T01:58:51.103 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph.log 2024-08-20T01:58:51.104 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-08-20T01:58:51.104 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph.log: /var/log/ceph/ceph-client.0.log: 87.4% -- replaced with /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph.log.gz 2024-08-20T01:58:51.105 INFO:teuthology.orchestra.run.smithi079.stderr: 95.0% -- replaced with /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mds.d.log.gz 2024-08-20T01:58:51.106 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph.log 2024-08-20T01:58:51.107 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mds.l.log 2024-08-20T01:58:51.120 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-volume.log: 90.8% -- replaced with /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-volume.log.gz 2024-08-20T01:58:51.121 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mon.c.log 2024-08-20T01:58:51.129 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mds.b.log: /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph.log: 87.4% -- replaced with /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph.log.gz 2024-08-20T01:58:51.130 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph.log 2024-08-20T01:58:51.152 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mon.c.log: /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph.log: 87.4% -- replaced with /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph.log.gz 2024-08-20T01:58:51.170 INFO:teuthology.orchestra.run.smithi079.stderr: 83.1% -- replaced with /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph.cephadm.log.gz 2024-08-20T01:58:51.236 INFO:teuthology.orchestra.run.smithi079.stderr: 90.3% -- replaced with /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph.audit.log.gz 2024-08-20T01:58:51.242 INFO:teuthology.orchestra.run.smithi081.stderr: 94.1% -- replaced with /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mds.k.log.gz 2024-08-20T01:58:51.300 INFO:teuthology.orchestra.run.smithi079.stderr: 95.1% -- replaced with /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mds.j.log.gz 2024-08-20T01:58:51.373 INFO:teuthology.orchestra.run.smithi081.stderr: 94.0% -- replaced with /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mds.e.log.gz 2024-08-20T01:58:51.487 INFO:teuthology.orchestra.run.smithi079.stderr: 94.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-20T01:58:51.614 INFO:teuthology.orchestra.run.smithi079.stderr: 90.8% -- replaced with /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-volume.log.gz 2024-08-20T01:58:51.695 INFO:teuthology.orchestra.run.smithi175.stderr: 94.3% -- replaced with /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mds.l.log.gz 2024-08-20T01:58:51.718 INFO:teuthology.orchestra.run.smithi081.stderr: 91.5% -- replaced with /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mon.b.log.gz 2024-08-20T01:58:51.876 INFO:teuthology.orchestra.run.smithi175.stderr: 91.6% -- replaced with /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mon.c.log.gz 2024-08-20T01:58:51.961 INFO:teuthology.orchestra.run.smithi175.stderr: 92.7% -- replaced with /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mds.c.log.gz 2024-08-20T01:58:52.164 INFO:teuthology.orchestra.run.smithi081.stderr: 93.0% -- replaced with /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mds.h.log.gz 2024-08-20T01:58:52.168 INFO:teuthology.orchestra.run.smithi079.stderr: 93.7% -- replaced with /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mds.a.log.gz 2024-08-20T01:58:52.452 INFO:teuthology.orchestra.run.smithi079.stderr: 93.6% -- replaced with /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mds.g.log.gz 2024-08-20T01:58:52.681 INFO:teuthology.orchestra.run.smithi175.stderr: 93.4% -- replaced with /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mds.f.log.gz 2024-08-20T01:58:53.086 INFO:teuthology.orchestra.run.smithi175.stderr: 92.9% -- replaced with /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mds.i.log.gz 2024-08-20T01:58:53.323 INFO:teuthology.orchestra.run.smithi079.stderr: 90.3% -- replaced with /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mgr.x.log.gz 2024-08-20T01:58:57.035 INFO:teuthology.orchestra.run.smithi081.stderr: 93.4% -- replaced with /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mds.b.log.gz 2024-08-20T01:58:59.875 INFO:teuthology.orchestra.run.smithi079.stderr: 90.2% -- replaced with /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-mon.a.log.gz 2024-08-20T01:59:02.053 INFO:teuthology.orchestra.run.smithi081.stderr: 92.8% -- replaced with /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-osd.4.log.gz 2024-08-20T01:59:04.280 INFO:teuthology.orchestra.run.smithi175.stderr: 92.9% -- replaced with /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-osd.8.log.gz 2024-08-20T01:59:04.441 INFO:teuthology.orchestra.run.smithi175.stderr: 92.9% -- replaced with /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-osd.2.log.gz 2024-08-20T01:59:05.176 INFO:teuthology.orchestra.run.smithi081.stderr: 92.9% -- replaced with /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-osd.10.log.gz 2024-08-20T01:59:05.457 INFO:teuthology.orchestra.run.smithi175.stderr: 92.8% -- replaced with /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-osd.5.log.gz 2024-08-20T01:59:08.472 INFO:teuthology.orchestra.run.smithi175.stderr: 93.0% -- replaced with /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-osd.11.log.gz 2024-08-20T01:59:08.475 INFO:teuthology.orchestra.run.smithi175.stderr: 2024-08-20T01:59:08.475 INFO:teuthology.orchestra.run.smithi175.stderr:real 0m17.414s 2024-08-20T01:59:08.475 INFO:teuthology.orchestra.run.smithi175.stderr:user 1m1.316s 2024-08-20T01:59:08.475 INFO:teuthology.orchestra.run.smithi175.stderr:sys 0m2.232s 2024-08-20T01:59:09.716 INFO:teuthology.orchestra.run.smithi081.stderr: 93.0% -- replaced with /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-osd.7.log.gz 2024-08-20T01:59:09.810 INFO:teuthology.orchestra.run.smithi081.stderr: 92.8% -- replaced with /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-osd.1.log.gz 2024-08-20T01:59:09.812 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-08-20T01:59:09.812 INFO:teuthology.orchestra.run.smithi081.stderr:real 0m18.752s 2024-08-20T01:59:09.812 INFO:teuthology.orchestra.run.smithi081.stderr:user 1m7.737s 2024-08-20T01:59:09.812 INFO:teuthology.orchestra.run.smithi081.stderr:sys 0m2.400s 2024-08-20T02:00:11.597 INFO:teuthology.orchestra.run.smithi079.stderr: 92.9% -- replaced with /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-osd.0.log.gz 2024-08-20T02:00:16.088 INFO:teuthology.orchestra.run.smithi079.stderr: 93.0% -- replaced with /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-osd.9.log.gz 2024-08-20T02:00:20.350 INFO:teuthology.orchestra.run.smithi079.stderr: 92.9% -- replaced with /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-osd.3.log.gz 2024-08-20T02:00:32.635 INFO:teuthology.orchestra.run.smithi079.stderr: 93.0% -- replaced with /var/log/ceph/28484e9a-5e93-11ef-bccf-c7b262605968/ceph-osd.6.log.gz 2024-08-20T02:03:11.311 INFO:teuthology.orchestra.run.smithi079.stderr: 95.7% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-08-20T02:03:11.313 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-08-20T02:03:11.313 INFO:teuthology.orchestra.run.smithi079.stderr:real 4m20.259s 2024-08-20T02:03:11.313 INFO:teuthology.orchestra.run.smithi079.stderr:user 3m38.495s 2024-08-20T02:03:11.313 INFO:teuthology.orchestra.run.smithi079.stderr:sys 0m9.725s 2024-08-20T02:03:11.314 INFO:tasks.cephadm:Archiving logs... 2024-08-20T02:03:11.315 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-08-19_19:57:23-fs-wip-hemanth-testing-2024-08-19-1357-distro-default-smithi/7861331/remote/smithi079/log 2024-08-20T02:03:11.316 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-20T02:03:43.601 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-08-19_19:57:23-fs-wip-hemanth-testing-2024-08-19-1357-distro-default-smithi/7861331/remote/smithi081/log 2024-08-20T02:03:43.602 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-20T02:03:53.806 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-08-19_19:57:23-fs-wip-hemanth-testing-2024-08-19-1357-distro-default-smithi/7861331/remote/smithi175/log 2024-08-20T02:03:53.807 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-20T02:04:04.850 INFO:tasks.cephadm:Removing cluster... 2024-08-20T02:04:04.851 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 --force 2024-08-20T02:04:05.053 INFO:teuthology.orchestra.run.smithi079.stdout:Deleting cluster with fsid: 28484e9a-5e93-11ef-bccf-c7b262605968 2024-08-20T02:04:05.399 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 --force 2024-08-20T02:04:05.602 INFO:teuthology.orchestra.run.smithi081.stdout:Deleting cluster with fsid: 28484e9a-5e93-11ef-bccf-c7b262605968 2024-08-20T02:04:06.033 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 28484e9a-5e93-11ef-bccf-c7b262605968 --force 2024-08-20T02:04:06.235 INFO:teuthology.orchestra.run.smithi175.stdout:Deleting cluster with fsid: 28484e9a-5e93-11ef-bccf-c7b262605968 2024-08-20T02:04:06.568 INFO:tasks.cephadm:Removing cephadm ... 2024-08-20T02:04:06.568 DEBUG:teuthology.orchestra.run.smithi079:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-20T02:04:06.588 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-20T02:04:06.605 DEBUG:teuthology.orchestra.run.smithi175:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-20T02:04:06.621 INFO:tasks.cephadm:Teardown complete 2024-08-20T02:04:06.621 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-20T02:04:06.632 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-20T02:04:06.632 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-20T02:04:06.635 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-20T02:04:06.647 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-20T02:04:06.845 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-20T02:04:06.855 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-20T02:04:06.855 DEBUG:teuthology.orchestra.run.smithi079:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-20T02:04:06.858 DEBUG:teuthology.orchestra.run.smithi081:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-20T02:04:06.860 DEBUG:teuthology.orchestra.run.smithi175:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-20T02:04:06.873 INFO:teuthology.orchestra.run.smithi081.stderr:bash: line 1: ntpq: command not found 2024-08-20T02:04:06.873 INFO:teuthology.orchestra.run.smithi079.stderr:bash: line 1: ntpq: command not found 2024-08-20T02:04:06.875 INFO:teuthology.orchestra.run.smithi175.stderr:bash: line 1: ntpq: command not found 2024-08-20T02:04:06.877 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-20T02:04:06.877 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2024-08-20T02:04:06.877 INFO:teuthology.orchestra.run.smithi081.stdout:^* hv01.front.sepia.ceph.com 3 6 377 9 -320us[ -310us] +/- 46ms 2024-08-20T02:04:06.877 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 12 +587us[ +596us] +/- 64ms 2024-08-20T02:04:06.878 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 10 -106us[ -96us] +/- 79ms 2024-08-20T02:04:06.878 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T02:04:06.879 INFO:teuthology.orchestra.run.smithi079.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-20T02:04:06.879 INFO:teuthology.orchestra.run.smithi079.stdout:=============================================================================== 2024-08-20T02:04:06.879 INFO:teuthology.orchestra.run.smithi079.stdout:^* hv01.front.sepia.ceph.com 3 6 377 10 -339us[ -337us] +/- 46ms 2024-08-20T02:04:06.879 INFO:teuthology.orchestra.run.smithi079.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 12 +564us[ +566us] +/- 64ms 2024-08-20T02:04:06.879 INFO:teuthology.orchestra.run.smithi079.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 7 -101us[ -101us] +/- 79ms 2024-08-20T02:04:06.880 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T02:04:06.880 INFO:teuthology.orchestra.run.smithi175.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-20T02:04:06.881 INFO:teuthology.orchestra.run.smithi175.stdout:=============================================================================== 2024-08-20T02:04:06.881 INFO:teuthology.orchestra.run.smithi175.stdout:^* hv01.front.sepia.ceph.com 3 6 377 12 -310us[ -288us] +/- 46ms 2024-08-20T02:04:06.881 INFO:teuthology.orchestra.run.smithi175.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 9 +614us[ +614us] +/- 64ms 2024-08-20T02:04:06.881 INFO:teuthology.orchestra.run.smithi175.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 9 -78us[ -78us] +/- 79ms 2024-08-20T02:04:06.881 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T02:04:06.881 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-20T02:04:06.891 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-20T02:04:06.891 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-20T02:04:06.901 DEBUG:teuthology.orchestra.run.smithi079:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-20T02:04:07.028 DEBUG:teuthology.orchestra.run.smithi081:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-20T02:04:07.082 DEBUG:teuthology.orchestra.run.smithi175:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-20T02:04:07.135 DEBUG:teuthology.orchestra.run.smithi079:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-20T02:04:07.166 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-20T02:04:07.166 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-20T02:04:07.192 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-20T02:04:07.193 DEBUG:teuthology.orchestra.run.smithi175:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-20T02:04:07.219 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-20T02:04:07.219 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-20T02:04:07.230 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-20T02:04:07.241 INFO:teuthology.task.internal:Duration was 2514.758918 seconds 2024-08-20T02:04:07.242 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-20T02:04:07.253 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-20T02:04:07.254 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-20T02:04:07.256 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-20T02:04:07.259 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-20T02:04:07.295 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-20T02:04:07.298 INFO:teuthology.orchestra.run.smithi175.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-20T02:04:07.333 INFO:teuthology.orchestra.run.smithi079.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-20T02:04:07.743 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-20T02:04:07.743 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi079.front.sepia.ceph.com 2024-08-20T02:04:07.743 DEBUG:teuthology.orchestra.run.smithi079:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-20T02:04:07.765 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi081.front.sepia.ceph.com 2024-08-20T02:04:07.765 DEBUG:teuthology.orchestra.run.smithi081:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-20T02:04:07.797 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi175.front.sepia.ceph.com 2024-08-20T02:04:07.798 DEBUG:teuthology.orchestra.run.smithi175:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-20T02:04:07.820 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-20T02:04:07.820 DEBUG:teuthology.orchestra.run.smithi079:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-20T02:04:07.822 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-20T02:04:07.840 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-20T02:04:07.887 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-20T02:04:07.888 DEBUG:teuthology.orchestra.run.smithi079:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-20T02:04:07.891 DEBUG:teuthology.orchestra.run.smithi081:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-20T02:04:07.908 DEBUG:teuthology.orchestra.run.smithi175:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-20T02:04:09.303 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-20T02:04:09.314 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-20T02:04:09.314 DEBUG:teuthology.orchestra.run.smithi079:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-20T02:04:09.355 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-20T02:04:09.385 DEBUG:teuthology.orchestra.run.smithi175:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-20T02:04:09.416 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-20T02:04:09.428 DEBUG:teuthology.orchestra.run.smithi079:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-20T02:04:09.430 DEBUG:teuthology.orchestra.run.smithi081:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-20T02:04:09.433 DEBUG:teuthology.orchestra.run.smithi175:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-20T02:04:09.458 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = core 2024-08-20T02:04:09.461 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = core 2024-08-20T02:04:09.482 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = core 2024-08-20T02:04:09.541 DEBUG:teuthology.orchestra.run.smithi079:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-20T02:04:09.556 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-20T02:04:09.556 DEBUG:teuthology.orchestra.run.smithi081:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-20T02:04:09.572 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-20T02:04:09.573 DEBUG:teuthology.orchestra.run.smithi175:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-20T02:04:09.598 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-20T02:04:09.598 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-20T02:04:09.614 INFO:teuthology.task.internal:Transferring archived files... 2024-08-20T02:04:09.616 DEBUG:teuthology.misc:Transferring archived files from smithi079:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-08-19_19:57:23-fs-wip-hemanth-testing-2024-08-19-1357-distro-default-smithi/7861331/remote/smithi079 2024-08-20T02:04:09.616 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-20T02:04:09.683 DEBUG:teuthology.misc:Transferring archived files from smithi081:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-08-19_19:57:23-fs-wip-hemanth-testing-2024-08-19-1357-distro-default-smithi/7861331/remote/smithi081 2024-08-20T02:04:09.684 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-20T02:04:09.721 DEBUG:teuthology.misc:Transferring archived files from smithi175:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-08-19_19:57:23-fs-wip-hemanth-testing-2024-08-19-1357-distro-default-smithi/7861331/remote/smithi175 2024-08-20T02:04:09.721 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-20T02:04:09.757 INFO:teuthology.task.internal:Removing archive directory... 2024-08-20T02:04:09.757 DEBUG:teuthology.orchestra.run.smithi079:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-20T02:04:09.759 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-20T02:04:09.762 DEBUG:teuthology.orchestra.run.smithi175:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-20T02:04:09.809 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-20T02:04:09.825 INFO:teuthology.task.internal:Not uploading archives. 2024-08-20T02:04:09.826 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-20T02:04:09.837 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-20T02:04:09.837 DEBUG:teuthology.orchestra.run.smithi079:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-20T02:04:09.840 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-20T02:04:09.842 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-20T02:04:09.852 INFO:teuthology.orchestra.run.smithi079.stdout: 262217 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 20 02:04 /home/ubuntu/cephtest 2024-08-20T02:04:09.856 INFO:teuthology.orchestra.run.smithi081.stdout: 262217 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 20 02:04 /home/ubuntu/cephtest 2024-08-20T02:04:09.866 INFO:teuthology.orchestra.run.smithi175.stdout: 262217 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 20 02:04 /home/ubuntu/cephtest 2024-08-20T02:04:09.867 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-20T02:04:09.879 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-20T02:04:09.909 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/ffsb}} duration: 2514.758917570114 failure_reason: '"2024-08-20T01:51:11.528435+0000 mon.a (mon.0) 1270 : cluster [WRN] Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT)" in cluster log' flavor: default owner: scheduled_hyelloji@teuthology success: false 2024-08-20T02:04:09.909 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-20T02:04:10.003 INFO:teuthology.run:FAIL